2023-10-03T09:56:07.365 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-03T09:56:07.365 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_dparmar@teuthology --archive /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573 --name dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi --description fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}} -- /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573/orig.config.yaml 2023-10-03T09:56:07.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T09:56:07.626 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573 branch: fix-nfs-apply-err-reporting description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}} email: null first_in_suite: false job_id: '7409573' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: fix-nfs-apply-err-reporting ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: dry_run: true install: ceph: flavor: default sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62953 sha1: a6297898cc696a7db13e71aaa0b24c78a4c800c5 owner: scheduled_dparmar@teuthology priority: 55 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 seed: 6051 sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 sleep_before_teardown: 0 suite: fs:upgrade suite_branch: wip-62953 suite_path: /home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa suite_relpath: qa suite_repo: https://github.com/dparmar18/ceph suite_sha1: a6297898cc696a7db13e71aaa0b24c78a4c800c5 targets: smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPfP9tnAMamE3Fl+b+77jHnwhMvEsyPJvhQeBm52/HeWDw4zKhS1nLPe+WvZ1BCeHtrP1rMdwfUOTRQ3u1vcOcM= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDdUQPzKTAiEAIAiiGvKrXKFTcQUH0/kbWZc2nUWH5/yuUO5D4vM9P02dkNXCqv3QvnHP5kU5YSVicX3N1foee8= tasks: - install: branch: pacific exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs - ceph-volume extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs extra_system_packages: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - print: '**** done installing pacific' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client pacific - print: '**** done ceph' - ceph-fuse: null - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: branch: reef - print: '**** done install.upgrade the host' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph osd dump -f json-pretty - ceph versions - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph osd require-osd-release reef - ceph.healthy: null - print: '**** done ceph.restart' - ceph-fuse: client.0: mounted: false - print: '**** done unmount client.0' - install.upgrade: client.0: null - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: null - print: '**** done remount client.0' - workunit: clients: all: - suites/iozone.sh teuthology: branch: pacific fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end - if not is_fuse() then reject() end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-03_09:48:43 tube: smithi user: dparmar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-03T09:56:07.626 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa; will attempt to use it 2023-10-03T09:56:07.627 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks 2023-10-03T09:56:07.627 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-03T09:56:07.629 INFO:teuthology.task.internal:Checking packages... 2023-10-03T09:56:07.651 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d6eb91756d99e822eeed7c6b783104a6ad86054' 2023-10-03T09:56:07.651 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T09:56:07.651 INFO:teuthology.packaging:ref: None 2023-10-03T09:56:07.651 INFO:teuthology.packaging:tag: None 2023-10-03T09:56:07.651 INFO:teuthology.packaging:branch: fix-nfs-apply-err-reporting 2023-10-03T09:56:07.652 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T09:56:07.652 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=fix-nfs-apply-err-reporting 2023-10-03T09:56:07.793 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5795.g3d6eb917 2023-10-03T09:56:07.793 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-03T09:56:07.799 INFO:teuthology.task.internal:no buildpackages task found 2023-10-03T09:56:07.799 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-03T09:56:07.805 INFO:teuthology.task.internal:Saving configuration 2023-10-03T09:56:07.822 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-03T09:56:07.828 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T09:56:07.855 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:48.262884', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPfP9tnAMamE3Fl+b+77jHnwhMvEsyPJvhQeBm52/HeWDw4zKhS1nLPe+WvZ1BCeHtrP1rMdwfUOTRQ3u1vcOcM='} 2023-10-03T09:56:07.879 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:48.264213', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDdUQPzKTAiEAIAiiGvKrXKFTcQUH0/kbWZc2nUWH5/yuUO5D4vM9P02dkNXCqv3QvnHP5kU5YSVicX3N1foee8='} 2023-10-03T09:56:07.879 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-03T09:56:07.885 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-10-03T09:56:07.885 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['client.0'] 2023-10-03T09:56:07.885 INFO:teuthology.run_tasks:Running task console_log... 2023-10-03T09:56:07.950 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdbafe3ef70>, signals=[15]) 2023-10-03T09:56:07.950 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-03T09:56:07.955 INFO:teuthology.task.internal:Opening connections... 2023-10-03T09:56:07.956 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2023-10-03T09:56:07.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:56:08.024 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2023-10-03T09:56:08.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:56:08.094 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-03T09:56:08.101 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-10-03T09:56:08.123 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-10-03T09:56:08.123 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-10-03T09:56:08.183 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-10-03T09:56:08.183 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8" 2023-10-03T09:56:08.183 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-10-03T09:56:08.183 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-10-03T09:56:08.184 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8" 2023-10-03T09:56:08.184 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-10-03T09:56:08.184 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-03T09:56:08.184 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-10-03T09:56:08.184 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-03T09:56:08.184 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-10-03T09:56:08.184 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T09:56:08.184 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-03T09:56:08.184 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-03T09:56:08.185 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-10-03T09:56:08.210 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2023-10-03T09:56:08.232 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2023-10-03T09:56:08.233 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-10-03T09:56:08.294 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2023-10-03T09:56:08.294 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8" 2023-10-03T09:56:08.295 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2023-10-03T09:56:08.295 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2023-10-03T09:56:08.295 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8" 2023-10-03T09:56:08.295 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2023-10-03T09:56:08.295 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-03T09:56:08.295 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-10-03T09:56:08.295 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-03T09:56:08.295 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2023-10-03T09:56:08.295 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T09:56:08.295 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-03T09:56:08.295 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-03T09:56:08.296 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-10-03T09:56:08.327 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-03T09:56:08.334 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-03T09:56:08.339 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-03T09:56:08.340 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2023-10-03T09:56:08.342 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2023-10-03T09:56:08.362 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-03T09:56:08.368 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-03T09:56:08.368 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2023-10-03T09:56:08.403 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2023-10-03T09:56:08.434 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-03T09:56:08.487 INFO:teuthology.run_tasks:Running task kernel... 2023-10-03T09:56:08.502 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-03T09:56:08.502 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-03T09:56:08.502 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-03T09:56:08.503 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-03T09:56:08.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:56:08.522 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-10-03T09:56:08.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:56:08.523 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2023-10-03T09:56:08.582 INFO:teuthology.orchestra.run.smithi072.stdout:4.18.0-489.el8.x86_64 2023-10-03T09:56:08.583 INFO:teuthology.task.kernel:Running kernel on smithi072: 4.18.0-489.el8.x86_64 2023-10-03T09:56:08.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum install -y kernel 2023-10-03T09:56:08.585 INFO:teuthology.orchestra.run.smithi119.stdout:4.18.0-489.el8.x86_64 2023-10-03T09:56:08.586 INFO:teuthology.task.kernel:Running kernel on smithi119: 4.18.0-489.el8.x86_64 2023-10-03T09:56:08.586 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum install -y kernel 2023-10-03T09:56:14.592 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - AppStream 9.8 MB/s | 33 MB 00:03 2023-10-03T09:56:15.725 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - AppStream 12 MB/s | 33 MB 00:02 2023-10-03T09:56:22.817 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 48 MB 00:02 2023-10-03T09:56:24.605 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 48 MB 00:02 2023-10-03T09:56:29.825 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - Extras 105 kB/s | 18 kB 00:00 2023-10-03T09:56:30.367 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 6.9 kB 00:00 2023-10-03T09:56:30.702 INFO:teuthology.orchestra.run.smithi119.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-10-03T09:56:31.728 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-10-03T09:56:31.803 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras 55 kB/s | 18 kB 00:00 2023-10-03T09:56:32.155 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras common packages 41 kB/s | 6.9 kB 00:00 2023-10-03T09:56:32.457 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-03T09:56:34.394 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 16 MB 00:01 2023-10-03T09:56:35.580 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 255 kB/s | 24 kB 00:00 2023-10-03T09:56:38.295 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 465 kB/s | 24 kB 00:00 2023-10-03T09:56:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-03T09:56:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-03T09:56:39.435 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-10-03T09:56:39.436 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-10-03T09:56:39.436 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2023-10-03T09:56:39.436 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-10-03T09:56:39.436 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-10-03T09:56:39.436 INFO:teuthology.orchestra.run.smithi119.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-03T09:56:39.436 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-10-03T09:56:39.436 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-03T09:56:39.436 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-03T09:56:39.437 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T09:56:39.437 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-10-03T09:56:39.437 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-10-03T09:56:39.437 INFO:teuthology.orchestra.run.smithi119.stdout:Install 3 Packages 2023-10-03T09:56:39.437 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T09:56:39.437 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 88 M 2023-10-03T09:56:39.437 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 96 M 2023-10-03T09:56:39.438 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-10-03T09:56:41.129 INFO:teuthology.orchestra.run.smithi119.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 7.0 MB/s | 10 MB 00:01 2023-10-03T09:56:41.829 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-03T09:56:41.829 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-03T09:56:42.102 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-10-03T09:56:42.103 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-10-03T09:56:42.103 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2023-10-03T09:56:42.103 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-10-03T09:56:42.103 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2023-10-03T09:56:42.104 INFO:teuthology.orchestra.run.smithi072.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-03T09:56:42.104 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2023-10-03T09:56:42.104 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-03T09:56:42.104 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-03T09:56:42.104 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T09:56:42.104 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-10-03T09:56:42.104 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2023-10-03T09:56:42.104 INFO:teuthology.orchestra.run.smithi072.stdout:Install 3 Packages 2023-10-03T09:56:42.104 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T09:56:42.105 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 88 M 2023-10-03T09:56:42.105 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 96 M 2023-10-03T09:56:42.105 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-10-03T09:56:42.230 INFO:teuthology.orchestra.run.smithi119.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 14 MB/s | 35 MB 00:02 2023-10-03T09:56:42.863 INFO:teuthology.orchestra.run.smithi119.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 13 MB/s | 43 MB 00:03 2023-10-03T09:56:42.863 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-10-03T09:56:42.863 INFO:teuthology.orchestra.run.smithi119.stdout:Total 26 MB/s | 88 MB 00:03 2023-10-03T09:56:43.532 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-10-03T09:56:43.588 INFO:teuthology.orchestra.run.smithi072.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 7.0 MB/s | 10 MB 00:01 2023-10-03T09:56:43.979 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-10-03T09:56:43.979 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-10-03T09:56:45.196 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-10-03T09:56:45.218 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-10-03T09:56:45.323 INFO:teuthology.orchestra.run.smithi072.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 11 MB/s | 35 MB 00:03 2023-10-03T09:56:46.016 INFO:teuthology.orchestra.run.smithi072.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 11 MB/s | 43 MB 00:03 2023-10-03T09:56:46.016 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-10-03T09:56:46.016 INFO:teuthology.orchestra.run.smithi072.stdout:Total 22 MB/s | 88 MB 00:03 2023-10-03T09:56:46.690 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-10-03T09:56:47.159 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-10-03T09:56:47.159 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-10-03T09:56:47.973 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-10-03T09:56:48.370 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-10-03T09:56:48.387 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-10-03T09:56:48.527 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:51.137 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-10-03T09:56:51.715 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:52.101 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:52.510 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:56:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:55.807 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:56:55.889 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:56:56.190 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:56:59.190 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:56:59.681 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:17.936 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:17.958 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:18.292 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:18.292 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:57:18.293 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:57:19.010 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:19.010 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T09:57:19.010 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-10-03T09:57:19.011 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-03T09:57:19.011 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-03T09:57:19.011 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T09:57:19.011 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-10-03T09:57:19.149 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:57:19.403 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:57:19.403 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:57:19.403 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-03T09:57:19.403 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-03T09:57:19.403 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-03T09:57:19.403 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-03T09:57:19.403 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi119.front.sepia.ceph.com, path=None, version=distro) 2023-10-03T09:57:19.404 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:57:19.611 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:57:19.612 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:57:19.612 DEBUG:teuthology.orchestra.run.smithi119:> sudo rpm -qi grub2-tools 2023-10-03T09:57:19.645 INFO:teuthology.orchestra.run.smithi119.stdout:Name : grub2-tools 2023-10-03T09:57:19.645 INFO:teuthology.orchestra.run.smithi119.stdout:Epoch : 1 2023-10-03T09:57:19.645 INFO:teuthology.orchestra.run.smithi119.stdout:Version : 2.02 2023-10-03T09:57:19.645 INFO:teuthology.orchestra.run.smithi119.stdout:Release : 129.el8 2023-10-03T09:57:19.645 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: x86_64 2023-10-03T09:57:19.646 INFO:teuthology.orchestra.run.smithi119.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-03T09:57:19.646 INFO:teuthology.orchestra.run.smithi119.stdout:Group : System Environment/Base 2023-10-03T09:57:19.646 INFO:teuthology.orchestra.run.smithi119.stdout:Size : 9265586 2023-10-03T09:57:19.646 INFO:teuthology.orchestra.run.smithi119.stdout:License : GPLv3+ 2023-10-03T09:57:19.646 INFO:teuthology.orchestra.run.smithi119.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-03T09:57:19.646 INFO:teuthology.orchestra.run.smithi119.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-03T09:57:19.646 INFO:teuthology.orchestra.run.smithi119.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-03T09:57:19.646 INFO:teuthology.orchestra.run.smithi119.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-03T09:57:19.646 INFO:teuthology.orchestra.run.smithi119.stdout:Relocations : (not relocatable) 2023-10-03T09:57:19.646 INFO:teuthology.orchestra.run.smithi119.stdout:Packager : CentOS BuildSystem 2023-10-03T09:57:19.646 INFO:teuthology.orchestra.run.smithi119.stdout:Vendor : CentOS 2023-10-03T09:57:19.647 INFO:teuthology.orchestra.run.smithi119.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-03T09:57:19.647 INFO:teuthology.orchestra.run.smithi119.stdout:Summary : Support tools for GRUB. 2023-10-03T09:57:19.647 INFO:teuthology.orchestra.run.smithi119.stdout:Description : 2023-10-03T09:57:19.647 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T09:57:19.647 INFO:teuthology.orchestra.run.smithi119.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-03T09:57:19.647 INFO:teuthology.orchestra.run.smithi119.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-03T09:57:19.647 INFO:teuthology.orchestra.run.smithi119.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-03T09:57:19.647 INFO:teuthology.orchestra.run.smithi119.stdout:hardware devices. 2023-10-03T09:57:19.647 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T09:57:19.647 INFO:teuthology.orchestra.run.smithi119.stdout:This subpackage provides tools for support of all platforms. 2023-10-03T09:57:19.648 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-03T09:57:19.648 INFO:teuthology.task.kernel:Updating grub on smithi119 to boot 4.18.0-514.el8.x86_64 2023-10-03T09:57:19.648 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-03T09:57:21.327 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2023-10-03T09:57:22.533 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:22.907 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:22.907 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:57:22.907 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:57:23.650 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:23.651 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T09:57:23.651 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2023-10-03T09:57:23.651 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-03T09:57:23.651 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-03T09:57:23.651 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T09:57:23.651 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-10-03T09:57:23.799 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:57:23.876 INFO:teuthology.orchestra.run.smithi119.stderr:done 2023-10-03T09:57:23.878 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2023-10-03T09:57:23.901 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.OnHDFS1lhO 2023-10-03T09:57:23.901 DEBUG:teuthology.orchestra.run.smithi119:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.OnHDFS1lhO 2023-10-03T09:57:23.990 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.OnHDFS1lhO 2023-10-03T09:57:24.014 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:57:24.014 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:57:24.015 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-03T09:57:24.015 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-03T09:57:24.015 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-03T09:57:24.015 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-03T09:57:24.015 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=None, version=distro) 2023-10-03T09:57:24.015 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:57:24.096 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.OnHDFS1lhO is 6KB 2023-10-03T09:57:24.144 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.OnHDFS1lhO 2023-10-03T09:57:24.161 DEBUG:teuthology.orchestra.run.smithi119:> sudo /bin/ls /boot/loader/entries || true 2023-10-03T09:57:24.222 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:57:24.222 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:57:24.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -qi grub2-tools 2023-10-03T09:57:24.227 INFO:teuthology.orchestra.run.smithi119.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-03T09:57:24.227 INFO:teuthology.orchestra.run.smithi119.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-03T09:57:24.227 INFO:teuthology.orchestra.run.smithi119.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-03T09:57:24.227 INFO:teuthology.orchestra.run.smithi119.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-03T09:57:24.228 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-03T09:57:24.256 INFO:teuthology.orchestra.run.smithi072.stdout:Name : grub2-tools 2023-10-03T09:57:24.256 INFO:teuthology.orchestra.run.smithi072.stdout:Epoch : 1 2023-10-03T09:57:24.256 INFO:teuthology.orchestra.run.smithi072.stdout:Version : 2.02 2023-10-03T09:57:24.256 INFO:teuthology.orchestra.run.smithi072.stdout:Release : 129.el8 2023-10-03T09:57:24.256 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: x86_64 2023-10-03T09:57:24.256 INFO:teuthology.orchestra.run.smithi072.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-03T09:57:24.256 INFO:teuthology.orchestra.run.smithi072.stdout:Group : System Environment/Base 2023-10-03T09:57:24.256 INFO:teuthology.orchestra.run.smithi072.stdout:Size : 9265586 2023-10-03T09:57:24.256 INFO:teuthology.orchestra.run.smithi072.stdout:License : GPLv3+ 2023-10-03T09:57:24.257 INFO:teuthology.orchestra.run.smithi072.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-03T09:57:24.257 INFO:teuthology.orchestra.run.smithi072.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-03T09:57:24.257 INFO:teuthology.orchestra.run.smithi072.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-03T09:57:24.257 INFO:teuthology.orchestra.run.smithi072.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-03T09:57:24.257 INFO:teuthology.orchestra.run.smithi072.stdout:Relocations : (not relocatable) 2023-10-03T09:57:24.257 INFO:teuthology.orchestra.run.smithi072.stdout:Packager : CentOS BuildSystem 2023-10-03T09:57:24.257 INFO:teuthology.orchestra.run.smithi072.stdout:Vendor : CentOS 2023-10-03T09:57:24.257 INFO:teuthology.orchestra.run.smithi072.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-03T09:57:24.257 INFO:teuthology.orchestra.run.smithi072.stdout:Summary : Support tools for GRUB. 2023-10-03T09:57:24.257 INFO:teuthology.orchestra.run.smithi072.stdout:Description : 2023-10-03T09:57:24.257 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T09:57:24.257 INFO:teuthology.orchestra.run.smithi072.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-03T09:57:24.258 INFO:teuthology.orchestra.run.smithi072.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-03T09:57:24.258 INFO:teuthology.orchestra.run.smithi072.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-03T09:57:24.258 INFO:teuthology.orchestra.run.smithi072.stdout:hardware devices. 2023-10-03T09:57:24.258 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T09:57:24.258 INFO:teuthology.orchestra.run.smithi072.stdout:This subpackage provides tools for support of all platforms. 2023-10-03T09:57:24.259 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-03T09:57:24.259 INFO:teuthology.task.kernel:Updating grub on smithi072 to boot 4.18.0-514.el8.x86_64 2023-10-03T09:57:24.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-03T09:57:24.399 DEBUG:teuthology.orchestra.run.smithi119:> sudo shutdown -r now 2023-10-03T09:57:29.841 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2023-10-03T09:57:32.685 INFO:teuthology.orchestra.run.smithi072.stderr:done 2023-10-03T09:57:32.699 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-10-03T09:57:32.741 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.L2Md50BwrO 2023-10-03T09:57:32.742 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.L2Md50BwrO 2023-10-03T09:57:32.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.L2Md50BwrO 2023-10-03T09:57:32.960 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.L2Md50BwrO is 6KB 2023-10-03T09:57:33.007 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.L2Md50BwrO 2023-10-03T09:57:33.024 DEBUG:teuthology.orchestra.run.smithi072:> sudo /bin/ls /boot/loader/entries || true 2023-10-03T09:57:33.089 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-03T09:57:33.089 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-03T09:57:33.089 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-03T09:57:33.089 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-03T09:57:33.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-03T09:57:33.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2023-10-03T09:57:54.406 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-03T09:57:54.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-10-03T09:57:54.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:03.285 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-03T09:58:03.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-03T09:58:03.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:12.858 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-10-03T09:58:21.818 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-03T09:58:21.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-10-03T09:58:21.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:24.922 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-10-03T09:58:30.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-03T09:58:30.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:33.886 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-03T09:58:36.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-10-03T09:58:36.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:45.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-03T09:58:45.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:55.358 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-10-03T09:59:04.314 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-03T09:59:10.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-10-03T09:59:10.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:59:11.224 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-10-03T09:59:12.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-10-03T09:59:12.635 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-514.el8.x86_64"... 2023-10-03T09:59:12.635 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2023-10-03T09:59:12.655 INFO:teuthology.orchestra.run.smithi119.stdout:4.18.0-514.el8.x86_64 2023-10-03T09:59:12.656 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-03T09:59:12.656 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-03T09:59:12.656 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-03T09:59:13.657 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-10-03T09:59:13.657 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-03T09:59:13.740 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2023-10-03T09:59:13.757 DEBUG:teuthology.parallel:result is None 2023-10-03T09:59:19.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-03T09:59:19.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:59:19.810 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-10-03T09:59:20.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-03T09:59:20.505 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-514.el8.x86_64"... 2023-10-03T09:59:20.505 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-10-03T09:59:20.523 INFO:teuthology.orchestra.run.smithi072.stdout:4.18.0-514.el8.x86_64 2023-10-03T09:59:20.523 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-03T09:59:20.523 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-03T09:59:20.523 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-03T09:59:21.524 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-03T09:59:21.524 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-03T09:59:21.613 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2023-10-03T09:59:21.624 DEBUG:teuthology.parallel:result is None 2023-10-03T09:59:21.624 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-03T09:59:21.631 INFO:teuthology.task.internal:Creating test directory... 2023-10-03T09:59:21.631 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-03T09:59:21.634 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-03T09:59:21.656 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-03T09:59:21.663 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-03T09:59:21.671 INFO:teuthology.task.internal:Creating archive directory... 2023-10-03T09:59:21.671 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-03T09:59:21.691 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-03T09:59:21.775 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-03T09:59:21.782 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-03T09:59:21.782 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-03T09:59:21.784 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-03T09:59:21.824 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:59:21.835 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:59:21.836 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:59:21.846 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T09:59:21.847 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-03T09:59:21.855 INFO:teuthology.task.internal:Configuring sudo... 2023-10-03T09:59:21.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-03T09:59:21.858 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-03T09:59:21.909 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-03T09:59:21.918 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-03T09:59:21.919 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-03T09:59:21.926 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-03T09:59:21.969 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:59:22.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:59:22.083 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:59:22.128 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:59:22.166 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T09:59:22.167 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-03T09:59:22.233 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:59:22.281 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T09:59:22.331 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:59:22.419 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T09:59:22.464 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-10-03T09:59:22.464 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-03T09:59:22.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2023-10-03T09:59:22.534 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2023-10-03T09:59:22.601 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T09:59:22.646 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T09:59:23.111 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-03T09:59:23.118 INFO:teuthology.task.internal:Starting timer... 2023-10-03T09:59:23.119 INFO:teuthology.run_tasks:Running task pcp... 2023-10-03T09:59:23.133 INFO:teuthology.run_tasks:Running task selinux... 2023-10-03T09:59:23.145 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-03T09:59:23.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2023-10-03T09:59:23.262 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2023-10-03T09:59:23.263 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2023-10-03T09:59:23.351 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2023-10-03T09:59:23.353 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-03T09:59:23.353 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2023-10-03T09:59:23.386 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2023-10-03T09:59:23.386 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2023-10-03T09:59:23.414 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2023-10-03T09:59:23.414 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi072.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi119.front.sepia.ceph.com': 'permissive'} 2023-10-03T09:59:23.415 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T09:59:23.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:59:23.451 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T09:59:23.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:59:23.483 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-03T09:59:23.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2023-10-03T09:59:23.537 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2023-10-03T09:59:23.572 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-03T09:59:23.586 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-03T09:59:23.586 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-03T09:59:23.603 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-03T09:59:23.604 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi072.front.sepia.ceph.com,smithi119.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-03T10:06:48.832 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com')] 2023-10-03T10:06:48.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-03T10:06:48.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T10:06:48.903 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-10-03T10:06:48.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-03T10:06:48.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-10-03T10:06:48.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T10:06:49.048 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-10-03T10:06:49.117 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-10-03T10:06:49.117 INFO:teuthology.run_tasks:Running task clock... 2023-10-03T10:06:49.129 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-03T10:06:49.129 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-03T10:06:49.129 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:06:49.132 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-03T10:06:49.132 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:06:49.164 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-03T10:06:49.179 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-03T10:06:49.192 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-03T10:06:49.206 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-03T10:06:49.241 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2023-10-03T10:06:49.252 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2023-10-03T10:06:49.266 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-03T10:06:49.272 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2023-10-03T10:06:49.279 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-03T10:06:49.284 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2023-10-03T10:06:49.298 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-03T10:06:49.311 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-03T10:06:49.350 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2023-10-03T10:06:49.354 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:06:49.354 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-10-03T10:06:49.354 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:49.354 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:49.354 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:49.354 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:49.379 INFO:teuthology.orchestra.run.smithi119.stderr:bash: ntpq: command not found 2023-10-03T10:06:49.383 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:06:49.383 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2023-10-03T10:06:49.383 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:49.383 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:49.383 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:49.383 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:06:49.384 INFO:teuthology.run_tasks:Running task install... 2023-10-03T10:06:49.395 DEBUG:teuthology.task.install:project ceph 2023-10-03T10:06:49.396 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}} 2023-10-03T10:06:49.396 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-10-03T10:06:49.396 INFO:teuthology.task.install:Using flavor: default 2023-10-03T10:06:49.401 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-03T10:06:49.401 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2023-10-03T10:06:49.402 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-10-03T10:06:49.402 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:49.402 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:49.402 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:49.402 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:49.402 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:49.403 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:06:49.404 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-10-03T10:06:49.404 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:49.405 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:49.405 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:49.405 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:49.405 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:49.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:06:49.648 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-10-03T10:06:49.649 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-10-03T10:06:49.720 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-10-03T10:06:49.720 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-10-03T10:06:49.826 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-03T10:06:49.826 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-10-03T10:06:49.826 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-03T10:06:49.855 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-10-03T10:06:49.855 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:49.855 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:49.855 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:49.855 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:49.855 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:49.855 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-03T10:06:49.887 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-03T10:06:49.887 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:06:49.887 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-03T10:06:49.919 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-10-03T10:06:49.919 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:06:49.919 INFO:teuthology.packaging:ref: None 2023-10-03T10:06:49.919 INFO:teuthology.packaging:tag: None 2023-10-03T10:06:49.919 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:06:49.919 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:06:49.919 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-03T10:06:49.923 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-03T10:06:49.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-03T10:06:50.000 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-03T10:06:50.066 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2023-10-03T10:06:50.068 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2023-10-03T10:06:50.069 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-03T10:06:50.136 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2023-10-03T10:06:50.137 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2023-10-03T10:06:50.349 INFO:teuthology.orchestra.run.smithi119.stdout:76 files removed 2023-10-03T10:06:50.379 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-10-03T10:06:50.401 INFO:teuthology.orchestra.run.smithi072.stdout:76 files removed 2023-10-03T10:06:50.430 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-10-03T10:06:51.099 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 287 kB/s | 76 kB 00:00 2023-10-03T10:06:51.137 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 214 kB/s | 76 kB 00:00 2023-10-03T10:06:51.446 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 56 kB/s | 15 kB 00:00 2023-10-03T10:06:51.483 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 44 kB/s | 15 kB 00:00 2023-10-03T10:06:51.780 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 4.7 kB/s | 1.4 kB 00:00 2023-10-03T10:06:51.843 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 4.3 kB/s | 1.4 kB 00:00 2023-10-03T10:06:54.472 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - AppStream 13 MB/s | 33 MB 00:02 2023-10-03T10:06:55.054 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - AppStream 10 MB/s | 33 MB 00:03 2023-10-03T10:07:02.905 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 48 MB 00:02 2023-10-03T10:07:03.973 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 48 MB 00:02 2023-10-03T10:07:10.664 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - Extras 23 kB/s | 18 kB 00:00 2023-10-03T10:07:11.142 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras 57 kB/s | 18 kB 00:00 2023-10-03T10:07:11.256 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2023-10-03T10:07:11.561 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras common packages 28 kB/s | 6.9 kB 00:00 2023-10-03T10:07:12.074 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - PowerTools 9.7 MB/s | 6.5 MB 00:00 2023-10-03T10:07:12.380 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - PowerTools 9.7 MB/s | 6.5 MB 00:00 2023-10-03T10:07:13.484 INFO:teuthology.orchestra.run.smithi119.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-03T10:07:13.832 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-03T10:07:14.643 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2023-10-03T10:07:15.885 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 16 MB 00:01 2023-10-03T10:07:18.501 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 602 kB/s | 24 kB 00:00 2023-10-03T10:07:19.754 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 282 kB/s | 24 kB 00:00 2023-10-03T10:07:22.694 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:07:22.695 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:07:22.720 INFO:teuthology.orchestra.run.smithi119.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-03T10:07:22.720 INFO:teuthology.orchestra.run.smithi119.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-03T10:07:22.721 INFO:teuthology.orchestra.run.smithi119.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-03T10:07:22.722 INFO:teuthology.orchestra.run.smithi119.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-03T10:07:22.927 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-10-03T10:07:22.939 INFO:teuthology.orchestra.run.smithi119.stdout:==================================================================================================== 2023-10-03T10:07:22.939 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-10-03T10:07:22.939 INFO:teuthology.orchestra.run.smithi119.stdout:==================================================================================================== 2023-10-03T10:07:22.939 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-10-03T10:07:22.939 INFO:teuthology.orchestra.run.smithi119.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-03T10:07:22.939 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-10-03T10:07:22.939 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-10-03T10:07:22.940 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-10-03T10:07:22.940 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-10-03T10:07:22.940 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-10-03T10:07:22.940 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-10-03T10:07:22.940 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-10-03T10:07:22.940 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-10-03T10:07:22.940 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-10-03T10:07:22.940 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-03T10:07:22.940 INFO:teuthology.orchestra.run.smithi119.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-03T10:07:22.940 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-10-03T10:07:22.940 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-10-03T10:07:22.941 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-10-03T10:07:22.941 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-03T10:07:22.941 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-10-03T10:07:22.941 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-10-03T10:07:22.941 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-10-03T10:07:22.941 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-10-03T10:07:22.941 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-10-03T10:07:22.941 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:07:22.941 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-10-03T10:07:22.941 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2023-10-03T10:07:22.941 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-03T10:07:22.941 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-03T10:07:22.942 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-03T10:07:22.942 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-03T10:07:22.942 INFO:teuthology.orchestra.run.smithi119.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-03T10:07:22.942 INFO:teuthology.orchestra.run.smithi119.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-03T10:07:22.942 INFO:teuthology.orchestra.run.smithi119.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-03T10:07:22.942 INFO:teuthology.orchestra.run.smithi119.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-03T10:07:22.942 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:07:22.942 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-10-03T10:07:22.942 INFO:teuthology.orchestra.run.smithi119.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-03T10:07:22.942 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-03T10:07:22.942 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-03T10:07:22.942 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-03T10:07:22.943 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-10-03T10:07:22.943 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-10-03T10:07:22.943 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-10-03T10:07:22.943 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-10-03T10:07:22.943 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-10-03T10:07:22.943 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-10-03T10:07:22.943 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-10-03T10:07:22.943 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-10-03T10:07:22.943 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-10-03T10:07:22.943 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-03T10:07:22.943 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-03T10:07:22.943 INFO:teuthology.orchestra.run.smithi119.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-03T10:07:22.944 INFO:teuthology.orchestra.run.smithi119.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-03T10:07:22.944 INFO:teuthology.orchestra.run.smithi119.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-03T10:07:22.944 INFO:teuthology.orchestra.run.smithi119.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-03T10:07:22.944 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-10-03T10:07:22.944 INFO:teuthology.orchestra.run.smithi119.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-03T10:07:22.944 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-03T10:07:22.944 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-03T10:07:22.944 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-03T10:07:22.944 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-03T10:07:22.944 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-10-03T10:07:22.944 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-03T10:07:22.945 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-10-03T10:07:22.945 INFO:teuthology.orchestra.run.smithi119.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-03T10:07:22.945 INFO:teuthology.orchestra.run.smithi119.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-03T10:07:22.945 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-03T10:07:22.945 INFO:teuthology.orchestra.run.smithi119.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-03T10:07:22.945 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-03T10:07:22.945 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-03T10:07:22.945 INFO:teuthology.orchestra.run.smithi119.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-03T10:07:22.945 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-03T10:07:22.945 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-03T10:07:22.945 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-03T10:07:22.945 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-03T10:07:22.946 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-03T10:07:22.946 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-03T10:07:22.946 INFO:teuthology.orchestra.run.smithi119.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-03T10:07:22.946 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-03T10:07:22.946 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-10-03T10:07:22.946 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-10-03T10:07:22.946 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-03T10:07:22.946 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-03T10:07:22.946 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-03T10:07:22.946 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-03T10:07:22.946 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-03T10:07:22.946 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-03T10:07:22.947 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-03T10:07:22.947 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-03T10:07:22.947 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-03T10:07:22.947 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-03T10:07:22.947 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-03T10:07:22.947 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-03T10:07:22.947 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-03T10:07:22.947 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-03T10:07:22.947 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-03T10:07:22.947 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-03T10:07:22.947 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-03T10:07:22.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-03T10:07:22.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-03T10:07:22.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-03T10:07:22.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-03T10:07:22.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-03T10:07:22.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-03T10:07:22.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-03T10:07:22.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-03T10:07:22.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-03T10:07:22.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-03T10:07:22.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-03T10:07:22.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-03T10:07:22.948 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-03T10:07:22.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-03T10:07:22.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-03T10:07:22.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-03T10:07:22.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-03T10:07:22.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-03T10:07:22.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-03T10:07:22.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-03T10:07:22.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-03T10:07:22.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-03T10:07:22.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-03T10:07:22.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-03T10:07:22.949 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-03T10:07:22.950 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-03T10:07:22.950 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-03T10:07:22.950 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-03T10:07:22.950 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:07:22.950 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-10-03T10:07:22.950 INFO:teuthology.orchestra.run.smithi119.stdout:==================================================================================================== 2023-10-03T10:07:22.950 INFO:teuthology.orchestra.run.smithi119.stdout:Install 108 Packages 2023-10-03T10:07:22.950 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 14 Packages 2023-10-03T10:07:22.950 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:07:22.951 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 200 M 2023-10-03T10:07:22.951 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-10-03T10:07:23.569 INFO:teuthology.orchestra.run.smithi119.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 32 kB/s | 6.4 kB 00:00 2023-10-03T10:07:23.987 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:07:23.988 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:07:24.012 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-03T10:07:24.013 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-03T10:07:24.013 INFO:teuthology.orchestra.run.smithi072.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-03T10:07:24.014 INFO:teuthology.orchestra.run.smithi072.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-03T10:07:24.036 INFO:teuthology.orchestra.run.smithi119.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 1.9 MB/s | 910 kB 00:00 2023-10-03T10:07:24.221 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-10-03T10:07:24.233 INFO:teuthology.orchestra.run.smithi072.stdout:==================================================================================================== 2023-10-03T10:07:24.233 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2023-10-03T10:07:24.233 INFO:teuthology.orchestra.run.smithi072.stdout:==================================================================================================== 2023-10-03T10:07:24.233 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2023-10-03T10:07:24.233 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-03T10:07:24.233 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-10-03T10:07:24.234 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-10-03T10:07:24.234 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-10-03T10:07:24.234 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-10-03T10:07:24.234 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-10-03T10:07:24.234 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-10-03T10:07:24.234 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-10-03T10:07:24.234 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-10-03T10:07:24.234 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-10-03T10:07:24.234 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-03T10:07:24.234 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-03T10:07:24.234 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-10-03T10:07:24.235 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-10-03T10:07:24.235 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-10-03T10:07:24.235 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-03T10:07:24.235 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-10-03T10:07:24.235 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-10-03T10:07:24.235 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-10-03T10:07:24.235 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-10-03T10:07:24.235 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-10-03T10:07:24.235 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:07:24.235 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-10-03T10:07:24.235 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2023-10-03T10:07:24.235 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-03T10:07:24.236 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-03T10:07:24.236 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-03T10:07:24.236 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-03T10:07:24.236 INFO:teuthology.orchestra.run.smithi072.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-03T10:07:24.236 INFO:teuthology.orchestra.run.smithi072.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-03T10:07:24.236 INFO:teuthology.orchestra.run.smithi072.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-03T10:07:24.236 INFO:teuthology.orchestra.run.smithi072.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-03T10:07:24.236 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:07:24.236 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-10-03T10:07:24.236 INFO:teuthology.orchestra.run.smithi072.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-03T10:07:24.236 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-03T10:07:24.236 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-03T10:07:24.237 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-03T10:07:24.237 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2023-10-03T10:07:24.237 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-10-03T10:07:24.237 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-10-03T10:07:24.237 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-10-03T10:07:24.237 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-10-03T10:07:24.237 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-10-03T10:07:24.237 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-10-03T10:07:24.237 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-10-03T10:07:24.237 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-10-03T10:07:24.237 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-03T10:07:24.237 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-03T10:07:24.238 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-03T10:07:24.238 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-03T10:07:24.238 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-03T10:07:24.238 INFO:teuthology.orchestra.run.smithi072.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-03T10:07:24.238 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-10-03T10:07:24.238 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-03T10:07:24.238 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-03T10:07:24.238 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-03T10:07:24.238 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-03T10:07:24.238 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-03T10:07:24.238 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-10-03T10:07:24.238 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-03T10:07:24.239 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-10-03T10:07:24.239 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-03T10:07:24.239 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-03T10:07:24.239 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-03T10:07:24.239 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-03T10:07:24.239 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-03T10:07:24.239 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-03T10:07:24.239 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-03T10:07:24.239 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-03T10:07:24.239 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-03T10:07:24.239 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-03T10:07:24.239 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-03T10:07:24.240 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-03T10:07:24.240 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-03T10:07:24.240 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-03T10:07:24.240 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-03T10:07:24.240 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-10-03T10:07:24.240 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-10-03T10:07:24.240 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-03T10:07:24.240 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-03T10:07:24.240 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-03T10:07:24.240 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-03T10:07:24.240 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-03T10:07:24.241 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-03T10:07:24.241 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-03T10:07:24.241 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-03T10:07:24.241 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-03T10:07:24.241 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-03T10:07:24.241 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-03T10:07:24.241 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-03T10:07:24.241 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-03T10:07:24.241 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-03T10:07:24.241 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-03T10:07:24.241 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-03T10:07:24.242 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-03T10:07:24.242 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-03T10:07:24.242 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-03T10:07:24.242 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-03T10:07:24.242 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-03T10:07:24.242 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-03T10:07:24.242 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-03T10:07:24.242 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-03T10:07:24.242 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-03T10:07:24.242 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-03T10:07:24.242 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-03T10:07:24.243 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-03T10:07:24.243 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-03T10:07:24.243 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-03T10:07:24.243 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-03T10:07:24.243 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-03T10:07:24.243 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-03T10:07:24.243 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-03T10:07:24.243 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-03T10:07:24.243 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-03T10:07:24.243 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-03T10:07:24.243 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-03T10:07:24.243 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-03T10:07:24.244 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-03T10:07:24.244 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-03T10:07:24.244 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-03T10:07:24.244 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-03T10:07:24.244 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-03T10:07:24.244 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-03T10:07:24.244 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:07:24.244 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-10-03T10:07:24.244 INFO:teuthology.orchestra.run.smithi072.stdout:==================================================================================================== 2023-10-03T10:07:24.244 INFO:teuthology.orchestra.run.smithi072.stdout:Install 108 Packages 2023-10-03T10:07:24.244 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 14 Packages 2023-10-03T10:07:24.245 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:07:24.245 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 200 M 2023-10-03T10:07:24.245 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-10-03T10:07:24.744 INFO:teuthology.orchestra.run.smithi119.stdout:(3/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 3.5 MB/s | 2.4 MB 00:00 2023-10-03T10:07:25.007 INFO:teuthology.orchestra.run.smithi072.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 19 kB/s | 6.4 kB 00:00 2023-10-03T10:07:25.245 INFO:teuthology.orchestra.run.smithi119.stdout:(4/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 3.2 MB/s | 1.6 MB 00:00 2023-10-03T10:07:26.224 INFO:teuthology.orchestra.run.smithi072.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 748 kB/s | 910 kB 00:01 2023-10-03T10:07:26.420 INFO:teuthology.orchestra.run.smithi119.stdout:(5/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 2.0 MB/s | 6.1 MB 00:03 2023-10-03T10:07:27.829 INFO:teuthology.orchestra.run.smithi119.stdout:(6/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 1.9 MB/s | 5.0 MB 00:02 2023-10-03T10:07:28.525 INFO:teuthology.orchestra.run.smithi072.stdout:(3/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 6.3 MB/s | 24 MB 00:03 2023-10-03T10:07:28.592 INFO:teuthology.orchestra.run.smithi072.stdout:(4/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 1.0 MB/s | 2.4 MB 00:02 2023-10-03T10:07:28.776 INFO:teuthology.orchestra.run.smithi072.stdout:(5/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 6.4 MB/s | 1.6 MB 00:00 2023-10-03T10:07:31.330 INFO:teuthology.orchestra.run.smithi072.stdout:(6/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86_ 7.2 MB/s | 18 MB 00:02 2023-10-03T10:07:32.316 INFO:teuthology.orchestra.run.smithi072.stdout:(7/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 1.3 MB/s | 5.0 MB 00:03 2023-10-03T10:07:32.404 INFO:teuthology.orchestra.run.smithi072.stdout:(8/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 294 kB/s | 26 kB 00:00 2023-10-03T10:07:33.013 INFO:teuthology.orchestra.run.smithi072.stdout:(9/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8. 6.9 MB/s | 12 MB 00:01 2023-10-03T10:07:33.078 INFO:teuthology.orchestra.run.smithi119.stdout:(7/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8. 2.2 MB/s | 12 MB 00:05 2023-10-03T10:07:33.080 INFO:teuthology.orchestra.run.smithi072.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 383 kB/s | 25 kB 00:00 2023-10-03T10:07:33.145 INFO:teuthology.orchestra.run.smithi119.stdout:(8/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 385 kB/s | 26 kB 00:00 2023-10-03T10:07:33.264 INFO:teuthology.orchestra.run.smithi072.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 4.4 MB/s | 824 kB 00:00 2023-10-03T10:07:33.356 INFO:teuthology.orchestra.run.smithi072.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 1.8 MB/s | 174 kB 00:00 2023-10-03T10:07:33.440 INFO:teuthology.orchestra.run.smithi072.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 1.5 MB/s | 131 kB 00:00 2023-10-03T10:07:33.541 INFO:teuthology.orchestra.run.smithi072.stdout:(14/122): libradosstriper1-16.2.14-44.geeb13ac9 4.8 MB/s | 493 kB 00:00 2023-10-03T10:07:34.208 INFO:teuthology.orchestra.run.smithi072.stdout:(15/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 5.7 MB/s | 3.8 MB 00:00 2023-10-03T10:07:34.283 INFO:teuthology.orchestra.run.smithi072.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 600 kB/s | 45 kB 00:00 2023-10-03T10:07:34.337 INFO:teuthology.orchestra.run.smithi119.stdout:(9/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 2.2 MB/s | 24 MB 00:10 2023-10-03T10:07:34.359 INFO:teuthology.orchestra.run.smithi072.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 1.3 MB/s | 99 kB 00:00 2023-10-03T10:07:34.470 INFO:teuthology.orchestra.run.smithi119.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 192 kB/s | 25 kB 00:00 2023-10-03T10:07:34.476 INFO:teuthology.orchestra.run.smithi072.stdout:(18/122): ceph-base-16.2.14-44.geeb13ac9.el8.x8 634 kB/s | 6.1 MB 00:09 2023-10-03T10:07:34.510 INFO:teuthology.orchestra.run.smithi072.stdout:(19/122): python3-cephfs-16.2.14-44.geeb13ac9.e 1.4 MB/s | 215 kB 00:00 2023-10-03T10:07:34.612 INFO:teuthology.orchestra.run.smithi072.stdout:(20/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 3.5 MB/s | 369 kB 00:00 2023-10-03T10:07:34.704 INFO:teuthology.orchestra.run.smithi072.stdout:(21/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.2 MB/s | 114 kB 00:00 2023-10-03T10:07:34.788 INFO:teuthology.orchestra.run.smithi072.stdout:(22/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.0 MB/s | 88 kB 00:00 2023-10-03T10:07:34.822 INFO:teuthology.orchestra.run.smithi072.stdout:(23/122): python3-rados-16.2.14-44.geeb13ac9.el 1.1 MB/s | 390 kB 00:00 2023-10-03T10:07:34.956 INFO:teuthology.orchestra.run.smithi072.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 1.3 MB/s | 173 kB 00:00 2023-10-03T10:07:34.962 INFO:teuthology.orchestra.run.smithi119.stdout:(11/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86 2.1 MB/s | 18 MB 00:08 2023-10-03T10:07:35.065 INFO:teuthology.orchestra.run.smithi072.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 224 kB/s | 24 kB 00:00 2023-10-03T10:07:35.120 INFO:teuthology.orchestra.run.smithi119.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 1.1 MB/s | 174 kB 00:00 2023-10-03T10:07:35.196 INFO:teuthology.orchestra.run.smithi119.stdout:(13/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 1.1 MB/s | 824 kB 00:00 2023-10-03T10:07:35.222 INFO:teuthology.orchestra.run.smithi119.stdout:(14/122): librados-devel-16.2.14-44.geeb13ac9.e 1.3 MB/s | 131 kB 00:00 2023-10-03T10:07:35.433 INFO:teuthology.orchestra.run.smithi072.stdout:(26/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 5.7 MB/s | 3.7 MB 00:00 2023-10-03T10:07:35.689 INFO:teuthology.orchestra.run.smithi119.stdout:(15/122): libradosstriper1-16.2.14-44.geeb13ac9 1.0 MB/s | 493 kB 00:00 2023-10-03T10:07:35.797 INFO:teuthology.orchestra.run.smithi119.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 416 kB/s | 45 kB 00:00 2023-10-03T10:07:35.905 INFO:teuthology.orchestra.run.smithi119.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 913 kB/s | 99 kB 00:00 2023-10-03T10:07:36.206 INFO:teuthology.orchestra.run.smithi119.stdout:(18/122): python3-cephfs-16.2.14-44.geeb13ac9.e 717 kB/s | 215 kB 00:00 2023-10-03T10:07:36.598 INFO:teuthology.orchestra.run.smithi119.stdout:(19/122): python3-rados-16.2.14-44.geeb13ac9.el 997 kB/s | 390 kB 00:00 2023-10-03T10:07:36.898 INFO:teuthology.orchestra.run.smithi119.stdout:(20/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 2.3 MB/s | 3.8 MB 00:01 2023-10-03T10:07:36.950 INFO:teuthology.orchestra.run.smithi072.stdout:(27/122): ceph-mgr-diskprediction-local-16.2.14 5.7 MB/s | 8.6 MB 00:01 2023-10-03T10:07:36.956 INFO:teuthology.orchestra.run.smithi119.stdout:(21/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 1.0 MB/s | 369 kB 00:00 2023-10-03T10:07:36.982 INFO:teuthology.orchestra.run.smithi119.stdout:(22/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.3 MB/s | 114 kB 00:00 2023-10-03T10:07:37.025 INFO:teuthology.orchestra.run.smithi072.stdout:(28/122): ceph-mgr-modules-core-16.2.14-44.geeb 3.2 MB/s | 244 kB 00:00 2023-10-03T10:07:37.041 INFO:teuthology.orchestra.run.smithi119.stdout:(23/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.0 MB/s | 88 kB 00:00 2023-10-03T10:07:37.117 INFO:teuthology.orchestra.run.smithi072.stdout:(29/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 1.5 MB/s | 3.1 MB 00:02 2023-10-03T10:07:37.143 INFO:teuthology.orchestra.run.smithi072.stdout:(30/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 233 kB/s | 27 kB 00:00 2023-10-03T10:07:37.174 INFO:teuthology.orchestra.run.smithi119.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 1.3 MB/s | 173 kB 00:00 2023-10-03T10:07:37.177 INFO:teuthology.orchestra.run.smithi072.stdout:(31/122): ceph-prometheus-alerts-16.2.14-44.gee 251 kB/s | 15 kB 00:00 2023-10-03T10:07:37.249 INFO:teuthology.orchestra.run.smithi119.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 324 kB/s | 24 kB 00:00 2023-10-03T10:07:37.853 INFO:teuthology.orchestra.run.smithi072.stdout:(32/122): flex-2.6.1-9.el8.x86_64.rpm 473 kB/s | 320 kB 00:00 2023-10-03T10:07:37.953 INFO:teuthology.orchestra.run.smithi072.stdout:(33/122): bison-3.0.4-10.el8.x86_64.rpm 850 kB/s | 688 kB 00:00 2023-10-03T10:07:38.022 INFO:teuthology.orchestra.run.smithi072.stdout:(34/122): jq-1.6-7.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2023-10-03T10:07:38.108 INFO:teuthology.orchestra.run.smithi119.stdout:(26/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 3.3 MB/s | 3.7 MB 00:01 2023-10-03T10:07:38.114 INFO:teuthology.orchestra.run.smithi072.stdout:(35/122): librdkafka-0.11.4-3.el8.x86_64.rpm 2.2 MB/s | 354 kB 00:00 2023-10-03T10:07:38.198 INFO:teuthology.orchestra.run.smithi072.stdout:(36/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.4 MB/s | 259 kB 00:00 2023-10-03T10:07:38.257 INFO:teuthology.orchestra.run.smithi072.stdout:(37/122): oniguruma-6.8.2-2.el8.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2023-10-03T10:07:38.774 INFO:teuthology.orchestra.run.smithi072.stdout:(38/122): openblas-threads-0.3.15-4.el8.x86_64. 9.4 MB/s | 4.9 MB 00:00 2023-10-03T10:07:38.875 INFO:teuthology.orchestra.run.smithi072.stdout:(39/122): openblas-0.3.15-4.el8.x86_64.rpm 7.0 MB/s | 4.7 MB 00:00 2023-10-03T10:07:38.900 INFO:teuthology.orchestra.run.smithi072.stdout:(40/122): python3-jsonpatch-1.21-2.el8.noarch.r 211 kB/s | 27 kB 00:00 2023-10-03T10:07:38.993 INFO:teuthology.orchestra.run.smithi072.stdout:(41/122): python3-jsonpointer-1.10-11.el8.noarc 170 kB/s | 20 kB 00:00 2023-10-03T10:07:39.027 INFO:teuthology.orchestra.run.smithi072.stdout:(42/122): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-10-03T10:07:39.111 INFO:teuthology.orchestra.run.smithi072.stdout:(43/122): python3-markupsafe-0.23-19.el8.x86_64 330 kB/s | 39 kB 00:00 2023-10-03T10:07:39.150 INFO:teuthology.orchestra.run.smithi119.stdout:(27/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 1.6 MB/s | 3.1 MB 00:01 2023-10-03T10:07:39.236 INFO:teuthology.orchestra.run.smithi072.stdout:(44/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.8 MB/s | 225 kB 00:00 2023-10-03T10:07:39.317 INFO:teuthology.orchestra.run.smithi119.stdout:(28/122): ceph-mgr-modules-core-16.2.14-44.geeb 1.4 MB/s | 244 kB 00:00 2023-10-03T10:07:39.353 INFO:teuthology.orchestra.run.smithi072.stdout:(45/122): python3-prettytable-0.7.2-14.el8.noar 376 kB/s | 44 kB 00:00 2023-10-03T10:07:39.409 INFO:teuthology.orchestra.run.smithi119.stdout:(29/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 300 kB/s | 27 kB 00:00 2023-10-03T10:07:39.446 INFO:teuthology.orchestra.run.smithi072.stdout:(46/122): python3-numpy-1.14.3-10.el8.x86_64.rp 8.9 MB/s | 3.7 MB 00:00 2023-10-03T10:07:39.481 INFO:teuthology.orchestra.run.smithi072.stdout:(47/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 811 kB/s | 103 kB 00:00 2023-10-03T10:07:39.492 INFO:teuthology.orchestra.run.smithi119.stdout:(30/122): ceph-prometheus-alerts-16.2.14-44.gee 178 kB/s | 15 kB 00:00 2023-10-03T10:07:39.565 INFO:teuthology.orchestra.run.smithi072.stdout:(48/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-10-03T10:07:39.607 INFO:teuthology.orchestra.run.smithi072.stdout:(49/122): python3-pyasn1-modules-0.3.7-6.el8.no 874 kB/s | 110 kB 00:00 2023-10-03T10:07:39.683 INFO:teuthology.orchestra.run.smithi072.stdout:(50/122): python3-pytz-2017.2-11.el8.noarch.rpm 485 kB/s | 57 kB 00:00 2023-10-03T10:07:39.817 INFO:teuthology.orchestra.run.smithi072.stdout:(51/122): python3-werkzeug-0.12.2-4.el8.noarch. 3.4 MB/s | 457 kB 00:00 2023-10-03T10:07:39.943 INFO:teuthology.orchestra.run.smithi072.stdout:(52/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2023-10-03T10:07:40.060 INFO:teuthology.orchestra.run.smithi072.stdout:(53/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 605 kB/s | 71 kB 00:00 2023-10-03T10:07:40.293 INFO:teuthology.orchestra.run.smithi119.stdout:(31/122): ceph-mgr-diskprediction-local-16.2.14 3.9 MB/s | 8.6 MB 00:02 2023-10-03T10:07:40.318 INFO:teuthology.orchestra.run.smithi119.stdout:(32/122): bison-3.0.4-10.el8.x86_64.rpm 834 kB/s | 688 kB 00:00 2023-10-03T10:07:40.460 INFO:teuthology.orchestra.run.smithi119.stdout:(33/122): jq-1.6-7.el8.x86_64.rpm 1.4 MB/s | 202 kB 00:00 2023-10-03T10:07:40.474 INFO:teuthology.orchestra.run.smithi072.stdout:(54/122): python3-scipy-1.0.0-21.module_el8.5.0 16 MB/s | 14 MB 00:00 2023-10-03T10:07:40.503 INFO:teuthology.orchestra.run.smithi072.stdout:(55/122): elfutils-libelf-devel-0.189-3.el8.x86 139 kB/s | 62 kB 00:00 2023-10-03T10:07:40.635 INFO:teuthology.orchestra.run.smithi119.stdout:(34/122): librdkafka-0.11.4-3.el8.x86_64.rpm 2.0 MB/s | 354 kB 00:00 2023-10-03T10:07:40.645 INFO:teuthology.orchestra.run.smithi072.stdout:(56/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 339 kB/s | 48 kB 00:00 2023-10-03T10:07:40.785 INFO:teuthology.orchestra.run.smithi119.stdout:(35/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.7 MB/s | 259 kB 00:00 2023-10-03T10:07:40.879 INFO:teuthology.orchestra.run.smithi072.stdout:(57/122): fuse-2.9.7-17.el8.x86_64.rpm 205 kB/s | 83 kB 00:00 2023-10-03T10:07:40.927 INFO:teuthology.orchestra.run.smithi119.stdout:(36/122): oniguruma-6.8.2-2.el8.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2023-10-03T10:07:40.994 INFO:teuthology.orchestra.run.smithi119.stdout:(37/122): flex-2.6.1-9.el8.x86_64.rpm 456 kB/s | 320 kB 00:00 2023-10-03T10:07:41.013 INFO:teuthology.orchestra.run.smithi072.stdout:(58/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.5 MB/s | 561 kB 00:00 2023-10-03T10:07:41.038 INFO:teuthology.orchestra.run.smithi072.stdout:(59/122): libcom_err-devel-1.45.6-5.el8.x86_64. 244 kB/s | 39 kB 00:00 2023-10-03T10:07:41.214 INFO:teuthology.orchestra.run.smithi072.stdout:(60/122): libgfortran-8.5.0-20.el8.x86_64.rpm 3.1 MB/s | 645 kB 00:00 2023-10-03T10:07:41.281 INFO:teuthology.orchestra.run.smithi072.stdout:(61/122): libquadmath-8.5.0-20.el8.x86_64.rpm 711 kB/s | 172 kB 00:00 2023-10-03T10:07:41.325 INFO:teuthology.orchestra.run.smithi072.stdout:(62/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 425 kB/s | 47 kB 00:00 2023-10-03T10:07:41.411 INFO:teuthology.orchestra.run.smithi119.stdout:(38/122): openblas-0.3.15-4.el8.x86_64.rpm 9.8 MB/s | 4.7 MB 00:00 2023-10-03T10:07:41.537 INFO:teuthology.orchestra.run.smithi119.stdout:(39/122): python3-jsonpatch-1.21-2.el8.noarch.r 212 kB/s | 27 kB 00:00 2023-10-03T10:07:41.604 INFO:teuthology.orchestra.run.smithi119.stdout:(40/122): openblas-threads-0.3.15-4.el8.x86_64. 8.0 MB/s | 4.9 MB 00:00 2023-10-03T10:07:41.654 INFO:teuthology.orchestra.run.smithi119.stdout:(41/122): python3-jsonpointer-1.10-11.el8.noarc 170 kB/s | 20 kB 00:00 2023-10-03T10:07:41.730 INFO:teuthology.orchestra.run.smithi119.stdout:(42/122): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-10-03T10:07:41.772 INFO:teuthology.orchestra.run.smithi119.stdout:(43/122): python3-markupsafe-0.23-19.el8.x86_64 332 kB/s | 39 kB 00:00 2023-10-03T10:07:41.803 INFO:teuthology.orchestra.run.smithi072.stdout:(63/122): libsepol-devel-2.9-3.el8.x86_64.rpm 182 kB/s | 87 kB 00:00 2023-10-03T10:07:41.834 INFO:teuthology.orchestra.run.smithi072.stdout:(64/122): libselinux-devel-2.9-8.el8.x86_64.rpm 362 kB/s | 200 kB 00:00 2023-10-03T10:07:41.902 INFO:teuthology.orchestra.run.smithi072.stdout:(65/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 185 kB/s | 18 kB 00:00 2023-10-03T10:07:41.905 INFO:teuthology.orchestra.run.smithi119.stdout:(44/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.6 MB/s | 225 kB 00:00 2023-10-03T10:07:41.944 INFO:teuthology.orchestra.run.smithi072.stdout:(66/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 402 kB/s | 44 kB 00:00 2023-10-03T10:07:42.030 INFO:teuthology.orchestra.run.smithi119.stdout:(45/122): python3-prettytable-0.7.2-14.el8.noar 352 kB/s | 44 kB 00:00 2023-10-03T10:07:42.089 INFO:teuthology.orchestra.run.smithi119.stdout:(46/122): python3-numpy-1.14.3-10.el8.x86_64.rp 10 MB/s | 3.7 MB 00:00 2023-10-03T10:07:42.148 INFO:teuthology.orchestra.run.smithi119.stdout:(47/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 884 kB/s | 103 kB 00:00 2023-10-03T10:07:42.206 INFO:teuthology.orchestra.run.smithi119.stdout:(48/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-10-03T10:07:42.219 INFO:teuthology.orchestra.run.smithi072.stdout:(67/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 10 MB/s | 3.2 MB 00:00 2023-10-03T10:07:42.281 INFO:teuthology.orchestra.run.smithi119.stdout:(49/122): python3-pyasn1-modules-0.3.7-6.el8.no 824 kB/s | 110 kB 00:00 2023-10-03T10:07:42.289 INFO:teuthology.orchestra.run.smithi072.stdout:(68/122): pcre2-devel-10.32-3.el8.x86_64.rpm 1.7 MB/s | 605 kB 00:00 2023-10-03T10:07:42.323 INFO:teuthology.orchestra.run.smithi119.stdout:(50/122): python3-pytz-2017.2-11.el8.noarch.rpm 488 kB/s | 57 kB 00:00 2023-10-03T10:07:42.337 INFO:teuthology.orchestra.run.smithi072.stdout:(69/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2023-10-03T10:07:42.413 INFO:teuthology.orchestra.run.smithi072.stdout:(70/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-10-03T10:07:42.446 INFO:teuthology.orchestra.run.smithi072.stdout:(71/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.2 MB/s | 249 kB 00:00 2023-10-03T10:07:42.457 INFO:teuthology.orchestra.run.smithi119.stdout:(51/122): python3-werkzeug-0.12.2-4.el8.noarch. 3.3 MB/s | 457 kB 00:00 2023-10-03T10:07:42.555 INFO:teuthology.orchestra.run.smithi072.stdout:(72/122): python3-jwt-1.6.1-2.el8.noarch.rpm 392 kB/s | 43 kB 00:00 2023-10-03T10:07:42.589 INFO:teuthology.orchestra.run.smithi072.stdout:(73/122): python3-cryptography-3.2.1-6.el8.x86_ 3.6 MB/s | 641 kB 00:00 2023-10-03T10:07:42.591 INFO:teuthology.orchestra.run.smithi119.stdout:(52/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2023-10-03T10:07:42.665 INFO:teuthology.orchestra.run.smithi072.stdout:(74/122): python3-oauthlib-2.1.0-1.el8.noarch.r 1.4 MB/s | 155 kB 00:00 2023-10-03T10:07:42.698 INFO:teuthology.orchestra.run.smithi072.stdout:(75/122): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2023-10-03T10:07:42.716 INFO:teuthology.orchestra.run.smithi119.stdout:(53/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 566 kB/s | 71 kB 00:00 2023-10-03T10:07:42.767 INFO:teuthology.orchestra.run.smithi072.stdout:(76/122): python3-requests-oauthlib-1.0.0-1.el8 417 kB/s | 43 kB 00:00 2023-10-03T10:07:42.810 INFO:teuthology.orchestra.run.smithi072.stdout:(77/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 524 kB/s | 58 kB 00:00 2023-10-03T10:07:42.992 INFO:teuthology.orchestra.run.smithi119.stdout:(54/122): python3-scipy-1.0.0-21.module_el8.5.0 19 MB/s | 14 MB 00:00 2023-10-03T10:07:43.107 INFO:teuthology.orchestra.run.smithi119.stdout:(55/122): elfutils-libelf-devel-0.189-3.el8.x86 158 kB/s | 62 kB 00:00 2023-10-03T10:07:43.277 INFO:teuthology.orchestra.run.smithi072.stdout:(78/122): leveldb-1.22-1.el8.x86_64.rpm 387 kB/s | 181 kB 00:00 2023-10-03T10:07:43.311 INFO:teuthology.orchestra.run.smithi072.stdout:(79/122): gperftools-libs-2.7-9.el8.x86_64.rpm 564 kB/s | 306 kB 00:00 2023-10-03T10:07:43.367 INFO:teuthology.orchestra.run.smithi119.stdout:(56/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 185 kB/s | 48 kB 00:00 2023-10-03T10:07:43.394 INFO:teuthology.orchestra.run.smithi072.stdout:(80/122): liboath-2.6.2-3.el8.x86_64.rpm 501 kB/s | 59 kB 00:00 2023-10-03T10:07:43.420 INFO:teuthology.orchestra.run.smithi072.stdout:(81/122): libunwind-1.3.1-3.el8.x86_64.rpm 687 kB/s | 75 kB 00:00 2023-10-03T10:07:43.434 INFO:teuthology.orchestra.run.smithi119.stdout:(57/122): fuse-2.9.7-17.el8.x86_64.rpm 188 kB/s | 83 kB 00:00 2023-10-03T10:07:43.496 INFO:teuthology.orchestra.run.smithi072.stdout:(82/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 433 kB/s | 44 kB 00:00 2023-10-03T10:07:43.568 INFO:teuthology.orchestra.run.smithi119.stdout:(58/122): libcom_err-devel-1.45.6-5.el8.x86_64. 291 kB/s | 39 kB 00:00 2023-10-03T10:07:43.571 INFO:teuthology.orchestra.run.smithi072.stdout:(83/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-10-03T10:07:43.597 INFO:teuthology.orchestra.run.smithi072.stdout:(84/122): python3-cachetools-3.1.1-4.el8.noarch 328 kB/s | 33 kB 00:00 2023-10-03T10:07:43.681 INFO:teuthology.orchestra.run.smithi072.stdout:(85/122): python3-certifi-2018.10.15-7.el8.noar 149 kB/s | 16 kB 00:00 2023-10-03T10:07:43.726 INFO:teuthology.orchestra.run.smithi119.stdout:(59/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.5 MB/s | 561 kB 00:00 2023-10-03T10:07:43.748 INFO:teuthology.orchestra.run.smithi072.stdout:(86/122): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-10-03T10:07:43.849 INFO:teuthology.orchestra.run.smithi072.stdout:(87/122): python3-cherrypy-18.4.0-1.el8.noarch. 2.2 MB/s | 384 kB 00:00 2023-10-03T10:07:43.851 INFO:teuthology.orchestra.run.smithi119.stdout:(60/122): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2023-10-03T10:07:43.874 INFO:teuthology.orchestra.run.smithi072.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 646 kB/s | 81 kB 00:00 2023-10-03T10:07:43.941 INFO:teuthology.orchestra.run.smithi072.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 120 kB/s | 11 kB 00:00 2023-10-03T10:07:43.963 INFO:teuthology.orchestra.run.smithi119.stdout:(61/122): libgfortran-8.5.0-20.el8.x86_64.rpm 1.6 MB/s | 645 kB 00:00 2023-10-03T10:07:43.975 INFO:teuthology.orchestra.run.smithi072.stdout:(90/122): python3-jaraco-functools-2.0-4.el8.no 174 kB/s | 18 kB 00:00 2023-10-03T10:07:43.994 INFO:teuthology.orchestra.run.smithi119.stdout:(62/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 331 kB/s | 47 kB 00:00 2023-10-03T10:07:44.086 INFO:teuthology.orchestra.run.smithi119.stdout:(63/122): libselinux-devel-2.9-8.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2023-10-03T10:07:44.086 INFO:teuthology.orchestra.run.smithi072.stdout:(91/122): python3-logutils-0.3.5-11.el8.noarch. 442 kB/s | 49 kB 00:00 2023-10-03T10:07:44.111 INFO:teuthology.orchestra.run.smithi119.stdout:(64/122): libsepol-devel-2.9-3.el8.x86_64.rpm 745 kB/s | 87 kB 00:00 2023-10-03T10:07:44.186 INFO:teuthology.orchestra.run.smithi119.stdout:(65/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 180 kB/s | 18 kB 00:00 2023-10-03T10:07:44.203 INFO:teuthology.orchestra.run.smithi072.stdout:(92/122): python3-kubernetes-11.0.0-6.el8.noarc 4.5 MB/s | 1.2 MB 00:00 2023-10-03T10:07:44.211 INFO:teuthology.orchestra.run.smithi119.stdout:(66/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 437 kB/s | 44 kB 00:00 2023-10-03T10:07:44.229 INFO:teuthology.orchestra.run.smithi072.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 412 kB/s | 59 kB 00:00 2023-10-03T10:07:44.321 INFO:teuthology.orchestra.run.smithi072.stdout:(94/122): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-10-03T10:07:44.346 INFO:teuthology.orchestra.run.smithi072.stdout:(95/122): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-10-03T10:07:44.408 INFO:teuthology.orchestra.run.smithi119.stdout:(67/122): pcre2-devel-10.32-3.el8.x86_64.rpm 3.0 MB/s | 605 kB 00:00 2023-10-03T10:07:44.546 INFO:teuthology.orchestra.run.smithi119.stdout:(68/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 8.9 MB/s | 3.2 MB 00:00 2023-10-03T10:07:44.571 INFO:teuthology.orchestra.run.smithi119.stdout:(69/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.4 MB/s | 229 kB 00:00 2023-10-03T10:07:44.654 INFO:teuthology.orchestra.run.smithi119.stdout:(70/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-10-03T10:07:44.696 INFO:teuthology.orchestra.run.smithi119.stdout:(71/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2023-10-03T10:07:44.780 INFO:teuthology.orchestra.run.smithi119.stdout:(72/122): python3-cryptography-3.2.1-6.el8.x86_ 5.0 MB/s | 641 kB 00:00 2023-10-03T10:07:44.814 INFO:teuthology.orchestra.run.smithi119.stdout:(73/122): python3-jwt-1.6.1-2.el8.noarch.rpm 364 kB/s | 43 kB 00:00 2023-10-03T10:07:45.197 INFO:teuthology.orchestra.run.smithi072.stdout:(96/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 4.0 MB/s | 52 MB 00:12 2023-10-03T10:07:45.231 INFO:teuthology.orchestra.run.smithi072.stdout:(97/122): python3-repoze-lru-0.7-6.el8.noarch.r 37 kB/s | 34 kB 00:00 2023-10-03T10:07:45.265 INFO:teuthology.orchestra.run.smithi072.stdout:(98/122): python3-routes-2.4.1-12.el8.noarch.rp 214 kB/s | 196 kB 00:00 2023-10-03T10:07:45.289 INFO:teuthology.orchestra.run.smithi119.stdout:(74/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 4.3 MB/s | 52 MB 00:12 2023-10-03T10:07:45.314 INFO:teuthology.orchestra.run.smithi119.stdout:(75/122): python3-pycparser-2.14-14.el8.noarch. 218 kB/s | 109 kB 00:00 2023-10-03T10:07:45.323 INFO:teuthology.orchestra.run.smithi072.stdout:(99/122): python3-simplegeneric-0.8.1-17.el8.no 202 kB/s | 19 kB 00:00 2023-10-03T10:07:45.331 INFO:teuthology.orchestra.run.smithi119.stdout:(76/122): python3-oauthlib-2.1.0-1.el8.noarch.r 281 kB/s | 155 kB 00:00 2023-10-03T10:07:45.374 INFO:teuthology.orchestra.run.smithi072.stdout:(100/122): python3-singledispatch-3.4.0.3-18.el 219 kB/s | 24 kB 00:00 2023-10-03T10:07:45.423 INFO:teuthology.orchestra.run.smithi119.stdout:(77/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 534 kB/s | 58 kB 00:00 2023-10-03T10:07:45.424 INFO:teuthology.orchestra.run.smithi072.stdout:(101/122): python3-tempora-1.14.1-5.el8.noarch. 290 kB/s | 29 kB 00:00 2023-10-03T10:07:45.483 INFO:teuthology.orchestra.run.smithi072.stdout:(102/122): python3-trustme-0.6.0-4.el8.noarch.r 252 kB/s | 27 kB 00:00 2023-10-03T10:07:45.534 INFO:teuthology.orchestra.run.smithi072.stdout:(103/122): python3-waitress-1.4.3-1.el8.noarch. 2.3 MB/s | 255 kB 00:00 2023-10-03T10:07:45.559 INFO:teuthology.orchestra.run.smithi072.stdout:(104/122): python3-rsa-4.9-2.el8.noarch.rpm 177 kB/s | 64 kB 00:00 2023-10-03T10:07:45.626 INFO:teuthology.orchestra.run.smithi072.stdout:(105/122): python3-websocket-client-0.56.0-5.el 663 kB/s | 61 kB 00:00 2023-10-03T10:07:45.631 INFO:teuthology.orchestra.run.smithi119.stdout:(78/122): python3-requests-oauthlib-1.0.0-1.el8 125 kB/s | 43 kB 00:00 2023-10-03T10:07:45.662 INFO:teuthology.orchestra.run.smithi072.stdout:(106/122): python3-webob-1.8.5-1.el8.1.noarch.r 1.4 MB/s | 251 kB 00:00 2023-10-03T10:07:45.721 INFO:teuthology.orchestra.run.smithi072.stdout:(107/122): python3-zc-lockfile-2.0-2.el8.noarch 244 kB/s | 23 kB 00:00 2023-10-03T10:07:45.746 INFO:teuthology.orchestra.run.smithi072.stdout:(108/122): python3-webtest-2.0.33-1.el8.noarch. 457 kB/s | 85 kB 00:00 2023-10-03T10:07:45.807 INFO:teuthology.orchestra.run.smithi119.stdout:(79/122): gperftools-libs-2.7-9.el8.x86_64.rpm 644 kB/s | 306 kB 00:00 2023-10-03T10:07:45.855 INFO:teuthology.orchestra.run.smithi072.stdout:(109/122): NetworkManager-initscripts-updown-1. 1.3 MB/s | 143 kB 00:00 2023-10-03T10:07:45.866 INFO:teuthology.orchestra.run.smithi119.stdout:(80/122): leveldb-1.22-1.el8.x86_64.rpm 409 kB/s | 181 kB 00:00 2023-10-03T10:07:45.891 INFO:teuthology.orchestra.run.smithi119.stdout:(81/122): libunwind-1.3.1-3.el8.x86_64.rpm 899 kB/s | 75 kB 00:00 2023-10-03T10:07:45.908 INFO:teuthology.orchestra.run.smithi119.stdout:(82/122): liboath-2.6.2-3.el8.x86_64.rpm 213 kB/s | 59 kB 00:00 2023-10-03T10:07:45.956 INFO:teuthology.orchestra.run.smithi072.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 760 kB/s | 76 kB 00:00 2023-10-03T10:07:46.000 INFO:teuthology.orchestra.run.smithi119.stdout:(83/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2023-10-03T10:07:46.033 INFO:teuthology.orchestra.run.smithi119.stdout:(84/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 261 kB/s | 44 kB 00:00 2023-10-03T10:07:46.050 INFO:teuthology.orchestra.run.smithi119.stdout:(85/122): python3-cachetools-3.1.1-4.el8.noarch 232 kB/s | 33 kB 00:00 2023-10-03T10:07:46.073 INFO:teuthology.orchestra.run.smithi072.stdout:(111/122): elfutils-libelf-0.189-3.el8.x86_64.r 1.9 MB/s | 232 kB 00:00 2023-10-03T10:07:46.134 INFO:teuthology.orchestra.run.smithi119.stdout:(86/122): python3-certifi-2018.10.15-7.el8.noar 122 kB/s | 16 kB 00:00 2023-10-03T10:07:46.149 INFO:teuthology.orchestra.run.smithi072.stdout:(112/122): librados2-16.2.14-44.geeb13ac9.el8.x 7.7 MB/s | 3.7 MB 00:00 2023-10-03T10:07:46.159 INFO:teuthology.orchestra.run.smithi119.stdout:(87/122): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-10-03T10:07:46.191 INFO:teuthology.orchestra.run.smithi072.stdout:(113/122): elfutils-libs-0.189-3.el8.x86_64.rpm 2.5 MB/s | 303 kB 00:00 2023-10-03T10:07:46.268 INFO:teuthology.orchestra.run.smithi119.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 608 kB/s | 81 kB 00:00 2023-10-03T10:07:46.293 INFO:teuthology.orchestra.run.smithi119.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 83 kB/s | 11 kB 00:00 2023-10-03T10:07:46.308 INFO:teuthology.orchestra.run.smithi072.stdout:(114/122): libblkid-2.32.1-43.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-10-03T10:07:46.350 INFO:teuthology.orchestra.run.smithi072.stdout:(115/122): iproute-6.2.0-5.el8.x86_64.rpm 4.1 MB/s | 854 kB 00:00 2023-10-03T10:07:46.401 INFO:teuthology.orchestra.run.smithi119.stdout:(90/122): python3-jaraco-functools-2.0-4.el8.no 132 kB/s | 18 kB 00:00 2023-10-03T10:07:46.417 INFO:teuthology.orchestra.run.smithi072.stdout:(116/122): libfdisk-2.32.1-43.el8.x86_64.rpm 2.3 MB/s | 254 kB 00:00 2023-10-03T10:07:46.476 INFO:teuthology.orchestra.run.smithi072.stdout:(117/122): libmount-2.32.1-43.el8.x86_64.rpm 1.8 MB/s | 236 kB 00:00 2023-10-03T10:07:46.502 INFO:teuthology.orchestra.run.smithi119.stdout:(91/122): python3-kubernetes-11.0.0-6.el8.noarc 5.6 MB/s | 1.2 MB 00:00 2023-10-03T10:07:46.519 INFO:teuthology.orchestra.run.smithi072.stdout:(118/122): libsmartcols-2.32.1-43.el8.x86_64.rp 1.7 MB/s | 179 kB 00:00 2023-10-03T10:07:46.560 INFO:teuthology.orchestra.run.smithi119.stdout:(92/122): python3-cherrypy-18.4.0-1.el8.noarch. 754 kB/s | 384 kB 00:00 2023-10-03T10:07:46.585 INFO:teuthology.orchestra.run.smithi119.stdout:(93/122): python3-logutils-0.3.5-11.el8.noarch. 265 kB/s | 49 kB 00:00 2023-10-03T10:07:46.611 INFO:teuthology.orchestra.run.smithi119.stdout:(94/122): python3-more-itertools-7.2.0-3.el8.no 540 kB/s | 59 kB 00:00 2023-10-03T10:07:46.627 INFO:teuthology.orchestra.run.smithi072.stdout:(119/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 4.6 MB/s | 4.2 MB 00:00 2023-10-03T10:07:46.653 INFO:teuthology.orchestra.run.smithi072.stdout:(120/122): libuuid-2.32.1-43.el8.x86_64.rpm 561 kB/s | 99 kB 00:00 2023-10-03T10:07:46.711 INFO:teuthology.orchestra.run.smithi119.stdout:(95/122): python3-portend-2.6-1.el8.noarch.rpm 124 kB/s | 16 kB 00:00 2023-10-03T10:07:46.730 INFO:teuthology.orchestra.run.smithi072.stdout:(121/122): util-linux-2.32.1-43.el8.x86_64.rpm 12 MB/s | 2.5 MB 00:00 2023-10-03T10:07:46.737 INFO:teuthology.orchestra.run.smithi119.stdout:(96/122): python3-repoze-lru-0.7-6.el8.noarch.r 268 kB/s | 34 kB 00:00 2023-10-03T10:07:46.787 INFO:teuthology.orchestra.run.smithi119.stdout:(97/122): python3-pecan-1.3.2-9.el8.noarch.rpm 1.2 MB/s | 283 kB 00:00 2023-10-03T10:07:46.837 INFO:teuthology.orchestra.run.smithi119.stdout:(98/122): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-10-03T10:07:46.889 INFO:teuthology.orchestra.run.smithi119.stdout:(99/122): python3-rsa-4.9-2.el8.noarch.rpm 426 kB/s | 64 kB 00:00 2023-10-03T10:07:46.929 INFO:teuthology.orchestra.run.smithi119.stdout:(100/122): python3-simplegeneric-0.8.1-17.el8.n 131 kB/s | 19 kB 00:00 2023-10-03T10:07:47.046 INFO:teuthology.orchestra.run.smithi119.stdout:(101/122): python3-trustme-0.6.0-4.el8.noarch.r 236 kB/s | 27 kB 00:00 2023-10-03T10:07:47.072 INFO:teuthology.orchestra.run.smithi119.stdout:(102/122): python3-singledispatch-3.4.0.3-18.el 102 kB/s | 24 kB 00:00 2023-10-03T10:07:47.114 INFO:teuthology.orchestra.run.smithi119.stdout:(103/122): python3-tempora-1.14.1-5.el8.noarch. 129 kB/s | 29 kB 00:00 2023-10-03T10:07:47.147 INFO:teuthology.orchestra.run.smithi072.stdout:(122/122): util-linux-user-2.32.1-43.el8.x86_64 197 kB/s | 103 kB 00:00 2023-10-03T10:07:47.150 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-10-03T10:07:47.150 INFO:teuthology.orchestra.run.smithi072.stdout:Total 8.7 MB/s | 200 MB 00:22 2023-10-03T10:07:47.239 INFO:teuthology.orchestra.run.smithi119.stdout:(104/122): python3-websocket-client-0.56.0-5.el 490 kB/s | 61 kB 00:00 2023-10-03T10:07:47.322 INFO:teuthology.orchestra.run.smithi119.stdout:(105/122): python3-waitress-1.4.3-1.el8.noarch. 926 kB/s | 255 kB 00:00 2023-10-03T10:07:47.408 INFO:teuthology.orchestra.run.smithi119.stdout:(106/122): python3-webtest-2.0.33-1.el8.noarch. 505 kB/s | 85 kB 00:00 2023-10-03T10:07:47.431 INFO:teuthology.orchestra.run.smithi119.stdout:(107/122): python3-zc-lockfile-2.0-2.el8.noarch 211 kB/s | 23 kB 00:00 2023-10-03T10:07:47.548 INFO:teuthology.orchestra.run.smithi119.stdout:(108/122): python3-webob-1.8.5-1.el8.1.noarch.r 527 kB/s | 251 kB 00:00 2023-10-03T10:07:47.657 INFO:teuthology.orchestra.run.smithi119.stdout:(109/122): NetworkManager-initscripts-updown-1. 1.3 MB/s | 143 kB 00:00 2023-10-03T10:07:47.766 INFO:teuthology.orchestra.run.smithi119.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 703 kB/s | 76 kB 00:00 2023-10-03T10:07:47.889 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-10-03T10:07:47.916 INFO:teuthology.orchestra.run.smithi119.stdout:(111/122): librados2-16.2.14-44.geeb13ac9.el8.x 7.4 MB/s | 3.7 MB 00:00 2023-10-03T10:07:47.941 INFO:teuthology.orchestra.run.smithi119.stdout:(112/122): elfutils-libelf-0.189-3.el8.x86_64.r 1.3 MB/s | 232 kB 00:00 2023-10-03T10:07:48.025 INFO:teuthology.orchestra.run.smithi119.stdout:(113/122): elfutils-libs-0.189-3.el8.x86_64.rpm 2.7 MB/s | 303 kB 00:00 2023-10-03T10:07:48.111 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-10-03T10:07:48.111 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-10-03T10:07:48.125 INFO:teuthology.orchestra.run.smithi119.stdout:(114/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 6.0 MB/s | 4.2 MB 00:00 2023-10-03T10:07:48.159 INFO:teuthology.orchestra.run.smithi119.stdout:(115/122): iproute-6.2.0-5.el8.x86_64.rpm 3.8 MB/s | 854 kB 00:00 2023-10-03T10:07:48.184 INFO:teuthology.orchestra.run.smithi119.stdout:(116/122): libblkid-2.32.1-43.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2023-10-03T10:07:48.292 INFO:teuthology.orchestra.run.smithi119.stdout:(117/122): libsmartcols-2.32.1-43.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-10-03T10:07:48.317 INFO:teuthology.orchestra.run.smithi119.stdout:(118/122): libmount-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 236 kB 00:00 2023-10-03T10:07:48.393 INFO:teuthology.orchestra.run.smithi119.stdout:(119/122): libuuid-2.32.1-43.el8.x86_64.rpm 990 kB/s | 99 kB 00:00 2023-10-03T10:07:48.443 INFO:teuthology.orchestra.run.smithi119.stdout:(120/122): libfdisk-2.32.1-43.el8.x86_64.rpm 798 kB/s | 254 kB 00:00 2023-10-03T10:07:48.493 INFO:teuthology.orchestra.run.smithi119.stdout:(121/122): util-linux-user-2.32.1-43.el8.x86_64 1.0 MB/s | 103 kB 00:00 2023-10-03T10:07:48.611 INFO:teuthology.orchestra.run.smithi119.stdout:(122/122): util-linux-2.32.1-43.el8.x86_64.rpm 8.5 MB/s | 2.5 MB 00:00 2023-10-03T10:07:48.613 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-10-03T10:07:48.613 INFO:teuthology.orchestra.run.smithi119.stdout:Total 7.8 MB/s | 200 MB 00:25 2023-10-03T10:07:49.324 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-10-03T10:07:49.485 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-10-03T10:07:49.488 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-10-03T10:07:49.549 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-10-03T10:07:49.550 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-10-03T10:07:50.892 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-10-03T10:07:50.895 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-10-03T10:07:54.510 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-10-03T10:07:54.550 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-10-03T10:07:54.753 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-10-03T10:07:54.958 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-10-03T10:07:55.153 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:07:55.231 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:07:55.395 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:07:55.499 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:07:55.634 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-10-03T10:07:55.685 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-10-03T10:07:55.691 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-10-03T10:07:55.845 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-10-03T10:07:55.901 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-10-03T10:07:56.062 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-10-03T10:07:56.119 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:07:56.203 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:07:56.271 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:07:56.453 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:07:56.487 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:07:56.551 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:07:56.686 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:07:56.741 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-10-03T10:07:56.976 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-10-03T10:07:57.097 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:07:57.128 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:07:57.286 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:07:57.405 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:07:57.503 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:07:57.603 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:07:57.694 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:07:57.699 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:07:58.105 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:07:58.201 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:07:58.278 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:07:58.377 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:07:58.386 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:07:58.611 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:07:58.714 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:07:58.761 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:07:58.961 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:07:58.976 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:07:59.028 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:07:59.136 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:07:59.266 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-10-03T10:07:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-10-03T10:07:59.498 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:07:59.611 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:07:59.644 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:07:59.705 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:07:59.747 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:07:59.919 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:07:59.946 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-10-03T10:08:00.038 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:08:00.143 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-10-03T10:08:00.217 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-10-03T10:08:00.294 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:08:00.394 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:08:00.403 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-10-03T10:08:00.519 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:08:00.536 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:08:00.651 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:08:00.711 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:08:00.859 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-10-03T10:08:00.868 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:08:01.030 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-10-03T10:08:01.169 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:08:01.303 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:08:01.427 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:08:01.465 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:08:01.686 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:08:02.062 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:08:02.227 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:08:02.305 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:08:02.510 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:08:02.839 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:08:02.985 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:08:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:08:03.603 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-10-03T10:08:03.724 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:08:03.838 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-10-03T10:08:04.044 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-10-03T10:08:04.049 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-10-03T10:08:04.261 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-10-03T10:08:04.498 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-10-03T10:08:04.553 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-10-03T10:08:04.677 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:08:04.733 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-10-03T10:08:04.911 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-10-03T10:08:05.130 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-10-03T10:08:05.335 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:08:06.491 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:08:06.806 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-10-03T10:08:07.027 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-10-03T10:08:07.202 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:08:07.281 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-10-03T10:08:07.526 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-10-03T10:08:07.531 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-10-03T10:08:07.713 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-10-03T10:08:07.792 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-10-03T10:08:07.972 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-10-03T10:08:08.036 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-10-03T10:08:08.232 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-10-03T10:08:08.245 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-10-03T10:08:08.470 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-10-03T10:08:08.481 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-10-03T10:08:08.735 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:08:08.743 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-10-03T10:08:08.817 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:08:08.942 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-10-03T10:08:08.993 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:08:09.064 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:08:09.160 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-10-03T10:08:09.251 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:08:09.343 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:08:09.426 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:08:09.635 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:08:09.697 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:08:09.825 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:08:09.868 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:08:10.094 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:08:10.108 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:08:10.312 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-10-03T10:08:10.381 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:08:10.603 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-10-03T10:08:10.668 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:08:10.684 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:08:10.849 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-10-03T10:08:10.880 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-10-03T10:08:11.047 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-10-03T10:08:11.124 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-10-03T10:08:11.236 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-10-03T10:08:11.408 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-10-03T10:08:11.492 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-10-03T10:08:11.572 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-10-03T10:08:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-10-03T10:08:11.745 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-10-03T10:08:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-10-03T10:08:11.937 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-10-03T10:08:12.114 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-10-03T10:08:12.180 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-10-03T10:08:12.330 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-10-03T10:08:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-10-03T10:08:12.499 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-10-03T10:08:12.541 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-10-03T10:08:12.693 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-10-03T10:08:12.783 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-10-03T10:08:12.843 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-10-03T10:08:13.032 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-10-03T10:08:13.072 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-10-03T10:08:13.295 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-10-03T10:08:13.302 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-10-03T10:08:13.506 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-10-03T10:08:13.518 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-10-03T10:08:13.710 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-10-03T10:08:13.738 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-10-03T10:08:13.936 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-10-03T10:08:13.950 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-10-03T10:08:14.152 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-10-03T10:08:14.233 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-10-03T10:08:14.402 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-10-03T10:08:14.627 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-10-03T10:08:14.782 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-10-03T10:08:14.921 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-10-03T10:08:15.058 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-10-03T10:08:15.161 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-10-03T10:08:15.279 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-10-03T10:08:15.414 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-10-03T10:08:15.502 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-10-03T10:08:15.630 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-10-03T10:08:15.740 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-10-03T10:08:16.691 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-10-03T10:08:16.874 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-10-03T10:08:16.975 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-10-03T10:08:17.117 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-10-03T10:08:17.225 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-10-03T10:08:17.313 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-10-03T10:08:17.459 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-10-03T10:08:17.543 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-10-03T10:08:17.728 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-10-03T10:08:17.794 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-10-03T10:08:17.964 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-10-03T10:08:17.970 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-10-03T10:08:18.243 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-10-03T10:08:18.265 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-10-03T10:08:18.447 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-10-03T10:08:18.480 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-10-03T10:08:18.577 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-10-03T10:08:18.635 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-10-03T10:08:18.748 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-10-03T10:08:18.917 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-10-03T10:08:19.041 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-10-03T10:08:19.220 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-10-03T10:08:19.262 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-10-03T10:08:19.396 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-10-03T10:08:19.454 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-10-03T10:08:19.621 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-10-03T10:08:19.636 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-10-03T10:08:19.792 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-10-03T10:08:19.864 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-10-03T10:08:20.035 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-10-03T10:08:20.085 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-10-03T10:08:20.278 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-10-03T10:08:20.297 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-10-03T10:08:20.506 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-10-03T10:08:20.587 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-10-03T10:08:20.661 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-10-03T10:08:20.766 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-10-03T10:08:20.880 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-10-03T10:08:20.963 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-10-03T10:08:21.156 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-10-03T10:08:21.172 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-10-03T10:08:21.441 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-10-03T10:08:21.476 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-10-03T10:08:21.566 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-10-03T10:08:21.717 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-10-03T10:08:21.875 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-10-03T10:08:23.996 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:24.257 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:24.449 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:24.691 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:24.980 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:25.283 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:08:25.397 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:08:25.429 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:08:25.565 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:08:25.741 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:08:25.853 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:08:26.049 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:08:43.717 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:08:43.717 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2023-10-03T10:08:43.717 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2023-10-03T10:08:43.717 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /dev 2023-10-03T10:08:43.717 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /run 2023-10-03T10:08:43.718 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2023-10-03T10:08:43.718 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2023-10-03T10:08:43.718 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2023-10-03T10:08:43.718 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2023-10-03T10:08:43.718 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /dev 2023-10-03T10:08:43.718 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:08:44.148 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:44.575 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:44.729 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:45.587 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:08:45.587 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2023-10-03T10:08:45.587 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2023-10-03T10:08:45.587 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-10-03T10:08:45.587 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /run 2023-10-03T10:08:45.588 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2023-10-03T10:08:45.588 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2023-10-03T10:08:45.588 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2023-10-03T10:08:45.588 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2023-10-03T10:08:45.588 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-10-03T10:08:45.588 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:08:46.022 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:46.213 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:46.437 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:46.445 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:08:46.473 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:46.647 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:46.686 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-10-03T10:08:47.034 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-10-03T10:08:47.335 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-10-03T10:08:47.529 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-10-03T10:08:47.756 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-10-03T10:08:47.886 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:47.968 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:48.126 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:08:48.156 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-10-03T10:08:48.252 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-10-03T10:08:48.355 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:48.389 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:08:48.623 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-10-03T10:08:48.946 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-10-03T10:08:49.270 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-10-03T10:08:49.366 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-10-03T10:08:49.522 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-10-03T10:08:49.653 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:49.749 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-10-03T10:08:49.955 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:50.042 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:08:50.224 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-10-03T10:08:50.362 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-10-03T10:08:50.697 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:50.869 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:50.968 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:51.403 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-10-03T10:08:51.420 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-10-03T10:08:51.637 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:51.663 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:51.704 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:51.878 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:51.889 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:52.742 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:08:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:53.001 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:08:53.386 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-10-03T10:08:53.637 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:53.663 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:08:53.821 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:08:56.523 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-10-03T10:08:57.742 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:08:57.994 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:08:58.382 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:08:58.466 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-10-03T10:08:58.568 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:58.662 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:08:59.561 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-10-03T10:08:59.695 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:08:59.823 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-10-03T10:08:59.987 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:09:00.049 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-10-03T10:09:00.230 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-10-03T10:09:00.386 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:09:00.401 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-10-03T10:09:00.579 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:09:00.583 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-10-03T10:09:00.672 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:09:00.904 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-10-03T10:09:01.161 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 119/136 2023-10-03T10:09:01.342 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:09:01.404 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:09:01.564 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-10-03T10:09:01.650 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:09:01.738 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:09:01.908 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-10-03T10:09:01.926 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:09:01.938 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:09:02.113 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-10-03T10:09:02.135 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-10-03T10:09:02.295 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-10-03T10:09:02.295 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:09:02.299 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-10-03T10:09:02.464 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-10-03T10:09:02.536 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:09:02.541 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:09:02.671 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:09:02.671 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:09:02.702 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-10-03T10:09:02.932 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:09:03.021 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-10-03T10:09:03.111 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-10-03T10:09:03.255 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 119/136 2023-10-03T10:09:03.272 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-10-03T10:09:03.414 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:09:03.494 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:09:03.535 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:09:03.535 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:09:03.778 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:09:03.795 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:09:03.795 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:09:03.871 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:09:03.978 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:09:03.978 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:09:04.080 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:09:04.093 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:09:04.161 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:09:04.161 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:09:04.271 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-10-03T10:09:04.361 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:09:04.361 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:09:04.445 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-10-03T10:09:04.446 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:09:04.553 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:09:04.730 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:09:04.736 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:09:04.743 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:09:04.914 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:09:04.915 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:09:05.194 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:09:05.298 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:09:05.298 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-10-03T10:09:05.298 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-10-03T10:09:05.298 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-10-03T10:09:05.298 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-10-03T10:09:05.298 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-10-03T10:09:05.299 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-10-03T10:09:05.299 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-10-03T10:09:05.299 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:09:05.299 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:09:05.299 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:09:05.299 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:09:05.299 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-10-03T10:09:05.299 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:09:05.299 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-10-03T10:09:05.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-10-03T10:09:05.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-10-03T10:09:05.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-10-03T10:09:05.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-10-03T10:09:05.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-10-03T10:09:05.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-10-03T10:09:05.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-10-03T10:09:05.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-10-03T10:09:05.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-10-03T10:09:05.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-10-03T10:09:05.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-10-03T10:09:05.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-10-03T10:09:05.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-10-03T10:09:05.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-10-03T10:09:05.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-10-03T10:09:05.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-10-03T10:09:05.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-10-03T10:09:05.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-10-03T10:09:05.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-10-03T10:09:05.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-10-03T10:09:05.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-10-03T10:09:05.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-10-03T10:09:05.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-10-03T10:09:05.302 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-10-03T10:09:05.302 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-10-03T10:09:05.302 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-10-03T10:09:05.302 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-10-03T10:09:05.302 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-10-03T10:09:05.302 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-10-03T10:09:05.302 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-10-03T10:09:05.302 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-10-03T10:09:05.302 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-10-03T10:09:05.302 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-10-03T10:09:05.302 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-10-03T10:09:05.303 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-10-03T10:09:05.303 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-10-03T10:09:05.303 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-10-03T10:09:05.303 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-10-03T10:09:05.303 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-10-03T10:09:05.303 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-10-03T10:09:05.303 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-10-03T10:09:05.303 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-10-03T10:09:05.303 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-10-03T10:09:05.303 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-10-03T10:09:05.304 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-10-03T10:09:05.304 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-10-03T10:09:05.304 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-10-03T10:09:05.304 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-10-03T10:09:05.304 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-10-03T10:09:05.304 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-10-03T10:09:05.304 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-10-03T10:09:05.304 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-10-03T10:09:05.304 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-10-03T10:09:05.304 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-10-03T10:09:05.304 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-10-03T10:09:05.305 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-10-03T10:09:05.305 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-10-03T10:09:05.305 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-10-03T10:09:05.305 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-10-03T10:09:05.305 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-10-03T10:09:05.305 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-10-03T10:09:05.305 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-10-03T10:09:05.305 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-10-03T10:09:05.305 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-10-03T10:09:05.305 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-10-03T10:09:05.306 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-10-03T10:09:05.306 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-10-03T10:09:05.306 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-10-03T10:09:05.306 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-10-03T10:09:05.306 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-10-03T10:09:05.306 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-10-03T10:09:05.306 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-10-03T10:09:05.306 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-10-03T10:09:05.306 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-10-03T10:09:05.306 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-10-03T10:09:05.307 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-10-03T10:09:05.307 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-10-03T10:09:05.307 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-10-03T10:09:05.307 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-10-03T10:09:05.307 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-10-03T10:09:05.307 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-10-03T10:09:05.307 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-10-03T10:09:05.307 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-10-03T10:09:05.307 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-10-03T10:09:05.307 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-10-03T10:09:05.307 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-10-03T10:09:05.307 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-10-03T10:09:05.308 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-10-03T10:09:05.308 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-10-03T10:09:05.308 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-10-03T10:09:05.308 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-10-03T10:09:05.308 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-10-03T10:09:05.308 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-10-03T10:09:05.308 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-10-03T10:09:05.308 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:09:05.308 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-10-03T10:09:05.308 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:09:05.308 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-10-03T10:09:05.309 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-10-03T10:09:05.309 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-10-03T10:09:05.309 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-10-03T10:09:05.309 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-10-03T10:09:05.309 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-10-03T10:09:05.309 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-10-03T10:09:05.309 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-10-03T10:09:05.309 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-10-03T10:09:05.309 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 121/136 2023-10-03T10:09:05.309 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-10-03T10:09:05.310 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-10-03T10:09:05.310 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-10-03T10:09:05.310 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-10-03T10:09:05.310 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-10-03T10:09:05.310 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-10-03T10:09:05.310 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-10-03T10:09:05.310 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-10-03T10:09:05.310 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:09:05.310 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-10-03T10:09:05.310 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:09:05.310 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-10-03T10:09:05.311 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:09:05.311 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-10-03T10:09:05.411 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-10-03T10:09:05.602 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-10-03T10:09:05.829 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:09:05.830 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:09:06.064 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:09:06.064 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:09:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:09:06.314 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:09:06.522 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:09:06.522 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:09:06.730 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:09:06.730 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:09:06.933 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:09:07.139 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:09:07.255 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-10-03T10:09:07.256 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:07.256 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2023-10-03T10:09:07.256 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-03T10:09:07.256 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-03T10:09:07.256 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-03T10:09:07.256 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-03T10:09:07.256 INFO:teuthology.orchestra.run.smithi119.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-03T10:09:07.256 INFO:teuthology.orchestra.run.smithi119.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-03T10:09:07.256 INFO:teuthology.orchestra.run.smithi119.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-03T10:09:07.256 INFO:teuthology.orchestra.run.smithi119.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-03T10:09:07.257 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.257 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.257 INFO:teuthology.orchestra.run.smithi119.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-03T10:09:07.257 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-03T10:09:07.257 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-03T10:09:07.257 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-03T10:09:07.257 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-10-03T10:09:07.257 INFO:teuthology.orchestra.run.smithi119.stdout: bison-3.0.4-10.el8.x86_64 2023-10-03T10:09:07.257 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.257 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.257 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.258 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.258 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:07.258 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.258 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.258 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:07.258 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:07.258 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:07.258 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:07.258 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.258 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.258 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:07.259 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.259 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.259 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.259 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-03T10:09:07.259 INFO:teuthology.orchestra.run.smithi119.stdout: flex-2.6.1-9.el8.x86_64 2023-10-03T10:09:07.259 INFO:teuthology.orchestra.run.smithi119.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-03T10:09:07.259 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-03T10:09:07.259 INFO:teuthology.orchestra.run.smithi119.stdout: jq-1.6-7.el8.x86_64 2023-10-03T10:09:07.259 INFO:teuthology.orchestra.run.smithi119.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-03T10:09:07.259 INFO:teuthology.orchestra.run.smithi119.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-03T10:09:07.259 INFO:teuthology.orchestra.run.smithi119.stdout: leveldb-1.22-1.el8.x86_64 2023-10-03T10:09:07.260 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.260 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.260 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.260 INFO:teuthology.orchestra.run.smithi119.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-03T10:09:07.260 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-03T10:09:07.260 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-03T10:09:07.260 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-03T10:09:07.260 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-03T10:09:07.260 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.260 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.260 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-03T10:09:07.260 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.261 INFO:teuthology.orchestra.run.smithi119.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-03T10:09:07.261 INFO:teuthology.orchestra.run.smithi119.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-03T10:09:07.261 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-03T10:09:07.261 INFO:teuthology.orchestra.run.smithi119.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-03T10:09:07.261 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-03T10:09:07.261 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-03T10:09:07.261 INFO:teuthology.orchestra.run.smithi119.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-03T10:09:07.261 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-03T10:09:07.261 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-03T10:09:07.261 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-03T10:09:07.261 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-03T10:09:07.262 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-03T10:09:07.262 INFO:teuthology.orchestra.run.smithi119.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-03T10:09:07.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-03T10:09:07.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-03T10:09:07.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-03T10:09:07.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-03T10:09:07.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-03T10:09:07.262 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-03T10:09:07.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-03T10:09:07.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-03T10:09:07.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-03T10:09:07.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-03T10:09:07.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-03T10:09:07.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-03T10:09:07.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-03T10:09:07.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-03T10:09:07.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-03T10:09:07.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-03T10:09:07.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-03T10:09:07.263 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-03T10:09:07.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-03T10:09:07.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-03T10:09:07.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-03T10:09:07.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-03T10:09:07.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-03T10:09:07.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-2.6-1.el8.noarch 2023-10-03T10:09:07.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-03T10:09:07.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-03T10:09:07.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-03T10:09:07.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-03T10:09:07.264 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-03T10:09:07.265 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-03T10:09:07.265 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.265 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.265 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-03T10:09:07.265 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-03T10:09:07.265 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.265 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-03T10:09:07.265 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-03T10:09:07.265 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-03T10:09:07.265 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-03T10:09:07.265 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-03T10:09:07.266 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-03T10:09:07.266 INFO:teuthology.orchestra.run.smithi119.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-03T10:09:07.266 INFO:teuthology.orchestra.run.smithi119.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-03T10:09:07.266 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-03T10:09:07.266 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-03T10:09:07.266 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-03T10:09:07.266 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-03T10:09:07.266 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-03T10:09:07.266 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.266 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.266 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:07.266 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-03T10:09:07.267 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-03T10:09:07.267 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-03T10:09:07.267 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:07.267 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-10-03T10:09:07.437 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:07.736 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:09:07.736 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:09:07.737 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-10-03T10:09:07.738 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-10-03T10:09:07.739 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-10-03T10:09:07.748 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-10-03T10:09:07.748 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-10-03T10:09:07.748 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-10-03T10:09:07.748 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-10-03T10:09:07.748 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-10-03T10:09:07.748 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-10-03T10:09:07.748 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-10-03T10:09:07.749 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-10-03T10:09:07.749 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-10-03T10:09:07.749 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-10-03T10:09:07.749 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-10-03T10:09:07.749 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-10-03T10:09:07.749 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-10-03T10:09:07.749 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-10-03T10:09:07.749 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-10-03T10:09:07.749 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-10-03T10:09:07.749 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-10-03T10:09:07.749 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-10-03T10:09:07.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-10-03T10:09:07.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-10-03T10:09:07.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-10-03T10:09:07.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-10-03T10:09:07.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-10-03T10:09:07.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-10-03T10:09:07.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-10-03T10:09:07.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-10-03T10:09:07.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-10-03T10:09:07.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-10-03T10:09:07.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-10-03T10:09:07.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-10-03T10:09:07.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-10-03T10:09:07.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-10-03T10:09:07.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-10-03T10:09:07.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-10-03T10:09:07.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-10-03T10:09:07.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-10-03T10:09:07.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-10-03T10:09:07.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-10-03T10:09:07.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-10-03T10:09:07.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-10-03T10:09:07.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-10-03T10:09:07.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-10-03T10:09:07.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-10-03T10:09:07.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-10-03T10:09:07.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-10-03T10:09:07.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-10-03T10:09:07.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-10-03T10:09:07.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-10-03T10:09:07.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-10-03T10:09:07.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-10-03T10:09:07.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-10-03T10:09:07.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-10-03T10:09:07.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-10-03T10:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-10-03T10:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-10-03T10:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-10-03T10:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-10-03T10:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-10-03T10:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-10-03T10:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-10-03T10:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-10-03T10:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-10-03T10:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-10-03T10:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-10-03T10:09:07.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-10-03T10:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-10-03T10:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-10-03T10:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-10-03T10:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-10-03T10:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-10-03T10:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-10-03T10:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-10-03T10:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-10-03T10:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-10-03T10:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-10-03T10:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-10-03T10:09:07.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-10-03T10:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-10-03T10:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-10-03T10:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-10-03T10:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-10-03T10:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-10-03T10:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-10-03T10:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-10-03T10:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-10-03T10:09:07.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-10-03T10:09:07.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-10-03T10:09:07.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-10-03T10:09:07.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 121/136 2023-10-03T10:09:07.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-10-03T10:09:07.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-10-03T10:09:07.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-10-03T10:09:07.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-10-03T10:09:07.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-10-03T10:09:07.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-10-03T10:09:07.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-10-03T10:09:07.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-10-03T10:09:07.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:09:07.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-10-03T10:09:07.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:09:07.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-10-03T10:09:07.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:09:07.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-10-03T10:09:09.735 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-10-03T10:09:09.736 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:09.736 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2023-10-03T10:09:09.736 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-03T10:09:09.736 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-03T10:09:09.736 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-03T10:09:09.736 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-03T10:09:09.736 INFO:teuthology.orchestra.run.smithi072.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-03T10:09:09.736 INFO:teuthology.orchestra.run.smithi072.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-03T10:09:09.736 INFO:teuthology.orchestra.run.smithi072.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-03T10:09:09.737 INFO:teuthology.orchestra.run.smithi072.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-03T10:09:09.737 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.737 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.737 INFO:teuthology.orchestra.run.smithi072.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-03T10:09:09.737 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-03T10:09:09.737 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-03T10:09:09.737 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-03T10:09:09.737 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2023-10-03T10:09:09.737 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.0.4-10.el8.x86_64 2023-10-03T10:09:09.737 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.737 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.737 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:09:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-03T10:09:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.1-9.el8.x86_64 2023-10-03T10:09:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-03T10:09:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-03T10:09:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: jq-1.6-7.el8.x86_64 2023-10-03T10:09:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-03T10:09:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-03T10:09:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: leveldb-1.22-1.el8.x86_64 2023-10-03T10:09:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-03T10:09:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-03T10:09:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-03T10:09:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-03T10:09:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-03T10:09:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-03T10:09:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-03T10:09:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-03T10:09:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-03T10:09:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-03T10:09:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-03T10:09:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-03T10:09:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-03T10:09:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-03T10:09:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-03T10:09:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-03T10:09:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-03T10:09:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-03T10:09:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-03T10:09:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-03T10:09:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-03T10:09:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-03T10:09:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-03T10:09:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-03T10:09:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-03T10:09:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-03T10:09:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-03T10:09:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-03T10:09:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-03T10:09:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-03T10:09:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-03T10:09:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-03T10:09:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-03T10:09:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-03T10:09:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-03T10:09:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-03T10:09:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-03T10:09:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-03T10:09:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-03T10:09:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-03T10:09:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-03T10:09:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-03T10:09:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-2.6-1.el8.noarch 2023-10-03T10:09:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-03T10:09:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-03T10:09:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-03T10:09:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-03T10:09:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-03T10:09:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-03T10:09:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-03T10:09:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-03T10:09:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-03T10:09:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-03T10:09:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-03T10:09:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-03T10:09:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-03T10:09:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-03T10:09:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-03T10:09:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-03T10:09:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-03T10:09:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-03T10:09:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-03T10:09:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-03T10:09:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-03T10:09:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:09:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-03T10:09:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-03T10:09:09.747 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-03T10:09:09.747 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:09.747 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-10-03T10:09:09.958 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:09.958 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:09:09.959 INFO:teuthology.packaging:ref: None 2023-10-03T10:09:09.959 INFO:teuthology.packaging:tag: None 2023-10-03T10:09:09.959 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:09:09.959 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:09:09.959 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:09:10.186 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:09:10.210 INFO:teuthology.orchestra.run.smithi072.stdout:16.2.14-44.geeb13ac9.el8 2023-10-03T10:09:10.210 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-10-03T10:09:10.210 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-10-03T10:09:10.211 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:09:10.211 INFO:teuthology.packaging:ref: None 2023-10-03T10:09:10.211 INFO:teuthology.packaging:tag: None 2023-10-03T10:09:10.211 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:09:10.211 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:09:10.211 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:09:10.515 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:09:10.544 INFO:teuthology.orchestra.run.smithi119.stdout:16.2.14-44.geeb13ac9.el8 2023-10-03T10:09:10.544 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-10-03T10:09:10.544 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-10-03T10:09:10.544 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-03T10:09:10.545 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:10.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-03T10:09:10.575 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-10-03T10:09:10.576 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-03T10:09:10.620 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-03T10:09:10.620 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:10.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2023-10-03T10:09:10.647 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-03T10:09:10.714 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-10-03T10:09:10.715 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2023-10-03T10:09:10.745 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-03T10:09:10.813 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-03T10:09:10.813 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:10.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-03T10:09:10.840 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-03T10:09:10.907 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-10-03T10:09:10.907 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-03T10:09:10.937 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-03T10:09:11.005 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-03T10:09:11.005 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:11.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2023-10-03T10:09:11.032 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-03T10:09:11.099 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-10-03T10:09:11.099 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2023-10-03T10:09:11.128 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-03T10:09:11.197 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:09:11.209 INFO:teuthology.task.print:**** done installing pacific 2023-10-03T10:09:11.209 INFO:teuthology.run_tasks:Running task ceph... 2023-10-03T10:09:11.313 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-03T10:09:11.314 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2023-10-03T10:09:11.316 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2023-10-03T10:09:11.345 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-03T10:09:11.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-03T10:09:11.383 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-03T10:09:11.412 INFO:tasks.ceph:Creating extra log directories... 2023-10-03T10:09:11.412 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-03T10:09:11.452 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-03T10:09:11.489 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-03T10:09:11.490 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-03T10:09:11.490 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573', 'branch': 'fix-nfs-apply-err-reporting', 'description': 'fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}}', 'email': None, 'first_in_suite': False, 'job_id': '7409573', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'fix-nfs-apply-err-reporting'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'dry_run': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62953', 'sha1': 'a6297898cc696a7db13e71aaa0b24c78a4c800c5'}}, 'owner': 'scheduled_dparmar@teuthology', 'priority': 55, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0']], 'seed': 6051, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'sleep_before_teardown': 0, 'suite': 'fs:upgrade', 'suite_branch': 'wip-62953', 'suite_path': '/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/dparmar18/ceph', 'suite_sha1': 'a6297898cc696a7db13e71aaa0b24c78a4c800c5', 'targets': {'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPfP9tnAMamE3Fl+b+77jHnwhMvEsyPJvhQeBm52/HeWDw4zKhS1nLPe+WvZ1BCeHtrP1rMdwfUOTRQ3u1vcOcM=', 'smithi119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDdUQPzKTAiEAIAiiGvKrXKFTcQUH0/kbWZc2nUWH5/yuUO5D4vM9P02dkNXCqv3QvnHP5kU5YSVicX3N1foee8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, {'print': '**** done installing pacific'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'flavor': 'default', 'fs': 'xfs', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client pacific']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': {'branch': 'reef'}}}, {'print': '**** done install.upgrade the host'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph osd dump -f json-pretty', 'ceph versions', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done', 'ceph osd require-osd-release reef']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'ceph-fuse': {'client.0': {'mounted': False}}}, {'print': '**** done unmount client.0'}, {'install.upgrade': {'client.0': None}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.0': None}}, {'print': '**** done remount client.0'}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology': {'branch': 'pacific', 'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end", 'if not is_fuse() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-03_09:48:43', 'tube': 'smithi', 'user': 'dparmar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-03T10:09:11.491 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-03T10:09:11.518 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-03T10:09:11.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2023-10-03T10:09:11.577 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2023-10-03T10:09:11.606 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:11.606 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2023-10-03T10:09:11.659 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-03T10:09:11.659 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2023-10-03T10:09:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-03T10:09:11.717 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:09:11.717 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 393578 Links: 1 2023-10-03T10:09:11.717 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:09:11.717 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:09:11.718 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-03 10:09:07.395209488 +0000 2023-10-03T10:09:11.718 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-03 10:06:10.515481808 +0000 2023-10-03T10:09:11.718 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-03 10:06:10.515481808 +0000 2023-10-03T10:09:11.718 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-03T10:09:11.718 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-03T10:09:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-03T10:09:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-03T10:09:11.783 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000227601 s, 2.2 MB/s 2023-10-03T10:09:11.784 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-03T10:09:11.843 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2023-10-03T10:09:11.901 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-03T10:09:11.901 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:09:11.901 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 387742 Links: 1 2023-10-03T10:09:11.901 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:09:11.901 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:09:11.901 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-03 10:09:07.395209488 +0000 2023-10-03T10:09:11.901 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-03 10:06:11.037471346 +0000 2023-10-03T10:09:11.901 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-03 10:06:11.037471346 +0000 2023-10-03T10:09:11.902 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-03T10:09:11.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-03T10:09:11.966 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-03T10:09:11.966 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-03T10:09:11.966 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000195807 s, 2.6 MB/s 2023-10-03T10:09:11.967 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-03T10:09:12.025 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2023-10-03T10:09:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-03T10:09:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:09:12.083 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 387804 Links: 1 2023-10-03T10:09:12.084 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:09:12.084 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:09:12.084 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-03 10:09:07.395209488 +0000 2023-10-03T10:09:12.084 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-03 10:06:11.548461104 +0000 2023-10-03T10:09:12.084 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-03 10:06:11.548461104 +0000 2023-10-03T10:09:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-03T10:09:12.084 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-03T10:09:12.148 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-03T10:09:12.148 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-03T10:09:12.149 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000215668 s, 2.4 MB/s 2023-10-03T10:09:12.149 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-03T10:09:12.208 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2023-10-03T10:09:12.266 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-03T10:09:12.267 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:09:12.267 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 387904 Links: 1 2023-10-03T10:09:12.267 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:09:12.267 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:09:12.267 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-03 10:09:07.396209468 +0000 2023-10-03T10:09:12.267 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-03 10:06:12.062450802 +0000 2023-10-03T10:09:12.267 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-03 10:06:12.062450802 +0000 2023-10-03T10:09:12.267 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-03T10:09:12.268 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-03T10:09:12.333 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-03T10:09:12.333 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-03T10:09:12.333 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.00023274 s, 2.2 MB/s 2023-10-03T10:09:12.334 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-03T10:09:12.393 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:09:12.393 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-10-03T10:09:12.393 INFO:tasks.ceph:Generating config... 2023-10-03T10:09:12.394 INFO:tasks.ceph:[global] mon warn on pool no app = False 2023-10-03T10:09:12.394 INFO:tasks.ceph:[global] ms bind msgr2 = False 2023-10-03T10:09:12.394 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2023-10-03T10:09:12.394 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2023-10-03T10:09:12.395 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-10-03T10:09:12.395 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-03T10:09:12.395 INFO:tasks.ceph:[client] debug client = 20 2023-10-03T10:09:12.395 INFO:tasks.ceph:[client] debug ms = 1 2023-10-03T10:09:12.395 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-03T10:09:12.395 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-03T10:09:12.395 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-03T10:09:12.395 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-03T10:09:12.395 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-03T10:09:12.395 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-03T10:09:12.395 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-03T10:09:12.395 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-03T10:09:12.395 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-03T10:09:12.396 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-03T10:09:12.396 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-03T10:09:12.396 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-03T10:09:12.396 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-03T10:09:12.396 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-03T10:09:12.396 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-03T10:09:12.396 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-03T10:09:12.396 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-03T10:09:12.396 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-03T10:09:12.396 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2023-10-03T10:09:12.396 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-03T10:09:12.396 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-03T10:09:12.397 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-03T10:09:12.397 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-03T10:09:12.397 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-03T10:09:12.397 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-03T10:09:12.397 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-03T10:09:12.397 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-03T10:09:12.397 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-03T10:09:12.397 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-03T10:09:12.397 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-03T10:09:12.397 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-03T10:09:12.397 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-03T10:09:12.397 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-03T10:09:12.398 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-03T10:09:12.398 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-03T10:09:12.398 INFO:tasks.ceph:Setting up mon.a... 2023-10-03T10:09:12.398 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-03T10:09:12.588 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.keyring 2023-10-03T10:09:12.590 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-03T10:09:12.631 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T10:09:12.698 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.72'), ('mon.b', '[v2:172.21.15.72:3301,v1:172.21.15.72:6790]'), ('mon.c', '[v2:172.21.15.72:3302,v1:172.21.15.72:6791]')] 2023-10-03T10:09:12.698 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.72,[v2:172.21.15.72:3301,v1:172.21.15.72:6790],[v2:172.21.15.72:3302,v1:172.21.15.72:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-03T10:09:12.699 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:12.699 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-03T10:09:12.756 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.72 --addv b '[v2:172.21.15.72:3301,v1:172.21.15.72:6790]' --addv c '[v2:172.21.15.72:3302,v1:172.21.15.72:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:12.840 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:12.840 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: generated fsid 33894c9a-ea73-4e47-9ce0-b9e281957c98 2023-10-03T10:09:12.840 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 0 2023-10-03T10:09:12.840 INFO:teuthology.orchestra.run.smithi072.stdout:fsid 33894c9a-ea73-4e47-9ce0-b9e281957c98 2023-10-03T10:09:12.840 INFO:teuthology.orchestra.run.smithi072.stdout:last_changed 2023-10-03T10:09:12.840825+0000 2023-10-03T10:09:12.840 INFO:teuthology.orchestra.run.smithi072.stdout:created 2023-10-03T10:09:12.840825+0000 2023-10-03T10:09:12.840 INFO:teuthology.orchestra.run.smithi072.stdout:min_mon_release 0 (unknown) 2023-10-03T10:09:12.840 INFO:teuthology.orchestra.run.smithi072.stdout:election_strategy: 1 2023-10-03T10:09:12.840 INFO:teuthology.orchestra.run.smithi072.stdout:0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2023-10-03T10:09:12.840 INFO:teuthology.orchestra.run.smithi072.stdout:1: [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] mon.b 2023-10-03T10:09:12.840 INFO:teuthology.orchestra.run.smithi072.stdout:2: [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] mon.c 2023-10-03T10:09:12.841 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-03T10:09:12.841 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-03T10:09:12.859 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 33894c9a-ea73-4e47-9ce0-b9e281957c98... 2023-10-03T10:09:12.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-03T10:09:12.902 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-03T10:09:12.944 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2023-10-03T10:09:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2023-10-03T10:09:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-03T10:09:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2023-10-03T10:09:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2023-10-03T10:09:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2023-10-03T10:09:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.944 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2023-10-03T10:09:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2023-10-03T10:09:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2023-10-03T10:09:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2023-10-03T10:09:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-03T10:09:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2023-10-03T10:09:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2023-10-03T10:09:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-03T10:09:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.945 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2023-10-03T10:09:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2023-10-03T10:09:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2023-10-03T10:09:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2023-10-03T10:09:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2023-10-03T10:09:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2023-10-03T10:09:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2023-10-03T10:09:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2023-10-03T10:09:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-03T10:09:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-03T10:09:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2023-10-03T10:09:12.946 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-03T10:09:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2023-10-03T10:09:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2023-10-03T10:09:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2023-10-03T10:09:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2023-10-03T10:09:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2023-10-03T10:09:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.72,[v2:172.21.15.72:3301,v1:172.21.15.72:6790],[v2:172.21.15.72:3302,v1:172.21.15.72:6791]" 2023-10-03T10:09:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on pool no app = False 2023-10-03T10:09:12.947 INFO:teuthology.orchestra.run.smithi072.stdout: ms bind msgr2 = False 2023-10-03T10:09:12.948 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore warn on legacy statfs = False 2023-10-03T10:09:12.948 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore warn on no per pool omap = False 2023-10-03T10:09:12.948 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn min per osd = 0 2023-10-03T10:09:12.948 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 33894c9a-ea73-4e47-9ce0-b9e281957c98 2023-10-03T10:09:12.948 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.948 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2023-10-03T10:09:12.948 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2023-10-03T10:09:12.948 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.948 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2023-10-03T10:09:12.948 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2023-10-03T10:09:12.948 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2023-10-03T10:09:12.948 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.948 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2023-10-03T10:09:12.949 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2023-10-03T10:09:12.949 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.949 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2023-10-03T10:09:12.949 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2023-10-03T10:09:12.949 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2023-10-03T10:09:12.949 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.949 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2023-10-03T10:09:12.949 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2023-10-03T10:09:12.949 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.949 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2023-10-03T10:09:12.949 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.949 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2023-10-03T10:09:12.950 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.950 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2023-10-03T10:09:12.950 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.950 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2023-10-03T10:09:12.950 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2023-10-03T10:09:12.950 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.950 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2023-10-03T10:09:12.950 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2023-10-03T10:09:12.950 INFO:teuthology.orchestra.run.smithi072.stdout: bdev async discard = True 2023-10-03T10:09:12.950 INFO:teuthology.orchestra.run.smithi072.stdout: bdev enable discard = True 2023-10-03T10:09:12.950 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore allocator = bitmap 2023-10-03T10:09:12.950 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2023-10-03T10:09:12.951 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2023-10-03T10:09:12.951 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 1/20 2023-10-03T10:09:12.951 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 1/20 2023-10-03T10:09:12.951 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-03T10:09:12.951 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2023-10-03T10:09:12.951 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 4/10 2023-10-03T10:09:12.951 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2023-10-03T10:09:12.951 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2023-10-03T10:09:12.951 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2023-10-03T10:09:12.951 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2023-10-03T10:09:12.951 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2023-10-03T10:09:12.951 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-10-03T10:09:12.951 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.952 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2023-10-03T10:09:12.952 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-03T10:09:12.952 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2023-10-03T10:09:12.952 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-10-03T10:09:12.952 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-10-03T10:09:12.952 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:09:12.952 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:09:12.952 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2023-10-03T10:09:12.952 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.952 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2023-10-03T10:09:12.952 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-03T10:09:12.952 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-10-03T10:09:12.952 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2023-10-03T10:09:12.953 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-10-03T10:09:12.953 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2023-10-03T10:09:12.953 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2023-10-03T10:09:12.953 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:09:12.953 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2023-10-03T10:09:12.953 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2023-10-03T10:09:12.953 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:09:12.953 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.953 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-03T10:09:12.953 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2023-10-03T10:09:12.953 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2023-10-03T10:09:12.953 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.953 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2023-10-03T10:09:12.954 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-03T10:09:12.954 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-03T10:09:12.954 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.954 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2023-10-03T10:09:12.954 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2023-10-03T10:09:12.954 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.954 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2023-10-03T10:09:12.954 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2023-10-03T10:09:12.954 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = False 2023-10-03T10:09:12.954 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:12.954 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2023-10-03T10:09:12.954 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2023-10-03T10:09:12.955 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2023-10-03T10:09:12.955 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2023-10-03T10:09:12.955 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-03T10:09:12.955 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-03T10:09:12.955 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2023-10-03T10:09:12.955 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2023-10-03T10:09:12.955 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-03T10:09:12.955 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-10-03T10:09:12.955 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-10-03T10:09:12.955 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2023-10-03T10:09:12.955 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2023-10-03T10:09:12.955 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2023-10-03T10:09:12.955 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-10-03T10:09:12.956 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2023-10-03T10:09:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2023-10-03T10:09:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds balancer = 20 2023-10-03T10:09:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-03T10:09:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2023-10-03T10:09:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2023-10-03T10:09:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2023-10-03T10:09:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2023-10-03T10:09:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-10-03T10:09:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-10-03T10:09:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-10-03T10:09:12.957 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2023-10-03T10:09:12.957 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2023-10-03T10:09:12.957 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-03T10:09:12.957 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2023-10-03T10:09:12.957 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.957 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2023-10-03T10:09:12.957 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.958 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2023-10-03T10:09:12.958 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.958 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2023-10-03T10:09:12.958 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2023-10-03T10:09:12.958 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.958 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2023-10-03T10:09:12.958 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2023-10-03T10:09:12.958 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.958 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-03T10:09:12.958 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2023-10-03T10:09:12.958 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.958 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2023-10-03T10:09:12.959 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-03T10:09:12.959 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.959 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2023-10-03T10:09:12.959 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.959 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2023-10-03T10:09:12.959 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2023-10-03T10:09:12.959 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2023-10-03T10:09:12.959 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2023-10-03T10:09:12.960 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2023-10-03T10:09:12.960 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2023-10-03T10:09:12.960 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2023-10-03T10:09:12.960 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-03T10:09:12.960 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-03T10:09:12.960 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2023-10-03T10:09:12.960 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.960 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-03T10:09:12.961 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.961 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2023-10-03T10:09:12.961 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.961 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2023-10-03T10:09:12.961 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.961 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2023-10-03T10:09:12.961 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2023-10-03T10:09:12.961 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2023-10-03T10:09:12.961 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.72,[v2:172.21.15.72:3301,v1:172.21.15.72:6790],[v2:172.21.15.72:3302,v1:172.21.15.72:6791]" 2023-10-03T10:09:12.962 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on pool no app = False 2023-10-03T10:09:12.962 INFO:teuthology.orchestra.run.smithi119.stdout: ms bind msgr2 = False 2023-10-03T10:09:12.962 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore warn on legacy statfs = False 2023-10-03T10:09:12.962 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore warn on no per pool omap = False 2023-10-03T10:09:12.962 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn min per osd = 0 2023-10-03T10:09:12.962 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = 33894c9a-ea73-4e47-9ce0-b9e281957c98 2023-10-03T10:09:12.962 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.962 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2023-10-03T10:09:12.963 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2023-10-03T10:09:12.963 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.963 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2023-10-03T10:09:12.963 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2023-10-03T10:09:12.963 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2023-10-03T10:09:12.963 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.963 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2023-10-03T10:09:12.963 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2023-10-03T10:09:12.963 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.964 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2023-10-03T10:09:12.964 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2023-10-03T10:09:12.964 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2023-10-03T10:09:12.964 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.964 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2023-10-03T10:09:12.964 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2023-10-03T10:09:12.964 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.964 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2023-10-03T10:09:12.964 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.965 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2023-10-03T10:09:12.965 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.965 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2023-10-03T10:09:12.965 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.965 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2023-10-03T10:09:12.965 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2023-10-03T10:09:12.965 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.965 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2023-10-03T10:09:12.965 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2023-10-03T10:09:12.966 INFO:teuthology.orchestra.run.smithi119.stdout: bdev async discard = True 2023-10-03T10:09:12.966 INFO:teuthology.orchestra.run.smithi119.stdout: bdev enable discard = True 2023-10-03T10:09:12.966 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore allocator = bitmap 2023-10-03T10:09:12.966 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2023-10-03T10:09:12.966 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2023-10-03T10:09:12.966 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 1/20 2023-10-03T10:09:12.966 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 1/20 2023-10-03T10:09:12.966 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-10-03T10:09:12.967 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2023-10-03T10:09:12.967 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 4/10 2023-10-03T10:09:12.967 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2023-10-03T10:09:12.967 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2023-10-03T10:09:12.967 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2023-10-03T10:09:12.967 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2023-10-03T10:09:12.967 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2023-10-03T10:09:12.967 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2023-10-03T10:09:12.968 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.968 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2023-10-03T10:09:12.968 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-10-03T10:09:12.968 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2023-10-03T10:09:12.968 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-10-03T10:09:12.968 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-10-03T10:09:12.968 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:09:12.968 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:09:12.969 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2023-10-03T10:09:12.969 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.969 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2023-10-03T10:09:12.969 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-10-03T10:09:12.969 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-10-03T10:09:12.969 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2023-10-03T10:09:12.969 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-10-03T10:09:12.969 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2023-10-03T10:09:12.969 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2023-10-03T10:09:12.970 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:09:12.970 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2023-10-03T10:09:12.970 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2023-10-03T10:09:12.970 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:09:12.970 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.970 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-03T10:09:12.970 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2023-10-03T10:09:12.970 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2023-10-03T10:09:12.971 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.971 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2023-10-03T10:09:12.971 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-03T10:09:12.971 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-03T10:09:12.971 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.971 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2023-10-03T10:09:12.971 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2023-10-03T10:09:12.971 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.972 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2023-10-03T10:09:12.972 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2023-10-03T10:09:12.972 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = False 2023-10-03T10:09:12.972 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-10-03T10:09:12.972 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2023-10-03T10:09:12.972 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2023-10-03T10:09:12.972 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2023-10-03T10:09:12.972 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2023-10-03T10:09:12.972 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-03T10:09:12.973 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-03T10:09:12.973 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2023-10-03T10:09:12.973 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2023-10-03T10:09:12.973 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-10-03T10:09:12.973 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2023-10-03T10:09:12.973 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2023-10-03T10:09:12.973 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2023-10-03T10:09:12.973 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2023-10-03T10:09:12.974 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2023-10-03T10:09:12.974 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2023-10-03T10:09:12.974 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2023-10-03T10:09:12.974 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2023-10-03T10:09:12.974 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds balancer = 20 2023-10-03T10:09:12.974 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-10-03T10:09:12.974 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2023-10-03T10:09:12.974 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2023-10-03T10:09:12.974 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2023-10-03T10:09:12.975 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2023-10-03T10:09:12.975 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2023-10-03T10:09:12.975 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2023-10-03T10:09:12.975 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2023-10-03T10:09:12.976 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-03T10:09:12.976 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-03T10:09:13.069 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-03T10:09:13.069 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:13.069 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-03T10:09:13.087 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:13.087 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-03T10:09:13.145 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2023-10-03T10:09:13.145 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:13.145 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-03T10:09:13.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T10:09:13.221 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:13.222 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:13.279 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2023-10-03T10:09:13.279 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-10-03T10:09:13.279 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-03T10:09:13.279 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T10:09:13.321 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-10-03T10:09:13.322 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:13.381 INFO:tasks.ceph:Setting up mon nodes... 2023-10-03T10:09:13.381 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-03T10:09:13.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-03T10:09:13.431 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-03T10:09:13.433 INFO:tasks.ceph:Setting up mds nodes... 2023-10-03T10:09:13.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T10:09:13.482 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T10:09:13.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-03T10:09:13.511 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-03T10:09:13.511 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-03T10:09:13.626 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-03T10:09:13.639 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-03T10:09:13.639 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-10-03T10:09:13.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-03T10:09:13.665 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:09:13.665 INFO:tasks.ceph:role: osd.0 2023-10-03T10:09:13.666 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-03T10:09:13.666 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-03T10:09:13.739 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:09:13.739 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:09:13.739 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:09:13.740 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:09:13.740 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:09:13.740 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:09:13.740 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:09:13.740 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:09:13.740 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:09:13.740 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:09:14.160 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-03T10:09:14.162 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-03T10:09:14.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-03T10:09:14.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-03T10:09:14.351 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-03T10:09:14.419 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:09:14.419 INFO:tasks.ceph:role: osd.1 2023-10-03T10:09:14.420 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-03T10:09:14.420 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-03T10:09:14.493 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:09:14.494 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:09:14.494 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:09:14.494 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:09:14.494 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:09:14.494 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:09:14.494 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:09:14.494 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:09:14.494 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:09:14.494 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:09:14.912 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-03T10:09:14.914 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-03T10:09:14.914 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-03T10:09:14.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-03T10:09:15.031 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-03T10:09:15.097 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:09:15.097 INFO:tasks.ceph:role: osd.2 2023-10-03T10:09:15.098 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-03T10:09:15.098 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-03T10:09:15.172 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:09:15.172 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:09:15.172 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:09:15.172 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:09:15.172 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:09:15.172 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:09:15.172 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:09:15.173 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:09:15.173 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:09:15.173 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:09:15.621 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-03T10:09:15.623 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-03T10:09:15.623 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-03T10:09:15.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-03T10:09:15.769 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-03T10:09:15.837 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:09:15.837 INFO:tasks.ceph:role: osd.3 2023-10-03T10:09:15.837 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-03T10:09:15.838 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-03T10:09:15.912 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:09:15.912 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:09:15.912 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:09:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:09:15.913 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:09:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:09:15.913 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:09:15.913 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:09:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:09:15.913 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:09:16.357 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-03T10:09:16.358 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-03T10:09:16.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-03T10:09:16.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-03T10:09:16.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:16.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:16.677+0000 7fcc2c6a5200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-03T10:09:16.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:16.680+0000 7fcc2c6a5200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-03T10:09:16.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:16.680+0000 7fcc2c6a5200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T10:09:16.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:16.680+0000 7fcc2c6a5200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T10:09:16.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:16.680+0000 7fcc2c6a5200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T10:09:16.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:16.684+0000 7fcc2c6a5200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-03T10:09:19.528 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-03T10:09:19.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:19.647+0000 7f1f2fb63200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-03T10:09:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:19.648+0000 7f1f2fb63200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-03T10:09:19.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:19.648+0000 7f1f2fb63200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T10:09:19.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:19.648+0000 7f1f2fb63200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T10:09:19.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:19.648+0000 7f1f2fb63200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T10:09:19.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:19.648+0000 7f1f2fb63200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-03T10:09:22.503 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-03T10:09:22.536 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:22.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:22.623+0000 7f102c6aa200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-03T10:09:22.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:22.623+0000 7f102c6aa200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-03T10:09:22.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:22.623+0000 7f102c6aa200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T10:09:22.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:22.623+0000 7f102c6aa200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T10:09:22.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:22.624+0000 7f102c6aa200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T10:09:22.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:22.624+0000 7f102c6aa200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-03T10:09:25.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-03T10:09:25.501 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:25.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:25.589+0000 7fc59ae72200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-03T10:09:25.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:25.590+0000 7fc59ae72200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-03T10:09:25.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:25.590+0000 7fc59ae72200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T10:09:25.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:25.590+0000 7fc59ae72200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T10:09:25.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:25.590+0000 7fc59ae72200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T10:09:25.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:25.590+0000 7fc59ae72200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-03T10:09:28.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-03T10:09:28.468 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-03T10:09:28.468 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:28.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-03T10:09:28.539 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:28.539 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-03T10:09:28.607 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:28.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-03T10:09:28.675 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:28.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-03T10:09:28.744 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:28.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-03T10:09:28.812 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:28.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-03T10:09:28.880 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-10-03T10:09:28.880 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-03T10:09:28.903 INFO:tasks.ceph:Adding keys to all mons... 2023-10-03T10:09:28.903 DEBUG:teuthology.orchestra.run.smithi072:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-03T10:09:28.946 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.x] 2023-10-03T10:09:28.946 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBJ6BtlbsbBGRAAAB1lp69saA1XnWvZqdrdUA== 2023-10-03T10:09:28.946 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-10-03T10:09:28.946 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBJ6BtlNULMHBAAwHSqVaqHcsL188RsVe0c8w== 2023-10-03T10:09:28.946 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.0] 2023-10-03T10:09:28.947 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBM6Btlu/VtKBAA3E7AtAH6trCeAAAN1FQWqg== 2023-10-03T10:09:28.947 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.1] 2023-10-03T10:09:28.947 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBP6BtlQn+yJhAAfurUZ3Y4TYTO0gjY7q6Ppg== 2023-10-03T10:09:28.947 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.2] 2023-10-03T10:09:28.947 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBS6Btla3hBJRAA3rh0Ic94KmEWcqczcJLmFw== 2023-10-03T10:09:28.947 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.3] 2023-10-03T10:09:28.947 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBV6BtlOuY8IxAA+GZpjAoasA9sjBUu2REJvA== 2023-10-03T10:09:28.947 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2023-10-03T10:09:28.947 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBJ6BtlC/9fJRAA+KhA6BAqfBpFNMjfBxx+fA== 2023-10-03T10:09:28.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-03T10:09:29.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-03T10:09:29.155 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:09:29.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:09:29.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:09:29.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:09:29.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-03T10:09:29.870 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-03T10:09:29.888 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-03T10:09:29.915 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T10:09:30.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-03T10:09:30.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-03T10:09:30.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T10:09:30.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-03T10:09:30.255 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-03T10:09:30.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T10:09:30.414 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-03T10:09:30.441 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:09:30.498 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-03T10:09:30.498 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-03T10:09:30.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-03T10:09:30.540 INFO:tasks.ceph.mon.a:Started 2023-10-03T10:09:30.541 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-03T10:09:30.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-03T10:09:30.542 INFO:tasks.ceph.mon.b:Started 2023-10-03T10:09:30.543 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-03T10:09:30.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-03T10:09:30.544 INFO:tasks.ceph.mon.c:Started 2023-10-03T10:09:30.545 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-03T10:09:30.545 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-03T10:09:30.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-03T10:09:30.547 INFO:tasks.ceph.mgr.x:Started 2023-10-03T10:09:30.547 INFO:tasks.ceph:Setting crush tunables to default 2023-10-03T10:09:30.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd crush tunables default 2023-10-03T10:09:30.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.678+0000 7f915fbe7700 1 Processor -- start 2023-10-03T10:09:30.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.678+0000 7f915fbe7700 1 -- start start 2023-10-03T10:09:30.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915fbe7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9158068980 0x7f915812cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915fbe7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 0x7f915812f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915fbe7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91580690b0 con 0x7f9158067e90 2023-10-03T10:09:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915fbe7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91580920e0 con 0x7f9158068980 2023-10-03T10:09:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915fbe7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9158092330 con 0x7f915812d2d0 2023-10-03T10:09:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915d182700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9158068980 0x7f915812cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915e184700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 0x7f915812f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915d182700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9158068980 0x7f915812cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41220/0 (socket says 172.21.15.72:41220) 2023-10-03T10:09:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915d983700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9158067e90 0x7f9158068270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41706/0 (socket says 172.21.15.72:41706) 2023-10-03T10:09:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915d182700 1 -- 172.21.15.72:0/836394187 learned_addr learned my addr 172.21.15.72:0/836394187 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915d182700 1 -- 172.21.15.72:0/836394187 >> v2:172.21.15.72:3300/0 conn(0x7f9158068980 msgr2=0x7f915812cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:09:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915d182700 1 -- 172.21.15.72:0/836394187 >> v2:172.21.15.72:3300/0 conn(0x7f9158068980 msgr2=0x7f915812cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915d182700 1 --2- 172.21.15.72:0/836394187 >> v2:172.21.15.72:3300/0 conn(0x7f9158068980 0x7f915812cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915e184700 1 -- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 msgr2=0x7f915812f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T10:09:30.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915e184700 1 -- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 msgr2=0x7f915812f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:30.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915e184700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 0x7f915812f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:30.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915d182700 1 --2- 172.21.15.72:0/836394187 >> v2:172.21.15.72:3300/0 conn(0x7f9158068980 0x7f915812cde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:09:30.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.679+0000 7f915e184700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 0x7f915812f6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:09:30.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.880+0000 7f915e184700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 0x7f915812f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.880+0000 7f915e184700 1 -- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 msgr2=0x7f915812f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.880+0000 7f915e184700 1 -- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 msgr2=0x7f915812f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.880+0000 7f915e184700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 0x7f915812f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.880+0000 7f915e184700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 0x7f915812f6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.956+0000 7f915d182700 1 --2- 172.21.15.72:0/836394187 >> v2:172.21.15.72:3300/0 conn(0x7f9158068980 0x7f915812cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.956+0000 7f915d182700 1 -- 172.21.15.72:0/836394187 >> v2:172.21.15.72:3300/0 conn(0x7f9158068980 msgr2=0x7f915812cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.956+0000 7f915d182700 1 -- 172.21.15.72:0/836394187 >> v2:172.21.15.72:3300/0 conn(0x7f9158068980 msgr2=0x7f915812cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.956+0000 7f915d182700 1 --2- 172.21.15.72:0/836394187 >> v2:172.21.15.72:3300/0 conn(0x7f9158068980 0x7f915812cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:09:30.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.956+0000 7f915d182700 1 --2- 172.21.15.72:0/836394187 >> v2:172.21.15.72:3300/0 conn(0x7f9158068980 0x7f915812cde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-10-03T10:09:30.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 -- 172.21.15.72:0/836394187 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438666314 0 0) 0x7f91580690b0 con 0x7f9158067e90 2023-10-03T10:09:30.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 -- 172.21.15.72:0/836394187 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91440033f0 con 0x7f9158067e90 2023-10-03T10:09:30.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 -- 172.21.15.72:0/836394187 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1185074248 0 0) 0x7f91440033f0 con 0x7f9158067e90 2023-10-03T10:09:30.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 -- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 msgr2=0x7f915812f6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:09:30.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 0x7f915812f6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 -- 172.21.15.72:0/836394187 >> v2:172.21.15.72:3300/0 conn(0x7f9158068980 msgr2=0x7f915812cde0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:09:30.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 --2- 172.21.15.72:0/836394187 >> v2:172.21.15.72:3300/0 conn(0x7f9158068980 0x7f915812cde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 -- 172.21.15.72:0/836394187 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9158069b20 con 0x7f9158067e90 2023-10-03T10:09:30.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 -- 172.21.15.72:0/836394187 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2586900296 0 0) 0x7f9154001470 con 0x7f9158067e90 2023-10-03T10:09:30.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 -- 172.21.15.72:0/836394187 >> v1:172.21.15.72:6789/0 conn(0x7f9158067e90 legacy=0x7f9158068270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91440038e0 0x7f9144003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 0x7f9144004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9144004b80 0x7f9144005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 -- 172.21.15.72:0/836394187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158092330 con 0x7f91440038e0 2023-10-03T10:09:30.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 -- 172.21.15.72:0/836394187 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914400b8e0 con 0x7f915812d2d0 2023-10-03T10:09:30.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915c981700 1 -- 172.21.15.72:0/836394187 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f914400ba50 con 0x7f9144004b80 2023-10-03T10:09:30.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915d983700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91440038e0 0x7f9144003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.982+0000 7f915e184700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9144004b80 0x7f9144005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.983+0000 7f915d983700 1 -- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9144004b80 msgr2=0x7f9144005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.983+0000 7f915d983700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9144004b80 0x7f9144005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.983+0000 7f915d983700 1 -- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 msgr2=0x7f9144004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.983+0000 7f915d983700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915812d2d0 0x7f9144004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.983+0000 7f915d983700 1 -- 172.21.15.72:0/836394187 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91440033f0 con 0x7f91440038e0 2023-10-03T10:09:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.983+0000 7f915e184700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9144004b80 0x7f9144005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:09:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.983+0000 7f915d983700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91440038e0 0x7f9144003d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f915400c190 tx=0x7f91580919e0).ready entity=mon.0 client_cookie=e1dc545508db9962 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.983+0000 7f915c981700 1 -- 172.21.15.72:0/836394187 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915400cac0 con 0x7f91440038e0 2023-10-03T10:09:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.983+0000 7f915c981700 1 -- 172.21.15.72:0/836394187 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915400cc20 con 0x7f91440038e0 2023-10-03T10:09:30.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.983+0000 7f915c981700 1 -- 172.21.15.72:0/836394187 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91540070d0 con 0x7f91440038e0 2023-10-03T10:09:30.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.984+0000 7f915fbe7700 1 -- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91440038e0 msgr2=0x7f9144003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.984+0000 7f915fbe7700 1 --2- 172.21.15.72:0/836394187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91440038e0 0x7f9144003d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f915400c190 tx=0x7f91580919e0).stop 2023-10-03T10:09:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.984+0000 7f915e184700 1 -- 172.21.15.72:0/836394187 reap_dead start 2023-10-03T10:09:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.984+0000 7f915fbe7700 1 -- 172.21.15.72:0/836394187 shutdown_connections 2023-10-03T10:09:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.984+0000 7f915fbe7700 1 -- 172.21.15.72:0/836394187 >> 172.21.15.72:0/836394187 conn(0x7f915809a3d0 msgr2=0x7f915809a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.984+0000 7f915fbe7700 1 -- 172.21.15.72:0/836394187 shutdown_connections 2023-10-03T10:09:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.984+0000 7f915fbe7700 1 -- 172.21.15.72:0/836394187 wait complete. 2023-10-03T10:09:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.985+0000 7f915fbe7700 1 Processor -- start 2023-10-03T10:09:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.985+0000 7f915fbe7700 1 -- start start 2023-10-03T10:09:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.986+0000 7f915fbe7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91440038e0 0x7f9158119780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.986+0000 7f915fbe7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9158116990 0x7f9158115750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.986+0000 7f915fbe7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9158115c40 0x7f91581160c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:30.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.986+0000 7f915fbe7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915812c910 con 0x7f9158116990 2023-10-03T10:09:30.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.986+0000 7f915fbe7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9158117e10 con 0x7f9158115c40 2023-10-03T10:09:30.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.986+0000 7f915fbe7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9158091bf0 con 0x7f91440038e0 2023-10-03T10:09:30.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.986+0000 7f915d182700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9158116990 0x7f9158115750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.986+0000 7f915d983700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91440038e0 0x7f9158119780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.986+0000 7f915d182700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9158116990 0x7f9158115750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41266/0 (socket says 172.21.15.72:41266) 2023-10-03T10:09:30.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.986+0000 7f915d182700 1 -- 172.21.15.72:0/1324043798 learned_addr learned my addr 172.21.15.72:0/1324043798 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:30.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.986+0000 7f915d983700 1 --2- 172.21.15.72:0/1324043798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91440038e0 0x7f9158119780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:54712/0 (socket says 172.21.15.72:54712) 2023-10-03T10:09:30.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.986+0000 7f915e184700 1 --2- 172.21.15.72:0/1324043798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9158115c40 0x7f91581160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:30.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.987+0000 7f915d182700 1 -- 172.21.15.72:0/1324043798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91440038e0 msgr2=0x7f9158119780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.987+0000 7f915d182700 1 --2- 172.21.15.72:0/1324043798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91440038e0 0x7f9158119780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.987+0000 7f915d182700 1 -- 172.21.15.72:0/1324043798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9158115c40 msgr2=0x7f91581160c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:30.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.987+0000 7f915d182700 1 --2- 172.21.15.72:0/1324043798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9158115c40 0x7f91581160c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:30.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.987+0000 7f915d182700 1 -- 172.21.15.72:0/1324043798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9158118ce0 con 0x7f9158116990 2023-10-03T10:09:30.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.987+0000 7f915d983700 1 --2- 172.21.15.72:0/1324043798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91440038e0 0x7f9158119780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:30.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.987+0000 7f915e184700 1 --2- 172.21.15.72:0/1324043798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9158115c40 0x7f91581160c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:30.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.987+0000 7f915d182700 1 --2- 172.21.15.72:0/1324043798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9158116990 0x7f9158115750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f9148006bc0 tx=0x7f9148008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:30.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.987+0000 7f914dffb700 1 -- 172.21.15.72:0/1324043798 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91480117d0 con 0x7f9158116990 2023-10-03T10:09:30.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.987+0000 7f914dffb700 1 -- 172.21.15.72:0/1324043798 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9148011930 con 0x7f9158116990 2023-10-03T10:09:30.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.987+0000 7f915fbe7700 1 -- 172.21.15.72:0/1324043798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9158119280 con 0x7f9158116990 2023-10-03T10:09:30.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.987+0000 7f914dffb700 1 -- 172.21.15.72:0/1324043798 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148011cd0 con 0x7f9158116990 2023-10-03T10:09:30.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.987+0000 7f915fbe7700 1 -- 172.21.15.72:0/1324043798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9158117530 con 0x7f9158116990 2023-10-03T10:09:30.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.988+0000 7f914dffb700 1 -- 172.21.15.72:0/1324043798 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f9148019680 con 0x7f9158116990 2023-10-03T10:09:30.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.988+0000 7f914dffb700 1 -- 172.21.15.72:0/1324043798 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9148023790 con 0x7f9158116990 2023-10-03T10:09:30.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.989+0000 7f915fbe7700 1 -- 172.21.15.72:0/1324043798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91581165b0 con 0x7f9158116990 2023-10-03T10:09:30.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:30.991+0000 7f914dffb700 1 -- 172.21.15.72:0/1324043798 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f914801e070 con 0x7f9158116990 2023-10-03T10:09:31.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.062+0000 7f915fbe7700 1 -- 172.21.15.72:0/1324043798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f915805a260 con 0x7f9158116990 2023-10-03T10:09:31.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.070+0000 7f914dffb700 1 -- 172.21.15.72:0/1324043798 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9148019b60 con 0x7f9158116990 2023-10-03T10:09:31.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.071+0000 7f915fbe7700 1 -- 172.21.15.72:0/1324043798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9158116990 msgr2=0x7f9158115750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.071+0000 7f915fbe7700 1 --2- 172.21.15.72:0/1324043798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9158116990 0x7f9158115750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f9148006bc0 tx=0x7f9148008040).stop 2023-10-03T10:09:31.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.071+0000 7f915fbe7700 1 -- 172.21.15.72:0/1324043798 shutdown_connections 2023-10-03T10:09:31.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.071+0000 7f915fbe7700 1 --2- 172.21.15.72:0/1324043798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9158115c40 0x7f91581160c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.071+0000 7f915fbe7700 1 --2- 172.21.15.72:0/1324043798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91440038e0 0x7f9158119780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.071+0000 7f915fbe7700 1 --2- 172.21.15.72:0/1324043798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9158116990 0x7f9158115750 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.071+0000 7f915fbe7700 1 -- 172.21.15.72:0/1324043798 >> 172.21.15.72:0/1324043798 conn(0x7f915809a3d0 msgr2=0x7f9158096eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:31.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.071+0000 7f915fbe7700 1 -- 172.21.15.72:0/1324043798 shutdown_connections 2023-10-03T10:09:31.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.071+0000 7f915fbe7700 1 -- 172.21.15.72:0/1324043798 wait complete. 2023-10-03T10:09:31.073 INFO:teuthology.orchestra.run.smithi072.stderr:adjusted tunables profile to default 2023-10-03T10:09:31.083 INFO:tasks.ceph:check_enable_crimson: False 2023-10-03T10:09:31.083 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-03T10:09:31.083 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:31.084 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-03T10:09:31.110 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:31.110 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-03T10:09:31.177 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:31.177 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-03T10:09:31.243 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:09:31.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-03T10:09:31.310 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 48d870e9-7887-40a6-bb5e-b2634b374762 0 2023-10-03T10:09:31.462 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:31.461+0000 7f2c48cab680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-03T10:09:31.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.465+0000 7f5d836b7700 1 Processor -- start 2023-10-03T10:09:31.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.465+0000 7f5d836b7700 1 -- start start 2023-10-03T10:09:31.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.465+0000 7f5d836b7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d7c059070 0x7f5d7c127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.465+0000 7f5d836b7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5d7c127d80 0x7f5d7c0953f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.465+0000 7f5d836b7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5d7c0958e0 0x7f5d7c095d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.465+0000 7f5d836b7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7c096280 con 0x7f5d7c0958e0 2023-10-03T10:09:31.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.465+0000 7f5d836b7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c096de0 con 0x7f5d7c059070 2023-10-03T10:09:31.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.465+0000 7f5d836b7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c092a50 con 0x7f5d7c127d80 2023-10-03T10:09:31.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.465+0000 7f5d81453700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d7c059070 0x7f5d7c127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.465+0000 7f5d81c54700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5d7c0958e0 0x7f5d7c095d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.466+0000 7f5d81453700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d7c059070 0x7f5d7c127890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34620/0 (socket says 172.21.15.72:34620) 2023-10-03T10:09:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.466+0000 7f5d81c54700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5d7c0958e0 0x7f5d7c095d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41282/0 (socket says 172.21.15.72:41282) 2023-10-03T10:09:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.466+0000 7f5d81453700 1 -- 172.21.15.72:0/16835643 learned_addr learned my addr 172.21.15.72:0/16835643 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.466+0000 7f5d80c52700 1 --2- 172.21.15.72:0/16835643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5d7c127d80 0x7f5d7c0953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.466+0000 7f5d81453700 1 -- 172.21.15.72:0/16835643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5d7c127d80 msgr2=0x7f5d7c0953f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.466+0000 7f5d81453700 1 --2- 172.21.15.72:0/16835643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5d7c127d80 0x7f5d7c0953f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.466+0000 7f5d81453700 1 -- 172.21.15.72:0/16835643 >> v2:172.21.15.72:3300/0 conn(0x7f5d7c0958e0 msgr2=0x7f5d7c095d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.466+0000 7f5d81453700 1 --2- 172.21.15.72:0/16835643 >> v2:172.21.15.72:3300/0 conn(0x7f5d7c0958e0 0x7f5d7c095d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.466+0000 7f5d81453700 1 -- 172.21.15.72:0/16835643 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c091ba0 con 0x7f5d7c059070 2023-10-03T10:09:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.466+0000 7f5d81c54700 1 --2- 172.21.15.72:0/16835643 >> v2:172.21.15.72:3300/0 conn(0x7f5d7c0958e0 0x7f5d7c095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.466+0000 7f5d81453700 1 --2- 172.21.15.72:0/16835643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d7c059070 0x7f5d7c127890 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f5d78009830 tx=0x7f5d780090f0).ready entity=mon.1 client_cookie=a8c22998a36bc9e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.466+0000 7f5d73fff700 1 -- 172.21.15.72:0/16835643 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800f510 con 0x7f5d7c059070 2023-10-03T10:09:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.466+0000 7f5d73fff700 1 -- 172.21.15.72:0/16835643 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7800f670 con 0x7f5d7c059070 2023-10-03T10:09:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.466+0000 7f5d73fff700 1 -- 172.21.15.72:0/16835643 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800f9f0 con 0x7f5d7c059070 2023-10-03T10:09:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.467+0000 7f5d836b7700 1 -- 172.21.15.72:0/16835643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d7c059070 msgr2=0x7f5d7c127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.467+0000 7f5d836b7700 1 --2- 172.21.15.72:0/16835643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d7c059070 0x7f5d7c127890 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f5d78009830 tx=0x7f5d780090f0).stop 2023-10-03T10:09:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.467+0000 7f5d836b7700 1 -- 172.21.15.72:0/16835643 shutdown_connections 2023-10-03T10:09:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.467+0000 7f5d836b7700 1 --2- 172.21.15.72:0/16835643 >> v2:172.21.15.72:3300/0 conn(0x7f5d7c0958e0 0x7f5d7c095d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.467+0000 7f5d836b7700 1 --2- 172.21.15.72:0/16835643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d7c059070 0x7f5d7c127890 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.467+0000 7f5d836b7700 1 --2- 172.21.15.72:0/16835643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5d7c127d80 0x7f5d7c0953f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.467+0000 7f5d836b7700 1 -- 172.21.15.72:0/16835643 >> 172.21.15.72:0/16835643 conn(0x7f5d7c0974f0 msgr2=0x7f5d7c097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:31.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.467+0000 7f5d836b7700 1 -- 172.21.15.72:0/16835643 shutdown_connections 2023-10-03T10:09:31.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.467+0000 7f5d836b7700 1 -- 172.21.15.72:0/16835643 wait complete. 2023-10-03T10:09:31.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.468+0000 7f5d836b7700 1 Processor -- start 2023-10-03T10:09:31.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.468+0000 7f5d836b7700 1 -- start start 2023-10-03T10:09:31.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d836b7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d7c059070 0x7f5d7c124a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d836b7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d7c0958e0 0x7f5d7c1138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d836b7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5d7c127d80 0x7f5d7c113db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d836b7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c115db0 con 0x7f5d7c059070 2023-10-03T10:09:31.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d836b7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c097010 con 0x7f5d7c0958e0 2023-10-03T10:09:31.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d836b7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c117420 con 0x7f5d7c127d80 2023-10-03T10:09:31.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d80c52700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d7c0958e0 0x7f5d7c1138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d81c54700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5d7c127d80 0x7f5d7c113db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d80c52700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d7c0958e0 0x7f5d7c1138c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34628/0 (socket says 172.21.15.72:34628) 2023-10-03T10:09:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d80c52700 1 -- 172.21.15.72:0/1498450167 learned_addr learned my addr 172.21.15.72:0/1498450167 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d81453700 1 --2- 172.21.15.72:0/1498450167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d7c059070 0x7f5d7c124a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d80c52700 1 -- 172.21.15.72:0/1498450167 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5d7c127d80 msgr2=0x7f5d7c113db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d80c52700 1 --2- 172.21.15.72:0/1498450167 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5d7c127d80 0x7f5d7c113db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d80c52700 1 -- 172.21.15.72:0/1498450167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d7c059070 msgr2=0x7f5d7c124a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d80c52700 1 --2- 172.21.15.72:0/1498450167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d7c059070 0x7f5d7c124a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d80c52700 1 -- 172.21.15.72:0/1498450167 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d74009a20 con 0x7f5d7c0958e0 2023-10-03T10:09:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d81453700 1 --2- 172.21.15.72:0/1498450167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d7c059070 0x7f5d7c124a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d80c52700 1 --2- 172.21.15.72:0/1498450167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d7c0958e0 0x7f5d7c1138c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f5d6c00e930 tx=0x7f5d6c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.469+0000 7f5d717fa700 1 -- 172.21.15.72:0/1498450167 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c00c670 con 0x7f5d7c0958e0 2023-10-03T10:09:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.470+0000 7f5d717fa700 1 -- 172.21.15.72:0/1498450167 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c00c7d0 con 0x7f5d7c0958e0 2023-10-03T10:09:31.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.470+0000 7f5d717fa700 1 -- 172.21.15.72:0/1498450167 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c00cb50 con 0x7f5d7c0958e0 2023-10-03T10:09:31.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.470+0000 7f5d836b7700 1 -- 172.21.15.72:0/1498450167 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d78009370 con 0x7f5d7c0958e0 2023-10-03T10:09:31.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.470+0000 7f5d836b7700 1 -- 172.21.15.72:0/1498450167 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7c117ad0 con 0x7f5d7c0958e0 2023-10-03T10:09:31.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.470+0000 7f5d717fa700 1 -- 172.21.15.72:0/1498450167 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f5d6c01b660 con 0x7f5d7c0958e0 2023-10-03T10:09:31.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.470+0000 7f5d717fa700 1 -- 172.21.15.72:0/1498450167 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5d6c012740 con 0x7f5d7c0958e0 2023-10-03T10:09:31.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.471+0000 7f5d836b7700 1 -- 172.21.15.72:0/1498450167 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7c117210 con 0x7f5d7c0958e0 2023-10-03T10:09:31.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.473+0000 7f5d717fa700 1 -- 172.21.15.72:0/1498450167 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f5d6c03ae50 con 0x7f5d7c0958e0 2023-10-03T10:09:31.534 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:31.534+0000 7f2c48cab680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-03T10:09:31.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.553+0000 7f5d836b7700 1 -- 172.21.15.72:0/1498450167 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd new", "uuid": "48d870e9-7887-40a6-bb5e-b2634b374762", "id": 0} v 0) v1 -- 0x7f5d7c097150 con 0x7f5d7c0958e0 2023-10-03T10:09:31.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.561+0000 7f5d717fa700 1 -- 172.21.15.72:0/1498450167 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "48d870e9-7887-40a6-bb5e-b2634b374762", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5d6c029030 con 0x7f5d7c0958e0 2023-10-03T10:09:31.562 INFO:teuthology.orchestra.run.smithi072.stdout:0 2023-10-03T10:09:31.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.562+0000 7f5d836b7700 1 -- 172.21.15.72:0/1498450167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d7c0958e0 msgr2=0x7f5d7c1138c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.562+0000 7f5d836b7700 1 --2- 172.21.15.72:0/1498450167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d7c0958e0 0x7f5d7c1138c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f5d6c00e930 tx=0x7f5d6c009060).stop 2023-10-03T10:09:31.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.562+0000 7f5d836b7700 1 -- 172.21.15.72:0/1498450167 shutdown_connections 2023-10-03T10:09:31.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.562+0000 7f5d836b7700 1 --2- 172.21.15.72:0/1498450167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d7c059070 0x7f5d7c124a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.562+0000 7f5d836b7700 1 --2- 172.21.15.72:0/1498450167 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5d7c127d80 0x7f5d7c113db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.562+0000 7f5d836b7700 1 --2- 172.21.15.72:0/1498450167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d7c0958e0 0x7f5d7c1138c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.562+0000 7f5d836b7700 1 -- 172.21.15.72:0/1498450167 >> 172.21.15.72:0/1498450167 conn(0x7f5d7c0974f0 msgr2=0x7f5d7c0942c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:31.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.562+0000 7f5d836b7700 1 -- 172.21.15.72:0/1498450167 shutdown_connections 2023-10-03T10:09:31.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.562+0000 7f5d836b7700 1 -- 172.21.15.72:0/1498450167 wait complete. 2023-10-03T10:09:31.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 9f579570-81c8-4dcb-aa20-b72cf8df944d 1 2023-10-03T10:09:31.623 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:31.622+0000 7f2c48cab680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-03T10:09:31.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.691+0000 7f16f594c700 1 Processor -- start 2023-10-03T10:09:31.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.691+0000 7f16f594c700 1 -- start start 2023-10-03T10:09:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.691+0000 7f16f594c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16f012b540 0x7f16f012ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.691+0000 7f16f594c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16f0130400 0x7f16f01327f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.691+0000 7f16f594c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f0066d80 con 0x7f16f00613a0 2023-10-03T10:09:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.691+0000 7f16f594c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f0061780 con 0x7f16f0130400 2023-10-03T10:09:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.691+0000 7f16f594c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16f012ac40 con 0x7f16f012b540 2023-10-03T10:09:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.691+0000 7f16eeffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f16f00613a0 0x7f16f012ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41718/0 (socket says 172.21.15.72:41718) 2023-10-03T10:09:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.691+0000 7f16eeffd700 1 -- 172.21.15.72:0/2672156749 learned_addr learned my addr 172.21.15.72:0/2672156749 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.691+0000 7f16ee7fc700 1 --2- 172.21.15.72:0/2672156749 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16f012b540 0x7f16f012ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.692+0000 7f16ef7fe700 1 --2- 172.21.15.72:0/2672156749 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16f0130400 0x7f16f01327f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.692+0000 7f16edffb700 1 -- 172.21.15.72:0/2672156749 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655818899 0 0) 0x7f16f0066d80 con 0x7f16f00613a0 2023-10-03T10:09:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.692+0000 7f16ee7fc700 1 -- 172.21.15.72:0/2672156749 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16f0130400 msgr2=0x7f16f01327f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.692+0000 7f16ee7fc700 1 --2- 172.21.15.72:0/2672156749 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16f0130400 0x7f16f01327f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.692+0000 7f16ee7fc700 1 -- 172.21.15.72:0/2672156749 >> v1:172.21.15.72:6789/0 conn(0x7f16f00613a0 legacy=0x7f16f012ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.692+0000 7f16ee7fc700 1 -- 172.21.15.72:0/2672156749 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f0092fb0 con 0x7f16f012b540 2023-10-03T10:09:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.692+0000 7f16ef7fe700 1 --2- 172.21.15.72:0/2672156749 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16f0130400 0x7f16f01327f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:09:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.692+0000 7f16ee7fc700 1 --2- 172.21.15.72:0/2672156749 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16f012b540 0x7f16f012ff10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f16e4009790 tx=0x7f16e4009060).ready entity=mon.2 client_cookie=13440ea8652ccb9f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.692+0000 7f16edffb700 1 -- 172.21.15.72:0/2672156749 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e400b5a0 con 0x7f16f012b540 2023-10-03T10:09:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.692+0000 7f16edffb700 1 -- 172.21.15.72:0/2672156749 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e400b700 con 0x7f16f012b540 2023-10-03T10:09:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.692+0000 7f16edffb700 1 -- 172.21.15.72:0/2672156749 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e400ba80 con 0x7f16f012b540 2023-10-03T10:09:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.693+0000 7f16f594c700 1 -- 172.21.15.72:0/2672156749 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16f012b540 msgr2=0x7f16f012ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.693+0000 7f16f594c700 1 --2- 172.21.15.72:0/2672156749 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16f012b540 0x7f16f012ff10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f16e4009790 tx=0x7f16e4009060).stop 2023-10-03T10:09:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.693+0000 7f16f594c700 1 -- 172.21.15.72:0/2672156749 shutdown_connections 2023-10-03T10:09:31.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.693+0000 7f16f594c700 1 --2- 172.21.15.72:0/2672156749 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16f0130400 0x7f16f01327f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.693+0000 7f16f594c700 1 --2- 172.21.15.72:0/2672156749 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16f012b540 0x7f16f012ff10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.693+0000 7f16f594c700 1 -- 172.21.15.72:0/2672156749 >> 172.21.15.72:0/2672156749 conn(0x7f16f009a3d0 msgr2=0x7f16f009a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:31.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.693+0000 7f16f594c700 1 -- 172.21.15.72:0/2672156749 shutdown_connections 2023-10-03T10:09:31.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.693+0000 7f16f594c700 1 -- 172.21.15.72:0/2672156749 wait complete. 2023-10-03T10:09:31.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.694+0000 7f16f594c700 1 Processor -- start 2023-10-03T10:09:31.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.694+0000 7f16f594c700 1 -- start start 2023-10-03T10:09:31.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.694+0000 7f16f594c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16f00613a0 0x7f16f0114920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.694+0000 7f16f594c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f012b540 0x7f16f0114e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.694+0000 7f16f594c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16f0130400 0x7f16f0115300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.694+0000 7f16f594c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f01157f0 con 0x7f16f012b540 2023-10-03T10:09:31.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.694+0000 7f16f594c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f0115df0 con 0x7f16f00613a0 2023-10-03T10:09:31.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.694+0000 7f16f594c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16f0117e60 con 0x7f16f0130400 2023-10-03T10:09:31.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.694+0000 7f16eeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16f00613a0 0x7f16f0114920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.694+0000 7f16ef7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16f0130400 0x7f16f0115300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.694+0000 7f16eeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16f00613a0 0x7f16f0114920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34656/0 (socket says 172.21.15.72:34656) 2023-10-03T10:09:31.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.694+0000 7f16ef7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16f0130400 0x7f16f0115300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:54764/0 (socket says 172.21.15.72:54764) 2023-10-03T10:09:31.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.694+0000 7f16eeffd700 1 -- 172.21.15.72:0/3758409068 learned_addr learned my addr 172.21.15.72:0/3758409068 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:31.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.694+0000 7f16ee7fc700 1 --2- 172.21.15.72:0/3758409068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f012b540 0x7f16f0114e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.695+0000 7f16eeffd700 1 -- 172.21.15.72:0/3758409068 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16f0130400 msgr2=0x7f16f0115300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.695+0000 7f16eeffd700 1 --2- 172.21.15.72:0/3758409068 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16f0130400 0x7f16f0115300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.695+0000 7f16eeffd700 1 -- 172.21.15.72:0/3758409068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f012b540 msgr2=0x7f16f0114e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.695+0000 7f16eeffd700 1 --2- 172.21.15.72:0/3758409068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f012b540 0x7f16f0114e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.695+0000 7f16eeffd700 1 -- 172.21.15.72:0/3758409068 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e40092a0 con 0x7f16f00613a0 2023-10-03T10:09:31.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.695+0000 7f16ef7fe700 1 --2- 172.21.15.72:0/3758409068 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16f0130400 0x7f16f0115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:31.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.695+0000 7f16ee7fc700 1 --2- 172.21.15.72:0/3758409068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f012b540 0x7f16f0114e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:31.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.695+0000 7f16eeffd700 1 --2- 172.21.15.72:0/3758409068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16f00613a0 0x7f16f0114920 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f16e000c4c0 tx=0x7f16e0007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:31.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.695+0000 7f16d6ffd700 1 -- 172.21.15.72:0/3758409068 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e000ce30 con 0x7f16f00613a0 2023-10-03T10:09:31.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.695+0000 7f16d6ffd700 1 -- 172.21.15.72:0/3758409068 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e00072e0 con 0x7f16f00613a0 2023-10-03T10:09:31.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.695+0000 7f16f594c700 1 -- 172.21.15.72:0/3758409068 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f0116600 con 0x7f16f00613a0 2023-10-03T10:09:31.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.695+0000 7f16d6ffd700 1 -- 172.21.15.72:0/3758409068 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e00057a0 con 0x7f16f00613a0 2023-10-03T10:09:31.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.695+0000 7f16f594c700 1 -- 172.21.15.72:0/3758409068 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f0118ae0 con 0x7f16f00613a0 2023-10-03T10:09:31.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.695+0000 7f16d6ffd700 1 -- 172.21.15.72:0/3758409068 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f16e0013450 con 0x7f16f00613a0 2023-10-03T10:09:31.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.695+0000 7f16d6ffd700 1 -- 172.21.15.72:0/3758409068 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f16e001d7b0 con 0x7f16f00613a0 2023-10-03T10:09:31.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.696+0000 7f16f594c700 1 -- 172.21.15.72:0/3758409068 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f005a260 con 0x7f16f00613a0 2023-10-03T10:09:31.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.698+0000 7f16d6ffd700 1 -- 172.21.15.72:0/3758409068 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f16e0005df0 con 0x7f16f00613a0 2023-10-03T10:09:31.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.778+0000 7f16f594c700 1 -- 172.21.15.72:0/3758409068 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9f579570-81c8-4dcb-aa20-b72cf8df944d", "id": 1} v 0) v1 -- 0x7f16f0093670 con 0x7f16f00613a0 2023-10-03T10:09:31.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.784+0000 7f16d6ffd700 1 -- 172.21.15.72:0/3758409068 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f579570-81c8-4dcb-aa20-b72cf8df944d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f16e00138e0 con 0x7f16f00613a0 2023-10-03T10:09:31.784 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:09:31.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.784+0000 7f16f594c700 1 -- 172.21.15.72:0/3758409068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16f00613a0 msgr2=0x7f16f0114920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.784+0000 7f16f594c700 1 --2- 172.21.15.72:0/3758409068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16f00613a0 0x7f16f0114920 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f16e000c4c0 tx=0x7f16e0007c10).stop 2023-10-03T10:09:31.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.785+0000 7f16f594c700 1 -- 172.21.15.72:0/3758409068 shutdown_connections 2023-10-03T10:09:31.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.785+0000 7f16f594c700 1 --2- 172.21.15.72:0/3758409068 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16f0130400 0x7f16f0115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.785+0000 7f16f594c700 1 --2- 172.21.15.72:0/3758409068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16f00613a0 0x7f16f0114920 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.785+0000 7f16f594c700 1 --2- 172.21.15.72:0/3758409068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16f012b540 0x7f16f0114e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.785+0000 7f16f594c700 1 -- 172.21.15.72:0/3758409068 >> 172.21.15.72:0/3758409068 conn(0x7f16f009a3d0 msgr2=0x7f16f00919e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:31.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.785+0000 7f16f594c700 1 -- 172.21.15.72:0/3758409068 shutdown_connections 2023-10-03T10:09:31.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.785+0000 7f16f594c700 1 -- 172.21.15.72:0/3758409068 wait complete. 2023-10-03T10:09:31.797 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new fd55a9ee-4434-4270-8e10-d8ed0a66164d 2 2023-10-03T10:09:31.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.909+0000 7ffabe4b2700 1 Processor -- start 2023-10-03T10:09:31.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.909+0000 7ffabe4b2700 1 -- start start 2023-10-03T10:09:31.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.909+0000 7ffabe4b2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab8096d30 0x7ffab8130850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.909+0000 7ffabe4b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab8097170 0x7ffab8132d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.909+0000 7ffabe4b2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab8065500 con 0x7ffab8091cc0 2023-10-03T10:09:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.909+0000 7ffabe4b2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80920a0 con 0x7ffab8097170 2023-10-03T10:09:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.909+0000 7ffabe4b2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8064640 con 0x7ffab8096d30 2023-10-03T10:09:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.909+0000 7ffab77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab8096d30 0x7ffab8130850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.909+0000 7ffabca4f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab8097170 0x7ffab8132d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.909+0000 7ffabca4f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab8097170 0x7ffab8132d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34660/0 (socket says 172.21.15.72:34660) 2023-10-03T10:09:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.909+0000 7ffab77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab8096d30 0x7ffab8130850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:54770/0 (socket says 172.21.15.72:54770) 2023-10-03T10:09:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.909+0000 7ffabca4f700 1 -- 172.21.15.72:0/1035037876 learned_addr learned my addr 172.21.15.72:0/1035037876 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.909+0000 7ffab7fff700 1 --1- 172.21.15.72:0/1035037876 >> v1:172.21.15.72:6789/0 conn(0x7ffab8091cc0 0x7ffab8096620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41732/0 (socket says 172.21.15.72:41732) 2023-10-03T10:09:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffabca4f700 1 -- 172.21.15.72:0/1035037876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab8096d30 msgr2=0x7ffab8130850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffab6ffd700 1 -- 172.21.15.72:0/1035037876 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550432025 0 0) 0x7ffab8065500 con 0x7ffab8091cc0 2023-10-03T10:09:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffabca4f700 1 --2- 172.21.15.72:0/1035037876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab8096d30 0x7ffab8130850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffabca4f700 1 -- 172.21.15.72:0/1035037876 >> v1:172.21.15.72:6789/0 conn(0x7ffab8091cc0 legacy=0x7ffab8096620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffabca4f700 1 -- 172.21.15.72:0/1035037876 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab8065230 con 0x7ffab8097170 2023-10-03T10:09:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffab77fe700 1 --2- 172.21.15.72:0/1035037876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab8096d30 0x7ffab8130850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffabca4f700 1 --2- 172.21.15.72:0/1035037876 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab8097170 0x7ffab8132d50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ffab0009f50 tx=0x7ffab0009840).ready entity=mon.1 client_cookie=1a455141909e5e08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffab6ffd700 1 -- 172.21.15.72:0/1035037876 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab000e070 con 0x7ffab8097170 2023-10-03T10:09:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffab6ffd700 1 -- 172.21.15.72:0/1035037876 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab000b9a0 con 0x7ffab8097170 2023-10-03T10:09:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffab6ffd700 1 -- 172.21.15.72:0/1035037876 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab000bd70 con 0x7ffab8097170 2023-10-03T10:09:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffabe4b2700 1 -- 172.21.15.72:0/1035037876 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab8097170 msgr2=0x7ffab8132d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffabe4b2700 1 --2- 172.21.15.72:0/1035037876 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab8097170 0x7ffab8132d50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ffab0009f50 tx=0x7ffab0009840).stop 2023-10-03T10:09:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffabe4b2700 1 -- 172.21.15.72:0/1035037876 shutdown_connections 2023-10-03T10:09:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffabe4b2700 1 --2- 172.21.15.72:0/1035037876 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab8097170 0x7ffab8132d50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffabe4b2700 1 --2- 172.21.15.72:0/1035037876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab8096d30 0x7ffab8130850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffabe4b2700 1 -- 172.21.15.72:0/1035037876 >> 172.21.15.72:0/1035037876 conn(0x7ffab8098720 msgr2=0x7ffab8098b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.910+0000 7ffabe4b2700 1 -- 172.21.15.72:0/1035037876 shutdown_connections 2023-10-03T10:09:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.911+0000 7ffabe4b2700 1 -- 172.21.15.72:0/1035037876 wait complete. 2023-10-03T10:09:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.911+0000 7ffabe4b2700 1 Processor -- start 2023-10-03T10:09:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.911+0000 7ffabe4b2700 1 -- start start 2023-10-03T10:09:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffabe4b2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab8091cc0 0x7ffab813a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffabe4b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab8096d30 0x7ffab813a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffabe4b2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab8097170 0x7ffab813ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffabe4b2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab813b050 con 0x7ffab8097170 2023-10-03T10:09:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffabe4b2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab811def0 con 0x7ffab8096d30 2023-10-03T10:09:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffabe4b2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffab806a740 con 0x7ffab8091cc0 2023-10-03T10:09:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffab7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab8091cc0 0x7ffab813a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffabca4f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab8097170 0x7ffab813ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffab7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab8091cc0 0x7ffab813a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:54782/0 (socket says 172.21.15.72:54782) 2023-10-03T10:09:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffab7fff700 1 -- 172.21.15.72:0/2674499588 learned_addr learned my addr 172.21.15.72:0/2674499588 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffab77fe700 1 --2- 172.21.15.72:0/2674499588 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab8096d30 0x7ffab813a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffabca4f700 1 -- 172.21.15.72:0/2674499588 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab8091cc0 msgr2=0x7ffab813a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffabca4f700 1 --2- 172.21.15.72:0/2674499588 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab8091cc0 0x7ffab813a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffabca4f700 1 -- 172.21.15.72:0/2674499588 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab8096d30 msgr2=0x7ffab813a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffabca4f700 1 --2- 172.21.15.72:0/2674499588 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab8096d30 0x7ffab813a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffabca4f700 1 -- 172.21.15.72:0/2674499588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac0092a0 con 0x7ffab8097170 2023-10-03T10:09:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffab77fe700 1 --2- 172.21.15.72:0/2674499588 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab8096d30 0x7ffab813a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.912+0000 7ffabca4f700 1 --2- 172.21.15.72:0/2674499588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab8097170 0x7ffab813ab60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ffab0013000 tx=0x7ffab8064d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.913+0000 7ffa9ffff700 1 -- 172.21.15.72:0/2674499588 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab00092e0 con 0x7ffab8097170 2023-10-03T10:09:31.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.913+0000 7ffa9ffff700 1 -- 172.21.15.72:0/2674499588 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab0013e40 con 0x7ffab8097170 2023-10-03T10:09:31.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.913+0000 7ffa9ffff700 1 -- 172.21.15.72:0/2674499588 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab0007880 con 0x7ffab8097170 2023-10-03T10:09:31.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.913+0000 7ffabe4b2700 1 -- 172.21.15.72:0/2674499588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab0009ae0 con 0x7ffab8097170 2023-10-03T10:09:31.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.913+0000 7ffabe4b2700 1 -- 172.21.15.72:0/2674499588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab811ca30 con 0x7ffab8097170 2023-10-03T10:09:31.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.913+0000 7ffa9ffff700 1 -- 172.21.15.72:0/2674499588 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ffab0003040 con 0x7ffab8097170 2023-10-03T10:09:31.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.913+0000 7ffa9ffff700 1 -- 172.21.15.72:0/2674499588 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7ffab001fa40 con 0x7ffab8097170 2023-10-03T10:09:31.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.914+0000 7ffabe4b2700 1 -- 172.21.15.72:0/2674499588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab805a260 con 0x7ffab8097170 2023-10-03T10:09:31.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.916+0000 7ffa9ffff700 1 -- 172.21.15.72:0/2674499588 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ffab0024070 con 0x7ffab8097170 2023-10-03T10:09:31.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.995+0000 7ffabe4b2700 1 -- 172.21.15.72:0/2674499588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fd55a9ee-4434-4270-8e10-d8ed0a66164d", "id": 2} v 0) v1 -- 0x7ffab8046c20 con 0x7ffab8097170 2023-10-03T10:09:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.997+0000 7ffa9ffff700 1 -- 172.21.15.72:0/2674499588 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fd55a9ee-4434-4270-8e10-d8ed0a66164d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffab001fcd0 con 0x7ffab8097170 2023-10-03T10:09:31.997 INFO:teuthology.orchestra.run.smithi072.stdout:2 2023-10-03T10:09:31.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.997+0000 7ffabe4b2700 1 -- 172.21.15.72:0/2674499588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab8097170 msgr2=0x7ffab813ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.997+0000 7ffabe4b2700 1 --2- 172.21.15.72:0/2674499588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab8097170 0x7ffab813ab60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ffab0013000 tx=0x7ffab8064d40).stop 2023-10-03T10:09:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.997+0000 7ffabe4b2700 1 -- 172.21.15.72:0/2674499588 shutdown_connections 2023-10-03T10:09:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.997+0000 7ffabe4b2700 1 --2- 172.21.15.72:0/2674499588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab8097170 0x7ffab813ab60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.997+0000 7ffabe4b2700 1 --2- 172.21.15.72:0/2674499588 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab8091cc0 0x7ffab813a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.997+0000 7ffabe4b2700 1 --2- 172.21.15.72:0/2674499588 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab8096d30 0x7ffab813a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.998+0000 7ffabe4b2700 1 -- 172.21.15.72:0/2674499588 >> 172.21.15.72:0/2674499588 conn(0x7ffab8098720 msgr2=0x7ffab809a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.998+0000 7ffabe4b2700 1 -- 172.21.15.72:0/2674499588 shutdown_connections 2023-10-03T10:09:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:31.998+0000 7ffabe4b2700 1 -- 172.21.15.72:0/2674499588 wait complete. 2023-10-03T10:09:32.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new b7aa354b-4fb5-45d4-8210-97d6af9d4a3e 3 2023-10-03T10:09:32.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.123+0000 7f9fdf7ab700 1 Processor -- start 2023-10-03T10:09:32.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.124+0000 7f9fdf7ab700 1 -- start start 2023-10-03T10:09:32.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.124+0000 7f9fdf7ab700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fd8059070 0x7f9fd8127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.124+0000 7f9fdf7ab700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9fd8127d80 0x7f9fd80953f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.124+0000 7f9fdf7ab700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd8092a50 con 0x7f9fd80958e0 2023-10-03T10:09:32.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.124+0000 7f9fdf7ab700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd8091ba0 con 0x7f9fd8127d80 2023-10-03T10:09:32.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.124+0000 7f9fdf7ab700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd8091e60 con 0x7f9fd8059070 2023-10-03T10:09:32.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.124+0000 7f9fdcd46700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9fd8127d80 0x7f9fd80953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.124+0000 7f9fdd547700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fd8059070 0x7f9fd8127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.124+0000 7f9fddd48700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9fd80958e0 0x7f9fd8131d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41738/0 (socket says 172.21.15.72:41738) 2023-10-03T10:09:32.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.124+0000 7f9fdd547700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fd8059070 0x7f9fd8127890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:54786/0 (socket says 172.21.15.72:54786) 2023-10-03T10:09:32.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.124+0000 7f9fddd48700 1 -- 172.21.15.72:0/1827536170 learned_addr learned my addr 172.21.15.72:0/1827536170 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:32.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.124+0000 7f9fdcd46700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9fd8127d80 0x7f9fd80953f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41316/0 (socket says 172.21.15.72:41316) 2023-10-03T10:09:32.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.125+0000 7f9fdd547700 1 -- 172.21.15.72:0/1827536170 >> v2:172.21.15.72:3300/0 conn(0x7f9fd8127d80 msgr2=0x7f9fd80953f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:32.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.125+0000 7f9fdd547700 1 --2- 172.21.15.72:0/1827536170 >> v2:172.21.15.72:3300/0 conn(0x7f9fd8127d80 0x7f9fd80953f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.125+0000 7f9fdd547700 1 -- 172.21.15.72:0/1827536170 >> v1:172.21.15.72:6789/0 conn(0x7f9fd80958e0 legacy=0x7f9fd8131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.125+0000 7f9fdd547700 1 -- 172.21.15.72:0/1827536170 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd8097220 con 0x7f9fd8059070 2023-10-03T10:09:32.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.125+0000 7f9fcbfff700 1 -- 172.21.15.72:0/1827536170 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604700725 0 0) 0x7f9fd8092a50 con 0x7f9fd80958e0 2023-10-03T10:09:32.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.125+0000 7f9fdcd46700 1 --2- 172.21.15.72:0/1827536170 >> v2:172.21.15.72:3300/0 conn(0x7f9fd8127d80 0x7f9fd80953f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:32.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.125+0000 7f9fdd547700 1 --2- 172.21.15.72:0/1827536170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fd8059070 0x7f9fd8127890 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9fcc009760 tx=0x7f9fcc009060).ready entity=mon.2 client_cookie=e94359cbe46f1a60 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:32.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.125+0000 7f9fcbfff700 1 -- 172.21.15.72:0/1827536170 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc00f510 con 0x7f9fd8059070 2023-10-03T10:09:32.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.125+0000 7f9fcbfff700 1 -- 172.21.15.72:0/1827536170 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc00f670 con 0x7f9fd8059070 2023-10-03T10:09:32.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.125+0000 7f9fcbfff700 1 -- 172.21.15.72:0/1827536170 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc00f9f0 con 0x7f9fd8059070 2023-10-03T10:09:32.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.125+0000 7f9fdf7ab700 1 -- 172.21.15.72:0/1827536170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fd8059070 msgr2=0x7f9fd8127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.125+0000 7f9fdf7ab700 1 --2- 172.21.15.72:0/1827536170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fd8059070 0x7f9fd8127890 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9fcc009760 tx=0x7f9fcc009060).stop 2023-10-03T10:09:32.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.125+0000 7f9fdf7ab700 1 -- 172.21.15.72:0/1827536170 shutdown_connections 2023-10-03T10:09:32.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.125+0000 7f9fdf7ab700 1 --2- 172.21.15.72:0/1827536170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fd8059070 0x7f9fd8127890 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.125+0000 7f9fdf7ab700 1 --2- 172.21.15.72:0/1827536170 >> v2:172.21.15.72:3300/0 conn(0x7f9fd8127d80 0x7f9fd80953f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.126+0000 7f9fdf7ab700 1 -- 172.21.15.72:0/1827536170 >> 172.21.15.72:0/1827536170 conn(0x7f9fd80974f0 msgr2=0x7f9fd8097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:32.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.126+0000 7f9fdf7ab700 1 -- 172.21.15.72:0/1827536170 shutdown_connections 2023-10-03T10:09:32.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.126+0000 7f9fdf7ab700 1 -- 172.21.15.72:0/1827536170 wait complete. 2023-10-03T10:09:32.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.126+0000 7f9fdf7ab700 1 Processor -- start 2023-10-03T10:09:32.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.126+0000 7f9fdf7ab700 1 -- start start 2023-10-03T10:09:32.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fdf7ab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fd8059070 0x7f9fd81249e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fdf7ab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fd80958e0 0x7f9fd8113880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fdf7ab700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fd8127d80 0x7f9fd8113d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fdf7ab700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd8097010 con 0x7f9fd80958e0 2023-10-03T10:09:32.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fdf7ab700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd81173b0 con 0x7f9fd8059070 2023-10-03T10:09:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fdf7ab700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd8098a30 con 0x7f9fd8127d80 2023-10-03T10:09:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fddd48700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fd8127d80 0x7f9fd8113d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fdd547700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fd8059070 0x7f9fd81249e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fddd48700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fd8127d80 0x7f9fd8113d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:54796/0 (socket says 172.21.15.72:54796) 2023-10-03T10:09:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fddd48700 1 -- 172.21.15.72:0/2672046208 learned_addr learned my addr 172.21.15.72:0/2672046208 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fdcd46700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fd80958e0 0x7f9fd8113880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fddd48700 1 -- 172.21.15.72:0/2672046208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fd8059070 msgr2=0x7f9fd81249e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fddd48700 1 --2- 172.21.15.72:0/2672046208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fd8059070 0x7f9fd81249e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fddd48700 1 -- 172.21.15.72:0/2672046208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fd80958e0 msgr2=0x7f9fd8113880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fddd48700 1 --2- 172.21.15.72:0/2672046208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fd80958e0 0x7f9fd8113880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fddd48700 1 -- 172.21.15.72:0/2672046208 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd40092a0 con 0x7f9fd8127d80 2023-10-03T10:09:32.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.127+0000 7f9fddd48700 1 --2- 172.21.15.72:0/2672046208 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fd8127d80 0x7f9fd8113d70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f9fd000c7e0 tx=0x7f9fd0007f90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:32.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.128+0000 7f9fc97fa700 1 -- 172.21.15.72:0/2672046208 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0005d30 con 0x7f9fd8127d80 2023-10-03T10:09:32.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.128+0000 7f9fc97fa700 1 -- 172.21.15.72:0/2672046208 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd0005e90 con 0x7f9fd8127d80 2023-10-03T10:09:32.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.128+0000 7f9fc97fa700 1 -- 172.21.15.72:0/2672046208 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0007320 con 0x7f9fd8127d80 2023-10-03T10:09:32.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.128+0000 7f9fdf7ab700 1 -- 172.21.15.72:0/2672046208 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fcc0092a0 con 0x7f9fd8127d80 2023-10-03T10:09:32.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.128+0000 7f9fdf7ab700 1 -- 172.21.15.72:0/2672046208 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd8117a90 con 0x7f9fd8127d80 2023-10-03T10:09:32.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.128+0000 7f9fc97fa700 1 -- 172.21.15.72:0/2672046208 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f9fd001d440 con 0x7f9fd8127d80 2023-10-03T10:09:32.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.128+0000 7f9fc97fa700 1 -- 172.21.15.72:0/2672046208 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f9fd0007970 con 0x7f9fd8127d80 2023-10-03T10:09:32.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.129+0000 7f9fdf7ab700 1 -- 172.21.15.72:0/2672046208 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd805a260 con 0x7f9fd8127d80 2023-10-03T10:09:32.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.131+0000 7f9fc97fa700 1 -- 172.21.15.72:0/2672046208 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f9fd001d6f0 con 0x7f9fd8127d80 2023-10-03T10:09:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.208+0000 7f9fdf7ab700 1 -- 172.21.15.72:0/2672046208 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd new", "uuid": "b7aa354b-4fb5-45d4-8210-97d6af9d4a3e", "id": 3} v 0) v1 -- 0x7f9fd8114680 con 0x7f9fd8127d80 2023-10-03T10:09:32.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.211+0000 7f9fc97fa700 1 -- 172.21.15.72:0/2672046208 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b7aa354b-4fb5-45d4-8210-97d6af9d4a3e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9fd001d970 con 0x7f9fd8127d80 2023-10-03T10:09:32.212 INFO:teuthology.orchestra.run.smithi072.stdout:3 2023-10-03T10:09:32.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.211+0000 7f9fdf7ab700 1 -- 172.21.15.72:0/2672046208 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fd8127d80 msgr2=0x7f9fd8113d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.211+0000 7f9fdf7ab700 1 --2- 172.21.15.72:0/2672046208 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fd8127d80 0x7f9fd8113d70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f9fd000c7e0 tx=0x7f9fd0007f90).stop 2023-10-03T10:09:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.212+0000 7f9fdf7ab700 1 -- 172.21.15.72:0/2672046208 shutdown_connections 2023-10-03T10:09:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.212+0000 7f9fdf7ab700 1 --2- 172.21.15.72:0/2672046208 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fd8127d80 0x7f9fd8113d70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.212+0000 7f9fdf7ab700 1 --2- 172.21.15.72:0/2672046208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fd8059070 0x7f9fd81249e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.212+0000 7f9fdf7ab700 1 --2- 172.21.15.72:0/2672046208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fd80958e0 0x7f9fd8113880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.212+0000 7f9fdf7ab700 1 -- 172.21.15.72:0/2672046208 >> 172.21.15.72:0/2672046208 conn(0x7f9fd80974f0 msgr2=0x7f9fd8094270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.212+0000 7f9fdf7ab700 1 -- 172.21.15.72:0/2672046208 shutdown_connections 2023-10-03T10:09:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.212+0000 7f9fdf7ab700 1 -- 172.21.15.72:0/2672046208 wait complete. 2023-10-03T10:09:32.223 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-03T10:09:32.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-03T10:09:32.225 INFO:tasks.ceph.osd.0:Started 2023-10-03T10:09:32.226 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-03T10:09:32.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-03T10:09:32.228 INFO:tasks.ceph.osd.1:Started 2023-10-03T10:09:32.228 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-03T10:09:32.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-03T10:09:32.230 INFO:tasks.ceph.osd.2:Started 2023-10-03T10:09:32.230 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-03T10:09:32.230 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-03T10:09:32.232 INFO:tasks.ceph.osd.3:Started 2023-10-03T10:09:32.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.381+0000 7f9a94374700 1 Processor -- start 2023-10-03T10:09:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.381+0000 7f9a94374700 1 -- start start 2023-10-03T10:09:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a94374700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a8c066200 0x7f9a8c0977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a94374700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a8c127dc0 0x7f9a8c12aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a94374700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8c065740 con 0x7f9a8c1281c0 2023-10-03T10:09:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a94374700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c0653a0 con 0x7f9a8c066200 2023-10-03T10:09:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a94374700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c064ef0 con 0x7f9a8c127dc0 2023-10-03T10:09:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a92110700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a8c066200 0x7f9a8c0977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a9190f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a8c127dc0 0x7f9a8c12aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a9190f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a8c127dc0 0x7f9a8c12aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:54838/0 (socket says 172.21.15.72:54838) 2023-10-03T10:09:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a92110700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a8c066200 0x7f9a8c0977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34720/0 (socket says 172.21.15.72:34720) 2023-10-03T10:09:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a9190f700 1 -- 172.21.15.72:0/3988994011 learned_addr learned my addr 172.21.15.72:0/3988994011 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a9190f700 1 -- 172.21.15.72:0/3988994011 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a8c066200 msgr2=0x7f9a8c0977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a9190f700 1 --2- 172.21.15.72:0/3988994011 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a8c066200 0x7f9a8c0977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a9190f700 1 -- 172.21.15.72:0/3988994011 >> v1:172.21.15.72:6789/0 conn(0x7f9a8c1281c0 legacy=0x7f9a8c12af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a9190f700 1 -- 172.21.15.72:0/3988994011 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c064a40 con 0x7f9a8c127dc0 2023-10-03T10:09:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a9110e700 1 -- 172.21.15.72:0/3988994011 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632969400 0 0) 0x7f9a8c065740 con 0x7f9a8c1281c0 2023-10-03T10:09:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a92110700 1 --2- 172.21.15.72:0/3988994011 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a8c066200 0x7f9a8c0977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.382+0000 7f9a9190f700 1 --2- 172.21.15.72:0/3988994011 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a8c127dc0 0x7f9a8c12aaa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f9a7c009830 tx=0x7f9a7c0090f0).ready entity=mon.2 client_cookie=8b3f43129f9e3539 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.383+0000 7f9a9110e700 1 -- 172.21.15.72:0/3988994011 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c00b580 con 0x7f9a8c127dc0 2023-10-03T10:09:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.383+0000 7f9a9110e700 1 -- 172.21.15.72:0/3988994011 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7c00b6e0 con 0x7f9a8c127dc0 2023-10-03T10:09:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.383+0000 7f9a9110e700 1 -- 172.21.15.72:0/3988994011 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c00ba60 con 0x7f9a8c127dc0 2023-10-03T10:09:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.383+0000 7f9a94374700 1 -- 172.21.15.72:0/3988994011 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a8c127dc0 msgr2=0x7f9a8c12aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.383+0000 7f9a94374700 1 --2- 172.21.15.72:0/3988994011 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a8c127dc0 0x7f9a8c12aaa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f9a7c009830 tx=0x7f9a7c0090f0).stop 2023-10-03T10:09:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.383+0000 7f9a94374700 1 -- 172.21.15.72:0/3988994011 shutdown_connections 2023-10-03T10:09:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.383+0000 7f9a94374700 1 --2- 172.21.15.72:0/3988994011 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a8c066200 0x7f9a8c0977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.383+0000 7f9a94374700 1 --2- 172.21.15.72:0/3988994011 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a8c127dc0 0x7f9a8c12aaa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.383+0000 7f9a94374700 1 -- 172.21.15.72:0/3988994011 >> 172.21.15.72:0/3988994011 conn(0x7f9a8c09ba50 msgr2=0x7f9a8c09be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.383+0000 7f9a94374700 1 -- 172.21.15.72:0/3988994011 shutdown_connections 2023-10-03T10:09:32.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.383+0000 7f9a94374700 1 -- 172.21.15.72:0/3988994011 wait complete. 2023-10-03T10:09:32.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.384+0000 7f9a94374700 1 Processor -- start 2023-10-03T10:09:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.384+0000 7f9a94374700 1 -- start start 2023-10-03T10:09:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a94374700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a8c066200 0x7f9a8c113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a94374700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a8c127dc0 0x7f9a8c114450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a94374700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a8c1281c0 0x7f9a8c114940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a94374700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c126940 con 0x7f9a8c1281c0 2023-10-03T10:09:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a94374700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c065120 con 0x7f9a8c127dc0 2023-10-03T10:09:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a94374700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8c116ab0 con 0x7f9a8c066200 2023-10-03T10:09:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a92110700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a8c066200 0x7f9a8c113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a9190f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a8c127dc0 0x7f9a8c114450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a92110700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a8c066200 0x7f9a8c113f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:54854/0 (socket says 172.21.15.72:54854) 2023-10-03T10:09:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a9190f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a8c127dc0 0x7f9a8c114450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34734/0 (socket says 172.21.15.72:34734) 2023-10-03T10:09:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a92110700 1 -- 172.21.15.72:0/649935078 learned_addr learned my addr 172.21.15.72:0/649935078 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a92911700 1 --2- 172.21.15.72:0/649935078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a8c1281c0 0x7f9a8c114940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a9190f700 1 -- 172.21.15.72:0/649935078 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a8c066200 msgr2=0x7f9a8c113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a9190f700 1 --2- 172.21.15.72:0/649935078 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a8c066200 0x7f9a8c113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a9190f700 1 -- 172.21.15.72:0/649935078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a8c1281c0 msgr2=0x7f9a8c114940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a9190f700 1 --2- 172.21.15.72:0/649935078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a8c1281c0 0x7f9a8c114940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a9190f700 1 -- 172.21.15.72:0/649935078 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a880092a0 con 0x7f9a8c127dc0 2023-10-03T10:09:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a92110700 1 --2- 172.21.15.72:0/649935078 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a8c066200 0x7f9a8c113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a9190f700 1 --2- 172.21.15.72:0/649935078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a8c127dc0 0x7f9a8c114450 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9a7c014000 tx=0x7f9a7c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a827fc700 1 -- 172.21.15.72:0/649935078 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c000bc0 con 0x7f9a8c127dc0 2023-10-03T10:09:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a827fc700 1 -- 172.21.15.72:0/649935078 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7c00b850 con 0x7f9a8c127dc0 2023-10-03T10:09:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a94374700 1 -- 172.21.15.72:0/649935078 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7c009370 con 0x7f9a8c127dc0 2023-10-03T10:09:32.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.385+0000 7f9a827fc700 1 -- 172.21.15.72:0/649935078 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c000d20 con 0x7f9a8c127dc0 2023-10-03T10:09:32.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.386+0000 7f9a94374700 1 -- 172.21.15.72:0/649935078 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8c1179e0 con 0x7f9a8c127dc0 2023-10-03T10:09:32.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.386+0000 7f9a827fc700 1 -- 172.21.15.72:0/649935078 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f9a7c025450 con 0x7f9a8c127dc0 2023-10-03T10:09:32.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.386+0000 7f9a827fc700 1 -- 172.21.15.72:0/649935078 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f9a7c006af0 con 0x7f9a8c127dc0 2023-10-03T10:09:32.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.386+0000 7f9a94374700 1 -- 172.21.15.72:0/649935078 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8c05a260 con 0x7f9a8c127dc0 2023-10-03T10:09:32.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.389+0000 7f9a827fc700 1 -- 172.21.15.72:0/649935078 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f9a7c044e50 con 0x7f9a8c127dc0 2023-10-03T10:09:32.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.455+0000 7f9a94374700 1 -- 172.21.15.72:0/649935078 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a8c046c20 con 0x7f9a8c127dc0 2023-10-03T10:09:32.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.456+0000 7f9a827fc700 1 -- 172.21.15.72:0/649935078 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7f9a7c033030 con 0x7f9a8c127dc0 2023-10-03T10:09:32.457 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:32.457 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":6,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:09:32.210536+0000","last_up_change":"0.000000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:32.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.457+0000 7f9a94374700 1 -- 172.21.15.72:0/649935078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a8c127dc0 msgr2=0x7f9a8c114450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.457+0000 7f9a94374700 1 --2- 172.21.15.72:0/649935078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a8c127dc0 0x7f9a8c114450 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9a7c014000 tx=0x7f9a7c017000).stop 2023-10-03T10:09:32.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.457+0000 7f9a94374700 1 -- 172.21.15.72:0/649935078 shutdown_connections 2023-10-03T10:09:32.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.457+0000 7f9a94374700 1 --2- 172.21.15.72:0/649935078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a8c1281c0 0x7f9a8c114940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.457+0000 7f9a94374700 1 --2- 172.21.15.72:0/649935078 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a8c066200 0x7f9a8c113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.457+0000 7f9a94374700 1 --2- 172.21.15.72:0/649935078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a8c127dc0 0x7f9a8c114450 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.457+0000 7f9a94374700 1 -- 172.21.15.72:0/649935078 >> 172.21.15.72:0/649935078 conn(0x7f9a8c09ba50 msgr2=0x7f9a8c069c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:32.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.457+0000 7f9a94374700 1 -- 172.21.15.72:0/649935078 shutdown_connections 2023-10-03T10:09:32.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:32.457+0000 7f9a94374700 1 -- 172.21.15.72:0/649935078 wait complete. 2023-10-03T10:09:32.469 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-03T10:09:32.469 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-03T10:09:32.718 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:32.718+0000 7f2c48cab680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-03T10:09:32.823 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:32.822+0000 7f2c48cab680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-03T10:09:32.837 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-10-03T10:09:32.836+0000 7f170fb4a200 -1 Falling back to public interface 2023-10-03T10:09:32.847 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-10-03T10:09:32.846+0000 7febc99ad200 -1 Falling back to public interface 2023-10-03T10:09:32.847 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-10-03T10:09:32.846+0000 7f1b14434200 -1 Falling back to public interface 2023-10-03T10:09:32.847 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-10-03T10:09:32.846+0000 7febc3b55700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6804/0: (98) Address already in use 2023-10-03T10:09:32.856 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-10-03T10:09:32.855+0000 7f32ce190200 -1 Falling back to public interface 2023-10-03T10:09:32.872 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:32.964 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:32.964+0000 7f2c48cab680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-03T10:09:32.980 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.980+0000 7ff62c932700 1 Processor -- start 2023-10-03T10:09:32.980 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.980+0000 7ff62c932700 1 -- start start 2023-10-03T10:09:32.982 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.980+0000 7ff62c932700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff62812b140 0x7ff62812b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.983 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.980+0000 7ff62c932700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff628095df0 0x7ff6280961d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.983 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.980+0000 7ff62c932700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6280966c0 0x7ff628131f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.983 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.980+0000 7ff62c932700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff628097290 con 0x7ff6280966c0 2023-10-03T10:09:32.983 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.980+0000 7ff62c932700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff628067830 con 0x7ff62812b140 2023-10-03T10:09:32.983 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.980+0000 7ff62c932700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff62812aca0 con 0x7ff628095df0 2023-10-03T10:09:32.983 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.980+0000 7ff625d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff628095df0 0x7ff6280961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.983 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.980+0000 7ff62659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff62812b140 0x7ff62812b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.983 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.980+0000 7ff62659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff62812b140 0x7ff62812b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34740/0 (socket says 172.21.15.72:34740) 2023-10-03T10:09:32.983 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.980+0000 7ff625d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff628095df0 0x7ff6280961d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:54864/0 (socket says 172.21.15.72:54864) 2023-10-03T10:09:32.984 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.980+0000 7ff62659c700 1 -- 172.21.15.72:0/3410335982 learned_addr learned my addr 172.21.15.72:0/3410335982 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:32.984 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.980+0000 7ff626d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6280966c0 0x7ff628131f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.984 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.981+0000 7ff62659c700 1 -- 172.21.15.72:0/3410335982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff628095df0 msgr2=0x7ff6280961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:32.984 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.981+0000 7ff62659c700 1 --2- 172.21.15.72:0/3410335982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff628095df0 0x7ff6280961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.984 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.981+0000 7ff62659c700 1 -- 172.21.15.72:0/3410335982 >> v2:172.21.15.72:3300/0 conn(0x7ff6280966c0 msgr2=0x7ff628131f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:32.984 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.981+0000 7ff62659c700 1 --2- 172.21.15.72:0/3410335982 >> v2:172.21.15.72:3300/0 conn(0x7ff6280966c0 0x7ff628131f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.984 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.981+0000 7ff62659c700 1 -- 172.21.15.72:0/3410335982 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff628068420 con 0x7ff62812b140 2023-10-03T10:09:32.984 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.981+0000 7ff626d9d700 1 --2- 172.21.15.72:0/3410335982 >> v2:172.21.15.72:3300/0 conn(0x7ff6280966c0 0x7ff628131f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:32.984 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.981+0000 7ff625d9b700 1 --2- 172.21.15.72:0/3410335982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff628095df0 0x7ff6280961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:32.984 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.981+0000 7ff62659c700 1 --2- 172.21.15.72:0/3410335982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff62812b140 0x7ff62812b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7ff618006fd0 tx=0x7ff6180090f0).ready entity=mon.1 client_cookie=dbeb06c9566c84d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:32.984 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.981+0000 7ff62559a700 1 -- 172.21.15.72:0/3410335982 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61800f510 con 0x7ff62812b140 2023-10-03T10:09:32.985 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.981+0000 7ff62559a700 1 -- 172.21.15.72:0/3410335982 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61800f670 con 0x7ff62812b140 2023-10-03T10:09:32.985 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.981+0000 7ff62559a700 1 -- 172.21.15.72:0/3410335982 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61800f9f0 con 0x7ff62812b140 2023-10-03T10:09:32.985 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.982+0000 7ff62c932700 1 -- 172.21.15.72:0/3410335982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff62812b140 msgr2=0x7ff62812b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.985 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.982+0000 7ff62c932700 1 --2- 172.21.15.72:0/3410335982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff62812b140 0x7ff62812b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7ff618006fd0 tx=0x7ff6180090f0).stop 2023-10-03T10:09:32.985 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.982+0000 7ff62c932700 1 -- 172.21.15.72:0/3410335982 shutdown_connections 2023-10-03T10:09:32.985 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.982+0000 7ff62c932700 1 --2- 172.21.15.72:0/3410335982 >> v2:172.21.15.72:3300/0 conn(0x7ff6280966c0 0x7ff628131f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.985 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.982+0000 7ff62c932700 1 --2- 172.21.15.72:0/3410335982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff62812b140 0x7ff62812b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.985 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.982+0000 7ff62c932700 1 --2- 172.21.15.72:0/3410335982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff628095df0 0x7ff6280961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.985 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.982+0000 7ff62c932700 1 -- 172.21.15.72:0/3410335982 >> 172.21.15.72:0/3410335982 conn(0x7ff62809aeb0 msgr2=0x7ff6280629b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:32.985 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.982+0000 7ff62c932700 1 -- 172.21.15.72:0/3410335982 shutdown_connections 2023-10-03T10:09:32.985 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.982+0000 7ff62c932700 1 -- 172.21.15.72:0/3410335982 wait complete. 2023-10-03T10:09:32.988 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.983+0000 7ff62c932700 1 Processor -- start 2023-10-03T10:09:32.988 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.983+0000 7ff62c932700 1 -- start start 2023-10-03T10:09:32.988 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.983+0000 7ff62c932700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6280966c0 0x7ff628128c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.988 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62c932700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff62812b140 0x7ff628117c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.988 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62c932700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff628118170 0x7ff6281185d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:32.988 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62c932700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff628119080 con 0x7ff628118170 2023-10-03T10:09:32.988 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62c932700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62811b0f0 con 0x7ff6280966c0 2023-10-03T10:09:32.988 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62c932700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff628118ac0 con 0x7ff62812b140 2023-10-03T10:09:32.988 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6280966c0 0x7ff628128c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.988 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff625d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff62812b140 0x7ff628117c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.988 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6280966c0 0x7ff628128c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34748/0 (socket says 172.21.15.72:34748) 2023-10-03T10:09:32.989 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62659c700 1 -- 172.21.15.72:0/297094063 learned_addr learned my addr 172.21.15.72:0/297094063 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:32.989 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff626d9d700 1 --2- 172.21.15.72:0/297094063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff628118170 0x7ff6281185d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:32.989 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62659c700 1 -- 172.21.15.72:0/297094063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff62812b140 msgr2=0x7ff628117c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.989 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62659c700 1 --2- 172.21.15.72:0/297094063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff62812b140 0x7ff628117c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.989 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62659c700 1 -- 172.21.15.72:0/297094063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff628118170 msgr2=0x7ff6281185d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:32.989 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62659c700 1 --2- 172.21.15.72:0/297094063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff628118170 0x7ff6281185d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:32.989 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62659c700 1 -- 172.21.15.72:0/297094063 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c0092a0 con 0x7ff6280966c0 2023-10-03T10:09:32.989 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff625d9b700 1 --2- 172.21.15.72:0/297094063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff62812b140 0x7ff628117c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:32.989 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62659c700 1 --2- 172.21.15.72:0/297094063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6280966c0 0x7ff628128c20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ff618009df0 tx=0x7ff618017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:32.989 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff6167fc700 1 -- 172.21.15.72:0/297094063 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618006a40 con 0x7ff6280966c0 2023-10-03T10:09:32.989 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff6167fc700 1 -- 172.21.15.72:0/297094063 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61800f7e0 con 0x7ff6280966c0 2023-10-03T10:09:32.990 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff6167fc700 1 -- 172.21.15.72:0/297094063 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61801d680 con 0x7ff6280966c0 2023-10-03T10:09:32.990 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62c932700 1 -- 172.21.15.72:0/297094063 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff620009a20 con 0x7ff6280966c0 2023-10-03T10:09:32.990 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.984+0000 7ff62c932700 1 -- 172.21.15.72:0/297094063 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff618009370 con 0x7ff6280966c0 2023-10-03T10:09:32.990 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.985+0000 7ff6167fc700 1 -- 172.21.15.72:0/297094063 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff61801dc50 con 0x7ff6280966c0 2023-10-03T10:09:32.990 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.985+0000 7ff6167fc700 1 -- 172.21.15.72:0/297094063 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7ff618026960 con 0x7ff6280966c0 2023-10-03T10:09:32.990 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.985+0000 7ff62c932700 1 -- 172.21.15.72:0/297094063 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62811b5f0 con 0x7ff6280966c0 2023-10-03T10:09:32.990 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:32.987+0000 7ff6167fc700 1 -- 172.21.15.72:0/297094063 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ff618026450 con 0x7ff6280966c0 2023-10-03T10:09:33.054 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:33.054+0000 7ff62c932700 1 -- 172.21.15.72:0/297094063 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff628097d20 con 0x7ff6280966c0 2023-10-03T10:09:33.055 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:33.054+0000 7ff6167fc700 1 -- 172.21.15.72:0/297094063 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7ff6180265f0 con 0x7ff6280966c0 2023-10-03T10:09:33.055 INFO:teuthology.misc.health.smithi072.stdout: 2023-10-03T10:09:33.055 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":6,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:09:32.210536+0000","last_up_change":"0.000000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:33.056 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:33.055+0000 7ff62c932700 1 -- 172.21.15.72:0/297094063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6280966c0 msgr2=0x7ff628128c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:33.056 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:33.055+0000 7ff62c932700 1 --2- 172.21.15.72:0/297094063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6280966c0 0x7ff628128c20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ff618009df0 tx=0x7ff618017000).stop 2023-10-03T10:09:33.056 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:33.055+0000 7ff62c932700 1 -- 172.21.15.72:0/297094063 shutdown_connections 2023-10-03T10:09:33.056 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:33.055+0000 7ff62c932700 1 --2- 172.21.15.72:0/297094063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff628118170 0x7ff6281185d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:33.056 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:33.055+0000 7ff62c932700 1 --2- 172.21.15.72:0/297094063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6280966c0 0x7ff628128c20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:33.057 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:33.055+0000 7ff62c932700 1 --2- 172.21.15.72:0/297094063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff62812b140 0x7ff628117c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:33.057 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:33.055+0000 7ff62c932700 1 -- 172.21.15.72:0/297094063 >> 172.21.15.72:0/297094063 conn(0x7ff628095df0 msgr2=0x7ff628129780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:33.057 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:33.055+0000 7ff62c932700 1 -- 172.21.15.72:0/297094063 shutdown_connections 2023-10-03T10:09:33.057 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:33.055+0000 7ff62c932700 1 -- 172.21.15.72:0/297094063 wait complete. 2023-10-03T10:09:33.067 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-10-03T10:09:33.395 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:33.394+0000 7f2c48cab680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-03T10:09:33.567 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:33.566+0000 7f2c48cab680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:09:33.631 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:33.630+0000 7f2c48cab680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-03T10:09:33.709 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:33.708+0000 7f2c48cab680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-03T10:09:33.777 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:33.777+0000 7f2c48cab680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-03T10:09:34.124 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:34.123+0000 7f2c48cab680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-03T10:09:34.208 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:34.208+0000 7f2c48cab680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-03T10:09:34.845 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:34.844+0000 7f2c48cab680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-03T10:09:34.914 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:34.913+0000 7f2c48cab680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-03T10:09:34.992 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:34.991+0000 7f2c48cab680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-03T10:09:35.278 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:35.278+0000 7f2c48cab680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-03T10:09:35.358 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:35.357+0000 7f2c48cab680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-03T10:09:35.471 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:35.470+0000 7f2c48cab680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-03T10:09:35.583 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:35.582+0000 7f2c48cab680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:09:35.786 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:35.786+0000 7f2c48cab680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-03T10:09:35.858 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:35.858+0000 7f2c48cab680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-03T10:09:36.351 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-10-03T10:09:36.351+0000 7f1b14434200 -1 osd.1 0 log_to_monitors {default=true} 2023-10-03T10:09:36.376 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-10-03T10:09:36.376+0000 7febc99ad200 -1 osd.0 0 log_to_monitors {default=true} 2023-10-03T10:09:36.586 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-10-03T10:09:36.585+0000 7f170fb4a200 -1 osd.2 0 log_to_monitors {default=true} 2023-10-03T10:09:36.614 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-10-03T10:09:36.614+0000 7f32ce190200 -1 osd.3 0 log_to_monitors {default=true} 2023-10-03T10:09:36.879 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:36.879+0000 7f2bff6e8700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-03T10:09:36.879 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:09:36.879+0000 7f2bff6e8700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-03T10:09:37.926 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-10-03T10:09:37.925+0000 7f32c4b31700 -1 osd.3 0 waiting for initial osdmap 2023-10-03T10:09:37.926 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-10-03T10:09:37.925+0000 7febc034e700 -1 osd.0 0 waiting for initial osdmap 2023-10-03T10:09:37.927 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-10-03T10:09:37.927+0000 7f17064eb700 -1 osd.2 0 waiting for initial osdmap 2023-10-03T10:09:37.928 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-10-03T10:09:37.928+0000 7f1b0add5700 -1 osd.1 0 waiting for initial osdmap 2023-10-03T10:09:37.931 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-10-03T10:09:37.931+0000 7f32c12ad700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:37.932 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-10-03T10:09:37.931+0000 7f1702c67700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:37.932 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-10-03T10:09:37.932+0000 7febbcaca700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:37.933 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-10-03T10:09:37.932+0000 7f1b07551700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:09:39.471 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:39.590 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.590+0000 7f1304551700 1 Processor -- start 2023-10-03T10:09:39.590 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.590+0000 7f1304551700 1 -- start start 2023-10-03T10:09:39.593 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.590+0000 7f1304551700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12fc0957d0 0x7f12fc095bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.593 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.590+0000 7f1304551700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12fc0960a0 0x7f12fc12f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.593 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.590+0000 7f1304551700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12fc12f6e0 0x7f12fc131ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.593 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.590+0000 7f1304551700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12fc096b50 con 0x7f12fc0960a0 2023-10-03T10:09:39.593 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.590+0000 7f1304551700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc092f30 con 0x7f12fc12f6e0 2023-10-03T10:09:39.593 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.590+0000 7f1304551700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc0919e0 con 0x7f12fc0957d0 2023-10-03T10:09:39.593 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f1302aee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12fc12f6e0 0x7f12fc131ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.593 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f1301aec700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12fc0960a0 0x7f12fc12f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.594 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f13022ed700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12fc0957d0 0x7f12fc095bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.594 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f1301aec700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12fc0960a0 0x7f12fc12f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38386/0 (socket says 172.21.15.72:38386) 2023-10-03T10:09:39.594 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f1301aec700 1 -- 172.21.15.72:0/3352153449 learned_addr learned my addr 172.21.15.72:0/3352153449 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:39.594 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f13022ed700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12fc0957d0 0x7f12fc095bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37866/0 (socket says 172.21.15.72:37866) 2023-10-03T10:09:39.594 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f1302aee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12fc12f6e0 0x7f12fc131ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42064/0 (socket says 172.21.15.72:42064) 2023-10-03T10:09:39.594 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f13022ed700 1 -- 172.21.15.72:0/3352153449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12fc12f6e0 msgr2=0x7f12fc131ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:39.594 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f13022ed700 1 --2- 172.21.15.72:0/3352153449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12fc12f6e0 0x7f12fc131ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.594 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f13022ed700 1 -- 172.21.15.72:0/3352153449 >> v2:172.21.15.72:3300/0 conn(0x7f12fc0960a0 msgr2=0x7f12fc12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:39.594 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f13022ed700 1 --2- 172.21.15.72:0/3352153449 >> v2:172.21.15.72:3300/0 conn(0x7f12fc0960a0 0x7f12fc12f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.594 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f13022ed700 1 -- 172.21.15.72:0/3352153449 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc094ee0 con 0x7f12fc0957d0 2023-10-03T10:09:39.595 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f1302aee700 1 --2- 172.21.15.72:0/3352153449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12fc12f6e0 0x7f12fc131ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:39.595 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f1301aec700 1 --2- 172.21.15.72:0/3352153449 >> v2:172.21.15.72:3300/0 conn(0x7f12fc0960a0 0x7f12fc12f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:39.595 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f13022ed700 1 --2- 172.21.15.72:0/3352153449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12fc0957d0 0x7f12fc095bb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f12f8009760 tx=0x7f12f8009060).ready entity=mon.2 client_cookie=fd0b358b61a7b285 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:39.595 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f13012eb700 1 -- 172.21.15.72:0/3352153449 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800d4a0 con 0x7f12fc0957d0 2023-10-03T10:09:39.595 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f13012eb700 1 -- 172.21.15.72:0/3352153449 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f800d600 con 0x7f12fc0957d0 2023-10-03T10:09:39.595 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.591+0000 7f13012eb700 1 -- 172.21.15.72:0/3352153449 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800d980 con 0x7f12fc0957d0 2023-10-03T10:09:39.595 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.592+0000 7f1304551700 1 -- 172.21.15.72:0/3352153449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12fc0957d0 msgr2=0x7f12fc095bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.595 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.592+0000 7f1304551700 1 --2- 172.21.15.72:0/3352153449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12fc0957d0 0x7f12fc095bb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f12f8009760 tx=0x7f12f8009060).stop 2023-10-03T10:09:39.595 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.592+0000 7f1304551700 1 -- 172.21.15.72:0/3352153449 shutdown_connections 2023-10-03T10:09:39.595 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.592+0000 7f1304551700 1 --2- 172.21.15.72:0/3352153449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12fc12f6e0 0x7f12fc131ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.595 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.592+0000 7f1304551700 1 --2- 172.21.15.72:0/3352153449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12fc0957d0 0x7f12fc095bb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.595 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.592+0000 7f1304551700 1 --2- 172.21.15.72:0/3352153449 >> v2:172.21.15.72:3300/0 conn(0x7f12fc0960a0 0x7f12fc12f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.596 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.592+0000 7f1304551700 1 -- 172.21.15.72:0/3352153449 >> 172.21.15.72:0/3352153449 conn(0x7f12fc09ab90 msgr2=0x7f12fc09afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:39.596 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.592+0000 7f1304551700 1 -- 172.21.15.72:0/3352153449 shutdown_connections 2023-10-03T10:09:39.596 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.592+0000 7f1304551700 1 -- 172.21.15.72:0/3352153449 wait complete. 2023-10-03T10:09:39.598 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.593+0000 7f1304551700 1 Processor -- start 2023-10-03T10:09:39.598 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.593+0000 7f1304551700 1 -- start start 2023-10-03T10:09:39.598 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.593+0000 7f1304551700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12fc0957d0 0x7f12fc118ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.598 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.593+0000 7f1304551700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12fc0960a0 0x7f12fc118fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.598 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.593+0000 7f1304551700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12fc12f6e0 0x7f12fc119490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.598 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.593+0000 7f1304551700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc11a770 con 0x7f12fc12f6e0 2023-10-03T10:09:39.598 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.593+0000 7f1304551700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc099ff0 con 0x7f12fc0957d0 2023-10-03T10:09:39.598 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.593+0000 7f1304551700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc096df0 con 0x7f12fc0960a0 2023-10-03T10:09:39.598 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.593+0000 7f13022ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12fc0957d0 0x7f12fc118ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.599 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.593+0000 7f1301aec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12fc0960a0 0x7f12fc118fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.599 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.593+0000 7f13022ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12fc0957d0 0x7f12fc118ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42068/0 (socket says 172.21.15.72:42068) 2023-10-03T10:09:39.599 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.593+0000 7f13022ed700 1 -- 172.21.15.72:0/741321990 learned_addr learned my addr 172.21.15.72:0/741321990 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:39.599 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.593+0000 7f1302aee700 1 --2- 172.21.15.72:0/741321990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12fc12f6e0 0x7f12fc119490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.599 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.594+0000 7f1301aec700 1 -- 172.21.15.72:0/741321990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12fc0957d0 msgr2=0x7f12fc118ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.599 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.594+0000 7f1301aec700 1 --2- 172.21.15.72:0/741321990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12fc0957d0 0x7f12fc118ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.599 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.594+0000 7f1301aec700 1 -- 172.21.15.72:0/741321990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12fc12f6e0 msgr2=0x7f12fc119490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.599 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.594+0000 7f1301aec700 1 --2- 172.21.15.72:0/741321990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12fc12f6e0 0x7f12fc119490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.599 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.594+0000 7f1301aec700 1 -- 172.21.15.72:0/741321990 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec009370 con 0x7f12fc0960a0 2023-10-03T10:09:39.599 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.594+0000 7f1301aec700 1 --2- 172.21.15.72:0/741321990 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12fc0960a0 0x7f12fc118fa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f12ec00ea00 tx=0x7f12ec0090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:39.599 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.594+0000 7f12f27fc700 1 -- 172.21.15.72:0/741321990 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec00c850 con 0x7f12fc0960a0 2023-10-03T10:09:39.600 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.594+0000 7f12f27fc700 1 -- 172.21.15.72:0/741321990 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec00c9b0 con 0x7f12fc0960a0 2023-10-03T10:09:39.600 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.594+0000 7f1304551700 1 -- 172.21.15.72:0/741321990 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f4009a20 con 0x7f12fc0960a0 2023-10-03T10:09:39.600 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.594+0000 7f12f27fc700 1 -- 172.21.15.72:0/741321990 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec00cd30 con 0x7f12fc0960a0 2023-10-03T10:09:39.600 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.594+0000 7f1304551700 1 -- 172.21.15.72:0/741321990 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f80092a0 con 0x7f12fc0960a0 2023-10-03T10:09:39.600 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.594+0000 7f12f27fc700 1 -- 172.21.15.72:0/741321990 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f12ec012600 con 0x7f12fc0960a0 2023-10-03T10:09:39.600 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.595+0000 7f12f27fc700 1 -- 172.21.15.72:0/741321990 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7f12ec03af80 con 0x7f12fc0960a0 2023-10-03T10:09:39.600 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.595+0000 7f1304551700 1 -- 172.21.15.72:0/741321990 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12fc096f30 con 0x7f12fc0960a0 2023-10-03T10:09:39.600 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.600+0000 7f12f27fc700 1 -- 172.21.15.72:0/741321990 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f12ec01b400 con 0x7f12fc0960a0 2023-10-03T10:09:39.759 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.759+0000 7f1304551700 1 -- 172.21.15.72:0/741321990 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12fc05a260 con 0x7f12fc0960a0 2023-10-03T10:09:39.760 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.759+0000 7f12f27fc700 1 -- 172.21.15.72:0/741321990 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4936 (secure 0 0 0) 0x7f12ec029030 con 0x7f12fc0960a0 2023-10-03T10:09:39.760 INFO:teuthology.misc.health.smithi072.stdout: 2023-10-03T10:09:39.760 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":9,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:09:38.922268+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:39.762 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.761+0000 7f1304551700 1 -- 172.21.15.72:0/741321990 >> v1:172.21.15.72:6816/118184 conn(0x7f12e002bb60 legacy=0x7f12e002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.762 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.761+0000 7f1304551700 1 -- 172.21.15.72:0/741321990 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12fc0960a0 msgr2=0x7f12fc118fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.762 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.761+0000 7f1304551700 1 --2- 172.21.15.72:0/741321990 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12fc0960a0 0x7f12fc118fa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f12ec00ea00 tx=0x7f12ec0090f0).stop 2023-10-03T10:09:39.762 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.761+0000 7f1304551700 1 -- 172.21.15.72:0/741321990 shutdown_connections 2023-10-03T10:09:39.762 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.761+0000 7f1304551700 1 --2- 172.21.15.72:0/741321990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12fc12f6e0 0x7f12fc119490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.762 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.761+0000 7f1304551700 1 --2- 172.21.15.72:0/741321990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12fc0957d0 0x7f12fc118ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.763 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.761+0000 7f1304551700 1 --2- 172.21.15.72:0/741321990 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12fc0960a0 0x7f12fc118fa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.763 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.761+0000 7f1304551700 1 -- 172.21.15.72:0/741321990 >> 172.21.15.72:0/741321990 conn(0x7f12fc09ab90 msgr2=0x7f12fc12e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:39.763 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.761+0000 7f1304551700 1 -- 172.21.15.72:0/741321990 shutdown_connections 2023-10-03T10:09:39.763 INFO:teuthology.misc.health.smithi072.stderr:2023-10-03T10:09:39.761+0000 7f1304551700 1 -- 172.21.15.72:0/741321990 wait complete. 2023-10-03T10:09:39.772 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-10-03T10:09:39.772 INFO:tasks.ceph:Creating RBD pool 2023-10-03T10:09:39.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-03T10:09:39.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.887+0000 7f2167d86700 1 Processor -- start 2023-10-03T10:09:39.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.887+0000 7f2167d86700 1 -- start start 2023-10-03T10:09:39.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2167d86700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f216012aa20 0x7f216012ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2167d86700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f216012d300 0x7f216012f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2167d86700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216006a6b0 con 0x7f216006a2d0 2023-10-03T10:09:39.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2167d86700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2160093db0 con 0x7f216012aa20 2023-10-03T10:09:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2167d86700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2160127af0 con 0x7f216012d300 2023-10-03T10:09:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2165321700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f216012aa20 0x7f216012ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2166323700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f216012d300 0x7f216012f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2165321700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f216012aa20 0x7f216012ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38412/0 (socket says 172.21.15.72:38412) 2023-10-03T10:09:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2166323700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f216012d300 0x7f216012f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42084/0 (socket says 172.21.15.72:42084) 2023-10-03T10:09:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2165321700 1 -- 172.21.15.72:0/1412073961 learned_addr learned my addr 172.21.15.72:0/1412073961 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2165b22700 1 --1- 172.21.15.72:0/1412073961 >> v1:172.21.15.72:6789/0 conn(0x7f216006a2d0 0x7f2160127d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60234/0 (socket says 172.21.15.72:60234) 2023-10-03T10:09:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2166323700 1 -- 172.21.15.72:0/1412073961 >> v2:172.21.15.72:3300/0 conn(0x7f216012aa20 msgr2=0x7f216012ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2166323700 1 --2- 172.21.15.72:0/1412073961 >> v2:172.21.15.72:3300/0 conn(0x7f216012aa20 0x7f216012ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2166323700 1 -- 172.21.15.72:0/1412073961 >> v1:172.21.15.72:6789/0 conn(0x7f216006a2d0 legacy=0x7f2160127d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2166323700 1 -- 172.21.15.72:0/1412073961 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160093330 con 0x7f216012d300 2023-10-03T10:09:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2164b20700 1 -- 172.21.15.72:0/1412073961 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460814048 0 0) 0x7f216006a6b0 con 0x7f216006a2d0 2023-10-03T10:09:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2165321700 1 --2- 172.21.15.72:0/1412073961 >> v2:172.21.15.72:3300/0 conn(0x7f216012aa20 0x7f216012ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.888+0000 7f2166323700 1 --2- 172.21.15.72:0/1412073961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f216012d300 0x7f216012f6f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2158009e60 tx=0x7f2158009780).ready entity=mon.1 client_cookie=3ea54e0bb2b97707 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.889+0000 7f2164b20700 1 -- 172.21.15.72:0/1412073961 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215800e070 con 0x7f216012d300 2023-10-03T10:09:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.889+0000 7f2164b20700 1 -- 172.21.15.72:0/1412073961 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215800bb60 con 0x7f216012d300 2023-10-03T10:09:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.889+0000 7f2164b20700 1 -- 172.21.15.72:0/1412073961 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158012410 con 0x7f216012d300 2023-10-03T10:09:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.889+0000 7f2167d86700 1 -- 172.21.15.72:0/1412073961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f216012d300 msgr2=0x7f216012f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.889+0000 7f2167d86700 1 --2- 172.21.15.72:0/1412073961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f216012d300 0x7f216012f6f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2158009e60 tx=0x7f2158009780).stop 2023-10-03T10:09:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.889+0000 7f2167d86700 1 -- 172.21.15.72:0/1412073961 shutdown_connections 2023-10-03T10:09:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.889+0000 7f2167d86700 1 --2- 172.21.15.72:0/1412073961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f216012d300 0x7f216012f6f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.889+0000 7f2167d86700 1 --2- 172.21.15.72:0/1412073961 >> v2:172.21.15.72:3300/0 conn(0x7f216012aa20 0x7f216012ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.889+0000 7f2167d86700 1 -- 172.21.15.72:0/1412073961 >> 172.21.15.72:0/1412073961 conn(0x7f21600998d0 msgr2=0x7f2160099ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.889+0000 7f2167d86700 1 -- 172.21.15.72:0/1412073961 shutdown_connections 2023-10-03T10:09:39.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.889+0000 7f2167d86700 1 -- 172.21.15.72:0/1412073961 wait complete. 2023-10-03T10:09:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.890+0000 7f2167d86700 1 Processor -- start 2023-10-03T10:09:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.890+0000 7f2167d86700 1 -- start start 2023-10-03T10:09:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.890+0000 7f2167d86700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f216006a2d0 0x7f2160110a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.890+0000 7f2167d86700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f216012aa20 0x7f2160066df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.890+0000 7f2167d86700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f216012d300 0x7f21600672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2167d86700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2160069420 con 0x7f216006a2d0 2023-10-03T10:09:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2167d86700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2160093560 con 0x7f216012d300 2023-10-03T10:09:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2167d86700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f216010ffd0 con 0x7f216012aa20 2023-10-03T10:09:39.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2165b22700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f216006a2d0 0x7f2160110a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2166323700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f216012d300 0x7f21600672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2166323700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f216012d300 0x7f21600672e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42100/0 (socket says 172.21.15.72:42100) 2023-10-03T10:09:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2165b22700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f216006a2d0 0x7f2160110a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38428/0 (socket says 172.21.15.72:38428) 2023-10-03T10:09:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2165321700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f216012aa20 0x7f2160066df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2165b22700 1 -- 172.21.15.72:0/3765421756 learned_addr learned my addr 172.21.15.72:0/3765421756 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2166323700 1 -- 172.21.15.72:0/3765421756 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f216012aa20 msgr2=0x7f2160066df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2166323700 1 --2- 172.21.15.72:0/3765421756 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f216012aa20 0x7f2160066df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2166323700 1 -- 172.21.15.72:0/3765421756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f216006a2d0 msgr2=0x7f2160110a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2166323700 1 --2- 172.21.15.72:0/3765421756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f216006a2d0 0x7f2160110a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2166323700 1 -- 172.21.15.72:0/3765421756 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c009370 con 0x7f216012d300 2023-10-03T10:09:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2165b22700 1 --2- 172.21.15.72:0/3765421756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f216006a2d0 0x7f2160110a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:39.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2165321700 1 --2- 172.21.15.72:0/3765421756 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f216012aa20 0x7f2160066df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:39.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2166323700 1 --2- 172.21.15.72:0/3765421756 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f216012d300 0x7f21600672e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2160063a60 tx=0x7f21600997b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:39.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2155ffb700 1 -- 172.21.15.72:0/3765421756 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158021070 con 0x7f216012d300 2023-10-03T10:09:39.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2155ffb700 1 -- 172.21.15.72:0/3765421756 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215801b830 con 0x7f216012d300 2023-10-03T10:09:39.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2155ffb700 1 -- 172.21.15.72:0/3765421756 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158012410 con 0x7f216012d300 2023-10-03T10:09:39.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2167d86700 1 -- 172.21.15.72:0/3765421756 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2158009a20 con 0x7f216012d300 2023-10-03T10:09:39.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.891+0000 7f2167d86700 1 -- 172.21.15.72:0/3765421756 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21600681f0 con 0x7f216012d300 2023-10-03T10:09:39.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.892+0000 7f2155ffb700 1 -- 172.21.15.72:0/3765421756 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2158003040 con 0x7f216012d300 2023-10-03T10:09:39.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.892+0000 7f2155ffb700 1 -- 172.21.15.72:0/3765421756 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2069+0+0 (secure 0 0 0) 0x7f215803fdf0 con 0x7f216012d300 2023-10-03T10:09:39.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.892+0000 7f2167d86700 1 -- 172.21.15.72:0/3765421756 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2160110110 con 0x7f216012d300 2023-10-03T10:09:39.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:39.897+0000 7f2155ffb700 1 -- 172.21.15.72:0/3765421756 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f215802b030 con 0x7f216012d300 2023-10-03T10:09:40.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:40.060+0000 7f2167d86700 1 -- 172.21.15.72:0/3765421756 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f216005a260 con 0x7f216012d300 2023-10-03T10:09:40.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:40.937+0000 7f2155ffb700 1 -- 172.21.15.72:0/3765421756 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v11) v1 ==== 109+0+0 (secure 0 0 0) 0x7f2158026460 con 0x7f216012d300 2023-10-03T10:09:40.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:40.941+0000 7f2167d86700 1 -- 172.21.15.72:0/3765421756 >> v1:172.21.15.72:6816/118184 conn(0x7f214402bb60 legacy=0x7f214402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:40.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:40.941+0000 7f2167d86700 1 -- 172.21.15.72:0/3765421756 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f216012d300 msgr2=0x7f21600672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:40.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:40.941+0000 7f2167d86700 1 --2- 172.21.15.72:0/3765421756 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f216012d300 0x7f21600672e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2160063a60 tx=0x7f21600997b0).stop 2023-10-03T10:09:40.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:40.941+0000 7f2167d86700 1 -- 172.21.15.72:0/3765421756 shutdown_connections 2023-10-03T10:09:40.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:40.941+0000 7f2167d86700 1 --2- 172.21.15.72:0/3765421756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f216006a2d0 0x7f2160110a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:40.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:40.941+0000 7f2167d86700 1 --2- 172.21.15.72:0/3765421756 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f216012d300 0x7f21600672e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:40.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:40.941+0000 7f2167d86700 1 --2- 172.21.15.72:0/3765421756 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f216012aa20 0x7f2160066df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:40.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:40.941+0000 7f2167d86700 1 -- 172.21.15.72:0/3765421756 >> 172.21.15.72:0/3765421756 conn(0x7f21600998d0 msgr2=0x7f2160126470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:40.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:40.942+0000 7f2167d86700 1 -- 172.21.15.72:0/3765421756 shutdown_connections 2023-10-03T10:09:40.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:40.942+0000 7f2167d86700 1 -- 172.21.15.72:0/3765421756 wait complete. 2023-10-03T10:09:40.943 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'rbd' created 2023-10-03T10:09:40.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-03T10:09:41.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.079+0000 7f7c702c5700 1 Processor -- start 2023-10-03T10:09:41.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.079+0000 7f7c702c5700 1 -- start start 2023-10-03T10:09:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c702c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c68059070 0x7f7c681277f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c702c5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7c681280e0 0x7f7c6812b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c702c5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c68092b60 con 0x7f7c68127ce0 2023-10-03T10:09:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c702c5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c68059450 con 0x7f7c681280e0 2023-10-03T10:09:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c702c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c68091c10 con 0x7f7c68059070 2023-10-03T10:09:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6e862700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7c681280e0 0x7f7c6812b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6e061700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c68059070 0x7f7c681277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6e061700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c68059070 0x7f7c681277f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42106/0 (socket says 172.21.15.72:42106) 2023-10-03T10:09:41.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6d860700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7c68127ce0 0x7f7c6812a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60238/0 (socket says 172.21.15.72:60238) 2023-10-03T10:09:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6e862700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7c681280e0 0x7f7c6812b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38442/0 (socket says 172.21.15.72:38442) 2023-10-03T10:09:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6e061700 1 -- 172.21.15.72:0/3199388098 learned_addr learned my addr 172.21.15.72:0/3199388098 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6e862700 1 -- 172.21.15.72:0/3199388098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c68059070 msgr2=0x7f7c681277f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6e862700 1 --2- 172.21.15.72:0/3199388098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c68059070 0x7f7c681277f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6e862700 1 -- 172.21.15.72:0/3199388098 >> v1:172.21.15.72:6789/0 conn(0x7f7c68127ce0 legacy=0x7f7c6812a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6d05f700 1 -- 172.21.15.72:0/3199388098 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683383312 0 0) 0x7f7c68092b60 con 0x7f7c68127ce0 2023-10-03T10:09:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6e862700 1 -- 172.21.15.72:0/3199388098 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c68096810 con 0x7f7c681280e0 2023-10-03T10:09:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6e061700 1 --2- 172.21.15.72:0/3199388098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c68059070 0x7f7c681277f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6e862700 1 --2- 172.21.15.72:0/3199388098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c681280e0 0x7f7c6812b0b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7c60009e60 tx=0x7f7c60009780).ready entity=mon.0 client_cookie=e38708ca5e8ba3e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6d05f700 1 -- 172.21.15.72:0/3199388098 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6000e070 con 0x7f7c681280e0 2023-10-03T10:09:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6d05f700 1 -- 172.21.15.72:0/3199388098 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6000bb60 con 0x7f7c681280e0 2023-10-03T10:09:41.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.080+0000 7f7c6d05f700 1 -- 172.21.15.72:0/3199388098 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60012410 con 0x7f7c681280e0 2023-10-03T10:09:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.081+0000 7f7c702c5700 1 -- 172.21.15.72:0/3199388098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c681280e0 msgr2=0x7f7c6812b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.081+0000 7f7c702c5700 1 --2- 172.21.15.72:0/3199388098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c681280e0 0x7f7c6812b0b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7c60009e60 tx=0x7f7c60009780).stop 2023-10-03T10:09:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.081+0000 7f7c702c5700 1 -- 172.21.15.72:0/3199388098 shutdown_connections 2023-10-03T10:09:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.081+0000 7f7c702c5700 1 --2- 172.21.15.72:0/3199388098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c681280e0 0x7f7c6812b0b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.081+0000 7f7c702c5700 1 --2- 172.21.15.72:0/3199388098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c68059070 0x7f7c681277f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.081+0000 7f7c702c5700 1 -- 172.21.15.72:0/3199388098 >> 172.21.15.72:0/3199388098 conn(0x7f7c68097560 msgr2=0x7f7c68097970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.081+0000 7f7c702c5700 1 -- 172.21.15.72:0/3199388098 shutdown_connections 2023-10-03T10:09:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.081+0000 7f7c702c5700 1 -- 172.21.15.72:0/3199388098 wait complete. 2023-10-03T10:09:41.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.082+0000 7f7c702c5700 1 Processor -- start 2023-10-03T10:09:41.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.082+0000 7f7c702c5700 1 -- start start 2023-10-03T10:09:41.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.082+0000 7f7c702c5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c68059070 0x7f7c68117c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:41.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.082+0000 7f7c702c5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c68127ce0 0x7f7c68113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.082+0000 7f7c702c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c681280e0 0x7f7c68114160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.082+0000 7f7c702c5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c681160d0 con 0x7f7c68127ce0 2023-10-03T10:09:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.082+0000 7f7c702c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c68124d40 con 0x7f7c681280e0 2023-10-03T10:09:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.082+0000 7f7c702c5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c68093600 con 0x7f7c68059070 2023-10-03T10:09:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.082+0000 7f7c6e061700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c68059070 0x7f7c68117c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.082+0000 7f7c6d860700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c68127ce0 0x7f7c68113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.082+0000 7f7c6e862700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c681280e0 0x7f7c68114160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.082+0000 7f7c6e061700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c68059070 0x7f7c68117c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37900/0 (socket says 172.21.15.72:37900) 2023-10-03T10:09:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.082+0000 7f7c6e061700 1 -- 172.21.15.72:0/3422709378 learned_addr learned my addr 172.21.15.72:0/3422709378 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.083+0000 7f7c6e862700 1 -- 172.21.15.72:0/3422709378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c68059070 msgr2=0x7f7c68117c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.083+0000 7f7c6e862700 1 --2- 172.21.15.72:0/3422709378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c68059070 0x7f7c68117c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.083+0000 7f7c6e862700 1 -- 172.21.15.72:0/3422709378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c68127ce0 msgr2=0x7f7c68113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.083+0000 7f7c6e862700 1 --2- 172.21.15.72:0/3422709378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c68127ce0 0x7f7c68113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.083+0000 7f7c6e862700 1 -- 172.21.15.72:0/3422709378 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58009370 con 0x7f7c681280e0 2023-10-03T10:09:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.083+0000 7f7c6e061700 1 --2- 172.21.15.72:0/3422709378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c68059070 0x7f7c68117c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.083+0000 7f7c6d860700 1 --2- 172.21.15.72:0/3422709378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c68127ce0 0x7f7c68113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.083+0000 7f7c6e862700 1 --2- 172.21.15.72:0/3422709378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c681280e0 0x7f7c68114160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f7c680657c0 tx=0x7f7c60009780).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.083+0000 7f7c5e7fc700 1 -- 172.21.15.72:0/3422709378 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60012410 con 0x7f7c681280e0 2023-10-03T10:09:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.083+0000 7f7c5e7fc700 1 -- 172.21.15.72:0/3422709378 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6001d630 con 0x7f7c681280e0 2023-10-03T10:09:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.083+0000 7f7c702c5700 1 -- 172.21.15.72:0/3422709378 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c60009a20 con 0x7f7c681280e0 2023-10-03T10:09:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.083+0000 7f7c5e7fc700 1 -- 172.21.15.72:0/3422709378 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c600070e0 con 0x7f7c681280e0 2023-10-03T10:09:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.083+0000 7f7c702c5700 1 -- 172.21.15.72:0/3422709378 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c68117170 con 0x7f7c681280e0 2023-10-03T10:09:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.084+0000 7f7c5e7fc700 1 -- 172.21.15.72:0/3422709378 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7c60003040 con 0x7f7c681280e0 2023-10-03T10:09:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.084+0000 7f7c5e7fc700 1 -- 172.21.15.72:0/3422709378 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2827+0+0 (secure 0 0 0) 0x7f7c6003c960 con 0x7f7c681280e0 2023-10-03T10:09:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.084+0000 7f7c702c5700 1 -- 172.21.15.72:0/3422709378 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c68097b70 con 0x7f7c681280e0 2023-10-03T10:09:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.089+0000 7f7c5e7fc700 1 -- 172.21.15.72:0/3422709378 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7c60025dc0 con 0x7f7c681280e0 2023-10-03T10:09:41.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.249+0000 7f7c702c5700 1 -- 172.21.15.72:0/3422709378 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7c68092d90 con 0x7f7c681280e0 2023-10-03T10:09:41.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.937+0000 7f7c5e7fc700 1 -- 172.21.15.72:0/3422709378 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v12) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7c60025360 con 0x7f7c681280e0 2023-10-03T10:09:41.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.941+0000 7f7c702c5700 1 -- 172.21.15.72:0/3422709378 >> v1:172.21.15.72:6816/118184 conn(0x7f7c4c02bb60 legacy=0x7f7c4c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:41.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.941+0000 7f7c702c5700 1 -- 172.21.15.72:0/3422709378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c681280e0 msgr2=0x7f7c68114160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:41.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.941+0000 7f7c702c5700 1 --2- 172.21.15.72:0/3422709378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c681280e0 0x7f7c68114160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f7c680657c0 tx=0x7f7c60009780).stop 2023-10-03T10:09:41.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.941+0000 7f7c702c5700 1 -- 172.21.15.72:0/3422709378 shutdown_connections 2023-10-03T10:09:41.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.941+0000 7f7c702c5700 1 --2- 172.21.15.72:0/3422709378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c681280e0 0x7f7c68114160 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:41.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.941+0000 7f7c702c5700 1 --2- 172.21.15.72:0/3422709378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c68059070 0x7f7c68117c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:41.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.941+0000 7f7c702c5700 1 --2- 172.21.15.72:0/3422709378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c68127ce0 0x7f7c68113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:41.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.941+0000 7f7c702c5700 1 -- 172.21.15.72:0/3422709378 >> 172.21.15.72:0/3422709378 conn(0x7f7c68097560 msgr2=0x7f7c681292b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:41.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.941+0000 7f7c702c5700 1 -- 172.21.15.72:0/3422709378 shutdown_connections 2023-10-03T10:09:41.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:41.941+0000 7f7c702c5700 1 -- 172.21.15.72:0/3422709378 wait complete. 2023-10-03T10:09:41.943 INFO:teuthology.orchestra.run.smithi072.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-03T10:09:41.957 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-03T10:09:41.957 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T10:09:41.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T10:09:41.959 INFO:tasks.ceph.mds.a:Started 2023-10-03T10:09:41.959 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-03T10:09:41.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:42.039 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-10-03T10:09:42.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.084+0000 7f39c258f700 1 Processor -- start 2023-10-03T10:09:42.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.084+0000 7f39c258f700 1 -- start start 2023-10-03T10:09:42.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.084+0000 7f39c258f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0965e0 0x7f39bc0969c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.084+0000 7f39c258f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f39bc096eb0 0x7f39bc067de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.084+0000 7f39c258f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc0682d0 0x7f39bc068740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.084+0000 7f39c258f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc068c30 con 0x7f39bc096eb0 2023-10-03T10:09:42.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.084+0000 7f39c258f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc0933b0 con 0x7f39bc0965e0 2023-10-03T10:09:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.084+0000 7f39c258f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc092190 con 0x7f39bc0682d0 2023-10-03T10:09:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.084+0000 7f39c0b2c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc0682d0 0x7f39bc068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.084+0000 7f39bb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f39bc096eb0 0x7f39bc067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.084+0000 7f39bbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0965e0 0x7f39bc0969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.084+0000 7f39c0b2c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc0682d0 0x7f39bc068740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37908/0 (socket says 172.21.15.72:37908) 2023-10-03T10:09:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.084+0000 7f39bbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0965e0 0x7f39bc0969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42126/0 (socket says 172.21.15.72:42126) 2023-10-03T10:09:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.084+0000 7f39bb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f39bc096eb0 0x7f39bc067de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38476/0 (socket says 172.21.15.72:38476) 2023-10-03T10:09:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.084+0000 7f39c0b2c700 1 -- 172.21.15.72:0/4201870546 learned_addr learned my addr 172.21.15.72:0/4201870546 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39c0b2c700 1 -- 172.21.15.72:0/4201870546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0965e0 msgr2=0x7f39bc0969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39c0b2c700 1 --2- 172.21.15.72:0/4201870546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0965e0 0x7f39bc0969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39c0b2c700 1 -- 172.21.15.72:0/4201870546 >> v2:172.21.15.72:3300/0 conn(0x7f39bc096eb0 msgr2=0x7f39bc067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39c0b2c700 1 --2- 172.21.15.72:0/4201870546 >> v2:172.21.15.72:3300/0 conn(0x7f39bc096eb0 0x7f39bc067de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39c0b2c700 1 -- 172.21.15.72:0/4201870546 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc069a20 con 0x7f39bc0682d0 2023-10-03T10:09:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39bb7fe700 1 --2- 172.21.15.72:0/4201870546 >> v2:172.21.15.72:3300/0 conn(0x7f39bc096eb0 0x7f39bc067de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39c0b2c700 1 --2- 172.21.15.72:0/4201870546 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc0682d0 0x7f39bc068740 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f39b400d1a0 tx=0x7f39b400ba50).ready entity=mon.2 client_cookie=8831ad554a10f0d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39baffd700 1 -- 172.21.15.72:0/4201870546 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4010070 con 0x7f39bc0682d0 2023-10-03T10:09:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39baffd700 1 -- 172.21.15.72:0/4201870546 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b400dd60 con 0x7f39bc0682d0 2023-10-03T10:09:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39baffd700 1 -- 172.21.15.72:0/4201870546 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b400b2e0 con 0x7f39bc0682d0 2023-10-03T10:09:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39c258f700 1 -- 172.21.15.72:0/4201870546 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc0682d0 msgr2=0x7f39bc068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39c258f700 1 --2- 172.21.15.72:0/4201870546 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc0682d0 0x7f39bc068740 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f39b400d1a0 tx=0x7f39b400ba50).stop 2023-10-03T10:09:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39c258f700 1 -- 172.21.15.72:0/4201870546 shutdown_connections 2023-10-03T10:09:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39c258f700 1 --2- 172.21.15.72:0/4201870546 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc0682d0 0x7f39bc068740 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39c258f700 1 --2- 172.21.15.72:0/4201870546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0965e0 0x7f39bc0969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39c258f700 1 --2- 172.21.15.72:0/4201870546 >> v2:172.21.15.72:3300/0 conn(0x7f39bc096eb0 0x7f39bc067de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39c258f700 1 -- 172.21.15.72:0/4201870546 >> 172.21.15.72:0/4201870546 conn(0x7f39bc09a220 msgr2=0x7f39bc09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:42.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39c258f700 1 -- 172.21.15.72:0/4201870546 shutdown_connections 2023-10-03T10:09:42.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.085+0000 7f39c258f700 1 -- 172.21.15.72:0/4201870546 wait complete. 2023-10-03T10:09:42.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.086+0000 7f39c258f700 1 Processor -- start 2023-10-03T10:09:42.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.086+0000 7f39c258f700 1 -- start start 2023-10-03T10:09:42.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39c258f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc0682d0 0x7f39bc12a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39c258f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0965e0 0x7f39bc115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39c258f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc096eb0 0x7f39bc116280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39c258f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc122980 con 0x7f39bc0682d0 2023-10-03T10:09:42.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39c258f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc1198c0 con 0x7f39bc0965e0 2023-10-03T10:09:42.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39c258f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc099ab0 con 0x7f39bc096eb0 2023-10-03T10:09:42.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39bbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc0682d0 0x7f39bc12a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39c0b2c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc096eb0 0x7f39bc116280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39bbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc0682d0 0x7f39bc12a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38488/0 (socket says 172.21.15.72:38488) 2023-10-03T10:09:42.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39bbfff700 1 -- 172.21.15.72:0/3527166798 learned_addr learned my addr 172.21.15.72:0/3527166798 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:42.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39bb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0965e0 0x7f39bc115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39bbfff700 1 -- 172.21.15.72:0/3527166798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc096eb0 msgr2=0x7f39bc116280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39bbfff700 1 --2- 172.21.15.72:0/3527166798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc096eb0 0x7f39bc116280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39bbfff700 1 -- 172.21.15.72:0/3527166798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0965e0 msgr2=0x7f39bc115d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39bbfff700 1 --2- 172.21.15.72:0/3527166798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0965e0 0x7f39bc115d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39bbfff700 1 -- 172.21.15.72:0/3527166798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac0092a0 con 0x7f39bc0682d0 2023-10-03T10:09:42.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39c0b2c700 1 --2- 172.21.15.72:0/3527166798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc096eb0 0x7f39bc116280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:42.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39bbfff700 1 --2- 172.21.15.72:0/3527166798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc0682d0 0x7f39bc12a630 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f39b000e930 tx=0x7f39b0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:42.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.087+0000 7f39a3fff700 1 -- 172.21.15.72:0/3527166798 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0012600 con 0x7f39bc0682d0 2023-10-03T10:09:42.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.088+0000 7f39a3fff700 1 -- 172.21.15.72:0/3527166798 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b0012760 con 0x7f39bc0682d0 2023-10-03T10:09:42.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.088+0000 7f39c258f700 1 -- 172.21.15.72:0/3527166798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b400bcf0 con 0x7f39bc0682d0 2023-10-03T10:09:42.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.088+0000 7f39a3fff700 1 -- 172.21.15.72:0/3527166798 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0012ae0 con 0x7f39bc0682d0 2023-10-03T10:09:42.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.088+0000 7f39c258f700 1 -- 172.21.15.72:0/3527166798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc1183a0 con 0x7f39bc0682d0 2023-10-03T10:09:42.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.088+0000 7f39a3fff700 1 -- 172.21.15.72:0/3527166798 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f39b001b400 con 0x7f39bc0682d0 2023-10-03T10:09:42.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.088+0000 7f39a3fff700 1 -- 172.21.15.72:0/3527166798 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f39b003b190 con 0x7f39bc0682d0 2023-10-03T10:09:42.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.089+0000 7f39c258f700 1 -- 172.21.15.72:0/3527166798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39bc05a260 con 0x7f39bc0682d0 2023-10-03T10:09:42.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.093+0000 7f39a3fff700 1 -- 172.21.15.72:0/3527166798 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f39b0019900 con 0x7f39bc0682d0 2023-10-03T10:09:42.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.252+0000 7f39c258f700 1 -- 172.21.15.72:0/3527166798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39bc069ce0 con 0x7f39bc0682d0 2023-10-03T10:09:42.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.253+0000 7f39a3fff700 1 -- 172.21.15.72:0/3527166798 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+8137 (secure 0 0 0) 0x7f39b0023350 con 0x7f39bc0682d0 2023-10-03T10:09:42.253 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:42.253 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":12,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:09:41.932822+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:42.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.254+0000 7f39c258f700 1 -- 172.21.15.72:0/3527166798 >> v1:172.21.15.72:6816/118184 conn(0x7f39a802bb60 legacy=0x7f39a802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.254+0000 7f39c258f700 1 -- 172.21.15.72:0/3527166798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc0682d0 msgr2=0x7f39bc12a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.254+0000 7f39c258f700 1 --2- 172.21.15.72:0/3527166798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc0682d0 0x7f39bc12a630 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f39b000e930 tx=0x7f39b0009060).stop 2023-10-03T10:09:42.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.254+0000 7f39c258f700 1 -- 172.21.15.72:0/3527166798 shutdown_connections 2023-10-03T10:09:42.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.254+0000 7f39c258f700 1 --2- 172.21.15.72:0/3527166798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc0682d0 0x7f39bc12a630 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.254+0000 7f39c258f700 1 --2- 172.21.15.72:0/3527166798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc096eb0 0x7f39bc116280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.254+0000 7f39c258f700 1 --2- 172.21.15.72:0/3527166798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0965e0 0x7f39bc115d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.254+0000 7f39c258f700 1 -- 172.21.15.72:0/3527166798 >> 172.21.15.72:0/3527166798 conn(0x7f39bc09a220 msgr2=0x7f39bc065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:42.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.255+0000 7f39c258f700 1 -- 172.21.15.72:0/3527166798 shutdown_connections 2023-10-03T10:09:42.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.255+0000 7f39c258f700 1 -- 172.21.15.72:0/3527166798 wait complete. 2023-10-03T10:09:42.267 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:38.963446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:40.092839+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-03T10:09:42.267 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:09:42.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.384+0000 7ff7cb521700 1 Processor -- start 2023-10-03T10:09:42.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.384+0000 7ff7cb521700 1 -- start start 2023-10-03T10:09:42.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.384+0000 7ff7cb521700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7c4093840 0x7ff7c4098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.384+0000 7ff7cb521700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7c4098c80 0x7ff7c4099060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.384+0000 7ff7cb521700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c4092d80 con 0x7ff7c412c150 2023-10-03T10:09:42.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.384+0000 7ff7cb521700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4093c20 con 0x7ff7c4098c80 2023-10-03T10:09:42.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.384+0000 7ff7cb521700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4092b90 con 0x7ff7c4093840 2023-10-03T10:09:42.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.385+0000 7ff7c8abc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7c4098c80 0x7ff7c4099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.385+0000 7ff7c92bd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7c4093840 0x7ff7c4098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.385+0000 7ff7c9abe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff7c412c150 0x7ff7c412e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60262/0 (socket says 172.21.15.72:60262) 2023-10-03T10:09:42.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.385+0000 7ff7c9abe700 1 -- 172.21.15.72:0/2130916301 learned_addr learned my addr 172.21.15.72:0/2130916301 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:42.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.385+0000 7ff7c92bd700 1 -- 172.21.15.72:0/2130916301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7c4098c80 msgr2=0x7ff7c4099060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:42.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.385+0000 7ff7c92bd700 1 --2- 172.21.15.72:0/2130916301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7c4098c80 0x7ff7c4099060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.385+0000 7ff7bbfff700 1 -- 172.21.15.72:0/2130916301 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749792593 0 0) 0x7ff7c4092d80 con 0x7ff7c412c150 2023-10-03T10:09:42.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.385+0000 7ff7c92bd700 1 -- 172.21.15.72:0/2130916301 >> v1:172.21.15.72:6789/0 conn(0x7ff7c412c150 legacy=0x7ff7c412e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.385+0000 7ff7c92bd700 1 -- 172.21.15.72:0/2130916301 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4099b70 con 0x7ff7c4093840 2023-10-03T10:09:42.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.385+0000 7ff7c8abc700 1 --2- 172.21.15.72:0/2130916301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7c4098c80 0x7ff7c4099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:42.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.385+0000 7ff7c92bd700 1 --2- 172.21.15.72:0/2130916301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7c4093840 0x7ff7c4098790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff7b4009790 tx=0x7ff7b4009060).ready entity=mon.2 client_cookie=c4d8979ebc3549b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:42.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.385+0000 7ff7bbfff700 1 -- 172.21.15.72:0/2130916301 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400f510 con 0x7ff7c4093840 2023-10-03T10:09:42.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.385+0000 7ff7bbfff700 1 -- 172.21.15.72:0/2130916301 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b400f670 con 0x7ff7c4093840 2023-10-03T10:09:42.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.385+0000 7ff7bbfff700 1 -- 172.21.15.72:0/2130916301 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400f9f0 con 0x7ff7c4093840 2023-10-03T10:09:42.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.386+0000 7ff7cb521700 1 -- 172.21.15.72:0/2130916301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7c4093840 msgr2=0x7ff7c4098790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.386+0000 7ff7cb521700 1 --2- 172.21.15.72:0/2130916301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7c4093840 0x7ff7c4098790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff7b4009790 tx=0x7ff7b4009060).stop 2023-10-03T10:09:42.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.386+0000 7ff7cb521700 1 -- 172.21.15.72:0/2130916301 shutdown_connections 2023-10-03T10:09:42.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.386+0000 7ff7cb521700 1 --2- 172.21.15.72:0/2130916301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7c4093840 0x7ff7c4098790 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.386+0000 7ff7cb521700 1 --2- 172.21.15.72:0/2130916301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7c4098c80 0x7ff7c4099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.386+0000 7ff7cb521700 1 -- 172.21.15.72:0/2130916301 >> 172.21.15.72:0/2130916301 conn(0x7ff7c4097480 msgr2=0x7ff7c4097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:42.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.386+0000 7ff7cb521700 1 -- 172.21.15.72:0/2130916301 shutdown_connections 2023-10-03T10:09:42.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.386+0000 7ff7cb521700 1 -- 172.21.15.72:0/2130916301 wait complete. 2023-10-03T10:09:42.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.387+0000 7ff7cb521700 1 Processor -- start 2023-10-03T10:09:42.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.387+0000 7ff7cb521700 1 -- start start 2023-10-03T10:09:42.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.387+0000 7ff7cb521700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7c4093840 0x7ff7c4115980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.387+0000 7ff7cb521700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7c4098c80 0x7ff7c4115e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.387+0000 7ff7cb521700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7c412c150 0x7ff7c4116360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.387+0000 7ff7cb521700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c412baa0 con 0x7ff7c4098c80 2023-10-03T10:09:42.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.387+0000 7ff7cb521700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4117fb0 con 0x7ff7c4093840 2023-10-03T10:09:42.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.387+0000 7ff7cb521700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c406a520 con 0x7ff7c412c150 2023-10-03T10:09:42.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.387+0000 7ff7c8abc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7c4098c80 0x7ff7c4115e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.387+0000 7ff7c9abe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7c412c150 0x7ff7c4116360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.387+0000 7ff7c8abc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7c4098c80 0x7ff7c4115e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38500/0 (socket says 172.21.15.72:38500) 2023-10-03T10:09:42.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.387+0000 7ff7c8abc700 1 -- 172.21.15.72:0/3600348164 learned_addr learned my addr 172.21.15.72:0/3600348164 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:42.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.387+0000 7ff7c9abe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7c412c150 0x7ff7c4116360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37932/0 (socket says 172.21.15.72:37932) 2023-10-03T10:09:42.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.387+0000 7ff7c92bd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7c4093840 0x7ff7c4115980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.388+0000 7ff7c9abe700 1 -- 172.21.15.72:0/3600348164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7c4093840 msgr2=0x7ff7c4115980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.388+0000 7ff7c9abe700 1 --2- 172.21.15.72:0/3600348164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7c4093840 0x7ff7c4115980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.388+0000 7ff7c9abe700 1 -- 172.21.15.72:0/3600348164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7c4098c80 msgr2=0x7ff7c4115e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.388+0000 7ff7c9abe700 1 --2- 172.21.15.72:0/3600348164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7c4098c80 0x7ff7c4115e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.388+0000 7ff7c9abe700 1 -- 172.21.15.72:0/3600348164 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c00092a0 con 0x7ff7c412c150 2023-10-03T10:09:42.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.388+0000 7ff7c9abe700 1 --2- 172.21.15.72:0/3600348164 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7c412c150 0x7ff7c4116360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff7bc002230 tx=0x7ff7bc007eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:42.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.388+0000 7ff7b97fa700 1 -- 172.21.15.72:0/3600348164 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc005d30 con 0x7ff7c412c150 2023-10-03T10:09:42.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.388+0000 7ff7b97fa700 1 -- 172.21.15.72:0/3600348164 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc005e90 con 0x7ff7c412c150 2023-10-03T10:09:42.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.388+0000 7ff7cb521700 1 -- 172.21.15.72:0/3600348164 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b40092a0 con 0x7ff7c412c150 2023-10-03T10:09:42.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.388+0000 7ff7b97fa700 1 -- 172.21.15.72:0/3600348164 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc007360 con 0x7ff7c412c150 2023-10-03T10:09:42.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.388+0000 7ff7cb521700 1 -- 172.21.15.72:0/3600348164 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c4119b00 con 0x7ff7c412c150 2023-10-03T10:09:42.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.389+0000 7ff7b97fa700 1 -- 172.21.15.72:0/3600348164 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff7bc007750 con 0x7ff7c412c150 2023-10-03T10:09:42.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.389+0000 7ff7b97fa700 1 -- 172.21.15.72:0/3600348164 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7ff7bc03ab90 con 0x7ff7c412c150 2023-10-03T10:09:42.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.389+0000 7ff7cb521700 1 -- 172.21.15.72:0/3600348164 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c4119330 con 0x7ff7c412c150 2023-10-03T10:09:42.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.393+0000 7ff7b97fa700 1 -- 172.21.15.72:0/3600348164 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff7bc01c3e0 con 0x7ff7c412c150 2023-10-03T10:09:42.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.550+0000 7ff7cb521700 1 -- 172.21.15.72:0/3600348164 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff7c405a260 con 0x7ff7c412c150 2023-10-03T10:09:42.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.550+0000 7ff7b97fa700 1 -- 172.21.15.72:0/3600348164 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v12) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff7bc011360 con 0x7ff7c412c150 2023-10-03T10:09:42.551 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-03T10:09:42.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.552+0000 7ff7cb521700 1 -- 172.21.15.72:0/3600348164 >> v1:172.21.15.72:6816/118184 conn(0x7ff7a802bb60 legacy=0x7ff7a802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.552+0000 7ff7cb521700 1 -- 172.21.15.72:0/3600348164 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7c412c150 msgr2=0x7ff7c4116360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.552+0000 7ff7cb521700 1 --2- 172.21.15.72:0/3600348164 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7c412c150 0x7ff7c4116360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff7bc002230 tx=0x7ff7bc007eb0).stop 2023-10-03T10:09:42.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.552+0000 7ff7cb521700 1 -- 172.21.15.72:0/3600348164 shutdown_connections 2023-10-03T10:09:42.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.552+0000 7ff7cb521700 1 --2- 172.21.15.72:0/3600348164 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7c412c150 0x7ff7c4116360 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.552+0000 7ff7cb521700 1 --2- 172.21.15.72:0/3600348164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7c4093840 0x7ff7c4115980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.552+0000 7ff7cb521700 1 --2- 172.21.15.72:0/3600348164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7c4098c80 0x7ff7c4115e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.552+0000 7ff7cb521700 1 -- 172.21.15.72:0/3600348164 >> 172.21.15.72:0/3600348164 conn(0x7ff7c4097480 msgr2=0x7ff7c4069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.552+0000 7ff7cb521700 1 -- 172.21.15.72:0/3600348164 shutdown_connections 2023-10-03T10:09:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.552+0000 7ff7cb521700 1 -- 172.21.15.72:0/3600348164 wait complete. 2023-10-03T10:09:42.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:09:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.682+0000 7f42718d6700 1 Processor -- start 2023-10-03T10:09:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.682+0000 7f42718d6700 1 -- start start 2023-10-03T10:09:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.682+0000 7f42718d6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f426c0653a0 0x7f426c098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.682+0000 7f42718d6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f426c130440 0x7f426c132830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.682+0000 7f42718d6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426c0663b0 con 0x7f426c098b30 2023-10-03T10:09:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.682+0000 7f42718d6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c065e80 con 0x7f426c130440 2023-10-03T10:09:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.683+0000 7f42718d6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f426c065780 con 0x7f426c0653a0 2023-10-03T10:09:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.683+0000 7f426b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f426c130440 0x7f426c132830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.683+0000 7f426affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f426c0653a0 0x7f426c098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.683+0000 7f426a7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f426c098b30 0x7f426c098f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60270/0 (socket says 172.21.15.72:60270) 2023-10-03T10:09:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.683+0000 7f426a7fc700 1 -- 172.21.15.72:0/3321549012 learned_addr learned my addr 172.21.15.72:0/3321549012 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:42.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.683+0000 7f426affd700 1 -- 172.21.15.72:0/3321549012 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f426c130440 msgr2=0x7f426c132830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.683+0000 7f426affd700 1 --2- 172.21.15.72:0/3321549012 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f426c130440 0x7f426c132830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.683+0000 7f426affd700 1 -- 172.21.15.72:0/3321549012 >> v1:172.21.15.72:6789/0 conn(0x7f426c098b30 legacy=0x7f426c098f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.683+0000 7f4269ffb700 1 -- 172.21.15.72:0/3321549012 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993106505 0 0) 0x7f426c0663b0 con 0x7f426c098b30 2023-10-03T10:09:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.683+0000 7f426affd700 1 -- 172.21.15.72:0/3321549012 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c096180 con 0x7f426c0653a0 2023-10-03T10:09:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.683+0000 7f426b7fe700 1 --2- 172.21.15.72:0/3321549012 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f426c130440 0x7f426c132830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.683+0000 7f426affd700 1 --2- 172.21.15.72:0/3321549012 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f426c0653a0 0x7f426c098640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4260009790 tx=0x7f4260009060).ready entity=mon.2 client_cookie=7cd983d0e555d5b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.683+0000 7f4269ffb700 1 -- 172.21.15.72:0/3321549012 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426000f510 con 0x7f426c0653a0 2023-10-03T10:09:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.683+0000 7f4269ffb700 1 -- 172.21.15.72:0/3321549012 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426000f670 con 0x7f426c0653a0 2023-10-03T10:09:42.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.683+0000 7f4269ffb700 1 -- 172.21.15.72:0/3321549012 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426000f9f0 con 0x7f426c0653a0 2023-10-03T10:09:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.684+0000 7f42718d6700 1 -- 172.21.15.72:0/3321549012 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f426c0653a0 msgr2=0x7f426c098640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.684+0000 7f42718d6700 1 --2- 172.21.15.72:0/3321549012 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f426c0653a0 0x7f426c098640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4260009790 tx=0x7f4260009060).stop 2023-10-03T10:09:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.684+0000 7f42718d6700 1 -- 172.21.15.72:0/3321549012 shutdown_connections 2023-10-03T10:09:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.684+0000 7f42718d6700 1 --2- 172.21.15.72:0/3321549012 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f426c130440 0x7f426c132830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.684+0000 7f42718d6700 1 --2- 172.21.15.72:0/3321549012 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f426c0653a0 0x7f426c098640 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.684+0000 7f42718d6700 1 -- 172.21.15.72:0/3321549012 >> 172.21.15.72:0/3321549012 conn(0x7f426c09dc20 msgr2=0x7f426c09e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.684+0000 7f42718d6700 1 -- 172.21.15.72:0/3321549012 shutdown_connections 2023-10-03T10:09:42.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.684+0000 7f42718d6700 1 -- 172.21.15.72:0/3321549012 wait complete. 2023-10-03T10:09:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.685+0000 7f42718d6700 1 Processor -- start 2023-10-03T10:09:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.685+0000 7f42718d6700 1 -- start start 2023-10-03T10:09:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.685+0000 7f42718d6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f426c0653a0 0x7f426c11a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.685+0000 7f42718d6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f426c098b30 0x7f426c11a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.685+0000 7f42718d6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f426c130440 0x7f426c11ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.685+0000 7f42718d6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c11b170 con 0x7f426c098b30 2023-10-03T10:09:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.685+0000 7f42718d6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c11ea50 con 0x7f426c0653a0 2023-10-03T10:09:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.685+0000 7f42718d6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f426c099a90 con 0x7f426c130440 2023-10-03T10:09:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.685+0000 7f426affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f426c0653a0 0x7f426c11a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.685+0000 7f426affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f426c0653a0 0x7f426c11a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42184/0 (socket says 172.21.15.72:42184) 2023-10-03T10:09:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.685+0000 7f426affd700 1 -- 172.21.15.72:0/3909235812 learned_addr learned my addr 172.21.15.72:0/3909235812 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.685+0000 7f426a7fc700 1 --2- 172.21.15.72:0/3909235812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f426c098b30 0x7f426c11a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.685+0000 7f426b7fe700 1 --2- 172.21.15.72:0/3909235812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f426c130440 0x7f426c11ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.686+0000 7f426affd700 1 -- 172.21.15.72:0/3909235812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f426c130440 msgr2=0x7f426c11ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.686+0000 7f426affd700 1 --2- 172.21.15.72:0/3909235812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f426c130440 0x7f426c11ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.686+0000 7f426affd700 1 -- 172.21.15.72:0/3909235812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f426c098b30 msgr2=0x7f426c11a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.686+0000 7f426affd700 1 --2- 172.21.15.72:0/3909235812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f426c098b30 0x7f426c11a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.686+0000 7f426affd700 1 -- 172.21.15.72:0/3909235812 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4264009a20 con 0x7f426c0653a0 2023-10-03T10:09:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.686+0000 7f426a7fc700 1 --2- 172.21.15.72:0/3909235812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f426c098b30 0x7f426c11a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.686+0000 7f426affd700 1 --2- 172.21.15.72:0/3909235812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f426c0653a0 0x7f426c11a2a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4260011000 tx=0x7f4260017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.686+0000 7f4252ffd700 1 -- 172.21.15.72:0/3909235812 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426000f7e0 con 0x7f426c0653a0 2023-10-03T10:09:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.686+0000 7f4252ffd700 1 -- 172.21.15.72:0/3909235812 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426000f940 con 0x7f426c0653a0 2023-10-03T10:09:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.686+0000 7f42718d6700 1 -- 172.21.15.72:0/3909235812 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42600092a0 con 0x7f426c0653a0 2023-10-03T10:09:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.686+0000 7f4252ffd700 1 -- 172.21.15.72:0/3909235812 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426001b670 con 0x7f426c0653a0 2023-10-03T10:09:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.686+0000 7f42718d6700 1 -- 172.21.15.72:0/3909235812 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426c11e4b0 con 0x7f426c0653a0 2023-10-03T10:09:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.687+0000 7f4252ffd700 1 -- 172.21.15.72:0/3909235812 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f426001ba60 con 0x7f426c0653a0 2023-10-03T10:09:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.687+0000 7f4252ffd700 1 -- 172.21.15.72:0/3909235812 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f426003c330 con 0x7f426c0653a0 2023-10-03T10:09:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.687+0000 7f42718d6700 1 -- 172.21.15.72:0/3909235812 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426c11de20 con 0x7f426c0653a0 2023-10-03T10:09:42.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.691+0000 7f4252ffd700 1 -- 172.21.15.72:0/3909235812 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4260018760 con 0x7f426c0653a0 2023-10-03T10:09:42.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.848+0000 7f42718d6700 1 -- 172.21.15.72:0/3909235812 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f426c05a260 con 0x7f426c0653a0 2023-10-03T10:09:42.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.848+0000 7f4252ffd700 1 -- 172.21.15.72:0/3909235812 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4260023360 con 0x7f426c0653a0 2023-10-03T10:09:42.850 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-10-03T10:09:42.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.850+0000 7f42718d6700 1 -- 172.21.15.72:0/3909235812 >> v1:172.21.15.72:6816/118184 conn(0x7f425802bb60 legacy=0x7f425802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.850+0000 7f42718d6700 1 -- 172.21.15.72:0/3909235812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f426c0653a0 msgr2=0x7f426c11a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.850+0000 7f42718d6700 1 --2- 172.21.15.72:0/3909235812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f426c0653a0 0x7f426c11a2a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4260011000 tx=0x7f4260017000).stop 2023-10-03T10:09:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.850+0000 7f42718d6700 1 -- 172.21.15.72:0/3909235812 shutdown_connections 2023-10-03T10:09:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.850+0000 7f42718d6700 1 --2- 172.21.15.72:0/3909235812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f426c130440 0x7f426c11ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.850+0000 7f42718d6700 1 --2- 172.21.15.72:0/3909235812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f426c0653a0 0x7f426c11a2a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.850+0000 7f42718d6700 1 --2- 172.21.15.72:0/3909235812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f426c098b30 0x7f426c11a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.850+0000 7f42718d6700 1 -- 172.21.15.72:0/3909235812 >> 172.21.15.72:0/3909235812 conn(0x7f426c09dc20 msgr2=0x7f426c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.850+0000 7f42718d6700 1 -- 172.21.15.72:0/3909235812 shutdown_connections 2023-10-03T10:09:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.850+0000 7f42718d6700 1 -- 172.21.15.72:0/3909235812 wait complete. 2023-10-03T10:09:42.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:09:42.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.980+0000 7f15ff12f700 1 Processor -- start 2023-10-03T10:09:42.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.980+0000 7f15ff12f700 1 -- start start 2023-10-03T10:09:42.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.980+0000 7f15ff12f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15f8059070 0x7f15f8127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.980+0000 7f15ff12f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15f8127390 0x7f15f8127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.980+0000 7f15ff12f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15f8095370 0x7f15f80957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.980+0000 7f15ff12f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f8059450 con 0x7f15f8095370 2023-10-03T10:09:42.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.980+0000 7f15ff12f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f80968c0 con 0x7f15f8127390 2023-10-03T10:09:42.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.980+0000 7f15ff12f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8094f30 con 0x7f15f8059070 2023-10-03T10:09:42.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.980+0000 7f15fd6cc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15f8095370 0x7f15f80957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.980+0000 7f15f7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15f8127390 0x7f15f8127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.980+0000 7f15fcecb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15f8059070 0x7f15f8127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.980+0000 7f15fd6cc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15f8095370 0x7f15f80957f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38518/0 (socket says 172.21.15.72:38518) 2023-10-03T10:09:42.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.980+0000 7f15f7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15f8127390 0x7f15f8127d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42190/0 (socket says 172.21.15.72:42190) 2023-10-03T10:09:42.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.980+0000 7f15fd6cc700 1 -- 172.21.15.72:0/1202651092 learned_addr learned my addr 172.21.15.72:0/1202651092 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:42.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15fd6cc700 1 -- 172.21.15.72:0/1202651092 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15f8059070 msgr2=0x7f15f8127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:42.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15fd6cc700 1 --2- 172.21.15.72:0/1202651092 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15f8059070 0x7f15f8127890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15fd6cc700 1 -- 172.21.15.72:0/1202651092 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15f8127390 msgr2=0x7f15f8127d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:42.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15fd6cc700 1 --2- 172.21.15.72:0/1202651092 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15f8127390 0x7f15f8127d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15fd6cc700 1 -- 172.21.15.72:0/1202651092 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f8091b60 con 0x7f15f8095370 2023-10-03T10:09:42.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15fcecb700 1 --2- 172.21.15.72:0/1202651092 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15f8059070 0x7f15f8127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:42.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15f7fff700 1 --2- 172.21.15.72:0/1202651092 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15f8127390 0x7f15f8127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:42.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15fd6cc700 1 --2- 172.21.15.72:0/1202651092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15f8095370 0x7f15f80957f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f15f0009f50 tx=0x7f15f0009840).ready entity=mon.0 client_cookie=278cca1b7a1f2a51 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:42.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15f77fe700 1 -- 172.21.15.72:0/1202651092 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f000e070 con 0x7f15f8095370 2023-10-03T10:09:42.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15f77fe700 1 -- 172.21.15.72:0/1202651092 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f000b910 con 0x7f15f8095370 2023-10-03T10:09:42.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15f77fe700 1 -- 172.21.15.72:0/1202651092 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f000bc90 con 0x7f15f8095370 2023-10-03T10:09:42.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15ff12f700 1 -- 172.21.15.72:0/1202651092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15f8095370 msgr2=0x7f15f80957f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15ff12f700 1 --2- 172.21.15.72:0/1202651092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15f8095370 0x7f15f80957f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f15f0009f50 tx=0x7f15f0009840).stop 2023-10-03T10:09:42.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15ff12f700 1 -- 172.21.15.72:0/1202651092 shutdown_connections 2023-10-03T10:09:42.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15ff12f700 1 --2- 172.21.15.72:0/1202651092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15f8095370 0x7f15f80957f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15ff12f700 1 --2- 172.21.15.72:0/1202651092 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15f8059070 0x7f15f8127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15ff12f700 1 --2- 172.21.15.72:0/1202651092 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15f8127390 0x7f15f8127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15ff12f700 1 -- 172.21.15.72:0/1202651092 >> 172.21.15.72:0/1202651092 conn(0x7f15f8097470 msgr2=0x7f15f8097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:42.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.981+0000 7f15ff12f700 1 -- 172.21.15.72:0/1202651092 shutdown_connections 2023-10-03T10:09:42.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.982+0000 7f15ff12f700 1 -- 172.21.15.72:0/1202651092 wait complete. 2023-10-03T10:09:42.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.982+0000 7f15ff12f700 1 Processor -- start 2023-10-03T10:09:42.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.982+0000 7f15ff12f700 1 -- start start 2023-10-03T10:09:42.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15ff12f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15f8059070 0x7f15f8114d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15ff12f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15f8095370 0x7f15f8115250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15ff12f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15f8127390 0x7f15f8115740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:42.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15ff12f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8096ea0 con 0x7f15f8095370 2023-10-03T10:09:42.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15ff12f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8117bb0 con 0x7f15f8059070 2023-10-03T10:09:42.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15ff12f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15f8114aa0 con 0x7f15f8127390 2023-10-03T10:09:42.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15fcecb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15f8059070 0x7f15f8114d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15f7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15f8095370 0x7f15f8115250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15fd6cc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15f8127390 0x7f15f8115740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:42.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15fcecb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15f8059070 0x7f15f8114d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42202/0 (socket says 172.21.15.72:42202) 2023-10-03T10:09:42.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15f7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15f8095370 0x7f15f8115250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38524/0 (socket says 172.21.15.72:38524) 2023-10-03T10:09:42.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15fcecb700 1 -- 172.21.15.72:0/2369239742 learned_addr learned my addr 172.21.15.72:0/2369239742 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:42.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15f7fff700 1 -- 172.21.15.72:0/2369239742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15f8127390 msgr2=0x7f15f8115740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15f7fff700 1 --2- 172.21.15.72:0/2369239742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15f8127390 0x7f15f8115740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15f7fff700 1 -- 172.21.15.72:0/2369239742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15f8059070 msgr2=0x7f15f8114d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:42.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15f7fff700 1 --2- 172.21.15.72:0/2369239742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15f8059070 0x7f15f8114d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:42.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15f7fff700 1 -- 172.21.15.72:0/2369239742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec0092a0 con 0x7f15f8095370 2023-10-03T10:09:42.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15fcecb700 1 --2- 172.21.15.72:0/2369239742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15f8059070 0x7f15f8114d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:42.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15fd6cc700 1 --2- 172.21.15.72:0/2369239742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15f8127390 0x7f15f8115740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:42.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.983+0000 7f15f7fff700 1 --2- 172.21.15.72:0/2369239742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15f8095370 0x7f15f8115250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f15f8098320 tx=0x7f15e4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:42.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.984+0000 7f15f4ff9700 1 -- 172.21.15.72:0/2369239742 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e4012600 con 0x7f15f8095370 2023-10-03T10:09:42.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.984+0000 7f15f4ff9700 1 -- 172.21.15.72:0/2369239742 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e4012760 con 0x7f15f8095370 2023-10-03T10:09:42.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.984+0000 7f15f4ff9700 1 -- 172.21.15.72:0/2369239742 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e4012b00 con 0x7f15f8095370 2023-10-03T10:09:42.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.984+0000 7f15ff12f700 1 -- 172.21.15.72:0/2369239742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e40092a0 con 0x7f15f8095370 2023-10-03T10:09:42.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.984+0000 7f15ff12f700 1 -- 172.21.15.72:0/2369239742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f0009ae0 con 0x7f15f8095370 2023-10-03T10:09:42.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.984+0000 7f15f4ff9700 1 -- 172.21.15.72:0/2369239742 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f15e401b400 con 0x7f15f8095370 2023-10-03T10:09:42.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.984+0000 7f15f4ff9700 1 -- 172.21.15.72:0/2369239742 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f15e403b080 con 0x7f15f8095370 2023-10-03T10:09:42.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.985+0000 7f15ff12f700 1 -- 172.21.15.72:0/2369239742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f805a260 con 0x7f15f8095370 2023-10-03T10:09:42.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:42.989+0000 7f15f4ff9700 1 -- 172.21.15.72:0/2369239742 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f15e4019900 con 0x7f15f8095370 2023-10-03T10:09:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.185+0000 7f15ff12f700 1 -- 172.21.15.72:0/2369239742 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15f8046c20 con 0x7f15f8095370 2023-10-03T10:09:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.185+0000 7f15f4ff9700 1 -- 172.21.15.72:0/2369239742 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1194 (secure 0 0 0) 0x7f15e4019310 con 0x7f15f8095370 2023-10-03T10:09:43.186 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:43.186 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6817/542674768","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6817","nonce":542674768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-03T10:09:43.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.187+0000 7f15ff12f700 1 -- 172.21.15.72:0/2369239742 >> v1:172.21.15.72:6816/118184 conn(0x7f15dc02bb60 legacy=0x7f15dc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.187+0000 7f15ff12f700 1 -- 172.21.15.72:0/2369239742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15f8095370 msgr2=0x7f15f8115250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.187+0000 7f15ff12f700 1 --2- 172.21.15.72:0/2369239742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15f8095370 0x7f15f8115250 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f15f8098320 tx=0x7f15e4009060).stop 2023-10-03T10:09:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.187+0000 7f15ff12f700 1 -- 172.21.15.72:0/2369239742 shutdown_connections 2023-10-03T10:09:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.187+0000 7f15ff12f700 1 --2- 172.21.15.72:0/2369239742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15f8127390 0x7f15f8115740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.187+0000 7f15ff12f700 1 --2- 172.21.15.72:0/2369239742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15f8059070 0x7f15f8114d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.187+0000 7f15ff12f700 1 --2- 172.21.15.72:0/2369239742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15f8095370 0x7f15f8115250 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.187+0000 7f15ff12f700 1 -- 172.21.15.72:0/2369239742 >> 172.21.15.72:0/2369239742 conn(0x7f15f8097470 msgr2=0x7f15f8099c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.187+0000 7f15ff12f700 1 -- 172.21.15.72:0/2369239742 shutdown_connections 2023-10-03T10:09:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.187+0000 7f15ff12f700 1 -- 172.21.15.72:0/2369239742 wait complete. 2023-10-03T10:09:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 2 2023-10-03T10:09:43.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:43.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.313+0000 7efe41714700 1 Processor -- start 2023-10-03T10:09:43.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.313+0000 7efe41714700 1 -- start start 2023-10-03T10:09:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe41714700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efe3c0927e0 0x7efe3c127390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe41714700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe3c12fc70 0x7efe3c132060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe41714700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c096cb0 con 0x7efe3c059070 2023-10-03T10:09:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe41714700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c059450 con 0x7efe3c0927e0 2023-10-03T10:09:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe41714700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c091b60 con 0x7efe3c12fc70 2023-10-03T10:09:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe3a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efe3c0927e0 0x7efe3c127390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe3b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe3c12fc70 0x7efe3c132060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe3a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efe3c0927e0 0x7efe3c127390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38536/0 (socket says 172.21.15.72:38536) 2023-10-03T10:09:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe3b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe3c12fc70 0x7efe3c132060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42206/0 (socket says 172.21.15.72:42206) 2023-10-03T10:09:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe3a7fc700 1 -- 172.21.15.72:0/2546771754 learned_addr learned my addr 172.21.15.72:0/2546771754 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe3affd700 1 --1- 172.21.15.72:0/2546771754 >> v1:172.21.15.72:6789/0 conn(0x7efe3c059070 0x7efe3c127a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60274/0 (socket says 172.21.15.72:60274) 2023-10-03T10:09:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe3b7fe700 1 -- 172.21.15.72:0/2546771754 >> v2:172.21.15.72:3300/0 conn(0x7efe3c0927e0 msgr2=0x7efe3c127390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe3b7fe700 1 --2- 172.21.15.72:0/2546771754 >> v2:172.21.15.72:3300/0 conn(0x7efe3c0927e0 0x7efe3c127390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe3b7fe700 1 -- 172.21.15.72:0/2546771754 >> v1:172.21.15.72:6789/0 conn(0x7efe3c059070 legacy=0x7efe3c127a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe3b7fe700 1 -- 172.21.15.72:0/2546771754 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c091e20 con 0x7efe3c12fc70 2023-10-03T10:09:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe39ffb700 1 -- 172.21.15.72:0/2546771754 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785384653 0 0) 0x7efe3c096cb0 con 0x7efe3c059070 2023-10-03T10:09:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe3a7fc700 1 --2- 172.21.15.72:0/2546771754 >> v2:172.21.15.72:3300/0 conn(0x7efe3c0927e0 0x7efe3c127390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe3b7fe700 1 --2- 172.21.15.72:0/2546771754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe3c12fc70 0x7efe3c132060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7efe34009e90 tx=0x7efe34009780).ready entity=mon.1 client_cookie=db640be31d044bcb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.314+0000 7efe39ffb700 1 -- 172.21.15.72:0/2546771754 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400e070 con 0x7efe3c12fc70 2023-10-03T10:09:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.315+0000 7efe39ffb700 1 -- 172.21.15.72:0/2546771754 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3400bb20 con 0x7efe3c12fc70 2023-10-03T10:09:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.315+0000 7efe39ffb700 1 -- 172.21.15.72:0/2546771754 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400bea0 con 0x7efe3c12fc70 2023-10-03T10:09:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.315+0000 7efe41714700 1 -- 172.21.15.72:0/2546771754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe3c12fc70 msgr2=0x7efe3c132060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.315+0000 7efe41714700 1 --2- 172.21.15.72:0/2546771754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe3c12fc70 0x7efe3c132060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7efe34009e90 tx=0x7efe34009780).stop 2023-10-03T10:09:43.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.315+0000 7efe41714700 1 -- 172.21.15.72:0/2546771754 shutdown_connections 2023-10-03T10:09:43.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.315+0000 7efe41714700 1 --2- 172.21.15.72:0/2546771754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe3c12fc70 0x7efe3c132060 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.315+0000 7efe41714700 1 --2- 172.21.15.72:0/2546771754 >> v2:172.21.15.72:3300/0 conn(0x7efe3c0927e0 0x7efe3c127390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.315+0000 7efe41714700 1 -- 172.21.15.72:0/2546771754 >> 172.21.15.72:0/2546771754 conn(0x7efe3c097470 msgr2=0x7efe3c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.315+0000 7efe41714700 1 -- 172.21.15.72:0/2546771754 shutdown_connections 2023-10-03T10:09:43.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.315+0000 7efe41714700 1 -- 172.21.15.72:0/2546771754 wait complete. 2023-10-03T10:09:43.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.316+0000 7efe41714700 1 Processor -- start 2023-10-03T10:09:43.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.316+0000 7efe41714700 1 -- start start 2023-10-03T10:09:43.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.316+0000 7efe41714700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efe3c059070 0x7efe3c12d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.316+0000 7efe41714700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe3c0927e0 0x7efe3c12dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.316+0000 7efe41714700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe3c12fc70 0x7efe3c12e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.316+0000 7efe41714700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c126c90 con 0x7efe3c12fc70 2023-10-03T10:09:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.316+0000 7efe41714700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c1126c0 con 0x7efe3c0927e0 2023-10-03T10:09:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.316+0000 7efe41714700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c112080 con 0x7efe3c059070 2023-10-03T10:09:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe3a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe3c0927e0 0x7efe3c12dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe3b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe3c12fc70 0x7efe3c12e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe3a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe3c0927e0 0x7efe3c12dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42216/0 (socket says 172.21.15.72:42216) 2023-10-03T10:09:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe3a7fc700 1 -- 172.21.15.72:0/1012675846 learned_addr learned my addr 172.21.15.72:0/1012675846 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe3affd700 1 --2- 172.21.15.72:0/1012675846 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efe3c059070 0x7efe3c12d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe3a7fc700 1 -- 172.21.15.72:0/1012675846 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efe3c059070 msgr2=0x7efe3c12d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe3a7fc700 1 --2- 172.21.15.72:0/1012675846 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efe3c059070 0x7efe3c12d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe3a7fc700 1 -- 172.21.15.72:0/1012675846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe3c12fc70 msgr2=0x7efe3c12e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe3a7fc700 1 --2- 172.21.15.72:0/1012675846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe3c12fc70 0x7efe3c12e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe3a7fc700 1 -- 172.21.15.72:0/1012675846 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c009370 con 0x7efe3c0927e0 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe3b7fe700 1 --2- 172.21.15.72:0/1012675846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe3c12fc70 0x7efe3c12e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe3a7fc700 1 --2- 172.21.15.72:0/1012675846 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe3c0927e0 0x7efe3c12dd00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7efe2c00ec80 tx=0x7efe2c0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe22ffd700 1 -- 172.21.15.72:0/1012675846 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00c850 con 0x7efe3c0927e0 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe22ffd700 1 -- 172.21.15.72:0/1012675846 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c00c9b0 con 0x7efe3c0927e0 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe22ffd700 1 -- 172.21.15.72:0/1012675846 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00cd30 con 0x7efe3c0927e0 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe41714700 1 -- 172.21.15.72:0/1012675846 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe34009a20 con 0x7efe3c0927e0 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.317+0000 7efe41714700 1 -- 172.21.15.72:0/1012675846 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c12f3a0 con 0x7efe3c0927e0 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.318+0000 7efe22ffd700 1 -- 172.21.15.72:0/1012675846 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7efe2c012600 con 0x7efe3c0927e0 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.318+0000 7efe22ffd700 1 -- 172.21.15.72:0/1012675846 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7efe2c03b250 con 0x7efe3c0927e0 2023-10-03T10:09:43.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.318+0000 7efe41714700 1 -- 172.21.15.72:0/1012675846 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c05a260 con 0x7efe3c0927e0 2023-10-03T10:09:43.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.322+0000 7efe22ffd700 1 -- 172.21.15.72:0/1012675846 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7efe2c016030 con 0x7efe3c0927e0 2023-10-03T10:09:43.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.482+0000 7efe41714700 1 -- 172.21.15.72:0/1012675846 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe3c128270 con 0x7efe3c0927e0 2023-10-03T10:09:43.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.482+0000 7efe22ffd700 1 -- 172.21.15.72:0/1012675846 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8124 (secure 0 0 0) 0x7efe2c0228f0 con 0x7efe3c0927e0 2023-10-03T10:09:43.483 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:43.483 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":13,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:09:42.934084+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.484+0000 7efe41714700 1 -- 172.21.15.72:0/1012675846 >> v1:172.21.15.72:6816/118184 conn(0x7efe2802bb60 legacy=0x7efe2802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.484+0000 7efe41714700 1 -- 172.21.15.72:0/1012675846 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe3c0927e0 msgr2=0x7efe3c12dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.484+0000 7efe41714700 1 --2- 172.21.15.72:0/1012675846 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe3c0927e0 0x7efe3c12dd00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7efe2c00ec80 tx=0x7efe2c0090f0).stop 2023-10-03T10:09:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.484+0000 7efe41714700 1 -- 172.21.15.72:0/1012675846 shutdown_connections 2023-10-03T10:09:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.484+0000 7efe41714700 1 --2- 172.21.15.72:0/1012675846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe3c12fc70 0x7efe3c12e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.484+0000 7efe41714700 1 --2- 172.21.15.72:0/1012675846 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efe3c059070 0x7efe3c12d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.484+0000 7efe41714700 1 --2- 172.21.15.72:0/1012675846 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe3c0927e0 0x7efe3c12dd00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.484+0000 7efe41714700 1 -- 172.21.15.72:0/1012675846 >> 172.21.15.72:0/1012675846 conn(0x7efe3c097470 msgr2=0x7efe3c094650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.484+0000 7efe41714700 1 -- 172.21.15.72:0/1012675846 shutdown_connections 2023-10-03T10:09:43.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.484+0000 7efe41714700 1 -- 172.21.15.72:0/1012675846 wait complete. 2023-10-03T10:09:43.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:38.963446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:40.092839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-03T10:09:43.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:09:43.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.615+0000 7fd1826fd700 1 Processor -- start 2023-10-03T10:09:43.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.615+0000 7fd1826fd700 1 -- start start 2023-10-03T10:09:43.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.615+0000 7fd1826fd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd17c099230 0x7fd17c12dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.615+0000 7fd1826fd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd17c12e0d0 0x7fd17c1304c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.615+0000 7fd1826fd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17c095270 con 0x7fd17c098740 2023-10-03T10:09:43.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.615+0000 7fd1826fd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17c094d20 con 0x7fd17c12e0d0 2023-10-03T10:09:43.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.615+0000 7fd1826fd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c096520 con 0x7fd17c099230 2023-10-03T10:09:43.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.615+0000 7fd180c9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd17c12e0d0 0x7fd17c1304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.615+0000 7fd17b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd17c099230 0x7fd17c12dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.616+0000 7fd180c9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd17c12e0d0 0x7fd17c1304c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38558/0 (socket says 172.21.15.72:38558) 2023-10-03T10:09:43.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.616+0000 7fd17b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd17c099230 0x7fd17c12dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37992/0 (socket says 172.21.15.72:37992) 2023-10-03T10:09:43.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.616+0000 7fd180c9a700 1 -- 172.21.15.72:0/4085316260 learned_addr learned my addr 172.21.15.72:0/4085316260 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:43.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.616+0000 7fd17bfff700 1 --1- 172.21.15.72:0/4085316260 >> v1:172.21.15.72:6789/0 conn(0x7fd17c098740 0x7fd17c098b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60284/0 (socket says 172.21.15.72:60284) 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.616+0000 7fd17b7fe700 1 -- 172.21.15.72:0/4085316260 >> v2:172.21.15.72:3300/0 conn(0x7fd17c12e0d0 msgr2=0x7fd17c1304c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.616+0000 7fd17b7fe700 1 --2- 172.21.15.72:0/4085316260 >> v2:172.21.15.72:3300/0 conn(0x7fd17c12e0d0 0x7fd17c1304c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.616+0000 7fd17b7fe700 1 -- 172.21.15.72:0/4085316260 >> v1:172.21.15.72:6789/0 conn(0x7fd17c098740 legacy=0x7fd17c098b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.616+0000 7fd17b7fe700 1 -- 172.21.15.72:0/4085316260 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c094870 con 0x7fd17c099230 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.616+0000 7fd17affd700 1 -- 172.21.15.72:0/4085316260 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765692617 0 0) 0x7fd17c095270 con 0x7fd17c098740 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.616+0000 7fd180c9a700 1 --2- 172.21.15.72:0/4085316260 >> v2:172.21.15.72:3300/0 conn(0x7fd17c12e0d0 0x7fd17c1304c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.616+0000 7fd17b7fe700 1 --2- 172.21.15.72:0/4085316260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd17c099230 0x7fd17c12dbe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fd16c009760 tx=0x7fd16c009060).ready entity=mon.2 client_cookie=149b0efecd7f2980 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.616+0000 7fd17affd700 1 -- 172.21.15.72:0/4085316260 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c0090d0 con 0x7fd17c099230 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.616+0000 7fd17affd700 1 -- 172.21.15.72:0/4085316260 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16c00f510 con 0x7fd17c099230 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.616+0000 7fd17affd700 1 -- 172.21.15.72:0/4085316260 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16c00f890 con 0x7fd17c099230 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.617+0000 7fd1826fd700 1 -- 172.21.15.72:0/4085316260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd17c099230 msgr2=0x7fd17c12dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.617+0000 7fd1826fd700 1 --2- 172.21.15.72:0/4085316260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd17c099230 0x7fd17c12dbe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fd16c009760 tx=0x7fd16c009060).stop 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.617+0000 7fd1826fd700 1 -- 172.21.15.72:0/4085316260 shutdown_connections 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.617+0000 7fd1826fd700 1 --2- 172.21.15.72:0/4085316260 >> v2:172.21.15.72:3300/0 conn(0x7fd17c12e0d0 0x7fd17c1304c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.617+0000 7fd1826fd700 1 --2- 172.21.15.72:0/4085316260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd17c099230 0x7fd17c12dbe0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.617+0000 7fd1826fd700 1 -- 172.21.15.72:0/4085316260 >> 172.21.15.72:0/4085316260 conn(0x7fd17c09a1c0 msgr2=0x7fd17c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.617+0000 7fd1826fd700 1 -- 172.21.15.72:0/4085316260 shutdown_connections 2023-10-03T10:09:43.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.617+0000 7fd1826fd700 1 -- 172.21.15.72:0/4085316260 wait complete. 2023-10-03T10:09:43.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.617+0000 7fd1826fd700 1 Processor -- start 2023-10-03T10:09:43.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.618+0000 7fd1826fd700 1 -- start start 2023-10-03T10:09:43.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.618+0000 7fd1826fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd17c098740 0x7fd17c13a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.618+0000 7fd1826fd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd17c099230 0x7fd17c13acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.618+0000 7fd1826fd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd17c12e0d0 0x7fd17c091a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.618+0000 7fd1826fd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c094f70 con 0x7fd17c12e0d0 2023-10-03T10:09:43.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.618+0000 7fd1826fd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c12e550 con 0x7fd17c098740 2023-10-03T10:09:43.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.618+0000 7fd1826fd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c11d020 con 0x7fd17c099230 2023-10-03T10:09:43.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.618+0000 7fd17bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd17c098740 0x7fd17c13a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.618+0000 7fd180c9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd17c12e0d0 0x7fd17c091a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.618+0000 7fd17bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd17c098740 0x7fd17c13a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42230/0 (socket says 172.21.15.72:42230) 2023-10-03T10:09:43.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.618+0000 7fd180c9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd17c12e0d0 0x7fd17c091a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38564/0 (socket says 172.21.15.72:38564) 2023-10-03T10:09:43.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.618+0000 7fd17bfff700 1 -- 172.21.15.72:0/1800974861 learned_addr learned my addr 172.21.15.72:0/1800974861 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:43.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.618+0000 7fd17b7fe700 1 --2- 172.21.15.72:0/1800974861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd17c099230 0x7fd17c13acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.618+0000 7fd17bfff700 1 -- 172.21.15.72:0/1800974861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd17c099230 msgr2=0x7fd17c13acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.618+0000 7fd17bfff700 1 --2- 172.21.15.72:0/1800974861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd17c099230 0x7fd17c13acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.619+0000 7fd17bfff700 1 -- 172.21.15.72:0/1800974861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd17c12e0d0 msgr2=0x7fd17c091a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.619+0000 7fd17bfff700 1 --2- 172.21.15.72:0/1800974861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd17c12e0d0 0x7fd17c091a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.619+0000 7fd17bfff700 1 -- 172.21.15.72:0/1800974861 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd174009ae0 con 0x7fd17c098740 2023-10-03T10:09:43.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.619+0000 7fd180c9a700 1 --2- 172.21.15.72:0/1800974861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd17c12e0d0 0x7fd17c091a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.619+0000 7fd17bfff700 1 --2- 172.21.15.72:0/1800974861 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd17c098740 0x7fd17c13a7c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fd17000c4f0 tx=0x7fd170007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.619+0000 7fd163fff700 1 -- 172.21.15.72:0/1800974861 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17000ce20 con 0x7fd17c098740 2023-10-03T10:09:43.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.619+0000 7fd163fff700 1 -- 172.21.15.72:0/1800974861 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1700072e0 con 0x7fd17c098740 2023-10-03T10:09:43.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.619+0000 7fd1826fd700 1 -- 172.21.15.72:0/1800974861 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16c0092a0 con 0x7fd17c098740 2023-10-03T10:09:43.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.619+0000 7fd163fff700 1 -- 172.21.15.72:0/1800974861 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1700056e0 con 0x7fd17c098740 2023-10-03T10:09:43.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.619+0000 7fd1826fd700 1 -- 172.21.15.72:0/1800974861 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17c11dfa0 con 0x7fd17c098740 2023-10-03T10:09:43.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.620+0000 7fd163fff700 1 -- 172.21.15.72:0/1800974861 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd170005a90 con 0x7fd17c098740 2023-10-03T10:09:43.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.620+0000 7fd163fff700 1 -- 172.21.15.72:0/1800974861 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fd17003a300 con 0x7fd17c098740 2023-10-03T10:09:43.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.620+0000 7fd1826fd700 1 -- 172.21.15.72:0/1800974861 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17c05a260 con 0x7fd17c098740 2023-10-03T10:09:43.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.624+0000 7fd163fff700 1 -- 172.21.15.72:0/1800974861 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd17001c350 con 0x7fd17c098740 2023-10-03T10:09:43.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.780+0000 7fd1826fd700 1 -- 172.21.15.72:0/1800974861 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd17c094540 con 0x7fd17c098740 2023-10-03T10:09:43.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.780+0000 7fd163fff700 1 -- 172.21.15.72:0/1800974861 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v13) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd170010ab0 con 0x7fd17c098740 2023-10-03T10:09:43.781 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-03T10:09:43.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.782+0000 7fd1826fd700 1 -- 172.21.15.72:0/1800974861 >> v1:172.21.15.72:6816/118184 conn(0x7fd16802bb90 legacy=0x7fd16802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.782+0000 7fd1826fd700 1 -- 172.21.15.72:0/1800974861 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd17c098740 msgr2=0x7fd17c13a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.782+0000 7fd1826fd700 1 --2- 172.21.15.72:0/1800974861 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd17c098740 0x7fd17c13a7c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fd17000c4f0 tx=0x7fd170007c10).stop 2023-10-03T10:09:43.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.782+0000 7fd1826fd700 1 -- 172.21.15.72:0/1800974861 shutdown_connections 2023-10-03T10:09:43.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.782+0000 7fd1826fd700 1 --2- 172.21.15.72:0/1800974861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd17c12e0d0 0x7fd17c091a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.782+0000 7fd1826fd700 1 --2- 172.21.15.72:0/1800974861 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd17c098740 0x7fd17c13a7c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.782+0000 7fd1826fd700 1 --2- 172.21.15.72:0/1800974861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd17c099230 0x7fd17c13acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.782+0000 7fd1826fd700 1 -- 172.21.15.72:0/1800974861 >> 172.21.15.72:0/1800974861 conn(0x7fd17c09a1c0 msgr2=0x7fd17c065d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.782+0000 7fd1826fd700 1 -- 172.21.15.72:0/1800974861 shutdown_connections 2023-10-03T10:09:43.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.782+0000 7fd1826fd700 1 -- 172.21.15.72:0/1800974861 wait complete. 2023-10-03T10:09:43.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:09:43.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.912+0000 7f37cdecb700 1 Processor -- start 2023-10-03T10:09:43.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.912+0000 7f37cdecb700 1 -- start start 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37cdecb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37c8093840 0x7f37c8098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37cdecb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37c812d160 0x7f37c812f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37cdecb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c8092d80 con 0x7f37c8098c80 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37cdecb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c8093c20 con 0x7f37c812d160 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37cdecb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37c8092b90 con 0x7f37c8093840 2023-10-03T10:09:43.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37c77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37c8093840 0x7f37c8098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37c7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37c812d160 0x7f37c812f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37c7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37c812d160 0x7f37c812f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38572/0 (socket says 172.21.15.72:38572) 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37c77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37c8093840 0x7f37c8098790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38014/0 (socket says 172.21.15.72:38014) 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37c7fff700 1 -- 172.21.15.72:0/687913519 learned_addr learned my addr 172.21.15.72:0/687913519 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37c6ffd700 1 --1- 172.21.15.72:0/687913519 >> v1:172.21.15.72:6789/0 conn(0x7f37c8098c80 0x7f37c8099060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60288/0 (socket says 172.21.15.72:60288) 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37c7fff700 1 -- 172.21.15.72:0/687913519 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37c8093840 msgr2=0x7f37c8098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37c7fff700 1 --2- 172.21.15.72:0/687913519 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37c8093840 0x7f37c8098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37c7fff700 1 -- 172.21.15.72:0/687913519 >> v1:172.21.15.72:6789/0 conn(0x7f37c8098c80 legacy=0x7f37c8099060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37c7fff700 1 -- 172.21.15.72:0/687913519 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c8099b70 con 0x7f37c812d160 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37c67fc700 1 -- 172.21.15.72:0/687913519 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184444716 0 0) 0x7f37c8092d80 con 0x7f37c8098c80 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.913+0000 7f37c77fe700 1 --2- 172.21.15.72:0/687913519 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37c8093840 0x7f37c8098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:43.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.914+0000 7f37c7fff700 1 --2- 172.21.15.72:0/687913519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37c812d160 0x7f37c812f550 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f37c0009f50 tx=0x7f37c0009840).ready entity=mon.0 client_cookie=caff95b1777e7a86 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.914+0000 7f37c67fc700 1 -- 172.21.15.72:0/687913519 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c000e070 con 0x7f37c812d160 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.914+0000 7f37c67fc700 1 -- 172.21.15.72:0/687913519 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c000b9c0 con 0x7f37c812d160 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.914+0000 7f37c67fc700 1 -- 172.21.15.72:0/687913519 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c000bd40 con 0x7f37c812d160 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.914+0000 7f37cdecb700 1 -- 172.21.15.72:0/687913519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37c812d160 msgr2=0x7f37c812f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.914+0000 7f37cdecb700 1 --2- 172.21.15.72:0/687913519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37c812d160 0x7f37c812f550 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f37c0009f50 tx=0x7f37c0009840).stop 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.914+0000 7f37cdecb700 1 -- 172.21.15.72:0/687913519 shutdown_connections 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.914+0000 7f37cdecb700 1 --2- 172.21.15.72:0/687913519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37c812d160 0x7f37c812f550 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.914+0000 7f37cdecb700 1 --2- 172.21.15.72:0/687913519 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37c8093840 0x7f37c8098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.914+0000 7f37cdecb700 1 -- 172.21.15.72:0/687913519 >> 172.21.15.72:0/687913519 conn(0x7f37c8097480 msgr2=0x7f37c8097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.914+0000 7f37cdecb700 1 -- 172.21.15.72:0/687913519 shutdown_connections 2023-10-03T10:09:43.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.914+0000 7f37cdecb700 1 -- 172.21.15.72:0/687913519 wait complete. 2023-10-03T10:09:43.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.915+0000 7f37cdecb700 1 Processor -- start 2023-10-03T10:09:43.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.915+0000 7f37cdecb700 1 -- start start 2023-10-03T10:09:43.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37cdecb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37c8093840 0x7f37c813a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37cdecb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37c8098c80 0x7f37c813ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37cdecb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37c812d160 0x7f37c813b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:43.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37cdecb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c8059ab0 con 0x7f37c8098c80 2023-10-03T10:09:43.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37cdecb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c811e550 con 0x7f37c8093840 2023-10-03T10:09:43.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37cdecb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37c8059ca0 con 0x7f37c812d160 2023-10-03T10:09:43.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37c6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37c8098c80 0x7f37c813ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37c77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37c8093840 0x7f37c813a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37c6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37c8098c80 0x7f37c813ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38584/0 (socket says 172.21.15.72:38584) 2023-10-03T10:09:43.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37c77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37c8093840 0x7f37c813a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42232/0 (socket says 172.21.15.72:42232) 2023-10-03T10:09:43.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37c6ffd700 1 -- 172.21.15.72:0/737542357 learned_addr learned my addr 172.21.15.72:0/737542357 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:43.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37c7fff700 1 --2- 172.21.15.72:0/737542357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37c812d160 0x7f37c813b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:43.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37c6ffd700 1 -- 172.21.15.72:0/737542357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37c812d160 msgr2=0x7f37c813b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37c6ffd700 1 --2- 172.21.15.72:0/737542357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37c812d160 0x7f37c813b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37c6ffd700 1 -- 172.21.15.72:0/737542357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37c8093840 msgr2=0x7f37c813a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:43.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37c6ffd700 1 --2- 172.21.15.72:0/737542357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37c8093840 0x7f37c813a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:43.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37c6ffd700 1 -- 172.21.15.72:0/737542357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc0092a0 con 0x7f37c8098c80 2023-10-03T10:09:43.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37c6ffd700 1 --2- 172.21.15.72:0/737542357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37c8098c80 0x7f37c813ab70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f37b800c4c0 tx=0x7f37b8007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:43.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37af7fe700 1 -- 172.21.15.72:0/737542357 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b800ce30 con 0x7f37c8098c80 2023-10-03T10:09:43.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37af7fe700 1 -- 172.21.15.72:0/737542357 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b80072e0 con 0x7f37c8098c80 2023-10-03T10:09:43.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37cdecb700 1 -- 172.21.15.72:0/737542357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c0009ae0 con 0x7f37c8098c80 2023-10-03T10:09:43.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37af7fe700 1 -- 172.21.15.72:0/737542357 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b80056e0 con 0x7f37c8098c80 2023-10-03T10:09:43.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.916+0000 7f37cdecb700 1 -- 172.21.15.72:0/737542357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c806a520 con 0x7f37c8098c80 2023-10-03T10:09:43.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.917+0000 7f37af7fe700 1 -- 172.21.15.72:0/737542357 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f37b8005a90 con 0x7f37c8098c80 2023-10-03T10:09:43.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.917+0000 7f37af7fe700 1 -- 172.21.15.72:0/737542357 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f37b803a370 con 0x7f37c8098c80 2023-10-03T10:09:43.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.917+0000 7f37cdecb700 1 -- 172.21.15.72:0/737542357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c8097bb0 con 0x7f37c8098c80 2023-10-03T10:09:43.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:43.922+0000 7f37af7fe700 1 -- 172.21.15.72:0/737542357 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f37b8018030 con 0x7f37c8098c80 2023-10-03T10:09:44.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.083+0000 7f37cdecb700 1 -- 172.21.15.72:0/737542357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f37c805a260 con 0x7f37c8098c80 2023-10-03T10:09:44.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.083+0000 7f37af7fe700 1 -- 172.21.15.72:0/737542357 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v13) v1 ==== 92+0+10 (secure 0 0 0) 0x7f37b8013970 con 0x7f37c8098c80 2023-10-03T10:09:44.084 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-10-03T10:09:44.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.085+0000 7f37cdecb700 1 -- 172.21.15.72:0/737542357 >> v1:172.21.15.72:6816/118184 conn(0x7f37b402bb60 legacy=0x7f37b402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.085+0000 7f37cdecb700 1 -- 172.21.15.72:0/737542357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37c8098c80 msgr2=0x7f37c813ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.085+0000 7f37cdecb700 1 --2- 172.21.15.72:0/737542357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37c8098c80 0x7f37c813ab70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f37b800c4c0 tx=0x7f37b8007c10).stop 2023-10-03T10:09:44.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.085+0000 7f37cdecb700 1 -- 172.21.15.72:0/737542357 shutdown_connections 2023-10-03T10:09:44.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.085+0000 7f37cdecb700 1 --2- 172.21.15.72:0/737542357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37c812d160 0x7f37c813b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.085+0000 7f37cdecb700 1 --2- 172.21.15.72:0/737542357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37c8093840 0x7f37c813a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.085+0000 7f37cdecb700 1 --2- 172.21.15.72:0/737542357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37c8098c80 0x7f37c813ab70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.085+0000 7f37cdecb700 1 -- 172.21.15.72:0/737542357 >> 172.21.15.72:0/737542357 conn(0x7f37c8097480 msgr2=0x7f37c8096280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:44.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.085+0000 7f37cdecb700 1 -- 172.21.15.72:0/737542357 shutdown_connections 2023-10-03T10:09:44.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.085+0000 7f37cdecb700 1 -- 172.21.15.72:0/737542357 wait complete. 2023-10-03T10:09:44.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-03T10:09:44.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.212+0000 7f01f7a88700 1 Processor -- start 2023-10-03T10:09:44.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.212+0000 7f01f7a88700 1 -- start start 2023-10-03T10:09:44.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.212+0000 7f01f7a88700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01f0059070 0x7f01f0127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.212+0000 7f01f7a88700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01f0127d80 0x7f01f0095a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.212+0000 7f01f7a88700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f0091b60 con 0x7f01f0127390 2023-10-03T10:09:44.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.212+0000 7f01f7a88700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f0096940 con 0x7f01f0127d80 2023-10-03T10:09:44.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.212+0000 7f01f7a88700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01f0059c00 con 0x7f01f0059070 2023-10-03T10:09:44.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.213+0000 7f01f5824700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01f0059070 0x7f01f0127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.213+0000 7f01f6025700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01f0127d80 0x7f01f0095a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.213+0000 7f01f5824700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01f0059070 0x7f01f0127890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38034/0 (socket says 172.21.15.72:38034) 2023-10-03T10:09:44.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.213+0000 7f01f5824700 1 -- 172.21.15.72:0/852474802 learned_addr learned my addr 172.21.15.72:0/852474802 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:44.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.213+0000 7f01f5824700 1 -- 172.21.15.72:0/852474802 >> v2:172.21.15.72:3300/0 conn(0x7f01f0127d80 msgr2=0x7f01f0095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:44.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.213+0000 7f01f5824700 1 --2- 172.21.15.72:0/852474802 >> v2:172.21.15.72:3300/0 conn(0x7f01f0127d80 0x7f01f0095a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.213+0000 7f01f5824700 1 -- 172.21.15.72:0/852474802 >> v1:172.21.15.72:6789/0 conn(0x7f01f0127390 legacy=0x7f01f0095370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.213+0000 7f01f5824700 1 -- 172.21.15.72:0/852474802 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f00929d0 con 0x7f01f0059070 2023-10-03T10:09:44.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.213+0000 7f01f6025700 1 --2- 172.21.15.72:0/852474802 >> v2:172.21.15.72:3300/0 conn(0x7f01f0127d80 0x7f01f0095a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:44.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.213+0000 7f01f5824700 1 --2- 172.21.15.72:0/852474802 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01f0059070 0x7f01f0127890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f01ec009830 tx=0x7f01ec0090f0).ready entity=mon.2 client_cookie=4dfb695cb19820d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:44.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.213+0000 7f01f4822700 1 -- 172.21.15.72:0/852474802 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec00b580 con 0x7f01f0059070 2023-10-03T10:09:44.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.213+0000 7f01f4822700 1 -- 172.21.15.72:0/852474802 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec00b6e0 con 0x7f01f0059070 2023-10-03T10:09:44.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.213+0000 7f01f4822700 1 -- 172.21.15.72:0/852474802 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec00ba80 con 0x7f01f0059070 2023-10-03T10:09:44.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.214+0000 7f01f7a88700 1 -- 172.21.15.72:0/852474802 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01f0059070 msgr2=0x7f01f0127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.214+0000 7f01f7a88700 1 --2- 172.21.15.72:0/852474802 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01f0059070 0x7f01f0127890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f01ec009830 tx=0x7f01ec0090f0).stop 2023-10-03T10:09:44.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.214+0000 7f01f7a88700 1 -- 172.21.15.72:0/852474802 shutdown_connections 2023-10-03T10:09:44.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.214+0000 7f01f7a88700 1 --2- 172.21.15.72:0/852474802 >> v2:172.21.15.72:3300/0 conn(0x7f01f0127d80 0x7f01f0095a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.214+0000 7f01f7a88700 1 --2- 172.21.15.72:0/852474802 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01f0059070 0x7f01f0127890 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.214+0000 7f01f7a88700 1 -- 172.21.15.72:0/852474802 >> 172.21.15.72:0/852474802 conn(0x7f01f0097470 msgr2=0x7f01f0097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:44.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.214+0000 7f01f7a88700 1 -- 172.21.15.72:0/852474802 shutdown_connections 2023-10-03T10:09:44.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.214+0000 7f01f7a88700 1 -- 172.21.15.72:0/852474802 wait complete. 2023-10-03T10:09:44.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f7a88700 1 Processor -- start 2023-10-03T10:09:44.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f7a88700 1 -- start start 2023-10-03T10:09:44.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f7a88700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f0059070 0x7f01f0117ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f7a88700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01f0127390 0x7f01f0113d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f7a88700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f0127d80 0x7f01f0114230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f7a88700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f01151e0 con 0x7f01f0127d80 2023-10-03T10:09:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f7a88700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f0124e10 con 0x7f01f0059070 2023-10-03T10:09:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f7a88700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01f0096f50 con 0x7f01f0127390 2023-10-03T10:09:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f5824700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f0059070 0x7f01f0117ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f6025700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f0127d80 0x7f01f0114230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f5023700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01f0127390 0x7f01f0113d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f5824700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f0059070 0x7f01f0117ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42242/0 (socket says 172.21.15.72:42242) 2023-10-03T10:09:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f5824700 1 -- 172.21.15.72:0/2446241360 learned_addr learned my addr 172.21.15.72:0/2446241360 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f5023700 1 -- 172.21.15.72:0/2446241360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f0059070 msgr2=0x7f01f0117ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f5023700 1 --2- 172.21.15.72:0/2446241360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f0059070 0x7f01f0117ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f5023700 1 -- 172.21.15.72:0/2446241360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f0127d80 msgr2=0x7f01f0114230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f5023700 1 --2- 172.21.15.72:0/2446241360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f0127d80 0x7f01f0114230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f5023700 1 -- 172.21.15.72:0/2446241360 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e8009a20 con 0x7f01f0127390 2023-10-03T10:09:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f5824700 1 --2- 172.21.15.72:0/2446241360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f0059070 0x7f01f0117ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.215+0000 7f01f6025700 1 --2- 172.21.15.72:0/2446241360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f0127d80 0x7f01f0114230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.216+0000 7f01f5023700 1 --2- 172.21.15.72:0/2446241360 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01f0127390 0x7f01f0113d40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f01e000c440 tx=0x7f01e0007d40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.216+0000 7f01e5ffb700 1 -- 172.21.15.72:0/2446241360 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e000ce00 con 0x7f01f0127390 2023-10-03T10:09:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.216+0000 7f01e5ffb700 1 -- 172.21.15.72:0/2446241360 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e0007020 con 0x7f01f0127390 2023-10-03T10:09:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.216+0000 7f01f7a88700 1 -- 172.21.15.72:0/2446241360 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec009370 con 0x7f01f0127390 2023-10-03T10:09:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.216+0000 7f01e5ffb700 1 -- 172.21.15.72:0/2446241360 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e00073c0 con 0x7f01f0127390 2023-10-03T10:09:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.216+0000 7f01f7a88700 1 -- 172.21.15.72:0/2446241360 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f0116130 con 0x7f01f0127390 2023-10-03T10:09:44.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.217+0000 7f01e5ffb700 1 -- 172.21.15.72:0/2446241360 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f01e00068b0 con 0x7f01f0127390 2023-10-03T10:09:44.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.217+0000 7f01e5ffb700 1 -- 172.21.15.72:0/2446241360 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f01e003a690 con 0x7f01f0127390 2023-10-03T10:09:44.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.217+0000 7f01f7a88700 1 -- 172.21.15.72:0/2446241360 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f0099f00 con 0x7f01f0127390 2023-10-03T10:09:44.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.221+0000 7f01e5ffb700 1 -- 172.21.15.72:0/2446241360 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f01e0007520 con 0x7f01f0127390 2023-10-03T10:09:44.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.380+0000 7f01f7a88700 1 -- 172.21.15.72:0/2446241360 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f01f005a260 con 0x7f01f0127390 2023-10-03T10:09:44.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.380+0000 7f01e5ffb700 1 -- 172.21.15.72:0/2446241360 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v13) v1 ==== 84+0+143 (secure 0 0 0) 0x7f01e001ab30 con 0x7f01f0127390 2023-10-03T10:09:44.381 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:44.381 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-10-03T10:09:44.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:09:44.381 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-10-03T10:09:44.381 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "device_health_metrics" 2023-10-03T10:09:44.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:09:44.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:09:44.382 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-10-03T10:09:44.382 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-10-03T10:09:44.382 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:09:44.382 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-10-03T10:09:44.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.382+0000 7f01f7a88700 1 -- 172.21.15.72:0/2446241360 >> v1:172.21.15.72:6816/118184 conn(0x7f01d402bb60 legacy=0x7f01d402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.382+0000 7f01f7a88700 1 -- 172.21.15.72:0/2446241360 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01f0127390 msgr2=0x7f01f0113d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.382+0000 7f01f7a88700 1 --2- 172.21.15.72:0/2446241360 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01f0127390 0x7f01f0113d40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f01e000c440 tx=0x7f01e0007d40).stop 2023-10-03T10:09:44.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.382+0000 7f01f7a88700 1 -- 172.21.15.72:0/2446241360 shutdown_connections 2023-10-03T10:09:44.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.382+0000 7f01f7a88700 1 --2- 172.21.15.72:0/2446241360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f0127d80 0x7f01f0114230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.382+0000 7f01f7a88700 1 --2- 172.21.15.72:0/2446241360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f0059070 0x7f01f0117ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.382+0000 7f01f7a88700 1 --2- 172.21.15.72:0/2446241360 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01f0127390 0x7f01f0113d40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.382+0000 7f01f7a88700 1 -- 172.21.15.72:0/2446241360 >> 172.21.15.72:0/2446241360 conn(0x7f01f0097470 msgr2=0x7f01f0094500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:44.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.382+0000 7f01f7a88700 1 -- 172.21.15.72:0/2446241360 shutdown_connections 2023-10-03T10:09:44.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.382+0000 7f01f7a88700 1 -- 172.21.15.72:0/2446241360 wait complete. 2023-10-03T10:09:44.394 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-03T10:09:44.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-03T10:09:44.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.513+0000 7fc759f9a700 1 Processor -- start 2023-10-03T10:09:44.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.513+0000 7fc759f9a700 1 -- start start 2023-10-03T10:09:44.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.513+0000 7fc759f9a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc754059070 0x7fc7541277f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.513+0000 7fc759f9a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7541280e0 0x7fc75412b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.513+0000 7fc759f9a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc754092b60 con 0x7fc754127ce0 2023-10-03T10:09:44.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.513+0000 7fc759f9a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc754059450 con 0x7fc7541280e0 2023-10-03T10:09:44.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.513+0000 7fc759f9a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc754091c10 con 0x7fc754059070 2023-10-03T10:09:44.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.513+0000 7fc7537fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc754059070 0x7fc7541277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.513+0000 7fc753fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7541280e0 0x7fc75412b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.513+0000 7fc752ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc754127ce0 0x7fc75412a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60298/0 (socket says 172.21.15.72:60298) 2023-10-03T10:09:44.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.513+0000 7fc752ffd700 1 -- 172.21.15.72:0/1423106020 learned_addr learned my addr 172.21.15.72:0/1423106020 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:44.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc753fff700 1 -- 172.21.15.72:0/1423106020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc754059070 msgr2=0x7fc7541277f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:44.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc753fff700 1 --2- 172.21.15.72:0/1423106020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc754059070 0x7fc7541277f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc753fff700 1 -- 172.21.15.72:0/1423106020 >> v1:172.21.15.72:6789/0 conn(0x7fc754127ce0 legacy=0x7fc75412a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc753fff700 1 -- 172.21.15.72:0/1423106020 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc754096810 con 0x7fc7541280e0 2023-10-03T10:09:44.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc7527fc700 1 -- 172.21.15.72:0/1423106020 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979388150 0 0) 0x7fc754092b60 con 0x7fc754127ce0 2023-10-03T10:09:44.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc7537fe700 1 --2- 172.21.15.72:0/1423106020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc754059070 0x7fc7541277f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:44.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc753fff700 1 --2- 172.21.15.72:0/1423106020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7541280e0 0x7fc75412b0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc74c009e90 tx=0x7fc74c009780).ready entity=mon.1 client_cookie=f3ca09fbdb86a30c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:44.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc7527fc700 1 -- 172.21.15.72:0/1423106020 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00e070 con 0x7fc7541280e0 2023-10-03T10:09:44.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc7527fc700 1 -- 172.21.15.72:0/1423106020 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c00bb60 con 0x7fc7541280e0 2023-10-03T10:09:44.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc7527fc700 1 -- 172.21.15.72:0/1423106020 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c012410 con 0x7fc7541280e0 2023-10-03T10:09:44.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc759f9a700 1 -- 172.21.15.72:0/1423106020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7541280e0 msgr2=0x7fc75412b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc759f9a700 1 --2- 172.21.15.72:0/1423106020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7541280e0 0x7fc75412b0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc74c009e90 tx=0x7fc74c009780).stop 2023-10-03T10:09:44.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc759f9a700 1 -- 172.21.15.72:0/1423106020 shutdown_connections 2023-10-03T10:09:44.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc759f9a700 1 --2- 172.21.15.72:0/1423106020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7541280e0 0x7fc75412b0b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc759f9a700 1 --2- 172.21.15.72:0/1423106020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc754059070 0x7fc7541277f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.514+0000 7fc759f9a700 1 -- 172.21.15.72:0/1423106020 >> 172.21.15.72:0/1423106020 conn(0x7fc754097560 msgr2=0x7fc754097970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:44.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.515+0000 7fc759f9a700 1 -- 172.21.15.72:0/1423106020 shutdown_connections 2023-10-03T10:09:44.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.515+0000 7fc759f9a700 1 -- 172.21.15.72:0/1423106020 wait complete. 2023-10-03T10:09:44.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.515+0000 7fc759f9a700 1 Processor -- start 2023-10-03T10:09:44.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc759f9a700 1 -- start start 2023-10-03T10:09:44.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc759f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc754059070 0x7fc754124be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc759f9a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc754127ce0 0x7fc754113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc759f9a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7541280e0 0x7fc7541140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:44.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc759f9a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7541170b0 con 0x7fc754059070 2023-10-03T10:09:44.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc759f9a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75405f900 con 0x7fc7541280e0 2023-10-03T10:09:44.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc759f9a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc754096ef0 con 0x7fc754127ce0 2023-10-03T10:09:44.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc752ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc754127ce0 0x7fc754113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc752ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc754127ce0 0x7fc754113bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38048/0 (socket says 172.21.15.72:38048) 2023-10-03T10:09:44.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc752ffd700 1 -- 172.21.15.72:0/2633157413 learned_addr learned my addr 172.21.15.72:0/2633157413 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:44.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc7537fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc754059070 0x7fc754124be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc753fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7541280e0 0x7fc7541140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:44.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc752ffd700 1 -- 172.21.15.72:0/2633157413 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7541280e0 msgr2=0x7fc7541140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc752ffd700 1 --2- 172.21.15.72:0/2633157413 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7541280e0 0x7fc7541140a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc752ffd700 1 -- 172.21.15.72:0/2633157413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc754059070 msgr2=0x7fc754124be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc752ffd700 1 --2- 172.21.15.72:0/2633157413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc754059070 0x7fc754124be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc752ffd700 1 -- 172.21.15.72:0/2633157413 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7440092a0 con 0x7fc754127ce0 2023-10-03T10:09:44.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc753fff700 1 --2- 172.21.15.72:0/2633157413 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7541280e0 0x7fc7541140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:44.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc7537fe700 1 --2- 172.21.15.72:0/2633157413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc754059070 0x7fc754124be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:44.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.516+0000 7fc752ffd700 1 --2- 172.21.15.72:0/2633157413 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc754127ce0 0x7fc754113bb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc748001eb0 tx=0x7fc748007bf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:44.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.517+0000 7fc73b7fe700 1 -- 172.21.15.72:0/2633157413 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74800ce00 con 0x7fc754127ce0 2023-10-03T10:09:44.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.517+0000 7fc73b7fe700 1 -- 172.21.15.72:0/2633157413 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7480072e0 con 0x7fc754127ce0 2023-10-03T10:09:44.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.517+0000 7fc73b7fe700 1 -- 172.21.15.72:0/2633157413 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7480057a0 con 0x7fc754127ce0 2023-10-03T10:09:44.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.517+0000 7fc759f9a700 1 -- 172.21.15.72:0/2633157413 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74c009a20 con 0x7fc754127ce0 2023-10-03T10:09:44.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.517+0000 7fc759f9a700 1 -- 172.21.15.72:0/2633157413 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc754115740 con 0x7fc754127ce0 2023-10-03T10:09:44.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.517+0000 7fc73b7fe700 1 -- 172.21.15.72:0/2633157413 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc748005b90 con 0x7fc754127ce0 2023-10-03T10:09:44.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.518+0000 7fc73b7fe700 1 -- 172.21.15.72:0/2633157413 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fc74803a2f0 con 0x7fc754127ce0 2023-10-03T10:09:44.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.518+0000 7fc759f9a700 1 -- 172.21.15.72:0/2633157413 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc754117ac0 con 0x7fc754127ce0 2023-10-03T10:09:44.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.522+0000 7fc73b7fe700 1 -- 172.21.15.72:0/2633157413 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc748005e40 con 0x7fc754127ce0 2023-10-03T10:09:44.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.681+0000 7fc759f9a700 1 -- 172.21.15.72:0/2633157413 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc754115900 con 0x7fc754127ce0 2023-10-03T10:09:44.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.972+0000 7fc73b7fe700 1 -- 172.21.15.72:0/2633157413 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v14) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc748010af0 con 0x7fc754127ce0 2023-10-03T10:09:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.975+0000 7fc759f9a700 1 -- 172.21.15.72:0/2633157413 >> v1:172.21.15.72:6816/118184 conn(0x7fc74002bb60 legacy=0x7fc74002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.975+0000 7fc759f9a700 1 -- 172.21.15.72:0/2633157413 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc754127ce0 msgr2=0x7fc754113bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.975+0000 7fc759f9a700 1 --2- 172.21.15.72:0/2633157413 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc754127ce0 0x7fc754113bb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc748001eb0 tx=0x7fc748007bf0).stop 2023-10-03T10:09:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.975+0000 7fc759f9a700 1 -- 172.21.15.72:0/2633157413 shutdown_connections 2023-10-03T10:09:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.975+0000 7fc759f9a700 1 --2- 172.21.15.72:0/2633157413 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc754059070 0x7fc754124be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.975+0000 7fc759f9a700 1 --2- 172.21.15.72:0/2633157413 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7541280e0 0x7fc7541140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.975+0000 7fc759f9a700 1 --2- 172.21.15.72:0/2633157413 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc754127ce0 0x7fc754113bb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.975+0000 7fc759f9a700 1 -- 172.21.15.72:0/2633157413 >> 172.21.15.72:0/2633157413 conn(0x7fc754097560 msgr2=0x7fc754093d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.975+0000 7fc759f9a700 1 -- 172.21.15.72:0/2633157413 shutdown_connections 2023-10-03T10:09:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:44.976+0000 7fc759f9a700 1 -- 172.21.15.72:0/2633157413 wait complete. 2023-10-03T10:09:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-10-03T10:09:44.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-03T10:09:45.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.112+0000 7f5dc3f62700 1 Processor -- start 2023-10-03T10:09:45.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.112+0000 7f5dc3f62700 1 -- start start 2023-10-03T10:09:45.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc3f62700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dbc096830 0x7f5dbc096c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc3f62700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc097100 0x7f5dbc066d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc3f62700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dbc068370 con 0x7f5dbc067270 2023-10-03T10:09:45.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc3f62700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc0695a0 con 0x7f5dbc097100 2023-10-03T10:09:45.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc3f62700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc0943e0 con 0x7f5dbc096830 2023-10-03T10:09:45.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc1cfe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dbc096830 0x7f5dbc096c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc24ff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5dbc067270 0x7f5dbc12fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60302/0 (socket says 172.21.15.72:60302) 2023-10-03T10:09:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc1cfe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dbc096830 0x7f5dbc096c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38064/0 (socket says 172.21.15.72:38064) 2023-10-03T10:09:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc14fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc097100 0x7f5dbc066d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc24ff700 1 -- 172.21.15.72:0/3743301221 learned_addr learned my addr 172.21.15.72:0/3743301221 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc0cfc700 1 -- 172.21.15.72:0/3743301221 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279949682 0 0) 0x7f5dbc068370 con 0x7f5dbc067270 2023-10-03T10:09:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc0cfc700 1 -- 172.21.15.72:0/3743301221 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5da80033f0 con 0x7f5dbc067270 2023-10-03T10:09:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc14fd700 1 -- 172.21.15.72:0/3743301221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dbc096830 msgr2=0x7f5dbc096c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc14fd700 1 --2- 172.21.15.72:0/3743301221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dbc096830 0x7f5dbc096c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc14fd700 1 -- 172.21.15.72:0/3743301221 >> v1:172.21.15.72:6789/0 conn(0x7f5dbc067270 legacy=0x7f5dbc12fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc14fd700 1 -- 172.21.15.72:0/3743301221 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc069860 con 0x7f5dbc097100 2023-10-03T10:09:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc1cfe700 1 --2- 172.21.15.72:0/3743301221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dbc096830 0x7f5dbc096c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.113+0000 7f5dc14fd700 1 --2- 172.21.15.72:0/3743301221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc097100 0x7f5dbc066d80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5db8009790 tx=0x7f5db8009060).ready entity=mon.1 client_cookie=5c448a7fbeb0ee3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.114+0000 7f5dc0cfc700 1 -- 172.21.15.72:0/3743301221 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800f510 con 0x7f5dbc097100 2023-10-03T10:09:45.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.114+0000 7f5dc0cfc700 1 -- 172.21.15.72:0/3743301221 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db800f670 con 0x7f5dbc097100 2023-10-03T10:09:45.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.114+0000 7f5dc0cfc700 1 -- 172.21.15.72:0/3743301221 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800f9f0 con 0x7f5dbc097100 2023-10-03T10:09:45.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.114+0000 7f5dc3f62700 1 -- 172.21.15.72:0/3743301221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc097100 msgr2=0x7f5dbc066d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.114+0000 7f5dc3f62700 1 --2- 172.21.15.72:0/3743301221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc097100 0x7f5dbc066d80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5db8009790 tx=0x7f5db8009060).stop 2023-10-03T10:09:45.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.114+0000 7f5dc3f62700 1 -- 172.21.15.72:0/3743301221 shutdown_connections 2023-10-03T10:09:45.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.114+0000 7f5dc3f62700 1 --2- 172.21.15.72:0/3743301221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dbc096830 0x7f5dbc096c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.114+0000 7f5dc3f62700 1 --2- 172.21.15.72:0/3743301221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc097100 0x7f5dbc066d80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.114+0000 7f5dc3f62700 1 -- 172.21.15.72:0/3743301221 >> 172.21.15.72:0/3743301221 conn(0x7f5dbc09a3d0 msgr2=0x7f5dbc09a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:45.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.114+0000 7f5dc3f62700 1 -- 172.21.15.72:0/3743301221 shutdown_connections 2023-10-03T10:09:45.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.114+0000 7f5dc3f62700 1 -- 172.21.15.72:0/3743301221 wait complete. 2023-10-03T10:09:45.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.115+0000 7f5dc3f62700 1 Processor -- start 2023-10-03T10:09:45.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.115+0000 7f5dc3f62700 1 -- start start 2023-10-03T10:09:45.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.115+0000 7f5dc3f62700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dbc067270 0x7f5dbc1383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.115+0000 7f5dc3f62700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc096830 0x7f5dbc1388a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.115+0000 7f5dc3f62700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc097100 0x7f5dbc138d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:45.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.115+0000 7f5dc3f62700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc1189e0 con 0x7f5dbc097100 2023-10-03T10:09:45.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.115+0000 7f5dc3f62700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc11a680 con 0x7f5dbc096830 2023-10-03T10:09:45.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.115+0000 7f5dc3f62700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc11a3c0 con 0x7f5dbc067270 2023-10-03T10:09:45.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5dc1cfe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dbc067270 0x7f5dbc1383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5dc24ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc097100 0x7f5dbc138d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5dc1cfe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dbc067270 0x7f5dbc1383b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38078/0 (socket says 172.21.15.72:38078) 2023-10-03T10:09:45.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5dc1cfe700 1 -- 172.21.15.72:0/3864765201 learned_addr learned my addr 172.21.15.72:0/3864765201 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:45.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5dc14fd700 1 --2- 172.21.15.72:0/3864765201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc096830 0x7f5dbc1388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:45.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5dc1cfe700 1 -- 172.21.15.72:0/3864765201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc096830 msgr2=0x7f5dbc1388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5dc1cfe700 1 --2- 172.21.15.72:0/3864765201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc096830 0x7f5dbc1388a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5dc1cfe700 1 -- 172.21.15.72:0/3864765201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc097100 msgr2=0x7f5dbc138d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5dc1cfe700 1 --2- 172.21.15.72:0/3864765201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc097100 0x7f5dbc138d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5dc1cfe700 1 -- 172.21.15.72:0/3864765201 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac0092a0 con 0x7f5dbc067270 2023-10-03T10:09:45.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5dc24ff700 1 --2- 172.21.15.72:0/3864765201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc097100 0x7f5dbc138d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:45.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5dc1cfe700 1 --2- 172.21.15.72:0/3864765201 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dbc067270 0x7f5dbc1383b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f5dac00ea50 tx=0x7f5dac009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:45.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5db1ffb700 1 -- 172.21.15.72:0/3864765201 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac00ee90 con 0x7f5dbc067270 2023-10-03T10:09:45.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5db1ffb700 1 -- 172.21.15.72:0/3864765201 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dac00c850 con 0x7f5dbc067270 2023-10-03T10:09:45.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5dc3f62700 1 -- 172.21.15.72:0/3864765201 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db80092a0 con 0x7f5dbc067270 2023-10-03T10:09:45.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5db1ffb700 1 -- 172.21.15.72:0/3864765201 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac00cbd0 con 0x7f5dbc067270 2023-10-03T10:09:45.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.116+0000 7f5dc3f62700 1 -- 172.21.15.72:0/3864765201 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dbc1191d0 con 0x7f5dbc067270 2023-10-03T10:09:45.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.117+0000 7f5db1ffb700 1 -- 172.21.15.72:0/3864765201 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5dac01b400 con 0x7f5dbc067270 2023-10-03T10:09:45.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.117+0000 7f5db1ffb700 1 -- 172.21.15.72:0/3864765201 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3208+0+0 (secure 0 0 0) 0x7f5dac03b360 con 0x7f5dbc067270 2023-10-03T10:09:45.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.117+0000 7f5dc3f62700 1 -- 172.21.15.72:0/3864765201 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dbc0691c0 con 0x7f5dbc067270 2023-10-03T10:09:45.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.122+0000 7f5db1ffb700 1 -- 172.21.15.72:0/3864765201 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5dac01be60 con 0x7f5dbc067270 2023-10-03T10:09:45.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.281+0000 7f5dc3f62700 1 -- 172.21.15.72:0/3864765201 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5dbc05a260 con 0x7f5dbc067270 2023-10-03T10:09:45.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.977+0000 7f5db1ffb700 1 -- 172.21.15.72:0/3864765201 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v15) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5dac01be60 con 0x7f5dbc067270 2023-10-03T10:09:45.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.991+0000 7f5dc3f62700 1 -- 172.21.15.72:0/3864765201 >> v1:172.21.15.72:6816/118184 conn(0x7f5da002bb60 legacy=0x7f5da002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.991+0000 7f5dc3f62700 1 -- 172.21.15.72:0/3864765201 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dbc067270 msgr2=0x7f5dbc1383b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:45.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.991+0000 7f5dc3f62700 1 --2- 172.21.15.72:0/3864765201 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dbc067270 0x7f5dbc1383b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f5dac00ea50 tx=0x7f5dac009060).stop 2023-10-03T10:09:45.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.992+0000 7f5dc3f62700 1 -- 172.21.15.72:0/3864765201 shutdown_connections 2023-10-03T10:09:45.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.992+0000 7f5dc3f62700 1 --2- 172.21.15.72:0/3864765201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dbc097100 0x7f5dbc138d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.992+0000 7f5dc3f62700 1 --2- 172.21.15.72:0/3864765201 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dbc067270 0x7f5dbc1383b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.992+0000 7f5dc3f62700 1 --2- 172.21.15.72:0/3864765201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dbc096830 0x7f5dbc1388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:45.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.992+0000 7f5dc3f62700 1 -- 172.21.15.72:0/3864765201 >> 172.21.15.72:0/3864765201 conn(0x7f5dbc09a3d0 msgr2=0x7f5dbc12c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:45.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.994+0000 7f5dc3f62700 1 -- 172.21.15.72:0/3864765201 shutdown_connections 2023-10-03T10:09:45.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:45.994+0000 7f5dc3f62700 1 -- 172.21.15.72:0/3864765201 wait complete. 2023-10-03T10:09:46.000 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-10-03T10:09:46.016 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-03T10:09:46.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.137+0000 7ff6ab9a5700 1 Processor -- start 2023-10-03T10:09:46.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.137+0000 7ff6ab9a5700 1 -- start start 2023-10-03T10:09:46.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6ab9a5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6a4066110 0x7ff6a4097420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6ab9a5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a412add0 0x7ff6a412b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6ab9a5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a41274d0 0x7ff6a4127980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6ab9a5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a40664f0 con 0x7ff6a4066110 2023-10-03T10:09:46.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6ab9a5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4065d80 con 0x7ff6a41274d0 2023-10-03T10:09:46.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6ab9a5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4065c20 con 0x7ff6a412add0 2023-10-03T10:09:46.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6a8f40700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a412add0 0x7ff6a412b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6a9741700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6a4066110 0x7ff6a4097420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6a9f42700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a41274d0 0x7ff6a4127980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6a9741700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6a4066110 0x7ff6a4097420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38632/0 (socket says 172.21.15.72:38632) 2023-10-03T10:09:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6a9f42700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a41274d0 0x7ff6a4127980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42278/0 (socket says 172.21.15.72:42278) 2023-10-03T10:09:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6a8f40700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a412add0 0x7ff6a412b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38084/0 (socket says 172.21.15.72:38084) 2023-10-03T10:09:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6a9741700 1 -- 172.21.15.72:0/656278964 learned_addr learned my addr 172.21.15.72:0/656278964 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6a9f42700 1 -- 172.21.15.72:0/656278964 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a412add0 msgr2=0x7ff6a412b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6a9f42700 1 --2- 172.21.15.72:0/656278964 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a412add0 0x7ff6a412b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6a9f42700 1 -- 172.21.15.72:0/656278964 >> v2:172.21.15.72:3300/0 conn(0x7ff6a4066110 msgr2=0x7ff6a4097420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6a9f42700 1 --2- 172.21.15.72:0/656278964 >> v2:172.21.15.72:3300/0 conn(0x7ff6a4066110 0x7ff6a4097420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6a9f42700 1 -- 172.21.15.72:0/656278964 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4064e80 con 0x7ff6a41274d0 2023-10-03T10:09:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6a9741700 1 --2- 172.21.15.72:0/656278964 >> v2:172.21.15.72:3300/0 conn(0x7ff6a4066110 0x7ff6a4097420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.138+0000 7ff6a9f42700 1 --2- 172.21.15.72:0/656278964 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a41274d0 0x7ff6a4127980 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff69c009e60 tx=0x7ff69c009780).ready entity=mon.1 client_cookie=a6a3c41cf8b43f81 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.139+0000 7ff69bfff700 1 -- 172.21.15.72:0/656278964 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c00e070 con 0x7ff6a41274d0 2023-10-03T10:09:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.139+0000 7ff69bfff700 1 -- 172.21.15.72:0/656278964 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c00bab0 con 0x7ff6a41274d0 2023-10-03T10:09:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.139+0000 7ff69bfff700 1 -- 172.21.15.72:0/656278964 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c00be30 con 0x7ff6a41274d0 2023-10-03T10:09:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.139+0000 7ff6ab9a5700 1 -- 172.21.15.72:0/656278964 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a41274d0 msgr2=0x7ff6a4127980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.139+0000 7ff6ab9a5700 1 --2- 172.21.15.72:0/656278964 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a41274d0 0x7ff6a4127980 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ff69c009e60 tx=0x7ff69c009780).stop 2023-10-03T10:09:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.139+0000 7ff6ab9a5700 1 -- 172.21.15.72:0/656278964 shutdown_connections 2023-10-03T10:09:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.139+0000 7ff6ab9a5700 1 --2- 172.21.15.72:0/656278964 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a41274d0 0x7ff6a4127980 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.139+0000 7ff6ab9a5700 1 --2- 172.21.15.72:0/656278964 >> v2:172.21.15.72:3300/0 conn(0x7ff6a4066110 0x7ff6a4097420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.139+0000 7ff6ab9a5700 1 --2- 172.21.15.72:0/656278964 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a412add0 0x7ff6a412b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.139+0000 7ff6ab9a5700 1 -- 172.21.15.72:0/656278964 >> 172.21.15.72:0/656278964 conn(0x7ff6a409ba60 msgr2=0x7ff6a409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.139+0000 7ff6ab9a5700 1 -- 172.21.15.72:0/656278964 shutdown_connections 2023-10-03T10:09:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.139+0000 7ff6ab9a5700 1 -- 172.21.15.72:0/656278964 wait complete. 2023-10-03T10:09:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.140+0000 7ff6ab9a5700 1 Processor -- start 2023-10-03T10:09:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.140+0000 7ff6ab9a5700 1 -- start start 2023-10-03T10:09:46.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6ab9a5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a4066110 0x7ff6a4117d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6ab9a5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a41274d0 0x7ff6a4113d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6ab9a5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a412add0 0x7ff6a4114220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6ab9a5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4115200 con 0x7ff6a412add0 2023-10-03T10:09:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6ab9a5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a4124ec0 con 0x7ff6a41274d0 2023-10-03T10:09:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6ab9a5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a41172c0 con 0x7ff6a4066110 2023-10-03T10:09:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6a9741700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a4066110 0x7ff6a4117d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6a9f42700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a412add0 0x7ff6a4114220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6a9f42700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a412add0 0x7ff6a4114220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38644/0 (socket says 172.21.15.72:38644) 2023-10-03T10:09:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6a9741700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a4066110 0x7ff6a4117d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38086/0 (socket says 172.21.15.72:38086) 2023-10-03T10:09:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6a9f42700 1 -- 172.21.15.72:0/1093951108 learned_addr learned my addr 172.21.15.72:0/1093951108 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6a8f40700 1 --2- 172.21.15.72:0/1093951108 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a41274d0 0x7ff6a4113d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6a9741700 1 -- 172.21.15.72:0/1093951108 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a41274d0 msgr2=0x7ff6a4113d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6a9741700 1 --2- 172.21.15.72:0/1093951108 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a41274d0 0x7ff6a4113d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6a9741700 1 -- 172.21.15.72:0/1093951108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a412add0 msgr2=0x7ff6a4114220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6a9741700 1 --2- 172.21.15.72:0/1093951108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a412add0 0x7ff6a4114220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6a9741700 1 -- 172.21.15.72:0/1093951108 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff694009370 con 0x7ff6a4066110 2023-10-03T10:09:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6a9f42700 1 --2- 172.21.15.72:0/1093951108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a412add0 0x7ff6a4114220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6a9741700 1 --2- 172.21.15.72:0/1093951108 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a4066110 0x7ff6a4117d60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff69400ea00 tx=0x7ff6940090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6997fa700 1 -- 172.21.15.72:0/1093951108 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69400c6a0 con 0x7ff6a4066110 2023-10-03T10:09:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6997fa700 1 -- 172.21.15.72:0/1093951108 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69400c800 con 0x7ff6a4066110 2023-10-03T10:09:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6ab9a5700 1 -- 172.21.15.72:0/1093951108 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69c009a20 con 0x7ff6a4066110 2023-10-03T10:09:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6997fa700 1 -- 172.21.15.72:0/1093951108 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69400cb80 con 0x7ff6a4066110 2023-10-03T10:09:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.141+0000 7ff6ab9a5700 1 -- 172.21.15.72:0/1093951108 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a4115950 con 0x7ff6a4066110 2023-10-03T10:09:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.142+0000 7ff6997fa700 1 -- 172.21.15.72:0/1093951108 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff69401b400 con 0x7ff6a4066110 2023-10-03T10:09:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.142+0000 7ff6997fa700 1 -- 172.21.15.72:0/1093951108 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3590+0+0 (secure 0 0 0) 0x7ff69403b500 con 0x7ff6a4066110 2023-10-03T10:09:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.142+0000 7ff6ab9a5700 1 -- 172.21.15.72:0/1093951108 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a405a260 con 0x7ff6a4066110 2023-10-03T10:09:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.147+0000 7ff6997fa700 1 -- 172.21.15.72:0/1093951108 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff694019900 con 0x7ff6a4066110 2023-10-03T10:09:46.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.342+0000 7ff6ab9a5700 1 -- 172.21.15.72:0/1093951108 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff6a4046c20 con 0x7ff6a4066110 2023-10-03T10:09:46.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.357+0000 7ff6997fa700 1 -- 172.21.15.72:0/1093951108 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff69402a0c0 con 0x7ff6a4066110 2023-10-03T10:09:46.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.360+0000 7ff6ab9a5700 1 -- 172.21.15.72:0/1093951108 >> v1:172.21.15.72:6816/118184 conn(0x7ff68802bb60 legacy=0x7ff68802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.360+0000 7ff6ab9a5700 1 -- 172.21.15.72:0/1093951108 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a4066110 msgr2=0x7ff6a4117d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.360+0000 7ff6ab9a5700 1 --2- 172.21.15.72:0/1093951108 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a4066110 0x7ff6a4117d60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff69400ea00 tx=0x7ff6940090f0).stop 2023-10-03T10:09:46.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.362+0000 7ff6ab9a5700 1 -- 172.21.15.72:0/1093951108 shutdown_connections 2023-10-03T10:09:46.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.362+0000 7ff6ab9a5700 1 --2- 172.21.15.72:0/1093951108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a412add0 0x7ff6a4114220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.362+0000 7ff6ab9a5700 1 --2- 172.21.15.72:0/1093951108 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a4066110 0x7ff6a4117d60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.362+0000 7ff6ab9a5700 1 --2- 172.21.15.72:0/1093951108 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a41274d0 0x7ff6a4113d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.362+0000 7ff6ab9a5700 1 -- 172.21.15.72:0/1093951108 >> 172.21.15.72:0/1093951108 conn(0x7ff6a409ba60 msgr2=0x7ff6a409a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:46.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.362+0000 7ff6ab9a5700 1 -- 172.21.15.72:0/1093951108 shutdown_connections 2023-10-03T10:09:46.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.362+0000 7ff6ab9a5700 1 -- 172.21.15.72:0/1093951108 wait complete. 2023-10-03T10:09:46.373 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 3 and data pool 4 2023-10-03T10:09:46.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:46.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.512+0000 7fe1f34f5700 1 Processor -- start 2023-10-03T10:09:46.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.512+0000 7fe1f34f5700 1 -- start start 2023-10-03T10:09:46.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.512+0000 7fe1f34f5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1ec059070 0x7fe1ec127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.512+0000 7fe1f34f5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1ec127390 0x7fe1ec127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.512+0000 7fe1f34f5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ec091b60 con 0x7fe1ec095370 2023-10-03T10:09:46.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.512+0000 7fe1f34f5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ec059450 con 0x7fe1ec127390 2023-10-03T10:09:46.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.512+0000 7fe1f34f5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec0968c0 con 0x7fe1ec059070 2023-10-03T10:09:46.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.512+0000 7fe1f1291700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1ec059070 0x7fe1ec127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.512+0000 7fe1f0a90700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1ec127390 0x7fe1ec127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.512+0000 7fe1f1291700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1ec059070 0x7fe1ec127890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42302/0 (socket says 172.21.15.72:42302) 2023-10-03T10:09:46.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.512+0000 7fe1f0a90700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1ec127390 0x7fe1ec127d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38654/0 (socket says 172.21.15.72:38654) 2023-10-03T10:09:46.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.512+0000 7fe1f1291700 1 -- 172.21.15.72:0/350317803 learned_addr learned my addr 172.21.15.72:0/350317803 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:46.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.512+0000 7fe1f1a92700 1 --1- 172.21.15.72:0/350317803 >> v1:172.21.15.72:6789/0 conn(0x7fe1ec095370 0x7fe1ec095820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60314/0 (socket says 172.21.15.72:60314) 2023-10-03T10:09:46.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.513+0000 7fe1f1291700 1 -- 172.21.15.72:0/350317803 >> v2:172.21.15.72:3300/0 conn(0x7fe1ec127390 msgr2=0x7fe1ec127d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:46.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.513+0000 7fe1f1291700 1 --2- 172.21.15.72:0/350317803 >> v2:172.21.15.72:3300/0 conn(0x7fe1ec127390 0x7fe1ec127d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.513+0000 7fe1f1291700 1 -- 172.21.15.72:0/350317803 >> v1:172.21.15.72:6789/0 conn(0x7fe1ec095370 legacy=0x7fe1ec095820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.513+0000 7fe1f1291700 1 -- 172.21.15.72:0/350317803 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec092a10 con 0x7fe1ec059070 2023-10-03T10:09:46.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.513+0000 7fe1f0a90700 1 --2- 172.21.15.72:0/350317803 >> v2:172.21.15.72:3300/0 conn(0x7fe1ec127390 0x7fe1ec127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:46.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.513+0000 7fe1f1291700 1 --2- 172.21.15.72:0/350317803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1ec059070 0x7fe1ec127890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe1e8009830 tx=0x7fe1e80090f0).ready entity=mon.1 client_cookie=eb48516f84975c35 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:46.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.513+0000 7fe1e3fff700 1 -- 172.21.15.72:0/350317803 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e800b580 con 0x7fe1ec059070 2023-10-03T10:09:46.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.513+0000 7fe1e3fff700 1 -- 172.21.15.72:0/350317803 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e800b6e0 con 0x7fe1ec059070 2023-10-03T10:09:46.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.513+0000 7fe1e3fff700 1 -- 172.21.15.72:0/350317803 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e800ba80 con 0x7fe1ec059070 2023-10-03T10:09:46.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.513+0000 7fe1f34f5700 1 -- 172.21.15.72:0/350317803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1ec059070 msgr2=0x7fe1ec127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.513+0000 7fe1f34f5700 1 --2- 172.21.15.72:0/350317803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1ec059070 0x7fe1ec127890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe1e8009830 tx=0x7fe1e80090f0).stop 2023-10-03T10:09:46.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.514+0000 7fe1f34f5700 1 -- 172.21.15.72:0/350317803 shutdown_connections 2023-10-03T10:09:46.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.514+0000 7fe1f34f5700 1 --2- 172.21.15.72:0/350317803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1ec059070 0x7fe1ec127890 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.514+0000 7fe1f34f5700 1 --2- 172.21.15.72:0/350317803 >> v2:172.21.15.72:3300/0 conn(0x7fe1ec127390 0x7fe1ec127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.514+0000 7fe1f34f5700 1 -- 172.21.15.72:0/350317803 >> 172.21.15.72:0/350317803 conn(0x7fe1ec097470 msgr2=0x7fe1ec097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:46.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.514+0000 7fe1f34f5700 1 -- 172.21.15.72:0/350317803 shutdown_connections 2023-10-03T10:09:46.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.514+0000 7fe1f34f5700 1 -- 172.21.15.72:0/350317803 wait complete. 2023-10-03T10:09:46.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.514+0000 7fe1f34f5700 1 Processor -- start 2023-10-03T10:09:46.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.514+0000 7fe1f34f5700 1 -- start start 2023-10-03T10:09:46.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.515+0000 7fe1f34f5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1ec059070 0x7fe1ec113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.515+0000 7fe1f34f5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1ec095370 0x7fe1ec113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.515+0000 7fe1f34f5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe1ec127390 0x7fe1ec114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.515+0000 7fe1f34f5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec124ae0 con 0x7fe1ec059070 2023-10-03T10:09:46.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.515+0000 7fe1f34f5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec096ea0 con 0x7fe1ec095370 2023-10-03T10:09:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.515+0000 7fe1f34f5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec116f10 con 0x7fe1ec127390 2023-10-03T10:09:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.515+0000 7fe1f1291700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1ec059070 0x7fe1ec113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.515+0000 7fe1f1291700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1ec059070 0x7fe1ec113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38658/0 (socket says 172.21.15.72:38658) 2023-10-03T10:09:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.515+0000 7fe1f1291700 1 -- 172.21.15.72:0/3269133295 learned_addr learned my addr 172.21.15.72:0/3269133295 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.515+0000 7fe1f1a92700 1 --2- 172.21.15.72:0/3269133295 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe1ec127390 0x7fe1ec114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.516+0000 7fe1f0a90700 1 --2- 172.21.15.72:0/3269133295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1ec095370 0x7fe1ec113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.516+0000 7fe1f1291700 1 -- 172.21.15.72:0/3269133295 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe1ec127390 msgr2=0x7fe1ec114440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.516+0000 7fe1f1291700 1 --2- 172.21.15.72:0/3269133295 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe1ec127390 0x7fe1ec114440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.516+0000 7fe1f1291700 1 -- 172.21.15.72:0/3269133295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1ec095370 msgr2=0x7fe1ec113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.516+0000 7fe1f1291700 1 --2- 172.21.15.72:0/3269133295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1ec095370 0x7fe1ec113f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.516+0000 7fe1f1291700 1 -- 172.21.15.72:0/3269133295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc0092a0 con 0x7fe1ec059070 2023-10-03T10:09:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.516+0000 7fe1f1291700 1 --2- 172.21.15.72:0/3269133295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1ec059070 0x7fe1ec113a60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe1ec092390 tx=0x7fe1e8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.516+0000 7fe1e17fa700 1 -- 172.21.15.72:0/3269133295 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8006d90 con 0x7fe1ec059070 2023-10-03T10:09:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.516+0000 7fe1e17fa700 1 -- 172.21.15.72:0/3269133295 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e800be40 con 0x7fe1ec059070 2023-10-03T10:09:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.516+0000 7fe1f34f5700 1 -- 172.21.15.72:0/3269133295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e8009370 con 0x7fe1ec059070 2023-10-03T10:09:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.516+0000 7fe1e17fa700 1 -- 172.21.15.72:0/3269133295 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e801c420 con 0x7fe1ec059070 2023-10-03T10:09:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.516+0000 7fe1f34f5700 1 -- 172.21.15.72:0/3269133295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ec117b90 con 0x7fe1ec059070 2023-10-03T10:09:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.517+0000 7fe1e17fa700 1 -- 172.21.15.72:0/3269133295 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe1e801c790 con 0x7fe1ec059070 2023-10-03T10:09:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.517+0000 7fe1e17fa700 1 -- 172.21.15.72:0/3269133295 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe1e803cb50 con 0x7fe1ec059070 2023-10-03T10:09:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.517+0000 7fe1f34f5700 1 -- 172.21.15.72:0/3269133295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ec091d80 con 0x7fe1ec059070 2023-10-03T10:09:46.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.522+0000 7fe1e17fa700 1 -- 172.21.15.72:0/3269133295 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe1e802a020 con 0x7fe1ec059070 2023-10-03T10:09:46.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.684+0000 7fe1f34f5700 1 -- 172.21.15.72:0/3269133295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1ec05a260 con 0x7fe1ec059070 2023-10-03T10:09:46.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.685+0000 7fe1e17fa700 1 -- 172.21.15.72:0/3269133295 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11354 (secure 0 0 0) 0x7fe1e8034090 con 0x7fe1ec059070 2023-10-03T10:09:46.686 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:46.686 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":16,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:09:46.344497+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:46.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.687+0000 7fe1f34f5700 1 -- 172.21.15.72:0/3269133295 >> v1:172.21.15.72:6816/118184 conn(0x7fe1d002bb60 legacy=0x7fe1d002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.687+0000 7fe1f34f5700 1 -- 172.21.15.72:0/3269133295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1ec059070 msgr2=0x7fe1ec113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.687+0000 7fe1f34f5700 1 --2- 172.21.15.72:0/3269133295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1ec059070 0x7fe1ec113a60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe1ec092390 tx=0x7fe1e8017000).stop 2023-10-03T10:09:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.687+0000 7fe1f34f5700 1 -- 172.21.15.72:0/3269133295 shutdown_connections 2023-10-03T10:09:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.687+0000 7fe1f34f5700 1 --2- 172.21.15.72:0/3269133295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1ec059070 0x7fe1ec113a60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.687+0000 7fe1f34f5700 1 --2- 172.21.15.72:0/3269133295 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe1ec127390 0x7fe1ec114440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.687+0000 7fe1f34f5700 1 --2- 172.21.15.72:0/3269133295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1ec095370 0x7fe1ec113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.687+0000 7fe1f34f5700 1 -- 172.21.15.72:0/3269133295 >> 172.21.15.72:0/3269133295 conn(0x7fe1ec097470 msgr2=0x7fe1ec129750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.687+0000 7fe1f34f5700 1 -- 172.21.15.72:0/3269133295 shutdown_connections 2023-10-03T10:09:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.687+0000 7fe1f34f5700 1 -- 172.21.15.72:0/3269133295 wait complete. 2023-10-03T10:09:46.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:46.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.814+0000 7f3ed6dbd700 1 Processor -- start 2023-10-03T10:09:46.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.814+0000 7f3ed6dbd700 1 -- start start 2023-10-03T10:09:46.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ed6dbd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ed00965e0 0x7f3ed00969c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ed6dbd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ed0096eb0 0x7f3ed0067de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ed6dbd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed00933b0 con 0x7f3ed00682d0 2023-10-03T10:09:46.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ed6dbd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed0092190 con 0x7f3ed0096eb0 2023-10-03T10:09:46.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ed6dbd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0069a20 con 0x7f3ed00965e0 2023-10-03T10:09:46.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ed4b59700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ed00965e0 0x7f3ed00969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ecffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ed0096eb0 0x7f3ed0067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ed4b59700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ed00965e0 0x7f3ed00969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38108/0 (socket says 172.21.15.72:38108) 2023-10-03T10:09:46.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ed4b59700 1 -- 172.21.15.72:0/1340324633 learned_addr learned my addr 172.21.15.72:0/1340324633 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:46.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ecffff700 1 -- 172.21.15.72:0/1340324633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ed00965e0 msgr2=0x7f3ed00969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:46.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ecffff700 1 --2- 172.21.15.72:0/1340324633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ed00965e0 0x7f3ed00969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ecffff700 1 -- 172.21.15.72:0/1340324633 >> v1:172.21.15.72:6789/0 conn(0x7f3ed00682d0 legacy=0x7f3ed012ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ecffff700 1 -- 172.21.15.72:0/1340324633 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed0069ca0 con 0x7f3ed0096eb0 2023-10-03T10:09:46.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ed4b59700 1 --2- 172.21.15.72:0/1340324633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ed00965e0 0x7f3ed00969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:46.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ecffff700 1 --2- 172.21.15.72:0/1340324633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed0096eb0 0x7f3ed0067de0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3ebc009760 tx=0x7f3ebc009060).ready entity=mon.0 client_cookie=bdacbb5e37d526c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:46.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ecf7fe700 1 -- 172.21.15.72:0/1340324633 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc00f510 con 0x7f3ed0096eb0 2023-10-03T10:09:46.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ecf7fe700 1 -- 172.21.15.72:0/1340324633 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc00f670 con 0x7f3ed0096eb0 2023-10-03T10:09:46.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.815+0000 7f3ecf7fe700 1 -- 172.21.15.72:0/1340324633 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc00f9f0 con 0x7f3ed0096eb0 2023-10-03T10:09:46.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.816+0000 7f3ed6dbd700 1 -- 172.21.15.72:0/1340324633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed0096eb0 msgr2=0x7f3ed0067de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.816+0000 7f3ed6dbd700 1 --2- 172.21.15.72:0/1340324633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed0096eb0 0x7f3ed0067de0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3ebc009760 tx=0x7f3ebc009060).stop 2023-10-03T10:09:46.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.816+0000 7f3ed6dbd700 1 -- 172.21.15.72:0/1340324633 shutdown_connections 2023-10-03T10:09:46.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.816+0000 7f3ed6dbd700 1 --2- 172.21.15.72:0/1340324633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ed00965e0 0x7f3ed00969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.816+0000 7f3ed6dbd700 1 --2- 172.21.15.72:0/1340324633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed0096eb0 0x7f3ed0067de0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.816+0000 7f3ed6dbd700 1 -- 172.21.15.72:0/1340324633 >> 172.21.15.72:0/1340324633 conn(0x7f3ed009a220 msgr2=0x7f3ed009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:46.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.816+0000 7f3ed6dbd700 1 -- 172.21.15.72:0/1340324633 shutdown_connections 2023-10-03T10:09:46.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.816+0000 7f3ed6dbd700 1 -- 172.21.15.72:0/1340324633 wait complete. 2023-10-03T10:09:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.817+0000 7f3ed6dbd700 1 Processor -- start 2023-10-03T10:09:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.817+0000 7f3ed6dbd700 1 -- start start 2023-10-03T10:09:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.817+0000 7f3ed6dbd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed00682d0 0x7f3ed01363f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.817+0000 7f3ed6dbd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ed00965e0 0x7f3ed01368e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.817+0000 7f3ed6dbd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ed0096eb0 0x7f3ed0114f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.817+0000 7f3ed6dbd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0118bf0 con 0x7f3ed00682d0 2023-10-03T10:09:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.817+0000 7f3ed6dbd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0116380 con 0x7f3ed00965e0 2023-10-03T10:09:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.817+0000 7f3ed6dbd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed012b140 con 0x7f3ed0096eb0 2023-10-03T10:09:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.817+0000 7f3ed535a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ed0096eb0 0x7f3ed0114f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.817+0000 7f3ed4b59700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed00682d0 0x7f3ed01363f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.817+0000 7f3ecffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ed00965e0 0x7f3ed01368e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.817+0000 7f3ed4b59700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed00682d0 0x7f3ed01363f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38668/0 (socket says 172.21.15.72:38668) 2023-10-03T10:09:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.817+0000 7f3ecffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ed00965e0 0x7f3ed01368e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42310/0 (socket says 172.21.15.72:42310) 2023-10-03T10:09:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.817+0000 7f3ed535a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ed0096eb0 0x7f3ed0114f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38118/0 (socket says 172.21.15.72:38118) 2023-10-03T10:09:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.817+0000 7f3ed4b59700 1 -- 172.21.15.72:0/1878333972 learned_addr learned my addr 172.21.15.72:0/1878333972 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.818+0000 7f3ed4b59700 1 -- 172.21.15.72:0/1878333972 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ed0096eb0 msgr2=0x7f3ed0114f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.818+0000 7f3ed4b59700 1 --2- 172.21.15.72:0/1878333972 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ed0096eb0 0x7f3ed0114f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.818+0000 7f3ed4b59700 1 -- 172.21.15.72:0/1878333972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ed00965e0 msgr2=0x7f3ed01368e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.818+0000 7f3ed4b59700 1 --2- 172.21.15.72:0/1878333972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ed00965e0 0x7f3ed01368e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.818+0000 7f3ed4b59700 1 -- 172.21.15.72:0/1878333972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec400b610 con 0x7f3ed00682d0 2023-10-03T10:09:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.818+0000 7f3ed535a700 1 --2- 172.21.15.72:0/1878333972 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ed0096eb0 0x7f3ed0114f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.818+0000 7f3ecffff700 1 --2- 172.21.15.72:0/1878333972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ed00965e0 0x7f3ed01368e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.818+0000 7f3ed4b59700 1 --2- 172.21.15.72:0/1878333972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed00682d0 0x7f3ed01363f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3ec4010e90 tx=0x7f3ec400b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.818+0000 7f3eccff9700 1 -- 172.21.15.72:0/1878333972 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec400ed40 con 0x7f3ed00682d0 2023-10-03T10:09:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.818+0000 7f3eccff9700 1 -- 172.21.15.72:0/1878333972 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec401a470 con 0x7f3ed00682d0 2023-10-03T10:09:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.818+0000 7f3ed6dbd700 1 -- 172.21.15.72:0/1878333972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ebc0092a0 con 0x7f3ed00682d0 2023-10-03T10:09:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.818+0000 7f3eccff9700 1 -- 172.21.15.72:0/1878333972 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec400eea0 con 0x7f3ed00682d0 2023-10-03T10:09:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.818+0000 7f3ed6dbd700 1 -- 172.21.15.72:0/1878333972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed01174c0 con 0x7f3ed00682d0 2023-10-03T10:09:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.819+0000 7f3eccff9700 1 -- 172.21.15.72:0/1878333972 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3ec4017070 con 0x7f3ed00682d0 2023-10-03T10:09:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.819+0000 7f3eccff9700 1 -- 172.21.15.72:0/1878333972 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3ec403dd10 con 0x7f3ed00682d0 2023-10-03T10:09:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.819+0000 7f3ed6dbd700 1 -- 172.21.15.72:0/1878333972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed0118440 con 0x7f3ed00682d0 2023-10-03T10:09:46.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.823+0000 7f3eccff9700 1 -- 172.21.15.72:0/1878333972 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3ec40117d0 con 0x7f3ed00682d0 2023-10-03T10:09:46.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.983+0000 7f3ed6dbd700 1 -- 172.21.15.72:0/1878333972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ed005a260 con 0x7f3ed00682d0 2023-10-03T10:09:46.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.983+0000 7f3eccff9700 1 -- 172.21.15.72:0/1878333972 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11354 (secure 0 0 0) 0x7f3ec400db40 con 0x7f3ed00682d0 2023-10-03T10:09:46.984 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:46.984 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":16,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:09:46.344497+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:46.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.985+0000 7f3ed6dbd700 1 -- 172.21.15.72:0/1878333972 >> v1:172.21.15.72:6816/118184 conn(0x7f3eb402bb60 legacy=0x7f3eb402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.985+0000 7f3ed6dbd700 1 -- 172.21.15.72:0/1878333972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed00682d0 msgr2=0x7f3ed01363f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:46.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.985+0000 7f3ed6dbd700 1 --2- 172.21.15.72:0/1878333972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed00682d0 0x7f3ed01363f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3ec4010e90 tx=0x7f3ec400b3b0).stop 2023-10-03T10:09:46.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.985+0000 7f3ed6dbd700 1 -- 172.21.15.72:0/1878333972 shutdown_connections 2023-10-03T10:09:46.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.985+0000 7f3ed6dbd700 1 --2- 172.21.15.72:0/1878333972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ed00682d0 0x7f3ed01363f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.985+0000 7f3ed6dbd700 1 --2- 172.21.15.72:0/1878333972 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ed0096eb0 0x7f3ed0114f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.985+0000 7f3ed6dbd700 1 --2- 172.21.15.72:0/1878333972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ed00965e0 0x7f3ed01368e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:46.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.985+0000 7f3ed6dbd700 1 -- 172.21.15.72:0/1878333972 >> 172.21.15.72:0/1878333972 conn(0x7f3ed009a220 msgr2=0x7f3ed0129c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:46.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.985+0000 7f3ed6dbd700 1 -- 172.21.15.72:0/1878333972 shutdown_connections 2023-10-03T10:09:46.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:46.985+0000 7f3ed6dbd700 1 -- 172.21.15.72:0/1878333972 wait complete. 2023-10-03T10:09:46.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-03T10:09:47.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.116+0000 7f405b0cb700 1 Processor -- start 2023-10-03T10:09:47.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.116+0000 7f405b0cb700 1 -- start start 2023-10-03T10:09:47.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f405b0cb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40540613a0 0x7f405412ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f405b0cb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f405412b230 0x7f4054068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f405b0cb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40540985c0 con 0x7f405412b610 2023-10-03T10:09:47.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f405b0cb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4054061780 con 0x7f40540613a0 2023-10-03T10:09:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f405b0cb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4054091dd0 con 0x7f405412b230 2023-10-03T10:09:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f4053fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f405412b230 0x7f4054068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f4058e67700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40540613a0 0x7f405412ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f4058e67700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40540613a0 0x7f405412ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38676/0 (socket says 172.21.15.72:38676) 2023-10-03T10:09:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f4053fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f405412b230 0x7f4054068d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38126/0 (socket says 172.21.15.72:38126) 2023-10-03T10:09:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f4058e67700 1 -- 172.21.15.72:0/3584018465 learned_addr learned my addr 172.21.15.72:0/3584018465 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f4059668700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f405412b610 0x7f4054069210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60338/0 (socket says 172.21.15.72:60338) 2023-10-03T10:09:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f4053fff700 1 -- 172.21.15.72:0/3584018465 >> v2:172.21.15.72:3300/0 conn(0x7f40540613a0 msgr2=0x7f405412ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f4053fff700 1 --2- 172.21.15.72:0/3584018465 >> v2:172.21.15.72:3300/0 conn(0x7f40540613a0 0x7f405412ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f4053fff700 1 -- 172.21.15.72:0/3584018465 >> v1:172.21.15.72:6789/0 conn(0x7f405412b610 legacy=0x7f4054069210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f4053fff700 1 -- 172.21.15.72:0/3584018465 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40540996a0 con 0x7f405412b230 2023-10-03T10:09:47.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f40537fe700 1 -- 172.21.15.72:0/3584018465 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782200957 0 0) 0x7f40540985c0 con 0x7f405412b610 2023-10-03T10:09:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.117+0000 7f4058e67700 1 --2- 172.21.15.72:0/3584018465 >> v2:172.21.15.72:3300/0 conn(0x7f40540613a0 0x7f405412ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.118+0000 7f4053fff700 1 --2- 172.21.15.72:0/3584018465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f405412b230 0x7f4054068d20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f4040009790 tx=0x7f4040009060).ready entity=mon.2 client_cookie=16131020a2c3a330 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.118+0000 7f40537fe700 1 -- 172.21.15.72:0/3584018465 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404000f510 con 0x7f405412b230 2023-10-03T10:09:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.118+0000 7f40537fe700 1 -- 172.21.15.72:0/3584018465 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404000f670 con 0x7f405412b230 2023-10-03T10:09:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.118+0000 7f40537fe700 1 -- 172.21.15.72:0/3584018465 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404000f9f0 con 0x7f405412b230 2023-10-03T10:09:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.118+0000 7f405b0cb700 1 -- 172.21.15.72:0/3584018465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f405412b230 msgr2=0x7f4054068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.118+0000 7f405b0cb700 1 --2- 172.21.15.72:0/3584018465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f405412b230 0x7f4054068d20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f4040009790 tx=0x7f4040009060).stop 2023-10-03T10:09:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.118+0000 7f405b0cb700 1 -- 172.21.15.72:0/3584018465 shutdown_connections 2023-10-03T10:09:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.118+0000 7f405b0cb700 1 --2- 172.21.15.72:0/3584018465 >> v2:172.21.15.72:3300/0 conn(0x7f40540613a0 0x7f405412ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.118+0000 7f405b0cb700 1 --2- 172.21.15.72:0/3584018465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f405412b230 0x7f4054068d20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.118+0000 7f405b0cb700 1 -- 172.21.15.72:0/3584018465 >> 172.21.15.72:0/3584018465 conn(0x7f405409a1c0 msgr2=0x7f405409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:47.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.118+0000 7f405b0cb700 1 -- 172.21.15.72:0/3584018465 shutdown_connections 2023-10-03T10:09:47.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.118+0000 7f405b0cb700 1 -- 172.21.15.72:0/3584018465 wait complete. 2023-10-03T10:09:47.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.119+0000 7f405b0cb700 1 Processor -- start 2023-10-03T10:09:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.119+0000 7f405b0cb700 1 -- start start 2023-10-03T10:09:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f405b0cb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40540613a0 0x7f405413a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f405b0cb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f405412b230 0x7f405413a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f405b0cb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f405412b610 0x7f4054114a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f405b0cb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40540938f0 con 0x7f405412b230 2023-10-03T10:09:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f405b0cb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4054118250 con 0x7f40540613a0 2023-10-03T10:09:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f405b0cb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4054117f90 con 0x7f405412b610 2023-10-03T10:09:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f4053fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f405412b230 0x7f405413a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f4059668700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f405412b610 0x7f4054114a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f4053fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f405412b230 0x7f405413a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38686/0 (socket says 172.21.15.72:38686) 2023-10-03T10:09:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f4053fff700 1 -- 172.21.15.72:0/3575975998 learned_addr learned my addr 172.21.15.72:0/3575975998 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:47.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f4058e67700 1 --2- 172.21.15.72:0/3575975998 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40540613a0 0x7f405413a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f4053fff700 1 -- 172.21.15.72:0/3575975998 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f405412b610 msgr2=0x7f4054114a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:47.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f4053fff700 1 --2- 172.21.15.72:0/3575975998 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f405412b610 0x7f4054114a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f4053fff700 1 -- 172.21.15.72:0/3575975998 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40540613a0 msgr2=0x7f405413a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:47.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f4053fff700 1 --2- 172.21.15.72:0/3575975998 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40540613a0 0x7f405413a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f4053fff700 1 -- 172.21.15.72:0/3575975998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4048009370 con 0x7f405412b230 2023-10-03T10:09:47.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f4059668700 1 --2- 172.21.15.72:0/3575975998 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f405412b610 0x7f4054114a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:47.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f4053fff700 1 --2- 172.21.15.72:0/3575975998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f405412b230 0x7f405413a970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4054091f10 tx=0x7f4040017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:47.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f4050ff9700 1 -- 172.21.15.72:0/3575975998 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404000f7e0 con 0x7f405412b230 2023-10-03T10:09:47.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f4050ff9700 1 -- 172.21.15.72:0/3575975998 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404000f940 con 0x7f405412b230 2023-10-03T10:09:47.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f4050ff9700 1 -- 172.21.15.72:0/3575975998 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404001b660 con 0x7f405412b230 2023-10-03T10:09:47.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f405b0cb700 1 -- 172.21.15.72:0/3575975998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40400092a0 con 0x7f405412b230 2023-10-03T10:09:47.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.120+0000 7f405b0cb700 1 -- 172.21.15.72:0/3575975998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40541166c0 con 0x7f405412b230 2023-10-03T10:09:47.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.121+0000 7f4050ff9700 1 -- 172.21.15.72:0/3575975998 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f404001ba50 con 0x7f405412b230 2023-10-03T10:09:47.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.121+0000 7f4050ff9700 1 -- 172.21.15.72:0/3575975998 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f404003ca50 con 0x7f405412b230 2023-10-03T10:09:47.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.121+0000 7f405b0cb700 1 -- 172.21.15.72:0/3575975998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405405a260 con 0x7f405412b230 2023-10-03T10:09:47.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.126+0000 7f4050ff9700 1 -- 172.21.15.72:0/3575975998 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4040028070 con 0x7f405412b230 2023-10-03T10:09:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.323+0000 7f405b0cb700 1 -- 172.21.15.72:0/3575975998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4054046c20 con 0x7f405412b230 2023-10-03T10:09:47.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.350+0000 7f4050ff9700 1 -- 172.21.15.72:0/3575975998 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v4) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4040031070 con 0x7f405412b230 2023-10-03T10:09:47.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.353+0000 7f405b0cb700 1 -- 172.21.15.72:0/3575975998 >> v1:172.21.15.72:6816/118184 conn(0x7f403802bb60 legacy=0x7f403802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:47.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.353+0000 7f405b0cb700 1 -- 172.21.15.72:0/3575975998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f405412b230 msgr2=0x7f405413a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:47.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.353+0000 7f405b0cb700 1 --2- 172.21.15.72:0/3575975998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f405412b230 0x7f405413a970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f4054091f10 tx=0x7f4040017000).stop 2023-10-03T10:09:47.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.354+0000 7f405b0cb700 1 -- 172.21.15.72:0/3575975998 shutdown_connections 2023-10-03T10:09:47.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.354+0000 7f405b0cb700 1 --2- 172.21.15.72:0/3575975998 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f405412b610 0x7f4054114a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.354+0000 7f405b0cb700 1 --2- 172.21.15.72:0/3575975998 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40540613a0 0x7f405413a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.354+0000 7f405b0cb700 1 --2- 172.21.15.72:0/3575975998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f405412b230 0x7f405413a970 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.354+0000 7f405b0cb700 1 -- 172.21.15.72:0/3575975998 >> 172.21.15.72:0/3575975998 conn(0x7f405409a1c0 msgr2=0x7f405412dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:47.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.354+0000 7f405b0cb700 1 -- 172.21.15.72:0/3575975998 shutdown_connections 2023-10-03T10:09:47.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.354+0000 7f405b0cb700 1 -- 172.21.15.72:0/3575975998 wait complete. 2023-10-03T10:09:47.367 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-03T10:09:47.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T10:09:47.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.485+0000 7f0baff28700 1 Processor -- start 2023-10-03T10:09:47.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.485+0000 7f0baff28700 1 -- start start 2023-10-03T10:09:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.485+0000 7f0baff28700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ba80926d0 0x7f0ba81275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0baff28700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ba8127be0 0x7f0ba8128000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0baff28700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ba812a9a0 0x7f0ba812ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0baff28700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba8099dd0 con 0x7f0ba812a9a0 2023-10-03T10:09:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0baff28700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba8091c80 con 0x7f0ba80926d0 2023-10-03T10:09:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0baff28700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80999d0 con 0x7f0ba8127be0 2023-10-03T10:09:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0badcc4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ba80926d0 0x7f0ba81275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0bad4c3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ba8127be0 0x7f0ba8128000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0bae4c5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ba812a9a0 0x7f0ba812ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0badcc4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ba80926d0 0x7f0ba81275c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42336/0 (socket says 172.21.15.72:42336) 2023-10-03T10:09:47.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0bad4c3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ba8127be0 0x7f0ba8128000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38148/0 (socket says 172.21.15.72:38148) 2023-10-03T10:09:47.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0badcc4700 1 -- 172.21.15.72:0/1325912254 learned_addr learned my addr 172.21.15.72:0/1325912254 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:47.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0bae4c5700 1 -- 172.21.15.72:0/1325912254 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ba8127be0 msgr2=0x7f0ba8128000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:47.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0bae4c5700 1 --2- 172.21.15.72:0/1325912254 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ba8127be0 0x7f0ba8128000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0bae4c5700 1 -- 172.21.15.72:0/1325912254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ba80926d0 msgr2=0x7f0ba81275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:47.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0bae4c5700 1 --2- 172.21.15.72:0/1325912254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ba80926d0 0x7f0ba81275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0bae4c5700 1 -- 172.21.15.72:0/1325912254 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba809a280 con 0x7f0ba812a9a0 2023-10-03T10:09:47.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0badcc4700 1 --2- 172.21.15.72:0/1325912254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ba80926d0 0x7f0ba81275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0bad4c3700 1 --2- 172.21.15.72:0/1325912254 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ba8127be0 0x7f0ba8128000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0bae4c5700 1 --2- 172.21.15.72:0/1325912254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba812a9a0 0x7f0ba812ae00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0ba0009e90 tx=0x7f0ba0009780).ready entity=mon.0 client_cookie=fab5fe4e19c1817f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0baccc2700 1 -- 172.21.15.72:0/1325912254 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba000e070 con 0x7f0ba812a9a0 2023-10-03T10:09:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0baccc2700 1 -- 172.21.15.72:0/1325912254 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba000ba70 con 0x7f0ba812a9a0 2023-10-03T10:09:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.486+0000 7f0baccc2700 1 -- 172.21.15.72:0/1325912254 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba000bdf0 con 0x7f0ba812a9a0 2023-10-03T10:09:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.487+0000 7f0baff28700 1 -- 172.21.15.72:0/1325912254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba812a9a0 msgr2=0x7f0ba812ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.487+0000 7f0baff28700 1 --2- 172.21.15.72:0/1325912254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba812a9a0 0x7f0ba812ae00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0ba0009e90 tx=0x7f0ba0009780).stop 2023-10-03T10:09:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.487+0000 7f0baff28700 1 -- 172.21.15.72:0/1325912254 shutdown_connections 2023-10-03T10:09:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.487+0000 7f0baff28700 1 --2- 172.21.15.72:0/1325912254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba812a9a0 0x7f0ba812ae00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.487+0000 7f0baff28700 1 --2- 172.21.15.72:0/1325912254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ba80926d0 0x7f0ba81275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.487+0000 7f0baff28700 1 --2- 172.21.15.72:0/1325912254 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ba8127be0 0x7f0ba8128000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.487+0000 7f0baff28700 1 -- 172.21.15.72:0/1325912254 >> 172.21.15.72:0/1325912254 conn(0x7f0ba8097480 msgr2=0x7f0ba8097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.487+0000 7f0baff28700 1 -- 172.21.15.72:0/1325912254 shutdown_connections 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.487+0000 7f0baff28700 1 -- 172.21.15.72:0/1325912254 wait complete. 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.488+0000 7f0baff28700 1 Processor -- start 2023-10-03T10:09:47.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.488+0000 7f0baff28700 1 -- start start 2023-10-03T10:09:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0baff28700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ba80926d0 0x7f0ba8124980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0baff28700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba8127be0 0x7f0ba81138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0baff28700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ba812a9a0 0x7f0ba8113db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0baff28700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba809a4b0 con 0x7f0ba8127be0 2023-10-03T10:09:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0baff28700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba8117350 con 0x7f0ba812a9a0 2023-10-03T10:09:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0baff28700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80936a0 con 0x7f0ba80926d0 2023-10-03T10:09:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0badcc4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ba80926d0 0x7f0ba8124980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0badcc4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ba80926d0 0x7f0ba8124980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38158/0 (socket says 172.21.15.72:38158) 2023-10-03T10:09:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0bae4c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ba812a9a0 0x7f0ba8113db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0badcc4700 1 -- 172.21.15.72:0/2331232740 learned_addr learned my addr 172.21.15.72:0/2331232740 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0bad4c3700 1 --2- 172.21.15.72:0/2331232740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba8127be0 0x7f0ba81138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0bae4c5700 1 -- 172.21.15.72:0/2331232740 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ba80926d0 msgr2=0x7f0ba8124980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0bae4c5700 1 --2- 172.21.15.72:0/2331232740 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ba80926d0 0x7f0ba8124980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0bae4c5700 1 -- 172.21.15.72:0/2331232740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba8127be0 msgr2=0x7f0ba81138c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0bae4c5700 1 --2- 172.21.15.72:0/2331232740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba8127be0 0x7f0ba81138c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0bae4c5700 1 -- 172.21.15.72:0/2331232740 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b98009370 con 0x7f0ba812a9a0 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0badcc4700 1 --2- 172.21.15.72:0/2331232740 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ba80926d0 0x7f0ba8124980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0bad4c3700 1 --2- 172.21.15.72:0/2331232740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba8127be0 0x7f0ba81138c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0bae4c5700 1 --2- 172.21.15.72:0/2331232740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ba812a9a0 0x7f0ba8113db0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f0ba0014000 tx=0x7f0ba809a410).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0b9dffb700 1 -- 172.21.15.72:0/2331232740 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba001d630 con 0x7f0ba812a9a0 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0b9dffb700 1 -- 172.21.15.72:0/2331232740 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba001d790 con 0x7f0ba812a9a0 2023-10-03T10:09:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0baff28700 1 -- 172.21.15.72:0/2331232740 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba40092a0 con 0x7f0ba812a9a0 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.489+0000 7f0b9dffb700 1 -- 172.21.15.72:0/2331232740 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba001db50 con 0x7f0ba812a9a0 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.490+0000 7f0baff28700 1 -- 172.21.15.72:0/2331232740 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba0009a20 con 0x7f0ba812a9a0 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.490+0000 7f0b9dffb700 1 -- 172.21.15.72:0/2331232740 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0ba0003040 con 0x7f0ba812a9a0 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.490+0000 7f0b9dffb700 1 -- 172.21.15.72:0/2331232740 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f0ba003cc90 con 0x7f0ba812a9a0 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.491+0000 7f0baff28700 1 -- 172.21.15.72:0/2331232740 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba8124f90 con 0x7f0ba812a9a0 2023-10-03T10:09:47.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.495+0000 7f0b9dffb700 1 -- 172.21.15.72:0/2331232740 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0ba0025e90 con 0x7f0ba812a9a0 2023-10-03T10:09:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:47.690+0000 7f0baff28700 1 -- 172.21.15.72:0/2331232740 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0ba805a260 con 0x7f0ba812a9a0 2023-10-03T10:09:48.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.353+0000 7f0b9dffb700 1 -- 172.21.15.72:0/2331232740 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v5) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0ba00263c0 con 0x7f0ba812a9a0 2023-10-03T10:09:48.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.355+0000 7f0baff28700 1 -- 172.21.15.72:0/2331232740 >> v1:172.21.15.72:6816/118184 conn(0x7f0b8c02bb60 legacy=0x7f0b8c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.355+0000 7f0baff28700 1 -- 172.21.15.72:0/2331232740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ba812a9a0 msgr2=0x7f0ba8113db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.355+0000 7f0baff28700 1 --2- 172.21.15.72:0/2331232740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ba812a9a0 0x7f0ba8113db0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f0ba0014000 tx=0x7f0ba809a410).stop 2023-10-03T10:09:48.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.355+0000 7f0baff28700 1 -- 172.21.15.72:0/2331232740 shutdown_connections 2023-10-03T10:09:48.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.355+0000 7f0baff28700 1 --2- 172.21.15.72:0/2331232740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ba812a9a0 0x7f0ba8113db0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.355+0000 7f0baff28700 1 --2- 172.21.15.72:0/2331232740 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ba80926d0 0x7f0ba8124980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.355+0000 7f0baff28700 1 --2- 172.21.15.72:0/2331232740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba8127be0 0x7f0ba81138c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.355+0000 7f0baff28700 1 -- 172.21.15.72:0/2331232740 >> 172.21.15.72:0/2331232740 conn(0x7f0ba8097480 msgr2=0x7f0ba8095a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.355+0000 7f0baff28700 1 -- 172.21.15.72:0/2331232740 shutdown_connections 2023-10-03T10:09:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.355+0000 7f0baff28700 1 -- 172.21.15.72:0/2331232740 wait complete. 2023-10-03T10:09:48.370 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-03T10:09:48.370 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:09:48.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.488+0000 7f3ecb776700 1 Processor -- start 2023-10-03T10:09:48.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.488+0000 7f3ecb776700 1 -- start start 2023-10-03T10:09:48.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.488+0000 7f3ecb776700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ec4127390 0x7f3ec412fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.488+0000 7f3ecb776700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ec4127fa0 0x7f3ec4132150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.488+0000 7f3ecb776700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec4091b60 con 0x7f3ec4059070 2023-10-03T10:09:48.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.488+0000 7f3ecb776700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec4059450 con 0x7f3ec4127fa0 2023-10-03T10:09:48.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.488+0000 7f3ecb776700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec40968c0 con 0x7f3ec4127390 2023-10-03T10:09:48.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.488+0000 7f3ec9d13700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ec4127fa0 0x7f3ec4132150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.488+0000 7f3ec8d11700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ec4127390 0x7f3ec412fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.489+0000 7f3ec8d11700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ec4127390 0x7f3ec412fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59126/0 (socket says 172.21.15.72:59126) 2023-10-03T10:09:48.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.489+0000 7f3ec9d13700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ec4127fa0 0x7f3ec4132150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33026/0 (socket says 172.21.15.72:33026) 2023-10-03T10:09:48.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.489+0000 7f3ec8d11700 1 -- 172.21.15.72:0/3943917563 learned_addr learned my addr 172.21.15.72:0/3943917563 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:48.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.489+0000 7f3ec9512700 1 --1- 172.21.15.72:0/3943917563 >> v1:172.21.15.72:6789/0 conn(0x7f3ec4059070 0x7f3ec4127890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40964/0 (socket says 172.21.15.72:40964) 2023-10-03T10:09:48.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.489+0000 7f3ec8d11700 1 -- 172.21.15.72:0/3943917563 >> v2:172.21.15.72:3300/0 conn(0x7f3ec4127fa0 msgr2=0x7f3ec4132150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:48.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.489+0000 7f3ec8d11700 1 --2- 172.21.15.72:0/3943917563 >> v2:172.21.15.72:3300/0 conn(0x7f3ec4127fa0 0x7f3ec4132150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.489+0000 7f3ec8d11700 1 -- 172.21.15.72:0/3943917563 >> v1:172.21.15.72:6789/0 conn(0x7f3ec4059070 legacy=0x7f3ec4127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.489+0000 7f3ec8d11700 1 -- 172.21.15.72:0/3943917563 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec4092a10 con 0x7f3ec4127390 2023-10-03T10:09:48.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.489+0000 7f3ec9d13700 1 --2- 172.21.15.72:0/3943917563 >> v2:172.21.15.72:3300/0 conn(0x7f3ec4127fa0 0x7f3ec4132150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:48.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.489+0000 7f3ec8d11700 1 --2- 172.21.15.72:0/3943917563 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ec4127390 0x7f3ec412fc50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3eb4009830 tx=0x7f3eb40090f0).ready entity=mon.2 client_cookie=fed9eecf30370e08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:48.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.489+0000 7f3ebbfff700 1 -- 172.21.15.72:0/3943917563 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb400b580 con 0x7f3ec4127390 2023-10-03T10:09:48.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.489+0000 7f3ebbfff700 1 -- 172.21.15.72:0/3943917563 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb400b6e0 con 0x7f3ec4127390 2023-10-03T10:09:48.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.489+0000 7f3ebbfff700 1 -- 172.21.15.72:0/3943917563 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb400ba80 con 0x7f3ec4127390 2023-10-03T10:09:48.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.490+0000 7f3ecb776700 1 -- 172.21.15.72:0/3943917563 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ec4127390 msgr2=0x7f3ec412fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.490+0000 7f3ecb776700 1 --2- 172.21.15.72:0/3943917563 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ec4127390 0x7f3ec412fc50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3eb4009830 tx=0x7f3eb40090f0).stop 2023-10-03T10:09:48.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.490+0000 7f3ecb776700 1 -- 172.21.15.72:0/3943917563 shutdown_connections 2023-10-03T10:09:48.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.490+0000 7f3ecb776700 1 --2- 172.21.15.72:0/3943917563 >> v2:172.21.15.72:3300/0 conn(0x7f3ec4127fa0 0x7f3ec4132150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.490+0000 7f3ecb776700 1 --2- 172.21.15.72:0/3943917563 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ec4127390 0x7f3ec412fc50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.490+0000 7f3ecb776700 1 -- 172.21.15.72:0/3943917563 >> 172.21.15.72:0/3943917563 conn(0x7f3ec4097470 msgr2=0x7f3ec4097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:48.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.490+0000 7f3ecb776700 1 -- 172.21.15.72:0/3943917563 shutdown_connections 2023-10-03T10:09:48.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.490+0000 7f3ecb776700 1 -- 172.21.15.72:0/3943917563 wait complete. 2023-10-03T10:09:48.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.490+0000 7f3ecb776700 1 Processor -- start 2023-10-03T10:09:48.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.491+0000 7f3ecb776700 1 -- start start 2023-10-03T10:09:48.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.491+0000 7f3ecb776700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ec4059070 0x7f3ec4113000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.491+0000 7f3ecb776700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ec4127390 0x7f3ec412fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.491+0000 7f3ecb776700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ec4127fa0 0x7f3ec41303c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.491+0000 7f3ecb776700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4112b70 con 0x7f3ec4127fa0 2023-10-03T10:09:48.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.491+0000 7f3ecb776700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4132160 con 0x7f3ec4127390 2023-10-03T10:09:48.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.491+0000 7f3ecb776700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4096ea0 con 0x7f3ec4059070 2023-10-03T10:09:48.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.491+0000 7f3ec9512700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ec4059070 0x7f3ec4113000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.491+0000 7f3ec8d11700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ec4127390 0x7f3ec412fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.491+0000 7f3ec9512700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ec4059070 0x7f3ec4113000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59132/0 (socket says 172.21.15.72:59132) 2023-10-03T10:09:48.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.491+0000 7f3ec8d11700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ec4127390 0x7f3ec412fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:47870/0 (socket says 172.21.15.72:47870) 2023-10-03T10:09:48.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.491+0000 7f3ec9512700 1 -- 172.21.15.72:0/4034786711 learned_addr learned my addr 172.21.15.72:0/4034786711 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:48.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.491+0000 7f3ec9d13700 1 --2- 172.21.15.72:0/4034786711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ec4127fa0 0x7f3ec41303c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.491+0000 7f3ec9512700 1 -- 172.21.15.72:0/4034786711 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ec4127390 msgr2=0x7f3ec412fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.491+0000 7f3ec9512700 1 --2- 172.21.15.72:0/4034786711 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ec4127390 0x7f3ec412fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.492+0000 7f3ec9512700 1 -- 172.21.15.72:0/4034786711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ec4127fa0 msgr2=0x7f3ec41303c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.492+0000 7f3ec9512700 1 --2- 172.21.15.72:0/4034786711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ec4127fa0 0x7f3ec41303c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.492+0000 7f3ec9512700 1 -- 172.21.15.72:0/4034786711 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc009a20 con 0x7f3ec4059070 2023-10-03T10:09:48.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.492+0000 7f3ec9d13700 1 --2- 172.21.15.72:0/4034786711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ec4127fa0 0x7f3ec41303c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:48.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.492+0000 7f3ec9512700 1 --2- 172.21.15.72:0/4034786711 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ec4059070 0x7f3ec4113000 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3ec0007fd0 tx=0x7f3ec0007df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:48.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.492+0000 7f3eb97fa700 1 -- 172.21.15.72:0/4034786711 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000ce10 con 0x7f3ec4059070 2023-10-03T10:09:48.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.492+0000 7f3eb97fa700 1 -- 172.21.15.72:0/4034786711 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec00072e0 con 0x7f3ec4059070 2023-10-03T10:09:48.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.492+0000 7f3ecb776700 1 -- 172.21.15.72:0/4034786711 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb4009370 con 0x7f3ec4059070 2023-10-03T10:09:48.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.492+0000 7f3eb97fa700 1 -- 172.21.15.72:0/4034786711 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec00056e0 con 0x7f3ec4059070 2023-10-03T10:09:48.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.492+0000 7f3ecb776700 1 -- 172.21.15.72:0/4034786711 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec4131c20 con 0x7f3ec4059070 2023-10-03T10:09:48.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.493+0000 7f3eb97fa700 1 -- 172.21.15.72:0/4034786711 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3ec0005a90 con 0x7f3ec4059070 2023-10-03T10:09:48.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.493+0000 7f3eb97fa700 1 -- 172.21.15.72:0/4034786711 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3ec003a6f0 con 0x7f3ec4059070 2023-10-03T10:09:48.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.493+0000 7f3ecb776700 1 -- 172.21.15.72:0/4034786711 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec4091d80 con 0x7f3ec4059070 2023-10-03T10:09:48.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.497+0000 7f3eb97fa700 1 -- 172.21.15.72:0/4034786711 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3ec0018030 con 0x7f3ec4059070 2023-10-03T10:09:48.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.693+0000 7f3ecb776700 1 -- 172.21.15.72:0/4034786711 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ec409a790 con 0x7f3ec4059070 2023-10-03T10:09:48.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.693+0000 7f3eb97fa700 1 -- 172.21.15.72:0/4034786711 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2154 (secure 0 0 0) 0x7f3ec0018020 con 0x7f3ec4059070 2023-10-03T10:09:48.694 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:48.694 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:46.344785+0000","modified":"2023-10-03T10:09:48.352357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6817/542674768","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6817","nonce":542674768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:09:48.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.695+0000 7f3ecb776700 1 -- 172.21.15.72:0/4034786711 >> v1:172.21.15.72:6816/118184 conn(0x7f3ea802bb60 legacy=0x7f3ea802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.695+0000 7f3ecb776700 1 -- 172.21.15.72:0/4034786711 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ec4059070 msgr2=0x7f3ec4113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.695+0000 7f3ecb776700 1 --2- 172.21.15.72:0/4034786711 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ec4059070 0x7f3ec4113000 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3ec0007fd0 tx=0x7f3ec0007df0).stop 2023-10-03T10:09:48.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.695+0000 7f3ecb776700 1 -- 172.21.15.72:0/4034786711 shutdown_connections 2023-10-03T10:09:48.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.695+0000 7f3ecb776700 1 --2- 172.21.15.72:0/4034786711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ec4127fa0 0x7f3ec41303c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.695+0000 7f3ecb776700 1 --2- 172.21.15.72:0/4034786711 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ec4059070 0x7f3ec4113000 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.695+0000 7f3ecb776700 1 --2- 172.21.15.72:0/4034786711 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ec4127390 0x7f3ec412fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.695+0000 7f3ecb776700 1 -- 172.21.15.72:0/4034786711 >> 172.21.15.72:0/4034786711 conn(0x7f3ec4097470 msgr2=0x7f3ec40952a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:48.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.695+0000 7f3ecb776700 1 -- 172.21.15.72:0/4034786711 shutdown_connections 2023-10-03T10:09:48.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.695+0000 7f3ecb776700 1 -- 172.21.15.72:0/4034786711 wait complete. 2023-10-03T10:09:48.697 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 5 2023-10-03T10:09:48.707 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:48.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.822+0000 7f8dbbd67700 1 Processor -- start 2023-10-03T10:09:48.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.822+0000 7f8dbbd67700 1 -- start start 2023-10-03T10:09:48.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.822+0000 7f8dbbd67700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8db40613a0 0x7f8db412ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.822+0000 7f8dbbd67700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8db412b2f0 0x7f8db412b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.822+0000 7f8dbbd67700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8db4095df0 0x7f8db4096270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.822+0000 7f8dbbd67700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db4061780 con 0x7f8db40613a0 2023-10-03T10:09:48.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.822+0000 7f8dbbd67700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db412abd0 con 0x7f8db412b2f0 2023-10-03T10:09:48.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.822+0000 7f8dbbd67700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8db4067530 con 0x7f8db4095df0 2023-10-03T10:09:48.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.822+0000 7f8db9b03700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8db40613a0 0x7f8db412ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.822+0000 7f8dba304700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8db4095df0 0x7f8db4096270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.822+0000 7f8db9302700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8db412b2f0 0x7f8db412b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.822+0000 7f8dba304700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8db4095df0 0x7f8db4096270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59142/0 (socket says 172.21.15.72:59142) 2023-10-03T10:09:48.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.822+0000 7f8db9b03700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8db40613a0 0x7f8db412ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33036/0 (socket says 172.21.15.72:33036) 2023-10-03T10:09:48.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.822+0000 7f8dba304700 1 -- 172.21.15.72:0/959553592 learned_addr learned my addr 172.21.15.72:0/959553592 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:48.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.822+0000 7f8db9302700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8db412b2f0 0x7f8db412b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:47878/0 (socket says 172.21.15.72:47878) 2023-10-03T10:09:48.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.823+0000 7f8db9b03700 1 -- 172.21.15.72:0/959553592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8db4095df0 msgr2=0x7f8db4096270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:48.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.823+0000 7f8db9b03700 1 --2- 172.21.15.72:0/959553592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8db4095df0 0x7f8db4096270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.823+0000 7f8db9b03700 1 -- 172.21.15.72:0/959553592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8db412b2f0 msgr2=0x7f8db412b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:48.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.823+0000 7f8db9b03700 1 --2- 172.21.15.72:0/959553592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8db412b2f0 0x7f8db412b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.823+0000 7f8db9b03700 1 -- 172.21.15.72:0/959553592 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db40683c0 con 0x7f8db40613a0 2023-10-03T10:09:48.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.823+0000 7f8db9302700 1 --2- 172.21.15.72:0/959553592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8db412b2f0 0x7f8db412b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:48.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.823+0000 7f8dba304700 1 --2- 172.21.15.72:0/959553592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8db4095df0 0x7f8db4096270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:48.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.823+0000 7f8db9b03700 1 --2- 172.21.15.72:0/959553592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8db40613a0 0x7f8db412ae00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f8da4009760 tx=0x7f8da4009060).ready entity=mon.0 client_cookie=727ff14991761970 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:48.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.823+0000 7f8db8b01700 1 -- 172.21.15.72:0/959553592 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da400d4a0 con 0x7f8db40613a0 2023-10-03T10:09:48.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.823+0000 7f8db8b01700 1 -- 172.21.15.72:0/959553592 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da400d600 con 0x7f8db40613a0 2023-10-03T10:09:48.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.823+0000 7f8db8b01700 1 -- 172.21.15.72:0/959553592 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da400d980 con 0x7f8db40613a0 2023-10-03T10:09:48.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.823+0000 7f8dbbd67700 1 -- 172.21.15.72:0/959553592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8db40613a0 msgr2=0x7f8db412ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.823+0000 7f8dbbd67700 1 --2- 172.21.15.72:0/959553592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8db40613a0 0x7f8db412ae00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f8da4009760 tx=0x7f8da4009060).stop 2023-10-03T10:09:48.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.824+0000 7f8dbbd67700 1 -- 172.21.15.72:0/959553592 shutdown_connections 2023-10-03T10:09:48.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.824+0000 7f8dbbd67700 1 --2- 172.21.15.72:0/959553592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8db4095df0 0x7f8db4096270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.824+0000 7f8dbbd67700 1 --2- 172.21.15.72:0/959553592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8db40613a0 0x7f8db412ae00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.824+0000 7f8dbbd67700 1 --2- 172.21.15.72:0/959553592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8db412b2f0 0x7f8db412b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.824+0000 7f8dbbd67700 1 -- 172.21.15.72:0/959553592 >> 172.21.15.72:0/959553592 conn(0x7f8db409a220 msgr2=0x7f8db409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:48.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.824+0000 7f8dbbd67700 1 -- 172.21.15.72:0/959553592 shutdown_connections 2023-10-03T10:09:48.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.824+0000 7f8dbbd67700 1 -- 172.21.15.72:0/959553592 wait complete. 2023-10-03T10:09:48.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.824+0000 7f8dbbd67700 1 Processor -- start 2023-10-03T10:09:48.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.824+0000 7f8dbbd67700 1 -- start start 2023-10-03T10:09:48.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8dbbd67700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8db40613a0 0x7f8db41284d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8dbbd67700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8db4095df0 0x7f8db4117410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8dbbd67700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8db412b2f0 0x7f8db4117900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:48.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8dbbd67700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db411afb0 con 0x7f8db4095df0 2023-10-03T10:09:48.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8dbbd67700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db4129730 con 0x7f8db412b2f0 2023-10-03T10:09:48.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8dbbd67700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8db4067130 con 0x7f8db40613a0 2023-10-03T10:09:48.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8db9302700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8db4095df0 0x7f8db4117410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8db9302700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8db4095df0 0x7f8db4117410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33048/0 (socket says 172.21.15.72:33048) 2023-10-03T10:09:48.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8db9302700 1 -- 172.21.15.72:0/1101507775 learned_addr learned my addr 172.21.15.72:0/1101507775 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:48.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8dba304700 1 --2- 172.21.15.72:0/1101507775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8db412b2f0 0x7f8db4117900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8db9b03700 1 --2- 172.21.15.72:0/1101507775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8db40613a0 0x7f8db41284d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:48.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8db9302700 1 -- 172.21.15.72:0/1101507775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8db40613a0 msgr2=0x7f8db41284d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8db9302700 1 --2- 172.21.15.72:0/1101507775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8db40613a0 0x7f8db41284d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8db9302700 1 -- 172.21.15.72:0/1101507775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8db412b2f0 msgr2=0x7f8db4117900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8db9302700 1 --2- 172.21.15.72:0/1101507775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8db412b2f0 0x7f8db4117900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8db9302700 1 -- 172.21.15.72:0/1101507775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac009ae0 con 0x7f8db4095df0 2023-10-03T10:09:48.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8dba304700 1 --2- 172.21.15.72:0/1101507775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8db412b2f0 0x7f8db4117900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:48.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.825+0000 7f8db9302700 1 --2- 172.21.15.72:0/1101507775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8db4095df0 0x7f8db4117410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8db000ea20 tx=0x7f8db0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:48.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.826+0000 7f8da9ffb700 1 -- 172.21.15.72:0/1101507775 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db000ee60 con 0x7f8db4095df0 2023-10-03T10:09:48.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.826+0000 7f8da9ffb700 1 -- 172.21.15.72:0/1101507775 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db000c850 con 0x7f8db4095df0 2023-10-03T10:09:48.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.826+0000 7f8dbbd67700 1 -- 172.21.15.72:0/1101507775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db00092a0 con 0x7f8db4095df0 2023-10-03T10:09:48.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.826+0000 7f8da9ffb700 1 -- 172.21.15.72:0/1101507775 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db000cbd0 con 0x7f8db4095df0 2023-10-03T10:09:48.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.826+0000 7f8dbbd67700 1 -- 172.21.15.72:0/1101507775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da40092a0 con 0x7f8db4095df0 2023-10-03T10:09:48.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.826+0000 7f8da9ffb700 1 -- 172.21.15.72:0/1101507775 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8db001b400 con 0x7f8db4095df0 2023-10-03T10:09:48.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.827+0000 7f8da9ffb700 1 -- 172.21.15.72:0/1101507775 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8db003b4c0 con 0x7f8db4095df0 2023-10-03T10:09:48.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.827+0000 7f8dbbd67700 1 -- 172.21.15.72:0/1101507775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db405a260 con 0x7f8db4095df0 2023-10-03T10:09:48.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.831+0000 7f8da9ffb700 1 -- 172.21.15.72:0/1101507775 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8db0019900 con 0x7f8db4095df0 2023-10-03T10:09:48.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.991+0000 7f8dbbd67700 1 -- 172.21.15.72:0/1101507775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8db412b080 con 0x7f8db4095df0 2023-10-03T10:09:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.992+0000 7f8da9ffb700 1 -- 172.21.15.72:0/1101507775 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f8db0019310 con 0x7f8db4095df0 2023-10-03T10:09:48.993 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:48.993 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:09:47.346977+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:48.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.994+0000 7f8dbbd67700 1 -- 172.21.15.72:0/1101507775 >> v1:172.21.15.72:6816/118184 conn(0x7f8d9802bb90 legacy=0x7f8d9802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.994+0000 7f8dbbd67700 1 -- 172.21.15.72:0/1101507775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8db4095df0 msgr2=0x7f8db4117410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:48.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.994+0000 7f8dbbd67700 1 --2- 172.21.15.72:0/1101507775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8db4095df0 0x7f8db4117410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f8db000ea20 tx=0x7f8db0009060).stop 2023-10-03T10:09:48.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.994+0000 7f8dbbd67700 1 -- 172.21.15.72:0/1101507775 shutdown_connections 2023-10-03T10:09:48.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.994+0000 7f8dbbd67700 1 --2- 172.21.15.72:0/1101507775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8db412b2f0 0x7f8db4117900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.994+0000 7f8dbbd67700 1 --2- 172.21.15.72:0/1101507775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8db40613a0 0x7f8db41284d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.994+0000 7f8dbbd67700 1 --2- 172.21.15.72:0/1101507775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8db4095df0 0x7f8db4117410 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:48.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.994+0000 7f8dbbd67700 1 -- 172.21.15.72:0/1101507775 >> 172.21.15.72:0/1101507775 conn(0x7f8db409a220 msgr2=0x7f8db4098900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:48.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.994+0000 7f8dbbd67700 1 -- 172.21.15.72:0/1101507775 shutdown_connections 2023-10-03T10:09:48.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:48.994+0000 7f8dbbd67700 1 -- 172.21.15.72:0/1101507775 wait complete. 2023-10-03T10:09:49.007 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-03T10:09:49.007 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:49.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.122+0000 7f941c4c1700 1 Processor -- start 2023-10-03T10:09:49.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.122+0000 7f941c4c1700 1 -- start start 2023-10-03T10:09:49.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.122+0000 7f941c4c1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9414066200 0x7f94140977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.122+0000 7f941c4c1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94141281c0 0x7f941412b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.122+0000 7f941c4c1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9414065740 con 0x7f9414127dc0 2023-10-03T10:09:49.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.122+0000 7f941c4c1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94140653a0 con 0x7f9414066200 2023-10-03T10:09:49.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.122+0000 7f941c4c1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9414064ef0 con 0x7f94141281c0 2023-10-03T10:09:49.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.122+0000 7f941aa5e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94141281c0 0x7f941412b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.122+0000 7f941a25d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9414066200 0x7f94140977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.122+0000 7f941aa5e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94141281c0 0x7f941412b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59172/0 (socket says 172.21.15.72:59172) 2023-10-03T10:09:49.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.122+0000 7f941aa5e700 1 -- 172.21.15.72:0/3293088483 learned_addr learned my addr 172.21.15.72:0/3293088483 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:49.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.122+0000 7f941a25d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9414066200 0x7f94140977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33064/0 (socket says 172.21.15.72:33064) 2023-10-03T10:09:49.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.122+0000 7f9419a5c700 1 --1- 172.21.15.72:0/3293088483 >> v1:172.21.15.72:6789/0 conn(0x7f9414127dc0 0x7f941412aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40968/0 (socket says 172.21.15.72:40968) 2023-10-03T10:09:49.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.123+0000 7f941a25d700 1 -- 172.21.15.72:0/3293088483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94141281c0 msgr2=0x7f941412b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:49.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.123+0000 7f941a25d700 1 --2- 172.21.15.72:0/3293088483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94141281c0 0x7f941412b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.123+0000 7f941a25d700 1 -- 172.21.15.72:0/3293088483 >> v1:172.21.15.72:6789/0 conn(0x7f9414127dc0 legacy=0x7f941412aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.123+0000 7f941925b700 1 -- 172.21.15.72:0/3293088483 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238280868 0 0) 0x7f9414065740 con 0x7f9414127dc0 2023-10-03T10:09:49.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.123+0000 7f941a25d700 1 -- 172.21.15.72:0/3293088483 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414064a40 con 0x7f9414066200 2023-10-03T10:09:49.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.123+0000 7f941a25d700 1 --2- 172.21.15.72:0/3293088483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9414066200 0x7f94140977a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9410009760 tx=0x7f9410009060).ready entity=mon.0 client_cookie=ccf9cd6914557e18 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:49.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.123+0000 7f941925b700 1 -- 172.21.15.72:0/3293088483 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941000f510 con 0x7f9414066200 2023-10-03T10:09:49.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.123+0000 7f941925b700 1 -- 172.21.15.72:0/3293088483 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941000f670 con 0x7f9414066200 2023-10-03T10:09:49.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.123+0000 7f941925b700 1 -- 172.21.15.72:0/3293088483 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941000f9f0 con 0x7f9414066200 2023-10-03T10:09:49.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.123+0000 7f941c4c1700 1 -- 172.21.15.72:0/3293088483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9414066200 msgr2=0x7f94140977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.123+0000 7f941c4c1700 1 --2- 172.21.15.72:0/3293088483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9414066200 0x7f94140977a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9410009760 tx=0x7f9410009060).stop 2023-10-03T10:09:49.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.124+0000 7f941c4c1700 1 -- 172.21.15.72:0/3293088483 shutdown_connections 2023-10-03T10:09:49.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.124+0000 7f941c4c1700 1 --2- 172.21.15.72:0/3293088483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94141281c0 0x7f941412b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.124+0000 7f941c4c1700 1 --2- 172.21.15.72:0/3293088483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9414066200 0x7f94140977a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.124+0000 7f941c4c1700 1 -- 172.21.15.72:0/3293088483 >> 172.21.15.72:0/3293088483 conn(0x7f941409ba50 msgr2=0x7f941409be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:49.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.124+0000 7f941c4c1700 1 -- 172.21.15.72:0/3293088483 shutdown_connections 2023-10-03T10:09:49.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.124+0000 7f941c4c1700 1 -- 172.21.15.72:0/3293088483 wait complete. 2023-10-03T10:09:49.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.124+0000 7f941c4c1700 1 Processor -- start 2023-10-03T10:09:49.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.124+0000 7f941c4c1700 1 -- start start 2023-10-03T10:09:49.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941c4c1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9414066200 0x7f94141178c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941c4c1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9414127dc0 0x7f94141249f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941c4c1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94141281c0 0x7f94141138e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941c4c1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94141268b0 con 0x7f9414127dc0 2023-10-03T10:09:49.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941c4c1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9414065120 con 0x7f9414066200 2023-10-03T10:09:49.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941c4c1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94141173c0 con 0x7f94141281c0 2023-10-03T10:09:49.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941a25d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9414066200 0x7f94141178c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941aa5e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94141281c0 0x7f94141138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941aa5e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94141281c0 0x7f94141138e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59186/0 (socket says 172.21.15.72:59186) 2023-10-03T10:09:49.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941a25d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9414066200 0x7f94141178c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:47900/0 (socket says 172.21.15.72:47900) 2023-10-03T10:09:49.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941aa5e700 1 -- 172.21.15.72:0/4037029543 learned_addr learned my addr 172.21.15.72:0/4037029543 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:49.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f9419a5c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9414127dc0 0x7f94141249f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941aa5e700 1 -- 172.21.15.72:0/4037029543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9414066200 msgr2=0x7f94141178c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941aa5e700 1 --2- 172.21.15.72:0/4037029543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9414066200 0x7f94141178c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941aa5e700 1 -- 172.21.15.72:0/4037029543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9414127dc0 msgr2=0x7f94141249f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941aa5e700 1 --2- 172.21.15.72:0/4037029543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9414127dc0 0x7f94141249f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941aa5e700 1 -- 172.21.15.72:0/4037029543 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94100092a0 con 0x7f94141281c0 2023-10-03T10:09:49.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f9419a5c700 1 --2- 172.21.15.72:0/4037029543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9414127dc0 0x7f94141249f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:49.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941aa5e700 1 --2- 172.21.15.72:0/4037029543 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94141281c0 0x7f94141138e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f940c009e20 tx=0x7f940c00b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:49.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f940a7fc700 1 -- 172.21.15.72:0/4037029543 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c009b80 con 0x7f94141281c0 2023-10-03T10:09:49.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f940a7fc700 1 -- 172.21.15.72:0/4037029543 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c00f040 con 0x7f94141281c0 2023-10-03T10:09:49.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f941c4c1700 1 -- 172.21.15.72:0/4037029543 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94141154b0 con 0x7f94141281c0 2023-10-03T10:09:49.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.125+0000 7f940a7fc700 1 -- 172.21.15.72:0/4037029543 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c00cac0 con 0x7f94141281c0 2023-10-03T10:09:49.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.126+0000 7f941c4c1700 1 -- 172.21.15.72:0/4037029543 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94141250a0 con 0x7f94141281c0 2023-10-03T10:09:49.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.126+0000 7f940a7fc700 1 -- 172.21.15.72:0/4037029543 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f940c014410 con 0x7f94141281c0 2023-10-03T10:09:49.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.126+0000 7f940a7fc700 1 -- 172.21.15.72:0/4037029543 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f940c03b150 con 0x7f94141281c0 2023-10-03T10:09:49.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.127+0000 7f941c4c1700 1 -- 172.21.15.72:0/4037029543 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9414117200 con 0x7f94141281c0 2023-10-03T10:09:49.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.131+0000 7f940a7fc700 1 -- 172.21.15.72:0/4037029543 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f940c01b900 con 0x7f94141281c0 2023-10-03T10:09:49.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.285+0000 7f941c4c1700 1 -- 172.21.15.72:0/4037029543 --> v1:172.21.15.72:6816/118184 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f941405a260 con 0x7f93f802bb60 2023-10-03T10:09:49.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.291+0000 7f940a7fc700 1 -- 172.21.15.72:0/4037029543 <== mgr.4102 v1:172.21.15.72:6816/118184 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+242428 (unknown 2965378022 0 1206251847) 0x7f941405a260 con 0x7f93f802bb60 2023-10-03T10:09:49.295 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:49.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.294+0000 7f941c4c1700 1 -- 172.21.15.72:0/4037029543 >> v1:172.21.15.72:6816/118184 conn(0x7f93f802bb60 legacy=0x7f93f802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.294+0000 7f941c4c1700 1 -- 172.21.15.72:0/4037029543 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94141281c0 msgr2=0x7f94141138e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.294+0000 7f941c4c1700 1 --2- 172.21.15.72:0/4037029543 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94141281c0 0x7f94141138e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f940c009e20 tx=0x7f940c00b040).stop 2023-10-03T10:09:49.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.294+0000 7f941c4c1700 1 -- 172.21.15.72:0/4037029543 shutdown_connections 2023-10-03T10:09:49.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.294+0000 7f941c4c1700 1 --2- 172.21.15.72:0/4037029543 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94141281c0 0x7f94141138e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.294+0000 7f941c4c1700 1 --2- 172.21.15.72:0/4037029543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9414066200 0x7f94141178c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.294+0000 7f941c4c1700 1 --2- 172.21.15.72:0/4037029543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9414127dc0 0x7f94141249f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.294+0000 7f941c4c1700 1 -- 172.21.15.72:0/4037029543 >> 172.21.15.72:0/4037029543 conn(0x7f941409ba50 msgr2=0x7f941412aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:49.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.294+0000 7f941c4c1700 1 -- 172.21.15.72:0/4037029543 shutdown_connections 2023-10-03T10:09:49.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.294+0000 7f941c4c1700 1 -- 172.21.15.72:0/4037029543 wait complete. 2023-10-03T10:09:49.298 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-03T10:09:49.306 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-03T10:09:47.878588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188820,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298540,"statfs":{"total":386547056640,"available":385329704960,"internally_reserved":0,"allocated":446464,"data_stored":116479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:42.506310+0000","last_change":"2023-10-03T10:09:42.503202+0000","last_active":"2023-10-03T10:09:42.506310+0000","last_peered":"2023-10-03T10:09:42.506310+0000","last_clean":"2023-10-03T10:09:42.506310+0000","last_became_active":"2023-10-03T10:09:42.502700+0000","last_became_peered":"2023-10-03T10:09:42.502700+0000","last_unstale":"2023-10-03T10:09:42.506310+0000","last_undegraded":"2023-10-03T10:09:42.506310+0000","last_fullsized":"2023-10-03T10:09:42.506310+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.947968+0000","last_change":"2023-10-03T10:09:41.940609+0000","last_active":"2023-10-03T10:09:41.947968+0000","last_peered":"2023-10-03T10:09:41.947968+0000","last_clean":"2023-10-03T10:09:41.947968+0000","last_became_active":"2023-10-03T10:09:41.940313+0000","last_became_peered":"2023-10-03T10:09:41.940313+0000","last_unstale":"2023-10-03T10:09:41.947968+0000","last_undegraded":"2023-10-03T10:09:41.947968+0000","last_fullsized":"2023-10-03T10:09:41.947968+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.945324+0000","last_change":"2023-10-03T10:09:41.940436+0000","last_active":"2023-10-03T10:09:41.945324+0000","last_peered":"2023-10-03T10:09:41.945324+0000","last_clean":"2023-10-03T10:09:41.945324+0000","last_became_active":"2023-10-03T10:09:41.940147+0000","last_became_peered":"2023-10-03T10:09:41.940147+0000","last_unstale":"2023-10-03T10:09:41.945324+0000","last_undegraded":"2023-10-03T10:09:41.945324+0000","last_fullsized":"2023-10-03T10:09:41.945324+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.948007+0000","last_change":"2023-10-03T10:09:41.941185+0000","last_active":"2023-10-03T10:09:41.948007+0000","last_peered":"2023-10-03T10:09:41.948007+0000","last_clean":"2023-10-03T10:09:41.948007+0000","last_became_active":"2023-10-03T10:09:41.940930+0000","last_became_peered":"2023-10-03T10:09:41.940930+0000","last_unstale":"2023-10-03T10:09:41.948007+0000","last_undegraded":"2023-10-03T10:09:41.948007+0000","last_fullsized":"2023-10-03T10:09:41.948007+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.937491+0000","last_change":"2023-10-03T10:09:40.948442+0000","last_active":"2023-10-03T10:09:41.937491+0000","last_peered":"2023-10-03T10:09:41.937491+0000","last_clean":"2023-10-03T10:09:41.937491+0000","last_became_active":"2023-10-03T10:09:40.948068+0000","last_became_peered":"2023-10-03T10:09:40.948068+0000","last_unstale":"2023-10-03T10:09:41.937491+0000","last_undegraded":"2023-10-03T10:09:41.937491+0000","last_fullsized":"2023-10-03T10:09:41.937491+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_clean_scrub_stamp":"2023-10-03T10:09:39.928111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.947965+0000","last_change":"2023-10-03T10:09:41.940561+0000","last_active":"2023-10-03T10:09:41.947965+0000","last_peered":"2023-10-03T10:09:41.947965+0000","last_clean":"2023-10-03T10:09:41.947965+0000","last_became_active":"2023-10-03T10:09:41.940202+0000","last_became_peered":"2023-10-03T10:09:41.940202+0000","last_unstale":"2023-10-03T10:09:41.947965+0000","last_undegraded":"2023-10-03T10:09:41.947965+0000","last_fullsized":"2023-10-03T10:09:41.947965+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:42.506148+0000","last_change":"2023-10-03T10:09:42.502984+0000","last_active":"2023-10-03T10:09:42.506148+0000","last_peered":"2023-10-03T10:09:42.506148+0000","last_clean":"2023-10-03T10:09:42.506148+0000","last_became_active":"2023-10-03T10:09:42.502699+0000","last_became_peered":"2023-10-03T10:09:42.502699+0000","last_unstale":"2023-10-03T10:09:42.506148+0000","last_undegraded":"2023-10-03T10:09:42.506148+0000","last_fullsized":"2023-10-03T10:09:42.506148+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:42.506059+0000","last_change":"2023-10-03T10:09:42.503022+0000","last_active":"2023-10-03T10:09:42.506059+0000","last_peered":"2023-10-03T10:09:42.506059+0000","last_clean":"2023-10-03T10:09:42.506059+0000","last_became_active":"2023-10-03T10:09:42.502739+0000","last_became_peered":"2023-10-03T10:09:42.502739+0000","last_unstale":"2023-10-03T10:09:42.506059+0000","last_undegraded":"2023-10-03T10:09:42.506059+0000","last_fullsized":"2023-10-03T10:09:42.506059+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:42.506333+0000","last_change":"2023-10-03T10:09:42.503368+0000","last_active":"2023-10-03T10:09:42.506333+0000","last_peered":"2023-10-03T10:09:42.506333+0000","last_clean":"2023-10-03T10:09:42.506333+0000","last_became_active":"2023-10-03T10:09:42.503090+0000","last_became_peered":"2023-10-03T10:09:42.503090+0000","last_unstale":"2023-10-03T10:09:42.506333+0000","last_undegraded":"2023-10-03T10:09:42.506333+0000","last_fullsized":"2023-10-03T10:09:42.506333+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297196,"kb_used_data":100,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074644,"statfs":{"total":96636764160,"available":96332435456,"internally_reserved":0,"allocated":102400,"data_stored":25867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]}]},{"osd":1,"up_from":9,"seq":38654705666,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:49.313 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:49.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.461+0000 7f9b029ed700 1 Processor -- start 2023-10-03T10:09:49.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.461+0000 7f9b029ed700 1 -- start start 2023-10-03T10:09:49.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.461+0000 7f9b029ed700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9afc096bc0 0x7f9afc125160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.461+0000 7f9b029ed700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9afc125780 0x7f9afc125b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.461+0000 7f9b029ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9afc093bf0 0x7f9afc094080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.461+0000 7f9b029ed700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9afc096120 con 0x7f9afc096bc0 2023-10-03T10:09:49.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.461+0000 7f9b029ed700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc0956a0 con 0x7f9afc093bf0 2023-10-03T10:09:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.461+0000 7f9b029ed700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc126050 con 0x7f9afc125780 2023-10-03T10:09:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9afbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9afc096bc0 0x7f9afc125160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9afb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9afc125780 0x7f9afc125b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9b00f8a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9afc093bf0 0x7f9afc094080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9afbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9afc096bc0 0x7f9afc125160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33088/0 (socket says 172.21.15.72:33088) 2023-10-03T10:09:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9b00f8a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9afc093bf0 0x7f9afc094080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:47910/0 (socket says 172.21.15.72:47910) 2023-10-03T10:09:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9afbfff700 1 -- 172.21.15.72:0/4109098032 learned_addr learned my addr 172.21.15.72:0/4109098032 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9afb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9afc125780 0x7f9afc125b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59194/0 (socket says 172.21.15.72:59194) 2023-10-03T10:09:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9afb7fe700 1 -- 172.21.15.72:0/4109098032 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9afc093bf0 msgr2=0x7f9afc094080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9afb7fe700 1 --2- 172.21.15.72:0/4109098032 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9afc093bf0 0x7f9afc094080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9afb7fe700 1 -- 172.21.15.72:0/4109098032 >> v2:172.21.15.72:3300/0 conn(0x7f9afc096bc0 msgr2=0x7f9afc125160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:49.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9afb7fe700 1 --2- 172.21.15.72:0/4109098032 >> v2:172.21.15.72:3300/0 conn(0x7f9afc096bc0 0x7f9afc125160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9afb7fe700 1 -- 172.21.15.72:0/4109098032 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc096fa0 con 0x7f9afc125780 2023-10-03T10:09:49.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9afbfff700 1 --2- 172.21.15.72:0/4109098032 >> v2:172.21.15.72:3300/0 conn(0x7f9afc096bc0 0x7f9afc125160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:49.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9afb7fe700 1 --2- 172.21.15.72:0/4109098032 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9afc125780 0x7f9afc125b60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9aec009760 tx=0x7f9aec009060).ready entity=mon.2 client_cookie=d076c9620b66c2a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:49.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9afaffd700 1 -- 172.21.15.72:0/4109098032 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00d4a0 con 0x7f9afc125780 2023-10-03T10:09:49.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9afaffd700 1 -- 172.21.15.72:0/4109098032 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec00d600 con 0x7f9afc125780 2023-10-03T10:09:49.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.462+0000 7f9afaffd700 1 -- 172.21.15.72:0/4109098032 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00d980 con 0x7f9afc125780 2023-10-03T10:09:49.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.463+0000 7f9b029ed700 1 -- 172.21.15.72:0/4109098032 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9afc125780 msgr2=0x7f9afc125b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.463+0000 7f9b029ed700 1 --2- 172.21.15.72:0/4109098032 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9afc125780 0x7f9afc125b60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9aec009760 tx=0x7f9aec009060).stop 2023-10-03T10:09:49.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.463+0000 7f9b029ed700 1 -- 172.21.15.72:0/4109098032 shutdown_connections 2023-10-03T10:09:49.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.463+0000 7f9b029ed700 1 --2- 172.21.15.72:0/4109098032 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9afc093bf0 0x7f9afc094080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.463+0000 7f9b029ed700 1 --2- 172.21.15.72:0/4109098032 >> v2:172.21.15.72:3300/0 conn(0x7f9afc096bc0 0x7f9afc125160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.463+0000 7f9b029ed700 1 --2- 172.21.15.72:0/4109098032 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9afc125780 0x7f9afc125b60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.463+0000 7f9b029ed700 1 -- 172.21.15.72:0/4109098032 >> 172.21.15.72:0/4109098032 conn(0x7f9afc097470 msgr2=0x7f9afc097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:49.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.463+0000 7f9b029ed700 1 -- 172.21.15.72:0/4109098032 shutdown_connections 2023-10-03T10:09:49.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.463+0000 7f9b029ed700 1 -- 172.21.15.72:0/4109098032 wait complete. 2023-10-03T10:09:49.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.463+0000 7f9b029ed700 1 Processor -- start 2023-10-03T10:09:49.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.464+0000 7f9b029ed700 1 -- start start 2023-10-03T10:09:49.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.464+0000 7f9b029ed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9afc093bf0 0x7f9afc091c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.464+0000 7f9b029ed700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9afc096bc0 0x7f9afc092170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.464+0000 7f9b029ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9afc125780 0x7f9afc092660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.464+0000 7f9b029ed700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc124d20 con 0x7f9afc093bf0 2023-10-03T10:09:49.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.464+0000 7f9b029ed700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc115f40 con 0x7f9afc125780 2023-10-03T10:09:49.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.464+0000 7f9b029ed700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc0919e0 con 0x7f9afc096bc0 2023-10-03T10:09:49.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.464+0000 7f9afb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9afc096bc0 0x7f9afc092170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.464+0000 7f9afbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9afc093bf0 0x7f9afc091c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.464+0000 7f9afb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9afc096bc0 0x7f9afc092170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59206/0 (socket says 172.21.15.72:59206) 2023-10-03T10:09:49.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.464+0000 7f9afb7fe700 1 -- 172.21.15.72:0/190435444 learned_addr learned my addr 172.21.15.72:0/190435444 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:49.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.464+0000 7f9afbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9afc093bf0 0x7f9afc091c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33096/0 (socket says 172.21.15.72:33096) 2023-10-03T10:09:49.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.464+0000 7f9b00f8a700 1 --2- 172.21.15.72:0/190435444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9afc125780 0x7f9afc092660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.464+0000 7f9afb7fe700 1 -- 172.21.15.72:0/190435444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9afc125780 msgr2=0x7f9afc092660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.465+0000 7f9afb7fe700 1 --2- 172.21.15.72:0/190435444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9afc125780 0x7f9afc092660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.465+0000 7f9afb7fe700 1 -- 172.21.15.72:0/190435444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9afc093bf0 msgr2=0x7f9afc091c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.465+0000 7f9afb7fe700 1 --2- 172.21.15.72:0/190435444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9afc093bf0 0x7f9afc091c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.465+0000 7f9afb7fe700 1 -- 172.21.15.72:0/190435444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af0009370 con 0x7f9afc096bc0 2023-10-03T10:09:49.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.465+0000 7f9afbfff700 1 --2- 172.21.15.72:0/190435444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9afc093bf0 0x7f9afc091c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.465+0000 7f9b00f8a700 1 --2- 172.21.15.72:0/190435444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9afc125780 0x7f9afc092660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.465+0000 7f9afb7fe700 1 --2- 172.21.15.72:0/190435444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9afc096bc0 0x7f9afc092170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9aec009d50 tx=0x7f9aec016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.465+0000 7f9ae3fff700 1 -- 172.21.15.72:0/190435444 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00dd30 con 0x7f9afc096bc0 2023-10-03T10:09:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.465+0000 7f9ae3fff700 1 -- 172.21.15.72:0/190435444 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec00de90 con 0x7f9afc096bc0 2023-10-03T10:09:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.465+0000 7f9ae3fff700 1 -- 172.21.15.72:0/190435444 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00d980 con 0x7f9afc096bc0 2023-10-03T10:09:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.465+0000 7f9b029ed700 1 -- 172.21.15.72:0/190435444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aec0092a0 con 0x7f9afc096bc0 2023-10-03T10:09:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.465+0000 7f9b029ed700 1 -- 172.21.15.72:0/190435444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9afc069ac0 con 0x7f9afc096bc0 2023-10-03T10:09:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.465+0000 7f9ae3fff700 1 -- 172.21.15.72:0/190435444 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9aec01d640 con 0x7f9afc096bc0 2023-10-03T10:09:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.466+0000 7f9ae3fff700 1 -- 172.21.15.72:0/190435444 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9aec03c570 con 0x7f9afc096bc0 2023-10-03T10:09:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.466+0000 7f9b029ed700 1 -- 172.21.15.72:0/190435444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9afc069ce0 con 0x7f9afc096bc0 2023-10-03T10:09:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.470+0000 7f9ae3fff700 1 -- 172.21.15.72:0/190435444 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9aec01d8f0 con 0x7f9afc096bc0 2023-10-03T10:09:49.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.622+0000 7f9b029ed700 1 -- 172.21.15.72:0/190435444 --> v1:172.21.15.72:6816/118184 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9afc115bc0 con 0x7f9ae802bb60 2023-10-03T10:09:49.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.628+0000 7f9ae3fff700 1 -- 172.21.15.72:0/190435444 <== mgr.4102 v1:172.21.15.72:6816/118184 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+242428 (unknown 2965378022 0 1206251847) 0x7f9af0009d00 con 0x7f9ae802bb60 2023-10-03T10:09:49.631 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:49.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.631+0000 7f9b029ed700 1 -- 172.21.15.72:0/190435444 >> v1:172.21.15.72:6816/118184 conn(0x7f9ae802bb60 legacy=0x7f9ae802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.631+0000 7f9b029ed700 1 -- 172.21.15.72:0/190435444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9afc096bc0 msgr2=0x7f9afc092170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.631+0000 7f9b029ed700 1 --2- 172.21.15.72:0/190435444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9afc096bc0 0x7f9afc092170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9aec009d50 tx=0x7f9aec016000).stop 2023-10-03T10:09:49.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.631+0000 7f9b029ed700 1 -- 172.21.15.72:0/190435444 shutdown_connections 2023-10-03T10:09:49.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.631+0000 7f9b029ed700 1 --2- 172.21.15.72:0/190435444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9afc093bf0 0x7f9afc091c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.631+0000 7f9b029ed700 1 --2- 172.21.15.72:0/190435444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9afc125780 0x7f9afc092660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.631+0000 7f9b029ed700 1 --2- 172.21.15.72:0/190435444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9afc096bc0 0x7f9afc092170 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.631+0000 7f9b029ed700 1 -- 172.21.15.72:0/190435444 >> 172.21.15.72:0/190435444 conn(0x7f9afc097470 msgr2=0x7f9afc1276d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:49.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.631+0000 7f9b029ed700 1 -- 172.21.15.72:0/190435444 shutdown_connections 2023-10-03T10:09:49.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.631+0000 7f9b029ed700 1 -- 172.21.15.72:0/190435444 wait complete. 2023-10-03T10:09:49.635 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-03T10:09:49.643 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-03T10:09:47.878588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188820,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298540,"statfs":{"total":386547056640,"available":385329704960,"internally_reserved":0,"allocated":446464,"data_stored":116479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:42.506310+0000","last_change":"2023-10-03T10:09:42.503202+0000","last_active":"2023-10-03T10:09:42.506310+0000","last_peered":"2023-10-03T10:09:42.506310+0000","last_clean":"2023-10-03T10:09:42.506310+0000","last_became_active":"2023-10-03T10:09:42.502700+0000","last_became_peered":"2023-10-03T10:09:42.502700+0000","last_unstale":"2023-10-03T10:09:42.506310+0000","last_undegraded":"2023-10-03T10:09:42.506310+0000","last_fullsized":"2023-10-03T10:09:42.506310+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.947968+0000","last_change":"2023-10-03T10:09:41.940609+0000","last_active":"2023-10-03T10:09:41.947968+0000","last_peered":"2023-10-03T10:09:41.947968+0000","last_clean":"2023-10-03T10:09:41.947968+0000","last_became_active":"2023-10-03T10:09:41.940313+0000","last_became_peered":"2023-10-03T10:09:41.940313+0000","last_unstale":"2023-10-03T10:09:41.947968+0000","last_undegraded":"2023-10-03T10:09:41.947968+0000","last_fullsized":"2023-10-03T10:09:41.947968+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.945324+0000","last_change":"2023-10-03T10:09:41.940436+0000","last_active":"2023-10-03T10:09:41.945324+0000","last_peered":"2023-10-03T10:09:41.945324+0000","last_clean":"2023-10-03T10:09:41.945324+0000","last_became_active":"2023-10-03T10:09:41.940147+0000","last_became_peered":"2023-10-03T10:09:41.940147+0000","last_unstale":"2023-10-03T10:09:41.945324+0000","last_undegraded":"2023-10-03T10:09:41.945324+0000","last_fullsized":"2023-10-03T10:09:41.945324+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.948007+0000","last_change":"2023-10-03T10:09:41.941185+0000","last_active":"2023-10-03T10:09:41.948007+0000","last_peered":"2023-10-03T10:09:41.948007+0000","last_clean":"2023-10-03T10:09:41.948007+0000","last_became_active":"2023-10-03T10:09:41.940930+0000","last_became_peered":"2023-10-03T10:09:41.940930+0000","last_unstale":"2023-10-03T10:09:41.948007+0000","last_undegraded":"2023-10-03T10:09:41.948007+0000","last_fullsized":"2023-10-03T10:09:41.948007+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.937491+0000","last_change":"2023-10-03T10:09:40.948442+0000","last_active":"2023-10-03T10:09:41.937491+0000","last_peered":"2023-10-03T10:09:41.937491+0000","last_clean":"2023-10-03T10:09:41.937491+0000","last_became_active":"2023-10-03T10:09:40.948068+0000","last_became_peered":"2023-10-03T10:09:40.948068+0000","last_unstale":"2023-10-03T10:09:41.937491+0000","last_undegraded":"2023-10-03T10:09:41.937491+0000","last_fullsized":"2023-10-03T10:09:41.937491+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_clean_scrub_stamp":"2023-10-03T10:09:39.928111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.947965+0000","last_change":"2023-10-03T10:09:41.940561+0000","last_active":"2023-10-03T10:09:41.947965+0000","last_peered":"2023-10-03T10:09:41.947965+0000","last_clean":"2023-10-03T10:09:41.947965+0000","last_became_active":"2023-10-03T10:09:41.940202+0000","last_became_peered":"2023-10-03T10:09:41.940202+0000","last_unstale":"2023-10-03T10:09:41.947965+0000","last_undegraded":"2023-10-03T10:09:41.947965+0000","last_fullsized":"2023-10-03T10:09:41.947965+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:42.506148+0000","last_change":"2023-10-03T10:09:42.502984+0000","last_active":"2023-10-03T10:09:42.506148+0000","last_peered":"2023-10-03T10:09:42.506148+0000","last_clean":"2023-10-03T10:09:42.506148+0000","last_became_active":"2023-10-03T10:09:42.502699+0000","last_became_peered":"2023-10-03T10:09:42.502699+0000","last_unstale":"2023-10-03T10:09:42.506148+0000","last_undegraded":"2023-10-03T10:09:42.506148+0000","last_fullsized":"2023-10-03T10:09:42.506148+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:42.506059+0000","last_change":"2023-10-03T10:09:42.503022+0000","last_active":"2023-10-03T10:09:42.506059+0000","last_peered":"2023-10-03T10:09:42.506059+0000","last_clean":"2023-10-03T10:09:42.506059+0000","last_became_active":"2023-10-03T10:09:42.502739+0000","last_became_peered":"2023-10-03T10:09:42.502739+0000","last_unstale":"2023-10-03T10:09:42.506059+0000","last_undegraded":"2023-10-03T10:09:42.506059+0000","last_fullsized":"2023-10-03T10:09:42.506059+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:42.506333+0000","last_change":"2023-10-03T10:09:42.503368+0000","last_active":"2023-10-03T10:09:42.506333+0000","last_peered":"2023-10-03T10:09:42.506333+0000","last_clean":"2023-10-03T10:09:42.506333+0000","last_became_active":"2023-10-03T10:09:42.503090+0000","last_became_peered":"2023-10-03T10:09:42.503090+0000","last_unstale":"2023-10-03T10:09:42.506333+0000","last_undegraded":"2023-10-03T10:09:42.506333+0000","last_fullsized":"2023-10-03T10:09:42.506333+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297196,"kb_used_data":100,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074644,"statfs":{"total":96636764160,"available":96332435456,"internally_reserved":0,"allocated":102400,"data_stored":25867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]}]},{"osd":1,"up_from":9,"seq":38654705666,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:49.648 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:49.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.798+0000 7fb45df30700 1 Processor -- start 2023-10-03T10:09:49.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.798+0000 7fb45df30700 1 -- start start 2023-10-03T10:09:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb45df30700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb458096380 0x7fb458094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb45df30700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb458094c20 0x7fb458127d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb45df30700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb458096760 con 0x7fb458091b00 2023-10-03T10:09:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb45df30700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb458091ff0 con 0x7fb458096380 2023-10-03T10:09:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb45df30700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb458092c80 con 0x7fb458094c20 2023-10-03T10:09:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb4577fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb458096380 0x7fb458094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb457fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb458094c20 0x7fb458127d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb456ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb458091b00 0x7fb458127600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40984/0 (socket says 172.21.15.72:40984) 2023-10-03T10:09:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb456ffd700 1 -- 172.21.15.72:0/2242231630 learned_addr learned my addr 172.21.15.72:0/2242231630 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb457fff700 1 -- 172.21.15.72:0/2242231630 >> v2:172.21.15.72:3300/0 conn(0x7fb458096380 msgr2=0x7fb458094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb457fff700 1 --2- 172.21.15.72:0/2242231630 >> v2:172.21.15.72:3300/0 conn(0x7fb458096380 0x7fb458094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb457fff700 1 -- 172.21.15.72:0/2242231630 >> v1:172.21.15.72:6789/0 conn(0x7fb458091b00 legacy=0x7fb458127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb457fff700 1 -- 172.21.15.72:0/2242231630 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb458093900 con 0x7fb458094c20 2023-10-03T10:09:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb4577fe700 1 --2- 172.21.15.72:0/2242231630 >> v2:172.21.15.72:3300/0 conn(0x7fb458096380 0x7fb458094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:49.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb457fff700 1 --2- 172.21.15.72:0/2242231630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb458094c20 0x7fb458127d10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb450009e60 tx=0x7fb450009780).ready entity=mon.1 client_cookie=a273472e72c1d11e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:49.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb4567fc700 1 -- 172.21.15.72:0/2242231630 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45000e070 con 0x7fb458094c20 2023-10-03T10:09:49.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb4567fc700 1 -- 172.21.15.72:0/2242231630 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45000bb60 con 0x7fb458094c20 2023-10-03T10:09:49.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.799+0000 7fb4567fc700 1 -- 172.21.15.72:0/2242231630 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450012410 con 0x7fb458094c20 2023-10-03T10:09:49.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.800+0000 7fb45df30700 1 -- 172.21.15.72:0/2242231630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb458094c20 msgr2=0x7fb458127d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.800+0000 7fb45df30700 1 --2- 172.21.15.72:0/2242231630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb458094c20 0x7fb458127d10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb450009e60 tx=0x7fb450009780).stop 2023-10-03T10:09:49.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.800+0000 7fb45df30700 1 -- 172.21.15.72:0/2242231630 shutdown_connections 2023-10-03T10:09:49.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.800+0000 7fb45df30700 1 --2- 172.21.15.72:0/2242231630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb458094c20 0x7fb458127d10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.800+0000 7fb45df30700 1 --2- 172.21.15.72:0/2242231630 >> v2:172.21.15.72:3300/0 conn(0x7fb458096380 0x7fb458094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.800+0000 7fb45df30700 1 -- 172.21.15.72:0/2242231630 >> 172.21.15.72:0/2242231630 conn(0x7fb458097470 msgr2=0x7fb458097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:49.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.800+0000 7fb45df30700 1 -- 172.21.15.72:0/2242231630 shutdown_connections 2023-10-03T10:09:49.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.800+0000 7fb45df30700 1 -- 172.21.15.72:0/2242231630 wait complete. 2023-10-03T10:09:49.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.801+0000 7fb45df30700 1 Processor -- start 2023-10-03T10:09:49.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.801+0000 7fb45df30700 1 -- start start 2023-10-03T10:09:49.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.801+0000 7fb45df30700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb458091b00 0x7fb458117dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.801+0000 7fb45df30700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb458094c20 0x7fb458113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.801+0000 7fb45df30700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb458096380 0x7fb4581143f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:49.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.801+0000 7fb45df30700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb458116f90 con 0x7fb458096380 2023-10-03T10:09:49.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.801+0000 7fb45df30700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45809a060 con 0x7fb458094c20 2023-10-03T10:09:49.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.801+0000 7fb45df30700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb45806a520 con 0x7fb458091b00 2023-10-03T10:09:49.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.801+0000 7fb456ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb458094c20 0x7fb458113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.801+0000 7fb4577fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb458091b00 0x7fb458117dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.801+0000 7fb457fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb458096380 0x7fb4581143f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:49.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.801+0000 7fb456ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb458094c20 0x7fb458113f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:47942/0 (socket says 172.21.15.72:47942) 2023-10-03T10:09:49.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.801+0000 7fb456ffd700 1 -- 172.21.15.72:0/4198821380 learned_addr learned my addr 172.21.15.72:0/4198821380 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:49.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.802+0000 7fb457fff700 1 -- 172.21.15.72:0/4198821380 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb458091b00 msgr2=0x7fb458117dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.802+0000 7fb457fff700 1 --2- 172.21.15.72:0/4198821380 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb458091b00 0x7fb458117dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.802+0000 7fb457fff700 1 -- 172.21.15.72:0/4198821380 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb458094c20 msgr2=0x7fb458113f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.802+0000 7fb457fff700 1 --2- 172.21.15.72:0/4198821380 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb458094c20 0x7fb458113f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.802+0000 7fb457fff700 1 -- 172.21.15.72:0/4198821380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4480092a0 con 0x7fb458096380 2023-10-03T10:09:49.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.802+0000 7fb4577fe700 1 --2- 172.21.15.72:0/4198821380 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb458091b00 0x7fb458117dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:49.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.802+0000 7fb457fff700 1 --2- 172.21.15.72:0/4198821380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb458096380 0x7fb4581143f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb450014000 tx=0x7fb450009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:49.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.802+0000 7fb43f7fe700 1 -- 172.21.15.72:0/4198821380 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45001d630 con 0x7fb458096380 2023-10-03T10:09:49.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.802+0000 7fb43f7fe700 1 -- 172.21.15.72:0/4198821380 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45001d790 con 0x7fb458096380 2023-10-03T10:09:49.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.802+0000 7fb45df30700 1 -- 172.21.15.72:0/4198821380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb450009a20 con 0x7fb458096380 2023-10-03T10:09:49.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.802+0000 7fb43f7fe700 1 -- 172.21.15.72:0/4198821380 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45001db50 con 0x7fb458096380 2023-10-03T10:09:49.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.802+0000 7fb45df30700 1 -- 172.21.15.72:0/4198821380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb458115950 con 0x7fb458096380 2023-10-03T10:09:49.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.803+0000 7fb43f7fe700 1 -- 172.21.15.72:0/4198821380 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb450003040 con 0x7fb458096380 2023-10-03T10:09:49.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.803+0000 7fb43f7fe700 1 -- 172.21.15.72:0/4198821380 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb45003cc90 con 0x7fb458096380 2023-10-03T10:09:49.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.803+0000 7fb45df30700 1 -- 172.21.15.72:0/4198821380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45805a260 con 0x7fb458096380 2023-10-03T10:09:49.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.807+0000 7fb43f7fe700 1 -- 172.21.15.72:0/4198821380 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb450010310 con 0x7fb458096380 2023-10-03T10:09:49.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.965+0000 7fb45df30700 1 -- 172.21.15.72:0/4198821380 --> v1:172.21.15.72:6816/118184 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4580942e0 con 0x7fb44402bb60 2023-10-03T10:09:49.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.971+0000 7fb43f7fe700 1 -- 172.21.15.72:0/4198821380 <== mgr.4102 v1:172.21.15.72:6816/118184 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247624 (unknown 2965378022 0 2316086705) 0x7fb4580942e0 con 0x7fb44402bb60 2023-10-03T10:09:49.975 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:49.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.974+0000 7fb45df30700 1 -- 172.21.15.72:0/4198821380 >> v1:172.21.15.72:6816/118184 conn(0x7fb44402bb60 legacy=0x7fb44402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.974+0000 7fb45df30700 1 -- 172.21.15.72:0/4198821380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb458096380 msgr2=0x7fb4581143f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:49.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.974+0000 7fb45df30700 1 --2- 172.21.15.72:0/4198821380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb458096380 0x7fb4581143f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb450014000 tx=0x7fb450009780).stop 2023-10-03T10:09:49.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.974+0000 7fb45df30700 1 -- 172.21.15.72:0/4198821380 shutdown_connections 2023-10-03T10:09:49.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.974+0000 7fb45df30700 1 --2- 172.21.15.72:0/4198821380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb458096380 0x7fb4581143f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.974+0000 7fb45df30700 1 --2- 172.21.15.72:0/4198821380 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb458091b00 0x7fb458117dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.974+0000 7fb45df30700 1 --2- 172.21.15.72:0/4198821380 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb458094c20 0x7fb458113f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:49.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.974+0000 7fb45df30700 1 -- 172.21.15.72:0/4198821380 >> 172.21.15.72:0/4198821380 conn(0x7fb458097470 msgr2=0x7fb458126810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:49.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.974+0000 7fb45df30700 1 -- 172.21.15.72:0/4198821380 shutdown_connections 2023-10-03T10:09:49.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:49.974+0000 7fb45df30700 1 -- 172.21.15.72:0/4198821380 wait complete. 2023-10-03T10:09:49.978 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-03T10:09:49.986 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-03T10:09:49.878901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188964,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298396,"statfs":{"total":386547056640,"available":385329557504,"internally_reserved":0,"allocated":593920,"data_stored":173714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387453+0000","last_change":"2023-10-03T10:09:46.383964+0000","last_active":"2023-10-03T10:09:46.387453+0000","last_peered":"2023-10-03T10:09:46.387453+0000","last_clean":"2023-10-03T10:09:46.387453+0000","last_became_active":"2023-10-03T10:09:46.383681+0000","last_became_peered":"2023-10-03T10:09:46.383681+0000","last_unstale":"2023-10-03T10:09:46.387453+0000","last_undegraded":"2023-10-03T10:09:46.387453+0000","last_fullsized":"2023-10-03T10:09:46.387453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380623+0000","last_change":"2023-10-03T10:09:46.369230+0000","last_active":"2023-10-03T10:09:46.380623+0000","last_peered":"2023-10-03T10:09:46.380623+0000","last_clean":"2023-10-03T10:09:46.380623+0000","last_became_active":"2023-10-03T10:09:46.368861+0000","last_became_peered":"2023-10-03T10:09:46.368861+0000","last_unstale":"2023-10-03T10:09:46.380623+0000","last_undegraded":"2023-10-03T10:09:46.380623+0000","last_fullsized":"2023-10-03T10:09:46.380623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381586+0000","last_change":"2023-10-03T10:09:46.379410+0000","last_active":"2023-10-03T10:09:46.381586+0000","last_peered":"2023-10-03T10:09:46.381586+0000","last_clean":"2023-10-03T10:09:46.381586+0000","last_became_active":"2023-10-03T10:09:46.379027+0000","last_became_peered":"2023-10-03T10:09:46.379027+0000","last_unstale":"2023-10-03T10:09:46.381586+0000","last_undegraded":"2023-10-03T10:09:46.381586+0000","last_fullsized":"2023-10-03T10:09:46.381586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381478+0000","last_change":"2023-10-03T10:09:46.379505+0000","last_active":"2023-10-03T10:09:46.381478+0000","last_peered":"2023-10-03T10:09:46.381478+0000","last_clean":"2023-10-03T10:09:46.381478+0000","last_became_active":"2023-10-03T10:09:46.379187+0000","last_became_peered":"2023-10-03T10:09:46.379187+0000","last_unstale":"2023-10-03T10:09:46.381478+0000","last_undegraded":"2023-10-03T10:09:46.381478+0000","last_fullsized":"2023-10-03T10:09:46.381478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381407+0000","last_change":"2023-10-03T10:09:46.379819+0000","last_active":"2023-10-03T10:09:46.381407+0000","last_peered":"2023-10-03T10:09:46.381407+0000","last_clean":"2023-10-03T10:09:46.381407+0000","last_became_active":"2023-10-03T10:09:46.379555+0000","last_became_peered":"2023-10-03T10:09:46.379555+0000","last_unstale":"2023-10-03T10:09:46.381407+0000","last_undegraded":"2023-10-03T10:09:46.381407+0000","last_fullsized":"2023-10-03T10:09:46.381407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380669+0000","last_change":"2023-10-03T10:09:46.375928+0000","last_active":"2023-10-03T10:09:46.380669+0000","last_peered":"2023-10-03T10:09:46.380669+0000","last_clean":"2023-10-03T10:09:46.380669+0000","last_became_active":"2023-10-03T10:09:46.375325+0000","last_became_peered":"2023-10-03T10:09:46.375325+0000","last_unstale":"2023-10-03T10:09:46.380669+0000","last_undegraded":"2023-10-03T10:09:46.380669+0000","last_fullsized":"2023-10-03T10:09:46.380669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381546+0000","last_change":"2023-10-03T10:09:46.379935+0000","last_active":"2023-10-03T10:09:46.381546+0000","last_peered":"2023-10-03T10:09:46.381546+0000","last_clean":"2023-10-03T10:09:46.381546+0000","last_became_active":"2023-10-03T10:09:46.379431+0000","last_became_peered":"2023-10-03T10:09:46.379431+0000","last_unstale":"2023-10-03T10:09:46.381546+0000","last_undegraded":"2023-10-03T10:09:46.381546+0000","last_fullsized":"2023-10-03T10:09:46.381546+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377432+0000","last_change":"2023-10-03T10:09:46.372991+0000","last_active":"2023-10-03T10:09:46.377432+0000","last_peered":"2023-10-03T10:09:46.377432+0000","last_clean":"2023-10-03T10:09:46.377432+0000","last_became_active":"2023-10-03T10:09:46.372738+0000","last_became_peered":"2023-10-03T10:09:46.372738+0000","last_unstale":"2023-10-03T10:09:46.377432+0000","last_undegraded":"2023-10-03T10:09:46.377432+0000","last_fullsized":"2023-10-03T10:09:46.377432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377393+0000","last_change":"2023-10-03T10:09:46.372532+0000","last_active":"2023-10-03T10:09:46.377393+0000","last_peered":"2023-10-03T10:09:46.377393+0000","last_clean":"2023-10-03T10:09:46.377393+0000","last_became_active":"2023-10-03T10:09:46.372304+0000","last_became_peered":"2023-10-03T10:09:46.372304+0000","last_unstale":"2023-10-03T10:09:46.377393+0000","last_undegraded":"2023-10-03T10:09:46.377393+0000","last_fullsized":"2023-10-03T10:09:46.377393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387695+0000","last_change":"2023-10-03T10:09:46.384266+0000","last_active":"2023-10-03T10:09:46.387695+0000","last_peered":"2023-10-03T10:09:46.387695+0000","last_clean":"2023-10-03T10:09:46.387695+0000","last_became_active":"2023-10-03T10:09:46.383826+0000","last_became_peered":"2023-10-03T10:09:46.383826+0000","last_unstale":"2023-10-03T10:09:46.387695+0000","last_undegraded":"2023-10-03T10:09:46.387695+0000","last_fullsized":"2023-10-03T10:09:46.387695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388178+0000","last_change":"2023-10-03T10:09:46.384841+0000","last_active":"2023-10-03T10:09:46.388178+0000","last_peered":"2023-10-03T10:09:46.388178+0000","last_clean":"2023-10-03T10:09:46.388178+0000","last_became_active":"2023-10-03T10:09:46.384396+0000","last_became_peered":"2023-10-03T10:09:46.384396+0000","last_unstale":"2023-10-03T10:09:46.388178+0000","last_undegraded":"2023-10-03T10:09:46.388178+0000","last_fullsized":"2023-10-03T10:09:46.388178+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377458+0000","last_change":"2023-10-03T10:09:46.373837+0000","last_active":"2023-10-03T10:09:46.377458+0000","last_peered":"2023-10-03T10:09:46.377458+0000","last_clean":"2023-10-03T10:09:46.377458+0000","last_became_active":"2023-10-03T10:09:46.373580+0000","last_became_peered":"2023-10-03T10:09:46.373580+0000","last_unstale":"2023-10-03T10:09:46.377458+0000","last_undegraded":"2023-10-03T10:09:46.377458+0000","last_fullsized":"2023-10-03T10:09:46.377458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381796+0000","last_change":"2023-10-03T10:09:46.380527+0000","last_active":"2023-10-03T10:09:46.381796+0000","last_peered":"2023-10-03T10:09:46.381796+0000","last_clean":"2023-10-03T10:09:46.381796+0000","last_became_active":"2023-10-03T10:09:46.379198+0000","last_became_peered":"2023-10-03T10:09:46.379198+0000","last_unstale":"2023-10-03T10:09:46.381796+0000","last_undegraded":"2023-10-03T10:09:46.381796+0000","last_fullsized":"2023-10-03T10:09:46.381796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381563+0000","last_change":"2023-10-03T10:09:46.380089+0000","last_active":"2023-10-03T10:09:46.381563+0000","last_peered":"2023-10-03T10:09:46.381563+0000","last_clean":"2023-10-03T10:09:46.381563+0000","last_became_active":"2023-10-03T10:09:46.379696+0000","last_became_peered":"2023-10-03T10:09:46.379696+0000","last_unstale":"2023-10-03T10:09:46.381563+0000","last_undegraded":"2023-10-03T10:09:46.381563+0000","last_fullsized":"2023-10-03T10:09:46.381563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.375967+0000","last_change":"2023-10-03T10:09:46.374686+0000","last_active":"2023-10-03T10:09:46.375967+0000","last_peered":"2023-10-03T10:09:46.375967+0000","last_clean":"2023-10-03T10:09:46.375967+0000","last_became_active":"2023-10-03T10:09:46.371287+0000","last_became_peered":"2023-10-03T10:09:46.371287+0000","last_unstale":"2023-10-03T10:09:46.375967+0000","last_undegraded":"2023-10-03T10:09:46.375967+0000","last_fullsized":"2023-10-03T10:09:46.375967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366160+0000","last_change":"2023-10-03T10:09:46.364615+0000","last_active":"2023-10-03T10:09:46.366160+0000","last_peered":"2023-10-03T10:09:46.366160+0000","last_clean":"2023-10-03T10:09:46.366160+0000","last_became_active":"2023-10-03T10:09:46.364379+0000","last_became_peered":"2023-10-03T10:09:46.364379+0000","last_unstale":"2023-10-03T10:09:46.366160+0000","last_undegraded":"2023-10-03T10:09:46.366160+0000","last_fullsized":"2023-10-03T10:09:46.366160+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.391649+0000","last_change":"2023-10-03T10:09:46.388555+0000","last_active":"2023-10-03T10:09:46.391649+0000","last_peered":"2023-10-03T10:09:46.391649+0000","last_clean":"2023-10-03T10:09:46.391649+0000","last_became_active":"2023-10-03T10:09:46.388278+0000","last_became_peered":"2023-10-03T10:09:46.388278+0000","last_unstale":"2023-10-03T10:09:46.391649+0000","last_undegraded":"2023-10-03T10:09:46.391649+0000","last_fullsized":"2023-10-03T10:09:46.391649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.375782+0000","last_change":"2023-10-03T10:09:46.367061+0000","last_active":"2023-10-03T10:09:46.375782+0000","last_peered":"2023-10-03T10:09:46.375782+0000","last_clean":"2023-10-03T10:09:46.375782+0000","last_became_active":"2023-10-03T10:09:46.366790+0000","last_became_peered":"2023-10-03T10:09:46.366790+0000","last_unstale":"2023-10-03T10:09:46.375782+0000","last_undegraded":"2023-10-03T10:09:46.375782+0000","last_fullsized":"2023-10-03T10:09:46.375782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381350+0000","last_change":"2023-10-03T10:09:46.378399+0000","last_active":"2023-10-03T10:09:46.381350+0000","last_peered":"2023-10-03T10:09:46.381350+0000","last_clean":"2023-10-03T10:09:46.381350+0000","last_became_active":"2023-10-03T10:09:46.378102+0000","last_became_peered":"2023-10-03T10:09:46.378102+0000","last_unstale":"2023-10-03T10:09:46.381350+0000","last_undegraded":"2023-10-03T10:09:46.381350+0000","last_fullsized":"2023-10-03T10:09:46.381350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380689+0000","last_change":"2023-10-03T10:09:46.375958+0000","last_active":"2023-10-03T10:09:46.380689+0000","last_peered":"2023-10-03T10:09:46.380689+0000","last_clean":"2023-10-03T10:09:46.380689+0000","last_became_active":"2023-10-03T10:09:46.375553+0000","last_became_peered":"2023-10-03T10:09:46.375553+0000","last_unstale":"2023-10-03T10:09:46.380689+0000","last_undegraded":"2023-10-03T10:09:46.380689+0000","last_fullsized":"2023-10-03T10:09:46.380689+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377238+0000","last_change":"2023-10-03T10:09:46.367258+0000","last_active":"2023-10-03T10:09:46.377238+0000","last_peered":"2023-10-03T10:09:46.377238+0000","last_clean":"2023-10-03T10:09:46.377238+0000","last_became_active":"2023-10-03T10:09:46.366828+0000","last_became_peered":"2023-10-03T10:09:46.366828+0000","last_unstale":"2023-10-03T10:09:46.377238+0000","last_undegraded":"2023-10-03T10:09:46.377238+0000","last_fullsized":"2023-10-03T10:09:46.377238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377457+0000","last_change":"2023-10-03T10:09:46.374039+0000","last_active":"2023-10-03T10:09:46.377457+0000","last_peered":"2023-10-03T10:09:46.377457+0000","last_clean":"2023-10-03T10:09:46.377457+0000","last_became_active":"2023-10-03T10:09:46.373585+0000","last_became_peered":"2023-10-03T10:09:46.373585+0000","last_unstale":"2023-10-03T10:09:46.377457+0000","last_undegraded":"2023-10-03T10:09:46.377457+0000","last_fullsized":"2023-10-03T10:09:46.377457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.373297+0000","last_change":"2023-10-03T10:09:45.994509+0000","last_active":"2023-10-03T10:09:46.373297+0000","last_peered":"2023-10-03T10:09:46.373297+0000","last_clean":"2023-10-03T10:09:46.373297+0000","last_became_active":"2023-10-03T10:09:45.994047+0000","last_became_peered":"2023-10-03T10:09:45.994047+0000","last_unstale":"2023-10-03T10:09:46.373297+0000","last_undegraded":"2023-10-03T10:09:46.373297+0000","last_fullsized":"2023-10-03T10:09:46.373297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.350498+0000","last_change":"2023-10-03T10:09:46.005851+0000","last_active":"2023-10-03T10:09:46.350498+0000","last_peered":"2023-10-03T10:09:46.350498+0000","last_clean":"2023-10-03T10:09:46.350498+0000","last_became_active":"2023-10-03T10:09:46.005573+0000","last_became_peered":"2023-10-03T10:09:46.005573+0000","last_unstale":"2023-10-03T10:09:46.350498+0000","last_undegraded":"2023-10-03T10:09:46.350498+0000","last_fullsized":"2023-10-03T10:09:46.350498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381389+0000","last_change":"2023-10-03T10:09:46.378806+0000","last_active":"2023-10-03T10:09:46.381389+0000","last_peered":"2023-10-03T10:09:46.381389+0000","last_clean":"2023-10-03T10:09:46.381389+0000","last_became_active":"2023-10-03T10:09:46.378564+0000","last_became_peered":"2023-10-03T10:09:46.378564+0000","last_unstale":"2023-10-03T10:09:46.381389+0000","last_undegraded":"2023-10-03T10:09:46.381389+0000","last_fullsized":"2023-10-03T10:09:46.381389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.370555+0000","last_change":"2023-10-03T10:09:46.003890+0000","last_active":"2023-10-03T10:09:46.370555+0000","last_peered":"2023-10-03T10:09:46.370555+0000","last_clean":"2023-10-03T10:09:46.370555+0000","last_became_active":"2023-10-03T10:09:46.002821+0000","last_became_peered":"2023-10-03T10:09:46.002821+0000","last_unstale":"2023-10-03T10:09:46.370555+0000","last_undegraded":"2023-10-03T10:09:46.370555+0000","last_fullsized":"2023-10-03T10:09:46.370555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354415+0000","last_change":"2023-10-03T10:09:46.002155+0000","last_active":"2023-10-03T10:09:46.354415+0000","last_peered":"2023-10-03T10:09:46.354415+0000","last_clean":"2023-10-03T10:09:46.354415+0000","last_became_active":"2023-10-03T10:09:46.001872+0000","last_became_peered":"2023-10-03T10:09:46.001872+0000","last_unstale":"2023-10-03T10:09:46.354415+0000","last_undegraded":"2023-10-03T10:09:46.354415+0000","last_fullsized":"2023-10-03T10:09:46.354415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.395252+0000","last_change":"2023-10-03T10:09:46.001705+0000","last_active":"2023-10-03T10:09:46.395252+0000","last_peered":"2023-10-03T10:09:46.395252+0000","last_clean":"2023-10-03T10:09:46.395252+0000","last_became_active":"2023-10-03T10:09:46.001338+0000","last_became_peered":"2023-10-03T10:09:46.001338+0000","last_unstale":"2023-10-03T10:09:46.395252+0000","last_undegraded":"2023-10-03T10:09:46.395252+0000","last_fullsized":"2023-10-03T10:09:46.395252+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.397119+0000","last_change":"2023-10-03T10:09:46.392590+0000","last_active":"2023-10-03T10:09:46.397119+0000","last_peered":"2023-10-03T10:09:46.397119+0000","last_clean":"2023-10-03T10:09:46.397119+0000","last_became_active":"2023-10-03T10:09:46.392268+0000","last_became_peered":"2023-10-03T10:09:46.392268+0000","last_unstale":"2023-10-03T10:09:46.397119+0000","last_undegraded":"2023-10-03T10:09:46.397119+0000","last_fullsized":"2023-10-03T10:09:46.397119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388193+0000","last_change":"2023-10-03T10:09:46.385651+0000","last_active":"2023-10-03T10:09:46.388193+0000","last_peered":"2023-10-03T10:09:46.388193+0000","last_clean":"2023-10-03T10:09:46.388193+0000","last_became_active":"2023-10-03T10:09:46.383900+0000","last_became_peered":"2023-10-03T10:09:46.383900+0000","last_unstale":"2023-10-03T10:09:46.388193+0000","last_undegraded":"2023-10-03T10:09:46.388193+0000","last_fullsized":"2023-10-03T10:09:46.388193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.364595+0000","last_change":"2023-10-03T10:09:45.999722+0000","last_active":"2023-10-03T10:09:46.364595+0000","last_peered":"2023-10-03T10:09:46.364595+0000","last_clean":"2023-10-03T10:09:46.364595+0000","last_became_active":"2023-10-03T10:09:45.999450+0000","last_became_peered":"2023-10-03T10:09:45.999450+0000","last_unstale":"2023-10-03T10:09:46.364595+0000","last_undegraded":"2023-10-03T10:09:46.364595+0000","last_fullsized":"2023-10-03T10:09:46.364595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381433+0000","last_change":"2023-10-03T10:09:46.379295+0000","last_active":"2023-10-03T10:09:46.381433+0000","last_peered":"2023-10-03T10:09:46.381433+0000","last_clean":"2023-10-03T10:09:46.381433+0000","last_became_active":"2023-10-03T10:09:46.370639+0000","last_became_peered":"2023-10-03T10:09:46.370639+0000","last_unstale":"2023-10-03T10:09:46.381433+0000","last_undegraded":"2023-10-03T10:09:46.381433+0000","last_fullsized":"2023-10-03T10:09:46.381433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377345+0000","last_change":"2023-10-03T10:09:45.991739+0000","last_active":"2023-10-03T10:09:46.377345+0000","last_peered":"2023-10-03T10:09:46.377345+0000","last_clean":"2023-10-03T10:09:46.377345+0000","last_became_active":"2023-10-03T10:09:45.991195+0000","last_became_peered":"2023-10-03T10:09:45.991195+0000","last_unstale":"2023-10-03T10:09:46.377345+0000","last_undegraded":"2023-10-03T10:09:46.377345+0000","last_fullsized":"2023-10-03T10:09:46.377345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381508+0000","last_change":"2023-10-03T10:09:46.004494+0000","last_active":"2023-10-03T10:09:46.381508+0000","last_peered":"2023-10-03T10:09:46.381508+0000","last_clean":"2023-10-03T10:09:46.381508+0000","last_became_active":"2023-10-03T10:09:46.004166+0000","last_became_peered":"2023-10-03T10:09:46.004166+0000","last_unstale":"2023-10-03T10:09:46.381508+0000","last_undegraded":"2023-10-03T10:09:46.381508+0000","last_fullsized":"2023-10-03T10:09:46.381508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.372772+0000","last_change":"2023-10-03T10:09:45.995572+0000","last_active":"2023-10-03T10:09:46.372772+0000","last_peered":"2023-10-03T10:09:46.372772+0000","last_clean":"2023-10-03T10:09:46.372772+0000","last_became_active":"2023-10-03T10:09:45.995093+0000","last_became_peered":"2023-10-03T10:09:45.995093+0000","last_unstale":"2023-10-03T10:09:46.372772+0000","last_undegraded":"2023-10-03T10:09:46.372772+0000","last_fullsized":"2023-10-03T10:09:46.372772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366121+0000","last_change":"2023-10-03T10:09:46.362868+0000","last_active":"2023-10-03T10:09:46.366121+0000","last_peered":"2023-10-03T10:09:46.366121+0000","last_clean":"2023-10-03T10:09:46.366121+0000","last_became_active":"2023-10-03T10:09:46.362550+0000","last_became_peered":"2023-10-03T10:09:46.362550+0000","last_unstale":"2023-10-03T10:09:46.366121+0000","last_undegraded":"2023-10-03T10:09:46.366121+0000","last_fullsized":"2023-10-03T10:09:46.366121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388581+0000","last_change":"2023-10-03T10:09:46.387104+0000","last_active":"2023-10-03T10:09:46.388581+0000","last_peered":"2023-10-03T10:09:46.388581+0000","last_clean":"2023-10-03T10:09:46.388581+0000","last_became_active":"2023-10-03T10:09:46.386697+0000","last_became_peered":"2023-10-03T10:09:46.386697+0000","last_unstale":"2023-10-03T10:09:46.388581+0000","last_undegraded":"2023-10-03T10:09:46.388581+0000","last_fullsized":"2023-10-03T10:09:46.388581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.365183+0000","last_change":"2023-10-03T10:09:46.001474+0000","last_active":"2023-10-03T10:09:46.365183+0000","last_peered":"2023-10-03T10:09:46.365183+0000","last_clean":"2023-10-03T10:09:46.365183+0000","last_became_active":"2023-10-03T10:09:46.001185+0000","last_became_peered":"2023-10-03T10:09:46.001185+0000","last_unstale":"2023-10-03T10:09:46.365183+0000","last_undegraded":"2023-10-03T10:09:46.365183+0000","last_fullsized":"2023-10-03T10:09:46.365183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381334+0000","last_change":"2023-10-03T10:09:46.378394+0000","last_active":"2023-10-03T10:09:46.381334+0000","last_peered":"2023-10-03T10:09:46.381334+0000","last_clean":"2023-10-03T10:09:46.381334+0000","last_became_active":"2023-10-03T10:09:46.378115+0000","last_became_peered":"2023-10-03T10:09:46.378115+0000","last_unstale":"2023-10-03T10:09:46.381334+0000","last_undegraded":"2023-10-03T10:09:46.381334+0000","last_fullsized":"2023-10-03T10:09:46.381334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387177+0000","last_change":"2023-10-03T10:09:46.385399+0000","last_active":"2023-10-03T10:09:46.387177+0000","last_peered":"2023-10-03T10:09:46.387177+0000","last_clean":"2023-10-03T10:09:46.387177+0000","last_became_active":"2023-10-03T10:09:46.385110+0000","last_became_peered":"2023-10-03T10:09:46.385110+0000","last_unstale":"2023-10-03T10:09:46.387177+0000","last_undegraded":"2023-10-03T10:09:46.387177+0000","last_fullsized":"2023-10-03T10:09:46.387177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.389051+0000","last_change":"2023-10-03T10:09:46.387220+0000","last_active":"2023-10-03T10:09:46.389051+0000","last_peered":"2023-10-03T10:09:46.389051+0000","last_clean":"2023-10-03T10:09:46.389051+0000","last_became_active":"2023-10-03T10:09:46.384091+0000","last_became_peered":"2023-10-03T10:09:46.384091+0000","last_unstale":"2023-10-03T10:09:46.389051+0000","last_undegraded":"2023-10-03T10:09:46.389051+0000","last_fullsized":"2023-10-03T10:09:46.389051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377212+0000","last_change":"2023-10-03T10:09:46.367086+0000","last_active":"2023-10-03T10:09:46.377212+0000","last_peered":"2023-10-03T10:09:46.377212+0000","last_clean":"2023-10-03T10:09:46.377212+0000","last_became_active":"2023-10-03T10:09:46.366505+0000","last_became_peered":"2023-10-03T10:09:46.366505+0000","last_unstale":"2023-10-03T10:09:46.377212+0000","last_undegraded":"2023-10-03T10:09:46.377212+0000","last_fullsized":"2023-10-03T10:09:46.377212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.355579+0000","last_change":"2023-10-03T10:09:42.503202+0000","last_active":"2023-10-03T10:09:46.355579+0000","last_peered":"2023-10-03T10:09:46.355579+0000","last_clean":"2023-10-03T10:09:46.355579+0000","last_became_active":"2023-10-03T10:09:42.502700+0000","last_became_peered":"2023-10-03T10:09:42.502700+0000","last_unstale":"2023-10-03T10:09:46.355579+0000","last_undegraded":"2023-10-03T10:09:46.355579+0000","last_fullsized":"2023-10-03T10:09:46.355579+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352129+0000","last_change":"2023-10-03T10:09:45.995268+0000","last_active":"2023-10-03T10:09:46.352129+0000","last_peered":"2023-10-03T10:09:46.352129+0000","last_clean":"2023-10-03T10:09:46.352129+0000","last_became_active":"2023-10-03T10:09:45.994970+0000","last_became_peered":"2023-10-03T10:09:45.994970+0000","last_unstale":"2023-10-03T10:09:46.352129+0000","last_undegraded":"2023-10-03T10:09:46.352129+0000","last_fullsized":"2023-10-03T10:09:46.352129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.397141+0000","last_change":"2023-10-03T10:09:46.393198+0000","last_active":"2023-10-03T10:09:46.397141+0000","last_peered":"2023-10-03T10:09:46.397141+0000","last_clean":"2023-10-03T10:09:46.397141+0000","last_became_active":"2023-10-03T10:09:46.392876+0000","last_became_peered":"2023-10-03T10:09:46.392876+0000","last_unstale":"2023-10-03T10:09:46.397141+0000","last_undegraded":"2023-10-03T10:09:46.397141+0000","last_fullsized":"2023-10-03T10:09:46.397141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.947968+0000","last_change":"2023-10-03T10:09:41.940609+0000","last_active":"2023-10-03T10:09:41.947968+0000","last_peered":"2023-10-03T10:09:41.947968+0000","last_clean":"2023-10-03T10:09:41.947968+0000","last_became_active":"2023-10-03T10:09:41.940313+0000","last_became_peered":"2023-10-03T10:09:41.940313+0000","last_unstale":"2023-10-03T10:09:41.947968+0000","last_undegraded":"2023-10-03T10:09:41.947968+0000","last_fullsized":"2023-10-03T10:09:41.947968+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.364759+0000","last_change":"2023-10-03T10:09:45.987289+0000","last_active":"2023-10-03T10:09:46.364759+0000","last_peered":"2023-10-03T10:09:46.364759+0000","last_clean":"2023-10-03T10:09:46.364759+0000","last_became_active":"2023-10-03T10:09:45.987013+0000","last_became_peered":"2023-10-03T10:09:45.987013+0000","last_unstale":"2023-10-03T10:09:46.364759+0000","last_undegraded":"2023-10-03T10:09:46.364759+0000","last_fullsized":"2023-10-03T10:09:46.364759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377619+0000","last_change":"2023-10-03T10:09:46.371416+0000","last_active":"2023-10-03T10:09:46.377619+0000","last_peered":"2023-10-03T10:09:46.377619+0000","last_clean":"2023-10-03T10:09:46.377619+0000","last_became_active":"2023-10-03T10:09:46.370977+0000","last_became_peered":"2023-10-03T10:09:46.370977+0000","last_unstale":"2023-10-03T10:09:46.377619+0000","last_undegraded":"2023-10-03T10:09:46.377619+0000","last_fullsized":"2023-10-03T10:09:46.377619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352788+0000","last_change":"2023-10-03T10:09:41.940436+0000","last_active":"2023-10-03T10:09:46.352788+0000","last_peered":"2023-10-03T10:09:46.352788+0000","last_clean":"2023-10-03T10:09:46.352788+0000","last_became_active":"2023-10-03T10:09:41.940147+0000","last_became_peered":"2023-10-03T10:09:41.940147+0000","last_unstale":"2023-10-03T10:09:46.352788+0000","last_undegraded":"2023-10-03T10:09:46.352788+0000","last_fullsized":"2023-10-03T10:09:46.352788+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354234+0000","last_change":"2023-10-03T10:09:45.994184+0000","last_active":"2023-10-03T10:09:46.354234+0000","last_peered":"2023-10-03T10:09:46.354234+0000","last_clean":"2023-10-03T10:09:46.354234+0000","last_became_active":"2023-10-03T10:09:45.993699+0000","last_became_peered":"2023-10-03T10:09:45.993699+0000","last_unstale":"2023-10-03T10:09:46.354234+0000","last_undegraded":"2023-10-03T10:09:46.354234+0000","last_fullsized":"2023-10-03T10:09:46.354234+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377610+0000","last_change":"2023-10-03T10:09:46.372991+0000","last_active":"2023-10-03T10:09:46.377610+0000","last_peered":"2023-10-03T10:09:46.377610+0000","last_clean":"2023-10-03T10:09:46.377610+0000","last_became_active":"2023-10-03T10:09:46.372753+0000","last_became_peered":"2023-10-03T10:09:46.372753+0000","last_unstale":"2023-10-03T10:09:46.377610+0000","last_undegraded":"2023-10-03T10:09:46.377610+0000","last_fullsized":"2023-10-03T10:09:46.377610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.948007+0000","last_change":"2023-10-03T10:09:41.941185+0000","last_active":"2023-10-03T10:09:41.948007+0000","last_peered":"2023-10-03T10:09:41.948007+0000","last_clean":"2023-10-03T10:09:41.948007+0000","last_became_active":"2023-10-03T10:09:41.940930+0000","last_became_peered":"2023-10-03T10:09:41.940930+0000","last_unstale":"2023-10-03T10:09:41.948007+0000","last_undegraded":"2023-10-03T10:09:41.948007+0000","last_fullsized":"2023-10-03T10:09:41.948007+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354131+0000","last_change":"2023-10-03T10:09:40.948442+0000","last_active":"2023-10-03T10:09:46.354131+0000","last_peered":"2023-10-03T10:09:46.354131+0000","last_clean":"2023-10-03T10:09:46.354131+0000","last_became_active":"2023-10-03T10:09:40.948068+0000","last_became_peered":"2023-10-03T10:09:40.948068+0000","last_unstale":"2023-10-03T10:09:46.354131+0000","last_undegraded":"2023-10-03T10:09:46.354131+0000","last_fullsized":"2023-10-03T10:09:46.354131+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_clean_scrub_stamp":"2023-10-03T10:09:39.928111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.947965+0000","last_change":"2023-10-03T10:09:41.940561+0000","last_active":"2023-10-03T10:09:41.947965+0000","last_peered":"2023-10-03T10:09:41.947965+0000","last_clean":"2023-10-03T10:09:41.947965+0000","last_became_active":"2023-10-03T10:09:41.940202+0000","last_became_peered":"2023-10-03T10:09:41.940202+0000","last_unstale":"2023-10-03T10:09:41.947965+0000","last_undegraded":"2023-10-03T10:09:41.947965+0000","last_fullsized":"2023-10-03T10:09:41.947965+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.367791+0000","last_change":"2023-10-03T10:09:45.987278+0000","last_active":"2023-10-03T10:09:46.367791+0000","last_peered":"2023-10-03T10:09:46.367791+0000","last_clean":"2023-10-03T10:09:46.367791+0000","last_became_active":"2023-10-03T10:09:45.986993+0000","last_became_peered":"2023-10-03T10:09:45.986993+0000","last_unstale":"2023-10-03T10:09:46.367791+0000","last_undegraded":"2023-10-03T10:09:46.367791+0000","last_fullsized":"2023-10-03T10:09:46.367791+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381370+0000","last_change":"2023-10-03T10:09:46.378722+0000","last_active":"2023-10-03T10:09:46.381370+0000","last_peered":"2023-10-03T10:09:46.381370+0000","last_clean":"2023-10-03T10:09:46.381370+0000","last_became_active":"2023-10-03T10:09:46.378186+0000","last_became_peered":"2023-10-03T10:09:46.378186+0000","last_unstale":"2023-10-03T10:09:46.381370+0000","last_undegraded":"2023-10-03T10:09:46.381370+0000","last_fullsized":"2023-10-03T10:09:46.381370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:42.506148+0000","last_change":"2023-10-03T10:09:42.502984+0000","last_active":"2023-10-03T10:09:42.506148+0000","last_peered":"2023-10-03T10:09:42.506148+0000","last_clean":"2023-10-03T10:09:42.506148+0000","last_became_active":"2023-10-03T10:09:42.502699+0000","last_became_peered":"2023-10-03T10:09:42.502699+0000","last_unstale":"2023-10-03T10:09:42.506148+0000","last_undegraded":"2023-10-03T10:09:42.506148+0000","last_fullsized":"2023-10-03T10:09:42.506148+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.355380+0000","last_change":"2023-10-03T10:09:45.995626+0000","last_active":"2023-10-03T10:09:46.355380+0000","last_peered":"2023-10-03T10:09:46.355380+0000","last_clean":"2023-10-03T10:09:46.355380+0000","last_became_active":"2023-10-03T10:09:45.995322+0000","last_became_peered":"2023-10-03T10:09:45.995322+0000","last_unstale":"2023-10-03T10:09:46.355380+0000","last_undegraded":"2023-10-03T10:09:46.355380+0000","last_fullsized":"2023-10-03T10:09:46.355380+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.375920+0000","last_change":"2023-10-03T10:09:46.371217+0000","last_active":"2023-10-03T10:09:46.375920+0000","last_peered":"2023-10-03T10:09:46.375920+0000","last_clean":"2023-10-03T10:09:46.375920+0000","last_became_active":"2023-10-03T10:09:46.370285+0000","last_became_peered":"2023-10-03T10:09:46.370285+0000","last_unstale":"2023-10-03T10:09:46.375920+0000","last_undegraded":"2023-10-03T10:09:46.375920+0000","last_fullsized":"2023-10-03T10:09:46.375920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.350860+0000","last_change":"2023-10-03T10:09:42.503022+0000","last_active":"2023-10-03T10:09:46.350860+0000","last_peered":"2023-10-03T10:09:46.350860+0000","last_clean":"2023-10-03T10:09:46.350860+0000","last_became_active":"2023-10-03T10:09:42.502739+0000","last_became_peered":"2023-10-03T10:09:42.502739+0000","last_unstale":"2023-10-03T10:09:46.350860+0000","last_undegraded":"2023-10-03T10:09:46.350860+0000","last_fullsized":"2023-10-03T10:09:46.350860+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:42.506333+0000","last_change":"2023-10-03T10:09:42.503368+0000","last_active":"2023-10-03T10:09:42.506333+0000","last_peered":"2023-10-03T10:09:42.506333+0000","last_clean":"2023-10-03T10:09:42.506333+0000","last_became_active":"2023-10-03T10:09:42.503090+0000","last_became_peered":"2023-10-03T10:09:42.503090+0000","last_unstale":"2023-10-03T10:09:42.506333+0000","last_undegraded":"2023-10-03T10:09:42.506333+0000","last_fullsized":"2023-10-03T10:09:42.506333+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.371581+0000","last_change":"2023-10-03T10:09:46.003516+0000","last_active":"2023-10-03T10:09:46.371581+0000","last_peered":"2023-10-03T10:09:46.371581+0000","last_clean":"2023-10-03T10:09:46.371581+0000","last_became_active":"2023-10-03T10:09:46.003227+0000","last_became_peered":"2023-10-03T10:09:46.003227+0000","last_unstale":"2023-10-03T10:09:46.371581+0000","last_undegraded":"2023-10-03T10:09:46.371581+0000","last_fullsized":"2023-10-03T10:09:46.371581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366737+0000","last_change":"2023-10-03T10:09:46.365107+0000","last_active":"2023-10-03T10:09:46.366737+0000","last_peered":"2023-10-03T10:09:46.366737+0000","last_clean":"2023-10-03T10:09:46.366737+0000","last_became_active":"2023-10-03T10:09:46.364877+0000","last_became_peered":"2023-10-03T10:09:46.364877+0000","last_unstale":"2023-10-03T10:09:46.366737+0000","last_undegraded":"2023-10-03T10:09:46.366737+0000","last_fullsized":"2023-10-03T10:09:46.366737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388998+0000","last_change":"2023-10-03T10:09:46.003786+0000","last_active":"2023-10-03T10:09:46.388998+0000","last_peered":"2023-10-03T10:09:46.388998+0000","last_clean":"2023-10-03T10:09:46.388998+0000","last_became_active":"2023-10-03T10:09:46.003506+0000","last_became_peered":"2023-10-03T10:09:46.003506+0000","last_unstale":"2023-10-03T10:09:46.388998+0000","last_undegraded":"2023-10-03T10:09:46.388998+0000","last_fullsized":"2023-10-03T10:09:46.388998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380939+0000","last_change":"2023-10-03T10:09:46.376808+0000","last_active":"2023-10-03T10:09:46.380939+0000","last_peered":"2023-10-03T10:09:46.380939+0000","last_clean":"2023-10-03T10:09:46.380939+0000","last_became_active":"2023-10-03T10:09:46.376414+0000","last_became_peered":"2023-10-03T10:09:46.376414+0000","last_unstale":"2023-10-03T10:09:46.380939+0000","last_undegraded":"2023-10-03T10:09:46.380939+0000","last_fullsized":"2023-10-03T10:09:46.380939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.374191+0000","last_change":"2023-10-03T10:09:45.992104+0000","last_active":"2023-10-03T10:09:46.374191+0000","last_peered":"2023-10-03T10:09:46.374191+0000","last_clean":"2023-10-03T10:09:46.374191+0000","last_became_active":"2023-10-03T10:09:45.991796+0000","last_became_peered":"2023-10-03T10:09:45.991796+0000","last_unstale":"2023-10-03T10:09:46.374191+0000","last_undegraded":"2023-10-03T10:09:46.374191+0000","last_fullsized":"2023-10-03T10:09:46.374191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387640+0000","last_change":"2023-10-03T10:09:46.384662+0000","last_active":"2023-10-03T10:09:46.387640+0000","last_peered":"2023-10-03T10:09:46.387640+0000","last_clean":"2023-10-03T10:09:46.387640+0000","last_became_active":"2023-10-03T10:09:46.384347+0000","last_became_peered":"2023-10-03T10:09:46.384347+0000","last_unstale":"2023-10-03T10:09:46.387640+0000","last_undegraded":"2023-10-03T10:09:46.387640+0000","last_fullsized":"2023-10-03T10:09:46.387640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388600+0000","last_change":"2023-10-03T10:09:46.387130+0000","last_active":"2023-10-03T10:09:46.388600+0000","last_peered":"2023-10-03T10:09:46.388600+0000","last_clean":"2023-10-03T10:09:46.388600+0000","last_became_active":"2023-10-03T10:09:46.386801+0000","last_became_peered":"2023-10-03T10:09:46.386801+0000","last_unstale":"2023-10-03T10:09:46.388600+0000","last_undegraded":"2023-10-03T10:09:46.388600+0000","last_fullsized":"2023-10-03T10:09:46.388600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381665+0000","last_change":"2023-10-03T10:09:46.004241+0000","last_active":"2023-10-03T10:09:46.381665+0000","last_peered":"2023-10-03T10:09:46.381665+0000","last_clean":"2023-10-03T10:09:46.381665+0000","last_became_active":"2023-10-03T10:09:46.003370+0000","last_became_peered":"2023-10-03T10:09:46.003370+0000","last_unstale":"2023-10-03T10:09:46.381665+0000","last_undegraded":"2023-10-03T10:09:46.381665+0000","last_fullsized":"2023-10-03T10:09:46.381665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380871+0000","last_change":"2023-10-03T10:09:46.374808+0000","last_active":"2023-10-03T10:09:46.380871+0000","last_peered":"2023-10-03T10:09:46.380871+0000","last_clean":"2023-10-03T10:09:46.380871+0000","last_became_active":"2023-10-03T10:09:46.374363+0000","last_became_peered":"2023-10-03T10:09:46.374363+0000","last_unstale":"2023-10-03T10:09:46.380871+0000","last_undegraded":"2023-10-03T10:09:46.380871+0000","last_fullsized":"2023-10-03T10:09:46.380871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377400+0000","last_change":"2023-10-03T10:09:46.371026+0000","last_active":"2023-10-03T10:09:46.377400+0000","last_peered":"2023-10-03T10:09:46.377400+0000","last_clean":"2023-10-03T10:09:46.377400+0000","last_became_active":"2023-10-03T10:09:46.370725+0000","last_became_peered":"2023-10-03T10:09:46.370725+0000","last_unstale":"2023-10-03T10:09:46.377400+0000","last_undegraded":"2023-10-03T10:09:46.377400+0000","last_fullsized":"2023-10-03T10:09:46.377400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387149+0000","last_change":"2023-10-03T10:09:46.385510+0000","last_active":"2023-10-03T10:09:46.387149+0000","last_peered":"2023-10-03T10:09:46.387149+0000","last_clean":"2023-10-03T10:09:46.387149+0000","last_became_active":"2023-10-03T10:09:46.385254+0000","last_became_peered":"2023-10-03T10:09:46.385254+0000","last_unstale":"2023-10-03T10:09:46.387149+0000","last_undegraded":"2023-10-03T10:09:46.387149+0000","last_fullsized":"2023-10-03T10:09:46.387149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377600+0000","last_change":"2023-10-03T10:09:46.371241+0000","last_active":"2023-10-03T10:09:46.377600+0000","last_peered":"2023-10-03T10:09:46.377600+0000","last_clean":"2023-10-03T10:09:46.377600+0000","last_became_active":"2023-10-03T10:09:46.370691+0000","last_became_peered":"2023-10-03T10:09:46.370691+0000","last_unstale":"2023-10-03T10:09:46.377600+0000","last_undegraded":"2023-10-03T10:09:46.377600+0000","last_fullsized":"2023-10-03T10:09:46.377600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":90,"acting":90,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":666,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":38,"acting":38,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":46930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:49.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-10-03T10:09:49.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-10-03T10:09:49.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-10-03T10:09:49.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-10-03T10:09:49.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-10-03T10:09:49.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-10-03T10:09:49.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-10-03T10:09:49.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:44.967552+0000', 'last_change': '2023-10-03T10:09:44.967552+0000', 'last_active': '2023-10-03T10:09:44.967552+0000', 'last_peered': '2023-10-03T10:09:44.967552+0000', 'last_clean': '2023-10-03T10:09:44.967552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:44.967552+0000', 'last_undegraded': '2023-10-03T10:09:44.967552+0000', 'last_fullsized': '2023-10-03T10:09:44.967552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-10-03T10:09:49.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-10-03T10:09:49.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-10-03T10:09:49.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-10-03T10:09:49.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:44.967552+0000', 'last_change': '2023-10-03T10:09:44.967552+0000', 'last_active': '2023-10-03T10:09:44.967552+0000', 'last_peered': '2023-10-03T10:09:44.967552+0000', 'last_clean': '2023-10-03T10:09:44.967552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:44.967552+0000', 'last_undegraded': '2023-10-03T10:09:44.967552+0000', 'last_fullsized': '2023-10-03T10:09:44.967552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-03T10:09:49.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:44.967552+0000', 'last_change': '2023-10-03T10:09:44.967552+0000', 'last_active': '2023-10-03T10:09:44.967552+0000', 'last_peered': '2023-10-03T10:09:44.967552+0000', 'last_clean': '2023-10-03T10:09:44.967552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:44.967552+0000', 'last_undegraded': '2023-10-03T10:09:44.967552+0000', 'last_fullsized': '2023-10-03T10:09:44.967552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-10-03T10:09:49.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-10-03T10:09:49.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-03T10:09:49.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:44.967552+0000', 'last_change': '2023-10-03T10:09:44.967552+0000', 'last_active': '2023-10-03T10:09:44.967552+0000', 'last_peered': '2023-10-03T10:09:44.967552+0000', 'last_clean': '2023-10-03T10:09:44.967552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:44.967552+0000', 'last_undegraded': '2023-10-03T10:09:44.967552+0000', 'last_fullsized': '2023-10-03T10:09:44.967552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-10-03T10:09:49.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-10-03T10:09:49.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-10-03T10:09:49.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:44.967552+0000', 'last_change': '2023-10-03T10:09:44.967552+0000', 'last_active': '2023-10-03T10:09:44.967552+0000', 'last_peered': '2023-10-03T10:09:44.967552+0000', 'last_clean': '2023-10-03T10:09:44.967552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:44.967552+0000', 'last_undegraded': '2023-10-03T10:09:44.967552+0000', 'last_fullsized': '2023-10-03T10:09:44.967552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-10-03T10:09:49.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:44.967552+0000', 'last_change': '2023-10-03T10:09:44.967552+0000', 'last_active': '2023-10-03T10:09:44.967552+0000', 'last_peered': '2023-10-03T10:09:44.967552+0000', 'last_clean': '2023-10-03T10:09:44.967552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:44.967552+0000', 'last_undegraded': '2023-10-03T10:09:44.967552+0000', 'last_fullsized': '2023-10-03T10:09:44.967552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-03T10:09:49.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:44.967552+0000', 'last_change': '2023-10-03T10:09:44.967552+0000', 'last_active': '2023-10-03T10:09:44.967552+0000', 'last_peered': '2023-10-03T10:09:44.967552+0000', 'last_clean': '2023-10-03T10:09:44.967552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:44.967552+0000', 'last_undegraded': '2023-10-03T10:09:44.967552+0000', 'last_fullsized': '2023-10-03T10:09:44.967552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-10-03T10:09:49.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-10-03T10:09:49.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:44.967552+0000', 'last_change': '2023-10-03T10:09:44.967552+0000', 'last_active': '2023-10-03T10:09:44.967552+0000', 'last_peered': '2023-10-03T10:09:44.967552+0000', 'last_clean': '2023-10-03T10:09:44.967552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:44.967552+0000', 'last_undegraded': '2023-10-03T10:09:44.967552+0000', 'last_fullsized': '2023-10-03T10:09:44.967552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-10-03T10:09:49.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:44.967552+0000', 'last_change': '2023-10-03T10:09:44.967552+0000', 'last_active': '2023-10-03T10:09:44.967552+0000', 'last_peered': '2023-10-03T10:09:44.967552+0000', 'last_clean': '2023-10-03T10:09:44.967552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:44.967552+0000', 'last_undegraded': '2023-10-03T10:09:44.967552+0000', 'last_fullsized': '2023-10-03T10:09:44.967552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-10-03T10:09:49.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:44.967552+0000', 'last_change': '2023-10-03T10:09:44.967552+0000', 'last_active': '2023-10-03T10:09:44.967552+0000', 'last_peered': '2023-10-03T10:09:44.967552+0000', 'last_clean': '2023-10-03T10:09:44.967552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:44.967552+0000', 'last_undegraded': '2023-10-03T10:09:44.967552+0000', 'last_fullsized': '2023-10-03T10:09:44.967552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-10-03T10:09:49.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-10-03T10:09:49.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:44.967552+0000', 'last_change': '2023-10-03T10:09:44.967552+0000', 'last_active': '2023-10-03T10:09:44.967552+0000', 'last_peered': '2023-10-03T10:09:44.967552+0000', 'last_clean': '2023-10-03T10:09:44.967552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:44.967552+0000', 'last_undegraded': '2023-10-03T10:09:44.967552+0000', 'last_fullsized': '2023-10-03T10:09:44.967552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-10-03T10:09:49.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-10-03T10:09:49.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:44.967552+0000', 'last_change': '2023-10-03T10:09:44.967552+0000', 'last_active': '2023-10-03T10:09:44.967552+0000', 'last_peered': '2023-10-03T10:09:44.967552+0000', 'last_clean': '2023-10-03T10:09:44.967552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:44.967552+0000', 'last_undegraded': '2023-10-03T10:09:44.967552+0000', 'last_fullsized': '2023-10-03T10:09:44.967552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-10-03T10:09:49.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:44.967552+0000', 'last_change': '2023-10-03T10:09:44.967552+0000', 'last_active': '2023-10-03T10:09:44.967552+0000', 'last_peered': '2023-10-03T10:09:44.967552+0000', 'last_clean': '2023-10-03T10:09:44.967552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:44.967552+0000', 'last_undegraded': '2023-10-03T10:09:44.967552+0000', 'last_fullsized': '2023-10-03T10:09:44.967552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:44.967552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-10-03T10:09:49.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-10-03T10:09:49.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-10-03T10:09:49.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-03T10:09:45.971109+0000', 'last_change': '2023-10-03T10:09:45.971109+0000', 'last_active': '2023-10-03T10:09:45.971109+0000', 'last_peered': '2023-10-03T10:09:45.971109+0000', 'last_clean': '2023-10-03T10:09:45.971109+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-03T10:09:45.971109+0000', 'last_undegraded': '2023-10-03T10:09:45.971109+0000', 'last_fullsized': '2023-10-03T10:09:45.971109+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'last_clean_scrub_stamp': '2023-10-03T10:09:45.971109+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-03T10:09:49.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-03T10:09:50.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.140+0000 7ff0a61e5700 1 Processor -- start 2023-10-03T10:09:50.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.140+0000 7ff0a61e5700 1 -- start start 2023-10-03T10:09:50.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff0a61e5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff0a00965e0 0x7ff0a00969c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:50.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff0a61e5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0a00684f0 0x7ff0a012fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:50.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff0a61e5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a00933b0 con 0x7ff0a0096eb0 2023-10-03T10:09:50.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff0a61e5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a0092190 con 0x7ff0a00965e0 2023-10-03T10:09:50.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff0a61e5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0069a20 con 0x7ff0a00684f0 2023-10-03T10:09:50.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff09f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff0a00965e0 0x7ff0a00969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:50.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff09ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0a00684f0 0x7ff0a012fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:50.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff096ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff0a0096eb0 0x7ff0a0067de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:40988/0 (socket says 172.21.15.72:40988) 2023-10-03T10:09:50.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff096ffd700 1 -- 172.21.15.72:0/1063749269 learned_addr learned my addr 172.21.15.72:0/1063749269 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:50.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff09ffff700 1 -- 172.21.15.72:0/1063749269 >> v2:172.21.15.72:3300/0 conn(0x7ff0a00965e0 msgr2=0x7ff0a00969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:50.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff09ffff700 1 --2- 172.21.15.72:0/1063749269 >> v2:172.21.15.72:3300/0 conn(0x7ff0a00965e0 0x7ff0a00969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff09ffff700 1 -- 172.21.15.72:0/1063749269 >> v1:172.21.15.72:6789/0 conn(0x7ff0a0096eb0 legacy=0x7ff0a0067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff09ffff700 1 -- 172.21.15.72:0/1063749269 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a0069ca0 con 0x7ff0a00684f0 2023-10-03T10:09:50.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff09effd700 1 -- 172.21.15.72:0/1063749269 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507747672 0 0) 0x7ff0a00933b0 con 0x7ff0a0096eb0 2023-10-03T10:09:50.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff09f7fe700 1 --2- 172.21.15.72:0/1063749269 >> v2:172.21.15.72:3300/0 conn(0x7ff0a00965e0 0x7ff0a00969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:50.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff09ffff700 1 --2- 172.21.15.72:0/1063749269 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0a00684f0 0x7ff0a012fc50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff098009e60 tx=0x7ff098009780).ready entity=mon.2 client_cookie=3f22f6e224720909 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:50.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff09effd700 1 -- 172.21.15.72:0/1063749269 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09800e070 con 0x7ff0a00684f0 2023-10-03T10:09:50.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff09effd700 1 -- 172.21.15.72:0/1063749269 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09800bb60 con 0x7ff0a00684f0 2023-10-03T10:09:50.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.141+0000 7ff09effd700 1 -- 172.21.15.72:0/1063749269 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff098012410 con 0x7ff0a00684f0 2023-10-03T10:09:50.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.142+0000 7ff0a61e5700 1 -- 172.21.15.72:0/1063749269 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0a00684f0 msgr2=0x7ff0a012fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.142+0000 7ff0a61e5700 1 --2- 172.21.15.72:0/1063749269 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0a00684f0 0x7ff0a012fc50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff098009e60 tx=0x7ff098009780).stop 2023-10-03T10:09:50.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.142+0000 7ff0a61e5700 1 -- 172.21.15.72:0/1063749269 shutdown_connections 2023-10-03T10:09:50.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.142+0000 7ff0a61e5700 1 --2- 172.21.15.72:0/1063749269 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0a00684f0 0x7ff0a012fc50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.142+0000 7ff0a61e5700 1 --2- 172.21.15.72:0/1063749269 >> v2:172.21.15.72:3300/0 conn(0x7ff0a00965e0 0x7ff0a00969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.142+0000 7ff0a61e5700 1 -- 172.21.15.72:0/1063749269 >> 172.21.15.72:0/1063749269 conn(0x7ff0a009a220 msgr2=0x7ff0a009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:50.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.142+0000 7ff0a61e5700 1 -- 172.21.15.72:0/1063749269 shutdown_connections 2023-10-03T10:09:50.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.142+0000 7ff0a61e5700 1 -- 172.21.15.72:0/1063749269 wait complete. 2023-10-03T10:09:50.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.143+0000 7ff0a61e5700 1 Processor -- start 2023-10-03T10:09:50.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.143+0000 7ff0a61e5700 1 -- start start 2023-10-03T10:09:50.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.143+0000 7ff0a61e5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0a00684f0 0x7ff0a011bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:50.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.143+0000 7ff0a61e5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0a00965e0 0x7ff0a01189b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:50.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.143+0000 7ff0a61e5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0a0096eb0 0x7ff0a0118ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:50.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.143+0000 7ff0a61e5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0119d40 con 0x7ff0a00965e0 2023-10-03T10:09:50.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.143+0000 7ff0a61e5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a011b500 con 0x7ff0a0096eb0 2023-10-03T10:09:50.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.143+0000 7ff0a61e5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a011b7c0 con 0x7ff0a00684f0 2023-10-03T10:09:50.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.143+0000 7ff09f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0a00684f0 0x7ff0a011bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:50.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.143+0000 7ff096ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0a00965e0 0x7ff0a01189b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:50.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.143+0000 7ff09f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0a00684f0 0x7ff0a011bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59220/0 (socket says 172.21.15.72:59220) 2023-10-03T10:09:50.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.143+0000 7ff09f7fe700 1 -- 172.21.15.72:0/3492378420 learned_addr learned my addr 172.21.15.72:0/3492378420 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:50.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.143+0000 7ff09ffff700 1 --2- 172.21.15.72:0/3492378420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0a0096eb0 0x7ff0a0118ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.144+0000 7ff09f7fe700 1 -- 172.21.15.72:0/3492378420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0a0096eb0 msgr2=0x7ff0a0118ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.144+0000 7ff09f7fe700 1 --2- 172.21.15.72:0/3492378420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0a0096eb0 0x7ff0a0118ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.144+0000 7ff09f7fe700 1 -- 172.21.15.72:0/3492378420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0a00965e0 msgr2=0x7ff0a01189b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.144+0000 7ff09f7fe700 1 --2- 172.21.15.72:0/3492378420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0a00965e0 0x7ff0a01189b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.144+0000 7ff09f7fe700 1 -- 172.21.15.72:0/3492378420 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0900092a0 con 0x7ff0a00684f0 2023-10-03T10:09:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.144+0000 7ff096ffd700 1 --2- 172.21.15.72:0/3492378420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0a00965e0 0x7ff0a01189b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.144+0000 7ff09f7fe700 1 --2- 172.21.15.72:0/3492378420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0a00684f0 0x7ff0a011bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff09000ea20 tx=0x7ff090009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.144+0000 7ff097fff700 1 -- 172.21.15.72:0/3492378420 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09000ee60 con 0x7ff0a00684f0 2023-10-03T10:09:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.144+0000 7ff097fff700 1 -- 172.21.15.72:0/3492378420 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff090009600 con 0x7ff0a00684f0 2023-10-03T10:09:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.144+0000 7ff0a61e5700 1 -- 172.21.15.72:0/3492378420 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff098009a20 con 0x7ff0a00684f0 2023-10-03T10:09:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.144+0000 7ff097fff700 1 -- 172.21.15.72:0/3492378420 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09000ca60 con 0x7ff0a00684f0 2023-10-03T10:09:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.144+0000 7ff0a61e5700 1 -- 172.21.15.72:0/3492378420 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a0118440 con 0x7ff0a00684f0 2023-10-03T10:09:50.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.145+0000 7ff097fff700 1 -- 172.21.15.72:0/3492378420 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff09001b400 con 0x7ff0a00684f0 2023-10-03T10:09:50.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.145+0000 7ff097fff700 1 -- 172.21.15.72:0/3492378420 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff09003b410 con 0x7ff0a00684f0 2023-10-03T10:09:50.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.145+0000 7ff0a61e5700 1 -- 172.21.15.72:0/3492378420 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a0066df0 con 0x7ff0a00684f0 2023-10-03T10:09:50.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.149+0000 7ff097fff700 1 -- 172.21.15.72:0/3492378420 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff090016030 con 0x7ff0a00684f0 2023-10-03T10:09:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.366+0000 7ff0a61e5700 1 -- 172.21.15.72:0/3492378420 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff0a005a260 con 0x7ff0a00684f0 2023-10-03T10:09:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.366+0000 7ff097fff700 1 -- 172.21.15.72:0/3492378420 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1024 (secure 0 0 0) 0x7ff090016070 con 0x7ff0a00684f0 2023-10-03T10:09:50.367 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:50.367 INFO:teuthology.orchestra.run.smithi072.stdout:{"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":19,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":17,"num_osds":4,"num_up_osds":4,"osd_up_since":1696327778,"num_in_osds":4,"osd_in_since":1696327772,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":73},{"state_name":"unknown","count":32}],"num_pgs":105,"num_pools":4,"num_objects":11,"data_bytes":666,"bytes_used":1217499136,"bytes_avail":385329557504,"bytes_total":386547056640,"unknown_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4187}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-03T10:09:30.970904+0000","services":{}},"progress_events":{}} 2023-10-03T10:09:50.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.368+0000 7ff0a61e5700 1 -- 172.21.15.72:0/3492378420 >> v1:172.21.15.72:6816/118184 conn(0x7ff08002bb90 legacy=0x7ff08002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.368+0000 7ff0a61e5700 1 -- 172.21.15.72:0/3492378420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0a00684f0 msgr2=0x7ff0a011bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.368+0000 7ff0a61e5700 1 --2- 172.21.15.72:0/3492378420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0a00684f0 0x7ff0a011bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff09000ea20 tx=0x7ff090009060).stop 2023-10-03T10:09:50.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.368+0000 7ff0a61e5700 1 -- 172.21.15.72:0/3492378420 shutdown_connections 2023-10-03T10:09:50.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.368+0000 7ff0a61e5700 1 --2- 172.21.15.72:0/3492378420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0a0096eb0 0x7ff0a0118ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.368+0000 7ff0a61e5700 1 --2- 172.21.15.72:0/3492378420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0a00684f0 0x7ff0a011bfa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.368+0000 7ff0a61e5700 1 --2- 172.21.15.72:0/3492378420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0a00965e0 0x7ff0a01189b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.368+0000 7ff0a61e5700 1 -- 172.21.15.72:0/3492378420 >> 172.21.15.72:0/3492378420 conn(0x7ff0a009a220 msgr2=0x7ff0a00955c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:50.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.368+0000 7ff0a61e5700 1 -- 172.21.15.72:0/3492378420 shutdown_connections 2023-10-03T10:09:50.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.368+0000 7ff0a61e5700 1 -- 172.21.15.72:0/3492378420 wait complete. 2023-10-03T10:09:50.380 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-03T10:09:50.380 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:50.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.494+0000 7f5f946ee700 1 Processor -- start 2023-10-03T10:09:50.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.494+0000 7f5f946ee700 1 -- start start 2023-10-03T10:09:50.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f946ee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c096610 0x7f5f8c0969f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:50.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f946ee700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0684f0 0x7f5f8c12fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:50.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f946ee700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8c069ad0 con 0x7f5f8c096ee0 2023-10-03T10:09:50.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f946ee700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c093420 con 0x7f5f8c096610 2023-10-03T10:09:50.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f946ee700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c091ef0 con 0x7f5f8c0684f0 2023-10-03T10:09:50.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f9248a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c096610 0x7f5f8c0969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:50.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f92c8b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0684f0 0x7f5f8c12fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:50.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f91c89700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5f8c096ee0 0x7f5f8c067de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41004/0 (socket says 172.21.15.72:41004) 2023-10-03T10:09:50.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f91c89700 1 -- 172.21.15.72:0/794528766 learned_addr learned my addr 172.21.15.72:0/794528766 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:50.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f91488700 1 -- 172.21.15.72:0/794528766 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111846511 0 0) 0x7f5f8c069ad0 con 0x7f5f8c096ee0 2023-10-03T10:09:50.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f9248a700 1 -- 172.21.15.72:0/794528766 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0684f0 msgr2=0x7f5f8c12fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:50.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f9248a700 1 --2- 172.21.15.72:0/794528766 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0684f0 0x7f5f8c12fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f9248a700 1 -- 172.21.15.72:0/794528766 >> v1:172.21.15.72:6789/0 conn(0x7f5f8c096ee0 legacy=0x7f5f8c067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f9248a700 1 -- 172.21.15.72:0/794528766 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8c092450 con 0x7f5f8c096610 2023-10-03T10:09:50.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f92c8b700 1 --2- 172.21.15.72:0/794528766 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0684f0 0x7f5f8c12fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:50.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f9248a700 1 --2- 172.21.15.72:0/794528766 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c096610 0x7f5f8c0969f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f5f88009790 tx=0x7f5f88009060).ready entity=mon.1 client_cookie=6e32f2676cc6c1b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:50.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f91488700 1 -- 172.21.15.72:0/794528766 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f880090d0 con 0x7f5f8c096610 2023-10-03T10:09:50.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f91488700 1 -- 172.21.15.72:0/794528766 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8800f510 con 0x7f5f8c096610 2023-10-03T10:09:50.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.495+0000 7f5f91488700 1 -- 172.21.15.72:0/794528766 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8800f890 con 0x7f5f8c096610 2023-10-03T10:09:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.496+0000 7f5f946ee700 1 -- 172.21.15.72:0/794528766 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c096610 msgr2=0x7f5f8c0969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.496+0000 7f5f946ee700 1 --2- 172.21.15.72:0/794528766 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c096610 0x7f5f8c0969f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f5f88009790 tx=0x7f5f88009060).stop 2023-10-03T10:09:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.496+0000 7f5f946ee700 1 -- 172.21.15.72:0/794528766 shutdown_connections 2023-10-03T10:09:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.496+0000 7f5f946ee700 1 --2- 172.21.15.72:0/794528766 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0684f0 0x7f5f8c12fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.496+0000 7f5f946ee700 1 --2- 172.21.15.72:0/794528766 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c096610 0x7f5f8c0969f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.496+0000 7f5f946ee700 1 -- 172.21.15.72:0/794528766 >> 172.21.15.72:0/794528766 conn(0x7f5f8c09a220 msgr2=0x7f5f8c09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.496+0000 7f5f946ee700 1 -- 172.21.15.72:0/794528766 shutdown_connections 2023-10-03T10:09:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.496+0000 7f5f946ee700 1 -- 172.21.15.72:0/794528766 wait complete. 2023-10-03T10:09:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.497+0000 7f5f946ee700 1 Processor -- start 2023-10-03T10:09:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.497+0000 7f5f946ee700 1 -- start start 2023-10-03T10:09:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.497+0000 7f5f946ee700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0684f0 0x7f5f8c13a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.497+0000 7f5f946ee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c096610 0x7f5f8c13a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.497+0000 7f5f946ee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8c096ee0 0x7f5f8c13aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.497+0000 7f5f946ee700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c11b8d0 con 0x7f5f8c096ee0 2023-10-03T10:09:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.497+0000 7f5f946ee700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c066430 con 0x7f5f8c096610 2023-10-03T10:09:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.497+0000 7f5f946ee700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c091bf0 con 0x7f5f8c0684f0 2023-10-03T10:09:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.497+0000 7f5f91c89700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c096610 0x7f5f8c13a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.497+0000 7f5f92c8b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8c096ee0 0x7f5f8c13aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.497+0000 7f5f92c8b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8c096ee0 0x7f5f8c13aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33138/0 (socket says 172.21.15.72:33138) 2023-10-03T10:09:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.497+0000 7f5f91c89700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c096610 0x7f5f8c13a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:47974/0 (socket says 172.21.15.72:47974) 2023-10-03T10:09:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.497+0000 7f5f92c8b700 1 -- 172.21.15.72:0/3683882616 learned_addr learned my addr 172.21.15.72:0/3683882616 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.497+0000 7f5f9248a700 1 --2- 172.21.15.72:0/3683882616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0684f0 0x7f5f8c13a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.498+0000 7f5f91c89700 1 -- 172.21.15.72:0/3683882616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0684f0 msgr2=0x7f5f8c13a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.498+0000 7f5f91c89700 1 --2- 172.21.15.72:0/3683882616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0684f0 0x7f5f8c13a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.498+0000 7f5f91c89700 1 -- 172.21.15.72:0/3683882616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8c096ee0 msgr2=0x7f5f8c13aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.498+0000 7f5f91c89700 1 --2- 172.21.15.72:0/3683882616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8c096ee0 0x7f5f8c13aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.498+0000 7f5f91c89700 1 -- 172.21.15.72:0/3683882616 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f84009a20 con 0x7f5f8c096610 2023-10-03T10:09:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.498+0000 7f5f92c8b700 1 --2- 172.21.15.72:0/3683882616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8c096ee0 0x7f5f8c13aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.498+0000 7f5f91c89700 1 --2- 172.21.15.72:0/3683882616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c096610 0x7f5f8c13a7b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5f7c000c00 tx=0x7f5f7c007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.498+0000 7f5f827fc700 1 -- 172.21.15.72:0/3683882616 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c0070d0 con 0x7f5f8c096610 2023-10-03T10:09:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.498+0000 7f5f827fc700 1 -- 172.21.15.72:0/3683882616 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c007250 con 0x7f5f8c096610 2023-10-03T10:09:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.498+0000 7f5f827fc700 1 -- 172.21.15.72:0/3683882616 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c007610 con 0x7f5f8c096610 2023-10-03T10:09:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.498+0000 7f5f946ee700 1 -- 172.21.15.72:0/3683882616 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f880092a0 con 0x7f5f8c096610 2023-10-03T10:09:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.498+0000 7f5f946ee700 1 -- 172.21.15.72:0/3683882616 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8c11d7e0 con 0x7f5f8c096610 2023-10-03T10:09:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.498+0000 7f5f827fc700 1 -- 172.21.15.72:0/3683882616 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5f7c0059b0 con 0x7f5f8c096610 2023-10-03T10:09:50.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.499+0000 7f5f827fc700 1 -- 172.21.15.72:0/3683882616 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5f7c03a5d0 con 0x7f5f8c096610 2023-10-03T10:09:50.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.499+0000 7f5f946ee700 1 -- 172.21.15.72:0/3683882616 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8c05a260 con 0x7f5f8c096610 2023-10-03T10:09:50.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.503+0000 7f5f827fc700 1 -- 172.21.15.72:0/3683882616 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5f7c013970 con 0x7f5f8c096610 2023-10-03T10:09:50.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.660+0000 7f5f946ee700 1 -- 172.21.15.72:0/3683882616 --> v1:172.21.15.72:6816/118184 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f8c11d460 con 0x7f5f7002bb60 2023-10-03T10:09:50.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.666+0000 7f5f827fc700 1 -- 172.21.15.72:0/3683882616 <== mgr.4102 v1:172.21.15.72:6816/118184 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247624 (unknown 2965378022 0 2316086705) 0x7f5f880090f0 con 0x7f5f7002bb60 2023-10-03T10:09:50.669 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:50.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.669+0000 7f5f946ee700 1 -- 172.21.15.72:0/3683882616 >> v1:172.21.15.72:6816/118184 conn(0x7f5f7002bb60 legacy=0x7f5f7002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.669+0000 7f5f946ee700 1 -- 172.21.15.72:0/3683882616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c096610 msgr2=0x7f5f8c13a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:50.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.669+0000 7f5f946ee700 1 --2- 172.21.15.72:0/3683882616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c096610 0x7f5f8c13a7b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5f7c000c00 tx=0x7f5f7c007b90).stop 2023-10-03T10:09:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.669+0000 7f5f946ee700 1 -- 172.21.15.72:0/3683882616 shutdown_connections 2023-10-03T10:09:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.669+0000 7f5f946ee700 1 --2- 172.21.15.72:0/3683882616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8c096ee0 0x7f5f8c13aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.669+0000 7f5f946ee700 1 --2- 172.21.15.72:0/3683882616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0684f0 0x7f5f8c13a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.669+0000 7f5f946ee700 1 --2- 172.21.15.72:0/3683882616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c096610 0x7f5f8c13a7b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.669+0000 7f5f946ee700 1 -- 172.21.15.72:0/3683882616 >> 172.21.15.72:0/3683882616 conn(0x7f5f8c09a220 msgr2=0x7f5f8c099020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.669+0000 7f5f946ee700 1 -- 172.21.15.72:0/3683882616 shutdown_connections 2023-10-03T10:09:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:50.669+0000 7f5f946ee700 1 -- 172.21.15.72:0/3683882616 wait complete. 2023-10-03T10:09:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-03T10:09:50.681 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-03T10:09:49.878901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188964,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298396,"statfs":{"total":386547056640,"available":385329557504,"internally_reserved":0,"allocated":593920,"data_stored":173714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387453+0000","last_change":"2023-10-03T10:09:46.383964+0000","last_active":"2023-10-03T10:09:46.387453+0000","last_peered":"2023-10-03T10:09:46.387453+0000","last_clean":"2023-10-03T10:09:46.387453+0000","last_became_active":"2023-10-03T10:09:46.383681+0000","last_became_peered":"2023-10-03T10:09:46.383681+0000","last_unstale":"2023-10-03T10:09:46.387453+0000","last_undegraded":"2023-10-03T10:09:46.387453+0000","last_fullsized":"2023-10-03T10:09:46.387453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380623+0000","last_change":"2023-10-03T10:09:46.369230+0000","last_active":"2023-10-03T10:09:46.380623+0000","last_peered":"2023-10-03T10:09:46.380623+0000","last_clean":"2023-10-03T10:09:46.380623+0000","last_became_active":"2023-10-03T10:09:46.368861+0000","last_became_peered":"2023-10-03T10:09:46.368861+0000","last_unstale":"2023-10-03T10:09:46.380623+0000","last_undegraded":"2023-10-03T10:09:46.380623+0000","last_fullsized":"2023-10-03T10:09:46.380623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381586+0000","last_change":"2023-10-03T10:09:46.379410+0000","last_active":"2023-10-03T10:09:46.381586+0000","last_peered":"2023-10-03T10:09:46.381586+0000","last_clean":"2023-10-03T10:09:46.381586+0000","last_became_active":"2023-10-03T10:09:46.379027+0000","last_became_peered":"2023-10-03T10:09:46.379027+0000","last_unstale":"2023-10-03T10:09:46.381586+0000","last_undegraded":"2023-10-03T10:09:46.381586+0000","last_fullsized":"2023-10-03T10:09:46.381586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381478+0000","last_change":"2023-10-03T10:09:46.379505+0000","last_active":"2023-10-03T10:09:46.381478+0000","last_peered":"2023-10-03T10:09:46.381478+0000","last_clean":"2023-10-03T10:09:46.381478+0000","last_became_active":"2023-10-03T10:09:46.379187+0000","last_became_peered":"2023-10-03T10:09:46.379187+0000","last_unstale":"2023-10-03T10:09:46.381478+0000","last_undegraded":"2023-10-03T10:09:46.381478+0000","last_fullsized":"2023-10-03T10:09:46.381478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381407+0000","last_change":"2023-10-03T10:09:46.379819+0000","last_active":"2023-10-03T10:09:46.381407+0000","last_peered":"2023-10-03T10:09:46.381407+0000","last_clean":"2023-10-03T10:09:46.381407+0000","last_became_active":"2023-10-03T10:09:46.379555+0000","last_became_peered":"2023-10-03T10:09:46.379555+0000","last_unstale":"2023-10-03T10:09:46.381407+0000","last_undegraded":"2023-10-03T10:09:46.381407+0000","last_fullsized":"2023-10-03T10:09:46.381407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380669+0000","last_change":"2023-10-03T10:09:46.375928+0000","last_active":"2023-10-03T10:09:46.380669+0000","last_peered":"2023-10-03T10:09:46.380669+0000","last_clean":"2023-10-03T10:09:46.380669+0000","last_became_active":"2023-10-03T10:09:46.375325+0000","last_became_peered":"2023-10-03T10:09:46.375325+0000","last_unstale":"2023-10-03T10:09:46.380669+0000","last_undegraded":"2023-10-03T10:09:46.380669+0000","last_fullsized":"2023-10-03T10:09:46.380669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381546+0000","last_change":"2023-10-03T10:09:46.379935+0000","last_active":"2023-10-03T10:09:46.381546+0000","last_peered":"2023-10-03T10:09:46.381546+0000","last_clean":"2023-10-03T10:09:46.381546+0000","last_became_active":"2023-10-03T10:09:46.379431+0000","last_became_peered":"2023-10-03T10:09:46.379431+0000","last_unstale":"2023-10-03T10:09:46.381546+0000","last_undegraded":"2023-10-03T10:09:46.381546+0000","last_fullsized":"2023-10-03T10:09:46.381546+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377432+0000","last_change":"2023-10-03T10:09:46.372991+0000","last_active":"2023-10-03T10:09:46.377432+0000","last_peered":"2023-10-03T10:09:46.377432+0000","last_clean":"2023-10-03T10:09:46.377432+0000","last_became_active":"2023-10-03T10:09:46.372738+0000","last_became_peered":"2023-10-03T10:09:46.372738+0000","last_unstale":"2023-10-03T10:09:46.377432+0000","last_undegraded":"2023-10-03T10:09:46.377432+0000","last_fullsized":"2023-10-03T10:09:46.377432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377393+0000","last_change":"2023-10-03T10:09:46.372532+0000","last_active":"2023-10-03T10:09:46.377393+0000","last_peered":"2023-10-03T10:09:46.377393+0000","last_clean":"2023-10-03T10:09:46.377393+0000","last_became_active":"2023-10-03T10:09:46.372304+0000","last_became_peered":"2023-10-03T10:09:46.372304+0000","last_unstale":"2023-10-03T10:09:46.377393+0000","last_undegraded":"2023-10-03T10:09:46.377393+0000","last_fullsized":"2023-10-03T10:09:46.377393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387695+0000","last_change":"2023-10-03T10:09:46.384266+0000","last_active":"2023-10-03T10:09:46.387695+0000","last_peered":"2023-10-03T10:09:46.387695+0000","last_clean":"2023-10-03T10:09:46.387695+0000","last_became_active":"2023-10-03T10:09:46.383826+0000","last_became_peered":"2023-10-03T10:09:46.383826+0000","last_unstale":"2023-10-03T10:09:46.387695+0000","last_undegraded":"2023-10-03T10:09:46.387695+0000","last_fullsized":"2023-10-03T10:09:46.387695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388178+0000","last_change":"2023-10-03T10:09:46.384841+0000","last_active":"2023-10-03T10:09:46.388178+0000","last_peered":"2023-10-03T10:09:46.388178+0000","last_clean":"2023-10-03T10:09:46.388178+0000","last_became_active":"2023-10-03T10:09:46.384396+0000","last_became_peered":"2023-10-03T10:09:46.384396+0000","last_unstale":"2023-10-03T10:09:46.388178+0000","last_undegraded":"2023-10-03T10:09:46.388178+0000","last_fullsized":"2023-10-03T10:09:46.388178+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377458+0000","last_change":"2023-10-03T10:09:46.373837+0000","last_active":"2023-10-03T10:09:46.377458+0000","last_peered":"2023-10-03T10:09:46.377458+0000","last_clean":"2023-10-03T10:09:46.377458+0000","last_became_active":"2023-10-03T10:09:46.373580+0000","last_became_peered":"2023-10-03T10:09:46.373580+0000","last_unstale":"2023-10-03T10:09:46.377458+0000","last_undegraded":"2023-10-03T10:09:46.377458+0000","last_fullsized":"2023-10-03T10:09:46.377458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381796+0000","last_change":"2023-10-03T10:09:46.380527+0000","last_active":"2023-10-03T10:09:46.381796+0000","last_peered":"2023-10-03T10:09:46.381796+0000","last_clean":"2023-10-03T10:09:46.381796+0000","last_became_active":"2023-10-03T10:09:46.379198+0000","last_became_peered":"2023-10-03T10:09:46.379198+0000","last_unstale":"2023-10-03T10:09:46.381796+0000","last_undegraded":"2023-10-03T10:09:46.381796+0000","last_fullsized":"2023-10-03T10:09:46.381796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381563+0000","last_change":"2023-10-03T10:09:46.380089+0000","last_active":"2023-10-03T10:09:46.381563+0000","last_peered":"2023-10-03T10:09:46.381563+0000","last_clean":"2023-10-03T10:09:46.381563+0000","last_became_active":"2023-10-03T10:09:46.379696+0000","last_became_peered":"2023-10-03T10:09:46.379696+0000","last_unstale":"2023-10-03T10:09:46.381563+0000","last_undegraded":"2023-10-03T10:09:46.381563+0000","last_fullsized":"2023-10-03T10:09:46.381563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.375967+0000","last_change":"2023-10-03T10:09:46.374686+0000","last_active":"2023-10-03T10:09:46.375967+0000","last_peered":"2023-10-03T10:09:46.375967+0000","last_clean":"2023-10-03T10:09:46.375967+0000","last_became_active":"2023-10-03T10:09:46.371287+0000","last_became_peered":"2023-10-03T10:09:46.371287+0000","last_unstale":"2023-10-03T10:09:46.375967+0000","last_undegraded":"2023-10-03T10:09:46.375967+0000","last_fullsized":"2023-10-03T10:09:46.375967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366160+0000","last_change":"2023-10-03T10:09:46.364615+0000","last_active":"2023-10-03T10:09:46.366160+0000","last_peered":"2023-10-03T10:09:46.366160+0000","last_clean":"2023-10-03T10:09:46.366160+0000","last_became_active":"2023-10-03T10:09:46.364379+0000","last_became_peered":"2023-10-03T10:09:46.364379+0000","last_unstale":"2023-10-03T10:09:46.366160+0000","last_undegraded":"2023-10-03T10:09:46.366160+0000","last_fullsized":"2023-10-03T10:09:46.366160+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.391649+0000","last_change":"2023-10-03T10:09:46.388555+0000","last_active":"2023-10-03T10:09:46.391649+0000","last_peered":"2023-10-03T10:09:46.391649+0000","last_clean":"2023-10-03T10:09:46.391649+0000","last_became_active":"2023-10-03T10:09:46.388278+0000","last_became_peered":"2023-10-03T10:09:46.388278+0000","last_unstale":"2023-10-03T10:09:46.391649+0000","last_undegraded":"2023-10-03T10:09:46.391649+0000","last_fullsized":"2023-10-03T10:09:46.391649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.375782+0000","last_change":"2023-10-03T10:09:46.367061+0000","last_active":"2023-10-03T10:09:46.375782+0000","last_peered":"2023-10-03T10:09:46.375782+0000","last_clean":"2023-10-03T10:09:46.375782+0000","last_became_active":"2023-10-03T10:09:46.366790+0000","last_became_peered":"2023-10-03T10:09:46.366790+0000","last_unstale":"2023-10-03T10:09:46.375782+0000","last_undegraded":"2023-10-03T10:09:46.375782+0000","last_fullsized":"2023-10-03T10:09:46.375782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381350+0000","last_change":"2023-10-03T10:09:46.378399+0000","last_active":"2023-10-03T10:09:46.381350+0000","last_peered":"2023-10-03T10:09:46.381350+0000","last_clean":"2023-10-03T10:09:46.381350+0000","last_became_active":"2023-10-03T10:09:46.378102+0000","last_became_peered":"2023-10-03T10:09:46.378102+0000","last_unstale":"2023-10-03T10:09:46.381350+0000","last_undegraded":"2023-10-03T10:09:46.381350+0000","last_fullsized":"2023-10-03T10:09:46.381350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380689+0000","last_change":"2023-10-03T10:09:46.375958+0000","last_active":"2023-10-03T10:09:46.380689+0000","last_peered":"2023-10-03T10:09:46.380689+0000","last_clean":"2023-10-03T10:09:46.380689+0000","last_became_active":"2023-10-03T10:09:46.375553+0000","last_became_peered":"2023-10-03T10:09:46.375553+0000","last_unstale":"2023-10-03T10:09:46.380689+0000","last_undegraded":"2023-10-03T10:09:46.380689+0000","last_fullsized":"2023-10-03T10:09:46.380689+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377238+0000","last_change":"2023-10-03T10:09:46.367258+0000","last_active":"2023-10-03T10:09:46.377238+0000","last_peered":"2023-10-03T10:09:46.377238+0000","last_clean":"2023-10-03T10:09:46.377238+0000","last_became_active":"2023-10-03T10:09:46.366828+0000","last_became_peered":"2023-10-03T10:09:46.366828+0000","last_unstale":"2023-10-03T10:09:46.377238+0000","last_undegraded":"2023-10-03T10:09:46.377238+0000","last_fullsized":"2023-10-03T10:09:46.377238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377457+0000","last_change":"2023-10-03T10:09:46.374039+0000","last_active":"2023-10-03T10:09:46.377457+0000","last_peered":"2023-10-03T10:09:46.377457+0000","last_clean":"2023-10-03T10:09:46.377457+0000","last_became_active":"2023-10-03T10:09:46.373585+0000","last_became_peered":"2023-10-03T10:09:46.373585+0000","last_unstale":"2023-10-03T10:09:46.377457+0000","last_undegraded":"2023-10-03T10:09:46.377457+0000","last_fullsized":"2023-10-03T10:09:46.377457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.373297+0000","last_change":"2023-10-03T10:09:45.994509+0000","last_active":"2023-10-03T10:09:46.373297+0000","last_peered":"2023-10-03T10:09:46.373297+0000","last_clean":"2023-10-03T10:09:46.373297+0000","last_became_active":"2023-10-03T10:09:45.994047+0000","last_became_peered":"2023-10-03T10:09:45.994047+0000","last_unstale":"2023-10-03T10:09:46.373297+0000","last_undegraded":"2023-10-03T10:09:46.373297+0000","last_fullsized":"2023-10-03T10:09:46.373297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.350498+0000","last_change":"2023-10-03T10:09:46.005851+0000","last_active":"2023-10-03T10:09:46.350498+0000","last_peered":"2023-10-03T10:09:46.350498+0000","last_clean":"2023-10-03T10:09:46.350498+0000","last_became_active":"2023-10-03T10:09:46.005573+0000","last_became_peered":"2023-10-03T10:09:46.005573+0000","last_unstale":"2023-10-03T10:09:46.350498+0000","last_undegraded":"2023-10-03T10:09:46.350498+0000","last_fullsized":"2023-10-03T10:09:46.350498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381389+0000","last_change":"2023-10-03T10:09:46.378806+0000","last_active":"2023-10-03T10:09:46.381389+0000","last_peered":"2023-10-03T10:09:46.381389+0000","last_clean":"2023-10-03T10:09:46.381389+0000","last_became_active":"2023-10-03T10:09:46.378564+0000","last_became_peered":"2023-10-03T10:09:46.378564+0000","last_unstale":"2023-10-03T10:09:46.381389+0000","last_undegraded":"2023-10-03T10:09:46.381389+0000","last_fullsized":"2023-10-03T10:09:46.381389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.370555+0000","last_change":"2023-10-03T10:09:46.003890+0000","last_active":"2023-10-03T10:09:46.370555+0000","last_peered":"2023-10-03T10:09:46.370555+0000","last_clean":"2023-10-03T10:09:46.370555+0000","last_became_active":"2023-10-03T10:09:46.002821+0000","last_became_peered":"2023-10-03T10:09:46.002821+0000","last_unstale":"2023-10-03T10:09:46.370555+0000","last_undegraded":"2023-10-03T10:09:46.370555+0000","last_fullsized":"2023-10-03T10:09:46.370555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354415+0000","last_change":"2023-10-03T10:09:46.002155+0000","last_active":"2023-10-03T10:09:46.354415+0000","last_peered":"2023-10-03T10:09:46.354415+0000","last_clean":"2023-10-03T10:09:46.354415+0000","last_became_active":"2023-10-03T10:09:46.001872+0000","last_became_peered":"2023-10-03T10:09:46.001872+0000","last_unstale":"2023-10-03T10:09:46.354415+0000","last_undegraded":"2023-10-03T10:09:46.354415+0000","last_fullsized":"2023-10-03T10:09:46.354415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.395252+0000","last_change":"2023-10-03T10:09:46.001705+0000","last_active":"2023-10-03T10:09:46.395252+0000","last_peered":"2023-10-03T10:09:46.395252+0000","last_clean":"2023-10-03T10:09:46.395252+0000","last_became_active":"2023-10-03T10:09:46.001338+0000","last_became_peered":"2023-10-03T10:09:46.001338+0000","last_unstale":"2023-10-03T10:09:46.395252+0000","last_undegraded":"2023-10-03T10:09:46.395252+0000","last_fullsized":"2023-10-03T10:09:46.395252+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.397119+0000","last_change":"2023-10-03T10:09:46.392590+0000","last_active":"2023-10-03T10:09:46.397119+0000","last_peered":"2023-10-03T10:09:46.397119+0000","last_clean":"2023-10-03T10:09:46.397119+0000","last_became_active":"2023-10-03T10:09:46.392268+0000","last_became_peered":"2023-10-03T10:09:46.392268+0000","last_unstale":"2023-10-03T10:09:46.397119+0000","last_undegraded":"2023-10-03T10:09:46.397119+0000","last_fullsized":"2023-10-03T10:09:46.397119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388193+0000","last_change":"2023-10-03T10:09:46.385651+0000","last_active":"2023-10-03T10:09:46.388193+0000","last_peered":"2023-10-03T10:09:46.388193+0000","last_clean":"2023-10-03T10:09:46.388193+0000","last_became_active":"2023-10-03T10:09:46.383900+0000","last_became_peered":"2023-10-03T10:09:46.383900+0000","last_unstale":"2023-10-03T10:09:46.388193+0000","last_undegraded":"2023-10-03T10:09:46.388193+0000","last_fullsized":"2023-10-03T10:09:46.388193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.364595+0000","last_change":"2023-10-03T10:09:45.999722+0000","last_active":"2023-10-03T10:09:46.364595+0000","last_peered":"2023-10-03T10:09:46.364595+0000","last_clean":"2023-10-03T10:09:46.364595+0000","last_became_active":"2023-10-03T10:09:45.999450+0000","last_became_peered":"2023-10-03T10:09:45.999450+0000","last_unstale":"2023-10-03T10:09:46.364595+0000","last_undegraded":"2023-10-03T10:09:46.364595+0000","last_fullsized":"2023-10-03T10:09:46.364595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381433+0000","last_change":"2023-10-03T10:09:46.379295+0000","last_active":"2023-10-03T10:09:46.381433+0000","last_peered":"2023-10-03T10:09:46.381433+0000","last_clean":"2023-10-03T10:09:46.381433+0000","last_became_active":"2023-10-03T10:09:46.370639+0000","last_became_peered":"2023-10-03T10:09:46.370639+0000","last_unstale":"2023-10-03T10:09:46.381433+0000","last_undegraded":"2023-10-03T10:09:46.381433+0000","last_fullsized":"2023-10-03T10:09:46.381433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377345+0000","last_change":"2023-10-03T10:09:45.991739+0000","last_active":"2023-10-03T10:09:46.377345+0000","last_peered":"2023-10-03T10:09:46.377345+0000","last_clean":"2023-10-03T10:09:46.377345+0000","last_became_active":"2023-10-03T10:09:45.991195+0000","last_became_peered":"2023-10-03T10:09:45.991195+0000","last_unstale":"2023-10-03T10:09:46.377345+0000","last_undegraded":"2023-10-03T10:09:46.377345+0000","last_fullsized":"2023-10-03T10:09:46.377345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381508+0000","last_change":"2023-10-03T10:09:46.004494+0000","last_active":"2023-10-03T10:09:46.381508+0000","last_peered":"2023-10-03T10:09:46.381508+0000","last_clean":"2023-10-03T10:09:46.381508+0000","last_became_active":"2023-10-03T10:09:46.004166+0000","last_became_peered":"2023-10-03T10:09:46.004166+0000","last_unstale":"2023-10-03T10:09:46.381508+0000","last_undegraded":"2023-10-03T10:09:46.381508+0000","last_fullsized":"2023-10-03T10:09:46.381508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.372772+0000","last_change":"2023-10-03T10:09:45.995572+0000","last_active":"2023-10-03T10:09:46.372772+0000","last_peered":"2023-10-03T10:09:46.372772+0000","last_clean":"2023-10-03T10:09:46.372772+0000","last_became_active":"2023-10-03T10:09:45.995093+0000","last_became_peered":"2023-10-03T10:09:45.995093+0000","last_unstale":"2023-10-03T10:09:46.372772+0000","last_undegraded":"2023-10-03T10:09:46.372772+0000","last_fullsized":"2023-10-03T10:09:46.372772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366121+0000","last_change":"2023-10-03T10:09:46.362868+0000","last_active":"2023-10-03T10:09:46.366121+0000","last_peered":"2023-10-03T10:09:46.366121+0000","last_clean":"2023-10-03T10:09:46.366121+0000","last_became_active":"2023-10-03T10:09:46.362550+0000","last_became_peered":"2023-10-03T10:09:46.362550+0000","last_unstale":"2023-10-03T10:09:46.366121+0000","last_undegraded":"2023-10-03T10:09:46.366121+0000","last_fullsized":"2023-10-03T10:09:46.366121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388581+0000","last_change":"2023-10-03T10:09:46.387104+0000","last_active":"2023-10-03T10:09:46.388581+0000","last_peered":"2023-10-03T10:09:46.388581+0000","last_clean":"2023-10-03T10:09:46.388581+0000","last_became_active":"2023-10-03T10:09:46.386697+0000","last_became_peered":"2023-10-03T10:09:46.386697+0000","last_unstale":"2023-10-03T10:09:46.388581+0000","last_undegraded":"2023-10-03T10:09:46.388581+0000","last_fullsized":"2023-10-03T10:09:46.388581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.365183+0000","last_change":"2023-10-03T10:09:46.001474+0000","last_active":"2023-10-03T10:09:46.365183+0000","last_peered":"2023-10-03T10:09:46.365183+0000","last_clean":"2023-10-03T10:09:46.365183+0000","last_became_active":"2023-10-03T10:09:46.001185+0000","last_became_peered":"2023-10-03T10:09:46.001185+0000","last_unstale":"2023-10-03T10:09:46.365183+0000","last_undegraded":"2023-10-03T10:09:46.365183+0000","last_fullsized":"2023-10-03T10:09:46.365183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381334+0000","last_change":"2023-10-03T10:09:46.378394+0000","last_active":"2023-10-03T10:09:46.381334+0000","last_peered":"2023-10-03T10:09:46.381334+0000","last_clean":"2023-10-03T10:09:46.381334+0000","last_became_active":"2023-10-03T10:09:46.378115+0000","last_became_peered":"2023-10-03T10:09:46.378115+0000","last_unstale":"2023-10-03T10:09:46.381334+0000","last_undegraded":"2023-10-03T10:09:46.381334+0000","last_fullsized":"2023-10-03T10:09:46.381334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387177+0000","last_change":"2023-10-03T10:09:46.385399+0000","last_active":"2023-10-03T10:09:46.387177+0000","last_peered":"2023-10-03T10:09:46.387177+0000","last_clean":"2023-10-03T10:09:46.387177+0000","last_became_active":"2023-10-03T10:09:46.385110+0000","last_became_peered":"2023-10-03T10:09:46.385110+0000","last_unstale":"2023-10-03T10:09:46.387177+0000","last_undegraded":"2023-10-03T10:09:46.387177+0000","last_fullsized":"2023-10-03T10:09:46.387177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.389051+0000","last_change":"2023-10-03T10:09:46.387220+0000","last_active":"2023-10-03T10:09:46.389051+0000","last_peered":"2023-10-03T10:09:46.389051+0000","last_clean":"2023-10-03T10:09:46.389051+0000","last_became_active":"2023-10-03T10:09:46.384091+0000","last_became_peered":"2023-10-03T10:09:46.384091+0000","last_unstale":"2023-10-03T10:09:46.389051+0000","last_undegraded":"2023-10-03T10:09:46.389051+0000","last_fullsized":"2023-10-03T10:09:46.389051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377212+0000","last_change":"2023-10-03T10:09:46.367086+0000","last_active":"2023-10-03T10:09:46.377212+0000","last_peered":"2023-10-03T10:09:46.377212+0000","last_clean":"2023-10-03T10:09:46.377212+0000","last_became_active":"2023-10-03T10:09:46.366505+0000","last_became_peered":"2023-10-03T10:09:46.366505+0000","last_unstale":"2023-10-03T10:09:46.377212+0000","last_undegraded":"2023-10-03T10:09:46.377212+0000","last_fullsized":"2023-10-03T10:09:46.377212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.355579+0000","last_change":"2023-10-03T10:09:42.503202+0000","last_active":"2023-10-03T10:09:46.355579+0000","last_peered":"2023-10-03T10:09:46.355579+0000","last_clean":"2023-10-03T10:09:46.355579+0000","last_became_active":"2023-10-03T10:09:42.502700+0000","last_became_peered":"2023-10-03T10:09:42.502700+0000","last_unstale":"2023-10-03T10:09:46.355579+0000","last_undegraded":"2023-10-03T10:09:46.355579+0000","last_fullsized":"2023-10-03T10:09:46.355579+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352129+0000","last_change":"2023-10-03T10:09:45.995268+0000","last_active":"2023-10-03T10:09:46.352129+0000","last_peered":"2023-10-03T10:09:46.352129+0000","last_clean":"2023-10-03T10:09:46.352129+0000","last_became_active":"2023-10-03T10:09:45.994970+0000","last_became_peered":"2023-10-03T10:09:45.994970+0000","last_unstale":"2023-10-03T10:09:46.352129+0000","last_undegraded":"2023-10-03T10:09:46.352129+0000","last_fullsized":"2023-10-03T10:09:46.352129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.397141+0000","last_change":"2023-10-03T10:09:46.393198+0000","last_active":"2023-10-03T10:09:46.397141+0000","last_peered":"2023-10-03T10:09:46.397141+0000","last_clean":"2023-10-03T10:09:46.397141+0000","last_became_active":"2023-10-03T10:09:46.392876+0000","last_became_peered":"2023-10-03T10:09:46.392876+0000","last_unstale":"2023-10-03T10:09:46.397141+0000","last_undegraded":"2023-10-03T10:09:46.397141+0000","last_fullsized":"2023-10-03T10:09:46.397141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.947968+0000","last_change":"2023-10-03T10:09:41.940609+0000","last_active":"2023-10-03T10:09:41.947968+0000","last_peered":"2023-10-03T10:09:41.947968+0000","last_clean":"2023-10-03T10:09:41.947968+0000","last_became_active":"2023-10-03T10:09:41.940313+0000","last_became_peered":"2023-10-03T10:09:41.940313+0000","last_unstale":"2023-10-03T10:09:41.947968+0000","last_undegraded":"2023-10-03T10:09:41.947968+0000","last_fullsized":"2023-10-03T10:09:41.947968+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.364759+0000","last_change":"2023-10-03T10:09:45.987289+0000","last_active":"2023-10-03T10:09:46.364759+0000","last_peered":"2023-10-03T10:09:46.364759+0000","last_clean":"2023-10-03T10:09:46.364759+0000","last_became_active":"2023-10-03T10:09:45.987013+0000","last_became_peered":"2023-10-03T10:09:45.987013+0000","last_unstale":"2023-10-03T10:09:46.364759+0000","last_undegraded":"2023-10-03T10:09:46.364759+0000","last_fullsized":"2023-10-03T10:09:46.364759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377619+0000","last_change":"2023-10-03T10:09:46.371416+0000","last_active":"2023-10-03T10:09:46.377619+0000","last_peered":"2023-10-03T10:09:46.377619+0000","last_clean":"2023-10-03T10:09:46.377619+0000","last_became_active":"2023-10-03T10:09:46.370977+0000","last_became_peered":"2023-10-03T10:09:46.370977+0000","last_unstale":"2023-10-03T10:09:46.377619+0000","last_undegraded":"2023-10-03T10:09:46.377619+0000","last_fullsized":"2023-10-03T10:09:46.377619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352788+0000","last_change":"2023-10-03T10:09:41.940436+0000","last_active":"2023-10-03T10:09:46.352788+0000","last_peered":"2023-10-03T10:09:46.352788+0000","last_clean":"2023-10-03T10:09:46.352788+0000","last_became_active":"2023-10-03T10:09:41.940147+0000","last_became_peered":"2023-10-03T10:09:41.940147+0000","last_unstale":"2023-10-03T10:09:46.352788+0000","last_undegraded":"2023-10-03T10:09:46.352788+0000","last_fullsized":"2023-10-03T10:09:46.352788+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354234+0000","last_change":"2023-10-03T10:09:45.994184+0000","last_active":"2023-10-03T10:09:46.354234+0000","last_peered":"2023-10-03T10:09:46.354234+0000","last_clean":"2023-10-03T10:09:46.354234+0000","last_became_active":"2023-10-03T10:09:45.993699+0000","last_became_peered":"2023-10-03T10:09:45.993699+0000","last_unstale":"2023-10-03T10:09:46.354234+0000","last_undegraded":"2023-10-03T10:09:46.354234+0000","last_fullsized":"2023-10-03T10:09:46.354234+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377610+0000","last_change":"2023-10-03T10:09:46.372991+0000","last_active":"2023-10-03T10:09:46.377610+0000","last_peered":"2023-10-03T10:09:46.377610+0000","last_clean":"2023-10-03T10:09:46.377610+0000","last_became_active":"2023-10-03T10:09:46.372753+0000","last_became_peered":"2023-10-03T10:09:46.372753+0000","last_unstale":"2023-10-03T10:09:46.377610+0000","last_undegraded":"2023-10-03T10:09:46.377610+0000","last_fullsized":"2023-10-03T10:09:46.377610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.948007+0000","last_change":"2023-10-03T10:09:41.941185+0000","last_active":"2023-10-03T10:09:41.948007+0000","last_peered":"2023-10-03T10:09:41.948007+0000","last_clean":"2023-10-03T10:09:41.948007+0000","last_became_active":"2023-10-03T10:09:41.940930+0000","last_became_peered":"2023-10-03T10:09:41.940930+0000","last_unstale":"2023-10-03T10:09:41.948007+0000","last_undegraded":"2023-10-03T10:09:41.948007+0000","last_fullsized":"2023-10-03T10:09:41.948007+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354131+0000","last_change":"2023-10-03T10:09:40.948442+0000","last_active":"2023-10-03T10:09:46.354131+0000","last_peered":"2023-10-03T10:09:46.354131+0000","last_clean":"2023-10-03T10:09:46.354131+0000","last_became_active":"2023-10-03T10:09:40.948068+0000","last_became_peered":"2023-10-03T10:09:40.948068+0000","last_unstale":"2023-10-03T10:09:46.354131+0000","last_undegraded":"2023-10-03T10:09:46.354131+0000","last_fullsized":"2023-10-03T10:09:46.354131+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_clean_scrub_stamp":"2023-10-03T10:09:39.928111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:41.947965+0000","last_change":"2023-10-03T10:09:41.940561+0000","last_active":"2023-10-03T10:09:41.947965+0000","last_peered":"2023-10-03T10:09:41.947965+0000","last_clean":"2023-10-03T10:09:41.947965+0000","last_became_active":"2023-10-03T10:09:41.940202+0000","last_became_peered":"2023-10-03T10:09:41.940202+0000","last_unstale":"2023-10-03T10:09:41.947965+0000","last_undegraded":"2023-10-03T10:09:41.947965+0000","last_fullsized":"2023-10-03T10:09:41.947965+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.367791+0000","last_change":"2023-10-03T10:09:45.987278+0000","last_active":"2023-10-03T10:09:46.367791+0000","last_peered":"2023-10-03T10:09:46.367791+0000","last_clean":"2023-10-03T10:09:46.367791+0000","last_became_active":"2023-10-03T10:09:45.986993+0000","last_became_peered":"2023-10-03T10:09:45.986993+0000","last_unstale":"2023-10-03T10:09:46.367791+0000","last_undegraded":"2023-10-03T10:09:46.367791+0000","last_fullsized":"2023-10-03T10:09:46.367791+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381370+0000","last_change":"2023-10-03T10:09:46.378722+0000","last_active":"2023-10-03T10:09:46.381370+0000","last_peered":"2023-10-03T10:09:46.381370+0000","last_clean":"2023-10-03T10:09:46.381370+0000","last_became_active":"2023-10-03T10:09:46.378186+0000","last_became_peered":"2023-10-03T10:09:46.378186+0000","last_unstale":"2023-10-03T10:09:46.381370+0000","last_undegraded":"2023-10-03T10:09:46.381370+0000","last_fullsized":"2023-10-03T10:09:46.381370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:42.506148+0000","last_change":"2023-10-03T10:09:42.502984+0000","last_active":"2023-10-03T10:09:42.506148+0000","last_peered":"2023-10-03T10:09:42.506148+0000","last_clean":"2023-10-03T10:09:42.506148+0000","last_became_active":"2023-10-03T10:09:42.502699+0000","last_became_peered":"2023-10-03T10:09:42.502699+0000","last_unstale":"2023-10-03T10:09:42.506148+0000","last_undegraded":"2023-10-03T10:09:42.506148+0000","last_fullsized":"2023-10-03T10:09:42.506148+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.355380+0000","last_change":"2023-10-03T10:09:45.995626+0000","last_active":"2023-10-03T10:09:46.355380+0000","last_peered":"2023-10-03T10:09:46.355380+0000","last_clean":"2023-10-03T10:09:46.355380+0000","last_became_active":"2023-10-03T10:09:45.995322+0000","last_became_peered":"2023-10-03T10:09:45.995322+0000","last_unstale":"2023-10-03T10:09:46.355380+0000","last_undegraded":"2023-10-03T10:09:46.355380+0000","last_fullsized":"2023-10-03T10:09:46.355380+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.375920+0000","last_change":"2023-10-03T10:09:46.371217+0000","last_active":"2023-10-03T10:09:46.375920+0000","last_peered":"2023-10-03T10:09:46.375920+0000","last_clean":"2023-10-03T10:09:46.375920+0000","last_became_active":"2023-10-03T10:09:46.370285+0000","last_became_peered":"2023-10-03T10:09:46.370285+0000","last_unstale":"2023-10-03T10:09:46.375920+0000","last_undegraded":"2023-10-03T10:09:46.375920+0000","last_fullsized":"2023-10-03T10:09:46.375920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.350860+0000","last_change":"2023-10-03T10:09:42.503022+0000","last_active":"2023-10-03T10:09:46.350860+0000","last_peered":"2023-10-03T10:09:46.350860+0000","last_clean":"2023-10-03T10:09:46.350860+0000","last_became_active":"2023-10-03T10:09:42.502739+0000","last_became_peered":"2023-10-03T10:09:42.502739+0000","last_unstale":"2023-10-03T10:09:46.350860+0000","last_undegraded":"2023-10-03T10:09:46.350860+0000","last_fullsized":"2023-10-03T10:09:46.350860+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:09:42.506333+0000","last_change":"2023-10-03T10:09:42.503368+0000","last_active":"2023-10-03T10:09:42.506333+0000","last_peered":"2023-10-03T10:09:42.506333+0000","last_clean":"2023-10-03T10:09:42.506333+0000","last_became_active":"2023-10-03T10:09:42.503090+0000","last_became_peered":"2023-10-03T10:09:42.503090+0000","last_unstale":"2023-10-03T10:09:42.506333+0000","last_undegraded":"2023-10-03T10:09:42.506333+0000","last_fullsized":"2023-10-03T10:09:42.506333+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.371581+0000","last_change":"2023-10-03T10:09:46.003516+0000","last_active":"2023-10-03T10:09:46.371581+0000","last_peered":"2023-10-03T10:09:46.371581+0000","last_clean":"2023-10-03T10:09:46.371581+0000","last_became_active":"2023-10-03T10:09:46.003227+0000","last_became_peered":"2023-10-03T10:09:46.003227+0000","last_unstale":"2023-10-03T10:09:46.371581+0000","last_undegraded":"2023-10-03T10:09:46.371581+0000","last_fullsized":"2023-10-03T10:09:46.371581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366737+0000","last_change":"2023-10-03T10:09:46.365107+0000","last_active":"2023-10-03T10:09:46.366737+0000","last_peered":"2023-10-03T10:09:46.366737+0000","last_clean":"2023-10-03T10:09:46.366737+0000","last_became_active":"2023-10-03T10:09:46.364877+0000","last_became_peered":"2023-10-03T10:09:46.364877+0000","last_unstale":"2023-10-03T10:09:46.366737+0000","last_undegraded":"2023-10-03T10:09:46.366737+0000","last_fullsized":"2023-10-03T10:09:46.366737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388998+0000","last_change":"2023-10-03T10:09:46.003786+0000","last_active":"2023-10-03T10:09:46.388998+0000","last_peered":"2023-10-03T10:09:46.388998+0000","last_clean":"2023-10-03T10:09:46.388998+0000","last_became_active":"2023-10-03T10:09:46.003506+0000","last_became_peered":"2023-10-03T10:09:46.003506+0000","last_unstale":"2023-10-03T10:09:46.388998+0000","last_undegraded":"2023-10-03T10:09:46.388998+0000","last_fullsized":"2023-10-03T10:09:46.388998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380939+0000","last_change":"2023-10-03T10:09:46.376808+0000","last_active":"2023-10-03T10:09:46.380939+0000","last_peered":"2023-10-03T10:09:46.380939+0000","last_clean":"2023-10-03T10:09:46.380939+0000","last_became_active":"2023-10-03T10:09:46.376414+0000","last_became_peered":"2023-10-03T10:09:46.376414+0000","last_unstale":"2023-10-03T10:09:46.380939+0000","last_undegraded":"2023-10-03T10:09:46.380939+0000","last_fullsized":"2023-10-03T10:09:46.380939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.374191+0000","last_change":"2023-10-03T10:09:45.992104+0000","last_active":"2023-10-03T10:09:46.374191+0000","last_peered":"2023-10-03T10:09:46.374191+0000","last_clean":"2023-10-03T10:09:46.374191+0000","last_became_active":"2023-10-03T10:09:45.991796+0000","last_became_peered":"2023-10-03T10:09:45.991796+0000","last_unstale":"2023-10-03T10:09:46.374191+0000","last_undegraded":"2023-10-03T10:09:46.374191+0000","last_fullsized":"2023-10-03T10:09:46.374191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387640+0000","last_change":"2023-10-03T10:09:46.384662+0000","last_active":"2023-10-03T10:09:46.387640+0000","last_peered":"2023-10-03T10:09:46.387640+0000","last_clean":"2023-10-03T10:09:46.387640+0000","last_became_active":"2023-10-03T10:09:46.384347+0000","last_became_peered":"2023-10-03T10:09:46.384347+0000","last_unstale":"2023-10-03T10:09:46.387640+0000","last_undegraded":"2023-10-03T10:09:46.387640+0000","last_fullsized":"2023-10-03T10:09:46.387640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388600+0000","last_change":"2023-10-03T10:09:46.387130+0000","last_active":"2023-10-03T10:09:46.388600+0000","last_peered":"2023-10-03T10:09:46.388600+0000","last_clean":"2023-10-03T10:09:46.388600+0000","last_became_active":"2023-10-03T10:09:46.386801+0000","last_became_peered":"2023-10-03T10:09:46.386801+0000","last_unstale":"2023-10-03T10:09:46.388600+0000","last_undegraded":"2023-10-03T10:09:46.388600+0000","last_fullsized":"2023-10-03T10:09:46.388600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:44.967552+0000","last_change":"2023-10-03T10:09:44.967552+0000","last_active":"2023-10-03T10:09:44.967552+0000","last_peered":"2023-10-03T10:09:44.967552+0000","last_clean":"2023-10-03T10:09:44.967552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:44.967552+0000","last_undegraded":"2023-10-03T10:09:44.967552+0000","last_fullsized":"2023-10-03T10:09:44.967552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381665+0000","last_change":"2023-10-03T10:09:46.004241+0000","last_active":"2023-10-03T10:09:46.381665+0000","last_peered":"2023-10-03T10:09:46.381665+0000","last_clean":"2023-10-03T10:09:46.381665+0000","last_became_active":"2023-10-03T10:09:46.003370+0000","last_became_peered":"2023-10-03T10:09:46.003370+0000","last_unstale":"2023-10-03T10:09:46.381665+0000","last_undegraded":"2023-10-03T10:09:46.381665+0000","last_fullsized":"2023-10-03T10:09:46.381665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380871+0000","last_change":"2023-10-03T10:09:46.374808+0000","last_active":"2023-10-03T10:09:46.380871+0000","last_peered":"2023-10-03T10:09:46.380871+0000","last_clean":"2023-10-03T10:09:46.380871+0000","last_became_active":"2023-10-03T10:09:46.374363+0000","last_became_peered":"2023-10-03T10:09:46.374363+0000","last_unstale":"2023-10-03T10:09:46.380871+0000","last_undegraded":"2023-10-03T10:09:46.380871+0000","last_fullsized":"2023-10-03T10:09:46.380871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377400+0000","last_change":"2023-10-03T10:09:46.371026+0000","last_active":"2023-10-03T10:09:46.377400+0000","last_peered":"2023-10-03T10:09:46.377400+0000","last_clean":"2023-10-03T10:09:46.377400+0000","last_became_active":"2023-10-03T10:09:46.370725+0000","last_became_peered":"2023-10-03T10:09:46.370725+0000","last_unstale":"2023-10-03T10:09:46.377400+0000","last_undegraded":"2023-10-03T10:09:46.377400+0000","last_fullsized":"2023-10-03T10:09:46.377400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387149+0000","last_change":"2023-10-03T10:09:46.385510+0000","last_active":"2023-10-03T10:09:46.387149+0000","last_peered":"2023-10-03T10:09:46.387149+0000","last_clean":"2023-10-03T10:09:46.387149+0000","last_became_active":"2023-10-03T10:09:46.385254+0000","last_became_peered":"2023-10-03T10:09:46.385254+0000","last_unstale":"2023-10-03T10:09:46.387149+0000","last_undegraded":"2023-10-03T10:09:46.387149+0000","last_fullsized":"2023-10-03T10:09:46.387149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:09:45.971109+0000","last_change":"2023-10-03T10:09:45.971109+0000","last_active":"2023-10-03T10:09:45.971109+0000","last_peered":"2023-10-03T10:09:45.971109+0000","last_clean":"2023-10-03T10:09:45.971109+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:09:45.971109+0000","last_undegraded":"2023-10-03T10:09:45.971109+0000","last_fullsized":"2023-10-03T10:09:45.971109+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377600+0000","last_change":"2023-10-03T10:09:46.371241+0000","last_active":"2023-10-03T10:09:46.377600+0000","last_peered":"2023-10-03T10:09:46.377600+0000","last_clean":"2023-10-03T10:09:46.377600+0000","last_became_active":"2023-10-03T10:09:46.370691+0000","last_became_peered":"2023-10-03T10:09:46.370691+0000","last_unstale":"2023-10-03T10:09:46.377600+0000","last_undegraded":"2023-10-03T10:09:46.377600+0000","last_fullsized":"2023-10-03T10:09:46.377600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":90,"acting":90,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":666,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":38,"acting":38,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":46930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:52.064 INFO:tasks.ceph.mds.a.smithi072.stderr:2023-10-03T10:09:52.064+0000 7f20c73db700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T10:09:53.687 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:53.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.816+0000 7f106e7c1700 1 Processor -- start 2023-10-03T10:09:53.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.816+0000 7f106e7c1700 1 -- start start 2023-10-03T10:09:53.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f106e7c1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1068123a90 0x7f1068123e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f106e7c1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1068067ce0 0x7f1068092340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f106e7c1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1068126f70 0x7f10681273f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f106e7c1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10680680c0 con 0x7f1068067ce0 2023-10-03T10:09:53.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f106e7c1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1068068880 con 0x7f1068126f70 2023-10-03T10:09:53.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f106e7c1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1068068c90 con 0x7f1068123a90 2023-10-03T10:09:53.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f10677fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1068067ce0 0x7f1068092340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f1067fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1068123a90 0x7f1068123e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f106cd5e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1068126f70 0x7f10681273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f1067fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1068123a90 0x7f1068123e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59264/0 (socket says 172.21.15.72:59264) 2023-10-03T10:09:53.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f10677fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1068067ce0 0x7f1068092340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33148/0 (socket says 172.21.15.72:33148) 2023-10-03T10:09:53.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f1067fff700 1 -- 172.21.15.72:0/1481379607 learned_addr learned my addr 172.21.15.72:0/1481379607 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:53.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f106cd5e700 1 -- 172.21.15.72:0/1481379607 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1068123a90 msgr2=0x7f1068123e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f106cd5e700 1 --2- 172.21.15.72:0/1481379607 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1068123a90 0x7f1068123e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f106cd5e700 1 -- 172.21.15.72:0/1481379607 >> v2:172.21.15.72:3300/0 conn(0x7f1068067ce0 msgr2=0x7f1068092340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f106cd5e700 1 --2- 172.21.15.72:0/1481379607 >> v2:172.21.15.72:3300/0 conn(0x7f1068067ce0 0x7f1068092340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f106cd5e700 1 -- 172.21.15.72:0/1481379607 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1068124430 con 0x7f1068126f70 2023-10-03T10:09:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f1067fff700 1 --2- 172.21.15.72:0/1481379607 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1068123a90 0x7f1068123e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.817+0000 7f10677fe700 1 --2- 172.21.15.72:0/1481379607 >> v2:172.21.15.72:3300/0 conn(0x7f1068067ce0 0x7f1068092340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.818+0000 7f106cd5e700 1 --2- 172.21.15.72:0/1481379607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1068126f70 0x7f10681273f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1060009e60 tx=0x7f1060009780).ready entity=mon.1 client_cookie=a5b66bc2bfe264e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.818+0000 7f1066ffd700 1 -- 172.21.15.72:0/1481379607 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000e070 con 0x7f1068126f70 2023-10-03T10:09:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.818+0000 7f1066ffd700 1 -- 172.21.15.72:0/1481379607 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106000bab0 con 0x7f1068126f70 2023-10-03T10:09:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.818+0000 7f1066ffd700 1 -- 172.21.15.72:0/1481379607 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000be30 con 0x7f1068126f70 2023-10-03T10:09:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.818+0000 7f106e7c1700 1 -- 172.21.15.72:0/1481379607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1068126f70 msgr2=0x7f10681273f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.818+0000 7f106e7c1700 1 --2- 172.21.15.72:0/1481379607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1068126f70 0x7f10681273f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1060009e60 tx=0x7f1060009780).stop 2023-10-03T10:09:53.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.818+0000 7f106e7c1700 1 -- 172.21.15.72:0/1481379607 shutdown_connections 2023-10-03T10:09:53.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.818+0000 7f106e7c1700 1 --2- 172.21.15.72:0/1481379607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1068126f70 0x7f10681273f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.818+0000 7f106e7c1700 1 --2- 172.21.15.72:0/1481379607 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1068123a90 0x7f1068123e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.818+0000 7f106e7c1700 1 --2- 172.21.15.72:0/1481379607 >> v2:172.21.15.72:3300/0 conn(0x7f1068067ce0 0x7f1068092340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.818+0000 7f106e7c1700 1 -- 172.21.15.72:0/1481379607 >> 172.21.15.72:0/1481379607 conn(0x7f106809a220 msgr2=0x7f106809a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:53.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.818+0000 7f106e7c1700 1 -- 172.21.15.72:0/1481379607 shutdown_connections 2023-10-03T10:09:53.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.818+0000 7f106e7c1700 1 -- 172.21.15.72:0/1481379607 wait complete. 2023-10-03T10:09:53.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.819+0000 7f106e7c1700 1 Processor -- start 2023-10-03T10:09:53.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.819+0000 7f106e7c1700 1 -- start start 2023-10-03T10:09:53.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f106e7c1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1068067ce0 0x7f1068111620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f106e7c1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1068123a90 0x7f1068111b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f106e7c1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1068126f70 0x7f1068112000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:53.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f106e7c1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10681124f0 con 0x7f1068067ce0 2023-10-03T10:09:53.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f106e7c1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1068118f70 con 0x7f1068126f70 2023-10-03T10:09:53.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f106e7c1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1068113370 con 0x7f1068123a90 2023-10-03T10:09:53.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f1067fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1068067ce0 0x7f1068111620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f1067fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1068067ce0 0x7f1068111620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33164/0 (socket says 172.21.15.72:33164) 2023-10-03T10:09:53.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f1067fff700 1 -- 172.21.15.72:0/1974987732 learned_addr learned my addr 172.21.15.72:0/1974987732 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:53.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f106cd5e700 1 --2- 172.21.15.72:0/1974987732 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1068126f70 0x7f1068112000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f10677fe700 1 --2- 172.21.15.72:0/1974987732 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1068123a90 0x7f1068111b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f1067fff700 1 -- 172.21.15.72:0/1974987732 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1068123a90 msgr2=0x7f1068111b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f1067fff700 1 --2- 172.21.15.72:0/1974987732 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1068123a90 0x7f1068111b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f1067fff700 1 -- 172.21.15.72:0/1974987732 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1068126f70 msgr2=0x7f1068112000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f1067fff700 1 --2- 172.21.15.72:0/1974987732 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1068126f70 0x7f1068112000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f1067fff700 1 -- 172.21.15.72:0/1974987732 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c0092a0 con 0x7f1068067ce0 2023-10-03T10:09:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f106cd5e700 1 --2- 172.21.15.72:0/1974987732 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1068126f70 0x7f1068112000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f1067fff700 1 --2- 172.21.15.72:0/1974987732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1068067ce0 0x7f1068111620 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1058006d00 tx=0x7f105800a2b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f104ffff700 1 -- 172.21.15.72:0/1974987732 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800c690 con 0x7f1068067ce0 2023-10-03T10:09:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f104ffff700 1 -- 172.21.15.72:0/1974987732 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105800c7f0 con 0x7f1068067ce0 2023-10-03T10:09:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f106e7c1700 1 -- 172.21.15.72:0/1974987732 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105800a510 con 0x7f1068067ce0 2023-10-03T10:09:53.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.820+0000 7f104ffff700 1 -- 172.21.15.72:0/1974987732 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800cb70 con 0x7f1068067ce0 2023-10-03T10:09:53.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.821+0000 7f106e7c1700 1 -- 172.21.15.72:0/1974987732 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1060009a20 con 0x7f1068067ce0 2023-10-03T10:09:53.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.821+0000 7f104ffff700 1 -- 172.21.15.72:0/1974987732 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f105801a400 con 0x7f1068067ce0 2023-10-03T10:09:53.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.821+0000 7f104ffff700 1 -- 172.21.15.72:0/1974987732 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f105803b350 con 0x7f1068067ce0 2023-10-03T10:09:53.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.821+0000 7f106e7c1700 1 -- 172.21.15.72:0/1974987732 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1068119450 con 0x7f1068067ce0 2023-10-03T10:09:53.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.826+0000 7f104ffff700 1 -- 172.21.15.72:0/1974987732 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1068119450 con 0x7f1068067ce0 2023-10-03T10:09:53.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.983+0000 7f106e7c1700 1 -- 172.21.15.72:0/1974987732 --> v1:172.21.15.72:6816/118184 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1068119450 con 0x7f105402bb90 2023-10-03T10:09:53.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.990+0000 7f104ffff700 1 -- 172.21.15.72:0/1974987732 <== mgr.4102 v1:172.21.15.72:6816/118184 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249990 (unknown 2965378022 0 1809566884) 0x7f1068119450 con 0x7f105402bb90 2023-10-03T10:09:53.993 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:53.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.993+0000 7f106e7c1700 1 -- 172.21.15.72:0/1974987732 >> v1:172.21.15.72:6816/118184 conn(0x7f105402bb90 legacy=0x7f105402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.993+0000 7f106e7c1700 1 -- 172.21.15.72:0/1974987732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1068067ce0 msgr2=0x7f1068111620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:53.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.993+0000 7f106e7c1700 1 --2- 172.21.15.72:0/1974987732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1068067ce0 0x7f1068111620 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1058006d00 tx=0x7f105800a2b0).stop 2023-10-03T10:09:53.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.993+0000 7f106e7c1700 1 -- 172.21.15.72:0/1974987732 shutdown_connections 2023-10-03T10:09:53.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.993+0000 7f106e7c1700 1 --2- 172.21.15.72:0/1974987732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1068067ce0 0x7f1068111620 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.993+0000 7f106e7c1700 1 --2- 172.21.15.72:0/1974987732 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1068126f70 0x7f1068112000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.993+0000 7f106e7c1700 1 --2- 172.21.15.72:0/1974987732 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1068123a90 0x7f1068111b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:53.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.993+0000 7f106e7c1700 1 -- 172.21.15.72:0/1974987732 >> 172.21.15.72:0/1974987732 conn(0x7f106809a220 msgr2=0x7f1068066b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:53.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.993+0000 7f106e7c1700 1 -- 172.21.15.72:0/1974987732 shutdown_connections 2023-10-03T10:09:53.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:53.993+0000 7f106e7c1700 1 -- 172.21.15.72:0/1974987732 wait complete. 2023-10-03T10:09:53.996 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-03T10:09:54.005 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-03T10:09:53.879764+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189020,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298340,"statfs":{"total":386547056640,"available":385329500160,"internally_reserved":0,"allocated":651264,"data_stored":192439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000862"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387453+0000","last_change":"2023-10-03T10:09:46.383964+0000","last_active":"2023-10-03T10:09:46.387453+0000","last_peered":"2023-10-03T10:09:46.387453+0000","last_clean":"2023-10-03T10:09:46.387453+0000","last_became_active":"2023-10-03T10:09:46.383681+0000","last_became_peered":"2023-10-03T10:09:46.383681+0000","last_unstale":"2023-10-03T10:09:46.387453+0000","last_undegraded":"2023-10-03T10:09:46.387453+0000","last_fullsized":"2023-10-03T10:09:46.387453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380623+0000","last_change":"2023-10-03T10:09:46.369230+0000","last_active":"2023-10-03T10:09:46.380623+0000","last_peered":"2023-10-03T10:09:46.380623+0000","last_clean":"2023-10-03T10:09:46.380623+0000","last_became_active":"2023-10-03T10:09:46.368861+0000","last_became_peered":"2023-10-03T10:09:46.368861+0000","last_unstale":"2023-10-03T10:09:46.380623+0000","last_undegraded":"2023-10-03T10:09:46.380623+0000","last_fullsized":"2023-10-03T10:09:46.380623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381586+0000","last_change":"2023-10-03T10:09:46.379410+0000","last_active":"2023-10-03T10:09:46.381586+0000","last_peered":"2023-10-03T10:09:46.381586+0000","last_clean":"2023-10-03T10:09:46.381586+0000","last_became_active":"2023-10-03T10:09:46.379027+0000","last_became_peered":"2023-10-03T10:09:46.379027+0000","last_unstale":"2023-10-03T10:09:46.381586+0000","last_undegraded":"2023-10-03T10:09:46.381586+0000","last_fullsized":"2023-10-03T10:09:46.381586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381478+0000","last_change":"2023-10-03T10:09:46.379505+0000","last_active":"2023-10-03T10:09:46.381478+0000","last_peered":"2023-10-03T10:09:46.381478+0000","last_clean":"2023-10-03T10:09:46.381478+0000","last_became_active":"2023-10-03T10:09:46.379187+0000","last_became_peered":"2023-10-03T10:09:46.379187+0000","last_unstale":"2023-10-03T10:09:46.381478+0000","last_undegraded":"2023-10-03T10:09:46.381478+0000","last_fullsized":"2023-10-03T10:09:46.381478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381407+0000","last_change":"2023-10-03T10:09:46.379819+0000","last_active":"2023-10-03T10:09:46.381407+0000","last_peered":"2023-10-03T10:09:46.381407+0000","last_clean":"2023-10-03T10:09:46.381407+0000","last_became_active":"2023-10-03T10:09:46.379555+0000","last_became_peered":"2023-10-03T10:09:46.379555+0000","last_unstale":"2023-10-03T10:09:46.381407+0000","last_undegraded":"2023-10-03T10:09:46.381407+0000","last_fullsized":"2023-10-03T10:09:46.381407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392234+0000","last_change":"2023-10-03T10:09:46.385185+0000","last_active":"2023-10-03T10:09:46.392234+0000","last_peered":"2023-10-03T10:09:46.392234+0000","last_clean":"2023-10-03T10:09:46.392234+0000","last_became_active":"2023-10-03T10:09:46.384935+0000","last_became_peered":"2023-10-03T10:09:46.384935+0000","last_unstale":"2023-10-03T10:09:46.392234+0000","last_undegraded":"2023-10-03T10:09:46.392234+0000","last_fullsized":"2023-10-03T10:09:46.392234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387917+0000","last_change":"2023-10-03T10:09:46.378880+0000","last_active":"2023-10-03T10:09:46.387917+0000","last_peered":"2023-10-03T10:09:46.387917+0000","last_clean":"2023-10-03T10:09:46.387917+0000","last_became_active":"2023-10-03T10:09:46.375285+0000","last_became_peered":"2023-10-03T10:09:46.375285+0000","last_unstale":"2023-10-03T10:09:46.387917+0000","last_undegraded":"2023-10-03T10:09:46.387917+0000","last_fullsized":"2023-10-03T10:09:46.387917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380669+0000","last_change":"2023-10-03T10:09:46.375928+0000","last_active":"2023-10-03T10:09:46.380669+0000","last_peered":"2023-10-03T10:09:46.380669+0000","last_clean":"2023-10-03T10:09:46.380669+0000","last_became_active":"2023-10-03T10:09:46.375325+0000","last_became_peered":"2023-10-03T10:09:46.375325+0000","last_unstale":"2023-10-03T10:09:46.380669+0000","last_undegraded":"2023-10-03T10:09:46.380669+0000","last_fullsized":"2023-10-03T10:09:46.380669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381546+0000","last_change":"2023-10-03T10:09:46.379935+0000","last_active":"2023-10-03T10:09:46.381546+0000","last_peered":"2023-10-03T10:09:46.381546+0000","last_clean":"2023-10-03T10:09:46.381546+0000","last_became_active":"2023-10-03T10:09:46.379431+0000","last_became_peered":"2023-10-03T10:09:46.379431+0000","last_unstale":"2023-10-03T10:09:46.381546+0000","last_undegraded":"2023-10-03T10:09:46.381546+0000","last_fullsized":"2023-10-03T10:09:46.381546+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377432+0000","last_change":"2023-10-03T10:09:46.372991+0000","last_active":"2023-10-03T10:09:46.377432+0000","last_peered":"2023-10-03T10:09:46.377432+0000","last_clean":"2023-10-03T10:09:46.377432+0000","last_became_active":"2023-10-03T10:09:46.372738+0000","last_became_peered":"2023-10-03T10:09:46.372738+0000","last_unstale":"2023-10-03T10:09:46.377432+0000","last_undegraded":"2023-10-03T10:09:46.377432+0000","last_fullsized":"2023-10-03T10:09:46.377432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377393+0000","last_change":"2023-10-03T10:09:46.372532+0000","last_active":"2023-10-03T10:09:46.377393+0000","last_peered":"2023-10-03T10:09:46.377393+0000","last_clean":"2023-10-03T10:09:46.377393+0000","last_became_active":"2023-10-03T10:09:46.372304+0000","last_became_peered":"2023-10-03T10:09:46.372304+0000","last_unstale":"2023-10-03T10:09:46.377393+0000","last_undegraded":"2023-10-03T10:09:46.377393+0000","last_fullsized":"2023-10-03T10:09:46.377393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387695+0000","last_change":"2023-10-03T10:09:46.384266+0000","last_active":"2023-10-03T10:09:46.387695+0000","last_peered":"2023-10-03T10:09:46.387695+0000","last_clean":"2023-10-03T10:09:46.387695+0000","last_became_active":"2023-10-03T10:09:46.383826+0000","last_became_peered":"2023-10-03T10:09:46.383826+0000","last_unstale":"2023-10-03T10:09:46.387695+0000","last_undegraded":"2023-10-03T10:09:46.387695+0000","last_fullsized":"2023-10-03T10:09:46.387695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388178+0000","last_change":"2023-10-03T10:09:46.384841+0000","last_active":"2023-10-03T10:09:46.388178+0000","last_peered":"2023-10-03T10:09:46.388178+0000","last_clean":"2023-10-03T10:09:46.388178+0000","last_became_active":"2023-10-03T10:09:46.384396+0000","last_became_peered":"2023-10-03T10:09:46.384396+0000","last_unstale":"2023-10-03T10:09:46.388178+0000","last_undegraded":"2023-10-03T10:09:46.388178+0000","last_fullsized":"2023-10-03T10:09:46.388178+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377458+0000","last_change":"2023-10-03T10:09:46.373837+0000","last_active":"2023-10-03T10:09:46.377458+0000","last_peered":"2023-10-03T10:09:46.377458+0000","last_clean":"2023-10-03T10:09:46.377458+0000","last_became_active":"2023-10-03T10:09:46.373580+0000","last_became_peered":"2023-10-03T10:09:46.373580+0000","last_unstale":"2023-10-03T10:09:46.377458+0000","last_undegraded":"2023-10-03T10:09:46.377458+0000","last_fullsized":"2023-10-03T10:09:46.377458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381796+0000","last_change":"2023-10-03T10:09:46.380527+0000","last_active":"2023-10-03T10:09:46.381796+0000","last_peered":"2023-10-03T10:09:46.381796+0000","last_clean":"2023-10-03T10:09:46.381796+0000","last_became_active":"2023-10-03T10:09:46.379198+0000","last_became_peered":"2023-10-03T10:09:46.379198+0000","last_unstale":"2023-10-03T10:09:46.381796+0000","last_undegraded":"2023-10-03T10:09:46.381796+0000","last_fullsized":"2023-10-03T10:09:46.381796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366853+0000","last_change":"2023-10-03T10:09:46.365014+0000","last_active":"2023-10-03T10:09:46.366853+0000","last_peered":"2023-10-03T10:09:46.366853+0000","last_clean":"2023-10-03T10:09:46.366853+0000","last_became_active":"2023-10-03T10:09:46.363620+0000","last_became_peered":"2023-10-03T10:09:46.363620+0000","last_unstale":"2023-10-03T10:09:46.366853+0000","last_undegraded":"2023-10-03T10:09:46.366853+0000","last_fullsized":"2023-10-03T10:09:46.366853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381563+0000","last_change":"2023-10-03T10:09:46.380089+0000","last_active":"2023-10-03T10:09:46.381563+0000","last_peered":"2023-10-03T10:09:46.381563+0000","last_clean":"2023-10-03T10:09:46.381563+0000","last_became_active":"2023-10-03T10:09:46.379696+0000","last_became_peered":"2023-10-03T10:09:46.379696+0000","last_unstale":"2023-10-03T10:09:46.381563+0000","last_undegraded":"2023-10-03T10:09:46.381563+0000","last_fullsized":"2023-10-03T10:09:46.381563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.375967+0000","last_change":"2023-10-03T10:09:46.374686+0000","last_active":"2023-10-03T10:09:46.375967+0000","last_peered":"2023-10-03T10:09:46.375967+0000","last_clean":"2023-10-03T10:09:46.375967+0000","last_became_active":"2023-10-03T10:09:46.371287+0000","last_became_peered":"2023-10-03T10:09:46.371287+0000","last_unstale":"2023-10-03T10:09:46.375967+0000","last_undegraded":"2023-10-03T10:09:46.375967+0000","last_fullsized":"2023-10-03T10:09:46.375967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366160+0000","last_change":"2023-10-03T10:09:46.364615+0000","last_active":"2023-10-03T10:09:46.366160+0000","last_peered":"2023-10-03T10:09:46.366160+0000","last_clean":"2023-10-03T10:09:46.366160+0000","last_became_active":"2023-10-03T10:09:46.364379+0000","last_became_peered":"2023-10-03T10:09:46.364379+0000","last_unstale":"2023-10-03T10:09:46.366160+0000","last_undegraded":"2023-10-03T10:09:46.366160+0000","last_fullsized":"2023-10-03T10:09:46.366160+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.391649+0000","last_change":"2023-10-03T10:09:46.388555+0000","last_active":"2023-10-03T10:09:46.391649+0000","last_peered":"2023-10-03T10:09:46.391649+0000","last_clean":"2023-10-03T10:09:46.391649+0000","last_became_active":"2023-10-03T10:09:46.388278+0000","last_became_peered":"2023-10-03T10:09:46.388278+0000","last_unstale":"2023-10-03T10:09:46.391649+0000","last_undegraded":"2023-10-03T10:09:46.391649+0000","last_fullsized":"2023-10-03T10:09:46.391649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.375782+0000","last_change":"2023-10-03T10:09:46.367061+0000","last_active":"2023-10-03T10:09:46.375782+0000","last_peered":"2023-10-03T10:09:46.375782+0000","last_clean":"2023-10-03T10:09:46.375782+0000","last_became_active":"2023-10-03T10:09:46.366790+0000","last_became_peered":"2023-10-03T10:09:46.366790+0000","last_unstale":"2023-10-03T10:09:46.375782+0000","last_undegraded":"2023-10-03T10:09:46.375782+0000","last_fullsized":"2023-10-03T10:09:46.375782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381350+0000","last_change":"2023-10-03T10:09:46.378399+0000","last_active":"2023-10-03T10:09:46.381350+0000","last_peered":"2023-10-03T10:09:46.381350+0000","last_clean":"2023-10-03T10:09:46.381350+0000","last_became_active":"2023-10-03T10:09:46.378102+0000","last_became_peered":"2023-10-03T10:09:46.378102+0000","last_unstale":"2023-10-03T10:09:46.381350+0000","last_undegraded":"2023-10-03T10:09:46.381350+0000","last_fullsized":"2023-10-03T10:09:46.381350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387548+0000","last_change":"2023-10-03T10:09:46.378572+0000","last_active":"2023-10-03T10:09:46.387548+0000","last_peered":"2023-10-03T10:09:46.387548+0000","last_clean":"2023-10-03T10:09:46.387548+0000","last_became_active":"2023-10-03T10:09:46.378004+0000","last_became_peered":"2023-10-03T10:09:46.378004+0000","last_unstale":"2023-10-03T10:09:46.387548+0000","last_undegraded":"2023-10-03T10:09:46.387548+0000","last_fullsized":"2023-10-03T10:09:46.387548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380689+0000","last_change":"2023-10-03T10:09:46.375958+0000","last_active":"2023-10-03T10:09:46.380689+0000","last_peered":"2023-10-03T10:09:46.380689+0000","last_clean":"2023-10-03T10:09:46.380689+0000","last_became_active":"2023-10-03T10:09:46.375553+0000","last_became_peered":"2023-10-03T10:09:46.375553+0000","last_unstale":"2023-10-03T10:09:46.380689+0000","last_undegraded":"2023-10-03T10:09:46.380689+0000","last_fullsized":"2023-10-03T10:09:46.380689+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377238+0000","last_change":"2023-10-03T10:09:46.367258+0000","last_active":"2023-10-03T10:09:46.377238+0000","last_peered":"2023-10-03T10:09:46.377238+0000","last_clean":"2023-10-03T10:09:46.377238+0000","last_became_active":"2023-10-03T10:09:46.366828+0000","last_became_peered":"2023-10-03T10:09:46.366828+0000","last_unstale":"2023-10-03T10:09:46.377238+0000","last_undegraded":"2023-10-03T10:09:46.377238+0000","last_fullsized":"2023-10-03T10:09:46.377238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377457+0000","last_change":"2023-10-03T10:09:46.374039+0000","last_active":"2023-10-03T10:09:46.377457+0000","last_peered":"2023-10-03T10:09:46.377457+0000","last_clean":"2023-10-03T10:09:46.377457+0000","last_became_active":"2023-10-03T10:09:46.373585+0000","last_became_peered":"2023-10-03T10:09:46.373585+0000","last_unstale":"2023-10-03T10:09:46.377457+0000","last_undegraded":"2023-10-03T10:09:46.377457+0000","last_fullsized":"2023-10-03T10:09:46.377457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392051+0000","last_change":"2023-10-03T10:09:46.383307+0000","last_active":"2023-10-03T10:09:46.392051+0000","last_peered":"2023-10-03T10:09:46.392051+0000","last_clean":"2023-10-03T10:09:46.392051+0000","last_became_active":"2023-10-03T10:09:46.377010+0000","last_became_peered":"2023-10-03T10:09:46.377010+0000","last_unstale":"2023-10-03T10:09:46.392051+0000","last_undegraded":"2023-10-03T10:09:46.392051+0000","last_fullsized":"2023-10-03T10:09:46.392051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.373297+0000","last_change":"2023-10-03T10:09:45.994509+0000","last_active":"2023-10-03T10:09:46.373297+0000","last_peered":"2023-10-03T10:09:46.373297+0000","last_clean":"2023-10-03T10:09:46.373297+0000","last_became_active":"2023-10-03T10:09:45.994047+0000","last_became_peered":"2023-10-03T10:09:45.994047+0000","last_unstale":"2023-10-03T10:09:46.373297+0000","last_undegraded":"2023-10-03T10:09:46.373297+0000","last_fullsized":"2023-10-03T10:09:46.373297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.369857+0000","last_change":"2023-10-03T10:09:46.367594+0000","last_active":"2023-10-03T10:09:46.369857+0000","last_peered":"2023-10-03T10:09:46.369857+0000","last_clean":"2023-10-03T10:09:46.369857+0000","last_became_active":"2023-10-03T10:09:46.367029+0000","last_became_peered":"2023-10-03T10:09:46.367029+0000","last_unstale":"2023-10-03T10:09:46.369857+0000","last_undegraded":"2023-10-03T10:09:46.369857+0000","last_fullsized":"2023-10-03T10:09:46.369857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.350498+0000","last_change":"2023-10-03T10:09:46.005851+0000","last_active":"2023-10-03T10:09:46.350498+0000","last_peered":"2023-10-03T10:09:46.350498+0000","last_clean":"2023-10-03T10:09:46.350498+0000","last_became_active":"2023-10-03T10:09:46.005573+0000","last_became_peered":"2023-10-03T10:09:46.005573+0000","last_unstale":"2023-10-03T10:09:46.350498+0000","last_undegraded":"2023-10-03T10:09:46.350498+0000","last_fullsized":"2023-10-03T10:09:46.350498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381389+0000","last_change":"2023-10-03T10:09:46.378806+0000","last_active":"2023-10-03T10:09:46.381389+0000","last_peered":"2023-10-03T10:09:46.381389+0000","last_clean":"2023-10-03T10:09:46.381389+0000","last_became_active":"2023-10-03T10:09:46.378564+0000","last_became_peered":"2023-10-03T10:09:46.378564+0000","last_unstale":"2023-10-03T10:09:46.381389+0000","last_undegraded":"2023-10-03T10:09:46.381389+0000","last_fullsized":"2023-10-03T10:09:46.381389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.351237+0000","last_change":"2023-10-03T10:09:46.004262+0000","last_active":"2023-10-03T10:09:46.351237+0000","last_peered":"2023-10-03T10:09:46.351237+0000","last_clean":"2023-10-03T10:09:46.351237+0000","last_became_active":"2023-10-03T10:09:46.004006+0000","last_became_peered":"2023-10-03T10:09:46.004006+0000","last_unstale":"2023-10-03T10:09:46.351237+0000","last_undegraded":"2023-10-03T10:09:46.351237+0000","last_fullsized":"2023-10-03T10:09:46.351237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377866+0000","last_change":"2023-10-03T10:09:46.369027+0000","last_active":"2023-10-03T10:09:46.377866+0000","last_peered":"2023-10-03T10:09:46.377866+0000","last_clean":"2023-10-03T10:09:46.377866+0000","last_became_active":"2023-10-03T10:09:46.368802+0000","last_became_peered":"2023-10-03T10:09:46.368802+0000","last_unstale":"2023-10-03T10:09:46.377866+0000","last_undegraded":"2023-10-03T10:09:46.377866+0000","last_fullsized":"2023-10-03T10:09:46.377866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.370555+0000","last_change":"2023-10-03T10:09:46.003890+0000","last_active":"2023-10-03T10:09:46.370555+0000","last_peered":"2023-10-03T10:09:46.370555+0000","last_clean":"2023-10-03T10:09:46.370555+0000","last_became_active":"2023-10-03T10:09:46.002821+0000","last_became_peered":"2023-10-03T10:09:46.002821+0000","last_unstale":"2023-10-03T10:09:46.370555+0000","last_undegraded":"2023-10-03T10:09:46.370555+0000","last_fullsized":"2023-10-03T10:09:46.370555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.391996+0000","last_change":"2023-10-03T10:09:46.383127+0000","last_active":"2023-10-03T10:09:46.391996+0000","last_peered":"2023-10-03T10:09:46.391996+0000","last_clean":"2023-10-03T10:09:46.391996+0000","last_became_active":"2023-10-03T10:09:46.374331+0000","last_became_peered":"2023-10-03T10:09:46.374331+0000","last_unstale":"2023-10-03T10:09:46.391996+0000","last_undegraded":"2023-10-03T10:09:46.391996+0000","last_fullsized":"2023-10-03T10:09:46.391996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354415+0000","last_change":"2023-10-03T10:09:46.002155+0000","last_active":"2023-10-03T10:09:46.354415+0000","last_peered":"2023-10-03T10:09:46.354415+0000","last_clean":"2023-10-03T10:09:46.354415+0000","last_became_active":"2023-10-03T10:09:46.001872+0000","last_became_peered":"2023-10-03T10:09:46.001872+0000","last_unstale":"2023-10-03T10:09:46.354415+0000","last_undegraded":"2023-10-03T10:09:46.354415+0000","last_fullsized":"2023-10-03T10:09:46.354415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387900+0000","last_change":"2023-10-03T10:09:46.378713+0000","last_active":"2023-10-03T10:09:46.387900+0000","last_peered":"2023-10-03T10:09:46.387900+0000","last_clean":"2023-10-03T10:09:46.387900+0000","last_became_active":"2023-10-03T10:09:46.378310+0000","last_became_peered":"2023-10-03T10:09:46.378310+0000","last_unstale":"2023-10-03T10:09:46.387900+0000","last_undegraded":"2023-10-03T10:09:46.387900+0000","last_fullsized":"2023-10-03T10:09:46.387900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.395252+0000","last_change":"2023-10-03T10:09:46.001705+0000","last_active":"2023-10-03T10:09:46.395252+0000","last_peered":"2023-10-03T10:09:46.395252+0000","last_clean":"2023-10-03T10:09:46.395252+0000","last_became_active":"2023-10-03T10:09:46.001338+0000","last_became_peered":"2023-10-03T10:09:46.001338+0000","last_unstale":"2023-10-03T10:09:46.395252+0000","last_undegraded":"2023-10-03T10:09:46.395252+0000","last_fullsized":"2023-10-03T10:09:46.395252+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.397119+0000","last_change":"2023-10-03T10:09:46.392590+0000","last_active":"2023-10-03T10:09:46.397119+0000","last_peered":"2023-10-03T10:09:46.397119+0000","last_clean":"2023-10-03T10:09:46.397119+0000","last_became_active":"2023-10-03T10:09:46.392268+0000","last_became_peered":"2023-10-03T10:09:46.392268+0000","last_unstale":"2023-10-03T10:09:46.397119+0000","last_undegraded":"2023-10-03T10:09:46.397119+0000","last_fullsized":"2023-10-03T10:09:46.397119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.397652+0000","last_change":"2023-10-03T10:09:45.995310+0000","last_active":"2023-10-03T10:09:46.397652+0000","last_peered":"2023-10-03T10:09:46.397652+0000","last_clean":"2023-10-03T10:09:46.397652+0000","last_became_active":"2023-10-03T10:09:45.995040+0000","last_became_peered":"2023-10-03T10:09:45.995040+0000","last_unstale":"2023-10-03T10:09:46.397652+0000","last_undegraded":"2023-10-03T10:09:46.397652+0000","last_fullsized":"2023-10-03T10:09:46.397652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388193+0000","last_change":"2023-10-03T10:09:46.385651+0000","last_active":"2023-10-03T10:09:46.388193+0000","last_peered":"2023-10-03T10:09:46.388193+0000","last_clean":"2023-10-03T10:09:46.388193+0000","last_became_active":"2023-10-03T10:09:46.383900+0000","last_became_peered":"2023-10-03T10:09:46.383900+0000","last_unstale":"2023-10-03T10:09:46.388193+0000","last_undegraded":"2023-10-03T10:09:46.388193+0000","last_fullsized":"2023-10-03T10:09:46.388193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.391818+0000","last_change":"2023-10-03T10:09:46.008019+0000","last_active":"2023-10-03T10:09:46.391818+0000","last_peered":"2023-10-03T10:09:46.391818+0000","last_clean":"2023-10-03T10:09:46.391818+0000","last_became_active":"2023-10-03T10:09:46.007374+0000","last_became_peered":"2023-10-03T10:09:46.007374+0000","last_unstale":"2023-10-03T10:09:46.391818+0000","last_undegraded":"2023-10-03T10:09:46.391818+0000","last_fullsized":"2023-10-03T10:09:46.391818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.391740+0000","last_change":"2023-10-03T10:09:46.382625+0000","last_active":"2023-10-03T10:09:46.391740+0000","last_peered":"2023-10-03T10:09:46.391740+0000","last_clean":"2023-10-03T10:09:46.391740+0000","last_became_active":"2023-10-03T10:09:46.382352+0000","last_became_peered":"2023-10-03T10:09:46.382352+0000","last_unstale":"2023-10-03T10:09:46.391740+0000","last_undegraded":"2023-10-03T10:09:46.391740+0000","last_fullsized":"2023-10-03T10:09:46.391740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.364595+0000","last_change":"2023-10-03T10:09:45.999722+0000","last_active":"2023-10-03T10:09:46.364595+0000","last_peered":"2023-10-03T10:09:46.364595+0000","last_clean":"2023-10-03T10:09:46.364595+0000","last_became_active":"2023-10-03T10:09:45.999450+0000","last_became_peered":"2023-10-03T10:09:45.999450+0000","last_unstale":"2023-10-03T10:09:46.364595+0000","last_undegraded":"2023-10-03T10:09:46.364595+0000","last_fullsized":"2023-10-03T10:09:46.364595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392163+0000","last_change":"2023-10-03T10:09:46.384495+0000","last_active":"2023-10-03T10:09:46.392163+0000","last_peered":"2023-10-03T10:09:46.392163+0000","last_clean":"2023-10-03T10:09:46.392163+0000","last_became_active":"2023-10-03T10:09:46.383160+0000","last_became_peered":"2023-10-03T10:09:46.383160+0000","last_unstale":"2023-10-03T10:09:46.392163+0000","last_undegraded":"2023-10-03T10:09:46.392163+0000","last_fullsized":"2023-10-03T10:09:46.392163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354617+0000","last_change":"2023-10-03T10:09:46.002469+0000","last_active":"2023-10-03T10:09:46.354617+0000","last_peered":"2023-10-03T10:09:46.354617+0000","last_clean":"2023-10-03T10:09:46.354617+0000","last_became_active":"2023-10-03T10:09:46.002179+0000","last_became_peered":"2023-10-03T10:09:46.002179+0000","last_unstale":"2023-10-03T10:09:46.354617+0000","last_undegraded":"2023-10-03T10:09:46.354617+0000","last_fullsized":"2023-10-03T10:09:46.354617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381433+0000","last_change":"2023-10-03T10:09:46.379295+0000","last_active":"2023-10-03T10:09:46.381433+0000","last_peered":"2023-10-03T10:09:46.381433+0000","last_clean":"2023-10-03T10:09:46.381433+0000","last_became_active":"2023-10-03T10:09:46.370639+0000","last_became_peered":"2023-10-03T10:09:46.370639+0000","last_unstale":"2023-10-03T10:09:46.381433+0000","last_undegraded":"2023-10-03T10:09:46.381433+0000","last_fullsized":"2023-10-03T10:09:46.381433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377345+0000","last_change":"2023-10-03T10:09:45.991739+0000","last_active":"2023-10-03T10:09:46.377345+0000","last_peered":"2023-10-03T10:09:46.377345+0000","last_clean":"2023-10-03T10:09:46.377345+0000","last_became_active":"2023-10-03T10:09:45.991195+0000","last_became_peered":"2023-10-03T10:09:45.991195+0000","last_unstale":"2023-10-03T10:09:46.377345+0000","last_undegraded":"2023-10-03T10:09:46.377345+0000","last_fullsized":"2023-10-03T10:09:46.377345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377898+0000","last_change":"2023-10-03T10:09:46.369391+0000","last_active":"2023-10-03T10:09:46.377898+0000","last_peered":"2023-10-03T10:09:46.377898+0000","last_clean":"2023-10-03T10:09:46.377898+0000","last_became_active":"2023-10-03T10:09:46.367938+0000","last_became_peered":"2023-10-03T10:09:46.367938+0000","last_unstale":"2023-10-03T10:09:46.377898+0000","last_undegraded":"2023-10-03T10:09:46.377898+0000","last_fullsized":"2023-10-03T10:09:46.377898+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381508+0000","last_change":"2023-10-03T10:09:46.004494+0000","last_active":"2023-10-03T10:09:46.381508+0000","last_peered":"2023-10-03T10:09:46.381508+0000","last_clean":"2023-10-03T10:09:46.381508+0000","last_became_active":"2023-10-03T10:09:46.004166+0000","last_became_peered":"2023-10-03T10:09:46.004166+0000","last_unstale":"2023-10-03T10:09:46.381508+0000","last_undegraded":"2023-10-03T10:09:46.381508+0000","last_fullsized":"2023-10-03T10:09:46.381508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392301+0000","last_change":"2023-10-03T10:09:46.383361+0000","last_active":"2023-10-03T10:09:46.392301+0000","last_peered":"2023-10-03T10:09:46.392301+0000","last_clean":"2023-10-03T10:09:46.392301+0000","last_became_active":"2023-10-03T10:09:46.378076+0000","last_became_peered":"2023-10-03T10:09:46.378076+0000","last_unstale":"2023-10-03T10:09:46.392301+0000","last_undegraded":"2023-10-03T10:09:46.392301+0000","last_fullsized":"2023-10-03T10:09:46.392301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.372772+0000","last_change":"2023-10-03T10:09:45.995572+0000","last_active":"2023-10-03T10:09:46.372772+0000","last_peered":"2023-10-03T10:09:46.372772+0000","last_clean":"2023-10-03T10:09:46.372772+0000","last_became_active":"2023-10-03T10:09:45.995093+0000","last_became_peered":"2023-10-03T10:09:45.995093+0000","last_unstale":"2023-10-03T10:09:46.372772+0000","last_undegraded":"2023-10-03T10:09:46.372772+0000","last_fullsized":"2023-10-03T10:09:46.372772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366121+0000","last_change":"2023-10-03T10:09:46.362868+0000","last_active":"2023-10-03T10:09:46.366121+0000","last_peered":"2023-10-03T10:09:46.366121+0000","last_clean":"2023-10-03T10:09:46.366121+0000","last_became_active":"2023-10-03T10:09:46.362550+0000","last_became_peered":"2023-10-03T10:09:46.362550+0000","last_unstale":"2023-10-03T10:09:46.366121+0000","last_undegraded":"2023-10-03T10:09:46.366121+0000","last_fullsized":"2023-10-03T10:09:46.366121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.394684+0000","last_change":"2023-10-03T10:09:46.007310+0000","last_active":"2023-10-03T10:09:46.394684+0000","last_peered":"2023-10-03T10:09:46.394684+0000","last_clean":"2023-10-03T10:09:46.394684+0000","last_became_active":"2023-10-03T10:09:46.007002+0000","last_became_peered":"2023-10-03T10:09:46.007002+0000","last_unstale":"2023-10-03T10:09:46.394684+0000","last_undegraded":"2023-10-03T10:09:46.394684+0000","last_fullsized":"2023-10-03T10:09:46.394684+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388581+0000","last_change":"2023-10-03T10:09:46.387104+0000","last_active":"2023-10-03T10:09:46.388581+0000","last_peered":"2023-10-03T10:09:46.388581+0000","last_clean":"2023-10-03T10:09:46.388581+0000","last_became_active":"2023-10-03T10:09:46.386697+0000","last_became_peered":"2023-10-03T10:09:46.386697+0000","last_unstale":"2023-10-03T10:09:46.388581+0000","last_undegraded":"2023-10-03T10:09:46.388581+0000","last_fullsized":"2023-10-03T10:09:46.388581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.365183+0000","last_change":"2023-10-03T10:09:46.001474+0000","last_active":"2023-10-03T10:09:46.365183+0000","last_peered":"2023-10-03T10:09:46.365183+0000","last_clean":"2023-10-03T10:09:46.365183+0000","last_became_active":"2023-10-03T10:09:46.001185+0000","last_became_peered":"2023-10-03T10:09:46.001185+0000","last_unstale":"2023-10-03T10:09:46.365183+0000","last_undegraded":"2023-10-03T10:09:46.365183+0000","last_fullsized":"2023-10-03T10:09:46.365183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381334+0000","last_change":"2023-10-03T10:09:46.378394+0000","last_active":"2023-10-03T10:09:46.381334+0000","last_peered":"2023-10-03T10:09:46.381334+0000","last_clean":"2023-10-03T10:09:46.381334+0000","last_became_active":"2023-10-03T10:09:46.378115+0000","last_became_peered":"2023-10-03T10:09:46.378115+0000","last_unstale":"2023-10-03T10:09:46.381334+0000","last_undegraded":"2023-10-03T10:09:46.381334+0000","last_fullsized":"2023-10-03T10:09:46.381334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392154+0000","last_change":"2023-10-03T10:09:46.008210+0000","last_active":"2023-10-03T10:09:46.392154+0000","last_peered":"2023-10-03T10:09:46.392154+0000","last_clean":"2023-10-03T10:09:46.392154+0000","last_became_active":"2023-10-03T10:09:46.007750+0000","last_became_peered":"2023-10-03T10:09:46.007750+0000","last_unstale":"2023-10-03T10:09:46.392154+0000","last_undegraded":"2023-10-03T10:09:46.392154+0000","last_fullsized":"2023-10-03T10:09:46.392154+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387177+0000","last_change":"2023-10-03T10:09:46.385399+0000","last_active":"2023-10-03T10:09:46.387177+0000","last_peered":"2023-10-03T10:09:46.387177+0000","last_clean":"2023-10-03T10:09:46.387177+0000","last_became_active":"2023-10-03T10:09:46.385110+0000","last_became_peered":"2023-10-03T10:09:46.385110+0000","last_unstale":"2023-10-03T10:09:46.387177+0000","last_undegraded":"2023-10-03T10:09:46.387177+0000","last_fullsized":"2023-10-03T10:09:46.387177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352988+0000","last_change":"2023-10-03T10:09:46.007708+0000","last_active":"2023-10-03T10:09:46.352988+0000","last_peered":"2023-10-03T10:09:46.352988+0000","last_clean":"2023-10-03T10:09:46.352988+0000","last_became_active":"2023-10-03T10:09:46.006141+0000","last_became_peered":"2023-10-03T10:09:46.006141+0000","last_unstale":"2023-10-03T10:09:46.352988+0000","last_undegraded":"2023-10-03T10:09:46.352988+0000","last_fullsized":"2023-10-03T10:09:46.352988+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.369876+0000","last_change":"2023-10-03T10:09:46.367623+0000","last_active":"2023-10-03T10:09:46.369876+0000","last_peered":"2023-10-03T10:09:46.369876+0000","last_clean":"2023-10-03T10:09:46.369876+0000","last_became_active":"2023-10-03T10:09:46.367337+0000","last_became_peered":"2023-10-03T10:09:46.367337+0000","last_unstale":"2023-10-03T10:09:46.369876+0000","last_undegraded":"2023-10-03T10:09:46.369876+0000","last_fullsized":"2023-10-03T10:09:46.369876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354145+0000","last_change":"2023-10-03T10:09:46.002433+0000","last_active":"2023-10-03T10:09:46.354145+0000","last_peered":"2023-10-03T10:09:46.354145+0000","last_clean":"2023-10-03T10:09:46.354145+0000","last_became_active":"2023-10-03T10:09:46.002135+0000","last_became_peered":"2023-10-03T10:09:46.002135+0000","last_unstale":"2023-10-03T10:09:46.354145+0000","last_undegraded":"2023-10-03T10:09:46.354145+0000","last_fullsized":"2023-10-03T10:09:46.354145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.389051+0000","last_change":"2023-10-03T10:09:46.387220+0000","last_active":"2023-10-03T10:09:46.389051+0000","last_peered":"2023-10-03T10:09:46.389051+0000","last_clean":"2023-10-03T10:09:46.389051+0000","last_became_active":"2023-10-03T10:09:46.384091+0000","last_became_peered":"2023-10-03T10:09:46.384091+0000","last_unstale":"2023-10-03T10:09:46.389051+0000","last_undegraded":"2023-10-03T10:09:46.389051+0000","last_fullsized":"2023-10-03T10:09:46.389051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.350749+0000","last_change":"2023-10-03T10:09:46.008899+0000","last_active":"2023-10-03T10:09:46.350749+0000","last_peered":"2023-10-03T10:09:46.350749+0000","last_clean":"2023-10-03T10:09:46.350749+0000","last_became_active":"2023-10-03T10:09:46.006123+0000","last_became_peered":"2023-10-03T10:09:46.006123+0000","last_unstale":"2023-10-03T10:09:46.350749+0000","last_undegraded":"2023-10-03T10:09:46.350749+0000","last_fullsized":"2023-10-03T10:09:46.350749+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377212+0000","last_change":"2023-10-03T10:09:46.367086+0000","last_active":"2023-10-03T10:09:46.377212+0000","last_peered":"2023-10-03T10:09:46.377212+0000","last_clean":"2023-10-03T10:09:46.377212+0000","last_became_active":"2023-10-03T10:09:46.366505+0000","last_became_peered":"2023-10-03T10:09:46.366505+0000","last_unstale":"2023-10-03T10:09:46.377212+0000","last_undegraded":"2023-10-03T10:09:46.377212+0000","last_fullsized":"2023-10-03T10:09:46.377212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.355579+0000","last_change":"2023-10-03T10:09:42.503202+0000","last_active":"2023-10-03T10:09:46.355579+0000","last_peered":"2023-10-03T10:09:46.355579+0000","last_clean":"2023-10-03T10:09:46.355579+0000","last_became_active":"2023-10-03T10:09:42.502700+0000","last_became_peered":"2023-10-03T10:09:42.502700+0000","last_unstale":"2023-10-03T10:09:46.355579+0000","last_undegraded":"2023-10-03T10:09:46.355579+0000","last_fullsized":"2023-10-03T10:09:46.355579+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352129+0000","last_change":"2023-10-03T10:09:45.995268+0000","last_active":"2023-10-03T10:09:46.352129+0000","last_peered":"2023-10-03T10:09:46.352129+0000","last_clean":"2023-10-03T10:09:46.352129+0000","last_became_active":"2023-10-03T10:09:45.994970+0000","last_became_peered":"2023-10-03T10:09:45.994970+0000","last_unstale":"2023-10-03T10:09:46.352129+0000","last_undegraded":"2023-10-03T10:09:46.352129+0000","last_fullsized":"2023-10-03T10:09:46.352129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.397141+0000","last_change":"2023-10-03T10:09:46.393198+0000","last_active":"2023-10-03T10:09:46.397141+0000","last_peered":"2023-10-03T10:09:46.397141+0000","last_clean":"2023-10-03T10:09:46.397141+0000","last_became_active":"2023-10-03T10:09:46.392876+0000","last_became_peered":"2023-10-03T10:09:46.392876+0000","last_unstale":"2023-10-03T10:09:46.397141+0000","last_undegraded":"2023-10-03T10:09:46.397141+0000","last_fullsized":"2023-10-03T10:09:46.397141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.355582+0000","last_change":"2023-10-03T10:09:41.940609+0000","last_active":"2023-10-03T10:09:46.355582+0000","last_peered":"2023-10-03T10:09:46.355582+0000","last_clean":"2023-10-03T10:09:46.355582+0000","last_became_active":"2023-10-03T10:09:41.940313+0000","last_became_peered":"2023-10-03T10:09:41.940313+0000","last_unstale":"2023-10-03T10:09:46.355582+0000","last_undegraded":"2023-10-03T10:09:46.355582+0000","last_fullsized":"2023-10-03T10:09:46.355582+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.364759+0000","last_change":"2023-10-03T10:09:45.987289+0000","last_active":"2023-10-03T10:09:46.364759+0000","last_peered":"2023-10-03T10:09:46.364759+0000","last_clean":"2023-10-03T10:09:46.364759+0000","last_became_active":"2023-10-03T10:09:45.987013+0000","last_became_peered":"2023-10-03T10:09:45.987013+0000","last_unstale":"2023-10-03T10:09:46.364759+0000","last_undegraded":"2023-10-03T10:09:46.364759+0000","last_fullsized":"2023-10-03T10:09:46.364759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377619+0000","last_change":"2023-10-03T10:09:46.371416+0000","last_active":"2023-10-03T10:09:46.377619+0000","last_peered":"2023-10-03T10:09:46.377619+0000","last_clean":"2023-10-03T10:09:46.377619+0000","last_became_active":"2023-10-03T10:09:46.370977+0000","last_became_peered":"2023-10-03T10:09:46.370977+0000","last_unstale":"2023-10-03T10:09:46.377619+0000","last_undegraded":"2023-10-03T10:09:46.377619+0000","last_fullsized":"2023-10-03T10:09:46.377619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352788+0000","last_change":"2023-10-03T10:09:41.940436+0000","last_active":"2023-10-03T10:09:46.352788+0000","last_peered":"2023-10-03T10:09:46.352788+0000","last_clean":"2023-10-03T10:09:46.352788+0000","last_became_active":"2023-10-03T10:09:41.940147+0000","last_became_peered":"2023-10-03T10:09:41.940147+0000","last_unstale":"2023-10-03T10:09:46.352788+0000","last_undegraded":"2023-10-03T10:09:46.352788+0000","last_fullsized":"2023-10-03T10:09:46.352788+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354234+0000","last_change":"2023-10-03T10:09:45.994184+0000","last_active":"2023-10-03T10:09:46.354234+0000","last_peered":"2023-10-03T10:09:46.354234+0000","last_clean":"2023-10-03T10:09:46.354234+0000","last_became_active":"2023-10-03T10:09:45.993699+0000","last_became_peered":"2023-10-03T10:09:45.993699+0000","last_unstale":"2023-10-03T10:09:46.354234+0000","last_undegraded":"2023-10-03T10:09:46.354234+0000","last_fullsized":"2023-10-03T10:09:46.354234+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377610+0000","last_change":"2023-10-03T10:09:46.372991+0000","last_active":"2023-10-03T10:09:46.377610+0000","last_peered":"2023-10-03T10:09:46.377610+0000","last_clean":"2023-10-03T10:09:46.377610+0000","last_became_active":"2023-10-03T10:09:46.372753+0000","last_became_peered":"2023-10-03T10:09:46.372753+0000","last_unstale":"2023-10-03T10:09:46.377610+0000","last_undegraded":"2023-10-03T10:09:46.377610+0000","last_fullsized":"2023-10-03T10:09:46.377610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352947+0000","last_change":"2023-10-03T10:09:41.941185+0000","last_active":"2023-10-03T10:09:46.352947+0000","last_peered":"2023-10-03T10:09:46.352947+0000","last_clean":"2023-10-03T10:09:46.352947+0000","last_became_active":"2023-10-03T10:09:41.940930+0000","last_became_peered":"2023-10-03T10:09:41.940930+0000","last_unstale":"2023-10-03T10:09:46.352947+0000","last_undegraded":"2023-10-03T10:09:46.352947+0000","last_fullsized":"2023-10-03T10:09:46.352947+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354131+0000","last_change":"2023-10-03T10:09:40.948442+0000","last_active":"2023-10-03T10:09:46.354131+0000","last_peered":"2023-10-03T10:09:46.354131+0000","last_clean":"2023-10-03T10:09:46.354131+0000","last_became_active":"2023-10-03T10:09:40.948068+0000","last_became_peered":"2023-10-03T10:09:40.948068+0000","last_unstale":"2023-10-03T10:09:46.354131+0000","last_undegraded":"2023-10-03T10:09:46.354131+0000","last_fullsized":"2023-10-03T10:09:46.354131+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_clean_scrub_stamp":"2023-10-03T10:09:39.928111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352898+0000","last_change":"2023-10-03T10:09:45.999685+0000","last_active":"2023-10-03T10:09:46.352898+0000","last_peered":"2023-10-03T10:09:46.352898+0000","last_clean":"2023-10-03T10:09:46.352898+0000","last_became_active":"2023-10-03T10:09:45.999343+0000","last_became_peered":"2023-10-03T10:09:45.999343+0000","last_unstale":"2023-10-03T10:09:46.352898+0000","last_undegraded":"2023-10-03T10:09:46.352898+0000","last_fullsized":"2023-10-03T10:09:46.352898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.384365+0000","last_change":"2023-10-03T10:09:46.367761+0000","last_active":"2023-10-03T10:09:46.384365+0000","last_peered":"2023-10-03T10:09:46.384365+0000","last_clean":"2023-10-03T10:09:46.384365+0000","last_became_active":"2023-10-03T10:09:46.367362+0000","last_became_peered":"2023-10-03T10:09:46.367362+0000","last_unstale":"2023-10-03T10:09:46.384365+0000","last_undegraded":"2023-10-03T10:09:46.384365+0000","last_fullsized":"2023-10-03T10:09:46.384365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.351142+0000","last_change":"2023-10-03T10:09:41.940561+0000","last_active":"2023-10-03T10:09:46.351142+0000","last_peered":"2023-10-03T10:09:46.351142+0000","last_clean":"2023-10-03T10:09:46.351142+0000","last_became_active":"2023-10-03T10:09:41.940202+0000","last_became_peered":"2023-10-03T10:09:41.940202+0000","last_unstale":"2023-10-03T10:09:46.351142+0000","last_undegraded":"2023-10-03T10:09:46.351142+0000","last_fullsized":"2023-10-03T10:09:46.351142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.367791+0000","last_change":"2023-10-03T10:09:45.987278+0000","last_active":"2023-10-03T10:09:46.367791+0000","last_peered":"2023-10-03T10:09:46.367791+0000","last_clean":"2023-10-03T10:09:46.367791+0000","last_became_active":"2023-10-03T10:09:45.986993+0000","last_became_peered":"2023-10-03T10:09:45.986993+0000","last_unstale":"2023-10-03T10:09:46.367791+0000","last_undegraded":"2023-10-03T10:09:46.367791+0000","last_fullsized":"2023-10-03T10:09:46.367791+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381370+0000","last_change":"2023-10-03T10:09:46.378722+0000","last_active":"2023-10-03T10:09:46.381370+0000","last_peered":"2023-10-03T10:09:46.381370+0000","last_clean":"2023-10-03T10:09:46.381370+0000","last_became_active":"2023-10-03T10:09:46.378186+0000","last_became_peered":"2023-10-03T10:09:46.378186+0000","last_unstale":"2023-10-03T10:09:46.381370+0000","last_undegraded":"2023-10-03T10:09:46.381370+0000","last_fullsized":"2023-10-03T10:09:46.381370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354254+0000","last_change":"2023-10-03T10:09:42.502984+0000","last_active":"2023-10-03T10:09:46.354254+0000","last_peered":"2023-10-03T10:09:46.354254+0000","last_clean":"2023-10-03T10:09:46.354254+0000","last_became_active":"2023-10-03T10:09:42.502699+0000","last_became_peered":"2023-10-03T10:09:42.502699+0000","last_unstale":"2023-10-03T10:09:46.354254+0000","last_undegraded":"2023-10-03T10:09:46.354254+0000","last_fullsized":"2023-10-03T10:09:46.354254+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.355380+0000","last_change":"2023-10-03T10:09:45.995626+0000","last_active":"2023-10-03T10:09:46.355380+0000","last_peered":"2023-10-03T10:09:46.355380+0000","last_clean":"2023-10-03T10:09:46.355380+0000","last_became_active":"2023-10-03T10:09:45.995322+0000","last_became_peered":"2023-10-03T10:09:45.995322+0000","last_unstale":"2023-10-03T10:09:46.355380+0000","last_undegraded":"2023-10-03T10:09:46.355380+0000","last_fullsized":"2023-10-03T10:09:46.355380+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.375920+0000","last_change":"2023-10-03T10:09:46.371217+0000","last_active":"2023-10-03T10:09:46.375920+0000","last_peered":"2023-10-03T10:09:46.375920+0000","last_clean":"2023-10-03T10:09:46.375920+0000","last_became_active":"2023-10-03T10:09:46.370285+0000","last_became_peered":"2023-10-03T10:09:46.370285+0000","last_unstale":"2023-10-03T10:09:46.375920+0000","last_undegraded":"2023-10-03T10:09:46.375920+0000","last_fullsized":"2023-10-03T10:09:46.375920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.383433+0000","last_change":"2023-10-03T10:09:46.006819+0000","last_active":"2023-10-03T10:09:46.383433+0000","last_peered":"2023-10-03T10:09:46.383433+0000","last_clean":"2023-10-03T10:09:46.383433+0000","last_became_active":"2023-10-03T10:09:46.006524+0000","last_became_peered":"2023-10-03T10:09:46.006524+0000","last_unstale":"2023-10-03T10:09:46.383433+0000","last_undegraded":"2023-10-03T10:09:46.383433+0000","last_fullsized":"2023-10-03T10:09:46.383433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.350860+0000","last_change":"2023-10-03T10:09:42.503022+0000","last_active":"2023-10-03T10:09:46.350860+0000","last_peered":"2023-10-03T10:09:46.350860+0000","last_clean":"2023-10-03T10:09:46.350860+0000","last_became_active":"2023-10-03T10:09:42.502739+0000","last_became_peered":"2023-10-03T10:09:42.502739+0000","last_unstale":"2023-10-03T10:09:46.350860+0000","last_undegraded":"2023-10-03T10:09:46.350860+0000","last_fullsized":"2023-10-03T10:09:46.350860+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392320+0000","last_change":"2023-10-03T10:09:46.383732+0000","last_active":"2023-10-03T10:09:46.392320+0000","last_peered":"2023-10-03T10:09:46.392320+0000","last_clean":"2023-10-03T10:09:46.392320+0000","last_became_active":"2023-10-03T10:09:46.374186+0000","last_became_peered":"2023-10-03T10:09:46.374186+0000","last_unstale":"2023-10-03T10:09:46.392320+0000","last_undegraded":"2023-10-03T10:09:46.392320+0000","last_fullsized":"2023-10-03T10:09:46.392320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.353582+0000","last_change":"2023-10-03T10:09:42.503368+0000","last_active":"2023-10-03T10:09:46.353582+0000","last_peered":"2023-10-03T10:09:46.353582+0000","last_clean":"2023-10-03T10:09:46.353582+0000","last_became_active":"2023-10-03T10:09:42.503090+0000","last_became_peered":"2023-10-03T10:09:42.503090+0000","last_unstale":"2023-10-03T10:09:46.353582+0000","last_undegraded":"2023-10-03T10:09:46.353582+0000","last_fullsized":"2023-10-03T10:09:46.353582+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.371581+0000","last_change":"2023-10-03T10:09:46.003516+0000","last_active":"2023-10-03T10:09:46.371581+0000","last_peered":"2023-10-03T10:09:46.371581+0000","last_clean":"2023-10-03T10:09:46.371581+0000","last_became_active":"2023-10-03T10:09:46.003227+0000","last_became_peered":"2023-10-03T10:09:46.003227+0000","last_unstale":"2023-10-03T10:09:46.371581+0000","last_undegraded":"2023-10-03T10:09:46.371581+0000","last_fullsized":"2023-10-03T10:09:46.371581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366737+0000","last_change":"2023-10-03T10:09:46.365107+0000","last_active":"2023-10-03T10:09:46.366737+0000","last_peered":"2023-10-03T10:09:46.366737+0000","last_clean":"2023-10-03T10:09:46.366737+0000","last_became_active":"2023-10-03T10:09:46.364877+0000","last_became_peered":"2023-10-03T10:09:46.364877+0000","last_unstale":"2023-10-03T10:09:46.366737+0000","last_undegraded":"2023-10-03T10:09:46.366737+0000","last_fullsized":"2023-10-03T10:09:46.366737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388998+0000","last_change":"2023-10-03T10:09:46.003786+0000","last_active":"2023-10-03T10:09:46.388998+0000","last_peered":"2023-10-03T10:09:46.388998+0000","last_clean":"2023-10-03T10:09:46.388998+0000","last_became_active":"2023-10-03T10:09:46.003506+0000","last_became_peered":"2023-10-03T10:09:46.003506+0000","last_unstale":"2023-10-03T10:09:46.388998+0000","last_undegraded":"2023-10-03T10:09:46.388998+0000","last_fullsized":"2023-10-03T10:09:46.388998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380939+0000","last_change":"2023-10-03T10:09:46.376808+0000","last_active":"2023-10-03T10:09:46.380939+0000","last_peered":"2023-10-03T10:09:46.380939+0000","last_clean":"2023-10-03T10:09:46.380939+0000","last_became_active":"2023-10-03T10:09:46.376414+0000","last_became_peered":"2023-10-03T10:09:46.376414+0000","last_unstale":"2023-10-03T10:09:46.380939+0000","last_undegraded":"2023-10-03T10:09:46.380939+0000","last_fullsized":"2023-10-03T10:09:46.380939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.374191+0000","last_change":"2023-10-03T10:09:45.992104+0000","last_active":"2023-10-03T10:09:46.374191+0000","last_peered":"2023-10-03T10:09:46.374191+0000","last_clean":"2023-10-03T10:09:46.374191+0000","last_became_active":"2023-10-03T10:09:45.991796+0000","last_became_peered":"2023-10-03T10:09:45.991796+0000","last_unstale":"2023-10-03T10:09:46.374191+0000","last_undegraded":"2023-10-03T10:09:46.374191+0000","last_fullsized":"2023-10-03T10:09:46.374191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387640+0000","last_change":"2023-10-03T10:09:46.384662+0000","last_active":"2023-10-03T10:09:46.387640+0000","last_peered":"2023-10-03T10:09:46.387640+0000","last_clean":"2023-10-03T10:09:46.387640+0000","last_became_active":"2023-10-03T10:09:46.384347+0000","last_became_peered":"2023-10-03T10:09:46.384347+0000","last_unstale":"2023-10-03T10:09:46.387640+0000","last_undegraded":"2023-10-03T10:09:46.387640+0000","last_fullsized":"2023-10-03T10:09:46.387640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.383719+0000","last_change":"2023-10-03T10:09:46.005018+0000","last_active":"2023-10-03T10:09:46.383719+0000","last_peered":"2023-10-03T10:09:46.383719+0000","last_clean":"2023-10-03T10:09:46.383719+0000","last_became_active":"2023-10-03T10:09:46.004611+0000","last_became_peered":"2023-10-03T10:09:46.004611+0000","last_unstale":"2023-10-03T10:09:46.383719+0000","last_undegraded":"2023-10-03T10:09:46.383719+0000","last_fullsized":"2023-10-03T10:09:46.383719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388600+0000","last_change":"2023-10-03T10:09:46.387130+0000","last_active":"2023-10-03T10:09:46.388600+0000","last_peered":"2023-10-03T10:09:46.388600+0000","last_clean":"2023-10-03T10:09:46.388600+0000","last_became_active":"2023-10-03T10:09:46.386801+0000","last_became_peered":"2023-10-03T10:09:46.386801+0000","last_unstale":"2023-10-03T10:09:46.388600+0000","last_undegraded":"2023-10-03T10:09:46.388600+0000","last_fullsized":"2023-10-03T10:09:46.388600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392142+0000","last_change":"2023-10-03T10:09:45.998407+0000","last_active":"2023-10-03T10:09:46.392142+0000","last_peered":"2023-10-03T10:09:46.392142+0000","last_clean":"2023-10-03T10:09:46.392142+0000","last_became_active":"2023-10-03T10:09:45.995915+0000","last_became_peered":"2023-10-03T10:09:45.995915+0000","last_unstale":"2023-10-03T10:09:46.392142+0000","last_undegraded":"2023-10-03T10:09:46.392142+0000","last_fullsized":"2023-10-03T10:09:46.392142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392233+0000","last_change":"2023-10-03T10:09:46.385531+0000","last_active":"2023-10-03T10:09:46.392233+0000","last_peered":"2023-10-03T10:09:46.392233+0000","last_clean":"2023-10-03T10:09:46.392233+0000","last_became_active":"2023-10-03T10:09:46.385289+0000","last_became_peered":"2023-10-03T10:09:46.385289+0000","last_unstale":"2023-10-03T10:09:46.392233+0000","last_undegraded":"2023-10-03T10:09:46.392233+0000","last_fullsized":"2023-10-03T10:09:46.392233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381665+0000","last_change":"2023-10-03T10:09:46.004241+0000","last_active":"2023-10-03T10:09:46.381665+0000","last_peered":"2023-10-03T10:09:46.381665+0000","last_clean":"2023-10-03T10:09:46.381665+0000","last_became_active":"2023-10-03T10:09:46.003370+0000","last_became_peered":"2023-10-03T10:09:46.003370+0000","last_unstale":"2023-10-03T10:09:46.381665+0000","last_undegraded":"2023-10-03T10:09:46.381665+0000","last_fullsized":"2023-10-03T10:09:46.381665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380871+0000","last_change":"2023-10-03T10:09:46.374808+0000","last_active":"2023-10-03T10:09:46.380871+0000","last_peered":"2023-10-03T10:09:46.380871+0000","last_clean":"2023-10-03T10:09:46.380871+0000","last_became_active":"2023-10-03T10:09:46.374363+0000","last_became_peered":"2023-10-03T10:09:46.374363+0000","last_unstale":"2023-10-03T10:09:46.380871+0000","last_undegraded":"2023-10-03T10:09:46.380871+0000","last_fullsized":"2023-10-03T10:09:46.380871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377400+0000","last_change":"2023-10-03T10:09:46.371026+0000","last_active":"2023-10-03T10:09:46.377400+0000","last_peered":"2023-10-03T10:09:46.377400+0000","last_clean":"2023-10-03T10:09:46.377400+0000","last_became_active":"2023-10-03T10:09:46.370725+0000","last_became_peered":"2023-10-03T10:09:46.370725+0000","last_unstale":"2023-10-03T10:09:46.377400+0000","last_undegraded":"2023-10-03T10:09:46.377400+0000","last_fullsized":"2023-10-03T10:09:46.377400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.369953+0000","last_change":"2023-10-03T10:09:46.368699+0000","last_active":"2023-10-03T10:09:46.369953+0000","last_peered":"2023-10-03T10:09:46.369953+0000","last_clean":"2023-10-03T10:09:46.369953+0000","last_became_active":"2023-10-03T10:09:46.367867+0000","last_became_peered":"2023-10-03T10:09:46.367867+0000","last_unstale":"2023-10-03T10:09:46.369953+0000","last_undegraded":"2023-10-03T10:09:46.369953+0000","last_fullsized":"2023-10-03T10:09:46.369953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387149+0000","last_change":"2023-10-03T10:09:46.385510+0000","last_active":"2023-10-03T10:09:46.387149+0000","last_peered":"2023-10-03T10:09:46.387149+0000","last_clean":"2023-10-03T10:09:46.387149+0000","last_became_active":"2023-10-03T10:09:46.385254+0000","last_became_peered":"2023-10-03T10:09:46.385254+0000","last_unstale":"2023-10-03T10:09:46.387149+0000","last_undegraded":"2023-10-03T10:09:46.387149+0000","last_fullsized":"2023-10-03T10:09:46.387149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.383009+0000","last_change":"2023-10-03T10:09:46.370858+0000","last_active":"2023-10-03T10:09:46.383009+0000","last_peered":"2023-10-03T10:09:46.383009+0000","last_clean":"2023-10-03T10:09:46.383009+0000","last_became_active":"2023-10-03T10:09:46.367104+0000","last_became_peered":"2023-10-03T10:09:46.367104+0000","last_unstale":"2023-10-03T10:09:46.383009+0000","last_undegraded":"2023-10-03T10:09:46.383009+0000","last_fullsized":"2023-10-03T10:09:46.383009+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377600+0000","last_change":"2023-10-03T10:09:46.371241+0000","last_active":"2023-10-03T10:09:46.377600+0000","last_peered":"2023-10-03T10:09:46.377600+0000","last_clean":"2023-10-03T10:09:46.377600+0000","last_became_active":"2023-10-03T10:09:46.370691+0000","last_became_peered":"2023-10-03T10:09:46.370691+0000","last_unstale":"2023-10-03T10:09:46.377600+0000","last_undegraded":"2023-10-03T10:09:46.377600+0000","last_fullsized":"2023-10-03T10:09:46.377600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":46930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:54.010 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-03T10:09:54.010 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T10:09:54.010 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T10:09:54.010 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T10:09:54.011 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-03T10:09:54.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.161+0000 7fb6c120b700 1 Processor -- start 2023-10-03T10:09:54.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.161+0000 7fb6c120b700 1 -- start start 2023-10-03T10:09:54.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6c120b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6bc059070 0x7fb6bc127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6c120b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6bc127390 0x7fb6bc127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6c120b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6bc095370 0x7fb6bc0957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6c120b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6bc096940 con 0x7fb6bc095370 2023-10-03T10:09:54.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6c120b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc059c00 con 0x7fb6bc127390 2023-10-03T10:09:54.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6c120b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc091b60 con 0x7fb6bc059070 2023-10-03T10:09:54.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6bad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6bc059070 0x7fb6bc127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6bb59e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6bc095370 0x7fb6bc0957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6ba59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6bc127390 0x7fb6bc127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6bad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6bc059070 0x7fb6bc127890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59290/0 (socket says 172.21.15.72:59290) 2023-10-03T10:09:54.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6bb59e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6bc095370 0x7fb6bc0957f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33178/0 (socket says 172.21.15.72:33178) 2023-10-03T10:09:54.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6ba59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6bc127390 0x7fb6bc127d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:47988/0 (socket says 172.21.15.72:47988) 2023-10-03T10:09:54.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6bad9d700 1 -- 172.21.15.72:0/2241724671 learned_addr learned my addr 172.21.15.72:0/2241724671 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:54.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6bad9d700 1 -- 172.21.15.72:0/2241724671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6bc127390 msgr2=0x7fb6bc127d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:54.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6bad9d700 1 --2- 172.21.15.72:0/2241724671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6bc127390 0x7fb6bc127d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6bad9d700 1 -- 172.21.15.72:0/2241724671 >> v2:172.21.15.72:3300/0 conn(0x7fb6bc095370 msgr2=0x7fb6bc0957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:54.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6bad9d700 1 --2- 172.21.15.72:0/2241724671 >> v2:172.21.15.72:3300/0 conn(0x7fb6bc095370 0x7fb6bc0957f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6bad9d700 1 -- 172.21.15.72:0/2241724671 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc0929d0 con 0x7fb6bc059070 2023-10-03T10:09:54.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6bb59e700 1 --2- 172.21.15.72:0/2241724671 >> v2:172.21.15.72:3300/0 conn(0x7fb6bc095370 0x7fb6bc0957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:54.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6ba59c700 1 --2- 172.21.15.72:0/2241724671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6bc127390 0x7fb6bc127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:54.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6bad9d700 1 --2- 172.21.15.72:0/2241724671 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6bc059070 0x7fb6bc127890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb6b0009830 tx=0x7fb6b00090f0).ready entity=mon.2 client_cookie=46023b2b60ed69d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:54.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6b9d9b700 1 -- 172.21.15.72:0/2241724671 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b000f510 con 0x7fb6bc059070 2023-10-03T10:09:54.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6b9d9b700 1 -- 172.21.15.72:0/2241724671 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b000f670 con 0x7fb6bc059070 2023-10-03T10:09:54.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.162+0000 7fb6b9d9b700 1 -- 172.21.15.72:0/2241724671 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b000fa10 con 0x7fb6bc059070 2023-10-03T10:09:54.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.163+0000 7fb6c120b700 1 -- 172.21.15.72:0/2241724671 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6bc059070 msgr2=0x7fb6bc127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.163+0000 7fb6c120b700 1 --2- 172.21.15.72:0/2241724671 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6bc059070 0x7fb6bc127890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb6b0009830 tx=0x7fb6b00090f0).stop 2023-10-03T10:09:54.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.163+0000 7fb6c120b700 1 -- 172.21.15.72:0/2241724671 shutdown_connections 2023-10-03T10:09:54.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.163+0000 7fb6c120b700 1 --2- 172.21.15.72:0/2241724671 >> v2:172.21.15.72:3300/0 conn(0x7fb6bc095370 0x7fb6bc0957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.163+0000 7fb6c120b700 1 --2- 172.21.15.72:0/2241724671 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6bc059070 0x7fb6bc127890 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.163+0000 7fb6c120b700 1 --2- 172.21.15.72:0/2241724671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6bc127390 0x7fb6bc127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.163+0000 7fb6c120b700 1 -- 172.21.15.72:0/2241724671 >> 172.21.15.72:0/2241724671 conn(0x7fb6bc097470 msgr2=0x7fb6bc097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:54.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.163+0000 7fb6c120b700 1 -- 172.21.15.72:0/2241724671 shutdown_connections 2023-10-03T10:09:54.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.163+0000 7fb6c120b700 1 -- 172.21.15.72:0/2241724671 wait complete. 2023-10-03T10:09:54.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.164+0000 7fb6c120b700 1 Processor -- start 2023-10-03T10:09:54.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.164+0000 7fb6c120b700 1 -- start start 2023-10-03T10:09:54.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.164+0000 7fb6c120b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6bc059070 0x7fb6bc117970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.164+0000 7fb6c120b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6bc095370 0x7fb6bc113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.164+0000 7fb6c120b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6bc127390 0x7fb6bc113e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.164+0000 7fb6c120b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc124aa0 con 0x7fb6bc095370 2023-10-03T10:09:54.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.164+0000 7fb6c120b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc096f20 con 0x7fb6bc059070 2023-10-03T10:09:54.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.164+0000 7fb6c120b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc116f00 con 0x7fb6bc127390 2023-10-03T10:09:54.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.164+0000 7fb6bad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6bc059070 0x7fb6bc117970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.164+0000 7fb6bb59e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6bc127390 0x7fb6bc113e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.164+0000 7fb6bad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6bc059070 0x7fb6bc117970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48004/0 (socket says 172.21.15.72:48004) 2023-10-03T10:09:54.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.164+0000 7fb6bad9d700 1 -- 172.21.15.72:0/1459648002 learned_addr learned my addr 172.21.15.72:0/1459648002 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:54.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.164+0000 7fb6ba59c700 1 --2- 172.21.15.72:0/1459648002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6bc095370 0x7fb6bc113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.165+0000 7fb6bad9d700 1 -- 172.21.15.72:0/1459648002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6bc127390 msgr2=0x7fb6bc113e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.165+0000 7fb6bad9d700 1 --2- 172.21.15.72:0/1459648002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6bc127390 0x7fb6bc113e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.165+0000 7fb6bad9d700 1 -- 172.21.15.72:0/1459648002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6bc095370 msgr2=0x7fb6bc113940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.165+0000 7fb6bad9d700 1 --2- 172.21.15.72:0/1459648002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6bc095370 0x7fb6bc113940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.165+0000 7fb6bad9d700 1 -- 172.21.15.72:0/1459648002 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b4009a20 con 0x7fb6bc059070 2023-10-03T10:09:54.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.165+0000 7fb6bb59e700 1 --2- 172.21.15.72:0/1459648002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6bc127390 0x7fb6bc113e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:54.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.165+0000 7fb6bad9d700 1 --2- 172.21.15.72:0/1459648002 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6bc059070 0x7fb6bc117970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb6bc0924e0 tx=0x7fb6b0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:54.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.165+0000 7fb6a2ffd700 1 -- 172.21.15.72:0/1459648002 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0006910 con 0x7fb6bc059070 2023-10-03T10:09:54.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.165+0000 7fb6a2ffd700 1 -- 172.21.15.72:0/1459648002 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b0000bc0 con 0x7fb6bc059070 2023-10-03T10:09:54.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.165+0000 7fb6a2ffd700 1 -- 172.21.15.72:0/1459648002 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0024470 con 0x7fb6bc059070 2023-10-03T10:09:54.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.165+0000 7fb6c120b700 1 -- 172.21.15.72:0/1459648002 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac0092a0 con 0x7fb6bc059070 2023-10-03T10:09:54.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.165+0000 7fb6c120b700 1 -- 172.21.15.72:0/1459648002 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b0009370 con 0x7fb6bc059070 2023-10-03T10:09:54.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.166+0000 7fb6a2ffd700 1 -- 172.21.15.72:0/1459648002 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb6b0021070 con 0x7fb6bc059070 2023-10-03T10:09:54.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.166+0000 7fb6a2ffd700 1 -- 172.21.15.72:0/1459648002 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb6b003c8b0 con 0x7fb6bc059070 2023-10-03T10:09:54.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.166+0000 7fb6c120b700 1 -- 172.21.15.72:0/1459648002 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6bc094d50 con 0x7fb6bc059070 2023-10-03T10:09:54.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.171+0000 7fb6a2ffd700 1 -- 172.21.15.72:0/1459648002 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb6b0029030 con 0x7fb6bc059070 2023-10-03T10:09:54.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.369+0000 7fb6c120b700 1 -- 172.21.15.72:0/1459648002 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb6bc05a260 con 0x7fb6bc059070 2023-10-03T10:09:54.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.371+0000 7fb6a2ffd700 1 -- 172.21.15.72:0/1459648002 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+64130 (secure 0 0 0) 0x7fb6b0029020 con 0x7fb6bc059070 2023-10-03T10:09:54.372 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:54.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.373+0000 7fb6c120b700 1 -- 172.21.15.72:0/1459648002 >> v1:172.21.15.72:6816/118184 conn(0x7fb6a802bb60 legacy=0x7fb6a802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.373+0000 7fb6c120b700 1 -- 172.21.15.72:0/1459648002 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6bc059070 msgr2=0x7fb6bc117970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.373+0000 7fb6c120b700 1 --2- 172.21.15.72:0/1459648002 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6bc059070 0x7fb6bc117970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb6bc0924e0 tx=0x7fb6b0015000).stop 2023-10-03T10:09:54.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.373+0000 7fb6c120b700 1 -- 172.21.15.72:0/1459648002 shutdown_connections 2023-10-03T10:09:54.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.373+0000 7fb6c120b700 1 --2- 172.21.15.72:0/1459648002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6bc127390 0x7fb6bc113e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.373+0000 7fb6c120b700 1 --2- 172.21.15.72:0/1459648002 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6bc059070 0x7fb6bc117970 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.373+0000 7fb6c120b700 1 --2- 172.21.15.72:0/1459648002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6bc095370 0x7fb6bc113940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.373+0000 7fb6c120b700 1 -- 172.21.15.72:0/1459648002 >> 172.21.15.72:0/1459648002 conn(0x7fb6bc097470 msgr2=0x7fb6bc098780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:54.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.373+0000 7fb6c120b700 1 -- 172.21.15.72:0/1459648002 shutdown_connections 2023-10-03T10:09:54.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.373+0000 7fb6c120b700 1 -- 172.21.15.72:0/1459648002 wait complete. 2023-10-03T10:09:54.385 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":4,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6816","nonce":118184}]},"active_addr":"172.21.15.72:6816/118184","active_change":"2023-10-03T10:09:35.872842+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2966012812}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":3319279924}]}]} 2023-10-03T10:09:54.388 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T10:09:54.388 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:09:54.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.503+0000 7f9ce47bb700 1 Processor -- start 2023-10-03T10:09:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.503+0000 7f9ce47bb700 1 -- start start 2023-10-03T10:09:54.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce47bb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cdc096380 0x7f9cdc094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce47bb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cdc091b00 0x7f9cdc127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce47bb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc096760 con 0x7f9cdc094c20 2023-10-03T10:09:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce47bb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cdc091ff0 con 0x7f9cdc096380 2023-10-03T10:09:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce47bb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc092c80 con 0x7f9cdc091b00 2023-10-03T10:09:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce2557700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cdc096380 0x7f9cdc094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce1d56700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cdc091b00 0x7f9cdc127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce2557700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cdc096380 0x7f9cdc094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33198/0 (socket says 172.21.15.72:33198) 2023-10-03T10:09:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce1d56700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cdc091b00 0x7f9cdc127600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48012/0 (socket says 172.21.15.72:48012) 2023-10-03T10:09:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce2d58700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9cdc094c20 0x7f9cdc127af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41012/0 (socket says 172.21.15.72:41012) 2023-10-03T10:09:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce2557700 1 -- 172.21.15.72:0/1320053578 learned_addr learned my addr 172.21.15.72:0/1320053578 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce1d56700 1 -- 172.21.15.72:0/1320053578 >> v2:172.21.15.72:3300/0 conn(0x7f9cdc096380 msgr2=0x7f9cdc094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce1d56700 1 --2- 172.21.15.72:0/1320053578 >> v2:172.21.15.72:3300/0 conn(0x7f9cdc096380 0x7f9cdc094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce1d56700 1 -- 172.21.15.72:0/1320053578 >> v1:172.21.15.72:6789/0 conn(0x7f9cdc094c20 legacy=0x7f9cdc127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce1d56700 1 -- 172.21.15.72:0/1320053578 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc093900 con 0x7f9cdc091b00 2023-10-03T10:09:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce1555700 1 -- 172.21.15.72:0/1320053578 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749163479 0 0) 0x7f9cdc096760 con 0x7f9cdc094c20 2023-10-03T10:09:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.504+0000 7f9ce2557700 1 --2- 172.21.15.72:0/1320053578 >> v2:172.21.15.72:3300/0 conn(0x7f9cdc096380 0x7f9cdc094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.505+0000 7f9ce1d56700 1 --2- 172.21.15.72:0/1320053578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cdc091b00 0x7f9cdc127600 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9cd800ba30 tx=0x7f9cd800b300).ready entity=mon.1 client_cookie=bdbb590436b7d89c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.505+0000 7f9ce1555700 1 -- 172.21.15.72:0/1320053578 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd800da30 con 0x7f9cdc091b00 2023-10-03T10:09:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.505+0000 7f9ce1555700 1 -- 172.21.15.72:0/1320053578 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd800db90 con 0x7f9cdc091b00 2023-10-03T10:09:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.505+0000 7f9ce1555700 1 -- 172.21.15.72:0/1320053578 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8010470 con 0x7f9cdc091b00 2023-10-03T10:09:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.505+0000 7f9ce47bb700 1 -- 172.21.15.72:0/1320053578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cdc091b00 msgr2=0x7f9cdc127600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.505+0000 7f9ce47bb700 1 --2- 172.21.15.72:0/1320053578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cdc091b00 0x7f9cdc127600 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9cd800ba30 tx=0x7f9cd800b300).stop 2023-10-03T10:09:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.505+0000 7f9ce47bb700 1 -- 172.21.15.72:0/1320053578 shutdown_connections 2023-10-03T10:09:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.505+0000 7f9ce47bb700 1 --2- 172.21.15.72:0/1320053578 >> v2:172.21.15.72:3300/0 conn(0x7f9cdc096380 0x7f9cdc094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.505+0000 7f9ce47bb700 1 --2- 172.21.15.72:0/1320053578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cdc091b00 0x7f9cdc127600 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.505+0000 7f9ce47bb700 1 -- 172.21.15.72:0/1320053578 >> 172.21.15.72:0/1320053578 conn(0x7f9cdc097470 msgr2=0x7f9cdc097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.505+0000 7f9ce47bb700 1 -- 172.21.15.72:0/1320053578 shutdown_connections 2023-10-03T10:09:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.505+0000 7f9ce47bb700 1 -- 172.21.15.72:0/1320053578 wait complete. 2023-10-03T10:09:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.506+0000 7f9ce47bb700 1 Processor -- start 2023-10-03T10:09:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.506+0000 7f9ce47bb700 1 -- start start 2023-10-03T10:09:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.506+0000 7f9ce47bb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc091b00 0x7f9cdc11aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.506+0000 7f9ce47bb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cdc094c20 0x7f9cdc116f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.506+0000 7f9ce47bb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cdc096380 0x7f9cdc117400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.506+0000 7f9ce47bb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc1183b0 con 0x7f9cdc091b00 2023-10-03T10:09:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce47bb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc06a520 con 0x7f9cdc094c20 2023-10-03T10:09:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce47bb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc124fb0 con 0x7f9cdc096380 2023-10-03T10:09:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce2557700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc091b00 0x7f9cdc11aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce2557700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc091b00 0x7f9cdc11aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33214/0 (socket says 172.21.15.72:33214) 2023-10-03T10:09:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce2557700 1 -- 172.21.15.72:0/3453552669 learned_addr learned my addr 172.21.15.72:0/3453552669 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce2d58700 1 --2- 172.21.15.72:0/3453552669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cdc096380 0x7f9cdc117400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce1d56700 1 --2- 172.21.15.72:0/3453552669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cdc094c20 0x7f9cdc116f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce2557700 1 -- 172.21.15.72:0/3453552669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cdc096380 msgr2=0x7f9cdc117400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce2557700 1 --2- 172.21.15.72:0/3453552669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cdc096380 0x7f9cdc117400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce2557700 1 -- 172.21.15.72:0/3453552669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cdc094c20 msgr2=0x7f9cdc116f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce2557700 1 --2- 172.21.15.72:0/3453552669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cdc094c20 0x7f9cdc116f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce2557700 1 -- 172.21.15.72:0/3453552669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ccc009370 con 0x7f9cdc091b00 2023-10-03T10:09:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce1d56700 1 --2- 172.21.15.72:0/3453552669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cdc094c20 0x7f9cdc116f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce2557700 1 --2- 172.21.15.72:0/3453552669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc091b00 0x7f9cdc11aeb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f9ccc00ea50 tx=0x7f9ccc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:54.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9cd27fc700 1 -- 172.21.15.72:0/3453552669 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc00ee90 con 0x7f9cdc091b00 2023-10-03T10:09:54.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9cd27fc700 1 -- 172.21.15.72:0/3453552669 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ccc00c850 con 0x7f9cdc091b00 2023-10-03T10:09:54.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9cd27fc700 1 -- 172.21.15.72:0/3453552669 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc00cbd0 con 0x7f9cdc091b00 2023-10-03T10:09:54.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce47bb700 1 -- 172.21.15.72:0/3453552669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd800b540 con 0x7f9cdc091b00 2023-10-03T10:09:54.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.507+0000 7f9ce47bb700 1 -- 172.21.15.72:0/3453552669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cdc11a410 con 0x7f9cdc091b00 2023-10-03T10:09:54.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.508+0000 7f9cd27fc700 1 -- 172.21.15.72:0/3453552669 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f9ccc01b400 con 0x7f9cdc091b00 2023-10-03T10:09:54.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.508+0000 7f9cd27fc700 1 -- 172.21.15.72:0/3453552669 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f9ccc03b580 con 0x7f9cdc091b00 2023-10-03T10:09:54.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.508+0000 7f9ce47bb700 1 -- 172.21.15.72:0/3453552669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cdc11a610 con 0x7f9cdc091b00 2023-10-03T10:09:54.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.513+0000 7f9cd27fc700 1 -- 172.21.15.72:0/3453552669 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9ccc016030 con 0x7f9cdc091b00 2023-10-03T10:09:54.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.671+0000 7f9ce47bb700 1 -- 172.21.15.72:0/3453552669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cdc05a260 con 0x7f9cdc091b00 2023-10-03T10:09:54.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.672+0000 7f9cd27fc700 1 -- 172.21.15.72:0/3453552669 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f9ccc0123f0 con 0x7f9cdc091b00 2023-10-03T10:09:54.672 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:54.672 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:09:47.346977+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.673+0000 7f9ce47bb700 1 -- 172.21.15.72:0/3453552669 >> v1:172.21.15.72:6816/118184 conn(0x7f9cc002bb60 legacy=0x7f9cc002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.673+0000 7f9ce47bb700 1 -- 172.21.15.72:0/3453552669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc091b00 msgr2=0x7f9cdc11aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.673+0000 7f9ce47bb700 1 --2- 172.21.15.72:0/3453552669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc091b00 0x7f9cdc11aeb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f9ccc00ea50 tx=0x7f9ccc0090f0).stop 2023-10-03T10:09:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.674+0000 7f9ce47bb700 1 -- 172.21.15.72:0/3453552669 shutdown_connections 2023-10-03T10:09:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.674+0000 7f9ce47bb700 1 --2- 172.21.15.72:0/3453552669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cdc091b00 0x7f9cdc11aeb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.674+0000 7f9ce47bb700 1 --2- 172.21.15.72:0/3453552669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cdc096380 0x7f9cdc117400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.674+0000 7f9ce47bb700 1 --2- 172.21.15.72:0/3453552669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cdc094c20 0x7f9cdc116f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.674+0000 7f9ce47bb700 1 -- 172.21.15.72:0/3453552669 >> 172.21.15.72:0/3453552669 conn(0x7f9cdc097470 msgr2=0x7f9cdc126ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.674+0000 7f9ce47bb700 1 -- 172.21.15.72:0/3453552669 shutdown_connections 2023-10-03T10:09:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.674+0000 7f9ce47bb700 1 -- 172.21.15.72:0/3453552669 wait complete. 2023-10-03T10:09:54.685 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:09:54.685 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:54.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.800+0000 7f1663a0f700 1 Processor -- start 2023-10-03T10:09:54.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.801+0000 7f1663a0f700 1 -- start start 2023-10-03T10:09:54.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.801+0000 7f1663a0f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f165c0970d0 0x7f165c12cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.801+0000 7f1663a0f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c12d120 0x7f165c12f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.801+0000 7f1663a0f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165c0919e0 con 0x7f165c0965e0 2023-10-03T10:09:54.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.801+0000 7f1663a0f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c0933b0 con 0x7f165c12d120 2023-10-03T10:09:54.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.801+0000 7f1663a0f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f165c092190 con 0x7f165c0970d0 2023-10-03T10:09:54.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.801+0000 7f1661fac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c12d120 0x7f165c12f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.801+0000 7f1660faa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f165c0970d0 0x7f165c12cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.801+0000 7f16617ab700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f165c0965e0 0x7f165c0969c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41024/0 (socket says 172.21.15.72:41024) 2023-10-03T10:09:54.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.801+0000 7f16617ab700 1 -- 172.21.15.72:0/3090903671 learned_addr learned my addr 172.21.15.72:0/3090903671 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:54.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.801+0000 7f1653fff700 1 -- 172.21.15.72:0/3090903671 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676145770 0 0) 0x7f165c0919e0 con 0x7f165c0965e0 2023-10-03T10:09:54.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1653fff700 1 -- 172.21.15.72:0/3090903671 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16480033f0 con 0x7f165c0965e0 2023-10-03T10:09:54.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1660faa700 1 -- 172.21.15.72:0/3090903671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c12d120 msgr2=0x7f165c12f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:54.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1660faa700 1 --2- 172.21.15.72:0/3090903671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c12d120 0x7f165c12f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1660faa700 1 -- 172.21.15.72:0/3090903671 >> v1:172.21.15.72:6789/0 conn(0x7f165c0965e0 legacy=0x7f165c0969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1660faa700 1 -- 172.21.15.72:0/3090903671 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c069a20 con 0x7f165c0970d0 2023-10-03T10:09:54.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1661fac700 1 --2- 172.21.15.72:0/3090903671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c12d120 0x7f165c12f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:54.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1660faa700 1 --2- 172.21.15.72:0/3090903671 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f165c0970d0 0x7f165c12cc30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1658009790 tx=0x7f1658009060).ready entity=mon.2 client_cookie=fc2f499d185ab4d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:54.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1653fff700 1 -- 172.21.15.72:0/3090903671 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165800f510 con 0x7f165c0970d0 2023-10-03T10:09:54.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1653fff700 1 -- 172.21.15.72:0/3090903671 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165800f670 con 0x7f165c0970d0 2023-10-03T10:09:54.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1653fff700 1 -- 172.21.15.72:0/3090903671 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165800f9f0 con 0x7f165c0970d0 2023-10-03T10:09:54.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1663a0f700 1 -- 172.21.15.72:0/3090903671 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f165c0970d0 msgr2=0x7f165c12cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1663a0f700 1 --2- 172.21.15.72:0/3090903671 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f165c0970d0 0x7f165c12cc30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1658009790 tx=0x7f1658009060).stop 2023-10-03T10:09:54.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1663a0f700 1 -- 172.21.15.72:0/3090903671 shutdown_connections 2023-10-03T10:09:54.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1663a0f700 1 --2- 172.21.15.72:0/3090903671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c12d120 0x7f165c12f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1663a0f700 1 --2- 172.21.15.72:0/3090903671 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f165c0970d0 0x7f165c12cc30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1663a0f700 1 -- 172.21.15.72:0/3090903671 >> 172.21.15.72:0/3090903671 conn(0x7f165c09a220 msgr2=0x7f165c09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:54.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1663a0f700 1 -- 172.21.15.72:0/3090903671 shutdown_connections 2023-10-03T10:09:54.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.802+0000 7f1663a0f700 1 -- 172.21.15.72:0/3090903671 wait complete. 2023-10-03T10:09:54.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.803+0000 7f1663a0f700 1 Processor -- start 2023-10-03T10:09:54.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.803+0000 7f1663a0f700 1 -- start start 2023-10-03T10:09:54.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f1663a0f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f165c0965e0 0x7f165c13a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f1663a0f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f165c0970d0 0x7f165c13acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f1663a0f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c12d120 0x7f165c116a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:54.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f1663a0f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c11e1e0 con 0x7f165c0965e0 2023-10-03T10:09:54.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f1663a0f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c12d5a0 con 0x7f165c12d120 2023-10-03T10:09:54.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f1663a0f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f165c0991f0 con 0x7f165c0970d0 2023-10-03T10:09:54.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f16617ab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f165c0965e0 0x7f165c13a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f16617ab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f165c0965e0 0x7f165c13a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33230/0 (socket says 172.21.15.72:33230) 2023-10-03T10:09:54.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f1661fac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c12d120 0x7f165c116a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f16617ab700 1 -- 172.21.15.72:0/1955345560 learned_addr learned my addr 172.21.15.72:0/1955345560 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:54.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f1660faa700 1 --2- 172.21.15.72:0/1955345560 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f165c0970d0 0x7f165c13acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:54.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f16617ab700 1 -- 172.21.15.72:0/1955345560 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f165c0970d0 msgr2=0x7f165c13acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f16617ab700 1 --2- 172.21.15.72:0/1955345560 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f165c0970d0 0x7f165c13acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f16617ab700 1 -- 172.21.15.72:0/1955345560 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c12d120 msgr2=0x7f165c116a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f16617ab700 1 --2- 172.21.15.72:0/1955345560 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c12d120 0x7f165c116a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f16617ab700 1 -- 172.21.15.72:0/1955345560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1654009a20 con 0x7f165c0965e0 2023-10-03T10:09:54.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f16617ab700 1 --2- 172.21.15.72:0/1955345560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f165c0965e0 0x7f165c13a800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f164c00c590 tx=0x7f164c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:54.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f16517fa700 1 -- 172.21.15.72:0/1955345560 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c0072e0 con 0x7f165c0965e0 2023-10-03T10:09:54.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.804+0000 7f16517fa700 1 -- 172.21.15.72:0/1955345560 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c007440 con 0x7f165c0965e0 2023-10-03T10:09:54.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.805+0000 7f1663a0f700 1 -- 172.21.15.72:0/1955345560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16580092a0 con 0x7f165c0965e0 2023-10-03T10:09:54.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.805+0000 7f16517fa700 1 -- 172.21.15.72:0/1955345560 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c0057a0 con 0x7f165c0965e0 2023-10-03T10:09:54.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.805+0000 7f1663a0f700 1 -- 172.21.15.72:0/1955345560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165c066e90 con 0x7f165c0965e0 2023-10-03T10:09:54.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.805+0000 7f16517fa700 1 -- 172.21.15.72:0/1955345560 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f164c005bd0 con 0x7f165c0965e0 2023-10-03T10:09:54.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.805+0000 7f16517fa700 1 -- 172.21.15.72:0/1955345560 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f164c03a760 con 0x7f165c0965e0 2023-10-03T10:09:54.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.805+0000 7f1663a0f700 1 -- 172.21.15.72:0/1955345560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165c0670b0 con 0x7f165c0965e0 2023-10-03T10:09:54.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.810+0000 7f16517fa700 1 -- 172.21.15.72:0/1955345560 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f165c0670b0 con 0x7f165c0965e0 2023-10-03T10:09:54.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.969+0000 7f1663a0f700 1 -- 172.21.15.72:0/1955345560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f165c0670b0 con 0x7f165c0965e0 2023-10-03T10:09:54.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.970+0000 7f16517fa700 1 -- 172.21.15.72:0/1955345560 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f165c0670b0 con 0x7f165c0965e0 2023-10-03T10:09:54.970 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:54.970 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:09:47.346977+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:54.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.972+0000 7f1663a0f700 1 -- 172.21.15.72:0/1955345560 >> v1:172.21.15.72:6816/118184 conn(0x7f164002bb90 legacy=0x7f164002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.972+0000 7f1663a0f700 1 -- 172.21.15.72:0/1955345560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f165c0965e0 msgr2=0x7f165c13a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:54.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.972+0000 7f1663a0f700 1 --2- 172.21.15.72:0/1955345560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f165c0965e0 0x7f165c13a800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f164c00c590 tx=0x7f164c007c80).stop 2023-10-03T10:09:54.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.972+0000 7f1663a0f700 1 -- 172.21.15.72:0/1955345560 shutdown_connections 2023-10-03T10:09:54.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.972+0000 7f1663a0f700 1 --2- 172.21.15.72:0/1955345560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f165c0965e0 0x7f165c13a800 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.972+0000 7f1663a0f700 1 --2- 172.21.15.72:0/1955345560 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f165c12d120 0x7f165c116a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.972+0000 7f1663a0f700 1 --2- 172.21.15.72:0/1955345560 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f165c0970d0 0x7f165c13acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:54.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.972+0000 7f1663a0f700 1 -- 172.21.15.72:0/1955345560 >> 172.21.15.72:0/1955345560 conn(0x7f165c09a220 msgr2=0x7f165c098170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:54.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.972+0000 7f1663a0f700 1 -- 172.21.15.72:0/1955345560 shutdown_connections 2023-10-03T10:09:54.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:54.972+0000 7f1663a0f700 1 -- 172.21.15.72:0/1955345560 wait complete. 2023-10-03T10:09:54.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T10:09:54.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T10:09:54.985 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T10:09:54.985 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T10:09:55.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.110+0000 7f44af272700 1 Processor -- start 2023-10-03T10:09:55.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.110+0000 7fde28209700 1 Processor -- start 2023-10-03T10:09:55.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7f44af272700 1 -- start start 2023-10-03T10:09:55.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7fde28209700 1 -- start start 2023-10-03T10:09:55.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7f44af272700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f44a8059070 0x7f44a8127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7f44af272700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44a8127390 0x7f44a8127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7fde28209700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde20059070 0x7fde2012af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7fde28209700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fde2012a9c0 0x7fde2012b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7f44af272700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a8091b60 con 0x7f44a8095370 2023-10-03T10:09:55.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7f44af272700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a8096940 con 0x7f44a8059070 2023-10-03T10:09:55.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7f44af272700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a8059c00 con 0x7f44a8127390 2023-10-03T10:09:55.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7fde28209700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde2012b8e0 con 0x7fde20127410 2023-10-03T10:09:55.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7fde28209700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde200921b0 con 0x7fde2012a9c0 2023-10-03T10:09:55.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7fde28209700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde20091c80 con 0x7fde20059070 2023-10-03T10:09:55.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7fde267a6700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fde20127410 0x7fde201278c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41036/0 (socket says 172.21.15.72:41036) 2023-10-03T10:09:55.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7fde267a6700 1 -- 172.21.15.72:0/3690851063 learned_addr learned my addr 172.21.15.72:0/3690851063 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:55.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7fde257a4700 1 --2- 172.21.15.72:0/3690851063 >> v2:172.21.15.72:3300/0 conn(0x7fde2012a9c0 0x7fde2012b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7fde25fa5700 1 --2- 172.21.15.72:0/3690851063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde20059070 0x7fde2012af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7f44ad80f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f44a8095370 0x7f44a8095820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41028/0 (socket says 172.21.15.72:41028) 2023-10-03T10:09:55.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7f44ad80f700 1 -- 172.21.15.72:0/4029538804 learned_addr learned my addr 172.21.15.72:0/4029538804 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:55.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.111+0000 7f44ad00e700 1 --2- 172.21.15.72:0/4029538804 >> v2:172.21.15.72:3300/0 conn(0x7f44a8059070 0x7f44a8127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7fde25fa5700 1 -- 172.21.15.72:0/3690851063 >> v2:172.21.15.72:3300/0 conn(0x7fde2012a9c0 msgr2=0x7fde2012b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:55.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7fde25fa5700 1 --2- 172.21.15.72:0/3690851063 >> v2:172.21.15.72:3300/0 conn(0x7fde2012a9c0 0x7fde2012b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7fde25fa5700 1 -- 172.21.15.72:0/3690851063 >> v1:172.21.15.72:6789/0 conn(0x7fde20127410 legacy=0x7fde201278c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7fde25fa5700 1 -- 172.21.15.72:0/3690851063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde20096e50 con 0x7fde20059070 2023-10-03T10:09:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7f44ad00e700 1 -- 172.21.15.72:0/4029538804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44a8127390 msgr2=0x7f44a8127d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7f44ad00e700 1 --2- 172.21.15.72:0/4029538804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44a8127390 0x7f44a8127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7f44ad00e700 1 -- 172.21.15.72:0/4029538804 >> v1:172.21.15.72:6789/0 conn(0x7f44a8095370 legacy=0x7f44a8095820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7f44ad00e700 1 -- 172.21.15.72:0/4029538804 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a80929d0 con 0x7f44a8059070 2023-10-03T10:09:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7f44ad00e700 1 --2- 172.21.15.72:0/4029538804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44a8059070 0x7f44a8127890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f44a4009760 tx=0x7f44a4009060).ready entity=mon.0 client_cookie=4545b0a4af8a8ab4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7fde25fa5700 1 --2- 172.21.15.72:0/3690851063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde20059070 0x7fde2012af00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fde1c009760 tx=0x7fde1c009060).ready entity=mon.2 client_cookie=e148717331025d76 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7f449ffff700 1 -- 172.21.15.72:0/4029538804 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a40090d0 con 0x7f44a8059070 2023-10-03T10:09:55.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7fde24fa3700 1 -- 172.21.15.72:0/3690851063 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0090d0 con 0x7fde20059070 2023-10-03T10:09:55.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7f449ffff700 1 -- 172.21.15.72:0/4029538804 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a400b580 con 0x7f44a8059070 2023-10-03T10:09:55.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7f449ffff700 1 -- 172.21.15.72:0/4029538804 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a400b900 con 0x7f44a8059070 2023-10-03T10:09:55.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7fde24fa3700 1 -- 172.21.15.72:0/3690851063 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c00f510 con 0x7fde20059070 2023-10-03T10:09:55.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.112+0000 7fde24fa3700 1 -- 172.21.15.72:0/3690851063 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c00f890 con 0x7fde20059070 2023-10-03T10:09:55.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7fde28209700 1 -- 172.21.15.72:0/3690851063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde20059070 msgr2=0x7fde2012af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7fde28209700 1 --2- 172.21.15.72:0/3690851063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde20059070 0x7fde2012af00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fde1c009760 tx=0x7fde1c009060).stop 2023-10-03T10:09:55.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7fde28209700 1 -- 172.21.15.72:0/3690851063 shutdown_connections 2023-10-03T10:09:55.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7fde28209700 1 --2- 172.21.15.72:0/3690851063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde20059070 0x7fde2012af00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7fde28209700 1 --2- 172.21.15.72:0/3690851063 >> v2:172.21.15.72:3300/0 conn(0x7fde2012a9c0 0x7fde2012b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7fde28209700 1 -- 172.21.15.72:0/3690851063 >> 172.21.15.72:0/3690851063 conn(0x7fde200974f0 msgr2=0x7fde20097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7f44af272700 1 -- 172.21.15.72:0/4029538804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44a8059070 msgr2=0x7f44a8127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7f44af272700 1 --2- 172.21.15.72:0/4029538804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44a8059070 0x7f44a8127890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f44a4009760 tx=0x7f44a4009060).stop 2023-10-03T10:09:55.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7fde28209700 1 -- 172.21.15.72:0/3690851063 shutdown_connections 2023-10-03T10:09:55.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7f44af272700 1 -- 172.21.15.72:0/4029538804 shutdown_connections 2023-10-03T10:09:55.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7f44af272700 1 --2- 172.21.15.72:0/4029538804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44a8059070 0x7f44a8127890 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7f44af272700 1 --2- 172.21.15.72:0/4029538804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44a8127390 0x7f44a8127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:55.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7f44af272700 1 -- 172.21.15.72:0/4029538804 >> 172.21.15.72:0/4029538804 conn(0x7f44a8097470 msgr2=0x7f44a8097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7fde28209700 1 -- 172.21.15.72:0/3690851063 wait complete. 2023-10-03T10:09:55.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7f44af272700 1 -- 172.21.15.72:0/4029538804 shutdown_connections 2023-10-03T10:09:55.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.113+0000 7f44af272700 1 -- 172.21.15.72:0/4029538804 wait complete. 2023-10-03T10:09:55.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.114+0000 7fde28209700 1 Processor -- start 2023-10-03T10:09:55.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.114+0000 7fde28209700 1 -- start start 2023-10-03T10:09:55.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.114+0000 7f44af272700 1 Processor -- start 2023-10-03T10:09:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.114+0000 7fde28209700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde20059070 0x7fde20113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.114+0000 7fde28209700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde20127410 0x7fde20113e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde28209700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2012a9c0 0x7fde20114320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde28209700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde20097080 con 0x7fde2012a9c0 2023-10-03T10:09:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde28209700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde20124a50 con 0x7fde20127410 2023-10-03T10:09:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde28209700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde20117420 con 0x7fde20059070 2023-10-03T10:09:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde267a6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2012a9c0 0x7fde20114320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde267a6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2012a9c0 0x7fde20114320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33254/0 (socket says 172.21.15.72:33254) 2023-10-03T10:09:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde267a6700 1 -- 172.21.15.72:0/1728525653 learned_addr learned my addr 172.21.15.72:0/1728525653 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde267a6700 1 -- 172.21.15.72:0/1728525653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde20059070 msgr2=0x7fde20113940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:09:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde267a6700 1 --2- 172.21.15.72:0/1728525653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde20059070 0x7fde20113940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde267a6700 1 -- 172.21.15.72:0/1728525653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde20127410 msgr2=0x7fde20113e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde267a6700 1 --2- 172.21.15.72:0/1728525653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde20127410 0x7fde20113e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde267a6700 1 -- 172.21.15.72:0/1728525653 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c0092a0 con 0x7fde2012a9c0 2023-10-03T10:09:55.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7f44af272700 1 -- start start 2023-10-03T10:09:55.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde267a6700 1 --2- 172.21.15.72:0/1728525653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2012a9c0 0x7fde20114320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fde1800c790 tx=0x7fde180015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde15ffb700 1 -- 172.21.15.72:0/1728525653 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde18005d30 con 0x7fde2012a9c0 2023-10-03T10:09:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde28209700 1 -- 172.21.15.72:0/1728525653 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde201292e0 con 0x7fde2012a9c0 2023-10-03T10:09:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7f44af272700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44a8059070 0x7f44a8118ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde15ffb700 1 -- 172.21.15.72:0/1728525653 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde18005e90 con 0x7fde2012a9c0 2023-10-03T10:09:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7fde15ffb700 1 -- 172.21.15.72:0/1728525653 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde18007320 con 0x7fde2012a9c0 2023-10-03T10:09:55.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.115+0000 7f44af272700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44a8095370 0x7f44a8114a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7f44ad00e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44a8059070 0x7f44a8118ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7f44ad00e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44a8059070 0x7f44a8118ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59342/0 (socket says 172.21.15.72:59342) 2023-10-03T10:09:55.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7f44af272700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44a8127390 0x7f44a8114f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7f44ac80d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44a8095370 0x7f44a8114a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7f44af272700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a8125be0 con 0x7f44a8095370 2023-10-03T10:09:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7f44ac80d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44a8095370 0x7f44a8114a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33256/0 (socket says 172.21.15.72:33256) 2023-10-03T10:09:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7f44ac80d700 1 -- 172.21.15.72:0/3266639324 learned_addr learned my addr 172.21.15.72:0/3266639324 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7f44af272700 1 -- 172.21.15.72:0/3266639324 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a8126dd0 con 0x7f44a8127390 2023-10-03T10:09:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7f44af272700 1 -- 172.21.15.72:0/3266639324 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44a8096f20 con 0x7f44a8059070 2023-10-03T10:09:55.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7f44ad80f700 1 --2- 172.21.15.72:0/3266639324 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44a8127390 0x7f44a8114f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7fde15ffb700 1 -- 172.21.15.72:0/1728525653 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fde18007480 con 0x7fde2012a9c0 2023-10-03T10:09:55.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7fde28209700 1 -- 172.21.15.72:0/1728525653 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde20117cc0 con 0x7fde2012a9c0 2023-10-03T10:09:55.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7f44ad00e700 1 -- 172.21.15.72:0/3266639324 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44a8127390 msgr2=0x7f44a8114f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7f44ad00e700 1 --2- 172.21.15.72:0/3266639324 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44a8127390 0x7f44a8114f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7f44ad00e700 1 -- 172.21.15.72:0/3266639324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44a8095370 msgr2=0x7f44a8114a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7f44ad00e700 1 --2- 172.21.15.72:0/3266639324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44a8095370 0x7f44a8114a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.116+0000 7f44ad00e700 1 -- 172.21.15.72:0/3266639324 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a40092a0 con 0x7f44a8059070 2023-10-03T10:09:55.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.117+0000 7f44ac80d700 1 --2- 172.21.15.72:0/3266639324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44a8095370 0x7f44a8114a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:55.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.117+0000 7f44ad00e700 1 --2- 172.21.15.72:0/3266639324 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44a8059070 0x7f44a8118ab0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f44a8097340 tx=0x7f44a4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.117+0000 7fde15ffb700 1 -- 172.21.15.72:0/1728525653 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fde18011bf0 con 0x7fde2012a9c0 2023-10-03T10:09:55.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.117+0000 7f449d7fa700 1 -- 172.21.15.72:0/3266639324 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4006910 con 0x7f44a8059070 2023-10-03T10:09:55.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.117+0000 7f449d7fa700 1 -- 172.21.15.72:0/3266639324 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a4011920 con 0x7f44a8059070 2023-10-03T10:09:55.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.117+0000 7f44af272700 1 -- 172.21.15.72:0/3266639324 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a81185b0 con 0x7f44a8059070 2023-10-03T10:09:55.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.117+0000 7f449d7fa700 1 -- 172.21.15.72:0/3266639324 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4011ca0 con 0x7f44a8059070 2023-10-03T10:09:55.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.117+0000 7f44af272700 1 -- 172.21.15.72:0/3266639324 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a81166a0 con 0x7f44a8059070 2023-10-03T10:09:55.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.117+0000 7fde28209700 1 -- 172.21.15.72:0/1728525653 --> v1:172.21.15.72:6805/118755 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde20099810 con 0x7fde201268a0 2023-10-03T10:09:55.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.118+0000 7f449d7fa700 1 -- 172.21.15.72:0/3266639324 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f44a401b620 con 0x7f44a8059070 2023-10-03T10:09:55.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.118+0000 7f44af272700 1 -- 172.21.15.72:0/3266639324 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4488000fc0 con 0x7f44a8059070 2023-10-03T10:09:55.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.118+0000 7f449d7fa700 1 -- 172.21.15.72:0/3266639324 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f44a403c970 con 0x7f44a8059070 2023-10-03T10:09:55.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.118+0000 7f449d7fa700 1 -- 172.21.15.72:0/3266639324 --> v1:172.21.15.72:6804/118756 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f448c038460 con 0x7f448c034770 2023-10-03T10:09:55.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.118+0000 7f449d7fa700 1 -- 172.21.15.72:0/3266639324 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44a4023400 con 0x7f44a8059070 2023-10-03T10:09:55.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.119+0000 7fde15ffb700 1 -- 172.21.15.72:0/1728525653 <== osd.0 v1:172.21.15.72:6805/118755 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fde20099810 con 0x7fde201268a0 2023-10-03T10:09:55.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.119+0000 7f449d7fa700 1 -- 172.21.15.72:0/3266639324 <== osd.1 v1:172.21.15.72:6804/118756 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f448c038460 con 0x7f448c034770 2023-10-03T10:09:55.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.120+0000 7f31c0c27700 1 Processor -- start 2023-10-03T10:09:55.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.120+0000 7f31c0c27700 1 -- start start 2023-10-03T10:09:55.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.121+0000 7f31c0c27700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31bc059070 0x7f31bc1257b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.121+0000 7f31c0c27700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31bc1252b0 0x7f31bc125ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.121+0000 7f31c0c27700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31bc093bf0 0x7f31bc0940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.121+0000 7f31c0c27700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31bc059450 con 0x7f31bc1252b0 2023-10-03T10:09:55.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.121+0000 7f31c0c27700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc0965d0 con 0x7f31bc093bf0 2023-10-03T10:09:55.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.121+0000 7f31c0c27700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc06a780 con 0x7f31bc059070 2023-10-03T10:09:55.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.121+0000 7f31ba59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31bc059070 0x7f31bc1257b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.121+0000 7f31ba59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31bc059070 0x7f31bc1257b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59350/0 (socket says 172.21.15.72:59350) 2023-10-03T10:09:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f31ba59c700 1 -- 172.21.15.72:0/815538111 learned_addr learned my addr 172.21.15.72:0/815538111 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f31b9d9b700 1 --2- 172.21.15.72:0/815538111 >> v2:172.21.15.72:3300/0 conn(0x7f31bc1252b0 0x7f31bc125ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f31bad9d700 1 --2- 172.21.15.72:0/815538111 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31bc093bf0 0x7f31bc0940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f31ba59c700 1 -- 172.21.15.72:0/815538111 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31bc093bf0 msgr2=0x7f31bc0940a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f31ba59c700 1 --2- 172.21.15.72:0/815538111 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31bc093bf0 0x7f31bc0940a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f31ba59c700 1 -- 172.21.15.72:0/815538111 >> v2:172.21.15.72:3300/0 conn(0x7f31bc1252b0 msgr2=0x7f31bc125ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f31ba59c700 1 --2- 172.21.15.72:0/815538111 >> v2:172.21.15.72:3300/0 conn(0x7f31bc1252b0 0x7f31bc125ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f31ba59c700 1 -- 172.21.15.72:0/815538111 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc059fc0 con 0x7f31bc059070 2023-10-03T10:09:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f31bad9d700 1 --2- 172.21.15.72:0/815538111 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31bc093bf0 0x7f31bc0940a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:55.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f31b9d9b700 1 --2- 172.21.15.72:0/815538111 >> v2:172.21.15.72:3300/0 conn(0x7f31bc1252b0 0x7f31bc125ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:09:55.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f31ba59c700 1 --2- 172.21.15.72:0/815538111 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31bc059070 0x7f31bc1257b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f31ac006fd0 tx=0x7f31ac0090f0).ready entity=mon.2 client_cookie=edd940806cd22cc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f31b959a700 1 -- 172.21.15.72:0/815538111 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00b520 con 0x7f31bc059070 2023-10-03T10:09:55.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f775889d700 1 Processor -- start 2023-10-03T10:09:55.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f31b959a700 1 -- 172.21.15.72:0/815538111 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac00b680 con 0x7f31bc059070 2023-10-03T10:09:55.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f31b959a700 1 -- 172.21.15.72:0/815538111 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00ba20 con 0x7f31bc059070 2023-10-03T10:09:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.122+0000 7f775889d700 1 -- start start 2023-10-03T10:09:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.123+0000 7f31c0c27700 1 -- 172.21.15.72:0/815538111 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31bc059070 msgr2=0x7f31bc1257b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.123+0000 7f31c0c27700 1 --2- 172.21.15.72:0/815538111 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31bc059070 0x7f31bc1257b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f31ac006fd0 tx=0x7f31ac0090f0).stop 2023-10-03T10:09:55.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.123+0000 7f31c0c27700 1 -- 172.21.15.72:0/815538111 shutdown_connections 2023-10-03T10:09:55.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.123+0000 7f31c0c27700 1 --2- 172.21.15.72:0/815538111 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31bc093bf0 0x7f31bc0940a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.123+0000 7f31c0c27700 1 --2- 172.21.15.72:0/815538111 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31bc059070 0x7f31bc1257b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.123+0000 7f31c0c27700 1 --2- 172.21.15.72:0/815538111 >> v2:172.21.15.72:3300/0 conn(0x7f31bc1252b0 0x7f31bc125ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.123+0000 7f31c0c27700 1 -- 172.21.15.72:0/815538111 >> 172.21.15.72:0/815538111 conn(0x7f31bc0974f0 msgr2=0x7f31bc097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.123+0000 7f31c0c27700 1 -- 172.21.15.72:0/815538111 shutdown_connections 2023-10-03T10:09:55.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.123+0000 7f31c0c27700 1 -- 172.21.15.72:0/815538111 wait complete. 2023-10-03T10:09:55.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.123+0000 7f775889d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7754065640 0x7f775406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.123+0000 7f775889d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77540960f0 0x7f7754098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.123+0000 7f775889d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7754098b30 0x7f7754098fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.123+0000 7f775889d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77540660b0 con 0x7f7754065640 2023-10-03T10:09:55.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.123+0000 7f775889d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77540951d0 con 0x7f77540960f0 2023-10-03T10:09:55.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.123+0000 7f775889d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7754097e10 con 0x7f7754098b30 2023-10-03T10:09:55.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.124+0000 7f7751d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77540960f0 0x7f7754098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.124+0000 7f7752d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7754098b30 0x7f7754098fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.124+0000 7f7751d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77540960f0 0x7f7754098640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48074/0 (socket says 172.21.15.72:48074) 2023-10-03T10:09:55.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.124+0000 7f7751d9b700 1 -- 172.21.15.72:0/2265670846 learned_addr learned my addr 172.21.15.72:0/2265670846 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:55.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.124+0000 7f7751d9b700 1 -- 172.21.15.72:0/2265670846 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7754098b30 msgr2=0x7f7754098fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:55.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.124+0000 7f7751d9b700 1 --2- 172.21.15.72:0/2265670846 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7754098b30 0x7f7754098fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.124+0000 7f7751d9b700 1 -- 172.21.15.72:0/2265670846 >> v2:172.21.15.72:3300/0 conn(0x7f7754065640 msgr2=0x7f775406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:55.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.124+0000 7f7751d9b700 1 --2- 172.21.15.72:0/2265670846 >> v2:172.21.15.72:3300/0 conn(0x7f7754065640 0x7f775406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:55.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.124+0000 7f7751d9b700 1 -- 172.21.15.72:0/2265670846 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7754095470 con 0x7f77540960f0 2023-10-03T10:09:55.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.124+0000 7f7751d9b700 1 --2- 172.21.15.72:0/2265670846 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77540960f0 0x7f7754098640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f774c009f50 tx=0x7f774c009840).ready entity=mon.1 client_cookie=60ba30783ca11626 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.124+0000 7f775159a700 1 -- 172.21.15.72:0/2265670846 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c00e070 con 0x7f77540960f0 2023-10-03T10:09:55.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.124+0000 7f775159a700 1 -- 172.21.15.72:0/2265670846 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c00b9c0 con 0x7f77540960f0 2023-10-03T10:09:55.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.124+0000 7f775159a700 1 -- 172.21.15.72:0/2265670846 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c00bd40 con 0x7f77540960f0 2023-10-03T10:09:55.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.124+0000 7f31c0c27700 1 Processor -- start 2023-10-03T10:09:55.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f31c0c27700 1 -- start start 2023-10-03T10:09:55.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f31c0c27700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31bc059070 0x7f31bc068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f31c0c27700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31bc093bf0 0x7f31bc068f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f31c0c27700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31bc1252b0 0x7f31bc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f31c0c27700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc067980 con 0x7f31bc1252b0 2023-10-03T10:09:55.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f31c0c27700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc066550 con 0x7f31bc093bf0 2023-10-03T10:09:55.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f31c0c27700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc114c40 con 0x7f31bc059070 2023-10-03T10:09:55.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f775889d700 1 -- 172.21.15.72:0/2265670846 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77540960f0 msgr2=0x7f7754098640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f775889d700 1 --2- 172.21.15.72:0/2265670846 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77540960f0 0x7f7754098640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f774c009f50 tx=0x7f774c009840).stop 2023-10-03T10:09:55.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f775889d700 1 -- 172.21.15.72:0/2265670846 shutdown_connections 2023-10-03T10:09:55.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f775889d700 1 --2- 172.21.15.72:0/2265670846 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7754098b30 0x7f7754098fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f775889d700 1 --2- 172.21.15.72:0/2265670846 >> v2:172.21.15.72:3300/0 conn(0x7f7754065640 0x7f775406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:55.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f775889d700 1 --2- 172.21.15.72:0/2265670846 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77540960f0 0x7f7754098640 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0x7f774c009f50 tx=0x7f774c009840).stop 2023-10-03T10:09:55.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f775889d700 1 -- 172.21.15.72:0/2265670846 >> 172.21.15.72:0/2265670846 conn(0x7f775409a900 msgr2=0x7f775409ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.126+0000 7f775889d700 1 -- 172.21.15.72:0/2265670846 shutdown_connections 2023-10-03T10:09:55.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.126+0000 7f775889d700 1 -- 172.21.15.72:0/2265670846 wait complete. 2023-10-03T10:09:55.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f31ba59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31bc059070 0x7f31bc068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f31ba59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31bc059070 0x7f31bc068a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59368/0 (socket says 172.21.15.72:59368) 2023-10-03T10:09:55.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f31ba59c700 1 -- 172.21.15.72:0/3732268234 learned_addr learned my addr 172.21.15.72:0/3732268234 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:55.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.125+0000 7f31bad9d700 1 --2- 172.21.15.72:0/3732268234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31bc1252b0 0x7f31bc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.126+0000 7f31b9d9b700 1 --2- 172.21.15.72:0/3732268234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31bc093bf0 0x7f31bc068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.126+0000 7f31ba59c700 1 -- 172.21.15.72:0/3732268234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31bc093bf0 msgr2=0x7f31bc068f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.126+0000 7f31ba59c700 1 --2- 172.21.15.72:0/3732268234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31bc093bf0 0x7f31bc068f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.126+0000 7f31ba59c700 1 -- 172.21.15.72:0/3732268234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31bc1252b0 msgr2=0x7f31bc069470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.126+0000 7f31ba59c700 1 --2- 172.21.15.72:0/3732268234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31bc1252b0 0x7f31bc069470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.126+0000 7f31ba59c700 1 -- 172.21.15.72:0/3732268234 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b4009a20 con 0x7f31bc059070 2023-10-03T10:09:55.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.126+0000 7f31ba59c700 1 --2- 172.21.15.72:0/3732268234 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31bc059070 0x7f31bc068a90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f31ac009ea0 tx=0x7f31ac017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.126+0000 7f31aa7fc700 1 -- 172.21.15.72:0/3732268234 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac006930 con 0x7f31bc059070 2023-10-03T10:09:55.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.126+0000 7f31aa7fc700 1 -- 172.21.15.72:0/3732268234 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac000bc0 con 0x7f31bc059070 2023-10-03T10:09:55.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.126+0000 7f31aa7fc700 1 -- 172.21.15.72:0/3732268234 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac00ba20 con 0x7f31bc059070 2023-10-03T10:09:55.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.126+0000 7f31c0c27700 1 -- 172.21.15.72:0/3732268234 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ac009370 con 0x7f31bc059070 2023-10-03T10:09:55.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.126+0000 7f31c0c27700 1 -- 172.21.15.72:0/3732268234 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc069960 con 0x7f31bc059070 2023-10-03T10:09:55.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.127+0000 7f775889d700 1 Processor -- start 2023-10-03T10:09:55.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.127+0000 7f775889d700 1 -- start start 2023-10-03T10:09:55.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.127+0000 7f31c0c27700 1 -- 172.21.15.72:0/3732268234 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31bc059790 con 0x7f31bc059070 2023-10-03T10:09:55.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f775889d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7754065640 0x7f775411ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f775889d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7754098b30 0x7f775411f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f775889d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f775411f8e0 0x7f775413e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f775889d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775411ed10 con 0x7f7754065640 2023-10-03T10:09:55.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f775889d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775411fd40 con 0x7f775411f8e0 2023-10-03T10:09:55.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f775889d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77540947b0 con 0x7f7754098b30 2023-10-03T10:09:55.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f31aa7fc700 1 -- 172.21.15.72:0/3732268234 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f31ac01c630 con 0x7f31bc059070 2023-10-03T10:09:55.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f775259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7754065640 0x7f775411ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f775259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7754065640 0x7f775411ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33302/0 (socket says 172.21.15.72:33302) 2023-10-03T10:09:55.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f7751d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7754098b30 0x7f775411f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f775259c700 1 -- 172.21.15.72:0/623814489 learned_addr learned my addr 172.21.15.72:0/623814489 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:55.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f31aa7fc700 1 -- 172.21.15.72:0/3732268234 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f31ac03d270 con 0x7f31bc059070 2023-10-03T10:09:55.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f7751d9b700 1 -- 172.21.15.72:0/623814489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f775411f8e0 msgr2=0x7f775413e680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:09:55.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f7751d9b700 1 --2- 172.21.15.72:0/623814489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f775411f8e0 0x7f775413e680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:55.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f7751d9b700 1 -- 172.21.15.72:0/623814489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7754065640 msgr2=0x7f775411ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f7751d9b700 1 --2- 172.21.15.72:0/623814489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7754065640 0x7f775411ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f7751d9b700 1 -- 172.21.15.72:0/623814489 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774c009ae0 con 0x7f7754098b30 2023-10-03T10:09:55.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f7751d9b700 1 --2- 172.21.15.72:0/623814489 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7754098b30 0x7f775411f3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7754065610 tx=0x7f77540649a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f31aa7fc700 1 -- 172.21.15.72:0/3732268234 --> v1:172.21.15.72:6812/118763 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f319c038560 con 0x7f319c034870 2023-10-03T10:09:55.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f31aa7fc700 1 -- 172.21.15.72:0/3732268234 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31ac03d5a0 con 0x7f31bc059070 2023-10-03T10:09:55.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f77427fc700 1 -- 172.21.15.72:0/623814489 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c007000 con 0x7f7754098b30 2023-10-03T10:09:55.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f77427fc700 1 -- 172.21.15.72:0/623814489 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c0092e0 con 0x7f7754098b30 2023-10-03T10:09:55.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.128+0000 7f77427fc700 1 -- 172.21.15.72:0/623814489 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c013e20 con 0x7f7754098b30 2023-10-03T10:09:55.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.129+0000 7f775889d700 1 -- 172.21.15.72:0/623814489 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7754094c20 con 0x7f7754098b30 2023-10-03T10:09:55.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.129+0000 7f775889d700 1 -- 172.21.15.72:0/623814489 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7754122ac0 con 0x7f7754098b30 2023-10-03T10:09:55.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.130+0000 7f77427fc700 1 -- 172.21.15.72:0/623814489 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f774c003040 con 0x7f7754098b30 2023-10-03T10:09:55.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.130+0000 7f77427fc700 1 -- 172.21.15.72:0/623814489 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f774c03c2c0 con 0x7f7754098b30 2023-10-03T10:09:55.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.130+0000 7f775889d700 1 -- 172.21.15.72:0/623814489 --> v1:172.21.15.72:6800/118746 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f775405f0a0 con 0x7f775413eb70 2023-10-03T10:09:55.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.130+0000 7f31aa7fc700 1 -- 172.21.15.72:0/3732268234 <== osd.3 v1:172.21.15.72:6812/118763 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f319c038560 con 0x7f319c034870 2023-10-03T10:09:55.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.132+0000 7f77427fc700 1 -- 172.21.15.72:0/623814489 <== osd.2 v1:172.21.15.72:6800/118746 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f775405f0a0 con 0x7f775413eb70 2023-10-03T10:09:55.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.136+0000 7f44af272700 1 -- 172.21.15.72:0/3266639324 --> v1:172.21.15.72:6804/118756 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4488002b10 con 0x7f448c034770 2023-10-03T10:09:55.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.137+0000 7f449d7fa700 1 -- 172.21.15.72:0/3266639324 <== osd.1 v1:172.21.15.72:6804/118756 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f4488002b10 con 0x7f448c034770 2023-10-03T10:09:55.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.137+0000 7fde28209700 1 -- 172.21.15.72:0/1728525653 --> v1:172.21.15.72:6805/118755 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fde201170a0 con 0x7fde201268a0 2023-10-03T10:09:55.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.137+0000 7f44af272700 1 -- 172.21.15.72:0/3266639324 >> v1:172.21.15.72:6804/118756 conn(0x7f448c034770 legacy=0x7f448c036bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.137+0000 7f44af272700 1 -- 172.21.15.72:0/3266639324 >> v1:172.21.15.72:6816/118184 conn(0x7f448c02bb60 legacy=0x7f448c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.137+0000 7f44af272700 1 -- 172.21.15.72:0/3266639324 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44a8059070 msgr2=0x7f44a8118ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.137+0000 7f44af272700 1 --2- 172.21.15.72:0/3266639324 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44a8059070 0x7f44a8118ab0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f44a8097340 tx=0x7f44a4017000).stop 2023-10-03T10:09:55.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.137+0000 7f44ad80f700 1 -- 172.21.15.72:0/3266639324 reap_dead start 2023-10-03T10:09:55.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.137+0000 7fde15ffb700 1 -- 172.21.15.72:0/1728525653 <== osd.0 v1:172.21.15.72:6805/118755 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7fde10009460 con 0x7fde201268a0 2023-10-03T10:09:55.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.137+0000 7f44af272700 1 -- 172.21.15.72:0/3266639324 shutdown_connections 2023-10-03T10:09:55.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.137+0000 7f44af272700 1 -- 172.21.15.72:0/3266639324 >> 172.21.15.72:0/3266639324 conn(0x7f44a8097470 msgr2=0x7f44a8094110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.138+0000 7f44af272700 1 -- 172.21.15.72:0/3266639324 shutdown_connections 2023-10-03T10:09:55.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.138+0000 7f44af272700 1 -- 172.21.15.72:0/3266639324 wait complete. 2023-10-03T10:09:55.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.140+0000 7fde28209700 1 -- 172.21.15.72:0/1728525653 >> v1:172.21.15.72:6805/118755 conn(0x7fde201268a0 legacy=0x7fde2005e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.140+0000 7fde28209700 1 -- 172.21.15.72:0/1728525653 >> v1:172.21.15.72:6816/118184 conn(0x7fde0402bb60 legacy=0x7fde0402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.140+0000 7fde28209700 1 -- 172.21.15.72:0/1728525653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2012a9c0 msgr2=0x7fde20114320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.140+0000 7fde28209700 1 --2- 172.21.15.72:0/1728525653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2012a9c0 0x7fde20114320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fde1800c790 tx=0x7fde180015e0).stop 2023-10-03T10:09:55.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.140+0000 7fde267a6700 1 -- 172.21.15.72:0/1728525653 reap_dead start 2023-10-03T10:09:55.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.140+0000 7fde28209700 1 -- 172.21.15.72:0/1728525653 shutdown_connections 2023-10-03T10:09:55.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.140+0000 7fde28209700 1 -- 172.21.15.72:0/1728525653 >> 172.21.15.72:0/1728525653 conn(0x7fde200974f0 msgr2=0x7fde20125920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.140+0000 7fde28209700 1 -- 172.21.15.72:0/1728525653 shutdown_connections 2023-10-03T10:09:55.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.140+0000 7fde28209700 1 -- 172.21.15.72:0/1728525653 wait complete. 2023-10-03T10:09:55.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.145+0000 7f31c0c27700 1 -- 172.21.15.72:0/3732268234 --> v1:172.21.15.72:6812/118763 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f31bc05a260 con 0x7f319c034870 2023-10-03T10:09:55.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.146+0000 7f31aa7fc700 1 -- 172.21.15.72:0/3732268234 <== osd.3 v1:172.21.15.72:6812/118763 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f31bc05a260 con 0x7f319c034870 2023-10-03T10:09:55.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.146+0000 7f31c0c27700 1 -- 172.21.15.72:0/3732268234 >> v1:172.21.15.72:6812/118763 conn(0x7f319c034870 legacy=0x7f319c036cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.146+0000 7f31c0c27700 1 -- 172.21.15.72:0/3732268234 >> v1:172.21.15.72:6816/118184 conn(0x7f319c02bb60 legacy=0x7f319c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.146+0000 7f31c0c27700 1 -- 172.21.15.72:0/3732268234 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31bc059070 msgr2=0x7f31bc068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.146+0000 7f31c0c27700 1 --2- 172.21.15.72:0/3732268234 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31bc059070 0x7f31bc068a90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f31ac009ea0 tx=0x7f31ac017000).stop 2023-10-03T10:09:55.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.146+0000 7f31bad9d700 1 -- 172.21.15.72:0/3732268234 reap_dead start 2023-10-03T10:09:55.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.149+0000 7f31c0c27700 1 -- 172.21.15.72:0/3732268234 shutdown_connections 2023-10-03T10:09:55.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.149+0000 7f31c0c27700 1 -- 172.21.15.72:0/3732268234 >> 172.21.15.72:0/3732268234 conn(0x7f31bc0974f0 msgr2=0x7f31bc123220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.149+0000 7f31c0c27700 1 -- 172.21.15.72:0/3732268234 shutdown_connections 2023-10-03T10:09:55.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.149+0000 7f31c0c27700 1 -- 172.21.15.72:0/3732268234 wait complete. 2023-10-03T10:09:55.162 INFO:teuthology.orchestra.run.smithi072.stdout:38654705669 2023-10-03T10:09:55.163 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:09:55.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.151+0000 7f775889d700 1 -- 172.21.15.72:0/623814489 --> v1:172.21.15.72:6800/118746 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f77541222e0 con 0x7f775413eb70 2023-10-03T10:09:55.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.151+0000 7f77427fc700 1 -- 172.21.15.72:0/623814489 <== osd.2 v1:172.21.15.72:6800/118746 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f7744009480 con 0x7f775413eb70 2023-10-03T10:09:55.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.152+0000 7f775889d700 1 -- 172.21.15.72:0/623814489 >> v1:172.21.15.72:6800/118746 conn(0x7f775413eb70 legacy=0x7f775413ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.152+0000 7f775889d700 1 -- 172.21.15.72:0/623814489 >> v1:172.21.15.72:6816/118184 conn(0x7f773402bb60 legacy=0x7f773402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.152+0000 7f775889d700 1 -- 172.21.15.72:0/623814489 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7754098b30 msgr2=0x7f775411f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.152+0000 7f775889d700 1 --2- 172.21.15.72:0/623814489 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7754098b30 0x7f775411f3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7754065610 tx=0x7f77540649a0).stop 2023-10-03T10:09:55.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.152+0000 7f7752d9d700 1 -- 172.21.15.72:0/623814489 reap_dead start 2023-10-03T10:09:55.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.152+0000 7f775889d700 1 -- 172.21.15.72:0/623814489 shutdown_connections 2023-10-03T10:09:55.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.152+0000 7f775889d700 1 -- 172.21.15.72:0/623814489 >> 172.21.15.72:0/623814489 conn(0x7f775409a900 msgr2=0x7f7754093d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.152+0000 7f775889d700 1 -- 172.21.15.72:0/623814489 shutdown_connections 2023-10-03T10:09:55.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.152+0000 7f775889d700 1 -- 172.21.15.72:0/623814489 wait complete. 2023-10-03T10:09:55.166 INFO:teuthology.orchestra.run.smithi072.stdout:38654705669 2023-10-03T10:09:55.166 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:09:55.167 INFO:teuthology.orchestra.run.smithi072.stdout:38654705669 2023-10-03T10:09:55.167 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:09:55.168 INFO:teuthology.orchestra.run.smithi072.stdout:38654705669 2023-10-03T10:09:55.168 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:09:55.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.300+0000 7fba68dfd700 1 Processor -- start 2023-10-03T10:09:55.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.300+0000 7fba68dfd700 1 -- start start 2023-10-03T10:09:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.301+0000 7fba68dfd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba64096380 0x7fba64094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.301+0000 7fba68dfd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba64091b00 0x7fba64127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.301+0000 7fba68dfd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba64096760 con 0x7fba64094c20 2023-10-03T10:09:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.301+0000 7fba68dfd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba64091ff0 con 0x7fba64096380 2023-10-03T10:09:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.301+0000 7fba68dfd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba64092c80 con 0x7fba64091b00 2023-10-03T10:09:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.301+0000 7fba6259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba64096380 0x7fba64094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.301+0000 7fba6259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba64096380 0x7fba64094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33306/0 (socket says 172.21.15.72:33306) 2023-10-03T10:09:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.301+0000 7fba62d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fba64094c20 0x7fba64127af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41050/0 (socket says 172.21.15.72:41050) 2023-10-03T10:09:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.301+0000 7fba6259c700 1 -- 172.21.15.72:0/2870736463 learned_addr learned my addr 172.21.15.72:0/2870736463 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.301+0000 7fba61d9b700 1 --2- 172.21.15.72:0/2870736463 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba64091b00 0x7fba64127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.301+0000 7fba61d9b700 1 -- 172.21.15.72:0/2870736463 >> v2:172.21.15.72:3300/0 conn(0x7fba64096380 msgr2=0x7fba64094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.301+0000 7fba61d9b700 1 --2- 172.21.15.72:0/2870736463 >> v2:172.21.15.72:3300/0 conn(0x7fba64096380 0x7fba64094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.301+0000 7fba6159a700 1 -- 172.21.15.72:0/2870736463 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912136519 0 0) 0x7fba64096760 con 0x7fba64094c20 2023-10-03T10:09:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.301+0000 7fba61d9b700 1 -- 172.21.15.72:0/2870736463 >> v1:172.21.15.72:6789/0 conn(0x7fba64094c20 legacy=0x7fba64127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.302+0000 7fba61d9b700 1 -- 172.21.15.72:0/2870736463 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba64093900 con 0x7fba64091b00 2023-10-03T10:09:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.302+0000 7fba61d9b700 1 --2- 172.21.15.72:0/2870736463 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba64091b00 0x7fba64127600 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fba58009790 tx=0x7fba58009060).ready entity=mon.1 client_cookie=d89d0afd7a085475 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.302+0000 7fba6159a700 1 -- 172.21.15.72:0/2870736463 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5800f510 con 0x7fba64091b00 2023-10-03T10:09:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.302+0000 7fba6159a700 1 -- 172.21.15.72:0/2870736463 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5800f670 con 0x7fba64091b00 2023-10-03T10:09:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.302+0000 7fba6159a700 1 -- 172.21.15.72:0/2870736463 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5800f9f0 con 0x7fba64091b00 2023-10-03T10:09:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.302+0000 7fba68dfd700 1 -- 172.21.15.72:0/2870736463 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba64091b00 msgr2=0x7fba64127600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.303+0000 7fba68dfd700 1 --2- 172.21.15.72:0/2870736463 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba64091b00 0x7fba64127600 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fba58009790 tx=0x7fba58009060).stop 2023-10-03T10:09:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.303+0000 7fba68dfd700 1 -- 172.21.15.72:0/2870736463 shutdown_connections 2023-10-03T10:09:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.303+0000 7fba68dfd700 1 --2- 172.21.15.72:0/2870736463 >> v2:172.21.15.72:3300/0 conn(0x7fba64096380 0x7fba64094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.303+0000 7fba68dfd700 1 --2- 172.21.15.72:0/2870736463 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba64091b00 0x7fba64127600 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.303+0000 7fba68dfd700 1 -- 172.21.15.72:0/2870736463 >> 172.21.15.72:0/2870736463 conn(0x7fba64097470 msgr2=0x7fba64097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.303+0000 7fba68dfd700 1 -- 172.21.15.72:0/2870736463 shutdown_connections 2023-10-03T10:09:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.303+0000 7fba68dfd700 1 -- 172.21.15.72:0/2870736463 wait complete. 2023-10-03T10:09:55.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.304+0000 7fba68dfd700 1 Processor -- start 2023-10-03T10:09:55.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.304+0000 7fba68dfd700 1 -- start start 2023-10-03T10:09:55.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba68dfd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba64091b00 0x7fba64112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba68dfd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba64094c20 0x7fba64112f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba68dfd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba64096380 0x7fba64113420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba68dfd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba64124a80 con 0x7fba64096380 2023-10-03T10:09:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba68dfd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba64114fd0 con 0x7fba64094c20 2023-10-03T10:09:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba68dfd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba6406a520 con 0x7fba64091b00 2023-10-03T10:09:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba61d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba64094c20 0x7fba64112f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba61d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba64094c20 0x7fba64112f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48092/0 (socket says 172.21.15.72:48092) 2023-10-03T10:09:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba61d9b700 1 -- 172.21.15.72:0/3617050063 learned_addr learned my addr 172.21.15.72:0/3617050063 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba62d9d700 1 --2- 172.21.15.72:0/3617050063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba64096380 0x7fba64113420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba61d9b700 1 -- 172.21.15.72:0/3617050063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba64091b00 msgr2=0x7fba64112a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba61d9b700 1 --2- 172.21.15.72:0/3617050063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba64091b00 0x7fba64112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:55.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba61d9b700 1 -- 172.21.15.72:0/3617050063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba64096380 msgr2=0x7fba64113420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba61d9b700 1 --2- 172.21.15.72:0/3617050063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba64096380 0x7fba64113420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba61d9b700 1 -- 172.21.15.72:0/3617050063 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba580092a0 con 0x7fba64094c20 2023-10-03T10:09:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba61d9b700 1 --2- 172.21.15.72:0/3617050063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba64094c20 0x7fba64112f30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fba64092dc0 tx=0x7fba58017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.305+0000 7fba527fc700 1 -- 172.21.15.72:0/3617050063 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5800f7e0 con 0x7fba64094c20 2023-10-03T10:09:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.306+0000 7fba527fc700 1 -- 172.21.15.72:0/3617050063 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5800f960 con 0x7fba64094c20 2023-10-03T10:09:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.306+0000 7fba68dfd700 1 -- 172.21.15.72:0/3617050063 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba64115ea0 con 0x7fba64094c20 2023-10-03T10:09:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.306+0000 7fba527fc700 1 -- 172.21.15.72:0/3617050063 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5801b660 con 0x7fba64094c20 2023-10-03T10:09:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.306+0000 7fba527fc700 1 -- 172.21.15.72:0/3617050063 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fba5801ba50 con 0x7fba64094c20 2023-10-03T10:09:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.306+0000 7fba68dfd700 1 -- 172.21.15.72:0/3617050063 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba64116b20 con 0x7fba64094c20 2023-10-03T10:09:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.306+0000 7fba527fc700 1 -- 172.21.15.72:0/3617050063 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fba5803f1c0 con 0x7fba64094c20 2023-10-03T10:09:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.307+0000 7fba68dfd700 1 -- 172.21.15.72:0/3617050063 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6405a260 con 0x7fba64094c20 2023-10-03T10:09:55.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.316+0000 7fba527fc700 1 -- 172.21.15.72:0/3617050063 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fba5801f070 con 0x7fba64094c20 2023-10-03T10:09:55.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.332+0000 7fe35c913700 1 Processor -- start 2023-10-03T10:09:55.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7f768da50700 1 Processor -- start 2023-10-03T10:09:55.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7f768da50700 1 -- start start 2023-10-03T10:09:55.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7fe35c913700 1 -- start start 2023-10-03T10:09:55.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7f768da50700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76880613a0 0x7f768812ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7f768da50700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f768812b2f0 0x7f768812b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7f768da50700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768812abd0 con 0x7f7688095df0 2023-10-03T10:09:55.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7f768da50700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7688061780 con 0x7f768812b2f0 2023-10-03T10:09:55.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7f768da50700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7688067530 con 0x7f76880613a0 2023-10-03T10:09:55.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7fe35c913700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe358123a90 0x7fe358123e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7fe35c913700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe358092340 0x7fe358127680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7fe35c913700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe358068880 con 0x7fe358067ce0 2023-10-03T10:09:55.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7fe35c913700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3580680c0 con 0x7fe358092340 2023-10-03T10:09:55.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7fe35c913700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe358068c90 con 0x7fe358123a90 2023-10-03T10:09:55.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7f76867fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f768812b2f0 0x7f768812b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7f76867fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f768812b2f0 0x7f768812b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48102/0 (socket says 172.21.15.72:48102) 2023-10-03T10:09:55.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.333+0000 7f76867fc700 1 -- 172.21.15.72:0/537695305 learned_addr learned my addr 172.21.15.72:0/537695305 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:55.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.334+0000 7fe355d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe358067ce0 0x7fe358126f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41062/0 (socket says 172.21.15.72:41062) 2023-10-03T10:09:55.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.334+0000 7fe355d9b700 1 -- 172.21.15.72:0/2465422995 learned_addr learned my addr 172.21.15.72:0/2465422995 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:55.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.334+0000 7fe35659c700 1 --2- 172.21.15.72:0/2465422995 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe358123a90 0x7fe358123e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.334+0000 7f7686ffd700 1 --2- 172.21.15.72:0/537695305 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76880613a0 0x7f768812ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.334+0000 7f76867fc700 1 -- 172.21.15.72:0/537695305 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76880613a0 msgr2=0x7f768812ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:55.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.334+0000 7f76867fc700 1 --2- 172.21.15.72:0/537695305 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76880613a0 0x7f768812ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.334+0000 7f76867fc700 1 -- 172.21.15.72:0/537695305 >> v1:172.21.15.72:6789/0 conn(0x7f7688095df0 legacy=0x7f7688096250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.334+0000 7f76867fc700 1 -- 172.21.15.72:0/537695305 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76880683c0 con 0x7f768812b2f0 2023-10-03T10:09:55.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.334+0000 7fe35659c700 1 -- 172.21.15.72:0/2465422995 >> v2:172.21.15.72:3300/0 conn(0x7fe358092340 msgr2=0x7fe358127680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:55.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.334+0000 7fe35659c700 1 --2- 172.21.15.72:0/2465422995 >> v2:172.21.15.72:3300/0 conn(0x7fe358092340 0x7fe358127680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:55.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.334+0000 7fe35659c700 1 -- 172.21.15.72:0/2465422995 >> v1:172.21.15.72:6789/0 conn(0x7fe358067ce0 legacy=0x7fe358126f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.334+0000 7fe35659c700 1 -- 172.21.15.72:0/2465422995 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe358124430 con 0x7fe358123a90 2023-10-03T10:09:55.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.334+0000 7f76867fc700 1 --2- 172.21.15.72:0/537695305 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f768812b2f0 0x7f768812b6d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f767c009830 tx=0x7f767c0090f0).ready entity=mon.1 client_cookie=9212bdc45088c9ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.334+0000 7fe35659c700 1 --2- 172.21.15.72:0/2465422995 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe358123a90 0x7fe358123e70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe348009790 tx=0x7fe348009060).ready entity=mon.2 client_cookie=8c083c1ab1254a57 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.334+0000 7fe35559a700 1 -- 172.21.15.72:0/2465422995 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34800b580 con 0x7fe358123a90 2023-10-03T10:09:55.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7fe35559a700 1 -- 172.21.15.72:0/2465422995 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34800b6e0 con 0x7fe358123a90 2023-10-03T10:09:55.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7fe35559a700 1 -- 172.21.15.72:0/2465422995 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34800ba60 con 0x7fe358123a90 2023-10-03T10:09:55.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7f7685ffb700 1 -- 172.21.15.72:0/537695305 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c00b640 con 0x7f768812b2f0 2023-10-03T10:09:55.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7f7685ffb700 1 -- 172.21.15.72:0/537695305 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c00b7a0 con 0x7f768812b2f0 2023-10-03T10:09:55.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7f7685ffb700 1 -- 172.21.15.72:0/537695305 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c00bb20 con 0x7f768812b2f0 2023-10-03T10:09:55.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7fe35c913700 1 -- 172.21.15.72:0/2465422995 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe358123a90 msgr2=0x7fe358123e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7fe35c913700 1 --2- 172.21.15.72:0/2465422995 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe358123a90 0x7fe358123e70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe348009790 tx=0x7fe348009060).stop 2023-10-03T10:09:55.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7f768da50700 1 -- 172.21.15.72:0/537695305 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f768812b2f0 msgr2=0x7f768812b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7f768da50700 1 --2- 172.21.15.72:0/537695305 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f768812b2f0 0x7f768812b6d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f767c009830 tx=0x7f767c0090f0).stop 2023-10-03T10:09:55.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7f768da50700 1 -- 172.21.15.72:0/537695305 shutdown_connections 2023-10-03T10:09:55.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7f768da50700 1 --2- 172.21.15.72:0/537695305 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76880613a0 0x7f768812ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7f768da50700 1 --2- 172.21.15.72:0/537695305 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f768812b2f0 0x7f768812b6d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7f768da50700 1 -- 172.21.15.72:0/537695305 >> 172.21.15.72:0/537695305 conn(0x7f768809a220 msgr2=0x7f768809a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7f768da50700 1 -- 172.21.15.72:0/537695305 shutdown_connections 2023-10-03T10:09:55.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7fe35c913700 1 -- 172.21.15.72:0/2465422995 shutdown_connections 2023-10-03T10:09:55.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7fe35c913700 1 --2- 172.21.15.72:0/2465422995 >> v2:172.21.15.72:3300/0 conn(0x7fe358092340 0x7fe358127680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:55.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7fe35c913700 1 --2- 172.21.15.72:0/2465422995 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe358123a90 0x7fe358123e70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7fe35c913700 1 -- 172.21.15.72:0/2465422995 >> 172.21.15.72:0/2465422995 conn(0x7fe35809a220 msgr2=0x7fe35809a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.335+0000 7f768da50700 1 -- 172.21.15.72:0/537695305 wait complete. 2023-10-03T10:09:55.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.336+0000 7f768da50700 1 Processor -- start 2023-10-03T10:09:55.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.336+0000 7f768da50700 1 -- start start 2023-10-03T10:09:55.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f768da50700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76880613a0 0x7f768811eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f768da50700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7688095df0 0x7f768811afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f768da50700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f768812b2f0 0x7f768811b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f768da50700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768811cb50 con 0x7f768812b2f0 2023-10-03T10:09:55.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f768da50700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7688098dc0 con 0x7f76880613a0 2023-10-03T10:09:55.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f768da50700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7688067130 con 0x7f7688095df0 2023-10-03T10:09:55.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f76877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f768812b2f0 0x7f768811b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f76877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f768812b2f0 0x7f768811b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33318/0 (socket says 172.21.15.72:33318) 2023-10-03T10:09:55.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f7686ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76880613a0 0x7f768811eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f76877fe700 1 -- 172.21.15.72:0/3481561564 learned_addr learned my addr 172.21.15.72:0/3481561564 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:55.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7fe35c913700 1 -- 172.21.15.72:0/2465422995 shutdown_connections 2023-10-03T10:09:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f76867fc700 1 --2- 172.21.15.72:0/3481561564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7688095df0 0x7f768811afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f7686ffd700 1 -- 172.21.15.72:0/3481561564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7688095df0 msgr2=0x7f768811afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f7686ffd700 1 --2- 172.21.15.72:0/3481561564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7688095df0 0x7f768811afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f7686ffd700 1 -- 172.21.15.72:0/3481561564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f768812b2f0 msgr2=0x7f768811b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f7686ffd700 1 --2- 172.21.15.72:0/3481561564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f768812b2f0 0x7f768811b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7f7686ffd700 1 -- 172.21.15.72:0/3481561564 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c009370 con 0x7f76880613a0 2023-10-03T10:09:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.338+0000 7f7686ffd700 1 --2- 172.21.15.72:0/3481561564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76880613a0 0x7f768811eec0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f767800d890 tx=0x7f7678008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.338+0000 7f766effd700 1 -- 172.21.15.72:0/3481561564 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7678011590 con 0x7f76880613a0 2023-10-03T10:09:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.338+0000 7f766effd700 1 -- 172.21.15.72:0/3481561564 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76780116f0 con 0x7f76880613a0 2023-10-03T10:09:55.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.338+0000 7f768da50700 1 -- 172.21.15.72:0/3481561564 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768811d230 con 0x7f76880613a0 2023-10-03T10:09:55.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.338+0000 7f766effd700 1 -- 172.21.15.72:0/3481561564 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7678011a70 con 0x7f76880613a0 2023-10-03T10:09:55.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.338+0000 7f768da50700 1 -- 172.21.15.72:0/3481561564 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768811e1c0 con 0x7f76880613a0 2023-10-03T10:09:55.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.337+0000 7fe35c913700 1 -- 172.21.15.72:0/2465422995 wait complete. 2023-10-03T10:09:55.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.338+0000 7fe35c913700 1 Processor -- start 2023-10-03T10:09:55.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.338+0000 7f766effd700 1 -- 172.21.15.72:0/3481561564 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7678012420 con 0x7f76880613a0 2023-10-03T10:09:55.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.338+0000 7fe35c913700 1 -- start start 2023-10-03T10:09:55.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7fe35c913700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe358067ce0 0x7fe358131f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7fe35c913700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe358092340 0x7fe358132440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7fe35c913700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe358123a90 0x7fe358132930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7fe35c913700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe358127650 con 0x7fe358123a90 2023-10-03T10:09:55.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7fe35c913700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580697c0 con 0x7fe358067ce0 2023-10-03T10:09:55.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7fe35c913700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe358111260 con 0x7fe358092340 2023-10-03T10:09:55.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7f766effd700 1 -- 172.21.15.72:0/3481561564 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f767803f170 con 0x7f76880613a0 2023-10-03T10:09:55.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7fe356d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe358123a90 0x7fe358132930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7fe356d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe358123a90 0x7fe358132930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33328/0 (socket says 172.21.15.72:33328) 2023-10-03T10:09:55.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7fe356d9d700 1 -- 172.21.15.72:0/2517624465 learned_addr learned my addr 172.21.15.72:0/2517624465 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:55.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7f768da50700 1 -- 172.21.15.72:0/3481561564 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f768805a260 con 0x7f76880613a0 2023-10-03T10:09:55.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7fe355d9b700 1 --2- 172.21.15.72:0/2517624465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe358092340 0x7fe358132440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7fe356d9d700 1 -- 172.21.15.72:0/2517624465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe358092340 msgr2=0x7fe358132440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7fe356d9d700 1 --2- 172.21.15.72:0/2517624465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe358092340 0x7fe358132440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7fe356d9d700 1 -- 172.21.15.72:0/2517624465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe358067ce0 msgr2=0x7fe358131f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7fe356d9d700 1 --2- 172.21.15.72:0/2517624465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe358067ce0 0x7fe358131f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.339+0000 7fe356d9d700 1 -- 172.21.15.72:0/2517624465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3480092a0 con 0x7fe358123a90 2023-10-03T10:09:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.340+0000 7fe356d9d700 1 --2- 172.21.15.72:0/2517624465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe358123a90 0x7fe358132930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe35000bc30 tx=0x7fe350009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.340+0000 7fe3467fc700 1 -- 172.21.15.72:0/2517624465 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35000c6f0 con 0x7fe358123a90 2023-10-03T10:09:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.340+0000 7fe3467fc700 1 -- 172.21.15.72:0/2517624465 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe350010070 con 0x7fe358123a90 2023-10-03T10:09:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.340+0000 7fe3467fc700 1 -- 172.21.15.72:0/2517624465 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35000c8b0 con 0x7fe358123a90 2023-10-03T10:09:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.341+0000 7fe35c913700 1 -- 172.21.15.72:0/2517624465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe358112f10 con 0x7fe358123a90 2023-10-03T10:09:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.341+0000 7fe35c913700 1 -- 172.21.15.72:0/2517624465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe358110ae0 con 0x7fe358123a90 2023-10-03T10:09:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.342+0000 7fe3467fc700 1 -- 172.21.15.72:0/2517624465 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe35000cc60 con 0x7fe358123a90 2023-10-03T10:09:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.342+0000 7fe35c913700 1 -- 172.21.15.72:0/2517624465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe358132e20 con 0x7fe358123a90 2023-10-03T10:09:55.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.342+0000 7fe3467fc700 1 -- 172.21.15.72:0/2517624465 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe35003a890 con 0x7fe358123a90 2023-10-03T10:09:55.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.344+0000 7f766effd700 1 -- 172.21.15.72:0/3481561564 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7678040060 con 0x7f76880613a0 2023-10-03T10:09:55.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.347+0000 7fe3467fc700 1 -- 172.21.15.72:0/2517624465 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe350012290 con 0x7fe358123a90 2023-10-03T10:09:55.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.358+0000 7f0a6fbc9700 1 Processor -- start 2023-10-03T10:09:55.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.358+0000 7f0a6fbc9700 1 -- start start 2023-10-03T10:09:55.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.358+0000 7f0a6fbc9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a680965e0 0x7f0a680969c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.358+0000 7f0a6fbc9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a68096eb0 0x7f0a68067de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6fbc9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a680933b0 con 0x7f0a680682d0 2023-10-03T10:09:55.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6fbc9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a68092190 con 0x7f0a680965e0 2023-10-03T10:09:55.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6fbc9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a68069a20 con 0x7f0a68096eb0 2023-10-03T10:09:55.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6d164700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a68096eb0 0x7f0a68067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6d164700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a68096eb0 0x7f0a68067de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59422/0 (socket says 172.21.15.72:59422) 2023-10-03T10:09:55.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6d164700 1 -- 172.21.15.72:0/2901953086 learned_addr learned my addr 172.21.15.72:0/2901953086 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:55.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6d965700 1 --2- 172.21.15.72:0/2901953086 >> v2:172.21.15.72:3300/0 conn(0x7f0a680965e0 0x7f0a680969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6d164700 1 -- 172.21.15.72:0/2901953086 >> v2:172.21.15.72:3300/0 conn(0x7f0a680965e0 msgr2=0x7f0a680969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:55.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6d164700 1 --2- 172.21.15.72:0/2901953086 >> v2:172.21.15.72:3300/0 conn(0x7f0a680965e0 0x7f0a680969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6d164700 1 -- 172.21.15.72:0/2901953086 >> v1:172.21.15.72:6789/0 conn(0x7f0a680682d0 legacy=0x7f0a6812ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6d164700 1 -- 172.21.15.72:0/2901953086 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a68069ca0 con 0x7f0a68096eb0 2023-10-03T10:09:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6d164700 1 --2- 172.21.15.72:0/2901953086 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a68096eb0 0x7f0a68067de0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0a58006fd0 tx=0x7f0a580090f0).ready entity=mon.2 client_cookie=2d7a75ee4fbfd464 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6d965700 1 --2- 172.21.15.72:0/2901953086 >> v2:172.21.15.72:3300/0 conn(0x7f0a680965e0 0x7f0a680969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:09:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6c963700 1 -- 172.21.15.72:0/2901953086 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800b600 con 0x7f0a68096eb0 2023-10-03T10:09:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6c963700 1 -- 172.21.15.72:0/2901953086 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5800b760 con 0x7f0a68096eb0 2023-10-03T10:09:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.359+0000 7f0a6c963700 1 -- 172.21.15.72:0/2901953086 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800bae0 con 0x7f0a68096eb0 2023-10-03T10:09:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.360+0000 7f0a6fbc9700 1 -- 172.21.15.72:0/2901953086 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a68096eb0 msgr2=0x7f0a68067de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.360+0000 7f0a6fbc9700 1 --2- 172.21.15.72:0/2901953086 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a68096eb0 0x7f0a68067de0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0a58006fd0 tx=0x7f0a580090f0).stop 2023-10-03T10:09:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.360+0000 7f0a6fbc9700 1 -- 172.21.15.72:0/2901953086 shutdown_connections 2023-10-03T10:09:55.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.360+0000 7f0a6fbc9700 1 --2- 172.21.15.72:0/2901953086 >> v2:172.21.15.72:3300/0 conn(0x7f0a680965e0 0x7f0a680969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.360+0000 7f0a6fbc9700 1 --2- 172.21.15.72:0/2901953086 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a68096eb0 0x7f0a68067de0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.360+0000 7f0a6fbc9700 1 -- 172.21.15.72:0/2901953086 >> 172.21.15.72:0/2901953086 conn(0x7f0a6809a220 msgr2=0x7f0a6809a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.360+0000 7f0a6fbc9700 1 -- 172.21.15.72:0/2901953086 shutdown_connections 2023-10-03T10:09:55.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.360+0000 7f0a6fbc9700 1 -- 172.21.15.72:0/2901953086 wait complete. 2023-10-03T10:09:55.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.361+0000 7f0a6fbc9700 1 Processor -- start 2023-10-03T10:09:55.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.361+0000 7f0a6fbc9700 1 -- start start 2023-10-03T10:09:55.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.362+0000 7f0a6fbc9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a680682d0 0x7f0a6813a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.362+0000 7f0a6fbc9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a680965e0 0x7f0a6813ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.362+0000 7f0a6fbc9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a68096eb0 0x7f0a68119f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.362+0000 7f0a6fbc9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6811b3f0 con 0x7f0a680965e0 2023-10-03T10:09:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.362+0000 7f0a6fbc9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6811dc70 con 0x7f0a680682d0 2023-10-03T10:09:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.362+0000 7f0a6fbc9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a68131480 con 0x7f0a68096eb0 2023-10-03T10:09:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.362+0000 7f0a6d164700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a680965e0 0x7f0a6813ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.362+0000 7f0a6d164700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a680965e0 0x7f0a6813ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33354/0 (socket says 172.21.15.72:33354) 2023-10-03T10:09:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.362+0000 7f0a6d164700 1 -- 172.21.15.72:0/3288518382 learned_addr learned my addr 172.21.15.72:0/3288518382 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.362+0000 7f0a6d965700 1 --2- 172.21.15.72:0/3288518382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a680682d0 0x7f0a6813a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.363+0000 7f0a6d164700 1 -- 172.21.15.72:0/3288518382 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a68096eb0 msgr2=0x7f0a68119f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.363+0000 7f0a6e166700 1 --2- 172.21.15.72:0/3288518382 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a68096eb0 0x7f0a68119f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.363+0000 7f0a6d164700 1 --2- 172.21.15.72:0/3288518382 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a68096eb0 0x7f0a68119f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.363+0000 7f0a6d164700 1 -- 172.21.15.72:0/3288518382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a680682d0 msgr2=0x7f0a6813a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.363+0000 7f0a6d164700 1 --2- 172.21.15.72:0/3288518382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a680682d0 0x7f0a6813a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.363+0000 7f0a6d164700 1 -- 172.21.15.72:0/3288518382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a58009370 con 0x7f0a680965e0 2023-10-03T10:09:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.363+0000 7f0a6d965700 1 --2- 172.21.15.72:0/3288518382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a680682d0 0x7f0a6813a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:09:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.363+0000 7f0a6e166700 1 --2- 172.21.15.72:0/3288518382 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a68096eb0 0x7f0a68119f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:09:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.363+0000 7f0a6d164700 1 --2- 172.21.15.72:0/3288518382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a680965e0 0x7f0a6813ac00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f0a68069b60 tx=0x7f0a58017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.363+0000 7f0a5dffb700 1 -- 172.21.15.72:0/3288518382 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800bae0 con 0x7f0a680965e0 2023-10-03T10:09:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.363+0000 7f0a5dffb700 1 -- 172.21.15.72:0/3288518382 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a58000c90 con 0x7f0a680965e0 2023-10-03T10:09:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.363+0000 7f0a6fbc9700 1 -- 172.21.15.72:0/3288518382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a68066790 con 0x7f0a680965e0 2023-10-03T10:09:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.363+0000 7f0a5dffb700 1 -- 172.21.15.72:0/3288518382 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5801d640 con 0x7f0a680965e0 2023-10-03T10:09:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.363+0000 7f0a6fbc9700 1 -- 172.21.15.72:0/3288518382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6811e0f0 con 0x7f0a680965e0 2023-10-03T10:09:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.364+0000 7f0a5dffb700 1 -- 172.21.15.72:0/3288518382 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0a5801d9b0 con 0x7f0a680965e0 2023-10-03T10:09:55.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.365+0000 7f0a5dffb700 1 -- 172.21.15.72:0/3288518382 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f0a5803cfc0 con 0x7f0a680965e0 2023-10-03T10:09:55.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.365+0000 7f0a6fbc9700 1 -- 172.21.15.72:0/3288518382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6805a260 con 0x7f0a680965e0 2023-10-03T10:09:55.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.369+0000 7f0a5dffb700 1 -- 172.21.15.72:0/3288518382 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0a58018350 con 0x7f0a680965e0 2023-10-03T10:09:55.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.503+0000 7fba68dfd700 1 -- 172.21.15.72:0/3617050063 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fba64046c20 con 0x7fba64094c20 2023-10-03T10:09:55.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.503+0000 7fba527fc700 1 -- 172.21.15.72:0/3617050063 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba5801f030 con 0x7fba64094c20 2023-10-03T10:09:55.504 INFO:teuthology.orchestra.run.smithi072.stdout:38654705667 2023-10-03T10:09:55.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.505+0000 7fba68dfd700 1 -- 172.21.15.72:0/3617050063 >> v1:172.21.15.72:6816/118184 conn(0x7fba4402bbe0 legacy=0x7fba4402e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.505+0000 7fba68dfd700 1 -- 172.21.15.72:0/3617050063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba64094c20 msgr2=0x7fba64112f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.505+0000 7fba68dfd700 1 --2- 172.21.15.72:0/3617050063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba64094c20 0x7fba64112f30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fba64092dc0 tx=0x7fba58017000).stop 2023-10-03T10:09:55.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.505+0000 7fba68dfd700 1 -- 172.21.15.72:0/3617050063 shutdown_connections 2023-10-03T10:09:55.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.505+0000 7fba68dfd700 1 --2- 172.21.15.72:0/3617050063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba64096380 0x7fba64113420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.505+0000 7fba68dfd700 1 --2- 172.21.15.72:0/3617050063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba64091b00 0x7fba64112a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:55.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.505+0000 7fba68dfd700 1 --2- 172.21.15.72:0/3617050063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba64094c20 0x7fba64112f30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.505+0000 7fba68dfd700 1 -- 172.21.15.72:0/3617050063 >> 172.21.15.72:0/3617050063 conn(0x7fba64097470 msgr2=0x7fba64126c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.505+0000 7fba68dfd700 1 -- 172.21.15.72:0/3617050063 shutdown_connections 2023-10-03T10:09:55.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.505+0000 7fba68dfd700 1 -- 172.21.15.72:0/3617050063 wait complete. 2023-10-03T10:09:55.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.1 2023-10-03T10:09:55.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.518+0000 7f768da50700 1 -- 172.21.15.72:0/3481561564 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f768811be40 con 0x7f76880613a0 2023-10-03T10:09:55.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.519+0000 7f766effd700 1 -- 172.21.15.72:0/3481561564 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76780108d0 con 0x7f76880613a0 2023-10-03T10:09:55.518 INFO:teuthology.orchestra.run.smithi072.stdout:38654705667 2023-10-03T10:09:55.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.520+0000 7f768da50700 1 -- 172.21.15.72:0/3481561564 >> v1:172.21.15.72:6816/118184 conn(0x7f767402bb60 legacy=0x7f767402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.520+0000 7f768da50700 1 -- 172.21.15.72:0/3481561564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76880613a0 msgr2=0x7f768811eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.520+0000 7f768da50700 1 --2- 172.21.15.72:0/3481561564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76880613a0 0x7f768811eec0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f767800d890 tx=0x7f7678008040).stop 2023-10-03T10:09:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.520+0000 7f768da50700 1 -- 172.21.15.72:0/3481561564 shutdown_connections 2023-10-03T10:09:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.520+0000 7f768da50700 1 --2- 172.21.15.72:0/3481561564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f768812b2f0 0x7f768811b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.520+0000 7f768da50700 1 --2- 172.21.15.72:0/3481561564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76880613a0 0x7f768811eec0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.520+0000 7f768da50700 1 --2- 172.21.15.72:0/3481561564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7688095df0 0x7f768811afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.520+0000 7f768da50700 1 -- 172.21.15.72:0/3481561564 >> 172.21.15.72:0/3481561564 conn(0x7f768809a220 msgr2=0x7f7688128390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.520+0000 7f768da50700 1 -- 172.21.15.72:0/3481561564 shutdown_connections 2023-10-03T10:09:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.520+0000 7f768da50700 1 -- 172.21.15.72:0/3481561564 wait complete. 2023-10-03T10:09:55.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.522+0000 7fe35c913700 1 -- 172.21.15.72:0/2517624465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe35805a260 con 0x7fe358123a90 2023-10-03T10:09:55.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.522+0000 7fe3467fc700 1 -- 172.21.15.72:0/2517624465 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe35001caf0 con 0x7fe358123a90 2023-10-03T10:09:55.522 INFO:teuthology.orchestra.run.smithi072.stdout:38654705667 2023-10-03T10:09:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.524+0000 7fe35c913700 1 -- 172.21.15.72:0/2517624465 >> v1:172.21.15.72:6816/118184 conn(0x7fe33802bb90 legacy=0x7fe33802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.524+0000 7fe35c913700 1 -- 172.21.15.72:0/2517624465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe358123a90 msgr2=0x7fe358132930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.524+0000 7fe35c913700 1 --2- 172.21.15.72:0/2517624465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe358123a90 0x7fe358132930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe35000bc30 tx=0x7fe350009840).stop 2023-10-03T10:09:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.524+0000 7fe35c913700 1 -- 172.21.15.72:0/2517624465 shutdown_connections 2023-10-03T10:09:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.524+0000 7fe35c913700 1 --2- 172.21.15.72:0/2517624465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe358123a90 0x7fe358132930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.524+0000 7fe35c913700 1 --2- 172.21.15.72:0/2517624465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe358067ce0 0x7fe358131f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:55.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.524+0000 7fe35c913700 1 --2- 172.21.15.72:0/2517624465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe358092340 0x7fe358132440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.524+0000 7fe35c913700 1 -- 172.21.15.72:0/2517624465 >> 172.21.15.72:0/2517624465 conn(0x7fe35809a220 msgr2=0x7fe358066b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.525+0000 7fe35c913700 1 -- 172.21.15.72:0/2517624465 shutdown_connections 2023-10-03T10:09:55.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.526+0000 7fe35c913700 1 -- 172.21.15.72:0/2517624465 wait complete. 2023-10-03T10:09:55.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.3 2023-10-03T10:09:55.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.0 2023-10-03T10:09:55.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.540+0000 7f0a6fbc9700 1 -- 172.21.15.72:0/3288518382 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a68069210 con 0x7f0a680965e0 2023-10-03T10:09:55.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.540+0000 7f0a5dffb700 1 -- 172.21.15.72:0/3288518382 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a58025b90 con 0x7f0a680965e0 2023-10-03T10:09:55.540 INFO:teuthology.orchestra.run.smithi072.stdout:38654705667 2023-10-03T10:09:55.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.542+0000 7f0a6fbc9700 1 -- 172.21.15.72:0/3288518382 >> v1:172.21.15.72:6816/118184 conn(0x7f0a4c02bb90 legacy=0x7f0a4c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.542+0000 7f0a6fbc9700 1 -- 172.21.15.72:0/3288518382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a680965e0 msgr2=0x7f0a6813ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:55.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.542+0000 7f0a6fbc9700 1 --2- 172.21.15.72:0/3288518382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a680965e0 0x7f0a6813ac00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f0a68069b60 tx=0x7f0a58017000).stop 2023-10-03T10:09:55.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.542+0000 7f0a6fbc9700 1 -- 172.21.15.72:0/3288518382 shutdown_connections 2023-10-03T10:09:55.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.542+0000 7f0a6fbc9700 1 --2- 172.21.15.72:0/3288518382 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a68096eb0 0x7f0a68119f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.542+0000 7f0a6fbc9700 1 --2- 172.21.15.72:0/3288518382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a680682d0 0x7f0a6813a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.542+0000 7f0a6fbc9700 1 --2- 172.21.15.72:0/3288518382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a680965e0 0x7f0a6813ac00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:55.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.542+0000 7f0a6fbc9700 1 -- 172.21.15.72:0/3288518382 >> 172.21.15.72:0/3288518382 conn(0x7f0a6809a220 msgr2=0x7f0a68099000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:55.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.542+0000 7f0a6fbc9700 1 -- 172.21.15.72:0/3288518382 shutdown_connections 2023-10-03T10:09:55.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:55.542+0000 7f0a6fbc9700 1 -- 172.21.15.72:0/3288518382 wait complete. 2023-10-03T10:09:55.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.2 2023-10-03T10:09:56.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:09:56.534 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:09:56.537 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:09:56.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:09:56.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.664+0000 7f1837841700 1 Processor -- start 2023-10-03T10:09:56.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.664+0000 7f1837841700 1 -- start start 2023-10-03T10:09:56.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.665+0000 7f1837841700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18300613a0 0x7f183012ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.665+0000 7f1837841700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f183012b2f0 0x7f183012b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.665+0000 7f1837841700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1830095df0 0x7f1830096250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.665+0000 7f1837841700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1830061780 con 0x7f1830095df0 2023-10-03T10:09:56.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.665+0000 7f1837841700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183012abd0 con 0x7f18300613a0 2023-10-03T10:09:56.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.665+0000 7f1837841700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1830067530 con 0x7f183012b2f0 2023-10-03T10:09:56.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.665+0000 7f1834ddc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f183012b2f0 0x7f183012b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.665+0000 7f1835dde700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1830095df0 0x7f1830096250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.665+0000 7f1834ddc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f183012b2f0 0x7f183012b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59438/0 (socket says 172.21.15.72:59438) 2023-10-03T10:09:56.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.665+0000 7f1834ddc700 1 -- 172.21.15.72:0/2649512629 learned_addr learned my addr 172.21.15.72:0/2649512629 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:56.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.665+0000 7f18355dd700 1 --2- 172.21.15.72:0/2649512629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18300613a0 0x7f183012ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.666+0000 7f1834ddc700 1 -- 172.21.15.72:0/2649512629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18300613a0 msgr2=0x7f183012ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:56.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.666+0000 7f1834ddc700 1 --2- 172.21.15.72:0/2649512629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18300613a0 0x7f183012ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.666+0000 7f1834ddc700 1 -- 172.21.15.72:0/2649512629 >> v2:172.21.15.72:3300/0 conn(0x7f1830095df0 msgr2=0x7f1830096250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:56.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.666+0000 7f1834ddc700 1 --2- 172.21.15.72:0/2649512629 >> v2:172.21.15.72:3300/0 conn(0x7f1830095df0 0x7f1830096250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.666+0000 7f1834ddc700 1 -- 172.21.15.72:0/2649512629 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300683c0 con 0x7f183012b2f0 2023-10-03T10:09:56.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.666+0000 7f1834ddc700 1 --2- 172.21.15.72:0/2649512629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f183012b2f0 0x7f183012b6d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1820009830 tx=0x7f18200090f0).ready entity=mon.2 client_cookie=dec38117ef960ded server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.666+0000 7f1827fff700 1 -- 172.21.15.72:0/2649512629 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000f510 con 0x7f183012b2f0 2023-10-03T10:09:56.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.666+0000 7f1827fff700 1 -- 172.21.15.72:0/2649512629 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182000f670 con 0x7f183012b2f0 2023-10-03T10:09:56.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.666+0000 7f1827fff700 1 -- 172.21.15.72:0/2649512629 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000f9f0 con 0x7f183012b2f0 2023-10-03T10:09:56.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.667+0000 7f1837841700 1 -- 172.21.15.72:0/2649512629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f183012b2f0 msgr2=0x7f183012b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.667+0000 7f1837841700 1 --2- 172.21.15.72:0/2649512629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f183012b2f0 0x7f183012b6d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1820009830 tx=0x7f18200090f0).stop 2023-10-03T10:09:56.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.667+0000 7f1837841700 1 -- 172.21.15.72:0/2649512629 shutdown_connections 2023-10-03T10:09:56.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.667+0000 7f1837841700 1 --2- 172.21.15.72:0/2649512629 >> v2:172.21.15.72:3300/0 conn(0x7f1830095df0 0x7f1830096250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.667+0000 7f1837841700 1 --2- 172.21.15.72:0/2649512629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18300613a0 0x7f183012ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.667+0000 7f1837841700 1 --2- 172.21.15.72:0/2649512629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f183012b2f0 0x7f183012b6d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.667+0000 7f1837841700 1 -- 172.21.15.72:0/2649512629 >> 172.21.15.72:0/2649512629 conn(0x7f183009a220 msgr2=0x7f183009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:56.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.667+0000 7f1837841700 1 -- 172.21.15.72:0/2649512629 shutdown_connections 2023-10-03T10:09:56.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.667+0000 7f1837841700 1 -- 172.21.15.72:0/2649512629 wait complete. 2023-10-03T10:09:56.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.668+0000 7f1837841700 1 Processor -- start 2023-10-03T10:09:56.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.668+0000 7f1837841700 1 -- start start 2023-10-03T10:09:56.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.669+0000 7f1837841700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18300613a0 0x7f183013a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.669+0000 7f1837841700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1830095df0 0x7f183013aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.669+0000 7f1837841700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f183012b2f0 0x7f1830113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.669+0000 7f1837841700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18301150e0 con 0x7f18300613a0 2023-10-03T10:09:56.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.669+0000 7f1837841700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183012f320 con 0x7f183012b2f0 2023-10-03T10:09:56.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.669+0000 7f1837841700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1830067130 con 0x7f1830095df0 2023-10-03T10:09:56.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.669+0000 7f18355dd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18300613a0 0x7f183013a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f1835dde700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f183012b2f0 0x7f1830113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f18355dd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18300613a0 0x7f183013a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33378/0 (socket says 172.21.15.72:33378) 2023-10-03T10:09:56.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f18355dd700 1 -- 172.21.15.72:0/2542929647 learned_addr learned my addr 172.21.15.72:0/2542929647 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:56.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f1834ddc700 1 --2- 172.21.15.72:0/2542929647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1830095df0 0x7f183013aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f18355dd700 1 -- 172.21.15.72:0/2542929647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1830095df0 msgr2=0x7f183013aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f18355dd700 1 --2- 172.21.15.72:0/2542929647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1830095df0 0x7f183013aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f18355dd700 1 -- 172.21.15.72:0/2542929647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f183012b2f0 msgr2=0x7f1830113c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f18355dd700 1 --2- 172.21.15.72:0/2542929647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f183012b2f0 0x7f1830113c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f18355dd700 1 -- 172.21.15.72:0/2542929647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1820009370 con 0x7f18300613a0 2023-10-03T10:09:56.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f1835dde700 1 --2- 172.21.15.72:0/2542929647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f183012b2f0 0x7f1830113c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:56.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f1834ddc700 1 --2- 172.21.15.72:0/2542929647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1830095df0 0x7f183013aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:56.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f18355dd700 1 --2- 172.21.15.72:0/2542929647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18300613a0 0x7f183013a560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f182c00e980 tx=0x7f182c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f18257fa700 1 -- 172.21.15.72:0/2542929647 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c012600 con 0x7f18300613a0 2023-10-03T10:09:56.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f18257fa700 1 -- 172.21.15.72:0/2542929647 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182c012760 con 0x7f18300613a0 2023-10-03T10:09:56.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f1837841700 1 -- 172.21.15.72:0/2542929647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1830098bb0 con 0x7f18300613a0 2023-10-03T10:09:56.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f18257fa700 1 -- 172.21.15.72:0/2542929647 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c012ae0 con 0x7f18300613a0 2023-10-03T10:09:56.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.670+0000 7f1837841700 1 -- 172.21.15.72:0/2542929647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1830117fb0 con 0x7f18300613a0 2023-10-03T10:09:56.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.671+0000 7f18257fa700 1 -- 172.21.15.72:0/2542929647 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f182c01b400 con 0x7f18300613a0 2023-10-03T10:09:56.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.672+0000 7f18257fa700 1 -- 172.21.15.72:0/2542929647 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f182c03b320 con 0x7f18300613a0 2023-10-03T10:09:56.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.672+0000 7f1837841700 1 -- 172.21.15.72:0/2542929647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1830117fb0 con 0x7f18300613a0 2023-10-03T10:09:56.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.677+0000 7f18257fa700 1 -- 172.21.15.72:0/2542929647 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1830117fb0 con 0x7f18300613a0 2023-10-03T10:09:56.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.695+0000 7f78acfea700 1 Processor -- start 2023-10-03T10:09:56.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.696+0000 7f83f80d9700 1 Processor -- start 2023-10-03T10:09:56.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.695+0000 7f78acfea700 1 -- start start 2023-10-03T10:09:56.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.696+0000 7f78acfea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a80677c0 0x7f78a8134430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.696+0000 7f78acfea700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a8134920 0x7f78a8136d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.696+0000 7f78acfea700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a8098000 con 0x7f78a8066cd0 2023-10-03T10:09:56.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.696+0000 7f78acfea700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8067ba0 con 0x7f78a8134920 2023-10-03T10:09:56.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.696+0000 7f78acfea700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8068b90 con 0x7f78a80677c0 2023-10-03T10:09:56.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.696+0000 7f78a659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f78a8066cd0 0x7f78a80670b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41094/0 (socket says 172.21.15.72:41094) 2023-10-03T10:09:56.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.696+0000 7f78a659c700 1 -- 172.21.15.72:0/3155259534 learned_addr learned my addr 172.21.15.72:0/3155259534 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:56.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.696+0000 7f78a5d9b700 1 --2- 172.21.15.72:0/3155259534 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a80677c0 0x7f78a8134430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.696+0000 7f83f80d9700 1 -- start start 2023-10-03T10:09:56.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f78a559a700 1 -- 172.21.15.72:0/3155259534 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191357834 0 0) 0x7f78a8098000 con 0x7f78a8066cd0 2023-10-03T10:09:56.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f78a5d9b700 1 -- 172.21.15.72:0/3155259534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a8134920 msgr2=0x7f78a8136d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:56.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f78a5d9b700 1 --2- 172.21.15.72:0/3155259534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a8134920 0x7f78a8136d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:56.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f78a5d9b700 1 -- 172.21.15.72:0/3155259534 >> v1:172.21.15.72:6789/0 conn(0x7f78a8066cd0 legacy=0x7f78a80670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f78a5d9b700 1 -- 172.21.15.72:0/3155259534 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80697b0 con 0x7f78a80677c0 2023-10-03T10:09:56.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f78a5d9b700 1 --2- 172.21.15.72:0/3155259534 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a80677c0 0x7f78a8134430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f789c009790 tx=0x7f789c009060).ready entity=mon.2 client_cookie=e55d00586412ded7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f83f80d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83f0066cd0 0x7f83f00670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f83f80d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83f00675a0 0x7f83f012f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f83f80d9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f0098000 con 0x7f83f012f6e0 2023-10-03T10:09:56.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f83f80d9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f0068b90 con 0x7f83f0066cd0 2023-10-03T10:09:56.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f83f80d9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83f00921c0 con 0x7f83f00675a0 2023-10-03T10:09:56.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f83f5e75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83f0066cd0 0x7f83f00670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f83f5674700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83f00675a0 0x7f83f012f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f83f5e75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83f0066cd0 0x7f83f00670b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48156/0 (socket says 172.21.15.72:48156) 2023-10-03T10:09:56.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f83f5674700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83f00675a0 0x7f83f012f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59482/0 (socket says 172.21.15.72:59482) 2023-10-03T10:09:56.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f83f5e75700 1 -- 172.21.15.72:0/2585794765 learned_addr learned my addr 172.21.15.72:0/2585794765 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:56.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f83f5e75700 1 -- 172.21.15.72:0/2585794765 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83f00675a0 msgr2=0x7f83f012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:56.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f83f5e75700 1 --2- 172.21.15.72:0/2585794765 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83f00675a0 0x7f83f012f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f83f5e75700 1 -- 172.21.15.72:0/2585794765 >> v1:172.21.15.72:6789/0 conn(0x7f83f012f6e0 legacy=0x7f83f0136440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f83f5e75700 1 -- 172.21.15.72:0/2585794765 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f00697b0 con 0x7f83f0066cd0 2023-10-03T10:09:56.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f83f5e75700 1 --2- 172.21.15.72:0/2585794765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83f0066cd0 0x7f83f00670b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f83ec009860 tx=0x7f83ec0090f0).ready entity=mon.1 client_cookie=35dce6ff9c103ee7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f78a559a700 1 -- 172.21.15.72:0/3155259534 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00b5a0 con 0x7f78a80677c0 2023-10-03T10:09:56.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f78a559a700 1 -- 172.21.15.72:0/3155259534 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c00b700 con 0x7f78a80677c0 2023-10-03T10:09:56.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.697+0000 7f78a559a700 1 -- 172.21.15.72:0/3155259534 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00ba80 con 0x7f78a80677c0 2023-10-03T10:09:56.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.698+0000 7f78acfea700 1 -- 172.21.15.72:0/3155259534 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a80677c0 msgr2=0x7f78a8134430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.698+0000 7f78acfea700 1 --2- 172.21.15.72:0/3155259534 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a80677c0 0x7f78a8134430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f789c009790 tx=0x7f789c009060).stop 2023-10-03T10:09:56.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.698+0000 7f83f4e73700 1 -- 172.21.15.72:0/2585794765 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00b580 con 0x7f83f0066cd0 2023-10-03T10:09:56.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.698+0000 7f78acfea700 1 -- 172.21.15.72:0/3155259534 shutdown_connections 2023-10-03T10:09:56.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.698+0000 7f78acfea700 1 --2- 172.21.15.72:0/3155259534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a8134920 0x7f78a8136d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:09:56.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.698+0000 7f78acfea700 1 --2- 172.21.15.72:0/3155259534 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a80677c0 0x7f78a8134430 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.698+0000 7f78acfea700 1 -- 172.21.15.72:0/3155259534 >> 172.21.15.72:0/3155259534 conn(0x7f78a809a220 msgr2=0x7f78a809a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:56.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.698+0000 7f78acfea700 1 -- 172.21.15.72:0/3155259534 shutdown_connections 2023-10-03T10:09:56.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.698+0000 7f78acfea700 1 -- 172.21.15.72:0/3155259534 wait complete. 2023-10-03T10:09:56.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.698+0000 7f83f4e73700 1 -- 172.21.15.72:0/2585794765 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec00b6e0 con 0x7f83f0066cd0 2023-10-03T10:09:56.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.698+0000 7f83f4e73700 1 -- 172.21.15.72:0/2585794765 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00ba80 con 0x7f83f0066cd0 2023-10-03T10:09:56.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.699+0000 7f83f80d9700 1 -- 172.21.15.72:0/2585794765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83f0066cd0 msgr2=0x7f83f00670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.699+0000 7f83f80d9700 1 --2- 172.21.15.72:0/2585794765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83f0066cd0 0x7f83f00670b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f83ec009860 tx=0x7f83ec0090f0).stop 2023-10-03T10:09:56.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.699+0000 7f83f80d9700 1 -- 172.21.15.72:0/2585794765 shutdown_connections 2023-10-03T10:09:56.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.699+0000 7f83f80d9700 1 --2- 172.21.15.72:0/2585794765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83f0066cd0 0x7f83f00670b0 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0x7f83ec009860 tx=0x7f83ec0090f0).stop 2023-10-03T10:09:56.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.699+0000 7f83f80d9700 1 --2- 172.21.15.72:0/2585794765 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83f00675a0 0x7f83f012f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.699+0000 7f83f80d9700 1 -- 172.21.15.72:0/2585794765 >> 172.21.15.72:0/2585794765 conn(0x7f83f009a220 msgr2=0x7f83f009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:56.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.699+0000 7f78acfea700 1 Processor -- start 2023-10-03T10:09:56.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.700+0000 7f83f80d9700 1 -- 172.21.15.72:0/2585794765 shutdown_connections 2023-10-03T10:09:56.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.700+0000 7f83f80d9700 1 -- 172.21.15.72:0/2585794765 wait complete. 2023-10-03T10:09:56.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.700+0000 7f83f80d9700 1 Processor -- start 2023-10-03T10:09:56.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.700+0000 7f83f80d9700 1 -- start start 2023-10-03T10:09:56.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f78acfea700 1 -- start start 2023-10-03T10:09:56.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f80d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83f00675a0 0x7f83f011dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f80d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f012f6e0 0x7f83f011e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f80d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83f011e5c0 0x7f83f011e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f80d9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f0069270 con 0x7f83f012f6e0 2023-10-03T10:09:56.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f80d9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f0121710 con 0x7f83f00675a0 2023-10-03T10:09:56.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f80d9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83f012f290 con 0x7f83f011e5c0 2023-10-03T10:09:56.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f5e75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83f00675a0 0x7f83f011dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f6676700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83f011e5c0 0x7f83f011e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f5e75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83f00675a0 0x7f83f011dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48162/0 (socket says 172.21.15.72:48162) 2023-10-03T10:09:56.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f6676700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83f011e5c0 0x7f83f011e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59488/0 (socket says 172.21.15.72:59488) 2023-10-03T10:09:56.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f5e75700 1 -- 172.21.15.72:0/3206649763 learned_addr learned my addr 172.21.15.72:0/3206649763 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:56.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f5674700 1 --2- 172.21.15.72:0/3206649763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f012f6e0 0x7f83f011e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f5e75700 1 -- 172.21.15.72:0/3206649763 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83f011e5c0 msgr2=0x7f83f011e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f5e75700 1 --2- 172.21.15.72:0/3206649763 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83f011e5c0 0x7f83f011e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f5e75700 1 -- 172.21.15.72:0/3206649763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f012f6e0 msgr2=0x7f83f011e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f5e75700 1 --2- 172.21.15.72:0/3206649763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f012f6e0 0x7f83f011e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f83f5e75700 1 -- 172.21.15.72:0/3206649763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec009370 con 0x7f83f00675a0 2023-10-03T10:09:56.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f78acfea700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78a8066cd0 0x7f78a81134a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f78acfea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a80677c0 0x7f78a8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f78acfea700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a8134920 0x7f78a81322e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.701+0000 7f78acfea700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8115a20 con 0x7f78a8066cd0 2023-10-03T10:09:56.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f78a659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78a8066cd0 0x7f78a81134a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f78a659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78a8066cd0 0x7f78a81134a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33400/0 (socket says 172.21.15.72:33400) 2023-10-03T10:09:56.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f78a659c700 1 -- 172.21.15.72:0/3237939649 learned_addr learned my addr 172.21.15.72:0/3237939649 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:56.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f78a5d9b700 1 --2- 172.21.15.72:0/3237939649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a80677c0 0x7f78a8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f83f5e75700 1 --2- 172.21.15.72:0/3206649763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83f00675a0 0x7f83f011dbe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f83f0061b20 tx=0x7f83ec017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f78acfea700 1 -- 172.21.15.72:0/3237939649 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8137af0 con 0x7f78a8134920 2023-10-03T10:09:56.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f78acfea700 1 -- 172.21.15.72:0/3237939649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8069270 con 0x7f78a80677c0 2023-10-03T10:09:56.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f78a6d9d700 1 --2- 172.21.15.72:0/3237939649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a8134920 0x7f78a81322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f78a659c700 1 -- 172.21.15.72:0/3237939649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a80677c0 msgr2=0x7f78a8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f78a659c700 1 --2- 172.21.15.72:0/3237939649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a80677c0 0x7f78a8133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f78a659c700 1 -- 172.21.15.72:0/3237939649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a8134920 msgr2=0x7f78a81322e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f78a659c700 1 --2- 172.21.15.72:0/3237939649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a8134920 0x7f78a81322e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f78a659c700 1 -- 172.21.15.72:0/3237939649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c0092a0 con 0x7f78a8066cd0 2023-10-03T10:09:56.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f78a659c700 1 --2- 172.21.15.72:0/3237939649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78a8066cd0 0x7f78a81134a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f789800c490 tx=0x7f7898007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f83e5ffb700 1 -- 172.21.15.72:0/3206649763 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00be40 con 0x7f83f00675a0 2023-10-03T10:09:56.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f78967fc700 1 -- 172.21.15.72:0/3237939649 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78980070d0 con 0x7f78a8066cd0 2023-10-03T10:09:56.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.703+0000 7f78967fc700 1 -- 172.21.15.72:0/3237939649 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7898007230 con 0x7f78a8066cd0 2023-10-03T10:09:56.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.703+0000 7f78967fc700 1 -- 172.21.15.72:0/3237939649 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78980075f0 con 0x7f78a8066cd0 2023-10-03T10:09:56.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f83e5ffb700 1 -- 172.21.15.72:0/3206649763 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec000bc0 con 0x7f83f00675a0 2023-10-03T10:09:56.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.702+0000 7f83e5ffb700 1 -- 172.21.15.72:0/3206649763 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec01c420 con 0x7f83f00675a0 2023-10-03T10:09:56.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.703+0000 7f83f80d9700 1 -- 172.21.15.72:0/3206649763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f0121170 con 0x7f83f00675a0 2023-10-03T10:09:56.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.703+0000 7f78acfea700 1 -- 172.21.15.72:0/3237939649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a81166a0 con 0x7f78a8066cd0 2023-10-03T10:09:56.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.703+0000 7f78acfea700 1 -- 172.21.15.72:0/3237939649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a8114270 con 0x7f78a8066cd0 2023-10-03T10:09:56.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.703+0000 7f83f80d9700 1 -- 172.21.15.72:0/3206649763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f012ee60 con 0x7f83f00675a0 2023-10-03T10:09:56.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.704+0000 7f78acfea700 1 -- 172.21.15.72:0/3237939649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a8115f20 con 0x7f78a8066cd0 2023-10-03T10:09:56.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.704+0000 7f83f80d9700 1 -- 172.21.15.72:0/3206649763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f00998d0 con 0x7f83f00675a0 2023-10-03T10:09:56.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.704+0000 7f78967fc700 1 -- 172.21.15.72:0/3237939649 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f78980059b0 con 0x7f78a8066cd0 2023-10-03T10:09:56.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.705+0000 7f83e5ffb700 1 -- 172.21.15.72:0/3206649763 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f83ec01ca60 con 0x7f83f00675a0 2023-10-03T10:09:56.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.704+0000 7f78967fc700 1 -- 172.21.15.72:0/3237939649 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f789803a720 con 0x7f78a8066cd0 2023-10-03T10:09:56.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.705+0000 7f83e5ffb700 1 -- 172.21.15.72:0/3206649763 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f83ec03d190 con 0x7f83f00675a0 2023-10-03T10:09:56.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.709+0000 7f83e5ffb700 1 -- 172.21.15.72:0/3206649763 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f83ec018350 con 0x7f83f00675a0 2023-10-03T10:09:56.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.711+0000 7f78967fc700 1 -- 172.21.15.72:0/3237939649 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7898013970 con 0x7f78a8066cd0 2023-10-03T10:09:56.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.715+0000 7fcc512ec700 1 Processor -- start 2023-10-03T10:09:56.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.715+0000 7fcc512ec700 1 -- start start 2023-10-03T10:09:56.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.716+0000 7fcc512ec700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc4c096380 0x7fcc4c094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.716+0000 7fcc512ec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc4c091b00 0x7fcc4c127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.716+0000 7fcc512ec700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4c096760 con 0x7fcc4c094c20 2023-10-03T10:09:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.716+0000 7fcc512ec700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c091ff0 con 0x7fcc4c096380 2023-10-03T10:09:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.716+0000 7fcc512ec700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c092c80 con 0x7fcc4c091b00 2023-10-03T10:09:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.716+0000 7fcc4b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcc4c094c20 0x7fcc4c127af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41116/0 (socket says 172.21.15.72:41116) 2023-10-03T10:09:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.716+0000 7fcc4b7fe700 1 -- 172.21.15.72:0/2008020665 learned_addr learned my addr 172.21.15.72:0/2008020665 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.716+0000 7fcc4a7fc700 1 --2- 172.21.15.72:0/2008020665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc4c091b00 0x7fcc4c127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.716+0000 7fcc4affd700 1 --2- 172.21.15.72:0/2008020665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc4c096380 0x7fcc4c094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.716+0000 7fcc49ffb700 1 -- 172.21.15.72:0/2008020665 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822006055 0 0) 0x7fcc4c096760 con 0x7fcc4c094c20 2023-10-03T10:09:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.716+0000 7fcc4a7fc700 1 -- 172.21.15.72:0/2008020665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc4c096380 msgr2=0x7fcc4c094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.716+0000 7fcc4a7fc700 1 --2- 172.21.15.72:0/2008020665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc4c096380 0x7fcc4c094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.716+0000 7fcc4a7fc700 1 -- 172.21.15.72:0/2008020665 >> v1:172.21.15.72:6789/0 conn(0x7fcc4c094c20 legacy=0x7fcc4c127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.716+0000 7fcc4a7fc700 1 -- 172.21.15.72:0/2008020665 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c093900 con 0x7fcc4c091b00 2023-10-03T10:09:56.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.717+0000 7fcc4a7fc700 1 --2- 172.21.15.72:0/2008020665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc4c091b00 0x7fcc4c127600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fcc40009790 tx=0x7fcc40009060).ready entity=mon.2 client_cookie=c91a361e0b485d71 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.717+0000 7fcc49ffb700 1 -- 172.21.15.72:0/2008020665 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000b5a0 con 0x7fcc4c091b00 2023-10-03T10:09:56.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.717+0000 7fcc49ffb700 1 -- 172.21.15.72:0/2008020665 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4000b700 con 0x7fcc4c091b00 2023-10-03T10:09:56.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.717+0000 7fcc49ffb700 1 -- 172.21.15.72:0/2008020665 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000ba80 con 0x7fcc4c091b00 2023-10-03T10:09:56.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.717+0000 7fcc512ec700 1 -- 172.21.15.72:0/2008020665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc4c091b00 msgr2=0x7fcc4c127600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.717+0000 7fcc512ec700 1 --2- 172.21.15.72:0/2008020665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc4c091b00 0x7fcc4c127600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fcc40009790 tx=0x7fcc40009060).stop 2023-10-03T10:09:56.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.717+0000 7fcc512ec700 1 -- 172.21.15.72:0/2008020665 shutdown_connections 2023-10-03T10:09:56.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.717+0000 7fcc512ec700 1 --2- 172.21.15.72:0/2008020665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc4c096380 0x7fcc4c094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.717+0000 7fcc512ec700 1 --2- 172.21.15.72:0/2008020665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc4c091b00 0x7fcc4c127600 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.717+0000 7fcc512ec700 1 -- 172.21.15.72:0/2008020665 >> 172.21.15.72:0/2008020665 conn(0x7fcc4c097470 msgr2=0x7fcc4c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:56.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.718+0000 7fcc512ec700 1 -- 172.21.15.72:0/2008020665 shutdown_connections 2023-10-03T10:09:56.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.718+0000 7fcc512ec700 1 -- 172.21.15.72:0/2008020665 wait complete. 2023-10-03T10:09:56.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.719+0000 7fcc512ec700 1 Processor -- start 2023-10-03T10:09:56.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.719+0000 7fcc512ec700 1 -- start start 2023-10-03T10:09:56.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.719+0000 7fcc512ec700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc4c091b00 0x7fcc4c123cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.719+0000 7fcc512ec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc4c094c20 0x7fcc4c1241b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc512ec700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc4c096380 0x7fcc4c113dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc512ec700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c11a880 con 0x7fcc4c096380 2023-10-03T10:09:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc512ec700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c11b4f0 con 0x7fcc4c091b00 2023-10-03T10:09:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc512ec700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c11b850 con 0x7fcc4c094c20 2023-10-03T10:09:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc4b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc4c096380 0x7fcc4c113dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc4b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc4c096380 0x7fcc4c113dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33404/0 (socket says 172.21.15.72:33404) 2023-10-03T10:09:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc4b7fe700 1 -- 172.21.15.72:0/4237275955 learned_addr learned my addr 172.21.15.72:0/4237275955 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc4affd700 1 --2- 172.21.15.72:0/4237275955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc4c091b00 0x7fcc4c123cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc4a7fc700 1 --2- 172.21.15.72:0/4237275955 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc4c094c20 0x7fcc4c1241b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc4b7fe700 1 -- 172.21.15.72:0/4237275955 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc4c094c20 msgr2=0x7fcc4c1241b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc4b7fe700 1 --2- 172.21.15.72:0/4237275955 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc4c094c20 0x7fcc4c1241b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc4b7fe700 1 -- 172.21.15.72:0/4237275955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc4c091b00 msgr2=0x7fcc4c123cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc4b7fe700 1 --2- 172.21.15.72:0/4237275955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc4c091b00 0x7fcc4c123cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc4b7fe700 1 -- 172.21.15.72:0/4237275955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc400092a0 con 0x7fcc4c096380 2023-10-03T10:09:56.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc4a7fc700 1 --2- 172.21.15.72:0/4237275955 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc4c094c20 0x7fcc4c1241b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:56.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc4b7fe700 1 --2- 172.21.15.72:0/4237275955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc4c096380 0x7fcc4c113dc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fcc440021e0 tx=0x7fcc44007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:56.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc32ffd700 1 -- 172.21.15.72:0/4237275955 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc44017070 con 0x7fcc4c096380 2023-10-03T10:09:56.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc32ffd700 1 -- 172.21.15.72:0/4237275955 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc44005d30 con 0x7fcc4c096380 2023-10-03T10:09:56.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc512ec700 1 -- 172.21.15.72:0/4237275955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4c06a520 con 0x7fcc4c096380 2023-10-03T10:09:56.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc32ffd700 1 -- 172.21.15.72:0/4237275955 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc44005ea0 con 0x7fcc4c096380 2023-10-03T10:09:56.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.720+0000 7fcc512ec700 1 -- 172.21.15.72:0/4237275955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4c1246a0 con 0x7fcc4c096380 2023-10-03T10:09:56.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.721+0000 7fcc32ffd700 1 -- 172.21.15.72:0/4237275955 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fcc44010850 con 0x7fcc4c096380 2023-10-03T10:09:56.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.721+0000 7fcc32ffd700 1 -- 172.21.15.72:0/4237275955 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fcc44042f40 con 0x7fcc4c096380 2023-10-03T10:09:56.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.722+0000 7fcc512ec700 1 -- 172.21.15.72:0/4237275955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4c099980 con 0x7fcc4c096380 2023-10-03T10:09:56.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.726+0000 7fcc32ffd700 1 -- 172.21.15.72:0/4237275955 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fcc440070d0 con 0x7fcc4c096380 2023-10-03T10:09:56.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.883+0000 7f1837841700 1 -- 172.21.15.72:0/2542929647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1830117fb0 con 0x7f18300613a0 2023-10-03T10:09:56.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.883+0000 7f18257fa700 1 -- 172.21.15.72:0/2542929647 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1830117fb0 con 0x7f18300613a0 2023-10-03T10:09:56.883 INFO:teuthology.orchestra.run.smithi072.stdout:38654705669 2023-10-03T10:09:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.885+0000 7f1837841700 1 -- 172.21.15.72:0/2542929647 >> v1:172.21.15.72:6816/118184 conn(0x7f181402bb60 legacy=0x7f181402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.885+0000 7f1837841700 1 -- 172.21.15.72:0/2542929647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18300613a0 msgr2=0x7f183013a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.885+0000 7f1837841700 1 --2- 172.21.15.72:0/2542929647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18300613a0 0x7f183013a560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f182c00e980 tx=0x7f182c009060).stop 2023-10-03T10:09:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.885+0000 7f1837841700 1 -- 172.21.15.72:0/2542929647 shutdown_connections 2023-10-03T10:09:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.885+0000 7f1837841700 1 --2- 172.21.15.72:0/2542929647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18300613a0 0x7f183013a560 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.885+0000 7f1837841700 1 --2- 172.21.15.72:0/2542929647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f183012b2f0 0x7f1830113c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.885+0000 7f1837841700 1 --2- 172.21.15.72:0/2542929647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1830095df0 0x7f183013aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.885+0000 7f1837841700 1 -- 172.21.15.72:0/2542929647 >> 172.21.15.72:0/2542929647 conn(0x7f183009a220 msgr2=0x7f1830065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.885+0000 7f1837841700 1 -- 172.21.15.72:0/2542929647 shutdown_connections 2023-10-03T10:09:56.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.885+0000 7f1837841700 1 -- 172.21.15.72:0/2542929647 wait complete. 2023-10-03T10:09:56.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.897+0000 7f83f80d9700 1 -- 172.21.15.72:0/3206649763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f83f005a260 con 0x7f83f00675a0 2023-10-03T10:09:56.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.897+0000 7f83e5ffb700 1 -- 172.21.15.72:0/3206649763 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f83ec020020 con 0x7f83f00675a0 2023-10-03T10:09:56.899 INFO:teuthology.orchestra.run.smithi072.stdout:38654705669 2023-10-03T10:09:56.899 INFO:teuthology.orchestra.run.smithi072.stdout:38654705669 2023-10-03T10:09:56.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.898+0000 7f78acfea700 1 -- 172.21.15.72:0/3237939649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f78a8068830 con 0x7f78a8066cd0 2023-10-03T10:09:56.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.898+0000 7f78967fc700 1 -- 172.21.15.72:0/3237939649 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7898010300 con 0x7f78a8066cd0 2023-10-03T10:09:56.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.900+0000 7f83f80d9700 1 -- 172.21.15.72:0/3206649763 >> v1:172.21.15.72:6816/118184 conn(0x7f83d402bb60 legacy=0x7f83d402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.900+0000 7f83f80d9700 1 -- 172.21.15.72:0/3206649763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83f00675a0 msgr2=0x7f83f011dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.900+0000 7f83f80d9700 1 --2- 172.21.15.72:0/3206649763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83f00675a0 0x7f83f011dbe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f83f0061b20 tx=0x7f83ec017000).stop 2023-10-03T10:09:56.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.900+0000 7f83f80d9700 1 -- 172.21.15.72:0/3206649763 shutdown_connections 2023-10-03T10:09:56.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.900+0000 7f83f80d9700 1 --2- 172.21.15.72:0/3206649763 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83f011e5c0 0x7f83f011e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.900+0000 7f83f80d9700 1 --2- 172.21.15.72:0/3206649763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83f00675a0 0x7f83f011dbe0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.900+0000 7f83f80d9700 1 --2- 172.21.15.72:0/3206649763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83f012f6e0 0x7f83f011e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.900+0000 7f83f80d9700 1 -- 172.21.15.72:0/3206649763 >> 172.21.15.72:0/3206649763 conn(0x7f83f009a220 msgr2=0x7f83f0096b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:56.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.900+0000 7f83f80d9700 1 -- 172.21.15.72:0/3206649763 shutdown_connections 2023-10-03T10:09:56.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.900+0000 7f83f80d9700 1 -- 172.21.15.72:0/3206649763 wait complete. 2023-10-03T10:09:56.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.901+0000 7f78acfea700 1 -- 172.21.15.72:0/3237939649 >> v1:172.21.15.72:6816/118184 conn(0x7f788802bb60 legacy=0x7f788802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.901+0000 7f78acfea700 1 -- 172.21.15.72:0/3237939649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78a8066cd0 msgr2=0x7f78a81134a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.901+0000 7f78acfea700 1 --2- 172.21.15.72:0/3237939649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78a8066cd0 0x7f78a81134a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f789800c490 tx=0x7f7898007e40).stop 2023-10-03T10:09:56.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2023-10-03T10:09:56.903 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:56.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.901+0000 7f78acfea700 1 -- 172.21.15.72:0/3237939649 shutdown_connections 2023-10-03T10:09:56.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.901+0000 7f78acfea700 1 --2- 172.21.15.72:0/3237939649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78a8066cd0 0x7f78a81134a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.901+0000 7f78acfea700 1 --2- 172.21.15.72:0/3237939649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a8134920 0x7f78a81322e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.901+0000 7f78acfea700 1 --2- 172.21.15.72:0/3237939649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a80677c0 0x7f78a8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.901+0000 7f78acfea700 1 -- 172.21.15.72:0/3237939649 >> 172.21.15.72:0/3237939649 conn(0x7f78a809a220 msgr2=0x7f78a8137220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:56.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.901+0000 7f78acfea700 1 -- 172.21.15.72:0/3237939649 shutdown_connections 2023-10-03T10:09:56.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.901+0000 7f78acfea700 1 -- 172.21.15.72:0/3237939649 wait complete. 2023-10-03T10:09:56.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2023-10-03T10:09:56.913 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:56.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2023-10-03T10:09:56.914 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:56.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.924+0000 7fcc512ec700 1 -- 172.21.15.72:0/4237275955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcc4c0942e0 con 0x7fcc4c096380 2023-10-03T10:09:56.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.924+0000 7fcc32ffd700 1 -- 172.21.15.72:0/4237275955 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcc440253f0 con 0x7fcc4c096380 2023-10-03T10:09:56.925 INFO:teuthology.orchestra.run.smithi072.stdout:38654705669 2023-10-03T10:09:56.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.926+0000 7fcc512ec700 1 -- 172.21.15.72:0/4237275955 >> v1:172.21.15.72:6816/118184 conn(0x7fcc3802bb60 legacy=0x7fcc3802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.926+0000 7fcc512ec700 1 -- 172.21.15.72:0/4237275955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc4c096380 msgr2=0x7fcc4c113dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:56.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.926+0000 7fcc512ec700 1 --2- 172.21.15.72:0/4237275955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc4c096380 0x7fcc4c113dc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fcc440021e0 tx=0x7fcc44007f90).stop 2023-10-03T10:09:56.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.926+0000 7fcc512ec700 1 -- 172.21.15.72:0/4237275955 shutdown_connections 2023-10-03T10:09:56.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.926+0000 7fcc512ec700 1 --2- 172.21.15.72:0/4237275955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc4c096380 0x7fcc4c113dc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.926+0000 7fcc512ec700 1 --2- 172.21.15.72:0/4237275955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc4c091b00 0x7fcc4c123cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.926+0000 7fcc512ec700 1 --2- 172.21.15.72:0/4237275955 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc4c094c20 0x7fcc4c1241b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:56.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.926+0000 7fcc512ec700 1 -- 172.21.15.72:0/4237275955 >> 172.21.15.72:0/4237275955 conn(0x7fcc4c097470 msgr2=0x7fcc4c098780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:56.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.926+0000 7fcc512ec700 1 -- 172.21.15.72:0/4237275955 shutdown_connections 2023-10-03T10:09:56.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:56.926+0000 7fcc512ec700 1 -- 172.21.15.72:0/4237275955 wait complete. 2023-10-03T10:09:56.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2023-10-03T10:09:56.938 DEBUG:teuthology.parallel:result is None 2023-10-03T10:09:56.938 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:09:56.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:57.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.093+0000 7feb49e07700 1 Processor -- start 2023-10-03T10:09:57.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.093+0000 7feb49e07700 1 -- start start 2023-10-03T10:09:57.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.094+0000 7feb49e07700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb44096380 0x7feb44094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.094+0000 7feb49e07700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb44091b00 0x7feb44127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.094+0000 7feb49e07700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb44096760 con 0x7feb44094c20 2023-10-03T10:09:57.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.094+0000 7feb49e07700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb44091ff0 con 0x7feb44096380 2023-10-03T10:09:57.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.094+0000 7feb49e07700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb44092c80 con 0x7feb44091b00 2023-10-03T10:09:57.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.094+0000 7feb42ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb44091b00 0x7feb44127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.094+0000 7feb437fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb44096380 0x7feb44094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.094+0000 7feb43fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7feb44094c20 0x7feb44127af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41132/0 (socket says 172.21.15.72:41132) 2023-10-03T10:09:57.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.094+0000 7feb43fff700 1 -- 172.21.15.72:0/2809981997 learned_addr learned my addr 172.21.15.72:0/2809981997 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:57.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.094+0000 7feb427fc700 1 -- 172.21.15.72:0/2809981997 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943300975 0 0) 0x7feb44096760 con 0x7feb44094c20 2023-10-03T10:09:57.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.094+0000 7feb437fe700 1 -- 172.21.15.72:0/2809981997 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb44091b00 msgr2=0x7feb44127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.094+0000 7feb437fe700 1 --2- 172.21.15.72:0/2809981997 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb44091b00 0x7feb44127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.094+0000 7feb437fe700 1 -- 172.21.15.72:0/2809981997 >> v1:172.21.15.72:6789/0 conn(0x7feb44094c20 legacy=0x7feb44127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.094+0000 7feb437fe700 1 -- 172.21.15.72:0/2809981997 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb44093900 con 0x7feb44096380 2023-10-03T10:09:57.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.095+0000 7feb437fe700 1 --2- 172.21.15.72:0/2809981997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb44096380 0x7feb44094730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7feb34009790 tx=0x7feb34009060).ready entity=mon.1 client_cookie=2137805e00bbda8b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.095+0000 7feb427fc700 1 -- 172.21.15.72:0/2809981997 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3400f510 con 0x7feb44096380 2023-10-03T10:09:57.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.095+0000 7feb427fc700 1 -- 172.21.15.72:0/2809981997 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3400f670 con 0x7feb44096380 2023-10-03T10:09:57.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.095+0000 7feb427fc700 1 -- 172.21.15.72:0/2809981997 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3400f9f0 con 0x7feb44096380 2023-10-03T10:09:57.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.095+0000 7feb49e07700 1 -- 172.21.15.72:0/2809981997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb44096380 msgr2=0x7feb44094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.095+0000 7feb49e07700 1 --2- 172.21.15.72:0/2809981997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb44096380 0x7feb44094730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7feb34009790 tx=0x7feb34009060).stop 2023-10-03T10:09:57.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.095+0000 7feb49e07700 1 -- 172.21.15.72:0/2809981997 shutdown_connections 2023-10-03T10:09:57.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.095+0000 7feb49e07700 1 --2- 172.21.15.72:0/2809981997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb44096380 0x7feb44094730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.095+0000 7feb49e07700 1 --2- 172.21.15.72:0/2809981997 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb44091b00 0x7feb44127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.095+0000 7feb49e07700 1 -- 172.21.15.72:0/2809981997 >> 172.21.15.72:0/2809981997 conn(0x7feb44097470 msgr2=0x7feb44097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.095+0000 7feb49e07700 1 -- 172.21.15.72:0/2809981997 shutdown_connections 2023-10-03T10:09:57.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.095+0000 7feb49e07700 1 -- 172.21.15.72:0/2809981997 wait complete. 2023-10-03T10:09:57.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.096+0000 7feb49e07700 1 Processor -- start 2023-10-03T10:09:57.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.096+0000 7feb49e07700 1 -- start start 2023-10-03T10:09:57.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb49e07700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb44091b00 0x7feb44069bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb49e07700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb44094c20 0x7feb441233c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb49e07700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb44096380 0x7feb441238b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb49e07700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb441251d0 con 0x7feb44096380 2023-10-03T10:09:57.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb49e07700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb441227e0 con 0x7feb44094c20 2023-10-03T10:09:57.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb49e07700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb44120990 con 0x7feb44091b00 2023-10-03T10:09:57.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb437fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb44091b00 0x7feb44069bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb43fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb44096380 0x7feb441238b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb437fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb44091b00 0x7feb44069bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59532/0 (socket says 172.21.15.72:59532) 2023-10-03T10:09:57.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb437fe700 1 -- 172.21.15.72:0/3590154491 learned_addr learned my addr 172.21.15.72:0/3590154491 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:57.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb42ffd700 1 --2- 172.21.15.72:0/3590154491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb44094c20 0x7feb441233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb437fe700 1 -- 172.21.15.72:0/3590154491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb44094c20 msgr2=0x7feb441233c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb437fe700 1 --2- 172.21.15.72:0/3590154491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb44094c20 0x7feb441233c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb437fe700 1 -- 172.21.15.72:0/3590154491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb44096380 msgr2=0x7feb441238b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb437fe700 1 --2- 172.21.15.72:0/3590154491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb44096380 0x7feb441238b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb437fe700 1 -- 172.21.15.72:0/3590154491 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb340092a0 con 0x7feb44091b00 2023-10-03T10:09:57.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb42ffd700 1 --2- 172.21.15.72:0/3590154491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb44094c20 0x7feb441233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:57.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb43fff700 1 --2- 172.21.15.72:0/3590154491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb44096380 0x7feb441238b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:57.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb437fe700 1 --2- 172.21.15.72:0/3590154491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb44091b00 0x7feb44069bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7feb44092130 tx=0x7feb34017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb3b7fe700 1 -- 172.21.15.72:0/3590154491 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3400f7e0 con 0x7feb44091b00 2023-10-03T10:09:57.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb3b7fe700 1 -- 172.21.15.72:0/3590154491 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3400f940 con 0x7feb44091b00 2023-10-03T10:09:57.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb49e07700 1 -- 172.21.15.72:0/3590154491 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb44122240 con 0x7feb44091b00 2023-10-03T10:09:57.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb3b7fe700 1 -- 172.21.15.72:0/3590154491 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3401c670 con 0x7feb44091b00 2023-10-03T10:09:57.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.097+0000 7feb49e07700 1 -- 172.21.15.72:0/3590154491 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb44122ec0 con 0x7feb44091b00 2023-10-03T10:09:57.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.098+0000 7feb3b7fe700 1 -- 172.21.15.72:0/3590154491 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7feb3401ca20 con 0x7feb44091b00 2023-10-03T10:09:57.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.098+0000 7feb3b7fe700 1 -- 172.21.15.72:0/3590154491 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7feb3403cc40 con 0x7feb44091b00 2023-10-03T10:09:57.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.098+0000 7feb49e07700 1 -- 172.21.15.72:0/3590154491 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb44099010 con 0x7feb44091b00 2023-10-03T10:09:57.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.103+0000 7feb3b7fe700 1 -- 172.21.15.72:0/3590154491 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7feb44099010 con 0x7feb44091b00 2023-10-03T10:09:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.257+0000 7feb49e07700 1 -- 172.21.15.72:0/3590154491 --> v1:172.21.15.72:6816/118184 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb4406a0c0 con 0x7feb2402bb90 2023-10-03T10:09:57.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.264+0000 7feb3b7fe700 1 -- 172.21.15.72:0/3590154491 <== mgr.4102 v1:172.21.15.72:6816/118184 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249969 (unknown 2965378022 0 1921904298) 0x7feb2c009c00 con 0x7feb2402bb90 2023-10-03T10:09:57.266 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:57.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.267+0000 7feb49e07700 1 -- 172.21.15.72:0/3590154491 >> v1:172.21.15.72:6816/118184 conn(0x7feb2402bb90 legacy=0x7feb2402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.267+0000 7feb49e07700 1 -- 172.21.15.72:0/3590154491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb44091b00 msgr2=0x7feb44069bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.267+0000 7feb49e07700 1 --2- 172.21.15.72:0/3590154491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb44091b00 0x7feb44069bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7feb44092130 tx=0x7feb34017000).stop 2023-10-03T10:09:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.267+0000 7feb49e07700 1 -- 172.21.15.72:0/3590154491 shutdown_connections 2023-10-03T10:09:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.267+0000 7feb49e07700 1 --2- 172.21.15.72:0/3590154491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb44096380 0x7feb441238b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.267+0000 7feb49e07700 1 --2- 172.21.15.72:0/3590154491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb44091b00 0x7feb44069bd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.267+0000 7feb49e07700 1 --2- 172.21.15.72:0/3590154491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb44094c20 0x7feb441233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.267+0000 7feb49e07700 1 -- 172.21.15.72:0/3590154491 >> 172.21.15.72:0/3590154491 conn(0x7feb44097470 msgr2=0x7feb44059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.267+0000 7feb49e07700 1 -- 172.21.15.72:0/3590154491 shutdown_connections 2023-10-03T10:09:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.267+0000 7feb49e07700 1 -- 172.21.15.72:0/3590154491 wait complete. 2023-10-03T10:09:57.269 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-03T10:09:57.278 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-03T10:09:55.880118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189020,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298340,"statfs":{"total":386547056640,"available":385329500160,"internally_reserved":0,"allocated":651264,"data_stored":192439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001216"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387453+0000","last_change":"2023-10-03T10:09:46.383964+0000","last_active":"2023-10-03T10:09:46.387453+0000","last_peered":"2023-10-03T10:09:46.387453+0000","last_clean":"2023-10-03T10:09:46.387453+0000","last_became_active":"2023-10-03T10:09:46.383681+0000","last_became_peered":"2023-10-03T10:09:46.383681+0000","last_unstale":"2023-10-03T10:09:46.387453+0000","last_undegraded":"2023-10-03T10:09:46.387453+0000","last_fullsized":"2023-10-03T10:09:46.387453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380623+0000","last_change":"2023-10-03T10:09:46.369230+0000","last_active":"2023-10-03T10:09:46.380623+0000","last_peered":"2023-10-03T10:09:46.380623+0000","last_clean":"2023-10-03T10:09:46.380623+0000","last_became_active":"2023-10-03T10:09:46.368861+0000","last_became_peered":"2023-10-03T10:09:46.368861+0000","last_unstale":"2023-10-03T10:09:46.380623+0000","last_undegraded":"2023-10-03T10:09:46.380623+0000","last_fullsized":"2023-10-03T10:09:46.380623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381586+0000","last_change":"2023-10-03T10:09:46.379410+0000","last_active":"2023-10-03T10:09:46.381586+0000","last_peered":"2023-10-03T10:09:46.381586+0000","last_clean":"2023-10-03T10:09:46.381586+0000","last_became_active":"2023-10-03T10:09:46.379027+0000","last_became_peered":"2023-10-03T10:09:46.379027+0000","last_unstale":"2023-10-03T10:09:46.381586+0000","last_undegraded":"2023-10-03T10:09:46.381586+0000","last_fullsized":"2023-10-03T10:09:46.381586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381478+0000","last_change":"2023-10-03T10:09:46.379505+0000","last_active":"2023-10-03T10:09:46.381478+0000","last_peered":"2023-10-03T10:09:46.381478+0000","last_clean":"2023-10-03T10:09:46.381478+0000","last_became_active":"2023-10-03T10:09:46.379187+0000","last_became_peered":"2023-10-03T10:09:46.379187+0000","last_unstale":"2023-10-03T10:09:46.381478+0000","last_undegraded":"2023-10-03T10:09:46.381478+0000","last_fullsized":"2023-10-03T10:09:46.381478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381407+0000","last_change":"2023-10-03T10:09:46.379819+0000","last_active":"2023-10-03T10:09:46.381407+0000","last_peered":"2023-10-03T10:09:46.381407+0000","last_clean":"2023-10-03T10:09:46.381407+0000","last_became_active":"2023-10-03T10:09:46.379555+0000","last_became_peered":"2023-10-03T10:09:46.379555+0000","last_unstale":"2023-10-03T10:09:46.381407+0000","last_undegraded":"2023-10-03T10:09:46.381407+0000","last_fullsized":"2023-10-03T10:09:46.381407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392234+0000","last_change":"2023-10-03T10:09:46.385185+0000","last_active":"2023-10-03T10:09:46.392234+0000","last_peered":"2023-10-03T10:09:46.392234+0000","last_clean":"2023-10-03T10:09:46.392234+0000","last_became_active":"2023-10-03T10:09:46.384935+0000","last_became_peered":"2023-10-03T10:09:46.384935+0000","last_unstale":"2023-10-03T10:09:46.392234+0000","last_undegraded":"2023-10-03T10:09:46.392234+0000","last_fullsized":"2023-10-03T10:09:46.392234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387917+0000","last_change":"2023-10-03T10:09:46.378880+0000","last_active":"2023-10-03T10:09:46.387917+0000","last_peered":"2023-10-03T10:09:46.387917+0000","last_clean":"2023-10-03T10:09:46.387917+0000","last_became_active":"2023-10-03T10:09:46.375285+0000","last_became_peered":"2023-10-03T10:09:46.375285+0000","last_unstale":"2023-10-03T10:09:46.387917+0000","last_undegraded":"2023-10-03T10:09:46.387917+0000","last_fullsized":"2023-10-03T10:09:46.387917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380669+0000","last_change":"2023-10-03T10:09:46.375928+0000","last_active":"2023-10-03T10:09:46.380669+0000","last_peered":"2023-10-03T10:09:46.380669+0000","last_clean":"2023-10-03T10:09:46.380669+0000","last_became_active":"2023-10-03T10:09:46.375325+0000","last_became_peered":"2023-10-03T10:09:46.375325+0000","last_unstale":"2023-10-03T10:09:46.380669+0000","last_undegraded":"2023-10-03T10:09:46.380669+0000","last_fullsized":"2023-10-03T10:09:46.380669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381546+0000","last_change":"2023-10-03T10:09:46.379935+0000","last_active":"2023-10-03T10:09:46.381546+0000","last_peered":"2023-10-03T10:09:46.381546+0000","last_clean":"2023-10-03T10:09:46.381546+0000","last_became_active":"2023-10-03T10:09:46.379431+0000","last_became_peered":"2023-10-03T10:09:46.379431+0000","last_unstale":"2023-10-03T10:09:46.381546+0000","last_undegraded":"2023-10-03T10:09:46.381546+0000","last_fullsized":"2023-10-03T10:09:46.381546+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377432+0000","last_change":"2023-10-03T10:09:46.372991+0000","last_active":"2023-10-03T10:09:46.377432+0000","last_peered":"2023-10-03T10:09:46.377432+0000","last_clean":"2023-10-03T10:09:46.377432+0000","last_became_active":"2023-10-03T10:09:46.372738+0000","last_became_peered":"2023-10-03T10:09:46.372738+0000","last_unstale":"2023-10-03T10:09:46.377432+0000","last_undegraded":"2023-10-03T10:09:46.377432+0000","last_fullsized":"2023-10-03T10:09:46.377432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377393+0000","last_change":"2023-10-03T10:09:46.372532+0000","last_active":"2023-10-03T10:09:46.377393+0000","last_peered":"2023-10-03T10:09:46.377393+0000","last_clean":"2023-10-03T10:09:46.377393+0000","last_became_active":"2023-10-03T10:09:46.372304+0000","last_became_peered":"2023-10-03T10:09:46.372304+0000","last_unstale":"2023-10-03T10:09:46.377393+0000","last_undegraded":"2023-10-03T10:09:46.377393+0000","last_fullsized":"2023-10-03T10:09:46.377393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387695+0000","last_change":"2023-10-03T10:09:46.384266+0000","last_active":"2023-10-03T10:09:46.387695+0000","last_peered":"2023-10-03T10:09:46.387695+0000","last_clean":"2023-10-03T10:09:46.387695+0000","last_became_active":"2023-10-03T10:09:46.383826+0000","last_became_peered":"2023-10-03T10:09:46.383826+0000","last_unstale":"2023-10-03T10:09:46.387695+0000","last_undegraded":"2023-10-03T10:09:46.387695+0000","last_fullsized":"2023-10-03T10:09:46.387695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388178+0000","last_change":"2023-10-03T10:09:46.384841+0000","last_active":"2023-10-03T10:09:46.388178+0000","last_peered":"2023-10-03T10:09:46.388178+0000","last_clean":"2023-10-03T10:09:46.388178+0000","last_became_active":"2023-10-03T10:09:46.384396+0000","last_became_peered":"2023-10-03T10:09:46.384396+0000","last_unstale":"2023-10-03T10:09:46.388178+0000","last_undegraded":"2023-10-03T10:09:46.388178+0000","last_fullsized":"2023-10-03T10:09:46.388178+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377458+0000","last_change":"2023-10-03T10:09:46.373837+0000","last_active":"2023-10-03T10:09:46.377458+0000","last_peered":"2023-10-03T10:09:46.377458+0000","last_clean":"2023-10-03T10:09:46.377458+0000","last_became_active":"2023-10-03T10:09:46.373580+0000","last_became_peered":"2023-10-03T10:09:46.373580+0000","last_unstale":"2023-10-03T10:09:46.377458+0000","last_undegraded":"2023-10-03T10:09:46.377458+0000","last_fullsized":"2023-10-03T10:09:46.377458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381796+0000","last_change":"2023-10-03T10:09:46.380527+0000","last_active":"2023-10-03T10:09:46.381796+0000","last_peered":"2023-10-03T10:09:46.381796+0000","last_clean":"2023-10-03T10:09:46.381796+0000","last_became_active":"2023-10-03T10:09:46.379198+0000","last_became_peered":"2023-10-03T10:09:46.379198+0000","last_unstale":"2023-10-03T10:09:46.381796+0000","last_undegraded":"2023-10-03T10:09:46.381796+0000","last_fullsized":"2023-10-03T10:09:46.381796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366853+0000","last_change":"2023-10-03T10:09:46.365014+0000","last_active":"2023-10-03T10:09:46.366853+0000","last_peered":"2023-10-03T10:09:46.366853+0000","last_clean":"2023-10-03T10:09:46.366853+0000","last_became_active":"2023-10-03T10:09:46.363620+0000","last_became_peered":"2023-10-03T10:09:46.363620+0000","last_unstale":"2023-10-03T10:09:46.366853+0000","last_undegraded":"2023-10-03T10:09:46.366853+0000","last_fullsized":"2023-10-03T10:09:46.366853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381563+0000","last_change":"2023-10-03T10:09:46.380089+0000","last_active":"2023-10-03T10:09:46.381563+0000","last_peered":"2023-10-03T10:09:46.381563+0000","last_clean":"2023-10-03T10:09:46.381563+0000","last_became_active":"2023-10-03T10:09:46.379696+0000","last_became_peered":"2023-10-03T10:09:46.379696+0000","last_unstale":"2023-10-03T10:09:46.381563+0000","last_undegraded":"2023-10-03T10:09:46.381563+0000","last_fullsized":"2023-10-03T10:09:46.381563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.375967+0000","last_change":"2023-10-03T10:09:46.374686+0000","last_active":"2023-10-03T10:09:46.375967+0000","last_peered":"2023-10-03T10:09:46.375967+0000","last_clean":"2023-10-03T10:09:46.375967+0000","last_became_active":"2023-10-03T10:09:46.371287+0000","last_became_peered":"2023-10-03T10:09:46.371287+0000","last_unstale":"2023-10-03T10:09:46.375967+0000","last_undegraded":"2023-10-03T10:09:46.375967+0000","last_fullsized":"2023-10-03T10:09:46.375967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366160+0000","last_change":"2023-10-03T10:09:46.364615+0000","last_active":"2023-10-03T10:09:46.366160+0000","last_peered":"2023-10-03T10:09:46.366160+0000","last_clean":"2023-10-03T10:09:46.366160+0000","last_became_active":"2023-10-03T10:09:46.364379+0000","last_became_peered":"2023-10-03T10:09:46.364379+0000","last_unstale":"2023-10-03T10:09:46.366160+0000","last_undegraded":"2023-10-03T10:09:46.366160+0000","last_fullsized":"2023-10-03T10:09:46.366160+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.391649+0000","last_change":"2023-10-03T10:09:46.388555+0000","last_active":"2023-10-03T10:09:46.391649+0000","last_peered":"2023-10-03T10:09:46.391649+0000","last_clean":"2023-10-03T10:09:46.391649+0000","last_became_active":"2023-10-03T10:09:46.388278+0000","last_became_peered":"2023-10-03T10:09:46.388278+0000","last_unstale":"2023-10-03T10:09:46.391649+0000","last_undegraded":"2023-10-03T10:09:46.391649+0000","last_fullsized":"2023-10-03T10:09:46.391649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.375782+0000","last_change":"2023-10-03T10:09:46.367061+0000","last_active":"2023-10-03T10:09:46.375782+0000","last_peered":"2023-10-03T10:09:46.375782+0000","last_clean":"2023-10-03T10:09:46.375782+0000","last_became_active":"2023-10-03T10:09:46.366790+0000","last_became_peered":"2023-10-03T10:09:46.366790+0000","last_unstale":"2023-10-03T10:09:46.375782+0000","last_undegraded":"2023-10-03T10:09:46.375782+0000","last_fullsized":"2023-10-03T10:09:46.375782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381350+0000","last_change":"2023-10-03T10:09:46.378399+0000","last_active":"2023-10-03T10:09:46.381350+0000","last_peered":"2023-10-03T10:09:46.381350+0000","last_clean":"2023-10-03T10:09:46.381350+0000","last_became_active":"2023-10-03T10:09:46.378102+0000","last_became_peered":"2023-10-03T10:09:46.378102+0000","last_unstale":"2023-10-03T10:09:46.381350+0000","last_undegraded":"2023-10-03T10:09:46.381350+0000","last_fullsized":"2023-10-03T10:09:46.381350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387548+0000","last_change":"2023-10-03T10:09:46.378572+0000","last_active":"2023-10-03T10:09:46.387548+0000","last_peered":"2023-10-03T10:09:46.387548+0000","last_clean":"2023-10-03T10:09:46.387548+0000","last_became_active":"2023-10-03T10:09:46.378004+0000","last_became_peered":"2023-10-03T10:09:46.378004+0000","last_unstale":"2023-10-03T10:09:46.387548+0000","last_undegraded":"2023-10-03T10:09:46.387548+0000","last_fullsized":"2023-10-03T10:09:46.387548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380689+0000","last_change":"2023-10-03T10:09:46.375958+0000","last_active":"2023-10-03T10:09:46.380689+0000","last_peered":"2023-10-03T10:09:46.380689+0000","last_clean":"2023-10-03T10:09:46.380689+0000","last_became_active":"2023-10-03T10:09:46.375553+0000","last_became_peered":"2023-10-03T10:09:46.375553+0000","last_unstale":"2023-10-03T10:09:46.380689+0000","last_undegraded":"2023-10-03T10:09:46.380689+0000","last_fullsized":"2023-10-03T10:09:46.380689+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377238+0000","last_change":"2023-10-03T10:09:46.367258+0000","last_active":"2023-10-03T10:09:46.377238+0000","last_peered":"2023-10-03T10:09:46.377238+0000","last_clean":"2023-10-03T10:09:46.377238+0000","last_became_active":"2023-10-03T10:09:46.366828+0000","last_became_peered":"2023-10-03T10:09:46.366828+0000","last_unstale":"2023-10-03T10:09:46.377238+0000","last_undegraded":"2023-10-03T10:09:46.377238+0000","last_fullsized":"2023-10-03T10:09:46.377238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377457+0000","last_change":"2023-10-03T10:09:46.374039+0000","last_active":"2023-10-03T10:09:46.377457+0000","last_peered":"2023-10-03T10:09:46.377457+0000","last_clean":"2023-10-03T10:09:46.377457+0000","last_became_active":"2023-10-03T10:09:46.373585+0000","last_became_peered":"2023-10-03T10:09:46.373585+0000","last_unstale":"2023-10-03T10:09:46.377457+0000","last_undegraded":"2023-10-03T10:09:46.377457+0000","last_fullsized":"2023-10-03T10:09:46.377457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392051+0000","last_change":"2023-10-03T10:09:46.383307+0000","last_active":"2023-10-03T10:09:46.392051+0000","last_peered":"2023-10-03T10:09:46.392051+0000","last_clean":"2023-10-03T10:09:46.392051+0000","last_became_active":"2023-10-03T10:09:46.377010+0000","last_became_peered":"2023-10-03T10:09:46.377010+0000","last_unstale":"2023-10-03T10:09:46.392051+0000","last_undegraded":"2023-10-03T10:09:46.392051+0000","last_fullsized":"2023-10-03T10:09:46.392051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.373297+0000","last_change":"2023-10-03T10:09:45.994509+0000","last_active":"2023-10-03T10:09:46.373297+0000","last_peered":"2023-10-03T10:09:46.373297+0000","last_clean":"2023-10-03T10:09:46.373297+0000","last_became_active":"2023-10-03T10:09:45.994047+0000","last_became_peered":"2023-10-03T10:09:45.994047+0000","last_unstale":"2023-10-03T10:09:46.373297+0000","last_undegraded":"2023-10-03T10:09:46.373297+0000","last_fullsized":"2023-10-03T10:09:46.373297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.369857+0000","last_change":"2023-10-03T10:09:46.367594+0000","last_active":"2023-10-03T10:09:46.369857+0000","last_peered":"2023-10-03T10:09:46.369857+0000","last_clean":"2023-10-03T10:09:46.369857+0000","last_became_active":"2023-10-03T10:09:46.367029+0000","last_became_peered":"2023-10-03T10:09:46.367029+0000","last_unstale":"2023-10-03T10:09:46.369857+0000","last_undegraded":"2023-10-03T10:09:46.369857+0000","last_fullsized":"2023-10-03T10:09:46.369857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.350498+0000","last_change":"2023-10-03T10:09:46.005851+0000","last_active":"2023-10-03T10:09:46.350498+0000","last_peered":"2023-10-03T10:09:46.350498+0000","last_clean":"2023-10-03T10:09:46.350498+0000","last_became_active":"2023-10-03T10:09:46.005573+0000","last_became_peered":"2023-10-03T10:09:46.005573+0000","last_unstale":"2023-10-03T10:09:46.350498+0000","last_undegraded":"2023-10-03T10:09:46.350498+0000","last_fullsized":"2023-10-03T10:09:46.350498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381389+0000","last_change":"2023-10-03T10:09:46.378806+0000","last_active":"2023-10-03T10:09:46.381389+0000","last_peered":"2023-10-03T10:09:46.381389+0000","last_clean":"2023-10-03T10:09:46.381389+0000","last_became_active":"2023-10-03T10:09:46.378564+0000","last_became_peered":"2023-10-03T10:09:46.378564+0000","last_unstale":"2023-10-03T10:09:46.381389+0000","last_undegraded":"2023-10-03T10:09:46.381389+0000","last_fullsized":"2023-10-03T10:09:46.381389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.351237+0000","last_change":"2023-10-03T10:09:46.004262+0000","last_active":"2023-10-03T10:09:46.351237+0000","last_peered":"2023-10-03T10:09:46.351237+0000","last_clean":"2023-10-03T10:09:46.351237+0000","last_became_active":"2023-10-03T10:09:46.004006+0000","last_became_peered":"2023-10-03T10:09:46.004006+0000","last_unstale":"2023-10-03T10:09:46.351237+0000","last_undegraded":"2023-10-03T10:09:46.351237+0000","last_fullsized":"2023-10-03T10:09:46.351237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377866+0000","last_change":"2023-10-03T10:09:46.369027+0000","last_active":"2023-10-03T10:09:46.377866+0000","last_peered":"2023-10-03T10:09:46.377866+0000","last_clean":"2023-10-03T10:09:46.377866+0000","last_became_active":"2023-10-03T10:09:46.368802+0000","last_became_peered":"2023-10-03T10:09:46.368802+0000","last_unstale":"2023-10-03T10:09:46.377866+0000","last_undegraded":"2023-10-03T10:09:46.377866+0000","last_fullsized":"2023-10-03T10:09:46.377866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.370555+0000","last_change":"2023-10-03T10:09:46.003890+0000","last_active":"2023-10-03T10:09:46.370555+0000","last_peered":"2023-10-03T10:09:46.370555+0000","last_clean":"2023-10-03T10:09:46.370555+0000","last_became_active":"2023-10-03T10:09:46.002821+0000","last_became_peered":"2023-10-03T10:09:46.002821+0000","last_unstale":"2023-10-03T10:09:46.370555+0000","last_undegraded":"2023-10-03T10:09:46.370555+0000","last_fullsized":"2023-10-03T10:09:46.370555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.391996+0000","last_change":"2023-10-03T10:09:46.383127+0000","last_active":"2023-10-03T10:09:46.391996+0000","last_peered":"2023-10-03T10:09:46.391996+0000","last_clean":"2023-10-03T10:09:46.391996+0000","last_became_active":"2023-10-03T10:09:46.374331+0000","last_became_peered":"2023-10-03T10:09:46.374331+0000","last_unstale":"2023-10-03T10:09:46.391996+0000","last_undegraded":"2023-10-03T10:09:46.391996+0000","last_fullsized":"2023-10-03T10:09:46.391996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354415+0000","last_change":"2023-10-03T10:09:46.002155+0000","last_active":"2023-10-03T10:09:46.354415+0000","last_peered":"2023-10-03T10:09:46.354415+0000","last_clean":"2023-10-03T10:09:46.354415+0000","last_became_active":"2023-10-03T10:09:46.001872+0000","last_became_peered":"2023-10-03T10:09:46.001872+0000","last_unstale":"2023-10-03T10:09:46.354415+0000","last_undegraded":"2023-10-03T10:09:46.354415+0000","last_fullsized":"2023-10-03T10:09:46.354415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387900+0000","last_change":"2023-10-03T10:09:46.378713+0000","last_active":"2023-10-03T10:09:46.387900+0000","last_peered":"2023-10-03T10:09:46.387900+0000","last_clean":"2023-10-03T10:09:46.387900+0000","last_became_active":"2023-10-03T10:09:46.378310+0000","last_became_peered":"2023-10-03T10:09:46.378310+0000","last_unstale":"2023-10-03T10:09:46.387900+0000","last_undegraded":"2023-10-03T10:09:46.387900+0000","last_fullsized":"2023-10-03T10:09:46.387900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.395252+0000","last_change":"2023-10-03T10:09:46.001705+0000","last_active":"2023-10-03T10:09:46.395252+0000","last_peered":"2023-10-03T10:09:46.395252+0000","last_clean":"2023-10-03T10:09:46.395252+0000","last_became_active":"2023-10-03T10:09:46.001338+0000","last_became_peered":"2023-10-03T10:09:46.001338+0000","last_unstale":"2023-10-03T10:09:46.395252+0000","last_undegraded":"2023-10-03T10:09:46.395252+0000","last_fullsized":"2023-10-03T10:09:46.395252+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.397119+0000","last_change":"2023-10-03T10:09:46.392590+0000","last_active":"2023-10-03T10:09:46.397119+0000","last_peered":"2023-10-03T10:09:46.397119+0000","last_clean":"2023-10-03T10:09:46.397119+0000","last_became_active":"2023-10-03T10:09:46.392268+0000","last_became_peered":"2023-10-03T10:09:46.392268+0000","last_unstale":"2023-10-03T10:09:46.397119+0000","last_undegraded":"2023-10-03T10:09:46.397119+0000","last_fullsized":"2023-10-03T10:09:46.397119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.397652+0000","last_change":"2023-10-03T10:09:45.995310+0000","last_active":"2023-10-03T10:09:46.397652+0000","last_peered":"2023-10-03T10:09:46.397652+0000","last_clean":"2023-10-03T10:09:46.397652+0000","last_became_active":"2023-10-03T10:09:45.995040+0000","last_became_peered":"2023-10-03T10:09:45.995040+0000","last_unstale":"2023-10-03T10:09:46.397652+0000","last_undegraded":"2023-10-03T10:09:46.397652+0000","last_fullsized":"2023-10-03T10:09:46.397652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388193+0000","last_change":"2023-10-03T10:09:46.385651+0000","last_active":"2023-10-03T10:09:46.388193+0000","last_peered":"2023-10-03T10:09:46.388193+0000","last_clean":"2023-10-03T10:09:46.388193+0000","last_became_active":"2023-10-03T10:09:46.383900+0000","last_became_peered":"2023-10-03T10:09:46.383900+0000","last_unstale":"2023-10-03T10:09:46.388193+0000","last_undegraded":"2023-10-03T10:09:46.388193+0000","last_fullsized":"2023-10-03T10:09:46.388193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.391818+0000","last_change":"2023-10-03T10:09:46.008019+0000","last_active":"2023-10-03T10:09:46.391818+0000","last_peered":"2023-10-03T10:09:46.391818+0000","last_clean":"2023-10-03T10:09:46.391818+0000","last_became_active":"2023-10-03T10:09:46.007374+0000","last_became_peered":"2023-10-03T10:09:46.007374+0000","last_unstale":"2023-10-03T10:09:46.391818+0000","last_undegraded":"2023-10-03T10:09:46.391818+0000","last_fullsized":"2023-10-03T10:09:46.391818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.391740+0000","last_change":"2023-10-03T10:09:46.382625+0000","last_active":"2023-10-03T10:09:46.391740+0000","last_peered":"2023-10-03T10:09:46.391740+0000","last_clean":"2023-10-03T10:09:46.391740+0000","last_became_active":"2023-10-03T10:09:46.382352+0000","last_became_peered":"2023-10-03T10:09:46.382352+0000","last_unstale":"2023-10-03T10:09:46.391740+0000","last_undegraded":"2023-10-03T10:09:46.391740+0000","last_fullsized":"2023-10-03T10:09:46.391740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.364595+0000","last_change":"2023-10-03T10:09:45.999722+0000","last_active":"2023-10-03T10:09:46.364595+0000","last_peered":"2023-10-03T10:09:46.364595+0000","last_clean":"2023-10-03T10:09:46.364595+0000","last_became_active":"2023-10-03T10:09:45.999450+0000","last_became_peered":"2023-10-03T10:09:45.999450+0000","last_unstale":"2023-10-03T10:09:46.364595+0000","last_undegraded":"2023-10-03T10:09:46.364595+0000","last_fullsized":"2023-10-03T10:09:46.364595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392163+0000","last_change":"2023-10-03T10:09:46.384495+0000","last_active":"2023-10-03T10:09:46.392163+0000","last_peered":"2023-10-03T10:09:46.392163+0000","last_clean":"2023-10-03T10:09:46.392163+0000","last_became_active":"2023-10-03T10:09:46.383160+0000","last_became_peered":"2023-10-03T10:09:46.383160+0000","last_unstale":"2023-10-03T10:09:46.392163+0000","last_undegraded":"2023-10-03T10:09:46.392163+0000","last_fullsized":"2023-10-03T10:09:46.392163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354617+0000","last_change":"2023-10-03T10:09:46.002469+0000","last_active":"2023-10-03T10:09:46.354617+0000","last_peered":"2023-10-03T10:09:46.354617+0000","last_clean":"2023-10-03T10:09:46.354617+0000","last_became_active":"2023-10-03T10:09:46.002179+0000","last_became_peered":"2023-10-03T10:09:46.002179+0000","last_unstale":"2023-10-03T10:09:46.354617+0000","last_undegraded":"2023-10-03T10:09:46.354617+0000","last_fullsized":"2023-10-03T10:09:46.354617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381433+0000","last_change":"2023-10-03T10:09:46.379295+0000","last_active":"2023-10-03T10:09:46.381433+0000","last_peered":"2023-10-03T10:09:46.381433+0000","last_clean":"2023-10-03T10:09:46.381433+0000","last_became_active":"2023-10-03T10:09:46.370639+0000","last_became_peered":"2023-10-03T10:09:46.370639+0000","last_unstale":"2023-10-03T10:09:46.381433+0000","last_undegraded":"2023-10-03T10:09:46.381433+0000","last_fullsized":"2023-10-03T10:09:46.381433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377345+0000","last_change":"2023-10-03T10:09:45.991739+0000","last_active":"2023-10-03T10:09:46.377345+0000","last_peered":"2023-10-03T10:09:46.377345+0000","last_clean":"2023-10-03T10:09:46.377345+0000","last_became_active":"2023-10-03T10:09:45.991195+0000","last_became_peered":"2023-10-03T10:09:45.991195+0000","last_unstale":"2023-10-03T10:09:46.377345+0000","last_undegraded":"2023-10-03T10:09:46.377345+0000","last_fullsized":"2023-10-03T10:09:46.377345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377898+0000","last_change":"2023-10-03T10:09:46.369391+0000","last_active":"2023-10-03T10:09:46.377898+0000","last_peered":"2023-10-03T10:09:46.377898+0000","last_clean":"2023-10-03T10:09:46.377898+0000","last_became_active":"2023-10-03T10:09:46.367938+0000","last_became_peered":"2023-10-03T10:09:46.367938+0000","last_unstale":"2023-10-03T10:09:46.377898+0000","last_undegraded":"2023-10-03T10:09:46.377898+0000","last_fullsized":"2023-10-03T10:09:46.377898+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381508+0000","last_change":"2023-10-03T10:09:46.004494+0000","last_active":"2023-10-03T10:09:46.381508+0000","last_peered":"2023-10-03T10:09:46.381508+0000","last_clean":"2023-10-03T10:09:46.381508+0000","last_became_active":"2023-10-03T10:09:46.004166+0000","last_became_peered":"2023-10-03T10:09:46.004166+0000","last_unstale":"2023-10-03T10:09:46.381508+0000","last_undegraded":"2023-10-03T10:09:46.381508+0000","last_fullsized":"2023-10-03T10:09:46.381508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392301+0000","last_change":"2023-10-03T10:09:46.383361+0000","last_active":"2023-10-03T10:09:46.392301+0000","last_peered":"2023-10-03T10:09:46.392301+0000","last_clean":"2023-10-03T10:09:46.392301+0000","last_became_active":"2023-10-03T10:09:46.378076+0000","last_became_peered":"2023-10-03T10:09:46.378076+0000","last_unstale":"2023-10-03T10:09:46.392301+0000","last_undegraded":"2023-10-03T10:09:46.392301+0000","last_fullsized":"2023-10-03T10:09:46.392301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.372772+0000","last_change":"2023-10-03T10:09:45.995572+0000","last_active":"2023-10-03T10:09:46.372772+0000","last_peered":"2023-10-03T10:09:46.372772+0000","last_clean":"2023-10-03T10:09:46.372772+0000","last_became_active":"2023-10-03T10:09:45.995093+0000","last_became_peered":"2023-10-03T10:09:45.995093+0000","last_unstale":"2023-10-03T10:09:46.372772+0000","last_undegraded":"2023-10-03T10:09:46.372772+0000","last_fullsized":"2023-10-03T10:09:46.372772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366121+0000","last_change":"2023-10-03T10:09:46.362868+0000","last_active":"2023-10-03T10:09:46.366121+0000","last_peered":"2023-10-03T10:09:46.366121+0000","last_clean":"2023-10-03T10:09:46.366121+0000","last_became_active":"2023-10-03T10:09:46.362550+0000","last_became_peered":"2023-10-03T10:09:46.362550+0000","last_unstale":"2023-10-03T10:09:46.366121+0000","last_undegraded":"2023-10-03T10:09:46.366121+0000","last_fullsized":"2023-10-03T10:09:46.366121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.394684+0000","last_change":"2023-10-03T10:09:46.007310+0000","last_active":"2023-10-03T10:09:46.394684+0000","last_peered":"2023-10-03T10:09:46.394684+0000","last_clean":"2023-10-03T10:09:46.394684+0000","last_became_active":"2023-10-03T10:09:46.007002+0000","last_became_peered":"2023-10-03T10:09:46.007002+0000","last_unstale":"2023-10-03T10:09:46.394684+0000","last_undegraded":"2023-10-03T10:09:46.394684+0000","last_fullsized":"2023-10-03T10:09:46.394684+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388581+0000","last_change":"2023-10-03T10:09:46.387104+0000","last_active":"2023-10-03T10:09:46.388581+0000","last_peered":"2023-10-03T10:09:46.388581+0000","last_clean":"2023-10-03T10:09:46.388581+0000","last_became_active":"2023-10-03T10:09:46.386697+0000","last_became_peered":"2023-10-03T10:09:46.386697+0000","last_unstale":"2023-10-03T10:09:46.388581+0000","last_undegraded":"2023-10-03T10:09:46.388581+0000","last_fullsized":"2023-10-03T10:09:46.388581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.365183+0000","last_change":"2023-10-03T10:09:46.001474+0000","last_active":"2023-10-03T10:09:46.365183+0000","last_peered":"2023-10-03T10:09:46.365183+0000","last_clean":"2023-10-03T10:09:46.365183+0000","last_became_active":"2023-10-03T10:09:46.001185+0000","last_became_peered":"2023-10-03T10:09:46.001185+0000","last_unstale":"2023-10-03T10:09:46.365183+0000","last_undegraded":"2023-10-03T10:09:46.365183+0000","last_fullsized":"2023-10-03T10:09:46.365183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381334+0000","last_change":"2023-10-03T10:09:46.378394+0000","last_active":"2023-10-03T10:09:46.381334+0000","last_peered":"2023-10-03T10:09:46.381334+0000","last_clean":"2023-10-03T10:09:46.381334+0000","last_became_active":"2023-10-03T10:09:46.378115+0000","last_became_peered":"2023-10-03T10:09:46.378115+0000","last_unstale":"2023-10-03T10:09:46.381334+0000","last_undegraded":"2023-10-03T10:09:46.381334+0000","last_fullsized":"2023-10-03T10:09:46.381334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392154+0000","last_change":"2023-10-03T10:09:46.008210+0000","last_active":"2023-10-03T10:09:46.392154+0000","last_peered":"2023-10-03T10:09:46.392154+0000","last_clean":"2023-10-03T10:09:46.392154+0000","last_became_active":"2023-10-03T10:09:46.007750+0000","last_became_peered":"2023-10-03T10:09:46.007750+0000","last_unstale":"2023-10-03T10:09:46.392154+0000","last_undegraded":"2023-10-03T10:09:46.392154+0000","last_fullsized":"2023-10-03T10:09:46.392154+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387177+0000","last_change":"2023-10-03T10:09:46.385399+0000","last_active":"2023-10-03T10:09:46.387177+0000","last_peered":"2023-10-03T10:09:46.387177+0000","last_clean":"2023-10-03T10:09:46.387177+0000","last_became_active":"2023-10-03T10:09:46.385110+0000","last_became_peered":"2023-10-03T10:09:46.385110+0000","last_unstale":"2023-10-03T10:09:46.387177+0000","last_undegraded":"2023-10-03T10:09:46.387177+0000","last_fullsized":"2023-10-03T10:09:46.387177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352988+0000","last_change":"2023-10-03T10:09:46.007708+0000","last_active":"2023-10-03T10:09:46.352988+0000","last_peered":"2023-10-03T10:09:46.352988+0000","last_clean":"2023-10-03T10:09:46.352988+0000","last_became_active":"2023-10-03T10:09:46.006141+0000","last_became_peered":"2023-10-03T10:09:46.006141+0000","last_unstale":"2023-10-03T10:09:46.352988+0000","last_undegraded":"2023-10-03T10:09:46.352988+0000","last_fullsized":"2023-10-03T10:09:46.352988+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.369876+0000","last_change":"2023-10-03T10:09:46.367623+0000","last_active":"2023-10-03T10:09:46.369876+0000","last_peered":"2023-10-03T10:09:46.369876+0000","last_clean":"2023-10-03T10:09:46.369876+0000","last_became_active":"2023-10-03T10:09:46.367337+0000","last_became_peered":"2023-10-03T10:09:46.367337+0000","last_unstale":"2023-10-03T10:09:46.369876+0000","last_undegraded":"2023-10-03T10:09:46.369876+0000","last_fullsized":"2023-10-03T10:09:46.369876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354145+0000","last_change":"2023-10-03T10:09:46.002433+0000","last_active":"2023-10-03T10:09:46.354145+0000","last_peered":"2023-10-03T10:09:46.354145+0000","last_clean":"2023-10-03T10:09:46.354145+0000","last_became_active":"2023-10-03T10:09:46.002135+0000","last_became_peered":"2023-10-03T10:09:46.002135+0000","last_unstale":"2023-10-03T10:09:46.354145+0000","last_undegraded":"2023-10-03T10:09:46.354145+0000","last_fullsized":"2023-10-03T10:09:46.354145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.389051+0000","last_change":"2023-10-03T10:09:46.387220+0000","last_active":"2023-10-03T10:09:46.389051+0000","last_peered":"2023-10-03T10:09:46.389051+0000","last_clean":"2023-10-03T10:09:46.389051+0000","last_became_active":"2023-10-03T10:09:46.384091+0000","last_became_peered":"2023-10-03T10:09:46.384091+0000","last_unstale":"2023-10-03T10:09:46.389051+0000","last_undegraded":"2023-10-03T10:09:46.389051+0000","last_fullsized":"2023-10-03T10:09:46.389051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.350749+0000","last_change":"2023-10-03T10:09:46.008899+0000","last_active":"2023-10-03T10:09:46.350749+0000","last_peered":"2023-10-03T10:09:46.350749+0000","last_clean":"2023-10-03T10:09:46.350749+0000","last_became_active":"2023-10-03T10:09:46.006123+0000","last_became_peered":"2023-10-03T10:09:46.006123+0000","last_unstale":"2023-10-03T10:09:46.350749+0000","last_undegraded":"2023-10-03T10:09:46.350749+0000","last_fullsized":"2023-10-03T10:09:46.350749+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377212+0000","last_change":"2023-10-03T10:09:46.367086+0000","last_active":"2023-10-03T10:09:46.377212+0000","last_peered":"2023-10-03T10:09:46.377212+0000","last_clean":"2023-10-03T10:09:46.377212+0000","last_became_active":"2023-10-03T10:09:46.366505+0000","last_became_peered":"2023-10-03T10:09:46.366505+0000","last_unstale":"2023-10-03T10:09:46.377212+0000","last_undegraded":"2023-10-03T10:09:46.377212+0000","last_fullsized":"2023-10-03T10:09:46.377212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.355579+0000","last_change":"2023-10-03T10:09:42.503202+0000","last_active":"2023-10-03T10:09:46.355579+0000","last_peered":"2023-10-03T10:09:46.355579+0000","last_clean":"2023-10-03T10:09:46.355579+0000","last_became_active":"2023-10-03T10:09:42.502700+0000","last_became_peered":"2023-10-03T10:09:42.502700+0000","last_unstale":"2023-10-03T10:09:46.355579+0000","last_undegraded":"2023-10-03T10:09:46.355579+0000","last_fullsized":"2023-10-03T10:09:46.355579+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352129+0000","last_change":"2023-10-03T10:09:45.995268+0000","last_active":"2023-10-03T10:09:46.352129+0000","last_peered":"2023-10-03T10:09:46.352129+0000","last_clean":"2023-10-03T10:09:46.352129+0000","last_became_active":"2023-10-03T10:09:45.994970+0000","last_became_peered":"2023-10-03T10:09:45.994970+0000","last_unstale":"2023-10-03T10:09:46.352129+0000","last_undegraded":"2023-10-03T10:09:46.352129+0000","last_fullsized":"2023-10-03T10:09:46.352129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.397141+0000","last_change":"2023-10-03T10:09:46.393198+0000","last_active":"2023-10-03T10:09:46.397141+0000","last_peered":"2023-10-03T10:09:46.397141+0000","last_clean":"2023-10-03T10:09:46.397141+0000","last_became_active":"2023-10-03T10:09:46.392876+0000","last_became_peered":"2023-10-03T10:09:46.392876+0000","last_unstale":"2023-10-03T10:09:46.397141+0000","last_undegraded":"2023-10-03T10:09:46.397141+0000","last_fullsized":"2023-10-03T10:09:46.397141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.355582+0000","last_change":"2023-10-03T10:09:41.940609+0000","last_active":"2023-10-03T10:09:46.355582+0000","last_peered":"2023-10-03T10:09:46.355582+0000","last_clean":"2023-10-03T10:09:46.355582+0000","last_became_active":"2023-10-03T10:09:41.940313+0000","last_became_peered":"2023-10-03T10:09:41.940313+0000","last_unstale":"2023-10-03T10:09:46.355582+0000","last_undegraded":"2023-10-03T10:09:46.355582+0000","last_fullsized":"2023-10-03T10:09:46.355582+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.364759+0000","last_change":"2023-10-03T10:09:45.987289+0000","last_active":"2023-10-03T10:09:46.364759+0000","last_peered":"2023-10-03T10:09:46.364759+0000","last_clean":"2023-10-03T10:09:46.364759+0000","last_became_active":"2023-10-03T10:09:45.987013+0000","last_became_peered":"2023-10-03T10:09:45.987013+0000","last_unstale":"2023-10-03T10:09:46.364759+0000","last_undegraded":"2023-10-03T10:09:46.364759+0000","last_fullsized":"2023-10-03T10:09:46.364759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377619+0000","last_change":"2023-10-03T10:09:46.371416+0000","last_active":"2023-10-03T10:09:46.377619+0000","last_peered":"2023-10-03T10:09:46.377619+0000","last_clean":"2023-10-03T10:09:46.377619+0000","last_became_active":"2023-10-03T10:09:46.370977+0000","last_became_peered":"2023-10-03T10:09:46.370977+0000","last_unstale":"2023-10-03T10:09:46.377619+0000","last_undegraded":"2023-10-03T10:09:46.377619+0000","last_fullsized":"2023-10-03T10:09:46.377619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352788+0000","last_change":"2023-10-03T10:09:41.940436+0000","last_active":"2023-10-03T10:09:46.352788+0000","last_peered":"2023-10-03T10:09:46.352788+0000","last_clean":"2023-10-03T10:09:46.352788+0000","last_became_active":"2023-10-03T10:09:41.940147+0000","last_became_peered":"2023-10-03T10:09:41.940147+0000","last_unstale":"2023-10-03T10:09:46.352788+0000","last_undegraded":"2023-10-03T10:09:46.352788+0000","last_fullsized":"2023-10-03T10:09:46.352788+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354234+0000","last_change":"2023-10-03T10:09:45.994184+0000","last_active":"2023-10-03T10:09:46.354234+0000","last_peered":"2023-10-03T10:09:46.354234+0000","last_clean":"2023-10-03T10:09:46.354234+0000","last_became_active":"2023-10-03T10:09:45.993699+0000","last_became_peered":"2023-10-03T10:09:45.993699+0000","last_unstale":"2023-10-03T10:09:46.354234+0000","last_undegraded":"2023-10-03T10:09:46.354234+0000","last_fullsized":"2023-10-03T10:09:46.354234+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377610+0000","last_change":"2023-10-03T10:09:46.372991+0000","last_active":"2023-10-03T10:09:46.377610+0000","last_peered":"2023-10-03T10:09:46.377610+0000","last_clean":"2023-10-03T10:09:46.377610+0000","last_became_active":"2023-10-03T10:09:46.372753+0000","last_became_peered":"2023-10-03T10:09:46.372753+0000","last_unstale":"2023-10-03T10:09:46.377610+0000","last_undegraded":"2023-10-03T10:09:46.377610+0000","last_fullsized":"2023-10-03T10:09:46.377610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352947+0000","last_change":"2023-10-03T10:09:41.941185+0000","last_active":"2023-10-03T10:09:46.352947+0000","last_peered":"2023-10-03T10:09:46.352947+0000","last_clean":"2023-10-03T10:09:46.352947+0000","last_became_active":"2023-10-03T10:09:41.940930+0000","last_became_peered":"2023-10-03T10:09:41.940930+0000","last_unstale":"2023-10-03T10:09:46.352947+0000","last_undegraded":"2023-10-03T10:09:46.352947+0000","last_fullsized":"2023-10-03T10:09:46.352947+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354131+0000","last_change":"2023-10-03T10:09:40.948442+0000","last_active":"2023-10-03T10:09:46.354131+0000","last_peered":"2023-10-03T10:09:46.354131+0000","last_clean":"2023-10-03T10:09:46.354131+0000","last_became_active":"2023-10-03T10:09:40.948068+0000","last_became_peered":"2023-10-03T10:09:40.948068+0000","last_unstale":"2023-10-03T10:09:46.354131+0000","last_undegraded":"2023-10-03T10:09:46.354131+0000","last_fullsized":"2023-10-03T10:09:46.354131+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_clean_scrub_stamp":"2023-10-03T10:09:39.928111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352898+0000","last_change":"2023-10-03T10:09:45.999685+0000","last_active":"2023-10-03T10:09:46.352898+0000","last_peered":"2023-10-03T10:09:46.352898+0000","last_clean":"2023-10-03T10:09:46.352898+0000","last_became_active":"2023-10-03T10:09:45.999343+0000","last_became_peered":"2023-10-03T10:09:45.999343+0000","last_unstale":"2023-10-03T10:09:46.352898+0000","last_undegraded":"2023-10-03T10:09:46.352898+0000","last_fullsized":"2023-10-03T10:09:46.352898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.384365+0000","last_change":"2023-10-03T10:09:46.367761+0000","last_active":"2023-10-03T10:09:46.384365+0000","last_peered":"2023-10-03T10:09:46.384365+0000","last_clean":"2023-10-03T10:09:46.384365+0000","last_became_active":"2023-10-03T10:09:46.367362+0000","last_became_peered":"2023-10-03T10:09:46.367362+0000","last_unstale":"2023-10-03T10:09:46.384365+0000","last_undegraded":"2023-10-03T10:09:46.384365+0000","last_fullsized":"2023-10-03T10:09:46.384365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.351142+0000","last_change":"2023-10-03T10:09:41.940561+0000","last_active":"2023-10-03T10:09:46.351142+0000","last_peered":"2023-10-03T10:09:46.351142+0000","last_clean":"2023-10-03T10:09:46.351142+0000","last_became_active":"2023-10-03T10:09:41.940202+0000","last_became_peered":"2023-10-03T10:09:41.940202+0000","last_unstale":"2023-10-03T10:09:46.351142+0000","last_undegraded":"2023-10-03T10:09:46.351142+0000","last_fullsized":"2023-10-03T10:09:46.351142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.367791+0000","last_change":"2023-10-03T10:09:45.987278+0000","last_active":"2023-10-03T10:09:46.367791+0000","last_peered":"2023-10-03T10:09:46.367791+0000","last_clean":"2023-10-03T10:09:46.367791+0000","last_became_active":"2023-10-03T10:09:45.986993+0000","last_became_peered":"2023-10-03T10:09:45.986993+0000","last_unstale":"2023-10-03T10:09:46.367791+0000","last_undegraded":"2023-10-03T10:09:46.367791+0000","last_fullsized":"2023-10-03T10:09:46.367791+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381370+0000","last_change":"2023-10-03T10:09:46.378722+0000","last_active":"2023-10-03T10:09:46.381370+0000","last_peered":"2023-10-03T10:09:46.381370+0000","last_clean":"2023-10-03T10:09:46.381370+0000","last_became_active":"2023-10-03T10:09:46.378186+0000","last_became_peered":"2023-10-03T10:09:46.378186+0000","last_unstale":"2023-10-03T10:09:46.381370+0000","last_undegraded":"2023-10-03T10:09:46.381370+0000","last_fullsized":"2023-10-03T10:09:46.381370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354254+0000","last_change":"2023-10-03T10:09:42.502984+0000","last_active":"2023-10-03T10:09:46.354254+0000","last_peered":"2023-10-03T10:09:46.354254+0000","last_clean":"2023-10-03T10:09:46.354254+0000","last_became_active":"2023-10-03T10:09:42.502699+0000","last_became_peered":"2023-10-03T10:09:42.502699+0000","last_unstale":"2023-10-03T10:09:46.354254+0000","last_undegraded":"2023-10-03T10:09:46.354254+0000","last_fullsized":"2023-10-03T10:09:46.354254+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.355380+0000","last_change":"2023-10-03T10:09:45.995626+0000","last_active":"2023-10-03T10:09:46.355380+0000","last_peered":"2023-10-03T10:09:46.355380+0000","last_clean":"2023-10-03T10:09:46.355380+0000","last_became_active":"2023-10-03T10:09:45.995322+0000","last_became_peered":"2023-10-03T10:09:45.995322+0000","last_unstale":"2023-10-03T10:09:46.355380+0000","last_undegraded":"2023-10-03T10:09:46.355380+0000","last_fullsized":"2023-10-03T10:09:46.355380+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.375920+0000","last_change":"2023-10-03T10:09:46.371217+0000","last_active":"2023-10-03T10:09:46.375920+0000","last_peered":"2023-10-03T10:09:46.375920+0000","last_clean":"2023-10-03T10:09:46.375920+0000","last_became_active":"2023-10-03T10:09:46.370285+0000","last_became_peered":"2023-10-03T10:09:46.370285+0000","last_unstale":"2023-10-03T10:09:46.375920+0000","last_undegraded":"2023-10-03T10:09:46.375920+0000","last_fullsized":"2023-10-03T10:09:46.375920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.383433+0000","last_change":"2023-10-03T10:09:46.006819+0000","last_active":"2023-10-03T10:09:46.383433+0000","last_peered":"2023-10-03T10:09:46.383433+0000","last_clean":"2023-10-03T10:09:46.383433+0000","last_became_active":"2023-10-03T10:09:46.006524+0000","last_became_peered":"2023-10-03T10:09:46.006524+0000","last_unstale":"2023-10-03T10:09:46.383433+0000","last_undegraded":"2023-10-03T10:09:46.383433+0000","last_fullsized":"2023-10-03T10:09:46.383433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.350860+0000","last_change":"2023-10-03T10:09:42.503022+0000","last_active":"2023-10-03T10:09:46.350860+0000","last_peered":"2023-10-03T10:09:46.350860+0000","last_clean":"2023-10-03T10:09:46.350860+0000","last_became_active":"2023-10-03T10:09:42.502739+0000","last_became_peered":"2023-10-03T10:09:42.502739+0000","last_unstale":"2023-10-03T10:09:46.350860+0000","last_undegraded":"2023-10-03T10:09:46.350860+0000","last_fullsized":"2023-10-03T10:09:46.350860+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392320+0000","last_change":"2023-10-03T10:09:46.383732+0000","last_active":"2023-10-03T10:09:46.392320+0000","last_peered":"2023-10-03T10:09:46.392320+0000","last_clean":"2023-10-03T10:09:46.392320+0000","last_became_active":"2023-10-03T10:09:46.374186+0000","last_became_peered":"2023-10-03T10:09:46.374186+0000","last_unstale":"2023-10-03T10:09:46.392320+0000","last_undegraded":"2023-10-03T10:09:46.392320+0000","last_fullsized":"2023-10-03T10:09:46.392320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.353582+0000","last_change":"2023-10-03T10:09:42.503368+0000","last_active":"2023-10-03T10:09:46.353582+0000","last_peered":"2023-10-03T10:09:46.353582+0000","last_clean":"2023-10-03T10:09:46.353582+0000","last_became_active":"2023-10-03T10:09:42.503090+0000","last_became_peered":"2023-10-03T10:09:42.503090+0000","last_unstale":"2023-10-03T10:09:46.353582+0000","last_undegraded":"2023-10-03T10:09:46.353582+0000","last_fullsized":"2023-10-03T10:09:46.353582+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.219487+0000","last_change":"2023-10-03T10:09:46.003516+0000","last_active":"2023-10-03T10:09:48.219487+0000","last_peered":"2023-10-03T10:09:48.219487+0000","last_clean":"2023-10-03T10:09:48.219487+0000","last_became_active":"2023-10-03T10:09:46.003227+0000","last_became_peered":"2023-10-03T10:09:46.003227+0000","last_unstale":"2023-10-03T10:09:48.219487+0000","last_undegraded":"2023-10-03T10:09:48.219487+0000","last_fullsized":"2023-10-03T10:09:48.219487+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366737+0000","last_change":"2023-10-03T10:09:46.365107+0000","last_active":"2023-10-03T10:09:46.366737+0000","last_peered":"2023-10-03T10:09:46.366737+0000","last_clean":"2023-10-03T10:09:46.366737+0000","last_became_active":"2023-10-03T10:09:46.364877+0000","last_became_peered":"2023-10-03T10:09:46.364877+0000","last_unstale":"2023-10-03T10:09:46.366737+0000","last_undegraded":"2023-10-03T10:09:46.366737+0000","last_fullsized":"2023-10-03T10:09:46.366737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388998+0000","last_change":"2023-10-03T10:09:46.003786+0000","last_active":"2023-10-03T10:09:46.388998+0000","last_peered":"2023-10-03T10:09:46.388998+0000","last_clean":"2023-10-03T10:09:46.388998+0000","last_became_active":"2023-10-03T10:09:46.003506+0000","last_became_peered":"2023-10-03T10:09:46.003506+0000","last_unstale":"2023-10-03T10:09:46.388998+0000","last_undegraded":"2023-10-03T10:09:46.388998+0000","last_fullsized":"2023-10-03T10:09:46.388998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380939+0000","last_change":"2023-10-03T10:09:46.376808+0000","last_active":"2023-10-03T10:09:46.380939+0000","last_peered":"2023-10-03T10:09:46.380939+0000","last_clean":"2023-10-03T10:09:46.380939+0000","last_became_active":"2023-10-03T10:09:46.376414+0000","last_became_peered":"2023-10-03T10:09:46.376414+0000","last_unstale":"2023-10-03T10:09:46.380939+0000","last_undegraded":"2023-10-03T10:09:46.380939+0000","last_fullsized":"2023-10-03T10:09:46.380939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.374191+0000","last_change":"2023-10-03T10:09:45.992104+0000","last_active":"2023-10-03T10:09:46.374191+0000","last_peered":"2023-10-03T10:09:46.374191+0000","last_clean":"2023-10-03T10:09:46.374191+0000","last_became_active":"2023-10-03T10:09:45.991796+0000","last_became_peered":"2023-10-03T10:09:45.991796+0000","last_unstale":"2023-10-03T10:09:46.374191+0000","last_undegraded":"2023-10-03T10:09:46.374191+0000","last_fullsized":"2023-10-03T10:09:46.374191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387640+0000","last_change":"2023-10-03T10:09:46.384662+0000","last_active":"2023-10-03T10:09:46.387640+0000","last_peered":"2023-10-03T10:09:46.387640+0000","last_clean":"2023-10-03T10:09:46.387640+0000","last_became_active":"2023-10-03T10:09:46.384347+0000","last_became_peered":"2023-10-03T10:09:46.384347+0000","last_unstale":"2023-10-03T10:09:46.387640+0000","last_undegraded":"2023-10-03T10:09:46.387640+0000","last_fullsized":"2023-10-03T10:09:46.387640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.383719+0000","last_change":"2023-10-03T10:09:46.005018+0000","last_active":"2023-10-03T10:09:46.383719+0000","last_peered":"2023-10-03T10:09:46.383719+0000","last_clean":"2023-10-03T10:09:46.383719+0000","last_became_active":"2023-10-03T10:09:46.004611+0000","last_became_peered":"2023-10-03T10:09:46.004611+0000","last_unstale":"2023-10-03T10:09:46.383719+0000","last_undegraded":"2023-10-03T10:09:46.383719+0000","last_fullsized":"2023-10-03T10:09:46.383719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388600+0000","last_change":"2023-10-03T10:09:46.387130+0000","last_active":"2023-10-03T10:09:46.388600+0000","last_peered":"2023-10-03T10:09:46.388600+0000","last_clean":"2023-10-03T10:09:46.388600+0000","last_became_active":"2023-10-03T10:09:46.386801+0000","last_became_peered":"2023-10-03T10:09:46.386801+0000","last_unstale":"2023-10-03T10:09:46.388600+0000","last_undegraded":"2023-10-03T10:09:46.388600+0000","last_fullsized":"2023-10-03T10:09:46.388600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392142+0000","last_change":"2023-10-03T10:09:45.998407+0000","last_active":"2023-10-03T10:09:46.392142+0000","last_peered":"2023-10-03T10:09:46.392142+0000","last_clean":"2023-10-03T10:09:46.392142+0000","last_became_active":"2023-10-03T10:09:45.995915+0000","last_became_peered":"2023-10-03T10:09:45.995915+0000","last_unstale":"2023-10-03T10:09:46.392142+0000","last_undegraded":"2023-10-03T10:09:46.392142+0000","last_fullsized":"2023-10-03T10:09:46.392142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392233+0000","last_change":"2023-10-03T10:09:46.385531+0000","last_active":"2023-10-03T10:09:46.392233+0000","last_peered":"2023-10-03T10:09:46.392233+0000","last_clean":"2023-10-03T10:09:46.392233+0000","last_became_active":"2023-10-03T10:09:46.385289+0000","last_became_peered":"2023-10-03T10:09:46.385289+0000","last_unstale":"2023-10-03T10:09:46.392233+0000","last_undegraded":"2023-10-03T10:09:46.392233+0000","last_fullsized":"2023-10-03T10:09:46.392233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381665+0000","last_change":"2023-10-03T10:09:46.004241+0000","last_active":"2023-10-03T10:09:46.381665+0000","last_peered":"2023-10-03T10:09:46.381665+0000","last_clean":"2023-10-03T10:09:46.381665+0000","last_became_active":"2023-10-03T10:09:46.003370+0000","last_became_peered":"2023-10-03T10:09:46.003370+0000","last_unstale":"2023-10-03T10:09:46.381665+0000","last_undegraded":"2023-10-03T10:09:46.381665+0000","last_fullsized":"2023-10-03T10:09:46.381665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380871+0000","last_change":"2023-10-03T10:09:46.374808+0000","last_active":"2023-10-03T10:09:46.380871+0000","last_peered":"2023-10-03T10:09:46.380871+0000","last_clean":"2023-10-03T10:09:46.380871+0000","last_became_active":"2023-10-03T10:09:46.374363+0000","last_became_peered":"2023-10-03T10:09:46.374363+0000","last_unstale":"2023-10-03T10:09:46.380871+0000","last_undegraded":"2023-10-03T10:09:46.380871+0000","last_fullsized":"2023-10-03T10:09:46.380871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377400+0000","last_change":"2023-10-03T10:09:46.371026+0000","last_active":"2023-10-03T10:09:46.377400+0000","last_peered":"2023-10-03T10:09:46.377400+0000","last_clean":"2023-10-03T10:09:46.377400+0000","last_became_active":"2023-10-03T10:09:46.370725+0000","last_became_peered":"2023-10-03T10:09:46.370725+0000","last_unstale":"2023-10-03T10:09:46.377400+0000","last_undegraded":"2023-10-03T10:09:46.377400+0000","last_fullsized":"2023-10-03T10:09:46.377400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.369953+0000","last_change":"2023-10-03T10:09:46.368699+0000","last_active":"2023-10-03T10:09:46.369953+0000","last_peered":"2023-10-03T10:09:46.369953+0000","last_clean":"2023-10-03T10:09:46.369953+0000","last_became_active":"2023-10-03T10:09:46.367867+0000","last_became_peered":"2023-10-03T10:09:46.367867+0000","last_unstale":"2023-10-03T10:09:46.369953+0000","last_undegraded":"2023-10-03T10:09:46.369953+0000","last_fullsized":"2023-10-03T10:09:46.369953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387149+0000","last_change":"2023-10-03T10:09:46.385510+0000","last_active":"2023-10-03T10:09:46.387149+0000","last_peered":"2023-10-03T10:09:46.387149+0000","last_clean":"2023-10-03T10:09:46.387149+0000","last_became_active":"2023-10-03T10:09:46.385254+0000","last_became_peered":"2023-10-03T10:09:46.385254+0000","last_unstale":"2023-10-03T10:09:46.387149+0000","last_undegraded":"2023-10-03T10:09:46.387149+0000","last_fullsized":"2023-10-03T10:09:46.387149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.383009+0000","last_change":"2023-10-03T10:09:46.370858+0000","last_active":"2023-10-03T10:09:46.383009+0000","last_peered":"2023-10-03T10:09:46.383009+0000","last_clean":"2023-10-03T10:09:46.383009+0000","last_became_active":"2023-10-03T10:09:46.367104+0000","last_became_peered":"2023-10-03T10:09:46.367104+0000","last_unstale":"2023-10-03T10:09:46.383009+0000","last_undegraded":"2023-10-03T10:09:46.383009+0000","last_fullsized":"2023-10-03T10:09:46.383009+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377600+0000","last_change":"2023-10-03T10:09:46.371241+0000","last_active":"2023-10-03T10:09:46.377600+0000","last_peered":"2023-10-03T10:09:46.377600+0000","last_clean":"2023-10-03T10:09:46.377600+0000","last_became_active":"2023-10-03T10:09:46.370691+0000","last_became_peered":"2023-10-03T10:09:46.370691+0000","last_unstale":"2023-10-03T10:09:46.377600+0000","last_undegraded":"2023-10-03T10:09:46.377600+0000","last_fullsized":"2023-10-03T10:09:46.377600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":46930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:57.284 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:09:57.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.434+0000 7f740bb8b700 1 Processor -- start 2023-10-03T10:09:57.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.434+0000 7f740bb8b700 1 -- start start 2023-10-03T10:09:57.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.434+0000 7f740bb8b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f740412b510 0x7f740412ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.434+0000 7f740bb8b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74041303f0 0x7f74041327e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.434+0000 7f740bb8b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740412abd0 con 0x7f74040613a0 2023-10-03T10:09:57.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.434+0000 7f740bb8b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7404061780 con 0x7f74041303f0 2023-10-03T10:09:57.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.434+0000 7f740bb8b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7404067560 con 0x7f740412b510 2023-10-03T10:09:57.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.435+0000 7f7409126700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f740412b510 0x7f740412ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.435+0000 7f740a128700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74041303f0 0x7f74041327e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.435+0000 7f740a128700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74041303f0 0x7f74041327e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48180/0 (socket says 172.21.15.72:48180) 2023-10-03T10:09:57.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.435+0000 7f7409126700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f740412b510 0x7f740412ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59542/0 (socket says 172.21.15.72:59542) 2023-10-03T10:09:57.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.435+0000 7f7409927700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f74040613a0 0x7f740412ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41138/0 (socket says 172.21.15.72:41138) 2023-10-03T10:09:57.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.435+0000 7f740a128700 1 -- 172.21.15.72:0/1629190797 learned_addr learned my addr 172.21.15.72:0/1629190797 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:57.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.435+0000 7f740a128700 1 -- 172.21.15.72:0/1629190797 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f740412b510 msgr2=0x7f740412ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.435+0000 7f7408925700 1 -- 172.21.15.72:0/1629190797 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310288791 0 0) 0x7f740412abd0 con 0x7f74040613a0 2023-10-03T10:09:57.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.435+0000 7f740a128700 1 --2- 172.21.15.72:0/1629190797 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f740412b510 0x7f740412ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.435+0000 7f740a128700 1 -- 172.21.15.72:0/1629190797 >> v1:172.21.15.72:6789/0 conn(0x7f74040613a0 legacy=0x7f740412ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.435+0000 7f740a128700 1 -- 172.21.15.72:0/1629190797 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74040683c0 con 0x7f74041303f0 2023-10-03T10:09:57.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.435+0000 7f740a128700 1 --2- 172.21.15.72:0/1629190797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74041303f0 0x7f74041327e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f73fc009f80 tx=0x7f73fc009840).ready entity=mon.1 client_cookie=ad88625a73c37cda server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.435+0000 7f7408925700 1 -- 172.21.15.72:0/1629190797 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00e070 con 0x7f74041303f0 2023-10-03T10:09:57.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.435+0000 7f7408925700 1 -- 172.21.15.72:0/1629190797 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc00ba40 con 0x7f74041303f0 2023-10-03T10:09:57.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.435+0000 7f7408925700 1 -- 172.21.15.72:0/1629190797 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00bdc0 con 0x7f74041303f0 2023-10-03T10:09:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.436+0000 7f740bb8b700 1 -- 172.21.15.72:0/1629190797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74041303f0 msgr2=0x7f74041327e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.436+0000 7f740bb8b700 1 --2- 172.21.15.72:0/1629190797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74041303f0 0x7f74041327e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f73fc009f80 tx=0x7f73fc009840).stop 2023-10-03T10:09:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.436+0000 7f740bb8b700 1 -- 172.21.15.72:0/1629190797 shutdown_connections 2023-10-03T10:09:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.436+0000 7f740bb8b700 1 --2- 172.21.15.72:0/1629190797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74041303f0 0x7f74041327e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.436+0000 7f740bb8b700 1 --2- 172.21.15.72:0/1629190797 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f740412b510 0x7f740412ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.436+0000 7f740bb8b700 1 -- 172.21.15.72:0/1629190797 >> 172.21.15.72:0/1629190797 conn(0x7f740409a220 msgr2=0x7f740409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.436+0000 7f740bb8b700 1 -- 172.21.15.72:0/1629190797 shutdown_connections 2023-10-03T10:09:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.436+0000 7f740bb8b700 1 -- 172.21.15.72:0/1629190797 wait complete. 2023-10-03T10:09:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f740bb8b700 1 Processor -- start 2023-10-03T10:09:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f740bb8b700 1 -- start start 2023-10-03T10:09:57.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f740bb8b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74040613a0 0x7f740412a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f740bb8b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f740412b510 0x7f7404114660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f740bb8b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74041303f0 0x7f7404114b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f740bb8b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7404118150 con 0x7f74040613a0 2023-10-03T10:09:57.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f740bb8b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7404115a60 con 0x7f74041303f0 2023-10-03T10:09:57.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f740bb8b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7404067130 con 0x7f740412b510 2023-10-03T10:09:57.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f7409927700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74040613a0 0x7f740412a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f7409126700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f740412b510 0x7f7404114660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f7409927700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74040613a0 0x7f740412a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33428/0 (socket says 172.21.15.72:33428) 2023-10-03T10:09:57.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f7409927700 1 -- 172.21.15.72:0/3758715173 learned_addr learned my addr 172.21.15.72:0/3758715173 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:57.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f740a128700 1 --2- 172.21.15.72:0/3758715173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74041303f0 0x7f7404114b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f7409927700 1 -- 172.21.15.72:0/3758715173 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f740412b510 msgr2=0x7f7404114660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f7409927700 1 --2- 172.21.15.72:0/3758715173 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f740412b510 0x7f7404114660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f7409927700 1 -- 172.21.15.72:0/3758715173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74041303f0 msgr2=0x7f7404114b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f7409927700 1 --2- 172.21.15.72:0/3758715173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74041303f0 0x7f7404114b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.437+0000 7f7409927700 1 -- 172.21.15.72:0/3758715173 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc009ae0 con 0x7f74040613a0 2023-10-03T10:09:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.438+0000 7f7409927700 1 --2- 172.21.15.72:0/3758715173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74040613a0 0x7f740412a6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f740000c4c0 tx=0x7f7400007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.438+0000 7f73f9ffb700 1 -- 172.21.15.72:0/3758715173 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740000ce30 con 0x7f74040613a0 2023-10-03T10:09:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.438+0000 7f73f9ffb700 1 -- 172.21.15.72:0/3758715173 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74000072e0 con 0x7f74040613a0 2023-10-03T10:09:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.438+0000 7f740bb8b700 1 -- 172.21.15.72:0/3758715173 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74041300b0 con 0x7f74040613a0 2023-10-03T10:09:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.438+0000 7f73f9ffb700 1 -- 172.21.15.72:0/3758715173 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74000056e0 con 0x7f74040613a0 2023-10-03T10:09:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.438+0000 7f740bb8b700 1 -- 172.21.15.72:0/3758715173 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7404116240 con 0x7f74040613a0 2023-10-03T10:09:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.438+0000 7f73f9ffb700 1 -- 172.21.15.72:0/3758715173 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7400005a90 con 0x7f74040613a0 2023-10-03T10:09:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.439+0000 7f73f9ffb700 1 -- 172.21.15.72:0/3758715173 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f740003a640 con 0x7f74040613a0 2023-10-03T10:09:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.439+0000 7f740bb8b700 1 -- 172.21.15.72:0/3758715173 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7404117aa0 con 0x7f74040613a0 2023-10-03T10:09:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.443+0000 7f73f9ffb700 1 -- 172.21.15.72:0/3758715173 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f740001c350 con 0x7f74040613a0 2023-10-03T10:09:57.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.597+0000 7f740bb8b700 1 -- 172.21.15.72:0/3758715173 --> v1:172.21.15.72:6816/118184 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f740405a260 con 0x7f73e802bb90 2023-10-03T10:09:57.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.603+0000 7f73f9ffb700 1 -- 172.21.15.72:0/3758715173 <== mgr.4102 v1:172.21.15.72:6816/118184 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249969 (unknown 2965378022 0 1921904298) 0x7f740405a260 con 0x7f73e802bb90 2023-10-03T10:09:57.606 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:57.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.606+0000 7f740bb8b700 1 -- 172.21.15.72:0/3758715173 >> v1:172.21.15.72:6816/118184 conn(0x7f73e802bb90 legacy=0x7f73e802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.606+0000 7f740bb8b700 1 -- 172.21.15.72:0/3758715173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74040613a0 msgr2=0x7f740412a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.606+0000 7f740bb8b700 1 --2- 172.21.15.72:0/3758715173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74040613a0 0x7f740412a6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f740000c4c0 tx=0x7f7400007c10).stop 2023-10-03T10:09:57.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.606+0000 7f740bb8b700 1 -- 172.21.15.72:0/3758715173 shutdown_connections 2023-10-03T10:09:57.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.606+0000 7f740bb8b700 1 --2- 172.21.15.72:0/3758715173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74040613a0 0x7f740412a6c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.606+0000 7f740bb8b700 1 --2- 172.21.15.72:0/3758715173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74041303f0 0x7f7404114b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.606+0000 7f740bb8b700 1 --2- 172.21.15.72:0/3758715173 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f740412b510 0x7f7404114660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.606+0000 7f740bb8b700 1 -- 172.21.15.72:0/3758715173 >> 172.21.15.72:0/3758715173 conn(0x7f740409a220 msgr2=0x7f7404095df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.606+0000 7f740bb8b700 1 -- 172.21.15.72:0/3758715173 shutdown_connections 2023-10-03T10:09:57.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.606+0000 7f740bb8b700 1 -- 172.21.15.72:0/3758715173 wait complete. 2023-10-03T10:09:57.609 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-03T10:09:57.617 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-03T10:09:55.880118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189020,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298340,"statfs":{"total":386547056640,"available":385329500160,"internally_reserved":0,"allocated":651264,"data_stored":192439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1640,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001216"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387453+0000","last_change":"2023-10-03T10:09:46.383964+0000","last_active":"2023-10-03T10:09:46.387453+0000","last_peered":"2023-10-03T10:09:46.387453+0000","last_clean":"2023-10-03T10:09:46.387453+0000","last_became_active":"2023-10-03T10:09:46.383681+0000","last_became_peered":"2023-10-03T10:09:46.383681+0000","last_unstale":"2023-10-03T10:09:46.387453+0000","last_undegraded":"2023-10-03T10:09:46.387453+0000","last_fullsized":"2023-10-03T10:09:46.387453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380623+0000","last_change":"2023-10-03T10:09:46.369230+0000","last_active":"2023-10-03T10:09:46.380623+0000","last_peered":"2023-10-03T10:09:46.380623+0000","last_clean":"2023-10-03T10:09:46.380623+0000","last_became_active":"2023-10-03T10:09:46.368861+0000","last_became_peered":"2023-10-03T10:09:46.368861+0000","last_unstale":"2023-10-03T10:09:46.380623+0000","last_undegraded":"2023-10-03T10:09:46.380623+0000","last_fullsized":"2023-10-03T10:09:46.380623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381586+0000","last_change":"2023-10-03T10:09:46.379410+0000","last_active":"2023-10-03T10:09:46.381586+0000","last_peered":"2023-10-03T10:09:46.381586+0000","last_clean":"2023-10-03T10:09:46.381586+0000","last_became_active":"2023-10-03T10:09:46.379027+0000","last_became_peered":"2023-10-03T10:09:46.379027+0000","last_unstale":"2023-10-03T10:09:46.381586+0000","last_undegraded":"2023-10-03T10:09:46.381586+0000","last_fullsized":"2023-10-03T10:09:46.381586+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381478+0000","last_change":"2023-10-03T10:09:46.379505+0000","last_active":"2023-10-03T10:09:46.381478+0000","last_peered":"2023-10-03T10:09:46.381478+0000","last_clean":"2023-10-03T10:09:46.381478+0000","last_became_active":"2023-10-03T10:09:46.379187+0000","last_became_peered":"2023-10-03T10:09:46.379187+0000","last_unstale":"2023-10-03T10:09:46.381478+0000","last_undegraded":"2023-10-03T10:09:46.381478+0000","last_fullsized":"2023-10-03T10:09:46.381478+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381407+0000","last_change":"2023-10-03T10:09:46.379819+0000","last_active":"2023-10-03T10:09:46.381407+0000","last_peered":"2023-10-03T10:09:46.381407+0000","last_clean":"2023-10-03T10:09:46.381407+0000","last_became_active":"2023-10-03T10:09:46.379555+0000","last_became_peered":"2023-10-03T10:09:46.379555+0000","last_unstale":"2023-10-03T10:09:46.381407+0000","last_undegraded":"2023-10-03T10:09:46.381407+0000","last_fullsized":"2023-10-03T10:09:46.381407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392234+0000","last_change":"2023-10-03T10:09:46.385185+0000","last_active":"2023-10-03T10:09:46.392234+0000","last_peered":"2023-10-03T10:09:46.392234+0000","last_clean":"2023-10-03T10:09:46.392234+0000","last_became_active":"2023-10-03T10:09:46.384935+0000","last_became_peered":"2023-10-03T10:09:46.384935+0000","last_unstale":"2023-10-03T10:09:46.392234+0000","last_undegraded":"2023-10-03T10:09:46.392234+0000","last_fullsized":"2023-10-03T10:09:46.392234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387917+0000","last_change":"2023-10-03T10:09:46.378880+0000","last_active":"2023-10-03T10:09:46.387917+0000","last_peered":"2023-10-03T10:09:46.387917+0000","last_clean":"2023-10-03T10:09:46.387917+0000","last_became_active":"2023-10-03T10:09:46.375285+0000","last_became_peered":"2023-10-03T10:09:46.375285+0000","last_unstale":"2023-10-03T10:09:46.387917+0000","last_undegraded":"2023-10-03T10:09:46.387917+0000","last_fullsized":"2023-10-03T10:09:46.387917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380669+0000","last_change":"2023-10-03T10:09:46.375928+0000","last_active":"2023-10-03T10:09:46.380669+0000","last_peered":"2023-10-03T10:09:46.380669+0000","last_clean":"2023-10-03T10:09:46.380669+0000","last_became_active":"2023-10-03T10:09:46.375325+0000","last_became_peered":"2023-10-03T10:09:46.375325+0000","last_unstale":"2023-10-03T10:09:46.380669+0000","last_undegraded":"2023-10-03T10:09:46.380669+0000","last_fullsized":"2023-10-03T10:09:46.380669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381546+0000","last_change":"2023-10-03T10:09:46.379935+0000","last_active":"2023-10-03T10:09:46.381546+0000","last_peered":"2023-10-03T10:09:46.381546+0000","last_clean":"2023-10-03T10:09:46.381546+0000","last_became_active":"2023-10-03T10:09:46.379431+0000","last_became_peered":"2023-10-03T10:09:46.379431+0000","last_unstale":"2023-10-03T10:09:46.381546+0000","last_undegraded":"2023-10-03T10:09:46.381546+0000","last_fullsized":"2023-10-03T10:09:46.381546+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377432+0000","last_change":"2023-10-03T10:09:46.372991+0000","last_active":"2023-10-03T10:09:46.377432+0000","last_peered":"2023-10-03T10:09:46.377432+0000","last_clean":"2023-10-03T10:09:46.377432+0000","last_became_active":"2023-10-03T10:09:46.372738+0000","last_became_peered":"2023-10-03T10:09:46.372738+0000","last_unstale":"2023-10-03T10:09:46.377432+0000","last_undegraded":"2023-10-03T10:09:46.377432+0000","last_fullsized":"2023-10-03T10:09:46.377432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377393+0000","last_change":"2023-10-03T10:09:46.372532+0000","last_active":"2023-10-03T10:09:46.377393+0000","last_peered":"2023-10-03T10:09:46.377393+0000","last_clean":"2023-10-03T10:09:46.377393+0000","last_became_active":"2023-10-03T10:09:46.372304+0000","last_became_peered":"2023-10-03T10:09:46.372304+0000","last_unstale":"2023-10-03T10:09:46.377393+0000","last_undegraded":"2023-10-03T10:09:46.377393+0000","last_fullsized":"2023-10-03T10:09:46.377393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387695+0000","last_change":"2023-10-03T10:09:46.384266+0000","last_active":"2023-10-03T10:09:46.387695+0000","last_peered":"2023-10-03T10:09:46.387695+0000","last_clean":"2023-10-03T10:09:46.387695+0000","last_became_active":"2023-10-03T10:09:46.383826+0000","last_became_peered":"2023-10-03T10:09:46.383826+0000","last_unstale":"2023-10-03T10:09:46.387695+0000","last_undegraded":"2023-10-03T10:09:46.387695+0000","last_fullsized":"2023-10-03T10:09:46.387695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388178+0000","last_change":"2023-10-03T10:09:46.384841+0000","last_active":"2023-10-03T10:09:46.388178+0000","last_peered":"2023-10-03T10:09:46.388178+0000","last_clean":"2023-10-03T10:09:46.388178+0000","last_became_active":"2023-10-03T10:09:46.384396+0000","last_became_peered":"2023-10-03T10:09:46.384396+0000","last_unstale":"2023-10-03T10:09:46.388178+0000","last_undegraded":"2023-10-03T10:09:46.388178+0000","last_fullsized":"2023-10-03T10:09:46.388178+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377458+0000","last_change":"2023-10-03T10:09:46.373837+0000","last_active":"2023-10-03T10:09:46.377458+0000","last_peered":"2023-10-03T10:09:46.377458+0000","last_clean":"2023-10-03T10:09:46.377458+0000","last_became_active":"2023-10-03T10:09:46.373580+0000","last_became_peered":"2023-10-03T10:09:46.373580+0000","last_unstale":"2023-10-03T10:09:46.377458+0000","last_undegraded":"2023-10-03T10:09:46.377458+0000","last_fullsized":"2023-10-03T10:09:46.377458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381796+0000","last_change":"2023-10-03T10:09:46.380527+0000","last_active":"2023-10-03T10:09:46.381796+0000","last_peered":"2023-10-03T10:09:46.381796+0000","last_clean":"2023-10-03T10:09:46.381796+0000","last_became_active":"2023-10-03T10:09:46.379198+0000","last_became_peered":"2023-10-03T10:09:46.379198+0000","last_unstale":"2023-10-03T10:09:46.381796+0000","last_undegraded":"2023-10-03T10:09:46.381796+0000","last_fullsized":"2023-10-03T10:09:46.381796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366853+0000","last_change":"2023-10-03T10:09:46.365014+0000","last_active":"2023-10-03T10:09:46.366853+0000","last_peered":"2023-10-03T10:09:46.366853+0000","last_clean":"2023-10-03T10:09:46.366853+0000","last_became_active":"2023-10-03T10:09:46.363620+0000","last_became_peered":"2023-10-03T10:09:46.363620+0000","last_unstale":"2023-10-03T10:09:46.366853+0000","last_undegraded":"2023-10-03T10:09:46.366853+0000","last_fullsized":"2023-10-03T10:09:46.366853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381563+0000","last_change":"2023-10-03T10:09:46.380089+0000","last_active":"2023-10-03T10:09:46.381563+0000","last_peered":"2023-10-03T10:09:46.381563+0000","last_clean":"2023-10-03T10:09:46.381563+0000","last_became_active":"2023-10-03T10:09:46.379696+0000","last_became_peered":"2023-10-03T10:09:46.379696+0000","last_unstale":"2023-10-03T10:09:46.381563+0000","last_undegraded":"2023-10-03T10:09:46.381563+0000","last_fullsized":"2023-10-03T10:09:46.381563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.375967+0000","last_change":"2023-10-03T10:09:46.374686+0000","last_active":"2023-10-03T10:09:46.375967+0000","last_peered":"2023-10-03T10:09:46.375967+0000","last_clean":"2023-10-03T10:09:46.375967+0000","last_became_active":"2023-10-03T10:09:46.371287+0000","last_became_peered":"2023-10-03T10:09:46.371287+0000","last_unstale":"2023-10-03T10:09:46.375967+0000","last_undegraded":"2023-10-03T10:09:46.375967+0000","last_fullsized":"2023-10-03T10:09:46.375967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366160+0000","last_change":"2023-10-03T10:09:46.364615+0000","last_active":"2023-10-03T10:09:46.366160+0000","last_peered":"2023-10-03T10:09:46.366160+0000","last_clean":"2023-10-03T10:09:46.366160+0000","last_became_active":"2023-10-03T10:09:46.364379+0000","last_became_peered":"2023-10-03T10:09:46.364379+0000","last_unstale":"2023-10-03T10:09:46.366160+0000","last_undegraded":"2023-10-03T10:09:46.366160+0000","last_fullsized":"2023-10-03T10:09:46.366160+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.391649+0000","last_change":"2023-10-03T10:09:46.388555+0000","last_active":"2023-10-03T10:09:46.391649+0000","last_peered":"2023-10-03T10:09:46.391649+0000","last_clean":"2023-10-03T10:09:46.391649+0000","last_became_active":"2023-10-03T10:09:46.388278+0000","last_became_peered":"2023-10-03T10:09:46.388278+0000","last_unstale":"2023-10-03T10:09:46.391649+0000","last_undegraded":"2023-10-03T10:09:46.391649+0000","last_fullsized":"2023-10-03T10:09:46.391649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.375782+0000","last_change":"2023-10-03T10:09:46.367061+0000","last_active":"2023-10-03T10:09:46.375782+0000","last_peered":"2023-10-03T10:09:46.375782+0000","last_clean":"2023-10-03T10:09:46.375782+0000","last_became_active":"2023-10-03T10:09:46.366790+0000","last_became_peered":"2023-10-03T10:09:46.366790+0000","last_unstale":"2023-10-03T10:09:46.375782+0000","last_undegraded":"2023-10-03T10:09:46.375782+0000","last_fullsized":"2023-10-03T10:09:46.375782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381350+0000","last_change":"2023-10-03T10:09:46.378399+0000","last_active":"2023-10-03T10:09:46.381350+0000","last_peered":"2023-10-03T10:09:46.381350+0000","last_clean":"2023-10-03T10:09:46.381350+0000","last_became_active":"2023-10-03T10:09:46.378102+0000","last_became_peered":"2023-10-03T10:09:46.378102+0000","last_unstale":"2023-10-03T10:09:46.381350+0000","last_undegraded":"2023-10-03T10:09:46.381350+0000","last_fullsized":"2023-10-03T10:09:46.381350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387548+0000","last_change":"2023-10-03T10:09:46.378572+0000","last_active":"2023-10-03T10:09:46.387548+0000","last_peered":"2023-10-03T10:09:46.387548+0000","last_clean":"2023-10-03T10:09:46.387548+0000","last_became_active":"2023-10-03T10:09:46.378004+0000","last_became_peered":"2023-10-03T10:09:46.378004+0000","last_unstale":"2023-10-03T10:09:46.387548+0000","last_undegraded":"2023-10-03T10:09:46.387548+0000","last_fullsized":"2023-10-03T10:09:46.387548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380689+0000","last_change":"2023-10-03T10:09:46.375958+0000","last_active":"2023-10-03T10:09:46.380689+0000","last_peered":"2023-10-03T10:09:46.380689+0000","last_clean":"2023-10-03T10:09:46.380689+0000","last_became_active":"2023-10-03T10:09:46.375553+0000","last_became_peered":"2023-10-03T10:09:46.375553+0000","last_unstale":"2023-10-03T10:09:46.380689+0000","last_undegraded":"2023-10-03T10:09:46.380689+0000","last_fullsized":"2023-10-03T10:09:46.380689+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377238+0000","last_change":"2023-10-03T10:09:46.367258+0000","last_active":"2023-10-03T10:09:46.377238+0000","last_peered":"2023-10-03T10:09:46.377238+0000","last_clean":"2023-10-03T10:09:46.377238+0000","last_became_active":"2023-10-03T10:09:46.366828+0000","last_became_peered":"2023-10-03T10:09:46.366828+0000","last_unstale":"2023-10-03T10:09:46.377238+0000","last_undegraded":"2023-10-03T10:09:46.377238+0000","last_fullsized":"2023-10-03T10:09:46.377238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377457+0000","last_change":"2023-10-03T10:09:46.374039+0000","last_active":"2023-10-03T10:09:46.377457+0000","last_peered":"2023-10-03T10:09:46.377457+0000","last_clean":"2023-10-03T10:09:46.377457+0000","last_became_active":"2023-10-03T10:09:46.373585+0000","last_became_peered":"2023-10-03T10:09:46.373585+0000","last_unstale":"2023-10-03T10:09:46.377457+0000","last_undegraded":"2023-10-03T10:09:46.377457+0000","last_fullsized":"2023-10-03T10:09:46.377457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392051+0000","last_change":"2023-10-03T10:09:46.383307+0000","last_active":"2023-10-03T10:09:46.392051+0000","last_peered":"2023-10-03T10:09:46.392051+0000","last_clean":"2023-10-03T10:09:46.392051+0000","last_became_active":"2023-10-03T10:09:46.377010+0000","last_became_peered":"2023-10-03T10:09:46.377010+0000","last_unstale":"2023-10-03T10:09:46.392051+0000","last_undegraded":"2023-10-03T10:09:46.392051+0000","last_fullsized":"2023-10-03T10:09:46.392051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.373297+0000","last_change":"2023-10-03T10:09:45.994509+0000","last_active":"2023-10-03T10:09:46.373297+0000","last_peered":"2023-10-03T10:09:46.373297+0000","last_clean":"2023-10-03T10:09:46.373297+0000","last_became_active":"2023-10-03T10:09:45.994047+0000","last_became_peered":"2023-10-03T10:09:45.994047+0000","last_unstale":"2023-10-03T10:09:46.373297+0000","last_undegraded":"2023-10-03T10:09:46.373297+0000","last_fullsized":"2023-10-03T10:09:46.373297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.369857+0000","last_change":"2023-10-03T10:09:46.367594+0000","last_active":"2023-10-03T10:09:46.369857+0000","last_peered":"2023-10-03T10:09:46.369857+0000","last_clean":"2023-10-03T10:09:46.369857+0000","last_became_active":"2023-10-03T10:09:46.367029+0000","last_became_peered":"2023-10-03T10:09:46.367029+0000","last_unstale":"2023-10-03T10:09:46.369857+0000","last_undegraded":"2023-10-03T10:09:46.369857+0000","last_fullsized":"2023-10-03T10:09:46.369857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.350498+0000","last_change":"2023-10-03T10:09:46.005851+0000","last_active":"2023-10-03T10:09:46.350498+0000","last_peered":"2023-10-03T10:09:46.350498+0000","last_clean":"2023-10-03T10:09:46.350498+0000","last_became_active":"2023-10-03T10:09:46.005573+0000","last_became_peered":"2023-10-03T10:09:46.005573+0000","last_unstale":"2023-10-03T10:09:46.350498+0000","last_undegraded":"2023-10-03T10:09:46.350498+0000","last_fullsized":"2023-10-03T10:09:46.350498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381389+0000","last_change":"2023-10-03T10:09:46.378806+0000","last_active":"2023-10-03T10:09:46.381389+0000","last_peered":"2023-10-03T10:09:46.381389+0000","last_clean":"2023-10-03T10:09:46.381389+0000","last_became_active":"2023-10-03T10:09:46.378564+0000","last_became_peered":"2023-10-03T10:09:46.378564+0000","last_unstale":"2023-10-03T10:09:46.381389+0000","last_undegraded":"2023-10-03T10:09:46.381389+0000","last_fullsized":"2023-10-03T10:09:46.381389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.351237+0000","last_change":"2023-10-03T10:09:46.004262+0000","last_active":"2023-10-03T10:09:46.351237+0000","last_peered":"2023-10-03T10:09:46.351237+0000","last_clean":"2023-10-03T10:09:46.351237+0000","last_became_active":"2023-10-03T10:09:46.004006+0000","last_became_peered":"2023-10-03T10:09:46.004006+0000","last_unstale":"2023-10-03T10:09:46.351237+0000","last_undegraded":"2023-10-03T10:09:46.351237+0000","last_fullsized":"2023-10-03T10:09:46.351237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377866+0000","last_change":"2023-10-03T10:09:46.369027+0000","last_active":"2023-10-03T10:09:46.377866+0000","last_peered":"2023-10-03T10:09:46.377866+0000","last_clean":"2023-10-03T10:09:46.377866+0000","last_became_active":"2023-10-03T10:09:46.368802+0000","last_became_peered":"2023-10-03T10:09:46.368802+0000","last_unstale":"2023-10-03T10:09:46.377866+0000","last_undegraded":"2023-10-03T10:09:46.377866+0000","last_fullsized":"2023-10-03T10:09:46.377866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.370555+0000","last_change":"2023-10-03T10:09:46.003890+0000","last_active":"2023-10-03T10:09:46.370555+0000","last_peered":"2023-10-03T10:09:46.370555+0000","last_clean":"2023-10-03T10:09:46.370555+0000","last_became_active":"2023-10-03T10:09:46.002821+0000","last_became_peered":"2023-10-03T10:09:46.002821+0000","last_unstale":"2023-10-03T10:09:46.370555+0000","last_undegraded":"2023-10-03T10:09:46.370555+0000","last_fullsized":"2023-10-03T10:09:46.370555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.391996+0000","last_change":"2023-10-03T10:09:46.383127+0000","last_active":"2023-10-03T10:09:46.391996+0000","last_peered":"2023-10-03T10:09:46.391996+0000","last_clean":"2023-10-03T10:09:46.391996+0000","last_became_active":"2023-10-03T10:09:46.374331+0000","last_became_peered":"2023-10-03T10:09:46.374331+0000","last_unstale":"2023-10-03T10:09:46.391996+0000","last_undegraded":"2023-10-03T10:09:46.391996+0000","last_fullsized":"2023-10-03T10:09:46.391996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354415+0000","last_change":"2023-10-03T10:09:46.002155+0000","last_active":"2023-10-03T10:09:46.354415+0000","last_peered":"2023-10-03T10:09:46.354415+0000","last_clean":"2023-10-03T10:09:46.354415+0000","last_became_active":"2023-10-03T10:09:46.001872+0000","last_became_peered":"2023-10-03T10:09:46.001872+0000","last_unstale":"2023-10-03T10:09:46.354415+0000","last_undegraded":"2023-10-03T10:09:46.354415+0000","last_fullsized":"2023-10-03T10:09:46.354415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387900+0000","last_change":"2023-10-03T10:09:46.378713+0000","last_active":"2023-10-03T10:09:46.387900+0000","last_peered":"2023-10-03T10:09:46.387900+0000","last_clean":"2023-10-03T10:09:46.387900+0000","last_became_active":"2023-10-03T10:09:46.378310+0000","last_became_peered":"2023-10-03T10:09:46.378310+0000","last_unstale":"2023-10-03T10:09:46.387900+0000","last_undegraded":"2023-10-03T10:09:46.387900+0000","last_fullsized":"2023-10-03T10:09:46.387900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.395252+0000","last_change":"2023-10-03T10:09:46.001705+0000","last_active":"2023-10-03T10:09:46.395252+0000","last_peered":"2023-10-03T10:09:46.395252+0000","last_clean":"2023-10-03T10:09:46.395252+0000","last_became_active":"2023-10-03T10:09:46.001338+0000","last_became_peered":"2023-10-03T10:09:46.001338+0000","last_unstale":"2023-10-03T10:09:46.395252+0000","last_undegraded":"2023-10-03T10:09:46.395252+0000","last_fullsized":"2023-10-03T10:09:46.395252+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.397119+0000","last_change":"2023-10-03T10:09:46.392590+0000","last_active":"2023-10-03T10:09:46.397119+0000","last_peered":"2023-10-03T10:09:46.397119+0000","last_clean":"2023-10-03T10:09:46.397119+0000","last_became_active":"2023-10-03T10:09:46.392268+0000","last_became_peered":"2023-10-03T10:09:46.392268+0000","last_unstale":"2023-10-03T10:09:46.397119+0000","last_undegraded":"2023-10-03T10:09:46.397119+0000","last_fullsized":"2023-10-03T10:09:46.397119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.397652+0000","last_change":"2023-10-03T10:09:45.995310+0000","last_active":"2023-10-03T10:09:46.397652+0000","last_peered":"2023-10-03T10:09:46.397652+0000","last_clean":"2023-10-03T10:09:46.397652+0000","last_became_active":"2023-10-03T10:09:45.995040+0000","last_became_peered":"2023-10-03T10:09:45.995040+0000","last_unstale":"2023-10-03T10:09:46.397652+0000","last_undegraded":"2023-10-03T10:09:46.397652+0000","last_fullsized":"2023-10-03T10:09:46.397652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388193+0000","last_change":"2023-10-03T10:09:46.385651+0000","last_active":"2023-10-03T10:09:46.388193+0000","last_peered":"2023-10-03T10:09:46.388193+0000","last_clean":"2023-10-03T10:09:46.388193+0000","last_became_active":"2023-10-03T10:09:46.383900+0000","last_became_peered":"2023-10-03T10:09:46.383900+0000","last_unstale":"2023-10-03T10:09:46.388193+0000","last_undegraded":"2023-10-03T10:09:46.388193+0000","last_fullsized":"2023-10-03T10:09:46.388193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.391818+0000","last_change":"2023-10-03T10:09:46.008019+0000","last_active":"2023-10-03T10:09:46.391818+0000","last_peered":"2023-10-03T10:09:46.391818+0000","last_clean":"2023-10-03T10:09:46.391818+0000","last_became_active":"2023-10-03T10:09:46.007374+0000","last_became_peered":"2023-10-03T10:09:46.007374+0000","last_unstale":"2023-10-03T10:09:46.391818+0000","last_undegraded":"2023-10-03T10:09:46.391818+0000","last_fullsized":"2023-10-03T10:09:46.391818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.391740+0000","last_change":"2023-10-03T10:09:46.382625+0000","last_active":"2023-10-03T10:09:46.391740+0000","last_peered":"2023-10-03T10:09:46.391740+0000","last_clean":"2023-10-03T10:09:46.391740+0000","last_became_active":"2023-10-03T10:09:46.382352+0000","last_became_peered":"2023-10-03T10:09:46.382352+0000","last_unstale":"2023-10-03T10:09:46.391740+0000","last_undegraded":"2023-10-03T10:09:46.391740+0000","last_fullsized":"2023-10-03T10:09:46.391740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.364595+0000","last_change":"2023-10-03T10:09:45.999722+0000","last_active":"2023-10-03T10:09:46.364595+0000","last_peered":"2023-10-03T10:09:46.364595+0000","last_clean":"2023-10-03T10:09:46.364595+0000","last_became_active":"2023-10-03T10:09:45.999450+0000","last_became_peered":"2023-10-03T10:09:45.999450+0000","last_unstale":"2023-10-03T10:09:46.364595+0000","last_undegraded":"2023-10-03T10:09:46.364595+0000","last_fullsized":"2023-10-03T10:09:46.364595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392163+0000","last_change":"2023-10-03T10:09:46.384495+0000","last_active":"2023-10-03T10:09:46.392163+0000","last_peered":"2023-10-03T10:09:46.392163+0000","last_clean":"2023-10-03T10:09:46.392163+0000","last_became_active":"2023-10-03T10:09:46.383160+0000","last_became_peered":"2023-10-03T10:09:46.383160+0000","last_unstale":"2023-10-03T10:09:46.392163+0000","last_undegraded":"2023-10-03T10:09:46.392163+0000","last_fullsized":"2023-10-03T10:09:46.392163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354617+0000","last_change":"2023-10-03T10:09:46.002469+0000","last_active":"2023-10-03T10:09:46.354617+0000","last_peered":"2023-10-03T10:09:46.354617+0000","last_clean":"2023-10-03T10:09:46.354617+0000","last_became_active":"2023-10-03T10:09:46.002179+0000","last_became_peered":"2023-10-03T10:09:46.002179+0000","last_unstale":"2023-10-03T10:09:46.354617+0000","last_undegraded":"2023-10-03T10:09:46.354617+0000","last_fullsized":"2023-10-03T10:09:46.354617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381433+0000","last_change":"2023-10-03T10:09:46.379295+0000","last_active":"2023-10-03T10:09:46.381433+0000","last_peered":"2023-10-03T10:09:46.381433+0000","last_clean":"2023-10-03T10:09:46.381433+0000","last_became_active":"2023-10-03T10:09:46.370639+0000","last_became_peered":"2023-10-03T10:09:46.370639+0000","last_unstale":"2023-10-03T10:09:46.381433+0000","last_undegraded":"2023-10-03T10:09:46.381433+0000","last_fullsized":"2023-10-03T10:09:46.381433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377345+0000","last_change":"2023-10-03T10:09:45.991739+0000","last_active":"2023-10-03T10:09:46.377345+0000","last_peered":"2023-10-03T10:09:46.377345+0000","last_clean":"2023-10-03T10:09:46.377345+0000","last_became_active":"2023-10-03T10:09:45.991195+0000","last_became_peered":"2023-10-03T10:09:45.991195+0000","last_unstale":"2023-10-03T10:09:46.377345+0000","last_undegraded":"2023-10-03T10:09:46.377345+0000","last_fullsized":"2023-10-03T10:09:46.377345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377898+0000","last_change":"2023-10-03T10:09:46.369391+0000","last_active":"2023-10-03T10:09:46.377898+0000","last_peered":"2023-10-03T10:09:46.377898+0000","last_clean":"2023-10-03T10:09:46.377898+0000","last_became_active":"2023-10-03T10:09:46.367938+0000","last_became_peered":"2023-10-03T10:09:46.367938+0000","last_unstale":"2023-10-03T10:09:46.377898+0000","last_undegraded":"2023-10-03T10:09:46.377898+0000","last_fullsized":"2023-10-03T10:09:46.377898+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381508+0000","last_change":"2023-10-03T10:09:46.004494+0000","last_active":"2023-10-03T10:09:46.381508+0000","last_peered":"2023-10-03T10:09:46.381508+0000","last_clean":"2023-10-03T10:09:46.381508+0000","last_became_active":"2023-10-03T10:09:46.004166+0000","last_became_peered":"2023-10-03T10:09:46.004166+0000","last_unstale":"2023-10-03T10:09:46.381508+0000","last_undegraded":"2023-10-03T10:09:46.381508+0000","last_fullsized":"2023-10-03T10:09:46.381508+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392301+0000","last_change":"2023-10-03T10:09:46.383361+0000","last_active":"2023-10-03T10:09:46.392301+0000","last_peered":"2023-10-03T10:09:46.392301+0000","last_clean":"2023-10-03T10:09:46.392301+0000","last_became_active":"2023-10-03T10:09:46.378076+0000","last_became_peered":"2023-10-03T10:09:46.378076+0000","last_unstale":"2023-10-03T10:09:46.392301+0000","last_undegraded":"2023-10-03T10:09:46.392301+0000","last_fullsized":"2023-10-03T10:09:46.392301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.372772+0000","last_change":"2023-10-03T10:09:45.995572+0000","last_active":"2023-10-03T10:09:46.372772+0000","last_peered":"2023-10-03T10:09:46.372772+0000","last_clean":"2023-10-03T10:09:46.372772+0000","last_became_active":"2023-10-03T10:09:45.995093+0000","last_became_peered":"2023-10-03T10:09:45.995093+0000","last_unstale":"2023-10-03T10:09:46.372772+0000","last_undegraded":"2023-10-03T10:09:46.372772+0000","last_fullsized":"2023-10-03T10:09:46.372772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366121+0000","last_change":"2023-10-03T10:09:46.362868+0000","last_active":"2023-10-03T10:09:46.366121+0000","last_peered":"2023-10-03T10:09:46.366121+0000","last_clean":"2023-10-03T10:09:46.366121+0000","last_became_active":"2023-10-03T10:09:46.362550+0000","last_became_peered":"2023-10-03T10:09:46.362550+0000","last_unstale":"2023-10-03T10:09:46.366121+0000","last_undegraded":"2023-10-03T10:09:46.366121+0000","last_fullsized":"2023-10-03T10:09:46.366121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.394684+0000","last_change":"2023-10-03T10:09:46.007310+0000","last_active":"2023-10-03T10:09:46.394684+0000","last_peered":"2023-10-03T10:09:46.394684+0000","last_clean":"2023-10-03T10:09:46.394684+0000","last_became_active":"2023-10-03T10:09:46.007002+0000","last_became_peered":"2023-10-03T10:09:46.007002+0000","last_unstale":"2023-10-03T10:09:46.394684+0000","last_undegraded":"2023-10-03T10:09:46.394684+0000","last_fullsized":"2023-10-03T10:09:46.394684+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388581+0000","last_change":"2023-10-03T10:09:46.387104+0000","last_active":"2023-10-03T10:09:46.388581+0000","last_peered":"2023-10-03T10:09:46.388581+0000","last_clean":"2023-10-03T10:09:46.388581+0000","last_became_active":"2023-10-03T10:09:46.386697+0000","last_became_peered":"2023-10-03T10:09:46.386697+0000","last_unstale":"2023-10-03T10:09:46.388581+0000","last_undegraded":"2023-10-03T10:09:46.388581+0000","last_fullsized":"2023-10-03T10:09:46.388581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.365183+0000","last_change":"2023-10-03T10:09:46.001474+0000","last_active":"2023-10-03T10:09:46.365183+0000","last_peered":"2023-10-03T10:09:46.365183+0000","last_clean":"2023-10-03T10:09:46.365183+0000","last_became_active":"2023-10-03T10:09:46.001185+0000","last_became_peered":"2023-10-03T10:09:46.001185+0000","last_unstale":"2023-10-03T10:09:46.365183+0000","last_undegraded":"2023-10-03T10:09:46.365183+0000","last_fullsized":"2023-10-03T10:09:46.365183+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381334+0000","last_change":"2023-10-03T10:09:46.378394+0000","last_active":"2023-10-03T10:09:46.381334+0000","last_peered":"2023-10-03T10:09:46.381334+0000","last_clean":"2023-10-03T10:09:46.381334+0000","last_became_active":"2023-10-03T10:09:46.378115+0000","last_became_peered":"2023-10-03T10:09:46.378115+0000","last_unstale":"2023-10-03T10:09:46.381334+0000","last_undegraded":"2023-10-03T10:09:46.381334+0000","last_fullsized":"2023-10-03T10:09:46.381334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392154+0000","last_change":"2023-10-03T10:09:46.008210+0000","last_active":"2023-10-03T10:09:46.392154+0000","last_peered":"2023-10-03T10:09:46.392154+0000","last_clean":"2023-10-03T10:09:46.392154+0000","last_became_active":"2023-10-03T10:09:46.007750+0000","last_became_peered":"2023-10-03T10:09:46.007750+0000","last_unstale":"2023-10-03T10:09:46.392154+0000","last_undegraded":"2023-10-03T10:09:46.392154+0000","last_fullsized":"2023-10-03T10:09:46.392154+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387177+0000","last_change":"2023-10-03T10:09:46.385399+0000","last_active":"2023-10-03T10:09:46.387177+0000","last_peered":"2023-10-03T10:09:46.387177+0000","last_clean":"2023-10-03T10:09:46.387177+0000","last_became_active":"2023-10-03T10:09:46.385110+0000","last_became_peered":"2023-10-03T10:09:46.385110+0000","last_unstale":"2023-10-03T10:09:46.387177+0000","last_undegraded":"2023-10-03T10:09:46.387177+0000","last_fullsized":"2023-10-03T10:09:46.387177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352988+0000","last_change":"2023-10-03T10:09:46.007708+0000","last_active":"2023-10-03T10:09:46.352988+0000","last_peered":"2023-10-03T10:09:46.352988+0000","last_clean":"2023-10-03T10:09:46.352988+0000","last_became_active":"2023-10-03T10:09:46.006141+0000","last_became_peered":"2023-10-03T10:09:46.006141+0000","last_unstale":"2023-10-03T10:09:46.352988+0000","last_undegraded":"2023-10-03T10:09:46.352988+0000","last_fullsized":"2023-10-03T10:09:46.352988+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.369876+0000","last_change":"2023-10-03T10:09:46.367623+0000","last_active":"2023-10-03T10:09:46.369876+0000","last_peered":"2023-10-03T10:09:46.369876+0000","last_clean":"2023-10-03T10:09:46.369876+0000","last_became_active":"2023-10-03T10:09:46.367337+0000","last_became_peered":"2023-10-03T10:09:46.367337+0000","last_unstale":"2023-10-03T10:09:46.369876+0000","last_undegraded":"2023-10-03T10:09:46.369876+0000","last_fullsized":"2023-10-03T10:09:46.369876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354145+0000","last_change":"2023-10-03T10:09:46.002433+0000","last_active":"2023-10-03T10:09:46.354145+0000","last_peered":"2023-10-03T10:09:46.354145+0000","last_clean":"2023-10-03T10:09:46.354145+0000","last_became_active":"2023-10-03T10:09:46.002135+0000","last_became_peered":"2023-10-03T10:09:46.002135+0000","last_unstale":"2023-10-03T10:09:46.354145+0000","last_undegraded":"2023-10-03T10:09:46.354145+0000","last_fullsized":"2023-10-03T10:09:46.354145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.389051+0000","last_change":"2023-10-03T10:09:46.387220+0000","last_active":"2023-10-03T10:09:46.389051+0000","last_peered":"2023-10-03T10:09:46.389051+0000","last_clean":"2023-10-03T10:09:46.389051+0000","last_became_active":"2023-10-03T10:09:46.384091+0000","last_became_peered":"2023-10-03T10:09:46.384091+0000","last_unstale":"2023-10-03T10:09:46.389051+0000","last_undegraded":"2023-10-03T10:09:46.389051+0000","last_fullsized":"2023-10-03T10:09:46.389051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.350749+0000","last_change":"2023-10-03T10:09:46.008899+0000","last_active":"2023-10-03T10:09:46.350749+0000","last_peered":"2023-10-03T10:09:46.350749+0000","last_clean":"2023-10-03T10:09:46.350749+0000","last_became_active":"2023-10-03T10:09:46.006123+0000","last_became_peered":"2023-10-03T10:09:46.006123+0000","last_unstale":"2023-10-03T10:09:46.350749+0000","last_undegraded":"2023-10-03T10:09:46.350749+0000","last_fullsized":"2023-10-03T10:09:46.350749+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377212+0000","last_change":"2023-10-03T10:09:46.367086+0000","last_active":"2023-10-03T10:09:46.377212+0000","last_peered":"2023-10-03T10:09:46.377212+0000","last_clean":"2023-10-03T10:09:46.377212+0000","last_became_active":"2023-10-03T10:09:46.366505+0000","last_became_peered":"2023-10-03T10:09:46.366505+0000","last_unstale":"2023-10-03T10:09:46.377212+0000","last_undegraded":"2023-10-03T10:09:46.377212+0000","last_fullsized":"2023-10-03T10:09:46.377212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.355579+0000","last_change":"2023-10-03T10:09:42.503202+0000","last_active":"2023-10-03T10:09:46.355579+0000","last_peered":"2023-10-03T10:09:46.355579+0000","last_clean":"2023-10-03T10:09:46.355579+0000","last_became_active":"2023-10-03T10:09:42.502700+0000","last_became_peered":"2023-10-03T10:09:42.502700+0000","last_unstale":"2023-10-03T10:09:46.355579+0000","last_undegraded":"2023-10-03T10:09:46.355579+0000","last_fullsized":"2023-10-03T10:09:46.355579+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352129+0000","last_change":"2023-10-03T10:09:45.995268+0000","last_active":"2023-10-03T10:09:46.352129+0000","last_peered":"2023-10-03T10:09:46.352129+0000","last_clean":"2023-10-03T10:09:46.352129+0000","last_became_active":"2023-10-03T10:09:45.994970+0000","last_became_peered":"2023-10-03T10:09:45.994970+0000","last_unstale":"2023-10-03T10:09:46.352129+0000","last_undegraded":"2023-10-03T10:09:46.352129+0000","last_fullsized":"2023-10-03T10:09:46.352129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.397141+0000","last_change":"2023-10-03T10:09:46.393198+0000","last_active":"2023-10-03T10:09:46.397141+0000","last_peered":"2023-10-03T10:09:46.397141+0000","last_clean":"2023-10-03T10:09:46.397141+0000","last_became_active":"2023-10-03T10:09:46.392876+0000","last_became_peered":"2023-10-03T10:09:46.392876+0000","last_unstale":"2023-10-03T10:09:46.397141+0000","last_undegraded":"2023-10-03T10:09:46.397141+0000","last_fullsized":"2023-10-03T10:09:46.397141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.355582+0000","last_change":"2023-10-03T10:09:41.940609+0000","last_active":"2023-10-03T10:09:46.355582+0000","last_peered":"2023-10-03T10:09:46.355582+0000","last_clean":"2023-10-03T10:09:46.355582+0000","last_became_active":"2023-10-03T10:09:41.940313+0000","last_became_peered":"2023-10-03T10:09:41.940313+0000","last_unstale":"2023-10-03T10:09:46.355582+0000","last_undegraded":"2023-10-03T10:09:46.355582+0000","last_fullsized":"2023-10-03T10:09:46.355582+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.364759+0000","last_change":"2023-10-03T10:09:45.987289+0000","last_active":"2023-10-03T10:09:46.364759+0000","last_peered":"2023-10-03T10:09:46.364759+0000","last_clean":"2023-10-03T10:09:46.364759+0000","last_became_active":"2023-10-03T10:09:45.987013+0000","last_became_peered":"2023-10-03T10:09:45.987013+0000","last_unstale":"2023-10-03T10:09:46.364759+0000","last_undegraded":"2023-10-03T10:09:46.364759+0000","last_fullsized":"2023-10-03T10:09:46.364759+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377619+0000","last_change":"2023-10-03T10:09:46.371416+0000","last_active":"2023-10-03T10:09:46.377619+0000","last_peered":"2023-10-03T10:09:46.377619+0000","last_clean":"2023-10-03T10:09:46.377619+0000","last_became_active":"2023-10-03T10:09:46.370977+0000","last_became_peered":"2023-10-03T10:09:46.370977+0000","last_unstale":"2023-10-03T10:09:46.377619+0000","last_undegraded":"2023-10-03T10:09:46.377619+0000","last_fullsized":"2023-10-03T10:09:46.377619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352788+0000","last_change":"2023-10-03T10:09:41.940436+0000","last_active":"2023-10-03T10:09:46.352788+0000","last_peered":"2023-10-03T10:09:46.352788+0000","last_clean":"2023-10-03T10:09:46.352788+0000","last_became_active":"2023-10-03T10:09:41.940147+0000","last_became_peered":"2023-10-03T10:09:41.940147+0000","last_unstale":"2023-10-03T10:09:46.352788+0000","last_undegraded":"2023-10-03T10:09:46.352788+0000","last_fullsized":"2023-10-03T10:09:46.352788+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354234+0000","last_change":"2023-10-03T10:09:45.994184+0000","last_active":"2023-10-03T10:09:46.354234+0000","last_peered":"2023-10-03T10:09:46.354234+0000","last_clean":"2023-10-03T10:09:46.354234+0000","last_became_active":"2023-10-03T10:09:45.993699+0000","last_became_peered":"2023-10-03T10:09:45.993699+0000","last_unstale":"2023-10-03T10:09:46.354234+0000","last_undegraded":"2023-10-03T10:09:46.354234+0000","last_fullsized":"2023-10-03T10:09:46.354234+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377610+0000","last_change":"2023-10-03T10:09:46.372991+0000","last_active":"2023-10-03T10:09:46.377610+0000","last_peered":"2023-10-03T10:09:46.377610+0000","last_clean":"2023-10-03T10:09:46.377610+0000","last_became_active":"2023-10-03T10:09:46.372753+0000","last_became_peered":"2023-10-03T10:09:46.372753+0000","last_unstale":"2023-10-03T10:09:46.377610+0000","last_undegraded":"2023-10-03T10:09:46.377610+0000","last_fullsized":"2023-10-03T10:09:46.377610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352947+0000","last_change":"2023-10-03T10:09:41.941185+0000","last_active":"2023-10-03T10:09:46.352947+0000","last_peered":"2023-10-03T10:09:46.352947+0000","last_clean":"2023-10-03T10:09:46.352947+0000","last_became_active":"2023-10-03T10:09:41.940930+0000","last_became_peered":"2023-10-03T10:09:41.940930+0000","last_unstale":"2023-10-03T10:09:46.352947+0000","last_undegraded":"2023-10-03T10:09:46.352947+0000","last_fullsized":"2023-10-03T10:09:46.352947+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354131+0000","last_change":"2023-10-03T10:09:40.948442+0000","last_active":"2023-10-03T10:09:46.354131+0000","last_peered":"2023-10-03T10:09:46.354131+0000","last_clean":"2023-10-03T10:09:46.354131+0000","last_became_active":"2023-10-03T10:09:40.948068+0000","last_became_peered":"2023-10-03T10:09:40.948068+0000","last_unstale":"2023-10-03T10:09:46.354131+0000","last_undegraded":"2023-10-03T10:09:46.354131+0000","last_fullsized":"2023-10-03T10:09:46.354131+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_clean_scrub_stamp":"2023-10-03T10:09:39.928111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.352898+0000","last_change":"2023-10-03T10:09:45.999685+0000","last_active":"2023-10-03T10:09:46.352898+0000","last_peered":"2023-10-03T10:09:46.352898+0000","last_clean":"2023-10-03T10:09:46.352898+0000","last_became_active":"2023-10-03T10:09:45.999343+0000","last_became_peered":"2023-10-03T10:09:45.999343+0000","last_unstale":"2023-10-03T10:09:46.352898+0000","last_undegraded":"2023-10-03T10:09:46.352898+0000","last_fullsized":"2023-10-03T10:09:46.352898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.384365+0000","last_change":"2023-10-03T10:09:46.367761+0000","last_active":"2023-10-03T10:09:46.384365+0000","last_peered":"2023-10-03T10:09:46.384365+0000","last_clean":"2023-10-03T10:09:46.384365+0000","last_became_active":"2023-10-03T10:09:46.367362+0000","last_became_peered":"2023-10-03T10:09:46.367362+0000","last_unstale":"2023-10-03T10:09:46.384365+0000","last_undegraded":"2023-10-03T10:09:46.384365+0000","last_fullsized":"2023-10-03T10:09:46.384365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.351142+0000","last_change":"2023-10-03T10:09:41.940561+0000","last_active":"2023-10-03T10:09:46.351142+0000","last_peered":"2023-10-03T10:09:46.351142+0000","last_clean":"2023-10-03T10:09:46.351142+0000","last_became_active":"2023-10-03T10:09:41.940202+0000","last_became_peered":"2023-10-03T10:09:41.940202+0000","last_unstale":"2023-10-03T10:09:46.351142+0000","last_undegraded":"2023-10-03T10:09:46.351142+0000","last_fullsized":"2023-10-03T10:09:46.351142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.367791+0000","last_change":"2023-10-03T10:09:45.987278+0000","last_active":"2023-10-03T10:09:46.367791+0000","last_peered":"2023-10-03T10:09:46.367791+0000","last_clean":"2023-10-03T10:09:46.367791+0000","last_became_active":"2023-10-03T10:09:45.986993+0000","last_became_peered":"2023-10-03T10:09:45.986993+0000","last_unstale":"2023-10-03T10:09:46.367791+0000","last_undegraded":"2023-10-03T10:09:46.367791+0000","last_fullsized":"2023-10-03T10:09:46.367791+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381370+0000","last_change":"2023-10-03T10:09:46.378722+0000","last_active":"2023-10-03T10:09:46.381370+0000","last_peered":"2023-10-03T10:09:46.381370+0000","last_clean":"2023-10-03T10:09:46.381370+0000","last_became_active":"2023-10-03T10:09:46.378186+0000","last_became_peered":"2023-10-03T10:09:46.378186+0000","last_unstale":"2023-10-03T10:09:46.381370+0000","last_undegraded":"2023-10-03T10:09:46.381370+0000","last_fullsized":"2023-10-03T10:09:46.381370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.354254+0000","last_change":"2023-10-03T10:09:42.502984+0000","last_active":"2023-10-03T10:09:46.354254+0000","last_peered":"2023-10-03T10:09:46.354254+0000","last_clean":"2023-10-03T10:09:46.354254+0000","last_became_active":"2023-10-03T10:09:42.502699+0000","last_became_peered":"2023-10-03T10:09:42.502699+0000","last_unstale":"2023-10-03T10:09:46.354254+0000","last_undegraded":"2023-10-03T10:09:46.354254+0000","last_fullsized":"2023-10-03T10:09:46.354254+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.355380+0000","last_change":"2023-10-03T10:09:45.995626+0000","last_active":"2023-10-03T10:09:46.355380+0000","last_peered":"2023-10-03T10:09:46.355380+0000","last_clean":"2023-10-03T10:09:46.355380+0000","last_became_active":"2023-10-03T10:09:45.995322+0000","last_became_peered":"2023-10-03T10:09:45.995322+0000","last_unstale":"2023-10-03T10:09:46.355380+0000","last_undegraded":"2023-10-03T10:09:46.355380+0000","last_fullsized":"2023-10-03T10:09:46.355380+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.375920+0000","last_change":"2023-10-03T10:09:46.371217+0000","last_active":"2023-10-03T10:09:46.375920+0000","last_peered":"2023-10-03T10:09:46.375920+0000","last_clean":"2023-10-03T10:09:46.375920+0000","last_became_active":"2023-10-03T10:09:46.370285+0000","last_became_peered":"2023-10-03T10:09:46.370285+0000","last_unstale":"2023-10-03T10:09:46.375920+0000","last_undegraded":"2023-10-03T10:09:46.375920+0000","last_fullsized":"2023-10-03T10:09:46.375920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.383433+0000","last_change":"2023-10-03T10:09:46.006819+0000","last_active":"2023-10-03T10:09:46.383433+0000","last_peered":"2023-10-03T10:09:46.383433+0000","last_clean":"2023-10-03T10:09:46.383433+0000","last_became_active":"2023-10-03T10:09:46.006524+0000","last_became_peered":"2023-10-03T10:09:46.006524+0000","last_unstale":"2023-10-03T10:09:46.383433+0000","last_undegraded":"2023-10-03T10:09:46.383433+0000","last_fullsized":"2023-10-03T10:09:46.383433+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.350860+0000","last_change":"2023-10-03T10:09:42.503022+0000","last_active":"2023-10-03T10:09:46.350860+0000","last_peered":"2023-10-03T10:09:46.350860+0000","last_clean":"2023-10-03T10:09:46.350860+0000","last_became_active":"2023-10-03T10:09:42.502739+0000","last_became_peered":"2023-10-03T10:09:42.502739+0000","last_unstale":"2023-10-03T10:09:46.350860+0000","last_undegraded":"2023-10-03T10:09:46.350860+0000","last_fullsized":"2023-10-03T10:09:46.350860+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392320+0000","last_change":"2023-10-03T10:09:46.383732+0000","last_active":"2023-10-03T10:09:46.392320+0000","last_peered":"2023-10-03T10:09:46.392320+0000","last_clean":"2023-10-03T10:09:46.392320+0000","last_became_active":"2023-10-03T10:09:46.374186+0000","last_became_peered":"2023-10-03T10:09:46.374186+0000","last_unstale":"2023-10-03T10:09:46.392320+0000","last_undegraded":"2023-10-03T10:09:46.392320+0000","last_fullsized":"2023-10-03T10:09:46.392320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.353582+0000","last_change":"2023-10-03T10:09:42.503368+0000","last_active":"2023-10-03T10:09:46.353582+0000","last_peered":"2023-10-03T10:09:46.353582+0000","last_clean":"2023-10-03T10:09:46.353582+0000","last_became_active":"2023-10-03T10:09:42.503090+0000","last_became_peered":"2023-10-03T10:09:42.503090+0000","last_unstale":"2023-10-03T10:09:46.353582+0000","last_undegraded":"2023-10-03T10:09:46.353582+0000","last_fullsized":"2023-10-03T10:09:46.353582+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-03T10:09:48.219487+0000","last_change":"2023-10-03T10:09:46.003516+0000","last_active":"2023-10-03T10:09:48.219487+0000","last_peered":"2023-10-03T10:09:48.219487+0000","last_clean":"2023-10-03T10:09:48.219487+0000","last_became_active":"2023-10-03T10:09:46.003227+0000","last_became_peered":"2023-10-03T10:09:46.003227+0000","last_unstale":"2023-10-03T10:09:48.219487+0000","last_undegraded":"2023-10-03T10:09:48.219487+0000","last_fullsized":"2023-10-03T10:09:48.219487+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.366737+0000","last_change":"2023-10-03T10:09:46.365107+0000","last_active":"2023-10-03T10:09:46.366737+0000","last_peered":"2023-10-03T10:09:46.366737+0000","last_clean":"2023-10-03T10:09:46.366737+0000","last_became_active":"2023-10-03T10:09:46.364877+0000","last_became_peered":"2023-10-03T10:09:46.364877+0000","last_unstale":"2023-10-03T10:09:46.366737+0000","last_undegraded":"2023-10-03T10:09:46.366737+0000","last_fullsized":"2023-10-03T10:09:46.366737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388998+0000","last_change":"2023-10-03T10:09:46.003786+0000","last_active":"2023-10-03T10:09:46.388998+0000","last_peered":"2023-10-03T10:09:46.388998+0000","last_clean":"2023-10-03T10:09:46.388998+0000","last_became_active":"2023-10-03T10:09:46.003506+0000","last_became_peered":"2023-10-03T10:09:46.003506+0000","last_unstale":"2023-10-03T10:09:46.388998+0000","last_undegraded":"2023-10-03T10:09:46.388998+0000","last_fullsized":"2023-10-03T10:09:46.388998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380939+0000","last_change":"2023-10-03T10:09:46.376808+0000","last_active":"2023-10-03T10:09:46.380939+0000","last_peered":"2023-10-03T10:09:46.380939+0000","last_clean":"2023-10-03T10:09:46.380939+0000","last_became_active":"2023-10-03T10:09:46.376414+0000","last_became_peered":"2023-10-03T10:09:46.376414+0000","last_unstale":"2023-10-03T10:09:46.380939+0000","last_undegraded":"2023-10-03T10:09:46.380939+0000","last_fullsized":"2023-10-03T10:09:46.380939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.374191+0000","last_change":"2023-10-03T10:09:45.992104+0000","last_active":"2023-10-03T10:09:46.374191+0000","last_peered":"2023-10-03T10:09:46.374191+0000","last_clean":"2023-10-03T10:09:46.374191+0000","last_became_active":"2023-10-03T10:09:45.991796+0000","last_became_peered":"2023-10-03T10:09:45.991796+0000","last_unstale":"2023-10-03T10:09:46.374191+0000","last_undegraded":"2023-10-03T10:09:46.374191+0000","last_fullsized":"2023-10-03T10:09:46.374191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387640+0000","last_change":"2023-10-03T10:09:46.384662+0000","last_active":"2023-10-03T10:09:46.387640+0000","last_peered":"2023-10-03T10:09:46.387640+0000","last_clean":"2023-10-03T10:09:46.387640+0000","last_became_active":"2023-10-03T10:09:46.384347+0000","last_became_peered":"2023-10-03T10:09:46.384347+0000","last_unstale":"2023-10-03T10:09:46.387640+0000","last_undegraded":"2023-10-03T10:09:46.387640+0000","last_fullsized":"2023-10-03T10:09:46.387640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.383719+0000","last_change":"2023-10-03T10:09:46.005018+0000","last_active":"2023-10-03T10:09:46.383719+0000","last_peered":"2023-10-03T10:09:46.383719+0000","last_clean":"2023-10-03T10:09:46.383719+0000","last_became_active":"2023-10-03T10:09:46.004611+0000","last_became_peered":"2023-10-03T10:09:46.004611+0000","last_unstale":"2023-10-03T10:09:46.383719+0000","last_undegraded":"2023-10-03T10:09:46.383719+0000","last_fullsized":"2023-10-03T10:09:46.383719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.388600+0000","last_change":"2023-10-03T10:09:46.387130+0000","last_active":"2023-10-03T10:09:46.388600+0000","last_peered":"2023-10-03T10:09:46.388600+0000","last_clean":"2023-10-03T10:09:46.388600+0000","last_became_active":"2023-10-03T10:09:46.386801+0000","last_became_peered":"2023-10-03T10:09:46.386801+0000","last_unstale":"2023-10-03T10:09:46.388600+0000","last_undegraded":"2023-10-03T10:09:46.388600+0000","last_fullsized":"2023-10-03T10:09:46.388600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392142+0000","last_change":"2023-10-03T10:09:45.998407+0000","last_active":"2023-10-03T10:09:46.392142+0000","last_peered":"2023-10-03T10:09:46.392142+0000","last_clean":"2023-10-03T10:09:46.392142+0000","last_became_active":"2023-10-03T10:09:45.995915+0000","last_became_peered":"2023-10-03T10:09:45.995915+0000","last_unstale":"2023-10-03T10:09:46.392142+0000","last_undegraded":"2023-10-03T10:09:46.392142+0000","last_fullsized":"2023-10-03T10:09:46.392142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.392233+0000","last_change":"2023-10-03T10:09:46.385531+0000","last_active":"2023-10-03T10:09:46.392233+0000","last_peered":"2023-10-03T10:09:46.392233+0000","last_clean":"2023-10-03T10:09:46.392233+0000","last_became_active":"2023-10-03T10:09:46.385289+0000","last_became_peered":"2023-10-03T10:09:46.385289+0000","last_unstale":"2023-10-03T10:09:46.392233+0000","last_undegraded":"2023-10-03T10:09:46.392233+0000","last_fullsized":"2023-10-03T10:09:46.392233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.381665+0000","last_change":"2023-10-03T10:09:46.004241+0000","last_active":"2023-10-03T10:09:46.381665+0000","last_peered":"2023-10-03T10:09:46.381665+0000","last_clean":"2023-10-03T10:09:46.381665+0000","last_became_active":"2023-10-03T10:09:46.003370+0000","last_became_peered":"2023-10-03T10:09:46.003370+0000","last_unstale":"2023-10-03T10:09:46.381665+0000","last_undegraded":"2023-10-03T10:09:46.381665+0000","last_fullsized":"2023-10-03T10:09:46.381665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.380871+0000","last_change":"2023-10-03T10:09:46.374808+0000","last_active":"2023-10-03T10:09:46.380871+0000","last_peered":"2023-10-03T10:09:46.380871+0000","last_clean":"2023-10-03T10:09:46.380871+0000","last_became_active":"2023-10-03T10:09:46.374363+0000","last_became_peered":"2023-10-03T10:09:46.374363+0000","last_unstale":"2023-10-03T10:09:46.380871+0000","last_undegraded":"2023-10-03T10:09:46.380871+0000","last_fullsized":"2023-10-03T10:09:46.380871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377400+0000","last_change":"2023-10-03T10:09:46.371026+0000","last_active":"2023-10-03T10:09:46.377400+0000","last_peered":"2023-10-03T10:09:46.377400+0000","last_clean":"2023-10-03T10:09:46.377400+0000","last_became_active":"2023-10-03T10:09:46.370725+0000","last_became_peered":"2023-10-03T10:09:46.370725+0000","last_unstale":"2023-10-03T10:09:46.377400+0000","last_undegraded":"2023-10-03T10:09:46.377400+0000","last_fullsized":"2023-10-03T10:09:46.377400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.369953+0000","last_change":"2023-10-03T10:09:46.368699+0000","last_active":"2023-10-03T10:09:46.369953+0000","last_peered":"2023-10-03T10:09:46.369953+0000","last_clean":"2023-10-03T10:09:46.369953+0000","last_became_active":"2023-10-03T10:09:46.367867+0000","last_became_peered":"2023-10-03T10:09:46.367867+0000","last_unstale":"2023-10-03T10:09:46.369953+0000","last_undegraded":"2023-10-03T10:09:46.369953+0000","last_fullsized":"2023-10-03T10:09:46.369953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.387149+0000","last_change":"2023-10-03T10:09:46.385510+0000","last_active":"2023-10-03T10:09:46.387149+0000","last_peered":"2023-10-03T10:09:46.387149+0000","last_clean":"2023-10-03T10:09:46.387149+0000","last_became_active":"2023-10-03T10:09:46.385254+0000","last_became_peered":"2023-10-03T10:09:46.385254+0000","last_unstale":"2023-10-03T10:09:46.387149+0000","last_undegraded":"2023-10-03T10:09:46.387149+0000","last_fullsized":"2023-10-03T10:09:46.387149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.383009+0000","last_change":"2023-10-03T10:09:46.370858+0000","last_active":"2023-10-03T10:09:46.383009+0000","last_peered":"2023-10-03T10:09:46.383009+0000","last_clean":"2023-10-03T10:09:46.383009+0000","last_became_active":"2023-10-03T10:09:46.367104+0000","last_became_peered":"2023-10-03T10:09:46.367104+0000","last_unstale":"2023-10-03T10:09:46.383009+0000","last_undegraded":"2023-10-03T10:09:46.383009+0000","last_fullsized":"2023-10-03T10:09:46.383009+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:09:46.377600+0000","last_change":"2023-10-03T10:09:46.371241+0000","last_active":"2023-10-03T10:09:46.377600+0000","last_peered":"2023-10-03T10:09:46.377600+0000","last_clean":"2023-10-03T10:09:46.377600+0000","last_became_active":"2023-10-03T10:09:46.370691+0000","last_became_peered":"2023-10-03T10:09:46.370691+0000","last_unstale":"2023-10-03T10:09:46.377600+0000","last_undegraded":"2023-10-03T10:09:46.377600+0000","last_fullsized":"2023-10-03T10:09:46.377600+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":46930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:09:57.621 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-03T10:09:57.621 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-03T10:09:57.622 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-03T10:09:57.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-03T10:09:57.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.772+0000 7f332d59e700 1 Processor -- start 2023-10-03T10:09:57.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.772+0000 7f332d59e700 1 -- start start 2023-10-03T10:09:57.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.772+0000 7f332d59e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3328059070 0x7f3328098ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.772+0000 7f332d59e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3328099400 0x7f332812af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.772+0000 7f332d59e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33280599b0 con 0x7f3328098fb0 2023-10-03T10:09:57.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.772+0000 7f332d59e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3328059450 con 0x7f3328059070 2023-10-03T10:09:57.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.772+0000 7f332d59e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3328091ed0 con 0x7f3328099400 2023-10-03T10:09:57.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f3327fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3328059070 0x7f3328098ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f332cd9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3328099400 0x7f332812af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f332cd9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3328099400 0x7f332812af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48192/0 (socket says 172.21.15.72:48192) 2023-10-03T10:09:57.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f3327fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3328059070 0x7f3328098ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33434/0 (socket says 172.21.15.72:33434) 2023-10-03T10:09:57.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f33277fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3328098fb0 0x7f332812a7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41146/0 (socket says 172.21.15.72:41146) 2023-10-03T10:09:57.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f332cd9d700 1 -- 172.21.15.72:0/3880108239 learned_addr learned my addr 172.21.15.72:0/3880108239 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:57.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f332cd9d700 1 -- 172.21.15.72:0/3880108239 >> v2:172.21.15.72:3300/0 conn(0x7f3328059070 msgr2=0x7f3328098ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:57.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f332cd9d700 1 --2- 172.21.15.72:0/3880108239 >> v2:172.21.15.72:3300/0 conn(0x7f3328059070 0x7f3328098ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f332cd9d700 1 -- 172.21.15.72:0/3880108239 >> v1:172.21.15.72:6789/0 conn(0x7f3328098fb0 legacy=0x7f332812a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f332cd9d700 1 -- 172.21.15.72:0/3880108239 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3328059da0 con 0x7f3328099400 2023-10-03T10:09:57.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f3326ffd700 1 -- 172.21.15.72:0/3880108239 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815592505 0 0) 0x7f33280599b0 con 0x7f3328098fb0 2023-10-03T10:09:57.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f3327fff700 1 --2- 172.21.15.72:0/3880108239 >> v2:172.21.15.72:3300/0 conn(0x7f3328059070 0x7f3328098ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:57.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f332cd9d700 1 --2- 172.21.15.72:0/3880108239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3328099400 0x7f332812af00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3320009f50 tx=0x7f3320009840).ready entity=mon.1 client_cookie=dad1ee45ada0232e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f3326ffd700 1 -- 172.21.15.72:0/3880108239 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332000e070 con 0x7f3328099400 2023-10-03T10:09:57.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f3326ffd700 1 -- 172.21.15.72:0/3880108239 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332000b9c0 con 0x7f3328099400 2023-10-03T10:09:57.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.773+0000 7f3326ffd700 1 -- 172.21.15.72:0/3880108239 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332000bd40 con 0x7f3328099400 2023-10-03T10:09:57.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.774+0000 7f332d59e700 1 -- 172.21.15.72:0/3880108239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3328099400 msgr2=0x7f332812af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.774+0000 7f332d59e700 1 --2- 172.21.15.72:0/3880108239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3328099400 0x7f332812af00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3320009f50 tx=0x7f3320009840).stop 2023-10-03T10:09:57.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.774+0000 7f332d59e700 1 -- 172.21.15.72:0/3880108239 shutdown_connections 2023-10-03T10:09:57.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.774+0000 7f332d59e700 1 --2- 172.21.15.72:0/3880108239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3328099400 0x7f332812af00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.774+0000 7f332d59e700 1 --2- 172.21.15.72:0/3880108239 >> v2:172.21.15.72:3300/0 conn(0x7f3328059070 0x7f3328098ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.774+0000 7f332d59e700 1 -- 172.21.15.72:0/3880108239 >> 172.21.15.72:0/3880108239 conn(0x7f332809b540 msgr2=0x7f3328097400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.774+0000 7f332d59e700 1 -- 172.21.15.72:0/3880108239 shutdown_connections 2023-10-03T10:09:57.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.774+0000 7f332d59e700 1 -- 172.21.15.72:0/3880108239 wait complete. 2023-10-03T10:09:57.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.774+0000 7f332d59e700 1 Processor -- start 2023-10-03T10:09:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f332d59e700 1 -- start start 2023-10-03T10:09:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f332d59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3328059070 0x7f3328068f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f332d59e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3328098fb0 0x7f3328069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f332d59e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3328099400 0x7f3328069960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f332d59e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3328096240 con 0x7f3328059070 2023-10-03T10:09:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f332d59e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3328099d00 con 0x7f3328098fb0 2023-10-03T10:09:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f332d59e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3328116050 con 0x7f3328099400 2023-10-03T10:09:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f3327fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3328059070 0x7f3328068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f332cd9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3328099400 0x7f3328069960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f3327fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3328059070 0x7f3328068f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33448/0 (socket says 172.21.15.72:33448) 2023-10-03T10:09:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f3327fff700 1 -- 172.21.15.72:0/1604424030 learned_addr learned my addr 172.21.15.72:0/1604424030 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f33277fe700 1 --2- 172.21.15.72:0/1604424030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3328098fb0 0x7f3328069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f332cd9d700 1 -- 172.21.15.72:0/1604424030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3328098fb0 msgr2=0x7f3328069470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f332cd9d700 1 --2- 172.21.15.72:0/1604424030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3328098fb0 0x7f3328069470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f332cd9d700 1 -- 172.21.15.72:0/1604424030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3328059070 msgr2=0x7f3328068f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f332cd9d700 1 --2- 172.21.15.72:0/1604424030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3328059070 0x7f3328068f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f332cd9d700 1 -- 172.21.15.72:0/1604424030 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33180092a0 con 0x7f3328099400 2023-10-03T10:09:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.775+0000 7f3327fff700 1 --2- 172.21.15.72:0/1604424030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3328059070 0x7f3328068f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.776+0000 7f332cd9d700 1 --2- 172.21.15.72:0/1604424030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3328099400 0x7f3328069960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3320013000 tx=0x7f3328092280).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.776+0000 7f331ffff700 1 -- 172.21.15.72:0/1604424030 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33200092e0 con 0x7f3328099400 2023-10-03T10:09:57.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.776+0000 7f331ffff700 1 -- 172.21.15.72:0/1604424030 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3320009500 con 0x7f3328099400 2023-10-03T10:09:57.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.776+0000 7f332d59e700 1 -- 172.21.15.72:0/1604424030 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3320009ae0 con 0x7f3328099400 2023-10-03T10:09:57.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.776+0000 7f331ffff700 1 -- 172.21.15.72:0/1604424030 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320007860 con 0x7f3328099400 2023-10-03T10:09:57.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.776+0000 7f332d59e700 1 -- 172.21.15.72:0/1604424030 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3328117b90 con 0x7f3328099400 2023-10-03T10:09:57.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.776+0000 7f331ffff700 1 -- 172.21.15.72:0/1604424030 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3320003040 con 0x7f3328099400 2023-10-03T10:09:57.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.777+0000 7f331ffff700 1 -- 172.21.15.72:0/1604424030 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f332003ca10 con 0x7f3328099400 2023-10-03T10:09:57.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.777+0000 7f332d59e700 1 -- 172.21.15.72:0/1604424030 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3328117b90 con 0x7f3328099400 2023-10-03T10:09:57.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.781+0000 7f331ffff700 1 -- 172.21.15.72:0/1604424030 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3328117b90 con 0x7f3328099400 2023-10-03T10:09:57.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.977+0000 7f332d59e700 1 -- 172.21.15.72:0/1604424030 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3328117b90 con 0x7f3328099400 2023-10-03T10:09:57.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.978+0000 7f331ffff700 1 -- 172.21.15.72:0/1604424030 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f3328117b90 con 0x7f3328099400 2023-10-03T10:09:57.978 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:57.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.980+0000 7f332d59e700 1 -- 172.21.15.72:0/1604424030 >> v1:172.21.15.72:6816/118184 conn(0x7f330802bb60 legacy=0x7f330802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.980+0000 7f332d59e700 1 -- 172.21.15.72:0/1604424030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3328099400 msgr2=0x7f3328069960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:57.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.980+0000 7f332d59e700 1 --2- 172.21.15.72:0/1604424030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3328099400 0x7f3328069960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3320013000 tx=0x7f3328092280).stop 2023-10-03T10:09:57.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.980+0000 7f332d59e700 1 -- 172.21.15.72:0/1604424030 shutdown_connections 2023-10-03T10:09:57.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.980+0000 7f332d59e700 1 --2- 172.21.15.72:0/1604424030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3328059070 0x7f3328068f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.980+0000 7f332d59e700 1 --2- 172.21.15.72:0/1604424030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3328099400 0x7f3328069960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.980+0000 7f332d59e700 1 --2- 172.21.15.72:0/1604424030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3328098fb0 0x7f3328069470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:57.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.980+0000 7f332d59e700 1 -- 172.21.15.72:0/1604424030 >> 172.21.15.72:0/1604424030 conn(0x7f332809b540 msgr2=0x7f33280938d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:57.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.980+0000 7f332d59e700 1 -- 172.21.15.72:0/1604424030 shutdown_connections 2023-10-03T10:09:57.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:57.980+0000 7f332d59e700 1 -- 172.21.15.72:0/1604424030 wait complete. 2023-10-03T10:09:57.991 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-03T10:09:57.991 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-03T10:09:57.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:58.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.107+0000 7fa50f151700 1 Processor -- start 2023-10-03T10:09:58.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.107+0000 7fa50f151700 1 -- start start 2023-10-03T10:09:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.107+0000 7fa50f151700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa508123a90 0x7fa508123e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.107+0000 7fa50f151700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa508067ce0 0x7fa508092340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa50f151700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa508068880 con 0x7fa508126f70 2023-10-03T10:09:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa50f151700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080680c0 con 0x7fa508067ce0 2023-10-03T10:09:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa50f151700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa508068c90 con 0x7fa508123a90 2023-10-03T10:09:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa507fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa508067ce0 0x7fa508092340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa50d6ee700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa508126f70 0x7fa5081273f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41156/0 (socket says 172.21.15.72:41156) 2023-10-03T10:09:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa50d6ee700 1 -- 172.21.15.72:0/3082649120 learned_addr learned my addr 172.21.15.72:0/3082649120 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:58.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa50ceed700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa508123a90 0x7fa508123e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa507fff700 1 -- 172.21.15.72:0/3082649120 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa508123a90 msgr2=0x7fa508123e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:58.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa507fff700 1 --2- 172.21.15.72:0/3082649120 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa508123a90 0x7fa508123e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa507fff700 1 -- 172.21.15.72:0/3082649120 >> v1:172.21.15.72:6789/0 conn(0x7fa508126f70 legacy=0x7fa5081273f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa5077fe700 1 -- 172.21.15.72:0/3082649120 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915560587 0 0) 0x7fa508068880 con 0x7fa508126f70 2023-10-03T10:09:58.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa507fff700 1 -- 172.21.15.72:0/3082649120 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa508124430 con 0x7fa508067ce0 2023-10-03T10:09:58.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa50ceed700 1 --2- 172.21.15.72:0/3082649120 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa508123a90 0x7fa508123e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:58.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa507fff700 1 --2- 172.21.15.72:0/3082649120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa508067ce0 0x7fa508092340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa4f4009790 tx=0x7fa4f4009060).ready entity=mon.1 client_cookie=8fbfca6a32071fa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:58.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa5077fe700 1 -- 172.21.15.72:0/3082649120 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f400f510 con 0x7fa508067ce0 2023-10-03T10:09:58.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa5077fe700 1 -- 172.21.15.72:0/3082649120 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f400f670 con 0x7fa508067ce0 2023-10-03T10:09:58.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.108+0000 7fa5077fe700 1 -- 172.21.15.72:0/3082649120 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f400f9f0 con 0x7fa508067ce0 2023-10-03T10:09:58.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.109+0000 7fa50f151700 1 -- 172.21.15.72:0/3082649120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa508067ce0 msgr2=0x7fa508092340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.109+0000 7fa50f151700 1 --2- 172.21.15.72:0/3082649120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa508067ce0 0x7fa508092340 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa4f4009790 tx=0x7fa4f4009060).stop 2023-10-03T10:09:58.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.109+0000 7fa50f151700 1 -- 172.21.15.72:0/3082649120 shutdown_connections 2023-10-03T10:09:58.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.109+0000 7fa50f151700 1 --2- 172.21.15.72:0/3082649120 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa508123a90 0x7fa508123e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.109+0000 7fa50f151700 1 --2- 172.21.15.72:0/3082649120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa508067ce0 0x7fa508092340 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.109+0000 7fa50f151700 1 -- 172.21.15.72:0/3082649120 >> 172.21.15.72:0/3082649120 conn(0x7fa50809a220 msgr2=0x7fa50809a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:58.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.109+0000 7fa50f151700 1 -- 172.21.15.72:0/3082649120 shutdown_connections 2023-10-03T10:09:58.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.109+0000 7fa50f151700 1 -- 172.21.15.72:0/3082649120 wait complete. 2023-10-03T10:09:58.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.110+0000 7fa50f151700 1 Processor -- start 2023-10-03T10:09:58.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.110+0000 7fa50f151700 1 -- start start 2023-10-03T10:09:58.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.110+0000 7fa50f151700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa508067ce0 0x7fa508130da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.110+0000 7fa50f151700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa508123a90 0x7fa508128dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.110+0000 7fa50f151700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa508126f70 0x7fa5081292c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.110+0000 7fa50f151700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080697c0 con 0x7fa508123a90 2023-10-03T10:09:58.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.110+0000 7fa50f151700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50812cec0 con 0x7fa508126f70 2023-10-03T10:09:58.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.110+0000 7fa50f151700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50812c900 con 0x7fa508067ce0 2023-10-03T10:09:58.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.110+0000 7fa50ceed700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa508067ce0 0x7fa508130da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.110+0000 7fa507fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa508123a90 0x7fa508128dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.110+0000 7fa50ceed700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa508067ce0 0x7fa508130da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59584/0 (socket says 172.21.15.72:59584) 2023-10-03T10:09:58.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.110+0000 7fa50d6ee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa508126f70 0x7fa5081292c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.110+0000 7fa50ceed700 1 -- 172.21.15.72:0/2191775512 learned_addr learned my addr 172.21.15.72:0/2191775512 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:58.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.110+0000 7fa507fff700 1 --2- 172.21.15.72:0/2191775512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa508123a90 0x7fa508128dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33452/0 (socket says 172.21.15.72:33452) 2023-10-03T10:09:58.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.111+0000 7fa50ceed700 1 -- 172.21.15.72:0/2191775512 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa508126f70 msgr2=0x7fa5081292c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.111+0000 7fa50ceed700 1 --2- 172.21.15.72:0/2191775512 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa508126f70 0x7fa5081292c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.111+0000 7fa50ceed700 1 -- 172.21.15.72:0/2191775512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa508123a90 msgr2=0x7fa508128dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.111+0000 7fa50ceed700 1 --2- 172.21.15.72:0/2191775512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa508123a90 0x7fa508128dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.111+0000 7fa50ceed700 1 -- 172.21.15.72:0/2191775512 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc0092a0 con 0x7fa508067ce0 2023-10-03T10:09:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.111+0000 7fa507fff700 1 --2- 172.21.15.72:0/2191775512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa508123a90 0x7fa508128dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.111+0000 7fa50ceed700 1 --2- 172.21.15.72:0/2191775512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa508067ce0 0x7fa508130da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa4fc00ea20 tx=0x7fa4fc009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.111+0000 7fa504ff9700 1 -- 172.21.15.72:0/2191775512 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc00ee60 con 0x7fa508067ce0 2023-10-03T10:09:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.111+0000 7fa504ff9700 1 -- 172.21.15.72:0/2191775512 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc00c7f0 con 0x7fa508067ce0 2023-10-03T10:09:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.111+0000 7fa504ff9700 1 -- 172.21.15.72:0/2191775512 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc00cb70 con 0x7fa508067ce0 2023-10-03T10:09:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.111+0000 7fa50f151700 1 -- 172.21.15.72:0/2191775512 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f40092a0 con 0x7fa508067ce0 2023-10-03T10:09:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.111+0000 7fa50f151700 1 -- 172.21.15.72:0/2191775512 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50812c360 con 0x7fa508067ce0 2023-10-03T10:09:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.112+0000 7fa504ff9700 1 -- 172.21.15.72:0/2191775512 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa4fc01b400 con 0x7fa508067ce0 2023-10-03T10:09:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.112+0000 7fa504ff9700 1 -- 172.21.15.72:0/2191775512 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa4fc03b5b0 con 0x7fa508067ce0 2023-10-03T10:09:58.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.112+0000 7fa50f151700 1 -- 172.21.15.72:0/2191775512 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50812c560 con 0x7fa508067ce0 2023-10-03T10:09:58.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.116+0000 7fa504ff9700 1 -- 172.21.15.72:0/2191775512 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa50812c560 con 0x7fa508067ce0 2023-10-03T10:09:58.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.278+0000 7fa50f151700 1 -- 172.21.15.72:0/2191775512 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa50812c560 con 0x7fa508067ce0 2023-10-03T10:09:58.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.279+0000 7fa504ff9700 1 -- 172.21.15.72:0/2191775512 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7fa50812c560 con 0x7fa508067ce0 2023-10-03T10:09:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:09:47.346977+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:09:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.281+0000 7fa50f151700 1 -- 172.21.15.72:0/2191775512 >> v1:172.21.15.72:6816/118184 conn(0x7fa4ec02bb60 legacy=0x7fa4ec02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.281+0000 7fa50f151700 1 -- 172.21.15.72:0/2191775512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa508067ce0 msgr2=0x7fa508130da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.281+0000 7fa50f151700 1 --2- 172.21.15.72:0/2191775512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa508067ce0 0x7fa508130da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa4fc00ea20 tx=0x7fa4fc009060).stop 2023-10-03T10:09:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.281+0000 7fa50f151700 1 -- 172.21.15.72:0/2191775512 shutdown_connections 2023-10-03T10:09:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.281+0000 7fa50f151700 1 --2- 172.21.15.72:0/2191775512 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa508126f70 0x7fa5081292c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.281+0000 7fa50f151700 1 --2- 172.21.15.72:0/2191775512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa508067ce0 0x7fa508130da0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.281+0000 7fa50f151700 1 --2- 172.21.15.72:0/2191775512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa508123a90 0x7fa508128dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.281+0000 7fa50f151700 1 -- 172.21.15.72:0/2191775512 >> 172.21.15.72:0/2191775512 conn(0x7fa50809a220 msgr2=0x7fa508126830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:58.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.281+0000 7fa50f151700 1 -- 172.21.15.72:0/2191775512 shutdown_connections 2023-10-03T10:09:58.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.281+0000 7fa50f151700 1 -- 172.21.15.72:0/2191775512 wait complete. 2023-10-03T10:09:58.292 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:38.963446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:40.092839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:44.713857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:45.314387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-03T10:09:58.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:09:58.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.412+0000 7f78f90f6700 1 Processor -- start 2023-10-03T10:09:58.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.412+0000 7f78f90f6700 1 -- start start 2023-10-03T10:09:58.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.412+0000 7f78f90f6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78f40613a0 0x7f78f40919e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.412+0000 7f78f90f6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f412cde0 0x7f78f412f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f90f6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f4092c00 con 0x7f78f4091ed0 2023-10-03T10:09:58.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f90f6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f4061780 con 0x7f78f40613a0 2023-10-03T10:09:58.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f90f6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78f4092ff0 con 0x7f78f412cde0 2023-10-03T10:09:58.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f359e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f412cde0 0x7f78f412f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78f40613a0 0x7f78f40919e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f359e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f412cde0 0x7f78f412f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59452/0 (socket says 172.21.15.72:59452) 2023-10-03T10:09:58.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78f40613a0 0x7f78f40919e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60760/0 (socket says 172.21.15.72:60760) 2023-10-03T10:09:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f359e700 1 -- 172.21.15.72:0/734215374 learned_addr learned my addr 172.21.15.72:0/734215374 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f259c700 1 --1- 172.21.15.72:0/734215374 >> v1:172.21.15.72:6789/0 conn(0x7f78f4091ed0 0x7f78f40922b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48162/0 (socket says 172.21.15.72:48162) 2023-10-03T10:09:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f359e700 1 -- 172.21.15.72:0/734215374 >> v2:172.21.15.72:3300/0 conn(0x7f78f40613a0 msgr2=0x7f78f40919e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f359e700 1 --2- 172.21.15.72:0/734215374 >> v2:172.21.15.72:3300/0 conn(0x7f78f40613a0 0x7f78f40919e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f359e700 1 -- 172.21.15.72:0/734215374 >> v1:172.21.15.72:6789/0 conn(0x7f78f4091ed0 legacy=0x7f78f40922b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f359e700 1 -- 172.21.15.72:0/734215374 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f4093b20 con 0x7f78f412cde0 2023-10-03T10:09:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f1d9b700 1 -- 172.21.15.72:0/734215374 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441764810 0 0) 0x7f78f4092c00 con 0x7f78f4091ed0 2023-10-03T10:09:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f2d9d700 1 --2- 172.21.15.72:0/734215374 >> v2:172.21.15.72:3300/0 conn(0x7f78f40613a0 0x7f78f40919e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f359e700 1 --2- 172.21.15.72:0/734215374 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f412cde0 0x7f78f412f1d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f78ec009f20 tx=0x7f78ec009840).ready entity=mon.2 client_cookie=a9f1a3f1c6c0b3d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f1d9b700 1 -- 172.21.15.72:0/734215374 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec00e070 con 0x7f78f412cde0 2023-10-03T10:09:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f1d9b700 1 -- 172.21.15.72:0/734215374 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec00b9d0 con 0x7f78f412cde0 2023-10-03T10:09:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.413+0000 7f78f1d9b700 1 -- 172.21.15.72:0/734215374 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec00bd50 con 0x7f78f412cde0 2023-10-03T10:09:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.414+0000 7f78f90f6700 1 -- 172.21.15.72:0/734215374 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f412cde0 msgr2=0x7f78f412f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.414+0000 7f78f90f6700 1 --2- 172.21.15.72:0/734215374 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f412cde0 0x7f78f412f1d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f78ec009f20 tx=0x7f78ec009840).stop 2023-10-03T10:09:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.414+0000 7f78f90f6700 1 -- 172.21.15.72:0/734215374 shutdown_connections 2023-10-03T10:09:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.414+0000 7f78f90f6700 1 --2- 172.21.15.72:0/734215374 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f412cde0 0x7f78f412f1d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.414+0000 7f78f90f6700 1 --2- 172.21.15.72:0/734215374 >> v2:172.21.15.72:3300/0 conn(0x7f78f40613a0 0x7f78f40919e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.414+0000 7f78f90f6700 1 -- 172.21.15.72:0/734215374 >> 172.21.15.72:0/734215374 conn(0x7f78f409a1c0 msgr2=0x7f78f409a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.414+0000 7f78f90f6700 1 -- 172.21.15.72:0/734215374 shutdown_connections 2023-10-03T10:09:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.414+0000 7f78f90f6700 1 -- 172.21.15.72:0/734215374 wait complete. 2023-10-03T10:09:58.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.415+0000 7f78f90f6700 1 Processor -- start 2023-10-03T10:09:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.415+0000 7f78f90f6700 1 -- start start 2023-10-03T10:09:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.415+0000 7f78f90f6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f40613a0 0x7f78f41285b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.415+0000 7f78f90f6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f4091ed0 0x7f78f41115a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.415+0000 7f78f90f6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f412cde0 0x7f78f4111a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.415+0000 7f78f90f6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f4113ab0 con 0x7f78f40613a0 2023-10-03T10:09:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.415+0000 7f78f90f6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f4093d70 con 0x7f78f412cde0 2023-10-03T10:09:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.415+0000 7f78f90f6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78f41149b0 con 0x7f78f4091ed0 2023-10-03T10:09:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.415+0000 7f78f2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f40613a0 0x7f78f41285b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.415+0000 7f78f2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f40613a0 0x7f78f41285b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60762/0 (socket says 172.21.15.72:60762) 2023-10-03T10:09:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.415+0000 7f78f2d9d700 1 -- 172.21.15.72:0/1499340638 learned_addr learned my addr 172.21.15.72:0/1499340638 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.415+0000 7f78f359e700 1 --2- 172.21.15.72:0/1499340638 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f412cde0 0x7f78f4111a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.415+0000 7f78f259c700 1 --2- 172.21.15.72:0/1499340638 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f4091ed0 0x7f78f41115a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.416+0000 7f78f2d9d700 1 -- 172.21.15.72:0/1499340638 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f4091ed0 msgr2=0x7f78f41115a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.416+0000 7f78f2d9d700 1 --2- 172.21.15.72:0/1499340638 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f4091ed0 0x7f78f41115a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.416+0000 7f78f2d9d700 1 -- 172.21.15.72:0/1499340638 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f412cde0 msgr2=0x7f78f4111a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.416+0000 7f78f2d9d700 1 --2- 172.21.15.72:0/1499340638 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f412cde0 0x7f78f4111a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.416+0000 7f78f2d9d700 1 -- 172.21.15.72:0/1499340638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e80092a0 con 0x7f78f40613a0 2023-10-03T10:09:58.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.416+0000 7f78f2d9d700 1 --2- 172.21.15.72:0/1499340638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f40613a0 0x7f78f41285b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f78e800ea20 tx=0x7f78e8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:58.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.416+0000 7f78daffd700 1 -- 172.21.15.72:0/1499340638 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e800ee60 con 0x7f78f40613a0 2023-10-03T10:09:58.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.416+0000 7f78daffd700 1 -- 172.21.15.72:0/1499340638 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e800c850 con 0x7f78f40613a0 2023-10-03T10:09:58.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.416+0000 7f78f90f6700 1 -- 172.21.15.72:0/1499340638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec009ae0 con 0x7f78f40613a0 2023-10-03T10:09:58.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.416+0000 7f78daffd700 1 -- 172.21.15.72:0/1499340638 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e800cbd0 con 0x7f78f40613a0 2023-10-03T10:09:58.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.416+0000 7f78f90f6700 1 -- 172.21.15.72:0/1499340638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f4115600 con 0x7f78f40613a0 2023-10-03T10:09:58.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.417+0000 7f78daffd700 1 -- 172.21.15.72:0/1499340638 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f78e801b400 con 0x7f78f40613a0 2023-10-03T10:09:58.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.417+0000 7f78daffd700 1 -- 172.21.15.72:0/1499340638 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f78e803b4c0 con 0x7f78f40613a0 2023-10-03T10:09:58.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.417+0000 7f78f90f6700 1 -- 172.21.15.72:0/1499340638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f405a260 con 0x7f78f40613a0 2023-10-03T10:09:58.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.421+0000 7f78daffd700 1 -- 172.21.15.72:0/1499340638 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f78e8019900 con 0x7f78f40613a0 2023-10-03T10:09:58.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.580+0000 7f78f90f6700 1 -- 172.21.15.72:0/1499340638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f78f4046c20 con 0x7f78f40613a0 2023-10-03T10:09:58.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.581+0000 7f78daffd700 1 -- 172.21.15.72:0/1499340638 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f78e8019310 con 0x7f78f40613a0 2023-10-03T10:09:58.581 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-03T10:09:58.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.582+0000 7f78f90f6700 1 -- 172.21.15.72:0/1499340638 >> v1:172.21.15.72:6816/118184 conn(0x7f78e002bb90 legacy=0x7f78e002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.583+0000 7f78f90f6700 1 -- 172.21.15.72:0/1499340638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f40613a0 msgr2=0x7f78f41285b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.583+0000 7f78f90f6700 1 --2- 172.21.15.72:0/1499340638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f40613a0 0x7f78f41285b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f78e800ea20 tx=0x7f78e8009060).stop 2023-10-03T10:09:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.583+0000 7f78f90f6700 1 -- 172.21.15.72:0/1499340638 shutdown_connections 2023-10-03T10:09:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.583+0000 7f78f90f6700 1 --2- 172.21.15.72:0/1499340638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f40613a0 0x7f78f41285b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.583+0000 7f78f90f6700 1 --2- 172.21.15.72:0/1499340638 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f412cde0 0x7f78f4111a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.583+0000 7f78f90f6700 1 --2- 172.21.15.72:0/1499340638 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f4091ed0 0x7f78f41115a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.583+0000 7f78f90f6700 1 -- 172.21.15.72:0/1499340638 >> 172.21.15.72:0/1499340638 conn(0x7f78f409a1c0 msgr2=0x7f78f412b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.583+0000 7f78f90f6700 1 -- 172.21.15.72:0/1499340638 shutdown_connections 2023-10-03T10:09:58.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.583+0000 7f78f90f6700 1 -- 172.21.15.72:0/1499340638 wait complete. 2023-10-03T10:09:58.594 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:09:58.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.712+0000 7fbdd44c6700 1 Processor -- start 2023-10-03T10:09:58.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.712+0000 7fbdd44c6700 1 -- start start 2023-10-03T10:09:58.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.713+0000 7fbdd44c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc093840 0x7fbdcc098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.713+0000 7fbdd44c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc12d160 0x7fbdcc12f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.713+0000 7fbdd44c6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdcc092d80 con 0x7fbdcc098c80 2023-10-03T10:09:58.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.713+0000 7fbdd44c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc093c20 con 0x7fbdcc12d160 2023-10-03T10:09:58.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.713+0000 7fbdd44c6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc092b90 con 0x7fbdcc093840 2023-10-03T10:09:58.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.713+0000 7fbdd2262700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc093840 0x7fbdcc098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.713+0000 7fbdd2a63700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc12d160 0x7fbdcc12f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.713+0000 7fbdd1a61700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbdcc098c80 0x7fbdcc099060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48166/0 (socket says 172.21.15.72:48166) 2023-10-03T10:09:58.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.713+0000 7fbdd1a61700 1 -- 172.21.15.72:0/568454541 learned_addr learned my addr 172.21.15.72:0/568454541 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:58.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.713+0000 7fbdd1260700 1 -- 172.21.15.72:0/568454541 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793719327 0 0) 0x7fbdcc092d80 con 0x7fbdcc098c80 2023-10-03T10:09:58.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.713+0000 7fbdd2a63700 1 -- 172.21.15.72:0/568454541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc093840 msgr2=0x7fbdcc098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:58.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.713+0000 7fbdd2a63700 1 --2- 172.21.15.72:0/568454541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc093840 0x7fbdcc098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.713+0000 7fbdd2a63700 1 -- 172.21.15.72:0/568454541 >> v1:172.21.15.72:6789/0 conn(0x7fbdcc098c80 legacy=0x7fbdcc099060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.713+0000 7fbdd2a63700 1 -- 172.21.15.72:0/568454541 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc099b70 con 0x7fbdcc12d160 2023-10-03T10:09:58.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.713+0000 7fbdd2262700 1 --2- 172.21.15.72:0/568454541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc093840 0x7fbdcc098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:58.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.714+0000 7fbdd2a63700 1 --2- 172.21.15.72:0/568454541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc12d160 0x7fbdcc12f550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fbdc4009e90 tx=0x7fbdc4009780).ready entity=mon.1 client_cookie=dcf4ad9d93957ccf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:58.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.714+0000 7fbdd1260700 1 -- 172.21.15.72:0/568454541 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc400e070 con 0x7fbdcc12d160 2023-10-03T10:09:58.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.714+0000 7fbdd1260700 1 -- 172.21.15.72:0/568454541 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc400bb60 con 0x7fbdcc12d160 2023-10-03T10:09:58.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.714+0000 7fbdd1260700 1 -- 172.21.15.72:0/568454541 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4012410 con 0x7fbdcc12d160 2023-10-03T10:09:58.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.714+0000 7fbdd44c6700 1 -- 172.21.15.72:0/568454541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc12d160 msgr2=0x7fbdcc12f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.714+0000 7fbdd44c6700 1 --2- 172.21.15.72:0/568454541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc12d160 0x7fbdcc12f550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fbdc4009e90 tx=0x7fbdc4009780).stop 2023-10-03T10:09:58.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.714+0000 7fbdd44c6700 1 -- 172.21.15.72:0/568454541 shutdown_connections 2023-10-03T10:09:58.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.714+0000 7fbdd44c6700 1 --2- 172.21.15.72:0/568454541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc12d160 0x7fbdcc12f550 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.714+0000 7fbdd44c6700 1 --2- 172.21.15.72:0/568454541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc093840 0x7fbdcc098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.714+0000 7fbdd44c6700 1 -- 172.21.15.72:0/568454541 >> 172.21.15.72:0/568454541 conn(0x7fbdcc097480 msgr2=0x7fbdcc097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:58.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.714+0000 7fbdd44c6700 1 -- 172.21.15.72:0/568454541 shutdown_connections 2023-10-03T10:09:58.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.714+0000 7fbdd44c6700 1 -- 172.21.15.72:0/568454541 wait complete. 2023-10-03T10:09:58.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.715+0000 7fbdd44c6700 1 Processor -- start 2023-10-03T10:09:58.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.715+0000 7fbdd44c6700 1 -- start start 2023-10-03T10:09:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd44c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc093840 0x7fbdcc11a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd44c6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdcc098c80 0x7fbdcc11a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd44c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc12d160 0x7fbdcc11aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd44c6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc11af20 con 0x7fbdcc098c80 2023-10-03T10:09:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd44c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc11d290 con 0x7fbdcc093840 2023-10-03T10:09:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd44c6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc11bbe0 con 0x7fbdcc12d160 2023-10-03T10:09:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd2262700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc093840 0x7fbdcc11a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd2262700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc093840 0x7fbdcc11a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51354/0 (socket says 172.21.15.72:51354) 2023-10-03T10:09:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd1a61700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdcc098c80 0x7fbdcc11a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd2262700 1 -- 172.21.15.72:0/124773615 learned_addr learned my addr 172.21.15.72:0/124773615 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:58.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd2a63700 1 --2- 172.21.15.72:0/124773615 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc12d160 0x7fbdcc11aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd2262700 1 -- 172.21.15.72:0/124773615 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc12d160 msgr2=0x7fbdcc11aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd2262700 1 --2- 172.21.15.72:0/124773615 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc12d160 0x7fbdcc11aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd2262700 1 -- 172.21.15.72:0/124773615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdcc098c80 msgr2=0x7fbdcc11a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd2262700 1 --2- 172.21.15.72:0/124773615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdcc098c80 0x7fbdcc11a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.716+0000 7fbdd2262700 1 -- 172.21.15.72:0/124773615 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc00b540 con 0x7fbdcc093840 2023-10-03T10:09:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.717+0000 7fbdd2262700 1 --2- 172.21.15.72:0/124773615 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc093840 0x7fbdcc11a050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbdbc00ede0 tx=0x7fbdbc00b300).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.717+0000 7fbdc27fc700 1 -- 172.21.15.72:0/124773615 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00db20 con 0x7fbdcc093840 2023-10-03T10:09:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.717+0000 7fbdc27fc700 1 -- 172.21.15.72:0/124773615 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc00dc80 con 0x7fbdcc093840 2023-10-03T10:09:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.717+0000 7fbdd44c6700 1 -- 172.21.15.72:0/124773615 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc4009a20 con 0x7fbdcc093840 2023-10-03T10:09:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.717+0000 7fbdc27fc700 1 -- 172.21.15.72:0/124773615 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc010440 con 0x7fbdcc093840 2023-10-03T10:09:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.717+0000 7fbdd44c6700 1 -- 172.21.15.72:0/124773615 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdcc06a520 con 0x7fbdcc093840 2023-10-03T10:09:58.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.717+0000 7fbdc27fc700 1 -- 172.21.15.72:0/124773615 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fbdbc0107f0 con 0x7fbdcc093840 2023-10-03T10:09:58.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.718+0000 7fbdc27fc700 1 -- 172.21.15.72:0/124773615 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fbdbc03b850 con 0x7fbdcc093840 2023-10-03T10:09:58.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.718+0000 7fbdd44c6700 1 -- 172.21.15.72:0/124773615 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdcc05a260 con 0x7fbdcc093840 2023-10-03T10:09:58.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.722+0000 7fbdc27fc700 1 -- 172.21.15.72:0/124773615 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fbdbc019400 con 0x7fbdcc093840 2023-10-03T10:09:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.880+0000 7fbdd44c6700 1 -- 172.21.15.72:0/124773615 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbdcc046c20 con 0x7fbdcc093840 2023-10-03T10:09:58.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.880+0000 7fbdc27fc700 1 -- 172.21.15.72:0/124773615 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbdbc017310 con 0x7fbdcc093840 2023-10-03T10:09:58.880 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-10-03T10:09:58.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.882+0000 7fbdd44c6700 1 -- 172.21.15.72:0/124773615 >> v1:172.21.15.72:6816/118184 conn(0x7fbdb002bb60 legacy=0x7fbdb002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.882+0000 7fbdd44c6700 1 -- 172.21.15.72:0/124773615 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc093840 msgr2=0x7fbdcc11a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:58.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.882+0000 7fbdd44c6700 1 --2- 172.21.15.72:0/124773615 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc093840 0x7fbdcc11a050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbdbc00ede0 tx=0x7fbdbc00b300).stop 2023-10-03T10:09:58.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.882+0000 7fbdd44c6700 1 -- 172.21.15.72:0/124773615 shutdown_connections 2023-10-03T10:09:58.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.882+0000 7fbdd44c6700 1 --2- 172.21.15.72:0/124773615 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc12d160 0x7fbdcc11aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.882+0000 7fbdd44c6700 1 --2- 172.21.15.72:0/124773615 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc093840 0x7fbdcc11a050 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.882+0000 7fbdd44c6700 1 --2- 172.21.15.72:0/124773615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdcc098c80 0x7fbdcc11a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:58.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.882+0000 7fbdd44c6700 1 -- 172.21.15.72:0/124773615 >> 172.21.15.72:0/124773615 conn(0x7fbdcc097480 msgr2=0x7fbdcc095320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:58.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.882+0000 7fbdd44c6700 1 -- 172.21.15.72:0/124773615 shutdown_connections 2023-10-03T10:09:58.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:58.882+0000 7fbdd44c6700 1 -- 172.21.15.72:0/124773615 wait complete. 2023-10-03T10:09:58.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.012+0000 7f7f2699f700 1 Processor -- start 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.012+0000 7f7f2699f700 1 -- start start 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f2699f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f200926d0 0x7f7f201275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f2699f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f20128000 0x7f7f2012b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f2699f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f20091c80 con 0x7f7f20127be0 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f2699f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f20099dd0 con 0x7f7f20128000 2023-10-03T10:09:59.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f2699f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200999d0 con 0x7f7f200926d0 2023-10-03T10:09:59.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f1ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f200926d0 0x7f7f201275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f24f3c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f20128000 0x7f7f2012b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f24f3c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f20128000 0x7f7f2012b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60768/0 (socket says 172.21.15.72:60768) 2023-10-03T10:09:59.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f1ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f200926d0 0x7f7f201275c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51366/0 (socket says 172.21.15.72:51366) 2023-10-03T10:09:59.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f24f3c700 1 -- 172.21.15.72:0/3083984897 learned_addr learned my addr 172.21.15.72:0/3083984897 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:59.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f1f7fe700 1 --1- 172.21.15.72:0/3083984897 >> v1:172.21.15.72:6789/0 conn(0x7f7f20127be0 0x7f7f2012a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48170/0 (socket says 172.21.15.72:48170) 2023-10-03T10:09:59.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f24f3c700 1 -- 172.21.15.72:0/3083984897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f200926d0 msgr2=0x7f7f201275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:59.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f24f3c700 1 --2- 172.21.15.72:0/3083984897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f200926d0 0x7f7f201275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f24f3c700 1 -- 172.21.15.72:0/3083984897 >> v1:172.21.15.72:6789/0 conn(0x7f7f20127be0 legacy=0x7f7f2012a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f24f3c700 1 -- 172.21.15.72:0/3083984897 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2009a280 con 0x7f7f20128000 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f1effd700 1 -- 172.21.15.72:0/3083984897 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849973545 0 0) 0x7f7f20091c80 con 0x7f7f20127be0 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f1ffff700 1 --2- 172.21.15.72:0/3083984897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f200926d0 0x7f7f201275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.013+0000 7f7f24f3c700 1 --2- 172.21.15.72:0/3083984897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f20128000 0x7f7f2012b0b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f7f18009f20 tx=0x7f7f18009840).ready entity=mon.0 client_cookie=e9a6495aa19e4576 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.014+0000 7f7f1effd700 1 -- 172.21.15.72:0/3083984897 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800e070 con 0x7f7f20128000 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.014+0000 7f7f1effd700 1 -- 172.21.15.72:0/3083984897 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1800b9d0 con 0x7f7f20128000 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.014+0000 7f7f1effd700 1 -- 172.21.15.72:0/3083984897 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800bd50 con 0x7f7f20128000 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.014+0000 7f7f2699f700 1 -- 172.21.15.72:0/3083984897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f20128000 msgr2=0x7f7f2012b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.014+0000 7f7f2699f700 1 --2- 172.21.15.72:0/3083984897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f20128000 0x7f7f2012b0b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f7f18009f20 tx=0x7f7f18009840).stop 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.014+0000 7f7f2699f700 1 -- 172.21.15.72:0/3083984897 shutdown_connections 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.014+0000 7f7f2699f700 1 --2- 172.21.15.72:0/3083984897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f20128000 0x7f7f2012b0b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.014+0000 7f7f2699f700 1 --2- 172.21.15.72:0/3083984897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f200926d0 0x7f7f201275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.014+0000 7f7f2699f700 1 -- 172.21.15.72:0/3083984897 >> 172.21.15.72:0/3083984897 conn(0x7f7f20097480 msgr2=0x7f7f20097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.014+0000 7f7f2699f700 1 -- 172.21.15.72:0/3083984897 shutdown_connections 2023-10-03T10:09:59.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.014+0000 7f7f2699f700 1 -- 172.21.15.72:0/3083984897 wait complete. 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.015+0000 7f7f2699f700 1 Processor -- start 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.015+0000 7f7f2699f700 1 -- start start 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.016+0000 7f7f2699f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f200926d0 0x7f7f20113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.016+0000 7f7f2699f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f20127be0 0x7f7f20113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.016+0000 7f7f2699f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f20128000 0x7f7f20114470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.016+0000 7f7f2699f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2009a4b0 con 0x7f7f200926d0 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.016+0000 7f7f2699f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20116f90 con 0x7f7f20128000 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.016+0000 7f7f2699f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20117530 con 0x7f7f20127be0 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.016+0000 7f7f1ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f200926d0 0x7f7f20113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.016+0000 7f7f1ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f200926d0 0x7f7f20113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60770/0 (socket says 172.21.15.72:60770) 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.016+0000 7f7f1ffff700 1 -- 172.21.15.72:0/1726651336 learned_addr learned my addr 172.21.15.72:0/1726651336 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.016+0000 7f7f1f7fe700 1 --2- 172.21.15.72:0/1726651336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f20127be0 0x7f7f20113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.016+0000 7f7f24f3c700 1 --2- 172.21.15.72:0/1726651336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f20128000 0x7f7f20114470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.017+0000 7f7f1f7fe700 1 -- 172.21.15.72:0/1726651336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f20128000 msgr2=0x7f7f20114470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.017+0000 7f7f1f7fe700 1 --2- 172.21.15.72:0/1726651336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f20128000 0x7f7f20114470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.017+0000 7f7f1f7fe700 1 -- 172.21.15.72:0/1726651336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f200926d0 msgr2=0x7f7f20113a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.017+0000 7f7f1f7fe700 1 --2- 172.21.15.72:0/1726651336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f200926d0 0x7f7f20113a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.017+0000 7f7f1f7fe700 1 -- 172.21.15.72:0/1726651336 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f080092a0 con 0x7f7f20127be0 2023-10-03T10:09:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.017+0000 7f7f1ffff700 1 --2- 172.21.15.72:0/1726651336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f200926d0 0x7f7f20113a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.017+0000 7f7f24f3c700 1 --2- 172.21.15.72:0/1726651336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f20128000 0x7f7f20114470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.017+0000 7f7f1f7fe700 1 --2- 172.21.15.72:0/1726651336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f20127be0 0x7f7f20113f80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f7f10000c00 tx=0x7f7f10007bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.017+0000 7f7f17fff700 1 -- 172.21.15.72:0/1726651336 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100070d0 con 0x7f7f20127be0 2023-10-03T10:09:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.017+0000 7f7f17fff700 1 -- 172.21.15.72:0/1726651336 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f10007230 con 0x7f7f20127be0 2023-10-03T10:09:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.017+0000 7f7f2699f700 1 -- 172.21.15.72:0/1726651336 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f18009ae0 con 0x7f7f20127be0 2023-10-03T10:09:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.017+0000 7f7f17fff700 1 -- 172.21.15.72:0/1726651336 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100056e0 con 0x7f7f20127be0 2023-10-03T10:09:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.017+0000 7f7f2699f700 1 -- 172.21.15.72:0/1726651336 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f20117dd0 con 0x7f7f20127be0 2023-10-03T10:09:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.017+0000 7f7f17fff700 1 -- 172.21.15.72:0/1726651336 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7f10005a90 con 0x7f7f20127be0 2023-10-03T10:09:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.018+0000 7f7f17fff700 1 -- 172.21.15.72:0/1726651336 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7f1003a490 con 0x7f7f20127be0 2023-10-03T10:09:59.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.018+0000 7f7f2699f700 1 -- 172.21.15.72:0/1726651336 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f20117dd0 con 0x7f7f20127be0 2023-10-03T10:09:59.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.022+0000 7f7f17fff700 1 -- 172.21.15.72:0/1726651336 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7f20117dd0 con 0x7f7f20127be0 2023-10-03T10:09:59.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.178+0000 7f7f2699f700 1 -- 172.21.15.72:0/1726651336 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f20117dd0 con 0x7f7f20127be0 2023-10-03T10:09:59.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.178+0000 7f7f17fff700 1 -- 172.21.15.72:0/1726651336 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f20117dd0 con 0x7f7f20127be0 2023-10-03T10:09:59.178 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-03T10:09:59.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.180+0000 7f7f2699f700 1 -- 172.21.15.72:0/1726651336 >> v1:172.21.15.72:6816/118184 conn(0x7f7f0002bb60 legacy=0x7f7f0002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.180+0000 7f7f2699f700 1 -- 172.21.15.72:0/1726651336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f20127be0 msgr2=0x7f7f20113f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.180+0000 7f7f2699f700 1 --2- 172.21.15.72:0/1726651336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f20127be0 0x7f7f20113f80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f7f10000c00 tx=0x7f7f10007bb0).stop 2023-10-03T10:09:59.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.180+0000 7f7f2699f700 1 -- 172.21.15.72:0/1726651336 shutdown_connections 2023-10-03T10:09:59.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.180+0000 7f7f2699f700 1 --2- 172.21.15.72:0/1726651336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f200926d0 0x7f7f20113a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.180+0000 7f7f2699f700 1 --2- 172.21.15.72:0/1726651336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f20128000 0x7f7f20114470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.180+0000 7f7f2699f700 1 --2- 172.21.15.72:0/1726651336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f20127be0 0x7f7f20113f80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.180+0000 7f7f2699f700 1 -- 172.21.15.72:0/1726651336 >> 172.21.15.72:0/1726651336 conn(0x7f7f20097480 msgr2=0x7f7f20126b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.180+0000 7f7f2699f700 1 -- 172.21.15.72:0/1726651336 shutdown_connections 2023-10-03T10:09:59.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.180+0000 7f7f2699f700 1 -- 172.21.15.72:0/1726651336 wait complete. 2023-10-03T10:09:59.191 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:09:59.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.310+0000 7f41ecb1a700 1 Processor -- start 2023-10-03T10:09:59.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.310+0000 7f41ecb1a700 1 -- start start 2023-10-03T10:09:59.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41ecb1a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41e80943b0 0x7f41e8126e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41ecb1a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41e8127820 0x7f41e8124060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41ecb1a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e8093e90 con 0x7f41e8127440 2023-10-03T10:09:59.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41ecb1a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e8127cd0 con 0x7f41e8127820 2023-10-03T10:09:59.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41ecb1a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41e8094790 con 0x7f41e80943b0 2023-10-03T10:09:59.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41e659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41e80943b0 0x7f41e8126e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41e6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41e8127820 0x7f41e8124060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41e5d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f41e8127440 0x7f41e8123950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48186/0 (socket says 172.21.15.72:48186) 2023-10-03T10:09:59.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41e5d9b700 1 -- 172.21.15.72:0/2648178099 learned_addr learned my addr 172.21.15.72:0/2648178099 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:59.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41e559a700 1 -- 172.21.15.72:0/2648178099 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481923098 0 0) 0x7f41e8093e90 con 0x7f41e8127440 2023-10-03T10:09:59.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41e6d9d700 1 -- 172.21.15.72:0/2648178099 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41e80943b0 msgr2=0x7f41e8126e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:59.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41e6d9d700 1 --2- 172.21.15.72:0/2648178099 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41e80943b0 0x7f41e8126e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41e6d9d700 1 -- 172.21.15.72:0/2648178099 >> v1:172.21.15.72:6789/0 conn(0x7f41e8127440 legacy=0x7f41e8123950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41e6d9d700 1 -- 172.21.15.72:0/2648178099 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e8093bb0 con 0x7f41e8127820 2023-10-03T10:09:59.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41e659c700 1 --2- 172.21.15.72:0/2648178099 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41e80943b0 0x7f41e8126e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:59.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.311+0000 7f41e6d9d700 1 --2- 172.21.15.72:0/2648178099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41e8127820 0x7f41e8124060 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f41e0009e90 tx=0x7f41e0009780).ready entity=mon.1 client_cookie=b7a1d466647aa2ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.312+0000 7f41e559a700 1 -- 172.21.15.72:0/2648178099 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e000e070 con 0x7f41e8127820 2023-10-03T10:09:59.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.312+0000 7f41e559a700 1 -- 172.21.15.72:0/2648178099 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e000bb60 con 0x7f41e8127820 2023-10-03T10:09:59.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.312+0000 7f41e559a700 1 -- 172.21.15.72:0/2648178099 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e0012410 con 0x7f41e8127820 2023-10-03T10:09:59.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.312+0000 7f41ecb1a700 1 -- 172.21.15.72:0/2648178099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41e8127820 msgr2=0x7f41e8124060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.312+0000 7f41ecb1a700 1 --2- 172.21.15.72:0/2648178099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41e8127820 0x7f41e8124060 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f41e0009e90 tx=0x7f41e0009780).stop 2023-10-03T10:09:59.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.312+0000 7f41ecb1a700 1 -- 172.21.15.72:0/2648178099 shutdown_connections 2023-10-03T10:09:59.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.312+0000 7f41ecb1a700 1 --2- 172.21.15.72:0/2648178099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41e8127820 0x7f41e8124060 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.312+0000 7f41ecb1a700 1 --2- 172.21.15.72:0/2648178099 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41e80943b0 0x7f41e8126e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.312+0000 7f41ecb1a700 1 -- 172.21.15.72:0/2648178099 >> 172.21.15.72:0/2648178099 conn(0x7f41e809a1c0 msgr2=0x7f41e809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.312+0000 7f41ecb1a700 1 -- 172.21.15.72:0/2648178099 shutdown_connections 2023-10-03T10:09:59.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.312+0000 7f41ecb1a700 1 -- 172.21.15.72:0/2648178099 wait complete. 2023-10-03T10:09:59.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.313+0000 7f41ecb1a700 1 Processor -- start 2023-10-03T10:09:59.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.313+0000 7f41ecb1a700 1 -- start start 2023-10-03T10:09:59.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.313+0000 7f41ecb1a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e80943b0 0x7f41e8110f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.313+0000 7f41ecb1a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41e8127440 0x7f41e8111430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41ecb1a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41e8127820 0x7f41e8111920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41ecb1a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e8110d10 con 0x7f41e80943b0 2023-10-03T10:09:59.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41ecb1a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e8126ba0 con 0x7f41e8127440 2023-10-03T10:09:59.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41ecb1a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41e8092e90 con 0x7f41e8127820 2023-10-03T10:09:59.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41e659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e80943b0 0x7f41e8110f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41e5d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41e8127440 0x7f41e8111430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41e659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e80943b0 0x7f41e8110f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60786/0 (socket says 172.21.15.72:60786) 2023-10-03T10:09:59.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41e659c700 1 -- 172.21.15.72:0/2461555477 learned_addr learned my addr 172.21.15.72:0/2461555477 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:59.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41e6d9d700 1 --2- 172.21.15.72:0/2461555477 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41e8127820 0x7f41e8111920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41e5d9b700 1 -- 172.21.15.72:0/2461555477 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41e8127820 msgr2=0x7f41e8111920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41e5d9b700 1 --2- 172.21.15.72:0/2461555477 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41e8127820 0x7f41e8111920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41e5d9b700 1 -- 172.21.15.72:0/2461555477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e80943b0 msgr2=0x7f41e8110f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41e5d9b700 1 --2- 172.21.15.72:0/2461555477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e80943b0 0x7f41e8110f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41e5d9b700 1 -- 172.21.15.72:0/2461555477 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d00092a0 con 0x7f41e8127440 2023-10-03T10:09:59.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41e6d9d700 1 --2- 172.21.15.72:0/2461555477 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41e8127820 0x7f41e8111920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:59.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41e659c700 1 --2- 172.21.15.72:0/2461555477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e80943b0 0x7f41e8110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:59.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41e5d9b700 1 --2- 172.21.15.72:0/2461555477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41e8127440 0x7f41e8111430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f41d8001eb0 tx=0x7f41d8007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41de7fc700 1 -- 172.21.15.72:0/2461555477 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d80070d0 con 0x7f41e8127440 2023-10-03T10:09:59.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41de7fc700 1 -- 172.21.15.72:0/2461555477 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d8007250 con 0x7f41e8127440 2023-10-03T10:09:59.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41ecb1a700 1 -- 172.21.15.72:0/2461555477 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e0009a20 con 0x7f41e8127440 2023-10-03T10:09:59.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41de7fc700 1 -- 172.21.15.72:0/2461555477 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8007610 con 0x7f41e8127440 2023-10-03T10:09:59.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.314+0000 7f41ecb1a700 1 -- 172.21.15.72:0/2461555477 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e8114a30 con 0x7f41e8127440 2023-10-03T10:09:59.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.315+0000 7f41de7fc700 1 -- 172.21.15.72:0/2461555477 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f41d80059b0 con 0x7f41e8127440 2023-10-03T10:09:59.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.315+0000 7f41de7fc700 1 -- 172.21.15.72:0/2461555477 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f41d803a5d0 con 0x7f41e8127440 2023-10-03T10:09:59.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.315+0000 7f41ecb1a700 1 -- 172.21.15.72:0/2461555477 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e805a260 con 0x7f41e8127440 2023-10-03T10:09:59.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.319+0000 7f41de7fc700 1 -- 172.21.15.72:0/2461555477 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f41d8013970 con 0x7f41e8127440 2023-10-03T10:09:59.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.477+0000 7f41ecb1a700 1 -- 172.21.15.72:0/2461555477 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41e8068ee0 con 0x7f41e8127440 2023-10-03T10:09:59.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.477+0000 7f41de7fc700 1 -- 172.21.15.72:0/2461555477 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41d8018020 con 0x7f41e8127440 2023-10-03T10:09:59.477 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-03T10:09:59.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.479+0000 7f41ecb1a700 1 -- 172.21.15.72:0/2461555477 >> v1:172.21.15.72:6816/118184 conn(0x7f41c802bb60 legacy=0x7f41c802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.479+0000 7f41ecb1a700 1 -- 172.21.15.72:0/2461555477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41e8127440 msgr2=0x7f41e8111430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.479+0000 7f41ecb1a700 1 --2- 172.21.15.72:0/2461555477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41e8127440 0x7f41e8111430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f41d8001eb0 tx=0x7f41d8007b90).stop 2023-10-03T10:09:59.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.479+0000 7f41ecb1a700 1 -- 172.21.15.72:0/2461555477 shutdown_connections 2023-10-03T10:09:59.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.479+0000 7f41ecb1a700 1 --2- 172.21.15.72:0/2461555477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e80943b0 0x7f41e8110f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.479+0000 7f41ecb1a700 1 --2- 172.21.15.72:0/2461555477 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41e8127820 0x7f41e8111920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.479+0000 7f41ecb1a700 1 --2- 172.21.15.72:0/2461555477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41e8127440 0x7f41e8111430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.479+0000 7f41ecb1a700 1 -- 172.21.15.72:0/2461555477 >> 172.21.15.72:0/2461555477 conn(0x7f41e809a1c0 msgr2=0x7f41e80674b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.479+0000 7f41ecb1a700 1 -- 172.21.15.72:0/2461555477 shutdown_connections 2023-10-03T10:09:59.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.479+0000 7f41ecb1a700 1 -- 172.21.15.72:0/2461555477 wait complete. 2023-10-03T10:09:59.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:09:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.606+0000 7f961258d700 1 Processor -- start 2023-10-03T10:09:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.606+0000 7f961258d700 1 -- start start 2023-10-03T10:09:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.606+0000 7f961258d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c096380 0x7f960c094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.606+0000 7f961258d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c091b00 0x7f960c127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.606+0000 7f961258d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960c096760 con 0x7f960c094c20 2023-10-03T10:09:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.606+0000 7f961258d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c091ff0 con 0x7f960c091b00 2023-10-03T10:09:59.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.606+0000 7f961258d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f960c092c80 con 0x7f960c096380 2023-10-03T10:09:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.606+0000 7f960bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c096380 0x7f960c094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.606+0000 7f960b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c091b00 0x7f960c127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.606+0000 7f9610b2a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f960c094c20 0x7f960c127af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48190/0 (socket says 172.21.15.72:48190) 2023-10-03T10:09:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.606+0000 7f960bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c096380 0x7f960c094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59498/0 (socket says 172.21.15.72:59498) 2023-10-03T10:09:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.606+0000 7f9610b2a700 1 -- 172.21.15.72:0/326044032 learned_addr learned my addr 172.21.15.72:0/326044032 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.606+0000 7f960b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c091b00 0x7f960c127600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51406/0 (socket says 172.21.15.72:51406) 2023-10-03T10:09:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f960bfff700 1 -- 172.21.15.72:0/326044032 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c091b00 msgr2=0x7f960c127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f960bfff700 1 --2- 172.21.15.72:0/326044032 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c091b00 0x7f960c127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f960affd700 1 -- 172.21.15.72:0/326044032 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066738392 0 0) 0x7f960c096760 con 0x7f960c094c20 2023-10-03T10:09:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f960bfff700 1 -- 172.21.15.72:0/326044032 >> v1:172.21.15.72:6789/0 conn(0x7f960c094c20 legacy=0x7f960c127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f960bfff700 1 -- 172.21.15.72:0/326044032 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c093900 con 0x7f960c096380 2023-10-03T10:09:59.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f960b7fe700 1 --2- 172.21.15.72:0/326044032 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c091b00 0x7f960c127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:59.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f960bfff700 1 --2- 172.21.15.72:0/326044032 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c096380 0x7f960c094730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f95fc009790 tx=0x7f95fc009060).ready entity=mon.2 client_cookie=e884c763286d0c42 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f960affd700 1 -- 172.21.15.72:0/326044032 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00f510 con 0x7f960c096380 2023-10-03T10:09:59.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f960affd700 1 -- 172.21.15.72:0/326044032 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc00f670 con 0x7f960c096380 2023-10-03T10:09:59.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f960affd700 1 -- 172.21.15.72:0/326044032 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00f9f0 con 0x7f960c096380 2023-10-03T10:09:59.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f961258d700 1 -- 172.21.15.72:0/326044032 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c096380 msgr2=0x7f960c094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f961258d700 1 --2- 172.21.15.72:0/326044032 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c096380 0x7f960c094730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f95fc009790 tx=0x7f95fc009060).stop 2023-10-03T10:09:59.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f961258d700 1 -- 172.21.15.72:0/326044032 shutdown_connections 2023-10-03T10:09:59.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f961258d700 1 --2- 172.21.15.72:0/326044032 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c096380 0x7f960c094730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f961258d700 1 --2- 172.21.15.72:0/326044032 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c091b00 0x7f960c127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.607+0000 7f961258d700 1 -- 172.21.15.72:0/326044032 >> 172.21.15.72:0/326044032 conn(0x7f960c097470 msgr2=0x7f960c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.608+0000 7f961258d700 1 -- 172.21.15.72:0/326044032 shutdown_connections 2023-10-03T10:09:59.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.608+0000 7f961258d700 1 -- 172.21.15.72:0/326044032 wait complete. 2023-10-03T10:09:59.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.608+0000 7f961258d700 1 Processor -- start 2023-10-03T10:09:59.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f961258d700 1 -- start start 2023-10-03T10:09:59.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f961258d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f960c091b00 0x7f960c12af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f961258d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c094c20 0x7f960c12b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f961258d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c096380 0x7f960c12b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f961258d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0940b0 con 0x7f960c091b00 2023-10-03T10:09:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f961258d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c12df70 con 0x7f960c096380 2023-10-03T10:09:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f961258d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f960c127bd0 con 0x7f960c094c20 2023-10-03T10:09:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f960b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c094c20 0x7f960c12b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f960b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c094c20 0x7f960c12b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59512/0 (socket says 172.21.15.72:59512) 2023-10-03T10:09:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f960bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f960c091b00 0x7f960c12af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f960b7fe700 1 -- 172.21.15.72:0/200837841 learned_addr learned my addr 172.21.15.72:0/200837841 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:59.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f9610b2a700 1 --2- 172.21.15.72:0/200837841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c096380 0x7f960c12b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f960b7fe700 1 -- 172.21.15.72:0/200837841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c096380 msgr2=0x7f960c12b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f960b7fe700 1 --2- 172.21.15.72:0/200837841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c096380 0x7f960c12b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f960b7fe700 1 -- 172.21.15.72:0/200837841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f960c091b00 msgr2=0x7f960c12af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f960b7fe700 1 --2- 172.21.15.72:0/200837841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f960c091b00 0x7f960c12af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f960b7fe700 1 -- 172.21.15.72:0/200837841 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000092a0 con 0x7f960c094c20 2023-10-03T10:09:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f960bfff700 1 --2- 172.21.15.72:0/200837841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f960c091b00 0x7f960c12af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.609+0000 7f960b7fe700 1 --2- 172.21.15.72:0/200837841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c094c20 0x7f960c12b420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f960000ea20 tx=0x7f9600009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.610+0000 7f95f3fff700 1 -- 172.21.15.72:0/200837841 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000ee60 con 0x7f960c094c20 2023-10-03T10:09:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.610+0000 7f95f3fff700 1 -- 172.21.15.72:0/200837841 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600009600 con 0x7f960c094c20 2023-10-03T10:09:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.610+0000 7f95f3fff700 1 -- 172.21.15.72:0/200837841 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000ca60 con 0x7f960c094c20 2023-10-03T10:09:59.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.610+0000 7f961258d700 1 -- 172.21.15.72:0/200837841 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95fc0092a0 con 0x7f960c094c20 2023-10-03T10:09:59.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.610+0000 7f961258d700 1 -- 172.21.15.72:0/200837841 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c12be00 con 0x7f960c094c20 2023-10-03T10:09:59.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.610+0000 7f95f3fff700 1 -- 172.21.15.72:0/200837841 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f960001b400 con 0x7f960c094c20 2023-10-03T10:09:59.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.610+0000 7f95f3fff700 1 -- 172.21.15.72:0/200837841 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f960003b410 con 0x7f960c094c20 2023-10-03T10:09:59.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.611+0000 7f961258d700 1 -- 172.21.15.72:0/200837841 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c097b80 con 0x7f960c094c20 2023-10-03T10:09:59.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.615+0000 7f95f3fff700 1 -- 172.21.15.72:0/200837841 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f9600016030 con 0x7f960c094c20 2023-10-03T10:09:59.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.811+0000 7f961258d700 1 -- 172.21.15.72:0/200837841 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f960c05a260 con 0x7f960c094c20 2023-10-03T10:09:59.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.812+0000 7f95f3fff700 1 -- 172.21.15.72:0/200837841 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2154 (secure 0 0 0) 0x7f9600029090 con 0x7f960c094c20 2023-10-03T10:09:59.812 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:09:59.812 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:46.344785+0000","modified":"2023-10-03T10:09:48.352357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6817/542674768","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6817","nonce":542674768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:09:59.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.813+0000 7f961258d700 1 -- 172.21.15.72:0/200837841 >> v1:172.21.15.72:6816/118184 conn(0x7f95f802bb60 legacy=0x7f95f802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.813+0000 7f961258d700 1 -- 172.21.15.72:0/200837841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c094c20 msgr2=0x7f960c12b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.813+0000 7f961258d700 1 --2- 172.21.15.72:0/200837841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c094c20 0x7f960c12b420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f960000ea20 tx=0x7f9600009060).stop 2023-10-03T10:09:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.813+0000 7f961258d700 1 -- 172.21.15.72:0/200837841 shutdown_connections 2023-10-03T10:09:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.813+0000 7f961258d700 1 --2- 172.21.15.72:0/200837841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f960c091b00 0x7f960c12af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.813+0000 7f961258d700 1 --2- 172.21.15.72:0/200837841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c096380 0x7f960c12b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.813+0000 7f961258d700 1 --2- 172.21.15.72:0/200837841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c094c20 0x7f960c12b420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.813+0000 7f961258d700 1 -- 172.21.15.72:0/200837841 >> 172.21.15.72:0/200837841 conn(0x7f960c097470 msgr2=0x7f960c059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.814+0000 7f961258d700 1 -- 172.21.15.72:0/200837841 shutdown_connections 2023-10-03T10:09:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.814+0000 7f961258d700 1 -- 172.21.15.72:0/200837841 wait complete. 2023-10-03T10:09:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 5 2023-10-03T10:09:59.825 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:09:59.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.942+0000 7fa681d4a700 1 Processor -- start 2023-10-03T10:09:59.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.942+0000 7fa681d4a700 1 -- start start 2023-10-03T10:09:59.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa681d4a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa67c096610 0x7fa67c0969f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa681d4a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa67c0684f0 0x7fa67c12fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa681d4a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67c069ad0 con 0x7fa67c096ee0 2023-10-03T10:09:59.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa681d4a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa67c093420 con 0x7fa67c096610 2023-10-03T10:09:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa681d4a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c091ef0 con 0x7fa67c0684f0 2023-10-03T10:09:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa67bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa67c0684f0 0x7fa67c12fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa67b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa67c096610 0x7fa67c0969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa67affd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa67c096ee0 0x7fa67c067de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48196/0 (socket says 172.21.15.72:48196) 2023-10-03T10:09:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa67affd700 1 -- 172.21.15.72:0/4174804017 learned_addr learned my addr 172.21.15.72:0/4174804017 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:09:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa67b7fe700 1 -- 172.21.15.72:0/4174804017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa67c0684f0 msgr2=0x7fa67c12fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:09:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa67b7fe700 1 --2- 172.21.15.72:0/4174804017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa67c0684f0 0x7fa67c12fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa67b7fe700 1 -- 172.21.15.72:0/4174804017 >> v1:172.21.15.72:6789/0 conn(0x7fa67c096ee0 legacy=0x7fa67c067de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa67b7fe700 1 -- 172.21.15.72:0/4174804017 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c092450 con 0x7fa67c096610 2023-10-03T10:09:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa67a7fc700 1 -- 172.21.15.72:0/4174804017 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901939322 0 0) 0x7fa67c069ad0 con 0x7fa67c096ee0 2023-10-03T10:09:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa67bfff700 1 --2- 172.21.15.72:0/4174804017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa67c0684f0 0x7fa67c12fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:09:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.943+0000 7fa67b7fe700 1 --2- 172.21.15.72:0/4174804017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa67c096610 0x7fa67c0969f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa66c009760 tx=0x7fa66c009060).ready entity=mon.0 client_cookie=c3f248229ef5daf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.944+0000 7fa67a7fc700 1 -- 172.21.15.72:0/4174804017 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0090d0 con 0x7fa67c096610 2023-10-03T10:09:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.944+0000 7fa67a7fc700 1 -- 172.21.15.72:0/4174804017 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c00f510 con 0x7fa67c096610 2023-10-03T10:09:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.944+0000 7fa67a7fc700 1 -- 172.21.15.72:0/4174804017 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00f890 con 0x7fa67c096610 2023-10-03T10:09:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.944+0000 7fa681d4a700 1 -- 172.21.15.72:0/4174804017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa67c096610 msgr2=0x7fa67c0969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.944+0000 7fa681d4a700 1 --2- 172.21.15.72:0/4174804017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa67c096610 0x7fa67c0969f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa66c009760 tx=0x7fa66c009060).stop 2023-10-03T10:09:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.944+0000 7fa681d4a700 1 -- 172.21.15.72:0/4174804017 shutdown_connections 2023-10-03T10:09:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.944+0000 7fa681d4a700 1 --2- 172.21.15.72:0/4174804017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa67c0684f0 0x7fa67c12fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.944+0000 7fa681d4a700 1 --2- 172.21.15.72:0/4174804017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa67c096610 0x7fa67c0969f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.944+0000 7fa681d4a700 1 -- 172.21.15.72:0/4174804017 >> 172.21.15.72:0/4174804017 conn(0x7fa67c09a220 msgr2=0x7fa67c09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:09:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.944+0000 7fa681d4a700 1 -- 172.21.15.72:0/4174804017 shutdown_connections 2023-10-03T10:09:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.944+0000 7fa681d4a700 1 -- 172.21.15.72:0/4174804017 wait complete. 2023-10-03T10:09:59.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.945+0000 7fa681d4a700 1 Processor -- start 2023-10-03T10:09:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.945+0000 7fa681d4a700 1 -- start start 2023-10-03T10:09:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa681d4a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa67c0684f0 0x7fa67c127b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa681d4a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa67c096610 0x7fa67c128060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa681d4a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa67c096ee0 0x7fa67c113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:09:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa681d4a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c091bf0 con 0x7fa67c0684f0 2023-10-03T10:09:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa681d4a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c0995f0 con 0x7fa67c096610 2023-10-03T10:09:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa681d4a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c11b2f0 con 0x7fa67c096ee0 2023-10-03T10:09:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa67b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa67c0684f0 0x7fa67c127b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa67b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa67c0684f0 0x7fa67c127b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60820/0 (socket says 172.21.15.72:60820) 2023-10-03T10:09:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa67b7fe700 1 -- 172.21.15.72:0/69415571 learned_addr learned my addr 172.21.15.72:0/69415571 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:09:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa67affd700 1 --2- 172.21.15.72:0/69415571 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa67c096610 0x7fa67c128060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa67bfff700 1 --2- 172.21.15.72:0/69415571 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa67c096ee0 0x7fa67c113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:09:59.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa67b7fe700 1 -- 172.21.15.72:0/69415571 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa67c096ee0 msgr2=0x7fa67c113bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa67b7fe700 1 --2- 172.21.15.72:0/69415571 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa67c096ee0 0x7fa67c113bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa67b7fe700 1 -- 172.21.15.72:0/69415571 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa67c096610 msgr2=0x7fa67c128060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:09:59.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa67b7fe700 1 --2- 172.21.15.72:0/69415571 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa67c096610 0x7fa67c128060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:09:59.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa67b7fe700 1 -- 172.21.15.72:0/69415571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674009a20 con 0x7fa67c0684f0 2023-10-03T10:09:59.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa67b7fe700 1 --2- 172.21.15.72:0/69415571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa67c0684f0 0x7fa67c127b70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa66c009190 tx=0x7fa66c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:09:59.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa6637fe700 1 -- 172.21.15.72:0/69415571 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00f890 con 0x7fa67c0684f0 2023-10-03T10:09:59.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa6637fe700 1 -- 172.21.15.72:0/69415571 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c006930 con 0x7fa67c0684f0 2023-10-03T10:09:59.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa681d4a700 1 -- 172.21.15.72:0/69415571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c0092a0 con 0x7fa67c0684f0 2023-10-03T10:09:59.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa6637fe700 1 -- 172.21.15.72:0/69415571 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00fea0 con 0x7fa67c0684f0 2023-10-03T10:09:59.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.946+0000 7fa681d4a700 1 -- 172.21.15.72:0/69415571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67c11a6b0 con 0x7fa67c0684f0 2023-10-03T10:09:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.947+0000 7fa6637fe700 1 -- 172.21.15.72:0/69415571 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa66c01b620 con 0x7fa67c0684f0 2023-10-03T10:09:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.947+0000 7fa6637fe700 1 -- 172.21.15.72:0/69415571 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa66c03c990 con 0x7fa67c0684f0 2023-10-03T10:09:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.948+0000 7fa681d4a700 1 -- 172.21.15.72:0/69415571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67c05a260 con 0x7fa67c0684f0 2023-10-03T10:09:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:09:59.952+0000 7fa6637fe700 1 -- 172.21.15.72:0/69415571 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa66c01f080 con 0x7fa67c0684f0 2023-10-03T10:10:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.110+0000 7fa681d4a700 1 -- 172.21.15.72:0/69415571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa67c046c20 con 0x7fa67c0684f0 2023-10-03T10:10:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.111+0000 7fa6637fe700 1 -- 172.21.15.72:0/69415571 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7fa66c029020 con 0x7fa67c0684f0 2023-10-03T10:10:00.111 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:10:00.111 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:09:47.346977+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:00.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.112+0000 7fa681d4a700 1 -- 172.21.15.72:0/69415571 >> v1:172.21.15.72:6816/118184 conn(0x7fa66802bb60 legacy=0x7fa66802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.112+0000 7fa681d4a700 1 -- 172.21.15.72:0/69415571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa67c0684f0 msgr2=0x7fa67c127b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.112+0000 7fa681d4a700 1 --2- 172.21.15.72:0/69415571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa67c0684f0 0x7fa67c127b70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa66c009190 tx=0x7fa66c017000).stop 2023-10-03T10:10:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.112+0000 7fa681d4a700 1 -- 172.21.15.72:0/69415571 shutdown_connections 2023-10-03T10:10:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.112+0000 7fa681d4a700 1 --2- 172.21.15.72:0/69415571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa67c0684f0 0x7fa67c127b70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.112+0000 7fa681d4a700 1 --2- 172.21.15.72:0/69415571 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa67c096ee0 0x7fa67c113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.112+0000 7fa681d4a700 1 --2- 172.21.15.72:0/69415571 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa67c096610 0x7fa67c128060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.112+0000 7fa681d4a700 1 -- 172.21.15.72:0/69415571 >> 172.21.15.72:0/69415571 conn(0x7fa67c09a220 msgr2=0x7fa67c12ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.112+0000 7fa681d4a700 1 -- 172.21.15.72:0/69415571 shutdown_connections 2023-10-03T10:10:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.112+0000 7fa681d4a700 1 -- 172.21.15.72:0/69415571 wait complete. 2023-10-03T10:10:00.124 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:38.963446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:40.092839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:44.713857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:45.314387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-03T10:10:00.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:10:00.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.245+0000 7fddf249c700 1 Processor -- start 2023-10-03T10:10:00.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.245+0000 7fddf249c700 1 -- start start 2023-10-03T10:10:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.245+0000 7fddf249c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fddec06a520 0x7fddec1257f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddf249c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddec1252b0 0x7fddec125ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddf249c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddec093bf0 0x7fddec094070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddf249c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddec06a900 con 0x7fddec06a520 2023-10-03T10:10:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddf249c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec1261d0 con 0x7fddec093bf0 2023-10-03T10:10:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddf249c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddec098790 con 0x7fddec1252b0 2023-10-03T10:10:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddf0a39700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddec093bf0 0x7fddec094070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddeb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddec1252b0 0x7fddec125ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddebfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fddec06a520 0x7fddec1257f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddf0a39700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddec093bf0 0x7fddec094070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51426/0 (socket says 172.21.15.72:51426) 2023-10-03T10:10:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddebfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fddec06a520 0x7fddec1257f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60826/0 (socket says 172.21.15.72:60826) 2023-10-03T10:10:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddf0a39700 1 -- 172.21.15.72:0/2169601854 learned_addr learned my addr 172.21.15.72:0/2169601854 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddeb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddec1252b0 0x7fddec125ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59534/0 (socket says 172.21.15.72:59534) 2023-10-03T10:10:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddeb7fe700 1 -- 172.21.15.72:0/2169601854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddec093bf0 msgr2=0x7fddec094070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddeb7fe700 1 --2- 172.21.15.72:0/2169601854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddec093bf0 0x7fddec094070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddeb7fe700 1 -- 172.21.15.72:0/2169601854 >> v2:172.21.15.72:3300/0 conn(0x7fddec06a520 msgr2=0x7fddec1257f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddeb7fe700 1 --2- 172.21.15.72:0/2169601854 >> v2:172.21.15.72:3300/0 conn(0x7fddec06a520 0x7fddec1257f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddeb7fe700 1 -- 172.21.15.72:0/2169601854 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec0996f0 con 0x7fddec1252b0 2023-10-03T10:10:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddeb7fe700 1 --2- 172.21.15.72:0/2169601854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddec1252b0 0x7fddec125ce0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fddd4009790 tx=0x7fddd4009060).ready entity=mon.2 client_cookie=ab9f64692c777e95 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddeaffd700 1 -- 172.21.15.72:0/2169601854 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd40090d0 con 0x7fddec1252b0 2023-10-03T10:10:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddeaffd700 1 -- 172.21.15.72:0/2169601854 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd400d4a0 con 0x7fddec1252b0 2023-10-03T10:10:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.246+0000 7fddeaffd700 1 -- 172.21.15.72:0/2169601854 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd400d820 con 0x7fddec1252b0 2023-10-03T10:10:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.247+0000 7fddf249c700 1 -- 172.21.15.72:0/2169601854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddec1252b0 msgr2=0x7fddec125ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.247+0000 7fddf249c700 1 --2- 172.21.15.72:0/2169601854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddec1252b0 0x7fddec125ce0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fddd4009790 tx=0x7fddd4009060).stop 2023-10-03T10:10:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.247+0000 7fddf249c700 1 -- 172.21.15.72:0/2169601854 shutdown_connections 2023-10-03T10:10:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.247+0000 7fddf249c700 1 --2- 172.21.15.72:0/2169601854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddec093bf0 0x7fddec094070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.247+0000 7fddf249c700 1 --2- 172.21.15.72:0/2169601854 >> v2:172.21.15.72:3300/0 conn(0x7fddec06a520 0x7fddec1257f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.247+0000 7fddf249c700 1 --2- 172.21.15.72:0/2169601854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddec1252b0 0x7fddec125ce0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.247+0000 7fddf249c700 1 -- 172.21.15.72:0/2169601854 >> 172.21.15.72:0/2169601854 conn(0x7fddec097480 msgr2=0x7fddec097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.247+0000 7fddf249c700 1 -- 172.21.15.72:0/2169601854 shutdown_connections 2023-10-03T10:10:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.247+0000 7fddf249c700 1 -- 172.21.15.72:0/2169601854 wait complete. 2023-10-03T10:10:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.248+0000 7fddf249c700 1 Processor -- start 2023-10-03T10:10:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.248+0000 7fddf249c700 1 -- start start 2023-10-03T10:10:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.248+0000 7fddf249c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddec06a520 0x7fddec111dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.248+0000 7fddf249c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddec093bf0 0x7fddec1122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.248+0000 7fddf249c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddec1252b0 0x7fddec1127a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.248+0000 7fddf249c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec112c90 con 0x7fddec093bf0 2023-10-03T10:10:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.248+0000 7fddf249c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec113240 con 0x7fddec1252b0 2023-10-03T10:10:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.248+0000 7fddf249c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddec114f60 con 0x7fddec06a520 2023-10-03T10:10:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.248+0000 7fddebfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddec06a520 0x7fddec111dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.248+0000 7fddeb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddec093bf0 0x7fddec1122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.248+0000 7fddebfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddec06a520 0x7fddec111dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59542/0 (socket says 172.21.15.72:59542) 2023-10-03T10:10:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.248+0000 7fddebfff700 1 -- 172.21.15.72:0/795767715 learned_addr learned my addr 172.21.15.72:0/795767715 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.248+0000 7fddf0a39700 1 --2- 172.21.15.72:0/795767715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddec1252b0 0x7fddec1127a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.249+0000 7fddeb7fe700 1 -- 172.21.15.72:0/795767715 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddec06a520 msgr2=0x7fddec111dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.249+0000 7fddeb7fe700 1 --2- 172.21.15.72:0/795767715 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddec06a520 0x7fddec111dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.249+0000 7fddeb7fe700 1 -- 172.21.15.72:0/795767715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddec1252b0 msgr2=0x7fddec1127a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.249+0000 7fddeb7fe700 1 --2- 172.21.15.72:0/795767715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddec1252b0 0x7fddec1127a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.249+0000 7fddeb7fe700 1 -- 172.21.15.72:0/795767715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd40092a0 con 0x7fddec093bf0 2023-10-03T10:10:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.249+0000 7fddf0a39700 1 --2- 172.21.15.72:0/795767715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddec1252b0 0x7fddec1127a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.249+0000 7fddeb7fe700 1 --2- 172.21.15.72:0/795767715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddec093bf0 0x7fddec1122b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fddd4013000 tx=0x7fddd4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.249+0000 7fdde3fff700 1 -- 172.21.15.72:0/795767715 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd40127f0 con 0x7fddec093bf0 2023-10-03T10:10:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.249+0000 7fdde3fff700 1 -- 172.21.15.72:0/795767715 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd4012970 con 0x7fddec093bf0 2023-10-03T10:10:00.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.249+0000 7fdde3fff700 1 -- 172.21.15.72:0/795767715 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4012d30 con 0x7fddec093bf0 2023-10-03T10:10:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.249+0000 7fddf249c700 1 -- 172.21.15.72:0/795767715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec115300 con 0x7fddec093bf0 2023-10-03T10:10:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.249+0000 7fddf249c700 1 -- 172.21.15.72:0/795767715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec098ea0 con 0x7fddec093bf0 2023-10-03T10:10:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.250+0000 7fdde3fff700 1 -- 172.21.15.72:0/795767715 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fddd401b380 con 0x7fddec093bf0 2023-10-03T10:10:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.250+0000 7fdde3fff700 1 -- 172.21.15.72:0/795767715 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fddd403b6e0 con 0x7fddec093bf0 2023-10-03T10:10:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.250+0000 7fddf249c700 1 -- 172.21.15.72:0/795767715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddec096590 con 0x7fddec093bf0 2023-10-03T10:10:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.254+0000 7fdde3fff700 1 -- 172.21.15.72:0/795767715 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fddd401b630 con 0x7fddec093bf0 2023-10-03T10:10:00.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.410+0000 7fddf249c700 1 -- 172.21.15.72:0/795767715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fddec0972c0 con 0x7fddec093bf0 2023-10-03T10:10:00.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.410+0000 7fdde3fff700 1 -- 172.21.15.72:0/795767715 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fddd4021030 con 0x7fddec093bf0 2023-10-03T10:10:00.410 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-03T10:10:00.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.412+0000 7fddf249c700 1 -- 172.21.15.72:0/795767715 >> v1:172.21.15.72:6816/118184 conn(0x7fddcc02bb60 legacy=0x7fddcc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.412+0000 7fddf249c700 1 -- 172.21.15.72:0/795767715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddec093bf0 msgr2=0x7fddec1122b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.412+0000 7fddf249c700 1 --2- 172.21.15.72:0/795767715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddec093bf0 0x7fddec1122b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fddd4013000 tx=0x7fddd4016000).stop 2023-10-03T10:10:00.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.412+0000 7fddf249c700 1 -- 172.21.15.72:0/795767715 shutdown_connections 2023-10-03T10:10:00.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.412+0000 7fddf249c700 1 --2- 172.21.15.72:0/795767715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddec1252b0 0x7fddec1127a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.412+0000 7fddf249c700 1 --2- 172.21.15.72:0/795767715 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddec06a520 0x7fddec111dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.412+0000 7fddf249c700 1 --2- 172.21.15.72:0/795767715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddec093bf0 0x7fddec1122b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.412+0000 7fddf249c700 1 -- 172.21.15.72:0/795767715 >> 172.21.15.72:0/795767715 conn(0x7fddec097480 msgr2=0x7fddec128f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:00.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.412+0000 7fddf249c700 1 -- 172.21.15.72:0/795767715 shutdown_connections 2023-10-03T10:10:00.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.412+0000 7fddf249c700 1 -- 172.21.15.72:0/795767715 wait complete. 2023-10-03T10:10:00.424 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:10:00.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.542+0000 7fa6107c2700 1 Processor -- start 2023-10-03T10:10:00.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.542+0000 7fa6107c2700 1 -- start start 2023-10-03T10:10:00.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.542+0000 7fa6107c2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6080926d0 0x7fa6081275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.542+0000 7fa6107c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa608127be0 0x7fa608128000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.542+0000 7fa6107c2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa60812a9a0 0x7fa60812ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.542+0000 7fa6107c2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa608099dd0 con 0x7fa6080926d0 2023-10-03T10:10:00.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.542+0000 7fa6107c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa608091c80 con 0x7fa608127be0 2023-10-03T10:10:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.542+0000 7fa6107c2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080999d0 con 0x7fa60812a9a0 2023-10-03T10:10:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60dd5d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa608127be0 0x7fa608128000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60e55e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6080926d0 0x7fa6081275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60dd5d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa608127be0 0x7fa608128000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51446/0 (socket says 172.21.15.72:51446) 2023-10-03T10:10:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60e55e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa6080926d0 0x7fa6081275c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60850/0 (socket says 172.21.15.72:60850) 2023-10-03T10:10:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60dd5d700 1 -- 172.21.15.72:0/2202490949 learned_addr learned my addr 172.21.15.72:0/2202490949 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60ed5f700 1 --2- 172.21.15.72:0/2202490949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa60812a9a0 0x7fa60812ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60e55e700 1 -- 172.21.15.72:0/2202490949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa60812a9a0 msgr2=0x7fa60812ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60e55e700 1 --2- 172.21.15.72:0/2202490949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa60812a9a0 0x7fa60812ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60e55e700 1 -- 172.21.15.72:0/2202490949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa608127be0 msgr2=0x7fa608128000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60e55e700 1 --2- 172.21.15.72:0/2202490949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa608127be0 0x7fa608128000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60e55e700 1 -- 172.21.15.72:0/2202490949 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60809a280 con 0x7fa6080926d0 2023-10-03T10:10:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60dd5d700 1 --2- 172.21.15.72:0/2202490949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa608127be0 0x7fa608128000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60ed5f700 1 --2- 172.21.15.72:0/2202490949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa60812a9a0 0x7fa60812ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60e55e700 1 --2- 172.21.15.72:0/2202490949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6080926d0 0x7fa6081275c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fa604009790 tx=0x7fa604009060).ready entity=mon.0 client_cookie=933f705086d20b5a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60d55c700 1 -- 172.21.15.72:0/2202490949 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60400d4a0 con 0x7fa6080926d0 2023-10-03T10:10:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60d55c700 1 -- 172.21.15.72:0/2202490949 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60400d600 con 0x7fa6080926d0 2023-10-03T10:10:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.543+0000 7fa60d55c700 1 -- 172.21.15.72:0/2202490949 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60400d980 con 0x7fa6080926d0 2023-10-03T10:10:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.544+0000 7fa6107c2700 1 -- 172.21.15.72:0/2202490949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6080926d0 msgr2=0x7fa6081275c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.544+0000 7fa6107c2700 1 --2- 172.21.15.72:0/2202490949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6080926d0 0x7fa6081275c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fa604009790 tx=0x7fa604009060).stop 2023-10-03T10:10:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.544+0000 7fa6107c2700 1 -- 172.21.15.72:0/2202490949 shutdown_connections 2023-10-03T10:10:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.544+0000 7fa6107c2700 1 --2- 172.21.15.72:0/2202490949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa60812a9a0 0x7fa60812ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.544+0000 7fa6107c2700 1 --2- 172.21.15.72:0/2202490949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6080926d0 0x7fa6081275c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.544+0000 7fa6107c2700 1 --2- 172.21.15.72:0/2202490949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa608127be0 0x7fa608128000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.544+0000 7fa6107c2700 1 -- 172.21.15.72:0/2202490949 >> 172.21.15.72:0/2202490949 conn(0x7fa608097480 msgr2=0x7fa608097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:00.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.544+0000 7fa6107c2700 1 -- 172.21.15.72:0/2202490949 shutdown_connections 2023-10-03T10:10:00.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.544+0000 7fa6107c2700 1 -- 172.21.15.72:0/2202490949 wait complete. 2023-10-03T10:10:00.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa6107c2700 1 Processor -- start 2023-10-03T10:10:00.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa6107c2700 1 -- start start 2023-10-03T10:10:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa6107c2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa6080926d0 0x7fa608124bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa6107c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa608127be0 0x7fa608113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa6107c2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa60812a9a0 0x7fa608113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa6107c2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa608117080 con 0x7fa60812a9a0 2023-10-03T10:10:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa6107c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa608093890 con 0x7fa608127be0 2023-10-03T10:10:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa6107c2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa60809a4b0 con 0x7fa6080926d0 2023-10-03T10:10:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa60dd5d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa608127be0 0x7fa608113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa60e55e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa6080926d0 0x7fa608124bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa60ed5f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa60812a9a0 0x7fa608113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa60e55e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa6080926d0 0x7fa608124bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59550/0 (socket says 172.21.15.72:59550) 2023-10-03T10:10:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa60dd5d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa608127be0 0x7fa608113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51458/0 (socket says 172.21.15.72:51458) 2023-10-03T10:10:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa60e55e700 1 -- 172.21.15.72:0/3949503651 learned_addr learned my addr 172.21.15.72:0/3949503651 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa60dd5d700 1 -- 172.21.15.72:0/3949503651 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa6080926d0 msgr2=0x7fa608124bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa60dd5d700 1 --2- 172.21.15.72:0/3949503651 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa6080926d0 0x7fa608124bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa60dd5d700 1 -- 172.21.15.72:0/3949503651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa60812a9a0 msgr2=0x7fa608113fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa60dd5d700 1 --2- 172.21.15.72:0/3949503651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa60812a9a0 0x7fa608113fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.545+0000 7fa60dd5d700 1 -- 172.21.15.72:0/3949503651 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f8009370 con 0x7fa608127be0 2023-10-03T10:10:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.546+0000 7fa60ed5f700 1 --2- 172.21.15.72:0/3949503651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa60812a9a0 0x7fa608113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.546+0000 7fa60dd5d700 1 --2- 172.21.15.72:0/3949503651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa608127be0 0x7fa608113af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fa5f8006fd0 tx=0x7fa5f80090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:00.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.546+0000 7fa5fe7fc700 1 -- 172.21.15.72:0/3949503651 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f800eec0 con 0x7fa608127be0 2023-10-03T10:10:00.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.546+0000 7fa5fe7fc700 1 -- 172.21.15.72:0/3949503651 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f800c850 con 0x7fa608127be0 2023-10-03T10:10:00.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.546+0000 7fa6107c2700 1 -- 172.21.15.72:0/3949503651 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa600009a20 con 0x7fa608127be0 2023-10-03T10:10:00.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.546+0000 7fa5fe7fc700 1 -- 172.21.15.72:0/3949503651 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f800cbd0 con 0x7fa608127be0 2023-10-03T10:10:00.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.546+0000 7fa6107c2700 1 -- 172.21.15.72:0/3949503651 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6040092a0 con 0x7fa608127be0 2023-10-03T10:10:00.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.546+0000 7fa5fe7fc700 1 -- 172.21.15.72:0/3949503651 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa5f801b400 con 0x7fa608127be0 2023-10-03T10:10:00.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.547+0000 7fa5fe7fc700 1 -- 172.21.15.72:0/3949503651 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa5f803b560 con 0x7fa608127be0 2023-10-03T10:10:00.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.547+0000 7fa6107c2700 1 -- 172.21.15.72:0/3949503651 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa608117560 con 0x7fa608127be0 2023-10-03T10:10:00.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.551+0000 7fa5fe7fc700 1 -- 172.21.15.72:0/3949503651 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa608117560 con 0x7fa608127be0 2023-10-03T10:10:00.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.708+0000 7fa6107c2700 1 -- 172.21.15.72:0/3949503651 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa608117560 con 0x7fa608127be0 2023-10-03T10:10:00.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.708+0000 7fa5fe7fc700 1 -- 172.21.15.72:0/3949503651 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa608117560 con 0x7fa608127be0 2023-10-03T10:10:00.708 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-10-03T10:10:00.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.710+0000 7fa6107c2700 1 -- 172.21.15.72:0/3949503651 >> v1:172.21.15.72:6816/118184 conn(0x7fa5ec02bb60 legacy=0x7fa5ec02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.710+0000 7fa6107c2700 1 -- 172.21.15.72:0/3949503651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa608127be0 msgr2=0x7fa608113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.710+0000 7fa6107c2700 1 --2- 172.21.15.72:0/3949503651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa608127be0 0x7fa608113af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fa5f8006fd0 tx=0x7fa5f80090f0).stop 2023-10-03T10:10:00.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.710+0000 7fa6107c2700 1 -- 172.21.15.72:0/3949503651 shutdown_connections 2023-10-03T10:10:00.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.710+0000 7fa6107c2700 1 --2- 172.21.15.72:0/3949503651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa60812a9a0 0x7fa608113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.710+0000 7fa6107c2700 1 --2- 172.21.15.72:0/3949503651 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa6080926d0 0x7fa608124bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.710+0000 7fa6107c2700 1 --2- 172.21.15.72:0/3949503651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa608127be0 0x7fa608113af0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.710+0000 7fa6107c2700 1 -- 172.21.15.72:0/3949503651 >> 172.21.15.72:0/3949503651 conn(0x7fa608097480 msgr2=0x7fa608095fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:00.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.710+0000 7fa6107c2700 1 -- 172.21.15.72:0/3949503651 shutdown_connections 2023-10-03T10:10:00.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.710+0000 7fa6107c2700 1 -- 172.21.15.72:0/3949503651 wait complete. 2023-10-03T10:10:00.722 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:10:00.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.840+0000 7f06e9d35700 1 Processor -- start 2023-10-03T10:10:00.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.840+0000 7f06e9d35700 1 -- start start 2023-10-03T10:10:00.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e9d35700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06e4093840 0x7f06e4098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e9d35700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06e4098c80 0x7f06e4099060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e9d35700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06e412c150 0x7f06e412e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e9d35700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e4093c20 con 0x7f06e412c150 2023-10-03T10:10:00.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e9d35700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4092b90 con 0x7f06e4098c80 2023-10-03T10:10:00.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e9d35700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4092d80 con 0x7f06e4093840 2023-10-03T10:10:00.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06e4093840 0x7f06e4098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06e412c150 0x7f06e412e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06e4098c80 0x7f06e4099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06e4093840 0x7f06e4098790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59560/0 (socket says 172.21.15.72:59560) 2023-10-03T10:10:00.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06e412c150 0x7f06e412e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60866/0 (socket says 172.21.15.72:60866) 2023-10-03T10:10:00.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e37fe700 1 -- 172.21.15.72:0/1445927992 learned_addr learned my addr 172.21.15.72:0/1445927992 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:00.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e2ffd700 1 -- 172.21.15.72:0/1445927992 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06e4093840 msgr2=0x7f06e4098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:00.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e2ffd700 1 --2- 172.21.15.72:0/1445927992 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06e4093840 0x7f06e4098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e2ffd700 1 -- 172.21.15.72:0/1445927992 >> v2:172.21.15.72:3300/0 conn(0x7f06e412c150 msgr2=0x7f06e412e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:00.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e2ffd700 1 --2- 172.21.15.72:0/1445927992 >> v2:172.21.15.72:3300/0 conn(0x7f06e412c150 0x7f06e412e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e2ffd700 1 -- 172.21.15.72:0/1445927992 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e4099b70 con 0x7f06e4098c80 2023-10-03T10:10:00.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e37fe700 1 --2- 172.21.15.72:0/1445927992 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06e4093840 0x7f06e4098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:00.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.841+0000 7f06e3fff700 1 --2- 172.21.15.72:0/1445927992 >> v2:172.21.15.72:3300/0 conn(0x7f06e412c150 0x7f06e412e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:00.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.842+0000 7f06e2ffd700 1 --2- 172.21.15.72:0/1445927992 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06e4098c80 0x7f06e4099060 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f06cc00ba00 tx=0x7f06cc00b300).ready entity=mon.1 client_cookie=39b7f486d14e8287 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:00.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.842+0000 7f06e27fc700 1 -- 172.21.15.72:0/1445927992 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc00d8c0 con 0x7f06e4098c80 2023-10-03T10:10:00.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.842+0000 7f06e27fc700 1 -- 172.21.15.72:0/1445927992 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc00da20 con 0x7f06e4098c80 2023-10-03T10:10:00.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.842+0000 7f06e27fc700 1 -- 172.21.15.72:0/1445927992 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc00dda0 con 0x7f06e4098c80 2023-10-03T10:10:00.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.842+0000 7f06e9d35700 1 -- 172.21.15.72:0/1445927992 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06e4098c80 msgr2=0x7f06e4099060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.842+0000 7f06e9d35700 1 --2- 172.21.15.72:0/1445927992 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06e4098c80 0x7f06e4099060 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f06cc00ba00 tx=0x7f06cc00b300).stop 2023-10-03T10:10:00.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.842+0000 7f06e9d35700 1 -- 172.21.15.72:0/1445927992 shutdown_connections 2023-10-03T10:10:00.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.842+0000 7f06e9d35700 1 --2- 172.21.15.72:0/1445927992 >> v2:172.21.15.72:3300/0 conn(0x7f06e412c150 0x7f06e412e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.842+0000 7f06e9d35700 1 --2- 172.21.15.72:0/1445927992 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06e4093840 0x7f06e4098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.842+0000 7f06e9d35700 1 --2- 172.21.15.72:0/1445927992 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06e4098c80 0x7f06e4099060 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.842+0000 7f06e9d35700 1 -- 172.21.15.72:0/1445927992 >> 172.21.15.72:0/1445927992 conn(0x7f06e4097480 msgr2=0x7f06e4097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:00.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.842+0000 7f06e9d35700 1 -- 172.21.15.72:0/1445927992 shutdown_connections 2023-10-03T10:10:00.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.842+0000 7f06e9d35700 1 -- 172.21.15.72:0/1445927992 wait complete. 2023-10-03T10:10:00.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.843+0000 7f06e9d35700 1 Processor -- start 2023-10-03T10:10:00.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.843+0000 7f06e9d35700 1 -- start start 2023-10-03T10:10:00.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e9d35700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e4093840 0x7f06e412acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e9d35700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06e4098c80 0x7f06e412b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e9d35700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06e412c150 0x7f06e4116090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:00.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e9d35700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4119b90 con 0x7f06e4093840 2023-10-03T10:10:00.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e9d35700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4064f10 con 0x7f06e412c150 2023-10-03T10:10:00.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e9d35700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06e406a550 con 0x7f06e4098c80 2023-10-03T10:10:00.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e4093840 0x7f06e412acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e2ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06e4098c80 0x7f06e412b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06e412c150 0x7f06e4116090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:00.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e4093840 0x7f06e412acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60880/0 (socket says 172.21.15.72:60880) 2023-10-03T10:10:00.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e2ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06e4098c80 0x7f06e412b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59566/0 (socket says 172.21.15.72:59566) 2023-10-03T10:10:00.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e37fe700 1 -- 172.21.15.72:0/2869089251 learned_addr learned my addr 172.21.15.72:0/2869089251 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:00.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e3fff700 1 -- 172.21.15.72:0/2869089251 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06e4098c80 msgr2=0x7f06e412b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e3fff700 1 --2- 172.21.15.72:0/2869089251 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06e4098c80 0x7f06e412b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e3fff700 1 -- 172.21.15.72:0/2869089251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e4093840 msgr2=0x7f06e412acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:00.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e3fff700 1 --2- 172.21.15.72:0/2869089251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e4093840 0x7f06e412acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:00.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e3fff700 1 -- 172.21.15.72:0/2869089251 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d4009370 con 0x7f06e412c150 2023-10-03T10:10:00.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e37fe700 1 --2- 172.21.15.72:0/2869089251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e4093840 0x7f06e412acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:00.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e3fff700 1 --2- 172.21.15.72:0/2869089251 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06e412c150 0x7f06e4116090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f06dc009f40 tx=0x7f06dc00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:00.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06db7fe700 1 -- 172.21.15.72:0/2869089251 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00cb70 con 0x7f06e412c150 2023-10-03T10:10:00.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06db7fe700 1 -- 172.21.15.72:0/2869089251 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc00f040 con 0x7f06e412c150 2023-10-03T10:10:00.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e9d35700 1 -- 172.21.15.72:0/2869089251 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06dc009a20 con 0x7f06e412c150 2023-10-03T10:10:00.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06db7fe700 1 -- 172.21.15.72:0/2869089251 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00cee0 con 0x7f06e412c150 2023-10-03T10:10:00.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.844+0000 7f06e9d35700 1 -- 172.21.15.72:0/2869089251 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06cc00b540 con 0x7f06e412c150 2023-10-03T10:10:00.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.845+0000 7f06db7fe700 1 -- 172.21.15.72:0/2869089251 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f06dc013610 con 0x7f06e412c150 2023-10-03T10:10:00.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.845+0000 7f06db7fe700 1 -- 172.21.15.72:0/2869089251 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f06dc03b860 con 0x7f06e412c150 2023-10-03T10:10:00.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.846+0000 7f06e9d35700 1 -- 172.21.15.72:0/2869089251 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e405a260 con 0x7f06e412c150 2023-10-03T10:10:00.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:00.850+0000 7f06db7fe700 1 -- 172.21.15.72:0/2869089251 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f06dc01c410 con 0x7f06e412c150 2023-10-03T10:10:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.009+0000 7f06e9d35700 1 -- 172.21.15.72:0/2869089251 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f06e4069a10 con 0x7f06e412c150 2023-10-03T10:10:01.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.010+0000 7f06db7fe700 1 -- 172.21.15.72:0/2869089251 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f06dc01b370 con 0x7f06e412c150 2023-10-03T10:10:01.010 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-03T10:10:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.011+0000 7f06e9d35700 1 -- 172.21.15.72:0/2869089251 >> v1:172.21.15.72:6816/118184 conn(0x7f06c402bb60 legacy=0x7f06c402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.011+0000 7f06e9d35700 1 -- 172.21.15.72:0/2869089251 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06e412c150 msgr2=0x7f06e4116090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.011+0000 7f06e9d35700 1 --2- 172.21.15.72:0/2869089251 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06e412c150 0x7f06e4116090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f06dc009f40 tx=0x7f06dc00b040).stop 2023-10-03T10:10:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.011+0000 7f06e9d35700 1 -- 172.21.15.72:0/2869089251 shutdown_connections 2023-10-03T10:10:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.011+0000 7f06e9d35700 1 --2- 172.21.15.72:0/2869089251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06e4093840 0x7f06e412acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.011+0000 7f06e9d35700 1 --2- 172.21.15.72:0/2869089251 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06e412c150 0x7f06e4116090 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.011+0000 7f06e9d35700 1 --2- 172.21.15.72:0/2869089251 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06e4098c80 0x7f06e412b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.012+0000 7f06e9d35700 1 -- 172.21.15.72:0/2869089251 >> 172.21.15.72:0/2869089251 conn(0x7f06e4097480 msgr2=0x7f06e40689f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.012+0000 7f06e9d35700 1 -- 172.21.15.72:0/2869089251 shutdown_connections 2023-10-03T10:10:01.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.012+0000 7f06e9d35700 1 -- 172.21.15.72:0/2869089251 wait complete. 2023-10-03T10:10:01.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:10:01.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.141+0000 7f1144a1a700 1 Processor -- start 2023-10-03T10:10:01.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.141+0000 7f1144a1a700 1 -- start start 2023-10-03T10:10:01.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.142+0000 7f1144a1a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1140098740 0x7f1140098b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.142+0000 7f1144a1a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1140069430 0x7f1140130c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.142+0000 7f1144a1a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1140095270 con 0x7f1140099010 2023-10-03T10:10:01.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.142+0000 7f1144a1a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1140094d20 con 0x7f1140098740 2023-10-03T10:10:01.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.142+0000 7f1144a1a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1140096520 con 0x7f1140069430 2023-10-03T10:10:01.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.142+0000 7f113e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1140098740 0x7f1140098b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.142+0000 7f113dd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1140099010 0x7f1140068d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48208/0 (socket says 172.21.15.72:48208) 2023-10-03T10:10:01.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.142+0000 7f113ed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1140069430 0x7f1140130c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.142+0000 7f113dd9b700 1 -- 172.21.15.72:0/1958754352 learned_addr learned my addr 172.21.15.72:0/1958754352 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:10:01.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f113d59a700 1 -- 172.21.15.72:0/1958754352 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61613219 0 0) 0x7f1140095270 con 0x7f1140099010 2023-10-03T10:10:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f113e59c700 1 -- 172.21.15.72:0/1958754352 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1140069430 msgr2=0x7f1140130c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f113e59c700 1 --2- 172.21.15.72:0/1958754352 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1140069430 0x7f1140130c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f113e59c700 1 -- 172.21.15.72:0/1958754352 >> v1:172.21.15.72:6789/0 conn(0x7f1140099010 legacy=0x7f1140068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f113e59c700 1 -- 172.21.15.72:0/1958754352 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1140094870 con 0x7f1140098740 2023-10-03T10:10:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f113ed9d700 1 --2- 172.21.15.72:0/1958754352 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1140069430 0x7f1140130c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f113e59c700 1 --2- 172.21.15.72:0/1958754352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1140098740 0x7f1140098b20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1130009790 tx=0x7f1130009060).ready entity=mon.1 client_cookie=9b1177d0435ebe60 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f113d59a700 1 -- 172.21.15.72:0/1958754352 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11300090d0 con 0x7f1140098740 2023-10-03T10:10:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f113d59a700 1 -- 172.21.15.72:0/1958754352 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113000f510 con 0x7f1140098740 2023-10-03T10:10:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f113d59a700 1 -- 172.21.15.72:0/1958754352 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113000f890 con 0x7f1140098740 2023-10-03T10:10:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f1144a1a700 1 -- 172.21.15.72:0/1958754352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1140098740 msgr2=0x7f1140098b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f1144a1a700 1 --2- 172.21.15.72:0/1958754352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1140098740 0x7f1140098b20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1130009790 tx=0x7f1130009060).stop 2023-10-03T10:10:01.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f1144a1a700 1 -- 172.21.15.72:0/1958754352 shutdown_connections 2023-10-03T10:10:01.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f1144a1a700 1 --2- 172.21.15.72:0/1958754352 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1140069430 0x7f1140130c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f1144a1a700 1 --2- 172.21.15.72:0/1958754352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1140098740 0x7f1140098b20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f1144a1a700 1 -- 172.21.15.72:0/1958754352 >> 172.21.15.72:0/1958754352 conn(0x7f114009a1c0 msgr2=0x7f114009a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f1144a1a700 1 -- 172.21.15.72:0/1958754352 shutdown_connections 2023-10-03T10:10:01.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.143+0000 7f1144a1a700 1 -- 172.21.15.72:0/1958754352 wait complete. 2023-10-03T10:10:01.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.144+0000 7f1144a1a700 1 Processor -- start 2023-10-03T10:10:01.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.144+0000 7f1144a1a700 1 -- start start 2023-10-03T10:10:01.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f1144a1a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1140069430 0x7f114011b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f1144a1a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1140098740 0x7f11400922a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f1144a1a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1140099010 0x7f1140092790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f1144a1a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1140129a20 con 0x7f1140069430 2023-10-03T10:10:01.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f1144a1a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114011a590 con 0x7f1140099010 2023-10-03T10:10:01.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f1144a1a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1140066e40 con 0x7f1140098740 2023-10-03T10:10:01.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f113dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1140098740 0x7f11400922a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f113ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1140099010 0x7f1140092790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f113e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1140069430 0x7f114011b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f113ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1140099010 0x7f1140092790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51486/0 (socket says 172.21.15.72:51486) 2023-10-03T10:10:01.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f113dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1140098740 0x7f11400922a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59586/0 (socket says 172.21.15.72:59586) 2023-10-03T10:10:01.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f113ed9d700 1 -- 172.21.15.72:0/1953788556 learned_addr learned my addr 172.21.15.72:0/1953788556 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:01.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f113ed9d700 1 -- 172.21.15.72:0/1953788556 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1140098740 msgr2=0x7f11400922a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f113ed9d700 1 --2- 172.21.15.72:0/1953788556 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1140098740 0x7f11400922a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f113ed9d700 1 -- 172.21.15.72:0/1953788556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1140069430 msgr2=0x7f114011b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f113ed9d700 1 --2- 172.21.15.72:0/1953788556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1140069430 0x7f114011b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f113ed9d700 1 -- 172.21.15.72:0/1953788556 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138009a20 con 0x7f1140099010 2023-10-03T10:10:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f113dd9b700 1 --2- 172.21.15.72:0/1953788556 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1140098740 0x7f11400922a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f113e59c700 1 --2- 172.21.15.72:0/1953788556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1140069430 0x7f114011b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f113ed9d700 1 --2- 172.21.15.72:0/1953788556 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1140099010 0x7f1140092790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1138009fc0 tx=0x7f113800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f11367fc700 1 -- 172.21.15.72:0/1953788556 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138009d20 con 0x7f1140099010 2023-10-03T10:10:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f11367fc700 1 -- 172.21.15.72:0/1953788556 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113800f040 con 0x7f1140099010 2023-10-03T10:10:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f1144a1a700 1 -- 172.21.15.72:0/1953788556 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11300092a0 con 0x7f1140099010 2023-10-03T10:10:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f11367fc700 1 -- 172.21.15.72:0/1953788556 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113800cde0 con 0x7f1140099010 2023-10-03T10:10:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.145+0000 7f1144a1a700 1 -- 172.21.15.72:0/1953788556 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1140091f70 con 0x7f1140099010 2023-10-03T10:10:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.146+0000 7f11367fc700 1 -- 172.21.15.72:0/1953788556 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1138013610 con 0x7f1140099010 2023-10-03T10:10:01.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.146+0000 7f11367fc700 1 -- 172.21.15.72:0/1953788556 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f113803b830 con 0x7f1140099010 2023-10-03T10:10:01.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.147+0000 7f1144a1a700 1 -- 172.21.15.72:0/1953788556 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114011a930 con 0x7f1140099010 2023-10-03T10:10:01.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.151+0000 7f11367fc700 1 -- 172.21.15.72:0/1953788556 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f113801d460 con 0x7f1140099010 2023-10-03T10:10:01.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.307+0000 7f1144a1a700 1 -- 172.21.15.72:0/1953788556 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f114005a260 con 0x7f1140099010 2023-10-03T10:10:01.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.308+0000 7f11367fc700 1 -- 172.21.15.72:0/1953788556 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f113802c0a0 con 0x7f1140099010 2023-10-03T10:10:01.307 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-03T10:10:01.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.309+0000 7f1144a1a700 1 -- 172.21.15.72:0/1953788556 >> v1:172.21.15.72:6816/118184 conn(0x7f112002bb60 legacy=0x7f112002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.309+0000 7f1144a1a700 1 -- 172.21.15.72:0/1953788556 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1140099010 msgr2=0x7f1140092790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.309+0000 7f1144a1a700 1 --2- 172.21.15.72:0/1953788556 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1140099010 0x7f1140092790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1138009fc0 tx=0x7f113800b040).stop 2023-10-03T10:10:01.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.309+0000 7f1144a1a700 1 -- 172.21.15.72:0/1953788556 shutdown_connections 2023-10-03T10:10:01.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.309+0000 7f1144a1a700 1 --2- 172.21.15.72:0/1953788556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1140069430 0x7f114011b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.309+0000 7f1144a1a700 1 --2- 172.21.15.72:0/1953788556 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1140099010 0x7f1140092790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.309+0000 7f1144a1a700 1 --2- 172.21.15.72:0/1953788556 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1140098740 0x7f11400922a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.309+0000 7f1144a1a700 1 -- 172.21.15.72:0/1953788556 >> 172.21.15.72:0/1953788556 conn(0x7f114009a1c0 msgr2=0x7f1140065d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.309+0000 7f1144a1a700 1 -- 172.21.15.72:0/1953788556 shutdown_connections 2023-10-03T10:10:01.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.309+0000 7f1144a1a700 1 -- 172.21.15.72:0/1953788556 wait complete. 2023-10-03T10:10:01.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:10:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.436+0000 7f7bfb0cd700 1 Processor -- start 2023-10-03T10:10:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.436+0000 7f7bfb0cd700 1 -- start start 2023-10-03T10:10:01.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bfb0cd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bf4096380 0x7f7bf4094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bfb0cd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf4091b00 0x7f7bf4127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bfb0cd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf4096760 con 0x7f7bf4094c20 2023-10-03T10:10:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bfb0cd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4091ff0 con 0x7f7bf4091b00 2023-10-03T10:10:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bfb0cd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4092c80 con 0x7f7bf4096380 2023-10-03T10:10:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bf8e69700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bf4096380 0x7f7bf4094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bf3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf4091b00 0x7f7bf4127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bf966a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7bf4094c20 0x7f7bf4127af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48220/0 (socket says 172.21.15.72:48220) 2023-10-03T10:10:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bf966a700 1 -- 172.21.15.72:0/729215049 learned_addr learned my addr 172.21.15.72:0/729215049 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:10:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bf37fe700 1 -- 172.21.15.72:0/729215049 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003393723 0 0) 0x7f7bf4096760 con 0x7f7bf4094c20 2023-10-03T10:10:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bf37fe700 1 -- 172.21.15.72:0/729215049 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7be40033f0 con 0x7f7bf4094c20 2023-10-03T10:10:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bf8e69700 1 -- 172.21.15.72:0/729215049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf4091b00 msgr2=0x7f7bf4127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bf8e69700 1 --2- 172.21.15.72:0/729215049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf4091b00 0x7f7bf4127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bf8e69700 1 -- 172.21.15.72:0/729215049 >> v1:172.21.15.72:6789/0 conn(0x7f7bf4094c20 legacy=0x7f7bf4127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bf8e69700 1 -- 172.21.15.72:0/729215049 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf4093900 con 0x7f7bf4096380 2023-10-03T10:10:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bf3fff700 1 --2- 172.21.15.72:0/729215049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf4091b00 0x7f7bf4127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.437+0000 7f7bf8e69700 1 --2- 172.21.15.72:0/729215049 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bf4096380 0x7f7bf4094730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7be8009790 tx=0x7f7be8009060).ready entity=mon.2 client_cookie=44dc08f88035e0c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.438+0000 7f7bf37fe700 1 -- 172.21.15.72:0/729215049 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be800f510 con 0x7f7bf4096380 2023-10-03T10:10:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.438+0000 7f7bf37fe700 1 -- 172.21.15.72:0/729215049 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be800f670 con 0x7f7bf4096380 2023-10-03T10:10:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.438+0000 7f7bf37fe700 1 -- 172.21.15.72:0/729215049 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be800f9f0 con 0x7f7bf4096380 2023-10-03T10:10:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.438+0000 7f7bfb0cd700 1 -- 172.21.15.72:0/729215049 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bf4096380 msgr2=0x7f7bf4094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.438+0000 7f7bfb0cd700 1 --2- 172.21.15.72:0/729215049 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bf4096380 0x7f7bf4094730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7be8009790 tx=0x7f7be8009060).stop 2023-10-03T10:10:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.438+0000 7f7bfb0cd700 1 -- 172.21.15.72:0/729215049 shutdown_connections 2023-10-03T10:10:01.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.438+0000 7f7bfb0cd700 1 --2- 172.21.15.72:0/729215049 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bf4096380 0x7f7bf4094730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.438+0000 7f7bfb0cd700 1 --2- 172.21.15.72:0/729215049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf4091b00 0x7f7bf4127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.438+0000 7f7bfb0cd700 1 -- 172.21.15.72:0/729215049 >> 172.21.15.72:0/729215049 conn(0x7f7bf4097470 msgr2=0x7f7bf4097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.438+0000 7f7bfb0cd700 1 -- 172.21.15.72:0/729215049 shutdown_connections 2023-10-03T10:10:01.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.438+0000 7f7bfb0cd700 1 -- 172.21.15.72:0/729215049 wait complete. 2023-10-03T10:10:01.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.439+0000 7f7bfb0cd700 1 Processor -- start 2023-10-03T10:10:01.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.439+0000 7f7bfb0cd700 1 -- start start 2023-10-03T10:10:01.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bfb0cd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bf4091b00 0x7f7bf4117c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bfb0cd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf4094c20 0x7f7bf4113d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bfb0cd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf4096380 0x7f7bf4114220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bfb0cd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4116140 con 0x7f7bf4096380 2023-10-03T10:10:01.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bfb0cd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf406a520 con 0x7f7bf4094c20 2023-10-03T10:10:01.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bfb0cd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4124db0 con 0x7f7bf4091b00 2023-10-03T10:10:01.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bf8e69700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bf4091b00 0x7f7bf4117c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bf8e69700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bf4091b00 0x7f7bf4117c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59594/0 (socket says 172.21.15.72:59594) 2023-10-03T10:10:01.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bf8e69700 1 -- 172.21.15.72:0/630300669 learned_addr learned my addr 172.21.15.72:0/630300669 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:01.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bf966a700 1 --2- 172.21.15.72:0/630300669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf4096380 0x7f7bf4114220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bf3fff700 1 --2- 172.21.15.72:0/630300669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf4094c20 0x7f7bf4113d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bf8e69700 1 -- 172.21.15.72:0/630300669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf4094c20 msgr2=0x7f7bf4113d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bf8e69700 1 --2- 172.21.15.72:0/630300669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf4094c20 0x7f7bf4113d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bf8e69700 1 -- 172.21.15.72:0/630300669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf4096380 msgr2=0x7f7bf4114220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bf8e69700 1 --2- 172.21.15.72:0/630300669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf4096380 0x7f7bf4114220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bf8e69700 1 -- 172.21.15.72:0/630300669 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be00092a0 con 0x7f7bf4091b00 2023-10-03T10:10:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.440+0000 7f7bf966a700 1 --2- 172.21.15.72:0/630300669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf4096380 0x7f7bf4114220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.441+0000 7f7bf8e69700 1 --2- 172.21.15.72:0/630300669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bf4091b00 0x7f7bf4117c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7be800ffd0 tx=0x7f7be8017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.441+0000 7f7bf0ff9700 1 -- 172.21.15.72:0/630300669 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be800f7e0 con 0x7f7bf4091b00 2023-10-03T10:10:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.441+0000 7f7bf0ff9700 1 -- 172.21.15.72:0/630300669 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be800f960 con 0x7f7bf4091b00 2023-10-03T10:10:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.441+0000 7f7bf0ff9700 1 -- 172.21.15.72:0/630300669 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8025690 con 0x7f7bf4091b00 2023-10-03T10:10:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.441+0000 7f7bfb0cd700 1 -- 172.21.15.72:0/630300669 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be80092a0 con 0x7f7bf4091b00 2023-10-03T10:10:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.441+0000 7f7bfb0cd700 1 -- 172.21.15.72:0/630300669 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf41171e0 con 0x7f7bf4091b00 2023-10-03T10:10:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.442+0000 7f7bf0ff9700 1 -- 172.21.15.72:0/630300669 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7be8025a00 con 0x7f7bf4091b00 2023-10-03T10:10:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.442+0000 7f7bf0ff9700 1 -- 172.21.15.72:0/630300669 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7be803e480 con 0x7f7bf4091b00 2023-10-03T10:10:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.442+0000 7f7bfb0cd700 1 -- 172.21.15.72:0/630300669 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf4099b10 con 0x7f7bf4091b00 2023-10-03T10:10:01.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.446+0000 7f7bf0ff9700 1 -- 172.21.15.72:0/630300669 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7be802a020 con 0x7f7bf4091b00 2023-10-03T10:10:01.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.640+0000 7f7bfb0cd700 1 -- 172.21.15.72:0/630300669 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bf405a260 con 0x7f7bf4091b00 2023-10-03T10:10:01.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.641+0000 7f7bf0ff9700 1 -- 172.21.15.72:0/630300669 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2154 (secure 0 0 0) 0x7f7be8033070 con 0x7f7bf4091b00 2023-10-03T10:10:01.641 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:10:01.641 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:46.344785+0000","modified":"2023-10-03T10:09:48.352357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6817/542674768","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6817","nonce":542674768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:10:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.643+0000 7f7bfb0cd700 1 -- 172.21.15.72:0/630300669 >> v1:172.21.15.72:6816/118184 conn(0x7f7bd802bb60 legacy=0x7f7bd802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.643+0000 7f7bfb0cd700 1 -- 172.21.15.72:0/630300669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bf4091b00 msgr2=0x7f7bf4117c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.643+0000 7f7bfb0cd700 1 --2- 172.21.15.72:0/630300669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bf4091b00 0x7f7bf4117c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7be800ffd0 tx=0x7f7be8017000).stop 2023-10-03T10:10:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.643+0000 7f7bfb0cd700 1 -- 172.21.15.72:0/630300669 shutdown_connections 2023-10-03T10:10:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.643+0000 7f7bfb0cd700 1 --2- 172.21.15.72:0/630300669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf4096380 0x7f7bf4114220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.643+0000 7f7bfb0cd700 1 --2- 172.21.15.72:0/630300669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bf4091b00 0x7f7bf4117c80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.643+0000 7f7bfb0cd700 1 --2- 172.21.15.72:0/630300669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf4094c20 0x7f7bf4113d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.643+0000 7f7bfb0cd700 1 -- 172.21.15.72:0/630300669 >> 172.21.15.72:0/630300669 conn(0x7f7bf4097470 msgr2=0x7f7bf4098780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.643+0000 7f7bfb0cd700 1 -- 172.21.15.72:0/630300669 shutdown_connections 2023-10-03T10:10:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.643+0000 7f7bfb0cd700 1 -- 172.21.15.72:0/630300669 wait complete. 2023-10-03T10:10:01.644 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 5 2023-10-03T10:10:01.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:01.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.769+0000 7f35a5112700 1 Processor -- start 2023-10-03T10:10:01.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.769+0000 7f35a5112700 1 -- start start 2023-10-03T10:10:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f35a5112700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35a0127390 0x7f35a012fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f35a5112700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35a0127fa0 0x7f35a0132170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f35a5112700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a0091b60 con 0x7f35a0059070 2023-10-03T10:10:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f35a5112700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0096940 con 0x7f35a0127fa0 2023-10-03T10:10:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f35a5112700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0059c00 con 0x7f35a0127390 2023-10-03T10:10:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f359f59e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35a0127fa0 0x7f35a0132170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f359e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35a0127390 0x7f35a012fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f359ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f35a0059070 0x7f35a0127890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48224/0 (socket says 172.21.15.72:48224) 2023-10-03T10:10:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f359ed9d700 1 -- 172.21.15.72:0/3655501910 learned_addr learned my addr 172.21.15.72:0/3655501910 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:10:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f359dd9b700 1 -- 172.21.15.72:0/3655501910 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258768390 0 0) 0x7f35a0091b60 con 0x7f35a0059070 2023-10-03T10:10:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f359dd9b700 1 -- 172.21.15.72:0/3655501910 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35880033f0 con 0x7f35a0059070 2023-10-03T10:10:01.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f359f59e700 1 -- 172.21.15.72:0/3655501910 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35a0127390 msgr2=0x7f35a012fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f359f59e700 1 --2- 172.21.15.72:0/3655501910 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35a0127390 0x7f35a012fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f359f59e700 1 -- 172.21.15.72:0/3655501910 >> v1:172.21.15.72:6789/0 conn(0x7f35a0059070 legacy=0x7f35a0127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f359f59e700 1 -- 172.21.15.72:0/3655501910 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00929d0 con 0x7f35a0127fa0 2023-10-03T10:10:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f359e59c700 1 --2- 172.21.15.72:0/3655501910 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35a0127390 0x7f35a012fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.770+0000 7f359f59e700 1 --2- 172.21.15.72:0/3655501910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35a0127fa0 0x7f35a0132170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3598009e90 tx=0x7f3598009780).ready entity=mon.1 client_cookie=20c92f7c6d74d2c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.771+0000 7f359dd9b700 1 -- 172.21.15.72:0/3655501910 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800e070 con 0x7f35a0127fa0 2023-10-03T10:10:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.771+0000 7f359dd9b700 1 -- 172.21.15.72:0/3655501910 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359800bab0 con 0x7f35a0127fa0 2023-10-03T10:10:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.771+0000 7f359dd9b700 1 -- 172.21.15.72:0/3655501910 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800be30 con 0x7f35a0127fa0 2023-10-03T10:10:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.771+0000 7f35a5112700 1 -- 172.21.15.72:0/3655501910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35a0127fa0 msgr2=0x7f35a0132170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.771+0000 7f35a5112700 1 --2- 172.21.15.72:0/3655501910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35a0127fa0 0x7f35a0132170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3598009e90 tx=0x7f3598009780).stop 2023-10-03T10:10:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.771+0000 7f35a5112700 1 -- 172.21.15.72:0/3655501910 shutdown_connections 2023-10-03T10:10:01.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.771+0000 7f35a5112700 1 --2- 172.21.15.72:0/3655501910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35a0127fa0 0x7f35a0132170 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.771+0000 7f35a5112700 1 --2- 172.21.15.72:0/3655501910 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35a0127390 0x7f35a012fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.771+0000 7f35a5112700 1 -- 172.21.15.72:0/3655501910 >> 172.21.15.72:0/3655501910 conn(0x7f35a0097470 msgr2=0x7f35a0097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.771+0000 7f35a5112700 1 -- 172.21.15.72:0/3655501910 shutdown_connections 2023-10-03T10:10:01.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.771+0000 7f35a5112700 1 -- 172.21.15.72:0/3655501910 wait complete. 2023-10-03T10:10:01.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.772+0000 7f35a5112700 1 Processor -- start 2023-10-03T10:10:01.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.772+0000 7f35a5112700 1 -- start start 2023-10-03T10:10:01.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f35a5112700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35a0059070 0x7f35a012ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f35a5112700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35a0127390 0x7f35a012e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f35a5112700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a0127fa0 0x7f35a012e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:01.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f35a5112700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0096f20 con 0x7f35a0127fa0 2023-10-03T10:10:01.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f35a5112700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0131de0 con 0x7f35a0059070 2023-10-03T10:10:01.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f35a5112700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0125180 con 0x7f35a0127390 2023-10-03T10:10:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f359ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35a0059070 0x7f35a012ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f359e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35a0127390 0x7f35a012e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f359f59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a0127fa0 0x7f35a012e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f359ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35a0059070 0x7f35a012ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51516/0 (socket says 172.21.15.72:51516) 2023-10-03T10:10:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f359e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35a0127390 0x7f35a012e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59606/0 (socket says 172.21.15.72:59606) 2023-10-03T10:10:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f359ed9d700 1 -- 172.21.15.72:0/479518904 learned_addr learned my addr 172.21.15.72:0/479518904 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f359ed9d700 1 -- 172.21.15.72:0/479518904 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35a0127390 msgr2=0x7f35a012e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f359ed9d700 1 --2- 172.21.15.72:0/479518904 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35a0127390 0x7f35a012e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f359ed9d700 1 -- 172.21.15.72:0/479518904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a0127fa0 msgr2=0x7f35a012e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f359ed9d700 1 --2- 172.21.15.72:0/479518904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a0127fa0 0x7f35a012e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f359ed9d700 1 -- 172.21.15.72:0/479518904 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35900092a0 con 0x7f35a0059070 2023-10-03T10:10:01.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f359f59e700 1 --2- 172.21.15.72:0/479518904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a0127fa0 0x7f35a012e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:01.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f359ed9d700 1 --2- 172.21.15.72:0/479518904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35a0059070 0x7f35a012ddd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f359400c590 tx=0x7f3594007c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:01.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f3586ffd700 1 -- 172.21.15.72:0/479518904 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35940072e0 con 0x7f35a0059070 2023-10-03T10:10:01.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f3586ffd700 1 -- 172.21.15.72:0/479518904 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3594007440 con 0x7f35a0059070 2023-10-03T10:10:01.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f35a5112700 1 -- 172.21.15.72:0/479518904 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3598009a20 con 0x7f35a0059070 2023-10-03T10:10:01.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f3586ffd700 1 -- 172.21.15.72:0/479518904 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35940057a0 con 0x7f35a0059070 2023-10-03T10:10:01.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.773+0000 7f35a5112700 1 -- 172.21.15.72:0/479518904 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a0111170 con 0x7f35a0059070 2023-10-03T10:10:01.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.774+0000 7f3586ffd700 1 -- 172.21.15.72:0/479518904 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3594005bd0 con 0x7f35a0059070 2023-10-03T10:10:01.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.774+0000 7f3586ffd700 1 -- 172.21.15.72:0/479518904 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f359403a7c0 con 0x7f35a0059070 2023-10-03T10:10:01.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.774+0000 7f35a5112700 1 -- 172.21.15.72:0/479518904 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a0064d20 con 0x7f35a0059070 2023-10-03T10:10:01.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.779+0000 7f3586ffd700 1 -- 172.21.15.72:0/479518904 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f35940123b0 con 0x7f35a0059070 2023-10-03T10:10:01.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.939+0000 7f35a5112700 1 -- 172.21.15.72:0/479518904 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35a005a260 con 0x7f35a0059070 2023-10-03T10:10:01.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.940+0000 7f3586ffd700 1 -- 172.21.15.72:0/479518904 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f3594010300 con 0x7f35a0059070 2023-10-03T10:10:01.940 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:10:01.940 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:09:47.346977+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:01.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.942+0000 7f35a5112700 1 -- 172.21.15.72:0/479518904 >> v1:172.21.15.72:6816/118184 conn(0x7f358c02bb60 legacy=0x7f358c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.942+0000 7f35a5112700 1 -- 172.21.15.72:0/479518904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35a0059070 msgr2=0x7f35a012ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:01.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.942+0000 7f35a5112700 1 --2- 172.21.15.72:0/479518904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35a0059070 0x7f35a012ddd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f359400c590 tx=0x7f3594007c80).stop 2023-10-03T10:10:01.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.942+0000 7f35a5112700 1 -- 172.21.15.72:0/479518904 shutdown_connections 2023-10-03T10:10:01.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.942+0000 7f35a5112700 1 --2- 172.21.15.72:0/479518904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35a0127fa0 0x7f35a012e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.942+0000 7f35a5112700 1 --2- 172.21.15.72:0/479518904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35a0059070 0x7f35a012ddd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.942+0000 7f35a5112700 1 --2- 172.21.15.72:0/479518904 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35a0127390 0x7f35a012e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:01.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.942+0000 7f35a5112700 1 -- 172.21.15.72:0/479518904 >> 172.21.15.72:0/479518904 conn(0x7f35a0097470 msgr2=0x7f35a0126b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:01.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.942+0000 7f35a5112700 1 -- 172.21.15.72:0/479518904 shutdown_connections 2023-10-03T10:10:01.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:01.942+0000 7f35a5112700 1 -- 172.21.15.72:0/479518904 wait complete. 2023-10-03T10:10:01.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:10:02.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.072+0000 7fb433367700 1 Processor -- start 2023-10-03T10:10:02.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.072+0000 7fb433367700 1 -- start start 2023-10-03T10:10:02.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.072+0000 7fb433367700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb42c123e70 0x7fb42c067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.072+0000 7fb433367700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb42c092340 0x7fb42c127680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.072+0000 7fb433367700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42c068880 con 0x7fb42c123a90 2023-10-03T10:10:02.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.072+0000 7fb433367700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42c124250 con 0x7fb42c092340 2023-10-03T10:10:02.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.072+0000 7fb433367700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c068c90 con 0x7fb42c123e70 2023-10-03T10:10:02.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.072+0000 7fb430902700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb42c123e70 0x7fb42c067ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.072+0000 7fb431904700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb42c092340 0x7fb42c127680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.072+0000 7fb430902700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb42c123e70 0x7fb42c067ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51524/0 (socket says 172.21.15.72:51524) 2023-10-03T10:10:02.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.072+0000 7fb431904700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb42c092340 0x7fb42c127680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60910/0 (socket says 172.21.15.72:60910) 2023-10-03T10:10:02.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.072+0000 7fb431103700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb42c123a90 0x7fb42c126f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48238/0 (socket says 172.21.15.72:48238) 2023-10-03T10:10:02.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.072+0000 7fb430902700 1 -- 172.21.15.72:0/1578394156 learned_addr learned my addr 172.21.15.72:0/1578394156 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:02.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.073+0000 7fb41ffff700 1 -- 172.21.15.72:0/1578394156 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033264817 0 0) 0x7fb42c068880 con 0x7fb42c123a90 2023-10-03T10:10:02.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.073+0000 7fb41ffff700 1 -- 172.21.15.72:0/1578394156 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4180033f0 con 0x7fb42c123a90 2023-10-03T10:10:02.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.073+0000 7fb430902700 1 -- 172.21.15.72:0/1578394156 >> v2:172.21.15.72:3300/0 conn(0x7fb42c092340 msgr2=0x7fb42c127680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.073+0000 7fb430902700 1 --2- 172.21.15.72:0/1578394156 >> v2:172.21.15.72:3300/0 conn(0x7fb42c092340 0x7fb42c127680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.073+0000 7fb430902700 1 -- 172.21.15.72:0/1578394156 >> v1:172.21.15.72:6789/0 conn(0x7fb42c123a90 legacy=0x7fb42c126f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.073+0000 7fb430902700 1 -- 172.21.15.72:0/1578394156 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c124430 con 0x7fb42c123e70 2023-10-03T10:10:02.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.073+0000 7fb431904700 1 --2- 172.21.15.72:0/1578394156 >> v2:172.21.15.72:3300/0 conn(0x7fb42c092340 0x7fb42c127680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.073+0000 7fb430902700 1 --2- 172.21.15.72:0/1578394156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb42c123e70 0x7fb42c067ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb42800baf0 tx=0x7fb42800b370).ready entity=mon.1 client_cookie=48b70dc9b0f969ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.073+0000 7fb41ffff700 1 -- 172.21.15.72:0/1578394156 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42800db30 con 0x7fb42c123e70 2023-10-03T10:10:02.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.073+0000 7fb41ffff700 1 -- 172.21.15.72:0/1578394156 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42800dc90 con 0x7fb42c123e70 2023-10-03T10:10:02.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.073+0000 7fb41ffff700 1 -- 172.21.15.72:0/1578394156 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428015600 con 0x7fb42c123e70 2023-10-03T10:10:02.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.073+0000 7fb433367700 1 -- 172.21.15.72:0/1578394156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb42c123e70 msgr2=0x7fb42c067ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.073+0000 7fb433367700 1 --2- 172.21.15.72:0/1578394156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb42c123e70 0x7fb42c067ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb42800baf0 tx=0x7fb42800b370).stop 2023-10-03T10:10:02.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.074+0000 7fb433367700 1 -- 172.21.15.72:0/1578394156 shutdown_connections 2023-10-03T10:10:02.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.074+0000 7fb433367700 1 --2- 172.21.15.72:0/1578394156 >> v2:172.21.15.72:3300/0 conn(0x7fb42c092340 0x7fb42c127680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.074+0000 7fb433367700 1 --2- 172.21.15.72:0/1578394156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb42c123e70 0x7fb42c067ce0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.074+0000 7fb433367700 1 -- 172.21.15.72:0/1578394156 >> 172.21.15.72:0/1578394156 conn(0x7fb42c09a220 msgr2=0x7fb42c09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.074+0000 7fb433367700 1 -- 172.21.15.72:0/1578394156 shutdown_connections 2023-10-03T10:10:02.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.074+0000 7fb433367700 1 -- 172.21.15.72:0/1578394156 wait complete. 2023-10-03T10:10:02.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.074+0000 7fb433367700 1 Processor -- start 2023-10-03T10:10:02.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.074+0000 7fb433367700 1 -- start start 2023-10-03T10:10:02.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb433367700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb42c092340 0x7fb42c115b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb433367700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb42c123a90 0x7fb42c116070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb433367700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42c123e70 0x7fb42c116560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb433367700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c116a50 con 0x7fb42c123e70 2023-10-03T10:10:02.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb433367700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c066cd0 con 0x7fb42c092340 2023-10-03T10:10:02.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb433367700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c0697c0 con 0x7fb42c123a90 2023-10-03T10:10:02.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb431103700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb42c092340 0x7fb42c115b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb431103700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb42c092340 0x7fb42c115b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51536/0 (socket says 172.21.15.72:51536) 2023-10-03T10:10:02.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb431904700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42c123e70 0x7fb42c116560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb431103700 1 -- 172.21.15.72:0/2091859507 learned_addr learned my addr 172.21.15.72:0/2091859507 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:02.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb430902700 1 --2- 172.21.15.72:0/2091859507 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb42c123a90 0x7fb42c116070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb431904700 1 -- 172.21.15.72:0/2091859507 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb42c123a90 msgr2=0x7fb42c116070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb431904700 1 --2- 172.21.15.72:0/2091859507 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb42c123a90 0x7fb42c116070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb431904700 1 -- 172.21.15.72:0/2091859507 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb42c092340 msgr2=0x7fb42c115b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb431904700 1 --2- 172.21.15.72:0/2091859507 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb42c092340 0x7fb42c115b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb431904700 1 -- 172.21.15.72:0/2091859507 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb424009a20 con 0x7fb42c123e70 2023-10-03T10:10:02.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.075+0000 7fb431103700 1 --2- 172.21.15.72:0/2091859507 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb42c092340 0x7fb42c115b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.076+0000 7fb431904700 1 --2- 172.21.15.72:0/2091859507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42c123e70 0x7fb42c116560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb424009e70 tx=0x7fb42400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.076+0000 7fb41d7fa700 1 -- 172.21.15.72:0/2091859507 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42400caa0 con 0x7fb42c123e70 2023-10-03T10:10:02.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.076+0000 7fb41d7fa700 1 -- 172.21.15.72:0/2091859507 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42400f040 con 0x7fb42c123e70 2023-10-03T10:10:02.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.076+0000 7fb433367700 1 -- 172.21.15.72:0/2091859507 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42800b6a0 con 0x7fb42c123e70 2023-10-03T10:10:02.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.076+0000 7fb41d7fa700 1 -- 172.21.15.72:0/2091859507 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42400ce10 con 0x7fb42c123e70 2023-10-03T10:10:02.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.076+0000 7fb433367700 1 -- 172.21.15.72:0/2091859507 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42c119340 con 0x7fb42c123e70 2023-10-03T10:10:02.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.077+0000 7fb41d7fa700 1 -- 172.21.15.72:0/2091859507 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb424013610 con 0x7fb42c123e70 2023-10-03T10:10:02.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.077+0000 7fb41d7fa700 1 -- 172.21.15.72:0/2091859507 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb42403b780 con 0x7fb42c123e70 2023-10-03T10:10:02.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.077+0000 7fb433367700 1 -- 172.21.15.72:0/2091859507 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42c05a260 con 0x7fb42c123e70 2023-10-03T10:10:02.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.081+0000 7fb41d7fa700 1 -- 172.21.15.72:0/2091859507 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb42401c410 con 0x7fb42c123e70 2023-10-03T10:10:02.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.276+0000 7fb433367700 1 -- 172.21.15.72:0/2091859507 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb42c046c20 con 0x7fb42c123e70 2023-10-03T10:10:02.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.277+0000 7fb41d7fa700 1 -- 172.21.15.72:0/2091859507 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2154 (secure 0 0 0) 0x7fb42402a090 con 0x7fb42c123e70 2023-10-03T10:10:02.276 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:10:02.276 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:46.344785+0000","modified":"2023-10-03T10:09:48.352357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6817/542674768","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6817","nonce":542674768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:10:02.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.278+0000 7fb433367700 1 -- 172.21.15.72:0/2091859507 >> v1:172.21.15.72:6816/118184 conn(0x7fb41002bb90 legacy=0x7fb41002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.278+0000 7fb433367700 1 -- 172.21.15.72:0/2091859507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42c123e70 msgr2=0x7fb42c116560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.278+0000 7fb433367700 1 --2- 172.21.15.72:0/2091859507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42c123e70 0x7fb42c116560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb424009e70 tx=0x7fb42400b040).stop 2023-10-03T10:10:02.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.278+0000 7fb433367700 1 -- 172.21.15.72:0/2091859507 shutdown_connections 2023-10-03T10:10:02.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.278+0000 7fb433367700 1 --2- 172.21.15.72:0/2091859507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42c123e70 0x7fb42c116560 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.278+0000 7fb433367700 1 --2- 172.21.15.72:0/2091859507 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb42c092340 0x7fb42c115b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.278+0000 7fb433367700 1 --2- 172.21.15.72:0/2091859507 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb42c123a90 0x7fb42c116070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.278+0000 7fb433367700 1 -- 172.21.15.72:0/2091859507 >> 172.21.15.72:0/2091859507 conn(0x7fb42c09a220 msgr2=0x7fb42c065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.279+0000 7fb433367700 1 -- 172.21.15.72:0/2091859507 shutdown_connections 2023-10-03T10:10:02.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.279+0000 7fb433367700 1 -- 172.21.15.72:0/2091859507 wait complete. 2023-10-03T10:10:02.279 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 5 2023-10-03T10:10:02.390 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T10:09:46.344785+0000', 'modified': '2023-10-03T10:09:48.352357+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4187}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4187': {'gid': 4187, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6817/542674768', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.72:6817', 'nonce': 542674768}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-03T10:10:02.391 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T10:10:02.391 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T10:10:02.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.508+0000 7fbdb218a700 1 Processor -- start 2023-10-03T10:10:02.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.508+0000 7fbdb218a700 1 -- start start 2023-10-03T10:10:02.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.508+0000 7fbdb218a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdac059070 0x7fbdac127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.508+0000 7fbdb218a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdac127390 0x7fbdac127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.508+0000 7fbdb218a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdac091b60 con 0x7fbdac095370 2023-10-03T10:10:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.508+0000 7fbdb218a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac059450 con 0x7fbdac059070 2023-10-03T10:10:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.508+0000 7fbdb218a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0968c0 con 0x7fbdac127390 2023-10-03T10:10:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.508+0000 7fbdab7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdac059070 0x7fbdac127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.508+0000 7fbdaaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdac127390 0x7fbdac127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.508+0000 7fbdabfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbdac095370 0x7fbdac0957f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48246/0 (socket says 172.21.15.72:48246) 2023-10-03T10:10:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.508+0000 7fbdabfff700 1 -- 172.21.15.72:0/1840319379 learned_addr learned my addr 172.21.15.72:0/1840319379 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:10:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdab7fe700 1 -- 172.21.15.72:0/1840319379 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdac127390 msgr2=0x7fbdac127d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdab7fe700 1 --2- 172.21.15.72:0/1840319379 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdac127390 0x7fbdac127d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdaa7fc700 1 -- 172.21.15.72:0/1840319379 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351624676 0 0) 0x7fbdac091b60 con 0x7fbdac095370 2023-10-03T10:10:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdab7fe700 1 -- 172.21.15.72:0/1840319379 >> v1:172.21.15.72:6789/0 conn(0x7fbdac095370 legacy=0x7fbdac0957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdab7fe700 1 -- 172.21.15.72:0/1840319379 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac092a10 con 0x7fbdac059070 2023-10-03T10:10:02.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdaaffd700 1 --2- 172.21.15.72:0/1840319379 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdac127390 0x7fbdac127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdab7fe700 1 --2- 172.21.15.72:0/1840319379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdac059070 0x7fbdac127890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fbd9c009790 tx=0x7fbd9c009060).ready entity=mon.1 client_cookie=6574028fb0dcf02 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdaa7fc700 1 -- 172.21.15.72:0/1840319379 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c0090d0 con 0x7fbdac059070 2023-10-03T10:10:02.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdaa7fc700 1 -- 172.21.15.72:0/1840319379 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c00f510 con 0x7fbdac059070 2023-10-03T10:10:02.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdaa7fc700 1 -- 172.21.15.72:0/1840319379 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00f890 con 0x7fbdac059070 2023-10-03T10:10:02.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdb218a700 1 -- 172.21.15.72:0/1840319379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdac059070 msgr2=0x7fbdac127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdb218a700 1 --2- 172.21.15.72:0/1840319379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdac059070 0x7fbdac127890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fbd9c009790 tx=0x7fbd9c009060).stop 2023-10-03T10:10:02.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdb218a700 1 -- 172.21.15.72:0/1840319379 shutdown_connections 2023-10-03T10:10:02.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdb218a700 1 --2- 172.21.15.72:0/1840319379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdac059070 0x7fbdac127890 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdb218a700 1 --2- 172.21.15.72:0/1840319379 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdac127390 0x7fbdac127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.509+0000 7fbdb218a700 1 -- 172.21.15.72:0/1840319379 >> 172.21.15.72:0/1840319379 conn(0x7fbdac097470 msgr2=0x7fbdac097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.510+0000 7fbdb218a700 1 -- 172.21.15.72:0/1840319379 shutdown_connections 2023-10-03T10:10:02.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.510+0000 7fbdb218a700 1 -- 172.21.15.72:0/1840319379 wait complete. 2023-10-03T10:10:02.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.511+0000 7fbdb218a700 1 Processor -- start 2023-10-03T10:10:02.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.511+0000 7fbdb218a700 1 -- start start 2023-10-03T10:10:02.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.511+0000 7fbdb218a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdac059070 0x7fbdac1259e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.511+0000 7fbdb218a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdac095370 0x7fbdac114910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.511+0000 7fbdb218a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdac127390 0x7fbdac114e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.511+0000 7fbdb218a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac096ea0 con 0x7fbdac095370 2023-10-03T10:10:02.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.511+0000 7fbdb218a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac1183b0 con 0x7fbdac127390 2023-10-03T10:10:02.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.511+0000 7fbdb218a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac1290c0 con 0x7fbdac059070 2023-10-03T10:10:02.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbdab7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdac059070 0x7fbdac1259e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbdaaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdac095370 0x7fbdac114910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbdabfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdac127390 0x7fbdac114e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbdab7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdac059070 0x7fbdac1259e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59624/0 (socket says 172.21.15.72:59624) 2023-10-03T10:10:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbdaaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdac095370 0x7fbdac114910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60930/0 (socket says 172.21.15.72:60930) 2023-10-03T10:10:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbdab7fe700 1 -- 172.21.15.72:0/4293678651 learned_addr learned my addr 172.21.15.72:0/4293678651 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbdab7fe700 1 -- 172.21.15.72:0/4293678651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdac127390 msgr2=0x7fbdac114e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbdab7fe700 1 --2- 172.21.15.72:0/4293678651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdac127390 0x7fbdac114e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbdab7fe700 1 -- 172.21.15.72:0/4293678651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdac095370 msgr2=0x7fbdac114910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbdab7fe700 1 --2- 172.21.15.72:0/4293678651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdac095370 0x7fbdac114910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbdab7fe700 1 -- 172.21.15.72:0/4293678651 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda00092a0 con 0x7fbdac059070 2023-10-03T10:10:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbdaaffd700 1 --2- 172.21.15.72:0/4293678651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdac095370 0x7fbdac114910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbdab7fe700 1 --2- 172.21.15.72:0/4293678651 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdac059070 0x7fbdac1259e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fbdac091cf0 tx=0x7fbd9c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbd937fe700 1 -- 172.21.15.72:0/4293678651 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00f890 con 0x7fbdac059070 2023-10-03T10:10:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbd937fe700 1 -- 172.21.15.72:0/4293678651 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c009e60 con 0x7fbdac059070 2023-10-03T10:10:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbdb218a700 1 -- 172.21.15.72:0/4293678651 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9c0092a0 con 0x7fbdac059070 2023-10-03T10:10:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbd937fe700 1 -- 172.21.15.72:0/4293678651 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00fea0 con 0x7fbdac059070 2023-10-03T10:10:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.512+0000 7fbdb218a700 1 -- 172.21.15.72:0/4293678651 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac118a90 con 0x7fbdac059070 2023-10-03T10:10:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.513+0000 7fbd937fe700 1 -- 172.21.15.72:0/4293678651 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fbd9c01b620 con 0x7fbdac059070 2023-10-03T10:10:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.513+0000 7fbd937fe700 1 -- 172.21.15.72:0/4293678651 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fbd9c03c830 con 0x7fbdac059070 2023-10-03T10:10:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.516+0000 7fbdc3b3db80 1 Processor -- start 2023-10-03T10:10:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.516+0000 7fbdc3b3db80 1 -- start start 2023-10-03T10:10:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.516+0000 7fbdc3b3db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976170 0x55560c976550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.516+0000 7fbdc3b3db80 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c976a40 0x55560c9a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.516+0000 7fbdc3b3db80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c9a05b0 0x55560c9a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.516+0000 7fbdc3b3db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560c940610 con 0x55560c976170 2023-10-03T10:10:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.516+0000 7fbdc3b3db80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55560c8b6db0 con 0x55560c9a05b0 2023-10-03T10:10:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.516+0000 7fbdc3b3db80 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x55560c8cc030 con 0x55560c976a40 2023-10-03T10:10:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.516+0000 7fbdaaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c976a40 0x55560c9a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.516+0000 7fbdaaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c976a40 0x55560c9a00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59640/0 (socket says 172.21.15.72:59640) 2023-10-03T10:10:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.516+0000 7fbdaaffd700 1 -- 172.21.15.72:0/4070279665 learned_addr learned my addr 172.21.15.72:0/4070279665 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.516+0000 7fbdabfff700 1 --2- 172.21.15.72:0/4070279665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c9a05b0 0x55560c9a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.516+0000 7fbdab7fe700 1 --2- 172.21.15.72:0/4070279665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976170 0x55560c976550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.517+0000 7fbdaaffd700 1 -- 172.21.15.72:0/4070279665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c9a05b0 msgr2=0x55560c9a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.517+0000 7fbdaaffd700 1 --2- 172.21.15.72:0/4070279665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c9a05b0 0x55560c9a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.517+0000 7fbdaaffd700 1 -- 172.21.15.72:0/4070279665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976170 msgr2=0x55560c976550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.517+0000 7fbdaaffd700 1 --2- 172.21.15.72:0/4070279665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976170 0x55560c976550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.517+0000 7fbdaaffd700 1 -- 172.21.15.72:0/4070279665 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55560c767710 con 0x55560c976a40 2023-10-03T10:10:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.517+0000 7fbdab7fe700 1 --2- 172.21.15.72:0/4070279665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976170 0x55560c976550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.517+0000 7fbdaaffd700 1 --2- 172.21.15.72:0/4070279665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c976a40 0x55560c9a00c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fbda00138e0 tx=0x7fbda0009060).ready entity=mon.2 client_cookie=bfa8e11a520472f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.517+0000 7fbd90ff9700 1 -- 172.21.15.72:0/4070279665 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0015700 con 0x55560c976a40 2023-10-03T10:10:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.517+0000 7fbd90ff9700 1 -- 172.21.15.72:0/4070279665 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda0015860 con 0x55560c976a40 2023-10-03T10:10:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.517+0000 7fbd90ff9700 1 -- 172.21.15.72:0/4070279665 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0015be0 con 0x55560c976a40 2023-10-03T10:10:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.518+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/4070279665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c976a40 msgr2=0x55560c9a00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.518+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/4070279665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c976a40 0x55560c9a00c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fbda00138e0 tx=0x7fbda0009060).stop 2023-10-03T10:10:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.518+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/4070279665 shutdown_connections 2023-10-03T10:10:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.518+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/4070279665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976170 0x55560c976550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.518+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/4070279665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c9a05b0 0x55560c9a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.518+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/4070279665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c976a40 0x55560c9a00c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.518+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/4070279665 >> 172.21.15.72:0/4070279665 conn(0x55560c7e4940 msgr2=0x55560c996cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.518+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/4070279665 shutdown_connections 2023-10-03T10:10:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.518+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/4070279665 wait complete. 2023-10-03T10:10:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.518+0000 7fbdc3b3db80 1 -- start start 2023-10-03T10:10:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.518+0000 7fbdc3b3db80 1 Processor -- start 2023-10-03T10:10:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdc3b3db80 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c976170 0x55560c99b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdc3b3db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 0x55560c99bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdc3b3db80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c9a05b0 0x55560c99c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdc3b3db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560c8cc170 con 0x55560c976a40 2023-10-03T10:10:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdc3b3db80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55560c8cc3f0 con 0x55560c9a05b0 2023-10-03T10:10:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdc3b3db80 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x55560c897920 con 0x55560c976170 2023-10-03T10:10:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdc3b3db80 10 client.0 ll_register_callbacks cb 0x55560c86cce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:10:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdab7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c976170 0x55560c99b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdab7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c976170 0x55560c99b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59644/0 (socket says 172.21.15.72:59644) 2023-10-03T10:10:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdab7fe700 1 -- 172.21.15.72:0/3301484867 learned_addr learned my addr 172.21.15.72:0/3301484867 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdaaffd700 1 --2- 172.21.15.72:0/3301484867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 0x55560c99bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdabfff700 1 --2- 172.21.15.72:0/3301484867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c9a05b0 0x55560c99c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdab7fe700 1 -- 172.21.15.72:0/3301484867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c9a05b0 msgr2=0x55560c99c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdab7fe700 1 --2- 172.21.15.72:0/3301484867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c9a05b0 0x55560c99c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdab7fe700 1 -- 172.21.15.72:0/3301484867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 msgr2=0x55560c99bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdab7fe700 1 --2- 172.21.15.72:0/3301484867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 0x55560c99bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdab7fe700 1 -- 172.21.15.72:0/3301484867 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda0013440 con 0x55560c976170 2023-10-03T10:10:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdab7fe700 1 --2- 172.21.15.72:0/3301484867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c976170 0x55560c99b9d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fbd9c010b50 tx=0x7fbd9c01c000).ready entity=mon.2 client_cookie=2130c11d8aeb556 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbd89ffb700 10 client.0 ms_handle_connect on v2:172.21.15.72:3302/0 2023-10-03T10:10:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbd89ffb700 1 -- 172.21.15.72:0/3301484867 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c02ce60 con 0x55560c976170 2023-10-03T10:10:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbd89ffb700 1 -- 172.21.15.72:0/3301484867 <== mon.2 v2:172.21.15.72:3302/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fbd9c010bc0 con 0x55560c976170 2023-10-03T10:10:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/3301484867 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55560c96ef20 con 0x55560c976170 2023-10-03T10:10:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbd89ffb700 1 -- 172.21.15.72:0/3301484867 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd9c03cbd0 con 0x55560c976170 2023-10-03T10:10:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdc3b3db80 10 client.4490 fetch_fsmap learned FSMap version 5 2023-10-03T10:10:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.519+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/3301484867 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x55560c89eb00 con 0x55560c976170 2023-10-03T10:10:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.520+0000 7fbd89ffb700 1 -- 172.21.15.72:0/3301484867 <== mon.2 v2:172.21.15.72:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55560c96ef20 con 0x55560c976170 2023-10-03T10:10:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.520+0000 7fbd89ffb700 1 -- 172.21.15.72:0/3301484867 <== mon.2 v2:172.21.15.72:3302/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fbd9c01aa40 con 0x55560c976170 2023-10-03T10:10:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.520+0000 7fbdc3b3db80 10 client.4490 fetch_fsmap finished waiting for FSMap version 5 2023-10-03T10:10:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.520+0000 7fbdc3b3db80 10 client.4490 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:10:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.520+0000 7fbdc3b3db80 20 client.4490 populate_metadata read hostname 'smithi072' 2023-10-03T10:10:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.520+0000 7fbdc3b3db80 4 client.4490 mds_command: new command op to 4187 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T10:10:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.520+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/3301484867 --> v1:172.21.15.72:6817/542674768 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55560c944250 con 0x55560c9908c0 2023-10-03T10:10:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.520+0000 7fbd89ffb700 10 client.4490 ms_handle_connect on v1:172.21.15.72:6817/542674768 2023-10-03T10:10:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.521+0000 7fbd89ffb700 1 -- 172.21.15.72:0/3301484867 <== mds.0 v1:172.21.15.72:6817/542674768 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55560c944250 con 0x55560c9908c0 2023-10-03T10:10:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.521+0000 7fbd89ffb700 10 client.4490 handle_command_reply: tid=0 2023-10-03T10:10:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.521+0000 7fbdc3b3db80 1 client.4490 shutdown 2023-10-03T10:10:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.521+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/3301484867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c976170 msgr2=0x55560c99b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.521+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/3301484867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c976170 0x55560c99b9d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fbd9c010b50 tx=0x7fbd9c01c000).stop 2023-10-03T10:10:02.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.521+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/3301484867 shutdown_connections 2023-10-03T10:10:02.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.521+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/3301484867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c9a05b0 0x55560c99c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.521+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/3301484867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c976170 0x55560c99b9d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.521+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/3301484867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 0x55560c99bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.521+0000 7fbd89ffb700 0 client.4490 ms_handle_reset on v1:172.21.15.72:6817/542674768 2023-10-03T10:10:02.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.521+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/3301484867 >> 172.21.15.72:0/3301484867 conn(0x55560c7e4940 msgr2=0x55560c996c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.521+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/3301484867 shutdown_connections 2023-10-03T10:10:02.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.521+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/3301484867 wait complete. 2023-10-03T10:10:02.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.521+0000 7fbdc3b3db80 20 client.4490 trim_cache size 0 max 16384 2023-10-03T10:10:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.537+0000 7fbdc3b3db80 1 Processor -- start 2023-10-03T10:10:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.537+0000 7fbdc3b3db80 1 -- start start 2023-10-03T10:10:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.537+0000 7fbdc3b3db80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c976170 0x55560c972610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.537+0000 7fbdc3b3db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 0x55560c99e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.537+0000 7fbdc3b3db80 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c9a05b0 0x55560c994480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.537+0000 7fbdc3b3db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560c944250 con 0x55560c976a40 2023-10-03T10:10:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.537+0000 7fbdc3b3db80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55560c994970 con 0x55560c976170 2023-10-03T10:10:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.537+0000 7fbdc3b3db80 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x55560c9770b0 con 0x55560c9a05b0 2023-10-03T10:10:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.537+0000 7fbdab7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c976170 0x55560c972610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.537+0000 7fbdaaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 0x55560c99e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.537+0000 7fbdabfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c9a05b0 0x55560c994480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.537+0000 7fbdab7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c976170 0x55560c972610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51588/0 (socket says 172.21.15.72:51588) 2023-10-03T10:10:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.537+0000 7fbdab7fe700 1 -- 172.21.15.72:0/3498551811 learned_addr learned my addr 172.21.15.72:0/3498551811 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdab7fe700 1 -- 172.21.15.72:0/3498551811 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c9a05b0 msgr2=0x55560c994480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdab7fe700 1 --2- 172.21.15.72:0/3498551811 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c9a05b0 0x55560c994480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdab7fe700 1 -- 172.21.15.72:0/3498551811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 msgr2=0x55560c99e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdab7fe700 1 --2- 172.21.15.72:0/3498551811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 0x55560c99e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdab7fe700 1 -- 172.21.15.72:0/3498551811 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55560c8c4f70 con 0x55560c976170 2023-10-03T10:10:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdaaffd700 1 --2- 172.21.15.72:0/3498551811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 0x55560c99e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdab7fe700 1 --2- 172.21.15.72:0/3498551811 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c976170 0x55560c972610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fbd9c0108d0 tx=0x7fbd9c037000).ready entity=mon.1 client_cookie=763471b7015e9ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbd917fa700 1 -- 172.21.15.72:0/3498551811 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c02ce60 con 0x55560c976170 2023-10-03T10:10:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbd917fa700 1 -- 172.21.15.72:0/3498551811 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c010bc0 con 0x55560c976170 2023-10-03T10:10:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbd917fa700 1 -- 172.21.15.72:0/3498551811 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c01bca0 con 0x55560c976170 2023-10-03T10:10:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/3498551811 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c976170 msgr2=0x55560c972610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/3498551811 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c976170 0x55560c972610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fbd9c0108d0 tx=0x7fbd9c037000).stop 2023-10-03T10:10:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/3498551811 shutdown_connections 2023-10-03T10:10:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/3498551811 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c9a05b0 0x55560c994480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/3498551811 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c976170 0x55560c972610 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/3498551811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 0x55560c99e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/3498551811 >> 172.21.15.72:0/3498551811 conn(0x55560c7e4940 msgr2=0x55560c9791f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/3498551811 shutdown_connections 2023-10-03T10:10:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.538+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/3498551811 wait complete. 2023-10-03T10:10:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.539+0000 7fbdc3b3db80 1 -- start start 2023-10-03T10:10:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.539+0000 7fbdc3b3db80 1 Processor -- start 2023-10-03T10:10:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.539+0000 7fbdc3b3db80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c976170 0x55560c99a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.539+0000 7fbdc3b3db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 0x55560c99aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.539+0000 7fbdc3b3db80 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c9a05b0 0x55560c9fa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.539+0000 7fbdc3b3db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55560c9dee90 con 0x55560c976a40 2023-10-03T10:10:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.539+0000 7fbdc3b3db80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55560c9de2b0 con 0x55560c976170 2023-10-03T10:10:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.539+0000 7fbdc3b3db80 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x55560c9dd0a0 con 0x55560c9a05b0 2023-10-03T10:10:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.539+0000 7fbdc3b3db80 10 client.0 ll_register_callbacks cb 0x55560c86cce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:10:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.539+0000 7fbdabfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c9a05b0 0x55560c9fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.539+0000 7fbdab7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c976170 0x55560c99a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.539+0000 7fbdaaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 0x55560c99aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.539+0000 7fbdab7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c976170 0x55560c99a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51596/0 (socket says 172.21.15.72:51596) 2023-10-03T10:10:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.539+0000 7fbdabfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c9a05b0 0x55560c9fa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59664/0 (socket says 172.21.15.72:59664) 2023-10-03T10:10:02.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.539+0000 7fbdab7fe700 1 -- 172.21.15.72:0/594824706 learned_addr learned my addr 172.21.15.72:0/594824706 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:02.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbdaaffd700 1 -- 172.21.15.72:0/594824706 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c9a05b0 msgr2=0x55560c9fa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbdaaffd700 1 --2- 172.21.15.72:0/594824706 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c9a05b0 0x55560c9fa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbdaaffd700 1 -- 172.21.15.72:0/594824706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c976170 msgr2=0x55560c99a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbdaaffd700 1 --2- 172.21.15.72:0/594824706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c976170 0x55560c99a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbdaaffd700 1 -- 172.21.15.72:0/594824706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55560c767710 con 0x55560c976a40 2023-10-03T10:10:02.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbdab7fe700 1 --2- 172.21.15.72:0/594824706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c976170 0x55560c99a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbdaaffd700 1 --2- 172.21.15.72:0/594824706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 0x55560c99aaa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fbda0017000 tx=0x7fbda0021040).ready entity=mon.0 client_cookie=d6a62a03138b1a88 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbd89ffb700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-10-03T10:10:02.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbd89ffb700 1 -- 172.21.15.72:0/594824706 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0015cb0 con 0x55560c976a40 2023-10-03T10:10:02.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbd89ffb700 1 -- 172.21.15.72:0/594824706 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fbda0015e10 con 0x55560c976a40 2023-10-03T10:10:02.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/594824706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbda0015860 con 0x55560c976a40 2023-10-03T10:10:02.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbd89ffb700 1 -- 172.21.15.72:0/594824706 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=5) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbda0014830 con 0x55560c976a40 2023-10-03T10:10:02.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbdc3b3db80 10 client.4608 fetch_fsmap learned FSMap version 5 2023-10-03T10:10:02.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/594824706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=5,monmap=2+}) v3 -- 0x55560c89eb00 con 0x55560c976a40 2023-10-03T10:10:02.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbd89ffb700 1 -- 172.21.15.72:0/594824706 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda0015860 con 0x55560c976a40 2023-10-03T10:10:02.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbd89ffb700 1 -- 172.21.15.72:0/594824706 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 5) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fbda0032070 con 0x55560c976a40 2023-10-03T10:10:02.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbdc3b3db80 10 client.4608 fetch_fsmap finished waiting for FSMap version 5 2023-10-03T10:10:02.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbdc3b3db80 10 client.4608 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:10:02.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbdc3b3db80 20 client.4608 populate_metadata read hostname 'smithi072' 2023-10-03T10:10:02.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbdc3b3db80 4 client.4608 mds_command: new command op to 4187 tid=0[{"prefix": "status"}] 2023-10-03T10:10:02.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.540+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/594824706 --> v1:172.21.15.72:6817/542674768 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55560c734ef0 con 0x55560c9fb170 2023-10-03T10:10:02.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.541+0000 7fbd89ffb700 10 client.4608 ms_handle_connect on v1:172.21.15.72:6817/542674768 2023-10-03T10:10:02.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.541+0000 7fbd89ffb700 1 -- 172.21.15.72:0/594824706 <== mds.0 v1:172.21.15.72:6817/542674768 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (unknown 0 0 2036924118) 0x55560c734ef0 con 0x55560c9fb170 2023-10-03T10:10:02.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.541+0000 7fbd89ffb700 10 client.4608 handle_command_reply: tid=0 2023-10-03T10:10:02.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.541+0000 7fbdc3b3db80 1 client.4608 shutdown 2023-10-03T10:10:02.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.541+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/594824706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 msgr2=0x55560c99aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.541+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/594824706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 0x55560c99aaa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fbda0017000 tx=0x7fbda0021040).stop 2023-10-03T10:10:02.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.541+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/594824706 shutdown_connections 2023-10-03T10:10:02.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.541+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/594824706 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55560c9a05b0 0x55560c9fa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.541+0000 7fbd89ffb700 0 client.4608 ms_handle_reset on v1:172.21.15.72:6817/542674768 2023-10-03T10:10:02.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.541+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/594824706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55560c976170 0x55560c99a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.541+0000 7fbdc3b3db80 1 --2- 172.21.15.72:0/594824706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55560c976a40 0x55560c99aaa0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.541+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/594824706 >> 172.21.15.72:0/594824706 conn(0x55560c7e4940 msgr2=0x55560c996b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.541+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/594824706 shutdown_connections 2023-10-03T10:10:02.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.541+0000 7fbdc3b3db80 1 -- 172.21.15.72:0/594824706 wait complete. 2023-10-03T10:10:02.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.541+0000 7fbdc3b3db80 20 client.4608 trim_cache size 0 max 16384 2023-10-03T10:10:02.549 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-03T10:10:02.549 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "33894c9a-ea73-4e47-9ce0-b9e281957c98", 2023-10-03T10:10:02.549 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-10-03T10:10:02.549 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4187, 2023-10-03T10:10:02.549 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-10-03T10:10:02.549 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-10-03T10:10:02.549 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-10-03T10:10:02.549 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 16.194506766, 2023-10-03T10:10:02.549 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 5, 2023-10-03T10:10:02.550 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 17, 2023-10-03T10:10:02.550 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 17, 2023-10-03T10:10:02.550 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 20.501205679000002 2023-10-03T10:10:02.550 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-03T10:10:02.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.542+0000 7fbdb218a700 1 -- 172.21.15.72:0/4293678651 >> v1:172.21.15.72:6816/118184 conn(0x7fbd9802bb60 legacy=0x7fbd9802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.542+0000 7fbdb218a700 1 -- 172.21.15.72:0/4293678651 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdac059070 msgr2=0x7fbdac1259e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.542+0000 7fbdb218a700 1 --2- 172.21.15.72:0/4293678651 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdac059070 0x7fbdac1259e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fbdac091cf0 tx=0x7fbd9c017000).stop 2023-10-03T10:10:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.542+0000 7fbdb218a700 1 -- 172.21.15.72:0/4293678651 shutdown_connections 2023-10-03T10:10:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.542+0000 7fbdb218a700 1 --2- 172.21.15.72:0/4293678651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdac127390 0x7fbdac114e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.542+0000 7fbdb218a700 1 --2- 172.21.15.72:0/4293678651 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdac059070 0x7fbdac1259e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.542+0000 7fbdb218a700 1 --2- 172.21.15.72:0/4293678651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdac095370 0x7fbdac114910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.542+0000 7fbdb218a700 1 -- 172.21.15.72:0/4293678651 >> 172.21.15.72:0/4293678651 conn(0x7fbdac097470 msgr2=0x7fbdac12a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.542+0000 7fbdb218a700 1 -- 172.21.15.72:0/4293678651 shutdown_connections 2023-10-03T10:10:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.542+0000 7fbdb218a700 1 -- 172.21.15.72:0/4293678651 wait complete. 2023-10-03T10:10:02.553 INFO:teuthology.run_tasks:Running task exec... 2023-10-03T10:10:02.564 INFO:teuthology.task.exec:Executing custom commands... 2023-10-03T10:10:02.564 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi072.front.sepia.ceph.com 2023-10-03T10:10:02.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client pacific' 2023-10-03T10:10:02.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.679+0000 7fe2053d9700 1 Processor -- start 2023-10-03T10:10:02.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.679+0000 7fe2053d9700 1 -- start start 2023-10-03T10:10:02.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.679+0000 7fe2053d9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe200097da0 0x7fe200098c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.679+0000 7fe2053d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe200099110 0x7fe200132490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.679+0000 7fe2053d9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe200066040 con 0x7fe200065500 2023-10-03T10:10:02.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.679+0000 7fe2053d9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2000658e0 con 0x7fe200097da0 2023-10-03T10:10:02.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.679+0000 7fe2053d9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe200066530 con 0x7fe200099110 2023-10-03T10:10:02.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.679+0000 7fe1fe7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe200097da0 0x7fe200098c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.679+0000 7fe1ff7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe200099110 0x7fe200132490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.679+0000 7fe1feffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe200065500 0x7fe200098510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48252/0 (socket says 172.21.15.72:48252) 2023-10-03T10:10:02.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.679+0000 7fe1fe7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe200097da0 0x7fe200098c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60992/0 (socket says 172.21.15.72:60992) 2023-10-03T10:10:02.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.679+0000 7fe1ff7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe200099110 0x7fe200132490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59674/0 (socket says 172.21.15.72:59674) 2023-10-03T10:10:02.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.679+0000 7fe1fe7fc700 1 -- 172.21.15.72:0/3136996658 learned_addr learned my addr 172.21.15.72:0/3136996658 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:02.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe1fe7fc700 1 -- 172.21.15.72:0/3136996658 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe200099110 msgr2=0x7fe200132490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:02.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe1fe7fc700 1 --2- 172.21.15.72:0/3136996658 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe200099110 0x7fe200132490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe1fe7fc700 1 -- 172.21.15.72:0/3136996658 >> v1:172.21.15.72:6789/0 conn(0x7fe200065500 legacy=0x7fe200098510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe1fe7fc700 1 -- 172.21.15.72:0/3136996658 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2000952f0 con 0x7fe200097da0 2023-10-03T10:10:02.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe1fdffb700 1 -- 172.21.15.72:0/3136996658 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260887973 0 0) 0x7fe200066040 con 0x7fe200065500 2023-10-03T10:10:02.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe1ff7fe700 1 --2- 172.21.15.72:0/3136996658 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe200099110 0x7fe200132490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe1fe7fc700 1 --2- 172.21.15.72:0/3136996658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe200097da0 0x7fe200098c20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fe1f4009830 tx=0x7fe1f40090f0).ready entity=mon.0 client_cookie=26f328f9b045021 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe1fdffb700 1 -- 172.21.15.72:0/3136996658 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400b580 con 0x7fe200097da0 2023-10-03T10:10:02.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe1fdffb700 1 -- 172.21.15.72:0/3136996658 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f400b6e0 con 0x7fe200097da0 2023-10-03T10:10:02.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe1fdffb700 1 -- 172.21.15.72:0/3136996658 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400ba80 con 0x7fe200097da0 2023-10-03T10:10:02.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe2053d9700 1 -- 172.21.15.72:0/3136996658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe200097da0 msgr2=0x7fe200098c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe2053d9700 1 --2- 172.21.15.72:0/3136996658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe200097da0 0x7fe200098c20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fe1f4009830 tx=0x7fe1f40090f0).stop 2023-10-03T10:10:02.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe2053d9700 1 -- 172.21.15.72:0/3136996658 shutdown_connections 2023-10-03T10:10:02.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe2053d9700 1 --2- 172.21.15.72:0/3136996658 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe200099110 0x7fe200132490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe2053d9700 1 --2- 172.21.15.72:0/3136996658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe200097da0 0x7fe200098c20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe2053d9700 1 -- 172.21.15.72:0/3136996658 >> 172.21.15.72:0/3136996658 conn(0x7fe20009a6e0 msgr2=0x7fe20009aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe2053d9700 1 -- 172.21.15.72:0/3136996658 shutdown_connections 2023-10-03T10:10:02.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.680+0000 7fe2053d9700 1 -- 172.21.15.72:0/3136996658 wait complete. 2023-10-03T10:10:02.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.681+0000 7fe2053d9700 1 Processor -- start 2023-10-03T10:10:02.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.681+0000 7fe2053d9700 1 -- start start 2023-10-03T10:10:02.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe2053d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe200065500 0x7fe2001323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe2053d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe200099110 0x7fe20011a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe2053d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20011a7a0 0x7fe20011ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:02.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe2053d9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20011e7e0 con 0x7fe20011a7a0 2023-10-03T10:10:02.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe2053d9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20011e3a0 con 0x7fe200099110 2023-10-03T10:10:02.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe2053d9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe200099bb0 con 0x7fe200065500 2023-10-03T10:10:02.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe1feffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe200065500 0x7fe2001323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe1feffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe200065500 0x7fe2001323e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59676/0 (socket says 172.21.15.72:59676) 2023-10-03T10:10:02.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe1feffd700 1 -- 172.21.15.72:0/437217381 learned_addr learned my addr 172.21.15.72:0/437217381 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:02.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe1ff7fe700 1 --2- 172.21.15.72:0/437217381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20011a7a0 0x7fe20011ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe1fe7fc700 1 --2- 172.21.15.72:0/437217381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe200099110 0x7fe20011a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:02.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe1ff7fe700 1 -- 172.21.15.72:0/437217381 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe200065500 msgr2=0x7fe2001323e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe1ff7fe700 1 --2- 172.21.15.72:0/437217381 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe200065500 0x7fe2001323e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe1ff7fe700 1 -- 172.21.15.72:0/437217381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe200099110 msgr2=0x7fe20011a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe1ff7fe700 1 --2- 172.21.15.72:0/437217381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe200099110 0x7fe20011a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe1ff7fe700 1 -- 172.21.15.72:0/437217381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f8009a20 con 0x7fe20011a7a0 2023-10-03T10:10:02.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe1feffd700 1 --2- 172.21.15.72:0/437217381 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe200065500 0x7fe2001323e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:02.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.682+0000 7fe1ff7fe700 1 --2- 172.21.15.72:0/437217381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20011a7a0 0x7fe20011ac00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fe1f8009f40 tx=0x7fe1f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:02.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.683+0000 7fe1e6ffd700 1 -- 172.21.15.72:0/437217381 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8009c70 con 0x7fe20011a7a0 2023-10-03T10:10:02.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.683+0000 7fe1e6ffd700 1 -- 172.21.15.72:0/437217381 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f800f040 con 0x7fe20011a7a0 2023-10-03T10:10:02.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.683+0000 7fe2053d9700 1 -- 172.21.15.72:0/437217381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f4009370 con 0x7fe20011a7a0 2023-10-03T10:10:02.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.683+0000 7fe1e6ffd700 1 -- 172.21.15.72:0/437217381 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f800cd80 con 0x7fe20011a7a0 2023-10-03T10:10:02.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.683+0000 7fe2053d9700 1 -- 172.21.15.72:0/437217381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20011b6b0 con 0x7fe20011a7a0 2023-10-03T10:10:02.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.683+0000 7fe1e6ffd700 1 -- 172.21.15.72:0/437217381 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe1f8013610 con 0x7fe20011a7a0 2023-10-03T10:10:02.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.683+0000 7fe1e6ffd700 1 -- 172.21.15.72:0/437217381 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe1f803b7a0 con 0x7fe20011a7a0 2023-10-03T10:10:02.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.684+0000 7fe2053d9700 1 -- 172.21.15.72:0/437217381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20009ccb0 con 0x7fe20011a7a0 2023-10-03T10:10:02.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.688+0000 7fe1e6ffd700 1 -- 172.21.15.72:0/437217381 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe1f801c410 con 0x7fe20011a7a0 2023-10-03T10:10:02.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.855+0000 7fe2053d9700 1 -- 172.21.15.72:0/437217381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "pacific"} v 0) v1 -- 0x7fe20009b200 con 0x7fe20011a7a0 2023-10-03T10:10:02.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.947+0000 7fe1e6ffd700 1 -- 172.21.15.72:0/437217381 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "pacific"}]=0 set require_min_compat_client to pacific v18) v1 ==== 143+0+0 (secure 0 0 0) 0x7fe1f801b6f0 con 0x7fe20011a7a0 2023-10-03T10:10:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.949+0000 7fe2053d9700 1 -- 172.21.15.72:0/437217381 >> v1:172.21.15.72:6816/118184 conn(0x7fe1ec02bb60 legacy=0x7fe1ec02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.949+0000 7fe2053d9700 1 -- 172.21.15.72:0/437217381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20011a7a0 msgr2=0x7fe20011ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.949+0000 7fe2053d9700 1 --2- 172.21.15.72:0/437217381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20011a7a0 0x7fe20011ac00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fe1f8009f40 tx=0x7fe1f800b040).stop 2023-10-03T10:10:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.949+0000 7fe2053d9700 1 -- 172.21.15.72:0/437217381 shutdown_connections 2023-10-03T10:10:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.949+0000 7fe2053d9700 1 --2- 172.21.15.72:0/437217381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20011a7a0 0x7fe20011ac00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.949+0000 7fe2053d9700 1 --2- 172.21.15.72:0/437217381 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe200065500 0x7fe2001323e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.949+0000 7fe2053d9700 1 --2- 172.21.15.72:0/437217381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe200099110 0x7fe20011a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.949+0000 7fe2053d9700 1 -- 172.21.15.72:0/437217381 >> 172.21.15.72:0/437217381 conn(0x7fe20009a6e0 msgr2=0x7fe20009ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.949+0000 7fe2053d9700 1 -- 172.21.15.72:0/437217381 shutdown_connections 2023-10-03T10:10:02.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:02.949+0000 7fe2053d9700 1 -- 172.21.15.72:0/437217381 wait complete. 2023-10-03T10:10:02.950 INFO:teuthology.orchestra.run.smithi072.stderr:set require_min_compat_client to pacific 2023-10-03T10:10:02.963 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:10:02.972 INFO:teuthology.task.print:**** done ceph 2023-10-03T10:10:02.972 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-03T10:10:03.001 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-03T10:10:03.001 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-10-03T10:10:03.001 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-03T10:10:03.001 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-03T10:10:03.001 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:03.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:03.002 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-10-03T10:10:03.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:03.025 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2023-10-03T10:10:03.102 INFO:teuthology.orchestra.run.smithi119.stderr:Cannot find device "ceph-brx" 2023-10-03T10:10:03.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:10:03.104 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-03T10:10:03.104 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T10:10:03.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.220+0000 7fcc366bc700 1 Processor -- start 2023-10-03T10:10:03.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.220+0000 7fcc366bc700 1 -- start start 2023-10-03T10:10:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.220+0000 7fcc366bc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcc300613a0 0x7fcc3012ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.220+0000 7fcc366bc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc3012fe50 0x7fcc30132240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.220+0000 7fcc366bc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc30067530 con 0x7fcc30097cb0 2023-10-03T10:10:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.220+0000 7fcc366bc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc30061780 con 0x7fcc300613a0 2023-10-03T10:10:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.220+0000 7fcc366bc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc30066ee0 con 0x7fcc3012fe50 2023-10-03T10:10:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.220+0000 7fcc2ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcc300613a0 0x7fcc3012ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.220+0000 7fcc2f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcc30097cb0 0x7fcc3012b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48254/0 (socket says 172.21.15.72:48254) 2023-10-03T10:10:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.220+0000 7fcc2f7fe700 1 -- 172.21.15.72:0/2808908403 learned_addr learned my addr 172.21.15.72:0/2808908403 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:10:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.220+0000 7fcc34c59700 1 --2- 172.21.15.72:0/2808908403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc3012fe50 0x7fcc30132240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.221+0000 7fcc2ffff700 1 -- 172.21.15.72:0/2808908403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc3012fe50 msgr2=0x7fcc30132240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:03.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.221+0000 7fcc2ffff700 1 --2- 172.21.15.72:0/2808908403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc3012fe50 0x7fcc30132240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.221+0000 7fcc2ffff700 1 -- 172.21.15.72:0/2808908403 >> v1:172.21.15.72:6789/0 conn(0x7fcc30097cb0 legacy=0x7fcc3012b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.221+0000 7fcc2ffff700 1 -- 172.21.15.72:0/2808908403 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3012b880 con 0x7fcc300613a0 2023-10-03T10:10:03.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.221+0000 7fcc2effd700 1 -- 172.21.15.72:0/2808908403 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106139537 0 0) 0x7fcc30067530 con 0x7fcc30097cb0 2023-10-03T10:10:03.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.221+0000 7fcc34c59700 1 --2- 172.21.15.72:0/2808908403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc3012fe50 0x7fcc30132240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:03.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.221+0000 7fcc2ffff700 1 --2- 172.21.15.72:0/2808908403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc300613a0 0x7fcc3012ac80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fcc20009760 tx=0x7fcc20009060).ready entity=mon.0 client_cookie=b86df68414f19886 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:03.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.221+0000 7fcc2effd700 1 -- 172.21.15.72:0/2808908403 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2000f510 con 0x7fcc300613a0 2023-10-03T10:10:03.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.221+0000 7fcc2effd700 1 -- 172.21.15.72:0/2808908403 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2000f670 con 0x7fcc300613a0 2023-10-03T10:10:03.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.221+0000 7fcc2effd700 1 -- 172.21.15.72:0/2808908403 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2000f9f0 con 0x7fcc300613a0 2023-10-03T10:10:03.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.221+0000 7fcc366bc700 1 -- 172.21.15.72:0/2808908403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc300613a0 msgr2=0x7fcc3012ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.221+0000 7fcc366bc700 1 --2- 172.21.15.72:0/2808908403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc300613a0 0x7fcc3012ac80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fcc20009760 tx=0x7fcc20009060).stop 2023-10-03T10:10:03.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.222+0000 7fcc366bc700 1 -- 172.21.15.72:0/2808908403 shutdown_connections 2023-10-03T10:10:03.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.222+0000 7fcc366bc700 1 --2- 172.21.15.72:0/2808908403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc3012fe50 0x7fcc30132240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.222+0000 7fcc366bc700 1 --2- 172.21.15.72:0/2808908403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc300613a0 0x7fcc3012ac80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.222+0000 7fcc366bc700 1 -- 172.21.15.72:0/2808908403 >> 172.21.15.72:0/2808908403 conn(0x7fcc3009a220 msgr2=0x7fcc3009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:03.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.222+0000 7fcc366bc700 1 -- 172.21.15.72:0/2808908403 shutdown_connections 2023-10-03T10:10:03.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.222+0000 7fcc366bc700 1 -- 172.21.15.72:0/2808908403 wait complete. 2023-10-03T10:10:03.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.222+0000 7fcc366bc700 1 Processor -- start 2023-10-03T10:10:03.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc366bc700 1 -- start start 2023-10-03T10:10:03.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc366bc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc300613a0 0x7fcc30112770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc366bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc30097cb0 0x7fcc30112c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc366bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc3012fe50 0x7fcc30113150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:03.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc366bc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc30113640 con 0x7fcc30097cb0 2023-10-03T10:10:03.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc366bc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc30114480 con 0x7fcc3012fe50 2023-10-03T10:10:03.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc366bc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc30115c70 con 0x7fcc300613a0 2023-10-03T10:10:03.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc2ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc300613a0 0x7fcc30112770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc2f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc30097cb0 0x7fcc30112c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc2ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc300613a0 0x7fcc30112770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59680/0 (socket says 172.21.15.72:59680) 2023-10-03T10:10:03.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc2ffff700 1 -- 172.21.15.72:0/1140467170 learned_addr learned my addr 172.21.15.72:0/1140467170 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:03.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc34c59700 1 --2- 172.21.15.72:0/1140467170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc3012fe50 0x7fcc30113150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:03.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc2f7fe700 1 -- 172.21.15.72:0/1140467170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc300613a0 msgr2=0x7fcc30112770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc2f7fe700 1 --2- 172.21.15.72:0/1140467170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc300613a0 0x7fcc30112770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc2f7fe700 1 -- 172.21.15.72:0/1140467170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc3012fe50 msgr2=0x7fcc30113150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc2f7fe700 1 --2- 172.21.15.72:0/1140467170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc3012fe50 0x7fcc30113150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc2f7fe700 1 -- 172.21.15.72:0/1140467170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc28009a20 con 0x7fcc30097cb0 2023-10-03T10:10:03.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.223+0000 7fcc2f7fe700 1 --2- 172.21.15.72:0/1140467170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc30097cb0 0x7fcc30112c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fcc24001eb0 tx=0x7fcc24007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:03.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.224+0000 7fcc17fff700 1 -- 172.21.15.72:0/1140467170 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2400ce10 con 0x7fcc30097cb0 2023-10-03T10:10:03.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.224+0000 7fcc17fff700 1 -- 172.21.15.72:0/1140467170 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc240072e0 con 0x7fcc30097cb0 2023-10-03T10:10:03.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.224+0000 7fcc366bc700 1 -- 172.21.15.72:0/1140467170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc200092a0 con 0x7fcc30097cb0 2023-10-03T10:10:03.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.224+0000 7fcc17fff700 1 -- 172.21.15.72:0/1140467170 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc240057a0 con 0x7fcc30097cb0 2023-10-03T10:10:03.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.224+0000 7fcc366bc700 1 -- 172.21.15.72:0/1140467170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc30067110 con 0x7fcc30097cb0 2023-10-03T10:10:03.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.224+0000 7fcc17fff700 1 -- 172.21.15.72:0/1140467170 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fcc24005bd0 con 0x7fcc30097cb0 2023-10-03T10:10:03.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.224+0000 7fcc17fff700 1 -- 172.21.15.72:0/1140467170 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fcc2403a750 con 0x7fcc30097cb0 2023-10-03T10:10:03.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.225+0000 7fcc366bc700 1 -- 172.21.15.72:0/1140467170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc300667a0 con 0x7fcc30097cb0 2023-10-03T10:10:03.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.229+0000 7fcc17fff700 1 -- 172.21.15.72:0/1140467170 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fcc2401d3f0 con 0x7fcc30097cb0 2023-10-03T10:10:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.426+0000 7fcc366bc700 1 -- 172.21.15.72:0/1140467170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcc3005a260 con 0x7fcc30097cb0 2023-10-03T10:10:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.426+0000 7fcc17fff700 1 -- 172.21.15.72:0/1140467170 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v5) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcc2401c350 con 0x7fcc30097cb0 2023-10-03T10:10:03.427 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T10:10:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.428+0000 7fcc366bc700 1 -- 172.21.15.72:0/1140467170 >> v1:172.21.15.72:6816/118184 conn(0x7fcc1c02bb60 legacy=0x7fcc1c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.428+0000 7fcc366bc700 1 -- 172.21.15.72:0/1140467170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc30097cb0 msgr2=0x7fcc30112c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:03.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.428+0000 7fcc366bc700 1 --2- 172.21.15.72:0/1140467170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc30097cb0 0x7fcc30112c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fcc24001eb0 tx=0x7fcc24007b90).stop 2023-10-03T10:10:03.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.428+0000 7fcc366bc700 1 -- 172.21.15.72:0/1140467170 shutdown_connections 2023-10-03T10:10:03.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.428+0000 7fcc366bc700 1 --2- 172.21.15.72:0/1140467170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc3012fe50 0x7fcc30113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.428+0000 7fcc366bc700 1 --2- 172.21.15.72:0/1140467170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc300613a0 0x7fcc30112770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.428+0000 7fcc366bc700 1 --2- 172.21.15.72:0/1140467170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc30097cb0 0x7fcc30112c60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.428+0000 7fcc366bc700 1 -- 172.21.15.72:0/1140467170 >> 172.21.15.72:0/1140467170 conn(0x7fcc3009a220 msgr2=0x7fcc30095df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.428+0000 7fcc366bc700 1 -- 172.21.15.72:0/1140467170 shutdown_connections 2023-10-03T10:10:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:03.428+0000 7fcc366bc700 1 -- 172.21.15.72:0/1140467170 wait complete. 2023-10-03T10:10:03.440 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T10:10:03.440 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T10:10:03.441 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2023-10-03T10:10:03.441 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-03T10:10:03.441 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:03.441 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T10:10:03.441 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T10:10:03.441 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T10:10:03.441 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T10:10:03.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:03.442 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2023-10-03T10:10:03.465 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T10:10:03.465 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T10:10:03.466 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T10:10:03.466 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-10-03T10:10:03.466 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-10-03T10:10:03.466 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-10-03T10:10:03.466 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-03T10:10:03.466 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2023-10-03T10:10:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2023-10-03T10:10:03.467 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-03T10:10:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2023-10-03T10:10:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2023-10-03T10:10:03.467 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-03T10:10:03.467 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2023-10-03T10:10:03.467 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T10:10:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2023-10-03T10:10:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-03T10:10:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42541sec preferred_lft 42541sec 2023-10-03T10:10:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2023-10-03T10:10:03.468 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-10-03T10:10:03.469 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-03T10:10:03.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:03.469 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-10-03T10:10:03.469 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-10-03T10:10:03.470 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add name ceph-brx type bridge 2023-10-03T10:10:03.470 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr flush dev ceph-brx 2023-10-03T10:10:03.470 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set ceph-brx up 2023-10-03T10:10:03.470 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-03T10:10:03.470 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-10-03T10:10:03.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:03.640 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T10:10:03.670 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-10-03T10:10:03.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:03.672 DEBUG:teuthology.orchestra.run.smithi119:> route 2023-10-03T10:10:03.759 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2023-10-03T10:10:03.759 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T10:10:03.759 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-03T10:10:03.759 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-03T10:10:03.760 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T10:10:03.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:03.760 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-10-03T10:10:03.760 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-10-03T10:10:03.760 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-03T10:10:03.760 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-03T10:10:03.761 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-03T10:10:03.761 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-10-03T10:10:04.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:04.007 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-10-03T10:10:04.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:04.025 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2023-10-03T10:10:04.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:04.082 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-10-03T10:10:04.082 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-10-03T10:10:04.082 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:10:04.082 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-03T10:10:04.082 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-10-03T10:10:04.177 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-03T10:10:04.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:04.177 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-10-03T10:10:04.177 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-10-03T10:10:04.177 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-03T10:10:04.178 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-03T10:10:04.178 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-03T10:10:04.178 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-03T10:10:04.178 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-03T10:10:04.178 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-10-03T10:10:04.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:04.364 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-10-03T10:10:04.364 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-10-03T10:10:04.364 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2023-10-03T10:10:04.364 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.0 master ceph-brx 2023-10-03T10:10:04.364 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-10-03T10:10:04.461 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-03T10:10:04.461 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T10:10:04.461 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:04.478 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-03T10:10:04.479 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T10:10:04.479 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:04.536 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-10-03T10:10:04.604 DEBUG:teuthology.orchestra.run.smithi119:> cat /proc/self/mounts | awk '{print $2}' 2023-10-03T10:10:04.663 INFO:teuthology.orchestra.run.smithi119.stdout:/sys 2023-10-03T10:10:04.663 INFO:teuthology.orchestra.run.smithi119.stdout:/proc 2023-10-03T10:10:04.663 INFO:teuthology.orchestra.run.smithi119.stdout:/dev 2023-10-03T10:10:04.663 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/security 2023-10-03T10:10:04.663 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/shm 2023-10-03T10:10:04.663 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/pts 2023-10-03T10:10:04.663 INFO:teuthology.orchestra.run.smithi119.stdout:/run 2023-10-03T10:10:04.664 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup 2023-10-03T10:10:04.664 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/systemd 2023-10-03T10:10:04.664 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/pstore 2023-10-03T10:10:04.664 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/bpf 2023-10-03T10:10:04.664 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/blkio 2023-10-03T10:10:04.664 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/rdma 2023-10-03T10:10:04.664 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-03T10:10:04.664 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/pids 2023-10-03T10:10:04.664 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/memory 2023-10-03T10:10:04.664 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/freezer 2023-10-03T10:10:04.664 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/cpuset 2023-10-03T10:10:04.664 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/devices 2023-10-03T10:10:04.665 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-03T10:10:04.665 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/hugetlb 2023-10-03T10:10:04.665 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/perf_event 2023-10-03T10:10:04.665 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/tracing 2023-10-03T10:10:04.665 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/config 2023-10-03T10:10:04.665 INFO:teuthology.orchestra.run.smithi119.stdout:/ 2023-10-03T10:10:04.665 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/selinux 2023-10-03T10:10:04.665 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2023-10-03T10:10:04.665 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/mqueue 2023-10-03T10:10:04.665 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/hugepages 2023-10-03T10:10:04.665 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/debug 2023-10-03T10:10:04.665 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/fuse/connections 2023-10-03T10:10:04.666 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/nfs/rpc_pipefs 2023-10-03T10:10:04.666 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/1000 2023-10-03T10:10:04.666 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph 2023-10-03T10:10:04.666 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns 2023-10-03T10:10:04.666 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:10:04.666 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:10:04.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:04.666 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-10-03T10:10:04.721 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T10:10:04.721 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-03T10:10:04.764 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-10-03T10:10:04.790 DEBUG:teuthology.orchestra.run.smithi119:> cat /proc/self/mounts | awk '{print $2}' 2023-10-03T10:10:04.849 INFO:teuthology.orchestra.run.smithi119.stdout:/sys 2023-10-03T10:10:04.849 INFO:teuthology.orchestra.run.smithi119.stdout:/proc 2023-10-03T10:10:04.849 INFO:teuthology.orchestra.run.smithi119.stdout:/dev 2023-10-03T10:10:04.850 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/security 2023-10-03T10:10:04.850 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/shm 2023-10-03T10:10:04.850 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/pts 2023-10-03T10:10:04.850 INFO:teuthology.orchestra.run.smithi119.stdout:/run 2023-10-03T10:10:04.850 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup 2023-10-03T10:10:04.850 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/systemd 2023-10-03T10:10:04.850 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/pstore 2023-10-03T10:10:04.850 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/bpf 2023-10-03T10:10:04.850 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/blkio 2023-10-03T10:10:04.850 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/rdma 2023-10-03T10:10:04.850 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-03T10:10:04.850 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/pids 2023-10-03T10:10:04.851 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/memory 2023-10-03T10:10:04.851 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/freezer 2023-10-03T10:10:04.851 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/cpuset 2023-10-03T10:10:04.851 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/devices 2023-10-03T10:10:04.851 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-03T10:10:04.851 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/hugetlb 2023-10-03T10:10:04.851 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/cgroup/perf_event 2023-10-03T10:10:04.851 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/tracing 2023-10-03T10:10:04.851 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/config 2023-10-03T10:10:04.851 INFO:teuthology.orchestra.run.smithi119.stdout:/ 2023-10-03T10:10:04.851 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/selinux 2023-10-03T10:10:04.851 INFO:teuthology.orchestra.run.smithi119.stdout:/proc/sys/fs/binfmt_misc 2023-10-03T10:10:04.852 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/mqueue 2023-10-03T10:10:04.852 INFO:teuthology.orchestra.run.smithi119.stdout:/dev/hugepages 2023-10-03T10:10:04.852 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/kernel/debug 2023-10-03T10:10:04.852 INFO:teuthology.orchestra.run.smithi119.stdout:/sys/fs/fuse/connections 2023-10-03T10:10:04.852 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/nfs/rpc_pipefs 2023-10-03T10:10:04.852 INFO:teuthology.orchestra.run.smithi119.stdout:/run/user/1000 2023-10-03T10:10:04.852 INFO:teuthology.orchestra.run.smithi119.stdout:/var/lib/ceph 2023-10-03T10:10:04.852 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns 2023-10-03T10:10:04.852 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:10:04.852 INFO:teuthology.orchestra.run.smithi119.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:10:04.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:04.853 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-10-03T10:10:04.865 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:2023-10-03T10:10:04.864+0000 7f3740c103c0 -1 init, newargv = 0x556c17ee9430 newargc=15 2023-10-03T10:10:04.865 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[112299]: starting ceph client 2023-10-03T10:10:04.870 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[112299]: starting fuse 2023-10-03T10:10:04.883 INFO:teuthology.orchestra.run.smithi119.stdout:46 2023-10-03T10:10:04.883 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-03T10:10:04.883 DEBUG:teuthology.orchestra.run.smithi119:> sudo stdin-killer -- python3 -c ' 2023-10-03T10:10:04.883 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2023-10-03T10:10:04.883 DEBUG:teuthology.orchestra.run.smithi119:> import re 2023-10-03T10:10:04.883 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-10-03T10:10:04.883 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2023-10-03T10:10:04.883 DEBUG:teuthology.orchestra.run.smithi119:> 2023-10-03T10:10:04.883 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2023-10-03T10:10:04.883 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-03T10:10:04.884 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2023-10-03T10:10:04.884 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-03T10:10:04.884 DEBUG:teuthology.orchestra.run.smithi119:> 2023-10-03T10:10:04.884 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2023-10-03T10:10:04.884 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2023-10-03T10:10:04.884 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2023-10-03T10:10:04.884 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2023-10-03T10:10:04.884 DEBUG:teuthology.orchestra.run.smithi119:> 2023-10-03T10:10:04.884 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2023-10-03T10:10:04.884 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T10:10:04.884 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T10:10:04.884 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T10:10:04.884 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2023-10-03T10:10:04.885 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2023-10-03T10:10:04.885 DEBUG:teuthology.orchestra.run.smithi119:> return f 2023-10-03T10:10:04.885 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T10:10:04.885 DEBUG:teuthology.orchestra.run.smithi119:> 2023-10-03T10:10:04.885 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.0")) 2023-10-03T10:10:04.885 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-10-03T10:10:05.006 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.0.112299.asok 2023-10-03T10:10:05.009 INFO:teuthology.orchestra.run.smithi119.stderr:2023-10-03T10:10:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-03T10:10:05.016 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.112299.asok 2023-10-03T10:10:05.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:05.016 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.112299.asok status 2023-10-03T10:10:05.168 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-10-03T10:10:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2023-10-03T10:10:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "eeb13ac974775bd0cce96a2c687e8bcc2faca43d", 2023-10-03T10:10:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 16.2.14-44-geeb13ac9 (eeb13ac974775bd0cce96a2c687e8bcc2faca43d) pacific (stable)", 2023-10-03T10:10:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "0", 2023-10-03T10:10:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2023-10-03T10:10:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-03T10:10:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "112299", 2023-10-03T10:10:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2023-10-03T10:10:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-10-03T10:10:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2023-10-03T10:10:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2023-10-03T10:10:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4632, 2023-10-03T10:10:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2023-10-03T10:10:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2023-10-03T10:10:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2023-10-03T10:10:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 4632 2023-10-03T10:10:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-10-03T10:10:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-10-03T10:10:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-10-03T10:10:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2023-10-03T10:10:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 898818226 2023-10-03T10:10:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-10-03T10:10:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-10-03T10:10:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-10-03T10:10:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-10-03T10:10:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "172.21.15.119:0", 2023-10-03T10:10:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 898818226 2023-10-03T10:10:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-10-03T10:10:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.4632 172.21.15.119:0/898818226", 2023-10-03T10:10:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "172.21.15.119:0/898818226", 2023-10-03T10:10:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2023-10-03T10:10:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 5, 2023-10-03T10:10:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 18, 2023-10-03T10:10:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2023-10-03T10:10:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2023-10-03T10:10:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2023-10-03T10:10:05.172 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-10-03T10:10:05.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:05.177 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2023-10-03T10:10:05.178 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:05.196 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2023-10-03T10:10:05.196 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:05.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:10:05.197 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-03T10:10:05.265 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2023-10-03T10:10:05.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:05.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.406+0000 7f527fc2f700 1 Processor -- start 2023-10-03T10:10:05.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.406+0000 7f527fc2f700 1 -- start start 2023-10-03T10:10:05.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527fc2f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5278059070 0x7f5278127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527fc2f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5278127d80 0x7f5278095a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527fc2f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5278096900 con 0x7f5278127390 2023-10-03T10:10:05.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527fc2f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5278059c00 con 0x7f5278059070 2023-10-03T10:10:05.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527fc2f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5278091b60 con 0x7f5278127d80 2023-10-03T10:10:05.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527d9cb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5278059070 0x7f5278127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527e1cc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5278127d80 0x7f5278095a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527d9cb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5278059070 0x7f5278127890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32804/0 (socket says 172.21.15.72:32804) 2023-10-03T10:10:05.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527d1ca700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5278127390 0x7f5278095370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48260/0 (socket says 172.21.15.72:48260) 2023-10-03T10:10:05.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527e1cc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5278127d80 0x7f5278095a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51628/0 (socket says 172.21.15.72:51628) 2023-10-03T10:10:05.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527d9cb700 1 -- 172.21.15.72:0/1865043725 learned_addr learned my addr 172.21.15.72:0/1865043725 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:05.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527e1cc700 1 -- 172.21.15.72:0/1865043725 >> v2:172.21.15.72:3300/0 conn(0x7f5278059070 msgr2=0x7f5278127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:05.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527e1cc700 1 --2- 172.21.15.72:0/1865043725 >> v2:172.21.15.72:3300/0 conn(0x7f5278059070 0x7f5278127890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527e1cc700 1 -- 172.21.15.72:0/1865043725 >> v1:172.21.15.72:6789/0 conn(0x7f5278127390 legacy=0x7f5278095370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527e1cc700 1 -- 172.21.15.72:0/1865043725 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5278092a10 con 0x7f5278127d80 2023-10-03T10:10:05.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527d9cb700 1 --2- 172.21.15.72:0/1865043725 >> v2:172.21.15.72:3300/0 conn(0x7f5278059070 0x7f5278127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:05.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.407+0000 7f527c9c9700 1 -- 172.21.15.72:0/1865043725 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549022269 0 0) 0x7f5278096900 con 0x7f5278127390 2023-10-03T10:10:05.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.408+0000 7f527e1cc700 1 --2- 172.21.15.72:0/1865043725 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5278127d80 0x7f5278095a80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5270009e60 tx=0x7f5270009780).ready entity=mon.1 client_cookie=a7aa73b6b07e8f6d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:05.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.408+0000 7f527c9c9700 1 -- 172.21.15.72:0/1865043725 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527000e070 con 0x7f5278127d80 2023-10-03T10:10:05.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.408+0000 7f527c9c9700 1 -- 172.21.15.72:0/1865043725 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527000bb60 con 0x7f5278127d80 2023-10-03T10:10:05.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.408+0000 7f527c9c9700 1 -- 172.21.15.72:0/1865043725 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5270012410 con 0x7f5278127d80 2023-10-03T10:10:05.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.408+0000 7f527fc2f700 1 -- 172.21.15.72:0/1865043725 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5278127d80 msgr2=0x7f5278095a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.408+0000 7f527fc2f700 1 --2- 172.21.15.72:0/1865043725 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5278127d80 0x7f5278095a80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5270009e60 tx=0x7f5270009780).stop 2023-10-03T10:10:05.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.408+0000 7f527fc2f700 1 -- 172.21.15.72:0/1865043725 shutdown_connections 2023-10-03T10:10:05.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.408+0000 7f527fc2f700 1 --2- 172.21.15.72:0/1865043725 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5278127d80 0x7f5278095a80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.408+0000 7f527fc2f700 1 --2- 172.21.15.72:0/1865043725 >> v2:172.21.15.72:3300/0 conn(0x7f5278059070 0x7f5278127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.408+0000 7f527fc2f700 1 -- 172.21.15.72:0/1865043725 >> 172.21.15.72:0/1865043725 conn(0x7f5278097470 msgr2=0x7f5278097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:05.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.408+0000 7f527fc2f700 1 -- 172.21.15.72:0/1865043725 shutdown_connections 2023-10-03T10:10:05.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.408+0000 7f527fc2f700 1 -- 172.21.15.72:0/1865043725 wait complete. 2023-10-03T10:10:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.409+0000 7f527fc2f700 1 Processor -- start 2023-10-03T10:10:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.409+0000 7f527fc2f700 1 -- start start 2023-10-03T10:10:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527fc2f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5278059070 0x7f5278113e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527fc2f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5278127390 0x7f5278114340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527fc2f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5278127d80 0x7f5278139da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527fc2f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5278096f00 con 0x7f5278059070 2023-10-03T10:10:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527fc2f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5278116be0 con 0x7f5278127390 2023-10-03T10:10:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527fc2f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5278116ea0 con 0x7f5278127d80 2023-10-03T10:10:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527d1ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5278127390 0x7f5278114340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527e1cc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5278127d80 0x7f5278139da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527d1ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5278127390 0x7f5278114340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51640/0 (socket says 172.21.15.72:51640) 2023-10-03T10:10:05.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527d1ca700 1 -- 172.21.15.72:0/339249675 learned_addr learned my addr 172.21.15.72:0/339249675 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:05.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527d9cb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5278059070 0x7f5278113e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527d1ca700 1 -- 172.21.15.72:0/339249675 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5278127d80 msgr2=0x7f5278139da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527d1ca700 1 --2- 172.21.15.72:0/339249675 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5278127d80 0x7f5278139da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527d1ca700 1 -- 172.21.15.72:0/339249675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5278059070 msgr2=0x7f5278113e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527d1ca700 1 --2- 172.21.15.72:0/339249675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5278059070 0x7f5278113e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527d1ca700 1 -- 172.21.15.72:0/339249675 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5268009370 con 0x7f5278127390 2023-10-03T10:10:05.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527d9cb700 1 --2- 172.21.15.72:0/339249675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5278059070 0x7f5278113e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:05.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527d1ca700 1 --2- 172.21.15.72:0/339249675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5278127390 0x7f5278114340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f527400c4c0 tx=0x7f5274007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:05.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f526dffb700 1 -- 172.21.15.72:0/339249675 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527400ce30 con 0x7f5278127390 2023-10-03T10:10:05.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f526dffb700 1 -- 172.21.15.72:0/339249675 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52740072e0 con 0x7f5278127390 2023-10-03T10:10:05.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f526dffb700 1 -- 172.21.15.72:0/339249675 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52740056e0 con 0x7f5278127390 2023-10-03T10:10:05.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.410+0000 7f527fc2f700 1 -- 172.21.15.72:0/339249675 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5270009a20 con 0x7f5278127390 2023-10-03T10:10:05.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.411+0000 7f527fc2f700 1 -- 172.21.15.72:0/339249675 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5278117840 con 0x7f5278127390 2023-10-03T10:10:05.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.411+0000 7f526dffb700 1 -- 172.21.15.72:0/339249675 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5274005a90 con 0x7f5278127390 2023-10-03T10:10:05.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.411+0000 7f526dffb700 1 -- 172.21.15.72:0/339249675 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f527403a5e0 con 0x7f5278127390 2023-10-03T10:10:05.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.412+0000 7f527fc2f700 1 -- 172.21.15.72:0/339249675 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527805a260 con 0x7f5278127390 2023-10-03T10:10:05.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.416+0000 7f526dffb700 1 -- 172.21.15.72:0/339249675 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5274013450 con 0x7f5278127390 2023-10-03T10:10:05.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.576+0000 7f527fc2f700 1 -- 172.21.15.72:0/339249675 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5278046c20 con 0x7f5278127390 2023-10-03T10:10:05.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.577+0000 7f526dffb700 1 -- 172.21.15.72:0/339249675 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11340 (secure 0 0 0) 0x7f5274010af0 con 0x7f5278127390 2023-10-03T10:10:05.655 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:10:05.655 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":18,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:10:02.945442+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:05.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.579+0000 7f527fc2f700 1 -- 172.21.15.72:0/339249675 >> v1:172.21.15.72:6816/118184 conn(0x7f525c02bb60 legacy=0x7f525c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.579+0000 7f527fc2f700 1 -- 172.21.15.72:0/339249675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5278127390 msgr2=0x7f5278114340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.579+0000 7f527fc2f700 1 --2- 172.21.15.72:0/339249675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5278127390 0x7f5278114340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f527400c4c0 tx=0x7f5274007c10).stop 2023-10-03T10:10:05.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.579+0000 7f527fc2f700 1 -- 172.21.15.72:0/339249675 shutdown_connections 2023-10-03T10:10:05.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.579+0000 7f527fc2f700 1 --2- 172.21.15.72:0/339249675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5278059070 0x7f5278113e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.579+0000 7f527fc2f700 1 --2- 172.21.15.72:0/339249675 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5278127d80 0x7f5278139da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.579+0000 7f527fc2f700 1 --2- 172.21.15.72:0/339249675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5278127390 0x7f5278114340 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.579+0000 7f527fc2f700 1 -- 172.21.15.72:0/339249675 >> 172.21.15.72:0/339249675 conn(0x7f5278097470 msgr2=0x7f527812a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:05.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.579+0000 7f527fc2f700 1 -- 172.21.15.72:0/339249675 shutdown_connections 2023-10-03T10:10:05.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.579+0000 7f527fc2f700 1 -- 172.21.15.72:0/339249675 wait complete. 2023-10-03T10:10:05.658 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:09:38.963446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:40.092839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:44.713857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:45.314387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-03T10:10:05.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:10:05.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.777+0000 7f8a26b16700 1 Processor -- start 2023-10-03T10:10:05.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.777+0000 7f8a26b16700 1 -- start start 2023-10-03T10:10:05.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a26b16700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a20066110 0x7f8a20097420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a26b16700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2012fd70 0x7f8a20132160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a26b16700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a20064e00 con 0x7f8a2012add0 2023-10-03T10:10:05.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a26b16700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a200664f0 con 0x7f8a20066110 2023-10-03T10:10:05.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a26b16700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a20065d80 con 0x7f8a2012fd70 2023-10-03T10:10:05.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a248b2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a20066110 0x7f8a20097420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a250b3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2012fd70 0x7f8a20132160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a1ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8a2012add0 0x7f8a2012b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48264/0 (socket says 172.21.15.72:48264) 2023-10-03T10:10:05.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a248b2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a20066110 0x7f8a20097420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32816/0 (socket says 172.21.15.72:32816) 2023-10-03T10:10:05.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a250b3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2012fd70 0x7f8a20132160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51642/0 (socket says 172.21.15.72:51642) 2023-10-03T10:10:05.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a1ffff700 1 -- 172.21.15.72:0/3118505635 learned_addr learned my addr 172.21.15.72:0/3118505635 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:10:05.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a248b2700 1 -- 172.21.15.72:0/3118505635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2012fd70 msgr2=0x7f8a20132160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:05.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a248b2700 1 --2- 172.21.15.72:0/3118505635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2012fd70 0x7f8a20132160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a248b2700 1 -- 172.21.15.72:0/3118505635 >> v1:172.21.15.72:6789/0 conn(0x7f8a2012add0 legacy=0x7f8a2012b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a1f7fe700 1 -- 172.21.15.72:0/3118505635 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725074984 0 0) 0x7f8a20064e00 con 0x7f8a2012add0 2023-10-03T10:10:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a248b2700 1 -- 172.21.15.72:0/3118505635 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a20065910 con 0x7f8a20066110 2023-10-03T10:10:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a250b3700 1 --2- 172.21.15.72:0/3118505635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2012fd70 0x7f8a20132160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a248b2700 1 --2- 172.21.15.72:0/3118505635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a20066110 0x7f8a20097420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f8a14009760 tx=0x7f8a14009060).ready entity=mon.0 client_cookie=ec7d077556f90d2e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a1f7fe700 1 -- 172.21.15.72:0/3118505635 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a140090d0 con 0x7f8a20066110 2023-10-03T10:10:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a1f7fe700 1 -- 172.21.15.72:0/3118505635 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1400f510 con 0x7f8a20066110 2023-10-03T10:10:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.778+0000 7f8a1f7fe700 1 -- 172.21.15.72:0/3118505635 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1400f890 con 0x7f8a20066110 2023-10-03T10:10:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.779+0000 7f8a26b16700 1 -- 172.21.15.72:0/3118505635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a20066110 msgr2=0x7f8a20097420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.779+0000 7f8a26b16700 1 --2- 172.21.15.72:0/3118505635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a20066110 0x7f8a20097420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f8a14009760 tx=0x7f8a14009060).stop 2023-10-03T10:10:05.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.779+0000 7f8a26b16700 1 -- 172.21.15.72:0/3118505635 shutdown_connections 2023-10-03T10:10:05.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.779+0000 7f8a26b16700 1 --2- 172.21.15.72:0/3118505635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2012fd70 0x7f8a20132160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.779+0000 7f8a26b16700 1 --2- 172.21.15.72:0/3118505635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a20066110 0x7f8a20097420 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.779+0000 7f8a26b16700 1 -- 172.21.15.72:0/3118505635 >> 172.21.15.72:0/3118505635 conn(0x7f8a2009ba60 msgr2=0x7f8a2009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:05.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.779+0000 7f8a26b16700 1 -- 172.21.15.72:0/3118505635 shutdown_connections 2023-10-03T10:10:05.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.779+0000 7f8a26b16700 1 -- 172.21.15.72:0/3118505635 wait complete. 2023-10-03T10:10:05.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.780+0000 7f8a26b16700 1 Processor -- start 2023-10-03T10:10:05.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.780+0000 7f8a26b16700 1 -- start start 2023-10-03T10:10:05.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.780+0000 7f8a26b16700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a20066110 0x7f8a2012bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.780+0000 7f8a26b16700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a2012add0 0x7f8a2012c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.780+0000 7f8a26b16700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2012fd70 0x7f8a2012c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:05.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.780+0000 7f8a26b16700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a20129d30 con 0x7f8a20066110 2023-10-03T10:10:05.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.780+0000 7f8a26b16700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2012ca10 con 0x7f8a2012fd70 2023-10-03T10:10:05.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.780+0000 7f8a26b16700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2012d180 con 0x7f8a2012add0 2023-10-03T10:10:05.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.780+0000 7f8a248b2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a20066110 0x7f8a2012bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.780+0000 7f8a250b3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2012fd70 0x7f8a2012c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.780+0000 7f8a248b2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a20066110 0x7f8a2012bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32828/0 (socket says 172.21.15.72:32828) 2023-10-03T10:10:05.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.780+0000 7f8a248b2700 1 -- 172.21.15.72:0/3939313342 learned_addr learned my addr 172.21.15.72:0/3939313342 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:05.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.780+0000 7f8a1ffff700 1 --2- 172.21.15.72:0/3939313342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a2012add0 0x7f8a2012c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:05.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.781+0000 7f8a250b3700 1 -- 172.21.15.72:0/3939313342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a2012add0 msgr2=0x7f8a2012c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.781+0000 7f8a250b3700 1 --2- 172.21.15.72:0/3939313342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a2012add0 0x7f8a2012c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.781+0000 7f8a250b3700 1 -- 172.21.15.72:0/3939313342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a20066110 msgr2=0x7f8a2012bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.781+0000 7f8a250b3700 1 --2- 172.21.15.72:0/3939313342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a20066110 0x7f8a2012bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.781+0000 7f8a250b3700 1 -- 172.21.15.72:0/3939313342 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a18009a20 con 0x7f8a2012fd70 2023-10-03T10:10:05.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.781+0000 7f8a248b2700 1 --2- 172.21.15.72:0/3939313342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a20066110 0x7f8a2012bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:05.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.781+0000 7f8a250b3700 1 --2- 172.21.15.72:0/3939313342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2012fd70 0x7f8a2012c520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8a18009f10 tx=0x7f8a1800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:05.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.781+0000 7f8a1cff9700 1 -- 172.21.15.72:0/3939313342 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18009c70 con 0x7f8a2012fd70 2023-10-03T10:10:05.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.781+0000 7f8a1cff9700 1 -- 172.21.15.72:0/3939313342 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1800f040 con 0x7f8a2012fd70 2023-10-03T10:10:05.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.781+0000 7f8a26b16700 1 -- 172.21.15.72:0/3939313342 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a140092a0 con 0x7f8a2012fd70 2023-10-03T10:10:05.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.781+0000 7f8a1cff9700 1 -- 172.21.15.72:0/3939313342 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1800ce30 con 0x7f8a2012fd70 2023-10-03T10:10:05.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.781+0000 7f8a26b16700 1 -- 172.21.15.72:0/3939313342 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2012e550 con 0x7f8a2012fd70 2023-10-03T10:10:05.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.782+0000 7f8a1cff9700 1 -- 172.21.15.72:0/3939313342 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8a18013610 con 0x7f8a2012fd70 2023-10-03T10:10:05.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.782+0000 7f8a1cff9700 1 -- 172.21.15.72:0/3939313342 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8a1803baa0 con 0x7f8a2012fd70 2023-10-03T10:10:05.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.782+0000 7f8a26b16700 1 -- 172.21.15.72:0/3939313342 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2005a260 con 0x7f8a2012fd70 2023-10-03T10:10:05.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.787+0000 7f8a1cff9700 1 -- 172.21.15.72:0/3939313342 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8a180138c0 con 0x7f8a2012fd70 2023-10-03T10:10:05.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.945+0000 7f8a26b16700 1 -- 172.21.15.72:0/3939313342 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8a20046c20 con 0x7f8a2012fd70 2023-10-03T10:10:05.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.945+0000 7f8a1cff9700 1 -- 172.21.15.72:0/3939313342 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8a1802c0b0 con 0x7f8a2012fd70 2023-10-03T10:10:05.945 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-03T10:10:05.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.947+0000 7f8a26b16700 1 -- 172.21.15.72:0/3939313342 >> v1:172.21.15.72:6816/118184 conn(0x7f8a0402bb60 legacy=0x7f8a0402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.947+0000 7f8a26b16700 1 -- 172.21.15.72:0/3939313342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2012fd70 msgr2=0x7f8a2012c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:05.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.947+0000 7f8a26b16700 1 --2- 172.21.15.72:0/3939313342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2012fd70 0x7f8a2012c520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8a18009f10 tx=0x7f8a1800b040).stop 2023-10-03T10:10:05.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.947+0000 7f8a26b16700 1 -- 172.21.15.72:0/3939313342 shutdown_connections 2023-10-03T10:10:05.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.947+0000 7f8a26b16700 1 --2- 172.21.15.72:0/3939313342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a20066110 0x7f8a2012bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.947+0000 7f8a26b16700 1 --2- 172.21.15.72:0/3939313342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2012fd70 0x7f8a2012c520 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.947+0000 7f8a26b16700 1 --2- 172.21.15.72:0/3939313342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a2012add0 0x7f8a2012c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:05.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.947+0000 7f8a26b16700 1 -- 172.21.15.72:0/3939313342 >> 172.21.15.72:0/3939313342 conn(0x7f8a2009ba60 msgr2=0x7f8a201286d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:05.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.947+0000 7f8a26b16700 1 -- 172.21.15.72:0/3939313342 shutdown_connections 2023-10-03T10:10:05.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:05.947+0000 7f8a26b16700 1 -- 172.21.15.72:0/3939313342 wait complete. 2023-10-03T10:10:05.958 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:10:06.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.077+0000 7f79950d9700 1 Processor -- start 2023-10-03T10:10:06.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.077+0000 7f79950d9700 1 -- start start 2023-10-03T10:10:06.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f79950d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7990098ea0 0x7f7990099280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f79950d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f799012d160 0x7f799012f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f79950d9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7990092d80 con 0x7f7990093840 2023-10-03T10:10:06.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f79950d9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7990093c20 con 0x7f7990098ea0 2023-10-03T10:10:06.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f79950d9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7990092b90 con 0x7f799012d160 2023-10-03T10:10:06.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f798e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7990098ea0 0x7f7990099280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f798f59e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f799012d160 0x7f799012f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f798ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7990093840 0x7f7990098790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48278/0 (socket says 172.21.15.72:48278) 2023-10-03T10:10:06.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f798ed9d700 1 -- 172.21.15.72:0/830120580 learned_addr learned my addr 172.21.15.72:0/830120580 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:10:06.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f798e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7990098ea0 0x7f7990099280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51662/0 (socket says 172.21.15.72:51662) 2023-10-03T10:10:06.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f798e59c700 1 -- 172.21.15.72:0/830120580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f799012d160 msgr2=0x7f799012f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:06.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f798e59c700 1 --2- 172.21.15.72:0/830120580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f799012d160 0x7f799012f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f798dd9b700 1 -- 172.21.15.72:0/830120580 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579760466 0 0) 0x7f7990092d80 con 0x7f7990093840 2023-10-03T10:10:06.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f798e59c700 1 -- 172.21.15.72:0/830120580 >> v1:172.21.15.72:6789/0 conn(0x7f7990093840 legacy=0x7f7990098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f798e59c700 1 -- 172.21.15.72:0/830120580 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7990099b70 con 0x7f7990098ea0 2023-10-03T10:10:06.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f798f59e700 1 --2- 172.21.15.72:0/830120580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f799012d160 0x7f799012f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f798e59c700 1 --2- 172.21.15.72:0/830120580 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7990098ea0 0x7f7990099280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f798400ba30 tx=0x7f798400b300).ready entity=mon.1 client_cookie=a72fb798bec0d443 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f798dd9b700 1 -- 172.21.15.72:0/830120580 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400da70 con 0x7f7990098ea0 2023-10-03T10:10:06.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f798dd9b700 1 -- 172.21.15.72:0/830120580 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798400dbd0 con 0x7f7990098ea0 2023-10-03T10:10:06.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.078+0000 7f798dd9b700 1 -- 172.21.15.72:0/830120580 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984010470 con 0x7f7990098ea0 2023-10-03T10:10:06.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.079+0000 7f79950d9700 1 -- 172.21.15.72:0/830120580 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7990098ea0 msgr2=0x7f7990099280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.079+0000 7f79950d9700 1 --2- 172.21.15.72:0/830120580 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7990098ea0 0x7f7990099280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f798400ba30 tx=0x7f798400b300).stop 2023-10-03T10:10:06.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.079+0000 7f79950d9700 1 -- 172.21.15.72:0/830120580 shutdown_connections 2023-10-03T10:10:06.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.079+0000 7f79950d9700 1 --2- 172.21.15.72:0/830120580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f799012d160 0x7f799012f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.079+0000 7f79950d9700 1 --2- 172.21.15.72:0/830120580 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7990098ea0 0x7f7990099280 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.079+0000 7f79950d9700 1 -- 172.21.15.72:0/830120580 >> 172.21.15.72:0/830120580 conn(0x7f7990097480 msgr2=0x7f7990097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.079+0000 7f79950d9700 1 -- 172.21.15.72:0/830120580 shutdown_connections 2023-10-03T10:10:06.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.079+0000 7f79950d9700 1 -- 172.21.15.72:0/830120580 wait complete. 2023-10-03T10:10:06.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.080+0000 7f79950d9700 1 Processor -- start 2023-10-03T10:10:06.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.080+0000 7f79950d9700 1 -- start start 2023-10-03T10:10:06.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f79950d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7990093840 0x7f7990119c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f79950d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7990098ea0 0x7f7990115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f79950d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f799012d160 0x7f7990116110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f79950d9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799012cda0 con 0x7f799012d160 2023-10-03T10:10:06.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f79950d9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799006a520 con 0x7f7990093840 2023-10-03T10:10:06.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f79950d9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7990119710 con 0x7f7990098ea0 2023-10-03T10:10:06.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f798f59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f799012d160 0x7f7990116110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f798e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7990098ea0 0x7f7990115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f798e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7990098ea0 0x7f7990115c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59706/0 (socket says 172.21.15.72:59706) 2023-10-03T10:10:06.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f798ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7990093840 0x7f7990119c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f798e59c700 1 -- 172.21.15.72:0/3818217176 learned_addr learned my addr 172.21.15.72:0/3818217176 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:06.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f798f59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f799012d160 0x7f7990116110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32830/0 (socket says 172.21.15.72:32830) 2023-10-03T10:10:06.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f798ed9d700 1 -- 172.21.15.72:0/3818217176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7990098ea0 msgr2=0x7f7990115c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f798ed9d700 1 --2- 172.21.15.72:0/3818217176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7990098ea0 0x7f7990115c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f798ed9d700 1 -- 172.21.15.72:0/3818217176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f799012d160 msgr2=0x7f7990116110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f798ed9d700 1 --2- 172.21.15.72:0/3818217176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f799012d160 0x7f7990116110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f798ed9d700 1 -- 172.21.15.72:0/3818217176 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7988009a20 con 0x7f7990093840 2023-10-03T10:10:06.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f798e59c700 1 --2- 172.21.15.72:0/3818217176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7990098ea0 0x7f7990115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f798f59e700 1 --2- 172.21.15.72:0/3818217176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f799012d160 0x7f7990116110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f798ed9d700 1 --2- 172.21.15.72:0/3818217176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7990093840 0x7f7990119c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f7980001eb0 tx=0x7f7980007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.081+0000 7f7976ffd700 1 -- 172.21.15.72:0/3818217176 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79800070d0 con 0x7f7990093840 2023-10-03T10:10:06.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.082+0000 7f7976ffd700 1 -- 172.21.15.72:0/3818217176 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7980007250 con 0x7f7990093840 2023-10-03T10:10:06.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.082+0000 7f7976ffd700 1 -- 172.21.15.72:0/3818217176 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7980007610 con 0x7f7990093840 2023-10-03T10:10:06.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.082+0000 7f79950d9700 1 -- 172.21.15.72:0/3818217176 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798400b540 con 0x7f7990093840 2023-10-03T10:10:06.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.082+0000 7f79950d9700 1 -- 172.21.15.72:0/3818217176 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7990117800 con 0x7f7990093840 2023-10-03T10:10:06.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.082+0000 7f7976ffd700 1 -- 172.21.15.72:0/3818217176 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f79800059b0 con 0x7f7990093840 2023-10-03T10:10:06.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.082+0000 7f7976ffd700 1 -- 172.21.15.72:0/3818217176 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f798003a5a0 con 0x7f7990093840 2023-10-03T10:10:06.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.083+0000 7f79950d9700 1 -- 172.21.15.72:0/3818217176 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79901170b0 con 0x7f7990093840 2023-10-03T10:10:06.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.087+0000 7f7976ffd700 1 -- 172.21.15.72:0/3818217176 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7980013970 con 0x7f7990093840 2023-10-03T10:10:06.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.242+0000 7f79950d9700 1 -- 172.21.15.72:0/3818217176 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7990117990 con 0x7f7990093840 2023-10-03T10:10:06.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.243+0000 7f7976ffd700 1 -- 172.21.15.72:0/3818217176 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7980010910 con 0x7f7990093840 2023-10-03T10:10:06.242 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-10-03T10:10:06.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.245+0000 7f79950d9700 1 -- 172.21.15.72:0/3818217176 >> v1:172.21.15.72:6816/118184 conn(0x7f797c02bb60 legacy=0x7f797c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.245+0000 7f79950d9700 1 -- 172.21.15.72:0/3818217176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7990093840 msgr2=0x7f7990119c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.245+0000 7f79950d9700 1 --2- 172.21.15.72:0/3818217176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7990093840 0x7f7990119c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f7980001eb0 tx=0x7f7980007b90).stop 2023-10-03T10:10:06.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.245+0000 7f79950d9700 1 -- 172.21.15.72:0/3818217176 shutdown_connections 2023-10-03T10:10:06.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.245+0000 7f79950d9700 1 --2- 172.21.15.72:0/3818217176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f799012d160 0x7f7990116110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.245+0000 7f79950d9700 1 --2- 172.21.15.72:0/3818217176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7990093840 0x7f7990119c10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.245+0000 7f79950d9700 1 --2- 172.21.15.72:0/3818217176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7990098ea0 0x7f7990115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.245+0000 7f79950d9700 1 -- 172.21.15.72:0/3818217176 >> 172.21.15.72:0/3818217176 conn(0x7f7990097480 msgr2=0x7f7990068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.245+0000 7f79950d9700 1 -- 172.21.15.72:0/3818217176 shutdown_connections 2023-10-03T10:10:06.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.245+0000 7f79950d9700 1 -- 172.21.15.72:0/3818217176 wait complete. 2023-10-03T10:10:06.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:10:06.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.374+0000 7f2478a78700 1 Processor -- start 2023-10-03T10:10:06.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.374+0000 7f2478a78700 1 -- start start 2023-10-03T10:10:06.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2478a78700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24740694d0 0x7f2474096410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2478a78700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2474096900 0x7f2474096d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2478a78700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f247412d230 0x7f247412f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2478a78700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2474095e60 con 0x7f24740694d0 2023-10-03T10:10:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2478a78700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2474068d40 con 0x7f2474096900 2023-10-03T10:10:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2478a78700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2474068fb0 con 0x7f247412d230 2023-10-03T10:10:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f247259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24740694d0 0x7f2474096410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2472d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f247412d230 0x7f247412f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2471d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2474096900 0x7f2474096d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2472d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f247412d230 0x7f247412f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59708/0 (socket says 172.21.15.72:59708) 2023-10-03T10:10:06.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f247259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24740694d0 0x7f2474096410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32842/0 (socket says 172.21.15.72:32842) 2023-10-03T10:10:06.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2472d9d700 1 -- 172.21.15.72:0/1696261649 learned_addr learned my addr 172.21.15.72:0/1696261649 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:06.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2472d9d700 1 -- 172.21.15.72:0/1696261649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2474096900 msgr2=0x7f2474096d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:06.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2472d9d700 1 --2- 172.21.15.72:0/1696261649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2474096900 0x7f2474096d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2472d9d700 1 -- 172.21.15.72:0/1696261649 >> v2:172.21.15.72:3300/0 conn(0x7f24740694d0 msgr2=0x7f2474096410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:06.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2472d9d700 1 --2- 172.21.15.72:0/1696261649 >> v2:172.21.15.72:3300/0 conn(0x7f24740694d0 0x7f2474096410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2472d9d700 1 -- 172.21.15.72:0/1696261649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2474068a10 con 0x7f247412d230 2023-10-03T10:10:06.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2471d9b700 1 --2- 172.21.15.72:0/1696261649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2474096900 0x7f2474096d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f247259c700 1 --2- 172.21.15.72:0/1696261649 >> v2:172.21.15.72:3300/0 conn(0x7f24740694d0 0x7f2474096410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.375+0000 7f2472d9d700 1 --2- 172.21.15.72:0/1696261649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f247412d230 0x7f247412f620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f246c009f20 tx=0x7f246c009840).ready entity=mon.2 client_cookie=adabd92c23d10a0d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.376+0000 7f247159a700 1 -- 172.21.15.72:0/1696261649 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c00e070 con 0x7f247412d230 2023-10-03T10:10:06.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.376+0000 7f247159a700 1 -- 172.21.15.72:0/1696261649 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246c00b970 con 0x7f247412d230 2023-10-03T10:10:06.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.376+0000 7f247159a700 1 -- 172.21.15.72:0/1696261649 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c00bcf0 con 0x7f247412d230 2023-10-03T10:10:06.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.376+0000 7f2478a78700 1 -- 172.21.15.72:0/1696261649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f247412d230 msgr2=0x7f247412f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.376+0000 7f2478a78700 1 --2- 172.21.15.72:0/1696261649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f247412d230 0x7f247412f620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f246c009f20 tx=0x7f246c009840).stop 2023-10-03T10:10:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.376+0000 7f2478a78700 1 -- 172.21.15.72:0/1696261649 shutdown_connections 2023-10-03T10:10:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.376+0000 7f2478a78700 1 --2- 172.21.15.72:0/1696261649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f247412d230 0x7f247412f620 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.376+0000 7f2478a78700 1 --2- 172.21.15.72:0/1696261649 >> v2:172.21.15.72:3300/0 conn(0x7f24740694d0 0x7f2474096410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.376+0000 7f2478a78700 1 --2- 172.21.15.72:0/1696261649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2474096900 0x7f2474096d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.376+0000 7f2478a78700 1 -- 172.21.15.72:0/1696261649 >> 172.21.15.72:0/1696261649 conn(0x7f247409ba60 msgr2=0x7f247409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.376+0000 7f2478a78700 1 -- 172.21.15.72:0/1696261649 shutdown_connections 2023-10-03T10:10:06.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.376+0000 7f2478a78700 1 -- 172.21.15.72:0/1696261649 wait complete. 2023-10-03T10:10:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.377+0000 7f2478a78700 1 Processor -- start 2023-10-03T10:10:06.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.377+0000 7f2478a78700 1 -- start start 2023-10-03T10:10:06.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.377+0000 7f2478a78700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24740694d0 0x7f247412cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.377+0000 7f2478a78700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2474096900 0x7f2474117b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.377+0000 7f2478a78700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247412d230 0x7f2474118080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.377+0000 7f2478a78700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247411a290 con 0x7f247412d230 2023-10-03T10:10:06.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.377+0000 7f2478a78700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2474067d80 con 0x7f2474096900 2023-10-03T10:10:06.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.377+0000 7f2478a78700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f247411bc80 con 0x7f24740694d0 2023-10-03T10:10:06.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.377+0000 7f247259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24740694d0 0x7f247412cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f2471d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2474096900 0x7f2474117b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f247259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24740694d0 0x7f247412cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59710/0 (socket says 172.21.15.72:59710) 2023-10-03T10:10:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f247259c700 1 -- 172.21.15.72:0/1187359590 learned_addr learned my addr 172.21.15.72:0/1187359590 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f2472d9d700 1 --2- 172.21.15.72:0/1187359590 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247412d230 0x7f2474118080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f2472d9d700 1 -- 172.21.15.72:0/1187359590 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24740694d0 msgr2=0x7f247412cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f2472d9d700 1 --2- 172.21.15.72:0/1187359590 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24740694d0 0x7f247412cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f2472d9d700 1 -- 172.21.15.72:0/1187359590 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2474096900 msgr2=0x7f2474117b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f2472d9d700 1 --2- 172.21.15.72:0/1187359590 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2474096900 0x7f2474117b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f2472d9d700 1 -- 172.21.15.72:0/1187359590 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24680092a0 con 0x7f247412d230 2023-10-03T10:10:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f2471d9b700 1 --2- 172.21.15.72:0/1187359590 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2474096900 0x7f2474117b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f247259c700 1 --2- 172.21.15.72:0/1187359590 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24740694d0 0x7f247412cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f2472d9d700 1 --2- 172.21.15.72:0/1187359590 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247412d230 0x7f2474118080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f246c013000 tx=0x7f246c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f24627fc700 1 -- 172.21.15.72:0/1187359590 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c007170 con 0x7f247412d230 2023-10-03T10:10:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f24627fc700 1 -- 172.21.15.72:0/1187359590 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246c0092e0 con 0x7f247412d230 2023-10-03T10:10:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f2478a78700 1 -- 172.21.15.72:0/1187359590 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24640092a0 con 0x7f247412d230 2023-10-03T10:10:06.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f24627fc700 1 -- 172.21.15.72:0/1187359590 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246c007860 con 0x7f247412d230 2023-10-03T10:10:06.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.378+0000 7f2478a78700 1 -- 172.21.15.72:0/1187359590 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246c009ae0 con 0x7f247412d230 2023-10-03T10:10:06.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.379+0000 7f24627fc700 1 -- 172.21.15.72:0/1187359590 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f246c007c10 con 0x7f247412d230 2023-10-03T10:10:06.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.379+0000 7f24627fc700 1 -- 172.21.15.72:0/1187359590 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f246c03cce0 con 0x7f247412d230 2023-10-03T10:10:06.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.379+0000 7f2478a78700 1 -- 172.21.15.72:0/1187359590 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2474098df0 con 0x7f247412d230 2023-10-03T10:10:06.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.383+0000 7f24627fc700 1 -- 172.21.15.72:0/1187359590 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f246c024070 con 0x7f247412d230 2023-10-03T10:10:06.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.539+0000 7f2478a78700 1 -- 172.21.15.72:0/1187359590 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f247405a260 con 0x7f247412d230 2023-10-03T10:10:06.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.539+0000 7f24627fc700 1 -- 172.21.15.72:0/1187359590 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7f246c024030 con 0x7f247412d230 2023-10-03T10:10:06.539 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-03T10:10:06.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.541+0000 7f2478a78700 1 -- 172.21.15.72:0/1187359590 >> v1:172.21.15.72:6816/118184 conn(0x7f245402bb60 legacy=0x7f245402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.541+0000 7f2478a78700 1 -- 172.21.15.72:0/1187359590 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247412d230 msgr2=0x7f2474118080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.541+0000 7f2478a78700 1 --2- 172.21.15.72:0/1187359590 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247412d230 0x7f2474118080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f246c013000 tx=0x7f246c009840).stop 2023-10-03T10:10:06.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.541+0000 7f2478a78700 1 -- 172.21.15.72:0/1187359590 shutdown_connections 2023-10-03T10:10:06.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.541+0000 7f2478a78700 1 --2- 172.21.15.72:0/1187359590 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f247412d230 0x7f2474118080 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.541+0000 7f2478a78700 1 --2- 172.21.15.72:0/1187359590 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24740694d0 0x7f247412cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.541+0000 7f2478a78700 1 --2- 172.21.15.72:0/1187359590 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2474096900 0x7f2474117b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.541+0000 7f2478a78700 1 -- 172.21.15.72:0/1187359590 >> 172.21.15.72:0/1187359590 conn(0x7f247409ba60 msgr2=0x7f2474094900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.541+0000 7f2478a78700 1 -- 172.21.15.72:0/1187359590 shutdown_connections 2023-10-03T10:10:06.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.541+0000 7f2478a78700 1 -- 172.21.15.72:0/1187359590 wait complete. 2023-10-03T10:10:06.552 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:10:06.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.671+0000 7fb9897df700 1 Processor -- start 2023-10-03T10:10:06.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.671+0000 7fb9897df700 1 -- start start 2023-10-03T10:10:06.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9897df700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb9840653a0 0x7fb984098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9897df700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb984098b30 0x7fb984098f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9897df700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb98412f430 0x7fb984131820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9897df700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb984065e80 con 0x7fb9840653a0 2023-10-03T10:10:06.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9897df700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9840663b0 con 0x7fb98412f430 2023-10-03T10:10:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9897df700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb984065780 con 0x7fb984098b30 2023-10-03T10:10:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9827fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb984098b30 0x7fb984098f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9837fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb98412f430 0x7fb984131820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9837fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb98412f430 0x7fb984131820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51686/0 (socket says 172.21.15.72:51686) 2023-10-03T10:10:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9827fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb984098b30 0x7fb984098f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59724/0 (socket says 172.21.15.72:59724) 2023-10-03T10:10:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb982ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb9840653a0 0x7fb984098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9837fe700 1 -- 172.21.15.72:0/1396585095 learned_addr learned my addr 172.21.15.72:0/1396585095 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9837fe700 1 -- 172.21.15.72:0/1396585095 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb984098b30 msgr2=0x7fb984098f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9837fe700 1 --2- 172.21.15.72:0/1396585095 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb984098b30 0x7fb984098f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9837fe700 1 -- 172.21.15.72:0/1396585095 >> v2:172.21.15.72:3300/0 conn(0x7fb9840653a0 msgr2=0x7fb984098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9837fe700 1 --2- 172.21.15.72:0/1396585095 >> v2:172.21.15.72:3300/0 conn(0x7fb9840653a0 0x7fb984098640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9837fe700 1 -- 172.21.15.72:0/1396585095 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb984096180 con 0x7fb98412f430 2023-10-03T10:10:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb982ffd700 1 --2- 172.21.15.72:0/1396585095 >> v2:172.21.15.72:3300/0 conn(0x7fb9840653a0 0x7fb984098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.672+0000 7fb9837fe700 1 --2- 172.21.15.72:0/1396585095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb98412f430 0x7fb984131820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb97c009f50 tx=0x7fb97c009840).ready entity=mon.1 client_cookie=f4d6f70b4692191b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.673+0000 7fb981ffb700 1 -- 172.21.15.72:0/1396585095 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c00e070 con 0x7fb98412f430 2023-10-03T10:10:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.673+0000 7fb981ffb700 1 -- 172.21.15.72:0/1396585095 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97c00b910 con 0x7fb98412f430 2023-10-03T10:10:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.673+0000 7fb981ffb700 1 -- 172.21.15.72:0/1396585095 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c00bc90 con 0x7fb98412f430 2023-10-03T10:10:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.673+0000 7fb9897df700 1 -- 172.21.15.72:0/1396585095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb98412f430 msgr2=0x7fb984131820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.673+0000 7fb9897df700 1 --2- 172.21.15.72:0/1396585095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb98412f430 0x7fb984131820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb97c009f50 tx=0x7fb97c009840).stop 2023-10-03T10:10:06.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.673+0000 7fb9897df700 1 -- 172.21.15.72:0/1396585095 shutdown_connections 2023-10-03T10:10:06.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.673+0000 7fb9897df700 1 --2- 172.21.15.72:0/1396585095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb98412f430 0x7fb984131820 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.673+0000 7fb9897df700 1 --2- 172.21.15.72:0/1396585095 >> v2:172.21.15.72:3300/0 conn(0x7fb9840653a0 0x7fb984098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.673+0000 7fb9897df700 1 --2- 172.21.15.72:0/1396585095 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb984098b30 0x7fb984098f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.673+0000 7fb9897df700 1 -- 172.21.15.72:0/1396585095 >> 172.21.15.72:0/1396585095 conn(0x7fb98409dc20 msgr2=0x7fb98409e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.673+0000 7fb9897df700 1 -- 172.21.15.72:0/1396585095 shutdown_connections 2023-10-03T10:10:06.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.673+0000 7fb9897df700 1 -- 172.21.15.72:0/1396585095 wait complete. 2023-10-03T10:10:06.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.674+0000 7fb9897df700 1 Processor -- start 2023-10-03T10:10:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.674+0000 7fb9897df700 1 -- start start 2023-10-03T10:10:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.674+0000 7fb9897df700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9840653a0 0x7fb98411a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb9897df700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb984098b30 0x7fb98411a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb9897df700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb98412f430 0x7fb98411ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb9897df700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98411b130 con 0x7fb984098b30 2023-10-03T10:10:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb9897df700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb984094680 con 0x7fb9840653a0 2023-10-03T10:10:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb9897df700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb98411e8f0 con 0x7fb98412f430 2023-10-03T10:10:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb982ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9840653a0 0x7fb98411a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb982ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9840653a0 0x7fb98411a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51698/0 (socket says 172.21.15.72:51698) 2023-10-03T10:10:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb982ffd700 1 -- 172.21.15.72:0/314872980 learned_addr learned my addr 172.21.15.72:0/314872980 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:06.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb9837fe700 1 --2- 172.21.15.72:0/314872980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb98412f430 0x7fb98411ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb9827fc700 1 --2- 172.21.15.72:0/314872980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb984098b30 0x7fb98411a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb982ffd700 1 -- 172.21.15.72:0/314872980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb98412f430 msgr2=0x7fb98411ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb982ffd700 1 --2- 172.21.15.72:0/314872980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb98412f430 0x7fb98411ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb982ffd700 1 -- 172.21.15.72:0/314872980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb984098b30 msgr2=0x7fb98411a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb982ffd700 1 --2- 172.21.15.72:0/314872980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb984098b30 0x7fb98411a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb982ffd700 1 -- 172.21.15.72:0/314872980 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9780092a0 con 0x7fb9840653a0 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb9837fe700 1 --2- 172.21.15.72:0/314872980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb98412f430 0x7fb98411ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb982ffd700 1 --2- 172.21.15.72:0/314872980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9840653a0 0x7fb98411a260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb97800ea20 tx=0x7fb978009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb96affd700 1 -- 172.21.15.72:0/314872980 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97800ee60 con 0x7fb9840653a0 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb96affd700 1 -- 172.21.15.72:0/314872980 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97800c850 con 0x7fb9840653a0 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb9897df700 1 -- 172.21.15.72:0/314872980 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97c009ae0 con 0x7fb9840653a0 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb96affd700 1 -- 172.21.15.72:0/314872980 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97800cbd0 con 0x7fb9840653a0 2023-10-03T10:10:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.675+0000 7fb9897df700 1 -- 172.21.15.72:0/314872980 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98411d770 con 0x7fb9840653a0 2023-10-03T10:10:06.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.676+0000 7fb96affd700 1 -- 172.21.15.72:0/314872980 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb97801b400 con 0x7fb9840653a0 2023-10-03T10:10:06.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.676+0000 7fb96affd700 1 -- 172.21.15.72:0/314872980 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb97803b480 con 0x7fb9840653a0 2023-10-03T10:10:06.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.676+0000 7fb9897df700 1 -- 172.21.15.72:0/314872980 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb984096bf0 con 0x7fb9840653a0 2023-10-03T10:10:06.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.680+0000 7fb96affd700 1 -- 172.21.15.72:0/314872980 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb978019900 con 0x7fb9840653a0 2023-10-03T10:10:06.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.838+0000 7fb9897df700 1 -- 172.21.15.72:0/314872980 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb98411d4b0 con 0x7fb9840653a0 2023-10-03T10:10:06.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.838+0000 7fb96affd700 1 -- 172.21.15.72:0/314872980 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb978019310 con 0x7fb9840653a0 2023-10-03T10:10:06.838 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-03T10:10:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.840+0000 7fb9897df700 1 -- 172.21.15.72:0/314872980 >> v1:172.21.15.72:6816/118184 conn(0x7fb97002bb90 legacy=0x7fb97002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.840+0000 7fb9897df700 1 -- 172.21.15.72:0/314872980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9840653a0 msgr2=0x7fb98411a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.840+0000 7fb9897df700 1 --2- 172.21.15.72:0/314872980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9840653a0 0x7fb98411a260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb97800ea20 tx=0x7fb978009060).stop 2023-10-03T10:10:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.840+0000 7fb9897df700 1 -- 172.21.15.72:0/314872980 shutdown_connections 2023-10-03T10:10:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.840+0000 7fb9897df700 1 --2- 172.21.15.72:0/314872980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb98412f430 0x7fb98411ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.840+0000 7fb9897df700 1 --2- 172.21.15.72:0/314872980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9840653a0 0x7fb98411a260 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.840+0000 7fb9897df700 1 --2- 172.21.15.72:0/314872980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb984098b30 0x7fb98411a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.840+0000 7fb9897df700 1 -- 172.21.15.72:0/314872980 >> 172.21.15.72:0/314872980 conn(0x7fb98409dc20 msgr2=0x7fb98409bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.840+0000 7fb9897df700 1 -- 172.21.15.72:0/314872980 shutdown_connections 2023-10-03T10:10:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.840+0000 7fb9897df700 1 -- 172.21.15.72:0/314872980 wait complete. 2023-10-03T10:10:06.851 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:10:06.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.967+0000 7ffad31c5700 1 Processor -- start 2023-10-03T10:10:06.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.967+0000 7ffad31c5700 1 -- start start 2023-10-03T10:10:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.967+0000 7ffad31c5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffacc096380 0x7ffacc094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.967+0000 7ffad31c5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffacc094c20 0x7ffacc127d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.968+0000 7ffad31c5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc096760 con 0x7ffacc091b00 2023-10-03T10:10:06.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.968+0000 7ffad31c5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc091ff0 con 0x7ffacc096380 2023-10-03T10:10:06.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.968+0000 7ffad31c5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc092c80 con 0x7ffacc094c20 2023-10-03T10:10:06.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.968+0000 7ffad1762700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffacc094c20 0x7ffacc127d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.968+0000 7ffacbfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffacc091b00 0x7ffacc127600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48280/0 (socket says 172.21.15.72:48280) 2023-10-03T10:10:06.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.968+0000 7ffacbfff700 1 -- 172.21.15.72:0/4195542528 learned_addr learned my addr 172.21.15.72:0/4195542528 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:10:06.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.968+0000 7ffad0f61700 1 --2- 172.21.15.72:0/4195542528 >> v2:172.21.15.72:3300/0 conn(0x7ffacc096380 0x7ffacc094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.968+0000 7ffad1762700 1 -- 172.21.15.72:0/4195542528 >> v2:172.21.15.72:3300/0 conn(0x7ffacc096380 msgr2=0x7ffacc094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:06.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.968+0000 7ffad1762700 1 --2- 172.21.15.72:0/4195542528 >> v2:172.21.15.72:3300/0 conn(0x7ffacc096380 0x7ffacc094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.968+0000 7ffad1762700 1 -- 172.21.15.72:0/4195542528 >> v1:172.21.15.72:6789/0 conn(0x7ffacc091b00 legacy=0x7ffacc127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.968+0000 7ffad1762700 1 -- 172.21.15.72:0/4195542528 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc093900 con 0x7ffacc094c20 2023-10-03T10:10:06.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.968+0000 7ffad0f61700 1 --2- 172.21.15.72:0/4195542528 >> v2:172.21.15.72:3300/0 conn(0x7ffacc096380 0x7ffacc094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.968+0000 7ffad1762700 1 --2- 172.21.15.72:0/4195542528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffacc094c20 0x7ffacc127d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ffac4009e60 tx=0x7ffac4009780).ready entity=mon.2 client_cookie=b08e37a84f9a1280 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.974+0000 7ffacb7fe700 1 -- 172.21.15.72:0/4195542528 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400e070 con 0x7ffacc094c20 2023-10-03T10:10:06.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.974+0000 7ffacb7fe700 1 -- 172.21.15.72:0/4195542528 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac400bb60 con 0x7ffacc094c20 2023-10-03T10:10:06.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.974+0000 7ffacb7fe700 1 -- 172.21.15.72:0/4195542528 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4012410 con 0x7ffacc094c20 2023-10-03T10:10:06.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.974+0000 7ffad31c5700 1 -- 172.21.15.72:0/4195542528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffacc094c20 msgr2=0x7ffacc127d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.974+0000 7ffad31c5700 1 --2- 172.21.15.72:0/4195542528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffacc094c20 0x7ffacc127d10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ffac4009e60 tx=0x7ffac4009780).stop 2023-10-03T10:10:06.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.974+0000 7ffad31c5700 1 -- 172.21.15.72:0/4195542528 shutdown_connections 2023-10-03T10:10:06.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.974+0000 7ffad31c5700 1 --2- 172.21.15.72:0/4195542528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffacc094c20 0x7ffacc127d10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.974+0000 7ffad31c5700 1 --2- 172.21.15.72:0/4195542528 >> v2:172.21.15.72:3300/0 conn(0x7ffacc096380 0x7ffacc094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.974+0000 7ffad31c5700 1 -- 172.21.15.72:0/4195542528 >> 172.21.15.72:0/4195542528 conn(0x7ffacc097470 msgr2=0x7ffacc097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:06.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.975+0000 7ffad31c5700 1 -- 172.21.15.72:0/4195542528 shutdown_connections 2023-10-03T10:10:06.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.975+0000 7ffad31c5700 1 -- 172.21.15.72:0/4195542528 wait complete. 2023-10-03T10:10:06.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.975+0000 7ffad31c5700 1 Processor -- start 2023-10-03T10:10:06.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad31c5700 1 -- start start 2023-10-03T10:10:06.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad31c5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffacc091b00 0x7ffacc117dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad31c5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffacc094c20 0x7ffacc113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad31c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffacc096380 0x7ffacc1143f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad31c5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc116f90 con 0x7ffacc091b00 2023-10-03T10:10:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad31c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc09a060 con 0x7ffacc096380 2023-10-03T10:10:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad31c5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc06a520 con 0x7ffacc094c20 2023-10-03T10:10:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad0f61700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffacc091b00 0x7ffacc117dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad0f61700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffacc091b00 0x7ffacc117dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32900/0 (socket says 172.21.15.72:32900) 2023-10-03T10:10:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad0f61700 1 -- 172.21.15.72:0/3355913641 learned_addr learned my addr 172.21.15.72:0/3355913641 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad1762700 1 --2- 172.21.15.72:0/3355913641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffacc096380 0x7ffacc1143f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffacbfff700 1 --2- 172.21.15.72:0/3355913641 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffacc094c20 0x7ffacc113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad0f61700 1 -- 172.21.15.72:0/3355913641 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffacc094c20 msgr2=0x7ffacc113f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad0f61700 1 --2- 172.21.15.72:0/3355913641 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffacc094c20 0x7ffacc113f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad0f61700 1 -- 172.21.15.72:0/3355913641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffacc096380 msgr2=0x7ffacc1143f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad0f61700 1 --2- 172.21.15.72:0/3355913641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffacc096380 0x7ffacc1143f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad0f61700 1 -- 172.21.15.72:0/3355913641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac00092a0 con 0x7ffacc091b00 2023-10-03T10:10:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.976+0000 7ffad1762700 1 --2- 172.21.15.72:0/3355913641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffacc096380 0x7ffacc1143f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.977+0000 7ffad0f61700 1 --2- 172.21.15.72:0/3355913641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffacc091b00 0x7ffacc117dd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7ffac000ea20 tx=0x7ffac0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.977+0000 7ffac8ff9700 1 -- 172.21.15.72:0/3355913641 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac000ee60 con 0x7ffacc091b00 2023-10-03T10:10:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.977+0000 7ffac8ff9700 1 -- 172.21.15.72:0/3355913641 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac000c850 con 0x7ffacc091b00 2023-10-03T10:10:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.977+0000 7ffad31c5700 1 -- 172.21.15.72:0/3355913641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac4009a20 con 0x7ffacc091b00 2023-10-03T10:10:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.977+0000 7ffac8ff9700 1 -- 172.21.15.72:0/3355913641 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac000cbd0 con 0x7ffacc091b00 2023-10-03T10:10:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.977+0000 7ffad31c5700 1 -- 172.21.15.72:0/3355913641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc115950 con 0x7ffacc091b00 2023-10-03T10:10:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.978+0000 7ffad31c5700 1 -- 172.21.15.72:0/3355913641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc05a260 con 0x7ffacc091b00 2023-10-03T10:10:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.978+0000 7ffac8ff9700 1 -- 172.21.15.72:0/3355913641 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ffac0025480 con 0x7ffacc091b00 2023-10-03T10:10:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.978+0000 7ffac8ff9700 1 -- 172.21.15.72:0/3355913641 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ffac003ba50 con 0x7ffacc091b00 2023-10-03T10:10:06.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:06.982+0000 7ffac8ff9700 1 -- 172.21.15.72:0/3355913641 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ffac0023940 con 0x7ffacc091b00 2023-10-03T10:10:07.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.179+0000 7ffad31c5700 1 -- 172.21.15.72:0/3355913641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffacc0942e0 con 0x7ffacc091b00 2023-10-03T10:10:07.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.179+0000 7ffac8ff9700 1 -- 172.21.15.72:0/3355913641 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2154 (secure 0 0 0) 0x7ffac002a090 con 0x7ffacc091b00 2023-10-03T10:10:07.179 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:10:07.179 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:46.344785+0000","modified":"2023-10-03T10:09:48.352357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6817/542674768","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6817","nonce":542674768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:10:07.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.181+0000 7ffad31c5700 1 -- 172.21.15.72:0/3355913641 >> v1:172.21.15.72:6816/118184 conn(0x7ffab002bb60 legacy=0x7ffab002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.181+0000 7ffad31c5700 1 -- 172.21.15.72:0/3355913641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffacc091b00 msgr2=0x7ffacc117dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.181+0000 7ffad31c5700 1 --2- 172.21.15.72:0/3355913641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffacc091b00 0x7ffacc117dd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7ffac000ea20 tx=0x7ffac0009060).stop 2023-10-03T10:10:07.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.181+0000 7ffad31c5700 1 -- 172.21.15.72:0/3355913641 shutdown_connections 2023-10-03T10:10:07.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.181+0000 7ffad31c5700 1 --2- 172.21.15.72:0/3355913641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffacc091b00 0x7ffacc117dd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.181+0000 7ffad31c5700 1 --2- 172.21.15.72:0/3355913641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffacc096380 0x7ffacc1143f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.181+0000 7ffad31c5700 1 --2- 172.21.15.72:0/3355913641 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffacc094c20 0x7ffacc113f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.181+0000 7ffad31c5700 1 -- 172.21.15.72:0/3355913641 >> 172.21.15.72:0/3355913641 conn(0x7ffacc097470 msgr2=0x7ffacc126810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:07.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.181+0000 7ffad31c5700 1 -- 172.21.15.72:0/3355913641 shutdown_connections 2023-10-03T10:10:07.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.181+0000 7ffad31c5700 1 -- 172.21.15.72:0/3355913641 wait complete. 2023-10-03T10:10:07.183 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 5 2023-10-03T10:10:07.193 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:07.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.308+0000 7fab10329700 1 Processor -- start 2023-10-03T10:10:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.308+0000 7fab10329700 1 -- start start 2023-10-03T10:10:07.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab10329700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab08059070 0x7fab08127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab10329700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab08127d80 0x7fab08095a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab10329700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab08091b60 con 0x7fab08127390 2023-10-03T10:10:07.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab10329700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab08059450 con 0x7fab08127d80 2023-10-03T10:10:07.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab10329700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab080968c0 con 0x7fab08059070 2023-10-03T10:10:07.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab0e0c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab08059070 0x7fab08127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab0d8c4700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fab08127390 0x7fab08095370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48294/0 (socket says 172.21.15.72:48294) 2023-10-03T10:10:07.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab0e8c6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab08127d80 0x7fab08095a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab0d8c4700 1 -- 172.21.15.72:0/3525181327 learned_addr learned my addr 172.21.15.72:0/3525181327 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:10:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab0e0c5700 1 -- 172.21.15.72:0/3525181327 >> v2:172.21.15.72:3300/0 conn(0x7fab08127d80 msgr2=0x7fab08095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab0e0c5700 1 --2- 172.21.15.72:0/3525181327 >> v2:172.21.15.72:3300/0 conn(0x7fab08127d80 0x7fab08095a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab0e0c5700 1 -- 172.21.15.72:0/3525181327 >> v1:172.21.15.72:6789/0 conn(0x7fab08127390 legacy=0x7fab08095370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab0e0c5700 1 -- 172.21.15.72:0/3525181327 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab08092a10 con 0x7fab08059070 2023-10-03T10:10:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab0e8c6700 1 --2- 172.21.15.72:0/3525181327 >> v2:172.21.15.72:3300/0 conn(0x7fab08127d80 0x7fab08095a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab0e0c5700 1 --2- 172.21.15.72:0/3525181327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab08059070 0x7fab08127890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7faaf8009790 tx=0x7faaf8009060).ready entity=mon.1 client_cookie=284c5bcab90e239 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab0d0c3700 1 -- 172.21.15.72:0/3525181327 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf80090d0 con 0x7fab08059070 2023-10-03T10:10:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab0d0c3700 1 -- 172.21.15.72:0/3525181327 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf800f510 con 0x7fab08059070 2023-10-03T10:10:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.309+0000 7fab0d0c3700 1 -- 172.21.15.72:0/3525181327 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf800f890 con 0x7fab08059070 2023-10-03T10:10:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.310+0000 7fab10329700 1 -- 172.21.15.72:0/3525181327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab08059070 msgr2=0x7fab08127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.310+0000 7fab10329700 1 --2- 172.21.15.72:0/3525181327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab08059070 0x7fab08127890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7faaf8009790 tx=0x7faaf8009060).stop 2023-10-03T10:10:07.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.310+0000 7fab10329700 1 -- 172.21.15.72:0/3525181327 shutdown_connections 2023-10-03T10:10:07.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.310+0000 7fab10329700 1 --2- 172.21.15.72:0/3525181327 >> v2:172.21.15.72:3300/0 conn(0x7fab08127d80 0x7fab08095a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.310+0000 7fab10329700 1 --2- 172.21.15.72:0/3525181327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab08059070 0x7fab08127890 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.310+0000 7fab10329700 1 -- 172.21.15.72:0/3525181327 >> 172.21.15.72:0/3525181327 conn(0x7fab08097470 msgr2=0x7fab08097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:07.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.310+0000 7fab10329700 1 -- 172.21.15.72:0/3525181327 shutdown_connections 2023-10-03T10:10:07.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.310+0000 7fab10329700 1 -- 172.21.15.72:0/3525181327 wait complete. 2023-10-03T10:10:07.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.311+0000 7fab10329700 1 Processor -- start 2023-10-03T10:10:07.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.311+0000 7fab10329700 1 -- start start 2023-10-03T10:10:07.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.311+0000 7fab10329700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab08059070 0x7fab081179b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.311+0000 7fab10329700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab08127390 0x7fab08113a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.311+0000 7fab10329700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab08127d80 0x7fab08113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.311+0000 7fab10329700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab08115e70 con 0x7fab08127d80 2023-10-03T10:10:07.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.311+0000 7fab10329700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab08124ae0 con 0x7fab08127390 2023-10-03T10:10:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.311+0000 7fab10329700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab08129290 con 0x7fab08059070 2023-10-03T10:10:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.311+0000 7fab0d8c4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab08127390 0x7fab08113a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.311+0000 7fab0e8c6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab08127d80 0x7fab08113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.311+0000 7fab0d8c4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab08127390 0x7fab08113a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51728/0 (socket says 172.21.15.72:51728) 2023-10-03T10:10:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.311+0000 7fab0d8c4700 1 -- 172.21.15.72:0/4233218946 learned_addr learned my addr 172.21.15.72:0/4233218946 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.311+0000 7fab0e0c5700 1 --2- 172.21.15.72:0/4233218946 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab08059070 0x7fab081179b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.312+0000 7fab0e8c6700 1 -- 172.21.15.72:0/4233218946 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab08059070 msgr2=0x7fab081179b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.312+0000 7fab0e8c6700 1 --2- 172.21.15.72:0/4233218946 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab08059070 0x7fab081179b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.312+0000 7fab0e8c6700 1 -- 172.21.15.72:0/4233218946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab08127390 msgr2=0x7fab08113a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.312+0000 7fab0e8c6700 1 --2- 172.21.15.72:0/4233218946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab08127390 0x7fab08113a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.312+0000 7fab0e8c6700 1 -- 172.21.15.72:0/4233218946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab00009a20 con 0x7fab08127d80 2023-10-03T10:10:07.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.312+0000 7fab0e8c6700 1 --2- 172.21.15.72:0/4233218946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab08127d80 0x7fab08113f00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fab00009f10 tx=0x7fab0000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:07.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.312+0000 7faafe7fc700 1 -- 172.21.15.72:0/4233218946 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0000cb70 con 0x7fab08127d80 2023-10-03T10:10:07.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.312+0000 7faafe7fc700 1 -- 172.21.15.72:0/4233218946 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0000f040 con 0x7fab08127d80 2023-10-03T10:10:07.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.312+0000 7fab10329700 1 -- 172.21.15.72:0/4233218946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf80092a0 con 0x7fab08127d80 2023-10-03T10:10:07.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.312+0000 7faafe7fc700 1 -- 172.21.15.72:0/4233218946 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00013400 con 0x7fab08127d80 2023-10-03T10:10:07.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.312+0000 7fab10329700 1 -- 172.21.15.72:0/4233218946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab08116f10 con 0x7fab08127d80 2023-10-03T10:10:07.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.312+0000 7faafe7fc700 1 -- 172.21.15.72:0/4233218946 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fab000137f0 con 0x7fab08127d80 2023-10-03T10:10:07.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.313+0000 7faafe7fc700 1 -- 172.21.15.72:0/4233218946 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fab0003b860 con 0x7fab08127d80 2023-10-03T10:10:07.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.313+0000 7fab10329700 1 -- 172.21.15.72:0/4233218946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab08091d80 con 0x7fab08127d80 2023-10-03T10:10:07.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.317+0000 7faafe7fc700 1 -- 172.21.15.72:0/4233218946 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fab00013aa0 con 0x7fab08127d80 2023-10-03T10:10:07.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.477+0000 7fab10329700 1 -- 172.21.15.72:0/4233218946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab0805a260 con 0x7fab08127d80 2023-10-03T10:10:07.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.478+0000 7faafe7fc700 1 -- 172.21.15.72:0/4233218946 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11340 (secure 0 0 0) 0x7fab0001b7e0 con 0x7fab08127d80 2023-10-03T10:10:07.478 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:10:07.478 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":18,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:10:02.945442+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:07.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.480+0000 7fab10329700 1 -- 172.21.15.72:0/4233218946 >> v1:172.21.15.72:6816/118184 conn(0x7faaec02bb60 legacy=0x7faaec02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.480+0000 7fab10329700 1 -- 172.21.15.72:0/4233218946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab08127d80 msgr2=0x7fab08113f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.480+0000 7fab10329700 1 --2- 172.21.15.72:0/4233218946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab08127d80 0x7fab08113f00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fab00009f10 tx=0x7fab0000b040).stop 2023-10-03T10:10:07.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.480+0000 7fab10329700 1 -- 172.21.15.72:0/4233218946 shutdown_connections 2023-10-03T10:10:07.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.480+0000 7fab10329700 1 --2- 172.21.15.72:0/4233218946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab08127d80 0x7fab08113f00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.480+0000 7fab10329700 1 --2- 172.21.15.72:0/4233218946 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab08059070 0x7fab081179b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.480+0000 7fab10329700 1 --2- 172.21.15.72:0/4233218946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab08127390 0x7fab08113a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.480+0000 7fab10329700 1 -- 172.21.15.72:0/4233218946 >> 172.21.15.72:0/4233218946 conn(0x7fab08097470 msgr2=0x7fab08125ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:07.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.480+0000 7fab10329700 1 -- 172.21.15.72:0/4233218946 shutdown_connections 2023-10-03T10:10:07.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.480+0000 7fab10329700 1 -- 172.21.15.72:0/4233218946 wait complete. 2023-10-03T10:10:07.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T10:10:07.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.610+0000 7f3ced9f2700 1 Processor -- start 2023-10-03T10:10:07.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.610+0000 7f3ced9f2700 1 -- start start 2023-10-03T10:10:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.610+0000 7f3ced9f2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ce80653a0 0x7f3ce8098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.610+0000 7f3ced9f2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ce8098b30 0x7f3ce8098f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.610+0000 7f3ced9f2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce80663b0 con 0x7f3ce812f430 2023-10-03T10:10:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.610+0000 7f3ced9f2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce8065e80 con 0x7f3ce80653a0 2023-10-03T10:10:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.610+0000 7f3ced9f2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce8065780 con 0x7f3ce8098b30 2023-10-03T10:10:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce67fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ce8098b30 0x7f3ce8098f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ce80653a0 0x7f3ce8098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ce80653a0 0x7f3ce8098640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51744/0 (socket says 172.21.15.72:51744) 2023-10-03T10:10:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce67fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ce8098b30 0x7f3ce8098f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59766/0 (socket says 172.21.15.72:59766) 2023-10-03T10:10:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce6ffd700 1 -- 172.21.15.72:0/3058161460 learned_addr learned my addr 172.21.15.72:0/3058161460 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce77fe700 1 --1- 172.21.15.72:0/3058161460 >> v1:172.21.15.72:6789/0 conn(0x7f3ce812f430 0x7f3ce8131820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48308/0 (socket says 172.21.15.72:48308) 2023-10-03T10:10:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce5ffb700 1 -- 172.21.15.72:0/3058161460 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121290971 0 0) 0x7f3ce80663b0 con 0x7f3ce812f430 2023-10-03T10:10:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce6ffd700 1 -- 172.21.15.72:0/3058161460 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ce8098b30 msgr2=0x7f3ce8098f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce6ffd700 1 --2- 172.21.15.72:0/3058161460 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ce8098b30 0x7f3ce8098f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce6ffd700 1 -- 172.21.15.72:0/3058161460 >> v1:172.21.15.72:6789/0 conn(0x7f3ce812f430 legacy=0x7f3ce8131820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce6ffd700 1 -- 172.21.15.72:0/3058161460 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce8096180 con 0x7f3ce80653a0 2023-10-03T10:10:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce67fc700 1 --2- 172.21.15.72:0/3058161460 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ce8098b30 0x7f3ce8098f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce6ffd700 1 --2- 172.21.15.72:0/3058161460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ce80653a0 0x7f3ce8098640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3cdc009830 tx=0x7f3cdc0090f0).ready entity=mon.1 client_cookie=32b4a8d29a9d3ba8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce5ffb700 1 -- 172.21.15.72:0/3058161460 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00b580 con 0x7f3ce80653a0 2023-10-03T10:10:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce5ffb700 1 -- 172.21.15.72:0/3058161460 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc00b6e0 con 0x7f3ce80653a0 2023-10-03T10:10:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.611+0000 7f3ce5ffb700 1 -- 172.21.15.72:0/3058161460 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00ba60 con 0x7f3ce80653a0 2023-10-03T10:10:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.612+0000 7f3ced9f2700 1 -- 172.21.15.72:0/3058161460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ce80653a0 msgr2=0x7f3ce8098640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.612+0000 7f3ced9f2700 1 --2- 172.21.15.72:0/3058161460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ce80653a0 0x7f3ce8098640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f3cdc009830 tx=0x7f3cdc0090f0).stop 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.612+0000 7f3ced9f2700 1 -- 172.21.15.72:0/3058161460 shutdown_connections 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.612+0000 7f3ced9f2700 1 --2- 172.21.15.72:0/3058161460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ce80653a0 0x7f3ce8098640 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.612+0000 7f3ced9f2700 1 --2- 172.21.15.72:0/3058161460 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ce8098b30 0x7f3ce8098f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.612+0000 7f3ced9f2700 1 -- 172.21.15.72:0/3058161460 >> 172.21.15.72:0/3058161460 conn(0x7f3ce809dc20 msgr2=0x7f3ce809e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.612+0000 7f3ced9f2700 1 -- 172.21.15.72:0/3058161460 shutdown_connections 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.612+0000 7f3ced9f2700 1 -- 172.21.15.72:0/3058161460 wait complete. 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.613+0000 7f3ced9f2700 1 Processor -- start 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.613+0000 7f3ced9f2700 1 -- start start 2023-10-03T10:10:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.613+0000 7f3ced9f2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ce80653a0 0x7f3ce811e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.613+0000 7f3ced9f2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce8098b30 0x7f3ce812e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.613+0000 7f3ced9f2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ce812f430 0x7f3ce812e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.613+0000 7f3ced9f2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce811ea00 con 0x7f3ce8098b30 2023-10-03T10:10:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.613+0000 7f3ced9f2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce8099a90 con 0x7f3ce80653a0 2023-10-03T10:10:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.613+0000 7f3ced9f2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce811ec30 con 0x7f3ce812f430 2023-10-03T10:10:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.613+0000 7f3ce6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ce80653a0 0x7f3ce811e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.613+0000 7f3ce67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce8098b30 0x7f3ce812e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.613+0000 7f3ce77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ce812f430 0x7f3ce812e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.613+0000 7f3ce67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce8098b30 0x7f3ce812e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32916/0 (socket says 172.21.15.72:32916) 2023-10-03T10:10:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.613+0000 7f3ce6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ce80653a0 0x7f3ce811e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51752/0 (socket says 172.21.15.72:51752) 2023-10-03T10:10:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.613+0000 7f3ce67fc700 1 -- 172.21.15.72:0/516404017 learned_addr learned my addr 172.21.15.72:0/516404017 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.614+0000 7f3ce67fc700 1 -- 172.21.15.72:0/516404017 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ce812f430 msgr2=0x7f3ce812e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.614+0000 7f3ce67fc700 1 --2- 172.21.15.72:0/516404017 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ce812f430 0x7f3ce812e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.614+0000 7f3ce67fc700 1 -- 172.21.15.72:0/516404017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ce80653a0 msgr2=0x7f3ce811e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.614+0000 7f3ce67fc700 1 --2- 172.21.15.72:0/516404017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ce80653a0 0x7f3ce811e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.614+0000 7f3ce67fc700 1 -- 172.21.15.72:0/516404017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd80092a0 con 0x7f3ce8098b30 2023-10-03T10:10:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.614+0000 7f3ce6ffd700 1 --2- 172.21.15.72:0/516404017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ce80653a0 0x7f3ce811e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.614+0000 7f3ce67fc700 1 --2- 172.21.15.72:0/516404017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce8098b30 0x7f3ce812e150 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f3cd800ea20 tx=0x7f3cd8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.614+0000 7f3cceffd700 1 -- 172.21.15.72:0/516404017 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd800ee60 con 0x7f3ce8098b30 2023-10-03T10:10:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.614+0000 7f3cceffd700 1 -- 172.21.15.72:0/516404017 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd8009600 con 0x7f3ce8098b30 2023-10-03T10:10:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.614+0000 7f3ced9f2700 1 -- 172.21.15.72:0/516404017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc009370 con 0x7f3ce8098b30 2023-10-03T10:10:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.614+0000 7f3cceffd700 1 -- 172.21.15.72:0/516404017 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd800ca60 con 0x7f3ce8098b30 2023-10-03T10:10:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.614+0000 7f3ced9f2700 1 -- 172.21.15.72:0/516404017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce811db40 con 0x7f3ce8098b30 2023-10-03T10:10:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.614+0000 7f3cceffd700 1 -- 172.21.15.72:0/516404017 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3cd801b400 con 0x7f3ce8098b30 2023-10-03T10:10:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.615+0000 7f3cceffd700 1 -- 172.21.15.72:0/516404017 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f3cd803b460 con 0x7f3ce8098b30 2023-10-03T10:10:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.615+0000 7f3ced9f2700 1 -- 172.21.15.72:0/516404017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce805a260 con 0x7f3ce8098b30 2023-10-03T10:10:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.619+0000 7f3cceffd700 1 -- 172.21.15.72:0/516404017 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3cd8016020 con 0x7f3ce8098b30 2023-10-03T10:10:07.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.816+0000 7f3ced9f2700 1 -- 172.21.15.72:0/516404017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3ce812f210 con 0x7f3ce8098b30 2023-10-03T10:10:07.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.973+0000 7f3cceffd700 1 -- 172.21.15.72:0/516404017 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3cd8011d20 con 0x7f3ce8098b30 2023-10-03T10:10:07.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.976+0000 7f3ced9f2700 1 -- 172.21.15.72:0/516404017 >> v1:172.21.15.72:6816/118184 conn(0x7f3cd402bb60 legacy=0x7f3cd402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.976+0000 7f3ced9f2700 1 -- 172.21.15.72:0/516404017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce8098b30 msgr2=0x7f3ce812e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:07.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.976+0000 7f3ced9f2700 1 --2- 172.21.15.72:0/516404017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce8098b30 0x7f3ce812e150 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f3cd800ea20 tx=0x7f3cd8009060).stop 2023-10-03T10:10:07.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.976+0000 7f3ced9f2700 1 -- 172.21.15.72:0/516404017 shutdown_connections 2023-10-03T10:10:07.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.976+0000 7f3ced9f2700 1 --2- 172.21.15.72:0/516404017 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ce812f430 0x7f3ce812e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.976+0000 7f3ced9f2700 1 --2- 172.21.15.72:0/516404017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ce80653a0 0x7f3ce811e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.976+0000 7f3ced9f2700 1 --2- 172.21.15.72:0/516404017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce8098b30 0x7f3ce812e150 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:07.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.976+0000 7f3ced9f2700 1 -- 172.21.15.72:0/516404017 >> 172.21.15.72:0/516404017 conn(0x7f3ce809dc20 msgr2=0x7f3ce809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:07.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.976+0000 7f3ced9f2700 1 -- 172.21.15.72:0/516404017 shutdown_connections 2023-10-03T10:10:07.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:07.976+0000 7f3ced9f2700 1 -- 172.21.15.72:0/516404017 wait complete. 2023-10-03T10:10:07.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2023-10-03T10:10:08.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.106+0000 7fba40d76700 1 Processor -- start 2023-10-03T10:10:08.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.106+0000 7fba40d76700 1 -- start start 2023-10-03T10:10:08.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba40d76700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba3c12b560 0x7fba3c12fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba40d76700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba3c130250 0x7fba3c132640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba40d76700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba3c098210 con 0x7fba3c0613a0 2023-10-03T10:10:08.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba40d76700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba3c12b940 con 0x7fba3c130250 2023-10-03T10:10:08.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba40d76700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c093380 con 0x7fba3c12b560 2023-10-03T10:10:08.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba39d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba3c12b560 0x7fba3c12fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba3ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba3c130250 0x7fba3c132640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba3a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fba3c0613a0 0x7fba3c12ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48316/0 (socket says 172.21.15.72:48316) 2023-10-03T10:10:08.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba3ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba3c130250 0x7fba3c132640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32926/0 (socket says 172.21.15.72:32926) 2023-10-03T10:10:08.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba39d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba3c12b560 0x7fba3c12fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59782/0 (socket says 172.21.15.72:59782) 2023-10-03T10:10:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba3a59c700 1 -- 172.21.15.72:0/4286458408 learned_addr learned my addr 172.21.15.72:0/4286458408 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:10:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba3ad9d700 1 -- 172.21.15.72:0/4286458408 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba3c12b560 msgr2=0x7fba3c12fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba3ad9d700 1 --2- 172.21.15.72:0/4286458408 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba3c12b560 0x7fba3c12fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba3ad9d700 1 -- 172.21.15.72:0/4286458408 >> v1:172.21.15.72:6789/0 conn(0x7fba3c0613a0 legacy=0x7fba3c12ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba3ad9d700 1 -- 172.21.15.72:0/4286458408 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c099670 con 0x7fba3c130250 2023-10-03T10:10:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba39d9b700 1 --2- 172.21.15.72:0/4286458408 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba3c12b560 0x7fba3c12fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba3959a700 1 -- 172.21.15.72:0/4286458408 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702242459 0 0) 0x7fba3c098210 con 0x7fba3c0613a0 2023-10-03T10:10:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba3ad9d700 1 --2- 172.21.15.72:0/4286458408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba3c130250 0x7fba3c132640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fba34009e90 tx=0x7fba34009780).ready entity=mon.0 client_cookie=bb8e4a648735bc20 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba3959a700 1 -- 172.21.15.72:0/4286458408 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3400e070 con 0x7fba3c130250 2023-10-03T10:10:08.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba3959a700 1 -- 172.21.15.72:0/4286458408 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3400bb20 con 0x7fba3c130250 2023-10-03T10:10:08.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.107+0000 7fba3959a700 1 -- 172.21.15.72:0/4286458408 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3400bea0 con 0x7fba3c130250 2023-10-03T10:10:08.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.108+0000 7fba40d76700 1 -- 172.21.15.72:0/4286458408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba3c130250 msgr2=0x7fba3c132640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.108+0000 7fba40d76700 1 --2- 172.21.15.72:0/4286458408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba3c130250 0x7fba3c132640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fba34009e90 tx=0x7fba34009780).stop 2023-10-03T10:10:08.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.108+0000 7fba40d76700 1 -- 172.21.15.72:0/4286458408 shutdown_connections 2023-10-03T10:10:08.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.108+0000 7fba40d76700 1 --2- 172.21.15.72:0/4286458408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba3c130250 0x7fba3c132640 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.108+0000 7fba40d76700 1 --2- 172.21.15.72:0/4286458408 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba3c12b560 0x7fba3c12fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.108+0000 7fba40d76700 1 -- 172.21.15.72:0/4286458408 >> 172.21.15.72:0/4286458408 conn(0x7fba3c09a1c0 msgr2=0x7fba3c09a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:08.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.108+0000 7fba40d76700 1 -- 172.21.15.72:0/4286458408 shutdown_connections 2023-10-03T10:10:08.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.108+0000 7fba40d76700 1 -- 172.21.15.72:0/4286458408 wait complete. 2023-10-03T10:10:08.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.109+0000 7fba40d76700 1 Processor -- start 2023-10-03T10:10:08.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.109+0000 7fba40d76700 1 -- start start 2023-10-03T10:10:08.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.109+0000 7fba40d76700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba3c0613a0 0x7fba3c12a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.109+0000 7fba40d76700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba3c12b560 0x7fba3c114330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.109+0000 7fba40d76700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba3c130250 0x7fba3c114820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:08.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.109+0000 7fba40d76700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c0698d0 con 0x7fba3c0613a0 2023-10-03T10:10:08.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.109+0000 7fba40d76700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c093940 con 0x7fba3c12b560 2023-10-03T10:10:08.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.109+0000 7fba40d76700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c118420 con 0x7fba3c130250 2023-10-03T10:10:08.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.109+0000 7fba39d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba3c12b560 0x7fba3c114330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.109+0000 7fba3ad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba3c130250 0x7fba3c114820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.109+0000 7fba39d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba3c12b560 0x7fba3c114330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51756/0 (socket says 172.21.15.72:51756) 2023-10-03T10:10:08.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.109+0000 7fba3ad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba3c130250 0x7fba3c114820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59796/0 (socket says 172.21.15.72:59796) 2023-10-03T10:10:08.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.109+0000 7fba39d9b700 1 -- 172.21.15.72:0/3399368387 learned_addr learned my addr 172.21.15.72:0/3399368387 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:08.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.109+0000 7fba3a59c700 1 --2- 172.21.15.72:0/3399368387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba3c0613a0 0x7fba3c12a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:08.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.110+0000 7fba39d9b700 1 -- 172.21.15.72:0/3399368387 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba3c130250 msgr2=0x7fba3c114820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.110+0000 7fba39d9b700 1 --2- 172.21.15.72:0/3399368387 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba3c130250 0x7fba3c114820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.110+0000 7fba39d9b700 1 -- 172.21.15.72:0/3399368387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba3c0613a0 msgr2=0x7fba3c12a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.110+0000 7fba39d9b700 1 --2- 172.21.15.72:0/3399368387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba3c0613a0 0x7fba3c12a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.110+0000 7fba39d9b700 1 -- 172.21.15.72:0/3399368387 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c0092a0 con 0x7fba3c12b560 2023-10-03T10:10:08.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.110+0000 7fba3ad9d700 1 --2- 172.21.15.72:0/3399368387 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba3c130250 0x7fba3c114820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:08.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.110+0000 7fba39d9b700 1 --2- 172.21.15.72:0/3399368387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba3c12b560 0x7fba3c114330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fba2c00e9d0 tx=0x7fba2c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:08.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.110+0000 7fba2a7fc700 1 -- 172.21.15.72:0/3399368387 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c00c6a0 con 0x7fba3c12b560 2023-10-03T10:10:08.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.110+0000 7fba2a7fc700 1 -- 172.21.15.72:0/3399368387 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2c00c800 con 0x7fba3c12b560 2023-10-03T10:10:08.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.110+0000 7fba40d76700 1 -- 172.21.15.72:0/3399368387 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba34009a20 con 0x7fba3c12b560 2023-10-03T10:10:08.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.110+0000 7fba2a7fc700 1 -- 172.21.15.72:0/3399368387 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c00cb80 con 0x7fba3c12b560 2023-10-03T10:10:08.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.110+0000 7fba40d76700 1 -- 172.21.15.72:0/3399368387 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3c117910 con 0x7fba3c12b560 2023-10-03T10:10:08.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.111+0000 7fba2a7fc700 1 -- 172.21.15.72:0/3399368387 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fba2c01b400 con 0x7fba3c12b560 2023-10-03T10:10:08.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.111+0000 7fba2a7fc700 1 -- 172.21.15.72:0/3399368387 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fba2c03b590 con 0x7fba3c12b560 2023-10-03T10:10:08.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.111+0000 7fba40d76700 1 -- 172.21.15.72:0/3399368387 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3c117aa0 con 0x7fba3c12b560 2023-10-03T10:10:08.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.115+0000 7fba2a7fc700 1 -- 172.21.15.72:0/3399368387 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fba2c019900 con 0x7fba3c12b560 2023-10-03T10:10:08.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.310+0000 7fba40d76700 1 -- 172.21.15.72:0/3399368387 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fba3c117c80 con 0x7fba3c12b560 2023-10-03T10:10:08.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.978+0000 7fba2a7fc700 1 -- 172.21.15.72:0/3399368387 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7fba2c02a0b0 con 0x7fba3c12b560 2023-10-03T10:10:08.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.981+0000 7fba40d76700 1 -- 172.21.15.72:0/3399368387 >> v1:172.21.15.72:6816/118184 conn(0x7fba1c02bb60 legacy=0x7fba1c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.981+0000 7fba40d76700 1 -- 172.21.15.72:0/3399368387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba3c12b560 msgr2=0x7fba3c114330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:08.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.981+0000 7fba40d76700 1 --2- 172.21.15.72:0/3399368387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba3c12b560 0x7fba3c114330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fba2c00e9d0 tx=0x7fba2c009060).stop 2023-10-03T10:10:08.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.981+0000 7fba40d76700 1 -- 172.21.15.72:0/3399368387 shutdown_connections 2023-10-03T10:10:08.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.981+0000 7fba40d76700 1 --2- 172.21.15.72:0/3399368387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba3c0613a0 0x7fba3c12a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.981+0000 7fba40d76700 1 --2- 172.21.15.72:0/3399368387 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba3c130250 0x7fba3c114820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.981+0000 7fba40d76700 1 --2- 172.21.15.72:0/3399368387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba3c12b560 0x7fba3c114330 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:08.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.981+0000 7fba40d76700 1 -- 172.21.15.72:0/3399368387 >> 172.21.15.72:0/3399368387 conn(0x7fba3c09a1c0 msgr2=0x7fba3c12f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:08.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.981+0000 7fba40d76700 1 -- 172.21.15.72:0/3399368387 shutdown_connections 2023-10-03T10:10:08.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:08.981+0000 7fba40d76700 1 -- 172.21.15.72:0/3399368387 wait complete. 2023-10-03T10:10:08.997 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:10:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.120+0000 7f424c7d1700 1 Processor -- start 2023-10-03T10:10:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.120+0000 7f424c7d1700 1 -- start start 2023-10-03T10:10:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424c7d1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4244097780 0x7f424412fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424c7d1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4244130330 0x7f4244132720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424c7d1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4244065740 con 0x7f4244066200 2023-10-03T10:10:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424c7d1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42440665e0 con 0x7f4244130330 2023-10-03T10:10:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424c7d1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f424412ba10 con 0x7f4244097780 2023-10-03T10:10:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424ad6e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4244130330 0x7f4244132720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f4249d6c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4244097780 0x7f424412fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424a56d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4244066200 0x7f424412b300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55146/0 (socket says 172.21.15.72:55146) 2023-10-03T10:10:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424a56d700 1 -- 172.21.15.72:0/1682612538 learned_addr learned my addr 172.21.15.72:0/1682612538 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:10:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424ad6e700 1 -- 172.21.15.72:0/1682612538 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4244097780 msgr2=0x7f424412fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424ad6e700 1 --2- 172.21.15.72:0/1682612538 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4244097780 0x7f424412fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424ad6e700 1 -- 172.21.15.72:0/1682612538 >> v1:172.21.15.72:6789/0 conn(0x7f4244066200 legacy=0x7f424412b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424ad6e700 1 -- 172.21.15.72:0/1682612538 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4244064ef0 con 0x7f4244130330 2023-10-03T10:10:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424956b700 1 -- 172.21.15.72:0/1682612538 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550707239 0 0) 0x7f4244065740 con 0x7f4244066200 2023-10-03T10:10:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f4249d6c700 1 --2- 172.21.15.72:0/1682612538 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4244097780 0x7f424412fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424ad6e700 1 --2- 172.21.15.72:0/1682612538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4244130330 0x7f4244132720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f423c009e90 tx=0x7f423c009780).ready entity=mon.0 client_cookie=7c4f696191e36416 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424956b700 1 -- 172.21.15.72:0/1682612538 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c00e070 con 0x7f4244130330 2023-10-03T10:10:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424956b700 1 -- 172.21.15.72:0/1682612538 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c00bb20 con 0x7f4244130330 2023-10-03T10:10:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.121+0000 7f424956b700 1 -- 172.21.15.72:0/1682612538 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c00bea0 con 0x7f4244130330 2023-10-03T10:10:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.122+0000 7f424c7d1700 1 -- 172.21.15.72:0/1682612538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4244130330 msgr2=0x7f4244132720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.122+0000 7f424c7d1700 1 --2- 172.21.15.72:0/1682612538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4244130330 0x7f4244132720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f423c009e90 tx=0x7f423c009780).stop 2023-10-03T10:10:09.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.122+0000 7f424c7d1700 1 -- 172.21.15.72:0/1682612538 shutdown_connections 2023-10-03T10:10:09.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.122+0000 7f424c7d1700 1 --2- 172.21.15.72:0/1682612538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4244130330 0x7f4244132720 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.122+0000 7f424c7d1700 1 --2- 172.21.15.72:0/1682612538 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4244097780 0x7f424412fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.122+0000 7f424c7d1700 1 -- 172.21.15.72:0/1682612538 >> 172.21.15.72:0/1682612538 conn(0x7f424409ba50 msgr2=0x7f424409be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.122+0000 7f424c7d1700 1 -- 172.21.15.72:0/1682612538 shutdown_connections 2023-10-03T10:10:09.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.122+0000 7f424c7d1700 1 -- 172.21.15.72:0/1682612538 wait complete. 2023-10-03T10:10:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.123+0000 7f424c7d1700 1 Processor -- start 2023-10-03T10:10:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.123+0000 7f424c7d1700 1 -- start start 2023-10-03T10:10:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f424c7d1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4244066200 0x7f424413aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f424c7d1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4244097780 0x7f424413af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f424c7d1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4244130330 0x7f424412d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f424c7d1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244065120 con 0x7f4244097780 2023-10-03T10:10:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f424c7d1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4244124f40 con 0x7f4244066200 2023-10-03T10:10:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f424c7d1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4244130820 con 0x7f4244130330 2023-10-03T10:10:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f424a56d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4244066200 0x7f424413aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f424ad6e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4244130330 0x7f424412d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f4249d6c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4244097780 0x7f424413af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f424a56d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4244066200 0x7f424413aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40534/0 (socket says 172.21.15.72:40534) 2023-10-03T10:10:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f424ad6e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4244130330 0x7f424412d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36598/0 (socket says 172.21.15.72:36598) 2023-10-03T10:10:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f424a56d700 1 -- 172.21.15.72:0/3469593425 learned_addr learned my addr 172.21.15.72:0/3469593425 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f4249d6c700 1 -- 172.21.15.72:0/3469593425 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4244130330 msgr2=0x7f424412d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f4249d6c700 1 --2- 172.21.15.72:0/3469593425 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4244130330 0x7f424412d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f4249d6c700 1 -- 172.21.15.72:0/3469593425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4244066200 msgr2=0x7f424413aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f4249d6c700 1 --2- 172.21.15.72:0/3469593425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4244066200 0x7f424413aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f4249d6c700 1 -- 172.21.15.72:0/3469593425 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42400092a0 con 0x7f4244097780 2023-10-03T10:10:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f424a56d700 1 --2- 172.21.15.72:0/3469593425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4244066200 0x7f424413aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f4249d6c700 1 --2- 172.21.15.72:0/3469593425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4244097780 0x7f424413af70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f424000e950 tx=0x7f4240009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f423a7fc700 1 -- 172.21.15.72:0/3469593425 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240009580 con 0x7f4244097780 2023-10-03T10:10:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f423a7fc700 1 -- 172.21.15.72:0/3469593425 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4240012600 con 0x7f4244097780 2023-10-03T10:10:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f424c7d1700 1 -- 172.21.15.72:0/3469593425 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c009a20 con 0x7f4244097780 2023-10-03T10:10:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.124+0000 7f423a7fc700 1 -- 172.21.15.72:0/3469593425 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42400129c0 con 0x7f4244097780 2023-10-03T10:10:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.125+0000 7f424c7d1700 1 -- 172.21.15.72:0/3469593425 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424412f5d0 con 0x7f4244097780 2023-10-03T10:10:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.125+0000 7f423a7fc700 1 -- 172.21.15.72:0/3469593425 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4240012d30 con 0x7f4244097780 2023-10-03T10:10:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.125+0000 7f423a7fc700 1 -- 172.21.15.72:0/3469593425 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f424003b420 con 0x7f4244097780 2023-10-03T10:10:09.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.126+0000 7f424c7d1700 1 -- 172.21.15.72:0/3469593425 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f424405a260 con 0x7f4244097780 2023-10-03T10:10:09.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.130+0000 7f423a7fc700 1 -- 172.21.15.72:0/3469593425 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4240016070 con 0x7f4244097780 2023-10-03T10:10:09.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.326+0000 7f424c7d1700 1 -- 172.21.15.72:0/3469593425 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4244128ab0 con 0x7f4244097780 2023-10-03T10:10:09.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.326+0000 7f423a7fc700 1 -- 172.21.15.72:0/3469593425 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2154 (secure 0 0 0) 0x7f4240016020 con 0x7f4244097780 2023-10-03T10:10:09.327 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:10:09.327 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:46.344785+0000","modified":"2023-10-03T10:10:08.974385+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6817/542674768","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6817","nonce":542674768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:10:09.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.328+0000 7f424c7d1700 1 -- 172.21.15.72:0/3469593425 >> v1:172.21.15.72:6816/118184 conn(0x7f422802bb60 legacy=0x7f422802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.328+0000 7f424c7d1700 1 -- 172.21.15.72:0/3469593425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4244097780 msgr2=0x7f424413af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.328+0000 7f424c7d1700 1 --2- 172.21.15.72:0/3469593425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4244097780 0x7f424413af70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f424000e950 tx=0x7f4240009060).stop 2023-10-03T10:10:09.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.328+0000 7f424c7d1700 1 -- 172.21.15.72:0/3469593425 shutdown_connections 2023-10-03T10:10:09.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.328+0000 7f424c7d1700 1 --2- 172.21.15.72:0/3469593425 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4244130330 0x7f424412d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.328+0000 7f424c7d1700 1 --2- 172.21.15.72:0/3469593425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4244066200 0x7f424413aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.328+0000 7f424c7d1700 1 --2- 172.21.15.72:0/3469593425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4244097780 0x7f424413af70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.328+0000 7f424c7d1700 1 -- 172.21.15.72:0/3469593425 >> 172.21.15.72:0/3469593425 conn(0x7f424409ba50 msgr2=0x7f4244069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.328+0000 7f424c7d1700 1 -- 172.21.15.72:0/3469593425 shutdown_connections 2023-10-03T10:10:09.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.328+0000 7f424c7d1700 1 -- 172.21.15.72:0/3469593425 wait complete. 2023-10-03T10:10:09.330 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-10-03T10:10:09.440 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T10:09:46.344785+0000', 'modified': '2023-10-03T10:10:08.974385+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4187}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4187': {'gid': 4187, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6817/542674768', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.72:6817', 'nonce': 542674768}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-03T10:10:09.440 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T10:10:09.441 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T10:10:09.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.556+0000 7f0f0ac2c700 1 Processor -- start 2023-10-03T10:10:09.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.556+0000 7f0f0ac2c700 1 -- start start 2023-10-03T10:10:09.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.557+0000 7f0f0ac2c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f040977a0 0x7f0f0412fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.557+0000 7f0f0ac2c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0f04130330 0x7f0f04132720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.557+0000 7f0f0ac2c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f04065740 con 0x7f0f04066200 2023-10-03T10:10:09.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.557+0000 7f0f0ac2c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f040665e0 con 0x7f0f04130330 2023-10-03T10:10:09.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.557+0000 7f0f0ac2c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040653a0 con 0x7f0f040977a0 2023-10-03T10:10:09.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.557+0000 7f0f03fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f040977a0 0x7f0f0412fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.557+0000 7f0f03fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f040977a0 0x7f0f0412fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40542/0 (socket says 172.21.15.72:40542) 2023-10-03T10:10:09.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.557+0000 7f0f03fff700 1 -- 172.21.15.72:0/1308329600 learned_addr learned my addr 172.21.15.72:0/1308329600 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:09.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.557+0000 7f0f091c9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0f04130330 0x7f0f04132720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.557+0000 7f0f03fff700 1 -- 172.21.15.72:0/1308329600 >> v2:172.21.15.72:3300/0 conn(0x7f0f04130330 msgr2=0x7f0f04132720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.557+0000 7f0f03fff700 1 --2- 172.21.15.72:0/1308329600 >> v2:172.21.15.72:3300/0 conn(0x7f0f04130330 0x7f0f04132720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.557+0000 7f0f03fff700 1 -- 172.21.15.72:0/1308329600 >> v1:172.21.15.72:6789/0 conn(0x7f0f04066200 legacy=0x7f0f04127dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.557+0000 7f0f037fe700 1 -- 172.21.15.72:0/1308329600 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4016067668 0 0) 0x7f0f04065740 con 0x7f0f04066200 2023-10-03T10:10:09.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.557+0000 7f0f03fff700 1 -- 172.21.15.72:0/1308329600 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f04064ef0 con 0x7f0f040977a0 2023-10-03T10:10:09.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.557+0000 7f0f091c9700 1 --2- 172.21.15.72:0/1308329600 >> v2:172.21.15.72:3300/0 conn(0x7f0f04130330 0x7f0f04132720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.558+0000 7f0f03fff700 1 --2- 172.21.15.72:0/1308329600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f040977a0 0x7f0f0412fe40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f0ef0006fd0 tx=0x7f0ef00090f0).ready entity=mon.1 client_cookie=8e91d391556cfa58 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.558+0000 7f0f037fe700 1 -- 172.21.15.72:0/1308329600 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef000b580 con 0x7f0f040977a0 2023-10-03T10:10:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.558+0000 7f0f037fe700 1 -- 172.21.15.72:0/1308329600 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef000b6e0 con 0x7f0f040977a0 2023-10-03T10:10:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.558+0000 7f0f037fe700 1 -- 172.21.15.72:0/1308329600 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef000ba60 con 0x7f0f040977a0 2023-10-03T10:10:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.558+0000 7f0f0ac2c700 1 -- 172.21.15.72:0/1308329600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f040977a0 msgr2=0x7f0f0412fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.558+0000 7f0f0ac2c700 1 --2- 172.21.15.72:0/1308329600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f040977a0 0x7f0f0412fe40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f0ef0006fd0 tx=0x7f0ef00090f0).stop 2023-10-03T10:10:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.558+0000 7f0f0ac2c700 1 -- 172.21.15.72:0/1308329600 shutdown_connections 2023-10-03T10:10:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.558+0000 7f0f0ac2c700 1 --2- 172.21.15.72:0/1308329600 >> v2:172.21.15.72:3300/0 conn(0x7f0f04130330 0x7f0f04132720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.558+0000 7f0f0ac2c700 1 --2- 172.21.15.72:0/1308329600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f040977a0 0x7f0f0412fe40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.558+0000 7f0f0ac2c700 1 -- 172.21.15.72:0/1308329600 >> 172.21.15.72:0/1308329600 conn(0x7f0f0409ba50 msgr2=0x7f0f0409be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.558+0000 7f0f0ac2c700 1 -- 172.21.15.72:0/1308329600 shutdown_connections 2023-10-03T10:10:09.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.558+0000 7f0f0ac2c700 1 -- 172.21.15.72:0/1308329600 wait complete. 2023-10-03T10:10:09.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.559+0000 7f0f0ac2c700 1 Processor -- start 2023-10-03T10:10:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.559+0000 7f0f0ac2c700 1 -- start start 2023-10-03T10:10:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f0ac2c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f04066200 0x7f0f04113080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f0ac2c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f040977a0 0x7f0f0412cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f0ac2c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f04130330 0x7f0f0412d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f0ac2c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f04065120 con 0x7f0f040977a0 2023-10-03T10:10:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f0ac2c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f041128a0 con 0x7f0f04066200 2023-10-03T10:10:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f0ac2c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f04130090 con 0x7f0f04130330 2023-10-03T10:10:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f089c8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f04066200 0x7f0f04113080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f03fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f040977a0 0x7f0f0412cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f089c8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f04066200 0x7f0f04113080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40548/0 (socket says 172.21.15.72:40548) 2023-10-03T10:10:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f091c9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f04130330 0x7f0f0412d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f089c8700 1 -- 172.21.15.72:0/1312583060 learned_addr learned my addr 172.21.15.72:0/1312583060 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f03fff700 1 -- 172.21.15.72:0/1312583060 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f04130330 msgr2=0x7f0f0412d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f03fff700 1 --2- 172.21.15.72:0/1312583060 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f04130330 0x7f0f0412d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f03fff700 1 -- 172.21.15.72:0/1312583060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f04066200 msgr2=0x7f0f04113080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f03fff700 1 --2- 172.21.15.72:0/1312583060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f04066200 0x7f0f04113080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f03fff700 1 -- 172.21.15.72:0/1312583060 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc009a20 con 0x7f0f040977a0 2023-10-03T10:10:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f089c8700 1 --2- 172.21.15.72:0/1312583060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f04066200 0x7f0f04113080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f091c9700 1 --2- 172.21.15.72:0/1312583060 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f04130330 0x7f0f0412d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f03fff700 1 --2- 172.21.15.72:0/1312583060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f040977a0 0x7f0f0412cf00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f0ef0014000 tx=0x7f0ef0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f00ff9700 1 -- 172.21.15.72:0/1312583060 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef000b850 con 0x7f0f040977a0 2023-10-03T10:10:09.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f00ff9700 1 -- 172.21.15.72:0/1312583060 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef000b9b0 con 0x7f0f040977a0 2023-10-03T10:10:09.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f0ac2c700 1 -- 172.21.15.72:0/1312583060 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef0009370 con 0x7f0f040977a0 2023-10-03T10:10:09.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f00ff9700 1 -- 172.21.15.72:0/1312583060 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef001c670 con 0x7f0f040977a0 2023-10-03T10:10:09.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.560+0000 7f0f0ac2c700 1 -- 172.21.15.72:0/1312583060 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f04125160 con 0x7f0f040977a0 2023-10-03T10:10:09.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.561+0000 7f0f00ff9700 1 -- 172.21.15.72:0/1312583060 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0ef001ca60 con 0x7f0f040977a0 2023-10-03T10:10:09.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.561+0000 7f0f00ff9700 1 -- 172.21.15.72:0/1312583060 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f0ef003d000 con 0x7f0f040977a0 2023-10-03T10:10:09.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.564+0000 7f0f1c5dfb80 1 Processor -- start 2023-10-03T10:10:09.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.564+0000 7f0f1c5dfb80 1 -- start start 2023-10-03T10:10:09.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.564+0000 7f0f1c5dfb80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79170 0x564c2be79550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.564+0000 7f0f1c5dfb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2be79a40 0x564c2bea30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.564+0000 7f0f1c5dfb80 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2bea35b0 0x564c2bea59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.564+0000 7f0f1c5dfb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2be43610 con 0x564c2be79a40 2023-10-03T10:10:09.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.564+0000 7f0f1c5dfb80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c2bdb9db0 con 0x564c2be79170 2023-10-03T10:10:09.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.564+0000 7f0f1c5dfb80 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x564c2bdcf030 con 0x564c2bea35b0 2023-10-03T10:10:09.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.564+0000 7f0f089c8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79170 0x564c2be79550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.564+0000 7f0f089c8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79170 0x564c2be79550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40550/0 (socket says 172.21.15.72:40550) 2023-10-03T10:10:09.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.564+0000 7f0f089c8700 1 -- 172.21.15.72:0/1872623704 learned_addr learned my addr 172.21.15.72:0/1872623704 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:09.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.564+0000 7f0f091c9700 1 --2- 172.21.15.72:0/1872623704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2bea35b0 0x564c2bea59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.564+0000 7f0f03fff700 1 --2- 172.21.15.72:0/1872623704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2be79a40 0x564c2bea30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0f089c8700 1 -- 172.21.15.72:0/1872623704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2bea35b0 msgr2=0x564c2bea59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0f089c8700 1 --2- 172.21.15.72:0/1872623704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2bea35b0 0x564c2bea59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0f089c8700 1 -- 172.21.15.72:0/1872623704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2be79a40 msgr2=0x564c2bea30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0f089c8700 1 --2- 172.21.15.72:0/1872623704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2be79a40 0x564c2bea30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0f089c8700 1 -- 172.21.15.72:0/1872623704 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c2bc6a710 con 0x564c2be79170 2023-10-03T10:10:09.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0f089c8700 1 --2- 172.21.15.72:0/1872623704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79170 0x564c2be79550 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0ef80114d0 tx=0x7f0ef8007c20).ready entity=mon.1 client_cookie=79558858578077c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0eedffb700 1 -- 172.21.15.72:0/1872623704 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8015410 con 0x564c2be79170 2023-10-03T10:10:09.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0eedffb700 1 -- 172.21.15.72:0/1872623704 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef8015570 con 0x564c2be79170 2023-10-03T10:10:09.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0eedffb700 1 -- 172.21.15.72:0/1872623704 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80158f0 con 0x564c2be79170 2023-10-03T10:10:09.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1872623704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79170 msgr2=0x564c2be79550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/1872623704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79170 0x564c2be79550 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f0ef80114d0 tx=0x7f0ef8007c20).stop 2023-10-03T10:10:09.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1872623704 shutdown_connections 2023-10-03T10:10:09.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/1872623704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2bea35b0 0x564c2bea59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/1872623704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79170 0x564c2be79550 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/1872623704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2be79a40 0x564c2bea30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.565+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1872623704 >> 172.21.15.72:0/1872623704 conn(0x564c2bce7940 msgr2=0x564c2be99cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.566+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1872623704 shutdown_connections 2023-10-03T10:10:09.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.566+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1872623704 wait complete. 2023-10-03T10:10:09.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.566+0000 7f0f1c5dfb80 1 -- start start 2023-10-03T10:10:09.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.566+0000 7f0f1c5dfb80 1 Processor -- start 2023-10-03T10:10:09.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f1c5dfb80 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2be79170 0x564c2bea8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f1c5dfb80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79a40 0x564c2bea9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f1c5dfb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2bea35b0 0x564c2be9eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f1c5dfb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2bdcf170 con 0x564c2bea35b0 2023-10-03T10:10:09.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f1c5dfb80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c2bdcf3f0 con 0x564c2be79a40 2023-10-03T10:10:09.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f1c5dfb80 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x564c2bd9a920 con 0x564c2be79170 2023-10-03T10:10:09.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f1c5dfb80 10 client.0 ll_register_callbacks cb 0x564c2bd6fce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:10:09.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f03fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79a40 0x564c2bea9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f03fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79a40 0x564c2bea9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40554/0 (socket says 172.21.15.72:40554) 2023-10-03T10:10:09.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f03fff700 1 -- 172.21.15.72:0/703720993 learned_addr learned my addr 172.21.15.72:0/703720993 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:09.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f091c9700 1 --2- 172.21.15.72:0/703720993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2bea35b0 0x564c2be9eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f089c8700 1 --2- 172.21.15.72:0/703720993 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2be79170 0x564c2bea8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f03fff700 1 -- 172.21.15.72:0/703720993 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2be79170 msgr2=0x564c2bea8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f03fff700 1 --2- 172.21.15.72:0/703720993 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2be79170 0x564c2bea8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f03fff700 1 -- 172.21.15.72:0/703720993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2bea35b0 msgr2=0x564c2be9eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f03fff700 1 --2- 172.21.15.72:0/703720993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2bea35b0 0x564c2be9eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f03fff700 1 -- 172.21.15.72:0/703720993 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef8001d10 con 0x564c2be79a40 2023-10-03T10:10:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f091c9700 1 --2- 172.21.15.72:0/703720993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2bea35b0 0x564c2be9eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f03fff700 1 --2- 172.21.15.72:0/703720993 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79a40 0x564c2bea9170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0ef0009030 tx=0x7f0ef001d000).ready entity=mon.1 client_cookie=f43bbe032b844286 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0ee2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.72:3301/0 2023-10-03T10:10:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0ee2ffd700 1 -- 172.21.15.72:0/703720993 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0023360 con 0x564c2be79a40 2023-10-03T10:10:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0ee2ffd700 1 -- 172.21.15.72:0/703720993 <== mon.1 v2:172.21.15.72:3301/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f0ef0023d90 con 0x564c2be79a40 2023-10-03T10:10:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/703720993 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c2be71f20 con 0x564c2be79a40 2023-10-03T10:10:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0ee2ffd700 1 -- 172.21.15.72:0/703720993 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ef0010c50 con 0x564c2be79a40 2023-10-03T10:10:09.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f1c5dfb80 10 client.4561 fetch_fsmap learned FSMap version 7 2023-10-03T10:10:09.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.567+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/703720993 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x564c2bda1b00 con 0x564c2be79a40 2023-10-03T10:10:09.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.568+0000 7f0ee2ffd700 1 -- 172.21.15.72:0/703720993 <== mon.1 v2:172.21.15.72:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564c2be71f20 con 0x564c2be79a40 2023-10-03T10:10:09.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.568+0000 7f0ee2ffd700 1 -- 172.21.15.72:0/703720993 <== mon.1 v2:172.21.15.72:3301/0 5 ==== fsmap(e 7) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f0ef00103a0 con 0x564c2be79a40 2023-10-03T10:10:09.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.568+0000 7f0f1c5dfb80 10 client.4561 fetch_fsmap finished waiting for FSMap version 7 2023-10-03T10:10:09.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.568+0000 7f0f1c5dfb80 10 client.4561 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:10:09.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.568+0000 7f0f1c5dfb80 20 client.4561 populate_metadata read hostname 'smithi072' 2023-10-03T10:10:09.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.568+0000 7f0f1c5dfb80 4 client.4561 mds_command: new command op to 4187 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T10:10:09.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.568+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/703720993 --> v1:172.21.15.72:6817/542674768 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c2be47250 con 0x564c2be9f510 2023-10-03T10:10:09.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.568+0000 7f0ee2ffd700 10 client.4561 ms_handle_connect on v1:172.21.15.72:6817/542674768 2023-10-03T10:10:09.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.569+0000 7f0ee2ffd700 1 -- 172.21.15.72:0/703720993 <== mds.0 v1:172.21.15.72:6817/542674768 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x564c2be47250 con 0x564c2be9f510 2023-10-03T10:10:09.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.569+0000 7f0ee2ffd700 10 client.4561 handle_command_reply: tid=0 2023-10-03T10:10:09.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.569+0000 7f0f1c5dfb80 1 client.4561 shutdown 2023-10-03T10:10:09.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.569+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/703720993 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79a40 msgr2=0x564c2bea9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.569+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/703720993 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79a40 0x564c2bea9170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f0ef0009030 tx=0x7f0ef001d000).stop 2023-10-03T10:10:09.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.569+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/703720993 shutdown_connections 2023-10-03T10:10:09.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.569+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/703720993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2bea35b0 0x564c2be9eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.569+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/703720993 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2be79170 0x564c2bea8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.569+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/703720993 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79a40 0x564c2bea9170 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.569+0000 7f0ee2ffd700 0 client.4561 ms_handle_reset on v1:172.21.15.72:6817/542674768 2023-10-03T10:10:09.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.569+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/703720993 >> 172.21.15.72:0/703720993 conn(0x564c2bce7940 msgr2=0x564c2be99c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.569+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/703720993 shutdown_connections 2023-10-03T10:10:09.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.569+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/703720993 wait complete. 2023-10-03T10:10:09.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.569+0000 7f0f1c5dfb80 20 client.4561 trim_cache size 0 max 16384 2023-10-03T10:10:09.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.585+0000 7f0f1c5dfb80 1 Processor -- start 2023-10-03T10:10:09.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.585+0000 7f0f1c5dfb80 1 -- start start 2023-10-03T10:10:09.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f1c5dfb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2be79170 0x564c2bea1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f1c5dfb80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79a40 0x564c2be9f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f1c5dfb80 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2bea35b0 0x564c2beb4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f1c5dfb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2be9a830 con 0x564c2be79170 2023-10-03T10:10:09.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f1c5dfb80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c2be7cc20 con 0x564c2be79a40 2023-10-03T10:10:09.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f1c5dfb80 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x564c2be7a1c0 con 0x564c2bea35b0 2023-10-03T10:10:09.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f089c8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2be79170 0x564c2bea1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f03fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79a40 0x564c2be9f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f089c8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2be79170 0x564c2bea1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56386/0 (socket says 172.21.15.72:56386) 2023-10-03T10:10:09.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f089c8700 1 -- 172.21.15.72:0/1218301654 learned_addr learned my addr 172.21.15.72:0/1218301654 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:09.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f03fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79a40 0x564c2be9f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40556/0 (socket says 172.21.15.72:40556) 2023-10-03T10:10:09.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f091c9700 1 --2- 172.21.15.72:0/1218301654 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2bea35b0 0x564c2beb4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f03fff700 1 -- 172.21.15.72:0/1218301654 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2bea35b0 msgr2=0x564c2beb4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f03fff700 1 --2- 172.21.15.72:0/1218301654 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2bea35b0 0x564c2beb4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f03fff700 1 -- 172.21.15.72:0/1218301654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2be79170 msgr2=0x564c2bea1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f03fff700 1 --2- 172.21.15.72:0/1218301654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2be79170 0x564c2bea1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f03fff700 1 -- 172.21.15.72:0/1218301654 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c2bea19d0 con 0x564c2be79a40 2023-10-03T10:10:09.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f091c9700 1 --2- 172.21.15.72:0/1218301654 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2bea35b0 0x564c2beb4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f089c8700 1 --2- 172.21.15.72:0/1218301654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2be79170 0x564c2bea1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0f03fff700 1 --2- 172.21.15.72:0/1218301654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79a40 0x564c2be9f8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f0ef0025040 tx=0x7f0ef0036000).ready entity=mon.1 client_cookie=eb5c82895f8ddbce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0eee7fc700 1 -- 172.21.15.72:0/1218301654 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0023360 con 0x564c2be79a40 2023-10-03T10:10:09.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0eee7fc700 1 -- 172.21.15.72:0/1218301654 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef0035040 con 0x564c2be79a40 2023-10-03T10:10:09.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.586+0000 7f0eee7fc700 1 -- 172.21.15.72:0/1218301654 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0023720 con 0x564c2be79a40 2023-10-03T10:10:09.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.587+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1218301654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79a40 msgr2=0x564c2be9f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.587+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/1218301654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79a40 0x564c2be9f8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f0ef0025040 tx=0x7f0ef0036000).stop 2023-10-03T10:10:09.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.587+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1218301654 shutdown_connections 2023-10-03T10:10:09.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.587+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/1218301654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2be79170 0x564c2bea1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.587+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/1218301654 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2bea35b0 0x564c2beb4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.587+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/1218301654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79a40 0x564c2be9f8f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.587+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1218301654 >> 172.21.15.72:0/1218301654 conn(0x564c2bce7940 msgr2=0x564c2be75610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.587+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1218301654 shutdown_connections 2023-10-03T10:10:09.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.587+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1218301654 wait complete. 2023-10-03T10:10:09.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.587+0000 7f0f1c5dfb80 1 -- start start 2023-10-03T10:10:09.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f1c5dfb80 1 Processor -- start 2023-10-03T10:10:09.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f1c5dfb80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79170 0x564c2be9d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f1c5dfb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2bea35b0 0x564c2be9d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f1c5dfb80 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2be9de40 0x564c2befd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:09.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f1c5dfb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2bee1bc0 con 0x564c2bea35b0 2023-10-03T10:10:09.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f1c5dfb80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c2bea2a90 con 0x564c2be79170 2023-10-03T10:10:09.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f1c5dfb80 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x564c2be978d0 con 0x564c2be9de40 2023-10-03T10:10:09.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f1c5dfb80 10 client.0 ll_register_callbacks cb 0x564c2bd6fce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:10:09.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f089c8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79170 0x564c2be9d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f03fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2bea35b0 0x564c2be9d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f089c8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79170 0x564c2be9d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40564/0 (socket says 172.21.15.72:40564) 2023-10-03T10:10:09.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f089c8700 1 -- 172.21.15.72:0/1148036020 learned_addr learned my addr 172.21.15.72:0/1148036020 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:10:09.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f03fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2bea35b0 0x564c2be9d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56388/0 (socket says 172.21.15.72:56388) 2023-10-03T10:10:09.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f091c9700 1 --2- 172.21.15.72:0/1148036020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2be9de40 0x564c2befd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:09.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f089c8700 1 -- 172.21.15.72:0/1148036020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2be9de40 msgr2=0x564c2befd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f089c8700 1 --2- 172.21.15.72:0/1148036020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2be9de40 0x564c2befd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f089c8700 1 -- 172.21.15.72:0/1148036020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2bea35b0 msgr2=0x564c2be9d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:09.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f089c8700 1 --2- 172.21.15.72:0/1148036020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2bea35b0 0x564c2be9d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f089c8700 1 -- 172.21.15.72:0/1148036020 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0efc00ed30 con 0x564c2be79170 2023-10-03T10:10:09.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.588+0000 7f0f03fff700 1 --2- 172.21.15.72:0/1148036020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2bea35b0 0x564c2be9d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:09.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0f089c8700 1 --2- 172.21.15.72:0/1148036020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79170 0x564c2be9d460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0ef8012010 tx=0x7f0ef8018000).ready entity=mon.1 client_cookie=9675788e9aa82a91 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:09.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0ee2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.72:3301/0 2023-10-03T10:10:09.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0ee2ffd700 1 -- 172.21.15.72:0/1148036020 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80156e0 con 0x564c2be79170 2023-10-03T10:10:09.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0ee2ffd700 1 -- 172.21.15.72:0/1148036020 <== mon.1 v2:172.21.15.72:3301/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f0ef8015840 con 0x564c2be79170 2023-10-03T10:10:09.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1148036020 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0ef8015570 con 0x564c2be79170 2023-10-03T10:10:09.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0ee2ffd700 1 -- 172.21.15.72:0/1148036020 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ef80245d0 con 0x564c2be79170 2023-10-03T10:10:09.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0f1c5dfb80 10 client.4567 fetch_fsmap learned FSMap version 7 2023-10-03T10:10:09.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1148036020 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x564c2bda1b00 con 0x564c2be79170 2023-10-03T10:10:09.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0ee2ffd700 1 -- 172.21.15.72:0/1148036020 <== mon.1 v2:172.21.15.72:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef8015570 con 0x564c2be79170 2023-10-03T10:10:09.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0ee2ffd700 1 -- 172.21.15.72:0/1148036020 <== mon.1 v2:172.21.15.72:3301/0 5 ==== fsmap(e 7) v1 ==== 1430+0+0 (secure 0 0 0) 0x7f0ef8011500 con 0x564c2be79170 2023-10-03T10:10:09.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0f1c5dfb80 10 client.4567 fetch_fsmap finished waiting for FSMap version 7 2023-10-03T10:10:09.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0f1c5dfb80 10 client.4567 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:10:09.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0f1c5dfb80 20 client.4567 populate_metadata read hostname 'smithi072' 2023-10-03T10:10:09.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0f1c5dfb80 4 client.4567 mds_command: new command op to 4187 tid=0[{"prefix": "status"}] 2023-10-03T10:10:09.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1148036020 --> v1:172.21.15.72:6817/542674768 -- command(tid 0: {"prefix": "status"}) v1 -- 0x564c2bc37ef0 con 0x564c2bf04760 2023-10-03T10:10:09.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.589+0000 7f0ee2ffd700 10 client.4567 ms_handle_connect on v1:172.21.15.72:6817/542674768 2023-10-03T10:10:09.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0ee2ffd700 1 -- 172.21.15.72:0/1148036020 <== mds.0 v1:172.21.15.72:6817/542674768 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (unknown 0 0 1509314048) 0x564c2bc37ef0 con 0x564c2bf04760 2023-10-03T10:10:09.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0ee2ffd700 10 client.4567 handle_command_reply: tid=0 2023-10-03T10:10:09.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0f1c5dfb80 1 client.4567 shutdown 2023-10-03T10:10:09.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1148036020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79170 msgr2=0x564c2be9d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/1148036020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79170 0x564c2be9d460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0ef8012010 tx=0x7f0ef8018000).stop 2023-10-03T10:10:09.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1148036020 shutdown_connections 2023-10-03T10:10:09.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/1148036020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x564c2be9de40 0x564c2befd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/1148036020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x564c2be79170 0x564c2be9d460 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0f1c5dfb80 1 --2- 172.21.15.72:0/1148036020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x564c2bea35b0 0x564c2be9d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1148036020 >> 172.21.15.72:0/1148036020 conn(0x564c2bce7940 msgr2=0x564c2be77f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0ee2ffd700 0 client.4567 ms_handle_reset on v1:172.21.15.72:6817/542674768 2023-10-03T10:10:09.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1148036020 shutdown_connections 2023-10-03T10:10:09.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0f1c5dfb80 1 -- 172.21.15.72:0/1148036020 wait complete. 2023-10-03T10:10:09.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0f1c5dfb80 20 client.4567 trim_cache size 0 max 16384 2023-10-03T10:10:09.599 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-03T10:10:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "33894c9a-ea73-4e47-9ce0-b9e281957c98", 2023-10-03T10:10:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-10-03T10:10:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4187, 2023-10-03T10:10:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-10-03T10:10:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-10-03T10:10:09.599 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-10-03T10:10:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 23.244258833, 2023-10-03T10:10:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 7, 2023-10-03T10:10:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 18, 2023-10-03T10:10:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 18, 2023-10-03T10:10:09.600 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 27.550959472999999 2023-10-03T10:10:09.600 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-03T10:10:09.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0f0ac2c700 1 -- 172.21.15.72:0/1312583060 >> v1:172.21.15.72:6816/118184 conn(0x7f0ee802bb60 legacy=0x7f0ee802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0f0ac2c700 1 -- 172.21.15.72:0/1312583060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f040977a0 msgr2=0x7f0f0412cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:09.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.590+0000 7f0f0ac2c700 1 --2- 172.21.15.72:0/1312583060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f040977a0 0x7f0f0412cf00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f0ef0014000 tx=0x7f0ef0017000).stop 2023-10-03T10:10:09.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.591+0000 7f0f0ac2c700 1 -- 172.21.15.72:0/1312583060 shutdown_connections 2023-10-03T10:10:09.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.591+0000 7f0f0ac2c700 1 --2- 172.21.15.72:0/1312583060 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f04130330 0x7f0f0412d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.591+0000 7f0f0ac2c700 1 --2- 172.21.15.72:0/1312583060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f04066200 0x7f0f04113080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.591+0000 7f0f0ac2c700 1 --2- 172.21.15.72:0/1312583060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f040977a0 0x7f0f0412cf00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:09.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.591+0000 7f0f0ac2c700 1 -- 172.21.15.72:0/1312583060 >> 172.21.15.72:0/1312583060 conn(0x7f0f0409ba50 msgr2=0x7f0f041254e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:09.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.591+0000 7f0f0ac2c700 1 -- 172.21.15.72:0/1312583060 shutdown_connections 2023-10-03T10:10:09.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:10:09.591+0000 7f0f0ac2c700 1 -- 172.21.15.72:0/1312583060 wait complete. 2023-10-03T10:10:09.602 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:10:09.612 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2023-10-03T10:10:09.612 INFO:teuthology.run_tasks:Running task install.upgrade... 2023-10-03T10:10:09.635 INFO:teuthology.task.install:project ceph config {'mon.a': {'branch': 'reef'}} overrides {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-10-03T10:10:09.635 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2023-10-03T10:10:09.635 INFO:teuthology.task.install:remote ubuntu@smithi072.front.sepia.ceph.com config {'branch': 'reef', 'flavor': 'default'} 2023-10-03T10:10:09.635 INFO:teuthology.task.install:extra packages: [] 2023-10-03T10:10:09.641 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-03T10:10:09.641 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2023-10-03T10:10:09.641 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:10:09.664 INFO:teuthology.orchestra.run.smithi072.stdout:16.2.14-44.geeb13ac9.el8 2023-10-03T10:10:09.664 INFO:teuthology.packaging:The installed version of ceph-common is 16.2.14-44.geeb13ac9.el8 2023-10-03T10:10:09.664 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-03T10:10:09.875 INFO:teuthology.task.install:Ceph rpm upgrade from 16.2.14-44.geeb13ac9.el8 to 18.2.0-507.g7cd99ce4 2023-10-03T10:10:09.875 INFO:teuthology.task.install.rpm:Host smithi072 is: centos 8 x86_64 2023-10-03T10:10:09.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-03T10:10:10.177 INFO:teuthology.task.install.rpm:Repo base URL: https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/ 2023-10-03T10:10:10.177 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-10-03T10:10:10.382 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-03T10:10:10.382 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-03T10:10:10.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-03T10:10:10.413 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-03T10:10:10.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-03T10:10:10.553 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-03T10:10:10.612 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2023-10-03T10:10:10.624 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2023-10-03T10:10:10.895 INFO:teuthology.orchestra.run.smithi072.stdout:71 files removed 2023-10-03T10:10:10.924 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2023-10-03T10:10:11.841 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 160 kB/s | 80 kB 00:00 2023-10-03T10:10:12.376 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 19 kB/s | 9.4 kB 00:00 2023-10-03T10:10:13.020 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 2.4 kB/s | 1.5 kB 00:00 2023-10-03T10:10:14.345 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - AppStream 26 MB/s | 33 MB 00:01 2023-10-03T10:10:24.141 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 48 MB 00:03 2023-10-03T10:10:31.434 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras 80 kB/s | 18 kB 00:00 2023-10-03T10:10:31.886 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras common packages 25 kB/s | 6.9 kB 00:00 2023-10-03T10:10:32.973 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - PowerTools 6.9 MB/s | 6.5 MB 00:00 2023-10-03T10:10:34.459 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-10-03T10:10:36.372 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 16 MB 00:01 2023-10-03T10:10:40.181 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 500 kB/s | 24 kB 00:00 2023-10-03T10:10:44.431 INFO:teuthology.orchestra.run.smithi072.stderr:Package cephadm available, but not installed. 2023-10-03T10:10:44.432 INFO:teuthology.orchestra.run.smithi072.stdout:No match for argument: cephadm 2023-10-03T10:10:44.433 INFO:teuthology.orchestra.run.smithi072.stderr:Package ceph-immutable-object-cache available, but not installed. 2023-10-03T10:10:44.433 INFO:teuthology.orchestra.run.smithi072.stdout:No match for argument: ceph-immutable-object-cache 2023-10-03T10:10:44.445 INFO:teuthology.orchestra.run.smithi072.stderr:Package ceph-mgr-cephadm available, but not installed. 2023-10-03T10:10:44.445 INFO:teuthology.orchestra.run.smithi072.stdout:No match for argument: ceph-mgr-cephadm 2023-10-03T10:10:44.449 INFO:teuthology.orchestra.run.smithi072.stderr:Package ceph-volume available, but not installed. 2023-10-03T10:10:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:No match for argument: ceph-volume 2023-10-03T10:10:44.726 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-10-03T10:10:44.730 INFO:teuthology.orchestra.run.smithi072.stdout:====================================================================================== 2023-10-03T10:10:44.730 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2023-10-03T10:10:44.730 INFO:teuthology.orchestra.run.smithi072.stdout:====================================================================================== 2023-10-03T10:10:44.730 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2023-10-03T10:10:44.730 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 6.4 k 2023-10-03T10:10:44.730 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 5.4 M 2023-10-03T10:10:44.730 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 22 M 2023-10-03T10:10:44.731 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 847 k 2023-10-03T10:10:44.731 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 23 k 2023-10-03T10:10:44.731 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 2.3 M 2023-10-03T10:10:44.731 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 1.5 M 2023-10-03T10:10:44.731 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 1.7 M 2023-10-03T10:10:44.731 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 7.4 M 2023-10-03T10:10:44.731 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 241 k 2023-10-03T10:10:44.731 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 47 k 2023-10-03T10:10:44.731 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 4.6 M 2023-10-03T10:10:44.731 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 18 M 2023-10-03T10:10:44.731 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 15 k 2023-10-03T10:10:44.731 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 13 M 2023-10-03T10:10:44.732 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 24 k 2023-10-03T10:10:44.732 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 47 M 2023-10-03T10:10:44.732 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 30 k 2023-10-03T10:10:44.732 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 769 k 2023-10-03T10:10:44.732 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 137 k 2023-10-03T10:10:44.732 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 139 k 2023-10-03T10:10:44.733 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 3.7 M 2023-10-03T10:10:44.733 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 474 k 2023-10-03T10:10:44.733 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 3.6 M 2023-10-03T10:10:44.733 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 6.5 M 2023-10-03T10:10:44.733 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 45 k 2023-10-03T10:10:44.733 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 123 k 2023-10-03T10:10:44.733 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 190 k 2023-10-03T10:10:44.733 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 370 k 2023-10-03T10:10:44.733 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 364 k 2023-10-03T10:10:44.734 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 107 k 2023-10-03T10:10:44.734 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 94 k 2023-10-03T10:10:44.734 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 3.4 M 2023-10-03T10:10:44.734 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 179 k 2023-10-03T10:10:44.734 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2023-10-03T10:10:44.734 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-03T10:10:44.734 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:10:44.734 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-10-03T10:10:44.734 INFO:teuthology.orchestra.run.smithi072.stdout:====================================================================================== 2023-10-03T10:10:44.735 INFO:teuthology.orchestra.run.smithi072.stdout:Install 1 Package 2023-10-03T10:10:44.735 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 34 Packages 2023-10-03T10:10:44.735 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:10:44.735 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 145 M 2023-10-03T10:10:44.735 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-10-03T10:10:45.068 INFO:teuthology.orchestra.run.smithi072.stdout:(1/35): ceph-18.2.0-507.g7cd99ce4.el8.x86_64.rp 24 kB/s | 6.4 kB 00:00 2023-10-03T10:10:45.549 INFO:teuthology.orchestra.run.smithi072.stdout:(2/35): thrift-0.13.0-2.el8.x86_64.rpm 3.3 MB/s | 1.7 MB 00:00 2023-10-03T10:10:46.136 INFO:teuthology.orchestra.run.smithi072.stdout:(3/35): ceph-fuse-18.2.0-507.g7cd99ce4.el8.x86_ 1.0 MB/s | 847 kB 00:00 2023-10-03T10:10:46.895 INFO:teuthology.orchestra.run.smithi072.stdout:(4/35): ceph-mds-18.2.0-507.g7cd99ce4.el8.x86_6 3.0 MB/s | 2.3 MB 00:00 2023-10-03T10:10:47.004 INFO:teuthology.orchestra.run.smithi072.stdout:(5/35): ceph-base-18.2.0-507.g7cd99ce4.el8.x86_ 2.4 MB/s | 5.4 MB 00:02 2023-10-03T10:10:47.356 INFO:teuthology.orchestra.run.smithi072.stdout:(6/35): ceph-mgr-18.2.0-507.g7cd99ce4.el8.x86_6 3.4 MB/s | 1.5 MB 00:00 2023-10-03T10:10:48.457 INFO:teuthology.orchestra.run.smithi072.stdout:(7/35): ceph-mon-18.2.0-507.g7cd99ce4.el8.x86_6 3.2 MB/s | 4.6 MB 00:01 2023-10-03T10:10:52.582 INFO:teuthology.orchestra.run.smithi072.stdout:(8/35): ceph-radosgw-18.2.0-507.g7cd99ce4.el8.x 3.2 MB/s | 13 MB 00:04 2023-10-03T10:10:53.056 INFO:teuthology.orchestra.run.smithi072.stdout:(9/35): ceph-osd-18.2.0-507.g7cd99ce4.el8.x86_6 3.2 MB/s | 18 MB 00:05 2023-10-03T10:10:53.056 INFO:teuthology.orchestra.run.smithi072.stdout:(10/35): ceph-selinux-18.2.0-507.g7cd99ce4.el8. 75 kB/s | 24 kB 00:00 2023-10-03T10:10:53.056 INFO:teuthology.orchestra.run.smithi072.stdout:(11/35): libcephfs-devel-18.2.0-507.g7cd99ce4.e 729 kB/s | 30 kB 00:00 2023-10-03T10:10:53.126 INFO:teuthology.orchestra.run.smithi072.stdout:(12/35): libcephfs2-18.2.0-507.g7cd99ce4.el8.x8 4.3 MB/s | 769 kB 00:00 2023-10-03T10:10:53.202 INFO:teuthology.orchestra.run.smithi072.stdout:(13/35): libcephsqlite-18.2.0-507.g7cd99ce4.el8 1.8 MB/s | 137 kB 00:00 2023-10-03T10:10:53.277 INFO:teuthology.orchestra.run.smithi072.stdout:(14/35): librados-devel-18.2.0-507.g7cd99ce4.el 1.8 MB/s | 139 kB 00:00 2023-10-03T10:10:54.320 INFO:teuthology.orchestra.run.smithi072.stdout:(15/35): librados2-18.2.0-507.g7cd99ce4.el8.x86 3.5 MB/s | 3.7 MB 00:01 2023-10-03T10:10:54.478 INFO:teuthology.orchestra.run.smithi072.stdout:(16/35): libradosstriper1-18.2.0-507.g7cd99ce4. 2.9 MB/s | 474 kB 00:00 2023-10-03T10:10:55.346 INFO:teuthology.orchestra.run.smithi072.stdout:(17/35): librbd1-18.2.0-507.g7cd99ce4.el8.x86_6 4.1 MB/s | 3.6 MB 00:00 2023-10-03T10:10:56.965 INFO:teuthology.orchestra.run.smithi072.stdout:(18/35): librgw2-18.2.0-507.g7cd99ce4.el8.x86_6 4.0 MB/s | 6.5 MB 00:01 2023-10-03T10:10:57.023 INFO:teuthology.orchestra.run.smithi072.stdout:(19/35): python3-ceph-argparse-18.2.0-507.g7cd9 745 kB/s | 45 kB 00:00 2023-10-03T10:10:57.107 INFO:teuthology.orchestra.run.smithi072.stdout:(20/35): python3-ceph-common-18.2.0-507.g7cd99c 1.4 MB/s | 123 kB 00:00 2023-10-03T10:10:57.208 INFO:teuthology.orchestra.run.smithi072.stdout:(21/35): python3-cephfs-18.2.0-507.g7cd99ce4.el 1.8 MB/s | 190 kB 00:00 2023-10-03T10:10:57.325 INFO:teuthology.orchestra.run.smithi072.stdout:(22/35): python3-rados-18.2.0-507.g7cd99ce4.el8 3.1 MB/s | 370 kB 00:00 2023-10-03T10:10:57.726 INFO:teuthology.orchestra.run.smithi072.stdout:(23/35): python3-rbd-18.2.0-507.g7cd99ce4.el8.x 2.3 MB/s | 364 kB 00:00 2023-10-03T10:10:57.726 INFO:teuthology.orchestra.run.smithi072.stdout:(24/35): python3-rgw-18.2.0-507.g7cd99ce4.el8.x 1.5 MB/s | 107 kB 00:00 2023-10-03T10:10:57.726 INFO:teuthology.orchestra.run.smithi072.stdout:(25/35): rbd-fuse-18.2.0-507.g7cd99ce4.el8.x86_ 1.0 MB/s | 94 kB 00:00 2023-10-03T10:10:58.795 INFO:teuthology.orchestra.run.smithi072.stdout:(26/35): rbd-mirror-18.2.0-507.g7cd99ce4.el8.x8 3.0 MB/s | 3.4 MB 00:01 2023-10-03T10:10:58.887 INFO:teuthology.orchestra.run.smithi072.stdout:(27/35): rbd-nbd-18.2.0-507.g7cd99ce4.el8.x86_6 1.9 MB/s | 179 kB 00:00 2023-10-03T10:10:58.938 INFO:teuthology.orchestra.run.smithi072.stdout:(28/35): ceph-grafana-dashboards-18.2.0-507.g7c 460 kB/s | 23 kB 00:00 2023-10-03T10:10:59.422 INFO:teuthology.orchestra.run.smithi072.stdout:(29/35): ceph-mgr-dashboard-18.2.0-507.g7cd99ce 3.6 MB/s | 1.7 MB 00:00 2023-10-03T10:10:59.855 INFO:teuthology.orchestra.run.smithi072.stdout:(30/35): ceph-common-18.2.0-507.g7cd99ce4.el8.x 1.5 MB/s | 22 MB 00:14 2023-10-03T10:11:00.033 INFO:teuthology.orchestra.run.smithi072.stdout:(31/35): ceph-mgr-modules-core-18.2.0-507.g7cd9 1.3 MB/s | 241 kB 00:00 2023-10-03T10:11:00.117 INFO:teuthology.orchestra.run.smithi072.stdout:(32/35): ceph-mgr-rook-18.2.0-507.g7cd99ce4.el8 569 kB/s | 47 kB 00:00 2023-10-03T10:11:00.232 INFO:teuthology.orchestra.run.smithi072.stdout:(33/35): ceph-prometheus-alerts-18.2.0-507.g7cd 126 kB/s | 15 kB 00:00 2023-10-03T10:11:01.276 INFO:teuthology.orchestra.run.smithi072.stdout:(34/35): ceph-mgr-diskprediction-local-18.2.0-5 4.0 MB/s | 7.4 MB 00:01 2023-10-03T10:11:02.660 INFO:teuthology.orchestra.run.smithi072.stdout:(35/35): ceph-test-18.2.0-507.g7cd99ce4.el8.x86 4.8 MB/s | 47 MB 00:09 2023-10-03T10:11:02.663 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-10-03T10:11:02.663 INFO:teuthology.orchestra.run.smithi072.stdout:Total 8.1 MB/s | 145 MB 00:17 2023-10-03T10:11:02.664 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-10-03T10:11:02.734 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-10-03T10:11:02.735 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-10-03T10:11:03.403 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-10-03T10:11:03.406 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-10-03T10:11:05.632 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-10-03T10:11:05.819 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-10-03T10:11:06.369 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/69 2023-10-03T10:11:06.763 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2/69 2023-10-03T10:11:07.166 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2/69 2023-10-03T10:11:07.371 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 3/69 2023-10-03T10:11:07.494 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 3/69 2023-10-03T10:11:07.730 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 4/69 2023-10-03T10:11:08.617 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 4/69 2023-10-03T10:11:08.921 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 5/69 2023-10-03T10:11:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 5/69 2023-10-03T10:11:09.250 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : python3-rados-2:18.2.0-507.g7cd99ce4.el8.x86_64 6/69 2023-10-03T10:11:09.479 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 7/69 2023-10-03T10:11:09.591 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 7/69 2023-10-03T10:11:09.787 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 8/69 2023-10-03T10:11:09.857 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 8/69 2023-10-03T10:11:10.025 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : python3-ceph-argparse-2:18.2.0-507.g7cd99ce4.el8.x 9/69 2023-10-03T10:11:10.333 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : python3-cephfs-2:18.2.0-507.g7cd99ce4.el8.x86_64 10/69 2023-10-03T10:11:10.566 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : python3-rbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 11/69 2023-10-03T10:11:10.795 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : python3-rgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 12/69 2023-10-03T10:11:11.007 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 13/69 2023-10-03T10:11:11.126 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-prometheus-alerts-2:18.2.0-507.g7cd99ce4.el8. 14/69 2023-10-03T10:11:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-grafana-dashboards-2:18.2.0-507.g7cd99ce4.el8 15/69 2023-10-03T10:11:12.321 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : python3-ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86 16/69 2023-10-03T10:11:14.921 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 17/69 2023-10-03T10:11:15.190 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 17/69 2023-10-03T10:11:15.900 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 17/69 2023-10-03T10:11:16.211 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 18/69 2023-10-03T10:11:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 18/69 2023-10-03T10:11:16.439 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 19/69 2023-10-03T10:11:34.152 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 19/69 2023-10-03T10:11:34.400 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noar 20/69 2023-10-03T10:11:35.865 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noar 20/69 2023-10-03T10:11:36.062 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99c 21/69 2023-10-03T10:11:36.161 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99c 21/69 2023-10-03T10:11:36.539 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-mgr-modules-core-2:18.2.0-507.g7cd99ce4.el8.n 22/69 2023-10-03T10:11:36.834 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 23/69 2023-10-03T10:11:36.858 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 23/69 2023-10-03T10:11:37.025 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 24/69 2023-10-03T10:11:37.231 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 24/69 2023-10-03T10:11:37.493 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 25/69 2023-10-03T10:11:38.021 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 25/69 2023-10-03T10:11:38.335 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 26/69 2023-10-03T10:11:40.345 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 26/69 2023-10-03T10:11:40.708 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 27/69 2023-10-03T10:11:40.719 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 27/69 2023-10-03T10:11:42.374 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-2:18.2.0-507.g7cd99ce4.el8.x86_64 28/69 2023-10-03T10:11:42.708 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 29/69 2023-10-03T10:11:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 29/69 2023-10-03T10:11:43.545 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 30/69 2023-10-03T10:11:48.836 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 30/69 2023-10-03T10:11:49.155 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-test-2:18.2.0-507.g7cd99ce4.el8.x86_64 31/69 2023-10-03T10:11:49.350 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libcephfs-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 32/69 2023-10-03T10:11:49.566 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : rbd-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 33/69 2023-10-03T10:11:49.883 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : rbd-nbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 34/69 2023-10-03T10:11:50.196 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : ceph-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 35/69 2023-10-03T10:11:50.303 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 36/69 2023-10-03T10:11:50.542 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-10-03T10:11:50.551 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-03T10:11:50.552 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-03T10:11:50.825 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-03T10:11:50.970 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-10-03T10:11:50.970 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-10-03T10:11:51.204 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-10-03T10:11:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-03T10:11:51.211 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-03T10:11:51.429 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-03T10:11:51.599 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 42/69 2023-10-03T10:11:51.800 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 43/69 2023-10-03T10:11:51.807 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-03T10:11:51.808 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-03T10:11:52.051 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-03T10:11:52.208 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-10-03T10:11:52.209 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-10-03T10:11:52.437 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-10-03T10:11:52.619 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-10-03T10:11:52.627 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-03T10:11:52.628 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-03T10:11:53.032 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-03T10:11:53.032 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-10-03T10:11:53.267 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-10-03T10:11:53.272 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-03T10:11:53.273 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-03T10:11:53.453 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-03T10:11:53.459 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:11:53.459 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:11:53.678 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:11:53.678 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-10-03T10:11:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-10-03T10:11:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:11:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:11:54.228 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:11:54.228 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-10-03T10:11:54.467 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-10-03T10:11:54.467 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-03T10:11:54.701 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-03T10:11:54.942 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 56/69 2023-10-03T10:11:55.150 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-10-03T10:11:55.151 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-10-03T10:11:55.409 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-10-03T10:11:55.619 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 59/69 2023-10-03T10:11:55.620 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-10-03T10:11:55.903 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-10-03T10:11:56.094 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 61/69 2023-10-03T10:11:56.094 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-10-03T10:11:56.343 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-10-03T10:11:56.516 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 63/69 2023-10-03T10:11:56.669 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 64/69 2023-10-03T10:11:56.858 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 65/69 2023-10-03T10:11:56.991 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 66/69 2023-10-03T10:11:57.096 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 67/69 2023-10-03T10:11:57.096 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-10-03T10:11:57.245 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-10-03T10:11:57.245 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-10-03T10:11:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-10-03T10:11:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 1/69 2023-10-03T10:11:58.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:18.2.0-507.g7cd99ce4.el8.x86_64 2/69 2023-10-03T10:11:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 3/69 2023-10-03T10:11:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 4/69 2023-10-03T10:11:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 5/69 2023-10-03T10:11:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 6/69 2023-10-03T10:11:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 7/69 2023-10-03T10:11:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 8/69 2023-10-03T10:11:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 9/69 2023-10-03T10:11:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 10/69 2023-10-03T10:11:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 11/69 2023-10-03T10:11:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 12/69 2023-10-03T10:11:58.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 13/69 2023-10-03T10:11:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 14/69 2023-10-03T10:11:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 15/69 2023-10-03T10:11:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 16/69 2023-10-03T10:11:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 17/69 2023-10-03T10:11:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 18/69 2023-10-03T10:11:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 19/69 2023-10-03T10:11:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 20/69 2023-10-03T10:11:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 21/69 2023-10-03T10:11:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:18.2.0-507.g7cd99ce4.el8.x86_64 22/69 2023-10-03T10:11:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 23/69 2023-10-03T10:11:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 24/69 2023-10-03T10:11:58.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 25/69 2023-10-03T10:11:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 26/69 2023-10-03T10:11:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 27/69 2023-10-03T10:11:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 28/69 2023-10-03T10:11:58.077 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 29/69 2023-10-03T10:11:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 30/69 2023-10-03T10:11:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 31/69 2023-10-03T10:11:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 32/69 2023-10-03T10:11:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 33/69 2023-10-03T10:11:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 34/69 2023-10-03T10:11:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 35/69 2023-10-03T10:11:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 36/69 2023-10-03T10:11:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-10-03T10:11:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 38/69 2023-10-03T10:11:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-10-03T10:11:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:18.2.0-507.g7cd99ce4.el8.x 40/69 2023-10-03T10:11:58.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 41/69 2023-10-03T10:11:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86 42/69 2023-10-03T10:11:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 43/69 2023-10-03T10:11:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:18.2.0-507.g7cd99ce4.el8.x86_64 44/69 2023-10-03T10:11:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-10-03T10:11:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:18.2.0-507.g7cd99ce4.el8.x86_64 46/69 2023-10-03T10:11:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-10-03T10:11:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 48/69 2023-10-03T10:11:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 49/69 2023-10-03T10:11:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 50/69 2023-10-03T10:11:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:11:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 52/69 2023-10-03T10:11:58.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:11:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 54/69 2023-10-03T10:11:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-03T10:11:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 56/69 2023-10-03T10:11:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-10-03T10:11:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-507.g7cd99ce4.el8 58/69 2023-10-03T10:11:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 59/69 2023-10-03T10:11:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noar 60/69 2023-10-03T10:11:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 61/69 2023-10-03T10:11:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99c 62/69 2023-10-03T10:11:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 63/69 2023-10-03T10:11:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-507.g7cd99ce4.el8.n 64/69 2023-10-03T10:11:58.080 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 65/69 2023-10-03T10:11:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 66/69 2023-10-03T10:11:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 67/69 2023-10-03T10:11:58.081 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-507.g7cd99ce4.el8. 68/69 2023-10-03T10:11:59.876 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 69/69 2023-10-03T10:11:59.876 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:11:59.876 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2023-10-03T10:11:59.876 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.876 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.876 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.877 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.877 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:59.877 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.877 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.877 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:59.877 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:59.877 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:59.877 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:59.877 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.877 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.877 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:11:59.877 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.878 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.878 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.878 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.878 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.878 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.878 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.878 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.878 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.878 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.878 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.879 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.879 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.879 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.879 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.879 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.879 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.879 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.879 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.879 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:11:59.879 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2023-10-03T10:11:59.879 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-03T10:11:59.879 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:11:59.880 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-10-03T10:12:00.007 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-03T10:12:00.237 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:12:00.262 INFO:teuthology.orchestra.run.smithi072.stdout:18.2.0-507.g7cd99ce4.el8 2023-10-03T10:12:00.262 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-507.g7cd99ce4.el8 2023-10-03T10:12:00.262 INFO:teuthology.task.install:The correct ceph version 18.2.0-507.g7cd99ce4 is installed. 2023-10-03T10:12:00.262 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:12:00.272 INFO:teuthology.task.print:**** done install.upgrade the host 2023-10-03T10:12:00.272 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-03T10:12:00.309 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-03T10:12:00.309 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:00.319 INFO:tasks.ceph.mon.a:Stopped 2023-10-03T10:12:00.319 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-03T10:12:00.319 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-03T10:12:00.362 INFO:tasks.ceph.mon.a:Started 2023-10-03T10:12:00.362 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-03T10:12:00.362 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:00.373 INFO:tasks.ceph.mon.b:Stopped 2023-10-03T10:12:00.373 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-03T10:12:00.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-03T10:12:00.415 INFO:tasks.ceph.mon.b:Started 2023-10-03T10:12:00.416 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-03T10:12:00.416 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:00.429 INFO:tasks.ceph.mon.c:Stopped 2023-10-03T10:12:00.429 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-03T10:12:00.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-03T10:12:00.471 INFO:tasks.ceph.mon.c:Started 2023-10-03T10:12:00.472 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-03T10:12:00.472 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:00.497 INFO:tasks.ceph.mgr.x:Stopped 2023-10-03T10:12:00.497 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-03T10:12:00.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-03T10:12:00.539 INFO:tasks.ceph.mgr.x:Started 2023-10-03T10:12:00.540 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-10-03T10:12:00.549 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T10:12:00.549 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T10:12:00.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T10:12:00.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.674+0000 7f8b297c5700 1 Processor -- start 2023-10-03T10:12:00.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.674+0000 7f8b297c5700 1 -- start start 2023-10-03T10:12:00.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b297c5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8b2409d6f0 0x7f8b2409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b297c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b2409e000 0x7f8b24130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b297c5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2409f130 con 0x7f8b2409e410 2023-10-03T10:12:00.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b297c5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2409f520 con 0x7f8b2409d6f0 2023-10-03T10:12:00.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b297c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2409e930 con 0x7f8b2409e000 2023-10-03T10:12:00.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b22ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8b2409d6f0 0x7f8b2409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b237fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8b2409e410 0x7f8b24130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57458/0 (socket says 172.21.15.72:57458) 2023-10-03T10:12:00.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b227fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b2409e000 0x7f8b24130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b237fe700 1 -- 172.21.15.72:0/2264394304 learned_addr learned my addr 172.21.15.72:0/2264394304 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:00.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b22ffd700 1 -- 172.21.15.72:0/2264394304 >> v2:172.21.15.72:3300/0 conn(0x7f8b2409d6f0 msgr2=0x7f8b2409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-03T10:12:00.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b22ffd700 1 -- 172.21.15.72:0/2264394304 >> v2:172.21.15.72:3300/0 conn(0x7f8b2409d6f0 msgr2=0x7f8b2409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:12:00.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b22ffd700 1 --2- 172.21.15.72:0/2264394304 >> v2:172.21.15.72:3300/0 conn(0x7f8b2409d6f0 0x7f8b2409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:12:00.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b227fc700 1 -- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b2409e000 msgr2=0x7f8b24130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:12:00.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b227fc700 1 -- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b2409e000 msgr2=0x7f8b24130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:12:00.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b227fc700 1 --2- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b2409e000 0x7f8b24130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:12:00.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b22ffd700 1 --2- 172.21.15.72:0/2264394304 >> v2:172.21.15.72:3300/0 conn(0x7f8b2409d6f0 0x7f8b2409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:12:00.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.675+0000 7f8b227fc700 1 --2- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b2409e000 0x7f8b24130660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:12:00.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.730+0000 7f8b21ffb700 1 -- 172.21.15.72:0/2264394304 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181043233 0 0) 0x7f8b2409f130 con 0x7f8b2409e410 2023-10-03T10:12:00.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.730+0000 7f8b21ffb700 1 -- 172.21.15.72:0/2264394304 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b0c0035b0 con 0x7f8b2409e410 2023-10-03T10:12:00.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b21ffb700 1 -- 172.21.15.72:0/2264394304 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 97840582 0 0) 0x7f8b0c0035b0 con 0x7f8b2409e410 2023-10-03T10:12:00.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b21ffb700 1 -- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b2409e000 msgr2=0x7f8b24130660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:12:00.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b21ffb700 1 --2- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b2409e000 0x7f8b24130660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b21ffb700 1 -- 172.21.15.72:0/2264394304 >> v2:172.21.15.72:3300/0 conn(0x7f8b2409d6f0 msgr2=0x7f8b2409dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:12:00.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b21ffb700 1 --2- 172.21.15.72:0/2264394304 >> v2:172.21.15.72:3300/0 conn(0x7f8b2409d6f0 0x7f8b2409dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b21ffb700 1 -- 172.21.15.72:0/2264394304 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2409b2d0 con 0x7f8b2409e410 2023-10-03T10:12:00.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b21ffb700 1 -- 172.21.15.72:0/2264394304 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 244944926 0 0) 0x7f8b1c0019f0 con 0x7f8b2409e410 2023-10-03T10:12:00.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b21ffb700 1 -- 172.21.15.72:0/2264394304 >> v1:172.21.15.72:6789/0 conn(0x7f8b2409e410 legacy=0x7f8b24130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b21ffb700 1 --2- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b0c003a00 0x7f8b0c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b21ffb700 1 --2- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b0c004850 0x7f8b0c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b21ffb700 1 --2- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b2409e000 0x7f8b0c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b21ffb700 1 -- 172.21.15.72:0/2264394304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2409e930 con 0x7f8b0c003a00 2023-10-03T10:12:00.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b21ffb700 1 -- 172.21.15.72:0/2264394304 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c00fed0 con 0x7f8b2409e000 2023-10-03T10:12:00.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b21ffb700 1 -- 172.21.15.72:0/2264394304 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c010090 con 0x7f8b0c004850 2023-10-03T10:12:00.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b227fc700 1 --2- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b0c004850 0x7f8b0c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b22ffd700 1 --2- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b0c003a00 0x7f8b0c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b237fe700 1 --2- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b2409e000 0x7f8b0c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b227fc700 1 -- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b2409e000 msgr2=0x7f8b0c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:00.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b227fc700 1 --2- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b2409e000 0x7f8b0c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b227fc700 1 -- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b0c003a00 msgr2=0x7f8b0c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:00.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b227fc700 1 --2- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b0c003a00 0x7f8b0c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b227fc700 1 -- 172.21.15.72:0/2264394304 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c0035b0 con 0x7f8b0c004850 2023-10-03T10:12:00.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b237fe700 1 --2- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b2409e000 0x7f8b0c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:00.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.732+0000 7f8b227fc700 1 --2- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b0c004850 0x7f8b0c004cc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8b140095c0 tx=0x7f8b0c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebf211af9309af63 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:00.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.733+0000 7f8b21ffb700 1 -- 172.21.15.72:0/2264394304 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1400c070 con 0x7f8b0c004850 2023-10-03T10:12:00.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.733+0000 7f8b21ffb700 1 -- 172.21.15.72:0/2264394304 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b14017d10 con 0x7f8b0c004850 2023-10-03T10:12:00.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.733+0000 7f8b21ffb700 1 -- 172.21.15.72:0/2264394304 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b14004260 con 0x7f8b0c004850 2023-10-03T10:12:00.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.734+0000 7f8b297c5700 1 -- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b0c004850 msgr2=0x7f8b0c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.734+0000 7f8b297c5700 1 --2- 172.21.15.72:0/2264394304 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b0c004850 0x7f8b0c004cc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8b140095c0 tx=0x7f8b0c005880 comp rx=0 tx=0).stop 2023-10-03T10:12:00.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.734+0000 7f8b237fe700 1 -- 172.21.15.72:0/2264394304 reap_dead start 2023-10-03T10:12:00.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.734+0000 7f8b297c5700 1 -- 172.21.15.72:0/2264394304 shutdown_connections 2023-10-03T10:12:00.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.734+0000 7f8b297c5700 1 -- 172.21.15.72:0/2264394304 >> 172.21.15.72:0/2264394304 conn(0x7f8b24066f50 msgr2=0x7f8b2409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:00.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.734+0000 7f8b297c5700 1 -- 172.21.15.72:0/2264394304 shutdown_connections 2023-10-03T10:12:00.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.734+0000 7f8b297c5700 1 -- 172.21.15.72:0/2264394304 wait complete. 2023-10-03T10:12:00.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.735+0000 7f8b297c5700 1 Processor -- start 2023-10-03T10:12:00.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.736+0000 7f8b297c5700 1 -- start start 2023-10-03T10:12:00.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.736+0000 7f8b297c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b0c004850 0x7f8b2411ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.736+0000 7f8b297c5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b24121df0 0x7f8b2411e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.736+0000 7f8b297c5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b2411e850 0x7f8b241ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:00.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.736+0000 7f8b297c5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b241216b0 con 0x7f8b24121df0 2023-10-03T10:12:00.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.736+0000 7f8b297c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2411f9e0 con 0x7f8b0c004850 2023-10-03T10:12:00.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.736+0000 7f8b297c5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b24120c30 con 0x7f8b2411e850 2023-10-03T10:12:00.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.736+0000 7f8b22ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b0c004850 0x7f8b2411ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.736+0000 7f8b237fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b2411e850 0x7f8b241ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.736+0000 7f8b22ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b0c004850 0x7f8b2411ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54986/0 (socket says 172.21.15.72:54986) 2023-10-03T10:12:00.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.736+0000 7f8b237fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b2411e850 0x7f8b241ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:43314/0 (socket says 172.21.15.72:43314) 2023-10-03T10:12:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.736+0000 7f8b22ffd700 1 -- 172.21.15.72:0/142180062 learned_addr learned my addr 172.21.15.72:0/142180062 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.736+0000 7f8b227fc700 1 --2- 172.21.15.72:0/142180062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b24121df0 0x7f8b2411e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.737+0000 7f8b237fe700 1 -- 172.21.15.72:0/142180062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b0c004850 msgr2=0x7f8b2411ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.737+0000 7f8b237fe700 1 --2- 172.21.15.72:0/142180062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b0c004850 0x7f8b2411ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.737+0000 7f8b237fe700 1 -- 172.21.15.72:0/142180062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b24121df0 msgr2=0x7f8b2411e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.737+0000 7f8b237fe700 1 --2- 172.21.15.72:0/142180062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b24121df0 0x7f8b2411e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.737+0000 7f8b237fe700 1 -- 172.21.15.72:0/142180062 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2411ffa0 con 0x7f8b2411e850 2023-10-03T10:12:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.737+0000 7f8b22ffd700 1 --2- 172.21.15.72:0/142180062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b0c004850 0x7f8b2411ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.737+0000 7f8b227fc700 1 --2- 172.21.15.72:0/142180062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b24121df0 0x7f8b2411e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.737+0000 7f8b237fe700 1 --2- 172.21.15.72:0/142180062 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b2411e850 0x7f8b241ca450 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8b2409a4d0 tx=0x7f8b1c00e440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:00.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.737+0000 7f8b0b7fe700 1 -- 172.21.15.72:0/142180062 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c017070 con 0x7f8b2411e850 2023-10-03T10:12:00.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.737+0000 7f8b0b7fe700 1 -- 172.21.15.72:0/142180062 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c00ec20 con 0x7f8b2411e850 2023-10-03T10:12:00.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.737+0000 7f8b297c5700 1 -- 172.21.15.72:0/142180062 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b24121080 con 0x7f8b2411e850 2023-10-03T10:12:00.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.737+0000 7f8b0b7fe700 1 -- 172.21.15.72:0/142180062 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c00edb0 con 0x7f8b2411e850 2023-10-03T10:12:00.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.737+0000 7f8b297c5700 1 -- 172.21.15.72:0/142180062 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2409c700 con 0x7f8b2411e850 2023-10-03T10:12:00.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.738+0000 7f8b0b7fe700 1 -- 172.21.15.72:0/142180062 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f8b1c013420 con 0x7f8b2411e850 2023-10-03T10:12:00.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.738+0000 7f8b0b7fe700 1 -- 172.21.15.72:0/142180062 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f8b1c03b410 con 0x7f8b2411e850 2023-10-03T10:12:00.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.738+0000 7f8b22ffd700 1 -- 172.21.15.72:0/142180062 >> v1:172.21.15.72:6816/118184 conn(0x7f8b1002c1e0 legacy=0x7f8b1002e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:00.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.738+0000 7f8b297c5700 1 -- 172.21.15.72:0/142180062 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2411ac20 con 0x7f8b2411e850 2023-10-03T10:12:00.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.743+0000 7f8b0b7fe700 1 -- 172.21.15.72:0/142180062 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f8b1c0138b0 con 0x7f8b2411e850 2023-10-03T10:12:00.861 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:00.860+0000 7f6aece4b240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-03T10:12:00.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.939+0000 7f8b22ffd700 1 -- 172.21.15.72:0/142180062 >> v1:172.21.15.72:6816/118184 conn(0x7f8b1002c1e0 legacy=0x7f8b1002e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:00.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.960+0000 7f8b297c5700 1 -- 172.21.15.72:0/142180062 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8b24074ea0 con 0x7f8b2411e850 2023-10-03T10:12:00.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.962+0000 7f8b0b7fe700 1 -- 172.21.15.72:0/142180062 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+64282 (secure 0 0 0) 0x7f8b1c01b370 con 0x7f8b2411e850 2023-10-03T10:12:00.965 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:00.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.964+0000 7f8b297c5700 1 -- 172.21.15.72:0/142180062 >> v1:172.21.15.72:6816/118184 conn(0x7f8b1002c1e0 legacy=0x7f8b1002e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:00.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.964+0000 7f8b297c5700 1 -- 172.21.15.72:0/142180062 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b2411e850 msgr2=0x7f8b241ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:00.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.964+0000 7f8b297c5700 1 --2- 172.21.15.72:0/142180062 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b2411e850 0x7f8b241ca450 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8b2409a4d0 tx=0x7f8b1c00e440 comp rx=0 tx=0).stop 2023-10-03T10:12:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.965+0000 7f8b297c5700 1 -- 172.21.15.72:0/142180062 shutdown_connections 2023-10-03T10:12:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.965+0000 7f8b297c5700 1 --2- 172.21.15.72:0/142180062 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b2411e850 0x7f8b241ca450 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.965+0000 7f8b297c5700 1 --2- 172.21.15.72:0/142180062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b0c004850 0x7f8b2411ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.965+0000 7f8b297c5700 1 --2- 172.21.15.72:0/142180062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b24121df0 0x7f8b2411e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.965+0000 7f8b297c5700 1 -- 172.21.15.72:0/142180062 >> 172.21.15.72:0/142180062 conn(0x7f8b24066f50 msgr2=0x7f8b24130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.966+0000 7f8b297c5700 1 -- 172.21.15.72:0/142180062 shutdown_connections 2023-10-03T10:12:00.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:00.966+0000 7f8b297c5700 1 -- 172.21.15.72:0/142180062 wait complete. 2023-10-03T10:12:00.982 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6816","nonce":118184}]},"active_addr":"172.21.15.72:6816/118184","active_change":"2023-10-03T10:09:35.872842+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2966012812}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":3319279924}]}]} 2023-10-03T10:12:00.984 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T10:12:00.984 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:12:00.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:01.015 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:01.015+0000 7f6aece4b240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-03T10:12:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.121+0000 7fc9ce79e700 1 Processor -- start 2023-10-03T10:12:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.121+0000 7fc9ce79e700 1 -- start start 2023-10-03T10:12:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.121+0000 7fc9ce79e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c81316c0 0x7fc9c8131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.121+0000 7fc9ce79e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc9c806ae80 0x7fc9c8139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.121+0000 7fc9ce79e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c809e130 con 0x7fc9c809d9f0 2023-10-03T10:12:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.121+0000 7fc9ce79e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c81312b0 con 0x7fc9c806ae80 2023-10-03T10:12:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.121+0000 7fc9ce79e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c809f6e0 con 0x7fc9c81316c0 2023-10-03T10:12:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.121+0000 7fc9c7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c81316c0 0x7fc9c8131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.121+0000 7fc9c7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c81316c0 0x7fc9c8131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55006/0 (socket says 172.21.15.72:55006) 2023-10-03T10:12:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.121+0000 7fc9ccd3b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc9c806ae80 0x7fc9c8139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.122+0000 7fc9c7fff700 1 -- 172.21.15.72:0/2884748293 learned_addr learned my addr 172.21.15.72:0/2884748293 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:01.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.122+0000 7fc9c7fff700 1 -- 172.21.15.72:0/2884748293 >> v2:172.21.15.72:3300/0 conn(0x7fc9c806ae80 msgr2=0x7fc9c8139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.122+0000 7fc9c7fff700 1 --2- 172.21.15.72:0/2884748293 >> v2:172.21.15.72:3300/0 conn(0x7fc9c806ae80 0x7fc9c8139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.122+0000 7fc9c7fff700 1 -- 172.21.15.72:0/2884748293 >> v1:172.21.15.72:6789/0 conn(0x7fc9c809d9f0 legacy=0x7fc9c806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.122+0000 7fc9c7fff700 1 -- 172.21.15.72:0/2884748293 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c809e760 con 0x7fc9c81316c0 2023-10-03T10:12:01.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.122+0000 7fc9c7fff700 1 --2- 172.21.15.72:0/2884748293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c81316c0 0x7fc9c8131a90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80098f0 tx=0x7fc9b8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bb589ae47f386a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.122+0000 7fc9c6ffd700 1 -- 172.21.15.72:0/2884748293 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8011830 con 0x7fc9c81316c0 2023-10-03T10:12:01.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.122+0000 7fc9c6ffd700 1 -- 172.21.15.72:0/2884748293 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8011990 con 0x7fc9c81316c0 2023-10-03T10:12:01.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.122+0000 7fc9c6ffd700 1 -- 172.21.15.72:0/2884748293 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8011d20 con 0x7fc9c81316c0 2023-10-03T10:12:01.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.123+0000 7fc9ce79e700 1 -- 172.21.15.72:0/2884748293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c81316c0 msgr2=0x7fc9c8131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.123+0000 7fc9ce79e700 1 --2- 172.21.15.72:0/2884748293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c81316c0 0x7fc9c8131a90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80098f0 tx=0x7fc9b8009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:01.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.123+0000 7fc9ce79e700 1 -- 172.21.15.72:0/2884748293 shutdown_connections 2023-10-03T10:12:01.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.123+0000 7fc9ce79e700 1 --2- 172.21.15.72:0/2884748293 >> v2:172.21.15.72:3300/0 conn(0x7fc9c806ae80 0x7fc9c8139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.123+0000 7fc9ce79e700 1 --2- 172.21.15.72:0/2884748293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c81316c0 0x7fc9c8131a90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.123+0000 7fc9ce79e700 1 -- 172.21.15.72:0/2884748293 >> 172.21.15.72:0/2884748293 conn(0x7fc9c8066f50 msgr2=0x7fc9c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.123+0000 7fc9ce79e700 1 -- 172.21.15.72:0/2884748293 shutdown_connections 2023-10-03T10:12:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.123+0000 7fc9ce79e700 1 -- 172.21.15.72:0/2884748293 wait complete. 2023-10-03T10:12:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.124+0000 7fc9ce79e700 1 Processor -- start 2023-10-03T10:12:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.124+0000 7fc9ce79e700 1 -- start start 2023-10-03T10:12:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.124+0000 7fc9ce79e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9c806ae80 0x7fc9c8070a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.124+0000 7fc9ce79e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c809d9f0 0x7fc9c8070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.124+0000 7fc9ce79e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9c81316c0 0x7fc9c8071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.124+0000 7fc9ce79e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c812b900 con 0x7fc9c806ae80 2023-10-03T10:12:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.124+0000 7fc9ce79e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c8072670 con 0x7fc9c809d9f0 2023-10-03T10:12:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.124+0000 7fc9ce79e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c8119530 con 0x7fc9c81316c0 2023-10-03T10:12:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.124+0000 7fc9c7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9c806ae80 0x7fc9c8070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.124+0000 7fc9c77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c809d9f0 0x7fc9c8070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.124+0000 7fc9ccd3b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9c81316c0 0x7fc9c8071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.124+0000 7fc9c7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9c806ae80 0x7fc9c8070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50458/0 (socket says 172.21.15.72:50458) 2023-10-03T10:12:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.124+0000 7fc9c7fff700 1 -- 172.21.15.72:0/2254336599 learned_addr learned my addr 172.21.15.72:0/2254336599 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.125+0000 7fc9c7fff700 1 -- 172.21.15.72:0/2254336599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9c81316c0 msgr2=0x7fc9c8071510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.125+0000 7fc9c7fff700 1 --2- 172.21.15.72:0/2254336599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9c81316c0 0x7fc9c8071510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.125+0000 7fc9c7fff700 1 -- 172.21.15.72:0/2254336599 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c809d9f0 msgr2=0x7fc9c8070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.125+0000 7fc9c7fff700 1 --2- 172.21.15.72:0/2254336599 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c809d9f0 0x7fc9c8070fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.125+0000 7fc9c7fff700 1 -- 172.21.15.72:0/2254336599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b8009550 con 0x7fc9c806ae80 2023-10-03T10:12:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.125+0000 7fc9ccd3b700 1 --2- 172.21.15.72:0/2254336599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9c81316c0 0x7fc9c8071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.125+0000 7fc9c7fff700 1 --2- 172.21.15.72:0/2254336599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9c806ae80 0x7fc9c8070a90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8000c00 tx=0x7fc9b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.125+0000 7fc9c4ff9700 1 -- 172.21.15.72:0/2254336599 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80036a0 con 0x7fc9c806ae80 2023-10-03T10:12:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.125+0000 7fc9c4ff9700 1 -- 172.21.15.72:0/2254336599 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8003800 con 0x7fc9c806ae80 2023-10-03T10:12:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.125+0000 7fc9c4ff9700 1 -- 172.21.15.72:0/2254336599 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8003bb0 con 0x7fc9c806ae80 2023-10-03T10:12:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.125+0000 7fc9ce79e700 1 -- 172.21.15.72:0/2254336599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c80a3760 con 0x7fc9c806ae80 2023-10-03T10:12:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.125+0000 7fc9ce79e700 1 -- 172.21.15.72:0/2254336599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c811b690 con 0x7fc9c806ae80 2023-10-03T10:12:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.126+0000 7fc9c4ff9700 1 -- 172.21.15.72:0/2254336599 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fc9b8021070 con 0x7fc9c806ae80 2023-10-03T10:12:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.126+0000 7fc9c4ff9700 1 -- 172.21.15.72:0/2254336599 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fc9b803cc60 con 0x7fc9c806ae80 2023-10-03T10:12:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.126+0000 7fc9c77fe700 1 -- 172.21.15.72:0/2254336599 >> v1:172.21.15.72:6816/118184 conn(0x7fc9b402c1b0 legacy=0x7fc9b402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:01.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.126+0000 7fc9ce79e700 1 -- 172.21.15.72:0/2254336599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c8074ea0 con 0x7fc9c806ae80 2023-10-03T10:12:01.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.130+0000 7fc9c4ff9700 1 -- 172.21.15.72:0/2254336599 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fc9b8015070 con 0x7fc9c806ae80 2023-10-03T10:12:01.279 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:01.279+0000 7f6aece4b240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-03T10:12:01.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.300+0000 7fc9ce79e700 1 -- 172.21.15.72:0/2254336599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9c809e420 con 0x7fc9c806ae80 2023-10-03T10:12:01.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.301+0000 7fc9c4ff9700 1 -- 172.21.15.72:0/2254336599 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+12688 (secure 0 0 0) 0x7fc9b8015020 con 0x7fc9c806ae80 2023-10-03T10:12:01.302 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:01.302 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:10:37.646966+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":0}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":0}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:01.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.303+0000 7fc9ce79e700 1 -- 172.21.15.72:0/2254336599 >> v1:172.21.15.72:6816/118184 conn(0x7fc9b402c1b0 legacy=0x7fc9b402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:01.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.303+0000 7fc9ce79e700 1 -- 172.21.15.72:0/2254336599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9c806ae80 msgr2=0x7fc9c8070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.303+0000 7fc9ce79e700 1 --2- 172.21.15.72:0/2254336599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9c806ae80 0x7fc9c8070a90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8000c00 tx=0x7fc9b8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:01.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.303+0000 7fc9ce79e700 1 -- 172.21.15.72:0/2254336599 shutdown_connections 2023-10-03T10:12:01.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.303+0000 7fc9ce79e700 1 --2- 172.21.15.72:0/2254336599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9c806ae80 0x7fc9c8070a90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.303+0000 7fc9ce79e700 1 --2- 172.21.15.72:0/2254336599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9c81316c0 0x7fc9c8071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.303+0000 7fc9ce79e700 1 --2- 172.21.15.72:0/2254336599 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9c809d9f0 0x7fc9c8070fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.303+0000 7fc9ce79e700 1 -- 172.21.15.72:0/2254336599 >> 172.21.15.72:0/2254336599 conn(0x7fc9c8066f50 msgr2=0x7fc9c80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.303+0000 7fc9ce79e700 1 -- 172.21.15.72:0/2254336599 shutdown_connections 2023-10-03T10:12:01.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.303+0000 7fc9ce79e700 1 -- 172.21.15.72:0/2254336599 wait complete. 2023-10-03T10:12:01.318 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:12:01.319 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:01.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.483+0000 7ff5cd2f4700 1 Processor -- start 2023-10-03T10:12:01.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.483+0000 7ff5cd2f4700 1 -- start start 2023-10-03T10:12:01.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.483+0000 7ff5cd2f4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5c809f410 0x7ff5c8136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5cd2f4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5c8136fe0 0x7ff5c81393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5cd2f4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c8070940 con 0x7ff5c809e930 2023-10-03T10:12:01.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5cd2f4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c806fd60 con 0x7ff5c8136fe0 2023-10-03T10:12:01.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5cd2f4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c806fa80 con 0x7ff5c809f410 2023-10-03T10:12:01.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5c67fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5c809f410 0x7ff5c8136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5c77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5c8136fe0 0x7ff5c81393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5c6ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff5c809e930 0x7ff5c809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57474/0 (socket says 172.21.15.72:57474) 2023-10-03T10:12:01.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5c6ffd700 1 -- 172.21.15.72:0/3150294838 learned_addr learned my addr 172.21.15.72:0/3150294838 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:01.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5c77fe700 1 -- 172.21.15.72:0/3150294838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5c809f410 msgr2=0x7ff5c8136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5c77fe700 1 --2- 172.21.15.72:0/3150294838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5c809f410 0x7ff5c8136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5c77fe700 1 -- 172.21.15.72:0/3150294838 >> v1:172.21.15.72:6789/0 conn(0x7ff5c809e930 legacy=0x7ff5c809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5c77fe700 1 -- 172.21.15.72:0/3150294838 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c809fb60 con 0x7ff5c8136fe0 2023-10-03T10:12:01.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5c5ffb700 1 -- 172.21.15.72:0/3150294838 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321438646 0 0) 0x7ff5c8070940 con 0x7ff5c809e930 2023-10-03T10:12:01.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5c67fc700 1 --2- 172.21.15.72:0/3150294838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5c809f410 0x7ff5c8136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5c77fe700 1 --2- 172.21.15.72:0/3150294838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5c8136fe0 0x7ff5c81393c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0009d90 tx=0x7ff5c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a283d47c6ff024d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5c5ffb700 1 -- 172.21.15.72:0/3150294838 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c000e070 con 0x7ff5c8136fe0 2023-10-03T10:12:01.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5c5ffb700 1 -- 172.21.15.72:0/3150294838 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c000bb20 con 0x7ff5c8136fe0 2023-10-03T10:12:01.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.484+0000 7ff5c5ffb700 1 -- 172.21.15.72:0/3150294838 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0012430 con 0x7ff5c8136fe0 2023-10-03T10:12:01.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.485+0000 7ff5cd2f4700 1 -- 172.21.15.72:0/3150294838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5c8136fe0 msgr2=0x7ff5c81393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.485+0000 7ff5cd2f4700 1 --2- 172.21.15.72:0/3150294838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5c8136fe0 0x7ff5c81393c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0009d90 tx=0x7ff5c000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:01.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.485+0000 7ff5cd2f4700 1 -- 172.21.15.72:0/3150294838 shutdown_connections 2023-10-03T10:12:01.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.485+0000 7ff5cd2f4700 1 --2- 172.21.15.72:0/3150294838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5c8136fe0 0x7ff5c81393c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.485+0000 7ff5cd2f4700 1 --2- 172.21.15.72:0/3150294838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5c809f410 0x7ff5c8136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.485+0000 7ff5cd2f4700 1 -- 172.21.15.72:0/3150294838 >> 172.21.15.72:0/3150294838 conn(0x7ff5c80a4210 msgr2=0x7ff5c80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.485+0000 7ff5cd2f4700 1 -- 172.21.15.72:0/3150294838 shutdown_connections 2023-10-03T10:12:01.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.485+0000 7ff5cd2f4700 1 -- 172.21.15.72:0/3150294838 wait complete. 2023-10-03T10:12:01.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.486+0000 7ff5cd2f4700 1 Processor -- start 2023-10-03T10:12:01.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.486+0000 7ff5cd2f4700 1 -- start start 2023-10-03T10:12:01.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.486+0000 7ff5cd2f4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff5c809e930 0x7ff5c81c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.486+0000 7ff5cd2f4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5c809f410 0x7ff5c81c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.486+0000 7ff5cd2f4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5c8136fe0 0x7ff5c806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.486+0000 7ff5cd2f4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c8132560 con 0x7ff5c8136fe0 2023-10-03T10:12:01.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.486+0000 7ff5cd2f4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c806d640 con 0x7ff5c809f410 2023-10-03T10:12:01.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.486+0000 7ff5cd2f4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c8120a50 con 0x7ff5c809e930 2023-10-03T10:12:01.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5c67fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5c809f410 0x7ff5c81c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5c6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff5c809e930 0x7ff5c81c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5c67fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5c809f410 0x7ff5c81c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55038/0 (socket says 172.21.15.72:55038) 2023-10-03T10:12:01.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5c67fc700 1 -- 172.21.15.72:0/1642140947 learned_addr learned my addr 172.21.15.72:0/1642140947 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:01.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5c77fe700 1 --2- 172.21.15.72:0/1642140947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5c8136fe0 0x7ff5c806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5c67fc700 1 -- 172.21.15.72:0/1642140947 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff5c809e930 msgr2=0x7ff5c81c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5c67fc700 1 --2- 172.21.15.72:0/1642140947 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff5c809e930 0x7ff5c81c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5c67fc700 1 -- 172.21.15.72:0/1642140947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5c8136fe0 msgr2=0x7ff5c806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5c67fc700 1 --2- 172.21.15.72:0/1642140947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5c8136fe0 0x7ff5c806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5c67fc700 1 -- 172.21.15.72:0/1642140947 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0094a0 con 0x7ff5c809f410 2023-10-03T10:12:01.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5c6ffd700 1 --2- 172.21.15.72:0/1642140947 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff5c809e930 0x7ff5c81c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5c77fe700 1 --2- 172.21.15.72:0/1642140947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5c8136fe0 0x7ff5c806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5c67fc700 1 --2- 172.21.15.72:0/1642140947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5c809f410 0x7ff5c81c8a60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00ec10 tx=0x7ff5bc00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5af7fe700 1 -- 172.21.15.72:0/1642140947 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00c850 con 0x7ff5c809f410 2023-10-03T10:12:01.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5af7fe700 1 -- 172.21.15.72:0/1642140947 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc00c9b0 con 0x7ff5c809f410 2023-10-03T10:12:01.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5cd2f4700 1 -- 172.21.15.72:0/1642140947 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c0009a70 con 0x7ff5c809f410 2023-10-03T10:12:01.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5af7fe700 1 -- 172.21.15.72:0/1642140947 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00cd20 con 0x7ff5c809f410 2023-10-03T10:12:01.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.487+0000 7ff5cd2f4700 1 -- 172.21.15.72:0/1642140947 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c81c8fa0 con 0x7ff5c809f410 2023-10-03T10:12:01.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.488+0000 7ff5af7fe700 1 -- 172.21.15.72:0/1642140947 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7ff5bc013470 con 0x7ff5c809f410 2023-10-03T10:12:01.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.488+0000 7ff5af7fe700 1 -- 172.21.15.72:0/1642140947 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7ff5bc03bc70 con 0x7ff5c809f410 2023-10-03T10:12:01.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.488+0000 7ff5c6ffd700 1 -- 172.21.15.72:0/1642140947 >> v1:172.21.15.72:6816/118184 conn(0x7ff5b402c1b0 legacy=0x7ff5b402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:01.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.488+0000 7ff5cd2f4700 1 -- 172.21.15.72:0/1642140947 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c8071d20 con 0x7ff5c809f410 2023-10-03T10:12:01.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.493+0000 7ff5af7fe700 1 -- 172.21.15.72:0/1642140947 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7ff5bc017080 con 0x7ff5c809f410 2023-10-03T10:12:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.662+0000 7ff5cd2f4700 1 -- 172.21.15.72:0/1642140947 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5c8074ea0 con 0x7ff5c809f410 2023-10-03T10:12:01.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.663+0000 7ff5af7fe700 1 -- 172.21.15.72:0/1642140947 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+12688 (secure 0 0 0) 0x7ff5bc013720 con 0x7ff5c809f410 2023-10-03T10:12:01.663 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:01.664 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":20,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:10:37.646966+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":0}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":0}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.666+0000 7ff5cd2f4700 1 -- 172.21.15.72:0/1642140947 >> v1:172.21.15.72:6816/118184 conn(0x7ff5b402c1b0 legacy=0x7ff5b402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.666+0000 7ff5cd2f4700 1 -- 172.21.15.72:0/1642140947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5c809f410 msgr2=0x7ff5c81c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.666+0000 7ff5cd2f4700 1 --2- 172.21.15.72:0/1642140947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5c809f410 0x7ff5c81c8a60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00ec10 tx=0x7ff5bc00ef20 comp rx=0 tx=0).stop 2023-10-03T10:12:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.666+0000 7ff5cd2f4700 1 -- 172.21.15.72:0/1642140947 shutdown_connections 2023-10-03T10:12:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.666+0000 7ff5cd2f4700 1 --2- 172.21.15.72:0/1642140947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5c8136fe0 0x7ff5c806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.666+0000 7ff5cd2f4700 1 --2- 172.21.15.72:0/1642140947 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff5c809e930 0x7ff5c81c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.666+0000 7ff5cd2f4700 1 --2- 172.21.15.72:0/1642140947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5c809f410 0x7ff5c81c8a60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.666+0000 7ff5cd2f4700 1 -- 172.21.15.72:0/1642140947 >> 172.21.15.72:0/1642140947 conn(0x7ff5c80a4210 msgr2=0x7ff5c8134990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.666+0000 7ff5cd2f4700 1 -- 172.21.15.72:0/1642140947 shutdown_connections 2023-10-03T10:12:01.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.666+0000 7ff5cd2f4700 1 -- 172.21.15.72:0/1642140947 wait complete. 2023-10-03T10:12:01.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T10:12:01.680 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T10:12:01.680 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T10:12:01.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T10:12:01.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.817+0000 7f55c5391700 1 Processor -- start 2023-10-03T10:12:01.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.817+0000 7f55c5391700 1 -- start start 2023-10-03T10:12:01.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.818+0000 7f55c5391700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f55c012cf60 0x7f55c006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.818+0000 7f55c5391700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55c012f8b0 0x7f55c012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.818+0000 7f55c5391700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c012cd90 con 0x7f55c0130260 2023-10-03T10:12:01.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.818+0000 7f55c5391700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c012d330 con 0x7f55c012cf60 2023-10-03T10:12:01.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.818+0000 7f55c5391700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55c01306d0 con 0x7f55c012f8b0 2023-10-03T10:12:01.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.819+0000 7f2bb8065700 1 Processor -- start 2023-10-03T10:12:01.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.818+0000 7f55beffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f55c012cf60 0x7f55c006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.818+0000 7f55beffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f55c012cf60 0x7f55c006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50476/0 (socket says 172.21.15.72:50476) 2023-10-03T10:12:01.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.818+0000 7f55beffd700 1 -- 172.21.15.72:0/1557424351 learned_addr learned my addr 172.21.15.72:0/1557424351 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:01.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.818+0000 7f55be7fc700 1 --2- 172.21.15.72:0/1557424351 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55c012f8b0 0x7f55c012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.818+0000 7f55beffd700 1 -- 172.21.15.72:0/1557424351 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55c012f8b0 msgr2=0x7f55c012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.818+0000 7f55beffd700 1 --2- 172.21.15.72:0/1557424351 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55c012f8b0 0x7f55c012fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.819+0000 7f55beffd700 1 -- 172.21.15.72:0/1557424351 >> v1:172.21.15.72:6789/0 conn(0x7f55c0130260 legacy=0x7f55c0136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.819+0000 7f55beffd700 1 -- 172.21.15.72:0/1557424351 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c0071780 con 0x7f55c012cf60 2023-10-03T10:12:01.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.819+0000 7f55beffd700 1 --2- 172.21.15.72:0/1557424351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c012cf60 0x7f55c006f5d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f55b000b9a0 tx=0x7f55b000bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34967e123604a217 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.819+0000 7f55bdffb700 1 -- 172.21.15.72:0/1557424351 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b000cb60 con 0x7f55c012cf60 2023-10-03T10:12:01.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.819+0000 7f55bdffb700 1 -- 172.21.15.72:0/1557424351 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b000ccc0 con 0x7f55c012cf60 2023-10-03T10:12:01.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.819+0000 7f55bdffb700 1 -- 172.21.15.72:0/1557424351 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0004270 con 0x7f55c012cf60 2023-10-03T10:12:01.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.819+0000 7f2bb8065700 1 -- start start 2023-10-03T10:12:01.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f2bb8065700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bb009eca0 0x7f2bb013cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f2bb8065700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2bb006f050 0x7f2bb013f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f2bb8065700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb0070ee0 con 0x7f2bb006e570 2023-10-03T10:12:01.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f2bb8065700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb0071980 con 0x7f2bb006f050 2023-10-03T10:12:01.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f2bb8065700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb0071480 con 0x7f2bb009eca0 2023-10-03T10:12:01.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f55c5391700 1 -- 172.21.15.72:0/1557424351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c012cf60 msgr2=0x7f55c006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f55c5391700 1 --2- 172.21.15.72:0/1557424351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c012cf60 0x7f55c006f5d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f55b000b9a0 tx=0x7f55b000bcb0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f55c5391700 1 -- 172.21.15.72:0/1557424351 shutdown_connections 2023-10-03T10:12:01.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f55c5391700 1 --2- 172.21.15.72:0/1557424351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c012cf60 0x7f55c006f5d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f55c5391700 1 --2- 172.21.15.72:0/1557424351 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55c012f8b0 0x7f55c012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f55c5391700 1 -- 172.21.15.72:0/1557424351 >> 172.21.15.72:0/1557424351 conn(0x7f55c00a2aa0 msgr2=0x7f55c00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f55c5391700 1 -- 172.21.15.72:0/1557424351 shutdown_connections 2023-10-03T10:12:01.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f55c5391700 1 -- 172.21.15.72:0/1557424351 wait complete. 2023-10-03T10:12:01.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f2bb5e01700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2bb006e570 0x7f2bb006e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57492/0 (socket says 172.21.15.72:57492) 2023-10-03T10:12:01.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f2bb5e01700 1 -- 172.21.15.72:0/352406219 learned_addr learned my addr 172.21.15.72:0/352406219 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:01.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f2bb6602700 1 --2- 172.21.15.72:0/352406219 >> v2:172.21.15.72:3300/0 conn(0x7f2bb006f050 0x7f2bb013f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.820+0000 7f2bb5600700 1 --2- 172.21.15.72:0/352406219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bb009eca0 0x7f2bb013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.821+0000 7f2bb6602700 1 -- 172.21.15.72:0/352406219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bb009eca0 msgr2=0x7f2bb013cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.821+0000 7f2bb6602700 1 --2- 172.21.15.72:0/352406219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bb009eca0 0x7f2bb013cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.821+0000 7f2bb6602700 1 -- 172.21.15.72:0/352406219 >> v1:172.21.15.72:6789/0 conn(0x7f2bb006e570 legacy=0x7f2bb006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.821+0000 7f2bb6602700 1 -- 172.21.15.72:0/352406219 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb0071b90 con 0x7f2bb006f050 2023-10-03T10:12:01.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.821+0000 7f2bb5600700 1 --2- 172.21.15.72:0/352406219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bb009eca0 0x7f2bb013cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.821+0000 7f2bb6602700 1 --2- 172.21.15.72:0/352406219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bb006f050 0x7f2bb013f3f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009d90 tx=0x7f2ba800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ffcc411976852db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.821+0000 7f2bb4dff700 1 -- 172.21.15.72:0/352406219 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba800e070 con 0x7f2bb006f050 2023-10-03T10:12:01.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.821+0000 7f2bb4dff700 1 -- 172.21.15.72:0/352406219 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba8003a20 con 0x7f2bb006f050 2023-10-03T10:12:01.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.821+0000 7f2bb4dff700 1 -- 172.21.15.72:0/352406219 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8003dd0 con 0x7f2bb006f050 2023-10-03T10:12:01.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.821+0000 7f55c5391700 1 Processor -- start 2023-10-03T10:12:01.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.821+0000 7f55c5391700 1 -- start start 2023-10-03T10:12:01.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f2bb8065700 1 -- 172.21.15.72:0/352406219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bb006f050 msgr2=0x7f2bb013f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f2bb8065700 1 --2- 172.21.15.72:0/352406219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bb006f050 0x7f2bb013f3f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009d90 tx=0x7f2ba800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:01.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f55c5391700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55c012cf60 0x7f55c009b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f2bb8065700 1 -- 172.21.15.72:0/352406219 shutdown_connections 2023-10-03T10:12:01.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f2bb8065700 1 --2- 172.21.15.72:0/352406219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bb006f050 0x7f2bb013f3f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f2bb8065700 1 --2- 172.21.15.72:0/352406219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bb009eca0 0x7f2bb013cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f2bb8065700 1 -- 172.21.15.72:0/352406219 >> 172.21.15.72:0/352406219 conn(0x7f2bb00a2aa0 msgr2=0x7f2bb00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f55c5391700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55c012f8b0 0x7f55c009b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f55c5391700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c0130260 0x7f55c009bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f55c5391700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c009c5d0 con 0x7f55c0130260 2023-10-03T10:12:01.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f55c5391700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c009d5f0 con 0x7f55c012f8b0 2023-10-03T10:12:01.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f55c5391700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55c012f5d0 con 0x7f55c012cf60 2023-10-03T10:12:01.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f55beffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55c012cf60 0x7f55c009b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f55be7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55c012f8b0 0x7f55c009b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f55beffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55c012cf60 0x7f55c009b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:43362/0 (socket says 172.21.15.72:43362) 2023-10-03T10:12:01.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f55beffd700 1 -- 172.21.15.72:0/2644282323 learned_addr learned my addr 172.21.15.72:0/2644282323 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:01.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f2bb8065700 1 -- 172.21.15.72:0/352406219 shutdown_connections 2023-10-03T10:12:01.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f55be7fc700 1 -- 172.21.15.72:0/2644282323 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55c012cf60 msgr2=0x7f55c009b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.822+0000 7f55be7fc700 1 --2- 172.21.15.72:0/2644282323 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55c012cf60 0x7f55c009b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.823+0000 7f55be7fc700 1 -- 172.21.15.72:0/2644282323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c0130260 msgr2=0x7f55c009bbf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:01.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.823+0000 7f55be7fc700 1 --2- 172.21.15.72:0/2644282323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55c0130260 0x7f55c009bbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.823+0000 7f2bb8065700 1 -- 172.21.15.72:0/352406219 wait complete. 2023-10-03T10:12:01.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.823+0000 7f55be7fc700 1 -- 172.21.15.72:0/2644282323 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b000b600 con 0x7f55c012f8b0 2023-10-03T10:12:01.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.823+0000 7f55beffd700 1 --2- 172.21.15.72:0/2644282323 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55c012cf60 0x7f55c009b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:01.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.823+0000 7f55be7fc700 1 --2- 172.21.15.72:0/2644282323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55c012f8b0 0x7f55c009b6b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f55b400bb20 tx=0x7f55b400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.823+0000 7f2bb8065700 1 Processor -- start 2023-10-03T10:12:01.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.823+0000 7f55a77fe700 1 -- 172.21.15.72:0/2644282323 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b400f7a0 con 0x7f55c012f8b0 2023-10-03T10:12:01.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.824+0000 7f55a77fe700 1 -- 172.21.15.72:0/2644282323 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b400f900 con 0x7f55c012f8b0 2023-10-03T10:12:01.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.824+0000 7f55a77fe700 1 -- 172.21.15.72:0/2644282323 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b400fc70 con 0x7f55c012f8b0 2023-10-03T10:12:01.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.824+0000 7f55c5391700 1 -- 172.21.15.72:0/2644282323 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c0129fa0 con 0x7f55c012f8b0 2023-10-03T10:12:01.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.824+0000 7f2bb8065700 1 -- start start 2023-10-03T10:12:01.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.824+0000 7f55c5391700 1 -- 172.21.15.72:0/2644282323 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c009e420 con 0x7f55c012f8b0 2023-10-03T10:12:01.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.824+0000 7f2bb8065700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bb006e570 0x7f2bb013cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.824+0000 7f2bb8065700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bb006f050 0x7f2bb013d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.824+0000 7f2bb8065700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bb0138430 0x7f2bb013d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.824+0000 7f2bb8065700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb012da20 con 0x7f2bb006e570 2023-10-03T10:12:01.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.824+0000 7f2bb8065700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb012e5e0 con 0x7f2bb0138430 2023-10-03T10:12:01.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.824+0000 7f2bb8065700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb012dc20 con 0x7f2bb006f050 2023-10-03T10:12:01.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.824+0000 7f2bb5600700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bb006f050 0x7f2bb013d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.824+0000 7f2bb5600700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bb006f050 0x7f2bb013d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:43378/0 (socket says 172.21.15.72:43378) 2023-10-03T10:12:01.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.824+0000 7f2bb5600700 1 -- 172.21.15.72:0/252107080 learned_addr learned my addr 172.21.15.72:0/252107080 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:01.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f55c5391700 1 -- 172.21.15.72:0/2644282323 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f55c012c620 con 0x7f55c012f8b0 2023-10-03T10:12:01.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f2bb5e01700 1 --2- 172.21.15.72:0/252107080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bb006e570 0x7f2bb013cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f2bb5600700 1 -- 172.21.15.72:0/252107080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bb0138430 msgr2=0x7f2bb013d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f2bb5600700 1 --2- 172.21.15.72:0/252107080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bb0138430 0x7f2bb013d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f2bb5600700 1 -- 172.21.15.72:0/252107080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bb006e570 msgr2=0x7f2bb013cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f2bb5600700 1 --2- 172.21.15.72:0/252107080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bb006e570 0x7f2bb013cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f2bb5600700 1 -- 172.21.15.72:0/252107080 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba00094a0 con 0x7f2bb006f050 2023-10-03T10:12:01.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f55a77fe700 1 -- 172.21.15.72:0/2644282323 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f55b4014070 con 0x7f55c012f8b0 2023-10-03T10:12:01.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f2bb5600700 1 --2- 172.21.15.72:0/252107080 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bb006f050 0x7f2bb013d280 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000ebb0 tx=0x7f2ba000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f55beffd700 1 -- 172.21.15.72:0/2644282323 >> v1:172.21.15.72:6816/118184 conn(0x7f55ac02c200 legacy=0x7f55ac02e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:01.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f55a77fe700 1 -- 172.21.15.72:0/2644282323 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f55b403ad20 con 0x7f55c012f8b0 2023-10-03T10:12:01.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f2ba67fc700 1 -- 172.21.15.72:0/252107080 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba000c850 con 0x7f2bb006f050 2023-10-03T10:12:01.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f55a77fe700 1 -- 172.21.15.72:0/2644282323 --> v1:172.21.15.72:6804/118756 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f55ac038e60 con 0x7f55ac035160 2023-10-03T10:12:01.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f55a77fe700 1 -- 172.21.15.72:0/2644282323 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55b400fdd0 con 0x7f55c012f8b0 2023-10-03T10:12:01.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f2ba67fc700 1 -- 172.21.15.72:0/252107080 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba000c9b0 con 0x7f2bb006f050 2023-10-03T10:12:01.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f2bb8065700 1 -- 172.21.15.72:0/252107080 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba8009a70 con 0x7f2bb006f050 2023-10-03T10:12:01.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.825+0000 7f2ba67fc700 1 -- 172.21.15.72:0/252107080 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba000cd40 con 0x7f2bb006f050 2023-10-03T10:12:01.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.826+0000 7f2bb8065700 1 -- 172.21.15.72:0/252107080 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb00a22c0 con 0x7f2bb006f050 2023-10-03T10:12:01.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.826+0000 7f2ba67fc700 1 -- 172.21.15.72:0/252107080 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f2ba0013470 con 0x7f2bb006f050 2023-10-03T10:12:01.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.826+0000 7f2bb8065700 1 -- 172.21.15.72:0/252107080 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2bb00722d0 con 0x7f2bb006f050 2023-10-03T10:12:01.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.826+0000 7f2ba67fc700 1 -- 172.21.15.72:0/252107080 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f2ba003b980 con 0x7f2bb006f050 2023-10-03T10:12:01.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.826+0000 7f2bb5e01700 1 -- 172.21.15.72:0/252107080 >> v1:172.21.15.72:6816/118184 conn(0x7f2b9402c1e0 legacy=0x7f2b9402e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:01.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.826+0000 7f2ba67fc700 1 -- 172.21.15.72:0/252107080 --> v1:172.21.15.72:6805/118755 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b94038dc0 con 0x7f2b940350c0 2023-10-03T10:12:01.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.826+0000 7f2ba67fc700 1 -- 172.21.15.72:0/252107080 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ba000cea0 con 0x7f2bb006f050 2023-10-03T10:12:01.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.827+0000 7f2ba67fc700 1 -- 172.21.15.72:0/252107080 <== osd.0 v1:172.21.15.72:6805/118755 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f2b94038dc0 con 0x7f2b940350c0 2023-10-03T10:12:01.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.828+0000 7f9fe66d8700 1 Processor -- start 2023-10-03T10:12:01.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.828+0000 7f55a77fe700 1 -- 172.21.15.72:0/2644282323 <== osd.1 v1:172.21.15.72:6804/118756 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f55ac038e60 con 0x7f55ac035160 2023-10-03T10:12:01.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.828+0000 7f9fe66d8700 1 -- start start 2023-10-03T10:12:01.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.828+0000 7f9fe66d8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9fe012fc70 0x7f9fe0130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.828+0000 7f9fe66d8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fe012c060 0x7f9fe012c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.828+0000 7f9fe66d8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fe012c970 0x7f9fe0136940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.828+0000 7f9fe66d8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe0130580 con 0x7f9fe012fc70 2023-10-03T10:12:01.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.828+0000 7f9fe66d8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe009be70 con 0x7f9fe012c970 2023-10-03T10:12:01.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.828+0000 7f9fe66d8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe009a6e0 con 0x7f9fe012c060 2023-10-03T10:12:01.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.829+0000 7f9fdffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9fe012fc70 0x7f9fe0130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.829+0000 7f9fdffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9fe012fc70 0x7f9fe0130040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50502/0 (socket says 172.21.15.72:50502) 2023-10-03T10:12:01.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.829+0000 7f9fdffff700 1 -- 172.21.15.72:0/1789487996 learned_addr learned my addr 172.21.15.72:0/1789487996 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:01.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.829+0000 7f9fe4c75700 1 --2- 172.21.15.72:0/1789487996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fe012c970 0x7f9fe0136940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.829+0000 7f9fdffff700 1 -- 172.21.15.72:0/1789487996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fe012c060 msgr2=0x7f9fe012c430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:12:01.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.829+0000 7f9fdffff700 1 --2- 172.21.15.72:0/1789487996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fe012c060 0x7f9fe012c430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.829+0000 7f9fdffff700 1 -- 172.21.15.72:0/1789487996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fe012c970 msgr2=0x7f9fe0136940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.829+0000 7f9fdffff700 1 --2- 172.21.15.72:0/1789487996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fe012c970 0x7f9fe0136940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.829+0000 7f9fdffff700 1 -- 172.21.15.72:0/1789487996 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe009ac80 con 0x7f9fe012fc70 2023-10-03T10:12:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.829+0000 7f9fdffff700 1 --2- 172.21.15.72:0/1789487996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fe012fc70 0x7f9fe0130040 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8007980 tx=0x7f9fd800d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c2cbc0e0946dee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.829+0000 7f9fdeffd700 1 -- 172.21.15.72:0/1789487996 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd80126d0 con 0x7f9fe012fc70 2023-10-03T10:12:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.829+0000 7f9fdeffd700 1 -- 172.21.15.72:0/1789487996 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd8012830 con 0x7f9fe012fc70 2023-10-03T10:12:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.829+0000 7f9fdeffd700 1 -- 172.21.15.72:0/1789487996 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8012bc0 con 0x7f9fe012fc70 2023-10-03T10:12:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.830+0000 7f9fe66d8700 1 -- 172.21.15.72:0/1789487996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fe012fc70 msgr2=0x7f9fe0130040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.830+0000 7f9fe66d8700 1 --2- 172.21.15.72:0/1789487996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fe012fc70 0x7f9fe0130040 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8007980 tx=0x7f9fd800d650 comp rx=0 tx=0).stop 2023-10-03T10:12:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.831+0000 7f9fe66d8700 1 -- 172.21.15.72:0/1789487996 shutdown_connections 2023-10-03T10:12:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.831+0000 7f9fe66d8700 1 --2- 172.21.15.72:0/1789487996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fe012c970 0x7f9fe0136940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.831+0000 7f9fe66d8700 1 --2- 172.21.15.72:0/1789487996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fe012fc70 0x7f9fe0130040 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.831+0000 7f9fe66d8700 1 --2- 172.21.15.72:0/1789487996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fe012c060 0x7f9fe012c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.831+0000 7f9fe66d8700 1 -- 172.21.15.72:0/1789487996 >> 172.21.15.72:0/1789487996 conn(0x7f9fe009e7e0 msgr2=0x7f9fe009ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.835+0000 7f9fe66d8700 1 -- 172.21.15.72:0/1789487996 shutdown_connections 2023-10-03T10:12:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.835+0000 7f9fe66d8700 1 -- 172.21.15.72:0/1789487996 wait complete. 2023-10-03T10:12:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.836+0000 7f9fe66d8700 1 Processor -- start 2023-10-03T10:12:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.837+0000 7f9fe66d8700 1 -- start start 2023-10-03T10:12:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.837+0000 7f9fe66d8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fe012c060 0x7f9fe006f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.837+0000 7f9fe66d8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fe012c970 0x7f9fe006f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.837+0000 7f9fe66d8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fe012fc70 0x7f9fe006fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.837+0000 7f9fe66d8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe0070510 con 0x7f9fe012c060 2023-10-03T10:12:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.837+0000 7f9fe66d8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe0072310 con 0x7f9fe012fc70 2023-10-03T10:12:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.837+0000 7f9fe66d8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe0071b00 con 0x7f9fe012c970 2023-10-03T10:12:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.837+0000 7f9fdffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fe012c060 0x7f9fe006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.837+0000 7f9fdffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fe012c060 0x7f9fe006f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50510/0 (socket says 172.21.15.72:50510) 2023-10-03T10:12:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.837+0000 7f9fdffff700 1 -- 172.21.15.72:0/2632108679 learned_addr learned my addr 172.21.15.72:0/2632108679 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.838+0000 7f9fe4c75700 1 --2- 172.21.15.72:0/2632108679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fe012fc70 0x7f9fe006fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.838+0000 7f9fdffff700 1 -- 172.21.15.72:0/2632108679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fe012c970 msgr2=0x7f9fe006f5a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.838+0000 7f9fdffff700 1 --2- 172.21.15.72:0/2632108679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9fe012c970 0x7f9fe006f5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.838+0000 7f9fdffff700 1 -- 172.21.15.72:0/2632108679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fe012fc70 msgr2=0x7f9fe006fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.838+0000 7f9fdffff700 1 --2- 172.21.15.72:0/2632108679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fe012fc70 0x7f9fe006fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.838+0000 7f9fdffff700 1 -- 172.21.15.72:0/2632108679 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd800d050 con 0x7f9fe012c060 2023-10-03T10:12:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.838+0000 7f9fdffff700 1 --2- 172.21.15.72:0/2632108679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fe012c060 0x7f9fe006f060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8007210 tx=0x7f9fd8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.838+0000 7f9fdcff9700 1 -- 172.21.15.72:0/2632108679 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8022070 con 0x7f9fe012c060 2023-10-03T10:12:01.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.838+0000 7f9fdcff9700 1 -- 172.21.15.72:0/2632108679 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd8013e40 con 0x7f9fe012c060 2023-10-03T10:12:01.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.838+0000 7f9fdcff9700 1 -- 172.21.15.72:0/2632108679 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8007e40 con 0x7f9fe012c060 2023-10-03T10:12:01.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.838+0000 7f9fe66d8700 1 -- 172.21.15.72:0/2632108679 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe0129df0 con 0x7f9fe012c060 2023-10-03T10:12:01.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.838+0000 7f9fe66d8700 1 -- 172.21.15.72:0/2632108679 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe012b3e0 con 0x7f9fe012c060 2023-10-03T10:12:01.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.839+0000 7f9fdcff9700 1 -- 172.21.15.72:0/2632108679 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f9fd8004040 con 0x7f9fe012c060 2023-10-03T10:12:01.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.840+0000 7f9fdcff9700 1 -- 172.21.15.72:0/2632108679 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f9fd8040b40 con 0x7f9fe012c060 2023-10-03T10:12:01.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.840+0000 7f9fe66d8700 1 -- 172.21.15.72:0/2632108679 --> v1:172.21.15.72:6812/118763 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9fe0099b90 con 0x7f9fe0061190 2023-10-03T10:12:01.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.841+0000 7f9fdf7fe700 1 -- 172.21.15.72:0/2632108679 >> v1:172.21.15.72:6816/118184 conn(0x7f9fcc02c1e0 legacy=0x7f9fcc02e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:01.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.844+0000 7f9fdcff9700 1 -- 172.21.15.72:0/2632108679 <== osd.3 v1:172.21.15.72:6812/118763 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f9fd0009310 con 0x7f9fe0061190 2023-10-03T10:12:01.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.845+0000 7f55c5391700 1 -- 172.21.15.72:0/2644282323 --> v1:172.21.15.72:6804/118756 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f55c0072220 con 0x7f55ac035160 2023-10-03T10:12:01.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.845+0000 7f55a77fe700 1 -- 172.21.15.72:0/2644282323 <== osd.1 v1:172.21.15.72:6804/118756 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2188548419) 0x7f55b8004020 con 0x7f55ac035160 2023-10-03T10:12:01.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.845+0000 7f55c5391700 1 -- 172.21.15.72:0/2644282323 >> v1:172.21.15.72:6804/118756 conn(0x7f55ac035160 legacy=0x7f55ac0375f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.845+0000 7f55c5391700 1 -- 172.21.15.72:0/2644282323 >> v1:172.21.15.72:6816/118184 conn(0x7f55ac02c200 legacy=0x7f55ac02e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:01.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.845+0000 7f55c5391700 1 -- 172.21.15.72:0/2644282323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55c012f8b0 msgr2=0x7f55c009b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.845+0000 7f55c5391700 1 --2- 172.21.15.72:0/2644282323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55c012f8b0 0x7f55c009b6b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f55b400bb20 tx=0x7f55b400be30 comp rx=0 tx=0).stop 2023-10-03T10:12:01.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.845+0000 7f55bf7fe700 1 -- 172.21.15.72:0/2644282323 reap_dead start 2023-10-03T10:12:01.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.847+0000 7f55c5391700 1 -- 172.21.15.72:0/2644282323 shutdown_connections 2023-10-03T10:12:01.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.847+0000 7f55c5391700 1 -- 172.21.15.72:0/2644282323 >> 172.21.15.72:0/2644282323 conn(0x7f55c00a2aa0 msgr2=0x7f55c006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.847+0000 7f55c5391700 1 -- 172.21.15.72:0/2644282323 shutdown_connections 2023-10-03T10:12:01.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.847+0000 7f55c5391700 1 -- 172.21.15.72:0/2644282323 wait complete. 2023-10-03T10:12:01.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.849+0000 7f2bb8065700 1 -- 172.21.15.72:0/252107080 --> v1:172.21.15.72:6805/118755 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2bb009eee0 con 0x7f2b940350c0 2023-10-03T10:12:01.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.850+0000 7f2ba67fc700 1 -- 172.21.15.72:0/252107080 <== osd.0 v1:172.21.15.72:6805/118755 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2188548419) 0x7f2bb009eee0 con 0x7f2b940350c0 2023-10-03T10:12:01.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.850+0000 7f2bb8065700 1 -- 172.21.15.72:0/252107080 >> v1:172.21.15.72:6805/118755 conn(0x7f2b940350c0 legacy=0x7f2b94037550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.850+0000 7f2bb8065700 1 -- 172.21.15.72:0/252107080 >> v1:172.21.15.72:6816/118184 conn(0x7f2b9402c1e0 legacy=0x7f2b9402e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:01.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.850+0000 7f2bb8065700 1 -- 172.21.15.72:0/252107080 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bb006f050 msgr2=0x7f2bb013d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.850+0000 7f2bb8065700 1 --2- 172.21.15.72:0/252107080 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bb006f050 0x7f2bb013d280 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000ebb0 tx=0x7f2ba000eec0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.850+0000 7f2bb6602700 1 -- 172.21.15.72:0/252107080 reap_dead start 2023-10-03T10:12:01.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.850+0000 7f2bb8065700 1 -- 172.21.15.72:0/252107080 shutdown_connections 2023-10-03T10:12:01.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.850+0000 7f2bb8065700 1 -- 172.21.15.72:0/252107080 >> 172.21.15.72:0/252107080 conn(0x7f2bb00a2aa0 msgr2=0x7f2bb009ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.851+0000 7f2bb8065700 1 -- 172.21.15.72:0/252107080 shutdown_connections 2023-10-03T10:12:01.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.851+0000 7f2bb8065700 1 -- 172.21.15.72:0/252107080 wait complete. 2023-10-03T10:12:01.854 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:01.854+0000 7f6aece4b240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-03T10:12:01.860 INFO:teuthology.orchestra.run.smithi072.stdout:38654705695 2023-10-03T10:12:01.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:01.870 INFO:teuthology.orchestra.run.smithi072.stdout:38654705695 2023-10-03T10:12:01.871 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:01.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.872+0000 7f9fe66d8700 1 -- 172.21.15.72:0/2632108679 --> v1:172.21.15.72:6812/118763 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9fe0061f20 con 0x7f9fe0061190 2023-10-03T10:12:01.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.872+0000 7f9fdcff9700 1 -- 172.21.15.72:0/2632108679 <== osd.3 v1:172.21.15.72:6812/118763 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2188548419) 0x7f9fe0061f20 con 0x7f9fe0061190 2023-10-03T10:12:01.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.872+0000 7f9fe66d8700 1 -- 172.21.15.72:0/2632108679 >> v1:172.21.15.72:6812/118763 conn(0x7f9fe0061190 legacy=0x7f9fe0061560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.873+0000 7f9fe66d8700 1 -- 172.21.15.72:0/2632108679 >> v1:172.21.15.72:6816/118184 conn(0x7f9fcc02c1e0 legacy=0x7f9fcc02e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:01.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.873+0000 7f9fe66d8700 1 -- 172.21.15.72:0/2632108679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fe012c060 msgr2=0x7f9fe006f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.873+0000 7f9fe66d8700 1 --2- 172.21.15.72:0/2632108679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fe012c060 0x7f9fe006f060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8007210 tx=0x7f9fd8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.873+0000 7f9fe4c75700 1 -- 172.21.15.72:0/2632108679 reap_dead start 2023-10-03T10:12:01.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.873+0000 7f9fe66d8700 1 -- 172.21.15.72:0/2632108679 shutdown_connections 2023-10-03T10:12:01.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.873+0000 7f9fe66d8700 1 -- 172.21.15.72:0/2632108679 >> 172.21.15.72:0/2632108679 conn(0x7f9fe009e7e0 msgr2=0x7f9fe0129560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.874+0000 7f9fe66d8700 1 -- 172.21.15.72:0/2632108679 shutdown_connections 2023-10-03T10:12:01.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.874+0000 7f9fe66d8700 1 -- 172.21.15.72:0/2632108679 wait complete. 2023-10-03T10:12:01.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.875+0000 7f36dfcbd700 1 Processor -- start 2023-10-03T10:12:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.876+0000 7f36dfcbd700 1 -- start start 2023-10-03T10:12:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.876+0000 7f36dfcbd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d806e570 0x7f36d806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.876+0000 7f36dfcbd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d809eca0 0x7f36d806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.876+0000 7f36dfcbd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36d8134610 0x7f36d8134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.876+0000 7f36dfcbd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d8070ee0 con 0x7f36d8134610 2023-10-03T10:12:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.876+0000 7f36dfcbd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d8071480 con 0x7f36d806e570 2023-10-03T10:12:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.876+0000 7f36dfcbd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36d806f3c0 con 0x7f36d809eca0 2023-10-03T10:12:01.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36de25a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36d8134610 0x7f36d8134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36de25a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36d8134610 0x7f36d8134ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50526/0 (socket says 172.21.15.72:50526) 2023-10-03T10:12:01.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36de25a700 1 -- 172.21.15.72:0/2998332266 learned_addr learned my addr 172.21.15.72:0/2998332266 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:01.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36dda59700 1 --2- 172.21.15.72:0/2998332266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d806e570 0x7f36d806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36dd258700 1 --2- 172.21.15.72:0/2998332266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d809eca0 0x7f36d806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36de25a700 1 -- 172.21.15.72:0/2998332266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d809eca0 msgr2=0x7f36d806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36de25a700 1 --2- 172.21.15.72:0/2998332266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d809eca0 0x7f36d806ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36de25a700 1 -- 172.21.15.72:0/2998332266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d806e570 msgr2=0x7f36d806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:01.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36de25a700 1 --2- 172.21.15.72:0/2998332266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d806e570 0x7f36d806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36de25a700 1 -- 172.21.15.72:0/2998332266 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d8071b90 con 0x7f36d8134610 2023-10-03T10:12:01.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36dda59700 1 --2- 172.21.15.72:0/2998332266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d806e570 0x7f36d806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:01.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36dd258700 1 --2- 172.21.15.72:0/2998332266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d809eca0 0x7f36d806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:01.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36de25a700 1 --2- 172.21.15.72:0/2998332266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36d8134610 0x7f36d8134ab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009e50 tx=0x7f36d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec08cef0bc7bd57 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36dca57700 1 -- 172.21.15.72:0/2998332266 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d000e070 con 0x7f36d8134610 2023-10-03T10:12:01.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36dca57700 1 -- 172.21.15.72:0/2998332266 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d000b9c0 con 0x7f36d8134610 2023-10-03T10:12:01.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.877+0000 7f36dca57700 1 -- 172.21.15.72:0/2998332266 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d000bd70 con 0x7f36d8134610 2023-10-03T10:12:01.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.878+0000 7f36dfcbd700 1 -- 172.21.15.72:0/2998332266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36d8134610 msgr2=0x7f36d8134ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.878+0000 7f36dfcbd700 1 --2- 172.21.15.72:0/2998332266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36d8134610 0x7f36d8134ab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009e50 tx=0x7f36d000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.878+0000 7f36dfcbd700 1 -- 172.21.15.72:0/2998332266 shutdown_connections 2023-10-03T10:12:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.878+0000 7f36dfcbd700 1 --2- 172.21.15.72:0/2998332266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36d8134610 0x7f36d8134ab0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.878+0000 7f36dfcbd700 1 --2- 172.21.15.72:0/2998332266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d806e570 0x7f36d806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.878+0000 7f36dfcbd700 1 --2- 172.21.15.72:0/2998332266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d809eca0 0x7f36d806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.878+0000 7f36dfcbd700 1 -- 172.21.15.72:0/2998332266 >> 172.21.15.72:0/2998332266 conn(0x7f36d80a2aa0 msgr2=0x7f36d80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.878+0000 7f36dfcbd700 1 -- 172.21.15.72:0/2998332266 shutdown_connections 2023-10-03T10:12:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.878+0000 7f36dfcbd700 1 -- 172.21.15.72:0/2998332266 wait complete. 2023-10-03T10:12:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.879+0000 7f36dfcbd700 1 Processor -- start 2023-10-03T10:12:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.879+0000 7f36dfcbd700 1 -- start start 2023-10-03T10:12:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.880+0000 7f36dfcbd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d806e570 0x7f36d81275a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.880+0000 7f36dfcbd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d8134610 0x7f36d8139da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.880+0000 7f36dfcbd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36d813a2e0 0x7f36d813a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:01.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.880+0000 7f36dfcbd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d813d830 con 0x7f36d813a2e0 2023-10-03T10:12:01.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.880+0000 7f36dfcbd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d8070680 con 0x7f36d8134610 2023-10-03T10:12:01.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.880+0000 7f36dfcbd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36d813d290 con 0x7f36d806e570 2023-10-03T10:12:01.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.880+0000 7f36dd258700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d8134610 0x7f36d8139da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.880+0000 7f36dd258700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d8134610 0x7f36d8139da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55096/0 (socket says 172.21.15.72:55096) 2023-10-03T10:12:01.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.880+0000 7f36dd258700 1 -- 172.21.15.72:0/1785482780 learned_addr learned my addr 172.21.15.72:0/1785482780 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:01.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.880+0000 7f36de25a700 1 --2- 172.21.15.72:0/1785482780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36d813a2e0 0x7f36d813a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:01.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.881+0000 7f36dd258700 1 -- 172.21.15.72:0/1785482780 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d806e570 msgr2=0x7f36d81275a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.881+0000 7f36dd258700 1 --2- 172.21.15.72:0/1785482780 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d806e570 0x7f36d81275a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.881+0000 7f36dd258700 1 -- 172.21.15.72:0/1785482780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36d813a2e0 msgr2=0x7f36d813a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.881+0000 7f36dd258700 1 --2- 172.21.15.72:0/1785482780 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36d813a2e0 0x7f36d813a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:01.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.881+0000 7f36dd258700 1 -- 172.21.15.72:0/1785482780 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d0009b30 con 0x7f36d8134610 2023-10-03T10:12:01.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.881+0000 7f36dd258700 1 --2- 172.21.15.72:0/1785482780 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d8134610 0x7f36d8139da0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f36c800e770 tx=0x7f36c800ea80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:01.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.881+0000 7f36ce7fc700 1 -- 172.21.15.72:0/1785482780 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8013610 con 0x7f36d8134610 2023-10-03T10:12:01.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.881+0000 7f36ce7fc700 1 -- 172.21.15.72:0/1785482780 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c8013770 con 0x7f36d8134610 2023-10-03T10:12:01.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.881+0000 7f36dfcbd700 1 -- 172.21.15.72:0/1785482780 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d813e590 con 0x7f36d8134610 2023-10-03T10:12:01.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.881+0000 7f36dfcbd700 1 -- 172.21.15.72:0/1785482780 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d813dfc0 con 0x7f36d8134610 2023-10-03T10:12:01.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.882+0000 7f36ce7fc700 1 -- 172.21.15.72:0/1785482780 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8013ae0 con 0x7f36d8134610 2023-10-03T10:12:01.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.882+0000 7f36ce7fc700 1 -- 172.21.15.72:0/1785482780 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f36c8013c40 con 0x7f36d8134610 2023-10-03T10:12:01.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.882+0000 7f36ce7fc700 1 -- 172.21.15.72:0/1785482780 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f36c803b970 con 0x7f36d8134610 2023-10-03T10:12:01.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.882+0000 7f36dda59700 1 -- 172.21.15.72:0/1785482780 >> v1:172.21.15.72:6816/118184 conn(0x7f36bc02c1b0 legacy=0x7f36bc02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:01.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.884+0000 7f36dfcbd700 1 -- 172.21.15.72:0/1785482780 --> v1:172.21.15.72:6800/118746 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36c0005390 con 0x7f36c00015b0 2023-10-03T10:12:01.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.885+0000 7f36ce7fc700 1 -- 172.21.15.72:0/1785482780 <== osd.2 v1:172.21.15.72:6800/118746 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f36c0005390 con 0x7f36c00015b0 2023-10-03T10:12:01.895 INFO:teuthology.orchestra.run.smithi072.stdout:38654705695 2023-10-03T10:12:01.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:01.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.903+0000 7f36dfcbd700 1 -- 172.21.15.72:0/1785482780 --> v1:172.21.15.72:6800/118746 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f36c00070f0 con 0x7f36c00015b0 2023-10-03T10:12:01.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.904+0000 7f36ce7fc700 1 -- 172.21.15.72:0/1785482780 <== osd.2 v1:172.21.15.72:6800/118746 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2188548419) 0x7f36c00070f0 con 0x7f36c00015b0 2023-10-03T10:12:01.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.904+0000 7f36dfcbd700 1 -- 172.21.15.72:0/1785482780 >> v1:172.21.15.72:6800/118746 conn(0x7f36c00015b0 legacy=0x7f36c0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.906+0000 7f36dfcbd700 1 -- 172.21.15.72:0/1785482780 >> v1:172.21.15.72:6816/118184 conn(0x7f36bc02c1b0 legacy=0x7f36bc02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:01.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.906+0000 7f36dfcbd700 1 -- 172.21.15.72:0/1785482780 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d8134610 msgr2=0x7f36d8139da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:01.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.906+0000 7f36dfcbd700 1 --2- 172.21.15.72:0/1785482780 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d8134610 0x7f36d8139da0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f36c800e770 tx=0x7f36c800ea80 comp rx=0 tx=0).stop 2023-10-03T10:12:01.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.906+0000 7f36de25a700 1 -- 172.21.15.72:0/1785482780 reap_dead start 2023-10-03T10:12:01.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.906+0000 7f36dfcbd700 1 -- 172.21.15.72:0/1785482780 shutdown_connections 2023-10-03T10:12:01.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.906+0000 7f36dfcbd700 1 -- 172.21.15.72:0/1785482780 >> 172.21.15.72:0/1785482780 conn(0x7f36d80a2aa0 msgr2=0x7f36d8137a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:01.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.906+0000 7f36dfcbd700 1 -- 172.21.15.72:0/1785482780 shutdown_connections 2023-10-03T10:12:01.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:01.906+0000 7f36dfcbd700 1 -- 172.21.15.72:0/1785482780 wait complete. 2023-10-03T10:12:01.922 INFO:teuthology.orchestra.run.smithi072.stdout:38654705695 2023-10-03T10:12:01.922 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:02.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.006+0000 7f7cd648f700 1 Processor -- start 2023-10-03T10:12:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.007+0000 7f7cd648f700 1 -- start start 2023-10-03T10:12:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.007+0000 7f7cd648f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd006e570 0x7f7cd006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.007+0000 7f7cd648f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7cd009eca0 0x7f7cd006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.007+0000 7f7cd648f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd0134610 0x7f7cd0134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.007+0000 7f7cd648f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd0070ee0 con 0x7f7cd009eca0 2023-10-03T10:12:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.007+0000 7f7cd648f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd0071480 con 0x7f7cd0134610 2023-10-03T10:12:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.007+0000 7f7cd648f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd006f3c0 con 0x7f7cd006e570 2023-10-03T10:12:02.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.008+0000 7f7cd4a2c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd0134610 0x7f7cd0134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.008+0000 7f7ccffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd006e570 0x7f7cd006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.008+0000 7f7cd4a2c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd0134610 0x7f7cd0134a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55098/0 (socket says 172.21.15.72:55098) 2023-10-03T10:12:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.008+0000 7f7cd4a2c700 1 -- 172.21.15.72:0/1309610249 learned_addr learned my addr 172.21.15.72:0/1309610249 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.008+0000 7f7ccf7fe700 1 --2- 172.21.15.72:0/1309610249 >> v2:172.21.15.72:3300/0 conn(0x7f7cd009eca0 0x7f7cd006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.008+0000 7f7ccffff700 1 -- 172.21.15.72:0/1309610249 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd0134610 msgr2=0x7f7cd0134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.008+0000 7f7ccffff700 1 --2- 172.21.15.72:0/1309610249 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd0134610 0x7f7cd0134a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.008+0000 7f7ccffff700 1 -- 172.21.15.72:0/1309610249 >> v2:172.21.15.72:3300/0 conn(0x7f7cd009eca0 msgr2=0x7f7cd006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.008+0000 7f7ccffff700 1 --2- 172.21.15.72:0/1309610249 >> v2:172.21.15.72:3300/0 conn(0x7f7cd009eca0 0x7f7cd006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.008+0000 7f7ccffff700 1 -- 172.21.15.72:0/1309610249 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd0071b90 con 0x7f7cd006e570 2023-10-03T10:12:02.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.009+0000 7f7ccffff700 1 --2- 172.21.15.72:0/1309610249 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd006e570 0x7f7cd006e940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009840 tx=0x7f7cc0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37cb71adbbfba2d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.009+0000 7f7cceffd700 1 -- 172.21.15.72:0/1309610249 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0011830 con 0x7f7cd006e570 2023-10-03T10:12:02.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.009+0000 7f7cceffd700 1 -- 172.21.15.72:0/1309610249 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc0011990 con 0x7f7cd006e570 2023-10-03T10:12:02.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.009+0000 7f7cceffd700 1 -- 172.21.15.72:0/1309610249 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0011d20 con 0x7f7cd006e570 2023-10-03T10:12:02.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.010+0000 7f7cd648f700 1 -- 172.21.15.72:0/1309610249 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd006e570 msgr2=0x7f7cd006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.010+0000 7f7cd648f700 1 --2- 172.21.15.72:0/1309610249 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd006e570 0x7f7cd006e940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009840 tx=0x7f7cc0009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:02.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.010+0000 7f7cd648f700 1 -- 172.21.15.72:0/1309610249 shutdown_connections 2023-10-03T10:12:02.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.010+0000 7f7cd648f700 1 --2- 172.21.15.72:0/1309610249 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd0134610 0x7f7cd0134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.010+0000 7f7cd648f700 1 --2- 172.21.15.72:0/1309610249 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd006e570 0x7f7cd006e940 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.010+0000 7f7cd648f700 1 --2- 172.21.15.72:0/1309610249 >> v2:172.21.15.72:3300/0 conn(0x7f7cd009eca0 0x7f7cd006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.010+0000 7f7cd648f700 1 -- 172.21.15.72:0/1309610249 >> 172.21.15.72:0/1309610249 conn(0x7f7cd00a2aa0 msgr2=0x7f7cd00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:02.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.010+0000 7f7cd648f700 1 -- 172.21.15.72:0/1309610249 shutdown_connections 2023-10-03T10:12:02.014 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:02.010+0000 7f6aece4b240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-03T10:12:02.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.010+0000 7f7cd648f700 1 -- 172.21.15.72:0/1309610249 wait complete. 2023-10-03T10:12:02.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.011+0000 7f7cd648f700 1 Processor -- start 2023-10-03T10:12:02.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.012+0000 7f7cd648f700 1 -- start start 2023-10-03T10:12:02.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.012+0000 7f7cd648f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd006e570 0x7f7cd013ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.012+0000 7f7cd648f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd0134610 0x7f7cd0126160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.012+0000 7f7cd648f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd01279f0 0x7f7cd01266a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.012+0000 7f7cd648f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd00a20f0 con 0x7f7cd006e570 2023-10-03T10:12:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.012+0000 7f7cd648f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd0070610 con 0x7f7cd01279f0 2023-10-03T10:12:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.012+0000 7f7cd648f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd013b9b0 con 0x7f7cd0134610 2023-10-03T10:12:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.012+0000 7f7ccffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd006e570 0x7f7cd013ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.013+0000 7f7ccffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd006e570 0x7f7cd013ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50542/0 (socket says 172.21.15.72:50542) 2023-10-03T10:12:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.013+0000 7f7ccffff700 1 -- 172.21.15.72:0/2402434368 learned_addr learned my addr 172.21.15.72:0/2402434368 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.013+0000 7f7cd4a2c700 1 --2- 172.21.15.72:0/2402434368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd01279f0 0x7f7cd01266a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.013+0000 7f7ccffff700 1 -- 172.21.15.72:0/2402434368 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd0134610 msgr2=0x7f7cd0126160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.013+0000 7f7ccffff700 1 --2- 172.21.15.72:0/2402434368 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd0134610 0x7f7cd0126160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.013+0000 7f7ccffff700 1 -- 172.21.15.72:0/2402434368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd01279f0 msgr2=0x7f7cd01266a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.013+0000 7f7ccffff700 1 --2- 172.21.15.72:0/2402434368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd01279f0 0x7f7cd01266a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.013+0000 7f7ccffff700 1 -- 172.21.15.72:0/2402434368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc00094a0 con 0x7f7cd006e570 2023-10-03T10:12:02.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.013+0000 7f7cd4a2c700 1 --2- 172.21.15.72:0/2402434368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd01279f0 0x7f7cd01266a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:02.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.013+0000 7f7ccffff700 1 --2- 172.21.15.72:0/2402434368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd006e570 0x7f7cd013ad90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009fd0 tx=0x7f7cc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.013+0000 7f7cccff9700 1 -- 172.21.15.72:0/2402434368 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0004450 con 0x7f7cd006e570 2023-10-03T10:12:02.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.013+0000 7f7cccff9700 1 -- 172.21.15.72:0/2402434368 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc001f070 con 0x7f7cd006e570 2023-10-03T10:12:02.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.014+0000 7f7cd648f700 1 -- 172.21.15.72:0/2402434368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd013c9b0 con 0x7f7cd006e570 2023-10-03T10:12:02.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.014+0000 7f7cccff9700 1 -- 172.21.15.72:0/2402434368 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00038e0 con 0x7f7cd006e570 2023-10-03T10:12:02.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.014+0000 7f7cd648f700 1 -- 172.21.15.72:0/2402434368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd013d820 con 0x7f7cd006e570 2023-10-03T10:12:02.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.015+0000 7f7cccff9700 1 -- 172.21.15.72:0/2402434368 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f7cc0003a40 con 0x7f7cd006e570 2023-10-03T10:12:02.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.015+0000 7f7cccff9700 1 -- 172.21.15.72:0/2402434368 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f7cc0021070 con 0x7f7cd006e570 2023-10-03T10:12:02.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.015+0000 7f7ccf7fe700 1 -- 172.21.15.72:0/2402434368 >> v1:172.21.15.72:6816/118184 conn(0x7f7cbc02c1e0 legacy=0x7f7cbc02e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:02.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.015+0000 7f7cd648f700 1 -- 172.21.15.72:0/2402434368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd013d1e0 con 0x7f7cd006e570 2023-10-03T10:12:02.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.023+0000 7f528c78c700 1 Processor -- start 2023-10-03T10:12:02.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.023+0000 7f528c78c700 1 -- start start 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.023+0000 7f528c78c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f528406f5d0 0x7f528412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.023+0000 7f528c78c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5284135c20 0x7f5284138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.023+0000 7f528c78c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528406fa40 con 0x7f528412cf60 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.023+0000 7f528c78c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528412cd90 con 0x7f528406f5d0 2023-10-03T10:12:02.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.023+0000 7f528c78c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5284071780 con 0x7f5284135c20 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.024+0000 7f528a528700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f528412cf60 0x7f528412f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57504/0 (socket says 172.21.15.72:57504) 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.024+0000 7f528a528700 1 -- 172.21.15.72:0/70367668 learned_addr learned my addr 172.21.15.72:0/70367668 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:02.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.024+0000 7f7cccff9700 1 -- 172.21.15.72:0/2402434368 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f7cc0015080 con 0x7f7cd006e570 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.024+0000 7f528ad29700 1 --2- 172.21.15.72:0/70367668 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5284135c20 0x7f5284138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.024+0000 7f5289d27700 1 --2- 172.21.15.72:0/70367668 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f528406f5d0 0x7f528412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.024+0000 7f5289526700 1 -- 172.21.15.72:0/70367668 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667548876 0 0) 0x7f528406fa40 con 0x7f528412cf60 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.024+0000 7f5289526700 1 -- 172.21.15.72:0/70367668 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52700035b0 con 0x7f528412cf60 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.024+0000 7f528ad29700 1 -- 172.21.15.72:0/70367668 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f528406f5d0 msgr2=0x7f528412ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.025+0000 7f528ad29700 1 --2- 172.21.15.72:0/70367668 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f528406f5d0 0x7f528412ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.025+0000 7f528ad29700 1 -- 172.21.15.72:0/70367668 >> v1:172.21.15.72:6789/0 conn(0x7f528412cf60 legacy=0x7f528412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.025+0000 7f528ad29700 1 -- 172.21.15.72:0/70367668 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5284071a40 con 0x7f5284135c20 2023-10-03T10:12:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.025+0000 7f528ad29700 1 --2- 172.21.15.72:0/70367668 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5284135c20 0x7f5284138000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f527c00be90 tx=0x7f527c00a400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd8849ac271bb308 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.025+0000 7f5289526700 1 -- 172.21.15.72:0/70367668 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c00b220 con 0x7f5284135c20 2023-10-03T10:12:02.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.025+0000 7f5289526700 1 -- 172.21.15.72:0/70367668 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527c00b380 con 0x7f5284135c20 2023-10-03T10:12:02.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.025+0000 7f5289526700 1 -- 172.21.15.72:0/70367668 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c00cc60 con 0x7f5284135c20 2023-10-03T10:12:02.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.026+0000 7f528c78c700 1 -- 172.21.15.72:0/70367668 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5284135c20 msgr2=0x7f5284138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.026+0000 7f528c78c700 1 --2- 172.21.15.72:0/70367668 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5284135c20 0x7f5284138000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f527c00be90 tx=0x7f527c00a400 comp rx=0 tx=0).stop 2023-10-03T10:12:02.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.026+0000 7f528c78c700 1 -- 172.21.15.72:0/70367668 shutdown_connections 2023-10-03T10:12:02.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.026+0000 7f528c78c700 1 --2- 172.21.15.72:0/70367668 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5284135c20 0x7f5284138000 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.026+0000 7f528c78c700 1 --2- 172.21.15.72:0/70367668 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f528406f5d0 0x7f528412ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.026+0000 7f528c78c700 1 -- 172.21.15.72:0/70367668 >> 172.21.15.72:0/70367668 conn(0x7f52840a2aa0 msgr2=0x7f52840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:02.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.027+0000 7f528c78c700 1 -- 172.21.15.72:0/70367668 shutdown_connections 2023-10-03T10:12:02.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.027+0000 7f528c78c700 1 -- 172.21.15.72:0/70367668 wait complete. 2023-10-03T10:12:02.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.028+0000 7f528c78c700 1 Processor -- start 2023-10-03T10:12:02.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.028+0000 7f528c78c700 1 -- start start 2023-10-03T10:12:02.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.029+0000 7f528c78c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f528406f5d0 0x7f5284099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.029+0000 7f528c78c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f528412cf60 0x7f528409a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.029+0000 7f528c78c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5284135c20 0x7f528409a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.029+0000 7f528c78c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5284129fa0 con 0x7f528406f5d0 2023-10-03T10:12:02.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.029+0000 7f528c78c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528409c3c0 con 0x7f5284135c20 2023-10-03T10:12:02.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.029+0000 7f528c78c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52840a1430 con 0x7f528412cf60 2023-10-03T10:12:02.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.029+0000 7f528ad29700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5284135c20 0x7f528409a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.029+0000 7f528ad29700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5284135c20 0x7f528409a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55112/0 (socket says 172.21.15.72:55112) 2023-10-03T10:12:02.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.029+0000 7f528ad29700 1 -- 172.21.15.72:0/1874277814 learned_addr learned my addr 172.21.15.72:0/1874277814 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:02.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.029+0000 7f528a528700 1 --2- 172.21.15.72:0/1874277814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f528406f5d0 0x7f5284099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.029+0000 7f528a528700 1 -- 172.21.15.72:0/1874277814 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f528412cf60 msgr2=0x7f528409a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.029+0000 7f528a528700 1 --2- 172.21.15.72:0/1874277814 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f528412cf60 0x7f528409a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.029+0000 7f528a528700 1 -- 172.21.15.72:0/1874277814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5284135c20 msgr2=0x7f528409a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.029+0000 7f528a528700 1 --2- 172.21.15.72:0/1874277814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5284135c20 0x7f528409a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.030+0000 7f528a528700 1 -- 172.21.15.72:0/1874277814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c00ba90 con 0x7f528406f5d0 2023-10-03T10:12:02.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.030+0000 7f528a528700 1 --2- 172.21.15.72:0/1874277814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f528406f5d0 0x7f5284099d50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f528000c490 tx=0x7f528000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.030+0000 7f527affd700 1 -- 172.21.15.72:0/1874277814 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5280005e30 con 0x7f528406f5d0 2023-10-03T10:12:02.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.030+0000 7f527affd700 1 -- 172.21.15.72:0/1874277814 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52800070d0 con 0x7f528406f5d0 2023-10-03T10:12:02.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.030+0000 7f527affd700 1 -- 172.21.15.72:0/1874277814 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5280007440 con 0x7f528406f5d0 2023-10-03T10:12:02.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.030+0000 7f528c78c700 1 -- 172.21.15.72:0/1874277814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f528409bc60 con 0x7f528406f5d0 2023-10-03T10:12:02.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.030+0000 7f528c78c700 1 -- 172.21.15.72:0/1874277814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5284135670 con 0x7f528406f5d0 2023-10-03T10:12:02.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.031+0000 7f527affd700 1 -- 172.21.15.72:0/1874277814 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f52800075a0 con 0x7f528406f5d0 2023-10-03T10:12:02.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.031+0000 7f528c78c700 1 -- 172.21.15.72:0/1874277814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5284074ea0 con 0x7f528406f5d0 2023-10-03T10:12:02.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.032+0000 7f527affd700 1 -- 172.21.15.72:0/1874277814 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f528003a900 con 0x7f528406f5d0 2023-10-03T10:12:02.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.032+0000 7f5289d27700 1 -- 172.21.15.72:0/1874277814 >> v1:172.21.15.72:6816/118184 conn(0x7f526802c1b0 legacy=0x7f526802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:02.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.040+0000 7f527affd700 1 -- 172.21.15.72:0/1874277814 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f5280018ad0 con 0x7f528406f5d0 2023-10-03T10:12:02.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.048+0000 7f1efcf51700 1 Processor -- start 2023-10-03T10:12:02.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.048+0000 7f1efcf51700 1 -- start start 2023-10-03T10:12:02.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.048+0000 7f1efcf51700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ef806e570 0x7f1ef806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.048+0000 7f1efcf51700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ef806ee80 0x7f1ef8134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.048+0000 7f1efcf51700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef8070ee0 con 0x7f1ef809eca0 2023-10-03T10:12:02.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.048+0000 7f1efcf51700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef8071480 con 0x7f1ef806ee80 2023-10-03T10:12:02.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.048+0000 7f1efcf51700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef8071b90 con 0x7f1ef806e570 2023-10-03T10:12:02.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.049+0000 7f1ef5d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1ef809eca0 0x7f1ef8134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57506/0 (socket says 172.21.15.72:57506) 2023-10-03T10:12:02.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.049+0000 7f1ef5d9b700 1 -- 172.21.15.72:0/1132075566 learned_addr learned my addr 172.21.15.72:0/1132075566 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:02.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.049+0000 7f1ef6d9d700 1 --2- 172.21.15.72:0/1132075566 >> v2:172.21.15.72:3300/0 conn(0x7f1ef806ee80 0x7f1ef8134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.049+0000 7f1ef659c700 1 --2- 172.21.15.72:0/1132075566 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ef806e570 0x7f1ef806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.049+0000 7f1ef659c700 1 -- 172.21.15.72:0/1132075566 >> v2:172.21.15.72:3300/0 conn(0x7f1ef806ee80 msgr2=0x7f1ef8134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:02.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.049+0000 7f1ef659c700 1 --2- 172.21.15.72:0/1132075566 >> v2:172.21.15.72:3300/0 conn(0x7f1ef806ee80 0x7f1ef8134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.049+0000 7f1ef659c700 1 -- 172.21.15.72:0/1132075566 >> v1:172.21.15.72:6789/0 conn(0x7f1ef809eca0 legacy=0x7f1ef8134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.049+0000 7f1ef659c700 1 -- 172.21.15.72:0/1132075566 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef80711a0 con 0x7f1ef806e570 2023-10-03T10:12:02.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.049+0000 7f1ef659c700 1 --2- 172.21.15.72:0/1132075566 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ef806e570 0x7f1ef806e940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009840 tx=0x7f1ee8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad541976a359bebc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.055+0000 7f1ef559a700 1 -- 172.21.15.72:0/1132075566 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8004230 con 0x7f1ef806e570 2023-10-03T10:12:02.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.055+0000 7f1ef559a700 1 -- 172.21.15.72:0/1132075566 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee8004390 con 0x7f1ef806e570 2023-10-03T10:12:02.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.055+0000 7f1ef559a700 1 -- 172.21.15.72:0/1132075566 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80036a0 con 0x7f1ef806e570 2023-10-03T10:12:02.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.055+0000 7f1efcf51700 1 -- 172.21.15.72:0/1132075566 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ef806e570 msgr2=0x7f1ef806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.055+0000 7f1efcf51700 1 --2- 172.21.15.72:0/1132075566 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ef806e570 0x7f1ef806e940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009840 tx=0x7f1ee8009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:02.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.056+0000 7f1efcf51700 1 -- 172.21.15.72:0/1132075566 shutdown_connections 2023-10-03T10:12:02.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.056+0000 7f1efcf51700 1 --2- 172.21.15.72:0/1132075566 >> v2:172.21.15.72:3300/0 conn(0x7f1ef806ee80 0x7f1ef8134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.056+0000 7f1efcf51700 1 --2- 172.21.15.72:0/1132075566 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ef806e570 0x7f1ef806e940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.056+0000 7f1efcf51700 1 -- 172.21.15.72:0/1132075566 >> 172.21.15.72:0/1132075566 conn(0x7f1ef80a2aa0 msgr2=0x7f1ef80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:02.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.056+0000 7f1efcf51700 1 -- 172.21.15.72:0/1132075566 shutdown_connections 2023-10-03T10:12:02.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.056+0000 7f1efcf51700 1 -- 172.21.15.72:0/1132075566 wait complete. 2023-10-03T10:12:02.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.057+0000 7f1efcf51700 1 Processor -- start 2023-10-03T10:12:02.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.057+0000 7f1efcf51700 1 -- start start 2023-10-03T10:12:02.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.057+0000 7f1efcf51700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef806e570 0x7f1ef8123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.057+0000 7f1efcf51700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ef806ee80 0x7f1ef8123850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.057+0000 7f1efcf51700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ef8123d90 0x7f1ef81cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.057+0000 7f1efcf51700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef8126530 con 0x7f1ef806e570 2023-10-03T10:12:02.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.057+0000 7f1efcf51700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef8124f20 con 0x7f1ef8123d90 2023-10-03T10:12:02.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.057+0000 7f1efcf51700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef8133ec0 con 0x7f1ef806ee80 2023-10-03T10:12:02.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.058+0000 7f1ef6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ef8123d90 0x7f1ef81cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.058+0000 7f1ef6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ef8123d90 0x7f1ef81cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55128/0 (socket says 172.21.15.72:55128) 2023-10-03T10:12:02.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.058+0000 7f1ef6d9d700 1 -- 172.21.15.72:0/4238457168 learned_addr learned my addr 172.21.15.72:0/4238457168 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:02.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.058+0000 7f1ef5d9b700 1 --2- 172.21.15.72:0/4238457168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ef806ee80 0x7f1ef8123850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.058+0000 7f1ef659c700 1 --2- 172.21.15.72:0/4238457168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef806e570 0x7f1ef8123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.058+0000 7f1ef5d9b700 1 -- 172.21.15.72:0/4238457168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ef8123d90 msgr2=0x7f1ef81cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.058+0000 7f1ef5d9b700 1 --2- 172.21.15.72:0/4238457168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ef8123d90 0x7f1ef81cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.058+0000 7f1ef5d9b700 1 -- 172.21.15.72:0/4238457168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef806e570 msgr2=0x7f1ef8123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.058+0000 7f1ef5d9b700 1 --2- 172.21.15.72:0/4238457168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef806e570 0x7f1ef8123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.058+0000 7f1ef5d9b700 1 -- 172.21.15.72:0/4238457168 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee80094a0 con 0x7f1ef806ee80 2023-10-03T10:12:02.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.058+0000 7f1ef5d9b700 1 --2- 172.21.15.72:0/4238457168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ef806ee80 0x7f1ef8123850 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1ef806b700 tx=0x7f1eec00ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.059+0000 7f1ee6ffd700 1 -- 172.21.15.72:0/4238457168 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec004c80 con 0x7f1ef806ee80 2023-10-03T10:12:02.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.059+0000 7f1efcf51700 1 -- 172.21.15.72:0/4238457168 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef8126e30 con 0x7f1ef806ee80 2023-10-03T10:12:02.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.059+0000 7f1efcf51700 1 -- 172.21.15.72:0/4238457168 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef8070660 con 0x7f1ef806ee80 2023-10-03T10:12:02.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.059+0000 7f1ee6ffd700 1 -- 172.21.15.72:0/4238457168 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eec004de0 con 0x7f1ef806ee80 2023-10-03T10:12:02.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.059+0000 7f1ee6ffd700 1 -- 172.21.15.72:0/4238457168 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec0072f0 con 0x7f1ef806ee80 2023-10-03T10:12:02.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.060+0000 7f1efcf51700 1 -- 172.21.15.72:0/4238457168 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1edc0052e0 con 0x7f1ef806ee80 2023-10-03T10:12:02.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.060+0000 7f1ee6ffd700 1 -- 172.21.15.72:0/4238457168 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f1eec007450 con 0x7f1ef806ee80 2023-10-03T10:12:02.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.061+0000 7f1ee6ffd700 1 -- 172.21.15.72:0/4238457168 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f1eec03b430 con 0x7f1ef806ee80 2023-10-03T10:12:02.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.061+0000 7f1ef659c700 1 -- 172.21.15.72:0/4238457168 >> v1:172.21.15.72:6816/118184 conn(0x7f1ed802c1e0 legacy=0x7f1ed802e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:02.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.065+0000 7f1ee6ffd700 1 -- 172.21.15.72:0/4238457168 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f1eec0102c0 con 0x7f1ef806ee80 2023-10-03T10:12:02.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.156+0000 7f0ce7cbc700 1 Processor -- start 2023-10-03T10:12:02.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.157+0000 7f0ce7cbc700 1 -- start start 2023-10-03T10:12:02.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.157+0000 7f0ce7cbc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ce009e930 0x7f0ce009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.157+0000 7f0ce7cbc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ce009f240 0x7f0ce01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.157+0000 7f0ce7cbc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce0070940 con 0x7f0ce009f650 2023-10-03T10:12:02.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.157+0000 7f0ce7cbc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce006fd60 con 0x7f0ce009f240 2023-10-03T10:12:02.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.157+0000 7f0ce7cbc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce006fa80 con 0x7f0ce009e930 2023-10-03T10:12:02.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.158+0000 7f0ce5257700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ce009f240 0x7f0ce01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.158+0000 7f0ce5257700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ce009f240 0x7f0ce01317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55140/0 (socket says 172.21.15.72:55140) 2023-10-03T10:12:02.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.158+0000 7f0ce5257700 1 -- 172.21.15.72:0/3018269097 learned_addr learned my addr 172.21.15.72:0/3018269097 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:02.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.158+0000 7f0ce5a58700 1 --2- 172.21.15.72:0/3018269097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ce009e930 0x7f0ce009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.158+0000 7f0ce5a58700 1 -- 172.21.15.72:0/3018269097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ce009f240 msgr2=0x7f0ce01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:02.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.158+0000 7f0ce5a58700 1 --2- 172.21.15.72:0/3018269097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ce009f240 0x7f0ce01317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.158+0000 7f0ce5a58700 1 -- 172.21.15.72:0/3018269097 >> v1:172.21.15.72:6789/0 conn(0x7f0ce009f650 legacy=0x7f0ce0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.158+0000 7f0ce4a56700 1 -- 172.21.15.72:0/3018269097 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307783641 0 0) 0x7f0ce0070940 con 0x7f0ce009f650 2023-10-03T10:12:02.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.158+0000 7f0ce5a58700 1 -- 172.21.15.72:0/3018269097 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce009fb60 con 0x7f0ce009e930 2023-10-03T10:12:02.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.158+0000 7f0ce5a58700 1 --2- 172.21.15.72:0/3018269097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ce009e930 0x7f0ce009ed00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009870 tx=0x7f0cdc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e6fe0dc0c68361d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.158+0000 7f0ce4a56700 1 -- 172.21.15.72:0/3018269097 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc011830 con 0x7f0ce009e930 2023-10-03T10:12:02.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.158+0000 7f0ce4a56700 1 -- 172.21.15.72:0/3018269097 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc011990 con 0x7f0ce009e930 2023-10-03T10:12:02.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.158+0000 7f0ce4a56700 1 -- 172.21.15.72:0/3018269097 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc011d20 con 0x7f0ce009e930 2023-10-03T10:12:02.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.159+0000 7f0ce7cbc700 1 -- 172.21.15.72:0/3018269097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ce009e930 msgr2=0x7f0ce009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.159+0000 7f0ce7cbc700 1 --2- 172.21.15.72:0/3018269097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ce009e930 0x7f0ce009ed00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc009870 tx=0x7f0cdc009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:02.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.159+0000 7f0ce7cbc700 1 -- 172.21.15.72:0/3018269097 shutdown_connections 2023-10-03T10:12:02.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.159+0000 7f0ce7cbc700 1 --2- 172.21.15.72:0/3018269097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ce009e930 0x7f0ce009ed00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.159+0000 7f0ce7cbc700 1 --2- 172.21.15.72:0/3018269097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ce009f240 0x7f0ce01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.159+0000 7f0ce7cbc700 1 -- 172.21.15.72:0/3018269097 >> 172.21.15.72:0/3018269097 conn(0x7f0ce00a4210 msgr2=0x7f0ce00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:02.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.160+0000 7f0ce7cbc700 1 -- 172.21.15.72:0/3018269097 shutdown_connections 2023-10-03T10:12:02.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.160+0000 7f0ce7cbc700 1 -- 172.21.15.72:0/3018269097 wait complete. 2023-10-03T10:12:02.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.161+0000 7f0ce7cbc700 1 Processor -- start 2023-10-03T10:12:02.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.161+0000 7f0ce7cbc700 1 -- start start 2023-10-03T10:12:02.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.162+0000 7f0ce7cbc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ce009e930 0x7f0ce01a3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.162+0000 7f0ce7cbc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ce009f240 0x7f0ce01a4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.162+0000 7f0ce7cbc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ce009f650 0x7f0ce01a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:02.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.162+0000 7f0ce7cbc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce01a8060 con 0x7f0ce009e930 2023-10-03T10:12:02.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.162+0000 7f0ce7cbc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce01a5790 con 0x7f0ce009f650 2023-10-03T10:12:02.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.162+0000 7f0ce7cbc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce01a5db0 con 0x7f0ce009f240 2023-10-03T10:12:02.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.162+0000 7f0ce6259700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ce009f650 0x7f0ce01a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.162+0000 7f0ce6259700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ce009f650 0x7f0ce01a4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55144/0 (socket says 172.21.15.72:55144) 2023-10-03T10:12:02.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.162+0000 7f0ce6259700 1 -- 172.21.15.72:0/377779246 learned_addr learned my addr 172.21.15.72:0/377779246 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:02.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.162+0000 7f0ce5257700 1 --2- 172.21.15.72:0/377779246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ce009f240 0x7f0ce01a4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:02.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.162+0000 7f0ce6259700 1 -- 172.21.15.72:0/377779246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ce009f240 msgr2=0x7f0ce01a4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.162+0000 7f0ce6259700 1 --2- 172.21.15.72:0/377779246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ce009f240 0x7f0ce01a4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.162+0000 7f0ce6259700 1 -- 172.21.15.72:0/377779246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ce009e930 msgr2=0x7f0ce01a3c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:02.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.162+0000 7f0ce6259700 1 --2- 172.21.15.72:0/377779246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ce009e930 0x7f0ce01a3c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.162+0000 7f0ce6259700 1 -- 172.21.15.72:0/377779246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc0094a0 con 0x7f0ce009f650 2023-10-03T10:12:02.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.163+0000 7f0ce6259700 1 --2- 172.21.15.72:0/377779246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ce009f650 0x7f0ce01a4690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800c820 tx=0x7f0cd800cb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:02.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.163+0000 7f0cd67fc700 1 -- 172.21.15.72:0/377779246 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8003e30 con 0x7f0ce009f650 2023-10-03T10:12:02.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.163+0000 7f0cd67fc700 1 -- 172.21.15.72:0/377779246 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd8011680 con 0x7f0ce009f650 2023-10-03T10:12:02.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.163+0000 7f0ce7cbc700 1 -- 172.21.15.72:0/377779246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce00a0190 con 0x7f0ce009f650 2023-10-03T10:12:02.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.163+0000 7f0cd67fc700 1 -- 172.21.15.72:0/377779246 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80119f0 con 0x7f0ce009f650 2023-10-03T10:12:02.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.163+0000 7f0ce7cbc700 1 -- 172.21.15.72:0/377779246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce00a33f0 con 0x7f0ce009f650 2023-10-03T10:12:02.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.164+0000 7f0ce7cbc700 1 -- 172.21.15.72:0/377779246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce0074ea0 con 0x7f0ce009f650 2023-10-03T10:12:02.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.165+0000 7f0cd67fc700 1 -- 172.21.15.72:0/377779246 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f0cd8017070 con 0x7f0ce009f650 2023-10-03T10:12:02.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.165+0000 7f0cd67fc700 1 -- 172.21.15.72:0/377779246 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f0cd803f470 con 0x7f0ce009f650 2023-10-03T10:12:02.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.168+0000 7f0ce5a58700 1 -- 172.21.15.72:0/377779246 >> v1:172.21.15.72:6816/118184 conn(0x7f0cc402c1b0 legacy=0x7f0cc402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:02.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.172+0000 7f0cd67fc700 1 -- 172.21.15.72:0/377779246 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f0cd8017320 con 0x7f0ce009f650 2023-10-03T10:12:02.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.210+0000 7f7cd648f700 1 -- 172.21.15.72:0/2402434368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7cd0135800 con 0x7f7cd006e570 2023-10-03T10:12:02.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.211+0000 7f7cccff9700 1 -- 172.21.15.72:0/2402434368 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7cc001a430 con 0x7f7cd006e570 2023-10-03T10:12:02.211 INFO:teuthology.orchestra.run.smithi072.stdout:38654705694 2023-10-03T10:12:02.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.214+0000 7f7cd648f700 1 -- 172.21.15.72:0/2402434368 >> v1:172.21.15.72:6816/118184 conn(0x7f7cbc02c1e0 legacy=0x7f7cbc02e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:02.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.214+0000 7f7cd648f700 1 -- 172.21.15.72:0/2402434368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd006e570 msgr2=0x7f7cd013ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.214+0000 7f7cd648f700 1 --2- 172.21.15.72:0/2402434368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd006e570 0x7f7cd013ad90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009fd0 tx=0x7f7cc0004750 comp rx=0 tx=0).stop 2023-10-03T10:12:02.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.214+0000 7f7cd648f700 1 -- 172.21.15.72:0/2402434368 shutdown_connections 2023-10-03T10:12:02.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.214+0000 7f7cd648f700 1 --2- 172.21.15.72:0/2402434368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd006e570 0x7f7cd013ad90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.214+0000 7f7cd648f700 1 --2- 172.21.15.72:0/2402434368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd01279f0 0x7f7cd01266a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.214+0000 7f7cd648f700 1 --2- 172.21.15.72:0/2402434368 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd0134610 0x7f7cd0126160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.214+0000 7f7cd648f700 1 -- 172.21.15.72:0/2402434368 >> 172.21.15.72:0/2402434368 conn(0x7f7cd00a2aa0 msgr2=0x7f7cd0099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:02.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.214+0000 7f7cd648f700 1 -- 172.21.15.72:0/2402434368 shutdown_connections 2023-10-03T10:12:02.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.214+0000 7f7cd648f700 1 -- 172.21.15.72:0/2402434368 wait complete. 2023-10-03T10:12:02.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.1 2023-10-03T10:12:02.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.233+0000 7f5289d27700 1 -- 172.21.15.72:0/1874277814 >> v1:172.21.15.72:6816/118184 conn(0x7f526802c1b0 legacy=0x7f526802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:02.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.262+0000 7f1ef659c700 1 -- 172.21.15.72:0/4238457168 >> v1:172.21.15.72:6816/118184 conn(0x7f1ed802c1e0 legacy=0x7f1ed802e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:02.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.267+0000 7f528c78c700 1 -- 172.21.15.72:0/1874277814 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f52840713a0 con 0x7f528406f5d0 2023-10-03T10:12:02.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.267+0000 7f527affd700 1 -- 172.21.15.72:0/1874277814 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f52800186e0 con 0x7f528406f5d0 2023-10-03T10:12:02.268 INFO:teuthology.orchestra.run.smithi072.stdout:38654705694 2023-10-03T10:12:02.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.269+0000 7f528c78c700 1 -- 172.21.15.72:0/1874277814 >> v1:172.21.15.72:6816/118184 conn(0x7f526802c1b0 legacy=0x7f526802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:02.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.269+0000 7f528c78c700 1 -- 172.21.15.72:0/1874277814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f528406f5d0 msgr2=0x7f5284099d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.269+0000 7f528c78c700 1 --2- 172.21.15.72:0/1874277814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f528406f5d0 0x7f5284099d50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f528000c490 tx=0x7f528000c7a0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.269+0000 7f528c78c700 1 -- 172.21.15.72:0/1874277814 shutdown_connections 2023-10-03T10:12:02.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.269+0000 7f528c78c700 1 --2- 172.21.15.72:0/1874277814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f528406f5d0 0x7f5284099d50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.269+0000 7f528c78c700 1 --2- 172.21.15.72:0/1874277814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5284135c20 0x7f528409a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.269+0000 7f528c78c700 1 --2- 172.21.15.72:0/1874277814 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f528412cf60 0x7f528409a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.269+0000 7f528c78c700 1 -- 172.21.15.72:0/1874277814 >> 172.21.15.72:0/1874277814 conn(0x7f52840a2aa0 msgr2=0x7f528406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:02.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.269+0000 7f528c78c700 1 -- 172.21.15.72:0/1874277814 shutdown_connections 2023-10-03T10:12:02.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.269+0000 7f528c78c700 1 -- 172.21.15.72:0/1874277814 wait complete. 2023-10-03T10:12:02.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.0 2023-10-03T10:12:02.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.318+0000 7f1efcf51700 1 -- 172.21.15.72:0/4238457168 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1edc005590 con 0x7f1ef806ee80 2023-10-03T10:12:02.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.319+0000 7f1ee6ffd700 1 -- 172.21.15.72:0/4238457168 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1eec011360 con 0x7f1ef806ee80 2023-10-03T10:12:02.320 INFO:teuthology.orchestra.run.smithi072.stdout:38654705693 2023-10-03T10:12:02.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.321+0000 7f1efcf51700 1 -- 172.21.15.72:0/4238457168 >> v1:172.21.15.72:6816/118184 conn(0x7f1ed802c1e0 legacy=0x7f1ed802e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:02.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.321+0000 7f1efcf51700 1 -- 172.21.15.72:0/4238457168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ef806ee80 msgr2=0x7f1ef8123850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.321+0000 7f1efcf51700 1 --2- 172.21.15.72:0/4238457168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ef806ee80 0x7f1ef8123850 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1ef806b700 tx=0x7f1eec00ca30 comp rx=0 tx=0).stop 2023-10-03T10:12:02.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.321+0000 7f1efcf51700 1 -- 172.21.15.72:0/4238457168 shutdown_connections 2023-10-03T10:12:02.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.321+0000 7f1efcf51700 1 --2- 172.21.15.72:0/4238457168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ef806e570 0x7f1ef8123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.321+0000 7f1efcf51700 1 --2- 172.21.15.72:0/4238457168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ef8123d90 0x7f1ef81cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.321+0000 7f1efcf51700 1 --2- 172.21.15.72:0/4238457168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ef806ee80 0x7f1ef8123850 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.321+0000 7f1efcf51700 1 -- 172.21.15.72:0/4238457168 >> 172.21.15.72:0/4238457168 conn(0x7f1ef80a2aa0 msgr2=0x7f1ef80a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:02.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.321+0000 7f1efcf51700 1 -- 172.21.15.72:0/4238457168 shutdown_connections 2023-10-03T10:12:02.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.321+0000 7f1efcf51700 1 -- 172.21.15.72:0/4238457168 wait complete. 2023-10-03T10:12:02.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.3 2023-10-03T10:12:02.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.369+0000 7f0ce5a58700 1 -- 172.21.15.72:0/377779246 >> v1:172.21.15.72:6816/118184 conn(0x7f0cc402c1b0 legacy=0x7f0cc402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:02.370 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:02.369+0000 7f6aece4b240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-03T10:12:02.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.421+0000 7f0ce7cbc700 1 -- 172.21.15.72:0/377779246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ce006b250 con 0x7f0ce009f650 2023-10-03T10:12:02.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.421+0000 7f0cd67fc700 1 -- 172.21.15.72:0/377779246 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0cd8028020 con 0x7f0ce009f650 2023-10-03T10:12:02.422 INFO:teuthology.orchestra.run.smithi072.stdout:38654705694 2023-10-03T10:12:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.423+0000 7f0ce7cbc700 1 -- 172.21.15.72:0/377779246 >> v1:172.21.15.72:6816/118184 conn(0x7f0cc402c1b0 legacy=0x7f0cc402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.423+0000 7f0ce7cbc700 1 -- 172.21.15.72:0/377779246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ce009f650 msgr2=0x7f0ce01a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.423+0000 7f0ce7cbc700 1 --2- 172.21.15.72:0/377779246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ce009f650 0x7f0ce01a4690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800c820 tx=0x7f0cd800cb30 comp rx=0 tx=0).stop 2023-10-03T10:12:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.423+0000 7f0ce7cbc700 1 -- 172.21.15.72:0/377779246 shutdown_connections 2023-10-03T10:12:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.423+0000 7f0ce7cbc700 1 --2- 172.21.15.72:0/377779246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ce009e930 0x7f0ce01a3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.423+0000 7f0ce7cbc700 1 --2- 172.21.15.72:0/377779246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ce009f650 0x7f0ce01a4690 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.423+0000 7f0ce7cbc700 1 --2- 172.21.15.72:0/377779246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ce009f240 0x7f0ce01a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.423+0000 7f0ce7cbc700 1 -- 172.21.15.72:0/377779246 >> 172.21.15.72:0/377779246 conn(0x7f0ce00a4210 msgr2=0x7f0ce01b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.423+0000 7f0ce7cbc700 1 -- 172.21.15.72:0/377779246 shutdown_connections 2023-10-03T10:12:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:02.423+0000 7f0ce7cbc700 1 -- 172.21.15.72:0/377779246 wait complete. 2023-10-03T10:12:02.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.2 2023-10-03T10:12:02.515 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:02.515+0000 7f6aece4b240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-03T10:12:02.588 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:02.587+0000 7f6aece4b240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-03T10:12:02.723 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:02.722+0000 7f6aece4b240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-03T10:12:02.792 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:02.792+0000 7f6aece4b240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-03T10:12:02.950 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:02.949+0000 7f6aece4b240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-03T10:12:03.029 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:03.028+0000 7f6aece4b240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-03T10:12:03.106 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:03.105+0000 7f6aece4b240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-03T10:12:03.196 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:03.195+0000 7f6aece4b240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-03T10:12:03.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:03.282 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:03.334 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:03.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.362+0000 7fae3aa9f700 1 Processor -- start 2023-10-03T10:12:03.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.362+0000 7fae3aa9f700 1 -- start start 2023-10-03T10:12:03.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.362+0000 7fae3aa9f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae3409d6f0 0x7fae3409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.362+0000 7fae3aa9f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fae3409e000 0x7fae34130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.362+0000 7fae3aa9f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae3409e410 0x7fae34130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.362+0000 7fae3aa9f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3409f520 con 0x7fae3409e000 2023-10-03T10:12:03.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.362+0000 7fae3aa9f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3409f130 con 0x7fae3409e410 2023-10-03T10:12:03.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.362+0000 7fae3aa9f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae3409e930 con 0x7fae3409d6f0 2023-10-03T10:12:03.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.363+0000 7fae33fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fae3409e000 0x7fae34130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.363+0000 7fae33fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fae3409e000 0x7fae34130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50584/0 (socket says 172.21.15.72:50584) 2023-10-03T10:12:03.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.363+0000 7fae33fff700 1 -- 172.21.15.72:0/1642702736 learned_addr learned my addr 172.21.15.72:0/1642702736 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:03.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.363+0000 7fae33fff700 1 -- 172.21.15.72:0/1642702736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae3409d6f0 msgr2=0x7fae3409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.363+0000 7fae33fff700 1 --2- 172.21.15.72:0/1642702736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae3409d6f0 0x7fae3409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.363+0000 7fae33fff700 1 -- 172.21.15.72:0/1642702736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae3409e410 msgr2=0x7fae34130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.363+0000 7fae33fff700 1 --2- 172.21.15.72:0/1642702736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae3409e410 0x7fae34130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.363+0000 7fae33fff700 1 -- 172.21.15.72:0/1642702736 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3409b2d0 con 0x7fae3409e000 2023-10-03T10:12:03.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.363+0000 7fae33fff700 1 --2- 172.21.15.72:0/1642702736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae3409e000 0x7fae34130660 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fae2000bbc0 tx=0x7fae2000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18d16a0656023be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.363+0000 7fae337fe700 1 -- 172.21.15.72:0/1642702736 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2000dd50 con 0x7fae3409e000 2023-10-03T10:12:03.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.363+0000 7fae337fe700 1 -- 172.21.15.72:0/1642702736 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae20010470 con 0x7fae3409e000 2023-10-03T10:12:03.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.363+0000 7fae337fe700 1 -- 172.21.15.72:0/1642702736 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20010800 con 0x7fae3409e000 2023-10-03T10:12:03.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.364+0000 7fae3aa9f700 1 -- 172.21.15.72:0/1642702736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae3409e000 msgr2=0x7fae34130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.364+0000 7fae3aa9f700 1 --2- 172.21.15.72:0/1642702736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae3409e000 0x7fae34130660 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fae2000bbc0 tx=0x7fae2000bed0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.364+0000 7fae3aa9f700 1 -- 172.21.15.72:0/1642702736 shutdown_connections 2023-10-03T10:12:03.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.365+0000 7fae3aa9f700 1 --2- 172.21.15.72:0/1642702736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae3409e410 0x7fae34130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.365+0000 7fae3aa9f700 1 --2- 172.21.15.72:0/1642702736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae3409d6f0 0x7fae3409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.365+0000 7fae3aa9f700 1 --2- 172.21.15.72:0/1642702736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae3409e000 0x7fae34130660 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.365+0000 7fae3aa9f700 1 -- 172.21.15.72:0/1642702736 >> 172.21.15.72:0/1642702736 conn(0x7fae34066f50 msgr2=0x7fae3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.365+0000 7fae3aa9f700 1 -- 172.21.15.72:0/1642702736 shutdown_connections 2023-10-03T10:12:03.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.365+0000 7fae3aa9f700 1 -- 172.21.15.72:0/1642702736 wait complete. 2023-10-03T10:12:03.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.366+0000 7fae3aa9f700 1 Processor -- start 2023-10-03T10:12:03.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.366+0000 7fae3aa9f700 1 -- start start 2023-10-03T10:12:03.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3aa9f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae3409d6f0 0x7fae3411e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3aa9f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae3409e000 0x7fae3411e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3aa9f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae3409e410 0x7fae3411ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3aa9f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae34121eb0 con 0x7fae3409e410 2023-10-03T10:12:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3aa9f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3411ffa0 con 0x7fae3409e000 2023-10-03T10:12:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3aa9f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae34120550 con 0x7fae3409d6f0 2023-10-03T10:12:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3903c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae3409e410 0x7fae3411ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3883b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae3409d6f0 0x7fae3411e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3903c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae3409e410 0x7fae3411ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50592/0 (socket says 172.21.15.72:50592) 2023-10-03T10:12:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3903c700 1 -- 172.21.15.72:0/1229027818 learned_addr learned my addr 172.21.15.72:0/1229027818 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3883b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae3409d6f0 0x7fae3411e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:43488/0 (socket says 172.21.15.72:43488) 2023-10-03T10:12:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae33fff700 1 --2- 172.21.15.72:0/1229027818 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae3409e000 0x7fae3411e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3883b700 1 -- 172.21.15.72:0/1229027818 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae3409e000 msgr2=0x7fae3411e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3883b700 1 --2- 172.21.15.72:0/1229027818 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae3409e000 0x7fae3411e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3883b700 1 -- 172.21.15.72:0/1229027818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae3409e410 msgr2=0x7fae3411ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3883b700 1 --2- 172.21.15.72:0/1229027818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae3409e410 0x7fae3411ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.367+0000 7fae3883b700 1 -- 172.21.15.72:0/1229027818 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2000b7f0 con 0x7fae3409d6f0 2023-10-03T10:12:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.368+0000 7fae3883b700 1 --2- 172.21.15.72:0/1229027818 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae3409d6f0 0x7fae3411e390 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fae2800b450 tx=0x7fae2800b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.368+0000 7fae317fa700 1 -- 172.21.15.72:0/1229027818 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28011830 con 0x7fae3409d6f0 2023-10-03T10:12:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.368+0000 7fae317fa700 1 -- 172.21.15.72:0/1229027818 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae28011990 con 0x7fae3409d6f0 2023-10-03T10:12:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.368+0000 7fae317fa700 1 -- 172.21.15.72:0/1229027818 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae28011d40 con 0x7fae3409d6f0 2023-10-03T10:12:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.368+0000 7fae3aa9f700 1 -- 172.21.15.72:0/1229027818 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae340a1ba0 con 0x7fae3409d6f0 2023-10-03T10:12:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.368+0000 7fae3aa9f700 1 -- 172.21.15.72:0/1229027818 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3409c760 con 0x7fae3409d6f0 2023-10-03T10:12:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.369+0000 7fae317fa700 1 -- 172.21.15.72:0/1229027818 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fae2801a400 con 0x7fae3409d6f0 2023-10-03T10:12:03.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.369+0000 7fae317fa700 1 -- 172.21.15.72:0/1229027818 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fae2803b6e0 con 0x7fae3409d6f0 2023-10-03T10:12:03.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.369+0000 7fae3aa9f700 1 -- 172.21.15.72:0/1229027818 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae34122700 con 0x7fae3409d6f0 2023-10-03T10:12:03.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.369+0000 7fae33fff700 1 -- 172.21.15.72:0/1229027818 >> v1:172.21.15.72:6816/118184 conn(0x7fae1802c1b0 legacy=0x7fae1802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:03.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.377+0000 7fae317fa700 1 -- 172.21.15.72:0/1229027818 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fae28015020 con 0x7fae3409d6f0 2023-10-03T10:12:03.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.416+0000 7fca90a65700 1 Processor -- start 2023-10-03T10:12:03.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.416+0000 7fca90a65700 1 -- start start 2023-10-03T10:12:03.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.417+0000 7fca90a65700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca8c09fa10 0x7fca8c136950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.417+0000 7fca90a65700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca8c09f2c0 0x7fca8c138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.417+0000 7fca90a65700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8c09b610 con 0x7fca8c09e7e0 2023-10-03T10:12:03.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.417+0000 7fca90a65700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8c09bbb0 con 0x7fca8c09f2c0 2023-10-03T10:12:03.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.417+0000 7fca90a65700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c0a0010 con 0x7fca8c09fa10 2023-10-03T10:12:03.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.417+0000 7fca89d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca8c09fa10 0x7fca8c136950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.417+0000 7fca8ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca8c09f2c0 0x7fca8c138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.417+0000 7fca8a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fca8c09e7e0 0x7fca8c09ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57528/0 (socket says 172.21.15.72:57528) 2023-10-03T10:12:03.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.417+0000 7fca8a59c700 1 -- 172.21.15.72:0/2954998950 learned_addr learned my addr 172.21.15.72:0/2954998950 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:03.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.417+0000 7fca89d9b700 1 -- 172.21.15.72:0/2954998950 >> v2:172.21.15.72:3300/0 conn(0x7fca8c09f2c0 msgr2=0x7fca8c138ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.417+0000 7fca89d9b700 1 --2- 172.21.15.72:0/2954998950 >> v2:172.21.15.72:3300/0 conn(0x7fca8c09f2c0 0x7fca8c138ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.417+0000 7fca89d9b700 1 -- 172.21.15.72:0/2954998950 >> v1:172.21.15.72:6789/0 conn(0x7fca8c09e7e0 legacy=0x7fca8c09ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.417+0000 7fca89d9b700 1 -- 172.21.15.72:0/2954998950 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c09b8d0 con 0x7fca8c09fa10 2023-10-03T10:12:03.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.418+0000 7fca89d9b700 1 --2- 172.21.15.72:0/2954998950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca8c09fa10 0x7fca8c136950 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fca80009840 tx=0x7fca80009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82902cee04ad1844 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.418+0000 7fca8959a700 1 -- 172.21.15.72:0/2954998950 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80011830 con 0x7fca8c09fa10 2023-10-03T10:12:03.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.418+0000 7fca8959a700 1 -- 172.21.15.72:0/2954998950 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca80011990 con 0x7fca8c09fa10 2023-10-03T10:12:03.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.418+0000 7fca8959a700 1 -- 172.21.15.72:0/2954998950 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80011d20 con 0x7fca8c09fa10 2023-10-03T10:12:03.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.418+0000 7fca90a65700 1 -- 172.21.15.72:0/2954998950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca8c09fa10 msgr2=0x7fca8c136950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.419+0000 7fca90a65700 1 --2- 172.21.15.72:0/2954998950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca8c09fa10 0x7fca8c136950 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fca80009840 tx=0x7fca80009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:03.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.419+0000 7fca90a65700 1 -- 172.21.15.72:0/2954998950 shutdown_connections 2023-10-03T10:12:03.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.419+0000 7fca90a65700 1 --2- 172.21.15.72:0/2954998950 >> v2:172.21.15.72:3300/0 conn(0x7fca8c09f2c0 0x7fca8c138ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.419+0000 7fca90a65700 1 --2- 172.21.15.72:0/2954998950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca8c09fa10 0x7fca8c136950 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.419+0000 7fca90a65700 1 -- 172.21.15.72:0/2954998950 >> 172.21.15.72:0/2954998950 conn(0x7fca8c0a4300 msgr2=0x7fca8c0a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.419+0000 7fca90a65700 1 -- 172.21.15.72:0/2954998950 shutdown_connections 2023-10-03T10:12:03.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.419+0000 7fca90a65700 1 -- 172.21.15.72:0/2954998950 wait complete. 2023-10-03T10:12:03.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.420+0000 7fca90a65700 1 Processor -- start 2023-10-03T10:12:03.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.420+0000 7fca90a65700 1 -- start start 2023-10-03T10:12:03.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.420+0000 7fca90a65700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca8c09e7e0 0x7fca8c1a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.420+0000 7fca90a65700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca8c09f2c0 0x7fca8c1a2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.420+0000 7fca90a65700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca8c09fa10 0x7fca8c1a25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.420+0000 7fca90a65700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c1a2fd0 con 0x7fca8c09e7e0 2023-10-03T10:12:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.420+0000 7fca90a65700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c1a3730 con 0x7fca8c09f2c0 2023-10-03T10:12:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.420+0000 7fca90a65700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c1a4980 con 0x7fca8c09fa10 2023-10-03T10:12:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.420+0000 7fca89d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca8c09f2c0 0x7fca8c1a2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.420+0000 7fca89d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca8c09f2c0 0x7fca8c1a2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55184/0 (socket says 172.21.15.72:55184) 2023-10-03T10:12:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.420+0000 7fca89d9b700 1 -- 172.21.15.72:0/1408518008 learned_addr learned my addr 172.21.15.72:0/1408518008 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.420+0000 7fca8a59c700 1 --2- 172.21.15.72:0/1408518008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca8c09e7e0 0x7fca8c1a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.421+0000 7fca8ad9d700 1 --2- 172.21.15.72:0/1408518008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca8c09fa10 0x7fca8c1a25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.421+0000 7fca89d9b700 1 -- 172.21.15.72:0/1408518008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca8c09fa10 msgr2=0x7fca8c1a25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.421+0000 7fca89d9b700 1 --2- 172.21.15.72:0/1408518008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca8c09fa10 0x7fca8c1a25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.421+0000 7fca89d9b700 1 -- 172.21.15.72:0/1408518008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca8c09e7e0 msgr2=0x7fca8c1a1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.421+0000 7fca89d9b700 1 --2- 172.21.15.72:0/1408518008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca8c09e7e0 0x7fca8c1a1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.421+0000 7fca89d9b700 1 -- 172.21.15.72:0/1408518008 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca800094a0 con 0x7fca8c09f2c0 2023-10-03T10:12:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.421+0000 7fca8ad9d700 1 --2- 172.21.15.72:0/1408518008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca8c09fa10 0x7fca8c1a25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.421+0000 7fca89d9b700 1 --2- 172.21.15.72:0/1408518008 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca8c09f2c0 0x7fca8c1a2060 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fca800090b0 tx=0x7fca80004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.421+0000 7fca7affd700 1 -- 172.21.15.72:0/1408518008 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca800036a0 con 0x7fca8c09f2c0 2023-10-03T10:12:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.421+0000 7fca90a65700 1 -- 172.21.15.72:0/1408518008 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8c1a5360 con 0x7fca8c09f2c0 2023-10-03T10:12:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.421+0000 7fca7affd700 1 -- 172.21.15.72:0/1408518008 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8001f070 con 0x7fca8c09f2c0 2023-10-03T10:12:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.421+0000 7fca7affd700 1 -- 172.21.15.72:0/1408518008 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80003a60 con 0x7fca8c09f2c0 2023-10-03T10:12:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.421+0000 7fca90a65700 1 -- 172.21.15.72:0/1408518008 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8c09d9c0 con 0x7fca8c09f2c0 2023-10-03T10:12:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.422+0000 7fca90a65700 1 -- 172.21.15.72:0/1408518008 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8c09f830 con 0x7fca8c09f2c0 2023-10-03T10:12:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.423+0000 7fca7affd700 1 -- 172.21.15.72:0/1408518008 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fca80003bc0 con 0x7fca8c09f2c0 2023-10-03T10:12:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.423+0000 7fca7affd700 1 -- 172.21.15.72:0/1408518008 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fca80021070 con 0x7fca8c09f2c0 2023-10-03T10:12:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.423+0000 7fca8a59c700 1 -- 172.21.15.72:0/1408518008 >> v1:172.21.15.72:6816/118184 conn(0x7fca6c02c1b0 legacy=0x7fca6c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:03.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.427+0000 7fca7affd700 1 -- 172.21.15.72:0/1408518008 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fca80010d50 con 0x7fca8c09f2c0 2023-10-03T10:12:03.437 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:03.478 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:03.477+0000 7f6aece4b240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-03T10:12:03.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.526+0000 7f503f251700 1 Processor -- start 2023-10-03T10:12:03.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.526+0000 7f503f251700 1 -- start start 2023-10-03T10:12:03.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.527+0000 7f503f251700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50381316c0 0x7f5038131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.527+0000 7f503f251700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f503806ae80 0x7f5038139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.527+0000 7f503f251700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503809e130 con 0x7f503809d9f0 2023-10-03T10:12:03.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.527+0000 7f503f251700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50381312b0 con 0x7f50381316c0 2023-10-03T10:12:03.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.527+0000 7f503f251700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f503809f6e0 con 0x7f503806ae80 2023-10-03T10:12:03.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.527+0000 7f5037fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f503809d9f0 0x7f503806a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57542/0 (socket says 172.21.15.72:57542) 2023-10-03T10:12:03.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.527+0000 7f5037fff700 1 -- 172.21.15.72:0/4186627724 learned_addr learned my addr 172.21.15.72:0/4186627724 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:03.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.527+0000 7f503d7ee700 1 --2- 172.21.15.72:0/4186627724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f503806ae80 0x7f5038139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.528+0000 7f503cfed700 1 --2- 172.21.15.72:0/4186627724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50381316c0 0x7f5038131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.528+0000 7f50377fe700 1 -- 172.21.15.72:0/4186627724 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616603825 0 0) 0x7f5024001110 con 0x7f503809d9f0 2023-10-03T10:12:03.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.528+0000 7f50377fe700 1 -- 172.21.15.72:0/4186627724 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50280035b0 con 0x7f503809d9f0 2023-10-03T10:12:03.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.528+0000 7f503d7ee700 1 -- 172.21.15.72:0/4186627724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50381316c0 msgr2=0x7f5038131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.528+0000 7f503d7ee700 1 --2- 172.21.15.72:0/4186627724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50381316c0 0x7f5038131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.528+0000 7f503d7ee700 1 -- 172.21.15.72:0/4186627724 >> v1:172.21.15.72:6789/0 conn(0x7f503809d9f0 legacy=0x7f503806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.528+0000 7f503d7ee700 1 -- 172.21.15.72:0/4186627724 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503809e760 con 0x7f503806ae80 2023-10-03T10:12:03.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.528+0000 7f503d7ee700 1 --2- 172.21.15.72:0/4186627724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f503806ae80 0x7f5038139550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5030009dc0 tx=0x7f503000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92f4235fe8aebc08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.528+0000 7f50377fe700 1 -- 172.21.15.72:0/4186627724 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503000e070 con 0x7f503806ae80 2023-10-03T10:12:03.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.528+0000 7f50377fe700 1 -- 172.21.15.72:0/4186627724 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503000bae0 con 0x7f503806ae80 2023-10-03T10:12:03.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.528+0000 7f50377fe700 1 -- 172.21.15.72:0/4186627724 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503000be90 con 0x7f503806ae80 2023-10-03T10:12:03.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.529+0000 7f503f251700 1 -- 172.21.15.72:0/4186627724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f503806ae80 msgr2=0x7f5038139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.529+0000 7f503f251700 1 --2- 172.21.15.72:0/4186627724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f503806ae80 0x7f5038139550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5030009dc0 tx=0x7f503000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:03.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.529+0000 7f503f251700 1 -- 172.21.15.72:0/4186627724 shutdown_connections 2023-10-03T10:12:03.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.529+0000 7f503f251700 1 --2- 172.21.15.72:0/4186627724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f503806ae80 0x7f5038139550 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.529+0000 7f503f251700 1 --2- 172.21.15.72:0/4186627724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50381316c0 0x7f5038131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.529+0000 7f503f251700 1 -- 172.21.15.72:0/4186627724 >> 172.21.15.72:0/4186627724 conn(0x7f5038066f50 msgr2=0x7f503809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.530+0000 7f503f251700 1 -- 172.21.15.72:0/4186627724 shutdown_connections 2023-10-03T10:12:03.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.530+0000 7f503f251700 1 -- 172.21.15.72:0/4186627724 wait complete. 2023-10-03T10:12:03.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.531+0000 7f503f251700 1 Processor -- start 2023-10-03T10:12:03.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.531+0000 7f503f251700 1 -- start start 2023-10-03T10:12:03.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.532+0000 7f503f251700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f503806ae80 0x7f503811df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.532+0000 7f503f251700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f503809d9f0 0x7f503811c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.532+0000 7f503f251700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50381316c0 0x7f503811ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.532+0000 7f503f251700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503811b480 con 0x7f503809d9f0 2023-10-03T10:12:03.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.532+0000 7f503f251700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503811baa0 con 0x7f503806ae80 2023-10-03T10:12:03.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.532+0000 7f503f251700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f503811bd10 con 0x7f50381316c0 2023-10-03T10:12:03.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.532+0000 7f503d7ee700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50381316c0 0x7f503811ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.532+0000 7f503d7ee700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50381316c0 0x7f503811ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:43508/0 (socket says 172.21.15.72:43508) 2023-10-03T10:12:03.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.532+0000 7f503d7ee700 1 -- 172.21.15.72:0/2655180527 learned_addr learned my addr 172.21.15.72:0/2655180527 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:03.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.532+0000 7f5037fff700 1 --2- 172.21.15.72:0/2655180527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f503809d9f0 0x7f503811c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.533+0000 7f503d7ee700 1 -- 172.21.15.72:0/2655180527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f503806ae80 msgr2=0x7f503811df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.533+0000 7f503d7ee700 1 --2- 172.21.15.72:0/2655180527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f503806ae80 0x7f503811df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.533+0000 7f503d7ee700 1 -- 172.21.15.72:0/2655180527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f503809d9f0 msgr2=0x7f503811c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.533+0000 7f503d7ee700 1 --2- 172.21.15.72:0/2655180527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f503809d9f0 0x7f503811c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.533+0000 7f503d7ee700 1 -- 172.21.15.72:0/2655180527 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5030009a70 con 0x7f50381316c0 2023-10-03T10:12:03.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.533+0000 7f503d7ee700 1 --2- 172.21.15.72:0/2655180527 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50381316c0 0x7f503811ce30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f503000b370 tx=0x7f5030004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.533+0000 7f50357fa700 1 -- 172.21.15.72:0/2655180527 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030004610 con 0x7f50381316c0 2023-10-03T10:12:03.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.533+0000 7f503f251700 1 -- 172.21.15.72:0/2655180527 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503812b520 con 0x7f50381316c0 2023-10-03T10:12:03.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.533+0000 7f503f251700 1 -- 172.21.15.72:0/2655180527 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503811b770 con 0x7f50381316c0 2023-10-03T10:12:03.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.533+0000 7f50357fa700 1 -- 172.21.15.72:0/2655180527 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5030004770 con 0x7f50381316c0 2023-10-03T10:12:03.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.533+0000 7f50357fa700 1 -- 172.21.15.72:0/2655180527 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030026650 con 0x7f50381316c0 2023-10-03T10:12:03.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.534+0000 7f503f251700 1 -- 172.21.15.72:0/2655180527 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50180052e0 con 0x7f50381316c0 2023-10-03T10:12:03.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.535+0000 7f50357fa700 1 -- 172.21.15.72:0/2655180527 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f5030012430 con 0x7f50381316c0 2023-10-03T10:12:03.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.535+0000 7f50357fa700 1 -- 172.21.15.72:0/2655180527 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f503003d210 con 0x7f50381316c0 2023-10-03T10:12:03.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.535+0000 7f503cfed700 1 -- 172.21.15.72:0/2655180527 >> v1:172.21.15.72:6816/118184 conn(0x7f501c02c1b0 legacy=0x7f501c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:03.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.543+0000 7f50357fa700 1 -- 172.21.15.72:0/2655180527 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f5030019760 con 0x7f50381316c0 2023-10-03T10:12:03.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.570+0000 7fae33fff700 1 -- 172.21.15.72:0/1229027818 >> v1:172.21.15.72:6816/118184 conn(0x7fae1802c1b0 legacy=0x7fae1802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:03.579 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:03.578+0000 7f6aece4b240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-03T10:12:03.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.583+0000 7f9df0cb8700 1 Processor -- start 2023-10-03T10:12:03.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.583+0000 7f9df0cb8700 1 -- start start 2023-10-03T10:12:03.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.583+0000 7f9df0cb8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dec09d6f0 0x7f9dec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.583+0000 7f9df0cb8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dec09e000 0x7f9dec1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.583+0000 7f9df0cb8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dec09b120 con 0x7f9dec09e410 2023-10-03T10:12:03.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.583+0000 7f9df0cb8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec06b460 con 0x7f9dec09e000 2023-10-03T10:12:03.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.583+0000 7f9df0cb8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec09a7e0 con 0x7f9dec09d6f0 2023-10-03T10:12:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9dead9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9dec09e410 0x7f9dec133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57544/0 (socket says 172.21.15.72:57544) 2023-10-03T10:12:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9dead9d700 1 -- 172.21.15.72:0/2129159757 learned_addr learned my addr 172.21.15.72:0/2129159757 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 -- 172.21.15.72:0/2129159757 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710241356 0 0) 0x7f9dec09b120 con 0x7f9dec09e410 2023-10-03T10:12:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 -- 172.21.15.72:0/2129159757 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dd40035b0 con 0x7f9dec09e410 2023-10-03T10:12:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 -- 172.21.15.72:0/2129159757 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2249364462 0 0) 0x7f9dd40035b0 con 0x7f9dec09e410 2023-10-03T10:12:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 -- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dec09d6f0 msgr2=0x7f9dec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 --2- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dec09d6f0 0x7f9dec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 -- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dec09e000 msgr2=0x7f9dec1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 --2- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dec09e000 0x7f9dec1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 -- 172.21.15.72:0/2129159757 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec09a500 con 0x7f9dec09e410 2023-10-03T10:12:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 -- 172.21.15.72:0/2129159757 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 244944926 0 0) 0x7f9de40019f0 con 0x7f9dec09e410 2023-10-03T10:12:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 -- 172.21.15.72:0/2129159757 >> v1:172.21.15.72:6789/0 conn(0x7f9dec09e410 legacy=0x7f9dec133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 --2- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dec09e000 0x7f9dd4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 --2- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dd4004140 0x7f9dd4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 --2- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dec09d6f0 0x7f9dd4004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 -- 172.21.15.72:0/2129159757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec06b460 con 0x7f9dd4004140 2023-10-03T10:12:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 -- 172.21.15.72:0/2129159757 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec09a7e0 con 0x7f9dec09e000 2023-10-03T10:12:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.584+0000 7f9de959a700 1 -- 172.21.15.72:0/2129159757 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd4005560 con 0x7f9dec09d6f0 2023-10-03T10:12:03.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.585+0000 7f9de9d9b700 1 --2- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dd4004140 0x7f9dd4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.585+0000 7f9dead9d700 1 --2- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dec09d6f0 0x7f9dd4004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.585+0000 7f9de9d9b700 1 -- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dec09d6f0 msgr2=0x7f9dd4004dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.585+0000 7f9de9d9b700 1 --2- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dec09d6f0 0x7f9dd4004dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.585+0000 7f9de9d9b700 1 -- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dec09e000 msgr2=0x7f9dd4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:03.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.585+0000 7f9de9d9b700 1 --2- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dec09e000 0x7f9dd4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.585+0000 7f9de9d9b700 1 -- 172.21.15.72:0/2129159757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd40035b0 con 0x7f9dd4004140 2023-10-03T10:12:03.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.585+0000 7f9de9d9b700 1 --2- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dd4004140 0x7f9dd4004850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9de00098e0 tx=0x7f9dd4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7ca8591a2ed74c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.585+0000 7f9de959a700 1 -- 172.21.15.72:0/2129159757 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0011620 con 0x7f9dd4004140 2023-10-03T10:12:03.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.585+0000 7f9de959a700 1 -- 172.21.15.72:0/2129159757 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de00117a0 con 0x7f9dd4004140 2023-10-03T10:12:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.585+0000 7f9de959a700 1 -- 172.21.15.72:0/2129159757 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0011b50 con 0x7f9dd4004140 2023-10-03T10:12:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.586+0000 7f9df0cb8700 1 -- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dd4004140 msgr2=0x7f9dd4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.586+0000 7f9df0cb8700 1 --2- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dd4004140 0x7f9dd4004850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9de00098e0 tx=0x7f9dd4005880 comp rx=0 tx=0).stop 2023-10-03T10:12:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.586+0000 7f9df0cb8700 1 -- 172.21.15.72:0/2129159757 shutdown_connections 2023-10-03T10:12:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.586+0000 7f9df0cb8700 1 --2- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dd4004140 0x7f9dd4004850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.586+0000 7f9df0cb8700 1 --2- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dec09d6f0 0x7f9dd4004dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.586+0000 7f9df0cb8700 1 --2- 172.21.15.72:0/2129159757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dec09e000 0x7f9dd4003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.586+0000 7f9df0cb8700 1 -- 172.21.15.72:0/2129159757 >> 172.21.15.72:0/2129159757 conn(0x7f9dec066f50 msgr2=0x7f9dec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.586+0000 7f9df0cb8700 1 -- 172.21.15.72:0/2129159757 shutdown_connections 2023-10-03T10:12:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.586+0000 7f9df0cb8700 1 -- 172.21.15.72:0/2129159757 wait complete. 2023-10-03T10:12:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.587+0000 7f9df0cb8700 1 Processor -- start 2023-10-03T10:12:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.587+0000 7f9df0cb8700 1 -- start start 2023-10-03T10:12:03.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.588+0000 7f9df0cb8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dd4004140 0x7f9dec1c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.588+0000 7f9df0cb8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dec09d6f0 0x7f9dec1c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.588+0000 7f9df0cb8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dec09e000 0x7f9dec1c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:03.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.588+0000 7f9df0cb8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec1a6440 con 0x7f9dec09e000 2023-10-03T10:12:03.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.588+0000 7f9df0cb8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec1a7ca0 con 0x7f9dd4004140 2023-10-03T10:12:03.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.588+0000 7f9df0cb8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec09c710 con 0x7f9dec09d6f0 2023-10-03T10:12:03.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.588+0000 7f9dea59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dd4004140 0x7f9dec1c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.588+0000 7f9dea59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dd4004140 0x7f9dec1c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55226/0 (socket says 172.21.15.72:55226) 2023-10-03T10:12:03.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.588+0000 7f9dea59c700 1 -- 172.21.15.72:0/1463452154 learned_addr learned my addr 172.21.15.72:0/1463452154 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:03.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.588+0000 7f9de9d9b700 1 --2- 172.21.15.72:0/1463452154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dec09d6f0 0x7f9dec1c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:03.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.588+0000 7f9de9d9b700 1 -- 172.21.15.72:0/1463452154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dd4004140 msgr2=0x7f9dec1c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.588+0000 7f9de9d9b700 1 --2- 172.21.15.72:0/1463452154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dd4004140 0x7f9dec1c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.588+0000 7f9de9d9b700 1 -- 172.21.15.72:0/1463452154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dec09e000 msgr2=0x7f9dec1c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.588+0000 7f9de9d9b700 1 --2- 172.21.15.72:0/1463452154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dec09e000 0x7f9dec1c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.588+0000 7f9de9d9b700 1 -- 172.21.15.72:0/1463452154 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec1a89d0 con 0x7f9dec09d6f0 2023-10-03T10:12:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.589+0000 7f9de9d9b700 1 --2- 172.21.15.72:0/1463452154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dec09d6f0 0x7f9dec1c8510 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9de0016000 tx=0x7f9de0004860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.589+0000 7f9ddaffd700 1 -- 172.21.15.72:0/1463452154 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0024420 con 0x7f9dec09d6f0 2023-10-03T10:12:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.589+0000 7f9df0cb8700 1 -- 172.21.15.72:0/1463452154 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dec1a6fa0 con 0x7f9dec09d6f0 2023-10-03T10:12:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.589+0000 7f9ddaffd700 1 -- 172.21.15.72:0/1463452154 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de00245a0 con 0x7f9dec09d6f0 2023-10-03T10:12:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.589+0000 7f9ddaffd700 1 -- 172.21.15.72:0/1463452154 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0024950 con 0x7f9dec09d6f0 2023-10-03T10:12:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.589+0000 7f9df0cb8700 1 -- 172.21.15.72:0/1463452154 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dec1b8030 con 0x7f9dec09d6f0 2023-10-03T10:12:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.590+0000 7f9ddaffd700 1 -- 172.21.15.72:0/1463452154 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f9de0022070 con 0x7f9dec09d6f0 2023-10-03T10:12:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.590+0000 7f9dea59c700 1 -- 172.21.15.72:0/1463452154 >> v1:172.21.15.72:6816/118184 conn(0x7f9dcc02c1b0 legacy=0x7f9dcc02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.590+0000 7f9df0cb8700 1 -- 172.21.15.72:0/1463452154 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dec074ea0 con 0x7f9dec09d6f0 2023-10-03T10:12:03.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.602+0000 7f9ddaffd700 1 -- 172.21.15.72:0/1463452154 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f9de001a7a0 con 0x7f9dec09d6f0 2023-10-03T10:12:03.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.602+0000 7f9ddaffd700 1 -- 172.21.15.72:0/1463452154 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f9de0029070 con 0x7f9dec09d6f0 2023-10-03T10:12:03.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.619+0000 7fca90a65700 1 -- 172.21.15.72:0/1408518008 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fca8c04f2a0 con 0x7fca8c09f2c0 2023-10-03T10:12:03.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.620+0000 7fca7affd700 1 -- 172.21.15.72:0/1408518008 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca80034090 con 0x7fca8c09f2c0 2023-10-03T10:12:03.620 INFO:teuthology.orchestra.run.smithi072.stdout:38654705694 2023-10-03T10:12:03.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.622+0000 7fca90a65700 1 -- 172.21.15.72:0/1408518008 >> v1:172.21.15.72:6816/118184 conn(0x7fca6c02c1b0 legacy=0x7fca6c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:03.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.622+0000 7fca90a65700 1 -- 172.21.15.72:0/1408518008 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca8c09f2c0 msgr2=0x7fca8c1a2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.622+0000 7fca90a65700 1 --2- 172.21.15.72:0/1408518008 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca8c09f2c0 0x7fca8c1a2060 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fca800090b0 tx=0x7fca80004750 comp rx=0 tx=0).stop 2023-10-03T10:12:03.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.622+0000 7fca90a65700 1 -- 172.21.15.72:0/1408518008 shutdown_connections 2023-10-03T10:12:03.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.622+0000 7fca90a65700 1 --2- 172.21.15.72:0/1408518008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca8c09e7e0 0x7fca8c1a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.622+0000 7fca90a65700 1 --2- 172.21.15.72:0/1408518008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca8c09fa10 0x7fca8c1a25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.622+0000 7fca90a65700 1 --2- 172.21.15.72:0/1408518008 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca8c09f2c0 0x7fca8c1a2060 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.622+0000 7fca90a65700 1 -- 172.21.15.72:0/1408518008 >> 172.21.15.72:0/1408518008 conn(0x7fca8c0a4300 msgr2=0x7fca8c1b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.622+0000 7fca90a65700 1 -- 172.21.15.72:0/1408518008 shutdown_connections 2023-10-03T10:12:03.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.622+0000 7fca90a65700 1 -- 172.21.15.72:0/1408518008 wait complete. 2023-10-03T10:12:03.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.0 2023-10-03T10:12:03.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.674+0000 7fae3aa9f700 1 -- 172.21.15.72:0/1229027818 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fae3404ea50 con 0x7fae3409d6f0 2023-10-03T10:12:03.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.674+0000 7fae317fa700 1 -- 172.21.15.72:0/1229027818 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae2800be60 con 0x7fae3409d6f0 2023-10-03T10:12:03.675 INFO:teuthology.orchestra.run.smithi072.stdout:38654705694 2023-10-03T10:12:03.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.676+0000 7fae3aa9f700 1 -- 172.21.15.72:0/1229027818 >> v1:172.21.15.72:6816/118184 conn(0x7fae1802c1b0 legacy=0x7fae1802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:03.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.676+0000 7fae3aa9f700 1 -- 172.21.15.72:0/1229027818 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae3409d6f0 msgr2=0x7fae3411e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.676+0000 7fae3aa9f700 1 --2- 172.21.15.72:0/1229027818 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae3409d6f0 0x7fae3411e390 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fae2800b450 tx=0x7fae2800b760 comp rx=0 tx=0).stop 2023-10-03T10:12:03.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.678+0000 7fae3aa9f700 1 -- 172.21.15.72:0/1229027818 shutdown_connections 2023-10-03T10:12:03.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.678+0000 7fae3aa9f700 1 --2- 172.21.15.72:0/1229027818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae3409e410 0x7fae3411ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.678+0000 7fae3aa9f700 1 --2- 172.21.15.72:0/1229027818 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae3409d6f0 0x7fae3411e390 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.678+0000 7fae3aa9f700 1 --2- 172.21.15.72:0/1229027818 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae3409e000 0x7fae3411e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.678+0000 7fae3aa9f700 1 -- 172.21.15.72:0/1229027818 >> 172.21.15.72:0/1229027818 conn(0x7fae34066f50 msgr2=0x7fae3406efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.678+0000 7fae3aa9f700 1 -- 172.21.15.72:0/1229027818 shutdown_connections 2023-10-03T10:12:03.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.678+0000 7fae3aa9f700 1 -- 172.21.15.72:0/1229027818 wait complete. 2023-10-03T10:12:03.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.1 2023-10-03T10:12:03.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.736+0000 7f503cfed700 1 -- 172.21.15.72:0/2655180527 >> v1:172.21.15.72:6816/118184 conn(0x7f501c02c1b0 legacy=0x7f501c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:03.747 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:03.746+0000 7f6aece4b240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-03T10:12:03.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.776+0000 7f503f251700 1 -- 172.21.15.72:0/2655180527 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5018005590 con 0x7f50381316c0 2023-10-03T10:12:03.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.776+0000 7f50357fa700 1 -- 172.21.15.72:0/2655180527 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5030019350 con 0x7f50381316c0 2023-10-03T10:12:03.777 INFO:teuthology.orchestra.run.smithi072.stdout:38654705693 2023-10-03T10:12:03.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.778+0000 7f503f251700 1 -- 172.21.15.72:0/2655180527 >> v1:172.21.15.72:6816/118184 conn(0x7f501c02c1b0 legacy=0x7f501c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:03.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.778+0000 7f503f251700 1 -- 172.21.15.72:0/2655180527 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50381316c0 msgr2=0x7f503811ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.778+0000 7f503f251700 1 --2- 172.21.15.72:0/2655180527 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50381316c0 0x7f503811ce30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f503000b370 tx=0x7f5030004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.778+0000 7f503f251700 1 -- 172.21.15.72:0/2655180527 shutdown_connections 2023-10-03T10:12:03.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.778+0000 7f503f251700 1 --2- 172.21.15.72:0/2655180527 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50381316c0 0x7f503811ce30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.778+0000 7f503f251700 1 --2- 172.21.15.72:0/2655180527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f503806ae80 0x7f503811df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.778+0000 7f503f251700 1 --2- 172.21.15.72:0/2655180527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f503809d9f0 0x7f503811c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.778+0000 7f503f251700 1 -- 172.21.15.72:0/2655180527 >> 172.21.15.72:0/2655180527 conn(0x7f5038066f50 msgr2=0x7f50380a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.778+0000 7f503f251700 1 -- 172.21.15.72:0/2655180527 shutdown_connections 2023-10-03T10:12:03.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.778+0000 7f503f251700 1 -- 172.21.15.72:0/2655180527 wait complete. 2023-10-03T10:12:03.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.780+0000 7f9df0cb8700 1 -- 172.21.15.72:0/1463452154 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9dec06c360 con 0x7f9dec09d6f0 2023-10-03T10:12:03.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.780+0000 7f9ddaffd700 1 -- 172.21.15.72:0/1463452154 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9de0029020 con 0x7f9dec09d6f0 2023-10-03T10:12:03.781 INFO:teuthology.orchestra.run.smithi072.stdout:38654705694 2023-10-03T10:12:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.782+0000 7f9df0cb8700 1 -- 172.21.15.72:0/1463452154 >> v1:172.21.15.72:6816/118184 conn(0x7f9dcc02c1b0 legacy=0x7f9dcc02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.782+0000 7f9df0cb8700 1 -- 172.21.15.72:0/1463452154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dec09d6f0 msgr2=0x7f9dec1c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.782+0000 7f9df0cb8700 1 --2- 172.21.15.72:0/1463452154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dec09d6f0 0x7f9dec1c8510 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9de0016000 tx=0x7f9de0004860 comp rx=0 tx=0).stop 2023-10-03T10:12:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.782+0000 7f9df0cb8700 1 -- 172.21.15.72:0/1463452154 shutdown_connections 2023-10-03T10:12:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.782+0000 7f9df0cb8700 1 --2- 172.21.15.72:0/1463452154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dec09e000 0x7f9dec1c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.782+0000 7f9df0cb8700 1 --2- 172.21.15.72:0/1463452154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dd4004140 0x7f9dec1c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.782+0000 7f9df0cb8700 1 --2- 172.21.15.72:0/1463452154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dec09d6f0 0x7f9dec1c8510 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:03.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.782+0000 7f9df0cb8700 1 -- 172.21.15.72:0/1463452154 >> 172.21.15.72:0/1463452154 conn(0x7f9dec066f50 msgr2=0x7f9dec1bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:03.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.782+0000 7f9df0cb8700 1 -- 172.21.15.72:0/1463452154 shutdown_connections 2023-10-03T10:12:03.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:03.782+0000 7f9df0cb8700 1 -- 172.21.15.72:0/1463452154 wait complete. 2023-10-03T10:12:03.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.3 2023-10-03T10:12:03.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.2 2023-10-03T10:12:03.822 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:03.821+0000 7f6aece4b240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-03T10:12:04.636 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:04.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:04.708 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:04.707+0000 7f6aece4b240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-03T10:12:04.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.766+0000 7fd55df61700 1 Processor -- start 2023-10-03T10:12:04.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.766+0000 7fd55df61700 1 -- start start 2023-10-03T10:12:04.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.766+0000 7fd55df61700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd55809e1d0 0x7fd558138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.766+0000 7fd55df61700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd558139170 0x7fd55813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.766+0000 7fd55df61700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55809b120 con 0x7fd55809d6f0 2023-10-03T10:12:04.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.766+0000 7fd55df61700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55806b460 con 0x7fd558139170 2023-10-03T10:12:04.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.766+0000 7fd55df61700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd55809a7e0 con 0x7fd55809e1d0 2023-10-03T10:12:04.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.767+0000 7fd557fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd558139170 0x7fd55813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.767+0000 7fd556ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd55809e1d0 0x7fd558138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.767+0000 7fd5577fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd55809d6f0 0x7fd55809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57552/0 (socket says 172.21.15.72:57552) 2023-10-03T10:12:04.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.767+0000 7fd5577fe700 1 -- 172.21.15.72:0/451828957 learned_addr learned my addr 172.21.15.72:0/451828957 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.767+0000 7fd556ffd700 1 -- 172.21.15.72:0/451828957 >> v2:172.21.15.72:3300/0 conn(0x7fd558139170 msgr2=0x7fd55813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.767+0000 7fd556ffd700 1 --2- 172.21.15.72:0/451828957 >> v2:172.21.15.72:3300/0 conn(0x7fd558139170 0x7fd55813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.767+0000 7fd556ffd700 1 -- 172.21.15.72:0/451828957 >> v1:172.21.15.72:6789/0 conn(0x7fd55809d6f0 legacy=0x7fd55809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.767+0000 7fd556ffd700 1 -- 172.21.15.72:0/451828957 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55809a500 con 0x7fd55809e1d0 2023-10-03T10:12:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.767+0000 7fd556ffd700 1 --2- 172.21.15.72:0/451828957 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd55809e1d0 0x7fd558138c30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009870 tx=0x7fd54c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3b0e749f781857e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.767+0000 7fd5567fc700 1 -- 172.21.15.72:0/451828957 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c011830 con 0x7fd55809e1d0 2023-10-03T10:12:04.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.767+0000 7fd5567fc700 1 -- 172.21.15.72:0/451828957 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c011990 con 0x7fd55809e1d0 2023-10-03T10:12:04.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.767+0000 7fd5567fc700 1 -- 172.21.15.72:0/451828957 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c011d20 con 0x7fd55809e1d0 2023-10-03T10:12:04.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.768+0000 7fd55df61700 1 -- 172.21.15.72:0/451828957 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd55809e1d0 msgr2=0x7fd558138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.768+0000 7fd55df61700 1 --2- 172.21.15.72:0/451828957 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd55809e1d0 0x7fd558138c30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009870 tx=0x7fd54c009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:04.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.768+0000 7fd55df61700 1 -- 172.21.15.72:0/451828957 shutdown_connections 2023-10-03T10:12:04.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.768+0000 7fd55df61700 1 --2- 172.21.15.72:0/451828957 >> v2:172.21.15.72:3300/0 conn(0x7fd558139170 0x7fd55813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.768+0000 7fd55df61700 1 --2- 172.21.15.72:0/451828957 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd55809e1d0 0x7fd558138c30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.768+0000 7fd55df61700 1 -- 172.21.15.72:0/451828957 >> 172.21.15.72:0/451828957 conn(0x7fd558066f50 msgr2=0x7fd55809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:04.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.768+0000 7fd55df61700 1 -- 172.21.15.72:0/451828957 shutdown_connections 2023-10-03T10:12:04.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.768+0000 7fd55df61700 1 -- 172.21.15.72:0/451828957 wait complete. 2023-10-03T10:12:04.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.770+0000 7fd55df61700 1 Processor -- start 2023-10-03T10:12:04.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.770+0000 7fd55df61700 1 -- start start 2023-10-03T10:12:04.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd55df61700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd55809d6f0 0x7fd5581c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd55df61700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd55809e1d0 0x7fd5581c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd55df61700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd558139170 0x7fd5581c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd55df61700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd558121d30 con 0x7fd55809d6f0 2023-10-03T10:12:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd55df61700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55809c710 con 0x7fd55809e1d0 2023-10-03T10:12:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd55df61700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd558122000 con 0x7fd558139170 2023-10-03T10:12:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd5577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd55809d6f0 0x7fd5581c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd556ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd55809e1d0 0x7fd5581c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd5577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd55809d6f0 0x7fd5581c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50658/0 (socket says 172.21.15.72:50658) 2023-10-03T10:12:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd556ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd55809e1d0 0x7fd5581c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55232/0 (socket says 172.21.15.72:55232) 2023-10-03T10:12:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd5577fe700 1 -- 172.21.15.72:0/3882997533 learned_addr learned my addr 172.21.15.72:0/3882997533 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:04.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd557fff700 1 --2- 172.21.15.72:0/3882997533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd558139170 0x7fd5581c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd556ffd700 1 -- 172.21.15.72:0/3882997533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd558139170 msgr2=0x7fd5581c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd556ffd700 1 --2- 172.21.15.72:0/3882997533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd558139170 0x7fd5581c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd556ffd700 1 -- 172.21.15.72:0/3882997533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd55809d6f0 msgr2=0x7fd5581c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd556ffd700 1 --2- 172.21.15.72:0/3882997533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd55809d6f0 0x7fd5581c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd556ffd700 1 -- 172.21.15.72:0/3882997533 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c0094a0 con 0x7fd55809e1d0 2023-10-03T10:12:04.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd556ffd700 1 --2- 172.21.15.72:0/3882997533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd55809e1d0 0x7fd5581c89a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd54c016000 tx=0x7fd54c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:04.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd53ffff700 1 -- 172.21.15.72:0/3882997533 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0036a0 con 0x7fd55809e1d0 2023-10-03T10:12:04.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.771+0000 7fd53ffff700 1 -- 172.21.15.72:0/3882997533 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c01f070 con 0x7fd55809e1d0 2023-10-03T10:12:04.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.772+0000 7fd55df61700 1 -- 172.21.15.72:0/3882997533 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd558121300 con 0x7fd55809e1d0 2023-10-03T10:12:04.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.772+0000 7fd53ffff700 1 -- 172.21.15.72:0/3882997533 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c003a20 con 0x7fd55809e1d0 2023-10-03T10:12:04.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.772+0000 7fd55df61700 1 -- 172.21.15.72:0/3882997533 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5581225a0 con 0x7fd55809e1d0 2023-10-03T10:12:04.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.773+0000 7fd55df61700 1 -- 172.21.15.72:0/3882997533 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd558122350 con 0x7fd55809e1d0 2023-10-03T10:12:04.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.773+0000 7fd53ffff700 1 -- 172.21.15.72:0/3882997533 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fd54c003b80 con 0x7fd55809e1d0 2023-10-03T10:12:04.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.773+0000 7fd53ffff700 1 -- 172.21.15.72:0/3882997533 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fd54c021070 con 0x7fd55809e1d0 2023-10-03T10:12:04.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.773+0000 7fd5577fe700 1 -- 172.21.15.72:0/3882997533 >> v1:172.21.15.72:6816/118184 conn(0x7fd54402c1b0 legacy=0x7fd54402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:04.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.777+0000 7fd53ffff700 1 -- 172.21.15.72:0/3882997533 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fd54c003e30 con 0x7fd55809e1d0 2023-10-03T10:12:04.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:04.797 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:04.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.823+0000 7fe2d00f5700 1 Processor -- start 2023-10-03T10:12:04.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.823+0000 7fe2d00f5700 1 -- start start 2023-10-03T10:12:04.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.824+0000 7fe2d00f5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2c8131810 0x7fe2c8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.824+0000 7fe2d00f5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2c8099a40 0x7fe2c8099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.824+0000 7fe2d00f5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c81313c0 con 0x7fe2c809a3b0 2023-10-03T10:12:04.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.824+0000 7fe2d00f5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c809b580 con 0x7fe2c8131810 2023-10-03T10:12:04.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.824+0000 7fe2d00f5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c806e8c0 con 0x7fe2c8099a40 2023-10-03T10:12:04.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.824+0000 7fe2ce692700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe2c809a3b0 0x7fe2c8138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57566/0 (socket says 172.21.15.72:57566) 2023-10-03T10:12:04.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.824+0000 7fe2ce692700 1 -- 172.21.15.72:0/2001574154 learned_addr learned my addr 172.21.15.72:0/2001574154 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:04.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.824+0000 7fe2cce8f700 1 -- 172.21.15.72:0/2001574154 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877826438 0 0) 0x7fe2c81313c0 con 0x7fe2c809a3b0 2023-10-03T10:12:04.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.824+0000 7fe2cce8f700 1 -- 172.21.15.72:0/2001574154 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2b40035b0 con 0x7fe2c809a3b0 2023-10-03T10:12:04.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cd690700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2c8099a40 0x7fe2c8099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cce8f700 1 -- 172.21.15.72:0/2001574154 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1499996899 0 0) 0x7fe2b40035b0 con 0x7fe2c809a3b0 2023-10-03T10:12:04.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cce8f700 1 -- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2c8099a40 msgr2=0x7fe2c8099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:04.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cce8f700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2c8099a40 0x7fe2c8099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cce8f700 1 -- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2c8131810 msgr2=0x7fe2c8131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:04.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cce8f700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2c8131810 0x7fe2c8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cce8f700 1 -- 172.21.15.72:0/2001574154 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c809a820 con 0x7fe2c809a3b0 2023-10-03T10:12:04.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cce8f700 1 -- 172.21.15.72:0/2001574154 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 244944926 0 0) 0x7fe2c00019f0 con 0x7fe2c809a3b0 2023-10-03T10:12:04.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cce8f700 1 -- 172.21.15.72:0/2001574154 >> v1:172.21.15.72:6789/0 conn(0x7fe2c809a3b0 legacy=0x7fe2c8138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cce8f700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2c8099a40 0x7fe2b4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cce8f700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b4004030 0x7fe2b4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cce8f700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4009a00 0x7fe2b4004d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cce8f700 1 -- 172.21.15.72:0/2001574154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c809b580 con 0x7fe2b4009a00 2023-10-03T10:12:04.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cce8f700 1 -- 172.21.15.72:0/2001574154 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c806e8c0 con 0x7fe2b4004030 2023-10-03T10:12:04.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cce8f700 1 -- 172.21.15.72:0/2001574154 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40056a0 con 0x7fe2c8099a40 2023-10-03T10:12:04.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cd690700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b4004030 0x7fe2b4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2ce692700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4009a00 0x7fe2b4004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.825+0000 7fe2cde91700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2c8099a40 0x7fe2b4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.826+0000 7fe2ce692700 1 -- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2c8099a40 msgr2=0x7fe2b4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:04.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.826+0000 7fe2ce692700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2c8099a40 0x7fe2b4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.826+0000 7fe2ce692700 1 -- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b4004030 msgr2=0x7fe2b4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:04.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.826+0000 7fe2ce692700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b4004030 0x7fe2b4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.826+0000 7fe2ce692700 1 -- 172.21.15.72:0/2001574154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40035b0 con 0x7fe2b4009a00 2023-10-03T10:12:04.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.826+0000 7fe2cde91700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2c8099a40 0x7fe2b4003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:04.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.826+0000 7fe2ce692700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4009a00 0x7fe2b4004d90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000a780 tx=0x7fe2b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5686f8201431c8f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.826+0000 7fe2cce8f700 1 -- 172.21.15.72:0/2001574154 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00072d0 con 0x7fe2b4009a00 2023-10-03T10:12:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.826+0000 7fe2cce8f700 1 -- 172.21.15.72:0/2001574154 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c0007430 con 0x7fe2b4009a00 2023-10-03T10:12:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.826+0000 7fe2cce8f700 1 -- 172.21.15.72:0/2001574154 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00077c0 con 0x7fe2b4009a00 2023-10-03T10:12:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.827+0000 7fe2d00f5700 1 -- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4009a00 msgr2=0x7fe2b4004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.827+0000 7fe2d00f5700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4009a00 0x7fe2b4004d90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000a780 tx=0x7fe2b4005880 comp rx=0 tx=0).stop 2023-10-03T10:12:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.827+0000 7fe2d00f5700 1 -- 172.21.15.72:0/2001574154 shutdown_connections 2023-10-03T10:12:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.827+0000 7fe2d00f5700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4009a00 0x7fe2b4004d90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.827+0000 7fe2d00f5700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b4004030 0x7fe2b4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.827+0000 7fe2d00f5700 1 --2- 172.21.15.72:0/2001574154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2c8099a40 0x7fe2b4003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.827+0000 7fe2d00f5700 1 -- 172.21.15.72:0/2001574154 >> 172.21.15.72:0/2001574154 conn(0x7fe2c80a2aa0 msgr2=0x7fe2c80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:04.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.827+0000 7fe2d00f5700 1 -- 172.21.15.72:0/2001574154 shutdown_connections 2023-10-03T10:12:04.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.828+0000 7fe2d00f5700 1 -- 172.21.15.72:0/2001574154 wait complete. 2023-10-03T10:12:04.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.829+0000 7fe2d00f5700 1 Processor -- start 2023-10-03T10:12:04.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.829+0000 7fe2d00f5700 1 -- start start 2023-10-03T10:12:04.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.830+0000 7fe2d00f5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b4004030 0x7fe2c8119410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.830+0000 7fe2d00f5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4009a00 0x7fe2c8119950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.830+0000 7fe2d00f5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2c8099a40 0x7fe2c8119e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.830+0000 7fe2d00f5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c811d8f0 con 0x7fe2b4009a00 2023-10-03T10:12:04.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.830+0000 7fe2d00f5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c811b020 con 0x7fe2c8099a40 2023-10-03T10:12:04.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.830+0000 7fe2d00f5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c811c270 con 0x7fe2b4004030 2023-10-03T10:12:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.830+0000 7fe2cd690700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4009a00 0x7fe2c8119950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.830+0000 7fe2cd690700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4009a00 0x7fe2c8119950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50670/0 (socket says 172.21.15.72:50670) 2023-10-03T10:12:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.830+0000 7fe2cd690700 1 -- 172.21.15.72:0/937688617 learned_addr learned my addr 172.21.15.72:0/937688617 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.830+0000 7fe2cde91700 1 --2- 172.21.15.72:0/937688617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b4004030 0x7fe2c8119410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.830+0000 7fe2cd690700 1 -- 172.21.15.72:0/937688617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b4004030 msgr2=0x7fe2c8119410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.830+0000 7fe2cd690700 1 --2- 172.21.15.72:0/937688617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b4004030 0x7fe2c8119410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.830+0000 7fe2cd690700 1 -- 172.21.15.72:0/937688617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2c8099a40 msgr2=0x7fe2c8119e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.831+0000 7fe2cd690700 1 --2- 172.21.15.72:0/937688617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2c8099a40 0x7fe2c8119e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.831+0000 7fe2cd690700 1 -- 172.21.15.72:0/937688617 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c811cc50 con 0x7fe2b4009a00 2023-10-03T10:12:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.831+0000 7fe2cd690700 1 --2- 172.21.15.72:0/937688617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4009a00 0x7fe2c8119950 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8011680 tx=0x7fe2b8011990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.831+0000 7fe2be7fc700 1 -- 172.21.15.72:0/937688617 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800c070 con 0x7fe2b4009a00 2023-10-03T10:12:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.831+0000 7fe2d00f5700 1 -- 172.21.15.72:0/937688617 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c811b5e0 con 0x7fe2b4009a00 2023-10-03T10:12:04.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.831+0000 7fe2d00f5700 1 -- 172.21.15.72:0/937688617 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c811c710 con 0x7fe2b4009a00 2023-10-03T10:12:04.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.831+0000 7fe2be7fc700 1 -- 172.21.15.72:0/937688617 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b8015870 con 0x7fe2b4009a00 2023-10-03T10:12:04.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.831+0000 7fe2be7fc700 1 -- 172.21.15.72:0/937688617 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8015be0 con 0x7fe2b4009a00 2023-10-03T10:12:04.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.832+0000 7fe2d00f5700 1 -- 172.21.15.72:0/937688617 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b00052e0 con 0x7fe2b4009a00 2023-10-03T10:12:04.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.834+0000 7fe2be7fc700 1 -- 172.21.15.72:0/937688617 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fe2b8015d40 con 0x7fe2b4009a00 2023-10-03T10:12:04.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.834+0000 7fe2be7fc700 1 -- 172.21.15.72:0/937688617 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fe2b803bb70 con 0x7fe2b4009a00 2023-10-03T10:12:04.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.834+0000 7fe2cde91700 1 -- 172.21.15.72:0/937688617 >> v1:172.21.15.72:6816/118184 conn(0x7fe2ac02c1b0 legacy=0x7fe2ac02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:04.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.839+0000 7fe2be7fc700 1 -- 172.21.15.72:0/937688617 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fe2b801e7d0 con 0x7fe2b4009a00 2023-10-03T10:12:04.873 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:04.873+0000 7f6aece4b240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-03T10:12:04.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.931+0000 7fda7cdc2700 1 Processor -- start 2023-10-03T10:12:04.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.931+0000 7fda7cdc2700 1 -- start start 2023-10-03T10:12:04.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.932+0000 7fda7cdc2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fda7806c0e0 0x7fda7809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.932+0000 7fda7cdc2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda78134ec0 0x7fda781379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.932+0000 7fda7cdc2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda78134980 con 0x7fda78137f20 2023-10-03T10:12:04.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.932+0000 7fda7cdc2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7806c4b0 con 0x7fda7806c0e0 2023-10-03T10:12:04.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.932+0000 7fda7cdc2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda780a09c0 con 0x7fda78134ec0 2023-10-03T10:12:04.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.932+0000 7fda7659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fda7806c0e0 0x7fda7809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.932+0000 7fda76d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fda78137f20 0x7fda7813ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57580/0 (socket says 172.21.15.72:57580) 2023-10-03T10:12:04.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.932+0000 7fda76d9d700 1 -- 172.21.15.72:0/4213947214 learned_addr learned my addr 172.21.15.72:0/4213947214 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:04.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.933+0000 7fda7659c700 1 -- 172.21.15.72:0/4213947214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda78134ec0 msgr2=0x7fda781379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:04.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.933+0000 7fda7659c700 1 --2- 172.21.15.72:0/4213947214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda78134ec0 0x7fda781379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.933+0000 7fda7659c700 1 -- 172.21.15.72:0/4213947214 >> v1:172.21.15.72:6789/0 conn(0x7fda78137f20 legacy=0x7fda7813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.933+0000 7fda7659c700 1 -- 172.21.15.72:0/4213947214 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda780a0600 con 0x7fda7806c0e0 2023-10-03T10:12:04.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.933+0000 7fda7659c700 1 --2- 172.21.15.72:0/4213947214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7806c0e0 0x7fda7809ac90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fda68009840 tx=0x7fda68009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649e472394296a37 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:04.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.933+0000 7fda7559a700 1 -- 172.21.15.72:0/4213947214 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68011830 con 0x7fda7806c0e0 2023-10-03T10:12:04.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.933+0000 7fda7559a700 1 -- 172.21.15.72:0/4213947214 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda68011990 con 0x7fda7806c0e0 2023-10-03T10:12:04.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.933+0000 7fda7559a700 1 -- 172.21.15.72:0/4213947214 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68011d20 con 0x7fda7806c0e0 2023-10-03T10:12:04.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.934+0000 7fda7cdc2700 1 -- 172.21.15.72:0/4213947214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7806c0e0 msgr2=0x7fda7809ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.934+0000 7fda7cdc2700 1 --2- 172.21.15.72:0/4213947214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7806c0e0 0x7fda7809ac90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fda68009840 tx=0x7fda68009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:04.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.934+0000 7fda7cdc2700 1 -- 172.21.15.72:0/4213947214 shutdown_connections 2023-10-03T10:12:04.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.934+0000 7fda7cdc2700 1 --2- 172.21.15.72:0/4213947214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7806c0e0 0x7fda7809ac90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.934+0000 7fda7cdc2700 1 --2- 172.21.15.72:0/4213947214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda78134ec0 0x7fda781379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.934+0000 7fda7cdc2700 1 -- 172.21.15.72:0/4213947214 >> 172.21.15.72:0/4213947214 conn(0x7fda780a4210 msgr2=0x7fda780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:04.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.934+0000 7fda7cdc2700 1 -- 172.21.15.72:0/4213947214 shutdown_connections 2023-10-03T10:12:04.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.934+0000 7fda7cdc2700 1 -- 172.21.15.72:0/4213947214 wait complete. 2023-10-03T10:12:04.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.935+0000 7fda7cdc2700 1 Processor -- start 2023-10-03T10:12:04.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.936+0000 7fda7cdc2700 1 -- start start 2023-10-03T10:12:04.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.936+0000 7fda7cdc2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7806c0e0 0x7fda781ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.936+0000 7fda7cdc2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda78134ec0 0x7fda781cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.936+0000 7fda7cdc2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda78137f20 0x7fda7811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.936+0000 7fda7cdc2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda78133b50 con 0x7fda7806c0e0 2023-10-03T10:12:04.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.936+0000 7fda7cdc2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda78127420 con 0x7fda78137f20 2023-10-03T10:12:04.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.936+0000 7fda7cdc2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda7811d8e0 con 0x7fda78134ec0 2023-10-03T10:12:04.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.936+0000 7fda7659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7806c0e0 0x7fda781ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.936+0000 7fda7659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7806c0e0 0x7fda781ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50686/0 (socket says 172.21.15.72:50686) 2023-10-03T10:12:04.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.936+0000 7fda7659c700 1 -- 172.21.15.72:0/553293757 learned_addr learned my addr 172.21.15.72:0/553293757 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:04.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.937+0000 7fda76d9d700 1 --2- 172.21.15.72:0/553293757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda78137f20 0x7fda7811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.937+0000 7fda75d9b700 1 --2- 172.21.15.72:0/553293757 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda78134ec0 0x7fda781cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.937+0000 7fda76d9d700 1 -- 172.21.15.72:0/553293757 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda78134ec0 msgr2=0x7fda781cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.937+0000 7fda76d9d700 1 --2- 172.21.15.72:0/553293757 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda78134ec0 0x7fda781cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.937+0000 7fda76d9d700 1 -- 172.21.15.72:0/553293757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7806c0e0 msgr2=0x7fda781ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.937+0000 7fda76d9d700 1 --2- 172.21.15.72:0/553293757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7806c0e0 0x7fda781ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.937+0000 7fda76d9d700 1 -- 172.21.15.72:0/553293757 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda680094a0 con 0x7fda78137f20 2023-10-03T10:12:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.937+0000 7fda7659c700 1 --2- 172.21.15.72:0/553293757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7806c0e0 0x7fda781ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.937+0000 7fda76d9d700 1 --2- 172.21.15.72:0/553293757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda78137f20 0x7fda7811a680 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fda7000caa0 tx=0x7fda7000ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.937+0000 7fda66ffd700 1 -- 172.21.15.72:0/553293757 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000aa40 con 0x7fda78137f20 2023-10-03T10:12:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.937+0000 7fda66ffd700 1 -- 172.21.15.72:0/553293757 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7000aba0 con 0x7fda78137f20 2023-10-03T10:12:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.937+0000 7fda66ffd700 1 -- 172.21.15.72:0/553293757 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70012400 con 0x7fda78137f20 2023-10-03T10:12:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.937+0000 7fda7cdc2700 1 -- 172.21.15.72:0/553293757 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda780a03f0 con 0x7fda78137f20 2023-10-03T10:12:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.937+0000 7fda7cdc2700 1 -- 172.21.15.72:0/553293757 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda78133f00 con 0x7fda78137f20 2023-10-03T10:12:04.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.939+0000 7fda7cdc2700 1 -- 172.21.15.72:0/553293757 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7811dfa0 con 0x7fda78137f20 2023-10-03T10:12:04.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.939+0000 7fda66ffd700 1 -- 172.21.15.72:0/553293757 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fda7001b3b0 con 0x7fda78137f20 2023-10-03T10:12:04.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.939+0000 7fda66ffd700 1 -- 172.21.15.72:0/553293757 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fda7003ba90 con 0x7fda78137f20 2023-10-03T10:12:04.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.944+0000 7fda7659c700 1 -- 172.21.15.72:0/553293757 >> v1:172.21.15.72:6816/118184 conn(0x7fda5802c1b0 legacy=0x7fda5802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:04.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.947+0000 7fda66ffd700 1 -- 172.21.15.72:0/553293757 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fda700192c0 con 0x7fda78137f20 2023-10-03T10:12:04.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.957+0000 7fc6a9f7e700 1 Processor -- start 2023-10-03T10:12:04.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.957+0000 7fc6a9f7e700 1 -- start start 2023-10-03T10:12:04.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.958+0000 7fc6a9f7e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6a4130560 0x7fc6a4130930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.958+0000 7fc6a9f7e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6a4130e70 0x7fc6a406fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.958+0000 7fc6a9f7e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a4070a50 con 0x7fc6a409eca0 2023-10-03T10:12:04.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.958+0000 7fc6a9f7e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40717d0 con 0x7fc6a4130560 2023-10-03T10:12:04.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.958+0000 7fc6a9f7e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a4130340 con 0x7fc6a4130e70 2023-10-03T10:12:04.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.958+0000 7fc6a37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6a4130560 0x7fc6a4130930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.958+0000 7fc6a37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6a4130560 0x7fc6a4130930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55288/0 (socket says 172.21.15.72:55288) 2023-10-03T10:12:04.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.958+0000 7fc6a37fe700 1 -- 172.21.15.72:0/708226333 learned_addr learned my addr 172.21.15.72:0/708226333 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:04.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.958+0000 7fc6a37fe700 1 -- 172.21.15.72:0/708226333 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6a4130e70 msgr2=0x7fc6a406fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:04.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.958+0000 7fc6a37fe700 1 --2- 172.21.15.72:0/708226333 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6a4130e70 0x7fc6a406fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.958+0000 7fc6a37fe700 1 -- 172.21.15.72:0/708226333 >> v1:172.21.15.72:6789/0 conn(0x7fc6a409eca0 legacy=0x7fc6a406f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.958+0000 7fc6a37fe700 1 -- 172.21.15.72:0/708226333 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a4071060 con 0x7fc6a4130560 2023-10-03T10:12:04.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.958+0000 7fc6a37fe700 1 --2- 172.21.15.72:0/708226333 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6a4130560 0x7fc6a4130930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc694009920 tx=0x7fc694009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c87fee7a6c06fd10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:04.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.959+0000 7fc6a27fc700 1 -- 172.21.15.72:0/708226333 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69400ba60 con 0x7fc6a4130560 2023-10-03T10:12:04.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.959+0000 7fc6a27fc700 1 -- 172.21.15.72:0/708226333 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69400bbc0 con 0x7fc6a4130560 2023-10-03T10:12:04.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.959+0000 7fc6a27fc700 1 -- 172.21.15.72:0/708226333 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694009e70 con 0x7fc6a4130560 2023-10-03T10:12:04.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.959+0000 7fc6a9f7e700 1 -- 172.21.15.72:0/708226333 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6a4130560 msgr2=0x7fc6a4130930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.959+0000 7fc6a9f7e700 1 --2- 172.21.15.72:0/708226333 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6a4130560 0x7fc6a4130930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc694009920 tx=0x7fc694009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:04.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.959+0000 7fc6a9f7e700 1 -- 172.21.15.72:0/708226333 shutdown_connections 2023-10-03T10:12:04.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.959+0000 7fc6a9f7e700 1 --2- 172.21.15.72:0/708226333 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6a4130e70 0x7fc6a406fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.959+0000 7fc6a9f7e700 1 --2- 172.21.15.72:0/708226333 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6a4130560 0x7fc6a4130930 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.959+0000 7fc6a9f7e700 1 -- 172.21.15.72:0/708226333 >> 172.21.15.72:0/708226333 conn(0x7fc6a40a2aa0 msgr2=0x7fc6a40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:04.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.960+0000 7fc6a9f7e700 1 -- 172.21.15.72:0/708226333 shutdown_connections 2023-10-03T10:12:04.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.960+0000 7fc6a9f7e700 1 -- 172.21.15.72:0/708226333 wait complete. 2023-10-03T10:12:04.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.961+0000 7fc6a9f7e700 1 Processor -- start 2023-10-03T10:12:04.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.961+0000 7fc6a9f7e700 1 -- start start 2023-10-03T10:12:04.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.962+0000 7fc6a9f7e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6a409eca0 0x7fc6a411c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.962+0000 7fc6a9f7e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6a4130560 0x7fc6a406e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.962+0000 7fc6a9f7e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6a4130e70 0x7fc6a406ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:04.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.962+0000 7fc6a9f7e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a4134730 con 0x7fc6a409eca0 2023-10-03T10:12:04.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.962+0000 7fc6a9f7e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a41371a0 con 0x7fc6a4130560 2023-10-03T10:12:04.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.962+0000 7fc6a9f7e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a412fbe0 con 0x7fc6a4130e70 2023-10-03T10:12:04.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.962+0000 7fc6a3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6a4130e70 0x7fc6a406ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.962+0000 7fc6a3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6a4130e70 0x7fc6a406ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:43612/0 (socket says 172.21.15.72:43612) 2023-10-03T10:12:04.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.962+0000 7fc6a3fff700 1 -- 172.21.15.72:0/2147139970 learned_addr learned my addr 172.21.15.72:0/2147139970 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:04.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.962+0000 7fc6a2ffd700 1 --2- 172.21.15.72:0/2147139970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6a4130560 0x7fc6a406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:04.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.962+0000 7fc6a3fff700 1 -- 172.21.15.72:0/2147139970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6a4130560 msgr2=0x7fc6a406e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.962+0000 7fc6a3fff700 1 --2- 172.21.15.72:0/2147139970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6a4130560 0x7fc6a406e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.962+0000 7fc6a3fff700 1 -- 172.21.15.72:0/2147139970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6a409eca0 msgr2=0x7fc6a411c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:04.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.962+0000 7fc6a3fff700 1 --2- 172.21.15.72:0/2147139970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6a409eca0 0x7fc6a411c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:04.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.962+0000 7fc6a3fff700 1 -- 172.21.15.72:0/2147139970 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc694009550 con 0x7fc6a4130e70 2023-10-03T10:12:04.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.963+0000 7fc6a3fff700 1 --2- 172.21.15.72:0/2147139970 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6a4130e70 0x7fc6a406ea50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00b9e0 tx=0x7fc69c00bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:04.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.963+0000 7fc68bfff700 1 -- 172.21.15.72:0/2147139970 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00c9b0 con 0x7fc6a4130e70 2023-10-03T10:12:04.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.963+0000 7fc68bfff700 1 -- 172.21.15.72:0/2147139970 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c00cb30 con 0x7fc6a4130e70 2023-10-03T10:12:04.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.963+0000 7fc68bfff700 1 -- 172.21.15.72:0/2147139970 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c014440 con 0x7fc6a4130e70 2023-10-03T10:12:04.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.963+0000 7fc6a9f7e700 1 -- 172.21.15.72:0/2147139970 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a40719f0 con 0x7fc6a4130e70 2023-10-03T10:12:04.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.963+0000 7fc6a9f7e700 1 -- 172.21.15.72:0/2147139970 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a4136800 con 0x7fc6a4130e70 2023-10-03T10:12:04.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.964+0000 7fc6a9f7e700 1 -- 172.21.15.72:0/2147139970 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a4074ea0 con 0x7fc6a4130e70 2023-10-03T10:12:04.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.967+0000 7fc68bfff700 1 -- 172.21.15.72:0/2147139970 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fc69c01d3b0 con 0x7fc6a4130e70 2023-10-03T10:12:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.967+0000 7fc68bfff700 1 -- 172.21.15.72:0/2147139970 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fc69c006e40 con 0x7fc6a4130e70 2023-10-03T10:12:04.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.967+0000 7fc6a37fe700 1 -- 172.21.15.72:0/2147139970 >> v1:172.21.15.72:6816/118184 conn(0x7fc69002c200 legacy=0x7fc69002e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:04.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.969+0000 7fc68bfff700 1 -- 172.21.15.72:0/2147139970 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fc69c01c360 con 0x7fc6a4130e70 2023-10-03T10:12:04.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:04.974+0000 7fd5577fe700 1 -- 172.21.15.72:0/3882997533 >> v1:172.21.15.72:6816/118184 conn(0x7fd54402c1b0 legacy=0x7fd54402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:05.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.031+0000 7fd55df61700 1 -- 172.21.15.72:0/3882997533 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd55809f420 con 0x7fd55809e1d0 2023-10-03T10:12:05.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.031+0000 7fd53ffff700 1 -- 172.21.15.72:0/3882997533 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd54c015030 con 0x7fd55809e1d0 2023-10-03T10:12:05.032 INFO:teuthology.orchestra.run.smithi072.stdout:38654705694 2023-10-03T10:12:05.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.034+0000 7fd55df61700 1 -- 172.21.15.72:0/3882997533 >> v1:172.21.15.72:6816/118184 conn(0x7fd54402c1b0 legacy=0x7fd54402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.034+0000 7fd55df61700 1 -- 172.21.15.72:0/3882997533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd55809e1d0 msgr2=0x7fd5581c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.034+0000 7fd55df61700 1 --2- 172.21.15.72:0/3882997533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd55809e1d0 0x7fd5581c89a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd54c016000 tx=0x7fd54c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:05.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.035+0000 7fe2cde91700 1 -- 172.21.15.72:0/937688617 >> v1:172.21.15.72:6816/118184 conn(0x7fe2ac02c1b0 legacy=0x7fe2ac02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.035+0000 7fd55df61700 1 -- 172.21.15.72:0/3882997533 shutdown_connections 2023-10-03T10:12:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.035+0000 7fd55df61700 1 --2- 172.21.15.72:0/3882997533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd55809d6f0 0x7fd5581c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.035+0000 7fd55df61700 1 --2- 172.21.15.72:0/3882997533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd558139170 0x7fd5581c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.035+0000 7fd55df61700 1 --2- 172.21.15.72:0/3882997533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd55809e1d0 0x7fd5581c89a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.035+0000 7fd55df61700 1 -- 172.21.15.72:0/3882997533 >> 172.21.15.72:0/3882997533 conn(0x7fd558066f50 msgr2=0x7fd558138090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:05.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.035+0000 7fd55df61700 1 -- 172.21.15.72:0/3882997533 shutdown_connections 2023-10-03T10:12:05.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.035+0000 7fd55df61700 1 -- 172.21.15.72:0/3882997533 wait complete. 2023-10-03T10:12:05.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.0 2023-10-03T10:12:05.081 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:05.080+0000 7f6aece4b240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:12:05.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.143+0000 7fc6a9f7e700 1 -- 172.21.15.72:0/2147139970 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc6a406b9e0 con 0x7fc6a4130e70 2023-10-03T10:12:05.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.143+0000 7fc68bfff700 1 -- 172.21.15.72:0/2147139970 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc69c019020 con 0x7fc6a4130e70 2023-10-03T10:12:05.144 INFO:teuthology.orchestra.run.smithi072.stdout:38654705694 2023-10-03T10:12:05.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.145+0000 7fda7659c700 1 -- 172.21.15.72:0/553293757 >> v1:172.21.15.72:6816/118184 conn(0x7fda5802c1b0 legacy=0x7fda5802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/118184 2023-10-03T10:12:05.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.145+0000 7fc6a9f7e700 1 -- 172.21.15.72:0/2147139970 >> v1:172.21.15.72:6816/118184 conn(0x7fc69002c200 legacy=0x7fc69002e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:05.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.145+0000 7fc6a9f7e700 1 -- 172.21.15.72:0/2147139970 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6a4130e70 msgr2=0x7fc6a406ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.145+0000 7fc6a9f7e700 1 --2- 172.21.15.72:0/2147139970 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6a4130e70 0x7fc6a406ea50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00b9e0 tx=0x7fc69c00bda0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.145+0000 7fc6a9f7e700 1 -- 172.21.15.72:0/2147139970 shutdown_connections 2023-10-03T10:12:05.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.145+0000 7fc6a9f7e700 1 --2- 172.21.15.72:0/2147139970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6a409eca0 0x7fc6a411c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.145+0000 7fc6a9f7e700 1 --2- 172.21.15.72:0/2147139970 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6a4130e70 0x7fc6a406ea50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.145+0000 7fc6a9f7e700 1 --2- 172.21.15.72:0/2147139970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6a4130560 0x7fc6a406e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.145+0000 7fc6a9f7e700 1 -- 172.21.15.72:0/2147139970 >> 172.21.15.72:0/2147139970 conn(0x7fc6a40a2aa0 msgr2=0x7fc6a412e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:05.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.145+0000 7fc6a9f7e700 1 -- 172.21.15.72:0/2147139970 shutdown_connections 2023-10-03T10:12:05.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.145+0000 7fc6a9f7e700 1 -- 172.21.15.72:0/2147139970 wait complete. 2023-10-03T10:12:05.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.2 2023-10-03T10:12:05.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.168+0000 7fda7cdc2700 1 -- 172.21.15.72:0/553293757 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fda78074ea0 con 0x7fda78137f20 2023-10-03T10:12:05.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.168+0000 7fda66ffd700 1 -- 172.21.15.72:0/553293757 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda70017030 con 0x7fda78137f20 2023-10-03T10:12:05.169 INFO:teuthology.orchestra.run.smithi072.stdout:38654705693 2023-10-03T10:12:05.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.171+0000 7fda7cdc2700 1 -- 172.21.15.72:0/553293757 >> v1:172.21.15.72:6816/118184 conn(0x7fda5802c1b0 legacy=0x7fda5802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:05.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.171+0000 7fda7cdc2700 1 -- 172.21.15.72:0/553293757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda78137f20 msgr2=0x7fda7811a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.171+0000 7fda7cdc2700 1 --2- 172.21.15.72:0/553293757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda78137f20 0x7fda7811a680 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fda7000caa0 tx=0x7fda7000ce60 comp rx=0 tx=0).stop 2023-10-03T10:12:05.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.171+0000 7fda7cdc2700 1 -- 172.21.15.72:0/553293757 shutdown_connections 2023-10-03T10:12:05.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.171+0000 7fda7cdc2700 1 --2- 172.21.15.72:0/553293757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7806c0e0 0x7fda781ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.171+0000 7fda7cdc2700 1 --2- 172.21.15.72:0/553293757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda78137f20 0x7fda7811a680 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.171+0000 7fda7cdc2700 1 --2- 172.21.15.72:0/553293757 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda78134ec0 0x7fda781cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.171+0000 7fda7cdc2700 1 -- 172.21.15.72:0/553293757 >> 172.21.15.72:0/553293757 conn(0x7fda780a4210 msgr2=0x7fda780a0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:05.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.171+0000 7fda7cdc2700 1 -- 172.21.15.72:0/553293757 shutdown_connections 2023-10-03T10:12:05.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.171+0000 7fda7cdc2700 1 -- 172.21.15.72:0/553293757 wait complete. 2023-10-03T10:12:05.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.3 2023-10-03T10:12:05.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.188+0000 7fe2d00f5700 1 -- 172.21.15.72:0/937688617 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe2b0005590 con 0x7fe2b4009a00 2023-10-03T10:12:05.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.188+0000 7fe2be7fc700 1 -- 172.21.15.72:0/937688617 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe2b8023090 con 0x7fe2b4009a00 2023-10-03T10:12:05.189 INFO:teuthology.orchestra.run.smithi072.stdout:38654705694 2023-10-03T10:12:05.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.190+0000 7fe2d00f5700 1 -- 172.21.15.72:0/937688617 >> v1:172.21.15.72:6816/118184 conn(0x7fe2ac02c1b0 legacy=0x7fe2ac02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:05.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.190+0000 7fe2d00f5700 1 -- 172.21.15.72:0/937688617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4009a00 msgr2=0x7fe2c8119950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:05.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.190+0000 7fe2d00f5700 1 --2- 172.21.15.72:0/937688617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4009a00 0x7fe2c8119950 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8011680 tx=0x7fe2b8011990 comp rx=0 tx=0).stop 2023-10-03T10:12:05.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.190+0000 7fe2d00f5700 1 -- 172.21.15.72:0/937688617 shutdown_connections 2023-10-03T10:12:05.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.190+0000 7fe2d00f5700 1 --2- 172.21.15.72:0/937688617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2c8099a40 0x7fe2c8119e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.190+0000 7fe2d00f5700 1 --2- 172.21.15.72:0/937688617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b4004030 0x7fe2c8119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.190+0000 7fe2d00f5700 1 --2- 172.21.15.72:0/937688617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b4009a00 0x7fe2c8119950 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:05.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.190+0000 7fe2d00f5700 1 -- 172.21.15.72:0/937688617 >> 172.21.15.72:0/937688617 conn(0x7fe2c80a2aa0 msgr2=0x7fe2c812e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:05.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.190+0000 7fe2d00f5700 1 -- 172.21.15.72:0/937688617 shutdown_connections 2023-10-03T10:12:05.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:05.190+0000 7fe2d00f5700 1 -- 172.21.15.72:0/937688617 wait complete. 2023-10-03T10:12:05.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.1 2023-10-03T10:12:05.685 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:05.684+0000 7f6aece4b240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-03T10:12:05.805 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:05.805+0000 7f6aece4b240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:12:05.957 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:05.957+0000 7f6aece4b240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-03T10:12:06.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:06.059 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:06.058+0000 7f6aece4b240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-03T10:12:06.145 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:06.144+0000 7f6a6bca4700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:06.145 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:06.144+0000 7f6a6bca4700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:06.145 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:06.144+0000 7f6a6bca4700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:06.145 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:06.144+0000 7f6a6bca4700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:06.145 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:06.144+0000 7f6a6bca4700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:06.146 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:06.146+0000 7f6a68c9e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:06.147 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:06.146+0000 7f6a68c9e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:06.147 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:06.146+0000 7f6a68c9e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:06.147 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:06.146+0000 7f6a68c9e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:06.147 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:06.146+0000 7f6a68c9e700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:12:06.158 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:06.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:06.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.194+0000 7f18df0bb700 1 Processor -- start 2023-10-03T10:12:06.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.194+0000 7f18df0bb700 1 -- start start 2023-10-03T10:12:06.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.194+0000 7f18df0bb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d809e930 0x7f18d809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.194+0000 7f18df0bb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d809f650 0x7f18d8131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.194+0000 7f18df0bb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d8070940 con 0x7f18d809f240 2023-10-03T10:12:06.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.194+0000 7f18df0bb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d806fd60 con 0x7f18d809e930 2023-10-03T10:12:06.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.194+0000 7f18df0bb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18d806fa80 con 0x7f18d809f650 2023-10-03T10:12:06.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.194+0000 7f18dce57700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d809e930 0x7f18d809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.195+0000 7f18dce57700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d809e930 0x7f18d809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55416/0 (socket says 172.21.15.72:55416) 2023-10-03T10:12:06.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.195+0000 7f18dce57700 1 -- 172.21.15.72:0/2903939213 learned_addr learned my addr 172.21.15.72:0/2903939213 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:06.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.195+0000 7f18dd658700 1 --2- 172.21.15.72:0/2903939213 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d809f650 0x7f18d8131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.195+0000 7f18dce57700 1 -- 172.21.15.72:0/2903939213 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d809f650 msgr2=0x7f18d8131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:06.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.195+0000 7f18dce57700 1 --2- 172.21.15.72:0/2903939213 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d809f650 0x7f18d8131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.195+0000 7f18d77fe700 1 -- 172.21.15.72:0/2903939213 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880015851 0 0) 0x7f18d8070940 con 0x7f18d809f240 2023-10-03T10:12:06.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.195+0000 7f18dce57700 1 -- 172.21.15.72:0/2903939213 >> v1:172.21.15.72:6789/0 conn(0x7f18d809f240 legacy=0x7f18d81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.195+0000 7f18dce57700 1 -- 172.21.15.72:0/2903939213 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d809fb60 con 0x7f18d809e930 2023-10-03T10:12:06.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.195+0000 7f18dce57700 1 --2- 172.21.15.72:0/2903939213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d809e930 0x7f18d809ed00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009920 tx=0x7f18cc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8330dce2ed2a1315 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.195+0000 7f18d77fe700 1 -- 172.21.15.72:0/2903939213 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc011830 con 0x7f18d809e930 2023-10-03T10:12:06.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.195+0000 7f18d77fe700 1 -- 172.21.15.72:0/2903939213 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc011990 con 0x7f18d809e930 2023-10-03T10:12:06.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.195+0000 7f18d77fe700 1 -- 172.21.15.72:0/2903939213 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc011d20 con 0x7f18d809e930 2023-10-03T10:12:06.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.196+0000 7f18df0bb700 1 -- 172.21.15.72:0/2903939213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d809e930 msgr2=0x7f18d809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.196+0000 7f18df0bb700 1 --2- 172.21.15.72:0/2903939213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d809e930 0x7f18d809ed00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009920 tx=0x7f18cc009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:06.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.196+0000 7f18df0bb700 1 -- 172.21.15.72:0/2903939213 shutdown_connections 2023-10-03T10:12:06.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.196+0000 7f18df0bb700 1 --2- 172.21.15.72:0/2903939213 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d809f650 0x7f18d8131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.196+0000 7f18df0bb700 1 --2- 172.21.15.72:0/2903939213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d809e930 0x7f18d809ed00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.196+0000 7f18df0bb700 1 -- 172.21.15.72:0/2903939213 >> 172.21.15.72:0/2903939213 conn(0x7f18d80a4210 msgr2=0x7f18d80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.196+0000 7f18df0bb700 1 -- 172.21.15.72:0/2903939213 shutdown_connections 2023-10-03T10:12:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.196+0000 7f18df0bb700 1 -- 172.21.15.72:0/2903939213 wait complete. 2023-10-03T10:12:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.197+0000 7f18df0bb700 1 Processor -- start 2023-10-03T10:12:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.197+0000 7f18df0bb700 1 -- start start 2023-10-03T10:12:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18df0bb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d809e930 0x7f18d81a3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18df0bb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d809f240 0x7f18d81a4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18df0bb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d809f650 0x7f18d81a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18df0bb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d81a80f0 con 0x7f18d809f240 2023-10-03T10:12:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18df0bb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d81a7730 con 0x7f18d809e930 2023-10-03T10:12:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18df0bb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18d81a6a70 con 0x7f18d809f650 2023-10-03T10:12:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18dce57700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d809e930 0x7f18d81a3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18dce57700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d809e930 0x7f18d81a3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55418/0 (socket says 172.21.15.72:55418) 2023-10-03T10:12:06.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18dce57700 1 -- 172.21.15.72:0/3021166447 learned_addr learned my addr 172.21.15.72:0/3021166447 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18d7fff700 1 --2- 172.21.15.72:0/3021166447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d809f240 0x7f18d81a4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18dd658700 1 --2- 172.21.15.72:0/3021166447 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d809f650 0x7f18d81a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18dce57700 1 -- 172.21.15.72:0/3021166447 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d809f650 msgr2=0x7f18d81a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18dce57700 1 --2- 172.21.15.72:0/3021166447 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d809f650 0x7f18d81a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18dce57700 1 -- 172.21.15.72:0/3021166447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d809f240 msgr2=0x7f18d81a4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18dce57700 1 --2- 172.21.15.72:0/3021166447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d809f240 0x7f18d81a4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18dce57700 1 -- 172.21.15.72:0/3021166447 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc009550 con 0x7f18d809e930 2023-10-03T10:12:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18dd658700 1 --2- 172.21.15.72:0/3021166447 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d809f650 0x7f18d81a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18d7fff700 1 --2- 172.21.15.72:0/3021166447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d809f240 0x7f18d81a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.198+0000 7f18dce57700 1 --2- 172.21.15.72:0/3021166447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d809e930 0x7f18d81a3c10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0098f0 tx=0x7f18cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.199+0000 7f18d57fa700 1 -- 172.21.15.72:0/3021166447 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc004450 con 0x7f18d809e930 2023-10-03T10:12:06.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.199+0000 7f18d57fa700 1 -- 172.21.15.72:0/3021166447 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc0045b0 con 0x7f18d809e930 2023-10-03T10:12:06.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.199+0000 7f18d57fa700 1 -- 172.21.15.72:0/3021166447 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc0038c0 con 0x7f18d809e930 2023-10-03T10:12:06.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.199+0000 7f18df0bb700 1 -- 172.21.15.72:0/3021166447 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d80a0190 con 0x7f18d809e930 2023-10-03T10:12:06.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.199+0000 7f18df0bb700 1 -- 172.21.15.72:0/3021166447 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d81a5820 con 0x7f18d809e930 2023-10-03T10:12:06.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.200+0000 7f18df0bb700 1 -- 172.21.15.72:0/3021166447 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d81a0b30 con 0x7f18d809e930 2023-10-03T10:12:06.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.201+0000 7f18d57fa700 1 -- 172.21.15.72:0/3021166447 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f18cc003a20 con 0x7f18d809e930 2023-10-03T10:12:06.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.201+0000 7f18d57fa700 1 -- 172.21.15.72:0/3021166447 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f18cc021030 con 0x7f18d809e930 2023-10-03T10:12:06.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.205+0000 7f18d57fa700 1 -- 172.21.15.72:0/3021166447 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f18cc030480 con 0x7f18d809e930 2023-10-03T10:12:06.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:06.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.288+0000 7f1db90d0700 1 Processor -- start 2023-10-03T10:12:06.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.288+0000 7f1db90d0700 1 -- start start 2023-10-03T10:12:06.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.289+0000 7f1db90d0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1db4131810 0x7f1db4131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.289+0000 7f1db90d0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1db409a580 0x7f1db4139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.289+0000 7f1db90d0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db41313c0 con 0x7f1db4099a40 2023-10-03T10:12:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.289+0000 7f1db90d0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db406e8c0 con 0x7f1db4131810 2023-10-03T10:12:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.289+0000 7f1db90d0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1db4071d20 con 0x7f1db409a580 2023-10-03T10:12:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.289+0000 7f1db2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1db4131810 0x7f1db4131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.289+0000 7f1db2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1db4131810 0x7f1db4131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50822/0 (socket says 172.21.15.72:50822) 2023-10-03T10:12:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.289+0000 7f1db359e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1db409a580 0x7f1db4139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.289+0000 7f1db2d9d700 1 -- 172.21.15.72:0/85492674 learned_addr learned my addr 172.21.15.72:0/85492674 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.289+0000 7f1db259c700 1 --1- 172.21.15.72:0/85492674 >> v1:172.21.15.72:6789/0 conn(0x7f1db4099a40 0x7f1db4099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57604/0 (socket says 172.21.15.72:57604) 2023-10-03T10:12:06.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.289+0000 7f1db359e700 1 -- 172.21.15.72:0/85492674 >> v2:172.21.15.72:3300/0 conn(0x7f1db4131810 msgr2=0x7f1db4131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:06.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.289+0000 7f1db359e700 1 --2- 172.21.15.72:0/85492674 >> v2:172.21.15.72:3300/0 conn(0x7f1db4131810 0x7f1db4131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.289+0000 7f1db359e700 1 -- 172.21.15.72:0/85492674 >> v1:172.21.15.72:6789/0 conn(0x7f1db4099a40 legacy=0x7f1db4099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:06.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.289+0000 7f1db359e700 1 -- 172.21.15.72:0/85492674 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db40721a0 con 0x7f1db409a580 2023-10-03T10:12:06.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.289+0000 7f1db2d9d700 1 --2- 172.21.15.72:0/85492674 >> v2:172.21.15.72:3300/0 conn(0x7f1db4131810 0x7f1db4131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:06.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.290+0000 7f1db359e700 1 --2- 172.21.15.72:0/85492674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1db409a580 0x7f1db4139660 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009d90 tx=0x7f1dac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7420bbc8518fa0d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.290+0000 7f1db1d9b700 1 -- 172.21.15.72:0/85492674 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00e070 con 0x7f1db409a580 2023-10-03T10:12:06.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.290+0000 7f1db1d9b700 1 -- 172.21.15.72:0/85492674 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac00bb20 con 0x7f1db409a580 2023-10-03T10:12:06.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.290+0000 7f1db1d9b700 1 -- 172.21.15.72:0/85492674 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac012430 con 0x7f1db409a580 2023-10-03T10:12:06.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.290+0000 7f1db90d0700 1 -- 172.21.15.72:0/85492674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1db409a580 msgr2=0x7f1db4139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.290+0000 7f1db90d0700 1 --2- 172.21.15.72:0/85492674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1db409a580 0x7f1db4139660 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009d90 tx=0x7f1dac00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:06.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.291+0000 7f1db90d0700 1 -- 172.21.15.72:0/85492674 shutdown_connections 2023-10-03T10:12:06.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.291+0000 7f1db90d0700 1 --2- 172.21.15.72:0/85492674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1db409a580 0x7f1db4139660 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.291+0000 7f1db90d0700 1 --2- 172.21.15.72:0/85492674 >> v2:172.21.15.72:3300/0 conn(0x7f1db4131810 0x7f1db4131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.291+0000 7f1db90d0700 1 -- 172.21.15.72:0/85492674 >> 172.21.15.72:0/85492674 conn(0x7f1db40a2aa0 msgr2=0x7f1db40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.291+0000 7f1db90d0700 1 -- 172.21.15.72:0/85492674 shutdown_connections 2023-10-03T10:12:06.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.291+0000 7f1db90d0700 1 -- 172.21.15.72:0/85492674 wait complete. 2023-10-03T10:12:06.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.292+0000 7f1db90d0700 1 Processor -- start 2023-10-03T10:12:06.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.292+0000 7f1db90d0700 1 -- start start 2023-10-03T10:12:06.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db90d0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1db4099a40 0x7f1db411b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db90d0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db409a580 0x7f1db411be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db90d0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1db4131810 0x7f1db411c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db90d0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db411d3c0 con 0x7f1db409a580 2023-10-03T10:12:06.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db90d0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db411e610 con 0x7f1db4131810 2023-10-03T10:12:06.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db90d0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1db411cd80 con 0x7f1db4099a40 2023-10-03T10:12:06.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db2d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1db4099a40 0x7f1db411b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db2d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1db4099a40 0x7f1db411b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:43728/0 (socket says 172.21.15.72:43728) 2023-10-03T10:12:06.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db2d9d700 1 -- 172.21.15.72:0/1514101235 learned_addr learned my addr 172.21.15.72:0/1514101235 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:06.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db259c700 1 --2- 172.21.15.72:0/1514101235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db409a580 0x7f1db411be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db359e700 1 --2- 172.21.15.72:0/1514101235 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1db4131810 0x7f1db411c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db2d9d700 1 -- 172.21.15.72:0/1514101235 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1db4131810 msgr2=0x7f1db411c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db2d9d700 1 --2- 172.21.15.72:0/1514101235 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1db4131810 0x7f1db411c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db2d9d700 1 -- 172.21.15.72:0/1514101235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db409a580 msgr2=0x7f1db411be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db2d9d700 1 --2- 172.21.15.72:0/1514101235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db409a580 0x7f1db411be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db2d9d700 1 -- 172.21.15.72:0/1514101235 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da4009550 con 0x7f1db4099a40 2023-10-03T10:12:06.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.293+0000 7f1db2d9d700 1 --2- 172.21.15.72:0/1514101235 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1db4099a40 0x7f1db411b920 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1da400b3f0 tx=0x7f1da400b700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.294+0000 7f1d9b7fe700 1 -- 172.21.15.72:0/1514101235 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da4019070 con 0x7f1db4099a40 2023-10-03T10:12:06.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.294+0000 7f1d9b7fe700 1 -- 172.21.15.72:0/1514101235 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da400be70 con 0x7f1db4099a40 2023-10-03T10:12:06.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.294+0000 7f1d9b7fe700 1 -- 172.21.15.72:0/1514101235 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da401d610 con 0x7f1db4099a40 2023-10-03T10:12:06.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.295+0000 7f1db90d0700 1 -- 172.21.15.72:0/1514101235 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dac009a70 con 0x7f1db4099a40 2023-10-03T10:12:06.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.295+0000 7f1db90d0700 1 -- 172.21.15.72:0/1514101235 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db40a1c90 con 0x7f1db4099a40 2023-10-03T10:12:06.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.296+0000 7f1d9b7fe700 1 -- 172.21.15.72:0/1514101235 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f1da401d770 con 0x7f1db4099a40 2023-10-03T10:12:06.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.297+0000 7f1d9b7fe700 1 -- 172.21.15.72:0/1514101235 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f1da4047340 con 0x7f1db4099a40 2023-10-03T10:12:06.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.297+0000 7f1db90d0700 1 -- 172.21.15.72:0/1514101235 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db406eb00 con 0x7f1db4099a40 2023-10-03T10:12:06.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.305+0000 7f1d9b7fe700 1 -- 172.21.15.72:0/1514101235 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f1da4022080 con 0x7f1db4099a40 2023-10-03T10:12:06.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.330+0000 7f1b14ca7700 1 Processor -- start 2023-10-03T10:12:06.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.330+0000 7f1b14ca7700 1 -- start start 2023-10-03T10:12:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.330+0000 7f1b14ca7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b1009d6f0 0x7f1b1009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.330+0000 7f1b14ca7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009e440 0x7f1b10134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.330+0000 7f1b14ca7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1009b120 con 0x7f1b1009e000 2023-10-03T10:12:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.330+0000 7f1b14ca7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1006b460 con 0x7f1b1009d6f0 2023-10-03T10:12:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.330+0000 7f1b14ca7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1009a7e0 con 0x7f1b1009e440 2023-10-03T10:12:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.331+0000 7f1b0ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009e440 0x7f1b10134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.331+0000 7f1b0e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b1009d6f0 0x7f1b1009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.331+0000 7f1b0ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009e440 0x7f1b10134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55432/0 (socket says 172.21.15.72:55432) 2023-10-03T10:12:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.331+0000 7f1b0ed9d700 1 -- 172.21.15.72:0/2415647355 learned_addr learned my addr 172.21.15.72:0/2415647355 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.331+0000 7f1b0ed9d700 1 -- 172.21.15.72:0/2415647355 >> v2:172.21.15.72:3300/0 conn(0x7f1b1009d6f0 msgr2=0x7f1b1009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:06.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.331+0000 7f1b0ed9d700 1 --2- 172.21.15.72:0/2415647355 >> v2:172.21.15.72:3300/0 conn(0x7f1b1009d6f0 0x7f1b1009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.331+0000 7f1b0ed9d700 1 -- 172.21.15.72:0/2415647355 >> v1:172.21.15.72:6789/0 conn(0x7f1b1009e000 legacy=0x7f1b101339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:06.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.331+0000 7f1b0ed9d700 1 -- 172.21.15.72:0/2415647355 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1009a500 con 0x7f1b1009e440 2023-10-03T10:12:06.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.331+0000 7f1b0e59c700 1 --2- 172.21.15.72:0/2415647355 >> v2:172.21.15.72:3300/0 conn(0x7f1b1009d6f0 0x7f1b1009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:06.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.331+0000 7f1b0ed9d700 1 --2- 172.21.15.72:0/2415647355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009e440 0x7f1b10134100 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009e80 tx=0x7f1b0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d11faf5ba9fe396 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.331+0000 7f1b0d59a700 1 -- 172.21.15.72:0/2415647355 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0800e070 con 0x7f1b1009e440 2023-10-03T10:12:06.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.331+0000 7f1b0d59a700 1 -- 172.21.15.72:0/2415647355 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b08003a20 con 0x7f1b1009e440 2023-10-03T10:12:06.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.331+0000 7f1b0d59a700 1 -- 172.21.15.72:0/2415647355 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08003dd0 con 0x7f1b1009e440 2023-10-03T10:12:06.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.332+0000 7f1b14ca7700 1 -- 172.21.15.72:0/2415647355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009e440 msgr2=0x7f1b10134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.332+0000 7f1b14ca7700 1 --2- 172.21.15.72:0/2415647355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009e440 0x7f1b10134100 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009e80 tx=0x7f1b0800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:06.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.332+0000 7f1b14ca7700 1 -- 172.21.15.72:0/2415647355 shutdown_connections 2023-10-03T10:12:06.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.332+0000 7f1b14ca7700 1 --2- 172.21.15.72:0/2415647355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009e440 0x7f1b10134100 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.332+0000 7f1b14ca7700 1 --2- 172.21.15.72:0/2415647355 >> v2:172.21.15.72:3300/0 conn(0x7f1b1009d6f0 0x7f1b1009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.332+0000 7f1b14ca7700 1 -- 172.21.15.72:0/2415647355 >> 172.21.15.72:0/2415647355 conn(0x7f1b10066f50 msgr2=0x7f1b1009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.332+0000 7f1b14ca7700 1 -- 172.21.15.72:0/2415647355 shutdown_connections 2023-10-03T10:12:06.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.332+0000 7f1b14ca7700 1 -- 172.21.15.72:0/2415647355 wait complete. 2023-10-03T10:12:06.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.333+0000 7f1b14ca7700 1 Processor -- start 2023-10-03T10:12:06.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.333+0000 7f1b14ca7700 1 -- start start 2023-10-03T10:12:06.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.333+0000 7f1b14ca7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b1009d6f0 0x7f1b101a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b14ca7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1009e000 0x7f1b101a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b14ca7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009e440 0x7f1b101a6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b14ca7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b101a8c80 con 0x7f1b1009e000 2023-10-03T10:12:06.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b14ca7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b101aa290 con 0x7f1b1009e440 2023-10-03T10:12:06.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b14ca7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b101a98d0 con 0x7f1b1009d6f0 2023-10-03T10:12:06.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b0dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1009e000 0x7f1b101a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b0dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1009e000 0x7f1b101a62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50852/0 (socket says 172.21.15.72:50852) 2023-10-03T10:12:06.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b0dd9b700 1 -- 172.21.15.72:0/3592087884 learned_addr learned my addr 172.21.15.72:0/3592087884 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:06.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b0ed9d700 1 --2- 172.21.15.72:0/3592087884 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009e440 0x7f1b101a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b0ed9d700 1 -- 172.21.15.72:0/3592087884 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b1009d6f0 msgr2=0x7f1b101a5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b0ed9d700 1 --2- 172.21.15.72:0/3592087884 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b1009d6f0 0x7f1b101a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b0ed9d700 1 -- 172.21.15.72:0/3592087884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1009e000 msgr2=0x7f1b101a62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b0ed9d700 1 --2- 172.21.15.72:0/3592087884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1009e000 0x7f1b101a62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b0ed9d700 1 -- 172.21.15.72:0/3592087884 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b000094a0 con 0x7f1b1009e440 2023-10-03T10:12:06.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b0dd9b700 1 --2- 172.21.15.72:0/3592087884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1009e000 0x7f1b101a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:06.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b0ed9d700 1 --2- 172.21.15.72:0/3592087884 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009e440 0x7f1b101a6830 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1b08014000 tx=0x7f1b08004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1afeffd700 1 -- 172.21.15.72:0/3592087884 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08004440 con 0x7f1b1009e440 2023-10-03T10:12:06.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1afeffd700 1 -- 172.21.15.72:0/3592087884 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b080045a0 con 0x7f1b1009e440 2023-10-03T10:12:06.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1b14ca7700 1 -- 172.21.15.72:0/3592087884 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b08009b30 con 0x7f1b1009e440 2023-10-03T10:12:06.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.334+0000 7f1afeffd700 1 -- 172.21.15.72:0/3592087884 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08004950 con 0x7f1b1009e440 2023-10-03T10:12:06.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.335+0000 7f1b14ca7700 1 -- 172.21.15.72:0/3592087884 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1009c710 con 0x7f1b1009e440 2023-10-03T10:12:06.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.335+0000 7f1b14ca7700 1 -- 172.21.15.72:0/3592087884 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b10074ea0 con 0x7f1b1009e440 2023-10-03T10:12:06.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.336+0000 7f1afeffd700 1 -- 172.21.15.72:0/3592087884 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f1b0802e430 con 0x7f1b1009e440 2023-10-03T10:12:06.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.336+0000 7f1afeffd700 1 -- 172.21.15.72:0/3592087884 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f1b08040b70 con 0x7f1b1009e440 2023-10-03T10:12:06.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.340+0000 7f1afeffd700 1 -- 172.21.15.72:0/3592087884 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f1b0802d390 con 0x7f1b1009e440 2023-10-03T10:12:06.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.347+0000 7fd10a7fd700 1 Processor -- start 2023-10-03T10:12:06.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.347+0000 7fd10a7fd700 1 -- start start 2023-10-03T10:12:06.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.348+0000 7fd10a7fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd104131630 0x7fd104131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.348+0000 7fd10a7fd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd104131f40 0x7fd10406e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.348+0000 7fd10a7fd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd104071a00 con 0x7fd10406e9d0 2023-10-03T10:12:06.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.348+0000 7fd10a7fd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd104131430 con 0x7fd104131f40 2023-10-03T10:12:06.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.348+0000 7fd10a7fd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10409a510 con 0x7fd104131630 2023-10-03T10:12:06.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.348+0000 7fd108d9a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd10406e9d0 0x7fd104138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57630/0 (socket says 172.21.15.72:57630) 2023-10-03T10:12:06.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.348+0000 7fd108d9a700 1 -- 172.21.15.72:0/2427931387 learned_addr learned my addr 172.21.15.72:0/2427931387 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:06.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.348+0000 7fd103fff700 1 --2- 172.21.15.72:0/2427931387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd104131630 0x7fd104131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.348+0000 7fd1037fe700 1 --2- 172.21.15.72:0/2427931387 >> v2:172.21.15.72:3300/0 conn(0x7fd104131f40 0x7fd10406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.349+0000 7fd103fff700 1 -- 172.21.15.72:0/2427931387 >> v2:172.21.15.72:3300/0 conn(0x7fd104131f40 msgr2=0x7fd10406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.349+0000 7fd103fff700 1 --2- 172.21.15.72:0/2427931387 >> v2:172.21.15.72:3300/0 conn(0x7fd104131f40 0x7fd10406e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.349+0000 7fd103fff700 1 -- 172.21.15.72:0/2427931387 >> v1:172.21.15.72:6789/0 conn(0x7fd10406e9d0 legacy=0x7fd104138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.349+0000 7fd103fff700 1 -- 172.21.15.72:0/2427931387 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1040721c0 con 0x7fd104131630 2023-10-03T10:12:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.349+0000 7fd103fff700 1 --2- 172.21.15.72:0/2427931387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd104131630 0x7fd104131a00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009840 tx=0x7fd0f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=896ad6c964cd8b3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.349+0000 7fd102ffd700 1 -- 172.21.15.72:0/2427931387 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4011830 con 0x7fd104131630 2023-10-03T10:12:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.349+0000 7fd102ffd700 1 -- 172.21.15.72:0/2427931387 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f4011990 con 0x7fd104131630 2023-10-03T10:12:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.349+0000 7fd102ffd700 1 -- 172.21.15.72:0/2427931387 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4011d20 con 0x7fd104131630 2023-10-03T10:12:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.350+0000 7fd10a7fd700 1 -- 172.21.15.72:0/2427931387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd104131630 msgr2=0x7fd104131a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.350+0000 7fd10a7fd700 1 --2- 172.21.15.72:0/2427931387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd104131630 0x7fd104131a00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009840 tx=0x7fd0f4009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.350+0000 7fd10a7fd700 1 -- 172.21.15.72:0/2427931387 shutdown_connections 2023-10-03T10:12:06.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.350+0000 7fd10a7fd700 1 --2- 172.21.15.72:0/2427931387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd104131630 0x7fd104131a00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.350+0000 7fd10a7fd700 1 --2- 172.21.15.72:0/2427931387 >> v2:172.21.15.72:3300/0 conn(0x7fd104131f40 0x7fd10406e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.350+0000 7fd10a7fd700 1 -- 172.21.15.72:0/2427931387 >> 172.21.15.72:0/2427931387 conn(0x7fd1040a2aa0 msgr2=0x7fd1040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.350+0000 7fd10a7fd700 1 -- 172.21.15.72:0/2427931387 shutdown_connections 2023-10-03T10:12:06.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.350+0000 7fd10a7fd700 1 -- 172.21.15.72:0/2427931387 wait complete. 2023-10-03T10:12:06.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.351+0000 7fd10a7fd700 1 Processor -- start 2023-10-03T10:12:06.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.352+0000 7fd10a7fd700 1 -- start start 2023-10-03T10:12:06.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.352+0000 7fd10a7fd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd10406e9d0 0x7fd10411b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.352+0000 7fd10a7fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd104131630 0x7fd10411bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.352+0000 7fd10a7fd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd104131f40 0x7fd10411c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:06.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.352+0000 7fd10a7fd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10411f460 con 0x7fd10406e9d0 2023-10-03T10:12:06.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.352+0000 7fd10a7fd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10411db30 con 0x7fd104131630 2023-10-03T10:12:06.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.352+0000 7fd10a7fd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd10411ebf0 con 0x7fd104131f40 2023-10-03T10:12:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.352+0000 7fd1037fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd104131630 0x7fd10411bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.352+0000 7fd1037fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd104131630 0x7fd10411bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55464/0 (socket says 172.21.15.72:55464) 2023-10-03T10:12:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.352+0000 7fd1037fe700 1 -- 172.21.15.72:0/3023521640 learned_addr learned my addr 172.21.15.72:0/3023521640 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.352+0000 7fd103fff700 1 --2- 172.21.15.72:0/3023521640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd10406e9d0 0x7fd10411b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.353+0000 7fd108d9a700 1 --2- 172.21.15.72:0/3023521640 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd104131f40 0x7fd10411c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.353+0000 7fd1037fe700 1 -- 172.21.15.72:0/3023521640 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd104131f40 msgr2=0x7fd10411c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.353+0000 7fd1037fe700 1 --2- 172.21.15.72:0/3023521640 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd104131f40 0x7fd10411c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.353+0000 7fd1037fe700 1 -- 172.21.15.72:0/3023521640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd10406e9d0 msgr2=0x7fd10411b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.353+0000 7fd1037fe700 1 --2- 172.21.15.72:0/3023521640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd10406e9d0 0x7fd10411b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.353+0000 7fd1037fe700 1 -- 172.21.15.72:0/3023521640 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f40094a0 con 0x7fd104131630 2023-10-03T10:12:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.353+0000 7fd1037fe700 1 --2- 172.21.15.72:0/3023521640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd104131630 0x7fd10411bf10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800e980 tx=0x7fd0f800ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.353+0000 7fd100ff9700 1 -- 172.21.15.72:0/3023521640 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8009710 con 0x7fd104131630 2023-10-03T10:12:06.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.353+0000 7fd100ff9700 1 -- 172.21.15.72:0/3023521640 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f800eed0 con 0x7fd104131630 2023-10-03T10:12:06.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.353+0000 7fd10a7fd700 1 -- 172.21.15.72:0/3023521640 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd104099f20 con 0x7fd104131630 2023-10-03T10:12:06.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.353+0000 7fd100ff9700 1 -- 172.21.15.72:0/3023521640 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f800ca70 con 0x7fd104131630 2023-10-03T10:12:06.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.353+0000 7fd10a7fd700 1 -- 172.21.15.72:0/3023521640 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10411d550 con 0x7fd104131630 2023-10-03T10:12:06.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.354+0000 7fd100ff9700 1 -- 172.21.15.72:0/3023521640 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fd0f800cbd0 con 0x7fd104131630 2023-10-03T10:12:06.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.354+0000 7fd100ff9700 1 -- 172.21.15.72:0/3023521640 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7fd0f803f9a0 con 0x7fd104131630 2023-10-03T10:12:06.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.355+0000 7fd10a7fd700 1 -- 172.21.15.72:0/3023521640 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10411ee20 con 0x7fd104131630 2023-10-03T10:12:06.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.359+0000 7fd100ff9700 1 -- 172.21.15.72:0/3023521640 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fd10411ee20 con 0x7fd104131630 2023-10-03T10:12:06.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.418+0000 7f18df0bb700 1 -- 172.21.15.72:0/3021166447 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f18d8074ea0 con 0x7f18d809e930 2023-10-03T10:12:06.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.418+0000 7f18d57fa700 1 -- 172.21.15.72:0/3021166447 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18cc015030 con 0x7f18d809e930 2023-10-03T10:12:06.419 INFO:teuthology.orchestra.run.smithi072.stdout:38654705694 2023-10-03T10:12:06.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.420+0000 7f18df0bb700 1 -- 172.21.15.72:0/3021166447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d809e930 msgr2=0x7f18d81a3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.420+0000 7f18df0bb700 1 --2- 172.21.15.72:0/3021166447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d809e930 0x7f18d81a3c10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0098f0 tx=0x7f18cc004750 comp rx=0 tx=0).stop 2023-10-03T10:12:06.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.420+0000 7f18df0bb700 1 -- 172.21.15.72:0/3021166447 shutdown_connections 2023-10-03T10:12:06.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.420+0000 7f18df0bb700 1 --2- 172.21.15.72:0/3021166447 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d809f650 0x7f18d81a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.420+0000 7f18df0bb700 1 --2- 172.21.15.72:0/3021166447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d809e930 0x7f18d81a3c10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.420+0000 7f18df0bb700 1 --2- 172.21.15.72:0/3021166447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d809f240 0x7f18d81a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.420+0000 7f18df0bb700 1 -- 172.21.15.72:0/3021166447 >> 172.21.15.72:0/3021166447 conn(0x7f18d80a4210 msgr2=0x7f18d81b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.420+0000 7f18df0bb700 1 -- 172.21.15.72:0/3021166447 shutdown_connections 2023-10-03T10:12:06.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.420+0000 7f18df0bb700 1 -- 172.21.15.72:0/3021166447 wait complete. 2023-10-03T10:12:06.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.0 2023-10-03T10:12:06.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.484+0000 7f1db90d0700 1 -- 172.21.15.72:0/1514101235 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1db4074ea0 con 0x7f1db4099a40 2023-10-03T10:12:06.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.484+0000 7f1d9b7fe700 1 -- 172.21.15.72:0/1514101235 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1da401b700 con 0x7f1db4099a40 2023-10-03T10:12:06.485 INFO:teuthology.orchestra.run.smithi072.stdout:38654705694 2023-10-03T10:12:06.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.487+0000 7f1db90d0700 1 -- 172.21.15.72:0/1514101235 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1db4099a40 msgr2=0x7f1db411b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.487+0000 7f1db90d0700 1 --2- 172.21.15.72:0/1514101235 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1db4099a40 0x7f1db411b920 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1da400b3f0 tx=0x7f1da400b700 comp rx=0 tx=0).stop 2023-10-03T10:12:06.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.487+0000 7f1db90d0700 1 -- 172.21.15.72:0/1514101235 shutdown_connections 2023-10-03T10:12:06.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.487+0000 7f1db90d0700 1 --2- 172.21.15.72:0/1514101235 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1db4131810 0x7f1db411c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.487+0000 7f1db90d0700 1 --2- 172.21.15.72:0/1514101235 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1db4099a40 0x7f1db411b920 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.487+0000 7f1db90d0700 1 --2- 172.21.15.72:0/1514101235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db409a580 0x7f1db411be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.487+0000 7f1db90d0700 1 -- 172.21.15.72:0/1514101235 >> 172.21.15.72:0/1514101235 conn(0x7f1db40a2aa0 msgr2=0x7f1db409d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.487+0000 7f1db90d0700 1 -- 172.21.15.72:0/1514101235 shutdown_connections 2023-10-03T10:12:06.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.487+0000 7f1db90d0700 1 -- 172.21.15.72:0/1514101235 wait complete. 2023-10-03T10:12:06.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.2 2023-10-03T10:12:06.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.522+0000 7f1b14ca7700 1 -- 172.21.15.72:0/3592087884 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1b1009f420 con 0x7f1b1009e440 2023-10-03T10:12:06.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.523+0000 7f1afeffd700 1 -- 172.21.15.72:0/3592087884 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b08017070 con 0x7f1b1009e440 2023-10-03T10:12:06.523 INFO:teuthology.orchestra.run.smithi072.stdout:38654705693 2023-10-03T10:12:06.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.524+0000 7f1b14ca7700 1 -- 172.21.15.72:0/3592087884 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009e440 msgr2=0x7f1b101a6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.524+0000 7f1b14ca7700 1 --2- 172.21.15.72:0/3592087884 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009e440 0x7f1b101a6830 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1b08014000 tx=0x7f1b08004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.524+0000 7f1b14ca7700 1 -- 172.21.15.72:0/3592087884 shutdown_connections 2023-10-03T10:12:06.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.524+0000 7f1b14ca7700 1 --2- 172.21.15.72:0/3592087884 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009e440 0x7f1b101a6830 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.524+0000 7f1b14ca7700 1 --2- 172.21.15.72:0/3592087884 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b1009d6f0 0x7f1b101a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.524+0000 7f1b14ca7700 1 --2- 172.21.15.72:0/3592087884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1009e000 0x7f1b101a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.524+0000 7f1b14ca7700 1 -- 172.21.15.72:0/3592087884 >> 172.21.15.72:0/3592087884 conn(0x7f1b10066f50 msgr2=0x7f1b101bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.524+0000 7f1b14ca7700 1 -- 172.21.15.72:0/3592087884 shutdown_connections 2023-10-03T10:12:06.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.525+0000 7f1b14ca7700 1 -- 172.21.15.72:0/3592087884 wait complete. 2023-10-03T10:12:06.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.3 2023-10-03T10:12:06.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.555+0000 7fd10a7fd700 1 -- 172.21.15.72:0/3023521640 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd10411ee20 con 0x7fd104131630 2023-10-03T10:12:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.555+0000 7fd100ff9700 1 -- 172.21.15.72:0/3023521640 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd10411ee20 con 0x7fd104131630 2023-10-03T10:12:06.556 INFO:teuthology.orchestra.run.smithi072.stdout:38654705694 2023-10-03T10:12:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.557+0000 7fd10a7fd700 1 -- 172.21.15.72:0/3023521640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd104131630 msgr2=0x7fd10411bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.557+0000 7fd10a7fd700 1 --2- 172.21.15.72:0/3023521640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd104131630 0x7fd10411bf10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800e980 tx=0x7fd0f800ec90 comp rx=0 tx=0).stop 2023-10-03T10:12:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.557+0000 7fd10a7fd700 1 -- 172.21.15.72:0/3023521640 shutdown_connections 2023-10-03T10:12:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.557+0000 7fd10a7fd700 1 --2- 172.21.15.72:0/3023521640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd10406e9d0 0x7fd10411b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.557+0000 7fd10a7fd700 1 --2- 172.21.15.72:0/3023521640 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd104131f40 0x7fd10411c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.557+0000 7fd10a7fd700 1 --2- 172.21.15.72:0/3023521640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd104131630 0x7fd10411bf10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.557+0000 7fd10a7fd700 1 -- 172.21.15.72:0/3023521640 >> 172.21.15.72:0/3023521640 conn(0x7fd1040a2aa0 msgr2=0x7fd1041b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.557+0000 7fd10a7fd700 1 -- 172.21.15.72:0/3023521640 shutdown_connections 2023-10-03T10:12:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:06.557+0000 7fd10a7fd700 1 -- 172.21.15.72:0/3023521640 wait complete. 2023-10-03T10:12:06.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.1 2023-10-03T10:12:07.090 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:07.089+0000 7f6aae266700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-10-03T10:12:07.091 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:07.090+0000 7f6aae266700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-03T10:12:07.092 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-03T10:12:07.091+0000 7f6aae266700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-03T10:12:07.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:07.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:07.537 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:07.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.573+0000 7f4301689700 1 Processor -- start 2023-10-03T10:12:07.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.573+0000 7f4301689700 1 -- start start 2023-10-03T10:12:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.574+0000 7f4301689700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42fc09d6f0 0x7f42fc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.574+0000 7f4301689700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42fc09e000 0x7f42fc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.574+0000 7f4301689700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42fc09e410 0x7f42fc130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.574+0000 7f4301689700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42fc09f520 con 0x7f42fc09e000 2023-10-03T10:12:07.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.574+0000 7f4301689700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc09f130 con 0x7f42fc09d6f0 2023-10-03T10:12:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.574+0000 7f4301689700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc09e930 con 0x7f42fc09e410 2023-10-03T10:12:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.574+0000 7f42faffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42fc09d6f0 0x7f42fc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.574+0000 7f42faffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42fc09d6f0 0x7f42fc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55472/0 (socket says 172.21.15.72:55472) 2023-10-03T10:12:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.574+0000 7f42faffd700 1 -- 172.21.15.72:0/2979140349 learned_addr learned my addr 172.21.15.72:0/2979140349 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.574+0000 7f42fb7fe700 1 --2- 172.21.15.72:0/2979140349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42fc09e410 0x7f42fc130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.575+0000 7f42f3fff700 1 --2- 172.21.15.72:0/2979140349 >> v2:172.21.15.72:3300/0 conn(0x7f42fc09e000 0x7f42fc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.575+0000 7f42fb7fe700 1 -- 172.21.15.72:0/2979140349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42fc09d6f0 msgr2=0x7f42fc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:07.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.575+0000 7f42fb7fe700 1 --2- 172.21.15.72:0/2979140349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42fc09d6f0 0x7f42fc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.575+0000 7f42fb7fe700 1 -- 172.21.15.72:0/2979140349 >> v2:172.21.15.72:3300/0 conn(0x7f42fc09e000 msgr2=0x7f42fc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.575+0000 7f42fb7fe700 1 --2- 172.21.15.72:0/2979140349 >> v2:172.21.15.72:3300/0 conn(0x7f42fc09e000 0x7f42fc130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.575+0000 7f42fb7fe700 1 -- 172.21.15.72:0/2979140349 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42fc09b2d0 con 0x7f42fc09e410 2023-10-03T10:12:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.575+0000 7f42faffd700 1 --2- 172.21.15.72:0/2979140349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42fc09d6f0 0x7f42fc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.575+0000 7f42fb7fe700 1 --2- 172.21.15.72:0/2979140349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42fc09e410 0x7f42fc130ba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009dc0 tx=0x7f42f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adb9d6ecd0b626e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.575+0000 7f42fa7fc700 1 -- 172.21.15.72:0/2979140349 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f400e070 con 0x7f42fc09e410 2023-10-03T10:12:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.575+0000 7f42fa7fc700 1 -- 172.21.15.72:0/2979140349 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f400bae0 con 0x7f42fc09e410 2023-10-03T10:12:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.575+0000 7f42fa7fc700 1 -- 172.21.15.72:0/2979140349 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f400be90 con 0x7f42fc09e410 2023-10-03T10:12:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.576+0000 7f4301689700 1 -- 172.21.15.72:0/2979140349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42fc09e410 msgr2=0x7f42fc130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.576+0000 7f4301689700 1 --2- 172.21.15.72:0/2979140349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42fc09e410 0x7f42fc130ba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009dc0 tx=0x7f42f400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.576+0000 7f4301689700 1 -- 172.21.15.72:0/2979140349 shutdown_connections 2023-10-03T10:12:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.576+0000 7f4301689700 1 --2- 172.21.15.72:0/2979140349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42fc09e410 0x7f42fc130ba0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.576+0000 7f4301689700 1 --2- 172.21.15.72:0/2979140349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42fc09d6f0 0x7f42fc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.576+0000 7f4301689700 1 --2- 172.21.15.72:0/2979140349 >> v2:172.21.15.72:3300/0 conn(0x7f42fc09e000 0x7f42fc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.576+0000 7f4301689700 1 -- 172.21.15.72:0/2979140349 >> 172.21.15.72:0/2979140349 conn(0x7f42fc066f50 msgr2=0x7f42fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:07.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.576+0000 7f4301689700 1 -- 172.21.15.72:0/2979140349 shutdown_connections 2023-10-03T10:12:07.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.577+0000 7f4301689700 1 -- 172.21.15.72:0/2979140349 wait complete. 2023-10-03T10:12:07.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.578+0000 7f4301689700 1 Processor -- start 2023-10-03T10:12:07.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.578+0000 7f4301689700 1 -- start start 2023-10-03T10:12:07.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.578+0000 7f4301689700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42fc09d6f0 0x7f42fc11dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f4301689700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42fc09e000 0x7f42fc11e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f4301689700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42fc09e410 0x7f42fc11e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f4301689700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc11f9b0 con 0x7f42fc09e000 2023-10-03T10:12:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f4301689700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc120c00 con 0x7f42fc09d6f0 2023-10-03T10:12:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f4301689700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc11ffa0 con 0x7f42fc09e410 2023-10-03T10:12:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f42faffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42fc09d6f0 0x7f42fc11dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f42faffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42fc09d6f0 0x7f42fc11dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55478/0 (socket says 172.21.15.72:55478) 2023-10-03T10:12:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f42faffd700 1 -- 172.21.15.72:0/2576846426 learned_addr learned my addr 172.21.15.72:0/2576846426 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f42f3fff700 1 --2- 172.21.15.72:0/2576846426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42fc09e000 0x7f42fc11e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f42fb7fe700 1 --2- 172.21.15.72:0/2576846426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42fc09e410 0x7f42fc11e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f42faffd700 1 -- 172.21.15.72:0/2576846426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42fc09e410 msgr2=0x7f42fc11e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f42faffd700 1 --2- 172.21.15.72:0/2576846426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42fc09e410 0x7f42fc11e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f42faffd700 1 -- 172.21.15.72:0/2576846426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42fc09e000 msgr2=0x7f42fc11e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f42faffd700 1 --2- 172.21.15.72:0/2576846426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42fc09e000 0x7f42fc11e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f42faffd700 1 -- 172.21.15.72:0/2576846426 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec00b7f0 con 0x7f42fc09d6f0 2023-10-03T10:12:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f42fb7fe700 1 --2- 172.21.15.72:0/2576846426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42fc09e410 0x7f42fc11e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.579+0000 7f42faffd700 1 --2- 172.21.15.72:0/2576846426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42fc09d6f0 0x7f42fc11dda0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f42ec010ee0 tx=0x7f42ec00e640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.580+0000 7f42f37fe700 1 -- 172.21.15.72:0/2576846426 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec004230 con 0x7f42fc09d6f0 2023-10-03T10:12:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.580+0000 7f42f37fe700 1 -- 172.21.15.72:0/2576846426 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec004390 con 0x7f42fc09d6f0 2023-10-03T10:12:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.580+0000 7f4301689700 1 -- 172.21.15.72:0/2576846426 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f4009a70 con 0x7f42fc09d6f0 2023-10-03T10:12:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.580+0000 7f42f37fe700 1 -- 172.21.15.72:0/2576846426 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec00ee10 con 0x7f42fc09d6f0 2023-10-03T10:12:07.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.580+0000 7f4301689700 1 -- 172.21.15.72:0/2576846426 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42fc09c700 con 0x7f42fc09d6f0 2023-10-03T10:12:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.581+0000 7f42f37fe700 1 -- 172.21.15.72:0/2576846426 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f42ec0036a0 con 0x7f42fc09d6f0 2023-10-03T10:12:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.581+0000 7f4301689700 1 -- 172.21.15.72:0/2576846426 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42fc11ac20 con 0x7f42fc09d6f0 2023-10-03T10:12:07.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.581+0000 7f42f37fe700 1 -- 172.21.15.72:0/2576846426 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4009+0+0 (secure 0 0 0) 0x7f42ec042280 con 0x7f42fc09d6f0 2023-10-03T10:12:07.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.587+0000 7f42f37fe700 1 -- 172.21.15.72:0/2576846426 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42ec011450 con 0x7f42fc09d6f0 2023-10-03T10:12:07.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.639+0000 7f4d639d0700 1 Processor -- start 2023-10-03T10:12:07.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.640+0000 7f4d639d0700 1 -- start start 2023-10-03T10:12:07.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.640+0000 7f4d639d0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d5c072590 0x7f4d5c1354b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.640+0000 7f4d639d0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4d5c1359f0 0x7f4d5c137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.640+0000 7f4d639d0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5c130290 con 0x7f4d5c1306e0 2023-10-03T10:12:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.640+0000 7f4d639d0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5c09bad0 con 0x7f4d5c1359f0 2023-10-03T10:12:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.641+0000 7f4d639d0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c09a8e0 con 0x7f4d5c072590 2023-10-03T10:12:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.641+0000 7f4d60f6b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d5c072590 0x7f4d5c1354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.641+0000 7f4d60f6b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d5c072590 0x7f4d5c1354b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:43784/0 (socket says 172.21.15.72:43784) 2023-10-03T10:12:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.641+0000 7f4d60f6b700 1 -- 172.21.15.72:0/973671475 learned_addr learned my addr 172.21.15.72:0/973671475 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.641+0000 7f4d61f6d700 1 --2- 172.21.15.72:0/973671475 >> v2:172.21.15.72:3300/0 conn(0x7f4d5c1359f0 0x7f4d5c137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.641+0000 7f4d60f6b700 1 -- 172.21.15.72:0/973671475 >> v2:172.21.15.72:3300/0 conn(0x7f4d5c1359f0 msgr2=0x7f4d5c137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.641+0000 7f4d60f6b700 1 --2- 172.21.15.72:0/973671475 >> v2:172.21.15.72:3300/0 conn(0x7f4d5c1359f0 0x7f4d5c137dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.641+0000 7f4d60f6b700 1 -- 172.21.15.72:0/973671475 >> v1:172.21.15.72:6789/0 conn(0x7f4d5c1306e0 legacy=0x7f4d5c130ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.641+0000 7f4d53fff700 1 -- 172.21.15.72:0/973671475 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654483805 0 0) 0x7f4d5c130290 con 0x7f4d5c1306e0 2023-10-03T10:12:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.641+0000 7f4d60f6b700 1 -- 172.21.15.72:0/973671475 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c06c560 con 0x7f4d5c072590 2023-10-03T10:12:07.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.641+0000 7f4d61f6d700 1 --2- 172.21.15.72:0/973671475 >> v2:172.21.15.72:3300/0 conn(0x7f4d5c1359f0 0x7f4d5c137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:07.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.641+0000 7f4d60f6b700 1 --2- 172.21.15.72:0/973671475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d5c072590 0x7f4d5c1354b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0098f0 tx=0x7f4d4c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=595365bc7f2c4036 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:07.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.642+0000 7f4d53fff700 1 -- 172.21.15.72:0/973671475 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c010a90 con 0x7f4d5c072590 2023-10-03T10:12:07.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.642+0000 7f4d53fff700 1 -- 172.21.15.72:0/973671475 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c010bf0 con 0x7f4d5c072590 2023-10-03T10:12:07.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.642+0000 7f4d53fff700 1 -- 172.21.15.72:0/973671475 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c018440 con 0x7f4d5c072590 2023-10-03T10:12:07.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.642+0000 7f4d639d0700 1 -- 172.21.15.72:0/973671475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d5c072590 msgr2=0x7f4d5c1354b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.642+0000 7f4d639d0700 1 --2- 172.21.15.72:0/973671475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d5c072590 0x7f4d5c1354b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0098f0 tx=0x7f4d4c009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:07.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.642+0000 7f4d639d0700 1 -- 172.21.15.72:0/973671475 shutdown_connections 2023-10-03T10:12:07.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.642+0000 7f4d639d0700 1 --2- 172.21.15.72:0/973671475 >> v2:172.21.15.72:3300/0 conn(0x7f4d5c1359f0 0x7f4d5c137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.642+0000 7f4d639d0700 1 --2- 172.21.15.72:0/973671475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d5c072590 0x7f4d5c1354b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.642+0000 7f4d639d0700 1 -- 172.21.15.72:0/973671475 >> 172.21.15.72:0/973671475 conn(0x7f4d5c09f470 msgr2=0x7f4d5c0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:07.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.643+0000 7f4d639d0700 1 -- 172.21.15.72:0/973671475 shutdown_connections 2023-10-03T10:12:07.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.643+0000 7f4d639d0700 1 -- 172.21.15.72:0/973671475 wait complete. 2023-10-03T10:12:07.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.644+0000 7f4d639d0700 1 Processor -- start 2023-10-03T10:12:07.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.644+0000 7f4d639d0700 1 -- start start 2023-10-03T10:12:07.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d639d0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d5c072590 0x7f4d5c127ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d639d0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d5c1306e0 0x7f4d5c127ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d639d0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d5c1359f0 0x7f4d5c1c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d639d0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c128e60 con 0x7f4d5c1306e0 2023-10-03T10:12:07.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d639d0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c129730 con 0x7f4d5c1359f0 2023-10-03T10:12:07.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d639d0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c12ad70 con 0x7f4d5c072590 2023-10-03T10:12:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d60f6b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d5c1306e0 0x7f4d5c127ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d6176c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d5c072590 0x7f4d5c127ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d60f6b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d5c1306e0 0x7f4d5c127ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50898/0 (socket says 172.21.15.72:50898) 2023-10-03T10:12:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d60f6b700 1 -- 172.21.15.72:0/2149660620 learned_addr learned my addr 172.21.15.72:0/2149660620 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d61f6d700 1 --2- 172.21.15.72:0/2149660620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d5c1359f0 0x7f4d5c1c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d61f6d700 1 -- 172.21.15.72:0/2149660620 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d5c072590 msgr2=0x7f4d5c127ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d61f6d700 1 --2- 172.21.15.72:0/2149660620 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d5c072590 0x7f4d5c127ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d61f6d700 1 -- 172.21.15.72:0/2149660620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d5c1306e0 msgr2=0x7f4d5c127ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d61f6d700 1 --2- 172.21.15.72:0/2149660620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d5c1306e0 0x7f4d5c127ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.645+0000 7f4d61f6d700 1 -- 172.21.15.72:0/2149660620 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d54009a70 con 0x7f4d5c1359f0 2023-10-03T10:12:07.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.646+0000 7f4d61f6d700 1 --2- 172.21.15.72:0/2149660620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d5c1359f0 0x7f4d5c1c3cd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400efc0 tx=0x7f4d5400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:07.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.646+0000 7f4d51ffb700 1 -- 172.21.15.72:0/2149660620 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5400cc90 con 0x7f4d5c1359f0 2023-10-03T10:12:07.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.646+0000 7f4d51ffb700 1 -- 172.21.15.72:0/2149660620 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5400f040 con 0x7f4d5c1359f0 2023-10-03T10:12:07.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.646+0000 7f4d51ffb700 1 -- 172.21.15.72:0/2149660620 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d54014480 con 0x7f4d5c1359f0 2023-10-03T10:12:07.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.646+0000 7f4d639d0700 1 -- 172.21.15.72:0/2149660620 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c009550 con 0x7f4d5c1359f0 2023-10-03T10:12:07.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.646+0000 7f4d639d0700 1 -- 172.21.15.72:0/2149660620 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5c12aa90 con 0x7f4d5c1359f0 2023-10-03T10:12:07.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.647+0000 7f4d51ffb700 1 -- 172.21.15.72:0/2149660620 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f4d54014600 con 0x7f4d5c1359f0 2023-10-03T10:12:07.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.647+0000 7f4d639d0700 1 -- 172.21.15.72:0/2149660620 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5c0747f0 con 0x7f4d5c1359f0 2023-10-03T10:12:07.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.647+0000 7f4d51ffb700 1 -- 172.21.15.72:0/2149660620 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4009+0+0 (secure 0 0 0) 0x7f4d5403fed0 con 0x7f4d5c1359f0 2023-10-03T10:12:07.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.656+0000 7f4d51ffb700 1 -- 172.21.15.72:0/2149660620 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d54018020 con 0x7f4d5c1359f0 2023-10-03T10:12:07.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.680+0000 7f4855dd6700 1 Processor -- start 2023-10-03T10:12:07.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.680+0000 7f4855dd6700 1 -- start start 2023-10-03T10:12:07.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.680+0000 7f4855dd6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485009d6f0 0x7f485009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.681+0000 7f4855dd6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f485009e410 0x7f4850130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.681+0000 7f4855dd6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485009f130 con 0x7f485009e000 2023-10-03T10:12:07.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.681+0000 7f4855dd6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485009f520 con 0x7f485009e410 2023-10-03T10:12:07.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.681+0000 7f4855dd6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485009e930 con 0x7f485009d6f0 2023-10-03T10:12:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.681+0000 7f484ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f485009e410 0x7f4850130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.681+0000 7f484ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f485009e410 0x7f4850130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50914/0 (socket says 172.21.15.72:50914) 2023-10-03T10:12:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.681+0000 7f484ffff700 1 -- 172.21.15.72:0/168524269 learned_addr learned my addr 172.21.15.72:0/168524269 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.681+0000 7f484f7fe700 1 --2- 172.21.15.72:0/168524269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485009d6f0 0x7f485009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.681+0000 7f484ffff700 1 -- 172.21.15.72:0/168524269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485009d6f0 msgr2=0x7f485009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.681+0000 7f484ffff700 1 --2- 172.21.15.72:0/168524269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485009d6f0 0x7f485009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.681+0000 7f484ffff700 1 -- 172.21.15.72:0/168524269 >> v1:172.21.15.72:6789/0 conn(0x7f485009e000 legacy=0x7f4850130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.681+0000 7f484effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f485009e000 0x7f4850130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57650/0 (socket says 172.21.15.72:57650) 2023-10-03T10:12:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.682+0000 7f484ffff700 1 -- 172.21.15.72:0/168524269 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485009b2d0 con 0x7f485009e410 2023-10-03T10:12:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.682+0000 7f484f7fe700 1 --2- 172.21.15.72:0/168524269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485009d6f0 0x7f485009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.682+0000 7f484ffff700 1 --2- 172.21.15.72:0/168524269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485009e410 0x7f4850130d70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4848009e50 tx=0x7f484800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b489d7bcbcce30 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.682+0000 7f484e7fc700 1 -- 172.21.15.72:0/168524269 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484800e070 con 0x7f485009e410 2023-10-03T10:12:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.682+0000 7f484e7fc700 1 -- 172.21.15.72:0/168524269 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4848003a20 con 0x7f485009e410 2023-10-03T10:12:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.682+0000 7f484e7fc700 1 -- 172.21.15.72:0/168524269 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848003dd0 con 0x7f485009e410 2023-10-03T10:12:07.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.683+0000 7f4855dd6700 1 -- 172.21.15.72:0/168524269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485009e410 msgr2=0x7f4850130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.683+0000 7f4855dd6700 1 --2- 172.21.15.72:0/168524269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485009e410 0x7f4850130d70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4848009e50 tx=0x7f484800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.683+0000 7f4855dd6700 1 -- 172.21.15.72:0/168524269 shutdown_connections 2023-10-03T10:12:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.683+0000 7f4855dd6700 1 --2- 172.21.15.72:0/168524269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485009e410 0x7f4850130d70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.683+0000 7f4855dd6700 1 --2- 172.21.15.72:0/168524269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485009d6f0 0x7f485009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.683+0000 7f4855dd6700 1 -- 172.21.15.72:0/168524269 >> 172.21.15.72:0/168524269 conn(0x7f4850066f50 msgr2=0x7f485009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.683+0000 7f4855dd6700 1 -- 172.21.15.72:0/168524269 shutdown_connections 2023-10-03T10:12:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.683+0000 7f4855dd6700 1 -- 172.21.15.72:0/168524269 wait complete. 2023-10-03T10:12:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.684+0000 7f4855dd6700 1 Processor -- start 2023-10-03T10:12:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.684+0000 7f4855dd6700 1 -- start start 2023-10-03T10:12:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.684+0000 7f4855dd6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485009d6f0 0x7f48501203a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.684+0000 7f4855dd6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f485009e000 0x7f48501208e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.684+0000 7f4855dd6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485009e410 0x7f4850120e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.684+0000 7f4855dd6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4850123ec0 con 0x7f485009e410 2023-10-03T10:12:07.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.684+0000 7f4855dd6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4850121fb0 con 0x7f485009d6f0 2023-10-03T10:12:07.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.684+0000 7f4855dd6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48500a1f10 con 0x7f485009e000 2023-10-03T10:12:07.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.684+0000 7f484f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485009d6f0 0x7f48501203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.684+0000 7f484effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f485009e000 0x7f48501208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.684+0000 7f484f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485009d6f0 0x7f48501203a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55500/0 (socket says 172.21.15.72:55500) 2023-10-03T10:12:07.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.684+0000 7f484f7fe700 1 -- 172.21.15.72:0/3859888916 learned_addr learned my addr 172.21.15.72:0/3859888916 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:07.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.685+0000 7f484ffff700 1 --2- 172.21.15.72:0/3859888916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485009e410 0x7f4850120e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.685+0000 7f484f7fe700 1 -- 172.21.15.72:0/3859888916 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f485009e000 msgr2=0x7f48501208e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.685+0000 7f484f7fe700 1 --2- 172.21.15.72:0/3859888916 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f485009e000 0x7f48501208e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.685+0000 7f484f7fe700 1 -- 172.21.15.72:0/3859888916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485009e410 msgr2=0x7f4850120e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.685+0000 7f484f7fe700 1 --2- 172.21.15.72:0/3859888916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485009e410 0x7f4850120e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.685+0000 7f484f7fe700 1 -- 172.21.15.72:0/3859888916 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48400094a0 con 0x7f485009d6f0 2023-10-03T10:12:07.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.685+0000 7f484effd700 1 --2- 172.21.15.72:0/3859888916 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f485009e000 0x7f48501208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:07.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.685+0000 7f484f7fe700 1 --2- 172.21.15.72:0/3859888916 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485009d6f0 0x7f48501203a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f484000ebe0 tx=0x7f484000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:07.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.685+0000 7f4837fff700 1 -- 172.21.15.72:0/3859888916 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484000c850 con 0x7f485009d6f0 2023-10-03T10:12:07.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.685+0000 7f4837fff700 1 -- 172.21.15.72:0/3859888916 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484000c9b0 con 0x7f485009d6f0 2023-10-03T10:12:07.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.685+0000 7f4855dd6700 1 -- 172.21.15.72:0/3859888916 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4848009b30 con 0x7f485009d6f0 2023-10-03T10:12:07.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.685+0000 7f4837fff700 1 -- 172.21.15.72:0/3859888916 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484000cd40 con 0x7f485009d6f0 2023-10-03T10:12:07.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.686+0000 7f4855dd6700 1 -- 172.21.15.72:0/3859888916 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4850121790 con 0x7f485009d6f0 2023-10-03T10:12:07.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.686+0000 7f4837fff700 1 -- 172.21.15.72:0/3859888916 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f4840013470 con 0x7f485009d6f0 2023-10-03T10:12:07.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.687+0000 7f4855dd6700 1 -- 172.21.15.72:0/3859888916 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4850074ea0 con 0x7f485009d6f0 2023-10-03T10:12:07.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.687+0000 7f4837fff700 1 -- 172.21.15.72:0/3859888916 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4009+0+0 (secure 0 0 0) 0x7f484003fc10 con 0x7f485009d6f0 2023-10-03T10:12:07.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.691+0000 7f4837fff700 1 -- 172.21.15.72:0/3859888916 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4840013720 con 0x7f485009d6f0 2023-10-03T10:12:07.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.708+0000 7fda816fd700 1 Processor -- start 2023-10-03T10:12:07.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.708+0000 7fda816fd700 1 -- start start 2023-10-03T10:12:07.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda816fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda7c09eca0 0x7fda7c13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda816fd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fda7c06f050 0x7fda7c13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda816fd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7c070ee0 con 0x7fda7c06e570 2023-10-03T10:12:07.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda816fd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7c071980 con 0x7fda7c06f050 2023-10-03T10:12:07.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda816fd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c071480 con 0x7fda7c09eca0 2023-10-03T10:12:07.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda7affd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fda7c06e570 0x7fda7c06e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57656/0 (socket says 172.21.15.72:57656) 2023-10-03T10:12:07.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda7affd700 1 -- 172.21.15.72:0/3546253591 learned_addr learned my addr 172.21.15.72:0/3546253591 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:07.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda7a7fc700 1 --2- 172.21.15.72:0/3546253591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda7c09eca0 0x7fda7c13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda7b7fe700 1 --2- 172.21.15.72:0/3546253591 >> v2:172.21.15.72:3300/0 conn(0x7fda7c06f050 0x7fda7c13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda79ffb700 1 -- 172.21.15.72:0/3546253591 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739453690 0 0) 0x7fda7c070ee0 con 0x7fda7c06e570 2023-10-03T10:12:07.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda79ffb700 1 -- 172.21.15.72:0/3546253591 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda640035b0 con 0x7fda7c06e570 2023-10-03T10:12:07.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda7a7fc700 1 -- 172.21.15.72:0/3546253591 >> v2:172.21.15.72:3300/0 conn(0x7fda7c06f050 msgr2=0x7fda7c13f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:07.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda7a7fc700 1 --2- 172.21.15.72:0/3546253591 >> v2:172.21.15.72:3300/0 conn(0x7fda7c06f050 0x7fda7c13f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda7a7fc700 1 -- 172.21.15.72:0/3546253591 >> v1:172.21.15.72:6789/0 conn(0x7fda7c06e570 legacy=0x7fda7c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda79ffb700 1 -- 172.21.15.72:0/3546253591 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3870849127 0 0) 0x7fda640035b0 con 0x7fda7c06e570 2023-10-03T10:12:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda7a7fc700 1 -- 172.21.15.72:0/3546253591 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c071b90 con 0x7fda7c09eca0 2023-10-03T10:12:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.709+0000 7fda7b7fe700 1 --2- 172.21.15.72:0/3546253591 >> v2:172.21.15.72:3300/0 conn(0x7fda7c06f050 0x7fda7c13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.710+0000 7fda7a7fc700 1 --2- 172.21.15.72:0/3546253591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda7c09eca0 0x7fda7c13cea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda70009840 tx=0x7fda70009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eedaa8bd6f91866b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.710+0000 7fda79ffb700 1 -- 172.21.15.72:0/3546253591 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c001670 con 0x7fda7c09eca0 2023-10-03T10:12:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.710+0000 7fda79ffb700 1 -- 172.21.15.72:0/3546253591 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda70004030 con 0x7fda7c09eca0 2023-10-03T10:12:07.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.710+0000 7fda79ffb700 1 -- 172.21.15.72:0/3546253591 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda700043c0 con 0x7fda7c09eca0 2023-10-03T10:12:07.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.711+0000 7fda816fd700 1 -- 172.21.15.72:0/3546253591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda7c09eca0 msgr2=0x7fda7c13cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.711+0000 7fda816fd700 1 --2- 172.21.15.72:0/3546253591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda7c09eca0 0x7fda7c13cea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda70009840 tx=0x7fda70009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:07.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.711+0000 7fda816fd700 1 -- 172.21.15.72:0/3546253591 shutdown_connections 2023-10-03T10:12:07.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.711+0000 7fda816fd700 1 --2- 172.21.15.72:0/3546253591 >> v2:172.21.15.72:3300/0 conn(0x7fda7c06f050 0x7fda7c13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.711+0000 7fda816fd700 1 --2- 172.21.15.72:0/3546253591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda7c09eca0 0x7fda7c13cea0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.711+0000 7fda816fd700 1 -- 172.21.15.72:0/3546253591 >> 172.21.15.72:0/3546253591 conn(0x7fda7c0a2aa0 msgr2=0x7fda7c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:07.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.711+0000 7fda816fd700 1 -- 172.21.15.72:0/3546253591 shutdown_connections 2023-10-03T10:12:07.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.711+0000 7fda816fd700 1 -- 172.21.15.72:0/3546253591 wait complete. 2023-10-03T10:12:07.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.712+0000 7fda816fd700 1 Processor -- start 2023-10-03T10:12:07.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.713+0000 7fda816fd700 1 -- start start 2023-10-03T10:12:07.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.713+0000 7fda816fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda7c06e570 0x7fda7c1214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.713+0000 7fda816fd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda7c06f050 0x7fda7c121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.713+0000 7fda816fd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7c121f60 0x7fda7c1d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:07.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.713+0000 7fda816fd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c122930 con 0x7fda7c121f60 2023-10-03T10:12:07.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.713+0000 7fda816fd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c123d60 con 0x7fda7c06e570 2023-10-03T10:12:07.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.713+0000 7fda816fd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c1234f0 con 0x7fda7c06f050 2023-10-03T10:12:07.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.713+0000 7fda7affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda7c06e570 0x7fda7c1214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.713+0000 7fda7a7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda7c06f050 0x7fda7c121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.713+0000 7fda7affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda7c06e570 0x7fda7c1214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55512/0 (socket says 172.21.15.72:55512) 2023-10-03T10:12:07.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.713+0000 7fda7affd700 1 -- 172.21.15.72:0/4130923886 learned_addr learned my addr 172.21.15.72:0/4130923886 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:07.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.713+0000 7fda7a7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda7c06f050 0x7fda7c121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:43812/0 (socket says 172.21.15.72:43812) 2023-10-03T10:12:07.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.713+0000 7fda7b7fe700 1 --2- 172.21.15.72:0/4130923886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7c121f60 0x7fda7c1d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:07.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.714+0000 7fda7a7fc700 1 -- 172.21.15.72:0/4130923886 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda7c06e570 msgr2=0x7fda7c1214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.714+0000 7fda7a7fc700 1 --2- 172.21.15.72:0/4130923886 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda7c06e570 0x7fda7c1214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.714+0000 7fda7a7fc700 1 -- 172.21.15.72:0/4130923886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7c121f60 msgr2=0x7fda7c1d2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.714+0000 7fda7a7fc700 1 --2- 172.21.15.72:0/4130923886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7c121f60 0x7fda7c1d2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.714+0000 7fda7a7fc700 1 -- 172.21.15.72:0/4130923886 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda700094a0 con 0x7fda7c06f050 2023-10-03T10:12:07.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.714+0000 7fda7affd700 1 --2- 172.21.15.72:0/4130923886 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda7c06e570 0x7fda7c1214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:07.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.714+0000 7fda7a7fc700 1 --2- 172.21.15.72:0/4130923886 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda7c06f050 0x7fda7c121a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fda70015000 tx=0x7fda70004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:07.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.714+0000 7fda637fe700 1 -- 172.21.15.72:0/4130923886 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70003df0 con 0x7fda7c06f050 2023-10-03T10:12:07.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.714+0000 7fda637fe700 1 -- 172.21.15.72:0/4130923886 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7001f070 con 0x7fda7c06f050 2023-10-03T10:12:07.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.714+0000 7fda816fd700 1 -- 172.21.15.72:0/4130923886 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7c09a0c0 con 0x7fda7c06f050 2023-10-03T10:12:07.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.714+0000 7fda637fe700 1 -- 172.21.15.72:0/4130923886 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70011870 con 0x7fda7c06f050 2023-10-03T10:12:07.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.714+0000 7fda816fd700 1 -- 172.21.15.72:0/4130923886 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7c138680 con 0x7fda7c06f050 2023-10-03T10:12:07.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.715+0000 7fda637fe700 1 -- 172.21.15.72:0/4130923886 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7fda700119d0 con 0x7fda7c06f050 2023-10-03T10:12:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.715+0000 7fda637fe700 1 -- 172.21.15.72:0/4130923886 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4009+0+0 (secure 0 0 0) 0x7fda70021070 con 0x7fda7c06f050 2023-10-03T10:12:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.715+0000 7fda816fd700 1 -- 172.21.15.72:0/4130923886 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7c13a190 con 0x7fda7c06f050 2023-10-03T10:12:07.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.721+0000 7fda637fe700 1 -- 172.21.15.72:0/4130923886 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda700253e0 con 0x7fda7c06f050 2023-10-03T10:12:07.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.793+0000 7f4301689700 1 -- 172.21.15.72:0/2576846426 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f42fc074ea0 con 0x7f42fc09d6f0 2023-10-03T10:12:07.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.793+0000 7f42f37fe700 1 -- 172.21.15.72:0/2576846426 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42ec00db40 con 0x7f42fc09d6f0 2023-10-03T10:12:07.794 INFO:teuthology.orchestra.run.smithi072.stdout:38654705694 2023-10-03T10:12:07.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.796+0000 7f4301689700 1 -- 172.21.15.72:0/2576846426 >> v1:172.21.15.72:6816/126756 conn(0x7f42dc02f270 legacy=0x7f42dc031720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.796+0000 7f4301689700 1 -- 172.21.15.72:0/2576846426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42fc09d6f0 msgr2=0x7f42fc11dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.796+0000 7f4301689700 1 --2- 172.21.15.72:0/2576846426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42fc09d6f0 0x7f42fc11dda0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f42ec010ee0 tx=0x7f42ec00e640 comp rx=0 tx=0).stop 2023-10-03T10:12:07.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.796+0000 7f4301689700 1 -- 172.21.15.72:0/2576846426 shutdown_connections 2023-10-03T10:12:07.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.796+0000 7f4301689700 1 --2- 172.21.15.72:0/2576846426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42fc09e410 0x7f42fc11e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.796+0000 7f4301689700 1 --2- 172.21.15.72:0/2576846426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42fc09d6f0 0x7f42fc11dda0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.796+0000 7f4301689700 1 --2- 172.21.15.72:0/2576846426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42fc09e000 0x7f42fc11e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.796+0000 7f4301689700 1 -- 172.21.15.72:0/2576846426 >> 172.21.15.72:0/2576846426 conn(0x7f42fc066f50 msgr2=0x7f42fc130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:07.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.796+0000 7f4301689700 1 -- 172.21.15.72:0/2576846426 shutdown_connections 2023-10-03T10:12:07.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.796+0000 7f4301689700 1 -- 172.21.15.72:0/2576846426 wait complete. 2023-10-03T10:12:07.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.0 2023-10-03T10:12:07.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.859+0000 7f4d639d0700 1 -- 172.21.15.72:0/2149660620 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4d5c1293b0 con 0x7f4d5c1359f0 2023-10-03T10:12:07.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.859+0000 7f4d51ffb700 1 -- 172.21.15.72:0/2149660620 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4d54011680 con 0x7f4d5c1359f0 2023-10-03T10:12:07.860 INFO:teuthology.orchestra.run.smithi072.stdout:38654705694 2023-10-03T10:12:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.861+0000 7f4d639d0700 1 -- 172.21.15.72:0/2149660620 >> v1:172.21.15.72:6816/126756 conn(0x7f4d4002f240 legacy=0x7f4d400316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.861+0000 7f4d639d0700 1 -- 172.21.15.72:0/2149660620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d5c1359f0 msgr2=0x7f4d5c1c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.861+0000 7f4d639d0700 1 --2- 172.21.15.72:0/2149660620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d5c1359f0 0x7f4d5c1c3cd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400efc0 tx=0x7f4d5400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.861+0000 7f4d639d0700 1 -- 172.21.15.72:0/2149660620 shutdown_connections 2023-10-03T10:12:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.861+0000 7f4d639d0700 1 --2- 172.21.15.72:0/2149660620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d5c1359f0 0x7f4d5c1c3cd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.861+0000 7f4d639d0700 1 --2- 172.21.15.72:0/2149660620 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d5c072590 0x7f4d5c127ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.861+0000 7f4d639d0700 1 --2- 172.21.15.72:0/2149660620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d5c1306e0 0x7f4d5c127ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.861+0000 7f4d639d0700 1 -- 172.21.15.72:0/2149660620 >> 172.21.15.72:0/2149660620 conn(0x7f4d5c09f470 msgr2=0x7f4d5c0a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.861+0000 7f4d639d0700 1 -- 172.21.15.72:0/2149660620 shutdown_connections 2023-10-03T10:12:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.861+0000 7f4d639d0700 1 -- 172.21.15.72:0/2149660620 wait complete. 2023-10-03T10:12:07.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.2 2023-10-03T10:12:07.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.890+0000 7f4855dd6700 1 -- 172.21.15.72:0/3859888916 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f48501227c0 con 0x7f485009d6f0 2023-10-03T10:12:07.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.891+0000 7f4837fff700 1 -- 172.21.15.72:0/3859888916 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4840017030 con 0x7f485009d6f0 2023-10-03T10:12:07.892 INFO:teuthology.orchestra.run.smithi072.stdout:38654705693 2023-10-03T10:12:07.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.893+0000 7f4855dd6700 1 -- 172.21.15.72:0/3859888916 >> v1:172.21.15.72:6816/126756 conn(0x7f483c02f240 legacy=0x7f483c0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.893+0000 7f4855dd6700 1 -- 172.21.15.72:0/3859888916 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485009d6f0 msgr2=0x7f48501203a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.893+0000 7f4855dd6700 1 --2- 172.21.15.72:0/3859888916 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485009d6f0 0x7f48501203a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f484000ebe0 tx=0x7f484000eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.893+0000 7f4855dd6700 1 -- 172.21.15.72:0/3859888916 shutdown_connections 2023-10-03T10:12:07.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.893+0000 7f4855dd6700 1 --2- 172.21.15.72:0/3859888916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485009e410 0x7f4850120e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.893+0000 7f4855dd6700 1 --2- 172.21.15.72:0/3859888916 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485009d6f0 0x7f48501203a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.893+0000 7f4855dd6700 1 --2- 172.21.15.72:0/3859888916 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f485009e000 0x7f48501208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.893+0000 7f4855dd6700 1 -- 172.21.15.72:0/3859888916 >> 172.21.15.72:0/3859888916 conn(0x7f4850066f50 msgr2=0x7f485006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:07.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.893+0000 7f4855dd6700 1 -- 172.21.15.72:0/3859888916 shutdown_connections 2023-10-03T10:12:07.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.893+0000 7f4855dd6700 1 -- 172.21.15.72:0/3859888916 wait complete. 2023-10-03T10:12:07.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705693 for osd.3 2023-10-03T10:12:07.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.921+0000 7fda816fd700 1 -- 172.21.15.72:0/4130923886 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fda7c074ea0 con 0x7fda7c06f050 2023-10-03T10:12:07.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.921+0000 7fda637fe700 1 -- 172.21.15.72:0/4130923886 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda70010b70 con 0x7fda7c06f050 2023-10-03T10:12:07.922 INFO:teuthology.orchestra.run.smithi072.stdout:38654705694 2023-10-03T10:12:07.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.923+0000 7fda816fd700 1 -- 172.21.15.72:0/4130923886 >> v1:172.21.15.72:6816/126756 conn(0x7fda6802f240 legacy=0x7fda680316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.923+0000 7fda816fd700 1 -- 172.21.15.72:0/4130923886 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda7c06f050 msgr2=0x7fda7c121a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:07.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.923+0000 7fda816fd700 1 --2- 172.21.15.72:0/4130923886 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda7c06f050 0x7fda7c121a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fda70015000 tx=0x7fda70004750 comp rx=0 tx=0).stop 2023-10-03T10:12:07.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.924+0000 7fda816fd700 1 -- 172.21.15.72:0/4130923886 shutdown_connections 2023-10-03T10:12:07.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.924+0000 7fda816fd700 1 --2- 172.21.15.72:0/4130923886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda7c121f60 0x7fda7c1d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.924+0000 7fda816fd700 1 --2- 172.21.15.72:0/4130923886 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda7c06e570 0x7fda7c1214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.924+0000 7fda816fd700 1 --2- 172.21.15.72:0/4130923886 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda7c06f050 0x7fda7c121a20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:07.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.924+0000 7fda816fd700 1 -- 172.21.15.72:0/4130923886 >> 172.21.15.72:0/4130923886 conn(0x7fda7c0a2aa0 msgr2=0x7fda7c09a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:07.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.924+0000 7fda816fd700 1 -- 172.21.15.72:0/4130923886 shutdown_connections 2023-10-03T10:12:07.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:07.924+0000 7fda816fd700 1 -- 172.21.15.72:0/4130923886 wait complete. 2023-10-03T10:12:07.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705694 for osd.1 2023-10-03T10:12:08.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:08.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:08.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:08.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.935+0000 7fb892822700 1 Processor -- start 2023-10-03T10:12:08.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.935+0000 7fb892822700 1 -- start start 2023-10-03T10:12:08.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:08.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb892822700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb88c09d6f0 0x7fb88c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb892822700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb88c09e000 0x7fb88c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb892822700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88c09b120 con 0x7fb88c09e410 2023-10-03T10:12:08.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb892822700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb88c06b460 con 0x7fb88c09e000 2023-10-03T10:12:08.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb892822700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c09a7e0 con 0x7fb88c09d6f0 2023-10-03T10:12:08.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb88b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb88c09e000 0x7fb88c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb88bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb88c09d6f0 0x7fb88c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb88b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb88c09e000 0x7fb88c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43982/0 (socket says 172.21.15.72:43982) 2023-10-03T10:12:08.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb88bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb88c09d6f0 0x7fb88c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47064/0 (socket says 172.21.15.72:47064) 2023-10-03T10:12:08.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb88b7fe700 1 -- 172.21.15.72:0/2985759897 learned_addr learned my addr 172.21.15.72:0/2985759897 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:08.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb88b7fe700 1 -- 172.21.15.72:0/2985759897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb88c09d6f0 msgr2=0x7fb88c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:08.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb88b7fe700 1 --2- 172.21.15.72:0/2985759897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb88c09d6f0 0x7fb88c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb88b7fe700 1 -- 172.21.15.72:0/2985759897 >> v1:172.21.15.72:6789/0 conn(0x7fb88c09e410 legacy=0x7fb88c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb88b7fe700 1 -- 172.21.15.72:0/2985759897 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c09a500 con 0x7fb88c09e000 2023-10-03T10:12:08.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb88affd700 1 -- 172.21.15.72:0/2985759897 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135701341 0 0) 0x7fb88c09b120 con 0x7fb88c09e410 2023-10-03T10:12:08.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb88b7fe700 1 --2- 172.21.15.72:0/2985759897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb88c09e000 0x7fb88c1339f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb8800098f0 tx=0x7fb880009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2d256aff3666bc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:08.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.936+0000 7fb88affd700 1 -- 172.21.15.72:0/2985759897 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880011830 con 0x7fb88c09e000 2023-10-03T10:12:08.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.937+0000 7fb88affd700 1 -- 172.21.15.72:0/2985759897 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb880011990 con 0x7fb88c09e000 2023-10-03T10:12:08.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.937+0000 7fb88affd700 1 -- 172.21.15.72:0/2985759897 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880011d20 con 0x7fb88c09e000 2023-10-03T10:12:08.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.937+0000 7fb892822700 1 -- 172.21.15.72:0/2985759897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb88c09e000 msgr2=0x7fb88c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.937+0000 7fb892822700 1 --2- 172.21.15.72:0/2985759897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb88c09e000 0x7fb88c1339f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb8800098f0 tx=0x7fb880009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:08.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.937+0000 7fb892822700 1 -- 172.21.15.72:0/2985759897 shutdown_connections 2023-10-03T10:12:08.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.937+0000 7fb892822700 1 --2- 172.21.15.72:0/2985759897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb88c09d6f0 0x7fb88c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.937+0000 7fb892822700 1 --2- 172.21.15.72:0/2985759897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb88c09e000 0x7fb88c1339f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.937+0000 7fb892822700 1 -- 172.21.15.72:0/2985759897 >> 172.21.15.72:0/2985759897 conn(0x7fb88c066f50 msgr2=0x7fb88c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:08.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.937+0000 7fb892822700 1 -- 172.21.15.72:0/2985759897 shutdown_connections 2023-10-03T10:12:08.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.937+0000 7fb892822700 1 -- 172.21.15.72:0/2985759897 wait complete. 2023-10-03T10:12:08.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.939+0000 7fb892822700 1 Processor -- start 2023-10-03T10:12:08.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.939+0000 7fb892822700 1 -- start start 2023-10-03T10:12:08.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.939+0000 7fb892822700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88c09d6f0 0x7fb88c1a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.939+0000 7fb892822700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb88c09e000 0x7fb88c1a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.939+0000 7fb892822700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb88c09e410 0x7fb88c1a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.939+0000 7fb892822700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c1a9150 con 0x7fb88c09e410 2023-10-03T10:12:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.939+0000 7fb892822700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c09c710 con 0x7fb88c09d6f0 2023-10-03T10:12:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.939+0000 7fb892822700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c0a2e40 con 0x7fb88c09e000 2023-10-03T10:12:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.940+0000 7fb88b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb88c09e000 0x7fb88c1a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.940+0000 7fb88bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88c09d6f0 0x7fb88c1a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.940+0000 7fb88b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb88c09e000 0x7fb88c1a63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47072/0 (socket says 172.21.15.72:47072) 2023-10-03T10:12:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.940+0000 7fb88b7fe700 1 -- 172.21.15.72:0/2796949724 learned_addr learned my addr 172.21.15.72:0/2796949724 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.940+0000 7fb890dbf700 1 --2- 172.21.15.72:0/2796949724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb88c09e410 0x7fb88c1a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.940+0000 7fb88bfff700 1 -- 172.21.15.72:0/2796949724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb88c09e000 msgr2=0x7fb88c1a63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.940+0000 7fb88bfff700 1 --2- 172.21.15.72:0/2796949724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb88c09e000 0x7fb88c1a63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.940+0000 7fb88bfff700 1 -- 172.21.15.72:0/2796949724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb88c09e410 msgr2=0x7fb88c1a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.940+0000 7fb88bfff700 1 --2- 172.21.15.72:0/2796949724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb88c09e410 0x7fb88c1a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:08.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.940+0000 7fb88bfff700 1 -- 172.21.15.72:0/2796949724 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb880009550 con 0x7fb88c09d6f0 2023-10-03T10:12:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.940+0000 7fb88bfff700 1 --2- 172.21.15.72:0/2796949724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88c09d6f0 0x7fb88c1a5ea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00e900 tx=0x7fb87c00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.940+0000 7fb888ff9700 1 -- 172.21.15.72:0/2796949724 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c013680 con 0x7fb88c09d6f0 2023-10-03T10:12:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.940+0000 7fb888ff9700 1 -- 172.21.15.72:0/2796949724 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87c0137e0 con 0x7fb88c09d6f0 2023-10-03T10:12:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.940+0000 7fb892822700 1 -- 172.21.15.72:0/2796949724 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb88c1a7ab0 con 0x7fb88c09d6f0 2023-10-03T10:12:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.941+0000 7fb888ff9700 1 -- 172.21.15.72:0/2796949724 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c013b50 con 0x7fb88c09d6f0 2023-10-03T10:12:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.941+0000 7fb892822700 1 -- 172.21.15.72:0/2796949724 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88c1a9ec0 con 0x7fb88c09d6f0 2023-10-03T10:12:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.942+0000 7fb888ff9700 1 -- 172.21.15.72:0/2796949724 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7fb87c013cb0 con 0x7fb88c09d6f0 2023-10-03T10:12:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.942+0000 7fb892822700 1 -- 172.21.15.72:0/2796949724 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88c1a9380 con 0x7fb88c09d6f0 2023-10-03T10:12:08.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.942+0000 7fb888ff9700 1 -- 172.21.15.72:0/2796949724 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fb87c03f900 con 0x7fb88c09d6f0 2023-10-03T10:12:08.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:08.948+0000 7fb888ff9700 1 -- 172.21.15.72:0/2796949724 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb88c1a9380 con 0x7fb88c09d6f0 2023-10-03T10:12:09.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.004+0000 7f89be94b700 1 Processor -- start 2023-10-03T10:12:09.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.004+0000 7f89be94b700 1 -- start start 2023-10-03T10:12:09.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.004+0000 7f89be94b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b81338c0 0x7f89b8133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.004+0000 7f89be94b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89b81341d0 0x7f89b809de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.004+0000 7f89be94b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b809e390 0x7f89b809e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.004+0000 7f89be94b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b8070c80 con 0x7f89b81341d0 2023-10-03T10:12:09.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.004+0000 7f89be94b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b809ed20 con 0x7f89b809e390 2023-10-03T10:12:09.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.004+0000 7f89be94b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89b806f720 con 0x7f89b81338c0 2023-10-03T10:12:09.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.005+0000 7f89b7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b81338c0 0x7f89b8133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.005+0000 7f89b7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b81338c0 0x7f89b8133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47080/0 (socket says 172.21.15.72:47080) 2023-10-03T10:12:09.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.005+0000 7f89b7fff700 1 -- 172.21.15.72:0/3383836724 learned_addr learned my addr 172.21.15.72:0/3383836724 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:09.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.005+0000 7f89b77fe700 1 --2- 172.21.15.72:0/3383836724 >> v2:172.21.15.72:3300/0 conn(0x7f89b81341d0 0x7f89b809de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.005+0000 7f89bcee8700 1 --2- 172.21.15.72:0/3383836724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b809e390 0x7f89b809e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.005+0000 7f89b77fe700 1 -- 172.21.15.72:0/3383836724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b81338c0 msgr2=0x7f89b8133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:09.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.005+0000 7f89b77fe700 1 --2- 172.21.15.72:0/3383836724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b81338c0 0x7f89b8133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.005+0000 7f89b77fe700 1 -- 172.21.15.72:0/3383836724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b809e390 msgr2=0x7f89b809e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:09.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.005+0000 7f89b77fe700 1 --2- 172.21.15.72:0/3383836724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b809e390 0x7f89b809e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.005+0000 7f89b77fe700 1 -- 172.21.15.72:0/3383836724 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b806fce0 con 0x7f89b81341d0 2023-10-03T10:12:09.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.005+0000 7f89b77fe700 1 --2- 172.21.15.72:0/3383836724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b81341d0 0x7f89b809de50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f89ac009840 tx=0x7f89ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c16bd34c19003 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.005+0000 7f89b6ffd700 1 -- 172.21.15.72:0/3383836724 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac011830 con 0x7f89b81341d0 2023-10-03T10:12:09.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.006+0000 7f89b6ffd700 1 -- 172.21.15.72:0/3383836724 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ac011990 con 0x7f89b81341d0 2023-10-03T10:12:09.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.006+0000 7f89b6ffd700 1 -- 172.21.15.72:0/3383836724 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac011d00 con 0x7f89b81341d0 2023-10-03T10:12:09.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.006+0000 7f89be94b700 1 -- 172.21.15.72:0/3383836724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b81341d0 msgr2=0x7f89b809de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.006+0000 7f89be94b700 1 --2- 172.21.15.72:0/3383836724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b81341d0 0x7f89b809de50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f89ac009840 tx=0x7f89ac009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:09.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.006+0000 7f89be94b700 1 -- 172.21.15.72:0/3383836724 shutdown_connections 2023-10-03T10:12:09.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.006+0000 7f89be94b700 1 --2- 172.21.15.72:0/3383836724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b809e390 0x7f89b809e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.006+0000 7f89be94b700 1 --2- 172.21.15.72:0/3383836724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b81338c0 0x7f89b8133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.007+0000 7f89be94b700 1 --2- 172.21.15.72:0/3383836724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b81341d0 0x7f89b809de50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.007+0000 7f89be94b700 1 -- 172.21.15.72:0/3383836724 >> 172.21.15.72:0/3383836724 conn(0x7f89b80a2aa0 msgr2=0x7f89b80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.007+0000 7f89be94b700 1 -- 172.21.15.72:0/3383836724 shutdown_connections 2023-10-03T10:12:09.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.007+0000 7f89be94b700 1 -- 172.21.15.72:0/3383836724 wait complete. 2023-10-03T10:12:09.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.007+0000 7f89be94b700 1 Processor -- start 2023-10-03T10:12:09.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.008+0000 7f89be94b700 1 -- start start 2023-10-03T10:12:09.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.008+0000 7f89be94b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b809e390 0x7f89b811b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.008+0000 7f89be94b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b81338c0 0x7f89b811bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.008+0000 7f89be94b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b81341d0 0x7f89b811c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.008+0000 7f89be94b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b811e870 con 0x7f89b809e390 2023-10-03T10:12:09.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.008+0000 7f89be94b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b806f960 con 0x7f89b81338c0 2023-10-03T10:12:09.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.008+0000 7f89be94b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8130e10 con 0x7f89b81341d0 2023-10-03T10:12:09.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.008+0000 7f89b7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b809e390 0x7f89b811b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.008+0000 7f89b7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b809e390 0x7f89b811b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44014/0 (socket says 172.21.15.72:44014) 2023-10-03T10:12:09.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.008+0000 7f89b7fff700 1 -- 172.21.15.72:0/1630639949 learned_addr learned my addr 172.21.15.72:0/1630639949 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:09.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.008+0000 7f89bcee8700 1 --2- 172.21.15.72:0/1630639949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b81341d0 0x7f89b811c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.009+0000 7f89b77fe700 1 --2- 172.21.15.72:0/1630639949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b81338c0 0x7f89b811bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.009+0000 7f89bcee8700 1 -- 172.21.15.72:0/1630639949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b81338c0 msgr2=0x7f89b811bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.009+0000 7f89bcee8700 1 --2- 172.21.15.72:0/1630639949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b81338c0 0x7f89b811bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.009+0000 7f89bcee8700 1 -- 172.21.15.72:0/1630639949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b809e390 msgr2=0x7f89b811b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.009+0000 7f89bcee8700 1 --2- 172.21.15.72:0/1630639949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b809e390 0x7f89b811b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.009+0000 7f89bcee8700 1 -- 172.21.15.72:0/1630639949 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac0094a0 con 0x7f89b81341d0 2023-10-03T10:12:09.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.009+0000 7f89bcee8700 1 --2- 172.21.15.72:0/1630639949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b81341d0 0x7f89b811c040 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f89b000eba0 tx=0x7f89b000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.009+0000 7f89b4ff9700 1 -- 172.21.15.72:0/1630639949 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b000ca30 con 0x7f89b81341d0 2023-10-03T10:12:09.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.009+0000 7f89b4ff9700 1 -- 172.21.15.72:0/1630639949 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b000f040 con 0x7f89b81341d0 2023-10-03T10:12:09.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.009+0000 7f89b4ff9700 1 -- 172.21.15.72:0/1630639949 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b000cdd0 con 0x7f89b81341d0 2023-10-03T10:12:09.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.009+0000 7f89be94b700 1 -- 172.21.15.72:0/1630639949 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b811d1d0 con 0x7f89b81341d0 2023-10-03T10:12:09.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.009+0000 7f89be94b700 1 -- 172.21.15.72:0/1630639949 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b811f5e0 con 0x7f89b81341d0 2023-10-03T10:12:09.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.010+0000 7f89b4ff9700 1 -- 172.21.15.72:0/1630639949 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f89b0014480 con 0x7f89b81341d0 2023-10-03T10:12:09.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.010+0000 7f89be94b700 1 -- 172.21.15.72:0/1630639949 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b811ec80 con 0x7f89b81341d0 2023-10-03T10:12:09.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.011+0000 7f89b4ff9700 1 -- 172.21.15.72:0/1630639949 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f89b00400b0 con 0x7f89b81341d0 2023-10-03T10:12:09.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.019+0000 7f89b4ff9700 1 -- 172.21.15.72:0/1630639949 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89b0007920 con 0x7f89b81341d0 2023-10-03T10:12:09.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.050+0000 7fa359ae8700 1 Processor -- start 2023-10-03T10:12:09.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.050+0000 7fa359ae8700 1 -- start start 2023-10-03T10:12:09.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.051+0000 7fa359ae8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa35409e1d0 0x7fa354138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.051+0000 7fa359ae8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa354139170 0x7fa35413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.051+0000 7fa359ae8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa35409b120 con 0x7fa35409d6f0 2023-10-03T10:12:09.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.051+0000 7fa359ae8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35406b460 con 0x7fa35409e1d0 2023-10-03T10:12:09.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.051+0000 7fa359ae8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa35409a7e0 con 0x7fa354139170 2023-10-03T10:12:09.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.051+0000 7fa353fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa354139170 0x7fa35413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.051+0000 7fa353fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa354139170 0x7fa35413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47092/0 (socket says 172.21.15.72:47092) 2023-10-03T10:12:09.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.051+0000 7fa353fff700 1 -- 172.21.15.72:0/114883782 learned_addr learned my addr 172.21.15.72:0/114883782 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:09.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.052+0000 7fa352ffd700 1 --2- 172.21.15.72:0/114883782 >> v2:172.21.15.72:3300/0 conn(0x7fa35409e1d0 0x7fa354138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.052+0000 7fa353fff700 1 -- 172.21.15.72:0/114883782 >> v2:172.21.15.72:3300/0 conn(0x7fa35409e1d0 msgr2=0x7fa354138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:09.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.052+0000 7fa353fff700 1 --2- 172.21.15.72:0/114883782 >> v2:172.21.15.72:3300/0 conn(0x7fa35409e1d0 0x7fa354138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.052+0000 7fa353fff700 1 -- 172.21.15.72:0/114883782 >> v1:172.21.15.72:6789/0 conn(0x7fa35409d6f0 legacy=0x7fa35409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.052+0000 7fa353fff700 1 -- 172.21.15.72:0/114883782 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35409a500 con 0x7fa354139170 2023-10-03T10:12:09.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.052+0000 7fa353fff700 1 --2- 172.21.15.72:0/114883782 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa354139170 0x7fa35413b550 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009e80 tx=0x7fa34c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=327bcb2df0c1fc61 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.052+0000 7fa3527fc700 1 -- 172.21.15.72:0/114883782 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c00e070 con 0x7fa354139170 2023-10-03T10:12:09.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.052+0000 7fa3527fc700 1 -- 172.21.15.72:0/114883782 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c00b8d0 con 0x7fa354139170 2023-10-03T10:12:09.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.052+0000 7fa3527fc700 1 -- 172.21.15.72:0/114883782 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c00bc60 con 0x7fa354139170 2023-10-03T10:12:09.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.053+0000 7fa359ae8700 1 -- 172.21.15.72:0/114883782 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa354139170 msgr2=0x7fa35413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.053+0000 7fa359ae8700 1 --2- 172.21.15.72:0/114883782 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa354139170 0x7fa35413b550 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009e80 tx=0x7fa34c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:09.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.053+0000 7fa359ae8700 1 -- 172.21.15.72:0/114883782 shutdown_connections 2023-10-03T10:12:09.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.053+0000 7fa359ae8700 1 --2- 172.21.15.72:0/114883782 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa354139170 0x7fa35413b550 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.053+0000 7fa359ae8700 1 --2- 172.21.15.72:0/114883782 >> v2:172.21.15.72:3300/0 conn(0x7fa35409e1d0 0x7fa354138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.053+0000 7fa359ae8700 1 -- 172.21.15.72:0/114883782 >> 172.21.15.72:0/114883782 conn(0x7fa354066f50 msgr2=0x7fa35409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.053+0000 7fa359ae8700 1 -- 172.21.15.72:0/114883782 shutdown_connections 2023-10-03T10:12:09.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.053+0000 7fa359ae8700 1 -- 172.21.15.72:0/114883782 wait complete. 2023-10-03T10:12:09.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.054+0000 7fa359ae8700 1 Processor -- start 2023-10-03T10:12:09.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.054+0000 7fa359ae8700 1 -- start start 2023-10-03T10:12:09.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa359ae8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa35409d6f0 0x7fa354121720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa359ae8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa35409e1d0 0x7fa354121c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa359ae8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa354139170 0x7fa3541c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa359ae8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa354124140 con 0x7fa35409e1d0 2023-10-03T10:12:09.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa359ae8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa354121370 con 0x7fa35409d6f0 2023-10-03T10:12:09.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa359ae8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3541235d0 con 0x7fa354139170 2023-10-03T10:12:09.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa353fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa354139170 0x7fa3541c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa353fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa354139170 0x7fa3541c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47096/0 (socket says 172.21.15.72:47096) 2023-10-03T10:12:09.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa3537fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa35409d6f0 0x7fa354121720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa353fff700 1 -- 172.21.15.72:0/3493600822 learned_addr learned my addr 172.21.15.72:0/3493600822 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:09.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa353fff700 1 -- 172.21.15.72:0/3493600822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa35409d6f0 msgr2=0x7fa354121720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa353fff700 1 --2- 172.21.15.72:0/3493600822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa35409d6f0 0x7fa354121720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa353fff700 1 -- 172.21.15.72:0/3493600822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa35409e1d0 msgr2=0x7fa354121c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa353fff700 1 --2- 172.21.15.72:0/3493600822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa35409e1d0 0x7fa354121c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa353fff700 1 -- 172.21.15.72:0/3493600822 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c009b30 con 0x7fa354139170 2023-10-03T10:12:09.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa353fff700 1 --2- 172.21.15.72:0/3493600822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa354139170 0x7fa3541c84d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009e50 tx=0x7fa34c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.055+0000 7fa33bfff700 1 -- 172.21.15.72:0/3493600822 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c004250 con 0x7fa354139170 2023-10-03T10:12:09.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.056+0000 7fa33bfff700 1 -- 172.21.15.72:0/3493600822 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c0043b0 con 0x7fa354139170 2023-10-03T10:12:09.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.056+0000 7fa359ae8700 1 -- 172.21.15.72:0/3493600822 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa354124400 con 0x7fa354139170 2023-10-03T10:12:09.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.056+0000 7fa33bfff700 1 -- 172.21.15.72:0/3493600822 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c004720 con 0x7fa354139170 2023-10-03T10:12:09.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.056+0000 7fa359ae8700 1 -- 172.21.15.72:0/3493600822 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa354124e70 con 0x7fa354139170 2023-10-03T10:12:09.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.056+0000 7fa33bfff700 1 -- 172.21.15.72:0/3493600822 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7fa34c01c440 con 0x7fa354139170 2023-10-03T10:12:09.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.057+0000 7fa33bfff700 1 -- 172.21.15.72:0/3493600822 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fa34c040be0 con 0x7fa354139170 2023-10-03T10:12:09.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.059+0000 7fa359ae8700 1 -- 172.21.15.72:0/3493600822 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35409c9f0 con 0x7fa354139170 2023-10-03T10:12:09.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.067+0000 7fa33bfff700 1 -- 172.21.15.72:0/3493600822 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa34c004880 con 0x7fa354139170 2023-10-03T10:12:09.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.076+0000 7fa8f526d700 1 Processor -- start 2023-10-03T10:12:09.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.076+0000 7fa8f526d700 1 -- start start 2023-10-03T10:12:09.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.076+0000 7fa8f526d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8f009e1d0 0x7fa8f0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.076+0000 7fa8f526d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8f0135e50 0x7fa8f0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.076+0000 7fa8f526d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f009f130 con 0x7fa8f009d6f0 2023-10-03T10:12:09.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.076+0000 7fa8f526d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f009f520 con 0x7fa8f0135e50 2023-10-03T10:12:09.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.076+0000 7fa8f526d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f009e930 con 0x7fa8f009e1d0 2023-10-03T10:12:09.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.076+0000 7fa8eeffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa8f009d6f0 0x7fa8f009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47904/0 (socket says 172.21.15.72:47904) 2023-10-03T10:12:09.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.076+0000 7fa8eeffd700 1 -- 172.21.15.72:0/715621068 learned_addr learned my addr 172.21.15.72:0/715621068 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:09.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.076+0000 7fa8ee7fc700 1 --2- 172.21.15.72:0/715621068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8f009e1d0 0x7fa8f0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.076+0000 7fa8ef7fe700 1 --2- 172.21.15.72:0/715621068 >> v2:172.21.15.72:3300/0 conn(0x7fa8f0135e50 0x7fa8f0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.077+0000 7fa8edffb700 1 -- 172.21.15.72:0/715621068 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971555356 0 0) 0x7fa8f009f130 con 0x7fa8f009d6f0 2023-10-03T10:12:09.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.077+0000 7fa8edffb700 1 -- 172.21.15.72:0/715621068 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8d80035b0 con 0x7fa8f009d6f0 2023-10-03T10:12:09.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.077+0000 7fa8ee7fc700 1 -- 172.21.15.72:0/715621068 >> v2:172.21.15.72:3300/0 conn(0x7fa8f0135e50 msgr2=0x7fa8f0138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:09.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.077+0000 7fa8ee7fc700 1 --2- 172.21.15.72:0/715621068 >> v2:172.21.15.72:3300/0 conn(0x7fa8f0135e50 0x7fa8f0138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.077+0000 7fa8ee7fc700 1 -- 172.21.15.72:0/715621068 >> v1:172.21.15.72:6789/0 conn(0x7fa8f009d6f0 legacy=0x7fa8f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.077+0000 7fa8ee7fc700 1 -- 172.21.15.72:0/715621068 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f009b2d0 con 0x7fa8f009e1d0 2023-10-03T10:12:09.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.077+0000 7fa8ee7fc700 1 --2- 172.21.15.72:0/715621068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8f009e1d0 0x7fa8f0135910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009870 tx=0x7fa8e4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb05259631bbae08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.077+0000 7fa8edffb700 1 -- 172.21.15.72:0/715621068 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400d8c0 con 0x7fa8f009e1d0 2023-10-03T10:12:09.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.077+0000 7fa8edffb700 1 -- 172.21.15.72:0/715621068 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e400c070 con 0x7fa8f009e1d0 2023-10-03T10:12:09.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.077+0000 7fa8edffb700 1 -- 172.21.15.72:0/715621068 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400dc40 con 0x7fa8f009e1d0 2023-10-03T10:12:09.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.078+0000 7fa8f526d700 1 -- 172.21.15.72:0/715621068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8f009e1d0 msgr2=0x7fa8f0135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.078+0000 7fa8f526d700 1 --2- 172.21.15.72:0/715621068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8f009e1d0 0x7fa8f0135910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009870 tx=0x7fa8e4009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:09.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.078+0000 7fa8f526d700 1 -- 172.21.15.72:0/715621068 shutdown_connections 2023-10-03T10:12:09.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.078+0000 7fa8f526d700 1 --2- 172.21.15.72:0/715621068 >> v2:172.21.15.72:3300/0 conn(0x7fa8f0135e50 0x7fa8f0138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.078+0000 7fa8f526d700 1 --2- 172.21.15.72:0/715621068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8f009e1d0 0x7fa8f0135910 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.078+0000 7fa8f526d700 1 -- 172.21.15.72:0/715621068 >> 172.21.15.72:0/715621068 conn(0x7fa8f0066f50 msgr2=0x7fa8f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.078+0000 7fa8f526d700 1 -- 172.21.15.72:0/715621068 shutdown_connections 2023-10-03T10:12:09.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.078+0000 7fa8f526d700 1 -- 172.21.15.72:0/715621068 wait complete. 2023-10-03T10:12:09.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.079+0000 7fa8f526d700 1 Processor -- start 2023-10-03T10:12:09.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.079+0000 7fa8f526d700 1 -- start start 2023-10-03T10:12:09.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8f526d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8f009d6f0 0x7fa8f0119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8f526d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f009e1d0 0x7fa8f01199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8f526d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8f0135e50 0x7fa8f0119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8f526d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f011cae0 con 0x7fa8f009e1d0 2023-10-03T10:12:09.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8f526d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f00a2000 con 0x7fa8f009d6f0 2023-10-03T10:12:09.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8f526d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f009c700 con 0x7fa8f0135e50 2023-10-03T10:12:09.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8eeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8f009d6f0 0x7fa8f0119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8ef7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8f0135e50 0x7fa8f0119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8ef7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8f0135e50 0x7fa8f0119f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47112/0 (socket says 172.21.15.72:47112) 2023-10-03T10:12:09.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8eeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8f009d6f0 0x7fa8f0119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58002/0 (socket says 172.21.15.72:58002) 2023-10-03T10:12:09.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8ef7fe700 1 -- 172.21.15.72:0/2409609488 learned_addr learned my addr 172.21.15.72:0/2409609488 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:09.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8ee7fc700 1 --2- 172.21.15.72:0/2409609488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f009e1d0 0x7fa8f01199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8ef7fe700 1 -- 172.21.15.72:0/2409609488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8f009d6f0 msgr2=0x7fa8f0119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8ef7fe700 1 --2- 172.21.15.72:0/2409609488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8f009d6f0 0x7fa8f0119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8ef7fe700 1 -- 172.21.15.72:0/2409609488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f009e1d0 msgr2=0x7fa8f01199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8ef7fe700 1 --2- 172.21.15.72:0/2409609488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f009e1d0 0x7fa8f01199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.080+0000 7fa8ef7fe700 1 -- 172.21.15.72:0/2409609488 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40094a0 con 0x7fa8f0135e50 2023-10-03T10:12:09.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.081+0000 7fa8ef7fe700 1 --2- 172.21.15.72:0/2409609488 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8f0135e50 0x7fa8f0119f00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800efc0 tx=0x7fa8e800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.081+0000 7fa8d77fe700 1 -- 172.21.15.72:0/2409609488 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800cc90 con 0x7fa8f0135e50 2023-10-03T10:12:09.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.081+0000 7fa8d77fe700 1 -- 172.21.15.72:0/2409609488 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e800f040 con 0x7fa8f0135e50 2023-10-03T10:12:09.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.081+0000 7fa8f526d700 1 -- 172.21.15.72:0/2409609488 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f011ae00 con 0x7fa8f0135e50 2023-10-03T10:12:09.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.081+0000 7fa8d77fe700 1 -- 172.21.15.72:0/2409609488 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8014480 con 0x7fa8f0135e50 2023-10-03T10:12:09.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.081+0000 7fa8f526d700 1 -- 172.21.15.72:0/2409609488 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f011bb60 con 0x7fa8f0135e50 2023-10-03T10:12:09.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.082+0000 7fa8f526d700 1 -- 172.21.15.72:0/2409609488 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f011b5b0 con 0x7fa8f0135e50 2023-10-03T10:12:09.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.083+0000 7fa8d77fe700 1 -- 172.21.15.72:0/2409609488 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7fa8e8014600 con 0x7fa8f0135e50 2023-10-03T10:12:09.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.083+0000 7fa8d77fe700 1 -- 172.21.15.72:0/2409609488 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fa8e8040730 con 0x7fa8f0135e50 2023-10-03T10:12:09.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.091+0000 7fa8d77fe700 1 -- 172.21.15.72:0/2409609488 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8e8012930 con 0x7fa8f0135e50 2023-10-03T10:12:09.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.101+0000 7f89b4ff9700 1 -- 172.21.15.72:0/1630639949 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f89b001d400 con 0x7f89b81341d0 2023-10-03T10:12:09.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.103+0000 7fa8d77fe700 1 -- 172.21.15.72:0/2409609488 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fa8e8026420 con 0x7fa8f0135e50 2023-10-03T10:12:09.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.101+0000 7fa33bfff700 1 -- 172.21.15.72:0/3493600822 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fa34c01c6f0 con 0x7fa354139170 2023-10-03T10:12:09.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.105+0000 7fb888ff9700 1 -- 172.21.15.72:0/2796949724 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fb87c01c730 con 0x7fb88c09d6f0 2023-10-03T10:12:09.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.161+0000 7fb892822700 1 -- 172.21.15.72:0/2796949724 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb88c1a9380 con 0x7fb88c09d6f0 2023-10-03T10:12:09.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.161+0000 7fb888ff9700 1 -- 172.21.15.72:0/2796949724 <== mon.1 v2:172.21.15.72:3301/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb88c1a9380 con 0x7fb88c09d6f0 2023-10-03T10:12:09.162 INFO:teuthology.orchestra.run.smithi072.stdout:38654705696 2023-10-03T10:12:09.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.163+0000 7fb892822700 1 -- 172.21.15.72:0/2796949724 >> v1:172.21.15.72:6816/126756 conn(0x7fb87802f240 legacy=0x7fb8780316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.163+0000 7fb892822700 1 -- 172.21.15.72:0/2796949724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88c09d6f0 msgr2=0x7fb88c1a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.163+0000 7fb892822700 1 --2- 172.21.15.72:0/2796949724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88c09d6f0 0x7fb88c1a5ea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00e900 tx=0x7fb87c00ec10 comp rx=0 tx=0).stop 2023-10-03T10:12:09.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.163+0000 7fb892822700 1 -- 172.21.15.72:0/2796949724 shutdown_connections 2023-10-03T10:12:09.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.163+0000 7fb892822700 1 --2- 172.21.15.72:0/2796949724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb88c09e410 0x7fb88c1a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.163+0000 7fb892822700 1 --2- 172.21.15.72:0/2796949724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88c09d6f0 0x7fb88c1a5ea0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.163+0000 7fb892822700 1 --2- 172.21.15.72:0/2796949724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb88c09e000 0x7fb88c1a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.163+0000 7fb892822700 1 -- 172.21.15.72:0/2796949724 >> 172.21.15.72:0/2796949724 conn(0x7fb88c066f50 msgr2=0x7fb88c1bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.164+0000 7fb892822700 1 -- 172.21.15.72:0/2796949724 shutdown_connections 2023-10-03T10:12:09.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.164+0000 7fb892822700 1 -- 172.21.15.72:0/2796949724 wait complete. 2023-10-03T10:12:09.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705696 for osd.0 2023-10-03T10:12:09.177 DEBUG:teuthology.parallel:result is None 2023-10-03T10:12:09.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.227+0000 7f89be94b700 1 -- 172.21.15.72:0/1630639949 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f89b8074ea0 con 0x7f89b81341d0 2023-10-03T10:12:09.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.227+0000 7f89b4ff9700 1 -- 172.21.15.72:0/1630639949 <== mon.2 v2:172.21.15.72:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f89b0007920 con 0x7f89b81341d0 2023-10-03T10:12:09.228 INFO:teuthology.orchestra.run.smithi072.stdout:38654705696 2023-10-03T10:12:09.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.229+0000 7f89be94b700 1 -- 172.21.15.72:0/1630639949 >> v1:172.21.15.72:6816/126756 conn(0x7f89a402f290 legacy=0x7f89a4031740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.229+0000 7f89be94b700 1 -- 172.21.15.72:0/1630639949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b81341d0 msgr2=0x7f89b811c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.229+0000 7f89be94b700 1 --2- 172.21.15.72:0/1630639949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b81341d0 0x7f89b811c040 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f89b000eba0 tx=0x7f89b000eeb0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.229+0000 7f89be94b700 1 -- 172.21.15.72:0/1630639949 shutdown_connections 2023-10-03T10:12:09.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.229+0000 7f89be94b700 1 --2- 172.21.15.72:0/1630639949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b809e390 0x7f89b811b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.229+0000 7f89be94b700 1 --2- 172.21.15.72:0/1630639949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b81341d0 0x7f89b811c040 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.229+0000 7f89be94b700 1 --2- 172.21.15.72:0/1630639949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b81338c0 0x7f89b811bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.229+0000 7f89be94b700 1 -- 172.21.15.72:0/1630639949 >> 172.21.15.72:0/1630639949 conn(0x7f89b80a2aa0 msgr2=0x7f89b812f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.230+0000 7f89be94b700 1 -- 172.21.15.72:0/1630639949 shutdown_connections 2023-10-03T10:12:09.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.230+0000 7f89be94b700 1 -- 172.21.15.72:0/1630639949 wait complete. 2023-10-03T10:12:09.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705696 for osd.2 2023-10-03T10:12:09.242 DEBUG:teuthology.parallel:result is None 2023-10-03T10:12:09.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.270+0000 7fa359ae8700 1 -- 172.21.15.72:0/3493600822 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa35409f420 con 0x7fa354139170 2023-10-03T10:12:09.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.270+0000 7fa33bfff700 1 -- 172.21.15.72:0/3493600822 <== mon.2 v2:172.21.15.72:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa34c004880 con 0x7fa354139170 2023-10-03T10:12:09.271 INFO:teuthology.orchestra.run.smithi072.stdout:38654705696 2023-10-03T10:12:09.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.272+0000 7fa359ae8700 1 -- 172.21.15.72:0/3493600822 >> v1:172.21.15.72:6816/126756 conn(0x7fa34002f240 legacy=0x7fa3400316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.272+0000 7fa359ae8700 1 -- 172.21.15.72:0/3493600822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa354139170 msgr2=0x7fa3541c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.272+0000 7fa359ae8700 1 --2- 172.21.15.72:0/3493600822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa354139170 0x7fa3541c84d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009e50 tx=0x7fa34c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.272+0000 7fa359ae8700 1 -- 172.21.15.72:0/3493600822 shutdown_connections 2023-10-03T10:12:09.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.272+0000 7fa359ae8700 1 --2- 172.21.15.72:0/3493600822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa354139170 0x7fa3541c84d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.272+0000 7fa359ae8700 1 --2- 172.21.15.72:0/3493600822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa35409d6f0 0x7fa354121720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.272+0000 7fa359ae8700 1 --2- 172.21.15.72:0/3493600822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa35409e1d0 0x7fa354121c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.272+0000 7fa359ae8700 1 -- 172.21.15.72:0/3493600822 >> 172.21.15.72:0/3493600822 conn(0x7fa354066f50 msgr2=0x7fa354070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.272+0000 7fa359ae8700 1 -- 172.21.15.72:0/3493600822 shutdown_connections 2023-10-03T10:12:09.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.272+0000 7fa359ae8700 1 -- 172.21.15.72:0/3493600822 wait complete. 2023-10-03T10:12:09.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705696 for osd.3 2023-10-03T10:12:09.285 DEBUG:teuthology.parallel:result is None 2023-10-03T10:12:09.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.296+0000 7fa8f526d700 1 -- 172.21.15.72:0/2409609488 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa8f0074ea0 con 0x7fa8f0135e50 2023-10-03T10:12:09.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.297+0000 7fa8d77fe700 1 -- 172.21.15.72:0/2409609488 <== mon.2 v2:172.21.15.72:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa8e8018070 con 0x7fa8f0135e50 2023-10-03T10:12:09.297 INFO:teuthology.orchestra.run.smithi072.stdout:38654705696 2023-10-03T10:12:09.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.299+0000 7fa8f526d700 1 -- 172.21.15.72:0/2409609488 >> v1:172.21.15.72:6816/126756 conn(0x7fa8dc02f240 legacy=0x7fa8dc0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.299+0000 7fa8f526d700 1 -- 172.21.15.72:0/2409609488 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8f0135e50 msgr2=0x7fa8f0119f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.299+0000 7fa8f526d700 1 --2- 172.21.15.72:0/2409609488 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8f0135e50 0x7fa8f0119f00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800efc0 tx=0x7fa8e800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.299+0000 7fa8f526d700 1 -- 172.21.15.72:0/2409609488 shutdown_connections 2023-10-03T10:12:09.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.299+0000 7fa8f526d700 1 --2- 172.21.15.72:0/2409609488 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8f0135e50 0x7fa8f0119f00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.299+0000 7fa8f526d700 1 --2- 172.21.15.72:0/2409609488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8f009d6f0 0x7fa8f0119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.299+0000 7fa8f526d700 1 --2- 172.21.15.72:0/2409609488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f009e1d0 0x7fa8f01199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.299+0000 7fa8f526d700 1 -- 172.21.15.72:0/2409609488 >> 172.21.15.72:0/2409609488 conn(0x7fa8f0066f50 msgr2=0x7fa8f0132810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.299+0000 7fa8f526d700 1 -- 172.21.15.72:0/2409609488 shutdown_connections 2023-10-03T10:12:09.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.299+0000 7fa8f526d700 1 -- 172.21.15.72:0/2409609488 wait complete. 2023-10-03T10:12:09.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705695 got 38654705696 for osd.1 2023-10-03T10:12:09.311 DEBUG:teuthology.parallel:result is None 2023-10-03T10:12:09.311 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:12:09.311 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:12:09.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.471+0000 7f6144c9c700 1 Processor -- start 2023-10-03T10:12:09.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.471+0000 7f6144c9c700 1 -- start start 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f6144c9c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f614009d6f0 0x7f614009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f6144c9c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f614009e410 0x7f6140134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f6144c9c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614009b120 con 0x7f614009e000 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f6144c9c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614006b460 con 0x7f614009d6f0 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f6144c9c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f614009a7e0 con 0x7f614009e410 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f614009d6f0 0x7f614009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613ed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f614009e410 0x7f6140134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613dd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f614009e000 0x7f61401339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47920/0 (socket says 172.21.15.72:47920) 2023-10-03T10:12:09.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f614009d6f0 0x7f614009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58004/0 (socket says 172.21.15.72:58004) 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613ed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f614009e410 0x7f6140134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47116/0 (socket says 172.21.15.72:47116) 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613dd9b700 1 -- 172.21.15.72:0/2617471693 learned_addr learned my addr 172.21.15.72:0/2617471693 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613d59a700 1 -- 172.21.15.72:0/2617471693 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643855171 0 0) 0x7f614009b120 con 0x7f614009e000 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613ed9d700 1 -- 172.21.15.72:0/2617471693 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f614009d6f0 msgr2=0x7f614009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613ed9d700 1 --2- 172.21.15.72:0/2617471693 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f614009d6f0 0x7f614009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613ed9d700 1 -- 172.21.15.72:0/2617471693 >> v1:172.21.15.72:6789/0 conn(0x7f614009e000 legacy=0x7f61401339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613ed9d700 1 -- 172.21.15.72:0/2617471693 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614009a500 con 0x7f614009e410 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613e59c700 1 --2- 172.21.15.72:0/2617471693 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f614009d6f0 0x7f614009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613ed9d700 1 --2- 172.21.15.72:0/2617471693 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f614009e410 0x7f6140134100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6138009df0 tx=0x7f613800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9371d7c9e07f640 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613d59a700 1 -- 172.21.15.72:0/2617471693 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613800e070 con 0x7f614009e410 2023-10-03T10:12:09.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613d59a700 1 -- 172.21.15.72:0/2617471693 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613800bae0 con 0x7f614009e410 2023-10-03T10:12:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.472+0000 7f613d59a700 1 -- 172.21.15.72:0/2617471693 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613800be90 con 0x7f614009e410 2023-10-03T10:12:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.473+0000 7f6144c9c700 1 -- 172.21.15.72:0/2617471693 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f614009e410 msgr2=0x7f6140134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.473+0000 7f6144c9c700 1 --2- 172.21.15.72:0/2617471693 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f614009e410 0x7f6140134100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6138009df0 tx=0x7f613800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.473+0000 7f6144c9c700 1 -- 172.21.15.72:0/2617471693 shutdown_connections 2023-10-03T10:12:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.473+0000 7f6144c9c700 1 --2- 172.21.15.72:0/2617471693 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f614009e410 0x7f6140134100 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.473+0000 7f6144c9c700 1 --2- 172.21.15.72:0/2617471693 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f614009d6f0 0x7f614009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.473+0000 7f6144c9c700 1 -- 172.21.15.72:0/2617471693 >> 172.21.15.72:0/2617471693 conn(0x7f6140066f50 msgr2=0x7f614009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.473+0000 7f6144c9c700 1 -- 172.21.15.72:0/2617471693 shutdown_connections 2023-10-03T10:12:09.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.473+0000 7f6144c9c700 1 -- 172.21.15.72:0/2617471693 wait complete. 2023-10-03T10:12:09.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.474+0000 7f6144c9c700 1 Processor -- start 2023-10-03T10:12:09.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.474+0000 7f6144c9c700 1 -- start start 2023-10-03T10:12:09.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f6144c9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f614009d6f0 0x7f6140122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f6144c9c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f614009e000 0x7f6140122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f6144c9c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f614009e410 0x7f6140122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f6144c9c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61401237f0 con 0x7f614009d6f0 2023-10-03T10:12:09.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f6144c9c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6140124e00 con 0x7f614009e410 2023-10-03T10:12:09.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f6144c9c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6140125e40 con 0x7f614009e000 2023-10-03T10:12:09.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f613e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f614009d6f0 0x7f6140122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f613dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f614009e000 0x7f6140122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f613e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f614009d6f0 0x7f6140122320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44058/0 (socket says 172.21.15.72:44058) 2023-10-03T10:12:09.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f613ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f614009e410 0x7f6140122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f613e59c700 1 -- 172.21.15.72:0/3624007698 learned_addr learned my addr 172.21.15.72:0/3624007698 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:09.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f613dd9b700 1 -- 172.21.15.72:0/3624007698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f614009e410 msgr2=0x7f6140122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f613dd9b700 1 --2- 172.21.15.72:0/3624007698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f614009e410 0x7f6140122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f613dd9b700 1 -- 172.21.15.72:0/3624007698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f614009d6f0 msgr2=0x7f6140122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f613dd9b700 1 --2- 172.21.15.72:0/3624007698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f614009d6f0 0x7f6140122320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f613dd9b700 1 -- 172.21.15.72:0/3624007698 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61340094a0 con 0x7f614009e000 2023-10-03T10:12:09.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f613e59c700 1 --2- 172.21.15.72:0/3624007698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f614009d6f0 0x7f6140122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:09.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f613dd9b700 1 --2- 172.21.15.72:0/3624007698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f614009e000 0x7f6140122860 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f614006e510 tx=0x7f613000c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f612effd700 1 -- 172.21.15.72:0/3624007698 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6130004c80 con 0x7f614009e000 2023-10-03T10:12:09.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f612effd700 1 -- 172.21.15.72:0/3624007698 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6130004de0 con 0x7f614009e000 2023-10-03T10:12:09.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f6144c9c700 1 -- 172.21.15.72:0/3624007698 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6138009a70 con 0x7f614009e000 2023-10-03T10:12:09.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f612effd700 1 -- 172.21.15.72:0/3624007698 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6130007310 con 0x7f614009e000 2023-10-03T10:12:09.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.475+0000 7f6144c9c700 1 -- 172.21.15.72:0/3624007698 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61400a2020 con 0x7f614009e000 2023-10-03T10:12:09.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.476+0000 7f612effd700 1 -- 172.21.15.72:0/3624007698 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f6130007470 con 0x7f614009e000 2023-10-03T10:12:09.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.476+0000 7f612effd700 1 -- 172.21.15.72:0/3624007698 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f613003f5b0 con 0x7f614009e000 2023-10-03T10:12:09.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.476+0000 7f6144c9c700 1 -- 172.21.15.72:0/3624007698 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614011f030 con 0x7f614009e000 2023-10-03T10:12:09.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.481+0000 7f612effd700 1 -- 172.21.15.72:0/3624007698 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6130007720 con 0x7f614009e000 2023-10-03T10:12:09.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.659+0000 7f6144c9c700 1 -- 172.21.15.72:0/3624007698 --> v1:172.21.15.72:6816/126756 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f614006a9e0 con 0x7f612002f480 2023-10-03T10:12:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.667+0000 7f612effd700 1 -- 172.21.15.72:0/3624007698 <== mgr.14102 v1:172.21.15.72:6816/126756 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270340 (unknown 2965378022 0 3867487099) 0x7f6134009d10 con 0x7f612002f480 2023-10-03T10:12:09.670 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.670+0000 7f6144c9c700 1 -- 172.21.15.72:0/3624007698 >> v1:172.21.15.72:6816/126756 conn(0x7f612002f480 legacy=0x7f6120031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.670+0000 7f6144c9c700 1 -- 172.21.15.72:0/3624007698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f614009e000 msgr2=0x7f6140122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.670+0000 7f6144c9c700 1 --2- 172.21.15.72:0/3624007698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f614009e000 0x7f6140122860 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f614006e510 tx=0x7f613000c750 comp rx=0 tx=0).stop 2023-10-03T10:12:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.670+0000 7f6144c9c700 1 -- 172.21.15.72:0/3624007698 shutdown_connections 2023-10-03T10:12:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.670+0000 7f6144c9c700 1 --2- 172.21.15.72:0/3624007698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f614009d6f0 0x7f6140122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.670+0000 7f6144c9c700 1 --2- 172.21.15.72:0/3624007698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f614009e410 0x7f6140122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.670+0000 7f6144c9c700 1 --2- 172.21.15.72:0/3624007698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f614009e000 0x7f6140122860 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.670+0000 7f6144c9c700 1 -- 172.21.15.72:0/3624007698 >> 172.21.15.72:0/3624007698 conn(0x7f6140066f50 msgr2=0x7f6140133de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.670+0000 7f6144c9c700 1 -- 172.21.15.72:0/3624007698 shutdown_connections 2023-10-03T10:12:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.670+0000 7f6144c9c700 1 -- 172.21.15.72:0/3624007698 wait complete. 2023-10-03T10:12:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-03T10:12:09.682 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-10-03T10:12:08.090368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189132,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298228,"statfs":{"total":386547056640,"available":385329385472,"internally_reserved":0,"allocated":765952,"data_stored":261537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.998680"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651774+0000","last_change":"2023-10-03T10:09:46.383964+0000","last_active":"2023-10-03T10:10:37.651774+0000","last_peered":"2023-10-03T10:10:37.651774+0000","last_clean":"2023-10-03T10:10:37.651774+0000","last_became_active":"2023-10-03T10:09:46.383681+0000","last_became_peered":"2023-10-03T10:09:46.383681+0000","last_unstale":"2023-10-03T10:10:37.651774+0000","last_undegraded":"2023-10-03T10:10:37.651774+0000","last_fullsized":"2023-10-03T10:10:37.651774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651588+0000","last_change":"2023-10-03T10:09:46.369230+0000","last_active":"2023-10-03T10:10:37.651588+0000","last_peered":"2023-10-03T10:10:37.651588+0000","last_clean":"2023-10-03T10:10:37.651588+0000","last_became_active":"2023-10-03T10:09:46.368861+0000","last_became_peered":"2023-10-03T10:09:46.368861+0000","last_unstale":"2023-10-03T10:10:37.651588+0000","last_undegraded":"2023-10-03T10:10:37.651588+0000","last_fullsized":"2023-10-03T10:10:37.651588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.656316+0000","last_change":"2023-10-03T10:09:46.379410+0000","last_active":"2023-10-03T10:10:37.656316+0000","last_peered":"2023-10-03T10:10:37.656316+0000","last_clean":"2023-10-03T10:10:37.656316+0000","last_became_active":"2023-10-03T10:09:46.379027+0000","last_became_peered":"2023-10-03T10:09:46.379027+0000","last_unstale":"2023-10-03T10:10:37.656316+0000","last_undegraded":"2023-10-03T10:10:37.656316+0000","last_fullsized":"2023-10-03T10:10:37.656316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655796+0000","last_change":"2023-10-03T10:09:46.379505+0000","last_active":"2023-10-03T10:10:37.655796+0000","last_peered":"2023-10-03T10:10:37.655796+0000","last_clean":"2023-10-03T10:10:37.655796+0000","last_became_active":"2023-10-03T10:09:46.379187+0000","last_became_peered":"2023-10-03T10:09:46.379187+0000","last_unstale":"2023-10-03T10:10:37.655796+0000","last_undegraded":"2023-10-03T10:10:37.655796+0000","last_fullsized":"2023-10-03T10:10:37.655796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.665267+0000","last_change":"2023-10-03T10:10:37.661902+0000","last_active":"2023-10-03T10:10:37.665267+0000","last_peered":"2023-10-03T10:10:37.665267+0000","last_clean":"2023-10-03T10:10:37.665267+0000","last_became_active":"2023-10-03T10:10:37.661652+0000","last_became_peered":"2023-10-03T10:10:37.661652+0000","last_unstale":"2023-10-03T10:10:37.665267+0000","last_undegraded":"2023-10-03T10:10:37.665267+0000","last_fullsized":"2023-10-03T10:10:37.665267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652711+0000","last_change":"2023-10-03T10:09:46.385185+0000","last_active":"2023-10-03T10:10:37.652711+0000","last_peered":"2023-10-03T10:10:37.652711+0000","last_clean":"2023-10-03T10:10:37.652711+0000","last_became_active":"2023-10-03T10:09:46.384935+0000","last_became_peered":"2023-10-03T10:09:46.384935+0000","last_unstale":"2023-10-03T10:10:37.652711+0000","last_undegraded":"2023-10-03T10:10:37.652711+0000","last_fullsized":"2023-10-03T10:10:37.652711+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651640+0000","last_change":"2023-10-03T10:09:46.378880+0000","last_active":"2023-10-03T10:10:37.651640+0000","last_peered":"2023-10-03T10:10:37.651640+0000","last_clean":"2023-10-03T10:10:37.651640+0000","last_became_active":"2023-10-03T10:09:46.375285+0000","last_became_peered":"2023-10-03T10:09:46.375285+0000","last_unstale":"2023-10-03T10:10:37.651640+0000","last_undegraded":"2023-10-03T10:10:37.651640+0000","last_fullsized":"2023-10-03T10:10:37.651640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654218+0000","last_change":"2023-10-03T10:09:46.375928+0000","last_active":"2023-10-03T10:10:37.654218+0000","last_peered":"2023-10-03T10:10:37.654218+0000","last_clean":"2023-10-03T10:10:37.654218+0000","last_became_active":"2023-10-03T10:09:46.375325+0000","last_became_peered":"2023-10-03T10:09:46.375325+0000","last_unstale":"2023-10-03T10:10:37.654218+0000","last_undegraded":"2023-10-03T10:10:37.654218+0000","last_fullsized":"2023-10-03T10:10:37.654218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.658364+0000","last_change":"2023-10-03T10:09:46.379935+0000","last_active":"2023-10-03T10:10:37.658364+0000","last_peered":"2023-10-03T10:10:37.658364+0000","last_clean":"2023-10-03T10:10:37.658364+0000","last_became_active":"2023-10-03T10:09:46.379431+0000","last_became_peered":"2023-10-03T10:09:46.379431+0000","last_unstale":"2023-10-03T10:10:37.658364+0000","last_undegraded":"2023-10-03T10:10:37.658364+0000","last_fullsized":"2023-10-03T10:10:37.658364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.656066+0000","last_change":"2023-10-03T10:09:46.372991+0000","last_active":"2023-10-03T10:10:37.656066+0000","last_peered":"2023-10-03T10:10:37.656066+0000","last_clean":"2023-10-03T10:10:37.656066+0000","last_became_active":"2023-10-03T10:09:46.372738+0000","last_became_peered":"2023-10-03T10:09:46.372738+0000","last_unstale":"2023-10-03T10:10:37.656066+0000","last_undegraded":"2023-10-03T10:10:37.656066+0000","last_fullsized":"2023-10-03T10:10:37.656066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655028+0000","last_change":"2023-10-03T10:09:46.372532+0000","last_active":"2023-10-03T10:10:37.655028+0000","last_peered":"2023-10-03T10:10:37.655028+0000","last_clean":"2023-10-03T10:10:37.655028+0000","last_became_active":"2023-10-03T10:09:46.372304+0000","last_became_peered":"2023-10-03T10:09:46.372304+0000","last_unstale":"2023-10-03T10:10:37.655028+0000","last_undegraded":"2023-10-03T10:10:37.655028+0000","last_fullsized":"2023-10-03T10:10:37.655028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651097+0000","last_change":"2023-10-03T10:09:46.384266+0000","last_active":"2023-10-03T10:10:37.651097+0000","last_peered":"2023-10-03T10:10:37.651097+0000","last_clean":"2023-10-03T10:10:37.651097+0000","last_became_active":"2023-10-03T10:09:46.383826+0000","last_became_peered":"2023-10-03T10:09:46.383826+0000","last_unstale":"2023-10-03T10:10:37.651097+0000","last_undegraded":"2023-10-03T10:10:37.651097+0000","last_fullsized":"2023-10-03T10:10:37.651097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651248+0000","last_change":"2023-10-03T10:09:46.384841+0000","last_active":"2023-10-03T10:10:37.651248+0000","last_peered":"2023-10-03T10:10:37.651248+0000","last_clean":"2023-10-03T10:10:37.651248+0000","last_became_active":"2023-10-03T10:09:46.384396+0000","last_became_peered":"2023-10-03T10:09:46.384396+0000","last_unstale":"2023-10-03T10:10:37.651248+0000","last_undegraded":"2023-10-03T10:10:37.651248+0000","last_fullsized":"2023-10-03T10:10:37.651248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654843+0000","last_change":"2023-10-03T10:09:46.373837+0000","last_active":"2023-10-03T10:10:37.654843+0000","last_peered":"2023-10-03T10:10:37.654843+0000","last_clean":"2023-10-03T10:10:37.654843+0000","last_became_active":"2023-10-03T10:09:46.373580+0000","last_became_peered":"2023-10-03T10:09:46.373580+0000","last_unstale":"2023-10-03T10:10:37.654843+0000","last_undegraded":"2023-10-03T10:10:37.654843+0000","last_fullsized":"2023-10-03T10:10:37.654843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.656651+0000","last_change":"2023-10-03T10:09:46.380527+0000","last_active":"2023-10-03T10:10:37.656651+0000","last_peered":"2023-10-03T10:10:37.656651+0000","last_clean":"2023-10-03T10:10:37.656651+0000","last_became_active":"2023-10-03T10:09:46.379198+0000","last_became_peered":"2023-10-03T10:09:46.379198+0000","last_unstale":"2023-10-03T10:10:37.656651+0000","last_undegraded":"2023-10-03T10:10:37.656651+0000","last_fullsized":"2023-10-03T10:10:37.656651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.650960+0000","last_change":"2023-10-03T10:09:46.365014+0000","last_active":"2023-10-03T10:10:37.650960+0000","last_peered":"2023-10-03T10:10:37.650960+0000","last_clean":"2023-10-03T10:10:37.650960+0000","last_became_active":"2023-10-03T10:09:46.363620+0000","last_became_peered":"2023-10-03T10:09:46.363620+0000","last_unstale":"2023-10-03T10:10:37.650960+0000","last_undegraded":"2023-10-03T10:10:37.650960+0000","last_fullsized":"2023-10-03T10:10:37.650960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.665285+0000","last_change":"2023-10-03T10:10:37.661935+0000","last_active":"2023-10-03T10:10:37.665285+0000","last_peered":"2023-10-03T10:10:37.665285+0000","last_clean":"2023-10-03T10:10:37.665285+0000","last_became_active":"2023-10-03T10:10:37.661696+0000","last_became_peered":"2023-10-03T10:10:37.661696+0000","last_unstale":"2023-10-03T10:10:37.665285+0000","last_undegraded":"2023-10-03T10:10:37.665285+0000","last_fullsized":"2023-10-03T10:10:37.665285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657728+0000","last_change":"2023-10-03T10:09:46.374686+0000","last_active":"2023-10-03T10:10:37.657728+0000","last_peered":"2023-10-03T10:10:37.657728+0000","last_clean":"2023-10-03T10:10:37.657728+0000","last_became_active":"2023-10-03T10:09:46.371287+0000","last_became_peered":"2023-10-03T10:09:46.371287+0000","last_unstale":"2023-10-03T10:10:37.657728+0000","last_undegraded":"2023-10-03T10:10:37.657728+0000","last_fullsized":"2023-10-03T10:10:37.657728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651055+0000","last_change":"2023-10-03T10:09:46.364615+0000","last_active":"2023-10-03T10:10:37.651055+0000","last_peered":"2023-10-03T10:10:37.651055+0000","last_clean":"2023-10-03T10:10:37.651055+0000","last_became_active":"2023-10-03T10:09:46.364379+0000","last_became_peered":"2023-10-03T10:09:46.364379+0000","last_unstale":"2023-10-03T10:10:37.651055+0000","last_undegraded":"2023-10-03T10:10:37.651055+0000","last_fullsized":"2023-10-03T10:10:37.651055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655688+0000","last_change":"2023-10-03T10:09:46.388555+0000","last_active":"2023-10-03T10:10:37.655688+0000","last_peered":"2023-10-03T10:10:37.655688+0000","last_clean":"2023-10-03T10:10:37.655688+0000","last_became_active":"2023-10-03T10:09:46.388278+0000","last_became_peered":"2023-10-03T10:09:46.388278+0000","last_unstale":"2023-10-03T10:10:37.655688+0000","last_undegraded":"2023-10-03T10:10:37.655688+0000","last_fullsized":"2023-10-03T10:10:37.655688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655129+0000","last_change":"2023-10-03T10:09:46.367061+0000","last_active":"2023-10-03T10:10:37.655129+0000","last_peered":"2023-10-03T10:10:37.655129+0000","last_clean":"2023-10-03T10:10:37.655129+0000","last_became_active":"2023-10-03T10:09:46.366790+0000","last_became_peered":"2023-10-03T10:09:46.366790+0000","last_unstale":"2023-10-03T10:10:37.655129+0000","last_undegraded":"2023-10-03T10:10:37.655129+0000","last_fullsized":"2023-10-03T10:10:37.655129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655592+0000","last_change":"2023-10-03T10:09:46.378399+0000","last_active":"2023-10-03T10:10:37.655592+0000","last_peered":"2023-10-03T10:10:37.655592+0000","last_clean":"2023-10-03T10:10:37.655592+0000","last_became_active":"2023-10-03T10:09:46.378102+0000","last_became_peered":"2023-10-03T10:09:46.378102+0000","last_unstale":"2023-10-03T10:10:37.655592+0000","last_undegraded":"2023-10-03T10:10:37.655592+0000","last_fullsized":"2023-10-03T10:10:37.655592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651480+0000","last_change":"2023-10-03T10:09:46.378572+0000","last_active":"2023-10-03T10:10:37.651480+0000","last_peered":"2023-10-03T10:10:37.651480+0000","last_clean":"2023-10-03T10:10:37.651480+0000","last_became_active":"2023-10-03T10:09:46.378004+0000","last_became_peered":"2023-10-03T10:09:46.378004+0000","last_unstale":"2023-10-03T10:10:37.651480+0000","last_undegraded":"2023-10-03T10:10:37.651480+0000","last_fullsized":"2023-10-03T10:10:37.651480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654250+0000","last_change":"2023-10-03T10:09:46.375958+0000","last_active":"2023-10-03T10:10:37.654250+0000","last_peered":"2023-10-03T10:10:37.654250+0000","last_clean":"2023-10-03T10:10:37.654250+0000","last_became_active":"2023-10-03T10:09:46.375553+0000","last_became_peered":"2023-10-03T10:09:46.375553+0000","last_unstale":"2023-10-03T10:10:37.654250+0000","last_undegraded":"2023-10-03T10:10:37.654250+0000","last_fullsized":"2023-10-03T10:10:37.654250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654801+0000","last_change":"2023-10-03T10:09:46.367258+0000","last_active":"2023-10-03T10:10:37.654801+0000","last_peered":"2023-10-03T10:10:37.654801+0000","last_clean":"2023-10-03T10:10:37.654801+0000","last_became_active":"2023-10-03T10:09:46.366828+0000","last_became_peered":"2023-10-03T10:09:46.366828+0000","last_unstale":"2023-10-03T10:10:37.654801+0000","last_undegraded":"2023-10-03T10:10:37.654801+0000","last_fullsized":"2023-10-03T10:10:37.654801+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655992+0000","last_change":"2023-10-03T10:09:46.374039+0000","last_active":"2023-10-03T10:10:37.655992+0000","last_peered":"2023-10-03T10:10:37.655992+0000","last_clean":"2023-10-03T10:10:37.655992+0000","last_became_active":"2023-10-03T10:09:46.373585+0000","last_became_peered":"2023-10-03T10:09:46.373585+0000","last_unstale":"2023-10-03T10:10:37.655992+0000","last_undegraded":"2023-10-03T10:10:37.655992+0000","last_fullsized":"2023-10-03T10:10:37.655992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.650981+0000","last_change":"2023-10-03T10:09:46.383307+0000","last_active":"2023-10-03T10:10:37.650981+0000","last_peered":"2023-10-03T10:10:37.650981+0000","last_clean":"2023-10-03T10:10:37.650981+0000","last_became_active":"2023-10-03T10:09:46.377010+0000","last_became_peered":"2023-10-03T10:09:46.377010+0000","last_unstale":"2023-10-03T10:10:37.650981+0000","last_undegraded":"2023-10-03T10:10:37.650981+0000","last_fullsized":"2023-10-03T10:10:37.650981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654694+0000","last_change":"2023-10-03T10:09:45.994509+0000","last_active":"2023-10-03T10:10:37.654694+0000","last_peered":"2023-10-03T10:10:37.654694+0000","last_clean":"2023-10-03T10:10:37.654694+0000","last_became_active":"2023-10-03T10:09:45.994047+0000","last_became_peered":"2023-10-03T10:09:45.994047+0000","last_unstale":"2023-10-03T10:10:37.654694+0000","last_undegraded":"2023-10-03T10:10:37.654694+0000","last_fullsized":"2023-10-03T10:10:37.654694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651032+0000","last_change":"2023-10-03T10:09:46.367594+0000","last_active":"2023-10-03T10:10:37.651032+0000","last_peered":"2023-10-03T10:10:37.651032+0000","last_clean":"2023-10-03T10:10:37.651032+0000","last_became_active":"2023-10-03T10:09:46.367029+0000","last_became_peered":"2023-10-03T10:09:46.367029+0000","last_unstale":"2023-10-03T10:10:37.651032+0000","last_undegraded":"2023-10-03T10:10:37.651032+0000","last_fullsized":"2023-10-03T10:10:37.651032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654498+0000","last_change":"2023-10-03T10:09:46.005851+0000","last_active":"2023-10-03T10:10:37.654498+0000","last_peered":"2023-10-03T10:10:37.654498+0000","last_clean":"2023-10-03T10:10:37.654498+0000","last_became_active":"2023-10-03T10:09:46.005573+0000","last_became_peered":"2023-10-03T10:09:46.005573+0000","last_unstale":"2023-10-03T10:10:37.654498+0000","last_undegraded":"2023-10-03T10:10:37.654498+0000","last_fullsized":"2023-10-03T10:10:37.654498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657550+0000","last_change":"2023-10-03T10:09:46.378806+0000","last_active":"2023-10-03T10:10:37.657550+0000","last_peered":"2023-10-03T10:10:37.657550+0000","last_clean":"2023-10-03T10:10:37.657550+0000","last_became_active":"2023-10-03T10:09:46.378564+0000","last_became_peered":"2023-10-03T10:09:46.378564+0000","last_unstale":"2023-10-03T10:10:37.657550+0000","last_undegraded":"2023-10-03T10:10:37.657550+0000","last_fullsized":"2023-10-03T10:10:37.657550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651445+0000","last_change":"2023-10-03T10:09:46.004262+0000","last_active":"2023-10-03T10:10:37.651445+0000","last_peered":"2023-10-03T10:10:37.651445+0000","last_clean":"2023-10-03T10:10:37.651445+0000","last_became_active":"2023-10-03T10:09:46.004006+0000","last_became_peered":"2023-10-03T10:09:46.004006+0000","last_unstale":"2023-10-03T10:10:37.651445+0000","last_undegraded":"2023-10-03T10:10:37.651445+0000","last_fullsized":"2023-10-03T10:10:37.651445+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652375+0000","last_change":"2023-10-03T10:09:46.369027+0000","last_active":"2023-10-03T10:10:37.652375+0000","last_peered":"2023-10-03T10:10:37.652375+0000","last_clean":"2023-10-03T10:10:37.652375+0000","last_became_active":"2023-10-03T10:09:46.368802+0000","last_became_peered":"2023-10-03T10:09:46.368802+0000","last_unstale":"2023-10-03T10:10:37.652375+0000","last_undegraded":"2023-10-03T10:10:37.652375+0000","last_fullsized":"2023-10-03T10:10:37.652375+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.658185+0000","last_change":"2023-10-03T10:09:46.003890+0000","last_active":"2023-10-03T10:10:37.658185+0000","last_peered":"2023-10-03T10:10:37.658185+0000","last_clean":"2023-10-03T10:10:37.658185+0000","last_became_active":"2023-10-03T10:09:46.002821+0000","last_became_peered":"2023-10-03T10:09:46.002821+0000","last_unstale":"2023-10-03T10:10:37.658185+0000","last_undegraded":"2023-10-03T10:10:37.658185+0000","last_fullsized":"2023-10-03T10:10:37.658185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651527+0000","last_change":"2023-10-03T10:09:46.383127+0000","last_active":"2023-10-03T10:10:37.651527+0000","last_peered":"2023-10-03T10:10:37.651527+0000","last_clean":"2023-10-03T10:10:37.651527+0000","last_became_active":"2023-10-03T10:09:46.374331+0000","last_became_peered":"2023-10-03T10:09:46.374331+0000","last_unstale":"2023-10-03T10:10:37.651527+0000","last_undegraded":"2023-10-03T10:10:37.651527+0000","last_fullsized":"2023-10-03T10:10:37.651527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651362+0000","last_change":"2023-10-03T10:09:46.002155+0000","last_active":"2023-10-03T10:10:37.651362+0000","last_peered":"2023-10-03T10:10:37.651362+0000","last_clean":"2023-10-03T10:10:37.651362+0000","last_became_active":"2023-10-03T10:09:46.001872+0000","last_became_peered":"2023-10-03T10:09:46.001872+0000","last_unstale":"2023-10-03T10:10:37.651362+0000","last_undegraded":"2023-10-03T10:10:37.651362+0000","last_fullsized":"2023-10-03T10:10:37.651362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654669+0000","last_change":"2023-10-03T10:09:46.378713+0000","last_active":"2023-10-03T10:10:37.654669+0000","last_peered":"2023-10-03T10:10:37.654669+0000","last_clean":"2023-10-03T10:10:37.654669+0000","last_became_active":"2023-10-03T10:09:46.378310+0000","last_became_peered":"2023-10-03T10:09:46.378310+0000","last_unstale":"2023-10-03T10:10:37.654669+0000","last_undegraded":"2023-10-03T10:10:37.654669+0000","last_fullsized":"2023-10-03T10:10:37.654669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.656233+0000","last_change":"2023-10-03T10:09:46.001705+0000","last_active":"2023-10-03T10:10:37.656233+0000","last_peered":"2023-10-03T10:10:37.656233+0000","last_clean":"2023-10-03T10:10:37.656233+0000","last_became_active":"2023-10-03T10:09:46.001338+0000","last_became_peered":"2023-10-03T10:09:46.001338+0000","last_unstale":"2023-10-03T10:10:37.656233+0000","last_undegraded":"2023-10-03T10:10:37.656233+0000","last_fullsized":"2023-10-03T10:10:37.656233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654805+0000","last_change":"2023-10-03T10:09:46.392590+0000","last_active":"2023-10-03T10:10:37.654805+0000","last_peered":"2023-10-03T10:10:37.654805+0000","last_clean":"2023-10-03T10:10:37.654805+0000","last_became_active":"2023-10-03T10:09:46.392268+0000","last_became_peered":"2023-10-03T10:09:46.392268+0000","last_unstale":"2023-10-03T10:10:37.654805+0000","last_undegraded":"2023-10-03T10:10:37.654805+0000","last_fullsized":"2023-10-03T10:10:37.654805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'12","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:12:06.153467+0000","last_change":"2023-10-03T10:09:45.995310+0000","last_active":"2023-10-03T10:12:06.153467+0000","last_peered":"2023-10-03T10:12:06.153467+0000","last_clean":"2023-10-03T10:12:06.153467+0000","last_became_active":"2023-10-03T10:09:45.995040+0000","last_became_peered":"2023-10-03T10:09:45.995040+0000","last_unstale":"2023-10-03T10:12:06.153467+0000","last_undegraded":"2023-10-03T10:12:06.153467+0000","last_fullsized":"2023-10-03T10:12:06.153467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651092+0000","last_change":"2023-10-03T10:09:46.385651+0000","last_active":"2023-10-03T10:10:37.651092+0000","last_peered":"2023-10-03T10:10:37.651092+0000","last_clean":"2023-10-03T10:10:37.651092+0000","last_became_active":"2023-10-03T10:09:46.383900+0000","last_became_peered":"2023-10-03T10:09:46.383900+0000","last_unstale":"2023-10-03T10:10:37.651092+0000","last_undegraded":"2023-10-03T10:10:37.651092+0000","last_fullsized":"2023-10-03T10:10:37.651092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654292+0000","last_change":"2023-10-03T10:09:46.008019+0000","last_active":"2023-10-03T10:10:37.654292+0000","last_peered":"2023-10-03T10:10:37.654292+0000","last_clean":"2023-10-03T10:10:37.654292+0000","last_became_active":"2023-10-03T10:09:46.007374+0000","last_became_peered":"2023-10-03T10:09:46.007374+0000","last_unstale":"2023-10-03T10:10:37.654292+0000","last_undegraded":"2023-10-03T10:10:37.654292+0000","last_fullsized":"2023-10-03T10:10:37.654292+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651575+0000","last_change":"2023-10-03T10:09:46.382625+0000","last_active":"2023-10-03T10:10:37.651575+0000","last_peered":"2023-10-03T10:10:37.651575+0000","last_clean":"2023-10-03T10:10:37.651575+0000","last_became_active":"2023-10-03T10:09:46.382352+0000","last_became_peered":"2023-10-03T10:09:46.382352+0000","last_unstale":"2023-10-03T10:10:37.651575+0000","last_undegraded":"2023-10-03T10:10:37.651575+0000","last_fullsized":"2023-10-03T10:10:37.651575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655644+0000","last_change":"2023-10-03T10:09:45.999722+0000","last_active":"2023-10-03T10:10:37.655644+0000","last_peered":"2023-10-03T10:10:37.655644+0000","last_clean":"2023-10-03T10:10:37.655644+0000","last_became_active":"2023-10-03T10:09:45.999450+0000","last_became_peered":"2023-10-03T10:09:45.999450+0000","last_unstale":"2023-10-03T10:10:37.655644+0000","last_undegraded":"2023-10-03T10:10:37.655644+0000","last_fullsized":"2023-10-03T10:10:37.655644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651065+0000","last_change":"2023-10-03T10:09:46.384495+0000","last_active":"2023-10-03T10:10:37.651065+0000","last_peered":"2023-10-03T10:10:37.651065+0000","last_clean":"2023-10-03T10:10:37.651065+0000","last_became_active":"2023-10-03T10:09:46.383160+0000","last_became_peered":"2023-10-03T10:09:46.383160+0000","last_unstale":"2023-10-03T10:10:37.651065+0000","last_undegraded":"2023-10-03T10:10:37.651065+0000","last_fullsized":"2023-10-03T10:10:37.651065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654593+0000","last_change":"2023-10-03T10:09:46.002469+0000","last_active":"2023-10-03T10:10:37.654593+0000","last_peered":"2023-10-03T10:10:37.654593+0000","last_clean":"2023-10-03T10:10:37.654593+0000","last_became_active":"2023-10-03T10:09:46.002179+0000","last_became_peered":"2023-10-03T10:09:46.002179+0000","last_unstale":"2023-10-03T10:10:37.654593+0000","last_undegraded":"2023-10-03T10:10:37.654593+0000","last_fullsized":"2023-10-03T10:10:37.654593+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657652+0000","last_change":"2023-10-03T10:09:46.379295+0000","last_active":"2023-10-03T10:10:37.657652+0000","last_peered":"2023-10-03T10:10:37.657652+0000","last_clean":"2023-10-03T10:10:37.657652+0000","last_became_active":"2023-10-03T10:09:46.370639+0000","last_became_peered":"2023-10-03T10:09:46.370639+0000","last_unstale":"2023-10-03T10:10:37.657652+0000","last_undegraded":"2023-10-03T10:10:37.657652+0000","last_fullsized":"2023-10-03T10:10:37.657652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654470+0000","last_change":"2023-10-03T10:09:45.991739+0000","last_active":"2023-10-03T10:10:37.654470+0000","last_peered":"2023-10-03T10:10:37.654470+0000","last_clean":"2023-10-03T10:10:37.654470+0000","last_became_active":"2023-10-03T10:09:45.991195+0000","last_became_peered":"2023-10-03T10:09:45.991195+0000","last_unstale":"2023-10-03T10:10:37.654470+0000","last_undegraded":"2023-10-03T10:10:37.654470+0000","last_fullsized":"2023-10-03T10:10:37.654470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.660080+0000","last_change":"2023-10-03T10:10:37.656679+0000","last_active":"2023-10-03T10:10:37.660080+0000","last_peered":"2023-10-03T10:10:37.660080+0000","last_clean":"2023-10-03T10:10:37.660080+0000","last_became_active":"2023-10-03T10:10:37.656372+0000","last_became_peered":"2023-10-03T10:10:37.656372+0000","last_unstale":"2023-10-03T10:10:37.660080+0000","last_undegraded":"2023-10-03T10:10:37.660080+0000","last_fullsized":"2023-10-03T10:10:37.660080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.658039+0000","last_change":"2023-10-03T10:09:46.004494+0000","last_active":"2023-10-03T10:10:37.658039+0000","last_peered":"2023-10-03T10:10:37.658039+0000","last_clean":"2023-10-03T10:10:37.658039+0000","last_became_active":"2023-10-03T10:09:46.004166+0000","last_became_peered":"2023-10-03T10:09:46.004166+0000","last_unstale":"2023-10-03T10:10:37.658039+0000","last_undegraded":"2023-10-03T10:10:37.658039+0000","last_fullsized":"2023-10-03T10:10:37.658039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651613+0000","last_change":"2023-10-03T10:09:46.383361+0000","last_active":"2023-10-03T10:10:37.651613+0000","last_peered":"2023-10-03T10:10:37.651613+0000","last_clean":"2023-10-03T10:10:37.651613+0000","last_became_active":"2023-10-03T10:09:46.378076+0000","last_became_peered":"2023-10-03T10:09:46.378076+0000","last_unstale":"2023-10-03T10:10:37.651613+0000","last_undegraded":"2023-10-03T10:10:37.651613+0000","last_fullsized":"2023-10-03T10:10:37.651613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651443+0000","last_change":"2023-10-03T10:09:45.995572+0000","last_active":"2023-10-03T10:10:37.651443+0000","last_peered":"2023-10-03T10:10:37.651443+0000","last_clean":"2023-10-03T10:10:37.651443+0000","last_became_active":"2023-10-03T10:09:45.995093+0000","last_became_peered":"2023-10-03T10:09:45.995093+0000","last_unstale":"2023-10-03T10:10:37.651443+0000","last_undegraded":"2023-10-03T10:10:37.651443+0000","last_fullsized":"2023-10-03T10:10:37.651443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654565+0000","last_change":"2023-10-03T10:09:46.362868+0000","last_active":"2023-10-03T10:10:37.654565+0000","last_peered":"2023-10-03T10:10:37.654565+0000","last_clean":"2023-10-03T10:10:37.654565+0000","last_became_active":"2023-10-03T10:09:46.362550+0000","last_became_peered":"2023-10-03T10:09:46.362550+0000","last_unstale":"2023-10-03T10:10:37.654565+0000","last_undegraded":"2023-10-03T10:10:37.654565+0000","last_fullsized":"2023-10-03T10:10:37.654565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652184+0000","last_change":"2023-10-03T10:09:46.007310+0000","last_active":"2023-10-03T10:10:37.652184+0000","last_peered":"2023-10-03T10:10:37.652184+0000","last_clean":"2023-10-03T10:10:37.652184+0000","last_became_active":"2023-10-03T10:09:46.007002+0000","last_became_peered":"2023-10-03T10:09:46.007002+0000","last_unstale":"2023-10-03T10:10:37.652184+0000","last_undegraded":"2023-10-03T10:10:37.652184+0000","last_fullsized":"2023-10-03T10:10:37.652184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.650843+0000","last_change":"2023-10-03T10:09:46.387104+0000","last_active":"2023-10-03T10:10:37.650843+0000","last_peered":"2023-10-03T10:10:37.650843+0000","last_clean":"2023-10-03T10:10:37.650843+0000","last_became_active":"2023-10-03T10:09:46.386697+0000","last_became_peered":"2023-10-03T10:09:46.386697+0000","last_unstale":"2023-10-03T10:10:37.650843+0000","last_undegraded":"2023-10-03T10:10:37.650843+0000","last_fullsized":"2023-10-03T10:10:37.650843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.656050+0000","last_change":"2023-10-03T10:09:46.001474+0000","last_active":"2023-10-03T10:10:37.656050+0000","last_peered":"2023-10-03T10:10:37.656050+0000","last_clean":"2023-10-03T10:10:37.656050+0000","last_became_active":"2023-10-03T10:09:46.001185+0000","last_became_peered":"2023-10-03T10:09:46.001185+0000","last_unstale":"2023-10-03T10:10:37.656050+0000","last_undegraded":"2023-10-03T10:10:37.656050+0000","last_fullsized":"2023-10-03T10:10:37.656050+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657325+0000","last_change":"2023-10-03T10:09:46.378394+0000","last_active":"2023-10-03T10:10:37.657325+0000","last_peered":"2023-10-03T10:10:37.657325+0000","last_clean":"2023-10-03T10:10:37.657325+0000","last_became_active":"2023-10-03T10:09:46.378115+0000","last_became_peered":"2023-10-03T10:09:46.378115+0000","last_unstale":"2023-10-03T10:10:37.657325+0000","last_undegraded":"2023-10-03T10:10:37.657325+0000","last_fullsized":"2023-10-03T10:10:37.657325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654125+0000","last_change":"2023-10-03T10:09:46.008210+0000","last_active":"2023-10-03T10:10:37.654125+0000","last_peered":"2023-10-03T10:10:37.654125+0000","last_clean":"2023-10-03T10:10:37.654125+0000","last_became_active":"2023-10-03T10:09:46.007750+0000","last_became_peered":"2023-10-03T10:09:46.007750+0000","last_unstale":"2023-10-03T10:10:37.654125+0000","last_undegraded":"2023-10-03T10:10:37.654125+0000","last_fullsized":"2023-10-03T10:10:37.654125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655974+0000","last_change":"2023-10-03T10:09:46.385399+0000","last_active":"2023-10-03T10:10:37.655974+0000","last_peered":"2023-10-03T10:10:37.655974+0000","last_clean":"2023-10-03T10:10:37.655974+0000","last_became_active":"2023-10-03T10:09:46.385110+0000","last_became_peered":"2023-10-03T10:09:46.385110+0000","last_unstale":"2023-10-03T10:10:37.655974+0000","last_undegraded":"2023-10-03T10:10:37.655974+0000","last_fullsized":"2023-10-03T10:10:37.655974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652518+0000","last_change":"2023-10-03T10:09:46.007708+0000","last_active":"2023-10-03T10:10:37.652518+0000","last_peered":"2023-10-03T10:10:37.652518+0000","last_clean":"2023-10-03T10:10:37.652518+0000","last_became_active":"2023-10-03T10:09:46.006141+0000","last_became_peered":"2023-10-03T10:09:46.006141+0000","last_unstale":"2023-10-03T10:10:37.652518+0000","last_undegraded":"2023-10-03T10:10:37.652518+0000","last_fullsized":"2023-10-03T10:10:37.652518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651125+0000","last_change":"2023-10-03T10:09:46.367623+0000","last_active":"2023-10-03T10:10:37.651125+0000","last_peered":"2023-10-03T10:10:37.651125+0000","last_clean":"2023-10-03T10:10:37.651125+0000","last_became_active":"2023-10-03T10:09:46.367337+0000","last_became_peered":"2023-10-03T10:09:46.367337+0000","last_unstale":"2023-10-03T10:10:37.651125+0000","last_undegraded":"2023-10-03T10:10:37.651125+0000","last_fullsized":"2023-10-03T10:10:37.651125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651919+0000","last_change":"2023-10-03T10:09:46.002433+0000","last_active":"2023-10-03T10:10:37.651919+0000","last_peered":"2023-10-03T10:10:37.651919+0000","last_clean":"2023-10-03T10:10:37.651919+0000","last_became_active":"2023-10-03T10:09:46.002135+0000","last_became_peered":"2023-10-03T10:09:46.002135+0000","last_unstale":"2023-10-03T10:10:37.651919+0000","last_undegraded":"2023-10-03T10:10:37.651919+0000","last_fullsized":"2023-10-03T10:10:37.651919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651518+0000","last_change":"2023-10-03T10:09:46.387220+0000","last_active":"2023-10-03T10:10:37.651518+0000","last_peered":"2023-10-03T10:10:37.651518+0000","last_clean":"2023-10-03T10:10:37.651518+0000","last_became_active":"2023-10-03T10:09:46.384091+0000","last_became_peered":"2023-10-03T10:09:46.384091+0000","last_unstale":"2023-10-03T10:10:37.651518+0000","last_undegraded":"2023-10-03T10:10:37.651518+0000","last_fullsized":"2023-10-03T10:10:37.651518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651053+0000","last_change":"2023-10-03T10:09:46.008899+0000","last_active":"2023-10-03T10:10:37.651053+0000","last_peered":"2023-10-03T10:10:37.651053+0000","last_clean":"2023-10-03T10:10:37.651053+0000","last_became_active":"2023-10-03T10:09:46.006123+0000","last_became_peered":"2023-10-03T10:09:46.006123+0000","last_unstale":"2023-10-03T10:10:37.651053+0000","last_undegraded":"2023-10-03T10:10:37.651053+0000","last_fullsized":"2023-10-03T10:10:37.651053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.662605+0000","last_change":"2023-10-03T10:10:37.660052+0000","last_active":"2023-10-03T10:10:37.662605+0000","last_peered":"2023-10-03T10:10:37.662605+0000","last_clean":"2023-10-03T10:10:37.662605+0000","last_became_active":"2023-10-03T10:10:37.659823+0000","last_became_peered":"2023-10-03T10:10:37.659823+0000","last_unstale":"2023-10-03T10:10:37.662605+0000","last_undegraded":"2023-10-03T10:10:37.662605+0000","last_fullsized":"2023-10-03T10:10:37.662605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655613+0000","last_change":"2023-10-03T10:09:42.503202+0000","last_active":"2023-10-03T10:10:37.655613+0000","last_peered":"2023-10-03T10:10:37.655613+0000","last_clean":"2023-10-03T10:10:37.655613+0000","last_became_active":"2023-10-03T10:09:42.502700+0000","last_became_peered":"2023-10-03T10:09:42.502700+0000","last_unstale":"2023-10-03T10:10:37.655613+0000","last_undegraded":"2023-10-03T10:10:37.655613+0000","last_fullsized":"2023-10-03T10:10:37.655613+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651140+0000","last_change":"2023-10-03T10:09:45.995268+0000","last_active":"2023-10-03T10:10:37.651140+0000","last_peered":"2023-10-03T10:10:37.651140+0000","last_clean":"2023-10-03T10:10:37.651140+0000","last_became_active":"2023-10-03T10:09:45.994970+0000","last_became_peered":"2023-10-03T10:09:45.994970+0000","last_unstale":"2023-10-03T10:10:37.651140+0000","last_undegraded":"2023-10-03T10:10:37.651140+0000","last_fullsized":"2023-10-03T10:10:37.651140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654764+0000","last_change":"2023-10-03T10:09:46.393198+0000","last_active":"2023-10-03T10:10:37.654764+0000","last_peered":"2023-10-03T10:10:37.654764+0000","last_clean":"2023-10-03T10:10:37.654764+0000","last_became_active":"2023-10-03T10:09:46.392876+0000","last_became_peered":"2023-10-03T10:09:46.392876+0000","last_unstale":"2023-10-03T10:10:37.654764+0000","last_undegraded":"2023-10-03T10:10:37.654764+0000","last_fullsized":"2023-10-03T10:10:37.654764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652589+0000","last_change":"2023-10-03T10:09:41.940609+0000","last_active":"2023-10-03T10:10:37.652589+0000","last_peered":"2023-10-03T10:10:37.652589+0000","last_clean":"2023-10-03T10:10:37.652589+0000","last_became_active":"2023-10-03T10:09:41.940313+0000","last_became_peered":"2023-10-03T10:09:41.940313+0000","last_unstale":"2023-10-03T10:10:37.652589+0000","last_undegraded":"2023-10-03T10:10:37.652589+0000","last_fullsized":"2023-10-03T10:10:37.652589+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657073+0000","last_change":"2023-10-03T10:09:45.987289+0000","last_active":"2023-10-03T10:10:37.657073+0000","last_peered":"2023-10-03T10:10:37.657073+0000","last_clean":"2023-10-03T10:10:37.657073+0000","last_became_active":"2023-10-03T10:09:45.987013+0000","last_became_peered":"2023-10-03T10:09:45.987013+0000","last_unstale":"2023-10-03T10:10:37.657073+0000","last_undegraded":"2023-10-03T10:10:37.657073+0000","last_fullsized":"2023-10-03T10:10:37.657073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655387+0000","last_change":"2023-10-03T10:09:46.371416+0000","last_active":"2023-10-03T10:10:37.655387+0000","last_peered":"2023-10-03T10:10:37.655387+0000","last_clean":"2023-10-03T10:10:37.655387+0000","last_became_active":"2023-10-03T10:09:46.370977+0000","last_became_peered":"2023-10-03T10:09:46.370977+0000","last_unstale":"2023-10-03T10:10:37.655387+0000","last_undegraded":"2023-10-03T10:10:37.655387+0000","last_fullsized":"2023-10-03T10:10:37.655387+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651017+0000","last_change":"2023-10-03T10:09:41.940436+0000","last_active":"2023-10-03T10:10:37.651017+0000","last_peered":"2023-10-03T10:10:37.651017+0000","last_clean":"2023-10-03T10:10:37.651017+0000","last_became_active":"2023-10-03T10:09:41.940147+0000","last_became_peered":"2023-10-03T10:09:41.940147+0000","last_unstale":"2023-10-03T10:10:37.651017+0000","last_undegraded":"2023-10-03T10:10:37.651017+0000","last_fullsized":"2023-10-03T10:10:37.651017+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654378+0000","last_change":"2023-10-03T10:09:45.994184+0000","last_active":"2023-10-03T10:10:37.654378+0000","last_peered":"2023-10-03T10:10:37.654378+0000","last_clean":"2023-10-03T10:10:37.654378+0000","last_became_active":"2023-10-03T10:09:45.993699+0000","last_became_peered":"2023-10-03T10:09:45.993699+0000","last_unstale":"2023-10-03T10:10:37.654378+0000","last_undegraded":"2023-10-03T10:10:37.654378+0000","last_fullsized":"2023-10-03T10:10:37.654378+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.662517+0000","last_change":"2023-10-03T10:10:37.659967+0000","last_active":"2023-10-03T10:10:37.662517+0000","last_peered":"2023-10-03T10:10:37.662517+0000","last_clean":"2023-10-03T10:10:37.662517+0000","last_became_active":"2023-10-03T10:10:37.659665+0000","last_became_peered":"2023-10-03T10:10:37.659665+0000","last_unstale":"2023-10-03T10:10:37.662517+0000","last_undegraded":"2023-10-03T10:10:37.662517+0000","last_fullsized":"2023-10-03T10:10:37.662517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654208+0000","last_change":"2023-10-03T10:09:41.941185+0000","last_active":"2023-10-03T10:10:37.654208+0000","last_peered":"2023-10-03T10:10:37.654208+0000","last_clean":"2023-10-03T10:10:37.654208+0000","last_became_active":"2023-10-03T10:09:41.940930+0000","last_became_peered":"2023-10-03T10:09:41.940930+0000","last_unstale":"2023-10-03T10:10:37.654208+0000","last_undegraded":"2023-10-03T10:10:37.654208+0000","last_fullsized":"2023-10-03T10:10:37.654208+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654296+0000","last_change":"2023-10-03T10:09:40.948442+0000","last_active":"2023-10-03T10:10:37.654296+0000","last_peered":"2023-10-03T10:10:37.654296+0000","last_clean":"2023-10-03T10:10:37.654296+0000","last_became_active":"2023-10-03T10:09:40.948068+0000","last_became_peered":"2023-10-03T10:09:40.948068+0000","last_unstale":"2023-10-03T10:10:37.654296+0000","last_undegraded":"2023-10-03T10:10:37.654296+0000","last_fullsized":"2023-10-03T10:10:37.654296+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_clean_scrub_stamp":"2023-10-03T10:09:39.928111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652438+0000","last_change":"2023-10-03T10:09:45.999685+0000","last_active":"2023-10-03T10:10:37.652438+0000","last_peered":"2023-10-03T10:10:37.652438+0000","last_clean":"2023-10-03T10:10:37.652438+0000","last_became_active":"2023-10-03T10:09:45.999343+0000","last_became_peered":"2023-10-03T10:09:45.999343+0000","last_unstale":"2023-10-03T10:10:37.652438+0000","last_undegraded":"2023-10-03T10:10:37.652438+0000","last_fullsized":"2023-10-03T10:10:37.652438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652460+0000","last_change":"2023-10-03T10:09:46.367761+0000","last_active":"2023-10-03T10:10:37.652460+0000","last_peered":"2023-10-03T10:10:37.652460+0000","last_clean":"2023-10-03T10:10:37.652460+0000","last_became_active":"2023-10-03T10:09:46.367362+0000","last_became_peered":"2023-10-03T10:09:46.367362+0000","last_unstale":"2023-10-03T10:10:37.652460+0000","last_undegraded":"2023-10-03T10:10:37.652460+0000","last_fullsized":"2023-10-03T10:10:37.652460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651289+0000","last_change":"2023-10-03T10:09:41.940561+0000","last_active":"2023-10-03T10:10:37.651289+0000","last_peered":"2023-10-03T10:10:37.651289+0000","last_clean":"2023-10-03T10:10:37.651289+0000","last_became_active":"2023-10-03T10:09:41.940202+0000","last_became_peered":"2023-10-03T10:09:41.940202+0000","last_unstale":"2023-10-03T10:10:37.651289+0000","last_undegraded":"2023-10-03T10:10:37.651289+0000","last_fullsized":"2023-10-03T10:10:37.651289+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.656637+0000","last_change":"2023-10-03T10:09:45.987278+0000","last_active":"2023-10-03T10:10:37.656637+0000","last_peered":"2023-10-03T10:10:37.656637+0000","last_clean":"2023-10-03T10:10:37.656637+0000","last_became_active":"2023-10-03T10:09:45.986993+0000","last_became_peered":"2023-10-03T10:09:45.986993+0000","last_unstale":"2023-10-03T10:10:37.656637+0000","last_undegraded":"2023-10-03T10:10:37.656637+0000","last_fullsized":"2023-10-03T10:10:37.656637+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657704+0000","last_change":"2023-10-03T10:09:46.378722+0000","last_active":"2023-10-03T10:10:37.657704+0000","last_peered":"2023-10-03T10:10:37.657704+0000","last_clean":"2023-10-03T10:10:37.657704+0000","last_became_active":"2023-10-03T10:09:46.378186+0000","last_became_peered":"2023-10-03T10:09:46.378186+0000","last_unstale":"2023-10-03T10:10:37.657704+0000","last_undegraded":"2023-10-03T10:10:37.657704+0000","last_fullsized":"2023-10-03T10:10:37.657704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.653935+0000","last_change":"2023-10-03T10:09:42.502984+0000","last_active":"2023-10-03T10:10:37.653935+0000","last_peered":"2023-10-03T10:10:37.653935+0000","last_clean":"2023-10-03T10:10:37.653935+0000","last_became_active":"2023-10-03T10:09:42.502699+0000","last_became_peered":"2023-10-03T10:09:42.502699+0000","last_unstale":"2023-10-03T10:10:37.653935+0000","last_undegraded":"2023-10-03T10:10:37.653935+0000","last_fullsized":"2023-10-03T10:10:37.653935+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655305+0000","last_change":"2023-10-03T10:09:45.995626+0000","last_active":"2023-10-03T10:10:37.655305+0000","last_peered":"2023-10-03T10:10:37.655305+0000","last_clean":"2023-10-03T10:10:37.655305+0000","last_became_active":"2023-10-03T10:09:45.995322+0000","last_became_peered":"2023-10-03T10:09:45.995322+0000","last_unstale":"2023-10-03T10:10:37.655305+0000","last_undegraded":"2023-10-03T10:10:37.655305+0000","last_fullsized":"2023-10-03T10:10:37.655305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657246+0000","last_change":"2023-10-03T10:09:46.371217+0000","last_active":"2023-10-03T10:10:37.657246+0000","last_peered":"2023-10-03T10:10:37.657246+0000","last_clean":"2023-10-03T10:10:37.657246+0000","last_became_active":"2023-10-03T10:09:46.370285+0000","last_became_peered":"2023-10-03T10:09:46.370285+0000","last_unstale":"2023-10-03T10:10:37.657246+0000","last_undegraded":"2023-10-03T10:10:37.657246+0000","last_fullsized":"2023-10-03T10:10:37.657246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652066+0000","last_change":"2023-10-03T10:09:46.006819+0000","last_active":"2023-10-03T10:10:37.652066+0000","last_peered":"2023-10-03T10:10:37.652066+0000","last_clean":"2023-10-03T10:10:37.652066+0000","last_became_active":"2023-10-03T10:09:46.006524+0000","last_became_peered":"2023-10-03T10:09:46.006524+0000","last_unstale":"2023-10-03T10:10:37.652066+0000","last_undegraded":"2023-10-03T10:10:37.652066+0000","last_fullsized":"2023-10-03T10:10:37.652066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655921+0000","last_change":"2023-10-03T10:09:42.503022+0000","last_active":"2023-10-03T10:10:37.655921+0000","last_peered":"2023-10-03T10:10:37.655921+0000","last_clean":"2023-10-03T10:10:37.655921+0000","last_became_active":"2023-10-03T10:09:42.502739+0000","last_became_peered":"2023-10-03T10:09:42.502739+0000","last_unstale":"2023-10-03T10:10:37.655921+0000","last_undegraded":"2023-10-03T10:10:37.655921+0000","last_fullsized":"2023-10-03T10:10:37.655921+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.665224+0000","last_change":"2023-10-03T10:10:37.660762+0000","last_active":"2023-10-03T10:10:37.665224+0000","last_peered":"2023-10-03T10:10:37.665224+0000","last_clean":"2023-10-03T10:10:37.665224+0000","last_became_active":"2023-10-03T10:10:37.660480+0000","last_became_peered":"2023-10-03T10:10:37.660480+0000","last_unstale":"2023-10-03T10:10:37.665224+0000","last_undegraded":"2023-10-03T10:10:37.665224+0000","last_fullsized":"2023-10-03T10:10:37.665224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652281+0000","last_change":"2023-10-03T10:09:42.503368+0000","last_active":"2023-10-03T10:10:37.652281+0000","last_peered":"2023-10-03T10:10:37.652281+0000","last_clean":"2023-10-03T10:10:37.652281+0000","last_became_active":"2023-10-03T10:09:42.503090+0000","last_became_peered":"2023-10-03T10:09:42.503090+0000","last_unstale":"2023-10-03T10:10:37.652281+0000","last_undegraded":"2023-10-03T10:10:37.652281+0000","last_fullsized":"2023-10-03T10:10:37.652281+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657560+0000","last_change":"2023-10-03T10:09:46.003516+0000","last_active":"2023-10-03T10:10:37.657560+0000","last_peered":"2023-10-03T10:10:37.657560+0000","last_clean":"2023-10-03T10:10:37.657560+0000","last_became_active":"2023-10-03T10:09:46.003227+0000","last_became_peered":"2023-10-03T10:09:46.003227+0000","last_unstale":"2023-10-03T10:10:37.657560+0000","last_undegraded":"2023-10-03T10:10:37.657560+0000","last_fullsized":"2023-10-03T10:10:37.657560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.650881+0000","last_change":"2023-10-03T10:09:46.365107+0000","last_active":"2023-10-03T10:10:37.650881+0000","last_peered":"2023-10-03T10:10:37.650881+0000","last_clean":"2023-10-03T10:10:37.650881+0000","last_became_active":"2023-10-03T10:09:46.364877+0000","last_became_peered":"2023-10-03T10:09:46.364877+0000","last_unstale":"2023-10-03T10:10:37.650881+0000","last_undegraded":"2023-10-03T10:10:37.650881+0000","last_fullsized":"2023-10-03T10:10:37.650881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657161+0000","last_change":"2023-10-03T10:09:46.003786+0000","last_active":"2023-10-03T10:10:37.657161+0000","last_peered":"2023-10-03T10:10:37.657161+0000","last_clean":"2023-10-03T10:10:37.657161+0000","last_became_active":"2023-10-03T10:09:46.003506+0000","last_became_peered":"2023-10-03T10:09:46.003506+0000","last_unstale":"2023-10-03T10:10:37.657161+0000","last_undegraded":"2023-10-03T10:10:37.657161+0000","last_fullsized":"2023-10-03T10:10:37.657161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651178+0000","last_change":"2023-10-03T10:09:46.376808+0000","last_active":"2023-10-03T10:10:37.651178+0000","last_peered":"2023-10-03T10:10:37.651178+0000","last_clean":"2023-10-03T10:10:37.651178+0000","last_became_active":"2023-10-03T10:09:46.376414+0000","last_became_peered":"2023-10-03T10:09:46.376414+0000","last_unstale":"2023-10-03T10:10:37.651178+0000","last_undegraded":"2023-10-03T10:10:37.651178+0000","last_fullsized":"2023-10-03T10:10:37.651178+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655467+0000","last_change":"2023-10-03T10:09:45.992104+0000","last_active":"2023-10-03T10:10:37.655467+0000","last_peered":"2023-10-03T10:10:37.655467+0000","last_clean":"2023-10-03T10:10:37.655467+0000","last_became_active":"2023-10-03T10:09:45.991796+0000","last_became_peered":"2023-10-03T10:09:45.991796+0000","last_unstale":"2023-10-03T10:10:37.655467+0000","last_undegraded":"2023-10-03T10:10:37.655467+0000","last_fullsized":"2023-10-03T10:10:37.655467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651173+0000","last_change":"2023-10-03T10:09:46.384662+0000","last_active":"2023-10-03T10:10:37.651173+0000","last_peered":"2023-10-03T10:10:37.651173+0000","last_clean":"2023-10-03T10:10:37.651173+0000","last_became_active":"2023-10-03T10:09:46.384347+0000","last_became_peered":"2023-10-03T10:09:46.384347+0000","last_unstale":"2023-10-03T10:10:37.651173+0000","last_undegraded":"2023-10-03T10:10:37.651173+0000","last_fullsized":"2023-10-03T10:10:37.651173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652273+0000","last_change":"2023-10-03T10:09:46.005018+0000","last_active":"2023-10-03T10:10:37.652273+0000","last_peered":"2023-10-03T10:10:37.652273+0000","last_clean":"2023-10-03T10:10:37.652273+0000","last_became_active":"2023-10-03T10:09:46.004611+0000","last_became_peered":"2023-10-03T10:09:46.004611+0000","last_unstale":"2023-10-03T10:10:37.652273+0000","last_undegraded":"2023-10-03T10:10:37.652273+0000","last_fullsized":"2023-10-03T10:10:37.652273+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.650783+0000","last_change":"2023-10-03T10:09:46.387130+0000","last_active":"2023-10-03T10:10:37.650783+0000","last_peered":"2023-10-03T10:10:37.650783+0000","last_clean":"2023-10-03T10:10:37.650783+0000","last_became_active":"2023-10-03T10:09:46.386801+0000","last_became_peered":"2023-10-03T10:09:46.386801+0000","last_unstale":"2023-10-03T10:10:37.650783+0000","last_undegraded":"2023-10-03T10:10:37.650783+0000","last_fullsized":"2023-10-03T10:10:37.650783+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651344+0000","last_change":"2023-10-03T10:09:45.998407+0000","last_active":"2023-10-03T10:10:37.651344+0000","last_peered":"2023-10-03T10:10:37.651344+0000","last_clean":"2023-10-03T10:10:37.651344+0000","last_became_active":"2023-10-03T10:09:45.995915+0000","last_became_peered":"2023-10-03T10:09:45.995915+0000","last_unstale":"2023-10-03T10:10:37.651344+0000","last_undegraded":"2023-10-03T10:10:37.651344+0000","last_fullsized":"2023-10-03T10:10:37.651344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651562+0000","last_change":"2023-10-03T10:09:46.385531+0000","last_active":"2023-10-03T10:10:37.651562+0000","last_peered":"2023-10-03T10:10:37.651562+0000","last_clean":"2023-10-03T10:10:37.651562+0000","last_became_active":"2023-10-03T10:09:46.385289+0000","last_became_peered":"2023-10-03T10:09:46.385289+0000","last_unstale":"2023-10-03T10:10:37.651562+0000","last_undegraded":"2023-10-03T10:10:37.651562+0000","last_fullsized":"2023-10-03T10:10:37.651562+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.658265+0000","last_change":"2023-10-03T10:09:46.004241+0000","last_active":"2023-10-03T10:10:37.658265+0000","last_peered":"2023-10-03T10:10:37.658265+0000","last_clean":"2023-10-03T10:10:37.658265+0000","last_became_active":"2023-10-03T10:09:46.003370+0000","last_became_peered":"2023-10-03T10:09:46.003370+0000","last_unstale":"2023-10-03T10:10:37.658265+0000","last_undegraded":"2023-10-03T10:10:37.658265+0000","last_fullsized":"2023-10-03T10:10:37.658265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.650623+0000","last_change":"2023-10-03T10:09:46.374808+0000","last_active":"2023-10-03T10:10:37.650623+0000","last_peered":"2023-10-03T10:10:37.650623+0000","last_clean":"2023-10-03T10:10:37.650623+0000","last_became_active":"2023-10-03T10:09:46.374363+0000","last_became_peered":"2023-10-03T10:09:46.374363+0000","last_unstale":"2023-10-03T10:10:37.650623+0000","last_undegraded":"2023-10-03T10:10:37.650623+0000","last_fullsized":"2023-10-03T10:10:37.650623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654535+0000","last_change":"2023-10-03T10:09:46.371026+0000","last_active":"2023-10-03T10:10:37.654535+0000","last_peered":"2023-10-03T10:10:37.654535+0000","last_clean":"2023-10-03T10:10:37.654535+0000","last_became_active":"2023-10-03T10:09:46.370725+0000","last_became_peered":"2023-10-03T10:09:46.370725+0000","last_unstale":"2023-10-03T10:10:37.654535+0000","last_undegraded":"2023-10-03T10:10:37.654535+0000","last_fullsized":"2023-10-03T10:10:37.654535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.662490+0000","last_change":"2023-10-03T10:10:37.660668+0000","last_active":"2023-10-03T10:10:37.662490+0000","last_peered":"2023-10-03T10:10:37.662490+0000","last_clean":"2023-10-03T10:10:37.662490+0000","last_became_active":"2023-10-03T10:10:37.660448+0000","last_became_peered":"2023-10-03T10:10:37.660448+0000","last_unstale":"2023-10-03T10:10:37.662490+0000","last_undegraded":"2023-10-03T10:10:37.662490+0000","last_fullsized":"2023-10-03T10:10:37.662490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655708+0000","last_change":"2023-10-03T10:09:46.385510+0000","last_active":"2023-10-03T10:10:37.655708+0000","last_peered":"2023-10-03T10:10:37.655708+0000","last_clean":"2023-10-03T10:10:37.655708+0000","last_became_active":"2023-10-03T10:09:46.385254+0000","last_became_peered":"2023-10-03T10:09:46.385254+0000","last_unstale":"2023-10-03T10:10:37.655708+0000","last_undegraded":"2023-10-03T10:10:37.655708+0000","last_fullsized":"2023-10-03T10:10:37.655708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654036+0000","last_change":"2023-10-03T10:09:46.370858+0000","last_active":"2023-10-03T10:10:37.654036+0000","last_peered":"2023-10-03T10:10:37.654036+0000","last_clean":"2023-10-03T10:10:37.654036+0000","last_became_active":"2023-10-03T10:09:46.367104+0000","last_became_peered":"2023-10-03T10:09:46.367104+0000","last_unstale":"2023-10-03T10:10:37.654036+0000","last_undegraded":"2023-10-03T10:10:37.654036+0000","last_fullsized":"2023-10-03T10:10:37.654036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655545+0000","last_change":"2023-10-03T10:09:46.371241+0000","last_active":"2023-10-03T10:10:37.655545+0000","last_peered":"2023-10-03T10:10:37.655545+0000","last_clean":"2023-10-03T10:10:37.655545+0000","last_became_active":"2023-10-03T10:09:46.370691+0000","last_became_peered":"2023-10-03T10:09:46.370691+0000","last_unstale":"2023-10-03T10:10:37.655545+0000","last_undegraded":"2023-10-03T10:10:37.655545+0000","last_fullsized":"2023-10-03T10:10:37.655545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705696,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297292,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074548,"statfs":{"total":96636764160,"available":96332337152,"internally_reserved":0,"allocated":200704,"data_stored":67217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:40 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29199999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"last":0.219},{"interface":"front","average":{"1min":0.314,"5min":0.308,"15min":0.307},"min":{"1min":0.246,"5min":0.192,"15min":0.192},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.27500000000000002}]},{"osd":1,"last update":"Tue Oct 3 10:11:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.24099999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.26300000000000001}]},{"osd":2,"last update":"Tue Oct 3 10:11:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.27500000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.313},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.34399999999999997,"15min":0.34499999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.254}]}]},{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":67023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:42 2023","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.26900000000000002,"15min":0.26700000000000002},"min":{"1min":0.20899999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.29899999999999999,"5min":0.28899999999999998,"15min":0.28699999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.25600000000000001}]},{"osd":1,"last update":"Tue Oct 3 10:11:42 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.314,"15min":0.314},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.42299999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.26800000000000002}]},{"osd":3,"last update":"Tue Oct 3 10:11:42 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.219},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.246}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":63191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 10:11:43 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.28899999999999998,"15min":0.28699999999999998},"min":{"1min":0.246,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.41999999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.316,"5min":0.30499999999999999,"15min":0.30299999999999999},"min":{"1min":0.248,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.66600000000000004}]},{"osd":2,"last update":"Tue Oct 3 10:11:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.312,"15min":0.31},"min":{"1min":0.253,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.44800000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.316},"min":{"1min":0.245,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.377}]},{"osd":3,"last update":"Tue Oct 3 10:11:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33000000000000002},"min":{"1min":0.30299999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.314,"15min":0.31},"min":{"1min":0.26700000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.59499999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705696,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":64106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:42 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.28999999999999998,"15min":0.28699999999999998},"min":{"1min":0.20799999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.44700000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.315},"min":{"1min":0.27400000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.35399999999999998}]},{"osd":2,"last update":"Tue Oct 3 10:11:42 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28000000000000003},"min":{"1min":0.23400000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.30399999999999999,"15min":0.29999999999999999},"min":{"1min":0.245,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.495,"5min":0.498,"15min":0.498},"last":0.33000000000000002}]},{"osd":3,"last update":"Tue Oct 3 10:11:42 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.29799999999999999,"15min":0.29599999999999999},"min":{"1min":0.23799999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.316,"15min":0.31},"min":{"1min":0.251,"5min":0.218,"15min":0.218},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.36899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:12:09.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:12:09.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.842+0000 7feac837f700 1 Processor -- start 2023-10-03T10:12:09.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.842+0000 7feac837f700 1 -- start start 2023-10-03T10:12:09.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.842+0000 7feac837f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feac009e1d0 0x7feac0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.842+0000 7feac837f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feac0139170 0x7feac013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.842+0000 7feac837f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac009b120 con 0x7feac009d6f0 2023-10-03T10:12:09.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.842+0000 7feac837f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac006b460 con 0x7feac009e1d0 2023-10-03T10:12:09.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.842+0000 7feac837f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feac009a7e0 con 0x7feac0139170 2023-10-03T10:12:09.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.842+0000 7feac611b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7feac009d6f0 0x7feac009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47924/0 (socket says 172.21.15.72:47924) 2023-10-03T10:12:09.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.842+0000 7feac611b700 1 -- 172.21.15.72:0/3855266328 learned_addr learned my addr 172.21.15.72:0/3855266328 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:09.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.842+0000 7feac691c700 1 --2- 172.21.15.72:0/3855266328 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feac0139170 0x7feac013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.842+0000 7feac591a700 1 --2- 172.21.15.72:0/3855266328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feac009e1d0 0x7feac0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.843+0000 7feac5119700 1 -- 172.21.15.72:0/3855266328 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475852452 0 0) 0x7feac009b120 con 0x7feac009d6f0 2023-10-03T10:12:09.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.843+0000 7feac591a700 1 -- 172.21.15.72:0/3855266328 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feac0139170 msgr2=0x7feac013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:09.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.843+0000 7feac591a700 1 --2- 172.21.15.72:0/3855266328 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feac0139170 0x7feac013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.843+0000 7feac591a700 1 -- 172.21.15.72:0/3855266328 >> v1:172.21.15.72:6789/0 conn(0x7feac009d6f0 legacy=0x7feac009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.843+0000 7feac591a700 1 -- 172.21.15.72:0/3855266328 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac009a500 con 0x7feac009e1d0 2023-10-03T10:12:09.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.843+0000 7feac691c700 1 --2- 172.21.15.72:0/3855266328 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feac0139170 0x7feac013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:09.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.843+0000 7feac591a700 1 --2- 172.21.15.72:0/3855266328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feac009e1d0 0x7feac0138c30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feabc009870 tx=0x7feabc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=219b9182d26e7cfe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.843+0000 7feac5119700 1 -- 172.21.15.72:0/3855266328 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc011830 con 0x7feac009e1d0 2023-10-03T10:12:09.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.843+0000 7feac5119700 1 -- 172.21.15.72:0/3855266328 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc011990 con 0x7feac009e1d0 2023-10-03T10:12:09.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.843+0000 7feac5119700 1 -- 172.21.15.72:0/3855266328 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc011d20 con 0x7feac009e1d0 2023-10-03T10:12:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.843+0000 7feac837f700 1 -- 172.21.15.72:0/3855266328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feac009e1d0 msgr2=0x7feac0138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.843+0000 7feac837f700 1 --2- 172.21.15.72:0/3855266328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feac009e1d0 0x7feac0138c30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feabc009870 tx=0x7feabc009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.844+0000 7feac837f700 1 -- 172.21.15.72:0/3855266328 shutdown_connections 2023-10-03T10:12:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.844+0000 7feac837f700 1 --2- 172.21.15.72:0/3855266328 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feac0139170 0x7feac013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.844+0000 7feac837f700 1 --2- 172.21.15.72:0/3855266328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feac009e1d0 0x7feac0138c30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.844+0000 7feac837f700 1 -- 172.21.15.72:0/3855266328 >> 172.21.15.72:0/3855266328 conn(0x7feac0066f50 msgr2=0x7feac009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.844+0000 7feac837f700 1 -- 172.21.15.72:0/3855266328 shutdown_connections 2023-10-03T10:12:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.844+0000 7feac837f700 1 -- 172.21.15.72:0/3855266328 wait complete. 2023-10-03T10:12:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.844+0000 7feac837f700 1 Processor -- start 2023-10-03T10:12:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.844+0000 7feac837f700 1 -- start start 2023-10-03T10:12:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac837f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac009d6f0 0x7feac0120770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac837f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feac009e1d0 0x7feac0120cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac837f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feac0139170 0x7feac01211f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac837f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac0122ba0 con 0x7feac009d6f0 2023-10-03T10:12:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac837f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac0136610 con 0x7feac009e1d0 2023-10-03T10:12:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac837f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feac009c710 con 0x7feac0139170 2023-10-03T10:12:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac611b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac009d6f0 0x7feac0120770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac591a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feac009e1d0 0x7feac0120cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac691c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feac0139170 0x7feac01211f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac611b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac009d6f0 0x7feac0120770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44064/0 (socket says 172.21.15.72:44064) 2023-10-03T10:12:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac691c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feac0139170 0x7feac01211f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47124/0 (socket says 172.21.15.72:47124) 2023-10-03T10:12:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac591a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feac009e1d0 0x7feac0120cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58040/0 (socket says 172.21.15.72:58040) 2023-10-03T10:12:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac611b700 1 -- 172.21.15.72:0/2287519550 learned_addr learned my addr 172.21.15.72:0/2287519550 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac691c700 1 -- 172.21.15.72:0/2287519550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feac009e1d0 msgr2=0x7feac0120cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac691c700 1 --2- 172.21.15.72:0/2287519550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feac009e1d0 0x7feac0120cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac691c700 1 -- 172.21.15.72:0/2287519550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac009d6f0 msgr2=0x7feac0120770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac691c700 1 --2- 172.21.15.72:0/2287519550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac009d6f0 0x7feac0120770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac691c700 1 -- 172.21.15.72:0/2287519550 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab8009a70 con 0x7feac0139170 2023-10-03T10:12:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac591a700 1 --2- 172.21.15.72:0/2287519550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feac009e1d0 0x7feac0120cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.845+0000 7feac691c700 1 --2- 172.21.15.72:0/2287519550 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feac0139170 0x7feac01211f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feab800efc0 tx=0x7feab800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.846+0000 7feab6ffd700 1 -- 172.21.15.72:0/2287519550 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab800ca90 con 0x7feac0139170 2023-10-03T10:12:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.846+0000 7feab6ffd700 1 -- 172.21.15.72:0/2287519550 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab800f040 con 0x7feac0139170 2023-10-03T10:12:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.846+0000 7feab6ffd700 1 -- 172.21.15.72:0/2287519550 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab800ce30 con 0x7feac0139170 2023-10-03T10:12:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.846+0000 7feac837f700 1 -- 172.21.15.72:0/2287519550 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feabc0094a0 con 0x7feac0139170 2023-10-03T10:12:09.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.846+0000 7feac837f700 1 -- 172.21.15.72:0/2287519550 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac0072150 con 0x7feac0139170 2023-10-03T10:12:09.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.846+0000 7feab6ffd700 1 -- 172.21.15.72:0/2287519550 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7feab8014480 con 0x7feac0139170 2023-10-03T10:12:09.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.847+0000 7feab6ffd700 1 -- 172.21.15.72:0/2287519550 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7feab8040170 con 0x7feac0139170 2023-10-03T10:12:09.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.847+0000 7feac837f700 1 -- 172.21.15.72:0/2287519550 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac0123e80 con 0x7feac0139170 2023-10-03T10:12:09.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:09.851+0000 7feab6ffd700 1 -- 172.21.15.72:0/2287519550 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feab8012930 con 0x7feac0139170 2023-10-03T10:12:10.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.034+0000 7feac837f700 1 -- 172.21.15.72:0/2287519550 --> v1:172.21.15.72:6816/126756 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feac006a9e0 con 0x7feaa402f480 2023-10-03T10:12:10.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.040+0000 7feab6ffd700 1 -- 172.21.15.72:0/2287519550 <== mgr.14102 v1:172.21.15.72:6816/126756 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270340 (unknown 2965378022 0 3867487099) 0x7feab00013b0 con 0x7feaa402f480 2023-10-03T10:12:10.044 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:10.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.044+0000 7feac837f700 1 -- 172.21.15.72:0/2287519550 >> v1:172.21.15.72:6816/126756 conn(0x7feaa402f480 legacy=0x7feaa4031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.044+0000 7feac837f700 1 -- 172.21.15.72:0/2287519550 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feac0139170 msgr2=0x7feac01211f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.044+0000 7feac837f700 1 --2- 172.21.15.72:0/2287519550 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feac0139170 0x7feac01211f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feab800efc0 tx=0x7feab800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.044+0000 7feac837f700 1 -- 172.21.15.72:0/2287519550 shutdown_connections 2023-10-03T10:12:10.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.044+0000 7feac837f700 1 --2- 172.21.15.72:0/2287519550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feac009d6f0 0x7feac0120770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.044+0000 7feac837f700 1 --2- 172.21.15.72:0/2287519550 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feac0139170 0x7feac01211f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.044+0000 7feac837f700 1 --2- 172.21.15.72:0/2287519550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feac009e1d0 0x7feac0120cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.044+0000 7feac837f700 1 -- 172.21.15.72:0/2287519550 >> 172.21.15.72:0/2287519550 conn(0x7feac0066f50 msgr2=0x7feac0136b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:10.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.044+0000 7feac837f700 1 -- 172.21.15.72:0/2287519550 shutdown_connections 2023-10-03T10:12:10.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.044+0000 7feac837f700 1 -- 172.21.15.72:0/2287519550 wait complete. 2023-10-03T10:12:10.047 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-03T10:12:10.056 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-10-03T10:12:08.090368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189132,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298228,"statfs":{"total":386547056640,"available":385329385472,"internally_reserved":0,"allocated":765952,"data_stored":261537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.998680"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651774+0000","last_change":"2023-10-03T10:09:46.383964+0000","last_active":"2023-10-03T10:10:37.651774+0000","last_peered":"2023-10-03T10:10:37.651774+0000","last_clean":"2023-10-03T10:10:37.651774+0000","last_became_active":"2023-10-03T10:09:46.383681+0000","last_became_peered":"2023-10-03T10:09:46.383681+0000","last_unstale":"2023-10-03T10:10:37.651774+0000","last_undegraded":"2023-10-03T10:10:37.651774+0000","last_fullsized":"2023-10-03T10:10:37.651774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651588+0000","last_change":"2023-10-03T10:09:46.369230+0000","last_active":"2023-10-03T10:10:37.651588+0000","last_peered":"2023-10-03T10:10:37.651588+0000","last_clean":"2023-10-03T10:10:37.651588+0000","last_became_active":"2023-10-03T10:09:46.368861+0000","last_became_peered":"2023-10-03T10:09:46.368861+0000","last_unstale":"2023-10-03T10:10:37.651588+0000","last_undegraded":"2023-10-03T10:10:37.651588+0000","last_fullsized":"2023-10-03T10:10:37.651588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.656316+0000","last_change":"2023-10-03T10:09:46.379410+0000","last_active":"2023-10-03T10:10:37.656316+0000","last_peered":"2023-10-03T10:10:37.656316+0000","last_clean":"2023-10-03T10:10:37.656316+0000","last_became_active":"2023-10-03T10:09:46.379027+0000","last_became_peered":"2023-10-03T10:09:46.379027+0000","last_unstale":"2023-10-03T10:10:37.656316+0000","last_undegraded":"2023-10-03T10:10:37.656316+0000","last_fullsized":"2023-10-03T10:10:37.656316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655796+0000","last_change":"2023-10-03T10:09:46.379505+0000","last_active":"2023-10-03T10:10:37.655796+0000","last_peered":"2023-10-03T10:10:37.655796+0000","last_clean":"2023-10-03T10:10:37.655796+0000","last_became_active":"2023-10-03T10:09:46.379187+0000","last_became_peered":"2023-10-03T10:09:46.379187+0000","last_unstale":"2023-10-03T10:10:37.655796+0000","last_undegraded":"2023-10-03T10:10:37.655796+0000","last_fullsized":"2023-10-03T10:10:37.655796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.665267+0000","last_change":"2023-10-03T10:10:37.661902+0000","last_active":"2023-10-03T10:10:37.665267+0000","last_peered":"2023-10-03T10:10:37.665267+0000","last_clean":"2023-10-03T10:10:37.665267+0000","last_became_active":"2023-10-03T10:10:37.661652+0000","last_became_peered":"2023-10-03T10:10:37.661652+0000","last_unstale":"2023-10-03T10:10:37.665267+0000","last_undegraded":"2023-10-03T10:10:37.665267+0000","last_fullsized":"2023-10-03T10:10:37.665267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652711+0000","last_change":"2023-10-03T10:09:46.385185+0000","last_active":"2023-10-03T10:10:37.652711+0000","last_peered":"2023-10-03T10:10:37.652711+0000","last_clean":"2023-10-03T10:10:37.652711+0000","last_became_active":"2023-10-03T10:09:46.384935+0000","last_became_peered":"2023-10-03T10:09:46.384935+0000","last_unstale":"2023-10-03T10:10:37.652711+0000","last_undegraded":"2023-10-03T10:10:37.652711+0000","last_fullsized":"2023-10-03T10:10:37.652711+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651640+0000","last_change":"2023-10-03T10:09:46.378880+0000","last_active":"2023-10-03T10:10:37.651640+0000","last_peered":"2023-10-03T10:10:37.651640+0000","last_clean":"2023-10-03T10:10:37.651640+0000","last_became_active":"2023-10-03T10:09:46.375285+0000","last_became_peered":"2023-10-03T10:09:46.375285+0000","last_unstale":"2023-10-03T10:10:37.651640+0000","last_undegraded":"2023-10-03T10:10:37.651640+0000","last_fullsized":"2023-10-03T10:10:37.651640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654218+0000","last_change":"2023-10-03T10:09:46.375928+0000","last_active":"2023-10-03T10:10:37.654218+0000","last_peered":"2023-10-03T10:10:37.654218+0000","last_clean":"2023-10-03T10:10:37.654218+0000","last_became_active":"2023-10-03T10:09:46.375325+0000","last_became_peered":"2023-10-03T10:09:46.375325+0000","last_unstale":"2023-10-03T10:10:37.654218+0000","last_undegraded":"2023-10-03T10:10:37.654218+0000","last_fullsized":"2023-10-03T10:10:37.654218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.658364+0000","last_change":"2023-10-03T10:09:46.379935+0000","last_active":"2023-10-03T10:10:37.658364+0000","last_peered":"2023-10-03T10:10:37.658364+0000","last_clean":"2023-10-03T10:10:37.658364+0000","last_became_active":"2023-10-03T10:09:46.379431+0000","last_became_peered":"2023-10-03T10:09:46.379431+0000","last_unstale":"2023-10-03T10:10:37.658364+0000","last_undegraded":"2023-10-03T10:10:37.658364+0000","last_fullsized":"2023-10-03T10:10:37.658364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.656066+0000","last_change":"2023-10-03T10:09:46.372991+0000","last_active":"2023-10-03T10:10:37.656066+0000","last_peered":"2023-10-03T10:10:37.656066+0000","last_clean":"2023-10-03T10:10:37.656066+0000","last_became_active":"2023-10-03T10:09:46.372738+0000","last_became_peered":"2023-10-03T10:09:46.372738+0000","last_unstale":"2023-10-03T10:10:37.656066+0000","last_undegraded":"2023-10-03T10:10:37.656066+0000","last_fullsized":"2023-10-03T10:10:37.656066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655028+0000","last_change":"2023-10-03T10:09:46.372532+0000","last_active":"2023-10-03T10:10:37.655028+0000","last_peered":"2023-10-03T10:10:37.655028+0000","last_clean":"2023-10-03T10:10:37.655028+0000","last_became_active":"2023-10-03T10:09:46.372304+0000","last_became_peered":"2023-10-03T10:09:46.372304+0000","last_unstale":"2023-10-03T10:10:37.655028+0000","last_undegraded":"2023-10-03T10:10:37.655028+0000","last_fullsized":"2023-10-03T10:10:37.655028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651097+0000","last_change":"2023-10-03T10:09:46.384266+0000","last_active":"2023-10-03T10:10:37.651097+0000","last_peered":"2023-10-03T10:10:37.651097+0000","last_clean":"2023-10-03T10:10:37.651097+0000","last_became_active":"2023-10-03T10:09:46.383826+0000","last_became_peered":"2023-10-03T10:09:46.383826+0000","last_unstale":"2023-10-03T10:10:37.651097+0000","last_undegraded":"2023-10-03T10:10:37.651097+0000","last_fullsized":"2023-10-03T10:10:37.651097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651248+0000","last_change":"2023-10-03T10:09:46.384841+0000","last_active":"2023-10-03T10:10:37.651248+0000","last_peered":"2023-10-03T10:10:37.651248+0000","last_clean":"2023-10-03T10:10:37.651248+0000","last_became_active":"2023-10-03T10:09:46.384396+0000","last_became_peered":"2023-10-03T10:09:46.384396+0000","last_unstale":"2023-10-03T10:10:37.651248+0000","last_undegraded":"2023-10-03T10:10:37.651248+0000","last_fullsized":"2023-10-03T10:10:37.651248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654843+0000","last_change":"2023-10-03T10:09:46.373837+0000","last_active":"2023-10-03T10:10:37.654843+0000","last_peered":"2023-10-03T10:10:37.654843+0000","last_clean":"2023-10-03T10:10:37.654843+0000","last_became_active":"2023-10-03T10:09:46.373580+0000","last_became_peered":"2023-10-03T10:09:46.373580+0000","last_unstale":"2023-10-03T10:10:37.654843+0000","last_undegraded":"2023-10-03T10:10:37.654843+0000","last_fullsized":"2023-10-03T10:10:37.654843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.656651+0000","last_change":"2023-10-03T10:09:46.380527+0000","last_active":"2023-10-03T10:10:37.656651+0000","last_peered":"2023-10-03T10:10:37.656651+0000","last_clean":"2023-10-03T10:10:37.656651+0000","last_became_active":"2023-10-03T10:09:46.379198+0000","last_became_peered":"2023-10-03T10:09:46.379198+0000","last_unstale":"2023-10-03T10:10:37.656651+0000","last_undegraded":"2023-10-03T10:10:37.656651+0000","last_fullsized":"2023-10-03T10:10:37.656651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.650960+0000","last_change":"2023-10-03T10:09:46.365014+0000","last_active":"2023-10-03T10:10:37.650960+0000","last_peered":"2023-10-03T10:10:37.650960+0000","last_clean":"2023-10-03T10:10:37.650960+0000","last_became_active":"2023-10-03T10:09:46.363620+0000","last_became_peered":"2023-10-03T10:09:46.363620+0000","last_unstale":"2023-10-03T10:10:37.650960+0000","last_undegraded":"2023-10-03T10:10:37.650960+0000","last_fullsized":"2023-10-03T10:10:37.650960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.665285+0000","last_change":"2023-10-03T10:10:37.661935+0000","last_active":"2023-10-03T10:10:37.665285+0000","last_peered":"2023-10-03T10:10:37.665285+0000","last_clean":"2023-10-03T10:10:37.665285+0000","last_became_active":"2023-10-03T10:10:37.661696+0000","last_became_peered":"2023-10-03T10:10:37.661696+0000","last_unstale":"2023-10-03T10:10:37.665285+0000","last_undegraded":"2023-10-03T10:10:37.665285+0000","last_fullsized":"2023-10-03T10:10:37.665285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657728+0000","last_change":"2023-10-03T10:09:46.374686+0000","last_active":"2023-10-03T10:10:37.657728+0000","last_peered":"2023-10-03T10:10:37.657728+0000","last_clean":"2023-10-03T10:10:37.657728+0000","last_became_active":"2023-10-03T10:09:46.371287+0000","last_became_peered":"2023-10-03T10:09:46.371287+0000","last_unstale":"2023-10-03T10:10:37.657728+0000","last_undegraded":"2023-10-03T10:10:37.657728+0000","last_fullsized":"2023-10-03T10:10:37.657728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651055+0000","last_change":"2023-10-03T10:09:46.364615+0000","last_active":"2023-10-03T10:10:37.651055+0000","last_peered":"2023-10-03T10:10:37.651055+0000","last_clean":"2023-10-03T10:10:37.651055+0000","last_became_active":"2023-10-03T10:09:46.364379+0000","last_became_peered":"2023-10-03T10:09:46.364379+0000","last_unstale":"2023-10-03T10:10:37.651055+0000","last_undegraded":"2023-10-03T10:10:37.651055+0000","last_fullsized":"2023-10-03T10:10:37.651055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655688+0000","last_change":"2023-10-03T10:09:46.388555+0000","last_active":"2023-10-03T10:10:37.655688+0000","last_peered":"2023-10-03T10:10:37.655688+0000","last_clean":"2023-10-03T10:10:37.655688+0000","last_became_active":"2023-10-03T10:09:46.388278+0000","last_became_peered":"2023-10-03T10:09:46.388278+0000","last_unstale":"2023-10-03T10:10:37.655688+0000","last_undegraded":"2023-10-03T10:10:37.655688+0000","last_fullsized":"2023-10-03T10:10:37.655688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655129+0000","last_change":"2023-10-03T10:09:46.367061+0000","last_active":"2023-10-03T10:10:37.655129+0000","last_peered":"2023-10-03T10:10:37.655129+0000","last_clean":"2023-10-03T10:10:37.655129+0000","last_became_active":"2023-10-03T10:09:46.366790+0000","last_became_peered":"2023-10-03T10:09:46.366790+0000","last_unstale":"2023-10-03T10:10:37.655129+0000","last_undegraded":"2023-10-03T10:10:37.655129+0000","last_fullsized":"2023-10-03T10:10:37.655129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655592+0000","last_change":"2023-10-03T10:09:46.378399+0000","last_active":"2023-10-03T10:10:37.655592+0000","last_peered":"2023-10-03T10:10:37.655592+0000","last_clean":"2023-10-03T10:10:37.655592+0000","last_became_active":"2023-10-03T10:09:46.378102+0000","last_became_peered":"2023-10-03T10:09:46.378102+0000","last_unstale":"2023-10-03T10:10:37.655592+0000","last_undegraded":"2023-10-03T10:10:37.655592+0000","last_fullsized":"2023-10-03T10:10:37.655592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651480+0000","last_change":"2023-10-03T10:09:46.378572+0000","last_active":"2023-10-03T10:10:37.651480+0000","last_peered":"2023-10-03T10:10:37.651480+0000","last_clean":"2023-10-03T10:10:37.651480+0000","last_became_active":"2023-10-03T10:09:46.378004+0000","last_became_peered":"2023-10-03T10:09:46.378004+0000","last_unstale":"2023-10-03T10:10:37.651480+0000","last_undegraded":"2023-10-03T10:10:37.651480+0000","last_fullsized":"2023-10-03T10:10:37.651480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654250+0000","last_change":"2023-10-03T10:09:46.375958+0000","last_active":"2023-10-03T10:10:37.654250+0000","last_peered":"2023-10-03T10:10:37.654250+0000","last_clean":"2023-10-03T10:10:37.654250+0000","last_became_active":"2023-10-03T10:09:46.375553+0000","last_became_peered":"2023-10-03T10:09:46.375553+0000","last_unstale":"2023-10-03T10:10:37.654250+0000","last_undegraded":"2023-10-03T10:10:37.654250+0000","last_fullsized":"2023-10-03T10:10:37.654250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654801+0000","last_change":"2023-10-03T10:09:46.367258+0000","last_active":"2023-10-03T10:10:37.654801+0000","last_peered":"2023-10-03T10:10:37.654801+0000","last_clean":"2023-10-03T10:10:37.654801+0000","last_became_active":"2023-10-03T10:09:46.366828+0000","last_became_peered":"2023-10-03T10:09:46.366828+0000","last_unstale":"2023-10-03T10:10:37.654801+0000","last_undegraded":"2023-10-03T10:10:37.654801+0000","last_fullsized":"2023-10-03T10:10:37.654801+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655992+0000","last_change":"2023-10-03T10:09:46.374039+0000","last_active":"2023-10-03T10:10:37.655992+0000","last_peered":"2023-10-03T10:10:37.655992+0000","last_clean":"2023-10-03T10:10:37.655992+0000","last_became_active":"2023-10-03T10:09:46.373585+0000","last_became_peered":"2023-10-03T10:09:46.373585+0000","last_unstale":"2023-10-03T10:10:37.655992+0000","last_undegraded":"2023-10-03T10:10:37.655992+0000","last_fullsized":"2023-10-03T10:10:37.655992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.650981+0000","last_change":"2023-10-03T10:09:46.383307+0000","last_active":"2023-10-03T10:10:37.650981+0000","last_peered":"2023-10-03T10:10:37.650981+0000","last_clean":"2023-10-03T10:10:37.650981+0000","last_became_active":"2023-10-03T10:09:46.377010+0000","last_became_peered":"2023-10-03T10:09:46.377010+0000","last_unstale":"2023-10-03T10:10:37.650981+0000","last_undegraded":"2023-10-03T10:10:37.650981+0000","last_fullsized":"2023-10-03T10:10:37.650981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654694+0000","last_change":"2023-10-03T10:09:45.994509+0000","last_active":"2023-10-03T10:10:37.654694+0000","last_peered":"2023-10-03T10:10:37.654694+0000","last_clean":"2023-10-03T10:10:37.654694+0000","last_became_active":"2023-10-03T10:09:45.994047+0000","last_became_peered":"2023-10-03T10:09:45.994047+0000","last_unstale":"2023-10-03T10:10:37.654694+0000","last_undegraded":"2023-10-03T10:10:37.654694+0000","last_fullsized":"2023-10-03T10:10:37.654694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651032+0000","last_change":"2023-10-03T10:09:46.367594+0000","last_active":"2023-10-03T10:10:37.651032+0000","last_peered":"2023-10-03T10:10:37.651032+0000","last_clean":"2023-10-03T10:10:37.651032+0000","last_became_active":"2023-10-03T10:09:46.367029+0000","last_became_peered":"2023-10-03T10:09:46.367029+0000","last_unstale":"2023-10-03T10:10:37.651032+0000","last_undegraded":"2023-10-03T10:10:37.651032+0000","last_fullsized":"2023-10-03T10:10:37.651032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654498+0000","last_change":"2023-10-03T10:09:46.005851+0000","last_active":"2023-10-03T10:10:37.654498+0000","last_peered":"2023-10-03T10:10:37.654498+0000","last_clean":"2023-10-03T10:10:37.654498+0000","last_became_active":"2023-10-03T10:09:46.005573+0000","last_became_peered":"2023-10-03T10:09:46.005573+0000","last_unstale":"2023-10-03T10:10:37.654498+0000","last_undegraded":"2023-10-03T10:10:37.654498+0000","last_fullsized":"2023-10-03T10:10:37.654498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657550+0000","last_change":"2023-10-03T10:09:46.378806+0000","last_active":"2023-10-03T10:10:37.657550+0000","last_peered":"2023-10-03T10:10:37.657550+0000","last_clean":"2023-10-03T10:10:37.657550+0000","last_became_active":"2023-10-03T10:09:46.378564+0000","last_became_peered":"2023-10-03T10:09:46.378564+0000","last_unstale":"2023-10-03T10:10:37.657550+0000","last_undegraded":"2023-10-03T10:10:37.657550+0000","last_fullsized":"2023-10-03T10:10:37.657550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651445+0000","last_change":"2023-10-03T10:09:46.004262+0000","last_active":"2023-10-03T10:10:37.651445+0000","last_peered":"2023-10-03T10:10:37.651445+0000","last_clean":"2023-10-03T10:10:37.651445+0000","last_became_active":"2023-10-03T10:09:46.004006+0000","last_became_peered":"2023-10-03T10:09:46.004006+0000","last_unstale":"2023-10-03T10:10:37.651445+0000","last_undegraded":"2023-10-03T10:10:37.651445+0000","last_fullsized":"2023-10-03T10:10:37.651445+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652375+0000","last_change":"2023-10-03T10:09:46.369027+0000","last_active":"2023-10-03T10:10:37.652375+0000","last_peered":"2023-10-03T10:10:37.652375+0000","last_clean":"2023-10-03T10:10:37.652375+0000","last_became_active":"2023-10-03T10:09:46.368802+0000","last_became_peered":"2023-10-03T10:09:46.368802+0000","last_unstale":"2023-10-03T10:10:37.652375+0000","last_undegraded":"2023-10-03T10:10:37.652375+0000","last_fullsized":"2023-10-03T10:10:37.652375+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.658185+0000","last_change":"2023-10-03T10:09:46.003890+0000","last_active":"2023-10-03T10:10:37.658185+0000","last_peered":"2023-10-03T10:10:37.658185+0000","last_clean":"2023-10-03T10:10:37.658185+0000","last_became_active":"2023-10-03T10:09:46.002821+0000","last_became_peered":"2023-10-03T10:09:46.002821+0000","last_unstale":"2023-10-03T10:10:37.658185+0000","last_undegraded":"2023-10-03T10:10:37.658185+0000","last_fullsized":"2023-10-03T10:10:37.658185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651527+0000","last_change":"2023-10-03T10:09:46.383127+0000","last_active":"2023-10-03T10:10:37.651527+0000","last_peered":"2023-10-03T10:10:37.651527+0000","last_clean":"2023-10-03T10:10:37.651527+0000","last_became_active":"2023-10-03T10:09:46.374331+0000","last_became_peered":"2023-10-03T10:09:46.374331+0000","last_unstale":"2023-10-03T10:10:37.651527+0000","last_undegraded":"2023-10-03T10:10:37.651527+0000","last_fullsized":"2023-10-03T10:10:37.651527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651362+0000","last_change":"2023-10-03T10:09:46.002155+0000","last_active":"2023-10-03T10:10:37.651362+0000","last_peered":"2023-10-03T10:10:37.651362+0000","last_clean":"2023-10-03T10:10:37.651362+0000","last_became_active":"2023-10-03T10:09:46.001872+0000","last_became_peered":"2023-10-03T10:09:46.001872+0000","last_unstale":"2023-10-03T10:10:37.651362+0000","last_undegraded":"2023-10-03T10:10:37.651362+0000","last_fullsized":"2023-10-03T10:10:37.651362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654669+0000","last_change":"2023-10-03T10:09:46.378713+0000","last_active":"2023-10-03T10:10:37.654669+0000","last_peered":"2023-10-03T10:10:37.654669+0000","last_clean":"2023-10-03T10:10:37.654669+0000","last_became_active":"2023-10-03T10:09:46.378310+0000","last_became_peered":"2023-10-03T10:09:46.378310+0000","last_unstale":"2023-10-03T10:10:37.654669+0000","last_undegraded":"2023-10-03T10:10:37.654669+0000","last_fullsized":"2023-10-03T10:10:37.654669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.656233+0000","last_change":"2023-10-03T10:09:46.001705+0000","last_active":"2023-10-03T10:10:37.656233+0000","last_peered":"2023-10-03T10:10:37.656233+0000","last_clean":"2023-10-03T10:10:37.656233+0000","last_became_active":"2023-10-03T10:09:46.001338+0000","last_became_peered":"2023-10-03T10:09:46.001338+0000","last_unstale":"2023-10-03T10:10:37.656233+0000","last_undegraded":"2023-10-03T10:10:37.656233+0000","last_fullsized":"2023-10-03T10:10:37.656233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654805+0000","last_change":"2023-10-03T10:09:46.392590+0000","last_active":"2023-10-03T10:10:37.654805+0000","last_peered":"2023-10-03T10:10:37.654805+0000","last_clean":"2023-10-03T10:10:37.654805+0000","last_became_active":"2023-10-03T10:09:46.392268+0000","last_became_peered":"2023-10-03T10:09:46.392268+0000","last_unstale":"2023-10-03T10:10:37.654805+0000","last_undegraded":"2023-10-03T10:10:37.654805+0000","last_fullsized":"2023-10-03T10:10:37.654805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'12","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:12:06.153467+0000","last_change":"2023-10-03T10:09:45.995310+0000","last_active":"2023-10-03T10:12:06.153467+0000","last_peered":"2023-10-03T10:12:06.153467+0000","last_clean":"2023-10-03T10:12:06.153467+0000","last_became_active":"2023-10-03T10:09:45.995040+0000","last_became_peered":"2023-10-03T10:09:45.995040+0000","last_unstale":"2023-10-03T10:12:06.153467+0000","last_undegraded":"2023-10-03T10:12:06.153467+0000","last_fullsized":"2023-10-03T10:12:06.153467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651092+0000","last_change":"2023-10-03T10:09:46.385651+0000","last_active":"2023-10-03T10:10:37.651092+0000","last_peered":"2023-10-03T10:10:37.651092+0000","last_clean":"2023-10-03T10:10:37.651092+0000","last_became_active":"2023-10-03T10:09:46.383900+0000","last_became_peered":"2023-10-03T10:09:46.383900+0000","last_unstale":"2023-10-03T10:10:37.651092+0000","last_undegraded":"2023-10-03T10:10:37.651092+0000","last_fullsized":"2023-10-03T10:10:37.651092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654292+0000","last_change":"2023-10-03T10:09:46.008019+0000","last_active":"2023-10-03T10:10:37.654292+0000","last_peered":"2023-10-03T10:10:37.654292+0000","last_clean":"2023-10-03T10:10:37.654292+0000","last_became_active":"2023-10-03T10:09:46.007374+0000","last_became_peered":"2023-10-03T10:09:46.007374+0000","last_unstale":"2023-10-03T10:10:37.654292+0000","last_undegraded":"2023-10-03T10:10:37.654292+0000","last_fullsized":"2023-10-03T10:10:37.654292+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651575+0000","last_change":"2023-10-03T10:09:46.382625+0000","last_active":"2023-10-03T10:10:37.651575+0000","last_peered":"2023-10-03T10:10:37.651575+0000","last_clean":"2023-10-03T10:10:37.651575+0000","last_became_active":"2023-10-03T10:09:46.382352+0000","last_became_peered":"2023-10-03T10:09:46.382352+0000","last_unstale":"2023-10-03T10:10:37.651575+0000","last_undegraded":"2023-10-03T10:10:37.651575+0000","last_fullsized":"2023-10-03T10:10:37.651575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655644+0000","last_change":"2023-10-03T10:09:45.999722+0000","last_active":"2023-10-03T10:10:37.655644+0000","last_peered":"2023-10-03T10:10:37.655644+0000","last_clean":"2023-10-03T10:10:37.655644+0000","last_became_active":"2023-10-03T10:09:45.999450+0000","last_became_peered":"2023-10-03T10:09:45.999450+0000","last_unstale":"2023-10-03T10:10:37.655644+0000","last_undegraded":"2023-10-03T10:10:37.655644+0000","last_fullsized":"2023-10-03T10:10:37.655644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651065+0000","last_change":"2023-10-03T10:09:46.384495+0000","last_active":"2023-10-03T10:10:37.651065+0000","last_peered":"2023-10-03T10:10:37.651065+0000","last_clean":"2023-10-03T10:10:37.651065+0000","last_became_active":"2023-10-03T10:09:46.383160+0000","last_became_peered":"2023-10-03T10:09:46.383160+0000","last_unstale":"2023-10-03T10:10:37.651065+0000","last_undegraded":"2023-10-03T10:10:37.651065+0000","last_fullsized":"2023-10-03T10:10:37.651065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654593+0000","last_change":"2023-10-03T10:09:46.002469+0000","last_active":"2023-10-03T10:10:37.654593+0000","last_peered":"2023-10-03T10:10:37.654593+0000","last_clean":"2023-10-03T10:10:37.654593+0000","last_became_active":"2023-10-03T10:09:46.002179+0000","last_became_peered":"2023-10-03T10:09:46.002179+0000","last_unstale":"2023-10-03T10:10:37.654593+0000","last_undegraded":"2023-10-03T10:10:37.654593+0000","last_fullsized":"2023-10-03T10:10:37.654593+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657652+0000","last_change":"2023-10-03T10:09:46.379295+0000","last_active":"2023-10-03T10:10:37.657652+0000","last_peered":"2023-10-03T10:10:37.657652+0000","last_clean":"2023-10-03T10:10:37.657652+0000","last_became_active":"2023-10-03T10:09:46.370639+0000","last_became_peered":"2023-10-03T10:09:46.370639+0000","last_unstale":"2023-10-03T10:10:37.657652+0000","last_undegraded":"2023-10-03T10:10:37.657652+0000","last_fullsized":"2023-10-03T10:10:37.657652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654470+0000","last_change":"2023-10-03T10:09:45.991739+0000","last_active":"2023-10-03T10:10:37.654470+0000","last_peered":"2023-10-03T10:10:37.654470+0000","last_clean":"2023-10-03T10:10:37.654470+0000","last_became_active":"2023-10-03T10:09:45.991195+0000","last_became_peered":"2023-10-03T10:09:45.991195+0000","last_unstale":"2023-10-03T10:10:37.654470+0000","last_undegraded":"2023-10-03T10:10:37.654470+0000","last_fullsized":"2023-10-03T10:10:37.654470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.660080+0000","last_change":"2023-10-03T10:10:37.656679+0000","last_active":"2023-10-03T10:10:37.660080+0000","last_peered":"2023-10-03T10:10:37.660080+0000","last_clean":"2023-10-03T10:10:37.660080+0000","last_became_active":"2023-10-03T10:10:37.656372+0000","last_became_peered":"2023-10-03T10:10:37.656372+0000","last_unstale":"2023-10-03T10:10:37.660080+0000","last_undegraded":"2023-10-03T10:10:37.660080+0000","last_fullsized":"2023-10-03T10:10:37.660080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.658039+0000","last_change":"2023-10-03T10:09:46.004494+0000","last_active":"2023-10-03T10:10:37.658039+0000","last_peered":"2023-10-03T10:10:37.658039+0000","last_clean":"2023-10-03T10:10:37.658039+0000","last_became_active":"2023-10-03T10:09:46.004166+0000","last_became_peered":"2023-10-03T10:09:46.004166+0000","last_unstale":"2023-10-03T10:10:37.658039+0000","last_undegraded":"2023-10-03T10:10:37.658039+0000","last_fullsized":"2023-10-03T10:10:37.658039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651613+0000","last_change":"2023-10-03T10:09:46.383361+0000","last_active":"2023-10-03T10:10:37.651613+0000","last_peered":"2023-10-03T10:10:37.651613+0000","last_clean":"2023-10-03T10:10:37.651613+0000","last_became_active":"2023-10-03T10:09:46.378076+0000","last_became_peered":"2023-10-03T10:09:46.378076+0000","last_unstale":"2023-10-03T10:10:37.651613+0000","last_undegraded":"2023-10-03T10:10:37.651613+0000","last_fullsized":"2023-10-03T10:10:37.651613+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651443+0000","last_change":"2023-10-03T10:09:45.995572+0000","last_active":"2023-10-03T10:10:37.651443+0000","last_peered":"2023-10-03T10:10:37.651443+0000","last_clean":"2023-10-03T10:10:37.651443+0000","last_became_active":"2023-10-03T10:09:45.995093+0000","last_became_peered":"2023-10-03T10:09:45.995093+0000","last_unstale":"2023-10-03T10:10:37.651443+0000","last_undegraded":"2023-10-03T10:10:37.651443+0000","last_fullsized":"2023-10-03T10:10:37.651443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654565+0000","last_change":"2023-10-03T10:09:46.362868+0000","last_active":"2023-10-03T10:10:37.654565+0000","last_peered":"2023-10-03T10:10:37.654565+0000","last_clean":"2023-10-03T10:10:37.654565+0000","last_became_active":"2023-10-03T10:09:46.362550+0000","last_became_peered":"2023-10-03T10:09:46.362550+0000","last_unstale":"2023-10-03T10:10:37.654565+0000","last_undegraded":"2023-10-03T10:10:37.654565+0000","last_fullsized":"2023-10-03T10:10:37.654565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652184+0000","last_change":"2023-10-03T10:09:46.007310+0000","last_active":"2023-10-03T10:10:37.652184+0000","last_peered":"2023-10-03T10:10:37.652184+0000","last_clean":"2023-10-03T10:10:37.652184+0000","last_became_active":"2023-10-03T10:09:46.007002+0000","last_became_peered":"2023-10-03T10:09:46.007002+0000","last_unstale":"2023-10-03T10:10:37.652184+0000","last_undegraded":"2023-10-03T10:10:37.652184+0000","last_fullsized":"2023-10-03T10:10:37.652184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.650843+0000","last_change":"2023-10-03T10:09:46.387104+0000","last_active":"2023-10-03T10:10:37.650843+0000","last_peered":"2023-10-03T10:10:37.650843+0000","last_clean":"2023-10-03T10:10:37.650843+0000","last_became_active":"2023-10-03T10:09:46.386697+0000","last_became_peered":"2023-10-03T10:09:46.386697+0000","last_unstale":"2023-10-03T10:10:37.650843+0000","last_undegraded":"2023-10-03T10:10:37.650843+0000","last_fullsized":"2023-10-03T10:10:37.650843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.656050+0000","last_change":"2023-10-03T10:09:46.001474+0000","last_active":"2023-10-03T10:10:37.656050+0000","last_peered":"2023-10-03T10:10:37.656050+0000","last_clean":"2023-10-03T10:10:37.656050+0000","last_became_active":"2023-10-03T10:09:46.001185+0000","last_became_peered":"2023-10-03T10:09:46.001185+0000","last_unstale":"2023-10-03T10:10:37.656050+0000","last_undegraded":"2023-10-03T10:10:37.656050+0000","last_fullsized":"2023-10-03T10:10:37.656050+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657325+0000","last_change":"2023-10-03T10:09:46.378394+0000","last_active":"2023-10-03T10:10:37.657325+0000","last_peered":"2023-10-03T10:10:37.657325+0000","last_clean":"2023-10-03T10:10:37.657325+0000","last_became_active":"2023-10-03T10:09:46.378115+0000","last_became_peered":"2023-10-03T10:09:46.378115+0000","last_unstale":"2023-10-03T10:10:37.657325+0000","last_undegraded":"2023-10-03T10:10:37.657325+0000","last_fullsized":"2023-10-03T10:10:37.657325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654125+0000","last_change":"2023-10-03T10:09:46.008210+0000","last_active":"2023-10-03T10:10:37.654125+0000","last_peered":"2023-10-03T10:10:37.654125+0000","last_clean":"2023-10-03T10:10:37.654125+0000","last_became_active":"2023-10-03T10:09:46.007750+0000","last_became_peered":"2023-10-03T10:09:46.007750+0000","last_unstale":"2023-10-03T10:10:37.654125+0000","last_undegraded":"2023-10-03T10:10:37.654125+0000","last_fullsized":"2023-10-03T10:10:37.654125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655974+0000","last_change":"2023-10-03T10:09:46.385399+0000","last_active":"2023-10-03T10:10:37.655974+0000","last_peered":"2023-10-03T10:10:37.655974+0000","last_clean":"2023-10-03T10:10:37.655974+0000","last_became_active":"2023-10-03T10:09:46.385110+0000","last_became_peered":"2023-10-03T10:09:46.385110+0000","last_unstale":"2023-10-03T10:10:37.655974+0000","last_undegraded":"2023-10-03T10:10:37.655974+0000","last_fullsized":"2023-10-03T10:10:37.655974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652518+0000","last_change":"2023-10-03T10:09:46.007708+0000","last_active":"2023-10-03T10:10:37.652518+0000","last_peered":"2023-10-03T10:10:37.652518+0000","last_clean":"2023-10-03T10:10:37.652518+0000","last_became_active":"2023-10-03T10:09:46.006141+0000","last_became_peered":"2023-10-03T10:09:46.006141+0000","last_unstale":"2023-10-03T10:10:37.652518+0000","last_undegraded":"2023-10-03T10:10:37.652518+0000","last_fullsized":"2023-10-03T10:10:37.652518+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651125+0000","last_change":"2023-10-03T10:09:46.367623+0000","last_active":"2023-10-03T10:10:37.651125+0000","last_peered":"2023-10-03T10:10:37.651125+0000","last_clean":"2023-10-03T10:10:37.651125+0000","last_became_active":"2023-10-03T10:09:46.367337+0000","last_became_peered":"2023-10-03T10:09:46.367337+0000","last_unstale":"2023-10-03T10:10:37.651125+0000","last_undegraded":"2023-10-03T10:10:37.651125+0000","last_fullsized":"2023-10-03T10:10:37.651125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651919+0000","last_change":"2023-10-03T10:09:46.002433+0000","last_active":"2023-10-03T10:10:37.651919+0000","last_peered":"2023-10-03T10:10:37.651919+0000","last_clean":"2023-10-03T10:10:37.651919+0000","last_became_active":"2023-10-03T10:09:46.002135+0000","last_became_peered":"2023-10-03T10:09:46.002135+0000","last_unstale":"2023-10-03T10:10:37.651919+0000","last_undegraded":"2023-10-03T10:10:37.651919+0000","last_fullsized":"2023-10-03T10:10:37.651919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651518+0000","last_change":"2023-10-03T10:09:46.387220+0000","last_active":"2023-10-03T10:10:37.651518+0000","last_peered":"2023-10-03T10:10:37.651518+0000","last_clean":"2023-10-03T10:10:37.651518+0000","last_became_active":"2023-10-03T10:09:46.384091+0000","last_became_peered":"2023-10-03T10:09:46.384091+0000","last_unstale":"2023-10-03T10:10:37.651518+0000","last_undegraded":"2023-10-03T10:10:37.651518+0000","last_fullsized":"2023-10-03T10:10:37.651518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651053+0000","last_change":"2023-10-03T10:09:46.008899+0000","last_active":"2023-10-03T10:10:37.651053+0000","last_peered":"2023-10-03T10:10:37.651053+0000","last_clean":"2023-10-03T10:10:37.651053+0000","last_became_active":"2023-10-03T10:09:46.006123+0000","last_became_peered":"2023-10-03T10:09:46.006123+0000","last_unstale":"2023-10-03T10:10:37.651053+0000","last_undegraded":"2023-10-03T10:10:37.651053+0000","last_fullsized":"2023-10-03T10:10:37.651053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.662605+0000","last_change":"2023-10-03T10:10:37.660052+0000","last_active":"2023-10-03T10:10:37.662605+0000","last_peered":"2023-10-03T10:10:37.662605+0000","last_clean":"2023-10-03T10:10:37.662605+0000","last_became_active":"2023-10-03T10:10:37.659823+0000","last_became_peered":"2023-10-03T10:10:37.659823+0000","last_unstale":"2023-10-03T10:10:37.662605+0000","last_undegraded":"2023-10-03T10:10:37.662605+0000","last_fullsized":"2023-10-03T10:10:37.662605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655613+0000","last_change":"2023-10-03T10:09:42.503202+0000","last_active":"2023-10-03T10:10:37.655613+0000","last_peered":"2023-10-03T10:10:37.655613+0000","last_clean":"2023-10-03T10:10:37.655613+0000","last_became_active":"2023-10-03T10:09:42.502700+0000","last_became_peered":"2023-10-03T10:09:42.502700+0000","last_unstale":"2023-10-03T10:10:37.655613+0000","last_undegraded":"2023-10-03T10:10:37.655613+0000","last_fullsized":"2023-10-03T10:10:37.655613+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651140+0000","last_change":"2023-10-03T10:09:45.995268+0000","last_active":"2023-10-03T10:10:37.651140+0000","last_peered":"2023-10-03T10:10:37.651140+0000","last_clean":"2023-10-03T10:10:37.651140+0000","last_became_active":"2023-10-03T10:09:45.994970+0000","last_became_peered":"2023-10-03T10:09:45.994970+0000","last_unstale":"2023-10-03T10:10:37.651140+0000","last_undegraded":"2023-10-03T10:10:37.651140+0000","last_fullsized":"2023-10-03T10:10:37.651140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654764+0000","last_change":"2023-10-03T10:09:46.393198+0000","last_active":"2023-10-03T10:10:37.654764+0000","last_peered":"2023-10-03T10:10:37.654764+0000","last_clean":"2023-10-03T10:10:37.654764+0000","last_became_active":"2023-10-03T10:09:46.392876+0000","last_became_peered":"2023-10-03T10:09:46.392876+0000","last_unstale":"2023-10-03T10:10:37.654764+0000","last_undegraded":"2023-10-03T10:10:37.654764+0000","last_fullsized":"2023-10-03T10:10:37.654764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652589+0000","last_change":"2023-10-03T10:09:41.940609+0000","last_active":"2023-10-03T10:10:37.652589+0000","last_peered":"2023-10-03T10:10:37.652589+0000","last_clean":"2023-10-03T10:10:37.652589+0000","last_became_active":"2023-10-03T10:09:41.940313+0000","last_became_peered":"2023-10-03T10:09:41.940313+0000","last_unstale":"2023-10-03T10:10:37.652589+0000","last_undegraded":"2023-10-03T10:10:37.652589+0000","last_fullsized":"2023-10-03T10:10:37.652589+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657073+0000","last_change":"2023-10-03T10:09:45.987289+0000","last_active":"2023-10-03T10:10:37.657073+0000","last_peered":"2023-10-03T10:10:37.657073+0000","last_clean":"2023-10-03T10:10:37.657073+0000","last_became_active":"2023-10-03T10:09:45.987013+0000","last_became_peered":"2023-10-03T10:09:45.987013+0000","last_unstale":"2023-10-03T10:10:37.657073+0000","last_undegraded":"2023-10-03T10:10:37.657073+0000","last_fullsized":"2023-10-03T10:10:37.657073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655387+0000","last_change":"2023-10-03T10:09:46.371416+0000","last_active":"2023-10-03T10:10:37.655387+0000","last_peered":"2023-10-03T10:10:37.655387+0000","last_clean":"2023-10-03T10:10:37.655387+0000","last_became_active":"2023-10-03T10:09:46.370977+0000","last_became_peered":"2023-10-03T10:09:46.370977+0000","last_unstale":"2023-10-03T10:10:37.655387+0000","last_undegraded":"2023-10-03T10:10:37.655387+0000","last_fullsized":"2023-10-03T10:10:37.655387+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651017+0000","last_change":"2023-10-03T10:09:41.940436+0000","last_active":"2023-10-03T10:10:37.651017+0000","last_peered":"2023-10-03T10:10:37.651017+0000","last_clean":"2023-10-03T10:10:37.651017+0000","last_became_active":"2023-10-03T10:09:41.940147+0000","last_became_peered":"2023-10-03T10:09:41.940147+0000","last_unstale":"2023-10-03T10:10:37.651017+0000","last_undegraded":"2023-10-03T10:10:37.651017+0000","last_fullsized":"2023-10-03T10:10:37.651017+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654378+0000","last_change":"2023-10-03T10:09:45.994184+0000","last_active":"2023-10-03T10:10:37.654378+0000","last_peered":"2023-10-03T10:10:37.654378+0000","last_clean":"2023-10-03T10:10:37.654378+0000","last_became_active":"2023-10-03T10:09:45.993699+0000","last_became_peered":"2023-10-03T10:09:45.993699+0000","last_unstale":"2023-10-03T10:10:37.654378+0000","last_undegraded":"2023-10-03T10:10:37.654378+0000","last_fullsized":"2023-10-03T10:10:37.654378+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.662517+0000","last_change":"2023-10-03T10:10:37.659967+0000","last_active":"2023-10-03T10:10:37.662517+0000","last_peered":"2023-10-03T10:10:37.662517+0000","last_clean":"2023-10-03T10:10:37.662517+0000","last_became_active":"2023-10-03T10:10:37.659665+0000","last_became_peered":"2023-10-03T10:10:37.659665+0000","last_unstale":"2023-10-03T10:10:37.662517+0000","last_undegraded":"2023-10-03T10:10:37.662517+0000","last_fullsized":"2023-10-03T10:10:37.662517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654208+0000","last_change":"2023-10-03T10:09:41.941185+0000","last_active":"2023-10-03T10:10:37.654208+0000","last_peered":"2023-10-03T10:10:37.654208+0000","last_clean":"2023-10-03T10:10:37.654208+0000","last_became_active":"2023-10-03T10:09:41.940930+0000","last_became_peered":"2023-10-03T10:09:41.940930+0000","last_unstale":"2023-10-03T10:10:37.654208+0000","last_undegraded":"2023-10-03T10:10:37.654208+0000","last_fullsized":"2023-10-03T10:10:37.654208+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654296+0000","last_change":"2023-10-03T10:09:40.948442+0000","last_active":"2023-10-03T10:10:37.654296+0000","last_peered":"2023-10-03T10:10:37.654296+0000","last_clean":"2023-10-03T10:10:37.654296+0000","last_became_active":"2023-10-03T10:09:40.948068+0000","last_became_peered":"2023-10-03T10:09:40.948068+0000","last_unstale":"2023-10-03T10:10:37.654296+0000","last_undegraded":"2023-10-03T10:10:37.654296+0000","last_fullsized":"2023-10-03T10:10:37.654296+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:39.928111+0000","last_clean_scrub_stamp":"2023-10-03T10:09:39.928111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652438+0000","last_change":"2023-10-03T10:09:45.999685+0000","last_active":"2023-10-03T10:10:37.652438+0000","last_peered":"2023-10-03T10:10:37.652438+0000","last_clean":"2023-10-03T10:10:37.652438+0000","last_became_active":"2023-10-03T10:09:45.999343+0000","last_became_peered":"2023-10-03T10:09:45.999343+0000","last_unstale":"2023-10-03T10:10:37.652438+0000","last_undegraded":"2023-10-03T10:10:37.652438+0000","last_fullsized":"2023-10-03T10:10:37.652438+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652460+0000","last_change":"2023-10-03T10:09:46.367761+0000","last_active":"2023-10-03T10:10:37.652460+0000","last_peered":"2023-10-03T10:10:37.652460+0000","last_clean":"2023-10-03T10:10:37.652460+0000","last_became_active":"2023-10-03T10:09:46.367362+0000","last_became_peered":"2023-10-03T10:09:46.367362+0000","last_unstale":"2023-10-03T10:10:37.652460+0000","last_undegraded":"2023-10-03T10:10:37.652460+0000","last_fullsized":"2023-10-03T10:10:37.652460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651289+0000","last_change":"2023-10-03T10:09:41.940561+0000","last_active":"2023-10-03T10:10:37.651289+0000","last_peered":"2023-10-03T10:10:37.651289+0000","last_clean":"2023-10-03T10:10:37.651289+0000","last_became_active":"2023-10-03T10:09:41.940202+0000","last_became_peered":"2023-10-03T10:09:41.940202+0000","last_unstale":"2023-10-03T10:10:37.651289+0000","last_undegraded":"2023-10-03T10:10:37.651289+0000","last_fullsized":"2023-10-03T10:10:37.651289+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.656637+0000","last_change":"2023-10-03T10:09:45.987278+0000","last_active":"2023-10-03T10:10:37.656637+0000","last_peered":"2023-10-03T10:10:37.656637+0000","last_clean":"2023-10-03T10:10:37.656637+0000","last_became_active":"2023-10-03T10:09:45.986993+0000","last_became_peered":"2023-10-03T10:09:45.986993+0000","last_unstale":"2023-10-03T10:10:37.656637+0000","last_undegraded":"2023-10-03T10:10:37.656637+0000","last_fullsized":"2023-10-03T10:10:37.656637+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657704+0000","last_change":"2023-10-03T10:09:46.378722+0000","last_active":"2023-10-03T10:10:37.657704+0000","last_peered":"2023-10-03T10:10:37.657704+0000","last_clean":"2023-10-03T10:10:37.657704+0000","last_became_active":"2023-10-03T10:09:46.378186+0000","last_became_peered":"2023-10-03T10:09:46.378186+0000","last_unstale":"2023-10-03T10:10:37.657704+0000","last_undegraded":"2023-10-03T10:10:37.657704+0000","last_fullsized":"2023-10-03T10:10:37.657704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.653935+0000","last_change":"2023-10-03T10:09:42.502984+0000","last_active":"2023-10-03T10:10:37.653935+0000","last_peered":"2023-10-03T10:10:37.653935+0000","last_clean":"2023-10-03T10:10:37.653935+0000","last_became_active":"2023-10-03T10:09:42.502699+0000","last_became_peered":"2023-10-03T10:09:42.502699+0000","last_unstale":"2023-10-03T10:10:37.653935+0000","last_undegraded":"2023-10-03T10:10:37.653935+0000","last_fullsized":"2023-10-03T10:10:37.653935+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655305+0000","last_change":"2023-10-03T10:09:45.995626+0000","last_active":"2023-10-03T10:10:37.655305+0000","last_peered":"2023-10-03T10:10:37.655305+0000","last_clean":"2023-10-03T10:10:37.655305+0000","last_became_active":"2023-10-03T10:09:45.995322+0000","last_became_peered":"2023-10-03T10:09:45.995322+0000","last_unstale":"2023-10-03T10:10:37.655305+0000","last_undegraded":"2023-10-03T10:10:37.655305+0000","last_fullsized":"2023-10-03T10:10:37.655305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657246+0000","last_change":"2023-10-03T10:09:46.371217+0000","last_active":"2023-10-03T10:10:37.657246+0000","last_peered":"2023-10-03T10:10:37.657246+0000","last_clean":"2023-10-03T10:10:37.657246+0000","last_became_active":"2023-10-03T10:09:46.370285+0000","last_became_peered":"2023-10-03T10:09:46.370285+0000","last_unstale":"2023-10-03T10:10:37.657246+0000","last_undegraded":"2023-10-03T10:10:37.657246+0000","last_fullsized":"2023-10-03T10:10:37.657246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652066+0000","last_change":"2023-10-03T10:09:46.006819+0000","last_active":"2023-10-03T10:10:37.652066+0000","last_peered":"2023-10-03T10:10:37.652066+0000","last_clean":"2023-10-03T10:10:37.652066+0000","last_became_active":"2023-10-03T10:09:46.006524+0000","last_became_peered":"2023-10-03T10:09:46.006524+0000","last_unstale":"2023-10-03T10:10:37.652066+0000","last_undegraded":"2023-10-03T10:10:37.652066+0000","last_fullsized":"2023-10-03T10:10:37.652066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655921+0000","last_change":"2023-10-03T10:09:42.503022+0000","last_active":"2023-10-03T10:10:37.655921+0000","last_peered":"2023-10-03T10:10:37.655921+0000","last_clean":"2023-10-03T10:10:37.655921+0000","last_became_active":"2023-10-03T10:09:42.502739+0000","last_became_peered":"2023-10-03T10:09:42.502739+0000","last_unstale":"2023-10-03T10:10:37.655921+0000","last_undegraded":"2023-10-03T10:10:37.655921+0000","last_fullsized":"2023-10-03T10:10:37.655921+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.665224+0000","last_change":"2023-10-03T10:10:37.660762+0000","last_active":"2023-10-03T10:10:37.665224+0000","last_peered":"2023-10-03T10:10:37.665224+0000","last_clean":"2023-10-03T10:10:37.665224+0000","last_became_active":"2023-10-03T10:10:37.660480+0000","last_became_peered":"2023-10-03T10:10:37.660480+0000","last_unstale":"2023-10-03T10:10:37.665224+0000","last_undegraded":"2023-10-03T10:10:37.665224+0000","last_fullsized":"2023-10-03T10:10:37.665224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652281+0000","last_change":"2023-10-03T10:09:42.503368+0000","last_active":"2023-10-03T10:10:37.652281+0000","last_peered":"2023-10-03T10:10:37.652281+0000","last_clean":"2023-10-03T10:10:37.652281+0000","last_became_active":"2023-10-03T10:09:42.503090+0000","last_became_peered":"2023-10-03T10:09:42.503090+0000","last_unstale":"2023-10-03T10:10:37.652281+0000","last_undegraded":"2023-10-03T10:10:37.652281+0000","last_fullsized":"2023-10-03T10:10:37.652281+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:40.931591+0000","last_clean_scrub_stamp":"2023-10-03T10:09:40.931591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657560+0000","last_change":"2023-10-03T10:09:46.003516+0000","last_active":"2023-10-03T10:10:37.657560+0000","last_peered":"2023-10-03T10:10:37.657560+0000","last_clean":"2023-10-03T10:10:37.657560+0000","last_became_active":"2023-10-03T10:09:46.003227+0000","last_became_peered":"2023-10-03T10:09:46.003227+0000","last_unstale":"2023-10-03T10:10:37.657560+0000","last_undegraded":"2023-10-03T10:10:37.657560+0000","last_fullsized":"2023-10-03T10:10:37.657560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.650881+0000","last_change":"2023-10-03T10:09:46.365107+0000","last_active":"2023-10-03T10:10:37.650881+0000","last_peered":"2023-10-03T10:10:37.650881+0000","last_clean":"2023-10-03T10:10:37.650881+0000","last_became_active":"2023-10-03T10:09:46.364877+0000","last_became_peered":"2023-10-03T10:09:46.364877+0000","last_unstale":"2023-10-03T10:10:37.650881+0000","last_undegraded":"2023-10-03T10:10:37.650881+0000","last_fullsized":"2023-10-03T10:10:37.650881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.657161+0000","last_change":"2023-10-03T10:09:46.003786+0000","last_active":"2023-10-03T10:10:37.657161+0000","last_peered":"2023-10-03T10:10:37.657161+0000","last_clean":"2023-10-03T10:10:37.657161+0000","last_became_active":"2023-10-03T10:09:46.003506+0000","last_became_peered":"2023-10-03T10:09:46.003506+0000","last_unstale":"2023-10-03T10:10:37.657161+0000","last_undegraded":"2023-10-03T10:10:37.657161+0000","last_fullsized":"2023-10-03T10:10:37.657161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651178+0000","last_change":"2023-10-03T10:09:46.376808+0000","last_active":"2023-10-03T10:10:37.651178+0000","last_peered":"2023-10-03T10:10:37.651178+0000","last_clean":"2023-10-03T10:10:37.651178+0000","last_became_active":"2023-10-03T10:09:46.376414+0000","last_became_peered":"2023-10-03T10:09:46.376414+0000","last_unstale":"2023-10-03T10:10:37.651178+0000","last_undegraded":"2023-10-03T10:10:37.651178+0000","last_fullsized":"2023-10-03T10:10:37.651178+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655467+0000","last_change":"2023-10-03T10:09:45.992104+0000","last_active":"2023-10-03T10:10:37.655467+0000","last_peered":"2023-10-03T10:10:37.655467+0000","last_clean":"2023-10-03T10:10:37.655467+0000","last_became_active":"2023-10-03T10:09:45.991796+0000","last_became_peered":"2023-10-03T10:09:45.991796+0000","last_unstale":"2023-10-03T10:10:37.655467+0000","last_undegraded":"2023-10-03T10:10:37.655467+0000","last_fullsized":"2023-10-03T10:10:37.655467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651173+0000","last_change":"2023-10-03T10:09:46.384662+0000","last_active":"2023-10-03T10:10:37.651173+0000","last_peered":"2023-10-03T10:10:37.651173+0000","last_clean":"2023-10-03T10:10:37.651173+0000","last_became_active":"2023-10-03T10:09:46.384347+0000","last_became_peered":"2023-10-03T10:09:46.384347+0000","last_unstale":"2023-10-03T10:10:37.651173+0000","last_undegraded":"2023-10-03T10:10:37.651173+0000","last_fullsized":"2023-10-03T10:10:37.651173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.652273+0000","last_change":"2023-10-03T10:09:46.005018+0000","last_active":"2023-10-03T10:10:37.652273+0000","last_peered":"2023-10-03T10:10:37.652273+0000","last_clean":"2023-10-03T10:10:37.652273+0000","last_became_active":"2023-10-03T10:09:46.004611+0000","last_became_peered":"2023-10-03T10:09:46.004611+0000","last_unstale":"2023-10-03T10:10:37.652273+0000","last_undegraded":"2023-10-03T10:10:37.652273+0000","last_fullsized":"2023-10-03T10:10:37.652273+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.650783+0000","last_change":"2023-10-03T10:09:46.387130+0000","last_active":"2023-10-03T10:10:37.650783+0000","last_peered":"2023-10-03T10:10:37.650783+0000","last_clean":"2023-10-03T10:10:37.650783+0000","last_became_active":"2023-10-03T10:09:46.386801+0000","last_became_peered":"2023-10-03T10:09:46.386801+0000","last_unstale":"2023-10-03T10:10:37.650783+0000","last_undegraded":"2023-10-03T10:10:37.650783+0000","last_fullsized":"2023-10-03T10:10:37.650783+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651344+0000","last_change":"2023-10-03T10:09:45.998407+0000","last_active":"2023-10-03T10:10:37.651344+0000","last_peered":"2023-10-03T10:10:37.651344+0000","last_clean":"2023-10-03T10:10:37.651344+0000","last_became_active":"2023-10-03T10:09:45.995915+0000","last_became_peered":"2023-10-03T10:09:45.995915+0000","last_unstale":"2023-10-03T10:10:37.651344+0000","last_undegraded":"2023-10-03T10:10:37.651344+0000","last_fullsized":"2023-10-03T10:10:37.651344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.651562+0000","last_change":"2023-10-03T10:09:46.385531+0000","last_active":"2023-10-03T10:10:37.651562+0000","last_peered":"2023-10-03T10:10:37.651562+0000","last_clean":"2023-10-03T10:10:37.651562+0000","last_became_active":"2023-10-03T10:09:46.385289+0000","last_became_peered":"2023-10-03T10:09:46.385289+0000","last_unstale":"2023-10-03T10:10:37.651562+0000","last_undegraded":"2023-10-03T10:10:37.651562+0000","last_fullsized":"2023-10-03T10:10:37.651562+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.658265+0000","last_change":"2023-10-03T10:09:46.004241+0000","last_active":"2023-10-03T10:10:37.658265+0000","last_peered":"2023-10-03T10:10:37.658265+0000","last_clean":"2023-10-03T10:10:37.658265+0000","last_became_active":"2023-10-03T10:09:46.003370+0000","last_became_peered":"2023-10-03T10:09:46.003370+0000","last_unstale":"2023-10-03T10:10:37.658265+0000","last_undegraded":"2023-10-03T10:10:37.658265+0000","last_fullsized":"2023-10-03T10:10:37.658265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:44.967552+0000","last_clean_scrub_stamp":"2023-10-03T10:09:44.967552+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.650623+0000","last_change":"2023-10-03T10:09:46.374808+0000","last_active":"2023-10-03T10:10:37.650623+0000","last_peered":"2023-10-03T10:10:37.650623+0000","last_clean":"2023-10-03T10:10:37.650623+0000","last_became_active":"2023-10-03T10:09:46.374363+0000","last_became_peered":"2023-10-03T10:09:46.374363+0000","last_unstale":"2023-10-03T10:10:37.650623+0000","last_undegraded":"2023-10-03T10:10:37.650623+0000","last_fullsized":"2023-10-03T10:10:37.650623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654535+0000","last_change":"2023-10-03T10:09:46.371026+0000","last_active":"2023-10-03T10:10:37.654535+0000","last_peered":"2023-10-03T10:10:37.654535+0000","last_clean":"2023-10-03T10:10:37.654535+0000","last_became_active":"2023-10-03T10:09:46.370725+0000","last_became_peered":"2023-10-03T10:09:46.370725+0000","last_unstale":"2023-10-03T10:10:37.654535+0000","last_undegraded":"2023-10-03T10:10:37.654535+0000","last_fullsized":"2023-10-03T10:10:37.654535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.662490+0000","last_change":"2023-10-03T10:10:37.660668+0000","last_active":"2023-10-03T10:10:37.662490+0000","last_peered":"2023-10-03T10:10:37.662490+0000","last_clean":"2023-10-03T10:10:37.662490+0000","last_became_active":"2023-10-03T10:10:37.660448+0000","last_became_peered":"2023-10-03T10:10:37.660448+0000","last_unstale":"2023-10-03T10:10:37.662490+0000","last_undegraded":"2023-10-03T10:10:37.662490+0000","last_fullsized":"2023-10-03T10:10:37.662490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655708+0000","last_change":"2023-10-03T10:09:46.385510+0000","last_active":"2023-10-03T10:10:37.655708+0000","last_peered":"2023-10-03T10:10:37.655708+0000","last_clean":"2023-10-03T10:10:37.655708+0000","last_became_active":"2023-10-03T10:09:46.385254+0000","last_became_peered":"2023-10-03T10:09:46.385254+0000","last_unstale":"2023-10-03T10:10:37.655708+0000","last_undegraded":"2023-10-03T10:10:37.655708+0000","last_fullsized":"2023-10-03T10:10:37.655708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.654036+0000","last_change":"2023-10-03T10:09:46.370858+0000","last_active":"2023-10-03T10:10:37.654036+0000","last_peered":"2023-10-03T10:10:37.654036+0000","last_clean":"2023-10-03T10:10:37.654036+0000","last_became_active":"2023-10-03T10:09:46.367104+0000","last_became_peered":"2023-10-03T10:09:46.367104+0000","last_unstale":"2023-10-03T10:10:37.654036+0000","last_undegraded":"2023-10-03T10:10:37.654036+0000","last_fullsized":"2023-10-03T10:10:37.654036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:10:37.655545+0000","last_change":"2023-10-03T10:09:46.371241+0000","last_active":"2023-10-03T10:10:37.655545+0000","last_peered":"2023-10-03T10:10:37.655545+0000","last_clean":"2023-10-03T10:10:37.655545+0000","last_became_active":"2023-10-03T10:09:46.370691+0000","last_became_peered":"2023-10-03T10:09:46.370691+0000","last_unstale":"2023-10-03T10:10:37.655545+0000","last_undegraded":"2023-10-03T10:10:37.655545+0000","last_fullsized":"2023-10-03T10:10:37.655545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:09:45.971109+0000","last_clean_scrub_stamp":"2023-10-03T10:09:45.971109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705696,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297292,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074548,"statfs":{"total":96636764160,"available":96332337152,"internally_reserved":0,"allocated":200704,"data_stored":67217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:40 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29199999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"last":0.219},{"interface":"front","average":{"1min":0.314,"5min":0.308,"15min":0.307},"min":{"1min":0.246,"5min":0.192,"15min":0.192},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.27500000000000002}]},{"osd":1,"last update":"Tue Oct 3 10:11:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.24099999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.26300000000000001}]},{"osd":2,"last update":"Tue Oct 3 10:11:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.27500000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.313},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.34399999999999997,"15min":0.34499999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.254}]}]},{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":67023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:42 2023","interfaces":[{"interface":"back","average":{"1min":0.28100000000000003,"5min":0.26900000000000002,"15min":0.26700000000000002},"min":{"1min":0.20899999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.29899999999999999,"5min":0.28899999999999998,"15min":0.28699999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.25600000000000001}]},{"osd":1,"last update":"Tue Oct 3 10:11:42 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.314,"15min":0.314},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.42299999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.26800000000000002}]},{"osd":3,"last update":"Tue Oct 3 10:11:42 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.313,"15min":0.313},"min":{"1min":0.25800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.219},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"last":0.246}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":63191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 10:11:43 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.28899999999999998,"15min":0.28699999999999998},"min":{"1min":0.246,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.41999999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.316,"5min":0.30499999999999999,"15min":0.30299999999999999},"min":{"1min":0.248,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.66600000000000004}]},{"osd":2,"last update":"Tue Oct 3 10:11:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.312,"15min":0.31},"min":{"1min":0.253,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.44800000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.31900000000000001,"15min":0.316},"min":{"1min":0.245,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.377}]},{"osd":3,"last update":"Tue Oct 3 10:11:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33000000000000002},"min":{"1min":0.30299999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.314,"15min":0.31},"min":{"1min":0.26700000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.59499999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705696,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":64106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:11:42 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.28999999999999998,"15min":0.28699999999999998},"min":{"1min":0.20799999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.44700000000000001,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.315},"min":{"1min":0.27400000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.35399999999999998}]},{"osd":2,"last update":"Tue Oct 3 10:11:42 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28000000000000003},"min":{"1min":0.23400000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.30399999999999999,"15min":0.29999999999999999},"min":{"1min":0.245,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.495,"5min":0.498,"15min":0.498},"last":0.33000000000000002}]},{"osd":3,"last update":"Tue Oct 3 10:11:42 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.29799999999999999,"15min":0.29599999999999999},"min":{"1min":0.23799999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.316,"15min":0.31},"min":{"1min":0.251,"5min":0.218,"15min":0.218},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.36899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:12:10.061 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-03T10:12:10.061 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-03T10:12:10.062 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-03T10:12:10.062 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-03T10:12:10.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.216+0000 7f7343fea700 1 Processor -- start 2023-10-03T10:12:10.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.216+0000 7f7343fea700 1 -- start start 2023-10-03T10:12:10.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7343fea700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f733c133420 0x7f733c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7343fea700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f733c133e30 0x7f733c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7343fea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f733c134260 0x7f733c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7343fea700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733c06b990 con 0x7f733c133e30 2023-10-03T10:12:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7343fea700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733c0a0590 con 0x7f733c133420 2023-10-03T10:12:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7343fea700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f733c09fb80 con 0x7f733c134260 2023-10-03T10:12:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7341585700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f733c133e30 0x7f733c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7341d86700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f733c133420 0x7f733c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7342587700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f733c134260 0x7f733c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7341d86700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f733c133420 0x7f733c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58052/0 (socket says 172.21.15.72:58052) 2023-10-03T10:12:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7341585700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f733c133e30 0x7f733c12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44076/0 (socket says 172.21.15.72:44076) 2023-10-03T10:12:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7341d86700 1 -- 172.21.15.72:0/4137345755 learned_addr learned my addr 172.21.15.72:0/4137345755 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7342587700 1 -- 172.21.15.72:0/4137345755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f733c133420 msgr2=0x7f733c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:10.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7342587700 1 --2- 172.21.15.72:0/4137345755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f733c133420 0x7f733c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7342587700 1 -- 172.21.15.72:0/4137345755 >> v2:172.21.15.72:3300/0 conn(0x7f733c133e30 msgr2=0x7f733c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:10.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7342587700 1 --2- 172.21.15.72:0/4137345755 >> v2:172.21.15.72:3300/0 conn(0x7f733c133e30 0x7f733c12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7342587700 1 -- 172.21.15.72:0/4137345755 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c0a0030 con 0x7f733c134260 2023-10-03T10:12:10.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7341d86700 1 --2- 172.21.15.72:0/4137345755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f733c133420 0x7f733c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:10.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7341585700 1 --2- 172.21.15.72:0/4137345755 >> v2:172.21.15.72:3300/0 conn(0x7f733c133e30 0x7f733c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:10.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.217+0000 7f7342587700 1 --2- 172.21.15.72:0/4137345755 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f733c134260 0x7f733c1304d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7334009d90 tx=0x7f733400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=591df10414fe192a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:10.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.218+0000 7f7340d84700 1 -- 172.21.15.72:0/4137345755 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733400e070 con 0x7f733c134260 2023-10-03T10:12:10.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.218+0000 7f7340d84700 1 -- 172.21.15.72:0/4137345755 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733400bb20 con 0x7f733c134260 2023-10-03T10:12:10.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.218+0000 7f7340d84700 1 -- 172.21.15.72:0/4137345755 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7334012430 con 0x7f733c134260 2023-10-03T10:12:10.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.218+0000 7f7343fea700 1 -- 172.21.15.72:0/4137345755 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f733c134260 msgr2=0x7f733c1304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.218+0000 7f7343fea700 1 --2- 172.21.15.72:0/4137345755 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f733c134260 0x7f733c1304d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7334009d90 tx=0x7f733400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:10.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.218+0000 7f7343fea700 1 -- 172.21.15.72:0/4137345755 shutdown_connections 2023-10-03T10:12:10.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.218+0000 7f7343fea700 1 --2- 172.21.15.72:0/4137345755 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f733c134260 0x7f733c1304d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.218+0000 7f7343fea700 1 --2- 172.21.15.72:0/4137345755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f733c133420 0x7f733c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.218+0000 7f7343fea700 1 --2- 172.21.15.72:0/4137345755 >> v2:172.21.15.72:3300/0 conn(0x7f733c133e30 0x7f733c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.218+0000 7f7343fea700 1 -- 172.21.15.72:0/4137345755 >> 172.21.15.72:0/4137345755 conn(0x7f733c0a4210 msgr2=0x7f733c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:10.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.218+0000 7f7343fea700 1 -- 172.21.15.72:0/4137345755 shutdown_connections 2023-10-03T10:12:10.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.218+0000 7f7343fea700 1 -- 172.21.15.72:0/4137345755 wait complete. 2023-10-03T10:12:10.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.219+0000 7f7343fea700 1 Processor -- start 2023-10-03T10:12:10.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.219+0000 7f7343fea700 1 -- start start 2023-10-03T10:12:10.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.219+0000 7f7343fea700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f733c133420 0x7f733c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.219+0000 7f7343fea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f733c133e30 0x7f733c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7343fea700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f733c134260 0x7f733c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7343fea700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c11f990 con 0x7f733c134260 2023-10-03T10:12:10.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7343fea700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733c11fbd0 con 0x7f733c133420 2023-10-03T10:12:10.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7343fea700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f733c09df00 con 0x7f733c133e30 2023-10-03T10:12:10.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7341d86700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f733c133420 0x7f733c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7341585700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f733c133e30 0x7f733c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7342587700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f733c134260 0x7f733c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7341d86700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f733c133420 0x7f733c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58060/0 (socket says 172.21.15.72:58060) 2023-10-03T10:12:10.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7341585700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f733c133e30 0x7f733c09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47148/0 (socket says 172.21.15.72:47148) 2023-10-03T10:12:10.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7341d86700 1 -- 172.21.15.72:0/4187143756 learned_addr learned my addr 172.21.15.72:0/4187143756 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:10.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7342587700 1 -- 172.21.15.72:0/4187143756 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f733c133e30 msgr2=0x7f733c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7342587700 1 --2- 172.21.15.72:0/4187143756 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f733c133e30 0x7f733c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7342587700 1 -- 172.21.15.72:0/4187143756 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f733c133420 msgr2=0x7f733c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7342587700 1 --2- 172.21.15.72:0/4187143756 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f733c133420 0x7f733c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7342587700 1 -- 172.21.15.72:0/4187143756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c009550 con 0x7f733c134260 2023-10-03T10:12:10.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7341d86700 1 --2- 172.21.15.72:0/4187143756 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f733c133420 0x7f733c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:10.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7342587700 1 --2- 172.21.15.72:0/4187143756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f733c134260 0x7f733c09cf00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7334016000 tx=0x7f7334004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f73327fc700 1 -- 172.21.15.72:0/4187143756 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7334012430 con 0x7f733c134260 2023-10-03T10:12:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f73327fc700 1 -- 172.21.15.72:0/4187143756 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7334020070 con 0x7f733c134260 2023-10-03T10:12:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f73327fc700 1 -- 172.21.15.72:0/4187143756 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7334012e40 con 0x7f733c134260 2023-10-03T10:12:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7343fea700 1 -- 172.21.15.72:0/4187143756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73380094a0 con 0x7f733c134260 2023-10-03T10:12:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.220+0000 7f7343fea700 1 -- 172.21.15.72:0/4187143756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7334009a70 con 0x7f733c134260 2023-10-03T10:12:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.221+0000 7f73327fc700 1 -- 172.21.15.72:0/4187143756 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7334004040 con 0x7f733c134260 2023-10-03T10:12:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.221+0000 7f73327fc700 1 -- 172.21.15.72:0/4187143756 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f7334022070 con 0x7f733c134260 2023-10-03T10:12:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.221+0000 7f7343fea700 1 -- 172.21.15.72:0/4187143756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733c074ea0 con 0x7f733c134260 2023-10-03T10:12:10.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.226+0000 7f73327fc700 1 -- 172.21.15.72:0/4187143756 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f733401c400 con 0x7f733c134260 2023-10-03T10:12:10.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.453+0000 7f7343fea700 1 -- 172.21.15.72:0/4187143756 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f733c06b250 con 0x7f733c134260 2023-10-03T10:12:10.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.454+0000 7f73327fc700 1 -- 172.21.15.72:0/4187143756 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f73340263e0 con 0x7f733c134260 2023-10-03T10:12:10.455 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:10.455 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-03T10:12:10.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.456+0000 7f7343fea700 1 -- 172.21.15.72:0/4187143756 >> v1:172.21.15.72:6816/126756 conn(0x7f732002f510 legacy=0x7f73200319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.456+0000 7f7343fea700 1 -- 172.21.15.72:0/4187143756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f733c134260 msgr2=0x7f733c09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.456+0000 7f7343fea700 1 --2- 172.21.15.72:0/4187143756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f733c134260 0x7f733c09cf00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7334016000 tx=0x7f7334004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.456+0000 7f7343fea700 1 -- 172.21.15.72:0/4187143756 shutdown_connections 2023-10-03T10:12:10.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.456+0000 7f7343fea700 1 --2- 172.21.15.72:0/4187143756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f733c134260 0x7f733c09cf00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.456+0000 7f7343fea700 1 --2- 172.21.15.72:0/4187143756 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f733c133420 0x7f733c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.456+0000 7f7343fea700 1 --2- 172.21.15.72:0/4187143756 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f733c133e30 0x7f733c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.456+0000 7f7343fea700 1 -- 172.21.15.72:0/4187143756 >> 172.21.15.72:0/4187143756 conn(0x7f733c0a4210 msgr2=0x7f733c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:10.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.456+0000 7f7343fea700 1 -- 172.21.15.72:0/4187143756 shutdown_connections 2023-10-03T10:12:10.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.456+0000 7f7343fea700 1 -- 172.21.15.72:0/4187143756 wait complete. 2023-10-03T10:12:10.468 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-03T10:12:10.469 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:10.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.588+0000 7f36f57ed700 1 Processor -- start 2023-10-03T10:12:10.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.588+0000 7f36f57ed700 1 -- start start 2023-10-03T10:12:10.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36f57ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36f009d630 0x7f36f00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36f57ed700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36f0138d80 0x7f36f013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36f57ed700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f00a2a70 con 0x7f36f00a0a30 2023-10-03T10:12:10.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36f57ed700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f00a01d0 con 0x7f36f0138d80 2023-10-03T10:12:10.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36f57ed700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f009e2b0 con 0x7f36f009d630 2023-10-03T10:12:10.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36ee7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36f009d630 0x7f36f00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36ef7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36f0138d80 0x7f36f013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36ee7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36f009d630 0x7f36f00a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58072/0 (socket says 172.21.15.72:58072) 2023-10-03T10:12:10.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36eeffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f36f00a0a30 0x7f36f00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47930/0 (socket says 172.21.15.72:47930) 2023-10-03T10:12:10.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36ef7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36f0138d80 0x7f36f013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44092/0 (socket says 172.21.15.72:44092) 2023-10-03T10:12:10.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36ee7fc700 1 -- 172.21.15.72:0/3276008320 learned_addr learned my addr 172.21.15.72:0/3276008320 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:10.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36ee7fc700 1 -- 172.21.15.72:0/3276008320 >> v2:172.21.15.72:3300/0 conn(0x7f36f0138d80 msgr2=0x7f36f013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:10.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36ee7fc700 1 --2- 172.21.15.72:0/3276008320 >> v2:172.21.15.72:3300/0 conn(0x7f36f0138d80 0x7f36f013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36ee7fc700 1 -- 172.21.15.72:0/3276008320 >> v1:172.21.15.72:6789/0 conn(0x7f36f00a0a30 legacy=0x7f36f00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36ee7fc700 1 -- 172.21.15.72:0/3276008320 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f009dc50 con 0x7f36f009d630 2023-10-03T10:12:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36ef7fe700 1 --2- 172.21.15.72:0/3276008320 >> v2:172.21.15.72:3300/0 conn(0x7f36f0138d80 0x7f36f013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36ee7fc700 1 --2- 172.21.15.72:0/3276008320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36f009d630 0x7f36f00a1510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f36e00098f0 tx=0x7f36e0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82ccc3ad175468b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.589+0000 7f36edffb700 1 -- 172.21.15.72:0/3276008320 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e0011830 con 0x7f36f009d630 2023-10-03T10:12:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.590+0000 7f36edffb700 1 -- 172.21.15.72:0/3276008320 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e0011990 con 0x7f36f009d630 2023-10-03T10:12:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.590+0000 7f36edffb700 1 -- 172.21.15.72:0/3276008320 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e0011d20 con 0x7f36f009d630 2023-10-03T10:12:10.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.590+0000 7f36f57ed700 1 -- 172.21.15.72:0/3276008320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36f009d630 msgr2=0x7f36f00a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.590+0000 7f36f57ed700 1 --2- 172.21.15.72:0/3276008320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36f009d630 0x7f36f00a1510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f36e00098f0 tx=0x7f36e0009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:10.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.590+0000 7f36f57ed700 1 -- 172.21.15.72:0/3276008320 shutdown_connections 2023-10-03T10:12:10.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.590+0000 7f36f57ed700 1 --2- 172.21.15.72:0/3276008320 >> v2:172.21.15.72:3300/0 conn(0x7f36f0138d80 0x7f36f013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.590+0000 7f36f57ed700 1 --2- 172.21.15.72:0/3276008320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36f009d630 0x7f36f00a1510 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.590+0000 7f36f57ed700 1 -- 172.21.15.72:0/3276008320 >> 172.21.15.72:0/3276008320 conn(0x7f36f00a3050 msgr2=0x7f36f00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:10.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.590+0000 7f36f57ed700 1 -- 172.21.15.72:0/3276008320 shutdown_connections 2023-10-03T10:12:10.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.590+0000 7f36f57ed700 1 -- 172.21.15.72:0/3276008320 wait complete. 2023-10-03T10:12:10.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.591+0000 7f36f57ed700 1 Processor -- start 2023-10-03T10:12:10.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.591+0000 7f36f57ed700 1 -- start start 2023-10-03T10:12:10.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36f57ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36f009d630 0x7f36f0133b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36f57ed700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36f00a0a30 0x7f36f0134090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36f57ed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f0138d80 0x7f36f01345d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36f57ed700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0135010 con 0x7f36f0138d80 2023-10-03T10:12:10.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36f57ed700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f013afc0 con 0x7f36f009d630 2023-10-03T10:12:10.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36f57ed700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0135c30 con 0x7f36f00a0a30 2023-10-03T10:12:10.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36eeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36f009d630 0x7f36f0133b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36ef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f0138d80 0x7f36f01345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36eeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36f009d630 0x7f36f0133b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58078/0 (socket says 172.21.15.72:58078) 2023-10-03T10:12:10.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36eeffd700 1 -- 172.21.15.72:0/1365797176 learned_addr learned my addr 172.21.15.72:0/1365797176 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:10.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36ee7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36f00a0a30 0x7f36f0134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36ef7fe700 1 -- 172.21.15.72:0/1365797176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36f00a0a30 msgr2=0x7f36f0134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36ef7fe700 1 --2- 172.21.15.72:0/1365797176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36f00a0a30 0x7f36f0134090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36ef7fe700 1 -- 172.21.15.72:0/1365797176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36f009d630 msgr2=0x7f36f0133b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36ef7fe700 1 --2- 172.21.15.72:0/1365797176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36f009d630 0x7f36f0133b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36ef7fe700 1 -- 172.21.15.72:0/1365797176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e8009a70 con 0x7f36f0138d80 2023-10-03T10:12:10.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36eeffd700 1 --2- 172.21.15.72:0/1365797176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36f009d630 0x7f36f0133b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:10.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36ee7fc700 1 --2- 172.21.15.72:0/1365797176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36f00a0a30 0x7f36f0134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:10.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36ef7fe700 1 --2- 172.21.15.72:0/1365797176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f0138d80 0x7f36f01345d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f36e800efc0 tx=0x7f36e800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:10.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36e77fe700 1 -- 172.21.15.72:0/1365797176 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e800ca90 con 0x7f36f0138d80 2023-10-03T10:12:10.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36e77fe700 1 -- 172.21.15.72:0/1365797176 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e800f040 con 0x7f36f0138d80 2023-10-03T10:12:10.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36f57ed700 1 -- 172.21.15.72:0/1365797176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e0009550 con 0x7f36f0138d80 2023-10-03T10:12:10.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36e77fe700 1 -- 172.21.15.72:0/1365797176 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e800ce30 con 0x7f36f0138d80 2023-10-03T10:12:10.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.592+0000 7f36f57ed700 1 -- 172.21.15.72:0/1365797176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f0137590 con 0x7f36f0138d80 2023-10-03T10:12:10.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.593+0000 7f36e77fe700 1 -- 172.21.15.72:0/1365797176 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f36e8014480 con 0x7f36f0138d80 2023-10-03T10:12:10.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.593+0000 7f36e77fe700 1 -- 172.21.15.72:0/1365797176 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f36e8040250 con 0x7f36f0138d80 2023-10-03T10:12:10.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.593+0000 7f36f57ed700 1 -- 172.21.15.72:0/1365797176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f00747f0 con 0x7f36f0138d80 2023-10-03T10:12:10.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.598+0000 7f36e77fe700 1 -- 172.21.15.72:0/1365797176 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36e8018080 con 0x7f36f0138d80 2023-10-03T10:12:10.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.782+0000 7f36f57ed700 1 -- 172.21.15.72:0/1365797176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36f0072980 con 0x7f36f0138d80 2023-10-03T10:12:10.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.783+0000 7f36e77fe700 1 -- 172.21.15.72:0/1365797176 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12864 (secure 0 0 0) 0x7f36e803ee60 con 0x7f36f0138d80 2023-10-03T10:12:10.784 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:10.784 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":23,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:12:08.075987+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":0}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":0}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6816/118184":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/3319279924":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/2966012812":"2023-10-04T10:12:06.073551+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:10.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.785+0000 7f36f57ed700 1 -- 172.21.15.72:0/1365797176 >> v1:172.21.15.72:6816/126756 conn(0x7f36d002f510 legacy=0x7f36d00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.785+0000 7f36f57ed700 1 -- 172.21.15.72:0/1365797176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f0138d80 msgr2=0x7f36f01345d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.785+0000 7f36f57ed700 1 --2- 172.21.15.72:0/1365797176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f0138d80 0x7f36f01345d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f36e800efc0 tx=0x7f36e800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.785+0000 7f36f57ed700 1 -- 172.21.15.72:0/1365797176 shutdown_connections 2023-10-03T10:12:10.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.785+0000 7f36f57ed700 1 --2- 172.21.15.72:0/1365797176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36f0138d80 0x7f36f01345d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.785+0000 7f36f57ed700 1 --2- 172.21.15.72:0/1365797176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36f009d630 0x7f36f0133b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.785+0000 7f36f57ed700 1 --2- 172.21.15.72:0/1365797176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36f00a0a30 0x7f36f0134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.785+0000 7f36f57ed700 1 -- 172.21.15.72:0/1365797176 >> 172.21.15.72:0/1365797176 conn(0x7f36f00a3050 msgr2=0x7f36f009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:10.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.785+0000 7f36f57ed700 1 -- 172.21.15.72:0/1365797176 shutdown_connections 2023-10-03T10:12:10.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.785+0000 7f36f57ed700 1 -- 172.21.15.72:0/1365797176 wait complete. 2023-10-03T10:12:10.797 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:38.963446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:40.092839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:44.713857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:45.314387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:12:10.798 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:12:10.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.921+0000 7f1addae0700 1 Processor -- start 2023-10-03T10:12:10.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.921+0000 7f1addae0700 1 -- start start 2023-10-03T10:12:10.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.921+0000 7f1addae0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ad8131c20 0x7f1ad8131ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.921+0000 7f1addae0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ad809bc50 0x7f1ad809c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.921+0000 7f1addae0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ad809c5a0 0x7f1ad8138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.921+0000 7f1addae0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad809ec00 con 0x7f1ad809bc50 2023-10-03T10:12:10.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.921+0000 7f1addae0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad806ee30 con 0x7f1ad8131c20 2023-10-03T10:12:10.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.921+0000 7f1addae0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8131780 con 0x7f1ad809c5a0 2023-10-03T10:12:10.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.921+0000 7f1ad7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ad809c5a0 0x7f1ad8138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.921+0000 7f1ad6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ad809bc50 0x7f1ad809c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.921+0000 7f1ad77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ad8131c20 0x7f1ad8131ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.921+0000 7f1ad7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ad809c5a0 0x7f1ad8138ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47158/0 (socket says 172.21.15.72:47158) 2023-10-03T10:12:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.921+0000 7f1ad6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ad809bc50 0x7f1ad809c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44124/0 (socket says 172.21.15.72:44124) 2023-10-03T10:12:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.921+0000 7f1ad7fff700 1 -- 172.21.15.72:0/1344315994 learned_addr learned my addr 172.21.15.72:0/1344315994 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1ad7fff700 1 -- 172.21.15.72:0/1344315994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ad8131c20 msgr2=0x7f1ad8131ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1ad7fff700 1 --2- 172.21.15.72:0/1344315994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ad8131c20 0x7f1ad8131ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1ad7fff700 1 -- 172.21.15.72:0/1344315994 >> v2:172.21.15.72:3300/0 conn(0x7f1ad809bc50 msgr2=0x7f1ad809c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1ad7fff700 1 --2- 172.21.15.72:0/1344315994 >> v2:172.21.15.72:3300/0 conn(0x7f1ad809bc50 0x7f1ad809c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1ad7fff700 1 -- 172.21.15.72:0/1344315994 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad8131a20 con 0x7f1ad809c5a0 2023-10-03T10:12:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1ad77fe700 1 --2- 172.21.15.72:0/1344315994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ad8131c20 0x7f1ad8131ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1ad6ffd700 1 --2- 172.21.15.72:0/1344315994 >> v2:172.21.15.72:3300/0 conn(0x7f1ad809bc50 0x7f1ad809c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1ad7fff700 1 --2- 172.21.15.72:0/1344315994 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ad809c5a0 0x7f1ad8138ab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0009e50 tx=0x7f1ad000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23239fc3630d9eb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1ad67fc700 1 -- 172.21.15.72:0/1344315994 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000e070 con 0x7f1ad809c5a0 2023-10-03T10:12:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1ad67fc700 1 -- 172.21.15.72:0/1344315994 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad000b910 con 0x7f1ad809c5a0 2023-10-03T10:12:10.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1ad67fc700 1 -- 172.21.15.72:0/1344315994 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000bcc0 con 0x7f1ad809c5a0 2023-10-03T10:12:10.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1addae0700 1 -- 172.21.15.72:0/1344315994 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ad809c5a0 msgr2=0x7f1ad8138ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1addae0700 1 --2- 172.21.15.72:0/1344315994 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ad809c5a0 0x7f1ad8138ab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0009e50 tx=0x7f1ad000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:10.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1addae0700 1 -- 172.21.15.72:0/1344315994 shutdown_connections 2023-10-03T10:12:10.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1addae0700 1 --2- 172.21.15.72:0/1344315994 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ad809c5a0 0x7f1ad8138ab0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1addae0700 1 --2- 172.21.15.72:0/1344315994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ad8131c20 0x7f1ad8131ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1addae0700 1 --2- 172.21.15.72:0/1344315994 >> v2:172.21.15.72:3300/0 conn(0x7f1ad809bc50 0x7f1ad809c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.922+0000 7f1addae0700 1 -- 172.21.15.72:0/1344315994 >> 172.21.15.72:0/1344315994 conn(0x7f1ad80a2c10 msgr2=0x7f1ad80a3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:10.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.923+0000 7f1addae0700 1 -- 172.21.15.72:0/1344315994 shutdown_connections 2023-10-03T10:12:10.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.923+0000 7f1addae0700 1 -- 172.21.15.72:0/1344315994 wait complete. 2023-10-03T10:12:10.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.923+0000 7f1addae0700 1 Processor -- start 2023-10-03T10:12:10.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1addae0700 1 -- start start 2023-10-03T10:12:10.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1addae0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ad809bc50 0x7f1ad8099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1addae0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ad809c5a0 0x7f1ad8099f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1addae0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad8131c20 0x7f1ad809a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:10.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1addae0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad811e510 con 0x7f1ad8131c20 2023-10-03T10:12:10.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1addae0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad811e6f0 con 0x7f1ad809bc50 2023-10-03T10:12:10.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1addae0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad812c5e0 con 0x7f1ad809c5a0 2023-10-03T10:12:10.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1ad77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ad809bc50 0x7f1ad8099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1ad7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad8131c20 0x7f1ad809a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1ad6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ad809c5a0 0x7f1ad8099f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:10.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1ad77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ad809bc50 0x7f1ad8099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58088/0 (socket says 172.21.15.72:58088) 2023-10-03T10:12:10.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1ad77fe700 1 -- 172.21.15.72:0/3245900898 learned_addr learned my addr 172.21.15.72:0/3245900898 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:10.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1ad7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad8131c20 0x7f1ad809a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44130/0 (socket says 172.21.15.72:44130) 2023-10-03T10:12:10.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1ad77fe700 1 -- 172.21.15.72:0/3245900898 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ad809c5a0 msgr2=0x7f1ad8099f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1ad77fe700 1 --2- 172.21.15.72:0/3245900898 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ad809c5a0 0x7f1ad8099f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1ad77fe700 1 -- 172.21.15.72:0/3245900898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad8131c20 msgr2=0x7f1ad809a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1ad77fe700 1 --2- 172.21.15.72:0/3245900898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad8131c20 0x7f1ad809a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.924+0000 7f1ad77fe700 1 -- 172.21.15.72:0/3245900898 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc0094a0 con 0x7f1ad809bc50 2023-10-03T10:12:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.925+0000 7f1ad77fe700 1 --2- 172.21.15.72:0/3245900898 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ad809bc50 0x7f1ad8099a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800ebe0 tx=0x7f1ac800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.925+0000 7f1abffff700 1 -- 172.21.15.72:0/3245900898 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800c850 con 0x7f1ad809bc50 2023-10-03T10:12:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.925+0000 7f1abffff700 1 -- 172.21.15.72:0/3245900898 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac800c9b0 con 0x7f1ad809bc50 2023-10-03T10:12:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.925+0000 7f1addae0700 1 -- 172.21.15.72:0/3245900898 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac80094a0 con 0x7f1ad809bc50 2023-10-03T10:12:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.925+0000 7f1abffff700 1 -- 172.21.15.72:0/3245900898 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800cd40 con 0x7f1ad809bc50 2023-10-03T10:12:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.925+0000 7f1addae0700 1 -- 172.21.15.72:0/3245900898 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad0009b30 con 0x7f1ad809bc50 2023-10-03T10:12:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.926+0000 7f1abffff700 1 -- 172.21.15.72:0/3245900898 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1ac8013470 con 0x7f1ad809bc50 2023-10-03T10:12:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.926+0000 7f1abffff700 1 -- 172.21.15.72:0/3245900898 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f1ac803ff40 con 0x7f1ad809bc50 2023-10-03T10:12:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.926+0000 7f1addae0700 1 -- 172.21.15.72:0/3245900898 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad804f2a0 con 0x7f1ad809bc50 2023-10-03T10:12:10.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:10.931+0000 7f1abffff700 1 -- 172.21.15.72:0/3245900898 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ac8013720 con 0x7f1ad809bc50 2023-10-03T10:12:11.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.114+0000 7f1addae0700 1 -- 172.21.15.72:0/3245900898 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ad811e370 con 0x7f1ad809bc50 2023-10-03T10:12:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.114+0000 7f1abffff700 1 -- 172.21.15.72:0/3245900898 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ad811e370 con 0x7f1ad809bc50 2023-10-03T10:12:11.115 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-03T10:12:11.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.116+0000 7f1addae0700 1 -- 172.21.15.72:0/3245900898 >> v1:172.21.15.72:6816/126756 conn(0x7f1ac402f510 legacy=0x7f1ac40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.116+0000 7f1addae0700 1 -- 172.21.15.72:0/3245900898 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ad809bc50 msgr2=0x7f1ad8099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.116+0000 7f1addae0700 1 --2- 172.21.15.72:0/3245900898 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ad809bc50 0x7f1ad8099a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800ebe0 tx=0x7f1ac800eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.116+0000 7f1addae0700 1 -- 172.21.15.72:0/3245900898 shutdown_connections 2023-10-03T10:12:11.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.116+0000 7f1addae0700 1 --2- 172.21.15.72:0/3245900898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ad8131c20 0x7f1ad809a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.116+0000 7f1addae0700 1 --2- 172.21.15.72:0/3245900898 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ad809bc50 0x7f1ad8099a40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.116+0000 7f1addae0700 1 --2- 172.21.15.72:0/3245900898 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1ad809c5a0 0x7f1ad8099f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.117+0000 7f1addae0700 1 -- 172.21.15.72:0/3245900898 >> 172.21.15.72:0/3245900898 conn(0x7f1ad80a2c10 msgr2=0x7f1ad812eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:11.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.117+0000 7f1addae0700 1 -- 172.21.15.72:0/3245900898 shutdown_connections 2023-10-03T10:12:11.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.117+0000 7f1addae0700 1 -- 172.21.15.72:0/3245900898 wait complete. 2023-10-03T10:12:11.129 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:12:11.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.252+0000 7f2db6c8d700 1 Processor -- start 2023-10-03T10:12:11.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.252+0000 7f2db6c8d700 1 -- start start 2023-10-03T10:12:11.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.252+0000 7f2db6c8d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2db0134a90 0x7f2db0136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.252+0000 7f2db6c8d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db01373b0 0x7f2db0139790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.252+0000 7f2db6c8d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db009ec00 con 0x7f2db0131c20 2023-10-03T10:12:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.252+0000 7f2db6c8d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db0132700 con 0x7f2db0134a90 2023-10-03T10:12:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.252+0000 7f2db6c8d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db006ee30 con 0x7f2db01373b0 2023-10-03T10:12:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.252+0000 7f2db522a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db01373b0 0x7f2db0139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.252+0000 7f2daffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2db0134a90 0x7f2db0136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.252+0000 7f2db4a29700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2db0131c20 0x7f2db0131ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47938/0 (socket says 172.21.15.72:47938) 2023-10-03T10:12:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.252+0000 7f2db4a29700 1 -- 172.21.15.72:0/4049735637 learned_addr learned my addr 172.21.15.72:0/4049735637 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.252+0000 7f2db522a700 1 --2- 172.21.15.72:0/4049735637 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db01373b0 0x7f2db0139790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58098/0 (socket says 172.21.15.72:58098) 2023-10-03T10:12:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.253+0000 7f2db522a700 1 -- 172.21.15.72:0/4049735637 >> v2:172.21.15.72:3300/0 conn(0x7f2db0134a90 msgr2=0x7f2db0136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.253+0000 7f2db522a700 1 --2- 172.21.15.72:0/4049735637 >> v2:172.21.15.72:3300/0 conn(0x7f2db0134a90 0x7f2db0136e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.253+0000 7f2db522a700 1 -- 172.21.15.72:0/4049735637 >> v1:172.21.15.72:6789/0 conn(0x7f2db0131c20 legacy=0x7f2db0131ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.253+0000 7f2db522a700 1 -- 172.21.15.72:0/4049735637 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db0131780 con 0x7f2db01373b0 2023-10-03T10:12:11.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.253+0000 7f2daffff700 1 --2- 172.21.15.72:0/4049735637 >> v2:172.21.15.72:3300/0 conn(0x7f2db0134a90 0x7f2db0136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:11.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.253+0000 7f2db522a700 1 --2- 172.21.15.72:0/4049735637 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db01373b0 0x7f2db0139790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009d90 tx=0x7f2da800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fce80bd359247b31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:11.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.253+0000 7f2daf7fe700 1 -- 172.21.15.72:0/4049735637 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da800e070 con 0x7f2db01373b0 2023-10-03T10:12:11.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.253+0000 7f2daf7fe700 1 -- 172.21.15.72:0/4049735637 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da800bb20 con 0x7f2db01373b0 2023-10-03T10:12:11.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.253+0000 7f2daf7fe700 1 -- 172.21.15.72:0/4049735637 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8012430 con 0x7f2db01373b0 2023-10-03T10:12:11.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.253+0000 7f2db6c8d700 1 -- 172.21.15.72:0/4049735637 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db01373b0 msgr2=0x7f2db0139790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.253+0000 7f2db6c8d700 1 --2- 172.21.15.72:0/4049735637 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db01373b0 0x7f2db0139790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009d90 tx=0x7f2da800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:11.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.253+0000 7f2db6c8d700 1 -- 172.21.15.72:0/4049735637 shutdown_connections 2023-10-03T10:12:11.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.253+0000 7f2db6c8d700 1 --2- 172.21.15.72:0/4049735637 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db01373b0 0x7f2db0139790 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.253+0000 7f2db6c8d700 1 --2- 172.21.15.72:0/4049735637 >> v2:172.21.15.72:3300/0 conn(0x7f2db0134a90 0x7f2db0136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.253+0000 7f2db6c8d700 1 -- 172.21.15.72:0/4049735637 >> 172.21.15.72:0/4049735637 conn(0x7f2db00a2c10 msgr2=0x7f2db00a3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:11.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.254+0000 7f2db6c8d700 1 -- 172.21.15.72:0/4049735637 shutdown_connections 2023-10-03T10:12:11.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.254+0000 7f2db6c8d700 1 -- 172.21.15.72:0/4049735637 wait complete. 2023-10-03T10:12:11.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.255+0000 7f2db6c8d700 1 Processor -- start 2023-10-03T10:12:11.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.255+0000 7f2db6c8d700 1 -- start start 2023-10-03T10:12:11.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.255+0000 7f2db6c8d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0131c20 0x7f2db006f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.255+0000 7f2db6c8d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2db0134a90 0x7f2db006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db6c8d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2db01373b0 0x7f2db006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db6c8d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db012bfd0 con 0x7f2db01373b0 2023-10-03T10:12:11.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db6c8d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db0136f10 con 0x7f2db0131c20 2023-10-03T10:12:11.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db6c8d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2db0072020 con 0x7f2db0134a90 2023-10-03T10:12:11.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db4a29700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0131c20 0x7f2db006f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db4a29700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0131c20 0x7f2db006f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58114/0 (socket says 172.21.15.72:58114) 2023-10-03T10:12:11.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db4a29700 1 -- 172.21.15.72:0/1670037564 learned_addr learned my addr 172.21.15.72:0/1670037564 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:11.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db522a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2db01373b0 0x7f2db006fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2daffff700 1 --2- 172.21.15.72:0/1670037564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2db0134a90 0x7f2db006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db522a700 1 -- 172.21.15.72:0/1670037564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2db0134a90 msgr2=0x7f2db006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db522a700 1 --2- 172.21.15.72:0/1670037564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2db0134a90 0x7f2db006f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db522a700 1 -- 172.21.15.72:0/1670037564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0131c20 msgr2=0x7f2db006f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db522a700 1 --2- 172.21.15.72:0/1670037564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0131c20 0x7f2db006f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db522a700 1 -- 172.21.15.72:0/1670037564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c0094a0 con 0x7f2db01373b0 2023-10-03T10:12:11.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db4a29700 1 --2- 172.21.15.72:0/1670037564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0131c20 0x7f2db006f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:11.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db522a700 1 --2- 172.21.15.72:0/1670037564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2db01373b0 0x7f2db006fb20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2da8016000 tx=0x7f2da8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:11.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2dad7fa700 1 -- 172.21.15.72:0/1670037564 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8012430 con 0x7f2db01373b0 2023-10-03T10:12:11.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2dad7fa700 1 -- 172.21.15.72:0/1670037564 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da8020070 con 0x7f2db01373b0 2023-10-03T10:12:11.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db6c8d700 1 -- 172.21.15.72:0/1670037564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da8009a70 con 0x7f2db01373b0 2023-10-03T10:12:11.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2dad7fa700 1 -- 172.21.15.72:0/1670037564 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da80098f0 con 0x7f2db01373b0 2023-10-03T10:12:11.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.256+0000 7f2db6c8d700 1 -- 172.21.15.72:0/1670037564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db0118f60 con 0x7f2db01373b0 2023-10-03T10:12:11.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.257+0000 7f2dad7fa700 1 -- 172.21.15.72:0/1670037564 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2da8004040 con 0x7f2db01373b0 2023-10-03T10:12:11.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.257+0000 7f2dad7fa700 1 -- 172.21.15.72:0/1670037564 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f2da8022070 con 0x7f2db01373b0 2023-10-03T10:12:11.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.257+0000 7f2db6c8d700 1 -- 172.21.15.72:0/1670037564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db0119350 con 0x7f2db01373b0 2023-10-03T10:12:11.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.262+0000 7f2dad7fa700 1 -- 172.21.15.72:0/1670037564 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2da802c080 con 0x7f2db01373b0 2023-10-03T10:12:11.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.445+0000 7f2db6c8d700 1 -- 172.21.15.72:0/1670037564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2db004f2a0 con 0x7f2db01373b0 2023-10-03T10:12:11.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.445+0000 7f2dad7fa700 1 -- 172.21.15.72:0/1670037564 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2da80269d0 con 0x7f2db01373b0 2023-10-03T10:12:11.447 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-10-03T10:12:11.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.447+0000 7f2db6c8d700 1 -- 172.21.15.72:0/1670037564 >> v1:172.21.15.72:6816/126756 conn(0x7f2d9402f510 legacy=0x7f2d940319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.447+0000 7f2db6c8d700 1 -- 172.21.15.72:0/1670037564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2db01373b0 msgr2=0x7f2db006fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.447+0000 7f2db6c8d700 1 --2- 172.21.15.72:0/1670037564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2db01373b0 0x7f2db006fb20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2da8016000 tx=0x7f2da8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.448+0000 7f2db6c8d700 1 -- 172.21.15.72:0/1670037564 shutdown_connections 2023-10-03T10:12:11.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.448+0000 7f2db6c8d700 1 --2- 172.21.15.72:0/1670037564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2db01373b0 0x7f2db006fb20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.448+0000 7f2db6c8d700 1 --2- 172.21.15.72:0/1670037564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0131c20 0x7f2db006f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.448+0000 7f2db6c8d700 1 --2- 172.21.15.72:0/1670037564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2db0134a90 0x7f2db006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.448+0000 7f2db6c8d700 1 -- 172.21.15.72:0/1670037564 >> 172.21.15.72:0/1670037564 conn(0x7f2db00a2c10 msgr2=0x7f2db012feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:11.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.448+0000 7f2db6c8d700 1 -- 172.21.15.72:0/1670037564 shutdown_connections 2023-10-03T10:12:11.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.448+0000 7f2db6c8d700 1 -- 172.21.15.72:0/1670037564 wait complete. 2023-10-03T10:12:11.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:12:11.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.583+0000 7fba80eb3700 1 Processor -- start 2023-10-03T10:12:11.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.583+0000 7fba80eb3700 1 -- start start 2023-10-03T10:12:11.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.583+0000 7fba80eb3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba7c09e2b0 0x7fba7c135a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.583+0000 7fba80eb3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba7c135f60 0x7fba7c138340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.583+0000 7fba80eb3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c09b800 con 0x7fba7c09d7d0 2023-10-03T10:12:11.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.583+0000 7fba80eb3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c09b620 con 0x7fba7c135f60 2023-10-03T10:12:11.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.583+0000 7fba80eb3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c09f370 con 0x7fba7c09e2b0 2023-10-03T10:12:11.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.584+0000 7fba7a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fba7c09d7d0 0x7fba7c09dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47950/0 (socket says 172.21.15.72:47950) 2023-10-03T10:12:11.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.584+0000 7fba7ad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba7c135f60 0x7fba7c138340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.584+0000 7fba79d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba7c09e2b0 0x7fba7c135a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.584+0000 7fba7a59c700 1 -- 172.21.15.72:0/2262119377 learned_addr learned my addr 172.21.15.72:0/2262119377 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:11.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.584+0000 7fba7959a700 1 -- 172.21.15.72:0/2262119377 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938308539 0 0) 0x7fba7c09b800 con 0x7fba7c09d7d0 2023-10-03T10:12:11.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.584+0000 7fba7ad9d700 1 -- 172.21.15.72:0/2262119377 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba7c09e2b0 msgr2=0x7fba7c135a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:11.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.584+0000 7fba7ad9d700 1 --2- 172.21.15.72:0/2262119377 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba7c09e2b0 0x7fba7c135a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.584+0000 7fba7ad9d700 1 -- 172.21.15.72:0/2262119377 >> v1:172.21.15.72:6789/0 conn(0x7fba7c09d7d0 legacy=0x7fba7c09dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.584+0000 7fba7ad9d700 1 -- 172.21.15.72:0/2262119377 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c09ef80 con 0x7fba7c135f60 2023-10-03T10:12:11.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.584+0000 7fba79d9b700 1 --2- 172.21.15.72:0/2262119377 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba7c09e2b0 0x7fba7c135a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:11.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.584+0000 7fba7ad9d700 1 --2- 172.21.15.72:0/2262119377 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba7c135f60 0x7fba7c138340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba74009df0 tx=0x7fba7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2469836a84c024ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:11.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.584+0000 7fba7959a700 1 -- 172.21.15.72:0/2262119377 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7400e070 con 0x7fba7c135f60 2023-10-03T10:12:11.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.584+0000 7fba7959a700 1 -- 172.21.15.72:0/2262119377 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7400bae0 con 0x7fba7c135f60 2023-10-03T10:12:11.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.584+0000 7fba7959a700 1 -- 172.21.15.72:0/2262119377 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7400be90 con 0x7fba7c135f60 2023-10-03T10:12:11.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.585+0000 7fba80eb3700 1 -- 172.21.15.72:0/2262119377 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba7c135f60 msgr2=0x7fba7c138340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.585+0000 7fba80eb3700 1 --2- 172.21.15.72:0/2262119377 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba7c135f60 0x7fba7c138340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba74009df0 tx=0x7fba7400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:11.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.585+0000 7fba80eb3700 1 -- 172.21.15.72:0/2262119377 shutdown_connections 2023-10-03T10:12:11.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.585+0000 7fba80eb3700 1 --2- 172.21.15.72:0/2262119377 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba7c135f60 0x7fba7c138340 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.585+0000 7fba80eb3700 1 --2- 172.21.15.72:0/2262119377 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba7c09e2b0 0x7fba7c135a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.585+0000 7fba80eb3700 1 -- 172.21.15.72:0/2262119377 >> 172.21.15.72:0/2262119377 conn(0x7fba7c066d70 msgr2=0x7fba7c0a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.585+0000 7fba80eb3700 1 -- 172.21.15.72:0/2262119377 shutdown_connections 2023-10-03T10:12:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.585+0000 7fba80eb3700 1 -- 172.21.15.72:0/2262119377 wait complete. 2023-10-03T10:12:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.586+0000 7fba80eb3700 1 Processor -- start 2023-10-03T10:12:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.586+0000 7fba80eb3700 1 -- start start 2023-10-03T10:12:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.586+0000 7fba80eb3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba7c09d7d0 0x7fba7c11e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.586+0000 7fba80eb3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba7c09e2b0 0x7fba7c11e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.586+0000 7fba80eb3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba7c135f60 0x7fba7c11ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.586+0000 7fba80eb3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c11ffd0 con 0x7fba7c09d7d0 2023-10-03T10:12:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.586+0000 7fba80eb3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c121220 con 0x7fba7c135f60 2023-10-03T10:12:11.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.586+0000 7fba80eb3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c120830 con 0x7fba7c09e2b0 2023-10-03T10:12:11.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.586+0000 7fba79d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba7c09e2b0 0x7fba7c11e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.586+0000 7fba79d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba7c09e2b0 0x7fba7c11e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47206/0 (socket says 172.21.15.72:47206) 2023-10-03T10:12:11.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.586+0000 7fba79d9b700 1 -- 172.21.15.72:0/4261088403 learned_addr learned my addr 172.21.15.72:0/4261088403 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:11.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.586+0000 7fba7a59c700 1 --2- 172.21.15.72:0/4261088403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba7c09d7d0 0x7fba7c11e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.586+0000 7fba7ad9d700 1 --2- 172.21.15.72:0/4261088403 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba7c135f60 0x7fba7c11ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.587+0000 7fba79d9b700 1 -- 172.21.15.72:0/4261088403 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba7c135f60 msgr2=0x7fba7c11ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.587+0000 7fba79d9b700 1 --2- 172.21.15.72:0/4261088403 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba7c135f60 0x7fba7c11ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.587+0000 7fba79d9b700 1 -- 172.21.15.72:0/4261088403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba7c09d7d0 msgr2=0x7fba7c11e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.587+0000 7fba79d9b700 1 --2- 172.21.15.72:0/4261088403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba7c09d7d0 0x7fba7c11e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.587+0000 7fba79d9b700 1 -- 172.21.15.72:0/4261088403 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba700094a0 con 0x7fba7c09e2b0 2023-10-03T10:12:11.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.587+0000 7fba7a59c700 1 --2- 172.21.15.72:0/4261088403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba7c09d7d0 0x7fba7c11e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:11.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.587+0000 7fba79d9b700 1 --2- 172.21.15.72:0/4261088403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba7c09e2b0 0x7fba7c11e950 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fba7000ebe0 tx=0x7fba7000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:11.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.587+0000 7fba6affd700 1 -- 172.21.15.72:0/4261088403 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7000c850 con 0x7fba7c09e2b0 2023-10-03T10:12:11.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.587+0000 7fba6affd700 1 -- 172.21.15.72:0/4261088403 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7000c9b0 con 0x7fba7c09e2b0 2023-10-03T10:12:11.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.587+0000 7fba6affd700 1 -- 172.21.15.72:0/4261088403 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7000cd40 con 0x7fba7c09e2b0 2023-10-03T10:12:11.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.587+0000 7fba80eb3700 1 -- 172.21.15.72:0/4261088403 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba74009a70 con 0x7fba7c09e2b0 2023-10-03T10:12:11.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.587+0000 7fba80eb3700 1 -- 172.21.15.72:0/4261088403 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c121c50 con 0x7fba7c09e2b0 2023-10-03T10:12:11.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.588+0000 7fba6affd700 1 -- 172.21.15.72:0/4261088403 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fba70013470 con 0x7fba7c09e2b0 2023-10-03T10:12:11.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.588+0000 7fba6affd700 1 -- 172.21.15.72:0/4261088403 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fba7003fad0 con 0x7fba7c09e2b0 2023-10-03T10:12:11.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.588+0000 7fba80eb3700 1 -- 172.21.15.72:0/4261088403 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c121c50 con 0x7fba7c09e2b0 2023-10-03T10:12:11.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.593+0000 7fba6affd700 1 -- 172.21.15.72:0/4261088403 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba7c121c50 con 0x7fba7c09e2b0 2023-10-03T10:12:11.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.775+0000 7fba80eb3700 1 -- 172.21.15.72:0/4261088403 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba7c121c50 con 0x7fba7c09e2b0 2023-10-03T10:12:11.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.776+0000 7fba6affd700 1 -- 172.21.15.72:0/4261088403 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba7c121c50 con 0x7fba7c09e2b0 2023-10-03T10:12:11.777 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-03T10:12:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.778+0000 7fba80eb3700 1 -- 172.21.15.72:0/4261088403 >> v1:172.21.15.72:6816/126756 conn(0x7fba5c02f540 legacy=0x7fba5c0319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.778+0000 7fba80eb3700 1 -- 172.21.15.72:0/4261088403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba7c09e2b0 msgr2=0x7fba7c11e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.778+0000 7fba80eb3700 1 --2- 172.21.15.72:0/4261088403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba7c09e2b0 0x7fba7c11e950 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fba7000ebe0 tx=0x7fba7000eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.778+0000 7fba80eb3700 1 -- 172.21.15.72:0/4261088403 shutdown_connections 2023-10-03T10:12:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.778+0000 7fba80eb3700 1 --2- 172.21.15.72:0/4261088403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba7c09d7d0 0x7fba7c11e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.778+0000 7fba80eb3700 1 --2- 172.21.15.72:0/4261088403 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba7c135f60 0x7fba7c11ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.778+0000 7fba80eb3700 1 --2- 172.21.15.72:0/4261088403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba7c09e2b0 0x7fba7c11e950 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.778+0000 7fba80eb3700 1 -- 172.21.15.72:0/4261088403 >> 172.21.15.72:0/4261088403 conn(0x7fba7c066d70 msgr2=0x7fba7c0a2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.778+0000 7fba80eb3700 1 -- 172.21.15.72:0/4261088403 shutdown_connections 2023-10-03T10:12:11.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.778+0000 7fba80eb3700 1 -- 172.21.15.72:0/4261088403 wait complete. 2023-10-03T10:12:11.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:12:11.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.912+0000 7fa908345700 1 Processor -- start 2023-10-03T10:12:11.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.912+0000 7fa908345700 1 -- start start 2023-10-03T10:12:11.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.913+0000 7fa908345700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa900136bb0 0x7fa900138f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.913+0000 7fa908345700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9001394d0 0x7fa90013b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.913+0000 7fa908345700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90009d060 con 0x7fa900133e70 2023-10-03T10:12:11.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.913+0000 7fa908345700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa90009acd0 con 0x7fa9001394d0 2023-10-03T10:12:11.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.913+0000 7fa908345700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90009eef0 con 0x7fa900136bb0 2023-10-03T10:12:11.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.913+0000 7fa9068e2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9001394d0 0x7fa90013b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.913+0000 7fa9060e1700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa900133e70 0x7fa900134240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47964/0 (socket says 172.21.15.72:47964) 2023-10-03T10:12:11.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.913+0000 7fa9058e0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa900136bb0 0x7fa900138f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.913+0000 7fa9060e1700 1 -- 172.21.15.72:0/1593541867 learned_addr learned my addr 172.21.15.72:0/1593541867 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:11.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.914+0000 7fa9068e2700 1 -- 172.21.15.72:0/1593541867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa900136bb0 msgr2=0x7fa900138f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:11.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.914+0000 7fa9068e2700 1 --2- 172.21.15.72:0/1593541867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa900136bb0 0x7fa900138f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.914+0000 7fa9068e2700 1 -- 172.21.15.72:0/1593541867 >> v1:172.21.15.72:6789/0 conn(0x7fa900133e70 legacy=0x7fa900134240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.914+0000 7fa9068e2700 1 -- 172.21.15.72:0/1593541867 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa900133c50 con 0x7fa9001394d0 2023-10-03T10:12:11.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.914+0000 7fa9050df700 1 -- 172.21.15.72:0/1593541867 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790634819 0 0) 0x7fa90009d060 con 0x7fa900133e70 2023-10-03T10:12:11.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.914+0000 7fa9058e0700 1 --2- 172.21.15.72:0/1593541867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa900136bb0 0x7fa900138f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:11.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.914+0000 7fa9068e2700 1 --2- 172.21.15.72:0/1593541867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9001394d0 0x7fa90013b8b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8009d90 tx=0x7fa8f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ad836e586bef8b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:11.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.914+0000 7fa9050df700 1 -- 172.21.15.72:0/1593541867 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f800e070 con 0x7fa9001394d0 2023-10-03T10:12:11.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.914+0000 7fa9050df700 1 -- 172.21.15.72:0/1593541867 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f800bb20 con 0x7fa9001394d0 2023-10-03T10:12:11.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.914+0000 7fa9050df700 1 -- 172.21.15.72:0/1593541867 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8012430 con 0x7fa9001394d0 2023-10-03T10:12:11.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.914+0000 7fa908345700 1 -- 172.21.15.72:0/1593541867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9001394d0 msgr2=0x7fa90013b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.914+0000 7fa908345700 1 --2- 172.21.15.72:0/1593541867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9001394d0 0x7fa90013b8b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8009d90 tx=0x7fa8f800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:11.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.915+0000 7fa908345700 1 -- 172.21.15.72:0/1593541867 shutdown_connections 2023-10-03T10:12:11.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.915+0000 7fa908345700 1 --2- 172.21.15.72:0/1593541867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9001394d0 0x7fa90013b8b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.915+0000 7fa908345700 1 --2- 172.21.15.72:0/1593541867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa900136bb0 0x7fa900138f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.915+0000 7fa908345700 1 -- 172.21.15.72:0/1593541867 >> 172.21.15.72:0/1593541867 conn(0x7fa9000a2c10 msgr2=0x7fa9000a3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:11.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.915+0000 7fa908345700 1 -- 172.21.15.72:0/1593541867 shutdown_connections 2023-10-03T10:12:11.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.915+0000 7fa908345700 1 -- 172.21.15.72:0/1593541867 wait complete. 2023-10-03T10:12:11.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.915+0000 7fa908345700 1 Processor -- start 2023-10-03T10:12:11.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.915+0000 7fa908345700 1 -- start start 2023-10-03T10:12:11.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa908345700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa900133e70 0x7fa900118e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa908345700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa900136bb0 0x7fa900119380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa908345700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa9001394d0 0x7fa9001198c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:11.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa908345700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90012e050 con 0x7fa900136bb0 2023-10-03T10:12:11.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa908345700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa900130c00 con 0x7fa900133e70 2023-10-03T10:12:11.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa908345700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa90011b0f0 con 0x7fa9001394d0 2023-10-03T10:12:11.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa9060e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa900133e70 0x7fa900118e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa9060e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa900133e70 0x7fa900118e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58146/0 (socket says 172.21.15.72:58146) 2023-10-03T10:12:11.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa9060e1700 1 -- 172.21.15.72:0/1147081066 learned_addr learned my addr 172.21.15.72:0/1147081066 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:11.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa9058e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa900136bb0 0x7fa900119380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa9068e2700 1 --2- 172.21.15.72:0/1147081066 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa9001394d0 0x7fa9001198c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:11.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa9060e1700 1 -- 172.21.15.72:0/1147081066 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa9001394d0 msgr2=0x7fa9001198c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa9060e1700 1 --2- 172.21.15.72:0/1147081066 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa9001394d0 0x7fa9001198c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa9060e1700 1 -- 172.21.15.72:0/1147081066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa900136bb0 msgr2=0x7fa900119380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:11.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa9060e1700 1 --2- 172.21.15.72:0/1147081066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa900136bb0 0x7fa900119380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:11.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa9060e1700 1 -- 172.21.15.72:0/1147081066 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f40094a0 con 0x7fa900133e70 2023-10-03T10:12:11.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa9058e0700 1 --2- 172.21.15.72:0/1147081066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa900136bb0 0x7fa900119380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:11.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.916+0000 7fa9060e1700 1 --2- 172.21.15.72:0/1147081066 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa900133e70 0x7fa900118e40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c550 tx=0x7fa8fc00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:11.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.917+0000 7fa8f2ffd700 1 -- 172.21.15.72:0/1147081066 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc004c80 con 0x7fa900133e70 2023-10-03T10:12:11.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.917+0000 7fa8f2ffd700 1 -- 172.21.15.72:0/1147081066 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc004e00 con 0x7fa900133e70 2023-10-03T10:12:11.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.917+0000 7fa908345700 1 -- 172.21.15.72:0/1147081066 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f8009a70 con 0x7fa900133e70 2023-10-03T10:12:11.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.917+0000 7fa8f2ffd700 1 -- 172.21.15.72:0/1147081066 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc007310 con 0x7fa900133e70 2023-10-03T10:12:11.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.917+0000 7fa908345700 1 -- 172.21.15.72:0/1147081066 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9001302a0 con 0x7fa900133e70 2023-10-03T10:12:11.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.917+0000 7fa8f2ffd700 1 -- 172.21.15.72:0/1147081066 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa8fc007470 con 0x7fa900133e70 2023-10-03T10:12:11.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.917+0000 7fa908345700 1 -- 172.21.15.72:0/1147081066 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90004f2a0 con 0x7fa900133e70 2023-10-03T10:12:11.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.918+0000 7fa8f2ffd700 1 -- 172.21.15.72:0/1147081066 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fa8fc03f730 con 0x7fa900133e70 2023-10-03T10:12:11.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:11.922+0000 7fa8f2ffd700 1 -- 172.21.15.72:0/1147081066 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8fc0133c0 con 0x7fa900133e70 2023-10-03T10:12:12.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.109+0000 7fa908345700 1 -- 172.21.15.72:0/1147081066 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa900072d60 con 0x7fa900133e70 2023-10-03T10:12:12.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.119+0000 7fa8f2ffd700 1 -- 172.21.15.72:0/1147081066 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa8fc0102c0 con 0x7fa900133e70 2023-10-03T10:12:12.120 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-03T10:12:12.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.121+0000 7fa908345700 1 -- 172.21.15.72:0/1147081066 >> v1:172.21.15.72:6816/126756 conn(0x7fa8e402f510 legacy=0x7fa8e40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.121+0000 7fa908345700 1 -- 172.21.15.72:0/1147081066 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa900133e70 msgr2=0x7fa900118e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.121+0000 7fa908345700 1 --2- 172.21.15.72:0/1147081066 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa900133e70 0x7fa900118e40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c550 tx=0x7fa8fc00c860 comp rx=0 tx=0).stop 2023-10-03T10:12:12.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.121+0000 7fa908345700 1 -- 172.21.15.72:0/1147081066 shutdown_connections 2023-10-03T10:12:12.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.121+0000 7fa908345700 1 --2- 172.21.15.72:0/1147081066 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa9001394d0 0x7fa9001198c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.121+0000 7fa908345700 1 --2- 172.21.15.72:0/1147081066 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa900133e70 0x7fa900118e40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.121+0000 7fa908345700 1 --2- 172.21.15.72:0/1147081066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa900136bb0 0x7fa900119380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.121+0000 7fa908345700 1 -- 172.21.15.72:0/1147081066 >> 172.21.15.72:0/1147081066 conn(0x7fa9000a2c10 msgr2=0x7fa90009f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.121+0000 7fa908345700 1 -- 172.21.15.72:0/1147081066 shutdown_connections 2023-10-03T10:12:12.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.121+0000 7fa908345700 1 -- 172.21.15.72:0/1147081066 wait complete. 2023-10-03T10:12:12.133 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:12:12.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.252+0000 7fe6fec38700 1 Processor -- start 2023-10-03T10:12:12.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.252+0000 7fe6fec38700 1 -- start start 2023-10-03T10:12:12.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fec38700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6f809d6f0 0x7fe6f809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fec38700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6f809e000 0x7fe6f81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fec38700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6f809e410 0x7fe6f8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fec38700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f806b460 con 0x7fe6f809e410 2023-10-03T10:12:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fec38700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f809b120 con 0x7fe6f809e000 2023-10-03T10:12:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fec38700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f809a7e0 con 0x7fe6f809d6f0 2023-10-03T10:12:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fc9d4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6f809d6f0 0x7fe6f809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fd1d5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6f809e410 0x7fe6f8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fd1d5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6f809e410 0x7fe6f8133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44154/0 (socket says 172.21.15.72:44154) 2023-10-03T10:12:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fc9d4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6f809d6f0 0x7fe6f809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47224/0 (socket says 172.21.15.72:47224) 2023-10-03T10:12:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fd1d5700 1 -- 172.21.15.72:0/2158602442 learned_addr learned my addr 172.21.15.72:0/2158602442 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6f7fff700 1 --2- 172.21.15.72:0/2158602442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6f809e000 0x7fe6f81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fd1d5700 1 -- 172.21.15.72:0/2158602442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6f809d6f0 msgr2=0x7fe6f809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fd1d5700 1 --2- 172.21.15.72:0/2158602442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6f809d6f0 0x7fe6f809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fd1d5700 1 -- 172.21.15.72:0/2158602442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6f809e000 msgr2=0x7fe6f81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fd1d5700 1 --2- 172.21.15.72:0/2158602442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6f809e000 0x7fe6f81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fd1d5700 1 -- 172.21.15.72:0/2158602442 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f809a500 con 0x7fe6f809e410 2023-10-03T10:12:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6f7fff700 1 --2- 172.21.15.72:0/2158602442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6f809e000 0x7fe6f81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fc9d4700 1 --2- 172.21.15.72:0/2158602442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6f809d6f0 0x7fe6f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.253+0000 7fe6fd1d5700 1 --2- 172.21.15.72:0/2158602442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6f809e410 0x7fe6f8133f30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0009e50 tx=0x7fe6f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b000b45f3c9ca3c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.254+0000 7fe6f77fe700 1 -- 172.21.15.72:0/2158602442 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000e070 con 0x7fe6f809e410 2023-10-03T10:12:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.254+0000 7fe6f77fe700 1 -- 172.21.15.72:0/2158602442 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f000b910 con 0x7fe6f809e410 2023-10-03T10:12:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.254+0000 7fe6f77fe700 1 -- 172.21.15.72:0/2158602442 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000bcc0 con 0x7fe6f809e410 2023-10-03T10:12:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.254+0000 7fe6fec38700 1 -- 172.21.15.72:0/2158602442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6f809e410 msgr2=0x7fe6f8133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.254+0000 7fe6fec38700 1 --2- 172.21.15.72:0/2158602442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6f809e410 0x7fe6f8133f30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0009e50 tx=0x7fe6f000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.254+0000 7fe6fec38700 1 -- 172.21.15.72:0/2158602442 shutdown_connections 2023-10-03T10:12:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.254+0000 7fe6fec38700 1 --2- 172.21.15.72:0/2158602442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6f809e410 0x7fe6f8133f30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.254+0000 7fe6fec38700 1 --2- 172.21.15.72:0/2158602442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6f809d6f0 0x7fe6f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.254+0000 7fe6fec38700 1 --2- 172.21.15.72:0/2158602442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6f809e000 0x7fe6f81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.254+0000 7fe6fec38700 1 -- 172.21.15.72:0/2158602442 >> 172.21.15.72:0/2158602442 conn(0x7fe6f8066f50 msgr2=0x7fe6f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.254+0000 7fe6fec38700 1 -- 172.21.15.72:0/2158602442 shutdown_connections 2023-10-03T10:12:12.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.254+0000 7fe6fec38700 1 -- 172.21.15.72:0/2158602442 wait complete. 2023-10-03T10:12:12.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.255+0000 7fe6fec38700 1 Processor -- start 2023-10-03T10:12:12.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.255+0000 7fe6fec38700 1 -- start start 2023-10-03T10:12:12.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fec38700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6f809d6f0 0x7fe6f81c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fec38700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6f809e000 0x7fe6f81c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fec38700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6f809e410 0x7fe6f81c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fec38700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f81a95b0 con 0x7fe6f809e000 2023-10-03T10:12:12.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fec38700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f81c5980 con 0x7fe6f809d6f0 2023-10-03T10:12:12.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fec38700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f81a97b0 con 0x7fe6f809e410 2023-10-03T10:12:12.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fc9d4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6f809d6f0 0x7fe6f81c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6f7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6f809e000 0x7fe6f81c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fd1d5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6f809e410 0x7fe6f81c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fc9d4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6f809d6f0 0x7fe6f81c4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58170/0 (socket says 172.21.15.72:58170) 2023-10-03T10:12:12.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6f7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6f809e000 0x7fe6f81c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44164/0 (socket says 172.21.15.72:44164) 2023-10-03T10:12:12.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fd1d5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6f809e410 0x7fe6f81c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47236/0 (socket says 172.21.15.72:47236) 2023-10-03T10:12:12.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fc9d4700 1 -- 172.21.15.72:0/310877451 learned_addr learned my addr 172.21.15.72:0/310877451 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:12.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fc9d4700 1 -- 172.21.15.72:0/310877451 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6f809e410 msgr2=0x7fe6f81c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fc9d4700 1 --2- 172.21.15.72:0/310877451 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6f809e410 0x7fe6f81c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fc9d4700 1 -- 172.21.15.72:0/310877451 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6f809e000 msgr2=0x7fe6f81c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fc9d4700 1 --2- 172.21.15.72:0/310877451 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6f809e000 0x7fe6f81c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fc9d4700 1 -- 172.21.15.72:0/310877451 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec0094a0 con 0x7fe6f809d6f0 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6f7fff700 1 --2- 172.21.15.72:0/310877451 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6f809e000 0x7fe6f81c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6fc9d4700 1 --2- 172.21.15.72:0/310877451 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6f809d6f0 0x7fe6f81c4f00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00ebe0 tx=0x7fe6ec00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.256+0000 7fe6f57fa700 1 -- 172.21.15.72:0/310877451 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec00c850 con 0x7fe6f809d6f0 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.257+0000 7fe6f57fa700 1 -- 172.21.15.72:0/310877451 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec00c9b0 con 0x7fe6f809d6f0 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.257+0000 7fe6f57fa700 1 -- 172.21.15.72:0/310877451 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec00cd40 con 0x7fe6f809d6f0 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.257+0000 7fe6fec38700 1 -- 172.21.15.72:0/310877451 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e40094a0 con 0x7fe6f809d6f0 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.257+0000 7fe6fec38700 1 -- 172.21.15.72:0/310877451 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f0009b30 con 0x7fe6f809d6f0 2023-10-03T10:12:12.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.257+0000 7fe6f57fa700 1 -- 172.21.15.72:0/310877451 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe6ec013470 con 0x7fe6f809d6f0 2023-10-03T10:12:12.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.257+0000 7fe6fec38700 1 -- 172.21.15.72:0/310877451 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f809c710 con 0x7fe6f809d6f0 2023-10-03T10:12:12.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.257+0000 7fe6f57fa700 1 -- 172.21.15.72:0/310877451 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fe6ec03fd20 con 0x7fe6f809d6f0 2023-10-03T10:12:12.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.262+0000 7fe6f57fa700 1 -- 172.21.15.72:0/310877451 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe6ec021020 con 0x7fe6f809d6f0 2023-10-03T10:12:12.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.486+0000 7fe6fec38700 1 -- 172.21.15.72:0/310877451 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6f8074ea0 con 0x7fe6f809d6f0 2023-10-03T10:12:12.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.487+0000 7fe6f57fa700 1 -- 172.21.15.72:0/310877451 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2313 (secure 0 0 0) 0x7fe6ec013720 con 0x7fe6f809d6f0 2023-10-03T10:12:12.487 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:12.488 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:46.344785+0000","modified":"2023-10-03T10:10:08.974385+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6817/542674768","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6817","nonce":542674768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T10:12:12.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.488+0000 7fe6fec38700 1 -- 172.21.15.72:0/310877451 >> v1:172.21.15.72:6816/126756 conn(0x7fe6dc02f510 legacy=0x7fe6dc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.488+0000 7fe6fec38700 1 -- 172.21.15.72:0/310877451 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6f809d6f0 msgr2=0x7fe6f81c4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.488+0000 7fe6fec38700 1 --2- 172.21.15.72:0/310877451 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6f809d6f0 0x7fe6f81c4f00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00ebe0 tx=0x7fe6ec00eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.489+0000 7fe6fec38700 1 -- 172.21.15.72:0/310877451 shutdown_connections 2023-10-03T10:12:12.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.489+0000 7fe6fec38700 1 --2- 172.21.15.72:0/310877451 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6f809e410 0x7fe6f81c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.489+0000 7fe6fec38700 1 --2- 172.21.15.72:0/310877451 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6f809d6f0 0x7fe6f81c4f00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.489+0000 7fe6fec38700 1 --2- 172.21.15.72:0/310877451 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6f809e000 0x7fe6f81c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.489+0000 7fe6fec38700 1 -- 172.21.15.72:0/310877451 >> 172.21.15.72:0/310877451 conn(0x7fe6f8066f50 msgr2=0x7fe6f81bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.489+0000 7fe6fec38700 1 -- 172.21.15.72:0/310877451 shutdown_connections 2023-10-03T10:12:12.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.489+0000 7fe6fec38700 1 -- 172.21.15.72:0/310877451 wait complete. 2023-10-03T10:12:12.491 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-10-03T10:12:12.501 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:12.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.620+0000 7f3fad7bc700 1 Processor -- start 2023-10-03T10:12:12.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.620+0000 7f3fad7bc700 1 -- start start 2023-10-03T10:12:12.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.621+0000 7f3fad7bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa80a09c0 0x7f3fa80a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.621+0000 7f3fad7bc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fa809d5c0 0x7f3fa80a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.621+0000 7f3fad7bc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa80a1810 con 0x7f3fa8133920 2023-10-03T10:12:12.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.621+0000 7f3fad7bc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa809ea10 con 0x7f3fa80a09c0 2023-10-03T10:12:12.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.621+0000 7f3fad7bc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa809e210 con 0x7f3fa809d5c0 2023-10-03T10:12:12.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.621+0000 7f3fa6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa80a09c0 0x7f3fa80a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.621+0000 7f3fa67fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fa809d5c0 0x7f3fa80a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.621+0000 7f3fa77fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3fa8133920 0x7f3fa8133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47978/0 (socket says 172.21.15.72:47978) 2023-10-03T10:12:12.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.621+0000 7f3fa77fe700 1 -- 172.21.15.72:0/2886221268 learned_addr learned my addr 172.21.15.72:0/2886221268 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:12.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.621+0000 7f3fa5ffb700 1 -- 172.21.15.72:0/2886221268 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956468116 0 0) 0x7f3fa80a1810 con 0x7f3fa8133920 2023-10-03T10:12:12.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.621+0000 7f3fa6ffd700 1 -- 172.21.15.72:0/2886221268 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fa809d5c0 msgr2=0x7f3fa80a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.621+0000 7f3fa6ffd700 1 --2- 172.21.15.72:0/2886221268 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fa809d5c0 0x7f3fa80a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.621+0000 7f3fa6ffd700 1 -- 172.21.15.72:0/2886221268 >> v1:172.21.15.72:6789/0 conn(0x7f3fa8133920 legacy=0x7f3fa8133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.621+0000 7f3fa6ffd700 1 -- 172.21.15.72:0/2886221268 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa80a26f0 con 0x7f3fa80a09c0 2023-10-03T10:12:12.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.621+0000 7f3fa67fc700 1 --2- 172.21.15.72:0/2886221268 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fa809d5c0 0x7f3fa80a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.622+0000 7f3fa6ffd700 1 --2- 172.21.15.72:0/2886221268 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa80a09c0 0x7f3fa80a0d90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009870 tx=0x7f3f9c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99dc8496d19a0204 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.622+0000 7f3fa5ffb700 1 -- 172.21.15.72:0/2886221268 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c011830 con 0x7f3fa80a09c0 2023-10-03T10:12:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.622+0000 7f3fa5ffb700 1 -- 172.21.15.72:0/2886221268 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c011990 con 0x7f3fa80a09c0 2023-10-03T10:12:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.622+0000 7f3fa5ffb700 1 -- 172.21.15.72:0/2886221268 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c011d20 con 0x7f3fa80a09c0 2023-10-03T10:12:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.622+0000 7f3fad7bc700 1 -- 172.21.15.72:0/2886221268 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa80a09c0 msgr2=0x7f3fa80a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.622+0000 7f3fad7bc700 1 --2- 172.21.15.72:0/2886221268 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa80a09c0 0x7f3fa80a0d90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009870 tx=0x7f3f9c009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.622+0000 7f3fad7bc700 1 -- 172.21.15.72:0/2886221268 shutdown_connections 2023-10-03T10:12:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.622+0000 7f3fad7bc700 1 --2- 172.21.15.72:0/2886221268 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa80a09c0 0x7f3fa80a0d90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.622+0000 7f3fad7bc700 1 --2- 172.21.15.72:0/2886221268 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fa809d5c0 0x7f3fa80a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.622+0000 7f3fad7bc700 1 -- 172.21.15.72:0/2886221268 >> 172.21.15.72:0/2886221268 conn(0x7f3fa80a2fe0 msgr2=0x7f3fa80a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.622+0000 7f3fad7bc700 1 -- 172.21.15.72:0/2886221268 shutdown_connections 2023-10-03T10:12:12.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.622+0000 7f3fad7bc700 1 -- 172.21.15.72:0/2886221268 wait complete. 2023-10-03T10:12:12.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.623+0000 7f3fad7bc700 1 Processor -- start 2023-10-03T10:12:12.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.623+0000 7f3fad7bc700 1 -- start start 2023-10-03T10:12:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fad7bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa809d5c0 0x7f3fa8132640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fad7bc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fa80a09c0 0x7f3fa8132b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fad7bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fa8133920 0x7f3fa81c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fad7bc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa811ed10 con 0x7f3fa8133920 2023-10-03T10:12:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fad7bc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa81206a0 con 0x7f3fa809d5c0 2023-10-03T10:12:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fad7bc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa8120470 con 0x7f3fa80a09c0 2023-10-03T10:12:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fa77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fa8133920 0x7f3fa81c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fa67fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fa80a09c0 0x7f3fa8132b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fa67fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fa80a09c0 0x7f3fa8132b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47264/0 (socket says 172.21.15.72:47264) 2023-10-03T10:12:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fa77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fa8133920 0x7f3fa81c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44168/0 (socket says 172.21.15.72:44168) 2023-10-03T10:12:12.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fa67fc700 1 -- 172.21.15.72:0/3338956624 learned_addr learned my addr 172.21.15.72:0/3338956624 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:12.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fa6ffd700 1 --2- 172.21.15.72:0/3338956624 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa809d5c0 0x7f3fa8132640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fa6ffd700 1 -- 172.21.15.72:0/3338956624 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fa80a09c0 msgr2=0x7f3fa8132b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fa6ffd700 1 --2- 172.21.15.72:0/3338956624 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fa80a09c0 0x7f3fa8132b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fa6ffd700 1 -- 172.21.15.72:0/3338956624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fa8133920 msgr2=0x7f3fa81c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fa6ffd700 1 --2- 172.21.15.72:0/3338956624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fa8133920 0x7f3fa81c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fa6ffd700 1 -- 172.21.15.72:0/3338956624 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980094a0 con 0x7f3fa809d5c0 2023-10-03T10:12:12.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fa67fc700 1 --2- 172.21.15.72:0/3338956624 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fa80a09c0 0x7f3fa8132b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fa77fe700 1 --2- 172.21.15.72:0/3338956624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fa8133920 0x7f3fa81c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fa6ffd700 1 --2- 172.21.15.72:0/3338956624 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa809d5c0 0x7f3fa8132640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c016000 tx=0x7f3f9c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3f8f7fe700 1 -- 172.21.15.72:0/3338956624 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c004300 con 0x7f3fa809d5c0 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3f8f7fe700 1 -- 172.21.15.72:0/3338956624 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c01f070 con 0x7f3fa809d5c0 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3f8f7fe700 1 -- 172.21.15.72:0/3338956624 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0036a0 con 0x7f3fa809d5c0 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.624+0000 7f3fad7bc700 1 -- 172.21.15.72:0/3338956624 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c0094a0 con 0x7f3fa809d5c0 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.625+0000 7f3fad7bc700 1 -- 172.21.15.72:0/3338956624 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa809cf10 con 0x7f3fa809d5c0 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.625+0000 7f3f8f7fe700 1 -- 172.21.15.72:0/3338956624 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3f9c021030 con 0x7f3fa809d5c0 2023-10-03T10:12:12.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.625+0000 7f3f8f7fe700 1 -- 172.21.15.72:0/3338956624 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f3f9c040a30 con 0x7f3fa809d5c0 2023-10-03T10:12:12.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.625+0000 7f3fad7bc700 1 -- 172.21.15.72:0/3338956624 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa8122250 con 0x7f3fa809d5c0 2023-10-03T10:12:12.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.630+0000 7f3f8f7fe700 1 -- 172.21.15.72:0/3338956624 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fa8122250 con 0x7f3fa809d5c0 2023-10-03T10:12:12.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.815+0000 7f3fad7bc700 1 -- 172.21.15.72:0/3338956624 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fa8133120 con 0x7f3fa809d5c0 2023-10-03T10:12:12.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.816+0000 7f3f8f7fe700 1 -- 172.21.15.72:0/3338956624 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12864 (secure 0 0 0) 0x7f3f9c015020 con 0x7f3fa809d5c0 2023-10-03T10:12:12.817 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:12.817 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":23,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:12:08.075987+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":0}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":0}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6816/118184":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/3319279924":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/2966012812":"2023-10-04T10:12:06.073551+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:12.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.819+0000 7f3fad7bc700 1 -- 172.21.15.72:0/3338956624 >> v1:172.21.15.72:6816/126756 conn(0x7f3f9402f510 legacy=0x7f3f940319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.819+0000 7f3fad7bc700 1 -- 172.21.15.72:0/3338956624 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa809d5c0 msgr2=0x7f3fa8132640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.819+0000 7f3fad7bc700 1 --2- 172.21.15.72:0/3338956624 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa809d5c0 0x7f3fa8132640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c016000 tx=0x7f3f9c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:12.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.819+0000 7f3fad7bc700 1 -- 172.21.15.72:0/3338956624 shutdown_connections 2023-10-03T10:12:12.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.819+0000 7f3fad7bc700 1 --2- 172.21.15.72:0/3338956624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fa8133920 0x7f3fa81c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.819+0000 7f3fad7bc700 1 --2- 172.21.15.72:0/3338956624 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fa809d5c0 0x7f3fa8132640 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.819+0000 7f3fad7bc700 1 --2- 172.21.15.72:0/3338956624 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fa80a09c0 0x7f3fa8132b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.819+0000 7f3fad7bc700 1 -- 172.21.15.72:0/3338956624 >> 172.21.15.72:0/3338956624 conn(0x7f3fa80a2fe0 msgr2=0x7f3fa81bbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.819+0000 7f3fad7bc700 1 -- 172.21.15.72:0/3338956624 shutdown_connections 2023-10-03T10:12:12.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.819+0000 7f3fad7bc700 1 -- 172.21.15.72:0/3338956624 wait complete. 2023-10-03T10:12:12.831 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:38.963446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:40.092839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:44.713857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:45.314387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:12:12.832 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:12:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.954+0000 7f25e892d700 1 Processor -- start 2023-10-03T10:12:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.954+0000 7f25e892d700 1 -- start start 2023-10-03T10:12:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e892d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25e41303c0 0x7f25e4130790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e892d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25e406a770 0x7f25e406ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e892d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e409f620 con 0x7f25e406b0c0 2023-10-03T10:12:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e892d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e4130250 con 0x7f25e41303c0 2023-10-03T10:12:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e892d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25e409e1b0 con 0x7f25e406a770 2023-10-03T10:12:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e1d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25e406a770 0x7f25e406ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25e41303c0 0x7f25e4130790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e1d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25e406a770 0x7f25e406ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47280/0 (socket says 172.21.15.72:47280) 2023-10-03T10:12:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e1d9b700 1 -- 172.21.15.72:0/3385617283 learned_addr learned my addr 172.21.15.72:0/3385617283 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e2d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f25e406b0c0 0x7f25e413a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47994/0 (socket says 172.21.15.72:47994) 2023-10-03T10:12:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e159a700 1 -- 172.21.15.72:0/3385617283 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661783300 0 0) 0x7f25e409f620 con 0x7f25e406b0c0 2023-10-03T10:12:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e159a700 1 -- 172.21.15.72:0/3385617283 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25cc0035b0 con 0x7f25e406b0c0 2023-10-03T10:12:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e259c700 1 -- 172.21.15.72:0/3385617283 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25e406a770 msgr2=0x7f25e406ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e259c700 1 --2- 172.21.15.72:0/3385617283 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25e406a770 0x7f25e406ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e259c700 1 -- 172.21.15.72:0/3385617283 >> v1:172.21.15.72:6789/0 conn(0x7f25e406b0c0 legacy=0x7f25e413a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e259c700 1 -- 172.21.15.72:0/3385617283 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e406b520 con 0x7f25e41303c0 2023-10-03T10:12:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.955+0000 7f25e259c700 1 --2- 172.21.15.72:0/3385617283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e41303c0 0x7f25e4130790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009840 tx=0x7f25d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30003fcf00ba135f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.956+0000 7f25e159a700 1 -- 172.21.15.72:0/3385617283 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8011830 con 0x7f25e41303c0 2023-10-03T10:12:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.956+0000 7f25e159a700 1 -- 172.21.15.72:0/3385617283 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d8011990 con 0x7f25e41303c0 2023-10-03T10:12:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.956+0000 7f25e159a700 1 -- 172.21.15.72:0/3385617283 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8011d20 con 0x7f25e41303c0 2023-10-03T10:12:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.956+0000 7f25e892d700 1 -- 172.21.15.72:0/3385617283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e41303c0 msgr2=0x7f25e4130790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.956+0000 7f25e892d700 1 --2- 172.21.15.72:0/3385617283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e41303c0 0x7f25e4130790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009840 tx=0x7f25d8009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.956+0000 7f25e892d700 1 -- 172.21.15.72:0/3385617283 shutdown_connections 2023-10-03T10:12:12.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.956+0000 7f25e892d700 1 --2- 172.21.15.72:0/3385617283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e41303c0 0x7f25e4130790 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.956+0000 7f25e892d700 1 --2- 172.21.15.72:0/3385617283 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25e406a770 0x7f25e406ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.956+0000 7f25e892d700 1 -- 172.21.15.72:0/3385617283 >> 172.21.15.72:0/3385617283 conn(0x7f25e4066d70 msgr2=0x7f25e40a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:12.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.956+0000 7f25e892d700 1 -- 172.21.15.72:0/3385617283 shutdown_connections 2023-10-03T10:12:12.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.956+0000 7f25e892d700 1 -- 172.21.15.72:0/3385617283 wait complete. 2023-10-03T10:12:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.957+0000 7f25e892d700 1 Processor -- start 2023-10-03T10:12:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.957+0000 7f25e892d700 1 -- start start 2023-10-03T10:12:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e892d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e406a770 0x7f25e411d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e892d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25e406b0c0 0x7f25e411de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e892d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25e41303c0 0x7f25e411e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e892d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4072330 con 0x7f25e406a770 2023-10-03T10:12:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e892d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4072140 con 0x7f25e41303c0 2023-10-03T10:12:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e892d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4120a40 con 0x7f25e406b0c0 2023-10-03T10:12:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e1d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25e406b0c0 0x7f25e411de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e406a770 0x7f25e411d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e1d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25e406b0c0 0x7f25e411de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47282/0 (socket says 172.21.15.72:47282) 2023-10-03T10:12:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e1d9b700 1 -- 172.21.15.72:0/3875000720 learned_addr learned my addr 172.21.15.72:0/3875000720 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e2d9d700 1 --2- 172.21.15.72:0/3875000720 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25e41303c0 0x7f25e411e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e259c700 1 -- 172.21.15.72:0/3875000720 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25e406b0c0 msgr2=0x7f25e411de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e259c700 1 --2- 172.21.15.72:0/3875000720 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25e406b0c0 0x7f25e411de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e259c700 1 -- 172.21.15.72:0/3875000720 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25e41303c0 msgr2=0x7f25e411e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e259c700 1 --2- 172.21.15.72:0/3875000720 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25e41303c0 0x7f25e411e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e259c700 1 -- 172.21.15.72:0/3875000720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d80094a0 con 0x7f25e406a770 2023-10-03T10:12:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e1d9b700 1 --2- 172.21.15.72:0/3875000720 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25e406b0c0 0x7f25e411de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e259c700 1 --2- 172.21.15.72:0/3875000720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e406a770 0x7f25e411d930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f25d8016000 tx=0x7f25d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25d2ffd700 1 -- 172.21.15.72:0/3875000720 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8004590 con 0x7f25e406a770 2023-10-03T10:12:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25d2ffd700 1 -- 172.21.15.72:0/3875000720 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d801f070 con 0x7f25e406a770 2023-10-03T10:12:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e892d700 1 -- 172.21.15.72:0/3875000720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e4130dc0 con 0x7f25e406a770 2023-10-03T10:12:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25d2ffd700 1 -- 172.21.15.72:0/3875000720 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d80038e0 con 0x7f25e406a770 2023-10-03T10:12:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.958+0000 7f25e892d700 1 -- 172.21.15.72:0/3875000720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e411f3a0 con 0x7f25e406a770 2023-10-03T10:12:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.959+0000 7f25e892d700 1 -- 172.21.15.72:0/3875000720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e411f7f0 con 0x7f25e406a770 2023-10-03T10:12:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.960+0000 7f25d2ffd700 1 -- 172.21.15.72:0/3875000720 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f25d8003a40 con 0x7f25e406a770 2023-10-03T10:12:12.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.960+0000 7f25d2ffd700 1 -- 172.21.15.72:0/3875000720 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f25d8021070 con 0x7f25e406a770 2023-10-03T10:12:12.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:12.964+0000 7f25d2ffd700 1 -- 172.21.15.72:0/3875000720 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25d8006bd0 con 0x7f25e406a770 2023-10-03T10:12:13.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.150+0000 7f25e892d700 1 -- 172.21.15.72:0/3875000720 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25e404f2a0 con 0x7f25e406a770 2023-10-03T10:12:13.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.150+0000 7f25d2ffd700 1 -- 172.21.15.72:0/3875000720 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25d8015030 con 0x7f25e406a770 2023-10-03T10:12:13.151 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-03T10:12:13.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.152+0000 7f25e892d700 1 -- 172.21.15.72:0/3875000720 >> v1:172.21.15.72:6816/126756 conn(0x7f25c402f540 legacy=0x7f25c40319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.152+0000 7f25e892d700 1 -- 172.21.15.72:0/3875000720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e406a770 msgr2=0x7f25e411d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.152+0000 7f25e892d700 1 --2- 172.21.15.72:0/3875000720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e406a770 0x7f25e411d930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f25d8016000 tx=0x7f25d8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:13.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.152+0000 7f25e892d700 1 -- 172.21.15.72:0/3875000720 shutdown_connections 2023-10-03T10:12:13.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.152+0000 7f25e892d700 1 --2- 172.21.15.72:0/3875000720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25e406a770 0x7f25e411d930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.152+0000 7f25e892d700 1 --2- 172.21.15.72:0/3875000720 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25e41303c0 0x7f25e411e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.152+0000 7f25e892d700 1 --2- 172.21.15.72:0/3875000720 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25e406b0c0 0x7f25e411de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.152+0000 7f25e892d700 1 -- 172.21.15.72:0/3875000720 >> 172.21.15.72:0/3875000720 conn(0x7f25e4066d70 msgr2=0x7f25e412eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.153+0000 7f25e892d700 1 -- 172.21.15.72:0/3875000720 shutdown_connections 2023-10-03T10:12:13.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.153+0000 7f25e892d700 1 -- 172.21.15.72:0/3875000720 wait complete. 2023-10-03T10:12:13.165 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:12:13.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.287+0000 7fc966762700 1 Processor -- start 2023-10-03T10:12:13.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.287+0000 7fc966762700 1 -- start start 2023-10-03T10:12:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc966762700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc960133fc0 0x7fc960138820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc966762700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc960138d60 0x7fc96013b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc966762700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96009e900 con 0x7fc9600a37f0 2023-10-03T10:12:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc966762700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96009dec0 con 0x7fc960133fc0 2023-10-03T10:12:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc966762700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc960134410 con 0x7fc960138d60 2023-10-03T10:12:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc964cff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc960138d60 0x7fc96013b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc95f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc960133fc0 0x7fc960138820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc95ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc9600a37f0 0x7fc9601338b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48002/0 (socket says 172.21.15.72:48002) 2023-10-03T10:12:13.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc964cff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc960138d60 0x7fc96013b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47284/0 (socket says 172.21.15.72:47284) 2023-10-03T10:12:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc95ffff700 1 -- 172.21.15.72:0/714777881 learned_addr learned my addr 172.21.15.72:0/714777881 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc964cff700 1 -- 172.21.15.72:0/714777881 >> v2:172.21.15.72:3300/0 conn(0x7fc960133fc0 msgr2=0x7fc960138820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc964cff700 1 --2- 172.21.15.72:0/714777881 >> v2:172.21.15.72:3300/0 conn(0x7fc960133fc0 0x7fc960138820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc964cff700 1 -- 172.21.15.72:0/714777881 >> v1:172.21.15.72:6789/0 conn(0x7fc9600a37f0 legacy=0x7fc9601338b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc964cff700 1 -- 172.21.15.72:0/714777881 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96009f600 con 0x7fc960138d60 2023-10-03T10:12:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc95effd700 1 -- 172.21.15.72:0/714777881 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1851730292 0 0) 0x7fc96009e900 con 0x7fc9600a37f0 2023-10-03T10:12:13.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc95f7fe700 1 --2- 172.21.15.72:0/714777881 >> v2:172.21.15.72:3300/0 conn(0x7fc960133fc0 0x7fc960138820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc964cff700 1 --2- 172.21.15.72:0/714777881 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc960138d60 0x7fc96013b140 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc958009d90 tx=0x7fc95800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e4b5d289276b2a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.288+0000 7fc95effd700 1 -- 172.21.15.72:0/714777881 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800e070 con 0x7fc960138d60 2023-10-03T10:12:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.289+0000 7fc95effd700 1 -- 172.21.15.72:0/714777881 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95800bb20 con 0x7fc960138d60 2023-10-03T10:12:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.289+0000 7fc95effd700 1 -- 172.21.15.72:0/714777881 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958012430 con 0x7fc960138d60 2023-10-03T10:12:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.289+0000 7fc966762700 1 -- 172.21.15.72:0/714777881 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc960138d60 msgr2=0x7fc96013b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.289+0000 7fc966762700 1 --2- 172.21.15.72:0/714777881 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc960138d60 0x7fc96013b140 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc958009d90 tx=0x7fc95800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.289+0000 7fc966762700 1 -- 172.21.15.72:0/714777881 shutdown_connections 2023-10-03T10:12:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.289+0000 7fc966762700 1 --2- 172.21.15.72:0/714777881 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc960138d60 0x7fc96013b140 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.289+0000 7fc966762700 1 --2- 172.21.15.72:0/714777881 >> v2:172.21.15.72:3300/0 conn(0x7fc960133fc0 0x7fc960138820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.289+0000 7fc966762700 1 -- 172.21.15.72:0/714777881 >> 172.21.15.72:0/714777881 conn(0x7fc960066d70 msgr2=0x7fc9600a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.289+0000 7fc966762700 1 -- 172.21.15.72:0/714777881 shutdown_connections 2023-10-03T10:12:13.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.289+0000 7fc966762700 1 -- 172.21.15.72:0/714777881 wait complete. 2023-10-03T10:12:13.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.290+0000 7fc966762700 1 Processor -- start 2023-10-03T10:12:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.290+0000 7fc966762700 1 -- start start 2023-10-03T10:12:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.290+0000 7fc966762700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9600a37f0 0x7fc9601c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.290+0000 7fc966762700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc960133fc0 0x7fc9601c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.290+0000 7fc966762700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc960138d60 0x7fc9601345b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.290+0000 7fc966762700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc960137770 con 0x7fc960138d60 2023-10-03T10:12:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc966762700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96012dc60 con 0x7fc960133fc0 2023-10-03T10:12:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc966762700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc960137030 con 0x7fc9600a37f0 2023-10-03T10:12:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc95ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9600a37f0 0x7fc9601c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc964cff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc960138d60 0x7fc9601345b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc964cff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc960138d60 0x7fc9601345b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44188/0 (socket says 172.21.15.72:44188) 2023-10-03T10:12:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc95ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9600a37f0 0x7fc9601c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47292/0 (socket says 172.21.15.72:47292) 2023-10-03T10:12:13.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc964cff700 1 -- 172.21.15.72:0/2680100246 learned_addr learned my addr 172.21.15.72:0/2680100246 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:13.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc95f7fe700 1 --2- 172.21.15.72:0/2680100246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc960133fc0 0x7fc9601c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc964cff700 1 -- 172.21.15.72:0/2680100246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9600a37f0 msgr2=0x7fc9601c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc964cff700 1 --2- 172.21.15.72:0/2680100246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9600a37f0 0x7fc9601c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc964cff700 1 -- 172.21.15.72:0/2680100246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc960133fc0 msgr2=0x7fc9601c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc964cff700 1 --2- 172.21.15.72:0/2680100246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc960133fc0 0x7fc9601c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc964cff700 1 -- 172.21.15.72:0/2680100246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9500094a0 con 0x7fc960138d60 2023-10-03T10:12:13.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc95ffff700 1 --2- 172.21.15.72:0/2680100246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9600a37f0 0x7fc9601c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:13.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc964cff700 1 --2- 172.21.15.72:0/2680100246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc960138d60 0x7fc9601345b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc958013000 tx=0x7fc958004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc95cff9700 1 -- 172.21.15.72:0/2680100246 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958012430 con 0x7fc960138d60 2023-10-03T10:12:13.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc95cff9700 1 -- 172.21.15.72:0/2680100246 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc958020070 con 0x7fc960138d60 2023-10-03T10:12:13.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc966762700 1 -- 172.21.15.72:0/2680100246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc958009a70 con 0x7fc960138d60 2023-10-03T10:12:13.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc95cff9700 1 -- 172.21.15.72:0/2680100246 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958004040 con 0x7fc960138d60 2023-10-03T10:12:13.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.291+0000 7fc966762700 1 -- 172.21.15.72:0/2680100246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc960137d10 con 0x7fc960138d60 2023-10-03T10:12:13.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.292+0000 7fc95cff9700 1 -- 172.21.15.72:0/2680100246 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc9580041a0 con 0x7fc960138d60 2023-10-03T10:12:13.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.292+0000 7fc95cff9700 1 -- 172.21.15.72:0/2680100246 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fc958022070 con 0x7fc960138d60 2023-10-03T10:12:13.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.292+0000 7fc966762700 1 -- 172.21.15.72:0/2680100246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96009ef40 con 0x7fc960138d60 2023-10-03T10:12:13.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.297+0000 7fc95cff9700 1 -- 172.21.15.72:0/2680100246 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc96009ef40 con 0x7fc960138d60 2023-10-03T10:12:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.481+0000 7fc966762700 1 -- 172.21.15.72:0/2680100246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc96009ef40 con 0x7fc960138d60 2023-10-03T10:12:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.481+0000 7fc95cff9700 1 -- 172.21.15.72:0/2680100246 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc96009ef40 con 0x7fc960138d60 2023-10-03T10:12:13.482 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-10-03T10:12:13.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.483+0000 7fc966762700 1 -- 172.21.15.72:0/2680100246 >> v1:172.21.15.72:6816/126756 conn(0x7fc94c02f510 legacy=0x7fc94c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.483+0000 7fc966762700 1 -- 172.21.15.72:0/2680100246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc960138d60 msgr2=0x7fc9601345b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.483+0000 7fc966762700 1 --2- 172.21.15.72:0/2680100246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc960138d60 0x7fc9601345b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc958013000 tx=0x7fc958004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.483+0000 7fc966762700 1 -- 172.21.15.72:0/2680100246 shutdown_connections 2023-10-03T10:12:13.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.483+0000 7fc966762700 1 --2- 172.21.15.72:0/2680100246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc960138d60 0x7fc9601345b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.483+0000 7fc966762700 1 --2- 172.21.15.72:0/2680100246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9600a37f0 0x7fc9601c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.483+0000 7fc966762700 1 --2- 172.21.15.72:0/2680100246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc960133fc0 0x7fc9601c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.483+0000 7fc966762700 1 -- 172.21.15.72:0/2680100246 >> 172.21.15.72:0/2680100246 conn(0x7fc960066d70 msgr2=0x7fc9600a2590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.483+0000 7fc966762700 1 -- 172.21.15.72:0/2680100246 shutdown_connections 2023-10-03T10:12:13.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.483+0000 7fc966762700 1 -- 172.21.15.72:0/2680100246 wait complete. 2023-10-03T10:12:13.495 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:12:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.618+0000 7f1395f2d700 1 Processor -- start 2023-10-03T10:12:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.618+0000 7f1395f2d700 1 -- start start 2023-10-03T10:12:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f1395f2d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1390133e70 0x7f1390134240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f1395f2d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f139009d880 0x7f139009dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f1395f2d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139009d060 con 0x7f139009e230 2023-10-03T10:12:13.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f1395f2d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139009acd0 con 0x7f139009d880 2023-10-03T10:12:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f1395f2d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f139009e6d0 con 0x7f1390133e70 2023-10-03T10:12:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f138f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1390133e70 0x7f1390134240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f138effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f139009d880 0x7f139009dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f138ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f139009e230 0x7f139013abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48010/0 (socket says 172.21.15.72:48010) 2023-10-03T10:12:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f138ffff700 1 -- 172.21.15.72:0/1598011451 learned_addr learned my addr 172.21.15.72:0/1598011451 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f138f7fe700 1 -- 172.21.15.72:0/1598011451 >> v2:172.21.15.72:3300/0 conn(0x7f139009d880 msgr2=0x7f139009dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f138e7fc700 1 -- 172.21.15.72:0/1598011451 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752549378 0 0) 0x7f139009d060 con 0x7f139009e230 2023-10-03T10:12:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f138f7fe700 1 --2- 172.21.15.72:0/1598011451 >> v2:172.21.15.72:3300/0 conn(0x7f139009d880 0x7f139009dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f138f7fe700 1 -- 172.21.15.72:0/1598011451 >> v1:172.21.15.72:6789/0 conn(0x7f139009e230 legacy=0x7f139013abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f138f7fe700 1 -- 172.21.15.72:0/1598011451 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139009eef0 con 0x7f1390133e70 2023-10-03T10:12:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f138effd700 1 --2- 172.21.15.72:0/1598011451 >> v2:172.21.15.72:3300/0 conn(0x7f139009d880 0x7f139009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f138f7fe700 1 --2- 172.21.15.72:0/1598011451 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1390133e70 0x7f1390134240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1384009840 tx=0x7f1384009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d30c3bbcc41e649b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f138e7fc700 1 -- 172.21.15.72:0/1598011451 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1384011830 con 0x7f1390133e70 2023-10-03T10:12:13.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f138e7fc700 1 -- 172.21.15.72:0/1598011451 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1384011990 con 0x7f1390133e70 2023-10-03T10:12:13.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.619+0000 7f138e7fc700 1 -- 172.21.15.72:0/1598011451 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1384011d20 con 0x7f1390133e70 2023-10-03T10:12:13.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.620+0000 7f1395f2d700 1 -- 172.21.15.72:0/1598011451 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1390133e70 msgr2=0x7f1390134240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.620+0000 7f1395f2d700 1 --2- 172.21.15.72:0/1598011451 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1390133e70 0x7f1390134240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1384009840 tx=0x7f1384009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:13.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.620+0000 7f1395f2d700 1 -- 172.21.15.72:0/1598011451 shutdown_connections 2023-10-03T10:12:13.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.620+0000 7f1395f2d700 1 --2- 172.21.15.72:0/1598011451 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1390133e70 0x7f1390134240 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.620+0000 7f1395f2d700 1 --2- 172.21.15.72:0/1598011451 >> v2:172.21.15.72:3300/0 conn(0x7f139009d880 0x7f139009dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.620+0000 7f1395f2d700 1 -- 172.21.15.72:0/1598011451 >> 172.21.15.72:0/1598011451 conn(0x7f13900a2c10 msgr2=0x7f13900a3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.620+0000 7f1395f2d700 1 -- 172.21.15.72:0/1598011451 shutdown_connections 2023-10-03T10:12:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.620+0000 7f1395f2d700 1 -- 172.21.15.72:0/1598011451 wait complete. 2023-10-03T10:12:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.621+0000 7f1395f2d700 1 Processor -- start 2023-10-03T10:12:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.621+0000 7f1395f2d700 1 -- start start 2023-10-03T10:12:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.621+0000 7f1395f2d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f139009d880 0x7f1390118e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.621+0000 7f1395f2d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f139009e230 0x7f1390119380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.621+0000 7f1395f2d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1390133e70 0x7f13901198c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.621+0000 7f1395f2d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139011c020 con 0x7f139009e230 2023-10-03T10:12:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.621+0000 7f1395f2d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139011c220 con 0x7f139009d880 2023-10-03T10:12:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.621+0000 7f1395f2d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f139011b110 con 0x7f1390133e70 2023-10-03T10:12:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f138ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1390133e70 0x7f13901198c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f138f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f139009d880 0x7f1390118e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f138effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f139009e230 0x7f1390119380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f138ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1390133e70 0x7f13901198c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47306/0 (socket says 172.21.15.72:47306) 2023-10-03T10:12:13.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f138ffff700 1 -- 172.21.15.72:0/3850431550 learned_addr learned my addr 172.21.15.72:0/3850431550 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:13.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f138effd700 1 --2- 172.21.15.72:0/3850431550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f139009e230 0x7f1390119380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44212/0 (socket says 172.21.15.72:44212) 2023-10-03T10:12:13.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f138f7fe700 1 --2- 172.21.15.72:0/3850431550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f139009d880 0x7f1390118e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58204/0 (socket says 172.21.15.72:58204) 2023-10-03T10:12:13.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f138effd700 1 -- 172.21.15.72:0/3850431550 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1390133e70 msgr2=0x7f13901198c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f138effd700 1 --2- 172.21.15.72:0/3850431550 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1390133e70 0x7f13901198c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f138effd700 1 -- 172.21.15.72:0/3850431550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f139009d880 msgr2=0x7f1390118e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f138effd700 1 --2- 172.21.15.72:0/3850431550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f139009d880 0x7f1390118e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f138effd700 1 -- 172.21.15.72:0/3850431550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13800094a0 con 0x7f139009e230 2023-10-03T10:12:13.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f138ffff700 1 --2- 172.21.15.72:0/3850431550 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1390133e70 0x7f13901198c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:13.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f138effd700 1 --2- 172.21.15.72:0/3850431550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f139009e230 0x7f1390119380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f138000e8d0 tx=0x7f138000ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f1377fff700 1 -- 172.21.15.72:0/3850431550 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380013680 con 0x7f139009e230 2023-10-03T10:12:13.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f1377fff700 1 -- 172.21.15.72:0/3850431550 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13800137e0 con 0x7f139009e230 2023-10-03T10:12:13.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f1395f2d700 1 -- 172.21.15.72:0/3850431550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13840094a0 con 0x7f139009e230 2023-10-03T10:12:13.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f1377fff700 1 -- 172.21.15.72:0/3850431550 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380013b70 con 0x7f139009e230 2023-10-03T10:12:13.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.622+0000 7f1395f2d700 1 -- 172.21.15.72:0/3850431550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13900a3100 con 0x7f139009e230 2023-10-03T10:12:13.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.623+0000 7f1377fff700 1 -- 172.21.15.72:0/3850431550 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1380013cd0 con 0x7f139009e230 2023-10-03T10:12:13.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.623+0000 7f1377fff700 1 -- 172.21.15.72:0/3850431550 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f138003fe90 con 0x7f139009e230 2023-10-03T10:12:13.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.623+0000 7f1395f2d700 1 -- 172.21.15.72:0/3850431550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13900a1e90 con 0x7f139009e230 2023-10-03T10:12:13.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.628+0000 7f1377fff700 1 -- 172.21.15.72:0/3850431550 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f138006b750 con 0x7f139009e230 2023-10-03T10:12:13.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.811+0000 7f1395f2d700 1 -- 172.21.15.72:0/3850431550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f139004f2a0 con 0x7f139009e230 2023-10-03T10:12:13.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.812+0000 7f1377fff700 1 -- 172.21.15.72:0/3850431550 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1380021070 con 0x7f139009e230 2023-10-03T10:12:13.812 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-03T10:12:13.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.814+0000 7f1395f2d700 1 -- 172.21.15.72:0/3850431550 >> v1:172.21.15.72:6816/126756 conn(0x7f137c02f510 legacy=0x7f137c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.814+0000 7f1395f2d700 1 -- 172.21.15.72:0/3850431550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f139009e230 msgr2=0x7f1390119380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.814+0000 7f1395f2d700 1 --2- 172.21.15.72:0/3850431550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f139009e230 0x7f1390119380 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f138000e8d0 tx=0x7f138000ebe0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.814+0000 7f1395f2d700 1 -- 172.21.15.72:0/3850431550 shutdown_connections 2023-10-03T10:12:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.814+0000 7f1395f2d700 1 --2- 172.21.15.72:0/3850431550 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1390133e70 0x7f13901198c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.814+0000 7f1395f2d700 1 --2- 172.21.15.72:0/3850431550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f139009d880 0x7f1390118e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.814+0000 7f1395f2d700 1 --2- 172.21.15.72:0/3850431550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f139009e230 0x7f1390119380 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.814+0000 7f1395f2d700 1 -- 172.21.15.72:0/3850431550 >> 172.21.15.72:0/3850431550 conn(0x7f13900a2c10 msgr2=0x7f139012d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.814+0000 7f1395f2d700 1 -- 172.21.15.72:0/3850431550 shutdown_connections 2023-10-03T10:12:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.814+0000 7f1395f2d700 1 -- 172.21.15.72:0/3850431550 wait complete. 2023-10-03T10:12:13.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:12:13.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6d50aa700 1 Processor -- start 2023-10-03T10:12:13.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6d50aa700 1 -- start start 2023-10-03T10:12:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6d50aa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6d009d7d0 0x7fe6d009dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6d50aa700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6d009e0e0 0x7fe6d0130770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6d50aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6d0130cb0 0x7fe6d0131150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6d50aa700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d009b620 con 0x7fe6d009e0e0 2023-10-03T10:12:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6d50aa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d009f370 con 0x7fe6d0130cb0 2023-10-03T10:12:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6d50aa700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d009b800 con 0x7fe6d009d7d0 2023-10-03T10:12:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6ced9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6d009d7d0 0x7fe6d009dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6cf59e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6d0130cb0 0x7fe6d0131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6ced9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6d009d7d0 0x7fe6d009dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47312/0 (socket says 172.21.15.72:47312) 2023-10-03T10:12:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6cf59e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6d0130cb0 0x7fe6d0131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58220/0 (socket says 172.21.15.72:58220) 2023-10-03T10:12:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6ced9d700 1 -- 172.21.15.72:0/456855871 learned_addr learned my addr 172.21.15.72:0/456855871 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6ce59c700 1 --2- 172.21.15.72:0/456855871 >> v2:172.21.15.72:3300/0 conn(0x7fe6d009e0e0 0x7fe6d0130770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6ced9d700 1 -- 172.21.15.72:0/456855871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6d0130cb0 msgr2=0x7fe6d0131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6ced9d700 1 --2- 172.21.15.72:0/456855871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6d0130cb0 0x7fe6d0131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6ced9d700 1 -- 172.21.15.72:0/456855871 >> v2:172.21.15.72:3300/0 conn(0x7fe6d009e0e0 msgr2=0x7fe6d0130770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6ced9d700 1 --2- 172.21.15.72:0/456855871 >> v2:172.21.15.72:3300/0 conn(0x7fe6d009e0e0 0x7fe6d0130770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6ced9d700 1 -- 172.21.15.72:0/456855871 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d009ef80 con 0x7fe6d009d7d0 2023-10-03T10:12:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.949+0000 7fe6ce59c700 1 --2- 172.21.15.72:0/456855871 >> v2:172.21.15.72:3300/0 conn(0x7fe6d009e0e0 0x7fe6d0130770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.950+0000 7fe6ced9d700 1 --2- 172.21.15.72:0/456855871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6d009d7d0 0x7fe6d009dba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000bbc0 tx=0x7fe6c000bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4cec252b137bdb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.950+0000 7fe6cdd9b700 1 -- 172.21.15.72:0/456855871 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c000dcf0 con 0x7fe6d009d7d0 2023-10-03T10:12:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.950+0000 7fe6cdd9b700 1 -- 172.21.15.72:0/456855871 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c000de50 con 0x7fe6d009d7d0 2023-10-03T10:12:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.950+0000 7fe6cdd9b700 1 -- 172.21.15.72:0/456855871 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0010690 con 0x7fe6d009d7d0 2023-10-03T10:12:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.950+0000 7fe6d50aa700 1 -- 172.21.15.72:0/456855871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6d009d7d0 msgr2=0x7fe6d009dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.950+0000 7fe6d50aa700 1 --2- 172.21.15.72:0/456855871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6d009d7d0 0x7fe6d009dba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000bbc0 tx=0x7fe6c000bed0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.950+0000 7fe6d50aa700 1 -- 172.21.15.72:0/456855871 shutdown_connections 2023-10-03T10:12:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.950+0000 7fe6d50aa700 1 --2- 172.21.15.72:0/456855871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6d0130cb0 0x7fe6d0131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.950+0000 7fe6d50aa700 1 --2- 172.21.15.72:0/456855871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6d009d7d0 0x7fe6d009dba0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.950+0000 7fe6d50aa700 1 --2- 172.21.15.72:0/456855871 >> v2:172.21.15.72:3300/0 conn(0x7fe6d009e0e0 0x7fe6d0130770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.950+0000 7fe6d50aa700 1 -- 172.21.15.72:0/456855871 >> 172.21.15.72:0/456855871 conn(0x7fe6d0066d70 msgr2=0x7fe6d00a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.950+0000 7fe6d50aa700 1 -- 172.21.15.72:0/456855871 shutdown_connections 2023-10-03T10:12:13.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.950+0000 7fe6d50aa700 1 -- 172.21.15.72:0/456855871 wait complete. 2023-10-03T10:12:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6d50aa700 1 Processor -- start 2023-10-03T10:12:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6d50aa700 1 -- start start 2023-10-03T10:12:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6d50aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6d009d7d0 0x7fe6d0070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6d50aa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6d009e0e0 0x7fe6d00714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6d50aa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6d0130cb0 0x7fe6d0071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6d50aa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d011f3a0 con 0x7fe6d009e0e0 2023-10-03T10:12:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6d50aa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d009c720 con 0x7fe6d009d7d0 2023-10-03T10:12:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6d50aa700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d012b460 con 0x7fe6d0130cb0 2023-10-03T10:12:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6ced9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6d009d7d0 0x7fe6d0070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6cf59e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6d0130cb0 0x7fe6d0071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6ced9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6d009d7d0 0x7fe6d0070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58236/0 (socket says 172.21.15.72:58236) 2023-10-03T10:12:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6ced9d700 1 -- 172.21.15.72:0/54058675 learned_addr learned my addr 172.21.15.72:0/54058675 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6ce59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6d009e0e0 0x7fe6d00714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6cf59e700 1 -- 172.21.15.72:0/54058675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6d009d7d0 msgr2=0x7fe6d0070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6cf59e700 1 --2- 172.21.15.72:0/54058675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6d009d7d0 0x7fe6d0070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6cf59e700 1 -- 172.21.15.72:0/54058675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6d009e0e0 msgr2=0x7fe6d00714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:13.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6cf59e700 1 --2- 172.21.15.72:0/54058675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6d009e0e0 0x7fe6d00714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:13.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6cf59e700 1 -- 172.21.15.72:0/54058675 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b80094a0 con 0x7fe6d0130cb0 2023-10-03T10:12:13.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6ced9d700 1 --2- 172.21.15.72:0/54058675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6d009d7d0 0x7fe6d0070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:13.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.952+0000 7fe6ce59c700 1 --2- 172.21.15.72:0/54058675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6d009e0e0 0x7fe6d00714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:13.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.953+0000 7fe6cf59e700 1 --2- 172.21.15.72:0/54058675 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6d0130cb0 0x7fe6d0071a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800efc0 tx=0x7fe6c800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:13.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.953+0000 7fe6c77fe700 1 -- 172.21.15.72:0/54058675 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800cc90 con 0x7fe6d0130cb0 2023-10-03T10:12:13.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.953+0000 7fe6c77fe700 1 -- 172.21.15.72:0/54058675 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c800f040 con 0x7fe6d0130cb0 2023-10-03T10:12:13.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.953+0000 7fe6d50aa700 1 -- 172.21.15.72:0/54058675 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c000b7f0 con 0x7fe6d0130cb0 2023-10-03T10:12:13.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.953+0000 7fe6c77fe700 1 -- 172.21.15.72:0/54058675 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c80146c0 con 0x7fe6d0130cb0 2023-10-03T10:12:13.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.953+0000 7fe6d50aa700 1 -- 172.21.15.72:0/54058675 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d011f590 con 0x7fe6d0130cb0 2023-10-03T10:12:13.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.954+0000 7fe6c77fe700 1 -- 172.21.15.72:0/54058675 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe6c8014820 con 0x7fe6d0130cb0 2023-10-03T10:12:13.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.954+0000 7fe6c77fe700 1 -- 172.21.15.72:0/54058675 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fe6c80408f0 con 0x7fe6d0130cb0 2023-10-03T10:12:13.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.954+0000 7fe6d50aa700 1 -- 172.21.15.72:0/54058675 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d004f2a0 con 0x7fe6d0130cb0 2023-10-03T10:12:13.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:13.959+0000 7fe6c77fe700 1 -- 172.21.15.72:0/54058675 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe6c8012930 con 0x7fe6d0130cb0 2023-10-03T10:12:14.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.144+0000 7fe6d50aa700 1 -- 172.21.15.72:0/54058675 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6d006c380 con 0x7fe6d0130cb0 2023-10-03T10:12:14.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.144+0000 7fe6c77fe700 1 -- 172.21.15.72:0/54058675 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe6c8012340 con 0x7fe6d0130cb0 2023-10-03T10:12:14.145 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-03T10:12:14.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.146+0000 7fe6d50aa700 1 -- 172.21.15.72:0/54058675 >> v1:172.21.15.72:6816/126756 conn(0x7fe6b002f510 legacy=0x7fe6b00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.146+0000 7fe6d50aa700 1 -- 172.21.15.72:0/54058675 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6d0130cb0 msgr2=0x7fe6d0071a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.146+0000 7fe6d50aa700 1 --2- 172.21.15.72:0/54058675 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6d0130cb0 0x7fe6d0071a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800efc0 tx=0x7fe6c800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.146+0000 7fe6d50aa700 1 -- 172.21.15.72:0/54058675 shutdown_connections 2023-10-03T10:12:14.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.146+0000 7fe6d50aa700 1 --2- 172.21.15.72:0/54058675 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6d0130cb0 0x7fe6d0071a00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.146+0000 7fe6d50aa700 1 --2- 172.21.15.72:0/54058675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6d009d7d0 0x7fe6d0070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.146+0000 7fe6d50aa700 1 --2- 172.21.15.72:0/54058675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6d009e0e0 0x7fe6d00714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.147+0000 7fe6d50aa700 1 -- 172.21.15.72:0/54058675 >> 172.21.15.72:0/54058675 conn(0x7fe6d0066d70 msgr2=0x7fe6d0130070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.147+0000 7fe6d50aa700 1 -- 172.21.15.72:0/54058675 shutdown_connections 2023-10-03T10:12:14.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.147+0000 7fe6d50aa700 1 -- 172.21.15.72:0/54058675 wait complete. 2023-10-03T10:12:14.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:12:14.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.278+0000 7f429843e700 1 Processor -- start 2023-10-03T10:12:14.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.278+0000 7f429843e700 1 -- start start 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.279+0000 7f429843e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f429009e930 0x7f429009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.279+0000 7f429843e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f429009f650 0x7f4290131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.279+0000 7f429843e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4290070940 con 0x7f429009f240 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.279+0000 7f429843e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429006fd60 con 0x7f429009f650 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.279+0000 7f429843e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f429006fa80 con 0x7f429009e930 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.279+0000 7f42961da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f429009e930 0x7f429009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.279+0000 7f42969db700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f429009f650 0x7f4290131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.279+0000 7f42961da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f429009e930 0x7f429009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47330/0 (socket says 172.21.15.72:47330) 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.279+0000 7f42961da700 1 -- 172.21.15.72:0/133345270 learned_addr learned my addr 172.21.15.72:0/133345270 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.279+0000 7f42959d9700 1 --1- 172.21.15.72:0/133345270 >> v1:172.21.15.72:6789/0 conn(0x7f429009f240 0x7f42901317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48018/0 (socket says 172.21.15.72:48018) 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.279+0000 7f42961da700 1 -- 172.21.15.72:0/133345270 >> v2:172.21.15.72:3300/0 conn(0x7f429009f650 msgr2=0x7f4290131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.279+0000 7f42961da700 1 --2- 172.21.15.72:0/133345270 >> v2:172.21.15.72:3300/0 conn(0x7f429009f650 0x7f4290131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.279+0000 7f42961da700 1 -- 172.21.15.72:0/133345270 >> v1:172.21.15.72:6789/0 conn(0x7f429009f240 legacy=0x7f42901317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.279+0000 7f42961da700 1 -- 172.21.15.72:0/133345270 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429009fb60 con 0x7f429009e930 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.279+0000 7f42969db700 1 --2- 172.21.15.72:0/133345270 >> v2:172.21.15.72:3300/0 conn(0x7f429009f650 0x7f4290131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.280+0000 7f42961da700 1 --2- 172.21.15.72:0/133345270 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f429009e930 0x7f429009ed00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f428c0098f0 tx=0x7f428c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ea2f62f9f16cf7d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.280+0000 7f42951d8700 1 -- 172.21.15.72:0/133345270 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c011830 con 0x7f429009e930 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.280+0000 7f42951d8700 1 -- 172.21.15.72:0/133345270 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c011990 con 0x7f429009e930 2023-10-03T10:12:14.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.280+0000 7f42951d8700 1 -- 172.21.15.72:0/133345270 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c011d20 con 0x7f429009e930 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.280+0000 7f429843e700 1 -- 172.21.15.72:0/133345270 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f429009e930 msgr2=0x7f429009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.280+0000 7f429843e700 1 --2- 172.21.15.72:0/133345270 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f429009e930 0x7f429009ed00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f428c0098f0 tx=0x7f428c009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.280+0000 7f429843e700 1 -- 172.21.15.72:0/133345270 shutdown_connections 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.280+0000 7f429843e700 1 --2- 172.21.15.72:0/133345270 >> v2:172.21.15.72:3300/0 conn(0x7f429009f650 0x7f4290131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.280+0000 7f429843e700 1 --2- 172.21.15.72:0/133345270 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f429009e930 0x7f429009ed00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.280+0000 7f429843e700 1 -- 172.21.15.72:0/133345270 >> 172.21.15.72:0/133345270 conn(0x7f42900a4210 msgr2=0x7f42900a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.280+0000 7f429843e700 1 -- 172.21.15.72:0/133345270 shutdown_connections 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.280+0000 7f429843e700 1 -- 172.21.15.72:0/133345270 wait complete. 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.282+0000 7f429843e700 1 Processor -- start 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.282+0000 7f429843e700 1 -- start start 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.282+0000 7f429843e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f429009e930 0x7f42901a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.282+0000 7f429843e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f429009f240 0x7f42901a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.282+0000 7f429843e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f429009f650 0x7f42901a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.282+0000 7f429843e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42901a5120 con 0x7f429009f240 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.282+0000 7f429843e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42901a5880 con 0x7f429009e930 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.282+0000 7f429843e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42901a5ea0 con 0x7f429009f650 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.282+0000 7f42959d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f429009f240 0x7f42901a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.282+0000 7f42961da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f429009e930 0x7f42901a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.282+0000 7f42969db700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f429009f650 0x7f42901a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.282+0000 7f42959d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f429009f240 0x7f42901a41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44238/0 (socket says 172.21.15.72:44238) 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.282+0000 7f42959d9700 1 -- 172.21.15.72:0/1983216370 learned_addr learned my addr 172.21.15.72:0/1983216370 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.282+0000 7f42961da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f429009e930 0x7f42901a3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58244/0 (socket says 172.21.15.72:58244) 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.283+0000 7f42961da700 1 -- 172.21.15.72:0/1983216370 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f429009f650 msgr2=0x7f42901a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.283+0000 7f42961da700 1 --2- 172.21.15.72:0/1983216370 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f429009f650 0x7f42901a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.283+0000 7f42961da700 1 -- 172.21.15.72:0/1983216370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f429009f240 msgr2=0x7f42901a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.283+0000 7f42961da700 1 --2- 172.21.15.72:0/1983216370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f429009f240 0x7f42901a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.283+0000 7f42961da700 1 -- 172.21.15.72:0/1983216370 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4288009a70 con 0x7f429009e930 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.283+0000 7f42959d9700 1 --2- 172.21.15.72:0/1983216370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f429009f240 0x7f42901a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.283+0000 7f42961da700 1 --2- 172.21.15.72:0/1983216370 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f429009e930 0x7f42901a3c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f428c016000 tx=0x7f428c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.283+0000 7f4282ffd700 1 -- 172.21.15.72:0/1983216370 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0043c0 con 0x7f429009e930 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.283+0000 7f4282ffd700 1 -- 172.21.15.72:0/1983216370 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c01f070 con 0x7f429009e930 2023-10-03T10:12:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.283+0000 7f429843e700 1 -- 172.21.15.72:0/1983216370 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c009550 con 0x7f429009e930 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.283+0000 7f4282ffd700 1 -- 172.21.15.72:0/1983216370 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0036a0 con 0x7f429009e930 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.283+0000 7f429843e700 1 -- 172.21.15.72:0/1983216370 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42900a0190 con 0x7f429009e930 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.284+0000 7f4282ffd700 1 -- 172.21.15.72:0/1983216370 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f428c021030 con 0x7f429009e930 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.284+0000 7f4282ffd700 1 -- 172.21.15.72:0/1983216370 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f428c040dc0 con 0x7f429009e930 2023-10-03T10:12:14.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.284+0000 7f429843e700 1 -- 172.21.15.72:0/1983216370 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42901a0b30 con 0x7f429009e930 2023-10-03T10:12:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.289+0000 7f4282ffd700 1 -- 172.21.15.72:0/1983216370 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f428c015080 con 0x7f429009e930 2023-10-03T10:12:14.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.514+0000 7f429843e700 1 -- 172.21.15.72:0/1983216370 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42900a3570 con 0x7f429009e930 2023-10-03T10:12:14.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.514+0000 7f4282ffd700 1 -- 172.21.15.72:0/1983216370 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2313 (secure 0 0 0) 0x7f428c0199a0 con 0x7f429009e930 2023-10-03T10:12:14.515 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:14.515 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:46.344785+0000","modified":"2023-10-03T10:10:08.974385+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6817/542674768","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6817","nonce":542674768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T10:12:14.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.516+0000 7f429843e700 1 -- 172.21.15.72:0/1983216370 >> v1:172.21.15.72:6816/126756 conn(0x7f427402f510 legacy=0x7f42740319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.516+0000 7f429843e700 1 -- 172.21.15.72:0/1983216370 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f429009e930 msgr2=0x7f42901a3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.516+0000 7f429843e700 1 --2- 172.21.15.72:0/1983216370 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f429009e930 0x7f42901a3c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f428c016000 tx=0x7f428c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:14.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.517+0000 7f429843e700 1 -- 172.21.15.72:0/1983216370 shutdown_connections 2023-10-03T10:12:14.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.517+0000 7f429843e700 1 --2- 172.21.15.72:0/1983216370 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f429009f650 0x7f42901a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.517+0000 7f429843e700 1 --2- 172.21.15.72:0/1983216370 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f429009e930 0x7f42901a3c70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.517+0000 7f429843e700 1 --2- 172.21.15.72:0/1983216370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f429009f240 0x7f42901a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.517+0000 7f429843e700 1 -- 172.21.15.72:0/1983216370 >> 172.21.15.72:0/1983216370 conn(0x7f42900a4210 msgr2=0x7f42901b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.517+0000 7f429843e700 1 -- 172.21.15.72:0/1983216370 shutdown_connections 2023-10-03T10:12:14.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.517+0000 7f429843e700 1 -- 172.21.15.72:0/1983216370 wait complete. 2023-10-03T10:12:14.518 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-10-03T10:12:14.529 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.648+0000 7fec8093d700 1 Processor -- start 2023-10-03T10:12:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.648+0000 7fec8093d700 1 -- start start 2023-10-03T10:12:14.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.648+0000 7fec8093d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec7c09e1d0 0x7fec7c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.648+0000 7fec8093d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec7c139170 0x7fec7c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.648+0000 7fec8093d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7c09b120 con 0x7fec7c09d6f0 2023-10-03T10:12:14.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.648+0000 7fec8093d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7c06b460 con 0x7fec7c139170 2023-10-03T10:12:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.648+0000 7fec8093d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c09a7e0 con 0x7fec7c09e1d0 2023-10-03T10:12:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.648+0000 7fec79d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec7c09e1d0 0x7fec7c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.648+0000 7fec7ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec7c139170 0x7fec7c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.648+0000 7fec79d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec7c09e1d0 0x7fec7c138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58246/0 (socket says 172.21.15.72:58246) 2023-10-03T10:12:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.648+0000 7fec7a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fec7c09d6f0 0x7fec7c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48024/0 (socket says 172.21.15.72:48024) 2023-10-03T10:12:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.648+0000 7fec79d9b700 1 -- 172.21.15.72:0/2041128704 learned_addr learned my addr 172.21.15.72:0/2041128704 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.648+0000 7fec7ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec7c139170 0x7fec7c13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44242/0 (socket says 172.21.15.72:44242) 2023-10-03T10:12:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.649+0000 7fec7ad9d700 1 -- 172.21.15.72:0/2041128704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec7c09e1d0 msgr2=0x7fec7c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.649+0000 7fec7ad9d700 1 --2- 172.21.15.72:0/2041128704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec7c09e1d0 0x7fec7c138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.649+0000 7fec7ad9d700 1 -- 172.21.15.72:0/2041128704 >> v1:172.21.15.72:6789/0 conn(0x7fec7c09d6f0 legacy=0x7fec7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.649+0000 7fec7ad9d700 1 -- 172.21.15.72:0/2041128704 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c09a500 con 0x7fec7c139170 2023-10-03T10:12:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.649+0000 7fec7959a700 1 -- 172.21.15.72:0/2041128704 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280728827 0 0) 0x7fec7c09b120 con 0x7fec7c09d6f0 2023-10-03T10:12:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.649+0000 7fec79d9b700 1 --2- 172.21.15.72:0/2041128704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec7c09e1d0 0x7fec7c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.649+0000 7fec7ad9d700 1 --2- 172.21.15.72:0/2041128704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec7c139170 0x7fec7c13b550 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec74009d90 tx=0x7fec7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379a13746a7ef982 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.649+0000 7fec7959a700 1 -- 172.21.15.72:0/2041128704 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7400e070 con 0x7fec7c139170 2023-10-03T10:12:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.649+0000 7fec7959a700 1 -- 172.21.15.72:0/2041128704 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7400bb20 con 0x7fec7c139170 2023-10-03T10:12:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.649+0000 7fec7959a700 1 -- 172.21.15.72:0/2041128704 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74012430 con 0x7fec7c139170 2023-10-03T10:12:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.649+0000 7fec8093d700 1 -- 172.21.15.72:0/2041128704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec7c139170 msgr2=0x7fec7c13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.650+0000 7fec8093d700 1 --2- 172.21.15.72:0/2041128704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec7c139170 0x7fec7c13b550 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec74009d90 tx=0x7fec7400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.650+0000 7fec8093d700 1 -- 172.21.15.72:0/2041128704 shutdown_connections 2023-10-03T10:12:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.650+0000 7fec8093d700 1 --2- 172.21.15.72:0/2041128704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec7c139170 0x7fec7c13b550 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.650+0000 7fec8093d700 1 --2- 172.21.15.72:0/2041128704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec7c09e1d0 0x7fec7c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.650+0000 7fec8093d700 1 -- 172.21.15.72:0/2041128704 >> 172.21.15.72:0/2041128704 conn(0x7fec7c066f50 msgr2=0x7fec7c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.650+0000 7fec8093d700 1 -- 172.21.15.72:0/2041128704 shutdown_connections 2023-10-03T10:12:14.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.650+0000 7fec8093d700 1 -- 172.21.15.72:0/2041128704 wait complete. 2023-10-03T10:12:14.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec8093d700 1 Processor -- start 2023-10-03T10:12:14.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec8093d700 1 -- start start 2023-10-03T10:12:14.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec8093d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec7c09d6f0 0x7fec7c11e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec8093d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec7c09e1d0 0x7fec7c11edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec8093d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec7c139170 0x7fec7c11f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec8093d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c0720b0 con 0x7fec7c09d6f0 2023-10-03T10:12:14.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec8093d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c1205d0 con 0x7fec7c09e1d0 2023-10-03T10:12:14.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec8093d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c121e30 con 0x7fec7c139170 2023-10-03T10:12:14.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec79d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec7c09e1d0 0x7fec7c11edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec7a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec7c09d6f0 0x7fec7c11e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec79d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec7c09e1d0 0x7fec7c11edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58256/0 (socket says 172.21.15.72:58256) 2023-10-03T10:12:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec79d9b700 1 -- 172.21.15.72:0/3684635402 learned_addr learned my addr 172.21.15.72:0/3684635402 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec7ad9d700 1 --2- 172.21.15.72:0/3684635402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec7c139170 0x7fec7c11f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec7a59c700 1 -- 172.21.15.72:0/3684635402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec7c139170 msgr2=0x7fec7c11f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec7a59c700 1 --2- 172.21.15.72:0/3684635402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec7c139170 0x7fec7c11f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec7a59c700 1 -- 172.21.15.72:0/3684635402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec7c09e1d0 msgr2=0x7fec7c11edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec7a59c700 1 --2- 172.21.15.72:0/3684635402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec7c09e1d0 0x7fec7c11edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec7a59c700 1 -- 172.21.15.72:0/3684635402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec70009550 con 0x7fec7c09d6f0 2023-10-03T10:12:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.651+0000 7fec79d9b700 1 --2- 172.21.15.72:0/3684635402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec7c09e1d0 0x7fec7c11edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.652+0000 7fec7a59c700 1 --2- 172.21.15.72:0/3684635402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec7c09d6f0 0x7fec7c11e8b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00c470 tx=0x7fec6c00c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.652+0000 7fec6affd700 1 -- 172.21.15.72:0/3684635402 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c004c80 con 0x7fec7c09d6f0 2023-10-03T10:12:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.652+0000 7fec6affd700 1 -- 172.21.15.72:0/3684635402 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c004de0 con 0x7fec7c09d6f0 2023-10-03T10:12:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.652+0000 7fec6affd700 1 -- 172.21.15.72:0/3684635402 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c007310 con 0x7fec7c09d6f0 2023-10-03T10:12:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.652+0000 7fec8093d700 1 -- 172.21.15.72:0/3684635402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec74009a70 con 0x7fec7c09d6f0 2023-10-03T10:12:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.652+0000 7fec8093d700 1 -- 172.21.15.72:0/3684635402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7c1220f0 con 0x7fec7c09d6f0 2023-10-03T10:12:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.652+0000 7fec6affd700 1 -- 172.21.15.72:0/3684635402 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fec6c007470 con 0x7fec7c09d6f0 2023-10-03T10:12:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.653+0000 7fec6affd700 1 -- 172.21.15.72:0/3684635402 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fec6c03f730 con 0x7fec7c09d6f0 2023-10-03T10:12:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.653+0000 7fec8093d700 1 -- 172.21.15.72:0/3684635402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7c074ea0 con 0x7fec7c09d6f0 2023-10-03T10:12:14.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.657+0000 7fec6affd700 1 -- 172.21.15.72:0/3684635402 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec6c007720 con 0x7fec7c09d6f0 2023-10-03T10:12:14.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.844+0000 7fec8093d700 1 -- 172.21.15.72:0/3684635402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec7c071e90 con 0x7fec7c09d6f0 2023-10-03T10:12:14.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.845+0000 7fec6affd700 1 -- 172.21.15.72:0/3684635402 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12864 (secure 0 0 0) 0x7fec6c011e80 con 0x7fec7c09d6f0 2023-10-03T10:12:14.846 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:14.846 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":23,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:12:08.075987+0000","last_up_change":"2023-10-03T10:09:38.922268+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":0}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":0}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6816/118184":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/3319279924":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/2966012812":"2023-10-04T10:12:06.073551+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.848+0000 7fec8093d700 1 -- 172.21.15.72:0/3684635402 >> v1:172.21.15.72:6816/126756 conn(0x7fec5c02f510 legacy=0x7fec5c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.848+0000 7fec8093d700 1 -- 172.21.15.72:0/3684635402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec7c09d6f0 msgr2=0x7fec7c11e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.848+0000 7fec8093d700 1 --2- 172.21.15.72:0/3684635402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec7c09d6f0 0x7fec7c11e8b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00c470 tx=0x7fec6c00c780 comp rx=0 tx=0).stop 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.848+0000 7fec8093d700 1 -- 172.21.15.72:0/3684635402 shutdown_connections 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.848+0000 7fec8093d700 1 --2- 172.21.15.72:0/3684635402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec7c09d6f0 0x7fec7c11e8b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.848+0000 7fec8093d700 1 --2- 172.21.15.72:0/3684635402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec7c139170 0x7fec7c11f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.848+0000 7fec8093d700 1 --2- 172.21.15.72:0/3684635402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec7c09e1d0 0x7fec7c11edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.848+0000 7fec8093d700 1 -- 172.21.15.72:0/3684635402 >> 172.21.15.72:0/3684635402 conn(0x7fec7c066f50 msgr2=0x7fec7c136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.848+0000 7fec8093d700 1 -- 172.21.15.72:0/3684635402 shutdown_connections 2023-10-03T10:12:14.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.848+0000 7fec8093d700 1 -- 172.21.15.72:0/3684635402 wait complete. 2023-10-03T10:12:14.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:12:14.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.979+0000 7f9615c60700 1 Processor -- start 2023-10-03T10:12:14.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.979+0000 7f9615c60700 1 -- start start 2023-10-03T10:12:14.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f9615c60700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96100a0a30 0x7f96100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f9615c60700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9610134170 0x7f961013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f9615c60700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961009edd0 con 0x7f96100a1340 2023-10-03T10:12:14.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f9615c60700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961009e1f0 con 0x7f96100a0a30 2023-10-03T10:12:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f9615c60700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f961009dc50 con 0x7f9610134170 2023-10-03T10:12:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f960f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96100a0a30 0x7f96100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f960ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9610134170 0x7f961013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f960effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f96100a1340 0x7f9610133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48032/0 (socket says 172.21.15.72:48032) 2023-10-03T10:12:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f960effd700 1 -- 172.21.15.72:0/2992597220 learned_addr learned my addr 172.21.15.72:0/2992597220 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f960e7fc700 1 -- 172.21.15.72:0/2992597220 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381494220 0 0) 0x7f961009edd0 con 0x7f96100a1340 2023-10-03T10:12:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f960f7fe700 1 -- 172.21.15.72:0/2992597220 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9610134170 msgr2=0x7f961013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f960f7fe700 1 --2- 172.21.15.72:0/2992597220 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9610134170 0x7f961013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f960f7fe700 1 -- 172.21.15.72:0/2992597220 >> v1:172.21.15.72:6789/0 conn(0x7f96100a1340 legacy=0x7f9610133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f960f7fe700 1 -- 172.21.15.72:0/2992597220 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96100a1fe0 con 0x7f96100a0a30 2023-10-03T10:12:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f960ffff700 1 --2- 172.21.15.72:0/2992597220 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9610134170 0x7f961013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.980+0000 7f960f7fe700 1 --2- 172.21.15.72:0/2992597220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96100a0a30 0x7f96100a0e00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9600009870 tx=0x7f9600009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c100a28b1d5f73b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.981+0000 7f960e7fc700 1 -- 172.21.15.72:0/2992597220 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600011830 con 0x7f96100a0a30 2023-10-03T10:12:14.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.981+0000 7f960e7fc700 1 -- 172.21.15.72:0/2992597220 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600011990 con 0x7f96100a0a30 2023-10-03T10:12:14.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.981+0000 7f960e7fc700 1 -- 172.21.15.72:0/2992597220 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600011d20 con 0x7f96100a0a30 2023-10-03T10:12:14.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.981+0000 7f9615c60700 1 -- 172.21.15.72:0/2992597220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96100a0a30 msgr2=0x7f96100a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.981+0000 7f9615c60700 1 --2- 172.21.15.72:0/2992597220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96100a0a30 0x7f96100a0e00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9600009870 tx=0x7f9600009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:14.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.981+0000 7f9615c60700 1 -- 172.21.15.72:0/2992597220 shutdown_connections 2023-10-03T10:12:14.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.981+0000 7f9615c60700 1 --2- 172.21.15.72:0/2992597220 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9610134170 0x7f961013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.981+0000 7f9615c60700 1 --2- 172.21.15.72:0/2992597220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96100a0a30 0x7f96100a0e00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.981+0000 7f9615c60700 1 -- 172.21.15.72:0/2992597220 >> 172.21.15.72:0/2992597220 conn(0x7f96100a6550 msgr2=0x7f96100a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:14.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.981+0000 7f9615c60700 1 -- 172.21.15.72:0/2992597220 shutdown_connections 2023-10-03T10:12:14.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.981+0000 7f9615c60700 1 -- 172.21.15.72:0/2992597220 wait complete. 2023-10-03T10:12:14.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.982+0000 7f9615c60700 1 Processor -- start 2023-10-03T10:12:14.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.982+0000 7f9615c60700 1 -- start start 2023-10-03T10:12:14.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f9615c60700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f96100a0a30 0x7f96101c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f9615c60700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96100a1340 0x7f96101c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f9615c60700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9610134170 0x7f96101c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:14.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f9615c60700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9610126440 con 0x7f96100a1340 2023-10-03T10:12:14.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f9615c60700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96101246d0 con 0x7f9610134170 2023-10-03T10:12:14.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f9615c60700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96101244a0 con 0x7f96100a0a30 2023-10-03T10:12:14.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f960ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9610134170 0x7f96101c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f960f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f96100a0a30 0x7f96101c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f960effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96100a1340 0x7f96101c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:14.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f960ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9610134170 0x7f96101c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58286/0 (socket says 172.21.15.72:58286) 2023-10-03T10:12:14.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f960ffff700 1 -- 172.21.15.72:0/3266758854 learned_addr learned my addr 172.21.15.72:0/3266758854 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:14.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f960f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f96100a0a30 0x7f96101c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47364/0 (socket says 172.21.15.72:47364) 2023-10-03T10:12:14.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f960effd700 1 -- 172.21.15.72:0/3266758854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f96100a0a30 msgr2=0x7f96101c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f960effd700 1 --2- 172.21.15.72:0/3266758854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f96100a0a30 0x7f96101c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f960effd700 1 -- 172.21.15.72:0/3266758854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9610134170 msgr2=0x7f96101c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:14.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f960effd700 1 --2- 172.21.15.72:0/3266758854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9610134170 0x7f96101c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:14.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f960effd700 1 -- 172.21.15.72:0/3266758854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9608009a70 con 0x7f96100a1340 2023-10-03T10:12:14.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f960ffff700 1 --2- 172.21.15.72:0/3266758854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9610134170 0x7f96101c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:14.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f960effd700 1 --2- 172.21.15.72:0/3266758854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96100a1340 0x7f96101c8990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f95f800c4a0 tx=0x7f95f800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:14.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f9607fff700 1 -- 172.21.15.72:0/3266758854 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8004c80 con 0x7f96100a1340 2023-10-03T10:12:14.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f9607fff700 1 -- 172.21.15.72:0/3266758854 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f8004de0 con 0x7f96100a1340 2023-10-03T10:12:14.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f9615c60700 1 -- 172.21.15.72:0/3266758854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96000094a0 con 0x7f96100a1340 2023-10-03T10:12:14.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.983+0000 7f9607fff700 1 -- 172.21.15.72:0/3266758854 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8007310 con 0x7f96100a1340 2023-10-03T10:12:14.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.984+0000 7f9615c60700 1 -- 172.21.15.72:0/3266758854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96100a25e0 con 0x7f96100a1340 2023-10-03T10:12:14.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.984+0000 7f9607fff700 1 -- 172.21.15.72:0/3266758854 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f95f8007470 con 0x7f96100a1340 2023-10-03T10:12:14.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.984+0000 7f9615c60700 1 -- 172.21.15.72:0/3266758854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9610126260 con 0x7f96100a1340 2023-10-03T10:12:14.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.984+0000 7f9607fff700 1 -- 172.21.15.72:0/3266758854 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f95f803f730 con 0x7f96100a1340 2023-10-03T10:12:14.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:14.989+0000 7f9607fff700 1 -- 172.21.15.72:0/3266758854 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95f80102c0 con 0x7f96100a1340 2023-10-03T10:12:15.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.215+0000 7f9615c60700 1 -- 172.21.15.72:0/3266758854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f961009c7e0 con 0x7f96100a1340 2023-10-03T10:12:15.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.216+0000 7f9607fff700 1 -- 172.21.15.72:0/3266758854 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2313 (secure 0 0 0) 0x7f95f8011360 con 0x7f96100a1340 2023-10-03T10:12:15.217 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:15.217 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:09:46.344785+0000","modified":"2023-10-03T10:10:08.974385+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4187":{"gid":4187,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6817/542674768","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6817","nonce":542674768}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T10:12:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.218+0000 7f9615c60700 1 -- 172.21.15.72:0/3266758854 >> v1:172.21.15.72:6816/126756 conn(0x7f95f002f510 legacy=0x7f95f00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.218+0000 7f9615c60700 1 -- 172.21.15.72:0/3266758854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96100a1340 msgr2=0x7f96101c8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.218+0000 7f9615c60700 1 --2- 172.21.15.72:0/3266758854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96100a1340 0x7f96101c8990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f95f800c4a0 tx=0x7f95f800c7b0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.218+0000 7f9615c60700 1 -- 172.21.15.72:0/3266758854 shutdown_connections 2023-10-03T10:12:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.218+0000 7f9615c60700 1 --2- 172.21.15.72:0/3266758854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9610134170 0x7f96101c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.218+0000 7f9615c60700 1 --2- 172.21.15.72:0/3266758854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f96100a0a30 0x7f96101c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.218+0000 7f9615c60700 1 --2- 172.21.15.72:0/3266758854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96100a1340 0x7f96101c8990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.218+0000 7f9615c60700 1 -- 172.21.15.72:0/3266758854 >> 172.21.15.72:0/3266758854 conn(0x7f96100a6550 msgr2=0x7f961009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.218+0000 7f9615c60700 1 -- 172.21.15.72:0/3266758854 shutdown_connections 2023-10-03T10:12:15.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.218+0000 7f9615c60700 1 -- 172.21.15.72:0/3266758854 wait complete. 2023-10-03T10:12:15.220 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-10-03T10:12:15.331 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T10:09:46.344785+0000', 'modified': '2023-10-03T10:10:08.974385+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4187}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4187': {'gid': 4187, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6817/542674768', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.72:6817', 'nonce': 542674768}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-03T10:12:15.331 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T10:12:15.332 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T10:12:15.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.451+0000 7fb95feb8700 1 Processor -- start 2023-10-03T10:12:15.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.452+0000 7fb95feb8700 1 -- start start 2023-10-03T10:12:15.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.452+0000 7fb95feb8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb95809e1d0 0x7fb958138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.452+0000 7fb95feb8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb958139170 0x7fb95813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.452+0000 7fb95feb8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb95809b120 con 0x7fb95809d6f0 2023-10-03T10:12:15.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.452+0000 7fb95feb8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95806b460 con 0x7fb958139170 2023-10-03T10:12:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.452+0000 7fb95feb8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb95809a7e0 con 0x7fb95809e1d0 2023-10-03T10:12:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.452+0000 7fb95d453700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb95809e1d0 0x7fb958138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.452+0000 7fb95dc54700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb95809d6f0 0x7fb95809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48044/0 (socket says 172.21.15.72:48044) 2023-10-03T10:12:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.452+0000 7fb95dc54700 1 -- 172.21.15.72:0/3701058721 learned_addr learned my addr 172.21.15.72:0/3701058721 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.452+0000 7fb95e455700 1 --2- 172.21.15.72:0/3701058721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb958139170 0x7fb95813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.452+0000 7fb95cc52700 1 -- 172.21.15.72:0/3701058721 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775835762 0 0) 0x7fb95809b120 con 0x7fb95809d6f0 2023-10-03T10:12:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.452+0000 7fb95cc52700 1 -- 172.21.15.72:0/3701058721 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9440035b0 con 0x7fb95809d6f0 2023-10-03T10:12:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.453+0000 7fb95d453700 1 -- 172.21.15.72:0/3701058721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb958139170 msgr2=0x7fb95813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.453+0000 7fb95d453700 1 --2- 172.21.15.72:0/3701058721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb958139170 0x7fb95813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.453+0000 7fb95d453700 1 -- 172.21.15.72:0/3701058721 >> v1:172.21.15.72:6789/0 conn(0x7fb95809d6f0 legacy=0x7fb95809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.453+0000 7fb95d453700 1 -- 172.21.15.72:0/3701058721 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95809a500 con 0x7fb95809e1d0 2023-10-03T10:12:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.453+0000 7fb95e455700 1 --2- 172.21.15.72:0/3701058721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb958139170 0x7fb95813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.453+0000 7fb95d453700 1 --2- 172.21.15.72:0/3701058721 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb95809e1d0 0x7fb958138c30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9540098a0 tx=0x7fb954009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=895658a462542578 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.453+0000 7fb95cc52700 1 -- 172.21.15.72:0/3701058721 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954011830 con 0x7fb95809e1d0 2023-10-03T10:12:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.453+0000 7fb95cc52700 1 -- 172.21.15.72:0/3701058721 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb954011990 con 0x7fb95809e1d0 2023-10-03T10:12:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.453+0000 7fb95cc52700 1 -- 172.21.15.72:0/3701058721 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954011d20 con 0x7fb95809e1d0 2023-10-03T10:12:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.453+0000 7fb95feb8700 1 -- 172.21.15.72:0/3701058721 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb95809e1d0 msgr2=0x7fb958138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.453+0000 7fb95feb8700 1 --2- 172.21.15.72:0/3701058721 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb95809e1d0 0x7fb958138c30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9540098a0 tx=0x7fb954009bb0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.453+0000 7fb95feb8700 1 -- 172.21.15.72:0/3701058721 shutdown_connections 2023-10-03T10:12:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.453+0000 7fb95feb8700 1 --2- 172.21.15.72:0/3701058721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb958139170 0x7fb95813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.453+0000 7fb95feb8700 1 --2- 172.21.15.72:0/3701058721 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb95809e1d0 0x7fb958138c30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.453+0000 7fb95feb8700 1 -- 172.21.15.72:0/3701058721 >> 172.21.15.72:0/3701058721 conn(0x7fb958066f50 msgr2=0x7fb95809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.454+0000 7fb95feb8700 1 -- 172.21.15.72:0/3701058721 shutdown_connections 2023-10-03T10:12:15.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.454+0000 7fb95feb8700 1 -- 172.21.15.72:0/3701058721 wait complete. 2023-10-03T10:12:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.454+0000 7fb95feb8700 1 Processor -- start 2023-10-03T10:12:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.454+0000 7fb95feb8700 1 -- start start 2023-10-03T10:12:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95feb8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb95809d6f0 0x7fb958120750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95feb8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95809e1d0 0x7fb958120c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95feb8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb958139170 0x7fb9581211d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95feb8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95809c7a0 con 0x7fb95809e1d0 2023-10-03T10:12:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95feb8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb958123a20 con 0x7fb958139170 2023-10-03T10:12:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95feb8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb958122bc0 con 0x7fb95809d6f0 2023-10-03T10:12:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95dc54700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb95809d6f0 0x7fb958120750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95e455700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb958139170 0x7fb9581211d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95d453700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95809e1d0 0x7fb958120c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95dc54700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb95809d6f0 0x7fb958120750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47382/0 (socket says 172.21.15.72:47382) 2023-10-03T10:12:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95e455700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb958139170 0x7fb9581211d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58296/0 (socket says 172.21.15.72:58296) 2023-10-03T10:12:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95dc54700 1 -- 172.21.15.72:0/546013685 learned_addr learned my addr 172.21.15.72:0/546013685 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95d453700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95809e1d0 0x7fb958120c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44276/0 (socket says 172.21.15.72:44276) 2023-10-03T10:12:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95dc54700 1 -- 172.21.15.72:0/546013685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb958139170 msgr2=0x7fb9581211d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95dc54700 1 --2- 172.21.15.72:0/546013685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb958139170 0x7fb9581211d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95dc54700 1 -- 172.21.15.72:0/546013685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95809e1d0 msgr2=0x7fb958120c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95dc54700 1 --2- 172.21.15.72:0/546013685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95809e1d0 0x7fb958120c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95dc54700 1 -- 172.21.15.72:0/546013685 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb950009a70 con 0x7fb95809d6f0 2023-10-03T10:12:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95d453700 1 --2- 172.21.15.72:0/546013685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95809e1d0 0x7fb958120c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:15.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb95dc54700 1 --2- 172.21.15.72:0/546013685 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb95809d6f0 0x7fb958120750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb94800c730 tx=0x7fb94800ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb94e7fc700 1 -- 172.21.15.72:0/546013685 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948005d70 con 0x7fb95809d6f0 2023-10-03T10:12:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.455+0000 7fb94e7fc700 1 -- 172.21.15.72:0/546013685 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9480070d0 con 0x7fb95809d6f0 2023-10-03T10:12:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.456+0000 7fb95feb8700 1 -- 172.21.15.72:0/546013685 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9540094a0 con 0x7fb95809d6f0 2023-10-03T10:12:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.456+0000 7fb94e7fc700 1 -- 172.21.15.72:0/546013685 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948007460 con 0x7fb95809d6f0 2023-10-03T10:12:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.456+0000 7fb95feb8700 1 -- 172.21.15.72:0/546013685 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb958123f90 con 0x7fb95809d6f0 2023-10-03T10:12:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.456+0000 7fb94e7fc700 1 -- 172.21.15.72:0/546013685 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb9480075c0 con 0x7fb95809d6f0 2023-10-03T10:12:15.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.456+0000 7fb94e7fc700 1 -- 172.21.15.72:0/546013685 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fb94803efa0 con 0x7fb95809d6f0 2023-10-03T10:12:15.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.459+0000 7fb96c05bb80 1 Processor -- start 2023-10-03T10:12:15.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.459+0000 7fb96c05bb80 1 -- start start 2023-10-03T10:12:15.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb96c05bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbe4c50 0x55646cbe5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb96c05bb80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cc01100 0x55646cbe5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb96c05bb80 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cbfb8f0 0x55646cbfbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb96c05bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646cb47c60 con 0x55646cbe4c50 2023-10-03T10:12:15.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb96c05bb80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55646cb42a10 con 0x55646cc01100 2023-10-03T10:12:15.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb96c05bb80 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x55646cb40210 con 0x55646cbfb8f0 2023-10-03T10:12:15.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb95dc54700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbe4c50 0x55646cbe5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb95dc54700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbe4c50 0x55646cbe5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44292/0 (socket says 172.21.15.72:44292) 2023-10-03T10:12:15.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb95e455700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cbfb8f0 0x55646cbfbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb95dc54700 1 -- 172.21.15.72:0/3651324123 learned_addr learned my addr 172.21.15.72:0/3651324123 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:15.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb95d453700 1 --2- 172.21.15.72:0/3651324123 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cc01100 0x55646cbe5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb95dc54700 1 -- 172.21.15.72:0/3651324123 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cbfb8f0 msgr2=0x55646cbfbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb95dc54700 1 --2- 172.21.15.72:0/3651324123 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cbfb8f0 0x55646cbfbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb95dc54700 1 -- 172.21.15.72:0/3651324123 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cc01100 msgr2=0x55646cbe5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb95dc54700 1 --2- 172.21.15.72:0/3651324123 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cc01100 0x55646cbe5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb95dc54700 1 -- 172.21.15.72:0/3651324123 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55646c92f790 con 0x55646cbe4c50 2023-10-03T10:12:15.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb95e455700 1 --2- 172.21.15.72:0/3651324123 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cbfb8f0 0x55646cbfbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:15.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb95dc54700 1 --2- 172.21.15.72:0/3651324123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbe4c50 0x55646cbe5020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb94803daf0 tx=0x7fb948009050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114c413b056c5f73 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb93b7fe700 1 -- 172.21.15.72:0/3651324123 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948011360 con 0x55646cbe4c50 2023-10-03T10:12:15.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb93b7fe700 1 -- 172.21.15.72:0/3651324123 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb948019640 con 0x55646cbe4c50 2023-10-03T10:12:15.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.460+0000 7fb93b7fe700 1 -- 172.21.15.72:0/3651324123 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94801bb60 con 0x55646cbe4c50 2023-10-03T10:12:15.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.461+0000 7fb96c05bb80 1 -- 172.21.15.72:0/3651324123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbe4c50 msgr2=0x55646cbe5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.461+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/3651324123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbe4c50 0x55646cbe5020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb94803daf0 tx=0x7fb948009050 comp rx=0 tx=0).stop 2023-10-03T10:12:15.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.461+0000 7fb96c05bb80 1 -- 172.21.15.72:0/3651324123 shutdown_connections 2023-10-03T10:12:15.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.461+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/3651324123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbe4c50 0x55646cbe5020 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.461+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/3651324123 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cbfb8f0 0x55646cbfbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.461+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/3651324123 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cc01100 0x55646cbe5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.461+0000 7fb96c05bb80 1 -- 172.21.15.72:0/3651324123 >> 172.21.15.72:0/3651324123 conn(0x55646cbe90f0 msgr2=0x55646cbe8690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.461+0000 7fb96c05bb80 1 -- 172.21.15.72:0/3651324123 shutdown_connections 2023-10-03T10:12:15.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.461+0000 7fb96c05bb80 1 -- 172.21.15.72:0/3651324123 wait complete. 2023-10-03T10:12:15.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.461+0000 7fb96c05bb80 1 -- start start 2023-10-03T10:12:15.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.462+0000 7fb96c05bb80 1 Processor -- start 2023-10-03T10:12:15.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.462+0000 7fb96c05bb80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cbfdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.462+0000 7fb96c05bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbfb8f0 0x55646cbfe440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb96c05bb80 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cc01100 0x55646cbfe980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb96c05bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646cb3bb00 con 0x55646cbfb8f0 2023-10-03T10:12:15.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb96c05bb80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55646cad7770 con 0x55646cbe4c50 2023-10-03T10:12:15.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb96c05bb80 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x55646cafa6f0 con 0x55646cc01100 2023-10-03T10:12:15.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb96c05bb80 10 client.0 _ll_register_callbacks cb 0x55646c9435a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:12:15.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb95dc54700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cbfdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb95dc54700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cbfdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58306/0 (socket says 172.21.15.72:58306) 2023-10-03T10:12:15.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb95dc54700 1 -- 172.21.15.72:0/3814043959 learned_addr learned my addr 172.21.15.72:0/3814043959 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:15.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb95d453700 1 --2- 172.21.15.72:0/3814043959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbfb8f0 0x55646cbfe440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb95e455700 1 --2- 172.21.15.72:0/3814043959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cc01100 0x55646cbfe980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb95dc54700 1 -- 172.21.15.72:0/3814043959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cc01100 msgr2=0x55646cbfe980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb95dc54700 1 --2- 172.21.15.72:0/3814043959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cc01100 0x55646cbfe980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb95dc54700 1 -- 172.21.15.72:0/3814043959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbfb8f0 msgr2=0x55646cbfe440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb95dc54700 1 --2- 172.21.15.72:0/3814043959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbfb8f0 0x55646cbfe440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb95dc54700 1 -- 172.21.15.72:0/3814043959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb950011230 con 0x55646cbe4c50 2023-10-03T10:12:15.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb95dc54700 1 --2- 172.21.15.72:0/3814043959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cbfdf00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb94803cf70 tx=0x7fb948001150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=804e3ce09fc6c98c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb938ff9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3301/0 2023-10-03T10:12:15.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb938ff9700 1 -- 172.21.15.72:0/3814043959 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94803d240 con 0x55646cbe4c50 2023-10-03T10:12:15.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb938ff9700 1 -- 172.21.15.72:0/3814043959 <== mon.1 v2:172.21.15.72:3301/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fb94803d3a0 con 0x55646cbe4c50 2023-10-03T10:12:15.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb96c05bb80 1 -- 172.21.15.72:0/3814043959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55646cbdd2b0 con 0x55646cbe4c50 2023-10-03T10:12:15.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb938ff9700 1 -- 172.21.15.72:0/3814043959 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb948011360 con 0x55646cbe4c50 2023-10-03T10:12:15.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb96c05bb80 10 client.14380 fetch_fsmap learned FSMap version 7 2023-10-03T10:12:15.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb96c05bb80 1 -- 172.21.15.72:0/3814043959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,fsmap=7,monmap=3+}) v3 -- 0x7fb958123f90 con 0x55646cbe4c50 2023-10-03T10:12:15.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.463+0000 7fb938ff9700 1 -- 172.21.15.72:0/3814043959 <== mon.1 v2:172.21.15.72:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94802a030 con 0x55646cbe4c50 2023-10-03T10:12:15.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.464+0000 7fb938ff9700 1 -- 172.21.15.72:0/3814043959 <== mon.1 v2:172.21.15.72:3301/0 5 ==== fsmap(e 7) v1 ==== 1436+0+0 (secure 0 0 0) 0x7fb948023020 con 0x55646cbe4c50 2023-10-03T10:12:15.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.464+0000 7fb96c05bb80 10 client.14380 fetch_fsmap finished waiting for FSMap version 7 2023-10-03T10:12:15.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.464+0000 7fb96c05bb80 10 client.14380 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:12:15.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.464+0000 7fb96c05bb80 20 client.14380 populate_metadata read hostname 'smithi072' 2023-10-03T10:12:15.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.464+0000 7fb96c05bb80 4 client.14380 mds_command: new command op to 4187 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T10:12:15.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.464+0000 7fb96c05bb80 1 -- 172.21.15.72:0/3814043959 --> v1:172.21.15.72:6817/542674768 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55646cbb9f40 con 0x55646cc158e0 2023-10-03T10:12:15.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.464+0000 7fb938ff9700 10 client.14380 ms_handle_connect on v1:172.21.15.72:6817/542674768 2023-10-03T10:12:15.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.464+0000 7fb938ff9700 1 -- 172.21.15.72:0/3814043959 <== mds.0 v1:172.21.15.72:6817/542674768 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55646cbb9f40 con 0x55646cc158e0 2023-10-03T10:12:15.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.464+0000 7fb938ff9700 10 client.14380 handle_command_reply: tid=0 2023-10-03T10:12:15.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.464+0000 7fb96c05bb80 1 client.14380 shutdown 2023-10-03T10:12:15.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.465+0000 7fb96c05bb80 1 -- 172.21.15.72:0/3814043959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 msgr2=0x55646cbfdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.465+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/3814043959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cbfdf00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb94803cf70 tx=0x7fb948001150 comp rx=0 tx=0).stop 2023-10-03T10:12:15.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.465+0000 7fb96c05bb80 1 -- 172.21.15.72:0/3814043959 shutdown_connections 2023-10-03T10:12:15.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.465+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/3814043959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cc01100 0x55646cbfe980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.465+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/3814043959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cbfdf00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.465+0000 7fb938ff9700 0 client.14380 ms_handle_reset on v1:172.21.15.72:6817/542674768 2023-10-03T10:12:15.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.465+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/3814043959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbfb8f0 0x55646cbfe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.465+0000 7fb96c05bb80 1 -- 172.21.15.72:0/3814043959 >> 172.21.15.72:0/3814043959 conn(0x55646cbe90f0 msgr2=0x55646cbe5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.465+0000 7fb96c05bb80 1 -- 172.21.15.72:0/3814043959 shutdown_connections 2023-10-03T10:12:15.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.465+0000 7fb96c05bb80 1 -- 172.21.15.72:0/3814043959 wait complete. 2023-10-03T10:12:15.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.465+0000 7fb96c05bb80 20 client.14380 trim_cache size 0 max 16384 2023-10-03T10:12:15.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.482+0000 7fb96c05bb80 1 Processor -- start 2023-10-03T10:12:15.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.482+0000 7fb96c05bb80 1 -- start start 2023-10-03T10:12:15.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.482+0000 7fb96c05bb80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cc258d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.482+0000 7fb96c05bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbfb8f0 0x55646cc05e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.482+0000 7fb96c05bb80 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cc01100 0x55646cc063c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.482+0000 7fb96c05bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646c930390 con 0x55646cbfb8f0 2023-10-03T10:12:15.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.482+0000 7fb96c05bb80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55646cc0ace0 con 0x55646cbe4c50 2023-10-03T10:12:15.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.482+0000 7fb96c05bb80 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x55646cbe7450 con 0x55646cc01100 2023-10-03T10:12:15.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.482+0000 7fb95dc54700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cc258d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.482+0000 7fb95e455700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cc01100 0x55646cc063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.482+0000 7fb95dc54700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cc258d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58312/0 (socket says 172.21.15.72:58312) 2023-10-03T10:12:15.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.483+0000 7fb95e455700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cc01100 0x55646cc063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47414/0 (socket says 172.21.15.72:47414) 2023-10-03T10:12:15.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.483+0000 7fb95dc54700 1 -- 172.21.15.72:0/514105734 learned_addr learned my addr 172.21.15.72:0/514105734 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:15.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.483+0000 7fb95d453700 1 --2- 172.21.15.72:0/514105734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbfb8f0 0x55646cc05e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.483+0000 7fb95dc54700 1 -- 172.21.15.72:0/514105734 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cc01100 msgr2=0x55646cc063c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.483+0000 7fb95dc54700 1 --2- 172.21.15.72:0/514105734 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cc01100 0x55646cc063c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.483+0000 7fb95dc54700 1 -- 172.21.15.72:0/514105734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbfb8f0 msgr2=0x55646cc05e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.483+0000 7fb95dc54700 1 --2- 172.21.15.72:0/514105734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbfb8f0 0x55646cc05e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.483+0000 7fb95dc54700 1 -- 172.21.15.72:0/514105734 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55646ca1c0a0 con 0x55646cbe4c50 2023-10-03T10:12:15.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.483+0000 7fb95e455700 1 --2- 172.21.15.72:0/514105734 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cc01100 0x55646cc063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:15.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.483+0000 7fb95dc54700 1 --2- 172.21.15.72:0/514105734 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cc258d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb94800c700 tx=0x7fb948037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c67905b84cec2b42 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.483+0000 7fb93bfff700 1 -- 172.21.15.72:0/514105734 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948011360 con 0x55646cbe4c50 2023-10-03T10:12:15.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.483+0000 7fb93bfff700 1 -- 172.21.15.72:0/514105734 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94802a070 con 0x55646cbe4c50 2023-10-03T10:12:15.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.483+0000 7fb93bfff700 1 -- 172.21.15.72:0/514105734 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94803cfa0 con 0x55646cbe4c50 2023-10-03T10:12:15.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.484+0000 7fb96c05bb80 1 -- 172.21.15.72:0/514105734 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 msgr2=0x55646cc258d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.484+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/514105734 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cc258d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb94800c700 tx=0x7fb948037000 comp rx=0 tx=0).stop 2023-10-03T10:12:15.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.484+0000 7fb96c05bb80 1 -- 172.21.15.72:0/514105734 shutdown_connections 2023-10-03T10:12:15.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.484+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/514105734 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cc01100 0x55646cc063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.484+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/514105734 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cc258d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.484+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/514105734 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cbfb8f0 0x55646cc05e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.484+0000 7fb96c05bb80 1 -- 172.21.15.72:0/514105734 >> 172.21.15.72:0/514105734 conn(0x55646cbe90f0 msgr2=0x55646cbe7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.484+0000 7fb96c05bb80 1 -- 172.21.15.72:0/514105734 shutdown_connections 2023-10-03T10:12:15.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.484+0000 7fb96c05bb80 1 -- 172.21.15.72:0/514105734 wait complete. 2023-10-03T10:12:15.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.484+0000 7fb96c05bb80 1 -- start start 2023-10-03T10:12:15.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.484+0000 7fb96c05bb80 1 Processor -- start 2023-10-03T10:12:15.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb96c05bb80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cc015b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb96c05bb80 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cbfb8f0 0x55646cc01af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb96c05bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cc01100 0x55646cc02030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb96c05bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646cc02ab0 con 0x55646cc01100 2023-10-03T10:12:15.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb96c05bb80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55646cc19eb0 con 0x55646cbe4c50 2023-10-03T10:12:15.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb96c05bb80 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x55646cc18300 con 0x55646cbfb8f0 2023-10-03T10:12:15.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb96c05bb80 10 client.0 _ll_register_callbacks cb 0x7fb94800f260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:12:15.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb95d453700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cbfb8f0 0x55646cc01af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb95d453700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cbfb8f0 0x55646cc01af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47422/0 (socket says 172.21.15.72:47422) 2023-10-03T10:12:15.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb95d453700 1 -- 172.21.15.72:0/483894268 learned_addr learned my addr 172.21.15.72:0/483894268 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:15.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb95e455700 1 --2- 172.21.15.72:0/483894268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cc01100 0x55646cc02030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb95dc54700 1 --2- 172.21.15.72:0/483894268 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cc015b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb95d453700 1 -- 172.21.15.72:0/483894268 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 msgr2=0x55646cc015b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb95d453700 1 --2- 172.21.15.72:0/483894268 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cc015b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb95d453700 1 -- 172.21.15.72:0/483894268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cc01100 msgr2=0x55646cc02030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb95d453700 1 --2- 172.21.15.72:0/483894268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cc01100 0x55646cc02030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb95d453700 1 -- 172.21.15.72:0/483894268 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb950003c30 con 0x55646cbfb8f0 2023-10-03T10:12:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb95d453700 1 --2- 172.21.15.72:0/483894268 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cbfb8f0 0x55646cc01af0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb9540093d0 tx=0x7fb95400e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51ad32f3bd24f0e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.485+0000 7fb938ff9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3302/0 2023-10-03T10:12:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.486+0000 7fb938ff9700 1 -- 172.21.15.72:0/483894268 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954024050 con 0x55646cbfb8f0 2023-10-03T10:12:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.486+0000 7fb938ff9700 1 -- 172.21.15.72:0/483894268 <== mon.2 v2:172.21.15.72:3302/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fb954004450 con 0x55646cbfb8f0 2023-10-03T10:12:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.486+0000 7fb96c05bb80 1 -- 172.21.15.72:0/483894268 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb948019640 con 0x55646cbfb8f0 2023-10-03T10:12:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.486+0000 7fb938ff9700 1 -- 172.21.15.72:0/483894268 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb954028280 con 0x55646cbfb8f0 2023-10-03T10:12:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.486+0000 7fb96c05bb80 10 client.14363 fetch_fsmap learned FSMap version 7 2023-10-03T10:12:15.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.486+0000 7fb96c05bb80 1 -- 172.21.15.72:0/483894268 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,fsmap=7,monmap=3+}) v3 -- 0x7fb958123f90 con 0x55646cbfb8f0 2023-10-03T10:12:15.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.486+0000 7fb938ff9700 1 -- 172.21.15.72:0/483894268 <== mon.2 v2:172.21.15.72:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb948019640 con 0x55646cbfb8f0 2023-10-03T10:12:15.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.486+0000 7fb938ff9700 1 -- 172.21.15.72:0/483894268 <== mon.2 v2:172.21.15.72:3302/0 5 ==== fsmap(e 7) v1 ==== 1436+0+0 (secure 0 0 0) 0x7fb954031070 con 0x55646cbfb8f0 2023-10-03T10:12:15.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.486+0000 7fb96c05bb80 10 client.14363 fetch_fsmap finished waiting for FSMap version 7 2023-10-03T10:12:15.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.486+0000 7fb96c05bb80 10 client.14363 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:12:15.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.486+0000 7fb96c05bb80 20 client.14363 populate_metadata read hostname 'smithi072' 2023-10-03T10:12:15.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.486+0000 7fb96c05bb80 4 client.14363 mds_command: new command op to 4187 tid=0[{"prefix": "status"}] 2023-10-03T10:12:15.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.486+0000 7fb96c05bb80 1 -- 172.21.15.72:0/483894268 --> v1:172.21.15.72:6817/542674768 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55646cb34ce0 con 0x55646cc6ff60 2023-10-03T10:12:15.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.486+0000 7fb938ff9700 10 client.14363 ms_handle_connect on v1:172.21.15.72:6817/542674768 2023-10-03T10:12:15.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb938ff9700 1 -- 172.21.15.72:0/483894268 <== mds.0 v1:172.21.15.72:6817/542674768 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (unknown 0 0 3630262051) 0x55646cb34ce0 con 0x55646cc6ff60 2023-10-03T10:12:15.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb938ff9700 10 client.14363 handle_command_reply: tid=0 2023-10-03T10:12:15.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb96c05bb80 1 client.14363 shutdown 2023-10-03T10:12:15.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb96c05bb80 1 -- 172.21.15.72:0/483894268 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cbfb8f0 msgr2=0x55646cc01af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/483894268 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cbfb8f0 0x55646cc01af0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb9540093d0 tx=0x7fb95400e000 comp rx=0 tx=0).stop 2023-10-03T10:12:15.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb96c05bb80 1 -- 172.21.15.72:0/483894268 shutdown_connections 2023-10-03T10:12:15.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/483894268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55646cc01100 0x55646cc02030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/483894268 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55646cbe4c50 0x55646cc015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb96c05bb80 1 --2- 172.21.15.72:0/483894268 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x55646cbfb8f0 0x55646cc01af0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb938ff9700 0 client.14363 ms_handle_reset on v1:172.21.15.72:6817/542674768 2023-10-03T10:12:15.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb96c05bb80 1 -- 172.21.15.72:0/483894268 >> 172.21.15.72:0/483894268 conn(0x55646cbe90f0 msgr2=0x55646cc05e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb96c05bb80 1 -- 172.21.15.72:0/483894268 shutdown_connections 2023-10-03T10:12:15.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb96c05bb80 1 -- 172.21.15.72:0/483894268 wait complete. 2023-10-03T10:12:15.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb96c05bb80 20 client.14363 trim_cache size 0 max 16384 2023-10-03T10:12:15.495 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-03T10:12:15.495 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "33894c9a-ea73-4e47-9ce0-b9e281957c98", 2023-10-03T10:12:15.495 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-10-03T10:12:15.495 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4187, 2023-10-03T10:12:15.495 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-10-03T10:12:15.495 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-10-03T10:12:15.495 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-10-03T10:12:15.495 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 149.14114886499999, 2023-10-03T10:12:15.495 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 7, 2023-10-03T10:12:15.495 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 23, 2023-10-03T10:12:15.495 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 18, 2023-10-03T10:12:15.496 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 153.447847397 2023-10-03T10:12:15.496 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-03T10:12:15.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb95feb8700 1 -- 172.21.15.72:0/546013685 >> v1:172.21.15.72:6816/126756 conn(0x7fb93c02f510 legacy=0x7fb93c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb95feb8700 1 -- 172.21.15.72:0/546013685 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb95809d6f0 msgr2=0x7fb958120750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb95feb8700 1 --2- 172.21.15.72:0/546013685 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb95809d6f0 0x7fb958120750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb94800c730 tx=0x7fb94800ca40 comp rx=0 tx=0).stop 2023-10-03T10:12:15.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb95feb8700 1 -- 172.21.15.72:0/546013685 shutdown_connections 2023-10-03T10:12:15.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb95feb8700 1 --2- 172.21.15.72:0/546013685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb958139170 0x7fb9581211d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb95feb8700 1 --2- 172.21.15.72:0/546013685 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb95809d6f0 0x7fb958120750 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb95feb8700 1 --2- 172.21.15.72:0/546013685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95809e1d0 0x7fb958120c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb95feb8700 1 -- 172.21.15.72:0/546013685 >> 172.21.15.72:0/546013685 conn(0x7fb958066f50 msgr2=0x7fb95809b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb95feb8700 1 -- 172.21.15.72:0/546013685 shutdown_connections 2023-10-03T10:12:15.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.487+0000 7fb95feb8700 1 -- 172.21.15.72:0/546013685 wait complete. 2023-10-03T10:12:15.499 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-03T10:12:15.510 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-03T10:12:15.510 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:15.538 INFO:tasks.ceph.osd.0:Stopped 2023-10-03T10:12:15.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2023-10-03T10:12:15.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.700+0000 7f16c8d55700 1 Processor -- start 2023-10-03T10:12:15.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.700+0000 7f16c8d55700 1 -- start start 2023-10-03T10:12:15.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c8d55700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16c4134630 0x7f16c4136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c8d55700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f16c4136f50 0x7f16c4139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c8d55700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c409b4f0 con 0x7f16c4131810 2023-10-03T10:12:15.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c8d55700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c41313c0 con 0x7f16c4136f50 2023-10-03T10:12:15.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c8d55700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16c406e8c0 con 0x7f16c4134630 2023-10-03T10:12:15.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c1d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16c4134630 0x7f16c4136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f16c4136f50 0x7f16c4139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c1d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16c4134630 0x7f16c4136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47434/0 (socket says 172.21.15.72:47434) 2023-10-03T10:12:15.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f16c4131810 0x7f16c4131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48056/0 (socket says 172.21.15.72:48056) 2023-10-03T10:12:15.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f16c4136f50 0x7f16c4139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44334/0 (socket says 172.21.15.72:44334) 2023-10-03T10:12:15.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c1d9b700 1 -- 172.21.15.72:0/3816109170 learned_addr learned my addr 172.21.15.72:0/3816109170 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:15.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c2d9d700 1 -- 172.21.15.72:0/3816109170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16c4134630 msgr2=0x7f16c4136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:15.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c2d9d700 1 --2- 172.21.15.72:0/3816109170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16c4134630 0x7f16c4136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c2d9d700 1 -- 172.21.15.72:0/3816109170 >> v1:172.21.15.72:6789/0 conn(0x7f16c4131810 legacy=0x7f16c4131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c2d9d700 1 -- 172.21.15.72:0/3816109170 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c4071d20 con 0x7f16c4136f50 2023-10-03T10:12:15.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c159a700 1 -- 172.21.15.72:0/3816109170 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557990610 0 0) 0x7f16c409b4f0 con 0x7f16c4131810 2023-10-03T10:12:15.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c1d9b700 1 --2- 172.21.15.72:0/3816109170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16c4134630 0x7f16c4136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:15.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c2d9d700 1 --2- 172.21.15.72:0/3816109170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c4136f50 0x7f16c4139330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009d90 tx=0x7f16bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ad4bf21df688da server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c159a700 1 -- 172.21.15.72:0/3816109170 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc00e070 con 0x7f16c4136f50 2023-10-03T10:12:15.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c159a700 1 -- 172.21.15.72:0/3816109170 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc00bb20 con 0x7f16c4136f50 2023-10-03T10:12:15.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.701+0000 7f16c159a700 1 -- 172.21.15.72:0/3816109170 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc012430 con 0x7f16c4136f50 2023-10-03T10:12:15.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.702+0000 7f16c8d55700 1 -- 172.21.15.72:0/3816109170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c4136f50 msgr2=0x7f16c4139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.702+0000 7f16c8d55700 1 --2- 172.21.15.72:0/3816109170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c4136f50 0x7f16c4139330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009d90 tx=0x7f16bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:15.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.702+0000 7f16c8d55700 1 -- 172.21.15.72:0/3816109170 shutdown_connections 2023-10-03T10:12:15.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.702+0000 7f16c8d55700 1 --2- 172.21.15.72:0/3816109170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c4136f50 0x7f16c4139330 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.702+0000 7f16c8d55700 1 --2- 172.21.15.72:0/3816109170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16c4134630 0x7f16c4136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.702+0000 7f16c8d55700 1 -- 172.21.15.72:0/3816109170 >> 172.21.15.72:0/3816109170 conn(0x7f16c40a2aa0 msgr2=0x7f16c40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:15.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.702+0000 7f16c8d55700 1 -- 172.21.15.72:0/3816109170 shutdown_connections 2023-10-03T10:12:15.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.702+0000 7f16c8d55700 1 -- 172.21.15.72:0/3816109170 wait complete. 2023-10-03T10:12:15.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.703+0000 7f16c8d55700 1 Processor -- start 2023-10-03T10:12:15.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.703+0000 7f16c8d55700 1 -- start start 2023-10-03T10:12:15.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.703+0000 7f16c8d55700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c4131810 0x7f16c406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.703+0000 7f16c8d55700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16c4134630 0x7f16c406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.703+0000 7f16c8d55700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16c4136f50 0x7f16c4070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:15.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.703+0000 7f16c8d55700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c411e5d0 con 0x7f16c4131810 2023-10-03T10:12:15.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.703+0000 7f16c8d55700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40711b0 con 0x7f16c4136f50 2023-10-03T10:12:15.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.703+0000 7f16c8d55700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40a1e60 con 0x7f16c4134630 2023-10-03T10:12:15.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16c259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c4131810 0x7f16c406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16c1d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16c4134630 0x7f16c406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16c259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c4131810 0x7f16c406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44344/0 (socket says 172.21.15.72:44344) 2023-10-03T10:12:15.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16c259c700 1 -- 172.21.15.72:0/3425646587 learned_addr learned my addr 172.21.15.72:0/3425646587 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:15.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16c2d9d700 1 --2- 172.21.15.72:0/3425646587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16c4136f50 0x7f16c4070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:15.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16c259c700 1 -- 172.21.15.72:0/3425646587 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16c4134630 msgr2=0x7f16c406fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16c259c700 1 --2- 172.21.15.72:0/3425646587 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16c4134630 0x7f16c406fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16c259c700 1 -- 172.21.15.72:0/3425646587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16c4136f50 msgr2=0x7f16c4070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:15.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16c259c700 1 --2- 172.21.15.72:0/3425646587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16c4136f50 0x7f16c4070060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:15.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16c259c700 1 -- 172.21.15.72:0/3425646587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b4009550 con 0x7f16c4131810 2023-10-03T10:12:15.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16c1d9b700 1 --2- 172.21.15.72:0/3425646587 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16c4134630 0x7f16c406fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:15.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16c2d9d700 1 --2- 172.21.15.72:0/3425646587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16c4136f50 0x7f16c4070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:15.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16c259c700 1 --2- 172.21.15.72:0/3425646587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c4131810 0x7f16c406f5e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f16b800c520 tx=0x7f16b800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:15.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16b2ffd700 1 -- 172.21.15.72:0/3425646587 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8004c80 con 0x7f16c4131810 2023-10-03T10:12:15.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16b2ffd700 1 -- 172.21.15.72:0/3425646587 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b8004de0 con 0x7f16c4131810 2023-10-03T10:12:15.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16c8d55700 1 -- 172.21.15.72:0/3425646587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16bc009a70 con 0x7f16c4131810 2023-10-03T10:12:15.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16b2ffd700 1 -- 172.21.15.72:0/3425646587 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8007310 con 0x7f16c4131810 2023-10-03T10:12:15.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.704+0000 7f16c8d55700 1 -- 172.21.15.72:0/3425646587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c411f040 con 0x7f16c4131810 2023-10-03T10:12:15.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.705+0000 7f16b2ffd700 1 -- 172.21.15.72:0/3425646587 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f16b8007470 con 0x7f16c4131810 2023-10-03T10:12:15.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.705+0000 7f16b2ffd700 1 -- 172.21.15.72:0/3425646587 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f16b803f700 con 0x7f16c4131810 2023-10-03T10:12:15.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.705+0000 7f16c8d55700 1 -- 172.21.15.72:0/3425646587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c4074ea0 con 0x7f16c4131810 2023-10-03T10:12:15.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.710+0000 7f16b2ffd700 1 -- 172.21.15.72:0/3425646587 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16b80123b0 con 0x7f16c4131810 2023-10-03T10:12:15.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:15.906+0000 7f16c8d55700 1 -- 172.21.15.72:0/3425646587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7f16c406b9e0 con 0x7f16c4131810 2023-10-03T10:12:15.906 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-10-03T10:12:15.906+0000 7fed8b668700 -1 mon.a@0(leader).osd e23 definitely_dead 0 2023-10-03T10:12:16.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.490+0000 7f16b2ffd700 1 -- 172.21.15.72:0/3425646587 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v24) v1 ==== 89+0+0 (secure 0 0 0) 0x7f16b80102c0 con 0x7f16c4131810 2023-10-03T10:12:16.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.493+0000 7f16c8d55700 1 -- 172.21.15.72:0/3425646587 >> v1:172.21.15.72:6816/126756 conn(0x7f16a402f510 legacy=0x7f16a40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.493+0000 7f16c8d55700 1 -- 172.21.15.72:0/3425646587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c4131810 msgr2=0x7f16c406f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.493+0000 7f16c8d55700 1 --2- 172.21.15.72:0/3425646587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c4131810 0x7f16c406f5e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f16b800c520 tx=0x7f16b800c830 comp rx=0 tx=0).stop 2023-10-03T10:12:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.493+0000 7f16c8d55700 1 -- 172.21.15.72:0/3425646587 shutdown_connections 2023-10-03T10:12:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.493+0000 7f16c8d55700 1 --2- 172.21.15.72:0/3425646587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c4131810 0x7f16c406f5e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.493+0000 7f16c8d55700 1 --2- 172.21.15.72:0/3425646587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16c4136f50 0x7f16c4070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.493+0000 7f16c8d55700 1 --2- 172.21.15.72:0/3425646587 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16c4134630 0x7f16c406fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.493+0000 7f16c8d55700 1 -- 172.21.15.72:0/3425646587 >> 172.21.15.72:0/3425646587 conn(0x7f16c40a2aa0 msgr2=0x7f16c40a09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.494+0000 7f16c8d55700 1 -- 172.21.15.72:0/3425646587 shutdown_connections 2023-10-03T10:12:16.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.494+0000 7f16c8d55700 1 -- 172.21.15.72:0/3425646587 wait complete. 2023-10-03T10:12:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:marked down osd.0. 2023-10-03T10:12:16.510 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-03T10:12:16.510 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-03T10:12:16.512 INFO:tasks.ceph.osd.0:Started 2023-10-03T10:12:16.513 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-03T10:12:16.513 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:16.545 INFO:tasks.ceph.osd.1:Stopped 2023-10-03T10:12:16.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2023-10-03T10:12:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.706+0000 7f351263d700 1 Processor -- start 2023-10-03T10:12:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.706+0000 7f351263d700 1 -- start start 2023-10-03T10:12:16.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.706+0000 7f351263d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f350c130540 0x7f350c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.706+0000 7f351263d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f350c06fcf0 0x7f350c138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.706+0000 7f351263d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350c0716a0 con 0x7f350c130e50 2023-10-03T10:12:16.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.706+0000 7f351263d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350c09a390 con 0x7f350c130540 2023-10-03T10:12:16.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.706+0000 7f351263d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f350c071290 con 0x7f350c06fcf0 2023-10-03T10:12:16.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.707+0000 7f350bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f350c130540 0x7f350c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.707+0000 7f3510bda700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f350c06fcf0 0x7f350c138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.707+0000 7f350b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f350c130e50 0x7f350c06f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48076/0 (socket says 172.21.15.72:48076) 2023-10-03T10:12:16.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.707+0000 7f350b7fe700 1 -- 172.21.15.72:0/3188753876 learned_addr learned my addr 172.21.15.72:0/3188753876 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:16.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.707+0000 7f350bfff700 1 -- 172.21.15.72:0/3188753876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f350c06fcf0 msgr2=0x7f350c138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:16.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.707+0000 7f350bfff700 1 --2- 172.21.15.72:0/3188753876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f350c06fcf0 0x7f350c138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.707+0000 7f350bfff700 1 -- 172.21.15.72:0/3188753876 >> v1:172.21.15.72:6789/0 conn(0x7f350c130e50 legacy=0x7f350c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.707+0000 7f350bfff700 1 -- 172.21.15.72:0/3188753876 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c130340 con 0x7f350c130540 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.707+0000 7f350affd700 1 -- 172.21.15.72:0/3188753876 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843608239 0 0) 0x7f350c0716a0 con 0x7f350c130e50 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.707+0000 7f350bfff700 1 --2- 172.21.15.72:0/3188753876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f350c130540 0x7f350c130910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009840 tx=0x7f34fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66fbd17e20ffba4d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.707+0000 7f350affd700 1 -- 172.21.15.72:0/3188753876 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc011830 con 0x7f350c130540 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.707+0000 7f350affd700 1 -- 172.21.15.72:0/3188753876 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc011990 con 0x7f350c130540 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.707+0000 7f350affd700 1 -- 172.21.15.72:0/3188753876 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc011d20 con 0x7f350c130540 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.708+0000 7f351263d700 1 -- 172.21.15.72:0/3188753876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f350c130540 msgr2=0x7f350c130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.708+0000 7f351263d700 1 --2- 172.21.15.72:0/3188753876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f350c130540 0x7f350c130910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009840 tx=0x7f34fc009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.708+0000 7f351263d700 1 -- 172.21.15.72:0/3188753876 shutdown_connections 2023-10-03T10:12:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.708+0000 7f351263d700 1 --2- 172.21.15.72:0/3188753876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f350c06fcf0 0x7f350c138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.708+0000 7f351263d700 1 --2- 172.21.15.72:0/3188753876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f350c130540 0x7f350c130910 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.708+0000 7f351263d700 1 -- 172.21.15.72:0/3188753876 >> 172.21.15.72:0/3188753876 conn(0x7f350c0a2aa0 msgr2=0x7f350c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.708+0000 7f351263d700 1 -- 172.21.15.72:0/3188753876 shutdown_connections 2023-10-03T10:12:16.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.708+0000 7f351263d700 1 -- 172.21.15.72:0/3188753876 wait complete. 2023-10-03T10:12:16.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.709+0000 7f351263d700 1 Processor -- start 2023-10-03T10:12:16.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.709+0000 7f351263d700 1 -- start start 2023-10-03T10:12:16.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.709+0000 7f351263d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f350c06fcf0 0x7f350c118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.709+0000 7f351263d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f350c130540 0x7f350c119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.709+0000 7f351263d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f350c130e50 0x7f350c119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:16.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.709+0000 7f351263d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c11b810 con 0x7f350c06fcf0 2023-10-03T10:12:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.709+0000 7f351263d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c0718e0 con 0x7f350c130540 2023-10-03T10:12:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.709+0000 7f351263d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f350c09cbe0 con 0x7f350c130e50 2023-10-03T10:12:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.709+0000 7f350bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f350c06fcf0 0x7f350c118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.709+0000 7f350bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f350c06fcf0 0x7f350c118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44370/0 (socket says 172.21.15.72:44370) 2023-10-03T10:12:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.709+0000 7f350bfff700 1 -- 172.21.15.72:0/1735976751 learned_addr learned my addr 172.21.15.72:0/1735976751 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.709+0000 7f350b7fe700 1 --2- 172.21.15.72:0/1735976751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f350c130540 0x7f350c119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.709+0000 7f3510bda700 1 --2- 172.21.15.72:0/1735976751 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f350c130e50 0x7f350c119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.710+0000 7f350bfff700 1 -- 172.21.15.72:0/1735976751 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f350c130e50 msgr2=0x7f350c119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.710+0000 7f350bfff700 1 --2- 172.21.15.72:0/1735976751 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f350c130e50 0x7f350c119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.710+0000 7f350bfff700 1 -- 172.21.15.72:0/1735976751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f350c130540 msgr2=0x7f350c119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.710+0000 7f350bfff700 1 --2- 172.21.15.72:0/1735976751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f350c130540 0x7f350c119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:16.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.710+0000 7f350bfff700 1 -- 172.21.15.72:0/1735976751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc0094a0 con 0x7f350c06fcf0 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.710+0000 7f350b7fe700 1 --2- 172.21.15.72:0/1735976751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f350c130540 0x7f350c119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.710+0000 7f350bfff700 1 --2- 172.21.15.72:0/1735976751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f350c06fcf0 0x7f350c118cd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f34fc000c00 tx=0x7f34fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.710+0000 7f3508ff9700 1 -- 172.21.15.72:0/1735976751 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc01a9f0 con 0x7f350c06fcf0 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.710+0000 7f3508ff9700 1 -- 172.21.15.72:0/1735976751 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc01ab50 con 0x7f350c06fcf0 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.710+0000 7f351263d700 1 -- 172.21.15.72:0/1735976751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c11a170 con 0x7f350c06fcf0 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.710+0000 7f3508ff9700 1 -- 172.21.15.72:0/1735976751 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc0243f0 con 0x7f350c06fcf0 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.710+0000 7f351263d700 1 -- 172.21.15.72:0/1735976751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350c1b8b00 con 0x7f350c06fcf0 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.711+0000 7f3508ff9700 1 -- 172.21.15.72:0/1735976751 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f34fc024550 con 0x7f350c06fcf0 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.711+0000 7f3508ff9700 1 -- 172.21.15.72:0/1735976751 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f34fc040f30 con 0x7f350c06fcf0 2023-10-03T10:12:16.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.711+0000 7f351263d700 1 -- 172.21.15.72:0/1735976751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350c11bc20 con 0x7f350c06fcf0 2023-10-03T10:12:16.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.716+0000 7f3508ff9700 1 -- 172.21.15.72:0/1735976751 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34fc015020 con 0x7f350c06fcf0 2023-10-03T10:12:16.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:16.911+0000 7f351263d700 1 -- 172.21.15.72:0/1735976751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7f350c074ea0 con 0x7f350c06fcf0 2023-10-03T10:12:16.912 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-10-03T10:12:16.911+0000 7fed8b668700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2023-10-03T10:12:17.108 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-10-03T10:12:17.107+0000 7f5fbbcd5680 -1 Falling back to public interface 2023-10-03T10:12:17.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.491+0000 7f3508ff9700 1 -- 172.21.15.72:0/1735976751 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7f34fc0193b0 con 0x7f350c06fcf0 2023-10-03T10:12:17.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.493+0000 7f351263d700 1 -- 172.21.15.72:0/1735976751 >> v1:172.21.15.72:6816/126756 conn(0x7f34f802f510 legacy=0x7f34f80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.493+0000 7f351263d700 1 -- 172.21.15.72:0/1735976751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f350c06fcf0 msgr2=0x7f350c118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.493+0000 7f351263d700 1 --2- 172.21.15.72:0/1735976751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f350c06fcf0 0x7f350c118cd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f34fc000c00 tx=0x7f34fc004750 comp rx=0 tx=0).stop 2023-10-03T10:12:17.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.493+0000 7f351263d700 1 -- 172.21.15.72:0/1735976751 shutdown_connections 2023-10-03T10:12:17.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.493+0000 7f351263d700 1 --2- 172.21.15.72:0/1735976751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f350c06fcf0 0x7f350c118cd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.493+0000 7f351263d700 1 --2- 172.21.15.72:0/1735976751 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f350c130e50 0x7f350c119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.493+0000 7f351263d700 1 --2- 172.21.15.72:0/1735976751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f350c130540 0x7f350c119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.493+0000 7f351263d700 1 -- 172.21.15.72:0/1735976751 >> 172.21.15.72:0/1735976751 conn(0x7f350c0a2aa0 msgr2=0x7f350c12d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.494+0000 7f351263d700 1 -- 172.21.15.72:0/1735976751 shutdown_connections 2023-10-03T10:12:17.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.494+0000 7f351263d700 1 -- 172.21.15.72:0/1735976751 wait complete. 2023-10-03T10:12:17.495 INFO:teuthology.orchestra.run.smithi072.stderr:marked down osd.1. 2023-10-03T10:12:17.512 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-03T10:12:17.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-03T10:12:17.514 INFO:tasks.ceph.osd.1:Started 2023-10-03T10:12:17.514 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-03T10:12:17.515 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:17.542 INFO:tasks.ceph.osd.2:Stopped 2023-10-03T10:12:17.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2023-10-03T10:12:17.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.704+0000 7f9c2720c700 1 Processor -- start 2023-10-03T10:12:17.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.704+0000 7f9c2720c700 1 -- start start 2023-10-03T10:12:17.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.704+0000 7f9c2720c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c2009d6f0 0x7f9c2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.704+0000 7f9c2720c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c2009e000 0x7f9c201339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.704+0000 7f9c2720c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2009b120 con 0x7f9c2009e410 2023-10-03T10:12:17.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.704+0000 7f9c2720c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c2006b460 con 0x7f9c2009e000 2023-10-03T10:12:17.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.704+0000 7f9c2720c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2009a7e0 con 0x7f9c2009d6f0 2023-10-03T10:12:17.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.704+0000 7f9c24fa8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c2009d6f0 0x7f9c2009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.704+0000 7f9c1ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c2009e000 0x7f9c201339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.704+0000 7f9c257a9700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9c2009e410 0x7f9c20133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48078/0 (socket says 172.21.15.72:48078) 2023-10-03T10:12:17.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.704+0000 7f9c257a9700 1 -- 172.21.15.72:0/3794193128 learned_addr learned my addr 172.21.15.72:0/3794193128 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:17.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.705+0000 7f9c1ffff700 1 -- 172.21.15.72:0/3794193128 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c2009d6f0 msgr2=0x7f9c2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:17.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.705+0000 7f9c1ffff700 1 --2- 172.21.15.72:0/3794193128 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c2009d6f0 0x7f9c2009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.705+0000 7f9c1ffff700 1 -- 172.21.15.72:0/3794193128 >> v1:172.21.15.72:6789/0 conn(0x7f9c2009e410 legacy=0x7f9c20133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.705+0000 7f9c1f7fe700 1 -- 172.21.15.72:0/3794193128 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698753795 0 0) 0x7f9c2009b120 con 0x7f9c2009e410 2023-10-03T10:12:17.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.705+0000 7f9c1ffff700 1 -- 172.21.15.72:0/3794193128 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2009a500 con 0x7f9c2009e000 2023-10-03T10:12:17.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.705+0000 7f9c24fa8700 1 --2- 172.21.15.72:0/3794193128 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c2009d6f0 0x7f9c2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:17.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.705+0000 7f9c1ffff700 1 --2- 172.21.15.72:0/3794193128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c2009e000 0x7f9c201339f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c009840 tx=0x7f9c0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f1ea05b6b11f23 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.705+0000 7f9c1f7fe700 1 -- 172.21.15.72:0/3794193128 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c011830 con 0x7f9c2009e000 2023-10-03T10:12:17.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.705+0000 7f9c1f7fe700 1 -- 172.21.15.72:0/3794193128 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c011990 con 0x7f9c2009e000 2023-10-03T10:12:17.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.705+0000 7f9c1f7fe700 1 -- 172.21.15.72:0/3794193128 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c011d20 con 0x7f9c2009e000 2023-10-03T10:12:17.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.705+0000 7f9c2720c700 1 -- 172.21.15.72:0/3794193128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c2009e000 msgr2=0x7f9c201339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.705+0000 7f9c2720c700 1 --2- 172.21.15.72:0/3794193128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c2009e000 0x7f9c201339f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c009840 tx=0x7f9c0c009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:17.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.706+0000 7f9c2720c700 1 -- 172.21.15.72:0/3794193128 shutdown_connections 2023-10-03T10:12:17.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.706+0000 7f9c2720c700 1 --2- 172.21.15.72:0/3794193128 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c2009d6f0 0x7f9c2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.706+0000 7f9c2720c700 1 --2- 172.21.15.72:0/3794193128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c2009e000 0x7f9c201339f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.706+0000 7f9c2720c700 1 -- 172.21.15.72:0/3794193128 >> 172.21.15.72:0/3794193128 conn(0x7f9c20066f50 msgr2=0x7f9c2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:17.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.706+0000 7f9c2720c700 1 -- 172.21.15.72:0/3794193128 shutdown_connections 2023-10-03T10:12:17.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.706+0000 7f9c2720c700 1 -- 172.21.15.72:0/3794193128 wait complete. 2023-10-03T10:12:17.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.706+0000 7f9c2720c700 1 Processor -- start 2023-10-03T10:12:17.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.707+0000 7f9c2720c700 1 -- start start 2023-10-03T10:12:17.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.707+0000 7f9c2720c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c2009d6f0 0x7f9c201a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.707+0000 7f9c2720c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c2009e000 0x7f9c201a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.707+0000 7f9c2720c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c2009e410 0x7f9c201a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:17.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.707+0000 7f9c2720c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c201a9150 con 0x7f9c2009e000 2023-10-03T10:12:17.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.707+0000 7f9c2720c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2009c710 con 0x7f9c2009d6f0 2023-10-03T10:12:17.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.707+0000 7f9c2720c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c200a2e40 con 0x7f9c2009e410 2023-10-03T10:12:17.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.707+0000 7f9c24fa8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c2009d6f0 0x7f9c201a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.707+0000 7f9c24fa8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c2009d6f0 0x7f9c201a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58374/0 (socket says 172.21.15.72:58374) 2023-10-03T10:12:17.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.707+0000 7f9c257a9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c2009e410 0x7f9c201a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.707+0000 7f9c24fa8700 1 -- 172.21.15.72:0/2756136994 learned_addr learned my addr 172.21.15.72:0/2756136994 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:17.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.707+0000 7f9c1ffff700 1 --2- 172.21.15.72:0/2756136994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c2009e000 0x7f9c201a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:17.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.708+0000 7f9c24fa8700 1 -- 172.21.15.72:0/2756136994 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c2009e410 msgr2=0x7f9c201a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.708+0000 7f9c24fa8700 1 --2- 172.21.15.72:0/2756136994 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c2009e410 0x7f9c201a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.708+0000 7f9c24fa8700 1 -- 172.21.15.72:0/2756136994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c2009e000 msgr2=0x7f9c201a63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.708+0000 7f9c24fa8700 1 --2- 172.21.15.72:0/2756136994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c2009e000 0x7f9c201a63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.708+0000 7f9c24fa8700 1 -- 172.21.15.72:0/2756136994 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c140094a0 con 0x7f9c2009d6f0 2023-10-03T10:12:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.708+0000 7f9c257a9700 1 --2- 172.21.15.72:0/2756136994 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c2009e410 0x7f9c201a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.708+0000 7f9c1ffff700 1 --2- 172.21.15.72:0/2756136994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c2009e000 0x7f9c201a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.708+0000 7f9c24fa8700 1 --2- 172.21.15.72:0/2756136994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c2009d6f0 0x7f9c201a5ea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400ebe0 tx=0x7f9c1400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.708+0000 7f9c1d7fa700 1 -- 172.21.15.72:0/2756136994 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1400c850 con 0x7f9c2009d6f0 2023-10-03T10:12:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.708+0000 7f9c1d7fa700 1 -- 172.21.15.72:0/2756136994 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1400c9b0 con 0x7f9c2009d6f0 2023-10-03T10:12:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.708+0000 7f9c2720c700 1 -- 172.21.15.72:0/2756136994 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0c0094a0 con 0x7f9c2009d6f0 2023-10-03T10:12:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.708+0000 7f9c1d7fa700 1 -- 172.21.15.72:0/2756136994 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1400cd40 con 0x7f9c2009d6f0 2023-10-03T10:12:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.708+0000 7f9c2720c700 1 -- 172.21.15.72:0/2756136994 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c201a8d00 con 0x7f9c2009d6f0 2023-10-03T10:12:17.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.709+0000 7f9c1d7fa700 1 -- 172.21.15.72:0/2756136994 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9c14013470 con 0x7f9c2009d6f0 2023-10-03T10:12:17.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.709+0000 7f9c1d7fa700 1 -- 172.21.15.72:0/2756136994 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f9c1403fc20 con 0x7f9c2009d6f0 2023-10-03T10:12:17.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.709+0000 7f9c2720c700 1 -- 172.21.15.72:0/2756136994 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c20074ea0 con 0x7f9c2009d6f0 2023-10-03T10:12:17.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.714+0000 7f9c1d7fa700 1 -- 172.21.15.72:0/2756136994 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c14021080 con 0x7f9c2009d6f0 2023-10-03T10:12:17.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:17.911+0000 7f9c2720c700 1 -- 172.21.15.72:0/2756136994 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7f9c20072620 con 0x7f9c2009d6f0 2023-10-03T10:12:17.912 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-10-03T10:12:17.912+0000 7fed8b668700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2023-10-03T10:12:18.104 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-10-03T10:12:18.103+0000 7f31ceda3680 -1 Falling back to public interface 2023-10-03T10:12:18.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.494+0000 7f9c1d7fa700 1 -- 172.21.15.72:0/2756136994 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v26) v1 ==== 89+0+0 (secure 0 0 0) 0x7f9c14013720 con 0x7f9c2009d6f0 2023-10-03T10:12:18.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.498+0000 7f9c2720c700 1 -- 172.21.15.72:0/2756136994 >> v1:172.21.15.72:6816/126756 conn(0x7f9c0402f510 legacy=0x7f9c040319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.498+0000 7f9c2720c700 1 -- 172.21.15.72:0/2756136994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c2009d6f0 msgr2=0x7f9c201a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.498+0000 7f9c2720c700 1 --2- 172.21.15.72:0/2756136994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c2009d6f0 0x7f9c201a5ea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400ebe0 tx=0x7f9c1400eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.499+0000 7f9c2720c700 1 -- 172.21.15.72:0/2756136994 shutdown_connections 2023-10-03T10:12:18.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.499+0000 7f9c2720c700 1 --2- 172.21.15.72:0/2756136994 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c2009e410 0x7f9c201a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.499+0000 7f9c2720c700 1 --2- 172.21.15.72:0/2756136994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c2009d6f0 0x7f9c201a5ea0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.499+0000 7f9c2720c700 1 --2- 172.21.15.72:0/2756136994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c2009e000 0x7f9c201a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.499+0000 7f9c2720c700 1 -- 172.21.15.72:0/2756136994 >> 172.21.15.72:0/2756136994 conn(0x7f9c20066f50 msgr2=0x7f9c201bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:18.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.499+0000 7f9c2720c700 1 -- 172.21.15.72:0/2756136994 shutdown_connections 2023-10-03T10:12:18.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.499+0000 7f9c2720c700 1 -- 172.21.15.72:0/2756136994 wait complete. 2023-10-03T10:12:18.504 INFO:teuthology.orchestra.run.smithi072.stderr:marked down osd.2. 2023-10-03T10:12:18.514 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-03T10:12:18.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-03T10:12:18.517 INFO:tasks.ceph.osd.2:Started 2023-10-03T10:12:18.517 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-03T10:12:18.517 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:18.559 INFO:tasks.ceph.osd.3:Stopped 2023-10-03T10:12:18.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2023-10-03T10:12:18.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.681+0000 7f2e20263700 1 Processor -- start 2023-10-03T10:12:18.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e20263700 1 -- start start 2023-10-03T10:12:18.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e20263700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e181337f0 0x7f2e18138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e20263700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e18138dc0 0x7f2e1813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e20263700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1806b990 con 0x7f2e18133420 2023-10-03T10:12:18.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e20263700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1809b0e0 con 0x7f2e181337f0 2023-10-03T10:12:18.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e20263700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e18133c20 con 0x7f2e18138dc0 2023-10-03T10:12:18.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e1d7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e181337f0 0x7f2e18138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e1e800700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e18138dc0 0x7f2e1813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e1dfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2e18133420 0x7f2e18133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34142/0 (socket says 172.21.15.72:34142) 2023-10-03T10:12:18.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e1dfff700 1 -- 172.21.15.72:0/2899329553 learned_addr learned my addr 172.21.15.72:0/2899329553 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:18.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e1e800700 1 -- 172.21.15.72:0/2899329553 >> v2:172.21.15.72:3300/0 conn(0x7f2e181337f0 msgr2=0x7f2e18138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:18.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e1e800700 1 --2- 172.21.15.72:0/2899329553 >> v2:172.21.15.72:3300/0 conn(0x7f2e181337f0 0x7f2e18138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e1e800700 1 -- 172.21.15.72:0/2899329553 >> v1:172.21.15.72:6789/0 conn(0x7f2e18133420 legacy=0x7f2e18133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e1e800700 1 -- 172.21.15.72:0/2899329553 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e180a0590 con 0x7f2e18138dc0 2023-10-03T10:12:18.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e1cffd700 1 -- 172.21.15.72:0/2899329553 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427279540 0 0) 0x7f2e1806b990 con 0x7f2e18133420 2023-10-03T10:12:18.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.682+0000 7f2e1d7fe700 1 --2- 172.21.15.72:0/2899329553 >> v2:172.21.15.72:3300/0 conn(0x7f2e181337f0 0x7f2e18138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:18.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.683+0000 7f2e1e800700 1 --2- 172.21.15.72:0/2899329553 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e18138dc0 0x7f2e1813b1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009d90 tx=0x7f2e1000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1c0789bdf5d749d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:18.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.683+0000 7f2e1cffd700 1 -- 172.21.15.72:0/2899329553 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1000e070 con 0x7f2e18138dc0 2023-10-03T10:12:18.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.683+0000 7f2e1cffd700 1 -- 172.21.15.72:0/2899329553 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1000bb20 con 0x7f2e18138dc0 2023-10-03T10:12:18.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.683+0000 7f2e1cffd700 1 -- 172.21.15.72:0/2899329553 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e10012430 con 0x7f2e18138dc0 2023-10-03T10:12:18.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.683+0000 7f2e20263700 1 -- 172.21.15.72:0/2899329553 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e18138dc0 msgr2=0x7f2e1813b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.683+0000 7f2e20263700 1 --2- 172.21.15.72:0/2899329553 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e18138dc0 0x7f2e1813b1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009d90 tx=0x7f2e1000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:18.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.684+0000 7f2e20263700 1 -- 172.21.15.72:0/2899329553 shutdown_connections 2023-10-03T10:12:18.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.684+0000 7f2e20263700 1 --2- 172.21.15.72:0/2899329553 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e18138dc0 0x7f2e1813b1a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.684+0000 7f2e20263700 1 --2- 172.21.15.72:0/2899329553 >> v2:172.21.15.72:3300/0 conn(0x7f2e181337f0 0x7f2e18138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.684+0000 7f2e20263700 1 -- 172.21.15.72:0/2899329553 >> 172.21.15.72:0/2899329553 conn(0x7f2e180a4210 msgr2=0x7f2e180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:18.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.684+0000 7f2e20263700 1 -- 172.21.15.72:0/2899329553 shutdown_connections 2023-10-03T10:12:18.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.684+0000 7f2e20263700 1 -- 172.21.15.72:0/2899329553 wait complete. 2023-10-03T10:12:18.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.684+0000 7f2e20263700 1 Processor -- start 2023-10-03T10:12:18.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e20263700 1 -- start start 2023-10-03T10:12:18.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e20263700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e18133420 0x7f2e1812eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e20263700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e181337f0 0x7f2e1812f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e20263700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e18138dc0 0x7f2e1812f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:18.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e20263700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1809c660 con 0x7f2e18133420 2023-10-03T10:12:18.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e20263700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1809b9d0 con 0x7f2e18138dc0 2023-10-03T10:12:18.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e20263700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e18130820 con 0x7f2e181337f0 2023-10-03T10:12:18.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e1dfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e18133420 0x7f2e1812eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e1dfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e18133420 0x7f2e1812eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35756/0 (socket says 172.21.15.72:35756) 2023-10-03T10:12:18.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e1dfff700 1 -- 172.21.15.72:0/3147506986 learned_addr learned my addr 172.21.15.72:0/3147506986 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:18.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e1e800700 1 --2- 172.21.15.72:0/3147506986 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e18138dc0 0x7f2e1812f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e1d7fe700 1 --2- 172.21.15.72:0/3147506986 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e181337f0 0x7f2e1812f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:18.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e1dfff700 1 -- 172.21.15.72:0/3147506986 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e181337f0 msgr2=0x7f2e1812f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e1dfff700 1 --2- 172.21.15.72:0/3147506986 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e181337f0 0x7f2e1812f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e1dfff700 1 -- 172.21.15.72:0/3147506986 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e18138dc0 msgr2=0x7f2e1812f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:18.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e1dfff700 1 --2- 172.21.15.72:0/3147506986 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e18138dc0 0x7f2e1812f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:18.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e1dfff700 1 -- 172.21.15.72:0/3147506986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140094a0 con 0x7f2e18133420 2023-10-03T10:12:18.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.685+0000 7f2e1e800700 1 --2- 172.21.15.72:0/3147506986 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e18138dc0 0x7f2e1812f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:18.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.686+0000 7f2e1dfff700 1 --2- 172.21.15.72:0/3147506986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e18133420 0x7f2e1812eb80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c520 tx=0x7f2e0800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:18.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.686+0000 7f2e0e7fc700 1 -- 172.21.15.72:0/3147506986 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08004c80 con 0x7f2e18133420 2023-10-03T10:12:18.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.686+0000 7f2e0e7fc700 1 -- 172.21.15.72:0/3147506986 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e08004e00 con 0x7f2e18133420 2023-10-03T10:12:18.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.686+0000 7f2e20263700 1 -- 172.21.15.72:0/3147506986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e10009a70 con 0x7f2e18133420 2023-10-03T10:12:18.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.686+0000 7f2e0e7fc700 1 -- 172.21.15.72:0/3147506986 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08007310 con 0x7f2e18133420 2023-10-03T10:12:18.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.686+0000 7f2e20263700 1 -- 172.21.15.72:0/3147506986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1809c920 con 0x7f2e18133420 2023-10-03T10:12:18.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.686+0000 7f2e0e7fc700 1 -- 172.21.15.72:0/3147506986 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2e08007470 con 0x7f2e18133420 2023-10-03T10:12:18.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.687+0000 7f2e0e7fc700 1 -- 172.21.15.72:0/3147506986 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f2e0803f7c0 con 0x7f2e18133420 2023-10-03T10:12:18.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.687+0000 7f2e20263700 1 -- 172.21.15.72:0/3147506986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1809cb10 con 0x7f2e18133420 2023-10-03T10:12:18.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.691+0000 7f2e0e7fc700 1 -- 172.21.15.72:0/3147506986 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e080123b0 con 0x7f2e18133420 2023-10-03T10:12:18.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:18.890+0000 7f2e20263700 1 -- 172.21.15.72:0/3147506986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7f2e18074ea0 con 0x7f2e18133420 2023-10-03T10:12:18.891 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-10-03T10:12:18.890+0000 7fed8b668700 -1 mon.a@0(leader).osd e26 definitely_dead 0 2023-10-03T10:12:19.120 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-10-03T10:12:19.120+0000 7f73263e2680 -1 Falling back to public interface 2023-10-03T10:12:19.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.495+0000 7f2e0e7fc700 1 -- 172.21.15.72:0/3147506986 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v27) v1 ==== 89+0+0 (secure 0 0 0) 0x7f2e080102c0 con 0x7f2e18133420 2023-10-03T10:12:19.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.498+0000 7f2e20263700 1 -- 172.21.15.72:0/3147506986 >> v1:172.21.15.72:6816/126756 conn(0x7f2dfc02f510 legacy=0x7f2dfc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.498+0000 7f2e20263700 1 -- 172.21.15.72:0/3147506986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e18133420 msgr2=0x7f2e1812eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.498+0000 7f2e20263700 1 --2- 172.21.15.72:0/3147506986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e18133420 0x7f2e1812eb80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800c520 tx=0x7f2e0800c830 comp rx=0 tx=0).stop 2023-10-03T10:12:19.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.498+0000 7f2e20263700 1 -- 172.21.15.72:0/3147506986 shutdown_connections 2023-10-03T10:12:19.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.498+0000 7f2e20263700 1 --2- 172.21.15.72:0/3147506986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e18133420 0x7f2e1812eb80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.498+0000 7f2e20263700 1 --2- 172.21.15.72:0/3147506986 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e18138dc0 0x7f2e1812f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.498+0000 7f2e20263700 1 --2- 172.21.15.72:0/3147506986 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e181337f0 0x7f2e1812f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.498+0000 7f2e20263700 1 -- 172.21.15.72:0/3147506986 >> 172.21.15.72:0/3147506986 conn(0x7f2e180a4210 msgr2=0x7f2e1813aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.498+0000 7f2e20263700 1 -- 172.21.15.72:0/3147506986 shutdown_connections 2023-10-03T10:12:19.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.498+0000 7f2e20263700 1 -- 172.21.15.72:0/3147506986 wait complete. 2023-10-03T10:12:19.500 INFO:teuthology.orchestra.run.smithi072.stderr:marked down osd.3. 2023-10-03T10:12:19.513 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-03T10:12:19.513 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-03T10:12:19.515 INFO:tasks.ceph.osd.3:Started 2023-10-03T10:12:19.515 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:12:19.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:19.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.640+0000 7fe7a0b72700 1 Processor -- start 2023-10-03T10:12:19.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.640+0000 7fe7a0b72700 1 -- start start 2023-10-03T10:12:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe7a0b72700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe79c09d6f0 0x7fe79c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe7a0b72700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe79c09e440 0x7fe79c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe7a0b72700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c09b120 con 0x7fe79c09e000 2023-10-03T10:12:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe7a0b72700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c06b460 con 0x7fe79c09d6f0 2023-10-03T10:12:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe7a0b72700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c09a7e0 con 0x7fe79c09e440 2023-10-03T10:12:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe79ad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe79c09e440 0x7fe79c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe799d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe79c09e000 0x7fe79c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34156/0 (socket says 172.21.15.72:34156) 2023-10-03T10:12:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe79a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe79c09d6f0 0x7fe79c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe799d9b700 1 -- 172.21.15.72:0/3304388605 learned_addr learned my addr 172.21.15.72:0/3304388605 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe79959a700 1 -- 172.21.15.72:0/3304388605 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571085895 0 0) 0x7fe79c09b120 con 0x7fe79c09e000 2023-10-03T10:12:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe79959a700 1 -- 172.21.15.72:0/3304388605 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7880035b0 con 0x7fe79c09e000 2023-10-03T10:12:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe79ad9d700 1 -- 172.21.15.72:0/3304388605 >> v2:172.21.15.72:3300/0 conn(0x7fe79c09d6f0 msgr2=0x7fe79c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe79ad9d700 1 --2- 172.21.15.72:0/3304388605 >> v2:172.21.15.72:3300/0 conn(0x7fe79c09d6f0 0x7fe79c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe79ad9d700 1 -- 172.21.15.72:0/3304388605 >> v1:172.21.15.72:6789/0 conn(0x7fe79c09e000 legacy=0x7fe79c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe79ad9d700 1 -- 172.21.15.72:0/3304388605 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c09a500 con 0x7fe79c09e440 2023-10-03T10:12:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.641+0000 7fe79a59c700 1 --2- 172.21.15.72:0/3304388605 >> v2:172.21.15.72:3300/0 conn(0x7fe79c09d6f0 0x7fe79c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.642+0000 7fe79ad9d700 1 --2- 172.21.15.72:0/3304388605 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe79c09e440 0x7fe79c134100 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe794009dc0 tx=0x7fe79400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a168b2ffbbdf2f1c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.642+0000 7fe79959a700 1 -- 172.21.15.72:0/3304388605 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400e070 con 0x7fe79c09e440 2023-10-03T10:12:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.642+0000 7fe79959a700 1 -- 172.21.15.72:0/3304388605 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79400bae0 con 0x7fe79c09e440 2023-10-03T10:12:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.642+0000 7fe79959a700 1 -- 172.21.15.72:0/3304388605 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400be90 con 0x7fe79c09e440 2023-10-03T10:12:19.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.642+0000 7fe7a0b72700 1 -- 172.21.15.72:0/3304388605 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe79c09e440 msgr2=0x7fe79c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.642+0000 7fe7a0b72700 1 --2- 172.21.15.72:0/3304388605 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe79c09e440 0x7fe79c134100 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe794009dc0 tx=0x7fe79400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:19.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.642+0000 7fe7a0b72700 1 -- 172.21.15.72:0/3304388605 shutdown_connections 2023-10-03T10:12:19.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.642+0000 7fe7a0b72700 1 --2- 172.21.15.72:0/3304388605 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe79c09e440 0x7fe79c134100 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.642+0000 7fe7a0b72700 1 --2- 172.21.15.72:0/3304388605 >> v2:172.21.15.72:3300/0 conn(0x7fe79c09d6f0 0x7fe79c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.642+0000 7fe7a0b72700 1 -- 172.21.15.72:0/3304388605 >> 172.21.15.72:0/3304388605 conn(0x7fe79c066f50 msgr2=0x7fe79c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.642+0000 7fe7a0b72700 1 -- 172.21.15.72:0/3304388605 shutdown_connections 2023-10-03T10:12:19.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.642+0000 7fe7a0b72700 1 -- 172.21.15.72:0/3304388605 wait complete. 2023-10-03T10:12:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.643+0000 7fe7a0b72700 1 Processor -- start 2023-10-03T10:12:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.643+0000 7fe7a0b72700 1 -- start start 2023-10-03T10:12:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe7a0b72700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe79c09d6f0 0x7fe79c1a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe7a0b72700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe79c09e000 0x7fe79c1a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe7a0b72700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe79c09e440 0x7fe79c1c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe7a0b72700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c1a7f10 con 0x7fe79c09e440 2023-10-03T10:12:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe7a0b72700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c1b9290 con 0x7fe79c09d6f0 2023-10-03T10:12:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe7a0b72700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c1a4e30 con 0x7fe79c09e000 2023-10-03T10:12:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe799d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe79c09e000 0x7fe79c1a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe79a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe79c09d6f0 0x7fe79c1a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe799d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe79c09e000 0x7fe79c1a5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36300/0 (socket says 172.21.15.72:36300) 2023-10-03T10:12:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe799d9b700 1 -- 172.21.15.72:0/2634882647 learned_addr learned my addr 172.21.15.72:0/2634882647 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe79ad9d700 1 --2- 172.21.15.72:0/2634882647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe79c09e440 0x7fe79c1c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe79a59c700 1 -- 172.21.15.72:0/2634882647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe79c09e000 msgr2=0x7fe79c1a5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe79a59c700 1 --2- 172.21.15.72:0/2634882647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe79c09e000 0x7fe79c1a5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe79a59c700 1 -- 172.21.15.72:0/2634882647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe79c09e440 msgr2=0x7fe79c1c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe79a59c700 1 --2- 172.21.15.72:0/2634882647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe79c09e440 0x7fe79c1c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe79a59c700 1 -- 172.21.15.72:0/2634882647 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7840094a0 con 0x7fe79c09d6f0 2023-10-03T10:12:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe799d9b700 1 --2- 172.21.15.72:0/2634882647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe79c09e000 0x7fe79c1a5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.644+0000 7fe79a59c700 1 --2- 172.21.15.72:0/2634882647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe79c09d6f0 0x7fe79c1a5320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe78400e9b0 tx=0x7fe78400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.645+0000 7fe792ffd700 1 -- 172.21.15.72:0/2634882647 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78400ee50 con 0x7fe79c09d6f0 2023-10-03T10:12:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.645+0000 7fe792ffd700 1 -- 172.21.15.72:0/2634882647 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78400c850 con 0x7fe79c09d6f0 2023-10-03T10:12:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.645+0000 7fe7a0b72700 1 -- 172.21.15.72:0/2634882647 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe794009a70 con 0x7fe79c09d6f0 2023-10-03T10:12:19.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.645+0000 7fe792ffd700 1 -- 172.21.15.72:0/2634882647 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78400cc00 con 0x7fe79c09d6f0 2023-10-03T10:12:19.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.645+0000 7fe7a0b72700 1 -- 172.21.15.72:0/2634882647 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c1a81a0 con 0x7fe79c09d6f0 2023-10-03T10:12:19.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.645+0000 7fe7a0b72700 1 -- 172.21.15.72:0/2634882647 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79c074ea0 con 0x7fe79c09d6f0 2023-10-03T10:12:19.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.646+0000 7fe792ffd700 1 -- 172.21.15.72:0/2634882647 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe784026480 con 0x7fe79c09d6f0 2023-10-03T10:12:19.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.646+0000 7fe792ffd700 1 -- 172.21.15.72:0/2634882647 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fe7840403f0 con 0x7fe79c09d6f0 2023-10-03T10:12:19.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.650+0000 7fe792ffd700 1 -- 172.21.15.72:0/2634882647 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe784026730 con 0x7fe79c09d6f0 2023-10-03T10:12:19.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.842+0000 7fe7a0b72700 1 -- 172.21.15.72:0/2634882647 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe79c09f420 con 0x7fe79c09d6f0 2023-10-03T10:12:19.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.843+0000 7fe792ffd700 1 -- 172.21.15.72:0/2634882647 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+11900 (secure 0 0 0) 0x7fe784017030 con 0x7fe79c09d6f0 2023-10-03T10:12:19.844 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:19.844 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:12:19.493196+0000","last_up_change":"2023-10-03T10:12:19.493196+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":118755}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":118755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":118755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":118755}]},"public_addr":"172.21.15.72:6805/118755","cluster_addr":"172.21.15.72:6807/118755","heartbeat_back_addr":"172.21.15.72:6811/118755","heartbeat_front_addr":"172.21.15.72:6809/118755","state":["exists"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:19.493196+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":0}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":0}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6816/118184":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/3319279924":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/2966012812":"2023-10-04T10:12:06.073551+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:19.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.845+0000 7fe7a0b72700 1 -- 172.21.15.72:0/2634882647 >> v1:172.21.15.72:6816/126756 conn(0x7fe77c02f510 legacy=0x7fe77c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.845+0000 7fe7a0b72700 1 -- 172.21.15.72:0/2634882647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe79c09d6f0 msgr2=0x7fe79c1a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:19.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.845+0000 7fe7a0b72700 1 --2- 172.21.15.72:0/2634882647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe79c09d6f0 0x7fe79c1a5320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe78400e9b0 tx=0x7fe78400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.845+0000 7fe7a0b72700 1 -- 172.21.15.72:0/2634882647 shutdown_connections 2023-10-03T10:12:19.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.845+0000 7fe7a0b72700 1 --2- 172.21.15.72:0/2634882647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe79c09e440 0x7fe79c1c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.845+0000 7fe7a0b72700 1 --2- 172.21.15.72:0/2634882647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe79c09d6f0 0x7fe79c1a5320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.845+0000 7fe7a0b72700 1 --2- 172.21.15.72:0/2634882647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe79c09e000 0x7fe79c1a5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.845+0000 7fe7a0b72700 1 -- 172.21.15.72:0/2634882647 >> 172.21.15.72:0/2634882647 conn(0x7fe79c066f50 msgr2=0x7fe79c1bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.845+0000 7fe7a0b72700 1 -- 172.21.15.72:0/2634882647 shutdown_connections 2023-10-03T10:12:19.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:19.845+0000 7fe7a0b72700 1 -- 172.21.15.72:0/2634882647 wait complete. 2023-10-03T10:12:20.109 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-10-03T10:12:20.109+0000 7f69b549e680 -1 Falling back to public interface 2023-10-03T10:12:20.879 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-10-03T10:12:20.879+0000 7f5fbbcd5680 -1 osd.0 23 log_to_monitors true 2023-10-03T10:12:21.960 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-10-03T10:12:21.960+0000 7f31ceda3680 -1 osd.1 23 log_to_monitors true 2023-10-03T10:12:22.373 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-10-03T10:12:22.374+0000 7f5fa7c50700 -1 osd.0 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:12:22.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:22.963 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-10-03T10:12:22.963+0000 7f73263e2680 -1 osd.2 25 log_to_monitors true 2023-10-03T10:12:23.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.029+0000 7f85b42b0700 1 Processor -- start 2023-10-03T10:12:23.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.029+0000 7f85b42b0700 1 -- start start 2023-10-03T10:12:23.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.030+0000 7f85b42b0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85ac09d6f0 0x7f85ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.030+0000 7f85b42b0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85ac09e000 0x7f85ac130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.030+0000 7f85b42b0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ac09f130 con 0x7f85ac09e410 2023-10-03T10:12:23.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.030+0000 7f85b42b0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ac09f520 con 0x7f85ac09e000 2023-10-03T10:12:23.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.030+0000 7f85b42b0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac09e930 con 0x7f85ac09d6f0 2023-10-03T10:12:23.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.030+0000 7f85b284d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f85ac09e410 0x7f85ac130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34194/0 (socket says 172.21.15.72:34194) 2023-10-03T10:12:23.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.030+0000 7f85b284d700 1 -- 172.21.15.72:0/3360888894 learned_addr learned my addr 172.21.15.72:0/3360888894 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:23.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.030+0000 7f85b204c700 1 --2- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85ac09d6f0 0x7f85ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.030+0000 7f85b104a700 1 -- 172.21.15.72:0/3360888894 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641082697 0 0) 0x7f85ac09f130 con 0x7f85ac09e410 2023-10-03T10:12:23.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.030+0000 7f85b104a700 1 -- 172.21.15.72:0/3360888894 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85980035b0 con 0x7f85ac09e410 2023-10-03T10:12:23.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.030+0000 7f85b184b700 1 --2- 172.21.15.72:0/3360888894 >> v2:172.21.15.72:3300/0 conn(0x7f85ac09e000 0x7f85ac130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.030+0000 7f85b104a700 1 -- 172.21.15.72:0/3360888894 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1881288713 0 0) 0x7f85980035b0 con 0x7f85ac09e410 2023-10-03T10:12:23.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 -- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85ac09d6f0 msgr2=0x7f85ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:23.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 --2- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85ac09d6f0 0x7f85ac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 -- 172.21.15.72:0/3360888894 >> v2:172.21.15.72:3300/0 conn(0x7f85ac09e000 msgr2=0x7f85ac130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:23.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 --2- 172.21.15.72:0/3360888894 >> v2:172.21.15.72:3300/0 conn(0x7f85ac09e000 0x7f85ac130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 -- 172.21.15.72:0/3360888894 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac09b2d0 con 0x7f85ac09e410 2023-10-03T10:12:23.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 -- 172.21.15.72:0/3360888894 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 244944926 0 0) 0x7f85a40019f0 con 0x7f85ac09e410 2023-10-03T10:12:23.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 -- 172.21.15.72:0/3360888894 >> v1:172.21.15.72:6789/0 conn(0x7f85ac09e410 legacy=0x7f85ac130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 --2- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8598003a00 0x7f8598003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 --2- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85980043e0 0x7f85980048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 --2- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85ac09d6f0 0x7f859800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 -- 172.21.15.72:0/3360888894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac09e930 con 0x7f8598003a00 2023-10-03T10:12:23.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 -- 172.21.15.72:0/3360888894 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8598005230 con 0x7f85ac09d6f0 2023-10-03T10:12:23.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 -- 172.21.15.72:0/3360888894 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85980053f0 con 0x7f85980043e0 2023-10-03T10:12:23.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b284d700 1 --2- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85ac09d6f0 0x7f859800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b204c700 1 --2- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8598003a00 0x7f8598003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b284d700 1 -- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85980043e0 msgr2=0x7f85980048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b284d700 1 --2- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85980043e0 0x7f85980048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b284d700 1 -- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8598003a00 msgr2=0x7f8598003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b284d700 1 --2- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8598003a00 0x7f8598003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b284d700 1 -- 172.21.15.72:0/3360888894 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85980035b0 con 0x7f85ac09d6f0 2023-10-03T10:12:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b204c700 1 --2- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8598003a00 0x7f8598003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b284d700 1 --2- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85ac09d6f0 0x7f859800ba10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f85ac06dff0 tx=0x7f8598005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aff1ee7228f6049e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 -- 172.21.15.72:0/3360888894 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4012600 con 0x7f85ac09d6f0 2023-10-03T10:12:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 -- 172.21.15.72:0/3360888894 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a4012760 con 0x7f85ac09d6f0 2023-10-03T10:12:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.031+0000 7f85b104a700 1 -- 172.21.15.72:0/3360888894 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4012af0 con 0x7f85ac09d6f0 2023-10-03T10:12:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.032+0000 7f85b42b0700 1 -- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85ac09d6f0 msgr2=0x7f859800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.032+0000 7f85b42b0700 1 --2- 172.21.15.72:0/3360888894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85ac09d6f0 0x7f859800ba10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f85ac06dff0 tx=0x7f8598005880 comp rx=0 tx=0).stop 2023-10-03T10:12:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.032+0000 7f85b284d700 1 -- 172.21.15.72:0/3360888894 reap_dead start 2023-10-03T10:12:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.032+0000 7f85b42b0700 1 -- 172.21.15.72:0/3360888894 shutdown_connections 2023-10-03T10:12:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.032+0000 7f85b42b0700 1 -- 172.21.15.72:0/3360888894 >> 172.21.15.72:0/3360888894 conn(0x7f85ac066f50 msgr2=0x7f85ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.032+0000 7f85b42b0700 1 -- 172.21.15.72:0/3360888894 shutdown_connections 2023-10-03T10:12:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.032+0000 7f85b42b0700 1 -- 172.21.15.72:0/3360888894 wait complete. 2023-10-03T10:12:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.033+0000 7f85b42b0700 1 Processor -- start 2023-10-03T10:12:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.033+0000 7f85b42b0700 1 -- start start 2023-10-03T10:12:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b42b0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac09d6f0 0x7f85ac11de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b42b0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85ac1300a0 0x7f85ac11e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b204c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac09d6f0 0x7f85ac11de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b204c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac09d6f0 0x7f85ac11de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35818/0 (socket says 172.21.15.72:35818) 2023-10-03T10:12:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b42b0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85ac11e910 0x7f85ac1ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b42b0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac1216e0 con 0x7f85ac09d6f0 2023-10-03T10:12:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b42b0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac122280 con 0x7f85ac11e910 2023-10-03T10:12:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b42b0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac11fa00 con 0x7f85ac1300a0 2023-10-03T10:12:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b204c700 1 -- 172.21.15.72:0/2841854491 learned_addr learned my addr 172.21.15.72:0/2841854491 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b184b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85ac1300a0 0x7f85ac11e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b284d700 1 --2- 172.21.15.72:0/2841854491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85ac11e910 0x7f85ac1ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b204c700 1 -- 172.21.15.72:0/2841854491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85ac1300a0 msgr2=0x7f85ac11e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b204c700 1 --2- 172.21.15.72:0/2841854491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85ac1300a0 0x7f85ac11e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b204c700 1 -- 172.21.15.72:0/2841854491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85ac11e910 msgr2=0x7f85ac1ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b204c700 1 --2- 172.21.15.72:0/2841854491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85ac11e910 0x7f85ac1ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.034+0000 7f85b204c700 1 -- 172.21.15.72:0/2841854491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac09c700 con 0x7f85ac09d6f0 2023-10-03T10:12:23.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.035+0000 7f85b204c700 1 --2- 172.21.15.72:0/2841854491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac09d6f0 0x7f85ac11de90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f85a8010950 tx=0x7f85a8010c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:23.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.035+0000 7f85a2ffd700 1 -- 172.21.15.72:0/2841854491 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8004220 con 0x7f85ac09d6f0 2023-10-03T10:12:23.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.035+0000 7f85a2ffd700 1 -- 172.21.15.72:0/2841854491 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a8004380 con 0x7f85ac09d6f0 2023-10-03T10:12:23.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.035+0000 7f85b42b0700 1 -- 172.21.15.72:0/2841854491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac072040 con 0x7f85ac09d6f0 2023-10-03T10:12:23.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.035+0000 7f85a2ffd700 1 -- 172.21.15.72:0/2841854491 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a80036a0 con 0x7f85ac09d6f0 2023-10-03T10:12:23.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.035+0000 7f85b42b0700 1 -- 172.21.15.72:0/2841854491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac120150 con 0x7f85ac09d6f0 2023-10-03T10:12:23.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.036+0000 7f85a2ffd700 1 -- 172.21.15.72:0/2841854491 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f85a8003800 con 0x7f85ac09d6f0 2023-10-03T10:12:23.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.036+0000 7f85a2ffd700 1 -- 172.21.15.72:0/2841854491 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f85a803f9d0 con 0x7f85ac09d6f0 2023-10-03T10:12:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.036+0000 7f85b42b0700 1 -- 172.21.15.72:0/2841854491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ac074ea0 con 0x7f85ac09d6f0 2023-10-03T10:12:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.041+0000 7f85a2ffd700 1 -- 172.21.15.72:0/2841854491 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85a8023af0 con 0x7f85ac09d6f0 2023-10-03T10:12:23.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.291+0000 7f85b42b0700 1 -- 172.21.15.72:0/2841854491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85ac1219a0 con 0x7f85ac09d6f0 2023-10-03T10:12:23.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.292+0000 7f85a2ffd700 1 -- 172.21.15.72:0/2841854491 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12688 (secure 0 0 0) 0x7f85a8023710 con 0x7f85ac09d6f0 2023-10-03T10:12:23.291 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:23.291 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":29,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:12:22.504232+0000","last_up_change":"2023-10-03T10:12:22.504232+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.25,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 4 has some PGs where all OSDs are with primary_affinity 0 (at least pg 4.1), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":19,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":129472}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":129472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":129472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":129472}]},"public_addr":"172.21.15.72:6804/129472","cluster_addr":"172.21.15.72:6805/129472","heartbeat_back_addr":"172.21.15.72:6807/129472","heartbeat_front_addr":"172.21.15.72:6806/129472","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":118756}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":118756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":118756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":118756}]},"public_addr":"172.21.15.72:6804/118756","cluster_addr":"172.21.15.72:6806/118756","heartbeat_back_addr":"172.21.15.72:6810/118756","heartbeat_front_addr":"172.21.15.72:6808/118756","state":["exists"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":118746}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":118746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":118746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":118746}]},"public_addr":"172.21.15.72:6800/118746","cluster_addr":"172.21.15.72:6801/118746","heartbeat_back_addr":"172.21.15.72:6803/118746","heartbeat_front_addr":"172.21.15.72:6802/118746","state":["exists"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":118763}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":118763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":118763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":118763}]},"public_addr":"172.21.15.72:6812/118763","cluster_addr":"172.21.15.72:6813/118763","heartbeat_back_addr":"172.21.15.72:6815/118763","heartbeat_front_addr":"172.21.15.72:6814/118763","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:19.493196+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":0}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":0}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6816/118184":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/3319279924":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/2966012812":"2023-10-04T10:12:06.073551+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:23.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.294+0000 7f85b42b0700 1 -- 172.21.15.72:0/2841854491 >> v1:172.21.15.72:6816/126756 conn(0x7f859002f510 legacy=0x7f85900319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.294+0000 7f85b42b0700 1 -- 172.21.15.72:0/2841854491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac09d6f0 msgr2=0x7f85ac11de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:23.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.294+0000 7f85b42b0700 1 --2- 172.21.15.72:0/2841854491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac09d6f0 0x7f85ac11de90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f85a8010950 tx=0x7f85a8010c60 comp rx=0 tx=0).stop 2023-10-03T10:12:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.294+0000 7f85b42b0700 1 -- 172.21.15.72:0/2841854491 shutdown_connections 2023-10-03T10:12:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.294+0000 7f85b42b0700 1 --2- 172.21.15.72:0/2841854491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85ac09d6f0 0x7f85ac11de90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.294+0000 7f85b42b0700 1 --2- 172.21.15.72:0/2841854491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85ac11e910 0x7f85ac1ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.294+0000 7f85b42b0700 1 --2- 172.21.15.72:0/2841854491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85ac1300a0 0x7f85ac11e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.294+0000 7f85b42b0700 1 -- 172.21.15.72:0/2841854491 >> 172.21.15.72:0/2841854491 conn(0x7f85ac066f50 msgr2=0x7f85ac070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.294+0000 7f85b42b0700 1 -- 172.21.15.72:0/2841854491 shutdown_connections 2023-10-03T10:12:23.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:23.294+0000 7f85b42b0700 1 -- 172.21.15.72:0/2841854491 wait complete. 2023-10-03T10:12:23.424 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-10-03T10:12:23.425+0000 7f31bad1e700 -1 osd.1 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:12:23.967 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-10-03T10:12:23.967+0000 7f69b549e680 -1 osd.3 26 log_to_monitors true 2023-10-03T10:12:24.375 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-10-03T10:12:24.375+0000 7f731235d700 -1 osd.2 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:12:25.369 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-10-03T10:12:25.369+0000 7f69a1419700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:12:26.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:26.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.442+0000 7fe5b8aa2700 1 Processor -- start 2023-10-03T10:12:26.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.442+0000 7fe5b8aa2700 1 -- start start 2023-10-03T10:12:26.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b8aa2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe5b409d6f0 0x7fe5b409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b8aa2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b409e000 0x7fe5b4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b8aa2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b409f130 con 0x7fe5b409e410 2023-10-03T10:12:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b8aa2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b409f520 con 0x7fe5b409e000 2023-10-03T10:12:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b8aa2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b409e930 con 0x7fe5b409d6f0 2023-10-03T10:12:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b1d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b409e000 0x7fe5b4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe5b409d6f0 0x7fe5b409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b2d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe5b409e410 0x7fe5b4130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34206/0 (socket says 172.21.15.72:34206) 2023-10-03T10:12:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b2d9d700 1 -- 172.21.15.72:0/3136173314 learned_addr learned my addr 172.21.15.72:0/3136173314 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b159a700 1 -- 172.21.15.72:0/3136173314 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3220409279 0 0) 0x7fe5b409f130 con 0x7fe5b409e410 2023-10-03T10:12:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b159a700 1 -- 172.21.15.72:0/3136173314 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe59c0035b0 con 0x7fe5b409e410 2023-10-03T10:12:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b1d9b700 1 -- 172.21.15.72:0/3136173314 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe5b409d6f0 msgr2=0x7fe5b409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b1d9b700 1 --2- 172.21.15.72:0/3136173314 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe5b409d6f0 0x7fe5b409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b1d9b700 1 -- 172.21.15.72:0/3136173314 >> v1:172.21.15.72:6789/0 conn(0x7fe5b409e410 legacy=0x7fe5b4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b1d9b700 1 -- 172.21.15.72:0/3136173314 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b409b2d0 con 0x7fe5b409e000 2023-10-03T10:12:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.443+0000 7fe5b1d9b700 1 --2- 172.21.15.72:0/3136173314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b409e000 0x7fe5b4130660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009870 tx=0x7fe5a8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a7e2d0d7988b44b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.444+0000 7fe5b159a700 1 -- 172.21.15.72:0/3136173314 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8011830 con 0x7fe5b409e000 2023-10-03T10:12:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.444+0000 7fe5b159a700 1 -- 172.21.15.72:0/3136173314 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a8011990 con 0x7fe5b409e000 2023-10-03T10:12:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.444+0000 7fe5b159a700 1 -- 172.21.15.72:0/3136173314 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8011d20 con 0x7fe5b409e000 2023-10-03T10:12:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.444+0000 7fe5b8aa2700 1 -- 172.21.15.72:0/3136173314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b409e000 msgr2=0x7fe5b4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.444+0000 7fe5b8aa2700 1 --2- 172.21.15.72:0/3136173314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b409e000 0x7fe5b4130660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009870 tx=0x7fe5a8009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.444+0000 7fe5b8aa2700 1 -- 172.21.15.72:0/3136173314 shutdown_connections 2023-10-03T10:12:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.444+0000 7fe5b8aa2700 1 --2- 172.21.15.72:0/3136173314 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe5b409d6f0 0x7fe5b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.444+0000 7fe5b8aa2700 1 --2- 172.21.15.72:0/3136173314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b409e000 0x7fe5b4130660 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.444+0000 7fe5b8aa2700 1 -- 172.21.15.72:0/3136173314 >> 172.21.15.72:0/3136173314 conn(0x7fe5b4066f50 msgr2=0x7fe5b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.444+0000 7fe5b8aa2700 1 -- 172.21.15.72:0/3136173314 shutdown_connections 2023-10-03T10:12:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.444+0000 7fe5b8aa2700 1 -- 172.21.15.72:0/3136173314 wait complete. 2023-10-03T10:12:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.446+0000 7fe5b8aa2700 1 Processor -- start 2023-10-03T10:12:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.446+0000 7fe5b8aa2700 1 -- start start 2023-10-03T10:12:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.446+0000 7fe5b8aa2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b409d6f0 0x7fe5b411ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.446+0000 7fe5b8aa2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b409e000 0x7fe5b411f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.446+0000 7fe5b8aa2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe5b409e410 0x7fe5b411f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.446+0000 7fe5b8aa2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b4120a70 con 0x7fe5b409e000 2023-10-03T10:12:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.446+0000 7fe5b8aa2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b4122740 con 0x7fe5b409d6f0 2023-10-03T10:12:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.446+0000 7fe5b8aa2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b4121900 con 0x7fe5b409e410 2023-10-03T10:12:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.446+0000 7fe5b259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b409d6f0 0x7fe5b411ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.446+0000 7fe5b2d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe5b409e410 0x7fe5b411f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.446+0000 7fe5b1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b409e000 0x7fe5b411f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.446+0000 7fe5b259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b409d6f0 0x7fe5b411ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33764/0 (socket says 172.21.15.72:33764) 2023-10-03T10:12:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.446+0000 7fe5b259c700 1 -- 172.21.15.72:0/4022718912 learned_addr learned my addr 172.21.15.72:0/4022718912 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.447+0000 7fe5b2d9d700 1 -- 172.21.15.72:0/4022718912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b409d6f0 msgr2=0x7fe5b411ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.447+0000 7fe5b2d9d700 1 --2- 172.21.15.72:0/4022718912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b409d6f0 0x7fe5b411ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.447+0000 7fe5b2d9d700 1 -- 172.21.15.72:0/4022718912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b409e000 msgr2=0x7fe5b411f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.447+0000 7fe5b2d9d700 1 --2- 172.21.15.72:0/4022718912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b409e000 0x7fe5b411f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.447+0000 7fe5b2d9d700 1 -- 172.21.15.72:0/4022718912 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a80094a0 con 0x7fe5b409e410 2023-10-03T10:12:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.447+0000 7fe5b259c700 1 --2- 172.21.15.72:0/4022718912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b409d6f0 0x7fe5b411ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.447+0000 7fe5b2d9d700 1 --2- 172.21.15.72:0/4022718912 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe5b409e410 0x7fe5b411f8e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac00ca80 tx=0x7fe5ac00cd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:26.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.447+0000 7fe5a2ffd700 1 -- 172.21.15.72:0/4022718912 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac00a980 con 0x7fe5b409e410 2023-10-03T10:12:26.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.447+0000 7fe5a2ffd700 1 -- 172.21.15.72:0/4022718912 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac00aae0 con 0x7fe5b409e410 2023-10-03T10:12:26.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.447+0000 7fe5a2ffd700 1 -- 172.21.15.72:0/4022718912 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac00ae50 con 0x7fe5b409e410 2023-10-03T10:12:26.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.447+0000 7fe5b8aa2700 1 -- 172.21.15.72:0/4022718912 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b41223e0 con 0x7fe5b409e410 2023-10-03T10:12:26.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.447+0000 7fe5b8aa2700 1 -- 172.21.15.72:0/4022718912 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b409c700 con 0x7fe5b409e410 2023-10-03T10:12:26.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.448+0000 7fe5a2ffd700 1 -- 172.21.15.72:0/4022718912 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe5ac01b3b0 con 0x7fe5b409e410 2023-10-03T10:12:26.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.448+0000 7fe5b8aa2700 1 -- 172.21.15.72:0/4022718912 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b4121cc0 con 0x7fe5b409e410 2023-10-03T10:12:26.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.448+0000 7fe5a2ffd700 1 -- 172.21.15.72:0/4022718912 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fe5ac03f6e0 con 0x7fe5b409e410 2023-10-03T10:12:26.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.453+0000 7fe5a2ffd700 1 -- 172.21.15.72:0/4022718912 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5ac06f750 con 0x7fe5b409e410 2023-10-03T10:12:26.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.658+0000 7fe5b8aa2700 1 -- 172.21.15.72:0/4022718912 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5b411bc30 con 0x7fe5b409e410 2023-10-03T10:12:26.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.660+0000 7fe5a2ffd700 1 -- 172.21.15.72:0/4022718912 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+12902 (secure 0 0 0) 0x7fe5ac017030 con 0x7fe5b409e410 2023-10-03T10:12:26.659 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:26.660 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":33,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:12:26.539022+0000","last_up_change":"2023-10-03T10:12:25.534779+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":129472}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":129472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":129472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":129472}]},"public_addr":"172.21.15.72:6804/129472","cluster_addr":"172.21.15.72:6805/129472","heartbeat_back_addr":"172.21.15.72:6807/129472","heartbeat_front_addr":"172.21.15.72:6806/129472","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":129570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":129570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":129570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":129570}]},"public_addr":"172.21.15.72:6800/129570","cluster_addr":"172.21.15.72:6801/129570","heartbeat_back_addr":"172.21.15.72:6803/129570","heartbeat_front_addr":"172.21.15.72:6802/129570","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":129702}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":129702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":129702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":129702}]},"public_addr":"172.21.15.72:6808/129702","cluster_addr":"172.21.15.72:6809/129702","heartbeat_back_addr":"172.21.15.72:6811/129702","heartbeat_front_addr":"172.21.15.72:6810/129702","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":130020}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":130020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":130020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":130020}]},"public_addr":"172.21.15.72:6812/130020","cluster_addr":"172.21.15.72:6813/130020","heartbeat_back_addr":"172.21.15.72:6815/130020","heartbeat_front_addr":"172.21.15.72:6814/130020","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:19.493196+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":0}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":0}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6816/118184":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/3319279924":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/2966012812":"2023-10-04T10:12:06.073551+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:26.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.661+0000 7fe5b8aa2700 1 -- 172.21.15.72:0/4022718912 >> v1:172.21.15.72:6816/126756 conn(0x7fe59402f510 legacy=0x7fe5940319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.661+0000 7fe5b8aa2700 1 -- 172.21.15.72:0/4022718912 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe5b409e410 msgr2=0x7fe5b411f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:26.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.661+0000 7fe5b8aa2700 1 --2- 172.21.15.72:0/4022718912 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe5b409e410 0x7fe5b411f8e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac00ca80 tx=0x7fe5ac00cd90 comp rx=0 tx=0).stop 2023-10-03T10:12:26.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.662+0000 7fe5b8aa2700 1 -- 172.21.15.72:0/4022718912 shutdown_connections 2023-10-03T10:12:26.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.662+0000 7fe5b8aa2700 1 --2- 172.21.15.72:0/4022718912 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe5b409e410 0x7fe5b411f8e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.662+0000 7fe5b8aa2700 1 --2- 172.21.15.72:0/4022718912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe5b409d6f0 0x7fe5b411ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.662+0000 7fe5b8aa2700 1 --2- 172.21.15.72:0/4022718912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe5b409e000 0x7fe5b411f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:26.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.662+0000 7fe5b8aa2700 1 -- 172.21.15.72:0/4022718912 >> 172.21.15.72:0/4022718912 conn(0x7fe5b4066f50 msgr2=0x7fe5b41309b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:26.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.662+0000 7fe5b8aa2700 1 -- 172.21.15.72:0/4022718912 shutdown_connections 2023-10-03T10:12:26.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:26.662+0000 7fe5b8aa2700 1 -- 172.21.15.72:0/4022718912 wait complete. 2023-10-03T10:12:26.673 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:12:26.673 INFO:teuthology.run_tasks:Running task ceph.stop... 2023-10-03T10:12:26.684 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T10:12:26.684 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:12:26.694 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T10:12:27.462 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2023-10-03T10:12:27.463 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-03T10:12:27.473 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2023-10-03T10:12:27.473 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T10:12:27.473 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T10:12:27.476 INFO:tasks.ceph.mds.a:Started 2023-10-03T10:12:27.476 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:12:27.476 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:27.569 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-10-03T10:12:27.583 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-10-03T10:12:27.584+0000 7fed8b668700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-03T10:12:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.623+0000 7f9f8ffe4700 1 Processor -- start 2023-10-03T10:12:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.623+0000 7f9f8ffe4700 1 -- start start 2023-10-03T10:12:27.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.623+0000 7f9f8ffe4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f880a0a30 0x7f9f880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.623+0000 7f9f8ffe4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f88138d80 0x7f9f8813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8ffe4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f880a2a70 con 0x7f9f8809d630 2023-10-03T10:12:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8ffe4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f880a01d0 con 0x7f9f880a0a30 2023-10-03T10:12:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8ffe4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8809e2b0 con 0x7f9f88138d80 2023-10-03T10:12:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8e581700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f88138d80 0x7f9f8813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8dd80700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f880a0a30 0x7f9f880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8d57f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9f8809d630 0x7f9f880a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34226/0 (socket says 172.21.15.72:34226) 2023-10-03T10:12:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8d57f700 1 -- 172.21.15.72:0/2444972224 learned_addr learned my addr 172.21.15.72:0/2444972224 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8dd80700 1 -- 172.21.15.72:0/2444972224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f88138d80 msgr2=0x7f9f8813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8dd80700 1 --2- 172.21.15.72:0/2444972224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f88138d80 0x7f9f8813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8dd80700 1 -- 172.21.15.72:0/2444972224 >> v1:172.21.15.72:6789/0 conn(0x7f9f8809d630 legacy=0x7f9f880a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8cd7e700 1 -- 172.21.15.72:0/2444972224 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3550041346 0 0) 0x7f9f880a2a70 con 0x7f9f8809d630 2023-10-03T10:12:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8dd80700 1 -- 172.21.15.72:0/2444972224 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8809dc50 con 0x7f9f880a0a30 2023-10-03T10:12:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8e581700 1 --2- 172.21.15.72:0/2444972224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f88138d80 0x7f9f8813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8dd80700 1 --2- 172.21.15.72:0/2444972224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f880a0a30 0x7f9f880a0e00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009840 tx=0x7f9f78009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45d80c15becb093 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8cd7e700 1 -- 172.21.15.72:0/2444972224 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f78011830 con 0x7f9f880a0a30 2023-10-03T10:12:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8cd7e700 1 -- 172.21.15.72:0/2444972224 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f78011990 con 0x7f9f880a0a30 2023-10-03T10:12:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.624+0000 7f9f8cd7e700 1 -- 172.21.15.72:0/2444972224 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f78011d20 con 0x7f9f880a0a30 2023-10-03T10:12:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.625+0000 7f9f8ffe4700 1 -- 172.21.15.72:0/2444972224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f880a0a30 msgr2=0x7f9f880a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.625+0000 7f9f8ffe4700 1 --2- 172.21.15.72:0/2444972224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f880a0a30 0x7f9f880a0e00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009840 tx=0x7f9f78009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.625+0000 7f9f8ffe4700 1 -- 172.21.15.72:0/2444972224 shutdown_connections 2023-10-03T10:12:27.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.625+0000 7f9f8ffe4700 1 --2- 172.21.15.72:0/2444972224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f88138d80 0x7f9f8813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.625+0000 7f9f8ffe4700 1 --2- 172.21.15.72:0/2444972224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f880a0a30 0x7f9f880a0e00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.625+0000 7f9f8ffe4700 1 -- 172.21.15.72:0/2444972224 >> 172.21.15.72:0/2444972224 conn(0x7f9f880a3050 msgr2=0x7f9f880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:27.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.625+0000 7f9f8ffe4700 1 -- 172.21.15.72:0/2444972224 shutdown_connections 2023-10-03T10:12:27.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.625+0000 7f9f8ffe4700 1 -- 172.21.15.72:0/2444972224 wait complete. 2023-10-03T10:12:27.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.626+0000 7f9f8ffe4700 1 Processor -- start 2023-10-03T10:12:27.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.626+0000 7f9f8ffe4700 1 -- start start 2023-10-03T10:12:27.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.626+0000 7f9f8ffe4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f8809d630 0x7f9f88133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.626+0000 7f9f8ffe4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f880a0a30 0x7f9f88133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.626+0000 7f9f8ffe4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f88138d80 0x7f9f881341e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.626+0000 7f9f8ffe4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f88136fa0 con 0x7f9f880a0a30 2023-10-03T10:12:27.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.626+0000 7f9f8ffe4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f88136630 con 0x7f9f88138d80 2023-10-03T10:12:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.626+0000 7f9f8ffe4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880a4b50 con 0x7f9f8809d630 2023-10-03T10:12:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.626+0000 7f9f8d57f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f880a0a30 0x7f9f88133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.626+0000 7f9f8dd80700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f8809d630 0x7f9f88133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.626+0000 7f9f8d57f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f880a0a30 0x7f9f88133ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35840/0 (socket says 172.21.15.72:35840) 2023-10-03T10:12:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.626+0000 7f9f8d57f700 1 -- 172.21.15.72:0/3258535273 learned_addr learned my addr 172.21.15.72:0/3258535273 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.626+0000 7f9f8e581700 1 --2- 172.21.15.72:0/3258535273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f88138d80 0x7f9f881341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.627+0000 7f9f8d57f700 1 -- 172.21.15.72:0/3258535273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f8809d630 msgr2=0x7f9f88133760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.627+0000 7f9f8d57f700 1 --2- 172.21.15.72:0/3258535273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f8809d630 0x7f9f88133760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.627+0000 7f9f8d57f700 1 -- 172.21.15.72:0/3258535273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f88138d80 msgr2=0x7f9f881341e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.627+0000 7f9f8d57f700 1 --2- 172.21.15.72:0/3258535273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f88138d80 0x7f9f881341e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.627+0000 7f9f8d57f700 1 -- 172.21.15.72:0/3258535273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f80009a70 con 0x7f9f880a0a30 2023-10-03T10:12:27.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.627+0000 7f9f8e581700 1 --2- 172.21.15.72:0/3258535273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f88138d80 0x7f9f881341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.627+0000 7f9f8d57f700 1 --2- 172.21.15.72:0/3258535273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f880a0a30 0x7f9f88133ca0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400c520 tx=0x7f9f8400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.627+0000 7f9f7e7fc700 1 -- 172.21.15.72:0/3258535273 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84004c80 con 0x7f9f880a0a30 2023-10-03T10:12:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.627+0000 7f9f7e7fc700 1 -- 172.21.15.72:0/3258535273 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84004e00 con 0x7f9f880a0a30 2023-10-03T10:12:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.627+0000 7f9f8ffe4700 1 -- 172.21.15.72:0/3258535273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f780094a0 con 0x7f9f880a0a30 2023-10-03T10:12:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.627+0000 7f9f7e7fc700 1 -- 172.21.15.72:0/3258535273 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84007310 con 0x7f9f880a0a30 2023-10-03T10:12:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.627+0000 7f9f8ffe4700 1 -- 172.21.15.72:0/3258535273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f88137a10 con 0x7f9f880a0a30 2023-10-03T10:12:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.628+0000 7f9f7e7fc700 1 -- 172.21.15.72:0/3258535273 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9f84007470 con 0x7f9f880a0a30 2023-10-03T10:12:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.628+0000 7f9f8ffe4700 1 -- 172.21.15.72:0/3258535273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f88136c40 con 0x7f9f880a0a30 2023-10-03T10:12:27.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.628+0000 7f9f7e7fc700 1 -- 172.21.15.72:0/3258535273 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f9f8403f720 con 0x7f9f880a0a30 2023-10-03T10:12:27.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.632+0000 7f9f7e7fc700 1 -- 172.21.15.72:0/3258535273 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f840106d0 con 0x7f9f880a0a30 2023-10-03T10:12:27.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.817+0000 7f9f8ffe4700 1 -- 172.21.15.72:0/3258535273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f880747f0 con 0x7f9f880a0a30 2023-10-03T10:12:27.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.818+0000 7f9f7e7fc700 1 -- 172.21.15.72:0/3258535273 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+12966 (secure 0 0 0) 0x7f9f84011360 con 0x7f9f880a0a30 2023-10-03T10:12:27.817 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:27.817 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":34,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:12:27.583975+0000","last_up_change":"2023-10-03T10:12:25.534779+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":129472}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":129472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":129472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":129472}]},"public_addr":"172.21.15.72:6804/129472","cluster_addr":"172.21.15.72:6805/129472","heartbeat_back_addr":"172.21.15.72:6807/129472","heartbeat_front_addr":"172.21.15.72:6806/129472","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":129570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":129570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":129570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":129570}]},"public_addr":"172.21.15.72:6800/129570","cluster_addr":"172.21.15.72:6801/129570","heartbeat_back_addr":"172.21.15.72:6803/129570","heartbeat_front_addr":"172.21.15.72:6802/129570","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":129702}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":129702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":129702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":129702}]},"public_addr":"172.21.15.72:6808/129702","cluster_addr":"172.21.15.72:6809/129702","heartbeat_back_addr":"172.21.15.72:6811/129702","heartbeat_front_addr":"172.21.15.72:6810/129702","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":130020}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":130020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":130020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":130020}]},"public_addr":"172.21.15.72:6812/130020","cluster_addr":"172.21.15.72:6813/130020","heartbeat_back_addr":"172.21.15.72:6815/130020","heartbeat_front_addr":"172.21.15.72:6814/130020","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:19.493196+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":0}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":0}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6816/118184":"2023-10-04T10:12:06.073551+0000","172.21.15.72:6817/542674768":"2023-10-04T10:12:27.583946+0000","172.21.15.72:0/3319279924":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/2966012812":"2023-10-04T10:12:06.073551+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:27.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.820+0000 7f9f8ffe4700 1 -- 172.21.15.72:0/3258535273 >> v1:172.21.15.72:6816/126756 conn(0x7f9f6c02f540 legacy=0x7f9f6c0319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.820+0000 7f9f8ffe4700 1 -- 172.21.15.72:0/3258535273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f880a0a30 msgr2=0x7f9f88133ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.820+0000 7f9f8ffe4700 1 --2- 172.21.15.72:0/3258535273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f880a0a30 0x7f9f88133ca0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400c520 tx=0x7f9f8400c830 comp rx=0 tx=0).stop 2023-10-03T10:12:27.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.820+0000 7f9f8ffe4700 1 -- 172.21.15.72:0/3258535273 shutdown_connections 2023-10-03T10:12:27.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.820+0000 7f9f8ffe4700 1 --2- 172.21.15.72:0/3258535273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f88138d80 0x7f9f881341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.820+0000 7f9f8ffe4700 1 --2- 172.21.15.72:0/3258535273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f8809d630 0x7f9f88133760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.820+0000 7f9f8ffe4700 1 --2- 172.21.15.72:0/3258535273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f880a0a30 0x7f9f88133ca0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.820+0000 7f9f8ffe4700 1 -- 172.21.15.72:0/3258535273 >> 172.21.15.72:0/3258535273 conn(0x7f9f880a3050 msgr2=0x7f9f8813ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:27.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.820+0000 7f9f8ffe4700 1 -- 172.21.15.72:0/3258535273 shutdown_connections 2023-10-03T10:12:27.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.820+0000 7f9f8ffe4700 1 -- 172.21.15.72:0/3258535273 wait complete. 2023-10-03T10:12:27.832 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:12:27.832 INFO:teuthology.run_tasks:Running task exec... 2023-10-03T10:12:27.842 INFO:teuthology.task.exec:Executing custom commands... 2023-10-03T10:12:27.842 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi072.front.sepia.ceph.com 2023-10-03T10:12:27.842 DEBUG:teuthology.orchestra.run.smithi072:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2023-10-03T10:12:27.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.961+0000 7f81f2999700 1 Processor -- start 2023-10-03T10:12:27.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.961+0000 7f81f2999700 1 -- start start 2023-10-03T10:12:27.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81f2999700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81ec09e9d0 0x7f81ec09eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81f2999700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81ec09f2e0 0x7f81ec09f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81f2999700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81ec1317b0 0x7f81ec131c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81f2999700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ec09abd0 con 0x7f81ec1317b0 2023-10-03T10:12:27.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81f2999700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec06fd90 con 0x7f81ec09f2e0 2023-10-03T10:12:27.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81f2999700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec071e80 con 0x7f81ec09e9d0 2023-10-03T10:12:27.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81ebfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81ec09e9d0 0x7f81ec09eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81f0f36700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81ec1317b0 0x7f81ec131c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81eb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81ec09f2e0 0x7f81ec09f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81f0f36700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81ec1317b0 0x7f81ec131c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35842/0 (socket says 172.21.15.72:35842) 2023-10-03T10:12:27.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81ebfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81ec09e9d0 0x7f81ec09eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36356/0 (socket says 172.21.15.72:36356) 2023-10-03T10:12:27.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81eb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81ec09f2e0 0x7f81ec09f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33802/0 (socket says 172.21.15.72:33802) 2023-10-03T10:12:27.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81f0f36700 1 -- 172.21.15.72:0/3176719183 learned_addr learned my addr 172.21.15.72:0/3176719183 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:27.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81f0f36700 1 -- 172.21.15.72:0/3176719183 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81ec09e9d0 msgr2=0x7f81ec09eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:27.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81f0f36700 1 --2- 172.21.15.72:0/3176719183 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81ec09e9d0 0x7f81ec09eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81f0f36700 1 -- 172.21.15.72:0/3176719183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81ec09f2e0 msgr2=0x7f81ec09f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:27.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81f0f36700 1 --2- 172.21.15.72:0/3176719183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81ec09f2e0 0x7f81ec09f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81f0f36700 1 -- 172.21.15.72:0/3176719183 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec0a0240 con 0x7f81ec1317b0 2023-10-03T10:12:27.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81eb7fe700 1 --2- 172.21.15.72:0/3176719183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81ec09f2e0 0x7f81ec09f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:27.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81ebfff700 1 --2- 172.21.15.72:0/3176719183 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81ec09e9d0 0x7f81ec09eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:27.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81f0f36700 1 --2- 172.21.15.72:0/3176719183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ec1317b0 0x7f81ec131c20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009e50 tx=0x7f81e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ddcc9369ce5a2e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:27.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81eaffd700 1 -- 172.21.15.72:0/3176719183 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e400e070 con 0x7f81ec1317b0 2023-10-03T10:12:27.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81eaffd700 1 -- 172.21.15.72:0/3176719183 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e400b910 con 0x7f81ec1317b0 2023-10-03T10:12:27.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.962+0000 7f81eaffd700 1 -- 172.21.15.72:0/3176719183 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e400bcc0 con 0x7f81ec1317b0 2023-10-03T10:12:27.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.963+0000 7f81f2999700 1 -- 172.21.15.72:0/3176719183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ec1317b0 msgr2=0x7f81ec131c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.963+0000 7f81f2999700 1 --2- 172.21.15.72:0/3176719183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ec1317b0 0x7f81ec131c20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009e50 tx=0x7f81e400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:27.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.963+0000 7f81f2999700 1 -- 172.21.15.72:0/3176719183 shutdown_connections 2023-10-03T10:12:27.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.963+0000 7f81f2999700 1 --2- 172.21.15.72:0/3176719183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ec1317b0 0x7f81ec131c20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.963+0000 7f81f2999700 1 --2- 172.21.15.72:0/3176719183 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81ec09e9d0 0x7f81ec09eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.963+0000 7f81f2999700 1 --2- 172.21.15.72:0/3176719183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81ec09f2e0 0x7f81ec09f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.963+0000 7f81f2999700 1 -- 172.21.15.72:0/3176719183 >> 172.21.15.72:0/3176719183 conn(0x7f81ec0a43c0 msgr2=0x7f81ec0a47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:27.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.963+0000 7f81f2999700 1 -- 172.21.15.72:0/3176719183 shutdown_connections 2023-10-03T10:12:27.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.963+0000 7f81f2999700 1 -- 172.21.15.72:0/3176719183 wait complete. 2023-10-03T10:12:27.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.964+0000 7f81f2999700 1 Processor -- start 2023-10-03T10:12:27.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.964+0000 7f81f2999700 1 -- start start 2023-10-03T10:12:27.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81f2999700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81ec09e9d0 0x7f81ec06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81f2999700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ec09f2e0 0x7f81ec06cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81f2999700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81ec1317b0 0x7f81ec06d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:27.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81f2999700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec121be0 con 0x7f81ec09f2e0 2023-10-03T10:12:27.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81f2999700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec120b80 con 0x7f81ec1317b0 2023-10-03T10:12:27.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81f2999700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec121370 con 0x7f81ec09e9d0 2023-10-03T10:12:27.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81eb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ec09f2e0 0x7f81ec06cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81ebfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81ec09e9d0 0x7f81ec06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81f0f36700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81ec1317b0 0x7f81ec06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:27.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81eb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ec09f2e0 0x7f81ec06cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35844/0 (socket says 172.21.15.72:35844) 2023-10-03T10:12:27.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81eb7fe700 1 -- 172.21.15.72:0/987365505 learned_addr learned my addr 172.21.15.72:0/987365505 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:27.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81f0f36700 1 -- 172.21.15.72:0/987365505 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81ec09e9d0 msgr2=0x7f81ec06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81f0f36700 1 --2- 172.21.15.72:0/987365505 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81ec09e9d0 0x7f81ec06c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81f0f36700 1 -- 172.21.15.72:0/987365505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ec09f2e0 msgr2=0x7f81ec06cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:27.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81f0f36700 1 --2- 172.21.15.72:0/987365505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ec09f2e0 0x7f81ec06cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:27.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81f0f36700 1 -- 172.21.15.72:0/987365505 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e00094a0 con 0x7f81ec1317b0 2023-10-03T10:12:27.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81eb7fe700 1 --2- 172.21.15.72:0/987365505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ec09f2e0 0x7f81ec06cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:27.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81ebfff700 1 --2- 172.21.15.72:0/987365505 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81ec09e9d0 0x7f81ec06c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:27.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81f0f36700 1 --2- 172.21.15.72:0/987365505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81ec1317b0 0x7f81ec06d420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f81e4015000 tx=0x7f81e4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:27.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81e8ff9700 1 -- 172.21.15.72:0/987365505 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4004450 con 0x7f81ec1317b0 2023-10-03T10:12:27.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81e8ff9700 1 -- 172.21.15.72:0/987365505 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e40045f0 con 0x7f81ec1317b0 2023-10-03T10:12:27.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81f2999700 1 -- 172.21.15.72:0/987365505 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81dc0094a0 con 0x7f81ec1317b0 2023-10-03T10:12:27.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81e8ff9700 1 -- 172.21.15.72:0/987365505 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e40099b0 con 0x7f81ec1317b0 2023-10-03T10:12:27.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.965+0000 7f81f2999700 1 -- 172.21.15.72:0/987365505 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e4009b30 con 0x7f81ec1317b0 2023-10-03T10:12:27.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.966+0000 7f81e8ff9700 1 -- 172.21.15.72:0/987365505 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f81e401c410 con 0x7f81ec1317b0 2023-10-03T10:12:27.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.966+0000 7f81e8ff9700 1 -- 172.21.15.72:0/987365505 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f81e4041830 con 0x7f81ec1317b0 2023-10-03T10:12:27.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.966+0000 7f81f2999700 1 -- 172.21.15.72:0/987365505 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ec06f1f0 con 0x7f81ec1317b0 2023-10-03T10:12:27.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:27.971+0000 7f81e8ff9700 1 -- 172.21.15.72:0/987365505 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81e400ce80 con 0x7f81ec1317b0 2023-10-03T10:12:28.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.155+0000 7f81f2999700 1 -- 172.21.15.72:0/987365505 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f81ec09cb70 con 0x7f81ec1317b0 2023-10-03T10:12:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.156+0000 7f81e8ff9700 1 -- 172.21.15.72:0/987365505 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v34) v1 ==== 81+0+24156 (secure 0 0 0) 0x7f81e4011390 con 0x7f81ec1317b0 2023-10-03T10:12:28.156 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:28.156 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-03T10:12:28.156 INFO:teuthology.orchestra.run.smithi072.stdout: "epoch": 34, 2023-10-03T10:12:28.156 INFO:teuthology.orchestra.run.smithi072.stdout: "fsid": "33894c9a-ea73-4e47-9ce0-b9e281957c98", 2023-10-03T10:12:28.156 INFO:teuthology.orchestra.run.smithi072.stdout: "created": "2023-10-03T10:09:30.970008+0000", 2023-10-03T10:12:28.156 INFO:teuthology.orchestra.run.smithi072.stdout: "modified": "2023-10-03T10:12:27.583975+0000", 2023-10-03T10:12:28.156 INFO:teuthology.orchestra.run.smithi072.stdout: "last_up_change": "2023-10-03T10:12:25.534779+0000", 2023-10-03T10:12:28.157 INFO:teuthology.orchestra.run.smithi072.stdout: "last_in_change": "2023-10-03T10:09:32.210536+0000", 2023-10-03T10:12:28.157 INFO:teuthology.orchestra.run.smithi072.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-03T10:12:28.157 INFO:teuthology.orchestra.run.smithi072.stdout: "flags_num": 5799936, 2023-10-03T10:12:28.157 INFO:teuthology.orchestra.run.smithi072.stdout: "flags_set": [ 2023-10-03T10:12:28.157 INFO:teuthology.orchestra.run.smithi072.stdout: "pglog_hardlimit", 2023-10-03T10:12:28.157 INFO:teuthology.orchestra.run.smithi072.stdout: "purged_snapdirs", 2023-10-03T10:12:28.157 INFO:teuthology.orchestra.run.smithi072.stdout: "recovery_deletes", 2023-10-03T10:12:28.157 INFO:teuthology.orchestra.run.smithi072.stdout: "sortbitwise" 2023-10-03T10:12:28.157 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-10-03T10:12:28.157 INFO:teuthology.orchestra.run.smithi072.stdout: "crush_version": 8, 2023-10-03T10:12:28.157 INFO:teuthology.orchestra.run.smithi072.stdout: "full_ratio": 0.94999998807907104, 2023-10-03T10:12:28.158 INFO:teuthology.orchestra.run.smithi072.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-10-03T10:12:28.158 INFO:teuthology.orchestra.run.smithi072.stdout: "nearfull_ratio": 0.85000002384185791, 2023-10-03T10:12:28.158 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_snapshot": "", 2023-10-03T10:12:28.158 INFO:teuthology.orchestra.run.smithi072.stdout: "pool_max": 4, 2023-10-03T10:12:28.158 INFO:teuthology.orchestra.run.smithi072.stdout: "max_osd": 4, 2023-10-03T10:12:28.158 INFO:teuthology.orchestra.run.smithi072.stdout: "require_min_compat_client": "pacific", 2023-10-03T10:12:28.158 INFO:teuthology.orchestra.run.smithi072.stdout: "min_compat_client": "luminous", 2023-10-03T10:12:28.158 INFO:teuthology.orchestra.run.smithi072.stdout: "require_osd_release": "pacific", 2023-10-03T10:12:28.158 INFO:teuthology.orchestra.run.smithi072.stdout: "allow_crimson": false, 2023-10-03T10:12:28.158 INFO:teuthology.orchestra.run.smithi072.stdout: "pools": [ 2023-10-03T10:12:28.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.159 INFO:teuthology.orchestra.run.smithi072.stdout: "pool": 1, 2023-10-03T10:12:28.159 INFO:teuthology.orchestra.run.smithi072.stdout: "pool_name": ".mgr", 2023-10-03T10:12:28.159 INFO:teuthology.orchestra.run.smithi072.stdout: "create_time": "2023-10-03T10:09:38.963446+0000", 2023-10-03T10:12:28.159 INFO:teuthology.orchestra.run.smithi072.stdout: "flags": 1, 2023-10-03T10:12:28.159 INFO:teuthology.orchestra.run.smithi072.stdout: "flags_names": "hashpspool", 2023-10-03T10:12:28.159 INFO:teuthology.orchestra.run.smithi072.stdout: "type": 1, 2023-10-03T10:12:28.159 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 2, 2023-10-03T10:12:28.159 INFO:teuthology.orchestra.run.smithi072.stdout: "min_size": 1, 2023-10-03T10:12:28.159 INFO:teuthology.orchestra.run.smithi072.stdout: "crush_rule": 0, 2023-10-03T10:12:28.159 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:12:28.159 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:12:28.159 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:12:28.160 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:12:28.160 INFO:teuthology.orchestra.run.smithi072.stdout: "object_hash": 2, 2023-10-03T10:12:28.160 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:12:28.160 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num": 1, 2023-10-03T10:12:28.160 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_placement_num": 1, 2023-10-03T10:12:28.160 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_placement_num_target": 1, 2023-10-03T10:12:28.160 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num_target": 1, 2023-10-03T10:12:28.160 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num_pending": 1, 2023-10-03T10:12:28.160 INFO:teuthology.orchestra.run.smithi072.stdout: "last_pg_merge_meta": { 2023-10-03T10:12:28.160 INFO:teuthology.orchestra.run.smithi072.stdout: "source_pgid": "0.0", 2023-10-03T10:12:28.160 INFO:teuthology.orchestra.run.smithi072.stdout: "ready_epoch": 0, 2023-10-03T10:12:28.160 INFO:teuthology.orchestra.run.smithi072.stdout: "last_epoch_started": 0, 2023-10-03T10:12:28.160 INFO:teuthology.orchestra.run.smithi072.stdout: "last_epoch_clean": 0, 2023-10-03T10:12:28.161 INFO:teuthology.orchestra.run.smithi072.stdout: "source_version": "0'0", 2023-10-03T10:12:28.161 INFO:teuthology.orchestra.run.smithi072.stdout: "target_version": "0'0" 2023-10-03T10:12:28.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.161 INFO:teuthology.orchestra.run.smithi072.stdout: "last_change": "23", 2023-10-03T10:12:28.161 INFO:teuthology.orchestra.run.smithi072.stdout: "last_force_op_resend": "0", 2023-10-03T10:12:28.161 INFO:teuthology.orchestra.run.smithi072.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:12:28.161 INFO:teuthology.orchestra.run.smithi072.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:12:28.161 INFO:teuthology.orchestra.run.smithi072.stdout: "auid": 0, 2023-10-03T10:12:28.161 INFO:teuthology.orchestra.run.smithi072.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:12:28.161 INFO:teuthology.orchestra.run.smithi072.stdout: "snap_seq": 0, 2023-10-03T10:12:28.161 INFO:teuthology.orchestra.run.smithi072.stdout: "snap_epoch": 0, 2023-10-03T10:12:28.161 INFO:teuthology.orchestra.run.smithi072.stdout: "pool_snaps": [], 2023-10-03T10:12:28.162 INFO:teuthology.orchestra.run.smithi072.stdout: "removed_snaps": "[]", 2023-10-03T10:12:28.162 INFO:teuthology.orchestra.run.smithi072.stdout: "quota_max_bytes": 0, 2023-10-03T10:12:28.162 INFO:teuthology.orchestra.run.smithi072.stdout: "quota_max_objects": 0, 2023-10-03T10:12:28.162 INFO:teuthology.orchestra.run.smithi072.stdout: "tiers": [], 2023-10-03T10:12:28.162 INFO:teuthology.orchestra.run.smithi072.stdout: "tier_of": -1, 2023-10-03T10:12:28.162 INFO:teuthology.orchestra.run.smithi072.stdout: "read_tier": -1, 2023-10-03T10:12:28.162 INFO:teuthology.orchestra.run.smithi072.stdout: "write_tier": -1, 2023-10-03T10:12:28.162 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_mode": "none", 2023-10-03T10:12:28.162 INFO:teuthology.orchestra.run.smithi072.stdout: "target_max_bytes": 0, 2023-10-03T10:12:28.162 INFO:teuthology.orchestra.run.smithi072.stdout: "target_max_objects": 0, 2023-10-03T10:12:28.162 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:12:28.163 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:12:28.163 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:12:28.163 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_min_flush_age": 0, 2023-10-03T10:12:28.163 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_min_evict_age": 0, 2023-10-03T10:12:28.163 INFO:teuthology.orchestra.run.smithi072.stdout: "erasure_code_profile": "", 2023-10-03T10:12:28.163 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_params": { 2023-10-03T10:12:28.163 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "none" 2023-10-03T10:12:28.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.163 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_period": 0, 2023-10-03T10:12:28.163 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_count": 0, 2023-10-03T10:12:28.163 INFO:teuthology.orchestra.run.smithi072.stdout: "use_gmt_hitset": true, 2023-10-03T10:12:28.163 INFO:teuthology.orchestra.run.smithi072.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:12:28.164 INFO:teuthology.orchestra.run.smithi072.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:12:28.164 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:12:28.164 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:12:28.164 INFO:teuthology.orchestra.run.smithi072.stdout: "grade_table": [], 2023-10-03T10:12:28.164 INFO:teuthology.orchestra.run.smithi072.stdout: "stripe_width": 0, 2023-10-03T10:12:28.164 INFO:teuthology.orchestra.run.smithi072.stdout: "expected_num_objects": 0, 2023-10-03T10:12:28.164 INFO:teuthology.orchestra.run.smithi072.stdout: "fast_read": false, 2023-10-03T10:12:28.164 INFO:teuthology.orchestra.run.smithi072.stdout: "options": { 2023-10-03T10:12:28.164 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num_max": 32, 2023-10-03T10:12:28.164 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num_min": 1 2023-10-03T10:12:28.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.164 INFO:teuthology.orchestra.run.smithi072.stdout: "application_metadata": { 2023-10-03T10:12:28.165 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": {}, 2023-10-03T10:12:28.165 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr_devicehealth": {} 2023-10-03T10:12:28.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.165 INFO:teuthology.orchestra.run.smithi072.stdout: "read_balance": { 2023-10-03T10:12:28.165 INFO:teuthology.orchestra.run.smithi072.stdout: "score_acting": 4, 2023-10-03T10:12:28.165 INFO:teuthology.orchestra.run.smithi072.stdout: "score_stable": 4, 2023-10-03T10:12:28.165 INFO:teuthology.orchestra.run.smithi072.stdout: "optimal_score": 0.5, 2023-10-03T10:12:28.165 INFO:teuthology.orchestra.run.smithi072.stdout: "raw_score_acting": 2, 2023-10-03T10:12:28.165 INFO:teuthology.orchestra.run.smithi072.stdout: "raw_score_stable": 2, 2023-10-03T10:12:28.165 INFO:teuthology.orchestra.run.smithi072.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:12:28.165 INFO:teuthology.orchestra.run.smithi072.stdout: "average_primary_affinity": 1, 2023-10-03T10:12:28.165 INFO:teuthology.orchestra.run.smithi072.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:12:28.166 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.166 INFO:teuthology.orchestra.run.smithi072.stdout: "pool": 2, 2023-10-03T10:12:28.166 INFO:teuthology.orchestra.run.smithi072.stdout: "pool_name": "rbd", 2023-10-03T10:12:28.166 INFO:teuthology.orchestra.run.smithi072.stdout: "create_time": "2023-10-03T10:09:40.092839+0000", 2023-10-03T10:12:28.166 INFO:teuthology.orchestra.run.smithi072.stdout: "flags": 1, 2023-10-03T10:12:28.166 INFO:teuthology.orchestra.run.smithi072.stdout: "flags_names": "hashpspool", 2023-10-03T10:12:28.166 INFO:teuthology.orchestra.run.smithi072.stdout: "type": 1, 2023-10-03T10:12:28.166 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 2, 2023-10-03T10:12:28.166 INFO:teuthology.orchestra.run.smithi072.stdout: "min_size": 1, 2023-10-03T10:12:28.166 INFO:teuthology.orchestra.run.smithi072.stdout: "crush_rule": 0, 2023-10-03T10:12:28.167 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:12:28.167 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:12:28.167 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:12:28.167 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:12:28.167 INFO:teuthology.orchestra.run.smithi072.stdout: "object_hash": 2, 2023-10-03T10:12:28.167 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:12:28.167 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num": 8, 2023-10-03T10:12:28.167 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_placement_num": 8, 2023-10-03T10:12:28.167 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_placement_num_target": 8, 2023-10-03T10:12:28.167 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num_target": 8, 2023-10-03T10:12:28.167 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num_pending": 8, 2023-10-03T10:12:28.167 INFO:teuthology.orchestra.run.smithi072.stdout: "last_pg_merge_meta": { 2023-10-03T10:12:28.168 INFO:teuthology.orchestra.run.smithi072.stdout: "source_pgid": "0.0", 2023-10-03T10:12:28.168 INFO:teuthology.orchestra.run.smithi072.stdout: "ready_epoch": 0, 2023-10-03T10:12:28.168 INFO:teuthology.orchestra.run.smithi072.stdout: "last_epoch_started": 0, 2023-10-03T10:12:28.168 INFO:teuthology.orchestra.run.smithi072.stdout: "last_epoch_clean": 0, 2023-10-03T10:12:28.168 INFO:teuthology.orchestra.run.smithi072.stdout: "source_version": "0'0", 2023-10-03T10:12:28.168 INFO:teuthology.orchestra.run.smithi072.stdout: "target_version": "0'0" 2023-10-03T10:12:28.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.168 INFO:teuthology.orchestra.run.smithi072.stdout: "last_change": "13", 2023-10-03T10:12:28.168 INFO:teuthology.orchestra.run.smithi072.stdout: "last_force_op_resend": "0", 2023-10-03T10:12:28.168 INFO:teuthology.orchestra.run.smithi072.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:12:28.168 INFO:teuthology.orchestra.run.smithi072.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:12:28.168 INFO:teuthology.orchestra.run.smithi072.stdout: "auid": 0, 2023-10-03T10:12:28.169 INFO:teuthology.orchestra.run.smithi072.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:12:28.169 INFO:teuthology.orchestra.run.smithi072.stdout: "snap_seq": 0, 2023-10-03T10:12:28.169 INFO:teuthology.orchestra.run.smithi072.stdout: "snap_epoch": 0, 2023-10-03T10:12:28.169 INFO:teuthology.orchestra.run.smithi072.stdout: "pool_snaps": [], 2023-10-03T10:12:28.169 INFO:teuthology.orchestra.run.smithi072.stdout: "removed_snaps": "[]", 2023-10-03T10:12:28.169 INFO:teuthology.orchestra.run.smithi072.stdout: "quota_max_bytes": 0, 2023-10-03T10:12:28.169 INFO:teuthology.orchestra.run.smithi072.stdout: "quota_max_objects": 0, 2023-10-03T10:12:28.169 INFO:teuthology.orchestra.run.smithi072.stdout: "tiers": [], 2023-10-03T10:12:28.169 INFO:teuthology.orchestra.run.smithi072.stdout: "tier_of": -1, 2023-10-03T10:12:28.169 INFO:teuthology.orchestra.run.smithi072.stdout: "read_tier": -1, 2023-10-03T10:12:28.169 INFO:teuthology.orchestra.run.smithi072.stdout: "write_tier": -1, 2023-10-03T10:12:28.169 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_mode": "none", 2023-10-03T10:12:28.170 INFO:teuthology.orchestra.run.smithi072.stdout: "target_max_bytes": 0, 2023-10-03T10:12:28.170 INFO:teuthology.orchestra.run.smithi072.stdout: "target_max_objects": 0, 2023-10-03T10:12:28.170 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:12:28.170 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:12:28.170 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:12:28.170 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_min_flush_age": 0, 2023-10-03T10:12:28.170 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_min_evict_age": 0, 2023-10-03T10:12:28.170 INFO:teuthology.orchestra.run.smithi072.stdout: "erasure_code_profile": "", 2023-10-03T10:12:28.170 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_params": { 2023-10-03T10:12:28.170 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "none" 2023-10-03T10:12:28.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.170 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_period": 0, 2023-10-03T10:12:28.171 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_count": 0, 2023-10-03T10:12:28.171 INFO:teuthology.orchestra.run.smithi072.stdout: "use_gmt_hitset": true, 2023-10-03T10:12:28.171 INFO:teuthology.orchestra.run.smithi072.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:12:28.171 INFO:teuthology.orchestra.run.smithi072.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:12:28.171 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:12:28.171 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:12:28.171 INFO:teuthology.orchestra.run.smithi072.stdout: "grade_table": [], 2023-10-03T10:12:28.171 INFO:teuthology.orchestra.run.smithi072.stdout: "stripe_width": 0, 2023-10-03T10:12:28.171 INFO:teuthology.orchestra.run.smithi072.stdout: "expected_num_objects": 0, 2023-10-03T10:12:28.171 INFO:teuthology.orchestra.run.smithi072.stdout: "fast_read": false, 2023-10-03T10:12:28.171 INFO:teuthology.orchestra.run.smithi072.stdout: "options": {}, 2023-10-03T10:12:28.171 INFO:teuthology.orchestra.run.smithi072.stdout: "application_metadata": { 2023-10-03T10:12:28.172 INFO:teuthology.orchestra.run.smithi072.stdout: "rbd": {} 2023-10-03T10:12:28.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.172 INFO:teuthology.orchestra.run.smithi072.stdout: "read_balance": { 2023-10-03T10:12:28.172 INFO:teuthology.orchestra.run.smithi072.stdout: "score_acting": 2.5, 2023-10-03T10:12:28.172 INFO:teuthology.orchestra.run.smithi072.stdout: "score_stable": 2.5, 2023-10-03T10:12:28.172 INFO:teuthology.orchestra.run.smithi072.stdout: "optimal_score": 1, 2023-10-03T10:12:28.172 INFO:teuthology.orchestra.run.smithi072.stdout: "raw_score_acting": 2.5, 2023-10-03T10:12:28.172 INFO:teuthology.orchestra.run.smithi072.stdout: "raw_score_stable": 2.5, 2023-10-03T10:12:28.172 INFO:teuthology.orchestra.run.smithi072.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:12:28.172 INFO:teuthology.orchestra.run.smithi072.stdout: "average_primary_affinity": 1, 2023-10-03T10:12:28.172 INFO:teuthology.orchestra.run.smithi072.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:12:28.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.173 INFO:teuthology.orchestra.run.smithi072.stdout: "pool": 3, 2023-10-03T10:12:28.173 INFO:teuthology.orchestra.run.smithi072.stdout: "pool_name": "cephfs_metadata", 2023-10-03T10:12:28.173 INFO:teuthology.orchestra.run.smithi072.stdout: "create_time": "2023-10-03T10:09:44.713857+0000", 2023-10-03T10:12:28.173 INFO:teuthology.orchestra.run.smithi072.stdout: "flags": 1, 2023-10-03T10:12:28.173 INFO:teuthology.orchestra.run.smithi072.stdout: "flags_names": "hashpspool", 2023-10-03T10:12:28.173 INFO:teuthology.orchestra.run.smithi072.stdout: "type": 1, 2023-10-03T10:12:28.173 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 2, 2023-10-03T10:12:28.173 INFO:teuthology.orchestra.run.smithi072.stdout: "min_size": 1, 2023-10-03T10:12:28.173 INFO:teuthology.orchestra.run.smithi072.stdout: "crush_rule": 0, 2023-10-03T10:12:28.173 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:12:28.173 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:12:28.174 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:12:28.174 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:12:28.174 INFO:teuthology.orchestra.run.smithi072.stdout: "object_hash": 2, 2023-10-03T10:12:28.174 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:12:28.174 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num": 32, 2023-10-03T10:12:28.174 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_placement_num": 32, 2023-10-03T10:12:28.174 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_placement_num_target": 32, 2023-10-03T10:12:28.174 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num_target": 32, 2023-10-03T10:12:28.174 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num_pending": 32, 2023-10-03T10:12:28.174 INFO:teuthology.orchestra.run.smithi072.stdout: "last_pg_merge_meta": { 2023-10-03T10:12:28.174 INFO:teuthology.orchestra.run.smithi072.stdout: "source_pgid": "0.0", 2023-10-03T10:12:28.174 INFO:teuthology.orchestra.run.smithi072.stdout: "ready_epoch": 0, 2023-10-03T10:12:28.175 INFO:teuthology.orchestra.run.smithi072.stdout: "last_epoch_started": 0, 2023-10-03T10:12:28.175 INFO:teuthology.orchestra.run.smithi072.stdout: "last_epoch_clean": 0, 2023-10-03T10:12:28.175 INFO:teuthology.orchestra.run.smithi072.stdout: "source_version": "0'0", 2023-10-03T10:12:28.175 INFO:teuthology.orchestra.run.smithi072.stdout: "target_version": "0'0" 2023-10-03T10:12:28.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.175 INFO:teuthology.orchestra.run.smithi072.stdout: "last_change": "16", 2023-10-03T10:12:28.175 INFO:teuthology.orchestra.run.smithi072.stdout: "last_force_op_resend": "0", 2023-10-03T10:12:28.175 INFO:teuthology.orchestra.run.smithi072.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:12:28.175 INFO:teuthology.orchestra.run.smithi072.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:12:28.175 INFO:teuthology.orchestra.run.smithi072.stdout: "auid": 0, 2023-10-03T10:12:28.175 INFO:teuthology.orchestra.run.smithi072.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:12:28.175 INFO:teuthology.orchestra.run.smithi072.stdout: "snap_seq": 0, 2023-10-03T10:12:28.176 INFO:teuthology.orchestra.run.smithi072.stdout: "snap_epoch": 0, 2023-10-03T10:12:28.176 INFO:teuthology.orchestra.run.smithi072.stdout: "pool_snaps": [], 2023-10-03T10:12:28.176 INFO:teuthology.orchestra.run.smithi072.stdout: "removed_snaps": "[]", 2023-10-03T10:12:28.176 INFO:teuthology.orchestra.run.smithi072.stdout: "quota_max_bytes": 0, 2023-10-03T10:12:28.176 INFO:teuthology.orchestra.run.smithi072.stdout: "quota_max_objects": 0, 2023-10-03T10:12:28.176 INFO:teuthology.orchestra.run.smithi072.stdout: "tiers": [], 2023-10-03T10:12:28.176 INFO:teuthology.orchestra.run.smithi072.stdout: "tier_of": -1, 2023-10-03T10:12:28.176 INFO:teuthology.orchestra.run.smithi072.stdout: "read_tier": -1, 2023-10-03T10:12:28.176 INFO:teuthology.orchestra.run.smithi072.stdout: "write_tier": -1, 2023-10-03T10:12:28.176 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_mode": "none", 2023-10-03T10:12:28.176 INFO:teuthology.orchestra.run.smithi072.stdout: "target_max_bytes": 0, 2023-10-03T10:12:28.176 INFO:teuthology.orchestra.run.smithi072.stdout: "target_max_objects": 0, 2023-10-03T10:12:28.177 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:12:28.177 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:12:28.177 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:12:28.177 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_min_flush_age": 0, 2023-10-03T10:12:28.177 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_min_evict_age": 0, 2023-10-03T10:12:28.177 INFO:teuthology.orchestra.run.smithi072.stdout: "erasure_code_profile": "", 2023-10-03T10:12:28.177 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_params": { 2023-10-03T10:12:28.177 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "none" 2023-10-03T10:12:28.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.177 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_period": 0, 2023-10-03T10:12:28.177 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_count": 0, 2023-10-03T10:12:28.177 INFO:teuthology.orchestra.run.smithi072.stdout: "use_gmt_hitset": true, 2023-10-03T10:12:28.178 INFO:teuthology.orchestra.run.smithi072.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:12:28.178 INFO:teuthology.orchestra.run.smithi072.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:12:28.178 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:12:28.178 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:12:28.178 INFO:teuthology.orchestra.run.smithi072.stdout: "grade_table": [], 2023-10-03T10:12:28.178 INFO:teuthology.orchestra.run.smithi072.stdout: "stripe_width": 0, 2023-10-03T10:12:28.178 INFO:teuthology.orchestra.run.smithi072.stdout: "expected_num_objects": 0, 2023-10-03T10:12:28.178 INFO:teuthology.orchestra.run.smithi072.stdout: "fast_read": false, 2023-10-03T10:12:28.178 INFO:teuthology.orchestra.run.smithi072.stdout: "options": { 2023-10-03T10:12:28.178 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_autoscale_bias": 4, 2023-10-03T10:12:28.178 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num_min": 16, 2023-10-03T10:12:28.179 INFO:teuthology.orchestra.run.smithi072.stdout: "recovery_priority": 5 2023-10-03T10:12:28.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.179 INFO:teuthology.orchestra.run.smithi072.stdout: "application_metadata": { 2023-10-03T10:12:28.179 INFO:teuthology.orchestra.run.smithi072.stdout: "cephfs": { 2023-10-03T10:12:28.179 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": "cephfs" 2023-10-03T10:12:28.179 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.179 INFO:teuthology.orchestra.run.smithi072.stdout: "read_balance": { 2023-10-03T10:12:28.179 INFO:teuthology.orchestra.run.smithi072.stdout: "score_acting": 1.6299999952316284, 2023-10-03T10:12:28.179 INFO:teuthology.orchestra.run.smithi072.stdout: "score_stable": 1.6299999952316284, 2023-10-03T10:12:28.179 INFO:teuthology.orchestra.run.smithi072.stdout: "optimal_score": 1, 2023-10-03T10:12:28.179 INFO:teuthology.orchestra.run.smithi072.stdout: "raw_score_acting": 1.6299999952316284, 2023-10-03T10:12:28.179 INFO:teuthology.orchestra.run.smithi072.stdout: "raw_score_stable": 1.6299999952316284, 2023-10-03T10:12:28.180 INFO:teuthology.orchestra.run.smithi072.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:12:28.180 INFO:teuthology.orchestra.run.smithi072.stdout: "average_primary_affinity": 1, 2023-10-03T10:12:28.180 INFO:teuthology.orchestra.run.smithi072.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:12:28.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.180 INFO:teuthology.orchestra.run.smithi072.stdout: "pool": 4, 2023-10-03T10:12:28.180 INFO:teuthology.orchestra.run.smithi072.stdout: "pool_name": "cephfs_data", 2023-10-03T10:12:28.180 INFO:teuthology.orchestra.run.smithi072.stdout: "create_time": "2023-10-03T10:09:45.314387+0000", 2023-10-03T10:12:28.180 INFO:teuthology.orchestra.run.smithi072.stdout: "flags": 1, 2023-10-03T10:12:28.180 INFO:teuthology.orchestra.run.smithi072.stdout: "flags_names": "hashpspool", 2023-10-03T10:12:28.180 INFO:teuthology.orchestra.run.smithi072.stdout: "type": 1, 2023-10-03T10:12:28.181 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 2, 2023-10-03T10:12:28.181 INFO:teuthology.orchestra.run.smithi072.stdout: "min_size": 1, 2023-10-03T10:12:28.181 INFO:teuthology.orchestra.run.smithi072.stdout: "crush_rule": 0, 2023-10-03T10:12:28.181 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:12:28.181 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:12:28.181 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:12:28.181 INFO:teuthology.orchestra.run.smithi072.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:12:28.181 INFO:teuthology.orchestra.run.smithi072.stdout: "object_hash": 2, 2023-10-03T10:12:28.181 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:12:28.181 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num": 64, 2023-10-03T10:12:28.181 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_placement_num": 64, 2023-10-03T10:12:28.181 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_placement_num_target": 64, 2023-10-03T10:12:28.182 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num_target": 64, 2023-10-03T10:12:28.182 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num_pending": 64, 2023-10-03T10:12:28.182 INFO:teuthology.orchestra.run.smithi072.stdout: "last_pg_merge_meta": { 2023-10-03T10:12:28.182 INFO:teuthology.orchestra.run.smithi072.stdout: "source_pgid": "0.0", 2023-10-03T10:12:28.182 INFO:teuthology.orchestra.run.smithi072.stdout: "ready_epoch": 0, 2023-10-03T10:12:28.182 INFO:teuthology.orchestra.run.smithi072.stdout: "last_epoch_started": 0, 2023-10-03T10:12:28.182 INFO:teuthology.orchestra.run.smithi072.stdout: "last_epoch_clean": 0, 2023-10-03T10:12:28.182 INFO:teuthology.orchestra.run.smithi072.stdout: "source_version": "0'0", 2023-10-03T10:12:28.182 INFO:teuthology.orchestra.run.smithi072.stdout: "target_version": "0'0" 2023-10-03T10:12:28.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.182 INFO:teuthology.orchestra.run.smithi072.stdout: "last_change": "17", 2023-10-03T10:12:28.182 INFO:teuthology.orchestra.run.smithi072.stdout: "last_force_op_resend": "0", 2023-10-03T10:12:28.183 INFO:teuthology.orchestra.run.smithi072.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:12:28.183 INFO:teuthology.orchestra.run.smithi072.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:12:28.183 INFO:teuthology.orchestra.run.smithi072.stdout: "auid": 0, 2023-10-03T10:12:28.183 INFO:teuthology.orchestra.run.smithi072.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:12:28.183 INFO:teuthology.orchestra.run.smithi072.stdout: "snap_seq": 0, 2023-10-03T10:12:28.183 INFO:teuthology.orchestra.run.smithi072.stdout: "snap_epoch": 0, 2023-10-03T10:12:28.183 INFO:teuthology.orchestra.run.smithi072.stdout: "pool_snaps": [], 2023-10-03T10:12:28.183 INFO:teuthology.orchestra.run.smithi072.stdout: "removed_snaps": "[]", 2023-10-03T10:12:28.183 INFO:teuthology.orchestra.run.smithi072.stdout: "quota_max_bytes": 0, 2023-10-03T10:12:28.183 INFO:teuthology.orchestra.run.smithi072.stdout: "quota_max_objects": 0, 2023-10-03T10:12:28.183 INFO:teuthology.orchestra.run.smithi072.stdout: "tiers": [], 2023-10-03T10:12:28.183 INFO:teuthology.orchestra.run.smithi072.stdout: "tier_of": -1, 2023-10-03T10:12:28.184 INFO:teuthology.orchestra.run.smithi072.stdout: "read_tier": -1, 2023-10-03T10:12:28.184 INFO:teuthology.orchestra.run.smithi072.stdout: "write_tier": -1, 2023-10-03T10:12:28.184 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_mode": "none", 2023-10-03T10:12:28.184 INFO:teuthology.orchestra.run.smithi072.stdout: "target_max_bytes": 0, 2023-10-03T10:12:28.184 INFO:teuthology.orchestra.run.smithi072.stdout: "target_max_objects": 0, 2023-10-03T10:12:28.184 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:12:28.184 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:12:28.184 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:12:28.184 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_min_flush_age": 0, 2023-10-03T10:12:28.184 INFO:teuthology.orchestra.run.smithi072.stdout: "cache_min_evict_age": 0, 2023-10-03T10:12:28.184 INFO:teuthology.orchestra.run.smithi072.stdout: "erasure_code_profile": "", 2023-10-03T10:12:28.184 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_params": { 2023-10-03T10:12:28.184 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "none" 2023-10-03T10:12:28.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.185 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_period": 0, 2023-10-03T10:12:28.185 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_count": 0, 2023-10-03T10:12:28.185 INFO:teuthology.orchestra.run.smithi072.stdout: "use_gmt_hitset": true, 2023-10-03T10:12:28.185 INFO:teuthology.orchestra.run.smithi072.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:12:28.185 INFO:teuthology.orchestra.run.smithi072.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:12:28.185 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:12:28.185 INFO:teuthology.orchestra.run.smithi072.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:12:28.185 INFO:teuthology.orchestra.run.smithi072.stdout: "grade_table": [], 2023-10-03T10:12:28.185 INFO:teuthology.orchestra.run.smithi072.stdout: "stripe_width": 0, 2023-10-03T10:12:28.185 INFO:teuthology.orchestra.run.smithi072.stdout: "expected_num_objects": 0, 2023-10-03T10:12:28.185 INFO:teuthology.orchestra.run.smithi072.stdout: "fast_read": false, 2023-10-03T10:12:28.186 INFO:teuthology.orchestra.run.smithi072.stdout: "options": { 2023-10-03T10:12:28.186 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_num_min": 64, 2023-10-03T10:12:28.186 INFO:teuthology.orchestra.run.smithi072.stdout: "target_size_ratio": 0.89999997615814209 2023-10-03T10:12:28.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.186 INFO:teuthology.orchestra.run.smithi072.stdout: "application_metadata": { 2023-10-03T10:12:28.186 INFO:teuthology.orchestra.run.smithi072.stdout: "cephfs": { 2023-10-03T10:12:28.186 INFO:teuthology.orchestra.run.smithi072.stdout: "data": "cephfs" 2023-10-03T10:12:28.186 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.186 INFO:teuthology.orchestra.run.smithi072.stdout: "read_balance": { 2023-10-03T10:12:28.186 INFO:teuthology.orchestra.run.smithi072.stdout: "score_acting": 1.059999942779541, 2023-10-03T10:12:28.187 INFO:teuthology.orchestra.run.smithi072.stdout: "score_stable": 1.059999942779541, 2023-10-03T10:12:28.187 INFO:teuthology.orchestra.run.smithi072.stdout: "optimal_score": 1, 2023-10-03T10:12:28.187 INFO:teuthology.orchestra.run.smithi072.stdout: "raw_score_acting": 1.059999942779541, 2023-10-03T10:12:28.187 INFO:teuthology.orchestra.run.smithi072.stdout: "raw_score_stable": 1.059999942779541, 2023-10-03T10:12:28.187 INFO:teuthology.orchestra.run.smithi072.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:12:28.187 INFO:teuthology.orchestra.run.smithi072.stdout: "average_primary_affinity": 1, 2023-10-03T10:12:28.187 INFO:teuthology.orchestra.run.smithi072.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:12:28.187 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.187 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.187 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-10-03T10:12:28.187 INFO:teuthology.orchestra.run.smithi072.stdout: "osds": [ 2023-10-03T10:12:28.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.188 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": 0, 2023-10-03T10:12:28.188 INFO:teuthology.orchestra.run.smithi072.stdout: "uuid": "48d870e9-7887-40a6-bb5e-b2634b374762", 2023-10-03T10:12:28.188 INFO:teuthology.orchestra.run.smithi072.stdout: "up": 1, 2023-10-03T10:12:28.188 INFO:teuthology.orchestra.run.smithi072.stdout: "in": 1, 2023-10-03T10:12:28.188 INFO:teuthology.orchestra.run.smithi072.stdout: "weight": 1, 2023-10-03T10:12:28.188 INFO:teuthology.orchestra.run.smithi072.stdout: "primary_affinity": 1, 2023-10-03T10:12:28.188 INFO:teuthology.orchestra.run.smithi072.stdout: "last_clean_begin": 9, 2023-10-03T10:12:28.188 INFO:teuthology.orchestra.run.smithi072.stdout: "last_clean_end": 23, 2023-10-03T10:12:28.188 INFO:teuthology.orchestra.run.smithi072.stdout: "up_from": 29, 2023-10-03T10:12:28.188 INFO:teuthology.orchestra.run.smithi072.stdout: "up_thru": 32, 2023-10-03T10:12:28.188 INFO:teuthology.orchestra.run.smithi072.stdout: "down_at": 24, 2023-10-03T10:12:28.188 INFO:teuthology.orchestra.run.smithi072.stdout: "lost_at": 0, 2023-10-03T10:12:28.189 INFO:teuthology.orchestra.run.smithi072.stdout: "public_addrs": { 2023-10-03T10:12:28.189 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.189 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.189 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6804", 2023-10-03T10:12:28.189 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 129472 2023-10-03T10:12:28.189 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.189 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.189 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_addrs": { 2023-10-03T10:12:28.189 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.189 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.190 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6805", 2023-10-03T10:12:28.190 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 129472 2023-10-03T10:12:28.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.190 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.190 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_back_addrs": { 2023-10-03T10:12:28.190 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.190 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.190 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6807", 2023-10-03T10:12:28.190 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 129472 2023-10-03T10:12:28.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.191 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.191 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_front_addrs": { 2023-10-03T10:12:28.191 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.191 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.191 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6806", 2023-10-03T10:12:28.191 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 129472 2023-10-03T10:12:28.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.191 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.191 INFO:teuthology.orchestra.run.smithi072.stdout: "public_addr": "172.21.15.72:6804/129472", 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_addr": "172.21.15.72:6805/129472", 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_back_addr": "172.21.15.72:6807/129472", 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_front_addr": "172.21.15.72:6806/129472", 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi072.stdout: "state": [ 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi072.stdout: "exists", 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi072.stdout: "up" 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": 1, 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi072.stdout: "uuid": "9f579570-81c8-4dcb-aa20-b72cf8df944d", 2023-10-03T10:12:28.192 INFO:teuthology.orchestra.run.smithi072.stdout: "up": 1, 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi072.stdout: "in": 1, 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi072.stdout: "weight": 1, 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi072.stdout: "primary_affinity": 1, 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi072.stdout: "last_clean_begin": 9, 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi072.stdout: "last_clean_end": 23, 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi072.stdout: "up_from": 30, 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi072.stdout: "up_thru": 32, 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi072.stdout: "down_at": 25, 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi072.stdout: "lost_at": 0, 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi072.stdout: "public_addrs": { 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.193 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.194 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6800", 2023-10-03T10:12:28.194 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 129570 2023-10-03T10:12:28.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.194 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.194 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_addrs": { 2023-10-03T10:12:28.194 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.194 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.194 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6801", 2023-10-03T10:12:28.194 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 129570 2023-10-03T10:12:28.195 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.195 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.195 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_back_addrs": { 2023-10-03T10:12:28.195 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.195 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.195 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6803", 2023-10-03T10:12:28.195 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 129570 2023-10-03T10:12:28.195 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.195 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.195 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_front_addrs": { 2023-10-03T10:12:28.196 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.196 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.196 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6802", 2023-10-03T10:12:28.196 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 129570 2023-10-03T10:12:28.196 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.196 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.196 INFO:teuthology.orchestra.run.smithi072.stdout: "public_addr": "172.21.15.72:6800/129570", 2023-10-03T10:12:28.196 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_addr": "172.21.15.72:6801/129570", 2023-10-03T10:12:28.196 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_back_addr": "172.21.15.72:6803/129570", 2023-10-03T10:12:28.196 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_front_addr": "172.21.15.72:6802/129570", 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi072.stdout: "state": [ 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi072.stdout: "exists", 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi072.stdout: "up" 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": 2, 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi072.stdout: "uuid": "fd55a9ee-4434-4270-8e10-d8ed0a66164d", 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi072.stdout: "up": 1, 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi072.stdout: "in": 1, 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi072.stdout: "weight": 1, 2023-10-03T10:12:28.197 INFO:teuthology.orchestra.run.smithi072.stdout: "primary_affinity": 1, 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi072.stdout: "last_clean_begin": 9, 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi072.stdout: "last_clean_end": 25, 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi072.stdout: "up_from": 31, 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi072.stdout: "up_thru": 32, 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi072.stdout: "down_at": 26, 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi072.stdout: "lost_at": 0, 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi072.stdout: "public_addrs": { 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6808", 2023-10-03T10:12:28.198 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 129702 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_addrs": { 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6809", 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 129702 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_back_addrs": { 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6811", 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 129702 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_front_addrs": { 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6810", 2023-10-03T10:12:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 129702 2023-10-03T10:12:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: "public_addr": "172.21.15.72:6808/129702", 2023-10-03T10:12:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_addr": "172.21.15.72:6809/129702", 2023-10-03T10:12:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_back_addr": "172.21.15.72:6811/129702", 2023-10-03T10:12:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_front_addr": "172.21.15.72:6810/129702", 2023-10-03T10:12:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: "state": [ 2023-10-03T10:12:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: "exists", 2023-10-03T10:12:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: "up" 2023-10-03T10:12:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": 3, 2023-10-03T10:12:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: "uuid": "b7aa354b-4fb5-45d4-8210-97d6af9d4a3e", 2023-10-03T10:12:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: "up": 1, 2023-10-03T10:12:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: "in": 1, 2023-10-03T10:12:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: "weight": 1, 2023-10-03T10:12:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: "primary_affinity": 1, 2023-10-03T10:12:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: "last_clean_begin": 9, 2023-10-03T10:12:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: "last_clean_end": 26, 2023-10-03T10:12:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: "up_from": 32, 2023-10-03T10:12:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: "up_thru": 32, 2023-10-03T10:12:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: "down_at": 27, 2023-10-03T10:12:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: "lost_at": 0, 2023-10-03T10:12:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: "public_addrs": { 2023-10-03T10:12:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6812", 2023-10-03T10:12:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 130020 2023-10-03T10:12:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_addrs": { 2023-10-03T10:12:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6813", 2023-10-03T10:12:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 130020 2023-10-03T10:12:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_back_addrs": { 2023-10-03T10:12:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6815", 2023-10-03T10:12:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 130020 2023-10-03T10:12:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_front_addrs": { 2023-10-03T10:12:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: "addrvec": [ 2023-10-03T10:12:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-03T10:12:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "172.21.15.72:6814", 2023-10-03T10:12:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 130020 2023-10-03T10:12:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: "public_addr": "172.21.15.72:6812/130020", 2023-10-03T10:12:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_addr": "172.21.15.72:6813/130020", 2023-10-03T10:12:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_back_addr": "172.21.15.72:6815/130020", 2023-10-03T10:12:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: "heartbeat_front_addr": "172.21.15.72:6814/130020", 2023-10-03T10:12:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: "state": [ 2023-10-03T10:12:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: "exists", 2023-10-03T10:12:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: "up" 2023-10-03T10:12:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-10-03T10:12:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_xinfo": [ 2023-10-03T10:12:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": 0, 2023-10-03T10:12:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "down_stamp": "0.000000", 2023-10-03T10:12:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "laggy_probability": 0, 2023-10-03T10:12:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "laggy_interval": 0, 2023-10-03T10:12:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "features": 4540138322906710015, 2023-10-03T10:12:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "old_weight": 0, 2023-10-03T10:12:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:37.346892+0000", 2023-10-03T10:12:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "dead_epoch": 24 2023-10-03T10:12:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": 1, 2023-10-03T10:12:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: "down_stamp": "0.000000", 2023-10-03T10:12:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: "laggy_probability": 0, 2023-10-03T10:12:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: "laggy_interval": 0, 2023-10-03T10:12:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: "features": 4540138322906710015, 2023-10-03T10:12:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: "old_weight": 0, 2023-10-03T10:12:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:37.339081+0000", 2023-10-03T10:12:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: "dead_epoch": 25 2023-10-03T10:12:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": 2, 2023-10-03T10:12:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: "down_stamp": "0.000000", 2023-10-03T10:12:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: "laggy_probability": 0, 2023-10-03T10:12:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: "laggy_interval": 0, 2023-10-03T10:12:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: "features": 4540138322906710015, 2023-10-03T10:12:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: "old_weight": 0, 2023-10-03T10:12:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:37.609392+0000", 2023-10-03T10:12:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: "dead_epoch": 26 2023-10-03T10:12:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": 3, 2023-10-03T10:12:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: "down_stamp": "2023-10-03T10:12:19.493196+0000", 2023-10-03T10:12:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: "laggy_probability": 0, 2023-10-03T10:12:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: "laggy_interval": 0, 2023-10-03T10:12:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: "features": 4540138322906710015, 2023-10-03T10:12:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: "old_weight": 0, 2023-10-03T10:12:28.210 INFO:teuthology.orchestra.run.smithi072.stdout: "last_purged_snaps_scrub": "2023-10-03T10:09:37.577218+0000", 2023-10-03T10:12:28.210 INFO:teuthology.orchestra.run.smithi072.stdout: "dead_epoch": 0 2023-10-03T10:12:28.210 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.210 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-10-03T10:12:28.210 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_upmap": [], 2023-10-03T10:12:28.210 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_upmap_items": [ 2023-10-03T10:12:28.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.210 INFO:teuthology.orchestra.run.smithi072.stdout: "pgid": "4.0", 2023-10-03T10:12:28.210 INFO:teuthology.orchestra.run.smithi072.stdout: "mappings": [ 2023-10-03T10:12:28.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.210 INFO:teuthology.orchestra.run.smithi072.stdout: "from": 3, 2023-10-03T10:12:28.210 INFO:teuthology.orchestra.run.smithi072.stdout: "to": 0 2023-10-03T10:12:28.211 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.211 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.211 INFO:teuthology.orchestra.run.smithi072.stdout: "pgid": "4.7", 2023-10-03T10:12:28.211 INFO:teuthology.orchestra.run.smithi072.stdout: "mappings": [ 2023-10-03T10:12:28.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.211 INFO:teuthology.orchestra.run.smithi072.stdout: "from": 1, 2023-10-03T10:12:28.211 INFO:teuthology.orchestra.run.smithi072.stdout: "to": 2 2023-10-03T10:12:28.211 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.211 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.212 INFO:teuthology.orchestra.run.smithi072.stdout: "pgid": "4.f", 2023-10-03T10:12:28.212 INFO:teuthology.orchestra.run.smithi072.stdout: "mappings": [ 2023-10-03T10:12:28.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.212 INFO:teuthology.orchestra.run.smithi072.stdout: "from": 3, 2023-10-03T10:12:28.212 INFO:teuthology.orchestra.run.smithi072.stdout: "to": 2 2023-10-03T10:12:28.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.212 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.212 INFO:teuthology.orchestra.run.smithi072.stdout: "pgid": "4.17", 2023-10-03T10:12:28.212 INFO:teuthology.orchestra.run.smithi072.stdout: "mappings": [ 2023-10-03T10:12:28.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.213 INFO:teuthology.orchestra.run.smithi072.stdout: "from": 3, 2023-10-03T10:12:28.213 INFO:teuthology.orchestra.run.smithi072.stdout: "to": 2 2023-10-03T10:12:28.213 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.213 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.213 INFO:teuthology.orchestra.run.smithi072.stdout: "pgid": "4.21", 2023-10-03T10:12:28.213 INFO:teuthology.orchestra.run.smithi072.stdout: "mappings": [ 2023-10-03T10:12:28.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.213 INFO:teuthology.orchestra.run.smithi072.stdout: "from": 3, 2023-10-03T10:12:28.213 INFO:teuthology.orchestra.run.smithi072.stdout: "to": 0 2023-10-03T10:12:28.213 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.214 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.214 INFO:teuthology.orchestra.run.smithi072.stdout: "pgid": "4.2f", 2023-10-03T10:12:28.214 INFO:teuthology.orchestra.run.smithi072.stdout: "mappings": [ 2023-10-03T10:12:28.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.214 INFO:teuthology.orchestra.run.smithi072.stdout: "from": 3, 2023-10-03T10:12:28.214 INFO:teuthology.orchestra.run.smithi072.stdout: "to": 2 2023-10-03T10:12:28.214 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.214 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.214 INFO:teuthology.orchestra.run.smithi072.stdout: "pgid": "4.3b", 2023-10-03T10:12:28.215 INFO:teuthology.orchestra.run.smithi072.stdout: "mappings": [ 2023-10-03T10:12:28.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-03T10:12:28.215 INFO:teuthology.orchestra.run.smithi072.stdout: "from": 3, 2023-10-03T10:12:28.215 INFO:teuthology.orchestra.run.smithi072.stdout: "to": 2 2023-10-03T10:12:28.215 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.215 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-03T10:12:28.215 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.215 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-10-03T10:12:28.215 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_upmap_primaries": [], 2023-10-03T10:12:28.215 INFO:teuthology.orchestra.run.smithi072.stdout: "pg_temp": [], 2023-10-03T10:12:28.215 INFO:teuthology.orchestra.run.smithi072.stdout: "primary_temp": [], 2023-10-03T10:12:28.215 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklist": { 2023-10-03T10:12:28.216 INFO:teuthology.orchestra.run.smithi072.stdout: "172.21.15.72:6816/118184": "2023-10-04T10:12:06.073551+0000", 2023-10-03T10:12:28.216 INFO:teuthology.orchestra.run.smithi072.stdout: "172.21.15.72:6817/542674768": "2023-10-04T10:12:27.583946+0000", 2023-10-03T10:12:28.216 INFO:teuthology.orchestra.run.smithi072.stdout: "172.21.15.72:0/3319279924": "2023-10-04T10:12:06.073551+0000", 2023-10-03T10:12:28.216 INFO:teuthology.orchestra.run.smithi072.stdout: "172.21.15.72:0/2966012812": "2023-10-04T10:12:06.073551+0000" 2023-10-03T10:12:28.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.216 INFO:teuthology.orchestra.run.smithi072.stdout: "range_blocklist": {}, 2023-10-03T10:12:28.216 INFO:teuthology.orchestra.run.smithi072.stdout: "erasure_code_profiles": { 2023-10-03T10:12:28.216 INFO:teuthology.orchestra.run.smithi072.stdout: "default": { 2023-10-03T10:12:28.216 INFO:teuthology.orchestra.run.smithi072.stdout: "crush-failure-domain": "osd", 2023-10-03T10:12:28.216 INFO:teuthology.orchestra.run.smithi072.stdout: "k": "2", 2023-10-03T10:12:28.216 INFO:teuthology.orchestra.run.smithi072.stdout: "m": "1", 2023-10-03T10:12:28.216 INFO:teuthology.orchestra.run.smithi072.stdout: "plugin": "jerasure", 2023-10-03T10:12:28.216 INFO:teuthology.orchestra.run.smithi072.stdout: "technique": "reed_sol_van" 2023-10-03T10:12:28.217 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.217 INFO:teuthology.orchestra.run.smithi072.stdout: "removed_snaps_queue": [], 2023-10-03T10:12:28.217 INFO:teuthology.orchestra.run.smithi072.stdout: "new_removed_snaps": [], 2023-10-03T10:12:28.217 INFO:teuthology.orchestra.run.smithi072.stdout: "new_purged_snaps": [], 2023-10-03T10:12:28.217 INFO:teuthology.orchestra.run.smithi072.stdout: "crush_node_flags": {}, 2023-10-03T10:12:28.217 INFO:teuthology.orchestra.run.smithi072.stdout: "device_class_flags": {}, 2023-10-03T10:12:28.217 INFO:teuthology.orchestra.run.smithi072.stdout: "stretch_mode": { 2023-10-03T10:12:28.217 INFO:teuthology.orchestra.run.smithi072.stdout: "stretch_mode_enabled": false, 2023-10-03T10:12:28.217 INFO:teuthology.orchestra.run.smithi072.stdout: "stretch_bucket_count": 0, 2023-10-03T10:12:28.217 INFO:teuthology.orchestra.run.smithi072.stdout: "degraded_stretch_mode": 0, 2023-10-03T10:12:28.217 INFO:teuthology.orchestra.run.smithi072.stdout: "recovering_stretch_mode": 0, 2023-10-03T10:12:28.218 INFO:teuthology.orchestra.run.smithi072.stdout: "stretch_mode_bucket": 0 2023-10-03T10:12:28.218 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.218 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-03T10:12:28.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.158+0000 7f81f2999700 1 -- 172.21.15.72:0/987365505 >> v1:172.21.15.72:6816/126756 conn(0x7f81d802f510 legacy=0x7f81d80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.158+0000 7f81f2999700 1 -- 172.21.15.72:0/987365505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81ec1317b0 msgr2=0x7f81ec06d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.158+0000 7f81f2999700 1 --2- 172.21.15.72:0/987365505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81ec1317b0 0x7f81ec06d420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f81e4015000 tx=0x7f81e4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.158+0000 7f81f2999700 1 -- 172.21.15.72:0/987365505 shutdown_connections 2023-10-03T10:12:28.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.158+0000 7f81f2999700 1 --2- 172.21.15.72:0/987365505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81ec1317b0 0x7f81ec06d420 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.158+0000 7f81f2999700 1 --2- 172.21.15.72:0/987365505 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81ec09e9d0 0x7f81ec06c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.158+0000 7f81f2999700 1 --2- 172.21.15.72:0/987365505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81ec09f2e0 0x7f81ec06cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.158+0000 7f81f2999700 1 -- 172.21.15.72:0/987365505 >> 172.21.15.72:0/987365505 conn(0x7f81ec0a43c0 msgr2=0x7f81ec130f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.158+0000 7f81f2999700 1 -- 172.21.15.72:0/987365505 shutdown_connections 2023-10-03T10:12:28.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.158+0000 7f81f2999700 1 -- 172.21.15.72:0/987365505 wait complete. 2023-10-03T10:12:28.221 DEBUG:teuthology.orchestra.run.smithi072:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2023-10-03T10:12:28.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.338+0000 7f6065f84700 1 Processor -- start 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.338+0000 7f6065f84700 1 -- start start 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.338+0000 7f6065f84700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6060136a50 0x7f6060138e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.338+0000 7f6065f84700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6060139370 0x7f606013b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.338+0000 7f6065f84700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606009f640 con 0x7f6060133b00 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.338+0000 7f6065f84700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606009a790 con 0x7f6060136a50 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.338+0000 7f6065f84700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f606009a4f0 con 0x7f6060139370 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.339+0000 7f605ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6060139370 0x7f606013b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.339+0000 7f605effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6060136a50 0x7f6060138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.339+0000 7f605f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6060133b00 0x7f6060133ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36232/0 (socket says 172.21.15.72:36232) 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.339+0000 7f605f7fe700 1 -- 172.21.15.72:0/1307976849 learned_addr learned my addr 172.21.15.72:0/1307976849 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:28.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.339+0000 7f605ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6060139370 0x7f606013b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58142/0 (socket says 172.21.15.72:58142) 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.339+0000 7f605effd700 1 -- 172.21.15.72:0/1307976849 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6060139370 msgr2=0x7f606013b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.339+0000 7f605effd700 1 --2- 172.21.15.72:0/1307976849 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6060139370 0x7f606013b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.339+0000 7f605effd700 1 -- 172.21.15.72:0/1307976849 >> v1:172.21.15.72:6789/0 conn(0x7f6060133b00 legacy=0x7f6060133ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.339+0000 7f605effd700 1 -- 172.21.15.72:0/1307976849 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606009eb20 con 0x7f6060136a50 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.339+0000 7f605e7fc700 1 -- 172.21.15.72:0/1307976849 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060906417 0 0) 0x7f606009f640 con 0x7f6060133b00 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.339+0000 7f605ffff700 1 --2- 172.21.15.72:0/1307976849 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6060139370 0x7f606013b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.339+0000 7f605effd700 1 --2- 172.21.15.72:0/1307976849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6060136a50 0x7f6060138e30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6050009820 tx=0x7f6050009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a571b38901c1417 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.339+0000 7f605e7fc700 1 -- 172.21.15.72:0/1307976849 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050005e30 con 0x7f6060136a50 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.339+0000 7f605e7fc700 1 -- 172.21.15.72:0/1307976849 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6050006030 con 0x7f6060136a50 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.339+0000 7f605e7fc700 1 -- 172.21.15.72:0/1307976849 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60500063c0 con 0x7f6060136a50 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.340+0000 7f6065f84700 1 -- 172.21.15.72:0/1307976849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6060136a50 msgr2=0x7f6060138e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.340+0000 7f6065f84700 1 --2- 172.21.15.72:0/1307976849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6060136a50 0x7f6060138e30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6050009820 tx=0x7f6050009b30 comp rx=0 tx=0).stop 2023-10-03T10:12:28.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.340+0000 7f6065f84700 1 -- 172.21.15.72:0/1307976849 shutdown_connections 2023-10-03T10:12:28.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.340+0000 7f6065f84700 1 --2- 172.21.15.72:0/1307976849 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6060139370 0x7f606013b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.340+0000 7f6065f84700 1 --2- 172.21.15.72:0/1307976849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6060136a50 0x7f6060138e30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.340+0000 7f6065f84700 1 -- 172.21.15.72:0/1307976849 >> 172.21.15.72:0/1307976849 conn(0x7f60600a2f50 msgr2=0x7f60600a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.340+0000 7f6065f84700 1 -- 172.21.15.72:0/1307976849 shutdown_connections 2023-10-03T10:12:28.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.340+0000 7f6065f84700 1 -- 172.21.15.72:0/1307976849 wait complete. 2023-10-03T10:12:28.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.341+0000 7f6065f84700 1 Processor -- start 2023-10-03T10:12:28.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.341+0000 7f6065f84700 1 -- start start 2023-10-03T10:12:28.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.341+0000 7f6065f84700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6060133b00 0x7f606011d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.341+0000 7f6065f84700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6060136a50 0x7f606011d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.341+0000 7f6065f84700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6060139370 0x7f606011df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.341+0000 7f6065f84700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60601332a0 con 0x7f6060133b00 2023-10-03T10:12:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.341+0000 7f6065f84700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6060120cd0 con 0x7f6060136a50 2023-10-03T10:12:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.341+0000 7f6065f84700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f606011efc0 con 0x7f6060139370 2023-10-03T10:12:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.341+0000 7f605f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6060133b00 0x7f606011d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.341+0000 7f605f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6060133b00 0x7f606011d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37814/0 (socket says 172.21.15.72:37814) 2023-10-03T10:12:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.341+0000 7f605f7fe700 1 -- 172.21.15.72:0/2459885313 learned_addr learned my addr 172.21.15.72:0/2459885313 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.341+0000 7f605ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6060139370 0x7f606011df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.341+0000 7f605effd700 1 --2- 172.21.15.72:0/2459885313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6060136a50 0x7f606011d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.342+0000 7f605f7fe700 1 -- 172.21.15.72:0/2459885313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6060139370 msgr2=0x7f606011df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.342+0000 7f605f7fe700 1 --2- 172.21.15.72:0/2459885313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6060139370 0x7f606011df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.342+0000 7f605f7fe700 1 -- 172.21.15.72:0/2459885313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6060136a50 msgr2=0x7f606011d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.342+0000 7f605f7fe700 1 --2- 172.21.15.72:0/2459885313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6060136a50 0x7f606011d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.342+0000 7f605f7fe700 1 -- 172.21.15.72:0/2459885313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6058009a70 con 0x7f6060133b00 2023-10-03T10:12:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.342+0000 7f605effd700 1 --2- 172.21.15.72:0/2459885313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6060136a50 0x7f606011d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.342+0000 7f605ffff700 1 --2- 172.21.15.72:0/2459885313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6060139370 0x7f606011df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.342+0000 7f605f7fe700 1 --2- 172.21.15.72:0/2459885313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6060133b00 0x7f606011d480 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f605400c520 tx=0x7f605400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.342+0000 7f6047fff700 1 -- 172.21.15.72:0/2459885313 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054004c80 con 0x7f6060133b00 2023-10-03T10:12:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.342+0000 7f6047fff700 1 -- 172.21.15.72:0/2459885313 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6054004e00 con 0x7f6060133b00 2023-10-03T10:12:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.342+0000 7f6047fff700 1 -- 172.21.15.72:0/2459885313 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054007310 con 0x7f6060133b00 2023-10-03T10:12:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.342+0000 7f6065f84700 1 -- 172.21.15.72:0/2459885313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6050009430 con 0x7f6060133b00 2023-10-03T10:12:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.342+0000 7f6065f84700 1 -- 172.21.15.72:0/2459885313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606009cc60 con 0x7f6060133b00 2023-10-03T10:12:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.343+0000 7f6047fff700 1 -- 172.21.15.72:0/2459885313 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6054007470 con 0x7f6060133b00 2023-10-03T10:12:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.343+0000 7f6047fff700 1 -- 172.21.15.72:0/2459885313 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f605403f750 con 0x7f6060133b00 2023-10-03T10:12:28.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.343+0000 7f6065f84700 1 -- 172.21.15.72:0/2459885313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606004f2a0 con 0x7f6060133b00 2023-10-03T10:12:28.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.348+0000 7f6047fff700 1 -- 172.21.15.72:0/2459885313 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f60540123b0 con 0x7f6060133b00 2023-10-03T10:12:28.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.617+0000 7f6065f84700 1 -- 172.21.15.72:0/2459885313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6060120ac0 con 0x7f6060133b00 2023-10-03T10:12:28.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.617+0000 7f6047fff700 1 -- 172.21.15.72:0/2459885313 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+627 (secure 0 0 0) 0x7f60540102c0 con 0x7f6060133b00 2023-10-03T10:12:28.617 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-03T10:12:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": { 2023-10-03T10:12:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 3 2023-10-03T10:12:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": { 2023-10-03T10:12:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 1 2023-10-03T10:12:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": { 2023-10-03T10:12:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 4 2023-10-03T10:12:28.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.618 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": { 2023-10-03T10:12:28.618 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 1 2023-10-03T10:12:28.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-03T10:12:28.618 INFO:teuthology.orchestra.run.smithi072.stdout: "overall": { 2023-10-03T10:12:28.618 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 9 2023-10-03T10:12:28.618 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-03T10:12:28.618 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-03T10:12:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.619+0000 7f6065f84700 1 -- 172.21.15.72:0/2459885313 >> v1:172.21.15.72:6816/126756 conn(0x7f604c02f510 legacy=0x7f604c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.619+0000 7f6065f84700 1 -- 172.21.15.72:0/2459885313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6060133b00 msgr2=0x7f606011d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.619+0000 7f6065f84700 1 --2- 172.21.15.72:0/2459885313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6060133b00 0x7f606011d480 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f605400c520 tx=0x7f605400c830 comp rx=0 tx=0).stop 2023-10-03T10:12:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.619+0000 7f6065f84700 1 -- 172.21.15.72:0/2459885313 shutdown_connections 2023-10-03T10:12:28.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.619+0000 7f6065f84700 1 --2- 172.21.15.72:0/2459885313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6060133b00 0x7f606011d480 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.619+0000 7f6065f84700 1 --2- 172.21.15.72:0/2459885313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6060139370 0x7f606011df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.619+0000 7f6065f84700 1 --2- 172.21.15.72:0/2459885313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6060136a50 0x7f606011d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.619+0000 7f6065f84700 1 -- 172.21.15.72:0/2459885313 >> 172.21.15.72:0/2459885313 conn(0x7f60600a2f50 msgr2=0x7f606009f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.619+0000 7f6065f84700 1 -- 172.21.15.72:0/2459885313 shutdown_connections 2023-10-03T10:12:28.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.619+0000 7f6065f84700 1 -- 172.21.15.72:0/2459885313 wait complete. 2023-10-03T10:12:28.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2023-10-03T10:12:28.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.750+0000 7fea6410b700 1 Processor -- start 2023-10-03T10:12:28.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.751+0000 7fea6410b700 1 -- start start 2023-10-03T10:12:28.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.751+0000 7fea6410b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea5c09abf0 0x7fea5c09f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.751+0000 7fea6410b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea5c138de0 0x7fea5c13b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.751+0000 7fea6410b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5c06d9d0 con 0x7fea5c09e9d0 2023-10-03T10:12:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.751+0000 7fea6410b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5c06d760 con 0x7fea5c138de0 2023-10-03T10:12:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.751+0000 7fea6410b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c09a9f0 con 0x7fea5c09abf0 2023-10-03T10:12:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.751+0000 7fea616a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea5c09abf0 0x7fea5c09f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.751+0000 7fea626a8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea5c138de0 0x7fea5c13b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.751+0000 7fea61ea7700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fea5c09e9d0 0x7fea5c09eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36246/0 (socket says 172.21.15.72:36246) 2023-10-03T10:12:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.751+0000 7fea616a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea5c09abf0 0x7fea5c09f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58158/0 (socket says 172.21.15.72:58158) 2023-10-03T10:12:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.751+0000 7fea626a8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea5c138de0 0x7fea5c13b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37826/0 (socket says 172.21.15.72:37826) 2023-10-03T10:12:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.751+0000 7fea61ea7700 1 -- 172.21.15.72:0/2851752596 learned_addr learned my addr 172.21.15.72:0/2851752596 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea616a6700 1 -- 172.21.15.72:0/2851752596 >> v2:172.21.15.72:3300/0 conn(0x7fea5c138de0 msgr2=0x7fea5c13b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea616a6700 1 --2- 172.21.15.72:0/2851752596 >> v2:172.21.15.72:3300/0 conn(0x7fea5c138de0 0x7fea5c13b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea616a6700 1 -- 172.21.15.72:0/2851752596 >> v1:172.21.15.72:6789/0 conn(0x7fea5c09e9d0 legacy=0x7fea5c09eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea616a6700 1 -- 172.21.15.72:0/2851752596 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c06ced0 con 0x7fea5c09abf0 2023-10-03T10:12:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea60ea5700 1 -- 172.21.15.72:0/2851752596 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415433361 0 0) 0x7fea5c06d9d0 con 0x7fea5c09e9d0 2023-10-03T10:12:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea626a8700 1 --2- 172.21.15.72:0/2851752596 >> v2:172.21.15.72:3300/0 conn(0x7fea5c138de0 0x7fea5c13b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea616a6700 1 --2- 172.21.15.72:0/2851752596 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea5c09abf0 0x7fea5c09f4b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea58009840 tx=0x7fea58009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9b57f136e817800 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea60ea5700 1 -- 172.21.15.72:0/2851752596 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58011830 con 0x7fea5c09abf0 2023-10-03T10:12:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea60ea5700 1 -- 172.21.15.72:0/2851752596 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea58011990 con 0x7fea5c09abf0 2023-10-03T10:12:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea60ea5700 1 -- 172.21.15.72:0/2851752596 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58011d20 con 0x7fea5c09abf0 2023-10-03T10:12:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea6410b700 1 -- 172.21.15.72:0/2851752596 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea5c09abf0 msgr2=0x7fea5c09f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea6410b700 1 --2- 172.21.15.72:0/2851752596 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea5c09abf0 0x7fea5c09f4b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea58009840 tx=0x7fea58009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea6410b700 1 -- 172.21.15.72:0/2851752596 shutdown_connections 2023-10-03T10:12:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea6410b700 1 --2- 172.21.15.72:0/2851752596 >> v2:172.21.15.72:3300/0 conn(0x7fea5c138de0 0x7fea5c13b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea6410b700 1 --2- 172.21.15.72:0/2851752596 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea5c09abf0 0x7fea5c09f4b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.752+0000 7fea6410b700 1 -- 172.21.15.72:0/2851752596 >> 172.21.15.72:0/2851752596 conn(0x7fea5c0a43f0 msgr2=0x7fea5c0a47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.753+0000 7fea6410b700 1 -- 172.21.15.72:0/2851752596 shutdown_connections 2023-10-03T10:12:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.753+0000 7fea6410b700 1 -- 172.21.15.72:0/2851752596 wait complete. 2023-10-03T10:12:28.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.753+0000 7fea6410b700 1 Processor -- start 2023-10-03T10:12:28.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.753+0000 7fea6410b700 1 -- start start 2023-10-03T10:12:28.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea6410b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea5c09abf0 0x7fea5c1208e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea6410b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea5c09e9d0 0x7fea5c120e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea6410b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea5c138de0 0x7fea5c121360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:28.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea6410b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c06dd10 con 0x7fea5c138de0 2023-10-03T10:12:28.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea6410b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0a33a0 con 0x7fea5c09abf0 2023-10-03T10:12:28.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea6410b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c123b40 con 0x7fea5c09e9d0 2023-10-03T10:12:28.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea61ea7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea5c09abf0 0x7fea5c1208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea616a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea5c09e9d0 0x7fea5c120e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea616a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea5c09e9d0 0x7fea5c120e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58172/0 (socket says 172.21.15.72:58172) 2023-10-03T10:12:28.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea626a8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea5c138de0 0x7fea5c121360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:28.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea616a6700 1 -- 172.21.15.72:0/1213433931 learned_addr learned my addr 172.21.15.72:0/1213433931 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:28.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea626a8700 1 -- 172.21.15.72:0/1213433931 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea5c09e9d0 msgr2=0x7fea5c120e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea626a8700 1 --2- 172.21.15.72:0/1213433931 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea5c09e9d0 0x7fea5c120e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea626a8700 1 -- 172.21.15.72:0/1213433931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea5c09abf0 msgr2=0x7fea5c1208e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea626a8700 1 --2- 172.21.15.72:0/1213433931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea5c09abf0 0x7fea5c1208e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea626a8700 1 -- 172.21.15.72:0/1213433931 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea54009a70 con 0x7fea5c138de0 2023-10-03T10:12:28.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea616a6700 1 --2- 172.21.15.72:0/1213433931 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea5c09e9d0 0x7fea5c120e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:28.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea61ea7700 1 --2- 172.21.15.72:0/1213433931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea5c09abf0 0x7fea5c1208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:28.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea626a8700 1 --2- 172.21.15.72:0/1213433931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea5c138de0 0x7fea5c121360 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea5400b6a0 tx=0x7fea5400b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:28.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.754+0000 7fea527fc700 1 -- 172.21.15.72:0/1213433931 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54019070 con 0x7fea5c138de0 2023-10-03T10:12:28.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.755+0000 7fea527fc700 1 -- 172.21.15.72:0/1213433931 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea54003a20 con 0x7fea5c138de0 2023-10-03T10:12:28.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.755+0000 7fea6410b700 1 -- 172.21.15.72:0/1213433931 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea580094a0 con 0x7fea5c138de0 2023-10-03T10:12:28.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.755+0000 7fea527fc700 1 -- 172.21.15.72:0/1213433931 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54009cc0 con 0x7fea5c138de0 2023-10-03T10:12:28.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.755+0000 7fea6410b700 1 -- 172.21.15.72:0/1213433931 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c122c90 con 0x7fea5c138de0 2023-10-03T10:12:28.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.755+0000 7fea6410b700 1 -- 172.21.15.72:0/1213433931 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5c123d10 con 0x7fea5c138de0 2023-10-03T10:12:28.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.756+0000 7fea527fc700 1 -- 172.21.15.72:0/1213433931 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fea54007540 con 0x7fea5c138de0 2023-10-03T10:12:28.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.756+0000 7fea527fc700 1 -- 172.21.15.72:0/1213433931 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fea540489b0 con 0x7fea5c138de0 2023-10-03T10:12:28.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.760+0000 7fea527fc700 1 -- 172.21.15.72:0/1213433931 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea540077f0 con 0x7fea5c138de0 2023-10-03T10:12:28.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.943+0000 7fea6410b700 1 -- 172.21.15.72:0/1213433931 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7fea5c04f2a0 con 0x7fea5c138de0 2023-10-03T10:12:28.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.944+0000 7fea527fc700 1 -- 172.21.15.72:0/1213433931 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v34) v1 ==== 59+0+37 (secure 0 0 0) 0x7fea54024310 con 0x7fea5c138de0 2023-10-03T10:12:28.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.946+0000 7fea6410b700 1 -- 172.21.15.72:0/1213433931 >> v1:172.21.15.72:6816/126756 conn(0x7fea4002f510 legacy=0x7fea400319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.946+0000 7fea6410b700 1 -- 172.21.15.72:0/1213433931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea5c138de0 msgr2=0x7fea5c121360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:28.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.946+0000 7fea6410b700 1 --2- 172.21.15.72:0/1213433931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea5c138de0 0x7fea5c121360 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea5400b6a0 tx=0x7fea5400b9b0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.946+0000 7fea6410b700 1 -- 172.21.15.72:0/1213433931 shutdown_connections 2023-10-03T10:12:28.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.946+0000 7fea6410b700 1 --2- 172.21.15.72:0/1213433931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea5c138de0 0x7fea5c121360 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.946+0000 7fea6410b700 1 --2- 172.21.15.72:0/1213433931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea5c09abf0 0x7fea5c1208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.946+0000 7fea6410b700 1 --2- 172.21.15.72:0/1213433931 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea5c09e9d0 0x7fea5c120e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:28.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.946+0000 7fea6410b700 1 -- 172.21.15.72:0/1213433931 >> 172.21.15.72:0/1213433931 conn(0x7fea5c0a43f0 msgr2=0x7fea5c0a1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:28.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.946+0000 7fea6410b700 1 -- 172.21.15.72:0/1213433931 shutdown_connections 2023-10-03T10:12:28.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:28.946+0000 7fea6410b700 1 -- 172.21.15.72:0/1213433931 wait complete. 2023-10-03T10:12:29.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.053+0000 7f75d9a07700 1 Processor -- start 2023-10-03T10:12:29.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.053+0000 7f75d9a07700 1 -- start start 2023-10-03T10:12:29.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d9a07700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75d409e430 0x7f75d4135a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d9a07700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75d4135f70 0x7f75d4138350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d9a07700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d409bd00 con 0x7f75d409d950 2023-10-03T10:12:29.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d9a07700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d409f510 con 0x7f75d409e430 2023-10-03T10:12:29.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d9a07700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d409ac70 con 0x7f75d4135f70 2023-10-03T10:12:29.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d27fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75d409e430 0x7f75d4135a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75d4135f70 0x7f75d4138350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d27fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75d409e430 0x7f75d4135a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37846/0 (socket says 172.21.15.72:37846) 2023-10-03T10:12:29.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75d4135f70 0x7f75d4138350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34082/0 (socket says 172.21.15.72:34082) 2023-10-03T10:12:29.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d2ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f75d409d950 0x7f75d409dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36252/0 (socket says 172.21.15.72:36252) 2023-10-03T10:12:29.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d27fc700 1 -- 172.21.15.72:0/2612074591 learned_addr learned my addr 172.21.15.72:0/2612074591 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:29.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d37fe700 1 -- 172.21.15.72:0/2612074591 >> v2:172.21.15.72:3300/0 conn(0x7f75d409e430 msgr2=0x7f75d4135a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:29.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d37fe700 1 --2- 172.21.15.72:0/2612074591 >> v2:172.21.15.72:3300/0 conn(0x7f75d409e430 0x7f75d4135a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d37fe700 1 -- 172.21.15.72:0/2612074591 >> v1:172.21.15.72:6789/0 conn(0x7f75d409d950 legacy=0x7f75d409dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d37fe700 1 -- 172.21.15.72:0/2612074591 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d409a350 con 0x7f75d4135f70 2023-10-03T10:12:29.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d1ffb700 1 -- 172.21.15.72:0/2612074591 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224300673 0 0) 0x7f75d409bd00 con 0x7f75d409d950 2023-10-03T10:12:29.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d27fc700 1 --2- 172.21.15.72:0/2612074591 >> v2:172.21.15.72:3300/0 conn(0x7f75d409e430 0x7f75d4135a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:29.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d37fe700 1 --2- 172.21.15.72:0/2612074591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75d4135f70 0x7f75d4138350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009d90 tx=0x7f75cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ef325b07e93f092 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d1ffb700 1 -- 172.21.15.72:0/2612074591 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00e070 con 0x7f75d4135f70 2023-10-03T10:12:29.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d1ffb700 1 -- 172.21.15.72:0/2612074591 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75cc00bb20 con 0x7f75d4135f70 2023-10-03T10:12:29.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.054+0000 7f75d1ffb700 1 -- 172.21.15.72:0/2612074591 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc012430 con 0x7f75d4135f70 2023-10-03T10:12:29.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.055+0000 7f75d9a07700 1 -- 172.21.15.72:0/2612074591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75d4135f70 msgr2=0x7f75d4138350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.055+0000 7f75d9a07700 1 --2- 172.21.15.72:0/2612074591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75d4135f70 0x7f75d4138350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009d90 tx=0x7f75cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:29.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.055+0000 7f75d9a07700 1 -- 172.21.15.72:0/2612074591 shutdown_connections 2023-10-03T10:12:29.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.055+0000 7f75d9a07700 1 --2- 172.21.15.72:0/2612074591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75d4135f70 0x7f75d4138350 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.055+0000 7f75d9a07700 1 --2- 172.21.15.72:0/2612074591 >> v2:172.21.15.72:3300/0 conn(0x7f75d409e430 0x7f75d4135a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.055+0000 7f75d9a07700 1 -- 172.21.15.72:0/2612074591 >> 172.21.15.72:0/2612074591 conn(0x7f75d40a2f50 msgr2=0x7f75d40a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.055+0000 7f75d9a07700 1 -- 172.21.15.72:0/2612074591 shutdown_connections 2023-10-03T10:12:29.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.055+0000 7f75d9a07700 1 -- 172.21.15.72:0/2612074591 wait complete. 2023-10-03T10:12:29.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.056+0000 7f75d9a07700 1 Processor -- start 2023-10-03T10:12:29.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.056+0000 7f75d9a07700 1 -- start start 2023-10-03T10:12:29.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.056+0000 7f75d9a07700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75d409d950 0x7f75d406e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.056+0000 7f75d9a07700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75d409e430 0x7f75d406ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.056+0000 7f75d9a07700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4135f70 0x7f75d41c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.056+0000 7f75d9a07700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d4123280 con 0x7f75d4135f70 2023-10-03T10:12:29.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.056+0000 7f75d9a07700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d406e3c0 con 0x7f75d409e430 2023-10-03T10:12:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.056+0000 7f75d9a07700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75d4121fe0 con 0x7f75d409d950 2023-10-03T10:12:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.056+0000 7f75d2ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75d409d950 0x7f75d406e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75d37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4135f70 0x7f75d41c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75d27fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75d409e430 0x7f75d406ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75d2ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75d409d950 0x7f75d406e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58178/0 (socket says 172.21.15.72:58178) 2023-10-03T10:12:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75d2ffd700 1 -- 172.21.15.72:0/851225381 learned_addr learned my addr 172.21.15.72:0/851225381 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75d27fc700 1 -- 172.21.15.72:0/851225381 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75d409d950 msgr2=0x7f75d406e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75d27fc700 1 --2- 172.21.15.72:0/851225381 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75d409d950 0x7f75d406e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75d27fc700 1 -- 172.21.15.72:0/851225381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4135f70 msgr2=0x7f75d41c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75d27fc700 1 --2- 172.21.15.72:0/851225381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4135f70 0x7f75d41c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75d27fc700 1 -- 172.21.15.72:0/851225381 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c4009500 con 0x7f75d409e430 2023-10-03T10:12:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75d37fe700 1 --2- 172.21.15.72:0/851225381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4135f70 0x7f75d41c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75d27fc700 1 --2- 172.21.15.72:0/851225381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75d409e430 0x7f75d406ed90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f75c400ebe0 tx=0x7f75c400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75bbfff700 1 -- 172.21.15.72:0/851225381 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4005a20 con 0x7f75d409e430 2023-10-03T10:12:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75bbfff700 1 -- 172.21.15.72:0/851225381 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c4005b80 con 0x7f75d409e430 2023-10-03T10:12:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75bbfff700 1 -- 172.21.15.72:0/851225381 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400c850 con 0x7f75d409e430 2023-10-03T10:12:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75d9a07700 1 -- 172.21.15.72:0/851225381 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc009a70 con 0x7f75d409e430 2023-10-03T10:12:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.057+0000 7f75d9a07700 1 -- 172.21.15.72:0/851225381 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d409cb00 con 0x7f75d409e430 2023-10-03T10:12:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.058+0000 7f75bbfff700 1 -- 172.21.15.72:0/851225381 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f75c400c9b0 con 0x7f75d409e430 2023-10-03T10:12:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.058+0000 7f75bbfff700 1 -- 172.21.15.72:0/851225381 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f75c403ff70 con 0x7f75d409e430 2023-10-03T10:12:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.058+0000 7f75d9a07700 1 -- 172.21.15.72:0/851225381 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d406f390 con 0x7f75d409e430 2023-10-03T10:12:29.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.063+0000 7f75bbfff700 1 -- 172.21.15.72:0/851225381 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75c4022710 con 0x7f75d409e430 2023-10-03T10:12:29.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.245+0000 7f75d9a07700 1 -- 172.21.15.72:0/851225381 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f75d404f2a0 con 0x7f75d409e430 2023-10-03T10:12:29.603 INFO:tasks.ceph.mgr.x.smithi072.stderr:terminate called recursively 2023-10-03T10:12:29.603 INFO:tasks.ceph.mgr.x.smithi072.stderr:terminate called after throwing an instance of 'ceph::buffer::v15_2_0::end_of_buffer' 2023-10-03T10:12:29.603 INFO:tasks.ceph.mgr.x.smithi072.stderr: what(): End of buffer [buffer:2] 2023-10-03T10:12:29.603 INFO:tasks.ceph.mgr.x.smithi072.stderr:*** Caught signal (Aborted) ** 2023-10-03T10:12:29.603 INFO:tasks.ceph.mgr.x.smithi072.stderr: in thread 7f6a5fc8c700 thread_name:ms_dispatch 2023-10-03T10:12:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.607+0000 7f75bbfff700 1 -- 172.21.15.72:0/851225381 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v35) v1 ==== 153+0+0 (secure 0 0 0) 0x7f75c402a0b0 con 0x7f75d409e430 2023-10-03T10:12:29.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.611+0000 7f75d9a07700 1 -- 172.21.15.72:0/851225381 >> v1:172.21.15.72:6816/126756 conn(0x7f75c002f510 legacy=0x7f75c00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.611+0000 7f75d9a07700 1 -- 172.21.15.72:0/851225381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75d409e430 msgr2=0x7f75d406ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.611+0000 7f75d9a07700 1 --2- 172.21.15.72:0/851225381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75d409e430 0x7f75d406ed90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f75c400ebe0 tx=0x7f75c400eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.611+0000 7f75d9a07700 1 -- 172.21.15.72:0/851225381 shutdown_connections 2023-10-03T10:12:29.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.611+0000 7f75d9a07700 1 --2- 172.21.15.72:0/851225381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75d4135f70 0x7f75d41c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.611+0000 7f75d9a07700 1 --2- 172.21.15.72:0/851225381 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75d409d950 0x7f75d406e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.611+0000 7f75d9a07700 1 --2- 172.21.15.72:0/851225381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75d409e430 0x7f75d406ed90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.611+0000 7f75d9a07700 1 -- 172.21.15.72:0/851225381 >> 172.21.15.72:0/851225381 conn(0x7f75d40a2f50 msgr2=0x7f75d4070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.611+0000 7f75d9a07700 1 -- 172.21.15.72:0/851225381 shutdown_connections 2023-10-03T10:12:29.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.611+0000 7f75d9a07700 1 -- 172.21.15.72:0/851225381 wait complete. 2023-10-03T10:12:29.612 INFO:teuthology.orchestra.run.smithi072.stderr:set pool 1 pg_autoscale_mode to off 2023-10-03T10:12:29.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.726+0000 7ff701d35700 1 Processor -- start 2023-10-03T10:12:29.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.726+0000 7ff701d35700 1 -- start start 2023-10-03T10:12:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.726+0000 7ff701d35700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6fc09e9d0 0x7ff6fc09eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff701d35700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6fc09f6e0 0x7ff6fc131ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff701d35700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc09ab50 con 0x7ff6fc09f2e0 2023-10-03T10:12:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff701d35700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc0a0140 con 0x7ff6fc09e9d0 2023-10-03T10:12:29.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff701d35700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0a0330 con 0x7ff6fc09f6e0 2023-10-03T10:12:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff6fbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6fc09f6e0 0x7ff6fc131ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff6fb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6fc09e9d0 0x7ff6fc09eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff6faffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff6fc09f2e0 0x7ff6fc1317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36260/0 (socket says 172.21.15.72:36260) 2023-10-03T10:12:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff6fbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6fc09f6e0 0x7ff6fc131ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34098/0 (socket says 172.21.15.72:34098) 2023-10-03T10:12:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff6faffd700 1 -- 172.21.15.72:0/1031935713 learned_addr learned my addr 172.21.15.72:0/1031935713 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff6fb7fe700 1 -- 172.21.15.72:0/1031935713 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6fc09f6e0 msgr2=0x7ff6fc131ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff6fb7fe700 1 --2- 172.21.15.72:0/1031935713 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6fc09f6e0 0x7ff6fc131ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff6fb7fe700 1 -- 172.21.15.72:0/1031935713 >> v1:172.21.15.72:6789/0 conn(0x7ff6fc09f2e0 legacy=0x7ff6fc1317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff6fb7fe700 1 -- 172.21.15.72:0/1031935713 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc06ef60 con 0x7ff6fc09e9d0 2023-10-03T10:12:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff6fbfff700 1 --2- 172.21.15.72:0/1031935713 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6fc09f6e0 0x7ff6fc131ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff6fb7fe700 1 --2- 172.21.15.72:0/1031935713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6fc09e9d0 0x7ff6fc09eda0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00dc60 tx=0x7ff6ec00df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e04bd489a3b728c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff6fa7fc700 1 -- 172.21.15.72:0/1031935713 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec012070 con 0x7ff6fc09e9d0 2023-10-03T10:12:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff6fa7fc700 1 -- 172.21.15.72:0/1031935713 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec00d2e0 con 0x7ff6fc09e9d0 2023-10-03T10:12:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.727+0000 7ff6fa7fc700 1 -- 172.21.15.72:0/1031935713 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00f900 con 0x7ff6fc09e9d0 2023-10-03T10:12:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.728+0000 7ff701d35700 1 -- 172.21.15.72:0/1031935713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6fc09e9d0 msgr2=0x7ff6fc09eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.728+0000 7ff701d35700 1 --2- 172.21.15.72:0/1031935713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6fc09e9d0 0x7ff6fc09eda0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec00dc60 tx=0x7ff6ec00df70 comp rx=0 tx=0).stop 2023-10-03T10:12:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.728+0000 7ff701d35700 1 -- 172.21.15.72:0/1031935713 shutdown_connections 2023-10-03T10:12:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.728+0000 7ff701d35700 1 --2- 172.21.15.72:0/1031935713 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6fc09f6e0 0x7ff6fc131ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.728+0000 7ff701d35700 1 --2- 172.21.15.72:0/1031935713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6fc09e9d0 0x7ff6fc09eda0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.728+0000 7ff701d35700 1 -- 172.21.15.72:0/1031935713 >> 172.21.15.72:0/1031935713 conn(0x7ff6fc0a43f0 msgr2=0x7ff6fc0a47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.728+0000 7ff701d35700 1 -- 172.21.15.72:0/1031935713 shutdown_connections 2023-10-03T10:12:29.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.728+0000 7ff701d35700 1 -- 172.21.15.72:0/1031935713 wait complete. 2023-10-03T10:12:29.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.729+0000 7ff701d35700 1 Processor -- start 2023-10-03T10:12:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.729+0000 7ff701d35700 1 -- start start 2023-10-03T10:12:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff701d35700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6fc09e9d0 0x7ff6fc11e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff701d35700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6fc09f2e0 0x7ff6fc11e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff701d35700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6fc09f6e0 0x7ff6fc11ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff701d35700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc11f4a0 con 0x7ff6fc09f6e0 2023-10-03T10:12:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff701d35700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc121a50 con 0x7ff6fc09f2e0 2023-10-03T10:12:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff701d35700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc11fb40 con 0x7ff6fc09e9d0 2023-10-03T10:12:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff6fb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6fc09e9d0 0x7ff6fc11e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff6faffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6fc09f2e0 0x7ff6fc11e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff6fb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6fc09e9d0 0x7ff6fc11e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58186/0 (socket says 172.21.15.72:58186) 2023-10-03T10:12:29.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff6fb7fe700 1 -- 172.21.15.72:0/226513228 learned_addr learned my addr 172.21.15.72:0/226513228 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:29.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff6fbfff700 1 --2- 172.21.15.72:0/226513228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6fc09f6e0 0x7ff6fc11ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:29.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff6faffd700 1 -- 172.21.15.72:0/226513228 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6fc09e9d0 msgr2=0x7ff6fc11e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff6faffd700 1 --2- 172.21.15.72:0/226513228 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6fc09e9d0 0x7ff6fc11e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff6faffd700 1 -- 172.21.15.72:0/226513228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6fc09f6e0 msgr2=0x7ff6fc11ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:29.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff6faffd700 1 --2- 172.21.15.72:0/226513228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6fc09f6e0 0x7ff6fc11ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:29.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff6faffd700 1 -- 172.21.15.72:0/226513228 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f4009a70 con 0x7ff6fc09f2e0 2023-10-03T10:12:29.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff6fb7fe700 1 --2- 172.21.15.72:0/226513228 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6fc09e9d0 0x7ff6fc11e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:29.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff6faffd700 1 --2- 172.21.15.72:0/226513228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6fc09f2e0 0x7ff6fc11e550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000c560 tx=0x7ff6f000c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:29.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff6e3fff700 1 -- 172.21.15.72:0/226513228 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0005d70 con 0x7ff6fc09f2e0 2023-10-03T10:12:29.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff6e3fff700 1 -- 172.21.15.72:0/226513228 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f000ce80 con 0x7ff6fc09f2e0 2023-10-03T10:12:29.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.730+0000 7ff701d35700 1 -- 172.21.15.72:0/226513228 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ec00d940 con 0x7ff6fc09f2e0 2023-10-03T10:12:29.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.731+0000 7ff6e3fff700 1 -- 172.21.15.72:0/226513228 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00072d0 con 0x7ff6fc09f2e0 2023-10-03T10:12:29.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.731+0000 7ff701d35700 1 -- 172.21.15.72:0/226513228 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc1214b0 con 0x7ff6fc09f2e0 2023-10-03T10:12:29.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.731+0000 7ff6e3fff700 1 -- 172.21.15.72:0/226513228 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff6f0007430 con 0x7ff6fc09f2e0 2023-10-03T10:12:29.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.731+0000 7ff6e3fff700 1 -- 172.21.15.72:0/226513228 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ff6f003efd0 con 0x7ff6fc09f2e0 2023-10-03T10:12:29.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.732+0000 7ff701d35700 1 -- 172.21.15.72:0/226513228 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc0a3500 con 0x7ff6fc09f2e0 2023-10-03T10:12:29.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.736+0000 7ff6e3fff700 1 -- 172.21.15.72:0/226513228 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6f0017070 con 0x7ff6fc09f2e0 2023-10-03T10:12:29.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.854+0000 7ff6fb7fe700 1 -- 172.21.15.72:0/226513228 >> v1:172.21.15.72:6816/126756 conn(0x7ff6e802f510 legacy=0x7ff6e80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk reading from fd=16 : -104 Unknown error -104 2023-10-03T10:12:29.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.854+0000 7ff6fb7fe700 1 -- 172.21.15.72:0/226513228 >> v1:172.21.15.72:6816/126756 conn(0x7ff6e802f510 legacy=0x7ff6e80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T10:12:29.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.854+0000 7ff6fb7fe700 1 --1- 172.21.15.72:0/226513228 >> v1:172.21.15.72:6816/126756 conn(0x7ff6e802f510 0x7ff6e80319c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify read banner and identify addresses failed 2023-10-03T10:12:29.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.854+0000 7ff6fb7fe700 1 --1- 172.21.15.72:0/226513228 >> v1:172.21.15.72:6816/126756 conn(0x7ff6e802f510 0x7ff6e80319c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).fault on lossy channel, failing 2023-10-03T10:12:29.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.854+0000 7ff6e3fff700 1 -- 172.21.15.72:0/226513228 >> v1:172.21.15.72:6816/126756 conn(0x7ff6e802f510 legacy=0x7ff6e80319c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T10:12:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:29.926+0000 7ff701d35700 1 -- 172.21.15.72:0/226513228 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7ff6d40051e0 con 0x7ff6fc09f2e0 2023-10-03T10:12:30.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.609+0000 7ff6e3fff700 1 -- 172.21.15.72:0/226513228 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v36) v1 ==== 152+0+0 (secure 0 0 0) 0x7ff6f001b3b0 con 0x7ff6fc09f2e0 2023-10-03T10:12:30.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.612+0000 7ff701d35700 1 -- 172.21.15.72:0/226513228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6fc09f2e0 msgr2=0x7ff6fc11e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.613+0000 7ff701d35700 1 --2- 172.21.15.72:0/226513228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6fc09f2e0 0x7ff6fc11e550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000c560 tx=0x7ff6f000c870 comp rx=0 tx=0).stop 2023-10-03T10:12:30.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.614+0000 7ff701d35700 1 -- 172.21.15.72:0/226513228 shutdown_connections 2023-10-03T10:12:30.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.614+0000 7ff701d35700 1 --2- 172.21.15.72:0/226513228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6fc09f6e0 0x7ff6fc11ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.614+0000 7ff701d35700 1 --2- 172.21.15.72:0/226513228 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6fc09e9d0 0x7ff6fc11e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.614+0000 7ff701d35700 1 --2- 172.21.15.72:0/226513228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6fc09f2e0 0x7ff6fc11e550 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.614+0000 7ff701d35700 1 -- 172.21.15.72:0/226513228 >> 172.21.15.72:0/226513228 conn(0x7ff6fc0a43f0 msgr2=0x7ff6fc131b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:30.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.614+0000 7ff701d35700 1 -- 172.21.15.72:0/226513228 shutdown_connections 2023-10-03T10:12:30.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.614+0000 7ff701d35700 1 -- 172.21.15.72:0/226513228 wait complete. 2023-10-03T10:12:30.615 INFO:teuthology.orchestra.run.smithi072.stderr:set pool 2 pg_autoscale_mode to off 2023-10-03T10:12:30.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.729+0000 7fbfd3083700 1 Processor -- start 2023-10-03T10:12:30.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.729+0000 7fbfd3083700 1 -- start start 2023-10-03T10:12:30.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.729+0000 7fbfd3083700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbfcc09e9d0 0x7fbfcc09eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfd3083700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfcc09f2e0 0x7fbfcc133ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfd3083700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfcc1340e0 0x7fbfcc134540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfd3083700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfcc06d7d0 con 0x7fbfcc09e9d0 2023-10-03T10:12:30.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfd3083700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc06db50 con 0x7fbfcc09f2e0 2023-10-03T10:12:30.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfd3083700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc09ae00 con 0x7fbfcc1340e0 2023-10-03T10:12:30.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfcbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfcc09f2e0 0x7fbfcc133ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfd0e1f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbfcc09e9d0 0x7fbfcc09eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfd1620700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfcc1340e0 0x7fbfcc134540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfd1620700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfcc1340e0 0x7fbfcc134540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58200/0 (socket says 172.21.15.72:58200) 2023-10-03T10:12:30.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfcbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfcc09f2e0 0x7fbfcc133ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34106/0 (socket says 172.21.15.72:34106) 2023-10-03T10:12:30.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfd0e1f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbfcc09e9d0 0x7fbfcc09eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37890/0 (socket says 172.21.15.72:37890) 2023-10-03T10:12:30.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfcbfff700 1 -- 172.21.15.72:0/927390776 learned_addr learned my addr 172.21.15.72:0/927390776 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:30.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfcbfff700 1 -- 172.21.15.72:0/927390776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfcc1340e0 msgr2=0x7fbfcc134540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:30.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfcbfff700 1 --2- 172.21.15.72:0/927390776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfcc1340e0 0x7fbfcc134540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfcbfff700 1 -- 172.21.15.72:0/927390776 >> v2:172.21.15.72:3300/0 conn(0x7fbfcc09e9d0 msgr2=0x7fbfcc09eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:30.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfcbfff700 1 --2- 172.21.15.72:0/927390776 >> v2:172.21.15.72:3300/0 conn(0x7fbfcc09e9d0 0x7fbfcc09eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfcbfff700 1 -- 172.21.15.72:0/927390776 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc06cb10 con 0x7fbfcc09f2e0 2023-10-03T10:12:30.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfd1620700 1 --2- 172.21.15.72:0/927390776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfcc1340e0 0x7fbfcc134540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:30.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfd0e1f700 1 --2- 172.21.15.72:0/927390776 >> v2:172.21.15.72:3300/0 conn(0x7fbfcc09e9d0 0x7fbfcc09eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:30.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfcbfff700 1 --2- 172.21.15.72:0/927390776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfcc09f2e0 0x7fbfcc133ba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009920 tx=0x7fbfb8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cf6e42b5620e87f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:30.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfcb7fe700 1 -- 172.21.15.72:0/927390776 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8011830 con 0x7fbfcc09f2e0 2023-10-03T10:12:30.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfcb7fe700 1 -- 172.21.15.72:0/927390776 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb8011990 con 0x7fbfcc09f2e0 2023-10-03T10:12:30.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.730+0000 7fbfcb7fe700 1 -- 172.21.15.72:0/927390776 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8011d20 con 0x7fbfcc09f2e0 2023-10-03T10:12:30.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.731+0000 7fbfd3083700 1 -- 172.21.15.72:0/927390776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfcc09f2e0 msgr2=0x7fbfcc133ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.731+0000 7fbfd3083700 1 --2- 172.21.15.72:0/927390776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfcc09f2e0 0x7fbfcc133ba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009920 tx=0x7fbfb8009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:30.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.731+0000 7fbfd3083700 1 -- 172.21.15.72:0/927390776 shutdown_connections 2023-10-03T10:12:30.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.731+0000 7fbfd3083700 1 --2- 172.21.15.72:0/927390776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfcc1340e0 0x7fbfcc134540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.731+0000 7fbfd3083700 1 --2- 172.21.15.72:0/927390776 >> v2:172.21.15.72:3300/0 conn(0x7fbfcc09e9d0 0x7fbfcc09eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.731+0000 7fbfd3083700 1 --2- 172.21.15.72:0/927390776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfcc09f2e0 0x7fbfcc133ba0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.731+0000 7fbfd3083700 1 -- 172.21.15.72:0/927390776 >> 172.21.15.72:0/927390776 conn(0x7fbfcc0a43c0 msgr2=0x7fbfcc0a47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:30.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.731+0000 7fbfd3083700 1 -- 172.21.15.72:0/927390776 shutdown_connections 2023-10-03T10:12:30.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.731+0000 7fbfd3083700 1 -- 172.21.15.72:0/927390776 wait complete. 2023-10-03T10:12:30.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.732+0000 7fbfd3083700 1 Processor -- start 2023-10-03T10:12:30.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.732+0000 7fbfd3083700 1 -- start start 2023-10-03T10:12:30.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.732+0000 7fbfd3083700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfcc09e9d0 0x7fbfcc122ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.732+0000 7fbfd3083700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfcc09f2e0 0x7fbfcc122ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.732+0000 7fbfd3083700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfcc1340e0 0x7fbfcc123530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:30.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.732+0000 7fbfd3083700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc126230 con 0x7fbfcc09f2e0 2023-10-03T10:12:30.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.732+0000 7fbfd3083700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc124e90 con 0x7fbfcc09e9d0 2023-10-03T10:12:30.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.732+0000 7fbfd3083700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc09b6f0 con 0x7fbfcc1340e0 2023-10-03T10:12:30.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.732+0000 7fbfd0e1f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfcc09e9d0 0x7fbfcc122ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.732+0000 7fbfd1620700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfcc1340e0 0x7fbfcc123530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.732+0000 7fbfd0e1f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfcc09e9d0 0x7fbfcc122ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34114/0 (socket says 172.21.15.72:34114) 2023-10-03T10:12:30.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.732+0000 7fbfd0e1f700 1 -- 172.21.15.72:0/1869616956 learned_addr learned my addr 172.21.15.72:0/1869616956 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:30.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.733+0000 7fbfcbfff700 1 --2- 172.21.15.72:0/1869616956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfcc09f2e0 0x7fbfcc122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:30.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.733+0000 7fbfd0e1f700 1 -- 172.21.15.72:0/1869616956 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfcc1340e0 msgr2=0x7fbfcc123530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.733+0000 7fbfd0e1f700 1 --2- 172.21.15.72:0/1869616956 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfcc1340e0 0x7fbfcc123530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.733+0000 7fbfd0e1f700 1 -- 172.21.15.72:0/1869616956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfcc09f2e0 msgr2=0x7fbfcc122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:30.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.733+0000 7fbfd0e1f700 1 --2- 172.21.15.72:0/1869616956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfcc09f2e0 0x7fbfcc122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:30.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.733+0000 7fbfd0e1f700 1 -- 172.21.15.72:0/1869616956 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc00094a0 con 0x7fbfcc09e9d0 2023-10-03T10:12:30.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.733+0000 7fbfcbfff700 1 --2- 172.21.15.72:0/1869616956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfcc09f2e0 0x7fbfcc122ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:30.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.733+0000 7fbfd1620700 1 --2- 172.21.15.72:0/1869616956 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfcc1340e0 0x7fbfcc123530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:30.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.733+0000 7fbfd0e1f700 1 --2- 172.21.15.72:0/1869616956 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfcc09e9d0 0x7fbfcc122ab0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000ec10 tx=0x7fbfc000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:30.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.733+0000 7fbfc97fa700 1 -- 172.21.15.72:0/1869616956 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc000c850 con 0x7fbfcc09e9d0 2023-10-03T10:12:30.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.733+0000 7fbfc97fa700 1 -- 172.21.15.72:0/1869616956 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc000c9b0 con 0x7fbfcc09e9d0 2023-10-03T10:12:30.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.733+0000 7fbfc97fa700 1 -- 172.21.15.72:0/1869616956 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc000cd20 con 0x7fbfcc09e9d0 2023-10-03T10:12:30.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.733+0000 7fbfd3083700 1 -- 172.21.15.72:0/1869616956 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc4009a70 con 0x7fbfcc09e9d0 2023-10-03T10:12:30.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.733+0000 7fbfd3083700 1 -- 172.21.15.72:0/1869616956 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb8009550 con 0x7fbfcc09e9d0 2023-10-03T10:12:30.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.734+0000 7fbfd3083700 1 -- 172.21.15.72:0/1869616956 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfcc133570 con 0x7fbfcc09e9d0 2023-10-03T10:12:30.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.734+0000 7fbfc97fa700 1 -- 172.21.15.72:0/1869616956 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbfc0013470 con 0x7fbfcc09e9d0 2023-10-03T10:12:30.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.735+0000 7fbfc97fa700 1 -- 172.21.15.72:0/1869616956 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fbfc0040450 con 0x7fbfcc09e9d0 2023-10-03T10:12:30.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.735+0000 7fbfcbfff700 1 -- 172.21.15.72:0/1869616956 >> v1:172.21.15.72:6816/126756 conn(0x7fbfb002f510 legacy=0x7fbfb00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:30.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.739+0000 7fbfc97fa700 1 -- 172.21.15.72:0/1869616956 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfc0013720 con 0x7fbfcc09e9d0 2023-10-03T10:12:30.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.922+0000 7fbfd3083700 1 -- 172.21.15.72:0/1869616956 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fbfcc04f2a0 con 0x7fbfcc09e9d0 2023-10-03T10:12:30.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:30.936+0000 7fbfcbfff700 1 -- 172.21.15.72:0/1869616956 >> v1:172.21.15.72:6816/126756 conn(0x7fbfb002f510 legacy=0x7fbfb00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:31.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.337+0000 7fbfcbfff700 1 -- 172.21.15.72:0/1869616956 >> v1:172.21.15.72:6816/126756 conn(0x7fbfb002f510 legacy=0x7fbfb00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:31.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.620+0000 7fbfc97fa700 1 -- 172.21.15.72:0/1869616956 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v37) v1 ==== 164+0+0 (secure 0 0 0) 0x7fbfc001acb0 con 0x7fbfcc09e9d0 2023-10-03T10:12:31.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.623+0000 7fbfd3083700 1 -- 172.21.15.72:0/1869616956 >> v1:172.21.15.72:6816/126756 conn(0x7fbfb002f510 legacy=0x7fbfb00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:31.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.623+0000 7fbfd3083700 1 -- 172.21.15.72:0/1869616956 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfcc09e9d0 msgr2=0x7fbfcc122ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.623+0000 7fbfd3083700 1 --2- 172.21.15.72:0/1869616956 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfcc09e9d0 0x7fbfcc122ab0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000ec10 tx=0x7fbfc000ef20 comp rx=0 tx=0).stop 2023-10-03T10:12:31.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.624+0000 7fbfd3083700 1 -- 172.21.15.72:0/1869616956 shutdown_connections 2023-10-03T10:12:31.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.624+0000 7fbfd3083700 1 --2- 172.21.15.72:0/1869616956 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfcc1340e0 0x7fbfcc123530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.624+0000 7fbfd3083700 1 --2- 172.21.15.72:0/1869616956 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfcc09e9d0 0x7fbfcc122ab0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.624+0000 7fbfd3083700 1 --2- 172.21.15.72:0/1869616956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfcc09f2e0 0x7fbfcc122ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.624+0000 7fbfd3083700 1 -- 172.21.15.72:0/1869616956 >> 172.21.15.72:0/1869616956 conn(0x7fbfcc0a43c0 msgr2=0x7fbfcc09ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:31.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.624+0000 7fbfd3083700 1 -- 172.21.15.72:0/1869616956 shutdown_connections 2023-10-03T10:12:31.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.624+0000 7fbfd3083700 1 -- 172.21.15.72:0/1869616956 wait complete. 2023-10-03T10:12:31.624 INFO:teuthology.orchestra.run.smithi072.stderr:set pool 3 pg_autoscale_mode to off 2023-10-03T10:12:31.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.739+0000 7f6a8c19d700 1 Processor -- start 2023-10-03T10:12:31.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.739+0000 7f6a8c19d700 1 -- start start 2023-10-03T10:12:31.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.739+0000 7f6a8c19d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a8409d950 0x7f6a8409dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.739+0000 7f6a8c19d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a84133e50 0x7f6a8413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.739+0000 7f6a8c19d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8406b5a0 con 0x7f6a8409e260 2023-10-03T10:12:31.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.739+0000 7f6a8c19d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8409ab70 con 0x7f6a8409d950 2023-10-03T10:12:31.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.739+0000 7f6a8c19d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8409f3d0 con 0x7f6a84133e50 2023-10-03T10:12:31.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.739+0000 7f6a89f39700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a8409d950 0x7f6a8409dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.739+0000 7f6a8a73a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a84133e50 0x7f6a8413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.740+0000 7f6a89f39700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a8409d950 0x7f6a8409dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37910/0 (socket says 172.21.15.72:37910) 2023-10-03T10:12:31.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.740+0000 7f6a89738700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6a8409e260 0x7f6a84133740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36262/0 (socket says 172.21.15.72:36262) 2023-10-03T10:12:31.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.740+0000 7f6a8a73a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a84133e50 0x7f6a8413bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34116/0 (socket says 172.21.15.72:34116) 2023-10-03T10:12:31.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.740+0000 7f6a89f39700 1 -- 172.21.15.72:0/1575346411 learned_addr learned my addr 172.21.15.72:0/1575346411 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.740+0000 7f6a89f39700 1 -- 172.21.15.72:0/1575346411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a84133e50 msgr2=0x7f6a8413bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.740+0000 7f6a89f39700 1 --2- 172.21.15.72:0/1575346411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a84133e50 0x7f6a8413bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.740+0000 7f6a89f39700 1 -- 172.21.15.72:0/1575346411 >> v1:172.21.15.72:6789/0 conn(0x7f6a8409e260 legacy=0x7f6a84133740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.740+0000 7f6a89f39700 1 -- 172.21.15.72:0/1575346411 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8409a560 con 0x7f6a8409d950 2023-10-03T10:12:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.740+0000 7f6a88f37700 1 -- 172.21.15.72:0/1575346411 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77487804 0 0) 0x7f6a8406b5a0 con 0x7f6a8409e260 2023-10-03T10:12:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.740+0000 7f6a8a73a700 1 --2- 172.21.15.72:0/1575346411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a84133e50 0x7f6a8413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.740+0000 7f6a89f39700 1 --2- 172.21.15.72:0/1575346411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a8409d950 0x7f6a8409dd20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6a80006fd0 tx=0x7f6a80009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16888f1364b0aee7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.740+0000 7f6a88f37700 1 -- 172.21.15.72:0/1575346411 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80005e30 con 0x7f6a8409d950 2023-10-03T10:12:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.740+0000 7f6a88f37700 1 -- 172.21.15.72:0/1575346411 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a80004030 con 0x7f6a8409d950 2023-10-03T10:12:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.740+0000 7f6a88f37700 1 -- 172.21.15.72:0/1575346411 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a800043e0 con 0x7f6a8409d950 2023-10-03T10:12:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.741+0000 7f6a8c19d700 1 -- 172.21.15.72:0/1575346411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a8409d950 msgr2=0x7f6a8409dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.741+0000 7f6a8c19d700 1 --2- 172.21.15.72:0/1575346411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a8409d950 0x7f6a8409dd20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6a80006fd0 tx=0x7f6a80009bd0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.741+0000 7f6a8c19d700 1 -- 172.21.15.72:0/1575346411 shutdown_connections 2023-10-03T10:12:31.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.741+0000 7f6a8c19d700 1 --2- 172.21.15.72:0/1575346411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a84133e50 0x7f6a8413bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.741+0000 7f6a8c19d700 1 --2- 172.21.15.72:0/1575346411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a8409d950 0x7f6a8409dd20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.741+0000 7f6a8c19d700 1 -- 172.21.15.72:0/1575346411 >> 172.21.15.72:0/1575346411 conn(0x7f6a840a2f50 msgr2=0x7f6a840a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:31.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.741+0000 7f6a8c19d700 1 -- 172.21.15.72:0/1575346411 shutdown_connections 2023-10-03T10:12:31.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.741+0000 7f6a8c19d700 1 -- 172.21.15.72:0/1575346411 wait complete. 2023-10-03T10:12:31.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a8c19d700 1 Processor -- start 2023-10-03T10:12:31.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a8c19d700 1 -- start start 2023-10-03T10:12:31.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a8c19d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a8409d950 0x7f6a8411ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a8c19d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a8409e260 0x7f6a8411f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a8c19d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a84133e50 0x7f6a8411fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:31.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a8c19d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a84122320 con 0x7f6a84133e50 2023-10-03T10:12:31.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a8c19d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a84123470 con 0x7f6a8409e260 2023-10-03T10:12:31.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a8c19d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a84121df0 con 0x7f6a8409d950 2023-10-03T10:12:31.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a89f39700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a8409d950 0x7f6a8411ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a8a73a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a84133e50 0x7f6a8411fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a89f39700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a8409d950 0x7f6a8411ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58220/0 (socket says 172.21.15.72:58220) 2023-10-03T10:12:31.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a89f39700 1 -- 172.21.15.72:0/1924985047 learned_addr learned my addr 172.21.15.72:0/1924985047 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:31.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a89738700 1 --2- 172.21.15.72:0/1924985047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a8409e260 0x7f6a8411f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:31.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a8a73a700 1 -- 172.21.15.72:0/1924985047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a8409d950 msgr2=0x7f6a8411ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a8a73a700 1 --2- 172.21.15.72:0/1924985047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a8409d950 0x7f6a8411ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a8a73a700 1 -- 172.21.15.72:0/1924985047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a8409e260 msgr2=0x7f6a8411f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:31.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a8a73a700 1 --2- 172.21.15.72:0/1924985047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a8409e260 0x7f6a8411f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:31.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a8a73a700 1 -- 172.21.15.72:0/1924985047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c009a70 con 0x7f6a84133e50 2023-10-03T10:12:31.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a89f39700 1 --2- 172.21.15.72:0/1924985047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a8409d950 0x7f6a8411ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:31.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.742+0000 7f6a89738700 1 --2- 172.21.15.72:0/1924985047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a8409e260 0x7f6a8411f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:31.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.743+0000 7f6a8a73a700 1 --2- 172.21.15.72:0/1924985047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a84133e50 0x7f6a8411fa10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009e50 tx=0x7f6a7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:31.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.743+0000 7f6a7a7fc700 1 -- 172.21.15.72:0/1924985047 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c00ca90 con 0x7f6a84133e50 2023-10-03T10:12:31.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.743+0000 7f6a7a7fc700 1 -- 172.21.15.72:0/1924985047 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7c00f040 con 0x7f6a84133e50 2023-10-03T10:12:31.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.743+0000 7f6a8c19d700 1 -- 172.21.15.72:0/1924985047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a80009500 con 0x7f6a84133e50 2023-10-03T10:12:31.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.743+0000 7f6a7a7fc700 1 -- 172.21.15.72:0/1924985047 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c00ce50 con 0x7f6a84133e50 2023-10-03T10:12:31.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.743+0000 7f6a8c19d700 1 -- 172.21.15.72:0/1924985047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a84122820 con 0x7f6a84133e50 2023-10-03T10:12:31.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.744+0000 7f6a7a7fc700 1 -- 172.21.15.72:0/1924985047 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6a7c014480 con 0x7f6a84133e50 2023-10-03T10:12:31.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.744+0000 7f6a7a7fc700 1 -- 172.21.15.72:0/1924985047 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f6a7c040030 con 0x7f6a84133e50 2023-10-03T10:12:31.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.744+0000 7f6a89f39700 1 -- 172.21.15.72:0/1924985047 >> v1:172.21.15.72:6816/126756 conn(0x7f6a6802f510 legacy=0x7f6a680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:31.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.744+0000 7f6a8c19d700 1 -- 172.21.15.72:0/1924985047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a84122820 con 0x7f6a84133e50 2023-10-03T10:12:31.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.749+0000 7f6a7a7fc700 1 -- 172.21.15.72:0/1924985047 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a84122820 con 0x7f6a84133e50 2023-10-03T10:12:31.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.931+0000 7f6a8c19d700 1 -- 172.21.15.72:0/1924985047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f6a84122820 con 0x7f6a84133e50 2023-10-03T10:12:31.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:31.945+0000 7f6a89f39700 1 -- 172.21.15.72:0/1924985047 >> v1:172.21.15.72:6816/126756 conn(0x7f6a6802f510 legacy=0x7f6a680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:32.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.346+0000 7f6a89f39700 1 -- 172.21.15.72:0/1924985047 >> v1:172.21.15.72:6816/126756 conn(0x7f6a6802f510 legacy=0x7f6a680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:32.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.621+0000 7f6a7a7fc700 1 -- 172.21.15.72:0/1924985047 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v38) v1 ==== 160+0+0 (secure 0 0 0) 0x7f6a84122820 con 0x7f6a84133e50 2023-10-03T10:12:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.625+0000 7f6a8c19d700 1 -- 172.21.15.72:0/1924985047 >> v1:172.21.15.72:6816/126756 conn(0x7f6a6802f510 legacy=0x7f6a680319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.625+0000 7f6a8c19d700 1 -- 172.21.15.72:0/1924985047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a84133e50 msgr2=0x7f6a8411fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.625+0000 7f6a8c19d700 1 --2- 172.21.15.72:0/1924985047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a84133e50 0x7f6a8411fa10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009e50 tx=0x7f6a7c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.625+0000 7f6a8c19d700 1 -- 172.21.15.72:0/1924985047 shutdown_connections 2023-10-03T10:12:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.625+0000 7f6a8c19d700 1 --2- 172.21.15.72:0/1924985047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a84133e50 0x7f6a8411fa10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.625+0000 7f6a8c19d700 1 --2- 172.21.15.72:0/1924985047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a8409d950 0x7f6a8411ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.625+0000 7f6a8c19d700 1 --2- 172.21.15.72:0/1924985047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a8409e260 0x7f6a8411f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.625+0000 7f6a8c19d700 1 -- 172.21.15.72:0/1924985047 >> 172.21.15.72:0/1924985047 conn(0x7f6a840a2f50 msgr2=0x7f6a841bae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.625+0000 7f6a8c19d700 1 -- 172.21.15.72:0/1924985047 shutdown_connections 2023-10-03T10:12:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.625+0000 7f6a8c19d700 1 -- 172.21.15.72:0/1924985047 wait complete. 2023-10-03T10:12:32.626 INFO:teuthology.orchestra.run.smithi072.stderr:set pool 4 pg_autoscale_mode to off 2023-10-03T10:12:32.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release reef' 2023-10-03T10:12:32.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.767+0000 7fcb2397e700 1 Processor -- start 2023-10-03T10:12:32.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.767+0000 7fcb2397e700 1 -- start start 2023-10-03T10:12:32.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb2397e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb1c0744d0 0x7fcb1c1304e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb2397e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb1c130a20 0x7fcb1c09d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb2397e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1c09a200 con 0x7fcb1c130e10 2023-10-03T10:12:32.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb2397e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c09a7c0 con 0x7fcb1c0744d0 2023-10-03T10:12:32.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb2397e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c09ef60 con 0x7fcb1c130a20 2023-10-03T10:12:32.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb2171a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb1c0744d0 0x7fcb1c1304e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb21f1b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcb1c130e10 0x7fcb1c09da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36270/0 (socket says 172.21.15.72:36270) 2023-10-03T10:12:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb21f1b700 1 -- 172.21.15.72:0/1240851626 learned_addr learned my addr 172.21.15.72:0/1240851626 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb20f19700 1 --2- 172.21.15.72:0/1240851626 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb1c130a20 0x7fcb1c09d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb2171a700 1 -- 172.21.15.72:0/1240851626 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb1c130a20 msgr2=0x7fcb1c09d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb2171a700 1 --2- 172.21.15.72:0/1240851626 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb1c130a20 0x7fcb1c09d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb2171a700 1 -- 172.21.15.72:0/1240851626 >> v1:172.21.15.72:6789/0 conn(0x7fcb1c130e10 legacy=0x7fcb1c09da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb13fff700 1 -- 172.21.15.72:0/1240851626 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746942911 0 0) 0x7fcb1c09a200 con 0x7fcb1c130e10 2023-10-03T10:12:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb2171a700 1 -- 172.21.15.72:0/1240851626 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1c1301d0 con 0x7fcb1c0744d0 2023-10-03T10:12:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb2171a700 1 --2- 172.21.15.72:0/1240851626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb1c0744d0 0x7fcb1c1304e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009870 tx=0x7fcb0c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9ea8029bd625ca1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb13fff700 1 -- 172.21.15.72:0/1240851626 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c011830 con 0x7fcb1c0744d0 2023-10-03T10:12:32.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb13fff700 1 -- 172.21.15.72:0/1240851626 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c011990 con 0x7fcb1c0744d0 2023-10-03T10:12:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.768+0000 7fcb13fff700 1 -- 172.21.15.72:0/1240851626 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c011d20 con 0x7fcb1c0744d0 2023-10-03T10:12:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.769+0000 7fcb2397e700 1 -- 172.21.15.72:0/1240851626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb1c0744d0 msgr2=0x7fcb1c1304e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.769+0000 7fcb2397e700 1 --2- 172.21.15.72:0/1240851626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb1c0744d0 0x7fcb1c1304e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009870 tx=0x7fcb0c009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.769+0000 7fcb2397e700 1 -- 172.21.15.72:0/1240851626 shutdown_connections 2023-10-03T10:12:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.769+0000 7fcb2397e700 1 --2- 172.21.15.72:0/1240851626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb1c0744d0 0x7fcb1c1304e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.769+0000 7fcb2397e700 1 --2- 172.21.15.72:0/1240851626 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb1c130a20 0x7fcb1c09d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.769+0000 7fcb2397e700 1 -- 172.21.15.72:0/1240851626 >> 172.21.15.72:0/1240851626 conn(0x7fcb1c0a29e0 msgr2=0x7fcb1c0a2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.769+0000 7fcb2397e700 1 -- 172.21.15.72:0/1240851626 shutdown_connections 2023-10-03T10:12:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.769+0000 7fcb2397e700 1 -- 172.21.15.72:0/1240851626 wait complete. 2023-10-03T10:12:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.770+0000 7fcb2397e700 1 Processor -- start 2023-10-03T10:12:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.770+0000 7fcb2397e700 1 -- start start 2023-10-03T10:12:32.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.770+0000 7fcb2397e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb1c0744d0 0x7fcb1c118e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.770+0000 7fcb2397e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb1c130a20 0x7fcb1c119390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.770+0000 7fcb2397e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb1c130e10 0x7fcb1c1198d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.770+0000 7fcb2397e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c11bee0 con 0x7fcb1c130e10 2023-10-03T10:12:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.770+0000 7fcb2397e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c11c0c0 con 0x7fcb1c130a20 2023-10-03T10:12:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.770+0000 7fcb2397e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c12bdc0 con 0x7fcb1c0744d0 2023-10-03T10:12:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.770+0000 7fcb2171a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb1c0744d0 0x7fcb1c118e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.770+0000 7fcb21f1b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb1c130e10 0x7fcb1c1198d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.770+0000 7fcb20f19700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb1c130a20 0x7fcb1c119390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.770+0000 7fcb2171a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb1c0744d0 0x7fcb1c118e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58234/0 (socket says 172.21.15.72:58234) 2023-10-03T10:12:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.770+0000 7fcb2171a700 1 -- 172.21.15.72:0/3993273704 learned_addr learned my addr 172.21.15.72:0/3993273704 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:32.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.771+0000 7fcb2171a700 1 -- 172.21.15.72:0/3993273704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb1c130a20 msgr2=0x7fcb1c119390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.771+0000 7fcb2171a700 1 --2- 172.21.15.72:0/3993273704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb1c130a20 0x7fcb1c119390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.771+0000 7fcb2171a700 1 -- 172.21.15.72:0/3993273704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb1c130e10 msgr2=0x7fcb1c1198d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:32.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.771+0000 7fcb2171a700 1 --2- 172.21.15.72:0/3993273704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb1c130e10 0x7fcb1c1198d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:32.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.771+0000 7fcb2171a700 1 -- 172.21.15.72:0/3993273704 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c0094a0 con 0x7fcb1c0744d0 2023-10-03T10:12:32.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.771+0000 7fcb2171a700 1 --2- 172.21.15.72:0/3993273704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb1c0744d0 0x7fcb1c118e50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c09ed60 tx=0x7fcb0c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:32.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.771+0000 7fcb11ffb700 1 -- 172.21.15.72:0/3993273704 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c004510 con 0x7fcb1c0744d0 2023-10-03T10:12:32.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.771+0000 7fcb11ffb700 1 -- 172.21.15.72:0/3993273704 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c01f070 con 0x7fcb1c0744d0 2023-10-03T10:12:32.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.771+0000 7fcb11ffb700 1 -- 172.21.15.72:0/3993273704 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0038c0 con 0x7fcb1c0744d0 2023-10-03T10:12:32.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.771+0000 7fcb2397e700 1 -- 172.21.15.72:0/3993273704 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1c12dfa0 con 0x7fcb1c0744d0 2023-10-03T10:12:32.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.771+0000 7fcb2397e700 1 -- 172.21.15.72:0/3993273704 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1c11af40 con 0x7fcb1c0744d0 2023-10-03T10:12:32.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.772+0000 7fcb11ffb700 1 -- 172.21.15.72:0/3993273704 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fcb0c003a20 con 0x7fcb1c0744d0 2023-10-03T10:12:32.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.772+0000 7fcb11ffb700 1 -- 172.21.15.72:0/3993273704 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fcb0c021070 con 0x7fcb1c0744d0 2023-10-03T10:12:32.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.772+0000 7fcb20f19700 1 -- 172.21.15.72:0/3993273704 >> v1:172.21.15.72:6816/126756 conn(0x7fcb0002f510 legacy=0x7fcb000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:32.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.772+0000 7fcb2397e700 1 -- 172.21.15.72:0/3993273704 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1c04f2a0 con 0x7fcb1c0744d0 2023-10-03T10:12:32.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.777+0000 7fcb11ffb700 1 -- 172.21.15.72:0/3993273704 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb0c015070 con 0x7fcb1c0744d0 2023-10-03T10:12:32.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.973+0000 7fcb20f19700 1 -- 172.21.15.72:0/3993273704 >> v1:172.21.15.72:6816/126756 conn(0x7fcb0002f510 legacy=0x7fcb000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:32.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:32.975+0000 7fcb2397e700 1 -- 172.21.15.72:0/3993273704 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd require-osd-release", "release": "reef"} v 0) v1 -- 0x7fcb1c0721f0 con 0x7fcb1c0744d0 2023-10-03T10:12:33.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.374+0000 7fcb20f19700 1 -- 172.21.15.72:0/3993273704 >> v1:172.21.15.72:6816/126756 conn(0x7fcb0002f510 legacy=0x7fcb000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.633+0000 7fcb11ffb700 1 -- 172.21.15.72:0/3993273704 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "reef"}]=0 v39) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcb0c01a430 con 0x7fcb1c0744d0 2023-10-03T10:12:33.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.636+0000 7fcb2397e700 1 -- 172.21.15.72:0/3993273704 >> v1:172.21.15.72:6816/126756 conn(0x7fcb0002f510 legacy=0x7fcb000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:33.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.636+0000 7fcb2397e700 1 -- 172.21.15.72:0/3993273704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb1c0744d0 msgr2=0x7fcb1c118e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.636+0000 7fcb2397e700 1 --2- 172.21.15.72:0/3993273704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb1c0744d0 0x7fcb1c118e50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c09ed60 tx=0x7fcb0c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:33.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.636+0000 7fcb2397e700 1 -- 172.21.15.72:0/3993273704 shutdown_connections 2023-10-03T10:12:33.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.636+0000 7fcb2397e700 1 --2- 172.21.15.72:0/3993273704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb1c130e10 0x7fcb1c1198d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.636+0000 7fcb2397e700 1 --2- 172.21.15.72:0/3993273704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb1c0744d0 0x7fcb1c118e50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.636+0000 7fcb2397e700 1 --2- 172.21.15.72:0/3993273704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb1c130a20 0x7fcb1c119390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.636+0000 7fcb2397e700 1 -- 172.21.15.72:0/3993273704 >> 172.21.15.72:0/3993273704 conn(0x7fcb1c0a29e0 msgr2=0x7fcb1c12d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:33.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.636+0000 7fcb2397e700 1 -- 172.21.15.72:0/3993273704 shutdown_connections 2023-10-03T10:12:33.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.636+0000 7fcb2397e700 1 -- 172.21.15.72:0/3993273704 wait complete. 2023-10-03T10:12:33.651 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-10-03T10:12:33.662 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T10:12:33.662 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T10:12:33.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T10:12:33.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.788+0000 7f8755eac700 1 Processor -- start 2023-10-03T10:12:33.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.788+0000 7f8755eac700 1 -- start start 2023-10-03T10:12:33.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f8755eac700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f875009c5e0 0x7f875009c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f8755eac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875009cef0 0x7f875013bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f8755eac700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f875009a830 con 0x7f875013c470 2023-10-03T10:12:33.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f8755eac700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f875009bff0 con 0x7f875009c5e0 2023-10-03T10:12:33.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f8755eac700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8750098ab0 con 0x7f875009cef0 2023-10-03T10:12:33.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f874effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875009cef0 0x7f875013bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f874f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f875009c5e0 0x7f875009c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f874effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875009cef0 0x7f875013bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34162/0 (socket says 172.21.15.72:34162) 2023-10-03T10:12:33.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f874effd700 1 -- 172.21.15.72:0/4271668233 learned_addr learned my addr 172.21.15.72:0/4271668233 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:33.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f874effd700 1 -- 172.21.15.72:0/4271668233 >> v2:172.21.15.72:3300/0 conn(0x7f875009c5e0 msgr2=0x7f875009c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:33.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f874effd700 1 --2- 172.21.15.72:0/4271668233 >> v2:172.21.15.72:3300/0 conn(0x7f875009c5e0 0x7f875009c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f874effd700 1 -- 172.21.15.72:0/4271668233 >> v1:172.21.15.72:6789/0 conn(0x7f875013c470 legacy=0x7f875013e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f874e7fc700 1 -- 172.21.15.72:0/4271668233 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965486491 0 0) 0x7f875009a830 con 0x7f875013c470 2023-10-03T10:12:33.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f874effd700 1 -- 172.21.15.72:0/4271668233 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875009c1a0 con 0x7f875009cef0 2023-10-03T10:12:33.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f874f7fe700 1 --2- 172.21.15.72:0/4271668233 >> v2:172.21.15.72:3300/0 conn(0x7f875009c5e0 0x7f875009c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:33.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f874effd700 1 --2- 172.21.15.72:0/4271668233 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875009cef0 0x7f875013bf30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f87400098f0 tx=0x7f8740009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f02e8db53ffc9f78 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.789+0000 7f874e7fc700 1 -- 172.21.15.72:0/4271668233 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740011830 con 0x7f875009cef0 2023-10-03T10:12:33.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.790+0000 7f874e7fc700 1 -- 172.21.15.72:0/4271668233 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8740011990 con 0x7f875009cef0 2023-10-03T10:12:33.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.790+0000 7f874e7fc700 1 -- 172.21.15.72:0/4271668233 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740011d20 con 0x7f875009cef0 2023-10-03T10:12:33.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.790+0000 7f8755eac700 1 -- 172.21.15.72:0/4271668233 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875009cef0 msgr2=0x7f875013bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.790+0000 7f8755eac700 1 --2- 172.21.15.72:0/4271668233 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875009cef0 0x7f875013bf30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f87400098f0 tx=0x7f8740009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:33.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.790+0000 7f8755eac700 1 -- 172.21.15.72:0/4271668233 shutdown_connections 2023-10-03T10:12:33.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.790+0000 7f8755eac700 1 --2- 172.21.15.72:0/4271668233 >> v2:172.21.15.72:3300/0 conn(0x7f875009c5e0 0x7f875009c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.790+0000 7f8755eac700 1 --2- 172.21.15.72:0/4271668233 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875009cef0 0x7f875013bf30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.790+0000 7f8755eac700 1 -- 172.21.15.72:0/4271668233 >> 172.21.15.72:0/4271668233 conn(0x7f875009e7e0 msgr2=0x7f875009ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:33.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.790+0000 7f8755eac700 1 -- 172.21.15.72:0/4271668233 shutdown_connections 2023-10-03T10:12:33.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.790+0000 7f8755eac700 1 -- 172.21.15.72:0/4271668233 wait complete. 2023-10-03T10:12:33.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.791+0000 7f8755eac700 1 Processor -- start 2023-10-03T10:12:33.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.791+0000 7f8755eac700 1 -- start start 2023-10-03T10:12:33.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f8755eac700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875009c5e0 0x7f8750095790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f8755eac700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875009cef0 0x7f8750095cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f8755eac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875013c470 0x7f8750096210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:33.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f8755eac700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8750071f90 con 0x7f875009c5e0 2023-10-03T10:12:33.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f8755eac700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87501383c0 con 0x7f875013c470 2023-10-03T10:12:33.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f8755eac700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8750127650 con 0x7f875009cef0 2023-10-03T10:12:33.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f874ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875013c470 0x7f8750096210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f874effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875009cef0 0x7f8750095cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f874f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875009c5e0 0x7f8750095790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:33.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f874effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875009cef0 0x7f8750095cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58242/0 (socket says 172.21.15.72:58242) 2023-10-03T10:12:33.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f874effd700 1 -- 172.21.15.72:0/894573211 learned_addr learned my addr 172.21.15.72:0/894573211 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:33.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f874ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875013c470 0x7f8750096210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34174/0 (socket says 172.21.15.72:34174) 2023-10-03T10:12:33.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f874ffff700 1 -- 172.21.15.72:0/894573211 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875009cef0 msgr2=0x7f8750095cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f874ffff700 1 --2- 172.21.15.72:0/894573211 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875009cef0 0x7f8750095cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f874ffff700 1 -- 172.21.15.72:0/894573211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875009c5e0 msgr2=0x7f8750095790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:33.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f874ffff700 1 --2- 172.21.15.72:0/894573211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875009c5e0 0x7f8750095790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:33.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f874ffff700 1 -- 172.21.15.72:0/894573211 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87440094a0 con 0x7f875013c470 2023-10-03T10:12:33.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f874ffff700 1 --2- 172.21.15.72:0/894573211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875013c470 0x7f8750096210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8750099c90 tx=0x7f874800caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:33.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f8737fff700 1 -- 172.21.15.72:0/894573211 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748003e30 con 0x7f875013c470 2023-10-03T10:12:33.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f8737fff700 1 -- 172.21.15.72:0/894573211 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8748005070 con 0x7f875013c470 2023-10-03T10:12:33.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f8755eac700 1 -- 172.21.15.72:0/894573211 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8740009550 con 0x7f875013c470 2023-10-03T10:12:33.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f8737fff700 1 -- 172.21.15.72:0/894573211 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748005420 con 0x7f875013c470 2023-10-03T10:12:33.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.792+0000 7f8755eac700 1 -- 172.21.15.72:0/894573211 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8750126f20 con 0x7f875013c470 2023-10-03T10:12:33.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.793+0000 7f8737fff700 1 -- 172.21.15.72:0/894573211 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8748005580 con 0x7f875013c470 2023-10-03T10:12:33.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.793+0000 7f8737fff700 1 -- 172.21.15.72:0/894573211 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f874803f090 con 0x7f875013c470 2023-10-03T10:12:33.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.793+0000 7f874f7fe700 1 -- 172.21.15.72:0/894573211 >> v1:172.21.15.72:6816/126756 conn(0x7f873c02f510 legacy=0x7f873c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:33.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.793+0000 7f8755eac700 1 -- 172.21.15.72:0/894573211 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87500747f0 con 0x7f875013c470 2023-10-03T10:12:33.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.798+0000 7f8737fff700 1 -- 172.21.15.72:0/894573211 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8748017070 con 0x7f875013c470 2023-10-03T10:12:33.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:33.994+0000 7f874f7fe700 1 -- 172.21.15.72:0/894573211 >> v1:172.21.15.72:6816/126756 conn(0x7f873c02f510 legacy=0x7f873c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:34.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.033+0000 7f8755eac700 1 -- 172.21.15.72:0/894573211 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f87500973a0 con 0x7f875013c470 2023-10-03T10:12:34.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.035+0000 7f8737fff700 1 -- 172.21.15.72:0/894573211 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v9) v1 ==== 74+0+70482 (secure 0 0 0) 0x7f8748005830 con 0x7f875013c470 2023-10-03T10:12:34.035 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:34.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.037+0000 7f8755eac700 1 -- 172.21.15.72:0/894573211 >> v1:172.21.15.72:6816/126756 conn(0x7f873c02f510 legacy=0x7f873c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:34.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.037+0000 7f8755eac700 1 -- 172.21.15.72:0/894573211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875013c470 msgr2=0x7f8750096210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.037+0000 7f8755eac700 1 --2- 172.21.15.72:0/894573211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875013c470 0x7f8750096210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8750099c90 tx=0x7f874800caa0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.037+0000 7f8755eac700 1 -- 172.21.15.72:0/894573211 shutdown_connections 2023-10-03T10:12:34.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.037+0000 7f8755eac700 1 --2- 172.21.15.72:0/894573211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875009c5e0 0x7f8750095790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.037+0000 7f8755eac700 1 --2- 172.21.15.72:0/894573211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875013c470 0x7f8750096210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.037+0000 7f8755eac700 1 --2- 172.21.15.72:0/894573211 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875009cef0 0x7f8750095cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.037+0000 7f8755eac700 1 -- 172.21.15.72:0/894573211 >> 172.21.15.72:0/894573211 conn(0x7f875009e7e0 msgr2=0x7f87500a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.037+0000 7f8755eac700 1 -- 172.21.15.72:0/894573211 shutdown_connections 2023-10-03T10:12:34.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.037+0000 7f8755eac700 1 -- 172.21.15.72:0/894573211 wait complete. 2023-10-03T10:12:34.049 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"active_gid":14102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6816","nonce":126756}]},"active_addr":"172.21.15.72:6816/126756","active_change":"2023-10-03T10:12:06.073720+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":21,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":405703097}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2763351041}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":412002554}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1449937992}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2679211469}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":3554355102}]}]} 2023-10-03T10:12:34.051 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T10:12:34.051 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:12:34.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:34.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.173+0000 7fa505006700 1 Processor -- start 2023-10-03T10:12:34.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.173+0000 7fa505006700 1 -- start start 2023-10-03T10:12:34.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa505006700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa500131630 0x7fa500131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa505006700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa500131f40 0x7fa50006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa505006700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa50006e9d0 0x7fa50006ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa505006700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa500071a00 con 0x7fa500131f40 2023-10-03T10:12:34.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa505006700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa500131430 con 0x7fa50006e9d0 2023-10-03T10:12:34.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa505006700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50009a510 con 0x7fa500131630 2023-10-03T10:12:34.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4ff59e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa50006e9d0 0x7fa50006ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4fed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa500131630 0x7fa500131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4ff59e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa50006e9d0 0x7fa50006ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34176/0 (socket says 172.21.15.72:34176) 2023-10-03T10:12:34.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4fe59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa500131f40 0x7fa50006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4fed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa500131630 0x7fa500131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58246/0 (socket says 172.21.15.72:58246) 2023-10-03T10:12:34.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4ff59e700 1 -- 172.21.15.72:0/4025107825 learned_addr learned my addr 172.21.15.72:0/4025107825 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:34.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4ff59e700 1 -- 172.21.15.72:0/4025107825 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa500131630 msgr2=0x7fa500131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:34.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4ff59e700 1 --2- 172.21.15.72:0/4025107825 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa500131630 0x7fa500131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4ff59e700 1 -- 172.21.15.72:0/4025107825 >> v2:172.21.15.72:3300/0 conn(0x7fa500131f40 msgr2=0x7fa50006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:34.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4ff59e700 1 --2- 172.21.15.72:0/4025107825 >> v2:172.21.15.72:3300/0 conn(0x7fa500131f40 0x7fa50006e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4ff59e700 1 -- 172.21.15.72:0/4025107825 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5000721c0 con 0x7fa50006e9d0 2023-10-03T10:12:34.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4fed9d700 1 --2- 172.21.15.72:0/4025107825 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa500131630 0x7fa500131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:34.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4fe59c700 1 --2- 172.21.15.72:0/4025107825 >> v2:172.21.15.72:3300/0 conn(0x7fa500131f40 0x7fa50006e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:34.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4ff59e700 1 --2- 172.21.15.72:0/4025107825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa50006e9d0 0x7fa50006ee70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00098f0 tx=0x7fa4f0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b271b85dc65f16d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4fdd9b700 1 -- 172.21.15.72:0/4025107825 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0011830 con 0x7fa50006e9d0 2023-10-03T10:12:34.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4fdd9b700 1 -- 172.21.15.72:0/4025107825 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f0011990 con 0x7fa50006e9d0 2023-10-03T10:12:34.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.174+0000 7fa4fdd9b700 1 -- 172.21.15.72:0/4025107825 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0011d20 con 0x7fa50006e9d0 2023-10-03T10:12:34.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.175+0000 7fa505006700 1 -- 172.21.15.72:0/4025107825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa50006e9d0 msgr2=0x7fa50006ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.175+0000 7fa505006700 1 --2- 172.21.15.72:0/4025107825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa50006e9d0 0x7fa50006ee70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00098f0 tx=0x7fa4f0009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:34.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.175+0000 7fa505006700 1 -- 172.21.15.72:0/4025107825 shutdown_connections 2023-10-03T10:12:34.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.175+0000 7fa505006700 1 --2- 172.21.15.72:0/4025107825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa50006e9d0 0x7fa50006ee70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.175+0000 7fa505006700 1 --2- 172.21.15.72:0/4025107825 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa500131630 0x7fa500131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.175+0000 7fa505006700 1 --2- 172.21.15.72:0/4025107825 >> v2:172.21.15.72:3300/0 conn(0x7fa500131f40 0x7fa50006e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.175+0000 7fa505006700 1 -- 172.21.15.72:0/4025107825 >> 172.21.15.72:0/4025107825 conn(0x7fa5000a2aa0 msgr2=0x7fa5000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.175+0000 7fa505006700 1 -- 172.21.15.72:0/4025107825 shutdown_connections 2023-10-03T10:12:34.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.175+0000 7fa505006700 1 -- 172.21.15.72:0/4025107825 wait complete. 2023-10-03T10:12:34.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.177+0000 7fa505006700 1 Processor -- start 2023-10-03T10:12:34.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.177+0000 7fa505006700 1 -- start start 2023-10-03T10:12:34.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.177+0000 7fa505006700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa50006e9d0 0x7fa50006f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.177+0000 7fa505006700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa500131630 0x7fa50006fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.177+0000 7fa505006700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa500131f40 0x7fa500070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.177+0000 7fa505006700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa500120af0 con 0x7fa500131630 2023-10-03T10:12:34.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.177+0000 7fa505006700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50012ec20 con 0x7fa50006e9d0 2023-10-03T10:12:34.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.177+0000 7fa505006700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa500120ff0 con 0x7fa500131f40 2023-10-03T10:12:34.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.177+0000 7fa4fed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa50006e9d0 0x7fa50006f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.177+0000 7fa4fed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa50006e9d0 0x7fa50006f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34184/0 (socket says 172.21.15.72:34184) 2023-10-03T10:12:34.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.177+0000 7fa4ff59e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa500131f40 0x7fa500070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.177+0000 7fa4fed9d700 1 -- 172.21.15.72:0/2053967463 learned_addr learned my addr 172.21.15.72:0/2053967463 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:34.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.177+0000 7fa4fe59c700 1 --2- 172.21.15.72:0/2053967463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa500131630 0x7fa50006fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.178+0000 7fa4ff59e700 1 -- 172.21.15.72:0/2053967463 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa50006e9d0 msgr2=0x7fa50006f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.178+0000 7fa4ff59e700 1 --2- 172.21.15.72:0/2053967463 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa50006e9d0 0x7fa50006f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.178+0000 7fa4ff59e700 1 -- 172.21.15.72:0/2053967463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa500131630 msgr2=0x7fa50006fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.178+0000 7fa4ff59e700 1 --2- 172.21.15.72:0/2053967463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa500131630 0x7fa50006fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.178+0000 7fa4ff59e700 1 -- 172.21.15.72:0/2053967463 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f8009a70 con 0x7fa500131f40 2023-10-03T10:12:34.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.178+0000 7fa4fed9d700 1 --2- 172.21.15.72:0/2053967463 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa50006e9d0 0x7fa50006f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:34.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.178+0000 7fa4ff59e700 1 --2- 172.21.15.72:0/2053967463 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa500131f40 0x7fa500070090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0016000 tx=0x7fa4f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.178+0000 7fa4f77fe700 1 -- 172.21.15.72:0/2053967463 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0004240 con 0x7fa500131f40 2023-10-03T10:12:34.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.178+0000 7fa4f77fe700 1 -- 172.21.15.72:0/2053967463 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f001f070 con 0x7fa500131f40 2023-10-03T10:12:34.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.178+0000 7fa505006700 1 -- 172.21.15.72:0/2053967463 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e80094a0 con 0x7fa500131f40 2023-10-03T10:12:34.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.178+0000 7fa4f77fe700 1 -- 172.21.15.72:0/2053967463 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00036a0 con 0x7fa500131f40 2023-10-03T10:12:34.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.178+0000 7fa505006700 1 -- 172.21.15.72:0/2053967463 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f0009550 con 0x7fa500131f40 2023-10-03T10:12:34.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.179+0000 7fa4f77fe700 1 -- 172.21.15.72:0/2053967463 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa4f0021030 con 0x7fa500131f40 2023-10-03T10:12:34.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.179+0000 7fa4f77fe700 1 -- 172.21.15.72:0/2053967463 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa4f0040b20 con 0x7fa500131f40 2023-10-03T10:12:34.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.179+0000 7fa4fed9d700 1 -- 172.21.15.72:0/2053967463 >> v1:172.21.15.72:6816/126756 conn(0x7fa4e002f510 legacy=0x7fa4e00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:34.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.179+0000 7fa505006700 1 -- 172.21.15.72:0/2053967463 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa500074ea0 con 0x7fa500131f40 2023-10-03T10:12:34.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.184+0000 7fa4f77fe700 1 -- 172.21.15.72:0/2053967463 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4f00239c0 con 0x7fa500131f40 2023-10-03T10:12:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.368+0000 7fa505006700 1 -- 172.21.15.72:0/2053967463 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa50006b9e0 con 0x7fa500131f40 2023-10-03T10:12:34.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.369+0000 7fa4f77fe700 1 -- 172.21.15.72:0/2053967463 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12963 (secure 0 0 0) 0x7fa4f001b430 con 0x7fa500131f40 2023-10-03T10:12:34.369 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:34.370 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":39,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:12:33.626322+0000","last_up_change":"2023-10-03T10:12:25.534779+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":129472}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":129472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":129472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":129472}]},"public_addr":"172.21.15.72:6804/129472","cluster_addr":"172.21.15.72:6805/129472","heartbeat_back_addr":"172.21.15.72:6807/129472","heartbeat_front_addr":"172.21.15.72:6806/129472","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":129570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":129570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":129570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":129570}]},"public_addr":"172.21.15.72:6800/129570","cluster_addr":"172.21.15.72:6801/129570","heartbeat_back_addr":"172.21.15.72:6803/129570","heartbeat_front_addr":"172.21.15.72:6802/129570","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":129702}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":129702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":129702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":129702}]},"public_addr":"172.21.15.72:6808/129702","cluster_addr":"172.21.15.72:6809/129702","heartbeat_back_addr":"172.21.15.72:6811/129702","heartbeat_front_addr":"172.21.15.72:6810/129702","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":130020}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":130020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":130020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":130020}]},"public_addr":"172.21.15.72:6812/130020","cluster_addr":"172.21.15.72:6813/130020","heartbeat_back_addr":"172.21.15.72:6815/130020","heartbeat_front_addr":"172.21.15.72:6814/130020","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:19.493196+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":0}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":0}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6816/118184":"2023-10-04T10:12:06.073551+0000","172.21.15.72:6817/542674768":"2023-10-04T10:12:27.583946+0000","172.21.15.72:0/3319279924":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/2966012812":"2023-10-04T10:12:06.073551+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:34.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.371+0000 7fa505006700 1 -- 172.21.15.72:0/2053967463 >> v1:172.21.15.72:6816/126756 conn(0x7fa4e002f510 legacy=0x7fa4e00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:34.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.371+0000 7fa505006700 1 -- 172.21.15.72:0/2053967463 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa500131f40 msgr2=0x7fa500070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.371+0000 7fa505006700 1 --2- 172.21.15.72:0/2053967463 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa500131f40 0x7fa500070090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0016000 tx=0x7fa4f0004750 comp rx=0 tx=0).stop 2023-10-03T10:12:34.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.371+0000 7fa505006700 1 -- 172.21.15.72:0/2053967463 shutdown_connections 2023-10-03T10:12:34.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.371+0000 7fa505006700 1 --2- 172.21.15.72:0/2053967463 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa500131f40 0x7fa500070090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.371+0000 7fa505006700 1 --2- 172.21.15.72:0/2053967463 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa50006e9d0 0x7fa50006f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.371+0000 7fa505006700 1 --2- 172.21.15.72:0/2053967463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa500131630 0x7fa50006fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.371+0000 7fa505006700 1 -- 172.21.15.72:0/2053967463 >> 172.21.15.72:0/2053967463 conn(0x7fa5000a2aa0 msgr2=0x7fa5001b8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.371+0000 7fa505006700 1 -- 172.21.15.72:0/2053967463 shutdown_connections 2023-10-03T10:12:34.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.371+0000 7fa505006700 1 -- 172.21.15.72:0/2053967463 wait complete. 2023-10-03T10:12:34.384 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:12:34.384 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:12:34.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.505+0000 7f7a688aa700 1 Processor -- start 2023-10-03T10:12:34.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.505+0000 7f7a688aa700 1 -- start start 2023-10-03T10:12:34.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a688aa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6409d6f0 0x7f7a6409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a688aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6409e000 0x7f7a641339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a688aa700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a6409e410 0x7f7a64133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a688aa700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a6406b460 con 0x7f7a6409e410 2023-10-03T10:12:34.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a688aa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6409b120 con 0x7f7a6409e000 2023-10-03T10:12:34.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a688aa700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6409a7e0 con 0x7f7a6409d6f0 2023-10-03T10:12:34.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a61d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6409e000 0x7f7a641339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a6259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6409d6f0 0x7f7a6409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a62d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a6409e410 0x7f7a64133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a6259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6409d6f0 0x7f7a6409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58268/0 (socket says 172.21.15.72:58268) 2023-10-03T10:12:34.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a61d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6409e000 0x7f7a641339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34186/0 (socket says 172.21.15.72:34186) 2023-10-03T10:12:34.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a6259c700 1 -- 172.21.15.72:0/1451972674 learned_addr learned my addr 172.21.15.72:0/1451972674 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:34.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a62d9d700 1 -- 172.21.15.72:0/1451972674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6409d6f0 msgr2=0x7f7a6409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:34.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a62d9d700 1 --2- 172.21.15.72:0/1451972674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6409d6f0 0x7f7a6409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a62d9d700 1 -- 172.21.15.72:0/1451972674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6409e000 msgr2=0x7f7a641339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:34.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a62d9d700 1 --2- 172.21.15.72:0/1451972674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6409e000 0x7f7a641339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a62d9d700 1 -- 172.21.15.72:0/1451972674 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6409a500 con 0x7f7a6409e410 2023-10-03T10:12:34.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a6259c700 1 --2- 172.21.15.72:0/1451972674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6409d6f0 0x7f7a6409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:34.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a61d9b700 1 --2- 172.21.15.72:0/1451972674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6409e000 0x7f7a641339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:34.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a62d9d700 1 --2- 172.21.15.72:0/1451972674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6409e410 0x7f7a64133f30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009d90 tx=0x7f7a5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f11419d0f925a9d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a6159a700 1 -- 172.21.15.72:0/1451972674 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c00e070 con 0x7f7a6409e410 2023-10-03T10:12:34.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a6159a700 1 -- 172.21.15.72:0/1451972674 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c00bb20 con 0x7f7a6409e410 2023-10-03T10:12:34.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.506+0000 7f7a6159a700 1 -- 172.21.15.72:0/1451972674 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c012430 con 0x7f7a6409e410 2023-10-03T10:12:34.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.507+0000 7f7a688aa700 1 -- 172.21.15.72:0/1451972674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6409e410 msgr2=0x7f7a64133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.507+0000 7f7a688aa700 1 --2- 172.21.15.72:0/1451972674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6409e410 0x7f7a64133f30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009d90 tx=0x7f7a5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:34.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.507+0000 7f7a688aa700 1 -- 172.21.15.72:0/1451972674 shutdown_connections 2023-10-03T10:12:34.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.507+0000 7f7a688aa700 1 --2- 172.21.15.72:0/1451972674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6409e410 0x7f7a64133f30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.507+0000 7f7a688aa700 1 --2- 172.21.15.72:0/1451972674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6409d6f0 0x7f7a6409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.507+0000 7f7a688aa700 1 --2- 172.21.15.72:0/1451972674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6409e000 0x7f7a641339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.507+0000 7f7a688aa700 1 -- 172.21.15.72:0/1451972674 >> 172.21.15.72:0/1451972674 conn(0x7f7a64066f50 msgr2=0x7f7a6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.507+0000 7f7a688aa700 1 -- 172.21.15.72:0/1451972674 shutdown_connections 2023-10-03T10:12:34.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.507+0000 7f7a688aa700 1 -- 172.21.15.72:0/1451972674 wait complete. 2023-10-03T10:12:34.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.508+0000 7f7a688aa700 1 Processor -- start 2023-10-03T10:12:34.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.508+0000 7f7a688aa700 1 -- start start 2023-10-03T10:12:34.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.508+0000 7f7a688aa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6409d6f0 0x7f7a641a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a688aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6409e000 0x7f7a641a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a688aa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6409e410 0x7f7a641c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a688aa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a641a5c90 con 0x7f7a6409d6f0 2023-10-03T10:12:34.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a688aa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a641b9140 con 0x7f7a6409e000 2023-10-03T10:12:34.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a688aa700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a641a4d20 con 0x7f7a6409e410 2023-10-03T10:12:34.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a6259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6409d6f0 0x7f7a641a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a6259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6409d6f0 0x7f7a641a5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37972/0 (socket says 172.21.15.72:37972) 2023-10-03T10:12:34.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a61d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6409e000 0x7f7a641a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a6259c700 1 -- 172.21.15.72:0/1385005193 learned_addr learned my addr 172.21.15.72:0/1385005193 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:34.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a62d9d700 1 --2- 172.21.15.72:0/1385005193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6409e410 0x7f7a641c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a6259c700 1 -- 172.21.15.72:0/1385005193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6409e410 msgr2=0x7f7a641c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a6259c700 1 --2- 172.21.15.72:0/1385005193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6409e410 0x7f7a641c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a6259c700 1 -- 172.21.15.72:0/1385005193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6409e000 msgr2=0x7f7a641a5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a6259c700 1 --2- 172.21.15.72:0/1385005193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6409e000 0x7f7a641a5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a6259c700 1 -- 172.21.15.72:0/1385005193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a58009550 con 0x7f7a6409d6f0 2023-10-03T10:12:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a61d9b700 1 --2- 172.21.15.72:0/1385005193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6409e000 0x7f7a641a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a6259c700 1 --2- 172.21.15.72:0/1385005193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6409d6f0 0x7f7a641a5210 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800ebe0 tx=0x7f7a5800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a52ffd700 1 -- 172.21.15.72:0/1385005193 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5800c850 con 0x7f7a6409d6f0 2023-10-03T10:12:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a52ffd700 1 -- 172.21.15.72:0/1385005193 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5800c9b0 con 0x7f7a6409d6f0 2023-10-03T10:12:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a688aa700 1 -- 172.21.15.72:0/1385005193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a540094a0 con 0x7f7a6409d6f0 2023-10-03T10:12:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a52ffd700 1 -- 172.21.15.72:0/1385005193 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5800cd40 con 0x7f7a6409d6f0 2023-10-03T10:12:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.509+0000 7f7a688aa700 1 -- 172.21.15.72:0/1385005193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c009a70 con 0x7f7a6409d6f0 2023-10-03T10:12:34.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.510+0000 7f7a52ffd700 1 -- 172.21.15.72:0/1385005193 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7a58013470 con 0x7f7a6409d6f0 2023-10-03T10:12:34.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.510+0000 7f7a688aa700 1 -- 172.21.15.72:0/1385005193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a64074ea0 con 0x7f7a6409d6f0 2023-10-03T10:12:34.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.510+0000 7f7a61d9b700 1 -- 172.21.15.72:0/1385005193 >> v1:172.21.15.72:6816/126756 conn(0x7f7a4402f510 legacy=0x7f7a440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:34.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.510+0000 7f7a52ffd700 1 -- 172.21.15.72:0/1385005193 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f7a580400f0 con 0x7f7a6409d6f0 2023-10-03T10:12:34.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.515+0000 7f7a52ffd700 1 -- 172.21.15.72:0/1385005193 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a5801b3b0 con 0x7f7a6409d6f0 2023-10-03T10:12:34.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.706+0000 7f7a688aa700 1 -- 172.21.15.72:0/1385005193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a641a7030 con 0x7f7a6409d6f0 2023-10-03T10:12:34.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.707+0000 7f7a52ffd700 1 -- 172.21.15.72:0/1385005193 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+12963 (secure 0 0 0) 0x7f7a58024350 con 0x7f7a6409d6f0 2023-10-03T10:12:34.707 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:12:34.707 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":39,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:12:33.626322+0000","last_up_change":"2023-10-03T10:12:25.534779+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":129472}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":129472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":129472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":129472}]},"public_addr":"172.21.15.72:6804/129472","cluster_addr":"172.21.15.72:6805/129472","heartbeat_back_addr":"172.21.15.72:6807/129472","heartbeat_front_addr":"172.21.15.72:6806/129472","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":129570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":129570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":129570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":129570}]},"public_addr":"172.21.15.72:6800/129570","cluster_addr":"172.21.15.72:6801/129570","heartbeat_back_addr":"172.21.15.72:6803/129570","heartbeat_front_addr":"172.21.15.72:6802/129570","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":129702}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":129702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":129702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":129702}]},"public_addr":"172.21.15.72:6808/129702","cluster_addr":"172.21.15.72:6809/129702","heartbeat_back_addr":"172.21.15.72:6811/129702","heartbeat_front_addr":"172.21.15.72:6810/129702","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":130020}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":130020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":130020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":130020}]},"public_addr":"172.21.15.72:6812/130020","cluster_addr":"172.21.15.72:6813/130020","heartbeat_back_addr":"172.21.15.72:6815/130020","heartbeat_front_addr":"172.21.15.72:6814/130020","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:19.493196+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":0}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":0}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6816/118184":"2023-10-04T10:12:06.073551+0000","172.21.15.72:6817/542674768":"2023-10-04T10:12:27.583946+0000","172.21.15.72:0/3319279924":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/2966012812":"2023-10-04T10:12:06.073551+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:12:34.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.709+0000 7f7a688aa700 1 -- 172.21.15.72:0/1385005193 >> v1:172.21.15.72:6816/126756 conn(0x7f7a4402f510 legacy=0x7f7a440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:34.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.709+0000 7f7a688aa700 1 -- 172.21.15.72:0/1385005193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6409d6f0 msgr2=0x7f7a641a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.709+0000 7f7a688aa700 1 --2- 172.21.15.72:0/1385005193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6409d6f0 0x7f7a641a5210 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800ebe0 tx=0x7f7a5800eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.709+0000 7f7a688aa700 1 -- 172.21.15.72:0/1385005193 shutdown_connections 2023-10-03T10:12:34.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.709+0000 7f7a688aa700 1 --2- 172.21.15.72:0/1385005193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6409d6f0 0x7f7a641a5210 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.709+0000 7f7a688aa700 1 --2- 172.21.15.72:0/1385005193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6409e410 0x7f7a641c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.709+0000 7f7a688aa700 1 --2- 172.21.15.72:0/1385005193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6409e000 0x7f7a641a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.709+0000 7f7a688aa700 1 -- 172.21.15.72:0/1385005193 >> 172.21.15.72:0/1385005193 conn(0x7f7a64066f50 msgr2=0x7f7a641bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.709+0000 7f7a688aa700 1 -- 172.21.15.72:0/1385005193 shutdown_connections 2023-10-03T10:12:34.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.709+0000 7f7a688aa700 1 -- 172.21.15.72:0/1385005193 wait complete. 2023-10-03T10:12:34.721 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T10:12:34.722 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T10:12:34.722 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T10:12:34.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T10:12:34.846 INFO:tasks.ceph.mgr.x.smithi072.stderr:daemon-helper: command crashed with signal 6 2023-10-03T10:12:34.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.853+0000 7fa2a3ada700 1 Processor -- start 2023-10-03T10:12:34.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.853+0000 7fa2a3ada700 1 -- start start 2023-10-03T10:12:34.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7fa2a3ada700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa29c130540 0x7fa29c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7fa2a3ada700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa29c130e50 0x7fa29c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7fa2a3ada700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c0716a0 con 0x7fa29c06fb20 2023-10-03T10:12:34.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7fa2a3ada700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c09a390 con 0x7fa29c130e50 2023-10-03T10:12:34.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7fa2a3ada700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c071290 con 0x7fa29c130540 2023-10-03T10:12:34.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7fa2a1075700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa29c130e50 0x7fa29c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7fa2a2077700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa29c06fb20 0x7fa29c137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36292/0 (socket says 172.21.15.72:36292) 2023-10-03T10:12:34.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7fa2a2077700 1 -- 172.21.15.72:0/2785129633 learned_addr learned my addr 172.21.15.72:0/2785129633 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:34.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7f8ff5c40700 1 Processor -- start 2023-10-03T10:12:34.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7fa2a1876700 1 --2- 172.21.15.72:0/2785129633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa29c130540 0x7fa29c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7f8ff5c40700 1 -- start start 2023-10-03T10:12:34.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.855+0000 7f8ff5c40700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ff006e570 0x7f8ff006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.855+0000 7f8ff5c40700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ff009eca0 0x7f8ff006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.855+0000 7f8ff5c40700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ff0134610 0x7f8ff0134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.855+0000 7f8ff5c40700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff0070ee0 con 0x7f8ff0134610 2023-10-03T10:12:34.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.855+0000 7f8ff5c40700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff0071480 con 0x7f8ff006e570 2023-10-03T10:12:34.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.855+0000 7f8ff5c40700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff006f3c0 con 0x7f8ff009eca0 2023-10-03T10:12:34.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7fa2a1876700 1 -- 172.21.15.72:0/2785129633 >> v2:172.21.15.72:3300/0 conn(0x7fa29c130e50 msgr2=0x7fa29c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:34.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7fa2a1876700 1 --2- 172.21.15.72:0/2785129633 >> v2:172.21.15.72:3300/0 conn(0x7fa29c130e50 0x7fa29c06f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7fa2a1876700 1 -- 172.21.15.72:0/2785129633 >> v1:172.21.15.72:6789/0 conn(0x7fa29c06fb20 legacy=0x7fa29c137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7fa2a1876700 1 -- 172.21.15.72:0/2785129633 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c130340 con 0x7fa29c130540 2023-10-03T10:12:34.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.854+0000 7fa2a1075700 1 --2- 172.21.15.72:0/2785129633 >> v2:172.21.15.72:3300/0 conn(0x7fa29c130e50 0x7fa29c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:34.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.855+0000 7fa2a1876700 1 --2- 172.21.15.72:0/2785129633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa29c130540 0x7fa29c130910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa298009870 tx=0x7fa298009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cb5ba83eafa2751 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.855+0000 7fa2a0874700 1 -- 172.21.15.72:0/2785129633 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa298011830 con 0x7fa29c130540 2023-10-03T10:12:34.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.855+0000 7fa2a0874700 1 -- 172.21.15.72:0/2785129633 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa298011990 con 0x7fa29c130540 2023-10-03T10:12:34.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.855+0000 7fa2a0874700 1 -- 172.21.15.72:0/2785129633 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa298011d20 con 0x7fa29c130540 2023-10-03T10:12:34.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.855+0000 7f8feffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ff0134610 0x7f8ff0134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.855+0000 7f8feffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ff0134610 0x7f8ff0134ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37990/0 (socket says 172.21.15.72:37990) 2023-10-03T10:12:34.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.855+0000 7f8feffff700 1 -- 172.21.15.72:0/3814929393 learned_addr learned my addr 172.21.15.72:0/3814929393 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:34.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.855+0000 7f8feeffd700 1 --2- 172.21.15.72:0/3814929393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ff009eca0 0x7f8ff006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7fa2a3ada700 1 -- 172.21.15.72:0/2785129633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa29c130540 msgr2=0x7fa29c130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7fa2a3ada700 1 --2- 172.21.15.72:0/2785129633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa29c130540 0x7fa29c130910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa298009870 tx=0x7fa298009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:34.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7f8feffff700 1 -- 172.21.15.72:0/3814929393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ff009eca0 msgr2=0x7f8ff006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:34.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7f8feffff700 1 --2- 172.21.15.72:0/3814929393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ff009eca0 0x7f8ff006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7f8feffff700 1 -- 172.21.15.72:0/3814929393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ff006e570 msgr2=0x7f8ff006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:34.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7f8feffff700 1 --2- 172.21.15.72:0/3814929393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ff006e570 0x7f8ff006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7f8feffff700 1 -- 172.21.15.72:0/3814929393 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff0071b90 con 0x7f8ff0134610 2023-10-03T10:12:34.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7fa2a3ada700 1 -- 172.21.15.72:0/2785129633 shutdown_connections 2023-10-03T10:12:34.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7fa2a3ada700 1 --2- 172.21.15.72:0/2785129633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa29c130540 0x7fa29c130910 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7fa2a3ada700 1 --2- 172.21.15.72:0/2785129633 >> v2:172.21.15.72:3300/0 conn(0x7fa29c130e50 0x7fa29c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7fa2a3ada700 1 -- 172.21.15.72:0/2785129633 >> 172.21.15.72:0/2785129633 conn(0x7fa29c0a2aa0 msgr2=0x7fa29c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7fa2a3ada700 1 -- 172.21.15.72:0/2785129633 shutdown_connections 2023-10-03T10:12:34.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7fa2a3ada700 1 -- 172.21.15.72:0/2785129633 wait complete. 2023-10-03T10:12:34.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7f8feffff700 1 --2- 172.21.15.72:0/3814929393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff0134610 0x7f8ff0134ab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00098f0 tx=0x7f8fe0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69fc9686e4369d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7f8fee7fc700 1 -- 172.21.15.72:0/3814929393 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0011830 con 0x7f8ff0134610 2023-10-03T10:12:34.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7f8fee7fc700 1 -- 172.21.15.72:0/3814929393 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe0011990 con 0x7f8ff0134610 2023-10-03T10:12:34.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.856+0000 7f8fee7fc700 1 -- 172.21.15.72:0/3814929393 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0011d20 con 0x7f8ff0134610 2023-10-03T10:12:34.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.857+0000 7fa2a3ada700 1 Processor -- start 2023-10-03T10:12:34.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.857+0000 7fa2a3ada700 1 -- start start 2023-10-03T10:12:34.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.858+0000 7fa2a3ada700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa29c06fb20 0x7fa29c11ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.858+0000 7fa2a3ada700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa29c130540 0x7fa29c11f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.858+0000 7fa2a3ada700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa29c130e50 0x7fa29c11f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.858+0000 7fa2a3ada700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c122360 con 0x7fa29c130540 2023-10-03T10:12:34.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.858+0000 7fa2a3ada700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0718e0 con 0x7fa29c06fb20 2023-10-03T10:12:34.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.858+0000 7fa2a3ada700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c120b00 con 0x7fa29c130e50 2023-10-03T10:12:34.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.858+0000 7fa2a1075700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa29c130540 0x7fa29c11f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.858+0000 7fa2a1075700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa29c130540 0x7fa29c11f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38002/0 (socket says 172.21.15.72:38002) 2023-10-03T10:12:34.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.858+0000 7fa2a1075700 1 -- 172.21.15.72:0/256463527 learned_addr learned my addr 172.21.15.72:0/256463527 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:34.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.858+0000 7fa2a1876700 1 --2- 172.21.15.72:0/256463527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa29c06fb20 0x7fa29c11ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.858+0000 7fa2a2077700 1 --2- 172.21.15.72:0/256463527 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa29c130e50 0x7fa29c11f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7fa2a1075700 1 -- 172.21.15.72:0/256463527 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa29c130e50 msgr2=0x7fa29c11f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7fa2a1075700 1 --2- 172.21.15.72:0/256463527 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa29c130e50 0x7fa29c11f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7fa2a1075700 1 -- 172.21.15.72:0/256463527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa29c06fb20 msgr2=0x7fa29c11ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7fa2a1075700 1 --2- 172.21.15.72:0/256463527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa29c06fb20 0x7fa29c11ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7fa2a1075700 1 -- 172.21.15.72:0/256463527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c00b740 con 0x7fa29c130540 2023-10-03T10:12:34.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7fa2a1075700 1 --2- 172.21.15.72:0/256463527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa29c130540 0x7fa29c11f3b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00ecf0 tx=0x7fa28c00bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7fa2927fc700 1 -- 172.21.15.72:0/256463527 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00dd70 con 0x7fa29c130540 2023-10-03T10:12:34.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7fa2927fc700 1 -- 172.21.15.72:0/256463527 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c010440 con 0x7fa29c130540 2023-10-03T10:12:34.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7fa2a3ada700 1 -- 172.21.15.72:0/256463527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2980094a0 con 0x7fa29c130540 2023-10-03T10:12:34.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7fa2927fc700 1 -- 172.21.15.72:0/256463527 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0107b0 con 0x7fa29c130540 2023-10-03T10:12:34.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7fa2a3ada700 1 -- 172.21.15.72:0/256463527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c123090 con 0x7fa29c130540 2023-10-03T10:12:34.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7f8ff5c40700 1 -- 172.21.15.72:0/3814929393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff0134610 msgr2=0x7f8ff0134ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7f8ff5c40700 1 --2- 172.21.15.72:0/3814929393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff0134610 0x7f8ff0134ab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00098f0 tx=0x7f8fe0009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:34.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7f8ff5c40700 1 -- 172.21.15.72:0/3814929393 shutdown_connections 2023-10-03T10:12:34.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7f8ff5c40700 1 --2- 172.21.15.72:0/3814929393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff0134610 0x7f8ff0134ab0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7f8ff5c40700 1 --2- 172.21.15.72:0/3814929393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ff006e570 0x7f8ff006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7f8ff5c40700 1 --2- 172.21.15.72:0/3814929393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ff009eca0 0x7f8ff006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.859+0000 7f8ff5c40700 1 -- 172.21.15.72:0/3814929393 >> 172.21.15.72:0/3814929393 conn(0x7f8ff00a2aa0 msgr2=0x7f8ff00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.860+0000 7fa2927fc700 1 -- 172.21.15.72:0/256463527 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa28c010910 con 0x7fa29c130540 2023-10-03T10:12:34.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.860+0000 7fa2927fc700 1 -- 172.21.15.72:0/256463527 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa28c014030 con 0x7fa29c130540 2023-10-03T10:12:34.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.860+0000 7fa2a1876700 1 -- 172.21.15.72:0/256463527 >> v1:172.21.15.72:6816/126756 conn(0x7fa28002f510 legacy=0x7fa2800319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:34.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.861+0000 7f8ff5c40700 1 -- 172.21.15.72:0/3814929393 shutdown_connections 2023-10-03T10:12:34.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.863+0000 7f8ff5c40700 1 -- 172.21.15.72:0/3814929393 wait complete. 2023-10-03T10:12:34.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.863+0000 7fa2a3ada700 1 -- 172.21.15.72:0/256463527 --> v1:172.21.15.72:6812/130020 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa29c0621a0 con 0x7fa29c1c8360 2023-10-03T10:12:34.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.863+0000 7fd8cf3a0700 1 Processor -- start 2023-10-03T10:12:34.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.863+0000 7f8ff5c40700 1 Processor -- start 2023-10-03T10:12:34.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.864+0000 7fd8cf3a0700 1 -- start start 2023-10-03T10:12:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.864+0000 7fd8cf3a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8c809d8d0 0x7fd8c809dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.864+0000 7fd8cf3a0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd8c809e1e0 0x7fd8c8130460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.864+0000 7fd8cf3a0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c809b6e0 con 0x7fd8c809e610 2023-10-03T10:12:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.864+0000 7fd8cf3a0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c809b470 con 0x7fd8c809e1e0 2023-10-03T10:12:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.864+0000 7fd8cf3a0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c809eb80 con 0x7fd8c809d8d0 2023-10-03T10:12:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.865+0000 7fa2927fc700 1 -- 172.21.15.72:0/256463527 <== osd.3 v1:172.21.15.72:6812/130020 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7fa29c0621a0 con 0x7fa29c1c8360 2023-10-03T10:12:34.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.865+0000 7f74fe4f3700 1 Processor -- start 2023-10-03T10:12:34.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.865+0000 7f74fe4f3700 1 -- start start 2023-10-03T10:12:34.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.866+0000 7f74fe4f3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74f8131630 0x7f74f8131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.866+0000 7f74fe4f3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f74f8131f40 0x7f74f806e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.866+0000 7f74fe4f3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f8071a00 con 0x7f74f806e9d0 2023-10-03T10:12:34.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.866+0000 7f74fe4f3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f8131430 con 0x7f74f8131f40 2023-10-03T10:12:34.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.866+0000 7f74fe4f3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f809a510 con 0x7f74f8131630 2023-10-03T10:12:34.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.866+0000 7f74f7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74f8131630 0x7f74f8131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.866+0000 7f74f7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74f8131630 0x7f74f8131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34224/0 (socket says 172.21.15.72:34224) 2023-10-03T10:12:34.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.866+0000 7f74f7fff700 1 -- 172.21.15.72:0/420211412 learned_addr learned my addr 172.21.15.72:0/420211412 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:34.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.866+0000 7f74f7fff700 1 -- 172.21.15.72:0/420211412 >> v2:172.21.15.72:3300/0 conn(0x7f74f8131f40 msgr2=0x7f74f806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:34.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.866+0000 7f74f7fff700 1 --2- 172.21.15.72:0/420211412 >> v2:172.21.15.72:3300/0 conn(0x7f74f8131f40 0x7f74f806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.866+0000 7f74f7fff700 1 -- 172.21.15.72:0/420211412 >> v1:172.21.15.72:6789/0 conn(0x7f74f806e9d0 legacy=0x7f74f8138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.866+0000 7f74f7fff700 1 -- 172.21.15.72:0/420211412 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f80721c0 con 0x7f74f8131630 2023-10-03T10:12:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.867+0000 7f74f7fff700 1 --2- 172.21.15.72:0/420211412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74f8131630 0x7f74f8131a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f74e80098f0 tx=0x7f74e8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f33168b898181d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.867+0000 7fd8cdb9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd8c809e1e0 0x7fd8c8130460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.867+0000 7fd8cdb9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd8c809e1e0 0x7fd8c8130460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38014/0 (socket says 172.21.15.72:38014) 2023-10-03T10:12:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.867+0000 7fd8cdb9d700 1 -- 172.21.15.72:0/2649065037 learned_addr learned my addr 172.21.15.72:0/2649065037 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.867+0000 7f74f6ffd700 1 -- 172.21.15.72:0/420211412 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8004230 con 0x7f74f8131630 2023-10-03T10:12:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.867+0000 7f74f6ffd700 1 -- 172.21.15.72:0/420211412 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e8004390 con 0x7f74f8131630 2023-10-03T10:12:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.867+0000 7f74f6ffd700 1 -- 172.21.15.72:0/420211412 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e80036a0 con 0x7f74f8131630 2023-10-03T10:12:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.867+0000 7fd8cdb9d700 1 -- 172.21.15.72:0/2649065037 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8c809d8d0 msgr2=0x7fd8c809dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.867+0000 7fd8cdb9d700 1 --2- 172.21.15.72:0/2649065037 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8c809d8d0 0x7fd8c809dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.867+0000 7fd8cdb9d700 1 -- 172.21.15.72:0/2649065037 >> v1:172.21.15.72:6789/0 conn(0x7fd8c809e610 legacy=0x7fd8c81309a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.867+0000 7fd8cdb9d700 1 -- 172.21.15.72:0/2649065037 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c809ae00 con 0x7fd8c809e1e0 2023-10-03T10:12:34.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.867+0000 7fd8cdb9d700 1 --2- 172.21.15.72:0/2649065037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8c809e1e0 0x7fd8c8130460 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8006fd0 tx=0x7fd8b800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcad51ef3b0a0c75 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f8ff5c40700 1 -- start start 2023-10-03T10:12:34.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f74fe4f3700 1 -- 172.21.15.72:0/420211412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74f8131630 msgr2=0x7f74f8131a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f74fe4f3700 1 --2- 172.21.15.72:0/420211412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74f8131630 0x7f74f8131a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f74e80098f0 tx=0x7f74e8009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f74fe4f3700 1 -- 172.21.15.72:0/420211412 shutdown_connections 2023-10-03T10:12:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f74fe4f3700 1 --2- 172.21.15.72:0/420211412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74f8131630 0x7f74f8131a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f74fe4f3700 1 --2- 172.21.15.72:0/420211412 >> v2:172.21.15.72:3300/0 conn(0x7f74f8131f40 0x7f74f806e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f74fe4f3700 1 -- 172.21.15.72:0/420211412 >> 172.21.15.72:0/420211412 conn(0x7f74f80a2aa0 msgr2=0x7f74f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f74fe4f3700 1 -- 172.21.15.72:0/420211412 shutdown_connections 2023-10-03T10:12:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f74fe4f3700 1 -- 172.21.15.72:0/420211412 wait complete. 2023-10-03T10:12:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f8ff5c40700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ff006e570 0x7f8ff0122430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f8ff5c40700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff0134610 0x7f8ff0122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f8ff5c40700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ff0122eb0 0x7f8ff01cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f8ff5c40700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff0123820 con 0x7f8ff0134610 2023-10-03T10:12:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f8ff5c40700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff0125930 con 0x7f8ff0122eb0 2023-10-03T10:12:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f8ff5c40700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff00a2420 con 0x7f8ff006e570 2023-10-03T10:12:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f8feffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ff0122eb0 0x7f8ff01cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f8feffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ff0122eb0 0x7f8ff01cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34236/0 (socket says 172.21.15.72:34236) 2023-10-03T10:12:34.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f8feffff700 1 -- 172.21.15.72:0/1321637897 learned_addr learned my addr 172.21.15.72:0/1321637897 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:34.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.868+0000 7f8fef7fe700 1 --2- 172.21.15.72:0/1321637897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ff006e570 0x7f8ff0122430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.869+0000 7f8feffff700 1 -- 172.21.15.72:0/1321637897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ff006e570 msgr2=0x7f8ff0122430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.869+0000 7f8feffff700 1 --2- 172.21.15.72:0/1321637897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ff006e570 0x7f8ff0122430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.869+0000 7f8feffff700 1 -- 172.21.15.72:0/1321637897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff0134610 msgr2=0x7f8ff0122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.869+0000 7f8feffff700 1 --2- 172.21.15.72:0/1321637897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ff0134610 0x7f8ff0122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.869+0000 7f8feffff700 1 -- 172.21.15.72:0/1321637897 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe0009550 con 0x7f8ff0122eb0 2023-10-03T10:12:34.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.869+0000 7f74fe4f3700 1 Processor -- start 2023-10-03T10:12:34.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.869+0000 7fd8cd39c700 1 -- 172.21.15.72:0/2649065037 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8005e30 con 0x7fd8c809e1e0 2023-10-03T10:12:34.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.869+0000 7f8feffff700 1 --2- 172.21.15.72:0/1321637897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ff0122eb0 0x7f8ff01cca00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0071020 tx=0x7f8fe0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.869+0000 7f8fd7fff700 1 -- 172.21.15.72:0/1321637897 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0004510 con 0x7f8ff0122eb0 2023-10-03T10:12:34.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.869+0000 7f8fd7fff700 1 -- 172.21.15.72:0/1321637897 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe00036a0 con 0x7f8ff0122eb0 2023-10-03T10:12:34.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.869+0000 7f8fd7fff700 1 -- 172.21.15.72:0/1321637897 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0003a50 con 0x7f8ff0122eb0 2023-10-03T10:12:34.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.869+0000 7f8ff5c40700 1 -- 172.21.15.72:0/1321637897 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff0070610 con 0x7f8ff0122eb0 2023-10-03T10:12:34.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.869+0000 7f74fe4f3700 1 -- start start 2023-10-03T10:12:34.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f8ff5c40700 1 -- 172.21.15.72:0/1321637897 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff0126660 con 0x7f8ff0122eb0 2023-10-03T10:12:34.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f74fe4f3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f74f806e9d0 0x7f74f812b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f74fe4f3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f8131630 0x7f74f812b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f74fe4f3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74f8131f40 0x7f74f812bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f74fe4f3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f812e030 con 0x7f74f8131630 2023-10-03T10:12:34.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f74fe4f3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f813df40 con 0x7f74f8131f40 2023-10-03T10:12:34.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f74fe4f3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74f8139720 con 0x7f74f806e9d0 2023-10-03T10:12:34.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f74f7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f74f806e9d0 0x7f74f812b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f74f7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f74f806e9d0 0x7f74f812b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58338/0 (socket says 172.21.15.72:58338) 2023-10-03T10:12:34.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f74f7fff700 1 -- 172.21.15.72:0/1714200124 learned_addr learned my addr 172.21.15.72:0/1714200124 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.869+0000 7fd8cd39c700 1 -- 172.21.15.72:0/2649065037 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b8004030 con 0x7fd8c809e1e0 2023-10-03T10:12:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.869+0000 7fd8cd39c700 1 -- 172.21.15.72:0/2649065037 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80043e0 con 0x7fd8c809e1e0 2023-10-03T10:12:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/2649065037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8c809e1e0 msgr2=0x7fd8c8130460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7fd8cf3a0700 1 --2- 172.21.15.72:0/2649065037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8c809e1e0 0x7fd8c8130460 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8006fd0 tx=0x7fd8b800be70 comp rx=0 tx=0).stop 2023-10-03T10:12:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f74f7fff700 1 -- 172.21.15.72:0/1714200124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74f8131f40 msgr2=0x7f74f812bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f74f7fff700 1 --2- 172.21.15.72:0/1714200124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f74f8131f40 0x7f74f812bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f74f7fff700 1 -- 172.21.15.72:0/1714200124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f8131630 msgr2=0x7f74f812b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f74f7fff700 1 --2- 172.21.15.72:0/1714200124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f8131630 0x7f74f812b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f74f7fff700 1 -- 172.21.15.72:0/1714200124 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e8009550 con 0x7f74f806e9d0 2023-10-03T10:12:34.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/2649065037 shutdown_connections 2023-10-03T10:12:34.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7fd8cf3a0700 1 --2- 172.21.15.72:0/2649065037 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8c809d8d0 0x7fd8c809dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7fd8cf3a0700 1 --2- 172.21.15.72:0/2649065037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8c809e1e0 0x7fd8c8130460 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/2649065037 >> 172.21.15.72:0/2649065037 conn(0x7fd8c80a2e20 msgr2=0x7fd8c80a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.871+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/2649065037 shutdown_connections 2023-10-03T10:12:34.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.870+0000 7f8ff5c40700 1 -- 172.21.15.72:0/1321637897 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ff00722d0 con 0x7f8ff0122eb0 2023-10-03T10:12:34.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.871+0000 7f74f7fff700 1 --2- 172.21.15.72:0/1714200124 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f74f806e9d0 0x7f74f812b270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009130 tx=0x7f74e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.871+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/2649065037 wait complete. 2023-10-03T10:12:34.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.871+0000 7f74f4ff9700 1 -- 172.21.15.72:0/1714200124 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8003e70 con 0x7f74f806e9d0 2023-10-03T10:12:34.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.871+0000 7f74f4ff9700 1 -- 172.21.15.72:0/1714200124 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e801f070 con 0x7f74f806e9d0 2023-10-03T10:12:34.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.871+0000 7f74f4ff9700 1 -- 172.21.15.72:0/1714200124 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e800b8c0 con 0x7f74f806e9d0 2023-10-03T10:12:34.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.872+0000 7fd8cf3a0700 1 Processor -- start 2023-10-03T10:12:34.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.872+0000 7f8fd7fff700 1 -- 172.21.15.72:0/1321637897 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8fe0003bb0 con 0x7f8ff0122eb0 2023-10-03T10:12:34.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.872+0000 7f8fd7fff700 1 -- 172.21.15.72:0/1321637897 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f8fe0041470 con 0x7f8ff0122eb0 2023-10-03T10:12:34.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.872+0000 7f8fef7fe700 1 -- 172.21.15.72:0/1321637897 >> v1:172.21.15.72:6816/126756 conn(0x7f8fdc02f510 legacy=0x7f8fdc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:34.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.872+0000 7f8fd7fff700 1 -- 172.21.15.72:0/1321637897 --> v1:172.21.15.72:6800/129570 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8fdc03c360 con 0x7f8fdc038660 2023-10-03T10:12:34.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.872+0000 7f8fd7fff700 1 -- 172.21.15.72:0/1321637897 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fe0041820 con 0x7f8ff0122eb0 2023-10-03T10:12:34.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.871+0000 7f74fe4f3700 1 -- 172.21.15.72:0/1714200124 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f8099f20 con 0x7f74f806e9d0 2023-10-03T10:12:34.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.871+0000 7f74fe4f3700 1 -- 172.21.15.72:0/1714200124 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f812ce80 con 0x7f74f806e9d0 2023-10-03T10:12:34.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.873+0000 7fd8cf3a0700 1 -- start start 2023-10-03T10:12:34.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.873+0000 7fd8cf3a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8c809d8d0 0x7fd8c811e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.873+0000 7fd8cf3a0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8c809e1e0 0x7fd8c811e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.873+0000 7fd8cf3a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8c809e610 0x7fd8c81cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:34.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.873+0000 7fd8cf3a0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c811fd10 con 0x7fd8c809e1e0 2023-10-03T10:12:34.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.873+0000 7fd8cf3a0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c811f3a0 con 0x7fd8c809d8d0 2023-10-03T10:12:34.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.873+0000 7fd8cf3a0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c8121500 con 0x7fd8c809e610 2023-10-03T10:12:34.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7fd8ceb9f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8c809e610 0x7fd8c81cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7fd8ceb9f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8c809e610 0x7fd8c81cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58354/0 (socket says 172.21.15.72:58354) 2023-10-03T10:12:34.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7fd8ceb9f700 1 -- 172.21.15.72:0/996223653 learned_addr learned my addr 172.21.15.72:0/996223653 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:34.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7fd8cdb9d700 1 --2- 172.21.15.72:0/996223653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8c809e1e0 0x7fd8c811e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:34.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7fd8cdb9d700 1 -- 172.21.15.72:0/996223653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8c809e610 msgr2=0x7fd8c81cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7fd8cdb9d700 1 --2- 172.21.15.72:0/996223653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8c809e610 0x7fd8c81cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7fd8cdb9d700 1 -- 172.21.15.72:0/996223653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8c809d8d0 msgr2=0x7fd8c811e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7fd8cdb9d700 1 --2- 172.21.15.72:0/996223653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8c809d8d0 0x7fd8c811e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:34.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7fd8cdb9d700 1 -- 172.21.15.72:0/996223653 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b800b7a0 con 0x7fd8c809e1e0 2023-10-03T10:12:34.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7f8fd7fff700 1 -- 172.21.15.72:0/1321637897 <== osd.1 v1:172.21.15.72:6800/129570 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f8fdc03c360 con 0x7f8fdc038660 2023-10-03T10:12:34.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.873+0000 7f74de7fc700 1 -- 172.21.15.72:0/1714200124 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74d0000fb0 con 0x7f74f806e9d0 2023-10-03T10:12:34.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7f74f4ff9700 1 -- 172.21.15.72:0/1714200124 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f74e8021030 con 0x7f74f806e9d0 2023-10-03T10:12:34.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7f74f4ff9700 1 -- 172.21.15.72:0/1714200124 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f74e8041430 con 0x7f74f806e9d0 2023-10-03T10:12:34.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7f74f4ff9700 1 -- 172.21.15.72:0/1714200124 --> v1:172.21.15.72:6808/129702 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f74e403c430 con 0x7f74e4038730 2023-10-03T10:12:34.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7f74f4ff9700 1 -- 172.21.15.72:0/1714200124 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74e8043910 con 0x7f74f806e9d0 2023-10-03T10:12:34.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7f74f77fe700 1 -- 172.21.15.72:0/1714200124 >> v1:172.21.15.72:6816/126756 conn(0x7f74e402f560 legacy=0x7f74e4031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:34.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.874+0000 7fd8cdb9d700 1 --2- 172.21.15.72:0/996223653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8c809e1e0 0x7fd8c811e780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8016000 tx=0x7fd8b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:34.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.878+0000 7fd8beffd700 1 -- 172.21.15.72:0/996223653 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b801e070 con 0x7fd8c809e1e0 2023-10-03T10:12:34.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.878+0000 7fd8beffd700 1 -- 172.21.15.72:0/996223653 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b80039f0 con 0x7fd8c809e1e0 2023-10-03T10:12:34.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.878+0000 7fd8beffd700 1 -- 172.21.15.72:0/996223653 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8003de0 con 0x7fd8c809e1e0 2023-10-03T10:12:34.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.878+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/996223653 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c8120af0 con 0x7fd8c809e1e0 2023-10-03T10:12:34.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.878+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/996223653 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c80a1f80 con 0x7fd8c809e1e0 2023-10-03T10:12:34.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.879+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/996223653 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8c809a930 con 0x7fd8c809e1e0 2023-10-03T10:12:34.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.880+0000 7f74f4ff9700 1 -- 172.21.15.72:0/1714200124 <== osd.2 v1:172.21.15.72:6808/129702 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f74e403c430 con 0x7f74e4038730 2023-10-03T10:12:34.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.880+0000 7fd8beffd700 1 -- 172.21.15.72:0/996223653 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd8b80193f0 con 0x7fd8c809e1e0 2023-10-03T10:12:34.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.881+0000 7fd8beffd700 1 -- 172.21.15.72:0/996223653 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd8b8041830 con 0x7fd8c809e1e0 2023-10-03T10:12:34.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.881+0000 7fd8ce39e700 1 -- 172.21.15.72:0/996223653 >> v1:172.21.15.72:6816/126756 conn(0x7fd8ac02f510 legacy=0x7fd8ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:34.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.881+0000 7fd8beffd700 1 -- 172.21.15.72:0/996223653 --> v1:172.21.15.72:6804/129472 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8ac03c2e0 con 0x7fd8ac0385e0 2023-10-03T10:12:34.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.881+0000 7fd8beffd700 1 -- 172.21.15.72:0/996223653 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8b8041c50 con 0x7fd8c809e1e0 2023-10-03T10:12:34.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.883+0000 7fd8beffd700 1 -- 172.21.15.72:0/996223653 <== osd.0 v1:172.21.15.72:6804/129472 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7fd8ac03c2e0 con 0x7fd8ac0385e0 2023-10-03T10:12:34.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.884+0000 7fa2a3ada700 1 -- 172.21.15.72:0/256463527 --> v1:172.21.15.72:6812/130020 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa29c070e10 con 0x7fa29c1c8360 2023-10-03T10:12:34.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.885+0000 7fa2927fc700 1 -- 172.21.15.72:0/256463527 <== osd.3 v1:172.21.15.72:6812/130020 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3191560019) 0x7fa294001670 con 0x7fa29c1c8360 2023-10-03T10:12:34.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.890+0000 7fa2a3ada700 1 -- 172.21.15.72:0/256463527 >> v1:172.21.15.72:6812/130020 conn(0x7fa29c1c8360 legacy=0x7fa29c1c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.890+0000 7fa2a3ada700 1 -- 172.21.15.72:0/256463527 >> v1:172.21.15.72:6816/126756 conn(0x7fa28002f510 legacy=0x7fa2800319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:34.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.890+0000 7fa2a3ada700 1 -- 172.21.15.72:0/256463527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa29c130540 msgr2=0x7fa29c11f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.890+0000 7fa2a3ada700 1 --2- 172.21.15.72:0/256463527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa29c130540 0x7fa29c11f3b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00ecf0 tx=0x7fa28c00bf70 comp rx=0 tx=0).stop 2023-10-03T10:12:34.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.890+0000 7fa2a2077700 1 -- 172.21.15.72:0/256463527 reap_dead start 2023-10-03T10:12:34.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.890+0000 7fa2a3ada700 1 -- 172.21.15.72:0/256463527 shutdown_connections 2023-10-03T10:12:34.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.890+0000 7fa2a3ada700 1 -- 172.21.15.72:0/256463527 >> 172.21.15.72:0/256463527 conn(0x7fa29c0a2aa0 msgr2=0x7fa29c06e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.890+0000 7fa2a3ada700 1 -- 172.21.15.72:0/256463527 shutdown_connections 2023-10-03T10:12:34.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.890+0000 7fa2a3ada700 1 -- 172.21.15.72:0/256463527 wait complete. 2023-10-03T10:12:34.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.897+0000 7f74de7fc700 1 -- 172.21.15.72:0/1714200124 --> v1:172.21.15.72:6808/129702 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f74d0002d00 con 0x7f74e4038730 2023-10-03T10:12:34.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.897+0000 7f74f4ff9700 1 -- 172.21.15.72:0/1714200124 <== osd.2 v1:172.21.15.72:6808/129702 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1985872850) 0x7f74d0002d00 con 0x7f74e4038730 2023-10-03T10:12:34.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.898+0000 7f74de7fc700 1 -- 172.21.15.72:0/1714200124 >> v1:172.21.15.72:6808/129702 conn(0x7f74e4038730 legacy=0x7f74e403abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.898+0000 7f74de7fc700 1 -- 172.21.15.72:0/1714200124 >> v1:172.21.15.72:6816/126756 conn(0x7f74e402f560 legacy=0x7f74e4031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:34.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.898+0000 7f74de7fc700 1 -- 172.21.15.72:0/1714200124 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f74f806e9d0 msgr2=0x7f74f812b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.898+0000 7f74de7fc700 1 --2- 172.21.15.72:0/1714200124 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f74f806e9d0 0x7f74f812b270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009130 tx=0x7f74e8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:34.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.898+0000 7f74fca90700 1 -- 172.21.15.72:0/1714200124 reap_dead start 2023-10-03T10:12:34.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.898+0000 7f74de7fc700 1 -- 172.21.15.72:0/1714200124 shutdown_connections 2023-10-03T10:12:34.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.898+0000 7f74de7fc700 1 -- 172.21.15.72:0/1714200124 >> 172.21.15.72:0/1714200124 conn(0x7f74f80a2aa0 msgr2=0x7f74f81300b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.898+0000 7f74de7fc700 1 -- 172.21.15.72:0/1714200124 shutdown_connections 2023-10-03T10:12:34.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.898+0000 7f74de7fc700 1 -- 172.21.15.72:0/1714200124 wait complete. 2023-10-03T10:12:34.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.899+0000 7f8ff5c40700 1 -- 172.21.15.72:0/1321637897 --> v1:172.21.15.72:6800/129570 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8ff0134ff0 con 0x7f8fdc038660 2023-10-03T10:12:34.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.900+0000 7f8fd7fff700 1 -- 172.21.15.72:0/1321637897 <== osd.1 v1:172.21.15.72:6800/129570 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2085588430) 0x7f8fe4009540 con 0x7f8fdc038660 2023-10-03T10:12:34.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.902+0000 7f8ff5c40700 1 -- 172.21.15.72:0/1321637897 >> v1:172.21.15.72:6800/129570 conn(0x7f8fdc038660 legacy=0x7f8fdc03aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.902+0000 7f8ff5c40700 1 -- 172.21.15.72:0/1321637897 >> v1:172.21.15.72:6816/126756 conn(0x7f8fdc02f510 legacy=0x7f8fdc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:34.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.902+0000 7f8ff5c40700 1 -- 172.21.15.72:0/1321637897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ff0122eb0 msgr2=0x7f8ff01cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.902+0000 7f8ff5c40700 1 --2- 172.21.15.72:0/1321637897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ff0122eb0 0x7f8ff01cca00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0071020 tx=0x7f8fe0004750 comp rx=0 tx=0).stop 2023-10-03T10:12:34.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.902+0000 7f8feffff700 1 -- 172.21.15.72:0/1321637897 reap_dead start 2023-10-03T10:12:34.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.902+0000 7f8ff5c40700 1 -- 172.21.15.72:0/1321637897 shutdown_connections 2023-10-03T10:12:34.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.902+0000 7f8ff5c40700 1 -- 172.21.15.72:0/1321637897 >> 172.21.15.72:0/1321637897 conn(0x7f8ff00a2aa0 msgr2=0x7f8ff00a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.902+0000 7f8ff5c40700 1 -- 172.21.15.72:0/1321637897 shutdown_connections 2023-10-03T10:12:34.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.902+0000 7f8ff5c40700 1 -- 172.21.15.72:0/1321637897 wait complete. 2023-10-03T10:12:34.903 INFO:teuthology.orchestra.run.smithi072.stdout:137438953475 2023-10-03T10:12:34.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:34.911 INFO:teuthology.orchestra.run.smithi072.stdout:133143986179 2023-10-03T10:12:34.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:34.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.912+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/996223653 --> v1:172.21.15.72:6804/129472 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd8c809c2c0 con 0x7fd8ac0385e0 2023-10-03T10:12:34.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.912+0000 7fd8beffd700 1 -- 172.21.15.72:0/996223653 <== osd.0 v1:172.21.15.72:6804/129472 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1318614166) 0x7fd8c00017f0 con 0x7fd8ac0385e0 2023-10-03T10:12:34.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.913+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/996223653 >> v1:172.21.15.72:6804/129472 conn(0x7fd8ac0385e0 legacy=0x7fd8ac03aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.913+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/996223653 >> v1:172.21.15.72:6816/126756 conn(0x7fd8ac02f510 legacy=0x7fd8ac0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:34.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.913+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/996223653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8c809e1e0 msgr2=0x7fd8c811e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:34.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.913+0000 7fd8cf3a0700 1 --2- 172.21.15.72:0/996223653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8c809e1e0 0x7fd8c811e780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8016000 tx=0x7fd8b8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:34.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.913+0000 7fd8ceb9f700 1 -- 172.21.15.72:0/996223653 reap_dead start 2023-10-03T10:12:34.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.913+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/996223653 shutdown_connections 2023-10-03T10:12:34.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.913+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/996223653 >> 172.21.15.72:0/996223653 conn(0x7fd8c80a2e20 msgr2=0x7fd8c81307e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:34.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.913+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/996223653 shutdown_connections 2023-10-03T10:12:34.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:34.913+0000 7fd8cf3a0700 1 -- 172.21.15.72:0/996223653 wait complete. 2023-10-03T10:12:34.919 INFO:teuthology.orchestra.run.smithi072.stdout:128849018883 2023-10-03T10:12:34.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:34.927 INFO:teuthology.orchestra.run.smithi072.stdout:124554051587 2023-10-03T10:12:34.927 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:35.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.053+0000 7f3d5e3f2700 1 Processor -- start 2023-10-03T10:12:35.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.053+0000 7f3d5e3f2700 1 -- start start 2023-10-03T10:12:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.054+0000 7f3d5e3f2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d580984f0 0x7f3d580988c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.054+0000 7f3d5e3f2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d5809d6f0 0x7f3d5809db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.054+0000 7f3d5e3f2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d58099620 con 0x7f3d5809e040 2023-10-03T10:12:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.054+0000 7f3d5e3f2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5809a9e0 con 0x7f3d5809d6f0 2023-10-03T10:12:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.054+0000 7f3d5e3f2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5809bce0 con 0x7f3d580984f0 2023-10-03T10:12:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.054+0000 7f3d57fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d580984f0 0x7f3d580988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.054+0000 7f3d577fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d5809d6f0 0x7f3d5809db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.054+0000 7f3d57fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d580984f0 0x7f3d580988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58360/0 (socket says 172.21.15.72:58360) 2023-10-03T10:12:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.054+0000 7f3d57fff700 1 -- 172.21.15.72:0/4264027710 learned_addr learned my addr 172.21.15.72:0/4264027710 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:35.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.054+0000 7f3d577fe700 1 -- 172.21.15.72:0/4264027710 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d580984f0 msgr2=0x7f3d580988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:35.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.054+0000 7f3d577fe700 1 --2- 172.21.15.72:0/4264027710 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d580984f0 0x7f3d580988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.054+0000 7f3d577fe700 1 -- 172.21.15.72:0/4264027710 >> v1:172.21.15.72:6789/0 conn(0x7f3d5809e040 legacy=0x7f3d581385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.054+0000 7f3d577fe700 1 -- 172.21.15.72:0/4264027710 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5809aca0 con 0x7f3d5809d6f0 2023-10-03T10:12:35.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.055+0000 7f3d577fe700 1 --2- 172.21.15.72:0/4264027710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5809d6f0 0x7f3d5809db00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009840 tx=0x7f3d4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4af3b95e628c87b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.055+0000 7f3d56ffd700 1 -- 172.21.15.72:0/4264027710 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c011830 con 0x7f3d5809d6f0 2023-10-03T10:12:35.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.055+0000 7f3d56ffd700 1 -- 172.21.15.72:0/4264027710 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c011990 con 0x7f3d5809d6f0 2023-10-03T10:12:35.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.055+0000 7f3d56ffd700 1 -- 172.21.15.72:0/4264027710 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c011d20 con 0x7f3d5809d6f0 2023-10-03T10:12:35.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.055+0000 7f04e179b700 1 Processor -- start 2023-10-03T10:12:35.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f3d5e3f2700 1 -- 172.21.15.72:0/4264027710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5809d6f0 msgr2=0x7f3d5809db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f3d5e3f2700 1 --2- 172.21.15.72:0/4264027710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5809d6f0 0x7f3d5809db00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009840 tx=0x7f3d4c009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:35.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f3d5e3f2700 1 -- 172.21.15.72:0/4264027710 shutdown_connections 2023-10-03T10:12:35.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f3d5e3f2700 1 --2- 172.21.15.72:0/4264027710 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d580984f0 0x7f3d580988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f3d5e3f2700 1 --2- 172.21.15.72:0/4264027710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5809d6f0 0x7f3d5809db00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f3d5e3f2700 1 -- 172.21.15.72:0/4264027710 >> 172.21.15.72:0/4264027710 conn(0x7f3d5809f470 msgr2=0x7f3d580a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f3d5e3f2700 1 -- 172.21.15.72:0/4264027710 shutdown_connections 2023-10-03T10:12:35.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f3d5e3f2700 1 -- 172.21.15.72:0/4264027710 wait complete. 2023-10-03T10:12:35.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f04e179b700 1 -- start start 2023-10-03T10:12:35.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f04e179b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04dc09d6f0 0x7f04dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f04e179b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04dc09e410 0x7f04dc130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f04e179b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04dc09f130 con 0x7f04dc09e000 2023-10-03T10:12:35.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f04e179b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc09f520 con 0x7f04dc09d6f0 2023-10-03T10:12:35.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f04e179b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc09e930 con 0x7f04dc09e410 2023-10-03T10:12:35.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f04da7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f04dc09e000 0x7f04dc130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36328/0 (socket says 172.21.15.72:36328) 2023-10-03T10:12:35.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f04da7fc700 1 -- 172.21.15.72:0/3559947005 learned_addr learned my addr 172.21.15.72:0/3559947005 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:35.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f04db7fe700 1 --2- 172.21.15.72:0/3559947005 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04dc09e410 0x7f04dc130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.056+0000 7f04d9ffb700 1 -- 172.21.15.72:0/3559947005 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236037715 0 0) 0x7f04dc09f130 con 0x7f04dc09e000 2023-10-03T10:12:35.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.057+0000 7f04d9ffb700 1 -- 172.21.15.72:0/3559947005 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04c40057c0 con 0x7f04dc09e000 2023-10-03T10:12:35.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.057+0000 7f04db7fe700 1 -- 172.21.15.72:0/3559947005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04dc09d6f0 msgr2=0x7f04dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:35.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.057+0000 7f04db7fe700 1 --2- 172.21.15.72:0/3559947005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04dc09d6f0 0x7f04dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.057+0000 7f04db7fe700 1 -- 172.21.15.72:0/3559947005 >> v1:172.21.15.72:6789/0 conn(0x7f04dc09e000 legacy=0x7f04dc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.057+0000 7f04db7fe700 1 -- 172.21.15.72:0/3559947005 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc09b2d0 con 0x7f04dc09e410 2023-10-03T10:12:35.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.057+0000 7f04db7fe700 1 --2- 172.21.15.72:0/3559947005 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04dc09e410 0x7f04dc130d70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009dc0 tx=0x7f04d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d49f0d3059bd0c1b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.057+0000 7f3d5e3f2700 1 Processor -- start 2023-10-03T10:12:35.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.057+0000 7f3d5e3f2700 1 -- start start 2023-10-03T10:12:35.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f04d9ffb700 1 -- 172.21.15.72:0/3559947005 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d400e070 con 0x7f04dc09e410 2023-10-03T10:12:35.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f04d9ffb700 1 -- 172.21.15.72:0/3559947005 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d400bb20 con 0x7f04dc09e410 2023-10-03T10:12:35.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f04d9ffb700 1 -- 172.21.15.72:0/3559947005 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4012430 con 0x7f04dc09e410 2023-10-03T10:12:35.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f3d5e3f2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d580984f0 0x7f3d581c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f3d5e3f2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5809d6f0 0x7f3d581c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f3d5e3f2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d5809e040 0x7f3d581c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f3d5e3f2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5812e5d0 con 0x7f3d5809d6f0 2023-10-03T10:12:35.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f3d5e3f2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5808b460 con 0x7f3d580984f0 2023-10-03T10:12:35.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f3d5e3f2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5809a2b0 con 0x7f3d5809e040 2023-10-03T10:12:35.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f3d5c98f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d5809e040 0x7f3d581c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f3d5c98f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d5809e040 0x7f3d581c6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58390/0 (socket says 172.21.15.72:58390) 2023-10-03T10:12:35.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f3d5c98f700 1 -- 172.21.15.72:0/2054509812 learned_addr learned my addr 172.21.15.72:0/2054509812 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:35.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f3d5c98f700 1 -- 172.21.15.72:0/2054509812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d580984f0 msgr2=0x7f3d581c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f3d5c98f700 1 --2- 172.21.15.72:0/2054509812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d580984f0 0x7f3d581c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f3d5c98f700 1 -- 172.21.15.72:0/2054509812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5809d6f0 msgr2=0x7f3d581c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f3d5c98f700 1 --2- 172.21.15.72:0/2054509812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5809d6f0 0x7f3d581c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f3d5c98f700 1 -- 172.21.15.72:0/2054509812 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c0094a0 con 0x7f3d5809e040 2023-10-03T10:12:35.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f3d5c98f700 1 --2- 172.21.15.72:0/2054509812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d5809e040 0x7f3d581c6e10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000cc80 tx=0x7f3d5000a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f04e179b700 1 -- 172.21.15.72:0/3559947005 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04dc09e410 msgr2=0x7f04dc130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.058+0000 7f04e179b700 1 --2- 172.21.15.72:0/3559947005 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04dc09e410 0x7f04dc130d70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009dc0 tx=0x7f04d400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:35.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.059+0000 7f3d54ff9700 1 -- 172.21.15.72:0/2054509812 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000ad40 con 0x7f3d5809e040 2023-10-03T10:12:35.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.059+0000 7f3d54ff9700 1 -- 172.21.15.72:0/2054509812 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5000ce80 con 0x7f3d5809e040 2023-10-03T10:12:35.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.059+0000 7f3d54ff9700 1 -- 172.21.15.72:0/2054509812 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000aea0 con 0x7f3d5809e040 2023-10-03T10:12:35.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.059+0000 7f3d5e3f2700 1 -- 172.21.15.72:0/2054509812 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5812e230 con 0x7f3d5809e040 2023-10-03T10:12:35.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.059+0000 7f3d5e3f2700 1 -- 172.21.15.72:0/2054509812 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5808afd0 con 0x7f3d5809e040 2023-10-03T10:12:35.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.059+0000 7f3d54ff9700 1 -- 172.21.15.72:0/2054509812 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3d50003c40 con 0x7f3d5809e040 2023-10-03T10:12:35.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.060+0000 7f3d54ff9700 1 -- 172.21.15.72:0/2054509812 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f3d5003fdd0 con 0x7f3d5809e040 2023-10-03T10:12:35.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.060+0000 7f3d57fff700 1 -- 172.21.15.72:0/2054509812 >> v1:172.21.15.72:6816/126756 conn(0x7f3d4402f510 legacy=0x7f3d440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:35.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.059+0000 7f04e179b700 1 -- 172.21.15.72:0/3559947005 shutdown_connections 2023-10-03T10:12:35.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.059+0000 7f04e179b700 1 --2- 172.21.15.72:0/3559947005 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04dc09e410 0x7f04dc130d70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.059+0000 7f04e179b700 1 --2- 172.21.15.72:0/3559947005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04dc09d6f0 0x7f04dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.059+0000 7f04e179b700 1 -- 172.21.15.72:0/3559947005 >> 172.21.15.72:0/3559947005 conn(0x7f04dc066f50 msgr2=0x7f04dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.060+0000 7f04e179b700 1 -- 172.21.15.72:0/3559947005 shutdown_connections 2023-10-03T10:12:35.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.060+0000 7f04e179b700 1 -- 172.21.15.72:0/3559947005 wait complete. 2023-10-03T10:12:35.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.060+0000 7f3d5e3f2700 1 -- 172.21.15.72:0/2054509812 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d580747f0 con 0x7f3d5809e040 2023-10-03T10:12:35.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.061+0000 7f04e179b700 1 Processor -- start 2023-10-03T10:12:35.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.061+0000 7f04e179b700 1 -- start start 2023-10-03T10:12:35.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04e179b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04dc09d6f0 0x7f04dc1224f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04e179b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04dc09e000 0x7f04dc122a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04e179b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04dc09e410 0x7f04dc122f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04e179b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc125d30 con 0x7f04dc09e000 2023-10-03T10:12:35.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04e179b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc072020 con 0x7f04dc09d6f0 2023-10-03T10:12:35.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04e179b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc1241a0 con 0x7f04dc09e410 2023-10-03T10:12:35.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04da7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04dc09e000 0x7f04dc122a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04da7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04dc09e000 0x7f04dc122a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38080/0 (socket says 172.21.15.72:38080) 2023-10-03T10:12:35.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04da7fc700 1 -- 172.21.15.72:0/2526807928 learned_addr learned my addr 172.21.15.72:0/2526807928 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:35.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04daffd700 1 --2- 172.21.15.72:0/2526807928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04dc09d6f0 0x7f04dc1224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04db7fe700 1 --2- 172.21.15.72:0/2526807928 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04dc09e410 0x7f04dc122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04da7fc700 1 -- 172.21.15.72:0/2526807928 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04dc09e410 msgr2=0x7f04dc122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04da7fc700 1 --2- 172.21.15.72:0/2526807928 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04dc09e410 0x7f04dc122f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04da7fc700 1 -- 172.21.15.72:0/2526807928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04dc09d6f0 msgr2=0x7f04dc1224f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04da7fc700 1 --2- 172.21.15.72:0/2526807928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04dc09d6f0 0x7f04dc1224f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.062+0000 7f04da7fc700 1 -- 172.21.15.72:0/2526807928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d4009a70 con 0x7f04dc09e000 2023-10-03T10:12:35.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.063+0000 7f04da7fc700 1 --2- 172.21.15.72:0/2526807928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04dc09e000 0x7f04dc122a30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f04d0005910 tx=0x7f04d000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.063+0000 7f04c37fe700 1 -- 172.21.15.72:0/2526807928 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0005d70 con 0x7f04dc09e000 2023-10-03T10:12:35.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.063+0000 7f04c37fe700 1 -- 172.21.15.72:0/2526807928 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d00070d0 con 0x7f04dc09e000 2023-10-03T10:12:35.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.063+0000 7f04c37fe700 1 -- 172.21.15.72:0/2526807928 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0007440 con 0x7f04dc09e000 2023-10-03T10:12:35.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.063+0000 7f04e179b700 1 -- 172.21.15.72:0/2526807928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc1248f0 con 0x7f04dc09e000 2023-10-03T10:12:35.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.063+0000 7f04e179b700 1 -- 172.21.15.72:0/2526807928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc130410 con 0x7f04dc09e000 2023-10-03T10:12:35.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.064+0000 7f04c37fe700 1 -- 172.21.15.72:0/2526807928 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f04d00075a0 con 0x7f04dc09e000 2023-10-03T10:12:35.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.064+0000 7f04c37fe700 1 -- 172.21.15.72:0/2526807928 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f04d003f090 con 0x7f04dc09e000 2023-10-03T10:12:35.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.064+0000 7f04daffd700 1 -- 172.21.15.72:0/2526807928 >> v1:172.21.15.72:6816/126756 conn(0x7f04c802f510 legacy=0x7f04c80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:35.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.064+0000 7f04e179b700 1 -- 172.21.15.72:0/2526807928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc0052e0 con 0x7f04dc09e000 2023-10-03T10:12:35.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.066+0000 7f3d54ff9700 1 -- 172.21.15.72:0/2054509812 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d500050d0 con 0x7f3d5809e040 2023-10-03T10:12:35.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.069+0000 7f04c37fe700 1 -- 172.21.15.72:0/2526807928 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04d0017020 con 0x7f04dc09e000 2023-10-03T10:12:35.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.098+0000 7fb3fe4c7700 1 Processor -- start 2023-10-03T10:12:35.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.098+0000 7fb3fe4c7700 1 -- start start 2023-10-03T10:12:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3fe4c7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f809e930 0x7fb3f809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3fe4c7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f809f240 0x7fb3f81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3fe4c7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb3f809f650 0x7fb3f8131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3fe4c7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f8070940 con 0x7fb3f809f650 2023-10-03T10:12:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3fe4c7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f806fd60 con 0x7fb3f809e930 2023-10-03T10:12:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3fe4c7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f806fa80 con 0x7fb3f809f240 2023-10-03T10:12:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3f7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f809e930 0x7fb3f809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3f7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f809e930 0x7fb3f809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34286/0 (socket says 172.21.15.72:34286) 2023-10-03T10:12:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3f7fff700 1 -- 172.21.15.72:0/420793617 learned_addr learned my addr 172.21.15.72:0/420793617 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3f77fe700 1 --2- 172.21.15.72:0/420793617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f809f240 0x7fb3f81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3f77fe700 1 -- 172.21.15.72:0/420793617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f809e930 msgr2=0x7fb3f809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:35.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3f77fe700 1 --2- 172.21.15.72:0/420793617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f809e930 0x7fb3f809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3f77fe700 1 -- 172.21.15.72:0/420793617 >> v2:172.21.15.72:3300/0 conn(0x7fb3f809f650 msgr2=0x7fb3f8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:35.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3f77fe700 1 --2- 172.21.15.72:0/420793617 >> v2:172.21.15.72:3300/0 conn(0x7fb3f809f650 0x7fb3f8131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3f77fe700 1 -- 172.21.15.72:0/420793617 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f809fb60 con 0x7fb3f809f240 2023-10-03T10:12:35.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.099+0000 7fb3f7fff700 1 --2- 172.21.15.72:0/420793617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f809e930 0x7fb3f809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:35.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.100+0000 7fb3f77fe700 1 --2- 172.21.15.72:0/420793617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f809f240 0x7fb3f81317f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec009840 tx=0x7fb3ec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49f1f806b1de57d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.100+0000 7fb3f6ffd700 1 -- 172.21.15.72:0/420793617 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec011830 con 0x7fb3f809f240 2023-10-03T10:12:35.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.100+0000 7fb3f6ffd700 1 -- 172.21.15.72:0/420793617 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec011990 con 0x7fb3f809f240 2023-10-03T10:12:35.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.100+0000 7fb3f6ffd700 1 -- 172.21.15.72:0/420793617 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec011d20 con 0x7fb3f809f240 2023-10-03T10:12:35.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.101+0000 7fb3fe4c7700 1 -- 172.21.15.72:0/420793617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f809f240 msgr2=0x7fb3f81317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.101+0000 7fb3fe4c7700 1 --2- 172.21.15.72:0/420793617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f809f240 0x7fb3f81317f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec009840 tx=0x7fb3ec009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:35.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.101+0000 7fb3fe4c7700 1 -- 172.21.15.72:0/420793617 shutdown_connections 2023-10-03T10:12:35.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.101+0000 7fb3fe4c7700 1 --2- 172.21.15.72:0/420793617 >> v2:172.21.15.72:3300/0 conn(0x7fb3f809f650 0x7fb3f8131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.101+0000 7fb3fe4c7700 1 --2- 172.21.15.72:0/420793617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f809e930 0x7fb3f809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.101+0000 7fb3fe4c7700 1 --2- 172.21.15.72:0/420793617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f809f240 0x7fb3f81317f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.101+0000 7fb3fe4c7700 1 -- 172.21.15.72:0/420793617 >> 172.21.15.72:0/420793617 conn(0x7fb3f80a4210 msgr2=0x7fb3f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.101+0000 7fb3fe4c7700 1 -- 172.21.15.72:0/420793617 shutdown_connections 2023-10-03T10:12:35.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.101+0000 7fb3fe4c7700 1 -- 172.21.15.72:0/420793617 wait complete. 2023-10-03T10:12:35.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.102+0000 7fb3fe4c7700 1 Processor -- start 2023-10-03T10:12:35.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.102+0000 7fb3fe4c7700 1 -- start start 2023-10-03T10:12:35.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.102+0000 7fb3fe4c7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f809e930 0x7fb3f806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.102+0000 7fb3fe4c7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3f809f240 0x7fb3f806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.102+0000 7fb3fe4c7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f809f650 0x7fb3f806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.102+0000 7fb3fe4c7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f81a9760 con 0x7fb3f809f240 2023-10-03T10:12:35.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.102+0000 7fb3fe4c7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f81b72d0 con 0x7fb3f809e930 2023-10-03T10:12:35.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.102+0000 7fb3fe4c7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f80a3730 con 0x7fb3f809f650 2023-10-03T10:12:35.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.102+0000 7fb3f7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f809e930 0x7fb3f806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.102+0000 7fb3fca64700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f809f650 0x7fb3f806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.102+0000 7fb3f7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f809e930 0x7fb3f806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34290/0 (socket says 172.21.15.72:34290) 2023-10-03T10:12:35.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.102+0000 7fb3f7fff700 1 -- 172.21.15.72:0/2136413785 learned_addr learned my addr 172.21.15.72:0/2136413785 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.103+0000 7fb3fca64700 1 -- 172.21.15.72:0/2136413785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f809e930 msgr2=0x7fb3f806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.103+0000 7fb3fca64700 1 --2- 172.21.15.72:0/2136413785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f809e930 0x7fb3f806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.103+0000 7fb3fca64700 1 -- 172.21.15.72:0/2136413785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3f809f240 msgr2=0x7fb3f806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.103+0000 7fb3fca64700 1 --2- 172.21.15.72:0/2136413785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3f809f240 0x7fb3f806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.103+0000 7fb3fca64700 1 -- 172.21.15.72:0/2136413785 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e8009550 con 0x7fb3f809f650 2023-10-03T10:12:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.103+0000 7fb3fca64700 1 --2- 172.21.15.72:0/2136413785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f809f650 0x7fb3f806c330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000be20 tx=0x7fb3f0009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.103+0000 7fb3f4ff9700 1 -- 172.21.15.72:0/2136413785 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f000cc10 con 0x7fb3f809f650 2023-10-03T10:12:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.103+0000 7fb3f4ff9700 1 -- 172.21.15.72:0/2136413785 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f000cd70 con 0x7fb3f809f650 2023-10-03T10:12:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.103+0000 7fb3fe4c7700 1 -- 172.21.15.72:0/2136413785 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ec0094a0 con 0x7fb3f809f650 2023-10-03T10:12:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.103+0000 7fb3fe4c7700 1 -- 172.21.15.72:0/2136413785 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f80a0190 con 0x7fb3f809f650 2023-10-03T10:12:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.103+0000 7fb3f4ff9700 1 -- 172.21.15.72:0/2136413785 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0014680 con 0x7fb3f809f650 2023-10-03T10:12:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.104+0000 7fb3f4ff9700 1 -- 172.21.15.72:0/2136413785 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb3f001d3b0 con 0x7fb3f809f650 2023-10-03T10:12:35.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.104+0000 7fb3f7fff700 1 -- 172.21.15.72:0/2136413785 >> v1:172.21.15.72:6816/126756 conn(0x7fb3e402f510 legacy=0x7fb3e40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:35.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.104+0000 7fb3f4ff9700 1 -- 172.21.15.72:0/2136413785 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fb3f0006e40 con 0x7fb3f809f650 2023-10-03T10:12:35.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.106+0000 7fb3fe4c7700 1 -- 172.21.15.72:0/2136413785 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d80052e0 con 0x7fb3f809f650 2023-10-03T10:12:35.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.110+0000 7fb3f4ff9700 1 -- 172.21.15.72:0/2136413785 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3f0019030 con 0x7fb3f809f650 2023-10-03T10:12:35.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.114+0000 7fcb0a6db700 1 Processor -- start 2023-10-03T10:12:35.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.114+0000 7fcb0a6db700 1 -- start start 2023-10-03T10:12:35.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.115+0000 7fcb0a6db700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb0406f5d0 0x7fcb0412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.115+0000 7fcb0a6db700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb04135c20 0x7fcb04138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.115+0000 7fcb0a6db700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0406fa40 con 0x7fcb0412cf60 2023-10-03T10:12:35.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.115+0000 7fcb0a6db700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0412cd90 con 0x7fcb04135c20 2023-10-03T10:12:35.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.115+0000 7fcb0a6db700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb04071780 con 0x7fcb0406f5d0 2023-10-03T10:12:35.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.115+0000 7fcb037fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb0406f5d0 0x7fcb0412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.115+0000 7fcb037fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb0406f5d0 0x7fcb0412ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34294/0 (socket says 172.21.15.72:34294) 2023-10-03T10:12:35.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.115+0000 7fcb037fe700 1 -- 172.21.15.72:0/214353757 learned_addr learned my addr 172.21.15.72:0/214353757 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:35.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.115+0000 7fcb08c78700 1 --2- 172.21.15.72:0/214353757 >> v2:172.21.15.72:3300/0 conn(0x7fcb04135c20 0x7fcb04138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.115+0000 7fcb037fe700 1 -- 172.21.15.72:0/214353757 >> v2:172.21.15.72:3300/0 conn(0x7fcb04135c20 msgr2=0x7fcb04138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:35.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.115+0000 7fcb037fe700 1 --2- 172.21.15.72:0/214353757 >> v2:172.21.15.72:3300/0 conn(0x7fcb04135c20 0x7fcb04138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.115+0000 7fcb037fe700 1 -- 172.21.15.72:0/214353757 >> v1:172.21.15.72:6789/0 conn(0x7fcb0412cf60 legacy=0x7fcb0412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:35.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.115+0000 7fcb037fe700 1 -- 172.21.15.72:0/214353757 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb04071a40 con 0x7fcb0406f5d0 2023-10-03T10:12:35.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.115+0000 7fcb037fe700 1 --2- 172.21.15.72:0/214353757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb0406f5d0 0x7fcb0412ffc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800bb90 tx=0x7fcaf800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed51bb78ec92e18b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.116+0000 7fcb02ffd700 1 -- 172.21.15.72:0/214353757 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800dd10 con 0x7fcb0406f5d0 2023-10-03T10:12:35.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.116+0000 7fcb02ffd700 1 -- 172.21.15.72:0/214353757 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf800de70 con 0x7fcb0406f5d0 2023-10-03T10:12:35.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.116+0000 7fcb02ffd700 1 -- 172.21.15.72:0/214353757 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8004230 con 0x7fcb0406f5d0 2023-10-03T10:12:35.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.116+0000 7fcb0a6db700 1 -- 172.21.15.72:0/214353757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb0406f5d0 msgr2=0x7fcb0412ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.116+0000 7fcb0a6db700 1 --2- 172.21.15.72:0/214353757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb0406f5d0 0x7fcb0412ffc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800bb90 tx=0x7fcaf800bea0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.116+0000 7fcb0a6db700 1 -- 172.21.15.72:0/214353757 shutdown_connections 2023-10-03T10:12:35.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.116+0000 7fcb0a6db700 1 --2- 172.21.15.72:0/214353757 >> v2:172.21.15.72:3300/0 conn(0x7fcb04135c20 0x7fcb04138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.116+0000 7fcb0a6db700 1 --2- 172.21.15.72:0/214353757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb0406f5d0 0x7fcb0412ffc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.116+0000 7fcb0a6db700 1 -- 172.21.15.72:0/214353757 >> 172.21.15.72:0/214353757 conn(0x7fcb040a2aa0 msgr2=0x7fcb040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.116+0000 7fcb0a6db700 1 -- 172.21.15.72:0/214353757 shutdown_connections 2023-10-03T10:12:35.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.117+0000 7fcb0a6db700 1 -- 172.21.15.72:0/214353757 wait complete. 2023-10-03T10:12:35.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.117+0000 7fcb0a6db700 1 Processor -- start 2023-10-03T10:12:35.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb0a6db700 1 -- start start 2023-10-03T10:12:35.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb0a6db700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb0406f5d0 0x7fcb041c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb0a6db700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb0412cf60 0x7fcb041c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb0a6db700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb04135c20 0x7fcb041c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:35.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb0a6db700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0412ff00 con 0x7fcb0406f5d0 2023-10-03T10:12:35.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb0a6db700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0412fc70 con 0x7fcb0412cf60 2023-10-03T10:12:35.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb0a6db700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb040a1690 con 0x7fcb04135c20 2023-10-03T10:12:35.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb037fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb0412cf60 0x7fcb041c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb037fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb0412cf60 0x7fcb041c44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34302/0 (socket says 172.21.15.72:34302) 2023-10-03T10:12:35.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb037fe700 1 -- 172.21.15.72:0/1715477955 learned_addr learned my addr 172.21.15.72:0/1715477955 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:35.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb08c78700 1 --2- 172.21.15.72:0/1715477955 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb04135c20 0x7fcb041c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:35.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb037fe700 1 -- 172.21.15.72:0/1715477955 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb04135c20 msgr2=0x7fcb041c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb037fe700 1 --2- 172.21.15.72:0/1715477955 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb04135c20 0x7fcb041c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb037fe700 1 -- 172.21.15.72:0/1715477955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb0406f5d0 msgr2=0x7fcb041c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb037fe700 1 --2- 172.21.15.72:0/1715477955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb0406f5d0 0x7fcb041c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.118+0000 7fcb037fe700 1 -- 172.21.15.72:0/1715477955 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf800b7f0 con 0x7fcb0412cf60 2023-10-03T10:12:35.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.119+0000 7fcb037fe700 1 --2- 172.21.15.72:0/1715477955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb0412cf60 0x7fcb041c44b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800d5d0 tx=0x7fcaf8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:35.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.119+0000 7fcb00ff9700 1 -- 172.21.15.72:0/1715477955 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80045e0 con 0x7fcb0412cf60 2023-10-03T10:12:35.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.119+0000 7fcb0a6db700 1 -- 172.21.15.72:0/1715477955 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0412e980 con 0x7fcb0412cf60 2023-10-03T10:12:35.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.119+0000 7fcb0a6db700 1 -- 172.21.15.72:0/1715477955 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0409e6f0 con 0x7fcb0412cf60 2023-10-03T10:12:35.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.119+0000 7fcb00ff9700 1 -- 172.21.15.72:0/1715477955 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf80224d0 con 0x7fcb0412cf60 2023-10-03T10:12:35.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.119+0000 7fcb00ff9700 1 -- 172.21.15.72:0/1715477955 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8006d00 con 0x7fcb0412cf60 2023-10-03T10:12:35.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.120+0000 7fcb00ff9700 1 -- 172.21.15.72:0/1715477955 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fcaf8022880 con 0x7fcb0412cf60 2023-10-03T10:12:35.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.120+0000 7fcb0a6db700 1 -- 172.21.15.72:0/1715477955 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae40052e0 con 0x7fcb0412cf60 2023-10-03T10:12:35.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.120+0000 7fcb00ff9700 1 -- 172.21.15.72:0/1715477955 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fcaf8045090 con 0x7fcb0412cf60 2023-10-03T10:12:35.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.120+0000 7fcb03fff700 1 -- 172.21.15.72:0/1715477955 >> v1:172.21.15.72:6816/126756 conn(0x7fcaf002f510 legacy=0x7fcaf00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:35.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.129+0000 7fcb00ff9700 1 -- 172.21.15.72:0/1715477955 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcaf802ad40 con 0x7fcb0412cf60 2023-10-03T10:12:35.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.261+0000 7f3d57fff700 1 -- 172.21.15.72:0/2054509812 >> v1:172.21.15.72:6816/126756 conn(0x7f3d4402f510 legacy=0x7f3d440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:35.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.265+0000 7f04daffd700 1 -- 172.21.15.72:0/2526807928 >> v1:172.21.15.72:6816/126756 conn(0x7f04c802f510 legacy=0x7f04c80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.272+0000 7f04e179b700 1 -- 172.21.15.72:0/2526807928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f04bc005860 con 0x7f04dc09e000 2023-10-03T10:12:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.273+0000 7f04c37fe700 1 -- 172.21.15.72:0/2526807928 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f04d0019b40 con 0x7f04dc09e000 2023-10-03T10:12:35.272 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.276+0000 7f04e179b700 1 -- 172.21.15.72:0/2526807928 >> v1:172.21.15.72:6816/126756 conn(0x7f04c802f510 legacy=0x7f04c80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.276+0000 7f04e179b700 1 -- 172.21.15.72:0/2526807928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04dc09e000 msgr2=0x7f04dc122a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.276+0000 7f04e179b700 1 --2- 172.21.15.72:0/2526807928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04dc09e000 0x7f04dc122a30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f04d0005910 tx=0x7f04d000c9e0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.276+0000 7f04e179b700 1 -- 172.21.15.72:0/2526807928 shutdown_connections 2023-10-03T10:12:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.276+0000 7f04e179b700 1 --2- 172.21.15.72:0/2526807928 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04dc09e410 0x7f04dc122f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.276+0000 7f04e179b700 1 --2- 172.21.15.72:0/2526807928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04dc09d6f0 0x7f04dc1224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.276+0000 7f04e179b700 1 --2- 172.21.15.72:0/2526807928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04dc09e000 0x7f04dc122a30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.276+0000 7f04e179b700 1 -- 172.21.15.72:0/2526807928 >> 172.21.15.72:0/2526807928 conn(0x7f04dc066f50 msgr2=0x7f04dc130a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.276+0000 7f04e179b700 1 -- 172.21.15.72:0/2526807928 shutdown_connections 2023-10-03T10:12:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.276+0000 7f04e179b700 1 -- 172.21.15.72:0/2526807928 wait complete. 2023-10-03T10:12:35.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:35.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.305+0000 7fb3f7fff700 1 -- 172.21.15.72:0/2136413785 >> v1:172.21.15.72:6816/126756 conn(0x7fb3e402f510 legacy=0x7fb3e40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:35.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.305+0000 7f3d5e3f2700 1 -- 172.21.15.72:0/2054509812 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3d5812e3c0 con 0x7f3d5809e040 2023-10-03T10:12:35.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.305+0000 7f3d54ff9700 1 -- 172.21.15.72:0/2054509812 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3d50019300 con 0x7f3d5809e040 2023-10-03T10:12:35.305 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:35.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.307+0000 7f3d5e3f2700 1 -- 172.21.15.72:0/2054509812 >> v1:172.21.15.72:6816/126756 conn(0x7f3d4402f510 legacy=0x7f3d440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:35.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.307+0000 7f3d5e3f2700 1 -- 172.21.15.72:0/2054509812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d5809e040 msgr2=0x7f3d581c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.307+0000 7f3d5e3f2700 1 --2- 172.21.15.72:0/2054509812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d5809e040 0x7f3d581c6e10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000cc80 tx=0x7f3d5000a340 comp rx=0 tx=0).stop 2023-10-03T10:12:35.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.307+0000 7f3d5e3f2700 1 -- 172.21.15.72:0/2054509812 shutdown_connections 2023-10-03T10:12:35.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.307+0000 7f3d5e3f2700 1 --2- 172.21.15.72:0/2054509812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d5809e040 0x7f3d581c6e10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.307+0000 7f3d5e3f2700 1 --2- 172.21.15.72:0/2054509812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d580984f0 0x7f3d581c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.307+0000 7f3d5e3f2700 1 --2- 172.21.15.72:0/2054509812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5809d6f0 0x7f3d581c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.307+0000 7f3d5e3f2700 1 -- 172.21.15.72:0/2054509812 >> 172.21.15.72:0/2054509812 conn(0x7f3d5809f470 msgr2=0x7f3d5809fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.307+0000 7f3d5e3f2700 1 -- 172.21.15.72:0/2054509812 shutdown_connections 2023-10-03T10:12:35.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.307+0000 7f3d5e3f2700 1 -- 172.21.15.72:0/2054509812 wait complete. 2023-10-03T10:12:35.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.318+0000 7fb3fe4c7700 1 -- 172.21.15.72:0/2136413785 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb3d8005860 con 0x7fb3f809f650 2023-10-03T10:12:35.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.318+0000 7fb3f4ff9700 1 -- 172.21.15.72:0/2136413785 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3f0019020 con 0x7fb3f809f650 2023-10-03T10:12:35.318 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:35.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.320+0000 7fb3fe4c7700 1 -- 172.21.15.72:0/2136413785 >> v1:172.21.15.72:6816/126756 conn(0x7fb3e402f510 legacy=0x7fb3e40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.320+0000 7fb3fe4c7700 1 -- 172.21.15.72:0/2136413785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f809f650 msgr2=0x7fb3f806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.320+0000 7fb3fe4c7700 1 --2- 172.21.15.72:0/2136413785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f809f650 0x7fb3f806c330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000be20 tx=0x7fb3f0009ed0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.320+0000 7fb3fe4c7700 1 -- 172.21.15.72:0/2136413785 shutdown_connections 2023-10-03T10:12:35.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.320+0000 7fb3fe4c7700 1 --2- 172.21.15.72:0/2136413785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f809f650 0x7fb3f806c330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.320+0000 7fb3fe4c7700 1 --2- 172.21.15.72:0/2136413785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f809e930 0x7fb3f806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.320+0000 7fb3fe4c7700 1 --2- 172.21.15.72:0/2136413785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3f809f240 0x7fb3f806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.320+0000 7fb3fe4c7700 1 -- 172.21.15.72:0/2136413785 >> 172.21.15.72:0/2136413785 conn(0x7fb3f80a4210 msgr2=0x7fb3f81b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.320+0000 7fb3fe4c7700 1 -- 172.21.15.72:0/2136413785 shutdown_connections 2023-10-03T10:12:35.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.320+0000 7fb3fe4c7700 1 -- 172.21.15.72:0/2136413785 wait complete. 2023-10-03T10:12:35.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.321+0000 7fcb03fff700 1 -- 172.21.15.72:0/1715477955 >> v1:172.21.15.72:6816/126756 conn(0x7fcaf002f510 legacy=0x7fcaf00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:35.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.347+0000 7fcb0a6db700 1 -- 172.21.15.72:0/1715477955 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcae4005860 con 0x7fcb0412cf60 2023-10-03T10:12:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.348+0000 7fcb00ff9700 1 -- 172.21.15.72:0/1715477955 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcaf802ab60 con 0x7fcb0412cf60 2023-10-03T10:12:35.347 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:35.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.350+0000 7fcb0a6db700 1 -- 172.21.15.72:0/1715477955 >> v1:172.21.15.72:6816/126756 conn(0x7fcaf002f510 legacy=0x7fcaf00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:35.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.350+0000 7fcb0a6db700 1 -- 172.21.15.72:0/1715477955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb0412cf60 msgr2=0x7fcb041c44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:35.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.350+0000 7fcb0a6db700 1 --2- 172.21.15.72:0/1715477955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb0412cf60 0x7fcb041c44b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800d5d0 tx=0x7fcaf8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:35.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.350+0000 7fcb0a6db700 1 -- 172.21.15.72:0/1715477955 shutdown_connections 2023-10-03T10:12:35.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.350+0000 7fcb0a6db700 1 --2- 172.21.15.72:0/1715477955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb0406f5d0 0x7fcb041c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.350+0000 7fcb0a6db700 1 --2- 172.21.15.72:0/1715477955 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb04135c20 0x7fcb041c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.350+0000 7fcb0a6db700 1 --2- 172.21.15.72:0/1715477955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb0412cf60 0x7fcb041c44b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:35.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.350+0000 7fcb0a6db700 1 -- 172.21.15.72:0/1715477955 >> 172.21.15.72:0/1715477955 conn(0x7fcb040a2aa0 msgr2=0x7fcb0412a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:35.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.350+0000 7fcb0a6db700 1 -- 172.21.15.72:0/1715477955 shutdown_connections 2023-10-03T10:12:35.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:35.350+0000 7fcb0a6db700 1 -- 172.21.15.72:0/1715477955 wait complete. 2023-10-03T10:12:35.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:36.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:36.320 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:36.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:36.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:36.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.438+0000 7f1f2fb17700 1 Processor -- start 2023-10-03T10:12:36.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.439+0000 7f1f2fb17700 1 -- start start 2023-10-03T10:12:36.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.439+0000 7f1f2fb17700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f28134630 0x7f1f28136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.439+0000 7f1f2fb17700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1f28136f50 0x7f1f28139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.439+0000 7f1f2fb17700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2809b4f0 con 0x7f1f28131810 2023-10-03T10:12:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.439+0000 7f1f2fb17700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f281313c0 con 0x7f1f28134630 2023-10-03T10:12:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.439+0000 7f1f2fb17700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2806e8c0 con 0x7f1f28136f50 2023-10-03T10:12:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.439+0000 7f1f2e0b4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1f28136f50 0x7f1f28139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.439+0000 7f1f2d0b2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f28134630 0x7f1f28136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.439+0000 7f1f2e0b4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1f28136f50 0x7f1f28139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58424/0 (socket says 172.21.15.72:58424) 2023-10-03T10:12:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.439+0000 7f1f2e0b4700 1 -- 172.21.15.72:0/607534459 learned_addr learned my addr 172.21.15.72:0/607534459 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.440+0000 7f1f2d0b2700 1 -- 172.21.15.72:0/607534459 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1f28136f50 msgr2=0x7f1f28139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.440+0000 7f1f2d0b2700 1 --2- 172.21.15.72:0/607534459 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1f28136f50 0x7f1f28139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.440+0000 7f1f2d0b2700 1 -- 172.21.15.72:0/607534459 >> v1:172.21.15.72:6789/0 conn(0x7f1f28131810 legacy=0x7f1f28131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.440+0000 7f1f2d0b2700 1 -- 172.21.15.72:0/607534459 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f28071d20 con 0x7f1f28134630 2023-10-03T10:12:36.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.440+0000 7f1f2d0b2700 1 --2- 172.21.15.72:0/607534459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f28134630 0x7f1f28136a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009840 tx=0x7f1f18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aefd94a65884918 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.440+0000 7f1f2c8b1700 1 -- 172.21.15.72:0/607534459 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f18011830 con 0x7f1f28134630 2023-10-03T10:12:36.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.440+0000 7f1f2c8b1700 1 -- 172.21.15.72:0/607534459 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f18011990 con 0x7f1f28134630 2023-10-03T10:12:36.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.440+0000 7f1f2c8b1700 1 -- 172.21.15.72:0/607534459 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f18011d20 con 0x7f1f28134630 2023-10-03T10:12:36.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.441+0000 7f1f2fb17700 1 -- 172.21.15.72:0/607534459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f28134630 msgr2=0x7f1f28136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.441+0000 7f1f2fb17700 1 --2- 172.21.15.72:0/607534459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f28134630 0x7f1f28136a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009840 tx=0x7f1f18009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:36.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.441+0000 7f1f2fb17700 1 -- 172.21.15.72:0/607534459 shutdown_connections 2023-10-03T10:12:36.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.441+0000 7f1f2fb17700 1 --2- 172.21.15.72:0/607534459 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1f28136f50 0x7f1f28139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.441+0000 7f1f2fb17700 1 --2- 172.21.15.72:0/607534459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f28134630 0x7f1f28136a10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.441+0000 7f1f2fb17700 1 -- 172.21.15.72:0/607534459 >> 172.21.15.72:0/607534459 conn(0x7f1f280a2aa0 msgr2=0x7f1f280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.441+0000 7f1f2fb17700 1 -- 172.21.15.72:0/607534459 shutdown_connections 2023-10-03T10:12:36.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.441+0000 7f1f2fb17700 1 -- 172.21.15.72:0/607534459 wait complete. 2023-10-03T10:12:36.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.442+0000 7f1f2fb17700 1 Processor -- start 2023-10-03T10:12:36.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.443+0000 7f1f2fb17700 1 -- start start 2023-10-03T10:12:36.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.443+0000 7f1f2fb17700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1f28131810 0x7f1f2806ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.443+0000 7f1f2fb17700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f28134630 0x7f1f28070520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.443+0000 7f1f2fb17700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f28136f50 0x7f1f281c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.443+0000 7f1f2fb17700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2811ea60 con 0x7f1f28136f50 2023-10-03T10:12:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.443+0000 7f1f2fb17700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f280711d0 con 0x7f1f28134630 2023-10-03T10:12:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.443+0000 7f1f2fb17700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2806eb00 con 0x7f1f28131810 2023-10-03T10:12:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.443+0000 7f1f2d0b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f28134630 0x7f1f28070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.443+0000 7f1f2d0b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f28134630 0x7f1f28070520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34318/0 (socket says 172.21.15.72:34318) 2023-10-03T10:12:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.443+0000 7f1f2d0b2700 1 -- 172.21.15.72:0/2418215968 learned_addr learned my addr 172.21.15.72:0/2418215968 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.443+0000 7f1f2e0b4700 1 --2- 172.21.15.72:0/2418215968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f28136f50 0x7f1f281c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.443+0000 7f1f2d8b3700 1 --2- 172.21.15.72:0/2418215968 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1f28131810 0x7f1f2806ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.444+0000 7f1f2d0b2700 1 -- 172.21.15.72:0/2418215968 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1f28131810 msgr2=0x7f1f2806ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.444+0000 7f1f2d0b2700 1 --2- 172.21.15.72:0/2418215968 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1f28131810 0x7f1f2806ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.444+0000 7f1f2d0b2700 1 -- 172.21.15.72:0/2418215968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f28136f50 msgr2=0x7f1f281c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.444+0000 7f1f2d0b2700 1 --2- 172.21.15.72:0/2418215968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f28136f50 0x7f1f281c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.444+0000 7f1f2d0b2700 1 -- 172.21.15.72:0/2418215968 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f180094a0 con 0x7f1f28134630 2023-10-03T10:12:36.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.444+0000 7f1f2d0b2700 1 --2- 172.21.15.72:0/2418215968 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f28134630 0x7f1f28070520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f18000c00 tx=0x7f1f18004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.444+0000 7f1f1e7fc700 1 -- 172.21.15.72:0/2418215968 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f180036a0 con 0x7f1f28134630 2023-10-03T10:12:36.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.444+0000 7f1f1e7fc700 1 -- 172.21.15.72:0/2418215968 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1801f070 con 0x7f1f28134630 2023-10-03T10:12:36.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.444+0000 7f1f1e7fc700 1 -- 172.21.15.72:0/2418215968 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f18003a60 con 0x7f1f28134630 2023-10-03T10:12:36.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.444+0000 7f1f2fb17700 1 -- 172.21.15.72:0/2418215968 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2812e830 con 0x7f1f28134630 2023-10-03T10:12:36.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.444+0000 7f1f2fb17700 1 -- 172.21.15.72:0/2418215968 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2806faf0 con 0x7f1f28134630 2023-10-03T10:12:36.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.445+0000 7f1f2fb17700 1 -- 172.21.15.72:0/2418215968 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f28074ea0 con 0x7f1f28134630 2023-10-03T10:12:36.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.445+0000 7f1f1e7fc700 1 -- 172.21.15.72:0/2418215968 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1f18003bc0 con 0x7f1f28134630 2023-10-03T10:12:36.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.446+0000 7f1f2d8b3700 1 -- 172.21.15.72:0/2418215968 >> v1:172.21.15.72:6816/126756 conn(0x7f1f0c02f560 legacy=0x7f1f0c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:36.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.446+0000 7f1f1e7fc700 1 -- 172.21.15.72:0/2418215968 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f1f18021070 con 0x7f1f28134630 2023-10-03T10:12:36.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.450+0000 7f1f1e7fc700 1 -- 172.21.15.72:0/2418215968 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f18010790 con 0x7f1f28134630 2023-10-03T10:12:36.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.475+0000 7f2f479cf700 1 Processor -- start 2023-10-03T10:12:36.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.475+0000 7f2f479cf700 1 -- start start 2023-10-03T10:12:36.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.475+0000 7f2f479cf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f40133a80 0x7f2f40133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.475+0000 7f2f479cf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4012ff20 0x7f2f40130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.475+0000 7f2f479cf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f40130870 0x7f2f4013a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.475+0000 7f2f479cf700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4006c570 con 0x7f2f40133a80 2023-10-03T10:12:36.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.475+0000 7f2f479cf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4006bc00 con 0x7f2f4012ff20 2023-10-03T10:12:36.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.475+0000 7f2f479cf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f400a0040 con 0x7f2f40130870 2023-10-03T10:12:36.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.475+0000 7f2f45f6c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f40130870 0x7f2f4013a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.475+0000 7f2f4576b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f40133a80 0x7f2f40133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.475+0000 7f2f45f6c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f40130870 0x7f2f4013a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58444/0 (socket says 172.21.15.72:58444) 2023-10-03T10:12:36.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.475+0000 7f2f4576b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f40133a80 0x7f2f40133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38154/0 (socket says 172.21.15.72:38154) 2023-10-03T10:12:36.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.475+0000 7f2f45f6c700 1 -- 172.21.15.72:0/4225625178 learned_addr learned my addr 172.21.15.72:0/4225625178 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:36.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.476+0000 7f2f44f6a700 1 --2- 172.21.15.72:0/4225625178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4012ff20 0x7f2f40130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.476+0000 7f2f44f6a700 1 -- 172.21.15.72:0/4225625178 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f40130870 msgr2=0x7f2f4013a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.476+0000 7f2f44f6a700 1 --2- 172.21.15.72:0/4225625178 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f40130870 0x7f2f4013a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.476+0000 7f2f44f6a700 1 -- 172.21.15.72:0/4225625178 >> v2:172.21.15.72:3300/0 conn(0x7f2f40133a80 msgr2=0x7f2f40133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.476+0000 7f2f44f6a700 1 --2- 172.21.15.72:0/4225625178 >> v2:172.21.15.72:3300/0 conn(0x7f2f40133a80 0x7f2f40133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.476+0000 7f2f44f6a700 1 -- 172.21.15.72:0/4225625178 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f40133860 con 0x7f2f4012ff20 2023-10-03T10:12:36.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.476+0000 7f2f45f6c700 1 --2- 172.21.15.72:0/4225625178 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f40130870 0x7f2f4013a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.476+0000 7f2f44f6a700 1 --2- 172.21.15.72:0/4225625178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4012ff20 0x7f2f40130330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009840 tx=0x7f2f30009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd3e4bd934d55abe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.476+0000 7f2f37fff700 1 -- 172.21.15.72:0/4225625178 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30011830 con 0x7f2f4012ff20 2023-10-03T10:12:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.476+0000 7f2f37fff700 1 -- 172.21.15.72:0/4225625178 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f30011990 con 0x7f2f4012ff20 2023-10-03T10:12:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.476+0000 7f2f37fff700 1 -- 172.21.15.72:0/4225625178 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30011d20 con 0x7f2f4012ff20 2023-10-03T10:12:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.477+0000 7f2f479cf700 1 -- 172.21.15.72:0/4225625178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4012ff20 msgr2=0x7f2f40130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.477+0000 7f2f479cf700 1 --2- 172.21.15.72:0/4225625178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4012ff20 0x7f2f40130330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009840 tx=0x7f2f30009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.477+0000 7f2f479cf700 1 -- 172.21.15.72:0/4225625178 shutdown_connections 2023-10-03T10:12:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.477+0000 7f2f479cf700 1 --2- 172.21.15.72:0/4225625178 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f40130870 0x7f2f4013a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.477+0000 7f2f479cf700 1 --2- 172.21.15.72:0/4225625178 >> v2:172.21.15.72:3300/0 conn(0x7f2f40133a80 0x7f2f40133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.477+0000 7f2f479cf700 1 --2- 172.21.15.72:0/4225625178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4012ff20 0x7f2f40130330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.477+0000 7f2f479cf700 1 -- 172.21.15.72:0/4225625178 >> 172.21.15.72:0/4225625178 conn(0x7f2f400a4210 msgr2=0x7f2f400a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.477+0000 7f2f479cf700 1 -- 172.21.15.72:0/4225625178 shutdown_connections 2023-10-03T10:12:36.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.477+0000 7f2f479cf700 1 -- 172.21.15.72:0/4225625178 wait complete. 2023-10-03T10:12:36.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.478+0000 7f2f479cf700 1 Processor -- start 2023-10-03T10:12:36.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.478+0000 7f2f479cf700 1 -- start start 2023-10-03T10:12:36.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.478+0000 7f2f479cf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4012ff20 0x7f2f4009c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.478+0000 7f2f479cf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f40130870 0x7f2f4009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.478+0000 7f2f479cf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f40133a80 0x7f2f4009d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.478+0000 7f2f479cf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4011fe80 con 0x7f2f40133a80 2023-10-03T10:12:36.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.478+0000 7f2f479cf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f40121000 con 0x7f2f4012ff20 2023-10-03T10:12:36.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f479cf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f40120520 con 0x7f2f40130870 2023-10-03T10:12:36.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f4576b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4012ff20 0x7f2f4009c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f45f6c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f40133a80 0x7f2f4009d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f4576b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4012ff20 0x7f2f4009c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34338/0 (socket says 172.21.15.72:34338) 2023-10-03T10:12:36.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f4576b700 1 -- 172.21.15.72:0/1206727350 learned_addr learned my addr 172.21.15.72:0/1206727350 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f44f6a700 1 --2- 172.21.15.72:0/1206727350 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f40130870 0x7f2f4009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f44f6a700 1 -- 172.21.15.72:0/1206727350 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4012ff20 msgr2=0x7f2f4009c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f44f6a700 1 --2- 172.21.15.72:0/1206727350 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4012ff20 0x7f2f4009c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f44f6a700 1 -- 172.21.15.72:0/1206727350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f40133a80 msgr2=0x7f2f4009d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f44f6a700 1 --2- 172.21.15.72:0/1206727350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f40133a80 0x7f2f4009d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f44f6a700 1 -- 172.21.15.72:0/1206727350 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f38009b30 con 0x7f2f40130870 2023-10-03T10:12:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f45f6c700 1 --2- 172.21.15.72:0/1206727350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f40133a80 0x7f2f4009d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f4576b700 1 --2- 172.21.15.72:0/1206727350 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4012ff20 0x7f2f4009c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f44f6a700 1 --2- 172.21.15.72:0/1206727350 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f40130870 0x7f2f4009cc20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f4009fb60 tx=0x7f2f30004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f35ffb700 1 -- 172.21.15.72:0/1206727350 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30004450 con 0x7f2f40130870 2023-10-03T10:12:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f35ffb700 1 -- 172.21.15.72:0/1206727350 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3001f070 con 0x7f2f40130870 2023-10-03T10:12:36.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f479cf700 1 -- 172.21.15.72:0/1206727350 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f300094a0 con 0x7f2f40130870 2023-10-03T10:12:36.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.479+0000 7f2f35ffb700 1 -- 172.21.15.72:0/1206727350 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f300038e0 con 0x7f2f40130870 2023-10-03T10:12:36.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.480+0000 7f2f479cf700 1 -- 172.21.15.72:0/1206727350 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4012db80 con 0x7f2f40130870 2023-10-03T10:12:36.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.481+0000 7f2f35ffb700 1 -- 172.21.15.72:0/1206727350 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2f30003a40 con 0x7f2f40130870 2023-10-03T10:12:36.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.481+0000 7f2f479cf700 1 -- 172.21.15.72:0/1206727350 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f400a2f50 con 0x7f2f40130870 2023-10-03T10:12:36.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.481+0000 7f2f35ffb700 1 -- 172.21.15.72:0/1206727350 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f2f30021070 con 0x7f2f40130870 2023-10-03T10:12:36.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.481+0000 7f2f4576b700 1 -- 172.21.15.72:0/1206727350 >> v1:172.21.15.72:6816/126756 conn(0x7f2f2402f510 legacy=0x7f2f240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:36.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.486+0000 7f2f35ffb700 1 -- 172.21.15.72:0/1206727350 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f30010380 con 0x7f2f40130870 2023-10-03T10:12:36.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.495+0000 7f63216e9700 1 Processor -- start 2023-10-03T10:12:36.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.495+0000 7f63216e9700 1 -- start start 2023-10-03T10:12:36.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.496+0000 7f63216e9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631c06a770 0x7f631c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.496+0000 7f63216e9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f631c13d1f0 0x7f631c13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.496+0000 7f63216e9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631c09a810 con 0x7f631c09dc30 2023-10-03T10:12:36.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.496+0000 7f63216e9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631c06ab40 con 0x7f631c13d1f0 2023-10-03T10:12:36.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.496+0000 7f63216e9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c09ebc0 con 0x7f631c06a770 2023-10-03T10:12:36.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.496+0000 7f631affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631c06a770 0x7f631c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.496+0000 7f631a7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f631c09dc30 0x7f631c09e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36344/0 (socket says 172.21.15.72:36344) 2023-10-03T10:12:36.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.496+0000 7f631a7fc700 1 -- 172.21.15.72:0/3565767939 learned_addr learned my addr 172.21.15.72:0/3565767939 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:36.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.496+0000 7f631b7fe700 1 --2- 172.21.15.72:0/3565767939 >> v2:172.21.15.72:3300/0 conn(0x7f631c13d1f0 0x7f631c13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.497+0000 7f6319ffb700 1 -- 172.21.15.72:0/3565767939 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400230072 0 0) 0x7f631c09a810 con 0x7f631c09dc30 2023-10-03T10:12:36.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.497+0000 7f6319ffb700 1 -- 172.21.15.72:0/3565767939 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63040035b0 con 0x7f631c09dc30 2023-10-03T10:12:36.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.497+0000 7f631affd700 1 -- 172.21.15.72:0/3565767939 >> v2:172.21.15.72:3300/0 conn(0x7f631c13d1f0 msgr2=0x7f631c13f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.497+0000 7f631affd700 1 --2- 172.21.15.72:0/3565767939 >> v2:172.21.15.72:3300/0 conn(0x7f631c13d1f0 0x7f631c13f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.497+0000 7f631affd700 1 -- 172.21.15.72:0/3565767939 >> v1:172.21.15.72:6789/0 conn(0x7f631c09dc30 legacy=0x7f631c09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.497+0000 7f6319ffb700 1 -- 172.21.15.72:0/3565767939 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2398789846 0 0) 0x7f63040035b0 con 0x7f631c09dc30 2023-10-03T10:12:36.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.497+0000 7f631affd700 1 -- 172.21.15.72:0/3565767939 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c09e920 con 0x7f631c06a770 2023-10-03T10:12:36.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.497+0000 7f631affd700 1 --2- 172.21.15.72:0/3565767939 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631c06a770 0x7f631c09d6f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f630c009870 tx=0x7f630c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69db0049aa9013 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.497+0000 7f6319ffb700 1 -- 172.21.15.72:0/3565767939 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310001670 con 0x7f631c06a770 2023-10-03T10:12:36.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.497+0000 7f6319ffb700 1 -- 172.21.15.72:0/3565767939 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c004030 con 0x7f631c06a770 2023-10-03T10:12:36.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.497+0000 7f6319ffb700 1 -- 172.21.15.72:0/3565767939 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c0043a0 con 0x7f631c06a770 2023-10-03T10:12:36.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.498+0000 7f63216e9700 1 -- 172.21.15.72:0/3565767939 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631c06a770 msgr2=0x7f631c09d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.498+0000 7f63216e9700 1 --2- 172.21.15.72:0/3565767939 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631c06a770 0x7f631c09d6f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f630c009870 tx=0x7f630c009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:36.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.498+0000 7f63216e9700 1 -- 172.21.15.72:0/3565767939 shutdown_connections 2023-10-03T10:12:36.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.498+0000 7f63216e9700 1 --2- 172.21.15.72:0/3565767939 >> v2:172.21.15.72:3300/0 conn(0x7f631c13d1f0 0x7f631c13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.498+0000 7f63216e9700 1 --2- 172.21.15.72:0/3565767939 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631c06a770 0x7f631c09d6f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.498+0000 7f63216e9700 1 -- 172.21.15.72:0/3565767939 >> 172.21.15.72:0/3565767939 conn(0x7f631c066f50 msgr2=0x7f631c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.498+0000 7f63216e9700 1 -- 172.21.15.72:0/3565767939 shutdown_connections 2023-10-03T10:12:36.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.498+0000 7f63216e9700 1 -- 172.21.15.72:0/3565767939 wait complete. 2023-10-03T10:12:36.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.499+0000 7f63216e9700 1 Processor -- start 2023-10-03T10:12:36.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.500+0000 7f63216e9700 1 -- start start 2023-10-03T10:12:36.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.500+0000 7f63216e9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631c06a770 0x7f631c11ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.500+0000 7f63216e9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f631c09dc30 0x7f631c11bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.500+0000 7f63216e9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f631c13d1f0 0x7f631c11c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.500+0000 7f63216e9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c11a1b0 con 0x7f631c13d1f0 2023-10-03T10:12:36.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.500+0000 7f63216e9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c11ab40 con 0x7f631c06a770 2023-10-03T10:12:36.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.500+0000 7f63216e9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f631c071c40 con 0x7f631c09dc30 2023-10-03T10:12:36.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.500+0000 7f631a7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f631c09dc30 0x7f631c11bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.500+0000 7f631a7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f631c09dc30 0x7f631c11bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58458/0 (socket says 172.21.15.72:58458) 2023-10-03T10:12:36.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.500+0000 7f631a7fc700 1 -- 172.21.15.72:0/3413722773 learned_addr learned my addr 172.21.15.72:0/3413722773 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:36.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.500+0000 7f631affd700 1 --2- 172.21.15.72:0/3413722773 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631c06a770 0x7f631c11ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.500+0000 7f631b7fe700 1 --2- 172.21.15.72:0/3413722773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f631c13d1f0 0x7f631c11c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.501+0000 7f631affd700 1 -- 172.21.15.72:0/3413722773 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f631c09dc30 msgr2=0x7f631c11bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.501+0000 7f631affd700 1 --2- 172.21.15.72:0/3413722773 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f631c09dc30 0x7f631c11bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.501+0000 7f631affd700 1 -- 172.21.15.72:0/3413722773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f631c13d1f0 msgr2=0x7f631c11c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.501+0000 7f631affd700 1 --2- 172.21.15.72:0/3413722773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f631c13d1f0 0x7f631c11c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.501+0000 7f631affd700 1 -- 172.21.15.72:0/3413722773 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c0094a0 con 0x7f631c06a770 2023-10-03T10:12:36.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.501+0000 7f631affd700 1 --2- 172.21.15.72:0/3413722773 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631c06a770 0x7f631c11ba00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f630c015000 tx=0x7f630c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.501+0000 7f63037fe700 1 -- 172.21.15.72:0/3413722773 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c003de0 con 0x7f631c06a770 2023-10-03T10:12:36.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.501+0000 7f63037fe700 1 -- 172.21.15.72:0/3413722773 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c011630 con 0x7f631c06a770 2023-10-03T10:12:36.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.501+0000 7f63216e9700 1 -- 172.21.15.72:0/3413722773 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631c09f1a0 con 0x7f631c06a770 2023-10-03T10:12:36.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.501+0000 7f63037fe700 1 -- 172.21.15.72:0/3413722773 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c0119e0 con 0x7f631c06a770 2023-10-03T10:12:36.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.501+0000 7f63216e9700 1 -- 172.21.15.72:0/3413722773 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631c11b5b0 con 0x7f631c06a770 2023-10-03T10:12:36.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.502+0000 7f63037fe700 1 -- 172.21.15.72:0/3413722773 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f630c011b40 con 0x7f631c06a770 2023-10-03T10:12:36.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.502+0000 7f63037fe700 1 -- 172.21.15.72:0/3413722773 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f630c041000 con 0x7f631c06a770 2023-10-03T10:12:36.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.502+0000 7f631a7fc700 1 -- 172.21.15.72:0/3413722773 >> v1:172.21.15.72:6816/126756 conn(0x7f630802f510 legacy=0x7f63080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:36.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.503+0000 7f63216e9700 1 -- 172.21.15.72:0/3413722773 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631c074ea0 con 0x7f631c06a770 2023-10-03T10:12:36.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.512+0000 7f63037fe700 1 -- 172.21.15.72:0/3413722773 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f630c006cc0 con 0x7f631c06a770 2023-10-03T10:12:36.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.540+0000 7f4cb4370700 1 Processor -- start 2023-10-03T10:12:36.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.540+0000 7f4cb4370700 1 -- start start 2023-10-03T10:12:36.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.541+0000 7f4cb4370700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cac0a0a30 0x7f4cac0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.541+0000 7f4cb4370700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4cac0a1340 0x7f4cac133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.541+0000 7f4cb4370700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cac09edd0 con 0x7f4cac133fa0 2023-10-03T10:12:36.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.541+0000 7f4cb4370700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cac09e1f0 con 0x7f4cac0a1340 2023-10-03T10:12:36.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.541+0000 7f4cb4370700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac09dc50 con 0x7f4cac0a0a30 2023-10-03T10:12:36.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.541+0000 7f4cb210c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cac0a0a30 0x7f4cac0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.541+0000 7f4cb210c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cac0a0a30 0x7f4cac0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58470/0 (socket says 172.21.15.72:58470) 2023-10-03T10:12:36.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.541+0000 7f4cb210c700 1 -- 172.21.15.72:0/2420331334 learned_addr learned my addr 172.21.15.72:0/2420331334 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:36.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.541+0000 7f4cb190b700 1 --2- 172.21.15.72:0/2420331334 >> v2:172.21.15.72:3300/0 conn(0x7f4cac0a1340 0x7f4cac133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.542+0000 7f4cb210c700 1 -- 172.21.15.72:0/2420331334 >> v2:172.21.15.72:3300/0 conn(0x7f4cac0a1340 msgr2=0x7f4cac133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:36.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.542+0000 7f4cb210c700 1 --2- 172.21.15.72:0/2420331334 >> v2:172.21.15.72:3300/0 conn(0x7f4cac0a1340 0x7f4cac133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.542+0000 7f4cb210c700 1 -- 172.21.15.72:0/2420331334 >> v1:172.21.15.72:6789/0 conn(0x7f4cac133fa0 legacy=0x7f4cac13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.542+0000 7f4cb210c700 1 -- 172.21.15.72:0/2420331334 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac0a1fe0 con 0x7f4cac0a0a30 2023-10-03T10:12:36.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.542+0000 7f4cb110a700 1 -- 172.21.15.72:0/2420331334 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586529911 0 0) 0x7f4cac09edd0 con 0x7f4cac133fa0 2023-10-03T10:12:36.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.542+0000 7f4cb210c700 1 --2- 172.21.15.72:0/2420331334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cac0a0a30 0x7f4cac0a0e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80098f0 tx=0x7f4ca8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78bd989bebe7b530 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.542+0000 7f4cb110a700 1 -- 172.21.15.72:0/2420331334 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8011830 con 0x7f4cac0a0a30 2023-10-03T10:12:36.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.542+0000 7f4cb110a700 1 -- 172.21.15.72:0/2420331334 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca8011990 con 0x7f4cac0a0a30 2023-10-03T10:12:36.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.542+0000 7f4cb110a700 1 -- 172.21.15.72:0/2420331334 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8011d20 con 0x7f4cac0a0a30 2023-10-03T10:12:36.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.543+0000 7f4cb4370700 1 -- 172.21.15.72:0/2420331334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cac0a0a30 msgr2=0x7f4cac0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.543+0000 7f4cb4370700 1 --2- 172.21.15.72:0/2420331334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cac0a0a30 0x7f4cac0a0e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80098f0 tx=0x7f4ca8009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:36.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.543+0000 7f4cb4370700 1 -- 172.21.15.72:0/2420331334 shutdown_connections 2023-10-03T10:12:36.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.543+0000 7f4cb4370700 1 --2- 172.21.15.72:0/2420331334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cac0a0a30 0x7f4cac0a0e00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.543+0000 7f4cb4370700 1 --2- 172.21.15.72:0/2420331334 >> v2:172.21.15.72:3300/0 conn(0x7f4cac0a1340 0x7f4cac133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.543+0000 7f4cb4370700 1 -- 172.21.15.72:0/2420331334 >> 172.21.15.72:0/2420331334 conn(0x7f4cac0a6550 msgr2=0x7f4cac0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.543+0000 7f4cb4370700 1 -- 172.21.15.72:0/2420331334 shutdown_connections 2023-10-03T10:12:36.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.543+0000 7f4cb4370700 1 -- 172.21.15.72:0/2420331334 wait complete. 2023-10-03T10:12:36.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.544+0000 7f4cb4370700 1 Processor -- start 2023-10-03T10:12:36.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.544+0000 7f4cb4370700 1 -- start start 2023-10-03T10:12:36.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.544+0000 7f4cb4370700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cac0a0a30 0x7f4cac123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.544+0000 7f4cb4370700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cac0a1340 0x7f4cac1238a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.544+0000 7f4cb4370700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cac133fa0 0x7f4cac1c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:36.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.544+0000 7f4cb4370700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac126340 con 0x7f4cac0a1340 2023-10-03T10:12:36.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.544+0000 7f4cb4370700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac124ee0 con 0x7f4cac0a0a30 2023-10-03T10:12:36.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.544+0000 7f4cb4370700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac126520 con 0x7f4cac133fa0 2023-10-03T10:12:36.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.544+0000 7f4cb210c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cac0a0a30 0x7f4cac123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.544+0000 7f4cb210c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cac0a0a30 0x7f4cac123360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34362/0 (socket says 172.21.15.72:34362) 2023-10-03T10:12:36.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.544+0000 7f4cb210c700 1 -- 172.21.15.72:0/1958875850 learned_addr learned my addr 172.21.15.72:0/1958875850 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:36.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.544+0000 7f4cb290d700 1 --2- 172.21.15.72:0/1958875850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cac133fa0 0x7f4cac1c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.545+0000 7f4cb190b700 1 --2- 172.21.15.72:0/1958875850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cac0a1340 0x7f4cac1238a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:36.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.545+0000 7f4cb210c700 1 -- 172.21.15.72:0/1958875850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cac133fa0 msgr2=0x7f4cac1c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.545+0000 7f4cb210c700 1 --2- 172.21.15.72:0/1958875850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cac133fa0 0x7f4cac1c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.545+0000 7f4cb210c700 1 -- 172.21.15.72:0/1958875850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cac0a1340 msgr2=0x7f4cac1238a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.545+0000 7f4cb210c700 1 --2- 172.21.15.72:0/1958875850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cac0a1340 0x7f4cac1238a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.545+0000 7f4cb210c700 1 -- 172.21.15.72:0/1958875850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca8009550 con 0x7f4cac0a0a30 2023-10-03T10:12:36.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.545+0000 7f4cb210c700 1 --2- 172.21.15.72:0/1958875850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cac0a0a30 0x7f4cac123360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4cac09dd90 tx=0x7f4ca8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:36.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.545+0000 7f4ca2ffd700 1 -- 172.21.15.72:0/1958875850 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8004380 con 0x7f4cac0a0a30 2023-10-03T10:12:36.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.545+0000 7f4ca2ffd700 1 -- 172.21.15.72:0/1958875850 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca801f070 con 0x7f4cac0a0a30 2023-10-03T10:12:36.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.545+0000 7f4ca2ffd700 1 -- 172.21.15.72:0/1958875850 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80036a0 con 0x7f4cac0a0a30 2023-10-03T10:12:36.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.546+0000 7f4cb4370700 1 -- 172.21.15.72:0/1958875850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cac0a3610 con 0x7f4cac0a0a30 2023-10-03T10:12:36.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.546+0000 7f4cb4370700 1 -- 172.21.15.72:0/1958875850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cac124b40 con 0x7f4cac0a0a30 2023-10-03T10:12:36.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.547+0000 7f4ca2ffd700 1 -- 172.21.15.72:0/1958875850 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4ca8021030 con 0x7f4cac0a0a30 2023-10-03T10:12:36.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.547+0000 7f4ca2ffd700 1 -- 172.21.15.72:0/1958875850 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f4ca8040f00 con 0x7f4cac0a0a30 2023-10-03T10:12:36.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.547+0000 7f4cb4370700 1 -- 172.21.15.72:0/1958875850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cac0a1d40 con 0x7f4cac0a0a30 2023-10-03T10:12:36.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.547+0000 7f4cb190b700 1 -- 172.21.15.72:0/1958875850 >> v1:172.21.15.72:6816/126756 conn(0x7f4c9002f510 legacy=0x7f4c900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:36.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.551+0000 7f4ca2ffd700 1 -- 172.21.15.72:0/1958875850 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ca8015070 con 0x7f4cac0a0a30 2023-10-03T10:12:36.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.647+0000 7f1f2d8b3700 1 -- 172.21.15.72:0/2418215968 >> v1:172.21.15.72:6816/126756 conn(0x7f1f0c02f560 legacy=0x7f1f0c031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:36.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.682+0000 7f2f4576b700 1 -- 172.21.15.72:0/1206727350 >> v1:172.21.15.72:6816/126756 conn(0x7f2f2402f510 legacy=0x7f2f240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:36.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.683+0000 7f2f479cf700 1 -- 172.21.15.72:0/1206727350 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2f40074ea0 con 0x7f2f40130870 2023-10-03T10:12:36.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.683+0000 7f2f35ffb700 1 -- 172.21.15.72:0/1206727350 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f30024b70 con 0x7f2f40130870 2023-10-03T10:12:36.683 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:36.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.685+0000 7f2f479cf700 1 -- 172.21.15.72:0/1206727350 >> v1:172.21.15.72:6816/126756 conn(0x7f2f2402f510 legacy=0x7f2f240319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:36.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.685+0000 7f2f479cf700 1 -- 172.21.15.72:0/1206727350 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f40130870 msgr2=0x7f2f4009cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.685+0000 7f2f479cf700 1 --2- 172.21.15.72:0/1206727350 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f40130870 0x7f2f4009cc20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f4009fb60 tx=0x7f2f30004750 comp rx=0 tx=0).stop 2023-10-03T10:12:36.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.685+0000 7f2f479cf700 1 -- 172.21.15.72:0/1206727350 shutdown_connections 2023-10-03T10:12:36.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.685+0000 7f2f479cf700 1 --2- 172.21.15.72:0/1206727350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f40133a80 0x7f2f4009d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.685+0000 7f2f479cf700 1 --2- 172.21.15.72:0/1206727350 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4012ff20 0x7f2f4009c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.685+0000 7f2f479cf700 1 --2- 172.21.15.72:0/1206727350 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f40130870 0x7f2f4009cc20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.685+0000 7f2f479cf700 1 -- 172.21.15.72:0/1206727350 >> 172.21.15.72:0/1206727350 conn(0x7f2f400a4210 msgr2=0x7f2f4009e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.685+0000 7f2f479cf700 1 -- 172.21.15.72:0/1206727350 shutdown_connections 2023-10-03T10:12:36.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.685+0000 7f2f479cf700 1 -- 172.21.15.72:0/1206727350 wait complete. 2023-10-03T10:12:36.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.689+0000 7f1f2fb17700 1 -- 172.21.15.72:0/2418215968 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f28070a60 con 0x7f1f28134630 2023-10-03T10:12:36.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.689+0000 7f1f1e7fc700 1 -- 172.21.15.72:0/2418215968 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1f18015090 con 0x7f1f28134630 2023-10-03T10:12:36.689 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:36.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.692+0000 7f1f2fb17700 1 -- 172.21.15.72:0/2418215968 >> v1:172.21.15.72:6816/126756 conn(0x7f1f0c02f560 legacy=0x7f1f0c031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.692+0000 7f1f2fb17700 1 -- 172.21.15.72:0/2418215968 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f28134630 msgr2=0x7f1f28070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.692+0000 7f1f2fb17700 1 --2- 172.21.15.72:0/2418215968 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f28134630 0x7f1f28070520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f18000c00 tx=0x7f1f18004750 comp rx=0 tx=0).stop 2023-10-03T10:12:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.692+0000 7f1f2fb17700 1 -- 172.21.15.72:0/2418215968 shutdown_connections 2023-10-03T10:12:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.692+0000 7f1f2fb17700 1 --2- 172.21.15.72:0/2418215968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f28136f50 0x7f1f281c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.692+0000 7f1f2fb17700 1 --2- 172.21.15.72:0/2418215968 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1f28131810 0x7f1f2806ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.692+0000 7f1f2fb17700 1 --2- 172.21.15.72:0/2418215968 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1f28134630 0x7f1f28070520 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.692+0000 7f1f2fb17700 1 -- 172.21.15.72:0/2418215968 >> 172.21.15.72:0/2418215968 conn(0x7f1f280a2aa0 msgr2=0x7f1f28132410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.692+0000 7f1f2fb17700 1 -- 172.21.15.72:0/2418215968 shutdown_connections 2023-10-03T10:12:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.692+0000 7f1f2fb17700 1 -- 172.21.15.72:0/2418215968 wait complete. 2023-10-03T10:12:36.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.703+0000 7f631a7fc700 1 -- 172.21.15.72:0/3413722773 >> v1:172.21.15.72:6816/126756 conn(0x7f630802f510 legacy=0x7f63080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:36.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:36.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.710+0000 7f63216e9700 1 -- 172.21.15.72:0/3413722773 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f631c11a9a0 con 0x7f631c06a770 2023-10-03T10:12:36.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.710+0000 7f63037fe700 1 -- 172.21.15.72:0/3413722773 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f631c11a9a0 con 0x7f631c06a770 2023-10-03T10:12:36.710 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.712+0000 7f63216e9700 1 -- 172.21.15.72:0/3413722773 >> v1:172.21.15.72:6816/126756 conn(0x7f630802f510 legacy=0x7f63080319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.712+0000 7f63216e9700 1 -- 172.21.15.72:0/3413722773 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631c06a770 msgr2=0x7f631c11ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.712+0000 7f63216e9700 1 --2- 172.21.15.72:0/3413722773 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631c06a770 0x7f631c11ba00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f630c015000 tx=0x7f630c0047c0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.712+0000 7f63216e9700 1 -- 172.21.15.72:0/3413722773 shutdown_connections 2023-10-03T10:12:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.712+0000 7f63216e9700 1 --2- 172.21.15.72:0/3413722773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f631c13d1f0 0x7f631c11c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.712+0000 7f63216e9700 1 --2- 172.21.15.72:0/3413722773 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631c06a770 0x7f631c11ba00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.712+0000 7f63216e9700 1 --2- 172.21.15.72:0/3413722773 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f631c09dc30 0x7f631c11bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.712+0000 7f63216e9700 1 -- 172.21.15.72:0/3413722773 >> 172.21.15.72:0/3413722773 conn(0x7f631c066f50 msgr2=0x7f631c0a2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.712+0000 7f63216e9700 1 -- 172.21.15.72:0/3413722773 shutdown_connections 2023-10-03T10:12:36.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.712+0000 7f63216e9700 1 -- 172.21.15.72:0/3413722773 wait complete. 2023-10-03T10:12:36.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:36.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.748+0000 7f4cb190b700 1 -- 172.21.15.72:0/1958875850 >> v1:172.21.15.72:6816/126756 conn(0x7f4c9002f510 legacy=0x7f4c900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:36.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.780+0000 7f4cb4370700 1 -- 172.21.15.72:0/1958875850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4cac074ea0 con 0x7f4cac0a0a30 2023-10-03T10:12:36.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.781+0000 7f4ca2ffd700 1 -- 172.21.15.72:0/1958875850 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ca8019590 con 0x7f4cac0a0a30 2023-10-03T10:12:36.780 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:36.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.783+0000 7f4cb4370700 1 -- 172.21.15.72:0/1958875850 >> v1:172.21.15.72:6816/126756 conn(0x7f4c9002f510 legacy=0x7f4c900319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:36.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.783+0000 7f4cb4370700 1 -- 172.21.15.72:0/1958875850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cac0a0a30 msgr2=0x7f4cac123360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:36.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.783+0000 7f4cb4370700 1 --2- 172.21.15.72:0/1958875850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cac0a0a30 0x7f4cac123360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4cac09dd90 tx=0x7f4ca8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:36.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.783+0000 7f4cb4370700 1 -- 172.21.15.72:0/1958875850 shutdown_connections 2023-10-03T10:12:36.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.783+0000 7f4cb4370700 1 --2- 172.21.15.72:0/1958875850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cac133fa0 0x7f4cac1c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.783+0000 7f4cb4370700 1 --2- 172.21.15.72:0/1958875850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cac0a0a30 0x7f4cac123360 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.783+0000 7f4cb4370700 1 --2- 172.21.15.72:0/1958875850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cac0a1340 0x7f4cac1238a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:36.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.783+0000 7f4cb4370700 1 -- 172.21.15.72:0/1958875850 >> 172.21.15.72:0/1958875850 conn(0x7f4cac0a6550 msgr2=0x7f4cac11c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:36.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.783+0000 7f4cb4370700 1 -- 172.21.15.72:0/1958875850 shutdown_connections 2023-10-03T10:12:36.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:36.783+0000 7f4cb4370700 1 -- 172.21.15.72:0/1958875850 wait complete. 2023-10-03T10:12:36.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:37.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:37.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:37.725 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:37.795 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:37.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.841+0000 7f21f61b8700 1 Processor -- start 2023-10-03T10:12:37.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.841+0000 7f21f61b8700 1 -- start start 2023-10-03T10:12:37.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.842+0000 7f21f61b8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21f0130790 0x7f21f0130b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.842+0000 7f21f61b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21f006f640 0x7f21f006fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.842+0000 7f21f61b8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21f006ffb0 0x7f21f01374f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.842+0000 7f21f61b8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f009a370 con 0x7f21f0130790 2023-10-03T10:12:37.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.842+0000 7f21f61b8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f009ef50 con 0x7f21f006f640 2023-10-03T10:12:37.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.842+0000 7f21f61b8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21f0070860 con 0x7f21f006ffb0 2023-10-03T10:12:37.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.842+0000 7f21effff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21f006ffb0 0x7f21f01374f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.842+0000 7f21effff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21f006ffb0 0x7f21f01374f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58496/0 (socket says 172.21.15.72:58496) 2023-10-03T10:12:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.842+0000 7f21effff700 1 -- 172.21.15.72:0/3256802971 learned_addr learned my addr 172.21.15.72:0/3256802971 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.842+0000 7f21ef7fe700 1 --2- 172.21.15.72:0/3256802971 >> v2:172.21.15.72:3300/0 conn(0x7f21f0130790 0x7f21f0130b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.842+0000 7f21eeffd700 1 --2- 172.21.15.72:0/3256802971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21f006f640 0x7f21f006fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.843+0000 7f21effff700 1 -- 172.21.15.72:0/3256802971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21f006f640 msgr2=0x7f21f006fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.843+0000 7f21effff700 1 --2- 172.21.15.72:0/3256802971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21f006f640 0x7f21f006fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.843+0000 7f21effff700 1 -- 172.21.15.72:0/3256802971 >> v2:172.21.15.72:3300/0 conn(0x7f21f0130790 msgr2=0x7f21f0130b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.843+0000 7f21effff700 1 --2- 172.21.15.72:0/3256802971 >> v2:172.21.15.72:3300/0 conn(0x7f21f0130790 0x7f21f0130b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.843+0000 7f21effff700 1 -- 172.21.15.72:0/3256802971 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f01310a0 con 0x7f21f006ffb0 2023-10-03T10:12:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.843+0000 7f21eeffd700 1 --2- 172.21.15.72:0/3256802971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21f006f640 0x7f21f006fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:37.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.843+0000 7f21ef7fe700 1 --2- 172.21.15.72:0/3256802971 >> v2:172.21.15.72:3300/0 conn(0x7f21f0130790 0x7f21f0130b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.843+0000 7f21effff700 1 --2- 172.21.15.72:0/3256802971 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21f006ffb0 0x7f21f01374f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009e50 tx=0x7f21e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=437ef73afb37f3e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.843+0000 7f21ee7fc700 1 -- 172.21.15.72:0/3256802971 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e800e070 con 0x7f21f006ffb0 2023-10-03T10:12:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.843+0000 7f21ee7fc700 1 -- 172.21.15.72:0/3256802971 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e800b910 con 0x7f21f006ffb0 2023-10-03T10:12:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.843+0000 7f21ee7fc700 1 -- 172.21.15.72:0/3256802971 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e800bcc0 con 0x7f21f006ffb0 2023-10-03T10:12:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.844+0000 7f21f61b8700 1 -- 172.21.15.72:0/3256802971 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21f006ffb0 msgr2=0x7f21f01374f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.844+0000 7f21f61b8700 1 --2- 172.21.15.72:0/3256802971 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21f006ffb0 0x7f21f01374f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009e50 tx=0x7f21e800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.844+0000 7f21f61b8700 1 -- 172.21.15.72:0/3256802971 shutdown_connections 2023-10-03T10:12:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.844+0000 7f21f61b8700 1 --2- 172.21.15.72:0/3256802971 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21f006ffb0 0x7f21f01374f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.844+0000 7f21f61b8700 1 --2- 172.21.15.72:0/3256802971 >> v2:172.21.15.72:3300/0 conn(0x7f21f0130790 0x7f21f0130b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.844+0000 7f21f61b8700 1 --2- 172.21.15.72:0/3256802971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21f006f640 0x7f21f006fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.844+0000 7f21f61b8700 1 -- 172.21.15.72:0/3256802971 >> 172.21.15.72:0/3256802971 conn(0x7f21f00a2aa0 msgr2=0x7f21f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:37.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.844+0000 7f21f61b8700 1 -- 172.21.15.72:0/3256802971 shutdown_connections 2023-10-03T10:12:37.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.844+0000 7f21f61b8700 1 -- 172.21.15.72:0/3256802971 wait complete. 2023-10-03T10:12:37.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.845+0000 7f21f61b8700 1 Processor -- start 2023-10-03T10:12:37.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.845+0000 7f21f61b8700 1 -- start start 2023-10-03T10:12:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.845+0000 7f21f61b8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f006f640 0x7f21f0118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.845+0000 7f21f61b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21f006ffb0 0x7f21f0119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.845+0000 7f21f61b8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21f0130790 0x7f21f0119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.845+0000 7f21f61b8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f012ea00 con 0x7f21f006f640 2023-10-03T10:12:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.845+0000 7f21f61b8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f011a390 con 0x7f21f006ffb0 2023-10-03T10:12:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.845+0000 7f21f61b8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21f0071800 con 0x7f21f0130790 2023-10-03T10:12:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21ef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f006f640 0x7f21f0118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21ef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f006f640 0x7f21f0118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38206/0 (socket says 172.21.15.72:38206) 2023-10-03T10:12:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21ef7fe700 1 -- 172.21.15.72:0/4067584476 learned_addr learned my addr 172.21.15.72:0/4067584476 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21effff700 1 --2- 172.21.15.72:0/4067584476 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21f0130790 0x7f21f0119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21eeffd700 1 --2- 172.21.15.72:0/4067584476 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21f006ffb0 0x7f21f0119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21ef7fe700 1 -- 172.21.15.72:0/4067584476 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21f0130790 msgr2=0x7f21f0119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21ef7fe700 1 --2- 172.21.15.72:0/4067584476 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21f0130790 0x7f21f0119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21ef7fe700 1 -- 172.21.15.72:0/4067584476 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21f006ffb0 msgr2=0x7f21f0119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21ef7fe700 1 --2- 172.21.15.72:0/4067584476 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21f006ffb0 0x7f21f0119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21ef7fe700 1 -- 172.21.15.72:0/4067584476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e000f610 con 0x7f21f006f640 2023-10-03T10:12:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21ef7fe700 1 --2- 172.21.15.72:0/4067584476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f006f640 0x7f21f0118cd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009d10 tx=0x7f21e00133b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21d7fff700 1 -- 172.21.15.72:0/4067584476 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0013d50 con 0x7f21f006f640 2023-10-03T10:12:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21d7fff700 1 -- 172.21.15.72:0/4067584476 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e0015040 con 0x7f21f006f640 2023-10-03T10:12:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21f61b8700 1 -- 172.21.15.72:0/4067584476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e8009b30 con 0x7f21f006f640 2023-10-03T10:12:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21d7fff700 1 -- 172.21.15.72:0/4067584476 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0004270 con 0x7f21f006f640 2023-10-03T10:12:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.846+0000 7f21f61b8700 1 -- 172.21.15.72:0/4067584476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f011c190 con 0x7f21f006f640 2023-10-03T10:12:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.848+0000 7f21f61b8700 1 -- 172.21.15.72:0/4067584476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f011aad0 con 0x7f21f006f640 2023-10-03T10:12:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.848+0000 7f21d7fff700 1 -- 172.21.15.72:0/4067584476 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f21e00043d0 con 0x7f21f006f640 2023-10-03T10:12:37.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.848+0000 7f21eeffd700 1 -- 172.21.15.72:0/4067584476 >> v1:172.21.15.72:6816/126756 conn(0x7f21dc02f510 legacy=0x7f21dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:37.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.849+0000 7f21d7fff700 1 -- 172.21.15.72:0/4067584476 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f21e0023360 con 0x7f21f006f640 2023-10-03T10:12:37.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.853+0000 7f21d7fff700 1 -- 172.21.15.72:0/4067584476 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21e0049060 con 0x7f21f006f640 2023-10-03T10:12:37.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.877+0000 7fe9c83e0700 1 Processor -- start 2023-10-03T10:12:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.877+0000 7fe9c83e0700 1 -- start start 2023-10-03T10:12:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.877+0000 7fe9c83e0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9c006c0e0 0x7fe9c009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.877+0000 7fe9c83e0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe9c0134ec0 0x7fe9c01379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.877+0000 7fe9c83e0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c0134980 con 0x7fe9c0137f20 2023-10-03T10:12:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.877+0000 7fe9c83e0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c006c4b0 con 0x7fe9c0134ec0 2023-10-03T10:12:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.877+0000 7fe9c83e0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c00a09c0 con 0x7fe9c006c0e0 2023-10-03T10:12:37.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.877+0000 7fe9c617c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9c006c0e0 0x7fe9c009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.877+0000 7fe9c617c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9c006c0e0 0x7fe9c009ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34394/0 (socket says 172.21.15.72:34394) 2023-10-03T10:12:37.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.877+0000 7fe9c617c700 1 -- 172.21.15.72:0/3050328779 learned_addr learned my addr 172.21.15.72:0/3050328779 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:37.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.877+0000 7fe9c597b700 1 --2- 172.21.15.72:0/3050328779 >> v2:172.21.15.72:3300/0 conn(0x7fe9c0134ec0 0x7fe9c01379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.878+0000 7fe9c597b700 1 -- 172.21.15.72:0/3050328779 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9c006c0e0 msgr2=0x7fe9c009ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.878+0000 7fe9c597b700 1 --2- 172.21.15.72:0/3050328779 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9c006c0e0 0x7fe9c009ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.878+0000 7fe9c597b700 1 -- 172.21.15.72:0/3050328779 >> v1:172.21.15.72:6789/0 conn(0x7fe9c0137f20 legacy=0x7fe9c013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.878+0000 7fe9c597b700 1 -- 172.21.15.72:0/3050328779 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c00a0600 con 0x7fe9c0134ec0 2023-10-03T10:12:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.878+0000 7fe9c517a700 1 -- 172.21.15.72:0/3050328779 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895742224 0 0) 0x7fe9c0134980 con 0x7fe9c0137f20 2023-10-03T10:12:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.878+0000 7fe9c597b700 1 --2- 172.21.15.72:0/3050328779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0134ec0 0x7fe9c01379e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009840 tx=0x7fe9b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b8db0627861d04 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.878+0000 7fe9c517a700 1 -- 172.21.15.72:0/3050328779 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0011830 con 0x7fe9c0134ec0 2023-10-03T10:12:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.878+0000 7fe9c517a700 1 -- 172.21.15.72:0/3050328779 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b0011990 con 0x7fe9c0134ec0 2023-10-03T10:12:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.878+0000 7fe9c517a700 1 -- 172.21.15.72:0/3050328779 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0011d20 con 0x7fe9c0134ec0 2023-10-03T10:12:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.879+0000 7fe9c83e0700 1 -- 172.21.15.72:0/3050328779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0134ec0 msgr2=0x7fe9c01379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.879+0000 7fe9c83e0700 1 --2- 172.21.15.72:0/3050328779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0134ec0 0x7fe9c01379e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009840 tx=0x7fe9b0009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.879+0000 7fe9c83e0700 1 -- 172.21.15.72:0/3050328779 shutdown_connections 2023-10-03T10:12:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.879+0000 7fe9c83e0700 1 --2- 172.21.15.72:0/3050328779 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9c006c0e0 0x7fe9c009ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.879+0000 7fe9c83e0700 1 --2- 172.21.15.72:0/3050328779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c0134ec0 0x7fe9c01379e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.879+0000 7fe9c83e0700 1 -- 172.21.15.72:0/3050328779 >> 172.21.15.72:0/3050328779 conn(0x7fe9c00a4210 msgr2=0x7fe9c00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.879+0000 7fe9c83e0700 1 -- 172.21.15.72:0/3050328779 shutdown_connections 2023-10-03T10:12:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.879+0000 7fe9c83e0700 1 -- 172.21.15.72:0/3050328779 wait complete. 2023-10-03T10:12:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.880+0000 7fe9c83e0700 1 Processor -- start 2023-10-03T10:12:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.880+0000 7fe9c83e0700 1 -- start start 2023-10-03T10:12:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.880+0000 7fe9c83e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c006c0e0 0x7fe9c011a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.880+0000 7fe9c83e0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9c0134ec0 0x7fe9c011abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.880+0000 7fe9c83e0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9c0137f20 0x7fe9c011b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.880+0000 7fe9c83e0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c011e390 con 0x7fe9c006c0e0 2023-10-03T10:12:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.880+0000 7fe9c83e0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c0137b00 con 0x7fe9c0134ec0 2023-10-03T10:12:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.880+0000 7fe9c83e0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c00a03f0 con 0x7fe9c0137f20 2023-10-03T10:12:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.880+0000 7fe9c617c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c006c0e0 0x7fe9c011a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.880+0000 7fe9c697d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9c0137f20 0x7fe9c011b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.880+0000 7fe9c617c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c006c0e0 0x7fe9c011a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38232/0 (socket says 172.21.15.72:38232) 2023-10-03T10:12:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.881+0000 7fe9c617c700 1 -- 172.21.15.72:0/1219427224 learned_addr learned my addr 172.21.15.72:0/1219427224 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.881+0000 7fe9c597b700 1 --2- 172.21.15.72:0/1219427224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9c0134ec0 0x7fe9c011abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.881+0000 7fe9c617c700 1 -- 172.21.15.72:0/1219427224 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9c0137f20 msgr2=0x7fe9c011b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.881+0000 7fe9c617c700 1 --2- 172.21.15.72:0/1219427224 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9c0137f20 0x7fe9c011b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.881+0000 7fe9c617c700 1 -- 172.21.15.72:0/1219427224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9c0134ec0 msgr2=0x7fe9c011abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.881+0000 7fe9c617c700 1 --2- 172.21.15.72:0/1219427224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9c0134ec0 0x7fe9c011abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.881+0000 7fe9c617c700 1 -- 172.21.15.72:0/1219427224 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b00094a0 con 0x7fe9c006c0e0 2023-10-03T10:12:37.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.881+0000 7fe9c617c700 1 --2- 172.21.15.72:0/1219427224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c006c0e0 0x7fe9c011a680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00e8b0 tx=0x7fe9bc00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.881+0000 7fe9b6ffd700 1 -- 172.21.15.72:0/1219427224 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc013680 con 0x7fe9c006c0e0 2023-10-03T10:12:37.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.881+0000 7fe9b6ffd700 1 -- 172.21.15.72:0/1219427224 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc0137e0 con 0x7fe9c006c0e0 2023-10-03T10:12:37.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.881+0000 7fe9c83e0700 1 -- 172.21.15.72:0/1219427224 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c011bb60 con 0x7fe9c006c0e0 2023-10-03T10:12:37.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.881+0000 7fe9b6ffd700 1 -- 172.21.15.72:0/1219427224 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc013b70 con 0x7fe9c006c0e0 2023-10-03T10:12:37.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.881+0000 7fe9c83e0700 1 -- 172.21.15.72:0/1219427224 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c011bfd0 con 0x7fe9c006c0e0 2023-10-03T10:12:37.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.882+0000 7fe9c83e0700 1 -- 172.21.15.72:0/1219427224 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c0074ea0 con 0x7fe9c006c0e0 2023-10-03T10:12:37.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.882+0000 7fe9b6ffd700 1 -- 172.21.15.72:0/1219427224 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe9bc013cd0 con 0x7fe9c006c0e0 2023-10-03T10:12:37.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.883+0000 7fe9b6ffd700 1 -- 172.21.15.72:0/1219427224 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fe9bc03fd90 con 0x7fe9c006c0e0 2023-10-03T10:12:37.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.883+0000 7fe9c597b700 1 -- 172.21.15.72:0/1219427224 >> v1:172.21.15.72:6816/126756 conn(0x7fe9a402f560 legacy=0x7fe9a4031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:37.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.887+0000 7fe9b6ffd700 1 -- 172.21.15.72:0/1219427224 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9bc011db0 con 0x7fe9c006c0e0 2023-10-03T10:12:37.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.890+0000 7f8e5a69d700 1 Processor -- start 2023-10-03T10:12:37.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.890+0000 7f8e5a69d700 1 -- start start 2023-10-03T10:12:37.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.890+0000 7f8e5a69d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5409e1d0 0x7f8e54135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.890+0000 7f8e5a69d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e54135e50 0x7f8e54138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.890+0000 7f8e5a69d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5409f130 con 0x7f8e5409d6f0 2023-10-03T10:12:37.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.890+0000 7f8e5a69d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5409f520 con 0x7f8e5409e1d0 2023-10-03T10:12:37.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.890+0000 7f8e5a69d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5409e930 con 0x7f8e54135e50 2023-10-03T10:12:37.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.890+0000 7f8e537fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5409e1d0 0x7f8e54135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.891+0000 7f8e537fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5409e1d0 0x7f8e54135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34404/0 (socket says 172.21.15.72:34404) 2023-10-03T10:12:37.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.891+0000 7f8e537fe700 1 -- 172.21.15.72:0/1807247200 learned_addr learned my addr 172.21.15.72:0/1807247200 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:37.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.891+0000 7f8e58c3a700 1 --2- 172.21.15.72:0/1807247200 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e54135e50 0x7f8e54138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.891+0000 7f8e537fe700 1 -- 172.21.15.72:0/1807247200 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e54135e50 msgr2=0x7f8e54138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:37.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.891+0000 7f8e537fe700 1 --2- 172.21.15.72:0/1807247200 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e54135e50 0x7f8e54138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.891+0000 7f8e537fe700 1 -- 172.21.15.72:0/1807247200 >> v1:172.21.15.72:6789/0 conn(0x7f8e5409d6f0 legacy=0x7f8e5409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:37.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.891+0000 7f8e537fe700 1 -- 172.21.15.72:0/1807247200 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5409b2d0 con 0x7f8e5409e1d0 2023-10-03T10:12:37.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.891+0000 7f8e537fe700 1 --2- 172.21.15.72:0/1807247200 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5409e1d0 0x7f8e54135910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800bbc0 tx=0x7f8e4800bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb63c140b6bced32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.891+0000 7f8e52ffd700 1 -- 172.21.15.72:0/1807247200 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4800dcf0 con 0x7f8e5409e1d0 2023-10-03T10:12:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.891+0000 7f8e52ffd700 1 -- 172.21.15.72:0/1807247200 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4800de50 con 0x7f8e5409e1d0 2023-10-03T10:12:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.891+0000 7f8e52ffd700 1 -- 172.21.15.72:0/1807247200 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48004250 con 0x7f8e5409e1d0 2023-10-03T10:12:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.892+0000 7f8e5a69d700 1 -- 172.21.15.72:0/1807247200 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5409e1d0 msgr2=0x7f8e54135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.892+0000 7f8e5a69d700 1 --2- 172.21.15.72:0/1807247200 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5409e1d0 0x7f8e54135910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800bbc0 tx=0x7f8e4800bed0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.892+0000 7f8e5a69d700 1 -- 172.21.15.72:0/1807247200 shutdown_connections 2023-10-03T10:12:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.892+0000 7f8e5a69d700 1 --2- 172.21.15.72:0/1807247200 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e54135e50 0x7f8e54138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.892+0000 7f8e5a69d700 1 --2- 172.21.15.72:0/1807247200 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5409e1d0 0x7f8e54135910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.892+0000 7f8e5a69d700 1 -- 172.21.15.72:0/1807247200 >> 172.21.15.72:0/1807247200 conn(0x7f8e54066f50 msgr2=0x7f8e5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.892+0000 7f8e5a69d700 1 -- 172.21.15.72:0/1807247200 shutdown_connections 2023-10-03T10:12:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.892+0000 7f8e5a69d700 1 -- 172.21.15.72:0/1807247200 wait complete. 2023-10-03T10:12:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.893+0000 7f8e5a69d700 1 Processor -- start 2023-10-03T10:12:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.893+0000 7f8e5a69d700 1 -- start start 2023-10-03T10:12:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e5a69d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e5409d6f0 0x7f8e5412f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e5a69d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5409e1d0 0x7f8e5412f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e5a69d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e54135e50 0x7f8e541c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e5a69d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5411cea0 con 0x7f8e54135e50 2023-10-03T10:12:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e5a69d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5411b190 con 0x7f8e5409e1d0 2023-10-03T10:12:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e5a69d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e540a1d00 con 0x7f8e5409d6f0 2023-10-03T10:12:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e537fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5409e1d0 0x7f8e5412f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e53fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e5409d6f0 0x7f8e5412f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e537fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5409e1d0 0x7f8e5412f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34406/0 (socket says 172.21.15.72:34406) 2023-10-03T10:12:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e537fe700 1 -- 172.21.15.72:0/157559830 learned_addr learned my addr 172.21.15.72:0/157559830 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e58c3a700 1 --2- 172.21.15.72:0/157559830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e54135e50 0x7f8e541c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e537fe700 1 -- 172.21.15.72:0/157559830 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e5409d6f0 msgr2=0x7f8e5412f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e537fe700 1 --2- 172.21.15.72:0/157559830 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e5409d6f0 0x7f8e5412f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e537fe700 1 -- 172.21.15.72:0/157559830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e54135e50 msgr2=0x7f8e541c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e537fe700 1 --2- 172.21.15.72:0/157559830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e54135e50 0x7f8e541c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e537fe700 1 -- 172.21.15.72:0/157559830 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4800b7f0 con 0x7f8e5409e1d0 2023-10-03T10:12:37.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.894+0000 7f8e537fe700 1 --2- 172.21.15.72:0/157559830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5409e1d0 0x7f8e5412f9e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800b340 tx=0x7f8e48004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.895+0000 7f8e50ff9700 1 -- 172.21.15.72:0/157559830 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48003bf0 con 0x7f8e5409e1d0 2023-10-03T10:12:37.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.895+0000 7f8e50ff9700 1 -- 172.21.15.72:0/157559830 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e48003d90 con 0x7f8e5409e1d0 2023-10-03T10:12:37.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.895+0000 7f8e5a69d700 1 -- 172.21.15.72:0/157559830 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5409c700 con 0x7f8e5409e1d0 2023-10-03T10:12:37.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.895+0000 7f8e5a69d700 1 -- 172.21.15.72:0/157559830 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5412ff20 con 0x7f8e5409e1d0 2023-10-03T10:12:37.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.895+0000 7f8e50ff9700 1 -- 172.21.15.72:0/157559830 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480106b0 con 0x7f8e5409e1d0 2023-10-03T10:12:37.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.896+0000 7f8e5a69d700 1 -- 172.21.15.72:0/157559830 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e340052e0 con 0x7f8e5409e1d0 2023-10-03T10:12:37.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.896+0000 7f8e50ff9700 1 -- 172.21.15.72:0/157559830 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8e48010810 con 0x7f8e5409e1d0 2023-10-03T10:12:37.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.896+0000 7f8e53fff700 1 -- 172.21.15.72:0/157559830 >> v1:172.21.15.72:6816/126756 conn(0x7f8e4002f510 legacy=0x7f8e400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:37.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.900+0000 7f8e50ff9700 1 -- 172.21.15.72:0/157559830 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f8e4800e9b0 con 0x7f8e5409e1d0 2023-10-03T10:12:37.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.901+0000 7f8e50ff9700 1 -- 172.21.15.72:0/157559830 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e4800e7d0 con 0x7f8e5409e1d0 2023-10-03T10:12:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.949+0000 7f2e3ba73700 1 Processor -- start 2023-10-03T10:12:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.949+0000 7f2e3ba73700 1 -- start start 2023-10-03T10:12:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3ba73700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e3406a770 0x7f2e3409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3ba73700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e3409dc30 0x7f2e3409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3ba73700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e3413c1e0 0x7f2e3413e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3ba73700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3406ab40 con 0x7f2e3413c1e0 2023-10-03T10:12:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3ba73700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3409ebc0 con 0x7f2e3409dc30 2023-10-03T10:12:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3ba73700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3409a810 con 0x7f2e3406a770 2023-10-03T10:12:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3900e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e3409dc30 0x7f2e3409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3980f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e3406a770 0x7f2e3409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3900e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e3409dc30 0x7f2e3409e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34422/0 (socket says 172.21.15.72:34422) 2023-10-03T10:12:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3900e700 1 -- 172.21.15.72:0/2741050216 learned_addr learned my addr 172.21.15.72:0/2741050216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3a010700 1 --2- 172.21.15.72:0/2741050216 >> v2:172.21.15.72:3300/0 conn(0x7f2e3413c1e0 0x7f2e3413e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3900e700 1 -- 172.21.15.72:0/2741050216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e3406a770 msgr2=0x7f2e3409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3900e700 1 --2- 172.21.15.72:0/2741050216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e3406a770 0x7f2e3409d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3900e700 1 -- 172.21.15.72:0/2741050216 >> v2:172.21.15.72:3300/0 conn(0x7f2e3413c1e0 msgr2=0x7f2e3413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3900e700 1 --2- 172.21.15.72:0/2741050216 >> v2:172.21.15.72:3300/0 conn(0x7f2e3413c1e0 0x7f2e3413e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3900e700 1 -- 172.21.15.72:0/2741050216 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3409e920 con 0x7f2e3409dc30 2023-10-03T10:12:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.950+0000 7f2e3900e700 1 --2- 172.21.15.72:0/2741050216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e3409dc30 0x7f2e3409e080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009920 tx=0x7f2e24009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=814d003bc762d3df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.951+0000 7f2e3880d700 1 -- 172.21.15.72:0/2741050216 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24011830 con 0x7f2e3409dc30 2023-10-03T10:12:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.951+0000 7f2e3880d700 1 -- 172.21.15.72:0/2741050216 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e24011990 con 0x7f2e3409dc30 2023-10-03T10:12:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.951+0000 7f2e3880d700 1 -- 172.21.15.72:0/2741050216 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24011d20 con 0x7f2e3409dc30 2023-10-03T10:12:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.951+0000 7f2e3ba73700 1 -- 172.21.15.72:0/2741050216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e3409dc30 msgr2=0x7f2e3409e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.951+0000 7f2e3ba73700 1 --2- 172.21.15.72:0/2741050216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e3409dc30 0x7f2e3409e080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009920 tx=0x7f2e24009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.951+0000 7f2e3ba73700 1 -- 172.21.15.72:0/2741050216 shutdown_connections 2023-10-03T10:12:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.951+0000 7f2e3ba73700 1 --2- 172.21.15.72:0/2741050216 >> v2:172.21.15.72:3300/0 conn(0x7f2e3413c1e0 0x7f2e3413e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.951+0000 7f2e3ba73700 1 --2- 172.21.15.72:0/2741050216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e3406a770 0x7f2e3409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.951+0000 7f2e3ba73700 1 --2- 172.21.15.72:0/2741050216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e3409dc30 0x7f2e3409e080 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.951+0000 7f2e3ba73700 1 -- 172.21.15.72:0/2741050216 >> 172.21.15.72:0/2741050216 conn(0x7f2e34066f50 msgr2=0x7f2e3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.951+0000 7f2e3ba73700 1 -- 172.21.15.72:0/2741050216 shutdown_connections 2023-10-03T10:12:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.951+0000 7f2e3ba73700 1 -- 172.21.15.72:0/2741050216 wait complete. 2023-10-03T10:12:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.953+0000 7f2e3ba73700 1 Processor -- start 2023-10-03T10:12:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.953+0000 7f2e3ba73700 1 -- start start 2023-10-03T10:12:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3ba73700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e3406a770 0x7f2e3413a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3ba73700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e3409dc30 0x7f2e3413ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3ba73700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e3413c1e0 0x7f2e3413b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3ba73700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3411fee0 con 0x7f2e3413c1e0 2023-10-03T10:12:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3ba73700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34138ff0 con 0x7f2e3409dc30 2023-10-03T10:12:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3ba73700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3409f1a0 con 0x7f2e3406a770 2023-10-03T10:12:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3980f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e3406a770 0x7f2e3413a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3900e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e3409dc30 0x7f2e3413ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3980f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e3406a770 0x7f2e3413a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58572/0 (socket says 172.21.15.72:58572) 2023-10-03T10:12:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3900e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e3409dc30 0x7f2e3413ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34428/0 (socket says 172.21.15.72:34428) 2023-10-03T10:12:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3980f700 1 -- 172.21.15.72:0/75099461 learned_addr learned my addr 172.21.15.72:0/75099461 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3a010700 1 --2- 172.21.15.72:0/75099461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e3413c1e0 0x7f2e3413b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3900e700 1 -- 172.21.15.72:0/75099461 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e3406a770 msgr2=0x7f2e3413a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3900e700 1 --2- 172.21.15.72:0/75099461 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e3406a770 0x7f2e3413a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3900e700 1 -- 172.21.15.72:0/75099461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e3413c1e0 msgr2=0x7f2e3413b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3900e700 1 --2- 172.21.15.72:0/75099461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e3413c1e0 0x7f2e3413b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3900e700 1 -- 172.21.15.72:0/75099461 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e24009550 con 0x7f2e3409dc30 2023-10-03T10:12:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3980f700 1 --2- 172.21.15.72:0/75099461 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e3406a770 0x7f2e3413a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:37.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3900e700 1 --2- 172.21.15.72:0/75099461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e3409dc30 0x7f2e3413ab00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2e24016000 tx=0x7f2e24004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e2a7fc700 1 -- 172.21.15.72:0/75099461 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24004240 con 0x7f2e3409dc30 2023-10-03T10:12:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e2a7fc700 1 -- 172.21.15.72:0/75099461 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2401f070 con 0x7f2e3409dc30 2023-10-03T10:12:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e3ba73700 1 -- 172.21.15.72:0/75099461 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3413baa0 con 0x7f2e3409dc30 2023-10-03T10:12:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.954+0000 7f2e2a7fc700 1 -- 172.21.15.72:0/75099461 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240045e0 con 0x7f2e3409dc30 2023-10-03T10:12:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.955+0000 7f2e3ba73700 1 -- 172.21.15.72:0/75099461 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3411fb90 con 0x7f2e3409dc30 2023-10-03T10:12:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.955+0000 7f2e2a7fc700 1 -- 172.21.15.72:0/75099461 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2e24021030 con 0x7f2e3409dc30 2023-10-03T10:12:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.956+0000 7f2e3ba73700 1 -- 172.21.15.72:0/75099461 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3411fd20 con 0x7f2e3409dc30 2023-10-03T10:12:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.956+0000 7f2e2a7fc700 1 -- 172.21.15.72:0/75099461 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f2e24040c20 con 0x7f2e3409dc30 2023-10-03T10:12:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.956+0000 7f2e3980f700 1 -- 172.21.15.72:0/75099461 >> v1:172.21.15.72:6816/126756 conn(0x7f2e1802f510 legacy=0x7f2e180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:37.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:37.965+0000 7f2e2a7fc700 1 -- 172.21.15.72:0/75099461 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e24003e00 con 0x7f2e3409dc30 2023-10-03T10:12:38.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.049+0000 7f21eeffd700 1 -- 172.21.15.72:0/4067584476 >> v1:172.21.15.72:6816/126756 conn(0x7f21dc02f510 legacy=0x7f21dc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:38.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.056+0000 7f21f61b8700 1 -- 172.21.15.72:0/4067584476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f21f011bb50 con 0x7f21f006f640 2023-10-03T10:12:38.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.057+0000 7f21d7fff700 1 -- 172.21.15.72:0/4067584476 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21f011bb50 con 0x7f21f006f640 2023-10-03T10:12:38.057 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.059+0000 7f21f61b8700 1 -- 172.21.15.72:0/4067584476 >> v1:172.21.15.72:6816/126756 conn(0x7f21dc02f510 legacy=0x7f21dc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.059+0000 7f21f61b8700 1 -- 172.21.15.72:0/4067584476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f006f640 msgr2=0x7f21f0118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.059+0000 7f21f61b8700 1 --2- 172.21.15.72:0/4067584476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f006f640 0x7f21f0118cd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009d10 tx=0x7f21e00133b0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.059+0000 7f21f61b8700 1 -- 172.21.15.72:0/4067584476 shutdown_connections 2023-10-03T10:12:38.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.059+0000 7f21f61b8700 1 --2- 172.21.15.72:0/4067584476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f006f640 0x7f21f0118cd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.059+0000 7f21f61b8700 1 --2- 172.21.15.72:0/4067584476 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21f0130790 0x7f21f0119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.059+0000 7f21f61b8700 1 --2- 172.21.15.72:0/4067584476 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21f006ffb0 0x7f21f0119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.059+0000 7f21f61b8700 1 -- 172.21.15.72:0/4067584476 >> 172.21.15.72:0/4067584476 conn(0x7f21f00a2aa0 msgr2=0x7f21f012d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.059+0000 7f21f61b8700 1 -- 172.21.15.72:0/4067584476 shutdown_connections 2023-10-03T10:12:38.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.059+0000 7f21f61b8700 1 -- 172.21.15.72:0/4067584476 wait complete. 2023-10-03T10:12:38.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:38.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.084+0000 7fe9c597b700 1 -- 172.21.15.72:0/1219427224 >> v1:172.21.15.72:6816/126756 conn(0x7fe9a402f560 legacy=0x7fe9a4031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.089+0000 7fe9c83e0700 1 -- 172.21.15.72:0/1219427224 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe9c011da30 con 0x7fe9c006c0e0 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.090+0000 7fe9b6ffd700 1 -- 172.21.15.72:0/1219427224 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe9bc017070 con 0x7fe9c006c0e0 2023-10-03T10:12:38.090 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:38.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.092+0000 7fe9c83e0700 1 -- 172.21.15.72:0/1219427224 >> v1:172.21.15.72:6816/126756 conn(0x7fe9a402f560 legacy=0x7fe9a4031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.092+0000 7fe9c83e0700 1 -- 172.21.15.72:0/1219427224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c006c0e0 msgr2=0x7fe9c011a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.092+0000 7fe9c83e0700 1 --2- 172.21.15.72:0/1219427224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c006c0e0 0x7fe9c011a680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00e8b0 tx=0x7fe9bc00ebc0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.092+0000 7fe9c83e0700 1 -- 172.21.15.72:0/1219427224 shutdown_connections 2023-10-03T10:12:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.092+0000 7fe9c83e0700 1 --2- 172.21.15.72:0/1219427224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9c006c0e0 0x7fe9c011a680 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.092+0000 7fe9c83e0700 1 --2- 172.21.15.72:0/1219427224 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9c0137f20 0x7fe9c011b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.092+0000 7fe9c83e0700 1 --2- 172.21.15.72:0/1219427224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9c0134ec0 0x7fe9c011abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.092+0000 7fe9c83e0700 1 -- 172.21.15.72:0/1219427224 >> 172.21.15.72:0/1219427224 conn(0x7fe9c00a4210 msgr2=0x7fe9c00a0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.092+0000 7fe9c83e0700 1 -- 172.21.15.72:0/1219427224 shutdown_connections 2023-10-03T10:12:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.092+0000 7fe9c83e0700 1 -- 172.21.15.72:0/1219427224 wait complete. 2023-10-03T10:12:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.097+0000 7f8e53fff700 1 -- 172.21.15.72:0/157559830 >> v1:172.21.15.72:6816/126756 conn(0x7f8e4002f510 legacy=0x7f8e400319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:38.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:38.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.115+0000 7f8e5a69d700 1 -- 172.21.15.72:0/157559830 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e34005860 con 0x7f8e5409e1d0 2023-10-03T10:12:38.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.115+0000 7f8e50ff9700 1 -- 172.21.15.72:0/157559830 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8e4800e7d0 con 0x7f8e5409e1d0 2023-10-03T10:12:38.116 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:38.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.117+0000 7f8e5a69d700 1 -- 172.21.15.72:0/157559830 >> v1:172.21.15.72:6816/126756 conn(0x7f8e4002f510 legacy=0x7f8e400319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:38.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.117+0000 7f8e5a69d700 1 -- 172.21.15.72:0/157559830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5409e1d0 msgr2=0x7f8e5412f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.117+0000 7f8e5a69d700 1 --2- 172.21.15.72:0/157559830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5409e1d0 0x7f8e5412f9e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800b340 tx=0x7f8e48004750 comp rx=0 tx=0).stop 2023-10-03T10:12:38.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.117+0000 7f8e5a69d700 1 -- 172.21.15.72:0/157559830 shutdown_connections 2023-10-03T10:12:38.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.117+0000 7f8e5a69d700 1 --2- 172.21.15.72:0/157559830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e54135e50 0x7f8e541c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.117+0000 7f8e5a69d700 1 --2- 172.21.15.72:0/157559830 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e5409d6f0 0x7f8e5412f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.117+0000 7f8e5a69d700 1 --2- 172.21.15.72:0/157559830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5409e1d0 0x7f8e5412f9e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.117+0000 7f8e5a69d700 1 -- 172.21.15.72:0/157559830 >> 172.21.15.72:0/157559830 conn(0x7f8e54066f50 msgr2=0x7f8e540a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.117+0000 7f8e5a69d700 1 -- 172.21.15.72:0/157559830 shutdown_connections 2023-10-03T10:12:38.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.117+0000 7f8e5a69d700 1 -- 172.21.15.72:0/157559830 wait complete. 2023-10-03T10:12:38.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:38.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.157+0000 7f2e3980f700 1 -- 172.21.15.72:0/75099461 >> v1:172.21.15.72:6816/126756 conn(0x7f2e1802f510 legacy=0x7f2e180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.160+0000 7f2e3ba73700 1 -- 172.21.15.72:0/75099461 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e34074ea0 con 0x7f2e3409dc30 2023-10-03T10:12:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.160+0000 7f2e2a7fc700 1 -- 172.21.15.72:0/75099461 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e24015020 con 0x7f2e3409dc30 2023-10-03T10:12:38.161 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.162+0000 7f2e3ba73700 1 -- 172.21.15.72:0/75099461 >> v1:172.21.15.72:6816/126756 conn(0x7f2e1802f510 legacy=0x7f2e180319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.162+0000 7f2e3ba73700 1 -- 172.21.15.72:0/75099461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e3409dc30 msgr2=0x7f2e3413ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.162+0000 7f2e3ba73700 1 --2- 172.21.15.72:0/75099461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e3409dc30 0x7f2e3413ab00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2e24016000 tx=0x7f2e24004750 comp rx=0 tx=0).stop 2023-10-03T10:12:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.162+0000 7f2e3ba73700 1 -- 172.21.15.72:0/75099461 shutdown_connections 2023-10-03T10:12:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.162+0000 7f2e3ba73700 1 --2- 172.21.15.72:0/75099461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e3413c1e0 0x7f2e3413b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.162+0000 7f2e3ba73700 1 --2- 172.21.15.72:0/75099461 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e3406a770 0x7f2e3413a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.162+0000 7f2e3ba73700 1 --2- 172.21.15.72:0/75099461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e3409dc30 0x7f2e3413ab00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.162+0000 7f2e3ba73700 1 -- 172.21.15.72:0/75099461 >> 172.21.15.72:0/75099461 conn(0x7f2e34066f50 msgr2=0x7f2e3409b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.163+0000 7f2e3ba73700 1 -- 172.21.15.72:0/75099461 shutdown_connections 2023-10-03T10:12:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:38.163+0000 7f2e3ba73700 1 -- 172.21.15.72:0/75099461 wait complete. 2023-10-03T10:12:38.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:39.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:39.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:39.131 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:39.176 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.206+0000 7f2720018700 1 Processor -- start 2023-10-03T10:12:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.206+0000 7f2720018700 1 -- start start 2023-10-03T10:12:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f2720018700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f271809e1b0 0x7f2718138a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f2720018700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2718138f50 0x7f271813b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f2720018700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271809a570 con 0x7f271809d6d0 2023-10-03T10:12:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f2720018700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271809e5a0 con 0x7f271809e1b0 2023-10-03T10:12:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f2720018700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f271809b1c0 con 0x7f2718138f50 2023-10-03T10:12:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f271d5b3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f271809e1b0 0x7f2718138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f271ddb4700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f271809d6d0 0x7f271809daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51070/0 (socket says 172.21.15.72:51070) 2023-10-03T10:12:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f271d5b3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f271809e1b0 0x7f2718138a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49144/0 (socket says 172.21.15.72:49144) 2023-10-03T10:12:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f271ddb4700 1 -- 172.21.15.72:0/4274456379 learned_addr learned my addr 172.21.15.72:0/4274456379 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f271e5b5700 1 --2- 172.21.15.72:0/4274456379 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2718138f50 0x7f271813b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f271d5b3700 1 -- 172.21.15.72:0/4274456379 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2718138f50 msgr2=0x7f271813b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f271d5b3700 1 --2- 172.21.15.72:0/4274456379 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2718138f50 0x7f271813b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f271d5b3700 1 -- 172.21.15.72:0/4274456379 >> v1:172.21.15.72:6789/0 conn(0x7f271809d6d0 legacy=0x7f271809daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f271d5b3700 1 -- 172.21.15.72:0/4274456379 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271809f240 con 0x7f271809e1b0 2023-10-03T10:12:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f271d5b3700 1 --2- 172.21.15.72:0/4274456379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f271809e1b0 0x7f2718138a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2708009840 tx=0x7f2708009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc30ca185d88c967 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.207+0000 7f271cdb2700 1 -- 172.21.15.72:0/4274456379 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2708004230 con 0x7f271809e1b0 2023-10-03T10:12:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.208+0000 7f271cdb2700 1 -- 172.21.15.72:0/4274456379 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2708004390 con 0x7f271809e1b0 2023-10-03T10:12:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.208+0000 7f271cdb2700 1 -- 172.21.15.72:0/4274456379 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080036a0 con 0x7f271809e1b0 2023-10-03T10:12:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.208+0000 7f2720018700 1 -- 172.21.15.72:0/4274456379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f271809e1b0 msgr2=0x7f2718138a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.208+0000 7f2720018700 1 --2- 172.21.15.72:0/4274456379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f271809e1b0 0x7f2718138a10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2708009840 tx=0x7f2708009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.208+0000 7f2720018700 1 -- 172.21.15.72:0/4274456379 shutdown_connections 2023-10-03T10:12:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.208+0000 7f2720018700 1 --2- 172.21.15.72:0/4274456379 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2718138f50 0x7f271813b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.208+0000 7f2720018700 1 --2- 172.21.15.72:0/4274456379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f271809e1b0 0x7f2718138a10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.208+0000 7f2720018700 1 -- 172.21.15.72:0/4274456379 >> 172.21.15.72:0/4274456379 conn(0x7f2718099c20 msgr2=0x7f27180a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.208+0000 7f2720018700 1 -- 172.21.15.72:0/4274456379 shutdown_connections 2023-10-03T10:12:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.208+0000 7f2720018700 1 -- 172.21.15.72:0/4274456379 wait complete. 2023-10-03T10:12:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.209+0000 7f2720018700 1 Processor -- start 2023-10-03T10:12:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.209+0000 7f2720018700 1 -- start start 2023-10-03T10:12:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f2720018700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f271809d6d0 0x7f27181c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f2720018700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f271809e1b0 0x7f27181c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f2720018700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2718138f50 0x7f271811a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f2720018700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271811e270 con 0x7f2718138f50 2023-10-03T10:12:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f2720018700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27181c9000 con 0x7f271809d6d0 2023-10-03T10:12:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f2720018700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27181be0d0 con 0x7f271809e1b0 2023-10-03T10:12:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f271d5b3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f271809e1b0 0x7f27181c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f271ddb4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f271809d6d0 0x7f27181c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f271d5b3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f271809e1b0 0x7f27181c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45578/0 (socket says 172.21.15.72:45578) 2023-10-03T10:12:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f271d5b3700 1 -- 172.21.15.72:0/2568592509 learned_addr learned my addr 172.21.15.72:0/2568592509 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f271e5b5700 1 --2- 172.21.15.72:0/2568592509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2718138f50 0x7f271811a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f271d5b3700 1 -- 172.21.15.72:0/2568592509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f271809d6d0 msgr2=0x7f27181c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f271d5b3700 1 --2- 172.21.15.72:0/2568592509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f271809d6d0 0x7f27181c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f271d5b3700 1 -- 172.21.15.72:0/2568592509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2718138f50 msgr2=0x7f271811a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f271d5b3700 1 --2- 172.21.15.72:0/2568592509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2718138f50 0x7f271811a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f271d5b3700 1 -- 172.21.15.72:0/2568592509 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080094a0 con 0x7f271809e1b0 2023-10-03T10:12:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f271ddb4700 1 --2- 172.21.15.72:0/2568592509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f271809d6d0 0x7f27181c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.210+0000 7f271d5b3700 1 --2- 172.21.15.72:0/2568592509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f271809e1b0 0x7f27181c8ac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f27080090b0 tx=0x7f2708004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.211+0000 7f270e7fc700 1 -- 172.21.15.72:0/2568592509 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2708003cd0 con 0x7f271809e1b0 2023-10-03T10:12:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.211+0000 7f270e7fc700 1 -- 172.21.15.72:0/2568592509 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270801f070 con 0x7f271809e1b0 2023-10-03T10:12:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.211+0000 7f270e7fc700 1 -- 172.21.15.72:0/2568592509 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2708011870 con 0x7f271809e1b0 2023-10-03T10:12:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.211+0000 7f2720018700 1 -- 172.21.15.72:0/2568592509 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27181303e0 con 0x7f271809e1b0 2023-10-03T10:12:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.211+0000 7f2720018700 1 -- 172.21.15.72:0/2568592509 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271811dd50 con 0x7f271809e1b0 2023-10-03T10:12:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.211+0000 7f270e7fc700 1 -- 172.21.15.72:0/2568592509 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2708021030 con 0x7f271809e1b0 2023-10-03T10:12:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.212+0000 7f270e7fc700 1 -- 172.21.15.72:0/2568592509 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f2708042870 con 0x7f271809e1b0 2023-10-03T10:12:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.212+0000 7f271ddb4700 1 -- 172.21.15.72:0/2568592509 >> v1:172.21.15.72:6816/126756 conn(0x7f26fc02f510 legacy=0x7f26fc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:39.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.212+0000 7f2720018700 1 -- 172.21.15.72:0/2568592509 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271804f2a0 con 0x7f271809e1b0 2023-10-03T10:12:39.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.217+0000 7f270e7fc700 1 -- 172.21.15.72:0/2568592509 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2708046060 con 0x7f271809e1b0 2023-10-03T10:12:39.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.248+0000 7f0ec3b41700 1 Processor -- start 2023-10-03T10:12:39.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.248+0000 7f0ec3b41700 1 -- start start 2023-10-03T10:12:39.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.249+0000 7f0ec3b41700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ebc09d6f0 0x7f0ebc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.249+0000 7f0ec3b41700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ebc09e440 0x7f0ebc134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.249+0000 7f0ec3b41700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc09b120 con 0x7f0ebc09e000 2023-10-03T10:12:39.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.249+0000 7f0ec3b41700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ebc06b460 con 0x7f0ebc09d6f0 2023-10-03T10:12:39.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.249+0000 7f0ec3b41700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc09a7e0 con 0x7f0ebc09e440 2023-10-03T10:12:39.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.249+0000 7f0ec18dd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ebc09d6f0 0x7f0ebc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.249+0000 7f0ec18dd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ebc09d6f0 0x7f0ebc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49162/0 (socket says 172.21.15.72:49162) 2023-10-03T10:12:39.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.249+0000 7f0ec18dd700 1 -- 172.21.15.72:0/617113471 learned_addr learned my addr 172.21.15.72:0/617113471 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:39.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.249+0000 7f0ec20de700 1 --2- 172.21.15.72:0/617113471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ebc09e440 0x7f0ebc134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.249+0000 7f0ec18dd700 1 -- 172.21.15.72:0/617113471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ebc09e440 msgr2=0x7f0ebc134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:39.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.249+0000 7f0ec08db700 1 -- 172.21.15.72:0/617113471 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517132759 0 0) 0x7f0ebc09b120 con 0x7f0ebc09e000 2023-10-03T10:12:39.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.249+0000 7f0ec18dd700 1 --2- 172.21.15.72:0/617113471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ebc09e440 0x7f0ebc134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.249+0000 7f0ec18dd700 1 -- 172.21.15.72:0/617113471 >> v1:172.21.15.72:6789/0 conn(0x7f0ebc09e000 legacy=0x7f0ebc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.249+0000 7f0ec18dd700 1 -- 172.21.15.72:0/617113471 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc09a500 con 0x7f0ebc09d6f0 2023-10-03T10:12:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.249+0000 7f0ec20de700 1 --2- 172.21.15.72:0/617113471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ebc09e440 0x7f0ebc134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.250+0000 7f0ec18dd700 1 --2- 172.21.15.72:0/617113471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ebc09d6f0 0x7f0ebc09dac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009920 tx=0x7f0eb8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792c32c624c4056b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.250+0000 7f0ec08db700 1 -- 172.21.15.72:0/617113471 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8011830 con 0x7f0ebc09d6f0 2023-10-03T10:12:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.250+0000 7f0ec08db700 1 -- 172.21.15.72:0/617113471 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb8011990 con 0x7f0ebc09d6f0 2023-10-03T10:12:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.250+0000 7f0ec08db700 1 -- 172.21.15.72:0/617113471 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb8011d20 con 0x7f0ebc09d6f0 2023-10-03T10:12:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.251+0000 7f0ec3b41700 1 -- 172.21.15.72:0/617113471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ebc09d6f0 msgr2=0x7f0ebc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.251+0000 7f0ec3b41700 1 --2- 172.21.15.72:0/617113471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ebc09d6f0 0x7f0ebc09dac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009920 tx=0x7f0eb8009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.252+0000 7f0ec3b41700 1 -- 172.21.15.72:0/617113471 shutdown_connections 2023-10-03T10:12:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.252+0000 7f0ec3b41700 1 --2- 172.21.15.72:0/617113471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ebc09e440 0x7f0ebc134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.252+0000 7f0ec3b41700 1 --2- 172.21.15.72:0/617113471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ebc09d6f0 0x7f0ebc09dac0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.252+0000 7f0ec3b41700 1 -- 172.21.15.72:0/617113471 >> 172.21.15.72:0/617113471 conn(0x7f0ebc066f50 msgr2=0x7f0ebc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.252+0000 7f0ec3b41700 1 -- 172.21.15.72:0/617113471 shutdown_connections 2023-10-03T10:12:39.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.252+0000 7f0ec3b41700 1 -- 172.21.15.72:0/617113471 wait complete. 2023-10-03T10:12:39.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.253+0000 7f0ec3b41700 1 Processor -- start 2023-10-03T10:12:39.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.253+0000 7f0ec3b41700 1 -- start start 2023-10-03T10:12:39.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.253+0000 7f0ec3b41700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ebc09d6f0 0x7f0ebc1c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.253+0000 7f0ec3b41700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ebc09e000 0x7f0ebc1c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.253+0000 7f0ec3b41700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ebc09e440 0x7f0ebc1a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.253+0000 7f0ec3b41700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc1bcf70 con 0x7f0ebc09e000 2023-10-03T10:12:39.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.253+0000 7f0ec3b41700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc1c8f60 con 0x7f0ebc09d6f0 2023-10-03T10:12:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.253+0000 7f0ec3b41700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc1a6b50 con 0x7f0ebc09e440 2023-10-03T10:12:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.253+0000 7f0ec10dc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ebc09e000 0x7f0ebc1c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.253+0000 7f0ec10dc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ebc09e000 0x7f0ebc1c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49166/0 (socket says 172.21.15.72:49166) 2023-10-03T10:12:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.253+0000 7f0ec10dc700 1 -- 172.21.15.72:0/1137730559 learned_addr learned my addr 172.21.15.72:0/1137730559 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.254+0000 7f0ec20de700 1 --2- 172.21.15.72:0/1137730559 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ebc09e440 0x7f0ebc1a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.254+0000 7f0ec18dd700 1 --2- 172.21.15.72:0/1137730559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ebc09d6f0 0x7f0ebc1c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.254+0000 7f0ec10dc700 1 -- 172.21.15.72:0/1137730559 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ebc09e440 msgr2=0x7f0ebc1a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.254+0000 7f0ec10dc700 1 --2- 172.21.15.72:0/1137730559 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ebc09e440 0x7f0ebc1a3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.254+0000 7f0ec10dc700 1 -- 172.21.15.72:0/1137730559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ebc09d6f0 msgr2=0x7f0ebc1c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.254+0000 7f0ec10dc700 1 --2- 172.21.15.72:0/1137730559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ebc09d6f0 0x7f0ebc1c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.254+0000 7f0ec10dc700 1 -- 172.21.15.72:0/1137730559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb4009a70 con 0x7f0ebc09e000 2023-10-03T10:12:39.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.254+0000 7f0ec10dc700 1 --2- 172.21.15.72:0/1137730559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ebc09e000 0x7f0ebc1c8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0eac001eb0 tx=0x7f0eac00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.254+0000 7f0eb27fc700 1 -- 172.21.15.72:0/1137730559 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0054e0 con 0x7f0ebc09e000 2023-10-03T10:12:39.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.254+0000 7f0ec3b41700 1 -- 172.21.15.72:0/1137730559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb8009550 con 0x7f0ebc09e000 2023-10-03T10:12:39.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.254+0000 7f0eb27fc700 1 -- 172.21.15.72:0/1137730559 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac003680 con 0x7f0ebc09e000 2023-10-03T10:12:39.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.254+0000 7f0ec3b41700 1 -- 172.21.15.72:0/1137730559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ebc09c710 con 0x7f0ebc09e000 2023-10-03T10:12:39.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.254+0000 7f0eb27fc700 1 -- 172.21.15.72:0/1137730559 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0039f0 con 0x7f0ebc09e000 2023-10-03T10:12:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.255+0000 7f0eb27fc700 1 -- 172.21.15.72:0/1137730559 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0eac003b50 con 0x7f0ebc09e000 2023-10-03T10:12:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.255+0000 7f0eb27fc700 1 -- 172.21.15.72:0/1137730559 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f0eac03efb0 con 0x7f0ebc09e000 2023-10-03T10:12:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.255+0000 7f0ec18dd700 1 -- 172.21.15.72:0/1137730559 >> v1:172.21.15.72:6816/126756 conn(0x7f0ea002f510 legacy=0x7f0ea00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.256+0000 7f0ec3b41700 1 -- 172.21.15.72:0/1137730559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea40052e0 con 0x7f0ebc09e000 2023-10-03T10:12:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.264+0000 7f0eb27fc700 1 -- 172.21.15.72:0/1137730559 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0eac017080 con 0x7f0ebc09e000 2023-10-03T10:12:39.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.292+0000 7efcd0fa3700 1 Processor -- start 2023-10-03T10:12:39.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.292+0000 7efcd0fa3700 1 -- start start 2023-10-03T10:12:39.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.292+0000 7efcd0fa3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efccc133a80 0x7efccc133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.292+0000 7efcd0fa3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efccc12ff20 0x7efccc130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.292+0000 7efcd0fa3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efccc06bc00 con 0x7efccc130870 2023-10-03T10:12:39.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.292+0000 7efcd0fa3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efccc06c570 con 0x7efccc12ff20 2023-10-03T10:12:39.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.293+0000 7efcd0fa3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efccc0a0040 con 0x7efccc133a80 2023-10-03T10:12:39.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.293+0000 7efcc9d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efccc12ff20 0x7efccc130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.293+0000 7efcc9d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efccc12ff20 0x7efccc130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49168/0 (socket says 172.21.15.72:49168) 2023-10-03T10:12:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.293+0000 7efcc9d9b700 1 -- 172.21.15.72:0/765541670 learned_addr learned my addr 172.21.15.72:0/765541670 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.293+0000 7efcca59c700 1 --2- 172.21.15.72:0/765541670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efccc133a80 0x7efccc133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.293+0000 7efcc9d9b700 1 -- 172.21.15.72:0/765541670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efccc133a80 msgr2=0x7efccc133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.293+0000 7efcc9d9b700 1 --2- 172.21.15.72:0/765541670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efccc133a80 0x7efccc133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.293+0000 7efcc9d9b700 1 -- 172.21.15.72:0/765541670 >> v1:172.21.15.72:6789/0 conn(0x7efccc130870 legacy=0x7efccc13a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.293+0000 7efcc9d9b700 1 -- 172.21.15.72:0/765541670 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc133860 con 0x7efccc12ff20 2023-10-03T10:12:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.293+0000 7efcc9d9b700 1 --2- 172.21.15.72:0/765541670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efccc12ff20 0x7efccc130330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efcc00098f0 tx=0x7efcc0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fff2cea53c0645a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.294+0000 7efcc959a700 1 -- 172.21.15.72:0/765541670 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0011830 con 0x7efccc12ff20 2023-10-03T10:12:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.294+0000 7efcc959a700 1 -- 172.21.15.72:0/765541670 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc0011990 con 0x7efccc12ff20 2023-10-03T10:12:39.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.294+0000 7efcc959a700 1 -- 172.21.15.72:0/765541670 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0011d20 con 0x7efccc12ff20 2023-10-03T10:12:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.294+0000 7efcd0fa3700 1 -- 172.21.15.72:0/765541670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efccc12ff20 msgr2=0x7efccc130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.294+0000 7efcd0fa3700 1 --2- 172.21.15.72:0/765541670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efccc12ff20 0x7efccc130330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efcc00098f0 tx=0x7efcc0009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.294+0000 7efcd0fa3700 1 -- 172.21.15.72:0/765541670 shutdown_connections 2023-10-03T10:12:39.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.294+0000 7efcd0fa3700 1 --2- 172.21.15.72:0/765541670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efccc133a80 0x7efccc133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.294+0000 7efcd0fa3700 1 --2- 172.21.15.72:0/765541670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efccc12ff20 0x7efccc130330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.294+0000 7efcd0fa3700 1 -- 172.21.15.72:0/765541670 >> 172.21.15.72:0/765541670 conn(0x7efccc0a4210 msgr2=0x7efccc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.294+0000 7efcd0fa3700 1 -- 172.21.15.72:0/765541670 shutdown_connections 2023-10-03T10:12:39.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.294+0000 7efcd0fa3700 1 -- 172.21.15.72:0/765541670 wait complete. 2023-10-03T10:12:39.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.296+0000 7efcd0fa3700 1 Processor -- start 2023-10-03T10:12:39.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.296+0000 7efcd0fa3700 1 -- start start 2023-10-03T10:12:39.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcd0fa3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efccc12ff20 0x7efccc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcd0fa3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efccc130870 0x7efccc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcd0fa3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efccc133a80 0x7efccc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcd0fa3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efccc12d770 con 0x7efccc12ff20 2023-10-03T10:12:39.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcd0fa3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efccc11fb60 con 0x7efccc133a80 2023-10-03T10:12:39.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcd0fa3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efccc11fda0 con 0x7efccc130870 2023-10-03T10:12:39.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcca59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efccc12ff20 0x7efccc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcc9d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efccc130870 0x7efccc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcca59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efccc12ff20 0x7efccc09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49178/0 (socket says 172.21.15.72:49178) 2023-10-03T10:12:39.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcca59c700 1 -- 172.21.15.72:0/3512422743 learned_addr learned my addr 172.21.15.72:0/3512422743 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:39.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcc9d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efccc130870 0x7efccc09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45590/0 (socket says 172.21.15.72:45590) 2023-10-03T10:12:39.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efccad9d700 1 --2- 172.21.15.72:0/3512422743 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efccc133a80 0x7efccc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcca59c700 1 -- 172.21.15.72:0/3512422743 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efccc130870 msgr2=0x7efccc09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcca59c700 1 --2- 172.21.15.72:0/3512422743 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efccc130870 0x7efccc09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcca59c700 1 -- 172.21.15.72:0/3512422743 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efccc133a80 msgr2=0x7efccc09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcca59c700 1 --2- 172.21.15.72:0/3512422743 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efccc133a80 0x7efccc09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcca59c700 1 -- 172.21.15.72:0/3512422743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc0009550 con 0x7efccc12ff20 2023-10-03T10:12:39.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcc9d9b700 1 --2- 172.21.15.72:0/3512422743 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efccc130870 0x7efccc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:39.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.297+0000 7efcca59c700 1 --2- 172.21.15.72:0/3512422743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efccc12ff20 0x7efccc09c480 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00e9e0 tx=0x7efcbc00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.298+0000 7efcbaffd700 1 -- 172.21.15.72:0/3512422743 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc009710 con 0x7efccc12ff20 2023-10-03T10:12:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.298+0000 7efcbaffd700 1 -- 172.21.15.72:0/3512422743 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcbc00c7f0 con 0x7efccc12ff20 2023-10-03T10:12:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.298+0000 7efcd0fa3700 1 -- 172.21.15.72:0/3512422743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efccc120420 con 0x7efccc12ff20 2023-10-03T10:12:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.298+0000 7efcbaffd700 1 -- 172.21.15.72:0/3512422743 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc00cb60 con 0x7efccc12ff20 2023-10-03T10:12:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.298+0000 7efcd0fa3700 1 -- 172.21.15.72:0/3512422743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efccc120ad0 con 0x7efccc12ff20 2023-10-03T10:12:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.299+0000 7efcd0fa3700 1 -- 172.21.15.72:0/3512422743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efccc074ea0 con 0x7efccc12ff20 2023-10-03T10:12:39.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.299+0000 7efcbaffd700 1 -- 172.21.15.72:0/3512422743 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7efcbc00ccc0 con 0x7efccc12ff20 2023-10-03T10:12:39.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.299+0000 7efcbaffd700 1 -- 172.21.15.72:0/3512422743 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7efcbc040000 con 0x7efccc12ff20 2023-10-03T10:12:39.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.300+0000 7efcc9d9b700 1 -- 172.21.15.72:0/3512422743 >> v1:172.21.15.72:6816/126756 conn(0x7efcac02f510 legacy=0x7efcac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:39.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.304+0000 7efcbaffd700 1 -- 172.21.15.72:0/3512422743 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcbc01ab50 con 0x7efccc12ff20 2023-10-03T10:12:39.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.364+0000 7f84fa1b5700 1 Processor -- start 2023-10-03T10:12:39.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.364+0000 7f84fa1b5700 1 -- start start 2023-10-03T10:12:39.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84fa1b5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84f409d6f0 0x7f84f409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84fa1b5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84f409e000 0x7f84f4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84fa1b5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84f409e410 0x7f84f4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84fa1b5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f409f520 con 0x7f84f409d6f0 2023-10-03T10:12:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84fa1b5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f409f130 con 0x7f84f409e410 2023-10-03T10:12:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84fa1b5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84f409e930 con 0x7f84f409e000 2023-10-03T10:12:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84f37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84f409d6f0 0x7f84f409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84f37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84f409d6f0 0x7f84f409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49190/0 (socket says 172.21.15.72:49190) 2023-10-03T10:12:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84f37fe700 1 -- 172.21.15.72:0/2723271278 learned_addr learned my addr 172.21.15.72:0/2723271278 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84f2ffd700 1 --2- 172.21.15.72:0/2723271278 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84f409e000 0x7f84f4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84f3fff700 1 --2- 172.21.15.72:0/2723271278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84f409e410 0x7f84f4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84f3fff700 1 -- 172.21.15.72:0/2723271278 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84f409e000 msgr2=0x7f84f4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:39.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84f3fff700 1 --2- 172.21.15.72:0/2723271278 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84f409e000 0x7f84f4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84f3fff700 1 -- 172.21.15.72:0/2723271278 >> v2:172.21.15.72:3300/0 conn(0x7f84f409d6f0 msgr2=0x7f84f409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:39.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84f3fff700 1 --2- 172.21.15.72:0/2723271278 >> v2:172.21.15.72:3300/0 conn(0x7f84f409d6f0 0x7f84f409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84f3fff700 1 -- 172.21.15.72:0/2723271278 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f409b2d0 con 0x7f84f409e410 2023-10-03T10:12:39.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.365+0000 7f84f37fe700 1 --2- 172.21.15.72:0/2723271278 >> v2:172.21.15.72:3300/0 conn(0x7f84f409d6f0 0x7f84f409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:39.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.366+0000 7f84f3fff700 1 --2- 172.21.15.72:0/2723271278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84f409e410 0x7f84f4130ba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009d90 tx=0x7f84ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67cbbeaf437a5e4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.366+0000 7f84f27fc700 1 -- 172.21.15.72:0/2723271278 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec00e070 con 0x7f84f409e410 2023-10-03T10:12:39.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.366+0000 7f84f27fc700 1 -- 172.21.15.72:0/2723271278 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ec00bb20 con 0x7f84f409e410 2023-10-03T10:12:39.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.366+0000 7f84f27fc700 1 -- 172.21.15.72:0/2723271278 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec012430 con 0x7f84f409e410 2023-10-03T10:12:39.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.366+0000 7f84fa1b5700 1 -- 172.21.15.72:0/2723271278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84f409e410 msgr2=0x7f84f4130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.366+0000 7f84fa1b5700 1 --2- 172.21.15.72:0/2723271278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84f409e410 0x7f84f4130ba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009d90 tx=0x7f84ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:12:39.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.366+0000 7f84fa1b5700 1 -- 172.21.15.72:0/2723271278 shutdown_connections 2023-10-03T10:12:39.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.366+0000 7f84fa1b5700 1 --2- 172.21.15.72:0/2723271278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84f409e410 0x7f84f4130ba0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.366+0000 7f84fa1b5700 1 --2- 172.21.15.72:0/2723271278 >> v2:172.21.15.72:3300/0 conn(0x7f84f409d6f0 0x7f84f409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.366+0000 7f84fa1b5700 1 --2- 172.21.15.72:0/2723271278 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84f409e000 0x7f84f4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.366+0000 7f84fa1b5700 1 -- 172.21.15.72:0/2723271278 >> 172.21.15.72:0/2723271278 conn(0x7f84f4066f50 msgr2=0x7f84f409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.367+0000 7f84fa1b5700 1 -- 172.21.15.72:0/2723271278 shutdown_connections 2023-10-03T10:12:39.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.367+0000 7f84fa1b5700 1 -- 172.21.15.72:0/2723271278 wait complete. 2023-10-03T10:12:39.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.368+0000 7f84fa1b5700 1 Processor -- start 2023-10-03T10:12:39.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.368+0000 7f84fa1b5700 1 -- start start 2023-10-03T10:12:39.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84fa1b5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84f409d6f0 0x7f84f4130820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84fa1b5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84f409e000 0x7f84f4132380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84fa1b5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84f409e410 0x7f84f41328c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:39.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84fa1b5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f4133850 con 0x7f84f409e410 2023-10-03T10:12:39.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84fa1b5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f41344e0 con 0x7f84f409e000 2023-10-03T10:12:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84fa1b5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84f4072320 con 0x7f84f409d6f0 2023-10-03T10:12:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84f2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84f409e000 0x7f84f4132380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84f2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84f409e000 0x7f84f4132380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53896/0 (socket says 172.21.15.72:53896) 2023-10-03T10:12:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84f2ffd700 1 -- 172.21.15.72:0/2369941629 learned_addr learned my addr 172.21.15.72:0/2369941629 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84f37fe700 1 --2- 172.21.15.72:0/2369941629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84f409d6f0 0x7f84f4130820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84f3fff700 1 --2- 172.21.15.72:0/2369941629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84f409e410 0x7f84f41328c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84f2ffd700 1 -- 172.21.15.72:0/2369941629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84f409d6f0 msgr2=0x7f84f4130820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84f2ffd700 1 --2- 172.21.15.72:0/2369941629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84f409d6f0 0x7f84f4130820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84f2ffd700 1 -- 172.21.15.72:0/2369941629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84f409e410 msgr2=0x7f84f41328c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84f2ffd700 1 --2- 172.21.15.72:0/2369941629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84f409e410 0x7f84f41328c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84f2ffd700 1 -- 172.21.15.72:0/2369941629 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e4009550 con 0x7f84f409e000 2023-10-03T10:12:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.369+0000 7f84f2ffd700 1 --2- 172.21.15.72:0/2369941629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84f409e000 0x7f84f4132380 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f84e800e9b0 tx=0x7f84e800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.370+0000 7f84dbfff700 1 -- 172.21.15.72:0/2369941629 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e8009710 con 0x7f84f409e000 2023-10-03T10:12:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.370+0000 7f84dbfff700 1 -- 172.21.15.72:0/2369941629 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e800ee40 con 0x7f84f409e000 2023-10-03T10:12:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.370+0000 7f84fa1b5700 1 -- 172.21.15.72:0/2369941629 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ec009a70 con 0x7f84f409e000 2023-10-03T10:12:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.370+0000 7f84dbfff700 1 -- 172.21.15.72:0/2369941629 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e800ca50 con 0x7f84f409e000 2023-10-03T10:12:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.370+0000 7f84fa1b5700 1 -- 172.21.15.72:0/2369941629 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f4135eb0 con 0x7f84f409e000 2023-10-03T10:12:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.371+0000 7f84dbfff700 1 -- 172.21.15.72:0/2369941629 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f84e800cbb0 con 0x7f84f409e000 2023-10-03T10:12:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.371+0000 7f84fa1b5700 1 -- 172.21.15.72:0/2369941629 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f413afb0 con 0x7f84f409e000 2023-10-03T10:12:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.371+0000 7f84f37fe700 1 -- 172.21.15.72:0/2369941629 >> v1:172.21.15.72:6816/126756 conn(0x7f84e002f510 legacy=0x7f84e00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.371+0000 7f84dbfff700 1 -- 172.21.15.72:0/2369941629 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f84e8040000 con 0x7f84f409e000 2023-10-03T10:12:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.376+0000 7f84dbfff700 1 -- 172.21.15.72:0/2369941629 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84e801b3b0 con 0x7f84f409e000 2023-10-03T10:12:39.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.413+0000 7f271ddb4700 1 -- 172.21.15.72:0/2568592509 >> v1:172.21.15.72:6816/126756 conn(0x7f26fc02f510 legacy=0x7f26fc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:39.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.431+0000 7f2720018700 1 -- 172.21.15.72:0/2568592509 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f271804f2a0 con 0x7f271809e1b0 2023-10-03T10:12:39.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.432+0000 7f270e7fc700 1 -- 172.21.15.72:0/2568592509 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f270801a460 con 0x7f271809e1b0 2023-10-03T10:12:39.433 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:39.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.434+0000 7f2720018700 1 -- 172.21.15.72:0/2568592509 >> v1:172.21.15.72:6816/126756 conn(0x7f26fc02f510 legacy=0x7f26fc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:39.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.434+0000 7f2720018700 1 -- 172.21.15.72:0/2568592509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f271809e1b0 msgr2=0x7f27181c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.434+0000 7f2720018700 1 --2- 172.21.15.72:0/2568592509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f271809e1b0 0x7f27181c8ac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f27080090b0 tx=0x7f2708004750 comp rx=0 tx=0).stop 2023-10-03T10:12:39.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.434+0000 7f2720018700 1 -- 172.21.15.72:0/2568592509 shutdown_connections 2023-10-03T10:12:39.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.434+0000 7f2720018700 1 --2- 172.21.15.72:0/2568592509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2718138f50 0x7f271811a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.434+0000 7f2720018700 1 --2- 172.21.15.72:0/2568592509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f271809d6d0 0x7f27181c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.434+0000 7f2720018700 1 --2- 172.21.15.72:0/2568592509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f271809e1b0 0x7f27181c8ac0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.434+0000 7f2720018700 1 -- 172.21.15.72:0/2568592509 >> 172.21.15.72:0/2568592509 conn(0x7f2718099c20 msgr2=0x7f27180a2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.434+0000 7f2720018700 1 -- 172.21.15.72:0/2568592509 shutdown_connections 2023-10-03T10:12:39.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.434+0000 7f2720018700 1 -- 172.21.15.72:0/2568592509 wait complete. 2023-10-03T10:12:39.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.456+0000 7f0ec18dd700 1 -- 172.21.15.72:0/1137730559 >> v1:172.21.15.72:6816/126756 conn(0x7f0ea002f510 legacy=0x7f0ea00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:39.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.472+0000 7f0ec3b41700 1 -- 172.21.15.72:0/1137730559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ea4005860 con 0x7f0ebc09e000 2023-10-03T10:12:39.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.472+0000 7f0eb27fc700 1 -- 172.21.15.72:0/1137730559 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0eac01b3b0 con 0x7f0ebc09e000 2023-10-03T10:12:39.473 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:39.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.474+0000 7f0ec3b41700 1 -- 172.21.15.72:0/1137730559 >> v1:172.21.15.72:6816/126756 conn(0x7f0ea002f510 legacy=0x7f0ea00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:39.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.474+0000 7f0ec3b41700 1 -- 172.21.15.72:0/1137730559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ebc09e000 msgr2=0x7f0ebc1c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.474+0000 7f0ec3b41700 1 --2- 172.21.15.72:0/1137730559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ebc09e000 0x7f0ebc1c8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0eac001eb0 tx=0x7f0eac00c800 comp rx=0 tx=0).stop 2023-10-03T10:12:39.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.474+0000 7f0ec3b41700 1 -- 172.21.15.72:0/1137730559 shutdown_connections 2023-10-03T10:12:39.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.474+0000 7f0ec3b41700 1 --2- 172.21.15.72:0/1137730559 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ebc09e440 0x7f0ebc1a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.474+0000 7f0ec3b41700 1 --2- 172.21.15.72:0/1137730559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ebc09d6f0 0x7f0ebc1c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.474+0000 7f0ec3b41700 1 --2- 172.21.15.72:0/1137730559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ebc09e000 0x7f0ebc1c8a20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.474+0000 7f0ec3b41700 1 -- 172.21.15.72:0/1137730559 >> 172.21.15.72:0/1137730559 conn(0x7f0ebc066f50 msgr2=0x7f0ebc1bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.474+0000 7f0ec3b41700 1 -- 172.21.15.72:0/1137730559 shutdown_connections 2023-10-03T10:12:39.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.474+0000 7f0ec3b41700 1 -- 172.21.15.72:0/1137730559 wait complete. 2023-10-03T10:12:39.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:39.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.501+0000 7efcc9d9b700 1 -- 172.21.15.72:0/3512422743 >> v1:172.21.15.72:6816/126756 conn(0x7efcac02f510 legacy=0x7efcac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:39.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.502+0000 7efcd0fa3700 1 -- 172.21.15.72:0/3512422743 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efccc06b250 con 0x7efccc12ff20 2023-10-03T10:12:39.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.502+0000 7efcbaffd700 1 -- 172.21.15.72:0/3512422743 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efcbc021020 con 0x7efccc12ff20 2023-10-03T10:12:39.503 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:39.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.504+0000 7efcd0fa3700 1 -- 172.21.15.72:0/3512422743 >> v1:172.21.15.72:6816/126756 conn(0x7efcac02f510 legacy=0x7efcac0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:39.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.504+0000 7efcd0fa3700 1 -- 172.21.15.72:0/3512422743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efccc12ff20 msgr2=0x7efccc09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.504+0000 7efcd0fa3700 1 --2- 172.21.15.72:0/3512422743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efccc12ff20 0x7efccc09c480 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00e9e0 tx=0x7efcbc00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.504+0000 7efcd0fa3700 1 -- 172.21.15.72:0/3512422743 shutdown_connections 2023-10-03T10:12:39.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.504+0000 7efcd0fa3700 1 --2- 172.21.15.72:0/3512422743 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efccc12ff20 0x7efccc09c480 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.504+0000 7efcd0fa3700 1 --2- 172.21.15.72:0/3512422743 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efccc133a80 0x7efccc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.504+0000 7efcd0fa3700 1 --2- 172.21.15.72:0/3512422743 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efccc130870 0x7efccc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.504+0000 7efcd0fa3700 1 -- 172.21.15.72:0/3512422743 >> 172.21.15.72:0/3512422743 conn(0x7efccc0a4210 msgr2=0x7efccc09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.504+0000 7efcd0fa3700 1 -- 172.21.15.72:0/3512422743 shutdown_connections 2023-10-03T10:12:39.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.504+0000 7efcd0fa3700 1 -- 172.21.15.72:0/3512422743 wait complete. 2023-10-03T10:12:39.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:39.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.572+0000 7f84f37fe700 1 -- 172.21.15.72:0/2369941629 >> v1:172.21.15.72:6816/126756 conn(0x7f84e002f510 legacy=0x7f84e00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:39.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.578+0000 7f84fa1b5700 1 -- 172.21.15.72:0/2369941629 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f84f4134750 con 0x7f84f409e000 2023-10-03T10:12:39.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.578+0000 7f84dbfff700 1 -- 172.21.15.72:0/2369941629 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84e8021070 con 0x7f84f409e000 2023-10-03T10:12:39.579 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:39.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.580+0000 7f84fa1b5700 1 -- 172.21.15.72:0/2369941629 >> v1:172.21.15.72:6816/126756 conn(0x7f84e002f510 legacy=0x7f84e00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:39.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.580+0000 7f84fa1b5700 1 -- 172.21.15.72:0/2369941629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84f409e000 msgr2=0x7f84f4132380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:39.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.580+0000 7f84fa1b5700 1 --2- 172.21.15.72:0/2369941629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84f409e000 0x7f84f4132380 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f84e800e9b0 tx=0x7f84e800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.580+0000 7f84fa1b5700 1 -- 172.21.15.72:0/2369941629 shutdown_connections 2023-10-03T10:12:39.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.580+0000 7f84fa1b5700 1 --2- 172.21.15.72:0/2369941629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84f409e410 0x7f84f41328c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.580+0000 7f84fa1b5700 1 --2- 172.21.15.72:0/2369941629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84f409d6f0 0x7f84f4130820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.580+0000 7f84fa1b5700 1 --2- 172.21.15.72:0/2369941629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84f409e000 0x7f84f4132380 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:39.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.580+0000 7f84fa1b5700 1 -- 172.21.15.72:0/2369941629 >> 172.21.15.72:0/2369941629 conn(0x7f84f4066f50 msgr2=0x7f84f406b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:39.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.580+0000 7f84fa1b5700 1 -- 172.21.15.72:0/2369941629 shutdown_connections 2023-10-03T10:12:39.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:39.580+0000 7f84fa1b5700 1 -- 172.21.15.72:0/2369941629 wait complete. 2023-10-03T10:12:39.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:40.449 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:40.488 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:40.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:40.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.588+0000 7f2db4920700 1 Processor -- start 2023-10-03T10:12:40.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.589+0000 7f2db4920700 1 -- start start 2023-10-03T10:12:40.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.589+0000 7f2db4920700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0131810 0x7f2db0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.589+0000 7f2db4920700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2db009a580 0x7f2db0139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.589+0000 7f2db4920700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db01313c0 con 0x7f2db0099a40 2023-10-03T10:12:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.589+0000 7f2db4920700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db009b580 con 0x7f2db009a580 2023-10-03T10:12:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.589+0000 7f2db4920700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db006e8c0 con 0x7f2db0131810 2023-10-03T10:12:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.589+0000 7f2dae59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0131810 0x7f2db0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.589+0000 7f2daed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2db009a580 0x7f2db0139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.589+0000 7f2dae59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0131810 0x7f2db0131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53906/0 (socket says 172.21.15.72:53906) 2023-10-03T10:12:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.589+0000 7f2dae59c700 1 -- 172.21.15.72:0/3638498713 learned_addr learned my addr 172.21.15.72:0/3638498713 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.590+0000 7f2daed9d700 1 -- 172.21.15.72:0/3638498713 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0131810 msgr2=0x7f2db0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.590+0000 7f2daed9d700 1 --2- 172.21.15.72:0/3638498713 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0131810 0x7f2db0131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.590+0000 7f2daed9d700 1 -- 172.21.15.72:0/3638498713 >> v1:172.21.15.72:6789/0 conn(0x7f2db0099a40 legacy=0x7f2db0099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.590+0000 7f2daed9d700 1 -- 172.21.15.72:0/3638498713 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db0071d20 con 0x7f2db009a580 2023-10-03T10:12:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.590+0000 7f2dad59a700 1 -- 172.21.15.72:0/3638498713 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821154409 0 0) 0x7f2db01313c0 con 0x7f2db0099a40 2023-10-03T10:12:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.590+0000 7f2daed9d700 1 --2- 172.21.15.72:0/3638498713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2db009a580 0x7f2db0139660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2da800f370 tx=0x7f2da800f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2191c8655017b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.590+0000 7f2dad59a700 1 -- 172.21.15.72:0/3638498713 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8012070 con 0x7f2db009a580 2023-10-03T10:12:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.590+0000 7f2dad59a700 1 -- 172.21.15.72:0/3638498713 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da800fe70 con 0x7f2db009a580 2023-10-03T10:12:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.590+0000 7f2dad59a700 1 -- 172.21.15.72:0/3638498713 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da800d2f0 con 0x7f2db009a580 2023-10-03T10:12:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.591+0000 7f2db4920700 1 -- 172.21.15.72:0/3638498713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2db009a580 msgr2=0x7f2db0139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.591+0000 7f2db4920700 1 --2- 172.21.15.72:0/3638498713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2db009a580 0x7f2db0139660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2da800f370 tx=0x7f2da800f680 comp rx=0 tx=0).stop 2023-10-03T10:12:40.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.591+0000 7f2db4920700 1 -- 172.21.15.72:0/3638498713 shutdown_connections 2023-10-03T10:12:40.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.591+0000 7f2db4920700 1 --2- 172.21.15.72:0/3638498713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2db009a580 0x7f2db0139660 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.591+0000 7f2db4920700 1 --2- 172.21.15.72:0/3638498713 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0131810 0x7f2db0131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.591+0000 7f2db4920700 1 -- 172.21.15.72:0/3638498713 >> 172.21.15.72:0/3638498713 conn(0x7f2db00a2aa0 msgr2=0x7f2db00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.591+0000 7f2db4920700 1 -- 172.21.15.72:0/3638498713 shutdown_connections 2023-10-03T10:12:40.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.591+0000 7f2db4920700 1 -- 172.21.15.72:0/3638498713 wait complete. 2023-10-03T10:12:40.594 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:40.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.592+0000 7f2db4920700 1 Processor -- start 2023-10-03T10:12:40.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.592+0000 7f2db4920700 1 -- start start 2023-10-03T10:12:40.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.592+0000 7f2db4920700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0099a40 0x7f2db009c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.592+0000 7f2db4920700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2db009a580 0x7f2db009ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.592+0000 7f2db4920700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2db0131810 0x7f2db009d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.592+0000 7f2db4920700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db0119f80 con 0x7f2db0131810 2023-10-03T10:12:40.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.592+0000 7f2db4920700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db01195a0 con 0x7f2db0099a40 2023-10-03T10:12:40.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.592+0000 7f2db4920700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2db009df50 con 0x7f2db009a580 2023-10-03T10:12:40.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.592+0000 7f2dae59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0099a40 0x7f2db009c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.592+0000 7f2dae59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0099a40 0x7f2db009c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53920/0 (socket says 172.21.15.72:53920) 2023-10-03T10:12:40.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.592+0000 7f2dae59c700 1 -- 172.21.15.72:0/591234181 learned_addr learned my addr 172.21.15.72:0/591234181 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:40.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.593+0000 7f2daed9d700 1 --2- 172.21.15.72:0/591234181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2db0131810 0x7f2db009d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.593+0000 7f2dadd9b700 1 --2- 172.21.15.72:0/591234181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2db009a580 0x7f2db009ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.593+0000 7f2dae59c700 1 -- 172.21.15.72:0/591234181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2db009a580 msgr2=0x7f2db009ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.593+0000 7f2dae59c700 1 --2- 172.21.15.72:0/591234181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2db009a580 0x7f2db009ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.593+0000 7f2dae59c700 1 -- 172.21.15.72:0/591234181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2db0131810 msgr2=0x7f2db009d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.593+0000 7f2dae59c700 1 --2- 172.21.15.72:0/591234181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2db0131810 0x7f2db009d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.593+0000 7f2dae59c700 1 -- 172.21.15.72:0/591234181 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da800f050 con 0x7f2db0099a40 2023-10-03T10:12:40.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.593+0000 7f2dae59c700 1 --2- 172.21.15.72:0/591234181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0099a40 0x7f2db009c7b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2da000e910 tx=0x7f2da000ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.593+0000 7f2d9effd700 1 -- 172.21.15.72:0/591234181 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da00096a0 con 0x7f2db0099a40 2023-10-03T10:12:40.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.593+0000 7f2d9effd700 1 -- 172.21.15.72:0/591234181 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da0013680 con 0x7f2db0099a40 2023-10-03T10:12:40.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.593+0000 7f2db4920700 1 -- 172.21.15.72:0/591234181 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db0072250 con 0x7f2db0099a40 2023-10-03T10:12:40.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.593+0000 7f2d9effd700 1 -- 172.21.15.72:0/591234181 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da0013a30 con 0x7f2db0099a40 2023-10-03T10:12:40.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.593+0000 7f2db4920700 1 -- 172.21.15.72:0/591234181 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db006eb00 con 0x7f2db0099a40 2023-10-03T10:12:40.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.594+0000 7f2db4920700 1 -- 172.21.15.72:0/591234181 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db011aab0 con 0x7f2db0099a40 2023-10-03T10:12:40.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.595+0000 7f2d9effd700 1 -- 172.21.15.72:0/591234181 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2da0013b90 con 0x7f2db0099a40 2023-10-03T10:12:40.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.595+0000 7f2d9effd700 1 -- 172.21.15.72:0/591234181 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f2da00402c0 con 0x7f2db0099a40 2023-10-03T10:12:40.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.595+0000 7f2dadd9b700 1 -- 172.21.15.72:0/591234181 >> v1:172.21.15.72:6816/126756 conn(0x7f2d9002f510 legacy=0x7f2d900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:40.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.600+0000 7f2d9effd700 1 -- 172.21.15.72:0/591234181 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2da00253d0 con 0x7f2db0099a40 2023-10-03T10:12:40.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.626+0000 7f856a3ac700 1 Processor -- start 2023-10-03T10:12:40.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.627+0000 7f856a3ac700 1 -- start start 2023-10-03T10:12:40.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.627+0000 7f856a3ac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f856406f5d0 0x7f856412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.627+0000 7f856a3ac700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8564135c20 0x7f8564138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.627+0000 7f856a3ac700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856406fa40 con 0x7f856412cf60 2023-10-03T10:12:40.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.627+0000 7f856a3ac700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856412cd90 con 0x7f8564135c20 2023-10-03T10:12:40.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.627+0000 7f856a3ac700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8564071780 con 0x7f856406f5d0 2023-10-03T10:12:40.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.628+0000 7f85637fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f856406f5d0 0x7f856412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.628+0000 7f85637fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f856406f5d0 0x7f856412ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53936/0 (socket says 172.21.15.72:53936) 2023-10-03T10:12:40.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.628+0000 7f85637fe700 1 -- 172.21.15.72:0/3415995140 learned_addr learned my addr 172.21.15.72:0/3415995140 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:40.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.628+0000 7f85637fe700 1 -- 172.21.15.72:0/3415995140 >> v2:172.21.15.72:3300/0 conn(0x7f8564135c20 msgr2=0x7f8564138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.628+0000 7f85637fe700 1 --2- 172.21.15.72:0/3415995140 >> v2:172.21.15.72:3300/0 conn(0x7f8564135c20 0x7f8564138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.628+0000 7f85637fe700 1 -- 172.21.15.72:0/3415995140 >> v1:172.21.15.72:6789/0 conn(0x7f856412cf60 legacy=0x7f856412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.628+0000 7f85637fe700 1 -- 172.21.15.72:0/3415995140 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8564071a40 con 0x7f856406f5d0 2023-10-03T10:12:40.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.628+0000 7f85637fe700 1 --2- 172.21.15.72:0/3415995140 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f856406f5d0 0x7f856412ffc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85580098f0 tx=0x7f8558009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bc3b860aded4d2c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.628+0000 7f8562ffd700 1 -- 172.21.15.72:0/3415995140 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855800b8a0 con 0x7f856406f5d0 2023-10-03T10:12:40.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.628+0000 7f8562ffd700 1 -- 172.21.15.72:0/3415995140 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855800ba00 con 0x7f856406f5d0 2023-10-03T10:12:40.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.628+0000 7f8562ffd700 1 -- 172.21.15.72:0/3415995140 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855800bd90 con 0x7f856406f5d0 2023-10-03T10:12:40.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.629+0000 7f856a3ac700 1 -- 172.21.15.72:0/3415995140 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f856406f5d0 msgr2=0x7f856412ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.629+0000 7f856a3ac700 1 --2- 172.21.15.72:0/3415995140 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f856406f5d0 0x7f856412ffc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85580098f0 tx=0x7f8558009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.629+0000 7f856a3ac700 1 -- 172.21.15.72:0/3415995140 shutdown_connections 2023-10-03T10:12:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.629+0000 7f856a3ac700 1 --2- 172.21.15.72:0/3415995140 >> v2:172.21.15.72:3300/0 conn(0x7f8564135c20 0x7f8564138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.629+0000 7f856a3ac700 1 --2- 172.21.15.72:0/3415995140 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f856406f5d0 0x7f856412ffc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.629+0000 7f856a3ac700 1 -- 172.21.15.72:0/3415995140 >> 172.21.15.72:0/3415995140 conn(0x7f85640a2aa0 msgr2=0x7f85640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.629+0000 7f856a3ac700 1 -- 172.21.15.72:0/3415995140 shutdown_connections 2023-10-03T10:12:40.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.629+0000 7f856a3ac700 1 -- 172.21.15.72:0/3415995140 wait complete. 2023-10-03T10:12:40.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.630+0000 7f856a3ac700 1 Processor -- start 2023-10-03T10:12:40.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.631+0000 7f856a3ac700 1 -- start start 2023-10-03T10:12:40.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.631+0000 7f856a3ac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f856406f5d0 0x7f8564137ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.631+0000 7f856a3ac700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f856412cf60 0x7f8564138420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.631+0000 7f856a3ac700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8564135c20 0x7f8564138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.631+0000 7f856a3ac700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856413a5f0 con 0x7f8564135c20 2023-10-03T10:12:40.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.631+0000 7f856a3ac700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85640a1240 con 0x7f856406f5d0 2023-10-03T10:12:40.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.631+0000 7f856a3ac700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f856413a050 con 0x7f856412cf60 2023-10-03T10:12:40.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.631+0000 7f8563fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f856406f5d0 0x7f8564137ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.631+0000 7f8563fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f856406f5d0 0x7f8564137ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53938/0 (socket says 172.21.15.72:53938) 2023-10-03T10:12:40.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.631+0000 7f8563fff700 1 -- 172.21.15.72:0/1041689262 learned_addr learned my addr 172.21.15.72:0/1041689262 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:40.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.631+0000 7f8568949700 1 --2- 172.21.15.72:0/1041689262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8564135c20 0x7f8564138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.632+0000 7f8563fff700 1 -- 172.21.15.72:0/1041689262 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f856412cf60 msgr2=0x7f8564138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.632+0000 7f8563fff700 1 --2- 172.21.15.72:0/1041689262 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f856412cf60 0x7f8564138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.632+0000 7f8563fff700 1 -- 172.21.15.72:0/1041689262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8564135c20 msgr2=0x7f8564138960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.632+0000 7f8563fff700 1 --2- 172.21.15.72:0/1041689262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8564135c20 0x7f8564138960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.632+0000 7f8563fff700 1 -- 172.21.15.72:0/1041689262 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8558009550 con 0x7f856406f5d0 2023-10-03T10:12:40.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.632+0000 7f8563fff700 1 --2- 172.21.15.72:0/1041689262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f856406f5d0 0x7f8564137ee0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f855400c510 tx=0x7f855400c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.632+0000 7f8560ff9700 1 -- 172.21.15.72:0/1041689262 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554011790 con 0x7f856406f5d0 2023-10-03T10:12:40.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.632+0000 7f856a3ac700 1 -- 172.21.15.72:0/1041689262 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856413b700 con 0x7f856406f5d0 2023-10-03T10:12:40.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.632+0000 7f8560ff9700 1 -- 172.21.15.72:0/1041689262 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85540118f0 con 0x7f856406f5d0 2023-10-03T10:12:40.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.632+0000 7f8560ff9700 1 -- 172.21.15.72:0/1041689262 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554011c60 con 0x7f856406f5d0 2023-10-03T10:12:40.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.632+0000 7f856a3ac700 1 -- 172.21.15.72:0/1041689262 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856413b420 con 0x7f856406f5d0 2023-10-03T10:12:40.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.633+0000 7f8560ff9700 1 -- 172.21.15.72:0/1041689262 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8554005080 con 0x7f856406f5d0 2023-10-03T10:12:40.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.633+0000 7f8560ff9700 1 -- 172.21.15.72:0/1041689262 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f855403f510 con 0x7f856406f5d0 2023-10-03T10:12:40.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.633+0000 7f85637fe700 1 -- 172.21.15.72:0/1041689262 >> v1:172.21.15.72:6816/126756 conn(0x7f855002f510 legacy=0x7f85500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:40.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.633+0000 7f856a3ac700 1 -- 172.21.15.72:0/1041689262 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8564074ea0 con 0x7f856406f5d0 2023-10-03T10:12:40.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.642+0000 7f8560ff9700 1 -- 172.21.15.72:0/1041689262 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85540102e0 con 0x7f856406f5d0 2023-10-03T10:12:40.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.695+0000 7f0b3cff2700 1 Processor -- start 2023-10-03T10:12:40.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.695+0000 7f0b3cff2700 1 -- start start 2023-10-03T10:12:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.696+0000 7f0b3cff2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b3809d6f0 0x7f0b3809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.696+0000 7f0b3cff2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809e410 0x7f0b38130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.696+0000 7f0b3cff2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3809f130 con 0x7f0b3809e000 2023-10-03T10:12:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.696+0000 7f0b3cff2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3809f520 con 0x7f0b3809d6f0 2023-10-03T10:12:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.696+0000 7f0b3cff2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3809e930 con 0x7f0b3809e410 2023-10-03T10:12:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.696+0000 7f0b3659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b3809d6f0 0x7f0b3809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.696+0000 7f0b35d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0b3809e000 0x7f0b38130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51116/0 (socket says 172.21.15.72:51116) 2023-10-03T10:12:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.696+0000 7f0b35d9b700 1 -- 172.21.15.72:0/4286910298 learned_addr learned my addr 172.21.15.72:0/4286910298 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:40.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.696+0000 7f0b36d9d700 1 --2- 172.21.15.72:0/4286910298 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809e410 0x7f0b38130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.696+0000 7f0b3659c700 1 -- 172.21.15.72:0/4286910298 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809e410 msgr2=0x7f0b38130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.696+0000 7f0b3659c700 1 --2- 172.21.15.72:0/4286910298 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809e410 0x7f0b38130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.696+0000 7f0b3659c700 1 -- 172.21.15.72:0/4286910298 >> v1:172.21.15.72:6789/0 conn(0x7f0b3809e000 legacy=0x7f0b38130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.696+0000 7f0b3559a700 1 -- 172.21.15.72:0/4286910298 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229565352 0 0) 0x7f0b3809f130 con 0x7f0b3809e000 2023-10-03T10:12:40.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.696+0000 7f0b3659c700 1 -- 172.21.15.72:0/4286910298 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3809b2d0 con 0x7f0b3809d6f0 2023-10-03T10:12:40.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.696+0000 7f0b36d9d700 1 --2- 172.21.15.72:0/4286910298 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809e410 0x7f0b38130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:40.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.697+0000 7f0b3659c700 1 --2- 172.21.15.72:0/4286910298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b3809d6f0 0x7f0b3809dac0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009840 tx=0x7f0b28009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a6d24027d0d8a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.697+0000 7f0b3559a700 1 -- 172.21.15.72:0/4286910298 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b28011830 con 0x7f0b3809d6f0 2023-10-03T10:12:40.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.697+0000 7f0b3559a700 1 -- 172.21.15.72:0/4286910298 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b28011990 con 0x7f0b3809d6f0 2023-10-03T10:12:40.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.697+0000 7f0b3559a700 1 -- 172.21.15.72:0/4286910298 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b28011d20 con 0x7f0b3809d6f0 2023-10-03T10:12:40.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.697+0000 7f0b3cff2700 1 -- 172.21.15.72:0/4286910298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b3809d6f0 msgr2=0x7f0b3809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.697+0000 7f0b3cff2700 1 --2- 172.21.15.72:0/4286910298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b3809d6f0 0x7f0b3809dac0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009840 tx=0x7f0b28009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:40.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.698+0000 7f0b3cff2700 1 -- 172.21.15.72:0/4286910298 shutdown_connections 2023-10-03T10:12:40.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.698+0000 7f0b3cff2700 1 --2- 172.21.15.72:0/4286910298 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809e410 0x7f0b38130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.698+0000 7f0b3cff2700 1 --2- 172.21.15.72:0/4286910298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b3809d6f0 0x7f0b3809dac0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.698+0000 7f0b3cff2700 1 -- 172.21.15.72:0/4286910298 >> 172.21.15.72:0/4286910298 conn(0x7f0b38066f50 msgr2=0x7f0b3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.698+0000 7f0b3cff2700 1 -- 172.21.15.72:0/4286910298 shutdown_connections 2023-10-03T10:12:40.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.698+0000 7f0b3cff2700 1 -- 172.21.15.72:0/4286910298 wait complete. 2023-10-03T10:12:40.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.699+0000 7f0b3cff2700 1 Processor -- start 2023-10-03T10:12:40.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.699+0000 7f0b3cff2700 1 -- start start 2023-10-03T10:12:40.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b3cff2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b3809d6f0 0x7f0b381c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b3cff2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809e000 0x7f0b381c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b3cff2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b3809e410 0x7f0b381c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b3cff2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3811ff90 con 0x7f0b3809d6f0 2023-10-03T10:12:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b3cff2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3806eca0 con 0x7f0b3809e410 2023-10-03T10:12:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b3cff2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3809c700 con 0x7f0b3809e000 2023-10-03T10:12:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b3659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b3809d6f0 0x7f0b381c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b3659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b3809d6f0 0x7f0b381c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49282/0 (socket says 172.21.15.72:49282) 2023-10-03T10:12:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b3659c700 1 -- 172.21.15.72:0/4024882663 learned_addr learned my addr 172.21.15.72:0/4024882663 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b35d9b700 1 --2- 172.21.15.72:0/4024882663 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809e000 0x7f0b381c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b36d9d700 1 --2- 172.21.15.72:0/4024882663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b3809e410 0x7f0b381c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b3659c700 1 -- 172.21.15.72:0/4024882663 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809e000 msgr2=0x7f0b381c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b3659c700 1 --2- 172.21.15.72:0/4024882663 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809e000 0x7f0b381c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b3659c700 1 -- 172.21.15.72:0/4024882663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b3809e410 msgr2=0x7f0b381c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b3659c700 1 --2- 172.21.15.72:0/4024882663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b3809e410 0x7f0b381c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b3659c700 1 -- 172.21.15.72:0/4024882663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b30009a70 con 0x7f0b3809d6f0 2023-10-03T10:12:40.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b36d9d700 1 --2- 172.21.15.72:0/4024882663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b3809e410 0x7f0b381c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:40.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.700+0000 7f0b3659c700 1 --2- 172.21.15.72:0/4024882663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b3809d6f0 0x7f0b381c8440 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009fd0 tx=0x7f0b28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.701+0000 7f0b26ffd700 1 -- 172.21.15.72:0/4024882663 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b280045d0 con 0x7f0b3809d6f0 2023-10-03T10:12:40.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.701+0000 7f0b26ffd700 1 -- 172.21.15.72:0/4024882663 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2801f070 con 0x7f0b3809d6f0 2023-10-03T10:12:40.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.701+0000 7f0b3cff2700 1 -- 172.21.15.72:0/4024882663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b280094a0 con 0x7f0b3809d6f0 2023-10-03T10:12:40.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.701+0000 7f0b26ffd700 1 -- 172.21.15.72:0/4024882663 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b280038e0 con 0x7f0b3809d6f0 2023-10-03T10:12:40.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.701+0000 7f0b3cff2700 1 -- 172.21.15.72:0/4024882663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b38125a10 con 0x7f0b3809d6f0 2023-10-03T10:12:40.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.702+0000 7f0b26ffd700 1 -- 172.21.15.72:0/4024882663 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0b28003a40 con 0x7f0b3809d6f0 2023-10-03T10:12:40.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.702+0000 7f0b3cff2700 1 -- 172.21.15.72:0/4024882663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b38074ea0 con 0x7f0b3809d6f0 2023-10-03T10:12:40.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.702+0000 7f0b35d9b700 1 -- 172.21.15.72:0/4024882663 >> v1:172.21.15.72:6816/126756 conn(0x7f0b1802f510 legacy=0x7f0b180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:40.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.702+0000 7f0b26ffd700 1 -- 172.21.15.72:0/4024882663 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f0b28021070 con 0x7f0b3809d6f0 2023-10-03T10:12:40.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.711+0000 7f0b26ffd700 1 -- 172.21.15.72:0/4024882663 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b28010380 con 0x7f0b3809d6f0 2023-10-03T10:12:40.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.734+0000 7f86c29ee700 1 Processor -- start 2023-10-03T10:12:40.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.734+0000 7f86c29ee700 1 -- start start 2023-10-03T10:12:40.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.735+0000 7f86c29ee700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86bc0a0a30 0x7f86bc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.735+0000 7f86c29ee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86bc138d80 0x7f86bc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.735+0000 7f86c29ee700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86bc0a2a70 con 0x7f86bc09d630 2023-10-03T10:12:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.735+0000 7f86c29ee700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc0a01d0 con 0x7f86bc138d80 2023-10-03T10:12:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.735+0000 7f86c29ee700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc09e2b0 con 0x7f86bc0a0a30 2023-10-03T10:12:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.735+0000 7f86bb7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f86bc09d630 0x7f86bc0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51132/0 (socket says 172.21.15.72:51132) 2023-10-03T10:12:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.735+0000 7f86bb7fe700 1 -- 172.21.15.72:0/3363199195 learned_addr learned my addr 172.21.15.72:0/3363199195 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.735+0000 7f86c0f8b700 1 --2- 172.21.15.72:0/3363199195 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86bc138d80 0x7f86bc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.735+0000 7f86baffd700 1 -- 172.21.15.72:0/3363199195 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067943165 0 0) 0x7f86bc0a2a70 con 0x7f86bc09d630 2023-10-03T10:12:40.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.735+0000 7f86c0f8b700 1 -- 172.21.15.72:0/3363199195 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86bc0a0a30 msgr2=0x7f86bc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:40.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.735+0000 7f86c0f8b700 1 --2- 172.21.15.72:0/3363199195 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86bc0a0a30 0x7f86bc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.735+0000 7f86c0f8b700 1 -- 172.21.15.72:0/3363199195 >> v1:172.21.15.72:6789/0 conn(0x7f86bc09d630 legacy=0x7f86bc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.735+0000 7f86c0f8b700 1 -- 172.21.15.72:0/3363199195 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc09dc50 con 0x7f86bc138d80 2023-10-03T10:12:40.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.735+0000 7f86c0f8b700 1 --2- 172.21.15.72:0/3363199195 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86bc138d80 0x7f86bc13b160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009dc0 tx=0x7f86b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cedabbffb984b6b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.735+0000 7f86baffd700 1 -- 172.21.15.72:0/3363199195 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b400e070 con 0x7f86bc138d80 2023-10-03T10:12:40.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.736+0000 7f86baffd700 1 -- 172.21.15.72:0/3363199195 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b400bbd0 con 0x7f86bc138d80 2023-10-03T10:12:40.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.736+0000 7f86baffd700 1 -- 172.21.15.72:0/3363199195 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4012430 con 0x7f86bc138d80 2023-10-03T10:12:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.736+0000 7f86c29ee700 1 -- 172.21.15.72:0/3363199195 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86bc138d80 msgr2=0x7f86bc13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.736+0000 7f86c29ee700 1 --2- 172.21.15.72:0/3363199195 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86bc138d80 0x7f86bc13b160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009dc0 tx=0x7f86b400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.736+0000 7f86c29ee700 1 -- 172.21.15.72:0/3363199195 shutdown_connections 2023-10-03T10:12:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.736+0000 7f86c29ee700 1 --2- 172.21.15.72:0/3363199195 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86bc138d80 0x7f86bc13b160 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.736+0000 7f86c29ee700 1 --2- 172.21.15.72:0/3363199195 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86bc0a0a30 0x7f86bc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.736+0000 7f86c29ee700 1 -- 172.21.15.72:0/3363199195 >> 172.21.15.72:0/3363199195 conn(0x7f86bc0a3050 msgr2=0x7f86bc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.736+0000 7f86c29ee700 1 -- 172.21.15.72:0/3363199195 shutdown_connections 2023-10-03T10:12:40.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.737+0000 7f86c29ee700 1 -- 172.21.15.72:0/3363199195 wait complete. 2023-10-03T10:12:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.738+0000 7f86c29ee700 1 Processor -- start 2023-10-03T10:12:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.738+0000 7f86c29ee700 1 -- start start 2023-10-03T10:12:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86c29ee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86bc09d630 0x7f86bc133680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86c29ee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86bc0a0a30 0x7f86bc133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86c29ee700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86bc138d80 0x7f86bc134100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86c29ee700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc134b50 con 0x7f86bc0a0a30 2023-10-03T10:12:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86c29ee700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc136550 con 0x7f86bc09d630 2023-10-03T10:12:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86c29ee700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc1371a0 con 0x7f86bc138d80 2023-10-03T10:12:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86bbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86bc09d630 0x7f86bc133680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86bbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86bc09d630 0x7f86bc133680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53976/0 (socket says 172.21.15.72:53976) 2023-10-03T10:12:40.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86bbfff700 1 -- 172.21.15.72:0/642546030 learned_addr learned my addr 172.21.15.72:0/642546030 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:40.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86c0f8b700 1 --2- 172.21.15.72:0/642546030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86bc138d80 0x7f86bc134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86bb7fe700 1 --2- 172.21.15.72:0/642546030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86bc0a0a30 0x7f86bc133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:40.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86bbfff700 1 -- 172.21.15.72:0/642546030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86bc138d80 msgr2=0x7f86bc134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86bbfff700 1 --2- 172.21.15.72:0/642546030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86bc138d80 0x7f86bc134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86bbfff700 1 -- 172.21.15.72:0/642546030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86bc0a0a30 msgr2=0x7f86bc133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86bbfff700 1 --2- 172.21.15.72:0/642546030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86bc0a0a30 0x7f86bc133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.739+0000 7f86bbfff700 1 -- 172.21.15.72:0/642546030 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b4009a70 con 0x7f86bc09d630 2023-10-03T10:12:40.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.740+0000 7f86bbfff700 1 --2- 172.21.15.72:0/642546030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86bc09d630 0x7f86bc133680 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00b530 tx=0x7f86ac00b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:40.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.740+0000 7f86b8ff9700 1 -- 172.21.15.72:0/642546030 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac011830 con 0x7f86bc09d630 2023-10-03T10:12:40.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.740+0000 7f86b8ff9700 1 -- 172.21.15.72:0/642546030 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac011990 con 0x7f86bc09d630 2023-10-03T10:12:40.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.740+0000 7f86c29ee700 1 -- 172.21.15.72:0/642546030 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86bc0a0410 con 0x7f86bc09d630 2023-10-03T10:12:40.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.740+0000 7f86b8ff9700 1 -- 172.21.15.72:0/642546030 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac011d40 con 0x7f86bc09d630 2023-10-03T10:12:40.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.740+0000 7f86c29ee700 1 -- 172.21.15.72:0/642546030 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86bc136c60 con 0x7f86bc09d630 2023-10-03T10:12:40.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.741+0000 7f86b8ff9700 1 -- 172.21.15.72:0/642546030 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f86ac01a400 con 0x7f86bc09d630 2023-10-03T10:12:40.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.741+0000 7f86c29ee700 1 -- 172.21.15.72:0/642546030 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86bc135b30 con 0x7f86bc09d630 2023-10-03T10:12:40.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.741+0000 7f86bb7fe700 1 -- 172.21.15.72:0/642546030 >> v1:172.21.15.72:6816/126756 conn(0x7f86a802f510 legacy=0x7f86a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:40.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.744+0000 7f86b8ff9700 1 -- 172.21.15.72:0/642546030 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f86ac01a6b0 con 0x7f86bc09d630 2023-10-03T10:12:40.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.750+0000 7f86b8ff9700 1 -- 172.21.15.72:0/642546030 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86ac015030 con 0x7f86bc09d630 2023-10-03T10:12:40.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.796+0000 7f2dadd9b700 1 -- 172.21.15.72:0/591234181 >> v1:172.21.15.72:6816/126756 conn(0x7f2d9002f510 legacy=0x7f2d900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:40.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.834+0000 7f85637fe700 1 -- 172.21.15.72:0/1041689262 >> v1:172.21.15.72:6816/126756 conn(0x7f855002f510 legacy=0x7f85500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.844+0000 7f2db4920700 1 -- 172.21.15.72:0/591234181 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2db0074ea0 con 0x7f2db0099a40 2023-10-03T10:12:40.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.845+0000 7f2d9effd700 1 -- 172.21.15.72:0/591234181 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2da0021020 con 0x7f2db0099a40 2023-10-03T10:12:40.845 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:40.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.847+0000 7f2db4920700 1 -- 172.21.15.72:0/591234181 >> v1:172.21.15.72:6816/126756 conn(0x7f2d9002f510 legacy=0x7f2d900319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:40.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.847+0000 7f2db4920700 1 -- 172.21.15.72:0/591234181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0099a40 msgr2=0x7f2db009c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.847+0000 7f2db4920700 1 --2- 172.21.15.72:0/591234181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0099a40 0x7f2db009c7b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2da000e910 tx=0x7f2da000ec20 comp rx=0 tx=0).stop 2023-10-03T10:12:40.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.847+0000 7f2db4920700 1 -- 172.21.15.72:0/591234181 shutdown_connections 2023-10-03T10:12:40.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.847+0000 7f2db4920700 1 --2- 172.21.15.72:0/591234181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2db0131810 0x7f2db009d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.847+0000 7f2db4920700 1 --2- 172.21.15.72:0/591234181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2db0099a40 0x7f2db009c7b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.847+0000 7f2db4920700 1 --2- 172.21.15.72:0/591234181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2db009a580 0x7f2db009ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.847+0000 7f2db4920700 1 -- 172.21.15.72:0/591234181 >> 172.21.15.72:0/591234181 conn(0x7f2db00a2aa0 msgr2=0x7f2db00a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.847+0000 7f2db4920700 1 -- 172.21.15.72:0/591234181 shutdown_connections 2023-10-03T10:12:40.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.847+0000 7f2db4920700 1 -- 172.21.15.72:0/591234181 wait complete. 2023-10-03T10:12:40.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:40.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.861+0000 7f856a3ac700 1 -- 172.21.15.72:0/1041689262 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f856413b210 con 0x7f856406f5d0 2023-10-03T10:12:40.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.861+0000 7f8560ff9700 1 -- 172.21.15.72:0/1041689262 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8554019b00 con 0x7f856406f5d0 2023-10-03T10:12:40.862 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:40.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.863+0000 7f856a3ac700 1 -- 172.21.15.72:0/1041689262 >> v1:172.21.15.72:6816/126756 conn(0x7f855002f510 legacy=0x7f85500319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:40.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.863+0000 7f856a3ac700 1 -- 172.21.15.72:0/1041689262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f856406f5d0 msgr2=0x7f8564137ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.863+0000 7f856a3ac700 1 --2- 172.21.15.72:0/1041689262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f856406f5d0 0x7f8564137ee0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f855400c510 tx=0x7f855400c820 comp rx=0 tx=0).stop 2023-10-03T10:12:40.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.863+0000 7f856a3ac700 1 -- 172.21.15.72:0/1041689262 shutdown_connections 2023-10-03T10:12:40.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.863+0000 7f856a3ac700 1 --2- 172.21.15.72:0/1041689262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8564135c20 0x7f8564138960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.863+0000 7f856a3ac700 1 --2- 172.21.15.72:0/1041689262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f856406f5d0 0x7f8564137ee0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.863+0000 7f856a3ac700 1 --2- 172.21.15.72:0/1041689262 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f856412cf60 0x7f8564138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.863+0000 7f856a3ac700 1 -- 172.21.15.72:0/1041689262 >> 172.21.15.72:0/1041689262 conn(0x7f85640a2aa0 msgr2=0x7f856412a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.863+0000 7f856a3ac700 1 -- 172.21.15.72:0/1041689262 shutdown_connections 2023-10-03T10:12:40.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.863+0000 7f856a3ac700 1 -- 172.21.15.72:0/1041689262 wait complete. 2023-10-03T10:12:40.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:40.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.903+0000 7f0b35d9b700 1 -- 172.21.15.72:0/4024882663 >> v1:172.21.15.72:6816/126756 conn(0x7f0b1802f510 legacy=0x7f0b180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:40.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.915+0000 7f0b3cff2700 1 -- 172.21.15.72:0/4024882663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0b3806c360 con 0x7f0b3809d6f0 2023-10-03T10:12:40.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.915+0000 7f0b26ffd700 1 -- 172.21.15.72:0/4024882663 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0b28015020 con 0x7f0b3809d6f0 2023-10-03T10:12:40.916 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:40.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.917+0000 7f0b3cff2700 1 -- 172.21.15.72:0/4024882663 >> v1:172.21.15.72:6816/126756 conn(0x7f0b1802f510 legacy=0x7f0b180319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:40.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.917+0000 7f0b3cff2700 1 -- 172.21.15.72:0/4024882663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b3809d6f0 msgr2=0x7f0b381c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.917+0000 7f0b3cff2700 1 --2- 172.21.15.72:0/4024882663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b3809d6f0 0x7f0b381c8440 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009fd0 tx=0x7f0b28004750 comp rx=0 tx=0).stop 2023-10-03T10:12:40.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.917+0000 7f0b3cff2700 1 -- 172.21.15.72:0/4024882663 shutdown_connections 2023-10-03T10:12:40.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.917+0000 7f0b3cff2700 1 --2- 172.21.15.72:0/4024882663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b3809d6f0 0x7f0b381c8440 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.917+0000 7f0b3cff2700 1 --2- 172.21.15.72:0/4024882663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b3809e410 0x7f0b381c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.917+0000 7f0b3cff2700 1 --2- 172.21.15.72:0/4024882663 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809e000 0x7f0b381c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.917+0000 7f0b3cff2700 1 -- 172.21.15.72:0/4024882663 >> 172.21.15.72:0/4024882663 conn(0x7f0b38066f50 msgr2=0x7f0b38130ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.917+0000 7f0b3cff2700 1 -- 172.21.15.72:0/4024882663 shutdown_connections 2023-10-03T10:12:40.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.917+0000 7f0b3cff2700 1 -- 172.21.15.72:0/4024882663 wait complete. 2023-10-03T10:12:40.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:40.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.942+0000 7f86bb7fe700 1 -- 172.21.15.72:0/642546030 >> v1:172.21.15.72:6816/126756 conn(0x7f86a802f510 legacy=0x7f86a80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:40.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.970+0000 7f86c29ee700 1 -- 172.21.15.72:0/642546030 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f86bc137d80 con 0x7f86bc09d630 2023-10-03T10:12:40.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.970+0000 7f86b8ff9700 1 -- 172.21.15.72:0/642546030 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86ac015020 con 0x7f86bc09d630 2023-10-03T10:12:40.971 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:40.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.972+0000 7f86c29ee700 1 -- 172.21.15.72:0/642546030 >> v1:172.21.15.72:6816/126756 conn(0x7f86a802f510 legacy=0x7f86a80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:40.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.972+0000 7f86c29ee700 1 -- 172.21.15.72:0/642546030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86bc09d630 msgr2=0x7f86bc133680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:40.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.972+0000 7f86c29ee700 1 --2- 172.21.15.72:0/642546030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86bc09d630 0x7f86bc133680 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00b530 tx=0x7f86ac00b840 comp rx=0 tx=0).stop 2023-10-03T10:12:40.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.972+0000 7f86c29ee700 1 -- 172.21.15.72:0/642546030 shutdown_connections 2023-10-03T10:12:40.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.972+0000 7f86c29ee700 1 --2- 172.21.15.72:0/642546030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86bc138d80 0x7f86bc134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.972+0000 7f86c29ee700 1 --2- 172.21.15.72:0/642546030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86bc09d630 0x7f86bc133680 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.972+0000 7f86c29ee700 1 --2- 172.21.15.72:0/642546030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86bc0a0a30 0x7f86bc133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:40.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.972+0000 7f86c29ee700 1 -- 172.21.15.72:0/642546030 >> 172.21.15.72:0/642546030 conn(0x7f86bc0a3050 msgr2=0x7f86bc0a68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:40.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.972+0000 7f86c29ee700 1 -- 172.21.15.72:0/642546030 shutdown_connections 2023-10-03T10:12:40.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:40.972+0000 7f86c29ee700 1 -- 172.21.15.72:0/642546030 wait complete. 2023-10-03T10:12:40.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:41.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:41.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:41.930 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:41.985 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:41.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.995+0000 7f92e698e700 1 Processor -- start 2023-10-03T10:12:41.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.995+0000 7f92e698e700 1 -- start start 2023-10-03T10:12:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.996+0000 7f92e698e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92e009d6f0 0x7f92e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.996+0000 7f92e698e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92e009e000 0x7f92e0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.996+0000 7f92e698e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f92e009e410 0x7f92e0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.996+0000 7f92e698e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e009f520 con 0x7f92e009d6f0 2023-10-03T10:12:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.996+0000 7f92e698e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e009f130 con 0x7f92e009e000 2023-10-03T10:12:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.996+0000 7f92e698e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92e009e930 con 0x7f92e009e410 2023-10-03T10:12:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.996+0000 7f92df7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92e009e000 0x7f92e0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.996+0000 7f92df7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92e009e000 0x7f92e0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53992/0 (socket says 172.21.15.72:53992) 2023-10-03T10:12:41.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.996+0000 7f92e4f2b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f92e009e410 0x7f92e0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.996+0000 7f92df7fe700 1 -- 172.21.15.72:0/432654857 learned_addr learned my addr 172.21.15.72:0/432654857 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:41.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.996+0000 7f92dffff700 1 --2- 172.21.15.72:0/432654857 >> v2:172.21.15.72:3300/0 conn(0x7f92e009d6f0 0x7f92e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:41.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.997+0000 7f92df7fe700 1 -- 172.21.15.72:0/432654857 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f92e009e410 msgr2=0x7f92e0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:41.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.997+0000 7f92df7fe700 1 --2- 172.21.15.72:0/432654857 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f92e009e410 0x7f92e0130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.997+0000 7f92df7fe700 1 -- 172.21.15.72:0/432654857 >> v2:172.21.15.72:3300/0 conn(0x7f92e009d6f0 msgr2=0x7f92e009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:41.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.997+0000 7f92df7fe700 1 --2- 172.21.15.72:0/432654857 >> v2:172.21.15.72:3300/0 conn(0x7f92e009d6f0 0x7f92e009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:41.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.997+0000 7f92df7fe700 1 -- 172.21.15.72:0/432654857 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e009b2d0 con 0x7f92e009e000 2023-10-03T10:12:41.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.997+0000 7f92df7fe700 1 --2- 172.21.15.72:0/432654857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92e009e000 0x7f92e0130660 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f92d400b9a0 tx=0x7f92d400bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=564249425aa793cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.997+0000 7f92deffd700 1 -- 172.21.15.72:0/432654857 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d400caa0 con 0x7f92e009e000 2023-10-03T10:12:42.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.997+0000 7f92deffd700 1 -- 172.21.15.72:0/432654857 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d400cc00 con 0x7f92e009e000 2023-10-03T10:12:42.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.997+0000 7f92deffd700 1 -- 172.21.15.72:0/432654857 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d400f460 con 0x7f92e009e000 2023-10-03T10:12:42.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.998+0000 7f92e698e700 1 -- 172.21.15.72:0/432654857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92e009e000 msgr2=0x7f92e0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.998+0000 7f92e698e700 1 --2- 172.21.15.72:0/432654857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92e009e000 0x7f92e0130660 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f92d400b9a0 tx=0x7f92d400bcb0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.998+0000 7f92e698e700 1 -- 172.21.15.72:0/432654857 shutdown_connections 2023-10-03T10:12:42.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.998+0000 7f92e698e700 1 --2- 172.21.15.72:0/432654857 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f92e009e410 0x7f92e0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.998+0000 7f92e698e700 1 --2- 172.21.15.72:0/432654857 >> v2:172.21.15.72:3300/0 conn(0x7f92e009d6f0 0x7f92e009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.998+0000 7f92e698e700 1 --2- 172.21.15.72:0/432654857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92e009e000 0x7f92e0130660 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.998+0000 7f92e698e700 1 -- 172.21.15.72:0/432654857 >> 172.21.15.72:0/432654857 conn(0x7f92e0066f50 msgr2=0x7f92e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.998+0000 7f92e698e700 1 -- 172.21.15.72:0/432654857 shutdown_connections 2023-10-03T10:12:42.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.998+0000 7f92e698e700 1 -- 172.21.15.72:0/432654857 wait complete. 2023-10-03T10:12:42.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.999+0000 7f92e698e700 1 Processor -- start 2023-10-03T10:12:42.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:41.999+0000 7f92e698e700 1 -- start start 2023-10-03T10:12:42.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92e698e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92e009d6f0 0x7f92e011e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92e698e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f92e009e000 0x7f92e011e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92e698e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92e009e410 0x7f92e011eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92e698e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e0121bc0 con 0x7f92e009d6f0 2023-10-03T10:12:42.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92e698e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e00a1a80 con 0x7f92e009e410 2023-10-03T10:12:42.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92e698e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92e009c700 con 0x7f92e009e000 2023-10-03T10:12:42.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92dffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92e009d6f0 0x7f92e011e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92dffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92e009d6f0 0x7f92e011e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49302/0 (socket says 172.21.15.72:49302) 2023-10-03T10:12:42.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92dffff700 1 -- 172.21.15.72:0/3131258376 learned_addr learned my addr 172.21.15.72:0/3131258376 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:42.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92e4f2b700 1 --2- 172.21.15.72:0/3131258376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92e009e410 0x7f92e011eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92df7fe700 1 --2- 172.21.15.72:0/3131258376 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f92e009e000 0x7f92e011e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92dffff700 1 -- 172.21.15.72:0/3131258376 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f92e009e000 msgr2=0x7f92e011e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92dffff700 1 --2- 172.21.15.72:0/3131258376 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f92e009e000 0x7f92e011e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92dffff700 1 -- 172.21.15.72:0/3131258376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92e009e410 msgr2=0x7f92e011eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92dffff700 1 --2- 172.21.15.72:0/3131258376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92e009e410 0x7f92e011eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92dffff700 1 -- 172.21.15.72:0/3131258376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d400b600 con 0x7f92e009d6f0 2023-10-03T10:12:42.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.000+0000 7f92e4f2b700 1 --2- 172.21.15.72:0/3131258376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92e009e410 0x7f92e011eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:42.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.001+0000 7f92dffff700 1 --2- 172.21.15.72:0/3131258376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92e009d6f0 0x7f92e011e0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f92d000e930 tx=0x7f92d000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.001+0000 7f92dcff9700 1 -- 172.21.15.72:0/3131258376 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0013680 con 0x7f92e009d6f0 2023-10-03T10:12:42.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.001+0000 7f92dcff9700 1 -- 172.21.15.72:0/3131258376 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d00137e0 con 0x7f92e009d6f0 2023-10-03T10:12:42.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.001+0000 7f92dcff9700 1 -- 172.21.15.72:0/3131258376 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0013b70 con 0x7f92e009d6f0 2023-10-03T10:12:42.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.001+0000 7f92e698e700 1 -- 172.21.15.72:0/3131258376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e0121620 con 0x7f92e009d6f0 2023-10-03T10:12:42.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.001+0000 7f92e698e700 1 -- 172.21.15.72:0/3131258376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e0120200 con 0x7f92e009d6f0 2023-10-03T10:12:42.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.002+0000 7f92e698e700 1 -- 172.21.15.72:0/3131258376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e0074ea0 con 0x7f92e009d6f0 2023-10-03T10:12:42.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.002+0000 7f92dcff9700 1 -- 172.21.15.72:0/3131258376 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f92d0013cd0 con 0x7f92e009d6f0 2023-10-03T10:12:42.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.003+0000 7f92dcff9700 1 -- 172.21.15.72:0/3131258376 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f92d003fce0 con 0x7f92e009d6f0 2023-10-03T10:12:42.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.003+0000 7f92df7fe700 1 -- 172.21.15.72:0/3131258376 >> v1:172.21.15.72:6816/126756 conn(0x7f92cc02f510 legacy=0x7f92cc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:42.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.008+0000 7f92dcff9700 1 -- 172.21.15.72:0/3131258376 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92d001be10 con 0x7f92e009d6f0 2023-10-03T10:12:42.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.043+0000 7facc3699700 1 Processor -- start 2023-10-03T10:12:42.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.044+0000 7facc3699700 1 -- start start 2023-10-03T10:12:42.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.044+0000 7facc3699700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7facbc09d6f0 0x7facbc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.044+0000 7facc3699700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7facbc09e000 0x7facbc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.044+0000 7facc3699700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facbc09b120 con 0x7facbc09e410 2023-10-03T10:12:42.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.044+0000 7facc3699700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facbc06b460 con 0x7facbc09e000 2023-10-03T10:12:42.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.044+0000 7facc3699700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facbc09a7e0 con 0x7facbc09d6f0 2023-10-03T10:12:42.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.045+0000 7facc1435700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7facbc09d6f0 0x7facbc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.045+0000 7facc0c34700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7facbc09e000 0x7facbc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.045+0000 7facc0c34700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7facbc09e000 0x7facbc1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49310/0 (socket says 172.21.15.72:49310) 2023-10-03T10:12:42.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.045+0000 7facc1435700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7facbc09d6f0 0x7facbc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45684/0 (socket says 172.21.15.72:45684) 2023-10-03T10:12:42.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.045+0000 7facc0c34700 1 -- 172.21.15.72:0/1863690897 learned_addr learned my addr 172.21.15.72:0/1863690897 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:42.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.045+0000 7facc0c34700 1 -- 172.21.15.72:0/1863690897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7facbc09d6f0 msgr2=0x7facbc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:42.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.045+0000 7facc0c34700 1 --2- 172.21.15.72:0/1863690897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7facbc09d6f0 0x7facbc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.045+0000 7facc0c34700 1 -- 172.21.15.72:0/1863690897 >> v1:172.21.15.72:6789/0 conn(0x7facbc09e410 legacy=0x7facbc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.045+0000 7facc0c34700 1 -- 172.21.15.72:0/1863690897 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc09a500 con 0x7facbc09e000 2023-10-03T10:12:42.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.045+0000 7facc1435700 1 --2- 172.21.15.72:0/1863690897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7facbc09d6f0 0x7facbc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:42.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.045+0000 7facc0c34700 1 --2- 172.21.15.72:0/1863690897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facbc09e000 0x7facbc1339f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7facac0098f0 tx=0x7facac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7755d52e6ae82d98 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.046+0000 7facb3fff700 1 -- 172.21.15.72:0/1863690897 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac011830 con 0x7facbc09e000 2023-10-03T10:12:42.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.046+0000 7facb3fff700 1 -- 172.21.15.72:0/1863690897 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac011990 con 0x7facbc09e000 2023-10-03T10:12:42.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.046+0000 7facb3fff700 1 -- 172.21.15.72:0/1863690897 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac011d20 con 0x7facbc09e000 2023-10-03T10:12:42.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.046+0000 7facc3699700 1 -- 172.21.15.72:0/1863690897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facbc09e000 msgr2=0x7facbc1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.046+0000 7facc3699700 1 --2- 172.21.15.72:0/1863690897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facbc09e000 0x7facbc1339f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7facac0098f0 tx=0x7facac009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:42.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.046+0000 7facc3699700 1 -- 172.21.15.72:0/1863690897 shutdown_connections 2023-10-03T10:12:42.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.046+0000 7facc3699700 1 --2- 172.21.15.72:0/1863690897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7facbc09d6f0 0x7facbc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.046+0000 7facc3699700 1 --2- 172.21.15.72:0/1863690897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facbc09e000 0x7facbc1339f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.046+0000 7facc3699700 1 -- 172.21.15.72:0/1863690897 >> 172.21.15.72:0/1863690897 conn(0x7facbc066f50 msgr2=0x7facbc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.047+0000 7facc3699700 1 -- 172.21.15.72:0/1863690897 shutdown_connections 2023-10-03T10:12:42.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.047+0000 7facc3699700 1 -- 172.21.15.72:0/1863690897 wait complete. 2023-10-03T10:12:42.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.047+0000 7facc3699700 1 Processor -- start 2023-10-03T10:12:42.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc3699700 1 -- start start 2023-10-03T10:12:42.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc3699700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facbc09d6f0 0x7facbc1a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc3699700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7facbc09e000 0x7facbc1a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc3699700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facbc09e410 0x7facbc1a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc3699700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc1a91f0 con 0x7facbc09d6f0 2023-10-03T10:12:42.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc3699700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facbc09c710 con 0x7facbc09e410 2023-10-03T10:12:42.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc3699700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facbc0a3160 con 0x7facbc09e000 2023-10-03T10:12:42.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc1435700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facbc09d6f0 0x7facbc1a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc1435700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facbc09d6f0 0x7facbc1a5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49320/0 (socket says 172.21.15.72:49320) 2023-10-03T10:12:42.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc1435700 1 -- 172.21.15.72:0/260191222 learned_addr learned my addr 172.21.15.72:0/260191222 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:42.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc0c34700 1 --2- 172.21.15.72:0/260191222 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7facbc09e000 0x7facbc1a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc1c36700 1 --2- 172.21.15.72:0/260191222 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facbc09e410 0x7facbc1a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc1435700 1 -- 172.21.15.72:0/260191222 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7facbc09e000 msgr2=0x7facbc1a6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc1435700 1 --2- 172.21.15.72:0/260191222 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7facbc09e000 0x7facbc1a6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc1435700 1 -- 172.21.15.72:0/260191222 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facbc09e410 msgr2=0x7facbc1a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc1435700 1 --2- 172.21.15.72:0/260191222 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facbc09e410 0x7facbc1a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc1435700 1 -- 172.21.15.72:0/260191222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb80094a0 con 0x7facbc09d6f0 2023-10-03T10:12:42.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc0c34700 1 --2- 172.21.15.72:0/260191222 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7facbc09e000 0x7facbc1a6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:42.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.048+0000 7facc1c36700 1 --2- 172.21.15.72:0/260191222 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facbc09e410 0x7facbc1a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:42.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.049+0000 7facc1435700 1 --2- 172.21.15.72:0/260191222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facbc09d6f0 0x7facbc1a5fd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7facb800ebe0 tx=0x7facb8009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.049+0000 7facb1ffb700 1 -- 172.21.15.72:0/260191222 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb800c910 con 0x7facbc09d6f0 2023-10-03T10:12:42.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.049+0000 7facb1ffb700 1 -- 172.21.15.72:0/260191222 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb800ca70 con 0x7facbc09d6f0 2023-10-03T10:12:42.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.049+0000 7facc3699700 1 -- 172.21.15.72:0/260191222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facac009550 con 0x7facbc09d6f0 2023-10-03T10:12:42.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.049+0000 7facb1ffb700 1 -- 172.21.15.72:0/260191222 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb800cde0 con 0x7facbc09d6f0 2023-10-03T10:12:42.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.049+0000 7facc3699700 1 -- 172.21.15.72:0/260191222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facbc1a8da0 con 0x7facbc09d6f0 2023-10-03T10:12:42.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.050+0000 7facb1ffb700 1 -- 172.21.15.72:0/260191222 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7facb8013470 con 0x7facbc09d6f0 2023-10-03T10:12:42.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.050+0000 7facb1ffb700 1 -- 172.21.15.72:0/260191222 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7facb803ff50 con 0x7facbc09d6f0 2023-10-03T10:12:42.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.050+0000 7facc0c34700 1 -- 172.21.15.72:0/260191222 >> v1:172.21.15.72:6816/126756 conn(0x7faca002f510 legacy=0x7faca00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:42.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.050+0000 7facc3699700 1 -- 172.21.15.72:0/260191222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facbc074ea0 con 0x7facbc09d6f0 2023-10-03T10:12:42.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.059+0000 7facb1ffb700 1 -- 172.21.15.72:0/260191222 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7facb8017080 con 0x7facbc09d6f0 2023-10-03T10:12:42.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.081+0000 7f1624f5e700 1 Processor -- start 2023-10-03T10:12:42.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.081+0000 7f1624f5e700 1 -- start start 2023-10-03T10:12:42.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f1624f5e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162006e570 0x7f162006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f1624f5e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f162009eca0 0x7f162006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f1624f5e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1620134610 0x7f1620134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f1624f5e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1620070ee0 con 0x7f162009eca0 2023-10-03T10:12:42.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f1624f5e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1620071480 con 0x7f1620134610 2023-10-03T10:12:42.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f1624f5e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f162006f3c0 con 0x7f162006e570 2023-10-03T10:12:42.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f161dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f162009eca0 0x7f162006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f161dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f162009eca0 0x7f162006ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49330/0 (socket says 172.21.15.72:49330) 2023-10-03T10:12:42.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f161dd9b700 1 -- 172.21.15.72:0/425156517 learned_addr learned my addr 172.21.15.72:0/425156517 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:42.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f161ed9d700 1 --2- 172.21.15.72:0/425156517 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1620134610 0x7f1620134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f161e59c700 1 --2- 172.21.15.72:0/425156517 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162006e570 0x7f162006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f161dd9b700 1 -- 172.21.15.72:0/425156517 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162006e570 msgr2=0x7f162006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:42.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f161dd9b700 1 --2- 172.21.15.72:0/425156517 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162006e570 0x7f162006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f161dd9b700 1 -- 172.21.15.72:0/425156517 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1620134610 msgr2=0x7f1620134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:42.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f161dd9b700 1 --2- 172.21.15.72:0/425156517 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1620134610 0x7f1620134a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.082+0000 7f161dd9b700 1 -- 172.21.15.72:0/425156517 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1620071b90 con 0x7f162009eca0 2023-10-03T10:12:42.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.083+0000 7f161e59c700 1 --2- 172.21.15.72:0/425156517 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162006e570 0x7f162006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:42.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.083+0000 7f161dd9b700 1 --2- 172.21.15.72:0/425156517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f162009eca0 0x7f162006ee80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f16140098f0 tx=0x7f1614009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e498129de593b74 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.083+0000 7f161d59a700 1 -- 172.21.15.72:0/425156517 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614011830 con 0x7f162009eca0 2023-10-03T10:12:42.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.083+0000 7f161d59a700 1 -- 172.21.15.72:0/425156517 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1614011990 con 0x7f162009eca0 2023-10-03T10:12:42.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.083+0000 7f161d59a700 1 -- 172.21.15.72:0/425156517 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614011d20 con 0x7f162009eca0 2023-10-03T10:12:42.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.083+0000 7f1624f5e700 1 -- 172.21.15.72:0/425156517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f162009eca0 msgr2=0x7f162006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.084+0000 7f1624f5e700 1 --2- 172.21.15.72:0/425156517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f162009eca0 0x7f162006ee80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f16140098f0 tx=0x7f1614009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:42.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.084+0000 7f1624f5e700 1 -- 172.21.15.72:0/425156517 shutdown_connections 2023-10-03T10:12:42.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.084+0000 7f1624f5e700 1 --2- 172.21.15.72:0/425156517 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1620134610 0x7f1620134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.084+0000 7f1624f5e700 1 --2- 172.21.15.72:0/425156517 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162006e570 0x7f162006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.084+0000 7f1624f5e700 1 --2- 172.21.15.72:0/425156517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f162009eca0 0x7f162006ee80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.084+0000 7f1624f5e700 1 -- 172.21.15.72:0/425156517 >> 172.21.15.72:0/425156517 conn(0x7f16200a2aa0 msgr2=0x7f16200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.084+0000 7f1624f5e700 1 -- 172.21.15.72:0/425156517 shutdown_connections 2023-10-03T10:12:42.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.084+0000 7f1624f5e700 1 -- 172.21.15.72:0/425156517 wait complete. 2023-10-03T10:12:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.085+0000 7f1624f5e700 1 Processor -- start 2023-10-03T10:12:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.085+0000 7f1624f5e700 1 -- start start 2023-10-03T10:12:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.085+0000 7f1624f5e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f162006e570 0x7f1620127410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.085+0000 7f1624f5e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1620134610 0x7f1620139e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.085+0000 7f1624f5e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1620127950 0x7f162013a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.085+0000 7f1624f5e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162013d470 con 0x7f1620134610 2023-10-03T10:12:42.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.085+0000 7f1624f5e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162013d8a0 con 0x7f162006e570 2023-10-03T10:12:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.085+0000 7f1624f5e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16200a1f30 con 0x7f1620127950 2023-10-03T10:12:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.085+0000 7f161e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f162006e570 0x7f1620127410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.085+0000 7f161e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f162006e570 0x7f1620127410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54026/0 (socket says 172.21.15.72:54026) 2023-10-03T10:12:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.085+0000 7f161e59c700 1 -- 172.21.15.72:0/2696160995 learned_addr learned my addr 172.21.15.72:0/2696160995 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.086+0000 7f161dd9b700 1 --2- 172.21.15.72:0/2696160995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1620134610 0x7f1620139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.086+0000 7f161ed9d700 1 --2- 172.21.15.72:0/2696160995 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1620127950 0x7f162013a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.086+0000 7f161dd9b700 1 -- 172.21.15.72:0/2696160995 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1620127950 msgr2=0x7f162013a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.086+0000 7f161dd9b700 1 --2- 172.21.15.72:0/2696160995 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1620127950 0x7f162013a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.086+0000 7f161dd9b700 1 -- 172.21.15.72:0/2696160995 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f162006e570 msgr2=0x7f1620127410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.086+0000 7f161dd9b700 1 --2- 172.21.15.72:0/2696160995 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f162006e570 0x7f1620127410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.086+0000 7f161dd9b700 1 -- 172.21.15.72:0/2696160995 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1614009550 con 0x7f1620134610 2023-10-03T10:12:42.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.086+0000 7f161dd9b700 1 --2- 172.21.15.72:0/2696160995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1620134610 0x7f1620139e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1614016000 tx=0x7f1614004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.086+0000 7f160effd700 1 -- 172.21.15.72:0/2696160995 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614004300 con 0x7f1620134610 2023-10-03T10:12:42.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.086+0000 7f160effd700 1 -- 172.21.15.72:0/2696160995 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161401f070 con 0x7f1620134610 2023-10-03T10:12:42.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.086+0000 7f1624f5e700 1 -- 172.21.15.72:0/2696160995 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1620070610 con 0x7f1620134610 2023-10-03T10:12:42.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.086+0000 7f160effd700 1 -- 172.21.15.72:0/2696160995 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16140036a0 con 0x7f1620134610 2023-10-03T10:12:42.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.086+0000 7f1624f5e700 1 -- 172.21.15.72:0/2696160995 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162013d200 con 0x7f1620134610 2023-10-03T10:12:42.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.087+0000 7f160effd700 1 -- 172.21.15.72:0/2696160995 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1614021030 con 0x7f1620134610 2023-10-03T10:12:42.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.088+0000 7f160effd700 1 -- 172.21.15.72:0/2696160995 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f1614040f50 con 0x7f1620134610 2023-10-03T10:12:42.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.088+0000 7f161e59c700 1 -- 172.21.15.72:0/2696160995 >> v1:172.21.15.72:6816/126756 conn(0x7f160002f510 legacy=0x7f16000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:42.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.088+0000 7f1624f5e700 1 -- 172.21.15.72:0/2696160995 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162009d1f0 con 0x7f1620134610 2023-10-03T10:12:42.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.093+0000 7f160effd700 1 -- 172.21.15.72:0/2696160995 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1614015080 con 0x7f1620134610 2023-10-03T10:12:42.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.124+0000 7f3fbf6f8700 1 Processor -- start 2023-10-03T10:12:42.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.124+0000 7f3fbf6f8700 1 -- start start 2023-10-03T10:12:42.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.124+0000 7f3fbf6f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fb809d6f0 0x7f3fb809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.124+0000 7f3fbf6f8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3fb809e410 0x7f3fb8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.124+0000 7f3fbf6f8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb809f130 con 0x7f3fb809e000 2023-10-03T10:12:42.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.124+0000 7f3fbf6f8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb809f520 con 0x7f3fb809e410 2023-10-03T10:12:42.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.124+0000 7f3fbf6f8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb809e930 con 0x7f3fb809d6f0 2023-10-03T10:12:42.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.124+0000 7f3fbd494700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fb809d6f0 0x7f3fb809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.125+0000 7f3fbd494700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fb809d6f0 0x7f3fb809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54030/0 (socket says 172.21.15.72:54030) 2023-10-03T10:12:42.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.125+0000 7f3fbd494700 1 -- 172.21.15.72:0/2729239457 learned_addr learned my addr 172.21.15.72:0/2729239457 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:42.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.125+0000 7f3fbdc95700 1 --2- 172.21.15.72:0/2729239457 >> v2:172.21.15.72:3300/0 conn(0x7f3fb809e410 0x7f3fb8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.125+0000 7f3fbd494700 1 -- 172.21.15.72:0/2729239457 >> v2:172.21.15.72:3300/0 conn(0x7f3fb809e410 msgr2=0x7f3fb8130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:42.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.125+0000 7f3fbd494700 1 --2- 172.21.15.72:0/2729239457 >> v2:172.21.15.72:3300/0 conn(0x7f3fb809e410 0x7f3fb8130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.125+0000 7f3fbd494700 1 -- 172.21.15.72:0/2729239457 >> v1:172.21.15.72:6789/0 conn(0x7f3fb809e000 legacy=0x7f3fb8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.125+0000 7f3fbd494700 1 -- 172.21.15.72:0/2729239457 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb809b2d0 con 0x7f3fb809d6f0 2023-10-03T10:12:42.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.125+0000 7f3fbd494700 1 --2- 172.21.15.72:0/2729239457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fb809d6f0 0x7f3fb809dac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40098f0 tx=0x7f3fb4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f6d9165a714a1f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.125+0000 7f3faffff700 1 -- 172.21.15.72:0/2729239457 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4011830 con 0x7f3fb809d6f0 2023-10-03T10:12:42.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.125+0000 7f3faffff700 1 -- 172.21.15.72:0/2729239457 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb4011990 con 0x7f3fb809d6f0 2023-10-03T10:12:42.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.125+0000 7f3faffff700 1 -- 172.21.15.72:0/2729239457 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4011d20 con 0x7f3fb809d6f0 2023-10-03T10:12:42.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.126+0000 7f3fbf6f8700 1 -- 172.21.15.72:0/2729239457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fb809d6f0 msgr2=0x7f3fb809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.126+0000 7f3fbf6f8700 1 --2- 172.21.15.72:0/2729239457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fb809d6f0 0x7f3fb809dac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40098f0 tx=0x7f3fb4009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:42.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.126+0000 7f3fbf6f8700 1 -- 172.21.15.72:0/2729239457 shutdown_connections 2023-10-03T10:12:42.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.126+0000 7f3fbf6f8700 1 --2- 172.21.15.72:0/2729239457 >> v2:172.21.15.72:3300/0 conn(0x7f3fb809e410 0x7f3fb8130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.126+0000 7f3fbf6f8700 1 --2- 172.21.15.72:0/2729239457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fb809d6f0 0x7f3fb809dac0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.126+0000 7f3fbf6f8700 1 -- 172.21.15.72:0/2729239457 >> 172.21.15.72:0/2729239457 conn(0x7f3fb8066f50 msgr2=0x7f3fb809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.126+0000 7f3fbf6f8700 1 -- 172.21.15.72:0/2729239457 shutdown_connections 2023-10-03T10:12:42.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.126+0000 7f3fbf6f8700 1 -- 172.21.15.72:0/2729239457 wait complete. 2023-10-03T10:12:42.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.127+0000 7f3fbf6f8700 1 Processor -- start 2023-10-03T10:12:42.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.127+0000 7f3fbf6f8700 1 -- start start 2023-10-03T10:12:42.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.127+0000 7f3fbf6f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fb809d6f0 0x7f3fb80701f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.127+0000 7f3fbf6f8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fb809e000 0x7f3fb8070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.127+0000 7f3fbf6f8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb809e410 0x7f3fb8070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:42.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.127+0000 7f3fbf6f8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb80715e0 con 0x7f3fb809e410 2023-10-03T10:12:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.127+0000 7f3fbf6f8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8071ed0 con 0x7f3fb809d6f0 2023-10-03T10:12:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.127+0000 7f3fbf6f8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8125c30 con 0x7f3fb809e000 2023-10-03T10:12:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.127+0000 7f3fbd494700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fb809d6f0 0x7f3fb80701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.127+0000 7f3fbcc93700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fb809e000 0x7f3fb8070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.128+0000 7f3fbd494700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fb809d6f0 0x7f3fb80701f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54032/0 (socket says 172.21.15.72:54032) 2023-10-03T10:12:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.128+0000 7f3fbd494700 1 -- 172.21.15.72:0/308973725 learned_addr learned my addr 172.21.15.72:0/308973725 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.128+0000 7f3fbdc95700 1 --2- 172.21.15.72:0/308973725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb809e410 0x7f3fb8070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.128+0000 7f3fbcc93700 1 -- 172.21.15.72:0/308973725 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fb809d6f0 msgr2=0x7f3fb80701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.128+0000 7f3fbcc93700 1 --2- 172.21.15.72:0/308973725 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fb809d6f0 0x7f3fb80701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.128+0000 7f3fbcc93700 1 -- 172.21.15.72:0/308973725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb809e410 msgr2=0x7f3fb8070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.128+0000 7f3fbcc93700 1 --2- 172.21.15.72:0/308973725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb809e410 0x7f3fb8070c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.128+0000 7f3fbcc93700 1 -- 172.21.15.72:0/308973725 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb4009550 con 0x7f3fb809e000 2023-10-03T10:12:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.128+0000 7f3fbd494700 1 --2- 172.21.15.72:0/308973725 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fb809d6f0 0x7f3fb80701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.128+0000 7f3fbcc93700 1 --2- 172.21.15.72:0/308973725 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fb809e000 0x7f3fb8070730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80a3e20 tx=0x7f3fa800c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.128+0000 7f3fadffb700 1 -- 172.21.15.72:0/308973725 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa80052d0 con 0x7f3fb809e000 2023-10-03T10:12:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.128+0000 7f3fadffb700 1 -- 172.21.15.72:0/308973725 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa8005430 con 0x7f3fb809e000 2023-10-03T10:12:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.128+0000 7f3fbf6f8700 1 -- 172.21.15.72:0/308973725 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb806ea40 con 0x7f3fb809e000 2023-10-03T10:12:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.128+0000 7f3fadffb700 1 -- 172.21.15.72:0/308973725 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa80038c0 con 0x7f3fb809e000 2023-10-03T10:12:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.129+0000 7f3fbf6f8700 1 -- 172.21.15.72:0/308973725 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb81266a0 con 0x7f3fb809e000 2023-10-03T10:12:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.129+0000 7f3fadffb700 1 -- 172.21.15.72:0/308973725 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3fa8003a20 con 0x7f3fb809e000 2023-10-03T10:12:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.130+0000 7f3fadffb700 1 -- 172.21.15.72:0/308973725 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f3fa803eed0 con 0x7f3fb809e000 2023-10-03T10:12:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.130+0000 7f3fbd494700 1 -- 172.21.15.72:0/308973725 >> v1:172.21.15.72:6816/126756 conn(0x7f3f9c02f510 legacy=0x7f3f9c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.130+0000 7f3fbf6f8700 1 -- 172.21.15.72:0/308973725 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb8074ea0 con 0x7f3fb809e000 2023-10-03T10:12:42.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.139+0000 7f3fadffb700 1 -- 172.21.15.72:0/308973725 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fa8017030 con 0x7f3fb809e000 2023-10-03T10:12:42.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.204+0000 7f92df7fe700 1 -- 172.21.15.72:0/3131258376 >> v1:172.21.15.72:6816/126756 conn(0x7f92cc02f510 legacy=0x7f92cc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.218+0000 7f92e698e700 1 -- 172.21.15.72:0/3131258376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f92e006c360 con 0x7f92e009d6f0 2023-10-03T10:12:42.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.218+0000 7f92dcff9700 1 -- 172.21.15.72:0/3131258376 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92d0017020 con 0x7f92e009d6f0 2023-10-03T10:12:42.219 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:42.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.220+0000 7f92e698e700 1 -- 172.21.15.72:0/3131258376 >> v1:172.21.15.72:6816/126756 conn(0x7f92cc02f510 legacy=0x7f92cc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:42.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.220+0000 7f92e698e700 1 -- 172.21.15.72:0/3131258376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92e009d6f0 msgr2=0x7f92e011e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.220+0000 7f92e698e700 1 --2- 172.21.15.72:0/3131258376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92e009d6f0 0x7f92e011e0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f92d000e930 tx=0x7f92d000ec40 comp rx=0 tx=0).stop 2023-10-03T10:12:42.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.220+0000 7f92e698e700 1 -- 172.21.15.72:0/3131258376 shutdown_connections 2023-10-03T10:12:42.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.220+0000 7f92e698e700 1 --2- 172.21.15.72:0/3131258376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92e009d6f0 0x7f92e011e0a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.220+0000 7f92e698e700 1 --2- 172.21.15.72:0/3131258376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92e009e410 0x7f92e011eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.220+0000 7f92e698e700 1 --2- 172.21.15.72:0/3131258376 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f92e009e000 0x7f92e011e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.220+0000 7f92e698e700 1 -- 172.21.15.72:0/3131258376 >> 172.21.15.72:0/3131258376 conn(0x7f92e0066f50 msgr2=0x7f92e006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.220+0000 7f92e698e700 1 -- 172.21.15.72:0/3131258376 shutdown_connections 2023-10-03T10:12:42.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.220+0000 7f92e698e700 1 -- 172.21.15.72:0/3131258376 wait complete. 2023-10-03T10:12:42.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:42.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.251+0000 7facc0c34700 1 -- 172.21.15.72:0/260191222 >> v1:172.21.15.72:6816/126756 conn(0x7faca002f510 legacy=0x7faca00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.258+0000 7facc3699700 1 -- 172.21.15.72:0/260191222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7facbc06c360 con 0x7facbc09d6f0 2023-10-03T10:12:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.258+0000 7facb1ffb700 1 -- 172.21.15.72:0/260191222 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7facb8021070 con 0x7facbc09d6f0 2023-10-03T10:12:42.259 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:42.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.260+0000 7facc3699700 1 -- 172.21.15.72:0/260191222 >> v1:172.21.15.72:6816/126756 conn(0x7faca002f510 legacy=0x7faca00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.260+0000 7facc3699700 1 -- 172.21.15.72:0/260191222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facbc09d6f0 msgr2=0x7facbc1a5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.260+0000 7facc3699700 1 --2- 172.21.15.72:0/260191222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facbc09d6f0 0x7facbc1a5fd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7facb800ebe0 tx=0x7facb8009ec0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.260+0000 7facc3699700 1 -- 172.21.15.72:0/260191222 shutdown_connections 2023-10-03T10:12:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.260+0000 7facc3699700 1 --2- 172.21.15.72:0/260191222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facbc09d6f0 0x7facbc1a5fd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.260+0000 7facc3699700 1 --2- 172.21.15.72:0/260191222 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facbc09e410 0x7facbc1a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.260+0000 7facc3699700 1 --2- 172.21.15.72:0/260191222 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7facbc09e000 0x7facbc1a6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.260+0000 7facc3699700 1 -- 172.21.15.72:0/260191222 >> 172.21.15.72:0/260191222 conn(0x7facbc066f50 msgr2=0x7facbc1baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.260+0000 7facc3699700 1 -- 172.21.15.72:0/260191222 shutdown_connections 2023-10-03T10:12:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.260+0000 7facc3699700 1 -- 172.21.15.72:0/260191222 wait complete. 2023-10-03T10:12:42.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:42.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.289+0000 7f161e59c700 1 -- 172.21.15.72:0/2696160995 >> v1:172.21.15.72:6816/126756 conn(0x7f160002f510 legacy=0x7f16000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:42.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.294+0000 7f1624f5e700 1 -- 172.21.15.72:0/2696160995 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f162013d6b0 con 0x7f1620134610 2023-10-03T10:12:42.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.294+0000 7f160effd700 1 -- 172.21.15.72:0/2696160995 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f16140199a0 con 0x7f1620134610 2023-10-03T10:12:42.295 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:42.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.296+0000 7f1624f5e700 1 -- 172.21.15.72:0/2696160995 >> v1:172.21.15.72:6816/126756 conn(0x7f160002f510 legacy=0x7f16000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:42.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.296+0000 7f1624f5e700 1 -- 172.21.15.72:0/2696160995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1620134610 msgr2=0x7f1620139e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.296+0000 7f1624f5e700 1 --2- 172.21.15.72:0/2696160995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1620134610 0x7f1620139e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1614016000 tx=0x7f1614004750 comp rx=0 tx=0).stop 2023-10-03T10:12:42.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.297+0000 7f1624f5e700 1 -- 172.21.15.72:0/2696160995 shutdown_connections 2023-10-03T10:12:42.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.297+0000 7f1624f5e700 1 --2- 172.21.15.72:0/2696160995 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1620127950 0x7f162013a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.297+0000 7f1624f5e700 1 --2- 172.21.15.72:0/2696160995 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f162006e570 0x7f1620127410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.297+0000 7f1624f5e700 1 --2- 172.21.15.72:0/2696160995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1620134610 0x7f1620139e50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.297+0000 7f1624f5e700 1 -- 172.21.15.72:0/2696160995 >> 172.21.15.72:0/2696160995 conn(0x7f16200a2aa0 msgr2=0x7f1620137b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.297+0000 7f1624f5e700 1 -- 172.21.15.72:0/2696160995 shutdown_connections 2023-10-03T10:12:42.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.297+0000 7f1624f5e700 1 -- 172.21.15.72:0/2696160995 wait complete. 2023-10-03T10:12:42.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:42.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.331+0000 7f3fbd494700 1 -- 172.21.15.72:0/308973725 >> v1:172.21.15.72:6816/126756 conn(0x7f3f9c02f510 legacy=0x7f3f9c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:42.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.332+0000 7f3fbf6f8700 1 -- 172.21.15.72:0/308973725 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3fb806c360 con 0x7f3fb809e000 2023-10-03T10:12:42.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.332+0000 7f3fadffb700 1 -- 172.21.15.72:0/308973725 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3fa8017020 con 0x7f3fb809e000 2023-10-03T10:12:42.333 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:42.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.334+0000 7f3fbf6f8700 1 -- 172.21.15.72:0/308973725 >> v1:172.21.15.72:6816/126756 conn(0x7f3f9c02f510 legacy=0x7f3f9c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:42.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.334+0000 7f3fbf6f8700 1 -- 172.21.15.72:0/308973725 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fb809e000 msgr2=0x7f3fb8070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:42.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.334+0000 7f3fbf6f8700 1 --2- 172.21.15.72:0/308973725 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fb809e000 0x7f3fb8070730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80a3e20 tx=0x7f3fa800c730 comp rx=0 tx=0).stop 2023-10-03T10:12:42.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.334+0000 7f3fbf6f8700 1 -- 172.21.15.72:0/308973725 shutdown_connections 2023-10-03T10:12:42.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.334+0000 7f3fbf6f8700 1 --2- 172.21.15.72:0/308973725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb809e410 0x7f3fb8070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.334+0000 7f3fbf6f8700 1 --2- 172.21.15.72:0/308973725 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fb809d6f0 0x7f3fb80701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.334+0000 7f3fbf6f8700 1 --2- 172.21.15.72:0/308973725 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fb809e000 0x7f3fb8070730 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:42.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.334+0000 7f3fbf6f8700 1 -- 172.21.15.72:0/308973725 >> 172.21.15.72:0/308973725 conn(0x7f3fb8066f50 msgr2=0x7f3fb80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:42.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.334+0000 7f3fbf6f8700 1 -- 172.21.15.72:0/308973725 shutdown_connections 2023-10-03T10:12:42.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:42.334+0000 7f3fbf6f8700 1 -- 172.21.15.72:0/308973725 wait complete. 2023-10-03T10:12:42.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:43.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:43.274 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:43.310 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:43.348 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:43.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.379+0000 7f1d0ce23700 1 Processor -- start 2023-10-03T10:12:43.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.379+0000 7f1d0ce23700 1 -- start start 2023-10-03T10:12:43.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.380+0000 7f1d0ce23700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d0809d6f0 0x7f1d0809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.380+0000 7f1d0ce23700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d0809e000 0x7f1d08130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.380+0000 7f1d0ce23700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d0809f130 con 0x7f1d0809e410 2023-10-03T10:12:43.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.380+0000 7f1d0ce23700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d0809f520 con 0x7f1d0809d6f0 2023-10-03T10:12:43.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.380+0000 7f1d0ce23700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0809e930 con 0x7f1d0809e000 2023-10-03T10:12:43.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.380+0000 7f1d05d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d0809e000 0x7f1d08130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.380+0000 7f1d05d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d0809e000 0x7f1d08130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54044/0 (socket says 172.21.15.72:54044) 2023-10-03T10:12:43.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.380+0000 7f1d05d9b700 1 -- 172.21.15.72:0/289604060 learned_addr learned my addr 172.21.15.72:0/289604060 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:43.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.380+0000 7f1d0659c700 1 --2- 172.21.15.72:0/289604060 >> v2:172.21.15.72:3300/0 conn(0x7f1d0809d6f0 0x7f1d0809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.380+0000 7f1d05d9b700 1 -- 172.21.15.72:0/289604060 >> v2:172.21.15.72:3300/0 conn(0x7f1d0809d6f0 msgr2=0x7f1d0809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:43.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.380+0000 7f1d05d9b700 1 --2- 172.21.15.72:0/289604060 >> v2:172.21.15.72:3300/0 conn(0x7f1d0809d6f0 0x7f1d0809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.380+0000 7f1d05d9b700 1 -- 172.21.15.72:0/289604060 >> v1:172.21.15.72:6789/0 conn(0x7f1d0809e410 legacy=0x7f1d08130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.380+0000 7f1d05d9b700 1 -- 172.21.15.72:0/289604060 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0809b2d0 con 0x7f1d0809e000 2023-10-03T10:12:43.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.381+0000 7f1d05d9b700 1 --2- 172.21.15.72:0/289604060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d0809e000 0x7f1d08130660 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0098f0 tx=0x7f1cfc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=477ef25ea0b9bac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.381+0000 7f1d0559a700 1 -- 172.21.15.72:0/289604060 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc011830 con 0x7f1d0809e000 2023-10-03T10:12:43.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.381+0000 7f1d0559a700 1 -- 172.21.15.72:0/289604060 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc011990 con 0x7f1d0809e000 2023-10-03T10:12:43.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.381+0000 7f1d0559a700 1 -- 172.21.15.72:0/289604060 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc011d20 con 0x7f1d0809e000 2023-10-03T10:12:43.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.381+0000 7f1d0ce23700 1 -- 172.21.15.72:0/289604060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d0809e000 msgr2=0x7f1d08130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.381+0000 7f1d0ce23700 1 --2- 172.21.15.72:0/289604060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d0809e000 0x7f1d08130660 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0098f0 tx=0x7f1cfc009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:43.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.382+0000 7f1d0ce23700 1 -- 172.21.15.72:0/289604060 shutdown_connections 2023-10-03T10:12:43.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.382+0000 7f1d0ce23700 1 --2- 172.21.15.72:0/289604060 >> v2:172.21.15.72:3300/0 conn(0x7f1d0809d6f0 0x7f1d0809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.382+0000 7f1d0ce23700 1 --2- 172.21.15.72:0/289604060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d0809e000 0x7f1d08130660 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.382+0000 7f1d0ce23700 1 -- 172.21.15.72:0/289604060 >> 172.21.15.72:0/289604060 conn(0x7f1d08066f50 msgr2=0x7f1d0809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.382+0000 7f1d0ce23700 1 -- 172.21.15.72:0/289604060 shutdown_connections 2023-10-03T10:12:43.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.382+0000 7f1d0ce23700 1 -- 172.21.15.72:0/289604060 wait complete. 2023-10-03T10:12:43.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.383+0000 7f1d0ce23700 1 Processor -- start 2023-10-03T10:12:43.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.383+0000 7f1d0ce23700 1 -- start start 2023-10-03T10:12:43.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.383+0000 7f1d0ce23700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d0809d6f0 0x7f1d081222f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.383+0000 7f1d0ce23700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d0809e000 0x7f1d08122830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.383+0000 7f1d0ce23700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d0809e410 0x7f1d08122d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.383+0000 7f1d0ce23700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d08125510 con 0x7f1d0809e000 2023-10-03T10:12:43.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.383+0000 7f1d0ce23700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d08123f00 con 0x7f1d0809e410 2023-10-03T10:12:43.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.383+0000 7f1d0ce23700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d081247d0 con 0x7f1d0809d6f0 2023-10-03T10:12:43.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.383+0000 7f1d06d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d0809e410 0x7f1d08122d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.383+0000 7f1d06d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d0809e410 0x7f1d08122d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54054/0 (socket says 172.21.15.72:54054) 2023-10-03T10:12:43.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.383+0000 7f1d06d9d700 1 -- 172.21.15.72:0/980929442 learned_addr learned my addr 172.21.15.72:0/980929442 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:43.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.384+0000 7f1d0659c700 1 --2- 172.21.15.72:0/980929442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d0809d6f0 0x7f1d081222f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.384+0000 7f1d06d9d700 1 -- 172.21.15.72:0/980929442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d0809d6f0 msgr2=0x7f1d081222f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.384+0000 7f1d06d9d700 1 --2- 172.21.15.72:0/980929442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d0809d6f0 0x7f1d081222f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.384+0000 7f1d06d9d700 1 -- 172.21.15.72:0/980929442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d0809e000 msgr2=0x7f1d08122830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.384+0000 7f1d05d9b700 1 --2- 172.21.15.72:0/980929442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d0809e000 0x7f1d08122830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.384+0000 7f1d06d9d700 1 --2- 172.21.15.72:0/980929442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d0809e000 0x7f1d08122830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.384+0000 7f1d06d9d700 1 -- 172.21.15.72:0/980929442 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc009550 con 0x7f1d0809e410 2023-10-03T10:12:43.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.384+0000 7f1d05d9b700 1 --2- 172.21.15.72:0/980929442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d0809e000 0x7f1d08122830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:43.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.384+0000 7f1d06d9d700 1 --2- 172.21.15.72:0/980929442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d0809e410 0x7f1d08122d70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000cc50 tx=0x7f1d0000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.384+0000 7f1cf6ffd700 1 -- 172.21.15.72:0/980929442 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d00003c00 con 0x7f1d0809e410 2023-10-03T10:12:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.384+0000 7f1cf6ffd700 1 -- 172.21.15.72:0/980929442 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d00003d60 con 0x7f1d0809e410 2023-10-03T10:12:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.384+0000 7f1d0ce23700 1 -- 172.21.15.72:0/980929442 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d08125e10 con 0x7f1d0809e410 2023-10-03T10:12:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.384+0000 7f1cf6ffd700 1 -- 172.21.15.72:0/980929442 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0000ab60 con 0x7f1d0809e410 2023-10-03T10:12:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.384+0000 7f1d0ce23700 1 -- 172.21.15.72:0/980929442 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d08125870 con 0x7f1d0809e410 2023-10-03T10:12:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.385+0000 7f1cf6ffd700 1 -- 172.21.15.72:0/980929442 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1d0000acc0 con 0x7f1d0809e410 2023-10-03T10:12:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.385+0000 7f1cf6ffd700 1 -- 172.21.15.72:0/980929442 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f1d0003fb20 con 0x7f1d0809e410 2023-10-03T10:12:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.385+0000 7f1d0659c700 1 -- 172.21.15.72:0/980929442 >> v1:172.21.15.72:6816/126756 conn(0x7f1ce802f540 legacy=0x7f1ce80319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.386+0000 7f1d0ce23700 1 -- 172.21.15.72:0/980929442 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d08074ea0 con 0x7f1d0809e410 2023-10-03T10:12:43.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.393+0000 7f1cf6ffd700 1 -- 172.21.15.72:0/980929442 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d000198f0 con 0x7f1d0809e410 2023-10-03T10:12:43.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.411+0000 7fcce64c3700 1 Processor -- start 2023-10-03T10:12:43.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.411+0000 7fcce64c3700 1 -- start start 2023-10-03T10:12:43.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fcce64c3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcce006c0e0 0x7fcce009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fcce64c3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcce01380f0 0x7fcce013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fcce64c3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce0134980 con 0x7fcce0134ec0 2023-10-03T10:12:43.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fcce64c3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce006c4b0 con 0x7fcce006c0e0 2023-10-03T10:12:43.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fcce64c3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00a09c0 con 0x7fcce01380f0 2023-10-03T10:12:43.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fccdffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcce006c0e0 0x7fcce009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fccdffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcce006c0e0 0x7fcce009ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49388/0 (socket says 172.21.15.72:49388) 2023-10-03T10:12:43.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fccdffff700 1 -- 172.21.15.72:0/388322243 learned_addr learned my addr 172.21.15.72:0/388322243 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:43.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fcce4a60700 1 --2- 172.21.15.72:0/388322243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcce01380f0 0x7fcce013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fccdffff700 1 -- 172.21.15.72:0/388322243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcce01380f0 msgr2=0x7fcce013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:43.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fccdffff700 1 --2- 172.21.15.72:0/388322243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcce01380f0 0x7fcce013fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fccdffff700 1 -- 172.21.15.72:0/388322243 >> v1:172.21.15.72:6789/0 conn(0x7fcce0134ec0 legacy=0x7fcce01379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fccdffff700 1 -- 172.21.15.72:0/388322243 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce00a0600 con 0x7fcce006c0e0 2023-10-03T10:12:43.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fcce4a60700 1 --2- 172.21.15.72:0/388322243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcce01380f0 0x7fcce013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:43.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fccdffff700 1 --2- 172.21.15.72:0/388322243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcce006c0e0 0x7fcce009ac90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009e50 tx=0x7fccd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ce08b2a6049363 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fccdeffd700 1 -- 172.21.15.72:0/388322243 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd800e070 con 0x7fcce006c0e0 2023-10-03T10:12:43.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fccdeffd700 1 -- 172.21.15.72:0/388322243 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd800b9c0 con 0x7fcce006c0e0 2023-10-03T10:12:43.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.412+0000 7fccdeffd700 1 -- 172.21.15.72:0/388322243 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd800bd70 con 0x7fcce006c0e0 2023-10-03T10:12:43.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.413+0000 7fcce64c3700 1 -- 172.21.15.72:0/388322243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcce006c0e0 msgr2=0x7fcce009ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.413+0000 7fcce64c3700 1 --2- 172.21.15.72:0/388322243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcce006c0e0 0x7fcce009ac90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009e50 tx=0x7fccd800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:43.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.413+0000 7fcce64c3700 1 -- 172.21.15.72:0/388322243 shutdown_connections 2023-10-03T10:12:43.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.413+0000 7fcce64c3700 1 --2- 172.21.15.72:0/388322243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcce01380f0 0x7fcce013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.413+0000 7fcce64c3700 1 --2- 172.21.15.72:0/388322243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcce006c0e0 0x7fcce009ac90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.413+0000 7fcce64c3700 1 -- 172.21.15.72:0/388322243 >> 172.21.15.72:0/388322243 conn(0x7fcce00a4210 msgr2=0x7fcce00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.413+0000 7fcce64c3700 1 -- 172.21.15.72:0/388322243 shutdown_connections 2023-10-03T10:12:43.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.413+0000 7fcce64c3700 1 -- 172.21.15.72:0/388322243 wait complete. 2023-10-03T10:12:43.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.414+0000 7fcce64c3700 1 Processor -- start 2023-10-03T10:12:43.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.415+0000 7fcce64c3700 1 -- start start 2023-10-03T10:12:43.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.415+0000 7fcce64c3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcce006c0e0 0x7fcce011a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.415+0000 7fcce64c3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcce0134ec0 0x7fcce011ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.415+0000 7fcce64c3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcce01380f0 0x7fcce011b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.415+0000 7fcce64c3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00a0460 con 0x7fcce0134ec0 2023-10-03T10:12:43.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.415+0000 7fcce64c3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce011d6f0 con 0x7fcce01380f0 2023-10-03T10:12:43.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.415+0000 7fcce64c3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcce011c1b0 con 0x7fcce006c0e0 2023-10-03T10:12:43.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.415+0000 7fccdffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcce006c0e0 0x7fcce011a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.415+0000 7fccdf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcce0134ec0 0x7fcce011ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.415+0000 7fccdffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcce006c0e0 0x7fcce011a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45728/0 (socket says 172.21.15.72:45728) 2023-10-03T10:12:43.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.415+0000 7fccdffff700 1 -- 172.21.15.72:0/1582835226 learned_addr learned my addr 172.21.15.72:0/1582835226 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:43.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.415+0000 7fcce4a60700 1 --2- 172.21.15.72:0/1582835226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcce01380f0 0x7fcce011b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.416+0000 7fccdf7fe700 1 -- 172.21.15.72:0/1582835226 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcce006c0e0 msgr2=0x7fcce011a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.416+0000 7fccdf7fe700 1 --2- 172.21.15.72:0/1582835226 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcce006c0e0 0x7fcce011a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.416+0000 7fccdf7fe700 1 -- 172.21.15.72:0/1582835226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcce01380f0 msgr2=0x7fcce011b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.416+0000 7fccdf7fe700 1 --2- 172.21.15.72:0/1582835226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcce01380f0 0x7fcce011b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.416+0000 7fccdf7fe700 1 -- 172.21.15.72:0/1582835226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd8009b30 con 0x7fcce0134ec0 2023-10-03T10:12:43.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.416+0000 7fcce4a60700 1 --2- 172.21.15.72:0/1582835226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcce01380f0 0x7fcce011b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:43.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.416+0000 7fccdf7fe700 1 --2- 172.21.15.72:0/1582835226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcce0134ec0 0x7fcce011ae30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fccd4000f60 tx=0x7fccd400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.416+0000 7fccdcff9700 1 -- 172.21.15.72:0/1582835226 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd40052d0 con 0x7fcce0134ec0 2023-10-03T10:12:43.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.416+0000 7fccdcff9700 1 -- 172.21.15.72:0/1582835226 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd4005430 con 0x7fcce0134ec0 2023-10-03T10:12:43.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.416+0000 7fcce64c3700 1 -- 172.21.15.72:0/1582835226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce011d2a0 con 0x7fcce0134ec0 2023-10-03T10:12:43.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.416+0000 7fccdcff9700 1 -- 172.21.15.72:0/1582835226 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd40038c0 con 0x7fcce0134ec0 2023-10-03T10:12:43.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.416+0000 7fcce64c3700 1 -- 172.21.15.72:0/1582835226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce0127350 con 0x7fcce0134ec0 2023-10-03T10:12:43.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.417+0000 7fccdcff9700 1 -- 172.21.15.72:0/1582835226 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fccd4003a20 con 0x7fcce0134ec0 2023-10-03T10:12:43.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.417+0000 7fccdcff9700 1 -- 172.21.15.72:0/1582835226 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fccd403efd0 con 0x7fcce0134ec0 2023-10-03T10:12:43.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.417+0000 7fcce64c3700 1 -- 172.21.15.72:0/1582835226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce0074ea0 con 0x7fcce0134ec0 2023-10-03T10:12:43.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.422+0000 7fccdffff700 1 -- 172.21.15.72:0/1582835226 >> v1:172.21.15.72:6816/126756 conn(0x7fcccc02f540 legacy=0x7fcccc0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:43.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.422+0000 7fccdcff9700 1 -- 172.21.15.72:0/1582835226 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fccd4017020 con 0x7fcce0134ec0 2023-10-03T10:12:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.485+0000 7f7d46bf9700 1 Processor -- start 2023-10-03T10:12:43.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.485+0000 7f7d46bf9700 1 -- start start 2023-10-03T10:12:43.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.485+0000 7f7d46bf9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d4006f5d0 0x7f7d4012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.485+0000 7f7d46bf9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7d40135c20 0x7f7d40138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.485+0000 7f7d46bf9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4006fa40 con 0x7f7d4012cf60 2023-10-03T10:12:43.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.485+0000 7f7d46bf9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4012cd90 con 0x7f7d40135c20 2023-10-03T10:12:43.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.485+0000 7f7d46bf9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d40071780 con 0x7f7d4006f5d0 2023-10-03T10:12:43.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.485+0000 7f7d3ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d4006f5d0 0x7f7d4012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.485+0000 7f7d3ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d4006f5d0 0x7f7d4012ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45742/0 (socket says 172.21.15.72:45742) 2023-10-03T10:12:43.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.485+0000 7f7d3ffff700 1 -- 172.21.15.72:0/453989427 learned_addr learned my addr 172.21.15.72:0/453989427 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:43.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.485+0000 7f7d44995700 1 --1- 172.21.15.72:0/453989427 >> v1:172.21.15.72:6789/0 conn(0x7f7d4012cf60 0x7f7d4012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51162/0 (socket says 172.21.15.72:51162) 2023-10-03T10:12:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.486+0000 7f7d45196700 1 --2- 172.21.15.72:0/453989427 >> v2:172.21.15.72:3300/0 conn(0x7f7d40135c20 0x7f7d40138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.486+0000 7f7d3ffff700 1 -- 172.21.15.72:0/453989427 >> v2:172.21.15.72:3300/0 conn(0x7f7d40135c20 msgr2=0x7f7d40138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.486+0000 7f7d3ffff700 1 --2- 172.21.15.72:0/453989427 >> v2:172.21.15.72:3300/0 conn(0x7f7d40135c20 0x7f7d40138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.486+0000 7f7d3ffff700 1 -- 172.21.15.72:0/453989427 >> v1:172.21.15.72:6789/0 conn(0x7f7d4012cf60 legacy=0x7f7d4012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.486+0000 7f7d3ffff700 1 -- 172.21.15.72:0/453989427 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d40071a40 con 0x7f7d4006f5d0 2023-10-03T10:12:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.486+0000 7f7d3ffff700 1 --2- 172.21.15.72:0/453989427 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d4006f5d0 0x7f7d4012ffc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c00bb90 tx=0x7f7d2c00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=977d72d27c074f48 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.486+0000 7f7d3f7fe700 1 -- 172.21.15.72:0/453989427 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c00dc20 con 0x7f7d4006f5d0 2023-10-03T10:12:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.486+0000 7f7d3f7fe700 1 -- 172.21.15.72:0/453989427 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c00dd80 con 0x7f7d4006f5d0 2023-10-03T10:12:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.486+0000 7f7d3f7fe700 1 -- 172.21.15.72:0/453989427 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c017650 con 0x7f7d4006f5d0 2023-10-03T10:12:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.487+0000 7f7d46bf9700 1 -- 172.21.15.72:0/453989427 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d4006f5d0 msgr2=0x7f7d4012ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.487+0000 7f7d46bf9700 1 --2- 172.21.15.72:0/453989427 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d4006f5d0 0x7f7d4012ffc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c00bb90 tx=0x7f7d2c00bea0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.487+0000 7f7d46bf9700 1 -- 172.21.15.72:0/453989427 shutdown_connections 2023-10-03T10:12:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.487+0000 7f7d46bf9700 1 --2- 172.21.15.72:0/453989427 >> v2:172.21.15.72:3300/0 conn(0x7f7d40135c20 0x7f7d40138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.487+0000 7f7d46bf9700 1 --2- 172.21.15.72:0/453989427 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d4006f5d0 0x7f7d4012ffc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.487+0000 7f7d46bf9700 1 -- 172.21.15.72:0/453989427 >> 172.21.15.72:0/453989427 conn(0x7f7d400a2aa0 msgr2=0x7f7d400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.487+0000 7f7d46bf9700 1 -- 172.21.15.72:0/453989427 shutdown_connections 2023-10-03T10:12:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.487+0000 7f7d46bf9700 1 -- 172.21.15.72:0/453989427 wait complete. 2023-10-03T10:12:43.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.488+0000 7f7d46bf9700 1 Processor -- start 2023-10-03T10:12:43.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.488+0000 7f7d46bf9700 1 -- start start 2023-10-03T10:12:43.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d46bf9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d4006f5d0 0x7f7d40133740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d46bf9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d4012cf60 0x7f7d40133c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d46bf9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d40135c20 0x7f7d401c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d46bf9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d40133350 con 0x7f7d4006f5d0 2023-10-03T10:12:43.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d46bf9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4012c130 con 0x7f7d4012cf60 2023-10-03T10:12:43.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d46bf9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d40129fa0 con 0x7f7d40135c20 2023-10-03T10:12:43.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d45196700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d40135c20 0x7f7d401c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d45196700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d40135c20 0x7f7d401c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45744/0 (socket says 172.21.15.72:45744) 2023-10-03T10:12:43.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d45196700 1 -- 172.21.15.72:0/1956678839 learned_addr learned my addr 172.21.15.72:0/1956678839 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:43.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d3ffff700 1 --2- 172.21.15.72:0/1956678839 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d4012cf60 0x7f7d40133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d44995700 1 --2- 172.21.15.72:0/1956678839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d4006f5d0 0x7f7d40133740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d45196700 1 -- 172.21.15.72:0/1956678839 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d4012cf60 msgr2=0x7f7d40133c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d45196700 1 --2- 172.21.15.72:0/1956678839 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d4012cf60 0x7f7d40133c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d45196700 1 -- 172.21.15.72:0/1956678839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d4006f5d0 msgr2=0x7f7d40133740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d45196700 1 --2- 172.21.15.72:0/1956678839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d4006f5d0 0x7f7d40133740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d45196700 1 -- 172.21.15.72:0/1956678839 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c00b7f0 con 0x7f7d40135c20 2023-10-03T10:12:43.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d3ffff700 1 --2- 172.21.15.72:0/1956678839 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d4012cf60 0x7f7d40133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.489+0000 7f7d45196700 1 --2- 172.21.15.72:0/1956678839 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d40135c20 0x7f7d401c3f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800ef90 tx=0x7f7d3800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.490+0000 7f7d3d7fa700 1 -- 172.21.15.72:0/1956678839 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3800cc90 con 0x7f7d40135c20 2023-10-03T10:12:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.490+0000 7f7d3d7fa700 1 -- 172.21.15.72:0/1956678839 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3800f040 con 0x7f7d40135c20 2023-10-03T10:12:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.490+0000 7f7d46bf9700 1 -- 172.21.15.72:0/1956678839 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4009a690 con 0x7f7d40135c20 2023-10-03T10:12:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.490+0000 7f7d3d7fa700 1 -- 172.21.15.72:0/1956678839 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38014480 con 0x7f7d40135c20 2023-10-03T10:12:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.490+0000 7f7d46bf9700 1 -- 172.21.15.72:0/1956678839 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4009eba0 con 0x7f7d40135c20 2023-10-03T10:12:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.491+0000 7f7d3d7fa700 1 -- 172.21.15.72:0/1956678839 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7d380145e0 con 0x7f7d40135c20 2023-10-03T10:12:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.491+0000 7f7d46bf9700 1 -- 172.21.15.72:0/1956678839 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d40074ea0 con 0x7f7d40135c20 2023-10-03T10:12:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.491+0000 7f7d3d7fa700 1 -- 172.21.15.72:0/1956678839 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f7d38040870 con 0x7f7d40135c20 2023-10-03T10:12:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.491+0000 7f7d44995700 1 -- 172.21.15.72:0/1956678839 >> v1:172.21.15.72:6816/126756 conn(0x7f7d2402f510 legacy=0x7f7d240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:43.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.498+0000 7efd86975700 1 Processor -- start 2023-10-03T10:12:43.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.498+0000 7efd86975700 1 -- start start 2023-10-03T10:12:43.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.498+0000 7efd86975700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8006a770 0x7efd8009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.498+0000 7efd86975700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efd8009dc30 0x7efd8009e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.498+0000 7efd86975700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd8009a810 con 0x7efd8013c1e0 2023-10-03T10:12:43.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.498+0000 7efd86975700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8006ab40 con 0x7efd8009dc30 2023-10-03T10:12:43.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.498+0000 7efd86975700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8009ebc0 con 0x7efd8006a770 2023-10-03T10:12:43.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.498+0000 7efd7f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efd8009dc30 0x7efd8009e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.498+0000 7efd7f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efd8009dc30 0x7efd8009e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49430/0 (socket says 172.21.15.72:49430) 2023-10-03T10:12:43.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.498+0000 7efd84f12700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efd8013c1e0 0x7efd8013e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51170/0 (socket says 172.21.15.72:51170) 2023-10-03T10:12:43.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.498+0000 7efd7f7fe700 1 -- 172.21.15.72:0/4236303361 learned_addr learned my addr 172.21.15.72:0/4236303361 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:43.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.498+0000 7efd7ffff700 1 --2- 172.21.15.72:0/4236303361 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8006a770 0x7efd8009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.498+0000 7f7d3d7fa700 1 -- 172.21.15.72:0/1956678839 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d380076f0 con 0x7f7d40135c20 2023-10-03T10:12:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.499+0000 7efd7ffff700 1 -- 172.21.15.72:0/4236303361 >> v2:172.21.15.72:3300/0 conn(0x7efd8009dc30 msgr2=0x7efd8009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.499+0000 7efd7ffff700 1 --2- 172.21.15.72:0/4236303361 >> v2:172.21.15.72:3300/0 conn(0x7efd8009dc30 0x7efd8009e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.499+0000 7efd7ffff700 1 -- 172.21.15.72:0/4236303361 >> v1:172.21.15.72:6789/0 conn(0x7efd8013c1e0 legacy=0x7efd8013e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.499+0000 7efd7ffff700 1 -- 172.21.15.72:0/4236303361 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8009e920 con 0x7efd8006a770 2023-10-03T10:12:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.499+0000 7efd7effd700 1 -- 172.21.15.72:0/4236303361 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526791068 0 0) 0x7efd8009a810 con 0x7efd8013c1e0 2023-10-03T10:12:43.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.499+0000 7efd7f7fe700 1 --2- 172.21.15.72:0/4236303361 >> v2:172.21.15.72:3300/0 conn(0x7efd8009dc30 0x7efd8009e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:43.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.499+0000 7efd7ffff700 1 --2- 172.21.15.72:0/4236303361 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8006a770 0x7efd8009d6f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd70009870 tx=0x7efd70009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=775feadf96ec05cc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.499+0000 7efd7effd700 1 -- 172.21.15.72:0/4236303361 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70011830 con 0x7efd8006a770 2023-10-03T10:12:43.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.499+0000 7efd7effd700 1 -- 172.21.15.72:0/4236303361 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd70011990 con 0x7efd8006a770 2023-10-03T10:12:43.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.499+0000 7efd7effd700 1 -- 172.21.15.72:0/4236303361 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd70011d20 con 0x7efd8006a770 2023-10-03T10:12:43.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.500+0000 7efd86975700 1 -- 172.21.15.72:0/4236303361 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8006a770 msgr2=0x7efd8009d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.500+0000 7efd86975700 1 --2- 172.21.15.72:0/4236303361 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8006a770 0x7efd8009d6f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd70009870 tx=0x7efd70009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:43.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.500+0000 7efd86975700 1 -- 172.21.15.72:0/4236303361 shutdown_connections 2023-10-03T10:12:43.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.500+0000 7efd86975700 1 --2- 172.21.15.72:0/4236303361 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8006a770 0x7efd8009d6f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.500+0000 7efd86975700 1 --2- 172.21.15.72:0/4236303361 >> v2:172.21.15.72:3300/0 conn(0x7efd8009dc30 0x7efd8009e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.500+0000 7efd86975700 1 -- 172.21.15.72:0/4236303361 >> 172.21.15.72:0/4236303361 conn(0x7efd80066f50 msgr2=0x7efd8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.500+0000 7efd86975700 1 -- 172.21.15.72:0/4236303361 shutdown_connections 2023-10-03T10:12:43.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.500+0000 7efd86975700 1 -- 172.21.15.72:0/4236303361 wait complete. 2023-10-03T10:12:43.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.501+0000 7efd86975700 1 Processor -- start 2023-10-03T10:12:43.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.501+0000 7efd86975700 1 -- start start 2023-10-03T10:12:43.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.502+0000 7efd86975700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd8006a770 0x7efd80127130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.502+0000 7efd86975700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efd8009dc30 0x7efd80127670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.502+0000 7efd86975700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8013c1e0 0x7efd80127bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:43.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.502+0000 7efd86975700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd80128cf0 con 0x7efd8006a770 2023-10-03T10:12:43.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.502+0000 7efd86975700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd8012ace0 con 0x7efd8013c1e0 2023-10-03T10:12:43.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.502+0000 7efd86975700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd8009c060 con 0x7efd8009dc30 2023-10-03T10:12:43.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.502+0000 7efd7f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efd8009dc30 0x7efd80127670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.502+0000 7efd7f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efd8009dc30 0x7efd80127670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45758/0 (socket says 172.21.15.72:45758) 2023-10-03T10:12:43.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.502+0000 7efd7f7fe700 1 -- 172.21.15.72:0/4111619444 learned_addr learned my addr 172.21.15.72:0/4111619444 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.502+0000 7efd84f12700 1 --2- 172.21.15.72:0/4111619444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8013c1e0 0x7efd80127bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.503+0000 7efd7f7fe700 1 -- 172.21.15.72:0/4111619444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8013c1e0 msgr2=0x7efd80127bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.503+0000 7efd7f7fe700 1 --2- 172.21.15.72:0/4111619444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8013c1e0 0x7efd80127bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.503+0000 7efd7f7fe700 1 -- 172.21.15.72:0/4111619444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd8006a770 msgr2=0x7efd80127130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.503+0000 7efd7f7fe700 1 --2- 172.21.15.72:0/4111619444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd8006a770 0x7efd80127130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.503+0000 7efd7f7fe700 1 -- 172.21.15.72:0/4111619444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd74009550 con 0x7efd8009dc30 2023-10-03T10:12:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.503+0000 7efd84f12700 1 --2- 172.21.15.72:0/4111619444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8013c1e0 0x7efd80127bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.503+0000 7efd7f7fe700 1 --2- 172.21.15.72:0/4111619444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efd8009dc30 0x7efd80127670 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd7400ebe0 tx=0x7efd7400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.503+0000 7efd7cff9700 1 -- 172.21.15.72:0/4111619444 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400c850 con 0x7efd8009dc30 2023-10-03T10:12:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.503+0000 7efd7cff9700 1 -- 172.21.15.72:0/4111619444 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7400c9b0 con 0x7efd8009dc30 2023-10-03T10:12:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.503+0000 7efd86975700 1 -- 172.21.15.72:0/4111619444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd700094a0 con 0x7efd8009dc30 2023-10-03T10:12:43.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.503+0000 7efd7cff9700 1 -- 172.21.15.72:0/4111619444 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400cd60 con 0x7efd8009dc30 2023-10-03T10:12:43.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.503+0000 7efd86975700 1 -- 172.21.15.72:0/4111619444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8012a660 con 0x7efd8009dc30 2023-10-03T10:12:43.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.504+0000 7efd86975700 1 -- 172.21.15.72:0/4111619444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd80074ea0 con 0x7efd8009dc30 2023-10-03T10:12:43.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.504+0000 7efd7cff9700 1 -- 172.21.15.72:0/4111619444 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7efd74013470 con 0x7efd8009dc30 2023-10-03T10:12:43.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.504+0000 7efd7cff9700 1 -- 172.21.15.72:0/4111619444 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7efd7403fd00 con 0x7efd8009dc30 2023-10-03T10:12:43.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.504+0000 7efd7ffff700 1 -- 172.21.15.72:0/4111619444 >> v1:172.21.15.72:6816/126756 conn(0x7efd6c02f510 legacy=0x7efd6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.513+0000 7efd7cff9700 1 -- 172.21.15.72:0/4111619444 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd74043030 con 0x7efd8009dc30 2023-10-03T10:12:43.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.587+0000 7f1d0659c700 1 -- 172.21.15.72:0/980929442 >> v1:172.21.15.72:6816/126756 conn(0x7f1ce802f540 legacy=0x7f1ce80319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:43.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.623+0000 7fccdffff700 1 -- 172.21.15.72:0/1582835226 >> v1:172.21.15.72:6816/126756 conn(0x7fcccc02f540 legacy=0x7fcccc0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:43.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.628+0000 7fcce64c3700 1 -- 172.21.15.72:0/1582835226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcce011dab0 con 0x7fcce0134ec0 2023-10-03T10:12:43.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.628+0000 7fccdcff9700 1 -- 172.21.15.72:0/1582835226 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fccd4019910 con 0x7fcce0134ec0 2023-10-03T10:12:43.629 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:43.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.630+0000 7fcce64c3700 1 -- 172.21.15.72:0/1582835226 >> v1:172.21.15.72:6816/126756 conn(0x7fcccc02f540 legacy=0x7fcccc0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:43.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.630+0000 7fcce64c3700 1 -- 172.21.15.72:0/1582835226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcce0134ec0 msgr2=0x7fcce011ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.630+0000 7fcce64c3700 1 --2- 172.21.15.72:0/1582835226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcce0134ec0 0x7fcce011ae30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fccd4000f60 tx=0x7fccd400c730 comp rx=0 tx=0).stop 2023-10-03T10:12:43.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.630+0000 7fcce64c3700 1 -- 172.21.15.72:0/1582835226 shutdown_connections 2023-10-03T10:12:43.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.630+0000 7fcce64c3700 1 --2- 172.21.15.72:0/1582835226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcce01380f0 0x7fcce011b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.630+0000 7fcce64c3700 1 --2- 172.21.15.72:0/1582835226 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcce006c0e0 0x7fcce011a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.630+0000 7fcce64c3700 1 --2- 172.21.15.72:0/1582835226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcce0134ec0 0x7fcce011ae30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.630+0000 7fcce64c3700 1 -- 172.21.15.72:0/1582835226 >> 172.21.15.72:0/1582835226 conn(0x7fcce00a4210 msgr2=0x7fcce00a4810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.631+0000 7fcce64c3700 1 -- 172.21.15.72:0/1582835226 shutdown_connections 2023-10-03T10:12:43.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.631+0000 7fcce64c3700 1 -- 172.21.15.72:0/1582835226 wait complete. 2023-10-03T10:12:43.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:43.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.656+0000 7f1d0ce23700 1 -- 172.21.15.72:0/980929442 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1d0806c360 con 0x7f1d0809e410 2023-10-03T10:12:43.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.656+0000 7f1cf6ffd700 1 -- 172.21.15.72:0/980929442 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d00019300 con 0x7f1d0809e410 2023-10-03T10:12:43.657 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.659+0000 7f1d0ce23700 1 -- 172.21.15.72:0/980929442 >> v1:172.21.15.72:6816/126756 conn(0x7f1ce802f540 legacy=0x7f1ce80319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.659+0000 7f1d0ce23700 1 -- 172.21.15.72:0/980929442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d0809e410 msgr2=0x7f1d08122d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.659+0000 7f1d0ce23700 1 --2- 172.21.15.72:0/980929442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d0809e410 0x7f1d08122d70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000cc50 tx=0x7f1d0000cf60 comp rx=0 tx=0).stop 2023-10-03T10:12:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.659+0000 7f1d0ce23700 1 -- 172.21.15.72:0/980929442 shutdown_connections 2023-10-03T10:12:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.659+0000 7f1d0ce23700 1 --2- 172.21.15.72:0/980929442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d0809e410 0x7f1d08122d70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.659+0000 7f1d0ce23700 1 --2- 172.21.15.72:0/980929442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d0809d6f0 0x7f1d081222f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.659+0000 7f1d0ce23700 1 --2- 172.21.15.72:0/980929442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d0809e000 0x7f1d08122830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.659+0000 7f1d0ce23700 1 -- 172.21.15.72:0/980929442 >> 172.21.15.72:0/980929442 conn(0x7f1d08066f50 msgr2=0x7f1d08130a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.659+0000 7f1d0ce23700 1 -- 172.21.15.72:0/980929442 shutdown_connections 2023-10-03T10:12:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.659+0000 7f1d0ce23700 1 -- 172.21.15.72:0/980929442 wait complete. 2023-10-03T10:12:43.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:43.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.692+0000 7f7d44995700 1 -- 172.21.15.72:0/1956678839 >> v1:172.21.15.72:6816/126756 conn(0x7f7d2402f510 legacy=0x7f7d240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:43.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.706+0000 7efd7ffff700 1 -- 172.21.15.72:0/4111619444 >> v1:172.21.15.72:6816/126756 conn(0x7efd6c02f510 legacy=0x7efd6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:43.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.708+0000 7efd86975700 1 -- 172.21.15.72:0/4111619444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efd8012aa90 con 0x7efd8009dc30 2023-10-03T10:12:43.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.708+0000 7efd7cff9700 1 -- 172.21.15.72:0/4111619444 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd74021090 con 0x7efd8009dc30 2023-10-03T10:12:43.708 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.710+0000 7efd86975700 1 -- 172.21.15.72:0/4111619444 >> v1:172.21.15.72:6816/126756 conn(0x7efd6c02f510 legacy=0x7efd6c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.710+0000 7efd86975700 1 -- 172.21.15.72:0/4111619444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efd8009dc30 msgr2=0x7efd80127670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.710+0000 7efd86975700 1 --2- 172.21.15.72:0/4111619444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efd8009dc30 0x7efd80127670 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd7400ebe0 tx=0x7efd7400eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.710+0000 7efd86975700 1 -- 172.21.15.72:0/4111619444 shutdown_connections 2023-10-03T10:12:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.710+0000 7efd86975700 1 --2- 172.21.15.72:0/4111619444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd8006a770 0x7efd80127130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.710+0000 7efd86975700 1 --2- 172.21.15.72:0/4111619444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd8013c1e0 0x7efd80127bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.710+0000 7efd86975700 1 --2- 172.21.15.72:0/4111619444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efd8009dc30 0x7efd80127670 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.710+0000 7efd86975700 1 -- 172.21.15.72:0/4111619444 >> 172.21.15.72:0/4111619444 conn(0x7efd80066f50 msgr2=0x7efd800a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.710+0000 7efd86975700 1 -- 172.21.15.72:0/4111619444 shutdown_connections 2023-10-03T10:12:43.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.710+0000 7efd86975700 1 -- 172.21.15.72:0/4111619444 wait complete. 2023-10-03T10:12:43.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:43.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.730+0000 7f7d46bf9700 1 -- 172.21.15.72:0/1956678839 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7d400713a0 con 0x7f7d40135c20 2023-10-03T10:12:43.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.731+0000 7f7d3d7fa700 1 -- 172.21.15.72:0/1956678839 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7d38009ca0 con 0x7f7d40135c20 2023-10-03T10:12:43.731 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:43.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.732+0000 7f7d46bf9700 1 -- 172.21.15.72:0/1956678839 >> v1:172.21.15.72:6816/126756 conn(0x7f7d2402f510 legacy=0x7f7d240319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:43.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.732+0000 7f7d46bf9700 1 -- 172.21.15.72:0/1956678839 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d40135c20 msgr2=0x7f7d401c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:43.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.732+0000 7f7d46bf9700 1 --2- 172.21.15.72:0/1956678839 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d40135c20 0x7f7d401c3f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800ef90 tx=0x7f7d3800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.733+0000 7f7d46bf9700 1 -- 172.21.15.72:0/1956678839 shutdown_connections 2023-10-03T10:12:43.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.733+0000 7f7d46bf9700 1 --2- 172.21.15.72:0/1956678839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d4006f5d0 0x7f7d40133740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.733+0000 7f7d46bf9700 1 --2- 172.21.15.72:0/1956678839 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d40135c20 0x7f7d401c3f70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.733+0000 7f7d46bf9700 1 --2- 172.21.15.72:0/1956678839 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d4012cf60 0x7f7d40133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:43.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.733+0000 7f7d46bf9700 1 -- 172.21.15.72:0/1956678839 >> 172.21.15.72:0/1956678839 conn(0x7f7d400a2aa0 msgr2=0x7f7d4006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:43.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.733+0000 7f7d46bf9700 1 -- 172.21.15.72:0/1956678839 shutdown_connections 2023-10-03T10:12:43.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:43.733+0000 7f7d46bf9700 1 -- 172.21.15.72:0/1956678839 wait complete. 2023-10-03T10:12:43.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:44.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:44.677 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:44.724 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:44.746 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:44.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.785+0000 7f0458a46700 1 Processor -- start 2023-10-03T10:12:44.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.785+0000 7f0458a46700 1 -- start start 2023-10-03T10:12:44.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.786+0000 7f0458a46700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f045409d6f0 0x7f045409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.786+0000 7f0458a46700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f045409e000 0x7f0454130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.786+0000 7f0458a46700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f045409e410 0x7f0454130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.786+0000 7f0458a46700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045409f520 con 0x7f045409d6f0 2023-10-03T10:12:44.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.786+0000 7f0458a46700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045409f130 con 0x7f045409e000 2023-10-03T10:12:44.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.786+0000 7f0458a46700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f045409e930 con 0x7f045409e410 2023-10-03T10:12:44.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.786+0000 7f0451d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f045409e000 0x7f0454130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.786+0000 7f0451d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f045409e000 0x7f0454130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54112/0 (socket says 172.21.15.72:54112) 2023-10-03T10:12:44.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.786+0000 7f0451d9b700 1 -- 172.21.15.72:0/3583376469 learned_addr learned my addr 172.21.15.72:0/3583376469 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:44.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.787+0000 7f0452d9d700 1 --2- 172.21.15.72:0/3583376469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f045409e410 0x7f0454130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.787+0000 7f045259c700 1 --2- 172.21.15.72:0/3583376469 >> v2:172.21.15.72:3300/0 conn(0x7f045409d6f0 0x7f045409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.787+0000 7f0452d9d700 1 -- 172.21.15.72:0/3583376469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f045409e000 msgr2=0x7f0454130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.787+0000 7f0452d9d700 1 --2- 172.21.15.72:0/3583376469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f045409e000 0x7f0454130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.787+0000 7f0452d9d700 1 -- 172.21.15.72:0/3583376469 >> v2:172.21.15.72:3300/0 conn(0x7f045409d6f0 msgr2=0x7f045409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.787+0000 7f0452d9d700 1 --2- 172.21.15.72:0/3583376469 >> v2:172.21.15.72:3300/0 conn(0x7f045409d6f0 0x7f045409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.787+0000 7f0452d9d700 1 -- 172.21.15.72:0/3583376469 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045409b2d0 con 0x7f045409e410 2023-10-03T10:12:44.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.787+0000 7f0451d9b700 1 --2- 172.21.15.72:0/3583376469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f045409e000 0x7f0454130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:44.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.787+0000 7f0452d9d700 1 --2- 172.21.15.72:0/3583376469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f045409e410 0x7f0454130ba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f044c009870 tx=0x7f044c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83710f12d9672537 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.787+0000 7f045159a700 1 -- 172.21.15.72:0/3583376469 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c011830 con 0x7f045409e410 2023-10-03T10:12:44.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.787+0000 7f045159a700 1 -- 172.21.15.72:0/3583376469 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c011990 con 0x7f045409e410 2023-10-03T10:12:44.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.787+0000 7f045159a700 1 -- 172.21.15.72:0/3583376469 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c011d20 con 0x7f045409e410 2023-10-03T10:12:44.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.788+0000 7f0458a46700 1 -- 172.21.15.72:0/3583376469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f045409e410 msgr2=0x7f0454130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.788+0000 7f0458a46700 1 --2- 172.21.15.72:0/3583376469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f045409e410 0x7f0454130ba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f044c009870 tx=0x7f044c009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:44.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.788+0000 7f0458a46700 1 -- 172.21.15.72:0/3583376469 shutdown_connections 2023-10-03T10:12:44.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.788+0000 7f0458a46700 1 --2- 172.21.15.72:0/3583376469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f045409e410 0x7f0454130ba0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.788+0000 7f0458a46700 1 --2- 172.21.15.72:0/3583376469 >> v2:172.21.15.72:3300/0 conn(0x7f045409d6f0 0x7f045409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.788+0000 7f0458a46700 1 --2- 172.21.15.72:0/3583376469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f045409e000 0x7f0454130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.788+0000 7f0458a46700 1 -- 172.21.15.72:0/3583376469 >> 172.21.15.72:0/3583376469 conn(0x7f0454066f50 msgr2=0x7f045409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.789+0000 7f0458a46700 1 -- 172.21.15.72:0/3583376469 shutdown_connections 2023-10-03T10:12:44.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.789+0000 7f0458a46700 1 -- 172.21.15.72:0/3583376469 wait complete. 2023-10-03T10:12:44.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.790+0000 7f0458a46700 1 Processor -- start 2023-10-03T10:12:44.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.790+0000 7f0458a46700 1 -- start start 2023-10-03T10:12:44.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.790+0000 7f0458a46700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f045409d6f0 0x7f045406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.790+0000 7f0458a46700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f045409e000 0x7f045406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.790+0000 7f0458a46700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f045409e410 0x7f045406f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.790+0000 7f0458a46700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0454125470 con 0x7f045409e410 2023-10-03T10:12:44.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.790+0000 7f0458a46700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04540a1e80 con 0x7f045409e000 2023-10-03T10:12:44.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.790+0000 7f0458a46700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0454125ab0 con 0x7f045409d6f0 2023-10-03T10:12:44.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.790+0000 7f045259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f045409d6f0 0x7f045406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.790+0000 7f045259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f045409d6f0 0x7f045406e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45782/0 (socket says 172.21.15.72:45782) 2023-10-03T10:12:44.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.790+0000 7f045259c700 1 -- 172.21.15.72:0/248266817 learned_addr learned my addr 172.21.15.72:0/248266817 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:44.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.791+0000 7f0452d9d700 1 --2- 172.21.15.72:0/248266817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f045409e410 0x7f045406f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.791+0000 7f0451d9b700 1 --2- 172.21.15.72:0/248266817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f045409e000 0x7f045406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.791+0000 7f045259c700 1 -- 172.21.15.72:0/248266817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f045409e000 msgr2=0x7f045406edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.791+0000 7f045259c700 1 --2- 172.21.15.72:0/248266817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f045409e000 0x7f045406edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.791+0000 7f045259c700 1 -- 172.21.15.72:0/248266817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f045409e410 msgr2=0x7f045406f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.791+0000 7f045259c700 1 --2- 172.21.15.72:0/248266817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f045409e410 0x7f045406f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.791+0000 7f045259c700 1 -- 172.21.15.72:0/248266817 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0448009550 con 0x7f045409d6f0 2023-10-03T10:12:44.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.791+0000 7f045259c700 1 --2- 172.21.15.72:0/248266817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f045409d6f0 0x7f045406e870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f044400eed0 tx=0x7f044400b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.791+0000 7f0442ffd700 1 -- 172.21.15.72:0/248266817 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444010040 con 0x7f045409d6f0 2023-10-03T10:12:44.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.791+0000 7f0458a46700 1 -- 172.21.15.72:0/248266817 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044c0094a0 con 0x7f045409d6f0 2023-10-03T10:12:44.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.791+0000 7f0442ffd700 1 -- 172.21.15.72:0/248266817 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044400bd00 con 0x7f045409d6f0 2023-10-03T10:12:44.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.791+0000 7f0442ffd700 1 -- 172.21.15.72:0/248266817 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444014600 con 0x7f045409d6f0 2023-10-03T10:12:44.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.791+0000 7f0458a46700 1 -- 172.21.15.72:0/248266817 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0454124690 con 0x7f045409d6f0 2023-10-03T10:12:44.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.792+0000 7f0458a46700 1 -- 172.21.15.72:0/248266817 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0454074ea0 con 0x7f045409d6f0 2023-10-03T10:12:44.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.792+0000 7f0442ffd700 1 -- 172.21.15.72:0/248266817 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0444014760 con 0x7f045409d6f0 2023-10-03T10:12:44.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.793+0000 7f0442ffd700 1 -- 172.21.15.72:0/248266817 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f04440401a0 con 0x7f045409d6f0 2023-10-03T10:12:44.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.793+0000 7f0451d9b700 1 -- 172.21.15.72:0/248266817 >> v1:172.21.15.72:6816/126756 conn(0x7f043402f510 legacy=0x7f04340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:44.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.797+0000 7f0442ffd700 1 -- 172.21.15.72:0/248266817 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f044401a8b0 con 0x7f045409d6f0 2023-10-03T10:12:44.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.831+0000 7f5b2176f700 1 Processor -- start 2023-10-03T10:12:44.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.831+0000 7f5b2176f700 1 -- start start 2023-10-03T10:12:44.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.831+0000 7f5b2176f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5b1c09d6f0 0x7f5b1c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.831+0000 7f5b2176f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b1c09e410 0x7f5b1c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.831+0000 7f5b2176f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c09f130 con 0x7f5b1c09e000 2023-10-03T10:12:44.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.831+0000 7f5b2176f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1c09f520 con 0x7f5b1c09d6f0 2023-10-03T10:12:44.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.831+0000 7f5b2176f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c09e930 con 0x7f5b1c09e410 2023-10-03T10:12:44.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.832+0000 7f5b1affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5b1c09d6f0 0x7f5b1c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.832+0000 7f5b1affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5b1c09d6f0 0x7f5b1c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49474/0 (socket says 172.21.15.72:49474) 2023-10-03T10:12:44.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.832+0000 7f5b1affd700 1 -- 172.21.15.72:0/406885708 learned_addr learned my addr 172.21.15.72:0/406885708 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:44.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.832+0000 7f5b1b7fe700 1 --2- 172.21.15.72:0/406885708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b1c09e410 0x7f5b1c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.832+0000 7f5b1b7fe700 1 -- 172.21.15.72:0/406885708 >> v2:172.21.15.72:3300/0 conn(0x7f5b1c09d6f0 msgr2=0x7f5b1c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.832+0000 7f5b1b7fe700 1 --2- 172.21.15.72:0/406885708 >> v2:172.21.15.72:3300/0 conn(0x7f5b1c09d6f0 0x7f5b1c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.832+0000 7f5b1b7fe700 1 -- 172.21.15.72:0/406885708 >> v1:172.21.15.72:6789/0 conn(0x7f5b1c09e000 legacy=0x7f5b1c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.832+0000 7f5b1b7fe700 1 -- 172.21.15.72:0/406885708 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c09b2d0 con 0x7f5b1c09e410 2023-10-03T10:12:44.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.832+0000 7f5b1b7fe700 1 --2- 172.21.15.72:0/406885708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b1c09e410 0x7f5b1c130d70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009d90 tx=0x7f5b1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45539e9ed4584306 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.832+0000 7f5b19ffb700 1 -- 172.21.15.72:0/406885708 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1400e070 con 0x7f5b1c09e410 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.832+0000 7f5b19ffb700 1 -- 172.21.15.72:0/406885708 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1400bb20 con 0x7f5b1c09e410 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.833+0000 7f5b19ffb700 1 -- 172.21.15.72:0/406885708 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14012430 con 0x7f5b1c09e410 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.833+0000 7f5b2176f700 1 -- 172.21.15.72:0/406885708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b1c09e410 msgr2=0x7f5b1c130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.833+0000 7f5b2176f700 1 --2- 172.21.15.72:0/406885708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b1c09e410 0x7f5b1c130d70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009d90 tx=0x7f5b1400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.833+0000 7f5b2176f700 1 -- 172.21.15.72:0/406885708 shutdown_connections 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.833+0000 7f5b2176f700 1 --2- 172.21.15.72:0/406885708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b1c09e410 0x7f5b1c130d70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.833+0000 7f5b2176f700 1 --2- 172.21.15.72:0/406885708 >> v2:172.21.15.72:3300/0 conn(0x7f5b1c09d6f0 0x7f5b1c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.833+0000 7f5b2176f700 1 -- 172.21.15.72:0/406885708 >> 172.21.15.72:0/406885708 conn(0x7f5b1c066f50 msgr2=0x7f5b1c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.833+0000 7f5b2176f700 1 -- 172.21.15.72:0/406885708 shutdown_connections 2023-10-03T10:12:44.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.833+0000 7f5b2176f700 1 -- 172.21.15.72:0/406885708 wait complete. 2023-10-03T10:12:44.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.835+0000 7f5b2176f700 1 Processor -- start 2023-10-03T10:12:44.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.835+0000 7f5b2176f700 1 -- start start 2023-10-03T10:12:44.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.835+0000 7f5b2176f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b1c09d6f0 0x7f5b1c1223e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.835+0000 7f5b2176f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b1c09e000 0x7f5b1c122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.835+0000 7f5b2176f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b1c09e410 0x7f5b1c122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.835+0000 7f5b2176f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c125780 con 0x7f5b1c09d6f0 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.835+0000 7f5b2176f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c125960 con 0x7f5b1c09e000 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.835+0000 7f5b2176f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c0a1d00 con 0x7f5b1c09e410 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.836+0000 7f5b1affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b1c09d6f0 0x7f5b1c1223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.836+0000 7f5b1a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b1c09e000 0x7f5b1c122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.836+0000 7f5b1b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b1c09e410 0x7f5b1c122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.836+0000 7f5b1affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b1c09d6f0 0x7f5b1c1223e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49482/0 (socket says 172.21.15.72:49482) 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.836+0000 7f5b1affd700 1 -- 172.21.15.72:0/4249190613 learned_addr learned my addr 172.21.15.72:0/4249190613 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.836+0000 7f5b1a7fc700 1 -- 172.21.15.72:0/4249190613 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b1c09e410 msgr2=0x7f5b1c122e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.836+0000 7f5b1a7fc700 1 --2- 172.21.15.72:0/4249190613 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b1c09e410 0x7f5b1c122e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.836+0000 7f5b1a7fc700 1 -- 172.21.15.72:0/4249190613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b1c09d6f0 msgr2=0x7f5b1c1223e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.836+0000 7f5b1a7fc700 1 --2- 172.21.15.72:0/4249190613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b1c09d6f0 0x7f5b1c1223e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.836+0000 7f5b1a7fc700 1 -- 172.21.15.72:0/4249190613 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b14009a70 con 0x7f5b1c09e000 2023-10-03T10:12:44.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.836+0000 7f5b1affd700 1 --2- 172.21.15.72:0/4249190613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b1c09d6f0 0x7f5b1c1223e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:44.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.836+0000 7f5b1a7fc700 1 --2- 172.21.15.72:0/4249190613 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b1c09e000 0x7f5b1c122920 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5b10000f60 tx=0x7f5b1000c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.836+0000 7f5b037fe700 1 -- 172.21.15.72:0/4249190613 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b100052d0 con 0x7f5b1c09e000 2023-10-03T10:12:44.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.837+0000 7f5b037fe700 1 -- 172.21.15.72:0/4249190613 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b10005430 con 0x7f5b1c09e000 2023-10-03T10:12:44.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.837+0000 7f5b2176f700 1 -- 172.21.15.72:0/4249190613 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1c125f00 con 0x7f5b1c09e000 2023-10-03T10:12:44.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.837+0000 7f5b037fe700 1 -- 172.21.15.72:0/4249190613 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b100038c0 con 0x7f5b1c09e000 2023-10-03T10:12:44.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.837+0000 7f5b2176f700 1 -- 172.21.15.72:0/4249190613 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1c125c20 con 0x7f5b1c09e000 2023-10-03T10:12:44.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.838+0000 7f5b037fe700 1 -- 172.21.15.72:0/4249190613 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5b10003a20 con 0x7f5b1c09e000 2023-10-03T10:12:44.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.838+0000 7f5b2176f700 1 -- 172.21.15.72:0/4249190613 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1c074ea0 con 0x7f5b1c09e000 2023-10-03T10:12:44.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.838+0000 7f5b1affd700 1 -- 172.21.15.72:0/4249190613 >> v1:172.21.15.72:6816/126756 conn(0x7f5b0802f510 legacy=0x7f5b080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:44.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.838+0000 7f5b037fe700 1 -- 172.21.15.72:0/4249190613 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f5b100473b0 con 0x7f5b1c09e000 2023-10-03T10:12:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.843+0000 7f5b037fe700 1 -- 172.21.15.72:0/4249190613 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b10011590 con 0x7f5b1c09e000 2023-10-03T10:12:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.874+0000 7f0cd20c2700 1 Processor -- start 2023-10-03T10:12:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.874+0000 7f0cd20c2700 1 -- start start 2023-10-03T10:12:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.874+0000 7f0cd20c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ccc09d630 0x7f0ccc0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.874+0000 7f0cd20c2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ccc138d80 0x7f0ccc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.874+0000 7f0cd20c2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ccc0a2a70 con 0x7f0ccc0a0a30 2023-10-03T10:12:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.874+0000 7f0cd20c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc0a01d0 con 0x7f0ccc09d630 2023-10-03T10:12:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.874+0000 7f0cd20c2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc09e2b0 con 0x7f0ccc138d80 2023-10-03T10:12:44.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.874+0000 7f0ccaffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ccc09d630 0x7f0ccc0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.874+0000 7f0ccb7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0ccc0a0a30 0x7f0ccc0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51184/0 (socket says 172.21.15.72:51184) 2023-10-03T10:12:44.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.874+0000 7f0ccb7fe700 1 -- 172.21.15.72:0/113199482 learned_addr learned my addr 172.21.15.72:0/113199482 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:44.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.874+0000 7f0ccbfff700 1 --2- 172.21.15.72:0/113199482 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ccc138d80 0x7f0ccc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.875+0000 7f0ccbfff700 1 -- 172.21.15.72:0/113199482 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ccc09d630 msgr2=0x7f0ccc0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.875+0000 7f0ccbfff700 1 --2- 172.21.15.72:0/113199482 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ccc09d630 0x7f0ccc0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.875+0000 7f0ccbfff700 1 -- 172.21.15.72:0/113199482 >> v1:172.21.15.72:6789/0 conn(0x7f0ccc0a0a30 legacy=0x7f0ccc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.875+0000 7f0cca7fc700 1 -- 172.21.15.72:0/113199482 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206282221 0 0) 0x7f0ccc0a2a70 con 0x7f0ccc0a0a30 2023-10-03T10:12:44.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.875+0000 7f0ccbfff700 1 -- 172.21.15.72:0/113199482 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc09dc50 con 0x7f0ccc138d80 2023-10-03T10:12:44.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.875+0000 7f0ccaffd700 1 --2- 172.21.15.72:0/113199482 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ccc09d630 0x7f0ccc0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:44.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.875+0000 7f0ccbfff700 1 --2- 172.21.15.72:0/113199482 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ccc138d80 0x7f0ccc13b160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4009dc0 tx=0x7f0cc400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9e9a4142c826542 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.875+0000 7f0cca7fc700 1 -- 172.21.15.72:0/113199482 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc400e070 con 0x7f0ccc138d80 2023-10-03T10:12:44.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.875+0000 7f0cca7fc700 1 -- 172.21.15.72:0/113199482 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc400bb20 con 0x7f0ccc138d80 2023-10-03T10:12:44.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.875+0000 7f0cca7fc700 1 -- 172.21.15.72:0/113199482 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4012430 con 0x7f0ccc138d80 2023-10-03T10:12:44.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.876+0000 7f0cd20c2700 1 -- 172.21.15.72:0/113199482 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ccc138d80 msgr2=0x7f0ccc13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.876+0000 7f0cd20c2700 1 --2- 172.21.15.72:0/113199482 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ccc138d80 0x7f0ccc13b160 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4009dc0 tx=0x7f0cc400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:44.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.876+0000 7f0cd20c2700 1 -- 172.21.15.72:0/113199482 shutdown_connections 2023-10-03T10:12:44.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.876+0000 7f0cd20c2700 1 --2- 172.21.15.72:0/113199482 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ccc138d80 0x7f0ccc13b160 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.876+0000 7f0cd20c2700 1 --2- 172.21.15.72:0/113199482 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ccc09d630 0x7f0ccc0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.876+0000 7f0cd20c2700 1 -- 172.21.15.72:0/113199482 >> 172.21.15.72:0/113199482 conn(0x7f0ccc0a3050 msgr2=0x7f0ccc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.876+0000 7f0cd20c2700 1 -- 172.21.15.72:0/113199482 shutdown_connections 2023-10-03T10:12:44.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.876+0000 7f0cd20c2700 1 -- 172.21.15.72:0/113199482 wait complete. 2023-10-03T10:12:44.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.877+0000 7f0cd20c2700 1 Processor -- start 2023-10-03T10:12:44.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.877+0000 7f0cd20c2700 1 -- start start 2023-10-03T10:12:44.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.877+0000 7f0cd20c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ccc09d630 0x7f0ccc1336e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.877+0000 7f0cd20c2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ccc0a0a30 0x7f0ccc133c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.877+0000 7f0cd20c2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ccc138d80 0x7f0ccc134160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.877+0000 7f0cd20c2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc136170 con 0x7f0ccc138d80 2023-10-03T10:12:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.877+0000 7f0cd20c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc134b40 con 0x7f0ccc09d630 2023-10-03T10:12:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.877+0000 7f0cd20c2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc136e90 con 0x7f0ccc0a0a30 2023-10-03T10:12:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0ccaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ccc0a0a30 0x7f0ccc133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0ccaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ccc0a0a30 0x7f0ccc133c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45808/0 (socket says 172.21.15.72:45808) 2023-10-03T10:12:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0ccaffd700 1 -- 172.21.15.72:0/2772174301 learned_addr learned my addr 172.21.15.72:0/2772174301 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0ccbfff700 1 --2- 172.21.15.72:0/2772174301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ccc138d80 0x7f0ccc134160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0ccb7fe700 1 --2- 172.21.15.72:0/2772174301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ccc09d630 0x7f0ccc1336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0ccaffd700 1 -- 172.21.15.72:0/2772174301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ccc09d630 msgr2=0x7f0ccc1336e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0ccaffd700 1 --2- 172.21.15.72:0/2772174301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ccc09d630 0x7f0ccc1336e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0ccaffd700 1 -- 172.21.15.72:0/2772174301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ccc138d80 msgr2=0x7f0ccc134160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0ccaffd700 1 --2- 172.21.15.72:0/2772174301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ccc138d80 0x7f0ccc134160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0ccaffd700 1 -- 172.21.15.72:0/2772174301 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc00094a0 con 0x7f0ccc0a0a30 2023-10-03T10:12:44.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0ccaffd700 1 --2- 172.21.15.72:0/2772174301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ccc0a0a30 0x7f0ccc133c20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000ebe0 tx=0x7f0cc000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0cb3fff700 1 -- 172.21.15.72:0/2772174301 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0009800 con 0x7f0ccc0a0a30 2023-10-03T10:12:44.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0cb3fff700 1 -- 172.21.15.72:0/2772174301 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc000c8b0 con 0x7f0ccc0a0a30 2023-10-03T10:12:44.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0cb3fff700 1 -- 172.21.15.72:0/2772174301 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc000cc20 con 0x7f0ccc0a0a30 2023-10-03T10:12:44.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0cd20c2700 1 -- 172.21.15.72:0/2772174301 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc4009a70 con 0x7f0ccc0a0a30 2023-10-03T10:12:44.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.878+0000 7f0cd20c2700 1 -- 172.21.15.72:0/2772174301 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ccc0a0410 con 0x7f0ccc0a0a30 2023-10-03T10:12:44.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.880+0000 7f0cd20c2700 1 -- 172.21.15.72:0/2772174301 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ccc136580 con 0x7f0ccc0a0a30 2023-10-03T10:12:44.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.880+0000 7f0cb3fff700 1 -- 172.21.15.72:0/2772174301 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0cc000cd80 con 0x7f0ccc0a0a30 2023-10-03T10:12:44.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.880+0000 7f0cb3fff700 1 -- 172.21.15.72:0/2772174301 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f0cc0040590 con 0x7f0ccc0a0a30 2023-10-03T10:12:44.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.880+0000 7f0ccb7fe700 1 -- 172.21.15.72:0/2772174301 >> v1:172.21.15.72:6816/126756 conn(0x7f0cb802f510 legacy=0x7f0cb80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:44.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.888+0000 7f0cb3fff700 1 -- 172.21.15.72:0/2772174301 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cc0011350 con 0x7f0ccc0a0a30 2023-10-03T10:12:44.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.918+0000 7f6938158700 1 Processor -- start 2023-10-03T10:12:44.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.918+0000 7f6938158700 1 -- start start 2023-10-03T10:12:44.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f6938158700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f693009e930 0x7f693009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f6938158700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f693009f240 0x7f69301317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f6938158700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f693009f650 0x7f6930131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f6938158700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6930070940 con 0x7f693009f240 2023-10-03T10:12:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f6938158700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693006fd60 con 0x7f693009e930 2023-10-03T10:12:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f6938158700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f693006fa80 con 0x7f693009f650 2023-10-03T10:12:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f6935ef4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f693009e930 0x7f693009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f6935ef4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f693009e930 0x7f693009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54164/0 (socket says 172.21.15.72:54164) 2023-10-03T10:12:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f6935ef4700 1 -- 172.21.15.72:0/1627040901 learned_addr learned my addr 172.21.15.72:0/1627040901 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f69356f3700 1 --2- 172.21.15.72:0/1627040901 >> v2:172.21.15.72:3300/0 conn(0x7f693009f240 0x7f69301317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f69366f5700 1 --2- 172.21.15.72:0/1627040901 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f693009f650 0x7f6930131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f69356f3700 1 -- 172.21.15.72:0/1627040901 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f693009f650 msgr2=0x7f6930131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f69356f3700 1 --2- 172.21.15.72:0/1627040901 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f693009f650 0x7f6930131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f69356f3700 1 -- 172.21.15.72:0/1627040901 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f693009e930 msgr2=0x7f693009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f69356f3700 1 --2- 172.21.15.72:0/1627040901 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f693009e930 0x7f693009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f69356f3700 1 -- 172.21.15.72:0/1627040901 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693009fb60 con 0x7f693009f240 2023-10-03T10:12:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f69366f5700 1 --2- 172.21.15.72:0/1627040901 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f693009f650 0x7f6930131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f69356f3700 1 --2- 172.21.15.72:0/1627040901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f693009f240 0x7f69301317f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6920009840 tx=0x7f6920009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70b4abf908758fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.919+0000 7f6934ef2700 1 -- 172.21.15.72:0/1627040901 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920011830 con 0x7f693009f240 2023-10-03T10:12:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.920+0000 7f6934ef2700 1 -- 172.21.15.72:0/1627040901 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6920011990 con 0x7f693009f240 2023-10-03T10:12:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.920+0000 7f6934ef2700 1 -- 172.21.15.72:0/1627040901 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920011d20 con 0x7f693009f240 2023-10-03T10:12:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.920+0000 7f6938158700 1 -- 172.21.15.72:0/1627040901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f693009f240 msgr2=0x7f69301317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.920+0000 7f6938158700 1 --2- 172.21.15.72:0/1627040901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f693009f240 0x7f69301317f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6920009840 tx=0x7f6920009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.920+0000 7f6938158700 1 -- 172.21.15.72:0/1627040901 shutdown_connections 2023-10-03T10:12:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.920+0000 7f6938158700 1 --2- 172.21.15.72:0/1627040901 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f693009f650 0x7f6930131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.920+0000 7f6938158700 1 --2- 172.21.15.72:0/1627040901 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f693009e930 0x7f693009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.920+0000 7f6938158700 1 --2- 172.21.15.72:0/1627040901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f693009f240 0x7f69301317f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.920+0000 7f6938158700 1 -- 172.21.15.72:0/1627040901 >> 172.21.15.72:0/1627040901 conn(0x7f69300a4210 msgr2=0x7f69300a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.920+0000 7f6938158700 1 -- 172.21.15.72:0/1627040901 shutdown_connections 2023-10-03T10:12:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.920+0000 7f6938158700 1 -- 172.21.15.72:0/1627040901 wait complete. 2023-10-03T10:12:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.921+0000 7f6938158700 1 Processor -- start 2023-10-03T10:12:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.921+0000 7f6938158700 1 -- start start 2023-10-03T10:12:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f6938158700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f693009e930 0x7f693006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f6938158700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f693009f240 0x7f693006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f6938158700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f693009f650 0x7f693006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f6938158700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693006cd80 con 0x7f693009f240 2023-10-03T10:12:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f6938158700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69301a99b0 con 0x7f693009e930 2023-10-03T10:12:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f6938158700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69301b72f0 con 0x7f693009f650 2023-10-03T10:12:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f6935ef4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f693009e930 0x7f693006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f69366f5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f693009f650 0x7f693006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f69366f5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f693009f650 0x7f693006c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45830/0 (socket says 172.21.15.72:45830) 2023-10-03T10:12:44.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f6935ef4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f693009e930 0x7f693006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54170/0 (socket says 172.21.15.72:54170) 2023-10-03T10:12:44.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f69366f5700 1 -- 172.21.15.72:0/3583181561 learned_addr learned my addr 172.21.15.72:0/3583181561 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:44.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f69356f3700 1 --2- 172.21.15.72:0/3583181561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f693009f240 0x7f693006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:44.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f69366f5700 1 -- 172.21.15.72:0/3583181561 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f693009e930 msgr2=0x7f693006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f69366f5700 1 --2- 172.21.15.72:0/3583181561 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f693009e930 0x7f693006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f69366f5700 1 -- 172.21.15.72:0/3583181561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f693009f240 msgr2=0x7f693006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:44.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f69366f5700 1 --2- 172.21.15.72:0/3583181561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f693009f240 0x7f693006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:44.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f69366f5700 1 -- 172.21.15.72:0/3583181561 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6928009a70 con 0x7f693009f650 2023-10-03T10:12:44.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f69366f5700 1 --2- 172.21.15.72:0/3583181561 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f693009f650 0x7f693006c330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f692800efc0 tx=0x7f692800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:44.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.922+0000 7f69267fc700 1 -- 172.21.15.72:0/3583181561 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692800cc90 con 0x7f693009f650 2023-10-03T10:12:44.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.923+0000 7f6938158700 1 -- 172.21.15.72:0/3583181561 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69200094a0 con 0x7f693009f650 2023-10-03T10:12:44.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.923+0000 7f69267fc700 1 -- 172.21.15.72:0/3583181561 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692800f040 con 0x7f693009f650 2023-10-03T10:12:44.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.923+0000 7f69267fc700 1 -- 172.21.15.72:0/3583181561 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6928014480 con 0x7f693009f650 2023-10-03T10:12:44.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.923+0000 7f6938158700 1 -- 172.21.15.72:0/3583181561 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69300a0190 con 0x7f693009f650 2023-10-03T10:12:44.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.924+0000 7f69267fc700 1 -- 172.21.15.72:0/3583181561 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6928014600 con 0x7f693009f650 2023-10-03T10:12:44.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.924+0000 7f6938158700 1 -- 172.21.15.72:0/3583181561 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69301a8710 con 0x7f693009f650 2023-10-03T10:12:44.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.924+0000 7f6935ef4700 1 -- 172.21.15.72:0/3583181561 >> v1:172.21.15.72:6816/126756 conn(0x7f691402f510 legacy=0x7f69140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:44.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.924+0000 7f69267fc700 1 -- 172.21.15.72:0/3583181561 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f6928040750 con 0x7f693009f650 2023-10-03T10:12:44.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.928+0000 7f69267fc700 1 -- 172.21.15.72:0/3583181561 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f69280248f0 con 0x7f693009f650 2023-10-03T10:12:44.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:44.994+0000 7f0451d9b700 1 -- 172.21.15.72:0/248266817 >> v1:172.21.15.72:6816/126756 conn(0x7f043402f510 legacy=0x7f04340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:45.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.039+0000 7f5b1affd700 1 -- 172.21.15.72:0/4249190613 >> v1:172.21.15.72:6816/126756 conn(0x7f5b0802f510 legacy=0x7f5b080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:45.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.069+0000 7f0458a46700 1 -- 172.21.15.72:0/248266817 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0454070310 con 0x7f045409d6f0 2023-10-03T10:12:45.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.070+0000 7f0442ffd700 1 -- 172.21.15.72:0/248266817 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f044401a2c0 con 0x7f045409d6f0 2023-10-03T10:12:45.070 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:45.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.072+0000 7f0458a46700 1 -- 172.21.15.72:0/248266817 >> v1:172.21.15.72:6816/126756 conn(0x7f043402f510 legacy=0x7f04340319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:45.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.072+0000 7f0458a46700 1 -- 172.21.15.72:0/248266817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f045409d6f0 msgr2=0x7f045406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.072+0000 7f0458a46700 1 --2- 172.21.15.72:0/248266817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f045409d6f0 0x7f045406e870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f044400eed0 tx=0x7f044400b390 comp rx=0 tx=0).stop 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.072+0000 7f0458a46700 1 -- 172.21.15.72:0/248266817 shutdown_connections 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.072+0000 7f0458a46700 1 --2- 172.21.15.72:0/248266817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f045409e410 0x7f045406f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.072+0000 7f0458a46700 1 --2- 172.21.15.72:0/248266817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f045409d6f0 0x7f045406e870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.072+0000 7f0458a46700 1 --2- 172.21.15.72:0/248266817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f045409e000 0x7f045406edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.072+0000 7f0458a46700 1 -- 172.21.15.72:0/248266817 >> 172.21.15.72:0/248266817 conn(0x7f0454066f50 msgr2=0x7f0454070ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.072+0000 7f0458a46700 1 -- 172.21.15.72:0/248266817 shutdown_connections 2023-10-03T10:12:45.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.072+0000 7f0458a46700 1 -- 172.21.15.72:0/248266817 wait complete. 2023-10-03T10:12:45.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.081+0000 7f0ccb7fe700 1 -- 172.21.15.72:0/2772174301 >> v1:172.21.15.72:6816/126756 conn(0x7f0cb802f510 legacy=0x7f0cb80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:45.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:45.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.102+0000 7f0cd20c2700 1 -- 172.21.15.72:0/2772174301 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0ccc0747f0 con 0x7f0ccc0a0a30 2023-10-03T10:12:45.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.102+0000 7f5b2176f700 1 -- 172.21.15.72:0/4249190613 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5b1c06c360 con 0x7f5b1c09e000 2023-10-03T10:12:45.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.102+0000 7f0cb3fff700 1 -- 172.21.15.72:0/2772174301 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cc00123d0 con 0x7f0ccc0a0a30 2023-10-03T10:12:45.103 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:45.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.102+0000 7f5b037fe700 1 -- 172.21.15.72:0/4249190613 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b10017020 con 0x7f5b1c09e000 2023-10-03T10:12:45.104 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:45.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f0cd20c2700 1 -- 172.21.15.72:0/2772174301 >> v1:172.21.15.72:6816/126756 conn(0x7f0cb802f510 legacy=0x7f0cb80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:45.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f0cd20c2700 1 -- 172.21.15.72:0/2772174301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ccc0a0a30 msgr2=0x7f0ccc133c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f0cd20c2700 1 --2- 172.21.15.72:0/2772174301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ccc0a0a30 0x7f0ccc133c20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000ebe0 tx=0x7f0cc000eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f0cd20c2700 1 -- 172.21.15.72:0/2772174301 shutdown_connections 2023-10-03T10:12:45.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f0cd20c2700 1 --2- 172.21.15.72:0/2772174301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ccc138d80 0x7f0ccc134160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f0cd20c2700 1 --2- 172.21.15.72:0/2772174301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ccc09d630 0x7f0ccc1336e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f0cd20c2700 1 --2- 172.21.15.72:0/2772174301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ccc0a0a30 0x7f0ccc133c20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f0cd20c2700 1 -- 172.21.15.72:0/2772174301 >> 172.21.15.72:0/2772174301 conn(0x7f0ccc0a3050 msgr2=0x7f0ccc13ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f5b2176f700 1 -- 172.21.15.72:0/4249190613 >> v1:172.21.15.72:6816/126756 conn(0x7f5b0802f510 legacy=0x7f5b080319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:45.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f5b2176f700 1 -- 172.21.15.72:0/4249190613 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b1c09e000 msgr2=0x7f5b1c122920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f5b2176f700 1 --2- 172.21.15.72:0/4249190613 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b1c09e000 0x7f5b1c122920 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5b10000f60 tx=0x7f5b1000c730 comp rx=0 tx=0).stop 2023-10-03T10:12:45.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f5b2176f700 1 -- 172.21.15.72:0/4249190613 shutdown_connections 2023-10-03T10:12:45.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f5b2176f700 1 --2- 172.21.15.72:0/4249190613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b1c09d6f0 0x7f5b1c1223e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f5b2176f700 1 --2- 172.21.15.72:0/4249190613 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b1c09e410 0x7f5b1c122e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f5b2176f700 1 --2- 172.21.15.72:0/4249190613 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b1c09e000 0x7f5b1c122920 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f5b2176f700 1 -- 172.21.15.72:0/4249190613 >> 172.21.15.72:0/4249190613 conn(0x7f5b1c066f50 msgr2=0x7f5b1c130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f0cd20c2700 1 -- 172.21.15.72:0/2772174301 shutdown_connections 2023-10-03T10:12:45.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f0cd20c2700 1 -- 172.21.15.72:0/2772174301 wait complete. 2023-10-03T10:12:45.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f5b2176f700 1 -- 172.21.15.72:0/4249190613 shutdown_connections 2023-10-03T10:12:45.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.105+0000 7f5b2176f700 1 -- 172.21.15.72:0/4249190613 wait complete. 2023-10-03T10:12:45.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:45.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:45.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.125+0000 7f6935ef4700 1 -- 172.21.15.72:0/3583181561 >> v1:172.21.15.72:6816/126756 conn(0x7f691402f510 legacy=0x7f69140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:45.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.140+0000 7f6938158700 1 -- 172.21.15.72:0/3583181561 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f69300a3530 con 0x7f693009f650 2023-10-03T10:12:45.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.140+0000 7f69267fc700 1 -- 172.21.15.72:0/3583181561 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6928024300 con 0x7f693009f650 2023-10-03T10:12:45.141 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:45.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.143+0000 7f6938158700 1 -- 172.21.15.72:0/3583181561 >> v1:172.21.15.72:6816/126756 conn(0x7f691402f510 legacy=0x7f69140319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:45.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.143+0000 7f6938158700 1 -- 172.21.15.72:0/3583181561 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f693009f650 msgr2=0x7f693006c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:45.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.143+0000 7f6938158700 1 --2- 172.21.15.72:0/3583181561 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f693009f650 0x7f693006c330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f692800efc0 tx=0x7f692800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.143+0000 7f6938158700 1 -- 172.21.15.72:0/3583181561 shutdown_connections 2023-10-03T10:12:45.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.143+0000 7f6938158700 1 --2- 172.21.15.72:0/3583181561 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f693009f650 0x7f693006c330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.143+0000 7f6938158700 1 --2- 172.21.15.72:0/3583181561 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f693009e930 0x7f693006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.143+0000 7f6938158700 1 --2- 172.21.15.72:0/3583181561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f693009f240 0x7f693006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:45.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.143+0000 7f6938158700 1 -- 172.21.15.72:0/3583181561 >> 172.21.15.72:0/3583181561 conn(0x7f69300a4210 msgr2=0x7f69301b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:45.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.143+0000 7f6938158700 1 -- 172.21.15.72:0/3583181561 shutdown_connections 2023-10-03T10:12:45.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:45.143+0000 7f6938158700 1 -- 172.21.15.72:0/3583181561 wait complete. 2023-10-03T10:12:45.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:46.086 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:46.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:46.120 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:46.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:46.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.229+0000 7f34b116f700 1 Processor -- start 2023-10-03T10:12:46.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.229+0000 7f34b116f700 1 -- start start 2023-10-03T10:12:46.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.229+0000 7f34b116f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34ac09d6f0 0x7f34ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.229+0000 7f34b116f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34ac09e000 0x7f34ac1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.229+0000 7f34b116f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac09b120 con 0x7f34ac09e410 2023-10-03T10:12:46.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.229+0000 7f34b116f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac06b460 con 0x7f34ac09e000 2023-10-03T10:12:46.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.229+0000 7f34b116f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac09a7e0 con 0x7f34ac09d6f0 2023-10-03T10:12:46.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.230+0000 7f34aa59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34ac09e000 0x7f34ac1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.230+0000 7f34ab59e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f34ac09e410 0x7f34ac133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51190/0 (socket says 172.21.15.72:51190) 2023-10-03T10:12:46.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.230+0000 7f34ab59e700 1 -- 172.21.15.72:0/2251729357 learned_addr learned my addr 172.21.15.72:0/2251729357 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:46.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.230+0000 7f34aad9d700 1 --2- 172.21.15.72:0/2251729357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34ac09d6f0 0x7f34ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.230+0000 7f34a9d9b700 1 -- 172.21.15.72:0/2251729357 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403165119 0 0) 0x7f34ac09b120 con 0x7f34ac09e410 2023-10-03T10:12:46.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.230+0000 7f34aa59c700 1 -- 172.21.15.72:0/2251729357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34ac09d6f0 msgr2=0x7f34ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.230+0000 7f34aa59c700 1 --2- 172.21.15.72:0/2251729357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34ac09d6f0 0x7f34ac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.230+0000 7f34aa59c700 1 -- 172.21.15.72:0/2251729357 >> v1:172.21.15.72:6789/0 conn(0x7f34ac09e410 legacy=0x7f34ac133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.230+0000 7f34aa59c700 1 -- 172.21.15.72:0/2251729357 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac09a500 con 0x7f34ac09e000 2023-10-03T10:12:46.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.230+0000 7f34aad9d700 1 --2- 172.21.15.72:0/2251729357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34ac09d6f0 0x7f34ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:46.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.230+0000 7f34aa59c700 1 --2- 172.21.15.72:0/2251729357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac09e000 0x7f34ac1339f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009840 tx=0x7f34a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7836a45f35ea25a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.230+0000 7f34a9d9b700 1 -- 172.21.15.72:0/2251729357 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0011830 con 0x7f34ac09e000 2023-10-03T10:12:46.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.230+0000 7f34a9d9b700 1 -- 172.21.15.72:0/2251729357 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a0011990 con 0x7f34ac09e000 2023-10-03T10:12:46.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.230+0000 7f34a9d9b700 1 -- 172.21.15.72:0/2251729357 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0011d20 con 0x7f34ac09e000 2023-10-03T10:12:46.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.231+0000 7f34b116f700 1 -- 172.21.15.72:0/2251729357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac09e000 msgr2=0x7f34ac1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.231+0000 7f34b116f700 1 --2- 172.21.15.72:0/2251729357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac09e000 0x7f34ac1339f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009840 tx=0x7f34a0009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:46.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.231+0000 7f34b116f700 1 -- 172.21.15.72:0/2251729357 shutdown_connections 2023-10-03T10:12:46.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.231+0000 7f34b116f700 1 --2- 172.21.15.72:0/2251729357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34ac09d6f0 0x7f34ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.231+0000 7f34b116f700 1 --2- 172.21.15.72:0/2251729357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac09e000 0x7f34ac1339f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.231+0000 7f34b116f700 1 -- 172.21.15.72:0/2251729357 >> 172.21.15.72:0/2251729357 conn(0x7f34ac066f50 msgr2=0x7f34ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.231+0000 7f34b116f700 1 -- 172.21.15.72:0/2251729357 shutdown_connections 2023-10-03T10:12:46.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.231+0000 7f34b116f700 1 -- 172.21.15.72:0/2251729357 wait complete. 2023-10-03T10:12:46.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.233+0000 7f34b116f700 1 Processor -- start 2023-10-03T10:12:46.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.233+0000 7f34b116f700 1 -- start start 2023-10-03T10:12:46.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.234+0000 7f34b116f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34ac09d6f0 0x7f34ac1c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.234+0000 7f34b116f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac09e000 0x7f34ac1c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.234+0000 7f34b116f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34ac09e410 0x7f34ac1c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.234+0000 7f34b116f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac1a64d0 con 0x7f34ac09e000 2023-10-03T10:12:46.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.234+0000 7f34b116f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac1a6b20 con 0x7f34ac09e410 2023-10-03T10:12:46.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.234+0000 7f34b116f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac1a83e0 con 0x7f34ac09d6f0 2023-10-03T10:12:46.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.234+0000 7f34aad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34ac09d6f0 0x7f34ac1c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.234+0000 7f34aa59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac09e000 0x7f34ac1c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.234+0000 7f34aad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34ac09d6f0 0x7f34ac1c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45846/0 (socket says 172.21.15.72:45846) 2023-10-03T10:12:46.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.234+0000 7f34aad9d700 1 -- 172.21.15.72:0/2057117902 learned_addr learned my addr 172.21.15.72:0/2057117902 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:46.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.234+0000 7f34ab59e700 1 --2- 172.21.15.72:0/2057117902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34ac09e410 0x7f34ac1c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.234+0000 7f34aad9d700 1 -- 172.21.15.72:0/2057117902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34ac09e410 msgr2=0x7f34ac1c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.235+0000 7f34aad9d700 1 --2- 172.21.15.72:0/2057117902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34ac09e410 0x7f34ac1c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.235+0000 7f34aad9d700 1 -- 172.21.15.72:0/2057117902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac09e000 msgr2=0x7f34ac1c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.235+0000 7f34aad9d700 1 --2- 172.21.15.72:0/2057117902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac09e000 0x7f34ac1c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.235+0000 7f34aad9d700 1 -- 172.21.15.72:0/2057117902 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c0094a0 con 0x7f34ac09d6f0 2023-10-03T10:12:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.235+0000 7f34ab59e700 1 --2- 172.21.15.72:0/2057117902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34ac09e410 0x7f34ac1c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.235+0000 7f34aad9d700 1 --2- 172.21.15.72:0/2057117902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34ac09d6f0 0x7f34ac1c8050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f349c00ebe0 tx=0x7f349c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.235+0000 7f34937fe700 1 -- 172.21.15.72:0/2057117902 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c00c850 con 0x7f34ac09d6f0 2023-10-03T10:12:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.235+0000 7f34937fe700 1 -- 172.21.15.72:0/2057117902 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c00c9b0 con 0x7f34ac09d6f0 2023-10-03T10:12:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.235+0000 7f34b116f700 1 -- 172.21.15.72:0/2057117902 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a00094a0 con 0x7f34ac09d6f0 2023-10-03T10:12:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.235+0000 7f34937fe700 1 -- 172.21.15.72:0/2057117902 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c00cd40 con 0x7f34ac09d6f0 2023-10-03T10:12:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.235+0000 7f34b116f700 1 -- 172.21.15.72:0/2057117902 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac1a8100 con 0x7f34ac09d6f0 2023-10-03T10:12:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.236+0000 7f34937fe700 1 -- 172.21.15.72:0/2057117902 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f349c013470 con 0x7f34ac09d6f0 2023-10-03T10:12:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.236+0000 7f34b116f700 1 -- 172.21.15.72:0/2057117902 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac1a6d20 con 0x7f34ac09d6f0 2023-10-03T10:12:46.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.240+0000 7f34aa59c700 1 -- 172.21.15.72:0/2057117902 >> v1:172.21.15.72:6816/126756 conn(0x7f349802f510 legacy=0x7f34980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:46.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.240+0000 7f34937fe700 1 -- 172.21.15.72:0/2057117902 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f349c012d90 con 0x7f34ac09d6f0 2023-10-03T10:12:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.245+0000 7f34937fe700 1 -- 172.21.15.72:0/2057117902 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f349c045060 con 0x7f34ac09d6f0 2023-10-03T10:12:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.267+0000 7fd2c46e4700 1 Processor -- start 2023-10-03T10:12:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.268+0000 7fd2c46e4700 1 -- start start 2023-10-03T10:12:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.268+0000 7fd2c46e4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2bc06b250 0x7fd2bc136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.268+0000 7fd2c46e4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2bc136d80 0x7fd2bc139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.268+0000 7fd2c46e4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc09ece0 con 0x7fd2bc06a770 2023-10-03T10:12:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.268+0000 7fd2c46e4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc09e760 con 0x7fd2bc06b250 2023-10-03T10:12:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.268+0000 7fd2c46e4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc09e040 con 0x7fd2bc136d80 2023-10-03T10:12:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.268+0000 7fd2c2c81700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2bc136d80 0x7fd2bc139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.268+0000 7fd2c1c7f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2bc06b250 0x7fd2bc136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.268+0000 7fd2c1c7f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2bc06b250 0x7fd2bc136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49546/0 (socket says 172.21.15.72:49546) 2023-10-03T10:12:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.268+0000 7fd2c2c81700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2bc136d80 0x7fd2bc139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45848/0 (socket says 172.21.15.72:45848) 2023-10-03T10:12:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.268+0000 7fd2c1c7f700 1 -- 172.21.15.72:0/631850456 learned_addr learned my addr 172.21.15.72:0/631850456 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.268+0000 7fd2c2480700 1 --1- 172.21.15.72:0/631850456 >> v1:172.21.15.72:6789/0 conn(0x7fd2bc06a770 0x7fd2bc06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51202/0 (socket says 172.21.15.72:51202) 2023-10-03T10:12:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.269+0000 7fd2c1c7f700 1 -- 172.21.15.72:0/631850456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2bc136d80 msgr2=0x7fd2bc139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.269+0000 7fd2c1c7f700 1 --2- 172.21.15.72:0/631850456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2bc136d80 0x7fd2bc139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.269+0000 7fd2c1c7f700 1 -- 172.21.15.72:0/631850456 >> v1:172.21.15.72:6789/0 conn(0x7fd2bc06a770 legacy=0x7fd2bc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.269+0000 7fd2c1c7f700 1 -- 172.21.15.72:0/631850456 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc09f630 con 0x7fd2bc06b250 2023-10-03T10:12:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.269+0000 7fd2c1c7f700 1 --2- 172.21.15.72:0/631850456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc06b250 0x7fd2bc136840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0098f0 tx=0x7fd2ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10f154fa6473e69 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.269+0000 7fd2c147e700 1 -- 172.21.15.72:0/631850456 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac011830 con 0x7fd2bc06b250 2023-10-03T10:12:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.269+0000 7fd2c147e700 1 -- 172.21.15.72:0/631850456 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac011990 con 0x7fd2bc06b250 2023-10-03T10:12:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.269+0000 7fd2c147e700 1 -- 172.21.15.72:0/631850456 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac011d20 con 0x7fd2bc06b250 2023-10-03T10:12:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.270+0000 7fd2c46e4700 1 -- 172.21.15.72:0/631850456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc06b250 msgr2=0x7fd2bc136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.270+0000 7fd2c46e4700 1 --2- 172.21.15.72:0/631850456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc06b250 0x7fd2bc136840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0098f0 tx=0x7fd2ac009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.270+0000 7fd2c46e4700 1 -- 172.21.15.72:0/631850456 shutdown_connections 2023-10-03T10:12:46.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.270+0000 7fd2c46e4700 1 --2- 172.21.15.72:0/631850456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2bc136d80 0x7fd2bc139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.270+0000 7fd2c46e4700 1 --2- 172.21.15.72:0/631850456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc06b250 0x7fd2bc136840 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.270+0000 7fd2c46e4700 1 -- 172.21.15.72:0/631850456 >> 172.21.15.72:0/631850456 conn(0x7fd2bc066f50 msgr2=0x7fd2bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.270+0000 7fd2c46e4700 1 -- 172.21.15.72:0/631850456 shutdown_connections 2023-10-03T10:12:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.270+0000 7fd2c46e4700 1 -- 172.21.15.72:0/631850456 wait complete. 2023-10-03T10:12:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.271+0000 7fd2c46e4700 1 Processor -- start 2023-10-03T10:12:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.271+0000 7fd2c46e4700 1 -- start start 2023-10-03T10:12:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.271+0000 7fd2c46e4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2bc06a770 0x7fd2bc11d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.271+0000 7fd2c46e4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2bc06b250 0x7fd2bc11d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.271+0000 7fd2c46e4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc136d80 0x7fd2bc1c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.271+0000 7fd2c46e4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc11cd30 con 0x7fd2bc136d80 2023-10-03T10:12:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.271+0000 7fd2c46e4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc120000 con 0x7fd2bc06a770 2023-10-03T10:12:46.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.271+0000 7fd2c46e4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc071ed0 con 0x7fd2bc06b250 2023-10-03T10:12:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2c2c81700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc136d80 0x7fd2bc1c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2c2c81700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc136d80 0x7fd2bc1c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49558/0 (socket says 172.21.15.72:49558) 2023-10-03T10:12:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2c2c81700 1 -- 172.21.15.72:0/1780060887 learned_addr learned my addr 172.21.15.72:0/1780060887 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2c2480700 1 --2- 172.21.15.72:0/1780060887 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2bc06a770 0x7fd2bc11d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2c1c7f700 1 --2- 172.21.15.72:0/1780060887 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2bc06b250 0x7fd2bc11d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2c2480700 1 -- 172.21.15.72:0/1780060887 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2bc06b250 msgr2=0x7fd2bc11d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2c2480700 1 --2- 172.21.15.72:0/1780060887 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2bc06b250 0x7fd2bc11d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2c2480700 1 -- 172.21.15.72:0/1780060887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc136d80 msgr2=0x7fd2bc1c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2c2480700 1 --2- 172.21.15.72:0/1780060887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc136d80 0x7fd2bc1c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2c2480700 1 -- 172.21.15.72:0/1780060887 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac009550 con 0x7fd2bc06a770 2023-10-03T10:12:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2c1c7f700 1 --2- 172.21.15.72:0/1780060887 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2bc06b250 0x7fd2bc11d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:46.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2c2480700 1 --2- 172.21.15.72:0/1780060887 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2bc06a770 0x7fd2bc11d340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd2b800c450 tx=0x7fd2b800c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2b2ffd700 1 -- 172.21.15.72:0/1780060887 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8005cb0 con 0x7fd2bc06a770 2023-10-03T10:12:46.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2b2ffd700 1 -- 172.21.15.72:0/1780060887 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b8005e10 con 0x7fd2bc06a770 2023-10-03T10:12:46.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2c46e4700 1 -- 172.21.15.72:0/1780060887 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc11fa80 con 0x7fd2bc06a770 2023-10-03T10:12:46.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.272+0000 7fd2b2ffd700 1 -- 172.21.15.72:0/1780060887 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b80072d0 con 0x7fd2bc06a770 2023-10-03T10:12:46.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.273+0000 7fd2c46e4700 1 -- 172.21.15.72:0/1780060887 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc11e360 con 0x7fd2bc06a770 2023-10-03T10:12:46.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.273+0000 7fd2b2ffd700 1 -- 172.21.15.72:0/1780060887 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd2b8007430 con 0x7fd2bc06a770 2023-10-03T10:12:46.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.274+0000 7fd2b2ffd700 1 -- 172.21.15.72:0/1780060887 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd2b8042220 con 0x7fd2bc06a770 2023-10-03T10:12:46.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.274+0000 7fd2c1c7f700 1 -- 172.21.15.72:0/1780060887 >> v1:172.21.15.72:6816/126756 conn(0x7fd2a002f510 legacy=0x7fd2a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:46.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.274+0000 7fd2c46e4700 1 -- 172.21.15.72:0/1780060887 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc074ea0 con 0x7fd2bc06a770 2023-10-03T10:12:46.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.275+0000 7f5822d20700 1 Processor -- start 2023-10-03T10:12:46.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.275+0000 7f5822d20700 1 -- start start 2023-10-03T10:12:46.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.276+0000 7f5822d20700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c131810 0x7f581c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.276+0000 7f5822d20700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f581c09a580 0x7f581c139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.276+0000 7f5822d20700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f581c1313c0 con 0x7f581c099a40 2023-10-03T10:12:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.276+0000 7f5822d20700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f581c09b580 con 0x7f581c09a580 2023-10-03T10:12:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.276+0000 7f5822d20700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f581c06e8c0 con 0x7f581c131810 2023-10-03T10:12:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.276+0000 7f581bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f581c099a40 0x7f581c099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51210/0 (socket says 172.21.15.72:51210) 2023-10-03T10:12:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.276+0000 7f581bfff700 1 -- 172.21.15.72:0/2993053235 learned_addr learned my addr 172.21.15.72:0/2993053235 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.277+0000 7f58212bd700 1 --2- 172.21.15.72:0/2993053235 >> v2:172.21.15.72:3300/0 conn(0x7f581c09a580 0x7f581c139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.277+0000 7f581b7fe700 1 -- 172.21.15.72:0/2993053235 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299470519 0 0) 0x7f581c1313c0 con 0x7f581c099a40 2023-10-03T10:12:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.277+0000 7f581b7fe700 1 -- 172.21.15.72:0/2993053235 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f580c0035b0 con 0x7f581c099a40 2023-10-03T10:12:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.277+0000 7f58212bd700 1 -- 172.21.15.72:0/2993053235 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c131810 msgr2=0x7f581c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.277+0000 7f58212bd700 1 --2- 172.21.15.72:0/2993053235 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c131810 0x7f581c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.277+0000 7f58212bd700 1 -- 172.21.15.72:0/2993053235 >> v1:172.21.15.72:6789/0 conn(0x7f581c099a40 legacy=0x7f581c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.277+0000 7f58212bd700 1 -- 172.21.15.72:0/2993053235 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c071d20 con 0x7f581c09a580 2023-10-03T10:12:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.277+0000 7f58212bd700 1 --2- 172.21.15.72:0/2993053235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f581c09a580 0x7f581c139660 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5814009d90 tx=0x7f581400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444c085ea6441378 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.277+0000 7f581b7fe700 1 -- 172.21.15.72:0/2993053235 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581400e070 con 0x7f581c09a580 2023-10-03T10:12:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.277+0000 7f581b7fe700 1 -- 172.21.15.72:0/2993053235 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581400bae0 con 0x7f581c09a580 2023-10-03T10:12:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.277+0000 7f581b7fe700 1 -- 172.21.15.72:0/2993053235 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581400be50 con 0x7f581c09a580 2023-10-03T10:12:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.278+0000 7f5822d20700 1 -- 172.21.15.72:0/2993053235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f581c09a580 msgr2=0x7f581c139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.278+0000 7f5822d20700 1 --2- 172.21.15.72:0/2993053235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f581c09a580 0x7f581c139660 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5814009d90 tx=0x7f581400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.278+0000 7f5822d20700 1 -- 172.21.15.72:0/2993053235 shutdown_connections 2023-10-03T10:12:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.278+0000 7f5822d20700 1 --2- 172.21.15.72:0/2993053235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f581c09a580 0x7f581c139660 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.278+0000 7f5822d20700 1 --2- 172.21.15.72:0/2993053235 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c131810 0x7f581c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.278+0000 7f5822d20700 1 -- 172.21.15.72:0/2993053235 >> 172.21.15.72:0/2993053235 conn(0x7f581c0a2aa0 msgr2=0x7f581c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.278+0000 7f5822d20700 1 -- 172.21.15.72:0/2993053235 shutdown_connections 2023-10-03T10:12:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.278+0000 7f5822d20700 1 -- 172.21.15.72:0/2993053235 wait complete. 2023-10-03T10:12:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.280+0000 7f5822d20700 1 Processor -- start 2023-10-03T10:12:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.280+0000 7f5822d20700 1 -- start start 2023-10-03T10:12:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.280+0000 7f5822d20700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c099a40 0x7f581c11b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f5822d20700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09a580 0x7f581c11bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f5822d20700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f581c131810 0x7f581c11c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f5822d20700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c11cd50 con 0x7f581c131810 2023-10-03T10:12:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f5822d20700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581c12ebe0 con 0x7f581c099a40 2023-10-03T10:12:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f5822d20700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f581c11e650 con 0x7f581c09a580 2023-10-03T10:12:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f581bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09a580 0x7f581c11bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f581bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09a580 0x7f581c11bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45886/0 (socket says 172.21.15.72:45886) 2023-10-03T10:12:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f581bfff700 1 -- 172.21.15.72:0/1481386295 learned_addr learned my addr 172.21.15.72:0/1481386295 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f58212bd700 1 --2- 172.21.15.72:0/1481386295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f581c131810 0x7f581c11c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f581bfff700 1 -- 172.21.15.72:0/1481386295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c099a40 msgr2=0x7f581c11b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f581bfff700 1 --2- 172.21.15.72:0/1481386295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c099a40 0x7f581c11b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f581bfff700 1 -- 172.21.15.72:0/1481386295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f581c131810 msgr2=0x7f581c11c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f581bfff700 1 --2- 172.21.15.72:0/1481386295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f581c131810 0x7f581c11c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f581bfff700 1 -- 172.21.15.72:0/1481386295 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5814009a70 con 0x7f581c09a580 2023-10-03T10:12:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f581bfff700 1 --2- 172.21.15.72:0/1481386295 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09a580 0x7f581c11bdc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5808010f70 tx=0x7f5808001b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f58197fa700 1 -- 172.21.15.72:0/1481386295 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580801e070 con 0x7f581c09a580 2023-10-03T10:12:46.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f5822d20700 1 -- 172.21.15.72:0/1481386295 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581c072250 con 0x7f581c09a580 2023-10-03T10:12:46.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f58197fa700 1 -- 172.21.15.72:0/1481386295 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580800d070 con 0x7f581c09a580 2023-10-03T10:12:46.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.281+0000 7f58197fa700 1 -- 172.21.15.72:0/1481386295 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808004ab0 con 0x7f581c09a580 2023-10-03T10:12:46.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.282+0000 7f5822d20700 1 -- 172.21.15.72:0/1481386295 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581c11eaa0 con 0x7f581c09a580 2023-10-03T10:12:46.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.282+0000 7fd2b2ffd700 1 -- 172.21.15.72:0/1780060887 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2b80076e0 con 0x7fd2bc06a770 2023-10-03T10:12:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.282+0000 7f5822d20700 1 -- 172.21.15.72:0/1481386295 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581c11ef70 con 0x7f581c09a580 2023-10-03T10:12:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.283+0000 7f58197fa700 1 -- 172.21.15.72:0/1481386295 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f580800f070 con 0x7f581c09a580 2023-10-03T10:12:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.283+0000 7f58197fa700 1 -- 172.21.15.72:0/1481386295 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f5808047cb0 con 0x7f581c09a580 2023-10-03T10:12:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.283+0000 7f5820abc700 1 -- 172.21.15.72:0/1481386295 >> v1:172.21.15.72:6816/126756 conn(0x7f580002f510 legacy=0x7f58000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:46.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.288+0000 7f58197fa700 1 -- 172.21.15.72:0/1481386295 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58080070d0 con 0x7f581c09a580 2023-10-03T10:12:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.312+0000 7f447cf2d700 1 Processor -- start 2023-10-03T10:12:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.312+0000 7f447cf2d700 1 -- start start 2023-10-03T10:12:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f447cf2d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44781302b0 0x7f44780700d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f447cf2d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f447812c260 0x7f447812c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f447cf2d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4478130090 con 0x7f447812cbb0 2023-10-03T10:12:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f447cf2d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4478070610 con 0x7f44781302b0 2023-10-03T10:12:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f447cf2d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f447809a210 con 0x7f447812c260 2023-10-03T10:12:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f4475d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f447812c260 0x7f447812c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f4475d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f447812c260 0x7f447812c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45898/0 (socket says 172.21.15.72:45898) 2023-10-03T10:12:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f4475d9b700 1 -- 172.21.15.72:0/1606118378 learned_addr learned my addr 172.21.15.72:0/1606118378 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f4476d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f447812cbb0 0x7f4478136b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51214/0 (socket says 172.21.15.72:51214) 2023-10-03T10:12:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f447659c700 1 --2- 172.21.15.72:0/1606118378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44781302b0 0x7f44780700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f4475d9b700 1 -- 172.21.15.72:0/1606118378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44781302b0 msgr2=0x7f44780700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:46.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f4475d9b700 1 --2- 172.21.15.72:0/1606118378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44781302b0 0x7f44780700d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f4475d9b700 1 -- 172.21.15.72:0/1606118378 >> v1:172.21.15.72:6789/0 conn(0x7f447812cbb0 legacy=0x7f4478136b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f447559a700 1 -- 172.21.15.72:0/1606118378 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292366791 0 0) 0x7f4478130090 con 0x7f447812cbb0 2023-10-03T10:12:46.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f4475d9b700 1 -- 172.21.15.72:0/1606118378 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4478099c70 con 0x7f447812c260 2023-10-03T10:12:46.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.313+0000 7f4475d9b700 1 --2- 172.21.15.72:0/1606118378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f447812c260 0x7f447812c670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f446c00b9d0 tx=0x7f446c00bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c65b148bf1daf06c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.314+0000 7f447559a700 1 -- 172.21.15.72:0/1606118378 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c009030 con 0x7f447812c260 2023-10-03T10:12:46.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.314+0000 7f447559a700 1 -- 172.21.15.72:0/1606118378 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446c00cd60 con 0x7f447812c260 2023-10-03T10:12:46.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.314+0000 7f447559a700 1 -- 172.21.15.72:0/1606118378 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c00d690 con 0x7f447812c260 2023-10-03T10:12:46.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.314+0000 7f447cf2d700 1 -- 172.21.15.72:0/1606118378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f447812c260 msgr2=0x7f447812c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.314+0000 7f447cf2d700 1 --2- 172.21.15.72:0/1606118378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f447812c260 0x7f447812c670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f446c00b9d0 tx=0x7f446c00bce0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.314+0000 7f447cf2d700 1 -- 172.21.15.72:0/1606118378 shutdown_connections 2023-10-03T10:12:46.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.314+0000 7f447cf2d700 1 --2- 172.21.15.72:0/1606118378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44781302b0 0x7f44780700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.314+0000 7f447cf2d700 1 --2- 172.21.15.72:0/1606118378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f447812c260 0x7f447812c670 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.314+0000 7f447cf2d700 1 -- 172.21.15.72:0/1606118378 >> 172.21.15.72:0/1606118378 conn(0x7f44780a27f0 msgr2=0x7f44780a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.314+0000 7f447cf2d700 1 -- 172.21.15.72:0/1606118378 shutdown_connections 2023-10-03T10:12:46.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.314+0000 7f447cf2d700 1 -- 172.21.15.72:0/1606118378 wait complete. 2023-10-03T10:12:46.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.316+0000 7f447cf2d700 1 Processor -- start 2023-10-03T10:12:46.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.316+0000 7f447cf2d700 1 -- start start 2023-10-03T10:12:46.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.316+0000 7f447cf2d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f447812c260 0x7f447809ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.316+0000 7f447cf2d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f447812cbb0 0x7f447809d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.316+0000 7f447cf2d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44781302b0 0x7f44781c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:46.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.316+0000 7f447cf2d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4478129920 con 0x7f447812c260 2023-10-03T10:12:46.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.316+0000 7f447cf2d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447809c720 con 0x7f44781302b0 2023-10-03T10:12:46.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.316+0000 7f447cf2d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f447809faa0 con 0x7f447812cbb0 2023-10-03T10:12:46.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.316+0000 7f4475d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f447812cbb0 0x7f447809d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.316+0000 7f4475d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f447812cbb0 0x7f447809d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45914/0 (socket says 172.21.15.72:45914) 2023-10-03T10:12:46.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.316+0000 7f4475d9b700 1 -- 172.21.15.72:0/4205679735 learned_addr learned my addr 172.21.15.72:0/4205679735 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:46.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.316+0000 7f4476d9d700 1 --2- 172.21.15.72:0/4205679735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44781302b0 0x7f44781c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.316+0000 7f447659c700 1 --2- 172.21.15.72:0/4205679735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f447812c260 0x7f447809ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:46.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.317+0000 7f4476d9d700 1 -- 172.21.15.72:0/4205679735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f447812cbb0 msgr2=0x7f447809d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.317+0000 7f4476d9d700 1 --2- 172.21.15.72:0/4205679735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f447812cbb0 0x7f447809d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.317+0000 7f4476d9d700 1 -- 172.21.15.72:0/4205679735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f447812c260 msgr2=0x7f447809ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.317+0000 7f4476d9d700 1 --2- 172.21.15.72:0/4205679735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f447812c260 0x7f447809ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.317+0000 7f4476d9d700 1 -- 172.21.15.72:0/4205679735 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c00b600 con 0x7f44781302b0 2023-10-03T10:12:46.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.317+0000 7f4475d9b700 1 --2- 172.21.15.72:0/4205679735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f447812cbb0 0x7f447809d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:46.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.317+0000 7f4476d9d700 1 --2- 172.21.15.72:0/4205679735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44781302b0 0x7f44781c3db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f447000cbe0 tx=0x7f447000cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:46.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.317+0000 7f4466ffd700 1 -- 172.21.15.72:0/4205679735 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447000aa40 con 0x7f44781302b0 2023-10-03T10:12:46.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.317+0000 7f4466ffd700 1 -- 172.21.15.72:0/4205679735 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447000abc0 con 0x7f44781302b0 2023-10-03T10:12:46.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.317+0000 7f4466ffd700 1 -- 172.21.15.72:0/4205679735 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44700070d0 con 0x7f44781302b0 2023-10-03T10:12:46.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.317+0000 7f447cf2d700 1 -- 172.21.15.72:0/4205679735 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447809e660 con 0x7f44781302b0 2023-10-03T10:12:46.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.317+0000 7f447cf2d700 1 -- 172.21.15.72:0/4205679735 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447809de70 con 0x7f44781302b0 2023-10-03T10:12:46.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.318+0000 7f4466ffd700 1 -- 172.21.15.72:0/4205679735 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4470007230 con 0x7f44781302b0 2023-10-03T10:12:46.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.318+0000 7f447cf2d700 1 -- 172.21.15.72:0/4205679735 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447809d740 con 0x7f44781302b0 2023-10-03T10:12:46.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.318+0000 7f447659c700 1 -- 172.21.15.72:0/4205679735 >> v1:172.21.15.72:6816/126756 conn(0x7f445802f540 legacy=0x7f44580319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:46.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.318+0000 7f4466ffd700 1 -- 172.21.15.72:0/4205679735 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f447003f500 con 0x7f44781302b0 2023-10-03T10:12:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.323+0000 7f4466ffd700 1 -- 172.21.15.72:0/4205679735 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4470019860 con 0x7f44781302b0 2023-10-03T10:12:46.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.441+0000 7f34aa59c700 1 -- 172.21.15.72:0/2057117902 >> v1:172.21.15.72:6816/126756 conn(0x7f349802f510 legacy=0x7f34980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:46.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.448+0000 7f34b116f700 1 -- 172.21.15.72:0/2057117902 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f34ac1a7f60 con 0x7f34ac09d6f0 2023-10-03T10:12:46.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.448+0000 7f34937fe700 1 -- 172.21.15.72:0/2057117902 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f34ac1a7f60 con 0x7f34ac09d6f0 2023-10-03T10:12:46.449 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:46.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.450+0000 7f34b116f700 1 -- 172.21.15.72:0/2057117902 >> v1:172.21.15.72:6816/126756 conn(0x7f349802f510 legacy=0x7f34980319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:46.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.450+0000 7f34b116f700 1 -- 172.21.15.72:0/2057117902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34ac09d6f0 msgr2=0x7f34ac1c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.450+0000 7f34b116f700 1 --2- 172.21.15.72:0/2057117902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34ac09d6f0 0x7f34ac1c8050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f349c00ebe0 tx=0x7f349c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.450+0000 7f34b116f700 1 -- 172.21.15.72:0/2057117902 shutdown_connections 2023-10-03T10:12:46.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.450+0000 7f34b116f700 1 --2- 172.21.15.72:0/2057117902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34ac09e410 0x7f34ac1c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.450+0000 7f34b116f700 1 --2- 172.21.15.72:0/2057117902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34ac09d6f0 0x7f34ac1c8050 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.450+0000 7f34b116f700 1 --2- 172.21.15.72:0/2057117902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34ac09e000 0x7f34ac1c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.450+0000 7f34b116f700 1 -- 172.21.15.72:0/2057117902 >> 172.21.15.72:0/2057117902 conn(0x7f34ac066f50 msgr2=0x7f34ac1bba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.451+0000 7f34b116f700 1 -- 172.21.15.72:0/2057117902 shutdown_connections 2023-10-03T10:12:46.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.451+0000 7f34b116f700 1 -- 172.21.15.72:0/2057117902 wait complete. 2023-10-03T10:12:46.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:46.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.475+0000 7fd2c1c7f700 1 -- 172.21.15.72:0/1780060887 >> v1:172.21.15.72:6816/126756 conn(0x7fd2a002f510 legacy=0x7fd2a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.484+0000 7f5820abc700 1 -- 172.21.15.72:0/1481386295 >> v1:172.21.15.72:6816/126756 conn(0x7f580002f510 legacy=0x7f58000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:46.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.510+0000 7fd2c46e4700 1 -- 172.21.15.72:0/1780060887 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd2bc120240 con 0x7fd2bc06a770 2023-10-03T10:12:46.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.510+0000 7fd2b2ffd700 1 -- 172.21.15.72:0/1780060887 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd2b8011360 con 0x7fd2bc06a770 2023-10-03T10:12:46.511 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:46.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.513+0000 7fd2c46e4700 1 -- 172.21.15.72:0/1780060887 >> v1:172.21.15.72:6816/126756 conn(0x7fd2a002f510 legacy=0x7fd2a00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:46.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.513+0000 7fd2c46e4700 1 -- 172.21.15.72:0/1780060887 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2bc06a770 msgr2=0x7fd2bc11d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.513+0000 7fd2c46e4700 1 --2- 172.21.15.72:0/1780060887 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2bc06a770 0x7fd2bc11d340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd2b800c450 tx=0x7fd2b800c760 comp rx=0 tx=0).stop 2023-10-03T10:12:46.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.513+0000 7fd2c46e4700 1 -- 172.21.15.72:0/1780060887 shutdown_connections 2023-10-03T10:12:46.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.513+0000 7fd2c46e4700 1 --2- 172.21.15.72:0/1780060887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2bc136d80 0x7fd2bc1c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.513+0000 7fd2c46e4700 1 --2- 172.21.15.72:0/1780060887 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2bc06a770 0x7fd2bc11d340 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.513+0000 7fd2c46e4700 1 --2- 172.21.15.72:0/1780060887 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2bc06b250 0x7fd2bc11d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.513+0000 7fd2c46e4700 1 -- 172.21.15.72:0/1780060887 >> 172.21.15.72:0/1780060887 conn(0x7fd2bc066f50 msgr2=0x7fd2bc135e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.513+0000 7fd2c46e4700 1 -- 172.21.15.72:0/1780060887 shutdown_connections 2023-10-03T10:12:46.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.513+0000 7fd2c46e4700 1 -- 172.21.15.72:0/1780060887 wait complete. 2023-10-03T10:12:46.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.516+0000 7f5822d20700 1 -- 172.21.15.72:0/1481386295 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f581c06eb00 con 0x7f581c09a580 2023-10-03T10:12:46.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.516+0000 7f58197fa700 1 -- 172.21.15.72:0/1481386295 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f580802cbd0 con 0x7f581c09a580 2023-10-03T10:12:46.517 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:46.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.518+0000 7f447cf2d700 1 -- 172.21.15.72:0/4205679735 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4478071d90 con 0x7f44781302b0 2023-10-03T10:12:46.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.519+0000 7f4466ffd700 1 -- 172.21.15.72:0/4205679735 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4478071d90 con 0x7f44781302b0 2023-10-03T10:12:46.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.519+0000 7f447659c700 1 -- 172.21.15.72:0/4205679735 >> v1:172.21.15.72:6816/126756 conn(0x7f445802f540 legacy=0x7f44580319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:46.519 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:46.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.520+0000 7f5822d20700 1 -- 172.21.15.72:0/1481386295 >> v1:172.21.15.72:6816/126756 conn(0x7f580002f510 legacy=0x7f58000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:46.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.520+0000 7f5822d20700 1 -- 172.21.15.72:0/1481386295 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09a580 msgr2=0x7f581c11bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.520+0000 7f5822d20700 1 --2- 172.21.15.72:0/1481386295 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09a580 0x7f581c11bdc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5808010f70 tx=0x7f5808001b80 comp rx=0 tx=0).stop 2023-10-03T10:12:46.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.520+0000 7f5822d20700 1 -- 172.21.15.72:0/1481386295 shutdown_connections 2023-10-03T10:12:46.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.520+0000 7f5822d20700 1 --2- 172.21.15.72:0/1481386295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f581c131810 0x7f581c11c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.520+0000 7f5822d20700 1 --2- 172.21.15.72:0/1481386295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c099a40 0x7f581c11b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.520+0000 7f5822d20700 1 --2- 172.21.15.72:0/1481386295 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09a580 0x7f581c11bdc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.520+0000 7f5822d20700 1 -- 172.21.15.72:0/1481386295 >> 172.21.15.72:0/1481386295 conn(0x7f581c0a2aa0 msgr2=0x7f581c09d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.520+0000 7f5822d20700 1 -- 172.21.15.72:0/1481386295 shutdown_connections 2023-10-03T10:12:46.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.520+0000 7f5822d20700 1 -- 172.21.15.72:0/1481386295 wait complete. 2023-10-03T10:12:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.521+0000 7f447cf2d700 1 -- 172.21.15.72:0/4205679735 >> v1:172.21.15.72:6816/126756 conn(0x7f445802f540 legacy=0x7f44580319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.521+0000 7f447cf2d700 1 -- 172.21.15.72:0/4205679735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44781302b0 msgr2=0x7f44781c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.521+0000 7f447cf2d700 1 --2- 172.21.15.72:0/4205679735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44781302b0 0x7f44781c3db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f447000cbe0 tx=0x7f447000cef0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.521+0000 7f447cf2d700 1 -- 172.21.15.72:0/4205679735 shutdown_connections 2023-10-03T10:12:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.521+0000 7f447cf2d700 1 --2- 172.21.15.72:0/4205679735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f447812c260 0x7f447809ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.521+0000 7f447cf2d700 1 --2- 172.21.15.72:0/4205679735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44781302b0 0x7f44781c3db0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.521+0000 7f447cf2d700 1 --2- 172.21.15.72:0/4205679735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f447812cbb0 0x7f447809d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:46.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.521+0000 7f447cf2d700 1 -- 172.21.15.72:0/4205679735 >> 172.21.15.72:0/4205679735 conn(0x7f44780a27f0 msgr2=0x7f447812a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.523+0000 7f447cf2d700 1 -- 172.21.15.72:0/4205679735 shutdown_connections 2023-10-03T10:12:46.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:46.523+0000 7f447cf2d700 1 -- 172.21.15.72:0/4205679735 wait complete. 2023-10-03T10:12:46.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:46.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:46.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:47.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:47.530 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:47.535 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:47.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:47.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.607+0000 7f70c055e700 1 Processor -- start 2023-10-03T10:12:47.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.607+0000 7f70c055e700 1 -- start start 2023-10-03T10:12:47.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.607+0000 7f70c055e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f70b812cf60 0x7f70b806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.607+0000 7f70c055e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70b812f8b0 0x7f70b812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.608+0000 7f70c055e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b8130260 0x7f70b8136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.608+0000 7f70c055e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b812d330 con 0x7f70b812cf60 2023-10-03T10:12:47.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.608+0000 7f70c055e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b812cd90 con 0x7f70b8130260 2023-10-03T10:12:47.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.608+0000 7f70c055e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70b81306d0 con 0x7f70b812f8b0 2023-10-03T10:12:47.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.608+0000 7f70bdaf9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70b812f8b0 0x7f70b812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.608+0000 7f70bdaf9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70b812f8b0 0x7f70b812fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45916/0 (socket says 172.21.15.72:45916) 2023-10-03T10:12:47.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.608+0000 7f70bdaf9700 1 -- 172.21.15.72:0/2647711616 learned_addr learned my addr 172.21.15.72:0/2647711616 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:47.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.608+0000 7f70beafb700 1 --2- 172.21.15.72:0/2647711616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b8130260 0x7f70b8136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.608+0000 7f70be2fa700 1 --2- 172.21.15.72:0/2647711616 >> v2:172.21.15.72:3300/0 conn(0x7f70b812cf60 0x7f70b806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.608+0000 7f70bdaf9700 1 -- 172.21.15.72:0/2647711616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b8130260 msgr2=0x7f70b8136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.608+0000 7f70bdaf9700 1 --2- 172.21.15.72:0/2647711616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b8130260 0x7f70b8136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.608+0000 7f70bdaf9700 1 -- 172.21.15.72:0/2647711616 >> v2:172.21.15.72:3300/0 conn(0x7f70b812cf60 msgr2=0x7f70b806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.608+0000 7f70bdaf9700 1 --2- 172.21.15.72:0/2647711616 >> v2:172.21.15.72:3300/0 conn(0x7f70b812cf60 0x7f70b806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.608+0000 7f70bdaf9700 1 -- 172.21.15.72:0/2647711616 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b8071780 con 0x7f70b812f8b0 2023-10-03T10:12:47.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.608+0000 7f70bdaf9700 1 --2- 172.21.15.72:0/2647711616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70b812f8b0 0x7f70b812fd20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f70a800bbc0 tx=0x7f70a800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15eadbd70462e948 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.609+0000 7f70bd2f8700 1 -- 172.21.15.72:0/2647711616 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a800dbe0 con 0x7f70b812f8b0 2023-10-03T10:12:47.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.609+0000 7f70bd2f8700 1 -- 172.21.15.72:0/2647711616 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a800dd40 con 0x7f70b812f8b0 2023-10-03T10:12:47.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.609+0000 7f70bd2f8700 1 -- 172.21.15.72:0/2647711616 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8017630 con 0x7f70b812f8b0 2023-10-03T10:12:47.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.609+0000 7f70c055e700 1 -- 172.21.15.72:0/2647711616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70b812f8b0 msgr2=0x7f70b812fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.609+0000 7f70c055e700 1 --2- 172.21.15.72:0/2647711616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70b812f8b0 0x7f70b812fd20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f70a800bbc0 tx=0x7f70a800bed0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.609+0000 7f70c055e700 1 -- 172.21.15.72:0/2647711616 shutdown_connections 2023-10-03T10:12:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.609+0000 7f70c055e700 1 --2- 172.21.15.72:0/2647711616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b8130260 0x7f70b8136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.609+0000 7f70c055e700 1 --2- 172.21.15.72:0/2647711616 >> v2:172.21.15.72:3300/0 conn(0x7f70b812cf60 0x7f70b806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.609+0000 7f70c055e700 1 --2- 172.21.15.72:0/2647711616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70b812f8b0 0x7f70b812fd20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.609+0000 7f70c055e700 1 -- 172.21.15.72:0/2647711616 >> 172.21.15.72:0/2647711616 conn(0x7f70b80a2aa0 msgr2=0x7f70b80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.610+0000 7f70c055e700 1 -- 172.21.15.72:0/2647711616 shutdown_connections 2023-10-03T10:12:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.610+0000 7f70c055e700 1 -- 172.21.15.72:0/2647711616 wait complete. 2023-10-03T10:12:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.611+0000 7f70c055e700 1 Processor -- start 2023-10-03T10:12:47.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.611+0000 7f70c055e700 1 -- start start 2023-10-03T10:12:47.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70c055e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b812cf60 0x7f70b809bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70c055e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b812f8b0 0x7f70b809bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70c055e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70b8130260 0x7f70b81c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70c055e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b812dab0 con 0x7f70b812cf60 2023-10-03T10:12:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70c055e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b809c530 con 0x7f70b812f8b0 2023-10-03T10:12:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70c055e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70b809e8d0 con 0x7f70b8130260 2023-10-03T10:12:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70be2fa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b812cf60 0x7f70b809bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70be2fa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b812cf60 0x7f70b809bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49592/0 (socket says 172.21.15.72:49592) 2023-10-03T10:12:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70be2fa700 1 -- 172.21.15.72:0/2705809252 learned_addr learned my addr 172.21.15.72:0/2705809252 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70bdaf9700 1 --2- 172.21.15.72:0/2705809252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b812f8b0 0x7f70b809bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70beafb700 1 --2- 172.21.15.72:0/2705809252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70b8130260 0x7f70b81c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70be2fa700 1 -- 172.21.15.72:0/2705809252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70b8130260 msgr2=0x7f70b81c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70be2fa700 1 --2- 172.21.15.72:0/2705809252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70b8130260 0x7f70b81c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70be2fa700 1 -- 172.21.15.72:0/2705809252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b812f8b0 msgr2=0x7f70b809bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70be2fa700 1 --2- 172.21.15.72:0/2705809252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b812f8b0 0x7f70b809bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70be2fa700 1 -- 172.21.15.72:0/2705809252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a800b7f0 con 0x7f70b812cf60 2023-10-03T10:12:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.612+0000 7f70be2fa700 1 --2- 172.21.15.72:0/2705809252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b812cf60 0x7f70b809bab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f70b400e810 tx=0x7f70b400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.613+0000 7f70aeffd700 1 -- 172.21.15.72:0/2705809252 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b400c070 con 0x7f70b812cf60 2023-10-03T10:12:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.613+0000 7f70aeffd700 1 -- 172.21.15.72:0/2705809252 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b4013610 con 0x7f70b812cf60 2023-10-03T10:12:47.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.613+0000 7f70aeffd700 1 -- 172.21.15.72:0/2705809252 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4013980 con 0x7f70b812cf60 2023-10-03T10:12:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.613+0000 7f70c055e700 1 -- 172.21.15.72:0/2705809252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b8129a00 con 0x7f70b812cf60 2023-10-03T10:12:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.614+0000 7f70c055e700 1 -- 172.21.15.72:0/2705809252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b809b780 con 0x7f70b812cf60 2023-10-03T10:12:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.615+0000 7f70c055e700 1 -- 172.21.15.72:0/2705809252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b809e6d0 con 0x7f70b812cf60 2023-10-03T10:12:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.615+0000 7f70aeffd700 1 -- 172.21.15.72:0/2705809252 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f70b4013ae0 con 0x7f70b812cf60 2023-10-03T10:12:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.615+0000 7f70aeffd700 1 -- 172.21.15.72:0/2705809252 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f70b403f7f0 con 0x7f70b812cf60 2023-10-03T10:12:47.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.615+0000 7f70bdaf9700 1 -- 172.21.15.72:0/2705809252 >> v1:172.21.15.72:6816/126756 conn(0x7f709c02f540 legacy=0x7f709c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:47.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.624+0000 7f70aeffd700 1 -- 172.21.15.72:0/2705809252 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70b400f040 con 0x7f70b812cf60 2023-10-03T10:12:47.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.673+0000 7fa25b968700 1 Processor -- start 2023-10-03T10:12:47.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.673+0000 7fa25b968700 1 -- start start 2023-10-03T10:12:47.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.674+0000 7fa25b968700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa25406f5d0 0x7fa25412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.674+0000 7fa25b968700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa254135c20 0x7fa254138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.674+0000 7fa25b968700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25406fa40 con 0x7fa25412cf60 2023-10-03T10:12:47.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.674+0000 7fa25b968700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25412cd90 con 0x7fa25406f5d0 2023-10-03T10:12:47.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.674+0000 7fa25b968700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa254071780 con 0x7fa254135c20 2023-10-03T10:12:47.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.674+0000 7fa258f03700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa25406f5d0 0x7fa25412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.674+0000 7fa258f03700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa25406f5d0 0x7fa25412ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49602/0 (socket says 172.21.15.72:49602) 2023-10-03T10:12:47.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.674+0000 7fa258f03700 1 -- 172.21.15.72:0/3577884000 learned_addr learned my addr 172.21.15.72:0/3577884000 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:47.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.674+0000 7fa259f05700 1 --2- 172.21.15.72:0/3577884000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa254135c20 0x7fa254138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.674+0000 7fa259f05700 1 -- 172.21.15.72:0/3577884000 >> v2:172.21.15.72:3300/0 conn(0x7fa25406f5d0 msgr2=0x7fa25412ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.674+0000 7fa259f05700 1 --2- 172.21.15.72:0/3577884000 >> v2:172.21.15.72:3300/0 conn(0x7fa25406f5d0 0x7fa25412ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.674+0000 7fa259f05700 1 -- 172.21.15.72:0/3577884000 >> v1:172.21.15.72:6789/0 conn(0x7fa25412cf60 legacy=0x7fa25412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.674+0000 7fa259f05700 1 -- 172.21.15.72:0/3577884000 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa254071a40 con 0x7fa254135c20 2023-10-03T10:12:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.675+0000 7fa259f05700 1 --2- 172.21.15.72:0/3577884000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa254135c20 0x7fa254138000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009e10 tx=0x7fa24c00d540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e97f2ba3121ac7c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.675+0000 7fa24bfff700 1 -- 172.21.15.72:0/3577884000 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c011460 con 0x7fa254135c20 2023-10-03T10:12:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.675+0000 7fa24bfff700 1 -- 172.21.15.72:0/3577884000 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24c0115c0 con 0x7fa254135c20 2023-10-03T10:12:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.675+0000 7fa24bfff700 1 -- 172.21.15.72:0/3577884000 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c011970 con 0x7fa254135c20 2023-10-03T10:12:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.675+0000 7fa25b968700 1 -- 172.21.15.72:0/3577884000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa254135c20 msgr2=0x7fa254138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.675+0000 7fa25b968700 1 --2- 172.21.15.72:0/3577884000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa254135c20 0x7fa254138000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009e10 tx=0x7fa24c00d540 comp rx=0 tx=0).stop 2023-10-03T10:12:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.676+0000 7fa25b968700 1 -- 172.21.15.72:0/3577884000 shutdown_connections 2023-10-03T10:12:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.676+0000 7fa25b968700 1 --2- 172.21.15.72:0/3577884000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa254135c20 0x7fa254138000 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.676+0000 7fa25b968700 1 --2- 172.21.15.72:0/3577884000 >> v2:172.21.15.72:3300/0 conn(0x7fa25406f5d0 0x7fa25412ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.676+0000 7fa25b968700 1 -- 172.21.15.72:0/3577884000 >> 172.21.15.72:0/3577884000 conn(0x7fa2540a2aa0 msgr2=0x7fa2540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.676+0000 7fa25b968700 1 -- 172.21.15.72:0/3577884000 shutdown_connections 2023-10-03T10:12:47.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.676+0000 7fa25b968700 1 -- 172.21.15.72:0/3577884000 wait complete. 2023-10-03T10:12:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.677+0000 7fa25b968700 1 Processor -- start 2023-10-03T10:12:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.677+0000 7fa25b968700 1 -- start start 2023-10-03T10:12:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.677+0000 7fa25b968700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25406f5d0 0x7fa25412e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.677+0000 7fa25b968700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25412cf60 0x7fa25412e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.677+0000 7fa25b968700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa254135c20 0x7fa2541c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.677+0000 7fa25b968700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25412e0b0 con 0x7fa254135c20 2023-10-03T10:12:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.677+0000 7fa25b968700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa254131010 con 0x7fa25406f5d0 2023-10-03T10:12:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.677+0000 7fa25b968700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2541312d0 con 0x7fa25412cf60 2023-10-03T10:12:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.677+0000 7fa258f03700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25412cf60 0x7fa25412e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.677+0000 7fa258f03700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25412cf60 0x7fa25412e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45936/0 (socket says 172.21.15.72:45936) 2023-10-03T10:12:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.677+0000 7fa258f03700 1 -- 172.21.15.72:0/2710928449 learned_addr learned my addr 172.21.15.72:0/2710928449 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.677+0000 7fa259f05700 1 --2- 172.21.15.72:0/2710928449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa254135c20 0x7fa2541c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.677+0000 7fa259704700 1 --2- 172.21.15.72:0/2710928449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25406f5d0 0x7fa25412e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.678+0000 7fa258f03700 1 -- 172.21.15.72:0/2710928449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25406f5d0 msgr2=0x7fa25412e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.678+0000 7fa258f03700 1 --2- 172.21.15.72:0/2710928449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25406f5d0 0x7fa25412e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.678+0000 7fa258f03700 1 -- 172.21.15.72:0/2710928449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa254135c20 msgr2=0x7fa2541c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.678+0000 7fa258f03700 1 --2- 172.21.15.72:0/2710928449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa254135c20 0x7fa2541c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.678+0000 7fa258f03700 1 -- 172.21.15.72:0/2710928449 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c009a70 con 0x7fa25412cf60 2023-10-03T10:12:47.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.678+0000 7fa259f05700 1 --2- 172.21.15.72:0/2710928449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa254135c20 0x7fa2541c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:47.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.678+0000 7fa258f03700 1 --2- 172.21.15.72:0/2710928449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25412cf60 0x7fa25412e870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa244009520 tx=0x7fa24400fcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.678+0000 7fa249ffb700 1 -- 172.21.15.72:0/2710928449 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400c070 con 0x7fa25412cf60 2023-10-03T10:12:47.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.678+0000 7fa249ffb700 1 -- 172.21.15.72:0/2710928449 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24400db60 con 0x7fa25412cf60 2023-10-03T10:12:47.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.678+0000 7fa25b968700 1 -- 172.21.15.72:0/2710928449 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa254131d40 con 0x7fa25412cf60 2023-10-03T10:12:47.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.679+0000 7fa249ffb700 1 -- 172.21.15.72:0/2710928449 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2440096a0 con 0x7fa25412cf60 2023-10-03T10:12:47.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.679+0000 7fa25b968700 1 -- 172.21.15.72:0/2710928449 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25412f880 con 0x7fa25412cf60 2023-10-03T10:12:47.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.680+0000 7fa249ffb700 1 -- 172.21.15.72:0/2710928449 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa244012460 con 0x7fa25412cf60 2023-10-03T10:12:47.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.680+0000 7fa249ffb700 1 -- 172.21.15.72:0/2710928449 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa24403fbe0 con 0x7fa25412cf60 2023-10-03T10:12:47.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.680+0000 7fa259704700 1 -- 172.21.15.72:0/2710928449 >> v1:172.21.15.72:6816/126756 conn(0x7fa23802f560 legacy=0x7fa238031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:47.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.681+0000 7fa25b968700 1 -- 172.21.15.72:0/2710928449 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25412f880 con 0x7fa25412cf60 2023-10-03T10:12:47.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.689+0000 7fa249ffb700 1 -- 172.21.15.72:0/2710928449 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa25412f880 con 0x7fa25412cf60 2023-10-03T10:12:47.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.717+0000 7f3685953700 1 Processor -- start 2023-10-03T10:12:47.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.717+0000 7f3685953700 1 -- start start 2023-10-03T10:12:47.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f3685953700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3680130790 0x7f3680130b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f3685953700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f368006f640 0x7f368006fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f3685953700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f368006ffb0 0x7f36801374f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f3685953700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368009a370 con 0x7f368006ffb0 2023-10-03T10:12:47.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f3685953700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368009ef50 con 0x7f3680130790 2023-10-03T10:12:47.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f3685953700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3680070860 con 0x7f368006f640 2023-10-03T10:12:47.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f367effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3680130790 0x7f3680130b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f367effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3680130790 0x7f3680130b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54232/0 (socket says 172.21.15.72:54232) 2023-10-03T10:12:47.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f367effd700 1 -- 172.21.15.72:0/2313474403 learned_addr learned my addr 172.21.15.72:0/2313474403 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:47.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f367e7fc700 1 --2- 172.21.15.72:0/2313474403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f368006f640 0x7f368006fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f367f7fe700 1 --2- 172.21.15.72:0/2313474403 >> v2:172.21.15.72:3300/0 conn(0x7f368006ffb0 0x7f36801374f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f367e7fc700 1 -- 172.21.15.72:0/2313474403 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3680130790 msgr2=0x7f3680130b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f367e7fc700 1 --2- 172.21.15.72:0/2313474403 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3680130790 0x7f3680130b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f367e7fc700 1 -- 172.21.15.72:0/2313474403 >> v2:172.21.15.72:3300/0 conn(0x7f368006ffb0 msgr2=0x7f36801374f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f367e7fc700 1 --2- 172.21.15.72:0/2313474403 >> v2:172.21.15.72:3300/0 conn(0x7f368006ffb0 0x7f36801374f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f367e7fc700 1 -- 172.21.15.72:0/2313474403 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680070450 con 0x7f368006f640 2023-10-03T10:12:47.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f367f7fe700 1 --2- 172.21.15.72:0/2313474403 >> v2:172.21.15.72:3300/0 conn(0x7f368006ffb0 0x7f36801374f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:47.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f367effd700 1 --2- 172.21.15.72:0/2313474403 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3680130790 0x7f3680130b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:47.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.718+0000 7f367e7fc700 1 --2- 172.21.15.72:0/2313474403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f368006f640 0x7f368006fa70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3674009840 tx=0x7f3674009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=454115015290e2ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.719+0000 7f367dffb700 1 -- 172.21.15.72:0/2313474403 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674011830 con 0x7f368006f640 2023-10-03T10:12:47.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.719+0000 7f367dffb700 1 -- 172.21.15.72:0/2313474403 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3674011990 con 0x7f368006f640 2023-10-03T10:12:47.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.719+0000 7f367dffb700 1 -- 172.21.15.72:0/2313474403 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674011d20 con 0x7f368006f640 2023-10-03T10:12:47.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.719+0000 7f3685953700 1 -- 172.21.15.72:0/2313474403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f368006f640 msgr2=0x7f368006fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.719+0000 7f3685953700 1 --2- 172.21.15.72:0/2313474403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f368006f640 0x7f368006fa70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3674009840 tx=0x7f3674009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:47.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.719+0000 7f3685953700 1 -- 172.21.15.72:0/2313474403 shutdown_connections 2023-10-03T10:12:47.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.719+0000 7f3685953700 1 --2- 172.21.15.72:0/2313474403 >> v2:172.21.15.72:3300/0 conn(0x7f368006ffb0 0x7f36801374f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.719+0000 7f3685953700 1 --2- 172.21.15.72:0/2313474403 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3680130790 0x7f3680130b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.719+0000 7f3685953700 1 --2- 172.21.15.72:0/2313474403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f368006f640 0x7f368006fa70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.719+0000 7f3685953700 1 -- 172.21.15.72:0/2313474403 >> 172.21.15.72:0/2313474403 conn(0x7f36800a2aa0 msgr2=0x7f36800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.719+0000 7f3685953700 1 -- 172.21.15.72:0/2313474403 shutdown_connections 2023-10-03T10:12:47.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.719+0000 7f3685953700 1 -- 172.21.15.72:0/2313474403 wait complete. 2023-10-03T10:12:47.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.721+0000 7f3685953700 1 Processor -- start 2023-10-03T10:12:47.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.721+0000 7f3685953700 1 -- start start 2023-10-03T10:12:47.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f3685953700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f368006f640 0x7f3680135fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f3685953700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368006ffb0 0x7f3680136520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f3685953700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3680130790 0x7f3680136a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f3685953700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3680135dc0 con 0x7f3680130790 2023-10-03T10:12:47.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f3685953700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3680135120 con 0x7f368006ffb0 2023-10-03T10:12:47.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f3685953700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3680139620 con 0x7f368006f640 2023-10-03T10:12:47.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f367e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368006ffb0 0x7f3680136520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f367e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368006ffb0 0x7f3680136520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54246/0 (socket says 172.21.15.72:54246) 2023-10-03T10:12:47.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f367e7fc700 1 -- 172.21.15.72:0/110243511 learned_addr learned my addr 172.21.15.72:0/110243511 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:47.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f367e7fc700 1 -- 172.21.15.72:0/110243511 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f368006f640 msgr2=0x7f3680135fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f367e7fc700 1 --2- 172.21.15.72:0/110243511 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f368006f640 0x7f3680135fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f367e7fc700 1 -- 172.21.15.72:0/110243511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3680130790 msgr2=0x7f3680136a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f367e7fc700 1 --2- 172.21.15.72:0/110243511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3680130790 0x7f3680136a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f367e7fc700 1 -- 172.21.15.72:0/110243511 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670009550 con 0x7f368006ffb0 2023-10-03T10:12:47.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f367e7fc700 1 --2- 172.21.15.72:0/110243511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368006ffb0 0x7f3680136520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3674000c00 tx=0x7f3674004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f3667fff700 1 -- 172.21.15.72:0/110243511 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36740036a0 con 0x7f368006ffb0 2023-10-03T10:12:47.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f3685953700 1 -- 172.21.15.72:0/110243511 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36740094a0 con 0x7f368006ffb0 2023-10-03T10:12:47.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.722+0000 7f3667fff700 1 -- 172.21.15.72:0/110243511 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367401e070 con 0x7f368006ffb0 2023-10-03T10:12:47.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.723+0000 7f3667fff700 1 -- 172.21.15.72:0/110243511 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674003a60 con 0x7f368006ffb0 2023-10-03T10:12:47.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.723+0000 7f3685953700 1 -- 172.21.15.72:0/110243511 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3680134160 con 0x7f368006ffb0 2023-10-03T10:12:47.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.724+0000 7f3667fff700 1 -- 172.21.15.72:0/110243511 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3674003bc0 con 0x7f368006ffb0 2023-10-03T10:12:47.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.724+0000 7f3667fff700 1 -- 172.21.15.72:0/110243511 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f3674020070 con 0x7f368006ffb0 2023-10-03T10:12:47.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.724+0000 7f367effd700 1 -- 172.21.15.72:0/110243511 >> v1:172.21.15.72:6816/126756 conn(0x7f366c02f540 legacy=0x7f366c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:47.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.725+0000 7f3685953700 1 -- 172.21.15.72:0/110243511 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368009dd00 con 0x7f368006ffb0 2023-10-03T10:12:47.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.729+0000 7fd372a28700 1 Processor -- start 2023-10-03T10:12:47.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.729+0000 7fd372a28700 1 -- start start 2023-10-03T10:12:47.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.730+0000 7fd372a28700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36c09d6f0 0x7fd36c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.730+0000 7fd372a28700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd36c09e000 0x7fd36c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.730+0000 7fd372a28700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd36c09b120 con 0x7fd36c09e410 2023-10-03T10:12:47.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.730+0000 7fd372a28700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36c06b460 con 0x7fd36c09e000 2023-10-03T10:12:47.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.730+0000 7fd372a28700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c09a7e0 con 0x7fd36c09d6f0 2023-10-03T10:12:47.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.730+0000 7fd36b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd36c09e000 0x7fd36c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.730+0000 7fd36b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd36c09e000 0x7fd36c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49652/0 (socket says 172.21.15.72:49652) 2023-10-03T10:12:47.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.730+0000 7fd36b7fe700 1 -- 172.21.15.72:0/4023370171 learned_addr learned my addr 172.21.15.72:0/4023370171 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:47.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.731+0000 7fd36b7fe700 1 -- 172.21.15.72:0/4023370171 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36c09d6f0 msgr2=0x7fd36c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.731+0000 7fd36b7fe700 1 --2- 172.21.15.72:0/4023370171 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36c09d6f0 0x7fd36c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.731+0000 7fd36b7fe700 1 -- 172.21.15.72:0/4023370171 >> v1:172.21.15.72:6789/0 conn(0x7fd36c09e410 legacy=0x7fd36c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:47.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.731+0000 7fd36b7fe700 1 -- 172.21.15.72:0/4023370171 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c09a500 con 0x7fd36c09e000 2023-10-03T10:12:47.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.731+0000 7fd36b7fe700 1 --2- 172.21.15.72:0/4023370171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36c09e000 0x7fd36c1339f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd3600098f0 tx=0x7fd360009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db16709fd02990f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.731+0000 7fd36affd700 1 -- 172.21.15.72:0/4023370171 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360004230 con 0x7fd36c09e000 2023-10-03T10:12:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.731+0000 7fd36affd700 1 -- 172.21.15.72:0/4023370171 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd360004390 con 0x7fd36c09e000 2023-10-03T10:12:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.731+0000 7fd36affd700 1 -- 172.21.15.72:0/4023370171 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3600036a0 con 0x7fd36c09e000 2023-10-03T10:12:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.732+0000 7fd372a28700 1 -- 172.21.15.72:0/4023370171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36c09e000 msgr2=0x7fd36c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.732+0000 7fd372a28700 1 --2- 172.21.15.72:0/4023370171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36c09e000 0x7fd36c1339f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd3600098f0 tx=0x7fd360009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.732+0000 7fd372a28700 1 -- 172.21.15.72:0/4023370171 shutdown_connections 2023-10-03T10:12:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.732+0000 7fd372a28700 1 --2- 172.21.15.72:0/4023370171 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36c09d6f0 0x7fd36c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.732+0000 7fd372a28700 1 --2- 172.21.15.72:0/4023370171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36c09e000 0x7fd36c1339f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.732+0000 7fd372a28700 1 -- 172.21.15.72:0/4023370171 >> 172.21.15.72:0/4023370171 conn(0x7fd36c066f50 msgr2=0x7fd36c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.732+0000 7fd372a28700 1 -- 172.21.15.72:0/4023370171 shutdown_connections 2023-10-03T10:12:47.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.732+0000 7fd372a28700 1 -- 172.21.15.72:0/4023370171 wait complete. 2023-10-03T10:12:47.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.733+0000 7fd372a28700 1 Processor -- start 2023-10-03T10:12:47.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.733+0000 7fd372a28700 1 -- start start 2023-10-03T10:12:47.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.733+0000 7fd372a28700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36c09d6f0 0x7fd36c1cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.733+0000 7fd372a28700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36c09e000 0x7fd36c1cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.733+0000 7fd372a28700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd36c09e410 0x7fd36c1194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:47.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.734+0000 7fd372a28700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c0a2db0 con 0x7fd36c09d6f0 2023-10-03T10:12:47.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.734+0000 7fd372a28700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c09c710 con 0x7fd36c09e000 2023-10-03T10:12:47.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.734+0000 7fd372a28700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c11ccf0 con 0x7fd36c09e410 2023-10-03T10:12:47.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.734+0000 7fd36b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36c09e000 0x7fd36c1cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.734+0000 7fd36b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36c09e000 0x7fd36c1cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54264/0 (socket says 172.21.15.72:54264) 2023-10-03T10:12:47.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.734+0000 7fd36b7fe700 1 -- 172.21.15.72:0/598408730 learned_addr learned my addr 172.21.15.72:0/598408730 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:47.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.734+0000 7fd36bfff700 1 --2- 172.21.15.72:0/598408730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36c09d6f0 0x7fd36c1cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.734+0000 7fd370fc5700 1 --2- 172.21.15.72:0/598408730 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd36c09e410 0x7fd36c1194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:47.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.734+0000 7fd36bfff700 1 -- 172.21.15.72:0/598408730 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd36c09e410 msgr2=0x7fd36c1194b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.734+0000 7fd36bfff700 1 --2- 172.21.15.72:0/598408730 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd36c09e410 0x7fd36c1194b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.734+0000 7fd36bfff700 1 -- 172.21.15.72:0/598408730 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36c09e000 msgr2=0x7fd36c1cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.734+0000 7fd36bfff700 1 --2- 172.21.15.72:0/598408730 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36c09e000 0x7fd36c1cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.734+0000 7fd36bfff700 1 -- 172.21.15.72:0/598408730 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd360009550 con 0x7fd36c09d6f0 2023-10-03T10:12:47.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.734+0000 7fd370fc5700 1 --2- 172.21.15.72:0/598408730 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd36c09e410 0x7fd36c1194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:47.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.734+0000 7f3667fff700 1 -- 172.21.15.72:0/110243511 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3674015080 con 0x7f368006ffb0 2023-10-03T10:12:47.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.735+0000 7fd36bfff700 1 --2- 172.21.15.72:0/598408730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36c09d6f0 0x7fd36c1cc990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00b450 tx=0x7fd35c00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:47.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.735+0000 7fd368ff9700 1 -- 172.21.15.72:0/598408730 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c011830 con 0x7fd36c09d6f0 2023-10-03T10:12:47.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.735+0000 7fd368ff9700 1 -- 172.21.15.72:0/598408730 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35c011990 con 0x7fd36c09d6f0 2023-10-03T10:12:47.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.735+0000 7fd368ff9700 1 -- 172.21.15.72:0/598408730 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c011d40 con 0x7fd36c09d6f0 2023-10-03T10:12:47.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.735+0000 7fd372a28700 1 -- 172.21.15.72:0/598408730 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36c1cd410 con 0x7fd36c09d6f0 2023-10-03T10:12:47.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.735+0000 7fd372a28700 1 -- 172.21.15.72:0/598408730 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36c1199f0 con 0x7fd36c09d6f0 2023-10-03T10:12:47.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.736+0000 7fd368ff9700 1 -- 172.21.15.72:0/598408730 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd35c01a400 con 0x7fd36c09d6f0 2023-10-03T10:12:47.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.736+0000 7fd372a28700 1 -- 172.21.15.72:0/598408730 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36c074ea0 con 0x7fd36c09d6f0 2023-10-03T10:12:47.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.737+0000 7fd368ff9700 1 -- 172.21.15.72:0/598408730 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd35c03fa10 con 0x7fd36c09d6f0 2023-10-03T10:12:47.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.740+0000 7fd36b7fe700 1 -- 172.21.15.72:0/598408730 >> v1:172.21.15.72:6816/126756 conn(0x7fd35802f560 legacy=0x7fd358031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.745+0000 7fd368ff9700 1 -- 172.21.15.72:0/598408730 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd35c00f2e0 con 0x7fd36c09d6f0 2023-10-03T10:12:47.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.816+0000 7f70bdaf9700 1 -- 172.21.15.72:0/2705809252 >> v1:172.21.15.72:6816/126756 conn(0x7f709c02f540 legacy=0x7f709c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:47.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.852+0000 7f70c055e700 1 -- 172.21.15.72:0/2705809252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f70b809b780 con 0x7f70b812cf60 2023-10-03T10:12:47.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.852+0000 7f70aeffd700 1 -- 172.21.15.72:0/2705809252 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f70b809b780 con 0x7f70b812cf60 2023-10-03T10:12:47.854 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:47.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.856+0000 7f70c055e700 1 -- 172.21.15.72:0/2705809252 >> v1:172.21.15.72:6816/126756 conn(0x7f709c02f540 legacy=0x7f709c0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.856+0000 7f70c055e700 1 -- 172.21.15.72:0/2705809252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b812cf60 msgr2=0x7f70b809bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.856+0000 7f70c055e700 1 --2- 172.21.15.72:0/2705809252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b812cf60 0x7f70b809bab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f70b400e810 tx=0x7f70b400eb20 comp rx=0 tx=0).stop 2023-10-03T10:12:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.856+0000 7f70c055e700 1 -- 172.21.15.72:0/2705809252 shutdown_connections 2023-10-03T10:12:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.856+0000 7f70c055e700 1 --2- 172.21.15.72:0/2705809252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b812cf60 0x7f70b809bab0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.856+0000 7f70c055e700 1 --2- 172.21.15.72:0/2705809252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70b8130260 0x7f70b81c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.856+0000 7f70c055e700 1 --2- 172.21.15.72:0/2705809252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b812f8b0 0x7f70b809bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.856+0000 7f70c055e700 1 -- 172.21.15.72:0/2705809252 >> 172.21.15.72:0/2705809252 conn(0x7f70b80a2aa0 msgr2=0x7f70b81b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.856+0000 7f70c055e700 1 -- 172.21.15.72:0/2705809252 shutdown_connections 2023-10-03T10:12:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.856+0000 7f70c055e700 1 -- 172.21.15.72:0/2705809252 wait complete. 2023-10-03T10:12:47.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.881+0000 7fa259704700 1 -- 172.21.15.72:0/2710928449 >> v1:172.21.15.72:6816/126756 conn(0x7fa23802f560 legacy=0x7fa238031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:47.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.893+0000 7fa25b968700 1 -- 172.21.15.72:0/2710928449 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa25412f880 con 0x7fa25412cf60 2023-10-03T10:12:47.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.894+0000 7fa249ffb700 1 -- 172.21.15.72:0/2710928449 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa25412f880 con 0x7fa25412cf60 2023-10-03T10:12:47.894 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:47.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.896+0000 7fa25b968700 1 -- 172.21.15.72:0/2710928449 >> v1:172.21.15.72:6816/126756 conn(0x7fa23802f560 legacy=0x7fa238031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:47.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.896+0000 7fa25b968700 1 -- 172.21.15.72:0/2710928449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25412cf60 msgr2=0x7fa25412e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.896+0000 7fa25b968700 1 --2- 172.21.15.72:0/2710928449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25412cf60 0x7fa25412e870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa244009520 tx=0x7fa24400fcc0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.896+0000 7fa25b968700 1 -- 172.21.15.72:0/2710928449 shutdown_connections 2023-10-03T10:12:47.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.896+0000 7fa25b968700 1 --2- 172.21.15.72:0/2710928449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa254135c20 0x7fa2541c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.896+0000 7fa25b968700 1 --2- 172.21.15.72:0/2710928449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25406f5d0 0x7fa25412e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.896+0000 7fa25b968700 1 --2- 172.21.15.72:0/2710928449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25412cf60 0x7fa25412e870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.896+0000 7fa25b968700 1 -- 172.21.15.72:0/2710928449 >> 172.21.15.72:0/2710928449 conn(0x7fa2540a2aa0 msgr2=0x7fa25412a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.896+0000 7fa25b968700 1 -- 172.21.15.72:0/2710928449 shutdown_connections 2023-10-03T10:12:47.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.896+0000 7fa25b968700 1 -- 172.21.15.72:0/2710928449 wait complete. 2023-10-03T10:12:47.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:47.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.925+0000 7f367effd700 1 -- 172.21.15.72:0/110243511 >> v1:172.21.15.72:6816/126756 conn(0x7f366c02f540 legacy=0x7f366c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:47.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.936+0000 7f3685953700 1 -- 172.21.15.72:0/110243511 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3680074ea0 con 0x7f368006ffb0 2023-10-03T10:12:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.936+0000 7f3667fff700 1 -- 172.21.15.72:0/110243511 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f367402e350 con 0x7f368006ffb0 2023-10-03T10:12:47.937 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.938+0000 7f3685953700 1 -- 172.21.15.72:0/110243511 >> v1:172.21.15.72:6816/126756 conn(0x7f366c02f540 legacy=0x7f366c0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.938+0000 7f3685953700 1 -- 172.21.15.72:0/110243511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368006ffb0 msgr2=0x7f3680136520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.938+0000 7f3685953700 1 --2- 172.21.15.72:0/110243511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368006ffb0 0x7f3680136520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3674000c00 tx=0x7f3674004750 comp rx=0 tx=0).stop 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.938+0000 7f3685953700 1 -- 172.21.15.72:0/110243511 shutdown_connections 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.938+0000 7f3685953700 1 --2- 172.21.15.72:0/110243511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3680130790 0x7f3680136a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.938+0000 7f3685953700 1 --2- 172.21.15.72:0/110243511 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f368006f640 0x7f3680135fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.938+0000 7f3685953700 1 --2- 172.21.15.72:0/110243511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368006ffb0 0x7f3680136520 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.938+0000 7f3685953700 1 -- 172.21.15.72:0/110243511 >> 172.21.15.72:0/110243511 conn(0x7f36800a2aa0 msgr2=0x7f36800a1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.938+0000 7f3685953700 1 -- 172.21.15.72:0/110243511 shutdown_connections 2023-10-03T10:12:47.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.938+0000 7f3685953700 1 -- 172.21.15.72:0/110243511 wait complete. 2023-10-03T10:12:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.941+0000 7fd36b7fe700 1 -- 172.21.15.72:0/598408730 >> v1:172.21.15.72:6816/126756 conn(0x7fd35802f560 legacy=0x7fd358031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.941+0000 7fd372a28700 1 -- 172.21.15.72:0/598408730 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd36c11cac0 con 0x7fd36c09d6f0 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.942+0000 7fd368ff9700 1 -- 172.21.15.72:0/598408730 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd35c015030 con 0x7fd36c09d6f0 2023-10-03T10:12:47.942 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:47.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.944+0000 7fd372a28700 1 -- 172.21.15.72:0/598408730 >> v1:172.21.15.72:6816/126756 conn(0x7fd35802f560 legacy=0x7fd358031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.944+0000 7fd372a28700 1 -- 172.21.15.72:0/598408730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36c09d6f0 msgr2=0x7fd36c1cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.944+0000 7fd372a28700 1 --2- 172.21.15.72:0/598408730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36c09d6f0 0x7fd36c1cc990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00b450 tx=0x7fd35c00b760 comp rx=0 tx=0).stop 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.944+0000 7fd372a28700 1 -- 172.21.15.72:0/598408730 shutdown_connections 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.944+0000 7fd372a28700 1 --2- 172.21.15.72:0/598408730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36c09d6f0 0x7fd36c1cc990 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.944+0000 7fd372a28700 1 --2- 172.21.15.72:0/598408730 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd36c09e410 0x7fd36c1194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.944+0000 7fd372a28700 1 --2- 172.21.15.72:0/598408730 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36c09e000 0x7fd36c1cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.944+0000 7fd372a28700 1 -- 172.21.15.72:0/598408730 >> 172.21.15.72:0/598408730 conn(0x7fd36c066f50 msgr2=0x7fd36c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.944+0000 7fd372a28700 1 -- 172.21.15.72:0/598408730 shutdown_connections 2023-10-03T10:12:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:47.944+0000 7fd372a28700 1 -- 172.21.15.72:0/598408730 wait complete. 2023-10-03T10:12:47.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:47.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:48.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:48.915 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:48.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:48.958 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.015+0000 7f968e2f2700 1 Processor -- start 2023-10-03T10:12:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.015+0000 7f968e2f2700 1 -- start start 2023-10-03T10:12:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f968e2f2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f968812cf60 0x7f968806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f968e2f2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9688130430 0x7f9688137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f968e2f2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968812cd90 con 0x7f968812f8b0 2023-10-03T10:12:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f968e2f2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968812d330 con 0x7f968812cf60 2023-10-03T10:12:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f968e2f2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9688071780 con 0x7f9688130430 2023-10-03T10:12:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f9687fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f968812cf60 0x7f968806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f96877fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f968812f8b0 0x7f968812fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59704/0 (socket says 172.21.15.72:59704) 2023-10-03T10:12:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f9687fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f968812cf60 0x7f968806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44798/0 (socket says 172.21.15.72:44798) 2023-10-03T10:12:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f96877fe700 1 -- 172.21.15.72:0/2982740941 learned_addr learned my addr 172.21.15.72:0/2982740941 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f968c88f700 1 --2- 172.21.15.72:0/2982740941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9688130430 0x7f9688137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f9686ffd700 1 -- 172.21.15.72:0/2982740941 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001412173 0 0) 0x7f968812cd90 con 0x7f968812f8b0 2023-10-03T10:12:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f9686ffd700 1 -- 172.21.15.72:0/2982740941 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96700035b0 con 0x7f968812f8b0 2023-10-03T10:12:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f968c88f700 1 -- 172.21.15.72:0/2982740941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f968812cf60 msgr2=0x7f968806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f968c88f700 1 --2- 172.21.15.72:0/2982740941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f968812cf60 0x7f968806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f968c88f700 1 -- 172.21.15.72:0/2982740941 >> v1:172.21.15.72:6789/0 conn(0x7f968812f8b0 legacy=0x7f968812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f968c88f700 1 -- 172.21.15.72:0/2982740941 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9688071a40 con 0x7f9688130430 2023-10-03T10:12:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f9687fff700 1 --2- 172.21.15.72:0/2982740941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f968812cf60 0x7f968806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:49.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.016+0000 7f968c88f700 1 --2- 172.21.15.72:0/2982740941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9688130430 0x7f9688137c30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9680009dc0 tx=0x7f968000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f95c65dc5cfe069 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.017+0000 7f9686ffd700 1 -- 172.21.15.72:0/2982740941 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968000e070 con 0x7f9688130430 2023-10-03T10:12:49.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.017+0000 7f9686ffd700 1 -- 172.21.15.72:0/2982740941 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968000bae0 con 0x7f9688130430 2023-10-03T10:12:49.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.017+0000 7f9686ffd700 1 -- 172.21.15.72:0/2982740941 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968000be90 con 0x7f9688130430 2023-10-03T10:12:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.017+0000 7f968e2f2700 1 -- 172.21.15.72:0/2982740941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9688130430 msgr2=0x7f9688137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.017+0000 7f968e2f2700 1 --2- 172.21.15.72:0/2982740941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9688130430 0x7f9688137c30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9680009dc0 tx=0x7f968000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.017+0000 7f968e2f2700 1 -- 172.21.15.72:0/2982740941 shutdown_connections 2023-10-03T10:12:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.017+0000 7f968e2f2700 1 --2- 172.21.15.72:0/2982740941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9688130430 0x7f9688137c30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.017+0000 7f968e2f2700 1 --2- 172.21.15.72:0/2982740941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f968812cf60 0x7f968806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.017+0000 7f968e2f2700 1 -- 172.21.15.72:0/2982740941 >> 172.21.15.72:0/2982740941 conn(0x7f96880a2aa0 msgr2=0x7f96880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.018+0000 7f968e2f2700 1 -- 172.21.15.72:0/2982740941 shutdown_connections 2023-10-03T10:12:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.018+0000 7f968e2f2700 1 -- 172.21.15.72:0/2982740941 wait complete. 2023-10-03T10:12:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.019+0000 7f968e2f2700 1 Processor -- start 2023-10-03T10:12:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.019+0000 7f968e2f2700 1 -- start start 2023-10-03T10:12:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.019+0000 7f968e2f2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968812cf60 0x7f96881c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.019+0000 7f968e2f2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f968812f8b0 0x7f96881c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.019+0000 7f968e2f2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9688130430 0x7f96881c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.019+0000 7f968e2f2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96881297d0 con 0x7f968812cf60 2023-10-03T10:12:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.019+0000 7f968e2f2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968809ce10 con 0x7f968812f8b0 2023-10-03T10:12:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.019+0000 7f968e2f2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f968812da40 con 0x7f9688130430 2023-10-03T10:12:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.019+0000 7f9687fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968812cf60 0x7f96881c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.019+0000 7f96877fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f968812f8b0 0x7f96881c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.019+0000 7f96877fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f968812f8b0 0x7f96881c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44802/0 (socket says 172.21.15.72:44802) 2023-10-03T10:12:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.019+0000 7f96877fe700 1 -- 172.21.15.72:0/1089349512 learned_addr learned my addr 172.21.15.72:0/1089349512 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.020+0000 7f968c88f700 1 --2- 172.21.15.72:0/1089349512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9688130430 0x7f96881c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.020+0000 7f96877fe700 1 -- 172.21.15.72:0/1089349512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9688130430 msgr2=0x7f96881c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.020+0000 7f96877fe700 1 --2- 172.21.15.72:0/1089349512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9688130430 0x7f96881c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.020+0000 7f96877fe700 1 -- 172.21.15.72:0/1089349512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968812cf60 msgr2=0x7f96881c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.020+0000 7f96877fe700 1 --2- 172.21.15.72:0/1089349512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968812cf60 0x7f96881c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.020+0000 7f96877fe700 1 -- 172.21.15.72:0/1089349512 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967800a640 con 0x7f968812f8b0 2023-10-03T10:12:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.020+0000 7f96877fe700 1 --2- 172.21.15.72:0/1089349512 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f968812f8b0 0x7f96881c43d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f967c001eb0 tx=0x7f967c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.020+0000 7f9684ff9700 1 -- 172.21.15.72:0/1089349512 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c004c80 con 0x7f968812f8b0 2023-10-03T10:12:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.020+0000 7f9684ff9700 1 -- 172.21.15.72:0/1089349512 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967c004de0 con 0x7f968812f8b0 2023-10-03T10:12:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.020+0000 7f968e2f2700 1 -- 172.21.15.72:0/1089349512 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9680009a70 con 0x7f968812f8b0 2023-10-03T10:12:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.020+0000 7f9684ff9700 1 -- 172.21.15.72:0/1089349512 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c0072f0 con 0x7f968812f8b0 2023-10-03T10:12:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.020+0000 7f968e2f2700 1 -- 172.21.15.72:0/1089349512 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968809d480 con 0x7f968812f8b0 2023-10-03T10:12:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.021+0000 7f9684ff9700 1 -- 172.21.15.72:0/1089349512 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f967c007450 con 0x7f968812f8b0 2023-10-03T10:12:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.022+0000 7f968e2f2700 1 -- 172.21.15.72:0/1089349512 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968809e560 con 0x7f968812f8b0 2023-10-03T10:12:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.022+0000 7f9687fff700 1 -- 172.21.15.72:0/1089349512 >> v1:172.21.15.72:6816/126756 conn(0x7f967402f510 legacy=0x7f96740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.022+0000 7f9684ff9700 1 -- 172.21.15.72:0/1089349512 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f967c03f940 con 0x7f968812f8b0 2023-10-03T10:12:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.026+0000 7f9684ff9700 1 -- 172.21.15.72:0/1089349512 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f968809e560 con 0x7f968812f8b0 2023-10-03T10:12:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.070+0000 7feab2b98700 1 Processor -- start 2023-10-03T10:12:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.070+0000 7feab2b98700 1 -- start start 2023-10-03T10:12:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.071+0000 7feab2b98700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaac09d9f0 0x7feaac136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.071+0000 7feab2b98700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feaac136a70 0x7feaac138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.071+0000 7feab2b98700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac09e130 con 0x7feaac1316c0 2023-10-03T10:12:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.071+0000 7feab2b98700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac1321a0 con 0x7feaac136a70 2023-10-03T10:12:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.071+0000 7feab2b98700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac1312b0 con 0x7feaac09d9f0 2023-10-03T10:12:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.071+0000 7feab0934700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7feaac1316c0 0x7feaac131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59716/0 (socket says 172.21.15.72:59716) 2023-10-03T10:12:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.071+0000 7feab0934700 1 -- 172.21.15.72:0/1540200879 learned_addr learned my addr 172.21.15.72:0/1540200879 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.071+0000 7feab1135700 1 --2- 172.21.15.72:0/1540200879 >> v2:172.21.15.72:3300/0 conn(0x7feaac136a70 0x7feaac138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.071+0000 7feaabfff700 1 --2- 172.21.15.72:0/1540200879 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaac09d9f0 0x7feaac136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.072+0000 7feab1135700 1 -- 172.21.15.72:0/1540200879 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaac09d9f0 msgr2=0x7feaac136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:49.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.072+0000 7feab1135700 1 --2- 172.21.15.72:0/1540200879 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaac09d9f0 0x7feaac136530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.072+0000 7feab1135700 1 -- 172.21.15.72:0/1540200879 >> v1:172.21.15.72:6789/0 conn(0x7feaac1316c0 legacy=0x7feaac131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.072+0000 7feab1135700 1 -- 172.21.15.72:0/1540200879 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac09f6e0 con 0x7feaac136a70 2023-10-03T10:12:49.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.072+0000 7feaab7fe700 1 -- 172.21.15.72:0/1540200879 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359476813 0 0) 0x7feaa0001110 con 0x7feaac1316c0 2023-10-03T10:12:49.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.072+0000 7feaabfff700 1 --2- 172.21.15.72:0/1540200879 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaac09d9f0 0x7feaac136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:49.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.072+0000 7feab1135700 1 --2- 172.21.15.72:0/1540200879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feaac136a70 0x7feaac138e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009d90 tx=0x7feaa400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f9f158a2c2d1db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.072+0000 7feaab7fe700 1 -- 172.21.15.72:0/1540200879 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa400e070 con 0x7feaac136a70 2023-10-03T10:12:49.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.072+0000 7feaab7fe700 1 -- 172.21.15.72:0/1540200879 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa400bbd0 con 0x7feaac136a70 2023-10-03T10:12:49.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.072+0000 7feaab7fe700 1 -- 172.21.15.72:0/1540200879 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4012430 con 0x7feaac136a70 2023-10-03T10:12:49.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.073+0000 7feab2b98700 1 -- 172.21.15.72:0/1540200879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feaac136a70 msgr2=0x7feaac138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.073+0000 7feab2b98700 1 --2- 172.21.15.72:0/1540200879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feaac136a70 0x7feaac138e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009d90 tx=0x7feaa400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:49.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.073+0000 7feab2b98700 1 -- 172.21.15.72:0/1540200879 shutdown_connections 2023-10-03T10:12:49.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.073+0000 7feab2b98700 1 --2- 172.21.15.72:0/1540200879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feaac136a70 0x7feaac138e50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.073+0000 7feab2b98700 1 --2- 172.21.15.72:0/1540200879 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaac09d9f0 0x7feaac136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.073+0000 7feab2b98700 1 -- 172.21.15.72:0/1540200879 >> 172.21.15.72:0/1540200879 conn(0x7feaac066f50 msgr2=0x7feaac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.073+0000 7feab2b98700 1 -- 172.21.15.72:0/1540200879 shutdown_connections 2023-10-03T10:12:49.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.073+0000 7feab2b98700 1 -- 172.21.15.72:0/1540200879 wait complete. 2023-10-03T10:12:49.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.074+0000 7feab2b98700 1 Processor -- start 2023-10-03T10:12:49.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.074+0000 7feab2b98700 1 -- start start 2023-10-03T10:12:49.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.074+0000 7feab2b98700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feaac09d9f0 0x7feaac12ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.074+0000 7feab2b98700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feaac1316c0 0x7feaac09a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.074+0000 7feab2b98700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaac136a70 0x7feaac09a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feab2b98700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac09c200 con 0x7feaac09d9f0 2023-10-03T10:12:49.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feab2b98700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac09c010 con 0x7feaac136a70 2023-10-03T10:12:49.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feab2b98700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaac1361d0 con 0x7feaac1316c0 2023-10-03T10:12:49.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feab0934700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feaac09d9f0 0x7feaac12ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feab0934700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feaac09d9f0 0x7feaac12ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60356/0 (socket says 172.21.15.72:60356) 2023-10-03T10:12:49.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feab0934700 1 -- 172.21.15.72:0/2384157483 learned_addr learned my addr 172.21.15.72:0/2384157483 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:49.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feaabfff700 1 --2- 172.21.15.72:0/2384157483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feaac1316c0 0x7feaac09a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feab1135700 1 --2- 172.21.15.72:0/2384157483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaac136a70 0x7feaac09a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feaabfff700 1 -- 172.21.15.72:0/2384157483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaac136a70 msgr2=0x7feaac09a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feaabfff700 1 --2- 172.21.15.72:0/2384157483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaac136a70 0x7feaac09a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feaabfff700 1 -- 172.21.15.72:0/2384157483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feaac09d9f0 msgr2=0x7feaac12ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feaabfff700 1 --2- 172.21.15.72:0/2384157483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feaac09d9f0 0x7feaac12ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feaabfff700 1 -- 172.21.15.72:0/2384157483 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa4009a70 con 0x7feaac1316c0 2023-10-03T10:12:49.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feaabfff700 1 --2- 172.21.15.72:0/2384157483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feaac1316c0 0x7feaac09a400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fea9800e7e0 tx=0x7fea9800eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feaa97fa700 1 -- 172.21.15.72:0/2384157483 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9800c070 con 0x7feaac1316c0 2023-10-03T10:12:49.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feaa97fa700 1 -- 172.21.15.72:0/2384157483 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea98013610 con 0x7feaac1316c0 2023-10-03T10:12:49.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feab2b98700 1 -- 172.21.15.72:0/2384157483 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac138e60 con 0x7feaac1316c0 2023-10-03T10:12:49.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feaa97fa700 1 -- 172.21.15.72:0/2384157483 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98013980 con 0x7feaac1316c0 2023-10-03T10:12:49.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.075+0000 7feab2b98700 1 -- 172.21.15.72:0/2384157483 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac1353f0 con 0x7feaac1316c0 2023-10-03T10:12:49.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.076+0000 7feaa97fa700 1 -- 172.21.15.72:0/2384157483 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fea98013ae0 con 0x7feaac1316c0 2023-10-03T10:12:49.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.076+0000 7feaa97fa700 1 -- 172.21.15.72:0/2384157483 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fea9803f970 con 0x7feaac1316c0 2023-10-03T10:12:49.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.076+0000 7feab0934700 1 -- 172.21.15.72:0/2384157483 >> v1:172.21.15.72:6816/126756 conn(0x7fea9002f510 legacy=0x7fea900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:49.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.076+0000 7feab2b98700 1 -- 172.21.15.72:0/2384157483 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac135610 con 0x7feaac1316c0 2023-10-03T10:12:49.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.081+0000 7feaa97fa700 1 -- 172.21.15.72:0/2384157483 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea98010910 con 0x7feaac1316c0 2023-10-03T10:12:49.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.100+0000 7f2a32abd700 1 Processor -- start 2023-10-03T10:12:49.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.100+0000 7f2a32abd700 1 -- start start 2023-10-03T10:12:49.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.100+0000 7f2a32abd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c09d6f0 0x7f2a2c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.100+0000 7f2a32abd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c09e410 0x7f2a2c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.100+0000 7f2a32abd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2c09b120 con 0x7f2a2c09e000 2023-10-03T10:12:49.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.100+0000 7f2a32abd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c06b460 con 0x7f2a2c09d6f0 2023-10-03T10:12:49.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.100+0000 7f2a32abd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c09a7e0 con 0x7f2a2c09e410 2023-10-03T10:12:49.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.100+0000 7f2a30859700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c09d6f0 0x7f2a2c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.100+0000 7f2a2bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2a2c09e000 0x7f2a2c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59732/0 (socket says 172.21.15.72:59732) 2023-10-03T10:12:49.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.100+0000 7f2a2bfff700 1 -- 172.21.15.72:0/906144125 learned_addr learned my addr 172.21.15.72:0/906144125 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:49.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.100+0000 7f2a3105a700 1 --2- 172.21.15.72:0/906144125 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c09e410 0x7f2a2c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.101+0000 7f2a2b7fe700 1 -- 172.21.15.72:0/906144125 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192858531 0 0) 0x7f2a2c09b120 con 0x7f2a2c09e000 2023-10-03T10:12:49.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.101+0000 7f2a2b7fe700 1 -- 172.21.15.72:0/906144125 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a1c0035b0 con 0x7f2a2c09e000 2023-10-03T10:12:49.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.101+0000 7f2a3105a700 1 -- 172.21.15.72:0/906144125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c09d6f0 msgr2=0x7f2a2c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:49.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.101+0000 7f2a3105a700 1 --2- 172.21.15.72:0/906144125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c09d6f0 0x7f2a2c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.101+0000 7f2a3105a700 1 -- 172.21.15.72:0/906144125 >> v1:172.21.15.72:6789/0 conn(0x7f2a2c09e000 legacy=0x7f2a2c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.101+0000 7f2a3105a700 1 -- 172.21.15.72:0/906144125 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c09a500 con 0x7f2a2c09e410 2023-10-03T10:12:49.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.101+0000 7f2a30859700 1 --2- 172.21.15.72:0/906144125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c09d6f0 0x7f2a2c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:49.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.101+0000 7f2a3105a700 1 --2- 172.21.15.72:0/906144125 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c09e410 0x7f2a2c134100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009df0 tx=0x7f2a2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7effff74b5ba8156 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.101+0000 7f2a2b7fe700 1 -- 172.21.15.72:0/906144125 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2400e070 con 0x7f2a2c09e410 2023-10-03T10:12:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.101+0000 7f2a2b7fe700 1 -- 172.21.15.72:0/906144125 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2400bae0 con 0x7f2a2c09e410 2023-10-03T10:12:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.101+0000 7f2a2b7fe700 1 -- 172.21.15.72:0/906144125 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2400be90 con 0x7f2a2c09e410 2023-10-03T10:12:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.102+0000 7f2a32abd700 1 -- 172.21.15.72:0/906144125 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c09e410 msgr2=0x7f2a2c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.102+0000 7f2a32abd700 1 --2- 172.21.15.72:0/906144125 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c09e410 0x7f2a2c134100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009df0 tx=0x7f2a2400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.102+0000 7f2a32abd700 1 -- 172.21.15.72:0/906144125 shutdown_connections 2023-10-03T10:12:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.102+0000 7f2a32abd700 1 --2- 172.21.15.72:0/906144125 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c09e410 0x7f2a2c134100 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.102+0000 7f2a32abd700 1 --2- 172.21.15.72:0/906144125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c09d6f0 0x7f2a2c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.102+0000 7f2a32abd700 1 -- 172.21.15.72:0/906144125 >> 172.21.15.72:0/906144125 conn(0x7f2a2c066f50 msgr2=0x7f2a2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.102+0000 7f2a32abd700 1 -- 172.21.15.72:0/906144125 shutdown_connections 2023-10-03T10:12:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.102+0000 7f2a32abd700 1 -- 172.21.15.72:0/906144125 wait complete. 2023-10-03T10:12:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.104+0000 7f2a32abd700 1 Processor -- start 2023-10-03T10:12:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.104+0000 7f2a32abd700 1 -- start start 2023-10-03T10:12:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.104+0000 7f2a32abd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c09d6f0 0x7f2a2c122650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a32abd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2c09e000 0x7f2a2c122b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a32abd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c09e410 0x7f2a2c1230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a32abd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c124a10 con 0x7f2a2c09e000 2023-10-03T10:12:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a32abd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c1260e0 con 0x7f2a2c09e410 2023-10-03T10:12:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a32abd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c1241d0 con 0x7f2a2c09d6f0 2023-10-03T10:12:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a30859700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c09d6f0 0x7f2a2c122650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a30859700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c09d6f0 0x7f2a2c122650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59482/0 (socket says 172.21.15.72:59482) 2023-10-03T10:12:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a30859700 1 -- 172.21.15.72:0/4278065603 learned_addr learned my addr 172.21.15.72:0/4278065603 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a3105a700 1 --2- 172.21.15.72:0/4278065603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c09e410 0x7f2a2c1230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a2bfff700 1 --2- 172.21.15.72:0/4278065603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2c09e000 0x7f2a2c122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a30859700 1 -- 172.21.15.72:0/4278065603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c09e410 msgr2=0x7f2a2c1230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a30859700 1 --2- 172.21.15.72:0/4278065603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c09e410 0x7f2a2c1230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a30859700 1 -- 172.21.15.72:0/4278065603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2c09e000 msgr2=0x7f2a2c122b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a30859700 1 --2- 172.21.15.72:0/4278065603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2c09e000 0x7f2a2c122b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a30859700 1 -- 172.21.15.72:0/4278065603 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a200094a0 con 0x7f2a2c09d6f0 2023-10-03T10:12:49.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a30859700 1 --2- 172.21.15.72:0/4278065603 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c09d6f0 0x7f2a2c122650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000ec10 tx=0x7f2a2000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.105+0000 7f2a297fa700 1 -- 172.21.15.72:0/4278065603 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2000c850 con 0x7f2a2c09d6f0 2023-10-03T10:12:49.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.106+0000 7f2a297fa700 1 -- 172.21.15.72:0/4278065603 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2000c9b0 con 0x7f2a2c09d6f0 2023-10-03T10:12:49.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.106+0000 7f2a297fa700 1 -- 172.21.15.72:0/4278065603 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2000cd20 con 0x7f2a2c09d6f0 2023-10-03T10:12:49.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.106+0000 7f2a32abd700 1 -- 172.21.15.72:0/4278065603 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a24009a70 con 0x7f2a2c09d6f0 2023-10-03T10:12:49.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.106+0000 7f2a32abd700 1 -- 172.21.15.72:0/4278065603 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c133510 con 0x7f2a2c09d6f0 2023-10-03T10:12:49.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.107+0000 7f2a297fa700 1 -- 172.21.15.72:0/4278065603 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2a20013470 con 0x7f2a2c09d6f0 2023-10-03T10:12:49.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.107+0000 7f2a32abd700 1 -- 172.21.15.72:0/4278065603 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c133140 con 0x7f2a2c09d6f0 2023-10-03T10:12:49.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.107+0000 7f2a297fa700 1 -- 172.21.15.72:0/4278065603 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f2a2003fce0 con 0x7f2a2c09d6f0 2023-10-03T10:12:49.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.107+0000 7f2a2bfff700 1 -- 172.21.15.72:0/4278065603 >> v1:172.21.15.72:6816/126756 conn(0x7f2a1002f510 legacy=0x7f2a100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:49.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.109+0000 7f2cc4da7700 1 Processor -- start 2023-10-03T10:12:49.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.110+0000 7f2cc4da7700 1 -- start start 2023-10-03T10:12:49.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.110+0000 7f2cc4da7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2cc009e1d0 0x7f2cc0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.110+0000 7f2cc4da7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cc0139170 0x7f2cc013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.110+0000 7f2cc4da7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc009b120 con 0x7f2cc009d6f0 2023-10-03T10:12:49.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.110+0000 7f2cc4da7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc006b460 con 0x7f2cc0139170 2023-10-03T10:12:49.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.110+0000 7f2cc4da7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc009a7e0 con 0x7f2cc009e1d0 2023-10-03T10:12:49.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.111+0000 7f2cbe59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2cc009d6f0 0x7f2cc009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59746/0 (socket says 172.21.15.72:59746) 2023-10-03T10:12:49.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.111+0000 7f2cbe59c700 1 -- 172.21.15.72:0/2193078815 learned_addr learned my addr 172.21.15.72:0/2193078815 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:49.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.111+0000 7f2cbed9d700 1 --2- 172.21.15.72:0/2193078815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cc0139170 0x7f2cc013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.111+0000 7f2cbd59a700 1 -- 172.21.15.72:0/2193078815 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823940244 0 0) 0x7f2cc009b120 con 0x7f2cc009d6f0 2023-10-03T10:12:49.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.111+0000 7f2cbd59a700 1 -- 172.21.15.72:0/2193078815 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca80035b0 con 0x7f2cc009d6f0 2023-10-03T10:12:49.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.111+0000 7f2cbed9d700 1 -- 172.21.15.72:0/2193078815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2cc009e1d0 msgr2=0x7f2cc0138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:49.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.111+0000 7f2cbed9d700 1 --2- 172.21.15.72:0/2193078815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2cc009e1d0 0x7f2cc0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.111+0000 7f2cbed9d700 1 -- 172.21.15.72:0/2193078815 >> v1:172.21.15.72:6789/0 conn(0x7f2cc009d6f0 legacy=0x7f2cc009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.111+0000 7f2cbed9d700 1 -- 172.21.15.72:0/2193078815 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc009a500 con 0x7f2cc0139170 2023-10-03T10:12:49.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.111+0000 7f2cbed9d700 1 --2- 172.21.15.72:0/2193078815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cc0139170 0x7f2cc013b550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009dc0 tx=0x7f2cb800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=587dfca50cb4d810 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.111+0000 7f2cbd59a700 1 -- 172.21.15.72:0/2193078815 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb800e070 con 0x7f2cc0139170 2023-10-03T10:12:49.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.111+0000 7f2cbd59a700 1 -- 172.21.15.72:0/2193078815 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb800bb20 con 0x7f2cc0139170 2023-10-03T10:12:49.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.111+0000 7f2cbd59a700 1 -- 172.21.15.72:0/2193078815 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb800be90 con 0x7f2cc0139170 2023-10-03T10:12:49.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.112+0000 7f2cc4da7700 1 -- 172.21.15.72:0/2193078815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cc0139170 msgr2=0x7f2cc013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.112+0000 7f2cc4da7700 1 --2- 172.21.15.72:0/2193078815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cc0139170 0x7f2cc013b550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009dc0 tx=0x7f2cb800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:49.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.112+0000 7f2cc4da7700 1 -- 172.21.15.72:0/2193078815 shutdown_connections 2023-10-03T10:12:49.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.112+0000 7f2cc4da7700 1 --2- 172.21.15.72:0/2193078815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cc0139170 0x7f2cc013b550 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.112+0000 7f2cc4da7700 1 --2- 172.21.15.72:0/2193078815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2cc009e1d0 0x7f2cc0138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.112+0000 7f2cc4da7700 1 -- 172.21.15.72:0/2193078815 >> 172.21.15.72:0/2193078815 conn(0x7f2cc0066f50 msgr2=0x7f2cc009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.112+0000 7f2cc4da7700 1 -- 172.21.15.72:0/2193078815 shutdown_connections 2023-10-03T10:12:49.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.112+0000 7f2cc4da7700 1 -- 172.21.15.72:0/2193078815 wait complete. 2023-10-03T10:12:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.113+0000 7f2cc4da7700 1 Processor -- start 2023-10-03T10:12:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.114+0000 7f2cc4da7700 1 -- start start 2023-10-03T10:12:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.114+0000 7f2a297fa700 1 -- 172.21.15.72:0/4278065603 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a20013720 con 0x7f2a2c09d6f0 2023-10-03T10:12:49.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.114+0000 7f2cc4da7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2cc009d6f0 0x7f2cc0121540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.114+0000 7f2cc4da7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cc009e1d0 0x7f2cc0121a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.114+0000 7f2cc4da7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0139170 0x7f2cc0121fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.114+0000 7f2cc4da7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0123150 con 0x7f2cc0139170 2023-10-03T10:12:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.114+0000 7f2cc4da7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0125060 con 0x7f2cc009e1d0 2023-10-03T10:12:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.114+0000 7f2cc4da7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0124410 con 0x7f2cc009d6f0 2023-10-03T10:12:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.114+0000 7f2cbdd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cc009e1d0 0x7f2cc0121a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.114+0000 7f2cbdd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cc009e1d0 0x7f2cc0121a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44864/0 (socket says 172.21.15.72:44864) 2023-10-03T10:12:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.114+0000 7f2cbdd9b700 1 -- 172.21.15.72:0/109786775 learned_addr learned my addr 172.21.15.72:0/109786775 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.115+0000 7f2cbe59c700 1 --2- 172.21.15.72:0/109786775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2cc009d6f0 0x7f2cc0121540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.115+0000 7f2cbed9d700 1 --2- 172.21.15.72:0/109786775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0139170 0x7f2cc0121fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.115+0000 7f2cbdd9b700 1 -- 172.21.15.72:0/109786775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2cc009d6f0 msgr2=0x7f2cc0121540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.115+0000 7f2cbdd9b700 1 --2- 172.21.15.72:0/109786775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2cc009d6f0 0x7f2cc0121540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.115+0000 7f2cbdd9b700 1 -- 172.21.15.72:0/109786775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0139170 msgr2=0x7f2cc0121fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.115+0000 7f2cbdd9b700 1 --2- 172.21.15.72:0/109786775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0139170 0x7f2cc0121fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.115+0000 7f2cbdd9b700 1 -- 172.21.15.72:0/109786775 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb8009a70 con 0x7f2cc009e1d0 2023-10-03T10:12:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.115+0000 7f2cbdd9b700 1 --2- 172.21.15.72:0/109786775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cc009e1d0 0x7f2cc0121a80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400b530 tx=0x7f2cb400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.115+0000 7f2caeffd700 1 -- 172.21.15.72:0/109786775 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4011830 con 0x7f2cc009e1d0 2023-10-03T10:12:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.115+0000 7f2caeffd700 1 -- 172.21.15.72:0/109786775 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb4011990 con 0x7f2cc009e1d0 2023-10-03T10:12:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.115+0000 7f2cc4da7700 1 -- 172.21.15.72:0/109786775 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc00a3b00 con 0x7f2cc009e1d0 2023-10-03T10:12:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.115+0000 7f2caeffd700 1 -- 172.21.15.72:0/109786775 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4011d40 con 0x7f2cc009e1d0 2023-10-03T10:12:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.115+0000 7f2cc4da7700 1 -- 172.21.15.72:0/109786775 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc0124d80 con 0x7f2cc009e1d0 2023-10-03T10:12:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.116+0000 7f2caeffd700 1 -- 172.21.15.72:0/109786775 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2cb401a400 con 0x7f2cc009e1d0 2023-10-03T10:12:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.117+0000 7f2caeffd700 1 -- 172.21.15.72:0/109786775 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f2cb403fbb0 con 0x7f2cc009e1d0 2023-10-03T10:12:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.117+0000 7f2cbe59c700 1 -- 172.21.15.72:0/109786775 >> v1:172.21.15.72:6816/126756 conn(0x7f2ca002f510 legacy=0x7f2ca00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.117+0000 7f2cc4da7700 1 -- 172.21.15.72:0/109786775 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc0124a00 con 0x7f2cc009e1d0 2023-10-03T10:12:49.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.126+0000 7f2caeffd700 1 -- 172.21.15.72:0/109786775 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2cc0124a00 con 0x7f2cc009e1d0 2023-10-03T10:12:49.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.223+0000 7f9687fff700 1 -- 172.21.15.72:0/1089349512 >> v1:172.21.15.72:6816/126756 conn(0x7f967402f510 legacy=0x7f96740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:49.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.245+0000 7f968e2f2700 1 -- 172.21.15.72:0/1089349512 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f968809e720 con 0x7f968812f8b0 2023-10-03T10:12:49.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.245+0000 7f9684ff9700 1 -- 172.21.15.72:0/1089349512 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f968809e720 con 0x7f968812f8b0 2023-10-03T10:12:49.246 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:49.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.248+0000 7f968e2f2700 1 -- 172.21.15.72:0/1089349512 >> v1:172.21.15.72:6816/126756 conn(0x7f967402f510 legacy=0x7f96740319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:49.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.248+0000 7f968e2f2700 1 -- 172.21.15.72:0/1089349512 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f968812f8b0 msgr2=0x7f96881c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.248+0000 7f968e2f2700 1 --2- 172.21.15.72:0/1089349512 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f968812f8b0 0x7f96881c43d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f967c001eb0 tx=0x7f967c00c800 comp rx=0 tx=0).stop 2023-10-03T10:12:49.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.248+0000 7f968e2f2700 1 -- 172.21.15.72:0/1089349512 shutdown_connections 2023-10-03T10:12:49.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.248+0000 7f968e2f2700 1 --2- 172.21.15.72:0/1089349512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f968812cf60 0x7f96881c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.248+0000 7f968e2f2700 1 --2- 172.21.15.72:0/1089349512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9688130430 0x7f96881c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.248+0000 7f968e2f2700 1 --2- 172.21.15.72:0/1089349512 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f968812f8b0 0x7f96881c43d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.248+0000 7f968e2f2700 1 -- 172.21.15.72:0/1089349512 >> 172.21.15.72:0/1089349512 conn(0x7f96880a2aa0 msgr2=0x7f96881b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.248+0000 7f968e2f2700 1 -- 172.21.15.72:0/1089349512 shutdown_connections 2023-10-03T10:12:49.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.249+0000 7f968e2f2700 1 -- 172.21.15.72:0/1089349512 wait complete. 2023-10-03T10:12:49.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:49.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.277+0000 7feab0934700 1 -- 172.21.15.72:0/2384157483 >> v1:172.21.15.72:6816/126756 conn(0x7fea9002f510 legacy=0x7fea900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:49.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.280+0000 7feab2b98700 1 -- 172.21.15.72:0/2384157483 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feaac074ea0 con 0x7feaac1316c0 2023-10-03T10:12:49.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.280+0000 7feaa97fa700 1 -- 172.21.15.72:0/2384157483 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea9802b090 con 0x7feaac1316c0 2023-10-03T10:12:49.281 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.283+0000 7feab2b98700 1 -- 172.21.15.72:0/2384157483 >> v1:172.21.15.72:6816/126756 conn(0x7fea9002f510 legacy=0x7fea900319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.283+0000 7feab2b98700 1 -- 172.21.15.72:0/2384157483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feaac1316c0 msgr2=0x7feaac09a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.283+0000 7feab2b98700 1 --2- 172.21.15.72:0/2384157483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feaac1316c0 0x7feaac09a400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fea9800e7e0 tx=0x7fea9800eaf0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.283+0000 7feab2b98700 1 -- 172.21.15.72:0/2384157483 shutdown_connections 2023-10-03T10:12:49.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.283+0000 7feab2b98700 1 --2- 172.21.15.72:0/2384157483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feaac09d9f0 0x7feaac12ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.283+0000 7feab2b98700 1 --2- 172.21.15.72:0/2384157483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feaac136a70 0x7feaac09a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.283+0000 7feab2b98700 1 --2- 172.21.15.72:0/2384157483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feaac1316c0 0x7feaac09a400 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.283+0000 7feab2b98700 1 -- 172.21.15.72:0/2384157483 >> 172.21.15.72:0/2384157483 conn(0x7feaac066f50 msgr2=0x7feaac0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.283+0000 7feab2b98700 1 -- 172.21.15.72:0/2384157483 shutdown_connections 2023-10-03T10:12:49.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.283+0000 7feab2b98700 1 -- 172.21.15.72:0/2384157483 wait complete. 2023-10-03T10:12:49.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:49.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.308+0000 7f2a2bfff700 1 -- 172.21.15.72:0/4278065603 >> v1:172.21.15.72:6816/126756 conn(0x7f2a1002f510 legacy=0x7f2a100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:49.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.318+0000 7f2cbe59c700 1 -- 172.21.15.72:0/109786775 >> v1:172.21.15.72:6816/126756 conn(0x7f2ca002f510 legacy=0x7f2ca00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:49.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.319+0000 7f2a32abd700 1 -- 172.21.15.72:0/4278065603 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2a2c09c9d0 con 0x7f2a2c09d6f0 2023-10-03T10:12:49.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.319+0000 7f2a297fa700 1 -- 172.21.15.72:0/4278065603 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2a2001bba0 con 0x7f2a2c09d6f0 2023-10-03T10:12:49.320 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.322+0000 7f2a32abd700 1 -- 172.21.15.72:0/4278065603 >> v1:172.21.15.72:6816/126756 conn(0x7f2a1002f510 legacy=0x7f2a100319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.322+0000 7f2a32abd700 1 -- 172.21.15.72:0/4278065603 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c09d6f0 msgr2=0x7f2a2c122650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.322+0000 7f2a32abd700 1 --2- 172.21.15.72:0/4278065603 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c09d6f0 0x7f2a2c122650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000ec10 tx=0x7f2a2000ef20 comp rx=0 tx=0).stop 2023-10-03T10:12:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.322+0000 7f2a32abd700 1 -- 172.21.15.72:0/4278065603 shutdown_connections 2023-10-03T10:12:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.322+0000 7f2a32abd700 1 --2- 172.21.15.72:0/4278065603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c09e410 0x7f2a2c1230d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.322+0000 7f2a32abd700 1 --2- 172.21.15.72:0/4278065603 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c09d6f0 0x7f2a2c122650 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.322+0000 7f2a32abd700 1 --2- 172.21.15.72:0/4278065603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2c09e000 0x7f2a2c122b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.322+0000 7f2a32abd700 1 -- 172.21.15.72:0/4278065603 >> 172.21.15.72:0/4278065603 conn(0x7f2a2c066f50 msgr2=0x7f2a2c070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.322+0000 7f2a32abd700 1 -- 172.21.15.72:0/4278065603 shutdown_connections 2023-10-03T10:12:49.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.322+0000 7f2a32abd700 1 -- 172.21.15.72:0/4278065603 wait complete. 2023-10-03T10:12:49.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:49.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.340+0000 7f2cc4da7700 1 -- 172.21.15.72:0/109786775 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2cc0124a00 con 0x7f2cc009e1d0 2023-10-03T10:12:49.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.340+0000 7f2caeffd700 1 -- 172.21.15.72:0/109786775 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2cb4015080 con 0x7f2cc009e1d0 2023-10-03T10:12:49.341 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:49.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.342+0000 7f2cc4da7700 1 -- 172.21.15.72:0/109786775 >> v1:172.21.15.72:6816/126756 conn(0x7f2ca002f510 legacy=0x7f2ca00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:49.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.342+0000 7f2cc4da7700 1 -- 172.21.15.72:0/109786775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cc009e1d0 msgr2=0x7f2cc0121a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:49.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.342+0000 7f2cc4da7700 1 --2- 172.21.15.72:0/109786775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cc009e1d0 0x7f2cc0121a80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400b530 tx=0x7f2cb400b840 comp rx=0 tx=0).stop 2023-10-03T10:12:49.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.342+0000 7f2cc4da7700 1 -- 172.21.15.72:0/109786775 shutdown_connections 2023-10-03T10:12:49.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.342+0000 7f2cc4da7700 1 --2- 172.21.15.72:0/109786775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cc0139170 0x7f2cc0121fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.342+0000 7f2cc4da7700 1 --2- 172.21.15.72:0/109786775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2cc009d6f0 0x7f2cc0121540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.342+0000 7f2cc4da7700 1 --2- 172.21.15.72:0/109786775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2cc009e1d0 0x7f2cc0121a80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:49.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.342+0000 7f2cc4da7700 1 -- 172.21.15.72:0/109786775 >> 172.21.15.72:0/109786775 conn(0x7f2cc0066f50 msgr2=0x7f2cc0070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:49.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.342+0000 7f2cc4da7700 1 -- 172.21.15.72:0/109786775 shutdown_connections 2023-10-03T10:12:49.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:49.342+0000 7f2cc4da7700 1 -- 172.21.15.72:0/109786775 wait complete. 2023-10-03T10:12:49.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:50.267 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:50.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:50.340 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:50.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.406+0000 7f2e52026700 1 Processor -- start 2023-10-03T10:12:50.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.406+0000 7f2e52026700 1 -- start start 2023-10-03T10:12:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.407+0000 7f2e52026700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c09d6f0 0x7f2e4c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.407+0000 7f2e52026700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e4c09e000 0x7f2e4c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.407+0000 7f2e52026700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e4c09e410 0x7f2e4c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.407+0000 7f2e52026700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4c06b460 con 0x7f2e4c09e410 2023-10-03T10:12:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.407+0000 7f2e52026700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c09b120 con 0x7f2e4c09d6f0 2023-10-03T10:12:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.407+0000 7f2e52026700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c09a7e0 con 0x7f2e4c09e000 2023-10-03T10:12:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.407+0000 7f2e4b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c09d6f0 0x7f2e4c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.407+0000 7f2e4b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c09d6f0 0x7f2e4c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44868/0 (socket says 172.21.15.72:44868) 2023-10-03T10:12:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.407+0000 7f2e4b7fe700 1 -- 172.21.15.72:0/3595494959 learned_addr learned my addr 172.21.15.72:0/3595494959 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.407+0000 7f2e4b7fe700 1 -- 172.21.15.72:0/3595494959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e4c09e000 msgr2=0x7f2e4c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.407+0000 7f2e4b7fe700 1 --2- 172.21.15.72:0/3595494959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e4c09e000 0x7f2e4c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.407+0000 7f2e4b7fe700 1 -- 172.21.15.72:0/3595494959 >> v2:172.21.15.72:3300/0 conn(0x7f2e4c09e410 msgr2=0x7f2e4c133f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:12:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.407+0000 7f2e4b7fe700 1 --2- 172.21.15.72:0/3595494959 >> v2:172.21.15.72:3300/0 conn(0x7f2e4c09e410 0x7f2e4c133f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.407+0000 7f2e4b7fe700 1 -- 172.21.15.72:0/3595494959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c09a500 con 0x7f2e4c09d6f0 2023-10-03T10:12:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.408+0000 7f2e4b7fe700 1 --2- 172.21.15.72:0/3595494959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c09d6f0 0x7f2e4c09dac0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009920 tx=0x7f2e3c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbfcb8754977a66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.408+0000 7f2e4a7fc700 1 -- 172.21.15.72:0/3595494959 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00ba20 con 0x7f2e4c09d6f0 2023-10-03T10:12:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.408+0000 7f2e4a7fc700 1 -- 172.21.15.72:0/3595494959 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c00bb80 con 0x7f2e4c09d6f0 2023-10-03T10:12:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.408+0000 7f2e4a7fc700 1 -- 172.21.15.72:0/3595494959 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c009e70 con 0x7f2e4c09d6f0 2023-10-03T10:12:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.409+0000 7f2e52026700 1 -- 172.21.15.72:0/3595494959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c09d6f0 msgr2=0x7f2e4c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.409+0000 7f2e52026700 1 --2- 172.21.15.72:0/3595494959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c09d6f0 0x7f2e4c09dac0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009920 tx=0x7f2e3c009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.409+0000 7f2e52026700 1 -- 172.21.15.72:0/3595494959 shutdown_connections 2023-10-03T10:12:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.409+0000 7f2e52026700 1 --2- 172.21.15.72:0/3595494959 >> v2:172.21.15.72:3300/0 conn(0x7f2e4c09e410 0x7f2e4c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.409+0000 7f2e52026700 1 --2- 172.21.15.72:0/3595494959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c09d6f0 0x7f2e4c09dac0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.409+0000 7f2e52026700 1 --2- 172.21.15.72:0/3595494959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e4c09e000 0x7f2e4c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.409+0000 7f2e52026700 1 -- 172.21.15.72:0/3595494959 >> 172.21.15.72:0/3595494959 conn(0x7f2e4c066f50 msgr2=0x7f2e4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.409+0000 7f2e52026700 1 -- 172.21.15.72:0/3595494959 shutdown_connections 2023-10-03T10:12:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.409+0000 7f2e52026700 1 -- 172.21.15.72:0/3595494959 wait complete. 2023-10-03T10:12:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.410+0000 7f2e52026700 1 Processor -- start 2023-10-03T10:12:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.410+0000 7f2e52026700 1 -- start start 2023-10-03T10:12:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.410+0000 7f2e52026700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e4c09d6f0 0x7f2e4c122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.410+0000 7f2e52026700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e4c09e000 0x7f2e4c122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.410+0000 7f2e52026700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c09e410 0x7f2e4c123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.410+0000 7f2e52026700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c1242b0 con 0x7f2e4c09e000 2023-10-03T10:12:50.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.410+0000 7f2e52026700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c09c710 con 0x7f2e4c09e410 2023-10-03T10:12:50.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.410+0000 7f2e52026700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c125c20 con 0x7f2e4c09d6f0 2023-10-03T10:12:50.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.411+0000 7f2e4bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c09e410 0x7f2e4c123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.411+0000 7f2e4bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c09e410 0x7f2e4c123200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44884/0 (socket says 172.21.15.72:44884) 2023-10-03T10:12:50.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.411+0000 7f2e4bfff700 1 -- 172.21.15.72:0/3571074538 learned_addr learned my addr 172.21.15.72:0/3571074538 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:50.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.411+0000 7f2e4b7fe700 1 --2- 172.21.15.72:0/3571074538 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e4c09d6f0 0x7f2e4c122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.411+0000 7f2e4bfff700 1 -- 172.21.15.72:0/3571074538 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e4c09d6f0 msgr2=0x7f2e4c122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.411+0000 7f2e4bfff700 1 --2- 172.21.15.72:0/3571074538 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e4c09d6f0 0x7f2e4c122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.411+0000 7f2e4bfff700 1 -- 172.21.15.72:0/3571074538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e4c09e000 msgr2=0x7f2e4c122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.411+0000 7f2e4bfff700 1 --2- 172.21.15.72:0/3571074538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e4c09e000 0x7f2e4c122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.411+0000 7f2e4bfff700 1 -- 172.21.15.72:0/3571074538 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c009550 con 0x7f2e4c09e410 2023-10-03T10:12:50.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.411+0000 7f2e4b7fe700 1 --2- 172.21.15.72:0/3571074538 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e4c09d6f0 0x7f2e4c122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:50.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.411+0000 7f2e4bfff700 1 --2- 172.21.15.72:0/3571074538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c09e410 0x7f2e4c123200 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400b9e0 tx=0x7f2e4400bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.412+0000 7f2e33fff700 1 -- 172.21.15.72:0/3571074538 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4400c9b0 con 0x7f2e4c09e410 2023-10-03T10:12:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.412+0000 7f2e52026700 1 -- 172.21.15.72:0/3571074538 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4c133660 con 0x7f2e4c09e410 2023-10-03T10:12:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.412+0000 7f2e33fff700 1 -- 172.21.15.72:0/3571074538 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4400cb50 con 0x7f2e4c09e410 2023-10-03T10:12:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.412+0000 7f2e33fff700 1 -- 172.21.15.72:0/3571074538 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44014440 con 0x7f2e4c09e410 2023-10-03T10:12:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.412+0000 7f2e52026700 1 -- 172.21.15.72:0/3571074538 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c1266c0 con 0x7f2e4c09e410 2023-10-03T10:12:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.413+0000 7f2e33fff700 1 -- 172.21.15.72:0/3571074538 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2e440145a0 con 0x7f2e4c09e410 2023-10-03T10:12:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.413+0000 7f2e4b7fe700 1 -- 172.21.15.72:0/3571074538 >> v1:172.21.15.72:6816/126756 conn(0x7f2e3802f510 legacy=0x7f2e380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.413+0000 7f2e33fff700 1 -- 172.21.15.72:0/3571074538 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f2e4403f900 con 0x7f2e4c09e410 2023-10-03T10:12:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.413+0000 7f2e52026700 1 -- 172.21.15.72:0/3571074538 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c125e40 con 0x7f2e4c09e410 2023-10-03T10:12:50.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.421+0000 7f2e33fff700 1 -- 172.21.15.72:0/3571074538 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e4c125e40 con 0x7f2e4c09e410 2023-10-03T10:12:50.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.446+0000 7f40d61b1700 1 Processor -- start 2023-10-03T10:12:50.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.446+0000 7f40d61b1700 1 -- start start 2023-10-03T10:12:50.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40d61b1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d006a770 0x7f40d009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40d61b1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40d009dc30 0x7f40d009e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40d61b1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d013c1e0 0x7f40d013e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40d61b1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d006ab40 con 0x7f40d009dc30 2023-10-03T10:12:50.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40d61b1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d009ebc0 con 0x7f40d006a770 2023-10-03T10:12:50.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40d61b1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40d009a810 con 0x7f40d013c1e0 2023-10-03T10:12:50.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40cf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d006a770 0x7f40d009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40cffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d013c1e0 0x7f40d013e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40cf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d006a770 0x7f40d009d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44890/0 (socket says 172.21.15.72:44890) 2023-10-03T10:12:50.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40cffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d013c1e0 0x7f40d013e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59518/0 (socket says 172.21.15.72:59518) 2023-10-03T10:12:50.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40cf7fe700 1 -- 172.21.15.72:0/3510726958 learned_addr learned my addr 172.21.15.72:0/3510726958 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:50.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40ceffd700 1 --2- 172.21.15.72:0/3510726958 >> v2:172.21.15.72:3300/0 conn(0x7f40d009dc30 0x7f40d009e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40cffff700 1 -- 172.21.15.72:0/3510726958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d006a770 msgr2=0x7f40d009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40cffff700 1 --2- 172.21.15.72:0/3510726958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d006a770 0x7f40d009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40cffff700 1 -- 172.21.15.72:0/3510726958 >> v2:172.21.15.72:3300/0 conn(0x7f40d009dc30 msgr2=0x7f40d009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40cffff700 1 --2- 172.21.15.72:0/3510726958 >> v2:172.21.15.72:3300/0 conn(0x7f40d009dc30 0x7f40d009e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40cffff700 1 -- 172.21.15.72:0/3510726958 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d009e920 con 0x7f40d013c1e0 2023-10-03T10:12:50.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.447+0000 7f40cf7fe700 1 --2- 172.21.15.72:0/3510726958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d006a770 0x7f40d009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:50.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.448+0000 7f40cffff700 1 --2- 172.21.15.72:0/3510726958 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d013c1e0 0x7f40d013e5c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009dc0 tx=0x7f40c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f07d1c33899c4a34 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.448+0000 7f40ce7fc700 1 -- 172.21.15.72:0/3510726958 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c800e070 con 0x7f40d013c1e0 2023-10-03T10:12:50.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.448+0000 7f40ce7fc700 1 -- 172.21.15.72:0/3510726958 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c800bae0 con 0x7f40d013c1e0 2023-10-03T10:12:50.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.448+0000 7f40ce7fc700 1 -- 172.21.15.72:0/3510726958 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c800be90 con 0x7f40d013c1e0 2023-10-03T10:12:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.448+0000 7f40d61b1700 1 -- 172.21.15.72:0/3510726958 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d013c1e0 msgr2=0x7f40d013e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.448+0000 7f40d61b1700 1 --2- 172.21.15.72:0/3510726958 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d013c1e0 0x7f40d013e5c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009dc0 tx=0x7f40c800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.448+0000 7f40d61b1700 1 -- 172.21.15.72:0/3510726958 shutdown_connections 2023-10-03T10:12:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.448+0000 7f40d61b1700 1 --2- 172.21.15.72:0/3510726958 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d013c1e0 0x7f40d013e5c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.448+0000 7f40d61b1700 1 --2- 172.21.15.72:0/3510726958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d006a770 0x7f40d009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.448+0000 7f40d61b1700 1 --2- 172.21.15.72:0/3510726958 >> v2:172.21.15.72:3300/0 conn(0x7f40d009dc30 0x7f40d009e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.449+0000 7f40d61b1700 1 -- 172.21.15.72:0/3510726958 >> 172.21.15.72:0/3510726958 conn(0x7f40d0066f50 msgr2=0x7f40d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.449+0000 7f40d61b1700 1 -- 172.21.15.72:0/3510726958 shutdown_connections 2023-10-03T10:12:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.449+0000 7f40d61b1700 1 -- 172.21.15.72:0/3510726958 wait complete. 2023-10-03T10:12:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.449+0000 7f40d61b1700 1 Processor -- start 2023-10-03T10:12:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.450+0000 7f40d61b1700 1 -- start start 2023-10-03T10:12:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.450+0000 7f40d61b1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d006a770 0x7f40d01cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.450+0000 7f40d61b1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009dc30 0x7f40d01ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.450+0000 7f40d61b1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d013c1e0 0x7f40d0127350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.450+0000 7f40d61b1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d012a730 con 0x7f40d009dc30 2023-10-03T10:12:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.450+0000 7f40d61b1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00a3860 con 0x7f40d006a770 2023-10-03T10:12:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.450+0000 7f40d61b1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40d009f1a0 con 0x7f40d013c1e0 2023-10-03T10:12:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.450+0000 7f40cf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d006a770 0x7f40d01cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.450+0000 7f40ceffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009dc30 0x7f40d01ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.450+0000 7f40cf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d006a770 0x7f40d01cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44906/0 (socket says 172.21.15.72:44906) 2023-10-03T10:12:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.450+0000 7f40cf7fe700 1 -- 172.21.15.72:0/2086415481 learned_addr learned my addr 172.21.15.72:0/2086415481 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.450+0000 7f40cffff700 1 --2- 172.21.15.72:0/2086415481 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d013c1e0 0x7f40d0127350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.451+0000 7f40ceffd700 1 -- 172.21.15.72:0/2086415481 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d013c1e0 msgr2=0x7f40d0127350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.451+0000 7f40ceffd700 1 --2- 172.21.15.72:0/2086415481 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d013c1e0 0x7f40d0127350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.451+0000 7f40ceffd700 1 -- 172.21.15.72:0/2086415481 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d006a770 msgr2=0x7f40d01cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.451+0000 7f40ceffd700 1 --2- 172.21.15.72:0/2086415481 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d006a770 0x7f40d01cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.451+0000 7f40ceffd700 1 -- 172.21.15.72:0/2086415481 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c0009550 con 0x7f40d009dc30 2023-10-03T10:12:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.451+0000 7f40ceffd700 1 --2- 172.21.15.72:0/2086415481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009dc30 0x7f40d01ccd00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f40c400e7e0 tx=0x7f40c400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.451+0000 7f40b7fff700 1 -- 172.21.15.72:0/2086415481 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c400c070 con 0x7f40d009dc30 2023-10-03T10:12:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.451+0000 7f40b7fff700 1 -- 172.21.15.72:0/2086415481 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c4004020 con 0x7f40d009dc30 2023-10-03T10:12:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.451+0000 7f40b7fff700 1 -- 172.21.15.72:0/2086415481 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c40043d0 con 0x7f40d009dc30 2023-10-03T10:12:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.451+0000 7f40d61b1700 1 -- 172.21.15.72:0/2086415481 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c8009a70 con 0x7f40d009dc30 2023-10-03T10:12:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.451+0000 7f40d61b1700 1 -- 172.21.15.72:0/2086415481 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d01cd240 con 0x7f40d009dc30 2023-10-03T10:12:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.452+0000 7f40b7fff700 1 -- 172.21.15.72:0/2086415481 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f40c40036a0 con 0x7f40d009dc30 2023-10-03T10:12:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.452+0000 7f40d61b1700 1 -- 172.21.15.72:0/2086415481 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d012ada0 con 0x7f40d009dc30 2023-10-03T10:12:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.452+0000 7f40b7fff700 1 -- 172.21.15.72:0/2086415481 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f40c403f470 con 0x7f40d009dc30 2023-10-03T10:12:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.452+0000 7f40cf7fe700 1 -- 172.21.15.72:0/2086415481 >> v1:172.21.15.72:6816/126756 conn(0x7f40bc02f510 legacy=0x7f40bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.457+0000 7f40b7fff700 1 -- 172.21.15.72:0/2086415481 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40c401c410 con 0x7f40d009dc30 2023-10-03T10:12:50.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.498+0000 7fd95af6e700 1 Processor -- start 2023-10-03T10:12:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.498+0000 7fd95af6e700 1 -- start start 2023-10-03T10:12:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.498+0000 7fd95af6e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd95412cf60 0x7fd95406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.498+0000 7fd95af6e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd95412f8b0 0x7fd95412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.498+0000 7fd95af6e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95412cd90 con 0x7fd954130260 2023-10-03T10:12:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.498+0000 7fd95af6e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95412d330 con 0x7fd95412cf60 2023-10-03T10:12:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.498+0000 7fd95af6e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9541306d0 con 0x7fd95412f8b0 2023-10-03T10:12:50.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.498+0000 7fd953fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd95412f8b0 0x7fd95412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.498+0000 7fd953fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd95412f8b0 0x7fd95412fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59530/0 (socket says 172.21.15.72:59530) 2023-10-03T10:12:50.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.498+0000 7fd953fff700 1 -- 172.21.15.72:0/1549031250 learned_addr learned my addr 172.21.15.72:0/1549031250 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:50.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.498+0000 7fd958d0a700 1 --2- 172.21.15.72:0/1549031250 >> v2:172.21.15.72:3300/0 conn(0x7fd95412cf60 0x7fd95406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.499+0000 7fd9537fe700 1 -- 172.21.15.72:0/1549031250 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428624566 0 0) 0x7fd95412cd90 con 0x7fd954130260 2023-10-03T10:12:50.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.499+0000 7fd9537fe700 1 -- 172.21.15.72:0/1549031250 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9440035b0 con 0x7fd954130260 2023-10-03T10:12:50.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.499+0000 7fd958d0a700 1 -- 172.21.15.72:0/1549031250 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd95412f8b0 msgr2=0x7fd95412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.499+0000 7fd958d0a700 1 --2- 172.21.15.72:0/1549031250 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd95412f8b0 0x7fd95412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.499+0000 7fd958d0a700 1 -- 172.21.15.72:0/1549031250 >> v1:172.21.15.72:6789/0 conn(0x7fd954130260 legacy=0x7fd954136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.499+0000 7fd958d0a700 1 -- 172.21.15.72:0/1549031250 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd954071780 con 0x7fd95412cf60 2023-10-03T10:12:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.499+0000 7fd958d0a700 1 --2- 172.21.15.72:0/1549031250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95412cf60 0x7fd95406f5d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd948009840 tx=0x7fd948009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caac47e43e99d449 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.499+0000 7fd9537fe700 1 -- 172.21.15.72:0/1549031250 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd948011830 con 0x7fd95412cf60 2023-10-03T10:12:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.499+0000 7fd9537fe700 1 -- 172.21.15.72:0/1549031250 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd948011990 con 0x7fd95412cf60 2023-10-03T10:12:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.499+0000 7fd9537fe700 1 -- 172.21.15.72:0/1549031250 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd948011d20 con 0x7fd95412cf60 2023-10-03T10:12:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.500+0000 7fd95af6e700 1 -- 172.21.15.72:0/1549031250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95412cf60 msgr2=0x7fd95406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.500+0000 7fd95af6e700 1 --2- 172.21.15.72:0/1549031250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95412cf60 0x7fd95406f5d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd948009840 tx=0x7fd948009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.500+0000 7fd95af6e700 1 -- 172.21.15.72:0/1549031250 shutdown_connections 2023-10-03T10:12:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.500+0000 7fd95af6e700 1 --2- 172.21.15.72:0/1549031250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95412cf60 0x7fd95406f5d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.500+0000 7fd95af6e700 1 --2- 172.21.15.72:0/1549031250 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd95412f8b0 0x7fd95412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.500+0000 7fd95af6e700 1 -- 172.21.15.72:0/1549031250 >> 172.21.15.72:0/1549031250 conn(0x7fd9540a2aa0 msgr2=0x7fd9540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.500+0000 7fd95af6e700 1 -- 172.21.15.72:0/1549031250 shutdown_connections 2023-10-03T10:12:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.500+0000 7fd95af6e700 1 -- 172.21.15.72:0/1549031250 wait complete. 2023-10-03T10:12:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.501+0000 7fd95af6e700 1 Processor -- start 2023-10-03T10:12:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.501+0000 7fd95af6e700 1 -- start start 2023-10-03T10:12:50.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.502+0000 7fd95af6e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd95412cf60 0x7fd9541c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.502+0000 7fd95af6e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95412f8b0 0x7fd9541c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.502+0000 7fd95af6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd954130260 0x7fd9541c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.502+0000 7fd95af6e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95409eb40 con 0x7fd95412f8b0 2023-10-03T10:12:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.502+0000 7fd95af6e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95409ce30 con 0x7fd954130260 2023-10-03T10:12:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.502+0000 7fd95af6e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd95409ed40 con 0x7fd95412cf60 2023-10-03T10:12:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd953fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95412f8b0 0x7fd9541c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd953fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95412f8b0 0x7fd9541c4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60402/0 (socket says 172.21.15.72:60402) 2023-10-03T10:12:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd953fff700 1 -- 172.21.15.72:0/885504647 learned_addr learned my addr 172.21.15.72:0/885504647 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd95950b700 1 --2- 172.21.15.72:0/885504647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd954130260 0x7fd9541c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd958d0a700 1 --2- 172.21.15.72:0/885504647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd95412cf60 0x7fd9541c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd953fff700 1 -- 172.21.15.72:0/885504647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd95412cf60 msgr2=0x7fd9541c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd953fff700 1 --2- 172.21.15.72:0/885504647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd95412cf60 0x7fd9541c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd953fff700 1 -- 172.21.15.72:0/885504647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd954130260 msgr2=0x7fd9541c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd953fff700 1 --2- 172.21.15.72:0/885504647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd954130260 0x7fd9541c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd953fff700 1 -- 172.21.15.72:0/885504647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9480094a0 con 0x7fd95412f8b0 2023-10-03T10:12:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd958d0a700 1 --2- 172.21.15.72:0/885504647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd95412cf60 0x7fd9541c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd95950b700 1 --2- 172.21.15.72:0/885504647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd954130260 0x7fd9541c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd953fff700 1 --2- 172.21.15.72:0/885504647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95412f8b0 0x7fd9541c4490 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd94000dd50 tx=0x7fd94000f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd9517fa700 1 -- 172.21.15.72:0/885504647 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94000a190 con 0x7fd95412f8b0 2023-10-03T10:12:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd9517fa700 1 -- 172.21.15.72:0/885504647 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94000fdb0 con 0x7fd95412f8b0 2023-10-03T10:12:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd95af6e700 1 -- 172.21.15.72:0/885504647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd954067d40 con 0x7fd95412f8b0 2023-10-03T10:12:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.503+0000 7fd95af6e700 1 -- 172.21.15.72:0/885504647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd954129a90 con 0x7fd95412f8b0 2023-10-03T10:12:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.504+0000 7fd9517fa700 1 -- 172.21.15.72:0/885504647 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940015630 con 0x7fd95412f8b0 2023-10-03T10:12:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.505+0000 7fd95af6e700 1 -- 172.21.15.72:0/885504647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9340052e0 con 0x7fd95412f8b0 2023-10-03T10:12:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.505+0000 7fd9517fa700 1 -- 172.21.15.72:0/885504647 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd940015790 con 0x7fd95412f8b0 2023-10-03T10:12:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.505+0000 7fd9517fa700 1 -- 172.21.15.72:0/885504647 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd940012070 con 0x7fd95412f8b0 2023-10-03T10:12:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.505+0000 7fd958d0a700 1 -- 172.21.15.72:0/885504647 >> v1:172.21.15.72:6816/126756 conn(0x7fd93802f510 legacy=0x7fd9380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:50.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.514+0000 7fd9517fa700 1 -- 172.21.15.72:0/885504647 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd94001b8b0 con 0x7fd95412f8b0 2023-10-03T10:12:50.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.538+0000 7f6faa724700 1 Processor -- start 2023-10-03T10:12:50.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.538+0000 7f6faa724700 1 -- start start 2023-10-03T10:12:50.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.539+0000 7f6faa724700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6fa4136710 0x7f6fa4138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.539+0000 7f6faa724700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fa4139030 0x7f6fa413b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.539+0000 7f6faa724700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa406ef30 con 0x7f6fa41338a0 2023-10-03T10:12:50.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.539+0000 7f6faa724700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa406fef0 con 0x7f6fa4136710 2023-10-03T10:12:50.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.539+0000 7f6faa724700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa41334b0 con 0x7f6fa4139030 2023-10-03T10:12:50.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.539+0000 7f6fa8cc1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fa4139030 0x7f6fa413b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.539+0000 7f6fa3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6fa41338a0 0x7f6fa4133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59772/0 (socket says 172.21.15.72:59772) 2023-10-03T10:12:50.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.539+0000 7f6fa3fff700 1 -- 172.21.15.72:0/2511387688 learned_addr learned my addr 172.21.15.72:0/2511387688 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:50.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.539+0000 7f6fa37fe700 1 --2- 172.21.15.72:0/2511387688 >> v2:172.21.15.72:3300/0 conn(0x7f6fa4136710 0x7f6fa4138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.540+0000 7f6fa37fe700 1 -- 172.21.15.72:0/2511387688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fa4139030 msgr2=0x7f6fa413b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:50.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.540+0000 7f6fa37fe700 1 --2- 172.21.15.72:0/2511387688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fa4139030 0x7f6fa413b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.540+0000 7f6fa37fe700 1 -- 172.21.15.72:0/2511387688 >> v1:172.21.15.72:6789/0 conn(0x7f6fa41338a0 legacy=0x7f6fa4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.540+0000 7f6fa37fe700 1 -- 172.21.15.72:0/2511387688 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa406fc30 con 0x7f6fa4136710 2023-10-03T10:12:50.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.540+0000 7f6fa2ffd700 1 -- 172.21.15.72:0/2511387688 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844637207 0 0) 0x7f6fa406ef30 con 0x7f6fa41338a0 2023-10-03T10:12:50.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.540+0000 7f6fa8cc1700 1 --2- 172.21.15.72:0/2511387688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fa4139030 0x7f6fa413b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:50.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.540+0000 7f6fa37fe700 1 --2- 172.21.15.72:0/2511387688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa4136710 0x7f6fa4138af0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009840 tx=0x7f6f98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d4c883e81fe65d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.540+0000 7f6fa2ffd700 1 -- 172.21.15.72:0/2511387688 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98011830 con 0x7f6fa4136710 2023-10-03T10:12:50.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.540+0000 7f6fa2ffd700 1 -- 172.21.15.72:0/2511387688 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f98011990 con 0x7f6fa4136710 2023-10-03T10:12:50.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.540+0000 7f6fa2ffd700 1 -- 172.21.15.72:0/2511387688 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98011d20 con 0x7f6fa4136710 2023-10-03T10:12:50.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.541+0000 7f6faa724700 1 -- 172.21.15.72:0/2511387688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa4136710 msgr2=0x7f6fa4138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.541+0000 7f6faa724700 1 --2- 172.21.15.72:0/2511387688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa4136710 0x7f6fa4138af0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009840 tx=0x7f6f98009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:50.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.541+0000 7f6faa724700 1 -- 172.21.15.72:0/2511387688 shutdown_connections 2023-10-03T10:12:50.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.541+0000 7f6faa724700 1 --2- 172.21.15.72:0/2511387688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fa4139030 0x7f6fa413b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.541+0000 7f6faa724700 1 --2- 172.21.15.72:0/2511387688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa4136710 0x7f6fa4138af0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.541+0000 7f6faa724700 1 -- 172.21.15.72:0/2511387688 >> 172.21.15.72:0/2511387688 conn(0x7f6fa40a2aa0 msgr2=0x7f6fa40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.541+0000 7f6faa724700 1 -- 172.21.15.72:0/2511387688 shutdown_connections 2023-10-03T10:12:50.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.541+0000 7f6faa724700 1 -- 172.21.15.72:0/2511387688 wait complete. 2023-10-03T10:12:50.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.542+0000 7f6faa724700 1 Processor -- start 2023-10-03T10:12:50.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.543+0000 7f6faa724700 1 -- start start 2023-10-03T10:12:50.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.543+0000 7f6faa724700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa41338a0 0x7f6fa41c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.543+0000 7f6faa724700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6fa4136710 0x7f6fa41c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.543+0000 7f6faa724700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fa4139030 0x7f6fa411adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:50.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.543+0000 7f6faa724700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa411e930 con 0x7f6fa41338a0 2023-10-03T10:12:50.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.543+0000 7f6faa724700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa411e4e0 con 0x7f6fa4139030 2023-10-03T10:12:50.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.543+0000 7f6faa724700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa41be1b0 con 0x7f6fa4136710 2023-10-03T10:12:50.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.543+0000 7f6fa3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa41338a0 0x7f6fa41c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.543+0000 7f6fa8cc1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fa4139030 0x7f6fa411adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.543+0000 7f6fa3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa41338a0 0x7f6fa41c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60432/0 (socket says 172.21.15.72:60432) 2023-10-03T10:12:50.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.543+0000 7f6fa3fff700 1 -- 172.21.15.72:0/1321102316 learned_addr learned my addr 172.21.15.72:0/1321102316 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:50.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.544+0000 7f6fa37fe700 1 --2- 172.21.15.72:0/1321102316 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6fa4136710 0x7f6fa41c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:50.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.544+0000 7f6fa3fff700 1 -- 172.21.15.72:0/1321102316 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6fa4136710 msgr2=0x7f6fa41c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.544+0000 7f6fa3fff700 1 --2- 172.21.15.72:0/1321102316 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6fa4136710 0x7f6fa41c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.544+0000 7f6fa3fff700 1 -- 172.21.15.72:0/1321102316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fa4139030 msgr2=0x7f6fa411adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.544+0000 7f6fa3fff700 1 --2- 172.21.15.72:0/1321102316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fa4139030 0x7f6fa411adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.544+0000 7f6fa3fff700 1 -- 172.21.15.72:0/1321102316 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c009a70 con 0x7f6fa41338a0 2023-10-03T10:12:50.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.544+0000 7f6fa3fff700 1 --2- 172.21.15.72:0/1321102316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa41338a0 0x7f6fa41c8400 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400c550 tx=0x7f6f9400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:50.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.544+0000 7f6fa0ff9700 1 -- 172.21.15.72:0/1321102316 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94004c80 con 0x7f6fa41338a0 2023-10-03T10:12:50.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.544+0000 7f6fa0ff9700 1 -- 172.21.15.72:0/1321102316 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f94004e00 con 0x7f6fa41338a0 2023-10-03T10:12:50.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.544+0000 7f6faa724700 1 -- 172.21.15.72:0/1321102316 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f980094a0 con 0x7f6fa41338a0 2023-10-03T10:12:50.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.544+0000 7f6fa0ff9700 1 -- 172.21.15.72:0/1321102316 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94007310 con 0x7f6fa41338a0 2023-10-03T10:12:50.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.544+0000 7f6faa724700 1 -- 172.21.15.72:0/1321102316 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa406f640 con 0x7f6fa41338a0 2023-10-03T10:12:50.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.545+0000 7f6fa0ff9700 1 -- 172.21.15.72:0/1321102316 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6f94007470 con 0x7f6fa41338a0 2023-10-03T10:12:50.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.546+0000 7f6fa0ff9700 1 -- 172.21.15.72:0/1321102316 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f6f9403f830 con 0x7f6fa41338a0 2023-10-03T10:12:50.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.546+0000 7f6faa724700 1 -- 172.21.15.72:0/1321102316 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa4074ea0 con 0x7f6fa41338a0 2023-10-03T10:12:50.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.547+0000 7f6fa37fe700 1 -- 172.21.15.72:0/1321102316 >> v1:172.21.15.72:6816/126756 conn(0x7f6f9002f510 legacy=0x7f6f900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:50.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.550+0000 7f6fa0ff9700 1 -- 172.21.15.72:0/1321102316 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f940123b0 con 0x7f6fa41338a0 2023-10-03T10:12:50.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.614+0000 7f2e4b7fe700 1 -- 172.21.15.72:0/3571074538 >> v1:172.21.15.72:6816/126756 conn(0x7f2e3802f510 legacy=0x7f2e380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.642+0000 7f2e52026700 1 -- 172.21.15.72:0/3571074538 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2e4c125e40 con 0x7f2e4c09e410 2023-10-03T10:12:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.643+0000 7f2e33fff700 1 -- 172.21.15.72:0/3571074538 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2e4c125e40 con 0x7f2e4c09e410 2023-10-03T10:12:50.644 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:50.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.645+0000 7f2e52026700 1 -- 172.21.15.72:0/3571074538 >> v1:172.21.15.72:6816/126756 conn(0x7f2e3802f510 legacy=0x7f2e380319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:50.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.645+0000 7f2e52026700 1 -- 172.21.15.72:0/3571074538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c09e410 msgr2=0x7f2e4c123200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.645+0000 7f2e52026700 1 --2- 172.21.15.72:0/3571074538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c09e410 0x7f2e4c123200 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400b9e0 tx=0x7f2e4400bda0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.645+0000 7f2e52026700 1 -- 172.21.15.72:0/3571074538 shutdown_connections 2023-10-03T10:12:50.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.645+0000 7f2e52026700 1 --2- 172.21.15.72:0/3571074538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e4c09e410 0x7f2e4c123200 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.645+0000 7f2e52026700 1 --2- 172.21.15.72:0/3571074538 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e4c09d6f0 0x7f2e4c122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.645+0000 7f2e52026700 1 --2- 172.21.15.72:0/3571074538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e4c09e000 0x7f2e4c122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.645+0000 7f2e52026700 1 -- 172.21.15.72:0/3571074538 >> 172.21.15.72:0/3571074538 conn(0x7f2e4c066f50 msgr2=0x7f2e4c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.645+0000 7f2e52026700 1 -- 172.21.15.72:0/3571074538 shutdown_connections 2023-10-03T10:12:50.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.645+0000 7f2e52026700 1 -- 172.21.15.72:0/3571074538 wait complete. 2023-10-03T10:12:50.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.653+0000 7f40cf7fe700 1 -- 172.21.15.72:0/2086415481 >> v1:172.21.15.72:6816/126756 conn(0x7f40bc02f510 legacy=0x7f40bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:50.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.702+0000 7f40d61b1700 1 -- 172.21.15.72:0/2086415481 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f40d0074ea0 con 0x7f40d009dc30 2023-10-03T10:12:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.703+0000 7f40b7fff700 1 -- 172.21.15.72:0/2086415481 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40c4017020 con 0x7f40d009dc30 2023-10-03T10:12:50.703 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.705+0000 7f40d61b1700 1 -- 172.21.15.72:0/2086415481 >> v1:172.21.15.72:6816/126756 conn(0x7f40bc02f510 legacy=0x7f40bc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.705+0000 7f40d61b1700 1 -- 172.21.15.72:0/2086415481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009dc30 msgr2=0x7f40d01ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.705+0000 7f40d61b1700 1 --2- 172.21.15.72:0/2086415481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009dc30 0x7f40d01ccd00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f40c400e7e0 tx=0x7f40c400eaf0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.705+0000 7f40d61b1700 1 -- 172.21.15.72:0/2086415481 shutdown_connections 2023-10-03T10:12:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.705+0000 7f40d61b1700 1 --2- 172.21.15.72:0/2086415481 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d013c1e0 0x7f40d0127350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.705+0000 7f40d61b1700 1 --2- 172.21.15.72:0/2086415481 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d006a770 0x7f40d01cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.705+0000 7f40d61b1700 1 --2- 172.21.15.72:0/2086415481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009dc30 0x7f40d01ccd00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.705+0000 7f40d61b1700 1 -- 172.21.15.72:0/2086415481 >> 172.21.15.72:0/2086415481 conn(0x7f40d0066f50 msgr2=0x7f40d00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.705+0000 7f40d61b1700 1 -- 172.21.15.72:0/2086415481 shutdown_connections 2023-10-03T10:12:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.705+0000 7f40d61b1700 1 -- 172.21.15.72:0/2086415481 wait complete. 2023-10-03T10:12:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.706+0000 7fd958d0a700 1 -- 172.21.15.72:0/885504647 >> v1:172.21.15.72:6816/126756 conn(0x7fd93802f510 legacy=0x7fd9380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:50.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:50.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.720+0000 7fd95af6e700 1 -- 172.21.15.72:0/885504647 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd934005860 con 0x7fd95412f8b0 2023-10-03T10:12:50.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.720+0000 7fd9517fa700 1 -- 172.21.15.72:0/885504647 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd940019070 con 0x7fd95412f8b0 2023-10-03T10:12:50.721 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:50.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.722+0000 7fd95af6e700 1 -- 172.21.15.72:0/885504647 >> v1:172.21.15.72:6816/126756 conn(0x7fd93802f510 legacy=0x7fd9380319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:50.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.722+0000 7fd95af6e700 1 -- 172.21.15.72:0/885504647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95412f8b0 msgr2=0x7fd9541c4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.722+0000 7fd95af6e700 1 --2- 172.21.15.72:0/885504647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95412f8b0 0x7fd9541c4490 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd94000dd50 tx=0x7fd94000f390 comp rx=0 tx=0).stop 2023-10-03T10:12:50.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.722+0000 7fd95af6e700 1 -- 172.21.15.72:0/885504647 shutdown_connections 2023-10-03T10:12:50.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.722+0000 7fd95af6e700 1 --2- 172.21.15.72:0/885504647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd954130260 0x7fd9541c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.722+0000 7fd95af6e700 1 --2- 172.21.15.72:0/885504647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd95412cf60 0x7fd9541c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.722+0000 7fd95af6e700 1 --2- 172.21.15.72:0/885504647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95412f8b0 0x7fd9541c4490 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.723+0000 7fd95af6e700 1 -- 172.21.15.72:0/885504647 >> 172.21.15.72:0/885504647 conn(0x7fd9540a2aa0 msgr2=0x7fd9540a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.723+0000 7fd95af6e700 1 -- 172.21.15.72:0/885504647 shutdown_connections 2023-10-03T10:12:50.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.723+0000 7fd95af6e700 1 -- 172.21.15.72:0/885504647 wait complete. 2023-10-03T10:12:50.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:50.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.748+0000 7f6fa37fe700 1 -- 172.21.15.72:0/1321102316 >> v1:172.21.15.72:6816/126756 conn(0x7f6f9002f510 legacy=0x7f6f900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.785+0000 7f6faa724700 1 -- 172.21.15.72:0/1321102316 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6fa411e6e0 con 0x7f6fa41338a0 2023-10-03T10:12:50.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.785+0000 7f6fa0ff9700 1 -- 172.21.15.72:0/1321102316 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f940102c0 con 0x7f6fa41338a0 2023-10-03T10:12:50.786 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.787+0000 7f6faa724700 1 -- 172.21.15.72:0/1321102316 >> v1:172.21.15.72:6816/126756 conn(0x7f6f9002f510 legacy=0x7f6f900319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.787+0000 7f6faa724700 1 -- 172.21.15.72:0/1321102316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa41338a0 msgr2=0x7f6fa41c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.787+0000 7f6faa724700 1 --2- 172.21.15.72:0/1321102316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa41338a0 0x7f6fa41c8400 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400c550 tx=0x7f6f9400c910 comp rx=0 tx=0).stop 2023-10-03T10:12:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.787+0000 7f6faa724700 1 -- 172.21.15.72:0/1321102316 shutdown_connections 2023-10-03T10:12:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.787+0000 7f6faa724700 1 --2- 172.21.15.72:0/1321102316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa41338a0 0x7f6fa41c8400 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.787+0000 7f6faa724700 1 --2- 172.21.15.72:0/1321102316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fa4139030 0x7f6fa411adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.787+0000 7f6faa724700 1 --2- 172.21.15.72:0/1321102316 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6fa4136710 0x7f6fa41c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.787+0000 7f6faa724700 1 -- 172.21.15.72:0/1321102316 >> 172.21.15.72:0/1321102316 conn(0x7f6fa40a2aa0 msgr2=0x7f6fa40a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.787+0000 7f6faa724700 1 -- 172.21.15.72:0/1321102316 shutdown_connections 2023-10-03T10:12:50.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:50.787+0000 7f6faa724700 1 -- 172.21.15.72:0/1321102316 wait complete. 2023-10-03T10:12:50.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:51.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:51.719 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:51.736 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:51.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.799+0000 7f058749f700 1 Processor -- start 2023-10-03T10:12:51.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.799+0000 7f058749f700 1 -- start start 2023-10-03T10:12:51.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:51.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.799+0000 7f058749f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05801338a0 0x7f0580133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.799+0000 7f058749f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058009de50 0x7f058009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.799+0000 7f058749f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058006ef30 con 0x7f058009e760 2023-10-03T10:12:51.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.799+0000 7f058749f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058006fef0 con 0x7f05801338a0 2023-10-03T10:12:51.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.799+0000 7f058749f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05801334b0 con 0x7f058009de50 2023-10-03T10:12:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.800+0000 7f0584a3a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058009de50 0x7f058009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.800+0000 7f0584a3a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058009de50 0x7f058009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59542/0 (socket says 172.21.15.72:59542) 2023-10-03T10:12:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.800+0000 7f0584a3a700 1 -- 172.21.15.72:0/2668743832 learned_addr learned my addr 172.21.15.72:0/2668743832 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.800+0000 7f058523b700 1 --2- 172.21.15.72:0/2668743832 >> v2:172.21.15.72:3300/0 conn(0x7f05801338a0 0x7f0580133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.800+0000 7f0584a3a700 1 -- 172.21.15.72:0/2668743832 >> v2:172.21.15.72:3300/0 conn(0x7f05801338a0 msgr2=0x7f0580133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.800+0000 7f0584a3a700 1 --2- 172.21.15.72:0/2668743832 >> v2:172.21.15.72:3300/0 conn(0x7f05801338a0 0x7f0580133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.800+0000 7f0584a3a700 1 -- 172.21.15.72:0/2668743832 >> v1:172.21.15.72:6789/0 conn(0x7f058009e760 legacy=0x7f058013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.800+0000 7f0584a3a700 1 -- 172.21.15.72:0/2668743832 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058006fc30 con 0x7f058009de50 2023-10-03T10:12:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.800+0000 7f0584a3a700 1 --2- 172.21.15.72:0/2668743832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058009de50 0x7f058009e220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f05700098f0 tx=0x7f0570009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b897316339fcfbcc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.800+0000 7f0577fff700 1 -- 172.21.15.72:0/2668743832 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570011830 con 0x7f058009de50 2023-10-03T10:12:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.800+0000 7f0577fff700 1 -- 172.21.15.72:0/2668743832 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0570011990 con 0x7f058009de50 2023-10-03T10:12:51.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.800+0000 7f0577fff700 1 -- 172.21.15.72:0/2668743832 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570011d20 con 0x7f058009de50 2023-10-03T10:12:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.801+0000 7f058749f700 1 -- 172.21.15.72:0/2668743832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058009de50 msgr2=0x7f058009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.801+0000 7f058749f700 1 --2- 172.21.15.72:0/2668743832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058009de50 0x7f058009e220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f05700098f0 tx=0x7f0570009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.801+0000 7f058749f700 1 -- 172.21.15.72:0/2668743832 shutdown_connections 2023-10-03T10:12:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.801+0000 7f058749f700 1 --2- 172.21.15.72:0/2668743832 >> v2:172.21.15.72:3300/0 conn(0x7f05801338a0 0x7f0580133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.801+0000 7f058749f700 1 --2- 172.21.15.72:0/2668743832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058009de50 0x7f058009e220 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.801+0000 7f058749f700 1 -- 172.21.15.72:0/2668743832 >> 172.21.15.72:0/2668743832 conn(0x7f05800a2aa0 msgr2=0x7f05800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.801+0000 7f058749f700 1 -- 172.21.15.72:0/2668743832 shutdown_connections 2023-10-03T10:12:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.801+0000 7f058749f700 1 -- 172.21.15.72:0/2668743832 wait complete. 2023-10-03T10:12:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.803+0000 7f058749f700 1 Processor -- start 2023-10-03T10:12:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.803+0000 7f058749f700 1 -- start start 2023-10-03T10:12:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.803+0000 7f058749f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058009de50 0x7f058011b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.803+0000 7f058749f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f058009e760 0x7f058011bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.803+0000 7f058749f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05801338a0 0x7f058011c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.803+0000 7f058749f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058011cd40 con 0x7f058009de50 2023-10-03T10:12:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.803+0000 7f058749f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058012ec60 con 0x7f058009e760 2023-10-03T10:12:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.803+0000 7f058749f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f058011daa0 con 0x7f05801338a0 2023-10-03T10:12:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.804+0000 7f058523b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058009de50 0x7f058011b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.804+0000 7f058523b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058009de50 0x7f058011b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60450/0 (socket says 172.21.15.72:60450) 2023-10-03T10:12:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.804+0000 7f058523b700 1 -- 172.21.15.72:0/3023085491 learned_addr learned my addr 172.21.15.72:0/3023085491 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.804+0000 7f0584a3a700 1 --2- 172.21.15.72:0/3023085491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f058009e760 0x7f058011bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.804+0000 7f0585a3c700 1 --2- 172.21.15.72:0/3023085491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05801338a0 0x7f058011c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.804+0000 7f058523b700 1 -- 172.21.15.72:0/3023085491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05801338a0 msgr2=0x7f058011c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.804+0000 7f058523b700 1 --2- 172.21.15.72:0/3023085491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05801338a0 0x7f058011c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.804+0000 7f058523b700 1 -- 172.21.15.72:0/3023085491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f058009e760 msgr2=0x7f058011bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.804+0000 7f058523b700 1 --2- 172.21.15.72:0/3023085491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f058009e760 0x7f058011bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.804+0000 7f058523b700 1 -- 172.21.15.72:0/3023085491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0570009550 con 0x7f058009de50 2023-10-03T10:12:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.804+0000 7f058523b700 1 --2- 172.21.15.72:0/3023085491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058009de50 0x7f058011b870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f057c00e9e0 tx=0x7f057c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.804+0000 7f0575ffb700 1 -- 172.21.15.72:0/3023085491 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c009710 con 0x7f058009de50 2023-10-03T10:12:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.804+0000 7f0575ffb700 1 -- 172.21.15.72:0/3023085491 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c00c850 con 0x7f058009de50 2023-10-03T10:12:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.804+0000 7f058749f700 1 -- 172.21.15.72:0/3023085491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058011f0b0 con 0x7f058009de50 2023-10-03T10:12:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.804+0000 7f0575ffb700 1 -- 172.21.15.72:0/3023085491 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c00cbc0 con 0x7f058009de50 2023-10-03T10:12:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.805+0000 7f058749f700 1 -- 172.21.15.72:0/3023085491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058006f640 con 0x7f058009de50 2023-10-03T10:12:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.805+0000 7f0575ffb700 1 -- 172.21.15.72:0/3023085491 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f057c00cd20 con 0x7f058009de50 2023-10-03T10:12:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.806+0000 7f0575ffb700 1 -- 172.21.15.72:0/3023085491 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f057c03fc60 con 0x7f058009de50 2023-10-03T10:12:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.806+0000 7f0584a3a700 1 -- 172.21.15.72:0/3023085491 >> v1:172.21.15.72:6816/126756 conn(0x7f056402f510 legacy=0x7f05640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.806+0000 7f058749f700 1 -- 172.21.15.72:0/3023085491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058004ea50 con 0x7f058009de50 2023-10-03T10:12:51.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.811+0000 7f0575ffb700 1 -- 172.21.15.72:0/3023085491 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f057c017080 con 0x7f058009de50 2023-10-03T10:12:51.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.868+0000 7f25d0540700 1 Processor -- start 2023-10-03T10:12:51.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.868+0000 7f25d0540700 1 -- start start 2023-10-03T10:12:51.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.869+0000 7f25d0540700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25c809e1d0 0x7f25c8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.869+0000 7f25d0540700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25c8139170 0x7f25c813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.869+0000 7f25d0540700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c809d2f0 con 0x7f25c809d6f0 2023-10-03T10:12:51.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.869+0000 7f25d0540700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c809b0f0 con 0x7f25c8139170 2023-10-03T10:12:51.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.869+0000 7f25d0540700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25c809a810 con 0x7f25c809e1d0 2023-10-03T10:12:51.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.869+0000 7f25cdadb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25c809e1d0 0x7f25c8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.869+0000 7f25ceadd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25c8139170 0x7f25c813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.869+0000 7f25cdadb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25c809e1d0 0x7f25c8138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59560/0 (socket says 172.21.15.72:59560) 2023-10-03T10:12:51.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.869+0000 7f25ceadd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25c8139170 0x7f25c813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44970/0 (socket says 172.21.15.72:44970) 2023-10-03T10:12:51.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.869+0000 7f25cdadb700 1 -- 172.21.15.72:0/2755591491 learned_addr learned my addr 172.21.15.72:0/2755591491 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:51.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.870+0000 7f25ceadd700 1 -- 172.21.15.72:0/2755591491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25c809e1d0 msgr2=0x7f25c8138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:51.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.870+0000 7f25ceadd700 1 --2- 172.21.15.72:0/2755591491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25c809e1d0 0x7f25c8138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.870+0000 7f25ceadd700 1 -- 172.21.15.72:0/2755591491 >> v1:172.21.15.72:6789/0 conn(0x7f25c809d6f0 legacy=0x7f25c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.870+0000 7f25ceadd700 1 -- 172.21.15.72:0/2755591491 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c809a470 con 0x7f25c8139170 2023-10-03T10:12:51.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.870+0000 7f25cdadb700 1 --2- 172.21.15.72:0/2755591491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25c809e1d0 0x7f25c8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:51.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.870+0000 7f25ceadd700 1 --2- 172.21.15.72:0/2755591491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25c8139170 0x7f25c813b550 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009df0 tx=0x7f25c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4511e6242024830 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.870+0000 7f25cd2da700 1 -- 172.21.15.72:0/2755591491 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c000e070 con 0x7f25c8139170 2023-10-03T10:12:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.870+0000 7f25cd2da700 1 -- 172.21.15.72:0/2755591491 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c000bb90 con 0x7f25c8139170 2023-10-03T10:12:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.870+0000 7f25cd2da700 1 -- 172.21.15.72:0/2755591491 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0012430 con 0x7f25c8139170 2023-10-03T10:12:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.871+0000 7f25d0540700 1 -- 172.21.15.72:0/2755591491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25c8139170 msgr2=0x7f25c813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.871+0000 7f25d0540700 1 --2- 172.21.15.72:0/2755591491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25c8139170 0x7f25c813b550 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009df0 tx=0x7f25c000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.871+0000 7f25d0540700 1 -- 172.21.15.72:0/2755591491 shutdown_connections 2023-10-03T10:12:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.871+0000 7f25d0540700 1 --2- 172.21.15.72:0/2755591491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25c8139170 0x7f25c813b550 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.871+0000 7f25d0540700 1 --2- 172.21.15.72:0/2755591491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25c809e1d0 0x7f25c8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.871+0000 7f25d0540700 1 -- 172.21.15.72:0/2755591491 >> 172.21.15.72:0/2755591491 conn(0x7f25c8066f50 msgr2=0x7f25c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.871+0000 7f25d0540700 1 -- 172.21.15.72:0/2755591491 shutdown_connections 2023-10-03T10:12:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.871+0000 7f25d0540700 1 -- 172.21.15.72:0/2755591491 wait complete. 2023-10-03T10:12:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.872+0000 7f25d0540700 1 Processor -- start 2023-10-03T10:12:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.872+0000 7f25d0540700 1 -- start start 2023-10-03T10:12:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.872+0000 7f25d0540700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25c809d6f0 0x7f25c811e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.872+0000 7f25d0540700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25c809e1d0 0x7f25c811ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.872+0000 7f25d0540700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25c8139170 0x7f25c811f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.872+0000 7f25d0540700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c81222d0 con 0x7f25c809e1d0 2023-10-03T10:12:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.872+0000 7f25d0540700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c809c640 con 0x7f25c809d6f0 2023-10-03T10:12:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.872+0000 7f25d0540700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25c80720c0 con 0x7f25c8139170 2023-10-03T10:12:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.873+0000 7f25ceadd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25c8139170 0x7f25c811f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.873+0000 7f25ceadd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25c8139170 0x7f25c811f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59566/0 (socket says 172.21.15.72:59566) 2023-10-03T10:12:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.873+0000 7f25ceadd700 1 -- 172.21.15.72:0/130711266 learned_addr learned my addr 172.21.15.72:0/130711266 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.873+0000 7f25ce2dc700 1 --2- 172.21.15.72:0/130711266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25c809d6f0 0x7f25c811e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.873+0000 7f25cdadb700 1 --2- 172.21.15.72:0/130711266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25c809e1d0 0x7f25c811ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.873+0000 7f25ceadd700 1 -- 172.21.15.72:0/130711266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25c809d6f0 msgr2=0x7f25c811e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.873+0000 7f25ceadd700 1 --2- 172.21.15.72:0/130711266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25c809d6f0 0x7f25c811e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.873+0000 7f25ceadd700 1 -- 172.21.15.72:0/130711266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25c809e1d0 msgr2=0x7f25c811ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.873+0000 7f25ceadd700 1 --2- 172.21.15.72:0/130711266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25c809e1d0 0x7f25c811ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.873+0000 7f25ceadd700 1 -- 172.21.15.72:0/130711266 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c0009a70 con 0x7f25c8139170 2023-10-03T10:12:51.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.873+0000 7f25ceadd700 1 --2- 172.21.15.72:0/130711266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25c8139170 0x7f25c811f230 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f25c000b370 tx=0x7f25c0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.873+0000 7f25beffd700 1 -- 172.21.15.72:0/130711266 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0012430 con 0x7f25c8139170 2023-10-03T10:12:51.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.873+0000 7f25beffd700 1 -- 172.21.15.72:0/130711266 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c0020070 con 0x7f25c8139170 2023-10-03T10:12:51.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.874+0000 7f25d0540700 1 -- 172.21.15.72:0/130711266 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c81203c0 con 0x7f25c8139170 2023-10-03T10:12:51.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.874+0000 7f25beffd700 1 -- 172.21.15.72:0/130711266 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0004280 con 0x7f25c8139170 2023-10-03T10:12:51.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.874+0000 7f25d0540700 1 -- 172.21.15.72:0/130711266 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c8122a60 con 0x7f25c8139170 2023-10-03T10:12:51.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.875+0000 7f25beffd700 1 -- 172.21.15.72:0/130711266 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f25c00043e0 con 0x7f25c8139170 2023-10-03T10:12:51.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.874+0000 7f25d0540700 1 -- 172.21.15.72:0/130711266 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c8121e40 con 0x7f25c8139170 2023-10-03T10:12:51.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.875+0000 7f25beffd700 1 -- 172.21.15.72:0/130711266 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f25c0022070 con 0x7f25c8139170 2023-10-03T10:12:51.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.875+0000 7f25ce2dc700 1 -- 172.21.15.72:0/130711266 >> v1:172.21.15.72:6816/126756 conn(0x7f25ac02f510 legacy=0x7f25ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:51.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.884+0000 7f25beffd700 1 -- 172.21.15.72:0/130711266 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25c0012e10 con 0x7f25c8139170 2023-10-03T10:12:51.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.893+0000 7f5b85e5f700 1 Processor -- start 2023-10-03T10:12:51.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.893+0000 7f5b85e5f700 1 -- start start 2023-10-03T10:12:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.893+0000 7f5b85e5f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b800a1510 0x7f5b80138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.894+0000 7f5b85e5f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b80139250 0x7f5b8013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.894+0000 7f5b85e5f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8009edd0 con 0x7f5b800a0a30 2023-10-03T10:12:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.894+0000 7f5b85e5f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b800a18e0 con 0x7f5b800a1510 2023-10-03T10:12:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.894+0000 7f5b85e5f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8009e1f0 con 0x7f5b80139250 2023-10-03T10:12:51.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.894+0000 7f5b7effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b800a1510 0x7f5b80138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.894+0000 7f5b7effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b800a1510 0x7f5b80138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44984/0 (socket says 172.21.15.72:44984) 2023-10-03T10:12:51.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.894+0000 7f5b7effd700 1 -- 172.21.15.72:0/2470530555 learned_addr learned my addr 172.21.15.72:0/2470530555 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:51.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.894+0000 7f5b7effd700 1 -- 172.21.15.72:0/2470530555 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b80139250 msgr2=0x7f5b8013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:51.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.894+0000 7f5b7effd700 1 --2- 172.21.15.72:0/2470530555 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b80139250 0x7f5b8013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.894+0000 7f5b7effd700 1 -- 172.21.15.72:0/2470530555 >> v1:172.21.15.72:6789/0 conn(0x7f5b800a0a30 legacy=0x7f5b800a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.894+0000 7f5b7effd700 1 -- 172.21.15.72:0/2470530555 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8009dc50 con 0x7f5b800a1510 2023-10-03T10:12:51.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.894+0000 7f5b7effd700 1 --2- 172.21.15.72:0/2470530555 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b800a1510 0x7f5b80138d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009920 tx=0x7f5b74009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c48aef69e8bb989 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.894+0000 7f5b7e7fc700 1 -- 172.21.15.72:0/2470530555 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7400ba60 con 0x7f5b800a1510 2023-10-03T10:12:51.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.894+0000 7f5b7e7fc700 1 -- 172.21.15.72:0/2470530555 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7400bbc0 con 0x7f5b800a1510 2023-10-03T10:12:51.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.894+0000 7f5b7e7fc700 1 -- 172.21.15.72:0/2470530555 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74009e70 con 0x7f5b800a1510 2023-10-03T10:12:51.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.895+0000 7f5b85e5f700 1 -- 172.21.15.72:0/2470530555 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b800a1510 msgr2=0x7f5b80138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.895+0000 7f5b85e5f700 1 --2- 172.21.15.72:0/2470530555 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b800a1510 0x7f5b80138d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009920 tx=0x7f5b74009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:51.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.896+0000 7f5b85e5f700 1 -- 172.21.15.72:0/2470530555 shutdown_connections 2023-10-03T10:12:51.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.896+0000 7f5b85e5f700 1 --2- 172.21.15.72:0/2470530555 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b80139250 0x7f5b8013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.896+0000 7f5b85e5f700 1 --2- 172.21.15.72:0/2470530555 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b800a1510 0x7f5b80138d10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.896+0000 7f5b85e5f700 1 -- 172.21.15.72:0/2470530555 >> 172.21.15.72:0/2470530555 conn(0x7f5b800a6550 msgr2=0x7f5b800a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:51.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.896+0000 7f5b85e5f700 1 -- 172.21.15.72:0/2470530555 shutdown_connections 2023-10-03T10:12:51.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.896+0000 7f5b85e5f700 1 -- 172.21.15.72:0/2470530555 wait complete. 2023-10-03T10:12:51.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.897+0000 7f5b85e5f700 1 Processor -- start 2023-10-03T10:12:51.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.897+0000 7f5b85e5f700 1 -- start start 2023-10-03T10:12:51.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.898+0000 7f5b85e5f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b800a0a30 0x7f5b801c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.898+0000 7f5b85e5f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b800a1510 0x7f5b801c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.898+0000 7f5b85e5f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b80139250 0x7f5b80122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.898+0000 7f5b85e5f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b800a0220 con 0x7f5b800a1510 2023-10-03T10:12:51.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.898+0000 7f5b85e5f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b80125ec0 con 0x7f5b80139250 2023-10-03T10:12:51.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.898+0000 7f5b85e5f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b80138d20 con 0x7f5b800a0a30 2023-10-03T10:12:51.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.898+0000 7f5b7ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b80139250 0x7f5b80122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.898+0000 7f5b7ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b80139250 0x7f5b80122940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44992/0 (socket says 172.21.15.72:44992) 2023-10-03T10:12:51.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.898+0000 7f5b7ffff700 1 -- 172.21.15.72:0/1581907947 learned_addr learned my addr 172.21.15.72:0/1581907947 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:51.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.898+0000 7f5b7effd700 1 --2- 172.21.15.72:0/1581907947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b800a1510 0x7f5b801c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.899+0000 7f5b7ffff700 1 -- 172.21.15.72:0/1581907947 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b800a0a30 msgr2=0x7f5b801c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.899+0000 7f5b7ffff700 1 --2- 172.21.15.72:0/1581907947 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b800a0a30 0x7f5b801c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.899+0000 7f5b7ffff700 1 -- 172.21.15.72:0/1581907947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b800a1510 msgr2=0x7f5b801c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.899+0000 7f5b7ffff700 1 --2- 172.21.15.72:0/1581907947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b800a1510 0x7f5b801c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.899+0000 7f5b7ffff700 1 -- 172.21.15.72:0/1581907947 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b74009550 con 0x7f5b80139250 2023-10-03T10:12:51.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.899+0000 7f5b7ffff700 1 --2- 172.21.15.72:0/1581907947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b80139250 0x7f5b80122940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800b970 tx=0x7f5b7800bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.899+0000 7f5b67fff700 1 -- 172.21.15.72:0/1581907947 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7800c930 con 0x7f5b80139250 2023-10-03T10:12:51.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.899+0000 7f5b67fff700 1 -- 172.21.15.72:0/1581907947 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7800cab0 con 0x7f5b80139250 2023-10-03T10:12:51.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.899+0000 7f5b85e5f700 1 -- 172.21.15.72:0/1581907947 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b80126460 con 0x7f5b80139250 2023-10-03T10:12:51.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.899+0000 7f5b67fff700 1 -- 172.21.15.72:0/1581907947 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7800ce60 con 0x7f5b80139250 2023-10-03T10:12:51.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.899+0000 7f5b85e5f700 1 -- 172.21.15.72:0/1581907947 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b80138860 con 0x7f5b80139250 2023-10-03T10:12:51.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.900+0000 7f5b67fff700 1 -- 172.21.15.72:0/1581907947 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5b7801d3b0 con 0x7f5b80139250 2023-10-03T10:12:51.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.900+0000 7f5b67fff700 1 -- 172.21.15.72:0/1581907947 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f5b78006e40 con 0x7f5b80139250 2023-10-03T10:12:51.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.900+0000 7f5b7f7fe700 1 -- 172.21.15.72:0/1581907947 >> v1:172.21.15.72:6816/126756 conn(0x7f5b6c02f510 legacy=0x7f5b6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:51.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.901+0000 7f5b85e5f700 1 -- 172.21.15.72:0/1581907947 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b801be3d0 con 0x7f5b80139250 2023-10-03T10:12:51.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.910+0000 7f5b67fff700 1 -- 172.21.15.72:0/1581907947 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b78019030 con 0x7f5b80139250 2023-10-03T10:12:51.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.939+0000 7f6de1284700 1 Processor -- start 2023-10-03T10:12:51.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.939+0000 7f6de1284700 1 -- start start 2023-10-03T10:12:51.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.940+0000 7f6de1284700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ddc09d6f0 0x7f6ddc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.940+0000 7f6de1284700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ddc09e000 0x7f6ddc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.940+0000 7f6de1284700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ddc09f130 con 0x7f6ddc09e410 2023-10-03T10:12:51.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.940+0000 7f6de1284700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc09f520 con 0x7f6ddc09e000 2023-10-03T10:12:51.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.940+0000 7f6de1284700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc09e930 con 0x7f6ddc09d6f0 2023-10-03T10:12:51.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.940+0000 7f6dda7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ddc09e000 0x7f6ddc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.940+0000 7f6dda7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ddc09e000 0x7f6ddc130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44996/0 (socket says 172.21.15.72:44996) 2023-10-03T10:12:51.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.940+0000 7f6dda7fc700 1 -- 172.21.15.72:0/568570281 learned_addr learned my addr 172.21.15.72:0/568570281 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:51.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.941+0000 7f6ddaffd700 1 --2- 172.21.15.72:0/568570281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ddc09d6f0 0x7f6ddc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.941+0000 7f6dda7fc700 1 -- 172.21.15.72:0/568570281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ddc09d6f0 msgr2=0x7f6ddc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:51.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.941+0000 7f6dda7fc700 1 --2- 172.21.15.72:0/568570281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ddc09d6f0 0x7f6ddc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.941+0000 7f6dda7fc700 1 -- 172.21.15.72:0/568570281 >> v1:172.21.15.72:6789/0 conn(0x7f6ddc09e410 legacy=0x7f6ddc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.941+0000 7f6dda7fc700 1 -- 172.21.15.72:0/568570281 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc09b2d0 con 0x7f6ddc09e000 2023-10-03T10:12:51.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.941+0000 7f6dda7fc700 1 --2- 172.21.15.72:0/568570281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ddc09e000 0x7f6ddc130660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009920 tx=0x7f6dd0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e36144a0003f719f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.941+0000 7f6dd9ffb700 1 -- 172.21.15.72:0/568570281 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0004230 con 0x7f6ddc09e000 2023-10-03T10:12:51.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.941+0000 7f6dd9ffb700 1 -- 172.21.15.72:0/568570281 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd0004390 con 0x7f6ddc09e000 2023-10-03T10:12:51.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.941+0000 7f6dd9ffb700 1 -- 172.21.15.72:0/568570281 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0009e70 con 0x7f6ddc09e000 2023-10-03T10:12:51.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.942+0000 7f6de1284700 1 -- 172.21.15.72:0/568570281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ddc09e000 msgr2=0x7f6ddc130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.942+0000 7f6de1284700 1 --2- 172.21.15.72:0/568570281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ddc09e000 0x7f6ddc130660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009920 tx=0x7f6dd0009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:51.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.942+0000 7f6de1284700 1 -- 172.21.15.72:0/568570281 shutdown_connections 2023-10-03T10:12:51.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.942+0000 7f6de1284700 1 --2- 172.21.15.72:0/568570281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ddc09d6f0 0x7f6ddc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.942+0000 7f6de1284700 1 --2- 172.21.15.72:0/568570281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ddc09e000 0x7f6ddc130660 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.942+0000 7f6de1284700 1 -- 172.21.15.72:0/568570281 >> 172.21.15.72:0/568570281 conn(0x7f6ddc066f50 msgr2=0x7f6ddc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:51.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.942+0000 7f6de1284700 1 -- 172.21.15.72:0/568570281 shutdown_connections 2023-10-03T10:12:51.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.942+0000 7f6de1284700 1 -- 172.21.15.72:0/568570281 wait complete. 2023-10-03T10:12:51.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.943+0000 7f6de1284700 1 Processor -- start 2023-10-03T10:12:51.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.943+0000 7f6de1284700 1 -- start start 2023-10-03T10:12:51.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6de1284700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ddc09d6f0 0x7f6ddc11e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6de1284700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ddc09e410 0x7f6ddc11e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6de1284700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ddc11ecf0 0x7f6ddc1ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:51.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6de1284700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc11f110 con 0x7f6ddc11ecf0 2023-10-03T10:12:51.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6de1284700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc09c700 con 0x7f6ddc09e410 2023-10-03T10:12:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6de1284700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc1203a0 con 0x7f6ddc09d6f0 2023-10-03T10:12:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6ddb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ddc11ecf0 0x7f6ddc1ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6ddb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ddc11ecf0 0x7f6ddc1ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60464/0 (socket says 172.21.15.72:60464) 2023-10-03T10:12:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6ddb7fe700 1 -- 172.21.15.72:0/4202747225 learned_addr learned my addr 172.21.15.72:0/4202747225 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6ddaffd700 1 --2- 172.21.15.72:0/4202747225 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ddc09d6f0 0x7f6ddc11e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6dda7fc700 1 --2- 172.21.15.72:0/4202747225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ddc09e410 0x7f6ddc11e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6ddb7fe700 1 -- 172.21.15.72:0/4202747225 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ddc09d6f0 msgr2=0x7f6ddc11e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6ddb7fe700 1 --2- 172.21.15.72:0/4202747225 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ddc09d6f0 0x7f6ddc11e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6ddb7fe700 1 -- 172.21.15.72:0/4202747225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ddc09e410 msgr2=0x7f6ddc11e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6ddb7fe700 1 --2- 172.21.15.72:0/4202747225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ddc09e410 0x7f6ddc11e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:51.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6ddb7fe700 1 -- 172.21.15.72:0/4202747225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd0009550 con 0x7f6ddc11ecf0 2023-10-03T10:12:51.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.944+0000 7f6ddb7fe700 1 --2- 172.21.15.72:0/4202747225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ddc11ecf0 0x7f6ddc1ca490 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400caf0 tx=0x7f6dd400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:51.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.945+0000 7f6dc37fe700 1 -- 172.21.15.72:0/4202747225 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4003e30 con 0x7f6ddc11ecf0 2023-10-03T10:12:51.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.945+0000 7f6dc37fe700 1 -- 172.21.15.72:0/4202747225 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd400ce70 con 0x7f6ddc11ecf0 2023-10-03T10:12:51.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.945+0000 7f6dc37fe700 1 -- 172.21.15.72:0/4202747225 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4005290 con 0x7f6ddc11ecf0 2023-10-03T10:12:51.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.945+0000 7f6de1284700 1 -- 172.21.15.72:0/4202747225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc0a1d90 con 0x7f6ddc11ecf0 2023-10-03T10:12:51.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.945+0000 7f6de1284700 1 -- 172.21.15.72:0/4202747225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc121a20 con 0x7f6ddc11ecf0 2023-10-03T10:12:51.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.946+0000 7f6de1284700 1 -- 172.21.15.72:0/4202747225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc121670 con 0x7f6ddc11ecf0 2023-10-03T10:12:51.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.947+0000 7f6dc37fe700 1 -- 172.21.15.72:0/4202747225 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6dd40053f0 con 0x7f6ddc11ecf0 2023-10-03T10:12:51.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.947+0000 7f6dc37fe700 1 -- 172.21.15.72:0/4202747225 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f6dd4040410 con 0x7f6ddc11ecf0 2023-10-03T10:12:51.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.947+0000 7f6ddaffd700 1 -- 172.21.15.72:0/4202747225 >> v1:172.21.15.72:6816/126756 conn(0x7f6dc802f510 legacy=0x7f6dc80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:51.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:51.951+0000 7f6dc37fe700 1 -- 172.21.15.72:0/4202747225 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6dd4024bd0 con 0x7f6ddc11ecf0 2023-10-03T10:12:52.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.007+0000 7f0584a3a700 1 -- 172.21.15.72:0/3023085491 >> v1:172.21.15.72:6816/126756 conn(0x7f056402f510 legacy=0x7f05640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:52.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.041+0000 7f058749f700 1 -- 172.21.15.72:0/3023085491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0580074ea0 con 0x7f058009de50 2023-10-03T10:12:52.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.042+0000 7f0575ffb700 1 -- 172.21.15.72:0/3023085491 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f057c021070 con 0x7f058009de50 2023-10-03T10:12:52.042 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:52.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.044+0000 7f058749f700 1 -- 172.21.15.72:0/3023085491 >> v1:172.21.15.72:6816/126756 conn(0x7f056402f510 legacy=0x7f05640319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:52.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.044+0000 7f058749f700 1 -- 172.21.15.72:0/3023085491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058009de50 msgr2=0x7f058011b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.044+0000 7f058749f700 1 --2- 172.21.15.72:0/3023085491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058009de50 0x7f058011b870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f057c00e9e0 tx=0x7f057c00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.044+0000 7f058749f700 1 -- 172.21.15.72:0/3023085491 shutdown_connections 2023-10-03T10:12:52.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.044+0000 7f058749f700 1 --2- 172.21.15.72:0/3023085491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058009de50 0x7f058011b870 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.044+0000 7f058749f700 1 --2- 172.21.15.72:0/3023085491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05801338a0 0x7f058011c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.044+0000 7f058749f700 1 --2- 172.21.15.72:0/3023085491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f058009e760 0x7f058011bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.044+0000 7f058749f700 1 -- 172.21.15.72:0/3023085491 >> 172.21.15.72:0/3023085491 conn(0x7f05800a2aa0 msgr2=0x7f0580130610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.044+0000 7f058749f700 1 -- 172.21.15.72:0/3023085491 shutdown_connections 2023-10-03T10:12:52.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.044+0000 7f058749f700 1 -- 172.21.15.72:0/3023085491 wait complete. 2023-10-03T10:12:52.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:52.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.076+0000 7f25ce2dc700 1 -- 172.21.15.72:0/130711266 >> v1:172.21.15.72:6816/126756 conn(0x7f25ac02f510 legacy=0x7f25ac0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:52.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.100+0000 7f25d0540700 1 -- 172.21.15.72:0/130711266 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f25c8074ea0 con 0x7f25c8139170 2023-10-03T10:12:52.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.100+0000 7f25beffd700 1 -- 172.21.15.72:0/130711266 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25c0041e60 con 0x7f25c8139170 2023-10-03T10:12:52.101 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:52.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.102+0000 7f5b7f7fe700 1 -- 172.21.15.72:0/1581907947 >> v1:172.21.15.72:6816/126756 conn(0x7f5b6c02f510 legacy=0x7f5b6c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:52.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.102+0000 7f25d0540700 1 -- 172.21.15.72:0/130711266 >> v1:172.21.15.72:6816/126756 conn(0x7f25ac02f510 legacy=0x7f25ac0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:52.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.102+0000 7f25d0540700 1 -- 172.21.15.72:0/130711266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25c8139170 msgr2=0x7f25c811f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.102+0000 7f25d0540700 1 --2- 172.21.15.72:0/130711266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25c8139170 0x7f25c811f230 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f25c000b370 tx=0x7f25c0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.102+0000 7f25d0540700 1 -- 172.21.15.72:0/130711266 shutdown_connections 2023-10-03T10:12:52.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.102+0000 7f25d0540700 1 --2- 172.21.15.72:0/130711266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25c8139170 0x7f25c811f230 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.102+0000 7f25d0540700 1 --2- 172.21.15.72:0/130711266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25c809d6f0 0x7f25c811e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.102+0000 7f25d0540700 1 --2- 172.21.15.72:0/130711266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25c809e1d0 0x7f25c811ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.102+0000 7f25d0540700 1 -- 172.21.15.72:0/130711266 >> 172.21.15.72:0/130711266 conn(0x7f25c8066f50 msgr2=0x7f25c8136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.102+0000 7f25d0540700 1 -- 172.21.15.72:0/130711266 shutdown_connections 2023-10-03T10:12:52.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.102+0000 7f25d0540700 1 -- 172.21.15.72:0/130711266 wait complete. 2023-10-03T10:12:52.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:52.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.118+0000 7f5b85e5f700 1 -- 172.21.15.72:0/1581907947 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5b80074ea0 con 0x7f5b80139250 2023-10-03T10:12:52.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.118+0000 7f5b67fff700 1 -- 172.21.15.72:0/1581907947 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5b78019020 con 0x7f5b80139250 2023-10-03T10:12:52.119 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.120+0000 7f5b85e5f700 1 -- 172.21.15.72:0/1581907947 >> v1:172.21.15.72:6816/126756 conn(0x7f5b6c02f510 legacy=0x7f5b6c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.120+0000 7f5b85e5f700 1 -- 172.21.15.72:0/1581907947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b80139250 msgr2=0x7f5b80122940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.120+0000 7f5b85e5f700 1 --2- 172.21.15.72:0/1581907947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b80139250 0x7f5b80122940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800b970 tx=0x7f5b7800bc80 comp rx=0 tx=0).stop 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.120+0000 7f5b85e5f700 1 -- 172.21.15.72:0/1581907947 shutdown_connections 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.120+0000 7f5b85e5f700 1 --2- 172.21.15.72:0/1581907947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b80139250 0x7f5b80122940 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.120+0000 7f5b85e5f700 1 --2- 172.21.15.72:0/1581907947 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b800a0a30 0x7f5b801c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.120+0000 7f5b85e5f700 1 --2- 172.21.15.72:0/1581907947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b800a1510 0x7f5b801c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.120+0000 7f5b85e5f700 1 -- 172.21.15.72:0/1581907947 >> 172.21.15.72:0/1581907947 conn(0x7f5b800a6550 msgr2=0x7f5b800a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.120+0000 7f5b85e5f700 1 -- 172.21.15.72:0/1581907947 shutdown_connections 2023-10-03T10:12:52.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.120+0000 7f5b85e5f700 1 -- 172.21.15.72:0/1581907947 wait complete. 2023-10-03T10:12:52.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:52.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.148+0000 7f6ddaffd700 1 -- 172.21.15.72:0/4202747225 >> v1:172.21.15.72:6816/126756 conn(0x7f6dc802f510 legacy=0x7f6dc80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:52.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.159+0000 7f6de1284700 1 -- 172.21.15.72:0/4202747225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6ddc074ea0 con 0x7f6ddc11ecf0 2023-10-03T10:12:52.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.159+0000 7f6dc37fe700 1 -- 172.21.15.72:0/4202747225 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6dd4024bd0 con 0x7f6ddc11ecf0 2023-10-03T10:12:52.160 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:52.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.161+0000 7f6de1284700 1 -- 172.21.15.72:0/4202747225 >> v1:172.21.15.72:6816/126756 conn(0x7f6dc802f510 legacy=0x7f6dc80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:52.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.161+0000 7f6de1284700 1 -- 172.21.15.72:0/4202747225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ddc11ecf0 msgr2=0x7f6ddc1ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:52.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.161+0000 7f6de1284700 1 --2- 172.21.15.72:0/4202747225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ddc11ecf0 0x7f6ddc1ca490 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400caf0 tx=0x7f6dd400ce00 comp rx=0 tx=0).stop 2023-10-03T10:12:52.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.161+0000 7f6de1284700 1 -- 172.21.15.72:0/4202747225 shutdown_connections 2023-10-03T10:12:52.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.161+0000 7f6de1284700 1 --2- 172.21.15.72:0/4202747225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ddc11ecf0 0x7f6ddc1ca490 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.161+0000 7f6de1284700 1 --2- 172.21.15.72:0/4202747225 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ddc09d6f0 0x7f6ddc11e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.161+0000 7f6de1284700 1 --2- 172.21.15.72:0/4202747225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ddc09e410 0x7f6ddc11e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:52.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.161+0000 7f6de1284700 1 -- 172.21.15.72:0/4202747225 >> 172.21.15.72:0/4202747225 conn(0x7f6ddc066f50 msgr2=0x7f6ddc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:52.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.161+0000 7f6de1284700 1 -- 172.21.15.72:0/4202747225 shutdown_connections 2023-10-03T10:12:52.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:52.161+0000 7f6de1284700 1 -- 172.21.15.72:0/4202747225 wait complete. 2023-10-03T10:12:52.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:53.058 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:53.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:53.133 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:53.175 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:53.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.197+0000 7f2987474700 1 Processor -- start 2023-10-03T10:12:53.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.197+0000 7f2987474700 1 -- start start 2023-10-03T10:12:53.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.197+0000 7f2987474700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2980136710 0x7f2980138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.197+0000 7f2987474700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2980139030 0x7f298013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.197+0000 7f2987474700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298006ef30 con 0x7f29801338a0 2023-10-03T10:12:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.197+0000 7f2987474700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298006fef0 con 0x7f2980136710 2023-10-03T10:12:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.197+0000 7f2987474700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29801334b0 con 0x7f2980139030 2023-10-03T10:12:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.198+0000 7f2984a0f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2980136710 0x7f2980138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.198+0000 7f2985210700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f29801338a0 0x7f2980133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59808/0 (socket says 172.21.15.72:59808) 2023-10-03T10:12:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.198+0000 7f2985210700 1 -- 172.21.15.72:0/2979976935 learned_addr learned my addr 172.21.15.72:0/2979976935 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.198+0000 7f2985a11700 1 --2- 172.21.15.72:0/2979976935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2980139030 0x7f298013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.198+0000 7f2984a0f700 1 -- 172.21.15.72:0/2979976935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2980139030 msgr2=0x7f298013b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.198+0000 7f2984a0f700 1 --2- 172.21.15.72:0/2979976935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2980139030 0x7f298013b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.198+0000 7f2984a0f700 1 -- 172.21.15.72:0/2979976935 >> v1:172.21.15.72:6789/0 conn(0x7f29801338a0 legacy=0x7f2980133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.198+0000 7f2984a0f700 1 -- 172.21.15.72:0/2979976935 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298006fc30 con 0x7f2980136710 2023-10-03T10:12:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.198+0000 7f2984a0f700 1 --2- 172.21.15.72:0/2979976935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2980136710 0x7f2980138af0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2970009840 tx=0x7f2970009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdc65309da68d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.198+0000 7f2977fff700 1 -- 172.21.15.72:0/2979976935 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970011830 con 0x7f2980136710 2023-10-03T10:12:53.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.198+0000 7f2977fff700 1 -- 172.21.15.72:0/2979976935 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2970011990 con 0x7f2980136710 2023-10-03T10:12:53.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.198+0000 7f2977fff700 1 -- 172.21.15.72:0/2979976935 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970011d20 con 0x7f2980136710 2023-10-03T10:12:53.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.199+0000 7f2987474700 1 -- 172.21.15.72:0/2979976935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2980136710 msgr2=0x7f2980138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.199+0000 7f2987474700 1 --2- 172.21.15.72:0/2979976935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2980136710 0x7f2980138af0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2970009840 tx=0x7f2970009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:53.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.199+0000 7f2987474700 1 -- 172.21.15.72:0/2979976935 shutdown_connections 2023-10-03T10:12:53.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.199+0000 7f2987474700 1 --2- 172.21.15.72:0/2979976935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2980139030 0x7f298013b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.199+0000 7f2987474700 1 --2- 172.21.15.72:0/2979976935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2980136710 0x7f2980138af0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.199+0000 7f2987474700 1 -- 172.21.15.72:0/2979976935 >> 172.21.15.72:0/2979976935 conn(0x7f29800a2aa0 msgr2=0x7f29800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.199+0000 7f2987474700 1 -- 172.21.15.72:0/2979976935 shutdown_connections 2023-10-03T10:12:53.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.199+0000 7f2987474700 1 -- 172.21.15.72:0/2979976935 wait complete. 2023-10-03T10:12:53.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.201+0000 7f2987474700 1 Processor -- start 2023-10-03T10:12:53.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.201+0000 7f2987474700 1 -- start start 2023-10-03T10:12:53.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2987474700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29801338a0 0x7f298011adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2987474700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2980136710 0x7f298011b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2987474700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2980139030 0x7f298011b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2987474700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298011cae0 con 0x7f2980139030 2023-10-03T10:12:53.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2987474700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2980130cb0 con 0x7f29801338a0 2023-10-03T10:12:53.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2987474700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2980138b00 con 0x7f2980136710 2023-10-03T10:12:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2985210700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29801338a0 0x7f298011adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2985210700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29801338a0 0x7f298011adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45002/0 (socket says 172.21.15.72:45002) 2023-10-03T10:12:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2985210700 1 -- 172.21.15.72:0/1654341434 learned_addr learned my addr 172.21.15.72:0/1654341434 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2985a11700 1 --2- 172.21.15.72:0/1654341434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2980139030 0x7f298011b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2984a0f700 1 --2- 172.21.15.72:0/1654341434 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2980136710 0x7f298011b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2985210700 1 -- 172.21.15.72:0/1654341434 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2980136710 msgr2=0x7f298011b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2985210700 1 --2- 172.21.15.72:0/1654341434 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2980136710 0x7f298011b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2985210700 1 -- 172.21.15.72:0/1654341434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2980139030 msgr2=0x7f298011b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2985210700 1 --2- 172.21.15.72:0/1654341434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2980139030 0x7f298011b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2985210700 1 -- 172.21.15.72:0/1654341434 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29700094a0 con 0x7f29801338a0 2023-10-03T10:12:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2985210700 1 --2- 172.21.15.72:0/1654341434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29801338a0 0x7f298011adc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f297c00c520 tx=0x7f297c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.202+0000 7f2975ffb700 1 -- 172.21.15.72:0/1654341434 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c005d70 con 0x7f29801338a0 2023-10-03T10:12:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.203+0000 7f2975ffb700 1 -- 172.21.15.72:0/1654341434 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c0070d0 con 0x7f29801338a0 2023-10-03T10:12:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.203+0000 7f2987474700 1 -- 172.21.15.72:0/1654341434 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298011e070 con 0x7f29801338a0 2023-10-03T10:12:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.203+0000 7f2975ffb700 1 -- 172.21.15.72:0/1654341434 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c007440 con 0x7f29801338a0 2023-10-03T10:12:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.203+0000 7f2987474700 1 -- 172.21.15.72:0/1654341434 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298011d180 con 0x7f29801338a0 2023-10-03T10:12:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.204+0000 7f2975ffb700 1 -- 172.21.15.72:0/1654341434 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f297c0075a0 con 0x7f29801338a0 2023-10-03T10:12:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.204+0000 7f2975ffb700 1 -- 172.21.15.72:0/1654341434 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f297c03efc0 con 0x7f29801338a0 2023-10-03T10:12:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.204+0000 7f2987474700 1 -- 172.21.15.72:0/1654341434 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298011e260 con 0x7f29801338a0 2023-10-03T10:12:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.204+0000 7f2984a0f700 1 -- 172.21.15.72:0/1654341434 >> v1:172.21.15.72:6816/126756 conn(0x7f296402f510 legacy=0x7f29640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.213+0000 7f2975ffb700 1 -- 172.21.15.72:0/1654341434 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f297c017030 con 0x7f29801338a0 2023-10-03T10:12:53.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.251+0000 7f2e1b20f700 1 Processor -- start 2023-10-03T10:12:53.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.251+0000 7f2e1b20f700 1 -- start start 2023-10-03T10:12:53.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.252+0000 7f2e1b20f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e1406e570 0x7f2e1406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.252+0000 7f2e1b20f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e1409eca0 0x7f2e1406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.252+0000 7f2e1b20f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e14070ee0 con 0x7f2e14134610 2023-10-03T10:12:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.252+0000 7f2e1b20f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e14071480 con 0x7f2e1409eca0 2023-10-03T10:12:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.252+0000 7f2e1b20f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1406f3c0 con 0x7f2e1406e570 2023-10-03T10:12:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.252+0000 7f2e13fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e1409eca0 0x7f2e1406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.252+0000 7f2e13fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e1409eca0 0x7f2e1406ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45008/0 (socket says 172.21.15.72:45008) 2023-10-03T10:12:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.252+0000 7f2e13fff700 1 -- 172.21.15.72:0/2164974612 learned_addr learned my addr 172.21.15.72:0/2164974612 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.252+0000 7f2e18fab700 1 --2- 172.21.15.72:0/2164974612 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e1406e570 0x7f2e1406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.252+0000 7f2e13fff700 1 -- 172.21.15.72:0/2164974612 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e1406e570 msgr2=0x7f2e1406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:53.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.252+0000 7f2e13fff700 1 --2- 172.21.15.72:0/2164974612 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e1406e570 0x7f2e1406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.252+0000 7f2e13fff700 1 -- 172.21.15.72:0/2164974612 >> v1:172.21.15.72:6789/0 conn(0x7f2e14134610 legacy=0x7f2e14134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.252+0000 7f2e13fff700 1 -- 172.21.15.72:0/2164974612 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e14071b90 con 0x7f2e1409eca0 2023-10-03T10:12:53.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.252+0000 7f2e137fe700 1 -- 172.21.15.72:0/2164974612 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286593005 0 0) 0x7f2e14070ee0 con 0x7f2e14134610 2023-10-03T10:12:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.252+0000 7f2e13fff700 1 --2- 172.21.15.72:0/2164974612 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e1409eca0 0x7f2e1406ee80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009920 tx=0x7f2e00009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6170a08cccb7fa4e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.253+0000 7f2e137fe700 1 -- 172.21.15.72:0/2164974612 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00011830 con 0x7f2e1409eca0 2023-10-03T10:12:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.253+0000 7f2e137fe700 1 -- 172.21.15.72:0/2164974612 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e00011990 con 0x7f2e1409eca0 2023-10-03T10:12:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.253+0000 7f2e137fe700 1 -- 172.21.15.72:0/2164974612 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00011d20 con 0x7f2e1409eca0 2023-10-03T10:12:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.253+0000 7f2e1b20f700 1 -- 172.21.15.72:0/2164974612 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e1409eca0 msgr2=0x7f2e1406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.253+0000 7f2e1b20f700 1 --2- 172.21.15.72:0/2164974612 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e1409eca0 0x7f2e1406ee80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009920 tx=0x7f2e00009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.253+0000 7f2e1b20f700 1 -- 172.21.15.72:0/2164974612 shutdown_connections 2023-10-03T10:12:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.253+0000 7f2e1b20f700 1 --2- 172.21.15.72:0/2164974612 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e1406e570 0x7f2e1406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.253+0000 7f2e1b20f700 1 --2- 172.21.15.72:0/2164974612 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e1409eca0 0x7f2e1406ee80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.253+0000 7f2e1b20f700 1 -- 172.21.15.72:0/2164974612 >> 172.21.15.72:0/2164974612 conn(0x7f2e140a2aa0 msgr2=0x7f2e140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.253+0000 7f2e1b20f700 1 -- 172.21.15.72:0/2164974612 shutdown_connections 2023-10-03T10:12:53.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.253+0000 7f2e1b20f700 1 -- 172.21.15.72:0/2164974612 wait complete. 2023-10-03T10:12:53.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.255+0000 7f2e1b20f700 1 Processor -- start 2023-10-03T10:12:53.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.255+0000 7f2e1b20f700 1 -- start start 2023-10-03T10:12:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e1b20f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e1406e570 0x7f2e141214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e1b20f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e14134610 0x7f2e14121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e1b20f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e14134100 0x7f2e14121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e1b20f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e14124730 con 0x7f2e14134100 2023-10-03T10:12:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e1b20f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e14124910 con 0x7f2e14134610 2023-10-03T10:12:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e1b20f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1409e540 con 0x7f2e1406e570 2023-10-03T10:12:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e18fab700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e1406e570 0x7f2e141214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e18fab700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e1406e570 0x7f2e141214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59622/0 (socket says 172.21.15.72:59622) 2023-10-03T10:12:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e18fab700 1 -- 172.21.15.72:0/520299496 learned_addr learned my addr 172.21.15.72:0/520299496 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e13fff700 1 --2- 172.21.15.72:0/520299496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e14134610 0x7f2e14121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e197ac700 1 --2- 172.21.15.72:0/520299496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e14134100 0x7f2e14121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e18fab700 1 -- 172.21.15.72:0/520299496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e14134610 msgr2=0x7f2e14121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e18fab700 1 --2- 172.21.15.72:0/520299496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e14134610 0x7f2e14121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e18fab700 1 -- 172.21.15.72:0/520299496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e14134100 msgr2=0x7f2e14121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e18fab700 1 --2- 172.21.15.72:0/520299496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e14134100 0x7f2e14121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e18fab700 1 -- 172.21.15.72:0/520299496 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e00009550 con 0x7f2e1406e570 2023-10-03T10:12:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e197ac700 1 --2- 172.21.15.72:0/520299496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e14134100 0x7f2e14121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e13fff700 1 --2- 172.21.15.72:0/520299496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e14134610 0x7f2e14121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.256+0000 7f2e18fab700 1 --2- 172.21.15.72:0/520299496 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e1406e570 0x7f2e141214e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800e8a0 tx=0x7f2e0800ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.257+0000 7f2e117fa700 1 -- 172.21.15.72:0/520299496 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08009590 con 0x7f2e1406e570 2023-10-03T10:12:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.257+0000 7f2e117fa700 1 -- 172.21.15.72:0/520299496 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e08013680 con 0x7f2e1406e570 2023-10-03T10:12:53.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.257+0000 7f2e117fa700 1 -- 172.21.15.72:0/520299496 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e080139f0 con 0x7f2e1406e570 2023-10-03T10:12:53.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.257+0000 7f2e1b20f700 1 -- 172.21.15.72:0/520299496 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e14070610 con 0x7f2e1406e570 2023-10-03T10:12:53.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.257+0000 7f2e1b20f700 1 -- 172.21.15.72:0/520299496 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e14123ba0 con 0x7f2e1406e570 2023-10-03T10:12:53.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.258+0000 7f2e117fa700 1 -- 172.21.15.72:0/520299496 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2e08013b50 con 0x7f2e1406e570 2023-10-03T10:12:53.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.258+0000 7f2e1b20f700 1 -- 172.21.15.72:0/520299496 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e14122ac0 con 0x7f2e1406e570 2023-10-03T10:12:53.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.258+0000 7f2e117fa700 1 -- 172.21.15.72:0/520299496 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f2e0803fe90 con 0x7f2e1406e570 2023-10-03T10:12:53.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.258+0000 7f2e13fff700 1 -- 172.21.15.72:0/520299496 >> v1:172.21.15.72:6816/126756 conn(0x7f2df802f510 legacy=0x7f2df80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:53.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.263+0000 7f2e117fa700 1 -- 172.21.15.72:0/520299496 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e0806b750 con 0x7f2e1406e570 2023-10-03T10:12:53.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.294+0000 7f368c7d9700 1 Processor -- start 2023-10-03T10:12:53.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.295+0000 7f368c7d9700 1 -- start start 2023-10-03T10:12:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.295+0000 7f368c7d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368406a770 0x7f368406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.295+0000 7f368c7d9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3684131d10 0x7f3684139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.295+0000 7f368c7d9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368409ece0 con 0x7f368406b080 2023-10-03T10:12:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.295+0000 7f368c7d9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368409e760 con 0x7f3684131d10 2023-10-03T10:12:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.295+0000 7f368c7d9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368409e040 con 0x7f368406a770 2023-10-03T10:12:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.295+0000 7f368a575700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368406a770 0x7f368406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.295+0000 7f368ad76700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3684131d10 0x7f3684139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.295+0000 7f368a575700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368406a770 0x7f368406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45026/0 (socket says 172.21.15.72:45026) 2023-10-03T10:12:53.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.295+0000 7f3689d74700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f368406b080 0x7f3684131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59828/0 (socket says 172.21.15.72:59828) 2023-10-03T10:12:53.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.295+0000 7f368a575700 1 -- 172.21.15.72:0/965846070 learned_addr learned my addr 172.21.15.72:0/965846070 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:53.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.296+0000 7f368a575700 1 -- 172.21.15.72:0/965846070 >> v2:172.21.15.72:3300/0 conn(0x7f3684131d10 msgr2=0x7f3684139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:53.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.296+0000 7f368a575700 1 --2- 172.21.15.72:0/965846070 >> v2:172.21.15.72:3300/0 conn(0x7f3684131d10 0x7f3684139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.296+0000 7f368a575700 1 -- 172.21.15.72:0/965846070 >> v1:172.21.15.72:6789/0 conn(0x7f368406b080 legacy=0x7f3684131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.296+0000 7f3689573700 1 -- 172.21.15.72:0/965846070 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029669810 0 0) 0x7f368409ece0 con 0x7f368406b080 2023-10-03T10:12:53.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.296+0000 7f368a575700 1 -- 172.21.15.72:0/965846070 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368409f630 con 0x7f368406a770 2023-10-03T10:12:53.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.296+0000 7f368a575700 1 --2- 172.21.15.72:0/965846070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368406a770 0x7f368406ab40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f36800098f0 tx=0x7f3680009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e37495b66865dc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.296+0000 7f3689573700 1 -- 172.21.15.72:0/965846070 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680011830 con 0x7f368406a770 2023-10-03T10:12:53.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.296+0000 7f3689573700 1 -- 172.21.15.72:0/965846070 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3680011990 con 0x7f368406a770 2023-10-03T10:12:53.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.296+0000 7f3689573700 1 -- 172.21.15.72:0/965846070 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680011d20 con 0x7f368406a770 2023-10-03T10:12:53.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.297+0000 7f368c7d9700 1 -- 172.21.15.72:0/965846070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368406a770 msgr2=0x7f368406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.297+0000 7f368c7d9700 1 --2- 172.21.15.72:0/965846070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368406a770 0x7f368406ab40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f36800098f0 tx=0x7f3680009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:53.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.297+0000 7f368c7d9700 1 -- 172.21.15.72:0/965846070 shutdown_connections 2023-10-03T10:12:53.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.297+0000 7f368c7d9700 1 --2- 172.21.15.72:0/965846070 >> v2:172.21.15.72:3300/0 conn(0x7f3684131d10 0x7f3684139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.297+0000 7f368c7d9700 1 --2- 172.21.15.72:0/965846070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368406a770 0x7f368406ab40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.297+0000 7f368c7d9700 1 -- 172.21.15.72:0/965846070 >> 172.21.15.72:0/965846070 conn(0x7f3684066f50 msgr2=0x7f368409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.297+0000 7f368c7d9700 1 -- 172.21.15.72:0/965846070 shutdown_connections 2023-10-03T10:12:53.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.297+0000 7f368c7d9700 1 -- 172.21.15.72:0/965846070 wait complete. 2023-10-03T10:12:53.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.298+0000 7f368c7d9700 1 Processor -- start 2023-10-03T10:12:53.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.298+0000 7f368c7d9700 1 -- start start 2023-10-03T10:12:53.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f368c7d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368406a770 0x7f368411e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f368c7d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f368406b080 0x7f368411e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f368c7d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3684131d10 0x7f368411ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f368c7d9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36841214c0 con 0x7f3684131d10 2023-10-03T10:12:53.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f368c7d9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3684120520 con 0x7f368406a770 2023-10-03T10:12:53.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f368c7d9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3684130c50 con 0x7f368406b080 2023-10-03T10:12:53.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f368ad76700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3684131d10 0x7f368411ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f368ad76700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3684131d10 0x7f368411ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60518/0 (socket says 172.21.15.72:60518) 2023-10-03T10:12:53.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f368ad76700 1 -- 172.21.15.72:0/338338832 learned_addr learned my addr 172.21.15.72:0/338338832 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:53.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f3689d74700 1 --2- 172.21.15.72:0/338338832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f368406b080 0x7f368411e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f368a575700 1 --2- 172.21.15.72:0/338338832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368406a770 0x7f368411e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f368ad76700 1 -- 172.21.15.72:0/338338832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f368406b080 msgr2=0x7f368411e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f368ad76700 1 --2- 172.21.15.72:0/338338832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f368406b080 0x7f368411e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f368ad76700 1 -- 172.21.15.72:0/338338832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368406a770 msgr2=0x7f368411e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f368ad76700 1 --2- 172.21.15.72:0/338338832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368406a770 0x7f368411e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.299+0000 7f368ad76700 1 -- 172.21.15.72:0/338338832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680009550 con 0x7f3684131d10 2023-10-03T10:12:53.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.300+0000 7f368ad76700 1 --2- 172.21.15.72:0/338338832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3684131d10 0x7f368411ed40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f367c009dd0 tx=0x7f367c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.300+0000 7f367affd700 1 -- 172.21.15.72:0/338338832 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c009c40 con 0x7f3684131d10 2023-10-03T10:12:53.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.300+0000 7f367affd700 1 -- 172.21.15.72:0/338338832 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c00f040 con 0x7f3684131d10 2023-10-03T10:12:53.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.300+0000 7f368c7d9700 1 -- 172.21.15.72:0/338338832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368409a5f0 con 0x7f3684131d10 2023-10-03T10:12:53.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.300+0000 7f367affd700 1 -- 172.21.15.72:0/338338832 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c00ce50 con 0x7f3684131d10 2023-10-03T10:12:53.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.300+0000 7f368c7d9700 1 -- 172.21.15.72:0/338338832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3684121e30 con 0x7f3684131d10 2023-10-03T10:12:53.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.301+0000 7f368c7d9700 1 -- 172.21.15.72:0/338338832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3684074ea0 con 0x7f3684131d10 2023-10-03T10:12:53.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.301+0000 7f367affd700 1 -- 172.21.15.72:0/338338832 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f367c014480 con 0x7f3684131d10 2023-10-03T10:12:53.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.302+0000 7f367affd700 1 -- 172.21.15.72:0/338338832 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f367c041d60 con 0x7f3684131d10 2023-10-03T10:12:53.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.302+0000 7f368a575700 1 -- 172.21.15.72:0/338338832 >> v1:172.21.15.72:6816/126756 conn(0x7f366802f510 legacy=0x7f36680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:53.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.306+0000 7f367affd700 1 -- 172.21.15.72:0/338338832 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3684121e30 con 0x7f3684131d10 2023-10-03T10:12:53.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.328+0000 7fb1bdce3700 1 Processor -- start 2023-10-03T10:12:53.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.328+0000 7fb1bdce3700 1 -- start start 2023-10-03T10:12:53.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1bdce3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1b806c0e0 0x7fb1b809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1bdce3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb1b8134ec0 0x7fb1b81379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1bdce3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1b8137f20 0x7fb1b81383c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1bdce3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b806c4b0 con 0x7fb1b8134ec0 2023-10-03T10:12:53.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1bdce3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80a09c0 con 0x7fb1b8137f20 2023-10-03T10:12:53.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1bdce3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8134980 con 0x7fb1b806c0e0 2023-10-03T10:12:53.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1b6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb1b8134ec0 0x7fb1b81379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1b77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1b806c0e0 0x7fb1b809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1b6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb1b8134ec0 0x7fb1b81379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60528/0 (socket says 172.21.15.72:60528) 2023-10-03T10:12:53.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1b77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1b806c0e0 0x7fb1b809ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59634/0 (socket says 172.21.15.72:59634) 2023-10-03T10:12:53.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1b6ffd700 1 -- 172.21.15.72:0/808084838 learned_addr learned my addr 172.21.15.72:0/808084838 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:53.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1b77fe700 1 -- 172.21.15.72:0/808084838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1b8137f20 msgr2=0x7fb1b81383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:53.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1b77fe700 1 --2- 172.21.15.72:0/808084838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1b8137f20 0x7fb1b81383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1b77fe700 1 -- 172.21.15.72:0/808084838 >> v2:172.21.15.72:3300/0 conn(0x7fb1b8134ec0 msgr2=0x7fb1b81379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:53.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1b77fe700 1 --2- 172.21.15.72:0/808084838 >> v2:172.21.15.72:3300/0 conn(0x7fb1b8134ec0 0x7fb1b81379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1b77fe700 1 -- 172.21.15.72:0/808084838 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b80a0600 con 0x7fb1b806c0e0 2023-10-03T10:12:53.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.329+0000 7fb1b6ffd700 1 --2- 172.21.15.72:0/808084838 >> v2:172.21.15.72:3300/0 conn(0x7fb1b8134ec0 0x7fb1b81379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:53.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.330+0000 7fb1b77fe700 1 --2- 172.21.15.72:0/808084838 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1b806c0e0 0x7fb1b809ac90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009840 tx=0x7fb1a8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d89dd2186024b344 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.330+0000 7fb1b67fc700 1 -- 172.21.15.72:0/808084838 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8011830 con 0x7fb1b806c0e0 2023-10-03T10:12:53.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.330+0000 7fb1b67fc700 1 -- 172.21.15.72:0/808084838 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a8011990 con 0x7fb1b806c0e0 2023-10-03T10:12:53.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.330+0000 7fb1b67fc700 1 -- 172.21.15.72:0/808084838 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8011d20 con 0x7fb1b806c0e0 2023-10-03T10:12:53.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.330+0000 7fb1bdce3700 1 -- 172.21.15.72:0/808084838 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1b806c0e0 msgr2=0x7fb1b809ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.330+0000 7fb1bdce3700 1 --2- 172.21.15.72:0/808084838 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1b806c0e0 0x7fb1b809ac90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009840 tx=0x7fb1a8009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:53.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.330+0000 7fb1bdce3700 1 -- 172.21.15.72:0/808084838 shutdown_connections 2023-10-03T10:12:53.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.330+0000 7fb1bdce3700 1 --2- 172.21.15.72:0/808084838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1b8137f20 0x7fb1b81383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.330+0000 7fb1bdce3700 1 --2- 172.21.15.72:0/808084838 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1b806c0e0 0x7fb1b809ac90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.330+0000 7fb1bdce3700 1 --2- 172.21.15.72:0/808084838 >> v2:172.21.15.72:3300/0 conn(0x7fb1b8134ec0 0x7fb1b81379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.330+0000 7fb1bdce3700 1 -- 172.21.15.72:0/808084838 >> 172.21.15.72:0/808084838 conn(0x7fb1b80a4210 msgr2=0x7fb1b80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.331+0000 7fb1bdce3700 1 -- 172.21.15.72:0/808084838 shutdown_connections 2023-10-03T10:12:53.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.331+0000 7fb1bdce3700 1 -- 172.21.15.72:0/808084838 wait complete. 2023-10-03T10:12:53.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.331+0000 7fb1bdce3700 1 Processor -- start 2023-10-03T10:12:53.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.332+0000 7fb1bdce3700 1 -- start start 2023-10-03T10:12:53.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.332+0000 7fb1bdce3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1b806c0e0 0x7fb1b81ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.332+0000 7fb1bdce3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1b8134ec0 0x7fb1b81cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.332+0000 7fb1bdce3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1b8137f20 0x7fb1b811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:53.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.332+0000 7fb1bdce3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b811da30 con 0x7fb1b806c0e0 2023-10-03T10:12:53.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.332+0000 7fb1bdce3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b811cd10 con 0x7fb1b8137f20 2023-10-03T10:12:53.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.332+0000 7fb1bdce3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b81341c0 con 0x7fb1b8134ec0 2023-10-03T10:12:53.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.332+0000 7fb1b77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1b806c0e0 0x7fb1b81ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.332+0000 7fb1b6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1b8134ec0 0x7fb1b81cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.332+0000 7fb1b77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1b806c0e0 0x7fb1b81ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60538/0 (socket says 172.21.15.72:60538) 2023-10-03T10:12:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.332+0000 7fb1b77fe700 1 -- 172.21.15.72:0/3912410282 learned_addr learned my addr 172.21.15.72:0/3912410282 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.332+0000 7fb1b7fff700 1 --2- 172.21.15.72:0/3912410282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1b8137f20 0x7fb1b811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.333+0000 7fb1b6ffd700 1 -- 172.21.15.72:0/3912410282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1b8137f20 msgr2=0x7fb1b811a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.333+0000 7fb1b6ffd700 1 --2- 172.21.15.72:0/3912410282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1b8137f20 0x7fb1b811a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.333+0000 7fb1b6ffd700 1 -- 172.21.15.72:0/3912410282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1b806c0e0 msgr2=0x7fb1b81ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.333+0000 7fb1b6ffd700 1 --2- 172.21.15.72:0/3912410282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1b806c0e0 0x7fb1b81ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.333+0000 7fb1b6ffd700 1 -- 172.21.15.72:0/3912410282 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac009550 con 0x7fb1b8134ec0 2023-10-03T10:12:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.333+0000 7fb1b7fff700 1 --2- 172.21.15.72:0/3912410282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1b8137f20 0x7fb1b811a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.333+0000 7fb1b77fe700 1 --2- 172.21.15.72:0/3912410282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1b806c0e0 0x7fb1b81ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.333+0000 7fb1b6ffd700 1 --2- 172.21.15.72:0/3912410282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1b8134ec0 0x7fb1b81cd290 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00e9a0 tx=0x7fb1ac00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:53.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.333+0000 7fb19ffff700 1 -- 172.21.15.72:0/3912410282 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac004240 con 0x7fb1b8134ec0 2023-10-03T10:12:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.333+0000 7fb19ffff700 1 -- 172.21.15.72:0/3912410282 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac0043a0 con 0x7fb1b8134ec0 2023-10-03T10:12:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.333+0000 7fb19ffff700 1 -- 172.21.15.72:0/3912410282 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac0036a0 con 0x7fb1b8134ec0 2023-10-03T10:12:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.333+0000 7fb1bdce3700 1 -- 172.21.15.72:0/3912410282 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a80094a0 con 0x7fb1b8134ec0 2023-10-03T10:12:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.333+0000 7fb1bdce3700 1 -- 172.21.15.72:0/3912410282 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b811c250 con 0x7fb1b8134ec0 2023-10-03T10:12:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.334+0000 7fb19ffff700 1 -- 172.21.15.72:0/3912410282 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb1ac003800 con 0x7fb1b8134ec0 2023-10-03T10:12:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.334+0000 7fb1bdce3700 1 -- 172.21.15.72:0/3912410282 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b8074ea0 con 0x7fb1b8134ec0 2023-10-03T10:12:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.335+0000 7fb1b77fe700 1 -- 172.21.15.72:0/3912410282 >> v1:172.21.15.72:6816/126756 conn(0x7fb1a402f510 legacy=0x7fb1a40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.335+0000 7fb19ffff700 1 -- 172.21.15.72:0/3912410282 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fb1ac01bd00 con 0x7fb1b8134ec0 2023-10-03T10:12:53.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.343+0000 7fb19ffff700 1 -- 172.21.15.72:0/3912410282 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1ac045060 con 0x7fb1b8134ec0 2023-10-03T10:12:53.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.405+0000 7f2984a0f700 1 -- 172.21.15.72:0/1654341434 >> v1:172.21.15.72:6816/126756 conn(0x7f296402f510 legacy=0x7f29640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:53.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.419+0000 7f2987474700 1 -- 172.21.15.72:0/1654341434 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f298006ea40 con 0x7f29801338a0 2023-10-03T10:12:53.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.420+0000 7f2975ffb700 1 -- 172.21.15.72:0/1654341434 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f297c017020 con 0x7f29801338a0 2023-10-03T10:12:53.420 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:53.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.423+0000 7f2987474700 1 -- 172.21.15.72:0/1654341434 >> v1:172.21.15.72:6816/126756 conn(0x7f296402f510 legacy=0x7f29640319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:53.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.423+0000 7f2987474700 1 -- 172.21.15.72:0/1654341434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29801338a0 msgr2=0x7f298011adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.423+0000 7f2987474700 1 --2- 172.21.15.72:0/1654341434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29801338a0 0x7f298011adc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f297c00c520 tx=0x7f297c00c830 comp rx=0 tx=0).stop 2023-10-03T10:12:53.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.423+0000 7f2987474700 1 -- 172.21.15.72:0/1654341434 shutdown_connections 2023-10-03T10:12:53.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.423+0000 7f2987474700 1 --2- 172.21.15.72:0/1654341434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2980139030 0x7f298011b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.423+0000 7f2987474700 1 --2- 172.21.15.72:0/1654341434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29801338a0 0x7f298011adc0 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f297c00c520 tx=0x7f297c00c830 comp rx=0 tx=0).stop 2023-10-03T10:12:53.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.423+0000 7f2987474700 1 --2- 172.21.15.72:0/1654341434 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2980136710 0x7f298011b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.423+0000 7f2987474700 1 -- 172.21.15.72:0/1654341434 >> 172.21.15.72:0/1654341434 conn(0x7f29800a2aa0 msgr2=0x7f29801344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.423+0000 7f2987474700 1 -- 172.21.15.72:0/1654341434 shutdown_connections 2023-10-03T10:12:53.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.423+0000 7f2987474700 1 -- 172.21.15.72:0/1654341434 wait complete. 2023-10-03T10:12:53.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:53.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.459+0000 7f2e13fff700 1 -- 172.21.15.72:0/520299496 >> v1:172.21.15.72:6816/126756 conn(0x7f2df802f510 legacy=0x7f2df80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:53.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.462+0000 7f2e1b20f700 1 -- 172.21.15.72:0/520299496 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e1409b1e0 con 0x7f2e1406e570 2023-10-03T10:12:53.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.463+0000 7f2e117fa700 1 -- 172.21.15.72:0/520299496 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e08021020 con 0x7f2e1406e570 2023-10-03T10:12:53.463 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.465+0000 7f2e1b20f700 1 -- 172.21.15.72:0/520299496 >> v1:172.21.15.72:6816/126756 conn(0x7f2df802f510 legacy=0x7f2df80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.465+0000 7f2e1b20f700 1 -- 172.21.15.72:0/520299496 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e1406e570 msgr2=0x7f2e141214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.465+0000 7f2e1b20f700 1 --2- 172.21.15.72:0/520299496 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e1406e570 0x7f2e141214e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800e8a0 tx=0x7f2e0800ebb0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.465+0000 7f2e1b20f700 1 -- 172.21.15.72:0/520299496 shutdown_connections 2023-10-03T10:12:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.465+0000 7f2e1b20f700 1 --2- 172.21.15.72:0/520299496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e14134100 0x7f2e14121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.465+0000 7f2e1b20f700 1 --2- 172.21.15.72:0/520299496 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e1406e570 0x7f2e141214e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.465+0000 7f2e1b20f700 1 --2- 172.21.15.72:0/520299496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e14134610 0x7f2e14121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.465+0000 7f2e1b20f700 1 -- 172.21.15.72:0/520299496 >> 172.21.15.72:0/520299496 conn(0x7f2e140a2aa0 msgr2=0x7f2e141bf210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.465+0000 7f2e1b20f700 1 -- 172.21.15.72:0/520299496 shutdown_connections 2023-10-03T10:12:53.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.465+0000 7f2e1b20f700 1 -- 172.21.15.72:0/520299496 wait complete. 2023-10-03T10:12:53.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.503+0000 7f368a575700 1 -- 172.21.15.72:0/338338832 >> v1:172.21.15.72:6816/126756 conn(0x7f366802f510 legacy=0x7f36680319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.513+0000 7f368c7d9700 1 -- 172.21.15.72:0/338338832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3684121e30 con 0x7f3684131d10 2023-10-03T10:12:53.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.513+0000 7f367affd700 1 -- 172.21.15.72:0/338338832 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3684121e30 con 0x7f3684131d10 2023-10-03T10:12:53.514 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:53.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.515+0000 7f368c7d9700 1 -- 172.21.15.72:0/338338832 >> v1:172.21.15.72:6816/126756 conn(0x7f366802f510 legacy=0x7f36680319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:53.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.515+0000 7f368c7d9700 1 -- 172.21.15.72:0/338338832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3684131d10 msgr2=0x7f368411ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.515+0000 7f368c7d9700 1 --2- 172.21.15.72:0/338338832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3684131d10 0x7f368411ed40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f367c009dd0 tx=0x7f367c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.515+0000 7f368c7d9700 1 -- 172.21.15.72:0/338338832 shutdown_connections 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.515+0000 7f368c7d9700 1 --2- 172.21.15.72:0/338338832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3684131d10 0x7f368411ed40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.515+0000 7f368c7d9700 1 --2- 172.21.15.72:0/338338832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368406a770 0x7f368411e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.515+0000 7f368c7d9700 1 --2- 172.21.15.72:0/338338832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f368406b080 0x7f368411e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.515+0000 7f368c7d9700 1 -- 172.21.15.72:0/338338832 >> 172.21.15.72:0/338338832 conn(0x7f3684066f50 msgr2=0x7f36840a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.515+0000 7f368c7d9700 1 -- 172.21.15.72:0/338338832 shutdown_connections 2023-10-03T10:12:53.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.515+0000 7f368c7d9700 1 -- 172.21.15.72:0/338338832 wait complete. 2023-10-03T10:12:53.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:53.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.536+0000 7fb1b77fe700 1 -- 172.21.15.72:0/3912410282 >> v1:172.21.15.72:6816/126756 conn(0x7fb1a402f510 legacy=0x7fb1a40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.540+0000 7fb1bdce3700 1 -- 172.21.15.72:0/3912410282 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb1b806b250 con 0x7fb1b8134ec0 2023-10-03T10:12:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.540+0000 7fb19ffff700 1 -- 172.21.15.72:0/3912410282 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1ac00c640 con 0x7fb1b8134ec0 2023-10-03T10:12:53.541 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:53.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.542+0000 7fb1bdce3700 1 -- 172.21.15.72:0/3912410282 >> v1:172.21.15.72:6816/126756 conn(0x7fb1a402f510 legacy=0x7fb1a40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:53.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.542+0000 7fb1bdce3700 1 -- 172.21.15.72:0/3912410282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1b8134ec0 msgr2=0x7fb1b81cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:53.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.543+0000 7fb1bdce3700 1 --2- 172.21.15.72:0/3912410282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1b8134ec0 0x7fb1b81cd290 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00e9a0 tx=0x7fb1ac00ecb0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.543+0000 7fb1bdce3700 1 -- 172.21.15.72:0/3912410282 shutdown_connections 2023-10-03T10:12:53.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.543+0000 7fb1bdce3700 1 --2- 172.21.15.72:0/3912410282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1b806c0e0 0x7fb1b81ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.543+0000 7fb1bdce3700 1 --2- 172.21.15.72:0/3912410282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1b8137f20 0x7fb1b811a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.543+0000 7fb1bdce3700 1 --2- 172.21.15.72:0/3912410282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1b8134ec0 0x7fb1b81cd290 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:53.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.543+0000 7fb1bdce3700 1 -- 172.21.15.72:0/3912410282 >> 172.21.15.72:0/3912410282 conn(0x7fb1b80a4210 msgr2=0x7fb1b8099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:53.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.543+0000 7fb1bdce3700 1 -- 172.21.15.72:0/3912410282 shutdown_connections 2023-10-03T10:12:53.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:53.543+0000 7fb1bdce3700 1 -- 172.21.15.72:0/3912410282 wait complete. 2023-10-03T10:12:53.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:54.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:54.479 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:54.529 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:54.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:54.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.577+0000 7f59e447c700 1 Processor -- start 2023-10-03T10:12:54.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.577+0000 7f59e447c700 1 -- start start 2023-10-03T10:12:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.578+0000 7f59e447c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09d6f0 0x7f59dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.578+0000 7f59e447c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e410 0x7f59dc130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.578+0000 7f59e447c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc09f130 con 0x7f59dc09e000 2023-10-03T10:12:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.578+0000 7f59e447c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc09f520 con 0x7f59dc09d6f0 2023-10-03T10:12:54.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.578+0000 7f59e447c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc09e930 con 0x7f59dc09e410 2023-10-03T10:12:54.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.578+0000 7f59e2218700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09d6f0 0x7f59dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.578+0000 7f59e2a19700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e410 0x7f59dc130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.578+0000 7f59e2218700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09d6f0 0x7f59dc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45054/0 (socket says 172.21.15.72:45054) 2023-10-03T10:12:54.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.578+0000 7f59e2218700 1 -- 172.21.15.72:0/291361221 learned_addr learned my addr 172.21.15.72:0/291361221 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:54.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.579+0000 7f59e2218700 1 -- 172.21.15.72:0/291361221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e410 msgr2=0x7f59dc130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:54.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.579+0000 7f59e2218700 1 --2- 172.21.15.72:0/291361221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e410 0x7f59dc130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.579+0000 7f59e2218700 1 -- 172.21.15.72:0/291361221 >> v1:172.21.15.72:6789/0 conn(0x7f59dc09e000 legacy=0x7f59dc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:54.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.579+0000 7f59e2218700 1 -- 172.21.15.72:0/291361221 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc09b2d0 con 0x7f59dc09d6f0 2023-10-03T10:12:54.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.579+0000 7f59e2a19700 1 --2- 172.21.15.72:0/291361221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e410 0x7f59dc130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:54.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.579+0000 7f59e2218700 1 --2- 172.21.15.72:0/291361221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09d6f0 0x7f59dc09dac0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009920 tx=0x7f59d8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2501032e372405f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.579+0000 7f59e1216700 1 -- 172.21.15.72:0/291361221 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d8004230 con 0x7f59dc09d6f0 2023-10-03T10:12:54.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.579+0000 7f59e1216700 1 -- 172.21.15.72:0/291361221 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d8004390 con 0x7f59dc09d6f0 2023-10-03T10:12:54.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.579+0000 7f59e1216700 1 -- 172.21.15.72:0/291361221 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d80036a0 con 0x7f59dc09d6f0 2023-10-03T10:12:54.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.580+0000 7f59e447c700 1 -- 172.21.15.72:0/291361221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09d6f0 msgr2=0x7f59dc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.580+0000 7f59e447c700 1 --2- 172.21.15.72:0/291361221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09d6f0 0x7f59dc09dac0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009920 tx=0x7f59d8009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:54.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.580+0000 7f59e447c700 1 -- 172.21.15.72:0/291361221 shutdown_connections 2023-10-03T10:12:54.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.580+0000 7f59e447c700 1 --2- 172.21.15.72:0/291361221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e410 0x7f59dc130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.580+0000 7f59e447c700 1 --2- 172.21.15.72:0/291361221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09d6f0 0x7f59dc09dac0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.580+0000 7f59e447c700 1 -- 172.21.15.72:0/291361221 >> 172.21.15.72:0/291361221 conn(0x7f59dc066f50 msgr2=0x7f59dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.580+0000 7f59e447c700 1 -- 172.21.15.72:0/291361221 shutdown_connections 2023-10-03T10:12:54.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.580+0000 7f59e447c700 1 -- 172.21.15.72:0/291361221 wait complete. 2023-10-03T10:12:54.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.581+0000 7f59e447c700 1 Processor -- start 2023-10-03T10:12:54.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.581+0000 7f59e447c700 1 -- start start 2023-10-03T10:12:54.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.581+0000 7f59e447c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09d6f0 0x7f59dc122410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.581+0000 7f59e447c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc09e000 0x7f59dc122950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.581+0000 7f59e447c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e410 0x7f59dc122e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.581+0000 7f59e447c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc09c700 con 0x7f59dc09e000 2023-10-03T10:12:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.581+0000 7f59e447c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc123850 con 0x7f59dc09d6f0 2023-10-03T10:12:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.581+0000 7f59e447c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc124130 con 0x7f59dc09e410 2023-10-03T10:12:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.582+0000 7f59e2218700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09d6f0 0x7f59dc122410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.582+0000 7f59e2218700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09d6f0 0x7f59dc122410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45060/0 (socket says 172.21.15.72:45060) 2023-10-03T10:12:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.582+0000 7f59e2218700 1 -- 172.21.15.72:0/1627003712 learned_addr learned my addr 172.21.15.72:0/1627003712 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.582+0000 7f59e1a17700 1 --2- 172.21.15.72:0/1627003712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc09e000 0x7f59dc122950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.582+0000 7f59e2218700 1 -- 172.21.15.72:0/1627003712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e410 msgr2=0x7f59dc122e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.582+0000 7f59e2218700 1 --2- 172.21.15.72:0/1627003712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e410 0x7f59dc122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.582+0000 7f59e2218700 1 -- 172.21.15.72:0/1627003712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc09e000 msgr2=0x7f59dc122950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.582+0000 7f59e2218700 1 --2- 172.21.15.72:0/1627003712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc09e000 0x7f59dc122950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.582+0000 7f59e2218700 1 -- 172.21.15.72:0/1627003712 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4009a70 con 0x7f59dc09d6f0 2023-10-03T10:12:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.582+0000 7f59e2218700 1 --2- 172.21.15.72:0/1627003712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09d6f0 0x7f59dc122410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f59d8000c00 tx=0x7f59d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.582+0000 7f59d2ffd700 1 -- 172.21.15.72:0/1627003712 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d8003e20 con 0x7f59dc09d6f0 2023-10-03T10:12:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.582+0000 7f59d2ffd700 1 -- 172.21.15.72:0/1627003712 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d8011630 con 0x7f59dc09d6f0 2023-10-03T10:12:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.582+0000 7f59e447c700 1 -- 172.21.15.72:0/1627003712 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d8009550 con 0x7f59dc09d6f0 2023-10-03T10:12:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.582+0000 7f59d2ffd700 1 -- 172.21.15.72:0/1627003712 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d80119e0 con 0x7f59dc09d6f0 2023-10-03T10:12:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.583+0000 7f59e447c700 1 -- 172.21.15.72:0/1627003712 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc124810 con 0x7f59dc09d6f0 2023-10-03T10:12:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.584+0000 7f59e447c700 1 -- 172.21.15.72:0/1627003712 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59dc074ea0 con 0x7f59dc09d6f0 2023-10-03T10:12:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.584+0000 7f59d2ffd700 1 -- 172.21.15.72:0/1627003712 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f59d8021070 con 0x7f59dc09d6f0 2023-10-03T10:12:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.584+0000 7f59e1a17700 1 -- 172.21.15.72:0/1627003712 >> v1:172.21.15.72:6816/126756 conn(0x7f59c002f510 legacy=0x7f59c00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.584+0000 7f59d2ffd700 1 -- 172.21.15.72:0/1627003712 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f59d8042a70 con 0x7f59dc09d6f0 2023-10-03T10:12:54.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.593+0000 7f59d2ffd700 1 -- 172.21.15.72:0/1627003712 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59d8046060 con 0x7f59dc09d6f0 2023-10-03T10:12:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.623+0000 7fd9ae82d700 1 Processor -- start 2023-10-03T10:12:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.623+0000 7fd9ae82d700 1 -- start start 2023-10-03T10:12:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.623+0000 7fd9ae82d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9a809d6f0 0x7fd9a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.623+0000 7fd9ae82d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9a809e000 0x7fd9a81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.623+0000 7fd9ae82d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd9a809e410 0x7fd9a8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.623+0000 7fd9ae82d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a806b460 con 0x7fd9a809e410 2023-10-03T10:12:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.623+0000 7fd9ae82d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a809b120 con 0x7fd9a809e000 2023-10-03T10:12:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.623+0000 7fd9ae82d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a809a7e0 con 0x7fd9a809d6f0 2023-10-03T10:12:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.623+0000 7fd9acdca700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd9a809e410 0x7fd9a8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.623+0000 7fd9a77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9a809e000 0x7fd9a81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.623+0000 7fd9acdca700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd9a809e410 0x7fd9a8133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60546/0 (socket says 172.21.15.72:60546) 2023-10-03T10:12:54.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.623+0000 7fd9acdca700 1 -- 172.21.15.72:0/1722862287 learned_addr learned my addr 172.21.15.72:0/1722862287 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:54.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.624+0000 7fd9a77fe700 1 -- 172.21.15.72:0/1722862287 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9a809d6f0 msgr2=0x7fd9a809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:54.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.624+0000 7fd9a77fe700 1 --2- 172.21.15.72:0/1722862287 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9a809d6f0 0x7fd9a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.624+0000 7fd9a77fe700 1 -- 172.21.15.72:0/1722862287 >> v2:172.21.15.72:3300/0 conn(0x7fd9a809e410 msgr2=0x7fd9a8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:54.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.624+0000 7fd9a77fe700 1 --2- 172.21.15.72:0/1722862287 >> v2:172.21.15.72:3300/0 conn(0x7fd9a809e410 0x7fd9a8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.624+0000 7fd9a77fe700 1 -- 172.21.15.72:0/1722862287 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a809a500 con 0x7fd9a809e000 2023-10-03T10:12:54.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.624+0000 7fd9acdca700 1 --2- 172.21.15.72:0/1722862287 >> v2:172.21.15.72:3300/0 conn(0x7fd9a809e410 0x7fd9a8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.624+0000 7fd9a77fe700 1 --2- 172.21.15.72:0/1722862287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9a809e000 0x7fd9a81339f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd99c009870 tx=0x7fd99c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45b23c995a891d50 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.624+0000 7fd9a6ffd700 1 -- 172.21.15.72:0/1722862287 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c011830 con 0x7fd9a809e000 2023-10-03T10:12:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.624+0000 7fd9a6ffd700 1 -- 172.21.15.72:0/1722862287 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c011990 con 0x7fd9a809e000 2023-10-03T10:12:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.624+0000 7fd9a6ffd700 1 -- 172.21.15.72:0/1722862287 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c011d20 con 0x7fd9a809e000 2023-10-03T10:12:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.625+0000 7fd9ae82d700 1 -- 172.21.15.72:0/1722862287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9a809e000 msgr2=0x7fd9a81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.625+0000 7fd9ae82d700 1 --2- 172.21.15.72:0/1722862287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9a809e000 0x7fd9a81339f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd99c009870 tx=0x7fd99c009b80 comp rx=0 tx=0).stop 2023-10-03T10:12:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.625+0000 7fd9ae82d700 1 -- 172.21.15.72:0/1722862287 shutdown_connections 2023-10-03T10:12:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.625+0000 7fd9ae82d700 1 --2- 172.21.15.72:0/1722862287 >> v2:172.21.15.72:3300/0 conn(0x7fd9a809e410 0x7fd9a8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.625+0000 7fd9ae82d700 1 --2- 172.21.15.72:0/1722862287 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9a809d6f0 0x7fd9a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.625+0000 7fd9ae82d700 1 --2- 172.21.15.72:0/1722862287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9a809e000 0x7fd9a81339f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.625+0000 7fd9ae82d700 1 -- 172.21.15.72:0/1722862287 >> 172.21.15.72:0/1722862287 conn(0x7fd9a8066f50 msgr2=0x7fd9a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.625+0000 7fd9ae82d700 1 -- 172.21.15.72:0/1722862287 shutdown_connections 2023-10-03T10:12:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.625+0000 7fd9ae82d700 1 -- 172.21.15.72:0/1722862287 wait complete. 2023-10-03T10:12:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.626+0000 7fd9ae82d700 1 Processor -- start 2023-10-03T10:12:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.626+0000 7fd9ae82d700 1 -- start start 2023-10-03T10:12:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.626+0000 7fd9ae82d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9a809d6f0 0x7fd9a81a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.626+0000 7fd9ae82d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9a809e000 0x7fd9a81a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.626+0000 7fd9ae82d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9a809e410 0x7fd9a81a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.626+0000 7fd9ae82d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a81a7380 con 0x7fd9a809e000 2023-10-03T10:12:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.626+0000 7fd9ae82d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a81a99f0 con 0x7fd9a809d6f0 2023-10-03T10:12:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.626+0000 7fd9ae82d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a81a8da0 con 0x7fd9a809e410 2023-10-03T10:12:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.626+0000 7fd9a7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9a809d6f0 0x7fd9a81a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.626+0000 7fd9a7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9a809d6f0 0x7fd9a81a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45090/0 (socket says 172.21.15.72:45090) 2023-10-03T10:12:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.626+0000 7fd9a7fff700 1 -- 172.21.15.72:0/2479588267 learned_addr learned my addr 172.21.15.72:0/2479588267 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.626+0000 7fd9a77fe700 1 --2- 172.21.15.72:0/2479588267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9a809e000 0x7fd9a81a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.627+0000 7fd9acdca700 1 --2- 172.21.15.72:0/2479588267 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9a809e410 0x7fd9a81a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.627+0000 7fd9a77fe700 1 -- 172.21.15.72:0/2479588267 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9a809e410 msgr2=0x7fd9a81a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.627+0000 7fd9a77fe700 1 --2- 172.21.15.72:0/2479588267 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9a809e410 0x7fd9a81a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.627+0000 7fd9a77fe700 1 -- 172.21.15.72:0/2479588267 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9a809d6f0 msgr2=0x7fd9a81a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.627+0000 7fd9a77fe700 1 --2- 172.21.15.72:0/2479588267 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9a809d6f0 0x7fd9a81a5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.627+0000 7fd9a77fe700 1 -- 172.21.15.72:0/2479588267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a0009b30 con 0x7fd9a809e000 2023-10-03T10:12:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.627+0000 7fd9a7fff700 1 --2- 172.21.15.72:0/2479588267 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9a809d6f0 0x7fd9a81a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.627+0000 7fd9a77fe700 1 --2- 172.21.15.72:0/2479588267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9a809e000 0x7fd9a81a6410 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd9a809e9b0 tx=0x7fd99c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.627+0000 7fd9a4ff9700 1 -- 172.21.15.72:0/2479588267 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c004590 con 0x7fd9a809e000 2023-10-03T10:12:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.627+0000 7fd9a4ff9700 1 -- 172.21.15.72:0/2479588267 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c01f070 con 0x7fd9a809e000 2023-10-03T10:12:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.627+0000 7fd9a4ff9700 1 -- 172.21.15.72:0/2479588267 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0038e0 con 0x7fd9a809e000 2023-10-03T10:12:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.627+0000 7fd9ae82d700 1 -- 172.21.15.72:0/2479588267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99c0094a0 con 0x7fd9a809e000 2023-10-03T10:12:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.627+0000 7fd9ae82d700 1 -- 172.21.15.72:0/2479588267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a81a88e0 con 0x7fd9a809e000 2023-10-03T10:12:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.628+0000 7fd9a4ff9700 1 -- 172.21.15.72:0/2479588267 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd99c003a40 con 0x7fd9a809e000 2023-10-03T10:12:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.628+0000 7fd9a4ff9700 1 -- 172.21.15.72:0/2479588267 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd99c021070 con 0x7fd9a809e000 2023-10-03T10:12:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.628+0000 7fd9a7fff700 1 -- 172.21.15.72:0/2479588267 >> v1:172.21.15.72:6816/126756 conn(0x7fd99402f510 legacy=0x7fd9940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:54.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.629+0000 7fd9ae82d700 1 -- 172.21.15.72:0/2479588267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a8074ea0 con 0x7fd9a809e000 2023-10-03T10:12:54.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.633+0000 7fd9a4ff9700 1 -- 172.21.15.72:0/2479588267 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd99c02b080 con 0x7fd9a809e000 2023-10-03T10:12:54.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.684+0000 7fe4c0893700 1 Processor -- start 2023-10-03T10:12:54.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.684+0000 7fe4c0893700 1 -- start start 2023-10-03T10:12:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.685+0000 7fe4c0893700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4bc1338a0 0x7fe4bc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.685+0000 7fe4c0893700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4bc09de50 0x7fe4bc09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.685+0000 7fe4c0893700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4bc06ef30 con 0x7fe4bc09e760 2023-10-03T10:12:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.685+0000 7fe4c0893700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4bc06fef0 con 0x7fe4bc09de50 2023-10-03T10:12:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.685+0000 7fe4c0893700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc1334b0 con 0x7fe4bc1338a0 2023-10-03T10:12:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.685+0000 7fe4b9d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4bc09de50 0x7fe4bc09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.685+0000 7fe4bad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe4bc09e760 0x7fe4bc13a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59848/0 (socket says 172.21.15.72:59848) 2023-10-03T10:12:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.685+0000 7fe4b9d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4bc09de50 0x7fe4bc09e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60568/0 (socket says 172.21.15.72:60568) 2023-10-03T10:12:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.685+0000 7fe4bad9d700 1 -- 172.21.15.72:0/3782543681 learned_addr learned my addr 172.21.15.72:0/3782543681 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.685+0000 7fe4ba59c700 1 --2- 172.21.15.72:0/3782543681 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4bc1338a0 0x7fe4bc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.686+0000 7fe4b9d9b700 1 -- 172.21.15.72:0/3782543681 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4bc1338a0 msgr2=0x7fe4bc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.686+0000 7fe4b9d9b700 1 --2- 172.21.15.72:0/3782543681 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4bc1338a0 0x7fe4bc133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.686+0000 7fe4b9d9b700 1 -- 172.21.15.72:0/3782543681 >> v1:172.21.15.72:6789/0 conn(0x7fe4bc09e760 legacy=0x7fe4bc13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.686+0000 7fe4b959a700 1 -- 172.21.15.72:0/3782543681 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175928368 0 0) 0x7fe4bc06ef30 con 0x7fe4bc09e760 2023-10-03T10:12:54.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.686+0000 7fe4b9d9b700 1 -- 172.21.15.72:0/3782543681 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc06fc30 con 0x7fe4bc09de50 2023-10-03T10:12:54.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.686+0000 7fe4b9d9b700 1 --2- 172.21.15.72:0/3782543681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09de50 0x7fe4bc09e220 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0009840 tx=0x7fe4b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd4395f4cb7ea30 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.686+0000 7fe4b959a700 1 -- 172.21.15.72:0/3782543681 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0011830 con 0x7fe4bc09de50 2023-10-03T10:12:54.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.686+0000 7fe4b959a700 1 -- 172.21.15.72:0/3782543681 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b0011990 con 0x7fe4bc09de50 2023-10-03T10:12:54.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.686+0000 7fe4b959a700 1 -- 172.21.15.72:0/3782543681 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0011d20 con 0x7fe4bc09de50 2023-10-03T10:12:54.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.687+0000 7fe4c0893700 1 -- 172.21.15.72:0/3782543681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09de50 msgr2=0x7fe4bc09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.687+0000 7fe4c0893700 1 --2- 172.21.15.72:0/3782543681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09de50 0x7fe4bc09e220 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0009840 tx=0x7fe4b0009b50 comp rx=0 tx=0).stop 2023-10-03T10:12:54.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.687+0000 7fe4c0893700 1 -- 172.21.15.72:0/3782543681 shutdown_connections 2023-10-03T10:12:54.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.687+0000 7fe4c0893700 1 --2- 172.21.15.72:0/3782543681 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4bc1338a0 0x7fe4bc133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.687+0000 7fe4c0893700 1 --2- 172.21.15.72:0/3782543681 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09de50 0x7fe4bc09e220 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.687+0000 7fe4c0893700 1 -- 172.21.15.72:0/3782543681 >> 172.21.15.72:0/3782543681 conn(0x7fe4bc0a2aa0 msgr2=0x7fe4bc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.687+0000 7fe4c0893700 1 -- 172.21.15.72:0/3782543681 shutdown_connections 2023-10-03T10:12:54.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.687+0000 7fe4c0893700 1 -- 172.21.15.72:0/3782543681 wait complete. 2023-10-03T10:12:54.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.688+0000 7fe4c0893700 1 Processor -- start 2023-10-03T10:12:54.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.688+0000 7fe4c0893700 1 -- start start 2023-10-03T10:12:54.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.688+0000 7fe4c0893700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09de50 0x7fe4bc11b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.688+0000 7fe4c0893700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e760 0x7fe4bc11bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.688+0000 7fe4c0893700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4bc1338a0 0x7fe4bc11c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.688+0000 7fe4c0893700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc11cbc0 con 0x7fe4bc09de50 2023-10-03T10:12:54.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.688+0000 7fe4c0893700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc11d1f0 con 0x7fe4bc09e760 2023-10-03T10:12:54.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.688+0000 7fe4c0893700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc11e440 con 0x7fe4bc1338a0 2023-10-03T10:12:54.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4ba59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09de50 0x7fe4bc11b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4ba59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09de50 0x7fe4bc11b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60580/0 (socket says 172.21.15.72:60580) 2023-10-03T10:12:54.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4ba59c700 1 -- 172.21.15.72:0/3289893450 learned_addr learned my addr 172.21.15.72:0/3289893450 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:54.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4b9d9b700 1 --2- 172.21.15.72:0/3289893450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e760 0x7fe4bc11bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4bad9d700 1 --2- 172.21.15.72:0/3289893450 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4bc1338a0 0x7fe4bc11c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4ba59c700 1 -- 172.21.15.72:0/3289893450 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4bc1338a0 msgr2=0x7fe4bc11c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4ba59c700 1 --2- 172.21.15.72:0/3289893450 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4bc1338a0 0x7fe4bc11c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4ba59c700 1 -- 172.21.15.72:0/3289893450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e760 msgr2=0x7fe4bc11bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4ba59c700 1 --2- 172.21.15.72:0/3289893450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e760 0x7fe4bc11bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4ba59c700 1 -- 172.21.15.72:0/3289893450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b00094a0 con 0x7fe4bc09de50 2023-10-03T10:12:54.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4b9d9b700 1 --2- 172.21.15.72:0/3289893450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e760 0x7fe4bc11bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:54.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4ba59c700 1 --2- 172.21.15.72:0/3289893450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09de50 0x7fe4bc11b710 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00e840 tx=0x7fe4ac00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4aaffd700 1 -- 172.21.15.72:0/3289893450 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac013610 con 0x7fe4bc09de50 2023-10-03T10:12:54.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4aaffd700 1 -- 172.21.15.72:0/3289893450 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ac013770 con 0x7fe4bc09de50 2023-10-03T10:12:54.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4c0893700 1 -- 172.21.15.72:0/3289893450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4bc11ee20 con 0x7fe4bc09de50 2023-10-03T10:12:54.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4aaffd700 1 -- 172.21.15.72:0/3289893450 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac013b00 con 0x7fe4bc09de50 2023-10-03T10:12:54.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.689+0000 7fe4c0893700 1 -- 172.21.15.72:0/3289893450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4bc06f640 con 0x7fe4bc09de50 2023-10-03T10:12:54.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.691+0000 7fe4c0893700 1 -- 172.21.15.72:0/3289893450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4bc1babb0 con 0x7fe4bc09de50 2023-10-03T10:12:54.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.691+0000 7fe4aaffd700 1 -- 172.21.15.72:0/3289893450 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe4ac013c60 con 0x7fe4bc09de50 2023-10-03T10:12:54.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.691+0000 7fe4aaffd700 1 -- 172.21.15.72:0/3289893450 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fe4ac03fd20 con 0x7fe4bc09de50 2023-10-03T10:12:54.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.691+0000 7fe4b9d9b700 1 -- 172.21.15.72:0/3289893450 >> v1:172.21.15.72:6816/126756 conn(0x7fe49c02f510 legacy=0x7fe49c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:54.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.700+0000 7fe4aaffd700 1 -- 172.21.15.72:0/3289893450 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4ac026430 con 0x7fe4bc09de50 2023-10-03T10:12:54.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.706+0000 7f2dcbfe0700 1 Processor -- start 2023-10-03T10:12:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.706+0000 7f2dcbfe0700 1 -- start start 2023-10-03T10:12:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.707+0000 7f2dcbfe0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dc40a0a30 0x7f2dc40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.707+0000 7f2dcbfe0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2dc4138d80 0x7f2dc413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.707+0000 7f2dcbfe0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc40a2a70 con 0x7f2dc409d630 2023-10-03T10:12:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.707+0000 7f2dcbfe0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc40a01d0 con 0x7f2dc4138d80 2023-10-03T10:12:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.707+0000 7f2dcbfe0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc409e2b0 con 0x7f2dc40a0a30 2023-10-03T10:12:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.707+0000 7f2dc9d7c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dc40a0a30 0x7f2dc40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.707+0000 7f2dc9d7c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dc40a0a30 0x7f2dc40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59700/0 (socket says 172.21.15.72:59700) 2023-10-03T10:12:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.707+0000 7f2dc9d7c700 1 -- 172.21.15.72:0/1869519110 learned_addr learned my addr 172.21.15.72:0/1869519110 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.707+0000 7f2dca57d700 1 --2- 172.21.15.72:0/1869519110 >> v2:172.21.15.72:3300/0 conn(0x7f2dc4138d80 0x7f2dc413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.708+0000 7f2dc9d7c700 1 -- 172.21.15.72:0/1869519110 >> v2:172.21.15.72:3300/0 conn(0x7f2dc4138d80 msgr2=0x7f2dc413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:54.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.708+0000 7f2dc9d7c700 1 --2- 172.21.15.72:0/1869519110 >> v2:172.21.15.72:3300/0 conn(0x7f2dc4138d80 0x7f2dc413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.708+0000 7f2dc9d7c700 1 -- 172.21.15.72:0/1869519110 >> v1:172.21.15.72:6789/0 conn(0x7f2dc409d630 legacy=0x7f2dc40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.708+0000 7f2dc9d7c700 1 -- 172.21.15.72:0/1869519110 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc409dc50 con 0x7f2dc40a0a30 2023-10-03T10:12:54.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.708+0000 7f2dc9d7c700 1 --2- 172.21.15.72:0/1869519110 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dc40a0a30 0x7f2dc40a0e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00098f0 tx=0x7f2dc0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1091323516a9f4f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.708+0000 7f2dc8d7a700 1 -- 172.21.15.72:0/1869519110 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0011830 con 0x7f2dc40a0a30 2023-10-03T10:12:54.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.708+0000 7f2dc8d7a700 1 -- 172.21.15.72:0/1869519110 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc0011990 con 0x7f2dc40a0a30 2023-10-03T10:12:54.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.708+0000 7f2dc8d7a700 1 -- 172.21.15.72:0/1869519110 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0011d20 con 0x7f2dc40a0a30 2023-10-03T10:12:54.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.709+0000 7f2dcbfe0700 1 -- 172.21.15.72:0/1869519110 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dc40a0a30 msgr2=0x7f2dc40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.709+0000 7f2dcbfe0700 1 --2- 172.21.15.72:0/1869519110 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dc40a0a30 0x7f2dc40a0e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00098f0 tx=0x7f2dc0009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.709+0000 7f2dcbfe0700 1 -- 172.21.15.72:0/1869519110 shutdown_connections 2023-10-03T10:12:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.709+0000 7f2dcbfe0700 1 --2- 172.21.15.72:0/1869519110 >> v2:172.21.15.72:3300/0 conn(0x7f2dc4138d80 0x7f2dc413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.709+0000 7f2dcbfe0700 1 --2- 172.21.15.72:0/1869519110 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dc40a0a30 0x7f2dc40a0e00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.709+0000 7f2dcbfe0700 1 -- 172.21.15.72:0/1869519110 >> 172.21.15.72:0/1869519110 conn(0x7f2dc40a3050 msgr2=0x7f2dc40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.709+0000 7f2dcbfe0700 1 -- 172.21.15.72:0/1869519110 shutdown_connections 2023-10-03T10:12:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.709+0000 7f2dcbfe0700 1 -- 172.21.15.72:0/1869519110 wait complete. 2023-10-03T10:12:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.710+0000 7f2dcbfe0700 1 Processor -- start 2023-10-03T10:12:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.710+0000 7f2dcbfe0700 1 -- start start 2023-10-03T10:12:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.711+0000 7f2dcbfe0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dc409d630 0x7f2dc41208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.711+0000 7f2dcbfe0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc40a0a30 0x7f2dc4120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.711+0000 7f2dcbfe0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dc4138d80 0x7f2dc4121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.711+0000 7f2dcbfe0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc4123700 con 0x7f2dc40a0a30 2023-10-03T10:12:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.711+0000 7f2dcbfe0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40a0410 con 0x7f2dc4138d80 2023-10-03T10:12:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.711+0000 7f2dcbfe0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc41224b0 con 0x7f2dc409d630 2023-10-03T10:12:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.711+0000 7f2dc957b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc40a0a30 0x7f2dc4120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.711+0000 7f2dc957b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc40a0a30 0x7f2dc4120e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60596/0 (socket says 172.21.15.72:60596) 2023-10-03T10:12:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.711+0000 7f2dc957b700 1 -- 172.21.15.72:0/2468882982 learned_addr learned my addr 172.21.15.72:0/2468882982 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.711+0000 7f2dca57d700 1 --2- 172.21.15.72:0/2468882982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dc4138d80 0x7f2dc4121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.711+0000 7f2dc9d7c700 1 --2- 172.21.15.72:0/2468882982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dc409d630 0x7f2dc41208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.712+0000 7f2dc957b700 1 -- 172.21.15.72:0/2468882982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dc409d630 msgr2=0x7f2dc41208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.712+0000 7f2dc957b700 1 --2- 172.21.15.72:0/2468882982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dc409d630 0x7f2dc41208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.712+0000 7f2dc957b700 1 -- 172.21.15.72:0/2468882982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dc4138d80 msgr2=0x7f2dc4121370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.712+0000 7f2dc957b700 1 --2- 172.21.15.72:0/2468882982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dc4138d80 0x7f2dc4121370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.712+0000 7f2dc957b700 1 -- 172.21.15.72:0/2468882982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc0009550 con 0x7f2dc40a0a30 2023-10-03T10:12:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.712+0000 7f2dc957b700 1 --2- 172.21.15.72:0/2468882982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc40a0a30 0x7f2dc4120e30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c4e0 tx=0x7f2db400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.712+0000 7f2dba7fc700 1 -- 172.21.15.72:0/2468882982 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db40052d0 con 0x7f2dc40a0a30 2023-10-03T10:12:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.712+0000 7f2dba7fc700 1 -- 172.21.15.72:0/2468882982 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db4005430 con 0x7f2dc40a0a30 2023-10-03T10:12:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.712+0000 7f2dcbfe0700 1 -- 172.21.15.72:0/2468882982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc41240e0 con 0x7f2dc40a0a30 2023-10-03T10:12:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.712+0000 7f2dba7fc700 1 -- 172.21.15.72:0/2468882982 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db40038c0 con 0x7f2dc40a0a30 2023-10-03T10:12:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.712+0000 7f2dcbfe0700 1 -- 172.21.15.72:0/2468882982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc4124b50 con 0x7f2dc40a0a30 2023-10-03T10:12:54.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.714+0000 7f2dba7fc700 1 -- 172.21.15.72:0/2468882982 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2db4003a20 con 0x7f2dc40a0a30 2023-10-03T10:12:54.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.714+0000 7f2dcbfe0700 1 -- 172.21.15.72:0/2468882982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc40747f0 con 0x7f2dc40a0a30 2023-10-03T10:12:54.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.714+0000 7f2dba7fc700 1 -- 172.21.15.72:0/2468882982 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f2db403f070 con 0x7f2dc40a0a30 2023-10-03T10:12:54.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.714+0000 7f2dc9d7c700 1 -- 172.21.15.72:0/2468882982 >> v1:172.21.15.72:6816/126756 conn(0x7f2da802f510 legacy=0x7f2da80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:54.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.719+0000 7f2dba7fc700 1 -- 172.21.15.72:0/2468882982 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2db4017070 con 0x7f2dc40a0a30 2023-10-03T10:12:54.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.785+0000 7f59e1a17700 1 -- 172.21.15.72:0/1627003712 >> v1:172.21.15.72:6816/126756 conn(0x7f59c002f510 legacy=0x7f59c00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:54.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.829+0000 7fd9a7fff700 1 -- 172.21.15.72:0/2479588267 >> v1:172.21.15.72:6816/126756 conn(0x7fd99402f510 legacy=0x7fd9940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:54.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.830+0000 7f59e447c700 1 -- 172.21.15.72:0/1627003712 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f59dc06c360 con 0x7f59dc09d6f0 2023-10-03T10:12:54.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.830+0000 7f59d2ffd700 1 -- 172.21.15.72:0/1627003712 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f59d8046020 con 0x7f59dc09d6f0 2023-10-03T10:12:54.832 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:54.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.831+0000 7fd9ae82d700 1 -- 172.21.15.72:0/2479588267 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd9a806c360 con 0x7fd9a809e000 2023-10-03T10:12:54.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.831+0000 7fd9a4ff9700 1 -- 172.21.15.72:0/2479588267 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd99c026480 con 0x7fd9a809e000 2023-10-03T10:12:54.833 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:54.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.833+0000 7f59e447c700 1 -- 172.21.15.72:0/1627003712 >> v1:172.21.15.72:6816/126756 conn(0x7f59c002f510 legacy=0x7f59c00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:54.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.833+0000 7f59e447c700 1 -- 172.21.15.72:0/1627003712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09d6f0 msgr2=0x7f59dc122410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.833+0000 7f59e447c700 1 --2- 172.21.15.72:0/1627003712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09d6f0 0x7f59dc122410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f59d8000c00 tx=0x7f59d8004750 comp rx=0 tx=0).stop 2023-10-03T10:12:54.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.833+0000 7f59e447c700 1 -- 172.21.15.72:0/1627003712 shutdown_connections 2023-10-03T10:12:54.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.833+0000 7f59e447c700 1 --2- 172.21.15.72:0/1627003712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e410 0x7f59dc122e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.833+0000 7f59e447c700 1 --2- 172.21.15.72:0/1627003712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09d6f0 0x7f59dc122410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.833+0000 7f59e447c700 1 --2- 172.21.15.72:0/1627003712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc09e000 0x7f59dc122950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.833+0000 7f59e447c700 1 -- 172.21.15.72:0/1627003712 >> 172.21.15.72:0/1627003712 conn(0x7f59dc066f50 msgr2=0x7f59dc06f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.833+0000 7f59e447c700 1 -- 172.21.15.72:0/1627003712 shutdown_connections 2023-10-03T10:12:54.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.833+0000 7f59e447c700 1 -- 172.21.15.72:0/1627003712 wait complete. 2023-10-03T10:12:54.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.834+0000 7fd9ae82d700 1 -- 172.21.15.72:0/2479588267 >> v1:172.21.15.72:6816/126756 conn(0x7fd99402f510 legacy=0x7fd9940319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:54.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.834+0000 7fd9ae82d700 1 -- 172.21.15.72:0/2479588267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9a809e000 msgr2=0x7fd9a81a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.834+0000 7fd9ae82d700 1 --2- 172.21.15.72:0/2479588267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9a809e000 0x7fd9a81a6410 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd9a809e9b0 tx=0x7fd99c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:54.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.834+0000 7fd9ae82d700 1 -- 172.21.15.72:0/2479588267 shutdown_connections 2023-10-03T10:12:54.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.834+0000 7fd9ae82d700 1 --2- 172.21.15.72:0/2479588267 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9a809e410 0x7fd9a81a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.834+0000 7fd9ae82d700 1 --2- 172.21.15.72:0/2479588267 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9a809d6f0 0x7fd9a81a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.834+0000 7fd9ae82d700 1 --2- 172.21.15.72:0/2479588267 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9a809e000 0x7fd9a81a6410 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.834+0000 7fd9ae82d700 1 -- 172.21.15.72:0/2479588267 >> 172.21.15.72:0/2479588267 conn(0x7fd9a8066f50 msgr2=0x7fd9a81bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.835+0000 7fd9ae82d700 1 -- 172.21.15.72:0/2479588267 shutdown_connections 2023-10-03T10:12:54.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.835+0000 7fd9ae82d700 1 -- 172.21.15.72:0/2479588267 wait complete. 2023-10-03T10:12:54.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:54.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.892+0000 7fe4b9d9b700 1 -- 172.21.15.72:0/3289893450 >> v1:172.21.15.72:6816/126756 conn(0x7fe49c02f510 legacy=0x7fe49c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:54.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.915+0000 7f2dc9d7c700 1 -- 172.21.15.72:0/2468882982 >> v1:172.21.15.72:6816/126756 conn(0x7f2da802f510 legacy=0x7f2da80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:54.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.926+0000 7fe4c0893700 1 -- 172.21.15.72:0/3289893450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe4bc11d7d0 con 0x7fe4bc09de50 2023-10-03T10:12:54.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.926+0000 7fe4aaffd700 1 -- 172.21.15.72:0/3289893450 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe4ac021070 con 0x7fe4bc09de50 2023-10-03T10:12:54.927 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.928+0000 7fe4c0893700 1 -- 172.21.15.72:0/3289893450 >> v1:172.21.15.72:6816/126756 conn(0x7fe49c02f510 legacy=0x7fe49c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.928+0000 7fe4c0893700 1 -- 172.21.15.72:0/3289893450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09de50 msgr2=0x7fe4bc11b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.928+0000 7fe4c0893700 1 --2- 172.21.15.72:0/3289893450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09de50 0x7fe4bc11b710 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00e840 tx=0x7fe4ac00eb50 comp rx=0 tx=0).stop 2023-10-03T10:12:54.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.928+0000 7fe4c0893700 1 -- 172.21.15.72:0/3289893450 shutdown_connections 2023-10-03T10:12:54.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.928+0000 7fe4c0893700 1 --2- 172.21.15.72:0/3289893450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09de50 0x7fe4bc11b710 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.928+0000 7fe4c0893700 1 --2- 172.21.15.72:0/3289893450 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4bc1338a0 0x7fe4bc11c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.928+0000 7fe4c0893700 1 --2- 172.21.15.72:0/3289893450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e760 0x7fe4bc11bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.928+0000 7fe4c0893700 1 -- 172.21.15.72:0/3289893450 >> 172.21.15.72:0/3289893450 conn(0x7fe4bc0a2aa0 msgr2=0x7fe4bc130460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.929+0000 7fe4c0893700 1 -- 172.21.15.72:0/3289893450 shutdown_connections 2023-10-03T10:12:54.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.929+0000 7fe4c0893700 1 -- 172.21.15.72:0/3289893450 wait complete. 2023-10-03T10:12:54.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:54.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.944+0000 7f2dcbfe0700 1 -- 172.21.15.72:0/2468882982 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2dc4072980 con 0x7f2dc40a0a30 2023-10-03T10:12:54.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.944+0000 7f2dba7fc700 1 -- 172.21.15.72:0/2468882982 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2db4018260 con 0x7f2dc40a0a30 2023-10-03T10:12:54.945 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.947+0000 7f2dcbfe0700 1 -- 172.21.15.72:0/2468882982 >> v1:172.21.15.72:6816/126756 conn(0x7f2da802f510 legacy=0x7f2da80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.947+0000 7f2dcbfe0700 1 -- 172.21.15.72:0/2468882982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc40a0a30 msgr2=0x7f2dc4120e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.947+0000 7f2dcbfe0700 1 --2- 172.21.15.72:0/2468882982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc40a0a30 0x7f2dc4120e30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2db400c4e0 tx=0x7f2db400c7f0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.947+0000 7f2dcbfe0700 1 -- 172.21.15.72:0/2468882982 shutdown_connections 2023-10-03T10:12:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.947+0000 7f2dcbfe0700 1 --2- 172.21.15.72:0/2468882982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dc4138d80 0x7f2dc4121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.947+0000 7f2dcbfe0700 1 --2- 172.21.15.72:0/2468882982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dc409d630 0x7f2dc41208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.947+0000 7f2dcbfe0700 1 --2- 172.21.15.72:0/2468882982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dc40a0a30 0x7f2dc4120e30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.947+0000 7f2dcbfe0700 1 -- 172.21.15.72:0/2468882982 >> 172.21.15.72:0/2468882982 conn(0x7f2dc40a3050 msgr2=0x7f2dc409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.947+0000 7f2dcbfe0700 1 -- 172.21.15.72:0/2468882982 shutdown_connections 2023-10-03T10:12:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:54.947+0000 7f2dcbfe0700 1 -- 172.21.15.72:0/2468882982 wait complete. 2023-10-03T10:12:54.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:55.853 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:55.854 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:55.942 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:55.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:55.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.994+0000 7f5823643700 1 Processor -- start 2023-10-03T10:12:55.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.994+0000 7f5823643700 1 -- start start 2023-10-03T10:12:55.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.994+0000 7fe723de9700 1 Processor -- start 2023-10-03T10:12:55.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.994+0000 7f5823643700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09d6f0 0x7f581c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.994+0000 7f5823643700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c09e000 0x7f581c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.994+0000 7f5823643700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f581c09e410 0x7f581c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.994+0000 7f5823643700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f581c06b460 con 0x7f581c09e410 2023-10-03T10:12:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.994+0000 7f5823643700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581c09b120 con 0x7f581c09e000 2023-10-03T10:12:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.994+0000 7f5823643700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f581c09a7e0 con 0x7f581c09d6f0 2023-10-03T10:12:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7f5820bde700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c09e000 0x7f581c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7f5820bde700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c09e000 0x7f581c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45112/0 (socket says 172.21.15.72:45112) 2023-10-03T10:12:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7f5820bde700 1 -- 172.21.15.72:0/3562501168 learned_addr learned my addr 172.21.15.72:0/3562501168 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7f5820bde700 1 -- 172.21.15.72:0/3562501168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09d6f0 msgr2=0x7f581c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7f5820bde700 1 --2- 172.21.15.72:0/3562501168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09d6f0 0x7f581c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7f5820bde700 1 -- 172.21.15.72:0/3562501168 >> v2:172.21.15.72:3300/0 conn(0x7f581c09e410 msgr2=0x7f581c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7f5820bde700 1 --2- 172.21.15.72:0/3562501168 >> v2:172.21.15.72:3300/0 conn(0x7f581c09e410 0x7f581c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7f5820bde700 1 -- 172.21.15.72:0/3562501168 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c09a500 con 0x7f581c09e000 2023-10-03T10:12:55.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.994+0000 7fe723de9700 1 -- start start 2023-10-03T10:12:55.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7fe723de9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe71c06e570 0x7fe71c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7fe723de9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe71c06ee80 0x7fe71c134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:55.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7fe723de9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71c070ee0 con 0x7fe71c09eca0 2023-10-03T10:12:55.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7fe723de9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71c071480 con 0x7fe71c06ee80 2023-10-03T10:12:55.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7fe723de9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c071b90 con 0x7fe71c06e570 2023-10-03T10:12:55.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7fe721b85700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe71c06e570 0x7fe71c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7fe721b85700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe71c06e570 0x7fe71c06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45128/0 (socket says 172.21.15.72:45128) 2023-10-03T10:12:55.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7fe721b85700 1 -- 172.21.15.72:0/1230421138 learned_addr learned my addr 172.21.15.72:0/1230421138 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:55.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7f5820bde700 1 --2- 172.21.15.72:0/3562501168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c09e000 0x7f581c1339f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f580c009920 tx=0x7f580c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd92b8cda0fe4951 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7fe722386700 1 --2- 172.21.15.72:0/1230421138 >> v2:172.21.15.72:3300/0 conn(0x7fe71c06ee80 0x7fe71c134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:55.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7fe721b85700 1 -- 172.21.15.72:0/1230421138 >> v2:172.21.15.72:3300/0 conn(0x7fe71c06ee80 msgr2=0x7fe71c134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:55.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7fe721b85700 1 --2- 172.21.15.72:0/1230421138 >> v2:172.21.15.72:3300/0 conn(0x7fe71c06ee80 0x7fe71c134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:55.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7fe721b85700 1 -- 172.21.15.72:0/1230421138 >> v1:172.21.15.72:6789/0 conn(0x7fe71c09eca0 legacy=0x7fe71c134610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:12:55.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.995+0000 7fe721b85700 1 -- 172.21.15.72:0/1230421138 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c0711a0 con 0x7fe71c06e570 2023-10-03T10:12:55.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.996+0000 7fe721b85700 1 --2- 172.21.15.72:0/1230421138 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe71c06e570 0x7fe71c06e940 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe7180098f0 tx=0x7fe718009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61817e6d7321fec4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:55.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.996+0000 7f5813fff700 1 -- 172.21.15.72:0/3562501168 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c00ba20 con 0x7f581c09e000 2023-10-03T10:12:55.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.996+0000 7f5813fff700 1 -- 172.21.15.72:0/3562501168 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c00bb80 con 0x7f581c09e000 2023-10-03T10:12:56.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.996+0000 7f5813fff700 1 -- 172.21.15.72:0/3562501168 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c009e70 con 0x7f581c09e000 2023-10-03T10:12:56.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.996+0000 7fe720b83700 1 -- 172.21.15.72:0/1230421138 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718004230 con 0x7fe71c06e570 2023-10-03T10:12:56.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.996+0000 7fe720b83700 1 -- 172.21.15.72:0/1230421138 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe718004390 con 0x7fe71c06e570 2023-10-03T10:12:56.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.996+0000 7fe720b83700 1 -- 172.21.15.72:0/1230421138 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180036a0 con 0x7fe71c06e570 2023-10-03T10:12:56.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7f5823643700 1 -- 172.21.15.72:0/3562501168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c09e000 msgr2=0x7f581c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7f5823643700 1 --2- 172.21.15.72:0/3562501168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c09e000 0x7f581c1339f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f580c009920 tx=0x7f580c009c30 comp rx=0 tx=0).stop 2023-10-03T10:12:56.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7fe723de9700 1 -- 172.21.15.72:0/1230421138 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe71c06e570 msgr2=0x7fe71c06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7fe723de9700 1 --2- 172.21.15.72:0/1230421138 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe71c06e570 0x7fe71c06e940 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe7180098f0 tx=0x7fe718009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:56.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7fe723de9700 1 -- 172.21.15.72:0/1230421138 shutdown_connections 2023-10-03T10:12:56.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7fe723de9700 1 --2- 172.21.15.72:0/1230421138 >> v2:172.21.15.72:3300/0 conn(0x7fe71c06ee80 0x7fe71c134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7fe723de9700 1 --2- 172.21.15.72:0/1230421138 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe71c06e570 0x7fe71c06e940 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe7180098f0 tx=0x7fe718009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:56.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7fe723de9700 1 -- 172.21.15.72:0/1230421138 >> 172.21.15.72:0/1230421138 conn(0x7fe71c0a2aa0 msgr2=0x7fe71c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7f5823643700 1 -- 172.21.15.72:0/3562501168 shutdown_connections 2023-10-03T10:12:56.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7f5823643700 1 --2- 172.21.15.72:0/3562501168 >> v2:172.21.15.72:3300/0 conn(0x7f581c09e410 0x7f581c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7f5823643700 1 --2- 172.21.15.72:0/3562501168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09d6f0 0x7f581c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7f5823643700 1 --2- 172.21.15.72:0/3562501168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c09e000 0x7f581c1339f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7f5823643700 1 -- 172.21.15.72:0/3562501168 >> 172.21.15.72:0/3562501168 conn(0x7f581c066f50 msgr2=0x7f581c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7f5823643700 1 -- 172.21.15.72:0/3562501168 shutdown_connections 2023-10-03T10:12:56.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7f5823643700 1 -- 172.21.15.72:0/3562501168 wait complete. 2023-10-03T10:12:56.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7fe723de9700 1 -- 172.21.15.72:0/1230421138 shutdown_connections 2023-10-03T10:12:56.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.997+0000 7fe723de9700 1 -- 172.21.15.72:0/1230421138 wait complete. 2023-10-03T10:12:56.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.998+0000 7fe723de9700 1 Processor -- start 2023-10-03T10:12:56.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.998+0000 7fe723de9700 1 -- start start 2023-10-03T10:12:56.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.998+0000 7f5823643700 1 Processor -- start 2023-10-03T10:12:56.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.998+0000 7f5823643700 1 -- start start 2023-10-03T10:12:56.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7f5823643700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c09d6f0 0x7f581c1a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7f5823643700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09e000 0x7f581c1a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7f5823643700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f581c09e410 0x7f581c1a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7f5823643700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c09c710 con 0x7f581c09e410 2023-10-03T10:12:56.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7f5823643700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f581c1a81a0 con 0x7f581c09d6f0 2023-10-03T10:12:56.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7f5823643700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f581c1a7b50 con 0x7f581c09e000 2023-10-03T10:12:56.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7f5820bde700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09e000 0x7f581c1a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7f58213df700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c09d6f0 0x7f581c1a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7f5820bde700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09e000 0x7f581c1a6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59742/0 (socket says 172.21.15.72:59742) 2023-10-03T10:12:56.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7f58213df700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c09d6f0 0x7f581c1a5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45150/0 (socket says 172.21.15.72:45150) 2023-10-03T10:12:56.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7f5820bde700 1 -- 172.21.15.72:0/2050169216 learned_addr learned my addr 172.21.15.72:0/2050169216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:56.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7f5821be0700 1 --2- 172.21.15.72:0/2050169216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f581c09e410 0x7f581c1a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe723de9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe71c06ee80 0x7fe71c13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7f5821be0700 1 -- 172.21.15.72:0/2050169216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09e000 msgr2=0x7f581c1a6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7f5821be0700 1 --2- 172.21.15.72:0/2050169216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09e000 0x7f581c1a6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7f5821be0700 1 -- 172.21.15.72:0/2050169216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c09d6f0 msgr2=0x7f581c1a5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7f5821be0700 1 --2- 172.21.15.72:0/2050169216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c09d6f0 0x7f581c1a5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7f5821be0700 1 -- 172.21.15.72:0/2050169216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c009550 con 0x7f581c09e410 2023-10-03T10:12:56.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe723de9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe71c13f1c0 0x7fe71c13b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe723de9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe71c13bc20 0x7fe71c133e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe723de9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c070610 con 0x7fe71c13bc20 2023-10-03T10:12:56.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe723de9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c13ecc0 con 0x7fe71c13f1c0 2023-10-03T10:12:56.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe723de9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c13c600 con 0x7fe71c06ee80 2023-10-03T10:12:56.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe721384700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe71c13f1c0 0x7fe71c13b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe721384700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe71c13f1c0 0x7fe71c13b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45134/0 (socket says 172.21.15.72:45134) 2023-10-03T10:12:56.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe721384700 1 -- 172.21.15.72:0/4038208809 learned_addr learned my addr 172.21.15.72:0/4038208809 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:56.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe722386700 1 --2- 172.21.15.72:0/4038208809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe71c13bc20 0x7fe71c133e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe721b85700 1 --2- 172.21.15.72:0/4038208809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe71c06ee80 0x7fe71c13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe722386700 1 -- 172.21.15.72:0/4038208809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe71c06ee80 msgr2=0x7fe71c13b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe722386700 1 --2- 172.21.15.72:0/4038208809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe71c06ee80 0x7fe71c13b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe722386700 1 -- 172.21.15.72:0/4038208809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe71c13f1c0 msgr2=0x7fe71c13b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe722386700 1 --2- 172.21.15.72:0/4038208809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe71c13f1c0 0x7fe71c13b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:55.999+0000 7fe722386700 1 -- 172.21.15.72:0/4038208809 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe718009550 con 0x7fe71c13bc20 2023-10-03T10:12:56.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7f5821be0700 1 --2- 172.21.15.72:0/2050169216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f581c09e410 0x7f581c1a69c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f581400be20 tx=0x7f581400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7fe722386700 1 --2- 172.21.15.72:0/4038208809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe71c13bc20 0x7fe71c133e80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe714007dc0 tx=0x7fe71400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7f5811ffb700 1 -- 172.21.15.72:0/2050169216 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581400cc90 con 0x7f581c09e410 2023-10-03T10:12:56.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7f5811ffb700 1 -- 172.21.15.72:0/2050169216 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581400cdf0 con 0x7f581c09e410 2023-10-03T10:12:56.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7f5811ffb700 1 -- 172.21.15.72:0/2050169216 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5814014680 con 0x7f581c09e410 2023-10-03T10:12:56.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7f5823643700 1 -- 172.21.15.72:0/2050169216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581c0a3140 con 0x7f581c09e410 2023-10-03T10:12:56.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7f5823643700 1 -- 172.21.15.72:0/2050169216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581c1a9780 con 0x7f581c09e410 2023-10-03T10:12:56.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7fe7127fc700 1 -- 172.21.15.72:0/4038208809 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe714018070 con 0x7fe71c13bc20 2023-10-03T10:12:56.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7fe7127fc700 1 -- 172.21.15.72:0/4038208809 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71400ebe0 con 0x7fe71c13bc20 2023-10-03T10:12:56.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7fe723de9700 1 -- 172.21.15.72:0/4038208809 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71c135af0 con 0x7fe71c13bc20 2023-10-03T10:12:56.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7fe723de9700 1 -- 172.21.15.72:0/4038208809 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71c13e450 con 0x7fe71c13bc20 2023-10-03T10:12:56.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.000+0000 7fe7127fc700 1 -- 172.21.15.72:0/4038208809 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe714003a20 con 0x7fe71c13bc20 2023-10-03T10:12:56.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.001+0000 7fe7127fc700 1 -- 172.21.15.72:0/4038208809 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe714003b80 con 0x7fe71c13bc20 2023-10-03T10:12:56.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.002+0000 7f5823643700 1 -- 172.21.15.72:0/2050169216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581c1a9330 con 0x7f581c09e410 2023-10-03T10:12:56.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.001+0000 7fe723de9700 1 -- 172.21.15.72:0/4038208809 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7040052e0 con 0x7fe71c13bc20 2023-10-03T10:12:56.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.002+0000 7fe7127fc700 1 -- 172.21.15.72:0/4038208809 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fe71403fcb0 con 0x7fe71c13bc20 2023-10-03T10:12:56.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.002+0000 7fe721b85700 1 -- 172.21.15.72:0/4038208809 >> v1:172.21.15.72:6816/126756 conn(0x7fe70002f510 legacy=0x7fe7000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:56.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.006+0000 7f5811ffb700 1 -- 172.21.15.72:0/2050169216 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f581401d3b0 con 0x7f581c09e410 2023-10-03T10:12:56.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.006+0000 7f5811ffb700 1 -- 172.21.15.72:0/2050169216 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f5814006e40 con 0x7f581c09e410 2023-10-03T10:12:56.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.006+0000 7f58213df700 1 -- 172.21.15.72:0/2050169216 >> v1:172.21.15.72:6816/126756 conn(0x7f580002f510 legacy=0x7f58000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:56.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.010+0000 7fe7127fc700 1 -- 172.21.15.72:0/4038208809 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe714003e30 con 0x7fe71c13bc20 2023-10-03T10:12:56.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.019+0000 7f5811ffb700 1 -- 172.21.15.72:0/2050169216 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f581401c360 con 0x7f581c09e410 2023-10-03T10:12:56.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.079+0000 7f3f8d1e7700 1 Processor -- start 2023-10-03T10:12:56.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.079+0000 7f3f8d1e7700 1 -- start start 2023-10-03T10:12:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.080+0000 7f3f8d1e7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f8809f330 0x7f3f88138e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.080+0000 7f3f8d1e7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f88139370 0x7f3f8813b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.080+0000 7f3f8d1e7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8806bec0 con 0x7f3f8809e850 2023-10-03T10:12:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.080+0000 7f3f8d1e7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8806bce0 con 0x7f3f88139370 2023-10-03T10:12:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.080+0000 7f3f8d1e7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8806caa0 con 0x7f3f8809f330 2023-10-03T10:12:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.080+0000 7f3f8659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f8809f330 0x7f3f88138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.080+0000 7f3f8759e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f88139370 0x7f3f8813b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.080+0000 7f3f8659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f8809f330 0x7f3f88138e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59758/0 (socket says 172.21.15.72:59758) 2023-10-03T10:12:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.080+0000 7f3f8659c700 1 -- 172.21.15.72:0/44880649 learned_addr learned my addr 172.21.15.72:0/44880649 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.080+0000 7f3f8659c700 1 -- 172.21.15.72:0/44880649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f88139370 msgr2=0x7f3f8813b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.080+0000 7f3f8659c700 1 --2- 172.21.15.72:0/44880649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f88139370 0x7f3f8813b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.080+0000 7f3f8659c700 1 -- 172.21.15.72:0/44880649 >> v1:172.21.15.72:6789/0 conn(0x7f3f8809e850 legacy=0x7f3f8809ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.080+0000 7f3f8659c700 1 -- 172.21.15.72:0/44880649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f880a00a0 con 0x7f3f8809f330 2023-10-03T10:12:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.081+0000 7f3f8659c700 1 --2- 172.21.15.72:0/44880649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f8809f330 0x7f3f88138e30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009950 tx=0x7f3f7c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efb45ecb96a95156 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.081+0000 7f3f85d9b700 1 -- 172.21.15.72:0/44880649 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c004230 con 0x7f3f8809f330 2023-10-03T10:12:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.081+0000 7f3f85d9b700 1 -- 172.21.15.72:0/44880649 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c004390 con 0x7f3f8809f330 2023-10-03T10:12:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.081+0000 7f3f85d9b700 1 -- 172.21.15.72:0/44880649 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c0036a0 con 0x7f3f8809f330 2023-10-03T10:12:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.081+0000 7f3f8d1e7700 1 -- 172.21.15.72:0/44880649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f8809f330 msgr2=0x7f3f88138e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.081+0000 7f3f8d1e7700 1 --2- 172.21.15.72:0/44880649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f8809f330 0x7f3f88138e30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c009950 tx=0x7f3f7c009c60 comp rx=0 tx=0).stop 2023-10-03T10:12:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.081+0000 7f3f8d1e7700 1 -- 172.21.15.72:0/44880649 shutdown_connections 2023-10-03T10:12:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.081+0000 7f3f8d1e7700 1 --2- 172.21.15.72:0/44880649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f88139370 0x7f3f8813b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.081+0000 7f3f8d1e7700 1 --2- 172.21.15.72:0/44880649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f8809f330 0x7f3f88138e30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.081+0000 7f3f8d1e7700 1 -- 172.21.15.72:0/44880649 >> 172.21.15.72:0/44880649 conn(0x7f3f880a3f70 msgr2=0x7f3f880a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.082+0000 7f3f8d1e7700 1 -- 172.21.15.72:0/44880649 shutdown_connections 2023-10-03T10:12:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.082+0000 7f3f8d1e7700 1 -- 172.21.15.72:0/44880649 wait complete. 2023-10-03T10:12:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.083+0000 7f3f8d1e7700 1 Processor -- start 2023-10-03T10:12:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.083+0000 7f3f8d1e7700 1 -- start start 2023-10-03T10:12:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.083+0000 7f3f8d1e7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f8809e850 0x7f3f881c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.083+0000 7f3f8d1e7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f8809f330 0x7f3f881c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.083+0000 7f3f8d1e7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f88139370 0x7f3f8811eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.083+0000 7f3f8d1e7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8806ccc0 con 0x7f3f8809f330 2023-10-03T10:12:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.083+0000 7f3f8d1e7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f88122790 con 0x7f3f8809e850 2023-10-03T10:12:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.083+0000 7f3f8d1e7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f881be4f0 con 0x7f3f88139370 2023-10-03T10:12:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.083+0000 7f3f8759e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f88139370 0x7f3f8811eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.083+0000 7f3f8759e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f88139370 0x7f3f8811eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59766/0 (socket says 172.21.15.72:59766) 2023-10-03T10:12:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.083+0000 7f3f8759e700 1 -- 172.21.15.72:0/3633357594 learned_addr learned my addr 172.21.15.72:0/3633357594 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.084+0000 7f3f8659c700 1 --2- 172.21.15.72:0/3633357594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f8809f330 0x7f3f881c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.084+0000 7f3f8759e700 1 -- 172.21.15.72:0/3633357594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f8809e850 msgr2=0x7f3f881c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.084+0000 7f3f86d9d700 1 --2- 172.21.15.72:0/3633357594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f8809e850 0x7f3f881c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.084+0000 7f3f8759e700 1 --2- 172.21.15.72:0/3633357594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f8809e850 0x7f3f881c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.084+0000 7f3f8759e700 1 -- 172.21.15.72:0/3633357594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f8809f330 msgr2=0x7f3f881c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.084+0000 7f3f8759e700 1 --2- 172.21.15.72:0/3633357594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f8809f330 0x7f3f881c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.084+0000 7f3f8759e700 1 -- 172.21.15.72:0/3633357594 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c009550 con 0x7f3f88139370 2023-10-03T10:12:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.084+0000 7f3f8659c700 1 --2- 172.21.15.72:0/3633357594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f8809f330 0x7f3f881c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.084+0000 7f3f86d9d700 1 --2- 172.21.15.72:0/3633357594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f8809e850 0x7f3f881c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:12:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.084+0000 7f3f8759e700 1 --2- 172.21.15.72:0/3633357594 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f88139370 0x7f3f8811eb10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000efc0 tx=0x7f3f8000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.084+0000 7f3f6f7fe700 1 -- 172.21.15.72:0/3633357594 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f80009ca0 con 0x7f3f88139370 2023-10-03T10:12:56.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.084+0000 7f3f6f7fe700 1 -- 172.21.15.72:0/3633357594 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8000f040 con 0x7f3f88139370 2023-10-03T10:12:56.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.084+0000 7f3f8d1e7700 1 -- 172.21.15.72:0/3633357594 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f88134900 con 0x7f3f88139370 2023-10-03T10:12:56.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.084+0000 7f3f6f7fe700 1 -- 172.21.15.72:0/3633357594 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f80014480 con 0x7f3f88139370 2023-10-03T10:12:56.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.084+0000 7f3f8d1e7700 1 -- 172.21.15.72:0/3633357594 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f88122270 con 0x7f3f88139370 2023-10-03T10:12:56.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.085+0000 7f3f6f7fe700 1 -- 172.21.15.72:0/3633357594 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3f800145e0 con 0x7f3f88139370 2023-10-03T10:12:56.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.085+0000 7f3f8d1e7700 1 -- 172.21.15.72:0/3633357594 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f880747f0 con 0x7f3f88139370 2023-10-03T10:12:56.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.085+0000 7f3f6f7fe700 1 -- 172.21.15.72:0/3633357594 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f3f800409f0 con 0x7f3f88139370 2023-10-03T10:12:56.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.085+0000 7f3f86d9d700 1 -- 172.21.15.72:0/3633357594 >> v1:172.21.15.72:6816/126756 conn(0x7f3f7402f510 legacy=0x7f3f740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:56.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.094+0000 7f3f6f7fe700 1 -- 172.21.15.72:0/3633357594 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f80007920 con 0x7f3f88139370 2023-10-03T10:12:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.116+0000 7f98ace0e700 1 Processor -- start 2023-10-03T10:12:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.117+0000 7f98ace0e700 1 -- start start 2023-10-03T10:12:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.117+0000 7f98ace0e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a8131810 0x7f98a8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.117+0000 7f98ace0e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a8099a40 0x7f98a8099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.117+0000 7f98ace0e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98a809a3b0 0x7f98a8138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.117+0000 7f98ace0e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a809b580 con 0x7f98a809a3b0 2023-10-03T10:12:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.117+0000 7f98ace0e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a81313c0 con 0x7f98a8099a40 2023-10-03T10:12:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.117+0000 7f98ace0e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98a806e8c0 con 0x7f98a8131810 2023-10-03T10:12:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.117+0000 7f98a5d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a8099a40 0x7f98a8099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.117+0000 7f98a6d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98a809a3b0 0x7f98a8138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.117+0000 7f98a5d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a8099a40 0x7f98a8099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45178/0 (socket says 172.21.15.72:45178) 2023-10-03T10:12:56.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.117+0000 7f98a5d9b700 1 -- 172.21.15.72:0/543887990 learned_addr learned my addr 172.21.15.72:0/543887990 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:56.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.118+0000 7f98a659c700 1 --2- 172.21.15.72:0/543887990 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a8131810 0x7f98a8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.118+0000 7f98a6d9d700 1 -- 172.21.15.72:0/543887990 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a8131810 msgr2=0x7f98a8131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:56.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.118+0000 7f98a6d9d700 1 --2- 172.21.15.72:0/543887990 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a8131810 0x7f98a8131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.118+0000 7f98a6d9d700 1 -- 172.21.15.72:0/543887990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a8099a40 msgr2=0x7f98a8099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:56.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.118+0000 7f98a6d9d700 1 --2- 172.21.15.72:0/543887990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a8099a40 0x7f98a8099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.118+0000 7f98a6d9d700 1 -- 172.21.15.72:0/543887990 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a809a820 con 0x7f98a809a3b0 2023-10-03T10:12:56.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.118+0000 7f98a6d9d700 1 --2- 172.21.15.72:0/543887990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a809a3b0 0x7f98a8138650 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009d90 tx=0x7f98a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e257221a03c2d78 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.118+0000 7f98a559a700 1 -- 172.21.15.72:0/543887990 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a000e070 con 0x7f98a809a3b0 2023-10-03T10:12:56.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.118+0000 7f98a559a700 1 -- 172.21.15.72:0/543887990 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a000bb20 con 0x7f98a809a3b0 2023-10-03T10:12:56.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.118+0000 7f98a559a700 1 -- 172.21.15.72:0/543887990 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a0012430 con 0x7f98a809a3b0 2023-10-03T10:12:56.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.119+0000 7f98ace0e700 1 -- 172.21.15.72:0/543887990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a809a3b0 msgr2=0x7f98a8138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.119+0000 7f98ace0e700 1 --2- 172.21.15.72:0/543887990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a809a3b0 0x7f98a8138650 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009d90 tx=0x7f98a000b330 comp rx=0 tx=0).stop 2023-10-03T10:12:56.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.119+0000 7f98ace0e700 1 -- 172.21.15.72:0/543887990 shutdown_connections 2023-10-03T10:12:56.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.119+0000 7f98ace0e700 1 --2- 172.21.15.72:0/543887990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a809a3b0 0x7f98a8138650 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.119+0000 7f98ace0e700 1 --2- 172.21.15.72:0/543887990 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a8131810 0x7f98a8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.119+0000 7f98ace0e700 1 --2- 172.21.15.72:0/543887990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a8099a40 0x7f98a8099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.119+0000 7f98ace0e700 1 -- 172.21.15.72:0/543887990 >> 172.21.15.72:0/543887990 conn(0x7f98a80a2aa0 msgr2=0x7f98a80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.119+0000 7f98ace0e700 1 -- 172.21.15.72:0/543887990 shutdown_connections 2023-10-03T10:12:56.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.119+0000 7f98ace0e700 1 -- 172.21.15.72:0/543887990 wait complete. 2023-10-03T10:12:56.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.120+0000 7f98ace0e700 1 Processor -- start 2023-10-03T10:12:56.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.120+0000 7f98ace0e700 1 -- start start 2023-10-03T10:12:56.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.120+0000 7f98ace0e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a8099a40 0x7f98a812bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.120+0000 7f98ace0e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a809a3b0 0x7f98a812c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.120+0000 7f98ace0e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a8131810 0x7f98a81c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:56.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.120+0000 7f98ace0e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a812d790 con 0x7f98a8099a40 2023-10-03T10:12:56.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.120+0000 7f98ace0e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a812ebb0 con 0x7f98a809a3b0 2023-10-03T10:12:56.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.120+0000 7f98ace0e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98a812df30 con 0x7f98a8131810 2023-10-03T10:12:56.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f98a5d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a809a3b0 0x7f98a812c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f98a659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a8099a40 0x7f98a812bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f98a5d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a809a3b0 0x7f98a812c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45180/0 (socket says 172.21.15.72:45180) 2023-10-03T10:12:56.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f98a659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a8099a40 0x7f98a812bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60642/0 (socket says 172.21.15.72:60642) 2023-10-03T10:12:56.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f98a5d9b700 1 -- 172.21.15.72:0/1497556524 learned_addr learned my addr 172.21.15.72:0/1497556524 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:56.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f98a6d9d700 1 --2- 172.21.15.72:0/1497556524 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a8131810 0x7f98a81c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:56.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f98a659c700 1 -- 172.21.15.72:0/1497556524 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a8131810 msgr2=0x7f98a81c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f98a659c700 1 --2- 172.21.15.72:0/1497556524 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a8131810 0x7f98a81c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f98a659c700 1 -- 172.21.15.72:0/1497556524 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a809a3b0 msgr2=0x7f98a812c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f98a659c700 1 --2- 172.21.15.72:0/1497556524 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a809a3b0 0x7f98a812c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f98a659c700 1 -- 172.21.15.72:0/1497556524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a0009a70 con 0x7f98a8099a40 2023-10-03T10:12:56.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f98a659c700 1 --2- 172.21.15.72:0/1497556524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a8099a40 0x7f98a812bba0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f989800e7e0 tx=0x7f989800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:56.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f9896ffd700 1 -- 172.21.15.72:0/1497556524 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989800c070 con 0x7f98a8099a40 2023-10-03T10:12:56.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f9896ffd700 1 -- 172.21.15.72:0/1497556524 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9898013610 con 0x7f98a8099a40 2023-10-03T10:12:56.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f98ace0e700 1 -- 172.21.15.72:0/1497556524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a80717e0 con 0x7f98a8099a40 2023-10-03T10:12:56.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f9896ffd700 1 -- 172.21.15.72:0/1497556524 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98980139a0 con 0x7f98a8099a40 2023-10-03T10:12:56.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.121+0000 7f98ace0e700 1 -- 172.21.15.72:0/1497556524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a812e4b0 con 0x7f98a8099a40 2023-10-03T10:12:56.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.122+0000 7f9896ffd700 1 -- 172.21.15.72:0/1497556524 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9898013b00 con 0x7f98a8099a40 2023-10-03T10:12:56.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.122+0000 7f98ace0e700 1 -- 172.21.15.72:0/1497556524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a8074ea0 con 0x7f98a8099a40 2023-10-03T10:12:56.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.123+0000 7f98a5d9b700 1 -- 172.21.15.72:0/1497556524 >> v1:172.21.15.72:6816/126756 conn(0x7f988802f510 legacy=0x7f98880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:56.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.123+0000 7f9896ffd700 1 -- 172.21.15.72:0/1497556524 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f9898042220 con 0x7f98a8099a40 2023-10-03T10:12:56.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.131+0000 7f9896ffd700 1 -- 172.21.15.72:0/1497556524 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f989801c400 con 0x7f98a8099a40 2023-10-03T10:12:56.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.203+0000 7fe721b85700 1 -- 172.21.15.72:0/4038208809 >> v1:172.21.15.72:6816/126756 conn(0x7fe70002f510 legacy=0x7fe7000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.207+0000 7f58213df700 1 -- 172.21.15.72:0/2050169216 >> v1:172.21.15.72:6816/126756 conn(0x7f580002f510 legacy=0x7f58000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.212+0000 7fe723de9700 1 -- 172.21.15.72:0/4038208809 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe704005860 con 0x7fe71c13bc20 2023-10-03T10:12:56.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.212+0000 7fe7127fc700 1 -- 172.21.15.72:0/4038208809 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe714013380 con 0x7fe71c13bc20 2023-10-03T10:12:56.213 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:56.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.214+0000 7fe723de9700 1 -- 172.21.15.72:0/4038208809 >> v1:172.21.15.72:6816/126756 conn(0x7fe70002f510 legacy=0x7fe7000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:56.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.214+0000 7fe723de9700 1 -- 172.21.15.72:0/4038208809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe71c13bc20 msgr2=0x7fe71c133e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.214+0000 7fe723de9700 1 --2- 172.21.15.72:0/4038208809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe71c13bc20 0x7fe71c133e80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe714007dc0 tx=0x7fe71400e3c0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.214+0000 7fe723de9700 1 -- 172.21.15.72:0/4038208809 shutdown_connections 2023-10-03T10:12:56.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.214+0000 7fe723de9700 1 --2- 172.21.15.72:0/4038208809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe71c13bc20 0x7fe71c133e80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.214+0000 7fe723de9700 1 --2- 172.21.15.72:0/4038208809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe71c06ee80 0x7fe71c13b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.214+0000 7fe723de9700 1 --2- 172.21.15.72:0/4038208809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe71c13f1c0 0x7fe71c13b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.214+0000 7fe723de9700 1 -- 172.21.15.72:0/4038208809 >> 172.21.15.72:0/4038208809 conn(0x7fe71c0a2aa0 msgr2=0x7fe71c09e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.214+0000 7fe723de9700 1 -- 172.21.15.72:0/4038208809 shutdown_connections 2023-10-03T10:12:56.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.214+0000 7fe723de9700 1 -- 172.21.15.72:0/4038208809 wait complete. 2023-10-03T10:12:56.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.224+0000 7f5823643700 1 -- 172.21.15.72:0/2050169216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f581c074ea0 con 0x7f581c09e410 2023-10-03T10:12:56.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.224+0000 7f5811ffb700 1 -- 172.21.15.72:0/2050169216 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5814019070 con 0x7f581c09e410 2023-10-03T10:12:56.225 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:56.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:56.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.227+0000 7f5823643700 1 -- 172.21.15.72:0/2050169216 >> v1:172.21.15.72:6816/126756 conn(0x7f580002f510 legacy=0x7f58000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:56.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.227+0000 7f5823643700 1 -- 172.21.15.72:0/2050169216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f581c09e410 msgr2=0x7f581c1a69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.227+0000 7f5823643700 1 --2- 172.21.15.72:0/2050169216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f581c09e410 0x7f581c1a69c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f581400be20 tx=0x7f581400bf00 comp rx=0 tx=0).stop 2023-10-03T10:12:56.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.227+0000 7f5823643700 1 -- 172.21.15.72:0/2050169216 shutdown_connections 2023-10-03T10:12:56.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.227+0000 7f5823643700 1 --2- 172.21.15.72:0/2050169216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f581c09e410 0x7f581c1a69c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.227+0000 7f5823643700 1 --2- 172.21.15.72:0/2050169216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f581c09d6f0 0x7f581c1a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.227+0000 7f5823643700 1 --2- 172.21.15.72:0/2050169216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f581c09e000 0x7f581c1a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.227+0000 7f5823643700 1 -- 172.21.15.72:0/2050169216 >> 172.21.15.72:0/2050169216 conn(0x7f581c066f50 msgr2=0x7f581c1bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.227+0000 7f5823643700 1 -- 172.21.15.72:0/2050169216 shutdown_connections 2023-10-03T10:12:56.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.227+0000 7f5823643700 1 -- 172.21.15.72:0/2050169216 wait complete. 2023-10-03T10:12:56.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:56.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.286+0000 7f3f86d9d700 1 -- 172.21.15.72:0/3633357594 >> v1:172.21.15.72:6816/126756 conn(0x7f3f7402f510 legacy=0x7f3f740319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:56.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.296+0000 7f3f8d1e7700 1 -- 172.21.15.72:0/3633357594 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3f88072820 con 0x7f3f88139370 2023-10-03T10:12:56.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.297+0000 7f3f6f7fe700 1 -- 172.21.15.72:0/3633357594 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3f80007330 con 0x7f3f88139370 2023-10-03T10:12:56.297 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:56.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.298+0000 7f3f8d1e7700 1 -- 172.21.15.72:0/3633357594 >> v1:172.21.15.72:6816/126756 conn(0x7f3f7402f510 legacy=0x7f3f740319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:56.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.298+0000 7f3f8d1e7700 1 -- 172.21.15.72:0/3633357594 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f88139370 msgr2=0x7f3f8811eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.298+0000 7f3f8d1e7700 1 --2- 172.21.15.72:0/3633357594 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f88139370 0x7f3f8811eb10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000efc0 tx=0x7f3f8000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.299+0000 7f3f8d1e7700 1 -- 172.21.15.72:0/3633357594 shutdown_connections 2023-10-03T10:12:56.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.299+0000 7f3f8d1e7700 1 --2- 172.21.15.72:0/3633357594 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f88139370 0x7f3f8811eb10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.299+0000 7f3f8d1e7700 1 --2- 172.21.15.72:0/3633357594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f8809e850 0x7f3f881c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.299+0000 7f3f8d1e7700 1 --2- 172.21.15.72:0/3633357594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f8809f330 0x7f3f881c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.299+0000 7f3f8d1e7700 1 -- 172.21.15.72:0/3633357594 >> 172.21.15.72:0/3633357594 conn(0x7f3f880a3f70 msgr2=0x7f3f880a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.299+0000 7f3f8d1e7700 1 -- 172.21.15.72:0/3633357594 shutdown_connections 2023-10-03T10:12:56.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.299+0000 7f3f8d1e7700 1 -- 172.21.15.72:0/3633357594 wait complete. 2023-10-03T10:12:56.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:56.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.324+0000 7f98a5d9b700 1 -- 172.21.15.72:0/1497556524 >> v1:172.21.15.72:6816/126756 conn(0x7f988802f510 legacy=0x7f98880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:56.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.326+0000 7f98ace0e700 1 -- 172.21.15.72:0/1497556524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f98a8071d80 con 0x7f98a8099a40 2023-10-03T10:12:56.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.326+0000 7f9896ffd700 1 -- 172.21.15.72:0/1497556524 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98980112f0 con 0x7f98a8099a40 2023-10-03T10:12:56.327 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:56.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.328+0000 7f98ace0e700 1 -- 172.21.15.72:0/1497556524 >> v1:172.21.15.72:6816/126756 conn(0x7f988802f510 legacy=0x7f98880319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:56.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.328+0000 7f98ace0e700 1 -- 172.21.15.72:0/1497556524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a8099a40 msgr2=0x7f98a812bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:56.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.328+0000 7f98ace0e700 1 --2- 172.21.15.72:0/1497556524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a8099a40 0x7f98a812bba0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f989800e7e0 tx=0x7f989800eaf0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.328+0000 7f98ace0e700 1 -- 172.21.15.72:0/1497556524 shutdown_connections 2023-10-03T10:12:56.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.328+0000 7f98ace0e700 1 --2- 172.21.15.72:0/1497556524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a8099a40 0x7f98a812bba0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.328+0000 7f98ace0e700 1 --2- 172.21.15.72:0/1497556524 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a8131810 0x7f98a81c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.328+0000 7f98ace0e700 1 --2- 172.21.15.72:0/1497556524 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a809a3b0 0x7f98a812c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:56.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.328+0000 7f98ace0e700 1 -- 172.21.15.72:0/1497556524 >> 172.21.15.72:0/1497556524 conn(0x7f98a80a2aa0 msgr2=0x7f98a812f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:56.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.328+0000 7f98ace0e700 1 -- 172.21.15.72:0/1497556524 shutdown_connections 2023-10-03T10:12:56.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:56.328+0000 7f98ace0e700 1 -- 172.21.15.72:0/1497556524 wait complete. 2023-10-03T10:12:56.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:57.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:57.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:57.312 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:57.341 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.371+0000 7ff280c7e700 1 Processor -- start 2023-10-03T10:12:57.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.371+0000 7ff280c7e700 1 -- start start 2023-10-03T10:12:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.372+0000 7ff280c7e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c133540 0x7ff27c135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.372+0000 7ff280c7e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff27c135e60 0x7ff27c138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.372+0000 7ff280c7e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27c0716a0 con 0x7ff27c130540 2023-10-03T10:12:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.372+0000 7ff280c7e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27c071290 con 0x7ff27c135e60 2023-10-03T10:12:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.372+0000 7ff280c7e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c130340 con 0x7ff27c133540 2023-10-03T10:12:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.372+0000 7ff27a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff27c130540 0x7ff27c130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59862/0 (socket says 172.21.15.72:59862) 2023-10-03T10:12:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.372+0000 7ff27a59c700 1 -- 172.21.15.72:0/931457386 learned_addr learned my addr 172.21.15.72:0/931457386 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:12:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.372+0000 7ff27ad9d700 1 --2- 172.21.15.72:0/931457386 >> v2:172.21.15.72:3300/0 conn(0x7ff27c135e60 0x7ff27c138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.372+0000 7ff279d9b700 1 --2- 172.21.15.72:0/931457386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c133540 0x7ff27c135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.372+0000 7ff27ad9d700 1 -- 172.21.15.72:0/931457386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c133540 msgr2=0x7ff27c135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.372+0000 7ff27ad9d700 1 --2- 172.21.15.72:0/931457386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c133540 0x7ff27c135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.372+0000 7ff27ad9d700 1 -- 172.21.15.72:0/931457386 >> v1:172.21.15.72:6789/0 conn(0x7ff27c130540 legacy=0x7ff27c130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.372+0000 7ff27ad9d700 1 -- 172.21.15.72:0/931457386 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c070b80 con 0x7ff27c135e60 2023-10-03T10:12:57.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.373+0000 7ff27ad9d700 1 --2- 172.21.15.72:0/931457386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c135e60 0x7ff27c138240 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff274009d90 tx=0x7ff27400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25bf71cde0cada6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.374+0000 7ff27959a700 1 -- 172.21.15.72:0/931457386 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27400e070 con 0x7ff27c135e60 2023-10-03T10:12:57.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.374+0000 7ff27959a700 1 -- 172.21.15.72:0/931457386 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27400bb20 con 0x7ff27c135e60 2023-10-03T10:12:57.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.374+0000 7ff27959a700 1 -- 172.21.15.72:0/931457386 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff274012430 con 0x7ff27c135e60 2023-10-03T10:12:57.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.375+0000 7ff280c7e700 1 -- 172.21.15.72:0/931457386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c135e60 msgr2=0x7ff27c138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.375+0000 7ff280c7e700 1 --2- 172.21.15.72:0/931457386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c135e60 0x7ff27c138240 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff274009d90 tx=0x7ff27400b330 comp rx=0 tx=0).stop 2023-10-03T10:12:57.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.375+0000 7ff280c7e700 1 -- 172.21.15.72:0/931457386 shutdown_connections 2023-10-03T10:12:57.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.375+0000 7ff280c7e700 1 --2- 172.21.15.72:0/931457386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c135e60 0x7ff27c138240 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.375+0000 7ff280c7e700 1 --2- 172.21.15.72:0/931457386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c133540 0x7ff27c135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.375+0000 7ff280c7e700 1 -- 172.21.15.72:0/931457386 >> 172.21.15.72:0/931457386 conn(0x7ff27c0a2aa0 msgr2=0x7ff27c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.375+0000 7ff280c7e700 1 -- 172.21.15.72:0/931457386 shutdown_connections 2023-10-03T10:12:57.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.375+0000 7ff280c7e700 1 -- 172.21.15.72:0/931457386 wait complete. 2023-10-03T10:12:57.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.377+0000 7ff280c7e700 1 Processor -- start 2023-10-03T10:12:57.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.377+0000 7ff280c7e700 1 -- start start 2023-10-03T10:12:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.377+0000 7ff280c7e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c130540 0x7ff27c11df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.377+0000 7ff280c7e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c133540 0x7ff27c11e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.377+0000 7ff280c7e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27c135e60 0x7ff27c1c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.377+0000 7ff280c7e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c120da0 con 0x7ff27c133540 2023-10-03T10:12:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.377+0000 7ff280c7e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c12fdf0 con 0x7ff27c130540 2023-10-03T10:12:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.377+0000 7ff280c7e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c11d9f0 con 0x7ff27c135e60 2023-10-03T10:12:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.377+0000 7ff27a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c130540 0x7ff27c11df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.377+0000 7ff27a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c130540 0x7ff27c11df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45192/0 (socket says 172.21.15.72:45192) 2023-10-03T10:12:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.377+0000 7ff27a59c700 1 -- 172.21.15.72:0/3658067052 learned_addr learned my addr 172.21.15.72:0/3658067052 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:57.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.377+0000 7ff27ad9d700 1 --2- 172.21.15.72:0/3658067052 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27c135e60 0x7ff27c1c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.377+0000 7ff279d9b700 1 --2- 172.21.15.72:0/3658067052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c133540 0x7ff27c11e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.378+0000 7ff27a59c700 1 -- 172.21.15.72:0/3658067052 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27c135e60 msgr2=0x7ff27c1c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.378+0000 7ff27a59c700 1 --2- 172.21.15.72:0/3658067052 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27c135e60 0x7ff27c1c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.378+0000 7ff27a59c700 1 -- 172.21.15.72:0/3658067052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c133540 msgr2=0x7ff27c11e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.378+0000 7ff27a59c700 1 --2- 172.21.15.72:0/3658067052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c133540 0x7ff27c11e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.378+0000 7ff27a59c700 1 -- 172.21.15.72:0/3658067052 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff274009a70 con 0x7ff27c130540 2023-10-03T10:12:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.378+0000 7ff27a59c700 1 --2- 172.21.15.72:0/3658067052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c130540 0x7ff27c11df90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00c4b0 tx=0x7ff26c00c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.378+0000 7ff26affd700 1 -- 172.21.15.72:0/3658067052 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c005d70 con 0x7ff27c130540 2023-10-03T10:12:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.378+0000 7ff26affd700 1 -- 172.21.15.72:0/3658067052 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c0070d0 con 0x7ff27c130540 2023-10-03T10:12:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.378+0000 7ff26affd700 1 -- 172.21.15.72:0/3658067052 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c007440 con 0x7ff27c130540 2023-10-03T10:12:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.378+0000 7ff280c7e700 1 -- 172.21.15.72:0/3658067052 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27c120fa0 con 0x7ff27c130540 2023-10-03T10:12:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.378+0000 7ff280c7e700 1 -- 172.21.15.72:0/3658067052 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27c11f0e0 con 0x7ff27c130540 2023-10-03T10:12:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.379+0000 7ff280c7e700 1 -- 172.21.15.72:0/3658067052 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27c0a23a0 con 0x7ff27c130540 2023-10-03T10:12:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.380+0000 7ff26affd700 1 -- 172.21.15.72:0/3658067052 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff26c0075a0 con 0x7ff27c130540 2023-10-03T10:12:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.380+0000 7ff26affd700 1 -- 172.21.15.72:0/3658067052 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ff26c03efc0 con 0x7ff27c130540 2023-10-03T10:12:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.380+0000 7ff279d9b700 1 -- 172.21.15.72:0/3658067052 >> v1:172.21.15.72:6816/126756 conn(0x7ff25c02f510 legacy=0x7ff25c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:57.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.388+0000 7ff26affd700 1 -- 172.21.15.72:0/3658067052 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff26c070750 con 0x7ff27c130540 2023-10-03T10:12:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.418+0000 7f51d5479700 1 Processor -- start 2023-10-03T10:12:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.419+0000 7f51d5479700 1 -- start start 2023-10-03T10:12:57.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.419+0000 7f51d5479700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51d009e930 0x7f51d009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.419+0000 7f51d5479700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51d009f240 0x7f51d01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.419+0000 7f51d5479700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51d009f650 0x7f51d0131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.419+0000 7f51d5479700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d0070940 con 0x7f51d009e930 2023-10-03T10:12:57.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.419+0000 7f51d5479700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d006fd60 con 0x7f51d009f240 2023-10-03T10:12:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.419+0000 7f51d5479700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51d006fa80 con 0x7f51d009f650 2023-10-03T10:12:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.419+0000 7f51cf7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51d009f650 0x7f51d0131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.420+0000 7f51ce7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51d009f240 0x7f51d01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.420+0000 7f51cf7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51d009f650 0x7f51d0131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59812/0 (socket says 172.21.15.72:59812) 2023-10-03T10:12:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.420+0000 7f51cf7fe700 1 -- 172.21.15.72:0/1038396188 learned_addr learned my addr 172.21.15.72:0/1038396188 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.420+0000 7f51ceffd700 1 --2- 172.21.15.72:0/1038396188 >> v2:172.21.15.72:3300/0 conn(0x7f51d009e930 0x7f51d009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.420+0000 7f51cf7fe700 1 -- 172.21.15.72:0/1038396188 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51d009f240 msgr2=0x7f51d01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.420+0000 7f51cf7fe700 1 --2- 172.21.15.72:0/1038396188 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51d009f240 0x7f51d01317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.420+0000 7f51cf7fe700 1 -- 172.21.15.72:0/1038396188 >> v2:172.21.15.72:3300/0 conn(0x7f51d009e930 msgr2=0x7f51d009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.420+0000 7f51cf7fe700 1 --2- 172.21.15.72:0/1038396188 >> v2:172.21.15.72:3300/0 conn(0x7f51d009e930 0x7f51d009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.420+0000 7f51cf7fe700 1 -- 172.21.15.72:0/1038396188 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d009fb60 con 0x7f51d009f650 2023-10-03T10:12:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.420+0000 7f51ceffd700 1 --2- 172.21.15.72:0/1038396188 >> v2:172.21.15.72:3300/0 conn(0x7f51d009e930 0x7f51d009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.420+0000 7f51cf7fe700 1 --2- 172.21.15.72:0/1038396188 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51d009f650 0x7f51d0131d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f51c8009e50 tx=0x7f51c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fc28681d9101bde server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.420+0000 7f51cdffb700 1 -- 172.21.15.72:0/1038396188 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c800e070 con 0x7f51d009f650 2023-10-03T10:12:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.420+0000 7f51cdffb700 1 -- 172.21.15.72:0/1038396188 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c800b910 con 0x7f51d009f650 2023-10-03T10:12:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.420+0000 7f51cdffb700 1 -- 172.21.15.72:0/1038396188 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c800bcc0 con 0x7f51d009f650 2023-10-03T10:12:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.421+0000 7f51d5479700 1 -- 172.21.15.72:0/1038396188 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51d009f650 msgr2=0x7f51d0131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.421+0000 7f51d5479700 1 --2- 172.21.15.72:0/1038396188 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51d009f650 0x7f51d0131d30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f51c8009e50 tx=0x7f51c800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.421+0000 7f51d5479700 1 -- 172.21.15.72:0/1038396188 shutdown_connections 2023-10-03T10:12:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.421+0000 7f51d5479700 1 --2- 172.21.15.72:0/1038396188 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51d009f650 0x7f51d0131d30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.421+0000 7f51d5479700 1 --2- 172.21.15.72:0/1038396188 >> v2:172.21.15.72:3300/0 conn(0x7f51d009e930 0x7f51d009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.421+0000 7f51d5479700 1 --2- 172.21.15.72:0/1038396188 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51d009f240 0x7f51d01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.421+0000 7f51d5479700 1 -- 172.21.15.72:0/1038396188 >> 172.21.15.72:0/1038396188 conn(0x7f51d00a4210 msgr2=0x7f51d00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.421+0000 7f51d5479700 1 -- 172.21.15.72:0/1038396188 shutdown_connections 2023-10-03T10:12:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.421+0000 7f51d5479700 1 -- 172.21.15.72:0/1038396188 wait complete. 2023-10-03T10:12:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.423+0000 7f51d5479700 1 Processor -- start 2023-10-03T10:12:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.423+0000 7f51d5479700 1 -- start start 2023-10-03T10:12:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.423+0000 7f51d5479700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51d009e930 0x7f51d01a7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.423+0000 7f51d5479700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51d009f240 0x7f51d01a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.423+0000 7f51d5479700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51d009f650 0x7f51d006b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.423+0000 7f51d5479700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d01a5370 con 0x7f51d009f240 2023-10-03T10:12:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.423+0000 7f51d5479700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d01a3d90 con 0x7f51d009f650 2023-10-03T10:12:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.423+0000 7f51d5479700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51d01a4fd0 con 0x7f51d009e930 2023-10-03T10:12:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.423+0000 7f51ceffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51d009e930 0x7f51d01a7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.423+0000 7f51ce7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51d009f240 0x7f51d01a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.424+0000 7f51ce7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51d009f240 0x7f51d01a78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60678/0 (socket says 172.21.15.72:60678) 2023-10-03T10:12:57.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.424+0000 7f51ceffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51d009e930 0x7f51d01a7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59818/0 (socket says 172.21.15.72:59818) 2023-10-03T10:12:57.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.424+0000 7f51ce7fc700 1 -- 172.21.15.72:0/1382509333 learned_addr learned my addr 172.21.15.72:0/1382509333 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:57.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.424+0000 7f51cf7fe700 1 --2- 172.21.15.72:0/1382509333 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51d009f650 0x7f51d006b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.424+0000 7f51ce7fc700 1 -- 172.21.15.72:0/1382509333 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51d009e930 msgr2=0x7f51d01a7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.424+0000 7f51ce7fc700 1 --2- 172.21.15.72:0/1382509333 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51d009e930 0x7f51d01a7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.424+0000 7f51ce7fc700 1 -- 172.21.15.72:0/1382509333 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51d009f650 msgr2=0x7f51d006b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.424+0000 7f51ce7fc700 1 --2- 172.21.15.72:0/1382509333 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51d009f650 0x7f51d006b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.424+0000 7f51ce7fc700 1 -- 172.21.15.72:0/1382509333 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c00094a0 con 0x7f51d009f240 2023-10-03T10:12:57.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.424+0000 7f51ce7fc700 1 --2- 172.21.15.72:0/1382509333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51d009f240 0x7f51d01a78d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f51c400e9e0 tx=0x7f51c400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.424+0000 7f51b77fe700 1 -- 172.21.15.72:0/1382509333 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c4009710 con 0x7f51d009f240 2023-10-03T10:12:57.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.424+0000 7f51b77fe700 1 -- 172.21.15.72:0/1382509333 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c400ee80 con 0x7f51d009f240 2023-10-03T10:12:57.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.424+0000 7f51b77fe700 1 -- 172.21.15.72:0/1382509333 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c400ca50 con 0x7f51d009f240 2023-10-03T10:12:57.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.424+0000 7f51d5479700 1 -- 172.21.15.72:0/1382509333 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c8009b30 con 0x7f51d009f240 2023-10-03T10:12:57.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.425+0000 7f51d5479700 1 -- 172.21.15.72:0/1382509333 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d00a0190 con 0x7f51d009f240 2023-10-03T10:12:57.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.426+0000 7f51b77fe700 1 -- 172.21.15.72:0/1382509333 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f51c400cbb0 con 0x7f51d009f240 2023-10-03T10:12:57.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.426+0000 7f51b77fe700 1 -- 172.21.15.72:0/1382509333 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f51c4040080 con 0x7f51d009f240 2023-10-03T10:12:57.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.426+0000 7f51ceffd700 1 -- 172.21.15.72:0/1382509333 >> v1:172.21.15.72:6816/126756 conn(0x7f51bc02f510 legacy=0x7f51bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:57.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.426+0000 7f51d5479700 1 -- 172.21.15.72:0/1382509333 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d01b7390 con 0x7f51d009f240 2023-10-03T10:12:57.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.435+0000 7f51b77fe700 1 -- 172.21.15.72:0/1382509333 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51c4021080 con 0x7f51d009f240 2023-10-03T10:12:57.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.452+0000 7f6dcc8c3700 1 Processor -- start 2023-10-03T10:12:57.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.452+0000 7f6dcc8c3700 1 -- start start 2023-10-03T10:12:57.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.453+0000 7f6dcc8c3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6dc80a09c0 0x7f6dc806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.453+0000 7f6dcc8c3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dc80a0d90 0x7f6dc80a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.453+0000 7f6dcc8c3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dc81338a0 0x7f6dc8133d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.453+0000 7f6dcc8c3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc80a2a20 con 0x7f6dc80a09c0 2023-10-03T10:12:57.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.453+0000 7f6dcc8c3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc809e690 con 0x7f6dc80a0d90 2023-10-03T10:12:57.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.453+0000 7f6dcc8c3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc80a1cc0 con 0x7f6dc81338a0 2023-10-03T10:12:57.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.453+0000 7f6dc5d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dc80a0d90 0x7f6dc80a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.453+0000 7f6dc6d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dc81338a0 0x7f6dc8133d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.453+0000 7f6dc5d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dc80a0d90 0x7f6dc80a11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45228/0 (socket says 172.21.15.72:45228) 2023-10-03T10:12:57.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.453+0000 7f6dc6d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dc81338a0 0x7f6dc8133d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59832/0 (socket says 172.21.15.72:59832) 2023-10-03T10:12:57.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.453+0000 7f6dc5d9b700 1 -- 172.21.15.72:0/3274166095 learned_addr learned my addr 172.21.15.72:0/3274166095 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:57.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.453+0000 7f6dc659c700 1 --2- 172.21.15.72:0/3274166095 >> v2:172.21.15.72:3300/0 conn(0x7f6dc80a09c0 0x7f6dc806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.454+0000 7f6dc5d9b700 1 -- 172.21.15.72:0/3274166095 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dc81338a0 msgr2=0x7f6dc8133d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.454+0000 7f6dc5d9b700 1 --2- 172.21.15.72:0/3274166095 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dc81338a0 0x7f6dc8133d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.454+0000 7f6dc5d9b700 1 -- 172.21.15.72:0/3274166095 >> v2:172.21.15.72:3300/0 conn(0x7f6dc80a09c0 msgr2=0x7f6dc806c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.454+0000 7f6dc5d9b700 1 --2- 172.21.15.72:0/3274166095 >> v2:172.21.15.72:3300/0 conn(0x7f6dc80a09c0 0x7f6dc806c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.454+0000 7f6dc5d9b700 1 -- 172.21.15.72:0/3274166095 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc80a1f40 con 0x7f6dc80a0d90 2023-10-03T10:12:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.454+0000 7f6dc6d9d700 1 --2- 172.21.15.72:0/3274166095 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dc81338a0 0x7f6dc8133d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.454+0000 7f6dc5d9b700 1 --2- 172.21.15.72:0/3274166095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dc80a0d90 0x7f6dc80a11c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0098f0 tx=0x7f6dbc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7158cec03579c002 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.454+0000 7f6dc559a700 1 -- 172.21.15.72:0/3274166095 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc011830 con 0x7f6dc80a0d90 2023-10-03T10:12:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.454+0000 7f6dc559a700 1 -- 172.21.15.72:0/3274166095 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc011990 con 0x7f6dc80a0d90 2023-10-03T10:12:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.454+0000 7f6dc559a700 1 -- 172.21.15.72:0/3274166095 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc011d20 con 0x7f6dc80a0d90 2023-10-03T10:12:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.455+0000 7f6dcc8c3700 1 -- 172.21.15.72:0/3274166095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dc80a0d90 msgr2=0x7f6dc80a11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.455+0000 7f6dcc8c3700 1 --2- 172.21.15.72:0/3274166095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dc80a0d90 0x7f6dc80a11c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0098f0 tx=0x7f6dbc009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.455+0000 7f6dcc8c3700 1 -- 172.21.15.72:0/3274166095 shutdown_connections 2023-10-03T10:12:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.455+0000 7f6dcc8c3700 1 --2- 172.21.15.72:0/3274166095 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dc81338a0 0x7f6dc8133d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.455+0000 7f6dcc8c3700 1 --2- 172.21.15.72:0/3274166095 >> v2:172.21.15.72:3300/0 conn(0x7f6dc80a09c0 0x7f6dc806c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.455+0000 7f6dcc8c3700 1 --2- 172.21.15.72:0/3274166095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dc80a0d90 0x7f6dc80a11c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.455+0000 7f6dcc8c3700 1 -- 172.21.15.72:0/3274166095 >> 172.21.15.72:0/3274166095 conn(0x7f6dc80a60c0 msgr2=0x7f6dc80a64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.455+0000 7f6dcc8c3700 1 -- 172.21.15.72:0/3274166095 shutdown_connections 2023-10-03T10:12:57.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.455+0000 7f6dcc8c3700 1 -- 172.21.15.72:0/3274166095 wait complete. 2023-10-03T10:12:57.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.457+0000 7f6dcc8c3700 1 Processor -- start 2023-10-03T10:12:57.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.457+0000 7f6dcc8c3700 1 -- start start 2023-10-03T10:12:57.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.457+0000 7f6dcc8c3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dc80a09c0 0x7f6dc811f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.457+0000 7f6dcc8c3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dc80a0d90 0x7f6dc811f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.457+0000 7f6dcc8c3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dc81338a0 0x7f6dc81c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.457+0000 7f6dcc8c3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc8122590 con 0x7f6dc81338a0 2023-10-03T10:12:57.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.457+0000 7f6dcc8c3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc811ee20 con 0x7f6dc80a0d90 2023-10-03T10:12:57.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.457+0000 7f6dcc8c3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc8120580 con 0x7f6dc80a09c0 2023-10-03T10:12:57.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.457+0000 7f6dc659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dc80a09c0 0x7f6dc811f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.457+0000 7f6dc659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dc80a09c0 0x7f6dc811f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59840/0 (socket says 172.21.15.72:59840) 2023-10-03T10:12:57.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.457+0000 7f6dc659c700 1 -- 172.21.15.72:0/861786042 learned_addr learned my addr 172.21.15.72:0/861786042 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:57.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.458+0000 7f6dc5d9b700 1 --2- 172.21.15.72:0/861786042 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dc80a0d90 0x7f6dc811f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.458+0000 7f6dc6d9d700 1 --2- 172.21.15.72:0/861786042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dc81338a0 0x7f6dc81c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.458+0000 7f6dc659c700 1 -- 172.21.15.72:0/861786042 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dc80a0d90 msgr2=0x7f6dc811f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.458+0000 7f6dc659c700 1 --2- 172.21.15.72:0/861786042 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dc80a0d90 0x7f6dc811f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.458+0000 7f6dc659c700 1 -- 172.21.15.72:0/861786042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dc81338a0 msgr2=0x7f6dc81c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.458+0000 7f6dc659c700 1 --2- 172.21.15.72:0/861786042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dc81338a0 0x7f6dc81c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.458+0000 7f6dc659c700 1 -- 172.21.15.72:0/861786042 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc0009a70 con 0x7f6dc80a09c0 2023-10-03T10:12:57.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.458+0000 7f6dc659c700 1 --2- 172.21.15.72:0/861786042 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dc80a09c0 0x7f6dc811f470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6db800e9b0 tx=0x7f6db800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.458+0000 7f6db6ffd700 1 -- 172.21.15.72:0/861786042 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db8009710 con 0x7f6dc80a09c0 2023-10-03T10:12:57.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.458+0000 7f6dcc8c3700 1 -- 172.21.15.72:0/861786042 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc009550 con 0x7f6dc80a09c0 2023-10-03T10:12:57.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.458+0000 7f6db6ffd700 1 -- 172.21.15.72:0/861786042 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db800c850 con 0x7f6dc80a09c0 2023-10-03T10:12:57.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.458+0000 7f6db6ffd700 1 -- 172.21.15.72:0/861786042 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db800cbc0 con 0x7f6dc80a09c0 2023-10-03T10:12:57.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.458+0000 7f6dcc8c3700 1 -- 172.21.15.72:0/861786042 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc809cea0 con 0x7f6dc80a09c0 2023-10-03T10:12:57.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.459+0000 7f6db6ffd700 1 -- 172.21.15.72:0/861786042 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6db800cd20 con 0x7f6dc80a09c0 2023-10-03T10:12:57.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.459+0000 7f6db6ffd700 1 -- 172.21.15.72:0/861786042 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f6db803fd00 con 0x7f6dc80a09c0 2023-10-03T10:12:57.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.460+0000 7f6dc5d9b700 1 -- 172.21.15.72:0/861786042 >> v1:172.21.15.72:6816/126756 conn(0x7f6da802f510 legacy=0x7f6da80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:57.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.460+0000 7f6dcc8c3700 1 -- 172.21.15.72:0/861786042 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc804f2a0 con 0x7f6dc80a09c0 2023-10-03T10:12:57.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.469+0000 7f6db6ffd700 1 -- 172.21.15.72:0/861786042 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6db80232f0 con 0x7f6dc80a09c0 2023-10-03T10:12:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.494+0000 7f9af6f88700 1 Processor -- start 2023-10-03T10:12:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.494+0000 7f9af6f88700 1 -- start start 2023-10-03T10:12:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.495+0000 7f9af6f88700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9af012cf60 0x7f9af006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.495+0000 7f9af6f88700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9af0130430 0x7f9af0137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.495+0000 7f9af6f88700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af012cd90 con 0x7f9af012f8b0 2023-10-03T10:12:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.495+0000 7f9af6f88700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af012d330 con 0x7f9af0130430 2023-10-03T10:12:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.495+0000 7f9af6f88700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9af0071780 con 0x7f9af012cf60 2023-10-03T10:12:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.495+0000 7f9af4d24700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9af012cf60 0x7f9af006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.495+0000 7f9af4d24700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9af012cf60 0x7f9af006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59852/0 (socket says 172.21.15.72:59852) 2023-10-03T10:12:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.495+0000 7f9af4d24700 1 -- 172.21.15.72:0/2494127299 learned_addr learned my addr 172.21.15.72:0/2494127299 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.495+0000 7f9af5525700 1 --2- 172.21.15.72:0/2494127299 >> v2:172.21.15.72:3300/0 conn(0x7f9af0130430 0x7f9af0137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.495+0000 7f9af4d24700 1 -- 172.21.15.72:0/2494127299 >> v2:172.21.15.72:3300/0 conn(0x7f9af0130430 msgr2=0x7f9af0137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.495+0000 7f9af4d24700 1 --2- 172.21.15.72:0/2494127299 >> v2:172.21.15.72:3300/0 conn(0x7f9af0130430 0x7f9af0137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.495+0000 7f9aef7fe700 1 -- 172.21.15.72:0/2494127299 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611134986 0 0) 0x7f9af012cd90 con 0x7f9af012f8b0 2023-10-03T10:12:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.495+0000 7f9af4d24700 1 -- 172.21.15.72:0/2494127299 >> v1:172.21.15.72:6789/0 conn(0x7f9af012f8b0 legacy=0x7f9af012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.495+0000 7f9af4d24700 1 -- 172.21.15.72:0/2494127299 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af0071a40 con 0x7f9af012cf60 2023-10-03T10:12:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.496+0000 7f9af4d24700 1 --2- 172.21.15.72:0/2494127299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9af012cf60 0x7f9af006f5d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40098f0 tx=0x7f9ae4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fc4866a1f9977a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.496+0000 7f9aef7fe700 1 -- 172.21.15.72:0/2494127299 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4011830 con 0x7f9af012cf60 2023-10-03T10:12:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.496+0000 7f9aef7fe700 1 -- 172.21.15.72:0/2494127299 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae4011990 con 0x7f9af012cf60 2023-10-03T10:12:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.496+0000 7f9aef7fe700 1 -- 172.21.15.72:0/2494127299 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4011d20 con 0x7f9af012cf60 2023-10-03T10:12:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.496+0000 7f9af6f88700 1 -- 172.21.15.72:0/2494127299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9af012cf60 msgr2=0x7f9af006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.496+0000 7f9af6f88700 1 --2- 172.21.15.72:0/2494127299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9af012cf60 0x7f9af006f5d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40098f0 tx=0x7f9ae4009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.497+0000 7f9af6f88700 1 -- 172.21.15.72:0/2494127299 shutdown_connections 2023-10-03T10:12:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.497+0000 7f9af6f88700 1 --2- 172.21.15.72:0/2494127299 >> v2:172.21.15.72:3300/0 conn(0x7f9af0130430 0x7f9af0137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.497+0000 7f9af6f88700 1 --2- 172.21.15.72:0/2494127299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9af012cf60 0x7f9af006f5d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.497+0000 7f9af6f88700 1 -- 172.21.15.72:0/2494127299 >> 172.21.15.72:0/2494127299 conn(0x7f9af00a2aa0 msgr2=0x7f9af00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.497+0000 7f9af6f88700 1 -- 172.21.15.72:0/2494127299 shutdown_connections 2023-10-03T10:12:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.497+0000 7f9af6f88700 1 -- 172.21.15.72:0/2494127299 wait complete. 2023-10-03T10:12:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.497+0000 7f9af6f88700 1 Processor -- start 2023-10-03T10:12:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.497+0000 7f9af6f88700 1 -- start start 2023-10-03T10:12:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.498+0000 7f9af6f88700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9af012cf60 0x7f9af01c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.498+0000 7f9af6f88700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9af012f8b0 0x7f9af01c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.498+0000 7f9af6f88700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9af0130430 0x7f9af01c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.498+0000 7f9af6f88700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af009ce70 con 0x7f9af0130430 2023-10-03T10:12:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.498+0000 7f9af6f88700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af009cc80 con 0x7f9af012cf60 2023-10-03T10:12:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.498+0000 7f9af6f88700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9af009e920 con 0x7f9af012f8b0 2023-10-03T10:12:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.498+0000 7f9af4d24700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9af012cf60 0x7f9af01c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.498+0000 7f9af4d24700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9af012cf60 0x7f9af01c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45252/0 (socket says 172.21.15.72:45252) 2023-10-03T10:12:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.498+0000 7f9af4d24700 1 -- 172.21.15.72:0/192214841 learned_addr learned my addr 172.21.15.72:0/192214841 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.498+0000 7f9aeffff700 1 --2- 172.21.15.72:0/192214841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9af012f8b0 0x7f9af01c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.498+0000 7f9af5525700 1 --2- 172.21.15.72:0/192214841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9af0130430 0x7f9af01c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.499+0000 7f9af4d24700 1 -- 172.21.15.72:0/192214841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9af012f8b0 msgr2=0x7f9af01c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.499+0000 7f9af4d24700 1 --2- 172.21.15.72:0/192214841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9af012f8b0 0x7f9af01c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.499+0000 7f9af4d24700 1 -- 172.21.15.72:0/192214841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9af0130430 msgr2=0x7f9af01c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.499+0000 7f9af4d24700 1 --2- 172.21.15.72:0/192214841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9af0130430 0x7f9af01c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.499+0000 7f9af4d24700 1 -- 172.21.15.72:0/192214841 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae4009550 con 0x7f9af012cf60 2023-10-03T10:12:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.499+0000 7f9af4d24700 1 --2- 172.21.15.72:0/192214841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9af012cf60 0x7f9af01c3e20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4000c00 tx=0x7f9ae4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:57.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.499+0000 7f9aed7fa700 1 -- 172.21.15.72:0/192214841 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae40043c0 con 0x7f9af012cf60 2023-10-03T10:12:57.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.499+0000 7f9aed7fa700 1 -- 172.21.15.72:0/192214841 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae401f070 con 0x7f9af012cf60 2023-10-03T10:12:57.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.499+0000 7f9af6f88700 1 -- 172.21.15.72:0/192214841 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af012d9b0 con 0x7f9af012cf60 2023-10-03T10:12:57.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.499+0000 7f9aed7fa700 1 -- 172.21.15.72:0/192214841 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae40036a0 con 0x7f9af012cf60 2023-10-03T10:12:57.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.499+0000 7f9af6f88700 1 -- 172.21.15.72:0/192214841 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af009d8f0 con 0x7f9af012cf60 2023-10-03T10:12:57.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.500+0000 7f9aed7fa700 1 -- 172.21.15.72:0/192214841 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9ae4021030 con 0x7f9af012cf60 2023-10-03T10:12:57.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.500+0000 7f9af6f88700 1 -- 172.21.15.72:0/192214841 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af0074ea0 con 0x7f9af012cf60 2023-10-03T10:12:57.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.500+0000 7f9aed7fa700 1 -- 172.21.15.72:0/192214841 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f9ae4040de0 con 0x7f9af012cf60 2023-10-03T10:12:57.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.500+0000 7f9aeffff700 1 -- 172.21.15.72:0/192214841 >> v1:172.21.15.72:6816/126756 conn(0x7f9ad402f510 legacy=0x7f9ad40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:57.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.505+0000 7f9aed7fa700 1 -- 172.21.15.72:0/192214841 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ae4006ca0 con 0x7f9af012cf60 2023-10-03T10:12:57.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.581+0000 7ff279d9b700 1 -- 172.21.15.72:0/3658067052 >> v1:172.21.15.72:6816/126756 conn(0x7ff25c02f510 legacy=0x7ff25c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.627+0000 7f51ceffd700 1 -- 172.21.15.72:0/1382509333 >> v1:172.21.15.72:6816/126756 conn(0x7f51bc02f510 legacy=0x7f51bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.634+0000 7ff280c7e700 1 -- 172.21.15.72:0/3658067052 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff27c074ea0 con 0x7ff27c130540 2023-10-03T10:12:57.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.634+0000 7ff26affd700 1 -- 172.21.15.72:0/3658067052 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff26c017020 con 0x7ff27c130540 2023-10-03T10:12:57.635 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:57.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.636+0000 7ff280c7e700 1 -- 172.21.15.72:0/3658067052 >> v1:172.21.15.72:6816/126756 conn(0x7ff25c02f510 legacy=0x7ff25c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:57.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.636+0000 7ff280c7e700 1 -- 172.21.15.72:0/3658067052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c130540 msgr2=0x7ff27c11df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.636+0000 7ff280c7e700 1 --2- 172.21.15.72:0/3658067052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c130540 0x7ff27c11df90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00c4b0 tx=0x7ff26c00c870 comp rx=0 tx=0).stop 2023-10-03T10:12:57.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.636+0000 7ff280c7e700 1 -- 172.21.15.72:0/3658067052 shutdown_connections 2023-10-03T10:12:57.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.636+0000 7ff280c7e700 1 --2- 172.21.15.72:0/3658067052 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27c135e60 0x7ff27c1c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.636+0000 7ff280c7e700 1 --2- 172.21.15.72:0/3658067052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c130540 0x7ff27c11df90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.636+0000 7ff280c7e700 1 --2- 172.21.15.72:0/3658067052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c133540 0x7ff27c11e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.636+0000 7ff280c7e700 1 -- 172.21.15.72:0/3658067052 >> 172.21.15.72:0/3658067052 conn(0x7ff27c0a2aa0 msgr2=0x7ff27c131320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.636+0000 7ff280c7e700 1 -- 172.21.15.72:0/3658067052 shutdown_connections 2023-10-03T10:12:57.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.636+0000 7ff280c7e700 1 -- 172.21.15.72:0/3658067052 wait complete. 2023-10-03T10:12:57.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.643+0000 7f51d5479700 1 -- 172.21.15.72:0/1382509333 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f51d0074ea0 con 0x7f51d009f240 2023-10-03T10:12:57.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.643+0000 7f51b77fe700 1 -- 172.21.15.72:0/1382509333 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f51c4017020 con 0x7f51d009f240 2023-10-03T10:12:57.644 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.645+0000 7f51d5479700 1 -- 172.21.15.72:0/1382509333 >> v1:172.21.15.72:6816/126756 conn(0x7f51bc02f510 legacy=0x7f51bc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.645+0000 7f51d5479700 1 -- 172.21.15.72:0/1382509333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51d009f240 msgr2=0x7f51d01a78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.645+0000 7f51d5479700 1 --2- 172.21.15.72:0/1382509333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51d009f240 0x7f51d01a78d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f51c400e9e0 tx=0x7f51c400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.645+0000 7f51d5479700 1 -- 172.21.15.72:0/1382509333 shutdown_connections 2023-10-03T10:12:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.645+0000 7f51d5479700 1 --2- 172.21.15.72:0/1382509333 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51d009f650 0x7f51d006b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.645+0000 7f51d5479700 1 --2- 172.21.15.72:0/1382509333 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51d009e930 0x7f51d01a7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.645+0000 7f51d5479700 1 --2- 172.21.15.72:0/1382509333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51d009f240 0x7f51d01a78d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.645+0000 7f51d5479700 1 -- 172.21.15.72:0/1382509333 >> 172.21.15.72:0/1382509333 conn(0x7f51d00a4210 msgr2=0x7f51d01b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.645+0000 7f51d5479700 1 -- 172.21.15.72:0/1382509333 shutdown_connections 2023-10-03T10:12:57.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.645+0000 7f51d5479700 1 -- 172.21.15.72:0/1382509333 wait complete. 2023-10-03T10:12:57.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:57.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.661+0000 7f6dc5d9b700 1 -- 172.21.15.72:0/861786042 >> v1:172.21.15.72:6816/126756 conn(0x7f6da802f510 legacy=0x7f6da80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:57.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.700+0000 7f6dcc8c3700 1 -- 172.21.15.72:0/861786042 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6dc809dd50 con 0x7f6dc80a09c0 2023-10-03T10:12:57.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.701+0000 7f9aeffff700 1 -- 172.21.15.72:0/192214841 >> v1:172.21.15.72:6816/126756 conn(0x7f9ad402f510 legacy=0x7f9ad40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:57.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.701+0000 7f6db6ffd700 1 -- 172.21.15.72:0/861786042 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6db801ae80 con 0x7f6dc80a09c0 2023-10-03T10:12:57.702 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:57.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.703+0000 7f6dcc8c3700 1 -- 172.21.15.72:0/861786042 >> v1:172.21.15.72:6816/126756 conn(0x7f6da802f510 legacy=0x7f6da80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:57.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.703+0000 7f6dcc8c3700 1 -- 172.21.15.72:0/861786042 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dc80a09c0 msgr2=0x7f6dc811f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.703+0000 7f6dcc8c3700 1 --2- 172.21.15.72:0/861786042 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dc80a09c0 0x7f6dc811f470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6db800e9b0 tx=0x7f6db800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.703+0000 7f6dcc8c3700 1 -- 172.21.15.72:0/861786042 shutdown_connections 2023-10-03T10:12:57.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.703+0000 7f6dcc8c3700 1 --2- 172.21.15.72:0/861786042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dc81338a0 0x7f6dc81c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.703+0000 7f6dcc8c3700 1 --2- 172.21.15.72:0/861786042 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dc80a09c0 0x7f6dc811f470 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.703+0000 7f6dcc8c3700 1 --2- 172.21.15.72:0/861786042 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dc80a0d90 0x7f6dc811f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.703+0000 7f6dcc8c3700 1 -- 172.21.15.72:0/861786042 >> 172.21.15.72:0/861786042 conn(0x7f6dc80a60c0 msgr2=0x7f6dc81bb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.703+0000 7f6dcc8c3700 1 -- 172.21.15.72:0/861786042 shutdown_connections 2023-10-03T10:12:57.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.703+0000 7f6dcc8c3700 1 -- 172.21.15.72:0/861786042 wait complete. 2023-10-03T10:12:57.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.704+0000 7f9af6f88700 1 -- 172.21.15.72:0/192214841 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9af00713a0 con 0x7f9af012cf60 2023-10-03T10:12:57.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.704+0000 7f9aed7fa700 1 -- 172.21.15.72:0/192214841 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ae4015070 con 0x7f9af012cf60 2023-10-03T10:12:57.705 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:57.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.706+0000 7f9af6f88700 1 -- 172.21.15.72:0/192214841 >> v1:172.21.15.72:6816/126756 conn(0x7f9ad402f510 legacy=0x7f9ad40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:57.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.706+0000 7f9af6f88700 1 -- 172.21.15.72:0/192214841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9af012cf60 msgr2=0x7f9af01c3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:57.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.706+0000 7f9af6f88700 1 --2- 172.21.15.72:0/192214841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9af012cf60 0x7f9af01c3e20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4000c00 tx=0x7f9ae4004750 comp rx=0 tx=0).stop 2023-10-03T10:12:57.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.706+0000 7f9af6f88700 1 -- 172.21.15.72:0/192214841 shutdown_connections 2023-10-03T10:12:57.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.706+0000 7f9af6f88700 1 --2- 172.21.15.72:0/192214841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9af0130430 0x7f9af01c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.707+0000 7f9af6f88700 1 --2- 172.21.15.72:0/192214841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9af012cf60 0x7f9af01c3e20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.707+0000 7f9af6f88700 1 --2- 172.21.15.72:0/192214841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9af012f8b0 0x7f9af01c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:57.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.707+0000 7f9af6f88700 1 -- 172.21.15.72:0/192214841 >> 172.21.15.72:0/192214841 conn(0x7f9af00a2aa0 msgr2=0x7f9af01b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:57.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.707+0000 7f9af6f88700 1 -- 172.21.15.72:0/192214841 shutdown_connections 2023-10-03T10:12:57.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:57.707+0000 7f9af6f88700 1 -- 172.21.15.72:0/192214841 wait complete. 2023-10-03T10:12:57.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:12:57.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:58.651 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:12:58.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:12:58.718 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:12:58.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:12:58.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.803+0000 7f4d70d76700 1 Processor -- start 2023-10-03T10:12:58.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.803+0000 7f4d70d76700 1 -- start start 2023-10-03T10:12:58.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.804+0000 7f4d70d76700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d6c09d6f0 0x7f4d6c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.804+0000 7f4d70d76700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4d6c09e000 0x7f4d6c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.804+0000 7f4d70d76700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6c09f130 con 0x7f4d6c09e410 2023-10-03T10:12:58.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.804+0000 7f4d70d76700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6c09f520 con 0x7f4d6c09e000 2023-10-03T10:12:58.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.804+0000 7f4d70d76700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c09e930 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.804+0000 7f4d6a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d6c09d6f0 0x7f4d6c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.804+0000 7f4d6a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d6c09d6f0 0x7f4d6c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38708/0 (socket says 172.21.15.72:38708) 2023-10-03T10:12:58.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.804+0000 7f4d6a59c700 1 -- 172.21.15.72:0/3092460061 learned_addr learned my addr 172.21.15.72:0/3092460061 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:58.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.804+0000 7f4d69d9b700 1 --2- 172.21.15.72:0/3092460061 >> v2:172.21.15.72:3300/0 conn(0x7f4d6c09e000 0x7f4d6c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.805+0000 7f4d6959a700 1 -- 172.21.15.72:0/3092460061 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798657783 0 0) 0x7f4d6c09f130 con 0x7f4d6c09e410 2023-10-03T10:12:58.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.805+0000 7f4d6959a700 1 -- 172.21.15.72:0/3092460061 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d540035b0 con 0x7f4d6c09e410 2023-10-03T10:12:58.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.805+0000 7f4d6a59c700 1 -- 172.21.15.72:0/3092460061 >> v2:172.21.15.72:3300/0 conn(0x7f4d6c09e000 msgr2=0x7f4d6c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:58.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.805+0000 7f4d6a59c700 1 --2- 172.21.15.72:0/3092460061 >> v2:172.21.15.72:3300/0 conn(0x7f4d6c09e000 0x7f4d6c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.805+0000 7f4d6a59c700 1 -- 172.21.15.72:0/3092460061 >> v1:172.21.15.72:6789/0 conn(0x7f4d6c09e410 legacy=0x7f4d6c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.805+0000 7f4d6a59c700 1 -- 172.21.15.72:0/3092460061 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c09b2d0 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.805+0000 7f4d69d9b700 1 --2- 172.21.15.72:0/3092460061 >> v2:172.21.15.72:3300/0 conn(0x7f4d6c09e000 0x7f4d6c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:58.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.805+0000 7f4d6a59c700 1 --2- 172.21.15.72:0/3092460061 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d6c09d6f0 0x7f4d6c09dac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0098f0 tx=0x7f4d5c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e12b311e30bb25b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.805+0000 7f4d6959a700 1 -- 172.21.15.72:0/3092460061 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c011830 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.805+0000 7f4d6959a700 1 -- 172.21.15.72:0/3092460061 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c011990 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.805+0000 7f4d6959a700 1 -- 172.21.15.72:0/3092460061 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c011d20 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.806+0000 7f4d70d76700 1 -- 172.21.15.72:0/3092460061 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d6c09d6f0 msgr2=0x7f4d6c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.806+0000 7f4d70d76700 1 --2- 172.21.15.72:0/3092460061 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d6c09d6f0 0x7f4d6c09dac0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0098f0 tx=0x7f4d5c009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:58.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.806+0000 7f4d70d76700 1 -- 172.21.15.72:0/3092460061 shutdown_connections 2023-10-03T10:12:58.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.806+0000 7f4d70d76700 1 --2- 172.21.15.72:0/3092460061 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d6c09d6f0 0x7f4d6c09dac0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.806+0000 7f4d70d76700 1 --2- 172.21.15.72:0/3092460061 >> v2:172.21.15.72:3300/0 conn(0x7f4d6c09e000 0x7f4d6c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.806+0000 7f4d70d76700 1 -- 172.21.15.72:0/3092460061 >> 172.21.15.72:0/3092460061 conn(0x7f4d6c066f50 msgr2=0x7f4d6c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.806+0000 7f4d70d76700 1 -- 172.21.15.72:0/3092460061 shutdown_connections 2023-10-03T10:12:58.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.806+0000 7f4d70d76700 1 -- 172.21.15.72:0/3092460061 wait complete. 2023-10-03T10:12:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.807+0000 7f4d70d76700 1 Processor -- start 2023-10-03T10:12:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.807+0000 7f4d70d76700 1 -- start start 2023-10-03T10:12:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d70d76700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d6c09d6f0 0x7f4d6c139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d70d76700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d6c09e000 0x7f4d6c139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d70d76700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c09e410 0x7f4d6c13a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d70d76700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c137590 con 0x7f4d6c09e410 2023-10-03T10:12:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d70d76700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c136bd0 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d70d76700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c09c700 con 0x7f4d6c09e000 2023-10-03T10:12:58.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d6a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d6c09d6f0 0x7f4d6c139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d6a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d6c09d6f0 0x7f4d6c139940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39404/0 (socket says 172.21.15.72:39404) 2023-10-03T10:12:58.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d6a59c700 1 -- 172.21.15.72:0/3253286877 learned_addr learned my addr 172.21.15.72:0/3253286877 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:58.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d69d9b700 1 --2- 172.21.15.72:0/3253286877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d6c09e000 0x7f4d6c139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d6ad9d700 1 --2- 172.21.15.72:0/3253286877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c09e410 0x7f4d6c13a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d6a59c700 1 -- 172.21.15.72:0/3253286877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d6c09e000 msgr2=0x7f4d6c139e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d6a59c700 1 --2- 172.21.15.72:0/3253286877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d6c09e000 0x7f4d6c139e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d6a59c700 1 -- 172.21.15.72:0/3253286877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c09e410 msgr2=0x7f4d6c13a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d6a59c700 1 --2- 172.21.15.72:0/3253286877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c09e410 0x7f4d6c13a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d6a59c700 1 -- 172.21.15.72:0/3253286877 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d600094a0 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.808+0000 7f4d6ad9d700 1 --2- 172.21.15.72:0/3253286877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c09e410 0x7f4d6c13a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:58.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.809+0000 7f4d6a59c700 1 --2- 172.21.15.72:0/3253286877 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d6c09d6f0 0x7f4d6c139940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c09ea70 tx=0x7f4d5c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.809+0000 7f4d5affd700 1 -- 172.21.15.72:0/3253286877 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c004510 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.809+0000 7f4d5affd700 1 -- 172.21.15.72:0/3253286877 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c01e070 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.809+0000 7f4d70d76700 1 -- 172.21.15.72:0/3253286877 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5c009550 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.809+0000 7f4d5affd700 1 -- 172.21.15.72:0/3253286877 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0038e0 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.809+0000 7f4d70d76700 1 -- 172.21.15.72:0/3253286877 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c136390 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.810+0000 7f4d5affd700 1 -- 172.21.15.72:0/3253286877 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4d5c003a40 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.810+0000 7f4d5affd700 1 -- 172.21.15.72:0/3253286877 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f4d5c040a90 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.810+0000 7f4d69d9b700 1 -- 172.21.15.72:0/3253286877 >> v1:172.21.15.72:6816/126756 conn(0x7f4d4c02f510 legacy=0x7f4d4c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:58.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.810+0000 7f4d70d76700 1 -- 172.21.15.72:0/3253286877 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c074ea0 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.815+0000 7f4d5affd700 1 -- 172.21.15.72:0/3253286877 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d5c015080 con 0x7f4d6c09d6f0 2023-10-03T10:12:58.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.832+0000 7f0f7a08e700 1 Processor -- start 2023-10-03T10:12:58.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.832+0000 7f0f7a08e700 1 -- start start 2023-10-03T10:12:58.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.833+0000 7f0f7a08e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f74133490 0x7f0f74135870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.833+0000 7f0f7a08e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0f74135db0 0x7f0f74138190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.833+0000 7f0f7a08e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7409c190 con 0x7f0f74130750 2023-10-03T10:12:58.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.833+0000 7f0f7a08e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7409b090 con 0x7f0f74135db0 2023-10-03T10:12:58.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.833+0000 7f0f7a08e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7409a6c0 con 0x7f0f74133490 2023-10-03T10:12:58.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.833+0000 7f0f72ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f74133490 0x7f0f74135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.833+0000 7f0f72ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f74133490 0x7f0f74135870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39418/0 (socket says 172.21.15.72:39418) 2023-10-03T10:12:58.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.833+0000 7f0f72ffd700 1 -- 172.21.15.72:0/4078424584 learned_addr learned my addr 172.21.15.72:0/4078424584 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:58.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.833+0000 7f0f73fff700 1 --2- 172.21.15.72:0/4078424584 >> v2:172.21.15.72:3300/0 conn(0x7f0f74135db0 0x7f0f74138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.833+0000 7f0f72ffd700 1 -- 172.21.15.72:0/4078424584 >> v2:172.21.15.72:3300/0 conn(0x7f0f74135db0 msgr2=0x7f0f74138190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.833+0000 7f0f72ffd700 1 --2- 172.21.15.72:0/4078424584 >> v2:172.21.15.72:3300/0 conn(0x7f0f74135db0 0x7f0f74138190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.833+0000 7f0f72ffd700 1 -- 172.21.15.72:0/4078424584 >> v1:172.21.15.72:6789/0 conn(0x7f0f74130750 legacy=0x7f0f74130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.833+0000 7f0f72ffd700 1 -- 172.21.15.72:0/4078424584 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f74130300 con 0x7f0f74133490 2023-10-03T10:12:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.833+0000 7f0f73fff700 1 --2- 172.21.15.72:0/4078424584 >> v2:172.21.15.72:3300/0 conn(0x7f0f74135db0 0x7f0f74138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.834+0000 7f0f72ffd700 1 --2- 172.21.15.72:0/4078424584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f74133490 0x7f0f74135870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0f680098f0 tx=0x7f0f68009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ab22769a1ab6226 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.834+0000 7f0f727fc700 1 -- 172.21.15.72:0/4078424584 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6800b8a0 con 0x7f0f74133490 2023-10-03T10:12:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.834+0000 7f0f727fc700 1 -- 172.21.15.72:0/4078424584 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6800ba00 con 0x7f0f74133490 2023-10-03T10:12:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.834+0000 7f0f727fc700 1 -- 172.21.15.72:0/4078424584 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6800bd90 con 0x7f0f74133490 2023-10-03T10:12:58.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.834+0000 7f0f7a08e700 1 -- 172.21.15.72:0/4078424584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f74133490 msgr2=0x7f0f74135870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.834+0000 7f0f7a08e700 1 --2- 172.21.15.72:0/4078424584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f74133490 0x7f0f74135870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0f680098f0 tx=0x7f0f68009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:58.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.834+0000 7f0f7a08e700 1 -- 172.21.15.72:0/4078424584 shutdown_connections 2023-10-03T10:12:58.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.834+0000 7f0f7a08e700 1 --2- 172.21.15.72:0/4078424584 >> v2:172.21.15.72:3300/0 conn(0x7f0f74135db0 0x7f0f74138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.834+0000 7f0f7a08e700 1 --2- 172.21.15.72:0/4078424584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f74133490 0x7f0f74135870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.834+0000 7f0f7a08e700 1 -- 172.21.15.72:0/4078424584 >> 172.21.15.72:0/4078424584 conn(0x7f0f7409f470 msgr2=0x7f0f740a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.835+0000 7f0f7a08e700 1 -- 172.21.15.72:0/4078424584 shutdown_connections 2023-10-03T10:12:58.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.835+0000 7f0f7a08e700 1 -- 172.21.15.72:0/4078424584 wait complete. 2023-10-03T10:12:58.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.835+0000 7f0f7a08e700 1 Processor -- start 2023-10-03T10:12:58.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.836+0000 7f0f7a08e700 1 -- start start 2023-10-03T10:12:58.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.836+0000 7f0f7a08e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f74130750 0x7f0f7406ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.836+0000 7f0f7a08e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f74133490 0x7f0f7406f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.836+0000 7f0f7a08e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f74135db0 0x7f0f7406f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.836+0000 7f0f7a08e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f74071d60 con 0x7f0f74133490 2023-10-03T10:12:58.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.836+0000 7f0f7a08e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f741392f0 con 0x7f0f74135db0 2023-10-03T10:12:58.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.836+0000 7f0f7a08e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7409b2b0 con 0x7f0f74130750 2023-10-03T10:12:58.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.836+0000 7f0f72ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f74133490 0x7f0f7406f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.836+0000 7f0f72ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f74133490 0x7f0f7406f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42130/0 (socket says 172.21.15.72:42130) 2023-10-03T10:12:58.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.836+0000 7f0f73fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f74135db0 0x7f0f7406f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.836+0000 7f0f72ffd700 1 -- 172.21.15.72:0/1089599973 learned_addr learned my addr 172.21.15.72:0/1089599973 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:58.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.837+0000 7f0f73fff700 1 -- 172.21.15.72:0/1089599973 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f74130750 msgr2=0x7f0f7406ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.837+0000 7f0f73fff700 1 --2- 172.21.15.72:0/1089599973 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f74130750 0x7f0f7406ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.837+0000 7f0f73fff700 1 -- 172.21.15.72:0/1089599973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f74133490 msgr2=0x7f0f7406f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.837+0000 7f0f73fff700 1 --2- 172.21.15.72:0/1089599973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f74133490 0x7f0f7406f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.837+0000 7f0f73fff700 1 -- 172.21.15.72:0/1089599973 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f68009550 con 0x7f0f74135db0 2023-10-03T10:12:58.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.837+0000 7f0f73fff700 1 --2- 172.21.15.72:0/1089599973 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f74135db0 0x7f0f7406f9c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f7406cd10 tx=0x7f0f6c00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.837+0000 7f0f5bfff700 1 -- 172.21.15.72:0/1089599973 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c00ddd0 con 0x7f0f74135db0 2023-10-03T10:12:58.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.837+0000 7f0f5bfff700 1 -- 172.21.15.72:0/1089599973 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6c00f040 con 0x7f0f74135db0 2023-10-03T10:12:58.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.837+0000 7f0f5bfff700 1 -- 172.21.15.72:0/1089599973 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c003c40 con 0x7f0f74135db0 2023-10-03T10:12:58.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.837+0000 7f0f7a08e700 1 -- 172.21.15.72:0/1089599973 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7412fc60 con 0x7f0f74135db0 2023-10-03T10:12:58.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.837+0000 7f0f7a08e700 1 -- 172.21.15.72:0/1089599973 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f741274b0 con 0x7f0f74135db0 2023-10-03T10:12:58.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.838+0000 7f0f7a08e700 1 -- 172.21.15.72:0/1089599973 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f74127080 con 0x7f0f74135db0 2023-10-03T10:12:58.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.838+0000 7f0f5bfff700 1 -- 172.21.15.72:0/1089599973 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f0f6c004030 con 0x7f0f74135db0 2023-10-03T10:12:58.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.839+0000 7f0f5bfff700 1 -- 172.21.15.72:0/1089599973 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f0f6c040240 con 0x7f0f74135db0 2023-10-03T10:12:58.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.839+0000 7f0f737fe700 1 -- 172.21.15.72:0/1089599973 >> v1:172.21.15.72:6816/126756 conn(0x7f0f6002f510 legacy=0x7f0f600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:58.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.843+0000 7f0f5bfff700 1 -- 172.21.15.72:0/1089599973 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f6c01f440 con 0x7f0f74135db0 2023-10-03T10:12:58.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.883+0000 7f02312a1700 1 Processor -- start 2023-10-03T10:12:58.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.883+0000 7f02312a1700 1 -- start start 2023-10-03T10:12:58.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f02312a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022c133420 0x7f022c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f02312a1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022c133e30 0x7f022c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f02312a1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f022c134260 0x7f022c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f02312a1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022c06b990 con 0x7f022c134260 2023-10-03T10:12:58.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f02312a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022c0a0590 con 0x7f022c133420 2023-10-03T10:12:58.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f02312a1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f022c09fb80 con 0x7f022c133e30 2023-10-03T10:12:58.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f022affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022c133420 0x7f022c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f022affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022c133420 0x7f022c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39432/0 (socket says 172.21.15.72:39432) 2023-10-03T10:12:58.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f022affd700 1 -- 172.21.15.72:0/1472833654 learned_addr learned my addr 172.21.15.72:0/1472833654 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:58.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f022a7fc700 1 --2- 172.21.15.72:0/1472833654 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022c133e30 0x7f022c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f022b7fe700 1 --2- 172.21.15.72:0/1472833654 >> v2:172.21.15.72:3300/0 conn(0x7f022c134260 0x7f022c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f022affd700 1 -- 172.21.15.72:0/1472833654 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022c133e30 msgr2=0x7f022c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:58.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f022affd700 1 --2- 172.21.15.72:0/1472833654 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022c133e30 0x7f022c12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f022affd700 1 -- 172.21.15.72:0/1472833654 >> v2:172.21.15.72:3300/0 conn(0x7f022c134260 msgr2=0x7f022c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:58.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f022affd700 1 --2- 172.21.15.72:0/1472833654 >> v2:172.21.15.72:3300/0 conn(0x7f022c134260 0x7f022c1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f022affd700 1 -- 172.21.15.72:0/1472833654 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c0a0030 con 0x7f022c133420 2023-10-03T10:12:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f022a7fc700 1 --2- 172.21.15.72:0/1472833654 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022c133e30 0x7f022c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:12:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.884+0000 7f022affd700 1 --2- 172.21.15.72:0/1472833654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022c133420 0x7f022c1337f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f021c0098f0 tx=0x7f021c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1fdb5e8a77048a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.885+0000 7f0229ffb700 1 -- 172.21.15.72:0/1472833654 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c011830 con 0x7f022c133420 2023-10-03T10:12:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.885+0000 7f0229ffb700 1 -- 172.21.15.72:0/1472833654 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c011990 con 0x7f022c133420 2023-10-03T10:12:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.885+0000 7f0229ffb700 1 -- 172.21.15.72:0/1472833654 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c011d20 con 0x7f022c133420 2023-10-03T10:12:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.885+0000 7f02312a1700 1 -- 172.21.15.72:0/1472833654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022c133420 msgr2=0x7f022c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.885+0000 7f02312a1700 1 --2- 172.21.15.72:0/1472833654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022c133420 0x7f022c1337f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f021c0098f0 tx=0x7f021c009c00 comp rx=0 tx=0).stop 2023-10-03T10:12:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.886+0000 7f02312a1700 1 -- 172.21.15.72:0/1472833654 shutdown_connections 2023-10-03T10:12:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.886+0000 7f02312a1700 1 --2- 172.21.15.72:0/1472833654 >> v2:172.21.15.72:3300/0 conn(0x7f022c134260 0x7f022c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.886+0000 7f02312a1700 1 --2- 172.21.15.72:0/1472833654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022c133420 0x7f022c1337f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.886+0000 7f02312a1700 1 --2- 172.21.15.72:0/1472833654 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022c133e30 0x7f022c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.886+0000 7f02312a1700 1 -- 172.21.15.72:0/1472833654 >> 172.21.15.72:0/1472833654 conn(0x7f022c0a4210 msgr2=0x7f022c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.886+0000 7f02312a1700 1 -- 172.21.15.72:0/1472833654 shutdown_connections 2023-10-03T10:12:58.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.886+0000 7f02312a1700 1 -- 172.21.15.72:0/1472833654 wait complete. 2023-10-03T10:12:58.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.887+0000 7f02312a1700 1 Processor -- start 2023-10-03T10:12:58.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.887+0000 7f02312a1700 1 -- start start 2023-10-03T10:12:58.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f02312a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022c133420 0x7f022c09c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f02312a1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c133e30 0x7f022c09c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f02312a1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022c134260 0x7f022c09cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f02312a1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c09dd30 con 0x7f022c133e30 2023-10-03T10:12:58.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f02312a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022c11fe70 con 0x7f022c133420 2023-10-03T10:12:58.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f02312a1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f022c11fb40 con 0x7f022c134260 2023-10-03T10:12:58.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f022affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022c133420 0x7f022c09c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f022affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022c133420 0x7f022c09c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39446/0 (socket says 172.21.15.72:39446) 2023-10-03T10:12:58.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f022affd700 1 -- 172.21.15.72:0/722152057 learned_addr learned my addr 172.21.15.72:0/722152057 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:58.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f022b7fe700 1 --2- 172.21.15.72:0/722152057 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022c134260 0x7f022c09cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f022a7fc700 1 --2- 172.21.15.72:0/722152057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c133e30 0x7f022c09c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f022affd700 1 -- 172.21.15.72:0/722152057 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022c134260 msgr2=0x7f022c09cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f022affd700 1 --2- 172.21.15.72:0/722152057 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022c134260 0x7f022c09cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f022affd700 1 -- 172.21.15.72:0/722152057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c133e30 msgr2=0x7f022c09c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f022affd700 1 --2- 172.21.15.72:0/722152057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c133e30 0x7f022c09c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.888+0000 7f022affd700 1 -- 172.21.15.72:0/722152057 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c009550 con 0x7f022c133420 2023-10-03T10:12:58.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.889+0000 7f022a7fc700 1 --2- 172.21.15.72:0/722152057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c133e30 0x7f022c09c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:58.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.889+0000 7f022affd700 1 --2- 172.21.15.72:0/722152057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022c133420 0x7f022c09c1f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f021c000c00 tx=0x7f021c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.889+0000 7f02137fe700 1 -- 172.21.15.72:0/722152057 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c004510 con 0x7f022c133420 2023-10-03T10:12:58.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.889+0000 7f02137fe700 1 -- 172.21.15.72:0/722152057 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c0036a0 con 0x7f022c133420 2023-10-03T10:12:58.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.889+0000 7f02137fe700 1 -- 172.21.15.72:0/722152057 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c003a50 con 0x7f022c133420 2023-10-03T10:12:58.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.889+0000 7f02312a1700 1 -- 172.21.15.72:0/722152057 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022c11f420 con 0x7f022c133420 2023-10-03T10:12:58.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.889+0000 7f02312a1700 1 -- 172.21.15.72:0/722152057 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022c120870 con 0x7f022c133420 2023-10-03T10:12:58.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.890+0000 7f02137fe700 1 -- 172.21.15.72:0/722152057 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f021c021070 con 0x7f022c133420 2023-10-03T10:12:58.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.890+0000 7f02137fe700 1 -- 172.21.15.72:0/722152057 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f021c040ec0 con 0x7f022c133420 2023-10-03T10:12:58.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.890+0000 7f022a7fc700 1 -- 172.21.15.72:0/722152057 >> v1:172.21.15.72:6816/126756 conn(0x7f021802f510 legacy=0x7f02180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:58.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.890+0000 7f02312a1700 1 -- 172.21.15.72:0/722152057 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022c09d650 con 0x7f022c133420 2023-10-03T10:12:58.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.895+0000 7f02137fe700 1 -- 172.21.15.72:0/722152057 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f021c029020 con 0x7f022c133420 2023-10-03T10:12:58.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.911+0000 7f8ba6b66700 1 Processor -- start 2023-10-03T10:12:58.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.911+0000 7f8ba6b66700 1 -- start start 2023-10-03T10:12:58.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.911+0000 7f8ba6b66700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ba01316c0 0x7f8ba0131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.911+0000 7f8ba6b66700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ba009d9f0 0x7f8ba006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.911+0000 7f8ba6b66700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ba006acb0 0x7f8ba006b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.911+0000 7f8ba6b66700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba009e130 con 0x7f8ba01316c0 2023-10-03T10:12:58.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.911+0000 7f8ba6b66700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba01312b0 con 0x7f8ba009d9f0 2023-10-03T10:12:58.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.911+0000 7f8ba6b66700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba009f6e0 con 0x7f8ba006acb0 2023-10-03T10:12:58.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.912+0000 7f8ba5103700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ba006acb0 0x7f8ba006b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.912+0000 7f8ba5103700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ba006acb0 0x7f8ba006b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38730/0 (socket says 172.21.15.72:38730) 2023-10-03T10:12:58.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.912+0000 7f8ba5103700 1 -- 172.21.15.72:0/2768468820 learned_addr learned my addr 172.21.15.72:0/2768468820 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:58.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.912+0000 7f8ba4902700 1 --2- 172.21.15.72:0/2768468820 >> v2:172.21.15.72:3300/0 conn(0x7f8ba01316c0 0x7f8ba0131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.912+0000 7f8b9ffff700 1 --2- 172.21.15.72:0/2768468820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ba009d9f0 0x7f8ba006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.912+0000 7f8ba5103700 1 -- 172.21.15.72:0/2768468820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ba009d9f0 msgr2=0x7f8ba006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:58.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.912+0000 7f8ba5103700 1 --2- 172.21.15.72:0/2768468820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ba009d9f0 0x7f8ba006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.912+0000 7f8ba5103700 1 -- 172.21.15.72:0/2768468820 >> v2:172.21.15.72:3300/0 conn(0x7f8ba01316c0 msgr2=0x7f8ba0131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:12:58.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.912+0000 7f8ba5103700 1 --2- 172.21.15.72:0/2768468820 >> v2:172.21.15.72:3300/0 conn(0x7f8ba01316c0 0x7f8ba0131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.912+0000 7f8ba5103700 1 -- 172.21.15.72:0/2768468820 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba009e760 con 0x7f8ba006acb0 2023-10-03T10:12:58.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.912+0000 7f8ba4902700 1 --2- 172.21.15.72:0/2768468820 >> v2:172.21.15.72:3300/0 conn(0x7f8ba01316c0 0x7f8ba0131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:12:58.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.912+0000 7f8ba5103700 1 --2- 172.21.15.72:0/2768468820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ba006acb0 0x7f8ba006b150 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009e50 tx=0x7f8b9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd501cc677e55861 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.912+0000 7f8b9f7fe700 1 -- 172.21.15.72:0/2768468820 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9800e070 con 0x7f8ba006acb0 2023-10-03T10:12:58.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.913+0000 7f8b9f7fe700 1 -- 172.21.15.72:0/2768468820 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9800b910 con 0x7f8ba006acb0 2023-10-03T10:12:58.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.913+0000 7f8b9f7fe700 1 -- 172.21.15.72:0/2768468820 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9800bcc0 con 0x7f8ba006acb0 2023-10-03T10:12:58.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.913+0000 7f8ba6b66700 1 -- 172.21.15.72:0/2768468820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ba006acb0 msgr2=0x7f8ba006b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.913+0000 7f8ba6b66700 1 --2- 172.21.15.72:0/2768468820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ba006acb0 0x7f8ba006b150 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009e50 tx=0x7f8b9800b330 comp rx=0 tx=0).stop 2023-10-03T10:12:58.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.913+0000 7f8ba6b66700 1 -- 172.21.15.72:0/2768468820 shutdown_connections 2023-10-03T10:12:58.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.913+0000 7f8ba6b66700 1 --2- 172.21.15.72:0/2768468820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ba006acb0 0x7f8ba006b150 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.913+0000 7f8ba6b66700 1 --2- 172.21.15.72:0/2768468820 >> v2:172.21.15.72:3300/0 conn(0x7f8ba01316c0 0x7f8ba0131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.913+0000 7f8ba6b66700 1 --2- 172.21.15.72:0/2768468820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ba009d9f0 0x7f8ba006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.913+0000 7f8ba6b66700 1 -- 172.21.15.72:0/2768468820 >> 172.21.15.72:0/2768468820 conn(0x7f8ba0066f50 msgr2=0x7f8ba009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:58.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.913+0000 7f8ba6b66700 1 -- 172.21.15.72:0/2768468820 shutdown_connections 2023-10-03T10:12:58.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.913+0000 7f8ba6b66700 1 -- 172.21.15.72:0/2768468820 wait complete. 2023-10-03T10:12:58.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.914+0000 7f8ba6b66700 1 Processor -- start 2023-10-03T10:12:58.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.914+0000 7f8ba6b66700 1 -- start start 2023-10-03T10:12:58.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.915+0000 7f8ba6b66700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ba006acb0 0x7f8ba01cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.915+0000 7f8ba6b66700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ba009d9f0 0x7f8ba01ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.915+0000 7f8ba6b66700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ba01316c0 0x7f8ba0121c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:12:58.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.915+0000 7f8ba6b66700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba0124c10 con 0x7f8ba006acb0 2023-10-03T10:12:58.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.915+0000 7f8ba6b66700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba012b900 con 0x7f8ba009d9f0 2023-10-03T10:12:58.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.915+0000 7f8ba6b66700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba0072230 con 0x7f8ba01316c0 2023-10-03T10:12:58.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.915+0000 7f8ba4902700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ba006acb0 0x7f8ba01cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.915+0000 7f8ba4902700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ba006acb0 0x7f8ba01cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42168/0 (socket says 172.21.15.72:42168) 2023-10-03T10:12:58.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.915+0000 7f8ba4902700 1 -- 172.21.15.72:0/2506006540 learned_addr learned my addr 172.21.15.72:0/2506006540 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:12:58.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.915+0000 7f8ba5103700 1 --2- 172.21.15.72:0/2506006540 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ba01316c0 0x7f8ba0121c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.915+0000 7f8b9ffff700 1 --2- 172.21.15.72:0/2506006540 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ba009d9f0 0x7f8ba01ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:12:58.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.916+0000 7f8ba5103700 1 -- 172.21.15.72:0/2506006540 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ba009d9f0 msgr2=0x7f8ba01ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.916+0000 7f8ba5103700 1 --2- 172.21.15.72:0/2506006540 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ba009d9f0 0x7f8ba01ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.916+0000 7f8ba5103700 1 -- 172.21.15.72:0/2506006540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ba006acb0 msgr2=0x7f8ba01cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:58.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.916+0000 7f8ba5103700 1 --2- 172.21.15.72:0/2506006540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ba006acb0 0x7f8ba01cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:58.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.916+0000 7f8ba5103700 1 -- 172.21.15.72:0/2506006540 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b940094a0 con 0x7f8ba01316c0 2023-10-03T10:12:58.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.916+0000 7f8ba5103700 1 --2- 172.21.15.72:0/2506006540 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ba01316c0 0x7f8ba0121c90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8b98015000 tx=0x7f8b98004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:12:58.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.916+0000 7f8b9d7fa700 1 -- 172.21.15.72:0/2506006540 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b980099b0 con 0x7f8ba01316c0 2023-10-03T10:12:58.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.916+0000 7f8b9d7fa700 1 -- 172.21.15.72:0/2506006540 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9800ce80 con 0x7f8ba01316c0 2023-10-03T10:12:58.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.916+0000 7f8ba6b66700 1 -- 172.21.15.72:0/2506006540 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b98009b30 con 0x7f8ba01316c0 2023-10-03T10:12:58.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.916+0000 7f8b9d7fa700 1 -- 172.21.15.72:0/2506006540 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98004470 con 0x7f8ba01316c0 2023-10-03T10:12:58.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.916+0000 7f8ba6b66700 1 -- 172.21.15.72:0/2506006540 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba0071720 con 0x7f8ba01316c0 2023-10-03T10:12:58.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.917+0000 7f8b9d7fa700 1 -- 172.21.15.72:0/2506006540 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8b980045d0 con 0x7f8ba01316c0 2023-10-03T10:12:58.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.918+0000 7f8b9d7fa700 1 -- 172.21.15.72:0/2506006540 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f8b98040f80 con 0x7f8ba01316c0 2023-10-03T10:12:58.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.918+0000 7f8ba4902700 1 -- 172.21.15.72:0/2506006540 >> v1:172.21.15.72:6816/126756 conn(0x7f8b8402f510 legacy=0x7f8b840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:58.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.918+0000 7f8ba6b66700 1 -- 172.21.15.72:0/2506006540 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba0123bb0 con 0x7f8ba01316c0 2023-10-03T10:12:58.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:58.922+0000 7f8b9d7fa700 1 -- 172.21.15.72:0/2506006540 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ba0123bb0 con 0x7f8ba01316c0 2023-10-03T10:12:59.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.011+0000 7f4d69d9b700 1 -- 172.21.15.72:0/3253286877 >> v1:172.21.15.72:6816/126756 conn(0x7f4d4c02f510 legacy=0x7f4d4c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:59.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.040+0000 7f0f737fe700 1 -- 172.21.15.72:0/1089599973 >> v1:172.21.15.72:6816/126756 conn(0x7f0f6002f510 legacy=0x7f0f600319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:59.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.056+0000 7f0f7a08e700 1 -- 172.21.15.72:0/1089599973 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0f740747f0 con 0x7f0f74135db0 2023-10-03T10:12:59.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.056+0000 7f0f5bfff700 1 -- 172.21.15.72:0/1089599973 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0f6c01a030 con 0x7f0f74135db0 2023-10-03T10:12:59.057 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:59.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.059+0000 7f0f7a08e700 1 -- 172.21.15.72:0/1089599973 >> v1:172.21.15.72:6816/126756 conn(0x7f0f6002f510 legacy=0x7f0f600319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:59.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.059+0000 7f0f7a08e700 1 -- 172.21.15.72:0/1089599973 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f74135db0 msgr2=0x7f0f7406f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.059+0000 7f0f7a08e700 1 --2- 172.21.15.72:0/1089599973 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f74135db0 0x7f0f7406f9c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f7406cd10 tx=0x7f0f6c00d3b0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.060+0000 7f0f7a08e700 1 -- 172.21.15.72:0/1089599973 shutdown_connections 2023-10-03T10:12:59.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.060+0000 7f0f7a08e700 1 --2- 172.21.15.72:0/1089599973 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f74135db0 0x7f0f7406f9c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.060+0000 7f0f7a08e700 1 --2- 172.21.15.72:0/1089599973 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f74130750 0x7f0f7406ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.060+0000 7f0f7a08e700 1 --2- 172.21.15.72:0/1089599973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f74133490 0x7f0f7406f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.060+0000 7f0f7a08e700 1 -- 172.21.15.72:0/1089599973 >> 172.21.15.72:0/1089599973 conn(0x7f0f7409f470 msgr2=0x7f0f740a0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.060+0000 7f0f7a08e700 1 -- 172.21.15.72:0/1089599973 shutdown_connections 2023-10-03T10:12:59.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.060+0000 7f0f7a08e700 1 -- 172.21.15.72:0/1089599973 wait complete. 2023-10-03T10:12:59.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.063+0000 7f4d70d76700 1 -- 172.21.15.72:0/3253286877 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4d6c06c360 con 0x7f4d6c09d6f0 2023-10-03T10:12:59.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.063+0000 7f4d5affd700 1 -- 172.21.15.72:0/3253286877 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d5c003cf0 con 0x7f4d6c09d6f0 2023-10-03T10:12:59.064 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:12:59.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.065+0000 7f4d70d76700 1 -- 172.21.15.72:0/3253286877 >> v1:172.21.15.72:6816/126756 conn(0x7f4d4c02f510 legacy=0x7f4d4c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:59.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.065+0000 7f4d70d76700 1 -- 172.21.15.72:0/3253286877 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d6c09d6f0 msgr2=0x7f4d6c139940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.065+0000 7f4d70d76700 1 --2- 172.21.15.72:0/3253286877 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d6c09d6f0 0x7f4d6c139940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c09ea70 tx=0x7f4d5c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:59.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.066+0000 7f4d70d76700 1 -- 172.21.15.72:0/3253286877 shutdown_connections 2023-10-03T10:12:59.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.066+0000 7f4d70d76700 1 --2- 172.21.15.72:0/3253286877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c09e410 0x7f4d6c13a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.066+0000 7f4d70d76700 1 --2- 172.21.15.72:0/3253286877 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d6c09d6f0 0x7f4d6c139940 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.066+0000 7f4d70d76700 1 --2- 172.21.15.72:0/3253286877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d6c09e000 0x7f4d6c139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.066+0000 7f4d70d76700 1 -- 172.21.15.72:0/3253286877 >> 172.21.15.72:0/3253286877 conn(0x7f4d6c066f50 msgr2=0x7f4d6c070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.066+0000 7f4d70d76700 1 -- 172.21.15.72:0/3253286877 shutdown_connections 2023-10-03T10:12:59.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.066+0000 7f4d70d76700 1 -- 172.21.15.72:0/3253286877 wait complete. 2023-10-03T10:12:59.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:12:59.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:12:59.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.091+0000 7f022a7fc700 1 -- 172.21.15.72:0/722152057 >> v1:172.21.15.72:6816/126756 conn(0x7f021802f510 legacy=0x7f02180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:59.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.095+0000 7f02312a1700 1 -- 172.21.15.72:0/722152057 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f022c11f870 con 0x7f022c133420 2023-10-03T10:12:59.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.095+0000 7f02137fe700 1 -- 172.21.15.72:0/722152057 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f021c032070 con 0x7f022c133420 2023-10-03T10:12:59.096 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:12:59.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.097+0000 7f02312a1700 1 -- 172.21.15.72:0/722152057 >> v1:172.21.15.72:6816/126756 conn(0x7f021802f510 legacy=0x7f02180319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:59.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.097+0000 7f02312a1700 1 -- 172.21.15.72:0/722152057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022c133420 msgr2=0x7f022c09c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.097+0000 7f02312a1700 1 --2- 172.21.15.72:0/722152057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022c133420 0x7f022c09c1f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f021c000c00 tx=0x7f021c004750 comp rx=0 tx=0).stop 2023-10-03T10:12:59.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.097+0000 7f02312a1700 1 -- 172.21.15.72:0/722152057 shutdown_connections 2023-10-03T10:12:59.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.097+0000 7f02312a1700 1 --2- 172.21.15.72:0/722152057 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022c134260 0x7f022c09cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.097+0000 7f02312a1700 1 --2- 172.21.15.72:0/722152057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022c133420 0x7f022c09c1f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.097+0000 7f02312a1700 1 --2- 172.21.15.72:0/722152057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c133e30 0x7f022c09c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.097+0000 7f02312a1700 1 -- 172.21.15.72:0/722152057 >> 172.21.15.72:0/722152057 conn(0x7f022c0a4210 msgr2=0x7f022c1302c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.097+0000 7f02312a1700 1 -- 172.21.15.72:0/722152057 shutdown_connections 2023-10-03T10:12:59.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.097+0000 7f02312a1700 1 -- 172.21.15.72:0/722152057 wait complete. 2023-10-03T10:12:59.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:12:59.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.119+0000 7f8ba4902700 1 -- 172.21.15.72:0/2506006540 >> v1:172.21.15.72:6816/126756 conn(0x7f8b8402f510 legacy=0x7f8b840319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:12:59.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.134+0000 7f8ba6b66700 1 -- 172.21.15.72:0/2506006540 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8ba0123bb0 con 0x7f8ba01316c0 2023-10-03T10:12:59.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.134+0000 7f8b9d7fa700 1 -- 172.21.15.72:0/2506006540 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8ba0123bb0 con 0x7f8ba01316c0 2023-10-03T10:12:59.135 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:12:59.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.137+0000 7f8ba6b66700 1 -- 172.21.15.72:0/2506006540 >> v1:172.21.15.72:6816/126756 conn(0x7f8b8402f510 legacy=0x7f8b840319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:12:59.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.137+0000 7f8ba6b66700 1 -- 172.21.15.72:0/2506006540 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ba01316c0 msgr2=0x7f8ba0121c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:12:59.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.137+0000 7f8ba6b66700 1 --2- 172.21.15.72:0/2506006540 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ba01316c0 0x7f8ba0121c90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8b98015000 tx=0x7f8b98004ad0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.137+0000 7f8ba6b66700 1 -- 172.21.15.72:0/2506006540 shutdown_connections 2023-10-03T10:12:59.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.137+0000 7f8ba6b66700 1 --2- 172.21.15.72:0/2506006540 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ba006acb0 0x7f8ba01cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.137+0000 7f8ba6b66700 1 --2- 172.21.15.72:0/2506006540 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ba01316c0 0x7f8ba0121c90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.137+0000 7f8ba6b66700 1 --2- 172.21.15.72:0/2506006540 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ba009d9f0 0x7f8ba01ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:12:59.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.137+0000 7f8ba6b66700 1 -- 172.21.15.72:0/2506006540 >> 172.21.15.72:0/2506006540 conn(0x7f8ba0066f50 msgr2=0x7f8ba009bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:12:59.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.137+0000 7f8ba6b66700 1 -- 172.21.15.72:0/2506006540 shutdown_connections 2023-10-03T10:12:59.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:12:59.137+0000 7f8ba6b66700 1 -- 172.21.15.72:0/2506006540 wait complete. 2023-10-03T10:12:59.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:00.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:00.082 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:00.111 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:00.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:00.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.223+0000 7fc13e6bb700 1 Processor -- start 2023-10-03T10:13:00.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.223+0000 7fc13e6bb700 1 -- start start 2023-10-03T10:13:00.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc13e6bb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc13809e930 0x7fc13809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc13e6bb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc13809f240 0x7fc1381317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc13e6bb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc13809f650 0x7fc138131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc13e6bb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc138070940 con 0x7fc13809e930 2023-10-03T10:13:00.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc13e6bb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13806fd60 con 0x7fc13809f240 2023-10-03T10:13:00.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc13e6bb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc13806fa80 con 0x7fc13809f650 2023-10-03T10:13:00.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc1377fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc13809f240 0x7fc1381317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc137fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc13809e930 0x7fc13809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc1377fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc13809f240 0x7fc1381317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39480/0 (socket says 172.21.15.72:39480) 2023-10-03T10:13:00.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc1377fe700 1 -- 172.21.15.72:0/2901593352 learned_addr learned my addr 172.21.15.72:0/2901593352 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:00.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc13cc58700 1 --2- 172.21.15.72:0/2901593352 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc13809f650 0x7fc138131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc05c87f700 1 Processor -- start 2023-10-03T10:13:00.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc137fff700 1 -- 172.21.15.72:0/2901593352 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc13809f650 msgr2=0x7fc138131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc137fff700 1 --2- 172.21.15.72:0/2901593352 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc13809f650 0x7fc138131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc137fff700 1 -- 172.21.15.72:0/2901593352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc13809f240 msgr2=0x7fc1381317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc137fff700 1 --2- 172.21.15.72:0/2901593352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc13809f240 0x7fc1381317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc137fff700 1 -- 172.21.15.72:0/2901593352 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13809fb60 con 0x7fc13809e930 2023-10-03T10:13:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.224+0000 7fc05c87f700 1 -- start start 2023-10-03T10:13:00.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.225+0000 7fc137fff700 1 --2- 172.21.15.72:0/2901593352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc13809e930 0x7fc13809ed00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc128009840 tx=0x7fc128009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c1bba84b08d9d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.225+0000 7fc136ffd700 1 -- 172.21.15.72:0/2901593352 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc128014e90 con 0x7fc13809e930 2023-10-03T10:13:00.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.225+0000 7fc136ffd700 1 -- 172.21.15.72:0/2901593352 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12801c440 con 0x7fc13809e930 2023-10-03T10:13:00.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.225+0000 7fc136ffd700 1 -- 172.21.15.72:0/2901593352 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12801c7d0 con 0x7fc13809e930 2023-10-03T10:13:00.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.225+0000 7fc05c87f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc05806f5d0 0x7fc05812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.225+0000 7fc05c87f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc058135c20 0x7fc058138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.225+0000 7fc05c87f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05806fa40 con 0x7fc05812cf60 2023-10-03T10:13:00.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.225+0000 7fc05c87f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05812cd90 con 0x7fc05806f5d0 2023-10-03T10:13:00.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.225+0000 7fc05c87f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc058071780 con 0x7fc058135c20 2023-10-03T10:13:00.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.225+0000 7fc05659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc05812cf60 0x7fc05812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57268/0 (socket says 172.21.15.72:57268) 2023-10-03T10:13:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.225+0000 7fc05659c700 1 -- 172.21.15.72:0/1135291166 learned_addr learned my addr 172.21.15.72:0/1135291166 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.225+0000 7fc056d9d700 1 --2- 172.21.15.72:0/1135291166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc058135c20 0x7fc058138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.225+0000 7fc055d9b700 1 --2- 172.21.15.72:0/1135291166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc05806f5d0 0x7fc05812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc05559a700 1 -- 172.21.15.72:0/1135291166 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586789629 0 0) 0x7fc05806fa40 con 0x7fc05812cf60 2023-10-03T10:13:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc05559a700 1 -- 172.21.15.72:0/1135291166 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0400035b0 con 0x7fc05812cf60 2023-10-03T10:13:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc13e6bb700 1 -- 172.21.15.72:0/2901593352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc13809e930 msgr2=0x7fc13809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc13e6bb700 1 --2- 172.21.15.72:0/2901593352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc13809e930 0x7fc13809ed00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc128009840 tx=0x7fc128009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc056d9d700 1 -- 172.21.15.72:0/1135291166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc05806f5d0 msgr2=0x7fc05812ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc056d9d700 1 --2- 172.21.15.72:0/1135291166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc05806f5d0 0x7fc05812ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc056d9d700 1 -- 172.21.15.72:0/1135291166 >> v1:172.21.15.72:6789/0 conn(0x7fc05812cf60 legacy=0x7fc05812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc056d9d700 1 -- 172.21.15.72:0/1135291166 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc058071a40 con 0x7fc058135c20 2023-10-03T10:13:00.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc056d9d700 1 --2- 172.21.15.72:0/1135291166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc058135c20 0x7fc058138000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc0480098a0 tx=0x7fc048009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c701fc2f8aa45c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc13e6bb700 1 -- 172.21.15.72:0/2901593352 shutdown_connections 2023-10-03T10:13:00.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc13e6bb700 1 --2- 172.21.15.72:0/2901593352 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc13809f650 0x7fc138131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc13e6bb700 1 --2- 172.21.15.72:0/2901593352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc13809e930 0x7fc13809ed00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc13e6bb700 1 --2- 172.21.15.72:0/2901593352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc13809f240 0x7fc1381317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc13e6bb700 1 -- 172.21.15.72:0/2901593352 >> 172.21.15.72:0/2901593352 conn(0x7fc1380a4210 msgr2=0x7fc1380a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc05559a700 1 -- 172.21.15.72:0/1135291166 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04800f940 con 0x7fc058135c20 2023-10-03T10:13:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc05559a700 1 -- 172.21.15.72:0/1135291166 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04800faa0 con 0x7fc058135c20 2023-10-03T10:13:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc05559a700 1 -- 172.21.15.72:0/1135291166 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04800fe30 con 0x7fc058135c20 2023-10-03T10:13:00.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc13e6bb700 1 -- 172.21.15.72:0/2901593352 shutdown_connections 2023-10-03T10:13:00.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.226+0000 7fc13e6bb700 1 -- 172.21.15.72:0/2901593352 wait complete. 2023-10-03T10:13:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.227+0000 7fc05c87f700 1 -- 172.21.15.72:0/1135291166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc058135c20 msgr2=0x7fc058138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.227+0000 7fc05c87f700 1 --2- 172.21.15.72:0/1135291166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc058135c20 0x7fc058138000 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc0480098a0 tx=0x7fc048009bb0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.227+0000 7fc05c87f700 1 -- 172.21.15.72:0/1135291166 shutdown_connections 2023-10-03T10:13:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.227+0000 7fc05c87f700 1 --2- 172.21.15.72:0/1135291166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc058135c20 0x7fc058138000 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.227+0000 7fc05c87f700 1 --2- 172.21.15.72:0/1135291166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc05806f5d0 0x7fc05812ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.227+0000 7fc05c87f700 1 -- 172.21.15.72:0/1135291166 >> 172.21.15.72:0/1135291166 conn(0x7fc0580a2aa0 msgr2=0x7fc0580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.227+0000 7fc13e6bb700 1 Processor -- start 2023-10-03T10:13:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.227+0000 7fc05c87f700 1 -- 172.21.15.72:0/1135291166 shutdown_connections 2023-10-03T10:13:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.227+0000 7fc05c87f700 1 -- 172.21.15.72:0/1135291166 wait complete. 2023-10-03T10:13:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.228+0000 7fc05c87f700 1 Processor -- start 2023-10-03T10:13:00.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.228+0000 7fc05c87f700 1 -- start start 2023-10-03T10:13:00.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.228+0000 7fc13e6bb700 1 -- start start 2023-10-03T10:13:00.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.228+0000 7fc13e6bb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc13809e930 0x7fc13811d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.228+0000 7fc13e6bb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc13809f240 0x7fc13811d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.228+0000 7fc13e6bb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc13809f650 0x7fc13811dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.228+0000 7fc13e6bb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc138120d20 con 0x7fc13809f650 2023-10-03T10:13:00.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.228+0000 7fc13e6bb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc138071d90 con 0x7fc13809f240 2023-10-03T10:13:00.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.228+0000 7fc13e6bb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1380a2f40 con 0x7fc13809e930 2023-10-03T10:13:00.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.228+0000 7fc05c87f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc05806f5d0 0x7fc05809e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc05c87f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc05812cf60 0x7fc058099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc05c87f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc058135c20 0x7fc05809a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc05c87f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0580a1500 con 0x7fc058135c20 2023-10-03T10:13:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc05c87f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc058135240 con 0x7fc05812cf60 2023-10-03T10:13:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc05c87f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc058129fa0 con 0x7fc05806f5d0 2023-10-03T10:13:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc055d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc05812cf60 0x7fc058099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc13cc58700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc13809f650 0x7fc13811dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc13cc58700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc13809f650 0x7fc13811dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42186/0 (socket says 172.21.15.72:42186) 2023-10-03T10:13:00.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc13cc58700 1 -- 172.21.15.72:0/2623693721 learned_addr learned my addr 172.21.15.72:0/2623693721 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:00.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc055d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc05812cf60 0x7fc058099d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39506/0 (socket says 172.21.15.72:39506) 2023-10-03T10:13:00.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc055d9b700 1 -- 172.21.15.72:0/1558472475 learned_addr learned my addr 172.21.15.72:0/1558472475 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:00.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc1377fe700 1 --2- 172.21.15.72:0/2623693721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc13809f240 0x7fc13811d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc056d9d700 1 --2- 172.21.15.72:0/1558472475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc058135c20 0x7fc05809a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc05659c700 1 --2- 172.21.15.72:0/1558472475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc05806f5d0 0x7fc05809e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc13cc58700 1 -- 172.21.15.72:0/2623693721 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc13809e930 msgr2=0x7fc13811d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc13cc58700 1 --2- 172.21.15.72:0/2623693721 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc13809e930 0x7fc13811d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc13cc58700 1 -- 172.21.15.72:0/2623693721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc13809f240 msgr2=0x7fc13811d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc13cc58700 1 --2- 172.21.15.72:0/2623693721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc13809f240 0x7fc13811d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc13cc58700 1 -- 172.21.15.72:0/2623693721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1280094a0 con 0x7fc13809f650 2023-10-03T10:13:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc055d9b700 1 -- 172.21.15.72:0/1558472475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc05806f5d0 msgr2=0x7fc05809e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc055d9b700 1 --2- 172.21.15.72:0/1558472475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc05806f5d0 0x7fc05809e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc055d9b700 1 -- 172.21.15.72:0/1558472475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc058135c20 msgr2=0x7fc05809a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc055d9b700 1 --2- 172.21.15.72:0/1558472475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc058135c20 0x7fc05809a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc055d9b700 1 -- 172.21.15.72:0/1558472475 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0480094a0 con 0x7fc05812cf60 2023-10-03T10:13:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.229+0000 7fc13cc58700 1 --2- 172.21.15.72:0/2623693721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc13809f650 0x7fc13811dd10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc13000d350 tx=0x7fc13000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.230+0000 7fc05659c700 1 --2- 172.21.15.72:0/1558472475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc05806f5d0 0x7fc05809e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:00.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.230+0000 7fc055d9b700 1 --2- 172.21.15.72:0/1558472475 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc05812cf60 0x7fc058099d50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc050009db0 tx=0x7fc05000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.230+0000 7fc134ff9700 1 -- 172.21.15.72:0/2623693721 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13001a680 con 0x7fc13809f650 2023-10-03T10:13:00.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.230+0000 7fc134ff9700 1 -- 172.21.15.72:0/2623693721 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc130013070 con 0x7fc13809f650 2023-10-03T10:13:00.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.230+0000 7fc13e6bb700 1 -- 172.21.15.72:0/2623693721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1380a0190 con 0x7fc13809f650 2023-10-03T10:13:00.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.230+0000 7fc134ff9700 1 -- 172.21.15.72:0/2623693721 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13001aa60 con 0x7fc13809f650 2023-10-03T10:13:00.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.230+0000 7fc13e6bb700 1 -- 172.21.15.72:0/2623693721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc138120780 con 0x7fc13809f650 2023-10-03T10:13:00.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.230+0000 7fc134ff9700 1 -- 172.21.15.72:0/2623693721 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc1300233f0 con 0x7fc13809f650 2023-10-03T10:13:00.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.231+0000 7fc134ff9700 1 -- 172.21.15.72:0/2623693721 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc130015070 con 0x7fc13809f650 2023-10-03T10:13:00.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.231+0000 7fc137fff700 1 -- 172.21.15.72:0/2623693721 >> v1:172.21.15.72:6816/126756 conn(0x7fc12402f560 legacy=0x7fc124031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:13:00.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.231+0000 7fc046ffd700 1 -- 172.21.15.72:0/1558472475 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050009c20 con 0x7fc05812cf60 2023-10-03T10:13:00.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.231+0000 7fc046ffd700 1 -- 172.21.15.72:0/1558472475 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05000f040 con 0x7fc05812cf60 2023-10-03T10:13:00.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.231+0000 7fc05c87f700 1 -- 172.21.15.72:0/1558472475 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0581356b0 con 0x7fc05812cf60 2023-10-03T10:13:00.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.231+0000 7fc13e6bb700 1 -- 172.21.15.72:0/2623693721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc138074ea0 con 0x7fc13809f650 2023-10-03T10:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.231+0000 7fc046ffd700 1 -- 172.21.15.72:0/1558472475 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050014480 con 0x7fc05812cf60 2023-10-03T10:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.231+0000 7fc05c87f700 1 -- 172.21.15.72:0/1558472475 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0581347a0 con 0x7fc05812cf60 2023-10-03T10:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.232+0000 7fc046ffd700 1 -- 172.21.15.72:0/1558472475 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc0500145e0 con 0x7fc05812cf60 2023-10-03T10:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.232+0000 7fc05659c700 1 -- 172.21.15.72:0/1558472475 >> v1:172.21.15.72:6816/126756 conn(0x7fc03802f510 legacy=0x7fc0380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.232+0000 7fc046ffd700 1 -- 172.21.15.72:0/1558472475 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc050040600 con 0x7fc05812cf60 2023-10-03T10:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.232+0000 7fc05c87f700 1 -- 172.21.15.72:0/1558472475 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc058074ea0 con 0x7fc05812cf60 2023-10-03T10:13:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.236+0000 7fc134ff9700 1 -- 172.21.15.72:0/2623693721 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1300223a0 con 0x7fc13809f650 2023-10-03T10:13:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.238+0000 7fc046ffd700 1 -- 172.21.15.72:0/1558472475 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc050040030 con 0x7fc05812cf60 2023-10-03T10:13:00.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.261+0000 7fdd285fc700 1 Processor -- start 2023-10-03T10:13:00.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.261+0000 7fdd285fc700 1 -- start start 2023-10-03T10:13:00.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.261+0000 7fdd285fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd2006e570 0x7fdd2006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.261+0000 7fdd285fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd2009eca0 0x7fdd2006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.261+0000 7fdd285fc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd20070ee0 con 0x7fdd20134610 2023-10-03T10:13:00.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.261+0000 7fdd285fc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd20071480 con 0x7fdd2009eca0 2023-10-03T10:13:00.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.261+0000 7fdd285fc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2006f3c0 con 0x7fdd2006e570 2023-10-03T10:13:00.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.262+0000 7fdd25b97700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd2009eca0 0x7fdd2006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.262+0000 7fdd25b97700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd2009eca0 0x7fdd2006ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39522/0 (socket says 172.21.15.72:39522) 2023-10-03T10:13:00.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.262+0000 7fdd25b97700 1 -- 172.21.15.72:0/279345841 learned_addr learned my addr 172.21.15.72:0/279345841 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:00.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.262+0000 7fdd26398700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd2006e570 0x7fdd2006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.262+0000 7fdd25b97700 1 -- 172.21.15.72:0/279345841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd2006e570 msgr2=0x7fdd2006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.262+0000 7fdd25b97700 1 --2- 172.21.15.72:0/279345841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd2006e570 0x7fdd2006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.262+0000 7fdd25b97700 1 -- 172.21.15.72:0/279345841 >> v1:172.21.15.72:6789/0 conn(0x7fdd20134610 legacy=0x7fdd20134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.262+0000 7fdd25b97700 1 -- 172.21.15.72:0/279345841 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd20071b90 con 0x7fdd2009eca0 2023-10-03T10:13:00.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.262+0000 7fdd25b97700 1 --2- 172.21.15.72:0/279345841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd2009eca0 0x7fdd2006ee80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdd10009920 tx=0x7fdd10009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8074c96264d1aba2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.262+0000 7fdd25396700 1 -- 172.21.15.72:0/279345841 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10011830 con 0x7fdd2009eca0 2023-10-03T10:13:00.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.262+0000 7fdd25396700 1 -- 172.21.15.72:0/279345841 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd10011990 con 0x7fdd2009eca0 2023-10-03T10:13:00.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.262+0000 7fdd25396700 1 -- 172.21.15.72:0/279345841 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10011d20 con 0x7fdd2009eca0 2023-10-03T10:13:00.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.263+0000 7fdd285fc700 1 -- 172.21.15.72:0/279345841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd2009eca0 msgr2=0x7fdd2006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.263+0000 7fdd285fc700 1 --2- 172.21.15.72:0/279345841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd2009eca0 0x7fdd2006ee80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdd10009920 tx=0x7fdd10009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:00.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.263+0000 7fdd285fc700 1 -- 172.21.15.72:0/279345841 shutdown_connections 2023-10-03T10:13:00.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.263+0000 7fdd285fc700 1 --2- 172.21.15.72:0/279345841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd2006e570 0x7fdd2006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.263+0000 7fdd285fc700 1 --2- 172.21.15.72:0/279345841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd2009eca0 0x7fdd2006ee80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.263+0000 7fdd285fc700 1 -- 172.21.15.72:0/279345841 >> 172.21.15.72:0/279345841 conn(0x7fdd200a2aa0 msgr2=0x7fdd200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.263+0000 7fdd285fc700 1 -- 172.21.15.72:0/279345841 shutdown_connections 2023-10-03T10:13:00.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.263+0000 7fdd285fc700 1 -- 172.21.15.72:0/279345841 wait complete. 2023-10-03T10:13:00.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.265+0000 7fdd285fc700 1 Processor -- start 2023-10-03T10:13:00.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.265+0000 7fdd285fc700 1 -- start start 2023-10-03T10:13:00.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.265+0000 7fdd285fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd2006e570 0x7fdd2013eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.265+0000 7fdd285fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd20134610 0x7fdd2013f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.265+0000 7fdd285fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd2013f970 0x7fdd20132e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.265+0000 7fdd285fc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd201402f0 con 0x7fdd2013f970 2023-10-03T10:13:00.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.265+0000 7fdd285fc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd20070610 con 0x7fdd20134610 2023-10-03T10:13:00.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.265+0000 7fdd285fc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2013da00 con 0x7fdd2006e570 2023-10-03T10:13:00.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd25b97700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd20134610 0x7fdd2013f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd25b97700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd20134610 0x7fdd2013f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39530/0 (socket says 172.21.15.72:39530) 2023-10-03T10:13:00.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd25b97700 1 -- 172.21.15.72:0/1463374554 learned_addr learned my addr 172.21.15.72:0/1463374554 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd26398700 1 --2- 172.21.15.72:0/1463374554 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd2006e570 0x7fdd2013eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd26b99700 1 --2- 172.21.15.72:0/1463374554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd2013f970 0x7fdd20132e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd25b97700 1 -- 172.21.15.72:0/1463374554 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd2006e570 msgr2=0x7fdd2013eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd25b97700 1 --2- 172.21.15.72:0/1463374554 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd2006e570 0x7fdd2013eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd25b97700 1 -- 172.21.15.72:0/1463374554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd2013f970 msgr2=0x7fdd20132e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd25b97700 1 --2- 172.21.15.72:0/1463374554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd2013f970 0x7fdd20132e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd25b97700 1 -- 172.21.15.72:0/1463374554 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd10009550 con 0x7fdd20134610 2023-10-03T10:13:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd25b97700 1 --2- 172.21.15.72:0/1463374554 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd20134610 0x7fdd2013f430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdd10000c00 tx=0x7fdd10004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd16ffd700 1 -- 172.21.15.72:0/1463374554 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10004450 con 0x7fdd20134610 2023-10-03T10:13:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd16ffd700 1 -- 172.21.15.72:0/1463374554 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd100045b0 con 0x7fdd20134610 2023-10-03T10:13:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd16ffd700 1 -- 172.21.15.72:0/1463374554 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd100038a0 con 0x7fdd20134610 2023-10-03T10:13:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd285fc700 1 -- 172.21.15.72:0/1463374554 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2013dd70 con 0x7fdd20134610 2023-10-03T10:13:00.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.266+0000 7fdd285fc700 1 -- 172.21.15.72:0/1463374554 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2013e310 con 0x7fdd20134610 2023-10-03T10:13:00.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.267+0000 7fdd16ffd700 1 -- 172.21.15.72:0/1463374554 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fdd10003a00 con 0x7fdd20134610 2023-10-03T10:13:00.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.268+0000 7fdd285fc700 1 -- 172.21.15.72:0/1463374554 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd20074ea0 con 0x7fdd20134610 2023-10-03T10:13:00.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.268+0000 7fdd26398700 1 -- 172.21.15.72:0/1463374554 >> v1:172.21.15.72:6816/126756 conn(0x7fdd0402f510 legacy=0x7fdd040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:13:00.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.268+0000 7fdd16ffd700 1 -- 172.21.15.72:0/1463374554 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fdd10021030 con 0x7fdd20134610 2023-10-03T10:13:00.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.277+0000 7fdd16ffd700 1 -- 172.21.15.72:0/1463374554 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd10046060 con 0x7fdd20134610 2023-10-03T10:13:00.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.318+0000 7fb1b3335700 1 Processor -- start 2023-10-03T10:13:00.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.318+0000 7fb1b3335700 1 -- start start 2023-10-03T10:13:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.319+0000 7fb1b3335700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1ac0a0a30 0x7fb1ac0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.319+0000 7fb1b3335700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb1ac09d630 0x7fb1ac0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.319+0000 7fb1b3335700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac0a2a70 con 0x7fb1ac133930 2023-10-03T10:13:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.319+0000 7fb1b3335700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac0a01d0 con 0x7fb1ac09d630 2023-10-03T10:13:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.319+0000 7fb1b3335700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac09e2b0 con 0x7fb1ac0a0a30 2023-10-03T10:13:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.319+0000 7fb1b10d1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1ac0a0a30 0x7fb1ac0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.319+0000 7fb1b18d2700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb1ac133930 0x7fb1ac133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57288/0 (socket says 172.21.15.72:57288) 2023-10-03T10:13:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.319+0000 7fb1b18d2700 1 -- 172.21.15.72:0/742509318 learned_addr learned my addr 172.21.15.72:0/742509318 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:00.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.319+0000 7fb1b10d1700 1 --2- 172.21.15.72:0/742509318 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1ac0a0a30 0x7fb1ac0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38802/0 (socket says 172.21.15.72:38802) 2023-10-03T10:13:00.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.319+0000 7fb1b08d0700 1 --2- 172.21.15.72:0/742509318 >> v2:172.21.15.72:3300/0 conn(0x7fb1ac09d630 0x7fb1ac0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.320+0000 7fb1b08d0700 1 -- 172.21.15.72:0/742509318 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1ac0a0a30 msgr2=0x7fb1ac0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:00.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.320+0000 7fb1b08d0700 1 --2- 172.21.15.72:0/742509318 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1ac0a0a30 0x7fb1ac0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.320+0000 7fb1b08d0700 1 -- 172.21.15.72:0/742509318 >> v1:172.21.15.72:6789/0 conn(0x7fb1ac133930 legacy=0x7fb1ac133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.320+0000 7fb1b08d0700 1 -- 172.21.15.72:0/742509318 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac09dc50 con 0x7fb1ac09d630 2023-10-03T10:13:00.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.320+0000 7fb1a3fff700 1 -- 172.21.15.72:0/742509318 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661580430 0 0) 0x7fb1ac0a2a70 con 0x7fb1ac133930 2023-10-03T10:13:00.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.320+0000 7fb1b08d0700 1 --2- 172.21.15.72:0/742509318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1ac09d630 0x7fb1ac0a1340 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009840 tx=0x7fb19c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a70ebdc0d78cd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.320+0000 7fb1a3fff700 1 -- 172.21.15.72:0/742509318 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c011830 con 0x7fb1ac09d630 2023-10-03T10:13:00.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.320+0000 7fb1a3fff700 1 -- 172.21.15.72:0/742509318 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c011990 con 0x7fb1ac09d630 2023-10-03T10:13:00.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.320+0000 7fb1a3fff700 1 -- 172.21.15.72:0/742509318 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c011d20 con 0x7fb1ac09d630 2023-10-03T10:13:00.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.321+0000 7fb1b3335700 1 -- 172.21.15.72:0/742509318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1ac09d630 msgr2=0x7fb1ac0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.321+0000 7fb1b3335700 1 --2- 172.21.15.72:0/742509318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1ac09d630 0x7fb1ac0a1340 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009840 tx=0x7fb19c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.321+0000 7fb1b3335700 1 -- 172.21.15.72:0/742509318 shutdown_connections 2023-10-03T10:13:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.321+0000 7fb1b3335700 1 --2- 172.21.15.72:0/742509318 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1ac0a0a30 0x7fb1ac0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.321+0000 7fb1b3335700 1 --2- 172.21.15.72:0/742509318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1ac09d630 0x7fb1ac0a1340 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.321+0000 7fb1b3335700 1 -- 172.21.15.72:0/742509318 >> 172.21.15.72:0/742509318 conn(0x7fb1ac0a3050 msgr2=0x7fb1ac0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.321+0000 7fb1b3335700 1 -- 172.21.15.72:0/742509318 shutdown_connections 2023-10-03T10:13:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.321+0000 7fb1b3335700 1 -- 172.21.15.72:0/742509318 wait complete. 2023-10-03T10:13:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.322+0000 7fb1b3335700 1 Processor -- start 2023-10-03T10:13:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.322+0000 7fb1b3335700 1 -- start start 2023-10-03T10:13:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.323+0000 7fb1b3335700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1ac09d630 0x7fb1ac07ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.323+0000 7fb1b3335700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1ac0a0a30 0x7fb1ac07ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.323+0000 7fb1b3335700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1ac133930 0x7fb1ac07f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.323+0000 7fb1b3335700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac082330 con 0x7fb1ac0a0a30 2023-10-03T10:13:00.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.323+0000 7fb1b3335700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac081420 con 0x7fb1ac09d630 2023-10-03T10:13:00.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.323+0000 7fb1b3335700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac089e40 con 0x7fb1ac133930 2023-10-03T10:13:00.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.323+0000 7fb1b10d1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1ac09d630 0x7fb1ac07ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.323+0000 7fb1b18d2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1ac133930 0x7fb1ac07f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.323+0000 7fb1b10d1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1ac09d630 0x7fb1ac07ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39534/0 (socket says 172.21.15.72:39534) 2023-10-03T10:13:00.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.323+0000 7fb1b10d1700 1 -- 172.21.15.72:0/4137282838 learned_addr learned my addr 172.21.15.72:0/4137282838 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:00.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.323+0000 7fb1b08d0700 1 --2- 172.21.15.72:0/4137282838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1ac0a0a30 0x7fb1ac07ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:00.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.323+0000 7fb1b08d0700 1 -- 172.21.15.72:0/4137282838 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1ac133930 msgr2=0x7fb1ac07f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.324+0000 7fb1b08d0700 1 --2- 172.21.15.72:0/4137282838 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1ac133930 0x7fb1ac07f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.324+0000 7fb1b08d0700 1 -- 172.21.15.72:0/4137282838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1ac09d630 msgr2=0x7fb1ac07ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.324+0000 7fb1b08d0700 1 --2- 172.21.15.72:0/4137282838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1ac09d630 0x7fb1ac07ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.324+0000 7fb1b08d0700 1 -- 172.21.15.72:0/4137282838 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c0094a0 con 0x7fb1ac0a0a30 2023-10-03T10:13:00.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.324+0000 7fb1b08d0700 1 --2- 172.21.15.72:0/4137282838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1ac0a0a30 0x7fb1ac07ef50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb19c016000 tx=0x7fb19c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:00.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.324+0000 7fb1a1ffb700 1 -- 172.21.15.72:0/4137282838 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c0036a0 con 0x7fb1ac0a0a30 2023-10-03T10:13:00.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.324+0000 7fb1a1ffb700 1 -- 172.21.15.72:0/4137282838 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c01f070 con 0x7fb1ac0a0a30 2023-10-03T10:13:00.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.324+0000 7fb1b3335700 1 -- 172.21.15.72:0/4137282838 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac0a4350 con 0x7fb1ac0a0a30 2023-10-03T10:13:00.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.324+0000 7fb1a1ffb700 1 -- 172.21.15.72:0/4137282838 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c003a40 con 0x7fb1ac0a0a30 2023-10-03T10:13:00.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.324+0000 7fb1b3335700 1 -- 172.21.15.72:0/4137282838 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac082a30 con 0x7fb1ac0a0a30 2023-10-03T10:13:00.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.325+0000 7fb1a1ffb700 1 -- 172.21.15.72:0/4137282838 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb19c003ba0 con 0x7fb1ac0a0a30 2023-10-03T10:13:00.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.325+0000 7fb1a1ffb700 1 -- 172.21.15.72:0/4137282838 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fb19c021070 con 0x7fb1ac0a0a30 2023-10-03T10:13:00.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.325+0000 7fb1b10d1700 1 -- 172.21.15.72:0/4137282838 >> v1:172.21.15.72:6816/126756 conn(0x7fb19002f510 legacy=0x7fb1900319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:13:00.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.325+0000 7fb1b3335700 1 -- 172.21.15.72:0/4137282838 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ac07b760 con 0x7fb1ac0a0a30 2023-10-03T10:13:00.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.334+0000 7fb1a1ffb700 1 -- 172.21.15.72:0/4137282838 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb19c02b080 con 0x7fb1ac0a0a30 2023-10-03T10:13:00.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.432+0000 7fc137fff700 1 -- 172.21.15.72:0/2623693721 >> v1:172.21.15.72:6816/126756 conn(0x7fc12402f560 legacy=0x7fc124031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:13:00.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.433+0000 7fc05659c700 1 -- 172.21.15.72:0/1558472475 >> v1:172.21.15.72:6816/126756 conn(0x7fc03802f510 legacy=0x7fc0380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:13:00.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.447+0000 7fc05c87f700 1 -- 172.21.15.72:0/1558472475 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc058135a00 con 0x7fc05812cf60 2023-10-03T10:13:00.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.448+0000 7fc046ffd700 1 -- 172.21.15.72:0/1558472475 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc050040020 con 0x7fc05812cf60 2023-10-03T10:13:00.448 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:00.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.450+0000 7fc05c87f700 1 -- 172.21.15.72:0/1558472475 >> v1:172.21.15.72:6816/126756 conn(0x7fc03802f510 legacy=0x7fc0380319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:00.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.450+0000 7fc05c87f700 1 -- 172.21.15.72:0/1558472475 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc05812cf60 msgr2=0x7fc058099d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.450+0000 7fc05c87f700 1 --2- 172.21.15.72:0/1558472475 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc05812cf60 0x7fc058099d50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc050009db0 tx=0x7fc05000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.450+0000 7fc05c87f700 1 -- 172.21.15.72:0/1558472475 shutdown_connections 2023-10-03T10:13:00.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.450+0000 7fc05c87f700 1 --2- 172.21.15.72:0/1558472475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc058135c20 0x7fc05809a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.450+0000 7fc05c87f700 1 --2- 172.21.15.72:0/1558472475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc05806f5d0 0x7fc05809e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.450+0000 7fc05c87f700 1 --2- 172.21.15.72:0/1558472475 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc05812cf60 0x7fc058099d50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.450+0000 7fc05c87f700 1 -- 172.21.15.72:0/1558472475 >> 172.21.15.72:0/1558472475 conn(0x7fc0580a2aa0 msgr2=0x7fc05812b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.450+0000 7fc05c87f700 1 -- 172.21.15.72:0/1558472475 shutdown_connections 2023-10-03T10:13:00.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.450+0000 7fc05c87f700 1 -- 172.21.15.72:0/1558472475 wait complete. 2023-10-03T10:13:00.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:00.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.469+0000 7fdd26398700 1 -- 172.21.15.72:0/1463374554 >> v1:172.21.15.72:6816/126756 conn(0x7fdd0402f510 legacy=0x7fdd040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.72:6816/126756 2023-10-03T10:13:00.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.472+0000 7fc13e6bb700 1 -- 172.21.15.72:0/2623693721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc13806b250 con 0x7fc13809f650 2023-10-03T10:13:00.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.472+0000 7fc134ff9700 1 -- 172.21.15.72:0/2623693721 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc130017330 con 0x7fc13809f650 2023-10-03T10:13:00.473 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:00.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.474+0000 7fdd285fc700 1 -- 172.21.15.72:0/1463374554 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd20071100 con 0x7fdd20134610 2023-10-03T10:13:00.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.474+0000 7fc13e6bb700 1 -- 172.21.15.72:0/2623693721 >> v1:172.21.15.72:6816/126756 conn(0x7fc12402f560 legacy=0x7fc124031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:00.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.474+0000 7fc13e6bb700 1 -- 172.21.15.72:0/2623693721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc13809f650 msgr2=0x7fc13811dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.474+0000 7fc13e6bb700 1 --2- 172.21.15.72:0/2623693721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc13809f650 0x7fc13811dd10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc13000d350 tx=0x7fc13000d710 comp rx=0 tx=0).stop 2023-10-03T10:13:00.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.474+0000 7fc13e6bb700 1 -- 172.21.15.72:0/2623693721 shutdown_connections 2023-10-03T10:13:00.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.474+0000 7fc13e6bb700 1 --2- 172.21.15.72:0/2623693721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc13809f650 0x7fc13811dd10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.474+0000 7fc13e6bb700 1 --2- 172.21.15.72:0/2623693721 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc13809e930 0x7fc13811d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.474+0000 7fdd16ffd700 1 -- 172.21.15.72:0/1463374554 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd10046070 con 0x7fdd20134610 2023-10-03T10:13:00.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.474+0000 7fc13e6bb700 1 --2- 172.21.15.72:0/2623693721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc13809f240 0x7fc13811d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.474+0000 7fc13e6bb700 1 -- 172.21.15.72:0/2623693721 >> 172.21.15.72:0/2623693721 conn(0x7fc1380a4210 msgr2=0x7fc1380a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.477 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:00.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.474+0000 7fc13e6bb700 1 -- 172.21.15.72:0/2623693721 shutdown_connections 2023-10-03T10:13:00.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.474+0000 7fc13e6bb700 1 -- 172.21.15.72:0/2623693721 wait complete. 2023-10-03T10:13:00.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.476+0000 7fdd285fc700 1 -- 172.21.15.72:0/1463374554 >> v1:172.21.15.72:6816/126756 conn(0x7fdd0402f510 legacy=0x7fdd040319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:00.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.477+0000 7fdd285fc700 1 -- 172.21.15.72:0/1463374554 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd20134610 msgr2=0x7fdd2013f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.477+0000 7fdd285fc700 1 --2- 172.21.15.72:0/1463374554 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd20134610 0x7fdd2013f430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdd10000c00 tx=0x7fdd10004750 comp rx=0 tx=0).stop 2023-10-03T10:13:00.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.477+0000 7fdd285fc700 1 -- 172.21.15.72:0/1463374554 shutdown_connections 2023-10-03T10:13:00.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.477+0000 7fdd285fc700 1 --2- 172.21.15.72:0/1463374554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd2013f970 0x7fdd20132e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.477+0000 7fdd285fc700 1 --2- 172.21.15.72:0/1463374554 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd2006e570 0x7fdd2013eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.477+0000 7fdd285fc700 1 --2- 172.21.15.72:0/1463374554 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd20134610 0x7fdd2013f430 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.477+0000 7fdd285fc700 1 -- 172.21.15.72:0/1463374554 >> 172.21.15.72:0/1463374554 conn(0x7fdd200a2aa0 msgr2=0x7fdd200a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.477+0000 7fdd285fc700 1 -- 172.21.15.72:0/1463374554 shutdown_connections 2023-10-03T10:13:00.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.477+0000 7fdd285fc700 1 -- 172.21.15.72:0/1463374554 wait complete. 2023-10-03T10:13:00.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.485+0000 7fb1a1ffb700 1 -- 172.21.15.72:0/4137282838 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb19c030cf0 con 0x7fb1ac0a0a30 2023-10-03T10:13:00.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.485+0000 7fb1a1ffb700 1 -- 172.21.15.72:0/4137282838 >> v1:172.21.15.72:6816/126756 conn(0x7fb19002f510 legacy=0x7fb1900319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:00.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:00.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:00.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.554+0000 7fb1b3335700 1 -- 172.21.15.72:0/4137282838 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb1ac082170 con 0x7fb1ac0a0a30 2023-10-03T10:13:00.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.555+0000 7fb1a1ffb700 1 -- 172.21.15.72:0/4137282838 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb19c02f3a0 con 0x7fb1ac0a0a30 2023-10-03T10:13:00.556 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:00.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.557+0000 7fb1b3335700 1 -- 172.21.15.72:0/4137282838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1ac0a0a30 msgr2=0x7fb1ac07ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:00.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.557+0000 7fb1b3335700 1 --2- 172.21.15.72:0/4137282838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1ac0a0a30 0x7fb1ac07ef50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb19c016000 tx=0x7fb19c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:00.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.557+0000 7fb1b3335700 1 -- 172.21.15.72:0/4137282838 shutdown_connections 2023-10-03T10:13:00.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.557+0000 7fb1b3335700 1 --2- 172.21.15.72:0/4137282838 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1ac133930 0x7fb1ac07f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.557+0000 7fb1b3335700 1 --2- 172.21.15.72:0/4137282838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1ac09d630 0x7fb1ac07ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.557+0000 7fb1b3335700 1 --2- 172.21.15.72:0/4137282838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1ac0a0a30 0x7fb1ac07ef50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:00.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.557+0000 7fb1b3335700 1 -- 172.21.15.72:0/4137282838 >> 172.21.15.72:0/4137282838 conn(0x7fb1ac0a3050 msgr2=0x7fb1ac08a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:00.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.557+0000 7fb1b3335700 1 -- 172.21.15.72:0/4137282838 shutdown_connections 2023-10-03T10:13:00.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:00.557+0000 7fb1b3335700 1 -- 172.21.15.72:0/4137282838 wait complete. 2023-10-03T10:13:00.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:01.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:01.494 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:01.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:01.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.604+0000 7f9ef9473700 1 Processor -- start 2023-10-03T10:13:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.604+0000 7f9ef9473700 1 -- start start 2023-10-03T10:13:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.605+0000 7f9ef9473700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ef409d6f0 0x7f9ef409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.605+0000 7f9ef9473700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9ef409e410 0x7f9ef4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.605+0000 7f9ef9473700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef409b120 con 0x7f9ef409e000 2023-10-03T10:13:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.605+0000 7f9ef9473700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef406b460 con 0x7f9ef409e410 2023-10-03T10:13:01.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.605+0000 7f9ef9473700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef409a7e0 con 0x7f9ef409d6f0 2023-10-03T10:13:01.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.605+0000 7f9ef2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ef409d6f0 0x7f9ef409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.605+0000 7f9ef2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ef409d6f0 0x7f9ef409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39548/0 (socket says 172.21.15.72:39548) 2023-10-03T10:13:01.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.605+0000 7f9ef2ffd700 1 -- 172.21.15.72:0/2493418559 learned_addr learned my addr 172.21.15.72:0/2493418559 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:01.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.605+0000 7f9ef37fe700 1 --2- 172.21.15.72:0/2493418559 >> v2:172.21.15.72:3300/0 conn(0x7f9ef409e410 0x7f9ef4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.605+0000 7f9ef2ffd700 1 -- 172.21.15.72:0/2493418559 >> v2:172.21.15.72:3300/0 conn(0x7f9ef409e410 msgr2=0x7f9ef4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:01.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.605+0000 7f9ef2ffd700 1 --2- 172.21.15.72:0/2493418559 >> v2:172.21.15.72:3300/0 conn(0x7f9ef409e410 0x7f9ef4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.605+0000 7f9ef2ffd700 1 -- 172.21.15.72:0/2493418559 >> v1:172.21.15.72:6789/0 conn(0x7f9ef409e000 legacy=0x7f9ef41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.605+0000 7f9ef2ffd700 1 -- 172.21.15.72:0/2493418559 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef409a500 con 0x7f9ef409d6f0 2023-10-03T10:13:01.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.605+0000 7f9ef37fe700 1 --2- 172.21.15.72:0/2493418559 >> v2:172.21.15.72:3300/0 conn(0x7f9ef409e410 0x7f9ef4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:01.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.605+0000 7f9ef2ffd700 1 --2- 172.21.15.72:0/2493418559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ef409d6f0 0x7f9ef409dac0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009920 tx=0x7f9ee4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2953c0a4cdca8abd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.606+0000 7f9ef1ffb700 1 -- 172.21.15.72:0/2493418559 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee400ba20 con 0x7f9ef409d6f0 2023-10-03T10:13:01.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.606+0000 7f9ef1ffb700 1 -- 172.21.15.72:0/2493418559 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee400bb80 con 0x7f9ef409d6f0 2023-10-03T10:13:01.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.606+0000 7f9ef1ffb700 1 -- 172.21.15.72:0/2493418559 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4009e70 con 0x7f9ef409d6f0 2023-10-03T10:13:01.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.606+0000 7f9ef9473700 1 -- 172.21.15.72:0/2493418559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ef409d6f0 msgr2=0x7f9ef409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.606+0000 7f9ef9473700 1 --2- 172.21.15.72:0/2493418559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ef409d6f0 0x7f9ef409dac0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009920 tx=0x7f9ee4009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:01.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.606+0000 7f9ef9473700 1 -- 172.21.15.72:0/2493418559 shutdown_connections 2023-10-03T10:13:01.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.606+0000 7f9ef9473700 1 --2- 172.21.15.72:0/2493418559 >> v2:172.21.15.72:3300/0 conn(0x7f9ef409e410 0x7f9ef4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.606+0000 7f9ef9473700 1 --2- 172.21.15.72:0/2493418559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ef409d6f0 0x7f9ef409dac0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.606+0000 7f9ef9473700 1 -- 172.21.15.72:0/2493418559 >> 172.21.15.72:0/2493418559 conn(0x7f9ef4066f50 msgr2=0x7f9ef409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.607+0000 7f9ef9473700 1 -- 172.21.15.72:0/2493418559 shutdown_connections 2023-10-03T10:13:01.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.607+0000 7f9ef9473700 1 -- 172.21.15.72:0/2493418559 wait complete. 2023-10-03T10:13:01.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.608+0000 7f9ef9473700 1 Processor -- start 2023-10-03T10:13:01.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.608+0000 7f9ef9473700 1 -- start start 2023-10-03T10:13:01.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.608+0000 7f9ef9473700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ef409d6f0 0x7f9ef41a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.608+0000 7f9ef9473700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ef409e000 0x7f9ef41a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.608+0000 7f9ef9473700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ef409e410 0x7f9ef41a68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.608+0000 7f9ef9473700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef41aa270 con 0x7f9ef409d6f0 2023-10-03T10:13:01.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.608+0000 7f9ef9473700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef409c710 con 0x7f9ef409e000 2023-10-03T10:13:01.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.608+0000 7f9ef9473700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef41a7a60 con 0x7f9ef409e410 2023-10-03T10:13:01.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.608+0000 7f9ef2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ef409d6f0 0x7f9ef41a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.608+0000 7f9ef2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ef409d6f0 0x7f9ef41a5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42230/0 (socket says 172.21.15.72:42230) 2023-10-03T10:13:01.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.608+0000 7f9ef2ffd700 1 -- 172.21.15.72:0/2949471084 learned_addr learned my addr 172.21.15.72:0/2949471084 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:01.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.608+0000 7f9ef27fc700 1 --2- 172.21.15.72:0/2949471084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ef409e000 0x7f9ef41a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.609+0000 7f9ef37fe700 1 --2- 172.21.15.72:0/2949471084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ef409e410 0x7f9ef41a68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.609+0000 7f9ef2ffd700 1 -- 172.21.15.72:0/2949471084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ef409e410 msgr2=0x7f9ef41a68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.609+0000 7f9ef2ffd700 1 --2- 172.21.15.72:0/2949471084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ef409e410 0x7f9ef41a68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.609+0000 7f9ef2ffd700 1 -- 172.21.15.72:0/2949471084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ef409e000 msgr2=0x7f9ef41a6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.609+0000 7f9ef2ffd700 1 --2- 172.21.15.72:0/2949471084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ef409e000 0x7f9ef41a6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.609+0000 7f9ef2ffd700 1 -- 172.21.15.72:0/2949471084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee4009550 con 0x7f9ef409d6f0 2023-10-03T10:13:01.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.609+0000 7f9ef27fc700 1 --2- 172.21.15.72:0/2949471084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ef409e000 0x7f9ef41a6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:01.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.609+0000 7f9ef37fe700 1 --2- 172.21.15.72:0/2949471084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ef409e410 0x7f9ef41a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:01.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.609+0000 7f9ef2ffd700 1 --2- 172.21.15.72:0/2949471084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ef409d6f0 0x7f9ef41a5e50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009c70 tx=0x7f9ee4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.609+0000 7f9edb7fe700 1 -- 172.21.15.72:0/2949471084 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4004480 con 0x7f9ef409d6f0 2023-10-03T10:13:01.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.609+0000 7f9edb7fe700 1 -- 172.21.15.72:0/2949471084 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee401f070 con 0x7f9ef409d6f0 2023-10-03T10:13:01.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.609+0000 7f9ef9473700 1 -- 172.21.15.72:0/2949471084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef41a95f0 con 0x7f9ef409d6f0 2023-10-03T10:13:01.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.609+0000 7f9edb7fe700 1 -- 172.21.15.72:0/2949471084 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee40038e0 con 0x7f9ef409d6f0 2023-10-03T10:13:01.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.609+0000 7f9ef9473700 1 -- 172.21.15.72:0/2949471084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef40a32a0 con 0x7f9ef409d6f0 2023-10-03T10:13:01.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.610+0000 7f9edb7fe700 1 -- 172.21.15.72:0/2949471084 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ee4021030 con 0x7f9ef409d6f0 2023-10-03T10:13:01.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.610+0000 7f9edb7fe700 1 -- 172.21.15.72:0/2949471084 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9ee4040b70 con 0x7f9ef409d6f0 2023-10-03T10:13:01.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.610+0000 7f9ef9473700 1 -- 172.21.15.72:0/2949471084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef4074ea0 con 0x7f9ef409d6f0 2023-10-03T10:13:01.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.615+0000 7f9edb7fe700 1 -- 172.21.15.72:0/2949471084 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ee401a7d0 con 0x7f9ef409d6f0 2023-10-03T10:13:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.643+0000 7ff48c7d1700 1 Processor -- start 2023-10-03T10:13:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.643+0000 7ff48c7d1700 1 -- start start 2023-10-03T10:13:01.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.643+0000 7f12826f8700 1 Processor -- start 2023-10-03T10:13:01.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.643+0000 7f12826f8700 1 -- start start 2023-10-03T10:13:01.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.643+0000 7f12826f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f127c0a09c0 0x7f127c0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.643+0000 7f12826f8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f127c09d5c0 0x7f127c0a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.643+0000 7f12826f8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c0a1810 con 0x7f127c133920 2023-10-03T10:13:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.643+0000 7f12826f8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c09ea10 con 0x7f127c0a09c0 2023-10-03T10:13:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.643+0000 7f12826f8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f127c09e210 con 0x7f127c09d5c0 2023-10-03T10:13:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7f127bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f127c0a09c0 0x7f127c0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.643+0000 7ff48c7d1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff48409d6f0 0x7ff48409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.643+0000 7ff48c7d1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff48409e000 0x7ff4841339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.643+0000 7ff48c7d1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48409e410 0x7ff484133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.643+0000 7ff48c7d1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48406b460 con 0x7ff48409e000 2023-10-03T10:13:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.643+0000 7ff48c7d1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48409b120 con 0x7ff48409e410 2023-10-03T10:13:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.643+0000 7ff48c7d1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff48409a7e0 con 0x7ff48409d6f0 2023-10-03T10:13:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7f127bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f127c0a09c0 0x7f127c0a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39570/0 (socket says 172.21.15.72:39570) 2023-10-03T10:13:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7f1280c95700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f127c133920 0x7f127c133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57312/0 (socket says 172.21.15.72:57312) 2023-10-03T10:13:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7f127bfff700 1 -- 172.21.15.72:0/3976594804 learned_addr learned my addr 172.21.15.72:0/3976594804 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:01.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7ff489d6c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff48409e000 0x7ff4841339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7ff489d6c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff48409e000 0x7ff4841339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42244/0 (socket says 172.21.15.72:42244) 2023-10-03T10:13:01.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7ff489d6c700 1 -- 172.21.15.72:0/70762370 learned_addr learned my addr 172.21.15.72:0/70762370 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:01.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7ff48ad6e700 1 --2- 172.21.15.72:0/70762370 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48409e410 0x7ff484133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7f127bfff700 1 -- 172.21.15.72:0/3976594804 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f127c09d5c0 msgr2=0x7f127c0a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:01.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7f127bfff700 1 --2- 172.21.15.72:0/3976594804 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f127c09d5c0 0x7f127c0a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7f127bfff700 1 -- 172.21.15.72:0/3976594804 >> v1:172.21.15.72:6789/0 conn(0x7f127c133920 legacy=0x7f127c133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7f127bfff700 1 -- 172.21.15.72:0/3976594804 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c0a26f0 con 0x7f127c0a09c0 2023-10-03T10:13:01.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7f127bfff700 1 --2- 172.21.15.72:0/3976594804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f127c0a09c0 0x7f127c0a0d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f126c009920 tx=0x7f126c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ae5c2e7592937d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7ff489d6c700 1 -- 172.21.15.72:0/70762370 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff48409d6f0 msgr2=0x7ff48409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:01.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7ff489d6c700 1 --2- 172.21.15.72:0/70762370 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff48409d6f0 0x7ff48409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7ff489d6c700 1 -- 172.21.15.72:0/70762370 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48409e410 msgr2=0x7ff484133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7ff489d6c700 1 --2- 172.21.15.72:0/70762370 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48409e410 0x7ff484133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7ff489d6c700 1 -- 172.21.15.72:0/70762370 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48409a500 con 0x7ff48409e000 2023-10-03T10:13:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.644+0000 7f127affd700 1 -- 172.21.15.72:0/3976594804 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c00ba60 con 0x7f127c0a09c0 2023-10-03T10:13:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7f127affd700 1 -- 172.21.15.72:0/3976594804 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c00bbc0 con 0x7f127c0a09c0 2023-10-03T10:13:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7f127affd700 1 -- 172.21.15.72:0/3976594804 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c009e70 con 0x7f127c0a09c0 2023-10-03T10:13:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7ff489d6c700 1 --2- 172.21.15.72:0/70762370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff48409e000 0x7ff4841339f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff4740098f0 tx=0x7ff474009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da146e46fe59a5b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7ff48956b700 1 -- 172.21.15.72:0/70762370 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474011830 con 0x7ff48409e000 2023-10-03T10:13:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7ff48956b700 1 -- 172.21.15.72:0/70762370 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff474011990 con 0x7ff48409e000 2023-10-03T10:13:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7ff48956b700 1 -- 172.21.15.72:0/70762370 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474011d20 con 0x7ff48409e000 2023-10-03T10:13:01.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7f12826f8700 1 -- 172.21.15.72:0/3976594804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f127c0a09c0 msgr2=0x7f127c0a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7f12826f8700 1 --2- 172.21.15.72:0/3976594804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f127c0a09c0 0x7f127c0a0d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f126c009920 tx=0x7f126c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:01.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7f12826f8700 1 -- 172.21.15.72:0/3976594804 shutdown_connections 2023-10-03T10:13:01.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7f12826f8700 1 --2- 172.21.15.72:0/3976594804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f127c0a09c0 0x7f127c0a0d90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7f12826f8700 1 --2- 172.21.15.72:0/3976594804 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f127c09d5c0 0x7f127c0a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7f12826f8700 1 -- 172.21.15.72:0/3976594804 >> 172.21.15.72:0/3976594804 conn(0x7f127c0a2fe0 msgr2=0x7f127c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7f12826f8700 1 -- 172.21.15.72:0/3976594804 shutdown_connections 2023-10-03T10:13:01.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7f12826f8700 1 -- 172.21.15.72:0/3976594804 wait complete. 2023-10-03T10:13:01.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.646+0000 7f12826f8700 1 Processor -- start 2023-10-03T10:13:01.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7ff48c7d1700 1 -- 172.21.15.72:0/70762370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff48409e000 msgr2=0x7ff4841339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.645+0000 7ff48c7d1700 1 --2- 172.21.15.72:0/70762370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff48409e000 0x7ff4841339f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff4740098f0 tx=0x7ff474009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:01.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.646+0000 7ff48c7d1700 1 -- 172.21.15.72:0/70762370 shutdown_connections 2023-10-03T10:13:01.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.646+0000 7ff48c7d1700 1 --2- 172.21.15.72:0/70762370 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48409e410 0x7ff484133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.646+0000 7ff48c7d1700 1 --2- 172.21.15.72:0/70762370 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff48409d6f0 0x7ff48409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.646+0000 7ff48c7d1700 1 --2- 172.21.15.72:0/70762370 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff48409e000 0x7ff4841339f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.646+0000 7ff48c7d1700 1 -- 172.21.15.72:0/70762370 >> 172.21.15.72:0/70762370 conn(0x7ff484066f50 msgr2=0x7ff48409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.646+0000 7ff48c7d1700 1 -- 172.21.15.72:0/70762370 shutdown_connections 2023-10-03T10:13:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.646+0000 7ff48c7d1700 1 -- 172.21.15.72:0/70762370 wait complete. 2023-10-03T10:13:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7f12826f8700 1 -- start start 2023-10-03T10:13:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7f12826f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f127c09d5c0 0x7f127c11df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7f12826f8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f127c0a09c0 0x7f127c11e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7f12826f8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f127c133920 0x7f127c11e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7f12826f8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c121840 con 0x7f127c133920 2023-10-03T10:13:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7f12826f8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c120930 con 0x7f127c09d5c0 2023-10-03T10:13:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7f12826f8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f127c120df0 con 0x7f127c0a09c0 2023-10-03T10:13:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7ff48c7d1700 1 Processor -- start 2023-10-03T10:13:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7ff48c7d1700 1 -- start start 2023-10-03T10:13:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7f127bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f127c09d5c0 0x7f127c11df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7f127bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f127c09d5c0 0x7f127c11df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39584/0 (socket says 172.21.15.72:39584) 2023-10-03T10:13:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7f127bfff700 1 -- 172.21.15.72:0/2347400897 learned_addr learned my addr 172.21.15.72:0/2347400897 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:01.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7f127bfff700 1 -- 172.21.15.72:0/2347400897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f127c0a09c0 msgr2=0x7f127c11e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7f127bfff700 1 --2- 172.21.15.72:0/2347400897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f127c0a09c0 0x7f127c11e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7f127bfff700 1 -- 172.21.15.72:0/2347400897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f127c133920 msgr2=0x7f127c11e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7f127bfff700 1 --2- 172.21.15.72:0/2347400897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f127c133920 0x7f127c11e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.647+0000 7f127bfff700 1 -- 172.21.15.72:0/2347400897 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c009550 con 0x7f127c09d5c0 2023-10-03T10:13:01.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7f127bfff700 1 --2- 172.21.15.72:0/2347400897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f127c09d5c0 0x7f127c11df70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f126c000c00 tx=0x7f126c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48c7d1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48409d6f0 0x7ff4841a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48c7d1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff48409e000 0x7ff4841a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48c7d1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff48409e410 0x7ff4841a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48c7d1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4841a6ae0 con 0x7ff48409e410 2023-10-03T10:13:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48c7d1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4841a7d30 con 0x7ff48409d6f0 2023-10-03T10:13:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48c7d1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4841a70d0 con 0x7ff48409e000 2023-10-03T10:13:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48a56d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48409d6f0 0x7ff4841a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48a56d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48409d6f0 0x7ff4841a4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39586/0 (socket says 172.21.15.72:39586) 2023-10-03T10:13:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48a56d700 1 -- 172.21.15.72:0/3495091564 learned_addr learned my addr 172.21.15.72:0/3495091564 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48ad6e700 1 --2- 172.21.15.72:0/3495091564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff48409e410 0x7ff4841a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48a56d700 1 -- 172.21.15.72:0/3495091564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff48409e000 msgr2=0x7ff4841a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48a56d700 1 --2- 172.21.15.72:0/3495091564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff48409e000 0x7ff4841a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48a56d700 1 -- 172.21.15.72:0/3495091564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff48409e410 msgr2=0x7ff4841a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48a56d700 1 --2- 172.21.15.72:0/3495091564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff48409e410 0x7ff4841a5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48a56d700 1 -- 172.21.15.72:0/3495091564 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff474009550 con 0x7ff48409d6f0 2023-10-03T10:13:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.648+0000 7ff48a56d700 1 --2- 172.21.15.72:0/3495091564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48409d6f0 0x7ff4841a4ed0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff48000b530 tx=0x7ff48000b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.649+0000 7f1278ff9700 1 -- 172.21.15.72:0/2347400897 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c0036a0 con 0x7f127c09d5c0 2023-10-03T10:13:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.649+0000 7ff47affd700 1 -- 172.21.15.72:0/3495091564 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480011830 con 0x7ff48409d6f0 2023-10-03T10:13:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.649+0000 7ff48c7d1700 1 -- 172.21.15.72:0/3495091564 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4841a8180 con 0x7ff48409d6f0 2023-10-03T10:13:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.649+0000 7ff47affd700 1 -- 172.21.15.72:0/3495091564 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff480011990 con 0x7ff48409d6f0 2023-10-03T10:13:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.649+0000 7ff47affd700 1 -- 172.21.15.72:0/3495091564 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480011d20 con 0x7ff48409d6f0 2023-10-03T10:13:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.649+0000 7f12826f8700 1 -- 172.21.15.72:0/2347400897 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c0a41e0 con 0x7f127c09d5c0 2023-10-03T10:13:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.649+0000 7f12826f8700 1 -- 172.21.15.72:0/2347400897 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c121a40 con 0x7f127c09d5c0 2023-10-03T10:13:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.649+0000 7ff48c7d1700 1 -- 172.21.15.72:0/3495091564 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4841a8710 con 0x7ff48409d6f0 2023-10-03T10:13:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.650+0000 7f12826f8700 1 -- 172.21.15.72:0/2347400897 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c0747f0 con 0x7f127c09d5c0 2023-10-03T10:13:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.650+0000 7f1278ff9700 1 -- 172.21.15.72:0/2347400897 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c003820 con 0x7f127c09d5c0 2023-10-03T10:13:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.650+0000 7f1278ff9700 1 -- 172.21.15.72:0/2347400897 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c003bd0 con 0x7f127c09d5c0 2023-10-03T10:13:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.650+0000 7f1278ff9700 1 -- 172.21.15.72:0/2347400897 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f126c02d440 con 0x7f127c09d5c0 2023-10-03T10:13:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.650+0000 7f1278ff9700 1 -- 172.21.15.72:0/2347400897 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f126c040d90 con 0x7f127c09d5c0 2023-10-03T10:13:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.650+0000 7ff48c7d1700 1 -- 172.21.15.72:0/3495091564 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff484074ea0 con 0x7ff48409d6f0 2023-10-03T10:13:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.655+0000 7ff47affd700 1 -- 172.21.15.72:0/3495091564 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff48001a400 con 0x7ff48409d6f0 2023-10-03T10:13:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.658+0000 7ff47affd700 1 -- 172.21.15.72:0/3495091564 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff480010540 con 0x7ff48409d6f0 2023-10-03T10:13:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.659+0000 7f1278ff9700 1 -- 172.21.15.72:0/2347400897 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f126c010790 con 0x7f127c09d5c0 2023-10-03T10:13:01.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.667+0000 7ff47affd700 1 -- 172.21.15.72:0/3495091564 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff480052750 con 0x7ff48409d6f0 2023-10-03T10:13:01.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.717+0000 7f5b908b5700 1 Processor -- start 2023-10-03T10:13:01.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.717+0000 7f5b908b5700 1 -- start start 2023-10-03T10:13:01.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.718+0000 7f5b908b5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b8c09d6f0 0x7f5b8c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.718+0000 7f5b908b5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b8c09e000 0x7f5b8c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.718+0000 7f5b908b5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8c09f130 con 0x7f5b8c09e410 2023-10-03T10:13:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.718+0000 7f5b908b5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c09f520 con 0x7f5b8c09d6f0 2023-10-03T10:13:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.718+0000 7f5b908b5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c09e930 con 0x7f5b8c09e000 2023-10-03T10:13:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.718+0000 7f5b8a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b8c09d6f0 0x7f5b8c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.718+0000 7f5b89d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b8c09e000 0x7f5b8c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.718+0000 7f5b89d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b8c09e000 0x7f5b8c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38856/0 (socket says 172.21.15.72:38856) 2023-10-03T10:13:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.718+0000 7f5b8a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b8c09d6f0 0x7f5b8c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39602/0 (socket says 172.21.15.72:39602) 2023-10-03T10:13:01.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.718+0000 7f5b89d9b700 1 -- 172.21.15.72:0/3897619644 learned_addr learned my addr 172.21.15.72:0/3897619644 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:01.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.718+0000 7f5b89d9b700 1 -- 172.21.15.72:0/3897619644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b8c09d6f0 msgr2=0x7f5b8c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.718+0000 7f5b89d9b700 1 --2- 172.21.15.72:0/3897619644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b8c09d6f0 0x7f5b8c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.718+0000 7f5b89d9b700 1 -- 172.21.15.72:0/3897619644 >> v1:172.21.15.72:6789/0 conn(0x7f5b8c09e410 legacy=0x7f5b8c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.718+0000 7f5b89d9b700 1 -- 172.21.15.72:0/3897619644 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c09b2d0 con 0x7f5b8c09e000 2023-10-03T10:13:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.719+0000 7f5b89d9b700 1 --2- 172.21.15.72:0/3897619644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b8c09e000 0x7f5b8c130660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009950 tx=0x7f5b80009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef25a2b96329bd90 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.719+0000 7f5b8959a700 1 -- 172.21.15.72:0/3897619644 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b80011830 con 0x7f5b8c09e000 2023-10-03T10:13:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.719+0000 7f5b8959a700 1 -- 172.21.15.72:0/3897619644 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b80011990 con 0x7f5b8c09e000 2023-10-03T10:13:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.719+0000 7f5b8959a700 1 -- 172.21.15.72:0/3897619644 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b80011d40 con 0x7f5b8c09e000 2023-10-03T10:13:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.719+0000 7f5b908b5700 1 -- 172.21.15.72:0/3897619644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b8c09e000 msgr2=0x7f5b8c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.719+0000 7f5b908b5700 1 --2- 172.21.15.72:0/3897619644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b8c09e000 0x7f5b8c130660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009950 tx=0x7f5b80009c60 comp rx=0 tx=0).stop 2023-10-03T10:13:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.720+0000 7f5b908b5700 1 -- 172.21.15.72:0/3897619644 shutdown_connections 2023-10-03T10:13:01.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.720+0000 7f5b908b5700 1 --2- 172.21.15.72:0/3897619644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b8c09d6f0 0x7f5b8c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.720+0000 7f5b908b5700 1 --2- 172.21.15.72:0/3897619644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b8c09e000 0x7f5b8c130660 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.720+0000 7f5b908b5700 1 -- 172.21.15.72:0/3897619644 >> 172.21.15.72:0/3897619644 conn(0x7f5b8c066f50 msgr2=0x7f5b8c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.720+0000 7f5b908b5700 1 -- 172.21.15.72:0/3897619644 shutdown_connections 2023-10-03T10:13:01.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.720+0000 7f5b908b5700 1 -- 172.21.15.72:0/3897619644 wait complete. 2023-10-03T10:13:01.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.721+0000 7f5b908b5700 1 Processor -- start 2023-10-03T10:13:01.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.721+0000 7f5b908b5700 1 -- start start 2023-10-03T10:13:01.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.722+0000 7f5b908b5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b8c09d6f0 0x7f5b8c122520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.722+0000 7f5b908b5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b8c09e000 0x7f5b8c122a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.722+0000 7f5b908b5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b8c09e410 0x7f5b8c122fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:01.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.722+0000 7f5b908b5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c0a1d00 con 0x7f5b8c09e000 2023-10-03T10:13:01.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.722+0000 7f5b908b5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c09c700 con 0x7f5b8c09d6f0 2023-10-03T10:13:01.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.722+0000 7f5b908b5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c125a80 con 0x7f5b8c09e410 2023-10-03T10:13:01.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.722+0000 7f5b89d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b8c09e000 0x7f5b8c122a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.722+0000 7f5b8a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b8c09d6f0 0x7f5b8c122520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.722+0000 7f5b89d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b8c09e000 0x7f5b8c122a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42280/0 (socket says 172.21.15.72:42280) 2023-10-03T10:13:01.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.722+0000 7f5b89d9b700 1 -- 172.21.15.72:0/1784659504 learned_addr learned my addr 172.21.15.72:0/1784659504 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:01.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.722+0000 7f5b8ad9d700 1 --2- 172.21.15.72:0/1784659504 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b8c09e410 0x7f5b8c122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:01.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.723+0000 7f5b8a59c700 1 -- 172.21.15.72:0/1784659504 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b8c09e410 msgr2=0x7f5b8c122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.723+0000 7f5b8a59c700 1 --2- 172.21.15.72:0/1784659504 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b8c09e410 0x7f5b8c122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.723+0000 7f5b8a59c700 1 -- 172.21.15.72:0/1784659504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b8c09e000 msgr2=0x7f5b8c122a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.723+0000 7f5b8a59c700 1 --2- 172.21.15.72:0/1784659504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b8c09e000 0x7f5b8c122a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.723+0000 7f5b8a59c700 1 -- 172.21.15.72:0/1784659504 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b80009550 con 0x7f5b8c09d6f0 2023-10-03T10:13:01.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.723+0000 7f5b89d9b700 1 --2- 172.21.15.72:0/1784659504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b8c09e000 0x7f5b8c122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:01.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.723+0000 7f5b8a59c700 1 --2- 172.21.15.72:0/1784659504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b8c09d6f0 0x7f5b8c122520 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00eb10 tx=0x7f5b7c00ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:01.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.723+0000 7f5b7affd700 1 -- 172.21.15.72:0/1784659504 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c00dd10 con 0x7f5b8c09d6f0 2023-10-03T10:13:01.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.723+0000 7f5b7affd700 1 -- 172.21.15.72:0/1784659504 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c00de70 con 0x7f5b8c09d6f0 2023-10-03T10:13:01.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.723+0000 7f5b908b5700 1 -- 172.21.15.72:0/1784659504 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b8c125d40 con 0x7f5b8c09d6f0 2023-10-03T10:13:01.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.723+0000 7f5b7affd700 1 -- 172.21.15.72:0/1784659504 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c010640 con 0x7f5b8c09d6f0 2023-10-03T10:13:01.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.723+0000 7f5b908b5700 1 -- 172.21.15.72:0/1784659504 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8c126720 con 0x7f5b8c09d6f0 2023-10-03T10:13:01.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.724+0000 7f5b7affd700 1 -- 172.21.15.72:0/1784659504 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b7c0107a0 con 0x7f5b8c09d6f0 2023-10-03T10:13:01.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.725+0000 7f5b7affd700 1 -- 172.21.15.72:0/1784659504 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5b7c010e30 con 0x7f5b8c09d6f0 2023-10-03T10:13:01.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.725+0000 7f5b908b5700 1 -- 172.21.15.72:0/1784659504 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b8c074ea0 con 0x7f5b8c09d6f0 2023-10-03T10:13:01.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.734+0000 7f5b7affd700 1 -- 172.21.15.72:0/1784659504 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b7c017950 con 0x7f5b8c09d6f0 2023-10-03T10:13:01.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.815+0000 7f9ef9473700 1 -- 172.21.15.72:0/2949471084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9ef41a9930 con 0x7f9ef409d6f0 2023-10-03T10:13:01.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.815+0000 7f9edb7fe700 1 -- 172.21.15.72:0/2949471084 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ee4015020 con 0x7f9ef409d6f0 2023-10-03T10:13:01.816 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:01.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.817+0000 7f9ef9473700 1 -- 172.21.15.72:0/2949471084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ef409d6f0 msgr2=0x7f9ef41a5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.817+0000 7f9ef9473700 1 --2- 172.21.15.72:0/2949471084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ef409d6f0 0x7f9ef41a5e50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009c70 tx=0x7f9ee4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:01.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.817+0000 7f9ef9473700 1 -- 172.21.15.72:0/2949471084 shutdown_connections 2023-10-03T10:13:01.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.817+0000 7f9ef9473700 1 --2- 172.21.15.72:0/2949471084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ef409d6f0 0x7f9ef41a5e50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.817+0000 7f9ef9473700 1 --2- 172.21.15.72:0/2949471084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ef409e410 0x7f9ef41a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.817+0000 7f9ef9473700 1 --2- 172.21.15.72:0/2949471084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ef409e000 0x7f9ef41a6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.817+0000 7f9ef9473700 1 -- 172.21.15.72:0/2949471084 >> 172.21.15.72:0/2949471084 conn(0x7f9ef4066f50 msgr2=0x7f9ef41badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.818+0000 7f9ef9473700 1 -- 172.21.15.72:0/2949471084 shutdown_connections 2023-10-03T10:13:01.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.818+0000 7f9ef9473700 1 -- 172.21.15.72:0/2949471084 wait complete. 2023-10-03T10:13:01.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:01.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.858+0000 7f12826f8700 1 -- 172.21.15.72:0/2347400897 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f127c072980 con 0x7f127c09d5c0 2023-10-03T10:13:01.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.858+0000 7f1278ff9700 1 -- 172.21.15.72:0/2347400897 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f126c0193b0 con 0x7f127c09d5c0 2023-10-03T10:13:01.859 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:01.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.860+0000 7f12826f8700 1 -- 172.21.15.72:0/2347400897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f127c09d5c0 msgr2=0x7f127c11df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.860+0000 7f12826f8700 1 --2- 172.21.15.72:0/2347400897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f127c09d5c0 0x7f127c11df70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f126c000c00 tx=0x7f126c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:01.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.860+0000 7f12826f8700 1 -- 172.21.15.72:0/2347400897 shutdown_connections 2023-10-03T10:13:01.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.860+0000 7f12826f8700 1 --2- 172.21.15.72:0/2347400897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f127c133920 0x7f127c11e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.860+0000 7f12826f8700 1 --2- 172.21.15.72:0/2347400897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f127c09d5c0 0x7f127c11df70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.860+0000 7f12826f8700 1 --2- 172.21.15.72:0/2347400897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f127c0a09c0 0x7f127c11e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.860+0000 7f12826f8700 1 -- 172.21.15.72:0/2347400897 >> 172.21.15.72:0/2347400897 conn(0x7f127c0a2fe0 msgr2=0x7f127c132ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.861+0000 7f12826f8700 1 -- 172.21.15.72:0/2347400897 shutdown_connections 2023-10-03T10:13:01.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.861+0000 7f12826f8700 1 -- 172.21.15.72:0/2347400897 wait complete. 2023-10-03T10:13:01.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.878+0000 7ff48c7d1700 1 -- 172.21.15.72:0/3495091564 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff4841a8900 con 0x7ff48409d6f0 2023-10-03T10:13:01.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.878+0000 7ff47affd700 1 -- 172.21.15.72:0/3495091564 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4841a8900 con 0x7ff48409d6f0 2023-10-03T10:13:01.879 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:01.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.880+0000 7ff48c7d1700 1 -- 172.21.15.72:0/3495091564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48409d6f0 msgr2=0x7ff4841a4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.880+0000 7ff48c7d1700 1 --2- 172.21.15.72:0/3495091564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48409d6f0 0x7ff4841a4ed0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff48000b530 tx=0x7ff48000b840 comp rx=0 tx=0).stop 2023-10-03T10:13:01.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.880+0000 7ff48c7d1700 1 -- 172.21.15.72:0/3495091564 shutdown_connections 2023-10-03T10:13:01.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.880+0000 7ff48c7d1700 1 --2- 172.21.15.72:0/3495091564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff48409e410 0x7ff4841a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.880+0000 7ff48c7d1700 1 --2- 172.21.15.72:0/3495091564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48409d6f0 0x7ff4841a4ed0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.880+0000 7ff48c7d1700 1 --2- 172.21.15.72:0/3495091564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff48409e000 0x7ff4841a5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.880+0000 7ff48c7d1700 1 -- 172.21.15.72:0/3495091564 >> 172.21.15.72:0/3495091564 conn(0x7ff484066f50 msgr2=0x7ff48406f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.880+0000 7ff48c7d1700 1 -- 172.21.15.72:0/3495091564 shutdown_connections 2023-10-03T10:13:01.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.880+0000 7ff48c7d1700 1 -- 172.21.15.72:0/3495091564 wait complete. 2023-10-03T10:13:01.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:01.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.931+0000 7f5b908b5700 1 -- 172.21.15.72:0/1784659504 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5b8c06c360 con 0x7f5b8c09d6f0 2023-10-03T10:13:01.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.932+0000 7f5b7affd700 1 -- 172.21.15.72:0/1784659504 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5b7c017360 con 0x7f5b8c09d6f0 2023-10-03T10:13:01.932 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.934+0000 7f5b908b5700 1 -- 172.21.15.72:0/1784659504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b8c09d6f0 msgr2=0x7f5b8c122520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.934+0000 7f5b908b5700 1 --2- 172.21.15.72:0/1784659504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b8c09d6f0 0x7f5b8c122520 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00eb10 tx=0x7f5b7c00ee20 comp rx=0 tx=0).stop 2023-10-03T10:13:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.934+0000 7f5b908b5700 1 -- 172.21.15.72:0/1784659504 shutdown_connections 2023-10-03T10:13:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.934+0000 7f5b908b5700 1 --2- 172.21.15.72:0/1784659504 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b8c09e410 0x7f5b8c122fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.934+0000 7f5b908b5700 1 --2- 172.21.15.72:0/1784659504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b8c09d6f0 0x7f5b8c122520 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.934+0000 7f5b908b5700 1 --2- 172.21.15.72:0/1784659504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b8c09e000 0x7f5b8c122a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.934+0000 7f5b908b5700 1 -- 172.21.15.72:0/1784659504 >> 172.21.15.72:0/1784659504 conn(0x7f5b8c066f50 msgr2=0x7f5b8c071050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.934+0000 7f5b908b5700 1 -- 172.21.15.72:0/1784659504 shutdown_connections 2023-10-03T10:13:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:01.934+0000 7f5b908b5700 1 -- 172.21.15.72:0/1784659504 wait complete. 2023-10-03T10:13:01.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:02.831 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:02.915 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:02.915 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:02.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:03.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.054+0000 7f47a15f1700 1 Processor -- start 2023-10-03T10:13:03.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.054+0000 7f47a15f1700 1 -- start start 2023-10-03T10:13:03.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.055+0000 7f47a15f1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f479c09e1d0 0x7f479c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.055+0000 7f47a15f1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f479c139170 0x7f479c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.055+0000 7f47a15f1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c09b120 con 0x7f479c09d6f0 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.055+0000 7f47a15f1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c06b460 con 0x7f479c09e1d0 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.055+0000 7f47a15f1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f479c09a7e0 con 0x7f479c139170 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.055+0000 7f479b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f479c139170 0x7f479c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.055+0000 7f479a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f479c09e1d0 0x7f479c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.055+0000 7f479b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f479c139170 0x7f479c13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38870/0 (socket says 172.21.15.72:38870) 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.055+0000 7f479b7fe700 1 -- 172.21.15.72:0/2068314488 learned_addr learned my addr 172.21.15.72:0/2068314488 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.056+0000 7f479a7fc700 1 -- 172.21.15.72:0/2068314488 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f479c139170 msgr2=0x7f479c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.056+0000 7f479a7fc700 1 --2- 172.21.15.72:0/2068314488 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f479c139170 0x7f479c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.056+0000 7f479a7fc700 1 -- 172.21.15.72:0/2068314488 >> v1:172.21.15.72:6789/0 conn(0x7f479c09d6f0 legacy=0x7f479c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.056+0000 7f479a7fc700 1 -- 172.21.15.72:0/2068314488 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c09a500 con 0x7f479c09e1d0 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.056+0000 7f479b7fe700 1 --2- 172.21.15.72:0/2068314488 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f479c139170 0x7f479c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:03.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.056+0000 7f479a7fc700 1 --2- 172.21.15.72:0/2068314488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f479c09e1d0 0x7f479c138c30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4790009870 tx=0x7f4790009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae96d8d0288fdc66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.056+0000 7f4799ffb700 1 -- 172.21.15.72:0/2068314488 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790011830 con 0x7f479c09e1d0 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.056+0000 7f4799ffb700 1 -- 172.21.15.72:0/2068314488 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4790011990 con 0x7f479c09e1d0 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.056+0000 7f4799ffb700 1 -- 172.21.15.72:0/2068314488 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790011d20 con 0x7f479c09e1d0 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.057+0000 7f47a15f1700 1 -- 172.21.15.72:0/2068314488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f479c09e1d0 msgr2=0x7f479c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.057+0000 7f47a15f1700 1 --2- 172.21.15.72:0/2068314488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f479c09e1d0 0x7f479c138c30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4790009870 tx=0x7f4790009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.057+0000 7f47a15f1700 1 -- 172.21.15.72:0/2068314488 shutdown_connections 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.057+0000 7f47a15f1700 1 --2- 172.21.15.72:0/2068314488 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f479c139170 0x7f479c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.057+0000 7f47a15f1700 1 --2- 172.21.15.72:0/2068314488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f479c09e1d0 0x7f479c138c30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.057+0000 7f47a15f1700 1 -- 172.21.15.72:0/2068314488 >> 172.21.15.72:0/2068314488 conn(0x7f479c066f50 msgr2=0x7f479c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.057+0000 7f47a15f1700 1 -- 172.21.15.72:0/2068314488 shutdown_connections 2023-10-03T10:13:03.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.057+0000 7f47a15f1700 1 -- 172.21.15.72:0/2068314488 wait complete. 2023-10-03T10:13:03.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.057+0000 7fd476f47700 1 Processor -- start 2023-10-03T10:13:03.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.057+0000 7f7cd8cf1700 1 Processor -- start 2023-10-03T10:13:03.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.058+0000 7f7cd8cf1700 1 -- start start 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.057+0000 7fd476f47700 1 -- start start 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.058+0000 7fd476f47700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd47006e570 0x7fd47006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.058+0000 7fd476f47700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd47009eca0 0x7fd47006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.058+0000 7fd476f47700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd470134610 0x7fd470134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.058+0000 7fd476f47700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd470070ee0 con 0x7fd47009eca0 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.058+0000 7fd476f47700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd470071480 con 0x7fd47006e570 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.058+0000 7fd476f47700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd47006f3c0 con 0x7fd470134610 2023-10-03T10:13:03.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.058+0000 7fd4754e4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd470134610 0x7fd470134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.058+0000 7fd4754e4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd470134610 0x7fd470134a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38880/0 (socket says 172.21.15.72:38880) 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.058+0000 7fd4754e4700 1 -- 172.21.15.72:0/2035905799 learned_addr learned my addr 172.21.15.72:0/2035905799 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.058+0000 7fd474ce3700 1 --2- 172.21.15.72:0/2035905799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd47006e570 0x7fd47006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f7cd8cf1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd409d6f0 0x7f7cd409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f7cd8cf1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7cd409e410 0x7f7cd4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f7cd8cf1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd409f130 con 0x7f7cd409e000 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f7cd8cf1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd409f520 con 0x7f7cd409e410 2023-10-03T10:13:03.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f7cd8cf1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd409e930 con 0x7f7cd409d6f0 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f47a15f1700 1 Processor -- start 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7fd474ce3700 1 -- 172.21.15.72:0/2035905799 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd470134610 msgr2=0x7fd470134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7fd474ce3700 1 --2- 172.21.15.72:0/2035905799 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd470134610 0x7fd470134a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7fd474ce3700 1 -- 172.21.15.72:0/2035905799 >> v2:172.21.15.72:3300/0 conn(0x7fd47009eca0 msgr2=0x7fd47006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7fd474ce3700 1 --2- 172.21.15.72:0/2035905799 >> v2:172.21.15.72:3300/0 conn(0x7fd47009eca0 0x7fd47006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7fd474ce3700 1 -- 172.21.15.72:0/2035905799 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd470071b90 con 0x7fd47006e570 2023-10-03T10:13:03.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7fd474ce3700 1 --2- 172.21.15.72:0/2035905799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd47006e570 0x7fd47006e940 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd464009840 tx=0x7fd464009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc97585ff5fb7a63 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f7cd1d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7cd409e000 0x7f7cd4130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57338/0 (socket says 172.21.15.72:57338) 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f7cd1d9b700 1 -- 172.21.15.72:0/2658736455 learned_addr learned my addr 172.21.15.72:0/2658736455 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f7cd2d9d700 1 --2- 172.21.15.72:0/2658736455 >> v2:172.21.15.72:3300/0 conn(0x7f7cd409e410 0x7f7cd4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f7cd259c700 1 --2- 172.21.15.72:0/2658736455 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd409d6f0 0x7f7cd409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f47a15f1700 1 -- start start 2023-10-03T10:13:03.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7fd46f7fe700 1 -- 172.21.15.72:0/2035905799 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd464011830 con 0x7fd47006e570 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7fd46f7fe700 1 -- 172.21.15.72:0/2035905799 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd464011990 con 0x7fd47006e570 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7fd46f7fe700 1 -- 172.21.15.72:0/2035905799 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd464011d20 con 0x7fd47006e570 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f7cd2d9d700 1 -- 172.21.15.72:0/2658736455 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd409d6f0 msgr2=0x7f7cd409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f7cd2d9d700 1 --2- 172.21.15.72:0/2658736455 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd409d6f0 0x7f7cd409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f7cd2d9d700 1 -- 172.21.15.72:0/2658736455 >> v1:172.21.15.72:6789/0 conn(0x7f7cd409e000 legacy=0x7f7cd4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f7cd2d9d700 1 -- 172.21.15.72:0/2658736455 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd409b2d0 con 0x7f7cd409e410 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f7cd2d9d700 1 --2- 172.21.15.72:0/2658736455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd409e410 0x7f7cd4130d70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009d90 tx=0x7f7ccc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16405fff5fe7f26 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f47a15f1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f479c09d6f0 0x7f479c121480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f47a15f1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f479c09e1d0 0x7f479c1219c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f47a15f1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f479c139170 0x7f479c1c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f47a15f1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c121030 con 0x7f479c09e1d0 2023-10-03T10:13:03.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f47a15f1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c121f00 con 0x7f479c139170 2023-10-03T10:13:03.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.059+0000 7f47a15f1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f479c124350 con 0x7f479c09d6f0 2023-10-03T10:13:03.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f479b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f479c139170 0x7f479c1c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f479b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f479c139170 0x7f479c1c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39644/0 (socket says 172.21.15.72:39644) 2023-10-03T10:13:03.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f479b7fe700 1 -- 172.21.15.72:0/1705610210 learned_addr learned my addr 172.21.15.72:0/1705610210 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:03.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f479a7fc700 1 --2- 172.21.15.72:0/1705610210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f479c09e1d0 0x7f479c1219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f7cd159a700 1 -- 172.21.15.72:0/2658736455 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc00bdd0 con 0x7f7cd409e410 2023-10-03T10:13:03.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f7cd159a700 1 -- 172.21.15.72:0/2658736455 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc011460 con 0x7f7cd409e410 2023-10-03T10:13:03.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f7cd159a700 1 -- 172.21.15.72:0/2658736455 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc011810 con 0x7f7cd409e410 2023-10-03T10:13:03.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f479b7fe700 1 -- 172.21.15.72:0/1705610210 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f479c09d6f0 msgr2=0x7f479c121480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:03.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f479b7fe700 1 --2- 172.21.15.72:0/1705610210 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f479c09d6f0 0x7f479c121480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f479b7fe700 1 -- 172.21.15.72:0/1705610210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f479c09e1d0 msgr2=0x7f479c1219c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f479b7fe700 1 --2- 172.21.15.72:0/1705610210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f479c09e1d0 0x7f479c1219c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f479b7fe700 1 -- 172.21.15.72:0/1705610210 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4794009b30 con 0x7f479c139170 2023-10-03T10:13:03.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7fd476f47700 1 -- 172.21.15.72:0/2035905799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd47006e570 msgr2=0x7fd47006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7fd476f47700 1 --2- 172.21.15.72:0/2035905799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd47006e570 0x7fd47006e940 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd464009840 tx=0x7fd464009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:03.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f479b7fe700 1 --2- 172.21.15.72:0/1705610210 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f479c139170 0x7f479c1c83d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4794009f10 tx=0x7f479400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7fd476f47700 1 -- 172.21.15.72:0/2035905799 shutdown_connections 2023-10-03T10:13:03.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7fd476f47700 1 --2- 172.21.15.72:0/2035905799 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd470134610 0x7fd470134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7fd476f47700 1 --2- 172.21.15.72:0/2035905799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd47006e570 0x7fd47006e940 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7fd476f47700 1 --2- 172.21.15.72:0/2035905799 >> v2:172.21.15.72:3300/0 conn(0x7fd47009eca0 0x7fd47006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7fd476f47700 1 -- 172.21.15.72:0/2035905799 >> 172.21.15.72:0/2035905799 conn(0x7fd4700a2aa0 msgr2=0x7fd4700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f47837fe700 1 -- 172.21.15.72:0/1705610210 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794018070 con 0x7f479c139170 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f47837fe700 1 -- 172.21.15.72:0/1705610210 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479400f040 con 0x7f479c139170 2023-10-03T10:13:03.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.060+0000 7f47a15f1700 1 -- 172.21.15.72:0/1705610210 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47900094a0 con 0x7f479c139170 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.061+0000 7f47837fe700 1 -- 172.21.15.72:0/1705610210 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794003c40 con 0x7f479c139170 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.061+0000 7f47a15f1700 1 -- 172.21.15.72:0/1705610210 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c123300 con 0x7f479c139170 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.061+0000 7fd476f47700 1 -- 172.21.15.72:0/2035905799 shutdown_connections 2023-10-03T10:13:03.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.061+0000 7fd476f47700 1 -- 172.21.15.72:0/2035905799 wait complete. 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.061+0000 7f7cd8cf1700 1 -- 172.21.15.72:0/2658736455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd409e410 msgr2=0x7f7cd4130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.061+0000 7f7cd8cf1700 1 --2- 172.21.15.72:0/2658736455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd409e410 0x7f7cd4130d70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009d90 tx=0x7f7ccc00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.061+0000 7f7cd8cf1700 1 -- 172.21.15.72:0/2658736455 shutdown_connections 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.061+0000 7f7cd8cf1700 1 --2- 172.21.15.72:0/2658736455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd409e410 0x7f7cd4130d70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.061+0000 7f7cd8cf1700 1 --2- 172.21.15.72:0/2658736455 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd409d6f0 0x7f7cd409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.061+0000 7f7cd8cf1700 1 -- 172.21.15.72:0/2658736455 >> 172.21.15.72:0/2658736455 conn(0x7f7cd4066f50 msgr2=0x7f7cd409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.061+0000 7f7cd8cf1700 1 -- 172.21.15.72:0/2658736455 shutdown_connections 2023-10-03T10:13:03.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.061+0000 7f7cd8cf1700 1 -- 172.21.15.72:0/2658736455 wait complete. 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.062+0000 7f47837fe700 1 -- 172.21.15.72:0/1705610210 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f479400c9f0 con 0x7f479c139170 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.062+0000 7f47a15f1700 1 -- 172.21.15.72:0/1705610210 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c074ea0 con 0x7f479c139170 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.062+0000 7fd476f47700 1 Processor -- start 2023-10-03T10:13:03.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.062+0000 7fd476f47700 1 -- start start 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.062+0000 7f7cd8cf1700 1 Processor -- start 2023-10-03T10:13:03.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7f7cd8cf1700 1 -- start start 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd476f47700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd47006e570 0x7fd47013b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd476f47700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd470134610 0x7fd470132850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd476f47700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd470133c90 0x7fd470132d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd476f47700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47013db10 con 0x7fd470133c90 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd476f47700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47013c430 con 0x7fd470134610 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd476f47700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd47013dfc0 con 0x7fd47006e570 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd4754e4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd470133c90 0x7fd470132d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd474ce3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd47006e570 0x7fd47013b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7f7cd8cf1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd409d6f0 0x7f7cd4130150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7f7cd8cf1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd409e000 0x7f7cd4130690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7f7cd8cf1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd409e410 0x7f7cd41bfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7f7cd8cf1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd41beca0 con 0x7f7cd409e410 2023-10-03T10:13:03.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7f7cd8cf1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd41bd620 con 0x7f7cd409d6f0 2023-10-03T10:13:03.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7f7cd8cf1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd40a1d00 con 0x7f7cd409e000 2023-10-03T10:13:03.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd474ce3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd47006e570 0x7fd47013b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38910/0 (socket says 172.21.15.72:38910) 2023-10-03T10:13:03.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd4754e4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd470133c90 0x7fd470132d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42306/0 (socket says 172.21.15.72:42306) 2023-10-03T10:13:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd474ce3700 1 -- 172.21.15.72:0/2519291478 learned_addr learned my addr 172.21.15.72:0/2519291478 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd4754e4700 1 -- 172.21.15.72:0/2519291478 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd47006e570 msgr2=0x7fd47013b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd4754e4700 1 --2- 172.21.15.72:0/2519291478 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd47006e570 0x7fd47013b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd4754e4700 1 -- 172.21.15.72:0/2519291478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd470134610 msgr2=0x7fd470132850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd4754e4700 1 --2- 172.21.15.72:0/2519291478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd470134610 0x7fd470132850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd4754e4700 1 -- 172.21.15.72:0/2519291478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4640094a0 con 0x7fd470133c90 2023-10-03T10:13:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7fd474ce3700 1 --2- 172.21.15.72:0/2519291478 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd47006e570 0x7fd47013b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7f7cd2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd409e410 0x7f7cd41bfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7f7cd2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd409e410 0x7f7cd41bfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42322/0 (socket says 172.21.15.72:42322) 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7f7cd2d9d700 1 -- 172.21.15.72:0/382946871 learned_addr learned my addr 172.21.15.72:0/382946871 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.063+0000 7f7cd1d9b700 1 --2- 172.21.15.72:0/382946871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd409e000 0x7f7cd4130690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.064+0000 7fd4754e4700 1 --2- 172.21.15.72:0/2519291478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd470133c90 0x7fd470132d90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd46800efc0 tx=0x7fd46800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.064+0000 7f7cd2d9d700 1 -- 172.21.15.72:0/382946871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd409e000 msgr2=0x7f7cd4130690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.064+0000 7f7cd2d9d700 1 --2- 172.21.15.72:0/382946871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd409e000 0x7f7cd4130690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.064+0000 7f7cd2d9d700 1 -- 172.21.15.72:0/382946871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd409d6f0 msgr2=0x7f7cd4130150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.064+0000 7f7cd2d9d700 1 --2- 172.21.15.72:0/382946871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd409d6f0 0x7f7cd4130150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.064+0000 7f7cd2d9d700 1 -- 172.21.15.72:0/382946871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc009a70 con 0x7f7cd409e410 2023-10-03T10:13:03.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.064+0000 7f7cd1d9b700 1 --2- 172.21.15.72:0/382946871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd409e000 0x7f7cd4130690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:03.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.064+0000 7f7cd2d9d700 1 --2- 172.21.15.72:0/382946871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd409e410 0x7f7cd41bfb60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc015000 tx=0x7f7ccc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.064+0000 7fd46d7fa700 1 -- 172.21.15.72:0/2519291478 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd468003c20 con 0x7fd470133c90 2023-10-03T10:13:03.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.064+0000 7fd46d7fa700 1 -- 172.21.15.72:0/2519291478 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46800f040 con 0x7fd470133c90 2023-10-03T10:13:03.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.064+0000 7fd46d7fa700 1 -- 172.21.15.72:0/2519291478 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd468009e60 con 0x7fd470133c90 2023-10-03T10:13:03.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.064+0000 7f7cc2ffd700 1 -- 172.21.15.72:0/382946871 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc003ea0 con 0x7f7cd409e410 2023-10-03T10:13:03.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.064+0000 7f7cc2ffd700 1 -- 172.21.15.72:0/382946871 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc00bdd0 con 0x7f7cd409e410 2023-10-03T10:13:03.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.064+0000 7f7cc2ffd700 1 -- 172.21.15.72:0/382946871 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc004280 con 0x7f7cd409e410 2023-10-03T10:13:03.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.062+0000 7f47837fe700 1 -- 172.21.15.72:0/1705610210 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f479403f8a0 con 0x7f479c139170 2023-10-03T10:13:03.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.065+0000 7fd476f47700 1 -- 172.21.15.72:0/2519291478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4700a1e60 con 0x7fd470133c90 2023-10-03T10:13:03.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.065+0000 7fd476f47700 1 -- 172.21.15.72:0/2519291478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47013e2a0 con 0x7fd470133c90 2023-10-03T10:13:03.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.065+0000 7f7cd8cf1700 1 -- 172.21.15.72:0/382946871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd41bd110 con 0x7f7cd409e410 2023-10-03T10:13:03.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.065+0000 7f7cd8cf1700 1 -- 172.21.15.72:0/382946871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd4130bd0 con 0x7f7cd409e410 2023-10-03T10:13:03.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.066+0000 7fd476f47700 1 -- 172.21.15.72:0/2519291478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd470134f00 con 0x7fd470133c90 2023-10-03T10:13:03.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.067+0000 7f7cd8cf1700 1 -- 172.21.15.72:0/382946871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd4074ea0 con 0x7f7cd409e410 2023-10-03T10:13:03.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.067+0000 7fd46d7fa700 1 -- 172.21.15.72:0/2519291478 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd46800c930 con 0x7fd470133c90 2023-10-03T10:13:03.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.067+0000 7fd46d7fa700 1 -- 172.21.15.72:0/2519291478 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd468040830 con 0x7fd470133c90 2023-10-03T10:13:03.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.067+0000 7f7cc2ffd700 1 -- 172.21.15.72:0/382946871 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ccc0045f0 con 0x7f7cd409e410 2023-10-03T10:13:03.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.068+0000 7f47837fe700 1 -- 172.21.15.72:0/1705610210 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4794012340 con 0x7f479c139170 2023-10-03T10:13:03.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.071+0000 7f7cc2ffd700 1 -- 172.21.15.72:0/382946871 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ccc02b350 con 0x7f7cd409e410 2023-10-03T10:13:03.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.072+0000 7fd46d7fa700 1 -- 172.21.15.72:0/2519291478 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd468026bd0 con 0x7fd470133c90 2023-10-03T10:13:03.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.076+0000 7f7cc2ffd700 1 -- 172.21.15.72:0/382946871 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ccc05b750 con 0x7f7cd409e410 2023-10-03T10:13:03.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.178+0000 7f79d7c19700 1 Processor -- start 2023-10-03T10:13:03.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.178+0000 7f79d7c19700 1 -- start start 2023-10-03T10:13:03.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.178+0000 7f79d7c19700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79d006a770 0x7f79d009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.178+0000 7f79d7c19700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d013d1f0 0x7f79d013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.178+0000 7f79d7c19700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d009a810 con 0x7f79d009dc30 2023-10-03T10:13:03.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.178+0000 7f79d7c19700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d006ab40 con 0x7f79d006a770 2023-10-03T10:13:03.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.178+0000 7f79d7c19700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d009ebc0 con 0x7f79d013d1f0 2023-10-03T10:13:03.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.179+0000 7f79d51b4700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f79d009dc30 0x7f79d009e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57342/0 (socket says 172.21.15.72:57342) 2023-10-03T10:13:03.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.179+0000 7f79d51b4700 1 -- 172.21.15.72:0/1948094067 learned_addr learned my addr 172.21.15.72:0/1948094067 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:03.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.179+0000 7f79d59b5700 1 --2- 172.21.15.72:0/1948094067 >> v2:172.21.15.72:3300/0 conn(0x7f79d006a770 0x7f79d009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.179+0000 7f79d61b6700 1 --2- 172.21.15.72:0/1948094067 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d013d1f0 0x7f79d013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.179+0000 7f79d61b6700 1 -- 172.21.15.72:0/1948094067 >> v2:172.21.15.72:3300/0 conn(0x7f79d006a770 msgr2=0x7f79d009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:03.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.179+0000 7f79d61b6700 1 --2- 172.21.15.72:0/1948094067 >> v2:172.21.15.72:3300/0 conn(0x7f79d006a770 0x7f79d009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.179+0000 7f79d61b6700 1 -- 172.21.15.72:0/1948094067 >> v1:172.21.15.72:6789/0 conn(0x7f79d009dc30 legacy=0x7f79d009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.179+0000 7f79d61b6700 1 -- 172.21.15.72:0/1948094067 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d009e920 con 0x7f79d013d1f0 2023-10-03T10:13:03.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.179+0000 7f79d61b6700 1 --2- 172.21.15.72:0/1948094067 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d013d1f0 0x7f79d013f5d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f79c8009d90 tx=0x7f79c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=164989d012c79ea3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.179+0000 7f79d49b3700 1 -- 172.21.15.72:0/1948094067 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c800e070 con 0x7f79d013d1f0 2023-10-03T10:13:03.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.179+0000 7f79d49b3700 1 -- 172.21.15.72:0/1948094067 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c800bb20 con 0x7f79d013d1f0 2023-10-03T10:13:03.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.180+0000 7f79d49b3700 1 -- 172.21.15.72:0/1948094067 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8012430 con 0x7f79d013d1f0 2023-10-03T10:13:03.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.180+0000 7f79d7c19700 1 -- 172.21.15.72:0/1948094067 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d013d1f0 msgr2=0x7f79d013f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.180+0000 7f79d7c19700 1 --2- 172.21.15.72:0/1948094067 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d013d1f0 0x7f79d013f5d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f79c8009d90 tx=0x7f79c800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:03.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.180+0000 7f79d7c19700 1 -- 172.21.15.72:0/1948094067 shutdown_connections 2023-10-03T10:13:03.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.180+0000 7f79d7c19700 1 --2- 172.21.15.72:0/1948094067 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d013d1f0 0x7f79d013f5d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.180+0000 7f79d7c19700 1 --2- 172.21.15.72:0/1948094067 >> v2:172.21.15.72:3300/0 conn(0x7f79d006a770 0x7f79d009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.180+0000 7f79d7c19700 1 -- 172.21.15.72:0/1948094067 >> 172.21.15.72:0/1948094067 conn(0x7f79d0066f50 msgr2=0x7f79d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.180+0000 7f79d7c19700 1 -- 172.21.15.72:0/1948094067 shutdown_connections 2023-10-03T10:13:03.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.180+0000 7f79d7c19700 1 -- 172.21.15.72:0/1948094067 wait complete. 2023-10-03T10:13:03.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.181+0000 7f79d7c19700 1 Processor -- start 2023-10-03T10:13:03.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.181+0000 7f79d7c19700 1 -- start start 2023-10-03T10:13:03.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.182+0000 7f79d7c19700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79d006a770 0x7f79d011c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.182+0000 7f79d7c19700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d009dc30 0x7f79d013b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.182+0000 7f79d7c19700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d013d1f0 0x7f79d013ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.182+0000 7f79d7c19700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d009f1a0 con 0x7f79d006a770 2023-10-03T10:13:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.182+0000 7f79d7c19700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d011e930 con 0x7f79d013d1f0 2023-10-03T10:13:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.182+0000 7f79d7c19700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79d011d110 con 0x7f79d009dc30 2023-10-03T10:13:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.182+0000 7f79d51b4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d009dc30 0x7f79d013b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.182+0000 7f79d51b4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d009dc30 0x7f79d013b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38928/0 (socket says 172.21.15.72:38928) 2023-10-03T10:13:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.182+0000 7f79d51b4700 1 -- 172.21.15.72:0/1300761831 learned_addr learned my addr 172.21.15.72:0/1300761831 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.182+0000 7f79d59b5700 1 --2- 172.21.15.72:0/1300761831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79d006a770 0x7f79d011c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.182+0000 7f79d61b6700 1 --2- 172.21.15.72:0/1300761831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d013d1f0 0x7f79d013ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.183+0000 7f79d59b5700 1 -- 172.21.15.72:0/1300761831 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d009dc30 msgr2=0x7f79d013b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.183+0000 7f79d59b5700 1 --2- 172.21.15.72:0/1300761831 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d009dc30 0x7f79d013b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.183+0000 7f79d59b5700 1 -- 172.21.15.72:0/1300761831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d013d1f0 msgr2=0x7f79d013ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.183+0000 7f79d59b5700 1 --2- 172.21.15.72:0/1300761831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d013d1f0 0x7f79d013ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.183+0000 7f79d59b5700 1 -- 172.21.15.72:0/1300761831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c8009a70 con 0x7f79d006a770 2023-10-03T10:13:03.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.183+0000 7f79d61b6700 1 --2- 172.21.15.72:0/1300761831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d013d1f0 0x7f79d013ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:03.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.183+0000 7f79d51b4700 1 --2- 172.21.15.72:0/1300761831 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d009dc30 0x7f79d013b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:03.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.183+0000 7f79d59b5700 1 --2- 172.21.15.72:0/1300761831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79d006a770 0x7f79d011c430 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00e900 tx=0x7f79cc00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:03.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.183+0000 7f79c67fc700 1 -- 172.21.15.72:0/1300761831 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00ee50 con 0x7f79d006a770 2023-10-03T10:13:03.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.183+0000 7f79c67fc700 1 -- 172.21.15.72:0/1300761831 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc00c850 con 0x7f79d006a770 2023-10-03T10:13:03.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.183+0000 7f79d7c19700 1 -- 172.21.15.72:0/1300761831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d011eed0 con 0x7f79d006a770 2023-10-03T10:13:03.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.183+0000 7f79d7c19700 1 -- 172.21.15.72:0/1300761831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d011ebf0 con 0x7f79d006a770 2023-10-03T10:13:03.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.184+0000 7f79c67fc700 1 -- 172.21.15.72:0/1300761831 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc00cbc0 con 0x7f79d006a770 2023-10-03T10:13:03.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.184+0000 7f79c67fc700 1 -- 172.21.15.72:0/1300761831 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79cc00cd20 con 0x7f79d006a770 2023-10-03T10:13:03.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.184+0000 7f79c67fc700 1 -- 172.21.15.72:0/1300761831 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f79cc03fa50 con 0x7f79d006a770 2023-10-03T10:13:03.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.184+0000 7f79d7c19700 1 -- 172.21.15.72:0/1300761831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b80052e0 con 0x7f79d006a770 2023-10-03T10:13:03.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.193+0000 7f79c67fc700 1 -- 172.21.15.72:0/1300761831 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79cc017080 con 0x7f79d006a770 2023-10-03T10:13:03.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.267+0000 7f47a15f1700 1 -- 172.21.15.72:0/1705610210 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f479c138f30 con 0x7f479c139170 2023-10-03T10:13:03.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.268+0000 7f47837fe700 1 -- 172.21.15.72:0/1705610210 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f479401de00 con 0x7f479c139170 2023-10-03T10:13:03.357 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:03.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.270+0000 7f47a15f1700 1 -- 172.21.15.72:0/1705610210 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f479c139170 msgr2=0x7f479c1c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.270+0000 7f47a15f1700 1 --2- 172.21.15.72:0/1705610210 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f479c139170 0x7f479c1c83d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4794009f10 tx=0x7f479400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.270+0000 7f47a15f1700 1 -- 172.21.15.72:0/1705610210 shutdown_connections 2023-10-03T10:13:03.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.270+0000 7f47a15f1700 1 --2- 172.21.15.72:0/1705610210 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f479c139170 0x7f479c1c83d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.270+0000 7f47a15f1700 1 --2- 172.21.15.72:0/1705610210 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f479c09d6f0 0x7f479c121480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.270+0000 7f47a15f1700 1 --2- 172.21.15.72:0/1705610210 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f479c09e1d0 0x7f479c1219c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.270+0000 7f47a15f1700 1 -- 172.21.15.72:0/1705610210 >> 172.21.15.72:0/1705610210 conn(0x7f479c066f50 msgr2=0x7f479c09b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.270+0000 7f47a15f1700 1 -- 172.21.15.72:0/1705610210 shutdown_connections 2023-10-03T10:13:03.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.270+0000 7f47a15f1700 1 -- 172.21.15.72:0/1705610210 wait complete. 2023-10-03T10:13:03.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.273+0000 7f7cd8cf1700 1 -- 172.21.15.72:0/382946871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7cd406c360 con 0x7f7cd409e410 2023-10-03T10:13:03.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.274+0000 7f7cc2ffd700 1 -- 172.21.15.72:0/382946871 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7ccc028020 con 0x7f7cd409e410 2023-10-03T10:13:03.359 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:03.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.277+0000 7f7cd8cf1700 1 -- 172.21.15.72:0/382946871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd409e410 msgr2=0x7f7cd41bfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.277+0000 7f7cd8cf1700 1 --2- 172.21.15.72:0/382946871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd409e410 0x7f7cd41bfb60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc015000 tx=0x7f7ccc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.277+0000 7f7cd8cf1700 1 -- 172.21.15.72:0/382946871 shutdown_connections 2023-10-03T10:13:03.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.277+0000 7f7cd8cf1700 1 --2- 172.21.15.72:0/382946871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd409e410 0x7f7cd41bfb60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.277+0000 7f7cd8cf1700 1 --2- 172.21.15.72:0/382946871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd409d6f0 0x7f7cd4130150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.277+0000 7f7cd8cf1700 1 --2- 172.21.15.72:0/382946871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd409e000 0x7f7cd4130690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.277+0000 7f7cd8cf1700 1 -- 172.21.15.72:0/382946871 >> 172.21.15.72:0/382946871 conn(0x7f7cd4066f50 msgr2=0x7f7cd406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.277+0000 7f7cd8cf1700 1 -- 172.21.15.72:0/382946871 shutdown_connections 2023-10-03T10:13:03.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.277+0000 7f7cd8cf1700 1 -- 172.21.15.72:0/382946871 wait complete. 2023-10-03T10:13:03.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:03.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:03.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.323+0000 7fd476f47700 1 -- 172.21.15.72:0/2519291478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd470074ea0 con 0x7fd470133c90 2023-10-03T10:13:03.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.323+0000 7fd46d7fa700 1 -- 172.21.15.72:0/2519291478 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd468014e00 con 0x7fd470133c90 2023-10-03T10:13:03.366 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:03.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.325+0000 7fd476f47700 1 -- 172.21.15.72:0/2519291478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd470133c90 msgr2=0x7fd470132d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.325+0000 7fd476f47700 1 --2- 172.21.15.72:0/2519291478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd470133c90 0x7fd470132d90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd46800efc0 tx=0x7fd46800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.325+0000 7fd476f47700 1 -- 172.21.15.72:0/2519291478 shutdown_connections 2023-10-03T10:13:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.325+0000 7fd476f47700 1 --2- 172.21.15.72:0/2519291478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd470133c90 0x7fd470132d90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.325+0000 7fd476f47700 1 --2- 172.21.15.72:0/2519291478 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd47006e570 0x7fd47013b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.325+0000 7fd476f47700 1 --2- 172.21.15.72:0/2519291478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd470134610 0x7fd470132850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.325+0000 7fd476f47700 1 -- 172.21.15.72:0/2519291478 >> 172.21.15.72:0/2519291478 conn(0x7fd4700a2aa0 msgr2=0x7fd4700a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.325+0000 7fd476f47700 1 -- 172.21.15.72:0/2519291478 shutdown_connections 2023-10-03T10:13:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.325+0000 7fd476f47700 1 -- 172.21.15.72:0/2519291478 wait complete. 2023-10-03T10:13:03.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:03.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.422+0000 7f79d7c19700 1 -- 172.21.15.72:0/1300761831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f79b8005590 con 0x7f79d006a770 2023-10-03T10:13:03.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.423+0000 7f79c67fc700 1 -- 172.21.15.72:0/1300761831 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f79cc021020 con 0x7f79d006a770 2023-10-03T10:13:03.496 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:03.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.425+0000 7f79d7c19700 1 -- 172.21.15.72:0/1300761831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79d006a770 msgr2=0x7f79d011c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:03.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.425+0000 7f79d7c19700 1 --2- 172.21.15.72:0/1300761831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79d006a770 0x7f79d011c430 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00e900 tx=0x7f79cc00ec10 comp rx=0 tx=0).stop 2023-10-03T10:13:03.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.425+0000 7f79d7c19700 1 -- 172.21.15.72:0/1300761831 shutdown_connections 2023-10-03T10:13:03.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.425+0000 7f79d7c19700 1 --2- 172.21.15.72:0/1300761831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79d006a770 0x7f79d011c430 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.425+0000 7f79d7c19700 1 --2- 172.21.15.72:0/1300761831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d013d1f0 0x7f79d013ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.425+0000 7f79d7c19700 1 --2- 172.21.15.72:0/1300761831 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d009dc30 0x7f79d013b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:03.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.425+0000 7f79d7c19700 1 -- 172.21.15.72:0/1300761831 >> 172.21.15.72:0/1300761831 conn(0x7f79d0066f50 msgr2=0x7f79d009b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:03.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.425+0000 7f79d7c19700 1 -- 172.21.15.72:0/1300761831 shutdown_connections 2023-10-03T10:13:03.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:03.425+0000 7f79d7c19700 1 -- 172.21.15.72:0/1300761831 wait complete. 2023-10-03T10:13:03.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:04.365 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:04.366 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:04.371 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:04.499 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:04.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.513+0000 7f9459ae6700 1 Processor -- start 2023-10-03T10:13:04.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.513+0000 7f9459ae6700 1 -- start start 2023-10-03T10:13:04.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.513+0000 7fe0b36ca700 1 Processor -- start 2023-10-03T10:13:04.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.513+0000 7fe0b36ca700 1 -- start start 2023-10-03T10:13:04.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7f9459ae6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9454131630 0x7f9454131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7f9459ae6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9454131f40 0x7f945406e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7f9459ae6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9454071a00 con 0x7f945406e9d0 2023-10-03T10:13:04.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7f9459ae6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9454131430 con 0x7f9454131630 2023-10-03T10:13:04.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7f9459ae6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945409a510 con 0x7f9454131f40 2023-10-03T10:13:04.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7f94537fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9454131630 0x7f9454131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7f94537fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9454131630 0x7f9454131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42352/0 (socket says 172.21.15.72:42352) 2023-10-03T10:13:04.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7f94537fe700 1 -- 172.21.15.72:0/1543999340 learned_addr learned my addr 172.21.15.72:0/1543999340 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:04.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7fe0b36ca700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe0ac130340 0x7fe0ac130710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7fe0b36ca700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0ac136e70 0x7fe0ac139250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7fe0b36ca700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac0716a0 con 0x7fe0ac130c50 2023-10-03T10:13:04.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7fe0b36ca700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ac09a390 con 0x7fe0ac130340 2023-10-03T10:13:04.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7fe0b36ca700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac071290 con 0x7fe0ac136e70 2023-10-03T10:13:04.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7f94537fe700 1 -- 172.21.15.72:0/1543999340 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9454131f40 msgr2=0x7f945406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7f94527fc700 1 -- 172.21.15.72:0/1543999340 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084875471 0 0) 0x7f9454071a00 con 0x7f945406e9d0 2023-10-03T10:13:04.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7f94537fe700 1 --2- 172.21.15.72:0/1543999340 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9454131f40 0x7f945406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7f94537fe700 1 -- 172.21.15.72:0/1543999340 >> v1:172.21.15.72:6789/0 conn(0x7f945406e9d0 legacy=0x7f9454138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7f94537fe700 1 -- 172.21.15.72:0/1543999340 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94540721c0 con 0x7f9454131630 2023-10-03T10:13:04.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7fe0b1466700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe0ac130340 0x7fe0ac130710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7fe0b1466700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe0ac130340 0x7fe0ac130710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42368/0 (socket says 172.21.15.72:42368) 2023-10-03T10:13:04.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.514+0000 7fe0b1466700 1 -- 172.21.15.72:0/114817565 learned_addr learned my addr 172.21.15.72:0/114817565 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:04.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.515+0000 7f94537fe700 1 --2- 172.21.15.72:0/1543999340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9454131630 0x7f9454131a00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f944400de50 tx=0x7f944400f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d457df98d8d55787 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.515+0000 7fe0b1c67700 1 --2- 172.21.15.72:0/114817565 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0ac136e70 0x7fe0ac139250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.515+0000 7fe0b1466700 1 -- 172.21.15.72:0/114817565 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0ac136e70 msgr2=0x7fe0ac139250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.515+0000 7fe0b1466700 1 --2- 172.21.15.72:0/114817565 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0ac136e70 0x7fe0ac139250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.515+0000 7fe0b1466700 1 -- 172.21.15.72:0/114817565 >> v1:172.21.15.72:6789/0 conn(0x7fe0ac130c50 legacy=0x7fe0ac135750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.515+0000 7fe0b1466700 1 -- 172.21.15.72:0/114817565 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac070b80 con 0x7fe0ac130340 2023-10-03T10:13:04.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.515+0000 7f94527fc700 1 -- 172.21.15.72:0/1543999340 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444012070 con 0x7f9454131630 2023-10-03T10:13:04.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.515+0000 7f94527fc700 1 -- 172.21.15.72:0/1543999340 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944400f9c0 con 0x7f9454131630 2023-10-03T10:13:04.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.515+0000 7fe0b1466700 1 --2- 172.21.15.72:0/114817565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0ac130340 0x7fe0ac130710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80098f0 tx=0x7fe0a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8547ce9e4981f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.515+0000 7f94527fc700 1 -- 172.21.15.72:0/1543999340 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400fd70 con 0x7f9454131630 2023-10-03T10:13:04.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.515+0000 7fe0a3fff700 1 -- 172.21.15.72:0/114817565 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a800b8a0 con 0x7fe0ac130340 2023-10-03T10:13:04.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.515+0000 7fe0a3fff700 1 -- 172.21.15.72:0/114817565 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a800ba00 con 0x7fe0ac130340 2023-10-03T10:13:04.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.515+0000 7fe0a3fff700 1 -- 172.21.15.72:0/114817565 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a800bd90 con 0x7fe0ac130340 2023-10-03T10:13:04.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.516+0000 7f9459ae6700 1 -- 172.21.15.72:0/1543999340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9454131630 msgr2=0x7f9454131a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.516+0000 7f9459ae6700 1 --2- 172.21.15.72:0/1543999340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9454131630 0x7f9454131a00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f944400de50 tx=0x7f944400f330 comp rx=0 tx=0).stop 2023-10-03T10:13:04.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.516+0000 7f9459ae6700 1 -- 172.21.15.72:0/1543999340 shutdown_connections 2023-10-03T10:13:04.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.516+0000 7f9459ae6700 1 --2- 172.21.15.72:0/1543999340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9454131630 0x7f9454131a00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.516+0000 7f9459ae6700 1 --2- 172.21.15.72:0/1543999340 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9454131f40 0x7f945406e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.516+0000 7f9459ae6700 1 -- 172.21.15.72:0/1543999340 >> 172.21.15.72:0/1543999340 conn(0x7f94540a2aa0 msgr2=0x7f94540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.516+0000 7fe0b36ca700 1 -- 172.21.15.72:0/114817565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0ac130340 msgr2=0x7fe0ac130710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.516+0000 7fe0b36ca700 1 --2- 172.21.15.72:0/114817565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0ac130340 0x7fe0ac130710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80098f0 tx=0x7fe0a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:04.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.516+0000 7f9459ae6700 1 -- 172.21.15.72:0/1543999340 shutdown_connections 2023-10-03T10:13:04.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.516+0000 7fe0b36ca700 1 -- 172.21.15.72:0/114817565 shutdown_connections 2023-10-03T10:13:04.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.516+0000 7fe0b36ca700 1 --2- 172.21.15.72:0/114817565 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0ac136e70 0x7fe0ac139250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.516+0000 7fe0b36ca700 1 --2- 172.21.15.72:0/114817565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0ac130340 0x7fe0ac130710 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.516+0000 7fe0b36ca700 1 -- 172.21.15.72:0/114817565 >> 172.21.15.72:0/114817565 conn(0x7fe0ac0a2aa0 msgr2=0x7fe0ac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.516+0000 7f9459ae6700 1 -- 172.21.15.72:0/1543999340 wait complete. 2023-10-03T10:13:04.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.516+0000 7fe0b36ca700 1 -- 172.21.15.72:0/114817565 shutdown_connections 2023-10-03T10:13:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.517+0000 7fe0b36ca700 1 -- 172.21.15.72:0/114817565 wait complete. 2023-10-03T10:13:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.517+0000 7fe0b36ca700 1 Processor -- start 2023-10-03T10:13:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.517+0000 7fe0b36ca700 1 -- start start 2023-10-03T10:13:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7f9459ae6700 1 Processor -- start 2023-10-03T10:13:04.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b36ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0ac130340 0x7fe0ac13cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b36ca700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0ac130c50 0x7fe0ac132a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b36ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0ac136e70 0x7fe0ac132fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b36ca700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac137490 con 0x7fe0ac136e70 2023-10-03T10:13:04.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b36ca700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac134730 con 0x7fe0ac130340 2023-10-03T10:13:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b36ca700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac0a0580 con 0x7fe0ac130c50 2023-10-03T10:13:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b0c65700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0ac130c50 0x7fe0ac132a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b0c65700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0ac130c50 0x7fe0ac132a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38952/0 (socket says 172.21.15.72:38952) 2023-10-03T10:13:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b0c65700 1 -- 172.21.15.72:0/972167678 learned_addr learned my addr 172.21.15.72:0/972167678 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b1c67700 1 --2- 172.21.15.72:0/972167678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0ac136e70 0x7fe0ac132fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b1c67700 1 -- 172.21.15.72:0/972167678 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0ac130c50 msgr2=0x7fe0ac132a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b1c67700 1 --2- 172.21.15.72:0/972167678 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0ac130c50 0x7fe0ac132a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b1c67700 1 -- 172.21.15.72:0/972167678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0ac130340 msgr2=0x7fe0ac13cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b1c67700 1 --2- 172.21.15.72:0/972167678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0ac130340 0x7fe0ac13cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b1c67700 1 -- 172.21.15.72:0/972167678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a8009550 con 0x7fe0ac136e70 2023-10-03T10:13:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7fe0b0c65700 1 --2- 172.21.15.72:0/972167678 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0ac130c50 0x7fe0ac132a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:04.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.518+0000 7f9459ae6700 1 -- start start 2023-10-03T10:13:04.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f9459ae6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f945406e9d0 0x7f94541cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f9459ae6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9454131630 0x7f94541ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f9459ae6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9454131f40 0x7f94541cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f9459ae6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9454125e00 con 0x7f945406e9d0 2023-10-03T10:13:04.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f9459ae6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9454125c10 con 0x7f9454131f40 2023-10-03T10:13:04.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f9459ae6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f945412ec00 con 0x7f9454131630 2023-10-03T10:13:04.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7fe0b1c67700 1 --2- 172.21.15.72:0/972167678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0ac136e70 0x7fe0ac132fc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4007d60 tx=0x7fe0a400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f9453fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9454131f40 0x7f94541cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f9453fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9454131f40 0x7f94541cd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39704/0 (socket says 172.21.15.72:39704) 2023-10-03T10:13:04.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f9453fff700 1 -- 172.21.15.72:0/458628288 learned_addr learned my addr 172.21.15.72:0/458628288 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:04.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f94537fe700 1 --2- 172.21.15.72:0/458628288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f945406e9d0 0x7f94541cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7fe0a1ffb700 1 -- 172.21.15.72:0/972167678 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4018070 con 0x7fe0ac136e70 2023-10-03T10:13:04.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7fe0a1ffb700 1 -- 172.21.15.72:0/972167678 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a400ebe0 con 0x7fe0ac136e70 2023-10-03T10:13:04.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7fe0b36ca700 1 -- 172.21.15.72:0/972167678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac0718e0 con 0x7fe0ac136e70 2023-10-03T10:13:04.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7fe0b36ca700 1 -- 172.21.15.72:0/972167678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac135490 con 0x7fe0ac136e70 2023-10-03T10:13:04.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7fe0a1ffb700 1 -- 172.21.15.72:0/972167678 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4003a20 con 0x7fe0ac136e70 2023-10-03T10:13:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f9453fff700 1 -- 172.21.15.72:0/458628288 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9454131630 msgr2=0x7f94541ccb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f9453fff700 1 --2- 172.21.15.72:0/458628288 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9454131630 0x7f94541ccb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f9453fff700 1 -- 172.21.15.72:0/458628288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f945406e9d0 msgr2=0x7f94541cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f9453fff700 1 --2- 172.21.15.72:0/458628288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f945406e9d0 0x7f94541cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f9453fff700 1 -- 172.21.15.72:0/458628288 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944400db30 con 0x7f9454131f40 2023-10-03T10:13:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.519+0000 7f9453fff700 1 --2- 172.21.15.72:0/458628288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9454131f40 0x7f94541cd070 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f944c00c870 tx=0x7f944c00cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.520+0000 7fe0a1ffb700 1 -- 172.21.15.72:0/972167678 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe0a4014420 con 0x7fe0ac136e70 2023-10-03T10:13:04.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.520+0000 7fe0a1ffb700 1 -- 172.21.15.72:0/972167678 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe0a403f5f0 con 0x7fe0ac136e70 2023-10-03T10:13:04.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.520+0000 7f943bfff700 1 -- 172.21.15.72:0/458628288 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c003e30 con 0x7f9454131f40 2023-10-03T10:13:04.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.521+0000 7f9459ae6700 1 -- 172.21.15.72:0/458628288 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945409f7d0 con 0x7f9454131f40 2023-10-03T10:13:04.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.521+0000 7fe0b36ca700 1 -- 172.21.15.72:0/972167678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08c0052e0 con 0x7fe0ac136e70 2023-10-03T10:13:04.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.521+0000 7f9459ae6700 1 -- 172.21.15.72:0/458628288 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9454127b70 con 0x7f9454131f40 2023-10-03T10:13:04.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.520+0000 7f943bfff700 1 -- 172.21.15.72:0/458628288 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c005070 con 0x7f9454131f40 2023-10-03T10:13:04.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.521+0000 7f943bfff700 1 -- 172.21.15.72:0/458628288 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c005420 con 0x7f9454131f40 2023-10-03T10:13:04.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.521+0000 7f9459ae6700 1 -- 172.21.15.72:0/458628288 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94541274e0 con 0x7f9454131f40 2023-10-03T10:13:04.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.522+0000 7f943bfff700 1 -- 172.21.15.72:0/458628288 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f944c005580 con 0x7f9454131f40 2023-10-03T10:13:04.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.522+0000 7f943bfff700 1 -- 172.21.15.72:0/458628288 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f944c03ed80 con 0x7f9454131f40 2023-10-03T10:13:04.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.526+0000 7f943bfff700 1 -- 172.21.15.72:0/458628288 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94541274e0 con 0x7f9454131f40 2023-10-03T10:13:04.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.526+0000 7fe0a1ffb700 1 -- 172.21.15.72:0/972167678 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0a40126a0 con 0x7fe0ac136e70 2023-10-03T10:13:04.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.554+0000 7f5b7c553700 1 Processor -- start 2023-10-03T10:13:04.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.554+0000 7f5b7c553700 1 -- start start 2023-10-03T10:13:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.555+0000 7f5b7c553700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b74133420 0x7f5b741337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.555+0000 7f5b7c553700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b74134260 0x7f5b741306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.555+0000 7f5b7c553700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7406b990 con 0x7f5b74133e30 2023-10-03T10:13:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.555+0000 7f5b7c553700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b740a0590 con 0x7f5b74133420 2023-10-03T10:13:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.555+0000 7f5b7c553700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7409fb80 con 0x7f5b74134260 2023-10-03T10:13:04.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.555+0000 7f5b79aee700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5b74133e30 0x7f5b7412ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57378/0 (socket says 172.21.15.72:57378) 2023-10-03T10:13:04.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.555+0000 7f5b79aee700 1 -- 172.21.15.72:0/753671820 learned_addr learned my addr 172.21.15.72:0/753671820 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:04.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.555+0000 7f5b7aaf0700 1 --2- 172.21.15.72:0/753671820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b74134260 0x7f5b741306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.555+0000 7f5b7a2ef700 1 --2- 172.21.15.72:0/753671820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b74133420 0x7f5b741337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.555+0000 7f5b792ed700 1 -- 172.21.15.72:0/753671820 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826107301 0 0) 0x7f5b7406b990 con 0x7f5b74133e30 2023-10-03T10:13:04.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.555+0000 7f5b792ed700 1 -- 172.21.15.72:0/753671820 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b600035b0 con 0x7f5b74133e30 2023-10-03T10:13:04.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.555+0000 7f5b7aaf0700 1 -- 172.21.15.72:0/753671820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b74133420 msgr2=0x7f5b741337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.555+0000 7f5b7aaf0700 1 --2- 172.21.15.72:0/753671820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b74133420 0x7f5b741337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.555+0000 7f5b7aaf0700 1 -- 172.21.15.72:0/753671820 >> v1:172.21.15.72:6789/0 conn(0x7f5b74133e30 legacy=0x7f5b7412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.555+0000 7f5b7aaf0700 1 -- 172.21.15.72:0/753671820 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b740a0030 con 0x7f5b74134260 2023-10-03T10:13:04.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.556+0000 7f5b7aaf0700 1 --2- 172.21.15.72:0/753671820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b74134260 0x7f5b741306a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009dc0 tx=0x7f5b6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cd487a516d94591 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.556+0000 7f5b792ed700 1 -- 172.21.15.72:0/753671820 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c00e070 con 0x7f5b74134260 2023-10-03T10:13:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.556+0000 7f5b792ed700 1 -- 172.21.15.72:0/753671820 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c00bb20 con 0x7f5b74134260 2023-10-03T10:13:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.556+0000 7f5b792ed700 1 -- 172.21.15.72:0/753671820 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c012430 con 0x7f5b74134260 2023-10-03T10:13:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.557+0000 7f5b7c553700 1 -- 172.21.15.72:0/753671820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b74134260 msgr2=0x7f5b741306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.557+0000 7f5b7c553700 1 --2- 172.21.15.72:0/753671820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b74134260 0x7f5b741306a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009dc0 tx=0x7f5b6c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.557+0000 7f5b7c553700 1 -- 172.21.15.72:0/753671820 shutdown_connections 2023-10-03T10:13:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.557+0000 7f5b7c553700 1 --2- 172.21.15.72:0/753671820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b74134260 0x7f5b741306a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.557+0000 7f5b7c553700 1 --2- 172.21.15.72:0/753671820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b74133420 0x7f5b741337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.557+0000 7f5b7c553700 1 -- 172.21.15.72:0/753671820 >> 172.21.15.72:0/753671820 conn(0x7f5b740a4210 msgr2=0x7f5b740a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.557+0000 7f5b7c553700 1 -- 172.21.15.72:0/753671820 shutdown_connections 2023-10-03T10:13:04.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.557+0000 7f5b7c553700 1 -- 172.21.15.72:0/753671820 wait complete. 2023-10-03T10:13:04.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.558+0000 7f5b7c553700 1 Processor -- start 2023-10-03T10:13:04.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.558+0000 7f5b7c553700 1 -- start start 2023-10-03T10:13:04.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b7c553700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b74133420 0x7f5b7411dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b7c553700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b74133e30 0x7f5b7411e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b7c553700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b74134260 0x7f5b7411c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b7c553700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7411c660 con 0x7f5b74134260 2023-10-03T10:13:04.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b7c553700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7411b750 con 0x7f5b74133420 2023-10-03T10:13:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b7c553700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7409dc90 con 0x7f5b74133e30 2023-10-03T10:13:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b79aee700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b74133e30 0x7f5b7411e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b79aee700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b74133e30 0x7f5b7411e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38974/0 (socket says 172.21.15.72:38974) 2023-10-03T10:13:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b79aee700 1 -- 172.21.15.72:0/1770307931 learned_addr learned my addr 172.21.15.72:0/1770307931 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b7a2ef700 1 --2- 172.21.15.72:0/1770307931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b74133420 0x7f5b7411dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b79aee700 1 -- 172.21.15.72:0/1770307931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b74133420 msgr2=0x7f5b7411dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b79aee700 1 --2- 172.21.15.72:0/1770307931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b74133420 0x7f5b7411dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b79aee700 1 -- 172.21.15.72:0/1770307931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b74134260 msgr2=0x7f5b7411c8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b79aee700 1 --2- 172.21.15.72:0/1770307931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b74134260 0x7f5b7411c8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b79aee700 1 -- 172.21.15.72:0/1770307931 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c009a70 con 0x7f5b74133e30 2023-10-03T10:13:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.559+0000 7f5b79aee700 1 --2- 172.21.15.72:0/1770307931 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b74133e30 0x7f5b7411e250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5b64005910 tx=0x7f5b6400c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.560+0000 7f5b6affd700 1 -- 172.21.15.72:0/1770307931 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64005d70 con 0x7f5b74133e30 2023-10-03T10:13:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.560+0000 7f5b7c553700 1 -- 172.21.15.72:0/1770307931 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7409e210 con 0x7f5b74133e30 2023-10-03T10:13:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.560+0000 7f5b7c553700 1 -- 172.21.15.72:0/1770307931 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7411bcf0 con 0x7f5b74133e30 2023-10-03T10:13:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.560+0000 7f5b6affd700 1 -- 172.21.15.72:0/1770307931 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b640070d0 con 0x7f5b74133e30 2023-10-03T10:13:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.560+0000 7f5b6affd700 1 -- 172.21.15.72:0/1770307931 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64007440 con 0x7f5b74133e30 2023-10-03T10:13:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.561+0000 7f5b7c553700 1 -- 172.21.15.72:0/1770307931 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5c0052e0 con 0x7f5b74133e30 2023-10-03T10:13:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.561+0000 7f5b6affd700 1 -- 172.21.15.72:0/1770307931 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b640075a0 con 0x7f5b74133e30 2023-10-03T10:13:04.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.562+0000 7f5b6affd700 1 -- 172.21.15.72:0/1770307931 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5b6403ec70 con 0x7f5b74133e30 2023-10-03T10:13:04.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.570+0000 7f5b6affd700 1 -- 172.21.15.72:0/1770307931 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b64019b40 con 0x7f5b74133e30 2023-10-03T10:13:04.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.630+0000 7f6703c6e700 1 Processor -- start 2023-10-03T10:13:04.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.630+0000 7f6703c6e700 1 -- start start 2023-10-03T10:13:04.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.631+0000 7f6703c6e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f66fc09f410 0x7f66fc136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.631+0000 7f6703c6e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc136fe0 0x7f66fc1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.631+0000 7f6703c6e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc070940 con 0x7f66fc09e930 2023-10-03T10:13:04.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.631+0000 7f6703c6e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc06fd60 con 0x7f66fc09f410 2023-10-03T10:13:04.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.631+0000 7f6703c6e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc06fa80 con 0x7f66fc136fe0 2023-10-03T10:13:04.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.631+0000 7f670220b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc136fe0 0x7f66fc1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.631+0000 7f670220b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc136fe0 0x7f66fc1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38988/0 (socket says 172.21.15.72:38988) 2023-10-03T10:13:04.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.631+0000 7f670220b700 1 -- 172.21.15.72:0/1161368535 learned_addr learned my addr 172.21.15.72:0/1161368535 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:04.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.631+0000 7f6701209700 1 --2- 172.21.15.72:0/1161368535 >> v2:172.21.15.72:3300/0 conn(0x7f66fc09f410 0x7f66fc136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.631+0000 7f6700a08700 1 -- 172.21.15.72:0/1161368535 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862211484 0 0) 0x7f66fc070940 con 0x7f66fc09e930 2023-10-03T10:13:04.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.631+0000 7f6701209700 1 -- 172.21.15.72:0/1161368535 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc136fe0 msgr2=0x7f66fc1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:04.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.631+0000 7f6701209700 1 --2- 172.21.15.72:0/1161368535 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc136fe0 0x7f66fc1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.631+0000 7f6701209700 1 -- 172.21.15.72:0/1161368535 >> v1:172.21.15.72:6789/0 conn(0x7f66fc09e930 legacy=0x7f66fc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.631+0000 7f6701209700 1 -- 172.21.15.72:0/1161368535 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc09fb60 con 0x7f66fc09f410 2023-10-03T10:13:04.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.631+0000 7f670220b700 1 --2- 172.21.15.72:0/1161368535 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc136fe0 0x7f66fc1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:04.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.632+0000 7f6701209700 1 --2- 172.21.15.72:0/1161368535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09f410 0x7f66fc136aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009840 tx=0x7f66ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4255c59910e9b3de server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.632+0000 7f6700a08700 1 -- 172.21.15.72:0/1161368535 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec011830 con 0x7f66fc09f410 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.632+0000 7f6700a08700 1 -- 172.21.15.72:0/1161368535 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec011990 con 0x7f66fc09f410 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.632+0000 7f6700a08700 1 -- 172.21.15.72:0/1161368535 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec011d20 con 0x7f66fc09f410 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.633+0000 7f6703c6e700 1 -- 172.21.15.72:0/1161368535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09f410 msgr2=0x7f66fc136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.633+0000 7f6703c6e700 1 --2- 172.21.15.72:0/1161368535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09f410 0x7f66fc136aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009840 tx=0x7f66ec009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.633+0000 7f6703c6e700 1 -- 172.21.15.72:0/1161368535 shutdown_connections 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.633+0000 7f6703c6e700 1 --2- 172.21.15.72:0/1161368535 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc136fe0 0x7f66fc1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.633+0000 7f6703c6e700 1 --2- 172.21.15.72:0/1161368535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09f410 0x7f66fc136aa0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.633+0000 7f6703c6e700 1 -- 172.21.15.72:0/1161368535 >> 172.21.15.72:0/1161368535 conn(0x7f66fc0a4210 msgr2=0x7f66fc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.633+0000 7f6703c6e700 1 -- 172.21.15.72:0/1161368535 shutdown_connections 2023-10-03T10:13:04.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.633+0000 7f6703c6e700 1 -- 172.21.15.72:0/1161368535 wait complete. 2023-10-03T10:13:04.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.634+0000 7f6703c6e700 1 Processor -- start 2023-10-03T10:13:04.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.634+0000 7f6703c6e700 1 -- start start 2023-10-03T10:13:04.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f6703c6e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09e930 0x7f66fc11e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f6703c6e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09f410 0x7f66fc11ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f6703c6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc136fe0 0x7f66fc11efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f6703c6e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc071d20 con 0x7f66fc09e930 2023-10-03T10:13:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f6703c6e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc121810 con 0x7f66fc136fe0 2023-10-03T10:13:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f6703c6e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc1343e0 con 0x7f66fc09f410 2023-10-03T10:13:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f6701a0a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09e930 0x7f66fc11e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f6701a0a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09e930 0x7f66fc11e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42398/0 (socket says 172.21.15.72:42398) 2023-10-03T10:13:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f6701a0a700 1 -- 172.21.15.72:0/4174351053 learned_addr learned my addr 172.21.15.72:0/4174351053 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f670220b700 1 --2- 172.21.15.72:0/4174351053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc136fe0 0x7f66fc11efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f6701209700 1 --2- 172.21.15.72:0/4174351053 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09f410 0x7f66fc11ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:04.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f6701a0a700 1 -- 172.21.15.72:0/4174351053 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09f410 msgr2=0x7f66fc11ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f6701a0a700 1 --2- 172.21.15.72:0/4174351053 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09f410 0x7f66fc11ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f6701a0a700 1 -- 172.21.15.72:0/4174351053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc136fe0 msgr2=0x7f66fc11efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f6701a0a700 1 --2- 172.21.15.72:0/4174351053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc136fe0 0x7f66fc11efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.635+0000 7f6701a0a700 1 -- 172.21.15.72:0/4174351053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f4009b30 con 0x7f66fc09e930 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.636+0000 7f6701a0a700 1 --2- 172.21.15.72:0/4174351053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09e930 0x7f66fc11e540 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f66f8001eb0 tx=0x7f66f800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.636+0000 7f66f27fc700 1 -- 172.21.15.72:0/4174351053 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f80054e0 con 0x7f66fc09e930 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.636+0000 7f66f27fc700 1 -- 172.21.15.72:0/4174351053 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f8003680 con 0x7f66fc09e930 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.636+0000 7f6703c6e700 1 -- 172.21.15.72:0/4174351053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ec0094a0 con 0x7f66fc09e930 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.636+0000 7f66f27fc700 1 -- 172.21.15.72:0/4174351053 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f80039f0 con 0x7f66fc09e930 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.636+0000 7f6703c6e700 1 -- 172.21.15.72:0/4174351053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc0a3340 con 0x7f66fc09e930 2023-10-03T10:13:04.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.637+0000 7f6703c6e700 1 -- 172.21.15.72:0/4174351053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66fc074ea0 con 0x7f66fc09e930 2023-10-03T10:13:04.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.638+0000 7f66f27fc700 1 -- 172.21.15.72:0/4174351053 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66f8003b50 con 0x7f66fc09e930 2023-10-03T10:13:04.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.638+0000 7f66f27fc700 1 -- 172.21.15.72:0/4174351053 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f66f803ef00 con 0x7f66fc09e930 2023-10-03T10:13:04.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.646+0000 7f66f27fc700 1 -- 172.21.15.72:0/4174351053 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66f801b3b0 con 0x7f66fc09e930 2023-10-03T10:13:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.728+0000 7f9459ae6700 1 -- 172.21.15.72:0/458628288 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f94541276a0 con 0x7f9454131f40 2023-10-03T10:13:04.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.728+0000 7f943bfff700 1 -- 172.21.15.72:0/458628288 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f94541276a0 con 0x7f9454131f40 2023-10-03T10:13:04.729 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.730+0000 7f9459ae6700 1 -- 172.21.15.72:0/458628288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9454131f40 msgr2=0x7f94541cd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.730+0000 7f9459ae6700 1 --2- 172.21.15.72:0/458628288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9454131f40 0x7f94541cd070 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f944c00c870 tx=0x7f944c00cb80 comp rx=0 tx=0).stop 2023-10-03T10:13:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.730+0000 7f9459ae6700 1 -- 172.21.15.72:0/458628288 shutdown_connections 2023-10-03T10:13:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.730+0000 7f9459ae6700 1 --2- 172.21.15.72:0/458628288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f945406e9d0 0x7f94541cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.730+0000 7f9459ae6700 1 --2- 172.21.15.72:0/458628288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9454131f40 0x7f94541cd070 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.730+0000 7f9459ae6700 1 --2- 172.21.15.72:0/458628288 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9454131630 0x7f94541ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.730+0000 7f9459ae6700 1 -- 172.21.15.72:0/458628288 >> 172.21.15.72:0/458628288 conn(0x7f94540a2aa0 msgr2=0x7f9454070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.730+0000 7f9459ae6700 1 -- 172.21.15.72:0/458628288 shutdown_connections 2023-10-03T10:13:04.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.730+0000 7f9459ae6700 1 -- 172.21.15.72:0/458628288 wait complete. 2023-10-03T10:13:04.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:04.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.755+0000 7fe0b36ca700 1 -- 172.21.15.72:0/972167678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe08c005590 con 0x7fe0ac136e70 2023-10-03T10:13:04.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.755+0000 7fe0a1ffb700 1 -- 172.21.15.72:0/972167678 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0a40122e0 con 0x7fe0ac136e70 2023-10-03T10:13:04.756 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:04.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.758+0000 7fe0b36ca700 1 -- 172.21.15.72:0/972167678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0ac136e70 msgr2=0x7fe0ac132fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.758+0000 7fe0b36ca700 1 --2- 172.21.15.72:0/972167678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0ac136e70 0x7fe0ac132fc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4007d60 tx=0x7fe0a400e3c0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.758+0000 7fe0b36ca700 1 -- 172.21.15.72:0/972167678 shutdown_connections 2023-10-03T10:13:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.758+0000 7fe0b36ca700 1 --2- 172.21.15.72:0/972167678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0ac136e70 0x7fe0ac132fc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.758+0000 7fe0b36ca700 1 --2- 172.21.15.72:0/972167678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0ac130340 0x7fe0ac13cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.758+0000 7fe0b36ca700 1 --2- 172.21.15.72:0/972167678 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0ac130c50 0x7fe0ac132a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.758+0000 7fe0b36ca700 1 -- 172.21.15.72:0/972167678 >> 172.21.15.72:0/972167678 conn(0x7fe0ac0a2aa0 msgr2=0x7fe0ac136560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.759+0000 7fe0b36ca700 1 -- 172.21.15.72:0/972167678 shutdown_connections 2023-10-03T10:13:04.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.759+0000 7fe0b36ca700 1 -- 172.21.15.72:0/972167678 wait complete. 2023-10-03T10:13:04.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:04.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.787+0000 7f5b7c553700 1 -- 172.21.15.72:0/1770307931 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5b5c005590 con 0x7f5b74133e30 2023-10-03T10:13:04.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.787+0000 7f5b6affd700 1 -- 172.21.15.72:0/1770307931 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b64017070 con 0x7f5b74133e30 2023-10-03T10:13:04.788 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:04.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.789+0000 7f5b7c553700 1 -- 172.21.15.72:0/1770307931 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b74133e30 msgr2=0x7f5b7411e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.789+0000 7f5b7c553700 1 --2- 172.21.15.72:0/1770307931 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b74133e30 0x7f5b7411e250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5b64005910 tx=0x7f5b6400c9e0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.789+0000 7f5b7c553700 1 -- 172.21.15.72:0/1770307931 shutdown_connections 2023-10-03T10:13:04.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.789+0000 7f5b7c553700 1 --2- 172.21.15.72:0/1770307931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b74134260 0x7f5b7411c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.789+0000 7f5b7c553700 1 --2- 172.21.15.72:0/1770307931 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b74133420 0x7f5b7411dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.789+0000 7f5b7c553700 1 --2- 172.21.15.72:0/1770307931 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b74133e30 0x7f5b7411e250 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.789+0000 7f5b7c553700 1 -- 172.21.15.72:0/1770307931 >> 172.21.15.72:0/1770307931 conn(0x7f5b740a4210 msgr2=0x7f5b74130480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.789+0000 7f5b7c553700 1 -- 172.21.15.72:0/1770307931 shutdown_connections 2023-10-03T10:13:04.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.789+0000 7f5b7c553700 1 -- 172.21.15.72:0/1770307931 wait complete. 2023-10-03T10:13:04.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:04.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.841+0000 7f6703c6e700 1 -- 172.21.15.72:0/4174351053 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f66fc06b250 con 0x7f66fc09e930 2023-10-03T10:13:04.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.841+0000 7f66f27fc700 1 -- 172.21.15.72:0/4174351053 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f66f8017030 con 0x7f66fc09e930 2023-10-03T10:13:04.842 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:04.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.843+0000 7f6703c6e700 1 -- 172.21.15.72:0/4174351053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09e930 msgr2=0x7f66fc11e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:04.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.843+0000 7f6703c6e700 1 --2- 172.21.15.72:0/4174351053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09e930 0x7f66fc11e540 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f66f8001eb0 tx=0x7f66f800c800 comp rx=0 tx=0).stop 2023-10-03T10:13:04.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.844+0000 7f6703c6e700 1 -- 172.21.15.72:0/4174351053 shutdown_connections 2023-10-03T10:13:04.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.844+0000 7f6703c6e700 1 --2- 172.21.15.72:0/4174351053 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09e930 0x7f66fc11e540 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.844+0000 7f6703c6e700 1 --2- 172.21.15.72:0/4174351053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc136fe0 0x7f66fc11efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.844+0000 7f6703c6e700 1 --2- 172.21.15.72:0/4174351053 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09f410 0x7f66fc11ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:04.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.844+0000 7f6703c6e700 1 -- 172.21.15.72:0/4174351053 >> 172.21.15.72:0/4174351053 conn(0x7f66fc0a4210 msgr2=0x7f66fc134920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:04.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.844+0000 7f6703c6e700 1 -- 172.21.15.72:0/4174351053 shutdown_connections 2023-10-03T10:13:04.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:04.844+0000 7f6703c6e700 1 -- 172.21.15.72:0/4174351053 wait complete. 2023-10-03T10:13:04.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:05.745 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:05.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:05.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:05.857 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:05.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.886+0000 7fc774146700 1 Processor -- start 2023-10-03T10:13:05.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.886+0000 7fc774146700 1 -- start start 2023-10-03T10:13:05.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.887+0000 7fc774146700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc76c09e1d0 0x7fc76c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.887+0000 7fc774146700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76c139170 0x7fc76c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.887+0000 7fc774146700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76c09b120 con 0x7fc76c09d6f0 2023-10-03T10:13:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.887+0000 7fc774146700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76c06b460 con 0x7fc76c09e1d0 2023-10-03T10:13:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.887+0000 7fc774146700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c09a7e0 con 0x7fc76c139170 2023-10-03T10:13:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.887+0000 7fc7726e3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76c139170 0x7fc76c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.887+0000 7fc7726e3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76c139170 0x7fc76c13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39008/0 (socket says 172.21.15.72:39008) 2023-10-03T10:13:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.887+0000 7fc7726e3700 1 -- 172.21.15.72:0/3119936380 learned_addr learned my addr 172.21.15.72:0/3119936380 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.887+0000 7fc7716e1700 1 --2- 172.21.15.72:0/3119936380 >> v2:172.21.15.72:3300/0 conn(0x7fc76c09e1d0 0x7fc76c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.887+0000 7fc771ee2700 1 --1- 172.21.15.72:0/3119936380 >> v1:172.21.15.72:6789/0 conn(0x7fc76c09d6f0 0x7fc76c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57382/0 (socket says 172.21.15.72:57382) 2023-10-03T10:13:05.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.887+0000 7fc7716e1700 1 -- 172.21.15.72:0/3119936380 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76c139170 msgr2=0x7fc76c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.887+0000 7fc7716e1700 1 --2- 172.21.15.72:0/3119936380 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76c139170 0x7fc76c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.887+0000 7fc7716e1700 1 -- 172.21.15.72:0/3119936380 >> v1:172.21.15.72:6789/0 conn(0x7fc76c09d6f0 legacy=0x7fc76c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.887+0000 7fc7716e1700 1 -- 172.21.15.72:0/3119936380 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c09a500 con 0x7fc76c09e1d0 2023-10-03T10:13:05.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.887+0000 7fc7716e1700 1 --2- 172.21.15.72:0/3119936380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc76c09e1d0 0x7fc76c138c30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009870 tx=0x7fc75c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be249f05b41dc76 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.888+0000 7fc770ee0700 1 -- 172.21.15.72:0/3119936380 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011830 con 0x7fc76c09e1d0 2023-10-03T10:13:05.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.888+0000 7fc770ee0700 1 -- 172.21.15.72:0/3119936380 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c011990 con 0x7fc76c09e1d0 2023-10-03T10:13:05.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.888+0000 7fc770ee0700 1 -- 172.21.15.72:0/3119936380 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011d20 con 0x7fc76c09e1d0 2023-10-03T10:13:05.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.888+0000 7fc774146700 1 -- 172.21.15.72:0/3119936380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc76c09e1d0 msgr2=0x7fc76c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.888+0000 7fc774146700 1 --2- 172.21.15.72:0/3119936380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc76c09e1d0 0x7fc76c138c30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009870 tx=0x7fc75c009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:05.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.888+0000 7fc774146700 1 -- 172.21.15.72:0/3119936380 shutdown_connections 2023-10-03T10:13:05.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.888+0000 7fc774146700 1 --2- 172.21.15.72:0/3119936380 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76c139170 0x7fc76c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.888+0000 7fc774146700 1 --2- 172.21.15.72:0/3119936380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc76c09e1d0 0x7fc76c138c30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.888+0000 7fc774146700 1 -- 172.21.15.72:0/3119936380 >> 172.21.15.72:0/3119936380 conn(0x7fc76c066f50 msgr2=0x7fc76c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.889+0000 7fc774146700 1 -- 172.21.15.72:0/3119936380 shutdown_connections 2023-10-03T10:13:05.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.889+0000 7fc774146700 1 -- 172.21.15.72:0/3119936380 wait complete. 2023-10-03T10:13:05.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.889+0000 7fc774146700 1 Processor -- start 2023-10-03T10:13:05.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc774146700 1 -- start start 2023-10-03T10:13:05.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc774146700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc76c09d6f0 0x7fc76c121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc774146700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc76c09e1d0 0x7fc76c1218b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc774146700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76c139170 0x7fc76c1c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc774146700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c123f60 con 0x7fc76c09d6f0 2023-10-03T10:13:05.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc774146700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c120f90 con 0x7fc76c09e1d0 2023-10-03T10:13:05.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc774146700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c1368b0 con 0x7fc76c139170 2023-10-03T10:13:05.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc7716e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc76c09e1d0 0x7fc76c1218b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc7716e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc76c09e1d0 0x7fc76c1218b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39718/0 (socket says 172.21.15.72:39718) 2023-10-03T10:13:05.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc7716e1700 1 -- 172.21.15.72:0/2799944561 learned_addr learned my addr 172.21.15.72:0/2799944561 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:05.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc7726e3700 1 --2- 172.21.15.72:0/2799944561 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76c139170 0x7fc76c1c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc771ee2700 1 --2- 172.21.15.72:0/2799944561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc76c09d6f0 0x7fc76c121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc7716e1700 1 -- 172.21.15.72:0/2799944561 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76c139170 msgr2=0x7fc76c1c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc7716e1700 1 --2- 172.21.15.72:0/2799944561 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76c139170 0x7fc76c1c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc7716e1700 1 -- 172.21.15.72:0/2799944561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc76c09d6f0 msgr2=0x7fc76c121370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc7716e1700 1 --2- 172.21.15.72:0/2799944561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc76c09d6f0 0x7fc76c121370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.890+0000 7fc7716e1700 1 -- 172.21.15.72:0/2799944561 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c0094a0 con 0x7fc76c09e1d0 2023-10-03T10:13:05.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.891+0000 7fc7716e1700 1 --2- 172.21.15.72:0/2799944561 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc76c09e1d0 0x7fc76c1218b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0090b0 tx=0x7fc75c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.891+0000 7fc771ee2700 1 --2- 172.21.15.72:0/2799944561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc76c09d6f0 0x7fc76c121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:05.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.892+0000 7fc7627fc700 1 -- 172.21.15.72:0/2799944561 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c0036a0 con 0x7fc76c09e1d0 2023-10-03T10:13:05.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.892+0000 7fc7627fc700 1 -- 172.21.15.72:0/2799944561 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c01f070 con 0x7fc76c09e1d0 2023-10-03T10:13:05.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.892+0000 7fc774146700 1 -- 172.21.15.72:0/2799944561 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76c122e50 con 0x7fc76c09e1d0 2023-10-03T10:13:05.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.892+0000 7fc7627fc700 1 -- 172.21.15.72:0/2799944561 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c003a00 con 0x7fc76c09e1d0 2023-10-03T10:13:05.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.892+0000 7fc774146700 1 -- 172.21.15.72:0/2799944561 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76c09c710 con 0x7fc76c09e1d0 2023-10-03T10:13:05.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.893+0000 7fc774146700 1 -- 172.21.15.72:0/2799944561 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76c09c4d0 con 0x7fc76c09e1d0 2023-10-03T10:13:05.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.893+0000 7fc7627fc700 1 -- 172.21.15.72:0/2799944561 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc75c003b60 con 0x7fc76c09e1d0 2023-10-03T10:13:05.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.893+0000 7fc7627fc700 1 -- 172.21.15.72:0/2799944561 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc75c021070 con 0x7fc76c09e1d0 2023-10-03T10:13:05.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.898+0000 7fc7627fc700 1 -- 172.21.15.72:0/2799944561 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc75c010380 con 0x7fc76c09e1d0 2023-10-03T10:13:05.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.922+0000 7fe3a0b95700 1 Processor -- start 2023-10-03T10:13:05.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.922+0000 7fe3a0b95700 1 -- start start 2023-10-03T10:13:05.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.922+0000 7fe3a0b95700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe39c130540 0x7fe39c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe3a0b95700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe39c130e50 0x7fe39c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe3a0b95700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39c06fb20 0x7fe39c06ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe3a0b95700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c0704b0 con 0x7fe39c130e50 2023-10-03T10:13:05.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe3a0b95700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c09a390 con 0x7fe39c06fb20 2023-10-03T10:13:05.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe3a0b95700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0716a0 con 0x7fe39c130540 2023-10-03T10:13:05.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe39a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe39c130540 0x7fe39c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe399d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe39c130e50 0x7fe39c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe39a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe39c130540 0x7fe39c130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39026/0 (socket says 172.21.15.72:39026) 2023-10-03T10:13:05.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe39a59c700 1 -- 172.21.15.72:0/2465887891 learned_addr learned my addr 172.21.15.72:0/2465887891 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:05.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe39ad9d700 1 --2- 172.21.15.72:0/2465887891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39c06fb20 0x7fe39c06ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe399d9b700 1 -- 172.21.15.72:0/2465887891 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe39c130540 msgr2=0x7fe39c130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe399d9b700 1 --2- 172.21.15.72:0/2465887891 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe39c130540 0x7fe39c130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe399d9b700 1 -- 172.21.15.72:0/2465887891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39c06fb20 msgr2=0x7fe39c06ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe399d9b700 1 --2- 172.21.15.72:0/2465887891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39c06fb20 0x7fe39c06ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe399d9b700 1 -- 172.21.15.72:0/2465887891 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c071290 con 0x7fe39c130e50 2023-10-03T10:13:05.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe399d9b700 1 --2- 172.21.15.72:0/2465887891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39c130e50 0x7fe39c06f5e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe390009870 tx=0x7fe390009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b99c9ffacd2c1f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.923+0000 7fe39959a700 1 -- 172.21.15.72:0/2465887891 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390011830 con 0x7fe39c130e50 2023-10-03T10:13:05.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.924+0000 7fe39959a700 1 -- 172.21.15.72:0/2465887891 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe390011990 con 0x7fe39c130e50 2023-10-03T10:13:05.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.924+0000 7fe39959a700 1 -- 172.21.15.72:0/2465887891 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390011d20 con 0x7fe39c130e50 2023-10-03T10:13:05.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.924+0000 7fe3a0b95700 1 -- 172.21.15.72:0/2465887891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39c130e50 msgr2=0x7fe39c06f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.924+0000 7fe3a0b95700 1 --2- 172.21.15.72:0/2465887891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39c130e50 0x7fe39c06f5e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe390009870 tx=0x7fe390009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.925+0000 7fe3a0b95700 1 -- 172.21.15.72:0/2465887891 shutdown_connections 2023-10-03T10:13:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.925+0000 7fe3a0b95700 1 --2- 172.21.15.72:0/2465887891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39c06fb20 0x7fe39c06ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.925+0000 7fe3a0b95700 1 --2- 172.21.15.72:0/2465887891 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe39c130540 0x7fe39c130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.925+0000 7fe3a0b95700 1 --2- 172.21.15.72:0/2465887891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39c130e50 0x7fe39c06f5e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.925+0000 7fe3a0b95700 1 -- 172.21.15.72:0/2465887891 >> 172.21.15.72:0/2465887891 conn(0x7fe39c0a2aa0 msgr2=0x7fe39c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.925+0000 7fe3a0b95700 1 -- 172.21.15.72:0/2465887891 shutdown_connections 2023-10-03T10:13:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.925+0000 7fe3a0b95700 1 -- 172.21.15.72:0/2465887891 wait complete. 2023-10-03T10:13:05.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.926+0000 7fe3a0b95700 1 Processor -- start 2023-10-03T10:13:05.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.926+0000 7fe3a0b95700 1 -- start start 2023-10-03T10:13:05.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.927+0000 7fe3a0b95700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39c06fb20 0x7fe39c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.927+0000 7fe3a0b95700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe39c130540 0x7fe39c06ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.927+0000 7fe3a0b95700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39c130e50 0x7fe39c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.927+0000 7fe3a0b95700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c09e480 con 0x7fe39c130e50 2023-10-03T10:13:05.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.927+0000 7fe3a0b95700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c12baa0 con 0x7fe39c06fb20 2023-10-03T10:13:05.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.927+0000 7fe3a0b95700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c11b8f0 con 0x7fe39c130540 2023-10-03T10:13:05.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.927+0000 7fe39a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39c06fb20 0x7fe39c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.927+0000 7fe39a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39c06fb20 0x7fe39c06e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39736/0 (socket says 172.21.15.72:39736) 2023-10-03T10:13:05.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.927+0000 7fe39a59c700 1 -- 172.21.15.72:0/2285411011 learned_addr learned my addr 172.21.15.72:0/2285411011 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:05.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.927+0000 7fe39ad9d700 1 --2- 172.21.15.72:0/2285411011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39c130e50 0x7fe39c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.928+0000 7fe39a59c700 1 -- 172.21.15.72:0/2285411011 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe39c130540 msgr2=0x7fe39c06ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.928+0000 7fe39a59c700 1 --2- 172.21.15.72:0/2285411011 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe39c130540 0x7fe39c06ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.928+0000 7fe39a59c700 1 -- 172.21.15.72:0/2285411011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39c130e50 msgr2=0x7fe39c06ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.928+0000 7fe39a59c700 1 --2- 172.21.15.72:0/2285411011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39c130e50 0x7fe39c06ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.928+0000 7fe39a59c700 1 -- 172.21.15.72:0/2285411011 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3900094a0 con 0x7fe39c06fb20 2023-10-03T10:13:05.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.928+0000 7fe39ad9d700 1 --2- 172.21.15.72:0/2285411011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39c130e50 0x7fe39c06ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:05.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.928+0000 7fe39a59c700 1 --2- 172.21.15.72:0/2285411011 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39c06fb20 0x7fe39c06e4d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe38c014fd0 tx=0x7fe38c00b470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.928+0000 7fe38affd700 1 -- 172.21.15.72:0/2285411011 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c019070 con 0x7fe39c06fb20 2023-10-03T10:13:05.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.928+0000 7fe38affd700 1 -- 172.21.15.72:0/2285411011 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c00bdb0 con 0x7fe39c06fb20 2023-10-03T10:13:05.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.928+0000 7fe38affd700 1 -- 172.21.15.72:0/2285411011 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c014a10 con 0x7fe39c06fb20 2023-10-03T10:13:05.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.928+0000 7fe3a0b95700 1 -- 172.21.15.72:0/2285411011 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39c11c520 con 0x7fe39c06fb20 2023-10-03T10:13:05.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.928+0000 7fe3a0b95700 1 -- 172.21.15.72:0/2285411011 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c0a1e30 con 0x7fe39c06fb20 2023-10-03T10:13:05.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.929+0000 7fe3a0b95700 1 -- 172.21.15.72:0/2285411011 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39c0718e0 con 0x7fe39c06fb20 2023-10-03T10:13:05.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.930+0000 7fe38affd700 1 -- 172.21.15.72:0/2285411011 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe38c01d650 con 0x7fe39c06fb20 2023-10-03T10:13:05.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.930+0000 7fe38affd700 1 -- 172.21.15.72:0/2285411011 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe38c047740 con 0x7fe39c06fb20 2023-10-03T10:13:05.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.934+0000 7fe38affd700 1 -- 172.21.15.72:0/2285411011 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe38c0263b0 con 0x7fe39c06fb20 2023-10-03T10:13:05.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.972+0000 7ffa34bc9700 1 Processor -- start 2023-10-03T10:13:05.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.972+0000 7ffa34bc9700 1 -- start start 2023-10-03T10:13:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.973+0000 7ffa34bc9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa3009d630 0x7ffa300a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.973+0000 7ffa34bc9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa30138d80 0x7ffa3013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.973+0000 7ffa34bc9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa300a2a70 con 0x7ffa300a0a30 2023-10-03T10:13:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.973+0000 7ffa34bc9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa300a01d0 con 0x7ffa3009d630 2023-10-03T10:13:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.973+0000 7ffa34bc9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3009e2b0 con 0x7ffa30138d80 2023-10-03T10:13:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.973+0000 7ffa2dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa3009d630 0x7ffa300a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.973+0000 7ffa2ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa30138d80 0x7ffa3013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.973+0000 7ffa2dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa3009d630 0x7ffa300a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42438/0 (socket says 172.21.15.72:42438) 2023-10-03T10:13:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.973+0000 7ffa2dd9b700 1 -- 172.21.15.72:0/1009951657 learned_addr learned my addr 172.21.15.72:0/1009951657 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.974+0000 7ffa2ed9d700 1 -- 172.21.15.72:0/1009951657 >> v2:172.21.15.72:3300/0 conn(0x7ffa3009d630 msgr2=0x7ffa300a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.974+0000 7ffa2ed9d700 1 --2- 172.21.15.72:0/1009951657 >> v2:172.21.15.72:3300/0 conn(0x7ffa3009d630 0x7ffa300a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.974+0000 7ffa2ed9d700 1 -- 172.21.15.72:0/1009951657 >> v1:172.21.15.72:6789/0 conn(0x7ffa300a0a30 legacy=0x7ffa300a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.974+0000 7ffa2ed9d700 1 -- 172.21.15.72:0/1009951657 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3009dc50 con 0x7ffa30138d80 2023-10-03T10:13:05.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.974+0000 7ffa2ed9d700 1 --2- 172.21.15.72:0/1009951657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa30138d80 0x7ffa3013b160 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009d90 tx=0x7ffa2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fa60c02de26cd0c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.974+0000 7ffa2d59a700 1 -- 172.21.15.72:0/1009951657 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800e070 con 0x7ffa30138d80 2023-10-03T10:13:05.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.974+0000 7ffa2d59a700 1 -- 172.21.15.72:0/1009951657 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2800bb20 con 0x7ffa30138d80 2023-10-03T10:13:05.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.974+0000 7ffa2d59a700 1 -- 172.21.15.72:0/1009951657 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28012430 con 0x7ffa30138d80 2023-10-03T10:13:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.975+0000 7ffa34bc9700 1 -- 172.21.15.72:0/1009951657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa30138d80 msgr2=0x7ffa3013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.975+0000 7ffa34bc9700 1 --2- 172.21.15.72:0/1009951657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa30138d80 0x7ffa3013b160 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009d90 tx=0x7ffa2800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.975+0000 7ffa34bc9700 1 -- 172.21.15.72:0/1009951657 shutdown_connections 2023-10-03T10:13:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.975+0000 7ffa34bc9700 1 --2- 172.21.15.72:0/1009951657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa30138d80 0x7ffa3013b160 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.975+0000 7ffa34bc9700 1 --2- 172.21.15.72:0/1009951657 >> v2:172.21.15.72:3300/0 conn(0x7ffa3009d630 0x7ffa300a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.975+0000 7ffa34bc9700 1 -- 172.21.15.72:0/1009951657 >> 172.21.15.72:0/1009951657 conn(0x7ffa300a3050 msgr2=0x7ffa300a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.975+0000 7ffa34bc9700 1 -- 172.21.15.72:0/1009951657 shutdown_connections 2023-10-03T10:13:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.975+0000 7ffa34bc9700 1 -- 172.21.15.72:0/1009951657 wait complete. 2023-10-03T10:13:05.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.976+0000 7ffa34bc9700 1 Processor -- start 2023-10-03T10:13:05.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.976+0000 7ffa34bc9700 1 -- start start 2023-10-03T10:13:05.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.977+0000 7ffa34bc9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa3009d630 0x7ffa301ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.977+0000 7ffa34bc9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa300a0a30 0x7ffa301cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.977+0000 7ffa34bc9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa30138d80 0x7ffa3011c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.977+0000 7ffa34bc9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3011f460 con 0x7ffa30138d80 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.977+0000 7ffa34bc9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa301c0530 con 0x7ffa300a0a30 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.977+0000 7ffa34bc9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300a0410 con 0x7ffa3009d630 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.977+0000 7ffa2ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa30138d80 0x7ffa3011c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.977+0000 7ffa2ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa30138d80 0x7ffa3011c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42454/0 (socket says 172.21.15.72:42454) 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.977+0000 7ffa2ed9d700 1 -- 172.21.15.72:0/2919059674 learned_addr learned my addr 172.21.15.72:0/2919059674 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.977+0000 7ffa2e59c700 1 --2- 172.21.15.72:0/2919059674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa3009d630 0x7ffa301ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.977+0000 7ffa2dd9b700 1 --2- 172.21.15.72:0/2919059674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa300a0a30 0x7ffa301cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.978+0000 7ffa2ed9d700 1 -- 172.21.15.72:0/2919059674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa3009d630 msgr2=0x7ffa301ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.978+0000 7ffa2ed9d700 1 --2- 172.21.15.72:0/2919059674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa3009d630 0x7ffa301ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.978+0000 7ffa2ed9d700 1 -- 172.21.15.72:0/2919059674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa300a0a30 msgr2=0x7ffa301cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:05.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.978+0000 7ffa2ed9d700 1 --2- 172.21.15.72:0/2919059674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa300a0a30 0x7ffa301cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:05.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.978+0000 7ffa2ed9d700 1 -- 172.21.15.72:0/2919059674 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa28009a70 con 0x7ffa30138d80 2023-10-03T10:13:05.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.978+0000 7ffa2ed9d700 1 --2- 172.21.15.72:0/2919059674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa30138d80 0x7ffa3011c7c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffa28013000 tx=0x7ffa28004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:05.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.978+0000 7ffa1effd700 1 -- 172.21.15.72:0/2919059674 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28012430 con 0x7ffa30138d80 2023-10-03T10:13:05.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.978+0000 7ffa1effd700 1 -- 172.21.15.72:0/2919059674 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa28020070 con 0x7ffa30138d80 2023-10-03T10:13:05.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.978+0000 7ffa34bc9700 1 -- 172.21.15.72:0/2919059674 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3011f090 con 0x7ffa30138d80 2023-10-03T10:13:05.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.978+0000 7ffa1effd700 1 -- 172.21.15.72:0/2919059674 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28004280 con 0x7ffa30138d80 2023-10-03T10:13:05.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.978+0000 7ffa34bc9700 1 -- 172.21.15.72:0/2919059674 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa30071770 con 0x7ffa30138d80 2023-10-03T10:13:05.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.979+0000 7ffa1effd700 1 -- 172.21.15.72:0/2919059674 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa280043e0 con 0x7ffa30138d80 2023-10-03T10:13:05.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.980+0000 7ffa1effd700 1 -- 172.21.15.72:0/2919059674 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffa28022070 con 0x7ffa30138d80 2023-10-03T10:13:05.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.980+0000 7ffa34bc9700 1 -- 172.21.15.72:0/2919059674 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa30071710 con 0x7ffa30138d80 2023-10-03T10:13:05.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:05.990+0000 7ffa1effd700 1 -- 172.21.15.72:0/2919059674 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa28004690 con 0x7ffa30138d80 2023-10-03T10:13:06.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.005+0000 7f2769aad700 1 Processor -- start 2023-10-03T10:13:06.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.005+0000 7f2769aad700 1 -- start start 2023-10-03T10:13:06.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.005+0000 7f2769aad700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276406e570 0x7f276406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.005+0000 7f2769aad700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f276409eca0 0x7f276406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.005+0000 7f2769aad700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2764070ee0 con 0x7f2764134610 2023-10-03T10:13:06.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.006+0000 7f2769aad700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2764071480 con 0x7f276409eca0 2023-10-03T10:13:06.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.006+0000 7f2769aad700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276406f3c0 con 0x7f276406e570 2023-10-03T10:13:06.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.006+0000 7f27637fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276406e570 0x7f276406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.006+0000 7f27637fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276406e570 0x7f276406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39770/0 (socket says 172.21.15.72:39770) 2023-10-03T10:13:06.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.006+0000 7f27637fe700 1 -- 172.21.15.72:0/4001692828 learned_addr learned my addr 172.21.15.72:0/4001692828 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:06.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.006+0000 7f2762ffd700 1 --2- 172.21.15.72:0/4001692828 >> v2:172.21.15.72:3300/0 conn(0x7f276409eca0 0x7f276406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.006+0000 7f27637fe700 1 -- 172.21.15.72:0/4001692828 >> v2:172.21.15.72:3300/0 conn(0x7f276409eca0 msgr2=0x7f276406ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:06.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.006+0000 7f27637fe700 1 --2- 172.21.15.72:0/4001692828 >> v2:172.21.15.72:3300/0 conn(0x7f276409eca0 0x7f276406ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.006+0000 7f27637fe700 1 -- 172.21.15.72:0/4001692828 >> v1:172.21.15.72:6789/0 conn(0x7f2764134610 legacy=0x7f2764134a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.006+0000 7f27637fe700 1 -- 172.21.15.72:0/4001692828 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2764071b90 con 0x7f276406e570 2023-10-03T10:13:06.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.006+0000 7f27637fe700 1 --2- 172.21.15.72:0/4001692828 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276406e570 0x7f276406e940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f27540098f0 tx=0x7f2754009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=940c24d5025e07f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:06.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.006+0000 7f27627fc700 1 -- 172.21.15.72:0/4001692828 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754011830 con 0x7f276406e570 2023-10-03T10:13:06.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.006+0000 7f27627fc700 1 -- 172.21.15.72:0/4001692828 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2754011990 con 0x7f276406e570 2023-10-03T10:13:06.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.006+0000 7f27627fc700 1 -- 172.21.15.72:0/4001692828 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754011d20 con 0x7f276406e570 2023-10-03T10:13:06.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.007+0000 7f2769aad700 1 -- 172.21.15.72:0/4001692828 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276406e570 msgr2=0x7f276406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.007+0000 7f2769aad700 1 --2- 172.21.15.72:0/4001692828 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276406e570 0x7f276406e940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f27540098f0 tx=0x7f2754009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:06.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.007+0000 7f2769aad700 1 -- 172.21.15.72:0/4001692828 shutdown_connections 2023-10-03T10:13:06.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.007+0000 7f2769aad700 1 --2- 172.21.15.72:0/4001692828 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276406e570 0x7f276406e940 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.007+0000 7f2769aad700 1 --2- 172.21.15.72:0/4001692828 >> v2:172.21.15.72:3300/0 conn(0x7f276409eca0 0x7f276406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.007+0000 7f2769aad700 1 -- 172.21.15.72:0/4001692828 >> 172.21.15.72:0/4001692828 conn(0x7f27640a2aa0 msgr2=0x7f27640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.007+0000 7f2769aad700 1 -- 172.21.15.72:0/4001692828 shutdown_connections 2023-10-03T10:13:06.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.007+0000 7f2769aad700 1 -- 172.21.15.72:0/4001692828 wait complete. 2023-10-03T10:13:06.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.008+0000 7f2769aad700 1 Processor -- start 2023-10-03T10:13:06.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.008+0000 7f2769aad700 1 -- start start 2023-10-03T10:13:06.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f2769aad700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276406e570 0x7f2764122560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f2769aad700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2764134610 0x7f2764122aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f2769aad700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2764122fe0 0x7f27641cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:06.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f2769aad700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27640a2320 con 0x7f2764122fe0 2023-10-03T10:13:06.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f2769aad700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2764123a10 con 0x7f2764134610 2023-10-03T10:13:06.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f2769aad700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2764125d30 con 0x7f276406e570 2023-10-03T10:13:06.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f27637fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276406e570 0x7f2764122560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f27637fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276406e570 0x7f2764122560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39052/0 (socket says 172.21.15.72:39052) 2023-10-03T10:13:06.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f27637fe700 1 -- 172.21.15.72:0/745926595 learned_addr learned my addr 172.21.15.72:0/745926595 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:06.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f2763fff700 1 --2- 172.21.15.72:0/745926595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2764122fe0 0x7f27641cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f2762ffd700 1 --2- 172.21.15.72:0/745926595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2764134610 0x7f2764122aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:06.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f27637fe700 1 -- 172.21.15.72:0/745926595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2764134610 msgr2=0x7f2764122aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f27637fe700 1 --2- 172.21.15.72:0/745926595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2764134610 0x7f2764122aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f27637fe700 1 -- 172.21.15.72:0/745926595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2764122fe0 msgr2=0x7f27641cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f27637fe700 1 --2- 172.21.15.72:0/745926595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2764122fe0 0x7f27641cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.009+0000 7f27637fe700 1 -- 172.21.15.72:0/745926595 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2754009550 con 0x7f276406e570 2023-10-03T10:13:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.010+0000 7f27637fe700 1 --2- 172.21.15.72:0/745926595 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276406e570 0x7f2764122560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2754009c40 tx=0x7f2754004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.010+0000 7f274bfff700 1 -- 172.21.15.72:0/745926595 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754004480 con 0x7f276406e570 2023-10-03T10:13:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.010+0000 7f274bfff700 1 -- 172.21.15.72:0/745926595 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275401f070 con 0x7f276406e570 2023-10-03T10:13:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.010+0000 7f274bfff700 1 -- 172.21.15.72:0/745926595 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27540038e0 con 0x7f276406e570 2023-10-03T10:13:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.010+0000 7f2769aad700 1 -- 172.21.15.72:0/745926595 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27641246b0 con 0x7f276406e570 2023-10-03T10:13:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.010+0000 7f2769aad700 1 -- 172.21.15.72:0/745926595 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27641248f0 con 0x7f276406e570 2023-10-03T10:13:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.011+0000 7f274bfff700 1 -- 172.21.15.72:0/745926595 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2754021030 con 0x7f276406e570 2023-10-03T10:13:06.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.011+0000 7f274bfff700 1 -- 172.21.15.72:0/745926595 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f27540444f0 con 0x7f276406e570 2023-10-03T10:13:06.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.011+0000 7f2769aad700 1 -- 172.21.15.72:0/745926595 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2764125e70 con 0x7f276406e570 2023-10-03T10:13:06.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.016+0000 7f274bfff700 1 -- 172.21.15.72:0/745926595 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2764125e70 con 0x7f276406e570 2023-10-03T10:13:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.134+0000 7fe3a0b95700 1 -- 172.21.15.72:0/2285411011 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe39c074ea0 con 0x7fe39c06fb20 2023-10-03T10:13:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.135+0000 7fe38affd700 1 -- 172.21.15.72:0/2285411011 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe38c022020 con 0x7fe39c06fb20 2023-10-03T10:13:06.135 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.138+0000 7fe3a0b95700 1 -- 172.21.15.72:0/2285411011 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39c06fb20 msgr2=0x7fe39c06e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.138+0000 7fe3a0b95700 1 --2- 172.21.15.72:0/2285411011 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39c06fb20 0x7fe39c06e4d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe38c014fd0 tx=0x7fe38c00b470 comp rx=0 tx=0).stop 2023-10-03T10:13:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.138+0000 7fe3a0b95700 1 -- 172.21.15.72:0/2285411011 shutdown_connections 2023-10-03T10:13:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.138+0000 7fe3a0b95700 1 --2- 172.21.15.72:0/2285411011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39c130e50 0x7fe39c06ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.138+0000 7fe3a0b95700 1 --2- 172.21.15.72:0/2285411011 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39c06fb20 0x7fe39c06e4d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.138+0000 7fe3a0b95700 1 --2- 172.21.15.72:0/2285411011 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe39c130540 0x7fe39c06ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.138+0000 7fe3a0b95700 1 -- 172.21.15.72:0/2285411011 >> 172.21.15.72:0/2285411011 conn(0x7fe39c0a2aa0 msgr2=0x7fe39c12d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.138+0000 7fe3a0b95700 1 -- 172.21.15.72:0/2285411011 shutdown_connections 2023-10-03T10:13:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.138+0000 7fe3a0b95700 1 -- 172.21.15.72:0/2285411011 wait complete. 2023-10-03T10:13:06.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.138+0000 7fc774146700 1 -- 172.21.15.72:0/2799944561 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc76c074ea0 con 0x7fc76c09e1d0 2023-10-03T10:13:06.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.139+0000 7fc7627fc700 1 -- 172.21.15.72:0/2799944561 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc75c015030 con 0x7fc76c09e1d0 2023-10-03T10:13:06.140 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.142+0000 7fc774146700 1 -- 172.21.15.72:0/2799944561 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc76c09e1d0 msgr2=0x7fc76c1218b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.142+0000 7fc774146700 1 --2- 172.21.15.72:0/2799944561 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc76c09e1d0 0x7fc76c1218b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0090b0 tx=0x7fc75c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.142+0000 7fc774146700 1 -- 172.21.15.72:0/2799944561 shutdown_connections 2023-10-03T10:13:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.142+0000 7fc774146700 1 --2- 172.21.15.72:0/2799944561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc76c09d6f0 0x7fc76c121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.142+0000 7fc774146700 1 --2- 172.21.15.72:0/2799944561 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76c139170 0x7fc76c1c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.142+0000 7fc774146700 1 --2- 172.21.15.72:0/2799944561 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc76c09e1d0 0x7fc76c1218b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.142+0000 7fc774146700 1 -- 172.21.15.72:0/2799944561 >> 172.21.15.72:0/2799944561 conn(0x7fc76c066f50 msgr2=0x7fc76c136b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.142+0000 7fc774146700 1 -- 172.21.15.72:0/2799944561 shutdown_connections 2023-10-03T10:13:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.142+0000 7fc774146700 1 -- 172.21.15.72:0/2799944561 wait complete. 2023-10-03T10:13:06.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:06.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:06.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.217+0000 7ffa34bc9700 1 -- 172.21.15.72:0/2919059674 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffa300747f0 con 0x7ffa30138d80 2023-10-03T10:13:06.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.217+0000 7ffa1effd700 1 -- 172.21.15.72:0/2919059674 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa2801a380 con 0x7ffa30138d80 2023-10-03T10:13:06.218 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:06.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.219+0000 7ffa34bc9700 1 -- 172.21.15.72:0/2919059674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa30138d80 msgr2=0x7ffa3011c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.219+0000 7ffa34bc9700 1 --2- 172.21.15.72:0/2919059674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa30138d80 0x7ffa3011c7c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffa28013000 tx=0x7ffa28004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.219+0000 7ffa34bc9700 1 -- 172.21.15.72:0/2919059674 shutdown_connections 2023-10-03T10:13:06.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.219+0000 7ffa34bc9700 1 --2- 172.21.15.72:0/2919059674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa30138d80 0x7ffa3011c7c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.219+0000 7ffa34bc9700 1 --2- 172.21.15.72:0/2919059674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa3009d630 0x7ffa301ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.219+0000 7ffa34bc9700 1 --2- 172.21.15.72:0/2919059674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa300a0a30 0x7ffa301cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.219+0000 7ffa34bc9700 1 -- 172.21.15.72:0/2919059674 >> 172.21.15.72:0/2919059674 conn(0x7ffa300a3050 msgr2=0x7ffa30099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.219+0000 7ffa34bc9700 1 -- 172.21.15.72:0/2919059674 shutdown_connections 2023-10-03T10:13:06.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.219+0000 7ffa34bc9700 1 -- 172.21.15.72:0/2919059674 wait complete. 2023-10-03T10:13:06.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.221+0000 7f2769aad700 1 -- 172.21.15.72:0/745926595 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f27641259b0 con 0x7f276406e570 2023-10-03T10:13:06.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.222+0000 7f274bfff700 1 -- 172.21.15.72:0/745926595 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f27641259b0 con 0x7f276406e570 2023-10-03T10:13:06.222 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:06.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.224+0000 7f2769aad700 1 -- 172.21.15.72:0/745926595 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276406e570 msgr2=0x7f2764122560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:06.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.224+0000 7f2769aad700 1 --2- 172.21.15.72:0/745926595 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276406e570 0x7f2764122560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2754009c40 tx=0x7f2754004750 comp rx=0 tx=0).stop 2023-10-03T10:13:06.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.224+0000 7f2769aad700 1 -- 172.21.15.72:0/745926595 shutdown_connections 2023-10-03T10:13:06.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.224+0000 7f2769aad700 1 --2- 172.21.15.72:0/745926595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2764122fe0 0x7f27641cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.224+0000 7f2769aad700 1 --2- 172.21.15.72:0/745926595 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276406e570 0x7f2764122560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.224+0000 7f2769aad700 1 --2- 172.21.15.72:0/745926595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2764134610 0x7f2764122aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:06.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.224+0000 7f2769aad700 1 -- 172.21.15.72:0/745926595 >> 172.21.15.72:0/745926595 conn(0x7f27640a2aa0 msgr2=0x7f27640a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:06.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.224+0000 7f2769aad700 1 -- 172.21.15.72:0/745926595 shutdown_connections 2023-10-03T10:13:06.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:06.224+0000 7f2769aad700 1 -- 172.21.15.72:0/745926595 wait complete. 2023-10-03T10:13:06.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:06.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:07.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:07.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:07.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:07.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:07.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.306+0000 7fb5e93dd700 1 Processor -- start 2023-10-03T10:13:07.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.306+0000 7fb5e93dd700 1 -- start start 2023-10-03T10:13:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.307+0000 7fb5e93dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e41337f0 0x7fb5e4138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.307+0000 7fb5e93dd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e4138dc0 0x7fb5e413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.307+0000 7fb5e93dd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e406b990 con 0x7fb5e4133420 2023-10-03T10:13:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.307+0000 7fb5e93dd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e409b0e0 con 0x7fb5e4138dc0 2023-10-03T10:13:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.307+0000 7fb5e93dd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e4133c20 con 0x7fb5e41337f0 2023-10-03T10:13:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.307+0000 7fb5e2ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb5e4133420 0x7fb5e4133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57406/0 (socket says 172.21.15.72:57406) 2023-10-03T10:13:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.307+0000 7fb5e27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e41337f0 0x7fb5e4138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.307+0000 7fb5e2ffd700 1 -- 172.21.15.72:0/2864147866 learned_addr learned my addr 172.21.15.72:0/2864147866 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.307+0000 7fb5e37fe700 1 --2- 172.21.15.72:0/2864147866 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e4138dc0 0x7fb5e413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.308+0000 7fb5e37fe700 1 -- 172.21.15.72:0/2864147866 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e41337f0 msgr2=0x7fb5e4138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.308+0000 7fb5e37fe700 1 --2- 172.21.15.72:0/2864147866 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e41337f0 0x7fb5e4138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.308+0000 7fb5e37fe700 1 -- 172.21.15.72:0/2864147866 >> v1:172.21.15.72:6789/0 conn(0x7fb5e4133420 legacy=0x7fb5e4133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.308+0000 7fb5e37fe700 1 -- 172.21.15.72:0/2864147866 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e40a0590 con 0x7fb5e4138dc0 2023-10-03T10:13:07.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.308+0000 7fb5e37fe700 1 --2- 172.21.15.72:0/2864147866 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e4138dc0 0x7fb5e413b1a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009dc0 tx=0x7fb5dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f07bab2fcc5cd4b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.308+0000 7fb5e1ffb700 1 -- 172.21.15.72:0/2864147866 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc00e070 con 0x7fb5e4138dc0 2023-10-03T10:13:07.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.308+0000 7fb5e1ffb700 1 -- 172.21.15.72:0/2864147866 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc00bbd0 con 0x7fb5e4138dc0 2023-10-03T10:13:07.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.308+0000 7fb5e1ffb700 1 -- 172.21.15.72:0/2864147866 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc012430 con 0x7fb5e4138dc0 2023-10-03T10:13:07.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.309+0000 7fb5e93dd700 1 -- 172.21.15.72:0/2864147866 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e4138dc0 msgr2=0x7fb5e413b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.309+0000 7fb5e93dd700 1 --2- 172.21.15.72:0/2864147866 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e4138dc0 0x7fb5e413b1a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009dc0 tx=0x7fb5dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.309+0000 7fb5e93dd700 1 -- 172.21.15.72:0/2864147866 shutdown_connections 2023-10-03T10:13:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.309+0000 7fb5e93dd700 1 --2- 172.21.15.72:0/2864147866 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e4138dc0 0x7fb5e413b1a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.309+0000 7fb5e93dd700 1 --2- 172.21.15.72:0/2864147866 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e41337f0 0x7fb5e4138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.309+0000 7fb5e93dd700 1 -- 172.21.15.72:0/2864147866 >> 172.21.15.72:0/2864147866 conn(0x7fb5e40a4210 msgr2=0x7fb5e40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.309+0000 7fb5e93dd700 1 -- 172.21.15.72:0/2864147866 shutdown_connections 2023-10-03T10:13:07.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.309+0000 7fb5e93dd700 1 -- 172.21.15.72:0/2864147866 wait complete. 2023-10-03T10:13:07.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.311+0000 7fb5e93dd700 1 Processor -- start 2023-10-03T10:13:07.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.311+0000 7fb5e93dd700 1 -- start start 2023-10-03T10:13:07.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.311+0000 7fb5e93dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e4133420 0x7fb5e4137a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.311+0000 7fb5e93dd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e41337f0 0x7fb5e4137f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.311+0000 7fb5e93dd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e4138dc0 0x7fb5e409c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.311+0000 7fb5e93dd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e4138930 con 0x7fb5e41337f0 2023-10-03T10:13:07.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.311+0000 7fb5e93dd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e4134650 con 0x7fb5e4138dc0 2023-10-03T10:13:07.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.311+0000 7fb5e93dd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e41384c0 con 0x7fb5e4133420 2023-10-03T10:13:07.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.312+0000 7fb5e2ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e4133420 0x7fb5e4137a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.312+0000 7fb5e27fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e41337f0 0x7fb5e4137f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.312+0000 7fb5e2ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e4133420 0x7fb5e4137a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39082/0 (socket says 172.21.15.72:39082) 2023-10-03T10:13:07.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.312+0000 7fb5e2ffd700 1 -- 172.21.15.72:0/3799042505 learned_addr learned my addr 172.21.15.72:0/3799042505 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:07.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.312+0000 7fb5e37fe700 1 --2- 172.21.15.72:0/3799042505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e4138dc0 0x7fb5e409c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.312+0000 7fb5e37fe700 1 -- 172.21.15.72:0/3799042505 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e4133420 msgr2=0x7fb5e4137a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.312+0000 7fb5e37fe700 1 --2- 172.21.15.72:0/3799042505 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e4133420 0x7fb5e4137a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.312+0000 7fb5e37fe700 1 -- 172.21.15.72:0/3799042505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e41337f0 msgr2=0x7fb5e4137f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.312+0000 7fb5e37fe700 1 --2- 172.21.15.72:0/3799042505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e41337f0 0x7fb5e4137f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.312+0000 7fb5e37fe700 1 -- 172.21.15.72:0/3799042505 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc009a70 con 0x7fb5e4138dc0 2023-10-03T10:13:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.312+0000 7fb5e27fc700 1 --2- 172.21.15.72:0/3799042505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e41337f0 0x7fb5e4137f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.312+0000 7fb5e37fe700 1 --2- 172.21.15.72:0/3799042505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e4138dc0 0x7fb5e409c500 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4072a30 tx=0x7fb5dc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.312+0000 7fb5cb7fe700 1 -- 172.21.15.72:0/3799042505 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc012430 con 0x7fb5e4138dc0 2023-10-03T10:13:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.312+0000 7fb5cb7fe700 1 -- 172.21.15.72:0/3799042505 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc020070 con 0x7fb5e4138dc0 2023-10-03T10:13:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.312+0000 7fb5cb7fe700 1 -- 172.21.15.72:0/3799042505 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0276c0 con 0x7fb5e4138dc0 2023-10-03T10:13:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.313+0000 7fb5e93dd700 1 -- 172.21.15.72:0/3799042505 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e412f1c0 con 0x7fb5e4138dc0 2023-10-03T10:13:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.313+0000 7fb5e93dd700 1 -- 172.21.15.72:0/3799042505 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e4130af0 con 0x7fb5e4138dc0 2023-10-03T10:13:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.314+0000 7fb5cb7fe700 1 -- 172.21.15.72:0/3799042505 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5dc003f00 con 0x7fb5e4138dc0 2023-10-03T10:13:07.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.314+0000 7fb5cb7fe700 1 -- 172.21.15.72:0/3799042505 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb5dc022070 con 0x7fb5e4138dc0 2023-10-03T10:13:07.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.315+0000 7fb5e93dd700 1 -- 172.21.15.72:0/3799042505 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e409d960 con 0x7fb5e4138dc0 2023-10-03T10:13:07.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.319+0000 7fb5cb7fe700 1 -- 172.21.15.72:0/3799042505 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5dc01a790 con 0x7fb5e4138dc0 2023-10-03T10:13:07.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.350+0000 7f355d2a1700 1 Processor -- start 2023-10-03T10:13:07.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.351+0000 7f355d2a1700 1 -- start start 2023-10-03T10:13:07.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.351+0000 7f355d2a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3558066410 0x7f355806e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.351+0000 7f355d2a1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f355806eb80 0x7f355806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.351+0000 7f355d2a1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3558099b50 con 0x7f355812f320 2023-10-03T10:13:07.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.351+0000 7f355d2a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35580667e0 con 0x7f3558066410 2023-10-03T10:13:07.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.351+0000 7f355d2a1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3558099f60 con 0x7f355806eb80 2023-10-03T10:13:07.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.351+0000 7f3556ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3558066410 0x7f355806e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.351+0000 7f35567fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f355806eb80 0x7f355806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.351+0000 7f35567fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f355806eb80 0x7f355806ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39086/0 (socket says 172.21.15.72:39086) 2023-10-03T10:13:07.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.351+0000 7f3556ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3558066410 0x7f355806e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39798/0 (socket says 172.21.15.72:39798) 2023-10-03T10:13:07.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.351+0000 7f35567fc700 1 -- 172.21.15.72:0/770893093 learned_addr learned my addr 172.21.15.72:0/770893093 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:07.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.352+0000 7f35567fc700 1 -- 172.21.15.72:0/770893093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3558066410 msgr2=0x7f355806e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.352+0000 7f35567fc700 1 --2- 172.21.15.72:0/770893093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3558066410 0x7f355806e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.352+0000 7f35567fc700 1 -- 172.21.15.72:0/770893093 >> v1:172.21.15.72:6789/0 conn(0x7f355812f320 legacy=0x7f355812f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.352+0000 7f35567fc700 1 -- 172.21.15.72:0/770893093 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355809a920 con 0x7f355806eb80 2023-10-03T10:13:07.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.352+0000 7f35567fc700 1 --2- 172.21.15.72:0/770893093 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f355806eb80 0x7f355806ef70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f354c009950 tx=0x7f354c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75175b684c88a60f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.352+0000 7f3555ffb700 1 -- 172.21.15.72:0/770893093 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c004230 con 0x7f355806eb80 2023-10-03T10:13:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.352+0000 7f3555ffb700 1 -- 172.21.15.72:0/770893093 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c004390 con 0x7f355806eb80 2023-10-03T10:13:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.352+0000 7f3555ffb700 1 -- 172.21.15.72:0/770893093 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0036a0 con 0x7f355806eb80 2023-10-03T10:13:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.353+0000 7f355d2a1700 1 -- 172.21.15.72:0/770893093 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f355806eb80 msgr2=0x7f355806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.353+0000 7f355d2a1700 1 --2- 172.21.15.72:0/770893093 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f355806eb80 0x7f355806ef70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f354c009950 tx=0x7f354c009c60 comp rx=0 tx=0).stop 2023-10-03T10:13:07.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.353+0000 7f355d2a1700 1 -- 172.21.15.72:0/770893093 shutdown_connections 2023-10-03T10:13:07.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.353+0000 7f355d2a1700 1 --2- 172.21.15.72:0/770893093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3558066410 0x7f355806e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.353+0000 7f355d2a1700 1 --2- 172.21.15.72:0/770893093 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f355806eb80 0x7f355806ef70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.353+0000 7f355d2a1700 1 -- 172.21.15.72:0/770893093 >> 172.21.15.72:0/770893093 conn(0x7f35580a2aa0 msgr2=0x7f35580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.353+0000 7f355d2a1700 1 -- 172.21.15.72:0/770893093 shutdown_connections 2023-10-03T10:13:07.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.353+0000 7f355d2a1700 1 -- 172.21.15.72:0/770893093 wait complete. 2023-10-03T10:13:07.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.354+0000 7f355d2a1700 1 Processor -- start 2023-10-03T10:13:07.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.354+0000 7f355d2a1700 1 -- start start 2023-10-03T10:13:07.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.355+0000 7f355d2a1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3558066410 0x7f35581195e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.355+0000 7f355d2a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f355806eb80 0x7f3558119b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.355+0000 7f355d2a1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f355812f320 0x7f355811a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.355+0000 7f355d2a1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355811c890 con 0x7f355812f320 2023-10-03T10:13:07.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.355+0000 7f355d2a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355809a180 con 0x7f355806eb80 2023-10-03T10:13:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.355+0000 7f355d2a1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f355809fb30 con 0x7f3558066410 2023-10-03T10:13:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.355+0000 7f35577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f355812f320 0x7f355811a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.355+0000 7f35577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f355812f320 0x7f355811a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42478/0 (socket says 172.21.15.72:42478) 2023-10-03T10:13:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.355+0000 7f35567fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f355806eb80 0x7f3558119b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.355+0000 7f35577fe700 1 -- 172.21.15.72:0/646669656 learned_addr learned my addr 172.21.15.72:0/646669656 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.355+0000 7f3556ffd700 1 --2- 172.21.15.72:0/646669656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3558066410 0x7f35581195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.355+0000 7f35567fc700 1 -- 172.21.15.72:0/646669656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3558066410 msgr2=0x7f35581195e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.355+0000 7f35567fc700 1 --2- 172.21.15.72:0/646669656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3558066410 0x7f35581195e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.355+0000 7f35567fc700 1 -- 172.21.15.72:0/646669656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f355812f320 msgr2=0x7f355811a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.355+0000 7f35567fc700 1 --2- 172.21.15.72:0/646669656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f355812f320 0x7f355811a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.356+0000 7f35567fc700 1 -- 172.21.15.72:0/646669656 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c009550 con 0x7f355806eb80 2023-10-03T10:13:07.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.356+0000 7f35577fe700 1 --2- 172.21.15.72:0/646669656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f355812f320 0x7f355811a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:07.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.356+0000 7f35567fc700 1 --2- 172.21.15.72:0/646669656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f355806eb80 0x7f3558119b20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f354c015000 tx=0x7f354c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.356+0000 7f353f7fe700 1 -- 172.21.15.72:0/646669656 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c003c10 con 0x7f355806eb80 2023-10-03T10:13:07.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.356+0000 7f353f7fe700 1 -- 172.21.15.72:0/646669656 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c01f070 con 0x7f355806eb80 2023-10-03T10:13:07.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.356+0000 7f355d2a1700 1 -- 172.21.15.72:0/646669656 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f355811b1f0 con 0x7f355806eb80 2023-10-03T10:13:07.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.356+0000 7f353f7fe700 1 -- 172.21.15.72:0/646669656 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c011630 con 0x7f355806eb80 2023-10-03T10:13:07.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.356+0000 7f355d2a1700 1 -- 172.21.15.72:0/646669656 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355811d600 con 0x7f355806eb80 2023-10-03T10:13:07.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.357+0000 7f353f7fe700 1 -- 172.21.15.72:0/646669656 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f354c021030 con 0x7f355806eb80 2023-10-03T10:13:07.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.357+0000 7f353f7fe700 1 -- 172.21.15.72:0/646669656 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f354c01a460 con 0x7f355806eb80 2023-10-03T10:13:07.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.358+0000 7f355d2a1700 1 -- 172.21.15.72:0/646669656 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355811cac0 con 0x7f355806eb80 2023-10-03T10:13:07.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.362+0000 7f353f7fe700 1 -- 172.21.15.72:0/646669656 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f355811cac0 con 0x7f355806eb80 2023-10-03T10:13:07.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.373+0000 7f3d8bc5b700 1 Processor -- start 2023-10-03T10:13:07.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.373+0000 7f3d8bc5b700 1 -- start start 2023-10-03T10:13:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d8bc5b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d840a0a30 0x7f3d840a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d8bc5b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d84134000 0x7f3d8413bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d8bc5b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8409eaf0 con 0x7f3d840a1340 2023-10-03T10:13:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d8bc5b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d840a27c0 con 0x7f3d84134000 2023-10-03T10:13:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d8bc5b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8409dbe0 con 0x7f3d840a0a30 2023-10-03T10:13:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d8a1f8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d84134000 0x7f3d8413bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d891f6700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3d840a1340 0x7f3d841338f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57420/0 (socket says 172.21.15.72:57420) 2023-10-03T10:13:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d8a1f8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d84134000 0x7f3d8413bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42482/0 (socket says 172.21.15.72:42482) 2023-10-03T10:13:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d891f6700 1 -- 172.21.15.72:0/2012224472 learned_addr learned my addr 172.21.15.72:0/2012224472 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d899f7700 1 --2- 172.21.15.72:0/2012224472 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d840a0a30 0x7f3d840a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d8a1f8700 1 -- 172.21.15.72:0/2012224472 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d840a0a30 msgr2=0x7f3d840a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d8a1f8700 1 --2- 172.21.15.72:0/2012224472 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d840a0a30 0x7f3d840a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d8a1f8700 1 -- 172.21.15.72:0/2012224472 >> v1:172.21.15.72:6789/0 conn(0x7f3d840a1340 legacy=0x7f3d841338f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d8a1f8700 1 -- 172.21.15.72:0/2012224472 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d840a1f90 con 0x7f3d84134000 2023-10-03T10:13:07.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d889f5700 1 -- 172.21.15.72:0/2012224472 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592651074 0 0) 0x7f3d74001110 con 0x7f3d840a1340 2023-10-03T10:13:07.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d899f7700 1 --2- 172.21.15.72:0/2012224472 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d840a0a30 0x7f3d840a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:07.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.374+0000 7f3d8a1f8700 1 --2- 172.21.15.72:0/2012224472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d84134000 0x7f3d8413bb50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009d90 tx=0x7f3d7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622f053c7146e44c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.375+0000 7f3d889f5700 1 -- 172.21.15.72:0/2012224472 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c00e070 con 0x7f3d84134000 2023-10-03T10:13:07.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.375+0000 7f3d889f5700 1 -- 172.21.15.72:0/2012224472 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c00bb20 con 0x7f3d84134000 2023-10-03T10:13:07.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.375+0000 7f3d889f5700 1 -- 172.21.15.72:0/2012224472 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c012430 con 0x7f3d84134000 2023-10-03T10:13:07.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.376+0000 7f3d8bc5b700 1 -- 172.21.15.72:0/2012224472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d84134000 msgr2=0x7f3d8413bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.376+0000 7f3d8bc5b700 1 --2- 172.21.15.72:0/2012224472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d84134000 0x7f3d8413bb50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009d90 tx=0x7f3d7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:07.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.376+0000 7f3d8bc5b700 1 -- 172.21.15.72:0/2012224472 shutdown_connections 2023-10-03T10:13:07.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.376+0000 7f3d8bc5b700 1 --2- 172.21.15.72:0/2012224472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d84134000 0x7f3d8413bb50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.376+0000 7f3d8bc5b700 1 --2- 172.21.15.72:0/2012224472 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d840a0a30 0x7f3d840a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.376+0000 7f3d8bc5b700 1 -- 172.21.15.72:0/2012224472 >> 172.21.15.72:0/2012224472 conn(0x7f3d840a6550 msgr2=0x7f3d840a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.376+0000 7f3d8bc5b700 1 -- 172.21.15.72:0/2012224472 shutdown_connections 2023-10-03T10:13:07.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.376+0000 7f3d8bc5b700 1 -- 172.21.15.72:0/2012224472 wait complete. 2023-10-03T10:13:07.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.377+0000 7f3d8bc5b700 1 Processor -- start 2023-10-03T10:13:07.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.377+0000 7f3d8bc5b700 1 -- start start 2023-10-03T10:13:07.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d8bc5b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d840a0a30 0x7f3d84122630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d8bc5b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d840a1340 0x7f3d84122b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d8bc5b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d84134000 0x7f3d841230b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d8bc5b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d841338c0 con 0x7f3d840a1340 2023-10-03T10:13:07.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d8bc5b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d840a02e0 con 0x7f3d840a0a30 2023-10-03T10:13:07.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d8bc5b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d84124240 con 0x7f3d84134000 2023-10-03T10:13:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d891f6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d840a1340 0x7f3d84122b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d8a1f8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d84134000 0x7f3d841230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d891f6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d840a1340 0x7f3d84122b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42496/0 (socket says 172.21.15.72:42496) 2023-10-03T10:13:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d891f6700 1 -- 172.21.15.72:0/4114183762 learned_addr learned my addr 172.21.15.72:0/4114183762 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:07.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d899f7700 1 --2- 172.21.15.72:0/4114183762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d840a0a30 0x7f3d84122630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d891f6700 1 -- 172.21.15.72:0/4114183762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d84134000 msgr2=0x7f3d841230b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d891f6700 1 --2- 172.21.15.72:0/4114183762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d84134000 0x7f3d841230b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d891f6700 1 -- 172.21.15.72:0/4114183762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d840a0a30 msgr2=0x7f3d84122630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d891f6700 1 --2- 172.21.15.72:0/4114183762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d840a0a30 0x7f3d84122630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.378+0000 7f3d891f6700 1 -- 172.21.15.72:0/4114183762 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d800094a0 con 0x7f3d840a1340 2023-10-03T10:13:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.379+0000 7f3d891f6700 1 --2- 172.21.15.72:0/4114183762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d840a1340 0x7f3d84122b70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3d74001eb0 tx=0x7f3d7400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.379+0000 7f3d7a7fc700 1 -- 172.21.15.72:0/4114183762 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74004c80 con 0x7f3d840a1340 2023-10-03T10:13:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.379+0000 7f3d7a7fc700 1 -- 172.21.15.72:0/4114183762 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d74004de0 con 0x7f3d840a1340 2023-10-03T10:13:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.379+0000 7f3d7a7fc700 1 -- 172.21.15.72:0/4114183762 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74007310 con 0x7f3d840a1340 2023-10-03T10:13:07.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.379+0000 7f3d8bc5b700 1 -- 172.21.15.72:0/4114183762 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d7c009a70 con 0x7f3d840a1340 2023-10-03T10:13:07.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.379+0000 7f3d8bc5b700 1 -- 172.21.15.72:0/4114183762 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8409d710 con 0x7f3d840a1340 2023-10-03T10:13:07.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.380+0000 7f3d7a7fc700 1 -- 172.21.15.72:0/4114183762 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d74007470 con 0x7f3d840a1340 2023-10-03T10:13:07.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.380+0000 7fe8c0417700 1 Processor -- start 2023-10-03T10:13:07.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.380+0000 7fe8c0417700 1 -- start start 2023-10-03T10:13:07.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.380+0000 7f3d8bc5b700 1 -- 172.21.15.72:0/4114183762 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8409eaf0 con 0x7f3d840a1340 2023-10-03T10:13:07.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.380+0000 7f3d7a7fc700 1 -- 172.21.15.72:0/4114183762 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3d740119b0 con 0x7f3d840a1340 2023-10-03T10:13:07.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.381+0000 7fe8c0417700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8b81316c0 0x7fe8b8131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.381+0000 7fe8c0417700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8b806ae80 0x7fe8b8139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.381+0000 7fe8c0417700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b809e130 con 0x7fe8b809d9f0 2023-10-03T10:13:07.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.381+0000 7fe8c0417700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b81312b0 con 0x7fe8b806ae80 2023-10-03T10:13:07.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.381+0000 7fe8c0417700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b809f6e0 con 0x7fe8b81316c0 2023-10-03T10:13:07.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.381+0000 7fe8be1b3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8b81316c0 0x7fe8b8131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.381+0000 7fe8be1b3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8b81316c0 0x7fe8b8131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39124/0 (socket says 172.21.15.72:39124) 2023-10-03T10:13:07.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.381+0000 7fe8be1b3700 1 -- 172.21.15.72:0/1767664239 learned_addr learned my addr 172.21.15.72:0/1767664239 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:07.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.381+0000 7fe8be9b4700 1 --2- 172.21.15.72:0/1767664239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8b806ae80 0x7fe8b8139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.381+0000 7fe8be1b3700 1 -- 172.21.15.72:0/1767664239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8b806ae80 msgr2=0x7fe8b8139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.381+0000 7fe8be1b3700 1 --2- 172.21.15.72:0/1767664239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8b806ae80 0x7fe8b8139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.381+0000 7fe8be1b3700 1 -- 172.21.15.72:0/1767664239 >> v1:172.21.15.72:6789/0 conn(0x7fe8b809d9f0 legacy=0x7fe8b806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.381+0000 7fe8be1b3700 1 -- 172.21.15.72:0/1767664239 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b809e760 con 0x7fe8b81316c0 2023-10-03T10:13:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.381+0000 7fe8be1b3700 1 --2- 172.21.15.72:0/1767664239 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8b81316c0 0x7fe8b8131a90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4013210 tx=0x7fe8b4013520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=179e73d1e9124a95 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.382+0000 7fe8bd1b1700 1 -- 172.21.15.72:0/1767664239 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4016070 con 0x7fe8b81316c0 2023-10-03T10:13:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.382+0000 7fe8bd1b1700 1 -- 172.21.15.72:0/1767664239 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b4013d70 con 0x7fe8b81316c0 2023-10-03T10:13:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.382+0000 7fe8bd1b1700 1 -- 172.21.15.72:0/1767664239 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4004250 con 0x7fe8b81316c0 2023-10-03T10:13:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.382+0000 7fe8c0417700 1 -- 172.21.15.72:0/1767664239 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8b81316c0 msgr2=0x7fe8b8131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.382+0000 7fe8c0417700 1 --2- 172.21.15.72:0/1767664239 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8b81316c0 0x7fe8b8131a90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4013210 tx=0x7fe8b4013520 comp rx=0 tx=0).stop 2023-10-03T10:13:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.382+0000 7fe8c0417700 1 -- 172.21.15.72:0/1767664239 shutdown_connections 2023-10-03T10:13:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.382+0000 7fe8c0417700 1 --2- 172.21.15.72:0/1767664239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8b806ae80 0x7fe8b8139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.382+0000 7fe8c0417700 1 --2- 172.21.15.72:0/1767664239 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8b81316c0 0x7fe8b8131a90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.382+0000 7fe8c0417700 1 -- 172.21.15.72:0/1767664239 >> 172.21.15.72:0/1767664239 conn(0x7fe8b8066f50 msgr2=0x7fe8b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.383+0000 7fe8c0417700 1 -- 172.21.15.72:0/1767664239 shutdown_connections 2023-10-03T10:13:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.383+0000 7fe8c0417700 1 -- 172.21.15.72:0/1767664239 wait complete. 2023-10-03T10:13:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.383+0000 7fe8c0417700 1 Processor -- start 2023-10-03T10:13:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.383+0000 7fe8c0417700 1 -- start start 2023-10-03T10:13:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8c0417700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8b806ae80 0x7fe8b806eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8c0417700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8b809d9f0 0x7fe8b806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8c0417700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8b81316c0 0x7fe8b806f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:07.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8c0417700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b8070df0 con 0x7fe8b806ae80 2023-10-03T10:13:07.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8c0417700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b8072430 con 0x7fe8b809d9f0 2023-10-03T10:13:07.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8c0417700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80a3540 con 0x7fe8b81316c0 2023-10-03T10:13:07.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8bd9b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8b809d9f0 0x7fe8b806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8bd9b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8b809d9f0 0x7fe8b806f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39846/0 (socket says 172.21.15.72:39846) 2023-10-03T10:13:07.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8bd9b2700 1 -- 172.21.15.72:0/3920388414 learned_addr learned my addr 172.21.15.72:0/3920388414 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:07.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8be9b4700 1 --2- 172.21.15.72:0/3920388414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8b81316c0 0x7fe8b806f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:07.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8bd9b2700 1 -- 172.21.15.72:0/3920388414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8b81316c0 msgr2=0x7fe8b806f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8bd9b2700 1 --2- 172.21.15.72:0/3920388414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8b81316c0 0x7fe8b806f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8bd9b2700 1 -- 172.21.15.72:0/3920388414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8b806ae80 msgr2=0x7fe8b806eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8bd9b2700 1 --2- 172.21.15.72:0/3920388414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8b806ae80 0x7fe8b806eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8bd9b2700 1 -- 172.21.15.72:0/3920388414 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b4011df0 con 0x7fe8b809d9f0 2023-10-03T10:13:07.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8be9b4700 1 --2- 172.21.15.72:0/3920388414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8b81316c0 0x7fe8b806f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:07.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.384+0000 7fe8bd9b2700 1 --2- 172.21.15.72:0/3920388414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8b809d9f0 0x7fe8b806f080 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800c450 tx=0x7fe8a800c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:07.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.385+0000 7fe8aeffd700 1 -- 172.21.15.72:0/3920388414 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a80054e0 con 0x7fe8b809d9f0 2023-10-03T10:13:07.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.385+0000 7fe8aeffd700 1 -- 172.21.15.72:0/3920388414 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a8003680 con 0x7fe8b809d9f0 2023-10-03T10:13:07.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.385+0000 7fe8aeffd700 1 -- 172.21.15.72:0/3920388414 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8003a10 con 0x7fe8b809d9f0 2023-10-03T10:13:07.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.385+0000 7fe8c0417700 1 -- 172.21.15.72:0/3920388414 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b8070ad0 con 0x7fe8b809d9f0 2023-10-03T10:13:07.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.385+0000 7fe8c0417700 1 -- 172.21.15.72:0/3920388414 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b8071e90 con 0x7fe8b809d9f0 2023-10-03T10:13:07.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.386+0000 7fe8aeffd700 1 -- 172.21.15.72:0/3920388414 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8a8003b70 con 0x7fe8b809d9f0 2023-10-03T10:13:07.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.386+0000 7fe8c0417700 1 -- 172.21.15.72:0/3920388414 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b80705a0 con 0x7fe8b809d9f0 2023-10-03T10:13:07.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.386+0000 7fe8aeffd700 1 -- 172.21.15.72:0/3920388414 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe8a803e8d0 con 0x7fe8b809d9f0 2023-10-03T10:13:07.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.387+0000 7f3d7a7fc700 1 -- 172.21.15.72:0/4114183762 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d8409eaf0 con 0x7f3d840a1340 2023-10-03T10:13:07.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.391+0000 7fe8aeffd700 1 -- 172.21.15.72:0/3920388414 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8a8011bc0 con 0x7fe8b809d9f0 2023-10-03T10:13:07.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.571+0000 7fb5e93dd700 1 -- 172.21.15.72:0/3799042505 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb5e4074ea0 con 0x7fb5e4138dc0 2023-10-03T10:13:07.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.572+0000 7fb5cb7fe700 1 -- 172.21.15.72:0/3799042505 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5dc02c020 con 0x7fb5e4138dc0 2023-10-03T10:13:07.573 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.575+0000 7fb5e93dd700 1 -- 172.21.15.72:0/3799042505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e4138dc0 msgr2=0x7fb5e409c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.575+0000 7fb5e93dd700 1 --2- 172.21.15.72:0/3799042505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e4138dc0 0x7fb5e409c500 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4072a30 tx=0x7fb5dc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.575+0000 7fb5e93dd700 1 -- 172.21.15.72:0/3799042505 shutdown_connections 2023-10-03T10:13:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.575+0000 7fb5e93dd700 1 --2- 172.21.15.72:0/3799042505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e4138dc0 0x7fb5e409c500 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.575+0000 7fb5e93dd700 1 --2- 172.21.15.72:0/3799042505 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e4133420 0x7fb5e4137a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.575+0000 7fb5e93dd700 1 --2- 172.21.15.72:0/3799042505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e41337f0 0x7fb5e4137f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.575+0000 7fb5e93dd700 1 -- 172.21.15.72:0/3799042505 >> 172.21.15.72:0/3799042505 conn(0x7fb5e40a4210 msgr2=0x7fb5e4131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.575+0000 7fb5e93dd700 1 -- 172.21.15.72:0/3799042505 shutdown_connections 2023-10-03T10:13:07.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.575+0000 7fb5e93dd700 1 -- 172.21.15.72:0/3799042505 wait complete. 2023-10-03T10:13:07.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:07.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.595+0000 7f355d2a1700 1 -- 172.21.15.72:0/646669656 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f355811cac0 con 0x7f355806eb80 2023-10-03T10:13:07.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.595+0000 7f353f7fe700 1 -- 172.21.15.72:0/646669656 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f355811cac0 con 0x7f355806eb80 2023-10-03T10:13:07.596 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:07.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.597+0000 7f355d2a1700 1 -- 172.21.15.72:0/646669656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f355806eb80 msgr2=0x7f3558119b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.597+0000 7f355d2a1700 1 --2- 172.21.15.72:0/646669656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f355806eb80 0x7f3558119b20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f354c015000 tx=0x7f354c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:07.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.598+0000 7f355d2a1700 1 -- 172.21.15.72:0/646669656 shutdown_connections 2023-10-03T10:13:07.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.598+0000 7f355d2a1700 1 --2- 172.21.15.72:0/646669656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f355812f320 0x7f355811a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.598+0000 7f355d2a1700 1 --2- 172.21.15.72:0/646669656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3558066410 0x7f35581195e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.598+0000 7f355d2a1700 1 --2- 172.21.15.72:0/646669656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f355806eb80 0x7f3558119b20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.598+0000 7f355d2a1700 1 -- 172.21.15.72:0/646669656 >> 172.21.15.72:0/646669656 conn(0x7f35580a2aa0 msgr2=0x7f355812e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.598+0000 7f355d2a1700 1 -- 172.21.15.72:0/646669656 shutdown_connections 2023-10-03T10:13:07.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.598+0000 7f355d2a1700 1 -- 172.21.15.72:0/646669656 wait complete. 2023-10-03T10:13:07.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.618+0000 7f3d8bc5b700 1 -- 172.21.15.72:0/4114183762 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3d8409eaf0 con 0x7f3d840a1340 2023-10-03T10:13:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.619+0000 7f3d7a7fc700 1 -- 172.21.15.72:0/4114183762 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d8409eaf0 con 0x7f3d840a1340 2023-10-03T10:13:07.619 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.621+0000 7f3d8bc5b700 1 -- 172.21.15.72:0/4114183762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d840a1340 msgr2=0x7f3d84122b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.621+0000 7f3d8bc5b700 1 --2- 172.21.15.72:0/4114183762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d840a1340 0x7f3d84122b70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3d74001eb0 tx=0x7f3d7400c800 comp rx=0 tx=0).stop 2023-10-03T10:13:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.621+0000 7f3d8bc5b700 1 -- 172.21.15.72:0/4114183762 shutdown_connections 2023-10-03T10:13:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.621+0000 7f3d8bc5b700 1 --2- 172.21.15.72:0/4114183762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d84134000 0x7f3d841230b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.621+0000 7f3d8bc5b700 1 --2- 172.21.15.72:0/4114183762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d840a0a30 0x7f3d84122630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.621+0000 7f3d8bc5b700 1 --2- 172.21.15.72:0/4114183762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d840a1340 0x7f3d84122b70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.621+0000 7f3d8bc5b700 1 -- 172.21.15.72:0/4114183762 >> 172.21.15.72:0/4114183762 conn(0x7f3d840a6550 msgr2=0x7f3d840a2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.621+0000 7f3d8bc5b700 1 -- 172.21.15.72:0/4114183762 shutdown_connections 2023-10-03T10:13:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.621+0000 7f3d8bc5b700 1 -- 172.21.15.72:0/4114183762 wait complete. 2023-10-03T10:13:07.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.630+0000 7fe8c0417700 1 -- 172.21.15.72:0/3920388414 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe8b8074ea0 con 0x7fe8b809d9f0 2023-10-03T10:13:07.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.631+0000 7fe8aeffd700 1 -- 172.21.15.72:0/3920388414 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe8a8017030 con 0x7fe8b809d9f0 2023-10-03T10:13:07.631 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:07.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.633+0000 7fe8c0417700 1 -- 172.21.15.72:0/3920388414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8b809d9f0 msgr2=0x7fe8b806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:07.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.633+0000 7fe8c0417700 1 --2- 172.21.15.72:0/3920388414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8b809d9f0 0x7fe8b806f080 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800c450 tx=0x7fe8a800c810 comp rx=0 tx=0).stop 2023-10-03T10:13:07.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.633+0000 7fe8c0417700 1 -- 172.21.15.72:0/3920388414 shutdown_connections 2023-10-03T10:13:07.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.633+0000 7fe8c0417700 1 --2- 172.21.15.72:0/3920388414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8b806ae80 0x7fe8b806eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.633+0000 7fe8c0417700 1 --2- 172.21.15.72:0/3920388414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8b81316c0 0x7fe8b806f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.633+0000 7fe8c0417700 1 --2- 172.21.15.72:0/3920388414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8b809d9f0 0x7fe8b806f080 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:07.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.633+0000 7fe8c0417700 1 -- 172.21.15.72:0/3920388414 >> 172.21.15.72:0/3920388414 conn(0x7fe8b8066f50 msgr2=0x7fe8b80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:07.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.633+0000 7fe8c0417700 1 -- 172.21.15.72:0/3920388414 shutdown_connections 2023-10-03T10:13:07.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:07.633+0000 7fe8c0417700 1 -- 172.21.15.72:0/3920388414 wait complete. 2023-10-03T10:13:07.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:07.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:08.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:08.611 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:08.636 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:08.647 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:08.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.736+0000 7f4e345ef700 1 Processor -- start 2023-10-03T10:13:08.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.736+0000 7f4e345ef700 1 -- start start 2023-10-03T10:13:08.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.736+0000 7f4e345ef700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4e2c06a770 0x7f4e2c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.736+0000 7f4e345ef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2c09dc30 0x7f4e2c09e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.736+0000 7f4e345ef700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e2c13c1e0 0x7f4e2c13e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.736+0000 7f4e345ef700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2c06ab40 con 0x7f4e2c06a770 2023-10-03T10:13:08.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.736+0000 7f4e345ef700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c09ebc0 con 0x7f4e2c09dc30 2023-10-03T10:13:08.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.736+0000 7f4e345ef700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c09a810 con 0x7f4e2c13c1e0 2023-10-03T10:13:08.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.737+0000 7f4e32b8c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e2c13c1e0 0x7f4e2c13e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.737+0000 7f4e31b8a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2c09dc30 0x7f4e2c09e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.737+0000 7f4e32b8c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e2c13c1e0 0x7f4e2c13e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37522/0 (socket says 172.21.15.72:37522) 2023-10-03T10:13:08.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.737+0000 7f4e32b8c700 1 -- 172.21.15.72:0/3063678559 learned_addr learned my addr 172.21.15.72:0/3063678559 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:08.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.737+0000 7f4e3238b700 1 --2- 172.21.15.72:0/3063678559 >> v2:172.21.15.72:3300/0 conn(0x7f4e2c06a770 0x7f4e2c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.737+0000 7f4e31b8a700 1 -- 172.21.15.72:0/3063678559 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e2c13c1e0 msgr2=0x7f4e2c13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.737+0000 7f4e31b8a700 1 --2- 172.21.15.72:0/3063678559 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e2c13c1e0 0x7f4e2c13e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.737+0000 7f4e31b8a700 1 -- 172.21.15.72:0/3063678559 >> v2:172.21.15.72:3300/0 conn(0x7f4e2c06a770 msgr2=0x7f4e2c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.737+0000 7f4e31b8a700 1 --2- 172.21.15.72:0/3063678559 >> v2:172.21.15.72:3300/0 conn(0x7f4e2c06a770 0x7f4e2c09d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.737+0000 7f4e31b8a700 1 -- 172.21.15.72:0/3063678559 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c09e920 con 0x7f4e2c09dc30 2023-10-03T10:13:08.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.737+0000 7f4e31b8a700 1 --2- 172.21.15.72:0/3063678559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2c09dc30 0x7f4e2c09e080 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009840 tx=0x7f4e1c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78c710dfc72f44e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.737+0000 7f4e31389700 1 -- 172.21.15.72:0/3063678559 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c011830 con 0x7f4e2c09dc30 2023-10-03T10:13:08.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.737+0000 7f4e31389700 1 -- 172.21.15.72:0/3063678559 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1c011990 con 0x7f4e2c09dc30 2023-10-03T10:13:08.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.737+0000 7f4e31389700 1 -- 172.21.15.72:0/3063678559 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c011d20 con 0x7f4e2c09dc30 2023-10-03T10:13:08.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.738+0000 7f4e345ef700 1 -- 172.21.15.72:0/3063678559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2c09dc30 msgr2=0x7f4e2c09e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.738+0000 7f4e345ef700 1 --2- 172.21.15.72:0/3063678559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2c09dc30 0x7f4e2c09e080 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009840 tx=0x7f4e1c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:08.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.739+0000 7f4e345ef700 1 -- 172.21.15.72:0/3063678559 shutdown_connections 2023-10-03T10:13:08.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.739+0000 7f4e345ef700 1 --2- 172.21.15.72:0/3063678559 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e2c13c1e0 0x7f4e2c13e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.739+0000 7f4e345ef700 1 --2- 172.21.15.72:0/3063678559 >> v2:172.21.15.72:3300/0 conn(0x7f4e2c06a770 0x7f4e2c09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.739+0000 7f4e345ef700 1 --2- 172.21.15.72:0/3063678559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2c09dc30 0x7f4e2c09e080 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.739+0000 7f4e345ef700 1 -- 172.21.15.72:0/3063678559 >> 172.21.15.72:0/3063678559 conn(0x7f4e2c066f50 msgr2=0x7f4e2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.739+0000 7f4e345ef700 1 -- 172.21.15.72:0/3063678559 shutdown_connections 2023-10-03T10:13:08.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.739+0000 7f4e345ef700 1 -- 172.21.15.72:0/3063678559 wait complete. 2023-10-03T10:13:08.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.740+0000 7f4e345ef700 1 Processor -- start 2023-10-03T10:13:08.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.740+0000 7f4e345ef700 1 -- start start 2023-10-03T10:13:08.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e345ef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e2c06a770 0x7f4e2c11d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e345ef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2c09dc30 0x7f4e2c13a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e345ef700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e2c13c1e0 0x7f4e2c13a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e345ef700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c11e200 con 0x7f4e2c06a770 2023-10-03T10:13:08.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e345ef700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c11e010 con 0x7f4e2c09dc30 2023-10-03T10:13:08.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e345ef700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c13bd30 con 0x7f4e2c13c1e0 2023-10-03T10:13:08.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e3238b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e2c06a770 0x7f4e2c11d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e3238b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e2c06a770 0x7f4e2c11d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34266/0 (socket says 172.21.15.72:34266) 2023-10-03T10:13:08.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e3238b700 1 -- 172.21.15.72:0/2976354065 learned_addr learned my addr 172.21.15.72:0/2976354065 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:08.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e31b8a700 1 --2- 172.21.15.72:0/2976354065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2c09dc30 0x7f4e2c13a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e32b8c700 1 --2- 172.21.15.72:0/2976354065 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e2c13c1e0 0x7f4e2c13a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e3238b700 1 -- 172.21.15.72:0/2976354065 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e2c13c1e0 msgr2=0x7f4e2c13a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e3238b700 1 --2- 172.21.15.72:0/2976354065 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e2c13c1e0 0x7f4e2c13a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e3238b700 1 -- 172.21.15.72:0/2976354065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2c09dc30 msgr2=0x7f4e2c13a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e3238b700 1 --2- 172.21.15.72:0/2976354065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2c09dc30 0x7f4e2c13a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e3238b700 1 -- 172.21.15.72:0/2976354065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c0094a0 con 0x7f4e2c06a770 2023-10-03T10:13:08.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.741+0000 7f4e3238b700 1 --2- 172.21.15.72:0/2976354065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e2c06a770 0x7f4e2c11d460 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800e840 tx=0x7f4e2800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.742+0000 7f4e22ffd700 1 -- 172.21.15.72:0/2976354065 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28013610 con 0x7f4e2c06a770 2023-10-03T10:13:08.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.742+0000 7f4e22ffd700 1 -- 172.21.15.72:0/2976354065 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e28013770 con 0x7f4e2c06a770 2023-10-03T10:13:08.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.742+0000 7f4e345ef700 1 -- 172.21.15.72:0/2976354065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2c09f1a0 con 0x7f4e2c06a770 2023-10-03T10:13:08.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.742+0000 7f4e22ffd700 1 -- 172.21.15.72:0/2976354065 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28013b20 con 0x7f4e2c06a770 2023-10-03T10:13:08.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.742+0000 7f4e345ef700 1 -- 172.21.15.72:0/2976354065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2c11ee10 con 0x7f4e2c06a770 2023-10-03T10:13:08.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.743+0000 7f4e22ffd700 1 -- 172.21.15.72:0/2976354065 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e28013c80 con 0x7f4e2c06a770 2023-10-03T10:13:08.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.743+0000 7f4e22ffd700 1 -- 172.21.15.72:0/2976354065 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4e2803f350 con 0x7f4e2c06a770 2023-10-03T10:13:08.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.743+0000 7f4e345ef700 1 -- 172.21.15.72:0/2976354065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2c071ff0 con 0x7f4e2c06a770 2023-10-03T10:13:08.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.748+0000 7f4e22ffd700 1 -- 172.21.15.72:0/2976354065 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e28012370 con 0x7f4e2c06a770 2023-10-03T10:13:08.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.775+0000 7fb323c6b700 1 Processor -- start 2023-10-03T10:13:08.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.775+0000 7fb323c6b700 1 -- start start 2023-10-03T10:13:08.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.776+0000 7fb323c6b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb31c09e1d0 0x7fb31c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.776+0000 7fb323c6b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb31c139170 0x7fb31c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.776+0000 7fb323c6b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c09b120 con 0x7fb31c09d6f0 2023-10-03T10:13:08.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.776+0000 7fb323c6b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31c06b460 con 0x7fb31c139170 2023-10-03T10:13:08.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.776+0000 7fb323c6b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c09a7e0 con 0x7fb31c09e1d0 2023-10-03T10:13:08.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.776+0000 7fb321206700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb31c09e1d0 0x7fb31c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.776+0000 7fb322208700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb31c139170 0x7fb31c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.776+0000 7fb321206700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb31c09e1d0 0x7fb31c138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46214/0 (socket says 172.21.15.72:46214) 2023-10-03T10:13:08.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.776+0000 7fb321206700 1 -- 172.21.15.72:0/1909301085 learned_addr learned my addr 172.21.15.72:0/1909301085 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.776+0000 7fb321206700 1 -- 172.21.15.72:0/1909301085 >> v2:172.21.15.72:3300/0 conn(0x7fb31c139170 msgr2=0x7fb31c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.776+0000 7fb321206700 1 --2- 172.21.15.72:0/1909301085 >> v2:172.21.15.72:3300/0 conn(0x7fb31c139170 0x7fb31c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.776+0000 7fb321206700 1 -- 172.21.15.72:0/1909301085 >> v1:172.21.15.72:6789/0 conn(0x7fb31c09d6f0 legacy=0x7fb31c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.776+0000 7fb321206700 1 -- 172.21.15.72:0/1909301085 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c09a500 con 0x7fb31c09e1d0 2023-10-03T10:13:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.776+0000 7fb320a05700 1 -- 172.21.15.72:0/1909301085 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116999832 0 0) 0x7fb31c09b120 con 0x7fb31c09d6f0 2023-10-03T10:13:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.776+0000 7fb322208700 1 --2- 172.21.15.72:0/1909301085 >> v2:172.21.15.72:3300/0 conn(0x7fb31c139170 0x7fb31c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.777+0000 7fb321206700 1 --2- 172.21.15.72:0/1909301085 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb31c09e1d0 0x7fb31c138c30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb30c009920 tx=0x7fb30c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87b800c26396167b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.777+0000 7fb320a05700 1 -- 172.21.15.72:0/1909301085 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c011830 con 0x7fb31c09e1d0 2023-10-03T10:13:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.777+0000 7fb320a05700 1 -- 172.21.15.72:0/1909301085 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c011990 con 0x7fb31c09e1d0 2023-10-03T10:13:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.777+0000 7fb320a05700 1 -- 172.21.15.72:0/1909301085 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c011d20 con 0x7fb31c09e1d0 2023-10-03T10:13:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.777+0000 7fb323c6b700 1 -- 172.21.15.72:0/1909301085 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb31c09e1d0 msgr2=0x7fb31c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.777+0000 7fb323c6b700 1 --2- 172.21.15.72:0/1909301085 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb31c09e1d0 0x7fb31c138c30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb30c009920 tx=0x7fb30c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:08.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.778+0000 7fb323c6b700 1 -- 172.21.15.72:0/1909301085 shutdown_connections 2023-10-03T10:13:08.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.778+0000 7fb323c6b700 1 --2- 172.21.15.72:0/1909301085 >> v2:172.21.15.72:3300/0 conn(0x7fb31c139170 0x7fb31c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.778+0000 7fb323c6b700 1 --2- 172.21.15.72:0/1909301085 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb31c09e1d0 0x7fb31c138c30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.778+0000 7fb323c6b700 1 -- 172.21.15.72:0/1909301085 >> 172.21.15.72:0/1909301085 conn(0x7fb31c066f50 msgr2=0x7fb31c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.778+0000 7fb323c6b700 1 -- 172.21.15.72:0/1909301085 shutdown_connections 2023-10-03T10:13:08.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.778+0000 7fb323c6b700 1 -- 172.21.15.72:0/1909301085 wait complete. 2023-10-03T10:13:08.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.779+0000 7fb323c6b700 1 Processor -- start 2023-10-03T10:13:08.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.779+0000 7fb323c6b700 1 -- start start 2023-10-03T10:13:08.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb323c6b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb31c09d6f0 0x7fb31c1218a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb323c6b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb31c09e1d0 0x7fb31c121de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb323c6b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb31c139170 0x7fb31c122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb323c6b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c1371b0 con 0x7fb31c09e1d0 2023-10-03T10:13:08.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb323c6b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c1253c0 con 0x7fb31c139170 2023-10-03T10:13:08.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb323c6b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c123ad0 con 0x7fb31c09d6f0 2023-10-03T10:13:08.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb321206700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb31c09e1d0 0x7fb31c121de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb321206700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb31c09e1d0 0x7fb31c121de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34296/0 (socket says 172.21.15.72:34296) 2023-10-03T10:13:08.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb321206700 1 -- 172.21.15.72:0/449928467 learned_addr learned my addr 172.21.15.72:0/449928467 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:08.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb321206700 1 -- 172.21.15.72:0/449928467 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb31c09d6f0 msgr2=0x7fb31c1218a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb321206700 1 --2- 172.21.15.72:0/449928467 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb31c09d6f0 0x7fb31c1218a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb321206700 1 -- 172.21.15.72:0/449928467 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb31c139170 msgr2=0x7fb31c122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb321206700 1 --2- 172.21.15.72:0/449928467 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb31c139170 0x7fb31c122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb321206700 1 -- 172.21.15.72:0/449928467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb314009a70 con 0x7fb31c09e1d0 2023-10-03T10:13:08.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb321206700 1 --2- 172.21.15.72:0/449928467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb31c09e1d0 0x7fb31c121de0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb30c009870 tx=0x7fb30c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb3127fc700 1 -- 172.21.15.72:0/449928467 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c004400 con 0x7fb31c09e1d0 2023-10-03T10:13:08.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb3127fc700 1 -- 172.21.15.72:0/449928467 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c01f070 con 0x7fb31c09e1d0 2023-10-03T10:13:08.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.780+0000 7fb3127fc700 1 -- 172.21.15.72:0/449928467 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c0038e0 con 0x7fb31c09e1d0 2023-10-03T10:13:08.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.781+0000 7fb323c6b700 1 -- 172.21.15.72:0/449928467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30c009550 con 0x7fb31c09e1d0 2023-10-03T10:13:08.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.781+0000 7fb323c6b700 1 -- 172.21.15.72:0/449928467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31c072150 con 0x7fb31c09e1d0 2023-10-03T10:13:08.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.781+0000 7fb3127fc700 1 -- 172.21.15.72:0/449928467 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb30c021030 con 0x7fb31c09e1d0 2023-10-03T10:13:08.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.782+0000 7fb3127fc700 1 -- 172.21.15.72:0/449928467 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb30c040ae0 con 0x7fb31c09e1d0 2023-10-03T10:13:08.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.782+0000 7fb323c6b700 1 -- 172.21.15.72:0/449928467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31c124f40 con 0x7fb31c09e1d0 2023-10-03T10:13:08.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.787+0000 7fb3127fc700 1 -- 172.21.15.72:0/449928467 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb31c124f40 con 0x7fb31c09e1d0 2023-10-03T10:13:08.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.788+0000 7f1e6e0f1700 1 Processor -- start 2023-10-03T10:13:08.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.789+0000 7f1e6e0f1700 1 -- start start 2023-10-03T10:13:08.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.789+0000 7f1e6e0f1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e68133420 0x7f1e681337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.789+0000 7f1e6e0f1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1e68134260 0x7f1e681306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.789+0000 7f1e6e0f1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6806b990 con 0x7f1e68133e30 2023-10-03T10:13:08.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.789+0000 7f1e6e0f1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e680a0590 con 0x7f1e68134260 2023-10-03T10:13:08.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.789+0000 7f1e6e0f1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6809fb80 con 0x7f1e68133420 2023-10-03T10:13:08.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.789+0000 7f1e677fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e68133420 0x7f1e681337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.790+0000 7f1e677fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e68133420 0x7f1e681337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46236/0 (socket says 172.21.15.72:46236) 2023-10-03T10:13:08.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.790+0000 7f1e677fe700 1 -- 172.21.15.72:0/677305236 learned_addr learned my addr 172.21.15.72:0/677305236 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:08.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.790+0000 7f1e67fff700 1 --2- 172.21.15.72:0/677305236 >> v2:172.21.15.72:3300/0 conn(0x7f1e68134260 0x7f1e681306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.790+0000 7f1e67fff700 1 -- 172.21.15.72:0/677305236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e68133420 msgr2=0x7f1e681337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.790+0000 7f1e67fff700 1 --2- 172.21.15.72:0/677305236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e68133420 0x7f1e681337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.790+0000 7f1e67fff700 1 -- 172.21.15.72:0/677305236 >> v1:172.21.15.72:6789/0 conn(0x7f1e68133e30 legacy=0x7f1e6812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.790+0000 7f1e67fff700 1 -- 172.21.15.72:0/677305236 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e680a0030 con 0x7f1e68134260 2023-10-03T10:13:08.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.790+0000 7f1e677fe700 1 --2- 172.21.15.72:0/677305236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e68133420 0x7f1e681337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:08.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.790+0000 7f1e67fff700 1 --2- 172.21.15.72:0/677305236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e68134260 0x7f1e681306a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009d90 tx=0x7f1e6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7908ace06cfa9eca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.790+0000 7f1e667fc700 1 -- 172.21.15.72:0/677305236 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6000e070 con 0x7f1e68134260 2023-10-03T10:13:08.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.790+0000 7f1e667fc700 1 -- 172.21.15.72:0/677305236 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6000bb20 con 0x7f1e68134260 2023-10-03T10:13:08.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.790+0000 7f1e667fc700 1 -- 172.21.15.72:0/677305236 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60012430 con 0x7f1e68134260 2023-10-03T10:13:08.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.791+0000 7f1e6e0f1700 1 -- 172.21.15.72:0/677305236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e68134260 msgr2=0x7f1e681306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.791+0000 7f1e6e0f1700 1 --2- 172.21.15.72:0/677305236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e68134260 0x7f1e681306a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009d90 tx=0x7f1e6000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:08.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.791+0000 7f1e6e0f1700 1 -- 172.21.15.72:0/677305236 shutdown_connections 2023-10-03T10:13:08.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.791+0000 7f1e6e0f1700 1 --2- 172.21.15.72:0/677305236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e68134260 0x7f1e681306a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.791+0000 7f1e6e0f1700 1 --2- 172.21.15.72:0/677305236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e68133420 0x7f1e681337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.791+0000 7f1e6e0f1700 1 -- 172.21.15.72:0/677305236 >> 172.21.15.72:0/677305236 conn(0x7f1e680a4210 msgr2=0x7f1e680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.791+0000 7f1e6e0f1700 1 -- 172.21.15.72:0/677305236 shutdown_connections 2023-10-03T10:13:08.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.791+0000 7f1e6e0f1700 1 -- 172.21.15.72:0/677305236 wait complete. 2023-10-03T10:13:08.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.792+0000 7f1e6e0f1700 1 Processor -- start 2023-10-03T10:13:08.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.793+0000 7f1e6e0f1700 1 -- start start 2023-10-03T10:13:08.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.793+0000 7f1e6e0f1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e68133420 0x7f1e6811dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.793+0000 7f1e6e0f1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e68133e30 0x7f1e6811e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.793+0000 7f1e6e0f1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e68134260 0x7f1e6811c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.793+0000 7f1e6e0f1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6812d870 con 0x7f1e68133e30 2023-10-03T10:13:08.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.793+0000 7f1e6e0f1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6811a8f0 con 0x7f1e68134260 2023-10-03T10:13:08.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.793+0000 7f1e6e0f1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6811bd60 con 0x7f1e68133420 2023-10-03T10:13:08.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.794+0000 7f1e677fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e68133420 0x7f1e6811dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.794+0000 7f1e67fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e68134260 0x7f1e6811c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.794+0000 7f1e677fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e68133420 0x7f1e6811dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37550/0 (socket says 172.21.15.72:37550) 2023-10-03T10:13:08.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.794+0000 7f1e677fe700 1 -- 172.21.15.72:0/3876953273 learned_addr learned my addr 172.21.15.72:0/3876953273 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:08.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.794+0000 7f1e66ffd700 1 --2- 172.21.15.72:0/3876953273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e68133e30 0x7f1e6811e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.794+0000 7f1e67fff700 1 -- 172.21.15.72:0/3876953273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e68133420 msgr2=0x7f1e6811dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.794+0000 7f1e67fff700 1 --2- 172.21.15.72:0/3876953273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e68133420 0x7f1e6811dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.794+0000 7f1e67fff700 1 -- 172.21.15.72:0/3876953273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e68133e30 msgr2=0x7f1e6811e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.794+0000 7f1e67fff700 1 --2- 172.21.15.72:0/3876953273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e68133e30 0x7f1e6811e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.794+0000 7f1e67fff700 1 -- 172.21.15.72:0/3876953273 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e58009550 con 0x7f1e68134260 2023-10-03T10:13:08.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.794+0000 7f1e67fff700 1 --2- 172.21.15.72:0/3876953273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e68134260 0x7f1e6811c940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1e60016000 tx=0x7f1e60004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.794+0000 7f1e4ffff700 1 -- 172.21.15.72:0/3876953273 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60012430 con 0x7f1e68134260 2023-10-03T10:13:08.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.794+0000 7f1e4ffff700 1 -- 172.21.15.72:0/3876953273 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e60020070 con 0x7f1e68134260 2023-10-03T10:13:08.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.795+0000 7f1e4ffff700 1 -- 172.21.15.72:0/3876953273 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60004280 con 0x7f1e68134260 2023-10-03T10:13:08.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.795+0000 7f1e6e0f1700 1 -- 172.21.15.72:0/3876953273 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e60009a70 con 0x7f1e68134260 2023-10-03T10:13:08.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.795+0000 7f1e6e0f1700 1 -- 172.21.15.72:0/3876953273 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e68131940 con 0x7f1e68134260 2023-10-03T10:13:08.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.796+0000 7f1e6e0f1700 1 -- 172.21.15.72:0/3876953273 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e68074ea0 con 0x7f1e68134260 2023-10-03T10:13:08.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.797+0000 7f1e4ffff700 1 -- 172.21.15.72:0/3876953273 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e600043e0 con 0x7f1e68134260 2023-10-03T10:13:08.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.797+0000 7f1e4ffff700 1 -- 172.21.15.72:0/3876953273 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1e60022070 con 0x7f1e68134260 2023-10-03T10:13:08.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.805+0000 7f1e4ffff700 1 -- 172.21.15.72:0/3876953273 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e60031430 con 0x7f1e68134260 2023-10-03T10:13:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.818+0000 7ff628b9d700 1 Processor -- start 2023-10-03T10:13:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.818+0000 7ff628b9d700 1 -- start start 2023-10-03T10:13:08.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.819+0000 7ff628b9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff624130540 0x7ff624130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.819+0000 7ff628b9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff624130e50 0x7ff62406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.819+0000 7ff628b9d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6240716a0 con 0x7ff62406fb20 2023-10-03T10:13:08.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.819+0000 7ff628b9d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff62409a390 con 0x7ff624130540 2023-10-03T10:13:08.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.819+0000 7ff628b9d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff624071290 con 0x7ff624130e50 2023-10-03T10:13:08.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.819+0000 7ff621d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff624130e50 0x7ff62406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.819+0000 7ff621d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff624130e50 0x7ff62406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46246/0 (socket says 172.21.15.72:46246) 2023-10-03T10:13:08.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.819+0000 7ff621d9b700 1 -- 172.21.15.72:0/2751736227 learned_addr learned my addr 172.21.15.72:0/2751736227 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.819+0000 7ff621d9b700 1 -- 172.21.15.72:0/2751736227 >> v2:172.21.15.72:3300/0 conn(0x7ff624130540 msgr2=0x7ff624130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.819+0000 7ff62259c700 1 --2- 172.21.15.72:0/2751736227 >> v2:172.21.15.72:3300/0 conn(0x7ff624130540 0x7ff624130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.819+0000 7ff621d9b700 1 --2- 172.21.15.72:0/2751736227 >> v2:172.21.15.72:3300/0 conn(0x7ff624130540 0x7ff624130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.819+0000 7ff621d9b700 1 -- 172.21.15.72:0/2751736227 >> v1:172.21.15.72:6789/0 conn(0x7ff62406fb20 legacy=0x7ff624137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.820+0000 7ff621d9b700 1 -- 172.21.15.72:0/2751736227 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff624130340 con 0x7ff624130e50 2023-10-03T10:13:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.820+0000 7ff62259c700 1 --2- 172.21.15.72:0/2751736227 >> v2:172.21.15.72:3300/0 conn(0x7ff624130540 0x7ff624130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.820+0000 7ff621d9b700 1 --2- 172.21.15.72:0/2751736227 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff624130e50 0x7ff62406f5e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff618009920 tx=0x7ff618009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87a70321ace4ecd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.820+0000 7ff62159a700 1 -- 172.21.15.72:0/2751736227 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61800ba20 con 0x7ff624130e50 2023-10-03T10:13:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.820+0000 7ff62159a700 1 -- 172.21.15.72:0/2751736227 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61800bb80 con 0x7ff624130e50 2023-10-03T10:13:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.820+0000 7ff62159a700 1 -- 172.21.15.72:0/2751736227 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618009e70 con 0x7ff624130e50 2023-10-03T10:13:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.820+0000 7ff628b9d700 1 -- 172.21.15.72:0/2751736227 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff624130e50 msgr2=0x7ff62406f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.820+0000 7ff628b9d700 1 --2- 172.21.15.72:0/2751736227 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff624130e50 0x7ff62406f5e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff618009920 tx=0x7ff618009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.821+0000 7ff628b9d700 1 -- 172.21.15.72:0/2751736227 shutdown_connections 2023-10-03T10:13:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.821+0000 7ff628b9d700 1 --2- 172.21.15.72:0/2751736227 >> v2:172.21.15.72:3300/0 conn(0x7ff624130540 0x7ff624130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.821+0000 7ff628b9d700 1 --2- 172.21.15.72:0/2751736227 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff624130e50 0x7ff62406f5e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.821+0000 7ff628b9d700 1 -- 172.21.15.72:0/2751736227 >> 172.21.15.72:0/2751736227 conn(0x7ff6240a2aa0 msgr2=0x7ff6240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.821+0000 7ff628b9d700 1 -- 172.21.15.72:0/2751736227 shutdown_connections 2023-10-03T10:13:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.821+0000 7ff628b9d700 1 -- 172.21.15.72:0/2751736227 wait complete. 2023-10-03T10:13:08.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.822+0000 7ff628b9d700 1 Processor -- start 2023-10-03T10:13:08.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.823+0000 7ff628b9d700 1 -- start start 2023-10-03T10:13:08.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.823+0000 7ff628b9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff62406fb20 0x7ff6241236e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.823+0000 7ff628b9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff624130540 0x7ff624123c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.823+0000 7ff628b9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff624130e50 0x7ff6241cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:08.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.823+0000 7ff628b9d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6240a0c00 con 0x7ff62406fb20 2023-10-03T10:13:08.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.823+0000 7ff628b9d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6240718e0 con 0x7ff624130e50 2023-10-03T10:13:08.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.823+0000 7ff628b9d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff624126390 con 0x7ff624130540 2023-10-03T10:13:08.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.823+0000 7ff622d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff624130e50 0x7ff6241cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.823+0000 7ff62259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff62406fb20 0x7ff6241236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:08.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.823+0000 7ff62259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff62406fb20 0x7ff6241236e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34332/0 (socket says 172.21.15.72:34332) 2023-10-03T10:13:08.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.823+0000 7ff62259c700 1 -- 172.21.15.72:0/2333072512 learned_addr learned my addr 172.21.15.72:0/2333072512 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:08.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.823+0000 7ff622d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff624130e50 0x7ff6241cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46262/0 (socket says 172.21.15.72:46262) 2023-10-03T10:13:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.824+0000 7ff62259c700 1 -- 172.21.15.72:0/2333072512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff624130540 msgr2=0x7ff624123c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.824+0000 7ff62259c700 1 --2- 172.21.15.72:0/2333072512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff624130540 0x7ff624123c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.824+0000 7ff62259c700 1 -- 172.21.15.72:0/2333072512 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff624130e50 msgr2=0x7ff6241cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.824+0000 7ff62259c700 1 --2- 172.21.15.72:0/2333072512 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff624130e50 0x7ff6241cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.824+0000 7ff62259c700 1 -- 172.21.15.72:0/2333072512 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff618009550 con 0x7ff62406fb20 2023-10-03T10:13:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.824+0000 7ff622d9d700 1 --2- 172.21.15.72:0/2333072512 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff624130e50 0x7ff6241cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.824+0000 7ff62259c700 1 --2- 172.21.15.72:0/2333072512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff62406fb20 0x7ff6241236e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff61400c750 tx=0x7ff61400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.824+0000 7ff612ffd700 1 -- 172.21.15.72:0/2333072512 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614011800 con 0x7ff62406fb20 2023-10-03T10:13:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.824+0000 7ff612ffd700 1 -- 172.21.15.72:0/2333072512 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff614011960 con 0x7ff62406fb20 2023-10-03T10:13:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.824+0000 7ff612ffd700 1 -- 172.21.15.72:0/2333072512 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614011cd0 con 0x7ff62406fb20 2023-10-03T10:13:08.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.824+0000 7ff628b9d700 1 -- 172.21.15.72:0/2333072512 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff624123260 con 0x7ff62406fb20 2023-10-03T10:13:08.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.824+0000 7ff628b9d700 1 -- 172.21.15.72:0/2333072512 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6241270c0 con 0x7ff62406fb20 2023-10-03T10:13:08.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.825+0000 7ff612ffd700 1 -- 172.21.15.72:0/2333072512 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff614010350 con 0x7ff62406fb20 2023-10-03T10:13:08.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.825+0000 7ff612ffd700 1 -- 172.21.15.72:0/2333072512 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff614017e60 con 0x7ff62406fb20 2023-10-03T10:13:08.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.825+0000 7ff628b9d700 1 -- 172.21.15.72:0/2333072512 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff624074ea0 con 0x7ff62406fb20 2023-10-03T10:13:08.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.830+0000 7ff612ffd700 1 -- 172.21.15.72:0/2333072512 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff614044060 con 0x7ff62406fb20 2023-10-03T10:13:08.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.988+0000 7fb323c6b700 1 -- 172.21.15.72:0/449928467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb31c124f40 con 0x7fb31c09e1d0 2023-10-03T10:13:08.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.988+0000 7fb3127fc700 1 -- 172.21.15.72:0/449928467 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb31c124f40 con 0x7fb31c09e1d0 2023-10-03T10:13:08.989 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:08.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.991+0000 7fb323c6b700 1 -- 172.21.15.72:0/449928467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb31c09e1d0 msgr2=0x7fb31c121de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:08.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.991+0000 7fb323c6b700 1 --2- 172.21.15.72:0/449928467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb31c09e1d0 0x7fb31c121de0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb30c009870 tx=0x7fb30c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:08.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.991+0000 7fb323c6b700 1 -- 172.21.15.72:0/449928467 shutdown_connections 2023-10-03T10:13:08.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.991+0000 7fb323c6b700 1 --2- 172.21.15.72:0/449928467 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb31c139170 0x7fb31c122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.991+0000 7fb323c6b700 1 --2- 172.21.15.72:0/449928467 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb31c09d6f0 0x7fb31c1218a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.991+0000 7fb323c6b700 1 --2- 172.21.15.72:0/449928467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb31c09e1d0 0x7fb31c121de0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:08.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.991+0000 7fb323c6b700 1 -- 172.21.15.72:0/449928467 >> 172.21.15.72:0/449928467 conn(0x7fb31c066f50 msgr2=0x7fb31c070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:08.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.991+0000 7fb323c6b700 1 -- 172.21.15.72:0/449928467 shutdown_connections 2023-10-03T10:13:08.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:08.991+0000 7fb323c6b700 1 -- 172.21.15.72:0/449928467 wait complete. 2023-10-03T10:13:09.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:09.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.023+0000 7ff628b9d700 1 -- 172.21.15.72:0/2333072512 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff62406b9e0 con 0x7ff62406fb20 2023-10-03T10:13:09.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.023+0000 7ff612ffd700 1 -- 172.21.15.72:0/2333072512 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff61400fd30 con 0x7ff62406fb20 2023-10-03T10:13:09.024 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:09.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.025+0000 7ff628b9d700 1 -- 172.21.15.72:0/2333072512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff62406fb20 msgr2=0x7ff6241236e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.025+0000 7ff628b9d700 1 --2- 172.21.15.72:0/2333072512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff62406fb20 0x7ff6241236e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff61400c750 tx=0x7ff61400ca60 comp rx=0 tx=0).stop 2023-10-03T10:13:09.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.025+0000 7ff628b9d700 1 -- 172.21.15.72:0/2333072512 shutdown_connections 2023-10-03T10:13:09.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.025+0000 7ff628b9d700 1 --2- 172.21.15.72:0/2333072512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff62406fb20 0x7ff6241236e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.025+0000 7ff628b9d700 1 --2- 172.21.15.72:0/2333072512 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff624130e50 0x7ff6241cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.025+0000 7ff628b9d700 1 --2- 172.21.15.72:0/2333072512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff624130540 0x7ff624123c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.025+0000 7ff628b9d700 1 -- 172.21.15.72:0/2333072512 >> 172.21.15.72:0/2333072512 conn(0x7ff6240a2aa0 msgr2=0x7ff62412d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.025+0000 7ff628b9d700 1 -- 172.21.15.72:0/2333072512 shutdown_connections 2023-10-03T10:13:09.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.025+0000 7ff628b9d700 1 -- 172.21.15.72:0/2333072512 wait complete. 2023-10-03T10:13:09.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.027+0000 7f4e345ef700 1 -- 172.21.15.72:0/2976354065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e2c11fb60 con 0x7f4e2c06a770 2023-10-03T10:13:09.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.027+0000 7f4e22ffd700 1 -- 172.21.15.72:0/2976354065 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e28010310 con 0x7f4e2c06a770 2023-10-03T10:13:09.028 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:09.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.030+0000 7f4e345ef700 1 -- 172.21.15.72:0/2976354065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e2c06a770 msgr2=0x7f4e2c11d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.030+0000 7f4e345ef700 1 --2- 172.21.15.72:0/2976354065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e2c06a770 0x7f4e2c11d460 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800e840 tx=0x7f4e2800eb50 comp rx=0 tx=0).stop 2023-10-03T10:13:09.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.031+0000 7f4e345ef700 1 -- 172.21.15.72:0/2976354065 shutdown_connections 2023-10-03T10:13:09.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.031+0000 7f4e345ef700 1 --2- 172.21.15.72:0/2976354065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e2c06a770 0x7f4e2c11d460 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.031+0000 7f4e345ef700 1 --2- 172.21.15.72:0/2976354065 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e2c13c1e0 0x7f4e2c13a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.031+0000 7f4e345ef700 1 --2- 172.21.15.72:0/2976354065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e2c09dc30 0x7f4e2c13a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.031+0000 7f4e345ef700 1 -- 172.21.15.72:0/2976354065 >> 172.21.15.72:0/2976354065 conn(0x7f4e2c066f50 msgr2=0x7f4e2c0a1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.031+0000 7f4e345ef700 1 -- 172.21.15.72:0/2976354065 shutdown_connections 2023-10-03T10:13:09.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.031+0000 7f4e345ef700 1 -- 172.21.15.72:0/2976354065 wait complete. 2023-10-03T10:13:09.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:09.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:09.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.060+0000 7f1e6e0f1700 1 -- 172.21.15.72:0/3876953273 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e6806b250 con 0x7f1e68134260 2023-10-03T10:13:09.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.060+0000 7f1e4ffff700 1 -- 172.21.15.72:0/3876953273 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1e60035090 con 0x7f1e68134260 2023-10-03T10:13:09.061 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:09.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.062+0000 7f1e6e0f1700 1 -- 172.21.15.72:0/3876953273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e68134260 msgr2=0x7f1e6811c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:09.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.062+0000 7f1e6e0f1700 1 --2- 172.21.15.72:0/3876953273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e68134260 0x7f1e6811c940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1e60016000 tx=0x7f1e60004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.062+0000 7f1e6e0f1700 1 -- 172.21.15.72:0/3876953273 shutdown_connections 2023-10-03T10:13:09.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.062+0000 7f1e6e0f1700 1 --2- 172.21.15.72:0/3876953273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e68134260 0x7f1e6811c940 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.062+0000 7f1e6e0f1700 1 --2- 172.21.15.72:0/3876953273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e68133420 0x7f1e6811dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.062+0000 7f1e6e0f1700 1 --2- 172.21.15.72:0/3876953273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e68133e30 0x7f1e6811e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:09.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.062+0000 7f1e6e0f1700 1 -- 172.21.15.72:0/3876953273 >> 172.21.15.72:0/3876953273 conn(0x7f1e680a4210 msgr2=0x7f1e680a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:09.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.062+0000 7f1e6e0f1700 1 -- 172.21.15.72:0/3876953273 shutdown_connections 2023-10-03T10:13:09.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:09.062+0000 7f1e6e0f1700 1 -- 172.21.15.72:0/3876953273 wait complete. 2023-10-03T10:13:09.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:10.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:10.044 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:10.048 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:10.076 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:10.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.153+0000 7efc63acf700 1 Processor -- start 2023-10-03T10:13:10.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.153+0000 7efc63acf700 1 -- start start 2023-10-03T10:13:10.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc63acf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5c09e1d0 0x7efc5c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc63acf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efc5c139170 0x7efc5c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc63acf700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5c09b120 con 0x7efc5c09d6f0 2023-10-03T10:13:10.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc63acf700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5c06b460 con 0x7efc5c139170 2023-10-03T10:13:10.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc63acf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c09a7e0 con 0x7efc5c09e1d0 2023-10-03T10:13:10.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc6106a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5c09e1d0 0x7efc5c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc6106a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5c09e1d0 0x7efc5c138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46268/0 (socket says 172.21.15.72:46268) 2023-10-03T10:13:10.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc6106a700 1 -- 172.21.15.72:0/1564368683 learned_addr learned my addr 172.21.15.72:0/1564368683 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:10.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc6206c700 1 --2- 172.21.15.72:0/1564368683 >> v2:172.21.15.72:3300/0 conn(0x7efc5c139170 0x7efc5c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc6206c700 1 -- 172.21.15.72:0/1564368683 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5c09e1d0 msgr2=0x7efc5c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc6206c700 1 --2- 172.21.15.72:0/1564368683 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5c09e1d0 0x7efc5c138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc6206c700 1 -- 172.21.15.72:0/1564368683 >> v1:172.21.15.72:6789/0 conn(0x7efc5c09d6f0 legacy=0x7efc5c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc6206c700 1 -- 172.21.15.72:0/1564368683 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c09a500 con 0x7efc5c139170 2023-10-03T10:13:10.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc6106a700 1 --2- 172.21.15.72:0/1564368683 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5c09e1d0 0x7efc5c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc6206c700 1 --2- 172.21.15.72:0/1564368683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc5c139170 0x7efc5c13b550 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efc54009d90 tx=0x7efc5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a5cf79451b39a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.154+0000 7efc60869700 1 -- 172.21.15.72:0/1564368683 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5400e070 con 0x7efc5c139170 2023-10-03T10:13:10.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.155+0000 7efc60869700 1 -- 172.21.15.72:0/1564368683 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5400bb20 con 0x7efc5c139170 2023-10-03T10:13:10.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.155+0000 7efc60869700 1 -- 172.21.15.72:0/1564368683 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc54012430 con 0x7efc5c139170 2023-10-03T10:13:10.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.155+0000 7efc63acf700 1 -- 172.21.15.72:0/1564368683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc5c139170 msgr2=0x7efc5c13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.155+0000 7efc63acf700 1 --2- 172.21.15.72:0/1564368683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc5c139170 0x7efc5c13b550 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efc54009d90 tx=0x7efc5400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:10.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.155+0000 7efc63acf700 1 -- 172.21.15.72:0/1564368683 shutdown_connections 2023-10-03T10:13:10.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.155+0000 7efc63acf700 1 --2- 172.21.15.72:0/1564368683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc5c139170 0x7efc5c13b550 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.155+0000 7efc63acf700 1 --2- 172.21.15.72:0/1564368683 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5c09e1d0 0x7efc5c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.155+0000 7efc63acf700 1 -- 172.21.15.72:0/1564368683 >> 172.21.15.72:0/1564368683 conn(0x7efc5c066f50 msgr2=0x7efc5c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.156+0000 7efc63acf700 1 -- 172.21.15.72:0/1564368683 shutdown_connections 2023-10-03T10:13:10.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.156+0000 7efc63acf700 1 -- 172.21.15.72:0/1564368683 wait complete. 2023-10-03T10:13:10.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.156+0000 7efc63acf700 1 Processor -- start 2023-10-03T10:13:10.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.157+0000 7efc63acf700 1 -- start start 2023-10-03T10:13:10.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.157+0000 7efc63acf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc5c09d6f0 0x7efc5c120910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.157+0000 7efc63acf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc5c09e1d0 0x7efc5c120e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.157+0000 7efc63acf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5c139170 0x7efc5c121390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.157+0000 7efc63acf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c123e20 con 0x7efc5c09e1d0 2023-10-03T10:13:10.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.157+0000 7efc63acf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0a18d0 con 0x7efc5c139170 2023-10-03T10:13:10.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.157+0000 7efc63acf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c1224e0 con 0x7efc5c09d6f0 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.157+0000 7efc6186b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc5c09d6f0 0x7efc5c120910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.157+0000 7efc6186b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc5c09d6f0 0x7efc5c120910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37568/0 (socket says 172.21.15.72:37568) 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.157+0000 7efc6186b700 1 -- 172.21.15.72:0/416572273 learned_addr learned my addr 172.21.15.72:0/416572273 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.157+0000 7efc6206c700 1 --2- 172.21.15.72:0/416572273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5c139170 0x7efc5c121390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.157+0000 7efc6106a700 1 --2- 172.21.15.72:0/416572273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc5c09e1d0 0x7efc5c120e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.158+0000 7efc6186b700 1 -- 172.21.15.72:0/416572273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5c139170 msgr2=0x7efc5c121390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.158+0000 7efc6186b700 1 --2- 172.21.15.72:0/416572273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5c139170 0x7efc5c121390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.158+0000 7efc6186b700 1 -- 172.21.15.72:0/416572273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc5c09e1d0 msgr2=0x7efc5c120e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.158+0000 7efc6186b700 1 --2- 172.21.15.72:0/416572273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc5c09e1d0 0x7efc5c120e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.158+0000 7efc6186b700 1 -- 172.21.15.72:0/416572273 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c009550 con 0x7efc5c09d6f0 2023-10-03T10:13:10.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.158+0000 7efc6206c700 1 --2- 172.21.15.72:0/416572273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5c139170 0x7efc5c121390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.158+0000 7efc6106a700 1 --2- 172.21.15.72:0/416572273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc5c09e1d0 0x7efc5c120e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.158+0000 7efc6186b700 1 --2- 172.21.15.72:0/416572273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc5c09d6f0 0x7efc5c120910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efc5800c4e0 tx=0x7efc5800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.158+0000 7efc527fc700 1 -- 172.21.15.72:0/416572273 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc580052d0 con 0x7efc5c09d6f0 2023-10-03T10:13:10.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.158+0000 7efc527fc700 1 -- 172.21.15.72:0/416572273 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc58005430 con 0x7efc5c09d6f0 2023-10-03T10:13:10.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.158+0000 7efc527fc700 1 -- 172.21.15.72:0/416572273 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc580038c0 con 0x7efc5c09d6f0 2023-10-03T10:13:10.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.158+0000 7efc63acf700 1 -- 172.21.15.72:0/416572273 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc54009a70 con 0x7efc5c09d6f0 2023-10-03T10:13:10.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.158+0000 7efc63acf700 1 -- 172.21.15.72:0/416572273 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5c122c30 con 0x7efc5c09d6f0 2023-10-03T10:13:10.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.159+0000 7efc527fc700 1 -- 172.21.15.72:0/416572273 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc58003a20 con 0x7efc5c09d6f0 2023-10-03T10:13:10.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.159+0000 7efc63acf700 1 -- 172.21.15.72:0/416572273 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5c074ea0 con 0x7efc5c09d6f0 2023-10-03T10:13:10.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.160+0000 7efc527fc700 1 -- 172.21.15.72:0/416572273 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efc5803eb20 con 0x7efc5c09d6f0 2023-10-03T10:13:10.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.164+0000 7efc527fc700 1 -- 172.21.15.72:0/416572273 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc58040e60 con 0x7efc5c09d6f0 2023-10-03T10:13:10.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.194+0000 7fc91c511700 1 Processor -- start 2023-10-03T10:13:10.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.194+0000 7fc91c511700 1 -- start start 2023-10-03T10:13:10.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.195+0000 7fc91c511700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc91409ac90 0x7fc91413cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.195+0000 7fc91c511700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc91413d240 0x7fc91413f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.195+0000 7fc91c511700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc914134980 con 0x7fc91406c0e0 2023-10-03T10:13:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.195+0000 7fc91c511700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91406c4b0 con 0x7fc91413d240 2023-10-03T10:13:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.195+0000 7fc91c511700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91409b0e0 con 0x7fc91409ac90 2023-10-03T10:13:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.195+0000 7fc919aac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc91409ac90 0x7fc91413cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.195+0000 7fc91a2ad700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc91406c0e0 0x7fc914134ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50442/0 (socket says 172.21.15.72:50442) 2023-10-03T10:13:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.195+0000 7fc91a2ad700 1 -- 172.21.15.72:0/4067403719 learned_addr learned my addr 172.21.15.72:0/4067403719 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.195+0000 7fc91aaae700 1 --2- 172.21.15.72:0/4067403719 >> v2:172.21.15.72:3300/0 conn(0x7fc91413d240 0x7fc91413f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.196+0000 7fc91aaae700 1 -- 172.21.15.72:0/4067403719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc91409ac90 msgr2=0x7fc91413cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.196+0000 7fc91aaae700 1 --2- 172.21.15.72:0/4067403719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc91409ac90 0x7fc91413cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.196+0000 7fc91aaae700 1 -- 172.21.15.72:0/4067403719 >> v1:172.21.15.72:6789/0 conn(0x7fc91406c0e0 legacy=0x7fc914134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.196+0000 7fc91aaae700 1 -- 172.21.15.72:0/4067403719 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9140a0600 con 0x7fc91413d240 2023-10-03T10:13:10.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.196+0000 7fc919aac700 1 --2- 172.21.15.72:0/4067403719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc91409ac90 0x7fc91413cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.196+0000 7fc91aaae700 1 --2- 172.21.15.72:0/4067403719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc91413d240 0x7fc91413f620 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009d90 tx=0x7fc90c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6fff25a5f042d28 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.196+0000 7fc9192ab700 1 -- 172.21.15.72:0/4067403719 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c00e070 con 0x7fc91413d240 2023-10-03T10:13:10.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.196+0000 7fc9192ab700 1 -- 172.21.15.72:0/4067403719 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c003a20 con 0x7fc91413d240 2023-10-03T10:13:10.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.196+0000 7fc9192ab700 1 -- 172.21.15.72:0/4067403719 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c003dd0 con 0x7fc91413d240 2023-10-03T10:13:10.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.197+0000 7fc91c511700 1 -- 172.21.15.72:0/4067403719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc91413d240 msgr2=0x7fc91413f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.197+0000 7fc91c511700 1 --2- 172.21.15.72:0/4067403719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc91413d240 0x7fc91413f620 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009d90 tx=0x7fc90c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:10.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.197+0000 7fc91c511700 1 -- 172.21.15.72:0/4067403719 shutdown_connections 2023-10-03T10:13:10.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.197+0000 7fc91c511700 1 --2- 172.21.15.72:0/4067403719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc91413d240 0x7fc91413f620 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.197+0000 7fc91c511700 1 --2- 172.21.15.72:0/4067403719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc91409ac90 0x7fc91413cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.197+0000 7fc91c511700 1 -- 172.21.15.72:0/4067403719 >> 172.21.15.72:0/4067403719 conn(0x7fc9140a4210 msgr2=0x7fc9140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.197+0000 7fc91c511700 1 -- 172.21.15.72:0/4067403719 shutdown_connections 2023-10-03T10:13:10.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.197+0000 7fc91c511700 1 -- 172.21.15.72:0/4067403719 wait complete. 2023-10-03T10:13:10.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.198+0000 7fc91c511700 1 Processor -- start 2023-10-03T10:13:10.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.198+0000 7fc91c511700 1 -- start start 2023-10-03T10:13:10.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.198+0000 7fc91c511700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc91406c0e0 0x7fc914135fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.198+0000 7fc91c511700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc91409ac90 0x7fc9141364e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.198+0000 7fc91c511700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc91413d240 0x7fc914136a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.198+0000 7fc91c511700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc914134400 con 0x7fc91406c0e0 2023-10-03T10:13:10.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.198+0000 7fc91c511700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9140a0460 con 0x7fc91413d240 2023-10-03T10:13:10.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.198+0000 7fc91c511700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9141382c0 con 0x7fc91409ac90 2023-10-03T10:13:10.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.198+0000 7fc91a2ad700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc91406c0e0 0x7fc914135fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.198+0000 7fc91a2ad700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc91406c0e0 0x7fc914135fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34366/0 (socket says 172.21.15.72:34366) 2023-10-03T10:13:10.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.198+0000 7fc91a2ad700 1 -- 172.21.15.72:0/3883927604 learned_addr learned my addr 172.21.15.72:0/3883927604 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:10.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.198+0000 7fc91aaae700 1 --2- 172.21.15.72:0/3883927604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc91413d240 0x7fc914136a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.199+0000 7fc91a2ad700 1 -- 172.21.15.72:0/3883927604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc91409ac90 msgr2=0x7fc9141364e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.199+0000 7fc91a2ad700 1 --2- 172.21.15.72:0/3883927604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc91409ac90 0x7fc9141364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.199+0000 7fc91a2ad700 1 -- 172.21.15.72:0/3883927604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc91413d240 msgr2=0x7fc914136a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.199+0000 7fc91a2ad700 1 --2- 172.21.15.72:0/3883927604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc91413d240 0x7fc914136a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.199+0000 7fc91a2ad700 1 -- 172.21.15.72:0/3883927604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9040094a0 con 0x7fc91406c0e0 2023-10-03T10:13:10.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.199+0000 7fc91a2ad700 1 --2- 172.21.15.72:0/3883927604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc91406c0e0 0x7fc914135fa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc91000c780 tx=0x7fc91000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.199+0000 7fc90affd700 1 -- 172.21.15.72:0/3883927604 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910004c80 con 0x7fc91406c0e0 2023-10-03T10:13:10.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.199+0000 7fc90affd700 1 -- 172.21.15.72:0/3883927604 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc910004de0 con 0x7fc91406c0e0 2023-10-03T10:13:10.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.199+0000 7fc91c511700 1 -- 172.21.15.72:0/3883927604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90c009a70 con 0x7fc91406c0e0 2023-10-03T10:13:10.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.199+0000 7fc90affd700 1 -- 172.21.15.72:0/3883927604 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910007310 con 0x7fc91406c0e0 2023-10-03T10:13:10.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.199+0000 7fc91c511700 1 -- 172.21.15.72:0/3883927604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc914139870 con 0x7fc91406c0e0 2023-10-03T10:13:10.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.200+0000 7fc90affd700 1 -- 172.21.15.72:0/3883927604 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc910007470 con 0x7fc91406c0e0 2023-10-03T10:13:10.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.200+0000 7fc90affd700 1 -- 172.21.15.72:0/3883927604 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc91003f3d0 con 0x7fc91406c0e0 2023-10-03T10:13:10.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.200+0000 7fc91c511700 1 -- 172.21.15.72:0/3883927604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc914074ea0 con 0x7fc91406c0e0 2023-10-03T10:13:10.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.203+0000 7f4562410700 1 Processor -- start 2023-10-03T10:13:10.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.203+0000 7f4562410700 1 -- start start 2023-10-03T10:13:10.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.203+0000 7f4562410700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f455c09d6f0 0x7f455c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f4562410700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f455c09e000 0x7f455c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f4562410700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f455c09e410 0x7f455c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f4562410700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455c09f520 con 0x7f455c09e410 2023-10-03T10:13:10.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f4562410700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455c09f130 con 0x7f455c09d6f0 2023-10-03T10:13:10.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f4562410700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f455c09e930 con 0x7f455c09e000 2023-10-03T10:13:10.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f455b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f455c09e000 0x7f455c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f45609ad700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f455c09e410 0x7f455c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f455b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f455c09e000 0x7f455c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37592/0 (socket says 172.21.15.72:37592) 2023-10-03T10:13:10.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f455b7fe700 1 -- 172.21.15.72:0/4144496396 learned_addr learned my addr 172.21.15.72:0/4144496396 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:10.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f455bfff700 1 --2- 172.21.15.72:0/4144496396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f455c09d6f0 0x7f455c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f455bfff700 1 -- 172.21.15.72:0/4144496396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f455c09e000 msgr2=0x7f455c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f455bfff700 1 --2- 172.21.15.72:0/4144496396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f455c09e000 0x7f455c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f455bfff700 1 -- 172.21.15.72:0/4144496396 >> v2:172.21.15.72:3300/0 conn(0x7f455c09e410 msgr2=0x7f455c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f455bfff700 1 --2- 172.21.15.72:0/4144496396 >> v2:172.21.15.72:3300/0 conn(0x7f455c09e410 0x7f455c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f455bfff700 1 -- 172.21.15.72:0/4144496396 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455c09b2d0 con 0x7f455c09d6f0 2023-10-03T10:13:10.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f45609ad700 1 --2- 172.21.15.72:0/4144496396 >> v2:172.21.15.72:3300/0 conn(0x7f455c09e410 0x7f455c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f455b7fe700 1 --2- 172.21.15.72:0/4144496396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f455c09e000 0x7f455c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.204+0000 7f455bfff700 1 --2- 172.21.15.72:0/4144496396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f455c09d6f0 0x7f455c09dac0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f454c009870 tx=0x7f454c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5afc70577ab263d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.205+0000 7f455affd700 1 -- 172.21.15.72:0/4144496396 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c011830 con 0x7f455c09d6f0 2023-10-03T10:13:10.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.205+0000 7f455affd700 1 -- 172.21.15.72:0/4144496396 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c011990 con 0x7f455c09d6f0 2023-10-03T10:13:10.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.205+0000 7f455affd700 1 -- 172.21.15.72:0/4144496396 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c011d20 con 0x7f455c09d6f0 2023-10-03T10:13:10.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.205+0000 7f4562410700 1 -- 172.21.15.72:0/4144496396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f455c09d6f0 msgr2=0x7f455c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.205+0000 7f4562410700 1 --2- 172.21.15.72:0/4144496396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f455c09d6f0 0x7f455c09dac0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f454c009870 tx=0x7f454c009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:10.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.205+0000 7f4562410700 1 -- 172.21.15.72:0/4144496396 shutdown_connections 2023-10-03T10:13:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.205+0000 7f4562410700 1 --2- 172.21.15.72:0/4144496396 >> v2:172.21.15.72:3300/0 conn(0x7f455c09e410 0x7f455c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.205+0000 7f4562410700 1 --2- 172.21.15.72:0/4144496396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f455c09d6f0 0x7f455c09dac0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.205+0000 7f4562410700 1 --2- 172.21.15.72:0/4144496396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f455c09e000 0x7f455c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.205+0000 7f4562410700 1 -- 172.21.15.72:0/4144496396 >> 172.21.15.72:0/4144496396 conn(0x7f455c066f50 msgr2=0x7f455c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.205+0000 7f4562410700 1 -- 172.21.15.72:0/4144496396 shutdown_connections 2023-10-03T10:13:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.205+0000 7f4562410700 1 -- 172.21.15.72:0/4144496396 wait complete. 2023-10-03T10:13:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.206+0000 7f4562410700 1 Processor -- start 2023-10-03T10:13:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.206+0000 7fc90affd700 1 -- 172.21.15.72:0/3883927604 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc910007720 con 0x7fc91406c0e0 2023-10-03T10:13:10.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.207+0000 7f4562410700 1 -- start start 2023-10-03T10:13:10.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.207+0000 7f4562410700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f455c09d6f0 0x7f455c1370e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.207+0000 7f4562410700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f455c09e000 0x7f455c137620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.207+0000 7f4562410700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f455c09e410 0x7f455c1c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.207+0000 7f4562410700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455c11a210 con 0x7f455c09d6f0 2023-10-03T10:13:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.207+0000 7f4562410700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455c0723f0 con 0x7f455c09e000 2023-10-03T10:13:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.207+0000 7f4562410700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f455c137b60 con 0x7f455c09e410 2023-10-03T10:13:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.207+0000 7f455bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f455c09d6f0 0x7f455c1370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.207+0000 7f455bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f455c09d6f0 0x7f455c1370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34392/0 (socket says 172.21.15.72:34392) 2023-10-03T10:13:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.207+0000 7f455bfff700 1 -- 172.21.15.72:0/3368264020 learned_addr learned my addr 172.21.15.72:0/3368264020 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.207+0000 7f455b7fe700 1 --2- 172.21.15.72:0/3368264020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f455c09e000 0x7f455c137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.207+0000 7f45609ad700 1 --2- 172.21.15.72:0/3368264020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f455c09e410 0x7f455c1c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.208+0000 7f455bfff700 1 -- 172.21.15.72:0/3368264020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f455c09e410 msgr2=0x7f455c1c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.208+0000 7f455bfff700 1 --2- 172.21.15.72:0/3368264020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f455c09e410 0x7f455c1c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.208+0000 7f455bfff700 1 -- 172.21.15.72:0/3368264020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f455c09e000 msgr2=0x7f455c137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.208+0000 7f455bfff700 1 --2- 172.21.15.72:0/3368264020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f455c09e000 0x7f455c137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.208+0000 7f455bfff700 1 -- 172.21.15.72:0/3368264020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4550009550 con 0x7f455c09d6f0 2023-10-03T10:13:10.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.208+0000 7f455bfff700 1 --2- 172.21.15.72:0/3368264020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f455c09d6f0 0x7f455c1370e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f454c000c00 tx=0x7f454c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.208+0000 7f4558ff9700 1 -- 172.21.15.72:0/3368264020 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c004510 con 0x7f455c09d6f0 2023-10-03T10:13:10.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.208+0000 7f4558ff9700 1 -- 172.21.15.72:0/3368264020 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c01f070 con 0x7f455c09d6f0 2023-10-03T10:13:10.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.208+0000 7f4558ff9700 1 -- 172.21.15.72:0/3368264020 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c0038a0 con 0x7f455c09d6f0 2023-10-03T10:13:10.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.208+0000 7f4562410700 1 -- 172.21.15.72:0/3368264020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4554009a70 con 0x7f455c09d6f0 2023-10-03T10:13:10.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.208+0000 7f4562410700 1 -- 172.21.15.72:0/3368264020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454c0094a0 con 0x7f455c09d6f0 2023-10-03T10:13:10.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.209+0000 7f4558ff9700 1 -- 172.21.15.72:0/3368264020 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f454c003a00 con 0x7f455c09d6f0 2023-10-03T10:13:10.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.209+0000 7f4558ff9700 1 -- 172.21.15.72:0/3368264020 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f454c021070 con 0x7f455c09d6f0 2023-10-03T10:13:10.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.209+0000 7f4562410700 1 -- 172.21.15.72:0/3368264020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f455c074ea0 con 0x7f455c09d6f0 2023-10-03T10:13:10.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.214+0000 7f4558ff9700 1 -- 172.21.15.72:0/3368264020 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f454c02b080 con 0x7f455c09d6f0 2023-10-03T10:13:10.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.233+0000 7f37b8bd7700 1 Processor -- start 2023-10-03T10:13:10.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.233+0000 7f37b8bd7700 1 -- start start 2023-10-03T10:13:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.234+0000 7f37b8bd7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37b412cf60 0x7f37b406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.234+0000 7f37b8bd7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37b4130430 0x7f37b4137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.234+0000 7f37b8bd7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b412cd90 con 0x7f37b412f8b0 2023-10-03T10:13:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.234+0000 7f37b8bd7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b412d330 con 0x7f37b412cf60 2023-10-03T10:13:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.234+0000 7f37b8bd7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37b4071780 con 0x7f37b4130430 2023-10-03T10:13:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.234+0000 7f37b2d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37b4130430 0x7f37b4137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.234+0000 7f37b2d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37b4130430 0x7f37b4137c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37616/0 (socket says 172.21.15.72:37616) 2023-10-03T10:13:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.234+0000 7f37b2d9d700 1 -- 172.21.15.72:0/35989415 learned_addr learned my addr 172.21.15.72:0/35989415 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:10.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.234+0000 7f37b259c700 1 --2- 172.21.15.72:0/35989415 >> v2:172.21.15.72:3300/0 conn(0x7f37b412cf60 0x7f37b406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.235+0000 7f37b259c700 1 -- 172.21.15.72:0/35989415 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37b4130430 msgr2=0x7f37b4137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.235+0000 7f37b259c700 1 --2- 172.21.15.72:0/35989415 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37b4130430 0x7f37b4137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.235+0000 7f37b259c700 1 -- 172.21.15.72:0/35989415 >> v1:172.21.15.72:6789/0 conn(0x7f37b412f8b0 legacy=0x7f37b412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.235+0000 7f37b159a700 1 -- 172.21.15.72:0/35989415 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522858999 0 0) 0x7f37b412cd90 con 0x7f37b412f8b0 2023-10-03T10:13:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.235+0000 7f37b259c700 1 -- 172.21.15.72:0/35989415 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4071a40 con 0x7f37b412cf60 2023-10-03T10:13:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.235+0000 7f37b2d9d700 1 --2- 172.21.15.72:0/35989415 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37b4130430 0x7f37b4137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.235+0000 7f37b259c700 1 --2- 172.21.15.72:0/35989415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37b412cf60 0x7f37b406f5d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009840 tx=0x7f37a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896033d8f059602f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.235+0000 7f37b159a700 1 -- 172.21.15.72:0/35989415 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a4011830 con 0x7f37b412cf60 2023-10-03T10:13:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.235+0000 7f37b159a700 1 -- 172.21.15.72:0/35989415 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a4011990 con 0x7f37b412cf60 2023-10-03T10:13:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.235+0000 7f37b159a700 1 -- 172.21.15.72:0/35989415 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a4011d20 con 0x7f37b412cf60 2023-10-03T10:13:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.236+0000 7f37b8bd7700 1 -- 172.21.15.72:0/35989415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37b412cf60 msgr2=0x7f37b406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.236+0000 7f37b8bd7700 1 --2- 172.21.15.72:0/35989415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37b412cf60 0x7f37b406f5d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009840 tx=0x7f37a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:10.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.236+0000 7f37b8bd7700 1 -- 172.21.15.72:0/35989415 shutdown_connections 2023-10-03T10:13:10.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.236+0000 7f37b8bd7700 1 --2- 172.21.15.72:0/35989415 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37b4130430 0x7f37b4137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.236+0000 7f37b8bd7700 1 --2- 172.21.15.72:0/35989415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37b412cf60 0x7f37b406f5d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.236+0000 7f37b8bd7700 1 -- 172.21.15.72:0/35989415 >> 172.21.15.72:0/35989415 conn(0x7f37b40a2aa0 msgr2=0x7f37b40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.236+0000 7f37b8bd7700 1 -- 172.21.15.72:0/35989415 shutdown_connections 2023-10-03T10:13:10.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.236+0000 7f37b8bd7700 1 -- 172.21.15.72:0/35989415 wait complete. 2023-10-03T10:13:10.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.237+0000 7f37b8bd7700 1 Processor -- start 2023-10-03T10:13:10.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.237+0000 7f37b8bd7700 1 -- start start 2023-10-03T10:13:10.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.237+0000 7f37b8bd7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37b412cf60 0x7f37b409be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.237+0000 7f37b8bd7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37b412f8b0 0x7f37b41c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.237+0000 7f37b8bd7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37b4130430 0x7f37b41c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.237+0000 7f37b8bd7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b409da00 con 0x7f37b412f8b0 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.237+0000 7f37b8bd7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b409b760 con 0x7f37b412cf60 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.237+0000 7f37b8bd7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37b409e8c0 con 0x7f37b4130430 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.237+0000 7f37b2d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37b4130430 0x7f37b41c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.237+0000 7f37b2d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37b4130430 0x7f37b41c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37628/0 (socket says 172.21.15.72:37628) 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.237+0000 7f37b2d9d700 1 -- 172.21.15.72:0/2538076184 learned_addr learned my addr 172.21.15.72:0/2538076184 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.237+0000 7f37b259c700 1 --2- 172.21.15.72:0/2538076184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37b412cf60 0x7f37b409be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.238+0000 7f37b1d9b700 1 --2- 172.21.15.72:0/2538076184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37b412f8b0 0x7f37b41c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.238+0000 7f37b2d9d700 1 -- 172.21.15.72:0/2538076184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37b412cf60 msgr2=0x7f37b409be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.238+0000 7f37b2d9d700 1 --2- 172.21.15.72:0/2538076184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37b412cf60 0x7f37b409be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.238+0000 7f37b2d9d700 1 -- 172.21.15.72:0/2538076184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37b412f8b0 msgr2=0x7f37b41c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.238+0000 7f37b2d9d700 1 --2- 172.21.15.72:0/2538076184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37b412f8b0 0x7f37b41c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.238+0000 7f37b2d9d700 1 -- 172.21.15.72:0/2538076184 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac00ac40 con 0x7f37b4130430 2023-10-03T10:13:10.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.238+0000 7f37b2d9d700 1 --2- 172.21.15.72:0/2538076184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37b4130430 0x7f37b41c4380 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0083f0 tx=0x7f37ac0074d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:10.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.238+0000 7f37a2ffd700 1 -- 172.21.15.72:0/2538076184 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac007c60 con 0x7f37b4130430 2023-10-03T10:13:10.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.238+0000 7f37a2ffd700 1 -- 172.21.15.72:0/2538076184 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac017070 con 0x7f37b4130430 2023-10-03T10:13:10.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.238+0000 7f37a2ffd700 1 -- 172.21.15.72:0/2538076184 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac013550 con 0x7f37b4130430 2023-10-03T10:13:10.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.238+0000 7f37b8bd7700 1 -- 172.21.15.72:0/2538076184 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a40094a0 con 0x7f37b4130430 2023-10-03T10:13:10.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.238+0000 7f37b8bd7700 1 -- 172.21.15.72:0/2538076184 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b409eba0 con 0x7f37b4130430 2023-10-03T10:13:10.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.239+0000 7f37a2ffd700 1 -- 172.21.15.72:0/2538076184 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37ac019030 con 0x7f37b4130430 2023-10-03T10:13:10.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.239+0000 7f37b8bd7700 1 -- 172.21.15.72:0/2538076184 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b4074ea0 con 0x7f37b4130430 2023-10-03T10:13:10.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.239+0000 7f37a2ffd700 1 -- 172.21.15.72:0/2538076184 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f37ac043ae0 con 0x7f37b4130430 2023-10-03T10:13:10.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.244+0000 7f37a2ffd700 1 -- 172.21.15.72:0/2538076184 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37ac023930 con 0x7f37b4130430 2023-10-03T10:13:10.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.366+0000 7efc63acf700 1 -- 172.21.15.72:0/416572273 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efc5c06c360 con 0x7efc5c09d6f0 2023-10-03T10:13:10.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.367+0000 7efc527fc700 1 -- 172.21.15.72:0/416572273 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc58017070 con 0x7efc5c09d6f0 2023-10-03T10:13:10.368 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:10.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.369+0000 7efc63acf700 1 -- 172.21.15.72:0/416572273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc5c09d6f0 msgr2=0x7efc5c120910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.369+0000 7efc63acf700 1 --2- 172.21.15.72:0/416572273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc5c09d6f0 0x7efc5c120910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efc5800c4e0 tx=0x7efc5800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.369+0000 7efc63acf700 1 -- 172.21.15.72:0/416572273 shutdown_connections 2023-10-03T10:13:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.369+0000 7efc63acf700 1 --2- 172.21.15.72:0/416572273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5c139170 0x7efc5c121390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.369+0000 7efc63acf700 1 --2- 172.21.15.72:0/416572273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc5c09d6f0 0x7efc5c120910 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.369+0000 7efc63acf700 1 --2- 172.21.15.72:0/416572273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc5c09e1d0 0x7efc5c120e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.369+0000 7efc63acf700 1 -- 172.21.15.72:0/416572273 >> 172.21.15.72:0/416572273 conn(0x7efc5c066f50 msgr2=0x7efc5c09b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.369+0000 7efc63acf700 1 -- 172.21.15.72:0/416572273 shutdown_connections 2023-10-03T10:13:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.369+0000 7efc63acf700 1 -- 172.21.15.72:0/416572273 wait complete. 2023-10-03T10:13:10.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:10.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.401+0000 7fc91c511700 1 -- 172.21.15.72:0/3883927604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc91413d020 con 0x7fc91406c0e0 2023-10-03T10:13:10.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.402+0000 7fc90affd700 1 -- 172.21.15.72:0/3883927604 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc910011e80 con 0x7fc91406c0e0 2023-10-03T10:13:10.403 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:10.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.404+0000 7fc91c511700 1 -- 172.21.15.72:0/3883927604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc91406c0e0 msgr2=0x7fc914135fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.404+0000 7fc91c511700 1 --2- 172.21.15.72:0/3883927604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc91406c0e0 0x7fc914135fa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc91000c780 tx=0x7fc91000ca90 comp rx=0 tx=0).stop 2023-10-03T10:13:10.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.404+0000 7fc91c511700 1 -- 172.21.15.72:0/3883927604 shutdown_connections 2023-10-03T10:13:10.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.404+0000 7fc91c511700 1 --2- 172.21.15.72:0/3883927604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc91406c0e0 0x7fc914135fa0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.404+0000 7fc91c511700 1 --2- 172.21.15.72:0/3883927604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc91413d240 0x7fc914136a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.404+0000 7fc91c511700 1 --2- 172.21.15.72:0/3883927604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc91409ac90 0x7fc9141364e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.404+0000 7fc91c511700 1 -- 172.21.15.72:0/3883927604 >> 172.21.15.72:0/3883927604 conn(0x7fc9140a4210 msgr2=0x7fc9140a2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.404+0000 7fc91c511700 1 -- 172.21.15.72:0/3883927604 shutdown_connections 2023-10-03T10:13:10.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.404+0000 7fc91c511700 1 -- 172.21.15.72:0/3883927604 wait complete. 2023-10-03T10:13:10.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.409+0000 7f4562410700 1 -- 172.21.15.72:0/3368264020 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f455c1383f0 con 0x7f455c09d6f0 2023-10-03T10:13:10.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.409+0000 7f4558ff9700 1 -- 172.21.15.72:0/3368264020 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f454c035090 con 0x7f455c09d6f0 2023-10-03T10:13:10.410 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:10.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.411+0000 7f4562410700 1 -- 172.21.15.72:0/3368264020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f455c09d6f0 msgr2=0x7f455c1370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.411+0000 7f4562410700 1 --2- 172.21.15.72:0/3368264020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f455c09d6f0 0x7f455c1370e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f454c000c00 tx=0x7f454c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:10.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.411+0000 7f4562410700 1 -- 172.21.15.72:0/3368264020 shutdown_connections 2023-10-03T10:13:10.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.411+0000 7f4562410700 1 --2- 172.21.15.72:0/3368264020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f455c09d6f0 0x7f455c1370e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.411+0000 7f4562410700 1 --2- 172.21.15.72:0/3368264020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f455c09e410 0x7f455c1c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.411+0000 7f4562410700 1 --2- 172.21.15.72:0/3368264020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f455c09e000 0x7f455c137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.411+0000 7f4562410700 1 -- 172.21.15.72:0/3368264020 >> 172.21.15.72:0/3368264020 conn(0x7f455c066f50 msgr2=0x7f455c0a1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.411+0000 7f4562410700 1 -- 172.21.15.72:0/3368264020 shutdown_connections 2023-10-03T10:13:10.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.412+0000 7f4562410700 1 -- 172.21.15.72:0/3368264020 wait complete. 2023-10-03T10:13:10.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:10.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:10.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.440+0000 7f37b8bd7700 1 -- 172.21.15.72:0/2538076184 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37b4129c30 con 0x7f37b4130430 2023-10-03T10:13:10.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.440+0000 7f37a2ffd700 1 -- 172.21.15.72:0/2538076184 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f37ac01b3d0 con 0x7f37b4130430 2023-10-03T10:13:10.440 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:10.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.443+0000 7f37b8bd7700 1 -- 172.21.15.72:0/2538076184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37b4130430 msgr2=0x7f37b41c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:10.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.443+0000 7f37b8bd7700 1 --2- 172.21.15.72:0/2538076184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37b4130430 0x7f37b41c4380 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0083f0 tx=0x7f37ac0074d0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.443+0000 7f37b8bd7700 1 -- 172.21.15.72:0/2538076184 shutdown_connections 2023-10-03T10:13:10.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.443+0000 7f37b8bd7700 1 --2- 172.21.15.72:0/2538076184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37b4130430 0x7f37b41c4380 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.443+0000 7f37b8bd7700 1 --2- 172.21.15.72:0/2538076184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37b412cf60 0x7f37b409be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.443+0000 7f37b8bd7700 1 --2- 172.21.15.72:0/2538076184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37b412f8b0 0x7f37b41c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:10.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.443+0000 7f37b8bd7700 1 -- 172.21.15.72:0/2538076184 >> 172.21.15.72:0/2538076184 conn(0x7f37b40a2aa0 msgr2=0x7f37b412a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:10.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.443+0000 7f37b8bd7700 1 -- 172.21.15.72:0/2538076184 shutdown_connections 2023-10-03T10:13:10.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:10.443+0000 7f37b8bd7700 1 -- 172.21.15.72:0/2538076184 wait complete. 2023-10-03T10:13:10.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:11.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:11.418 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:11.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:11.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.525+0000 7f78946a2700 1 Processor -- start 2023-10-03T10:13:11.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.525+0000 7f78946a2700 1 -- start start 2023-10-03T10:13:11.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.525+0000 7f78946a2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f788c130540 0x7f788c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.525+0000 7f78946a2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f788c06fcf0 0x7f788c138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.525+0000 7f78946a2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788c0716a0 con 0x7f788c130e50 2023-10-03T10:13:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.525+0000 7f78946a2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788c09a390 con 0x7f788c06fcf0 2023-10-03T10:13:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.525+0000 7f78946a2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788c071290 con 0x7f788c130540 2023-10-03T10:13:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.526+0000 7f789243e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f788c130540 0x7f788c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.526+0000 7f789243e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f788c130540 0x7f788c130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46328/0 (socket says 172.21.15.72:46328) 2023-10-03T10:13:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.526+0000 7f789243e700 1 -- 172.21.15.72:0/3262912368 learned_addr learned my addr 172.21.15.72:0/3262912368 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.526+0000 7f7892c3f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f788c06fcf0 0x7f788c138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.526+0000 7f789243e700 1 -- 172.21.15.72:0/3262912368 >> v2:172.21.15.72:3300/0 conn(0x7f788c06fcf0 msgr2=0x7f788c138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.526+0000 7f789243e700 1 --2- 172.21.15.72:0/3262912368 >> v2:172.21.15.72:3300/0 conn(0x7f788c06fcf0 0x7f788c138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.526+0000 7f789243e700 1 -- 172.21.15.72:0/3262912368 >> v1:172.21.15.72:6789/0 conn(0x7f788c130e50 legacy=0x7f788c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.526+0000 7f789243e700 1 -- 172.21.15.72:0/3262912368 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c130340 con 0x7f788c130540 2023-10-03T10:13:11.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.526+0000 7f789243e700 1 --2- 172.21.15.72:0/3262912368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f788c130540 0x7f788c130910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7888009920 tx=0x7f7888009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aefb43e8286419bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.526+0000 7f789143c700 1 -- 172.21.15.72:0/3262912368 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7888011830 con 0x7f788c130540 2023-10-03T10:13:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.526+0000 7f789143c700 1 -- 172.21.15.72:0/3262912368 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7888011990 con 0x7f788c130540 2023-10-03T10:13:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.527+0000 7f789143c700 1 -- 172.21.15.72:0/3262912368 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7888011d20 con 0x7f788c130540 2023-10-03T10:13:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.527+0000 7f78946a2700 1 -- 172.21.15.72:0/3262912368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f788c130540 msgr2=0x7f788c130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.527+0000 7f78946a2700 1 --2- 172.21.15.72:0/3262912368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f788c130540 0x7f788c130910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7888009920 tx=0x7f7888009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.527+0000 7f78946a2700 1 -- 172.21.15.72:0/3262912368 shutdown_connections 2023-10-03T10:13:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.527+0000 7f78946a2700 1 --2- 172.21.15.72:0/3262912368 >> v2:172.21.15.72:3300/0 conn(0x7f788c06fcf0 0x7f788c138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.527+0000 7f78946a2700 1 --2- 172.21.15.72:0/3262912368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f788c130540 0x7f788c130910 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.527+0000 7f78946a2700 1 -- 172.21.15.72:0/3262912368 >> 172.21.15.72:0/3262912368 conn(0x7f788c0a2aa0 msgr2=0x7f788c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.527+0000 7f78946a2700 1 -- 172.21.15.72:0/3262912368 shutdown_connections 2023-10-03T10:13:11.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.527+0000 7f78946a2700 1 -- 172.21.15.72:0/3262912368 wait complete. 2023-10-03T10:13:11.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.528+0000 7f78946a2700 1 Processor -- start 2023-10-03T10:13:11.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.528+0000 7f78946a2700 1 -- start start 2023-10-03T10:13:11.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f78946a2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f788c06fcf0 0x7f788c139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f78946a2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f788c130540 0x7f788c13a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f78946a2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c130e50 0x7f788c13a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f78946a2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c12dcc0 con 0x7f788c130e50 2023-10-03T10:13:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f78946a2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0718e0 con 0x7f788c130540 2023-10-03T10:13:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f78946a2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f788c13b6e0 con 0x7f788c06fcf0 2023-10-03T10:13:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f7891c3d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f788c130540 0x7f788c13a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f7891c3d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f788c130540 0x7f788c13a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46344/0 (socket says 172.21.15.72:46344) 2023-10-03T10:13:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f7891c3d700 1 -- 172.21.15.72:0/766479127 learned_addr learned my addr 172.21.15.72:0/766479127 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f7892c3f700 1 --2- 172.21.15.72:0/766479127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c130e50 0x7f788c13a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f789243e700 1 --2- 172.21.15.72:0/766479127 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f788c06fcf0 0x7f788c139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f7891c3d700 1 -- 172.21.15.72:0/766479127 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f788c06fcf0 msgr2=0x7f788c139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f7891c3d700 1 --2- 172.21.15.72:0/766479127 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f788c06fcf0 0x7f788c139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f7891c3d700 1 -- 172.21.15.72:0/766479127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c130e50 msgr2=0x7f788c13a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f7891c3d700 1 --2- 172.21.15.72:0/766479127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c130e50 0x7f788c13a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f7891c3d700 1 -- 172.21.15.72:0/766479127 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7888009550 con 0x7f788c130540 2023-10-03T10:13:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.529+0000 7f789243e700 1 --2- 172.21.15.72:0/766479127 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f788c06fcf0 0x7f788c139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.530+0000 7f7891c3d700 1 --2- 172.21.15.72:0/766479127 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f788c130540 0x7f788c13a000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c4e0 tx=0x7f787c00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.530+0000 7f7882ffd700 1 -- 172.21.15.72:0/766479127 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c0052d0 con 0x7f788c130540 2023-10-03T10:13:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.530+0000 7f7882ffd700 1 -- 172.21.15.72:0/766479127 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c005430 con 0x7f788c130540 2023-10-03T10:13:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.530+0000 7f7882ffd700 1 -- 172.21.15.72:0/766479127 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c0038c0 con 0x7f788c130540 2023-10-03T10:13:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.530+0000 7f78946a2700 1 -- 172.21.15.72:0/766479127 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788c119030 con 0x7f788c130540 2023-10-03T10:13:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.530+0000 7f78946a2700 1 -- 172.21.15.72:0/766479127 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788c118d70 con 0x7f788c130540 2023-10-03T10:13:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.531+0000 7f78946a2700 1 -- 172.21.15.72:0/766479127 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f788c09dd40 con 0x7f788c130540 2023-10-03T10:13:11.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.532+0000 7f7882ffd700 1 -- 172.21.15.72:0/766479127 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f787c003a20 con 0x7f788c130540 2023-10-03T10:13:11.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.532+0000 7f7882ffd700 1 -- 172.21.15.72:0/766479127 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f787c03eac0 con 0x7f788c130540 2023-10-03T10:13:11.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.536+0000 7f7882ffd700 1 -- 172.21.15.72:0/766479127 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f787c018260 con 0x7f788c130540 2023-10-03T10:13:11.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.564+0000 7fae511d5700 1 Processor -- start 2023-10-03T10:13:11.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.564+0000 7fae511d5700 1 -- start start 2023-10-03T10:13:11.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.564+0000 7fe2fb1d0700 1 Processor -- start 2023-10-03T10:13:11.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.564+0000 7fae511d5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fae4c131810 0x7fae4c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.564+0000 7fae511d5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae4c099a40 0x7fae4c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fae511d5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4c1313c0 con 0x7fae4c09a3b0 2023-10-03T10:13:11.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fae511d5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4c09b580 con 0x7fae4c131810 2023-10-03T10:13:11.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fae511d5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c06e8c0 con 0x7fae4c099a40 2023-10-03T10:13:11.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.564+0000 7fe2fb1d0700 1 -- start start 2023-10-03T10:13:11.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fe2fb1d0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2f409d5c0 0x7fe2f4138d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fe2fb1d0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2f40a14a0 0x7fe2f413b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fe2fb1d0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f409ea10 con 0x7fe2f40a09c0 2023-10-03T10:13:11.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fe2fb1d0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f409e210 con 0x7fe2f409d5c0 2023-10-03T10:13:11.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fe2fb1d0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40a26f0 con 0x7fe2f40a14a0 2023-10-03T10:13:11.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fae4a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae4c099a40 0x7fae4c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fae4a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae4c099a40 0x7fae4c099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37646/0 (socket says 172.21.15.72:37646) 2023-10-03T10:13:11.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fae4a59c700 1 -- 172.21.15.72:0/2437193550 learned_addr learned my addr 172.21.15.72:0/2437193550 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:11.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fe2f976d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2f40a14a0 0x7fe2f413b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fe2f976d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2f40a14a0 0x7fe2f413b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46354/0 (socket says 172.21.15.72:46354) 2023-10-03T10:13:11.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fe2f976d700 1 -- 172.21.15.72:0/2743117496 learned_addr learned my addr 172.21.15.72:0/2743117496 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:11.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fae4a59c700 1 -- 172.21.15.72:0/2437193550 >> v2:172.21.15.72:3300/0 conn(0x7fae4c131810 msgr2=0x7fae4c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fae4a59c700 1 --2- 172.21.15.72:0/2437193550 >> v2:172.21.15.72:3300/0 conn(0x7fae4c131810 0x7fae4c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fae4a59c700 1 -- 172.21.15.72:0/2437193550 >> v1:172.21.15.72:6789/0 conn(0x7fae4c09a3b0 legacy=0x7fae4c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fae4a59c700 1 -- 172.21.15.72:0/2437193550 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c09a830 con 0x7fae4c099a40 2023-10-03T10:13:11.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fae4a59c700 1 --2- 172.21.15.72:0/2437193550 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae4c099a40 0x7fae4c099e70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fae40009920 tx=0x7fae40009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37cf4f9837a8c821 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fe2f3fff700 1 --2- 172.21.15.72:0/2743117496 >> v2:172.21.15.72:3300/0 conn(0x7fe2f409d5c0 0x7fe2f4138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fe2f976d700 1 -- 172.21.15.72:0/2743117496 >> v2:172.21.15.72:3300/0 conn(0x7fe2f409d5c0 msgr2=0x7fe2f4138d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fe2f976d700 1 --2- 172.21.15.72:0/2743117496 >> v2:172.21.15.72:3300/0 conn(0x7fe2f409d5c0 0x7fe2f4138d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.565+0000 7fe2f976d700 1 -- 172.21.15.72:0/2743117496 >> v1:172.21.15.72:6789/0 conn(0x7fe2f40a09c0 legacy=0x7fe2f40a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.566+0000 7fe2f976d700 1 -- 172.21.15.72:0/2743117496 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f409db70 con 0x7fe2f40a14a0 2023-10-03T10:13:11.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.566+0000 7fe2f976d700 1 --2- 172.21.15.72:0/2743117496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2f40a14a0 0x7fe2f413b2c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009e50 tx=0x7fe2ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e439ae4d7ce1c724 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.566+0000 7fae49d9b700 1 -- 172.21.15.72:0/2437193550 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae40004230 con 0x7fae4c099a40 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.566+0000 7fe2f37fe700 1 -- 172.21.15.72:0/2743117496 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00e070 con 0x7fe2f40a14a0 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.566+0000 7fe2f37fe700 1 -- 172.21.15.72:0/2743117496 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec00b910 con 0x7fe2f40a14a0 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.566+0000 7fe2f37fe700 1 -- 172.21.15.72:0/2743117496 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00bcc0 con 0x7fe2f40a14a0 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.566+0000 7fae49d9b700 1 -- 172.21.15.72:0/2437193550 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae40004390 con 0x7fae4c099a40 2023-10-03T10:13:11.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.566+0000 7fae49d9b700 1 -- 172.21.15.72:0/2437193550 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae40009e70 con 0x7fae4c099a40 2023-10-03T10:13:11.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fe2fb1d0700 1 -- 172.21.15.72:0/2743117496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2f40a14a0 msgr2=0x7fe2f413b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fe2fb1d0700 1 --2- 172.21.15.72:0/2743117496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2f40a14a0 0x7fe2f413b2c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec009e50 tx=0x7fe2ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:11.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fae511d5700 1 -- 172.21.15.72:0/2437193550 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae4c099a40 msgr2=0x7fae4c099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fae511d5700 1 --2- 172.21.15.72:0/2437193550 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae4c099a40 0x7fae4c099e70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fae40009920 tx=0x7fae40009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fe2fb1d0700 1 -- 172.21.15.72:0/2743117496 shutdown_connections 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fe2fb1d0700 1 --2- 172.21.15.72:0/2743117496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2f40a14a0 0x7fe2f413b2c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fe2fb1d0700 1 --2- 172.21.15.72:0/2743117496 >> v2:172.21.15.72:3300/0 conn(0x7fe2f409d5c0 0x7fe2f4138d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fe2fb1d0700 1 -- 172.21.15.72:0/2743117496 >> 172.21.15.72:0/2743117496 conn(0x7fe2f40a2fe0 msgr2=0x7fe2f40a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fae511d5700 1 -- 172.21.15.72:0/2437193550 shutdown_connections 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fae511d5700 1 --2- 172.21.15.72:0/2437193550 >> v2:172.21.15.72:3300/0 conn(0x7fae4c131810 0x7fae4c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fae511d5700 1 --2- 172.21.15.72:0/2437193550 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae4c099a40 0x7fae4c099e70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fae511d5700 1 -- 172.21.15.72:0/2437193550 >> 172.21.15.72:0/2437193550 conn(0x7fae4c0a2aa0 msgr2=0x7fae4c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fe2fb1d0700 1 -- 172.21.15.72:0/2743117496 shutdown_connections 2023-10-03T10:13:11.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fe2fb1d0700 1 -- 172.21.15.72:0/2743117496 wait complete. 2023-10-03T10:13:11.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fae511d5700 1 -- 172.21.15.72:0/2437193550 shutdown_connections 2023-10-03T10:13:11.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.567+0000 7fae511d5700 1 -- 172.21.15.72:0/2437193550 wait complete. 2023-10-03T10:13:11.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.568+0000 7fe2fb1d0700 1 Processor -- start 2023-10-03T10:13:11.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.568+0000 7fae511d5700 1 Processor -- start 2023-10-03T10:13:11.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.568+0000 7fae511d5700 1 -- start start 2023-10-03T10:13:11.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fae511d5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae4c099a40 0x7fae4c119780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fae511d5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae4c09a3b0 0x7fae4c119cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fae511d5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c131810 0x7fae4c11a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fae511d5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c11ac30 con 0x7fae4c131810 2023-10-03T10:13:11.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fae511d5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c11d1c0 con 0x7fae4c099a40 2023-10-03T10:13:11.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fae511d5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c11c570 con 0x7fae4c09a3b0 2023-10-03T10:13:11.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fae4b59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c131810 0x7fae4c11a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fae4b59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c131810 0x7fae4c11a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34478/0 (socket says 172.21.15.72:34478) 2023-10-03T10:13:11.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fae4b59e700 1 -- 172.21.15.72:0/2813567736 learned_addr learned my addr 172.21.15.72:0/2813567736 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:11.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.568+0000 7fe2fb1d0700 1 -- start start 2023-10-03T10:13:11.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fe2fb1d0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2f409d5c0 0x7fe2f4071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fe2fb1d0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2f40a09c0 0x7fe2f40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fe2fb1d0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2f40a14a0 0x7fe2f406da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fe2fb1d0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f406f950 con 0x7fe2f409d5c0 2023-10-03T10:13:11.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fe2fb1d0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f406eca0 con 0x7fe2f40a14a0 2023-10-03T10:13:11.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fe2fb1d0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f4070ab0 con 0x7fe2f40a09c0 2023-10-03T10:13:11.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fe2f976d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2f40a14a0 0x7fe2f406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fe2f976d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2f40a14a0 0x7fe2f406da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46370/0 (socket says 172.21.15.72:46370) 2023-10-03T10:13:11.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.569+0000 7fe2f976d700 1 -- 172.21.15.72:0/1961156763 learned_addr learned my addr 172.21.15.72:0/1961156763 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:11.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.570+0000 7fae4a59c700 1 --2- 172.21.15.72:0/2813567736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae4c09a3b0 0x7fae4c119cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.570+0000 7fae4b59e700 1 -- 172.21.15.72:0/2813567736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae4c09a3b0 msgr2=0x7fae4c119cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.570+0000 7fae4b59e700 1 --2- 172.21.15.72:0/2813567736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae4c09a3b0 0x7fae4c119cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.570+0000 7fae4b59e700 1 -- 172.21.15.72:0/2813567736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae4c099a40 msgr2=0x7fae4c119780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.570+0000 7fae4b59e700 1 --2- 172.21.15.72:0/2813567736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae4c099a40 0x7fae4c119780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.570+0000 7fae4b59e700 1 -- 172.21.15.72:0/2813567736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae40009550 con 0x7fae4c131810 2023-10-03T10:13:11.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.570+0000 7fe2f976d700 1 -- 172.21.15.72:0/1961156763 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2f40a09c0 msgr2=0x7fe2f40718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.570+0000 7fe2f976d700 1 --2- 172.21.15.72:0/1961156763 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2f40a09c0 0x7fe2f40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.570+0000 7fe2f976d700 1 -- 172.21.15.72:0/1961156763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2f409d5c0 msgr2=0x7fe2f4071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.570+0000 7fe2f976d700 1 --2- 172.21.15.72:0/1961156763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2f409d5c0 0x7fe2f4071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.570+0000 7fe2f976d700 1 -- 172.21.15.72:0/1961156763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec009b30 con 0x7fe2f40a14a0 2023-10-03T10:13:11.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.571+0000 7fae4b59e700 1 --2- 172.21.15.72:0/2813567736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c131810 0x7fae4c11a200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c7d0 tx=0x7fae4400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.571+0000 7fe2f976d700 1 --2- 172.21.15.72:0/1961156763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2f40a14a0 0x7fe2f406da90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40a2830 tx=0x7fe2ec004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.571+0000 7fe2f17fa700 1 -- 172.21.15.72:0/1961156763 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec004960 con 0x7fe2f40a14a0 2023-10-03T10:13:11.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.571+0000 7fe2f17fa700 1 -- 172.21.15.72:0/1961156763 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec0099b0 con 0x7fe2f40a14a0 2023-10-03T10:13:11.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.571+0000 7fe2f17fa700 1 -- 172.21.15.72:0/1961156763 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec01c680 con 0x7fe2f40a14a0 2023-10-03T10:13:11.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.571+0000 7fae337fe700 1 -- 172.21.15.72:0/2813567736 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44003e10 con 0x7fae4c131810 2023-10-03T10:13:11.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.571+0000 7fae337fe700 1 -- 172.21.15.72:0/2813567736 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae44005070 con 0x7fae4c131810 2023-10-03T10:13:11.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.571+0000 7fae337fe700 1 -- 172.21.15.72:0/2813567736 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44005420 con 0x7fae4c131810 2023-10-03T10:13:11.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.571+0000 7fae511d5700 1 -- 172.21.15.72:0/2813567736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4c0a1c60 con 0x7fae4c131810 2023-10-03T10:13:11.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.571+0000 7fae511d5700 1 -- 172.21.15.72:0/2813567736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4c11c0b0 con 0x7fae4c131810 2023-10-03T10:13:11.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.572+0000 7fe2fb1d0700 1 -- 172.21.15.72:0/1961156763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f409cec0 con 0x7fe2f40a14a0 2023-10-03T10:13:11.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.572+0000 7fe2fb1d0700 1 -- 172.21.15.72:0/1961156763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f406fe60 con 0x7fe2f40a14a0 2023-10-03T10:13:11.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.572+0000 7fae511d5700 1 -- 172.21.15.72:0/2813567736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4c11ce20 con 0x7fae4c131810 2023-10-03T10:13:11.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.573+0000 7fe2fb1d0700 1 -- 172.21.15.72:0/1961156763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f406fb00 con 0x7fe2f40a14a0 2023-10-03T10:13:11.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.573+0000 7fae337fe700 1 -- 172.21.15.72:0/2813567736 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae44005580 con 0x7fae4c131810 2023-10-03T10:13:11.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.573+0000 7fae337fe700 1 -- 172.21.15.72:0/2813567736 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fae4403f320 con 0x7fae4c131810 2023-10-03T10:13:11.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.573+0000 7fe2f17fa700 1 -- 172.21.15.72:0/1961156763 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2ec01c7e0 con 0x7fe2f40a14a0 2023-10-03T10:13:11.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.574+0000 7fe2f17fa700 1 -- 172.21.15.72:0/1961156763 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe2ec041460 con 0x7fe2f40a14a0 2023-10-03T10:13:11.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.578+0000 7fae337fe700 1 -- 172.21.15.72:0/2813567736 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae44005830 con 0x7fae4c131810 2023-10-03T10:13:11.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.582+0000 7fe2f17fa700 1 -- 172.21.15.72:0/1961156763 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2ec02d940 con 0x7fe2f40a14a0 2023-10-03T10:13:11.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.602+0000 7fc3b1a10700 1 Processor -- start 2023-10-03T10:13:11.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.602+0000 7fc3b1a10700 1 -- start start 2023-10-03T10:13:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3b1a10700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3ac1316d0 0x7fc3ac131aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3b1a10700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3ac131fe0 0x7fc3ac06e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3b1a10700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3ac06ea90 0x7fc3ac06eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3b1a10700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ac09a5f0 con 0x7fc3ac1316d0 2023-10-03T10:13:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3b1a10700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac131510 con 0x7fc3ac06ea90 2023-10-03T10:13:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3b1a10700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac099e70 con 0x7fc3ac131fe0 2023-10-03T10:13:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3aa7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3ac131fe0 0x7fc3ac06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3aa7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3ac131fe0 0x7fc3ac06e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37678/0 (socket says 172.21.15.72:37678) 2023-10-03T10:13:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3aa7fc700 1 -- 172.21.15.72:0/1123233540 learned_addr learned my addr 172.21.15.72:0/1123233540 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3aaffd700 1 --2- 172.21.15.72:0/1123233540 >> v2:172.21.15.72:3300/0 conn(0x7fc3ac1316d0 0x7fc3ac131aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3ab7fe700 1 --2- 172.21.15.72:0/1123233540 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3ac06ea90 0x7fc3ac06eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3aa7fc700 1 -- 172.21.15.72:0/1123233540 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3ac06ea90 msgr2=0x7fc3ac06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3aa7fc700 1 --2- 172.21.15.72:0/1123233540 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3ac06ea90 0x7fc3ac06eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3aa7fc700 1 -- 172.21.15.72:0/1123233540 >> v2:172.21.15.72:3300/0 conn(0x7fc3ac1316d0 msgr2=0x7fc3ac131aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:11.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3aa7fc700 1 --2- 172.21.15.72:0/1123233540 >> v2:172.21.15.72:3300/0 conn(0x7fc3ac1316d0 0x7fc3ac131aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.603+0000 7fc3aa7fc700 1 -- 172.21.15.72:0/1123233540 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac066680 con 0x7fc3ac131fe0 2023-10-03T10:13:11.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.604+0000 7fc3aa7fc700 1 --2- 172.21.15.72:0/1123233540 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3ac131fe0 0x7fc3ac06e550 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0013db0 tx=0x7fc3a0009710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dead03dee701b05c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.604+0000 7fc3a9ffb700 1 -- 172.21.15.72:0/1123233540 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0012ae0 con 0x7fc3ac131fe0 2023-10-03T10:13:11.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.604+0000 7fc3a9ffb700 1 -- 172.21.15.72:0/1123233540 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a0012c40 con 0x7fc3ac131fe0 2023-10-03T10:13:11.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.604+0000 7fc3a9ffb700 1 -- 172.21.15.72:0/1123233540 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0013050 con 0x7fc3ac131fe0 2023-10-03T10:13:11.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.605+0000 7fc3b1a10700 1 -- 172.21.15.72:0/1123233540 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3ac131fe0 msgr2=0x7fc3ac06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.605+0000 7fc3b1a10700 1 --2- 172.21.15.72:0/1123233540 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3ac131fe0 0x7fc3ac06e550 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0013db0 tx=0x7fc3a0009710 comp rx=0 tx=0).stop 2023-10-03T10:13:11.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.605+0000 7fc3b1a10700 1 -- 172.21.15.72:0/1123233540 shutdown_connections 2023-10-03T10:13:11.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.605+0000 7fc3b1a10700 1 --2- 172.21.15.72:0/1123233540 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3ac06ea90 0x7fc3ac06eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.605+0000 7fc3b1a10700 1 --2- 172.21.15.72:0/1123233540 >> v2:172.21.15.72:3300/0 conn(0x7fc3ac1316d0 0x7fc3ac131aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.605+0000 7fc3b1a10700 1 --2- 172.21.15.72:0/1123233540 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3ac131fe0 0x7fc3ac06e550 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.605+0000 7fc3b1a10700 1 -- 172.21.15.72:0/1123233540 >> 172.21.15.72:0/1123233540 conn(0x7fc3ac0a2aa0 msgr2=0x7fc3ac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.605+0000 7fc3b1a10700 1 -- 172.21.15.72:0/1123233540 shutdown_connections 2023-10-03T10:13:11.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.605+0000 7fc3b1a10700 1 -- 172.21.15.72:0/1123233540 wait complete. 2023-10-03T10:13:11.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.606+0000 7fc3b1a10700 1 Processor -- start 2023-10-03T10:13:11.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.606+0000 7fc3b1a10700 1 -- start start 2023-10-03T10:13:11.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.606+0000 7fc3b1a10700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3ac06ea90 0x7fc3ac1c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.606+0000 7fc3b1a10700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3ac1316d0 0x7fc3ac1c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.606+0000 7fc3b1a10700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3ac131fe0 0x7fc3ac118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:11.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.606+0000 7fc3b1a10700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac12bc70 con 0x7fc3ac06ea90 2023-10-03T10:13:11.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.606+0000 7fc3b1a10700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac11ac00 con 0x7fc3ac131fe0 2023-10-03T10:13:11.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.606+0000 7fc3b1a10700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac11c030 con 0x7fc3ac1316d0 2023-10-03T10:13:11.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.607+0000 7fc3ab7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3ac131fe0 0x7fc3ac118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.607+0000 7fc3ab7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3ac131fe0 0x7fc3ac118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46396/0 (socket says 172.21.15.72:46396) 2023-10-03T10:13:11.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.607+0000 7fc3ab7fe700 1 -- 172.21.15.72:0/2820705241 learned_addr learned my addr 172.21.15.72:0/2820705241 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:11.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.607+0000 7fc3aa7fc700 1 --2- 172.21.15.72:0/2820705241 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3ac1316d0 0x7fc3ac1c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.607+0000 7fc3aaffd700 1 --2- 172.21.15.72:0/2820705241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3ac06ea90 0x7fc3ac1c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:11.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.607+0000 7fc3ab7fe700 1 -- 172.21.15.72:0/2820705241 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3ac1316d0 msgr2=0x7fc3ac1c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.607+0000 7fc3ab7fe700 1 --2- 172.21.15.72:0/2820705241 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3ac1316d0 0x7fc3ac1c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.607+0000 7fc3ab7fe700 1 -- 172.21.15.72:0/2820705241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3ac06ea90 msgr2=0x7fc3ac1c41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.607+0000 7fc3ab7fe700 1 --2- 172.21.15.72:0/2820705241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3ac06ea90 0x7fc3ac1c41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.607+0000 7fc3ab7fe700 1 -- 172.21.15.72:0/2820705241 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a0013a10 con 0x7fc3ac131fe0 2023-10-03T10:13:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.607+0000 7fc3ab7fe700 1 --2- 172.21.15.72:0/2820705241 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3ac131fe0 0x7fc3ac118cd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400efc0 tx=0x7fc3a400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.607+0000 7fc393fff700 1 -- 172.21.15.72:0/2820705241 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4009ea0 con 0x7fc3ac131fe0 2023-10-03T10:13:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.607+0000 7fc3b1a10700 1 -- 172.21.15.72:0/2820705241 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ac1c3d20 con 0x7fc3ac131fe0 2023-10-03T10:13:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.607+0000 7fc393fff700 1 -- 172.21.15.72:0/2820705241 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a400f040 con 0x7fc3ac131fe0 2023-10-03T10:13:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.607+0000 7fc393fff700 1 -- 172.21.15.72:0/2820705241 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a400ced0 con 0x7fc3ac131fe0 2023-10-03T10:13:11.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.608+0000 7fc3b1a10700 1 -- 172.21.15.72:0/2820705241 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ac11bb30 con 0x7fc3ac131fe0 2023-10-03T10:13:11.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.608+0000 7fc393fff700 1 -- 172.21.15.72:0/2820705241 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3a4014480 con 0x7fc3ac131fe0 2023-10-03T10:13:11.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.609+0000 7fc393fff700 1 -- 172.21.15.72:0/2820705241 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc3a403fdf0 con 0x7fc3ac131fe0 2023-10-03T10:13:11.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.609+0000 7fc3b1a10700 1 -- 172.21.15.72:0/2820705241 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38c0052e0 con 0x7fc3ac131fe0 2023-10-03T10:13:11.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.618+0000 7fc393fff700 1 -- 172.21.15.72:0/2820705241 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3a4018070 con 0x7fc3ac131fe0 2023-10-03T10:13:11.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.745+0000 7f78946a2700 1 -- 172.21.15.72:0/766479127 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f788c13ac70 con 0x7f788c130540 2023-10-03T10:13:11.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.745+0000 7f7882ffd700 1 -- 172.21.15.72:0/766479127 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f787c017030 con 0x7f788c130540 2023-10-03T10:13:11.746 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:11.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.747+0000 7f78946a2700 1 -- 172.21.15.72:0/766479127 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f788c130540 msgr2=0x7f788c13a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.747+0000 7f78946a2700 1 --2- 172.21.15.72:0/766479127 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f788c130540 0x7f788c13a000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c4e0 tx=0x7f787c00c7f0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.747+0000 7f78946a2700 1 -- 172.21.15.72:0/766479127 shutdown_connections 2023-10-03T10:13:11.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.747+0000 7f78946a2700 1 --2- 172.21.15.72:0/766479127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f788c130e50 0x7f788c13a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.747+0000 7f78946a2700 1 --2- 172.21.15.72:0/766479127 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f788c06fcf0 0x7f788c139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.747+0000 7f78946a2700 1 --2- 172.21.15.72:0/766479127 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f788c130540 0x7f788c13a000 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.747+0000 7f78946a2700 1 -- 172.21.15.72:0/766479127 >> 172.21.15.72:0/766479127 conn(0x7f788c0a2aa0 msgr2=0x7f788c12f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.747+0000 7f78946a2700 1 -- 172.21.15.72:0/766479127 shutdown_connections 2023-10-03T10:13:11.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.747+0000 7f78946a2700 1 -- 172.21.15.72:0/766479127 wait complete. 2023-10-03T10:13:11.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:11.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.774+0000 7fae511d5700 1 -- 172.21.15.72:0/2813567736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae4c074ea0 con 0x7fae4c131810 2023-10-03T10:13:11.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.775+0000 7fae337fe700 1 -- 172.21.15.72:0/2813567736 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fae44017030 con 0x7fae4c131810 2023-10-03T10:13:11.774 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:11.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.777+0000 7fae511d5700 1 -- 172.21.15.72:0/2813567736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c131810 msgr2=0x7fae4c11a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.777+0000 7fae511d5700 1 --2- 172.21.15.72:0/2813567736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c131810 0x7fae4c11a200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c7d0 tx=0x7fae4400cae0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.777+0000 7fae511d5700 1 -- 172.21.15.72:0/2813567736 shutdown_connections 2023-10-03T10:13:11.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.777+0000 7fae511d5700 1 --2- 172.21.15.72:0/2813567736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae4c131810 0x7fae4c11a200 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.777+0000 7fae511d5700 1 --2- 172.21.15.72:0/2813567736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae4c099a40 0x7fae4c119780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.777+0000 7fae511d5700 1 --2- 172.21.15.72:0/2813567736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae4c09a3b0 0x7fae4c119cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.777+0000 7fae511d5700 1 -- 172.21.15.72:0/2813567736 >> 172.21.15.72:0/2813567736 conn(0x7fae4c0a2aa0 msgr2=0x7fae4c12e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.777+0000 7fae511d5700 1 -- 172.21.15.72:0/2813567736 shutdown_connections 2023-10-03T10:13:11.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.777+0000 7fae511d5700 1 -- 172.21.15.72:0/2813567736 wait complete. 2023-10-03T10:13:11.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.779+0000 7fe2fb1d0700 1 -- 172.21.15.72:0/1961156763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe2f409cc80 con 0x7fe2f40a14a0 2023-10-03T10:13:11.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.779+0000 7fe2f17fa700 1 -- 172.21.15.72:0/1961156763 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2ec02d350 con 0x7fe2f40a14a0 2023-10-03T10:13:11.779 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:11.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.781+0000 7fe2fb1d0700 1 -- 172.21.15.72:0/1961156763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2f40a14a0 msgr2=0x7fe2f406da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.781+0000 7fe2fb1d0700 1 --2- 172.21.15.72:0/1961156763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2f40a14a0 0x7fe2f406da90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40a2830 tx=0x7fe2ec004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.781+0000 7fe2fb1d0700 1 -- 172.21.15.72:0/1961156763 shutdown_connections 2023-10-03T10:13:11.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.781+0000 7fe2fb1d0700 1 --2- 172.21.15.72:0/1961156763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2f409d5c0 0x7fe2f4071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.781+0000 7fe2fb1d0700 1 --2- 172.21.15.72:0/1961156763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2f40a14a0 0x7fe2f406da90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.781+0000 7fe2fb1d0700 1 --2- 172.21.15.72:0/1961156763 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2f40a09c0 0x7fe2f40718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.781+0000 7fe2fb1d0700 1 -- 172.21.15.72:0/1961156763 >> 172.21.15.72:0/1961156763 conn(0x7fe2f40a2fe0 msgr2=0x7fe2f4136fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.781+0000 7fe2fb1d0700 1 -- 172.21.15.72:0/1961156763 shutdown_connections 2023-10-03T10:13:11.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.781+0000 7fe2fb1d0700 1 -- 172.21.15.72:0/1961156763 wait complete. 2023-10-03T10:13:11.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:11.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.814+0000 7fc3b1a10700 1 -- 172.21.15.72:0/2820705241 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc38c005590 con 0x7fc3ac131fe0 2023-10-03T10:13:11.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.815+0000 7fc393fff700 1 -- 172.21.15.72:0/2820705241 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc3a401a8b0 con 0x7fc3ac131fe0 2023-10-03T10:13:11.815 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.817+0000 7fc3b1a10700 1 -- 172.21.15.72:0/2820705241 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3ac131fe0 msgr2=0x7fc3ac118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.817+0000 7fc3b1a10700 1 --2- 172.21.15.72:0/2820705241 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3ac131fe0 0x7fc3ac118cd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400efc0 tx=0x7fc3a400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.817+0000 7fc3b1a10700 1 -- 172.21.15.72:0/2820705241 shutdown_connections 2023-10-03T10:13:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.817+0000 7fc3b1a10700 1 --2- 172.21.15.72:0/2820705241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3ac06ea90 0x7fc3ac1c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.817+0000 7fc3b1a10700 1 --2- 172.21.15.72:0/2820705241 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3ac131fe0 0x7fc3ac118cd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.817+0000 7fc3b1a10700 1 --2- 172.21.15.72:0/2820705241 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3ac1316d0 0x7fc3ac1c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.817+0000 7fc3b1a10700 1 -- 172.21.15.72:0/2820705241 >> 172.21.15.72:0/2820705241 conn(0x7fc3ac0a2aa0 msgr2=0x7fc3ac12d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.817+0000 7fc3b1a10700 1 -- 172.21.15.72:0/2820705241 shutdown_connections 2023-10-03T10:13:11.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:11.817+0000 7fc3b1a10700 1 -- 172.21.15.72:0/2820705241 wait complete. 2023-10-03T10:13:11.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:12.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:12.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:12.795 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:12.829 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:12.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.914+0000 7f090e6e9700 1 Processor -- start 2023-10-03T10:13:12.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.914+0000 7f090e6e9700 1 -- start start 2023-10-03T10:13:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.915+0000 7f090e6e9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f090809d6f0 0x7f090809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.915+0000 7f090e6e9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f090809e000 0x7f0908130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.915+0000 7f090e6e9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090809f130 con 0x7f090809e410 2023-10-03T10:13:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.915+0000 7f090e6e9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090809f520 con 0x7f090809e000 2023-10-03T10:13:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.915+0000 7f090e6e9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090809e930 con 0x7f090809d6f0 2023-10-03T10:13:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.915+0000 7f090cc86700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f090809e410 0x7f0908130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50480/0 (socket says 172.21.15.72:50480) 2023-10-03T10:13:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.915+0000 7f090cc86700 1 -- 172.21.15.72:0/1880027453 learned_addr learned my addr 172.21.15.72:0/1880027453 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.915+0000 7f0907fff700 1 --2- 172.21.15.72:0/1880027453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f090809d6f0 0x7f090809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.915+0000 7f09077fe700 1 --2- 172.21.15.72:0/1880027453 >> v2:172.21.15.72:3300/0 conn(0x7f090809e000 0x7f0908130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.915+0000 7f0906ffd700 1 -- 172.21.15.72:0/1880027453 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349844045 0 0) 0x7f090809f130 con 0x7f090809e410 2023-10-03T10:13:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.915+0000 7f0906ffd700 1 -- 172.21.15.72:0/1880027453 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08f00035b0 con 0x7f090809e410 2023-10-03T10:13:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.915+0000 7f0907fff700 1 -- 172.21.15.72:0/1880027453 >> v2:172.21.15.72:3300/0 conn(0x7f090809e000 msgr2=0x7f0908130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.915+0000 7f0907fff700 1 --2- 172.21.15.72:0/1880027453 >> v2:172.21.15.72:3300/0 conn(0x7f090809e000 0x7f0908130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.915+0000 7f0907fff700 1 -- 172.21.15.72:0/1880027453 >> v1:172.21.15.72:6789/0 conn(0x7f090809e410 legacy=0x7f0908130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.915+0000 7f0907fff700 1 -- 172.21.15.72:0/1880027453 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090809b2d0 con 0x7f090809d6f0 2023-10-03T10:13:12.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.916+0000 7f09077fe700 1 --2- 172.21.15.72:0/1880027453 >> v2:172.21.15.72:3300/0 conn(0x7f090809e000 0x7f0908130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:12.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.916+0000 7f0907fff700 1 --2- 172.21.15.72:0/1880027453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f090809d6f0 0x7f090809dac0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009840 tx=0x7f08f8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ede0cea6ccede6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.916+0000 7f0906ffd700 1 -- 172.21.15.72:0/1880027453 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8011830 con 0x7f090809d6f0 2023-10-03T10:13:12.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.916+0000 7f0906ffd700 1 -- 172.21.15.72:0/1880027453 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f8011990 con 0x7f090809d6f0 2023-10-03T10:13:12.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.916+0000 7f0906ffd700 1 -- 172.21.15.72:0/1880027453 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8011d20 con 0x7f090809d6f0 2023-10-03T10:13:12.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.917+0000 7f090e6e9700 1 -- 172.21.15.72:0/1880027453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f090809d6f0 msgr2=0x7f090809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.917+0000 7f090e6e9700 1 --2- 172.21.15.72:0/1880027453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f090809d6f0 0x7f090809dac0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009840 tx=0x7f08f8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:12.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.917+0000 7f090e6e9700 1 -- 172.21.15.72:0/1880027453 shutdown_connections 2023-10-03T10:13:12.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.917+0000 7f090e6e9700 1 --2- 172.21.15.72:0/1880027453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f090809d6f0 0x7f090809dac0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.917+0000 7f090e6e9700 1 --2- 172.21.15.72:0/1880027453 >> v2:172.21.15.72:3300/0 conn(0x7f090809e000 0x7f0908130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.917+0000 7f090e6e9700 1 -- 172.21.15.72:0/1880027453 >> 172.21.15.72:0/1880027453 conn(0x7f0908066f50 msgr2=0x7f090809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.917+0000 7f090e6e9700 1 -- 172.21.15.72:0/1880027453 shutdown_connections 2023-10-03T10:13:12.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.917+0000 7f090e6e9700 1 -- 172.21.15.72:0/1880027453 wait complete. 2023-10-03T10:13:12.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.918+0000 7f090e6e9700 1 Processor -- start 2023-10-03T10:13:12.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.919+0000 7f090e6e9700 1 -- start start 2023-10-03T10:13:12.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.919+0000 7f090e6e9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f090809d6f0 0x7f09081c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.919+0000 7f090e6e9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f090809e000 0x7f09081c3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.919+0000 7f090e6e9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f090809e410 0x7f0908131670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.919+0000 7f090e6e9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09080a2000 con 0x7f090809e410 2023-10-03T10:13:12.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.919+0000 7f090e6e9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09081346e0 con 0x7f090809d6f0 2023-10-03T10:13:12.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.919+0000 7f090e6e9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f090809c700 con 0x7f090809e000 2023-10-03T10:13:12.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.919+0000 7f090cc86700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f090809e410 0x7f0908131670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.919+0000 7f0907fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f090809d6f0 0x7f09081c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.919+0000 7f090cc86700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f090809e410 0x7f0908131670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34508/0 (socket says 172.21.15.72:34508) 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.919+0000 7f090cc86700 1 -- 172.21.15.72:0/1773694277 learned_addr learned my addr 172.21.15.72:0/1773694277 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.920+0000 7f09077fe700 1 --2- 172.21.15.72:0/1773694277 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f090809e000 0x7f09081c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.920+0000 7f090cc86700 1 -- 172.21.15.72:0/1773694277 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f090809e000 msgr2=0x7f09081c3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.920+0000 7f090cc86700 1 --2- 172.21.15.72:0/1773694277 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f090809e000 0x7f09081c3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.920+0000 7f090cc86700 1 -- 172.21.15.72:0/1773694277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f090809d6f0 msgr2=0x7f09081c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.920+0000 7f090cc86700 1 --2- 172.21.15.72:0/1773694277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f090809d6f0 0x7f09081c2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.920+0000 7f090cc86700 1 -- 172.21.15.72:0/1773694277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc0094a0 con 0x7f090809e410 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.920+0000 7f0907fff700 1 --2- 172.21.15.72:0/1773694277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f090809d6f0 0x7f09081c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.920+0000 7f090cc86700 1 --2- 172.21.15.72:0/1773694277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f090809e410 0x7f0908131670 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f090000cbb0 tx=0x7f090000cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.920+0000 7f0904ff9700 1 -- 172.21.15.72:0/1773694277 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000a9e0 con 0x7f090809e410 2023-10-03T10:13:12.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.920+0000 7f0904ff9700 1 -- 172.21.15.72:0/1773694277 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090000ab40 con 0x7f090809e410 2023-10-03T10:13:12.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.920+0000 7f090e6e9700 1 -- 172.21.15.72:0/1773694277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f80094a0 con 0x7f090809e410 2023-10-03T10:13:12.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.920+0000 7f0904ff9700 1 -- 172.21.15.72:0/1773694277 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900012400 con 0x7f090809e410 2023-10-03T10:13:12.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.920+0000 7f090e6e9700 1 -- 172.21.15.72:0/1773694277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0908132ae0 con 0x7f090809e410 2023-10-03T10:13:12.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.921+0000 7f0904ff9700 1 -- 172.21.15.72:0/1773694277 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f090001b3b0 con 0x7f090809e410 2023-10-03T10:13:12.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.921+0000 7f0904ff9700 1 -- 172.21.15.72:0/1773694277 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f090003f380 con 0x7f090809e410 2023-10-03T10:13:12.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.922+0000 7f090e6e9700 1 -- 172.21.15.72:0/1773694277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09081338a0 con 0x7f090809e410 2023-10-03T10:13:12.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.927+0000 7f0904ff9700 1 -- 172.21.15.72:0/1773694277 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09000192c0 con 0x7f090809e410 2023-10-03T10:13:12.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.949+0000 7f3056e2e700 1 Processor -- start 2023-10-03T10:13:12.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.949+0000 7f3056e2e700 1 -- start start 2023-10-03T10:13:12.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.949+0000 7f82fd61b700 1 Processor -- start 2023-10-03T10:13:12.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.949+0000 7f82fd61b700 1 -- start start 2023-10-03T10:13:12.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f3056e2e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30500a0a30 0x7f30500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f3056e2e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3050138d80 0x7f305013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f3056e2e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30500a2a70 con 0x7f305009d630 2023-10-03T10:13:12.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f3056e2e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30500a01d0 con 0x7f3050138d80 2023-10-03T10:13:12.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f3056e2e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305009e2b0 con 0x7f30500a0a30 2023-10-03T10:13:12.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f304ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f305009d630 0x7f30500a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50494/0 (socket says 172.21.15.72:50494) 2023-10-03T10:13:12.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f304ffff700 1 -- 172.21.15.72:0/782271342 learned_addr learned my addr 172.21.15.72:0/782271342 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:12.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f82fd61b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f82f809d9f0 0x7f82f8136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f82fd61b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f8136a70 0x7f82f8138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f82fd61b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f809e130 con 0x7f82f81316c0 2023-10-03T10:13:12.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f82fd61b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f81321a0 con 0x7f82f809d9f0 2023-10-03T10:13:12.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f82fd61b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82f81312b0 con 0x7f82f8136a70 2023-10-03T10:13:12.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f82f77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f8136a70 0x7f82f8138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f82f77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f8136a70 0x7f82f8138e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37708/0 (socket says 172.21.15.72:37708) 2023-10-03T10:13:12.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f82f67fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f82f809d9f0 0x7f82f8136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f82f77fe700 1 -- 172.21.15.72:0/1181026935 learned_addr learned my addr 172.21.15.72:0/1181026935 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:12.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f304f7fe700 1 -- 172.21.15.72:0/782271342 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203877309 0 0) 0x7f30500a2a70 con 0x7f305009d630 2023-10-03T10:13:12.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.950+0000 7f304f7fe700 1 -- 172.21.15.72:0/782271342 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30400035b0 con 0x7f305009d630 2023-10-03T10:13:12.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f82f67fc700 1 -- 172.21.15.72:0/1181026935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f8136a70 msgr2=0x7f82f8138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f82f67fc700 1 --2- 172.21.15.72:0/1181026935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f8136a70 0x7f82f8138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f82f67fc700 1 -- 172.21.15.72:0/1181026935 >> v1:172.21.15.72:6789/0 conn(0x7f82f81316c0 legacy=0x7f82f8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f82f67fc700 1 -- 172.21.15.72:0/1181026935 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f809f6e0 con 0x7f82f809d9f0 2023-10-03T10:13:12.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f82f67fc700 1 --2- 172.21.15.72:0/1181026935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f809d9f0 0x7f82f8136530 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009840 tx=0x7f82ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b86a056f92e2d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f304f7fe700 1 -- 172.21.15.72:0/782271342 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4018716881 0 0) 0x7f30400035b0 con 0x7f305009d630 2023-10-03T10:13:12.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f304f7fe700 1 -- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30500a0a30 msgr2=0x7f30500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f304f7fe700 1 --2- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30500a0a30 0x7f30500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f304f7fe700 1 -- 172.21.15.72:0/782271342 >> v2:172.21.15.72:3300/0 conn(0x7f3050138d80 msgr2=0x7f305013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f304f7fe700 1 --2- 172.21.15.72:0/782271342 >> v2:172.21.15.72:3300/0 conn(0x7f3050138d80 0x7f305013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f304f7fe700 1 -- 172.21.15.72:0/782271342 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305009dc50 con 0x7f305009d630 2023-10-03T10:13:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f304f7fe700 1 -- 172.21.15.72:0/782271342 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 244944926 0 0) 0x7f303c001670 con 0x7f305009d630 2023-10-03T10:13:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f304f7fe700 1 -- 172.21.15.72:0/782271342 >> v1:172.21.15.72:6789/0 conn(0x7f305009d630 legacy=0x7f30500a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f304f7fe700 1 --2- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3040003a00 0x7f3040003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f304f7fe700 1 --2- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3040004850 0x7f3040004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f304f7fe700 1 --2- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30500a0a30 0x7f304000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f304f7fe700 1 -- 172.21.15.72:0/782271342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30500a01d0 con 0x7f3040003a00 2023-10-03T10:13:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f304f7fe700 1 -- 172.21.15.72:0/782271342 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305009e2b0 con 0x7f30500a0a30 2023-10-03T10:13:12.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f304f7fe700 1 -- 172.21.15.72:0/782271342 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30400056f0 con 0x7f3040004850 2023-10-03T10:13:12.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f82f5ffb700 1 -- 172.21.15.72:0/1181026935 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec004230 con 0x7f82f809d9f0 2023-10-03T10:13:12.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f82f5ffb700 1 -- 172.21.15.72:0/1181026935 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec004390 con 0x7f82f809d9f0 2023-10-03T10:13:12.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f82f5ffb700 1 -- 172.21.15.72:0/1181026935 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec0036a0 con 0x7f82f809d9f0 2023-10-03T10:13:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f3054bca700 1 --2- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3040003a00 0x7f3040003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f30553cb700 1 --2- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30500a0a30 0x7f304000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.951+0000 7f304ffff700 1 --2- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3040004850 0x7f3040004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f30553cb700 1 -- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3040004850 msgr2=0x7f3040004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f30553cb700 1 --2- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3040004850 0x7f3040004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f30553cb700 1 -- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3040003a00 msgr2=0x7f3040003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f30553cb700 1 --2- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3040003a00 0x7f3040003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f30553cb700 1 -- 172.21.15.72:0/782271342 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305009dc50 con 0x7f30500a0a30 2023-10-03T10:13:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f3054bca700 1 --2- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3040003a00 0x7f3040003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f30553cb700 1 --2- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30500a0a30 0x7f304000ba10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f30500a2430 tx=0x7f3040005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b3be18a23b97f89 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f304f7fe700 1 -- 172.21.15.72:0/782271342 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30480098b0 con 0x7f30500a0a30 2023-10-03T10:13:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f304f7fe700 1 -- 172.21.15.72:0/782271342 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304800bac0 con 0x7f30500a0a30 2023-10-03T10:13:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f82fd61b700 1 -- 172.21.15.72:0/1181026935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f809d9f0 msgr2=0x7f82f8136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f82fd61b700 1 --2- 172.21.15.72:0/1181026935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f809d9f0 0x7f82f8136530 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009840 tx=0x7f82ec009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f304f7fe700 1 -- 172.21.15.72:0/782271342 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800be70 con 0x7f30500a0a30 2023-10-03T10:13:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f82fd61b700 1 -- 172.21.15.72:0/1181026935 shutdown_connections 2023-10-03T10:13:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f82fd61b700 1 --2- 172.21.15.72:0/1181026935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f8136a70 0x7f82f8138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f82fd61b700 1 --2- 172.21.15.72:0/1181026935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f809d9f0 0x7f82f8136530 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f82fd61b700 1 -- 172.21.15.72:0/1181026935 >> 172.21.15.72:0/1181026935 conn(0x7f82f8066f50 msgr2=0x7f82f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f82fd61b700 1 -- 172.21.15.72:0/1181026935 shutdown_connections 2023-10-03T10:13:12.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.952+0000 7f82fd61b700 1 -- 172.21.15.72:0/1181026935 wait complete. 2023-10-03T10:13:12.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.953+0000 7f3056e2e700 1 -- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30500a0a30 msgr2=0x7f304000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.953+0000 7f3056e2e700 1 --2- 172.21.15.72:0/782271342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30500a0a30 0x7f304000ba10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f30500a2430 tx=0x7f3040005880 comp rx=0 tx=0).stop 2023-10-03T10:13:12.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.953+0000 7f30553cb700 1 -- 172.21.15.72:0/782271342 reap_dead start 2023-10-03T10:13:12.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.953+0000 7f3056e2e700 1 -- 172.21.15.72:0/782271342 shutdown_connections 2023-10-03T10:13:12.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.953+0000 7f3056e2e700 1 -- 172.21.15.72:0/782271342 >> 172.21.15.72:0/782271342 conn(0x7f30500a3050 msgr2=0x7f30500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:12.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.953+0000 7f3056e2e700 1 -- 172.21.15.72:0/782271342 shutdown_connections 2023-10-03T10:13:12.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.953+0000 7f3056e2e700 1 -- 172.21.15.72:0/782271342 wait complete. 2023-10-03T10:13:12.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.954+0000 7f82fd61b700 1 Processor -- start 2023-10-03T10:13:12.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.954+0000 7f82fd61b700 1 -- start start 2023-10-03T10:13:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.954+0000 7f3056e2e700 1 Processor -- start 2023-10-03T10:13:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f82fd61b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f809d9f0 0x7f82f8071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f82fd61b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f81316c0 0x7f82f80718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f82fd61b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f8136a70 0x7f82f8071e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f82fd61b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8072840 con 0x7f82f8136a70 2023-10-03T10:13:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f82fd61b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f806fba0 con 0x7f82f81316c0 2023-10-03T10:13:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f82fd61b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8070210 con 0x7f82f809d9f0 2023-10-03T10:13:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.954+0000 7f3056e2e700 1 -- start start 2023-10-03T10:13:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f3056e2e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30500a0a30 0x7f30501c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f3056e2e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f305012b150 0x7f30501c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f3056e2e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30501cc480 0x7f30501cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f3056e2e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30501285a0 con 0x7f30501cc480 2023-10-03T10:13:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f3056e2e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30501c9eb0 con 0x7f30500a0a30 2023-10-03T10:13:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f3056e2e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3050128de0 con 0x7f305012b150 2023-10-03T10:13:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f82f6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f809d9f0 0x7f82f8071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f82f6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f809d9f0 0x7f82f8071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37720/0 (socket says 172.21.15.72:37720) 2023-10-03T10:13:12.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f82f6ffd700 1 -- 172.21.15.72:0/875330943 learned_addr learned my addr 172.21.15.72:0/875330943 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:12.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f30553cb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30501cc480 0x7f30501cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f30553cb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30501cc480 0x7f30501cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34534/0 (socket says 172.21.15.72:34534) 2023-10-03T10:13:12.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f30553cb700 1 -- 172.21.15.72:0/1894551087 learned_addr learned my addr 172.21.15.72:0/1894551087 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:12.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f82f67fc700 1 --2- 172.21.15.72:0/875330943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f81316c0 0x7f82f80718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.955+0000 7f3054bca700 1 --2- 172.21.15.72:0/1894551087 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30500a0a30 0x7f30501c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:12.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f30553cb700 1 -- 172.21.15.72:0/1894551087 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f305012b150 msgr2=0x7f30501c9970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:12.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f30553cb700 1 --2- 172.21.15.72:0/1894551087 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f305012b150 0x7f30501c9970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f30553cb700 1 -- 172.21.15.72:0/1894551087 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30500a0a30 msgr2=0x7f30501c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f30553cb700 1 --2- 172.21.15.72:0/1894551087 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30500a0a30 0x7f30501c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f30553cb700 1 -- 172.21.15.72:0/1894551087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500a0410 con 0x7f30501cc480 2023-10-03T10:13:12.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f82f67fc700 1 -- 172.21.15.72:0/875330943 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f809d9f0 msgr2=0x7f82f8071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f82f67fc700 1 --2- 172.21.15.72:0/875330943 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f809d9f0 0x7f82f8071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f82f67fc700 1 -- 172.21.15.72:0/875330943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f8136a70 msgr2=0x7f82f8071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f82f67fc700 1 --2- 172.21.15.72:0/875330943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f8136a70 0x7f82f8071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f82f67fc700 1 -- 172.21.15.72:0/875330943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec0094a0 con 0x7f82f81316c0 2023-10-03T10:13:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f82f67fc700 1 --2- 172.21.15.72:0/875330943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f81316c0 0x7f82f80718d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009840 tx=0x7f82ec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f82df7fe700 1 -- 172.21.15.72:0/875330943 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec004580 con 0x7f82f81316c0 2023-10-03T10:13:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f82df7fe700 1 -- 172.21.15.72:0/875330943 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec011630 con 0x7f82f81316c0 2023-10-03T10:13:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f82fd61b700 1 -- 172.21.15.72:0/875330943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f80704d0 con 0x7f82f81316c0 2023-10-03T10:13:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f82df7fe700 1 -- 172.21.15.72:0/875330943 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec0119e0 con 0x7f82f81316c0 2023-10-03T10:13:12.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f82fd61b700 1 -- 172.21.15.72:0/875330943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f8071060 con 0x7f82f81316c0 2023-10-03T10:13:12.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f30553cb700 1 --2- 172.21.15.72:0/1894551087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30501cc480 0x7f30501cc8f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3048009220 tx=0x7f3048004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:12.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.956+0000 7f304d7fa700 1 -- 172.21.15.72:0/1894551087 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048015970 con 0x7f30501cc480 2023-10-03T10:13:12.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.957+0000 7f304d7fa700 1 -- 172.21.15.72:0/1894551087 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3048015ad0 con 0x7f30501cc480 2023-10-03T10:13:12.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.957+0000 7f304d7fa700 1 -- 172.21.15.72:0/1894551087 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048015e80 con 0x7f30501cc480 2023-10-03T10:13:12.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.957+0000 7f3056e2e700 1 -- 172.21.15.72:0/1894551087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3050129ec0 con 0x7f30501cc480 2023-10-03T10:13:12.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.957+0000 7f3056e2e700 1 -- 172.21.15.72:0/1894551087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30501299b0 con 0x7f30501cc480 2023-10-03T10:13:12.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.957+0000 7f82df7fe700 1 -- 172.21.15.72:0/875330943 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82ec018050 con 0x7f82f81316c0 2023-10-03T10:13:12.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.957+0000 7f82df7fe700 1 -- 172.21.15.72:0/875330943 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f82ec040110 con 0x7f82f81316c0 2023-10-03T10:13:12.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.957+0000 7f82fd61b700 1 -- 172.21.15.72:0/875330943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f809e130 con 0x7f82f81316c0 2023-10-03T10:13:12.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.958+0000 7f3056e2e700 1 -- 172.21.15.72:0/1894551087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30300052e0 con 0x7f30501cc480 2023-10-03T10:13:12.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.958+0000 7f304d7fa700 1 -- 172.21.15.72:0/1894551087 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3048021470 con 0x7f30501cc480 2023-10-03T10:13:12.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.958+0000 7f304d7fa700 1 -- 172.21.15.72:0/1894551087 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3048011070 con 0x7f30501cc480 2023-10-03T10:13:12.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.962+0000 7f82df7fe700 1 -- 172.21.15.72:0/875330943 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82f809e130 con 0x7f82f81316c0 2023-10-03T10:13:12.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:12.963+0000 7f304d7fa700 1 -- 172.21.15.72:0/1894551087 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30480293b0 con 0x7f30501cc480 2023-10-03T10:13:13.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.008+0000 7fc26befb700 1 Processor -- start 2023-10-03T10:13:13.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.008+0000 7fc26befb700 1 -- start start 2023-10-03T10:13:13.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.008+0000 7fc26befb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc264133420 0x7fc2641337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.008+0000 7fc26befb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc264133e30 0x7fc26412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.008+0000 7fc26befb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc264134260 0x7fc2641304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.008+0000 7fc26befb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26406b990 con 0x7fc264134260 2023-10-03T10:13:13.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.008+0000 7fc26befb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640a0590 con 0x7fc264133420 2023-10-03T10:13:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.008+0000 7fc26befb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc26409fb80 con 0x7fc264133e30 2023-10-03T10:13:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.009+0000 7fc269496700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc264133e30 0x7fc26412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.009+0000 7fc269496700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc264133e30 0x7fc26412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37730/0 (socket says 172.21.15.72:37730) 2023-10-03T10:13:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.009+0000 7fc269496700 1 -- 172.21.15.72:0/3267293629 learned_addr learned my addr 172.21.15.72:0/3267293629 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.009+0000 7fc269c97700 1 --2- 172.21.15.72:0/3267293629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc264133420 0x7fc2641337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.009+0000 7fc26a498700 1 --2- 172.21.15.72:0/3267293629 >> v2:172.21.15.72:3300/0 conn(0x7fc264134260 0x7fc2641304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.009+0000 7fc269496700 1 -- 172.21.15.72:0/3267293629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc264133420 msgr2=0x7fc2641337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:13.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.009+0000 7fc269496700 1 --2- 172.21.15.72:0/3267293629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc264133420 0x7fc2641337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.009+0000 7fc269496700 1 -- 172.21.15.72:0/3267293629 >> v2:172.21.15.72:3300/0 conn(0x7fc264134260 msgr2=0x7fc2641304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:13.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.009+0000 7fc269496700 1 --2- 172.21.15.72:0/3267293629 >> v2:172.21.15.72:3300/0 conn(0x7fc264134260 0x7fc2641304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.009+0000 7fc269496700 1 -- 172.21.15.72:0/3267293629 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2640a0030 con 0x7fc264133e30 2023-10-03T10:13:13.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.009+0000 7fc269496700 1 --2- 172.21.15.72:0/3267293629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc264133e30 0x7fc26412ff90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc2540098f0 tx=0x7fc254009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1dc61e70fd034fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:13.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.009+0000 7fc268c95700 1 -- 172.21.15.72:0/3267293629 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254011830 con 0x7fc264133e30 2023-10-03T10:13:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.009+0000 7fc268c95700 1 -- 172.21.15.72:0/3267293629 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc254011990 con 0x7fc264133e30 2023-10-03T10:13:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.009+0000 7fc268c95700 1 -- 172.21.15.72:0/3267293629 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254011d20 con 0x7fc264133e30 2023-10-03T10:13:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.010+0000 7fc26befb700 1 -- 172.21.15.72:0/3267293629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc264133e30 msgr2=0x7fc26412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.010+0000 7fc26befb700 1 --2- 172.21.15.72:0/3267293629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc264133e30 0x7fc26412ff90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc2540098f0 tx=0x7fc254009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.010+0000 7fc26befb700 1 -- 172.21.15.72:0/3267293629 shutdown_connections 2023-10-03T10:13:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.010+0000 7fc26befb700 1 --2- 172.21.15.72:0/3267293629 >> v2:172.21.15.72:3300/0 conn(0x7fc264134260 0x7fc2641304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.010+0000 7fc26befb700 1 --2- 172.21.15.72:0/3267293629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc264133420 0x7fc2641337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.010+0000 7fc26befb700 1 --2- 172.21.15.72:0/3267293629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc264133e30 0x7fc26412ff90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.010+0000 7fc26befb700 1 -- 172.21.15.72:0/3267293629 >> 172.21.15.72:0/3267293629 conn(0x7fc2640a4210 msgr2=0x7fc2640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.010+0000 7fc26befb700 1 -- 172.21.15.72:0/3267293629 shutdown_connections 2023-10-03T10:13:13.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.011+0000 7fc26befb700 1 -- 172.21.15.72:0/3267293629 wait complete. 2023-10-03T10:13:13.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.011+0000 7fc26befb700 1 Processor -- start 2023-10-03T10:13:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.011+0000 7fc26befb700 1 -- start start 2023-10-03T10:13:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc26befb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc264133420 0x7fc26409c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc26befb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc264133e30 0x7fc26409cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc26befb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc264134260 0x7fc26409d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc26befb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc264120330 con 0x7fc264133420 2023-10-03T10:13:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc26befb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26412db50 con 0x7fc264134260 2023-10-03T10:13:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc26befb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc26412d5a0 con 0x7fc264133e30 2023-10-03T10:13:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc269c97700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc264133420 0x7fc26409c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc269496700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc264133e30 0x7fc26409cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc269c97700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc264133420 0x7fc26409c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34552/0 (socket says 172.21.15.72:34552) 2023-10-03T10:13:13.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc269496700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc264133e30 0x7fc26409cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37732/0 (socket says 172.21.15.72:37732) 2023-10-03T10:13:13.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc269c97700 1 -- 172.21.15.72:0/2015218485 learned_addr learned my addr 172.21.15.72:0/2015218485 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:13.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc26a498700 1 --2- 172.21.15.72:0/2015218485 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc264134260 0x7fc26409d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:13.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc269496700 1 -- 172.21.15.72:0/2015218485 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc264134260 msgr2=0x7fc26409d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc269496700 1 --2- 172.21.15.72:0/2015218485 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc264134260 0x7fc26409d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc269496700 1 -- 172.21.15.72:0/2015218485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc264133420 msgr2=0x7fc26409c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc269496700 1 --2- 172.21.15.72:0/2015218485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc264133420 0x7fc26409c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.012+0000 7fc269496700 1 -- 172.21.15.72:0/2015218485 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254009550 con 0x7fc264133e30 2023-10-03T10:13:13.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.013+0000 7fc269496700 1 --2- 172.21.15.72:0/2015218485 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc264133e30 0x7fc26409cb60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc254016000 tx=0x7fc254004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:13.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.013+0000 7fc25a7fc700 1 -- 172.21.15.72:0/2015218485 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254004590 con 0x7fc264133e30 2023-10-03T10:13:13.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.013+0000 7fc25a7fc700 1 -- 172.21.15.72:0/2015218485 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2540036a0 con 0x7fc264133e30 2023-10-03T10:13:13.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.013+0000 7fc26befb700 1 -- 172.21.15.72:0/2015218485 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc264131490 con 0x7fc264133e30 2023-10-03T10:13:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.013+0000 7fc25a7fc700 1 -- 172.21.15.72:0/2015218485 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc254003a10 con 0x7fc264133e30 2023-10-03T10:13:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.013+0000 7fc26befb700 1 -- 172.21.15.72:0/2015218485 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc264120c10 con 0x7fc264133e30 2023-10-03T10:13:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.014+0000 7fc25a7fc700 1 -- 172.21.15.72:0/2015218485 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc254021070 con 0x7fc264133e30 2023-10-03T10:13:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.014+0000 7fc25a7fc700 1 -- 172.21.15.72:0/2015218485 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc2540409b0 con 0x7fc264133e30 2023-10-03T10:13:13.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.014+0000 7fc26befb700 1 -- 172.21.15.72:0/2015218485 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26409daf0 con 0x7fc264133e30 2023-10-03T10:13:13.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.023+0000 7fc25a7fc700 1 -- 172.21.15.72:0/2015218485 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc26409daf0 con 0x7fc264133e30 2023-10-03T10:13:13.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.161+0000 7f82fd61b700 1 -- 172.21.15.72:0/875330943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f82f809e130 con 0x7f82f81316c0 2023-10-03T10:13:13.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.162+0000 7f82df7fe700 1 -- 172.21.15.72:0/875330943 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82f809e130 con 0x7f82f81316c0 2023-10-03T10:13:13.161 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:13.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.162+0000 7f3056e2e700 1 -- 172.21.15.72:0/1894551087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3030005590 con 0x7f30501cc480 2023-10-03T10:13:13.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.163+0000 7f304d7fa700 1 -- 172.21.15.72:0/1894551087 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3048025070 con 0x7f30501cc480 2023-10-03T10:13:13.162 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:13.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.164+0000 7f82fd61b700 1 -- 172.21.15.72:0/875330943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f81316c0 msgr2=0x7f82f80718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.164+0000 7f82fd61b700 1 --2- 172.21.15.72:0/875330943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f81316c0 0x7f82f80718d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009840 tx=0x7f82ec004750 comp rx=0 tx=0).stop 2023-10-03T10:13:13.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.164+0000 7f82fd61b700 1 -- 172.21.15.72:0/875330943 shutdown_connections 2023-10-03T10:13:13.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.164+0000 7f82fd61b700 1 --2- 172.21.15.72:0/875330943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f8136a70 0x7f82f8071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.164+0000 7f82fd61b700 1 --2- 172.21.15.72:0/875330943 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f809d9f0 0x7f82f8071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.164+0000 7f82fd61b700 1 --2- 172.21.15.72:0/875330943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f81316c0 0x7f82f80718d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.164+0000 7f82fd61b700 1 -- 172.21.15.72:0/875330943 >> 172.21.15.72:0/875330943 conn(0x7f82f8066f50 msgr2=0x7f82f809a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.164+0000 7f82fd61b700 1 -- 172.21.15.72:0/875330943 shutdown_connections 2023-10-03T10:13:13.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.164+0000 7f82fd61b700 1 -- 172.21.15.72:0/875330943 wait complete. 2023-10-03T10:13:13.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.165+0000 7f3056e2e700 1 -- 172.21.15.72:0/1894551087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30501cc480 msgr2=0x7f30501cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.165+0000 7f3056e2e700 1 --2- 172.21.15.72:0/1894551087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30501cc480 0x7f30501cc8f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3048009220 tx=0x7f3048004be0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.167+0000 7f3056e2e700 1 -- 172.21.15.72:0/1894551087 shutdown_connections 2023-10-03T10:13:13.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.167+0000 7f3056e2e700 1 --2- 172.21.15.72:0/1894551087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30501cc480 0x7f30501cc8f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.167+0000 7f3056e2e700 1 --2- 172.21.15.72:0/1894551087 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30500a0a30 0x7f30501c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.167+0000 7f3056e2e700 1 --2- 172.21.15.72:0/1894551087 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f305012b150 0x7f30501c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.167+0000 7f3056e2e700 1 -- 172.21.15.72:0/1894551087 >> 172.21.15.72:0/1894551087 conn(0x7f30500a3050 msgr2=0x7f305006da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.167+0000 7f3056e2e700 1 -- 172.21.15.72:0/1894551087 shutdown_connections 2023-10-03T10:13:13.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.167+0000 7f3056e2e700 1 -- 172.21.15.72:0/1894551087 wait complete. 2023-10-03T10:13:13.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.173+0000 7f090e6e9700 1 -- 172.21.15.72:0/1773694277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0908074ea0 con 0x7f090809e410 2023-10-03T10:13:13.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.173+0000 7f0904ff9700 1 -- 172.21.15.72:0/1773694277 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0900017030 con 0x7f090809e410 2023-10-03T10:13:13.173 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:13.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.175+0000 7f090e6e9700 1 -- 172.21.15.72:0/1773694277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f090809e410 msgr2=0x7f0908131670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.175+0000 7f090e6e9700 1 --2- 172.21.15.72:0/1773694277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f090809e410 0x7f0908131670 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f090000cbb0 tx=0x7f090000cec0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.175+0000 7f090e6e9700 1 -- 172.21.15.72:0/1773694277 shutdown_connections 2023-10-03T10:13:13.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.175+0000 7f090e6e9700 1 --2- 172.21.15.72:0/1773694277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f090809e410 0x7f0908131670 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.175+0000 7f090e6e9700 1 --2- 172.21.15.72:0/1773694277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f090809d6f0 0x7f09081c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.175+0000 7f090e6e9700 1 --2- 172.21.15.72:0/1773694277 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f090809e000 0x7f09081c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.175+0000 7f090e6e9700 1 -- 172.21.15.72:0/1773694277 >> 172.21.15.72:0/1773694277 conn(0x7f0908066f50 msgr2=0x7f0908070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.175+0000 7f090e6e9700 1 -- 172.21.15.72:0/1773694277 shutdown_connections 2023-10-03T10:13:13.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.175+0000 7f090e6e9700 1 -- 172.21.15.72:0/1773694277 wait complete. 2023-10-03T10:13:13.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:13.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:13.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:13.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.231+0000 7fc26befb700 1 -- 172.21.15.72:0/2015218485 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc264120190 con 0x7fc264133e30 2023-10-03T10:13:13.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.231+0000 7fc25a7fc700 1 -- 172.21.15.72:0/2015218485 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc264120190 con 0x7fc264133e30 2023-10-03T10:13:13.231 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:13.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.233+0000 7fc26befb700 1 -- 172.21.15.72:0/2015218485 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc264133e30 msgr2=0x7fc26409cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:13.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.233+0000 7fc26befb700 1 --2- 172.21.15.72:0/2015218485 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc264133e30 0x7fc26409cb60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc254016000 tx=0x7fc254004750 comp rx=0 tx=0).stop 2023-10-03T10:13:13.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.233+0000 7fc26befb700 1 -- 172.21.15.72:0/2015218485 shutdown_connections 2023-10-03T10:13:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.233+0000 7fc26befb700 1 --2- 172.21.15.72:0/2015218485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc264133420 0x7fc26409c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.233+0000 7fc26befb700 1 --2- 172.21.15.72:0/2015218485 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc264134260 0x7fc26409d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.233+0000 7fc26befb700 1 --2- 172.21.15.72:0/2015218485 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc264133e30 0x7fc26409cb60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.233+0000 7fc26befb700 1 -- 172.21.15.72:0/2015218485 >> 172.21.15.72:0/2015218485 conn(0x7fc2640a4210 msgr2=0x7fc2640a2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.234+0000 7fc26befb700 1 -- 172.21.15.72:0/2015218485 shutdown_connections 2023-10-03T10:13:13.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:13.234+0000 7fc26befb700 1 -- 172.21.15.72:0/2015218485 wait complete. 2023-10-03T10:13:13.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:14.178 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:14.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:14.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:14.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:14.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.320+0000 7f499f74d700 1 Processor -- start 2023-10-03T10:13:14.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.320+0000 7f499f74d700 1 -- start start 2023-10-03T10:13:14.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499f74d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4998133420 0x7f49981337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499f74d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4998133e30 0x7f499812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499f74d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4998134260 0x7f49981304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499f74d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499806b990 con 0x7f4998133420 2023-10-03T10:13:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499f74d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49980a0590 con 0x7f4998133e30 2023-10-03T10:13:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499f74d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f499809fb80 con 0x7f4998134260 2023-10-03T10:13:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499dcea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4998134260 0x7f49981304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499cce8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4998133e30 0x7f499812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499d4e9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4998133420 0x7f49981337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499dcea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4998134260 0x7f49981304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37746/0 (socket says 172.21.15.72:37746) 2023-10-03T10:13:14.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499dcea700 1 -- 172.21.15.72:0/223365500 learned_addr learned my addr 172.21.15.72:0/223365500 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499dcea700 1 -- 172.21.15.72:0/223365500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4998133e30 msgr2=0x7f499812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499dcea700 1 --2- 172.21.15.72:0/223365500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4998133e30 0x7f499812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499dcea700 1 -- 172.21.15.72:0/223365500 >> v2:172.21.15.72:3300/0 conn(0x7f4998133420 msgr2=0x7f49981337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499dcea700 1 --2- 172.21.15.72:0/223365500 >> v2:172.21.15.72:3300/0 conn(0x7f4998133420 0x7f49981337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499dcea700 1 -- 172.21.15.72:0/223365500 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49980a0030 con 0x7f4998134260 2023-10-03T10:13:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499cce8700 1 --2- 172.21.15.72:0/223365500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4998133e30 0x7f499812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.321+0000 7f499dcea700 1 --2- 172.21.15.72:0/223365500 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4998134260 0x7f49981304d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4990009e50 tx=0x7f499000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd52d2289b7e8a3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.322+0000 7f498ffff700 1 -- 172.21.15.72:0/223365500 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499000e070 con 0x7f4998134260 2023-10-03T10:13:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.322+0000 7f498ffff700 1 -- 172.21.15.72:0/223365500 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499000b910 con 0x7f4998134260 2023-10-03T10:13:14.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.322+0000 7f498ffff700 1 -- 172.21.15.72:0/223365500 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499000bcc0 con 0x7f4998134260 2023-10-03T10:13:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.323+0000 7f499f74d700 1 -- 172.21.15.72:0/223365500 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4998134260 msgr2=0x7f49981304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.323+0000 7f499f74d700 1 --2- 172.21.15.72:0/223365500 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4998134260 0x7f49981304d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4990009e50 tx=0x7f499000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.323+0000 7f499f74d700 1 -- 172.21.15.72:0/223365500 shutdown_connections 2023-10-03T10:13:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.323+0000 7f499f74d700 1 --2- 172.21.15.72:0/223365500 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4998134260 0x7f49981304d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.323+0000 7f499f74d700 1 --2- 172.21.15.72:0/223365500 >> v2:172.21.15.72:3300/0 conn(0x7f4998133420 0x7f49981337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.323+0000 7f499f74d700 1 --2- 172.21.15.72:0/223365500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4998133e30 0x7f499812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.323+0000 7f499f74d700 1 -- 172.21.15.72:0/223365500 >> 172.21.15.72:0/223365500 conn(0x7f49980a4210 msgr2=0x7f49980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.323+0000 7f499f74d700 1 -- 172.21.15.72:0/223365500 shutdown_connections 2023-10-03T10:13:14.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.323+0000 7f499f74d700 1 -- 172.21.15.72:0/223365500 wait complete. 2023-10-03T10:13:14.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.324+0000 7f499f74d700 1 Processor -- start 2023-10-03T10:13:14.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.324+0000 7f499f74d700 1 -- start start 2023-10-03T10:13:14.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499f74d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4998133420 0x7f499809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499f74d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4998133e30 0x7f499809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499f74d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4998134260 0x7f499809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499f74d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499809d850 con 0x7f4998134260 2023-10-03T10:13:14.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499f74d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499812d6c0 con 0x7f4998133e30 2023-10-03T10:13:14.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499f74d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4998133130 con 0x7f4998133420 2023-10-03T10:13:14.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499cce8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4998133e30 0x7f499809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499cce8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4998133e30 0x7f499809c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46482/0 (socket says 172.21.15.72:46482) 2023-10-03T10:13:14.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499cce8700 1 -- 172.21.15.72:0/1753910212 learned_addr learned my addr 172.21.15.72:0/1753910212 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:14.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499d4e9700 1 --2- 172.21.15.72:0/1753910212 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4998133420 0x7f499809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499dcea700 1 --2- 172.21.15.72:0/1753910212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4998134260 0x7f499809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499cce8700 1 -- 172.21.15.72:0/1753910212 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4998133420 msgr2=0x7f499809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499cce8700 1 --2- 172.21.15.72:0/1753910212 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4998133420 0x7f499809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499cce8700 1 -- 172.21.15.72:0/1753910212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4998134260 msgr2=0x7f499809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499cce8700 1 --2- 172.21.15.72:0/1753910212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4998134260 0x7f499809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.325+0000 7f499cce8700 1 -- 172.21.15.72:0/1753910212 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49880094a0 con 0x7f4998133e30 2023-10-03T10:13:14.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.326+0000 7f499cce8700 1 --2- 172.21.15.72:0/1753910212 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4998133e30 0x7f499809c9c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f498800ebe0 tx=0x7f498800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.326+0000 7f498dffb700 1 -- 172.21.15.72:0/1753910212 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498800c850 con 0x7f4998133e30 2023-10-03T10:13:14.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.326+0000 7f498dffb700 1 -- 172.21.15.72:0/1753910212 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498800c9b0 con 0x7f4998133e30 2023-10-03T10:13:14.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.326+0000 7f499f74d700 1 -- 172.21.15.72:0/1753910212 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4990009b30 con 0x7f4998133e30 2023-10-03T10:13:14.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.326+0000 7f498dffb700 1 -- 172.21.15.72:0/1753910212 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498800cd40 con 0x7f4998133e30 2023-10-03T10:13:14.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.326+0000 7f499f74d700 1 -- 172.21.15.72:0/1753910212 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49981209f0 con 0x7f4998133e30 2023-10-03T10:13:14.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.327+0000 7f498dffb700 1 -- 172.21.15.72:0/1753910212 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4988013470 con 0x7f4998133e30 2023-10-03T10:13:14.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.327+0000 7f498dffb700 1 -- 172.21.15.72:0/1753910212 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f498803f6c0 con 0x7f4998133e30 2023-10-03T10:13:14.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.327+0000 7f499f74d700 1 -- 172.21.15.72:0/1753910212 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4998074ea0 con 0x7f4998133e30 2023-10-03T10:13:14.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.332+0000 7f498dffb700 1 -- 172.21.15.72:0/1753910212 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4988013720 con 0x7f4998133e30 2023-10-03T10:13:14.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.362+0000 7f7a0a8d3700 1 Processor -- start 2023-10-03T10:13:14.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.362+0000 7f7a0a8d3700 1 -- start start 2023-10-03T10:13:14.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.363+0000 7f228e38b700 1 Processor -- start 2023-10-03T10:13:14.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.363+0000 7f228e38b700 1 -- start start 2023-10-03T10:13:14.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.363+0000 7f7a0a8d3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a0409e930 0x7f7a0409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.363+0000 7f7a0a8d3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a0409f650 0x7f7a04131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.363+0000 7f7a0a8d3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a04070940 con 0x7f7a0409f240 2023-10-03T10:13:14.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.363+0000 7f7a0a8d3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0406fd60 con 0x7f7a0409e930 2023-10-03T10:13:14.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.363+0000 7f7a0a8d3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0406fa80 con 0x7f7a0409f650 2023-10-03T10:13:14.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.363+0000 7f7a03fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a0409e930 0x7f7a0409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.363+0000 7f7a03fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a0409e930 0x7f7a0409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46492/0 (socket says 172.21.15.72:46492) 2023-10-03T10:13:14.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.363+0000 7f7a03fff700 1 -- 172.21.15.72:0/1281861402 learned_addr learned my addr 172.21.15.72:0/1281861402 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:14.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.363+0000 7f7a08e70700 1 --2- 172.21.15.72:0/1281861402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a0409f650 0x7f7a04131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f228e38b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f228809d6f0 0x7f228809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f228e38b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f228809e000 0x7f22881339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f228e38b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f228809e410 0x7f2288133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f228e38b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f228806b460 con 0x7f228809d6f0 2023-10-03T10:13:14.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f228e38b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228809b120 con 0x7f228809e000 2023-10-03T10:13:14.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f228e38b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f228809a7e0 con 0x7f228809e410 2023-10-03T10:13:14.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f7a08e70700 1 -- 172.21.15.72:0/1281861402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a0409e930 msgr2=0x7f7a0409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f7a08e70700 1 --2- 172.21.15.72:0/1281861402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a0409e930 0x7f7a0409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f7a08e70700 1 -- 172.21.15.72:0/1281861402 >> v1:172.21.15.72:6789/0 conn(0x7f7a0409f240 legacy=0x7f7a041317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f7a08e70700 1 -- 172.21.15.72:0/1281861402 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0409fb60 con 0x7f7a0409f650 2023-10-03T10:13:14.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f228c928700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f228809e410 0x7f2288133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f228c928700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f228809e410 0x7f2288133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37776/0 (socket says 172.21.15.72:37776) 2023-10-03T10:13:14.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f228c928700 1 -- 172.21.15.72:0/1457923589 learned_addr learned my addr 172.21.15.72:0/1457923589 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:14.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f22877fe700 1 --2- 172.21.15.72:0/1457923589 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f228809e000 0x7f22881339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f7a08e70700 1 --2- 172.21.15.72:0/1281861402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a0409f650 0x7f7a04131f00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009dc0 tx=0x7f79fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=422ddc4498fa03c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f228c928700 1 -- 172.21.15.72:0/1457923589 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f228809e000 msgr2=0x7f22881339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f228c928700 1 --2- 172.21.15.72:0/1457923589 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f228809e000 0x7f22881339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f228c928700 1 -- 172.21.15.72:0/1457923589 >> v2:172.21.15.72:3300/0 conn(0x7f228809d6f0 msgr2=0x7f228809dac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:13:14.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f228c928700 1 --2- 172.21.15.72:0/1457923589 >> v2:172.21.15.72:3300/0 conn(0x7f228809d6f0 0x7f228809dac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f228c928700 1 -- 172.21.15.72:0/1457923589 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228809a500 con 0x7f228809e410 2023-10-03T10:13:14.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f7a02ffd700 1 -- 172.21.15.72:0/1281861402 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00e070 con 0x7f7a0409f650 2023-10-03T10:13:14.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f7a02ffd700 1 -- 172.21.15.72:0/1281861402 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc003a20 con 0x7f7a0409f650 2023-10-03T10:13:14.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.364+0000 7f7a02ffd700 1 -- 172.21.15.72:0/1281861402 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc003dd0 con 0x7f7a0409f650 2023-10-03T10:13:14.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.365+0000 7f228c928700 1 --2- 172.21.15.72:0/1457923589 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f228809e410 0x7f2288133f30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2280009e80 tx=0x7f228000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54eaa5d71eb252d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.365+0000 7f2286ffd700 1 -- 172.21.15.72:0/1457923589 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228000e070 con 0x7f228809e410 2023-10-03T10:13:14.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.365+0000 7f2286ffd700 1 -- 172.21.15.72:0/1457923589 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228000b980 con 0x7f228809e410 2023-10-03T10:13:14.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.365+0000 7f2286ffd700 1 -- 172.21.15.72:0/1457923589 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228000bd30 con 0x7f228809e410 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.365+0000 7f7a0a8d3700 1 -- 172.21.15.72:0/1281861402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a0409f650 msgr2=0x7f7a04131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.365+0000 7f7a0a8d3700 1 --2- 172.21.15.72:0/1281861402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a0409f650 0x7f7a04131f00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009dc0 tx=0x7f79fc00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.365+0000 7f7a0a8d3700 1 -- 172.21.15.72:0/1281861402 shutdown_connections 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.365+0000 7f7a0a8d3700 1 --2- 172.21.15.72:0/1281861402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a0409f650 0x7f7a04131f00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.365+0000 7f7a0a8d3700 1 --2- 172.21.15.72:0/1281861402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a0409e930 0x7f7a0409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.365+0000 7f7a0a8d3700 1 -- 172.21.15.72:0/1281861402 >> 172.21.15.72:0/1281861402 conn(0x7f7a040a4210 msgr2=0x7f7a040a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.365+0000 7f7a0a8d3700 1 -- 172.21.15.72:0/1281861402 shutdown_connections 2023-10-03T10:13:14.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.365+0000 7f7a0a8d3700 1 -- 172.21.15.72:0/1281861402 wait complete. 2023-10-03T10:13:14.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.365+0000 7f228e38b700 1 -- 172.21.15.72:0/1457923589 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f228809e410 msgr2=0x7f2288133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.365+0000 7f228e38b700 1 --2- 172.21.15.72:0/1457923589 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f228809e410 0x7f2288133f30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2280009e80 tx=0x7f228000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:14.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.366+0000 7f228e38b700 1 -- 172.21.15.72:0/1457923589 shutdown_connections 2023-10-03T10:13:14.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.366+0000 7f228e38b700 1 --2- 172.21.15.72:0/1457923589 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f228809e410 0x7f2288133f30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.366+0000 7f228e38b700 1 --2- 172.21.15.72:0/1457923589 >> v2:172.21.15.72:3300/0 conn(0x7f228809d6f0 0x7f228809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.366+0000 7f228e38b700 1 --2- 172.21.15.72:0/1457923589 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f228809e000 0x7f22881339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.366+0000 7f228e38b700 1 -- 172.21.15.72:0/1457923589 >> 172.21.15.72:0/1457923589 conn(0x7f2288066f50 msgr2=0x7f228809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.366+0000 7f228e38b700 1 -- 172.21.15.72:0/1457923589 shutdown_connections 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.367+0000 7f7a0a8d3700 1 Processor -- start 2023-10-03T10:13:14.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.367+0000 7f228e38b700 1 -- 172.21.15.72:0/1457923589 wait complete. 2023-10-03T10:13:14.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.367+0000 7f7a0a8d3700 1 -- start start 2023-10-03T10:13:14.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a0a8d3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a0409e930 0x7f7a0412d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a0a8d3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a0409f240 0x7f7a0412d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a0a8d3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a0409f650 0x7f7a0412dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a0a8d3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04130510 con 0x7f7a0409f240 2023-10-03T10:13:14.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a0a8d3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a040a3430 con 0x7f7a0409e930 2023-10-03T10:13:14.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a0a8d3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04071d20 con 0x7f7a0409f650 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a0409f240 0x7f7a0412d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a0409f240 0x7f7a0412d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34582/0 (socket says 172.21.15.72:34582) 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a037fe700 1 -- 172.21.15.72:0/764350574 learned_addr learned my addr 172.21.15.72:0/764350574 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a03fff700 1 --2- 172.21.15.72:0/764350574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a0409e930 0x7f7a0412d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f228e38b700 1 Processor -- start 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a08e70700 1 --2- 172.21.15.72:0/764350574 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a0409f650 0x7f7a0412dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a03fff700 1 -- 172.21.15.72:0/764350574 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a0409f650 msgr2=0x7f7a0412dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a03fff700 1 --2- 172.21.15.72:0/764350574 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a0409f650 0x7f7a0412dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a03fff700 1 -- 172.21.15.72:0/764350574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a0409f240 msgr2=0x7f7a0412d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a03fff700 1 --2- 172.21.15.72:0/764350574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a0409f240 0x7f7a0412d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a03fff700 1 -- 172.21.15.72:0/764350574 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc009a70 con 0x7f7a0409e930 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a037fe700 1 --2- 172.21.15.72:0/764350574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a0409f240 0x7f7a0412d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:14.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.368+0000 7f7a03fff700 1 --2- 172.21.15.72:0/764350574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a0409e930 0x7f7a0412d130 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f79f400e8e0 tx=0x7f79f400ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.369+0000 7f228e38b700 1 -- start start 2023-10-03T10:13:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.369+0000 7f7a00ff9700 1 -- 172.21.15.72:0/764350574 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4013680 con 0x7f7a0409e930 2023-10-03T10:13:14.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.369+0000 7f7a00ff9700 1 -- 172.21.15.72:0/764350574 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f40137e0 con 0x7f7a0409e930 2023-10-03T10:13:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.369+0000 7f7a0a8d3700 1 -- 172.21.15.72:0/764350574 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a040a0190 con 0x7f7a0409e930 2023-10-03T10:13:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.369+0000 7f7a00ff9700 1 -- 172.21.15.72:0/764350574 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4013b70 con 0x7f7a0409e930 2023-10-03T10:13:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.369+0000 7f7a0a8d3700 1 -- 172.21.15.72:0/764350574 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0412f290 con 0x7f7a0409e930 2023-10-03T10:13:14.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.369+0000 7f228e38b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f228809d6f0 0x7f22881a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.369+0000 7f228e38b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f228809e000 0x7f22881a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.369+0000 7f228e38b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f228809e410 0x7f22881c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.369+0000 7f228e38b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22881a8350 con 0x7f228809d6f0 2023-10-03T10:13:14.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.369+0000 7f228e38b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22881b9410 con 0x7f228809e000 2023-10-03T10:13:14.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.369+0000 7f228e38b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22881a5ed0 con 0x7f228809e410 2023-10-03T10:13:14.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.369+0000 7f22877fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f228809e000 0x7f22881a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.369+0000 7f22877fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f228809e000 0x7f22881a5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46508/0 (socket says 172.21.15.72:46508) 2023-10-03T10:13:14.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.369+0000 7f22877fe700 1 -- 172.21.15.72:0/2961841692 learned_addr learned my addr 172.21.15.72:0/2961841692 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:14.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.370+0000 7f2287fff700 1 --2- 172.21.15.72:0/2961841692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f228809d6f0 0x7f22881a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.370+0000 7f22877fe700 1 -- 172.21.15.72:0/2961841692 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f228809e410 msgr2=0x7f22881c82c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:14.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.370+0000 7f22877fe700 1 --2- 172.21.15.72:0/2961841692 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f228809e410 0x7f22881c82c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.370+0000 7f22877fe700 1 -- 172.21.15.72:0/2961841692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f228809d6f0 msgr2=0x7f22881a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.370+0000 7f22877fe700 1 --2- 172.21.15.72:0/2961841692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f228809d6f0 0x7f22881a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.370+0000 7f22877fe700 1 -- 172.21.15.72:0/2961841692 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2280009b30 con 0x7f228809e000 2023-10-03T10:13:14.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.370+0000 7f7a00ff9700 1 -- 172.21.15.72:0/764350574 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79f4013cd0 con 0x7f7a0409e930 2023-10-03T10:13:14.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.370+0000 7f7a00ff9700 1 -- 172.21.15.72:0/764350574 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f79f403f980 con 0x7f7a0409e930 2023-10-03T10:13:14.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.370+0000 7f22877fe700 1 --2- 172.21.15.72:0/2961841692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f228809e000 0x7f22881a5990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f227c00e810 tx=0x7f227c00eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.370+0000 7f7a0a8d3700 1 -- 172.21.15.72:0/764350574 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a04131600 con 0x7f7a0409e930 2023-10-03T10:13:14.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.370+0000 7f2284ff9700 1 -- 172.21.15.72:0/2961841692 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c013610 con 0x7f228809e000 2023-10-03T10:13:14.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.370+0000 7f2284ff9700 1 -- 172.21.15.72:0/2961841692 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227c013770 con 0x7f228809e000 2023-10-03T10:13:14.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.370+0000 7f228e38b700 1 -- 172.21.15.72:0/2961841692 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22881a4f40 con 0x7f228809e000 2023-10-03T10:13:14.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.370+0000 7f2284ff9700 1 -- 172.21.15.72:0/2961841692 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c013b20 con 0x7f228809e000 2023-10-03T10:13:14.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.371+0000 7f228e38b700 1 -- 172.21.15.72:0/2961841692 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22880a1e20 con 0x7f228809e000 2023-10-03T10:13:14.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.372+0000 7f228e38b700 1 -- 172.21.15.72:0/2961841692 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228804ea50 con 0x7f228809e000 2023-10-03T10:13:14.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.376+0000 7f7a00ff9700 1 -- 172.21.15.72:0/764350574 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79f40119a0 con 0x7f7a0409e930 2023-10-03T10:13:14.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.376+0000 7f2284ff9700 1 -- 172.21.15.72:0/2961841692 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f227c013c80 con 0x7f228809e000 2023-10-03T10:13:14.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.376+0000 7f2284ff9700 1 -- 172.21.15.72:0/2961841692 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f227c03f830 con 0x7f228809e000 2023-10-03T10:13:14.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.381+0000 7f2284ff9700 1 -- 172.21.15.72:0/2961841692 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f227c026480 con 0x7f228809e000 2023-10-03T10:13:14.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.407+0000 7ff616b6d700 1 Processor -- start 2023-10-03T10:13:14.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.407+0000 7ff616b6d700 1 -- start start 2023-10-03T10:13:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.407+0000 7ff616b6d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff61009e1d0 0x7ff610138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.407+0000 7ff616b6d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff610139170 0x7ff61013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.407+0000 7ff616b6d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61009b120 con 0x7ff61009d6f0 2023-10-03T10:13:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.407+0000 7ff616b6d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff61006b460 con 0x7ff61009e1d0 2023-10-03T10:13:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.407+0000 7ff616b6d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff61009a7e0 con 0x7ff610139170 2023-10-03T10:13:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.407+0000 7ff61510a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff610139170 0x7ff61013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.407+0000 7ff61510a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff610139170 0x7ff61013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37794/0 (socket says 172.21.15.72:37794) 2023-10-03T10:13:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.407+0000 7ff61510a700 1 -- 172.21.15.72:0/2931838437 learned_addr learned my addr 172.21.15.72:0/2931838437 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.408+0000 7ff60ffff700 1 --2- 172.21.15.72:0/2931838437 >> v2:172.21.15.72:3300/0 conn(0x7ff61009e1d0 0x7ff610138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.408+0000 7ff60ffff700 1 -- 172.21.15.72:0/2931838437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff610139170 msgr2=0x7ff61013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.408+0000 7ff60ffff700 1 --2- 172.21.15.72:0/2931838437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff610139170 0x7ff61013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.408+0000 7ff60ffff700 1 -- 172.21.15.72:0/2931838437 >> v1:172.21.15.72:6789/0 conn(0x7ff61009d6f0 legacy=0x7ff61009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.408+0000 7ff60ffff700 1 -- 172.21.15.72:0/2931838437 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61009a500 con 0x7ff61009e1d0 2023-10-03T10:13:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.408+0000 7ff61510a700 1 --2- 172.21.15.72:0/2931838437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff610139170 0x7ff61013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.408+0000 7ff60ffff700 1 --2- 172.21.15.72:0/2931838437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff61009e1d0 0x7ff610138c30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009870 tx=0x7ff5fc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f043ef3a3717000 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.408+0000 7ff60f7fe700 1 -- 172.21.15.72:0/2931838437 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc004230 con 0x7ff61009e1d0 2023-10-03T10:13:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.408+0000 7ff60f7fe700 1 -- 172.21.15.72:0/2931838437 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc004390 con 0x7ff61009e1d0 2023-10-03T10:13:14.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.408+0000 7ff60f7fe700 1 -- 172.21.15.72:0/2931838437 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc0036a0 con 0x7ff61009e1d0 2023-10-03T10:13:14.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.409+0000 7ff616b6d700 1 -- 172.21.15.72:0/2931838437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff61009e1d0 msgr2=0x7ff610138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.409+0000 7ff616b6d700 1 --2- 172.21.15.72:0/2931838437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff61009e1d0 0x7ff610138c30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009870 tx=0x7ff5fc009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:14.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.409+0000 7ff616b6d700 1 -- 172.21.15.72:0/2931838437 shutdown_connections 2023-10-03T10:13:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.409+0000 7ff616b6d700 1 --2- 172.21.15.72:0/2931838437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff610139170 0x7ff61013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.409+0000 7ff616b6d700 1 --2- 172.21.15.72:0/2931838437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff61009e1d0 0x7ff610138c30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.409+0000 7ff616b6d700 1 -- 172.21.15.72:0/2931838437 >> 172.21.15.72:0/2931838437 conn(0x7ff610066f50 msgr2=0x7ff61009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.409+0000 7ff616b6d700 1 -- 172.21.15.72:0/2931838437 shutdown_connections 2023-10-03T10:13:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.409+0000 7ff616b6d700 1 -- 172.21.15.72:0/2931838437 wait complete. 2023-10-03T10:13:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.410+0000 7ff616b6d700 1 Processor -- start 2023-10-03T10:13:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.410+0000 7ff616b6d700 1 -- start start 2023-10-03T10:13:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.410+0000 7ff616b6d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff61009d6f0 0x7ff6101c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.410+0000 7ff616b6d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff61009e1d0 0x7ff6101c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.410+0000 7ff616b6d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff610139170 0x7ff6101c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.410+0000 7ff616b6d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6100721c0 con 0x7ff61009e1d0 2023-10-03T10:13:14.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.410+0000 7ff616b6d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff610121cf0 con 0x7ff610139170 2023-10-03T10:13:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.410+0000 7ff616b6d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff610120760 con 0x7ff61009d6f0 2023-10-03T10:13:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff61510a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff610139170 0x7ff6101c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff61510a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff610139170 0x7ff6101c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46510/0 (socket says 172.21.15.72:46510) 2023-10-03T10:13:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff61510a700 1 -- 172.21.15.72:0/1649965484 learned_addr learned my addr 172.21.15.72:0/1649965484 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff60ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff61009e1d0 0x7ff6101c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff614909700 1 --2- 172.21.15.72:0/1649965484 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff61009d6f0 0x7ff6101c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff61510a700 1 -- 172.21.15.72:0/1649965484 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff61009d6f0 msgr2=0x7ff6101c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff61510a700 1 --2- 172.21.15.72:0/1649965484 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff61009d6f0 0x7ff6101c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff61510a700 1 -- 172.21.15.72:0/1649965484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff61009e1d0 msgr2=0x7ff6101c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff61510a700 1 --2- 172.21.15.72:0/1649965484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff61009e1d0 0x7ff6101c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff61510a700 1 -- 172.21.15.72:0/1649965484 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff608009b30 con 0x7ff610139170 2023-10-03T10:13:14.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff61510a700 1 --2- 172.21.15.72:0/1649965484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff610139170 0x7ff6101c8ee0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff608009ef0 tx=0x7ff60800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:14.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff60d7fa700 1 -- 172.21.15.72:0/1649965484 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60800cb40 con 0x7ff610139170 2023-10-03T10:13:14.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff616b6d700 1 -- 172.21.15.72:0/1649965484 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5fc0094a0 con 0x7ff610139170 2023-10-03T10:13:14.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff616b6d700 1 -- 172.21.15.72:0/1649965484 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6101212c0 con 0x7ff610139170 2023-10-03T10:13:14.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff60d7fa700 1 -- 172.21.15.72:0/1649965484 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60800f040 con 0x7ff610139170 2023-10-03T10:13:14.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.411+0000 7ff60d7fa700 1 -- 172.21.15.72:0/1649965484 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60800cee0 con 0x7ff610139170 2023-10-03T10:13:14.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.412+0000 7ff60d7fa700 1 -- 172.21.15.72:0/1649965484 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff608014480 con 0x7ff610139170 2023-10-03T10:13:14.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.413+0000 7ff616b6d700 1 -- 172.21.15.72:0/1649965484 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f00052e0 con 0x7ff610139170 2023-10-03T10:13:14.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.413+0000 7ff60d7fa700 1 -- 172.21.15.72:0/1649965484 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff60803fc10 con 0x7ff610139170 2023-10-03T10:13:14.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.421+0000 7ff60d7fa700 1 -- 172.21.15.72:0/1649965484 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff608012700 con 0x7ff610139170 2023-10-03T10:13:14.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.531+0000 7f499f74d700 1 -- 172.21.15.72:0/1753910212 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4998132ca0 con 0x7f4998133e30 2023-10-03T10:13:14.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.531+0000 7f498dffb700 1 -- 172.21.15.72:0/1753910212 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4988021020 con 0x7f4998133e30 2023-10-03T10:13:14.531 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:14.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.533+0000 7f499f74d700 1 -- 172.21.15.72:0/1753910212 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4998133e30 msgr2=0x7f499809c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.533+0000 7f499f74d700 1 --2- 172.21.15.72:0/1753910212 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4998133e30 0x7f499809c9c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f498800ebe0 tx=0x7f498800eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.534+0000 7f499f74d700 1 -- 172.21.15.72:0/1753910212 shutdown_connections 2023-10-03T10:13:14.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.534+0000 7f499f74d700 1 --2- 172.21.15.72:0/1753910212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4998134260 0x7f499809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.534+0000 7f499f74d700 1 --2- 172.21.15.72:0/1753910212 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4998133420 0x7f499809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.534+0000 7f499f74d700 1 --2- 172.21.15.72:0/1753910212 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4998133e30 0x7f499809c9c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.534+0000 7f499f74d700 1 -- 172.21.15.72:0/1753910212 >> 172.21.15.72:0/1753910212 conn(0x7f49980a4210 msgr2=0x7f49980a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.534+0000 7f499f74d700 1 -- 172.21.15.72:0/1753910212 shutdown_connections 2023-10-03T10:13:14.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.534+0000 7f499f74d700 1 -- 172.21.15.72:0/1753910212 wait complete. 2023-10-03T10:13:14.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:14.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.586+0000 7f228e38b700 1 -- 172.21.15.72:0/2961841692 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2288074ea0 con 0x7f228809e000 2023-10-03T10:13:14.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.586+0000 7f2284ff9700 1 -- 172.21.15.72:0/2961841692 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f227c024350 con 0x7f228809e000 2023-10-03T10:13:14.586 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:14.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.586+0000 7f7a0a8d3700 1 -- 172.21.15.72:0/764350574 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7a04074ea0 con 0x7f7a0409e930 2023-10-03T10:13:14.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.587+0000 7f7a00ff9700 1 -- 172.21.15.72:0/764350574 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79f4021030 con 0x7f7a0409e930 2023-10-03T10:13:14.587 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:14.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.588+0000 7f228e38b700 1 -- 172.21.15.72:0/2961841692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f228809e000 msgr2=0x7f22881a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.588+0000 7f228e38b700 1 --2- 172.21.15.72:0/2961841692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f228809e000 0x7f22881a5990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f227c00e810 tx=0x7f227c00eb20 comp rx=0 tx=0).stop 2023-10-03T10:13:14.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.588+0000 7f228e38b700 1 -- 172.21.15.72:0/2961841692 shutdown_connections 2023-10-03T10:13:14.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.588+0000 7f228e38b700 1 --2- 172.21.15.72:0/2961841692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f228809d6f0 0x7f22881a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.588+0000 7f228e38b700 1 --2- 172.21.15.72:0/2961841692 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f228809e410 0x7f22881c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.588+0000 7f228e38b700 1 --2- 172.21.15.72:0/2961841692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f228809e000 0x7f22881a5990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.588+0000 7f228e38b700 1 -- 172.21.15.72:0/2961841692 >> 172.21.15.72:0/2961841692 conn(0x7f2288066f50 msgr2=0x7f22881bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.588+0000 7f228e38b700 1 -- 172.21.15.72:0/2961841692 shutdown_connections 2023-10-03T10:13:14.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.588+0000 7f228e38b700 1 -- 172.21.15.72:0/2961841692 wait complete. 2023-10-03T10:13:14.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.590+0000 7f7a0a8d3700 1 -- 172.21.15.72:0/764350574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a0409e930 msgr2=0x7f7a0412d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.590+0000 7f7a0a8d3700 1 --2- 172.21.15.72:0/764350574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a0409e930 0x7f7a0412d130 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f79f400e8e0 tx=0x7f79f400ebf0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.590+0000 7f7a0a8d3700 1 -- 172.21.15.72:0/764350574 shutdown_connections 2023-10-03T10:13:14.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.590+0000 7f7a0a8d3700 1 --2- 172.21.15.72:0/764350574 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a0409f650 0x7f7a0412dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.590+0000 7f7a0a8d3700 1 --2- 172.21.15.72:0/764350574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a0409e930 0x7f7a0412d130 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.590+0000 7f7a0a8d3700 1 --2- 172.21.15.72:0/764350574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a0409f240 0x7f7a0412d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.590+0000 7f7a0a8d3700 1 -- 172.21.15.72:0/764350574 >> 172.21.15.72:0/764350574 conn(0x7f7a040a4210 msgr2=0x7f7a0412a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.590+0000 7f7a0a8d3700 1 -- 172.21.15.72:0/764350574 shutdown_connections 2023-10-03T10:13:14.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.590+0000 7f7a0a8d3700 1 -- 172.21.15.72:0/764350574 wait complete. 2023-10-03T10:13:14.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:14.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:14.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.628+0000 7ff616b6d700 1 -- 172.21.15.72:0/1649965484 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff5f0005590 con 0x7ff610139170 2023-10-03T10:13:14.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.629+0000 7ff60d7fa700 1 -- 172.21.15.72:0/1649965484 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff608012340 con 0x7ff610139170 2023-10-03T10:13:14.628 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:14.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.631+0000 7ff616b6d700 1 -- 172.21.15.72:0/1649965484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff610139170 msgr2=0x7ff6101c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:14.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.631+0000 7ff616b6d700 1 --2- 172.21.15.72:0/1649965484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff610139170 0x7ff6101c8ee0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff608009ef0 tx=0x7ff60800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.631+0000 7ff616b6d700 1 -- 172.21.15.72:0/1649965484 shutdown_connections 2023-10-03T10:13:14.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.631+0000 7ff616b6d700 1 --2- 172.21.15.72:0/1649965484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff610139170 0x7ff6101c8ee0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.631+0000 7ff616b6d700 1 --2- 172.21.15.72:0/1649965484 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff61009d6f0 0x7ff6101c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.631+0000 7ff616b6d700 1 --2- 172.21.15.72:0/1649965484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff61009e1d0 0x7ff6101c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:14.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.631+0000 7ff616b6d700 1 -- 172.21.15.72:0/1649965484 >> 172.21.15.72:0/1649965484 conn(0x7ff610066f50 msgr2=0x7ff610136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:14.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.631+0000 7ff616b6d700 1 -- 172.21.15.72:0/1649965484 shutdown_connections 2023-10-03T10:13:14.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:14.631+0000 7ff616b6d700 1 -- 172.21.15.72:0/1649965484 wait complete. 2023-10-03T10:13:14.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:15.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:15.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:15.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:15.643 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:15.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.691+0000 7ff7a807a700 1 Processor -- start 2023-10-03T10:13:15.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.691+0000 7ff7a807a700 1 -- start start 2023-10-03T10:13:15.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.692+0000 7ff7a807a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a009e1d0 0x7ff7a0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.692+0000 7ff7a807a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7a0135e50 0x7ff7a0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.692+0000 7ff7a807a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a009f130 con 0x7ff7a009d6f0 2023-10-03T10:13:15.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.692+0000 7ff7a807a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a009f520 con 0x7ff7a009e1d0 2023-10-03T10:13:15.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.692+0000 7ff7a807a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a009e930 con 0x7ff7a0135e50 2023-10-03T10:13:15.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.692+0000 7ff7a5e16700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff7a009d6f0 0x7ff7a009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50536/0 (socket says 172.21.15.72:50536) 2023-10-03T10:13:15.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.692+0000 7ff7a5e16700 1 -- 172.21.15.72:0/2784792959 learned_addr learned my addr 172.21.15.72:0/2784792959 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:15.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.692+0000 7ff7a6617700 1 --2- 172.21.15.72:0/2784792959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7a0135e50 0x7ff7a0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.692+0000 7ff7a5615700 1 --2- 172.21.15.72:0/2784792959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a009e1d0 0x7ff7a0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.692+0000 7ff7a6617700 1 -- 172.21.15.72:0/2784792959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a009e1d0 msgr2=0x7ff7a0135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.692+0000 7ff7a6617700 1 --2- 172.21.15.72:0/2784792959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a009e1d0 0x7ff7a0135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.692+0000 7ff7a6617700 1 -- 172.21.15.72:0/2784792959 >> v1:172.21.15.72:6789/0 conn(0x7ff7a009d6f0 legacy=0x7ff7a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.692+0000 7ff7a4e14700 1 -- 172.21.15.72:0/2784792959 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143635767 0 0) 0x7ff7a009f130 con 0x7ff7a009d6f0 2023-10-03T10:13:15.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.692+0000 7ff7a6617700 1 -- 172.21.15.72:0/2784792959 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a009b2d0 con 0x7ff7a0135e50 2023-10-03T10:13:15.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.693+0000 7ff7a6617700 1 --2- 172.21.15.72:0/2784792959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7a0135e50 0x7ff7a0138230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff798009dc0 tx=0x7ff79800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83699f4d090e840 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.693+0000 7ff7a4e14700 1 -- 172.21.15.72:0/2784792959 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79800e070 con 0x7ff7a0135e50 2023-10-03T10:13:15.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.693+0000 7ff7a4e14700 1 -- 172.21.15.72:0/2784792959 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79800bb20 con 0x7ff7a0135e50 2023-10-03T10:13:15.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.693+0000 7ff7a4e14700 1 -- 172.21.15.72:0/2784792959 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798012430 con 0x7ff7a0135e50 2023-10-03T10:13:15.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.693+0000 7ff7a807a700 1 -- 172.21.15.72:0/2784792959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7a0135e50 msgr2=0x7ff7a0138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.693+0000 7ff7a807a700 1 --2- 172.21.15.72:0/2784792959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7a0135e50 0x7ff7a0138230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff798009dc0 tx=0x7ff79800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:15.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.694+0000 7ff7a807a700 1 -- 172.21.15.72:0/2784792959 shutdown_connections 2023-10-03T10:13:15.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.694+0000 7ff7a807a700 1 --2- 172.21.15.72:0/2784792959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7a0135e50 0x7ff7a0138230 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.694+0000 7ff7a807a700 1 --2- 172.21.15.72:0/2784792959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a009e1d0 0x7ff7a0135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.694+0000 7ff7a807a700 1 -- 172.21.15.72:0/2784792959 >> 172.21.15.72:0/2784792959 conn(0x7ff7a0066f50 msgr2=0x7ff7a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.694+0000 7ff7a807a700 1 -- 172.21.15.72:0/2784792959 shutdown_connections 2023-10-03T10:13:15.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.694+0000 7ff7a807a700 1 -- 172.21.15.72:0/2784792959 wait complete. 2023-10-03T10:13:15.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.695+0000 7ff7a807a700 1 Processor -- start 2023-10-03T10:13:15.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.695+0000 7ff7a807a700 1 -- start start 2023-10-03T10:13:15.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.695+0000 7ff7a807a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a009d6f0 0x7ff7a0120fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.695+0000 7ff7a807a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7a009e1d0 0x7ff7a01214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.695+0000 7ff7a807a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a0135e50 0x7ff7a01c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.695+0000 7ff7a807a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a0122bf0 con 0x7ff7a009d6f0 2023-10-03T10:13:15.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.695+0000 7ff7a807a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a0120bf0 con 0x7ff7a0135e50 2023-10-03T10:13:15.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.695+0000 7ff7a807a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a0133080 con 0x7ff7a009e1d0 2023-10-03T10:13:15.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.695+0000 7ff7a5615700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7a009e1d0 0x7ff7a01214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.695+0000 7ff7a5615700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7a009e1d0 0x7ff7a01214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37834/0 (socket says 172.21.15.72:37834) 2023-10-03T10:13:15.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.695+0000 7ff7a5615700 1 -- 172.21.15.72:0/3645514824 learned_addr learned my addr 172.21.15.72:0/3645514824 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:15.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.695+0000 7ff7a5e16700 1 --2- 172.21.15.72:0/3645514824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a009d6f0 0x7ff7a0120fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.695+0000 7ff7a6617700 1 --2- 172.21.15.72:0/3645514824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a0135e50 0x7ff7a01c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.696+0000 7ff7a5615700 1 -- 172.21.15.72:0/3645514824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a0135e50 msgr2=0x7ff7a01c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.696+0000 7ff7a5615700 1 --2- 172.21.15.72:0/3645514824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a0135e50 0x7ff7a01c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.696+0000 7ff7a5615700 1 -- 172.21.15.72:0/3645514824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a009d6f0 msgr2=0x7ff7a0120fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.696+0000 7ff7a5615700 1 --2- 172.21.15.72:0/3645514824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a009d6f0 0x7ff7a0120fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.696+0000 7ff7a5615700 1 -- 172.21.15.72:0/3645514824 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff798009a70 con 0x7ff7a009e1d0 2023-10-03T10:13:15.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.696+0000 7ff7a5615700 1 --2- 172.21.15.72:0/3645514824 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7a009e1d0 0x7ff7a01214e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff79000e9e0 tx=0x7ff79000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.696+0000 7ff7967fc700 1 -- 172.21.15.72:0/3645514824 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790009710 con 0x7ff7a009e1d0 2023-10-03T10:13:15.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.696+0000 7ff7967fc700 1 -- 172.21.15.72:0/3645514824 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79000ee80 con 0x7ff7a009e1d0 2023-10-03T10:13:15.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.696+0000 7ff7967fc700 1 -- 172.21.15.72:0/3645514824 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79000ca50 con 0x7ff7a009e1d0 2023-10-03T10:13:15.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.696+0000 7ff7a807a700 1 -- 172.21.15.72:0/3645514824 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a0123f50 con 0x7ff7a009e1d0 2023-10-03T10:13:15.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.696+0000 7ff7a807a700 1 -- 172.21.15.72:0/3645514824 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a01228d0 con 0x7ff7a009e1d0 2023-10-03T10:13:15.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.697+0000 7ff7967fc700 1 -- 172.21.15.72:0/3645514824 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff79000cbb0 con 0x7ff7a009e1d0 2023-10-03T10:13:15.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.697+0000 7ff7a807a700 1 -- 172.21.15.72:0/3645514824 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a0123bf0 con 0x7ff7a009e1d0 2023-10-03T10:13:15.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.697+0000 7ff7967fc700 1 -- 172.21.15.72:0/3645514824 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff79003f6b0 con 0x7ff7a009e1d0 2023-10-03T10:13:15.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.706+0000 7ff7967fc700 1 -- 172.21.15.72:0/3645514824 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7a0123bf0 con 0x7ff7a009e1d0 2023-10-03T10:13:15.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.741+0000 7f7b0e0ce700 1 Processor -- start 2023-10-03T10:13:15.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.741+0000 7f7b0e0ce700 1 -- start start 2023-10-03T10:13:15.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.741+0000 7f7b0e0ce700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b0809d6f0 0x7f7b0809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.741+0000 7f7b0e0ce700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7b0809e410 0x7f7b08134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.741+0000 7f7b0e0ce700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0809b120 con 0x7f7b0809e000 2023-10-03T10:13:15.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.741+0000 7f7b0e0ce700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b0806b460 con 0x7f7b0809e410 2023-10-03T10:13:15.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.741+0000 7f7b0e0ce700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0809a7e0 con 0x7f7b0809d6f0 2023-10-03T10:13:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.742+0000 7f7b07fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7b0809e410 0x7f7b08134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.742+0000 7f7b077fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b0809d6f0 0x7f7b0809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.742+0000 7f7b077fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b0809d6f0 0x7f7b0809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37846/0 (socket says 172.21.15.72:37846) 2023-10-03T10:13:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.742+0000 7f7b07fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7b0809e410 0x7f7b08134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34612/0 (socket says 172.21.15.72:34612) 2023-10-03T10:13:15.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.742+0000 7f7b077fe700 1 -- 172.21.15.72:0/1921549981 learned_addr learned my addr 172.21.15.72:0/1921549981 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.742+0000 7f7b077fe700 1 -- 172.21.15.72:0/1921549981 >> v2:172.21.15.72:3300/0 conn(0x7f7b0809e410 msgr2=0x7f7b08134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.742+0000 7f7b077fe700 1 --2- 172.21.15.72:0/1921549981 >> v2:172.21.15.72:3300/0 conn(0x7f7b0809e410 0x7f7b08134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.742+0000 7f7b077fe700 1 -- 172.21.15.72:0/1921549981 >> v1:172.21.15.72:6789/0 conn(0x7f7b0809e000 legacy=0x7f7b081339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.742+0000 7f7b077fe700 1 -- 172.21.15.72:0/1921549981 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0809a500 con 0x7f7b0809d6f0 2023-10-03T10:13:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.742+0000 7f7b07fff700 1 --2- 172.21.15.72:0/1921549981 >> v2:172.21.15.72:3300/0 conn(0x7f7b0809e410 0x7f7b08134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.742+0000 7f7b077fe700 1 --2- 172.21.15.72:0/1921549981 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b0809d6f0 0x7f7b0809dac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009920 tx=0x7f7af8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67a62228f9828d6a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.742+0000 7f7b067fc700 1 -- 172.21.15.72:0/1921549981 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8011830 con 0x7f7b0809d6f0 2023-10-03T10:13:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.742+0000 7f7b067fc700 1 -- 172.21.15.72:0/1921549981 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af8011990 con 0x7f7b0809d6f0 2023-10-03T10:13:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.742+0000 7f7b067fc700 1 -- 172.21.15.72:0/1921549981 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8011d20 con 0x7f7b0809d6f0 2023-10-03T10:13:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.743+0000 7f7b0e0ce700 1 -- 172.21.15.72:0/1921549981 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b0809d6f0 msgr2=0x7f7b0809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.743+0000 7f7b0e0ce700 1 --2- 172.21.15.72:0/1921549981 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b0809d6f0 0x7f7b0809dac0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009920 tx=0x7f7af8009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.743+0000 7f7b0e0ce700 1 -- 172.21.15.72:0/1921549981 shutdown_connections 2023-10-03T10:13:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.743+0000 7f7b0e0ce700 1 --2- 172.21.15.72:0/1921549981 >> v2:172.21.15.72:3300/0 conn(0x7f7b0809e410 0x7f7b08134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.743+0000 7f7b0e0ce700 1 --2- 172.21.15.72:0/1921549981 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b0809d6f0 0x7f7b0809dac0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.743+0000 7f7b0e0ce700 1 -- 172.21.15.72:0/1921549981 >> 172.21.15.72:0/1921549981 conn(0x7f7b08066f50 msgr2=0x7f7b0809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.743+0000 7f7b0e0ce700 1 -- 172.21.15.72:0/1921549981 shutdown_connections 2023-10-03T10:13:15.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.743+0000 7f7b0e0ce700 1 -- 172.21.15.72:0/1921549981 wait complete. 2023-10-03T10:13:15.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.744+0000 7f7b0e0ce700 1 Processor -- start 2023-10-03T10:13:15.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.744+0000 7f7b0e0ce700 1 -- start start 2023-10-03T10:13:15.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b0e0ce700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b0809d6f0 0x7f7b081a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b0e0ce700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b0809e000 0x7f7b081a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b0e0ce700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b0809e410 0x7f7b081a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b0e0ce700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b080a3480 con 0x7f7b0809e000 2023-10-03T10:13:15.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b0e0ce700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b081a6b90 con 0x7f7b0809e410 2023-10-03T10:13:15.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b0e0ce700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b081a7d40 con 0x7f7b0809d6f0 2023-10-03T10:13:15.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b07fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b0809e410 0x7f7b081a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b06ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b0809e000 0x7f7b081a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b07fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b0809e410 0x7f7b081a5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46546/0 (socket says 172.21.15.72:46546) 2023-10-03T10:13:15.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b07fff700 1 -- 172.21.15.72:0/4286708787 learned_addr learned my addr 172.21.15.72:0/4286708787 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:15.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b077fe700 1 --2- 172.21.15.72:0/4286708787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b0809d6f0 0x7f7b081a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b07fff700 1 -- 172.21.15.72:0/4286708787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b0809d6f0 msgr2=0x7f7b081a4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b07fff700 1 --2- 172.21.15.72:0/4286708787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b0809d6f0 0x7f7b081a4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b07fff700 1 -- 172.21.15.72:0/4286708787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b0809e000 msgr2=0x7f7b081a5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b07fff700 1 --2- 172.21.15.72:0/4286708787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b0809e000 0x7f7b081a5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b07fff700 1 -- 172.21.15.72:0/4286708787 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b00009a70 con 0x7f7b0809e410 2023-10-03T10:13:15.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.745+0000 7f7b07fff700 1 --2- 172.21.15.72:0/4286708787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b0809e410 0x7f7b081a5980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000efc0 tx=0x7f7b0000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.746+0000 7f7aeffff700 1 -- 172.21.15.72:0/4286708787 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000ca90 con 0x7f7b0809e410 2023-10-03T10:13:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.746+0000 7f7aeffff700 1 -- 172.21.15.72:0/4286708787 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0000f040 con 0x7f7b0809e410 2023-10-03T10:13:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.746+0000 7f7b0e0ce700 1 -- 172.21.15.72:0/4286708787 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af8009550 con 0x7f7b0809e410 2023-10-03T10:13:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.746+0000 7f7aeffff700 1 -- 172.21.15.72:0/4286708787 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000ce10 con 0x7f7b0809e410 2023-10-03T10:13:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.746+0000 7f7b0e0ce700 1 -- 172.21.15.72:0/4286708787 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0809c760 con 0x7f7b0809e410 2023-10-03T10:13:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.747+0000 7f7aeffff700 1 -- 172.21.15.72:0/4286708787 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b00014480 con 0x7f7b0809e410 2023-10-03T10:13:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.747+0000 7f7aeffff700 1 -- 172.21.15.72:0/4286708787 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7b0003fe40 con 0x7f7b0809e410 2023-10-03T10:13:15.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.747+0000 7f7b0e0ce700 1 -- 172.21.15.72:0/4286708787 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b081a82d0 con 0x7f7b0809e410 2023-10-03T10:13:15.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.752+0000 7f7aeffff700 1 -- 172.21.15.72:0/4286708787 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b00012930 con 0x7f7b0809e410 2023-10-03T10:13:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.779+0000 7f09b8eca700 1 Processor -- start 2023-10-03T10:13:15.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.779+0000 7f09b8eca700 1 -- start start 2023-10-03T10:13:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.780+0000 7f09b8eca700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09b406c0e0 0x7f09b409ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.780+0000 7f09b8eca700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09b4134ec0 0x7f09b41379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.780+0000 7f09b8eca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4137f20 0x7f09b41383c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.780+0000 7f09b8eca700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b406c4b0 con 0x7f09b4134ec0 2023-10-03T10:13:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.780+0000 7f09b8eca700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b40a09c0 con 0x7f09b4137f20 2023-10-03T10:13:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.780+0000 7f09b8eca700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09b4134980 con 0x7f09b406c0e0 2023-10-03T10:13:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.780+0000 7f09b259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09b406c0e0 0x7f09b409ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.780+0000 7f09b259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09b406c0e0 0x7f09b409ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37862/0 (socket says 172.21.15.72:37862) 2023-10-03T10:13:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.780+0000 7f09b1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09b4134ec0 0x7f09b41379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.780+0000 7f09b259c700 1 -- 172.21.15.72:0/1571582158 learned_addr learned my addr 172.21.15.72:0/1571582158 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.780+0000 7f09b2d9d700 1 --2- 172.21.15.72:0/1571582158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4137f20 0x7f09b41383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.781+0000 7f09b1d9b700 1 -- 172.21.15.72:0/1571582158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09b406c0e0 msgr2=0x7f09b409ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.781+0000 7f09b1d9b700 1 --2- 172.21.15.72:0/1571582158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09b406c0e0 0x7f09b409ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.781+0000 7f09b1d9b700 1 -- 172.21.15.72:0/1571582158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4137f20 msgr2=0x7f09b41383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.781+0000 7f09b1d9b700 1 --2- 172.21.15.72:0/1571582158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4137f20 0x7f09b41383c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.781+0000 7f09b1d9b700 1 -- 172.21.15.72:0/1571582158 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b40a0600 con 0x7f09b4134ec0 2023-10-03T10:13:15.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.781+0000 7f09b1d9b700 1 --2- 172.21.15.72:0/1571582158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b4134ec0 0x7f09b41379e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009840 tx=0x7f09a8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5370f64eecdd8db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.781+0000 7f09b159a700 1 -- 172.21.15.72:0/1571582158 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8011830 con 0x7f09b4134ec0 2023-10-03T10:13:15.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.781+0000 7f09b159a700 1 -- 172.21.15.72:0/1571582158 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a8011990 con 0x7f09b4134ec0 2023-10-03T10:13:15.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.781+0000 7f09b159a700 1 -- 172.21.15.72:0/1571582158 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8011d20 con 0x7f09b4134ec0 2023-10-03T10:13:15.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.781+0000 7f09b8eca700 1 -- 172.21.15.72:0/1571582158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b4134ec0 msgr2=0x7f09b41379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.781+0000 7f09b8eca700 1 --2- 172.21.15.72:0/1571582158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b4134ec0 0x7f09b41379e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009840 tx=0x7f09a8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:15.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.782+0000 7f09b8eca700 1 -- 172.21.15.72:0/1571582158 shutdown_connections 2023-10-03T10:13:15.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.782+0000 7f09b8eca700 1 --2- 172.21.15.72:0/1571582158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4137f20 0x7f09b41383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.782+0000 7f09b8eca700 1 --2- 172.21.15.72:0/1571582158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09b406c0e0 0x7f09b409ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.782+0000 7f09b8eca700 1 --2- 172.21.15.72:0/1571582158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b4134ec0 0x7f09b41379e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.782+0000 7f09b8eca700 1 -- 172.21.15.72:0/1571582158 >> 172.21.15.72:0/1571582158 conn(0x7f09b40a4210 msgr2=0x7f09b40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.782+0000 7f09b8eca700 1 -- 172.21.15.72:0/1571582158 shutdown_connections 2023-10-03T10:13:15.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.782+0000 7f09b8eca700 1 -- 172.21.15.72:0/1571582158 wait complete. 2023-10-03T10:13:15.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.783+0000 7f09b8eca700 1 Processor -- start 2023-10-03T10:13:15.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.783+0000 7f09b8eca700 1 -- start start 2023-10-03T10:13:15.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.783+0000 7f09b8eca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b406c0e0 0x7f09b41ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.783+0000 7f09b8eca700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09b4134ec0 0x7f09b41cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.783+0000 7f09b8eca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4137f20 0x7f09b411a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.783+0000 7f09b8eca700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b411db30 con 0x7f09b406c0e0 2023-10-03T10:13:15.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.783+0000 7f09b8eca700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b40a16c0 con 0x7f09b4137f20 2023-10-03T10:13:15.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.783+0000 7f09b8eca700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09b40a03f0 con 0x7f09b4134ec0 2023-10-03T10:13:15.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.783+0000 7f09b259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b406c0e0 0x7f09b41ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.783+0000 7f09b259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b406c0e0 0x7f09b41ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34634/0 (socket says 172.21.15.72:34634) 2023-10-03T10:13:15.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.783+0000 7f09b259c700 1 -- 172.21.15.72:0/2782070209 learned_addr learned my addr 172.21.15.72:0/2782070209 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:15.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.783+0000 7f09b2d9d700 1 --2- 172.21.15.72:0/2782070209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4137f20 0x7f09b411a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.784+0000 7f09b1d9b700 1 --2- 172.21.15.72:0/2782070209 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09b4134ec0 0x7f09b41cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.784+0000 7f09b259c700 1 -- 172.21.15.72:0/2782070209 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09b4134ec0 msgr2=0x7f09b41cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.784+0000 7f09b259c700 1 --2- 172.21.15.72:0/2782070209 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09b4134ec0 0x7f09b41cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.784+0000 7f09b259c700 1 -- 172.21.15.72:0/2782070209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4137f20 msgr2=0x7f09b411a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.784+0000 7f09b259c700 1 --2- 172.21.15.72:0/2782070209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4137f20 0x7f09b411a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.784+0000 7f09b259c700 1 -- 172.21.15.72:0/2782070209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a80094a0 con 0x7f09b406c0e0 2023-10-03T10:13:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.784+0000 7f09b2d9d700 1 --2- 172.21.15.72:0/2782070209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4137f20 0x7f09b411a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.784+0000 7f09b259c700 1 --2- 172.21.15.72:0/2782070209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b406c0e0 0x7f09b41ccd50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f09a400e8b0 tx=0x7f09a400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.784+0000 7f09a2ffd700 1 -- 172.21.15.72:0/2782070209 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a4009600 con 0x7f09b406c0e0 2023-10-03T10:13:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.784+0000 7f09a2ffd700 1 -- 172.21.15.72:0/2782070209 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a4013680 con 0x7f09b406c0e0 2023-10-03T10:13:15.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.784+0000 7f09b8eca700 1 -- 172.21.15.72:0/2782070209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b411dd80 con 0x7f09b406c0e0 2023-10-03T10:13:15.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.784+0000 7f09a2ffd700 1 -- 172.21.15.72:0/2782070209 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a4013a30 con 0x7f09b406c0e0 2023-10-03T10:13:15.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.784+0000 7f09b8eca700 1 -- 172.21.15.72:0/2782070209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b411cc00 con 0x7f09b406c0e0 2023-10-03T10:13:15.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.785+0000 7f09a2ffd700 1 -- 172.21.15.72:0/2782070209 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09a4013b90 con 0x7f09b406c0e0 2023-10-03T10:13:15.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.785+0000 7f09b8eca700 1 -- 172.21.15.72:0/2782070209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b411c3b0 con 0x7f09b406c0e0 2023-10-03T10:13:15.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.785+0000 7f09a2ffd700 1 -- 172.21.15.72:0/2782070209 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09a403f8b0 con 0x7f09b406c0e0 2023-10-03T10:13:15.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.790+0000 7f30659a1700 1 Processor -- start 2023-10-03T10:13:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.790+0000 7f30659a1700 1 -- start start 2023-10-03T10:13:15.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.790+0000 7f30659a1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f306006a770 0x7f306009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.790+0000 7f30659a1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f306009dc30 0x7f306009e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.790+0000 7f30659a1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306009a810 con 0x7f306013c1e0 2023-10-03T10:13:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.790+0000 7f30659a1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306006ab40 con 0x7f306006a770 2023-10-03T10:13:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.790+0000 7f30659a1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f306009ebc0 con 0x7f306009dc30 2023-10-03T10:13:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.791+0000 7f305effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f306006a770 0x7f306009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.791+0000 7f305f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f306013c1e0 0x7f306013e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50548/0 (socket says 172.21.15.72:50548) 2023-10-03T10:13:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.791+0000 7f305f7fe700 1 -- 172.21.15.72:0/644652154 learned_addr learned my addr 172.21.15.72:0/644652154 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.791+0000 7f305e7fc700 1 --2- 172.21.15.72:0/644652154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f306009dc30 0x7f306009e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.791+0000 7f305effd700 1 -- 172.21.15.72:0/644652154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f306009dc30 msgr2=0x7f306009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.791+0000 7f305effd700 1 --2- 172.21.15.72:0/644652154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f306009dc30 0x7f306009e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.791+0000 7f305effd700 1 -- 172.21.15.72:0/644652154 >> v1:172.21.15.72:6789/0 conn(0x7f306013c1e0 legacy=0x7f306013e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.791+0000 7f305effd700 1 -- 172.21.15.72:0/644652154 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306009e920 con 0x7f306006a770 2023-10-03T10:13:15.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.791+0000 7f305effd700 1 --2- 172.21.15.72:0/644652154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306006a770 0x7f306009d6f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3050009840 tx=0x7f3050009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694a27fb61e6f572 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.794+0000 7f305dffb700 1 -- 172.21.15.72:0/644652154 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050011830 con 0x7f306006a770 2023-10-03T10:13:15.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.794+0000 7f305dffb700 1 -- 172.21.15.72:0/644652154 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3050011990 con 0x7f306006a770 2023-10-03T10:13:15.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.794+0000 7f305dffb700 1 -- 172.21.15.72:0/644652154 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050011d20 con 0x7f306006a770 2023-10-03T10:13:15.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.794+0000 7f09a2ffd700 1 -- 172.21.15.72:0/2782070209 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09a4011bb0 con 0x7f09b406c0e0 2023-10-03T10:13:15.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.795+0000 7f30659a1700 1 -- 172.21.15.72:0/644652154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306006a770 msgr2=0x7f306009d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.795+0000 7f30659a1700 1 --2- 172.21.15.72:0/644652154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306006a770 0x7f306009d6f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3050009840 tx=0x7f3050009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:15.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.795+0000 7f30659a1700 1 -- 172.21.15.72:0/644652154 shutdown_connections 2023-10-03T10:13:15.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.795+0000 7f30659a1700 1 --2- 172.21.15.72:0/644652154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306006a770 0x7f306009d6f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.795+0000 7f30659a1700 1 --2- 172.21.15.72:0/644652154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f306009dc30 0x7f306009e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.795+0000 7f30659a1700 1 -- 172.21.15.72:0/644652154 >> 172.21.15.72:0/644652154 conn(0x7f3060066f50 msgr2=0x7f306009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.795+0000 7f30659a1700 1 -- 172.21.15.72:0/644652154 shutdown_connections 2023-10-03T10:13:15.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.795+0000 7f30659a1700 1 -- 172.21.15.72:0/644652154 wait complete. 2023-10-03T10:13:15.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.796+0000 7f30659a1700 1 Processor -- start 2023-10-03T10:13:15.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.796+0000 7f30659a1700 1 -- start start 2023-10-03T10:13:15.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.797+0000 7f30659a1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f306006a770 0x7f306013e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.797+0000 7f30659a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f306009dc30 0x7f306013a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.797+0000 7f30659a1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306013c1e0 0x7f306013abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:15.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.797+0000 7f30659a1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306011de30 con 0x7f306013c1e0 2023-10-03T10:13:15.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.797+0000 7f30659a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306013fa20 con 0x7f306009dc30 2023-10-03T10:13:15.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.797+0000 7f30659a1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3060071e20 con 0x7f306006a770 2023-10-03T10:13:15.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.797+0000 7f305f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306013c1e0 0x7f306013abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.797+0000 7f305f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306013c1e0 0x7f306013abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34650/0 (socket says 172.21.15.72:34650) 2023-10-03T10:13:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.797+0000 7f305f7fe700 1 -- 172.21.15.72:0/3707510863 learned_addr learned my addr 172.21.15.72:0/3707510863 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.797+0000 7f305e7fc700 1 --2- 172.21.15.72:0/3707510863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f306009dc30 0x7f306013a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.798+0000 7f305effd700 1 --2- 172.21.15.72:0/3707510863 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f306006a770 0x7f306013e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.798+0000 7f305f7fe700 1 -- 172.21.15.72:0/3707510863 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f306006a770 msgr2=0x7f306013e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.798+0000 7f305f7fe700 1 --2- 172.21.15.72:0/3707510863 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f306006a770 0x7f306013e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.798+0000 7f305f7fe700 1 -- 172.21.15.72:0/3707510863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f306009dc30 msgr2=0x7f306013a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.798+0000 7f305f7fe700 1 --2- 172.21.15.72:0/3707510863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f306009dc30 0x7f306013a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.798+0000 7f305f7fe700 1 -- 172.21.15.72:0/3707510863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500094a0 con 0x7f306013c1e0 2023-10-03T10:13:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.798+0000 7f305e7fc700 1 --2- 172.21.15.72:0/3707510863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f306009dc30 0x7f306013a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.798+0000 7f305effd700 1 --2- 172.21.15.72:0/3707510863 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f306006a770 0x7f306013e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.798+0000 7f305f7fe700 1 --2- 172.21.15.72:0/3707510863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306013c1e0 0x7f306013abe0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f305800cbf0 tx=0x7f30580021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:15.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.798+0000 7f3047fff700 1 -- 172.21.15.72:0/3707510863 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305800ab40 con 0x7f306013c1e0 2023-10-03T10:13:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.798+0000 7f3047fff700 1 -- 172.21.15.72:0/3707510863 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305800aca0 con 0x7f306013c1e0 2023-10-03T10:13:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.798+0000 7f30659a1700 1 -- 172.21.15.72:0/3707510863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306009f1a0 con 0x7f306013c1e0 2023-10-03T10:13:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.798+0000 7f30659a1700 1 -- 172.21.15.72:0/3707510863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306013efe0 con 0x7f306013c1e0 2023-10-03T10:13:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.799+0000 7f3047fff700 1 -- 172.21.15.72:0/3707510863 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058012600 con 0x7f306013c1e0 2023-10-03T10:13:15.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.799+0000 7f3047fff700 1 -- 172.21.15.72:0/3707510863 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f305801b3b0 con 0x7f306013c1e0 2023-10-03T10:13:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.800+0000 7f3047fff700 1 -- 172.21.15.72:0/3707510863 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f305803f420 con 0x7f306013c1e0 2023-10-03T10:13:15.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.800+0000 7f30659a1700 1 -- 172.21.15.72:0/3707510863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306011df70 con 0x7f306013c1e0 2023-10-03T10:13:15.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.809+0000 7f3047fff700 1 -- 172.21.15.72:0/3707510863 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f305801b660 con 0x7f306013c1e0 2023-10-03T10:13:15.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.914+0000 7ff7a807a700 1 -- 172.21.15.72:0/3645514824 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff7a0123bf0 con 0x7ff7a009e1d0 2023-10-03T10:13:15.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.914+0000 7ff7967fc700 1 -- 172.21.15.72:0/3645514824 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7a0123bf0 con 0x7ff7a009e1d0 2023-10-03T10:13:15.914 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:15.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.916+0000 7ff7a807a700 1 -- 172.21.15.72:0/3645514824 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7a009e1d0 msgr2=0x7ff7a01214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.916+0000 7ff7a807a700 1 --2- 172.21.15.72:0/3645514824 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7a009e1d0 0x7ff7a01214e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff79000e9e0 tx=0x7ff79000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.917+0000 7ff7a807a700 1 -- 172.21.15.72:0/3645514824 shutdown_connections 2023-10-03T10:13:15.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.917+0000 7ff7a807a700 1 --2- 172.21.15.72:0/3645514824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a009d6f0 0x7ff7a0120fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.917+0000 7ff7a807a700 1 --2- 172.21.15.72:0/3645514824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a0135e50 0x7ff7a01c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.917+0000 7ff7a807a700 1 --2- 172.21.15.72:0/3645514824 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7a009e1d0 0x7ff7a01214e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.917+0000 7ff7a807a700 1 -- 172.21.15.72:0/3645514824 >> 172.21.15.72:0/3645514824 conn(0x7ff7a0066f50 msgr2=0x7ff7a006ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.917+0000 7ff7a807a700 1 -- 172.21.15.72:0/3645514824 shutdown_connections 2023-10-03T10:13:15.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.917+0000 7ff7a807a700 1 -- 172.21.15.72:0/3645514824 wait complete. 2023-10-03T10:13:15.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:15.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.957+0000 7f7b0e0ce700 1 -- 172.21.15.72:0/4286708787 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7b081a8520 con 0x7f7b0809e410 2023-10-03T10:13:15.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.957+0000 7f7aeffff700 1 -- 172.21.15.72:0/4286708787 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7b00012340 con 0x7f7b0809e410 2023-10-03T10:13:15.957 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.959+0000 7f7b0e0ce700 1 -- 172.21.15.72:0/4286708787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b0809e410 msgr2=0x7f7b081a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.959+0000 7f7b0e0ce700 1 --2- 172.21.15.72:0/4286708787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b0809e410 0x7f7b081a5980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000efc0 tx=0x7f7b0000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.960+0000 7f7b0e0ce700 1 -- 172.21.15.72:0/4286708787 shutdown_connections 2023-10-03T10:13:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.960+0000 7f7b0e0ce700 1 --2- 172.21.15.72:0/4286708787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b0809e410 0x7f7b081a5980 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.960+0000 7f7b0e0ce700 1 --2- 172.21.15.72:0/4286708787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b0809d6f0 0x7f7b081a4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.960+0000 7f7b0e0ce700 1 --2- 172.21.15.72:0/4286708787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b0809e000 0x7f7b081a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.960+0000 7f7b0e0ce700 1 -- 172.21.15.72:0/4286708787 >> 172.21.15.72:0/4286708787 conn(0x7f7b08066f50 msgr2=0x7f7b081bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.960+0000 7f7b0e0ce700 1 -- 172.21.15.72:0/4286708787 shutdown_connections 2023-10-03T10:13:15.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.960+0000 7f7b0e0ce700 1 -- 172.21.15.72:0/4286708787 wait complete. 2023-10-03T10:13:15.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.991+0000 7f09b8eca700 1 -- 172.21.15.72:0/2782070209 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f09b411d990 con 0x7f09b406c0e0 2023-10-03T10:13:15.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.992+0000 7f09a2ffd700 1 -- 172.21.15.72:0/2782070209 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09b411d990 con 0x7f09b406c0e0 2023-10-03T10:13:15.991 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.994+0000 7f09b8eca700 1 -- 172.21.15.72:0/2782070209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b406c0e0 msgr2=0x7f09b41ccd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.994+0000 7f09b8eca700 1 --2- 172.21.15.72:0/2782070209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b406c0e0 0x7f09b41ccd50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f09a400e8b0 tx=0x7f09a400ebc0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.994+0000 7f09b8eca700 1 -- 172.21.15.72:0/2782070209 shutdown_connections 2023-10-03T10:13:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.994+0000 7f09b8eca700 1 --2- 172.21.15.72:0/2782070209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09b406c0e0 0x7f09b41ccd50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.994+0000 7f09b8eca700 1 --2- 172.21.15.72:0/2782070209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09b4137f20 0x7f09b411a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.994+0000 7f09b8eca700 1 --2- 172.21.15.72:0/2782070209 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09b4134ec0 0x7f09b41cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.994+0000 7f09b8eca700 1 -- 172.21.15.72:0/2782070209 >> 172.21.15.72:0/2782070209 conn(0x7f09b40a4210 msgr2=0x7f09b4099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.994+0000 7f09b8eca700 1 -- 172.21.15.72:0/2782070209 shutdown_connections 2023-10-03T10:13:15.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:15.994+0000 7f09b8eca700 1 -- 172.21.15.72:0/2782070209 wait complete. 2023-10-03T10:13:16.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:16.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:16.006+0000 7f30659a1700 1 -- 172.21.15.72:0/3707510863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3060074ea0 con 0x7f306013c1e0 2023-10-03T10:13:16.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:16.007+0000 7f3047fff700 1 -- 172.21.15.72:0/3707510863 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3058017020 con 0x7f306013c1e0 2023-10-03T10:13:16.006 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:16.009+0000 7f30659a1700 1 -- 172.21.15.72:0/3707510863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306013c1e0 msgr2=0x7f306013abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:16.009+0000 7f30659a1700 1 --2- 172.21.15.72:0/3707510863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306013c1e0 0x7f306013abe0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f305800cbf0 tx=0x7f30580021c0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:16.009+0000 7f30659a1700 1 -- 172.21.15.72:0/3707510863 shutdown_connections 2023-10-03T10:13:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:16.009+0000 7f30659a1700 1 --2- 172.21.15.72:0/3707510863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f306013c1e0 0x7f306013abe0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:16.009+0000 7f30659a1700 1 --2- 172.21.15.72:0/3707510863 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f306006a770 0x7f306013e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:16.009+0000 7f30659a1700 1 --2- 172.21.15.72:0/3707510863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f306009dc30 0x7f306013a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:16.009+0000 7f30659a1700 1 -- 172.21.15.72:0/3707510863 >> 172.21.15.72:0/3707510863 conn(0x7f3060066f50 msgr2=0x7f306009bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:16.009+0000 7f30659a1700 1 -- 172.21.15.72:0/3707510863 shutdown_connections 2023-10-03T10:13:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:16.009+0000 7f30659a1700 1 -- 172.21.15.72:0/3707510863 wait complete. 2023-10-03T10:13:16.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:16.929 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:16.972 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:17.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:17.021 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:17.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.072+0000 7f99a3a21700 1 Processor -- start 2023-10-03T10:13:17.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.072+0000 7f99a3a21700 1 -- start start 2023-10-03T10:13:17.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.072+0000 7f99a3a21700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f999c136710 0x7f999c138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.072+0000 7f99a3a21700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f999c139030 0x7f999c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.072+0000 7f99a3a21700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f999c06ef30 con 0x7f999c1338a0 2023-10-03T10:13:17.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.072+0000 7f99a3a21700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999c06fef0 con 0x7f999c136710 2023-10-03T10:13:17.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.072+0000 7f99a3a21700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f999c1334b0 con 0x7f999c139030 2023-10-03T10:13:17.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.073+0000 7f99a1fbe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f999c139030 0x7f999c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.073+0000 7f99a0fbc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f999c136710 0x7f999c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.073+0000 7f99a17bd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f999c1338a0 0x7f999c133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50556/0 (socket says 172.21.15.72:50556) 2023-10-03T10:13:17.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.073+0000 7f99a1fbe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f999c139030 0x7f999c13b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37896/0 (socket says 172.21.15.72:37896) 2023-10-03T10:13:17.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.073+0000 7f99a17bd700 1 -- 172.21.15.72:0/3531355584 learned_addr learned my addr 172.21.15.72:0/3531355584 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:17.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.073+0000 7f99a1fbe700 1 -- 172.21.15.72:0/3531355584 >> v2:172.21.15.72:3300/0 conn(0x7f999c136710 msgr2=0x7f999c138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.073+0000 7f99a1fbe700 1 --2- 172.21.15.72:0/3531355584 >> v2:172.21.15.72:3300/0 conn(0x7f999c136710 0x7f999c138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.073+0000 7f99a1fbe700 1 -- 172.21.15.72:0/3531355584 >> v1:172.21.15.72:6789/0 conn(0x7f999c1338a0 legacy=0x7f999c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.073+0000 7f99a1fbe700 1 -- 172.21.15.72:0/3531355584 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c06fc30 con 0x7f999c139030 2023-10-03T10:13:17.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.073+0000 7f99a1fbe700 1 --2- 172.21.15.72:0/3531355584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f999c139030 0x7f999c13b410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9994009d90 tx=0x7f999400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c38f952d80dac0bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.073+0000 7f9993fff700 1 -- 172.21.15.72:0/3531355584 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999400e070 con 0x7f999c139030 2023-10-03T10:13:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.073+0000 7f9993fff700 1 -- 172.21.15.72:0/3531355584 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999400bb20 con 0x7f999c139030 2023-10-03T10:13:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.074+0000 7f9993fff700 1 -- 172.21.15.72:0/3531355584 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994012430 con 0x7f999c139030 2023-10-03T10:13:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.074+0000 7f99a3a21700 1 -- 172.21.15.72:0/3531355584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f999c139030 msgr2=0x7f999c13b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.074+0000 7f99a3a21700 1 --2- 172.21.15.72:0/3531355584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f999c139030 0x7f999c13b410 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9994009d90 tx=0x7f999400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.074+0000 7f99a3a21700 1 -- 172.21.15.72:0/3531355584 shutdown_connections 2023-10-03T10:13:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.074+0000 7f99a3a21700 1 --2- 172.21.15.72:0/3531355584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f999c139030 0x7f999c13b410 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.074+0000 7f99a3a21700 1 --2- 172.21.15.72:0/3531355584 >> v2:172.21.15.72:3300/0 conn(0x7f999c136710 0x7f999c138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.074+0000 7f99a3a21700 1 -- 172.21.15.72:0/3531355584 >> 172.21.15.72:0/3531355584 conn(0x7f999c0a2aa0 msgr2=0x7f999c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.075+0000 7f99a3a21700 1 -- 172.21.15.72:0/3531355584 shutdown_connections 2023-10-03T10:13:17.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.075+0000 7f99a3a21700 1 -- 172.21.15.72:0/3531355584 wait complete. 2023-10-03T10:13:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.076+0000 7f99a3a21700 1 Processor -- start 2023-10-03T10:13:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.076+0000 7f99a3a21700 1 -- start start 2023-10-03T10:13:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.076+0000 7f99a3a21700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f999c1338a0 0x7f999c11ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.076+0000 7f99a3a21700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f999c136710 0x7f999c11b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.076+0000 7f99a3a21700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f999c139030 0x7f999c11b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.076+0000 7f99a3a21700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c11e550 con 0x7f999c139030 2023-10-03T10:13:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.076+0000 7f99a3a21700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999c138d90 con 0x7f999c136710 2023-10-03T10:13:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.076+0000 7f99a3a21700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f999c06f640 con 0x7f999c1338a0 2023-10-03T10:13:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.077+0000 7f99a1fbe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f999c139030 0x7f999c11b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.077+0000 7f99a1fbe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f999c139030 0x7f999c11b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34664/0 (socket says 172.21.15.72:34664) 2023-10-03T10:13:17.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.077+0000 7f99a1fbe700 1 -- 172.21.15.72:0/1120752789 learned_addr learned my addr 172.21.15.72:0/1120752789 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.077+0000 7f99a0fbc700 1 --2- 172.21.15.72:0/1120752789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f999c136710 0x7f999c11b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.077+0000 7f99a17bd700 1 --2- 172.21.15.72:0/1120752789 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f999c1338a0 0x7f999c11ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.077+0000 7f99a1fbe700 1 -- 172.21.15.72:0/1120752789 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f999c1338a0 msgr2=0x7f999c11ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.077+0000 7f99a1fbe700 1 --2- 172.21.15.72:0/1120752789 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f999c1338a0 0x7f999c11ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.077+0000 7f99a1fbe700 1 -- 172.21.15.72:0/1120752789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f999c136710 msgr2=0x7f999c11b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.077+0000 7f99a1fbe700 1 --2- 172.21.15.72:0/1120752789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f999c136710 0x7f999c11b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.077+0000 7f99a1fbe700 1 -- 172.21.15.72:0/1120752789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9994009a70 con 0x7f999c139030 2023-10-03T10:13:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.077+0000 7f99a0fbc700 1 --2- 172.21.15.72:0/1120752789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f999c136710 0x7f999c11b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.077+0000 7f99a1fbe700 1 --2- 172.21.15.72:0/1120752789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f999c139030 0x7f999c11b790 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9994014040 tx=0x7f9994004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.078+0000 7f9991ffb700 1 -- 172.21.15.72:0/1120752789 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994012430 con 0x7f999c139030 2023-10-03T10:13:17.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.078+0000 7f99a3a21700 1 -- 172.21.15.72:0/1120752789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f999c11ca30 con 0x7f999c139030 2023-10-03T10:13:17.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.078+0000 7f99a3a21700 1 -- 172.21.15.72:0/1120752789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999c11efc0 con 0x7f999c139030 2023-10-03T10:13:17.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.078+0000 7f9991ffb700 1 -- 172.21.15.72:0/1120752789 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9994020070 con 0x7f999c139030 2023-10-03T10:13:17.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.078+0000 7f9991ffb700 1 -- 172.21.15.72:0/1120752789 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994003ea0 con 0x7f999c139030 2023-10-03T10:13:17.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.079+0000 7f9991ffb700 1 -- 172.21.15.72:0/1120752789 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9994004040 con 0x7f999c139030 2023-10-03T10:13:17.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.079+0000 7f9991ffb700 1 -- 172.21.15.72:0/1120752789 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9994022070 con 0x7f999c139030 2023-10-03T10:13:17.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.079+0000 7f99a3a21700 1 -- 172.21.15.72:0/1120752789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997c0052e0 con 0x7f999c139030 2023-10-03T10:13:17.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.088+0000 7f9991ffb700 1 -- 172.21.15.72:0/1120752789 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9994011980 con 0x7f999c139030 2023-10-03T10:13:17.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.117+0000 7f7dcc013700 1 Processor -- start 2023-10-03T10:13:17.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.118+0000 7f7dcc013700 1 -- start start 2023-10-03T10:13:17.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.118+0000 7f7dcc013700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc409e930 0x7f7dc409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.118+0000 7f7dcc013700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7dc409f650 0x7f7dc4131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.118+0000 7f7dcc013700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc4070940 con 0x7f7dc409f240 2023-10-03T10:13:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.118+0000 7f7dcc013700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc406fd60 con 0x7f7dc409f650 2023-10-03T10:13:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.118+0000 7f7dcc013700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc406fa80 con 0x7f7dc409e930 2023-10-03T10:13:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.118+0000 7f7dc9daf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc409e930 0x7f7dc409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.118+0000 7f7dc9daf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc409e930 0x7f7dc409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37910/0 (socket says 172.21.15.72:37910) 2023-10-03T10:13:17.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.118+0000 7f7dc9daf700 1 -- 172.21.15.72:0/2999927477 learned_addr learned my addr 172.21.15.72:0/2999927477 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:17.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.119+0000 7f7dca5b0700 1 --2- 172.21.15.72:0/2999927477 >> v2:172.21.15.72:3300/0 conn(0x7f7dc409f650 0x7f7dc4131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.119+0000 7f7dc9daf700 1 -- 172.21.15.72:0/2999927477 >> v2:172.21.15.72:3300/0 conn(0x7f7dc409f650 msgr2=0x7f7dc4131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.119+0000 7f7dc9daf700 1 --2- 172.21.15.72:0/2999927477 >> v2:172.21.15.72:3300/0 conn(0x7f7dc409f650 0x7f7dc4131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.119+0000 7f7dc9daf700 1 -- 172.21.15.72:0/2999927477 >> v1:172.21.15.72:6789/0 conn(0x7f7dc409f240 legacy=0x7f7dc41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.119+0000 7f7dc9daf700 1 -- 172.21.15.72:0/2999927477 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc409fb60 con 0x7f7dc409e930 2023-10-03T10:13:17.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.119+0000 7f7dc9daf700 1 --2- 172.21.15.72:0/2999927477 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc409e930 0x7f7dc409ed00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00131e0 tx=0x7f7dc00134f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7617624a9a104a69 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.119+0000 7f7dc8dad700 1 -- 172.21.15.72:0/2999927477 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0016070 con 0x7f7dc409e930 2023-10-03T10:13:17.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.119+0000 7f7dc8dad700 1 -- 172.21.15.72:0/2999927477 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc0013d80 con 0x7f7dc409e930 2023-10-03T10:13:17.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.119+0000 7f7dc8dad700 1 -- 172.21.15.72:0/2999927477 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc00112f0 con 0x7f7dc409e930 2023-10-03T10:13:17.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.120+0000 7f7dcc013700 1 -- 172.21.15.72:0/2999927477 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc409e930 msgr2=0x7f7dc409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.120+0000 7f7dcc013700 1 --2- 172.21.15.72:0/2999927477 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc409e930 0x7f7dc409ed00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00131e0 tx=0x7f7dc00134f0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.120+0000 7f7dcc013700 1 -- 172.21.15.72:0/2999927477 shutdown_connections 2023-10-03T10:13:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.120+0000 7f7dcc013700 1 --2- 172.21.15.72:0/2999927477 >> v2:172.21.15.72:3300/0 conn(0x7f7dc409f650 0x7f7dc4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.120+0000 7f7dcc013700 1 --2- 172.21.15.72:0/2999927477 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc409e930 0x7f7dc409ed00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.120+0000 7f7dcc013700 1 -- 172.21.15.72:0/2999927477 >> 172.21.15.72:0/2999927477 conn(0x7f7dc40a4210 msgr2=0x7f7dc40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.120+0000 7f7dcc013700 1 -- 172.21.15.72:0/2999927477 shutdown_connections 2023-10-03T10:13:17.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.120+0000 7f7dcc013700 1 -- 172.21.15.72:0/2999927477 wait complete. 2023-10-03T10:13:17.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.122+0000 7f7dcc013700 1 Processor -- start 2023-10-03T10:13:17.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.122+0000 7f7dcc013700 1 -- start start 2023-10-03T10:13:17.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.122+0000 7f7dcc013700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dc409e930 0x7f7dc41a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.122+0000 7f7dcc013700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc409f240 0x7f7dc41a20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.122+0000 7f7dcc013700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc409f650 0x7f7dc41a2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.122+0000 7f7dcc013700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc41a6090 con 0x7f7dc409e930 2023-10-03T10:13:17.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.122+0000 7f7dcc013700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc41a56d0 con 0x7f7dc409f240 2023-10-03T10:13:17.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.122+0000 7f7dcc013700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc40a3460 con 0x7f7dc409f650 2023-10-03T10:13:17.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.122+0000 7f7dc95ae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc409f240 0x7f7dc41a20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.122+0000 7f7dc95ae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc409f240 0x7f7dc41a20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46582/0 (socket says 172.21.15.72:46582) 2023-10-03T10:13:17.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.123+0000 7f7dc95ae700 1 -- 172.21.15.72:0/2072197107 learned_addr learned my addr 172.21.15.72:0/2072197107 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:17.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.123+0000 7f7dca5b0700 1 --2- 172.21.15.72:0/2072197107 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc409f650 0x7f7dc41a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.123+0000 7f7dc9daf700 1 --2- 172.21.15.72:0/2072197107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dc409e930 0x7f7dc41a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.123+0000 7f7dc95ae700 1 -- 172.21.15.72:0/2072197107 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc409f650 msgr2=0x7f7dc41a2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.123+0000 7f7dc95ae700 1 --2- 172.21.15.72:0/2072197107 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc409f650 0x7f7dc41a2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.123+0000 7f7dc95ae700 1 -- 172.21.15.72:0/2072197107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dc409e930 msgr2=0x7f7dc41a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.123+0000 7f7dc95ae700 1 --2- 172.21.15.72:0/2072197107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dc409e930 0x7f7dc41a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.123+0000 7f7dc95ae700 1 -- 172.21.15.72:0/2072197107 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc0011df0 con 0x7f7dc409f240 2023-10-03T10:13:17.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.123+0000 7f7dc95ae700 1 --2- 172.21.15.72:0/2072197107 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc409f240 0x7f7dc41a20f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7db400c4e0 tx=0x7f7db400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.123+0000 7f7dba7fc700 1 -- 172.21.15.72:0/2072197107 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db40052d0 con 0x7f7dc409f240 2023-10-03T10:13:17.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.123+0000 7f7dba7fc700 1 -- 172.21.15.72:0/2072197107 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db4005430 con 0x7f7dc409f240 2023-10-03T10:13:17.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.123+0000 7f7dba7fc700 1 -- 172.21.15.72:0/2072197107 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db40038c0 con 0x7f7dc409f240 2023-10-03T10:13:17.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.123+0000 7f7dcc013700 1 -- 172.21.15.72:0/2072197107 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc40a0190 con 0x7f7dc409f240 2023-10-03T10:13:17.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.123+0000 7f7dcc013700 1 -- 172.21.15.72:0/2072197107 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc41a4a70 con 0x7f7dc409f240 2023-10-03T10:13:17.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.124+0000 7f7dba7fc700 1 -- 172.21.15.72:0/2072197107 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7db4003a20 con 0x7f7dc409f240 2023-10-03T10:13:17.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.124+0000 7f7dba7fc700 1 -- 172.21.15.72:0/2072197107 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7db403e8b0 con 0x7f7dc409f240 2023-10-03T10:13:17.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.125+0000 7f7dcc013700 1 -- 172.21.15.72:0/2072197107 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc41a4a10 con 0x7f7dc409f240 2023-10-03T10:13:17.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.134+0000 7f7dba7fc700 1 -- 172.21.15.72:0/2072197107 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7db4011590 con 0x7f7dc409f240 2023-10-03T10:13:17.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.173+0000 7eff646eb700 1 Processor -- start 2023-10-03T10:13:17.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.173+0000 7eff646eb700 1 -- start start 2023-10-03T10:13:17.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff646eb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff5c09e1d0 0x7eff5c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff646eb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff5c139170 0x7eff5c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff646eb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5c09b120 con 0x7eff5c09d6f0 2023-10-03T10:13:17.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff646eb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5c06b460 con 0x7eff5c139170 2023-10-03T10:13:17.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff646eb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c09a7e0 con 0x7eff5c09e1d0 2023-10-03T10:13:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff61c86700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff5c09e1d0 0x7eff5c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff61c86700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff5c09e1d0 0x7eff5c138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37926/0 (socket says 172.21.15.72:37926) 2023-10-03T10:13:17.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff61c86700 1 -- 172.21.15.72:0/1478934167 learned_addr learned my addr 172.21.15.72:0/1478934167 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff62c88700 1 --2- 172.21.15.72:0/1478934167 >> v2:172.21.15.72:3300/0 conn(0x7eff5c139170 0x7eff5c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff61c86700 1 -- 172.21.15.72:0/1478934167 >> v2:172.21.15.72:3300/0 conn(0x7eff5c139170 msgr2=0x7eff5c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff61c86700 1 --2- 172.21.15.72:0/1478934167 >> v2:172.21.15.72:3300/0 conn(0x7eff5c139170 0x7eff5c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff61c86700 1 -- 172.21.15.72:0/1478934167 >> v1:172.21.15.72:6789/0 conn(0x7eff5c09d6f0 legacy=0x7eff5c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff61c86700 1 -- 172.21.15.72:0/1478934167 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c09a500 con 0x7eff5c09e1d0 2023-10-03T10:13:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff61c86700 1 --2- 172.21.15.72:0/1478934167 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff5c09e1d0 0x7eff5c138c30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009920 tx=0x7eff4c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7353078cd310928 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff61485700 1 -- 172.21.15.72:0/1478934167 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c011830 con 0x7eff5c09e1d0 2023-10-03T10:13:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff61485700 1 -- 172.21.15.72:0/1478934167 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c011990 con 0x7eff5c09e1d0 2023-10-03T10:13:17.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.174+0000 7eff61485700 1 -- 172.21.15.72:0/1478934167 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c011d20 con 0x7eff5c09e1d0 2023-10-03T10:13:17.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.175+0000 7eff646eb700 1 -- 172.21.15.72:0/1478934167 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff5c09e1d0 msgr2=0x7eff5c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.175+0000 7eff646eb700 1 --2- 172.21.15.72:0/1478934167 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff5c09e1d0 0x7eff5c138c30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009920 tx=0x7eff4c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:17.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.175+0000 7eff646eb700 1 -- 172.21.15.72:0/1478934167 shutdown_connections 2023-10-03T10:13:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.175+0000 7eff646eb700 1 --2- 172.21.15.72:0/1478934167 >> v2:172.21.15.72:3300/0 conn(0x7eff5c139170 0x7eff5c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.175+0000 7eff646eb700 1 --2- 172.21.15.72:0/1478934167 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff5c09e1d0 0x7eff5c138c30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.176+0000 7eff646eb700 1 -- 172.21.15.72:0/1478934167 >> 172.21.15.72:0/1478934167 conn(0x7eff5c066f50 msgr2=0x7eff5c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.176+0000 7eff646eb700 1 -- 172.21.15.72:0/1478934167 shutdown_connections 2023-10-03T10:13:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.176+0000 7eff646eb700 1 -- 172.21.15.72:0/1478934167 wait complete. 2023-10-03T10:13:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.177+0000 7eff646eb700 1 Processor -- start 2023-10-03T10:13:17.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.177+0000 7eff646eb700 1 -- start start 2023-10-03T10:13:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.177+0000 7eff646eb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5c09d6f0 0x7eff5c11e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff646eb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff5c09e1d0 0x7eff5c11edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff646eb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff5c139170 0x7eff5c11f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff646eb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c121e80 con 0x7eff5c09d6f0 2023-10-03T10:13:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff646eb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c120540 con 0x7eff5c09e1d0 2023-10-03T10:13:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff646eb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0a20b0 con 0x7eff5c139170 2023-10-03T10:13:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff62487700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5c09d6f0 0x7eff5c11e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff62487700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5c09d6f0 0x7eff5c11e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34688/0 (socket says 172.21.15.72:34688) 2023-10-03T10:13:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff62c88700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff5c139170 0x7eff5c11f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff62487700 1 -- 172.21.15.72:0/917401254 learned_addr learned my addr 172.21.15.72:0/917401254 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff61c86700 1 --2- 172.21.15.72:0/917401254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff5c09e1d0 0x7eff5c11edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff62487700 1 -- 172.21.15.72:0/917401254 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff5c139170 msgr2=0x7eff5c11f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff62487700 1 --2- 172.21.15.72:0/917401254 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff5c139170 0x7eff5c11f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff62487700 1 -- 172.21.15.72:0/917401254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff5c09e1d0 msgr2=0x7eff5c11edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff62487700 1 --2- 172.21.15.72:0/917401254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff5c09e1d0 0x7eff5c11edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff62487700 1 -- 172.21.15.72:0/917401254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c009550 con 0x7eff5c09d6f0 2023-10-03T10:13:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff61c86700 1 --2- 172.21.15.72:0/917401254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff5c09e1d0 0x7eff5c11edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:17.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.178+0000 7eff62487700 1 --2- 172.21.15.72:0/917401254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5c09d6f0 0x7eff5c11e890 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7eff5800c4e0 tx=0x7eff5800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.179+0000 7eff52ffd700 1 -- 172.21.15.72:0/917401254 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff580052d0 con 0x7eff5c09d6f0 2023-10-03T10:13:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.179+0000 7eff52ffd700 1 -- 172.21.15.72:0/917401254 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff58005430 con 0x7eff5c09d6f0 2023-10-03T10:13:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.179+0000 7eff646eb700 1 -- 172.21.15.72:0/917401254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5c120c90 con 0x7eff5c09d6f0 2023-10-03T10:13:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.179+0000 7eff52ffd700 1 -- 172.21.15.72:0/917401254 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff580038c0 con 0x7eff5c09d6f0 2023-10-03T10:13:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.179+0000 7eff646eb700 1 -- 172.21.15.72:0/917401254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5c1228b0 con 0x7eff5c09d6f0 2023-10-03T10:13:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.180+0000 7eff52ffd700 1 -- 172.21.15.72:0/917401254 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff58003a20 con 0x7eff5c09d6f0 2023-10-03T10:13:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.180+0000 7eff52ffd700 1 -- 172.21.15.72:0/917401254 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7eff58040a70 con 0x7eff5c09d6f0 2023-10-03T10:13:17.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.181+0000 7eff646eb700 1 -- 172.21.15.72:0/917401254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5c074ea0 con 0x7eff5c09d6f0 2023-10-03T10:13:17.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.187+0000 7eff52ffd700 1 -- 172.21.15.72:0/917401254 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff58017020 con 0x7eff5c09d6f0 2023-10-03T10:13:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.195+0000 7f9924f83700 1 Processor -- start 2023-10-03T10:13:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.195+0000 7f9924f83700 1 -- start start 2023-10-03T10:13:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.196+0000 7f9924f83700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f992006cc90 0x7f99200a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.196+0000 7f9924f83700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f99200a0f70 0x7f99200a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.196+0000 7f9924f83700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99200a1e00 con 0x7f992013c120 2023-10-03T10:13:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.196+0000 7f9924f83700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992006d060 con 0x7f99200a0f70 2023-10-03T10:13:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.196+0000 7f9924f83700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99200a2550 con 0x7f992006cc90 2023-10-03T10:13:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.196+0000 7f991e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f992006cc90 0x7f99200a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.196+0000 7f991e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f992006cc90 0x7f99200a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46598/0 (socket says 172.21.15.72:46598) 2023-10-03T10:13:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.196+0000 7f991e59c700 1 -- 172.21.15.72:0/3401300296 learned_addr learned my addr 172.21.15.72:0/3401300296 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.196+0000 7f991dd9b700 1 --2- 172.21.15.72:0/3401300296 >> v2:172.21.15.72:3300/0 conn(0x7f99200a0f70 0x7f99200a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.196+0000 7f991d59a700 1 -- 172.21.15.72:0/3401300296 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047051360 0 0) 0x7f99200a1e00 con 0x7f992013c120 2023-10-03T10:13:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.196+0000 7f991d59a700 1 -- 172.21.15.72:0/3401300296 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99080035b0 con 0x7f992013c120 2023-10-03T10:13:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.196+0000 7f991dd9b700 1 -- 172.21.15.72:0/3401300296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f992006cc90 msgr2=0x7f99200a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.196+0000 7f991dd9b700 1 --2- 172.21.15.72:0/3401300296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f992006cc90 0x7f99200a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.196+0000 7f991dd9b700 1 -- 172.21.15.72:0/3401300296 >> v1:172.21.15.72:6789/0 conn(0x7f992013c120 legacy=0x7f992013e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.196+0000 7f991dd9b700 1 -- 172.21.15.72:0/3401300296 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992009cfa0 con 0x7f99200a0f70 2023-10-03T10:13:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.197+0000 7f991dd9b700 1 --2- 172.21.15.72:0/3401300296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99200a0f70 0x7f99200a13e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9914009840 tx=0x7f9914009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c0a77681646dd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.197+0000 7f991d59a700 1 -- 172.21.15.72:0/3401300296 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914011830 con 0x7f99200a0f70 2023-10-03T10:13:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.197+0000 7f991d59a700 1 -- 172.21.15.72:0/3401300296 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9914011990 con 0x7f99200a0f70 2023-10-03T10:13:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.197+0000 7f991d59a700 1 -- 172.21.15.72:0/3401300296 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914011d20 con 0x7f99200a0f70 2023-10-03T10:13:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.197+0000 7f9924f83700 1 -- 172.21.15.72:0/3401300296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99200a0f70 msgr2=0x7f99200a13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.197+0000 7f9924f83700 1 --2- 172.21.15.72:0/3401300296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99200a0f70 0x7f99200a13e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9914009840 tx=0x7f9914009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.198+0000 7f9924f83700 1 -- 172.21.15.72:0/3401300296 shutdown_connections 2023-10-03T10:13:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.198+0000 7f9924f83700 1 --2- 172.21.15.72:0/3401300296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f992006cc90 0x7f99200a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.198+0000 7f9924f83700 1 --2- 172.21.15.72:0/3401300296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99200a0f70 0x7f99200a13e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.198+0000 7f9924f83700 1 -- 172.21.15.72:0/3401300296 >> 172.21.15.72:0/3401300296 conn(0x7f99200a3050 msgr2=0x7f99200a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.198+0000 7f9924f83700 1 -- 172.21.15.72:0/3401300296 shutdown_connections 2023-10-03T10:13:17.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.198+0000 7f9924f83700 1 -- 172.21.15.72:0/3401300296 wait complete. 2023-10-03T10:13:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.199+0000 7f9924f83700 1 Processor -- start 2023-10-03T10:13:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.199+0000 7f9924f83700 1 -- start start 2023-10-03T10:13:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.200+0000 7f9924f83700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f992006cc90 0x7f99201cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.200+0000 7f9924f83700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99200a0f70 0x7f99201ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.200+0000 7f9924f83700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f992013c120 0x7f99201cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.200+0000 7f9924f83700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99201281d0 con 0x7f992013c120 2023-10-03T10:13:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.200+0000 7f9924f83700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9920127fe0 con 0x7f992006cc90 2023-10-03T10:13:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.200+0000 7f9924f83700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9920128f60 con 0x7f99200a0f70 2023-10-03T10:13:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.200+0000 7f991e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f992006cc90 0x7f99201cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.200+0000 7f991e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f992006cc90 0x7f99201cc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46610/0 (socket says 172.21.15.72:46610) 2023-10-03T10:13:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.200+0000 7f991e59c700 1 -- 172.21.15.72:0/1662852250 learned_addr learned my addr 172.21.15.72:0/1662852250 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.200+0000 7f991ed9d700 1 --2- 172.21.15.72:0/1662852250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f992013c120 0x7f99201cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.200+0000 7f991e59c700 1 -- 172.21.15.72:0/1662852250 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99200a0f70 msgr2=0x7f99201ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.200+0000 7f991e59c700 1 --2- 172.21.15.72:0/1662852250 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99200a0f70 0x7f99201ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.200+0000 7f991e59c700 1 -- 172.21.15.72:0/1662852250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f992013c120 msgr2=0x7f99201cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.200+0000 7f991e59c700 1 --2- 172.21.15.72:0/1662852250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f992013c120 0x7f99201cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.200+0000 7f991e59c700 1 -- 172.21.15.72:0/1662852250 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99140094a0 con 0x7f992006cc90 2023-10-03T10:13:17.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.201+0000 7f991e59c700 1 --2- 172.21.15.72:0/1662852250 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f992006cc90 0x7f99201cc5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f991000e8e0 tx=0x7f991000ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:17.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.201+0000 7f990effd700 1 -- 172.21.15.72:0/1662852250 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910013680 con 0x7f992006cc90 2023-10-03T10:13:17.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.201+0000 7f990effd700 1 -- 172.21.15.72:0/1662852250 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99100137e0 con 0x7f992006cc90 2023-10-03T10:13:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.201+0000 7f9924f83700 1 -- 172.21.15.72:0/1662852250 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9920129ef0 con 0x7f992006cc90 2023-10-03T10:13:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.201+0000 7f990effd700 1 -- 172.21.15.72:0/1662852250 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910013b90 con 0x7f992006cc90 2023-10-03T10:13:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.201+0000 7f9924f83700 1 -- 172.21.15.72:0/1662852250 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992009f950 con 0x7f992006cc90 2023-10-03T10:13:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.202+0000 7f990effd700 1 -- 172.21.15.72:0/1662852250 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9910013cf0 con 0x7f992006cc90 2023-10-03T10:13:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.202+0000 7f990effd700 1 -- 172.21.15.72:0/1662852250 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f991003f6e0 con 0x7f992006cc90 2023-10-03T10:13:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.202+0000 7f9924f83700 1 -- 172.21.15.72:0/1662852250 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920071e20 con 0x7f992006cc90 2023-10-03T10:13:17.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.207+0000 7f990effd700 1 -- 172.21.15.72:0/1662852250 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f991001ba00 con 0x7f992006cc90 2023-10-03T10:13:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.287+0000 7f99a3a21700 1 -- 172.21.15.72:0/1120752789 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f997c005590 con 0x7f999c139030 2023-10-03T10:13:17.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.288+0000 7f9991ffb700 1 -- 172.21.15.72:0/1120752789 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9994036090 con 0x7f999c139030 2023-10-03T10:13:17.287 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.290+0000 7f99a3a21700 1 -- 172.21.15.72:0/1120752789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f999c139030 msgr2=0x7f999c11b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.290+0000 7f99a3a21700 1 --2- 172.21.15.72:0/1120752789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f999c139030 0x7f999c11b790 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9994014040 tx=0x7f9994004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.290+0000 7f99a3a21700 1 -- 172.21.15.72:0/1120752789 shutdown_connections 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.290+0000 7f99a3a21700 1 --2- 172.21.15.72:0/1120752789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f999c139030 0x7f999c11b790 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.290+0000 7f99a3a21700 1 --2- 172.21.15.72:0/1120752789 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f999c1338a0 0x7f999c11ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.290+0000 7f99a3a21700 1 --2- 172.21.15.72:0/1120752789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f999c136710 0x7f999c11b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.290+0000 7f99a3a21700 1 -- 172.21.15.72:0/1120752789 >> 172.21.15.72:0/1120752789 conn(0x7f999c0a2aa0 msgr2=0x7f999c1344d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.290+0000 7f99a3a21700 1 -- 172.21.15.72:0/1120752789 shutdown_connections 2023-10-03T10:13:17.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.290+0000 7f99a3a21700 1 -- 172.21.15.72:0/1120752789 wait complete. 2023-10-03T10:13:17.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:17.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.385+0000 7f7dcc013700 1 -- 172.21.15.72:0/2072197107 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7dc41a5250 con 0x7f7dc409f240 2023-10-03T10:13:17.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.385+0000 7f7dba7fc700 1 -- 172.21.15.72:0/2072197107 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7dc41a5250 con 0x7f7dc409f240 2023-10-03T10:13:17.385 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.387+0000 7f7dcc013700 1 -- 172.21.15.72:0/2072197107 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc409f240 msgr2=0x7f7dc41a20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.387+0000 7f7dcc013700 1 --2- 172.21.15.72:0/2072197107 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc409f240 0x7f7dc41a20f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7db400c4e0 tx=0x7f7db400c7f0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.387+0000 7f7dcc013700 1 -- 172.21.15.72:0/2072197107 shutdown_connections 2023-10-03T10:13:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.387+0000 7f7dcc013700 1 --2- 172.21.15.72:0/2072197107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dc409e930 0x7f7dc41a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.387+0000 7f7dcc013700 1 --2- 172.21.15.72:0/2072197107 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc409f650 0x7f7dc41a2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.387+0000 7f7dcc013700 1 --2- 172.21.15.72:0/2072197107 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc409f240 0x7f7dc41a20f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.388+0000 7f7dcc013700 1 -- 172.21.15.72:0/2072197107 >> 172.21.15.72:0/2072197107 conn(0x7f7dc40a4210 msgr2=0x7f7dc41b6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.388+0000 7f7dcc013700 1 -- 172.21.15.72:0/2072197107 shutdown_connections 2023-10-03T10:13:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.388+0000 7f7dcc013700 1 -- 172.21.15.72:0/2072197107 wait complete. 2023-10-03T10:13:17.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:17.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.404+0000 7f9924f83700 1 -- 172.21.15.72:0/1662852250 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9920128870 con 0x7f992006cc90 2023-10-03T10:13:17.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.404+0000 7f990effd700 1 -- 172.21.15.72:0/1662852250 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9920128870 con 0x7f992006cc90 2023-10-03T10:13:17.404 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:17.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.406+0000 7f9924f83700 1 -- 172.21.15.72:0/1662852250 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f992006cc90 msgr2=0x7f99201cc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.406+0000 7f9924f83700 1 --2- 172.21.15.72:0/1662852250 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f992006cc90 0x7f99201cc5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f991000e8e0 tx=0x7f991000ebf0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.406+0000 7f9924f83700 1 -- 172.21.15.72:0/1662852250 shutdown_connections 2023-10-03T10:13:17.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.406+0000 7f9924f83700 1 --2- 172.21.15.72:0/1662852250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f992013c120 0x7f99201cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.406+0000 7f9924f83700 1 --2- 172.21.15.72:0/1662852250 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f992006cc90 0x7f99201cc5a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.406+0000 7f9924f83700 1 --2- 172.21.15.72:0/1662852250 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99200a0f70 0x7f99201ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.406+0000 7f9924f83700 1 -- 172.21.15.72:0/1662852250 >> 172.21.15.72:0/1662852250 conn(0x7f99200a3050 msgr2=0x7f992013b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.406+0000 7f9924f83700 1 -- 172.21.15.72:0/1662852250 shutdown_connections 2023-10-03T10:13:17.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.406+0000 7f9924f83700 1 -- 172.21.15.72:0/1662852250 wait complete. 2023-10-03T10:13:17.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:17.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.421+0000 7eff646eb700 1 -- 172.21.15.72:0/917401254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7eff5c09c6e0 con 0x7eff5c09d6f0 2023-10-03T10:13:17.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.421+0000 7eff52ffd700 1 -- 172.21.15.72:0/917401254 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff58044060 con 0x7eff5c09d6f0 2023-10-03T10:13:17.421 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:17.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.423+0000 7eff646eb700 1 -- 172.21.15.72:0/917401254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5c09d6f0 msgr2=0x7eff5c11e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:17.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.423+0000 7eff646eb700 1 --2- 172.21.15.72:0/917401254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5c09d6f0 0x7eff5c11e890 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7eff5800c4e0 tx=0x7eff5800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.423+0000 7eff646eb700 1 -- 172.21.15.72:0/917401254 shutdown_connections 2023-10-03T10:13:17.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.423+0000 7eff646eb700 1 --2- 172.21.15.72:0/917401254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff5c09d6f0 0x7eff5c11e890 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.423+0000 7eff646eb700 1 --2- 172.21.15.72:0/917401254 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff5c139170 0x7eff5c11f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.423+0000 7eff646eb700 1 --2- 172.21.15.72:0/917401254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff5c09e1d0 0x7eff5c11edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:17.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.423+0000 7eff646eb700 1 -- 172.21.15.72:0/917401254 >> 172.21.15.72:0/917401254 conn(0x7eff5c066f50 msgr2=0x7eff5c136c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:17.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.423+0000 7eff646eb700 1 -- 172.21.15.72:0/917401254 shutdown_connections 2023-10-03T10:13:17.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:17.423+0000 7eff646eb700 1 -- 172.21.15.72:0/917401254 wait complete. 2023-10-03T10:13:17.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:18.303 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:18.400 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:18.418 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:18.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.433+0000 7efcc1934700 1 Processor -- start 2023-10-03T10:13:18.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.433+0000 7efcc1934700 1 -- start start 2023-10-03T10:13:18.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcc1934700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcbc09e1d0 0x7efcbc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcc1934700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcbc139170 0x7efcbc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcc1934700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcbc09b120 con 0x7efcbc09d6f0 2023-10-03T10:13:18.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcc1934700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc06b460 con 0x7efcbc09e1d0 2023-10-03T10:13:18.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcc1934700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc09a7e0 con 0x7efcbc139170 2023-10-03T10:13:18.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcba7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcbc09e1d0 0x7efcbc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcbb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcbc139170 0x7efcbc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcba7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcbc09e1d0 0x7efcbc138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38522/0 (socket says 172.21.15.72:38522) 2023-10-03T10:13:18.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcbaffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efcbc09d6f0 0x7efcbc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60064/0 (socket says 172.21.15.72:60064) 2023-10-03T10:13:18.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcbb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcbc139170 0x7efcbc13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40618/0 (socket says 172.21.15.72:40618) 2023-10-03T10:13:18.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcba7fc700 1 -- 172.21.15.72:0/2379588106 learned_addr learned my addr 172.21.15.72:0/2379588106 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:18.435 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:18.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcba7fc700 1 -- 172.21.15.72:0/2379588106 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcbc139170 msgr2=0x7efcbc13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcba7fc700 1 --2- 172.21.15.72:0/2379588106 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcbc139170 0x7efcbc13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcba7fc700 1 -- 172.21.15.72:0/2379588106 >> v1:172.21.15.72:6789/0 conn(0x7efcbc09d6f0 legacy=0x7efcbc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcb9ffb700 1 -- 172.21.15.72:0/2379588106 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339708228 0 0) 0x7efcbc09b120 con 0x7efcbc09d6f0 2023-10-03T10:13:18.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcba7fc700 1 -- 172.21.15.72:0/2379588106 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc09a500 con 0x7efcbc09e1d0 2023-10-03T10:13:18.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.434+0000 7efcbb7fe700 1 --2- 172.21.15.72:0/2379588106 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcbc139170 0x7efcbc13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:18.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.435+0000 7efcba7fc700 1 --2- 172.21.15.72:0/2379588106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcbc09e1d0 0x7efcbc138c30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009920 tx=0x7efcb0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45ab5de354959aad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.435+0000 7efcb9ffb700 1 -- 172.21.15.72:0/2379588106 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0011830 con 0x7efcbc09e1d0 2023-10-03T10:13:18.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.435+0000 7efcb9ffb700 1 -- 172.21.15.72:0/2379588106 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb0011990 con 0x7efcbc09e1d0 2023-10-03T10:13:18.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.435+0000 7efcb9ffb700 1 -- 172.21.15.72:0/2379588106 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0011d20 con 0x7efcbc09e1d0 2023-10-03T10:13:18.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.435+0000 7efcc1934700 1 -- 172.21.15.72:0/2379588106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcbc09e1d0 msgr2=0x7efcbc138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.435+0000 7efcc1934700 1 --2- 172.21.15.72:0/2379588106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcbc09e1d0 0x7efcbc138c30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009920 tx=0x7efcb0009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:18.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.435+0000 7efcc1934700 1 -- 172.21.15.72:0/2379588106 shutdown_connections 2023-10-03T10:13:18.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.435+0000 7efcc1934700 1 --2- 172.21.15.72:0/2379588106 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcbc139170 0x7efcbc13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.435+0000 7efcc1934700 1 --2- 172.21.15.72:0/2379588106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcbc09e1d0 0x7efcbc138c30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.435+0000 7efcc1934700 1 -- 172.21.15.72:0/2379588106 >> 172.21.15.72:0/2379588106 conn(0x7efcbc066f50 msgr2=0x7efcbc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.436+0000 7efcc1934700 1 -- 172.21.15.72:0/2379588106 shutdown_connections 2023-10-03T10:13:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.436+0000 7efcc1934700 1 -- 172.21.15.72:0/2379588106 wait complete. 2023-10-03T10:13:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.436+0000 7efcc1934700 1 Processor -- start 2023-10-03T10:13:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.437+0000 7efcc1934700 1 -- start start 2023-10-03T10:13:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.437+0000 7efcc1934700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcbc09d6f0 0x7efcbc11e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.437+0000 7efcc1934700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcbc09e1d0 0x7efcbc11ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.437+0000 7efcc1934700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcbc139170 0x7efcbc11f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.437+0000 7efcc1934700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc1222b0 con 0x7efcbc09d6f0 2023-10-03T10:13:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.437+0000 7efcc1934700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc09c710 con 0x7efcbc139170 2023-10-03T10:13:18.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.437+0000 7efcc1934700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0a2080 con 0x7efcbc09e1d0 2023-10-03T10:13:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.437+0000 7efcba7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcbc09e1d0 0x7efcbc11ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.437+0000 7efcba7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcbc09e1d0 0x7efcbc11ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40620/0 (socket says 172.21.15.72:40620) 2023-10-03T10:13:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.437+0000 7efcba7fc700 1 -- 172.21.15.72:0/1748426184 learned_addr learned my addr 172.21.15.72:0/1748426184 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.437+0000 7efcbaffd700 1 --2- 172.21.15.72:0/1748426184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcbc09d6f0 0x7efcbc11e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.437+0000 7efcbb7fe700 1 --2- 172.21.15.72:0/1748426184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcbc139170 0x7efcbc11f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.438+0000 7efcbb7fe700 1 -- 172.21.15.72:0/1748426184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcbc09e1d0 msgr2=0x7efcbc11ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.438+0000 7efcbb7fe700 1 --2- 172.21.15.72:0/1748426184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcbc09e1d0 0x7efcbc11ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.438+0000 7efcbb7fe700 1 -- 172.21.15.72:0/1748426184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcbc09d6f0 msgr2=0x7efcbc11e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.438+0000 7efcbb7fe700 1 --2- 172.21.15.72:0/1748426184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcbc09d6f0 0x7efcbc11e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.438+0000 7efcbb7fe700 1 -- 172.21.15.72:0/1748426184 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb4009a70 con 0x7efcbc139170 2023-10-03T10:13:18.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.438+0000 7efcba7fc700 1 --2- 172.21.15.72:0/1748426184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcbc09e1d0 0x7efcbc11ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:18.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.438+0000 7efcbaffd700 1 --2- 172.21.15.72:0/1748426184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcbc09d6f0 0x7efcbc11e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:18.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.438+0000 7efcbb7fe700 1 --2- 172.21.15.72:0/1748426184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcbc139170 0x7efcbc11f2a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efcb400efc0 tx=0x7efcb400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.438+0000 7efca3fff700 1 -- 172.21.15.72:0/1748426184 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb400ca90 con 0x7efcbc139170 2023-10-03T10:13:18.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.438+0000 7efcc1934700 1 -- 172.21.15.72:0/1748426184 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb0009550 con 0x7efcbc139170 2023-10-03T10:13:18.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.438+0000 7efcc1934700 1 -- 172.21.15.72:0/1748426184 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcbc121d10 con 0x7efcbc139170 2023-10-03T10:13:18.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.438+0000 7efca3fff700 1 -- 172.21.15.72:0/1748426184 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb400f040 con 0x7efcbc139170 2023-10-03T10:13:18.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.438+0000 7efca3fff700 1 -- 172.21.15.72:0/1748426184 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb400cdf0 con 0x7efcbc139170 2023-10-03T10:13:18.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.439+0000 7efca3fff700 1 -- 172.21.15.72:0/1748426184 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efcb4003a20 con 0x7efcbc139170 2023-10-03T10:13:18.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.439+0000 7efcc1934700 1 -- 172.21.15.72:0/1748426184 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9c0052e0 con 0x7efcbc139170 2023-10-03T10:13:18.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.439+0000 7efca3fff700 1 -- 172.21.15.72:0/1748426184 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efcb403fbe0 con 0x7efcbc139170 2023-10-03T10:13:18.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.445+0000 7efca3fff700 1 -- 172.21.15.72:0/1748426184 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcb4012340 con 0x7efcbc139170 2023-10-03T10:13:18.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.548+0000 7fc735211700 1 Processor -- start 2023-10-03T10:13:18.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.548+0000 7fc735211700 1 -- start start 2023-10-03T10:13:18.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.548+0000 7fc735211700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc73009d6f0 0x7fc73009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.548+0000 7fc735211700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc73009e410 0x7fc730134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.548+0000 7fc735211700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73009b120 con 0x7fc73009e000 2023-10-03T10:13:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.548+0000 7fc735211700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc73006b460 con 0x7fc73009e410 2023-10-03T10:13:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.548+0000 7fc735211700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc73009a7e0 con 0x7fc73009d6f0 2023-10-03T10:13:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.548+0000 7fc72ed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc73009d6f0 0x7fc73009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.548+0000 7fc72ed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc73009d6f0 0x7fc73009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40622/0 (socket says 172.21.15.72:40622) 2023-10-03T10:13:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.548+0000 7fc72ed9d700 1 -- 172.21.15.72:0/3129588296 learned_addr learned my addr 172.21.15.72:0/3129588296 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.548+0000 7fc72f59e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc73009e410 0x7fc730134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.549+0000 7fc72ed9d700 1 -- 172.21.15.72:0/3129588296 >> v2:172.21.15.72:3300/0 conn(0x7fc73009e410 msgr2=0x7fc730134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.549+0000 7fc72ed9d700 1 --2- 172.21.15.72:0/3129588296 >> v2:172.21.15.72:3300/0 conn(0x7fc73009e410 0x7fc730134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.549+0000 7fc72ed9d700 1 -- 172.21.15.72:0/3129588296 >> v1:172.21.15.72:6789/0 conn(0x7fc73009e000 legacy=0x7fc7301339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.549+0000 7fc72ed9d700 1 -- 172.21.15.72:0/3129588296 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73009a500 con 0x7fc73009d6f0 2023-10-03T10:13:18.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.549+0000 7fc72ed9d700 1 --2- 172.21.15.72:0/3129588296 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc73009d6f0 0x7fc73009dac0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc720009920 tx=0x7fc720009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ba6f4356d3c632b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.549+0000 7fc72dd9b700 1 -- 172.21.15.72:0/3129588296 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc720004230 con 0x7fc73009d6f0 2023-10-03T10:13:18.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.549+0000 7fc72dd9b700 1 -- 172.21.15.72:0/3129588296 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc720004390 con 0x7fc73009d6f0 2023-10-03T10:13:18.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.549+0000 7fc72dd9b700 1 -- 172.21.15.72:0/3129588296 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7200036a0 con 0x7fc73009d6f0 2023-10-03T10:13:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.550+0000 7fc735211700 1 -- 172.21.15.72:0/3129588296 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc73009d6f0 msgr2=0x7fc73009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.550+0000 7fc735211700 1 --2- 172.21.15.72:0/3129588296 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc73009d6f0 0x7fc73009dac0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc720009920 tx=0x7fc720009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.550+0000 7fc735211700 1 -- 172.21.15.72:0/3129588296 shutdown_connections 2023-10-03T10:13:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.550+0000 7fc735211700 1 --2- 172.21.15.72:0/3129588296 >> v2:172.21.15.72:3300/0 conn(0x7fc73009e410 0x7fc730134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.550+0000 7fc735211700 1 --2- 172.21.15.72:0/3129588296 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc73009d6f0 0x7fc73009dac0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.550+0000 7fc735211700 1 -- 172.21.15.72:0/3129588296 >> 172.21.15.72:0/3129588296 conn(0x7fc730066f50 msgr2=0x7fc73009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.550+0000 7fc735211700 1 -- 172.21.15.72:0/3129588296 shutdown_connections 2023-10-03T10:13:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.550+0000 7fc735211700 1 -- 172.21.15.72:0/3129588296 wait complete. 2023-10-03T10:13:18.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.551+0000 7fc735211700 1 Processor -- start 2023-10-03T10:13:18.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.552+0000 7fc735211700 1 -- start start 2023-10-03T10:13:18.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.552+0000 7fc735211700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc73009d6f0 0x7fc7301a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.552+0000 7fc735211700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc73009e000 0x7fc7301a6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.552+0000 7fc735211700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc73009e410 0x7fc7301a69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.552+0000 7fc735211700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7301a91d0 con 0x7fc73009e410 2023-10-03T10:13:18.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.552+0000 7fc735211700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73009c710 con 0x7fc73009d6f0 2023-10-03T10:13:18.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.552+0000 7fc735211700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7300a3210 con 0x7fc73009e000 2023-10-03T10:13:18.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.552+0000 7fc72ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc73009d6f0 0x7fc7301a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.552+0000 7fc72ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc73009d6f0 0x7fc7301a5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38548/0 (socket says 172.21.15.72:38548) 2023-10-03T10:13:18.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.552+0000 7fc72ed9d700 1 -- 172.21.15.72:0/1216139698 learned_addr learned my addr 172.21.15.72:0/1216139698 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:18.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.552+0000 7fc72e59c700 1 --2- 172.21.15.72:0/1216139698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc73009e000 0x7fc7301a6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.553+0000 7fc72f59e700 1 --2- 172.21.15.72:0/1216139698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc73009e410 0x7fc7301a69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.553+0000 7fc72e59c700 1 -- 172.21.15.72:0/1216139698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc73009d6f0 msgr2=0x7fc7301a5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.553+0000 7fc72e59c700 1 --2- 172.21.15.72:0/1216139698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc73009d6f0 0x7fc7301a5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.553+0000 7fc72e59c700 1 -- 172.21.15.72:0/1216139698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc73009e410 msgr2=0x7fc7301a69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.553+0000 7fc72e59c700 1 --2- 172.21.15.72:0/1216139698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc73009e410 0x7fc7301a69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.553+0000 7fc72e59c700 1 -- 172.21.15.72:0/1216139698 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc720009550 con 0x7fc73009e000 2023-10-03T10:13:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.553+0000 7fc72e59c700 1 --2- 172.21.15.72:0/1216139698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc73009e000 0x7fc7301a6460 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc73006e510 tx=0x7fc72400c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.553+0000 7fc7177fe700 1 -- 172.21.15.72:0/1216139698 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724012620 con 0x7fc73009e000 2023-10-03T10:13:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.553+0000 7fc7177fe700 1 -- 172.21.15.72:0/1216139698 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc724012780 con 0x7fc73009e000 2023-10-03T10:13:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.553+0000 7fc735211700 1 -- 172.21.15.72:0/1216139698 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7301a7b30 con 0x7fc73009e000 2023-10-03T10:13:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.553+0000 7fc7177fe700 1 -- 172.21.15.72:0/1216139698 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724012b30 con 0x7fc73009e000 2023-10-03T10:13:18.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.553+0000 7fc735211700 1 -- 172.21.15.72:0/1216139698 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7301a9f40 con 0x7fc73009e000 2023-10-03T10:13:18.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.554+0000 7fc735211700 1 -- 172.21.15.72:0/1216139698 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc730074ea0 con 0x7fc73009e000 2023-10-03T10:13:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.554+0000 7fc7177fe700 1 -- 172.21.15.72:0/1216139698 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc72401c460 con 0x7fc73009e000 2023-10-03T10:13:18.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.555+0000 7fc7177fe700 1 -- 172.21.15.72:0/1216139698 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc72403f600 con 0x7fc73009e000 2023-10-03T10:13:18.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.563+0000 7fc7177fe700 1 -- 172.21.15.72:0/1216139698 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc72401c710 con 0x7fc73009e000 2023-10-03T10:13:18.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.564+0000 7fc2b4b50700 1 Processor -- start 2023-10-03T10:13:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.565+0000 7fc2b4b50700 1 -- start start 2023-10-03T10:13:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.565+0000 7fc2b4b50700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2b012cf60 0x7fc2b006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.565+0000 7fc2b4b50700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2b0130430 0x7fc2b0137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.565+0000 7fc2b4b50700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b012cd90 con 0x7fc2b012f8b0 2023-10-03T10:13:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.565+0000 7fc2b4b50700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b012d330 con 0x7fc2b012cf60 2023-10-03T10:13:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.565+0000 7fc2b4b50700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b0071780 con 0x7fc2b0130430 2023-10-03T10:13:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.565+0000 7fc2add9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc2b012f8b0 0x7fc2b012fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60086/0 (socket says 172.21.15.72:60086) 2023-10-03T10:13:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.565+0000 7fc2add9b700 1 -- 172.21.15.72:0/2706997512 learned_addr learned my addr 172.21.15.72:0/2706997512 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:18.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.565+0000 7fc2ae59c700 1 --2- 172.21.15.72:0/2706997512 >> v2:172.21.15.72:3300/0 conn(0x7fc2b012cf60 0x7fc2b006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.565+0000 7fc2aed9d700 1 --2- 172.21.15.72:0/2706997512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2b0130430 0x7fc2b0137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.566+0000 7fc2aed9d700 1 -- 172.21.15.72:0/2706997512 >> v2:172.21.15.72:3300/0 conn(0x7fc2b012cf60 msgr2=0x7fc2b006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.566+0000 7fc2aed9d700 1 --2- 172.21.15.72:0/2706997512 >> v2:172.21.15.72:3300/0 conn(0x7fc2b012cf60 0x7fc2b006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.566+0000 7fc2aed9d700 1 -- 172.21.15.72:0/2706997512 >> v1:172.21.15.72:6789/0 conn(0x7fc2b012f8b0 legacy=0x7fc2b012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.566+0000 7fc2aed9d700 1 -- 172.21.15.72:0/2706997512 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b0071a40 con 0x7fc2b0130430 2023-10-03T10:13:18.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.566+0000 7fc2aed9d700 1 --2- 172.21.15.72:0/2706997512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2b0130430 0x7fc2b0137c30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009e10 tx=0x7fc2a800d540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31f05182e92e4f64 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.567+0000 7fc2ad59a700 1 -- 172.21.15.72:0/2706997512 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8011460 con 0x7fc2b0130430 2023-10-03T10:13:18.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.567+0000 7fc2ad59a700 1 -- 172.21.15.72:0/2706997512 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a80115c0 con 0x7fc2b0130430 2023-10-03T10:13:18.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.567+0000 7fc2ad59a700 1 -- 172.21.15.72:0/2706997512 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8011970 con 0x7fc2b0130430 2023-10-03T10:13:18.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.567+0000 7fc2b4b50700 1 -- 172.21.15.72:0/2706997512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2b0130430 msgr2=0x7fc2b0137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.567+0000 7fc2b4b50700 1 --2- 172.21.15.72:0/2706997512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2b0130430 0x7fc2b0137c30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009e10 tx=0x7fc2a800d540 comp rx=0 tx=0).stop 2023-10-03T10:13:18.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.567+0000 7fc2b4b50700 1 -- 172.21.15.72:0/2706997512 shutdown_connections 2023-10-03T10:13:18.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.567+0000 7fc2b4b50700 1 --2- 172.21.15.72:0/2706997512 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2b0130430 0x7fc2b0137c30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.567+0000 7fc2b4b50700 1 --2- 172.21.15.72:0/2706997512 >> v2:172.21.15.72:3300/0 conn(0x7fc2b012cf60 0x7fc2b006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.567+0000 7fc2b4b50700 1 -- 172.21.15.72:0/2706997512 >> 172.21.15.72:0/2706997512 conn(0x7fc2b00a2aa0 msgr2=0x7fc2b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.568+0000 7fc2b4b50700 1 -- 172.21.15.72:0/2706997512 shutdown_connections 2023-10-03T10:13:18.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.568+0000 7fc2b4b50700 1 -- 172.21.15.72:0/2706997512 wait complete. 2023-10-03T10:13:18.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.569+0000 7fc2b4b50700 1 Processor -- start 2023-10-03T10:13:18.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.569+0000 7fc2b4b50700 1 -- start start 2023-10-03T10:13:18.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.569+0000 7fc2b4b50700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2b012cf60 0x7fc2b009bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.569+0000 7fc2b4b50700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2b012f8b0 0x7fc2b009c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.569+0000 7fc2b4b50700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2b0130430 0x7fc2b01c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.569+0000 7fc2b4b50700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b0129b30 con 0x7fc2b012f8b0 2023-10-03T10:13:18.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.569+0000 7fc2b4b50700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b009ba10 con 0x7fc2b012cf60 2023-10-03T10:13:18.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.569+0000 7fc2b4b50700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b012da40 con 0x7fc2b0130430 2023-10-03T10:13:18.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.569+0000 7fc2add9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2b012f8b0 0x7fc2b009c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.569+0000 7fc2add9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2b012f8b0 0x7fc2b009c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43648/0 (socket says 172.21.15.72:43648) 2023-10-03T10:13:18.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.569+0000 7fc2add9b700 1 -- 172.21.15.72:0/2081120731 learned_addr learned my addr 172.21.15.72:0/2081120731 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:18.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.569+0000 7fc2aed9d700 1 --2- 172.21.15.72:0/2081120731 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2b0130430 0x7fc2b01c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.570+0000 7fc2aed9d700 1 -- 172.21.15.72:0/2081120731 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2b012cf60 msgr2=0x7fc2b009bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.570+0000 7fc2aed9d700 1 --2- 172.21.15.72:0/2081120731 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2b012cf60 0x7fc2b009bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.570+0000 7fc2aed9d700 1 -- 172.21.15.72:0/2081120731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2b012f8b0 msgr2=0x7fc2b009c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.570+0000 7fc2aed9d700 1 --2- 172.21.15.72:0/2081120731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2b012f8b0 0x7fc2b009c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.570+0000 7fc2aed9d700 1 -- 172.21.15.72:0/2081120731 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a8009a70 con 0x7fc2b0130430 2023-10-03T10:13:18.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.570+0000 7fc2aed9d700 1 --2- 172.21.15.72:0/2081120731 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2b0130430 0x7fc2b01c3dd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8018000 tx=0x7fc2a8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.570+0000 7fc29effd700 1 -- 172.21.15.72:0/2081120731 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8020070 con 0x7fc2b0130430 2023-10-03T10:13:18.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.570+0000 7fc29effd700 1 -- 172.21.15.72:0/2081120731 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a8011d20 con 0x7fc2b0130430 2023-10-03T10:13:18.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.570+0000 7fc29effd700 1 -- 172.21.15.72:0/2081120731 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8011460 con 0x7fc2b0130430 2023-10-03T10:13:18.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.570+0000 7fc2b4b50700 1 -- 172.21.15.72:0/2081120731 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b0129fa0 con 0x7fc2b0130430 2023-10-03T10:13:18.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.570+0000 7fc2b4b50700 1 -- 172.21.15.72:0/2081120731 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b0119220 con 0x7fc2b0130430 2023-10-03T10:13:18.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.571+0000 7fc2b4b50700 1 -- 172.21.15.72:0/2081120731 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b0074ea0 con 0x7fc2b0130430 2023-10-03T10:13:18.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.572+0000 7fc29effd700 1 -- 172.21.15.72:0/2081120731 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2a80042a0 con 0x7fc2b0130430 2023-10-03T10:13:18.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.572+0000 7fc29effd700 1 -- 172.21.15.72:0/2081120731 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc2a8042f90 con 0x7fc2b0130430 2023-10-03T10:13:18.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.573+0000 7f9a11e8a700 1 Processor -- start 2023-10-03T10:13:18.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.573+0000 7f9a11e8a700 1 -- start start 2023-10-03T10:13:18.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.574+0000 7f9a11e8a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a0c09d6d0 0x7f9a0c09daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.574+0000 7f9a11e8a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9a0c09dfe0 0x7f9a0c13bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.574+0000 7f9a11e8a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c09a2d0 con 0x7f9a0c13c2f0 2023-10-03T10:13:18.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.574+0000 7f9a11e8a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0c09a570 con 0x7f9a0c09dfe0 2023-10-03T10:13:18.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.574+0000 7f9a11e8a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c09edc0 con 0x7f9a0c09d6d0 2023-10-03T10:13:18.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.574+0000 7f9a0b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a0c09d6d0 0x7f9a0c09daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.574+0000 7f9a0b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a0c09d6d0 0x7f9a0c09daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38558/0 (socket says 172.21.15.72:38558) 2023-10-03T10:13:18.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.574+0000 7f9a0b7fe700 1 -- 172.21.15.72:0/4189705069 learned_addr learned my addr 172.21.15.72:0/4189705069 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:18.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.574+0000 7f9a0affd700 1 --2- 172.21.15.72:0/4189705069 >> v2:172.21.15.72:3300/0 conn(0x7f9a0c09dfe0 0x7f9a0c13bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.574+0000 7f9a0b7fe700 1 -- 172.21.15.72:0/4189705069 >> v2:172.21.15.72:3300/0 conn(0x7f9a0c09dfe0 msgr2=0x7f9a0c13bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:18.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.574+0000 7f9a0b7fe700 1 --2- 172.21.15.72:0/4189705069 >> v2:172.21.15.72:3300/0 conn(0x7f9a0c09dfe0 0x7f9a0c13bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.574+0000 7f9a0b7fe700 1 -- 172.21.15.72:0/4189705069 >> v1:172.21.15.72:6789/0 conn(0x7f9a0c13c2f0 legacy=0x7f9a0c13e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.574+0000 7f9a0b7fe700 1 -- 172.21.15.72:0/4189705069 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c06a9e0 con 0x7f9a0c09d6d0 2023-10-03T10:13:18.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.575+0000 7f9a0b7fe700 1 --2- 172.21.15.72:0/4189705069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a0c09d6d0 0x7f9a0c09daa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0098f0 tx=0x7f99fc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d32259259ba9c83 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.575+0000 7f9a0a7fc700 1 -- 172.21.15.72:0/4189705069 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc011830 con 0x7f9a0c09d6d0 2023-10-03T10:13:18.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.575+0000 7f9a0a7fc700 1 -- 172.21.15.72:0/4189705069 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc011990 con 0x7f9a0c09d6d0 2023-10-03T10:13:18.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.575+0000 7f9a0a7fc700 1 -- 172.21.15.72:0/4189705069 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc011d20 con 0x7f9a0c09d6d0 2023-10-03T10:13:18.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.576+0000 7f9a11e8a700 1 -- 172.21.15.72:0/4189705069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a0c09d6d0 msgr2=0x7f9a0c09daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.576+0000 7f9a11e8a700 1 --2- 172.21.15.72:0/4189705069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a0c09d6d0 0x7f9a0c09daa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0098f0 tx=0x7f99fc009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:18.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.576+0000 7f9a11e8a700 1 -- 172.21.15.72:0/4189705069 shutdown_connections 2023-10-03T10:13:18.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.576+0000 7f9a11e8a700 1 --2- 172.21.15.72:0/4189705069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a0c09d6d0 0x7f9a0c09daa0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0098f0 tx=0x7f99fc009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:18.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.576+0000 7f9a11e8a700 1 --2- 172.21.15.72:0/4189705069 >> v2:172.21.15.72:3300/0 conn(0x7f9a0c09dfe0 0x7f9a0c13bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.576+0000 7f9a11e8a700 1 -- 172.21.15.72:0/4189705069 >> 172.21.15.72:0/4189705069 conn(0x7f9a0c099c20 msgr2=0x7f9a0c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.576+0000 7f9a11e8a700 1 -- 172.21.15.72:0/4189705069 shutdown_connections 2023-10-03T10:13:18.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.576+0000 7f9a11e8a700 1 -- 172.21.15.72:0/4189705069 wait complete. 2023-10-03T10:13:18.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.577+0000 7fc29effd700 1 -- 172.21.15.72:0/2081120731 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2a8019400 con 0x7fc2b0130430 2023-10-03T10:13:18.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.577+0000 7f9a11e8a700 1 Processor -- start 2023-10-03T10:13:18.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.577+0000 7f9a11e8a700 1 -- start start 2023-10-03T10:13:18.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.577+0000 7f9a11e8a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a0c09dfe0 0x7f9a0c1377b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.577+0000 7f9a11e8a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a0c13c2f0 0x7f9a0c137cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.577+0000 7f9a11e8a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a0c138230 0x7f9a0c1cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:18.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.577+0000 7f9a11e8a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c1266b0 con 0x7f9a0c138230 2023-10-03T10:13:18.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.577+0000 7f9a11e8a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c125940 con 0x7f9a0c13c2f0 2023-10-03T10:13:18.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.577+0000 7f9a11e8a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c1272b0 con 0x7f9a0c09dfe0 2023-10-03T10:13:18.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.578+0000 7f9a0b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a0c09dfe0 0x7f9a0c1377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.578+0000 7f9a0b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a0c09dfe0 0x7f9a0c1377b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40668/0 (socket says 172.21.15.72:40668) 2023-10-03T10:13:18.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.578+0000 7f9a0b7fe700 1 -- 172.21.15.72:0/2689187216 learned_addr learned my addr 172.21.15.72:0/2689187216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:18.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.578+0000 7f9a0bfff700 1 --2- 172.21.15.72:0/2689187216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a0c138230 0x7f9a0c1cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.578+0000 7f9a0affd700 1 --2- 172.21.15.72:0/2689187216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a0c13c2f0 0x7f9a0c137cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:18.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.578+0000 7f9a0b7fe700 1 -- 172.21.15.72:0/2689187216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a0c13c2f0 msgr2=0x7f9a0c137cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.578+0000 7f9a0b7fe700 1 --2- 172.21.15.72:0/2689187216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a0c13c2f0 0x7f9a0c137cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.578+0000 7f9a0b7fe700 1 -- 172.21.15.72:0/2689187216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a0c138230 msgr2=0x7f9a0c1cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.578+0000 7f9a0b7fe700 1 --2- 172.21.15.72:0/2689187216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a0c138230 0x7f9a0c1cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.578+0000 7f9a0b7fe700 1 -- 172.21.15.72:0/2689187216 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc009550 con 0x7f9a0c09dfe0 2023-10-03T10:13:18.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.578+0000 7f9a0bfff700 1 --2- 172.21.15.72:0/2689187216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a0c138230 0x7f9a0c1cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:18.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.578+0000 7f9a0b7fe700 1 --2- 172.21.15.72:0/2689187216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a0c09dfe0 0x7f9a0c1377b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f99fc013000 tx=0x7f99fc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:18.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.579+0000 7f99f3fff700 1 -- 172.21.15.72:0/2689187216 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0036a0 con 0x7f9a0c09dfe0 2023-10-03T10:13:18.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.579+0000 7f99f3fff700 1 -- 172.21.15.72:0/2689187216 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc003800 con 0x7f9a0c09dfe0 2023-10-03T10:13:18.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.579+0000 7f9a11e8a700 1 -- 172.21.15.72:0/2689187216 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c09e550 con 0x7f9a0c09dfe0 2023-10-03T10:13:18.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.579+0000 7f99f3fff700 1 -- 172.21.15.72:0/2689187216 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc003bb0 con 0x7f9a0c09dfe0 2023-10-03T10:13:18.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.579+0000 7f9a11e8a700 1 -- 172.21.15.72:0/2689187216 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c09c6f0 con 0x7f9a0c09dfe0 2023-10-03T10:13:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.580+0000 7f99f3fff700 1 -- 172.21.15.72:0/2689187216 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99fc021070 con 0x7f9a0c09dfe0 2023-10-03T10:13:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.580+0000 7f9a11e8a700 1 -- 172.21.15.72:0/2689187216 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c04f2a0 con 0x7f9a0c09dfe0 2023-10-03T10:13:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.580+0000 7f99f3fff700 1 -- 172.21.15.72:0/2689187216 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f99fc040c90 con 0x7f9a0c09dfe0 2023-10-03T10:13:18.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.589+0000 7f99f3fff700 1 -- 172.21.15.72:0/2689187216 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99fc024470 con 0x7f9a0c09dfe0 2023-10-03T10:13:18.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.660+0000 7efcc1934700 1 -- 172.21.15.72:0/1748426184 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efc9c005590 con 0x7efcbc139170 2023-10-03T10:13:18.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.660+0000 7efca3fff700 1 -- 172.21.15.72:0/1748426184 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efcb401bb10 con 0x7efcbc139170 2023-10-03T10:13:18.660 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:18.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.662+0000 7efcc1934700 1 -- 172.21.15.72:0/1748426184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcbc139170 msgr2=0x7efcbc11f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.662+0000 7efcc1934700 1 --2- 172.21.15.72:0/1748426184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcbc139170 0x7efcbc11f2a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efcb400efc0 tx=0x7efcb400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.662+0000 7efcc1934700 1 -- 172.21.15.72:0/1748426184 shutdown_connections 2023-10-03T10:13:18.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.662+0000 7efcc1934700 1 --2- 172.21.15.72:0/1748426184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcbc09d6f0 0x7efcbc11e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.662+0000 7efcc1934700 1 --2- 172.21.15.72:0/1748426184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcbc139170 0x7efcbc11f2a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.662+0000 7efcc1934700 1 --2- 172.21.15.72:0/1748426184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcbc09e1d0 0x7efcbc11ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.662+0000 7efcc1934700 1 -- 172.21.15.72:0/1748426184 >> 172.21.15.72:0/1748426184 conn(0x7efcbc066f50 msgr2=0x7efcbc136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.662+0000 7efcc1934700 1 -- 172.21.15.72:0/1748426184 shutdown_connections 2023-10-03T10:13:18.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.662+0000 7efcc1934700 1 -- 172.21.15.72:0/1748426184 wait complete. 2023-10-03T10:13:18.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:18.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.765+0000 7fc735211700 1 -- 172.21.15.72:0/1216139698 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc73006c360 con 0x7fc73009e000 2023-10-03T10:13:18.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.765+0000 7fc7177fe700 1 -- 172.21.15.72:0/1216139698 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc7240102e0 con 0x7fc73009e000 2023-10-03T10:13:18.765 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:18.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.767+0000 7fc735211700 1 -- 172.21.15.72:0/1216139698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc73009e000 msgr2=0x7fc7301a6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.767+0000 7fc735211700 1 --2- 172.21.15.72:0/1216139698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc73009e000 0x7fc7301a6460 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc73006e510 tx=0x7fc72400c6e0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.767+0000 7fc735211700 1 -- 172.21.15.72:0/1216139698 shutdown_connections 2023-10-03T10:13:18.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.767+0000 7fc735211700 1 --2- 172.21.15.72:0/1216139698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc73009e410 0x7fc7301a69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.767+0000 7fc735211700 1 --2- 172.21.15.72:0/1216139698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc73009d6f0 0x7fc7301a5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.767+0000 7fc735211700 1 --2- 172.21.15.72:0/1216139698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc73009e000 0x7fc7301a6460 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.767+0000 7fc735211700 1 -- 172.21.15.72:0/1216139698 >> 172.21.15.72:0/1216139698 conn(0x7fc730066f50 msgr2=0x7fc7301baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.767+0000 7fc735211700 1 -- 172.21.15.72:0/1216139698 shutdown_connections 2023-10-03T10:13:18.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.767+0000 7fc735211700 1 -- 172.21.15.72:0/1216139698 wait complete. 2023-10-03T10:13:18.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.779+0000 7fc2b4b50700 1 -- 172.21.15.72:0/2081120731 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc2b00713a0 con 0x7fc2b0130430 2023-10-03T10:13:18.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.779+0000 7fc29effd700 1 -- 172.21.15.72:0/2081120731 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc2a8029070 con 0x7fc2b0130430 2023-10-03T10:13:18.779 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:18.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:18.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.781+0000 7fc2b4b50700 1 -- 172.21.15.72:0/2081120731 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2b0130430 msgr2=0x7fc2b01c3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.781+0000 7fc2b4b50700 1 --2- 172.21.15.72:0/2081120731 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2b0130430 0x7fc2b01c3dd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8018000 tx=0x7fc2a8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.781+0000 7fc2b4b50700 1 -- 172.21.15.72:0/2081120731 shutdown_connections 2023-10-03T10:13:18.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.781+0000 7fc2b4b50700 1 --2- 172.21.15.72:0/2081120731 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2b0130430 0x7fc2b01c3dd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.781+0000 7fc2b4b50700 1 --2- 172.21.15.72:0/2081120731 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2b012cf60 0x7fc2b009bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.781+0000 7fc2b4b50700 1 --2- 172.21.15.72:0/2081120731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2b012f8b0 0x7fc2b009c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.781+0000 7fc2b4b50700 1 -- 172.21.15.72:0/2081120731 >> 172.21.15.72:0/2081120731 conn(0x7fc2b00a2aa0 msgr2=0x7fc2b006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.781+0000 7fc2b4b50700 1 -- 172.21.15.72:0/2081120731 shutdown_connections 2023-10-03T10:13:18.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.781+0000 7fc2b4b50700 1 -- 172.21.15.72:0/2081120731 wait complete. 2023-10-03T10:13:18.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.784+0000 7f9a11e8a700 1 -- 172.21.15.72:0/2689187216 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9a0c1387e0 con 0x7f9a0c09dfe0 2023-10-03T10:13:18.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.784+0000 7f99f3fff700 1 -- 172.21.15.72:0/2689187216 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99fc029070 con 0x7f9a0c09dfe0 2023-10-03T10:13:18.784 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:18.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.786+0000 7f9a11e8a700 1 -- 172.21.15.72:0/2689187216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a0c09dfe0 msgr2=0x7f9a0c1377b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:18.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.786+0000 7f9a11e8a700 1 --2- 172.21.15.72:0/2689187216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a0c09dfe0 0x7f9a0c1377b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f99fc013000 tx=0x7f99fc004750 comp rx=0 tx=0).stop 2023-10-03T10:13:18.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.786+0000 7f9a11e8a700 1 -- 172.21.15.72:0/2689187216 shutdown_connections 2023-10-03T10:13:18.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.786+0000 7f9a11e8a700 1 --2- 172.21.15.72:0/2689187216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a0c138230 0x7f9a0c1cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.786+0000 7f9a11e8a700 1 --2- 172.21.15.72:0/2689187216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a0c09dfe0 0x7f9a0c1377b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.786+0000 7f9a11e8a700 1 --2- 172.21.15.72:0/2689187216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a0c13c2f0 0x7f9a0c137cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:18.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.786+0000 7f9a11e8a700 1 -- 172.21.15.72:0/2689187216 >> 172.21.15.72:0/2689187216 conn(0x7f9a0c099c20 msgr2=0x7f9a0c0a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:18.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.786+0000 7f9a11e8a700 1 -- 172.21.15.72:0/2689187216 shutdown_connections 2023-10-03T10:13:18.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:18.786+0000 7f9a11e8a700 1 -- 172.21.15.72:0/2689187216 wait complete. 2023-10-03T10:13:18.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:18.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:19.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:19.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:19.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:19.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.804+0000 7f7da8564700 1 Processor -- start 2023-10-03T10:13:19.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.804+0000 7f7da8564700 1 -- start start 2023-10-03T10:13:19.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.804+0000 7f7da8564700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7da009d6f0 0x7f7da009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.804+0000 7f7da8564700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7da009e000 0x7f7da01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.804+0000 7f7da8564700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da009b120 con 0x7f7da009e410 2023-10-03T10:13:19.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.804+0000 7f7da8564700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da006b460 con 0x7f7da009d6f0 2023-10-03T10:13:19.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.804+0000 7f7da8564700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7da009a7e0 con 0x7f7da009e000 2023-10-03T10:13:19.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.805+0000 7f7da5aff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7da009e000 0x7f7da01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.805+0000 7f7da6300700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7da009d6f0 0x7f7da009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.805+0000 7f7da6b01700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7da009e410 0x7f7da0133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60100/0 (socket says 172.21.15.72:60100) 2023-10-03T10:13:19.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.805+0000 7f7da6b01700 1 -- 172.21.15.72:0/2442715576 learned_addr learned my addr 172.21.15.72:0/2442715576 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:19.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.805+0000 7f7da5aff700 1 -- 172.21.15.72:0/2442715576 >> v2:172.21.15.72:3300/0 conn(0x7f7da009d6f0 msgr2=0x7f7da009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:19.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.805+0000 7f7da5aff700 1 --2- 172.21.15.72:0/2442715576 >> v2:172.21.15.72:3300/0 conn(0x7f7da009d6f0 0x7f7da009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.805+0000 7f7da5aff700 1 -- 172.21.15.72:0/2442715576 >> v1:172.21.15.72:6789/0 conn(0x7f7da009e410 legacy=0x7f7da0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.805+0000 7f7da5aff700 1 -- 172.21.15.72:0/2442715576 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da009a500 con 0x7f7da009e000 2023-10-03T10:13:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.805+0000 7f7da6300700 1 --2- 172.21.15.72:0/2442715576 >> v2:172.21.15.72:3300/0 conn(0x7f7da009d6f0 0x7f7da009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.805+0000 7f7da5aff700 1 --2- 172.21.15.72:0/2442715576 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7da009e000 0x7f7da01339f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009870 tx=0x7f7d90009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db51856c9cdac9f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.805+0000 7f7da52fe700 1 -- 172.21.15.72:0/2442715576 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90011830 con 0x7f7da009e000 2023-10-03T10:13:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.805+0000 7f7da52fe700 1 -- 172.21.15.72:0/2442715576 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d90011990 con 0x7f7da009e000 2023-10-03T10:13:19.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.805+0000 7f7da52fe700 1 -- 172.21.15.72:0/2442715576 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90011d20 con 0x7f7da009e000 2023-10-03T10:13:19.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.806+0000 7f7da8564700 1 -- 172.21.15.72:0/2442715576 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7da009e000 msgr2=0x7f7da01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.806+0000 7f7da8564700 1 --2- 172.21.15.72:0/2442715576 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7da009e000 0x7f7da01339f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009870 tx=0x7f7d90009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:19.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.806+0000 7f7da8564700 1 -- 172.21.15.72:0/2442715576 shutdown_connections 2023-10-03T10:13:19.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.806+0000 7f7da8564700 1 --2- 172.21.15.72:0/2442715576 >> v2:172.21.15.72:3300/0 conn(0x7f7da009d6f0 0x7f7da009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.806+0000 7f7da8564700 1 --2- 172.21.15.72:0/2442715576 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7da009e000 0x7f7da01339f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.806+0000 7f7da8564700 1 -- 172.21.15.72:0/2442715576 >> 172.21.15.72:0/2442715576 conn(0x7f7da0066f50 msgr2=0x7f7da009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.806+0000 7f7da8564700 1 -- 172.21.15.72:0/2442715576 shutdown_connections 2023-10-03T10:13:19.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.806+0000 7f7da8564700 1 -- 172.21.15.72:0/2442715576 wait complete. 2023-10-03T10:13:19.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.807+0000 7f7da8564700 1 Processor -- start 2023-10-03T10:13:19.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.807+0000 7f7da8564700 1 -- start start 2023-10-03T10:13:19.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da8564700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7da009d6f0 0x7f7da01a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da8564700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7da009e000 0x7f7da01a6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da8564700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7da009e410 0x7f7da01a6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da8564700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da01a7490 con 0x7f7da009d6f0 2023-10-03T10:13:19.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da8564700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da01a7ba0 con 0x7f7da009e000 2023-10-03T10:13:19.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da8564700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7da01a8df0 con 0x7f7da009e410 2023-10-03T10:13:19.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da6300700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7da009d6f0 0x7f7da01a5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da6300700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7da009d6f0 0x7f7da01a5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43666/0 (socket says 172.21.15.72:43666) 2023-10-03T10:13:19.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da6300700 1 -- 172.21.15.72:0/2793176669 learned_addr learned my addr 172.21.15.72:0/2793176669 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:19.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da6b01700 1 --2- 172.21.15.72:0/2793176669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7da009e410 0x7f7da01a6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da6b01700 1 -- 172.21.15.72:0/2793176669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7da009e000 msgr2=0x7f7da01a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da6b01700 1 --2- 172.21.15.72:0/2793176669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7da009e000 0x7f7da01a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da6b01700 1 -- 172.21.15.72:0/2793176669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7da009d6f0 msgr2=0x7f7da01a5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da6b01700 1 --2- 172.21.15.72:0/2793176669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7da009d6f0 0x7f7da01a5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da6b01700 1 -- 172.21.15.72:0/2793176669 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c0094a0 con 0x7f7da009e410 2023-10-03T10:13:19.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.808+0000 7f7da6300700 1 --2- 172.21.15.72:0/2793176669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7da009d6f0 0x7f7da01a5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:19.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.809+0000 7f7da6b01700 1 --2- 172.21.15.72:0/2793176669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7da009e410 0x7f7da01a6a60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800cad0 tx=0x7f7d9800cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.809+0000 7f7d96ffd700 1 -- 172.21.15.72:0/2793176669 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9800aa20 con 0x7f7da009e410 2023-10-03T10:13:19.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.809+0000 7f7da8564700 1 -- 172.21.15.72:0/2793176669 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d900094a0 con 0x7f7da009e410 2023-10-03T10:13:19.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.809+0000 7f7d96ffd700 1 -- 172.21.15.72:0/2793176669 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9800ab80 con 0x7f7da009e410 2023-10-03T10:13:19.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.809+0000 7f7d96ffd700 1 -- 172.21.15.72:0/2793176669 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d98012400 con 0x7f7da009e410 2023-10-03T10:13:19.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.809+0000 7f7da8564700 1 -- 172.21.15.72:0/2793176669 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da00a31b0 con 0x7f7da009e410 2023-10-03T10:13:19.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.810+0000 7f7d96ffd700 1 -- 172.21.15.72:0/2793176669 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d9801b3b0 con 0x7f7da009e410 2023-10-03T10:13:19.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.810+0000 7f7d96ffd700 1 -- 172.21.15.72:0/2793176669 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d9803f230 con 0x7f7da009e410 2023-10-03T10:13:19.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.811+0000 7f7da8564700 1 -- 172.21.15.72:0/2793176669 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da0074ea0 con 0x7f7da009e410 2023-10-03T10:13:19.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.816+0000 7f7d96ffd700 1 -- 172.21.15.72:0/2793176669 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d980192c0 con 0x7f7da009e410 2023-10-03T10:13:19.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.913+0000 7f51b4233700 1 Processor -- start 2023-10-03T10:13:19.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.913+0000 7f51b4233700 1 -- start start 2023-10-03T10:13:19.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.914+0000 7f51b4233700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51ac09f410 0x7f51ac136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.914+0000 7f51b4233700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51ac136fe0 0x7f51ac1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.914+0000 7f51b4233700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac070940 con 0x7f51ac09e930 2023-10-03T10:13:19.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.914+0000 7f51b4233700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac06fd60 con 0x7f51ac136fe0 2023-10-03T10:13:19.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.914+0000 7f51b4233700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac06fa80 con 0x7f51ac09f410 2023-10-03T10:13:19.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.914+0000 7f51b27d0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51ac136fe0 0x7f51ac1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.914+0000 7f51b27d0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51ac136fe0 0x7f51ac1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43672/0 (socket says 172.21.15.72:43672) 2023-10-03T10:13:19.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.914+0000 7f51b27d0700 1 -- 172.21.15.72:0/4169910447 learned_addr learned my addr 172.21.15.72:0/4169910447 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:19.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.914+0000 7f51b17ce700 1 --2- 172.21.15.72:0/4169910447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51ac09f410 0x7f51ac136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.914+0000 7f51b17ce700 1 -- 172.21.15.72:0/4169910447 >> v2:172.21.15.72:3300/0 conn(0x7f51ac136fe0 msgr2=0x7f51ac1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:19.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.914+0000 7f51b17ce700 1 --2- 172.21.15.72:0/4169910447 >> v2:172.21.15.72:3300/0 conn(0x7f51ac136fe0 0x7f51ac1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.914+0000 7f51b17ce700 1 -- 172.21.15.72:0/4169910447 >> v1:172.21.15.72:6789/0 conn(0x7f51ac09e930 legacy=0x7f51ac09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.914+0000 7f51b17ce700 1 -- 172.21.15.72:0/4169910447 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac09fb60 con 0x7f51ac09f410 2023-10-03T10:13:19.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.915+0000 7f51b17ce700 1 --2- 172.21.15.72:0/4169910447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51ac09f410 0x7f51ac136aa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f519c00dc60 tx=0x7f519c00df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=672acfaf3aa847a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.915+0000 7f51b0fcd700 1 -- 172.21.15.72:0/4169910447 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c012070 con 0x7f51ac09f410 2023-10-03T10:13:19.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.915+0000 7f51b0fcd700 1 -- 172.21.15.72:0/4169910447 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c00d2e0 con 0x7f51ac09f410 2023-10-03T10:13:19.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.915+0000 7f51b0fcd700 1 -- 172.21.15.72:0/4169910447 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c00f900 con 0x7f51ac09f410 2023-10-03T10:13:19.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.915+0000 7f51b4233700 1 -- 172.21.15.72:0/4169910447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51ac09f410 msgr2=0x7f51ac136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.915+0000 7f51b4233700 1 --2- 172.21.15.72:0/4169910447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51ac09f410 0x7f51ac136aa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f519c00dc60 tx=0x7f519c00df70 comp rx=0 tx=0).stop 2023-10-03T10:13:19.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.916+0000 7f51b4233700 1 -- 172.21.15.72:0/4169910447 shutdown_connections 2023-10-03T10:13:19.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.916+0000 7f51b4233700 1 --2- 172.21.15.72:0/4169910447 >> v2:172.21.15.72:3300/0 conn(0x7f51ac136fe0 0x7f51ac1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.916+0000 7f51b4233700 1 --2- 172.21.15.72:0/4169910447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51ac09f410 0x7f51ac136aa0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.916+0000 7f51b4233700 1 -- 172.21.15.72:0/4169910447 >> 172.21.15.72:0/4169910447 conn(0x7f51ac0a4210 msgr2=0x7f51ac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.916+0000 7f51b4233700 1 -- 172.21.15.72:0/4169910447 shutdown_connections 2023-10-03T10:13:19.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.916+0000 7f51b4233700 1 -- 172.21.15.72:0/4169910447 wait complete. 2023-10-03T10:13:19.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.917+0000 7f51b4233700 1 Processor -- start 2023-10-03T10:13:19.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.917+0000 7f51b4233700 1 -- start start 2023-10-03T10:13:19.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.917+0000 7f51b4233700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51ac09e930 0x7f51ac134dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.917+0000 7f51b4233700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51ac09f410 0x7f51ac135300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.917+0000 7f51b4233700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51ac136fe0 0x7f51ac135840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.917+0000 7f51b4233700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac06d810 con 0x7f51ac09e930 2023-10-03T10:13:19.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.917+0000 7f51b4233700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac071d20 con 0x7f51ac09f410 2023-10-03T10:13:19.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.917+0000 7f51b4233700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac11b6c0 con 0x7f51ac136fe0 2023-10-03T10:13:19.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.917+0000 7f51b27d0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51ac136fe0 0x7f51ac135840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.917+0000 7f51b27d0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51ac136fe0 0x7f51ac135840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40684/0 (socket says 172.21.15.72:40684) 2023-10-03T10:13:19.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.917+0000 7f51b27d0700 1 -- 172.21.15.72:0/1733982965 learned_addr learned my addr 172.21.15.72:0/1733982965 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:19.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.917+0000 7f51b1fcf700 1 --2- 172.21.15.72:0/1733982965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51ac09e930 0x7f51ac134dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.918+0000 7f51b27d0700 1 -- 172.21.15.72:0/1733982965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51ac09f410 msgr2=0x7f51ac135300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.918+0000 7f51b27d0700 1 --2- 172.21.15.72:0/1733982965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51ac09f410 0x7f51ac135300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.918+0000 7f51b27d0700 1 -- 172.21.15.72:0/1733982965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51ac09e930 msgr2=0x7f51ac134dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.918+0000 7f51b27d0700 1 --2- 172.21.15.72:0/1733982965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51ac09e930 0x7f51ac134dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.918+0000 7f51b27d0700 1 -- 172.21.15.72:0/1733982965 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c00d940 con 0x7f51ac136fe0 2023-10-03T10:13:19.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.918+0000 7f51b27d0700 1 --2- 172.21.15.72:0/1733982965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51ac136fe0 0x7f51ac135840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f51a400efc0 tx=0x7f51a400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.918+0000 7f51a27fc700 1 -- 172.21.15.72:0/1733982965 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a4003c20 con 0x7f51ac136fe0 2023-10-03T10:13:19.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.918+0000 7f51a27fc700 1 -- 172.21.15.72:0/1733982965 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a400f040 con 0x7f51ac136fe0 2023-10-03T10:13:19.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.918+0000 7f51a27fc700 1 -- 172.21.15.72:0/1733982965 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a4009e30 con 0x7f51ac136fe0 2023-10-03T10:13:19.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.918+0000 7f51b4233700 1 -- 172.21.15.72:0/1733982965 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac11bfd0 con 0x7f51ac136fe0 2023-10-03T10:13:19.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.918+0000 7f51b4233700 1 -- 172.21.15.72:0/1733982965 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac11a9f0 con 0x7f51ac136fe0 2023-10-03T10:13:19.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.919+0000 7f51b4233700 1 -- 172.21.15.72:0/1733982965 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac074ea0 con 0x7f51ac136fe0 2023-10-03T10:13:19.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.919+0000 7f51a27fc700 1 -- 172.21.15.72:0/1733982965 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51a400c930 con 0x7f51ac136fe0 2023-10-03T10:13:19.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.920+0000 7f51a27fc700 1 -- 172.21.15.72:0/1733982965 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f51a403f9b0 con 0x7f51ac136fe0 2023-10-03T10:13:19.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.928+0000 7f51a27fc700 1 -- 172.21.15.72:0/1733982965 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51a400cbe0 con 0x7f51ac136fe0 2023-10-03T10:13:19.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.934+0000 7fa9d17f9700 1 Processor -- start 2023-10-03T10:13:19.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.934+0000 7fa9d17f9700 1 -- start start 2023-10-03T10:13:19.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.935+0000 7fa9d17f9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9cc131630 0x7fa9cc131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.935+0000 7fa9d17f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9cc06eba0 0x7fa9cc139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.935+0000 7fa9d17f9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9cc071a00 con 0x7fa9cc131f40 2023-10-03T10:13:19.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.935+0000 7fa9d17f9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc131430 con 0x7fa9cc131630 2023-10-03T10:13:19.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.935+0000 7fa9d17f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc09a510 con 0x7fa9cc06eba0 2023-10-03T10:13:19.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.935+0000 7fa9cb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9cc06eba0 0x7fa9cc139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.935+0000 7fa9cb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9cc06eba0 0x7fa9cc139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38604/0 (socket says 172.21.15.72:38604) 2023-10-03T10:13:19.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.935+0000 7fa9cb7fe700 1 -- 172.21.15.72:0/2917679444 learned_addr learned my addr 172.21.15.72:0/2917679444 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:19.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.935+0000 7fa9caffd700 1 --2- 172.21.15.72:0/2917679444 >> v2:172.21.15.72:3300/0 conn(0x7fa9cc131630 0x7fa9cc131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.936+0000 7fa9cb7fe700 1 -- 172.21.15.72:0/2917679444 >> v2:172.21.15.72:3300/0 conn(0x7fa9cc131630 msgr2=0x7fa9cc131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:19.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.936+0000 7fa9cb7fe700 1 --2- 172.21.15.72:0/2917679444 >> v2:172.21.15.72:3300/0 conn(0x7fa9cc131630 0x7fa9cc131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.936+0000 7fa9cb7fe700 1 -- 172.21.15.72:0/2917679444 >> v1:172.21.15.72:6789/0 conn(0x7fa9cc131f40 legacy=0x7fa9cc06e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.936+0000 7fa9cb7fe700 1 -- 172.21.15.72:0/2917679444 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc0721c0 con 0x7fa9cc06eba0 2023-10-03T10:13:19.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.936+0000 7fa9cb7fe700 1 --2- 172.21.15.72:0/2917679444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9cc06eba0 0x7fa9cc139660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009e50 tx=0x7fa9c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3b833f2f5d7c6e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.936+0000 7fa9c9ffb700 1 -- 172.21.15.72:0/2917679444 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c400e070 con 0x7fa9cc06eba0 2023-10-03T10:13:19.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.936+0000 7fa9c9ffb700 1 -- 172.21.15.72:0/2917679444 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c400b910 con 0x7fa9cc06eba0 2023-10-03T10:13:19.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.936+0000 7fa9c9ffb700 1 -- 172.21.15.72:0/2917679444 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c400bcc0 con 0x7fa9cc06eba0 2023-10-03T10:13:19.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.937+0000 7fa9d17f9700 1 -- 172.21.15.72:0/2917679444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9cc06eba0 msgr2=0x7fa9cc139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.937+0000 7fa9d17f9700 1 --2- 172.21.15.72:0/2917679444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9cc06eba0 0x7fa9cc139660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009e50 tx=0x7fa9c400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:19.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.937+0000 7fa9d17f9700 1 -- 172.21.15.72:0/2917679444 shutdown_connections 2023-10-03T10:13:19.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.937+0000 7fa9d17f9700 1 --2- 172.21.15.72:0/2917679444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9cc06eba0 0x7fa9cc139660 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.937+0000 7fa9d17f9700 1 --2- 172.21.15.72:0/2917679444 >> v2:172.21.15.72:3300/0 conn(0x7fa9cc131630 0x7fa9cc131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.937+0000 7fa9d17f9700 1 -- 172.21.15.72:0/2917679444 >> 172.21.15.72:0/2917679444 conn(0x7fa9cc0a2aa0 msgr2=0x7fa9cc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.937+0000 7fa9d17f9700 1 -- 172.21.15.72:0/2917679444 shutdown_connections 2023-10-03T10:13:19.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.937+0000 7fa9d17f9700 1 -- 172.21.15.72:0/2917679444 wait complete. 2023-10-03T10:13:19.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.938+0000 7f71e2aa2700 1 Processor -- start 2023-10-03T10:13:19.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.938+0000 7f71e2aa2700 1 -- start start 2023-10-03T10:13:19.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7f71e2aa2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71dc09d6f0 0x7f71dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7fa9d17f9700 1 Processor -- start 2023-10-03T10:13:19.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7f71e2aa2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71dc09e410 0x7f71dc134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7f71e2aa2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71dc09b120 con 0x7f71dc09e000 2023-10-03T10:13:19.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7f71e2aa2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc06b460 con 0x7f71dc09e410 2023-10-03T10:13:19.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7f71e2aa2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc09a7e0 con 0x7f71dc09d6f0 2023-10-03T10:13:19.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7f71e103f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71dc09e410 0x7f71dc134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7f71e103f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71dc09e410 0x7f71dc134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43690/0 (socket says 172.21.15.72:43690) 2023-10-03T10:13:19.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7f71e103f700 1 -- 172.21.15.72:0/953622096 learned_addr learned my addr 172.21.15.72:0/953622096 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:19.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7f71e103f700 1 -- 172.21.15.72:0/953622096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71dc09d6f0 msgr2=0x7f71dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:19.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7f71e103f700 1 --2- 172.21.15.72:0/953622096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71dc09d6f0 0x7f71dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7f71e103f700 1 -- 172.21.15.72:0/953622096 >> v1:172.21.15.72:6789/0 conn(0x7f71dc09e000 legacy=0x7f71dc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7f71e103f700 1 -- 172.21.15.72:0/953622096 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc09a500 con 0x7f71dc09e410 2023-10-03T10:13:19.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7f71e103f700 1 --2- 172.21.15.72:0/953622096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71dc09e410 0x7f71dc134100 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009e50 tx=0x7f71d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2870a7f95685a5c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7fa9d17f9700 1 -- start start 2023-10-03T10:13:19.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7fa9d17f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9cc06eba0 0x7fa9cc11b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7fa9d17f9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa9cc131630 0x7fa9cc11bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7fa9d17f9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc131f40 0x7fa9cc11c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7fa9d17f9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc11f1e0 con 0x7fa9cc131f40 2023-10-03T10:13:19.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7fa9d17f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc11cbb0 con 0x7fa9cc06eba0 2023-10-03T10:13:19.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.939+0000 7fa9d17f9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc11d370 con 0x7fa9cc131630 2023-10-03T10:13:19.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7f71db7fe700 1 -- 172.21.15.72:0/953622096 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400e070 con 0x7f71dc09e410 2023-10-03T10:13:19.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7fa9cb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc131f40 0x7fa9cc11c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7fa9cb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc131f40 0x7fa9cc11c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43694/0 (socket says 172.21.15.72:43694) 2023-10-03T10:13:19.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7fa9cb7fe700 1 -- 172.21.15.72:0/1647057469 learned_addr learned my addr 172.21.15.72:0/1647057469 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:19.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7f71db7fe700 1 -- 172.21.15.72:0/953622096 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d400b9c0 con 0x7f71dc09e410 2023-10-03T10:13:19.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7f71db7fe700 1 -- 172.21.15.72:0/953622096 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d400bd70 con 0x7f71dc09e410 2023-10-03T10:13:19.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7fa9caffd700 1 --2- 172.21.15.72:0/1647057469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9cc06eba0 0x7fa9cc11b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7fa9cb7fe700 1 -- 172.21.15.72:0/1647057469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa9cc131630 msgr2=0x7fa9cc11bc90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:19.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7fa9cb7fe700 1 --2- 172.21.15.72:0/1647057469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa9cc131630 0x7fa9cc11bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7fa9cb7fe700 1 -- 172.21.15.72:0/1647057469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9cc06eba0 msgr2=0x7fa9cc11b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7fa9cb7fe700 1 --2- 172.21.15.72:0/1647057469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9cc06eba0 0x7fa9cc11b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7fa9cb7fe700 1 -- 172.21.15.72:0/1647057469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c4009b30 con 0x7fa9cc131f40 2023-10-03T10:13:19.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7fa9cb7fe700 1 --2- 172.21.15.72:0/1647057469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc131f40 0x7fa9cc11c1d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc09a650 tx=0x7fa9c4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7fa9b37fe700 1 -- 172.21.15.72:0/1647057469 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4004680 con 0x7fa9cc131f40 2023-10-03T10:13:19.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7f71e2aa2700 1 -- 172.21.15.72:0/953622096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71dc09e410 msgr2=0x7f71dc134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7f71e2aa2700 1 --2- 172.21.15.72:0/953622096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71dc09e410 0x7f71dc134100 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009e50 tx=0x7f71d400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:19.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7fa9b37fe700 1 -- 172.21.15.72:0/1647057469 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c40047e0 con 0x7fa9cc131f40 2023-10-03T10:13:19.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.940+0000 7fa9b37fe700 1 -- 172.21.15.72:0/1647057469 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c401e960 con 0x7fa9cc131f40 2023-10-03T10:13:19.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.941+0000 7f71e2aa2700 1 -- 172.21.15.72:0/953622096 shutdown_connections 2023-10-03T10:13:19.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.941+0000 7f71e2aa2700 1 --2- 172.21.15.72:0/953622096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71dc09e410 0x7f71dc134100 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.941+0000 7f71e2aa2700 1 --2- 172.21.15.72:0/953622096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71dc09d6f0 0x7f71dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.941+0000 7f71e2aa2700 1 -- 172.21.15.72:0/953622096 >> 172.21.15.72:0/953622096 conn(0x7f71dc066f50 msgr2=0x7f71dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:19.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.941+0000 7fa9d17f9700 1 -- 172.21.15.72:0/1647057469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc06e5d0 con 0x7fa9cc131f40 2023-10-03T10:13:19.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.941+0000 7fa9d17f9700 1 -- 172.21.15.72:0/1647057469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc099f80 con 0x7fa9cc131f40 2023-10-03T10:13:19.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.941+0000 7f71e2aa2700 1 -- 172.21.15.72:0/953622096 shutdown_connections 2023-10-03T10:13:19.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.941+0000 7f71e2aa2700 1 -- 172.21.15.72:0/953622096 wait complete. 2023-10-03T10:13:19.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.942+0000 7f71e2aa2700 1 Processor -- start 2023-10-03T10:13:19.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.942+0000 7f71e2aa2700 1 -- start start 2023-10-03T10:13:19.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.942+0000 7fa9b37fe700 1 -- 172.21.15.72:0/1647057469 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9c4024070 con 0x7fa9cc131f40 2023-10-03T10:13:19.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.942+0000 7fa9b37fe700 1 -- 172.21.15.72:0/1647057469 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa9c4044c30 con 0x7fa9cc131f40 2023-10-03T10:13:19.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.942+0000 7f71e2aa2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71dc09d6f0 0x7f71dc1b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.942+0000 7f71e2aa2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71dc09e000 0x7f71dc1b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.942+0000 7f71e2aa2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71dc09e410 0x7f71dc1d4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:19.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.942+0000 7f71e2aa2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc1b82f0 con 0x7f71dc09e000 2023-10-03T10:13:19.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.942+0000 7f71e2aa2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc1b8540 con 0x7f71dc09d6f0 2023-10-03T10:13:19.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.942+0000 7f71e2aa2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc1b6630 con 0x7f71dc09e410 2023-10-03T10:13:19.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.942+0000 7fa9d17f9700 1 -- 172.21.15.72:0/1647057469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9cc11e1f0 con 0x7fa9cc131f40 2023-10-03T10:13:19.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.943+0000 7f71e083e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71dc09d6f0 0x7f71dc1b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.943+0000 7f71e083e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71dc09d6f0 0x7f71dc1b53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38618/0 (socket says 172.21.15.72:38618) 2023-10-03T10:13:19.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.943+0000 7f71e083e700 1 -- 172.21.15.72:0/3316422746 learned_addr learned my addr 172.21.15.72:0/3316422746 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:19.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.943+0000 7f71e103f700 1 --2- 172.21.15.72:0/3316422746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71dc09e410 0x7f71dc1d4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:19.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.943+0000 7f71e103f700 1 -- 172.21.15.72:0/3316422746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71dc09d6f0 msgr2=0x7f71dc1b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.943+0000 7f71e103f700 1 --2- 172.21.15.72:0/3316422746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71dc09d6f0 0x7f71dc1b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.943+0000 7f71e103f700 1 -- 172.21.15.72:0/3316422746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71dc09e000 msgr2=0x7f71dc1b5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:19.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.943+0000 7f71e103f700 1 --2- 172.21.15.72:0/3316422746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71dc09e000 0x7f71dc1b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:19.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.943+0000 7f71e103f700 1 -- 172.21.15.72:0/3316422746 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d4009b30 con 0x7f71dc09e410 2023-10-03T10:13:19.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.943+0000 7f71e103f700 1 --2- 172.21.15.72:0/3316422746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71dc09e410 0x7f71dc1d4f30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f71d4015000 tx=0x7f71d4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:19.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.944+0000 7f71d97fa700 1 -- 172.21.15.72:0/3316422746 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4004930 con 0x7f71dc09e410 2023-10-03T10:13:19.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.944+0000 7f71d97fa700 1 -- 172.21.15.72:0/3316422746 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d40092e0 con 0x7f71dc09e410 2023-10-03T10:13:19.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.944+0000 7f71d97fa700 1 -- 172.21.15.72:0/3316422746 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d401c640 con 0x7f71dc09e410 2023-10-03T10:13:19.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.944+0000 7f71e2aa2700 1 -- 172.21.15.72:0/3316422746 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc0a31a0 con 0x7f71dc09e410 2023-10-03T10:13:19.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.944+0000 7f71e2aa2700 1 -- 172.21.15.72:0/3316422746 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc09c770 con 0x7f71dc09e410 2023-10-03T10:13:19.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.945+0000 7f71d97fa700 1 -- 172.21.15.72:0/3316422746 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71d401c7a0 con 0x7f71dc09e410 2023-10-03T10:13:19.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.945+0000 7f71d97fa700 1 -- 172.21.15.72:0/3316422746 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f71d4041160 con 0x7f71dc09e410 2023-10-03T10:13:19.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.945+0000 7f71e2aa2700 1 -- 172.21.15.72:0/3316422746 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc074ea0 con 0x7f71dc09e410 2023-10-03T10:13:19.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.946+0000 7f71e083e700 1 --2- 172.21.15.72:0/3316422746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71dc09d6f0 0x7f71dc1b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:19.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.952+0000 7fa9b37fe700 1 -- 172.21.15.72:0/1647057469 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9c40123f0 con 0x7fa9cc131f40 2023-10-03T10:13:19.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:19.954+0000 7f71d97fa700 1 -- 172.21.15.72:0/3316422746 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71d40123f0 con 0x7f71dc09e410 2023-10-03T10:13:20.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.023+0000 7f7da8564700 1 -- 172.21.15.72:0/2793176669 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7da009c6d0 con 0x7f7da009e410 2023-10-03T10:13:20.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.023+0000 7f7d96ffd700 1 -- 172.21.15.72:0/2793176669 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d98017020 con 0x7f7da009e410 2023-10-03T10:13:20.023 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:20.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.025+0000 7f7da8564700 1 -- 172.21.15.72:0/2793176669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7da009e410 msgr2=0x7f7da01a6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.025+0000 7f7da8564700 1 --2- 172.21.15.72:0/2793176669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7da009e410 0x7f7da01a6a60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800cad0 tx=0x7f7d9800cde0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.025+0000 7f7da8564700 1 -- 172.21.15.72:0/2793176669 shutdown_connections 2023-10-03T10:13:20.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.025+0000 7f7da8564700 1 --2- 172.21.15.72:0/2793176669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7da009d6f0 0x7f7da01a5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.025+0000 7f7da8564700 1 --2- 172.21.15.72:0/2793176669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7da009e410 0x7f7da01a6a60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.025+0000 7f7da8564700 1 --2- 172.21.15.72:0/2793176669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7da009e000 0x7f7da01a6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.025+0000 7f7da8564700 1 -- 172.21.15.72:0/2793176669 >> 172.21.15.72:0/2793176669 conn(0x7f7da0066f50 msgr2=0x7f7da01baf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.026+0000 7f7da8564700 1 -- 172.21.15.72:0/2793176669 shutdown_connections 2023-10-03T10:13:20.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.026+0000 7f7da8564700 1 -- 172.21.15.72:0/2793176669 wait complete. 2023-10-03T10:13:20.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:20.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.147+0000 7f71e2aa2700 1 -- 172.21.15.72:0/3316422746 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f71dc1b7f00 con 0x7f71dc09e410 2023-10-03T10:13:20.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.147+0000 7f71d97fa700 1 -- 172.21.15.72:0/3316422746 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f71d4033090 con 0x7f71dc09e410 2023-10-03T10:13:20.147 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:20.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.149+0000 7f51b4233700 1 -- 172.21.15.72:0/1733982965 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f51ac06b250 con 0x7f51ac136fe0 2023-10-03T10:13:20.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.150+0000 7f71e2aa2700 1 -- 172.21.15.72:0/3316422746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71dc09e410 msgr2=0x7f71dc1d4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.150+0000 7f71e2aa2700 1 --2- 172.21.15.72:0/3316422746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71dc09e410 0x7f71dc1d4f30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f71d4015000 tx=0x7f71d4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.150+0000 7f51a27fc700 1 -- 172.21.15.72:0/1733982965 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f51a4014e00 con 0x7f51ac136fe0 2023-10-03T10:13:20.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.150+0000 7f71e2aa2700 1 -- 172.21.15.72:0/3316422746 shutdown_connections 2023-10-03T10:13:20.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.150+0000 7f71e2aa2700 1 --2- 172.21.15.72:0/3316422746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71dc09e410 0x7f71dc1d4f30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.150+0000 7f71e2aa2700 1 --2- 172.21.15.72:0/3316422746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71dc09d6f0 0x7f71dc1b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.150+0000 7f71e2aa2700 1 --2- 172.21.15.72:0/3316422746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71dc09e000 0x7f71dc1b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.150+0000 7f71e2aa2700 1 -- 172.21.15.72:0/3316422746 >> 172.21.15.72:0/3316422746 conn(0x7f71dc066f50 msgr2=0x7f71dc0712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.151 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:20.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.151+0000 7f71e2aa2700 1 -- 172.21.15.72:0/3316422746 shutdown_connections 2023-10-03T10:13:20.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.151+0000 7f71e2aa2700 1 -- 172.21.15.72:0/3316422746 wait complete. 2023-10-03T10:13:20.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.152+0000 7f51b4233700 1 -- 172.21.15.72:0/1733982965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51ac136fe0 msgr2=0x7f51ac135840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.152+0000 7f51b4233700 1 --2- 172.21.15.72:0/1733982965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51ac136fe0 0x7f51ac135840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f51a400efc0 tx=0x7f51a400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.152+0000 7f51b4233700 1 -- 172.21.15.72:0/1733982965 shutdown_connections 2023-10-03T10:13:20.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.152+0000 7f51b4233700 1 --2- 172.21.15.72:0/1733982965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51ac09e930 0x7f51ac134dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.152+0000 7f51b4233700 1 --2- 172.21.15.72:0/1733982965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51ac136fe0 0x7f51ac135840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.152+0000 7f51b4233700 1 --2- 172.21.15.72:0/1733982965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51ac09f410 0x7f51ac135300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.152+0000 7f51b4233700 1 -- 172.21.15.72:0/1733982965 >> 172.21.15.72:0/1733982965 conn(0x7f51ac0a4210 msgr2=0x7f51ac0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.152+0000 7f51b4233700 1 -- 172.21.15.72:0/1733982965 shutdown_connections 2023-10-03T10:13:20.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.152+0000 7f51b4233700 1 -- 172.21.15.72:0/1733982965 wait complete. 2023-10-03T10:13:20.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.164+0000 7fa9d17f9700 1 -- 172.21.15.72:0/1647057469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa9cc074ea0 con 0x7fa9cc131f40 2023-10-03T10:13:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.164+0000 7fa9b37fe700 1 -- 172.21.15.72:0/1647057469 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9c402c020 con 0x7fa9cc131f40 2023-10-03T10:13:20.164 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:20.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:20.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.166+0000 7fa9d17f9700 1 -- 172.21.15.72:0/1647057469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc131f40 msgr2=0x7fa9cc11c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:20.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.166+0000 7fa9d17f9700 1 --2- 172.21.15.72:0/1647057469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc131f40 0x7fa9cc11c1d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc09a650 tx=0x7fa9c4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.166+0000 7fa9d17f9700 1 -- 172.21.15.72:0/1647057469 shutdown_connections 2023-10-03T10:13:20.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.166+0000 7fa9d17f9700 1 --2- 172.21.15.72:0/1647057469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9cc131f40 0x7fa9cc11c1d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.166+0000 7fa9d17f9700 1 --2- 172.21.15.72:0/1647057469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa9cc06eba0 0x7fa9cc11b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.166+0000 7fa9d17f9700 1 --2- 172.21.15.72:0/1647057469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa9cc131630 0x7fa9cc11bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:20.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.166+0000 7fa9d17f9700 1 -- 172.21.15.72:0/1647057469 >> 172.21.15.72:0/1647057469 conn(0x7fa9cc0a2aa0 msgr2=0x7fa9cc09d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:20.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.167+0000 7fa9d17f9700 1 -- 172.21.15.72:0/1647057469 shutdown_connections 2023-10-03T10:13:20.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:20.167+0000 7fa9d17f9700 1 -- 172.21.15.72:0/1647057469 wait complete. 2023-10-03T10:13:20.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:21.039 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:21.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:21.166 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:21.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.169+0000 7f0afc945700 1 Processor -- start 2023-10-03T10:13:21.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.169+0000 7f0afc945700 1 -- start start 2023-10-03T10:13:21.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.169+0000 7f0afc945700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0af809d6f0 0x7f0af809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0afc945700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0af809e000 0x7f0af81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0afc945700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af809b120 con 0x7f0af809e410 2023-10-03T10:13:21.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0afc945700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af806b460 con 0x7f0af809e000 2023-10-03T10:13:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0afc945700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0af809a7e0 con 0x7f0af809d6f0 2023-10-03T10:13:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0af5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0af809e000 0x7f0af81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0af659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0af809d6f0 0x7f0af809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0af5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0af809e000 0x7f0af81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43710/0 (socket says 172.21.15.72:43710) 2023-10-03T10:13:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0af659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0af809d6f0 0x7f0af809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40710/0 (socket says 172.21.15.72:40710) 2023-10-03T10:13:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0af5d9b700 1 -- 172.21.15.72:0/1718747564 learned_addr learned my addr 172.21.15.72:0/1718747564 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0af659c700 1 -- 172.21.15.72:0/1718747564 >> v2:172.21.15.72:3300/0 conn(0x7f0af809e000 msgr2=0x7f0af81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0af659c700 1 --2- 172.21.15.72:0/1718747564 >> v2:172.21.15.72:3300/0 conn(0x7f0af809e000 0x7f0af81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0af659c700 1 -- 172.21.15.72:0/1718747564 >> v1:172.21.15.72:6789/0 conn(0x7f0af809e410 legacy=0x7f0af8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0af659c700 1 -- 172.21.15.72:0/1718747564 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af809a500 con 0x7f0af809d6f0 2023-10-03T10:13:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0af559a700 1 -- 172.21.15.72:0/1718747564 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621285854 0 0) 0x7f0af809b120 con 0x7f0af809e410 2023-10-03T10:13:21.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0af5d9b700 1 --2- 172.21.15.72:0/1718747564 >> v2:172.21.15.72:3300/0 conn(0x7f0af809e000 0x7f0af81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:21.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0af659c700 1 --2- 172.21.15.72:0/1718747564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0af809d6f0 0x7f0af809dac0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009870 tx=0x7f0ae8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fe22929d271bcae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.170+0000 7f0af559a700 1 -- 172.21.15.72:0/1718747564 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8011830 con 0x7f0af809d6f0 2023-10-03T10:13:21.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.171+0000 7f0af559a700 1 -- 172.21.15.72:0/1718747564 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae8011990 con 0x7f0af809d6f0 2023-10-03T10:13:21.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.171+0000 7f0af559a700 1 -- 172.21.15.72:0/1718747564 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8011d20 con 0x7f0af809d6f0 2023-10-03T10:13:21.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.171+0000 7f0afc945700 1 -- 172.21.15.72:0/1718747564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0af809d6f0 msgr2=0x7f0af809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.171+0000 7f0afc945700 1 --2- 172.21.15.72:0/1718747564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0af809d6f0 0x7f0af809dac0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009870 tx=0x7f0ae8009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.171+0000 7f0afc945700 1 -- 172.21.15.72:0/1718747564 shutdown_connections 2023-10-03T10:13:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.171+0000 7f0afc945700 1 --2- 172.21.15.72:0/1718747564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0af809d6f0 0x7f0af809dac0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.171+0000 7f0afc945700 1 --2- 172.21.15.72:0/1718747564 >> v2:172.21.15.72:3300/0 conn(0x7f0af809e000 0x7f0af81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.171+0000 7f0afc945700 1 -- 172.21.15.72:0/1718747564 >> 172.21.15.72:0/1718747564 conn(0x7f0af8066f50 msgr2=0x7f0af809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.171+0000 7f0afc945700 1 -- 172.21.15.72:0/1718747564 shutdown_connections 2023-10-03T10:13:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.171+0000 7f0afc945700 1 -- 172.21.15.72:0/1718747564 wait complete. 2023-10-03T10:13:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.172+0000 7f0afc945700 1 Processor -- start 2023-10-03T10:13:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.172+0000 7f0afc945700 1 -- start start 2023-10-03T10:13:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0afc945700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0af809d6f0 0x7f0af81c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0afc945700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af809e000 0x7f0af81c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0afc945700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0af809e410 0x7f0af81c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0afc945700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af809c710 con 0x7f0af809e000 2023-10-03T10:13:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0afc945700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af81a80e0 con 0x7f0af809d6f0 2023-10-03T10:13:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0afc945700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0af81a63d0 con 0x7f0af809e410 2023-10-03T10:13:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0af5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af809e000 0x7f0af81c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0af5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af809e000 0x7f0af81c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43716/0 (socket says 172.21.15.72:43716) 2023-10-03T10:13:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0af6d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0af809e410 0x7f0af81c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0af5d9b700 1 -- 172.21.15.72:0/2769553795 learned_addr learned my addr 172.21.15.72:0/2769553795 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0af659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0af809d6f0 0x7f0af81c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0af5d9b700 1 -- 172.21.15.72:0/2769553795 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0af809e410 msgr2=0x7f0af81c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0af5d9b700 1 --2- 172.21.15.72:0/2769553795 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0af809e410 0x7f0af81c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0af5d9b700 1 -- 172.21.15.72:0/2769553795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0af809d6f0 msgr2=0x7f0af81c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0af5d9b700 1 --2- 172.21.15.72:0/2769553795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0af809d6f0 0x7f0af81c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.173+0000 7f0af5d9b700 1 -- 172.21.15.72:0/2769553795 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec009550 con 0x7f0af809e000 2023-10-03T10:13:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.174+0000 7f0af5d9b700 1 --2- 172.21.15.72:0/2769553795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af809e000 0x7f0af81c8560 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00ec10 tx=0x7f0aec00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.174+0000 7f0ae6ffd700 1 -- 172.21.15.72:0/2769553795 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec00c850 con 0x7f0af809e000 2023-10-03T10:13:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.174+0000 7f0ae6ffd700 1 -- 172.21.15.72:0/2769553795 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aec00c9b0 con 0x7f0af809e000 2023-10-03T10:13:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.174+0000 7f0ae6ffd700 1 -- 172.21.15.72:0/2769553795 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec00cd60 con 0x7f0af809e000 2023-10-03T10:13:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.174+0000 7f0afc945700 1 -- 172.21.15.72:0/2769553795 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae80094a0 con 0x7f0af809e000 2023-10-03T10:13:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.174+0000 7f0afc945700 1 -- 172.21.15.72:0/2769553795 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af81a6bc0 con 0x7f0af809e000 2023-10-03T10:13:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.175+0000 7f0ae6ffd700 1 -- 172.21.15.72:0/2769553795 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0aec013470 con 0x7f0af809e000 2023-10-03T10:13:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.175+0000 7f0ae6ffd700 1 -- 172.21.15.72:0/2769553795 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0aec03f740 con 0x7f0af809e000 2023-10-03T10:13:21.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.175+0000 7f0afc945700 1 -- 172.21.15.72:0/2769553795 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af8074ea0 con 0x7f0af809e000 2023-10-03T10:13:21.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:21.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.180+0000 7f0ae6ffd700 1 -- 172.21.15.72:0/2769553795 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0aec0232f0 con 0x7f0af809e000 2023-10-03T10:13:21.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.295+0000 7f0ab87f5700 1 Processor -- start 2023-10-03T10:13:21.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.295+0000 7f5628742700 1 Processor -- start 2023-10-03T10:13:21.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.295+0000 7f5628742700 1 -- start start 2023-10-03T10:13:21.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.295+0000 7f0ab87f5700 1 -- start start 2023-10-03T10:13:21.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.295+0000 7f5628742700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56200a09c0 0x7f56200a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.295+0000 7f5628742700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f562009d5c0 0x7f56200a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.295+0000 7f5628742700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133920 0x7f5620133d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.295+0000 7f5628742700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56200a1810 con 0x7f56200a09c0 2023-10-03T10:13:21.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.295+0000 7f5628742700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562009ea10 con 0x7f5620133920 2023-10-03T10:13:21.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f5628742700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f562009e210 con 0x7f562009d5c0 2023-10-03T10:13:21.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab87f5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ab01337f0 0x7f0ab0138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab87f5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ab0138dc0 0x7f0ab013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab87f5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab006b990 con 0x7f0ab0133420 2023-10-03T10:13:21.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab87f5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab009b0e0 con 0x7f0ab01337f0 2023-10-03T10:13:21.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab87f5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab0133c20 con 0x7f0ab0138dc0 2023-10-03T10:13:21.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab6591700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0ab0133420 0x7f0ab0133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60132/0 (socket says 172.21.15.72:60132) 2023-10-03T10:13:21.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab6591700 1 -- 172.21.15.72:0/3332750336 learned_addr learned my addr 172.21.15.72:0/3332750336 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:21.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f5626cdf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133920 0x7f5620133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f5626cdf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133920 0x7f5620133d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38636/0 (socket says 172.21.15.72:38636) 2023-10-03T10:13:21.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f5626cdf700 1 -- 172.21.15.72:0/776507274 learned_addr learned my addr 172.21.15.72:0/776507274 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:21.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f5625cdd700 1 --2- 172.21.15.72:0/776507274 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f562009d5c0 0x7f56200a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab6d92700 1 --2- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ab0138dc0 0x7f0ab013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab558f700 1 -- 172.21.15.72:0/3332750336 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332456285 0 0) 0x7f0ab006b990 con 0x7f0ab0133420 2023-10-03T10:13:21.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab558f700 1 -- 172.21.15.72:0/3332750336 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a9c0035b0 con 0x7f0ab0133420 2023-10-03T10:13:21.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f5626cdf700 1 -- 172.21.15.72:0/776507274 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f562009d5c0 msgr2=0x7f56200a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f5626cdf700 1 --2- 172.21.15.72:0/776507274 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f562009d5c0 0x7f56200a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f5626cdf700 1 -- 172.21.15.72:0/776507274 >> v2:172.21.15.72:3300/0 conn(0x7f56200a09c0 msgr2=0x7f56200a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f5626cdf700 1 --2- 172.21.15.72:0/776507274 >> v2:172.21.15.72:3300/0 conn(0x7f56200a09c0 0x7f56200a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f5626cdf700 1 -- 172.21.15.72:0/776507274 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56200a26f0 con 0x7f5620133920 2023-10-03T10:13:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab558f700 1 -- 172.21.15.72:0/3332750336 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4220923720 0 0) 0x7f0a9c0035b0 con 0x7f0ab0133420 2023-10-03T10:13:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab558f700 1 -- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ab0138dc0 msgr2=0x7f0ab013b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab558f700 1 --2- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ab0138dc0 0x7f0ab013b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab558f700 1 -- 172.21.15.72:0/3332750336 >> v2:172.21.15.72:3300/0 conn(0x7f0ab01337f0 msgr2=0x7f0ab0138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab558f700 1 --2- 172.21.15.72:0/3332750336 >> v2:172.21.15.72:3300/0 conn(0x7f0ab01337f0 0x7f0ab0138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab558f700 1 -- 172.21.15.72:0/3332750336 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab00a0590 con 0x7f0ab0133420 2023-10-03T10:13:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.296+0000 7f0ab558f700 1 -- 172.21.15.72:0/3332750336 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 244944926 0 0) 0x7f0aac001670 con 0x7f0ab0133420 2023-10-03T10:13:21.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab558f700 1 -- 172.21.15.72:0/3332750336 >> v1:172.21.15.72:6789/0 conn(0x7f0ab0133420 legacy=0x7f0ab0133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f5626cdf700 1 --2- 172.21.15.72:0/776507274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133920 0x7f5620133d70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5618009e50 tx=0x7f561800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5f0f315c40e02b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab558f700 1 --2- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a9c003a00 0x7f0a9c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab558f700 1 --2- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a9c004430 0x7f0a9c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab558f700 1 --2- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ab0138dc0 0x7f0a9c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab558f700 1 -- 172.21.15.72:0/3332750336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab009b0e0 con 0x7f0a9c003a00 2023-10-03T10:13:21.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab558f700 1 -- 172.21.15.72:0/3332750336 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab0133c20 con 0x7f0a9c004430 2023-10-03T10:13:21.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab558f700 1 -- 172.21.15.72:0/3332750336 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c00bb90 con 0x7f0ab0138dc0 2023-10-03T10:13:21.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab6591700 1 --2- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a9c003a00 0x7f0a9c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab5d90700 1 --2- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a9c004430 0x7f0a9c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab6d92700 1 --2- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ab0138dc0 0x7f0a9c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab6591700 1 -- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ab0138dc0 msgr2=0x7f0a9c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab6591700 1 --2- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ab0138dc0 0x7f0a9c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab6591700 1 -- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a9c004430 msgr2=0x7f0a9c0048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab6591700 1 --2- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a9c004430 0x7f0a9c0048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab6591700 1 -- 172.21.15.72:0/3332750336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab00a0590 con 0x7f0a9c003a00 2023-10-03T10:13:21.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab6591700 1 --2- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a9c003a00 0x7f0a9c003e10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00c4e0 tx=0x7f0a9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813de2f08706fb22 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f0ab558f700 1 -- 172.21.15.72:0/3332750336 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac005960 con 0x7f0a9c003a00 2023-10-03T10:13:21.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f56254dc700 1 -- 172.21.15.72:0/776507274 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561800e070 con 0x7f5620133920 2023-10-03T10:13:21.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f56254dc700 1 -- 172.21.15.72:0/776507274 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561800b910 con 0x7f5620133920 2023-10-03T10:13:21.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.298+0000 7f0ab558f700 1 -- 172.21.15.72:0/3332750336 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac005ac0 con 0x7f0a9c003a00 2023-10-03T10:13:21.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.298+0000 7f0ab558f700 1 -- 172.21.15.72:0/3332750336 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac005e50 con 0x7f0a9c003a00 2023-10-03T10:13:21.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.297+0000 7f56254dc700 1 -- 172.21.15.72:0/776507274 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561800bcc0 con 0x7f5620133920 2023-10-03T10:13:21.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.298+0000 7f5628742700 1 -- 172.21.15.72:0/776507274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133920 msgr2=0x7f5620133d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.298+0000 7f5628742700 1 --2- 172.21.15.72:0/776507274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133920 0x7f5620133d70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5618009e50 tx=0x7f561800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:21.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.298+0000 7f0ab87f5700 1 -- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a9c003a00 msgr2=0x7f0a9c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.298+0000 7f0ab87f5700 1 --2- 172.21.15.72:0/3332750336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a9c003a00 0x7f0a9c003e10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00c4e0 tx=0x7f0a9c005880 comp rx=0 tx=0).stop 2023-10-03T10:13:21.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.298+0000 7f0ab6d92700 1 -- 172.21.15.72:0/3332750336 reap_dead start 2023-10-03T10:13:21.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.299+0000 7f0ab87f5700 1 -- 172.21.15.72:0/3332750336 shutdown_connections 2023-10-03T10:13:21.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.299+0000 7f0ab87f5700 1 -- 172.21.15.72:0/3332750336 >> 172.21.15.72:0/3332750336 conn(0x7f0ab00a4210 msgr2=0x7f0ab00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.299+0000 7f5628742700 1 -- 172.21.15.72:0/776507274 shutdown_connections 2023-10-03T10:13:21.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.299+0000 7f5628742700 1 --2- 172.21.15.72:0/776507274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133920 0x7f5620133d70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.299+0000 7f5628742700 1 --2- 172.21.15.72:0/776507274 >> v2:172.21.15.72:3300/0 conn(0x7f56200a09c0 0x7f56200a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.299+0000 7f5628742700 1 --2- 172.21.15.72:0/776507274 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f562009d5c0 0x7f56200a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.299+0000 7f5628742700 1 -- 172.21.15.72:0/776507274 >> 172.21.15.72:0/776507274 conn(0x7f56200a2fe0 msgr2=0x7f56200a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.299+0000 7f0ab87f5700 1 -- 172.21.15.72:0/3332750336 shutdown_connections 2023-10-03T10:13:21.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.299+0000 7f0ab87f5700 1 -- 172.21.15.72:0/3332750336 wait complete. 2023-10-03T10:13:21.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.299+0000 7f5628742700 1 -- 172.21.15.72:0/776507274 shutdown_connections 2023-10-03T10:13:21.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.299+0000 7f5628742700 1 -- 172.21.15.72:0/776507274 wait complete. 2023-10-03T10:13:21.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.300+0000 7f0ab87f5700 1 Processor -- start 2023-10-03T10:13:21.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.300+0000 7f5628742700 1 Processor -- start 2023-10-03T10:13:21.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.300+0000 7f0ab87f5700 1 -- start start 2023-10-03T10:13:21.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f0ab87f5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a9c003a00 0x7f0ab012d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f0ab87f5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ab012d600 0x7f0ab006fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f0ab87f5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ab012da10 0x7f0ab00702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f0ab87f5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab0138910 con 0x7f0ab012d600 2023-10-03T10:13:21.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f0ab87f5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab0135e50 con 0x7f0ab012da10 2023-10-03T10:13:21.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f0ab87f5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab0134ef0 con 0x7f0a9c003a00 2023-10-03T10:13:21.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.300+0000 7f5628742700 1 -- start start 2023-10-03T10:13:21.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f5628742700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f562009d5c0 0x7f562006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f5628742700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56200a09c0 0x7f562006e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f5628742700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5620133920 0x7f562006e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f5628742700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56200714f0 con 0x7f5620133920 2023-10-03T10:13:21.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f5628742700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562006fc00 con 0x7f56200a09c0 2023-10-03T10:13:21.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f5628742700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f562009cf30 con 0x7f562009d5c0 2023-10-03T10:13:21.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f56264de700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f562009d5c0 0x7f562006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f56264de700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f562009d5c0 0x7f562006dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40756/0 (socket says 172.21.15.72:40756) 2023-10-03T10:13:21.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f56264de700 1 -- 172.21.15.72:0/1483354967 learned_addr learned my addr 172.21.15.72:0/1483354967 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:21.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f5626cdf700 1 --2- 172.21.15.72:0/1483354967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5620133920 0x7f562006e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f0ab6591700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a9c003a00 0x7f0ab012d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f0ab6591700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a9c003a00 0x7f0ab012d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40758/0 (socket says 172.21.15.72:40758) 2023-10-03T10:13:21.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f0ab6591700 1 -- 172.21.15.72:0/776576007 learned_addr learned my addr 172.21.15.72:0/776576007 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:21.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f0ab6d92700 1 --2- 172.21.15.72:0/776576007 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ab012da10 0x7f0ab00702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f0ab5d90700 1 --2- 172.21.15.72:0/776576007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ab012d600 0x7f0ab006fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f5626cdf700 1 -- 172.21.15.72:0/1483354967 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f562009d5c0 msgr2=0x7f562006dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f5626cdf700 1 --2- 172.21.15.72:0/1483354967 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f562009d5c0 0x7f562006dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f5626cdf700 1 -- 172.21.15.72:0/1483354967 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56200a09c0 msgr2=0x7f562006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f5626cdf700 1 --2- 172.21.15.72:0/1483354967 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56200a09c0 0x7f562006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.301+0000 7f5626cdf700 1 -- 172.21.15.72:0/1483354967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5618009b30 con 0x7f5620133920 2023-10-03T10:13:21.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f0ab6d92700 1 -- 172.21.15.72:0/776576007 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a9c003a00 msgr2=0x7f0ab012d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f0ab6d92700 1 --2- 172.21.15.72:0/776576007 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a9c003a00 0x7f0ab012d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f0ab6d92700 1 -- 172.21.15.72:0/776576007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ab012d600 msgr2=0x7f0ab006fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f0ab6d92700 1 --2- 172.21.15.72:0/776576007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ab012d600 0x7f0ab006fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f0ab6d92700 1 -- 172.21.15.72:0/776576007 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab01346c0 con 0x7f0ab012da10 2023-10-03T10:13:21.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f0ab5d90700 1 --2- 172.21.15.72:0/776576007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ab012d600 0x7f0ab006fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:21.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f5626cdf700 1 --2- 172.21.15.72:0/1483354967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5620133920 0x7f562006e780 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5618015000 tx=0x7f5618004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f0ab6d92700 1 --2- 172.21.15.72:0/776576007 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ab012da10 0x7f0ab00702d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0ab006da40 tx=0x7f0aa8011ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f5616ffd700 1 -- 172.21.15.72:0/1483354967 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5618004450 con 0x7f5620133920 2023-10-03T10:13:21.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f0aa6ffd700 1 -- 172.21.15.72:0/776576007 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa800e040 con 0x7f0ab012da10 2023-10-03T10:13:21.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f5616ffd700 1 -- 172.21.15.72:0/1483354967 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56180045b0 con 0x7f5620133920 2023-10-03T10:13:21.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f5616ffd700 1 -- 172.21.15.72:0/1483354967 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5618004960 con 0x7f5620133920 2023-10-03T10:13:21.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f0aa6ffd700 1 -- 172.21.15.72:0/776576007 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa800f040 con 0x7f0ab012da10 2023-10-03T10:13:21.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f0ab87f5700 1 -- 172.21.15.72:0/776576007 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab0135960 con 0x7f0ab012da10 2023-10-03T10:13:21.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f0aa6ffd700 1 -- 172.21.15.72:0/776576007 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa800fde0 con 0x7f0ab012da10 2023-10-03T10:13:21.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f0ab87f5700 1 -- 172.21.15.72:0/776576007 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab00716b0 con 0x7f0ab012da10 2023-10-03T10:13:21.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f5628742700 1 -- 172.21.15.72:0/1483354967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56200a59d0 con 0x7f5620133920 2023-10-03T10:13:21.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.302+0000 7f5628742700 1 -- 172.21.15.72:0/1483354967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f562006fdd0 con 0x7f5620133920 2023-10-03T10:13:21.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.303+0000 7f0aa6ffd700 1 -- 172.21.15.72:0/776576007 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0aa8015430 con 0x7f0ab012da10 2023-10-03T10:13:21.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.303+0000 7f0aa6ffd700 1 -- 172.21.15.72:0/776576007 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0aa803f7d0 con 0x7f0ab012da10 2023-10-03T10:13:21.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.304+0000 7f0ab87f5700 1 -- 172.21.15.72:0/776576007 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a980052e0 con 0x7f0ab012da10 2023-10-03T10:13:21.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.303+0000 7f5628742700 1 -- 172.21.15.72:0/1483354967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56080052e0 con 0x7f5620133920 2023-10-03T10:13:21.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.304+0000 7f5616ffd700 1 -- 172.21.15.72:0/1483354967 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f561802f480 con 0x7f5620133920 2023-10-03T10:13:21.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.304+0000 7f5616ffd700 1 -- 172.21.15.72:0/1483354967 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5618041420 con 0x7f5620133920 2023-10-03T10:13:21.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.308+0000 7f5616ffd700 1 -- 172.21.15.72:0/1483354967 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56180117a0 con 0x7f5620133920 2023-10-03T10:13:21.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.310+0000 7f0aa6ffd700 1 -- 172.21.15.72:0/776576007 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0aa8025890 con 0x7f0ab012da10 2023-10-03T10:13:21.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.315+0000 7fd321b4c700 1 Processor -- start 2023-10-03T10:13:21.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.315+0000 7fd321b4c700 1 -- start start 2023-10-03T10:13:21.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.316+0000 7fd321b4c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd31c06e570 0x7fd31c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.316+0000 7fd321b4c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd31c09eca0 0x7fd31c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.316+0000 7fd321b4c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31c070ee0 con 0x7fd31c134610 2023-10-03T10:13:21.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.316+0000 7fd321b4c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31c071480 con 0x7fd31c06e570 2023-10-03T10:13:21.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.316+0000 7fd321b4c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c06f3c0 con 0x7fd31c09eca0 2023-10-03T10:13:21.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.318+0000 7fd31affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd31c09eca0 0x7fd31c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.318+0000 7fd31affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd31c09eca0 0x7fd31c06ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40774/0 (socket says 172.21.15.72:40774) 2023-10-03T10:13:21.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.318+0000 7fd31affd700 1 -- 172.21.15.72:0/3162553782 learned_addr learned my addr 172.21.15.72:0/3162553782 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:21.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.318+0000 7fd31affd700 1 -- 172.21.15.72:0/3162553782 >> v2:172.21.15.72:3300/0 conn(0x7fd31c06e570 msgr2=0x7fd31c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.318+0000 7fd31affd700 1 --2- 172.21.15.72:0/3162553782 >> v2:172.21.15.72:3300/0 conn(0x7fd31c06e570 0x7fd31c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.318+0000 7fd31affd700 1 -- 172.21.15.72:0/3162553782 >> v1:172.21.15.72:6789/0 conn(0x7fd31c134610 legacy=0x7fd31c134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:21.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.318+0000 7fd31affd700 1 -- 172.21.15.72:0/3162553782 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c071b90 con 0x7fd31c09eca0 2023-10-03T10:13:21.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.318+0000 7fd31affd700 1 --2- 172.21.15.72:0/3162553782 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd31c09eca0 0x7fd31c06ee80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd3100098f0 tx=0x7fd310009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59f6f55c60f2a51e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.319+0000 7fd31a7fc700 1 -- 172.21.15.72:0/3162553782 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310004230 con 0x7fd31c09eca0 2023-10-03T10:13:21.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.319+0000 7fd31a7fc700 1 -- 172.21.15.72:0/3162553782 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd310004390 con 0x7fd31c09eca0 2023-10-03T10:13:21.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.319+0000 7fd31a7fc700 1 -- 172.21.15.72:0/3162553782 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3100036a0 con 0x7fd31c09eca0 2023-10-03T10:13:21.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.320+0000 7fd321b4c700 1 -- 172.21.15.72:0/3162553782 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd31c09eca0 msgr2=0x7fd31c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.320+0000 7fd321b4c700 1 --2- 172.21.15.72:0/3162553782 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd31c09eca0 0x7fd31c06ee80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd3100098f0 tx=0x7fd310009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:21.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.320+0000 7fd321b4c700 1 -- 172.21.15.72:0/3162553782 shutdown_connections 2023-10-03T10:13:21.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.320+0000 7fd321b4c700 1 --2- 172.21.15.72:0/3162553782 >> v2:172.21.15.72:3300/0 conn(0x7fd31c06e570 0x7fd31c06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.320+0000 7fd321b4c700 1 --2- 172.21.15.72:0/3162553782 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd31c09eca0 0x7fd31c06ee80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.320+0000 7fd321b4c700 1 -- 172.21.15.72:0/3162553782 >> 172.21.15.72:0/3162553782 conn(0x7fd31c0a2aa0 msgr2=0x7fd31c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.320+0000 7fd321b4c700 1 -- 172.21.15.72:0/3162553782 shutdown_connections 2023-10-03T10:13:21.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.320+0000 7fd321b4c700 1 -- 172.21.15.72:0/3162553782 wait complete. 2023-10-03T10:13:21.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.321+0000 7fd321b4c700 1 Processor -- start 2023-10-03T10:13:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.321+0000 7fd321b4c700 1 -- start start 2023-10-03T10:13:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.322+0000 7fd321b4c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd31c06e570 0x7fd31c123180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.322+0000 7fd321b4c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd31c134610 0x7fd31c1236c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.322+0000 7fd321b4c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd31c123c00 0x7fd31c1cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.322+0000 7fd321b4c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c126aa0 con 0x7fd31c123c00 2023-10-03T10:13:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.322+0000 7fd321b4c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c133c80 con 0x7fd31c06e570 2023-10-03T10:13:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.322+0000 7fd321b4c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c124e30 con 0x7fd31c134610 2023-10-03T10:13:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.322+0000 7fd31b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd31c06e570 0x7fd31c123180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.322+0000 7fd31b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd31c06e570 0x7fd31c123180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38658/0 (socket says 172.21.15.72:38658) 2023-10-03T10:13:21.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.322+0000 7fd31b7fe700 1 -- 172.21.15.72:0/2304574327 learned_addr learned my addr 172.21.15.72:0/2304574327 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.322+0000 7fd31bfff700 1 --2- 172.21.15.72:0/2304574327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd31c123c00 0x7fd31c1cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.323+0000 7fd31b7fe700 1 -- 172.21.15.72:0/2304574327 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd31c134610 msgr2=0x7fd31c1236c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.323+0000 7fd31b7fe700 1 --2- 172.21.15.72:0/2304574327 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd31c134610 0x7fd31c1236c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.323+0000 7fd31b7fe700 1 -- 172.21.15.72:0/2304574327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd31c123c00 msgr2=0x7fd31c1cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.323+0000 7fd31b7fe700 1 --2- 172.21.15.72:0/2304574327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd31c123c00 0x7fd31c1cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.323+0000 7fd31b7fe700 1 -- 172.21.15.72:0/2304574327 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd310009550 con 0x7fd31c06e570 2023-10-03T10:13:21.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.323+0000 7fd31bfff700 1 --2- 172.21.15.72:0/2304574327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd31c123c00 0x7fd31c1cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:21.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.323+0000 7fd31b7fe700 1 --2- 172.21.15.72:0/2304574327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd31c06e570 0x7fd31c123180 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00b560 tx=0x7fd30c00b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:21.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.323+0000 7fd303fff700 1 -- 172.21.15.72:0/2304574327 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c011830 con 0x7fd31c06e570 2023-10-03T10:13:21.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.323+0000 7fd303fff700 1 -- 172.21.15.72:0/2304574327 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c0119b0 con 0x7fd31c06e570 2023-10-03T10:13:21.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.323+0000 7fd303fff700 1 -- 172.21.15.72:0/2304574327 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c011d60 con 0x7fd31c06e570 2023-10-03T10:13:21.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.323+0000 7fd321b4c700 1 -- 172.21.15.72:0/2304574327 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c0a2230 con 0x7fd31c06e570 2023-10-03T10:13:21.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.323+0000 7fd321b4c700 1 -- 172.21.15.72:0/2304574327 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31c126700 con 0x7fd31c06e570 2023-10-03T10:13:21.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.324+0000 7fd303fff700 1 -- 172.21.15.72:0/2304574327 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd30c01a400 con 0x7fd31c06e570 2023-10-03T10:13:21.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.324+0000 7fd321b4c700 1 -- 172.21.15.72:0/2304574327 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31c1268f0 con 0x7fd31c06e570 2023-10-03T10:13:21.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.324+0000 7fd303fff700 1 -- 172.21.15.72:0/2304574327 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd30c03f770 con 0x7fd31c06e570 2023-10-03T10:13:21.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.329+0000 7fd303fff700 1 -- 172.21.15.72:0/2304574327 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd30c015070 con 0x7fd31c06e570 2023-10-03T10:13:21.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.392+0000 7f0afc945700 1 -- 172.21.15.72:0/2769553795 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0af81a7040 con 0x7f0af809e000 2023-10-03T10:13:21.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.393+0000 7f0ae6ffd700 1 -- 172.21.15.72:0/2769553795 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0aec021020 con 0x7f0af809e000 2023-10-03T10:13:21.392 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:21.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.394+0000 7f0afc945700 1 -- 172.21.15.72:0/2769553795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af809e000 msgr2=0x7f0af81c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.394+0000 7f0afc945700 1 --2- 172.21.15.72:0/2769553795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af809e000 0x7f0af81c8560 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00ec10 tx=0x7f0aec00ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.395+0000 7f0afc945700 1 -- 172.21.15.72:0/2769553795 shutdown_connections 2023-10-03T10:13:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.395+0000 7f0afc945700 1 --2- 172.21.15.72:0/2769553795 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0af809e410 0x7f0af81c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.395+0000 7f0afc945700 1 --2- 172.21.15.72:0/2769553795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0af809d6f0 0x7f0af81c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.395+0000 7f0afc945700 1 --2- 172.21.15.72:0/2769553795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0af809e000 0x7f0af81c8560 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.395+0000 7f0afc945700 1 -- 172.21.15.72:0/2769553795 >> 172.21.15.72:0/2769553795 conn(0x7f0af8066f50 msgr2=0x7f0af81bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.395+0000 7f0afc945700 1 -- 172.21.15.72:0/2769553795 shutdown_connections 2023-10-03T10:13:21.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.395+0000 7f0afc945700 1 -- 172.21.15.72:0/2769553795 wait complete. 2023-10-03T10:13:21.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:21.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.504+0000 7f5628742700 1 -- 172.21.15.72:0/1483354967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5608005860 con 0x7f5620133920 2023-10-03T10:13:21.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.504+0000 7f5616ffd700 1 -- 172.21.15.72:0/1483354967 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f561802a070 con 0x7f5620133920 2023-10-03T10:13:21.504 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:21.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.504+0000 7f0ab87f5700 1 -- 172.21.15.72:0/776576007 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0a98005590 con 0x7f0ab012da10 2023-10-03T10:13:21.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.505+0000 7f0aa6ffd700 1 -- 172.21.15.72:0/776576007 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0aa80252a0 con 0x7f0ab012da10 2023-10-03T10:13:21.505 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.507+0000 7f5628742700 1 -- 172.21.15.72:0/1483354967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5620133920 msgr2=0x7f562006e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.507+0000 7f5628742700 1 --2- 172.21.15.72:0/1483354967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5620133920 0x7f562006e780 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5618015000 tx=0x7f5618004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.507+0000 7f5628742700 1 -- 172.21.15.72:0/1483354967 shutdown_connections 2023-10-03T10:13:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.507+0000 7f5628742700 1 --2- 172.21.15.72:0/1483354967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5620133920 0x7f562006e780 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.507+0000 7f5628742700 1 --2- 172.21.15.72:0/1483354967 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f562009d5c0 0x7f562006dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.507+0000 7f5628742700 1 --2- 172.21.15.72:0/1483354967 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56200a09c0 0x7f562006e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.507+0000 7f5628742700 1 -- 172.21.15.72:0/1483354967 >> 172.21.15.72:0/1483354967 conn(0x7f56200a2fe0 msgr2=0x7f562009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.507+0000 7f5628742700 1 -- 172.21.15.72:0/1483354967 shutdown_connections 2023-10-03T10:13:21.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.508+0000 7f5628742700 1 -- 172.21.15.72:0/1483354967 wait complete. 2023-10-03T10:13:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.508+0000 7f0ab87f5700 1 -- 172.21.15.72:0/776576007 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ab012da10 msgr2=0x7f0ab00702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.508+0000 7f0ab87f5700 1 --2- 172.21.15.72:0/776576007 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ab012da10 0x7f0ab00702d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0ab006da40 tx=0x7f0aa8011ef0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.508+0000 7f0ab87f5700 1 -- 172.21.15.72:0/776576007 shutdown_connections 2023-10-03T10:13:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.508+0000 7f0ab87f5700 1 --2- 172.21.15.72:0/776576007 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ab012da10 0x7f0ab00702d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.508+0000 7f0ab87f5700 1 --2- 172.21.15.72:0/776576007 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a9c003a00 0x7f0ab012d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.508+0000 7f0ab87f5700 1 --2- 172.21.15.72:0/776576007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ab012d600 0x7f0ab006fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.508+0000 7f0ab87f5700 1 -- 172.21.15.72:0/776576007 >> 172.21.15.72:0/776576007 conn(0x7f0ab00a4210 msgr2=0x7f0ab00a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.508+0000 7f0ab87f5700 1 -- 172.21.15.72:0/776576007 shutdown_connections 2023-10-03T10:13:21.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.508+0000 7f0ab87f5700 1 -- 172.21.15.72:0/776576007 wait complete. 2023-10-03T10:13:21.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:21.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:21.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.526+0000 7fd321b4c700 1 -- 172.21.15.72:0/2304574327 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd31c1274f0 con 0x7fd31c06e570 2023-10-03T10:13:21.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.527+0000 7fd303fff700 1 -- 172.21.15.72:0/2304574327 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd30c015020 con 0x7fd31c06e570 2023-10-03T10:13:21.526 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:21.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.528+0000 7fd321b4c700 1 -- 172.21.15.72:0/2304574327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd31c06e570 msgr2=0x7fd31c123180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:21.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.529+0000 7fd321b4c700 1 --2- 172.21.15.72:0/2304574327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd31c06e570 0x7fd31c123180 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00b560 tx=0x7fd30c00b920 comp rx=0 tx=0).stop 2023-10-03T10:13:21.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.529+0000 7fd321b4c700 1 -- 172.21.15.72:0/2304574327 shutdown_connections 2023-10-03T10:13:21.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.529+0000 7fd321b4c700 1 --2- 172.21.15.72:0/2304574327 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd31c123c00 0x7fd31c1cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.529+0000 7fd321b4c700 1 --2- 172.21.15.72:0/2304574327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd31c06e570 0x7fd31c123180 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.529+0000 7fd321b4c700 1 --2- 172.21.15.72:0/2304574327 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd31c134610 0x7fd31c1236c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:21.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.529+0000 7fd321b4c700 1 -- 172.21.15.72:0/2304574327 >> 172.21.15.72:0/2304574327 conn(0x7fd31c0a2aa0 msgr2=0x7fd31c0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:21.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.529+0000 7fd321b4c700 1 -- 172.21.15.72:0/2304574327 shutdown_connections 2023-10-03T10:13:21.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:21.529+0000 7fd321b4c700 1 -- 172.21.15.72:0/2304574327 wait complete. 2023-10-03T10:13:21.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:22.407 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:22.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:22.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:22.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.541+0000 7fca0f0b0700 1 Processor -- start 2023-10-03T10:13:22.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.541+0000 7fca0f0b0700 1 -- start start 2023-10-03T10:13:22.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:22.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.542+0000 7fca0f0b0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca08130670 0x7fca08130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.542+0000 7fca0f0b0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca0806f680 0x7fca0806fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.542+0000 7fca0f0b0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca08130260 con 0x7fca0806ffd0 2023-10-03T10:13:22.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.542+0000 7fca0f0b0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0809a350 con 0x7fca08130670 2023-10-03T10:13:22.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.542+0000 7fca0f0b0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca08071ff0 con 0x7fca0806f680 2023-10-03T10:13:22.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.542+0000 7fca0ce4c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca08130670 0x7fca08130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.542+0000 7fca0d64d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fca0806ffd0 0x7fca08137530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60142/0 (socket says 172.21.15.72:60142) 2023-10-03T10:13:22.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.542+0000 7fca0d64d700 1 -- 172.21.15.72:0/27995330 learned_addr learned my addr 172.21.15.72:0/27995330 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:22.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.542+0000 7fca07fff700 1 --2- 172.21.15.72:0/27995330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca0806f680 0x7fca0806fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.542+0000 7fca077fe700 1 -- 172.21.15.72:0/27995330 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683484655 0 0) 0x7fca08130260 con 0x7fca0806ffd0 2023-10-03T10:13:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.542+0000 7fca0ce4c700 1 -- 172.21.15.72:0/27995330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca0806f680 msgr2=0x7fca0806fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.542+0000 7fca0ce4c700 1 --2- 172.21.15.72:0/27995330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca0806f680 0x7fca0806fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.542+0000 7fca0ce4c700 1 -- 172.21.15.72:0/27995330 >> v1:172.21.15.72:6789/0 conn(0x7fca0806ffd0 legacy=0x7fca08137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.542+0000 7fca0ce4c700 1 -- 172.21.15.72:0/27995330 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca08070470 con 0x7fca08130670 2023-10-03T10:13:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.542+0000 7fca0ce4c700 1 --2- 172.21.15.72:0/27995330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca08130670 0x7fca08130a40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009870 tx=0x7fc9fc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c9c84121cd56cea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.543+0000 7fca077fe700 1 -- 172.21.15.72:0/27995330 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc011830 con 0x7fca08130670 2023-10-03T10:13:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.543+0000 7fca077fe700 1 -- 172.21.15.72:0/27995330 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc011990 con 0x7fca08130670 2023-10-03T10:13:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.543+0000 7fca077fe700 1 -- 172.21.15.72:0/27995330 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc011d20 con 0x7fca08130670 2023-10-03T10:13:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.543+0000 7fca0f0b0700 1 -- 172.21.15.72:0/27995330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca08130670 msgr2=0x7fca08130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.543+0000 7fca0f0b0700 1 --2- 172.21.15.72:0/27995330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca08130670 0x7fca08130a40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009870 tx=0x7fc9fc009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:22.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.543+0000 7fca0f0b0700 1 -- 172.21.15.72:0/27995330 shutdown_connections 2023-10-03T10:13:22.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.543+0000 7fca0f0b0700 1 --2- 172.21.15.72:0/27995330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca08130670 0x7fca08130a40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.543+0000 7fca0f0b0700 1 --2- 172.21.15.72:0/27995330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca0806f680 0x7fca0806fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.543+0000 7fca0f0b0700 1 -- 172.21.15.72:0/27995330 >> 172.21.15.72:0/27995330 conn(0x7fca080a2aa0 msgr2=0x7fca080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.544+0000 7fca0f0b0700 1 -- 172.21.15.72:0/27995330 shutdown_connections 2023-10-03T10:13:22.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.544+0000 7fca0f0b0700 1 -- 172.21.15.72:0/27995330 wait complete. 2023-10-03T10:13:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.545+0000 7fca0f0b0700 1 Processor -- start 2023-10-03T10:13:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.545+0000 7fca0f0b0700 1 -- start start 2023-10-03T10:13:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.545+0000 7fca0f0b0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca0806f680 0x7fca0811b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.545+0000 7fca0f0b0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca0806ffd0 0x7fca0811bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.545+0000 7fca0f0b0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca08130670 0x7fca0811c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.545+0000 7fca0f0b0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0811cc40 con 0x7fca08130670 2023-10-03T10:13:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.545+0000 7fca0f0b0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0811ef40 con 0x7fca0806ffd0 2023-10-03T10:13:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.545+0000 7fca0f0b0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca0811f190 con 0x7fca0806f680 2023-10-03T10:13:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.545+0000 7fca0d64d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca08130670 0x7fca0811c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.545+0000 7fca0ce4c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca0806f680 0x7fca0811b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.545+0000 7fca0d64d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca08130670 0x7fca0811c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43774/0 (socket says 172.21.15.72:43774) 2023-10-03T10:13:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.545+0000 7fca0ce4c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca0806f680 0x7fca0811b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40808/0 (socket says 172.21.15.72:40808) 2023-10-03T10:13:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.545+0000 7fca0d64d700 1 -- 172.21.15.72:0/4210583736 learned_addr learned my addr 172.21.15.72:0/4210583736 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.546+0000 7fca07fff700 1 --2- 172.21.15.72:0/4210583736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca0806ffd0 0x7fca0811bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.546+0000 7fca0d64d700 1 -- 172.21.15.72:0/4210583736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca0806f680 msgr2=0x7fca0811b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.546+0000 7fca0d64d700 1 --2- 172.21.15.72:0/4210583736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca0806f680 0x7fca0811b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.546+0000 7fca0d64d700 1 -- 172.21.15.72:0/4210583736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca0806ffd0 msgr2=0x7fca0811bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.546+0000 7fca0d64d700 1 --2- 172.21.15.72:0/4210583736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca0806ffd0 0x7fca0811bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.546+0000 7fca0d64d700 1 -- 172.21.15.72:0/4210583736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc0094a0 con 0x7fca08130670 2023-10-03T10:13:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.546+0000 7fca07fff700 1 --2- 172.21.15.72:0/4210583736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca0806ffd0 0x7fca0811bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.546+0000 7fca0d64d700 1 --2- 172.21.15.72:0/4210583736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca08130670 0x7fca0811c2d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fca00002230 tx=0x7fca0000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.546+0000 7fca057fa700 1 -- 172.21.15.72:0/4210583736 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0000ab70 con 0x7fca08130670 2023-10-03T10:13:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.546+0000 7fca057fa700 1 -- 172.21.15.72:0/4210583736 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0000acf0 con 0x7fca08130670 2023-10-03T10:13:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.546+0000 7fca0f0b0700 1 -- 172.21.15.72:0/4210583736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0812da50 con 0x7fca08130670 2023-10-03T10:13:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.546+0000 7fca057fa700 1 -- 172.21.15.72:0/4210583736 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca00007310 con 0x7fca08130670 2023-10-03T10:13:22.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.546+0000 7fca0f0b0700 1 -- 172.21.15.72:0/4210583736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0811e4d0 con 0x7fca08130670 2023-10-03T10:13:22.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.547+0000 7fca0f0b0700 1 -- 172.21.15.72:0/4210583736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca08074ea0 con 0x7fca08130670 2023-10-03T10:13:22.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.548+0000 7fca057fa700 1 -- 172.21.15.72:0/4210583736 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca00007470 con 0x7fca08130670 2023-10-03T10:13:22.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.548+0000 7fca057fa700 1 -- 172.21.15.72:0/4210583736 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fca0003f870 con 0x7fca08130670 2023-10-03T10:13:22.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.553+0000 7fca057fa700 1 -- 172.21.15.72:0/4210583736 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca0000ae60 con 0x7fca08130670 2023-10-03T10:13:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.661+0000 7f953219d700 1 Processor -- start 2023-10-03T10:13:22.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.661+0000 7f953219d700 1 -- start start 2023-10-03T10:13:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.662+0000 7f953219d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f952c09e1d0 0x7f952c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.662+0000 7f953219d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f952c139170 0x7f952c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.662+0000 7f953219d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c09b120 con 0x7f952c09d6f0 2023-10-03T10:13:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.662+0000 7f953219d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952c06b460 con 0x7f952c139170 2023-10-03T10:13:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.662+0000 7f953219d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c09a7e0 con 0x7f952c09e1d0 2023-10-03T10:13:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.662+0000 7f952bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f952c139170 0x7f952c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.662+0000 7f952b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f952c09d6f0 0x7f952c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60146/0 (socket says 172.21.15.72:60146) 2023-10-03T10:13:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.662+0000 7f952b7fe700 1 -- 172.21.15.72:0/74813918 learned_addr learned my addr 172.21.15.72:0/74813918 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.662+0000 7f952a7fc700 1 -- 172.21.15.72:0/74813918 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637389758 0 0) 0x7f952c09b120 con 0x7f952c09d6f0 2023-10-03T10:13:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.662+0000 7f952a7fc700 1 -- 172.21.15.72:0/74813918 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95140035b0 con 0x7f952c09d6f0 2023-10-03T10:13:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.662+0000 7f952bfff700 1 -- 172.21.15.72:0/74813918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f952c09e1d0 msgr2=0x7f952c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.662+0000 7f952bfff700 1 --2- 172.21.15.72:0/74813918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f952c09e1d0 0x7f952c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.662+0000 7f952bfff700 1 -- 172.21.15.72:0/74813918 >> v1:172.21.15.72:6789/0 conn(0x7f952c09d6f0 legacy=0x7f952c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.662+0000 7f952bfff700 1 -- 172.21.15.72:0/74813918 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c09a500 con 0x7f952c139170 2023-10-03T10:13:22.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.663+0000 7f952bfff700 1 --2- 172.21.15.72:0/74813918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c139170 0x7f952c13b550 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9524009d90 tx=0x7f952400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c665e6a17e82912 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:22.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.663+0000 7f952a7fc700 1 -- 172.21.15.72:0/74813918 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952400e070 con 0x7f952c139170 2023-10-03T10:13:22.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.663+0000 7f952a7fc700 1 -- 172.21.15.72:0/74813918 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952400bb20 con 0x7f952c139170 2023-10-03T10:13:22.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.663+0000 7f952a7fc700 1 -- 172.21.15.72:0/74813918 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9524012430 con 0x7f952c139170 2023-10-03T10:13:22.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.664+0000 7f953219d700 1 -- 172.21.15.72:0/74813918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c139170 msgr2=0x7f952c13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.664+0000 7f953219d700 1 --2- 172.21.15.72:0/74813918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c139170 0x7f952c13b550 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9524009d90 tx=0x7f952400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:22.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.664+0000 7f953219d700 1 -- 172.21.15.72:0/74813918 shutdown_connections 2023-10-03T10:13:22.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.664+0000 7f953219d700 1 --2- 172.21.15.72:0/74813918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c139170 0x7f952c13b550 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.664+0000 7f953219d700 1 --2- 172.21.15.72:0/74813918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f952c09e1d0 0x7f952c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.664+0000 7f953219d700 1 -- 172.21.15.72:0/74813918 >> 172.21.15.72:0/74813918 conn(0x7f952c066f50 msgr2=0x7f952c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.664+0000 7f953219d700 1 -- 172.21.15.72:0/74813918 shutdown_connections 2023-10-03T10:13:22.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.664+0000 7f953219d700 1 -- 172.21.15.72:0/74813918 wait complete. 2023-10-03T10:13:22.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.665+0000 7f953219d700 1 Processor -- start 2023-10-03T10:13:22.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.665+0000 7f953219d700 1 -- start start 2023-10-03T10:13:22.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.665+0000 7f953219d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c09d6f0 0x7f952c1206b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.665+0000 7f953219d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f952c09e1d0 0x7f952c120bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.665+0000 7f953219d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f952c139170 0x7f952c121130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.665+0000 7f953219d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c123110 con 0x7f952c09d6f0 2023-10-03T10:13:22.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.665+0000 7f953219d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0a3ab0 con 0x7f952c139170 2023-10-03T10:13:22.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.665+0000 7f953219d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f952c09c710 con 0x7f952c09e1d0 2023-10-03T10:13:22.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.665+0000 7f952affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f952c09e1d0 0x7f952c120bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.665+0000 7f952b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c09d6f0 0x7f952c1206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.665+0000 7f952affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f952c09e1d0 0x7f952c120bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40814/0 (socket says 172.21.15.72:40814) 2023-10-03T10:13:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.665+0000 7f952affd700 1 -- 172.21.15.72:0/3193021444 learned_addr learned my addr 172.21.15.72:0/3193021444 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.665+0000 7f952bfff700 1 --2- 172.21.15.72:0/3193021444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f952c139170 0x7f952c121130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.666+0000 7f952affd700 1 -- 172.21.15.72:0/3193021444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f952c139170 msgr2=0x7f952c121130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.666+0000 7f952affd700 1 --2- 172.21.15.72:0/3193021444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f952c139170 0x7f952c121130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.666+0000 7f952affd700 1 -- 172.21.15.72:0/3193021444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c09d6f0 msgr2=0x7f952c1206b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.666+0000 7f952affd700 1 --2- 172.21.15.72:0/3193021444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c09d6f0 0x7f952c1206b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.666+0000 7f952affd700 1 -- 172.21.15.72:0/3193021444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9524009a70 con 0x7f952c09e1d0 2023-10-03T10:13:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.666+0000 7f952bfff700 1 --2- 172.21.15.72:0/3193021444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f952c139170 0x7f952c121130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.666+0000 7f952affd700 1 --2- 172.21.15.72:0/3193021444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f952c09e1d0 0x7f952c120bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f952000b530 tx=0x7f952000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.666+0000 7f9513fff700 1 -- 172.21.15.72:0/3193021444 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520011830 con 0x7f952c09e1d0 2023-10-03T10:13:22.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.666+0000 7f9513fff700 1 -- 172.21.15.72:0/3193021444 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9520011990 con 0x7f952c09e1d0 2023-10-03T10:13:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.666+0000 7f953219d700 1 -- 172.21.15.72:0/3193021444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c123530 con 0x7f952c09e1d0 2023-10-03T10:13:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.666+0000 7f9513fff700 1 -- 172.21.15.72:0/3193021444 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520011d40 con 0x7f952c09e1d0 2023-10-03T10:13:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.666+0000 7f953219d700 1 -- 172.21.15.72:0/3193021444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c124910 con 0x7f952c09e1d0 2023-10-03T10:13:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.667+0000 7f9513fff700 1 -- 172.21.15.72:0/3193021444 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f952001a400 con 0x7f952c09e1d0 2023-10-03T10:13:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.667+0000 7f953219d700 1 -- 172.21.15.72:0/3193021444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c074ea0 con 0x7f952c09e1d0 2023-10-03T10:13:22.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.667+0000 7f9513fff700 1 -- 172.21.15.72:0/3193021444 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f952003f680 con 0x7f952c09e1d0 2023-10-03T10:13:22.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.674+0000 7f9513fff700 1 -- 172.21.15.72:0/3193021444 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f952000f8b0 con 0x7f952c09e1d0 2023-10-03T10:13:22.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.677+0000 7f34a9670700 1 Processor -- start 2023-10-03T10:13:22.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.677+0000 7f34a9670700 1 -- start start 2023-10-03T10:13:22.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.678+0000 7f34a9670700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34a409d6f0 0x7f34a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.678+0000 7f34a9670700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a409e000 0x7f34a41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.678+0000 7f34a9670700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a409b120 con 0x7f34a409e410 2023-10-03T10:13:22.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.678+0000 7f34a9670700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a406b460 con 0x7f34a409d6f0 2023-10-03T10:13:22.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.678+0000 7f34a9670700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34a409a7e0 con 0x7f34a409e000 2023-10-03T10:13:22.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.678+0000 7f34a2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34a409d6f0 0x7f34a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.678+0000 7f34a2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34a409d6f0 0x7f34a409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43792/0 (socket says 172.21.15.72:43792) 2023-10-03T10:13:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.678+0000 7f34a2ffd700 1 -- 172.21.15.72:0/1491994537 learned_addr learned my addr 172.21.15.72:0/1491994537 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.678+0000 7f34a2ffd700 1 -- 172.21.15.72:0/1491994537 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a409e000 msgr2=0x7f34a41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.678+0000 7f34a2ffd700 1 --2- 172.21.15.72:0/1491994537 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a409e000 0x7f34a41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.678+0000 7f34a2ffd700 1 -- 172.21.15.72:0/1491994537 >> v1:172.21.15.72:6789/0 conn(0x7f34a409e410 legacy=0x7f34a4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.678+0000 7f34a2ffd700 1 -- 172.21.15.72:0/1491994537 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a409a500 con 0x7f34a409d6f0 2023-10-03T10:13:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.678+0000 7f34a2ffd700 1 --2- 172.21.15.72:0/1491994537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a409d6f0 0x7f34a409dac0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f34940098f0 tx=0x7f3494009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418b8476d71e3795 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.679+0000 7f34a1ffb700 1 -- 172.21.15.72:0/1491994537 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494004230 con 0x7f34a409d6f0 2023-10-03T10:13:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.679+0000 7f34a1ffb700 1 -- 172.21.15.72:0/1491994537 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3494004390 con 0x7f34a409d6f0 2023-10-03T10:13:22.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.679+0000 7f34a1ffb700 1 -- 172.21.15.72:0/1491994537 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34940036a0 con 0x7f34a409d6f0 2023-10-03T10:13:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.679+0000 7f34a9670700 1 -- 172.21.15.72:0/1491994537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a409d6f0 msgr2=0x7f34a409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.679+0000 7f34a9670700 1 --2- 172.21.15.72:0/1491994537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a409d6f0 0x7f34a409dac0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f34940098f0 tx=0x7f3494009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.679+0000 7f34a9670700 1 -- 172.21.15.72:0/1491994537 shutdown_connections 2023-10-03T10:13:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.679+0000 7f34a9670700 1 --2- 172.21.15.72:0/1491994537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a409d6f0 0x7f34a409dac0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.679+0000 7f34a9670700 1 --2- 172.21.15.72:0/1491994537 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a409e000 0x7f34a41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.679+0000 7f34a9670700 1 -- 172.21.15.72:0/1491994537 >> 172.21.15.72:0/1491994537 conn(0x7f34a4066f50 msgr2=0x7f34a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.679+0000 7f34a9670700 1 -- 172.21.15.72:0/1491994537 shutdown_connections 2023-10-03T10:13:22.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.679+0000 7f34a9670700 1 -- 172.21.15.72:0/1491994537 wait complete. 2023-10-03T10:13:22.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.680+0000 7f34a9670700 1 Processor -- start 2023-10-03T10:13:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.680+0000 7f34a9670700 1 -- start start 2023-10-03T10:13:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a9670700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a409d6f0 0x7f34a41cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a9670700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a409e000 0x7f34a41cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a9670700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a409e410 0x7f34a41194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a9670700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a411d0e0 con 0x7f34a409e000 2023-10-03T10:13:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a9670700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40a3340 con 0x7f34a409e410 2023-10-03T10:13:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a9670700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34a41b9620 con 0x7f34a409d6f0 2023-10-03T10:13:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a27fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a409e000 0x7f34a41cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a27fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a409e000 0x7f34a41cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43800/0 (socket says 172.21.15.72:43800) 2023-10-03T10:13:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a27fc700 1 -- 172.21.15.72:0/3336925816 learned_addr learned my addr 172.21.15.72:0/3336925816 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a37fe700 1 --2- 172.21.15.72:0/3336925816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a409e410 0x7f34a41194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a27fc700 1 -- 172.21.15.72:0/3336925816 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a409d6f0 msgr2=0x7f34a41cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a27fc700 1 --2- 172.21.15.72:0/3336925816 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a409d6f0 0x7f34a41cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a27fc700 1 -- 172.21.15.72:0/3336925816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a409e410 msgr2=0x7f34a41194b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a27fc700 1 --2- 172.21.15.72:0/3336925816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a409e410 0x7f34a41194b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a27fc700 1 -- 172.21.15.72:0/3336925816 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3494009550 con 0x7f34a409e000 2023-10-03T10:13:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.681+0000 7f34a27fc700 1 --2- 172.21.15.72:0/3336925816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a409e000 0x7f34a41cd200 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f349800b530 tx=0x7f349800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:22.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.682+0000 7f348b7fe700 1 -- 172.21.15.72:0/3336925816 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498011830 con 0x7f34a409e000 2023-10-03T10:13:22.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.682+0000 7f348b7fe700 1 -- 172.21.15.72:0/3336925816 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34980119b0 con 0x7f34a409e000 2023-10-03T10:13:22.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.682+0000 7f348b7fe700 1 -- 172.21.15.72:0/3336925816 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498011d60 con 0x7f34a409e000 2023-10-03T10:13:22.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.682+0000 7f34a9670700 1 -- 172.21.15.72:0/3336925816 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a411c260 con 0x7f34a409e000 2023-10-03T10:13:22.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.682+0000 7f34a9670700 1 -- 172.21.15.72:0/3336925816 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a411b3e0 con 0x7f34a409e000 2023-10-03T10:13:22.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.683+0000 7f34a9670700 1 -- 172.21.15.72:0/3336925816 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a4074ea0 con 0x7f34a409e000 2023-10-03T10:13:22.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.684+0000 7f348b7fe700 1 -- 172.21.15.72:0/3336925816 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f349801a400 con 0x7f34a409e000 2023-10-03T10:13:22.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.684+0000 7f348b7fe700 1 -- 172.21.15.72:0/3336925816 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f349803fe90 con 0x7f34a409e000 2023-10-03T10:13:22.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.688+0000 7f348b7fe700 1 -- 172.21.15.72:0/3336925816 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f349801ae60 con 0x7f34a409e000 2023-10-03T10:13:22.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.708+0000 7fba9ba0b700 1 Processor -- start 2023-10-03T10:13:22.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.708+0000 7fba9ba0b700 1 -- start start 2023-10-03T10:13:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba9ba0b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba9409de00 0x7fba9409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba9ba0b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9413d1f0 0x7fba9413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba98fa6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba9409de00 0x7fba9409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba98fa6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba9409de00 0x7fba9409e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43816/0 (socket says 172.21.15.72:43816) 2023-10-03T10:13:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba98fa6700 1 -- 172.21.15.72:0/3906245456 learned_addr learned my addr 172.21.15.72:0/3906245456 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3906245456 --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9409a810 con 0x7fba9406a770 2023-10-03T10:13:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3906245456 --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba9406ab40 con 0x7fba9409de00 2023-10-03T10:13:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba99fa8700 1 --2- 172.21.15.72:0/3906245456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9413d1f0 0x7fba9413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3906245456 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9409ebc0 con 0x7fba9413d1f0 2023-10-03T10:13:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba8bfff700 1 -- 172.21.15.72:0/3906245456 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268097504 0 0) 0x7fba9409a810 con 0x7fba9406a770 2023-10-03T10:13:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba8bfff700 1 -- 172.21.15.72:0/3906245456 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba800035b0 con 0x7fba9406a770 2023-10-03T10:13:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba99fa8700 1 -- 172.21.15.72:0/3906245456 >> v2:172.21.15.72:3300/0 conn(0x7fba9409de00 msgr2=0x7fba9409e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba99fa8700 1 --2- 172.21.15.72:0/3906245456 >> v2:172.21.15.72:3300/0 conn(0x7fba9409de00 0x7fba9409e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba99fa8700 1 -- 172.21.15.72:0/3906245456 >> v1:172.21.15.72:6789/0 conn(0x7fba9406a770 legacy=0x7fba9409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba99fa8700 1 -- 172.21.15.72:0/3906245456 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9409e920 con 0x7fba9413d1f0 2023-10-03T10:13:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.709+0000 7fba98fa6700 1 --2- 172.21.15.72:0/3906245456 >> v2:172.21.15.72:3300/0 conn(0x7fba9409de00 0x7fba9409e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.710+0000 7fba99fa8700 1 --2- 172.21.15.72:0/3906245456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9413d1f0 0x7fba9413f5d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009d90 tx=0x7fba8c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c55b3edd3d8e9dcf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.710+0000 7fba8bfff700 1 -- 172.21.15.72:0/3906245456 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c00e070 con 0x7fba9413d1f0 2023-10-03T10:13:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.710+0000 7fba8bfff700 1 -- 172.21.15.72:0/3906245456 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c00bb20 con 0x7fba9413d1f0 2023-10-03T10:13:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.710+0000 7fba8bfff700 1 -- 172.21.15.72:0/3906245456 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c012430 con 0x7fba9413d1f0 2023-10-03T10:13:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.710+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3906245456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9413d1f0 msgr2=0x7fba9413f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.710+0000 7fba9ba0b700 1 --2- 172.21.15.72:0/3906245456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9413d1f0 0x7fba9413f5d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009d90 tx=0x7fba8c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.710+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3906245456 shutdown_connections 2023-10-03T10:13:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.710+0000 7fba9ba0b700 1 --2- 172.21.15.72:0/3906245456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9413d1f0 0x7fba9413f5d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.710+0000 7fba9ba0b700 1 --2- 172.21.15.72:0/3906245456 >> v2:172.21.15.72:3300/0 conn(0x7fba9409de00 0x7fba9409e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.710+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3906245456 >> 172.21.15.72:0/3906245456 conn(0x7fba94066f50 msgr2=0x7fba9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.711+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3906245456 shutdown_connections 2023-10-03T10:13:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.711+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3906245456 wait complete. 2023-10-03T10:13:22.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.712+0000 7fba9ba0b700 1 Processor -- start 2023-10-03T10:13:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.712+0000 7fba9ba0b700 1 -- start start 2023-10-03T10:13:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.712+0000 7fba9ba0b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba9406a770 0x7fba94070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.712+0000 7fba9ba0b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9409de00 0x7fba940710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba9ba0b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9413d1f0 0x7fba94071600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba9ba0b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9406ffa0 con 0x7fba9406a770 2023-10-03T10:13:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba9ba0b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9409f1a0 con 0x7fba9413d1f0 2023-10-03T10:13:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba9ba0b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba940727c0 con 0x7fba9409de00 2023-10-03T10:13:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba997a7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba9406a770 0x7fba94070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba99fa8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9413d1f0 0x7fba94071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba997a7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba9406a770 0x7fba94070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43828/0 (socket says 172.21.15.72:43828) 2023-10-03T10:13:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba997a7700 1 -- 172.21.15.72:0/3258996616 learned_addr learned my addr 172.21.15.72:0/3258996616 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba997a7700 1 -- 172.21.15.72:0/3258996616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9409de00 msgr2=0x7fba940710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba997a7700 1 --2- 172.21.15.72:0/3258996616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9409de00 0x7fba940710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba997a7700 1 -- 172.21.15.72:0/3258996616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9413d1f0 msgr2=0x7fba94071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba997a7700 1 --2- 172.21.15.72:0/3258996616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9413d1f0 0x7fba94071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba997a7700 1 -- 172.21.15.72:0/3258996616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba84009550 con 0x7fba9406a770 2023-10-03T10:13:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba99fa8700 1 --2- 172.21.15.72:0/3258996616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9413d1f0 0x7fba94071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba997a7700 1 --2- 172.21.15.72:0/3258996616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba9406a770 0x7fba94070b80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fba9000c520 tx=0x7fba9000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba89ffb700 1 -- 172.21.15.72:0/3258996616 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba900052d0 con 0x7fba9406a770 2023-10-03T10:13:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba89ffb700 1 -- 172.21.15.72:0/3258996616 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba90005430 con 0x7fba9406a770 2023-10-03T10:13:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3258996616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c009a70 con 0x7fba9406a770 2023-10-03T10:13:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.713+0000 7fba89ffb700 1 -- 172.21.15.72:0/3258996616 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba900038a0 con 0x7fba9406a770 2023-10-03T10:13:22.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.714+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3258996616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9406fa00 con 0x7fba9406a770 2023-10-03T10:13:22.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.715+0000 7fba89ffb700 1 -- 172.21.15.72:0/3258996616 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba90003a00 con 0x7fba9406a770 2023-10-03T10:13:22.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.715+0000 7fba89ffb700 1 -- 172.21.15.72:0/3258996616 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fba9000bf20 con 0x7fba9406a770 2023-10-03T10:13:22.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.715+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3258996616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba94071b90 con 0x7fba9406a770 2023-10-03T10:13:22.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.724+0000 7fba89ffb700 1 -- 172.21.15.72:0/3258996616 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba90017070 con 0x7fba9406a770 2023-10-03T10:13:22.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.814+0000 7fca0f0b0700 1 -- 172.21.15.72:0/4210583736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fca08072210 con 0x7fca08130670 2023-10-03T10:13:22.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.814+0000 7fca057fa700 1 -- 172.21.15.72:0/4210583736 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca00018020 con 0x7fca08130670 2023-10-03T10:13:22.814 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:22.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.816+0000 7fca0f0b0700 1 -- 172.21.15.72:0/4210583736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca08130670 msgr2=0x7fca0811c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.816+0000 7fca0f0b0700 1 --2- 172.21.15.72:0/4210583736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca08130670 0x7fca0811c2d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fca00002230 tx=0x7fca0000cf50 comp rx=0 tx=0).stop 2023-10-03T10:13:22.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.816+0000 7fca0f0b0700 1 -- 172.21.15.72:0/4210583736 shutdown_connections 2023-10-03T10:13:22.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.816+0000 7fca0f0b0700 1 --2- 172.21.15.72:0/4210583736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca08130670 0x7fca0811c2d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.816+0000 7fca0f0b0700 1 --2- 172.21.15.72:0/4210583736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fca0806f680 0x7fca0811b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.816+0000 7fca0f0b0700 1 --2- 172.21.15.72:0/4210583736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca0806ffd0 0x7fca0811bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.816+0000 7fca0f0b0700 1 -- 172.21.15.72:0/4210583736 >> 172.21.15.72:0/4210583736 conn(0x7fca080a2aa0 msgr2=0x7fca080a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.816+0000 7fca0f0b0700 1 -- 172.21.15.72:0/4210583736 shutdown_connections 2023-10-03T10:13:22.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.816+0000 7fca0f0b0700 1 -- 172.21.15.72:0/4210583736 wait complete. 2023-10-03T10:13:22.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:22.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.881+0000 7f953219d700 1 -- 172.21.15.72:0/3193021444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f952c06c360 con 0x7f952c09e1d0 2023-10-03T10:13:22.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.881+0000 7f9513fff700 1 -- 172.21.15.72:0/3193021444 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9520015020 con 0x7f952c09e1d0 2023-10-03T10:13:22.881 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:22.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.884+0000 7f953219d700 1 -- 172.21.15.72:0/3193021444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f952c09e1d0 msgr2=0x7f952c120bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.884+0000 7f953219d700 1 --2- 172.21.15.72:0/3193021444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f952c09e1d0 0x7f952c120bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f952000b530 tx=0x7f952000b840 comp rx=0 tx=0).stop 2023-10-03T10:13:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.885+0000 7f953219d700 1 -- 172.21.15.72:0/3193021444 shutdown_connections 2023-10-03T10:13:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.885+0000 7f953219d700 1 --2- 172.21.15.72:0/3193021444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f952c09d6f0 0x7f952c1206b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.885+0000 7f953219d700 1 --2- 172.21.15.72:0/3193021444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f952c139170 0x7f952c121130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.885+0000 7f953219d700 1 --2- 172.21.15.72:0/3193021444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f952c09e1d0 0x7f952c120bf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.885+0000 7f953219d700 1 -- 172.21.15.72:0/3193021444 >> 172.21.15.72:0/3193021444 conn(0x7f952c066f50 msgr2=0x7f952c136b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.885+0000 7f953219d700 1 -- 172.21.15.72:0/3193021444 shutdown_connections 2023-10-03T10:13:22.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.885+0000 7f953219d700 1 -- 172.21.15.72:0/3193021444 wait complete. 2023-10-03T10:13:22.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.888+0000 7f34a9670700 1 -- 172.21.15.72:0/3336925816 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f34a411bad0 con 0x7f34a409e000 2023-10-03T10:13:22.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.889+0000 7f348b7fe700 1 -- 172.21.15.72:0/3336925816 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3498028070 con 0x7f34a409e000 2023-10-03T10:13:22.888 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:22.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.891+0000 7f34a9670700 1 -- 172.21.15.72:0/3336925816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a409e000 msgr2=0x7f34a41cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.891+0000 7f34a9670700 1 --2- 172.21.15.72:0/3336925816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a409e000 0x7f34a41cd200 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f349800b530 tx=0x7f349800b8f0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.891+0000 7f34a9670700 1 -- 172.21.15.72:0/3336925816 shutdown_connections 2023-10-03T10:13:22.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.891+0000 7f34a9670700 1 --2- 172.21.15.72:0/3336925816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a409e410 0x7f34a41194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.891+0000 7f34a9670700 1 --2- 172.21.15.72:0/3336925816 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a409d6f0 0x7f34a41cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.891+0000 7f34a9670700 1 --2- 172.21.15.72:0/3336925816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a409e000 0x7f34a41cd200 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.891+0000 7f34a9670700 1 -- 172.21.15.72:0/3336925816 >> 172.21.15.72:0/3336925816 conn(0x7f34a4066f50 msgr2=0x7f34a41baf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.891+0000 7f34a9670700 1 -- 172.21.15.72:0/3336925816 shutdown_connections 2023-10-03T10:13:22.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.891+0000 7f34a9670700 1 -- 172.21.15.72:0/3336925816 wait complete. 2023-10-03T10:13:22.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:22.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:22.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.923+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3258996616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fba94074ea0 con 0x7fba9406a770 2023-10-03T10:13:22.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.923+0000 7fba89ffb700 1 -- 172.21.15.72:0/3258996616 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fba9002e030 con 0x7fba9406a770 2023-10-03T10:13:22.923 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:22.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.925+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3258996616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba9406a770 msgr2=0x7fba94070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:22.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.925+0000 7fba9ba0b700 1 --2- 172.21.15.72:0/3258996616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba9406a770 0x7fba94070b80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fba9000c520 tx=0x7fba9000c830 comp rx=0 tx=0).stop 2023-10-03T10:13:22.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.925+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3258996616 shutdown_connections 2023-10-03T10:13:22.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.925+0000 7fba9ba0b700 1 --2- 172.21.15.72:0/3258996616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba9406a770 0x7fba94070b80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.925+0000 7fba9ba0b700 1 --2- 172.21.15.72:0/3258996616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9413d1f0 0x7fba94071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.925+0000 7fba9ba0b700 1 --2- 172.21.15.72:0/3258996616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9409de00 0x7fba940710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:22.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.925+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3258996616 >> 172.21.15.72:0/3258996616 conn(0x7fba94066f50 msgr2=0x7fba9413c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:22.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.925+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3258996616 shutdown_connections 2023-10-03T10:13:22.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:22.925+0000 7fba9ba0b700 1 -- 172.21.15.72:0/3258996616 wait complete. 2023-10-03T10:13:22.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:23.830 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:23.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:23.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:23.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:23.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.968+0000 7fa10fa74700 1 Processor -- start 2023-10-03T10:13:23.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.968+0000 7fa10fa74700 1 -- start start 2023-10-03T10:13:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.969+0000 7fa10fa74700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa108136830 0x7fa108138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.969+0000 7fa10fa74700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa108139150 0x7fa10813b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.969+0000 7fa10fa74700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa10806f720 con 0x7fa1081338c0 2023-10-03T10:13:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.969+0000 7fa10fa74700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa108070c80 con 0x7fa108136830 2023-10-03T10:13:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.969+0000 7fa10fa74700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa10806fce0 con 0x7fa108139150 2023-10-03T10:13:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.969+0000 7fa10d00f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa108136830 0x7fa108138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.969+0000 7fa10e011700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa108139150 0x7fa10813b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.969+0000 7fa10e011700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa108139150 0x7fa10813b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40836/0 (socket says 172.21.15.72:40836) 2023-10-03T10:13:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.969+0000 7fa10d00f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa108136830 0x7fa108138c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38732/0 (socket says 172.21.15.72:38732) 2023-10-03T10:13:23.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.969+0000 7fa10e011700 1 -- 172.21.15.72:0/484643985 learned_addr learned my addr 172.21.15.72:0/484643985 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:23.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.970+0000 7fa10e011700 1 -- 172.21.15.72:0/484643985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa108136830 msgr2=0x7fa108138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.970+0000 7fa10e011700 1 --2- 172.21.15.72:0/484643985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa108136830 0x7fa108138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.970+0000 7fa10e011700 1 -- 172.21.15.72:0/484643985 >> v1:172.21.15.72:6789/0 conn(0x7fa1081338c0 legacy=0x7fa108133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.970+0000 7fa10e011700 1 -- 172.21.15.72:0/484643985 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1081336a0 con 0x7fa108139150 2023-10-03T10:13:23.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.970+0000 7fa10c80e700 1 -- 172.21.15.72:0/484643985 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383497474 0 0) 0x7fa10806f720 con 0x7fa1081338c0 2023-10-03T10:13:23.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.970+0000 7fa10e011700 1 --2- 172.21.15.72:0/484643985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa108139150 0x7fa10813b530 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009e80 tx=0x7fa0f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1abd9006bbb1125 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.970+0000 7fa10c80e700 1 -- 172.21.15.72:0/484643985 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f800e070 con 0x7fa108139150 2023-10-03T10:13:23.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.970+0000 7fa10c80e700 1 -- 172.21.15.72:0/484643985 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f800b910 con 0x7fa108139150 2023-10-03T10:13:23.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.970+0000 7fa10c80e700 1 -- 172.21.15.72:0/484643985 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f800bcc0 con 0x7fa108139150 2023-10-03T10:13:23.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.971+0000 7fa10fa74700 1 -- 172.21.15.72:0/484643985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa108139150 msgr2=0x7fa10813b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.971+0000 7fa10fa74700 1 --2- 172.21.15.72:0/484643985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa108139150 0x7fa10813b530 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009e80 tx=0x7fa0f800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:23.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.971+0000 7fa10fa74700 1 -- 172.21.15.72:0/484643985 shutdown_connections 2023-10-03T10:13:23.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.971+0000 7fa10fa74700 1 --2- 172.21.15.72:0/484643985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa108139150 0x7fa10813b530 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.971+0000 7fa10fa74700 1 --2- 172.21.15.72:0/484643985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa108136830 0x7fa108138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.971+0000 7fa10fa74700 1 -- 172.21.15.72:0/484643985 >> 172.21.15.72:0/484643985 conn(0x7fa1080a2aa0 msgr2=0x7fa1080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.971+0000 7fa10fa74700 1 -- 172.21.15.72:0/484643985 shutdown_connections 2023-10-03T10:13:23.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.971+0000 7fa10fa74700 1 -- 172.21.15.72:0/484643985 wait complete. 2023-10-03T10:13:23.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.972+0000 7fa10fa74700 1 Processor -- start 2023-10-03T10:13:23.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.973+0000 7fa10fa74700 1 -- start start 2023-10-03T10:13:23.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.973+0000 7fa10fa74700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1081338c0 0x7fa108119c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.973+0000 7fa10fa74700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa108136830 0x7fa10811a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.973+0000 7fa10fa74700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa108139150 0x7fa10811a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.973+0000 7fa10fa74700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10811b910 con 0x7fa108139150 2023-10-03T10:13:23.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.973+0000 7fa10fa74700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10812fac0 con 0x7fa108136830 2023-10-03T10:13:23.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.973+0000 7fa10fa74700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa10806f960 con 0x7fa1081338c0 2023-10-03T10:13:23.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.973+0000 7fa10d00f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa108136830 0x7fa10811a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.973+0000 7fa10d810700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1081338c0 0x7fa108119c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.973+0000 7fa10d00f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa108136830 0x7fa10811a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38746/0 (socket says 172.21.15.72:38746) 2023-10-03T10:13:23.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.973+0000 7fa10d00f700 1 -- 172.21.15.72:0/2462245902 learned_addr learned my addr 172.21.15.72:0/2462245902 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:23.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.974+0000 7fa10e011700 1 --2- 172.21.15.72:0/2462245902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa108139150 0x7fa10811a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.974+0000 7fa10d810700 1 -- 172.21.15.72:0/2462245902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa108136830 msgr2=0x7fa10811a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.974+0000 7fa10d810700 1 --2- 172.21.15.72:0/2462245902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa108136830 0x7fa10811a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.974+0000 7fa10d810700 1 -- 172.21.15.72:0/2462245902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa108139150 msgr2=0x7fa10811a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.974+0000 7fa10d810700 1 --2- 172.21.15.72:0/2462245902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa108139150 0x7fa10811a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.974+0000 7fa10d810700 1 -- 172.21.15.72:0/2462245902 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f8009b30 con 0x7fa1081338c0 2023-10-03T10:13:23.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.974+0000 7fa10e011700 1 --2- 172.21.15.72:0/2462245902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa108139150 0x7fa10811a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:23.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.974+0000 7fa10d810700 1 --2- 172.21.15.72:0/2462245902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1081338c0 0x7fa108119c80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa10000c430 tx=0x7fa10000c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.974+0000 7fa1067fc700 1 -- 172.21.15.72:0/2462245902 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1000054e0 con 0x7fa1081338c0 2023-10-03T10:13:23.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.974+0000 7fa1067fc700 1 -- 172.21.15.72:0/2462245902 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa100003680 con 0x7fa1081338c0 2023-10-03T10:13:23.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.974+0000 7fa10fa74700 1 -- 172.21.15.72:0/2462245902 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10811d170 con 0x7fa1081338c0 2023-10-03T10:13:23.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.974+0000 7fa1067fc700 1 -- 172.21.15.72:0/2462245902 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa100003a30 con 0x7fa1081338c0 2023-10-03T10:13:23.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.974+0000 7fa10fa74700 1 -- 172.21.15.72:0/2462245902 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10811ce20 con 0x7fa1081338c0 2023-10-03T10:13:23.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.975+0000 7fa1067fc700 1 -- 172.21.15.72:0/2462245902 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa100003b90 con 0x7fa1081338c0 2023-10-03T10:13:23.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.975+0000 7fa10fa74700 1 -- 172.21.15.72:0/2462245902 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa108074ea0 con 0x7fa1081338c0 2023-10-03T10:13:23.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.975+0000 7fa1067fc700 1 -- 172.21.15.72:0/2462245902 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa10003eba0 con 0x7fa1081338c0 2023-10-03T10:13:23.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:23.980+0000 7fa1067fc700 1 -- 172.21.15.72:0/2462245902 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa10001b3b0 con 0x7fa1081338c0 2023-10-03T10:13:24.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.056+0000 7f6eed9d7700 1 Processor -- start 2023-10-03T10:13:24.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.056+0000 7f6eed9d7700 1 -- start start 2023-10-03T10:13:24.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.057+0000 7f6eed9d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ee806a770 0x7f6ee809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.057+0000 7f6eed9d7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ee809dc30 0x7f6ee809e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.057+0000 7f6eed9d7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee809a810 con 0x7f6ee813c1e0 2023-10-03T10:13:24.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.057+0000 7f6eed9d7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee806ab40 con 0x7f6ee806a770 2023-10-03T10:13:24.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.057+0000 7f6eed9d7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee809ebc0 con 0x7f6ee809dc30 2023-10-03T10:13:24.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.057+0000 7f6ee6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ee806a770 0x7f6ee809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.057+0000 7f6ee67fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ee809dc30 0x7f6ee809e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.057+0000 7f6ee6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ee806a770 0x7f6ee809d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38758/0 (socket says 172.21.15.72:38758) 2023-10-03T10:13:24.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.057+0000 7f6ee6ffd700 1 -- 172.21.15.72:0/1997509189 learned_addr learned my addr 172.21.15.72:0/1997509189 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.057+0000 7f6ee67fc700 1 -- 172.21.15.72:0/1997509189 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ee806a770 msgr2=0x7f6ee809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.057+0000 7f6ee67fc700 1 --2- 172.21.15.72:0/1997509189 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ee806a770 0x7f6ee809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.057+0000 7f6ee67fc700 1 -- 172.21.15.72:0/1997509189 >> v1:172.21.15.72:6789/0 conn(0x7f6ee813c1e0 legacy=0x7f6ee813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.057+0000 7f6ee67fc700 1 -- 172.21.15.72:0/1997509189 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee809e920 con 0x7f6ee809dc30 2023-10-03T10:13:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.057+0000 7f6ee67fc700 1 --2- 172.21.15.72:0/1997509189 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ee809dc30 0x7f6ee809e080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0098a0 tx=0x7f6edc009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=930f046eb19e35d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.058+0000 7f6ee5ffb700 1 -- 172.21.15.72:0/1997509189 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc011830 con 0x7f6ee809dc30 2023-10-03T10:13:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.058+0000 7f6ee5ffb700 1 -- 172.21.15.72:0/1997509189 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc011990 con 0x7f6ee809dc30 2023-10-03T10:13:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.058+0000 7f6ee5ffb700 1 -- 172.21.15.72:0/1997509189 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc011d20 con 0x7f6ee809dc30 2023-10-03T10:13:24.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.058+0000 7f6eed9d7700 1 -- 172.21.15.72:0/1997509189 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ee809dc30 msgr2=0x7f6ee809e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.058+0000 7f6eed9d7700 1 --2- 172.21.15.72:0/1997509189 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ee809dc30 0x7f6ee809e080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0098a0 tx=0x7f6edc009bb0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.058+0000 7f6eed9d7700 1 -- 172.21.15.72:0/1997509189 shutdown_connections 2023-10-03T10:13:24.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.058+0000 7f6eed9d7700 1 --2- 172.21.15.72:0/1997509189 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ee806a770 0x7f6ee809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.058+0000 7f6eed9d7700 1 --2- 172.21.15.72:0/1997509189 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ee809dc30 0x7f6ee809e080 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.058+0000 7f6eed9d7700 1 -- 172.21.15.72:0/1997509189 >> 172.21.15.72:0/1997509189 conn(0x7f6ee8066f50 msgr2=0x7f6ee809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.058+0000 7f6eed9d7700 1 -- 172.21.15.72:0/1997509189 shutdown_connections 2023-10-03T10:13:24.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.059+0000 7f6eed9d7700 1 -- 172.21.15.72:0/1997509189 wait complete. 2023-10-03T10:13:24.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.059+0000 7f6eed9d7700 1 Processor -- start 2023-10-03T10:13:24.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.060+0000 7f6eed9d7700 1 -- start start 2023-10-03T10:13:24.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.060+0000 7f6eed9d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ee806a770 0x7f6ee813a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.060+0000 7f6eed9d7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ee809dc30 0x7f6ee813ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.060+0000 7f6eed9d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ee813c1e0 0x7f6ee813b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.060+0000 7f6eed9d7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee8134dc0 con 0x7f6ee813c1e0 2023-10-03T10:13:24.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.060+0000 7f6eed9d7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee809f210 con 0x7f6ee806a770 2023-10-03T10:13:24.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.060+0000 7f6eed9d7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee811dd10 con 0x7f6ee809dc30 2023-10-03T10:13:24.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.060+0000 7f6ee6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ee806a770 0x7f6ee813a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.060+0000 7f6ee6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ee806a770 0x7f6ee813a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38766/0 (socket says 172.21.15.72:38766) 2023-10-03T10:13:24.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.060+0000 7f6ee6ffd700 1 -- 172.21.15.72:0/4016248133 learned_addr learned my addr 172.21.15.72:0/4016248133 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:24.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.060+0000 7f6ee77fe700 1 --2- 172.21.15.72:0/4016248133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ee813c1e0 0x7f6ee813b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.060+0000 7f6ee67fc700 1 --2- 172.21.15.72:0/4016248133 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ee809dc30 0x7f6ee813ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.061+0000 7f6ee6ffd700 1 -- 172.21.15.72:0/4016248133 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ee809dc30 msgr2=0x7f6ee813ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.061+0000 7f6ee6ffd700 1 --2- 172.21.15.72:0/4016248133 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ee809dc30 0x7f6ee813ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.061+0000 7f6ee6ffd700 1 -- 172.21.15.72:0/4016248133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ee813c1e0 msgr2=0x7f6ee813b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.061+0000 7f6ee6ffd700 1 --2- 172.21.15.72:0/4016248133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ee813c1e0 0x7f6ee813b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.061+0000 7f6ee6ffd700 1 -- 172.21.15.72:0/4016248133 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc0094a0 con 0x7f6ee806a770 2023-10-03T10:13:24.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.061+0000 7f6ee6ffd700 1 --2- 172.21.15.72:0/4016248133 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ee806a770 0x7f6ee813a6f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800e940 tx=0x7f6ed800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.061+0000 7f6ecffff700 1 -- 172.21.15.72:0/4016248133 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed80096a0 con 0x7f6ee806a770 2023-10-03T10:13:24.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.061+0000 7f6ecffff700 1 -- 172.21.15.72:0/4016248133 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed8013680 con 0x7f6ee806a770 2023-10-03T10:13:24.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.061+0000 7f6ecffff700 1 -- 172.21.15.72:0/4016248133 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8013a30 con 0x7f6ee806a770 2023-10-03T10:13:24.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.061+0000 7f6eed9d7700 1 -- 172.21.15.72:0/4016248133 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee809a4e0 con 0x7f6ee806a770 2023-10-03T10:13:24.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.061+0000 7f6eed9d7700 1 -- 172.21.15.72:0/4016248133 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee811da50 con 0x7f6ee806a770 2023-10-03T10:13:24.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.062+0000 7f6eed9d7700 1 -- 172.21.15.72:0/4016248133 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee8074ea0 con 0x7f6ee806a770 2023-10-03T10:13:24.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.062+0000 7f6ecffff700 1 -- 172.21.15.72:0/4016248133 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ed8013b90 con 0x7f6ee806a770 2023-10-03T10:13:24.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.063+0000 7f6ecffff700 1 -- 172.21.15.72:0/4016248133 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6ed803fb60 con 0x7f6ee806a770 2023-10-03T10:13:24.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.067+0000 7f6ecffff700 1 -- 172.21.15.72:0/4016248133 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ed80119a0 con 0x7f6ee806a770 2023-10-03T10:13:24.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.073+0000 7f898e100700 1 Processor -- start 2023-10-03T10:13:24.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.073+0000 7f898e100700 1 -- start start 2023-10-03T10:13:24.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.073+0000 7f898e100700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8988131810 0x7f8988131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.073+0000 7f898e100700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f898809a580 0x7f8988139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.073+0000 7f898e100700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89881313c0 con 0x7f8988099a40 2023-10-03T10:13:24.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.073+0000 7f898e100700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898806e8c0 con 0x7f8988131810 2023-10-03T10:13:24.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.073+0000 7f898e100700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8988071d20 con 0x7f898809a580 2023-10-03T10:13:24.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.074+0000 7f8987fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f898809a580 0x7f8988139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.074+0000 7f8987fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f898809a580 0x7f8988139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38782/0 (socket says 172.21.15.72:38782) 2023-10-03T10:13:24.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.074+0000 7f8987fff700 1 -- 172.21.15.72:0/3202617635 learned_addr learned my addr 172.21.15.72:0/3202617635 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:24.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.074+0000 7f8987fff700 1 -- 172.21.15.72:0/3202617635 >> v2:172.21.15.72:3300/0 conn(0x7f8988131810 msgr2=0x7f8988131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.074+0000 7f8987fff700 1 --2- 172.21.15.72:0/3202617635 >> v2:172.21.15.72:3300/0 conn(0x7f8988131810 0x7f8988131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.074+0000 7f8987fff700 1 -- 172.21.15.72:0/3202617635 >> v1:172.21.15.72:6789/0 conn(0x7f8988099a40 legacy=0x7f8988099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.074+0000 7f8987fff700 1 -- 172.21.15.72:0/3202617635 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89880721a0 con 0x7f898809a580 2023-10-03T10:13:24.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.074+0000 7f8987fff700 1 --2- 172.21.15.72:0/3202617635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f898809a580 0x7f8988139660 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8980009e50 tx=0x7f898000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd694dd1a346cac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.074+0000 7f89867fc700 1 -- 172.21.15.72:0/3202617635 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898000e070 con 0x7f898809a580 2023-10-03T10:13:24.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.074+0000 7f89867fc700 1 -- 172.21.15.72:0/3202617635 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8980003a20 con 0x7f898809a580 2023-10-03T10:13:24.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.074+0000 7f89867fc700 1 -- 172.21.15.72:0/3202617635 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980003dd0 con 0x7f898809a580 2023-10-03T10:13:24.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.075+0000 7f898e100700 1 -- 172.21.15.72:0/3202617635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f898809a580 msgr2=0x7f8988139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.075+0000 7f898e100700 1 --2- 172.21.15.72:0/3202617635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f898809a580 0x7f8988139660 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8980009e50 tx=0x7f898000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:24.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.075+0000 7f898e100700 1 -- 172.21.15.72:0/3202617635 shutdown_connections 2023-10-03T10:13:24.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.075+0000 7f898e100700 1 --2- 172.21.15.72:0/3202617635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f898809a580 0x7f8988139660 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.075+0000 7f898e100700 1 --2- 172.21.15.72:0/3202617635 >> v2:172.21.15.72:3300/0 conn(0x7f8988131810 0x7f8988131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.075+0000 7f898e100700 1 -- 172.21.15.72:0/3202617635 >> 172.21.15.72:0/3202617635 conn(0x7f89880a2aa0 msgr2=0x7f89880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.075+0000 7f898e100700 1 -- 172.21.15.72:0/3202617635 shutdown_connections 2023-10-03T10:13:24.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.075+0000 7f898e100700 1 -- 172.21.15.72:0/3202617635 wait complete. 2023-10-03T10:13:24.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.076+0000 7f898e100700 1 Processor -- start 2023-10-03T10:13:24.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.077+0000 7f898e100700 1 -- start start 2023-10-03T10:13:24.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.077+0000 7f898e100700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8988099a40 0x7f8988118f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.077+0000 7f898e100700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f898809a580 0x7f8988119470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.077+0000 7f898e100700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8988131810 0x7f89881199b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.077+0000 7f898e100700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898811c310 con 0x7f8988131810 2023-10-03T10:13:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.077+0000 7f898e100700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898806eb00 con 0x7f898809a580 2023-10-03T10:13:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.077+0000 7f898e100700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f898811c9b0 con 0x7f8988099a40 2023-10-03T10:13:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.078+0000 7f8986ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f898809a580 0x7f8988119470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.078+0000 7f89877fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8988099a40 0x7f8988118f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.078+0000 7f8986ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f898809a580 0x7f8988119470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38788/0 (socket says 172.21.15.72:38788) 2023-10-03T10:13:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.078+0000 7f8987fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8988131810 0x7f89881199b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.078+0000 7f8986ffd700 1 -- 172.21.15.72:0/2484798031 learned_addr learned my addr 172.21.15.72:0/2484798031 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.078+0000 7f8987fff700 1 -- 172.21.15.72:0/2484798031 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8988099a40 msgr2=0x7f8988118f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.078+0000 7f8987fff700 1 --2- 172.21.15.72:0/2484798031 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8988099a40 0x7f8988118f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.078+0000 7f8987fff700 1 -- 172.21.15.72:0/2484798031 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f898809a580 msgr2=0x7f8988119470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.078+0000 7f8987fff700 1 --2- 172.21.15.72:0/2484798031 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f898809a580 0x7f8988119470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.078+0000 7f8987fff700 1 -- 172.21.15.72:0/2484798031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8980009b30 con 0x7f8988131810 2023-10-03T10:13:24.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.078+0000 7f8987fff700 1 --2- 172.21.15.72:0/2484798031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8988131810 0x7f89881199b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8980014000 tx=0x7f8980004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.078+0000 7f896ffff700 1 -- 172.21.15.72:0/2484798031 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980004440 con 0x7f8988131810 2023-10-03T10:13:24.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.078+0000 7f896ffff700 1 -- 172.21.15.72:0/2484798031 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89800045a0 con 0x7f8988131810 2023-10-03T10:13:24.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.078+0000 7f896ffff700 1 -- 172.21.15.72:0/2484798031 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980004950 con 0x7f8988131810 2023-10-03T10:13:24.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.079+0000 7f898e100700 1 -- 172.21.15.72:0/2484798031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89880a1cd0 con 0x7f8988131810 2023-10-03T10:13:24.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.079+0000 7f898e100700 1 -- 172.21.15.72:0/2484798031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8988125bf0 con 0x7f8988131810 2023-10-03T10:13:24.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.079+0000 7f896ffff700 1 -- 172.21.15.72:0/2484798031 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8980012430 con 0x7f8988131810 2023-10-03T10:13:24.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.080+0000 7f896ffff700 1 -- 172.21.15.72:0/2484798031 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8980040aa0 con 0x7f8988131810 2023-10-03T10:13:24.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.080+0000 7f898e100700 1 -- 172.21.15.72:0/2484798031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898811c7f0 con 0x7f8988131810 2023-10-03T10:13:24.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.085+0000 7f896ffff700 1 -- 172.21.15.72:0/2484798031 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89800117a0 con 0x7f8988131810 2023-10-03T10:13:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.099+0000 7ffab01c0700 1 Processor -- start 2023-10-03T10:13:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.099+0000 7ffab01c0700 1 -- start start 2023-10-03T10:13:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.099+0000 7ffab01c0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffaa8136710 0x7ffaa8138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.099+0000 7ffab01c0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffaa8139030 0x7ffaa813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.099+0000 7ffab01c0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa806ef30 con 0x7ffaa81338a0 2023-10-03T10:13:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.099+0000 7ffab01c0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa806fef0 con 0x7ffaa8139030 2023-10-03T10:13:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.099+0000 7ffab01c0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa81334b0 con 0x7ffaa8136710 2023-10-03T10:13:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.100+0000 7ffaad75b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffaa8136710 0x7ffaa8138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.100+0000 7ffaad75b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffaa8136710 0x7ffaa8138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40890/0 (socket says 172.21.15.72:40890) 2023-10-03T10:13:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.100+0000 7ffaad75b700 1 -- 172.21.15.72:0/2398748684 learned_addr learned my addr 172.21.15.72:0/2398748684 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.100+0000 7ffaadf5c700 1 --1- 172.21.15.72:0/2398748684 >> v1:172.21.15.72:6789/0 conn(0x7ffaa81338a0 0x7ffaa8133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60210/0 (socket says 172.21.15.72:60210) 2023-10-03T10:13:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.100+0000 7ffaae75d700 1 --2- 172.21.15.72:0/2398748684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffaa8139030 0x7ffaa813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.100+0000 7ffaad75b700 1 -- 172.21.15.72:0/2398748684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffaa8139030 msgr2=0x7ffaa813b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.100+0000 7ffaad75b700 1 --2- 172.21.15.72:0/2398748684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffaa8139030 0x7ffaa813b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.100+0000 7ffaacf5a700 1 -- 172.21.15.72:0/2398748684 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546584132 0 0) 0x7ffaa806ef30 con 0x7ffaa81338a0 2023-10-03T10:13:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.100+0000 7ffaad75b700 1 -- 172.21.15.72:0/2398748684 >> v1:172.21.15.72:6789/0 conn(0x7ffaa81338a0 legacy=0x7ffaa8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.100+0000 7ffaad75b700 1 -- 172.21.15.72:0/2398748684 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa806fc30 con 0x7ffaa8136710 2023-10-03T10:13:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.100+0000 7ffaad75b700 1 --2- 172.21.15.72:0/2398748684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffaa8136710 0x7ffaa8138af0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009920 tx=0x7ffa98009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c730ddc2159dbce3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.100+0000 7ffaacf5a700 1 -- 172.21.15.72:0/2398748684 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9800ba60 con 0x7ffaa8136710 2023-10-03T10:13:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.100+0000 7ffaacf5a700 1 -- 172.21.15.72:0/2398748684 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9800bbc0 con 0x7ffaa8136710 2023-10-03T10:13:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.100+0000 7ffaacf5a700 1 -- 172.21.15.72:0/2398748684 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98009e70 con 0x7ffaa8136710 2023-10-03T10:13:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.101+0000 7ffab01c0700 1 -- 172.21.15.72:0/2398748684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffaa8136710 msgr2=0x7ffaa8138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.101+0000 7ffab01c0700 1 --2- 172.21.15.72:0/2398748684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffaa8136710 0x7ffaa8138af0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009920 tx=0x7ffa98009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.101+0000 7ffab01c0700 1 -- 172.21.15.72:0/2398748684 shutdown_connections 2023-10-03T10:13:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.101+0000 7ffab01c0700 1 --2- 172.21.15.72:0/2398748684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffaa8139030 0x7ffaa813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.101+0000 7ffab01c0700 1 --2- 172.21.15.72:0/2398748684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffaa8136710 0x7ffaa8138af0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.101+0000 7ffab01c0700 1 -- 172.21.15.72:0/2398748684 >> 172.21.15.72:0/2398748684 conn(0x7ffaa80a2aa0 msgr2=0x7ffaa80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.101+0000 7ffab01c0700 1 -- 172.21.15.72:0/2398748684 shutdown_connections 2023-10-03T10:13:24.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.101+0000 7ffab01c0700 1 -- 172.21.15.72:0/2398748684 wait complete. 2023-10-03T10:13:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.102+0000 7ffab01c0700 1 Processor -- start 2023-10-03T10:13:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.102+0000 7ffab01c0700 1 -- start start 2023-10-03T10:13:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.103+0000 7ffab01c0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffaa81338a0 0x7ffaa811adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.103+0000 7ffab01c0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa8136710 0x7ffaa811b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.103+0000 7ffab01c0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffaa8139030 0x7ffaa811b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.103+0000 7ffab01c0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa806f640 con 0x7ffaa8136710 2023-10-03T10:13:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.103+0000 7ffab01c0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa811c990 con 0x7ffaa8139030 2023-10-03T10:13:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.103+0000 7ffab01c0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa811e520 con 0x7ffaa81338a0 2023-10-03T10:13:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.103+0000 7ffaae75d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffaa8139030 0x7ffaa811b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.103+0000 7ffaae75d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffaa8139030 0x7ffaa811b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38806/0 (socket says 172.21.15.72:38806) 2023-10-03T10:13:24.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.103+0000 7ffaae75d700 1 -- 172.21.15.72:0/2776876985 learned_addr learned my addr 172.21.15.72:0/2776876985 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.103+0000 7ffaadf5c700 1 --2- 172.21.15.72:0/2776876985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffaa81338a0 0x7ffaa811adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.103+0000 7ffaae75d700 1 -- 172.21.15.72:0/2776876985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffaa81338a0 msgr2=0x7ffaa811adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.103+0000 7ffaae75d700 1 --2- 172.21.15.72:0/2776876985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffaa81338a0 0x7ffaa811adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.103+0000 7ffaae75d700 1 -- 172.21.15.72:0/2776876985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa8136710 msgr2=0x7ffaa811b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.103+0000 7ffaae75d700 1 --2- 172.21.15.72:0/2776876985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa8136710 0x7ffaa811b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.103+0000 7ffaae75d700 1 -- 172.21.15.72:0/2776876985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98009550 con 0x7ffaa8139030 2023-10-03T10:13:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.104+0000 7ffaae75d700 1 --2- 172.21.15.72:0/2776876985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffaa8139030 0x7ffaa811b870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0007de0 tx=0x7ffaa000e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.104+0000 7ffa9e7fc700 1 -- 172.21.15.72:0/2776876985 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000ede0 con 0x7ffaa8139030 2023-10-03T10:13:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.104+0000 7ffa9e7fc700 1 -- 172.21.15.72:0/2776876985 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa0014420 con 0x7ffaa8139030 2023-10-03T10:13:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.104+0000 7ffab01c0700 1 -- 172.21.15.72:0/2776876985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa8138d20 con 0x7ffaa8139030 2023-10-03T10:13:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.104+0000 7ffab01c0700 1 -- 172.21.15.72:0/2776876985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa811ef90 con 0x7ffaa8139030 2023-10-03T10:13:24.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.104+0000 7ffa9e7fc700 1 -- 172.21.15.72:0/2776876985 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00147d0 con 0x7ffaa8139030 2023-10-03T10:13:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.105+0000 7ffa9e7fc700 1 -- 172.21.15.72:0/2776876985 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffaa0014930 con 0x7ffaa8139030 2023-10-03T10:13:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.105+0000 7ffa9e7fc700 1 -- 172.21.15.72:0/2776876985 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffaa003fef0 con 0x7ffaa8139030 2023-10-03T10:13:24.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.105+0000 7ffab01c0700 1 -- 172.21.15.72:0/2776876985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa900052e0 con 0x7ffaa8139030 2023-10-03T10:13:24.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.110+0000 7ffa9e7fc700 1 -- 172.21.15.72:0/2776876985 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffaa00122e0 con 0x7ffaa8139030 2023-10-03T10:13:24.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.183+0000 7fa10fa74700 1 -- 172.21.15.72:0/2462245902 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa10811d360 con 0x7fa1081338c0 2023-10-03T10:13:24.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.183+0000 7fa1067fc700 1 -- 172.21.15.72:0/2462245902 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa100017030 con 0x7fa1081338c0 2023-10-03T10:13:24.183 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:24.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.185+0000 7fa10fa74700 1 -- 172.21.15.72:0/2462245902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1081338c0 msgr2=0x7fa108119c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.185+0000 7fa10fa74700 1 --2- 172.21.15.72:0/2462245902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1081338c0 0x7fa108119c80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa10000c430 tx=0x7fa10000c740 comp rx=0 tx=0).stop 2023-10-03T10:13:24.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.185+0000 7fa10fa74700 1 -- 172.21.15.72:0/2462245902 shutdown_connections 2023-10-03T10:13:24.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.185+0000 7fa10fa74700 1 --2- 172.21.15.72:0/2462245902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa108139150 0x7fa10811a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.185+0000 7fa10fa74700 1 --2- 172.21.15.72:0/2462245902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1081338c0 0x7fa108119c80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.185+0000 7fa10fa74700 1 --2- 172.21.15.72:0/2462245902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa108136830 0x7fa10811a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.185+0000 7fa10fa74700 1 -- 172.21.15.72:0/2462245902 >> 172.21.15.72:0/2462245902 conn(0x7fa1080a2aa0 msgr2=0x7fa108134d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.185+0000 7fa10fa74700 1 -- 172.21.15.72:0/2462245902 shutdown_connections 2023-10-03T10:13:24.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.186+0000 7fa10fa74700 1 -- 172.21.15.72:0/2462245902 wait complete. 2023-10-03T10:13:24.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:24.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.295+0000 7f6eed9d7700 1 -- 172.21.15.72:0/4016248133 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6ee811cda0 con 0x7f6ee806a770 2023-10-03T10:13:24.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.295+0000 7f6ecffff700 1 -- 172.21.15.72:0/4016248133 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6ed8021090 con 0x7f6ee806a770 2023-10-03T10:13:24.295 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:24.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.297+0000 7f6eed9d7700 1 -- 172.21.15.72:0/4016248133 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ee806a770 msgr2=0x7f6ee813a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.297+0000 7f6eed9d7700 1 --2- 172.21.15.72:0/4016248133 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ee806a770 0x7f6ee813a6f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800e940 tx=0x7f6ed800ec50 comp rx=0 tx=0).stop 2023-10-03T10:13:24.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.298+0000 7f6eed9d7700 1 -- 172.21.15.72:0/4016248133 shutdown_connections 2023-10-03T10:13:24.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.298+0000 7f6eed9d7700 1 --2- 172.21.15.72:0/4016248133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ee813c1e0 0x7f6ee813b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.298+0000 7f6eed9d7700 1 --2- 172.21.15.72:0/4016248133 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ee806a770 0x7f6ee813a6f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.298+0000 7f6eed9d7700 1 --2- 172.21.15.72:0/4016248133 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6ee809dc30 0x7f6ee813ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.298+0000 7f6eed9d7700 1 -- 172.21.15.72:0/4016248133 >> 172.21.15.72:0/4016248133 conn(0x7f6ee8066f50 msgr2=0x7f6ee8070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.298+0000 7f6eed9d7700 1 -- 172.21.15.72:0/4016248133 shutdown_connections 2023-10-03T10:13:24.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.298+0000 7f6eed9d7700 1 -- 172.21.15.72:0/4016248133 wait complete. 2023-10-03T10:13:24.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.305+0000 7ffab01c0700 1 -- 172.21.15.72:0/2776876985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffa90005150 con 0x7ffaa8139030 2023-10-03T10:13:24.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.306+0000 7ffa9e7fc700 1 -- 172.21.15.72:0/2776876985 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffaa001bb00 con 0x7ffaa8139030 2023-10-03T10:13:24.306 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:24.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.308+0000 7f898e100700 1 -- 172.21.15.72:0/2484798031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8988074ea0 con 0x7f8988131810 2023-10-03T10:13:24.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.308+0000 7f896ffff700 1 -- 172.21.15.72:0/2484798031 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8980017030 con 0x7f8988131810 2023-10-03T10:13:24.308 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.309+0000 7ffab01c0700 1 -- 172.21.15.72:0/2776876985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffaa8139030 msgr2=0x7ffaa811b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.309+0000 7ffab01c0700 1 --2- 172.21.15.72:0/2776876985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffaa8139030 0x7ffaa811b870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0007de0 tx=0x7ffaa000e3c0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.309+0000 7ffab01c0700 1 -- 172.21.15.72:0/2776876985 shutdown_connections 2023-10-03T10:13:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.309+0000 7ffab01c0700 1 --2- 172.21.15.72:0/2776876985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffaa8139030 0x7ffaa811b870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.309+0000 7ffab01c0700 1 --2- 172.21.15.72:0/2776876985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffaa81338a0 0x7ffaa811adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.309+0000 7ffab01c0700 1 --2- 172.21.15.72:0/2776876985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaa8136710 0x7ffaa811b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.309+0000 7ffab01c0700 1 -- 172.21.15.72:0/2776876985 >> 172.21.15.72:0/2776876985 conn(0x7ffaa80a2aa0 msgr2=0x7ffaa81344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.309+0000 7ffab01c0700 1 -- 172.21.15.72:0/2776876985 shutdown_connections 2023-10-03T10:13:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.309+0000 7ffab01c0700 1 -- 172.21.15.72:0/2776876985 wait complete. 2023-10-03T10:13:24.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.311+0000 7f898e100700 1 -- 172.21.15.72:0/2484798031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8988131810 msgr2=0x7f89881199b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.311+0000 7f898e100700 1 --2- 172.21.15.72:0/2484798031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8988131810 0x7f89881199b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8980014000 tx=0x7f8980004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.311+0000 7f898e100700 1 -- 172.21.15.72:0/2484798031 shutdown_connections 2023-10-03T10:13:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.311+0000 7f898e100700 1 --2- 172.21.15.72:0/2484798031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8988131810 0x7f89881199b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.311+0000 7f898e100700 1 --2- 172.21.15.72:0/2484798031 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8988099a40 0x7f8988118f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.311+0000 7f898e100700 1 --2- 172.21.15.72:0/2484798031 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f898809a580 0x7f8988119470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.311+0000 7f898e100700 1 -- 172.21.15.72:0/2484798031 >> 172.21.15.72:0/2484798031 conn(0x7f89880a2aa0 msgr2=0x7f898812ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:24.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.311+0000 7f898e100700 1 -- 172.21.15.72:0/2484798031 shutdown_connections 2023-10-03T10:13:24.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:24.311+0000 7f898e100700 1 -- 172.21.15.72:0/2484798031 wait complete. 2023-10-03T10:13:24.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:24.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:25.198 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:25.313 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:25.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:25.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.334+0000 7f433f06b700 1 Processor -- start 2023-10-03T10:13:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.334+0000 7f433f06b700 1 -- start start 2023-10-03T10:13:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.334+0000 7f433f06b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f433809d6f0 0x7f433809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.334+0000 7f433f06b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f433809e000 0x7f43381339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.334+0000 7f433f06b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433809b120 con 0x7f433809e410 2023-10-03T10:13:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.334+0000 7f433f06b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433806b460 con 0x7f433809e000 2023-10-03T10:13:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.334+0000 7f433f06b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433809a7e0 con 0x7f433809d6f0 2023-10-03T10:13:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.334+0000 7f433ce07700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f433809d6f0 0x7f433809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.334+0000 7f4337fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f433809e000 0x7f43381339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.335+0000 7f433ce07700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f433809d6f0 0x7f433809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38812/0 (socket says 172.21.15.72:38812) 2023-10-03T10:13:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.335+0000 7f433ce07700 1 -- 172.21.15.72:0/3135163568 learned_addr learned my addr 172.21.15.72:0/3135163568 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.335+0000 7f433ce07700 1 -- 172.21.15.72:0/3135163568 >> v2:172.21.15.72:3300/0 conn(0x7f433809e000 msgr2=0x7f43381339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.335+0000 7f433ce07700 1 --2- 172.21.15.72:0/3135163568 >> v2:172.21.15.72:3300/0 conn(0x7f433809e000 0x7f43381339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.335+0000 7f433ce07700 1 -- 172.21.15.72:0/3135163568 >> v1:172.21.15.72:6789/0 conn(0x7f433809e410 legacy=0x7f4338133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.335+0000 7f433ce07700 1 -- 172.21.15.72:0/3135163568 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433809a500 con 0x7f433809d6f0 2023-10-03T10:13:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.335+0000 7f433ce07700 1 --2- 172.21.15.72:0/3135163568 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f433809d6f0 0x7f433809dac0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f432c009920 tx=0x7f432c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9ff5375eb864e16 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.335+0000 7f43377fe700 1 -- 172.21.15.72:0/3135163568 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c011830 con 0x7f433809d6f0 2023-10-03T10:13:25.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.335+0000 7f43377fe700 1 -- 172.21.15.72:0/3135163568 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c011990 con 0x7f433809d6f0 2023-10-03T10:13:25.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.335+0000 7f43377fe700 1 -- 172.21.15.72:0/3135163568 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c011d20 con 0x7f433809d6f0 2023-10-03T10:13:25.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.336+0000 7f433f06b700 1 -- 172.21.15.72:0/3135163568 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f433809d6f0 msgr2=0x7f433809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.336+0000 7f433f06b700 1 --2- 172.21.15.72:0/3135163568 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f433809d6f0 0x7f433809dac0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f432c009920 tx=0x7f432c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:25.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.336+0000 7f433f06b700 1 -- 172.21.15.72:0/3135163568 shutdown_connections 2023-10-03T10:13:25.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.336+0000 7f433f06b700 1 --2- 172.21.15.72:0/3135163568 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f433809d6f0 0x7f433809dac0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.336+0000 7f433f06b700 1 --2- 172.21.15.72:0/3135163568 >> v2:172.21.15.72:3300/0 conn(0x7f433809e000 0x7f43381339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.336+0000 7f433f06b700 1 -- 172.21.15.72:0/3135163568 >> 172.21.15.72:0/3135163568 conn(0x7f4338066f50 msgr2=0x7f433809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.337+0000 7f433f06b700 1 -- 172.21.15.72:0/3135163568 shutdown_connections 2023-10-03T10:13:25.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.337+0000 7f433f06b700 1 -- 172.21.15.72:0/3135163568 wait complete. 2023-10-03T10:13:25.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.339+0000 7f433f06b700 1 Processor -- start 2023-10-03T10:13:25.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.339+0000 7f433f06b700 1 -- start start 2023-10-03T10:13:25.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.339+0000 7f433f06b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f433809d6f0 0x7f43381cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433f06b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f433809e000 0x7f43381cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433f06b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f433809e410 0x7f43381c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433f06b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433811c9a0 con 0x7f433809e000 2023-10-03T10:13:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433f06b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433811d440 con 0x7f433809e410 2023-10-03T10:13:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433f06b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f433811d040 con 0x7f433809d6f0 2023-10-03T10:13:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433ce07700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f433809d6f0 0x7f43381cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433ce07700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f433809d6f0 0x7f43381cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40908/0 (socket says 172.21.15.72:40908) 2023-10-03T10:13:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433ce07700 1 -- 172.21.15.72:0/3433160922 learned_addr learned my addr 172.21.15.72:0/3433160922 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433d608700 1 --2- 172.21.15.72:0/3433160922 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f433809e410 0x7f43381c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f4337fff700 1 --2- 172.21.15.72:0/3433160922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f433809e000 0x7f43381cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433ce07700 1 -- 172.21.15.72:0/3433160922 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f433809e410 msgr2=0x7f43381c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433ce07700 1 --2- 172.21.15.72:0/3433160922 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f433809e410 0x7f43381c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433ce07700 1 -- 172.21.15.72:0/3433160922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f433809e000 msgr2=0x7f43381cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433ce07700 1 --2- 172.21.15.72:0/3433160922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f433809e000 0x7f43381cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433ce07700 1 -- 172.21.15.72:0/3433160922 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c009550 con 0x7f433809d6f0 2023-10-03T10:13:25.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433d608700 1 --2- 172.21.15.72:0/3433160922 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f433809e410 0x7f43381c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:25.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.340+0000 7f433ce07700 1 --2- 172.21.15.72:0/3433160922 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f433809d6f0 0x7f43381cccf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f432c009870 tx=0x7f432c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.341+0000 7f43357fa700 1 -- 172.21.15.72:0/3433160922 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c0036a0 con 0x7f433809d6f0 2023-10-03T10:13:25.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.341+0000 7f433f06b700 1 -- 172.21.15.72:0/3433160922 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433811be30 con 0x7f433809d6f0 2023-10-03T10:13:25.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.341+0000 7f433f06b700 1 -- 172.21.15.72:0/3433160922 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433811b030 con 0x7f433809d6f0 2023-10-03T10:13:25.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.341+0000 7f43357fa700 1 -- 172.21.15.72:0/3433160922 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c01f070 con 0x7f433809d6f0 2023-10-03T10:13:25.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.341+0000 7f43357fa700 1 -- 172.21.15.72:0/3433160922 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c003a60 con 0x7f433809d6f0 2023-10-03T10:13:25.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.342+0000 7f43357fa700 1 -- 172.21.15.72:0/3433160922 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f432c003bc0 con 0x7f433809d6f0 2023-10-03T10:13:25.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.342+0000 7f433f06b700 1 -- 172.21.15.72:0/3433160922 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43180052e0 con 0x7f433809d6f0 2023-10-03T10:13:25.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.342+0000 7f43357fa700 1 -- 172.21.15.72:0/3433160922 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f432c021070 con 0x7f433809d6f0 2023-10-03T10:13:25.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.348+0000 7f43357fa700 1 -- 172.21.15.72:0/3433160922 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f432c006cc0 con 0x7f433809d6f0 2023-10-03T10:13:25.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.461+0000 7f8c08bf0700 1 Processor -- start 2023-10-03T10:13:25.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.461+0000 7f748fcc1700 1 Processor -- start 2023-10-03T10:13:25.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.461+0000 7f8c08bf0700 1 -- start start 2023-10-03T10:13:25.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f748fcc1700 1 -- start start 2023-10-03T10:13:25.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f8c08bf0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0412cf60 0x7f8c0406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f8c08bf0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8c04130430 0x7f8c04137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f8c08bf0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0412cd90 con 0x7f8c0412f8b0 2023-10-03T10:13:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f8c08bf0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0412d330 con 0x7f8c04130430 2023-10-03T10:13:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f8c08bf0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04071780 con 0x7f8c0412cf60 2023-10-03T10:13:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f748fcc1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f748809e930 0x7f748809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f748fcc1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f748809f240 0x7f74881317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f748fcc1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7488070940 con 0x7f748809f650 2023-10-03T10:13:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f748fcc1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748806fd60 con 0x7f748809e930 2023-10-03T10:13:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f748fcc1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748806fa80 con 0x7f748809f240 2023-10-03T10:13:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f748da5d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f748809e930 0x7f748809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f8c0259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0412cf60 0x7f8c0406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f8c0259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0412cf60 0x7f8c0406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38836/0 (socket says 172.21.15.72:38836) 2023-10-03T10:13:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f8c0259c700 1 -- 172.21.15.72:0/2079988855 learned_addr learned my addr 172.21.15.72:0/2079988855 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f8c02d9d700 1 --2- 172.21.15.72:0/2079988855 >> v2:172.21.15.72:3300/0 conn(0x7f8c04130430 0x7f8c04137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f748da5d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f748809e930 0x7f748809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43886/0 (socket says 172.21.15.72:43886) 2023-10-03T10:13:25.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.462+0000 7f748da5d700 1 -- 172.21.15.72:0/979198579 learned_addr learned my addr 172.21.15.72:0/979198579 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:25.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f748d25c700 1 --2- 172.21.15.72:0/979198579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f748809f240 0x7f74881317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f748da5d700 1 -- 172.21.15.72:0/979198579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f748809f240 msgr2=0x7f74881317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f748da5d700 1 --2- 172.21.15.72:0/979198579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f748809f240 0x7f74881317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f748da5d700 1 -- 172.21.15.72:0/979198579 >> v1:172.21.15.72:6789/0 conn(0x7f748809f650 legacy=0x7f7488131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f748da5d700 1 -- 172.21.15.72:0/979198579 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748809fb60 con 0x7f748809e930 2023-10-03T10:13:25.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f8c0259c700 1 -- 172.21.15.72:0/2079988855 >> v2:172.21.15.72:3300/0 conn(0x7f8c04130430 msgr2=0x7f8c04137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f8c0259c700 1 --2- 172.21.15.72:0/2079988855 >> v2:172.21.15.72:3300/0 conn(0x7f8c04130430 0x7f8c04137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f8c0259c700 1 -- 172.21.15.72:0/2079988855 >> v1:172.21.15.72:6789/0 conn(0x7f8c0412f8b0 legacy=0x7f8c0412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f8c0259c700 1 -- 172.21.15.72:0/2079988855 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04071a40 con 0x7f8c0412cf60 2023-10-03T10:13:25.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f8c0259c700 1 --2- 172.21.15.72:0/2079988855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0412cf60 0x7f8c0406f5d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40098f0 tx=0x7f8bf4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4404d3c521c45250 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f748da5d700 1 --2- 172.21.15.72:0/979198579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f748809e930 0x7f748809ed00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f74840098f0 tx=0x7f7484009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df36c75e0dde7245 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f748ca5b700 1 -- 172.21.15.72:0/979198579 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484004230 con 0x7f748809e930 2023-10-03T10:13:25.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f748ca5b700 1 -- 172.21.15.72:0/979198579 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7484004390 con 0x7f748809e930 2023-10-03T10:13:25.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f748ca5b700 1 -- 172.21.15.72:0/979198579 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74840036a0 con 0x7f748809e930 2023-10-03T10:13:25.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f8c0159a700 1 -- 172.21.15.72:0/2079988855 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf400f8a0 con 0x7f8c0412cf60 2023-10-03T10:13:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f8c0159a700 1 -- 172.21.15.72:0/2079988855 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf400fa00 con 0x7f8c0412cf60 2023-10-03T10:13:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.463+0000 7f8c0159a700 1 -- 172.21.15.72:0/2079988855 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf400fd90 con 0x7f8c0412cf60 2023-10-03T10:13:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f748fcc1700 1 -- 172.21.15.72:0/979198579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f748809e930 msgr2=0x7f748809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f748fcc1700 1 --2- 172.21.15.72:0/979198579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f748809e930 0x7f748809ed00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f74840098f0 tx=0x7f7484009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f8c08bf0700 1 -- 172.21.15.72:0/2079988855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0412cf60 msgr2=0x7f8c0406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f8c08bf0700 1 --2- 172.21.15.72:0/2079988855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0412cf60 0x7f8c0406f5d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40098f0 tx=0x7f8bf4009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f748fcc1700 1 -- 172.21.15.72:0/979198579 shutdown_connections 2023-10-03T10:13:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f748fcc1700 1 --2- 172.21.15.72:0/979198579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f748809e930 0x7f748809ed00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f748fcc1700 1 --2- 172.21.15.72:0/979198579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f748809f240 0x7f74881317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f748fcc1700 1 -- 172.21.15.72:0/979198579 >> 172.21.15.72:0/979198579 conn(0x7f74880a4210 msgr2=0x7f74880a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f8c08bf0700 1 -- 172.21.15.72:0/2079988855 shutdown_connections 2023-10-03T10:13:25.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f8c08bf0700 1 --2- 172.21.15.72:0/2079988855 >> v2:172.21.15.72:3300/0 conn(0x7f8c04130430 0x7f8c04137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f8c08bf0700 1 --2- 172.21.15.72:0/2079988855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0412cf60 0x7f8c0406f5d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f8c08bf0700 1 -- 172.21.15.72:0/2079988855 >> 172.21.15.72:0/2079988855 conn(0x7f8c040a2aa0 msgr2=0x7f8c040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f748fcc1700 1 -- 172.21.15.72:0/979198579 shutdown_connections 2023-10-03T10:13:25.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f748fcc1700 1 -- 172.21.15.72:0/979198579 wait complete. 2023-10-03T10:13:25.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f8c08bf0700 1 -- 172.21.15.72:0/2079988855 shutdown_connections 2023-10-03T10:13:25.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.464+0000 7f8c08bf0700 1 -- 172.21.15.72:0/2079988855 wait complete. 2023-10-03T10:13:25.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.465+0000 7f748fcc1700 1 Processor -- start 2023-10-03T10:13:25.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f748fcc1700 1 -- start start 2023-10-03T10:13:25.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f8c08bf0700 1 Processor -- start 2023-10-03T10:13:25.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f8c08bf0700 1 -- start start 2023-10-03T10:13:25.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f748fcc1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f748809e930 0x7f74881a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f748fcc1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f748809f240 0x7f74881a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f748fcc1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f748809f650 0x7f74881a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f748fcc1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74881a81b0 con 0x7f748809f240 2023-10-03T10:13:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f748fcc1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74881a77f0 con 0x7f748809e930 2023-10-03T10:13:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f748fcc1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74880a35c0 con 0x7f748809f650 2023-10-03T10:13:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f748d25c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f748809f240 0x7f74881a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f748d25c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f748809f240 0x7f74881a42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43902/0 (socket says 172.21.15.72:43902) 2023-10-03T10:13:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f748d25c700 1 -- 172.21.15.72:0/428936638 learned_addr learned my addr 172.21.15.72:0/428936638 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f748da5d700 1 --2- 172.21.15.72:0/428936638 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f748809e930 0x7f74881a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f8c08bf0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0412cf60 0x7f8c041c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f8c08bf0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c0412f8b0 0x7f8c041c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f8c08bf0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c04130430 0x7f8c041c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f8c08bf0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04129c20 con 0x7f8c04130430 2023-10-03T10:13:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f8c08bf0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0412d7b0 con 0x7f8c0412cf60 2023-10-03T10:13:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.466+0000 7f8c08bf0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0409df40 con 0x7f8c0412f8b0 2023-10-03T10:13:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f8c0259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0412cf60 0x7f8c041c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f8c0259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0412cf60 0x7f8c041c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38842/0 (socket says 172.21.15.72:38842) 2023-10-03T10:13:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f8c0259c700 1 -- 172.21.15.72:0/3602483888 learned_addr learned my addr 172.21.15.72:0/3602483888 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f748e25e700 1 --2- 172.21.15.72:0/428936638 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f748809f650 0x7f74881a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f8c02d9d700 1 --2- 172.21.15.72:0/3602483888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c04130430 0x7f8c041c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f748d25c700 1 -- 172.21.15.72:0/428936638 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f748809f650 msgr2=0x7f74881a47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f748d25c700 1 --2- 172.21.15.72:0/428936638 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f748809f650 0x7f74881a47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f748d25c700 1 -- 172.21.15.72:0/428936638 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f748809e930 msgr2=0x7f74881a3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f748d25c700 1 --2- 172.21.15.72:0/428936638 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f748809e930 0x7f74881a3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f748d25c700 1 -- 172.21.15.72:0/428936638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7484009550 con 0x7f748809f240 2023-10-03T10:13:25.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f8c01d9b700 1 --2- 172.21.15.72:0/3602483888 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c0412f8b0 0x7f8c041c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f748e25e700 1 --2- 172.21.15.72:0/428936638 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f748809f650 0x7f74881a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:25.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f8c0259c700 1 -- 172.21.15.72:0/3602483888 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c0412f8b0 msgr2=0x7f8c041c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f8c0259c700 1 --2- 172.21.15.72:0/3602483888 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c0412f8b0 0x7f8c041c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f8c0259c700 1 -- 172.21.15.72:0/3602483888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c04130430 msgr2=0x7f8c041c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f8c0259c700 1 --2- 172.21.15.72:0/3602483888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c04130430 0x7f8c041c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f8c0259c700 1 -- 172.21.15.72:0/3602483888 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf4009550 con 0x7f8c0412cf60 2023-10-03T10:13:25.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f8c01d9b700 1 --2- 172.21.15.72:0/3602483888 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c0412f8b0 0x7f8c041c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:25.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f748d25c700 1 --2- 172.21.15.72:0/428936638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f748809f240 0x7f74881a42b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f747800e810 tx=0x7f747800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f8c02d9d700 1 --2- 172.21.15.72:0/3602483888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c04130430 0x7f8c041c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:25.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f8c0259c700 1 --2- 172.21.15.72:0/3602483888 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0412cf60 0x7f8c041c8810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8c0412d470 tx=0x7f8bf4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.467+0000 7f747e7fc700 1 -- 172.21.15.72:0/428936638 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7478013610 con 0x7f748809f240 2023-10-03T10:13:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.468+0000 7f747e7fc700 1 -- 172.21.15.72:0/428936638 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7478013770 con 0x7f748809f240 2023-10-03T10:13:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.468+0000 7f747e7fc700 1 -- 172.21.15.72:0/428936638 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7478013b20 con 0x7f748809f240 2023-10-03T10:13:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.468+0000 7f748fcc1700 1 -- 172.21.15.72:0/428936638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74880a0190 con 0x7f748809f240 2023-10-03T10:13:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.468+0000 7f748fcc1700 1 -- 172.21.15.72:0/428936638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74881a58e0 con 0x7f748809f240 2023-10-03T10:13:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.469+0000 7f747e7fc700 1 -- 172.21.15.72:0/428936638 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7478013c80 con 0x7f748809f240 2023-10-03T10:13:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.469+0000 7f8bf2ffd700 1 -- 172.21.15.72:0/3602483888 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40038a0 con 0x7f8c0412cf60 2023-10-03T10:13:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.469+0000 7f748fcc1700 1 -- 172.21.15.72:0/428936638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74881a0b30 con 0x7f748809f240 2023-10-03T10:13:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.469+0000 7f8bf2ffd700 1 -- 172.21.15.72:0/3602483888 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf4003a00 con 0x7f8c0412cf60 2023-10-03T10:13:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.469+0000 7f8bf2ffd700 1 -- 172.21.15.72:0/3602483888 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4003db0 con 0x7f8c0412cf60 2023-10-03T10:13:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.469+0000 7f747e7fc700 1 -- 172.21.15.72:0/428936638 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f747803f410 con 0x7f748809f240 2023-10-03T10:13:25.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.469+0000 7f8c08bf0700 1 -- 172.21.15.72:0/3602483888 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c041c9290 con 0x7f8c0412cf60 2023-10-03T10:13:25.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.469+0000 7f8c08bf0700 1 -- 172.21.15.72:0/3602483888 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0409cda0 con 0x7f8c0412cf60 2023-10-03T10:13:25.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.470+0000 7f8bf2ffd700 1 -- 172.21.15.72:0/3602483888 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bf4019400 con 0x7f8c0412cf60 2023-10-03T10:13:25.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.471+0000 7f8bf2ffd700 1 -- 172.21.15.72:0/3602483888 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8bf4040e10 con 0x7f8c0412cf60 2023-10-03T10:13:25.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.471+0000 7f8c08bf0700 1 -- 172.21.15.72:0/3602483888 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0409ea20 con 0x7f8c0412cf60 2023-10-03T10:13:25.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.477+0000 7f747e7fc700 1 -- 172.21.15.72:0/428936638 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7478012370 con 0x7f748809f240 2023-10-03T10:13:25.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.478+0000 7f8bf2ffd700 1 -- 172.21.15.72:0/3602483888 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bf4020980 con 0x7f8c0412cf60 2023-10-03T10:13:25.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.491+0000 7f2091a19700 1 Processor -- start 2023-10-03T10:13:25.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.491+0000 7f2091a19700 1 -- start start 2023-10-03T10:13:25.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.491+0000 7f2091a19700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208c06e570 0x7f208c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.491+0000 7f2091a19700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208c06ee80 0x7f208c134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.491+0000 7f2091a19700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f208c070ee0 con 0x7f208c09eca0 2023-10-03T10:13:25.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.491+0000 7f2091a19700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208c071480 con 0x7f208c06e570 2023-10-03T10:13:25.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.491+0000 7f2091a19700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f208c071b90 con 0x7f208c06ee80 2023-10-03T10:13:25.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.492+0000 7f208a7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f208c09eca0 0x7f208c134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60260/0 (socket says 172.21.15.72:60260) 2023-10-03T10:13:25.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.492+0000 7f208a7fc700 1 -- 172.21.15.72:0/904873633 learned_addr learned my addr 172.21.15.72:0/904873633 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.492+0000 7f208affd700 1 --2- 172.21.15.72:0/904873633 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208c06e570 0x7f208c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.492+0000 7f208b7fe700 1 --2- 172.21.15.72:0/904873633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208c06ee80 0x7f208c134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.492+0000 7f208affd700 1 -- 172.21.15.72:0/904873633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208c06ee80 msgr2=0x7f208c134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.492+0000 7f208affd700 1 --2- 172.21.15.72:0/904873633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208c06ee80 0x7f208c134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.492+0000 7f208affd700 1 -- 172.21.15.72:0/904873633 >> v1:172.21.15.72:6789/0 conn(0x7f208c09eca0 legacy=0x7f208c134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.492+0000 7f208affd700 1 -- 172.21.15.72:0/904873633 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c0711a0 con 0x7f208c06e570 2023-10-03T10:13:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.493+0000 7f208affd700 1 --2- 172.21.15.72:0/904873633 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208c06e570 0x7f208c06e940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f207c009870 tx=0x7f207c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b31f8a80eb18ec3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.493+0000 7f2089ffb700 1 -- 172.21.15.72:0/904873633 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c011830 con 0x7f208c06e570 2023-10-03T10:13:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.493+0000 7f2089ffb700 1 -- 172.21.15.72:0/904873633 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c011990 con 0x7f208c06e570 2023-10-03T10:13:25.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.493+0000 7f2089ffb700 1 -- 172.21.15.72:0/904873633 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c011d20 con 0x7f208c06e570 2023-10-03T10:13:25.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.493+0000 7f2091a19700 1 -- 172.21.15.72:0/904873633 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208c06e570 msgr2=0x7f208c06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.493+0000 7f2091a19700 1 --2- 172.21.15.72:0/904873633 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208c06e570 0x7f208c06e940 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f207c009870 tx=0x7f207c009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:25.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.493+0000 7f2091a19700 1 -- 172.21.15.72:0/904873633 shutdown_connections 2023-10-03T10:13:25.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.493+0000 7f2091a19700 1 --2- 172.21.15.72:0/904873633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208c06ee80 0x7f208c134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.493+0000 7f2091a19700 1 --2- 172.21.15.72:0/904873633 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208c06e570 0x7f208c06e940 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.493+0000 7f2091a19700 1 -- 172.21.15.72:0/904873633 >> 172.21.15.72:0/904873633 conn(0x7f208c0a2aa0 msgr2=0x7f208c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.494+0000 7f2091a19700 1 -- 172.21.15.72:0/904873633 shutdown_connections 2023-10-03T10:13:25.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.494+0000 7f2091a19700 1 -- 172.21.15.72:0/904873633 wait complete. 2023-10-03T10:13:25.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.494+0000 7f2091a19700 1 Processor -- start 2023-10-03T10:13:25.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.495+0000 7f2091a19700 1 -- start start 2023-10-03T10:13:25.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.495+0000 7f2091a19700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f208c06e570 0x7f208c140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.495+0000 7f2091a19700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208c06ee80 0x7f208c13b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.495+0000 7f2091a19700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208c13b750 0x7f208c13bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.495+0000 7f2091a19700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c13c6e0 con 0x7f208c06e570 2023-10-03T10:13:25.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.495+0000 7f2091a19700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208c13ea50 con 0x7f208c13b750 2023-10-03T10:13:25.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.495+0000 7f2091a19700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f208c13f9a0 con 0x7f208c06ee80 2023-10-03T10:13:25.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.495+0000 7f208b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208c13b750 0x7f208c13bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.495+0000 7f208b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208c13b750 0x7f208c13bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38854/0 (socket says 172.21.15.72:38854) 2023-10-03T10:13:25.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.495+0000 7f208b7fe700 1 -- 172.21.15.72:0/2421837246 learned_addr learned my addr 172.21.15.72:0/2421837246 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:25.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.495+0000 7f208a7fc700 1 --2- 172.21.15.72:0/2421837246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208c06ee80 0x7f208c13b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.495+0000 7f208affd700 1 --2- 172.21.15.72:0/2421837246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f208c06e570 0x7f208c140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.496+0000 7f208b7fe700 1 -- 172.21.15.72:0/2421837246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208c06ee80 msgr2=0x7f208c13b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.496+0000 7f208b7fe700 1 --2- 172.21.15.72:0/2421837246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208c06ee80 0x7f208c13b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.496+0000 7f208b7fe700 1 -- 172.21.15.72:0/2421837246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f208c06e570 msgr2=0x7f208c140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.496+0000 7f208b7fe700 1 --2- 172.21.15.72:0/2421837246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f208c06e570 0x7f208c140420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.496+0000 7f208b7fe700 1 -- 172.21.15.72:0/2421837246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c0094a0 con 0x7f208c13b750 2023-10-03T10:13:25.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.496+0000 7f208b7fe700 1 --2- 172.21.15.72:0/2421837246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208c13b750 0x7f208c13bbf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2084009dd0 tx=0x7f208400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.496+0000 7f2073fff700 1 -- 172.21.15.72:0/2421837246 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2084009c40 con 0x7f208c13b750 2023-10-03T10:13:25.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.496+0000 7f2073fff700 1 -- 172.21.15.72:0/2421837246 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208400f040 con 0x7f208c13b750 2023-10-03T10:13:25.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.496+0000 7f2091a19700 1 -- 172.21.15.72:0/2421837246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208c13d680 con 0x7f208c13b750 2023-10-03T10:13:25.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.496+0000 7f2073fff700 1 -- 172.21.15.72:0/2421837246 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2084014480 con 0x7f208c13b750 2023-10-03T10:13:25.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.496+0000 7f2091a19700 1 -- 172.21.15.72:0/2421837246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208c070610 con 0x7f208c13b750 2023-10-03T10:13:25.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.497+0000 7f2091a19700 1 -- 172.21.15.72:0/2421837246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208c074ea0 con 0x7f208c13b750 2023-10-03T10:13:25.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.498+0000 7f2073fff700 1 -- 172.21.15.72:0/2421837246 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20840145e0 con 0x7f208c13b750 2023-10-03T10:13:25.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.498+0000 7f2073fff700 1 -- 172.21.15.72:0/2421837246 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2084040670 con 0x7f208c13b750 2023-10-03T10:13:25.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.506+0000 7f2073fff700 1 -- 172.21.15.72:0/2421837246 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2084012910 con 0x7f208c13b750 2023-10-03T10:13:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.630+0000 7f433f06b700 1 -- 172.21.15.72:0/3433160922 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4318005590 con 0x7f433809d6f0 2023-10-03T10:13:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.630+0000 7f43357fa700 1 -- 172.21.15.72:0/3433160922 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f432c02b070 con 0x7f433809d6f0 2023-10-03T10:13:25.631 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:25.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.633+0000 7f433f06b700 1 -- 172.21.15.72:0/3433160922 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f433809d6f0 msgr2=0x7f43381cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.633+0000 7f433f06b700 1 --2- 172.21.15.72:0/3433160922 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f433809d6f0 0x7f43381cccf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f432c009870 tx=0x7f432c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.633+0000 7f433f06b700 1 -- 172.21.15.72:0/3433160922 shutdown_connections 2023-10-03T10:13:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.633+0000 7f433f06b700 1 --2- 172.21.15.72:0/3433160922 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f433809e410 0x7f43381c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.633+0000 7f433f06b700 1 --2- 172.21.15.72:0/3433160922 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f433809d6f0 0x7f43381cccf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.633+0000 7f433f06b700 1 --2- 172.21.15.72:0/3433160922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f433809e000 0x7f43381cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.633+0000 7f433f06b700 1 -- 172.21.15.72:0/3433160922 >> 172.21.15.72:0/3433160922 conn(0x7f4338066f50 msgr2=0x7f43380a1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.633+0000 7f433f06b700 1 -- 172.21.15.72:0/3433160922 shutdown_connections 2023-10-03T10:13:25.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.633+0000 7f433f06b700 1 -- 172.21.15.72:0/3433160922 wait complete. 2023-10-03T10:13:25.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:25.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.677+0000 7f748fcc1700 1 -- 172.21.15.72:0/428936638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7488074ea0 con 0x7f748809f240 2023-10-03T10:13:25.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.677+0000 7f747e7fc700 1 -- 172.21.15.72:0/428936638 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7478021030 con 0x7f748809f240 2023-10-03T10:13:25.677 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:25.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.679+0000 7f8c08bf0700 1 -- 172.21.15.72:0/3602483888 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8c04074ea0 con 0x7f8c0412cf60 2023-10-03T10:13:25.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.680+0000 7f8bf2ffd700 1 -- 172.21.15.72:0/3602483888 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8bf4030090 con 0x7f8c0412cf60 2023-10-03T10:13:25.679 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:25.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.680+0000 7f748fcc1700 1 -- 172.21.15.72:0/428936638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f748809f240 msgr2=0x7f74881a42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.680+0000 7f748fcc1700 1 --2- 172.21.15.72:0/428936638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f748809f240 0x7f74881a42b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f747800e810 tx=0x7f747800eb20 comp rx=0 tx=0).stop 2023-10-03T10:13:25.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.680+0000 7f748fcc1700 1 -- 172.21.15.72:0/428936638 shutdown_connections 2023-10-03T10:13:25.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.680+0000 7f748fcc1700 1 --2- 172.21.15.72:0/428936638 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f748809f650 0x7f74881a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.680+0000 7f748fcc1700 1 --2- 172.21.15.72:0/428936638 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f748809e930 0x7f74881a3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.680+0000 7f748fcc1700 1 --2- 172.21.15.72:0/428936638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f748809f240 0x7f74881a42b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.680+0000 7f748fcc1700 1 -- 172.21.15.72:0/428936638 >> 172.21.15.72:0/428936638 conn(0x7f74880a4210 msgr2=0x7f74881b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.680+0000 7f748fcc1700 1 -- 172.21.15.72:0/428936638 shutdown_connections 2023-10-03T10:13:25.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.680+0000 7f748fcc1700 1 -- 172.21.15.72:0/428936638 wait complete. 2023-10-03T10:13:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.682+0000 7f8c08bf0700 1 -- 172.21.15.72:0/3602483888 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0412cf60 msgr2=0x7f8c041c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.682+0000 7f8c08bf0700 1 --2- 172.21.15.72:0/3602483888 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0412cf60 0x7f8c041c8810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8c0412d470 tx=0x7f8bf4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:25.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.683+0000 7f8c08bf0700 1 -- 172.21.15.72:0/3602483888 shutdown_connections 2023-10-03T10:13:25.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.683+0000 7f8c08bf0700 1 --2- 172.21.15.72:0/3602483888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c04130430 0x7f8c041c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.683+0000 7f8c08bf0700 1 --2- 172.21.15.72:0/3602483888 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c0412cf60 0x7f8c041c8810 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.683+0000 7f8c08bf0700 1 --2- 172.21.15.72:0/3602483888 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c0412f8b0 0x7f8c041c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.683+0000 7f8c08bf0700 1 -- 172.21.15.72:0/3602483888 >> 172.21.15.72:0/3602483888 conn(0x7f8c040a2aa0 msgr2=0x7f8c0406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.683+0000 7f8c08bf0700 1 -- 172.21.15.72:0/3602483888 shutdown_connections 2023-10-03T10:13:25.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.683+0000 7f8c08bf0700 1 -- 172.21.15.72:0/3602483888 wait complete. 2023-10-03T10:13:25.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:25.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:25.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.718+0000 7f2091a19700 1 -- 172.21.15.72:0/2421837246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f208c13e070 con 0x7f208c13b750 2023-10-03T10:13:25.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.718+0000 7f2073fff700 1 -- 172.21.15.72:0/2421837246 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f208402a090 con 0x7f208c13b750 2023-10-03T10:13:25.718 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:25.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.720+0000 7f2091a19700 1 -- 172.21.15.72:0/2421837246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208c13b750 msgr2=0x7f208c13bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.720+0000 7f2091a19700 1 --2- 172.21.15.72:0/2421837246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208c13b750 0x7f208c13bbf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2084009dd0 tx=0x7f208400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.720+0000 7f2091a19700 1 -- 172.21.15.72:0/2421837246 shutdown_connections 2023-10-03T10:13:25.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.720+0000 7f2091a19700 1 --2- 172.21.15.72:0/2421837246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f208c06e570 0x7f208c140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.720+0000 7f2091a19700 1 --2- 172.21.15.72:0/2421837246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208c13b750 0x7f208c13bbf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.720+0000 7f2091a19700 1 --2- 172.21.15.72:0/2421837246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208c06ee80 0x7f208c13b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.720+0000 7f2091a19700 1 -- 172.21.15.72:0/2421837246 >> 172.21.15.72:0/2421837246 conn(0x7f208c0a2aa0 msgr2=0x7f208c0a2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.721+0000 7f2091a19700 1 -- 172.21.15.72:0/2421837246 shutdown_connections 2023-10-03T10:13:25.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:25.721+0000 7f2091a19700 1 -- 172.21.15.72:0/2421837246 wait complete. 2023-10-03T10:13:25.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:26.647 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:26.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:26.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:26.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:26.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.785+0000 7fd4105ba700 1 Processor -- start 2023-10-03T10:13:26.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.785+0000 7fd4105ba700 1 -- start start 2023-10-03T10:13:26.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.786+0000 7fd4105ba700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4081338a0 0x7fd408133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.786+0000 7fd4105ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd40809e930 0x7fd40813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.786+0000 7fd4105ba700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40806ef30 con 0x7fd40809de50 2023-10-03T10:13:26.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.786+0000 7fd4105ba700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40806fef0 con 0x7fd40809e930 2023-10-03T10:13:26.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.786+0000 7fd4105ba700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4081334b0 con 0x7fd4081338a0 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.786+0000 7fd40e356700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4081338a0 0x7fd408133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.786+0000 7fd40e356700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4081338a0 0x7fd408133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40946/0 (socket says 172.21.15.72:40946) 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.786+0000 7fd40db55700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd40809de50 0x7fd40809e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60272/0 (socket says 172.21.15.72:60272) 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.786+0000 7fd40e356700 1 -- 172.21.15.72:0/1601046655 learned_addr learned my addr 172.21.15.72:0/1601046655 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.786+0000 7fd40eb57700 1 --2- 172.21.15.72:0/1601046655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd40809e930 0x7fd40813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.786+0000 7fd40e356700 1 -- 172.21.15.72:0/1601046655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd40809e930 msgr2=0x7fd40813b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.786+0000 7fd40e356700 1 --2- 172.21.15.72:0/1601046655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd40809e930 0x7fd40813b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.786+0000 7fd40e356700 1 -- 172.21.15.72:0/1601046655 >> v1:172.21.15.72:6789/0 conn(0x7fd40809de50 legacy=0x7fd40809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.786+0000 7fd40d354700 1 -- 172.21.15.72:0/1601046655 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254290542 0 0) 0x7fd40806ef30 con 0x7fd40809de50 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.786+0000 7fd40e356700 1 -- 172.21.15.72:0/1601046655 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40806fc30 con 0x7fd4081338a0 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.787+0000 7fd40e356700 1 --2- 172.21.15.72:0/1601046655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4081338a0 0x7fd408133c70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd404009920 tx=0x7fd404009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fe863b924372fb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.787+0000 7fd40d354700 1 -- 172.21.15.72:0/1601046655 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40400ba60 con 0x7fd4081338a0 2023-10-03T10:13:26.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.787+0000 7fd40d354700 1 -- 172.21.15.72:0/1601046655 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40400bbc0 con 0x7fd4081338a0 2023-10-03T10:13:26.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.787+0000 7fd40d354700 1 -- 172.21.15.72:0/1601046655 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd404009e70 con 0x7fd4081338a0 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.787+0000 7fd4105ba700 1 -- 172.21.15.72:0/1601046655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4081338a0 msgr2=0x7fd408133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.787+0000 7fd4105ba700 1 --2- 172.21.15.72:0/1601046655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4081338a0 0x7fd408133c70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd404009920 tx=0x7fd404009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.788+0000 7fd4105ba700 1 -- 172.21.15.72:0/1601046655 shutdown_connections 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.788+0000 7fd4105ba700 1 --2- 172.21.15.72:0/1601046655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd40809e930 0x7fd40813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.788+0000 7fd4105ba700 1 --2- 172.21.15.72:0/1601046655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4081338a0 0x7fd408133c70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.788+0000 7fd4105ba700 1 -- 172.21.15.72:0/1601046655 >> 172.21.15.72:0/1601046655 conn(0x7fd4080a2aa0 msgr2=0x7fd4080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.788+0000 7fd4105ba700 1 -- 172.21.15.72:0/1601046655 shutdown_connections 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.788+0000 7fd4105ba700 1 -- 172.21.15.72:0/1601046655 wait complete. 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.789+0000 7fd4105ba700 1 Processor -- start 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.789+0000 7fd4105ba700 1 -- start start 2023-10-03T10:13:26.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd4105ba700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd40809de50 0x7fd40811d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd4105ba700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd40809e930 0x7fd40811dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd4105ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4081338a0 0x7fd40811e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd4105ba700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40811ed10 con 0x7fd40809e930 2023-10-03T10:13:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd4105ba700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd408130c30 con 0x7fd4081338a0 2023-10-03T10:13:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd4105ba700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd40811fa70 con 0x7fd40809de50 2023-10-03T10:13:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd40e356700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd40809de50 0x7fd40811d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd40eb57700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4081338a0 0x7fd40811e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd40eb57700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4081338a0 0x7fd40811e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38886/0 (socket says 172.21.15.72:38886) 2023-10-03T10:13:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd40e356700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd40809de50 0x7fd40811d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40960/0 (socket says 172.21.15.72:40960) 2023-10-03T10:13:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd40eb57700 1 -- 172.21.15.72:0/3913850357 learned_addr learned my addr 172.21.15.72:0/3913850357 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:26.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd40db55700 1 --2- 172.21.15.72:0/3913850357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd40809e930 0x7fd40811dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd40eb57700 1 -- 172.21.15.72:0/3913850357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd40809de50 msgr2=0x7fd40811d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd40eb57700 1 --2- 172.21.15.72:0/3913850357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd40809de50 0x7fd40811d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd40eb57700 1 -- 172.21.15.72:0/3913850357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd40809e930 msgr2=0x7fd40811dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd40eb57700 1 --2- 172.21.15.72:0/3913850357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd40809e930 0x7fd40811dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd40eb57700 1 -- 172.21.15.72:0/3913850357 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404009550 con 0x7fd4081338a0 2023-10-03T10:13:26.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.790+0000 7fd40e356700 1 --2- 172.21.15.72:0/3913850357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd40809de50 0x7fd40811d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:26.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.791+0000 7fd40eb57700 1 --2- 172.21.15.72:0/3913850357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4081338a0 0x7fd40811e2c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd400007e40 tx=0x7fd40000e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.791+0000 7fd3feffd700 1 -- 172.21.15.72:0/3913850357 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40000ed30 con 0x7fd4081338a0 2023-10-03T10:13:26.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.791+0000 7fd3feffd700 1 -- 172.21.15.72:0/3913850357 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd400014420 con 0x7fd4081338a0 2023-10-03T10:13:26.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.791+0000 7fd4105ba700 1 -- 172.21.15.72:0/3913850357 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4081206a0 con 0x7fd4081338a0 2023-10-03T10:13:26.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.791+0000 7fd3feffd700 1 -- 172.21.15.72:0/3913850357 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4000147d0 con 0x7fd4081338a0 2023-10-03T10:13:26.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.791+0000 7fd4105ba700 1 -- 172.21.15.72:0/3913850357 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4080a0cc0 con 0x7fd4081338a0 2023-10-03T10:13:26.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.792+0000 7fd3feffd700 1 -- 172.21.15.72:0/3913850357 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd400014930 con 0x7fd4081338a0 2023-10-03T10:13:26.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.792+0000 7fd4105ba700 1 -- 172.21.15.72:0/3913850357 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40811a470 con 0x7fd4081338a0 2023-10-03T10:13:26.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.792+0000 7fd3feffd700 1 -- 172.21.15.72:0/3913850357 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd40003fe20 con 0x7fd4081338a0 2023-10-03T10:13:26.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.797+0000 7fd3feffd700 1 -- 172.21.15.72:0/3913850357 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd400044070 con 0x7fd4081338a0 2023-10-03T10:13:26.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.832+0000 7fbea8869700 1 Processor -- start 2023-10-03T10:13:26.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.832+0000 7fbea8869700 1 -- start start 2023-10-03T10:13:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.833+0000 7fbea8869700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea409f410 0x7fbea4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.833+0000 7fbea8869700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbea4136fe0 0x7fbea41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.833+0000 7fbea8869700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea4070940 con 0x7fbea409e930 2023-10-03T10:13:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.833+0000 7fbea8869700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea406fd60 con 0x7fbea4136fe0 2023-10-03T10:13:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.833+0000 7fbea8869700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea406fa80 con 0x7fbea409f410 2023-10-03T10:13:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.833+0000 7fbea1d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea409f410 0x7fbea4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.833+0000 7fbea1d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea409f410 0x7fbea4136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38892/0 (socket says 172.21.15.72:38892) 2023-10-03T10:13:26.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.833+0000 7fbea1d9b700 1 -- 172.21.15.72:0/3249625779 learned_addr learned my addr 172.21.15.72:0/3249625779 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:26.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.833+0000 7fbea2d9d700 1 --2- 172.21.15.72:0/3249625779 >> v2:172.21.15.72:3300/0 conn(0x7fbea4136fe0 0x7fbea41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.834+0000 7fbea1d9b700 1 -- 172.21.15.72:0/3249625779 >> v2:172.21.15.72:3300/0 conn(0x7fbea4136fe0 msgr2=0x7fbea41393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:26.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.834+0000 7fbea1d9b700 1 --2- 172.21.15.72:0/3249625779 >> v2:172.21.15.72:3300/0 conn(0x7fbea4136fe0 0x7fbea41393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.834+0000 7fbea1d9b700 1 -- 172.21.15.72:0/3249625779 >> v1:172.21.15.72:6789/0 conn(0x7fbea409e930 legacy=0x7fbea409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.834+0000 7fbea1d9b700 1 -- 172.21.15.72:0/3249625779 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea409fb60 con 0x7fbea409f410 2023-10-03T10:13:26.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.834+0000 7fbea1d9b700 1 --2- 172.21.15.72:0/3249625779 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea409f410 0x7fbea4136aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe980098f0 tx=0x7fbe98009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ea409c7cc6e9a15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.834+0000 7fbea159a700 1 -- 172.21.15.72:0/3249625779 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98011830 con 0x7fbea409f410 2023-10-03T10:13:26.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.834+0000 7fbea159a700 1 -- 172.21.15.72:0/3249625779 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe98011990 con 0x7fbea409f410 2023-10-03T10:13:26.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.834+0000 7fbea159a700 1 -- 172.21.15.72:0/3249625779 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98011d20 con 0x7fbea409f410 2023-10-03T10:13:26.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.835+0000 7fbea8869700 1 -- 172.21.15.72:0/3249625779 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea409f410 msgr2=0x7fbea4136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.835+0000 7fbea8869700 1 --2- 172.21.15.72:0/3249625779 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea409f410 0x7fbea4136aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe980098f0 tx=0x7fbe98009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:26.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.835+0000 7fbea8869700 1 -- 172.21.15.72:0/3249625779 shutdown_connections 2023-10-03T10:13:26.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.835+0000 7fbea8869700 1 --2- 172.21.15.72:0/3249625779 >> v2:172.21.15.72:3300/0 conn(0x7fbea4136fe0 0x7fbea41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.835+0000 7fbea8869700 1 --2- 172.21.15.72:0/3249625779 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea409f410 0x7fbea4136aa0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.835+0000 7fbea8869700 1 -- 172.21.15.72:0/3249625779 >> 172.21.15.72:0/3249625779 conn(0x7fbea40a4210 msgr2=0x7fbea40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.835+0000 7fbea8869700 1 -- 172.21.15.72:0/3249625779 shutdown_connections 2023-10-03T10:13:26.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.835+0000 7fbea8869700 1 -- 172.21.15.72:0/3249625779 wait complete. 2023-10-03T10:13:26.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.837+0000 7fbea8869700 1 Processor -- start 2023-10-03T10:13:26.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.837+0000 7fbea8869700 1 -- start start 2023-10-03T10:13:26.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.837+0000 7fbea8869700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea409e930 0x7fbea411c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.837+0000 7fbea8869700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea409f410 0x7fbea411cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.837+0000 7fbea8869700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea4136fe0 0x7fbea411d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.837+0000 7fbea8869700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea411fe50 con 0x7fbea409e930 2023-10-03T10:13:26.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.837+0000 7fbea8869700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea40a2f40 con 0x7fbea409f410 2023-10-03T10:13:26.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.837+0000 7fbea8869700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbea411f8a0 con 0x7fbea4136fe0 2023-10-03T10:13:26.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.837+0000 7fbea1d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea409f410 0x7fbea411cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.837+0000 7fbea1d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea409f410 0x7fbea411cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38906/0 (socket says 172.21.15.72:38906) 2023-10-03T10:13:26.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.837+0000 7fbea1d9b700 1 -- 172.21.15.72:0/3623485617 learned_addr learned my addr 172.21.15.72:0/3623485617 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:26.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.838+0000 7fbea2d9d700 1 --2- 172.21.15.72:0/3623485617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea4136fe0 0x7fbea411d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.838+0000 7fbea259c700 1 --2- 172.21.15.72:0/3623485617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea409e930 0x7fbea411c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.838+0000 7fbea2d9d700 1 -- 172.21.15.72:0/3623485617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea409f410 msgr2=0x7fbea411cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.838+0000 7fbea2d9d700 1 --2- 172.21.15.72:0/3623485617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea409f410 0x7fbea411cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.838+0000 7fbea2d9d700 1 -- 172.21.15.72:0/3623485617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea409e930 msgr2=0x7fbea411c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.838+0000 7fbea2d9d700 1 --2- 172.21.15.72:0/3623485617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea409e930 0x7fbea411c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.838+0000 7fbea2d9d700 1 -- 172.21.15.72:0/3623485617 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009550 con 0x7fbea4136fe0 2023-10-03T10:13:26.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.838+0000 7fbea2d9d700 1 --2- 172.21.15.72:0/3623485617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea4136fe0 0x7fbea411d0e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00ef90 tx=0x7fbe9c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.838+0000 7fbe92ffd700 1 -- 172.21.15.72:0/3623485617 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00cc90 con 0x7fbea4136fe0 2023-10-03T10:13:26.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.838+0000 7fbea8869700 1 -- 172.21.15.72:0/3623485617 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea4071d20 con 0x7fbea4136fe0 2023-10-03T10:13:26.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.838+0000 7fbea8869700 1 -- 172.21.15.72:0/3623485617 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea411e9d0 con 0x7fbea4136fe0 2023-10-03T10:13:26.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.838+0000 7fbe92ffd700 1 -- 172.21.15.72:0/3623485617 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c00f040 con 0x7fbea4136fe0 2023-10-03T10:13:26.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.838+0000 7fbe92ffd700 1 -- 172.21.15.72:0/3623485617 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c009e60 con 0x7fbea4136fe0 2023-10-03T10:13:26.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.839+0000 7fbea8869700 1 -- 172.21.15.72:0/3623485617 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe880052e0 con 0x7fbea4136fe0 2023-10-03T10:13:26.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.839+0000 7fbe92ffd700 1 -- 172.21.15.72:0/3623485617 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe9c014480 con 0x7fbea4136fe0 2023-10-03T10:13:26.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.840+0000 7fbe92ffd700 1 -- 172.21.15.72:0/3623485617 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbe9c040110 con 0x7fbea4136fe0 2023-10-03T10:13:26.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.843+0000 7f97b2b9c700 1 Processor -- start 2023-10-03T10:13:26.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.843+0000 7f97b2b9c700 1 -- start start 2023-10-03T10:13:26.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.843+0000 7f97b2b9c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97ac131630 0x7f97ac131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.843+0000 7f97b2b9c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac131f40 0x7f97ac06e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.843+0000 7f97b2b9c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97ac06e9d0 0x7f97ac06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.843+0000 7f97b2b9c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ac071a00 con 0x7f97ac06e9d0 2023-10-03T10:13:26.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.843+0000 7f97b2b9c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac131430 con 0x7f97ac131f40 2023-10-03T10:13:26.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.843+0000 7f97b2b9c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac09a510 con 0x7f97ac131630 2023-10-03T10:13:26.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97b0938700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97ac131630 0x7f97ac131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97abfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac131f40 0x7f97ac06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97b0938700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97ac131630 0x7f97ac131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:40984/0 (socket says 172.21.15.72:40984) 2023-10-03T10:13:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97abfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac131f40 0x7f97ac06e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38920/0 (socket says 172.21.15.72:38920) 2023-10-03T10:13:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97b0938700 1 -- 172.21.15.72:0/3535235858 learned_addr learned my addr 172.21.15.72:0/3535235858 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97b1139700 1 --2- 172.21.15.72:0/3535235858 >> v2:172.21.15.72:3300/0 conn(0x7f97ac06e9d0 0x7f97ac06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97abfff700 1 -- 172.21.15.72:0/3535235858 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97ac131630 msgr2=0x7f97ac131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97abfff700 1 --2- 172.21.15.72:0/3535235858 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97ac131630 0x7f97ac131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97abfff700 1 -- 172.21.15.72:0/3535235858 >> v2:172.21.15.72:3300/0 conn(0x7f97ac06e9d0 msgr2=0x7f97ac06ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97abfff700 1 --2- 172.21.15.72:0/3535235858 >> v2:172.21.15.72:3300/0 conn(0x7f97ac06e9d0 0x7f97ac06ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97abfff700 1 -- 172.21.15.72:0/3535235858 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac0721c0 con 0x7f97ac131f40 2023-10-03T10:13:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97b1139700 1 --2- 172.21.15.72:0/3535235858 >> v2:172.21.15.72:3300/0 conn(0x7f97ac06e9d0 0x7f97ac06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:26.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97abfff700 1 --2- 172.21.15.72:0/3535235858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac131f40 0x7f97ac06e490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9798009840 tx=0x7f9798009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f8dab4a9d9d53e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97ab7fe700 1 -- 172.21.15.72:0/3535235858 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798011830 con 0x7f97ac131f40 2023-10-03T10:13:26.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97ab7fe700 1 -- 172.21.15.72:0/3535235858 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9798011990 con 0x7f97ac131f40 2023-10-03T10:13:26.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.844+0000 7f97ab7fe700 1 -- 172.21.15.72:0/3535235858 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798011d20 con 0x7f97ac131f40 2023-10-03T10:13:26.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.845+0000 7f97b2b9c700 1 -- 172.21.15.72:0/3535235858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac131f40 msgr2=0x7f97ac06e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.845+0000 7f97b2b9c700 1 --2- 172.21.15.72:0/3535235858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac131f40 0x7f97ac06e490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9798009840 tx=0x7f9798009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:26.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.845+0000 7f97b2b9c700 1 -- 172.21.15.72:0/3535235858 shutdown_connections 2023-10-03T10:13:26.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.845+0000 7f97b2b9c700 1 --2- 172.21.15.72:0/3535235858 >> v2:172.21.15.72:3300/0 conn(0x7f97ac06e9d0 0x7f97ac06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.845+0000 7f97b2b9c700 1 --2- 172.21.15.72:0/3535235858 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97ac131630 0x7f97ac131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.845+0000 7f97b2b9c700 1 --2- 172.21.15.72:0/3535235858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac131f40 0x7f97ac06e490 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.845+0000 7f97b2b9c700 1 -- 172.21.15.72:0/3535235858 >> 172.21.15.72:0/3535235858 conn(0x7f97ac0a2aa0 msgr2=0x7f97ac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.845+0000 7f97b2b9c700 1 -- 172.21.15.72:0/3535235858 shutdown_connections 2023-10-03T10:13:26.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.845+0000 7f97b2b9c700 1 -- 172.21.15.72:0/3535235858 wait complete. 2023-10-03T10:13:26.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.846+0000 7f97b2b9c700 1 Processor -- start 2023-10-03T10:13:26.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.846+0000 7f97b2b9c700 1 -- start start 2023-10-03T10:13:26.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97b2b9c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97ac06e9d0 0x7f97ac11b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97b2b9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97ac131630 0x7f97ac11bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97b2b9c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac131f40 0x7f97ac11c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97b2b9c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac11cad0 con 0x7f97ac131630 2023-10-03T10:13:26.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97b2b9c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac11d230 con 0x7f97ac131f40 2023-10-03T10:13:26.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97b2b9c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac11e480 con 0x7f97ac06e9d0 2023-10-03T10:13:26.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97abfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97ac131630 0x7f97ac11bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97abfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97ac131630 0x7f97ac11bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43952/0 (socket says 172.21.15.72:43952) 2023-10-03T10:13:26.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97abfff700 1 -- 172.21.15.72:0/1294426215 learned_addr learned my addr 172.21.15.72:0/1294426215 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:26.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97b1139700 1 --2- 172.21.15.72:0/1294426215 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac131f40 0x7f97ac11c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97b0938700 1 --2- 172.21.15.72:0/1294426215 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97ac06e9d0 0x7f97ac11b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97abfff700 1 -- 172.21.15.72:0/1294426215 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97ac06e9d0 msgr2=0x7f97ac11b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97abfff700 1 --2- 172.21.15.72:0/1294426215 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97ac06e9d0 0x7f97ac11b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97abfff700 1 -- 172.21.15.72:0/1294426215 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac131f40 msgr2=0x7f97ac11c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97abfff700 1 --2- 172.21.15.72:0/1294426215 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac131f40 0x7f97ac11c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97abfff700 1 -- 172.21.15.72:0/1294426215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97980094a0 con 0x7f97ac131630 2023-10-03T10:13:26.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.847+0000 7f97abfff700 1 --2- 172.21.15.72:0/1294426215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97ac131630 0x7f97ac11bb60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9798009b90 tx=0x7f9798004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.848+0000 7f97a97fa700 1 -- 172.21.15.72:0/1294426215 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798004510 con 0x7f97ac131630 2023-10-03T10:13:26.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.848+0000 7f97a97fa700 1 -- 172.21.15.72:0/1294426215 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97980036a0 con 0x7f97ac131630 2023-10-03T10:13:26.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.848+0000 7f97a97fa700 1 -- 172.21.15.72:0/1294426215 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798003a50 con 0x7f97ac131630 2023-10-03T10:13:26.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.848+0000 7f97b2b9c700 1 -- 172.21.15.72:0/1294426215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ac11ee60 con 0x7f97ac131630 2023-10-03T10:13:26.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.848+0000 7f97b2b9c700 1 -- 172.21.15.72:0/1294426215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac0a30e0 con 0x7f97ac131630 2023-10-03T10:13:26.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.848+0000 7fbe92ffd700 1 -- 172.21.15.72:0/3623485617 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe9c007920 con 0x7fbea4136fe0 2023-10-03T10:13:26.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.849+0000 7f97b2b9c700 1 -- 172.21.15.72:0/1294426215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ac099f20 con 0x7f97ac131630 2023-10-03T10:13:26.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.853+0000 7f97a97fa700 1 -- 172.21.15.72:0/1294426215 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9798003bb0 con 0x7f97ac131630 2023-10-03T10:13:26.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.853+0000 7f97a97fa700 1 -- 172.21.15.72:0/1294426215 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9798042bc0 con 0x7f97ac131630 2023-10-03T10:13:26.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.854+0000 7f97a97fa700 1 -- 172.21.15.72:0/1294426215 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9798046060 con 0x7f97ac131630 2023-10-03T10:13:26.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.890+0000 7f0920ce9700 1 Processor -- start 2023-10-03T10:13:26.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.890+0000 7f0920ce9700 1 -- start start 2023-10-03T10:13:26.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.891+0000 7f0920ce9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f091c09d760 0x7f091c09db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.891+0000 7f0920ce9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f091c130f10 0x7f091c138ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.891+0000 7f0920ce9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091c09c520 con 0x7f091c09e070 2023-10-03T10:13:26.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.891+0000 7f0920ce9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f091c09a940 con 0x7f091c09d760 2023-10-03T10:13:26.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.891+0000 7f0920ce9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f091c09a3d0 con 0x7f091c130f10 2023-10-03T10:13:26.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.891+0000 7f091ad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f091c130f10 0x7f091c138ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.891+0000 7f0919d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f091c09e070 0x7f091c130800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60298/0 (socket says 172.21.15.72:60298) 2023-10-03T10:13:26.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.891+0000 7f0919d9b700 1 -- 172.21.15.72:0/3423959815 learned_addr learned my addr 172.21.15.72:0/3423959815 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:26.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.891+0000 7f091a59c700 1 --2- 172.21.15.72:0/3423959815 >> v2:172.21.15.72:3300/0 conn(0x7f091c09d760 0x7f091c09db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.892+0000 7f091ad9d700 1 -- 172.21.15.72:0/3423959815 >> v2:172.21.15.72:3300/0 conn(0x7f091c09d760 msgr2=0x7f091c09db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:26.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.892+0000 7f091ad9d700 1 --2- 172.21.15.72:0/3423959815 >> v2:172.21.15.72:3300/0 conn(0x7f091c09d760 0x7f091c09db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.892+0000 7f091ad9d700 1 -- 172.21.15.72:0/3423959815 >> v1:172.21.15.72:6789/0 conn(0x7f091c09e070 legacy=0x7f091c130800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.892+0000 7f091ad9d700 1 -- 172.21.15.72:0/3423959815 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c09f1a0 con 0x7f091c130f10 2023-10-03T10:13:26.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.892+0000 7f091ad9d700 1 --2- 172.21.15.72:0/3423959815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f091c130f10 0x7f091c138ad0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0914009d90 tx=0x7f091400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e36f64b5bed3b90 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.892+0000 7f091959a700 1 -- 172.21.15.72:0/3423959815 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091400e070 con 0x7f091c130f10 2023-10-03T10:13:26.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.892+0000 7f091959a700 1 -- 172.21.15.72:0/3423959815 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091400bb20 con 0x7f091c130f10 2023-10-03T10:13:26.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.892+0000 7f091959a700 1 -- 172.21.15.72:0/3423959815 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0914012430 con 0x7f091c130f10 2023-10-03T10:13:26.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.893+0000 7f0920ce9700 1 -- 172.21.15.72:0/3423959815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f091c130f10 msgr2=0x7f091c138ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.893+0000 7f0920ce9700 1 --2- 172.21.15.72:0/3423959815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f091c130f10 0x7f091c138ad0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0914009d90 tx=0x7f091400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:26.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.893+0000 7f0920ce9700 1 -- 172.21.15.72:0/3423959815 shutdown_connections 2023-10-03T10:13:26.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.893+0000 7f0920ce9700 1 --2- 172.21.15.72:0/3423959815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f091c130f10 0x7f091c138ad0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.893+0000 7f0920ce9700 1 --2- 172.21.15.72:0/3423959815 >> v2:172.21.15.72:3300/0 conn(0x7f091c09d760 0x7f091c09db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.893+0000 7f0920ce9700 1 -- 172.21.15.72:0/3423959815 >> 172.21.15.72:0/3423959815 conn(0x7f091c066f50 msgr2=0x7f091c0a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.893+0000 7f0920ce9700 1 -- 172.21.15.72:0/3423959815 shutdown_connections 2023-10-03T10:13:26.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.893+0000 7f0920ce9700 1 -- 172.21.15.72:0/3423959815 wait complete. 2023-10-03T10:13:26.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.894+0000 7f0920ce9700 1 Processor -- start 2023-10-03T10:13:26.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.894+0000 7f0920ce9700 1 -- start start 2023-10-03T10:13:26.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.894+0000 7f0920ce9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f091c09d760 0x7f091c11b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.894+0000 7f0920ce9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f091c09e070 0x7f091c11bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.894+0000 7f0920ce9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f091c130f10 0x7f091c11c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.894+0000 7f0920ce9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c11d9a0 con 0x7f091c09d760 2023-10-03T10:13:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.894+0000 7f0920ce9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091c1303e0 con 0x7f091c09e070 2023-10-03T10:13:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.894+0000 7f0920ce9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f091c09c860 con 0x7f091c130f10 2023-10-03T10:13:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f091ad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f091c130f10 0x7f091c11c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f091a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f091c09d760 0x7f091c11b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f091ad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f091c130f10 0x7f091c11c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41000/0 (socket says 172.21.15.72:41000) 2023-10-03T10:13:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f091ad9d700 1 -- 172.21.15.72:0/2423773531 learned_addr learned my addr 172.21.15.72:0/2423773531 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f0919d9b700 1 --2- 172.21.15.72:0/2423773531 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f091c09e070 0x7f091c11bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f091a59c700 1 -- 172.21.15.72:0/2423773531 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f091c130f10 msgr2=0x7f091c11c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f091a59c700 1 --2- 172.21.15.72:0/2423773531 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f091c130f10 0x7f091c11c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f091a59c700 1 -- 172.21.15.72:0/2423773531 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f091c09e070 msgr2=0x7f091c11bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f091a59c700 1 --2- 172.21.15.72:0/2423773531 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f091c09e070 0x7f091c11bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f091a59c700 1 -- 172.21.15.72:0/2423773531 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0914009a70 con 0x7f091c09d760 2023-10-03T10:13:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f0919d9b700 1 --2- 172.21.15.72:0/2423773531 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f091c09e070 0x7f091c11bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f091a59c700 1 --2- 172.21.15.72:0/2423773531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f091c09d760 0x7f091c11b6c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f090c00e870 tx=0x7f090c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f090affd700 1 -- 172.21.15.72:0/2423773531 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c013680 con 0x7f091c09d760 2023-10-03T10:13:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f090affd700 1 -- 172.21.15.72:0/2423773531 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c0137e0 con 0x7f091c09d760 2023-10-03T10:13:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f0920ce9700 1 -- 172.21.15.72:0/2423773531 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091c06b310 con 0x7f091c09d760 2023-10-03T10:13:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f090affd700 1 -- 172.21.15.72:0/2423773531 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c013b70 con 0x7f091c09d760 2023-10-03T10:13:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.895+0000 7f0920ce9700 1 -- 172.21.15.72:0/2423773531 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091c12e3a0 con 0x7f091c09d760 2023-10-03T10:13:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.896+0000 7f090affd700 1 -- 172.21.15.72:0/2423773531 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f090c013cd0 con 0x7f091c09d760 2023-10-03T10:13:26.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.897+0000 7f0920ce9700 1 -- 172.21.15.72:0/2423773531 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091c0747f0 con 0x7f091c09d760 2023-10-03T10:13:26.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.897+0000 7f090affd700 1 -- 172.21.15.72:0/2423773531 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f090c03f8a0 con 0x7f091c09d760 2023-10-03T10:13:26.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:26.901+0000 7f090affd700 1 -- 172.21.15.72:0/2423773531 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f090c011db0 con 0x7f091c09d760 2023-10-03T10:13:27.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.009+0000 7fd4105ba700 1 -- 172.21.15.72:0/3913850357 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd4081ba420 con 0x7fd4081338a0 2023-10-03T10:13:27.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.009+0000 7fd3feffd700 1 -- 172.21.15.72:0/3913850357 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd40001bb00 con 0x7fd4081338a0 2023-10-03T10:13:27.009 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:27.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.011+0000 7fd4105ba700 1 -- 172.21.15.72:0/3913850357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4081338a0 msgr2=0x7fd40811e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.011+0000 7fd4105ba700 1 --2- 172.21.15.72:0/3913850357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4081338a0 0x7fd40811e2c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd400007e40 tx=0x7fd40000e3c0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.011+0000 7fd4105ba700 1 -- 172.21.15.72:0/3913850357 shutdown_connections 2023-10-03T10:13:27.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.011+0000 7fd4105ba700 1 --2- 172.21.15.72:0/3913850357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4081338a0 0x7fd40811e2c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.011+0000 7fd4105ba700 1 --2- 172.21.15.72:0/3913850357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd40809de50 0x7fd40811d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.011+0000 7fd4105ba700 1 --2- 172.21.15.72:0/3913850357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd40809e930 0x7fd40811dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.011+0000 7fd4105ba700 1 -- 172.21.15.72:0/3913850357 >> 172.21.15.72:0/3913850357 conn(0x7fd4080a2aa0 msgr2=0x7fd4081bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.012+0000 7fd4105ba700 1 -- 172.21.15.72:0/3913850357 shutdown_connections 2023-10-03T10:13:27.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.014+0000 7fd4105ba700 1 -- 172.21.15.72:0/3913850357 wait complete. 2023-10-03T10:13:27.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:27.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.042+0000 7fbea8869700 1 -- 172.21.15.72:0/3623485617 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbe88005590 con 0x7fbea4136fe0 2023-10-03T10:13:27.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.043+0000 7fbe92ffd700 1 -- 172.21.15.72:0/3623485617 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe9c007330 con 0x7fbea4136fe0 2023-10-03T10:13:27.042 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:27.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.045+0000 7fbea8869700 1 -- 172.21.15.72:0/3623485617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea4136fe0 msgr2=0x7fbea411d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.045+0000 7fbea8869700 1 --2- 172.21.15.72:0/3623485617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea4136fe0 0x7fbea411d0e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00ef90 tx=0x7fbe9c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.045+0000 7fbea8869700 1 -- 172.21.15.72:0/3623485617 shutdown_connections 2023-10-03T10:13:27.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.045+0000 7fbea8869700 1 --2- 172.21.15.72:0/3623485617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea409e930 0x7fbea411c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.045+0000 7fbea8869700 1 --2- 172.21.15.72:0/3623485617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea4136fe0 0x7fbea411d0e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.045+0000 7fbea8869700 1 --2- 172.21.15.72:0/3623485617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea409f410 0x7fbea411cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.045+0000 7fbea8869700 1 -- 172.21.15.72:0/3623485617 >> 172.21.15.72:0/3623485617 conn(0x7fbea40a4210 msgr2=0x7fbea40a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.045+0000 7fbea8869700 1 -- 172.21.15.72:0/3623485617 shutdown_connections 2023-10-03T10:13:27.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.045+0000 7fbea8869700 1 -- 172.21.15.72:0/3623485617 wait complete. 2023-10-03T10:13:27.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:27.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.064+0000 7f97b2b9c700 1 -- 172.21.15.72:0/1294426215 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f97ac074ea0 con 0x7f97ac131630 2023-10-03T10:13:27.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.064+0000 7f97a97fa700 1 -- 172.21.15.72:0/1294426215 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9798015020 con 0x7f97ac131630 2023-10-03T10:13:27.065 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:27.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.066+0000 7f97b2b9c700 1 -- 172.21.15.72:0/1294426215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97ac131630 msgr2=0x7f97ac11bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.066+0000 7f97b2b9c700 1 --2- 172.21.15.72:0/1294426215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97ac131630 0x7f97ac11bb60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9798009b90 tx=0x7f9798004750 comp rx=0 tx=0).stop 2023-10-03T10:13:27.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.066+0000 7f97b2b9c700 1 -- 172.21.15.72:0/1294426215 shutdown_connections 2023-10-03T10:13:27.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.066+0000 7f97b2b9c700 1 --2- 172.21.15.72:0/1294426215 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97ac131f40 0x7f97ac11c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.066+0000 7f97b2b9c700 1 --2- 172.21.15.72:0/1294426215 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97ac06e9d0 0x7f97ac11b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.066+0000 7f97b2b9c700 1 --2- 172.21.15.72:0/1294426215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97ac131630 0x7f97ac11bb60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.066+0000 7f97b2b9c700 1 -- 172.21.15.72:0/1294426215 >> 172.21.15.72:0/1294426215 conn(0x7f97ac0a2aa0 msgr2=0x7f97ac1b8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.066+0000 7f97b2b9c700 1 -- 172.21.15.72:0/1294426215 shutdown_connections 2023-10-03T10:13:27.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.067+0000 7f97b2b9c700 1 -- 172.21.15.72:0/1294426215 wait complete. 2023-10-03T10:13:27.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:27.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.095+0000 7f0920ce9700 1 -- 172.21.15.72:0/2423773531 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f091c06c360 con 0x7f091c09d760 2023-10-03T10:13:27.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.095+0000 7f090affd700 1 -- 172.21.15.72:0/2423773531 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f090c017070 con 0x7f091c09d760 2023-10-03T10:13:27.096 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.097+0000 7f0920ce9700 1 -- 172.21.15.72:0/2423773531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f091c09d760 msgr2=0x7f091c11b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.097+0000 7f0920ce9700 1 --2- 172.21.15.72:0/2423773531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f091c09d760 0x7f091c11b6c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f090c00e870 tx=0x7f090c00eb80 comp rx=0 tx=0).stop 2023-10-03T10:13:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.097+0000 7f0920ce9700 1 -- 172.21.15.72:0/2423773531 shutdown_connections 2023-10-03T10:13:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.097+0000 7f0920ce9700 1 --2- 172.21.15.72:0/2423773531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f091c09d760 0x7f091c11b6c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.097+0000 7f0920ce9700 1 --2- 172.21.15.72:0/2423773531 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f091c130f10 0x7f091c11c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.097+0000 7f0920ce9700 1 --2- 172.21.15.72:0/2423773531 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f091c09e070 0x7f091c11bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.097+0000 7f0920ce9700 1 -- 172.21.15.72:0/2423773531 >> 172.21.15.72:0/2423773531 conn(0x7f091c066f50 msgr2=0x7f091c12e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.097+0000 7f0920ce9700 1 -- 172.21.15.72:0/2423773531 shutdown_connections 2023-10-03T10:13:27.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:27.097+0000 7f0920ce9700 1 -- 172.21.15.72:0/2423773531 wait complete. 2023-10-03T10:13:27.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:28.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:28.057 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:28.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:28.110 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:28.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.173+0000 7fc748140700 1 Processor -- start 2023-10-03T10:13:28.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.173+0000 7fc748140700 1 -- start start 2023-10-03T10:13:28.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.173+0000 7fc748140700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc74006a770 0x7fc74006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.173+0000 7fc748140700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc74006b080 0x7fc740131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.173+0000 7fc748140700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc740131b40 0x7fc740131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.173+0000 7fc748140700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74009ece0 con 0x7fc74006a770 2023-10-03T10:13:28.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.173+0000 7fc748140700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74009e760 con 0x7fc74006b080 2023-10-03T10:13:28.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.173+0000 7fc748140700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc74009e040 con 0x7fc740131b40 2023-10-03T10:13:28.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.174+0000 7fc7466dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc740131b40 0x7fc740131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.174+0000 7fc7456db700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc74006b080 0x7fc740131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.174+0000 7fc7466dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc740131b40 0x7fc740131fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41010/0 (socket says 172.21.15.72:41010) 2023-10-03T10:13:28.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.174+0000 7fc7466dd700 1 -- 172.21.15.72:0/277569449 learned_addr learned my addr 172.21.15.72:0/277569449 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:28.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.174+0000 7fc745edc700 1 --2- 172.21.15.72:0/277569449 >> v2:172.21.15.72:3300/0 conn(0x7fc74006a770 0x7fc74006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.174+0000 7fc7456db700 1 -- 172.21.15.72:0/277569449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc740131b40 msgr2=0x7fc740131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.174+0000 7fc7456db700 1 --2- 172.21.15.72:0/277569449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc740131b40 0x7fc740131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.174+0000 7fc7456db700 1 -- 172.21.15.72:0/277569449 >> v2:172.21.15.72:3300/0 conn(0x7fc74006a770 msgr2=0x7fc74006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.174+0000 7fc7456db700 1 --2- 172.21.15.72:0/277569449 >> v2:172.21.15.72:3300/0 conn(0x7fc74006a770 0x7fc74006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.174+0000 7fc7456db700 1 -- 172.21.15.72:0/277569449 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74009f630 con 0x7fc74006b080 2023-10-03T10:13:28.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.174+0000 7fc7466dd700 1 --2- 172.21.15.72:0/277569449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc740131b40 0x7fc740131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.174+0000 7fc7456db700 1 --2- 172.21.15.72:0/277569449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc74006b080 0x7fc740131600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc730009840 tx=0x7fc730009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66a7edc41b37b833 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.174+0000 7fc744eda700 1 -- 172.21.15.72:0/277569449 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730011830 con 0x7fc74006b080 2023-10-03T10:13:28.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.174+0000 7fc744eda700 1 -- 172.21.15.72:0/277569449 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc730011990 con 0x7fc74006b080 2023-10-03T10:13:28.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.175+0000 7fc744eda700 1 -- 172.21.15.72:0/277569449 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730011d20 con 0x7fc74006b080 2023-10-03T10:13:28.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.175+0000 7fc748140700 1 -- 172.21.15.72:0/277569449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc74006b080 msgr2=0x7fc740131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.175+0000 7fc748140700 1 --2- 172.21.15.72:0/277569449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc74006b080 0x7fc740131600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc730009840 tx=0x7fc730009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:28.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.175+0000 7fc748140700 1 -- 172.21.15.72:0/277569449 shutdown_connections 2023-10-03T10:13:28.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.175+0000 7fc748140700 1 --2- 172.21.15.72:0/277569449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc740131b40 0x7fc740131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.175+0000 7fc748140700 1 --2- 172.21.15.72:0/277569449 >> v2:172.21.15.72:3300/0 conn(0x7fc74006a770 0x7fc74006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.175+0000 7fc748140700 1 --2- 172.21.15.72:0/277569449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc74006b080 0x7fc740131600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.175+0000 7fc748140700 1 -- 172.21.15.72:0/277569449 >> 172.21.15.72:0/277569449 conn(0x7fc740066f50 msgr2=0x7fc74009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.175+0000 7fc748140700 1 -- 172.21.15.72:0/277569449 shutdown_connections 2023-10-03T10:13:28.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.175+0000 7fc748140700 1 -- 172.21.15.72:0/277569449 wait complete. 2023-10-03T10:13:28.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.177+0000 7fc748140700 1 Processor -- start 2023-10-03T10:13:28.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.177+0000 7fc748140700 1 -- start start 2023-10-03T10:13:28.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.177+0000 7fc748140700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc74006a770 0x7fc7401c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.177+0000 7fc748140700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74006b080 0x7fc7401c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.177+0000 7fc748140700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc740131b40 0x7fc74011e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.177+0000 7fc748140700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc740130ed0 con 0x7fc74006b080 2023-10-03T10:13:28.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.177+0000 7fc748140700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc740121b50 con 0x7fc740131b40 2023-10-03T10:13:28.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.177+0000 7fc748140700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7401b6c90 con 0x7fc74006a770 2023-10-03T10:13:28.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc745edc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc74006a770 0x7fc7401c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc745edc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc74006a770 0x7fc7401c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41016/0 (socket says 172.21.15.72:41016) 2023-10-03T10:13:28.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc745edc700 1 -- 172.21.15.72:0/354584424 learned_addr learned my addr 172.21.15.72:0/354584424 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:28.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc7466dd700 1 --2- 172.21.15.72:0/354584424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc740131b40 0x7fc74011e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc7456db700 1 --2- 172.21.15.72:0/354584424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74006b080 0x7fc7401c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc7466dd700 1 -- 172.21.15.72:0/354584424 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc74006a770 msgr2=0x7fc7401c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc7466dd700 1 --2- 172.21.15.72:0/354584424 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc74006a770 0x7fc7401c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc7466dd700 1 -- 172.21.15.72:0/354584424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74006b080 msgr2=0x7fc7401c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc7466dd700 1 --2- 172.21.15.72:0/354584424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74006b080 0x7fc7401c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc7466dd700 1 -- 172.21.15.72:0/354584424 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73800f050 con 0x7fc740131b40 2023-10-03T10:13:28.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc7456db700 1 --2- 172.21.15.72:0/354584424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74006b080 0x7fc7401c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:28.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc7466dd700 1 --2- 172.21.15.72:0/354584424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc740131b40 0x7fc74011e540 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc73800d7e0 tx=0x7fc73800d810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc7367fc700 1 -- 172.21.15.72:0/354584424 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc738012050 con 0x7fc740131b40 2023-10-03T10:13:28.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc7367fc700 1 -- 172.21.15.72:0/354584424 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc738013040 con 0x7fc740131b40 2023-10-03T10:13:28.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc748140700 1 -- 172.21.15.72:0/354584424 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7300094a0 con 0x7fc740131b40 2023-10-03T10:13:28.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.178+0000 7fc7367fc700 1 -- 172.21.15.72:0/354584424 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc738019610 con 0x7fc740131b40 2023-10-03T10:13:28.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.179+0000 7fc748140700 1 -- 172.21.15.72:0/354584424 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc740120150 con 0x7fc740131b40 2023-10-03T10:13:28.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.179+0000 7fc7367fc700 1 -- 172.21.15.72:0/354584424 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc738019770 con 0x7fc740131b40 2023-10-03T10:13:28.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.180+0000 7fc7367fc700 1 -- 172.21.15.72:0/354584424 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc738044330 con 0x7fc740131b40 2023-10-03T10:13:28.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.180+0000 7fc748140700 1 -- 172.21.15.72:0/354584424 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc740120700 con 0x7fc740131b40 2023-10-03T10:13:28.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.189+0000 7fc7367fc700 1 -- 172.21.15.72:0/354584424 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc738023460 con 0x7fc740131b40 2023-10-03T10:13:28.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.220+0000 7fd4dfa3f700 1 Processor -- start 2023-10-03T10:13:28.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.220+0000 7fd4dfa3f700 1 -- start start 2023-10-03T10:13:28.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.221+0000 7fd4dfa3f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4d81338a0 0x7fd4d8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.221+0000 7fd4dfa3f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4d809de50 0x7fd4d809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.221+0000 7fd4dfa3f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4d809e760 0x7fd4d813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.221+0000 7fd4dfa3f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d806fef0 con 0x7fd4d809de50 2023-10-03T10:13:28.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.221+0000 7fd4dfa3f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d806ef30 con 0x7fd4d81338a0 2023-10-03T10:13:28.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.221+0000 7fd4dfa3f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d81334b0 con 0x7fd4d809e760 2023-10-03T10:13:28.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.221+0000 7fd4dcfda700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4d809de50 0x7fd4d809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.221+0000 7fd4dd7db700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4d81338a0 0x7fd4d8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.221+0000 7fd4dcfda700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4d809de50 0x7fd4d809e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44002/0 (socket says 172.21.15.72:44002) 2023-10-03T10:13:28.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.221+0000 7fd4dd7db700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4d81338a0 0x7fd4d8133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38952/0 (socket says 172.21.15.72:38952) 2023-10-03T10:13:28.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.221+0000 7fd4dcfda700 1 -- 172.21.15.72:0/605766932 learned_addr learned my addr 172.21.15.72:0/605766932 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:28.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.221+0000 7fd4ddfdc700 1 --2- 172.21.15.72:0/605766932 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4d809e760 0x7fd4d813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.222+0000 7fd4dd7db700 1 -- 172.21.15.72:0/605766932 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4d809e760 msgr2=0x7fd4d813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.222+0000 7fd4dd7db700 1 --2- 172.21.15.72:0/605766932 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4d809e760 0x7fd4d813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.222+0000 7fd4dd7db700 1 -- 172.21.15.72:0/605766932 >> v2:172.21.15.72:3300/0 conn(0x7fd4d809de50 msgr2=0x7fd4d809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.222+0000 7fd4dd7db700 1 --2- 172.21.15.72:0/605766932 >> v2:172.21.15.72:3300/0 conn(0x7fd4d809de50 0x7fd4d809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.222+0000 7fd4dd7db700 1 -- 172.21.15.72:0/605766932 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d806fc30 con 0x7fd4d81338a0 2023-10-03T10:13:28.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.222+0000 7fd4dcfda700 1 --2- 172.21.15.72:0/605766932 >> v2:172.21.15.72:3300/0 conn(0x7fd4d809de50 0x7fd4d809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.222+0000 7fd4dd7db700 1 --2- 172.21.15.72:0/605766932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4d81338a0 0x7fd4d8133c70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009840 tx=0x7fd4d4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f15fecf55bffe931 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.222+0000 7fd4cffff700 1 -- 172.21.15.72:0/605766932 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4011830 con 0x7fd4d81338a0 2023-10-03T10:13:28.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.222+0000 7fd4cffff700 1 -- 172.21.15.72:0/605766932 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d4011990 con 0x7fd4d81338a0 2023-10-03T10:13:28.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.222+0000 7fd4cffff700 1 -- 172.21.15.72:0/605766932 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4011d20 con 0x7fd4d81338a0 2023-10-03T10:13:28.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.223+0000 7fd4dfa3f700 1 -- 172.21.15.72:0/605766932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4d81338a0 msgr2=0x7fd4d8133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.223+0000 7fd4dfa3f700 1 --2- 172.21.15.72:0/605766932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4d81338a0 0x7fd4d8133c70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009840 tx=0x7fd4d4009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:28.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.223+0000 7fd4dfa3f700 1 -- 172.21.15.72:0/605766932 shutdown_connections 2023-10-03T10:13:28.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.223+0000 7fd4dfa3f700 1 --2- 172.21.15.72:0/605766932 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4d809e760 0x7fd4d813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.223+0000 7fd4dfa3f700 1 --2- 172.21.15.72:0/605766932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4d81338a0 0x7fd4d8133c70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.223+0000 7fd4dfa3f700 1 --2- 172.21.15.72:0/605766932 >> v2:172.21.15.72:3300/0 conn(0x7fd4d809de50 0x7fd4d809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.223+0000 7fd4dfa3f700 1 -- 172.21.15.72:0/605766932 >> 172.21.15.72:0/605766932 conn(0x7fd4d80a2aa0 msgr2=0x7fd4d80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.223+0000 7fd4dfa3f700 1 -- 172.21.15.72:0/605766932 shutdown_connections 2023-10-03T10:13:28.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.224+0000 7fd4dfa3f700 1 -- 172.21.15.72:0/605766932 wait complete. 2023-10-03T10:13:28.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.225+0000 7fd4dfa3f700 1 Processor -- start 2023-10-03T10:13:28.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.225+0000 7fd4dfa3f700 1 -- start start 2023-10-03T10:13:28.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dfa3f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d809de50 0x7fd4d811a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dfa3f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4d809e760 0x7fd4d811ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dfa3f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4d81338a0 0x7fd4d811b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dfa3f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d811ba20 con 0x7fd4d809de50 2023-10-03T10:13:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dfa3f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d811d400 con 0x7fd4d81338a0 2023-10-03T10:13:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dfa3f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d811c250 con 0x7fd4d809e760 2023-10-03T10:13:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dd7db700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d809de50 0x7fd4d811a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dd7db700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d809de50 0x7fd4d811a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44008/0 (socket says 172.21.15.72:44008) 2023-10-03T10:13:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dd7db700 1 -- 172.21.15.72:0/13073021 learned_addr learned my addr 172.21.15.72:0/13073021 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4ddfdc700 1 --2- 172.21.15.72:0/13073021 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4d81338a0 0x7fd4d811b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dcfda700 1 --2- 172.21.15.72:0/13073021 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4d809e760 0x7fd4d811ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dd7db700 1 -- 172.21.15.72:0/13073021 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4d809e760 msgr2=0x7fd4d811ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dd7db700 1 --2- 172.21.15.72:0/13073021 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4d809e760 0x7fd4d811ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dd7db700 1 -- 172.21.15.72:0/13073021 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4d81338a0 msgr2=0x7fd4d811b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dd7db700 1 --2- 172.21.15.72:0/13073021 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4d81338a0 0x7fd4d811b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dd7db700 1 -- 172.21.15.72:0/13073021 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c8009550 con 0x7fd4d809de50 2023-10-03T10:13:28.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4dd7db700 1 --2- 172.21.15.72:0/13073021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d809de50 0x7fd4d811a5e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009b90 tx=0x7fd4d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.226+0000 7fd4cdffb700 1 -- 172.21.15.72:0/13073021 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4004590 con 0x7fd4d809de50 2023-10-03T10:13:28.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.227+0000 7fd4cdffb700 1 -- 172.21.15.72:0/13073021 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d40036a0 con 0x7fd4d809de50 2023-10-03T10:13:28.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.227+0000 7fd4dfa3f700 1 -- 172.21.15.72:0/13073021 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d40094a0 con 0x7fd4d809de50 2023-10-03T10:13:28.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.227+0000 7fd4cdffb700 1 -- 172.21.15.72:0/13073021 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4003a30 con 0x7fd4d809de50 2023-10-03T10:13:28.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.227+0000 7fd4dfa3f700 1 -- 172.21.15.72:0/13073021 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d806f640 con 0x7fd4d809de50 2023-10-03T10:13:28.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.228+0000 7fd4cdffb700 1 -- 172.21.15.72:0/13073021 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd4d4003b90 con 0x7fd4d809de50 2023-10-03T10:13:28.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.228+0000 7fd4cdffb700 1 -- 172.21.15.72:0/13073021 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd4d4040ac0 con 0x7fd4d809de50 2023-10-03T10:13:28.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.228+0000 7fd4dfa3f700 1 -- 172.21.15.72:0/13073021 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d8074ea0 con 0x7fd4d809de50 2023-10-03T10:13:28.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.236+0000 7fd4cdffb700 1 -- 172.21.15.72:0/13073021 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4d4015080 con 0x7fd4d809de50 2023-10-03T10:13:28.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.253+0000 7f30caa82700 1 Processor -- start 2023-10-03T10:13:28.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.253+0000 7f30caa82700 1 -- start start 2023-10-03T10:13:28.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.253+0000 7f30caa82700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30c4133420 0x7f30c41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.253+0000 7f30caa82700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f30c4133e30 0x7f30c412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.253+0000 7f30caa82700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30c4134260 0x7f30c41304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.253+0000 7f30caa82700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c406b990 con 0x7f30c4133e30 2023-10-03T10:13:28.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.253+0000 7f30caa82700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40a0590 con 0x7f30c4133420 2023-10-03T10:13:28.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.253+0000 7f30caa82700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30c409fb80 con 0x7f30c4134260 2023-10-03T10:13:28.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.253+0000 7f30c881e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30c4133420 0x7f30c41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.253+0000 7f30c3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f30c4133e30 0x7f30c412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.253+0000 7f30c881e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30c4133420 0x7f30c41337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50418/0 (socket says 172.21.15.72:50418) 2023-10-03T10:13:28.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.253+0000 7f30c3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f30c4133e30 0x7f30c412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51468/0 (socket says 172.21.15.72:51468) 2023-10-03T10:13:28.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.253+0000 7f30c881e700 1 -- 172.21.15.72:0/99061395 learned_addr learned my addr 172.21.15.72:0/99061395 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:28.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.253+0000 7f30c901f700 1 --2- 172.21.15.72:0/99061395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30c4134260 0x7f30c41304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.254+0000 7f30c881e700 1 -- 172.21.15.72:0/99061395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30c4134260 msgr2=0x7f30c41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.254+0000 7f30c881e700 1 --2- 172.21.15.72:0/99061395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30c4134260 0x7f30c41304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.254+0000 7f30c881e700 1 -- 172.21.15.72:0/99061395 >> v2:172.21.15.72:3300/0 conn(0x7f30c4133e30 msgr2=0x7f30c412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.254+0000 7f30c881e700 1 --2- 172.21.15.72:0/99061395 >> v2:172.21.15.72:3300/0 conn(0x7f30c4133e30 0x7f30c412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.254+0000 7f30c881e700 1 -- 172.21.15.72:0/99061395 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c40a0030 con 0x7f30c4133420 2023-10-03T10:13:28.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.254+0000 7f30c3fff700 1 --2- 172.21.15.72:0/99061395 >> v2:172.21.15.72:3300/0 conn(0x7f30c4133e30 0x7f30c412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:28.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.254+0000 7f30c881e700 1 --2- 172.21.15.72:0/99061395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30c4133420 0x7f30c41337f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f30b80098f0 tx=0x7f30b8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17a0baf1141fb68d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.254+0000 7f30c37fe700 1 -- 172.21.15.72:0/99061395 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8011830 con 0x7f30c4133420 2023-10-03T10:13:28.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.254+0000 7f30c37fe700 1 -- 172.21.15.72:0/99061395 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b8011990 con 0x7f30c4133420 2023-10-03T10:13:28.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.254+0000 7f30c37fe700 1 -- 172.21.15.72:0/99061395 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8011d20 con 0x7f30c4133420 2023-10-03T10:13:28.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.255+0000 7f30caa82700 1 -- 172.21.15.72:0/99061395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30c4133420 msgr2=0x7f30c41337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.255+0000 7f30caa82700 1 --2- 172.21.15.72:0/99061395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30c4133420 0x7f30c41337f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f30b80098f0 tx=0x7f30b8009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:28.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.255+0000 7f30caa82700 1 -- 172.21.15.72:0/99061395 shutdown_connections 2023-10-03T10:13:28.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.255+0000 7f30caa82700 1 --2- 172.21.15.72:0/99061395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30c4134260 0x7f30c41304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.255+0000 7f30caa82700 1 --2- 172.21.15.72:0/99061395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30c4133420 0x7f30c41337f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.255+0000 7f30caa82700 1 --2- 172.21.15.72:0/99061395 >> v2:172.21.15.72:3300/0 conn(0x7f30c4133e30 0x7f30c412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.255+0000 7f30caa82700 1 -- 172.21.15.72:0/99061395 >> 172.21.15.72:0/99061395 conn(0x7f30c40a4210 msgr2=0x7f30c40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.255+0000 7f30caa82700 1 -- 172.21.15.72:0/99061395 shutdown_connections 2023-10-03T10:13:28.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.255+0000 7f30caa82700 1 -- 172.21.15.72:0/99061395 wait complete. 2023-10-03T10:13:28.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.256+0000 7f30caa82700 1 Processor -- start 2023-10-03T10:13:28.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.256+0000 7f30caa82700 1 -- start start 2023-10-03T10:13:28.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.256+0000 7f30caa82700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30c4133420 0x7f30c409c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.256+0000 7f30caa82700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30c4133e30 0x7f30c409c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.256+0000 7f30caa82700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c4134260 0x7f30c409cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.256+0000 7f30caa82700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c409df50 con 0x7f30c4134260 2023-10-03T10:13:28.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.256+0000 7f30caa82700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c411f130 con 0x7f30c4133e30 2023-10-03T10:13:28.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.256+0000 7f30caa82700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30c411f4f0 con 0x7f30c4133420 2023-10-03T10:13:28.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30c901f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c4134260 0x7f30c409cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30c901f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c4134260 0x7f30c409cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51474/0 (socket says 172.21.15.72:51474) 2023-10-03T10:13:28.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30c901f700 1 -- 172.21.15.72:0/1184857470 learned_addr learned my addr 172.21.15.72:0/1184857470 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:28.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30c881e700 1 --2- 172.21.15.72:0/1184857470 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30c4133420 0x7f30c409c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30c3fff700 1 --2- 172.21.15.72:0/1184857470 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30c4133e30 0x7f30c409c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30c881e700 1 -- 172.21.15.72:0/1184857470 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30c4133e30 msgr2=0x7f30c409c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30c881e700 1 --2- 172.21.15.72:0/1184857470 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30c4133e30 0x7f30c409c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30c881e700 1 -- 172.21.15.72:0/1184857470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c4134260 msgr2=0x7f30c409cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30c881e700 1 --2- 172.21.15.72:0/1184857470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c4134260 0x7f30c409cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30c881e700 1 -- 172.21.15.72:0/1184857470 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b00094a0 con 0x7f30c4133420 2023-10-03T10:13:28.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30c881e700 1 --2- 172.21.15.72:0/1184857470 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30c4133420 0x7f30c409c2c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f30b8016000 tx=0x7f30b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30c17fa700 1 -- 172.21.15.72:0/1184857470 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8004450 con 0x7f30c4133420 2023-10-03T10:13:28.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30c17fa700 1 -- 172.21.15.72:0/1184857470 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b801f070 con 0x7f30c4133420 2023-10-03T10:13:28.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30caa82700 1 -- 172.21.15.72:0/1184857470 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b8009550 con 0x7f30c4133420 2023-10-03T10:13:28.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30c17fa700 1 -- 172.21.15.72:0/1184857470 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b80038e0 con 0x7f30c4133420 2023-10-03T10:13:28.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.257+0000 7f30caa82700 1 -- 172.21.15.72:0/1184857470 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c411fc60 con 0x7f30c4133420 2023-10-03T10:13:28.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.259+0000 7f30caa82700 1 -- 172.21.15.72:0/1184857470 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c4074ea0 con 0x7f30c4133420 2023-10-03T10:13:28.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.259+0000 7f30c17fa700 1 -- 172.21.15.72:0/1184857470 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30b8003a40 con 0x7f30c4133420 2023-10-03T10:13:28.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.259+0000 7f30c17fa700 1 -- 172.21.15.72:0/1184857470 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f30b8021070 con 0x7f30c4133420 2023-10-03T10:13:28.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.267+0000 7f30c17fa700 1 -- 172.21.15.72:0/1184857470 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30b8045060 con 0x7f30c4133420 2023-10-03T10:13:28.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.270+0000 7f34a72ca700 1 Processor -- start 2023-10-03T10:13:28.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.270+0000 7f34a72ca700 1 -- start start 2023-10-03T10:13:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.270+0000 7f34a72ca700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34a0131810 0x7f34a0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.270+0000 7f34a72ca700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a0099a40 0x7f34a0099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.270+0000 7f34a72ca700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a01313c0 con 0x7f34a009a3b0 2023-10-03T10:13:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.270+0000 7f34a72ca700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a009b580 con 0x7f34a0131810 2023-10-03T10:13:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.270+0000 7f34a72ca700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34a006e8c0 con 0x7f34a0099a40 2023-10-03T10:13:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.271+0000 7f34a4865700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a0099a40 0x7f34a0099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.271+0000 7f34a5867700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f34a009a3b0 0x7f34a0138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43426/0 (socket says 172.21.15.72:43426) 2023-10-03T10:13:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.271+0000 7f34a5867700 1 -- 172.21.15.72:0/3307805544 learned_addr learned my addr 172.21.15.72:0/3307805544 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.271+0000 7f34a4865700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a0099a40 0x7f34a0099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41378/0 (socket says 172.21.15.72:41378) 2023-10-03T10:13:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.271+0000 7f34a5066700 1 --2- 172.21.15.72:0/3307805544 >> v2:172.21.15.72:3300/0 conn(0x7f34a0131810 0x7f34a0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.271+0000 7f34a4865700 1 -- 172.21.15.72:0/3307805544 >> v2:172.21.15.72:3300/0 conn(0x7f34a0131810 msgr2=0x7f34a0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.271+0000 7f34a4865700 1 --2- 172.21.15.72:0/3307805544 >> v2:172.21.15.72:3300/0 conn(0x7f34a0131810 0x7f34a0131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.271+0000 7f34a4865700 1 -- 172.21.15.72:0/3307805544 >> v1:172.21.15.72:6789/0 conn(0x7f34a009a3b0 legacy=0x7f34a0138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.271+0000 7f34a4865700 1 -- 172.21.15.72:0/3307805544 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a009a830 con 0x7f34a0099a40 2023-10-03T10:13:28.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.271+0000 7f34a4865700 1 --2- 172.21.15.72:0/3307805544 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a0099a40 0x7f34a0099e70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3490009870 tx=0x7f3490009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ed0acb470b41400 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.271+0000 7f3497fff700 1 -- 172.21.15.72:0/3307805544 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490011830 con 0x7f34a0099a40 2023-10-03T10:13:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.271+0000 7f3497fff700 1 -- 172.21.15.72:0/3307805544 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3490011990 con 0x7f34a0099a40 2023-10-03T10:13:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.271+0000 7f3497fff700 1 -- 172.21.15.72:0/3307805544 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490011d20 con 0x7f34a0099a40 2023-10-03T10:13:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.272+0000 7f34a72ca700 1 -- 172.21.15.72:0/3307805544 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a0099a40 msgr2=0x7f34a0099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.272+0000 7f34a72ca700 1 --2- 172.21.15.72:0/3307805544 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a0099a40 0x7f34a0099e70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3490009870 tx=0x7f3490009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.272+0000 7f34a72ca700 1 -- 172.21.15.72:0/3307805544 shutdown_connections 2023-10-03T10:13:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.272+0000 7f34a72ca700 1 --2- 172.21.15.72:0/3307805544 >> v2:172.21.15.72:3300/0 conn(0x7f34a0131810 0x7f34a0131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.272+0000 7f34a72ca700 1 --2- 172.21.15.72:0/3307805544 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a0099a40 0x7f34a0099e70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.272+0000 7f34a72ca700 1 -- 172.21.15.72:0/3307805544 >> 172.21.15.72:0/3307805544 conn(0x7f34a00a2aa0 msgr2=0x7f34a00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.272+0000 7f34a72ca700 1 -- 172.21.15.72:0/3307805544 shutdown_connections 2023-10-03T10:13:28.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.272+0000 7f34a72ca700 1 -- 172.21.15.72:0/3307805544 wait complete. 2023-10-03T10:13:28.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.274+0000 7f34a72ca700 1 Processor -- start 2023-10-03T10:13:28.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.274+0000 7f34a72ca700 1 -- start start 2023-10-03T10:13:28.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.274+0000 7f34a72ca700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a0099a40 0x7f34a011f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.274+0000 7f34a72ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a009a3b0 0x7f34a011f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.274+0000 7f34a72ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a0131810 0x7f34a011faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.274+0000 7f34a72ca700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a006eb00 con 0x7f34a009a3b0 2023-10-03T10:13:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.274+0000 7f34a72ca700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0122860 con 0x7f34a0131810 2023-10-03T10:13:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.274+0000 7f34a72ca700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0120d40 con 0x7f34a0099a40 2023-10-03T10:13:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.274+0000 7f34a4865700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a009a3b0 0x7f34a011f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.274+0000 7f34a4865700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a009a3b0 0x7f34a011f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51484/0 (socket says 172.21.15.72:51484) 2023-10-03T10:13:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.274+0000 7f34a4865700 1 -- 172.21.15.72:0/1691775985 learned_addr learned my addr 172.21.15.72:0/1691775985 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.275+0000 7f34a5066700 1 --2- 172.21.15.72:0/1691775985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a0099a40 0x7f34a011f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.275+0000 7f34a5867700 1 --2- 172.21.15.72:0/1691775985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a0131810 0x7f34a011faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.275+0000 7f34a4865700 1 -- 172.21.15.72:0/1691775985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a0099a40 msgr2=0x7f34a011f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.275+0000 7f34a4865700 1 --2- 172.21.15.72:0/1691775985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a0099a40 0x7f34a011f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.275+0000 7f34a4865700 1 -- 172.21.15.72:0/1691775985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a0131810 msgr2=0x7f34a011faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.275+0000 7f34a4865700 1 --2- 172.21.15.72:0/1691775985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a0131810 0x7f34a011faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.275+0000 7f34a4865700 1 -- 172.21.15.72:0/1691775985 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34900094a0 con 0x7f34a009a3b0 2023-10-03T10:13:28.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.275+0000 7f34a5867700 1 --2- 172.21.15.72:0/1691775985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a0131810 0x7f34a011faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:28.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.275+0000 7f34a4865700 1 --2- 172.21.15.72:0/1691775985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a009a3b0 0x7f34a011f560 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3490000c00 tx=0x7f3490004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.276+0000 7f3495ffb700 1 -- 172.21.15.72:0/1691775985 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900036a0 con 0x7f34a009a3b0 2023-10-03T10:13:28.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.276+0000 7f3495ffb700 1 -- 172.21.15.72:0/1691775985 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349001f070 con 0x7f34a009a3b0 2023-10-03T10:13:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.276+0000 7f3495ffb700 1 -- 172.21.15.72:0/1691775985 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490003a20 con 0x7f34a009a3b0 2023-10-03T10:13:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.277+0000 7f34a72ca700 1 -- 172.21.15.72:0/1691775985 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a0071dd0 con 0x7f34a009a3b0 2023-10-03T10:13:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.277+0000 7f34a72ca700 1 -- 172.21.15.72:0/1691775985 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a00a1c80 con 0x7f34a009a3b0 2023-10-03T10:13:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.278+0000 7f34a72ca700 1 -- 172.21.15.72:0/1691775985 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a0074ea0 con 0x7f34a009a3b0 2023-10-03T10:13:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.279+0000 7f3495ffb700 1 -- 172.21.15.72:0/1691775985 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3490003b80 con 0x7f34a009a3b0 2023-10-03T10:13:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.279+0000 7f3495ffb700 1 -- 172.21.15.72:0/1691775985 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3490021070 con 0x7f34a009a3b0 2023-10-03T10:13:28.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.288+0000 7f3495ffb700 1 -- 172.21.15.72:0/1691775985 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34900253e0 con 0x7f34a009a3b0 2023-10-03T10:13:28.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.400+0000 7fc748140700 1 -- 172.21.15.72:0/354584424 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc740074ea0 con 0x7fc740131b40 2023-10-03T10:13:28.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.400+0000 7fc7367fc700 1 -- 172.21.15.72:0/354584424 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc738021b50 con 0x7fc740131b40 2023-10-03T10:13:28.401 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:28.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.402+0000 7fc748140700 1 -- 172.21.15.72:0/354584424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc740131b40 msgr2=0x7fc74011e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.402+0000 7fc748140700 1 --2- 172.21.15.72:0/354584424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc740131b40 0x7fc74011e540 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc73800d7e0 tx=0x7fc73800d810 comp rx=0 tx=0).stop 2023-10-03T10:13:28.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.402+0000 7fc748140700 1 -- 172.21.15.72:0/354584424 shutdown_connections 2023-10-03T10:13:28.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.402+0000 7fc748140700 1 --2- 172.21.15.72:0/354584424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc740131b40 0x7fc74011e540 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.402+0000 7fc748140700 1 --2- 172.21.15.72:0/354584424 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc74006a770 0x7fc7401c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.402+0000 7fc748140700 1 --2- 172.21.15.72:0/354584424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc74006b080 0x7fc7401c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.402+0000 7fc748140700 1 -- 172.21.15.72:0/354584424 >> 172.21.15.72:0/354584424 conn(0x7fc740066f50 msgr2=0x7fc7400a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.403+0000 7fc748140700 1 -- 172.21.15.72:0/354584424 shutdown_connections 2023-10-03T10:13:28.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.403+0000 7fc748140700 1 -- 172.21.15.72:0/354584424 wait complete. 2023-10-03T10:13:28.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:28.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.443+0000 7fd4dfa3f700 1 -- 172.21.15.72:0/13073021 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd4d806b9e0 con 0x7fd4d809de50 2023-10-03T10:13:28.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.443+0000 7fd4cdffb700 1 -- 172.21.15.72:0/13073021 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd4d402e970 con 0x7fd4d809de50 2023-10-03T10:13:28.444 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:28.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.445+0000 7fd4dfa3f700 1 -- 172.21.15.72:0/13073021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d809de50 msgr2=0x7fd4d811a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.445+0000 7fd4dfa3f700 1 --2- 172.21.15.72:0/13073021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d809de50 0x7fd4d811a5e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009b90 tx=0x7fd4d4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:28.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.445+0000 7fd4dfa3f700 1 -- 172.21.15.72:0/13073021 shutdown_connections 2023-10-03T10:13:28.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.445+0000 7fd4dfa3f700 1 --2- 172.21.15.72:0/13073021 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4d809de50 0x7fd4d811a5e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.445+0000 7fd4dfa3f700 1 --2- 172.21.15.72:0/13073021 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4d81338a0 0x7fd4d811b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.445+0000 7fd4dfa3f700 1 --2- 172.21.15.72:0/13073021 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4d809e760 0x7fd4d811ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.445+0000 7fd4dfa3f700 1 -- 172.21.15.72:0/13073021 >> 172.21.15.72:0/13073021 conn(0x7fd4d80a2aa0 msgr2=0x7fd4d81b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.445+0000 7fd4dfa3f700 1 -- 172.21.15.72:0/13073021 shutdown_connections 2023-10-03T10:13:28.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.445+0000 7fd4dfa3f700 1 -- 172.21.15.72:0/13073021 wait complete. 2023-10-03T10:13:28.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:28.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.464+0000 7f30caa82700 1 -- 172.21.15.72:0/1184857470 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f30c406b250 con 0x7f30c4133420 2023-10-03T10:13:28.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.465+0000 7f30c17fa700 1 -- 172.21.15.72:0/1184857470 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f30b8015070 con 0x7f30c4133420 2023-10-03T10:13:28.465 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.467+0000 7f30caa82700 1 -- 172.21.15.72:0/1184857470 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30c4133420 msgr2=0x7f30c409c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.467+0000 7f30caa82700 1 --2- 172.21.15.72:0/1184857470 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30c4133420 0x7f30c409c2c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f30b8016000 tx=0x7f30b8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.467+0000 7f30caa82700 1 -- 172.21.15.72:0/1184857470 shutdown_connections 2023-10-03T10:13:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.467+0000 7f30caa82700 1 --2- 172.21.15.72:0/1184857470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30c4134260 0x7f30c409cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.467+0000 7f30caa82700 1 --2- 172.21.15.72:0/1184857470 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30c4133420 0x7f30c409c2c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.467+0000 7f30caa82700 1 --2- 172.21.15.72:0/1184857470 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f30c4133e30 0x7f30c409c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.467+0000 7f30caa82700 1 -- 172.21.15.72:0/1184857470 >> 172.21.15.72:0/1184857470 conn(0x7f30c40a4210 msgr2=0x7f30c40a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.467+0000 7f30caa82700 1 -- 172.21.15.72:0/1184857470 shutdown_connections 2023-10-03T10:13:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.467+0000 7f30caa82700 1 -- 172.21.15.72:0/1184857470 wait complete. 2023-10-03T10:13:28.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:28.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.485+0000 7f34a72ca700 1 -- 172.21.15.72:0/1691775985 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f34a01229a0 con 0x7f34a009a3b0 2023-10-03T10:13:28.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.485+0000 7f3495ffb700 1 -- 172.21.15.72:0/1691775985 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f34a01229a0 con 0x7f34a009a3b0 2023-10-03T10:13:28.486 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:28.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.487+0000 7f34a72ca700 1 -- 172.21.15.72:0/1691775985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a009a3b0 msgr2=0x7f34a011f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.488+0000 7f34a72ca700 1 --2- 172.21.15.72:0/1691775985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a009a3b0 0x7f34a011f560 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3490000c00 tx=0x7f3490004750 comp rx=0 tx=0).stop 2023-10-03T10:13:28.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.488+0000 7f34a72ca700 1 -- 172.21.15.72:0/1691775985 shutdown_connections 2023-10-03T10:13:28.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.488+0000 7f34a72ca700 1 --2- 172.21.15.72:0/1691775985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a0131810 0x7f34a011faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.488+0000 7f34a72ca700 1 --2- 172.21.15.72:0/1691775985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a0099a40 0x7f34a011f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.488+0000 7f34a72ca700 1 --2- 172.21.15.72:0/1691775985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a009a3b0 0x7f34a011f560 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.488+0000 7f34a72ca700 1 -- 172.21.15.72:0/1691775985 >> 172.21.15.72:0/1691775985 conn(0x7f34a00a2aa0 msgr2=0x7f34a00a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.488+0000 7f34a72ca700 1 -- 172.21.15.72:0/1691775985 shutdown_connections 2023-10-03T10:13:28.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:28.488+0000 7f34a72ca700 1 -- 172.21.15.72:0/1691775985 wait complete. 2023-10-03T10:13:28.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:29.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:29.459 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:29.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:29.501 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:29.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.561+0000 7fee74dc7700 1 Processor -- start 2023-10-03T10:13:29.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.561+0000 7fee74dc7700 1 -- start start 2023-10-03T10:13:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.562+0000 7fee74dc7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee7012c9a0 0x7fee7012cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.562+0000 7fee74dc7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee70130380 0x7fee70137c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.562+0000 7fee74dc7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7009a420 con 0x7fee7012f880 2023-10-03T10:13:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.562+0000 7fee74dc7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7009b890 con 0x7fee70130380 2023-10-03T10:13:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.562+0000 7fee74dc7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee7009b2f0 con 0x7fee7012c9a0 2023-10-03T10:13:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.562+0000 7fee6dd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fee7012f880 0x7fee7012fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43430/0 (socket says 172.21.15.72:43430) 2023-10-03T10:13:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.562+0000 7fee6dd9b700 1 -- 172.21.15.72:0/3412446994 learned_addr learned my addr 172.21.15.72:0/3412446994 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.562+0000 7fee6ed9d700 1 --2- 172.21.15.72:0/3412446994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee70130380 0x7fee70137c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.563+0000 7fee6d59a700 1 -- 172.21.15.72:0/3412446994 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816391596 0 0) 0x7fee7009a420 con 0x7fee7012f880 2023-10-03T10:13:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.563+0000 7fee6d59a700 1 -- 172.21.15.72:0/3412446994 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee580035b0 con 0x7fee7012f880 2023-10-03T10:13:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.563+0000 7fee6ed9d700 1 -- 172.21.15.72:0/3412446994 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee7012c9a0 msgr2=0x7fee7012cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.563+0000 7fee6ed9d700 1 --2- 172.21.15.72:0/3412446994 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee7012c9a0 0x7fee7012cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.563+0000 7fee6ed9d700 1 -- 172.21.15.72:0/3412446994 >> v1:172.21.15.72:6789/0 conn(0x7fee7012f880 legacy=0x7fee7012fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.563+0000 7fee6ed9d700 1 -- 172.21.15.72:0/3412446994 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7009a870 con 0x7fee70130380 2023-10-03T10:13:29.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.563+0000 7fee6ed9d700 1 --2- 172.21.15.72:0/3412446994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee70130380 0x7fee70137c20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fee6800bd50 tx=0x7fee68010730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff804640ff0b6a01 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.563+0000 7fee6d59a700 1 -- 172.21.15.72:0/3412446994 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68010d10 con 0x7fee70130380 2023-10-03T10:13:29.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.563+0000 7fee6d59a700 1 -- 172.21.15.72:0/3412446994 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee68010e70 con 0x7fee70130380 2023-10-03T10:13:29.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.563+0000 7fee6d59a700 1 -- 172.21.15.72:0/3412446994 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68018620 con 0x7fee70130380 2023-10-03T10:13:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.564+0000 7fee74dc7700 1 -- 172.21.15.72:0/3412446994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee70130380 msgr2=0x7fee70137c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.564+0000 7fee74dc7700 1 --2- 172.21.15.72:0/3412446994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee70130380 0x7fee70137c20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fee6800bd50 tx=0x7fee68010730 comp rx=0 tx=0).stop 2023-10-03T10:13:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.564+0000 7fee74dc7700 1 -- 172.21.15.72:0/3412446994 shutdown_connections 2023-10-03T10:13:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.564+0000 7fee74dc7700 1 --2- 172.21.15.72:0/3412446994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee70130380 0x7fee70137c20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.564+0000 7fee74dc7700 1 --2- 172.21.15.72:0/3412446994 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee7012c9a0 0x7fee7012cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.564+0000 7fee74dc7700 1 -- 172.21.15.72:0/3412446994 >> 172.21.15.72:0/3412446994 conn(0x7fee700a2360 msgr2=0x7fee700a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.564+0000 7fee74dc7700 1 -- 172.21.15.72:0/3412446994 shutdown_connections 2023-10-03T10:13:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.564+0000 7fee74dc7700 1 -- 172.21.15.72:0/3412446994 wait complete. 2023-10-03T10:13:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.566+0000 7fee74dc7700 1 Processor -- start 2023-10-03T10:13:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.566+0000 7fee74dc7700 1 -- start start 2023-10-03T10:13:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.566+0000 7fee74dc7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee7012c9a0 0x7fee7012a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.566+0000 7fee74dc7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee7012f880 0x7fee7012a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.566+0000 7fee74dc7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee70130380 0x7fee7012ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.566+0000 7fee74dc7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7006f430 con 0x7fee7012c9a0 2023-10-03T10:13:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.566+0000 7fee74dc7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee700702f0 con 0x7fee7012f880 2023-10-03T10:13:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.566+0000 7fee74dc7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee7009f960 con 0x7fee70130380 2023-10-03T10:13:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.567+0000 7fee6dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee7012f880 0x7fee7012a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.567+0000 7fee6dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee7012f880 0x7fee7012a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50460/0 (socket says 172.21.15.72:50460) 2023-10-03T10:13:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.567+0000 7fee6dd9b700 1 -- 172.21.15.72:0/1806486203 learned_addr learned my addr 172.21.15.72:0/1806486203 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.567+0000 7fee6e59c700 1 --2- 172.21.15.72:0/1806486203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee7012c9a0 0x7fee7012a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.567+0000 7fee6ed9d700 1 --2- 172.21.15.72:0/1806486203 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee70130380 0x7fee7012ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.567+0000 7fee6ed9d700 1 -- 172.21.15.72:0/1806486203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee7012f880 msgr2=0x7fee7012a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.567+0000 7fee6ed9d700 1 --2- 172.21.15.72:0/1806486203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee7012f880 0x7fee7012a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.567+0000 7fee6ed9d700 1 -- 172.21.15.72:0/1806486203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee7012c9a0 msgr2=0x7fee7012a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.567+0000 7fee6ed9d700 1 --2- 172.21.15.72:0/1806486203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee7012c9a0 0x7fee7012a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.567+0000 7fee6ed9d700 1 -- 172.21.15.72:0/1806486203 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6800b980 con 0x7fee70130380 2023-10-03T10:13:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.567+0000 7fee6dd9b700 1 --2- 172.21.15.72:0/1806486203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee7012f880 0x7fee7012a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.567+0000 7fee6e59c700 1 --2- 172.21.15.72:0/1806486203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee7012c9a0 0x7fee7012a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.567+0000 7fee6ed9d700 1 --2- 172.21.15.72:0/1806486203 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee70130380 0x7fee7012ae20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fee68019000 tx=0x7fee68004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.567+0000 7fee5effd700 1 -- 172.21.15.72:0/1806486203 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68010d10 con 0x7fee70130380 2023-10-03T10:13:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.567+0000 7fee5effd700 1 -- 172.21.15.72:0/1806486203 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee68003e50 con 0x7fee70130380 2023-10-03T10:13:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.568+0000 7fee74dc7700 1 -- 172.21.15.72:0/1806486203 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7009c5f0 con 0x7fee70130380 2023-10-03T10:13:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.568+0000 7fee5effd700 1 -- 172.21.15.72:0/1806486203 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6800aa50 con 0x7fee70130380 2023-10-03T10:13:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.568+0000 7fee74dc7700 1 -- 172.21.15.72:0/1806486203 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7006dd70 con 0x7fee70130380 2023-10-03T10:13:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.569+0000 7fee5effd700 1 -- 172.21.15.72:0/1806486203 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee6800abb0 con 0x7fee70130380 2023-10-03T10:13:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.569+0000 7fee5effd700 1 -- 172.21.15.72:0/1806486203 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fee68045330 con 0x7fee70130380 2023-10-03T10:13:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.569+0000 7fee74dc7700 1 -- 172.21.15.72:0/1806486203 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7006f0d0 con 0x7fee70130380 2023-10-03T10:13:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.578+0000 7fee5effd700 1 -- 172.21.15.72:0/1806486203 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee7006f0d0 con 0x7fee70130380 2023-10-03T10:13:29.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.596+0000 7f6db7dd3700 1 Processor -- start 2023-10-03T10:13:29.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.596+0000 7f6db7dd3700 1 -- start start 2023-10-03T10:13:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db7dd3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6db009e1d0 0x7f6db0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db7dd3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6db0139170 0x7f6db013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db7dd3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db009b120 con 0x7f6db009d6f0 2023-10-03T10:13:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db7dd3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db006b460 con 0x7f6db0139170 2023-10-03T10:13:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db7dd3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6db009a7e0 con 0x7f6db009e1d0 2023-10-03T10:13:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db6370700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6db0139170 0x7f6db013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db536e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6db009e1d0 0x7f6db0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db536e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6db009e1d0 0x7f6db0138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41412/0 (socket says 172.21.15.72:41412) 2023-10-03T10:13:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db6370700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6db0139170 0x7f6db013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51498/0 (socket says 172.21.15.72:51498) 2023-10-03T10:13:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db536e700 1 -- 172.21.15.72:0/2036195610 learned_addr learned my addr 172.21.15.72:0/2036195610 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db536e700 1 -- 172.21.15.72:0/2036195610 >> v2:172.21.15.72:3300/0 conn(0x7f6db0139170 msgr2=0x7f6db013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db536e700 1 --2- 172.21.15.72:0/2036195610 >> v2:172.21.15.72:3300/0 conn(0x7f6db0139170 0x7f6db013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db536e700 1 -- 172.21.15.72:0/2036195610 >> v1:172.21.15.72:6789/0 conn(0x7f6db009d6f0 legacy=0x7f6db009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db536e700 1 -- 172.21.15.72:0/2036195610 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db009a500 con 0x7f6db009e1d0 2023-10-03T10:13:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db6370700 1 --2- 172.21.15.72:0/2036195610 >> v2:172.21.15.72:3300/0 conn(0x7f6db0139170 0x7f6db013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.597+0000 7f6db536e700 1 --2- 172.21.15.72:0/2036195610 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6db009e1d0 0x7f6db0138c30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009920 tx=0x7f6da0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8052ad1b66a4e98 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.598+0000 7f6db4b6d700 1 -- 172.21.15.72:0/2036195610 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0011830 con 0x7f6db009e1d0 2023-10-03T10:13:29.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.598+0000 7f6db4b6d700 1 -- 172.21.15.72:0/2036195610 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da0011990 con 0x7f6db009e1d0 2023-10-03T10:13:29.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.598+0000 7f6db4b6d700 1 -- 172.21.15.72:0/2036195610 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0011d20 con 0x7f6db009e1d0 2023-10-03T10:13:29.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.598+0000 7f6db7dd3700 1 -- 172.21.15.72:0/2036195610 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6db009e1d0 msgr2=0x7f6db0138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.598+0000 7f6db7dd3700 1 --2- 172.21.15.72:0/2036195610 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6db009e1d0 0x7f6db0138c30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009920 tx=0x7f6da0009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:29.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.598+0000 7f6db7dd3700 1 -- 172.21.15.72:0/2036195610 shutdown_connections 2023-10-03T10:13:29.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.598+0000 7f6db7dd3700 1 --2- 172.21.15.72:0/2036195610 >> v2:172.21.15.72:3300/0 conn(0x7f6db0139170 0x7f6db013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.598+0000 7f6db7dd3700 1 --2- 172.21.15.72:0/2036195610 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6db009e1d0 0x7f6db0138c30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.598+0000 7f6db7dd3700 1 -- 172.21.15.72:0/2036195610 >> 172.21.15.72:0/2036195610 conn(0x7f6db0066f50 msgr2=0x7f6db009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.598+0000 7f6db7dd3700 1 -- 172.21.15.72:0/2036195610 shutdown_connections 2023-10-03T10:13:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.599+0000 7f6db7dd3700 1 -- 172.21.15.72:0/2036195610 wait complete. 2023-10-03T10:13:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.599+0000 7f6db7dd3700 1 Processor -- start 2023-10-03T10:13:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.599+0000 7f6db7dd3700 1 -- start start 2023-10-03T10:13:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db7dd3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6db009d6f0 0x7f6db011e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db7dd3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db009e1d0 0x7f6db011eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db7dd3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6db0139170 0x7f6db011f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db7dd3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db009c710 con 0x7f6db009e1d0 2023-10-03T10:13:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db7dd3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db0120510 con 0x7f6db009d6f0 2023-10-03T10:13:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db7dd3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6db01220a0 con 0x7f6db0139170 2023-10-03T10:13:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db536e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db009e1d0 0x7f6db011eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db5b6f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6db009d6f0 0x7f6db011e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db536e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db009e1d0 0x7f6db011eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51510/0 (socket says 172.21.15.72:51510) 2023-10-03T10:13:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db5b6f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6db009d6f0 0x7f6db011e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50464/0 (socket says 172.21.15.72:50464) 2023-10-03T10:13:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db536e700 1 -- 172.21.15.72:0/837752706 learned_addr learned my addr 172.21.15.72:0/837752706 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:29.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db6370700 1 --2- 172.21.15.72:0/837752706 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6db0139170 0x7f6db011f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db536e700 1 -- 172.21.15.72:0/837752706 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6db0139170 msgr2=0x7f6db011f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db536e700 1 --2- 172.21.15.72:0/837752706 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6db0139170 0x7f6db011f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db536e700 1 -- 172.21.15.72:0/837752706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6db009d6f0 msgr2=0x7f6db011e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db536e700 1 --2- 172.21.15.72:0/837752706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6db009d6f0 0x7f6db011e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.600+0000 7f6db536e700 1 -- 172.21.15.72:0/837752706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da8009a70 con 0x7f6db009e1d0 2023-10-03T10:13:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.601+0000 7f6db536e700 1 --2- 172.21.15.72:0/837752706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db009e1d0 0x7f6db011eda0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009870 tx=0x7f6da0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.601+0000 7f6da67fc700 1 -- 172.21.15.72:0/837752706 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0004510 con 0x7f6db009e1d0 2023-10-03T10:13:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.601+0000 7f6da67fc700 1 -- 172.21.15.72:0/837752706 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da00036a0 con 0x7f6db009e1d0 2023-10-03T10:13:29.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.601+0000 7f6db7dd3700 1 -- 172.21.15.72:0/837752706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da0009550 con 0x7f6db009e1d0 2023-10-03T10:13:29.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.601+0000 7f6da67fc700 1 -- 172.21.15.72:0/837752706 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0003a50 con 0x7f6db009e1d0 2023-10-03T10:13:29.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.601+0000 7f6db7dd3700 1 -- 172.21.15.72:0/837752706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db0134750 con 0x7f6db009e1d0 2023-10-03T10:13:29.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.602+0000 7f6db7dd3700 1 -- 172.21.15.72:0/837752706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db0122bd0 con 0x7f6db009e1d0 2023-10-03T10:13:29.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.602+0000 7f6da67fc700 1 -- 172.21.15.72:0/837752706 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6da0003bb0 con 0x7f6db009e1d0 2023-10-03T10:13:29.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.602+0000 7f6da67fc700 1 -- 172.21.15.72:0/837752706 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6da0021030 con 0x7f6db009e1d0 2023-10-03T10:13:29.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.607+0000 7f6da67fc700 1 -- 172.21.15.72:0/837752706 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6da001a430 con 0x7f6db009e1d0 2023-10-03T10:13:29.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.638+0000 7f696fa0f700 1 Processor -- start 2023-10-03T10:13:29.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.639+0000 7f696fa0f700 1 -- start start 2023-10-03T10:13:29.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.639+0000 7f696fa0f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968133420 0x7f69681337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.639+0000 7f696fa0f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6968134260 0x7f69681306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.639+0000 7f696fa0f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696806b990 con 0x7f6968133e30 2023-10-03T10:13:29.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.639+0000 7f696fa0f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69680a0590 con 0x7f6968134260 2023-10-03T10:13:29.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.639+0000 7f696fa0f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f696809fb80 con 0x7f6968133420 2023-10-03T10:13:29.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.639+0000 7f696d7ab700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968133420 0x7f69681337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.639+0000 7f696d7ab700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968133420 0x7f69681337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41422/0 (socket says 172.21.15.72:41422) 2023-10-03T10:13:29.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.639+0000 7f696d7ab700 1 -- 172.21.15.72:0/4265721783 learned_addr learned my addr 172.21.15.72:0/4265721783 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:29.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.639+0000 7f696dfac700 1 --2- 172.21.15.72:0/4265721783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6968134260 0x7f69681306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.640+0000 7f696d7ab700 1 -- 172.21.15.72:0/4265721783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6968134260 msgr2=0x7f69681306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.640+0000 7f696d7ab700 1 --2- 172.21.15.72:0/4265721783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6968134260 0x7f69681306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.640+0000 7f696d7ab700 1 -- 172.21.15.72:0/4265721783 >> v1:172.21.15.72:6789/0 conn(0x7f6968133e30 legacy=0x7f696812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.640+0000 7f695ffff700 1 -- 172.21.15.72:0/4265721783 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759889528 0 0) 0x7f696806b990 con 0x7f6968133e30 2023-10-03T10:13:29.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.640+0000 7f696d7ab700 1 -- 172.21.15.72:0/4265721783 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69680a0030 con 0x7f6968133420 2023-10-03T10:13:29.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.640+0000 7f696dfac700 1 --2- 172.21.15.72:0/4265721783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6968134260 0x7f69681306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:29.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.640+0000 7f696d7ab700 1 --2- 172.21.15.72:0/4265721783 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968133420 0x7f69681337f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6964009920 tx=0x7f6964009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=612db460fa853151 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.640+0000 7f695ffff700 1 -- 172.21.15.72:0/4265721783 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696400ba60 con 0x7f6968133420 2023-10-03T10:13:29.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.640+0000 7f695ffff700 1 -- 172.21.15.72:0/4265721783 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696400bbc0 con 0x7f6968133420 2023-10-03T10:13:29.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.640+0000 7f695ffff700 1 -- 172.21.15.72:0/4265721783 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964009e70 con 0x7f6968133420 2023-10-03T10:13:29.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.641+0000 7f696fa0f700 1 -- 172.21.15.72:0/4265721783 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968133420 msgr2=0x7f69681337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.641+0000 7f696fa0f700 1 --2- 172.21.15.72:0/4265721783 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968133420 0x7f69681337f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6964009920 tx=0x7f6964009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:29.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.641+0000 7f696fa0f700 1 -- 172.21.15.72:0/4265721783 shutdown_connections 2023-10-03T10:13:29.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.641+0000 7f696fa0f700 1 --2- 172.21.15.72:0/4265721783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6968134260 0x7f69681306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.641+0000 7f696fa0f700 1 --2- 172.21.15.72:0/4265721783 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968133420 0x7f69681337f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.641+0000 7f696fa0f700 1 -- 172.21.15.72:0/4265721783 >> 172.21.15.72:0/4265721783 conn(0x7f69680a4210 msgr2=0x7f69680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.641+0000 7f696fa0f700 1 -- 172.21.15.72:0/4265721783 shutdown_connections 2023-10-03T10:13:29.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.641+0000 7f696fa0f700 1 -- 172.21.15.72:0/4265721783 wait complete. 2023-10-03T10:13:29.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.642+0000 7f696fa0f700 1 Processor -- start 2023-10-03T10:13:29.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.642+0000 7f696fa0f700 1 -- start start 2023-10-03T10:13:29.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.642+0000 7f696fa0f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6968133420 0x7f696809c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.642+0000 7f696fa0f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968133e30 0x7f696809c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.642+0000 7f696fa0f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6968134260 0x7f696809cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.642+0000 7f696fa0f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696811fd40 con 0x7f6968133420 2023-10-03T10:13:29.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.642+0000 7f696fa0f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696811fa80 con 0x7f6968134260 2023-10-03T10:13:29.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.642+0000 7f696fa0f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6968131590 con 0x7f6968133e30 2023-10-03T10:13:29.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.643+0000 7f696d7ab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6968133420 0x7f696809c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.643+0000 7f696d7ab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6968133420 0x7f696809c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51524/0 (socket says 172.21.15.72:51524) 2023-10-03T10:13:29.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.643+0000 7f696d7ab700 1 -- 172.21.15.72:0/3512606569 learned_addr learned my addr 172.21.15.72:0/3512606569 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:29.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.643+0000 7f696cfaa700 1 --2- 172.21.15.72:0/3512606569 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968133e30 0x7f696809c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.643+0000 7f696dfac700 1 --2- 172.21.15.72:0/3512606569 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6968134260 0x7f696809cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.643+0000 7f696d7ab700 1 -- 172.21.15.72:0/3512606569 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968133e30 msgr2=0x7f696809c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.643+0000 7f696d7ab700 1 --2- 172.21.15.72:0/3512606569 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968133e30 0x7f696809c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.643+0000 7f696d7ab700 1 -- 172.21.15.72:0/3512606569 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6968134260 msgr2=0x7f696809cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.643+0000 7f696d7ab700 1 --2- 172.21.15.72:0/3512606569 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6968134260 0x7f696809cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.643+0000 7f696d7ab700 1 -- 172.21.15.72:0/3512606569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6964009550 con 0x7f6968133420 2023-10-03T10:13:29.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.643+0000 7f696d7ab700 1 --2- 172.21.15.72:0/3512606569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6968133420 0x7f696809c0a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6964000c00 tx=0x7f6964004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.643+0000 7f695dffb700 1 -- 172.21.15.72:0/3512606569 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964004510 con 0x7f6968133420 2023-10-03T10:13:29.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.643+0000 7f695dffb700 1 -- 172.21.15.72:0/3512606569 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69640036a0 con 0x7f6968133420 2023-10-03T10:13:29.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.643+0000 7f696fa0f700 1 -- 172.21.15.72:0/3512606569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69681205e0 con 0x7f6968133420 2023-10-03T10:13:29.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.643+0000 7f695dffb700 1 -- 172.21.15.72:0/3512606569 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964003a10 con 0x7f6968133420 2023-10-03T10:13:29.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.644+0000 7f696fa0f700 1 -- 172.21.15.72:0/3512606569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696812dad0 con 0x7f6968133420 2023-10-03T10:13:29.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.645+0000 7f696fa0f700 1 -- 172.21.15.72:0/3512606569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696811fe90 con 0x7f6968133420 2023-10-03T10:13:29.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.645+0000 7f695dffb700 1 -- 172.21.15.72:0/3512606569 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6964021070 con 0x7f6968133420 2023-10-03T10:13:29.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.645+0000 7f695dffb700 1 -- 172.21.15.72:0/3512606569 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f69640483f0 con 0x7f6968133420 2023-10-03T10:13:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.645+0000 7f9af0e64700 1 Processor -- start 2023-10-03T10:13:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.645+0000 7f9af0e64700 1 -- start start 2023-10-03T10:13:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.646+0000 7f9af0e64700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9aec09e1d0 0x7f9aec135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.646+0000 7f9af0e64700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9aec135e50 0x7f9aec138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.646+0000 7f9af0e64700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aec09f130 con 0x7f9aec09d6f0 2023-10-03T10:13:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.646+0000 7f9af0e64700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec09f520 con 0x7f9aec09e1d0 2023-10-03T10:13:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.646+0000 7f9af0e64700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec09e930 con 0x7f9aec135e50 2023-10-03T10:13:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.647+0000 7f9aead9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9aec135e50 0x7f9aec138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.647+0000 7f9ae9d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9aec09e1d0 0x7f9aec135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.647+0000 7f9ae9d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9aec09e1d0 0x7f9aec135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50506/0 (socket says 172.21.15.72:50506) 2023-10-03T10:13:29.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.647+0000 7f9aead9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9aec135e50 0x7f9aec138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41450/0 (socket says 172.21.15.72:41450) 2023-10-03T10:13:29.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.647+0000 7f9ae9d9b700 1 -- 172.21.15.72:0/63849962 learned_addr learned my addr 172.21.15.72:0/63849962 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:29.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.647+0000 7f9ae9d9b700 1 -- 172.21.15.72:0/63849962 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9aec135e50 msgr2=0x7f9aec138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.647+0000 7f9ae9d9b700 1 --2- 172.21.15.72:0/63849962 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9aec135e50 0x7f9aec138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.647+0000 7f9ae9d9b700 1 -- 172.21.15.72:0/63849962 >> v1:172.21.15.72:6789/0 conn(0x7f9aec09d6f0 legacy=0x7f9aec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.647+0000 7f9ae9d9b700 1 -- 172.21.15.72:0/63849962 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec09b2d0 con 0x7f9aec09e1d0 2023-10-03T10:13:29.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.647+0000 7f9ae9d9b700 1 --2- 172.21.15.72:0/63849962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9aec09e1d0 0x7f9aec135910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009950 tx=0x7f9ae0009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0ccf350dbc338e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.647+0000 7f9ae959a700 1 -- 172.21.15.72:0/63849962 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0004230 con 0x7f9aec09e1d0 2023-10-03T10:13:29.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.647+0000 7f9ae959a700 1 -- 172.21.15.72:0/63849962 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae0004390 con 0x7f9aec09e1d0 2023-10-03T10:13:29.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.647+0000 7f9ae959a700 1 -- 172.21.15.72:0/63849962 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0010890 con 0x7f9aec09e1d0 2023-10-03T10:13:29.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.648+0000 7f9af0e64700 1 -- 172.21.15.72:0/63849962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9aec09e1d0 msgr2=0x7f9aec135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.648+0000 7f9af0e64700 1 --2- 172.21.15.72:0/63849962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9aec09e1d0 0x7f9aec135910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009950 tx=0x7f9ae0009c60 comp rx=0 tx=0).stop 2023-10-03T10:13:29.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.648+0000 7f9af0e64700 1 -- 172.21.15.72:0/63849962 shutdown_connections 2023-10-03T10:13:29.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.648+0000 7f9af0e64700 1 --2- 172.21.15.72:0/63849962 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9aec135e50 0x7f9aec138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.648+0000 7f9af0e64700 1 --2- 172.21.15.72:0/63849962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9aec09e1d0 0x7f9aec135910 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.648+0000 7f9af0e64700 1 -- 172.21.15.72:0/63849962 >> 172.21.15.72:0/63849962 conn(0x7f9aec066f50 msgr2=0x7f9aec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.648+0000 7f9af0e64700 1 -- 172.21.15.72:0/63849962 shutdown_connections 2023-10-03T10:13:29.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.648+0000 7f9af0e64700 1 -- 172.21.15.72:0/63849962 wait complete. 2023-10-03T10:13:29.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.650+0000 7f9af0e64700 1 Processor -- start 2023-10-03T10:13:29.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.650+0000 7f695dffb700 1 -- 172.21.15.72:0/3512606569 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6964044070 con 0x7f6968133420 2023-10-03T10:13:29.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.650+0000 7f9af0e64700 1 -- start start 2023-10-03T10:13:29.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.651+0000 7f9af0e64700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9aec09d6f0 0x7f9aec119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.651+0000 7f9af0e64700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9aec09e1d0 0x7f9aec1199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.651+0000 7f9af0e64700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9aec135e50 0x7f9aec119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.651+0000 7f9af0e64700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec11b0b0 con 0x7f9aec09d6f0 2023-10-03T10:13:29.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.651+0000 7f9af0e64700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec11cbd0 con 0x7f9aec09e1d0 2023-10-03T10:13:29.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.651+0000 7f9af0e64700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec0a1d00 con 0x7f9aec135e50 2023-10-03T10:13:29.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.651+0000 7f9aead9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9aec135e50 0x7f9aec119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.651+0000 7f9aead9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9aec135e50 0x7f9aec119f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41452/0 (socket says 172.21.15.72:41452) 2023-10-03T10:13:29.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.651+0000 7f9aead9d700 1 -- 172.21.15.72:0/2858567069 learned_addr learned my addr 172.21.15.72:0/2858567069 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:29.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.651+0000 7f9ae9d9b700 1 --2- 172.21.15.72:0/2858567069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9aec09e1d0 0x7f9aec1199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.651+0000 7f9aead9d700 1 -- 172.21.15.72:0/2858567069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9aec09e1d0 msgr2=0x7f9aec1199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.651+0000 7f9aead9d700 1 --2- 172.21.15.72:0/2858567069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9aec09e1d0 0x7f9aec1199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.651+0000 7f9aead9d700 1 -- 172.21.15.72:0/2858567069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9aec09d6f0 msgr2=0x7f9aec119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.651+0000 7f9aead9d700 1 --2- 172.21.15.72:0/2858567069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9aec09d6f0 0x7f9aec119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.651+0000 7f9aead9d700 1 -- 172.21.15.72:0/2858567069 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae0009550 con 0x7f9aec135e50 2023-10-03T10:13:29.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.652+0000 7f9aead9d700 1 --2- 172.21.15.72:0/2858567069 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9aec135e50 0x7f9aec119f00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400efc0 tx=0x7f9ae400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.652+0000 7f9adaffd700 1 -- 172.21.15.72:0/2858567069 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae400cd40 con 0x7f9aec135e50 2023-10-03T10:13:29.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.652+0000 7f9adaffd700 1 -- 172.21.15.72:0/2858567069 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae400f040 con 0x7f9aec135e50 2023-10-03T10:13:29.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.652+0000 7f9af0e64700 1 -- 172.21.15.72:0/2858567069 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aec09c700 con 0x7f9aec135e50 2023-10-03T10:13:29.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.652+0000 7f9adaffd700 1 -- 172.21.15.72:0/2858567069 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae40146c0 con 0x7f9aec135e50 2023-10-03T10:13:29.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.652+0000 7f9af0e64700 1 -- 172.21.15.72:0/2858567069 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aec11b730 con 0x7f9aec135e50 2023-10-03T10:13:29.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.652+0000 7f9adaffd700 1 -- 172.21.15.72:0/2858567069 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ae4014820 con 0x7f9aec135e50 2023-10-03T10:13:29.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.653+0000 7f9adaffd700 1 -- 172.21.15.72:0/2858567069 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9ae4040310 con 0x7f9aec135e50 2023-10-03T10:13:29.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.655+0000 7f9af0e64700 1 -- 172.21.15.72:0/2858567069 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aec074ea0 con 0x7f9aec135e50 2023-10-03T10:13:29.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.659+0000 7f9adaffd700 1 -- 172.21.15.72:0/2858567069 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ae4018020 con 0x7f9aec135e50 2023-10-03T10:13:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.784+0000 7fee74dc7700 1 -- 172.21.15.72:0/1806486203 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fee7006f0d0 con 0x7fee70130380 2023-10-03T10:13:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.785+0000 7fee5effd700 1 -- 172.21.15.72:0/1806486203 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee7006f0d0 con 0x7fee70130380 2023-10-03T10:13:29.785 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.787+0000 7fee74dc7700 1 -- 172.21.15.72:0/1806486203 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee70130380 msgr2=0x7fee7012ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.787+0000 7fee74dc7700 1 --2- 172.21.15.72:0/1806486203 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee70130380 0x7fee7012ae20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fee68019000 tx=0x7fee68004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.787+0000 7fee74dc7700 1 -- 172.21.15.72:0/1806486203 shutdown_connections 2023-10-03T10:13:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.787+0000 7fee74dc7700 1 --2- 172.21.15.72:0/1806486203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee7012c9a0 0x7fee7012a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.787+0000 7fee74dc7700 1 --2- 172.21.15.72:0/1806486203 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee70130380 0x7fee7012ae20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.787+0000 7fee74dc7700 1 --2- 172.21.15.72:0/1806486203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee7012f880 0x7fee7012a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.787+0000 7fee74dc7700 1 -- 172.21.15.72:0/1806486203 >> 172.21.15.72:0/1806486203 conn(0x7fee700a2360 msgr2=0x7fee701b58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.787+0000 7fee74dc7700 1 -- 172.21.15.72:0/1806486203 shutdown_connections 2023-10-03T10:13:29.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.787+0000 7fee74dc7700 1 -- 172.21.15.72:0/1806486203 wait complete. 2023-10-03T10:13:29.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:29.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.807+0000 7f6db7dd3700 1 -- 172.21.15.72:0/837752706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6db0074ea0 con 0x7f6db009e1d0 2023-10-03T10:13:29.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.807+0000 7f6da67fc700 1 -- 172.21.15.72:0/837752706 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6da002b070 con 0x7f6db009e1d0 2023-10-03T10:13:29.808 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:29.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.810+0000 7f6db7dd3700 1 -- 172.21.15.72:0/837752706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db009e1d0 msgr2=0x7f6db011eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.810+0000 7f6db7dd3700 1 --2- 172.21.15.72:0/837752706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db009e1d0 0x7f6db011eda0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009870 tx=0x7f6da0004750 comp rx=0 tx=0).stop 2023-10-03T10:13:29.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.810+0000 7f6db7dd3700 1 -- 172.21.15.72:0/837752706 shutdown_connections 2023-10-03T10:13:29.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.810+0000 7f6db7dd3700 1 --2- 172.21.15.72:0/837752706 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6db0139170 0x7f6db011f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.810+0000 7f6db7dd3700 1 --2- 172.21.15.72:0/837752706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6db009d6f0 0x7f6db011e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.810+0000 7f6db7dd3700 1 --2- 172.21.15.72:0/837752706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6db009e1d0 0x7f6db011eda0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.810+0000 7f6db7dd3700 1 -- 172.21.15.72:0/837752706 >> 172.21.15.72:0/837752706 conn(0x7f6db0066f50 msgr2=0x7f6db0136c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.810+0000 7f6db7dd3700 1 -- 172.21.15.72:0/837752706 shutdown_connections 2023-10-03T10:13:29.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.810+0000 7f6db7dd3700 1 -- 172.21.15.72:0/837752706 wait complete. 2023-10-03T10:13:29.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:29.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.859+0000 7f696fa0f700 1 -- 172.21.15.72:0/3512606569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6968074ea0 con 0x7f6968133420 2023-10-03T10:13:29.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.859+0000 7f695dffb700 1 -- 172.21.15.72:0/3512606569 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6964015020 con 0x7f6968133420 2023-10-03T10:13:29.860 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:29.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.861+0000 7f696fa0f700 1 -- 172.21.15.72:0/3512606569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6968133420 msgr2=0x7f696809c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.861+0000 7f696fa0f700 1 --2- 172.21.15.72:0/3512606569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6968133420 0x7f696809c0a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6964000c00 tx=0x7f6964004750 comp rx=0 tx=0).stop 2023-10-03T10:13:29.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.861+0000 7f696fa0f700 1 -- 172.21.15.72:0/3512606569 shutdown_connections 2023-10-03T10:13:29.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.861+0000 7f696fa0f700 1 --2- 172.21.15.72:0/3512606569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6968133420 0x7f696809c0a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.861+0000 7f696fa0f700 1 --2- 172.21.15.72:0/3512606569 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6968134260 0x7f696809cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.861+0000 7f696fa0f700 1 --2- 172.21.15.72:0/3512606569 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968133e30 0x7f696809c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.861+0000 7f696fa0f700 1 -- 172.21.15.72:0/3512606569 >> 172.21.15.72:0/3512606569 conn(0x7f69680a4210 msgr2=0x7f6968130480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.861+0000 7f696fa0f700 1 -- 172.21.15.72:0/3512606569 shutdown_connections 2023-10-03T10:13:29.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.861+0000 7f696fa0f700 1 -- 172.21.15.72:0/3512606569 wait complete. 2023-10-03T10:13:29.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.870+0000 7f9af0e64700 1 -- 172.21.15.72:0/2858567069 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9aec06c360 con 0x7f9aec135e50 2023-10-03T10:13:29.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.870+0000 7f9adaffd700 1 -- 172.21.15.72:0/2858567069 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9ae402b090 con 0x7f9aec135e50 2023-10-03T10:13:29.871 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.873+0000 7f9af0e64700 1 -- 172.21.15.72:0/2858567069 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9aec135e50 msgr2=0x7f9aec119f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.873+0000 7f9af0e64700 1 --2- 172.21.15.72:0/2858567069 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9aec135e50 0x7f9aec119f00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400efc0 tx=0x7f9ae400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.873+0000 7f9af0e64700 1 -- 172.21.15.72:0/2858567069 shutdown_connections 2023-10-03T10:13:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.873+0000 7f9af0e64700 1 --2- 172.21.15.72:0/2858567069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9aec09d6f0 0x7f9aec119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.873+0000 7f9af0e64700 1 --2- 172.21.15.72:0/2858567069 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9aec135e50 0x7f9aec119f00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.873+0000 7f9af0e64700 1 --2- 172.21.15.72:0/2858567069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9aec09e1d0 0x7f9aec1199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.873+0000 7f9af0e64700 1 -- 172.21.15.72:0/2858567069 >> 172.21.15.72:0/2858567069 conn(0x7f9aec066f50 msgr2=0x7f9aec132940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.873+0000 7f9af0e64700 1 -- 172.21.15.72:0/2858567069 shutdown_connections 2023-10-03T10:13:29.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:29.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:29.873+0000 7f9af0e64700 1 -- 172.21.15.72:0/2858567069 wait complete. 2023-10-03T10:13:29.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:30.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:30.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:30.876 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:30.887 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:30.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.932+0000 7f71f1f30700 1 Processor -- start 2023-10-03T10:13:30.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.932+0000 7f71f1f30700 1 -- start start 2023-10-03T10:13:30.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.932+0000 7f71f1f30700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71ec09d6f0 0x7f71ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.932+0000 7f71f1f30700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71ec09e000 0x7f71ec130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.932+0000 7f71f1f30700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ec09f130 con 0x7f71ec09e410 2023-10-03T10:13:30.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.932+0000 7f71f1f30700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ec09f520 con 0x7f71ec09d6f0 2023-10-03T10:13:30.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.932+0000 7f71f1f30700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec09e930 con 0x7f71ec09e000 2023-10-03T10:13:30.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.932+0000 7f71eb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71ec09d6f0 0x7f71ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.932+0000 7f71eb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71ec09d6f0 0x7f71ec09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51546/0 (socket says 172.21.15.72:51546) 2023-10-03T10:13:30.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.932+0000 7f71eb7fe700 1 -- 172.21.15.72:0/3292955582 learned_addr learned my addr 172.21.15.72:0/3292955582 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:30.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.933+0000 7f71eb7fe700 1 -- 172.21.15.72:0/3292955582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71ec09e000 msgr2=0x7f71ec130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.933+0000 7f71eb7fe700 1 --2- 172.21.15.72:0/3292955582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71ec09e000 0x7f71ec130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.933+0000 7f71eb7fe700 1 -- 172.21.15.72:0/3292955582 >> v1:172.21.15.72:6789/0 conn(0x7f71ec09e410 legacy=0x7f71ec130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.933+0000 7f71eb7fe700 1 -- 172.21.15.72:0/3292955582 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec09b2d0 con 0x7f71ec09d6f0 2023-10-03T10:13:30.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.933+0000 7f71eb7fe700 1 --2- 172.21.15.72:0/3292955582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71ec09d6f0 0x7f71ec09dac0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0098f0 tx=0x7f71dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347c0b40a59dfb47 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.933+0000 7f71ea7fc700 1 -- 172.21.15.72:0/3292955582 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00b8a0 con 0x7f71ec09d6f0 2023-10-03T10:13:30.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.933+0000 7f71ea7fc700 1 -- 172.21.15.72:0/3292955582 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc00ba00 con 0x7f71ec09d6f0 2023-10-03T10:13:30.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.933+0000 7f71ea7fc700 1 -- 172.21.15.72:0/3292955582 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00bd90 con 0x7f71ec09d6f0 2023-10-03T10:13:30.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.934+0000 7f71f1f30700 1 -- 172.21.15.72:0/3292955582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71ec09d6f0 msgr2=0x7f71ec09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.934+0000 7f71f1f30700 1 --2- 172.21.15.72:0/3292955582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71ec09d6f0 0x7f71ec09dac0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0098f0 tx=0x7f71dc009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:30.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.934+0000 7f71f1f30700 1 -- 172.21.15.72:0/3292955582 shutdown_connections 2023-10-03T10:13:30.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.934+0000 7f71f1f30700 1 --2- 172.21.15.72:0/3292955582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71ec09d6f0 0x7f71ec09dac0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.934+0000 7f71f1f30700 1 --2- 172.21.15.72:0/3292955582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71ec09e000 0x7f71ec130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.934+0000 7f71f1f30700 1 -- 172.21.15.72:0/3292955582 >> 172.21.15.72:0/3292955582 conn(0x7f71ec066f50 msgr2=0x7f71ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.934+0000 7f71f1f30700 1 -- 172.21.15.72:0/3292955582 shutdown_connections 2023-10-03T10:13:30.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.934+0000 7f71f1f30700 1 -- 172.21.15.72:0/3292955582 wait complete. 2023-10-03T10:13:30.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.935+0000 7f71f1f30700 1 Processor -- start 2023-10-03T10:13:30.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.936+0000 7f71f1f30700 1 -- start start 2023-10-03T10:13:30.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.936+0000 7f71f1f30700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71ec09d6f0 0x7f71ec1301c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.936+0000 7f71f1f30700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71ec09e000 0x7f71ec130700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.936+0000 7f71f1f30700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71ec09e410 0x7f71ec130c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.936+0000 7f71f1f30700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec13ada0 con 0x7f71ec09e000 2023-10-03T10:13:30.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.936+0000 7f71f1f30700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec0a1d00 con 0x7f71ec09e410 2023-10-03T10:13:30.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.936+0000 7f71f1f30700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec09c700 con 0x7f71ec09d6f0 2023-10-03T10:13:30.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71eaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71ec09e000 0x7f71ec130700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71eaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71ec09e000 0x7f71ec130700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51552/0 (socket says 172.21.15.72:51552) 2023-10-03T10:13:30.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71eaffd700 1 -- 172.21.15.72:0/3746972769 learned_addr learned my addr 172.21.15.72:0/3746972769 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:30.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71ebfff700 1 --2- 172.21.15.72:0/3746972769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71ec09e410 0x7f71ec130c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71eaffd700 1 -- 172.21.15.72:0/3746972769 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71ec09d6f0 msgr2=0x7f71ec1301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71eaffd700 1 --2- 172.21.15.72:0/3746972769 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71ec09d6f0 0x7f71ec1301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71eaffd700 1 -- 172.21.15.72:0/3746972769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71ec09e410 msgr2=0x7f71ec130c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71eaffd700 1 --2- 172.21.15.72:0/3746972769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71ec09e410 0x7f71ec130c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71eaffd700 1 -- 172.21.15.72:0/3746972769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc009550 con 0x7f71ec09e000 2023-10-03T10:13:30.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71ebfff700 1 --2- 172.21.15.72:0/3746972769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71ec09e410 0x7f71ec130c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:30.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71eaffd700 1 --2- 172.21.15.72:0/3746972769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71ec09e000 0x7f71ec130700 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f71e000b530 tx=0x7f71e000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71d3fff700 1 -- 172.21.15.72:0/3746972769 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e0011830 con 0x7f71ec09e000 2023-10-03T10:13:30.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71d3fff700 1 -- 172.21.15.72:0/3746972769 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e0011990 con 0x7f71ec09e000 2023-10-03T10:13:30.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71f1f30700 1 -- 172.21.15.72:0/3746972769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ec12e510 con 0x7f71ec09e000 2023-10-03T10:13:30.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71d3fff700 1 -- 172.21.15.72:0/3746972769 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e0011d20 con 0x7f71ec09e000 2023-10-03T10:13:30.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.937+0000 7f71f1f30700 1 -- 172.21.15.72:0/3746972769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ec12f300 con 0x7f71ec09e000 2023-10-03T10:13:30.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.938+0000 7f71d3fff700 1 -- 172.21.15.72:0/3746972769 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71e001a400 con 0x7f71ec09e000 2023-10-03T10:13:30.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.938+0000 7f71d3fff700 1 -- 172.21.15.72:0/3746972769 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f71e003f7f0 con 0x7f71ec09e000 2023-10-03T10:13:30.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.939+0000 7f71f1f30700 1 -- 172.21.15.72:0/3746972769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ec12ef50 con 0x7f71ec09e000 2023-10-03T10:13:30.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.944+0000 7f71d3fff700 1 -- 172.21.15.72:0/3746972769 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71e0015020 con 0x7f71ec09e000 2023-10-03T10:13:31.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.999+0000 7fcac9e4d700 1 Processor -- start 2023-10-03T10:13:31.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:30.999+0000 7fcac9e4d700 1 -- start start 2023-10-03T10:13:31.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.000+0000 7fcac9e4d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcac406f5d0 0x7fcac412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.000+0000 7fcac9e4d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcac4135c20 0x7fcac4138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.000+0000 7fcac9e4d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac406fa40 con 0x7fcac412cf60 2023-10-03T10:13:31.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.000+0000 7fcac9e4d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac412cd90 con 0x7fcac4135c20 2023-10-03T10:13:31.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.000+0000 7fcac9e4d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcac4071780 con 0x7fcac406f5d0 2023-10-03T10:13:31.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.000+0000 7fcac37fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcac412cf60 0x7fcac412f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43454/0 (socket says 172.21.15.72:43454) 2023-10-03T10:13:31.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.000+0000 7fcac37fe700 1 -- 172.21.15.72:0/3412247879 learned_addr learned my addr 172.21.15.72:0/3412247879 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:31.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.000+0000 7fcac2ffd700 1 --2- 172.21.15.72:0/3412247879 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcac406f5d0 0x7fcac412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.000+0000 7fcac3fff700 1 --2- 172.21.15.72:0/3412247879 >> v2:172.21.15.72:3300/0 conn(0x7fcac4135c20 0x7fcac4138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.000+0000 7fcac27fc700 1 -- 172.21.15.72:0/3412247879 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227513598 0 0) 0x7fcac406fa40 con 0x7fcac412cf60 2023-10-03T10:13:31.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.001+0000 7fcac27fc700 1 -- 172.21.15.72:0/3412247879 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaac0035b0 con 0x7fcac412cf60 2023-10-03T10:13:31.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.001+0000 7fcac2ffd700 1 -- 172.21.15.72:0/3412247879 >> v2:172.21.15.72:3300/0 conn(0x7fcac4135c20 msgr2=0x7fcac4138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.001+0000 7fcac2ffd700 1 --2- 172.21.15.72:0/3412247879 >> v2:172.21.15.72:3300/0 conn(0x7fcac4135c20 0x7fcac4138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.001+0000 7fcac2ffd700 1 -- 172.21.15.72:0/3412247879 >> v1:172.21.15.72:6789/0 conn(0x7fcac412cf60 legacy=0x7fcac412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.001+0000 7fcac2ffd700 1 -- 172.21.15.72:0/3412247879 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac4071a40 con 0x7fcac406f5d0 2023-10-03T10:13:31.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.001+0000 7fcac2ffd700 1 --2- 172.21.15.72:0/3412247879 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcac406f5d0 0x7fcac412ffc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009840 tx=0x7fcab8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b38e2183a25ab39 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.001+0000 7fcac27fc700 1 -- 172.21.15.72:0/3412247879 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8011830 con 0x7fcac406f5d0 2023-10-03T10:13:31.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.001+0000 7fcac27fc700 1 -- 172.21.15.72:0/3412247879 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab8011990 con 0x7fcac406f5d0 2023-10-03T10:13:31.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.001+0000 7fcac27fc700 1 -- 172.21.15.72:0/3412247879 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8011d00 con 0x7fcac406f5d0 2023-10-03T10:13:31.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.002+0000 7fcac9e4d700 1 -- 172.21.15.72:0/3412247879 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcac406f5d0 msgr2=0x7fcac412ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.002+0000 7fcac9e4d700 1 --2- 172.21.15.72:0/3412247879 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcac406f5d0 0x7fcac412ffc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009840 tx=0x7fcab8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:31.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.002+0000 7fcac9e4d700 1 -- 172.21.15.72:0/3412247879 shutdown_connections 2023-10-03T10:13:31.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.002+0000 7fcac9e4d700 1 --2- 172.21.15.72:0/3412247879 >> v2:172.21.15.72:3300/0 conn(0x7fcac4135c20 0x7fcac4138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.002+0000 7fcac9e4d700 1 --2- 172.21.15.72:0/3412247879 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcac406f5d0 0x7fcac412ffc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.002+0000 7fcac9e4d700 1 -- 172.21.15.72:0/3412247879 >> 172.21.15.72:0/3412247879 conn(0x7fcac40a2aa0 msgr2=0x7fcac40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.002+0000 7fcac9e4d700 1 -- 172.21.15.72:0/3412247879 shutdown_connections 2023-10-03T10:13:31.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.002+0000 7fcac9e4d700 1 -- 172.21.15.72:0/3412247879 wait complete. 2023-10-03T10:13:31.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.003+0000 7fcac9e4d700 1 Processor -- start 2023-10-03T10:13:31.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.004+0000 7fcac9e4d700 1 -- start start 2023-10-03T10:13:31.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.004+0000 7fcac9e4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcac406f5d0 0x7fcac4099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.004+0000 7fcac9e4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcac412cf60 0x7fcac409a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.004+0000 7fcac9e4d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcac4135c20 0x7fcac409a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.004+0000 7fcac9e4d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac409cd40 con 0x7fcac412cf60 2023-10-03T10:13:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.004+0000 7fcac9e4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac409c360 con 0x7fcac406f5d0 2023-10-03T10:13:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.004+0000 7fcac9e4d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcac409aef0 con 0x7fcac4135c20 2023-10-03T10:13:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.004+0000 7fcac3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcac4135c20 0x7fcac409a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.004+0000 7fcac3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcac4135c20 0x7fcac409a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41486/0 (socket says 172.21.15.72:41486) 2023-10-03T10:13:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.004+0000 7fcac3fff700 1 -- 172.21.15.72:0/2144675744 learned_addr learned my addr 172.21.15.72:0/2144675744 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.004+0000 7fcac2ffd700 1 --2- 172.21.15.72:0/2144675744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcac412cf60 0x7fcac409a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.005+0000 7fcac2ffd700 1 -- 172.21.15.72:0/2144675744 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcac4135c20 msgr2=0x7fcac409a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.005+0000 7fcac2ffd700 1 --2- 172.21.15.72:0/2144675744 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcac4135c20 0x7fcac409a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.005+0000 7fcac2ffd700 1 -- 172.21.15.72:0/2144675744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcac406f5d0 msgr2=0x7fcac4099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.005+0000 7fcac2ffd700 1 --2- 172.21.15.72:0/2144675744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcac406f5d0 0x7fcac4099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.005+0000 7fcac2ffd700 1 -- 172.21.15.72:0/2144675744 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab80094a0 con 0x7fcac412cf60 2023-10-03T10:13:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.005+0000 7fcac3fff700 1 --2- 172.21.15.72:0/2144675744 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcac4135c20 0x7fcac409a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.005+0000 7fcac2ffd700 1 --2- 172.21.15.72:0/2144675744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcac412cf60 0x7fcac409a290 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcac4070520 tx=0x7fcab8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.005+0000 7fcaabfff700 1 -- 172.21.15.72:0/2144675744 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab80036a0 con 0x7fcac412cf60 2023-10-03T10:13:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.005+0000 7fcaabfff700 1 -- 172.21.15.72:0/2144675744 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab801f070 con 0x7fcac412cf60 2023-10-03T10:13:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.005+0000 7fcaabfff700 1 -- 172.21.15.72:0/2144675744 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8003a40 con 0x7fcac412cf60 2023-10-03T10:13:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.005+0000 7fcac9e4d700 1 -- 172.21.15.72:0/2144675744 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac409b7c0 con 0x7fcac412cf60 2023-10-03T10:13:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.005+0000 7fcac9e4d700 1 -- 172.21.15.72:0/2144675744 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac413c640 con 0x7fcac412cf60 2023-10-03T10:13:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.006+0000 7fcaabfff700 1 -- 172.21.15.72:0/2144675744 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcab8003ba0 con 0x7fcac412cf60 2023-10-03T10:13:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.007+0000 7fcaabfff700 1 -- 172.21.15.72:0/2144675744 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcab8021070 con 0x7fcac412cf60 2023-10-03T10:13:31.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.006+0000 7fcac9e4d700 1 -- 172.21.15.72:0/2144675744 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac4074ea0 con 0x7fcac412cf60 2023-10-03T10:13:31.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.015+0000 7fcaabfff700 1 -- 172.21.15.72:0/2144675744 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcab802b070 con 0x7fcac412cf60 2023-10-03T10:13:31.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.048+0000 7f6c09209700 1 Processor -- start 2023-10-03T10:13:31.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.048+0000 7f6c09209700 1 -- start start 2023-10-03T10:13:31.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.049+0000 7f6c09209700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c041338a0 0x7f6c04133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.049+0000 7f6c09209700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c0409e930 0x7f6c0413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.049+0000 7f6c09209700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0406ef30 con 0x7f6c0409de50 2023-10-03T10:13:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.049+0000 7f6c09209700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0406fef0 con 0x7f6c0409e930 2023-10-03T10:13:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.049+0000 7f6c09209700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c041334b0 con 0x7f6c041338a0 2023-10-03T10:13:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.049+0000 7f6c02d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c041338a0 0x7f6c04133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.049+0000 7f6c02d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c041338a0 0x7f6c04133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41494/0 (socket says 172.21.15.72:41494) 2023-10-03T10:13:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.049+0000 7f6c02d9d700 1 -- 172.21.15.72:0/1213829631 learned_addr learned my addr 172.21.15.72:0/1213829631 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.049+0000 7f6c0359e700 1 --2- 172.21.15.72:0/1213829631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c0409e930 0x7f6c0413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.050+0000 7f6c02d9d700 1 -- 172.21.15.72:0/1213829631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c0409e930 msgr2=0x7f6c0413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.050+0000 7f6c02d9d700 1 --2- 172.21.15.72:0/1213829631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c0409e930 0x7f6c0413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.050+0000 7f6c02d9d700 1 -- 172.21.15.72:0/1213829631 >> v1:172.21.15.72:6789/0 conn(0x7f6c0409de50 legacy=0x7f6c0409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.050+0000 7f6c02d9d700 1 -- 172.21.15.72:0/1213829631 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0406fc30 con 0x7f6c041338a0 2023-10-03T10:13:31.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.050+0000 7f6c02d9d700 1 --2- 172.21.15.72:0/1213829631 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c041338a0 0x7f6c04133c70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4009920 tx=0x7f6bf4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=287354e6b5c92aeb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.050+0000 7f6c01d9b700 1 -- 172.21.15.72:0/1213829631 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4011830 con 0x7f6c041338a0 2023-10-03T10:13:31.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.050+0000 7f6c01d9b700 1 -- 172.21.15.72:0/1213829631 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf4011990 con 0x7f6c041338a0 2023-10-03T10:13:31.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.050+0000 7f6c01d9b700 1 -- 172.21.15.72:0/1213829631 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4011d20 con 0x7f6c041338a0 2023-10-03T10:13:31.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.051+0000 7f6c09209700 1 -- 172.21.15.72:0/1213829631 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c041338a0 msgr2=0x7f6c04133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.051+0000 7f6c09209700 1 --2- 172.21.15.72:0/1213829631 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c041338a0 0x7f6c04133c70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4009920 tx=0x7f6bf4009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:31.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.051+0000 7f6c09209700 1 -- 172.21.15.72:0/1213829631 shutdown_connections 2023-10-03T10:13:31.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.051+0000 7f6c09209700 1 --2- 172.21.15.72:0/1213829631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c0409e930 0x7f6c0413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.051+0000 7f6c09209700 1 --2- 172.21.15.72:0/1213829631 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c041338a0 0x7f6c04133c70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.051+0000 7f6c09209700 1 -- 172.21.15.72:0/1213829631 >> 172.21.15.72:0/1213829631 conn(0x7f6c040a2aa0 msgr2=0x7f6c040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.051+0000 7f6c09209700 1 -- 172.21.15.72:0/1213829631 shutdown_connections 2023-10-03T10:13:31.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.051+0000 7f6c09209700 1 -- 172.21.15.72:0/1213829631 wait complete. 2023-10-03T10:13:31.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.053+0000 7f6c09209700 1 Processor -- start 2023-10-03T10:13:31.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.053+0000 7f6c09209700 1 -- start start 2023-10-03T10:13:31.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.053+0000 7f6c09209700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0409de50 0x7f6c0411eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.053+0000 7f6c09209700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c0409e930 0x7f6c0411f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.053+0000 7f6c09209700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c041338a0 0x7f6c0411f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.053+0000 7f6c09209700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0411ff80 con 0x7f6c0409de50 2023-10-03T10:13:31.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.053+0000 7f6c09209700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0412f640 con 0x7f6c041338a0 2023-10-03T10:13:31.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.053+0000 7f6c09209700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0406f640 con 0x7f6c0409e930 2023-10-03T10:13:31.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.053+0000 7f6c02d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0409de50 0x7f6c0411eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.053+0000 7f6c0259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c0409e930 0x7f6c0411f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.054+0000 7f6c02d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0409de50 0x7f6c0411eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51580/0 (socket says 172.21.15.72:51580) 2023-10-03T10:13:31.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.054+0000 7f6c02d9d700 1 -- 172.21.15.72:0/1906968404 learned_addr learned my addr 172.21.15.72:0/1906968404 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:31.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.054+0000 7f6c0359e700 1 --2- 172.21.15.72:0/1906968404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c041338a0 0x7f6c0411f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.054+0000 7f6c0259c700 1 -- 172.21.15.72:0/1906968404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c041338a0 msgr2=0x7f6c0411f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.054+0000 7f6c0259c700 1 --2- 172.21.15.72:0/1906968404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c041338a0 0x7f6c0411f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.054+0000 7f6c0259c700 1 -- 172.21.15.72:0/1906968404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0409de50 msgr2=0x7f6c0411eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.054+0000 7f6c0259c700 1 --2- 172.21.15.72:0/1906968404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0409de50 0x7f6c0411eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.054+0000 7f6c0259c700 1 -- 172.21.15.72:0/1906968404 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf4009550 con 0x7f6c0409e930 2023-10-03T10:13:31.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.054+0000 7f6c0259c700 1 --2- 172.21.15.72:0/1906968404 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c0409e930 0x7f6c0411f080 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8000f60 tx=0x7f6bf800c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.054+0000 7f6beb7fe700 1 -- 172.21.15.72:0/1906968404 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf80050d0 con 0x7f6c0409e930 2023-10-03T10:13:31.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.054+0000 7f6beb7fe700 1 -- 172.21.15.72:0/1906968404 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf8005230 con 0x7f6c0409e930 2023-10-03T10:13:31.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.054+0000 7f6c09209700 1 -- 172.21.15.72:0/1906968404 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c041225d0 con 0x7f6c0409e930 2023-10-03T10:13:31.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.054+0000 7f6beb7fe700 1 -- 172.21.15.72:0/1906968404 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8003680 con 0x7f6c0409e930 2023-10-03T10:13:31.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.054+0000 7f6c09209700 1 -- 172.21.15.72:0/1906968404 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c041222f0 con 0x7f6c0409e930 2023-10-03T10:13:31.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.055+0000 7f6c09209700 1 -- 172.21.15.72:0/1906968404 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c04074ea0 con 0x7f6c0409e930 2023-10-03T10:13:31.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.056+0000 7f6beb7fe700 1 -- 172.21.15.72:0/1906968404 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bf80037e0 con 0x7f6c0409e930 2023-10-03T10:13:31.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.056+0000 7f6beb7fe700 1 -- 172.21.15.72:0/1906968404 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6bf803eae0 con 0x7f6c0409e930 2023-10-03T10:13:31.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.058+0000 7f621f9d5700 1 Processor -- start 2023-10-03T10:13:31.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.059+0000 7f621f9d5700 1 -- start start 2023-10-03T10:13:31.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.059+0000 7f621f9d5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f621809de00 0x7f621809e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.059+0000 7f621f9d5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f621813d1f0 0x7f621813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.059+0000 7f621f9d5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621809a810 con 0x7f621806a770 2023-10-03T10:13:31.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.059+0000 7f621f9d5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621806ab40 con 0x7f621809de00 2023-10-03T10:13:31.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.059+0000 7f621f9d5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f621809ebc0 con 0x7f621813d1f0 2023-10-03T10:13:31.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.059+0000 7f621d771700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f621806a770 0x7f621809d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43472/0 (socket says 172.21.15.72:43472) 2023-10-03T10:13:31.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.059+0000 7f621d771700 1 -- 172.21.15.72:0/2535744310 learned_addr learned my addr 172.21.15.72:0/2535744310 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:31.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.059+0000 7f621df72700 1 --2- 172.21.15.72:0/2535744310 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f621813d1f0 0x7f621813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.059+0000 7f620ffff700 1 -- 172.21.15.72:0/2535744310 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537337208 0 0) 0x7f621809a810 con 0x7f621806a770 2023-10-03T10:13:31.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.059+0000 7f620ffff700 1 -- 172.21.15.72:0/2535744310 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62040035b0 con 0x7f621806a770 2023-10-03T10:13:31.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.060+0000 7f621df72700 1 -- 172.21.15.72:0/2535744310 >> v2:172.21.15.72:3300/0 conn(0x7f621809de00 msgr2=0x7f621809e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.060+0000 7f621df72700 1 --2- 172.21.15.72:0/2535744310 >> v2:172.21.15.72:3300/0 conn(0x7f621809de00 0x7f621809e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.060+0000 7f621df72700 1 -- 172.21.15.72:0/2535744310 >> v1:172.21.15.72:6789/0 conn(0x7f621806a770 legacy=0x7f621809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.060+0000 7f621df72700 1 -- 172.21.15.72:0/2535744310 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621809e920 con 0x7f621813d1f0 2023-10-03T10:13:31.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.060+0000 7f621df72700 1 --2- 172.21.15.72:0/2535744310 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f621813d1f0 0x7f621813f5d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6210009d90 tx=0x7f621000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29583ca29a895c2e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.064+0000 7f620ffff700 1 -- 172.21.15.72:0/2535744310 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621000e070 con 0x7f621813d1f0 2023-10-03T10:13:31.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.065+0000 7f620ffff700 1 -- 172.21.15.72:0/2535744310 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621000bb20 con 0x7f621813d1f0 2023-10-03T10:13:31.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.065+0000 7f620ffff700 1 -- 172.21.15.72:0/2535744310 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210012430 con 0x7f621813d1f0 2023-10-03T10:13:31.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.065+0000 7f6beb7fe700 1 -- 172.21.15.72:0/1906968404 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bf8011590 con 0x7f6c0409e930 2023-10-03T10:13:31.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.065+0000 7f621f9d5700 1 -- 172.21.15.72:0/2535744310 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f621813d1f0 msgr2=0x7f621813f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.065+0000 7f621f9d5700 1 --2- 172.21.15.72:0/2535744310 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f621813d1f0 0x7f621813f5d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6210009d90 tx=0x7f621000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:31.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.065+0000 7f621f9d5700 1 -- 172.21.15.72:0/2535744310 shutdown_connections 2023-10-03T10:13:31.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.065+0000 7f621f9d5700 1 --2- 172.21.15.72:0/2535744310 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f621813d1f0 0x7f621813f5d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.065+0000 7f621f9d5700 1 --2- 172.21.15.72:0/2535744310 >> v2:172.21.15.72:3300/0 conn(0x7f621809de00 0x7f621809e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.065+0000 7f621f9d5700 1 -- 172.21.15.72:0/2535744310 >> 172.21.15.72:0/2535744310 conn(0x7f6218066f50 msgr2=0x7f621809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.065+0000 7f621f9d5700 1 -- 172.21.15.72:0/2535744310 shutdown_connections 2023-10-03T10:13:31.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.065+0000 7f621f9d5700 1 -- 172.21.15.72:0/2535744310 wait complete. 2023-10-03T10:13:31.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.066+0000 7f621f9d5700 1 Processor -- start 2023-10-03T10:13:31.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.066+0000 7f621f9d5700 1 -- start start 2023-10-03T10:13:31.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.067+0000 7f621f9d5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f621806a770 0x7f6218071760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.067+0000 7f621f9d5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f621809de00 0x7f621813b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.067+0000 7f621f9d5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f621813d1f0 0x7f621813bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.067+0000 7f621f9d5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621813cd40 con 0x7f621806a770 2023-10-03T10:13:31.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.067+0000 7f621f9d5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6218072520 con 0x7f621809de00 2023-10-03T10:13:31.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.067+0000 7f621f9d5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f621811e340 con 0x7f621813d1f0 2023-10-03T10:13:31.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.067+0000 7f621df72700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f621813d1f0 0x7f621813bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.067+0000 7f621df72700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f621813d1f0 0x7f621813bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41518/0 (socket says 172.21.15.72:41518) 2023-10-03T10:13:31.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.067+0000 7f621df72700 1 -- 172.21.15.72:0/2206952601 learned_addr learned my addr 172.21.15.72:0/2206952601 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:31.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.067+0000 7f621d771700 1 --2- 172.21.15.72:0/2206952601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f621806a770 0x7f6218071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.067+0000 7f621df72700 1 -- 172.21.15.72:0/2206952601 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f621809de00 msgr2=0x7f621813b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.067+0000 7f621df72700 1 --2- 172.21.15.72:0/2206952601 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f621809de00 0x7f621813b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.067+0000 7f621df72700 1 -- 172.21.15.72:0/2206952601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f621806a770 msgr2=0x7f6218071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.067+0000 7f621df72700 1 --2- 172.21.15.72:0/2206952601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f621806a770 0x7f6218071760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.067+0000 7f621df72700 1 -- 172.21.15.72:0/2206952601 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6210009a70 con 0x7f621813d1f0 2023-10-03T10:13:31.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.068+0000 7f621df72700 1 --2- 172.21.15.72:0/2206952601 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f621813d1f0 0x7f621813bb60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f621000b370 tx=0x7f6210004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.068+0000 7f620dffb700 1 -- 172.21.15.72:0/2206952601 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210004830 con 0x7f621813d1f0 2023-10-03T10:13:31.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.068+0000 7f620dffb700 1 -- 172.21.15.72:0/2206952601 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6210020070 con 0x7f621813d1f0 2023-10-03T10:13:31.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.068+0000 7f620dffb700 1 -- 172.21.15.72:0/2206952601 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62100276c0 con 0x7f621813d1f0 2023-10-03T10:13:31.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.068+0000 7f621f9d5700 1 -- 172.21.15.72:0/2206952601 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621811e9f0 con 0x7f621813d1f0 2023-10-03T10:13:31.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.068+0000 7f621f9d5700 1 -- 172.21.15.72:0/2206952601 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621811de80 con 0x7f621813d1f0 2023-10-03T10:13:31.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.069+0000 7f620dffb700 1 -- 172.21.15.72:0/2206952601 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6210012430 con 0x7f621813d1f0 2023-10-03T10:13:31.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.069+0000 7f621f9d5700 1 -- 172.21.15.72:0/2206952601 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6218074ea0 con 0x7f621813d1f0 2023-10-03T10:13:31.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.069+0000 7f620dffb700 1 -- 172.21.15.72:0/2206952601 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6210022070 con 0x7f621813d1f0 2023-10-03T10:13:31.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.078+0000 7f620dffb700 1 -- 172.21.15.72:0/2206952601 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f621001a970 con 0x7f621813d1f0 2023-10-03T10:13:31.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.155+0000 7f71f1f30700 1 -- 172.21.15.72:0/3746972769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f71ec074ea0 con 0x7f71ec09e000 2023-10-03T10:13:31.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.156+0000 7f71d3fff700 1 -- 172.21.15.72:0/3746972769 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71e0029090 con 0x7f71ec09e000 2023-10-03T10:13:31.158 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:31.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.159+0000 7f71f1f30700 1 -- 172.21.15.72:0/3746972769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71ec09e000 msgr2=0x7f71ec130700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.159+0000 7f71f1f30700 1 --2- 172.21.15.72:0/3746972769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71ec09e000 0x7f71ec130700 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f71e000b530 tx=0x7f71e000b840 comp rx=0 tx=0).stop 2023-10-03T10:13:31.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.159+0000 7f71f1f30700 1 -- 172.21.15.72:0/3746972769 shutdown_connections 2023-10-03T10:13:31.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.159+0000 7f71f1f30700 1 --2- 172.21.15.72:0/3746972769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71ec09e410 0x7f71ec130c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.159+0000 7f71f1f30700 1 --2- 172.21.15.72:0/3746972769 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71ec09d6f0 0x7f71ec1301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.159+0000 7f71f1f30700 1 --2- 172.21.15.72:0/3746972769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71ec09e000 0x7f71ec130700 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.159+0000 7f71f1f30700 1 -- 172.21.15.72:0/3746972769 >> 172.21.15.72:0/3746972769 conn(0x7f71ec066f50 msgr2=0x7f71ec0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.159+0000 7f71f1f30700 1 -- 172.21.15.72:0/3746972769 shutdown_connections 2023-10-03T10:13:31.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.159+0000 7f71f1f30700 1 -- 172.21.15.72:0/3746972769 wait complete. 2023-10-03T10:13:31.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:31.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.236+0000 7fcac9e4d700 1 -- 172.21.15.72:0/2144675744 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcac40713a0 con 0x7fcac412cf60 2023-10-03T10:13:31.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.237+0000 7fcaabfff700 1 -- 172.21.15.72:0/2144675744 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcab8015030 con 0x7fcac412cf60 2023-10-03T10:13:31.238 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:31.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.239+0000 7fcac9e4d700 1 -- 172.21.15.72:0/2144675744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcac412cf60 msgr2=0x7fcac409a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.239+0000 7fcac9e4d700 1 --2- 172.21.15.72:0/2144675744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcac412cf60 0x7fcac409a290 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcac4070520 tx=0x7fcab8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.239+0000 7fcac9e4d700 1 -- 172.21.15.72:0/2144675744 shutdown_connections 2023-10-03T10:13:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.239+0000 7fcac9e4d700 1 --2- 172.21.15.72:0/2144675744 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcac4135c20 0x7fcac409a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.239+0000 7fcac9e4d700 1 --2- 172.21.15.72:0/2144675744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcac406f5d0 0x7fcac4099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.239+0000 7fcac9e4d700 1 --2- 172.21.15.72:0/2144675744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcac412cf60 0x7fcac409a290 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.239+0000 7fcac9e4d700 1 -- 172.21.15.72:0/2144675744 >> 172.21.15.72:0/2144675744 conn(0x7fcac40a2aa0 msgr2=0x7fcac412f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.239+0000 7fcac9e4d700 1 -- 172.21.15.72:0/2144675744 shutdown_connections 2023-10-03T10:13:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.239+0000 7fcac9e4d700 1 -- 172.21.15.72:0/2144675744 wait complete. 2023-10-03T10:13:31.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:31.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.261+0000 7f6c09209700 1 -- 172.21.15.72:0/1906968404 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6c0406b9e0 con 0x7f6c0409e930 2023-10-03T10:13:31.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.262+0000 7f6beb7fe700 1 -- 172.21.15.72:0/1906968404 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6bf8017070 con 0x7f6c0409e930 2023-10-03T10:13:31.263 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:31.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.264+0000 7f6c09209700 1 -- 172.21.15.72:0/1906968404 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c0409e930 msgr2=0x7f6c0411f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.264+0000 7f6c09209700 1 --2- 172.21.15.72:0/1906968404 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c0409e930 0x7f6c0411f080 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8000f60 tx=0x7f6bf800c730 comp rx=0 tx=0).stop 2023-10-03T10:13:31.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.264+0000 7f6c09209700 1 -- 172.21.15.72:0/1906968404 shutdown_connections 2023-10-03T10:13:31.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.264+0000 7f6c09209700 1 --2- 172.21.15.72:0/1906968404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0409de50 0x7f6c0411eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.264+0000 7f6c09209700 1 --2- 172.21.15.72:0/1906968404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c041338a0 0x7f6c0411f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.264+0000 7f6c09209700 1 --2- 172.21.15.72:0/1906968404 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c0409e930 0x7f6c0411f080 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.264+0000 7f6c09209700 1 -- 172.21.15.72:0/1906968404 >> 172.21.15.72:0/1906968404 conn(0x7f6c040a2aa0 msgr2=0x7f6c0409ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.264+0000 7f6c09209700 1 -- 172.21.15.72:0/1906968404 shutdown_connections 2023-10-03T10:13:31.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.264+0000 7f6c09209700 1 -- 172.21.15.72:0/1906968404 wait complete. 2023-10-03T10:13:31.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.273+0000 7f621f9d5700 1 -- 172.21.15.72:0/2206952601 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f621811ebf0 con 0x7f621813d1f0 2023-10-03T10:13:31.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.273+0000 7f620dffb700 1 -- 172.21.15.72:0/2206952601 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f621002c020 con 0x7f621813d1f0 2023-10-03T10:13:31.274 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:31.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.275+0000 7f621f9d5700 1 -- 172.21.15.72:0/2206952601 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f621813d1f0 msgr2=0x7f621813bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.275+0000 7f621f9d5700 1 --2- 172.21.15.72:0/2206952601 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f621813d1f0 0x7f621813bb60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f621000b370 tx=0x7f6210004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.275+0000 7f621f9d5700 1 -- 172.21.15.72:0/2206952601 shutdown_connections 2023-10-03T10:13:31.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.275+0000 7f621f9d5700 1 --2- 172.21.15.72:0/2206952601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f621806a770 0x7f6218071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.275+0000 7f621f9d5700 1 --2- 172.21.15.72:0/2206952601 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f621813d1f0 0x7f621813bb60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.275+0000 7f621f9d5700 1 --2- 172.21.15.72:0/2206952601 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f621809de00 0x7f621813b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.275+0000 7f621f9d5700 1 -- 172.21.15.72:0/2206952601 >> 172.21.15.72:0/2206952601 conn(0x7f6218066f50 msgr2=0x7f621809b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.276+0000 7f621f9d5700 1 -- 172.21.15.72:0/2206952601 shutdown_connections 2023-10-03T10:13:31.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:31.276+0000 7f621f9d5700 1 -- 172.21.15.72:0/2206952601 wait complete. 2023-10-03T10:13:31.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:31.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:32.173 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:32.253 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:32.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:32.289 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:32.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.303+0000 7f2e6f98b700 1 Processor -- start 2023-10-03T10:13:32.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.303+0000 7f2e6f98b700 1 -- start start 2023-10-03T10:13:32.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.304+0000 7f2e6f98b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e6809d6f0 0x7f2e6809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.304+0000 7f2e6f98b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e6809e000 0x7f2e68130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.304+0000 7f2e6f98b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6809f130 con 0x7f2e6809e410 2023-10-03T10:13:32.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.304+0000 7f2e6f98b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6809f520 con 0x7f2e6809e000 2023-10-03T10:13:32.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.304+0000 7f2e6f98b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6809e930 con 0x7f2e6809d6f0 2023-10-03T10:13:32.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.304+0000 7f2e6d727700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e6809d6f0 0x7f2e6809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.304+0000 7f2e6d727700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e6809d6f0 0x7f2e6809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50566/0 (socket says 172.21.15.72:50566) 2023-10-03T10:13:32.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.304+0000 7f2e6d727700 1 -- 172.21.15.72:0/84602963 learned_addr learned my addr 172.21.15.72:0/84602963 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:32.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.304+0000 7f2e6cf26700 1 --2- 172.21.15.72:0/84602963 >> v2:172.21.15.72:3300/0 conn(0x7f2e6809e000 0x7f2e68130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.304+0000 7f2e6cf26700 1 -- 172.21.15.72:0/84602963 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e6809d6f0 msgr2=0x7f2e6809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.304+0000 7f2e6cf26700 1 --2- 172.21.15.72:0/84602963 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e6809d6f0 0x7f2e6809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.304+0000 7f2e6cf26700 1 -- 172.21.15.72:0/84602963 >> v1:172.21.15.72:6789/0 conn(0x7f2e6809e410 legacy=0x7f2e68130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.304+0000 7f2e6cf26700 1 -- 172.21.15.72:0/84602963 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6809b2d0 con 0x7f2e6809e000 2023-10-03T10:13:32.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.304+0000 7f2e6d727700 1 --2- 172.21.15.72:0/84602963 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e6809d6f0 0x7f2e6809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.305+0000 7f2e6cf26700 1 --2- 172.21.15.72:0/84602963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e6809e000 0x7f2e68130660 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800dc60 tx=0x7f2e5800df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1aa567ee5826f15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.305+0000 7f2e5ffff700 1 -- 172.21.15.72:0/84602963 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58012070 con 0x7f2e6809e000 2023-10-03T10:13:32.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.305+0000 7f2e5ffff700 1 -- 172.21.15.72:0/84602963 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5800d2e0 con 0x7f2e6809e000 2023-10-03T10:13:32.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.305+0000 7f2e5ffff700 1 -- 172.21.15.72:0/84602963 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800f900 con 0x7f2e6809e000 2023-10-03T10:13:32.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.305+0000 7f2e6f98b700 1 -- 172.21.15.72:0/84602963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e6809e000 msgr2=0x7f2e68130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.305+0000 7f2e6f98b700 1 --2- 172.21.15.72:0/84602963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e6809e000 0x7f2e68130660 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800dc60 tx=0x7f2e5800df70 comp rx=0 tx=0).stop 2023-10-03T10:13:32.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.305+0000 7f2e6f98b700 1 -- 172.21.15.72:0/84602963 shutdown_connections 2023-10-03T10:13:32.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.306+0000 7f2e6f98b700 1 --2- 172.21.15.72:0/84602963 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e6809d6f0 0x7f2e6809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.306+0000 7f2e6f98b700 1 --2- 172.21.15.72:0/84602963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e6809e000 0x7f2e68130660 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.306+0000 7f2e6f98b700 1 -- 172.21.15.72:0/84602963 >> 172.21.15.72:0/84602963 conn(0x7f2e68066f50 msgr2=0x7f2e6809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.306+0000 7f2e6f98b700 1 -- 172.21.15.72:0/84602963 shutdown_connections 2023-10-03T10:13:32.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.306+0000 7f2e6f98b700 1 -- 172.21.15.72:0/84602963 wait complete. 2023-10-03T10:13:32.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.307+0000 7f2e6f98b700 1 Processor -- start 2023-10-03T10:13:32.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.307+0000 7f2e6f98b700 1 -- start start 2023-10-03T10:13:32.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.307+0000 7f2e6f98b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e6809d6f0 0x7f2e6811dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.307+0000 7f2e6f98b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e6809e000 0x7f2e6811e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.307+0000 7f2e6f98b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e6809e410 0x7f2e6811ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.307+0000 7f2e6f98b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e68130380 con 0x7f2e6809e000 2023-10-03T10:13:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.307+0000 7f2e6f98b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e68120e00 con 0x7f2e6809d6f0 2023-10-03T10:13:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.307+0000 7f2e6f98b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e681217e0 con 0x7f2e6809e410 2023-10-03T10:13:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.308+0000 7f2e6cf26700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e6809e000 0x7f2e6811e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.308+0000 7f2e6cf26700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e6809e000 0x7f2e6811e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51618/0 (socket says 172.21.15.72:51618) 2023-10-03T10:13:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.308+0000 7f2e6cf26700 1 -- 172.21.15.72:0/630072331 learned_addr learned my addr 172.21.15.72:0/630072331 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.308+0000 7f2e6cf26700 1 -- 172.21.15.72:0/630072331 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e6809e410 msgr2=0x7f2e6811ea20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.308+0000 7f2e6cf26700 1 --2- 172.21.15.72:0/630072331 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e6809e410 0x7f2e6811ea20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.308+0000 7f2e6cf26700 1 -- 172.21.15.72:0/630072331 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e6809d6f0 msgr2=0x7f2e6811dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.308+0000 7f2e6cf26700 1 --2- 172.21.15.72:0/630072331 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e6809d6f0 0x7f2e6811dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.308+0000 7f2e6cf26700 1 -- 172.21.15.72:0/630072331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e64009550 con 0x7f2e6809e000 2023-10-03T10:13:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.308+0000 7f2e6cf26700 1 --2- 172.21.15.72:0/630072331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e6809e000 0x7f2e6811e4e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2e58016000 tx=0x7f2e58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.308+0000 7f2e5dffb700 1 -- 172.21.15.72:0/630072331 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580045d0 con 0x7f2e6809e000 2023-10-03T10:13:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.309+0000 7f2e5dffb700 1 -- 172.21.15.72:0/630072331 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e580038b0 con 0x7f2e6809e000 2023-10-03T10:13:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.309+0000 7f2e5dffb700 1 -- 172.21.15.72:0/630072331 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58003c60 con 0x7f2e6809e000 2023-10-03T10:13:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.309+0000 7f2e6f98b700 1 -- 172.21.15.72:0/630072331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5800d940 con 0x7f2e6809e000 2023-10-03T10:13:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.310+0000 7f2e6f98b700 1 -- 172.21.15.72:0/630072331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e68121250 con 0x7f2e6809e000 2023-10-03T10:13:32.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.311+0000 7f2e5dffb700 1 -- 172.21.15.72:0/630072331 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e5800b450 con 0x7f2e6809e000 2023-10-03T10:13:32.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.311+0000 7f2e6f98b700 1 -- 172.21.15.72:0/630072331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e680a1e20 con 0x7f2e6809e000 2023-10-03T10:13:32.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.311+0000 7f2e5dffb700 1 -- 172.21.15.72:0/630072331 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2e58044aa0 con 0x7f2e6809e000 2023-10-03T10:13:32.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.317+0000 7f2e5dffb700 1 -- 172.21.15.72:0/630072331 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e580157a0 con 0x7f2e6809e000 2023-10-03T10:13:32.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.393+0000 7f8c57a47700 1 Processor -- start 2023-10-03T10:13:32.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.393+0000 7f8c57a47700 1 -- start start 2023-10-03T10:13:32.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c57a47700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c501338a0 0x7f8c50133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c57a47700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c5009de50 0x7f8c5009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c57a47700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8c5009e760 0x7f8c5013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c57a47700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c5006fef0 con 0x7f8c5009e760 2023-10-03T10:13:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c57a47700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5006ef30 con 0x7f8c5009de50 2023-10-03T10:13:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c57a47700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c501334b0 con 0x7f8c501338a0 2023-10-03T10:13:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c54fe2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c5009de50 0x7f8c5009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c557e3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c501338a0 0x7f8c50133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c54fe2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c5009de50 0x7f8c5009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50578/0 (socket says 172.21.15.72:50578) 2023-10-03T10:13:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c54fe2700 1 -- 172.21.15.72:0/3043804727 learned_addr learned my addr 172.21.15.72:0/3043804727 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c55fe4700 1 --2- 172.21.15.72:0/3043804727 >> v2:172.21.15.72:3300/0 conn(0x7f8c5009e760 0x7f8c5013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c54fe2700 1 -- 172.21.15.72:0/3043804727 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c501338a0 msgr2=0x7f8c50133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c54fe2700 1 --2- 172.21.15.72:0/3043804727 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c501338a0 0x7f8c50133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c54fe2700 1 -- 172.21.15.72:0/3043804727 >> v2:172.21.15.72:3300/0 conn(0x7f8c5009e760 msgr2=0x7f8c5013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c54fe2700 1 --2- 172.21.15.72:0/3043804727 >> v2:172.21.15.72:3300/0 conn(0x7f8c5009e760 0x7f8c5013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c54fe2700 1 -- 172.21.15.72:0/3043804727 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5006fc30 con 0x7f8c5009de50 2023-10-03T10:13:32.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.394+0000 7f8c55fe4700 1 --2- 172.21.15.72:0/3043804727 >> v2:172.21.15.72:3300/0 conn(0x7f8c5009e760 0x7f8c5013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.395+0000 7f8c54fe2700 1 --2- 172.21.15.72:0/3043804727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c5009de50 0x7f8c5009e220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009920 tx=0x7f8c40009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e637d6e11f2e2cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.395+0000 7f8c47fff700 1 -- 172.21.15.72:0/3043804727 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40011830 con 0x7f8c5009de50 2023-10-03T10:13:32.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.395+0000 7f8c47fff700 1 -- 172.21.15.72:0/3043804727 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c40011990 con 0x7f8c5009de50 2023-10-03T10:13:32.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.395+0000 7f8c47fff700 1 -- 172.21.15.72:0/3043804727 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40011d20 con 0x7f8c5009de50 2023-10-03T10:13:32.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.395+0000 7f8c57a47700 1 -- 172.21.15.72:0/3043804727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c5009de50 msgr2=0x7f8c5009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.395+0000 7f8c57a47700 1 --2- 172.21.15.72:0/3043804727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c5009de50 0x7f8c5009e220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009920 tx=0x7f8c40009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.396+0000 7f8c57a47700 1 -- 172.21.15.72:0/3043804727 shutdown_connections 2023-10-03T10:13:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.396+0000 7f8c57a47700 1 --2- 172.21.15.72:0/3043804727 >> v2:172.21.15.72:3300/0 conn(0x7f8c5009e760 0x7f8c5013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.396+0000 7f8c57a47700 1 --2- 172.21.15.72:0/3043804727 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c501338a0 0x7f8c50133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.396+0000 7f8c57a47700 1 --2- 172.21.15.72:0/3043804727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c5009de50 0x7f8c5009e220 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.396+0000 7f8c57a47700 1 -- 172.21.15.72:0/3043804727 >> 172.21.15.72:0/3043804727 conn(0x7f8c500a2aa0 msgr2=0x7f8c500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.396+0000 7f8c57a47700 1 -- 172.21.15.72:0/3043804727 shutdown_connections 2023-10-03T10:13:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.396+0000 7f8c57a47700 1 -- 172.21.15.72:0/3043804727 wait complete. 2023-10-03T10:13:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.397+0000 7f8c57a47700 1 Processor -- start 2023-10-03T10:13:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.397+0000 7f8c57a47700 1 -- start start 2023-10-03T10:13:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c57a47700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c5009de50 0x7f8c5011ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c57a47700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c5009e760 0x7f8c5011efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c57a47700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c501338a0 0x7f8c5011f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c57a47700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5011fec0 con 0x7f8c501338a0 2023-10-03T10:13:32.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c57a47700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c500a1110 con 0x7f8c5009e760 2023-10-03T10:13:32.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c57a47700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c50120780 con 0x7f8c5009de50 2023-10-03T10:13:32.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c55fe4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c501338a0 0x7f8c5011f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c54fe2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c5009e760 0x7f8c5011efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c55fe4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c501338a0 0x7f8c5011f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51646/0 (socket says 172.21.15.72:51646) 2023-10-03T10:13:32.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c55fe4700 1 -- 172.21.15.72:0/379641150 learned_addr learned my addr 172.21.15.72:0/379641150 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:32.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c557e3700 1 --2- 172.21.15.72:0/379641150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c5009de50 0x7f8c5011ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c55fe4700 1 -- 172.21.15.72:0/379641150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c5009de50 msgr2=0x7f8c5011ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c55fe4700 1 --2- 172.21.15.72:0/379641150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c5009de50 0x7f8c5011ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c55fe4700 1 -- 172.21.15.72:0/379641150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c5009e760 msgr2=0x7f8c5011efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c55fe4700 1 --2- 172.21.15.72:0/379641150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c5009e760 0x7f8c5011efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c55fe4700 1 -- 172.21.15.72:0/379641150 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c48009a70 con 0x7f8c501338a0 2023-10-03T10:13:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.398+0000 7f8c54fe2700 1 --2- 172.21.15.72:0/379641150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c5009e760 0x7f8c5011efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.399+0000 7f8c55fe4700 1 --2- 172.21.15.72:0/379641150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c501338a0 0x7f8c5011f4e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009f00 tx=0x7f8c4800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.399+0000 7f8c45ffb700 1 -- 172.21.15.72:0/379641150 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48009d70 con 0x7f8c501338a0 2023-10-03T10:13:32.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.399+0000 7f8c45ffb700 1 -- 172.21.15.72:0/379641150 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4800f040 con 0x7f8c501338a0 2023-10-03T10:13:32.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.399+0000 7f8c57a47700 1 -- 172.21.15.72:0/379641150 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c40009550 con 0x7f8c501338a0 2023-10-03T10:13:32.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.399+0000 7f8c45ffb700 1 -- 172.21.15.72:0/379641150 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4800cd70 con 0x7f8c501338a0 2023-10-03T10:13:32.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.399+0000 7f8c57a47700 1 -- 172.21.15.72:0/379641150 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5012f580 con 0x7f8c501338a0 2023-10-03T10:13:32.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.400+0000 7f8c57a47700 1 -- 172.21.15.72:0/379641150 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c50074ea0 con 0x7f8c501338a0 2023-10-03T10:13:32.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.401+0000 7f8c45ffb700 1 -- 172.21.15.72:0/379641150 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c48003a20 con 0x7f8c501338a0 2023-10-03T10:13:32.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.401+0000 7f8c45ffb700 1 -- 172.21.15.72:0/379641150 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c48040890 con 0x7f8c501338a0 2023-10-03T10:13:32.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.405+0000 7f8c45ffb700 1 -- 172.21.15.72:0/379641150 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c4801c7c0 con 0x7f8c501338a0 2023-10-03T10:13:32.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.428+0000 7f899cae9700 1 Processor -- start 2023-10-03T10:13:32.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.428+0000 7f899cae9700 1 -- start start 2023-10-03T10:13:32.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f3e16049700 1 Processor -- start 2023-10-03T10:13:32.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f899cae9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f899809d6f0 0x7f899809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f899cae9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f899809e000 0x7f8998130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f899cae9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899809f130 con 0x7f899809e410 2023-10-03T10:13:32.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f899cae9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899809f520 con 0x7f899809e000 2023-10-03T10:13:32.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f899cae9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f899809e930 con 0x7f899809d6f0 2023-10-03T10:13:32.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f899659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f899809d6f0 0x7f899809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f899659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f899809d6f0 0x7f899809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41542/0 (socket says 172.21.15.72:41542) 2023-10-03T10:13:32.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f899659c700 1 -- 172.21.15.72:0/4271155800 learned_addr learned my addr 172.21.15.72:0/4271155800 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:32.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f3e16049700 1 -- start start 2023-10-03T10:13:32.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f3e16049700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e1009e1d0 0x7f3e10135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f3e16049700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e10135e50 0x7f3e10138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f3e16049700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1009f130 con 0x7f3e1009d6f0 2023-10-03T10:13:32.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f3e16049700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1009f520 con 0x7f3e10135e50 2023-10-03T10:13:32.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f3e16049700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1009e930 con 0x7f3e1009e1d0 2023-10-03T10:13:32.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.429+0000 7f3e0effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e1009e1d0 0x7f3e10135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f3e0effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e1009e1d0 0x7f3e10135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41558/0 (socket says 172.21.15.72:41558) 2023-10-03T10:13:32.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f3e0effd700 1 -- 172.21.15.72:0/3016178498 learned_addr learned my addr 172.21.15.72:0/3016178498 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:32.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f3e0ffff700 1 --2- 172.21.15.72:0/3016178498 >> v2:172.21.15.72:3300/0 conn(0x7f3e10135e50 0x7f3e10138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f899659c700 1 -- 172.21.15.72:0/4271155800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f899809e000 msgr2=0x7f8998130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f899659c700 1 --2- 172.21.15.72:0/4271155800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f899809e000 0x7f8998130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f899659c700 1 -- 172.21.15.72:0/4271155800 >> v1:172.21.15.72:6789/0 conn(0x7f899809e410 legacy=0x7f8998130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f899659c700 1 -- 172.21.15.72:0/4271155800 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899809b2d0 con 0x7f899809d6f0 2023-10-03T10:13:32.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f3e0effd700 1 -- 172.21.15.72:0/3016178498 >> v2:172.21.15.72:3300/0 conn(0x7f3e10135e50 msgr2=0x7f3e10138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f3e0effd700 1 --2- 172.21.15.72:0/3016178498 >> v2:172.21.15.72:3300/0 conn(0x7f3e10135e50 0x7f3e10138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f3e0effd700 1 -- 172.21.15.72:0/3016178498 >> v1:172.21.15.72:6789/0 conn(0x7f3e1009d6f0 legacy=0x7f3e1009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f3e0effd700 1 -- 172.21.15.72:0/3016178498 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1009b2d0 con 0x7f3e1009e1d0 2023-10-03T10:13:32.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f3e0ffff700 1 --2- 172.21.15.72:0/3016178498 >> v2:172.21.15.72:3300/0 conn(0x7f3e10135e50 0x7f3e10138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f899659c700 1 --2- 172.21.15.72:0/4271155800 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f899809d6f0 0x7f899809dac0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f898800bbf0 tx=0x7f898800bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53db599d7c44dca4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f3e0effd700 1 --2- 172.21.15.72:0/3016178498 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e1009e1d0 0x7f3e10135910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400b9d0 tx=0x7f3e0400bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a719d24c843c5a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f3e0e7fc700 1 -- 172.21.15.72:0/3016178498 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0400cbe0 con 0x7f3e1009e1d0 2023-10-03T10:13:32.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f3e0e7fc700 1 -- 172.21.15.72:0/3016178498 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0400cd40 con 0x7f3e1009e1d0 2023-10-03T10:13:32.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.430+0000 7f3e0e7fc700 1 -- 172.21.15.72:0/3016178498 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04004230 con 0x7f3e1009e1d0 2023-10-03T10:13:32.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f899559a700 1 -- 172.21.15.72:0/4271155800 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898800dda0 con 0x7f899809d6f0 2023-10-03T10:13:32.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f899559a700 1 -- 172.21.15.72:0/4271155800 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8988010470 con 0x7f899809d6f0 2023-10-03T10:13:32.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f899559a700 1 -- 172.21.15.72:0/4271155800 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988010800 con 0x7f899809d6f0 2023-10-03T10:13:32.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f3e16049700 1 -- 172.21.15.72:0/3016178498 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e1009e1d0 msgr2=0x7f3e10135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f3e16049700 1 --2- 172.21.15.72:0/3016178498 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e1009e1d0 0x7f3e10135910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400b9d0 tx=0x7f3e0400bce0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f3e16049700 1 -- 172.21.15.72:0/3016178498 shutdown_connections 2023-10-03T10:13:32.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f3e16049700 1 --2- 172.21.15.72:0/3016178498 >> v2:172.21.15.72:3300/0 conn(0x7f3e10135e50 0x7f3e10138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f3e16049700 1 --2- 172.21.15.72:0/3016178498 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e1009e1d0 0x7f3e10135910 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f3e16049700 1 -- 172.21.15.72:0/3016178498 >> 172.21.15.72:0/3016178498 conn(0x7f3e10066f50 msgr2=0x7f3e1009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f3e16049700 1 -- 172.21.15.72:0/3016178498 shutdown_connections 2023-10-03T10:13:32.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f899cae9700 1 -- 172.21.15.72:0/4271155800 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f899809d6f0 msgr2=0x7f899809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f899cae9700 1 --2- 172.21.15.72:0/4271155800 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f899809d6f0 0x7f899809dac0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f898800bbf0 tx=0x7f898800bf00 comp rx=0 tx=0).stop 2023-10-03T10:13:32.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f3e16049700 1 -- 172.21.15.72:0/3016178498 wait complete. 2023-10-03T10:13:32.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f899cae9700 1 -- 172.21.15.72:0/4271155800 shutdown_connections 2023-10-03T10:13:32.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f899cae9700 1 --2- 172.21.15.72:0/4271155800 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f899809d6f0 0x7f899809dac0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f899cae9700 1 --2- 172.21.15.72:0/4271155800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f899809e000 0x7f8998130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.431+0000 7f899cae9700 1 -- 172.21.15.72:0/4271155800 >> 172.21.15.72:0/4271155800 conn(0x7f8998066f50 msgr2=0x7f899809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.432+0000 7f3e16049700 1 Processor -- start 2023-10-03T10:13:32.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.432+0000 7f899cae9700 1 -- 172.21.15.72:0/4271155800 shutdown_connections 2023-10-03T10:13:32.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.432+0000 7f3e16049700 1 -- start start 2023-10-03T10:13:32.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e16049700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1009d6f0 0x7f3e10119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e16049700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1009e1d0 0x7f3e101199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e16049700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e10135e50 0x7f3e10119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e16049700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1012fd90 con 0x7f3e1009d6f0 2023-10-03T10:13:32.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e16049700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1011cb90 con 0x7f3e1009e1d0 2023-10-03T10:13:32.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e16049700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1011b070 con 0x7f3e10135e50 2023-10-03T10:13:32.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e0f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1009d6f0 0x7f3e10119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e0f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1009d6f0 0x7f3e10119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51670/0 (socket says 172.21.15.72:51670) 2023-10-03T10:13:32.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e0f7fe700 1 -- 172.21.15.72:0/3199287058 learned_addr learned my addr 172.21.15.72:0/3199287058 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:32.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e0effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1009e1d0 0x7f3e101199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e0ffff700 1 --2- 172.21.15.72:0/3199287058 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e10135e50 0x7f3e10119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e0effd700 1 -- 172.21.15.72:0/3199287058 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e10135e50 msgr2=0x7f3e10119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e0effd700 1 --2- 172.21.15.72:0/3199287058 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e10135e50 0x7f3e10119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e0effd700 1 -- 172.21.15.72:0/3199287058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1009d6f0 msgr2=0x7f3e10119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e0effd700 1 --2- 172.21.15.72:0/3199287058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1009d6f0 0x7f3e10119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e0effd700 1 -- 172.21.15.72:0/3199287058 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0800f050 con 0x7f3e1009e1d0 2023-10-03T10:13:32.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f3e0ffff700 1 --2- 172.21.15.72:0/3199287058 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e10135e50 0x7f3e10119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.433+0000 7f899cae9700 1 -- 172.21.15.72:0/4271155800 wait complete. 2023-10-03T10:13:32.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.434+0000 7f3e0effd700 1 --2- 172.21.15.72:0/3199287058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1009e1d0 0x7f3e101199c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3e1009f6f0 tx=0x7f3e04004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.434+0000 7f3df7fff700 1 -- 172.21.15.72:0/3199287058 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0401d070 con 0x7f3e1009e1d0 2023-10-03T10:13:32.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.434+0000 7f3df7fff700 1 -- 172.21.15.72:0/3199287058 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0400ceb0 con 0x7f3e1009e1d0 2023-10-03T10:13:32.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.434+0000 7f3e16049700 1 -- 172.21.15.72:0/3199287058 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0400b600 con 0x7f3e1009e1d0 2023-10-03T10:13:32.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.434+0000 7f3df7fff700 1 -- 172.21.15.72:0/3199287058 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04003ad0 con 0x7f3e1009e1d0 2023-10-03T10:13:32.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.434+0000 7f899cae9700 1 Processor -- start 2023-10-03T10:13:32.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.434+0000 7f3e16049700 1 -- 172.21.15.72:0/3199287058 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1011b710 con 0x7f3e1009e1d0 2023-10-03T10:13:32.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.435+0000 7f3e16049700 1 -- 172.21.15.72:0/3199287058 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e10074ea0 con 0x7f3e1009e1d0 2023-10-03T10:13:32.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.435+0000 7f899cae9700 1 -- start start 2023-10-03T10:13:32.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.435+0000 7f899cae9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f899809d6f0 0x7f899811e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.435+0000 7f899cae9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f899809e000 0x7f899811e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.435+0000 7f3df7fff700 1 -- 172.21.15.72:0/3199287058 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e04003c30 con 0x7f3e1009e1d0 2023-10-03T10:13:32.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f899659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f899809d6f0 0x7f899811e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f899659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f899809d6f0 0x7f899811e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50622/0 (socket says 172.21.15.72:50622) 2023-10-03T10:13:32.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f8995d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f899809e000 0x7f899811e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f899cae9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f899809e410 0x7f899811eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f899cae9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8998121ce0 con 0x7f899809e000 2023-10-03T10:13:32.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f899cae9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89980a1e70 con 0x7f899809d6f0 2023-10-03T10:13:32.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f899cae9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f899809c700 con 0x7f899809e410 2023-10-03T10:13:32.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f8996d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f899809e410 0x7f899811eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f8995d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f899809e000 0x7f899811e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51676/0 (socket says 172.21.15.72:51676) 2023-10-03T10:13:32.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f8995d9b700 1 -- 172.21.15.72:0/771681763 learned_addr learned my addr 172.21.15.72:0/771681763 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:32.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f8995d9b700 1 -- 172.21.15.72:0/771681763 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f899809e410 msgr2=0x7f899811eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f8995d9b700 1 --2- 172.21.15.72:0/771681763 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f899809e410 0x7f899811eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f8995d9b700 1 -- 172.21.15.72:0/771681763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f899809d6f0 msgr2=0x7f899811e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f8995d9b700 1 --2- 172.21.15.72:0/771681763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f899809d6f0 0x7f899811e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f8995d9b700 1 -- 172.21.15.72:0/771681763 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898800b7f0 con 0x7f899809e000 2023-10-03T10:13:32.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.436+0000 7f8995d9b700 1 --2- 172.21.15.72:0/771681763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f899809e000 0x7f899811e660 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f898c00b500 tx=0x7f898c00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.437+0000 7f8986ffd700 1 -- 172.21.15.72:0/771681763 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c011830 con 0x7f899809e000 2023-10-03T10:13:32.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.437+0000 7f8986ffd700 1 -- 172.21.15.72:0/771681763 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c0119b0 con 0x7f899809e000 2023-10-03T10:13:32.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.437+0000 7f8986ffd700 1 -- 172.21.15.72:0/771681763 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c011d60 con 0x7f899809e000 2023-10-03T10:13:32.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.437+0000 7f899cae9700 1 -- 172.21.15.72:0/771681763 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899811f510 con 0x7f899809e000 2023-10-03T10:13:32.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.437+0000 7f899cae9700 1 -- 172.21.15.72:0/771681763 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89981202a0 con 0x7f899809e000 2023-10-03T10:13:32.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.438+0000 7f8986ffd700 1 -- 172.21.15.72:0/771681763 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f898c01a400 con 0x7f899809e000 2023-10-03T10:13:32.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.438+0000 7f8986ffd700 1 -- 172.21.15.72:0/771681763 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f898c03f6f0 con 0x7f899809e000 2023-10-03T10:13:32.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.439+0000 7f3df7fff700 1 -- 172.21.15.72:0/3199287058 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3e0400e3c0 con 0x7f3e1009e1d0 2023-10-03T10:13:32.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.441+0000 7f3df7fff700 1 -- 172.21.15.72:0/3199287058 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e04046060 con 0x7f3e1009e1d0 2023-10-03T10:13:32.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.441+0000 7f899cae9700 1 -- 172.21.15.72:0/771681763 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89981215b0 con 0x7f899809e000 2023-10-03T10:13:32.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.450+0000 7f8986ffd700 1 -- 172.21.15.72:0/771681763 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f898c01ae60 con 0x7f899809e000 2023-10-03T10:13:32.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.530+0000 7f2e6f98b700 1 -- 172.21.15.72:0/630072331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2e68074ea0 con 0x7f2e6809e000 2023-10-03T10:13:32.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.530+0000 7f2e5dffb700 1 -- 172.21.15.72:0/630072331 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e58017e20 con 0x7f2e6809e000 2023-10-03T10:13:32.531 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:32.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.532+0000 7f2e6f98b700 1 -- 172.21.15.72:0/630072331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e6809e000 msgr2=0x7f2e6811e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.532+0000 7f2e6f98b700 1 --2- 172.21.15.72:0/630072331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e6809e000 0x7f2e6811e4e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2e58016000 tx=0x7f2e58004750 comp rx=0 tx=0).stop 2023-10-03T10:13:32.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.533+0000 7f2e6f98b700 1 -- 172.21.15.72:0/630072331 shutdown_connections 2023-10-03T10:13:32.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.533+0000 7f2e6f98b700 1 --2- 172.21.15.72:0/630072331 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e6809e410 0x7f2e6811ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.533+0000 7f2e6f98b700 1 --2- 172.21.15.72:0/630072331 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e6809d6f0 0x7f2e6811dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.533+0000 7f2e6f98b700 1 --2- 172.21.15.72:0/630072331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e6809e000 0x7f2e6811e4e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.533+0000 7f2e6f98b700 1 -- 172.21.15.72:0/630072331 >> 172.21.15.72:0/630072331 conn(0x7f2e68066f50 msgr2=0x7f2e680a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.533+0000 7f2e6f98b700 1 -- 172.21.15.72:0/630072331 shutdown_connections 2023-10-03T10:13:32.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.533+0000 7f2e6f98b700 1 -- 172.21.15.72:0/630072331 wait complete. 2023-10-03T10:13:32.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:32.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.604+0000 7f8c57a47700 1 -- 172.21.15.72:0/379641150 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8c5006b9e0 con 0x7f8c501338a0 2023-10-03T10:13:32.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.605+0000 7f8c45ffb700 1 -- 172.21.15.72:0/379641150 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c480133e0 con 0x7f8c501338a0 2023-10-03T10:13:32.606 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:32.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.607+0000 7f8c57a47700 1 -- 172.21.15.72:0/379641150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c501338a0 msgr2=0x7f8c5011f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.607+0000 7f8c57a47700 1 --2- 172.21.15.72:0/379641150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c501338a0 0x7f8c5011f4e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009f00 tx=0x7f8c4800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.607+0000 7f8c57a47700 1 -- 172.21.15.72:0/379641150 shutdown_connections 2023-10-03T10:13:32.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.607+0000 7f8c57a47700 1 --2- 172.21.15.72:0/379641150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c501338a0 0x7f8c5011f4e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.607+0000 7f8c57a47700 1 --2- 172.21.15.72:0/379641150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c5009de50 0x7f8c5011ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.607+0000 7f8c57a47700 1 --2- 172.21.15.72:0/379641150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c5009e760 0x7f8c5011efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.607+0000 7f8c57a47700 1 -- 172.21.15.72:0/379641150 >> 172.21.15.72:0/379641150 conn(0x7f8c500a2aa0 msgr2=0x7f8c5009ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.607+0000 7f8c57a47700 1 -- 172.21.15.72:0/379641150 shutdown_connections 2023-10-03T10:13:32.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.607+0000 7f8c57a47700 1 -- 172.21.15.72:0/379641150 wait complete. 2023-10-03T10:13:32.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:32.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.636+0000 7f3e16049700 1 -- 172.21.15.72:0/3199287058 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3e1006c360 con 0x7f3e1009e1d0 2023-10-03T10:13:32.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.636+0000 7f3df7fff700 1 -- 172.21.15.72:0/3199287058 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3e04046030 con 0x7f3e1009e1d0 2023-10-03T10:13:32.637 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:32.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.638+0000 7f3e16049700 1 -- 172.21.15.72:0/3199287058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1009e1d0 msgr2=0x7f3e101199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.638+0000 7f3e16049700 1 --2- 172.21.15.72:0/3199287058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1009e1d0 0x7f3e101199c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3e1009f6f0 tx=0x7f3e04004750 comp rx=0 tx=0).stop 2023-10-03T10:13:32.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.638+0000 7f3e16049700 1 -- 172.21.15.72:0/3199287058 shutdown_connections 2023-10-03T10:13:32.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.638+0000 7f3e16049700 1 --2- 172.21.15.72:0/3199287058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1009d6f0 0x7f3e10119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.638+0000 7f3e16049700 1 --2- 172.21.15.72:0/3199287058 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e10135e50 0x7f3e10119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.638+0000 7f3e16049700 1 --2- 172.21.15.72:0/3199287058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e1009e1d0 0x7f3e101199c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.638+0000 7f3e16049700 1 -- 172.21.15.72:0/3199287058 >> 172.21.15.72:0/3199287058 conn(0x7f3e10066f50 msgr2=0x7f3e1006f510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.638+0000 7f3e16049700 1 -- 172.21.15.72:0/3199287058 shutdown_connections 2023-10-03T10:13:32.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.638+0000 7f3e16049700 1 -- 172.21.15.72:0/3199287058 wait complete. 2023-10-03T10:13:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.645+0000 7f899cae9700 1 -- 172.21.15.72:0/771681763 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8998074ea0 con 0x7f899809e000 2023-10-03T10:13:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.645+0000 7f8986ffd700 1 -- 172.21.15.72:0/771681763 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f898c0193b0 con 0x7f899809e000 2023-10-03T10:13:32.646 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.647+0000 7f899cae9700 1 -- 172.21.15.72:0/771681763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f899809e000 msgr2=0x7f899811e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.647+0000 7f899cae9700 1 --2- 172.21.15.72:0/771681763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f899809e000 0x7f899811e660 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f898c00b500 tx=0x7f898c00b810 comp rx=0 tx=0).stop 2023-10-03T10:13:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.647+0000 7f899cae9700 1 -- 172.21.15.72:0/771681763 shutdown_connections 2023-10-03T10:13:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.647+0000 7f899cae9700 1 --2- 172.21.15.72:0/771681763 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f899809e410 0x7f899811eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.647+0000 7f899cae9700 1 --2- 172.21.15.72:0/771681763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f899809d6f0 0x7f899811e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.647+0000 7f899cae9700 1 --2- 172.21.15.72:0/771681763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f899809e000 0x7f899811e660 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.647+0000 7f899cae9700 1 -- 172.21.15.72:0/771681763 >> 172.21.15.72:0/771681763 conn(0x7f8998066f50 msgr2=0x7f89980711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.647+0000 7f899cae9700 1 -- 172.21.15.72:0/771681763 shutdown_connections 2023-10-03T10:13:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:32.647+0000 7f899cae9700 1 -- 172.21.15.72:0/771681763 wait complete. 2023-10-03T10:13:32.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:32.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:33.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:33.620 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:33.652 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:33.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:33.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.685+0000 7f5835032700 1 Processor -- start 2023-10-03T10:13:33.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.685+0000 7f5835032700 1 -- start start 2023-10-03T10:13:33.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.685+0000 7f5835032700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583009d6f0 0x7f583009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.685+0000 7f5835032700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f583009e410 0x7f5830134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.685+0000 7f5835032700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583009b120 con 0x7f583009e000 2023-10-03T10:13:33.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.685+0000 7f5835032700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583006b460 con 0x7f583009e410 2023-10-03T10:13:33.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.685+0000 7f5835032700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f583009a7e0 con 0x7f583009d6f0 2023-10-03T10:13:33.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.686+0000 7f582ed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583009d6f0 0x7f583009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.686+0000 7f582ed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583009d6f0 0x7f583009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41574/0 (socket says 172.21.15.72:41574) 2023-10-03T10:13:33.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.686+0000 7f582ed9d700 1 -- 172.21.15.72:0/2143210004 learned_addr learned my addr 172.21.15.72:0/2143210004 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:33.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.686+0000 7f582f59e700 1 --2- 172.21.15.72:0/2143210004 >> v2:172.21.15.72:3300/0 conn(0x7f583009e410 0x7f5830134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.686+0000 7f582ed9d700 1 -- 172.21.15.72:0/2143210004 >> v2:172.21.15.72:3300/0 conn(0x7f583009e410 msgr2=0x7f5830134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:33.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.686+0000 7f582ed9d700 1 --2- 172.21.15.72:0/2143210004 >> v2:172.21.15.72:3300/0 conn(0x7f583009e410 0x7f5830134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.686+0000 7f582ed9d700 1 -- 172.21.15.72:0/2143210004 >> v1:172.21.15.72:6789/0 conn(0x7f583009e000 legacy=0x7f58301339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.686+0000 7f582ed9d700 1 -- 172.21.15.72:0/2143210004 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583009a500 con 0x7f583009d6f0 2023-10-03T10:13:33.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.686+0000 7f582ed9d700 1 --2- 172.21.15.72:0/2143210004 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583009d6f0 0x7f583009dac0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5820009920 tx=0x7f5820009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce1ae120d4fc5a71 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.686+0000 7f582dd9b700 1 -- 172.21.15.72:0/2143210004 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820011830 con 0x7f583009d6f0 2023-10-03T10:13:33.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.686+0000 7f582dd9b700 1 -- 172.21.15.72:0/2143210004 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820011990 con 0x7f583009d6f0 2023-10-03T10:13:33.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.686+0000 7f582dd9b700 1 -- 172.21.15.72:0/2143210004 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820011d20 con 0x7f583009d6f0 2023-10-03T10:13:33.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.687+0000 7f5835032700 1 -- 172.21.15.72:0/2143210004 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583009d6f0 msgr2=0x7f583009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.687+0000 7f5835032700 1 --2- 172.21.15.72:0/2143210004 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583009d6f0 0x7f583009dac0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5820009920 tx=0x7f5820009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:33.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.687+0000 7f5835032700 1 -- 172.21.15.72:0/2143210004 shutdown_connections 2023-10-03T10:13:33.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.687+0000 7f5835032700 1 --2- 172.21.15.72:0/2143210004 >> v2:172.21.15.72:3300/0 conn(0x7f583009e410 0x7f5830134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.687+0000 7f5835032700 1 --2- 172.21.15.72:0/2143210004 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583009d6f0 0x7f583009dac0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.687+0000 7f5835032700 1 -- 172.21.15.72:0/2143210004 >> 172.21.15.72:0/2143210004 conn(0x7f5830066f50 msgr2=0x7f583009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.687+0000 7f5835032700 1 -- 172.21.15.72:0/2143210004 shutdown_connections 2023-10-03T10:13:33.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.687+0000 7f5835032700 1 -- 172.21.15.72:0/2143210004 wait complete. 2023-10-03T10:13:33.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.688+0000 7f5835032700 1 Processor -- start 2023-10-03T10:13:33.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.688+0000 7f5835032700 1 -- start start 2023-10-03T10:13:33.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.689+0000 7f5835032700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583009d6f0 0x7f58301a8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.689+0000 7f5835032700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583009e000 0x7f58301a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.689+0000 7f5835032700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583009e410 0x7f58301a8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.689+0000 7f5835032700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58301ab880 con 0x7f583009e000 2023-10-03T10:13:33.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.689+0000 7f5835032700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583009c710 con 0x7f583009e410 2023-10-03T10:13:33.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.689+0000 7f5835032700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58301a9ba0 con 0x7f583009d6f0 2023-10-03T10:13:33.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.689+0000 7f582ed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583009d6f0 0x7f58301a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.689+0000 7f582ed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583009d6f0 0x7f58301a8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41584/0 (socket says 172.21.15.72:41584) 2023-10-03T10:13:33.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.689+0000 7f582ed9d700 1 -- 172.21.15.72:0/2775364724 learned_addr learned my addr 172.21.15.72:0/2775364724 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:33.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.689+0000 7f582e59c700 1 --2- 172.21.15.72:0/2775364724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583009e000 0x7f58301a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.689+0000 7f582f59e700 1 --2- 172.21.15.72:0/2775364724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583009e410 0x7f58301a8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.690+0000 7f582ed9d700 1 -- 172.21.15.72:0/2775364724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583009e410 msgr2=0x7f58301a8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.690+0000 7f582ed9d700 1 --2- 172.21.15.72:0/2775364724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583009e410 0x7f58301a8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.690+0000 7f582ed9d700 1 -- 172.21.15.72:0/2775364724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583009e000 msgr2=0x7f58301a85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.690+0000 7f582ed9d700 1 --2- 172.21.15.72:0/2775364724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583009e000 0x7f58301a85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.690+0000 7f582ed9d700 1 -- 172.21.15.72:0/2775364724 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5820009550 con 0x7f583009d6f0 2023-10-03T10:13:33.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.690+0000 7f582ed9d700 1 --2- 172.21.15.72:0/2775364724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583009d6f0 0x7f58301a8070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5820009c70 tx=0x7f5820004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.690+0000 7f58177fe700 1 -- 172.21.15.72:0/2775364724 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820004240 con 0x7f583009d6f0 2023-10-03T10:13:33.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.690+0000 7f58177fe700 1 -- 172.21.15.72:0/2775364724 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582001f070 con 0x7f583009d6f0 2023-10-03T10:13:33.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.690+0000 7f5835032700 1 -- 172.21.15.72:0/2775364724 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58301abae0 con 0x7f583009d6f0 2023-10-03T10:13:33.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.690+0000 7f58177fe700 1 -- 172.21.15.72:0/2775364724 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58200036a0 con 0x7f583009d6f0 2023-10-03T10:13:33.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.690+0000 7f5835032700 1 -- 172.21.15.72:0/2775364724 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58301aa290 con 0x7f583009d6f0 2023-10-03T10:13:33.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.692+0000 7f58177fe700 1 -- 172.21.15.72:0/2775364724 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5820021030 con 0x7f583009d6f0 2023-10-03T10:13:33.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.692+0000 7f58177fe700 1 -- 172.21.15.72:0/2775364724 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5820040a60 con 0x7f583009d6f0 2023-10-03T10:13:33.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.696+0000 7f5835032700 1 -- 172.21.15.72:0/2775364724 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5830074ea0 con 0x7f583009d6f0 2023-10-03T10:13:33.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.701+0000 7f58177fe700 1 -- 172.21.15.72:0/2775364724 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5820015020 con 0x7f583009d6f0 2023-10-03T10:13:33.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.761+0000 7f6e7346d700 1 Processor -- start 2023-10-03T10:13:33.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.761+0000 7f6e7346d700 1 -- start start 2023-10-03T10:13:33.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.762+0000 7f6e7346d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e6c09e930 0x7f6e6c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.762+0000 7f6e7346d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e6c09f240 0x7f6e6c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.762+0000 7f6e7346d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e6c070940 con 0x7f6e6c09f650 2023-10-03T10:13:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.762+0000 7f6e7346d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e6c06fd60 con 0x7f6e6c09f240 2023-10-03T10:13:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.762+0000 7f6e7346d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c06fa80 con 0x7f6e6c09e930 2023-10-03T10:13:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.762+0000 7f6e71209700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e6c09e930 0x7f6e6c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.762+0000 7f6e71209700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e6c09e930 0x7f6e6c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41598/0 (socket says 172.21.15.72:41598) 2023-10-03T10:13:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.762+0000 7f6e71209700 1 -- 172.21.15.72:0/206926676 learned_addr learned my addr 172.21.15.72:0/206926676 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.762+0000 7f6e70a08700 1 --2- 172.21.15.72:0/206926676 >> v2:172.21.15.72:3300/0 conn(0x7f6e6c09f240 0x7f6e6c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.763+0000 7f6e71209700 1 -- 172.21.15.72:0/206926676 >> v2:172.21.15.72:3300/0 conn(0x7f6e6c09f240 msgr2=0x7f6e6c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:33.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.763+0000 7f6e71209700 1 --2- 172.21.15.72:0/206926676 >> v2:172.21.15.72:3300/0 conn(0x7f6e6c09f240 0x7f6e6c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.763+0000 7f6e71209700 1 -- 172.21.15.72:0/206926676 >> v1:172.21.15.72:6789/0 conn(0x7f6e6c09f650 legacy=0x7f6e6c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.763+0000 7f6e71209700 1 -- 172.21.15.72:0/206926676 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c09fb60 con 0x7f6e6c09e930 2023-10-03T10:13:33.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.763+0000 7f6e71209700 1 --2- 172.21.15.72:0/206926676 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e6c09e930 0x7f6e6c09ed00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6e680098f0 tx=0x7f6e68009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87ab7d7af8ca8d43 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.763+0000 7f6e63fff700 1 -- 172.21.15.72:0/206926676 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68011830 con 0x7f6e6c09e930 2023-10-03T10:13:33.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.763+0000 7f6e63fff700 1 -- 172.21.15.72:0/206926676 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e68011990 con 0x7f6e6c09e930 2023-10-03T10:13:33.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.763+0000 7f6e63fff700 1 -- 172.21.15.72:0/206926676 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68011d20 con 0x7f6e6c09e930 2023-10-03T10:13:33.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.764+0000 7f6e7346d700 1 -- 172.21.15.72:0/206926676 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e6c09e930 msgr2=0x7f6e6c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.764+0000 7f6e7346d700 1 --2- 172.21.15.72:0/206926676 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e6c09e930 0x7f6e6c09ed00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6e680098f0 tx=0x7f6e68009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:33.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.764+0000 7f6e7346d700 1 -- 172.21.15.72:0/206926676 shutdown_connections 2023-10-03T10:13:33.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.764+0000 7f6e7346d700 1 --2- 172.21.15.72:0/206926676 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e6c09e930 0x7f6e6c09ed00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.764+0000 7f6e7346d700 1 --2- 172.21.15.72:0/206926676 >> v2:172.21.15.72:3300/0 conn(0x7f6e6c09f240 0x7f6e6c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.764+0000 7f6e7346d700 1 -- 172.21.15.72:0/206926676 >> 172.21.15.72:0/206926676 conn(0x7f6e6c0a4210 msgr2=0x7f6e6c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.764+0000 7f6e7346d700 1 -- 172.21.15.72:0/206926676 shutdown_connections 2023-10-03T10:13:33.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.764+0000 7f6e7346d700 1 -- 172.21.15.72:0/206926676 wait complete. 2023-10-03T10:13:33.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.765+0000 7f6e7346d700 1 Processor -- start 2023-10-03T10:13:33.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.765+0000 7f6e7346d700 1 -- start start 2023-10-03T10:13:33.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.765+0000 7f6e7346d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e6c09e930 0x7f6e6c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.765+0000 7f6e7346d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e6c09f240 0x7f6e6c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.765+0000 7f6e7346d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e6c09f650 0x7f6e6c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.765+0000 7f6e7346d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c1b72b0 con 0x7f6e6c09f650 2023-10-03T10:13:33.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.765+0000 7f6e7346d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c1a9460 con 0x7f6e6c09f240 2023-10-03T10:13:33.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.765+0000 7f6e7346d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c1a8980 con 0x7f6e6c09e930 2023-10-03T10:13:33.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.765+0000 7f6e71209700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e6c09e930 0x7f6e6c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.765+0000 7f6e71209700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e6c09e930 0x7f6e6c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41606/0 (socket says 172.21.15.72:41606) 2023-10-03T10:13:33.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.765+0000 7f6e71209700 1 -- 172.21.15.72:0/4266267857 learned_addr learned my addr 172.21.15.72:0/4266267857 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:33.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.765+0000 7f6e71a0a700 1 --2- 172.21.15.72:0/4266267857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e6c09f650 0x7f6e6c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.766+0000 7f6e70a08700 1 --2- 172.21.15.72:0/4266267857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e6c09f240 0x7f6e6c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.766+0000 7f6e71209700 1 -- 172.21.15.72:0/4266267857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e6c09f240 msgr2=0x7f6e6c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.766+0000 7f6e71209700 1 --2- 172.21.15.72:0/4266267857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e6c09f240 0x7f6e6c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.766+0000 7f6e71209700 1 -- 172.21.15.72:0/4266267857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e6c09f650 msgr2=0x7f6e6c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.766+0000 7f6e71209700 1 --2- 172.21.15.72:0/4266267857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e6c09f650 0x7f6e6c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.766+0000 7f6e71209700 1 -- 172.21.15.72:0/4266267857 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e68009550 con 0x7f6e6c09e930 2023-10-03T10:13:33.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.766+0000 7f6e71a0a700 1 --2- 172.21.15.72:0/4266267857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e6c09f650 0x7f6e6c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:33.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.766+0000 7f6e70a08700 1 --2- 172.21.15.72:0/4266267857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e6c09f240 0x7f6e6c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:33.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.766+0000 7f6e71209700 1 --2- 172.21.15.72:0/4266267857 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e6c09e930 0x7f6e6c06b8b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6e68000c00 tx=0x7f6e68004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.766+0000 7f6e61ffb700 1 -- 172.21.15.72:0/4266267857 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68004480 con 0x7f6e6c09e930 2023-10-03T10:13:33.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.766+0000 7f6e61ffb700 1 -- 172.21.15.72:0/4266267857 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6801f070 con 0x7f6e6c09e930 2023-10-03T10:13:33.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.766+0000 7f6e61ffb700 1 -- 172.21.15.72:0/4266267857 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e680038c0 con 0x7f6e6c09e930 2023-10-03T10:13:33.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.767+0000 7f6e7346d700 1 -- 172.21.15.72:0/4266267857 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6c0a0190 con 0x7f6e6c09e930 2023-10-03T10:13:33.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.767+0000 7f6e7346d700 1 -- 172.21.15.72:0/4266267857 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6c1a9190 con 0x7f6e6c09e930 2023-10-03T10:13:33.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.769+0000 7f6e7346d700 1 -- 172.21.15.72:0/4266267857 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6c1a0b30 con 0x7f6e6c09e930 2023-10-03T10:13:33.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.769+0000 7f6e61ffb700 1 -- 172.21.15.72:0/4266267857 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e68021030 con 0x7f6e6c09e930 2023-10-03T10:13:33.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.769+0000 7f6e61ffb700 1 -- 172.21.15.72:0/4266267857 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6e68040a30 con 0x7f6e6c09e930 2023-10-03T10:13:33.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.778+0000 7f6e61ffb700 1 -- 172.21.15.72:0/4266267857 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e680199a0 con 0x7f6e6c09e930 2023-10-03T10:13:33.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.807+0000 7fb2eb7b1700 1 Processor -- start 2023-10-03T10:13:33.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.807+0000 7fb2eb7b1700 1 -- start start 2023-10-03T10:13:33.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.808+0000 7fb2eb7b1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2e409e1d0 0x7fb2e4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.808+0000 7fb2eb7b1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2e4139170 0x7fb2e413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.808+0000 7fb2eb7b1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e409b120 con 0x7fb2e409d6f0 2023-10-03T10:13:33.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.808+0000 7fb2eb7b1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e406b460 con 0x7fb2e409e1d0 2023-10-03T10:13:33.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.808+0000 7fb2eb7b1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e409a7e0 con 0x7fb2e4139170 2023-10-03T10:13:33.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.808+0000 7fb2e8d4c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2e409e1d0 0x7fb2e4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.808+0000 7fb2e8d4c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2e409e1d0 0x7fb2e4138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51728/0 (socket says 172.21.15.72:51728) 2023-10-03T10:13:33.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.808+0000 7fb2e8d4c700 1 -- 172.21.15.72:0/4011471678 learned_addr learned my addr 172.21.15.72:0/4011471678 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:33.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.809+0000 7fb2e9d4e700 1 --2- 172.21.15.72:0/4011471678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2e4139170 0x7fb2e413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.809+0000 7fb2e8d4c700 1 -- 172.21.15.72:0/4011471678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2e4139170 msgr2=0x7fb2e413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:33.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.809+0000 7fb2e8d4c700 1 --2- 172.21.15.72:0/4011471678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2e4139170 0x7fb2e413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.809+0000 7fb2e8d4c700 1 -- 172.21.15.72:0/4011471678 >> v1:172.21.15.72:6789/0 conn(0x7fb2e409d6f0 legacy=0x7fb2e409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.809+0000 7fb2e8d4c700 1 -- 172.21.15.72:0/4011471678 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e409a500 con 0x7fb2e409e1d0 2023-10-03T10:13:33.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.809+0000 7fb2e8d4c700 1 --2- 172.21.15.72:0/4011471678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e409e1d0 0x7fb2e4138c30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009920 tx=0x7fb2d4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61701c2088ce6f16 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.809+0000 7fb2dbfff700 1 -- 172.21.15.72:0/4011471678 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4011830 con 0x7fb2e409e1d0 2023-10-03T10:13:33.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.809+0000 7fb2dbfff700 1 -- 172.21.15.72:0/4011471678 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d4011990 con 0x7fb2e409e1d0 2023-10-03T10:13:33.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.809+0000 7fb2dbfff700 1 -- 172.21.15.72:0/4011471678 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4011d20 con 0x7fb2e409e1d0 2023-10-03T10:13:33.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.810+0000 7fb2eb7b1700 1 -- 172.21.15.72:0/4011471678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e409e1d0 msgr2=0x7fb2e4138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.810+0000 7fb2eb7b1700 1 --2- 172.21.15.72:0/4011471678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e409e1d0 0x7fb2e4138c30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009920 tx=0x7fb2d4009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:33.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.810+0000 7fb2eb7b1700 1 -- 172.21.15.72:0/4011471678 shutdown_connections 2023-10-03T10:13:33.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.810+0000 7fb2eb7b1700 1 --2- 172.21.15.72:0/4011471678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2e4139170 0x7fb2e413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.810+0000 7fb2eb7b1700 1 --2- 172.21.15.72:0/4011471678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e409e1d0 0x7fb2e4138c30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.810+0000 7fb2eb7b1700 1 -- 172.21.15.72:0/4011471678 >> 172.21.15.72:0/4011471678 conn(0x7fb2e4066f50 msgr2=0x7fb2e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.810+0000 7fb2eb7b1700 1 -- 172.21.15.72:0/4011471678 shutdown_connections 2023-10-03T10:13:33.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.810+0000 7fb2eb7b1700 1 -- 172.21.15.72:0/4011471678 wait complete. 2023-10-03T10:13:33.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.811+0000 7fb2eb7b1700 1 Processor -- start 2023-10-03T10:13:33.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.811+0000 7fb2eb7b1700 1 -- start start 2023-10-03T10:13:33.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.812+0000 7fb2eb7b1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e409d6f0 0x7fb2e411e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.812+0000 7fb2eb7b1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2e409e1d0 0x7fb2e411eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.812+0000 7fb2eb7b1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e4139170 0x7fb2e411f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.812+0000 7fb2eb7b1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4120630 con 0x7fb2e4139170 2023-10-03T10:13:33.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.812+0000 7fb2eb7b1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4120a90 con 0x7fb2e409e1d0 2023-10-03T10:13:33.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.812+0000 7fb2eb7b1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e409c710 con 0x7fb2e409d6f0 2023-10-03T10:13:33.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.812+0000 7fb2e9d4e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e4139170 0x7fb2e411f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.812+0000 7fb2e9d4e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e4139170 0x7fb2e411f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51730/0 (socket says 172.21.15.72:51730) 2023-10-03T10:13:33.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.812+0000 7fb2e9d4e700 1 -- 172.21.15.72:0/901475078 learned_addr learned my addr 172.21.15.72:0/901475078 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:33.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.812+0000 7fb2e9d4e700 1 -- 172.21.15.72:0/901475078 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e409d6f0 msgr2=0x7fb2e411e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.812+0000 7fb2e9d4e700 1 --2- 172.21.15.72:0/901475078 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e409d6f0 0x7fb2e411e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.812+0000 7fb2e9d4e700 1 -- 172.21.15.72:0/901475078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2e409e1d0 msgr2=0x7fb2e411eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.812+0000 7fb2e9d4e700 1 --2- 172.21.15.72:0/901475078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2e409e1d0 0x7fb2e411eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.812+0000 7fb2e9d4e700 1 -- 172.21.15.72:0/901475078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d4009550 con 0x7fb2e4139170 2023-10-03T10:13:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.812+0000 7fb2e9d4e700 1 --2- 172.21.15.72:0/901475078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e4139170 0x7fb2e411f400 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009e30 tx=0x7fb2dc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.813+0000 7fb2d9ffb700 1 -- 172.21.15.72:0/901475078 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc00ce00 con 0x7fb2e4139170 2023-10-03T10:13:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.813+0000 7fb2d9ffb700 1 -- 172.21.15.72:0/901475078 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc00f040 con 0x7fb2e4139170 2023-10-03T10:13:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.813+0000 7fb2d9ffb700 1 -- 172.21.15.72:0/901475078 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0146c0 con 0x7fb2e4139170 2023-10-03T10:13:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.813+0000 7fb2eb7b1700 1 -- 172.21.15.72:0/901475078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e41220e0 con 0x7fb2e4139170 2023-10-03T10:13:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.813+0000 7fb2eb7b1700 1 -- 172.21.15.72:0/901475078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e40720d0 con 0x7fb2e4139170 2023-10-03T10:13:33.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.814+0000 7fb2d9ffb700 1 -- 172.21.15.72:0/901475078 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2dc014820 con 0x7fb2e4139170 2023-10-03T10:13:33.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.814+0000 7fb2d9ffb700 1 -- 172.21.15.72:0/901475078 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb2dc0403d0 con 0x7fb2e4139170 2023-10-03T10:13:33.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.814+0000 7fb2eb7b1700 1 -- 172.21.15.72:0/901475078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e4074ea0 con 0x7fb2e4139170 2023-10-03T10:13:33.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.819+0000 7f3899822700 1 Processor -- start 2023-10-03T10:13:33.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.819+0000 7f3899822700 1 -- start start 2023-10-03T10:13:33.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.819+0000 7fb2d9ffb700 1 -- 172.21.15.72:0/901475078 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2dc01d400 con 0x7fb2e4139170 2023-10-03T10:13:33.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.819+0000 7f3899822700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389412cf60 0x7f389406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.819+0000 7f3899822700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 0x7f389412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.819+0000 7f3899822700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389412cd90 con 0x7f3894130260 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.819+0000 7f3899822700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389412d330 con 0x7f389412f8b0 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.819+0000 7f3899822700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38941306d0 con 0x7f389412cf60 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f38937fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3894130260 0x7f3894136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43536/0 (socket says 172.21.15.72:43536) 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f38937fe700 1 -- 172.21.15.72:0/3575842442 learned_addr learned my addr 172.21.15.72:0/3575842442 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f38927fc700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 0x7f389412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 -- 172.21.15.72:0/3575842442 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452730094 0 0) 0x7f389412cd90 con 0x7f3894130260 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 -- 172.21.15.72:0/3575842442 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f387c0035b0 con 0x7f3894130260 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3892ffd700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389412cf60 0x7f389406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 -- 172.21.15.72:0/3575842442 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 810774303 0 0) 0x7f387c0035b0 con 0x7f3894130260 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 -- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389412cf60 msgr2=0x7f389406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:33.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389412cf60 0x7f389406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 -- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 msgr2=0x7f389412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:33.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 0x7f389412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 -- 172.21.15.72:0/3575842442 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3894071780 con 0x7f3894130260 2023-10-03T10:13:33.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 -- 172.21.15.72:0/3575842442 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 244944926 0 0) 0x7f388c0019f0 con 0x7f3894130260 2023-10-03T10:13:33.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 -- 172.21.15.72:0/3575842442 >> v1:172.21.15.72:6789/0 conn(0x7f3894130260 legacy=0x7f3894136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f387c003a00 0x7f387c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389412cf60 0x7f387c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 0x7f387c004d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 -- 172.21.15.72:0/3575842442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389412d330 con 0x7f387c003a00 2023-10-03T10:13:33.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 -- 172.21.15.72:0/3575842442 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38941306d0 con 0x7f389412f8b0 2023-10-03T10:13:33.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f3891ffb700 1 -- 172.21.15.72:0/3575842442 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0052d0 con 0x7f389412cf60 2023-10-03T10:13:33.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.820+0000 7f38937fe700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 0x7f387c004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.821+0000 7f3892ffd700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f387c003a00 0x7f387c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.821+0000 7f38927fc700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389412cf60 0x7f387c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.821+0000 7f38937fe700 1 -- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389412cf60 msgr2=0x7f387c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:33.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.821+0000 7f38937fe700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389412cf60 0x7f387c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.821+0000 7f38937fe700 1 -- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f387c003a00 msgr2=0x7f387c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:33.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.821+0000 7f38937fe700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f387c003a00 0x7f387c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.821+0000 7f38937fe700 1 -- 172.21.15.72:0/3575842442 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3894071780 con 0x7f389412f8b0 2023-10-03T10:13:33.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.821+0000 7f38937fe700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 0x7f387c004d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f388c00a8c0 tx=0x7f387c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4acd5f00b725d7b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.821+0000 7f3891ffb700 1 -- 172.21.15.72:0/3575842442 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00a360 con 0x7f389412f8b0 2023-10-03T10:13:33.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.821+0000 7f3891ffb700 1 -- 172.21.15.72:0/3575842442 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c012600 con 0x7f389412f8b0 2023-10-03T10:13:33.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.821+0000 7f3891ffb700 1 -- 172.21.15.72:0/3575842442 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c0129b0 con 0x7f389412f8b0 2023-10-03T10:13:33.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.822+0000 7f3899822700 1 -- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 msgr2=0x7f387c004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.822+0000 7f3899822700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 0x7f387c004d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f388c00a8c0 tx=0x7f387c005880 comp rx=0 tx=0).stop 2023-10-03T10:13:33.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.822+0000 7f3899822700 1 -- 172.21.15.72:0/3575842442 shutdown_connections 2023-10-03T10:13:33.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.822+0000 7f3899822700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f387c003a00 0x7f387c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.822+0000 7f3899822700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 0x7f387c004d90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.822+0000 7f3899822700 1 --2- 172.21.15.72:0/3575842442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389412cf60 0x7f387c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.822+0000 7f3899822700 1 -- 172.21.15.72:0/3575842442 >> 172.21.15.72:0/3575842442 conn(0x7f38940a2aa0 msgr2=0x7f38940a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.822+0000 7f3899822700 1 -- 172.21.15.72:0/3575842442 shutdown_connections 2023-10-03T10:13:33.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.822+0000 7f3899822700 1 -- 172.21.15.72:0/3575842442 wait complete. 2023-10-03T10:13:33.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.823+0000 7f3899822700 1 Processor -- start 2023-10-03T10:13:33.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.823+0000 7f3899822700 1 -- start start 2023-10-03T10:13:33.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f3899822700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f387c003a00 0x7f389409d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f3899822700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389412cf60 0x7f389409dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f3899822700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 0x7f389409e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f3899822700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3894130fa0 con 0x7f387c003a00 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f3899822700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3894132910 con 0x7f389412f8b0 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f3899822700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3894132f90 con 0x7f389412cf60 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f38937fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 0x7f389409e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f38937fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 0x7f389409e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50690/0 (socket says 172.21.15.72:50690) 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f38937fe700 1 -- 172.21.15.72:0/3137992965 learned_addr learned my addr 172.21.15.72:0/3137992965 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f38927fc700 1 --2- 172.21.15.72:0/3137992965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389412cf60 0x7f389409dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f38937fe700 1 -- 172.21.15.72:0/3137992965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389412cf60 msgr2=0x7f389409dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f38937fe700 1 --2- 172.21.15.72:0/3137992965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389412cf60 0x7f389409dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f38937fe700 1 -- 172.21.15.72:0/3137992965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f387c003a00 msgr2=0x7f389409d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f38937fe700 1 --2- 172.21.15.72:0/3137992965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f387c003a00 0x7f389409d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f38937fe700 1 -- 172.21.15.72:0/3137992965 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3894067bc0 con 0x7f389412f8b0 2023-10-03T10:13:33.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.824+0000 7f38937fe700 1 --2- 172.21.15.72:0/3137992965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 0x7f389409e160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f388c00aeb0 tx=0x7f388c001cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.825+0000 7f387bfff700 1 -- 172.21.15.72:0/3137992965 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00a360 con 0x7f389412f8b0 2023-10-03T10:13:33.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.825+0000 7f387bfff700 1 -- 172.21.15.72:0/3137992965 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c01e640 con 0x7f389412f8b0 2023-10-03T10:13:33.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.825+0000 7f387bfff700 1 -- 172.21.15.72:0/3137992965 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c01e9d0 con 0x7f389412f8b0 2023-10-03T10:13:33.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.825+0000 7f3899822700 1 -- 172.21.15.72:0/3137992965 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3894129fa0 con 0x7f389412f8b0 2023-10-03T10:13:33.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.825+0000 7f3899822700 1 -- 172.21.15.72:0/3137992965 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3894133640 con 0x7f389412f8b0 2023-10-03T10:13:33.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.826+0000 7f387bfff700 1 -- 172.21.15.72:0/3137992965 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f388c01eb30 con 0x7f389412f8b0 2023-10-03T10:13:33.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.826+0000 7f3899822700 1 -- 172.21.15.72:0/3137992965 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3894074ea0 con 0x7f389412f8b0 2023-10-03T10:13:33.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.826+0000 7f387bfff700 1 -- 172.21.15.72:0/3137992965 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f388c042040 con 0x7f389412f8b0 2023-10-03T10:13:33.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.831+0000 7f387bfff700 1 -- 172.21.15.72:0/3137992965 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f388c01ede0 con 0x7f389412f8b0 2023-10-03T10:13:33.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.918+0000 7f5835032700 1 -- 172.21.15.72:0/2775364724 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f583006c360 con 0x7f583009d6f0 2023-10-03T10:13:33.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.919+0000 7f58177fe700 1 -- 172.21.15.72:0/2775364724 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58200199a0 con 0x7f583009d6f0 2023-10-03T10:13:33.919 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:33.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.922+0000 7f5835032700 1 -- 172.21.15.72:0/2775364724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583009d6f0 msgr2=0x7f58301a8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.922+0000 7f5835032700 1 --2- 172.21.15.72:0/2775364724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583009d6f0 0x7f58301a8070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5820009c70 tx=0x7f5820004750 comp rx=0 tx=0).stop 2023-10-03T10:13:33.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.922+0000 7f5835032700 1 -- 172.21.15.72:0/2775364724 shutdown_connections 2023-10-03T10:13:33.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.922+0000 7f5835032700 1 --2- 172.21.15.72:0/2775364724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583009e410 0x7f58301a8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.922+0000 7f5835032700 1 --2- 172.21.15.72:0/2775364724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583009d6f0 0x7f58301a8070 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.922+0000 7f5835032700 1 --2- 172.21.15.72:0/2775364724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583009e000 0x7f58301a85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.922+0000 7f5835032700 1 -- 172.21.15.72:0/2775364724 >> 172.21.15.72:0/2775364724 conn(0x7f5830066f50 msgr2=0x7f583006f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.922+0000 7f5835032700 1 -- 172.21.15.72:0/2775364724 shutdown_connections 2023-10-03T10:13:33.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.922+0000 7f5835032700 1 -- 172.21.15.72:0/2775364724 wait complete. 2023-10-03T10:13:33.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:33.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.990+0000 7f6e7346d700 1 -- 172.21.15.72:0/4266267857 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6e6c074ea0 con 0x7f6e6c09e930 2023-10-03T10:13:33.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.991+0000 7f6e61ffb700 1 -- 172.21.15.72:0/4266267857 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e68015030 con 0x7f6e6c09e930 2023-10-03T10:13:33.991 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.993+0000 7f6e7346d700 1 -- 172.21.15.72:0/4266267857 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e6c09e930 msgr2=0x7f6e6c06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.993+0000 7f6e7346d700 1 --2- 172.21.15.72:0/4266267857 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e6c09e930 0x7f6e6c06b8b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6e68000c00 tx=0x7f6e68004750 comp rx=0 tx=0).stop 2023-10-03T10:13:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.993+0000 7f6e7346d700 1 -- 172.21.15.72:0/4266267857 shutdown_connections 2023-10-03T10:13:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.993+0000 7f6e7346d700 1 --2- 172.21.15.72:0/4266267857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e6c09f650 0x7f6e6c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.993+0000 7f6e7346d700 1 --2- 172.21.15.72:0/4266267857 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e6c09e930 0x7f6e6c06b8b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.993+0000 7f6e7346d700 1 --2- 172.21.15.72:0/4266267857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e6c09f240 0x7f6e6c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.993+0000 7f6e7346d700 1 -- 172.21.15.72:0/4266267857 >> 172.21.15.72:0/4266267857 conn(0x7f6e6c0a4210 msgr2=0x7f6e6c1b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.993+0000 7f6e7346d700 1 -- 172.21.15.72:0/4266267857 shutdown_connections 2023-10-03T10:13:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:33.993+0000 7f6e7346d700 1 -- 172.21.15.72:0/4266267857 wait complete. 2023-10-03T10:13:34.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:34.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.017+0000 7fb2eb7b1700 1 -- 172.21.15.72:0/901475078 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb2e409f420 con 0x7fb2e4139170 2023-10-03T10:13:34.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.017+0000 7fb2d9ffb700 1 -- 172.21.15.72:0/901475078 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb2dc02c090 con 0x7fb2e4139170 2023-10-03T10:13:34.018 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:34.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.019+0000 7fb2eb7b1700 1 -- 172.21.15.72:0/901475078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e4139170 msgr2=0x7fb2e411f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.019+0000 7fb2eb7b1700 1 --2- 172.21.15.72:0/901475078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e4139170 0x7fb2e411f400 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009e30 tx=0x7fb2dc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.019+0000 7fb2eb7b1700 1 -- 172.21.15.72:0/901475078 shutdown_connections 2023-10-03T10:13:34.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.019+0000 7fb2eb7b1700 1 --2- 172.21.15.72:0/901475078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e4139170 0x7fb2e411f400 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.019+0000 7fb2eb7b1700 1 --2- 172.21.15.72:0/901475078 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e409d6f0 0x7fb2e411e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.019+0000 7fb2eb7b1700 1 --2- 172.21.15.72:0/901475078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2e409e1d0 0x7fb2e411eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.019+0000 7fb2eb7b1700 1 -- 172.21.15.72:0/901475078 >> 172.21.15.72:0/901475078 conn(0x7fb2e4066f50 msgr2=0x7fb2e4138100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.019+0000 7fb2eb7b1700 1 -- 172.21.15.72:0/901475078 shutdown_connections 2023-10-03T10:13:34.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.019+0000 7fb2eb7b1700 1 -- 172.21.15.72:0/901475078 wait complete. 2023-10-03T10:13:34.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:34.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.036+0000 7f3899822700 1 -- 172.21.15.72:0/3137992965 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f38940713a0 con 0x7f389412f8b0 2023-10-03T10:13:34.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.036+0000 7f387bfff700 1 -- 172.21.15.72:0/3137992965 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f388c02c020 con 0x7f389412f8b0 2023-10-03T10:13:34.036 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.038+0000 7f3899822700 1 -- 172.21.15.72:0/3137992965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 msgr2=0x7f389409e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.038+0000 7f3899822700 1 --2- 172.21.15.72:0/3137992965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 0x7f389409e160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f388c00aeb0 tx=0x7f388c001cb0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.038+0000 7f3899822700 1 -- 172.21.15.72:0/3137992965 shutdown_connections 2023-10-03T10:13:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.038+0000 7f3899822700 1 --2- 172.21.15.72:0/3137992965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f387c003a00 0x7f389409d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.038+0000 7f3899822700 1 --2- 172.21.15.72:0/3137992965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389412f8b0 0x7f389409e160 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.038+0000 7f3899822700 1 --2- 172.21.15.72:0/3137992965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389412cf60 0x7f389409dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.038+0000 7f3899822700 1 -- 172.21.15.72:0/3137992965 >> 172.21.15.72:0/3137992965 conn(0x7f38940a2aa0 msgr2=0x7f389412b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.038+0000 7f3899822700 1 -- 172.21.15.72:0/3137992965 shutdown_connections 2023-10-03T10:13:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:34.038+0000 7f3899822700 1 -- 172.21.15.72:0/3137992965 wait complete. 2023-10-03T10:13:34.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:34.940 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:35.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:35.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:35.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:35.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.076+0000 7f745484f700 1 Processor -- start 2023-10-03T10:13:35.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.077+0000 7f745484f700 1 -- start start 2023-10-03T10:13:35.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.077+0000 7f745484f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745006a770 0x7f745006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.077+0000 7f745484f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745006b080 0x7f7450131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.077+0000 7f745484f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745009ece0 con 0x7f7450131b40 2023-10-03T10:13:35.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.077+0000 7f745484f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745009e760 con 0x7f745006a770 2023-10-03T10:13:35.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.077+0000 7f745484f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f745009e040 con 0x7f745006b080 2023-10-03T10:13:35.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.078+0000 7f744ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7450131b40 0x7f7450138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43544/0 (socket says 172.21.15.72:43544) 2023-10-03T10:13:35.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.078+0000 7f744ed9d700 1 -- 172.21.15.72:0/2950387848 learned_addr learned my addr 172.21.15.72:0/2950387848 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:35.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.078+0000 7f744e59c700 1 --2- 172.21.15.72:0/2950387848 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745006a770 0x7f745006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.078+0000 7f744e59c700 1 -- 172.21.15.72:0/2950387848 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745006b080 msgr2=0x7f7450131600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:13:35.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.078+0000 7f744e59c700 1 --2- 172.21.15.72:0/2950387848 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745006b080 0x7f7450131600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.078+0000 7f744e59c700 1 -- 172.21.15.72:0/2950387848 >> v1:172.21.15.72:6789/0 conn(0x7f7450131b40 legacy=0x7f7450138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.078+0000 7f744e59c700 1 -- 172.21.15.72:0/2950387848 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745009f630 con 0x7f745006a770 2023-10-03T10:13:35.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.078+0000 7f744e59c700 1 --2- 172.21.15.72:0/2950387848 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745006a770 0x7f745006ab40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7438009870 tx=0x7f7438009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=209e7e7908891ebc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.078+0000 7f744d59a700 1 -- 172.21.15.72:0/2950387848 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438011830 con 0x7f745006a770 2023-10-03T10:13:35.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.078+0000 7f744d59a700 1 -- 172.21.15.72:0/2950387848 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7438011990 con 0x7f745006a770 2023-10-03T10:13:35.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.078+0000 7f744d59a700 1 -- 172.21.15.72:0/2950387848 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438011d20 con 0x7f745006a770 2023-10-03T10:13:35.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.079+0000 7f745484f700 1 -- 172.21.15.72:0/2950387848 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745006a770 msgr2=0x7f745006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.079+0000 7f745484f700 1 --2- 172.21.15.72:0/2950387848 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745006a770 0x7f745006ab40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7438009870 tx=0x7f7438009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:35.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.079+0000 7f745484f700 1 -- 172.21.15.72:0/2950387848 shutdown_connections 2023-10-03T10:13:35.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.079+0000 7f745484f700 1 --2- 172.21.15.72:0/2950387848 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745006a770 0x7f745006ab40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.079+0000 7f745484f700 1 --2- 172.21.15.72:0/2950387848 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745006b080 0x7f7450131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.079+0000 7f745484f700 1 -- 172.21.15.72:0/2950387848 >> 172.21.15.72:0/2950387848 conn(0x7f7450066f50 msgr2=0x7f745009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.079+0000 7f745484f700 1 -- 172.21.15.72:0/2950387848 shutdown_connections 2023-10-03T10:13:35.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.080+0000 7f745484f700 1 -- 172.21.15.72:0/2950387848 wait complete. 2023-10-03T10:13:35.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.081+0000 7f745484f700 1 Processor -- start 2023-10-03T10:13:35.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.081+0000 7f745484f700 1 -- start start 2023-10-03T10:13:35.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.081+0000 7f745484f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745006a770 0x7f745009acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.081+0000 7f745484f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745006b080 0x7f745009b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.081+0000 7f745484f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7450131b40 0x7f74501c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.081+0000 7f745484f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7450130fd0 con 0x7f7450131b40 2023-10-03T10:13:35.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.081+0000 7f745484f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745009a8e0 con 0x7f745006b080 2023-10-03T10:13:35.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.081+0000 7f745484f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7450121be0 con 0x7f745006a770 2023-10-03T10:13:35.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.082+0000 7f744e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745006a770 0x7f745009acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.082+0000 7f744e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745006a770 0x7f745009acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41644/0 (socket says 172.21.15.72:41644) 2023-10-03T10:13:35.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.082+0000 7f744e59c700 1 -- 172.21.15.72:0/738786722 learned_addr learned my addr 172.21.15.72:0/738786722 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:35.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.082+0000 7f744ed9d700 1 --2- 172.21.15.72:0/738786722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7450131b40 0x7f74501c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.082+0000 7f744e59c700 1 -- 172.21.15.72:0/738786722 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745006b080 msgr2=0x7f745009b210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:35.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.082+0000 7f744e59c700 1 --2- 172.21.15.72:0/738786722 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745006b080 0x7f745009b210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.082+0000 7f744e59c700 1 -- 172.21.15.72:0/738786722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7450131b40 msgr2=0x7f74501c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.082+0000 7f744e59c700 1 --2- 172.21.15.72:0/738786722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7450131b40 0x7f74501c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.082+0000 7f744e59c700 1 -- 172.21.15.72:0/738786722 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380094a0 con 0x7f745006a770 2023-10-03T10:13:35.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.082+0000 7f744e59c700 1 --2- 172.21.15.72:0/738786722 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745006a770 0x7f745009acd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f74380090b0 tx=0x7f7438004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.082+0000 7f7446ffd700 1 -- 172.21.15.72:0/738786722 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74380036a0 con 0x7f745006a770 2023-10-03T10:13:35.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.082+0000 7f745484f700 1 -- 172.21.15.72:0/738786722 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7450120ee0 con 0x7f745006a770 2023-10-03T10:13:35.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.082+0000 7f7446ffd700 1 -- 172.21.15.72:0/738786722 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743801f070 con 0x7f745006a770 2023-10-03T10:13:35.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.082+0000 7f7446ffd700 1 -- 172.21.15.72:0/738786722 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438003a60 con 0x7f745006a770 2023-10-03T10:13:35.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.082+0000 7f745484f700 1 -- 172.21.15.72:0/738786722 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745009bfd0 con 0x7f745006a770 2023-10-03T10:13:35.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.083+0000 7f745484f700 1 -- 172.21.15.72:0/738786722 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74501315d0 con 0x7f745006a770 2023-10-03T10:13:35.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.084+0000 7f7446ffd700 1 -- 172.21.15.72:0/738786722 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7438003bc0 con 0x7f745006a770 2023-10-03T10:13:35.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.084+0000 7f7446ffd700 1 -- 172.21.15.72:0/738786722 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7438021070 con 0x7f745006a770 2023-10-03T10:13:35.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.088+0000 7f7446ffd700 1 -- 172.21.15.72:0/738786722 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7438010380 con 0x7f745006a770 2023-10-03T10:13:35.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.171+0000 7fc69cc5f700 1 Processor -- start 2023-10-03T10:13:35.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.171+0000 7fc69cc5f700 1 -- start start 2023-10-03T10:13:35.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.172+0000 7fc69cc5f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc69809e1d0 0x7fc698135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.172+0000 7fc69cc5f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc698135e50 0x7fc698138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.172+0000 7fc69cc5f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69809f130 con 0x7fc69809d6f0 2023-10-03T10:13:35.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.172+0000 7fc69cc5f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69809f520 con 0x7fc69809e1d0 2023-10-03T10:13:35.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.172+0000 7fc69cc5f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc69809e930 con 0x7fc698135e50 2023-10-03T10:13:35.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.172+0000 7fc69659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc69809d6f0 0x7fc69809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43548/0 (socket says 172.21.15.72:43548) 2023-10-03T10:13:35.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.172+0000 7fc69659c700 1 -- 172.21.15.72:0/1180491274 learned_addr learned my addr 172.21.15.72:0/1180491274 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:35.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.172+0000 7fc695d9b700 1 --2- 172.21.15.72:0/1180491274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc69809e1d0 0x7fc698135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.173+0000 7fc69559a700 1 -- 172.21.15.72:0/1180491274 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034481084 0 0) 0x7fc69809f130 con 0x7fc69809d6f0 2023-10-03T10:13:35.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.173+0000 7fc69559a700 1 -- 172.21.15.72:0/1180491274 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6800035b0 con 0x7fc69809d6f0 2023-10-03T10:13:35.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.173+0000 7fc695d9b700 1 -- 172.21.15.72:0/1180491274 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc698135e50 msgr2=0x7fc698138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.173+0000 7fc695d9b700 1 --2- 172.21.15.72:0/1180491274 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc698135e50 0x7fc698138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.173+0000 7fc695d9b700 1 -- 172.21.15.72:0/1180491274 >> v1:172.21.15.72:6789/0 conn(0x7fc69809d6f0 legacy=0x7fc69809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.173+0000 7fc695d9b700 1 -- 172.21.15.72:0/1180491274 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69809b2d0 con 0x7fc69809e1d0 2023-10-03T10:13:35.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.173+0000 7fc695d9b700 1 --2- 172.21.15.72:0/1180491274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc69809e1d0 0x7fc698135910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0098a0 tx=0x7fc68c009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de98fab5a0870f6e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.173+0000 7fc69559a700 1 -- 172.21.15.72:0/1180491274 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c011830 con 0x7fc69809e1d0 2023-10-03T10:13:35.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.173+0000 7fc69559a700 1 -- 172.21.15.72:0/1180491274 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c011990 con 0x7fc69809e1d0 2023-10-03T10:13:35.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.173+0000 7fc69559a700 1 -- 172.21.15.72:0/1180491274 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c011d20 con 0x7fc69809e1d0 2023-10-03T10:13:35.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.174+0000 7fc69cc5f700 1 -- 172.21.15.72:0/1180491274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc69809e1d0 msgr2=0x7fc698135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.174+0000 7fc69cc5f700 1 --2- 172.21.15.72:0/1180491274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc69809e1d0 0x7fc698135910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0098a0 tx=0x7fc68c009bb0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.174+0000 7fc69cc5f700 1 -- 172.21.15.72:0/1180491274 shutdown_connections 2023-10-03T10:13:35.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.174+0000 7fc69cc5f700 1 --2- 172.21.15.72:0/1180491274 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc698135e50 0x7fc698138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.174+0000 7fc69cc5f700 1 --2- 172.21.15.72:0/1180491274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc69809e1d0 0x7fc698135910 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.174+0000 7fc69cc5f700 1 -- 172.21.15.72:0/1180491274 >> 172.21.15.72:0/1180491274 conn(0x7fc698066f50 msgr2=0x7fc69809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.174+0000 7fc69cc5f700 1 -- 172.21.15.72:0/1180491274 shutdown_connections 2023-10-03T10:13:35.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.174+0000 7fc69cc5f700 1 -- 172.21.15.72:0/1180491274 wait complete. 2023-10-03T10:13:35.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.175+0000 7fc69cc5f700 1 Processor -- start 2023-10-03T10:13:35.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.175+0000 7fc69cc5f700 1 -- start start 2023-10-03T10:13:35.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc69cc5f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc69809d6f0 0x7fc698132760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc69cc5f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc69809e1d0 0x7fc698132ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc69cc5f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc698135e50 0x7fc6981331e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc69cc5f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6981342e0 con 0x7fc698135e50 2023-10-03T10:13:35.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc69cc5f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc698134890 con 0x7fc69809d6f0 2023-10-03T10:13:35.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc69cc5f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980a20d0 con 0x7fc69809e1d0 2023-10-03T10:13:35.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc69659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc69809d6f0 0x7fc698132760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc69659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc69809d6f0 0x7fc698132760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50712/0 (socket says 172.21.15.72:50712) 2023-10-03T10:13:35.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc69659c700 1 -- 172.21.15.72:0/1693819000 learned_addr learned my addr 172.21.15.72:0/1693819000 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:35.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc695d9b700 1 --2- 172.21.15.72:0/1693819000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc69809e1d0 0x7fc698132ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc696d9d700 1 --2- 172.21.15.72:0/1693819000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc698135e50 0x7fc6981331e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc69659c700 1 -- 172.21.15.72:0/1693819000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc69809e1d0 msgr2=0x7fc698132ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc69659c700 1 --2- 172.21.15.72:0/1693819000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc69809e1d0 0x7fc698132ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc69659c700 1 -- 172.21.15.72:0/1693819000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc698135e50 msgr2=0x7fc6981331e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc69659c700 1 --2- 172.21.15.72:0/1693819000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc698135e50 0x7fc6981331e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc69659c700 1 -- 172.21.15.72:0/1693819000 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c0094a0 con 0x7fc69809d6f0 2023-10-03T10:13:35.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.176+0000 7fc695d9b700 1 --2- 172.21.15.72:0/1693819000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc69809e1d0 0x7fc698132ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.177+0000 7fc69659c700 1 --2- 172.21.15.72:0/1693819000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc69809d6f0 0x7fc698132760 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc68800c700 tx=0x7fc68800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.177+0000 7fc686ffd700 1 -- 172.21.15.72:0/1693819000 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688005d70 con 0x7fc69809d6f0 2023-10-03T10:13:35.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.177+0000 7fc686ffd700 1 -- 172.21.15.72:0/1693819000 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6880070d0 con 0x7fc69809d6f0 2023-10-03T10:13:35.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.177+0000 7fc69cc5f700 1 -- 172.21.15.72:0/1693819000 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69809c700 con 0x7fc69809d6f0 2023-10-03T10:13:35.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.177+0000 7fc69cc5f700 1 -- 172.21.15.72:0/1693819000 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6981300d0 con 0x7fc69809d6f0 2023-10-03T10:13:35.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.177+0000 7fc686ffd700 1 -- 172.21.15.72:0/1693819000 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688007460 con 0x7fc69809d6f0 2023-10-03T10:13:35.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.177+0000 7fc686ffd700 1 -- 172.21.15.72:0/1693819000 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6880075c0 con 0x7fc69809d6f0 2023-10-03T10:13:35.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.178+0000 7fc686ffd700 1 -- 172.21.15.72:0/1693819000 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc68803ebf0 con 0x7fc69809d6f0 2023-10-03T10:13:35.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.178+0000 7fc69cc5f700 1 -- 172.21.15.72:0/1693819000 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67c0052e0 con 0x7fc69809d6f0 2023-10-03T10:13:35.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.181+0000 7f81ef6cc700 1 Processor -- start 2023-10-03T10:13:35.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.182+0000 7f81ef6cc700 1 -- start start 2023-10-03T10:13:35.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.182+0000 7f81ef6cc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81e809d6f0 0x7f81e809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.182+0000 7f81ef6cc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81e809e000 0x7f81e8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.182+0000 7f81ef6cc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81e809e410 0x7f81e8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.182+0000 7f81ef6cc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e809f520 con 0x7f81e809e000 2023-10-03T10:13:35.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.182+0000 7f81ef6cc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e809f130 con 0x7f81e809d6f0 2023-10-03T10:13:35.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.182+0000 7f81ef6cc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81e809e930 con 0x7f81e809e410 2023-10-03T10:13:35.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.182+0000 7f81ed468700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81e809d6f0 0x7f81e809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.182+0000 7f81ed468700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81e809d6f0 0x7f81e809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50722/0 (socket says 172.21.15.72:50722) 2023-10-03T10:13:35.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.182+0000 7f81ed468700 1 -- 172.21.15.72:0/3050361844 learned_addr learned my addr 172.21.15.72:0/3050361844 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:35.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.183+0000 7f81ecc67700 1 --2- 172.21.15.72:0/3050361844 >> v2:172.21.15.72:3300/0 conn(0x7f81e809e000 0x7f81e8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.183+0000 7f81edc69700 1 --2- 172.21.15.72:0/3050361844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81e809e410 0x7f81e8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.183+0000 7f81ed468700 1 -- 172.21.15.72:0/3050361844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81e809e410 msgr2=0x7f81e8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.183+0000 7f81ed468700 1 --2- 172.21.15.72:0/3050361844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81e809e410 0x7f81e8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.183+0000 7f81ed468700 1 -- 172.21.15.72:0/3050361844 >> v2:172.21.15.72:3300/0 conn(0x7f81e809e000 msgr2=0x7f81e8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.183+0000 7f81ed468700 1 --2- 172.21.15.72:0/3050361844 >> v2:172.21.15.72:3300/0 conn(0x7f81e809e000 0x7f81e8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.183+0000 7f81ed468700 1 -- 172.21.15.72:0/3050361844 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e809b2d0 con 0x7f81e809d6f0 2023-10-03T10:13:35.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.183+0000 7f81ed468700 1 --2- 172.21.15.72:0/3050361844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81e809d6f0 0x7f81e809dac0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f81e40098f0 tx=0x7f81e4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b5f6143385a12ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.187+0000 7f81dffff700 1 -- 172.21.15.72:0/3050361844 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4011830 con 0x7f81e809d6f0 2023-10-03T10:13:35.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.187+0000 7f81dffff700 1 -- 172.21.15.72:0/3050361844 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4011990 con 0x7f81e809d6f0 2023-10-03T10:13:35.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.187+0000 7f81dffff700 1 -- 172.21.15.72:0/3050361844 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4011d20 con 0x7f81e809d6f0 2023-10-03T10:13:35.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.187+0000 7fc686ffd700 1 -- 172.21.15.72:0/1693819000 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc68800e280 con 0x7fc69809d6f0 2023-10-03T10:13:35.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.187+0000 7f81ef6cc700 1 -- 172.21.15.72:0/3050361844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81e809d6f0 msgr2=0x7f81e809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.187+0000 7f81ef6cc700 1 --2- 172.21.15.72:0/3050361844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81e809d6f0 0x7f81e809dac0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f81e40098f0 tx=0x7f81e4009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:35.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.187+0000 7f81ef6cc700 1 -- 172.21.15.72:0/3050361844 shutdown_connections 2023-10-03T10:13:35.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.188+0000 7f81ef6cc700 1 --2- 172.21.15.72:0/3050361844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81e809e410 0x7f81e8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.188+0000 7f81ef6cc700 1 --2- 172.21.15.72:0/3050361844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81e809d6f0 0x7f81e809dac0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.188+0000 7f81ef6cc700 1 --2- 172.21.15.72:0/3050361844 >> v2:172.21.15.72:3300/0 conn(0x7f81e809e000 0x7f81e8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.188+0000 7f81ef6cc700 1 -- 172.21.15.72:0/3050361844 >> 172.21.15.72:0/3050361844 conn(0x7f81e8066f50 msgr2=0x7f81e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.188+0000 7f81ef6cc700 1 -- 172.21.15.72:0/3050361844 shutdown_connections 2023-10-03T10:13:35.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.188+0000 7f81ef6cc700 1 -- 172.21.15.72:0/3050361844 wait complete. 2023-10-03T10:13:35.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.189+0000 7f81ef6cc700 1 Processor -- start 2023-10-03T10:13:35.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.189+0000 7f81ef6cc700 1 -- start start 2023-10-03T10:13:35.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.189+0000 7f81ef6cc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81e809d6f0 0x7f81e811ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.189+0000 7f81ef6cc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81e809e000 0x7f81e811e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.189+0000 7f81ef6cc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81e809e410 0x7f81e811e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.189+0000 7f81ef6cc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e811f260 con 0x7f81e809e410 2023-10-03T10:13:35.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.189+0000 7f81ef6cc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e811f9e0 con 0x7f81e809d6f0 2023-10-03T10:13:35.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.189+0000 7f81ef6cc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81e8120000 con 0x7f81e809e000 2023-10-03T10:13:35.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.189+0000 7f81ed468700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81e809d6f0 0x7f81e811ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.189+0000 7f81edc69700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81e809e410 0x7f81e811e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.189+0000 7f81ed468700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81e809d6f0 0x7f81e811ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50732/0 (socket says 172.21.15.72:50732) 2023-10-03T10:13:35.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.189+0000 7f81ed468700 1 -- 172.21.15.72:0/3023008274 learned_addr learned my addr 172.21.15.72:0/3023008274 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:35.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.189+0000 7f81ecc67700 1 --2- 172.21.15.72:0/3023008274 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81e809e000 0x7f81e811e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.190+0000 7f81ed468700 1 -- 172.21.15.72:0/3023008274 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81e809e000 msgr2=0x7f81e811e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.190+0000 7f81ed468700 1 --2- 172.21.15.72:0/3023008274 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81e809e000 0x7f81e811e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.190+0000 7f81ed468700 1 -- 172.21.15.72:0/3023008274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81e809e410 msgr2=0x7f81e811e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.190+0000 7f81ed468700 1 --2- 172.21.15.72:0/3023008274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81e809e410 0x7f81e811e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.190+0000 7f81ed468700 1 -- 172.21.15.72:0/3023008274 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e4009550 con 0x7f81e809d6f0 2023-10-03T10:13:35.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.190+0000 7f81edc69700 1 --2- 172.21.15.72:0/3023008274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81e809e410 0x7f81e811e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.190+0000 7f81ed468700 1 --2- 172.21.15.72:0/3023008274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81e809d6f0 0x7f81e811ddd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f81e4011930 tx=0x7f81e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.190+0000 7f81ddffb700 1 -- 172.21.15.72:0/3023008274 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4004240 con 0x7f81e809d6f0 2023-10-03T10:13:35.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.190+0000 7f81ddffb700 1 -- 172.21.15.72:0/3023008274 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4023070 con 0x7f81e809d6f0 2023-10-03T10:13:35.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.190+0000 7f81ddffb700 1 -- 172.21.15.72:0/3023008274 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e40045e0 con 0x7f81e809d6f0 2023-10-03T10:13:35.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.190+0000 7f81ef6cc700 1 -- 172.21.15.72:0/3023008274 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e8121610 con 0x7f81e809d6f0 2023-10-03T10:13:35.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.190+0000 7f81ef6cc700 1 -- 172.21.15.72:0/3023008274 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e81210d0 con 0x7f81e809d6f0 2023-10-03T10:13:35.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.191+0000 7f81ddffb700 1 -- 172.21.15.72:0/3023008274 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81e4025030 con 0x7f81e809d6f0 2023-10-03T10:13:35.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.191+0000 7f81ef6cc700 1 -- 172.21.15.72:0/3023008274 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e811ac20 con 0x7f81e809d6f0 2023-10-03T10:13:35.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.191+0000 7f81ddffb700 1 -- 172.21.15.72:0/3023008274 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f81e4044d10 con 0x7f81e809d6f0 2023-10-03T10:13:35.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.200+0000 7f81ddffb700 1 -- 172.21.15.72:0/3023008274 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81e400b3e0 con 0x7f81e809d6f0 2023-10-03T10:13:35.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.227+0000 7f0fdd607700 1 Processor -- start 2023-10-03T10:13:35.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.227+0000 7f0fdd607700 1 -- start start 2023-10-03T10:13:35.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fdd607700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd8130540 0x7f0fd8130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fdd607700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd8130e50 0x7f0fd806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fdd607700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fd806fb20 0x7f0fd806ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fdd607700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd809a390 con 0x7f0fd806fb20 2023-10-03T10:13:35.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fdd607700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd80716a0 con 0x7f0fd8130540 2023-10-03T10:13:35.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fdd607700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd8071290 con 0x7f0fd8130e50 2023-10-03T10:13:35.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fd6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd8130540 0x7f0fd8130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fd6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd8130540 0x7f0fd8130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50742/0 (socket says 172.21.15.72:50742) 2023-10-03T10:13:35.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fd6ffd700 1 -- 172.21.15.72:0/1923479453 learned_addr learned my addr 172.21.15.72:0/1923479453 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:35.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fd67fc700 1 --2- 172.21.15.72:0/1923479453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd8130e50 0x7f0fd806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fd77fe700 1 --2- 172.21.15.72:0/1923479453 >> v2:172.21.15.72:3300/0 conn(0x7f0fd806fb20 0x7f0fd806ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fd67fc700 1 -- 172.21.15.72:0/1923479453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd8130540 msgr2=0x7f0fd8130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fd67fc700 1 --2- 172.21.15.72:0/1923479453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd8130540 0x7f0fd8130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fd67fc700 1 -- 172.21.15.72:0/1923479453 >> v2:172.21.15.72:3300/0 conn(0x7f0fd806fb20 msgr2=0x7f0fd806ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fd67fc700 1 --2- 172.21.15.72:0/1923479453 >> v2:172.21.15.72:3300/0 conn(0x7f0fd806fb20 0x7f0fd806ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fd67fc700 1 -- 172.21.15.72:0/1923479453 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd8130340 con 0x7f0fd8130e50 2023-10-03T10:13:35.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.228+0000 7f0fd67fc700 1 --2- 172.21.15.72:0/1923479453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd8130e50 0x7f0fd806f5e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc009870 tx=0x7f0fcc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=783ee26170071845 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.229+0000 7f0fd5ffb700 1 -- 172.21.15.72:0/1923479453 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc011830 con 0x7f0fd8130e50 2023-10-03T10:13:35.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.229+0000 7f0fd5ffb700 1 -- 172.21.15.72:0/1923479453 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fcc011990 con 0x7f0fd8130e50 2023-10-03T10:13:35.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.229+0000 7f0fd5ffb700 1 -- 172.21.15.72:0/1923479453 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc011d20 con 0x7f0fd8130e50 2023-10-03T10:13:35.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.229+0000 7f0fdd607700 1 -- 172.21.15.72:0/1923479453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd8130e50 msgr2=0x7f0fd806f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.229+0000 7f0fdd607700 1 --2- 172.21.15.72:0/1923479453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd8130e50 0x7f0fd806f5e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc009870 tx=0x7f0fcc009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:35.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.229+0000 7f0fdd607700 1 -- 172.21.15.72:0/1923479453 shutdown_connections 2023-10-03T10:13:35.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.229+0000 7f0fdd607700 1 --2- 172.21.15.72:0/1923479453 >> v2:172.21.15.72:3300/0 conn(0x7f0fd806fb20 0x7f0fd806ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.229+0000 7f0fdd607700 1 --2- 172.21.15.72:0/1923479453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd8130540 0x7f0fd8130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.229+0000 7f0fdd607700 1 --2- 172.21.15.72:0/1923479453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd8130e50 0x7f0fd806f5e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.229+0000 7f0fdd607700 1 -- 172.21.15.72:0/1923479453 >> 172.21.15.72:0/1923479453 conn(0x7f0fd80a2aa0 msgr2=0x7f0fd80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.229+0000 7f0fdd607700 1 -- 172.21.15.72:0/1923479453 shutdown_connections 2023-10-03T10:13:35.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.229+0000 7f0fdd607700 1 -- 172.21.15.72:0/1923479453 wait complete. 2023-10-03T10:13:35.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.230+0000 7f0fdd607700 1 Processor -- start 2023-10-03T10:13:35.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.230+0000 7f0fdd607700 1 -- start start 2023-10-03T10:13:35.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fdd607700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd806fb20 0x7f0fd811ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fdd607700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd8130540 0x7f0fd811f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fdd607700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd8130e50 0x7f0fd811f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fdd607700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd81201c0 con 0x7f0fd8130e50 2023-10-03T10:13:35.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fdd607700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd8122880 con 0x7f0fd8130540 2023-10-03T10:13:35.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fdd607700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd812c830 con 0x7f0fd806fb20 2023-10-03T10:13:35.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fd6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd806fb20 0x7f0fd811ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fd6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd806fb20 0x7f0fd811ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41706/0 (socket says 172.21.15.72:41706) 2023-10-03T10:13:35.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fd6ffd700 1 -- 172.21.15.72:0/662242363 learned_addr learned my addr 172.21.15.72:0/662242363 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:35.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fd67fc700 1 --2- 172.21.15.72:0/662242363 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd8130540 0x7f0fd811f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fd77fe700 1 --2- 172.21.15.72:0/662242363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd8130e50 0x7f0fd811f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fd6ffd700 1 -- 172.21.15.72:0/662242363 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd8130540 msgr2=0x7f0fd811f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fd6ffd700 1 --2- 172.21.15.72:0/662242363 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd8130540 0x7f0fd811f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fd6ffd700 1 -- 172.21.15.72:0/662242363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd8130e50 msgr2=0x7f0fd811f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fd6ffd700 1 --2- 172.21.15.72:0/662242363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd8130e50 0x7f0fd811f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fd6ffd700 1 -- 172.21.15.72:0/662242363 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc0094a0 con 0x7f0fd806fb20 2023-10-03T10:13:35.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.231+0000 7f0fd77fe700 1 --2- 172.21.15.72:0/662242363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd8130e50 0x7f0fd811f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:35.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.232+0000 7f0fd6ffd700 1 --2- 172.21.15.72:0/662242363 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd806fb20 0x7f0fd811ed60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800e910 tx=0x7f0fc800ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.232+0000 7f0fbf7fe700 1 -- 172.21.15.72:0/662242363 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80096a0 con 0x7f0fd806fb20 2023-10-03T10:13:35.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.232+0000 7f0fbf7fe700 1 -- 172.21.15.72:0/662242363 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc800ee60 con 0x7f0fd806fb20 2023-10-03T10:13:35.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.232+0000 7f0fdd607700 1 -- 172.21.15.72:0/662242363 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd8120a10 con 0x7f0fd806fb20 2023-10-03T10:13:35.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.232+0000 7f0fbf7fe700 1 -- 172.21.15.72:0/662242363 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800ca90 con 0x7f0fd806fb20 2023-10-03T10:13:35.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.232+0000 7f0fdd607700 1 -- 172.21.15.72:0/662242363 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd80a0a50 con 0x7f0fd806fb20 2023-10-03T10:13:35.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.233+0000 7f0fbf7fe700 1 -- 172.21.15.72:0/662242363 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0fc800cbf0 con 0x7f0fd806fb20 2023-10-03T10:13:35.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.233+0000 7f0fdd607700 1 -- 172.21.15.72:0/662242363 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd8074ea0 con 0x7f0fd806fb20 2023-10-03T10:13:35.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.233+0000 7f0fbf7fe700 1 -- 172.21.15.72:0/662242363 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0fc803fae0 con 0x7f0fd806fb20 2023-10-03T10:13:35.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.237+0000 7f0fbf7fe700 1 -- 172.21.15.72:0/662242363 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0fc8013470 con 0x7f0fd806fb20 2023-10-03T10:13:35.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.304+0000 7f745484f700 1 -- 172.21.15.72:0/738786722 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7450074ea0 con 0x7f745006a770 2023-10-03T10:13:35.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.304+0000 7f7446ffd700 1 -- 172.21.15.72:0/738786722 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7438035020 con 0x7f745006a770 2023-10-03T10:13:35.305 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:35.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.307+0000 7f745484f700 1 -- 172.21.15.72:0/738786722 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745006a770 msgr2=0x7f745009acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.307+0000 7f745484f700 1 --2- 172.21.15.72:0/738786722 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745006a770 0x7f745009acd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f74380090b0 tx=0x7f7438004750 comp rx=0 tx=0).stop 2023-10-03T10:13:35.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.308+0000 7f745484f700 1 -- 172.21.15.72:0/738786722 shutdown_connections 2023-10-03T10:13:35.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.308+0000 7f745484f700 1 --2- 172.21.15.72:0/738786722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7450131b40 0x7f74501c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.308+0000 7f745484f700 1 --2- 172.21.15.72:0/738786722 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745006a770 0x7f745009acd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.308+0000 7f745484f700 1 --2- 172.21.15.72:0/738786722 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745006b080 0x7f745009b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.308+0000 7f745484f700 1 -- 172.21.15.72:0/738786722 >> 172.21.15.72:0/738786722 conn(0x7f7450066f50 msgr2=0x7f74500a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.308+0000 7f745484f700 1 -- 172.21.15.72:0/738786722 shutdown_connections 2023-10-03T10:13:35.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.308+0000 7f745484f700 1 -- 172.21.15.72:0/738786722 wait complete. 2023-10-03T10:13:35.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:35.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.389+0000 7fc69cc5f700 1 -- 172.21.15.72:0/1693819000 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc67c005590 con 0x7fc69809d6f0 2023-10-03T10:13:35.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.389+0000 7fc686ffd700 1 -- 172.21.15.72:0/1693819000 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc688017020 con 0x7fc69809d6f0 2023-10-03T10:13:35.390 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:35.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.392+0000 7fc69cc5f700 1 -- 172.21.15.72:0/1693819000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc69809d6f0 msgr2=0x7fc698132760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.392+0000 7fc69cc5f700 1 --2- 172.21.15.72:0/1693819000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc69809d6f0 0x7fc698132760 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc68800c700 tx=0x7fc68800ca10 comp rx=0 tx=0).stop 2023-10-03T10:13:35.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.392+0000 7fc69cc5f700 1 -- 172.21.15.72:0/1693819000 shutdown_connections 2023-10-03T10:13:35.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.392+0000 7fc69cc5f700 1 --2- 172.21.15.72:0/1693819000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc698135e50 0x7fc6981331e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.392+0000 7fc69cc5f700 1 --2- 172.21.15.72:0/1693819000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc69809d6f0 0x7fc698132760 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.392+0000 7fc69cc5f700 1 --2- 172.21.15.72:0/1693819000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc69809e1d0 0x7fc698132ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.392+0000 7fc69cc5f700 1 -- 172.21.15.72:0/1693819000 >> 172.21.15.72:0/1693819000 conn(0x7fc698066f50 msgr2=0x7fc69806e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.392+0000 7fc69cc5f700 1 -- 172.21.15.72:0/1693819000 shutdown_connections 2023-10-03T10:13:35.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.392+0000 7fc69cc5f700 1 -- 172.21.15.72:0/1693819000 wait complete. 2023-10-03T10:13:35.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.399+0000 7f81ef6cc700 1 -- 172.21.15.72:0/3023008274 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f81e8074ea0 con 0x7f81e809d6f0 2023-10-03T10:13:35.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.399+0000 7f81ddffb700 1 -- 172.21.15.72:0/3023008274 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f81e4015070 con 0x7f81e809d6f0 2023-10-03T10:13:35.400 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.401+0000 7f81ef6cc700 1 -- 172.21.15.72:0/3023008274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81e809d6f0 msgr2=0x7f81e811ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.401+0000 7f81ef6cc700 1 --2- 172.21.15.72:0/3023008274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81e809d6f0 0x7f81e811ddd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f81e4011930 tx=0x7f81e4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.401+0000 7f81ef6cc700 1 -- 172.21.15.72:0/3023008274 shutdown_connections 2023-10-03T10:13:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.401+0000 7f81ef6cc700 1 --2- 172.21.15.72:0/3023008274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81e809e410 0x7f81e811e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.401+0000 7f81ef6cc700 1 --2- 172.21.15.72:0/3023008274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81e809d6f0 0x7f81e811ddd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.401+0000 7f81ef6cc700 1 --2- 172.21.15.72:0/3023008274 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81e809e000 0x7f81e811e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.401+0000 7f81ef6cc700 1 -- 172.21.15.72:0/3023008274 >> 172.21.15.72:0/3023008274 conn(0x7f81e8066f50 msgr2=0x7f81e8130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.401+0000 7f81ef6cc700 1 -- 172.21.15.72:0/3023008274 shutdown_connections 2023-10-03T10:13:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.401+0000 7f81ef6cc700 1 -- 172.21.15.72:0/3023008274 wait complete. 2023-10-03T10:13:35.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:35.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:35.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.442+0000 7f0fdd607700 1 -- 172.21.15.72:0/662242363 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0fd806b9e0 con 0x7f0fd806fb20 2023-10-03T10:13:35.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.442+0000 7f0fbf7fe700 1 -- 172.21.15.72:0/662242363 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0fc8011350 con 0x7f0fd806fb20 2023-10-03T10:13:35.443 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:35.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.444+0000 7f0fdd607700 1 -- 172.21.15.72:0/662242363 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd806fb20 msgr2=0x7f0fd811ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.444+0000 7f0fdd607700 1 --2- 172.21.15.72:0/662242363 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd806fb20 0x7f0fd811ed60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800e910 tx=0x7f0fc800ec20 comp rx=0 tx=0).stop 2023-10-03T10:13:35.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.445+0000 7f0fdd607700 1 -- 172.21.15.72:0/662242363 shutdown_connections 2023-10-03T10:13:35.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.445+0000 7f0fdd607700 1 --2- 172.21.15.72:0/662242363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd8130e50 0x7f0fd811f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.445+0000 7f0fdd607700 1 --2- 172.21.15.72:0/662242363 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd806fb20 0x7f0fd811ed60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.445+0000 7f0fdd607700 1 --2- 172.21.15.72:0/662242363 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd8130540 0x7f0fd811f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.445+0000 7f0fdd607700 1 -- 172.21.15.72:0/662242363 >> 172.21.15.72:0/662242363 conn(0x7f0fd80a2aa0 msgr2=0x7f0fd806e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.445+0000 7f0fdd607700 1 -- 172.21.15.72:0/662242363 shutdown_connections 2023-10-03T10:13:35.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:35.445+0000 7f0fdd607700 1 -- 172.21.15.72:0/662242363 wait complete. 2023-10-03T10:13:35.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:36.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:36.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:36.415 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:36.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.454+0000 7fc81ce9b700 1 Processor -- start 2023-10-03T10:13:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.454+0000 7fc81ce9b700 1 -- start start 2023-10-03T10:13:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc81ce9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8180a0a30 0x7fc8180a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc81ce9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc818134170 0x7fc81813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc81ce9b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81809edd0 con 0x7fc8180a1340 2023-10-03T10:13:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc81ce9b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81809e1f0 con 0x7fc8180a0a30 2023-10-03T10:13:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc81ce9b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc81809dc50 con 0x7fc818134170 2023-10-03T10:13:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc81659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8180a0a30 0x7fc8180a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc816d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc818134170 0x7fc81813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc81659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8180a0a30 0x7fc8180a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51802/0 (socket says 172.21.15.72:51802) 2023-10-03T10:13:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc816d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc818134170 0x7fc81813bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41712/0 (socket says 172.21.15.72:41712) 2023-10-03T10:13:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc81659c700 1 -- 172.21.15.72:0/1121330851 learned_addr learned my addr 172.21.15.72:0/1121330851 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc81659c700 1 -- 172.21.15.72:0/1121330851 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc818134170 msgr2=0x7fc81813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc81659c700 1 --2- 172.21.15.72:0/1121330851 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc818134170 0x7fc81813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc81659c700 1 -- 172.21.15.72:0/1121330851 >> v1:172.21.15.72:6789/0 conn(0x7fc8180a1340 legacy=0x7fc818133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc81559a700 1 -- 172.21.15.72:0/1121330851 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429211922 0 0) 0x7fc81809edd0 con 0x7fc8180a1340 2023-10-03T10:13:36.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc81659c700 1 -- 172.21.15.72:0/1121330851 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8180a1fe0 con 0x7fc8180a0a30 2023-10-03T10:13:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.455+0000 7fc81659c700 1 --2- 172.21.15.72:0/1121330851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180a0a30 0x7fc8180a0e00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc8080098f0 tx=0x7fc808009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90303a1fdbb18cb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.456+0000 7fc81559a700 1 -- 172.21.15.72:0/1121330851 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80800b8a0 con 0x7fc8180a0a30 2023-10-03T10:13:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.456+0000 7fc81559a700 1 -- 172.21.15.72:0/1121330851 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80800ba00 con 0x7fc8180a0a30 2023-10-03T10:13:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.456+0000 7fc81559a700 1 -- 172.21.15.72:0/1121330851 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80800bd90 con 0x7fc8180a0a30 2023-10-03T10:13:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.456+0000 7fc81ce9b700 1 -- 172.21.15.72:0/1121330851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180a0a30 msgr2=0x7fc8180a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.456+0000 7fc81ce9b700 1 --2- 172.21.15.72:0/1121330851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180a0a30 0x7fc8180a0e00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc8080098f0 tx=0x7fc808009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.457+0000 7fc81ce9b700 1 -- 172.21.15.72:0/1121330851 shutdown_connections 2023-10-03T10:13:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.457+0000 7fc81ce9b700 1 --2- 172.21.15.72:0/1121330851 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc818134170 0x7fc81813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.457+0000 7fc81ce9b700 1 --2- 172.21.15.72:0/1121330851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180a0a30 0x7fc8180a0e00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.457+0000 7fc81ce9b700 1 -- 172.21.15.72:0/1121330851 >> 172.21.15.72:0/1121330851 conn(0x7fc8180a6550 msgr2=0x7fc8180a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.457+0000 7fc81ce9b700 1 -- 172.21.15.72:0/1121330851 shutdown_connections 2023-10-03T10:13:36.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.457+0000 7fc81ce9b700 1 -- 172.21.15.72:0/1121330851 wait complete. 2023-10-03T10:13:36.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.458+0000 7fc81ce9b700 1 Processor -- start 2023-10-03T10:13:36.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.458+0000 7fc81ce9b700 1 -- start start 2023-10-03T10:13:36.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:36.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.459+0000 7fc81ce9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8180a0a30 0x7fc8181228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.459+0000 7fc81ce9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180a1340 0x7fc818122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.459+0000 7fc81ce9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc818134170 0x7fc818123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.459+0000 7fc81ce9b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc818126040 con 0x7fc8180a1340 2023-10-03T10:13:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.459+0000 7fc81ce9b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc818124520 con 0x7fc8180a0a30 2023-10-03T10:13:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.459+0000 7fc81ce9b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8180a0220 con 0x7fc818134170 2023-10-03T10:13:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.459+0000 7fc815d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180a1340 0x7fc818122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.459+0000 7fc815d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180a1340 0x7fc818122e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51818/0 (socket says 172.21.15.72:51818) 2023-10-03T10:13:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.459+0000 7fc815d9b700 1 -- 172.21.15.72:0/3976854408 learned_addr learned my addr 172.21.15.72:0/3976854408 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.459+0000 7fc81659c700 1 --2- 172.21.15.72:0/3976854408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8180a0a30 0x7fc8181228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.459+0000 7fc815d9b700 1 -- 172.21.15.72:0/3976854408 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc818134170 msgr2=0x7fc818123360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.459+0000 7fc815d9b700 1 --2- 172.21.15.72:0/3976854408 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc818134170 0x7fc818123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.459+0000 7fc815d9b700 1 -- 172.21.15.72:0/3976854408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8180a0a30 msgr2=0x7fc8181228e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.459+0000 7fc815d9b700 1 --2- 172.21.15.72:0/3976854408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8180a0a30 0x7fc8181228e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.459+0000 7fc815d9b700 1 -- 172.21.15.72:0/3976854408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc808009550 con 0x7fc8180a1340 2023-10-03T10:13:36.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.460+0000 7fc815d9b700 1 --2- 172.21.15.72:0/3976854408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180a1340 0x7fc818122e20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc80c001eb0 tx=0x7fc80c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.460+0000 7fc806ffd700 1 -- 172.21.15.72:0/3976854408 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0054e0 con 0x7fc8180a1340 2023-10-03T10:13:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.460+0000 7fc806ffd700 1 -- 172.21.15.72:0/3976854408 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80c003680 con 0x7fc8180a1340 2023-10-03T10:13:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.460+0000 7fc81ce9b700 1 -- 172.21.15.72:0/3976854408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8180a25e0 con 0x7fc8180a1340 2023-10-03T10:13:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.460+0000 7fc806ffd700 1 -- 172.21.15.72:0/3976854408 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0039f0 con 0x7fc8180a1340 2023-10-03T10:13:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.460+0000 7fc81ce9b700 1 -- 172.21.15.72:0/3976854408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc818133320 con 0x7fc8180a1340 2023-10-03T10:13:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.461+0000 7fc81ce9b700 1 -- 172.21.15.72:0/3976854408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc818074ea0 con 0x7fc8180a1340 2023-10-03T10:13:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.461+0000 7fc806ffd700 1 -- 172.21.15.72:0/3976854408 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc80c003b50 con 0x7fc8180a1340 2023-10-03T10:13:36.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.461+0000 7fc806ffd700 1 -- 172.21.15.72:0/3976854408 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc80c03eb80 con 0x7fc8180a1340 2023-10-03T10:13:36.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.467+0000 7fc806ffd700 1 -- 172.21.15.72:0/3976854408 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc80c01b3b0 con 0x7fc8180a1340 2023-10-03T10:13:36.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.554+0000 7f127aa77700 1 Processor -- start 2023-10-03T10:13:36.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.554+0000 7f127aa77700 1 -- start start 2023-10-03T10:13:36.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.555+0000 7f127aa77700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1274133420 0x7f12741337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.555+0000 7f127aa77700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1274134260 0x7f12741306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.555+0000 7f127aa77700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127406b990 con 0x7f1274133e30 2023-10-03T10:13:36.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.555+0000 7f127aa77700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12740a0590 con 0x7f1274134260 2023-10-03T10:13:36.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.555+0000 7f127aa77700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f127409fb80 con 0x7f1274133420 2023-10-03T10:13:36.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.555+0000 7f1273fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1274133e30 0x7f127412ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43556/0 (socket says 172.21.15.72:43556) 2023-10-03T10:13:36.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.555+0000 7f1279014700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1274134260 0x7f12741306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.555+0000 7f1273fff700 1 -- 172.21.15.72:0/1892359599 learned_addr learned my addr 172.21.15.72:0/1892359599 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:36.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.555+0000 7f1278813700 1 --2- 172.21.15.72:0/1892359599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1274133420 0x7f12741337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.555+0000 7f12737fe700 1 -- 172.21.15.72:0/1892359599 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189637669 0 0) 0x7f127406b990 con 0x7f1274133e30 2023-10-03T10:13:36.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.555+0000 7f12737fe700 1 -- 172.21.15.72:0/1892359599 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12640035b0 con 0x7f1274133e30 2023-10-03T10:13:36.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.555+0000 7f1279014700 1 -- 172.21.15.72:0/1892359599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1274133420 msgr2=0x7f12741337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:36.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.555+0000 7f1279014700 1 --2- 172.21.15.72:0/1892359599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1274133420 0x7f12741337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.555+0000 7f1279014700 1 -- 172.21.15.72:0/1892359599 >> v1:172.21.15.72:6789/0 conn(0x7f1274133e30 legacy=0x7f127412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.555+0000 7f1279014700 1 -- 172.21.15.72:0/1892359599 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12740a0030 con 0x7f1274134260 2023-10-03T10:13:36.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.556+0000 7f1279014700 1 --2- 172.21.15.72:0/1892359599 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1274134260 0x7f12741306a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f126c009dc0 tx=0x7f126c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e04c5cdbe99ae228 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.557+0000 7f12737fe700 1 -- 172.21.15.72:0/1892359599 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c00e070 con 0x7f1274134260 2023-10-03T10:13:36.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.557+0000 7f12737fe700 1 -- 172.21.15.72:0/1892359599 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c00bb20 con 0x7f1274134260 2023-10-03T10:13:36.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.557+0000 7f12737fe700 1 -- 172.21.15.72:0/1892359599 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c012430 con 0x7f1274134260 2023-10-03T10:13:36.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.557+0000 7f127aa77700 1 -- 172.21.15.72:0/1892359599 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1274134260 msgr2=0x7f12741306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.557+0000 7f127aa77700 1 --2- 172.21.15.72:0/1892359599 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1274134260 0x7f12741306a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f126c009dc0 tx=0x7f126c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:36.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.557+0000 7f127aa77700 1 -- 172.21.15.72:0/1892359599 shutdown_connections 2023-10-03T10:13:36.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.557+0000 7f127aa77700 1 --2- 172.21.15.72:0/1892359599 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1274134260 0x7f12741306a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.557+0000 7f127aa77700 1 --2- 172.21.15.72:0/1892359599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1274133420 0x7f12741337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.557+0000 7f127aa77700 1 -- 172.21.15.72:0/1892359599 >> 172.21.15.72:0/1892359599 conn(0x7f12740a4210 msgr2=0x7f12740a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.557+0000 7f127aa77700 1 -- 172.21.15.72:0/1892359599 shutdown_connections 2023-10-03T10:13:36.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.557+0000 7f127aa77700 1 -- 172.21.15.72:0/1892359599 wait complete. 2023-10-03T10:13:36.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.559+0000 7f127aa77700 1 Processor -- start 2023-10-03T10:13:36.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.559+0000 7f127aa77700 1 -- start start 2023-10-03T10:13:36.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f127aa77700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1274133420 0x7f127409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f127aa77700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1274133e30 0x7f127409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f127aa77700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1274134260 0x7f127409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f127aa77700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127411fdb0 con 0x7f1274133420 2023-10-03T10:13:36.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f127aa77700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12741201e0 con 0x7f1274134260 2023-10-03T10:13:36.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f127aa77700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f127411faf0 con 0x7f1274133e30 2023-10-03T10:13:36.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f1279014700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1274134260 0x7f127409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f1279014700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1274134260 0x7f127409cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50792/0 (socket says 172.21.15.72:50792) 2023-10-03T10:13:36.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f1279014700 1 -- 172.21.15.72:0/2576122113 learned_addr learned my addr 172.21.15.72:0/2576122113 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:36.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f1278813700 1 --2- 172.21.15.72:0/2576122113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1274133420 0x7f127409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f1273fff700 1 --2- 172.21.15.72:0/2576122113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1274133e30 0x7f127409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f1273fff700 1 -- 172.21.15.72:0/2576122113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1274134260 msgr2=0x7f127409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f1273fff700 1 --2- 172.21.15.72:0/2576122113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1274134260 0x7f127409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f1273fff700 1 -- 172.21.15.72:0/2576122113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1274133420 msgr2=0x7f127409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f1273fff700 1 --2- 172.21.15.72:0/2576122113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1274133420 0x7f127409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f1273fff700 1 -- 172.21.15.72:0/2576122113 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c009a70 con 0x7f1274133e30 2023-10-03T10:13:36.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.560+0000 7f1279014700 1 --2- 172.21.15.72:0/2576122113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1274134260 0x7f127409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:36.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.561+0000 7f1273fff700 1 --2- 172.21.15.72:0/2576122113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1274133e30 0x7f127409c9c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f126000c4c0 tx=0x7f126000c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.561+0000 7f12717fa700 1 -- 172.21.15.72:0/2576122113 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260005d70 con 0x7f1274133e30 2023-10-03T10:13:36.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.561+0000 7f12717fa700 1 -- 172.21.15.72:0/2576122113 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12600070d0 con 0x7f1274133e30 2023-10-03T10:13:36.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.561+0000 7f12717fa700 1 -- 172.21.15.72:0/2576122113 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260007440 con 0x7f1274133e30 2023-10-03T10:13:36.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.561+0000 7f127aa77700 1 -- 172.21.15.72:0/2576122113 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127411f460 con 0x7f1274133e30 2023-10-03T10:13:36.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.561+0000 7f127aa77700 1 -- 172.21.15.72:0/2576122113 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1274120820 con 0x7f1274133e30 2023-10-03T10:13:36.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.562+0000 7f12717fa700 1 -- 172.21.15.72:0/2576122113 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12600075a0 con 0x7f1274133e30 2023-10-03T10:13:36.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.562+0000 7f127aa77700 1 -- 172.21.15.72:0/2576122113 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127411fff0 con 0x7f1274133e30 2023-10-03T10:13:36.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.562+0000 7f12717fa700 1 -- 172.21.15.72:0/2576122113 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f126003e690 con 0x7f1274133e30 2023-10-03T10:13:36.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.570+0000 7f12717fa700 1 -- 172.21.15.72:0/2576122113 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1260017020 con 0x7f1274133e30 2023-10-03T10:13:36.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.588+0000 7ffb3c34e700 1 Processor -- start 2023-10-03T10:13:36.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.588+0000 7ffb3c34e700 1 -- start start 2023-10-03T10:13:36.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.588+0000 7ffb3c34e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb3409d9f0 0x7ffb34136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.588+0000 7ffb3c34e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffb34136a70 0x7ffb34138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.588+0000 7ffb3c34e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3409e130 con 0x7ffb341316c0 2023-10-03T10:13:36.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.588+0000 7ffb3c34e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb341321a0 con 0x7ffb34136a70 2023-10-03T10:13:36.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.588+0000 7ffb3c34e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb341312b0 con 0x7ffb3409d9f0 2023-10-03T10:13:36.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.589+0000 7ffb398e9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb3409d9f0 0x7ffb34136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.589+0000 7ffb398e9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb3409d9f0 0x7ffb34136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41756/0 (socket says 172.21.15.72:41756) 2023-10-03T10:13:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.589+0000 7ffb398e9700 1 -- 172.21.15.72:0/2580116968 learned_addr learned my addr 172.21.15.72:0/2580116968 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.589+0000 7ffb3a8eb700 1 --2- 172.21.15.72:0/2580116968 >> v2:172.21.15.72:3300/0 conn(0x7ffb34136a70 0x7ffb34138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.589+0000 7ffb398e9700 1 -- 172.21.15.72:0/2580116968 >> v2:172.21.15.72:3300/0 conn(0x7ffb34136a70 msgr2=0x7ffb34138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.589+0000 7ffb398e9700 1 --2- 172.21.15.72:0/2580116968 >> v2:172.21.15.72:3300/0 conn(0x7ffb34136a70 0x7ffb34138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.589+0000 7ffb398e9700 1 -- 172.21.15.72:0/2580116968 >> v1:172.21.15.72:6789/0 conn(0x7ffb341316c0 legacy=0x7ffb34131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.589+0000 7ffb398e9700 1 -- 172.21.15.72:0/2580116968 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3409f6e0 con 0x7ffb3409d9f0 2023-10-03T10:13:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.589+0000 7ffb398e9700 1 --2- 172.21.15.72:0/2580116968 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb3409d9f0 0x7ffb34136530 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffb240098f0 tx=0x7ffb24009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75e7e2cd3e187917 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.589+0000 7ffb390e8700 1 -- 172.21.15.72:0/2580116968 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24011830 con 0x7ffb3409d9f0 2023-10-03T10:13:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.589+0000 7ffb390e8700 1 -- 172.21.15.72:0/2580116968 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb24011990 con 0x7ffb3409d9f0 2023-10-03T10:13:36.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.589+0000 7ffb390e8700 1 -- 172.21.15.72:0/2580116968 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24011d20 con 0x7ffb3409d9f0 2023-10-03T10:13:36.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.590+0000 7ffb3c34e700 1 -- 172.21.15.72:0/2580116968 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb3409d9f0 msgr2=0x7ffb34136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.590+0000 7ffb3c34e700 1 --2- 172.21.15.72:0/2580116968 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb3409d9f0 0x7ffb34136530 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffb240098f0 tx=0x7ffb24009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.590+0000 7ffb3c34e700 1 -- 172.21.15.72:0/2580116968 shutdown_connections 2023-10-03T10:13:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.590+0000 7ffb3c34e700 1 --2- 172.21.15.72:0/2580116968 >> v2:172.21.15.72:3300/0 conn(0x7ffb34136a70 0x7ffb34138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.590+0000 7ffb3c34e700 1 --2- 172.21.15.72:0/2580116968 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb3409d9f0 0x7ffb34136530 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.590+0000 7ffb3c34e700 1 -- 172.21.15.72:0/2580116968 >> 172.21.15.72:0/2580116968 conn(0x7ffb34066f50 msgr2=0x7ffb3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.590+0000 7ffb3c34e700 1 -- 172.21.15.72:0/2580116968 shutdown_connections 2023-10-03T10:13:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.590+0000 7ffb3c34e700 1 -- 172.21.15.72:0/2580116968 wait complete. 2023-10-03T10:13:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.591+0000 7ffb3c34e700 1 Processor -- start 2023-10-03T10:13:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.591+0000 7ffb3c34e700 1 -- start start 2023-10-03T10:13:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3c34e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb3409d9f0 0x7ffb3412ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3c34e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb341316c0 0x7ffb3412b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3c34e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb34136a70 0x7ffb34134360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3c34e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3409b580 con 0x7ffb341316c0 2023-10-03T10:13:36.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3c34e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3406eb90 con 0x7ffb34136a70 2023-10-03T10:13:36.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3c34e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb34072260 con 0x7ffb3409d9f0 2023-10-03T10:13:36.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3a0ea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb3409d9f0 0x7ffb3412ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3a0ea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb3409d9f0 0x7ffb3412ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41762/0 (socket says 172.21.15.72:41762) 2023-10-03T10:13:36.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3a0ea700 1 -- 172.21.15.72:0/3424922234 learned_addr learned my addr 172.21.15.72:0/3424922234 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:36.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb398e9700 1 --2- 172.21.15.72:0/3424922234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb341316c0 0x7ffb3412b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3a8eb700 1 --2- 172.21.15.72:0/3424922234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb34136a70 0x7ffb34134360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3a0ea700 1 -- 172.21.15.72:0/3424922234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb34136a70 msgr2=0x7ffb34134360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3a0ea700 1 --2- 172.21.15.72:0/3424922234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb34136a70 0x7ffb34134360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3a0ea700 1 -- 172.21.15.72:0/3424922234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb341316c0 msgr2=0x7ffb3412b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3a0ea700 1 --2- 172.21.15.72:0/3424922234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb341316c0 0x7ffb3412b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3a0ea700 1 -- 172.21.15.72:0/3424922234 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb24009550 con 0x7ffb3409d9f0 2023-10-03T10:13:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.592+0000 7ffb3a0ea700 1 --2- 172.21.15.72:0/3424922234 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb3409d9f0 0x7ffb3412ab70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000c4e0 tx=0x7ffb3000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.593+0000 7ffb2affd700 1 -- 172.21.15.72:0/3424922234 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb300052d0 con 0x7ffb3409d9f0 2023-10-03T10:13:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.593+0000 7ffb2affd700 1 -- 172.21.15.72:0/3424922234 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb30005430 con 0x7ffb3409d9f0 2023-10-03T10:13:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.593+0000 7ffb2affd700 1 -- 172.21.15.72:0/3424922234 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb300038c0 con 0x7ffb3409d9f0 2023-10-03T10:13:36.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.593+0000 7ffb3c34e700 1 -- 172.21.15.72:0/3424922234 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3409bea0 con 0x7ffb3409d9f0 2023-10-03T10:13:36.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.593+0000 7ffb3c34e700 1 -- 172.21.15.72:0/3424922234 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb34138e60 con 0x7ffb3409d9f0 2023-10-03T10:13:36.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.594+0000 7ffb2affd700 1 -- 172.21.15.72:0/3424922234 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb30003a20 con 0x7ffb3409d9f0 2023-10-03T10:13:36.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.594+0000 7ffb3c34e700 1 -- 172.21.15.72:0/3424922234 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb3412b900 con 0x7ffb3409d9f0 2023-10-03T10:13:36.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.594+0000 7ffb2affd700 1 -- 172.21.15.72:0/3424922234 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb3003e880 con 0x7ffb3409d9f0 2023-10-03T10:13:36.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.595+0000 7f81066a9700 1 Processor -- start 2023-10-03T10:13:36.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.595+0000 7f81066a9700 1 -- start start 2023-10-03T10:13:36.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.595+0000 7f81066a9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f810012cf60 0x7f810006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.595+0000 7f81066a9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8100130430 0x7f8100137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.595+0000 7f81066a9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810012cd90 con 0x7f810012f8b0 2023-10-03T10:13:36.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.595+0000 7f81066a9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810012d330 con 0x7f810012cf60 2023-10-03T10:13:36.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.595+0000 7f81066a9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8100071780 con 0x7f8100130430 2023-10-03T10:13:36.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.595+0000 7f80fffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f810012cf60 0x7f810006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.595+0000 7f80fffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f810012cf60 0x7f810006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51852/0 (socket says 172.21.15.72:51852) 2023-10-03T10:13:36.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.595+0000 7f80fffff700 1 -- 172.21.15.72:0/2303336603 learned_addr learned my addr 172.21.15.72:0/2303336603 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:36.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.596+0000 7f80fffff700 1 -- 172.21.15.72:0/2303336603 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8100130430 msgr2=0x7f8100137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:36.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.596+0000 7f80fffff700 1 --2- 172.21.15.72:0/2303336603 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8100130430 0x7f8100137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.596+0000 7f80fffff700 1 -- 172.21.15.72:0/2303336603 >> v1:172.21.15.72:6789/0 conn(0x7f810012f8b0 legacy=0x7f810012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.596+0000 7f80fffff700 1 -- 172.21.15.72:0/2303336603 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8100071a40 con 0x7f810012cf60 2023-10-03T10:13:36.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.596+0000 7f80fffff700 1 --2- 172.21.15.72:0/2303336603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810012cf60 0x7f810006f5d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f80f40098f0 tx=0x7f80f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcbb4aa0656fe5e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.596+0000 7f80feffd700 1 -- 172.21.15.72:0/2303336603 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4004230 con 0x7f810012cf60 2023-10-03T10:13:36.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.596+0000 7f80feffd700 1 -- 172.21.15.72:0/2303336603 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f4004390 con 0x7f810012cf60 2023-10-03T10:13:36.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.596+0000 7f80feffd700 1 -- 172.21.15.72:0/2303336603 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f40036a0 con 0x7f810012cf60 2023-10-03T10:13:36.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.597+0000 7f81066a9700 1 -- 172.21.15.72:0/2303336603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810012cf60 msgr2=0x7f810006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.597+0000 7f81066a9700 1 --2- 172.21.15.72:0/2303336603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810012cf60 0x7f810006f5d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f80f40098f0 tx=0x7f80f4009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:36.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.597+0000 7f81066a9700 1 -- 172.21.15.72:0/2303336603 shutdown_connections 2023-10-03T10:13:36.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.597+0000 7f81066a9700 1 --2- 172.21.15.72:0/2303336603 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8100130430 0x7f8100137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.597+0000 7f81066a9700 1 --2- 172.21.15.72:0/2303336603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810012cf60 0x7f810006f5d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.597+0000 7f81066a9700 1 -- 172.21.15.72:0/2303336603 >> 172.21.15.72:0/2303336603 conn(0x7f81000a2aa0 msgr2=0x7f81000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.597+0000 7f81066a9700 1 -- 172.21.15.72:0/2303336603 shutdown_connections 2023-10-03T10:13:36.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.597+0000 7f81066a9700 1 -- 172.21.15.72:0/2303336603 wait complete. 2023-10-03T10:13:36.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.598+0000 7f81066a9700 1 Processor -- start 2023-10-03T10:13:36.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.598+0000 7f81066a9700 1 -- start start 2023-10-03T10:13:36.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.599+0000 7f81066a9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f810012cf60 0x7f8100129770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.599+0000 7f81066a9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810012f8b0 0x7f810009aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.599+0000 7f81066a9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8100130430 0x7f810009b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.599+0000 7f81066a9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8100129fa0 con 0x7f810012f8b0 2023-10-03T10:13:36.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.599+0000 7f81066a9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810009c2f0 con 0x7f810012cf60 2023-10-03T10:13:36.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.599+0000 7f81066a9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8100129cb0 con 0x7f8100130430 2023-10-03T10:13:36.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.599+0000 7f80ff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810012f8b0 0x7f810009aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.599+0000 7f80ff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810012f8b0 0x7f810009aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51864/0 (socket says 172.21.15.72:51864) 2023-10-03T10:13:36.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.599+0000 7f80ff7fe700 1 -- 172.21.15.72:0/1121453956 learned_addr learned my addr 172.21.15.72:0/1121453956 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:36.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.599+0000 7f8104c46700 1 --2- 172.21.15.72:0/1121453956 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8100130430 0x7f810009b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.599+0000 7f80ff7fe700 1 -- 172.21.15.72:0/1121453956 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8100130430 msgr2=0x7f810009b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.599+0000 7f80ff7fe700 1 --2- 172.21.15.72:0/1121453956 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8100130430 0x7f810009b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.599+0000 7f80ff7fe700 1 -- 172.21.15.72:0/1121453956 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f810012cf60 msgr2=0x7f8100129770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.599+0000 7f80ff7fe700 1 --2- 172.21.15.72:0/1121453956 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f810012cf60 0x7f8100129770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.599+0000 7f80ff7fe700 1 -- 172.21.15.72:0/1121453956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f4009550 con 0x7f810012f8b0 2023-10-03T10:13:36.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.600+0000 7f80ff7fe700 1 --2- 172.21.15.72:0/1121453956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810012f8b0 0x7f810009aff0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f80f000c650 tx=0x7f80f000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.600+0000 7f80fcff9700 1 -- 172.21.15.72:0/1121453956 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f00054e0 con 0x7f810012f8b0 2023-10-03T10:13:36.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.600+0000 7f80fcff9700 1 -- 172.21.15.72:0/1121453956 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0003680 con 0x7f810012f8b0 2023-10-03T10:13:36.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.600+0000 7f80fcff9700 1 -- 172.21.15.72:0/1121453956 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0003a30 con 0x7f810012f8b0 2023-10-03T10:13:36.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.600+0000 7f81066a9700 1 -- 172.21.15.72:0/1121453956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810012e440 con 0x7f810012f8b0 2023-10-03T10:13:36.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.600+0000 7f81066a9700 1 -- 172.21.15.72:0/1121453956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810009da80 con 0x7f810012f8b0 2023-10-03T10:13:36.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.601+0000 7f81066a9700 1 -- 172.21.15.72:0/1121453956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810009d870 con 0x7f810012f8b0 2023-10-03T10:13:36.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.601+0000 7f80fcff9700 1 -- 172.21.15.72:0/1121453956 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80f0003b90 con 0x7f810012f8b0 2023-10-03T10:13:36.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.601+0000 7ffb2affd700 1 -- 172.21.15.72:0/3424922234 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb30011590 con 0x7ffb3409d9f0 2023-10-03T10:13:36.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.601+0000 7f80fcff9700 1 -- 172.21.15.72:0/1121453956 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f80f0010de0 con 0x7f810012f8b0 2023-10-03T10:13:36.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.606+0000 7f80fcff9700 1 -- 172.21.15.72:0/1121453956 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f810009da80 con 0x7f810012f8b0 2023-10-03T10:13:36.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.717+0000 7fc81ce9b700 1 -- 172.21.15.72:0/3976854408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc8180a28e0 con 0x7fc8180a1340 2023-10-03T10:13:36.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.718+0000 7fc806ffd700 1 -- 172.21.15.72:0/3976854408 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc80c017030 con 0x7fc8180a1340 2023-10-03T10:13:36.719 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.721+0000 7fc81ce9b700 1 -- 172.21.15.72:0/3976854408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180a1340 msgr2=0x7fc818122e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.721+0000 7fc81ce9b700 1 --2- 172.21.15.72:0/3976854408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180a1340 0x7fc818122e20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc80c001eb0 tx=0x7fc80c00c800 comp rx=0 tx=0).stop 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.721+0000 7fc81ce9b700 1 -- 172.21.15.72:0/3976854408 shutdown_connections 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.721+0000 7fc81ce9b700 1 --2- 172.21.15.72:0/3976854408 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc818134170 0x7fc818123360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.721+0000 7fc81ce9b700 1 --2- 172.21.15.72:0/3976854408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8180a0a30 0x7fc8181228e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.721+0000 7fc81ce9b700 1 --2- 172.21.15.72:0/3976854408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8180a1340 0x7fc818122e20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.721+0000 7fc81ce9b700 1 -- 172.21.15.72:0/3976854408 >> 172.21.15.72:0/3976854408 conn(0x7fc8180a6550 msgr2=0x7fc81809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.721+0000 7fc81ce9b700 1 -- 172.21.15.72:0/3976854408 shutdown_connections 2023-10-03T10:13:36.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.721+0000 7fc81ce9b700 1 -- 172.21.15.72:0/3976854408 wait complete. 2023-10-03T10:13:36.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:36.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.795+0000 7ffb3c34e700 1 -- 172.21.15.72:0/3424922234 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffb3409e130 con 0x7ffb3409d9f0 2023-10-03T10:13:36.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.795+0000 7ffb2affd700 1 -- 172.21.15.72:0/3424922234 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffb3409e130 con 0x7ffb3409d9f0 2023-10-03T10:13:36.796 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:36.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.798+0000 7ffb3c34e700 1 -- 172.21.15.72:0/3424922234 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb3409d9f0 msgr2=0x7ffb3412ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.798+0000 7ffb3c34e700 1 --2- 172.21.15.72:0/3424922234 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb3409d9f0 0x7ffb3412ab70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000c4e0 tx=0x7ffb3000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.798+0000 7ffb3c34e700 1 -- 172.21.15.72:0/3424922234 shutdown_connections 2023-10-03T10:13:36.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.798+0000 7ffb3c34e700 1 --2- 172.21.15.72:0/3424922234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb34136a70 0x7ffb34134360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.798+0000 7ffb3c34e700 1 --2- 172.21.15.72:0/3424922234 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb3409d9f0 0x7ffb3412ab70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.798+0000 7ffb3c34e700 1 --2- 172.21.15.72:0/3424922234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb341316c0 0x7ffb3412b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.798+0000 7ffb3c34e700 1 -- 172.21.15.72:0/3424922234 >> 172.21.15.72:0/3424922234 conn(0x7ffb34066f50 msgr2=0x7ffb340a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.799+0000 7ffb3c34e700 1 -- 172.21.15.72:0/3424922234 shutdown_connections 2023-10-03T10:13:36.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.800+0000 7ffb3c34e700 1 -- 172.21.15.72:0/3424922234 wait complete. 2023-10-03T10:13:36.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.806+0000 7f127aa77700 1 -- 172.21.15.72:0/2576122113 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1274074ea0 con 0x7f1274133e30 2023-10-03T10:13:36.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.807+0000 7f12717fa700 1 -- 172.21.15.72:0/2576122113 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1260018af0 con 0x7f1274133e30 2023-10-03T10:13:36.807 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:36.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.809+0000 7f127aa77700 1 -- 172.21.15.72:0/2576122113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1274133e30 msgr2=0x7f127409c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.809+0000 7f127aa77700 1 --2- 172.21.15.72:0/2576122113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1274133e30 0x7f127409c9c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f126000c4c0 tx=0x7f126000c7d0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.809+0000 7f127aa77700 1 -- 172.21.15.72:0/2576122113 shutdown_connections 2023-10-03T10:13:36.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.809+0000 7f127aa77700 1 --2- 172.21.15.72:0/2576122113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1274133420 0x7f127409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.809+0000 7f127aa77700 1 --2- 172.21.15.72:0/2576122113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1274134260 0x7f127409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.809+0000 7f127aa77700 1 --2- 172.21.15.72:0/2576122113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1274133e30 0x7f127409c9c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.809+0000 7f127aa77700 1 -- 172.21.15.72:0/2576122113 >> 172.21.15.72:0/2576122113 conn(0x7f12740a4210 msgr2=0x7f127412de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.809+0000 7f127aa77700 1 -- 172.21.15.72:0/2576122113 shutdown_connections 2023-10-03T10:13:36.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.809+0000 7f127aa77700 1 -- 172.21.15.72:0/2576122113 wait complete. 2023-10-03T10:13:36.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.818+0000 7f81066a9700 1 -- 172.21.15.72:0/1121453956 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f810009da80 con 0x7f810012f8b0 2023-10-03T10:13:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.818+0000 7f80fcff9700 1 -- 172.21.15.72:0/1121453956 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f810009da80 con 0x7f810012f8b0 2023-10-03T10:13:36.819 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:36.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.820+0000 7f81066a9700 1 -- 172.21.15.72:0/1121453956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810012f8b0 msgr2=0x7f810009aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.820+0000 7f81066a9700 1 --2- 172.21.15.72:0/1121453956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810012f8b0 0x7f810009aff0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f80f000c650 tx=0x7f80f000c960 comp rx=0 tx=0).stop 2023-10-03T10:13:36.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.820+0000 7f81066a9700 1 -- 172.21.15.72:0/1121453956 shutdown_connections 2023-10-03T10:13:36.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.820+0000 7f81066a9700 1 --2- 172.21.15.72:0/1121453956 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8100130430 0x7f810009b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.820+0000 7f81066a9700 1 --2- 172.21.15.72:0/1121453956 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f810012cf60 0x7f8100129770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.820+0000 7f81066a9700 1 --2- 172.21.15.72:0/1121453956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f810012f8b0 0x7f810009aff0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.820+0000 7f81066a9700 1 -- 172.21.15.72:0/1121453956 >> 172.21.15.72:0/1121453956 conn(0x7f81000a2aa0 msgr2=0x7f81001b5900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.820+0000 7f81066a9700 1 -- 172.21.15.72:0/1121453956 shutdown_connections 2023-10-03T10:13:36.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:36.820+0000 7f81066a9700 1 -- 172.21.15.72:0/1121453956 wait complete. 2023-10-03T10:13:36.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:36.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:37.739 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:37.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:37.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:37.833 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:37.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.875+0000 7f550c2d8700 1 Processor -- start 2023-10-03T10:13:37.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.875+0000 7f550c2d8700 1 -- start start 2023-10-03T10:13:37.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f550c2d8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550409d6f0 0x7f550409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f550c2d8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f550409e000 0x7f55041339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f550c2d8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f550409e410 0x7f5504133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f550c2d8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550406b460 con 0x7f550409e410 2023-10-03T10:13:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f550c2d8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550409b120 con 0x7f550409d6f0 2023-10-03T10:13:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f550c2d8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f550409a7e0 con 0x7f550409e000 2023-10-03T10:13:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f5509873700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f550409e000 0x7f55041339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f5509873700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f550409e000 0x7f55041339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41794/0 (socket says 172.21.15.72:41794) 2023-10-03T10:13:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f5509873700 1 -- 172.21.15.72:0/2013036709 learned_addr learned my addr 172.21.15.72:0/2013036709 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f550a875700 1 --2- 172.21.15.72:0/2013036709 >> v2:172.21.15.72:3300/0 conn(0x7f550409e410 0x7f5504133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f550a074700 1 --2- 172.21.15.72:0/2013036709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550409d6f0 0x7f550409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f550a074700 1 -- 172.21.15.72:0/2013036709 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f550409e000 msgr2=0x7f55041339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f550a074700 1 --2- 172.21.15.72:0/2013036709 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f550409e000 0x7f55041339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f550a074700 1 -- 172.21.15.72:0/2013036709 >> v2:172.21.15.72:3300/0 conn(0x7f550409e410 msgr2=0x7f5504133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f550a074700 1 --2- 172.21.15.72:0/2013036709 >> v2:172.21.15.72:3300/0 conn(0x7f550409e410 0x7f5504133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f550a074700 1 -- 172.21.15.72:0/2013036709 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550409a500 con 0x7f550409d6f0 2023-10-03T10:13:37.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f5509873700 1 --2- 172.21.15.72:0/2013036709 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f550409e000 0x7f55041339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.876+0000 7f550a875700 1 --2- 172.21.15.72:0/2013036709 >> v2:172.21.15.72:3300/0 conn(0x7f550409e410 0x7f5504133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.877+0000 7f550a074700 1 --2- 172.21.15.72:0/2013036709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550409d6f0 0x7f550409dac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5500009870 tx=0x7f5500009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4992e46f6f97225 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.877+0000 7f5509072700 1 -- 172.21.15.72:0/2013036709 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500011830 con 0x7f550409d6f0 2023-10-03T10:13:37.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.877+0000 7f5509072700 1 -- 172.21.15.72:0/2013036709 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5500011990 con 0x7f550409d6f0 2023-10-03T10:13:37.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.877+0000 7f5509072700 1 -- 172.21.15.72:0/2013036709 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500011d20 con 0x7f550409d6f0 2023-10-03T10:13:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.877+0000 7f550c2d8700 1 -- 172.21.15.72:0/2013036709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550409d6f0 msgr2=0x7f550409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.877+0000 7f550c2d8700 1 --2- 172.21.15.72:0/2013036709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550409d6f0 0x7f550409dac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5500009870 tx=0x7f5500009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.878+0000 7f550c2d8700 1 -- 172.21.15.72:0/2013036709 shutdown_connections 2023-10-03T10:13:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.878+0000 7f550c2d8700 1 --2- 172.21.15.72:0/2013036709 >> v2:172.21.15.72:3300/0 conn(0x7f550409e410 0x7f5504133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.878+0000 7f550c2d8700 1 --2- 172.21.15.72:0/2013036709 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550409d6f0 0x7f550409dac0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.878+0000 7f550c2d8700 1 --2- 172.21.15.72:0/2013036709 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f550409e000 0x7f55041339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.878+0000 7f550c2d8700 1 -- 172.21.15.72:0/2013036709 >> 172.21.15.72:0/2013036709 conn(0x7f5504066f50 msgr2=0x7f550409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.878+0000 7f550c2d8700 1 -- 172.21.15.72:0/2013036709 shutdown_connections 2023-10-03T10:13:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.878+0000 7f550c2d8700 1 -- 172.21.15.72:0/2013036709 wait complete. 2023-10-03T10:13:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.879+0000 7f550c2d8700 1 Processor -- start 2023-10-03T10:13:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.879+0000 7f550c2d8700 1 -- start start 2023-10-03T10:13:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.879+0000 7f550c2d8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550409d6f0 0x7f55041a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.879+0000 7f550c2d8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f550409e000 0x7f55041a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.879+0000 7f550c2d8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550409e410 0x7f55041c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.879+0000 7f550c2d8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55041a8190 con 0x7f550409e410 2023-10-03T10:13:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.879+0000 7f550c2d8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55041a8370 con 0x7f550409d6f0 2023-10-03T10:13:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.879+0000 7f550c2d8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55041b91e0 con 0x7f550409e000 2023-10-03T10:13:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.879+0000 7f550a875700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550409e410 0x7f55041c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.879+0000 7f550a875700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550409e410 0x7f55041c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51888/0 (socket says 172.21.15.72:51888) 2023-10-03T10:13:37.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.879+0000 7f5509873700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f550409e000 0x7f55041a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.879+0000 7f550a875700 1 -- 172.21.15.72:0/1156035812 learned_addr learned my addr 172.21.15.72:0/1156035812 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:37.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.880+0000 7f550a074700 1 --2- 172.21.15.72:0/1156035812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550409d6f0 0x7f55041a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.880+0000 7f550a875700 1 -- 172.21.15.72:0/1156035812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f550409e000 msgr2=0x7f55041a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.880+0000 7f550a875700 1 --2- 172.21.15.72:0/1156035812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f550409e000 0x7f55041a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.880+0000 7f550a875700 1 -- 172.21.15.72:0/1156035812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550409d6f0 msgr2=0x7f55041a52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.880+0000 7f550a875700 1 --2- 172.21.15.72:0/1156035812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550409d6f0 0x7f55041a52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.880+0000 7f550a875700 1 -- 172.21.15.72:0/1156035812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f4009550 con 0x7f550409e410 2023-10-03T10:13:37.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.880+0000 7f550a875700 1 --2- 172.21.15.72:0/1156035812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550409e410 0x7f55041c80b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00efc0 tx=0x7f54fc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.880+0000 7f54faffd700 1 -- 172.21.15.72:0/1156035812 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00cd40 con 0x7f550409e410 2023-10-03T10:13:37.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.880+0000 7f54faffd700 1 -- 172.21.15.72:0/1156035812 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc00f040 con 0x7f550409e410 2023-10-03T10:13:37.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.880+0000 7f550c2d8700 1 -- 172.21.15.72:0/1156035812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54fc009a70 con 0x7f550409e410 2023-10-03T10:13:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.880+0000 7f54faffd700 1 -- 172.21.15.72:0/1156035812 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0146c0 con 0x7f550409e410 2023-10-03T10:13:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.880+0000 7f550c2d8700 1 -- 172.21.15.72:0/1156035812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55000094a0 con 0x7f550409e410 2023-10-03T10:13:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.881+0000 7f54faffd700 1 -- 172.21.15.72:0/1156035812 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f54fc014820 con 0x7f550409e410 2023-10-03T10:13:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.881+0000 7f550c2d8700 1 -- 172.21.15.72:0/1156035812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55040a3000 con 0x7f550409e410 2023-10-03T10:13:37.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.882+0000 7f54faffd700 1 -- 172.21.15.72:0/1156035812 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f54fc040370 con 0x7f550409e410 2023-10-03T10:13:37.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.886+0000 7f54faffd700 1 -- 172.21.15.72:0/1156035812 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54fc007920 con 0x7f550409e410 2023-10-03T10:13:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.951+0000 7fc60003c700 1 Processor -- start 2023-10-03T10:13:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.951+0000 7fc60003c700 1 -- start start 2023-10-03T10:13:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.952+0000 7fc60003c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5f809e1d0 0x7fc5f8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.952+0000 7fc60003c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5f8139170 0x7fc5f813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.952+0000 7fc60003c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f809b120 con 0x7fc5f809d6f0 2023-10-03T10:13:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.952+0000 7fc60003c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f806b460 con 0x7fc5f809e1d0 2023-10-03T10:13:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.952+0000 7fc60003c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f809a7e0 con 0x7fc5f8139170 2023-10-03T10:13:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.952+0000 7fc5fddd8700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc5f809d6f0 0x7fc5f809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43596/0 (socket says 172.21.15.72:43596) 2023-10-03T10:13:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.952+0000 7fc5fd5d7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5f809e1d0 0x7fc5f8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.952+0000 7fc5fddd8700 1 -- 172.21.15.72:0/3242450955 learned_addr learned my addr 172.21.15.72:0/3242450955 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.952+0000 7fc5fe5d9700 1 --2- 172.21.15.72:0/3242450955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5f8139170 0x7fc5f813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.952+0000 7fc5fd5d7700 1 -- 172.21.15.72:0/3242450955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5f8139170 msgr2=0x7fc5f813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.952+0000 7fc5fd5d7700 1 --2- 172.21.15.72:0/3242450955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5f8139170 0x7fc5f813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.952+0000 7fc5fd5d7700 1 -- 172.21.15.72:0/3242450955 >> v1:172.21.15.72:6789/0 conn(0x7fc5f809d6f0 legacy=0x7fc5f809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.952+0000 7fc5fd5d7700 1 -- 172.21.15.72:0/3242450955 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f809a500 con 0x7fc5f809e1d0 2023-10-03T10:13:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.952+0000 7fc5fd5d7700 1 --2- 172.21.15.72:0/3242450955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5f809e1d0 0x7fc5f8138c30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8009870 tx=0x7fc5e8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8878633f0dc526 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.952+0000 7fc5fcdd6700 1 -- 172.21.15.72:0/3242450955 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8011830 con 0x7fc5f809e1d0 2023-10-03T10:13:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.953+0000 7fc5fcdd6700 1 -- 172.21.15.72:0/3242450955 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e8011990 con 0x7fc5f809e1d0 2023-10-03T10:13:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.953+0000 7fc5fcdd6700 1 -- 172.21.15.72:0/3242450955 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8011d20 con 0x7fc5f809e1d0 2023-10-03T10:13:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.954+0000 7fc60003c700 1 -- 172.21.15.72:0/3242450955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5f809e1d0 msgr2=0x7fc5f8138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.954+0000 7fc60003c700 1 --2- 172.21.15.72:0/3242450955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5f809e1d0 0x7fc5f8138c30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8009870 tx=0x7fc5e8009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.954+0000 7fc60003c700 1 -- 172.21.15.72:0/3242450955 shutdown_connections 2023-10-03T10:13:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.954+0000 7fc60003c700 1 --2- 172.21.15.72:0/3242450955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5f8139170 0x7fc5f813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.954+0000 7fc60003c700 1 --2- 172.21.15.72:0/3242450955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5f809e1d0 0x7fc5f8138c30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.954+0000 7fc60003c700 1 -- 172.21.15.72:0/3242450955 >> 172.21.15.72:0/3242450955 conn(0x7fc5f8066f50 msgr2=0x7fc5f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.954+0000 7fc60003c700 1 -- 172.21.15.72:0/3242450955 shutdown_connections 2023-10-03T10:13:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.954+0000 7fc60003c700 1 -- 172.21.15.72:0/3242450955 wait complete. 2023-10-03T10:13:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.955+0000 7fc60003c700 1 Processor -- start 2023-10-03T10:13:37.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.955+0000 7fc60003c700 1 -- start start 2023-10-03T10:13:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.956+0000 7fc60003c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5f809d6f0 0x7fc5f81c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.956+0000 7fc60003c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5f809e1d0 0x7fc5f81c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.956+0000 7fc60003c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5f8139170 0x7fc5f81c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.956+0000 7fc60003c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f8120740 con 0x7fc5f809d6f0 2023-10-03T10:13:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.956+0000 7fc60003c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f81221f0 con 0x7fc5f809e1d0 2023-10-03T10:13:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.956+0000 7fc60003c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f809a0c0 con 0x7fc5f8139170 2023-10-03T10:13:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.956+0000 7fc5fe5d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5f8139170 0x7fc5f81c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.956+0000 7fc5fe5d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5f8139170 0x7fc5f81c8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41818/0 (socket says 172.21.15.72:41818) 2023-10-03T10:13:37.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.956+0000 7fc5fe5d9700 1 -- 172.21.15.72:0/885036952 learned_addr learned my addr 172.21.15.72:0/885036952 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.957+0000 7fc5fe5d9700 1 -- 172.21.15.72:0/885036952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5f809e1d0 msgr2=0x7fc5f81c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.957+0000 7fc5fe5d9700 1 --2- 172.21.15.72:0/885036952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5f809e1d0 0x7fc5f81c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.957+0000 7fc5fe5d9700 1 -- 172.21.15.72:0/885036952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5f809d6f0 msgr2=0x7fc5f81c8360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.957+0000 7fc5fe5d9700 1 --2- 172.21.15.72:0/885036952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5f809d6f0 0x7fc5f81c8360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.957+0000 7fc5fe5d9700 1 -- 172.21.15.72:0/885036952 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e80094a0 con 0x7fc5f8139170 2023-10-03T10:13:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.957+0000 7fc5fe5d9700 1 --2- 172.21.15.72:0/885036952 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5f8139170 0x7fc5f81c8de0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0007e30 tx=0x7fc5f000e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.957+0000 7fc5ee7fc700 1 -- 172.21.15.72:0/885036952 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000eea0 con 0x7fc5f8139170 2023-10-03T10:13:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.957+0000 7fc5ee7fc700 1 -- 172.21.15.72:0/885036952 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f0014420 con 0x7fc5f8139170 2023-10-03T10:13:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.957+0000 7fc60003c700 1 -- 172.21.15.72:0/885036952 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f809c710 con 0x7fc5f8139170 2023-10-03T10:13:37.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.957+0000 7fc60003c700 1 -- 172.21.15.72:0/885036952 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f8122c60 con 0x7fc5f8139170 2023-10-03T10:13:37.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.958+0000 7fc5ee7fc700 1 -- 172.21.15.72:0/885036952 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f00147b0 con 0x7fc5f8139170 2023-10-03T10:13:37.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.958+0000 7fc5ee7fc700 1 -- 172.21.15.72:0/885036952 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5f0014910 con 0x7fc5f8139170 2023-10-03T10:13:37.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.959+0000 7fc5ee7fc700 1 -- 172.21.15.72:0/885036952 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc5f0040030 con 0x7fc5f8139170 2023-10-03T10:13:37.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.959+0000 7fc60003c700 1 -- 172.21.15.72:0/885036952 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f8074ea0 con 0x7fc5f8139170 2023-10-03T10:13:37.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.964+0000 7fc5ee7fc700 1 -- 172.21.15.72:0/885036952 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5f00122e0 con 0x7fc5f8139170 2023-10-03T10:13:37.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.992+0000 7f44a0c49700 1 Processor -- start 2023-10-03T10:13:37.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.992+0000 7f44a0c49700 1 -- start start 2023-10-03T10:13:37.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f44a0c49700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f449c09d6f0 0x7f449c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f44a0c49700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f449c09e410 0x7f449c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f44a0c49700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449c09b120 con 0x7f449c09e000 2023-10-03T10:13:37.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f44a0c49700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c06b460 con 0x7f449c09e410 2023-10-03T10:13:37.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f44a0c49700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f449c09a7e0 con 0x7f449c09d6f0 2023-10-03T10:13:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f449a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f449c09d6f0 0x7f449c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f449a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f449c09d6f0 0x7f449c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41822/0 (socket says 172.21.15.72:41822) 2023-10-03T10:13:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f449a59c700 1 -- 172.21.15.72:0/4255399840 learned_addr learned my addr 172.21.15.72:0/4255399840 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f449a59c700 1 -- 172.21.15.72:0/4255399840 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f449c09e410 msgr2=0x7f449c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f449ad9d700 1 --2- 172.21.15.72:0/4255399840 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f449c09e410 0x7f449c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f449959a700 1 -- 172.21.15.72:0/4255399840 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342601771 0 0) 0x7f449c09b120 con 0x7f449c09e000 2023-10-03T10:13:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f449a59c700 1 --2- 172.21.15.72:0/4255399840 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f449c09e410 0x7f449c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f449a59c700 1 -- 172.21.15.72:0/4255399840 >> v1:172.21.15.72:6789/0 conn(0x7f449c09e000 legacy=0x7f449c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f449a59c700 1 -- 172.21.15.72:0/4255399840 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c09a500 con 0x7f449c09d6f0 2023-10-03T10:13:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f449ad9d700 1 --2- 172.21.15.72:0/4255399840 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f449c09e410 0x7f449c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.993+0000 7f449a59c700 1 --2- 172.21.15.72:0/4255399840 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f449c09d6f0 0x7f449c09dac0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f448c009950 tx=0x7f448c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d2c96655fdb222 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.994+0000 7f449959a700 1 -- 172.21.15.72:0/4255399840 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c009ea0 con 0x7f449c09d6f0 2023-10-03T10:13:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.994+0000 7f449959a700 1 -- 172.21.15.72:0/4255399840 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c00ba20 con 0x7f449c09d6f0 2023-10-03T10:13:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.994+0000 7f449959a700 1 -- 172.21.15.72:0/4255399840 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c00bdb0 con 0x7f449c09d6f0 2023-10-03T10:13:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.994+0000 7f44a0c49700 1 -- 172.21.15.72:0/4255399840 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f449c09d6f0 msgr2=0x7f449c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.994+0000 7f44a0c49700 1 --2- 172.21.15.72:0/4255399840 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f449c09d6f0 0x7f449c09dac0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f448c009950 tx=0x7f448c009c60 comp rx=0 tx=0).stop 2023-10-03T10:13:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.994+0000 7f44a0c49700 1 -- 172.21.15.72:0/4255399840 shutdown_connections 2023-10-03T10:13:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.994+0000 7f44a0c49700 1 --2- 172.21.15.72:0/4255399840 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f449c09e410 0x7f449c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.994+0000 7f44a0c49700 1 --2- 172.21.15.72:0/4255399840 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f449c09d6f0 0x7f449c09dac0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.994+0000 7f44a0c49700 1 -- 172.21.15.72:0/4255399840 >> 172.21.15.72:0/4255399840 conn(0x7f449c066f50 msgr2=0x7f449c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.994+0000 7f44a0c49700 1 -- 172.21.15.72:0/4255399840 shutdown_connections 2023-10-03T10:13:37.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.995+0000 7f44a0c49700 1 -- 172.21.15.72:0/4255399840 wait complete. 2023-10-03T10:13:37.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.996+0000 7f44a0c49700 1 Processor -- start 2023-10-03T10:13:37.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.996+0000 7f44a0c49700 1 -- start start 2023-10-03T10:13:37.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.996+0000 7f44a0c49700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f449c09d6f0 0x7f449c1226a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.996+0000 7f44a0c49700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f449c09e000 0x7f449c122be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.996+0000 7f44a0c49700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f449c09e410 0x7f449c123120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.996+0000 7f44a0c49700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c1258a0 con 0x7f449c09e410 2023-10-03T10:13:37.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.996+0000 7f44a0c49700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c133250 con 0x7f449c09e000 2023-10-03T10:13:37.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.996+0000 7f44a0c49700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f449c1242b0 con 0x7f449c09d6f0 2023-10-03T10:13:37.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.996+0000 7f449a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f449c09d6f0 0x7f449c1226a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.996+0000 7f449a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f449c09d6f0 0x7f449c1226a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41832/0 (socket says 172.21.15.72:41832) 2023-10-03T10:13:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.996+0000 7f449a59c700 1 -- 172.21.15.72:0/4091121456 learned_addr learned my addr 172.21.15.72:0/4091121456 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.996+0000 7f449ad9d700 1 --2- 172.21.15.72:0/4091121456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f449c09e410 0x7f449c123120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.996+0000 7f4499d9b700 1 --2- 172.21.15.72:0/4091121456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f449c09e000 0x7f449c122be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.997+0000 7f449ad9d700 1 -- 172.21.15.72:0/4091121456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f449c09d6f0 msgr2=0x7f449c1226a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.997+0000 7f449ad9d700 1 --2- 172.21.15.72:0/4091121456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f449c09d6f0 0x7f449c1226a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.997+0000 7f449ad9d700 1 -- 172.21.15.72:0/4091121456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f449c09e000 msgr2=0x7f449c122be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.997+0000 7f449ad9d700 1 --2- 172.21.15.72:0/4091121456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f449c09e000 0x7f449c122be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.997+0000 7f449ad9d700 1 -- 172.21.15.72:0/4091121456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c009550 con 0x7f449c09e410 2023-10-03T10:13:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.997+0000 7f449a59c700 1 --2- 172.21.15.72:0/4091121456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f449c09d6f0 0x7f449c1226a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.997+0000 7f449ad9d700 1 --2- 172.21.15.72:0/4091121456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f449c09e410 0x7f449c123120 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f449400ce20 tx=0x7f449400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.997+0000 7f448affd700 1 -- 172.21.15.72:0/4091121456 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449400ac40 con 0x7f449c09e410 2023-10-03T10:13:38.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.997+0000 7f448affd700 1 -- 172.21.15.72:0/4091121456 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449400ada0 con 0x7f449c09e410 2023-10-03T10:13:38.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.997+0000 7f44a0c49700 1 -- 172.21.15.72:0/4091121456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449c0a19d0 con 0x7f449c09e410 2023-10-03T10:13:38.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.997+0000 7f448affd700 1 -- 172.21.15.72:0/4091121456 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494015680 con 0x7f449c09e410 2023-10-03T10:13:38.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.997+0000 7f44a0c49700 1 -- 172.21.15.72:0/4091121456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449c126210 con 0x7f449c09e410 2023-10-03T10:13:38.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.998+0000 7f448affd700 1 -- 172.21.15.72:0/4091121456 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f449400d430 con 0x7f449c09e410 2023-10-03T10:13:38.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.998+0000 7f448affd700 1 -- 172.21.15.72:0/4091121456 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f449403f8c0 con 0x7f449c09e410 2023-10-03T10:13:38.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:37.998+0000 7f44a0c49700 1 -- 172.21.15.72:0/4091121456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449c126210 con 0x7f449c09e410 2023-10-03T10:13:38.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.007+0000 7f448affd700 1 -- 172.21.15.72:0/4091121456 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f449c126210 con 0x7f449c09e410 2023-10-03T10:13:38.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.007+0000 7f4ce31e5700 1 Processor -- start 2023-10-03T10:13:38.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.007+0000 7f4ce31e5700 1 -- start start 2023-10-03T10:13:38.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.007+0000 7f4ce31e5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cdc09d6f0 0x7f4cdc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4ce31e5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4cdc09e410 0x7f4cdc130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4ce31e5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cdc09f130 con 0x7f4cdc09e000 2023-10-03T10:13:38.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4ce31e5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cdc09f520 con 0x7f4cdc09e410 2023-10-03T10:13:38.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4ce31e5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc09e930 con 0x7f4cdc09d6f0 2023-10-03T10:13:38.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4ce1782700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4cdc09e410 0x7f4cdc130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4ce0f81700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cdc09d6f0 0x7f4cdc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4ce1782700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4cdc09e410 0x7f4cdc130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51910/0 (socket says 172.21.15.72:51910) 2023-10-03T10:13:38.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4ce1782700 1 -- 172.21.15.72:0/1068724986 learned_addr learned my addr 172.21.15.72:0/1068724986 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:38.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4cdbfff700 1 --1- 172.21.15.72:0/1068724986 >> v1:172.21.15.72:6789/0 conn(0x7f4cdc09e000 0x7f4cdc130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43618/0 (socket says 172.21.15.72:43618) 2023-10-03T10:13:38.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4ce1782700 1 -- 172.21.15.72:0/1068724986 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cdc09d6f0 msgr2=0x7f4cdc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4ce1782700 1 --2- 172.21.15.72:0/1068724986 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cdc09d6f0 0x7f4cdc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4ce1782700 1 -- 172.21.15.72:0/1068724986 >> v1:172.21.15.72:6789/0 conn(0x7f4cdc09e000 legacy=0x7f4cdc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4cdb7fe700 1 -- 172.21.15.72:0/1068724986 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198016850 0 0) 0x7f4cdc09f130 con 0x7f4cdc09e000 2023-10-03T10:13:38.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4ce1782700 1 -- 172.21.15.72:0/1068724986 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc09b2d0 con 0x7f4cdc09e410 2023-10-03T10:13:38.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4ce0f81700 1 --2- 172.21.15.72:0/1068724986 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cdc09d6f0 0x7f4cdc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4ce1782700 1 --2- 172.21.15.72:0/1068724986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cdc09e410 0x7f4cdc130d70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009e50 tx=0x7f4cd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9443da97147ad846 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.008+0000 7f4cdb7fe700 1 -- 172.21.15.72:0/1068724986 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd400e070 con 0x7f4cdc09e410 2023-10-03T10:13:38.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.009+0000 7f4cdb7fe700 1 -- 172.21.15.72:0/1068724986 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd400b910 con 0x7f4cdc09e410 2023-10-03T10:13:38.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.009+0000 7f4cdb7fe700 1 -- 172.21.15.72:0/1068724986 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd400bcc0 con 0x7f4cdc09e410 2023-10-03T10:13:38.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.009+0000 7f4ce31e5700 1 -- 172.21.15.72:0/1068724986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cdc09e410 msgr2=0x7f4cdc130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.009+0000 7f4ce31e5700 1 --2- 172.21.15.72:0/1068724986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cdc09e410 0x7f4cdc130d70 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009e50 tx=0x7f4cd400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:38.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.009+0000 7f4ce31e5700 1 -- 172.21.15.72:0/1068724986 shutdown_connections 2023-10-03T10:13:38.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.009+0000 7f4ce31e5700 1 --2- 172.21.15.72:0/1068724986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cdc09e410 0x7f4cdc130d70 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.009+0000 7f4ce31e5700 1 --2- 172.21.15.72:0/1068724986 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cdc09d6f0 0x7f4cdc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.009+0000 7f4ce31e5700 1 -- 172.21.15.72:0/1068724986 >> 172.21.15.72:0/1068724986 conn(0x7f4cdc066f50 msgr2=0x7f4cdc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.009+0000 7f4ce31e5700 1 -- 172.21.15.72:0/1068724986 shutdown_connections 2023-10-03T10:13:38.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.009+0000 7f4ce31e5700 1 -- 172.21.15.72:0/1068724986 wait complete. 2023-10-03T10:13:38.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.010+0000 7f4ce31e5700 1 Processor -- start 2023-10-03T10:13:38.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.010+0000 7f4ce31e5700 1 -- start start 2023-10-03T10:13:38.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce31e5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cdc09d6f0 0x7f4cdc11dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce31e5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cdc09e000 0x7f4cdc11e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce31e5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cdc09e410 0x7f4cdc11e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce31e5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc11f9f0 con 0x7f4cdc09e410 2023-10-03T10:13:38.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce31e5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc120010 con 0x7f4cdc09d6f0 2023-10-03T10:13:38.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce31e5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc120c40 con 0x7f4cdc09e000 2023-10-03T10:13:38.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce0f81700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cdc09d6f0 0x7f4cdc11dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce0f81700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cdc09d6f0 0x7f4cdc11dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50868/0 (socket says 172.21.15.72:50868) 2023-10-03T10:13:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce0f81700 1 -- 172.21.15.72:0/2465259269 learned_addr learned my addr 172.21.15.72:0/2465259269 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce1782700 1 --2- 172.21.15.72:0/2465259269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cdc09e410 0x7f4cdc11e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce0f81700 1 -- 172.21.15.72:0/2465259269 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cdc09e000 msgr2=0x7f4cdc11e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce0f81700 1 --2- 172.21.15.72:0/2465259269 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cdc09e000 0x7f4cdc11e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce0f81700 1 -- 172.21.15.72:0/2465259269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cdc09e410 msgr2=0x7f4cdc11e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce0f81700 1 --2- 172.21.15.72:0/2465259269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cdc09e410 0x7f4cdc11e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce0f81700 1 -- 172.21.15.72:0/2465259269 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd00094a0 con 0x7f4cdc09d6f0 2023-10-03T10:13:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.011+0000 7f4ce1782700 1 --2- 172.21.15.72:0/2465259269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cdc09e410 0x7f4cdc11e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.012+0000 7f4ce0f81700 1 --2- 172.21.15.72:0/2465259269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cdc09d6f0 0x7f4cdc11dde0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000ec10 tx=0x7f4cd000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.012+0000 7f4cd97fa700 1 -- 172.21.15.72:0/2465259269 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd000c850 con 0x7f4cdc09d6f0 2023-10-03T10:13:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.012+0000 7f4cd97fa700 1 -- 172.21.15.72:0/2465259269 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd000c9b0 con 0x7f4cdc09d6f0 2023-10-03T10:13:38.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.012+0000 7f4ce31e5700 1 -- 172.21.15.72:0/2465259269 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd4009b30 con 0x7f4cdc09d6f0 2023-10-03T10:13:38.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.012+0000 7f4cd97fa700 1 -- 172.21.15.72:0/2465259269 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd000cd40 con 0x7f4cdc09d6f0 2023-10-03T10:13:38.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.012+0000 7f4ce31e5700 1 -- 172.21.15.72:0/2465259269 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cdc09c700 con 0x7f4cdc09d6f0 2023-10-03T10:13:38.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.013+0000 7f4ce31e5700 1 -- 172.21.15.72:0/2465259269 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cdc11ac20 con 0x7f4cdc09d6f0 2023-10-03T10:13:38.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.013+0000 7f4cd97fa700 1 -- 172.21.15.72:0/2465259269 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4cd0013470 con 0x7f4cdc09d6f0 2023-10-03T10:13:38.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.013+0000 7f4cd97fa700 1 -- 172.21.15.72:0/2465259269 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4cd003ff20 con 0x7f4cdc09d6f0 2023-10-03T10:13:38.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.018+0000 7f4cd97fa700 1 -- 172.21.15.72:0/2465259269 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4cd0013720 con 0x7f4cdc09d6f0 2023-10-03T10:13:38.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.110+0000 7f550c2d8700 1 -- 172.21.15.72:0/1156035812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f550409c710 con 0x7f550409e410 2023-10-03T10:13:38.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.111+0000 7f54faffd700 1 -- 172.21.15.72:0/1156035812 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54fc009d70 con 0x7f550409e410 2023-10-03T10:13:38.111 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:38.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.113+0000 7f550c2d8700 1 -- 172.21.15.72:0/1156035812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550409e410 msgr2=0x7f55041c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.113+0000 7f550c2d8700 1 --2- 172.21.15.72:0/1156035812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550409e410 0x7f55041c80b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00efc0 tx=0x7f54fc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.113+0000 7f550c2d8700 1 -- 172.21.15.72:0/1156035812 shutdown_connections 2023-10-03T10:13:38.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.113+0000 7f550c2d8700 1 --2- 172.21.15.72:0/1156035812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550409e410 0x7f55041c80b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.113+0000 7f550c2d8700 1 --2- 172.21.15.72:0/1156035812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550409d6f0 0x7f55041a52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.113+0000 7f550c2d8700 1 --2- 172.21.15.72:0/1156035812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f550409e000 0x7f55041a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.113+0000 7f550c2d8700 1 -- 172.21.15.72:0/1156035812 >> 172.21.15.72:0/1156035812 conn(0x7f5504066f50 msgr2=0x7f550406f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.113+0000 7f550c2d8700 1 -- 172.21.15.72:0/1156035812 shutdown_connections 2023-10-03T10:13:38.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.113+0000 7f550c2d8700 1 -- 172.21.15.72:0/1156035812 wait complete. 2023-10-03T10:13:38.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:38.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.179+0000 7fc60003c700 1 -- 172.21.15.72:0/885036952 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc5f809f420 con 0x7fc5f8139170 2023-10-03T10:13:38.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.180+0000 7fc5ee7fc700 1 -- 172.21.15.72:0/885036952 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc5f001bb00 con 0x7fc5f8139170 2023-10-03T10:13:38.181 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:38.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.182+0000 7fc60003c700 1 -- 172.21.15.72:0/885036952 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5f8139170 msgr2=0x7fc5f81c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.182+0000 7fc60003c700 1 --2- 172.21.15.72:0/885036952 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5f8139170 0x7fc5f81c8de0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0007e30 tx=0x7fc5f000e3c0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.182+0000 7fc60003c700 1 -- 172.21.15.72:0/885036952 shutdown_connections 2023-10-03T10:13:38.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.182+0000 7fc60003c700 1 --2- 172.21.15.72:0/885036952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5f809d6f0 0x7fc5f81c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.182+0000 7fc60003c700 1 --2- 172.21.15.72:0/885036952 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5f8139170 0x7fc5f81c8de0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.182+0000 7fc60003c700 1 --2- 172.21.15.72:0/885036952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5f809e1d0 0x7fc5f81c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.182+0000 7fc60003c700 1 -- 172.21.15.72:0/885036952 >> 172.21.15.72:0/885036952 conn(0x7fc5f8066f50 msgr2=0x7fc5f8134c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.182+0000 7fc60003c700 1 -- 172.21.15.72:0/885036952 shutdown_connections 2023-10-03T10:13:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.182+0000 7fc60003c700 1 -- 172.21.15.72:0/885036952 wait complete. 2023-10-03T10:13:38.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:38.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.215+0000 7f4ce31e5700 1 -- 172.21.15.72:0/2465259269 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4cdc074ea0 con 0x7f4cdc09d6f0 2023-10-03T10:13:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.215+0000 7f4cd97fa700 1 -- 172.21.15.72:0/2465259269 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4cd002a090 con 0x7f4cdc09d6f0 2023-10-03T10:13:38.216 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:38.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.218+0000 7f4ce31e5700 1 -- 172.21.15.72:0/2465259269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cdc09d6f0 msgr2=0x7f4cdc11dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.218+0000 7f4ce31e5700 1 --2- 172.21.15.72:0/2465259269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cdc09d6f0 0x7f4cdc11dde0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000ec10 tx=0x7f4cd000ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:38.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.218+0000 7f4ce31e5700 1 -- 172.21.15.72:0/2465259269 shutdown_connections 2023-10-03T10:13:38.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.218+0000 7f4ce31e5700 1 --2- 172.21.15.72:0/2465259269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4cdc09e410 0x7f4cdc11e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.218+0000 7f4ce31e5700 1 --2- 172.21.15.72:0/2465259269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4cdc09d6f0 0x7f4cdc11dde0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.218+0000 7f4ce31e5700 1 --2- 172.21.15.72:0/2465259269 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4cdc09e000 0x7f4cdc11e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.219+0000 7f4ce31e5700 1 -- 172.21.15.72:0/2465259269 >> 172.21.15.72:0/2465259269 conn(0x7f4cdc066f50 msgr2=0x7f4cdc130970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.219+0000 7f4ce31e5700 1 -- 172.21.15.72:0/2465259269 shutdown_connections 2023-10-03T10:13:38.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.219+0000 7f4ce31e5700 1 -- 172.21.15.72:0/2465259269 wait complete. 2023-10-03T10:13:38.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.228+0000 7f44a0c49700 1 -- 172.21.15.72:0/4091121456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f449c126210 con 0x7f449c09e410 2023-10-03T10:13:38.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.229+0000 7f448affd700 1 -- 172.21.15.72:0/4091121456 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f449c126210 con 0x7f449c09e410 2023-10-03T10:13:38.230 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:38.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.232+0000 7f44a0c49700 1 -- 172.21.15.72:0/4091121456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f449c09e410 msgr2=0x7f449c123120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.232+0000 7f44a0c49700 1 --2- 172.21.15.72:0/4091121456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f449c09e410 0x7f449c123120 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f449400ce20 tx=0x7f449400ce50 comp rx=0 tx=0).stop 2023-10-03T10:13:38.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.232+0000 7f44a0c49700 1 -- 172.21.15.72:0/4091121456 shutdown_connections 2023-10-03T10:13:38.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.232+0000 7f44a0c49700 1 --2- 172.21.15.72:0/4091121456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f449c09e410 0x7f449c123120 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.232+0000 7f44a0c49700 1 --2- 172.21.15.72:0/4091121456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f449c09d6f0 0x7f449c1226a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.232+0000 7f44a0c49700 1 --2- 172.21.15.72:0/4091121456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f449c09e000 0x7f449c122be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.232+0000 7f44a0c49700 1 -- 172.21.15.72:0/4091121456 >> 172.21.15.72:0/4091121456 conn(0x7f449c066f50 msgr2=0x7f449c133e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.232+0000 7f44a0c49700 1 -- 172.21.15.72:0/4091121456 shutdown_connections 2023-10-03T10:13:38.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:38.232+0000 7f44a0c49700 1 -- 172.21.15.72:0/4091121456 wait complete. 2023-10-03T10:13:38.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:38.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:39.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:39.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:39.236 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:39.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.264+0000 7fe5731f0700 1 Processor -- start 2023-10-03T10:13:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.265+0000 7fe5731f0700 1 -- start start 2023-10-03T10:13:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.265+0000 7fe5731f0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe56c09d6f0 0x7fe56c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.265+0000 7fe5731f0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe56c09e000 0x7fe56c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.265+0000 7fe5731f0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe56c09e410 0x7fe56c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.265+0000 7fe5731f0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56c09f520 con 0x7fe56c09e000 2023-10-03T10:13:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.265+0000 7fe5731f0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c09f130 con 0x7fe56c09d6f0 2023-10-03T10:13:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.265+0000 7fe5731f0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c09e930 con 0x7fe56c09e410 2023-10-03T10:13:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.265+0000 7fe56bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe56c09e000 0x7fe56c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.265+0000 7fe570f8c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe56c09d6f0 0x7fe56c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.265+0000 7fe56bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe56c09e000 0x7fe56c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46462/0 (socket says 172.21.15.72:46462) 2023-10-03T10:13:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.265+0000 7fe56bfff700 1 -- 172.21.15.72:0/1516349017 learned_addr learned my addr 172.21.15.72:0/1516349017 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.265+0000 7fe57178d700 1 --2- 172.21.15.72:0/1516349017 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe56c09e410 0x7fe56c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.266+0000 7fe56bfff700 1 -- 172.21.15.72:0/1516349017 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe56c09e410 msgr2=0x7fe56c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.266+0000 7fe56bfff700 1 --2- 172.21.15.72:0/1516349017 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe56c09e410 0x7fe56c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.266+0000 7fe56bfff700 1 -- 172.21.15.72:0/1516349017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe56c09d6f0 msgr2=0x7fe56c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.266+0000 7fe56bfff700 1 --2- 172.21.15.72:0/1516349017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe56c09d6f0 0x7fe56c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.266+0000 7fe56bfff700 1 -- 172.21.15.72:0/1516349017 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c09b2d0 con 0x7fe56c09e000 2023-10-03T10:13:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.266+0000 7fe570f8c700 1 --2- 172.21.15.72:0/1516349017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe56c09d6f0 0x7fe56c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.266+0000 7fe56bfff700 1 --2- 172.21.15.72:0/1516349017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe56c09e000 0x7fe56c130660 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe558009920 tx=0x7fe558009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f147e52f8a4589 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.266+0000 7fe56b7fe700 1 -- 172.21.15.72:0/1516349017 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558011830 con 0x7fe56c09e000 2023-10-03T10:13:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.266+0000 7fe56b7fe700 1 -- 172.21.15.72:0/1516349017 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe558011990 con 0x7fe56c09e000 2023-10-03T10:13:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.266+0000 7fe56b7fe700 1 -- 172.21.15.72:0/1516349017 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558011d20 con 0x7fe56c09e000 2023-10-03T10:13:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.267+0000 7fe5731f0700 1 -- 172.21.15.72:0/1516349017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe56c09e000 msgr2=0x7fe56c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.267+0000 7fe5731f0700 1 --2- 172.21.15.72:0/1516349017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe56c09e000 0x7fe56c130660 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe558009920 tx=0x7fe558009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.267+0000 7fe5731f0700 1 -- 172.21.15.72:0/1516349017 shutdown_connections 2023-10-03T10:13:39.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.267+0000 7fe5731f0700 1 --2- 172.21.15.72:0/1516349017 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe56c09e410 0x7fe56c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.267+0000 7fe5731f0700 1 --2- 172.21.15.72:0/1516349017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe56c09d6f0 0x7fe56c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.267+0000 7fe5731f0700 1 --2- 172.21.15.72:0/1516349017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe56c09e000 0x7fe56c130660 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.267+0000 7fe5731f0700 1 -- 172.21.15.72:0/1516349017 >> 172.21.15.72:0/1516349017 conn(0x7fe56c066f50 msgr2=0x7fe56c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.267+0000 7fe5731f0700 1 -- 172.21.15.72:0/1516349017 shutdown_connections 2023-10-03T10:13:39.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.267+0000 7fe5731f0700 1 -- 172.21.15.72:0/1516349017 wait complete. 2023-10-03T10:13:39.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.268+0000 7fe5731f0700 1 Processor -- start 2023-10-03T10:13:39.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.268+0000 7fe5731f0700 1 -- start start 2023-10-03T10:13:39.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.268+0000 7fe5731f0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe56c09d6f0 0x7fe56c06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.268+0000 7fe5731f0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe56c09e000 0x7fe56c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.268+0000 7fe5731f0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe56c09e410 0x7fe56c06f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.268+0000 7fe5731f0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c125e50 con 0x7fe56c09e410 2023-10-03T10:13:39.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.268+0000 7fe5731f0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c1258b0 con 0x7fe56c09e000 2023-10-03T10:13:39.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.268+0000 7fe5731f0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c0717c0 con 0x7fe56c09d6f0 2023-10-03T10:13:39.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.268+0000 7fe570f8c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe56c09d6f0 0x7fe56c06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.269+0000 7fe57178d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe56c09e410 0x7fe56c06f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.269+0000 7fe570f8c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe56c09d6f0 0x7fe56c06e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38332/0 (socket says 172.21.15.72:38332) 2023-10-03T10:13:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.269+0000 7fe570f8c700 1 -- 172.21.15.72:0/3758008378 learned_addr learned my addr 172.21.15.72:0/3758008378 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.269+0000 7fe570f8c700 1 -- 172.21.15.72:0/3758008378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe56c09e000 msgr2=0x7fe56c06edb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.269+0000 7fe570f8c700 1 --2- 172.21.15.72:0/3758008378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe56c09e000 0x7fe56c06edb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.269+0000 7fe570f8c700 1 -- 172.21.15.72:0/3758008378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe56c09e410 msgr2=0x7fe56c06f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.269+0000 7fe570f8c700 1 --2- 172.21.15.72:0/3758008378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe56c09e410 0x7fe56c06f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.269+0000 7fe570f8c700 1 -- 172.21.15.72:0/3758008378 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5600094a0 con 0x7fe56c09d6f0 2023-10-03T10:13:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.269+0000 7fe570f8c700 1 --2- 172.21.15.72:0/3758008378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe56c09d6f0 0x7fe56c06e870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe56000ebe0 tx=0x7fe56000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.269+0000 7fe5697fa700 1 -- 172.21.15.72:0/3758008378 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560009780 con 0x7fe56c09d6f0 2023-10-03T10:13:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.269+0000 7fe5697fa700 1 -- 172.21.15.72:0/3758008378 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56000c850 con 0x7fe56c09d6f0 2023-10-03T10:13:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.269+0000 7fe5697fa700 1 -- 172.21.15.72:0/3758008378 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56000cbe0 con 0x7fe56c09d6f0 2023-10-03T10:13:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.269+0000 7fe5731f0700 1 -- 172.21.15.72:0/3758008378 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe558009550 con 0x7fe56c09d6f0 2023-10-03T10:13:39.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.269+0000 7fe5731f0700 1 -- 172.21.15.72:0/3758008378 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56c070480 con 0x7fe56c09d6f0 2023-10-03T10:13:39.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.270+0000 7fe5697fa700 1 -- 172.21.15.72:0/3758008378 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe56000cd40 con 0x7fe56c09d6f0 2023-10-03T10:13:39.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.271+0000 7fe5697fa700 1 -- 172.21.15.72:0/3758008378 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe56003fb60 con 0x7fe56c09d6f0 2023-10-03T10:13:39.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.271+0000 7fe5731f0700 1 -- 172.21.15.72:0/3758008378 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56c074ea0 con 0x7fe56c09d6f0 2023-10-03T10:13:39.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.279+0000 7fe5697fa700 1 -- 172.21.15.72:0/3758008378 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe56001b3b0 con 0x7fe56c09d6f0 2023-10-03T10:13:39.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.344+0000 7f4e5bc9d700 1 Processor -- start 2023-10-03T10:13:39.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.344+0000 7f4e5bc9d700 1 -- start start 2023-10-03T10:13:39.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.345+0000 7f4e5bc9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5409d6f0 0x7f4e5409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.345+0000 7f4e5bc9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5409e000 0x7f4e541339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.345+0000 7f4e5bc9d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5409b120 con 0x7f4e5409e410 2023-10-03T10:13:39.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.345+0000 7f4e5bc9d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5406b460 con 0x7f4e5409d6f0 2023-10-03T10:13:39.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.345+0000 7f4e5bc9d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5409a7e0 con 0x7f4e5409e000 2023-10-03T10:13:39.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.345+0000 7f4e59238700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5409e000 0x7f4e541339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.345+0000 7f4e59238700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5409e000 0x7f4e541339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38340/0 (socket says 172.21.15.72:38340) 2023-10-03T10:13:39.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.345+0000 7f4e59238700 1 -- 172.21.15.72:0/2722192480 learned_addr learned my addr 172.21.15.72:0/2722192480 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:39.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.345+0000 7f4e59a39700 1 --2- 172.21.15.72:0/2722192480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5409d6f0 0x7f4e5409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.346+0000 7f4e59a39700 1 -- 172.21.15.72:0/2722192480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5409e000 msgr2=0x7f4e541339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.346+0000 7f4e59a39700 1 --2- 172.21.15.72:0/2722192480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5409e000 0x7f4e541339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.346+0000 7f4e59a39700 1 -- 172.21.15.72:0/2722192480 >> v1:172.21.15.72:6789/0 conn(0x7f4e5409e410 legacy=0x7f4e54133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.346+0000 7f4e59a39700 1 -- 172.21.15.72:0/2722192480 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5409a500 con 0x7f4e5409d6f0 2023-10-03T10:13:39.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.346+0000 7f4e59a39700 1 --2- 172.21.15.72:0/2722192480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5409d6f0 0x7f4e5409dac0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009870 tx=0x7f4e50009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=570424ee461a184c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.346+0000 7f4e58a37700 1 -- 172.21.15.72:0/2722192480 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50011830 con 0x7f4e5409d6f0 2023-10-03T10:13:39.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.346+0000 7f4e58a37700 1 -- 172.21.15.72:0/2722192480 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e50011990 con 0x7f4e5409d6f0 2023-10-03T10:13:39.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.346+0000 7f4e58a37700 1 -- 172.21.15.72:0/2722192480 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50011d20 con 0x7f4e5409d6f0 2023-10-03T10:13:39.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.347+0000 7f4e5bc9d700 1 -- 172.21.15.72:0/2722192480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5409d6f0 msgr2=0x7f4e5409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.347+0000 7f4e5bc9d700 1 --2- 172.21.15.72:0/2722192480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5409d6f0 0x7f4e5409dac0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009870 tx=0x7f4e50009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:39.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.347+0000 7f4e5bc9d700 1 -- 172.21.15.72:0/2722192480 shutdown_connections 2023-10-03T10:13:39.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.347+0000 7f4e5bc9d700 1 --2- 172.21.15.72:0/2722192480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5409d6f0 0x7f4e5409dac0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.347+0000 7f4e5bc9d700 1 --2- 172.21.15.72:0/2722192480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5409e000 0x7f4e541339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.347+0000 7f4e5bc9d700 1 -- 172.21.15.72:0/2722192480 >> 172.21.15.72:0/2722192480 conn(0x7f4e54066f50 msgr2=0x7f4e5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.347+0000 7f4e5bc9d700 1 -- 172.21.15.72:0/2722192480 shutdown_connections 2023-10-03T10:13:39.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.347+0000 7f4e5bc9d700 1 -- 172.21.15.72:0/2722192480 wait complete. 2023-10-03T10:13:39.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.348+0000 7f4e5bc9d700 1 Processor -- start 2023-10-03T10:13:39.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.348+0000 7f4e5bc9d700 1 -- start start 2023-10-03T10:13:39.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.348+0000 7f4e5bc9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5409d6f0 0x7f4e54122490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.348+0000 7f4e5bc9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5409e000 0x7f4e541229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.348+0000 7f4e5bc9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e5409e410 0x7f4e54122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.348+0000 7f4e5bc9d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e54125a10 con 0x7f4e5409e410 2023-10-03T10:13:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.348+0000 7f4e5bc9d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e541238f0 con 0x7f4e5409e000 2023-10-03T10:13:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.348+0000 7f4e5bc9d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e54124900 con 0x7f4e5409d6f0 2023-10-03T10:13:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.348+0000 7f4e59238700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5409e000 0x7f4e541229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e59238700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5409e000 0x7f4e541229d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39752/0 (socket says 172.21.15.72:39752) 2023-10-03T10:13:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e59238700 1 -- 172.21.15.72:0/4170989094 learned_addr learned my addr 172.21.15.72:0/4170989094 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e5a23a700 1 --2- 172.21.15.72:0/4170989094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e5409e410 0x7f4e54122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e59238700 1 -- 172.21.15.72:0/4170989094 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5409d6f0 msgr2=0x7f4e54122490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e59a39700 1 --2- 172.21.15.72:0/4170989094 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5409d6f0 0x7f4e54122490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e59238700 1 --2- 172.21.15.72:0/4170989094 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5409d6f0 0x7f4e54122490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e59238700 1 -- 172.21.15.72:0/4170989094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e5409e410 msgr2=0x7f4e54122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e59238700 1 --2- 172.21.15.72:0/4170989094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e5409e410 0x7f4e54122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e59238700 1 -- 172.21.15.72:0/4170989094 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e500094a0 con 0x7f4e5409e000 2023-10-03T10:13:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e5a23a700 1 --2- 172.21.15.72:0/4170989094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e5409e410 0x7f4e54122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e59a39700 1 --2- 172.21.15.72:0/4170989094 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5409d6f0 0x7f4e54122490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e59238700 1 --2- 172.21.15.72:0/4170989094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5409e000 0x7f4e541229d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400e910 tx=0x7f4e4400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e4a7fc700 1 -- 172.21.15.72:0/4170989094 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4400c850 con 0x7f4e5409e000 2023-10-03T10:13:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e4a7fc700 1 -- 172.21.15.72:0/4170989094 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4400c9b0 con 0x7f4e5409e000 2023-10-03T10:13:39.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e5bc9d700 1 -- 172.21.15.72:0/4170989094 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e540a2be0 con 0x7f4e5409e000 2023-10-03T10:13:39.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e4a7fc700 1 -- 172.21.15.72:0/4170989094 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4400cd20 con 0x7f4e5409e000 2023-10-03T10:13:39.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.349+0000 7f4e5bc9d700 1 -- 172.21.15.72:0/4170989094 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e54126740 con 0x7f4e5409e000 2023-10-03T10:13:39.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.350+0000 7f4e4a7fc700 1 -- 172.21.15.72:0/4170989094 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e44013470 con 0x7f4e5409e000 2023-10-03T10:13:39.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.350+0000 7f4e5bc9d700 1 -- 172.21.15.72:0/4170989094 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e54125360 con 0x7f4e5409e000 2023-10-03T10:13:39.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.350+0000 7f4e4a7fc700 1 -- 172.21.15.72:0/4170989094 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4e4403faf0 con 0x7f4e5409e000 2023-10-03T10:13:39.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.355+0000 7f4e4a7fc700 1 -- 172.21.15.72:0/4170989094 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e44017020 con 0x7f4e5409e000 2023-10-03T10:13:39.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.371+0000 7f9c12d35700 1 Processor -- start 2023-10-03T10:13:39.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.371+0000 7f9c12d35700 1 -- start start 2023-10-03T10:13:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.372+0000 7f9c12d35700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c0c09f410 0x7f9c0c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.372+0000 7f9c12d35700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c0c136fe0 0x7f9c0c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.372+0000 7f9c12d35700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c070940 con 0x7f9c0c09e930 2023-10-03T10:13:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.372+0000 7f9c12d35700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0c06fd60 con 0x7f9c0c09f410 2023-10-03T10:13:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.372+0000 7f9c12d35700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c06fa80 con 0x7f9c0c136fe0 2023-10-03T10:13:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.372+0000 7f9c112d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c0c136fe0 0x7f9c0c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.372+0000 7f9c112d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c0c136fe0 0x7f9c0c1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39758/0 (socket says 172.21.15.72:39758) 2023-10-03T10:13:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.372+0000 7f9c0bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c0c09f410 0x7f9c0c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.372+0000 7f9c112d2700 1 -- 172.21.15.72:0/3990596184 learned_addr learned my addr 172.21.15.72:0/3990596184 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.372+0000 7f9c112d2700 1 -- 172.21.15.72:0/3990596184 >> v2:172.21.15.72:3300/0 conn(0x7f9c0c09f410 msgr2=0x7f9c0c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.372+0000 7f9c112d2700 1 --2- 172.21.15.72:0/3990596184 >> v2:172.21.15.72:3300/0 conn(0x7f9c0c09f410 0x7f9c0c136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.372+0000 7f9c112d2700 1 -- 172.21.15.72:0/3990596184 >> v1:172.21.15.72:6789/0 conn(0x7f9c0c09e930 legacy=0x7f9c0c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.373+0000 7f9c112d2700 1 -- 172.21.15.72:0/3990596184 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c09fb60 con 0x7f9c0c136fe0 2023-10-03T10:13:39.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.373+0000 7f9c112d2700 1 --2- 172.21.15.72:0/3990596184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c0c136fe0 0x7f9c0c1393c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009e50 tx=0x7f9c0400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1762bd6cc979e226 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.373+0000 7f9c0b7fe700 1 -- 172.21.15.72:0/3990596184 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0400e070 con 0x7f9c0c136fe0 2023-10-03T10:13:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.373+0000 7f9c0b7fe700 1 -- 172.21.15.72:0/3990596184 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0400b910 con 0x7f9c0c136fe0 2023-10-03T10:13:39.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.373+0000 7f9c0b7fe700 1 -- 172.21.15.72:0/3990596184 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0400bcc0 con 0x7f9c0c136fe0 2023-10-03T10:13:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.374+0000 7f9c12d35700 1 -- 172.21.15.72:0/3990596184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c0c136fe0 msgr2=0x7f9c0c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.374+0000 7f9c12d35700 1 --2- 172.21.15.72:0/3990596184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c0c136fe0 0x7f9c0c1393c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009e50 tx=0x7f9c0400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.374+0000 7f9c12d35700 1 -- 172.21.15.72:0/3990596184 shutdown_connections 2023-10-03T10:13:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.374+0000 7f9c12d35700 1 --2- 172.21.15.72:0/3990596184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c0c136fe0 0x7f9c0c1393c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.374+0000 7f9c12d35700 1 --2- 172.21.15.72:0/3990596184 >> v2:172.21.15.72:3300/0 conn(0x7f9c0c09f410 0x7f9c0c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.374+0000 7f9c12d35700 1 -- 172.21.15.72:0/3990596184 >> 172.21.15.72:0/3990596184 conn(0x7f9c0c0a4210 msgr2=0x7f9c0c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.374+0000 7f9c12d35700 1 -- 172.21.15.72:0/3990596184 shutdown_connections 2023-10-03T10:13:39.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.374+0000 7f9c12d35700 1 -- 172.21.15.72:0/3990596184 wait complete. 2023-10-03T10:13:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.375+0000 7f9c12d35700 1 Processor -- start 2023-10-03T10:13:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.375+0000 7f9c12d35700 1 -- start start 2023-10-03T10:13:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.375+0000 7f9c12d35700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c0c09e930 0x7f9c0c11b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.375+0000 7f9c12d35700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c0c09f410 0x7f9c0c11b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.375+0000 7f9c12d35700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c0c136fe0 0x7f9c0c11bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.375+0000 7f9c12d35700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c11e260 con 0x7f9c0c136fe0 2023-10-03T10:13:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.375+0000 7f9c12d35700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c071d20 con 0x7f9c0c09f410 2023-10-03T10:13:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.375+0000 7f9c12d35700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c11c810 con 0x7f9c0c09e930 2023-10-03T10:13:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.375+0000 7f9c0bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c0c09f410 0x7f9c0c11b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.375+0000 7f9c0bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c0c09f410 0x7f9c0c11b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39766/0 (socket says 172.21.15.72:39766) 2023-10-03T10:13:39.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.375+0000 7f9c0bfff700 1 -- 172.21.15.72:0/2102220750 learned_addr learned my addr 172.21.15.72:0/2102220750 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:39.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.376+0000 7f9c112d2700 1 --2- 172.21.15.72:0/2102220750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c0c136fe0 0x7f9c0c11bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.376+0000 7f9c0bfff700 1 -- 172.21.15.72:0/2102220750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c0c09e930 msgr2=0x7f9c0c11b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.376+0000 7f9c0bfff700 1 --2- 172.21.15.72:0/2102220750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c0c09e930 0x7f9c0c11b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.376+0000 7f9c0bfff700 1 -- 172.21.15.72:0/2102220750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c0c136fe0 msgr2=0x7f9c0c11bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.376+0000 7f9c0bfff700 1 --2- 172.21.15.72:0/2102220750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c0c136fe0 0x7f9c0c11bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.376+0000 7f9c0bfff700 1 -- 172.21.15.72:0/2102220750 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c04009b30 con 0x7f9c0c09f410 2023-10-03T10:13:39.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.376+0000 7f9c0bfff700 1 --2- 172.21.15.72:0/2102220750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c0c09f410 0x7f9c0c11b980 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8012fc0 tx=0x7f9bf80103a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.376+0000 7f9c097fa700 1 -- 172.21.15.72:0/2102220750 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf800dbb0 con 0x7f9c0c09f410 2023-10-03T10:13:39.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.376+0000 7f9c097fa700 1 -- 172.21.15.72:0/2102220750 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf8013040 con 0x7f9c0c09f410 2023-10-03T10:13:39.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.376+0000 7f9c12d35700 1 -- 172.21.15.72:0/2102220750 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0c11d830 con 0x7f9c0c09f410 2023-10-03T10:13:39.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.376+0000 7f9c097fa700 1 -- 172.21.15.72:0/2102220750 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8010db0 con 0x7f9c0c09f410 2023-10-03T10:13:39.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.376+0000 7f9c12d35700 1 -- 172.21.15.72:0/2102220750 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0c11e6b0 con 0x7f9c0c09f410 2023-10-03T10:13:39.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.377+0000 7f9c12d35700 1 -- 172.21.15.72:0/2102220750 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0c074ea0 con 0x7f9c0c09f410 2023-10-03T10:13:39.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.377+0000 7f9c097fa700 1 -- 172.21.15.72:0/2102220750 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9bf8018480 con 0x7f9c0c09f410 2023-10-03T10:13:39.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.377+0000 7f9c097fa700 1 -- 172.21.15.72:0/2102220750 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9bf8043760 con 0x7f9c0c09f410 2023-10-03T10:13:39.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.386+0000 7f9c097fa700 1 -- 172.21.15.72:0/2102220750 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9bf8016700 con 0x7f9c0c09f410 2023-10-03T10:13:39.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.403+0000 7f26d6355700 1 Processor -- start 2023-10-03T10:13:39.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.403+0000 7f26d6355700 1 -- start start 2023-10-03T10:13:39.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.403+0000 7f26d6355700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26d01338a0 0x7f26d0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.403+0000 7f26d6355700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f26d009de50 0x7f26d009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.403+0000 7f26d6355700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d006ef30 con 0x7f26d009e760 2023-10-03T10:13:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.403+0000 7f26d6355700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d006fef0 con 0x7f26d01338a0 2023-10-03T10:13:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.403+0000 7f26d6355700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26d01334b0 con 0x7f26d009de50 2023-10-03T10:13:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.403+0000 7f26d48f2700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f26d009e760 0x7f26d013a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50528/0 (socket says 172.21.15.72:50528) 2023-10-03T10:13:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.403+0000 7f26d48f2700 1 -- 172.21.15.72:0/2549950263 learned_addr learned my addr 172.21.15.72:0/2549950263 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.403+0000 7f26cf7fe700 1 --2- 172.21.15.72:0/2549950263 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f26d009de50 0x7f26d009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.403+0000 7f26cffff700 1 --2- 172.21.15.72:0/2549950263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26d01338a0 0x7f26d0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.404+0000 7f26ceffd700 1 -- 172.21.15.72:0/2549950263 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191641062 0 0) 0x7f26d006ef30 con 0x7f26d009e760 2023-10-03T10:13:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.404+0000 7f26cffff700 1 -- 172.21.15.72:0/2549950263 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f26d009de50 msgr2=0x7f26d009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.404+0000 7f26cffff700 1 --2- 172.21.15.72:0/2549950263 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f26d009de50 0x7f26d009e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.404+0000 7f26cffff700 1 -- 172.21.15.72:0/2549950263 >> v1:172.21.15.72:6789/0 conn(0x7f26d009e760 legacy=0x7f26d013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.404+0000 7f26cffff700 1 -- 172.21.15.72:0/2549950263 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d006fc30 con 0x7f26d01338a0 2023-10-03T10:13:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.404+0000 7f26cffff700 1 --2- 172.21.15.72:0/2549950263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26d01338a0 0x7f26d0133c70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009870 tx=0x7f26c0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9a666f030ca532d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.404+0000 7f26ceffd700 1 -- 172.21.15.72:0/2549950263 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0011830 con 0x7f26d01338a0 2023-10-03T10:13:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.404+0000 7f26ceffd700 1 -- 172.21.15.72:0/2549950263 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c0011990 con 0x7f26d01338a0 2023-10-03T10:13:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.404+0000 7f26ceffd700 1 -- 172.21.15.72:0/2549950263 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0011d20 con 0x7f26d01338a0 2023-10-03T10:13:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.405+0000 7f26d6355700 1 -- 172.21.15.72:0/2549950263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26d01338a0 msgr2=0x7f26d0133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.405+0000 7f26d6355700 1 --2- 172.21.15.72:0/2549950263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26d01338a0 0x7f26d0133c70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f26c0009870 tx=0x7f26c0009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.405+0000 7f26d6355700 1 -- 172.21.15.72:0/2549950263 shutdown_connections 2023-10-03T10:13:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.405+0000 7f26d6355700 1 --2- 172.21.15.72:0/2549950263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26d01338a0 0x7f26d0133c70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.405+0000 7f26d6355700 1 --2- 172.21.15.72:0/2549950263 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f26d009de50 0x7f26d009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.405+0000 7f26d6355700 1 -- 172.21.15.72:0/2549950263 >> 172.21.15.72:0/2549950263 conn(0x7f26d00a2aa0 msgr2=0x7f26d00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.405+0000 7f26d6355700 1 -- 172.21.15.72:0/2549950263 shutdown_connections 2023-10-03T10:13:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.405+0000 7f26d6355700 1 -- 172.21.15.72:0/2549950263 wait complete. 2023-10-03T10:13:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.406+0000 7f26d6355700 1 Processor -- start 2023-10-03T10:13:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.406+0000 7f26d6355700 1 -- start start 2023-10-03T10:13:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26d6355700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f26d009de50 0x7f26d011b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26d6355700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26d009e760 0x7f26d011ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26d6355700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26d01338a0 0x7f26d011bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26d6355700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d011fa00 con 0x7f26d01338a0 2023-10-03T10:13:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26d6355700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d011f040 con 0x7f26d009e760 2023-10-03T10:13:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26d6355700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26d00a0e40 con 0x7f26d009de50 2023-10-03T10:13:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26cf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26d009e760 0x7f26d011ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26d48f2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26d01338a0 0x7f26d011bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26cf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26d009e760 0x7f26d011ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39782/0 (socket says 172.21.15.72:39782) 2023-10-03T10:13:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26cf7fe700 1 -- 172.21.15.72:0/1549076351 learned_addr learned my addr 172.21.15.72:0/1549076351 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26cffff700 1 --2- 172.21.15.72:0/1549076351 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f26d009de50 0x7f26d011b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26d48f2700 1 -- 172.21.15.72:0/1549076351 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f26d009de50 msgr2=0x7f26d011b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26d48f2700 1 --2- 172.21.15.72:0/1549076351 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f26d009de50 0x7f26d011b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26d48f2700 1 -- 172.21.15.72:0/1549076351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26d009e760 msgr2=0x7f26d011ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26d48f2700 1 --2- 172.21.15.72:0/1549076351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26d009e760 0x7f26d011ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26d48f2700 1 -- 172.21.15.72:0/1549076351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c00094a0 con 0x7f26d01338a0 2023-10-03T10:13:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26cf7fe700 1 --2- 172.21.15.72:0/1549076351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26d009e760 0x7f26d011ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.407+0000 7f26d48f2700 1 --2- 172.21.15.72:0/1549076351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26d01338a0 0x7f26d011bfa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f26c800cbe0 tx=0x7f26c800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.408+0000 7f26ccff9700 1 -- 172.21.15.72:0/1549076351 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c800aa40 con 0x7f26d01338a0 2023-10-03T10:13:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.408+0000 7f26ccff9700 1 -- 172.21.15.72:0/1549076351 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c800abc0 con 0x7f26d01338a0 2023-10-03T10:13:39.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.408+0000 7f26d6355700 1 -- 172.21.15.72:0/1549076351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d011e7d0 con 0x7f26d01338a0 2023-10-03T10:13:39.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.408+0000 7f26ccff9700 1 -- 172.21.15.72:0/1549076351 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c80070d0 con 0x7f26d01338a0 2023-10-03T10:13:39.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.408+0000 7f26d6355700 1 -- 172.21.15.72:0/1549076351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d011e380 con 0x7f26d01338a0 2023-10-03T10:13:39.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.409+0000 7f26d6355700 1 -- 172.21.15.72:0/1549076351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b00052e0 con 0x7f26d01338a0 2023-10-03T10:13:39.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.409+0000 7f26ccff9700 1 -- 172.21.15.72:0/1549076351 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26c8007230 con 0x7f26d01338a0 2023-10-03T10:13:39.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.409+0000 7f26ccff9700 1 -- 172.21.15.72:0/1549076351 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f26c803f000 con 0x7f26d01338a0 2023-10-03T10:13:39.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.414+0000 7f26ccff9700 1 -- 172.21.15.72:0/1549076351 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26c80074e0 con 0x7f26d01338a0 2023-10-03T10:13:39.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.516+0000 7fe5731f0700 1 -- 172.21.15.72:0/3758008378 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe56c125bd0 con 0x7fe56c09d6f0 2023-10-03T10:13:39.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.516+0000 7fe5697fa700 1 -- 172.21.15.72:0/3758008378 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe560024350 con 0x7fe56c09d6f0 2023-10-03T10:13:39.517 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.519+0000 7fe5731f0700 1 -- 172.21.15.72:0/3758008378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe56c09d6f0 msgr2=0x7fe56c06e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.519+0000 7fe5731f0700 1 --2- 172.21.15.72:0/3758008378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe56c09d6f0 0x7fe56c06e870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe56000ebe0 tx=0x7fe56000eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.519+0000 7fe5731f0700 1 -- 172.21.15.72:0/3758008378 shutdown_connections 2023-10-03T10:13:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.519+0000 7fe5731f0700 1 --2- 172.21.15.72:0/3758008378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe56c09e410 0x7fe56c06f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.519+0000 7fe5731f0700 1 --2- 172.21.15.72:0/3758008378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe56c09d6f0 0x7fe56c06e870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.519+0000 7fe5731f0700 1 --2- 172.21.15.72:0/3758008378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe56c09e000 0x7fe56c06edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.519+0000 7fe5731f0700 1 -- 172.21.15.72:0/3758008378 >> 172.21.15.72:0/3758008378 conn(0x7fe56c066f50 msgr2=0x7fe56c0a15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.519+0000 7fe5731f0700 1 -- 172.21.15.72:0/3758008378 shutdown_connections 2023-10-03T10:13:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.519+0000 7fe5731f0700 1 -- 172.21.15.72:0/3758008378 wait complete. 2023-10-03T10:13:39.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:39.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.564+0000 7f4e5bc9d700 1 -- 172.21.15.72:0/4170989094 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4e54074ea0 con 0x7f4e5409e000 2023-10-03T10:13:39.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.564+0000 7f4e4a7fc700 1 -- 172.21.15.72:0/4170989094 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4e4400ce80 con 0x7f4e5409e000 2023-10-03T10:13:39.565 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:39.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.567+0000 7f4e5bc9d700 1 -- 172.21.15.72:0/4170989094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5409e000 msgr2=0x7f4e541229d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.567+0000 7f4e5bc9d700 1 --2- 172.21.15.72:0/4170989094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5409e000 0x7f4e541229d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400e910 tx=0x7f4e4400ecd0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.567+0000 7f4e5bc9d700 1 -- 172.21.15.72:0/4170989094 shutdown_connections 2023-10-03T10:13:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.567+0000 7f4e5bc9d700 1 --2- 172.21.15.72:0/4170989094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e5409e410 0x7f4e54122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.567+0000 7f4e5bc9d700 1 --2- 172.21.15.72:0/4170989094 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5409d6f0 0x7f4e54122490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.567+0000 7f4e5bc9d700 1 --2- 172.21.15.72:0/4170989094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5409e000 0x7f4e541229d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.567+0000 7f4e5bc9d700 1 -- 172.21.15.72:0/4170989094 >> 172.21.15.72:0/4170989094 conn(0x7f4e54066f50 msgr2=0x7f4e540a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.567+0000 7f4e5bc9d700 1 -- 172.21.15.72:0/4170989094 shutdown_connections 2023-10-03T10:13:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.567+0000 7f4e5bc9d700 1 -- 172.21.15.72:0/4170989094 wait complete. 2023-10-03T10:13:39.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:39.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.584+0000 7f9c12d35700 1 -- 172.21.15.72:0/2102220750 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9c0c06b250 con 0x7f9c0c09f410 2023-10-03T10:13:39.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.584+0000 7f9c097fa700 1 -- 172.21.15.72:0/2102220750 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9bf8016340 con 0x7f9c0c09f410 2023-10-03T10:13:39.585 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:39.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.586+0000 7f9c12d35700 1 -- 172.21.15.72:0/2102220750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c0c09f410 msgr2=0x7f9c0c11b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.586+0000 7f9c12d35700 1 --2- 172.21.15.72:0/2102220750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c0c09f410 0x7f9c0c11b980 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8012fc0 tx=0x7f9bf80103a0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.586+0000 7f9c12d35700 1 -- 172.21.15.72:0/2102220750 shutdown_connections 2023-10-03T10:13:39.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.586+0000 7f9c12d35700 1 --2- 172.21.15.72:0/2102220750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c0c136fe0 0x7f9c0c11bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.586+0000 7f9c12d35700 1 --2- 172.21.15.72:0/2102220750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c0c09e930 0x7f9c0c11b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.586+0000 7f9c12d35700 1 --2- 172.21.15.72:0/2102220750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c0c09f410 0x7f9c0c11b980 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.586+0000 7f9c12d35700 1 -- 172.21.15.72:0/2102220750 >> 172.21.15.72:0/2102220750 conn(0x7f9c0c0a4210 msgr2=0x7f9c0c06c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.586+0000 7f9c12d35700 1 -- 172.21.15.72:0/2102220750 shutdown_connections 2023-10-03T10:13:39.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.586+0000 7f9c12d35700 1 -- 172.21.15.72:0/2102220750 wait complete. 2023-10-03T10:13:39.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:39.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.626+0000 7f26d6355700 1 -- 172.21.15.72:0/1549076351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f26b0005590 con 0x7f26d01338a0 2023-10-03T10:13:39.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.627+0000 7f26ccff9700 1 -- 172.21.15.72:0/1549076351 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f26c8018070 con 0x7f26d01338a0 2023-10-03T10:13:39.627 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:39.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.629+0000 7f26d6355700 1 -- 172.21.15.72:0/1549076351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26d01338a0 msgr2=0x7f26d011bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.629+0000 7f26d6355700 1 --2- 172.21.15.72:0/1549076351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26d01338a0 0x7f26d011bfa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f26c800cbe0 tx=0x7f26c800cef0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.629+0000 7f26d6355700 1 -- 172.21.15.72:0/1549076351 shutdown_connections 2023-10-03T10:13:39.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.629+0000 7f26d6355700 1 --2- 172.21.15.72:0/1549076351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26d01338a0 0x7f26d011bfa0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.629+0000 7f26d6355700 1 --2- 172.21.15.72:0/1549076351 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f26d009de50 0x7f26d011b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.629+0000 7f26d6355700 1 --2- 172.21.15.72:0/1549076351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26d009e760 0x7f26d011ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.629+0000 7f26d6355700 1 -- 172.21.15.72:0/1549076351 >> 172.21.15.72:0/1549076351 conn(0x7f26d00a2aa0 msgr2=0x7f26d0130630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.629+0000 7f26d6355700 1 -- 172.21.15.72:0/1549076351 shutdown_connections 2023-10-03T10:13:39.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:39.629+0000 7f26d6355700 1 -- 172.21.15.72:0/1549076351 wait complete. 2023-10-03T10:13:39.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:40.533 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:40.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:40.599 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:40.642 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.682+0000 7f63e4af1700 1 Processor -- start 2023-10-03T10:13:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.682+0000 7f63e4af1700 1 -- start start 2023-10-03T10:13:40.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63e4af1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63e0130670 0x7f63e0130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63e4af1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63e006f680 0x7f63e006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63e4af1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63e006ffd0 0x7f63e0137530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63e4af1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e009a350 con 0x7f63e0130670 2023-10-03T10:13:40.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63e4af1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e0130260 con 0x7f63e006f680 2023-10-03T10:13:40.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63e4af1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63e0071ff0 con 0x7f63e006ffd0 2023-10-03T10:13:40.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63ded9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63e006ffd0 0x7f63e0137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63ded9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63e006ffd0 0x7f63e0137530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38376/0 (socket says 172.21.15.72:38376) 2023-10-03T10:13:40.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63ded9d700 1 -- 172.21.15.72:0/2187774543 learned_addr learned my addr 172.21.15.72:0/2187774543 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:40.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63ddd9b700 1 --2- 172.21.15.72:0/2187774543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63e006f680 0x7f63e006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63de59c700 1 --2- 172.21.15.72:0/2187774543 >> v2:172.21.15.72:3300/0 conn(0x7f63e0130670 0x7f63e0130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63ded9d700 1 -- 172.21.15.72:0/2187774543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63e006f680 msgr2=0x7f63e006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:40.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63ded9d700 1 --2- 172.21.15.72:0/2187774543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63e006f680 0x7f63e006fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63ded9d700 1 -- 172.21.15.72:0/2187774543 >> v2:172.21.15.72:3300/0 conn(0x7f63e0130670 msgr2=0x7f63e0130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:40.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63ded9d700 1 --2- 172.21.15.72:0/2187774543 >> v2:172.21.15.72:3300/0 conn(0x7f63e0130670 0x7f63e0130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63ded9d700 1 -- 172.21.15.72:0/2187774543 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e009ecf0 con 0x7f63e006ffd0 2023-10-03T10:13:40.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.683+0000 7f63ded9d700 1 --2- 172.21.15.72:0/2187774543 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63e006ffd0 0x7f63e0137530 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f63d800bf20 tx=0x7f63d80093b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb33196842c9a583 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.684+0000 7f63dd59a700 1 -- 172.21.15.72:0/2187774543 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800b4e0 con 0x7f63e006ffd0 2023-10-03T10:13:40.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.684+0000 7f63dd59a700 1 -- 172.21.15.72:0/2187774543 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d800c910 con 0x7f63e006ffd0 2023-10-03T10:13:40.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.684+0000 7f63dd59a700 1 -- 172.21.15.72:0/2187774543 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800cc80 con 0x7f63e006ffd0 2023-10-03T10:13:40.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.684+0000 7f63e4af1700 1 -- 172.21.15.72:0/2187774543 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63e006ffd0 msgr2=0x7f63e0137530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.684+0000 7f63e4af1700 1 --2- 172.21.15.72:0/2187774543 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63e006ffd0 0x7f63e0137530 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f63d800bf20 tx=0x7f63d80093b0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.685+0000 7f63e4af1700 1 -- 172.21.15.72:0/2187774543 shutdown_connections 2023-10-03T10:13:40.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.685+0000 7f63e4af1700 1 --2- 172.21.15.72:0/2187774543 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63e006ffd0 0x7f63e0137530 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.685+0000 7f63e4af1700 1 --2- 172.21.15.72:0/2187774543 >> v2:172.21.15.72:3300/0 conn(0x7f63e0130670 0x7f63e0130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.685+0000 7f63e4af1700 1 --2- 172.21.15.72:0/2187774543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63e006f680 0x7f63e006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.685+0000 7f63e4af1700 1 -- 172.21.15.72:0/2187774543 >> 172.21.15.72:0/2187774543 conn(0x7f63e00a2aa0 msgr2=0x7f63e00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.685+0000 7f63e4af1700 1 -- 172.21.15.72:0/2187774543 shutdown_connections 2023-10-03T10:13:40.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.685+0000 7f63e4af1700 1 -- 172.21.15.72:0/2187774543 wait complete. 2023-10-03T10:13:40.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.686+0000 7f63e4af1700 1 Processor -- start 2023-10-03T10:13:40.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.686+0000 7f63e4af1700 1 -- start start 2023-10-03T10:13:40.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63e4af1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63e006f680 0x7f63e011a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63e4af1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e006ffd0 0x7f63e011ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63e4af1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63e0130670 0x7f63e011b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63e4af1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e011e350 con 0x7f63e006ffd0 2023-10-03T10:13:40.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63e4af1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e011d720 con 0x7f63e006f680 2023-10-03T10:13:40.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63e4af1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63e012ea40 con 0x7f63e0130670 2023-10-03T10:13:40.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63de59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63e006f680 0x7f63e011a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63de59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63e006f680 0x7f63e011a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39800/0 (socket says 172.21.15.72:39800) 2023-10-03T10:13:40.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63de59c700 1 -- 172.21.15.72:0/1879331808 learned_addr learned my addr 172.21.15.72:0/1879331808 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:40.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63ddd9b700 1 --2- 172.21.15.72:0/1879331808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e006ffd0 0x7f63e011ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63ded9d700 1 --2- 172.21.15.72:0/1879331808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63e0130670 0x7f63e011b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63de59c700 1 -- 172.21.15.72:0/1879331808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63e0130670 msgr2=0x7f63e011b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63de59c700 1 --2- 172.21.15.72:0/1879331808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63e0130670 0x7f63e011b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63de59c700 1 -- 172.21.15.72:0/1879331808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e006ffd0 msgr2=0x7f63e011ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63de59c700 1 --2- 172.21.15.72:0/1879331808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e006ffd0 0x7f63e011ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63de59c700 1 -- 172.21.15.72:0/1879331808 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d800bb50 con 0x7f63e006f680 2023-10-03T10:13:40.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.687+0000 7f63ddd9b700 1 --2- 172.21.15.72:0/1879331808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e006ffd0 0x7f63e011ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:40.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.688+0000 7f63de59c700 1 --2- 172.21.15.72:0/1879331808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63e006f680 0x7f63e011a8c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f63d000e9b0 tx=0x7f63d000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.688+0000 7f63ceffd700 1 -- 172.21.15.72:0/1879331808 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0009710 con 0x7f63e006f680 2023-10-03T10:13:40.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.688+0000 7f63ceffd700 1 -- 172.21.15.72:0/1879331808 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d000c850 con 0x7f63e006f680 2023-10-03T10:13:40.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.688+0000 7f63e4af1700 1 -- 172.21.15.72:0/1879331808 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e011ca20 con 0x7f63e006f680 2023-10-03T10:13:40.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.688+0000 7f63ceffd700 1 -- 172.21.15.72:0/1879331808 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000cbc0 con 0x7f63e006f680 2023-10-03T10:13:40.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.688+0000 7f63e4af1700 1 -- 172.21.15.72:0/1879331808 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e012dc20 con 0x7f63e006f680 2023-10-03T10:13:40.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.689+0000 7f63e4af1700 1 -- 172.21.15.72:0/1879331808 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e006eda0 con 0x7f63e006f680 2023-10-03T10:13:40.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.689+0000 7f63ceffd700 1 -- 172.21.15.72:0/1879331808 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63d000cd20 con 0x7f63e006f680 2023-10-03T10:13:40.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.689+0000 7f63ceffd700 1 -- 172.21.15.72:0/1879331808 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f63d003fab0 con 0x7f63e006f680 2023-10-03T10:13:40.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.694+0000 7f63ceffd700 1 -- 172.21.15.72:0/1879331808 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63d001adc0 con 0x7f63e006f680 2023-10-03T10:13:40.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.725+0000 7f8e1b595700 1 Processor -- start 2023-10-03T10:13:40.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.725+0000 7f8e1b595700 1 -- start start 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.726+0000 7f8e1b595700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e14133540 0x7f8e14135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.726+0000 7f8e1b595700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e14135e60 0x7f8e14138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.726+0000 7f8e1b595700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e140716a0 con 0x7f8e14130540 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.726+0000 7f8e1b595700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e14071290 con 0x7f8e14135e60 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.726+0000 7f8e1b595700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e14130340 con 0x7f8e14133540 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.726+0000 7f8e18b30700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e14133540 0x7f8e14135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.726+0000 7f8e19b32700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e14135e60 0x7f8e14138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.726+0000 7f8e18b30700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e14133540 0x7f8e14135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38402/0 (socket says 172.21.15.72:38402) 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.726+0000 7f8e18b30700 1 -- 172.21.15.72:0/2068179299 learned_addr learned my addr 172.21.15.72:0/2068179299 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.726+0000 7f8e19b32700 1 -- 172.21.15.72:0/2068179299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e14133540 msgr2=0x7f8e14135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.726+0000 7f8e19b32700 1 --2- 172.21.15.72:0/2068179299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e14133540 0x7f8e14135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.726+0000 7f8e19b32700 1 -- 172.21.15.72:0/2068179299 >> v1:172.21.15.72:6789/0 conn(0x7f8e14130540 legacy=0x7f8e14130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.726+0000 7f8e19b32700 1 -- 172.21.15.72:0/2068179299 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e14070b80 con 0x7f8e14135e60 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.726+0000 7f8e18b30700 1 --2- 172.21.15.72:0/2068179299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e14133540 0x7f8e14135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.726+0000 7f8e19b32700 1 --2- 172.21.15.72:0/2068179299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e14135e60 0x7f8e14138240 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00be30 tx=0x7f8e0c0092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08963f335dff5b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.727+0000 7f8e0bfff700 1 -- 172.21.15.72:0/2068179299 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c00c890 con 0x7f8e14135e60 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.727+0000 7f8e0bfff700 1 -- 172.21.15.72:0/2068179299 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c00c9f0 con 0x7f8e14135e60 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.727+0000 7f8e0bfff700 1 -- 172.21.15.72:0/2068179299 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c00cda0 con 0x7f8e14135e60 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.728+0000 7f8e1b595700 1 -- 172.21.15.72:0/2068179299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e14135e60 msgr2=0x7f8e14138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.728+0000 7f8e1b595700 1 --2- 172.21.15.72:0/2068179299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e14135e60 0x7f8e14138240 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00be30 tx=0x7f8e0c0092f0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.728+0000 7f8e1b595700 1 -- 172.21.15.72:0/2068179299 shutdown_connections 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.728+0000 7f8e1b595700 1 --2- 172.21.15.72:0/2068179299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e14135e60 0x7f8e14138240 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.728+0000 7f8e1b595700 1 --2- 172.21.15.72:0/2068179299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e14133540 0x7f8e14135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.728+0000 7f8e1b595700 1 -- 172.21.15.72:0/2068179299 >> 172.21.15.72:0/2068179299 conn(0x7f8e140a2aa0 msgr2=0x7f8e140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.728+0000 7f8e1b595700 1 -- 172.21.15.72:0/2068179299 shutdown_connections 2023-10-03T10:13:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.728+0000 7f8e1b595700 1 -- 172.21.15.72:0/2068179299 wait complete. 2023-10-03T10:13:40.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.729+0000 7f8e1b595700 1 Processor -- start 2023-10-03T10:13:40.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.729+0000 7f8e1b595700 1 -- start start 2023-10-03T10:13:40.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e1b595700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e14130540 0x7f8e1409c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e1b595700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e14133540 0x7f8e1409cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e1b595700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e14135e60 0x7f8e1409d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e1b595700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e140a22f0 con 0x7f8e14130540 2023-10-03T10:13:40.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e1b595700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e140718e0 con 0x7f8e14135e60 2023-10-03T10:13:40.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e1b595700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1411a220 con 0x7f8e14133540 2023-10-03T10:13:40.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e19b32700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e14135e60 0x7f8e1409d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e19b32700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e14135e60 0x7f8e1409d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39804/0 (socket says 172.21.15.72:39804) 2023-10-03T10:13:40.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e19b32700 1 -- 172.21.15.72:0/2194598880 learned_addr learned my addr 172.21.15.72:0/2194598880 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:40.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e19331700 1 --2- 172.21.15.72:0/2194598880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e14130540 0x7f8e1409c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e18b30700 1 --2- 172.21.15.72:0/2194598880 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e14133540 0x7f8e1409cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e19b32700 1 -- 172.21.15.72:0/2194598880 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e14133540 msgr2=0x7f8e1409cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e19b32700 1 --2- 172.21.15.72:0/2194598880 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e14133540 0x7f8e1409cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e19b32700 1 -- 172.21.15.72:0/2194598880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e14130540 msgr2=0x7f8e1409c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e19b32700 1 --2- 172.21.15.72:0/2194598880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e14130540 0x7f8e1409c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.730+0000 7f8e19b32700 1 -- 172.21.15.72:0/2194598880 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0400d9f0 con 0x7f8e14135e60 2023-10-03T10:13:40.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.731+0000 7f8e19b32700 1 --2- 172.21.15.72:0/2194598880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e14135e60 0x7f8e1409d0d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00c600 tx=0x7f8e0c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.731+0000 7f8e09ffb700 1 -- 172.21.15.72:0/2194598880 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c00c890 con 0x7f8e14135e60 2023-10-03T10:13:40.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.731+0000 7f8e09ffb700 1 -- 172.21.15.72:0/2194598880 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c00b8e0 con 0x7f8e14135e60 2023-10-03T10:13:40.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.731+0000 7f8e09ffb700 1 -- 172.21.15.72:0/2194598880 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c01f670 con 0x7f8e14135e60 2023-10-03T10:13:40.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.732+0000 7f8e1b595700 1 -- 172.21.15.72:0/2194598880 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0c00ba90 con 0x7f8e14135e60 2023-10-03T10:13:40.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.732+0000 7f8e1b595700 1 -- 172.21.15.72:0/2194598880 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e14119060 con 0x7f8e14135e60 2023-10-03T10:13:40.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.733+0000 7f8e09ffb700 1 -- 172.21.15.72:0/2194598880 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e0c01f7d0 con 0x7f8e14135e60 2023-10-03T10:13:40.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.733+0000 7f8e1b595700 1 -- 172.21.15.72:0/2194598880 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e14074ea0 con 0x7f8e14135e60 2023-10-03T10:13:40.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.733+0000 7f8e09ffb700 1 -- 172.21.15.72:0/2194598880 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8e0c0417a0 con 0x7f8e14135e60 2023-10-03T10:13:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.738+0000 7f8e09ffb700 1 -- 172.21.15.72:0/2194598880 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e0c018080 con 0x7f8e14135e60 2023-10-03T10:13:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.768+0000 7fcdb471e700 1 Processor -- start 2023-10-03T10:13:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.768+0000 7fcdb471e700 1 -- start start 2023-10-03T10:13:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.769+0000 7fcdb471e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdac09d6f0 0x7fcdac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.769+0000 7fcdb471e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcdac09e000 0x7fcdac130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.769+0000 7fcdb471e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdac09f130 con 0x7fcdac09e410 2023-10-03T10:13:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.769+0000 7fcdb471e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac09f520 con 0x7fcdac09d6f0 2023-10-03T10:13:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.769+0000 7fcdb471e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac09e930 con 0x7fcdac09e000 2023-10-03T10:13:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.769+0000 7fcdb24ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdac09d6f0 0x7fcdac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.769+0000 7fcdb1cb9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcdac09e000 0x7fcdac130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.769+0000 7fcdb24ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdac09d6f0 0x7fcdac09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39818/0 (socket says 172.21.15.72:39818) 2023-10-03T10:13:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.769+0000 7fcdb24ba700 1 -- 172.21.15.72:0/305565484 learned_addr learned my addr 172.21.15.72:0/305565484 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.770+0000 7fcdb24ba700 1 -- 172.21.15.72:0/305565484 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcdac09e000 msgr2=0x7fcdac130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.770+0000 7fcdb24ba700 1 --2- 172.21.15.72:0/305565484 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcdac09e000 0x7fcdac130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.770+0000 7fcdb24ba700 1 -- 172.21.15.72:0/305565484 >> v1:172.21.15.72:6789/0 conn(0x7fcdac09e410 legacy=0x7fcdac130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.770+0000 7fcdb24ba700 1 -- 172.21.15.72:0/305565484 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac09b2d0 con 0x7fcdac09d6f0 2023-10-03T10:13:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.770+0000 7fcdb24ba700 1 --2- 172.21.15.72:0/305565484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdac09d6f0 0x7fcdac09dac0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009920 tx=0x7fcda8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6854d2c79062b76e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.770+0000 7fcdb14b8700 1 -- 172.21.15.72:0/305565484 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8011830 con 0x7fcdac09d6f0 2023-10-03T10:13:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.770+0000 7fcdb14b8700 1 -- 172.21.15.72:0/305565484 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda8011990 con 0x7fcdac09d6f0 2023-10-03T10:13:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.770+0000 7fcdb14b8700 1 -- 172.21.15.72:0/305565484 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8011d20 con 0x7fcdac09d6f0 2023-10-03T10:13:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.771+0000 7fcdb471e700 1 -- 172.21.15.72:0/305565484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdac09d6f0 msgr2=0x7fcdac09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.771+0000 7fcdb471e700 1 --2- 172.21.15.72:0/305565484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdac09d6f0 0x7fcdac09dac0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009920 tx=0x7fcda8009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.771+0000 7fcdb471e700 1 -- 172.21.15.72:0/305565484 shutdown_connections 2023-10-03T10:13:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.771+0000 7fcdb471e700 1 --2- 172.21.15.72:0/305565484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdac09d6f0 0x7fcdac09dac0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.771+0000 7fcdb471e700 1 --2- 172.21.15.72:0/305565484 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcdac09e000 0x7fcdac130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.771+0000 7fcdb471e700 1 -- 172.21.15.72:0/305565484 >> 172.21.15.72:0/305565484 conn(0x7fcdac066f50 msgr2=0x7fcdac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.771+0000 7fcdb471e700 1 -- 172.21.15.72:0/305565484 shutdown_connections 2023-10-03T10:13:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.771+0000 7fcdb471e700 1 -- 172.21.15.72:0/305565484 wait complete. 2023-10-03T10:13:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.772+0000 7fcdb471e700 1 Processor -- start 2023-10-03T10:13:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.772+0000 7fcdb471e700 1 -- start start 2023-10-03T10:13:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.772+0000 7fcdb471e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdac09d6f0 0x7fcdac06f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb471e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcdac09e000 0x7fcdac06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb471e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac09e410 0x7fcdac1c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb471e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0a1d10 con 0x7fcdac09e410 2023-10-03T10:13:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb471e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac09c700 con 0x7fcdac09d6f0 2023-10-03T10:13:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb471e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac125f40 con 0x7fcdac09e000 2023-10-03T10:13:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb24ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdac09d6f0 0x7fcdac06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb24ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdac09d6f0 0x7fcdac06f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39824/0 (socket says 172.21.15.72:39824) 2023-10-03T10:13:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb24ba700 1 -- 172.21.15.72:0/1027121308 learned_addr learned my addr 172.21.15.72:0/1027121308 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb2cbb700 1 --2- 172.21.15.72:0/1027121308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac09e410 0x7fcdac1c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb24ba700 1 -- 172.21.15.72:0/1027121308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcdac09e000 msgr2=0x7fcdac06f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb1cb9700 1 --2- 172.21.15.72:0/1027121308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcdac09e000 0x7fcdac06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb24ba700 1 --2- 172.21.15.72:0/1027121308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcdac09e000 0x7fcdac06f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb24ba700 1 -- 172.21.15.72:0/1027121308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac09e410 msgr2=0x7fcdac1c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb24ba700 1 --2- 172.21.15.72:0/1027121308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac09e410 0x7fcdac1c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb24ba700 1 -- 172.21.15.72:0/1027121308 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda8009550 con 0x7fcdac09d6f0 2023-10-03T10:13:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb2cbb700 1 --2- 172.21.15.72:0/1027121308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac09e410 0x7fcdac1c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb1cb9700 1 --2- 172.21.15.72:0/1027121308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcdac09e000 0x7fcdac06f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcdb24ba700 1 --2- 172.21.15.72:0/1027121308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdac09d6f0 0x7fcdac06f060 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcda8000c00 tx=0x7fcda8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.773+0000 7fcda2ffd700 1 -- 172.21.15.72:0/1027121308 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8004510 con 0x7fcdac09d6f0 2023-10-03T10:13:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.774+0000 7fcda2ffd700 1 -- 172.21.15.72:0/1027121308 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda80036a0 con 0x7fcdac09d6f0 2023-10-03T10:13:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.774+0000 7fcdb471e700 1 -- 172.21.15.72:0/1027121308 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac1269b0 con 0x7fcdac09d6f0 2023-10-03T10:13:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.774+0000 7fcda2ffd700 1 -- 172.21.15.72:0/1027121308 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8003a10 con 0x7fcdac09d6f0 2023-10-03T10:13:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.774+0000 7fcdb471e700 1 -- 172.21.15.72:0/1027121308 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac06fae0 con 0x7fcdac09d6f0 2023-10-03T10:13:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.775+0000 7fcda2ffd700 1 -- 172.21.15.72:0/1027121308 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcda8003b70 con 0x7fcdac09d6f0 2023-10-03T10:13:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.775+0000 7fcdb471e700 1 -- 172.21.15.72:0/1027121308 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac0a39f0 con 0x7fcdac09d6f0 2023-10-03T10:13:40.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.775+0000 7fcda2ffd700 1 -- 172.21.15.72:0/1027121308 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcda8021030 con 0x7fcdac09d6f0 2023-10-03T10:13:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.779+0000 7fcda2ffd700 1 -- 172.21.15.72:0/1027121308 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcda801a430 con 0x7fcdac09d6f0 2023-10-03T10:13:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.811+0000 7f178ee08700 1 Processor -- start 2023-10-03T10:13:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.811+0000 7f178ee08700 1 -- start start 2023-10-03T10:13:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.812+0000 7f178ee08700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17880a0a30 0x7f17880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.812+0000 7f178ee08700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1788138d80 0x7f178813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.812+0000 7f178ee08700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17880a2a70 con 0x7f178809d630 2023-10-03T10:13:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.812+0000 7f178ee08700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17880a01d0 con 0x7f17880a0a30 2023-10-03T10:13:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.812+0000 7f178ee08700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f178809e2b0 con 0x7f1788138d80 2023-10-03T10:13:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.812+0000 7f178cba4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17880a0a30 0x7f17880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.812+0000 7f178cba4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17880a0a30 0x7f17880a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46560/0 (socket says 172.21.15.72:46560) 2023-10-03T10:13:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.812+0000 7f178cba4700 1 -- 172.21.15.72:0/3947228514 learned_addr learned my addr 172.21.15.72:0/3947228514 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.812+0000 7f178d3a5700 1 --2- 172.21.15.72:0/3947228514 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1788138d80 0x7f178813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.813+0000 7f178cba4700 1 -- 172.21.15.72:0/3947228514 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1788138d80 msgr2=0x7f178813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:40.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.813+0000 7f178cba4700 1 --2- 172.21.15.72:0/3947228514 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1788138d80 0x7f178813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.813+0000 7f178cba4700 1 -- 172.21.15.72:0/3947228514 >> v1:172.21.15.72:6789/0 conn(0x7f178809d630 legacy=0x7f17880a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.813+0000 7f178cba4700 1 -- 172.21.15.72:0/3947228514 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178809dc50 con 0x7f17880a0a30 2023-10-03T10:13:40.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.813+0000 7f178cba4700 1 --2- 172.21.15.72:0/3947228514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17880a0a30 0x7f17880a0e00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f177c0098f0 tx=0x7f177c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a569e2550190d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.813+0000 7f17877fe700 1 -- 172.21.15.72:0/3947228514 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c011830 con 0x7f17880a0a30 2023-10-03T10:13:40.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.813+0000 7f17877fe700 1 -- 172.21.15.72:0/3947228514 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c011990 con 0x7f17880a0a30 2023-10-03T10:13:40.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.813+0000 7f17877fe700 1 -- 172.21.15.72:0/3947228514 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c011d20 con 0x7f17880a0a30 2023-10-03T10:13:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.814+0000 7f178ee08700 1 -- 172.21.15.72:0/3947228514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17880a0a30 msgr2=0x7f17880a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.814+0000 7f178ee08700 1 --2- 172.21.15.72:0/3947228514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17880a0a30 0x7f17880a0e00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f177c0098f0 tx=0x7f177c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.814+0000 7f178ee08700 1 -- 172.21.15.72:0/3947228514 shutdown_connections 2023-10-03T10:13:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.814+0000 7f178ee08700 1 --2- 172.21.15.72:0/3947228514 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1788138d80 0x7f178813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.814+0000 7f178ee08700 1 --2- 172.21.15.72:0/3947228514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17880a0a30 0x7f17880a0e00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.814+0000 7f178ee08700 1 -- 172.21.15.72:0/3947228514 >> 172.21.15.72:0/3947228514 conn(0x7f17880a3050 msgr2=0x7f17880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.814+0000 7f178ee08700 1 -- 172.21.15.72:0/3947228514 shutdown_connections 2023-10-03T10:13:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.814+0000 7f178ee08700 1 -- 172.21.15.72:0/3947228514 wait complete. 2023-10-03T10:13:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.815+0000 7f178ee08700 1 Processor -- start 2023-10-03T10:13:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.815+0000 7f178ee08700 1 -- start start 2023-10-03T10:13:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178ee08700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f178809d630 0x7f17881207c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178ee08700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17880a0a30 0x7f1788120d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178ee08700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1788138d80 0x7f1788121240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178ee08700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17881223d0 con 0x7f1788138d80 2023-10-03T10:13:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178ee08700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1788122c30 con 0x7f17880a0a30 2023-10-03T10:13:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178ee08700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1788124000 con 0x7f178809d630 2023-10-03T10:13:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178cba4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f178809d630 0x7f17881207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178cba4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f178809d630 0x7f17881207c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38446/0 (socket says 172.21.15.72:38446) 2023-10-03T10:13:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178cba4700 1 -- 172.21.15.72:0/1237345772 learned_addr learned my addr 172.21.15.72:0/1237345772 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f1787fff700 1 --2- 172.21.15.72:0/1237345772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17880a0a30 0x7f1788120d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178d3a5700 1 --2- 172.21.15.72:0/1237345772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1788138d80 0x7f1788121240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178cba4700 1 -- 172.21.15.72:0/1237345772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17880a0a30 msgr2=0x7f1788120d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178cba4700 1 --2- 172.21.15.72:0/1237345772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17880a0a30 0x7f1788120d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178cba4700 1 -- 172.21.15.72:0/1237345772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1788138d80 msgr2=0x7f1788121240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178cba4700 1 --2- 172.21.15.72:0/1237345772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1788138d80 0x7f1788121240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178cba4700 1 -- 172.21.15.72:0/1237345772 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c009550 con 0x7f178809d630 2023-10-03T10:13:40.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.816+0000 7f178cba4700 1 --2- 172.21.15.72:0/1237345772 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f178809d630 0x7f17881207c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f177c009c40 tx=0x7f177c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.817+0000 7f17857fa700 1 -- 172.21.15.72:0/1237345772 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c004480 con 0x7f178809d630 2023-10-03T10:13:40.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.817+0000 7f17857fa700 1 -- 172.21.15.72:0/1237345772 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c01f070 con 0x7f178809d630 2023-10-03T10:13:40.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.817+0000 7f178ee08700 1 -- 172.21.15.72:0/1237345772 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1788123a70 con 0x7f178809d630 2023-10-03T10:13:40.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.817+0000 7f17857fa700 1 -- 172.21.15.72:0/1237345772 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c0038a0 con 0x7f178809d630 2023-10-03T10:13:40.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.817+0000 7f178ee08700 1 -- 172.21.15.72:0/1237345772 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17880a0410 con 0x7f178809d630 2023-10-03T10:13:40.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.817+0000 7f17857fa700 1 -- 172.21.15.72:0/1237345772 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f177c021030 con 0x7f178809d630 2023-10-03T10:13:40.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.817+0000 7f17857fa700 1 -- 172.21.15.72:0/1237345772 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f177c0409a0 con 0x7f178809d630 2023-10-03T10:13:40.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.818+0000 7f178ee08700 1 -- 172.21.15.72:0/1237345772 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17880747f0 con 0x7f178809d630 2023-10-03T10:13:40.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.823+0000 7f17857fa700 1 -- 172.21.15.72:0/1237345772 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f177c015080 con 0x7f178809d630 2023-10-03T10:13:40.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.898+0000 7f63e4af1700 1 -- 172.21.15.72:0/1879331808 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f63e0074ea0 con 0x7f63e006f680 2023-10-03T10:13:40.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.899+0000 7f63ceffd700 1 -- 172.21.15.72:0/1879331808 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63d0021020 con 0x7f63e006f680 2023-10-03T10:13:40.900 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:40.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.901+0000 7f63e4af1700 1 -- 172.21.15.72:0/1879331808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63e006f680 msgr2=0x7f63e011a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.901+0000 7f63e4af1700 1 --2- 172.21.15.72:0/1879331808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63e006f680 0x7f63e011a8c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f63d000e9b0 tx=0x7f63d000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.901+0000 7f63e4af1700 1 -- 172.21.15.72:0/1879331808 shutdown_connections 2023-10-03T10:13:40.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.901+0000 7f63e4af1700 1 --2- 172.21.15.72:0/1879331808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63e0130670 0x7f63e011b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.901+0000 7f63e4af1700 1 --2- 172.21.15.72:0/1879331808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63e006f680 0x7f63e011a8c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.901+0000 7f63e4af1700 1 --2- 172.21.15.72:0/1879331808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63e006ffd0 0x7f63e011ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.901+0000 7f63e4af1700 1 -- 172.21.15.72:0/1879331808 >> 172.21.15.72:0/1879331808 conn(0x7f63e00a2aa0 msgr2=0x7f63e01b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.901+0000 7f63e4af1700 1 -- 172.21.15.72:0/1879331808 shutdown_connections 2023-10-03T10:13:40.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.901+0000 7f63e4af1700 1 -- 172.21.15.72:0/1879331808 wait complete. 2023-10-03T10:13:40.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:40.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.936+0000 7f8e1b595700 1 -- 172.21.15.72:0/2194598880 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e1406b9e0 con 0x7f8e14135e60 2023-10-03T10:13:40.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.937+0000 7f8e09ffb700 1 -- 172.21.15.72:0/2194598880 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8e0c023020 con 0x7f8e14135e60 2023-10-03T10:13:40.937 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:40.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.939+0000 7f8e1b595700 1 -- 172.21.15.72:0/2194598880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e14135e60 msgr2=0x7f8e1409d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.939+0000 7f8e1b595700 1 --2- 172.21.15.72:0/2194598880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e14135e60 0x7f8e1409d0d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00c600 tx=0x7f8e0c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.939+0000 7f8e1b595700 1 -- 172.21.15.72:0/2194598880 shutdown_connections 2023-10-03T10:13:40.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.939+0000 7f8e1b595700 1 --2- 172.21.15.72:0/2194598880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e14130540 0x7f8e1409c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.939+0000 7f8e1b595700 1 --2- 172.21.15.72:0/2194598880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e14135e60 0x7f8e1409d0d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.939+0000 7f8e1b595700 1 --2- 172.21.15.72:0/2194598880 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e14133540 0x7f8e1409cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.939+0000 7f8e1b595700 1 -- 172.21.15.72:0/2194598880 >> 172.21.15.72:0/2194598880 conn(0x7f8e140a2aa0 msgr2=0x7f8e14131300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.939+0000 7f8e1b595700 1 -- 172.21.15.72:0/2194598880 shutdown_connections 2023-10-03T10:13:40.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.939+0000 7f8e1b595700 1 -- 172.21.15.72:0/2194598880 wait complete. 2023-10-03T10:13:40.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:40.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.988+0000 7fcdb471e700 1 -- 172.21.15.72:0/1027121308 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcdac09de20 con 0x7fcdac09d6f0 2023-10-03T10:13:40.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.988+0000 7fcda2ffd700 1 -- 172.21.15.72:0/1027121308 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcda802b070 con 0x7fcdac09d6f0 2023-10-03T10:13:40.989 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:40.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.990+0000 7fcdb471e700 1 -- 172.21.15.72:0/1027121308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdac09d6f0 msgr2=0x7fcdac06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.990+0000 7fcdb471e700 1 --2- 172.21.15.72:0/1027121308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdac09d6f0 0x7fcdac06f060 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcda8000c00 tx=0x7fcda8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:40.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.990+0000 7fcdb471e700 1 -- 172.21.15.72:0/1027121308 shutdown_connections 2023-10-03T10:13:40.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.990+0000 7fcdb471e700 1 --2- 172.21.15.72:0/1027121308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdac09e410 0x7fcdac1c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.990+0000 7fcdb471e700 1 --2- 172.21.15.72:0/1027121308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdac09d6f0 0x7fcdac06f060 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.990+0000 7fcdb471e700 1 --2- 172.21.15.72:0/1027121308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcdac09e000 0x7fcdac06f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.990+0000 7fcdb471e700 1 -- 172.21.15.72:0/1027121308 >> 172.21.15.72:0/1027121308 conn(0x7fcdac066f50 msgr2=0x7fcdac06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.990+0000 7fcdb471e700 1 -- 172.21.15.72:0/1027121308 shutdown_connections 2023-10-03T10:13:40.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:40.990+0000 7fcdb471e700 1 -- 172.21.15.72:0/1027121308 wait complete. 2023-10-03T10:13:41.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:41.021+0000 7f178ee08700 1 -- 172.21.15.72:0/1237345772 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1788123ca0 con 0x7f178809d630 2023-10-03T10:13:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:41.021+0000 7f17857fa700 1 -- 172.21.15.72:0/1237345772 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f177c006ce0 con 0x7f178809d630 2023-10-03T10:13:41.033 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:41.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:41.023+0000 7f178ee08700 1 -- 172.21.15.72:0/1237345772 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f178809d630 msgr2=0x7f17881207c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:41.023+0000 7f178ee08700 1 --2- 172.21.15.72:0/1237345772 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f178809d630 0x7f17881207c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f177c009c40 tx=0x7f177c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:41.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:41.023+0000 7f178ee08700 1 -- 172.21.15.72:0/1237345772 shutdown_connections 2023-10-03T10:13:41.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:41.023+0000 7f178ee08700 1 --2- 172.21.15.72:0/1237345772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1788138d80 0x7f1788121240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:41.023+0000 7f178ee08700 1 --2- 172.21.15.72:0/1237345772 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f178809d630 0x7f17881207c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:41.023+0000 7f178ee08700 1 --2- 172.21.15.72:0/1237345772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17880a0a30 0x7f1788120d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:41.023+0000 7f178ee08700 1 -- 172.21.15.72:0/1237345772 >> 172.21.15.72:0/1237345772 conn(0x7f17880a3050 msgr2=0x7f178809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:41.023+0000 7f178ee08700 1 -- 172.21.15.72:0/1237345772 shutdown_connections 2023-10-03T10:13:41.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:41.023+0000 7f178ee08700 1 -- 172.21.15.72:0/1237345772 wait complete. 2023-10-03T10:13:41.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:41.915 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:41.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:42.032 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:42.036 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:42.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.057+0000 7f636b417700 1 Processor -- start 2023-10-03T10:13:42.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.058+0000 7f636b417700 1 -- start start 2023-10-03T10:13:42.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.058+0000 7f636b417700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63641338a0 0x7f6364133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.058+0000 7f636b417700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f636409e930 0x7f636413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.058+0000 7f636b417700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636406ef30 con 0x7f636409de50 2023-10-03T10:13:42.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.058+0000 7f636b417700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636406fef0 con 0x7f636409e930 2023-10-03T10:13:42.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.058+0000 7f636b417700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63641334b0 con 0x7f63641338a0 2023-10-03T10:13:42.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.058+0000 7f63691b3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63641338a0 0x7f6364133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.058+0000 7f63691b3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63641338a0 0x7f6364133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39836/0 (socket says 172.21.15.72:39836) 2023-10-03T10:13:42.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.058+0000 7f63691b3700 1 -- 172.21.15.72:0/1341237145 learned_addr learned my addr 172.21.15.72:0/1341237145 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:42.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.058+0000 7f63689b2700 1 --1- 172.21.15.72:0/1341237145 >> v1:172.21.15.72:6789/0 conn(0x7f636409de50 0x7f636409e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50566/0 (socket says 172.21.15.72:50566) 2023-10-03T10:13:42.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.058+0000 7f63699b4700 1 --2- 172.21.15.72:0/1341237145 >> v2:172.21.15.72:3300/0 conn(0x7f636409e930 0x7f636413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.059+0000 7f63691b3700 1 -- 172.21.15.72:0/1341237145 >> v2:172.21.15.72:3300/0 conn(0x7f636409e930 msgr2=0x7f636413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.059+0000 7f63691b3700 1 --2- 172.21.15.72:0/1341237145 >> v2:172.21.15.72:3300/0 conn(0x7f636409e930 0x7f636413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.059+0000 7f63691b3700 1 -- 172.21.15.72:0/1341237145 >> v1:172.21.15.72:6789/0 conn(0x7f636409de50 legacy=0x7f636409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.059+0000 7f63691b3700 1 -- 172.21.15.72:0/1341237145 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636406fc30 con 0x7f63641338a0 2023-10-03T10:13:42.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.059+0000 7f63699b4700 1 --2- 172.21.15.72:0/1341237145 >> v2:172.21.15.72:3300/0 conn(0x7f636409e930 0x7f636413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:42.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.059+0000 7f63691b3700 1 --2- 172.21.15.72:0/1341237145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63641338a0 0x7f6364133c70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f63600098f0 tx=0x7f6360009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=486b70a6e9b55628 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.060+0000 7f635bfff700 1 -- 172.21.15.72:0/1341237145 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6360011830 con 0x7f63641338a0 2023-10-03T10:13:42.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.060+0000 7f635bfff700 1 -- 172.21.15.72:0/1341237145 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6360011990 con 0x7f63641338a0 2023-10-03T10:13:42.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.060+0000 7f635bfff700 1 -- 172.21.15.72:0/1341237145 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6360011d20 con 0x7f63641338a0 2023-10-03T10:13:42.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.060+0000 7f636b417700 1 -- 172.21.15.72:0/1341237145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63641338a0 msgr2=0x7f6364133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.060+0000 7f636b417700 1 --2- 172.21.15.72:0/1341237145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63641338a0 0x7f6364133c70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f63600098f0 tx=0x7f6360009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:42.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.060+0000 7f636b417700 1 -- 172.21.15.72:0/1341237145 shutdown_connections 2023-10-03T10:13:42.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.060+0000 7f636b417700 1 --2- 172.21.15.72:0/1341237145 >> v2:172.21.15.72:3300/0 conn(0x7f636409e930 0x7f636413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.060+0000 7f636b417700 1 --2- 172.21.15.72:0/1341237145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63641338a0 0x7f6364133c70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.061+0000 7f636b417700 1 -- 172.21.15.72:0/1341237145 >> 172.21.15.72:0/1341237145 conn(0x7f63640a2aa0 msgr2=0x7f63640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.061+0000 7f636b417700 1 -- 172.21.15.72:0/1341237145 shutdown_connections 2023-10-03T10:13:42.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.061+0000 7f636b417700 1 -- 172.21.15.72:0/1341237145 wait complete. 2023-10-03T10:13:42.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.062+0000 7f636b417700 1 Processor -- start 2023-10-03T10:13:42.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.062+0000 7f636b417700 1 -- start start 2023-10-03T10:13:42.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.062+0000 7f636b417700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f636409de50 0x7f636411d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.062+0000 7f636b417700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f636409e930 0x7f636411dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.062+0000 7f636b417700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63641338a0 0x7f636411e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.062+0000 7f636b417700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636411f350 con 0x7f636409e930 2023-10-03T10:13:42.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.062+0000 7f636b417700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636406f640 con 0x7f63641338a0 2023-10-03T10:13:42.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.062+0000 7f636b417700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6364120f80 con 0x7f636409de50 2023-10-03T10:13:42.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.063+0000 7f63691b3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f636409de50 0x7f636411d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.063+0000 7f63691b3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f636409de50 0x7f636411d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38450/0 (socket says 172.21.15.72:38450) 2023-10-03T10:13:42.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.063+0000 7f63691b3700 1 -- 172.21.15.72:0/1618325789 learned_addr learned my addr 172.21.15.72:0/1618325789 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:42.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.063+0000 7f63699b4700 1 --2- 172.21.15.72:0/1618325789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63641338a0 0x7f636411e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.063+0000 7f63689b2700 1 --2- 172.21.15.72:0/1618325789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f636409e930 0x7f636411dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.063+0000 7f63699b4700 1 -- 172.21.15.72:0/1618325789 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f636409de50 msgr2=0x7f636411d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.063+0000 7f63699b4700 1 --2- 172.21.15.72:0/1618325789 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f636409de50 0x7f636411d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.063+0000 7f63699b4700 1 -- 172.21.15.72:0/1618325789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f636409e930 msgr2=0x7f636411dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.063+0000 7f63699b4700 1 --2- 172.21.15.72:0/1618325789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f636409e930 0x7f636411dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.063+0000 7f63699b4700 1 -- 172.21.15.72:0/1618325789 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c009a70 con 0x7f63641338a0 2023-10-03T10:13:42.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.063+0000 7f63699b4700 1 --2- 172.21.15.72:0/1618325789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63641338a0 0x7f636411e2a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f635c00efc0 tx=0x7f635c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.063+0000 7f6359ffb700 1 -- 172.21.15.72:0/1618325789 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c00ca90 con 0x7f63641338a0 2023-10-03T10:13:42.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.064+0000 7f6359ffb700 1 -- 172.21.15.72:0/1618325789 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c00f040 con 0x7f63641338a0 2023-10-03T10:13:42.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.064+0000 7f6359ffb700 1 -- 172.21.15.72:0/1618325789 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c00ce30 con 0x7f63641338a0 2023-10-03T10:13:42.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.064+0000 7f636b417700 1 -- 172.21.15.72:0/1618325789 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6360009550 con 0x7f63641338a0 2023-10-03T10:13:42.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.065+0000 7f636b417700 1 -- 172.21.15.72:0/1618325789 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63641205a0 con 0x7f63641338a0 2023-10-03T10:13:42.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.065+0000 7f6359ffb700 1 -- 172.21.15.72:0/1618325789 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f635c014480 con 0x7f63641338a0 2023-10-03T10:13:42.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.066+0000 7f6359ffb700 1 -- 172.21.15.72:0/1618325789 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f635c03fc00 con 0x7f63641338a0 2023-10-03T10:13:42.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.066+0000 7f636b417700 1 -- 172.21.15.72:0/1618325789 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636411a470 con 0x7f63641338a0 2023-10-03T10:13:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.071+0000 7f6359ffb700 1 -- 172.21.15.72:0/1618325789 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f635c012930 con 0x7f63641338a0 2023-10-03T10:13:42.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.098+0000 7f7f85cff700 1 Processor -- start 2023-10-03T10:13:42.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.098+0000 7f7f85cff700 1 -- start start 2023-10-03T10:13:42.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.099+0000 7f7f85cff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8012cf60 0x7f7f8006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.099+0000 7f7f85cff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f8012f8b0 0x7f7f8012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.099+0000 7f7f85cff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f80130260 0x7f7f80136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.099+0000 7f7f85cff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8012d330 con 0x7f7f8012f8b0 2023-10-03T10:13:42.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.099+0000 7f7f85cff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8012cd90 con 0x7f7f8012cf60 2023-10-03T10:13:42.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.099+0000 7f7f85cff700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f801306d0 con 0x7f7f80130260 2023-10-03T10:13:42.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.099+0000 7f7f7ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f80130260 0x7f7f80136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.099+0000 7f7f7ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f80130260 0x7f7f80136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38452/0 (socket says 172.21.15.72:38452) 2023-10-03T10:13:42.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.099+0000 7f7f7ffff700 1 -- 172.21.15.72:0/1733869274 learned_addr learned my addr 172.21.15.72:0/1733869274 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:42.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.099+0000 7f7f7f7fe700 1 --2- 172.21.15.72:0/1733869274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8012cf60 0x7f7f8006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.099+0000 7f7f7effd700 1 --2- 172.21.15.72:0/1733869274 >> v2:172.21.15.72:3300/0 conn(0x7f7f8012f8b0 0x7f7f8012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.100+0000 7f7f7ffff700 1 -- 172.21.15.72:0/1733869274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8012cf60 msgr2=0x7f7f8006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.100+0000 7f7f7ffff700 1 --2- 172.21.15.72:0/1733869274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8012cf60 0x7f7f8006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.100+0000 7f7f7ffff700 1 -- 172.21.15.72:0/1733869274 >> v2:172.21.15.72:3300/0 conn(0x7f7f8012f8b0 msgr2=0x7f7f8012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.100+0000 7f7f7ffff700 1 --2- 172.21.15.72:0/1733869274 >> v2:172.21.15.72:3300/0 conn(0x7f7f8012f8b0 0x7f7f8012fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.100+0000 7f7f7ffff700 1 -- 172.21.15.72:0/1733869274 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f80071780 con 0x7f7f80130260 2023-10-03T10:13:42.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.100+0000 7f7f7ffff700 1 --2- 172.21.15.72:0/1733869274 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f80130260 0x7f7f80136c20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009e80 tx=0x7f7f7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b85f819aaaf0921e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.100+0000 7f7f7e7fc700 1 -- 172.21.15.72:0/1733869274 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7800e070 con 0x7f7f80130260 2023-10-03T10:13:42.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.100+0000 7f7f7e7fc700 1 -- 172.21.15.72:0/1733869274 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7800b8d0 con 0x7f7f80130260 2023-10-03T10:13:42.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.100+0000 7f7f7e7fc700 1 -- 172.21.15.72:0/1733869274 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7800bc80 con 0x7f7f80130260 2023-10-03T10:13:42.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.101+0000 7f7f85cff700 1 -- 172.21.15.72:0/1733869274 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f80130260 msgr2=0x7f7f80136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.101+0000 7f7f85cff700 1 --2- 172.21.15.72:0/1733869274 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f80130260 0x7f7f80136c20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009e80 tx=0x7f7f7800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:42.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.101+0000 7f7f85cff700 1 -- 172.21.15.72:0/1733869274 shutdown_connections 2023-10-03T10:13:42.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.101+0000 7f7f85cff700 1 --2- 172.21.15.72:0/1733869274 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f80130260 0x7f7f80136c20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.101+0000 7f7f85cff700 1 --2- 172.21.15.72:0/1733869274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8012cf60 0x7f7f8006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.101+0000 7f7f85cff700 1 --2- 172.21.15.72:0/1733869274 >> v2:172.21.15.72:3300/0 conn(0x7f7f8012f8b0 0x7f7f8012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.101+0000 7f7f85cff700 1 -- 172.21.15.72:0/1733869274 >> 172.21.15.72:0/1733869274 conn(0x7f7f800a2aa0 msgr2=0x7f7f800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.101+0000 7f7f85cff700 1 -- 172.21.15.72:0/1733869274 shutdown_connections 2023-10-03T10:13:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.101+0000 7f7f85cff700 1 -- 172.21.15.72:0/1733869274 wait complete. 2023-10-03T10:13:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.102+0000 7f7f85cff700 1 Processor -- start 2023-10-03T10:13:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.102+0000 7f7f85cff700 1 -- start start 2023-10-03T10:13:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.102+0000 7f7f85cff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8012cf60 0x7f7f801309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.102+0000 7f7f85cff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f8012f8b0 0x7f7f80130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.102+0000 7f7f85cff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f80130260 0x7f7f80131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.103+0000 7f7f85cff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f80133b30 con 0x7f7f8012f8b0 2023-10-03T10:13:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.103+0000 7f7f85cff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8009e770 con 0x7f7f8012cf60 2023-10-03T10:13:42.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.103+0000 7f7f85cff700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8012da40 con 0x7f7f80130260 2023-10-03T10:13:42.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.103+0000 7f7f7ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f80130260 0x7f7f80131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.103+0000 7f7f7effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f8012f8b0 0x7f7f80130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.103+0000 7f7f7ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f80130260 0x7f7f80131460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38460/0 (socket says 172.21.15.72:38460) 2023-10-03T10:13:42.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.103+0000 7f7f7effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f8012f8b0 0x7f7f80130f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46602/0 (socket says 172.21.15.72:46602) 2023-10-03T10:13:42.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.103+0000 7f7f7ffff700 1 -- 172.21.15.72:0/2486834133 learned_addr learned my addr 172.21.15.72:0/2486834133 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:42.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.103+0000 7f7f7f7fe700 1 --2- 172.21.15.72:0/2486834133 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8012cf60 0x7f7f801309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.103+0000 7f7f7ffff700 1 -- 172.21.15.72:0/2486834133 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8012cf60 msgr2=0x7f7f801309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.103+0000 7f7f7ffff700 1 --2- 172.21.15.72:0/2486834133 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8012cf60 0x7f7f801309e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.103+0000 7f7f7ffff700 1 -- 172.21.15.72:0/2486834133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f8012f8b0 msgr2=0x7f7f80130f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.103+0000 7f7f7ffff700 1 --2- 172.21.15.72:0/2486834133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f8012f8b0 0x7f7f80130f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.103+0000 7f7f7ffff700 1 -- 172.21.15.72:0/2486834133 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f78009b30 con 0x7f7f80130260 2023-10-03T10:13:42.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.104+0000 7f7f7ffff700 1 --2- 172.21.15.72:0/2486834133 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f80130260 0x7f7f80131460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7f80130860 tx=0x7f7f78004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.104+0000 7f7f67fff700 1 -- 172.21.15.72:0/2486834133 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78004450 con 0x7f7f80130260 2023-10-03T10:13:42.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.104+0000 7f7f67fff700 1 -- 172.21.15.72:0/2486834133 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f780045b0 con 0x7f7f80130260 2023-10-03T10:13:42.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.104+0000 7f7f85cff700 1 -- 172.21.15.72:0/2486834133 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f80129fa0 con 0x7f7f80130260 2023-10-03T10:13:42.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.104+0000 7f7f67fff700 1 -- 172.21.15.72:0/2486834133 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f78004960 con 0x7f7f80130260 2023-10-03T10:13:42.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.104+0000 7f7f85cff700 1 -- 172.21.15.72:0/2486834133 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8009dd20 con 0x7f7f80130260 2023-10-03T10:13:42.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.105+0000 7f7f85cff700 1 -- 172.21.15.72:0/2486834133 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f80074ea0 con 0x7f7f80130260 2023-10-03T10:13:42.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.105+0000 7f7f67fff700 1 -- 172.21.15.72:0/2486834133 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f7801c410 con 0x7f7f80130260 2023-10-03T10:13:42.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.105+0000 7f7f67fff700 1 -- 172.21.15.72:0/2486834133 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7f78041110 con 0x7f7f80130260 2023-10-03T10:13:42.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.110+0000 7f7f67fff700 1 -- 172.21.15.72:0/2486834133 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f780117a0 con 0x7f7f80130260 2023-10-03T10:13:42.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.174+0000 7f4122b60700 1 Processor -- start 2023-10-03T10:13:42.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.174+0000 7f4122b60700 1 -- start start 2023-10-03T10:13:42.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.175+0000 7f4122b60700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f411c09e1d0 0x7f411c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.175+0000 7f4122b60700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f411c139170 0x7f411c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.175+0000 7f4122b60700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411c09d2f0 con 0x7f411c09d6f0 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.175+0000 7f4122b60700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c09b0f0 con 0x7f411c139170 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.175+0000 7f4122b60700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f411c09a810 con 0x7f411c09e1d0 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.175+0000 7f411bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f411c09e1d0 0x7f411c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.175+0000 7f41208fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f411c09d6f0 0x7f411c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50574/0 (socket says 172.21.15.72:50574) 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.175+0000 7f41208fc700 1 -- 172.21.15.72:0/1860244744 learned_addr learned my addr 172.21.15.72:0/1860244744 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:42.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.175+0000 7f41210fd700 1 --2- 172.21.15.72:0/1860244744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f411c139170 0x7f411c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.175+0000 7f411bfff700 1 -- 172.21.15.72:0/1860244744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f411c139170 msgr2=0x7f411c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.175+0000 7f411bfff700 1 --2- 172.21.15.72:0/1860244744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f411c139170 0x7f411c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.175+0000 7f411bfff700 1 -- 172.21.15.72:0/1860244744 >> v1:172.21.15.72:6789/0 conn(0x7f411c09d6f0 legacy=0x7f411c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.175+0000 7f411bfff700 1 -- 172.21.15.72:0/1860244744 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c09a470 con 0x7f411c09e1d0 2023-10-03T10:13:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.176+0000 7f411bfff700 1 --2- 172.21.15.72:0/1860244744 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f411c09e1d0 0x7f411c138c30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4108009870 tx=0x7f4108009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abca18b19310b536 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.176+0000 7f411b7fe700 1 -- 172.21.15.72:0/1860244744 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108011830 con 0x7f411c09e1d0 2023-10-03T10:13:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.176+0000 7f411b7fe700 1 -- 172.21.15.72:0/1860244744 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4108011990 con 0x7f411c09e1d0 2023-10-03T10:13:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.176+0000 7f411b7fe700 1 -- 172.21.15.72:0/1860244744 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108011d20 con 0x7f411c09e1d0 2023-10-03T10:13:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.177+0000 7f4122b60700 1 -- 172.21.15.72:0/1860244744 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f411c09e1d0 msgr2=0x7f411c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.177+0000 7f4122b60700 1 --2- 172.21.15.72:0/1860244744 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f411c09e1d0 0x7f411c138c30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4108009870 tx=0x7f4108009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.177+0000 7f4122b60700 1 -- 172.21.15.72:0/1860244744 shutdown_connections 2023-10-03T10:13:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.177+0000 7f4122b60700 1 --2- 172.21.15.72:0/1860244744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f411c139170 0x7f411c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.177+0000 7f4122b60700 1 --2- 172.21.15.72:0/1860244744 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f411c09e1d0 0x7f411c138c30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.177+0000 7f4122b60700 1 -- 172.21.15.72:0/1860244744 >> 172.21.15.72:0/1860244744 conn(0x7f411c066f50 msgr2=0x7f411c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.177+0000 7f4122b60700 1 -- 172.21.15.72:0/1860244744 shutdown_connections 2023-10-03T10:13:42.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.177+0000 7f4122b60700 1 -- 172.21.15.72:0/1860244744 wait complete. 2023-10-03T10:13:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.178+0000 7f4122b60700 1 Processor -- start 2023-10-03T10:13:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.178+0000 7f4122b60700 1 -- start start 2023-10-03T10:13:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.179+0000 7f4122b60700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f411c09d6f0 0x7f411c122640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.179+0000 7f4122b60700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f411c09e1d0 0x7f411c122b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.179+0000 7f4122b60700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f411c139170 0x7f411c1c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.179+0000 7f4122b60700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c1230c0 con 0x7f411c09d6f0 2023-10-03T10:13:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.179+0000 7f4122b60700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c122230 con 0x7f411c09e1d0 2023-10-03T10:13:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.179+0000 7f4122b60700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f411c0a2020 con 0x7f411c139170 2023-10-03T10:13:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.179+0000 7f41208fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f411c09d6f0 0x7f411c122640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.179+0000 7f41208fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f411c09d6f0 0x7f411c122640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46618/0 (socket says 172.21.15.72:46618) 2023-10-03T10:13:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.179+0000 7f41208fc700 1 -- 172.21.15.72:0/1755905627 learned_addr learned my addr 172.21.15.72:0/1755905627 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.179+0000 7f411bfff700 1 --2- 172.21.15.72:0/1755905627 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f411c09e1d0 0x7f411c122b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.179+0000 7f41210fd700 1 --2- 172.21.15.72:0/1755905627 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f411c139170 0x7f411c1c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.180+0000 7f41208fc700 1 -- 172.21.15.72:0/1755905627 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f411c139170 msgr2=0x7f411c1c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.180+0000 7f41208fc700 1 --2- 172.21.15.72:0/1755905627 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f411c139170 0x7f411c1c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.180+0000 7f41208fc700 1 -- 172.21.15.72:0/1755905627 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f411c09e1d0 msgr2=0x7f411c122b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.180+0000 7f41208fc700 1 --2- 172.21.15.72:0/1755905627 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f411c09e1d0 0x7f411c122b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.180+0000 7f41208fc700 1 -- 172.21.15.72:0/1755905627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41080094a0 con 0x7f411c09d6f0 2023-10-03T10:13:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.180+0000 7f411bfff700 1 --2- 172.21.15.72:0/1755905627 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f411c09e1d0 0x7f411c122b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.180+0000 7f41210fd700 1 --2- 172.21.15.72:0/1755905627 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f411c139170 0x7f411c1c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.180+0000 7f41208fc700 1 --2- 172.21.15.72:0/1755905627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f411c09d6f0 0x7f411c122640 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f411000c480 tx=0x7f411000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.180+0000 7f41197fa700 1 -- 172.21.15.72:0/1755905627 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110005d70 con 0x7f411c09d6f0 2023-10-03T10:13:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.180+0000 7f41197fa700 1 -- 172.21.15.72:0/1755905627 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41100070d0 con 0x7f411c09d6f0 2023-10-03T10:13:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.180+0000 7f4122b60700 1 -- 172.21.15.72:0/1755905627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411c09c640 con 0x7f411c09d6f0 2023-10-03T10:13:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.180+0000 7f41197fa700 1 -- 172.21.15.72:0/1755905627 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110007440 con 0x7f411c09d6f0 2023-10-03T10:13:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.180+0000 7f4122b60700 1 -- 172.21.15.72:0/1755905627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c124080 con 0x7f411c09d6f0 2023-10-03T10:13:42.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.181+0000 7f41197fa700 1 -- 172.21.15.72:0/1755905627 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41100075a0 con 0x7f411c09d6f0 2023-10-03T10:13:42.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.181+0000 7f41197fa700 1 -- 172.21.15.72:0/1755905627 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f411003eb90 con 0x7f411c09d6f0 2023-10-03T10:13:42.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.181+0000 7f4122b60700 1 -- 172.21.15.72:0/1755905627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411c125320 con 0x7f411c09d6f0 2023-10-03T10:13:42.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.186+0000 7f41197fa700 1 -- 172.21.15.72:0/1755905627 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f411c125320 con 0x7f411c09d6f0 2023-10-03T10:13:42.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.210+0000 7f1dff289700 1 Processor -- start 2023-10-03T10:13:42.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.210+0000 7f1dff289700 1 -- start start 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.211+0000 7f1dff289700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1df809e1d0 0x7f1df8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.211+0000 7f1dff289700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1df8139170 0x7f1df813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.211+0000 7f1dff289700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df809b120 con 0x7f1df809d6f0 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.211+0000 7f1dff289700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df806b460 con 0x7f1df809e1d0 2023-10-03T10:13:42.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.211+0000 7f1dff289700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df809a7e0 con 0x7f1df8139170 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.211+0000 7f1dfd025700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1df809d6f0 0x7f1df809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50590/0 (socket says 172.21.15.72:50590) 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.211+0000 7f1dfd025700 1 -- 172.21.15.72:0/2581734921 learned_addr learned my addr 172.21.15.72:0/2581734921 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.211+0000 7f1dfc824700 1 --2- 172.21.15.72:0/2581734921 >> v2:172.21.15.72:3300/0 conn(0x7f1df809e1d0 0x7f1df8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.211+0000 7f1dfd826700 1 --2- 172.21.15.72:0/2581734921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1df8139170 0x7f1df813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.211+0000 7f1deffff700 1 -- 172.21.15.72:0/2581734921 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302880330 0 0) 0x7f1df809b120 con 0x7f1df809d6f0 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.211+0000 7f1dfd826700 1 -- 172.21.15.72:0/2581734921 >> v2:172.21.15.72:3300/0 conn(0x7f1df809e1d0 msgr2=0x7f1df8138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.211+0000 7f1dfd826700 1 --2- 172.21.15.72:0/2581734921 >> v2:172.21.15.72:3300/0 conn(0x7f1df809e1d0 0x7f1df8138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.211+0000 7f1dfd826700 1 -- 172.21.15.72:0/2581734921 >> v1:172.21.15.72:6789/0 conn(0x7f1df809d6f0 legacy=0x7f1df809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.211+0000 7f1dfd826700 1 -- 172.21.15.72:0/2581734921 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df809a500 con 0x7f1df8139170 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.211+0000 7f1dfc824700 1 --2- 172.21.15.72:0/2581734921 >> v2:172.21.15.72:3300/0 conn(0x7f1df809e1d0 0x7f1df8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.212+0000 7f1dfd826700 1 --2- 172.21.15.72:0/2581734921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1df8139170 0x7f1df813b550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009dc0 tx=0x7f1df000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14d73fdcabe6a244 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.212+0000 7f1deffff700 1 -- 172.21.15.72:0/2581734921 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df000e070 con 0x7f1df8139170 2023-10-03T10:13:42.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.212+0000 7f1deffff700 1 -- 172.21.15.72:0/2581734921 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df000bae0 con 0x7f1df8139170 2023-10-03T10:13:42.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.212+0000 7f1deffff700 1 -- 172.21.15.72:0/2581734921 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df000be90 con 0x7f1df8139170 2023-10-03T10:13:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.212+0000 7f1dff289700 1 -- 172.21.15.72:0/2581734921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1df8139170 msgr2=0x7f1df813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.212+0000 7f1dff289700 1 --2- 172.21.15.72:0/2581734921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1df8139170 0x7f1df813b550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009dc0 tx=0x7f1df000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.212+0000 7f1dff289700 1 -- 172.21.15.72:0/2581734921 shutdown_connections 2023-10-03T10:13:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.212+0000 7f1dff289700 1 --2- 172.21.15.72:0/2581734921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1df8139170 0x7f1df813b550 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.212+0000 7f1dff289700 1 --2- 172.21.15.72:0/2581734921 >> v2:172.21.15.72:3300/0 conn(0x7f1df809e1d0 0x7f1df8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.212+0000 7f1dff289700 1 -- 172.21.15.72:0/2581734921 >> 172.21.15.72:0/2581734921 conn(0x7f1df8066f50 msgr2=0x7f1df809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.213+0000 7f1dff289700 1 -- 172.21.15.72:0/2581734921 shutdown_connections 2023-10-03T10:13:42.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.213+0000 7f1dff289700 1 -- 172.21.15.72:0/2581734921 wait complete. 2023-10-03T10:13:42.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.213+0000 7f1dff289700 1 Processor -- start 2023-10-03T10:13:42.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.213+0000 7f1dff289700 1 -- start start 2023-10-03T10:13:42.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dff289700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1df809d6f0 0x7f1df81217a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dff289700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df809e1d0 0x7f1df8121ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dff289700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1df8139170 0x7f1df8122220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dff289700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df8124fe0 con 0x7f1df809e1d0 2023-10-03T10:13:42.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dff289700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df8124ac0 con 0x7f1df8139170 2023-10-03T10:13:42.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dff289700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1df80a2000 con 0x7f1df809d6f0 2023-10-03T10:13:42.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dfd826700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1df8139170 0x7f1df8122220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dfd826700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1df8139170 0x7f1df8122220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39914/0 (socket says 172.21.15.72:39914) 2023-10-03T10:13:42.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dfd826700 1 -- 172.21.15.72:0/3826713583 learned_addr learned my addr 172.21.15.72:0/3826713583 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dfc824700 1 --2- 172.21.15.72:0/3826713583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df809e1d0 0x7f1df8121ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dfd826700 1 -- 172.21.15.72:0/3826713583 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1df809d6f0 msgr2=0x7f1df81217a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dfd826700 1 --2- 172.21.15.72:0/3826713583 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1df809d6f0 0x7f1df81217a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dfd826700 1 -- 172.21.15.72:0/3826713583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df809e1d0 msgr2=0x7f1df8121ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dfd826700 1 --2- 172.21.15.72:0/3826713583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df809e1d0 0x7f1df8121ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dfd826700 1 -- 172.21.15.72:0/3826713583 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de80094a0 con 0x7f1df8139170 2023-10-03T10:13:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dfc824700 1 --2- 172.21.15.72:0/3826713583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df809e1d0 0x7f1df8121ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.214+0000 7f1dfd826700 1 --2- 172.21.15.72:0/3826713583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1df8139170 0x7f1df8122220 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1df0014040 tx=0x7f1df0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.215+0000 7f1dedffb700 1 -- 172.21.15.72:0/3826713583 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df00046c0 con 0x7f1df8139170 2023-10-03T10:13:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.215+0000 7f1dedffb700 1 -- 172.21.15.72:0/3826713583 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df0020070 con 0x7f1df8139170 2023-10-03T10:13:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.215+0000 7f1dff289700 1 -- 172.21.15.72:0/3826713583 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df0009a70 con 0x7f1df8139170 2023-10-03T10:13:42.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.215+0000 7f1dedffb700 1 -- 172.21.15.72:0/3826713583 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0027480 con 0x7f1df8139170 2023-10-03T10:13:42.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.215+0000 7f1dff289700 1 -- 172.21.15.72:0/3826713583 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df8125a50 con 0x7f1df8139170 2023-10-03T10:13:42.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.216+0000 7f1dedffb700 1 -- 172.21.15.72:0/3826713583 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1df00275e0 con 0x7f1df8139170 2023-10-03T10:13:42.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.216+0000 7f1dedffb700 1 -- 172.21.15.72:0/3826713583 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1df0022070 con 0x7f1df8139170 2023-10-03T10:13:42.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.216+0000 7f1dff289700 1 -- 172.21.15.72:0/3826713583 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df8074ea0 con 0x7f1df8139170 2023-10-03T10:13:42.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.225+0000 7f1dedffb700 1 -- 172.21.15.72:0/3826713583 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1df0027890 con 0x7f1df8139170 2023-10-03T10:13:42.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.273+0000 7f636b417700 1 -- 172.21.15.72:0/1618325789 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6364074ea0 con 0x7f63641338a0 2023-10-03T10:13:42.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.273+0000 7f6359ffb700 1 -- 172.21.15.72:0/1618325789 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f635c012340 con 0x7f63641338a0 2023-10-03T10:13:42.274 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:42.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.276+0000 7f636b417700 1 -- 172.21.15.72:0/1618325789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63641338a0 msgr2=0x7f636411e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.276+0000 7f636b417700 1 --2- 172.21.15.72:0/1618325789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63641338a0 0x7f636411e2a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f635c00efc0 tx=0x7f635c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.276+0000 7f636b417700 1 -- 172.21.15.72:0/1618325789 shutdown_connections 2023-10-03T10:13:42.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.276+0000 7f636b417700 1 --2- 172.21.15.72:0/1618325789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63641338a0 0x7f636411e2a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.276+0000 7f636b417700 1 --2- 172.21.15.72:0/1618325789 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f636409de50 0x7f636411d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.276+0000 7f636b417700 1 --2- 172.21.15.72:0/1618325789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f636409e930 0x7f636411dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.276+0000 7f636b417700 1 -- 172.21.15.72:0/1618325789 >> 172.21.15.72:0/1618325789 conn(0x7f63640a2aa0 msgr2=0x7f63641badd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.276+0000 7f636b417700 1 -- 172.21.15.72:0/1618325789 shutdown_connections 2023-10-03T10:13:42.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.276+0000 7f636b417700 1 -- 172.21.15.72:0/1618325789 wait complete. 2023-10-03T10:13:42.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:42.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.340+0000 7f7f85cff700 1 -- 172.21.15.72:0/2486834133 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7f800713a0 con 0x7f7f80130260 2023-10-03T10:13:42.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.341+0000 7f7f67fff700 1 -- 172.21.15.72:0/2486834133 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7f78011390 con 0x7f7f80130260 2023-10-03T10:13:42.342 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:42.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.343+0000 7f7f85cff700 1 -- 172.21.15.72:0/2486834133 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f80130260 msgr2=0x7f7f80131460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.343+0000 7f7f85cff700 1 --2- 172.21.15.72:0/2486834133 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f80130260 0x7f7f80131460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7f80130860 tx=0x7f7f78004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.343+0000 7f7f85cff700 1 -- 172.21.15.72:0/2486834133 shutdown_connections 2023-10-03T10:13:42.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.343+0000 7f7f85cff700 1 --2- 172.21.15.72:0/2486834133 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f80130260 0x7f7f80131460 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.343+0000 7f7f85cff700 1 --2- 172.21.15.72:0/2486834133 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8012cf60 0x7f7f801309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.343+0000 7f7f85cff700 1 --2- 172.21.15.72:0/2486834133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f8012f8b0 0x7f7f80130f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.343+0000 7f7f85cff700 1 -- 172.21.15.72:0/2486834133 >> 172.21.15.72:0/2486834133 conn(0x7f7f800a2aa0 msgr2=0x7f7f8012a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.344+0000 7f7f85cff700 1 -- 172.21.15.72:0/2486834133 shutdown_connections 2023-10-03T10:13:42.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.344+0000 7f7f85cff700 1 -- 172.21.15.72:0/2486834133 wait complete. 2023-10-03T10:13:42.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:42.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.392+0000 7f4122b60700 1 -- 172.21.15.72:0/1755905627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f411c125320 con 0x7f411c09d6f0 2023-10-03T10:13:42.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.392+0000 7f41197fa700 1 -- 172.21.15.72:0/1755905627 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f411c125320 con 0x7f411c09d6f0 2023-10-03T10:13:42.393 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:42.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.394+0000 7f4122b60700 1 -- 172.21.15.72:0/1755905627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f411c09d6f0 msgr2=0x7f411c122640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.394+0000 7f4122b60700 1 --2- 172.21.15.72:0/1755905627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f411c09d6f0 0x7f411c122640 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f411000c480 tx=0x7f411000c840 comp rx=0 tx=0).stop 2023-10-03T10:13:42.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.395+0000 7f4122b60700 1 -- 172.21.15.72:0/1755905627 shutdown_connections 2023-10-03T10:13:42.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.395+0000 7f4122b60700 1 --2- 172.21.15.72:0/1755905627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f411c09d6f0 0x7f411c122640 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.395+0000 7f4122b60700 1 --2- 172.21.15.72:0/1755905627 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f411c139170 0x7f411c1c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.395+0000 7f4122b60700 1 --2- 172.21.15.72:0/1755905627 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f411c09e1d0 0x7f411c122b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.395+0000 7f4122b60700 1 -- 172.21.15.72:0/1755905627 >> 172.21.15.72:0/1755905627 conn(0x7f411c066f50 msgr2=0x7f411c09fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.395+0000 7f4122b60700 1 -- 172.21.15.72:0/1755905627 shutdown_connections 2023-10-03T10:13:42.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.395+0000 7f4122b60700 1 -- 172.21.15.72:0/1755905627 wait complete. 2023-10-03T10:13:42.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:42.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.420+0000 7f1dff289700 1 -- 172.21.15.72:0/3826713583 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1df809f420 con 0x7f1df8139170 2023-10-03T10:13:42.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.420+0000 7f1dedffb700 1 -- 172.21.15.72:0/3826713583 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1df001c400 con 0x7f1df8139170 2023-10-03T10:13:42.421 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:42.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.422+0000 7f1dff289700 1 -- 172.21.15.72:0/3826713583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1df8139170 msgr2=0x7f1df8122220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.422+0000 7f1dff289700 1 --2- 172.21.15.72:0/3826713583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1df8139170 0x7f1df8122220 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1df0014040 tx=0x7f1df0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.422+0000 7f1dff289700 1 -- 172.21.15.72:0/3826713583 shutdown_connections 2023-10-03T10:13:42.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.422+0000 7f1dff289700 1 --2- 172.21.15.72:0/3826713583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1df8139170 0x7f1df8122220 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.422+0000 7f1dff289700 1 --2- 172.21.15.72:0/3826713583 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1df809d6f0 0x7f1df81217a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.422+0000 7f1dff289700 1 --2- 172.21.15.72:0/3826713583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1df809e1d0 0x7f1df8121ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.422+0000 7f1dff289700 1 -- 172.21.15.72:0/3826713583 >> 172.21.15.72:0/3826713583 conn(0x7f1df8066f50 msgr2=0x7f1df8070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.422+0000 7f1dff289700 1 -- 172.21.15.72:0/3826713583 shutdown_connections 2023-10-03T10:13:42.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:42.422+0000 7f1dff289700 1 -- 172.21.15.72:0/3826713583 wait complete. 2023-10-03T10:13:42.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:43.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:43.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:43.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:43.435 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:43.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.438+0000 7f2d4ebcb700 1 Processor -- start 2023-10-03T10:13:43.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.438+0000 7f2d4ebcb700 1 -- start start 2023-10-03T10:13:43.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d4ebcb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2d48130540 0x7f2d48130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d4ebcb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d4806fcf0 0x7f2d48138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d4ebcb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d480716a0 con 0x7f2d48130e50 2023-10-03T10:13:43.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d4ebcb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4809a390 con 0x7f2d48130540 2023-10-03T10:13:43.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d4ebcb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d48071290 con 0x7f2d4806fcf0 2023-10-03T10:13:43.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d4d168700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d4806fcf0 0x7f2d48138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d4c967700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2d48130540 0x7f2d48130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d4d168700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d4806fcf0 0x7f2d48138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38494/0 (socket says 172.21.15.72:38494) 2023-10-03T10:13:43.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d4c967700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2d48130540 0x7f2d48130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46630/0 (socket says 172.21.15.72:46630) 2023-10-03T10:13:43.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d4d168700 1 -- 172.21.15.72:0/3681996491 learned_addr learned my addr 172.21.15.72:0/3681996491 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:43.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d4d168700 1 -- 172.21.15.72:0/3681996491 >> v2:172.21.15.72:3300/0 conn(0x7f2d48130540 msgr2=0x7f2d48130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d4d168700 1 --2- 172.21.15.72:0/3681996491 >> v2:172.21.15.72:3300/0 conn(0x7f2d48130540 0x7f2d48130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d4d168700 1 -- 172.21.15.72:0/3681996491 >> v1:172.21.15.72:6789/0 conn(0x7f2d48130e50 legacy=0x7f2d4806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d4d168700 1 -- 172.21.15.72:0/3681996491 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d48130340 con 0x7f2d4806fcf0 2023-10-03T10:13:43.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d477fe700 1 -- 172.21.15.72:0/3681996491 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855330463 0 0) 0x7f2d480716a0 con 0x7f2d48130e50 2023-10-03T10:13:43.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.439+0000 7f2d4d168700 1 --2- 172.21.15.72:0/3681996491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d4806fcf0 0x7f2d48138570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009e80 tx=0x7f2d4000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1585f025429af312 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.440+0000 7f2d477fe700 1 -- 172.21.15.72:0/3681996491 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4000e070 con 0x7f2d4806fcf0 2023-10-03T10:13:43.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.440+0000 7f2d477fe700 1 -- 172.21.15.72:0/3681996491 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4000b8d0 con 0x7f2d4806fcf0 2023-10-03T10:13:43.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.440+0000 7f2d477fe700 1 -- 172.21.15.72:0/3681996491 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4000bc80 con 0x7f2d4806fcf0 2023-10-03T10:13:43.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.440+0000 7f2d4ebcb700 1 -- 172.21.15.72:0/3681996491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d4806fcf0 msgr2=0x7f2d48138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.440+0000 7f2d4ebcb700 1 --2- 172.21.15.72:0/3681996491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d4806fcf0 0x7f2d48138570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009e80 tx=0x7f2d4000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:43.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.440+0000 7f2d4ebcb700 1 -- 172.21.15.72:0/3681996491 shutdown_connections 2023-10-03T10:13:43.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.440+0000 7f2d4ebcb700 1 --2- 172.21.15.72:0/3681996491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d4806fcf0 0x7f2d48138570 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.440+0000 7f2d4ebcb700 1 --2- 172.21.15.72:0/3681996491 >> v2:172.21.15.72:3300/0 conn(0x7f2d48130540 0x7f2d48130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.440+0000 7f2d4ebcb700 1 -- 172.21.15.72:0/3681996491 >> 172.21.15.72:0/3681996491 conn(0x7f2d480a2aa0 msgr2=0x7f2d480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.441+0000 7f2d4ebcb700 1 -- 172.21.15.72:0/3681996491 shutdown_connections 2023-10-03T10:13:43.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.441+0000 7f2d4ebcb700 1 -- 172.21.15.72:0/3681996491 wait complete. 2023-10-03T10:13:43.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.442+0000 7f2d4ebcb700 1 Processor -- start 2023-10-03T10:13:43.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.442+0000 7f2d4ebcb700 1 -- start start 2023-10-03T10:13:43.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d4ebcb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d4806fcf0 0x7f2d4811a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d4ebcb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d48130540 0x7f2d4811aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d4ebcb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d48130e50 0x7f2d4811aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d4ebcb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4811ba20 con 0x7f2d4806fcf0 2023-10-03T10:13:43.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d4ebcb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4811c180 con 0x7f2d48130e50 2023-10-03T10:13:43.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d4ebcb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4811d3d0 con 0x7f2d48130540 2023-10-03T10:13:43.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d47fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d48130540 0x7f2d4811aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d47fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d48130540 0x7f2d4811aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38502/0 (socket says 172.21.15.72:38502) 2023-10-03T10:13:43.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d47fff700 1 -- 172.21.15.72:0/841440183 learned_addr learned my addr 172.21.15.72:0/841440183 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:43.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d4d168700 1 --2- 172.21.15.72:0/841440183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d48130e50 0x7f2d4811aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d4c967700 1 --2- 172.21.15.72:0/841440183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d4806fcf0 0x7f2d4811a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d47fff700 1 -- 172.21.15.72:0/841440183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d48130e50 msgr2=0x7f2d4811aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d47fff700 1 --2- 172.21.15.72:0/841440183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d48130e50 0x7f2d4811aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d47fff700 1 -- 172.21.15.72:0/841440183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d4806fcf0 msgr2=0x7f2d4811a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d47fff700 1 --2- 172.21.15.72:0/841440183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d4806fcf0 0x7f2d4811a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d47fff700 1 -- 172.21.15.72:0/841440183 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d40009b30 con 0x7f2d48130540 2023-10-03T10:13:43.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d4d168700 1 --2- 172.21.15.72:0/841440183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d48130e50 0x7f2d4811aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.443+0000 7f2d47fff700 1 --2- 172.21.15.72:0/841440183 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d48130540 0x7f2d4811aab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400c520 tx=0x7f2d3400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.444+0000 7f2d457fa700 1 -- 172.21.15.72:0/841440183 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d340054e0 con 0x7f2d48130540 2023-10-03T10:13:43.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.444+0000 7f2d457fa700 1 -- 172.21.15.72:0/841440183 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d34003680 con 0x7f2d48130540 2023-10-03T10:13:43.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.444+0000 7f2d457fa700 1 -- 172.21.15.72:0/841440183 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d340039f0 con 0x7f2d48130540 2023-10-03T10:13:43.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.444+0000 7f2d4ebcb700 1 -- 172.21.15.72:0/841440183 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4811ddb0 con 0x7f2d48130540 2023-10-03T10:13:43.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.444+0000 7f2d4ebcb700 1 -- 172.21.15.72:0/841440183 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d480718e0 con 0x7f2d48130540 2023-10-03T10:13:43.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.444+0000 7f2d457fa700 1 -- 172.21.15.72:0/841440183 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d34003b50 con 0x7f2d48130540 2023-10-03T10:13:43.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.444+0000 7f2d457fa700 1 -- 172.21.15.72:0/841440183 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2d3403ea10 con 0x7f2d48130540 2023-10-03T10:13:43.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.445+0000 7f2d4ebcb700 1 -- 172.21.15.72:0/841440183 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4809cd40 con 0x7f2d48130540 2023-10-03T10:13:43.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.453+0000 7f2d457fa700 1 -- 172.21.15.72:0/841440183 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d3401b3b0 con 0x7f2d48130540 2023-10-03T10:13:43.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.504+0000 7f58cb622700 1 Processor -- start 2023-10-03T10:13:43.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.505+0000 7f58cb622700 1 -- start start 2023-10-03T10:13:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.505+0000 7f58cb622700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58c40a0a30 0x7f58c40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.505+0000 7f58cb622700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f58c409d630 0x7f58c40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.505+0000 7f58cb622700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58c4133930 0x7f58c4133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.505+0000 7f58cb622700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c40a2a70 con 0x7f58c409d630 2023-10-03T10:13:43.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.505+0000 7f58cb622700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40a01d0 con 0x7f58c40a0a30 2023-10-03T10:13:43.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.505+0000 7f58cb622700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58c409e2b0 con 0x7f58c4133930 2023-10-03T10:13:43.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58c9bbf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58c4133930 0x7f58c4133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58c8bbd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f58c409d630 0x7f58c40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58c93be700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58c40a0a30 0x7f58c40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58c8bbd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f58c409d630 0x7f58c40a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46642/0 (socket says 172.21.15.72:46642) 2023-10-03T10:13:43.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58c9bbf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58c4133930 0x7f58c4133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38508/0 (socket says 172.21.15.72:38508) 2023-10-03T10:13:43.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58c8bbd700 1 -- 172.21.15.72:0/2545300980 learned_addr learned my addr 172.21.15.72:0/2545300980 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:43.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58c8bbd700 1 -- 172.21.15.72:0/2545300980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58c4133930 msgr2=0x7f58c4133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58c8bbd700 1 --2- 172.21.15.72:0/2545300980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58c4133930 0x7f58c4133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58c8bbd700 1 -- 172.21.15.72:0/2545300980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58c40a0a30 msgr2=0x7f58c40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58c8bbd700 1 --2- 172.21.15.72:0/2545300980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58c40a0a30 0x7f58c40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58c8bbd700 1 -- 172.21.15.72:0/2545300980 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c409dc50 con 0x7f58c409d630 2023-10-03T10:13:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58c9bbf700 1 --2- 172.21.15.72:0/2545300980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58c4133930 0x7f58c4133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58c8bbd700 1 --2- 172.21.15.72:0/2545300980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58c409d630 0x7f58c40a1340 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f58b40098f0 tx=0x7f58b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f456b6fd00b828e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58bbfff700 1 -- 172.21.15.72:0/2545300980 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4011830 con 0x7f58c409d630 2023-10-03T10:13:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58bbfff700 1 -- 172.21.15.72:0/2545300980 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b4011990 con 0x7f58c409d630 2023-10-03T10:13:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.506+0000 7f58bbfff700 1 -- 172.21.15.72:0/2545300980 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4011d20 con 0x7f58c409d630 2023-10-03T10:13:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.507+0000 7f58cb622700 1 -- 172.21.15.72:0/2545300980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58c409d630 msgr2=0x7f58c40a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.507+0000 7f58cb622700 1 --2- 172.21.15.72:0/2545300980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58c409d630 0x7f58c40a1340 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f58b40098f0 tx=0x7f58b4009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.507+0000 7f58cb622700 1 -- 172.21.15.72:0/2545300980 shutdown_connections 2023-10-03T10:13:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.507+0000 7f58cb622700 1 --2- 172.21.15.72:0/2545300980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58c4133930 0x7f58c4133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.507+0000 7f58cb622700 1 --2- 172.21.15.72:0/2545300980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58c40a0a30 0x7f58c40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.507+0000 7f58cb622700 1 --2- 172.21.15.72:0/2545300980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58c409d630 0x7f58c40a1340 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.507+0000 7f58cb622700 1 -- 172.21.15.72:0/2545300980 >> 172.21.15.72:0/2545300980 conn(0x7f58c40a3050 msgr2=0x7f58c40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.508+0000 7f58cb622700 1 -- 172.21.15.72:0/2545300980 shutdown_connections 2023-10-03T10:13:43.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.508+0000 7f58cb622700 1 -- 172.21.15.72:0/2545300980 wait complete. 2023-10-03T10:13:43.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.509+0000 7f58cb622700 1 Processor -- start 2023-10-03T10:13:43.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.509+0000 7f58cb622700 1 -- start start 2023-10-03T10:13:43.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.509+0000 7f58cb622700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58c409d630 0x7f58c411f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.509+0000 7f58cb622700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58c40a0a30 0x7f58c411f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.509+0000 7f58cb622700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58c4133930 0x7f58c41c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.509+0000 7f58cb622700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c411ee60 con 0x7f58c4133930 2023-10-03T10:13:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.509+0000 7f58cb622700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c411fdd0 con 0x7f58c409d630 2023-10-03T10:13:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.509+0000 7f58cb622700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58c4121e70 con 0x7f58c40a0a30 2023-10-03T10:13:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58c93be700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58c409d630 0x7f58c411f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58c93be700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58c409d630 0x7f58c411f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39946/0 (socket says 172.21.15.72:39946) 2023-10-03T10:13:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58c93be700 1 -- 172.21.15.72:0/1085721396 learned_addr learned my addr 172.21.15.72:0/1085721396 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58c9bbf700 1 --2- 172.21.15.72:0/1085721396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58c4133930 0x7f58c41c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58c8bbd700 1 --2- 172.21.15.72:0/1085721396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58c40a0a30 0x7f58c411f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58c9bbf700 1 -- 172.21.15.72:0/1085721396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58c40a0a30 msgr2=0x7f58c411f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58c9bbf700 1 --2- 172.21.15.72:0/1085721396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58c40a0a30 0x7f58c411f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58c9bbf700 1 -- 172.21.15.72:0/1085721396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58c409d630 msgr2=0x7f58c411f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58c9bbf700 1 --2- 172.21.15.72:0/1085721396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58c409d630 0x7f58c411f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58c9bbf700 1 -- 172.21.15.72:0/1085721396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc009a70 con 0x7f58c4133930 2023-10-03T10:13:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58c93be700 1 --2- 172.21.15.72:0/1085721396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58c409d630 0x7f58c411f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58c9bbf700 1 --2- 172.21.15.72:0/1085721396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58c4133930 0x7f58c41c8000 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00efc0 tx=0x7f58bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58b9ffb700 1 -- 172.21.15.72:0/1085721396 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc00ca90 con 0x7f58c4133930 2023-10-03T10:13:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58b9ffb700 1 -- 172.21.15.72:0/1085721396 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc00f040 con 0x7f58c4133930 2023-10-03T10:13:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58cb622700 1 -- 172.21.15.72:0/1085721396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b4009550 con 0x7f58c4133930 2023-10-03T10:13:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.510+0000 7f58b9ffb700 1 -- 172.21.15.72:0/1085721396 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc00ce30 con 0x7f58c4133930 2023-10-03T10:13:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.511+0000 7f58cb622700 1 -- 172.21.15.72:0/1085721396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c4122130 con 0x7f58c4133930 2023-10-03T10:13:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.511+0000 7f58b9ffb700 1 -- 172.21.15.72:0/1085721396 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f58bc014480 con 0x7f58c4133930 2023-10-03T10:13:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.512+0000 7f58b9ffb700 1 -- 172.21.15.72:0/1085721396 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f58bc042530 con 0x7f58c4133930 2023-10-03T10:13:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.513+0000 7f58cb622700 1 -- 172.21.15.72:0/1085721396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c4122320 con 0x7f58c4133930 2023-10-03T10:13:43.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.517+0000 7f58b9ffb700 1 -- 172.21.15.72:0/1085721396 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58bc012930 con 0x7f58c4133930 2023-10-03T10:13:43.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.563+0000 7f67021f4700 1 Processor -- start 2023-10-03T10:13:43.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.563+0000 7f67021f4700 1 -- start start 2023-10-03T10:13:43.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f67021f4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc09d6f0 0x7f66fc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f67021f4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09e000 0x7f66fc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f67021f4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc09f130 con 0x7f66fc09e410 2023-10-03T10:13:43.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f67021f4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc09f520 con 0x7f66fc09d6f0 2023-10-03T10:13:43.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f67021f4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc09e930 con 0x7f66fc09e000 2023-10-03T10:13:43.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f66fbfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f66fc09e410 0x7f66fc130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50616/0 (socket says 172.21.15.72:50616) 2023-10-03T10:13:43.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f66fbfff700 1 -- 172.21.15.72:0/1158833393 learned_addr learned my addr 172.21.15.72:0/1158833393 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:43.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f66fb7fe700 1 --2- 172.21.15.72:0/1158833393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc09d6f0 0x7f66fc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f66faffd700 1 --2- 172.21.15.72:0/1158833393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09e000 0x7f66fc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f66fa7fc700 1 -- 172.21.15.72:0/1158833393 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169699800 0 0) 0x7f66fc09f130 con 0x7f66fc09e410 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f66fa7fc700 1 -- 172.21.15.72:0/1158833393 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e40035b0 con 0x7f66fc09e410 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f66faffd700 1 -- 172.21.15.72:0/1158833393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc09d6f0 msgr2=0x7f66fc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f66faffd700 1 --2- 172.21.15.72:0/1158833393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc09d6f0 0x7f66fc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f66faffd700 1 -- 172.21.15.72:0/1158833393 >> v1:172.21.15.72:6789/0 conn(0x7f66fc09e410 legacy=0x7f66fc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f66faffd700 1 -- 172.21.15.72:0/1158833393 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc09b2d0 con 0x7f66fc09e000 2023-10-03T10:13:43.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f66fb7fe700 1 --2- 172.21.15.72:0/1158833393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc09d6f0 0x7f66fc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.564+0000 7f66faffd700 1 --2- 172.21.15.72:0/1158833393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09e000 0x7f66fc130660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f66f00098a0 tx=0x7f66f0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fed2c2e482ab1b12 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.565+0000 7f66fa7fc700 1 -- 172.21.15.72:0/1158833393 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f000f8a0 con 0x7f66fc09e000 2023-10-03T10:13:43.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.565+0000 7f66fa7fc700 1 -- 172.21.15.72:0/1158833393 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f000fa00 con 0x7f66fc09e000 2023-10-03T10:13:43.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.565+0000 7f66fa7fc700 1 -- 172.21.15.72:0/1158833393 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f000fd70 con 0x7f66fc09e000 2023-10-03T10:13:43.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.565+0000 7f67021f4700 1 -- 172.21.15.72:0/1158833393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09e000 msgr2=0x7f66fc130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.565+0000 7f67021f4700 1 --2- 172.21.15.72:0/1158833393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09e000 0x7f66fc130660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f66f00098a0 tx=0x7f66f0009bb0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.565+0000 7f67021f4700 1 -- 172.21.15.72:0/1158833393 shutdown_connections 2023-10-03T10:13:43.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.565+0000 7f67021f4700 1 --2- 172.21.15.72:0/1158833393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc09d6f0 0x7f66fc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.565+0000 7f67021f4700 1 --2- 172.21.15.72:0/1158833393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09e000 0x7f66fc130660 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.565+0000 7f67021f4700 1 -- 172.21.15.72:0/1158833393 >> 172.21.15.72:0/1158833393 conn(0x7f66fc066f50 msgr2=0x7f66fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.565+0000 7f67021f4700 1 -- 172.21.15.72:0/1158833393 shutdown_connections 2023-10-03T10:13:43.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.565+0000 7f67021f4700 1 -- 172.21.15.72:0/1158833393 wait complete. 2023-10-03T10:13:43.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.566+0000 7f67021f4700 1 Processor -- start 2023-10-03T10:13:43.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.566+0000 7f67021f4700 1 -- start start 2023-10-03T10:13:43.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f67021f4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09d6f0 0x7f66fc11dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f67021f4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09e000 0x7f66fc11e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f67021f4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc09e410 0x7f66fc11e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f67021f4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc1210f0 con 0x7f66fc09e000 2023-10-03T10:13:43.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f67021f4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc11fa10 con 0x7f66fc09e410 2023-10-03T10:13:43.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f67021f4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc1215a0 con 0x7f66fc09d6f0 2023-10-03T10:13:43.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f66fb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09d6f0 0x7f66fc11dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f66faffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09e000 0x7f66fc11e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f66fb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09d6f0 0x7f66fc11dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38540/0 (socket says 172.21.15.72:38540) 2023-10-03T10:13:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f66faffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09e000 0x7f66fc11e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46660/0 (socket says 172.21.15.72:46660) 2023-10-03T10:13:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f66fb7fe700 1 -- 172.21.15.72:0/3194769910 learned_addr learned my addr 172.21.15.72:0/3194769910 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f66fbfff700 1 --2- 172.21.15.72:0/3194769910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc09e410 0x7f66fc11e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f66fb7fe700 1 -- 172.21.15.72:0/3194769910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc09e410 msgr2=0x7f66fc11e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f66fb7fe700 1 --2- 172.21.15.72:0/3194769910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc09e410 0x7f66fc11e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f66fb7fe700 1 -- 172.21.15.72:0/3194769910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09e000 msgr2=0x7f66fc11e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f66fb7fe700 1 --2- 172.21.15.72:0/3194769910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09e000 0x7f66fc11e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.567+0000 7f66fb7fe700 1 -- 172.21.15.72:0/3194769910 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec0094a0 con 0x7f66fc09d6f0 2023-10-03T10:13:43.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.568+0000 7f66fb7fe700 1 --2- 172.21.15.72:0/3194769910 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09d6f0 0x7f66fc11dd60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f66ec010ef0 tx=0x7f66ec00b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.568+0000 7f66e3fff700 1 -- 172.21.15.72:0/3194769910 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec015070 con 0x7f66fc09d6f0 2023-10-03T10:13:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.568+0000 7f66e3fff700 1 -- 172.21.15.72:0/3194769910 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec00bc40 con 0x7f66fc09d6f0 2023-10-03T10:13:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.568+0000 7f67021f4700 1 -- 172.21.15.72:0/3194769910 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f00094a0 con 0x7f66fc09d6f0 2023-10-03T10:13:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.568+0000 7f66e3fff700 1 -- 172.21.15.72:0/3194769910 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec019410 con 0x7f66fc09d6f0 2023-10-03T10:13:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.568+0000 7f67021f4700 1 -- 172.21.15.72:0/3194769910 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc120bc0 con 0x7f66fc09d6f0 2023-10-03T10:13:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.568+0000 7f66e3fff700 1 -- 172.21.15.72:0/3194769910 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66ec019570 con 0x7f66fc09d6f0 2023-10-03T10:13:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.569+0000 7f66e3fff700 1 -- 172.21.15.72:0/3194769910 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f66ec043090 con 0x7f66fc09d6f0 2023-10-03T10:13:43.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.569+0000 7f67021f4700 1 -- 172.21.15.72:0/3194769910 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66fc11ac20 con 0x7f66fc09d6f0 2023-10-03T10:13:43.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.574+0000 7f66e3fff700 1 -- 172.21.15.72:0/3194769910 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66ec01e020 con 0x7f66fc09d6f0 2023-10-03T10:13:43.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.577+0000 7ff1648b8700 1 Processor -- start 2023-10-03T10:13:43.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.577+0000 7ff1648b8700 1 -- start start 2023-10-03T10:13:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.578+0000 7ff1648b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff160133510 0x7ff1601358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.578+0000 7ff1648b8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff160135e30 0x7ff160138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.578+0000 7ff1648b8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1601310d0 con 0x7ff1601305f0 2023-10-03T10:13:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.578+0000 7ff1648b8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1601301c0 con 0x7ff160135e30 2023-10-03T10:13:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.578+0000 7ff1648b8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff160071ff0 con 0x7ff160133510 2023-10-03T10:13:43.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.578+0000 7ff15e59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff1601305f0 0x7ff1601309c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50628/0 (socket says 172.21.15.72:50628) 2023-10-03T10:13:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.578+0000 7ff15e59c700 1 -- 172.21.15.72:0/4075371528 learned_addr learned my addr 172.21.15.72:0/4075371528 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.578+0000 7ff15dd9b700 1 --2- 172.21.15.72:0/4075371528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff160133510 0x7ff1601358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.578+0000 7ff15d59a700 1 -- 172.21.15.72:0/4075371528 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207974641 0 0) 0x7ff1601310d0 con 0x7ff1601305f0 2023-10-03T10:13:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.578+0000 7ff15dd9b700 1 -- 172.21.15.72:0/4075371528 >> v2:172.21.15.72:3300/0 conn(0x7ff160135e30 msgr2=0x7ff160138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.578+0000 7ff15dd9b700 1 --2- 172.21.15.72:0/4075371528 >> v2:172.21.15.72:3300/0 conn(0x7ff160135e30 0x7ff160138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.578+0000 7ff15dd9b700 1 -- 172.21.15.72:0/4075371528 >> v1:172.21.15.72:6789/0 conn(0x7ff1601305f0 legacy=0x7ff1601309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.578+0000 7ff15dd9b700 1 -- 172.21.15.72:0/4075371528 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff160070e70 con 0x7ff160133510 2023-10-03T10:13:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.578+0000 7ff15dd9b700 1 --2- 172.21.15.72:0/4075371528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff160133510 0x7ff1601358f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff154009840 tx=0x7ff154009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b3b37e2acb9bb64 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.579+0000 7ff15d59a700 1 -- 172.21.15.72:0/4075371528 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154011830 con 0x7ff160133510 2023-10-03T10:13:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.579+0000 7ff15d59a700 1 -- 172.21.15.72:0/4075371528 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff154011990 con 0x7ff160133510 2023-10-03T10:13:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.579+0000 7ff15d59a700 1 -- 172.21.15.72:0/4075371528 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154011d20 con 0x7ff160133510 2023-10-03T10:13:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.579+0000 7ff1648b8700 1 -- 172.21.15.72:0/4075371528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff160133510 msgr2=0x7ff1601358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.579+0000 7ff1648b8700 1 --2- 172.21.15.72:0/4075371528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff160133510 0x7ff1601358f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff154009840 tx=0x7ff154009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.579+0000 7ff1648b8700 1 -- 172.21.15.72:0/4075371528 shutdown_connections 2023-10-03T10:13:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.579+0000 7ff1648b8700 1 --2- 172.21.15.72:0/4075371528 >> v2:172.21.15.72:3300/0 conn(0x7ff160135e30 0x7ff160138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.579+0000 7ff1648b8700 1 --2- 172.21.15.72:0/4075371528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff160133510 0x7ff1601358f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.579+0000 7ff1648b8700 1 -- 172.21.15.72:0/4075371528 >> 172.21.15.72:0/4075371528 conn(0x7ff1600a2aa0 msgr2=0x7ff1600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.579+0000 7ff1648b8700 1 -- 172.21.15.72:0/4075371528 shutdown_connections 2023-10-03T10:13:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.579+0000 7ff1648b8700 1 -- 172.21.15.72:0/4075371528 wait complete. 2023-10-03T10:13:43.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.581+0000 7ff1648b8700 1 Processor -- start 2023-10-03T10:13:43.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.581+0000 7ff1648b8700 1 -- start start 2023-10-03T10:13:43.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.581+0000 7ff1648b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1601305f0 0x7ff16009d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.581+0000 7ff1648b8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff160133510 0x7ff16009d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.581+0000 7ff1648b8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff160135e30 0x7ff1601c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff1648b8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16011ab00 con 0x7ff160135e30 2023-10-03T10:13:43.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff1648b8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16012ff70 con 0x7ff1601305f0 2023-10-03T10:13:43.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff1648b8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff160071820 con 0x7ff160133510 2023-10-03T10:13:43.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff15e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1601305f0 0x7ff16009d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff15e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1601305f0 0x7ff16009d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39992/0 (socket says 172.21.15.72:39992) 2023-10-03T10:13:43.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff15e59c700 1 -- 172.21.15.72:0/455457474 learned_addr learned my addr 172.21.15.72:0/455457474 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:43.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff15ed9d700 1 --2- 172.21.15.72:0/455457474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff160135e30 0x7ff1601c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff15dd9b700 1 --2- 172.21.15.72:0/455457474 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff160133510 0x7ff16009d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff15e59c700 1 -- 172.21.15.72:0/455457474 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff160133510 msgr2=0x7ff16009d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff15e59c700 1 --2- 172.21.15.72:0/455457474 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff160133510 0x7ff16009d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff15e59c700 1 -- 172.21.15.72:0/455457474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff160135e30 msgr2=0x7ff1601c4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff15e59c700 1 --2- 172.21.15.72:0/455457474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff160135e30 0x7ff1601c4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff15e59c700 1 -- 172.21.15.72:0/455457474 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1540094a0 con 0x7ff1601305f0 2023-10-03T10:13:43.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff15e59c700 1 --2- 172.21.15.72:0/455457474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1601305f0 0x7ff16009d200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff15000c520 tx=0x7ff15000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff14effd700 1 -- 172.21.15.72:0/455457474 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150004c80 con 0x7ff1601305f0 2023-10-03T10:13:43.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff14effd700 1 -- 172.21.15.72:0/455457474 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff150004e00 con 0x7ff1601305f0 2023-10-03T10:13:43.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.582+0000 7ff1648b8700 1 -- 172.21.15.72:0/455457474 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16009cee0 con 0x7ff1601305f0 2023-10-03T10:13:43.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.583+0000 7ff14effd700 1 -- 172.21.15.72:0/455457474 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150007310 con 0x7ff1601305f0 2023-10-03T10:13:43.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.583+0000 7ff1648b8700 1 -- 172.21.15.72:0/455457474 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16011a5b0 con 0x7ff1601305f0 2023-10-03T10:13:43.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.584+0000 7ff14effd700 1 -- 172.21.15.72:0/455457474 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff150007470 con 0x7ff1601305f0 2023-10-03T10:13:43.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.584+0000 7ff1648b8700 1 -- 172.21.15.72:0/455457474 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16011a740 con 0x7ff1601305f0 2023-10-03T10:13:43.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.584+0000 7ff14effd700 1 -- 172.21.15.72:0/455457474 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff15003f350 con 0x7ff1601305f0 2023-10-03T10:13:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.593+0000 7ff14effd700 1 -- 172.21.15.72:0/455457474 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff1500133c0 con 0x7ff1601305f0 2023-10-03T10:13:43.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.655+0000 7f2d4ebcb700 1 -- 172.21.15.72:0/841440183 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2d48074ea0 con 0x7f2d48130540 2023-10-03T10:13:43.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.655+0000 7f2d457fa700 1 -- 172.21.15.72:0/841440183 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d34017020 con 0x7f2d48130540 2023-10-03T10:13:43.656 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:43.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.659+0000 7f2d4ebcb700 1 -- 172.21.15.72:0/841440183 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d48130540 msgr2=0x7f2d4811aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.659+0000 7f2d4ebcb700 1 --2- 172.21.15.72:0/841440183 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d48130540 0x7f2d4811aab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400c520 tx=0x7f2d3400c830 comp rx=0 tx=0).stop 2023-10-03T10:13:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.659+0000 7f2d4ebcb700 1 -- 172.21.15.72:0/841440183 shutdown_connections 2023-10-03T10:13:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.659+0000 7f2d4ebcb700 1 --2- 172.21.15.72:0/841440183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d4806fcf0 0x7f2d4811a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.659+0000 7f2d4ebcb700 1 --2- 172.21.15.72:0/841440183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d48130e50 0x7f2d4811aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.659+0000 7f2d4ebcb700 1 --2- 172.21.15.72:0/841440183 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d48130540 0x7f2d4811aab0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.659+0000 7f2d4ebcb700 1 -- 172.21.15.72:0/841440183 >> 172.21.15.72:0/841440183 conn(0x7f2d480a2aa0 msgr2=0x7f2d4812d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.659+0000 7f2d4ebcb700 1 -- 172.21.15.72:0/841440183 shutdown_connections 2023-10-03T10:13:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.659+0000 7f2d4ebcb700 1 -- 172.21.15.72:0/841440183 wait complete. 2023-10-03T10:13:43.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:43.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.736+0000 7f58cb622700 1 -- 172.21.15.72:0/1085721396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f58c40747f0 con 0x7f58c4133930 2023-10-03T10:13:43.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.736+0000 7f58b9ffb700 1 -- 172.21.15.72:0/1085721396 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f58bc012340 con 0x7f58c4133930 2023-10-03T10:13:43.737 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:43.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.738+0000 7f58cb622700 1 -- 172.21.15.72:0/1085721396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58c4133930 msgr2=0x7f58c41c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.738+0000 7f58cb622700 1 --2- 172.21.15.72:0/1085721396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58c4133930 0x7f58c41c8000 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00efc0 tx=0x7f58bc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.738+0000 7f58cb622700 1 -- 172.21.15.72:0/1085721396 shutdown_connections 2023-10-03T10:13:43.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.738+0000 7f58cb622700 1 --2- 172.21.15.72:0/1085721396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58c4133930 0x7f58c41c8000 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.738+0000 7f58cb622700 1 --2- 172.21.15.72:0/1085721396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58c409d630 0x7f58c411f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.738+0000 7f58cb622700 1 --2- 172.21.15.72:0/1085721396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58c40a0a30 0x7f58c411f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.738+0000 7f58cb622700 1 -- 172.21.15.72:0/1085721396 >> 172.21.15.72:0/1085721396 conn(0x7f58c40a3050 msgr2=0x7f58c409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.738+0000 7f58cb622700 1 -- 172.21.15.72:0/1085721396 shutdown_connections 2023-10-03T10:13:43.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.738+0000 7f58cb622700 1 -- 172.21.15.72:0/1085721396 wait complete. 2023-10-03T10:13:43.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:43.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.777+0000 7f67021f4700 1 -- 172.21.15.72:0/3194769910 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f66fc074ea0 con 0x7f66fc09d6f0 2023-10-03T10:13:43.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.778+0000 7f66e3fff700 1 -- 172.21.15.72:0/3194769910 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66ec0223b0 con 0x7f66fc09d6f0 2023-10-03T10:13:43.778 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:43.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.780+0000 7f67021f4700 1 -- 172.21.15.72:0/3194769910 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09d6f0 msgr2=0x7f66fc11dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.780+0000 7f67021f4700 1 --2- 172.21.15.72:0/3194769910 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09d6f0 0x7f66fc11dd60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f66ec010ef0 tx=0x7f66ec00b420 comp rx=0 tx=0).stop 2023-10-03T10:13:43.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.780+0000 7f67021f4700 1 -- 172.21.15.72:0/3194769910 shutdown_connections 2023-10-03T10:13:43.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.780+0000 7f67021f4700 1 --2- 172.21.15.72:0/3194769910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66fc09e410 0x7f66fc11e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.780+0000 7f67021f4700 1 --2- 172.21.15.72:0/3194769910 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f66fc09d6f0 0x7f66fc11dd60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.780+0000 7f67021f4700 1 --2- 172.21.15.72:0/3194769910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66fc09e000 0x7f66fc11e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.780+0000 7f67021f4700 1 -- 172.21.15.72:0/3194769910 >> 172.21.15.72:0/3194769910 conn(0x7f66fc066f50 msgr2=0x7f66fc130a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.780+0000 7f67021f4700 1 -- 172.21.15.72:0/3194769910 shutdown_connections 2023-10-03T10:13:43.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.780+0000 7f67021f4700 1 -- 172.21.15.72:0/3194769910 wait complete. 2023-10-03T10:13:43.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:43.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.792+0000 7ff1648b8700 1 -- 172.21.15.72:0/455457474 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff16011b350 con 0x7ff1601305f0 2023-10-03T10:13:43.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.793+0000 7ff14effd700 1 -- 172.21.15.72:0/455457474 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff150011360 con 0x7ff1601305f0 2023-10-03T10:13:43.794 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:43.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.795+0000 7ff1648b8700 1 -- 172.21.15.72:0/455457474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1601305f0 msgr2=0x7ff16009d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.795+0000 7ff1648b8700 1 --2- 172.21.15.72:0/455457474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1601305f0 0x7ff16009d200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff15000c520 tx=0x7ff15000c830 comp rx=0 tx=0).stop 2023-10-03T10:13:43.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.795+0000 7ff1648b8700 1 -- 172.21.15.72:0/455457474 shutdown_connections 2023-10-03T10:13:43.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.795+0000 7ff1648b8700 1 --2- 172.21.15.72:0/455457474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff160135e30 0x7ff1601c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.795+0000 7ff1648b8700 1 --2- 172.21.15.72:0/455457474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1601305f0 0x7ff16009d200 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.795+0000 7ff1648b8700 1 --2- 172.21.15.72:0/455457474 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff160133510 0x7ff16009d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.795+0000 7ff1648b8700 1 -- 172.21.15.72:0/455457474 >> 172.21.15.72:0/455457474 conn(0x7ff1600a2aa0 msgr2=0x7ff1601312f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.795+0000 7ff1648b8700 1 -- 172.21.15.72:0/455457474 shutdown_connections 2023-10-03T10:13:43.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:43.795+0000 7ff1648b8700 1 -- 172.21.15.72:0/455457474 wait complete. 2023-10-03T10:13:43.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:44.672 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:44.751 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:44.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:44.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:44.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.811+0000 7fc950575700 1 Processor -- start 2023-10-03T10:13:44.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.811+0000 7fc950575700 1 -- start start 2023-10-03T10:13:44.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.811+0000 7fc950575700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc948131810 0x7fc948131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.811+0000 7fc950575700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc948099a40 0x7fc948099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.811+0000 7fc950575700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc94809a3b0 0x7fc948138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.811+0000 7fc950575700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9481313c0 con 0x7fc948131810 2023-10-03T10:13:44.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.811+0000 7fc950575700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94806e8c0 con 0x7fc948099a40 2023-10-03T10:13:44.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.811+0000 7fc950575700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc948071d20 con 0x7fc94809a3b0 2023-10-03T10:13:44.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.811+0000 7fc94e311700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc948131810 0x7fc948131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.812+0000 7fc94db10700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc948099a40 0x7fc948099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.812+0000 7fc94e311700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc948131810 0x7fc948131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46686/0 (socket says 172.21.15.72:46686) 2023-10-03T10:13:44.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.812+0000 7fc94e311700 1 -- 172.21.15.72:0/1916487143 learned_addr learned my addr 172.21.15.72:0/1916487143 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:44.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.812+0000 7fc94eb12700 1 --2- 172.21.15.72:0/1916487143 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc94809a3b0 0x7fc948138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.812+0000 7fc94db10700 1 -- 172.21.15.72:0/1916487143 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc94809a3b0 msgr2=0x7fc948138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.812+0000 7fc94db10700 1 --2- 172.21.15.72:0/1916487143 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc94809a3b0 0x7fc948138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.812+0000 7fc94db10700 1 -- 172.21.15.72:0/1916487143 >> v2:172.21.15.72:3300/0 conn(0x7fc948131810 msgr2=0x7fc948131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.812+0000 7fc94db10700 1 --2- 172.21.15.72:0/1916487143 >> v2:172.21.15.72:3300/0 conn(0x7fc948131810 0x7fc948131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.812+0000 7fc94db10700 1 -- 172.21.15.72:0/1916487143 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480721a0 con 0x7fc948099a40 2023-10-03T10:13:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.812+0000 7fc94db10700 1 --2- 172.21.15.72:0/1916487143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc948099a40 0x7fc948099e70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc938009840 tx=0x7fc938009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c138f6a200af8784 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.812+0000 7fc94d30f700 1 -- 172.21.15.72:0/1916487143 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938011830 con 0x7fc948099a40 2023-10-03T10:13:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.812+0000 7fc94d30f700 1 -- 172.21.15.72:0/1916487143 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc938011990 con 0x7fc948099a40 2023-10-03T10:13:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.812+0000 7fc94d30f700 1 -- 172.21.15.72:0/1916487143 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938011d20 con 0x7fc948099a40 2023-10-03T10:13:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.813+0000 7fc950575700 1 -- 172.21.15.72:0/1916487143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc948099a40 msgr2=0x7fc948099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.813+0000 7fc950575700 1 --2- 172.21.15.72:0/1916487143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc948099a40 0x7fc948099e70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc938009840 tx=0x7fc938009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.813+0000 7fc950575700 1 -- 172.21.15.72:0/1916487143 shutdown_connections 2023-10-03T10:13:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.813+0000 7fc950575700 1 --2- 172.21.15.72:0/1916487143 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc94809a3b0 0x7fc948138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.813+0000 7fc950575700 1 --2- 172.21.15.72:0/1916487143 >> v2:172.21.15.72:3300/0 conn(0x7fc948131810 0x7fc948131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.813+0000 7fc950575700 1 --2- 172.21.15.72:0/1916487143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc948099a40 0x7fc948099e70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.813+0000 7fc950575700 1 -- 172.21.15.72:0/1916487143 >> 172.21.15.72:0/1916487143 conn(0x7fc9480a2aa0 msgr2=0x7fc9480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.813+0000 7fc950575700 1 -- 172.21.15.72:0/1916487143 shutdown_connections 2023-10-03T10:13:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.813+0000 7fc950575700 1 -- 172.21.15.72:0/1916487143 wait complete. 2023-10-03T10:13:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.814+0000 7fc950575700 1 Processor -- start 2023-10-03T10:13:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.814+0000 7fc950575700 1 -- start start 2023-10-03T10:13:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc950575700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc948099a40 0x7fc94806f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc950575700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc94809a3b0 0x7fc94806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc950575700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc948131810 0x7fc948070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc950575700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc948070ae0 con 0x7fc94809a3b0 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc950575700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94811e260 con 0x7fc948099a40 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc950575700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc94811f270 con 0x7fc948131810 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc94e311700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc948099a40 0x7fc94806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc94e311700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc948099a40 0x7fc94806f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40006/0 (socket says 172.21.15.72:40006) 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc94e311700 1 -- 172.21.15.72:0/4254805364 learned_addr learned my addr 172.21.15.72:0/4254805364 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc94db10700 1 --2- 172.21.15.72:0/4254805364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc94809a3b0 0x7fc94806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc94eb12700 1 --2- 172.21.15.72:0/4254805364 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc948131810 0x7fc948070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc94e311700 1 -- 172.21.15.72:0/4254805364 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc948131810 msgr2=0x7fc948070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc94e311700 1 --2- 172.21.15.72:0/4254805364 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc948131810 0x7fc948070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc94e311700 1 -- 172.21.15.72:0/4254805364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc94809a3b0 msgr2=0x7fc94806fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc94e311700 1 --2- 172.21.15.72:0/4254805364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc94809a3b0 0x7fc94806fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc94e311700 1 -- 172.21.15.72:0/4254805364 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9380094a0 con 0x7fc948099a40 2023-10-03T10:13:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc94db10700 1 --2- 172.21.15.72:0/4254805364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc94809a3b0 0x7fc94806fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.815+0000 7fc94eb12700 1 --2- 172.21.15.72:0/4254805364 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc948131810 0x7fc948070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.816+0000 7fc94e311700 1 --2- 172.21.15.72:0/4254805364 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc948099a40 0x7fc94806f610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc94400e910 tx=0x7fc94400ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.816+0000 7fc93effd700 1 -- 172.21.15.72:0/4254805364 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440096a0 con 0x7fc948099a40 2023-10-03T10:13:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.816+0000 7fc93effd700 1 -- 172.21.15.72:0/4254805364 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94400ee60 con 0x7fc948099a40 2023-10-03T10:13:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.816+0000 7fc93effd700 1 -- 172.21.15.72:0/4254805364 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94400ca90 con 0x7fc948099a40 2023-10-03T10:13:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.816+0000 7fc950575700 1 -- 172.21.15.72:0/4254805364 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc948130890 con 0x7fc948099a40 2023-10-03T10:13:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.816+0000 7fc950575700 1 -- 172.21.15.72:0/4254805364 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94812cb20 con 0x7fc948099a40 2023-10-03T10:13:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.817+0000 7fc93effd700 1 -- 172.21.15.72:0/4254805364 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc94400cbf0 con 0x7fc948099a40 2023-10-03T10:13:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.817+0000 7fc950575700 1 -- 172.21.15.72:0/4254805364 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc948074ea0 con 0x7fc948099a40 2023-10-03T10:13:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.817+0000 7fc93effd700 1 -- 172.21.15.72:0/4254805364 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc94403f5f0 con 0x7fc948099a40 2023-10-03T10:13:44.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.822+0000 7fc93effd700 1 -- 172.21.15.72:0/4254805364 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc944021080 con 0x7fc948099a40 2023-10-03T10:13:44.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.886+0000 7f9dc9515700 1 Processor -- start 2023-10-03T10:13:44.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.886+0000 7f9dc9515700 1 -- start start 2023-10-03T10:13:44.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.887+0000 7f9dc9515700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9dc409d6f0 0x7f9dc409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.887+0000 7f9dc9515700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dc409e440 0x7f9dc4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.887+0000 7f9dc9515700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc409b120 con 0x7f9dc409e000 2023-10-03T10:13:44.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.887+0000 7f9dc9515700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc406b460 con 0x7f9dc409d6f0 2023-10-03T10:13:44.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.887+0000 7f9dc9515700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc409a7e0 con 0x7f9dc409e440 2023-10-03T10:13:44.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.887+0000 7f9dc37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dc409e440 0x7f9dc4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.887+0000 7f9dc37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dc409e440 0x7f9dc4134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38588/0 (socket says 172.21.15.72:38588) 2023-10-03T10:13:44.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.887+0000 7f9dc37fe700 1 -- 172.21.15.72:0/1848132532 learned_addr learned my addr 172.21.15.72:0/1848132532 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:44.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.887+0000 7f9dc2ffd700 1 --2- 172.21.15.72:0/1848132532 >> v2:172.21.15.72:3300/0 conn(0x7f9dc409d6f0 0x7f9dc409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.887+0000 7f9dc37fe700 1 -- 172.21.15.72:0/1848132532 >> v2:172.21.15.72:3300/0 conn(0x7f9dc409d6f0 msgr2=0x7f9dc409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:44.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.887+0000 7f9dc37fe700 1 --2- 172.21.15.72:0/1848132532 >> v2:172.21.15.72:3300/0 conn(0x7f9dc409d6f0 0x7f9dc409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.887+0000 7f9dc37fe700 1 -- 172.21.15.72:0/1848132532 >> v1:172.21.15.72:6789/0 conn(0x7f9dc409e000 legacy=0x7f9dc41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.887+0000 7f9dc37fe700 1 -- 172.21.15.72:0/1848132532 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc409a500 con 0x7f9dc409e440 2023-10-03T10:13:44.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.887+0000 7f9dc2ffd700 1 --2- 172.21.15.72:0/1848132532 >> v2:172.21.15.72:3300/0 conn(0x7f9dc409d6f0 0x7f9dc409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:44.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.888+0000 7f9dc37fe700 1 --2- 172.21.15.72:0/1848132532 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dc409e440 0x7f9dc4134100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009e80 tx=0x7f9dbc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=215a89e3f8bbebc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.888+0000 7f9dc1ffb700 1 -- 172.21.15.72:0/1848132532 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc00e070 con 0x7f9dc409e440 2023-10-03T10:13:44.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.888+0000 7f9dc1ffb700 1 -- 172.21.15.72:0/1848132532 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc00b8d0 con 0x7f9dc409e440 2023-10-03T10:13:44.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.888+0000 7f9dc1ffb700 1 -- 172.21.15.72:0/1848132532 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc00bc80 con 0x7f9dc409e440 2023-10-03T10:13:44.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.888+0000 7f9dc9515700 1 -- 172.21.15.72:0/1848132532 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dc409e440 msgr2=0x7f9dc4134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.888+0000 7f9dc9515700 1 --2- 172.21.15.72:0/1848132532 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dc409e440 0x7f9dc4134100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009e80 tx=0x7f9dbc00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:44.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.888+0000 7f9dc9515700 1 -- 172.21.15.72:0/1848132532 shutdown_connections 2023-10-03T10:13:44.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.889+0000 7f9dc9515700 1 --2- 172.21.15.72:0/1848132532 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dc409e440 0x7f9dc4134100 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.889+0000 7f9dc9515700 1 --2- 172.21.15.72:0/1848132532 >> v2:172.21.15.72:3300/0 conn(0x7f9dc409d6f0 0x7f9dc409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.889+0000 7f9dc9515700 1 -- 172.21.15.72:0/1848132532 >> 172.21.15.72:0/1848132532 conn(0x7f9dc4066f50 msgr2=0x7f9dc409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.889+0000 7f9dc9515700 1 -- 172.21.15.72:0/1848132532 shutdown_connections 2023-10-03T10:13:44.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.889+0000 7f9dc9515700 1 -- 172.21.15.72:0/1848132532 wait complete. 2023-10-03T10:13:44.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.890+0000 7f9dc9515700 1 Processor -- start 2023-10-03T10:13:44.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.890+0000 7f9dc9515700 1 -- start start 2023-10-03T10:13:44.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.890+0000 7f9dc9515700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dc409d6f0 0x7f9dc41abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.890+0000 7f9dc9515700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dc409e000 0x7f9dc41ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.890+0000 7f9dc9515700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dc409e440 0x7f9dc41ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.890+0000 7f9dc9515700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc41acfb0 con 0x7f9dc409e440 2023-10-03T10:13:44.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.890+0000 7f9dc9515700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc40a2000 con 0x7f9dc409d6f0 2023-10-03T10:13:44.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.890+0000 7f9dc9515700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc41ad870 con 0x7f9dc409e000 2023-10-03T10:13:44.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.890+0000 7f9dc2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dc409d6f0 0x7f9dc41abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.890+0000 7f9dc37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dc409e440 0x7f9dc41ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.890+0000 7f9dc2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dc409d6f0 0x7f9dc41abb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40012/0 (socket says 172.21.15.72:40012) 2023-10-03T10:13:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.890+0000 7f9dc37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dc409e440 0x7f9dc41ac5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46720/0 (socket says 172.21.15.72:46720) 2023-10-03T10:13:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.890+0000 7f9dc2ffd700 1 -- 172.21.15.72:0/3795356568 learned_addr learned my addr 172.21.15.72:0/3795356568 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.891+0000 7f9dc27fc700 1 --2- 172.21.15.72:0/3795356568 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dc409e000 0x7f9dc41ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.891+0000 7f9dc37fe700 1 -- 172.21.15.72:0/3795356568 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dc409e000 msgr2=0x7f9dc41ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.891+0000 7f9dc37fe700 1 --2- 172.21.15.72:0/3795356568 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dc409e000 0x7f9dc41ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.891+0000 7f9dc37fe700 1 -- 172.21.15.72:0/3795356568 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dc409d6f0 msgr2=0x7f9dc41abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.891+0000 7f9dc37fe700 1 --2- 172.21.15.72:0/3795356568 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dc409d6f0 0x7f9dc41abb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.891+0000 7f9dc37fe700 1 -- 172.21.15.72:0/3795356568 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db40094a0 con 0x7f9dc409e440 2023-10-03T10:13:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.891+0000 7f9dc37fe700 1 --2- 172.21.15.72:0/3795356568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dc409e440 0x7f9dc41ac5d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc015000 tx=0x7f9dbc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.891+0000 7f9dab7fe700 1 -- 172.21.15.72:0/3795356568 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc0048b0 con 0x7f9dc409e440 2023-10-03T10:13:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.891+0000 7f9dab7fe700 1 -- 172.21.15.72:0/3795356568 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc0092e0 con 0x7f9dc409e440 2023-10-03T10:13:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.891+0000 7f9dc9515700 1 -- 172.21.15.72:0/3795356568 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dbc009b30 con 0x7f9dc409e440 2023-10-03T10:13:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.891+0000 7f9dab7fe700 1 -- 172.21.15.72:0/3795356568 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc01c660 con 0x7f9dc409e440 2023-10-03T10:13:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.891+0000 7f9dc9515700 1 -- 172.21.15.72:0/3795356568 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc41adf20 con 0x7f9dc409e440 2023-10-03T10:13:44.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.892+0000 7f9dab7fe700 1 -- 172.21.15.72:0/3795356568 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9dbc01c7c0 con 0x7f9dc409e440 2023-10-03T10:13:44.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.892+0000 7f9dab7fe700 1 -- 172.21.15.72:0/3795356568 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9dbc041150 con 0x7f9dc409e440 2023-10-03T10:13:44.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.893+0000 7f9dc9515700 1 -- 172.21.15.72:0/3795356568 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc4074ea0 con 0x7f9dc409e440 2023-10-03T10:13:44.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.898+0000 7f9dab7fe700 1 -- 172.21.15.72:0/3795356568 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9dbc025410 con 0x7f9dc409e440 2023-10-03T10:13:44.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.928+0000 7f1e3e5d7700 1 Processor -- start 2023-10-03T10:13:44.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.928+0000 7f1e3e5d7700 1 -- start start 2023-10-03T10:13:44.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.929+0000 7f1e3e5d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e3809d6f0 0x7f1e3809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.929+0000 7f1e3e5d7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e3809e000 0x7f1e38130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.929+0000 7f1e3e5d7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3809f130 con 0x7f1e3809e410 2023-10-03T10:13:44.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.929+0000 7f1e3e5d7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3809f520 con 0x7f1e3809d6f0 2023-10-03T10:13:44.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.929+0000 7f1e3e5d7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3809e930 con 0x7f1e3809e000 2023-10-03T10:13:44.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.929+0000 7f1e377fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e3809e000 0x7f1e38130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.929+0000 7f1e377fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e3809e000 0x7f1e38130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38608/0 (socket says 172.21.15.72:38608) 2023-10-03T10:13:44.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.929+0000 7f1e377fe700 1 -- 172.21.15.72:0/733204764 learned_addr learned my addr 172.21.15.72:0/733204764 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:44.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.929+0000 7f1e37fff700 1 --2- 172.21.15.72:0/733204764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e3809d6f0 0x7f1e3809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.929+0000 7f1e377fe700 1 -- 172.21.15.72:0/733204764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e3809d6f0 msgr2=0x7f1e3809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:44.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.929+0000 7f1e377fe700 1 --2- 172.21.15.72:0/733204764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e3809d6f0 0x7f1e3809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.929+0000 7f1e377fe700 1 -- 172.21.15.72:0/733204764 >> v1:172.21.15.72:6789/0 conn(0x7f1e3809e410 legacy=0x7f1e38130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.929+0000 7f1e377fe700 1 -- 172.21.15.72:0/733204764 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3809b2d0 con 0x7f1e3809e000 2023-10-03T10:13:44.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.929+0000 7f1e377fe700 1 --2- 172.21.15.72:0/733204764 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e3809e000 0x7f1e38130660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009950 tx=0x7f1e2c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=548f2e01b5efafea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.930+0000 7f1e36ffd700 1 -- 172.21.15.72:0/733204764 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c011830 con 0x7f1e3809e000 2023-10-03T10:13:44.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.930+0000 7f1e36ffd700 1 -- 172.21.15.72:0/733204764 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c011990 con 0x7f1e3809e000 2023-10-03T10:13:44.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.930+0000 7f1e36ffd700 1 -- 172.21.15.72:0/733204764 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c011d40 con 0x7f1e3809e000 2023-10-03T10:13:44.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.930+0000 7f1e3e5d7700 1 -- 172.21.15.72:0/733204764 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e3809e000 msgr2=0x7f1e38130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.930+0000 7f1e3e5d7700 1 --2- 172.21.15.72:0/733204764 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e3809e000 0x7f1e38130660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009950 tx=0x7f1e2c009c60 comp rx=0 tx=0).stop 2023-10-03T10:13:44.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.930+0000 7f1e3e5d7700 1 -- 172.21.15.72:0/733204764 shutdown_connections 2023-10-03T10:13:44.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.930+0000 7f1e3e5d7700 1 --2- 172.21.15.72:0/733204764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e3809d6f0 0x7f1e3809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.930+0000 7f1e3e5d7700 1 --2- 172.21.15.72:0/733204764 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e3809e000 0x7f1e38130660 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.930+0000 7f1e3e5d7700 1 -- 172.21.15.72:0/733204764 >> 172.21.15.72:0/733204764 conn(0x7f1e38066f50 msgr2=0x7f1e3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.930+0000 7f1e3e5d7700 1 -- 172.21.15.72:0/733204764 shutdown_connections 2023-10-03T10:13:44.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.930+0000 7f1e3e5d7700 1 -- 172.21.15.72:0/733204764 wait complete. 2023-10-03T10:13:44.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.931+0000 7f1e3e5d7700 1 Processor -- start 2023-10-03T10:13:44.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e3e5d7700 1 -- start start 2023-10-03T10:13:44.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e3e5d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e3809d6f0 0x7f1e3806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e3e5d7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e3809e000 0x7f1e3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e3e5d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e3809e410 0x7f1e3806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e3e5d7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3812ff40 con 0x7f1e3809d6f0 2023-10-03T10:13:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e3e5d7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e38070480 con 0x7f1e3809e410 2023-10-03T10:13:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e3e5d7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3806fcb0 con 0x7f1e3809e000 2023-10-03T10:13:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e377fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e3809e000 0x7f1e3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e377fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e3809e000 0x7f1e3806edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38612/0 (socket says 172.21.15.72:38612) 2023-10-03T10:13:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e377fe700 1 -- 172.21.15.72:0/3442574069 learned_addr learned my addr 172.21.15.72:0/3442574069 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e3cb74700 1 --2- 172.21.15.72:0/3442574069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e3809e410 0x7f1e3806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e37fff700 1 --2- 172.21.15.72:0/3442574069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e3809d6f0 0x7f1e3806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e377fe700 1 -- 172.21.15.72:0/3442574069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e3809e410 msgr2=0x7f1e3806f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e377fe700 1 --2- 172.21.15.72:0/3442574069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e3809e410 0x7f1e3806f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e377fe700 1 -- 172.21.15.72:0/3442574069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e3809d6f0 msgr2=0x7f1e3806e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e377fe700 1 --2- 172.21.15.72:0/3442574069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e3809d6f0 0x7f1e3806e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.932+0000 7f1e377fe700 1 -- 172.21.15.72:0/3442574069 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c009550 con 0x7f1e3809e000 2023-10-03T10:13:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.933+0000 7f1e377fe700 1 --2- 172.21.15.72:0/3442574069 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e3809e000 0x7f1e3806edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c013000 tx=0x7f1e2c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.933+0000 7f1e34ff9700 1 -- 172.21.15.72:0/3442574069 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c004240 con 0x7f1e3809e000 2023-10-03T10:13:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.933+0000 7f1e34ff9700 1 -- 172.21.15.72:0/3442574069 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c01f070 con 0x7f1e3809e000 2023-10-03T10:13:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.933+0000 7f1e3e5d7700 1 -- 172.21.15.72:0/3442574069 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e381302c0 con 0x7f1e3809e000 2023-10-03T10:13:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.933+0000 7f1e34ff9700 1 -- 172.21.15.72:0/3442574069 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0045c0 con 0x7f1e3809e000 2023-10-03T10:13:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.933+0000 7f1e3e5d7700 1 -- 172.21.15.72:0/3442574069 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e38125be0 con 0x7f1e3809e000 2023-10-03T10:13:44.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.934+0000 7f1e34ff9700 1 -- 172.21.15.72:0/3442574069 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e2c021030 con 0x7f1e3809e000 2023-10-03T10:13:44.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.934+0000 7f1e34ff9700 1 -- 172.21.15.72:0/3442574069 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1e2c0408f0 con 0x7f1e3809e000 2023-10-03T10:13:44.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.934+0000 7f1e1e7fc700 1 -- 172.21.15.72:0/3442574069 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e100052e0 con 0x7f1e3809e000 2023-10-03T10:13:44.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.943+0000 7f1e34ff9700 1 -- 172.21.15.72:0/3442574069 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e2c015020 con 0x7f1e3809e000 2023-10-03T10:13:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.947+0000 7f16df6d7700 1 Processor -- start 2023-10-03T10:13:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.948+0000 7f16df6d7700 1 -- start start 2023-10-03T10:13:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.948+0000 7f16df6d7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16d806f5d0 0x7f16d812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.948+0000 7f16df6d7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f16d8135c20 0x7f16d8138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.948+0000 7f16df6d7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d806fa40 con 0x7f16d812cf60 2023-10-03T10:13:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.948+0000 7f16df6d7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d812cd90 con 0x7f16d8135c20 2023-10-03T10:13:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.948+0000 7f16df6d7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16d8071780 con 0x7f16d806f5d0 2023-10-03T10:13:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.949+0000 7f16dd473700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f16d812cf60 0x7f16d812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50664/0 (socket says 172.21.15.72:50664) 2023-10-03T10:13:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.949+0000 7f16dd473700 1 -- 172.21.15.72:0/569274008 learned_addr learned my addr 172.21.15.72:0/569274008 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.949+0000 7f16dcc72700 1 --2- 172.21.15.72:0/569274008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16d806f5d0 0x7f16d812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.949+0000 7f16ddc74700 1 --2- 172.21.15.72:0/569274008 >> v2:172.21.15.72:3300/0 conn(0x7f16d8135c20 0x7f16d8138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.949+0000 7f16cffff700 1 -- 172.21.15.72:0/569274008 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490581205 0 0) 0x7f16d806fa40 con 0x7f16d812cf60 2023-10-03T10:13:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.949+0000 7f16cffff700 1 -- 172.21.15.72:0/569274008 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16c40035b0 con 0x7f16d812cf60 2023-10-03T10:13:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.949+0000 7f16dcc72700 1 -- 172.21.15.72:0/569274008 >> v2:172.21.15.72:3300/0 conn(0x7f16d8135c20 msgr2=0x7f16d8138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.949+0000 7f16dcc72700 1 --2- 172.21.15.72:0/569274008 >> v2:172.21.15.72:3300/0 conn(0x7f16d8135c20 0x7f16d8138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.949+0000 7f16dcc72700 1 -- 172.21.15.72:0/569274008 >> v1:172.21.15.72:6789/0 conn(0x7f16d812cf60 legacy=0x7f16d812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.949+0000 7f16dcc72700 1 -- 172.21.15.72:0/569274008 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d8071a40 con 0x7f16d806f5d0 2023-10-03T10:13:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.949+0000 7f16dcc72700 1 --2- 172.21.15.72:0/569274008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16d806f5d0 0x7f16d812ffc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f16c8009840 tx=0x7f16c8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee14ce7bf7b0ea31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.949+0000 7f16cffff700 1 -- 172.21.15.72:0/569274008 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8011830 con 0x7f16d806f5d0 2023-10-03T10:13:44.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.950+0000 7f16cffff700 1 -- 172.21.15.72:0/569274008 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c8011990 con 0x7f16d806f5d0 2023-10-03T10:13:44.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.950+0000 7f16cffff700 1 -- 172.21.15.72:0/569274008 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8011d20 con 0x7f16d806f5d0 2023-10-03T10:13:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.950+0000 7f16df6d7700 1 -- 172.21.15.72:0/569274008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16d806f5d0 msgr2=0x7f16d812ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.950+0000 7f16df6d7700 1 --2- 172.21.15.72:0/569274008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16d806f5d0 0x7f16d812ffc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f16c8009840 tx=0x7f16c8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.950+0000 7f16df6d7700 1 -- 172.21.15.72:0/569274008 shutdown_connections 2023-10-03T10:13:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.950+0000 7f16df6d7700 1 --2- 172.21.15.72:0/569274008 >> v2:172.21.15.72:3300/0 conn(0x7f16d8135c20 0x7f16d8138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.950+0000 7f16df6d7700 1 --2- 172.21.15.72:0/569274008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16d806f5d0 0x7f16d812ffc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.950+0000 7f16df6d7700 1 -- 172.21.15.72:0/569274008 >> 172.21.15.72:0/569274008 conn(0x7f16d80a2aa0 msgr2=0x7f16d80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.951+0000 7f16df6d7700 1 -- 172.21.15.72:0/569274008 shutdown_connections 2023-10-03T10:13:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.951+0000 7f16df6d7700 1 -- 172.21.15.72:0/569274008 wait complete. 2023-10-03T10:13:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.952+0000 7f16df6d7700 1 Processor -- start 2023-10-03T10:13:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.952+0000 7f16df6d7700 1 -- start start 2023-10-03T10:13:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.953+0000 7f16df6d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16d806f5d0 0x7f16d813a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.953+0000 7f16df6d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16d812cf60 0x7f16d813aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.953+0000 7f16df6d7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16d8135c20 0x7f16d813b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.953+0000 7f16df6d7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d813c390 con 0x7f16d812cf60 2023-10-03T10:13:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.953+0000 7f16df6d7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d813c640 con 0x7f16d806f5d0 2023-10-03T10:13:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.953+0000 7f16df6d7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16d809a300 con 0x7f16d8135c20 2023-10-03T10:13:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.953+0000 7f16ddc74700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16d8135c20 0x7f16d813b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.953+0000 7f16ddc74700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16d8135c20 0x7f16d813b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38620/0 (socket says 172.21.15.72:38620) 2023-10-03T10:13:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.953+0000 7f16ddc74700 1 -- 172.21.15.72:0/3647427945 learned_addr learned my addr 172.21.15.72:0/3647427945 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.953+0000 7f16ddc74700 1 -- 172.21.15.72:0/3647427945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16d806f5d0 msgr2=0x7f16d813a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.953+0000 7f16ddc74700 1 --2- 172.21.15.72:0/3647427945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16d806f5d0 0x7f16d813a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.953+0000 7f16ddc74700 1 -- 172.21.15.72:0/3647427945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16d812cf60 msgr2=0x7f16d813aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.953+0000 7f16ddc74700 1 --2- 172.21.15.72:0/3647427945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16d812cf60 0x7f16d813aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.953+0000 7f16ddc74700 1 -- 172.21.15.72:0/3647427945 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c80094a0 con 0x7f16d8135c20 2023-10-03T10:13:44.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.953+0000 7f16ddc74700 1 --2- 172.21.15.72:0/3647427945 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16d8135c20 0x7f16d813b0e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f16d000ef90 tx=0x7f16d000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:44.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.954+0000 7f16cdffb700 1 -- 172.21.15.72:0/3647427945 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0009ca0 con 0x7f16d8135c20 2023-10-03T10:13:44.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.954+0000 7f16cdffb700 1 -- 172.21.15.72:0/3647427945 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d000f040 con 0x7f16d8135c20 2023-10-03T10:13:44.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.954+0000 7f16cdffb700 1 -- 172.21.15.72:0/3647427945 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0014480 con 0x7f16d8135c20 2023-10-03T10:13:44.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.954+0000 7f16df6d7700 1 -- 172.21.15.72:0/3647427945 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d813b9d0 con 0x7f16d8135c20 2023-10-03T10:13:44.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.954+0000 7f16df6d7700 1 -- 172.21.15.72:0/3647427945 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d809a5e0 con 0x7f16d8135c20 2023-10-03T10:13:44.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.955+0000 7f16df6d7700 1 -- 172.21.15.72:0/3647427945 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d8074ea0 con 0x7f16d8135c20 2023-10-03T10:13:44.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.955+0000 7f16cdffb700 1 -- 172.21.15.72:0/3647427945 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16d00145e0 con 0x7f16d8135c20 2023-10-03T10:13:44.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.955+0000 7f16cdffb700 1 -- 172.21.15.72:0/3647427945 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f16d00403c0 con 0x7f16d8135c20 2023-10-03T10:13:44.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:44.964+0000 7f16cdffb700 1 -- 172.21.15.72:0/3647427945 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16d0007920 con 0x7f16d8135c20 2023-10-03T10:13:45.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.030+0000 7fc950575700 1 -- 172.21.15.72:0/4254805364 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc948066680 con 0x7fc948099a40 2023-10-03T10:13:45.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.030+0000 7fc93effd700 1 -- 172.21.15.72:0/4254805364 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc944017020 con 0x7fc948099a40 2023-10-03T10:13:45.031 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:45.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.034+0000 7fc950575700 1 -- 172.21.15.72:0/4254805364 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc948099a40 msgr2=0x7fc94806f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.034+0000 7fc950575700 1 --2- 172.21.15.72:0/4254805364 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc948099a40 0x7fc94806f610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc94400e910 tx=0x7fc94400ec20 comp rx=0 tx=0).stop 2023-10-03T10:13:45.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.034+0000 7fc950575700 1 -- 172.21.15.72:0/4254805364 shutdown_connections 2023-10-03T10:13:45.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.034+0000 7fc950575700 1 --2- 172.21.15.72:0/4254805364 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc948131810 0x7fc948070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.034+0000 7fc950575700 1 --2- 172.21.15.72:0/4254805364 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc948099a40 0x7fc94806f610 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.034+0000 7fc950575700 1 --2- 172.21.15.72:0/4254805364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc94809a3b0 0x7fc94806fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.034+0000 7fc950575700 1 -- 172.21.15.72:0/4254805364 >> 172.21.15.72:0/4254805364 conn(0x7fc9480a2aa0 msgr2=0x7fc94812e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.034+0000 7fc950575700 1 -- 172.21.15.72:0/4254805364 shutdown_connections 2023-10-03T10:13:45.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.034+0000 7fc950575700 1 -- 172.21.15.72:0/4254805364 wait complete. 2023-10-03T10:13:45.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:45.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.112+0000 7f9dc9515700 1 -- 172.21.15.72:0/3795356568 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9dc409f420 con 0x7f9dc409e440 2023-10-03T10:13:45.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.112+0000 7f9dab7fe700 1 -- 172.21.15.72:0/3795356568 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9dbc033090 con 0x7f9dc409e440 2023-10-03T10:13:45.113 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:45.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.114+0000 7f9dc9515700 1 -- 172.21.15.72:0/3795356568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dc409e440 msgr2=0x7f9dc41ac5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.114+0000 7f9dc9515700 1 --2- 172.21.15.72:0/3795356568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dc409e440 0x7f9dc41ac5d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc015000 tx=0x7f9dbc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.114+0000 7f9dc9515700 1 -- 172.21.15.72:0/3795356568 shutdown_connections 2023-10-03T10:13:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.114+0000 7f9dc9515700 1 --2- 172.21.15.72:0/3795356568 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dc409e440 0x7f9dc41ac5d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.114+0000 7f9dc9515700 1 --2- 172.21.15.72:0/3795356568 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dc409d6f0 0x7f9dc41abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.114+0000 7f9dc9515700 1 --2- 172.21.15.72:0/3795356568 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dc409e000 0x7f9dc41ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.114+0000 7f9dc9515700 1 -- 172.21.15.72:0/3795356568 >> 172.21.15.72:0/3795356568 conn(0x7f9dc4066f50 msgr2=0x7f9dc40711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.114+0000 7f9dc9515700 1 -- 172.21.15.72:0/3795356568 shutdown_connections 2023-10-03T10:13:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.114+0000 7f9dc9515700 1 -- 172.21.15.72:0/3795356568 wait complete. 2023-10-03T10:13:45.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:45.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.142+0000 7f1e1e7fc700 1 -- 172.21.15.72:0/3442574069 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1e10005590 con 0x7f1e3809e000 2023-10-03T10:13:45.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.142+0000 7f1e34ff9700 1 -- 172.21.15.72:0/3442574069 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e2c01a450 con 0x7f1e3809e000 2023-10-03T10:13:45.143 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:45.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.144+0000 7f1e1e7fc700 1 -- 172.21.15.72:0/3442574069 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e3809e000 msgr2=0x7f1e3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.144+0000 7f1e1e7fc700 1 --2- 172.21.15.72:0/3442574069 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e3809e000 0x7f1e3806edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c013000 tx=0x7f1e2c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:45.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.144+0000 7f1e1e7fc700 1 -- 172.21.15.72:0/3442574069 shutdown_connections 2023-10-03T10:13:45.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.144+0000 7f1e1e7fc700 1 --2- 172.21.15.72:0/3442574069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e3809d6f0 0x7f1e3806e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.144+0000 7f1e1e7fc700 1 --2- 172.21.15.72:0/3442574069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e3809e410 0x7f1e3806f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.144+0000 7f1e1e7fc700 1 --2- 172.21.15.72:0/3442574069 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e3809e000 0x7f1e3806edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.144+0000 7f1e1e7fc700 1 -- 172.21.15.72:0/3442574069 >> 172.21.15.72:0/3442574069 conn(0x7f1e38066f50 msgr2=0x7f1e3806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.144+0000 7f1e1e7fc700 1 -- 172.21.15.72:0/3442574069 shutdown_connections 2023-10-03T10:13:45.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.144+0000 7f1e1e7fc700 1 -- 172.21.15.72:0/3442574069 wait complete. 2023-10-03T10:13:45.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:45.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.163+0000 7f16df6d7700 1 -- 172.21.15.72:0/3647427945 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f16d80713a0 con 0x7f16d8135c20 2023-10-03T10:13:45.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.164+0000 7f16cdffb700 1 -- 172.21.15.72:0/3647427945 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f16d0007330 con 0x7f16d8135c20 2023-10-03T10:13:45.164 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:45.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.166+0000 7f16df6d7700 1 -- 172.21.15.72:0/3647427945 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16d8135c20 msgr2=0x7f16d813b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:45.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.166+0000 7f16df6d7700 1 --2- 172.21.15.72:0/3647427945 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16d8135c20 0x7f16d813b0e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f16d000ef90 tx=0x7f16d000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.166+0000 7f16df6d7700 1 -- 172.21.15.72:0/3647427945 shutdown_connections 2023-10-03T10:13:45.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.166+0000 7f16df6d7700 1 --2- 172.21.15.72:0/3647427945 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f16d8135c20 0x7f16d813b0e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.166+0000 7f16df6d7700 1 --2- 172.21.15.72:0/3647427945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16d806f5d0 0x7f16d813a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.166+0000 7f16df6d7700 1 --2- 172.21.15.72:0/3647427945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16d812cf60 0x7f16d813aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:45.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.166+0000 7f16df6d7700 1 -- 172.21.15.72:0/3647427945 >> 172.21.15.72:0/3647427945 conn(0x7f16d80a2aa0 msgr2=0x7f16d812f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:45.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.166+0000 7f16df6d7700 1 -- 172.21.15.72:0/3647427945 shutdown_connections 2023-10-03T10:13:45.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:45.166+0000 7f16df6d7700 1 -- 172.21.15.72:0/3647427945 wait complete. 2023-10-03T10:13:45.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:46.052 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:46.128 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:46.158 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:46.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:46.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.180+0000 7f72efe09700 1 Processor -- start 2023-10-03T10:13:46.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.180+0000 7f72efe09700 1 -- start start 2023-10-03T10:13:46.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.181+0000 7f72efe09700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72e81338a0 0x7f72e8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.181+0000 7f72efe09700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f72e809de50 0x7f72e809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.181+0000 7f72efe09700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f72e809e760 0x7f72e813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.181+0000 7f72efe09700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e806fef0 con 0x7f72e809e760 2023-10-03T10:13:46.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.181+0000 7f72efe09700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e806ef30 con 0x7f72e81338a0 2023-10-03T10:13:46.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.181+0000 7f72efe09700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72e81334b0 con 0x7f72e809de50 2023-10-03T10:13:46.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.181+0000 7f72ed3a4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f72e809de50 0x7f72e809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.181+0000 7f72ed3a4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f72e809de50 0x7f72e809e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38628/0 (socket says 172.21.15.72:38628) 2023-10-03T10:13:46.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.181+0000 7f72ed3a4700 1 -- 172.21.15.72:0/3647674049 learned_addr learned my addr 172.21.15.72:0/3647674049 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:46.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.181+0000 7f72ee3a6700 1 --2- 172.21.15.72:0/3647674049 >> v2:172.21.15.72:3300/0 conn(0x7f72e809e760 0x7f72e813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.181+0000 7f72ed3a4700 1 -- 172.21.15.72:0/3647674049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72e81338a0 msgr2=0x7f72e8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.181+0000 7f72ed3a4700 1 --2- 172.21.15.72:0/3647674049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72e81338a0 0x7f72e8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.181+0000 7f72ed3a4700 1 -- 172.21.15.72:0/3647674049 >> v2:172.21.15.72:3300/0 conn(0x7f72e809e760 msgr2=0x7f72e813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.181+0000 7f72ed3a4700 1 --2- 172.21.15.72:0/3647674049 >> v2:172.21.15.72:3300/0 conn(0x7f72e809e760 0x7f72e813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.181+0000 7f72ed3a4700 1 -- 172.21.15.72:0/3647674049 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e806fc30 con 0x7f72e809de50 2023-10-03T10:13:46.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.182+0000 7f72ed3a4700 1 --2- 172.21.15.72:0/3647674049 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f72e809de50 0x7f72e809e220 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009920 tx=0x7f72d8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcbea0e5db73a767 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.182+0000 7f72ecba3700 1 -- 172.21.15.72:0/3647674049 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8011830 con 0x7f72e809de50 2023-10-03T10:13:46.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.182+0000 7f72ecba3700 1 -- 172.21.15.72:0/3647674049 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d8011990 con 0x7f72e809de50 2023-10-03T10:13:46.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.182+0000 7f72ecba3700 1 -- 172.21.15.72:0/3647674049 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8011d20 con 0x7f72e809de50 2023-10-03T10:13:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.183+0000 7f72efe09700 1 -- 172.21.15.72:0/3647674049 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f72e809de50 msgr2=0x7f72e809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.183+0000 7f72efe09700 1 --2- 172.21.15.72:0/3647674049 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f72e809de50 0x7f72e809e220 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009920 tx=0x7f72d8009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.183+0000 7f72efe09700 1 -- 172.21.15.72:0/3647674049 shutdown_connections 2023-10-03T10:13:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.183+0000 7f72efe09700 1 --2- 172.21.15.72:0/3647674049 >> v2:172.21.15.72:3300/0 conn(0x7f72e809e760 0x7f72e813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.183+0000 7f72efe09700 1 --2- 172.21.15.72:0/3647674049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72e81338a0 0x7f72e8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.183+0000 7f72efe09700 1 --2- 172.21.15.72:0/3647674049 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f72e809de50 0x7f72e809e220 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.183+0000 7f72efe09700 1 -- 172.21.15.72:0/3647674049 >> 172.21.15.72:0/3647674049 conn(0x7f72e80a2aa0 msgr2=0x7f72e80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.183+0000 7f72efe09700 1 -- 172.21.15.72:0/3647674049 shutdown_connections 2023-10-03T10:13:46.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.183+0000 7f72efe09700 1 -- 172.21.15.72:0/3647674049 wait complete. 2023-10-03T10:13:46.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.184+0000 7f72efe09700 1 Processor -- start 2023-10-03T10:13:46.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.184+0000 7f72efe09700 1 -- start start 2023-10-03T10:13:46.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.185+0000 7f72efe09700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72e809de50 0x7f72e811ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.185+0000 7f72efe09700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72e809e760 0x7f72e811f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.185+0000 7f72efe09700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f72e81338a0 0x7f72e811f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.185+0000 7f72efe09700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8120930 con 0x7f72e809de50 2023-10-03T10:13:46.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.185+0000 7f72efe09700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e80a10a0 con 0x7f72e809e760 2023-10-03T10:13:46.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.185+0000 7f72efe09700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8121190 con 0x7f72e81338a0 2023-10-03T10:13:46.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.185+0000 7f72ed3a4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72e809e760 0x7f72e811f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.185+0000 7f72ed3a4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72e809e760 0x7f72e811f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40062/0 (socket says 172.21.15.72:40062) 2023-10-03T10:13:46.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.185+0000 7f72ed3a4700 1 -- 172.21.15.72:0/1697135830 learned_addr learned my addr 172.21.15.72:0/1697135830 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:46.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.185+0000 7f72ee3a6700 1 --2- 172.21.15.72:0/1697135830 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f72e81338a0 0x7f72e811f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.185+0000 7f72edba5700 1 --2- 172.21.15.72:0/1697135830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72e809de50 0x7f72e811ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.186+0000 7f72ee3a6700 1 -- 172.21.15.72:0/1697135830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72e809e760 msgr2=0x7f72e811f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.186+0000 7f72ee3a6700 1 --2- 172.21.15.72:0/1697135830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72e809e760 0x7f72e811f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.186+0000 7f72ee3a6700 1 -- 172.21.15.72:0/1697135830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72e809de50 msgr2=0x7f72e811ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.186+0000 7f72ee3a6700 1 --2- 172.21.15.72:0/1697135830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72e809de50 0x7f72e811ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.186+0000 7f72ee3a6700 1 -- 172.21.15.72:0/1697135830 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d8009550 con 0x7f72e81338a0 2023-10-03T10:13:46.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.186+0000 7f72edba5700 1 --2- 172.21.15.72:0/1697135830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72e809de50 0x7f72e811ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.186+0000 7f72ee3a6700 1 --2- 172.21.15.72:0/1697135830 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f72e81338a0 0x7f72e811f7a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f72e000efc0 tx=0x7f72e000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.186+0000 7f72de7fc700 1 -- 172.21.15.72:0/1697135830 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e000cc90 con 0x7f72e81338a0 2023-10-03T10:13:46.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.186+0000 7f72de7fc700 1 -- 172.21.15.72:0/1697135830 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e000f040 con 0x7f72e81338a0 2023-10-03T10:13:46.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.186+0000 7f72de7fc700 1 -- 172.21.15.72:0/1697135830 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e0009e60 con 0x7f72e81338a0 2023-10-03T10:13:46.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.186+0000 7f72efe09700 1 -- 172.21.15.72:0/1697135830 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e8122840 con 0x7f72e81338a0 2023-10-03T10:13:46.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.186+0000 7f72efe09700 1 -- 172.21.15.72:0/1697135830 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e812f840 con 0x7f72e81338a0 2023-10-03T10:13:46.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.187+0000 7f72de7fc700 1 -- 172.21.15.72:0/1697135830 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72e0014480 con 0x7f72e81338a0 2023-10-03T10:13:46.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.188+0000 7f72efe09700 1 -- 172.21.15.72:0/1697135830 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e8074ea0 con 0x7f72e81338a0 2023-10-03T10:13:46.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.188+0000 7f72de7fc700 1 -- 172.21.15.72:0/1697135830 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f72e00401f0 con 0x7f72e81338a0 2023-10-03T10:13:46.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.196+0000 7f72de7fc700 1 -- 172.21.15.72:0/1697135830 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72e00076f0 con 0x7f72e81338a0 2023-10-03T10:13:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.276+0000 7fecf212d700 1 Processor -- start 2023-10-03T10:13:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.276+0000 7fecf212d700 1 -- start start 2023-10-03T10:13:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.277+0000 7fecf212d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fecec09eca0 0x7fecec13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.277+0000 7fecf212d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecec06f050 0x7fecec13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.277+0000 7fecf212d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecec070ee0 con 0x7fecec06e570 2023-10-03T10:13:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.277+0000 7fecf212d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec071980 con 0x7fecec06f050 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.277+0000 7fecf212d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecec071480 con 0x7fecec09eca0 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.277+0000 7feceaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fecec09eca0 0x7fecec13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.277+0000 7feceaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fecec09eca0 0x7fecec13cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38638/0 (socket says 172.21.15.72:38638) 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.277+0000 7feceaffd700 1 -- 172.21.15.72:0/3946775395 learned_addr learned my addr 172.21.15.72:0/3946775395 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.277+0000 7fecebfff700 1 --2- 172.21.15.72:0/3946775395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecec06f050 0x7fecec13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.277+0000 7fecea7fc700 1 -- 172.21.15.72:0/3946775395 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291115905 0 0) 0x7fecec070ee0 con 0x7fecec06e570 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.277+0000 7fecea7fc700 1 -- 172.21.15.72:0/3946775395 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecd40035b0 con 0x7fecec06e570 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.278+0000 7feceaffd700 1 -- 172.21.15.72:0/3946775395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecec06f050 msgr2=0x7fecec13f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.278+0000 7feceaffd700 1 --2- 172.21.15.72:0/3946775395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecec06f050 0x7fecec13f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.278+0000 7feceaffd700 1 -- 172.21.15.72:0/3946775395 >> v1:172.21.15.72:6789/0 conn(0x7fecec06e570 legacy=0x7fecec06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.278+0000 7feceaffd700 1 -- 172.21.15.72:0/3946775395 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec071b90 con 0x7fecec09eca0 2023-10-03T10:13:46.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.278+0000 7fecebfff700 1 --2- 172.21.15.72:0/3946775395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecec06f050 0x7fecec13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.278+0000 7feceaffd700 1 --2- 172.21.15.72:0/3946775395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fecec09eca0 0x7fecec13cea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fece0009920 tx=0x7fece0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f986e554a85c9ba9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.278+0000 7fecea7fc700 1 -- 172.21.15.72:0/3946775395 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0011830 con 0x7fecec09eca0 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.278+0000 7fecea7fc700 1 -- 172.21.15.72:0/3946775395 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece0011990 con 0x7fecec09eca0 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.278+0000 7fecea7fc700 1 -- 172.21.15.72:0/3946775395 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0011d20 con 0x7fecec09eca0 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.279+0000 7fecf212d700 1 -- 172.21.15.72:0/3946775395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fecec09eca0 msgr2=0x7fecec13cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.279+0000 7fecf212d700 1 --2- 172.21.15.72:0/3946775395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fecec09eca0 0x7fecec13cea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fece0009920 tx=0x7fece0009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.279+0000 7fecf212d700 1 -- 172.21.15.72:0/3946775395 shutdown_connections 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.279+0000 7fecf212d700 1 --2- 172.21.15.72:0/3946775395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecec06f050 0x7fecec13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.279+0000 7fecf212d700 1 --2- 172.21.15.72:0/3946775395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fecec09eca0 0x7fecec13cea0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.279+0000 7fecf212d700 1 -- 172.21.15.72:0/3946775395 >> 172.21.15.72:0/3946775395 conn(0x7fecec0a2aa0 msgr2=0x7fecec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.279+0000 7fecf212d700 1 -- 172.21.15.72:0/3946775395 shutdown_connections 2023-10-03T10:13:46.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.279+0000 7fecf212d700 1 -- 172.21.15.72:0/3946775395 wait complete. 2023-10-03T10:13:46.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.280+0000 7fecf212d700 1 Processor -- start 2023-10-03T10:13:46.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.280+0000 7fecf212d700 1 -- start start 2023-10-03T10:13:46.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.281+0000 7fecf212d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecec06e570 0x7fecec1214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.281+0000 7fecf212d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecec06f050 0x7fecec121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.281+0000 7fecf212d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fecec121f60 0x7fecec1d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.281+0000 7fecf212d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec09a0f0 con 0x7fecec06f050 2023-10-03T10:13:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.281+0000 7fecf212d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec123e50 con 0x7fecec06e570 2023-10-03T10:13:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.281+0000 7fecf212d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecec122760 con 0x7fecec121f60 2023-10-03T10:13:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.281+0000 7feceb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecec06e570 0x7fecec1214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.281+0000 7feceaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecec06f050 0x7fecec121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.281+0000 7feceb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecec06e570 0x7fecec1214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40084/0 (socket says 172.21.15.72:40084) 2023-10-03T10:13:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.281+0000 7feceb7fe700 1 -- 172.21.15.72:0/1909036509 learned_addr learned my addr 172.21.15.72:0/1909036509 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.281+0000 7fecebfff700 1 --2- 172.21.15.72:0/1909036509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fecec121f60 0x7fecec1d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.282+0000 7feceb7fe700 1 -- 172.21.15.72:0/1909036509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fecec121f60 msgr2=0x7fecec1d2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.282+0000 7feceb7fe700 1 --2- 172.21.15.72:0/1909036509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fecec121f60 0x7fecec1d2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.282+0000 7feceb7fe700 1 -- 172.21.15.72:0/1909036509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecec06f050 msgr2=0x7fecec121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.282+0000 7feceb7fe700 1 --2- 172.21.15.72:0/1909036509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecec06f050 0x7fecec121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.282+0000 7feceb7fe700 1 -- 172.21.15.72:0/1909036509 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece4009a70 con 0x7fecec06e570 2023-10-03T10:13:46.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.282+0000 7fecebfff700 1 --2- 172.21.15.72:0/1909036509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fecec121f60 0x7fecec1d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:46.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.282+0000 7feceaffd700 1 --2- 172.21.15.72:0/1909036509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecec06f050 0x7fecec121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:46.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.282+0000 7feceb7fe700 1 --2- 172.21.15.72:0/1909036509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecec06e570 0x7fecec1214e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00c520 tx=0x7fecdc00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.282+0000 7fecd3fff700 1 -- 172.21.15.72:0/1909036509 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc0052d0 con 0x7fecec06e570 2023-10-03T10:13:46.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.282+0000 7fecd3fff700 1 -- 172.21.15.72:0/1909036509 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc005430 con 0x7fecec06e570 2023-10-03T10:13:46.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.282+0000 7fecf212d700 1 -- 172.21.15.72:0/1909036509 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece0009550 con 0x7fecec06e570 2023-10-03T10:13:46.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.282+0000 7fecd3fff700 1 -- 172.21.15.72:0/1909036509 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc0038a0 con 0x7fecec06e570 2023-10-03T10:13:46.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.282+0000 7fecf212d700 1 -- 172.21.15.72:0/1909036509 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecec070670 con 0x7fecec06e570 2023-10-03T10:13:46.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.283+0000 7fecd3fff700 1 -- 172.21.15.72:0/1909036509 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fecdc003a00 con 0x7fecec06e570 2023-10-03T10:13:46.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.283+0000 7fecd3fff700 1 -- 172.21.15.72:0/1909036509 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fecdc03ebb0 con 0x7fecec06e570 2023-10-03T10:13:46.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.283+0000 7fecf212d700 1 -- 172.21.15.72:0/1909036509 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc0052e0 con 0x7fecec06e570 2023-10-03T10:13:46.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.292+0000 7fecd3fff700 1 -- 172.21.15.72:0/1909036509 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecdc019e60 con 0x7fecec06e570 2023-10-03T10:13:46.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.305+0000 7f4f9e4e4700 1 Processor -- start 2023-10-03T10:13:46.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.305+0000 7f4f9e4e4700 1 -- start start 2023-10-03T10:13:46.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.305+0000 7f4f9e4e4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f9809d6f0 0x7f4f9809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.305+0000 7f4f9e4e4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f9809e000 0x7f4f98130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.305+0000 7f4f9e4e4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f9809e410 0x7f4f98130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.305+0000 7f4f9e4e4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9809f520 con 0x7f4f9809e000 2023-10-03T10:13:46.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.305+0000 7f4f9e4e4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9809f130 con 0x7f4f9809d6f0 2023-10-03T10:13:46.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.305+0000 7f4f9e4e4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9809e930 con 0x7f4f9809e410 2023-10-03T10:13:46.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.305+0000 7f4f97fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f9809d6f0 0x7f4f9809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.305+0000 7f4f97fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f9809d6f0 0x7f4f9809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40094/0 (socket says 172.21.15.72:40094) 2023-10-03T10:13:46.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.305+0000 7f4f97fff700 1 -- 172.21.15.72:0/206052304 learned_addr learned my addr 172.21.15.72:0/206052304 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:46.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.305+0000 7f4f9ca81700 1 --2- 172.21.15.72:0/206052304 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f9809e410 0x7f4f98130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.305+0000 7f4f977fe700 1 --2- 172.21.15.72:0/206052304 >> v2:172.21.15.72:3300/0 conn(0x7f4f9809e000 0x7f4f98130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.306+0000 7f4f97fff700 1 -- 172.21.15.72:0/206052304 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f9809e410 msgr2=0x7f4f98130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.306+0000 7f4f97fff700 1 --2- 172.21.15.72:0/206052304 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f9809e410 0x7f4f98130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.306+0000 7f4f97fff700 1 -- 172.21.15.72:0/206052304 >> v2:172.21.15.72:3300/0 conn(0x7f4f9809e000 msgr2=0x7f4f98130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.306+0000 7f4f97fff700 1 --2- 172.21.15.72:0/206052304 >> v2:172.21.15.72:3300/0 conn(0x7f4f9809e000 0x7f4f98130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.306+0000 7f4f97fff700 1 -- 172.21.15.72:0/206052304 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9809b2d0 con 0x7f4f9809d6f0 2023-10-03T10:13:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.306+0000 7f4f97fff700 1 --2- 172.21.15.72:0/206052304 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f9809d6f0 0x7f4f9809dac0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800b9a0 tx=0x7f4f8800bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=664b46ab16ed9f9a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.306+0000 7f4f96ffd700 1 -- 172.21.15.72:0/206052304 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800caa0 con 0x7f4f9809d6f0 2023-10-03T10:13:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.306+0000 7f4f96ffd700 1 -- 172.21.15.72:0/206052304 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8800cc00 con 0x7f4f9809d6f0 2023-10-03T10:13:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.306+0000 7f4f96ffd700 1 -- 172.21.15.72:0/206052304 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800f460 con 0x7f4f9809d6f0 2023-10-03T10:13:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.307+0000 7f4f9e4e4700 1 -- 172.21.15.72:0/206052304 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f9809d6f0 msgr2=0x7f4f9809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.307+0000 7f4f9e4e4700 1 --2- 172.21.15.72:0/206052304 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f9809d6f0 0x7f4f9809dac0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800b9a0 tx=0x7f4f8800bcb0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.307+0000 7f4f9e4e4700 1 -- 172.21.15.72:0/206052304 shutdown_connections 2023-10-03T10:13:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.307+0000 7f4f9e4e4700 1 --2- 172.21.15.72:0/206052304 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f9809e410 0x7f4f98130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.307+0000 7f4f9e4e4700 1 --2- 172.21.15.72:0/206052304 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f9809d6f0 0x7f4f9809dac0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.307+0000 7f4f9e4e4700 1 --2- 172.21.15.72:0/206052304 >> v2:172.21.15.72:3300/0 conn(0x7f4f9809e000 0x7f4f98130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.307+0000 7f4f9e4e4700 1 -- 172.21.15.72:0/206052304 >> 172.21.15.72:0/206052304 conn(0x7f4f98066f50 msgr2=0x7f4f9809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.308+0000 7f4f9e4e4700 1 -- 172.21.15.72:0/206052304 shutdown_connections 2023-10-03T10:13:46.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.308+0000 7f4f9e4e4700 1 -- 172.21.15.72:0/206052304 wait complete. 2023-10-03T10:13:46.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.308+0000 7f4f9e4e4700 1 Processor -- start 2023-10-03T10:13:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.309+0000 7f4f9e4e4700 1 -- start start 2023-10-03T10:13:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.309+0000 7f4f9e4e4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f9809d6f0 0x7f4f981bfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.309+0000 7f4f9e4e4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f9809e000 0x7f4f981bff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.309+0000 7f4f9e4e4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f9809e410 0x7f4f981c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.309+0000 7f4f9e4e4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f981beb70 con 0x7f4f9809d6f0 2023-10-03T10:13:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.309+0000 7f4f9e4e4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f981bb7f0 con 0x7f4f9809e000 2023-10-03T10:13:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.309+0000 7f4f9e4e4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9809c700 con 0x7f4f9809e410 2023-10-03T10:13:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.309+0000 7f4f9ca81700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f9809e410 0x7f4f981c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.309+0000 7f4f9ca81700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f9809e410 0x7f4f981c04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38658/0 (socket says 172.21.15.72:38658) 2023-10-03T10:13:46.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.309+0000 7f4f9ca81700 1 -- 172.21.15.72:0/1567834320 learned_addr learned my addr 172.21.15.72:0/1567834320 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.309+0000 7f4f977fe700 1 --2- 172.21.15.72:0/1567834320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f9809e000 0x7f4f981bff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.310+0000 7f4f97fff700 1 --2- 172.21.15.72:0/1567834320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f9809d6f0 0x7f4f981bfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.310+0000 7f4f9ca81700 1 -- 172.21.15.72:0/1567834320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f9809e000 msgr2=0x7f4f981bff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.310+0000 7f4f9ca81700 1 --2- 172.21.15.72:0/1567834320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f9809e000 0x7f4f981bff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.310+0000 7f4f9ca81700 1 -- 172.21.15.72:0/1567834320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f9809d6f0 msgr2=0x7f4f981bfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.310+0000 7f4f9ca81700 1 --2- 172.21.15.72:0/1567834320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f9809d6f0 0x7f4f981bfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.310+0000 7f4f9ca81700 1 -- 172.21.15.72:0/1567834320 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8800b600 con 0x7f4f9809e410 2023-10-03T10:13:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.310+0000 7f4f97fff700 1 --2- 172.21.15.72:0/1567834320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f9809d6f0 0x7f4f981bfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.310+0000 7f4f9ca81700 1 --2- 172.21.15.72:0/1567834320 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f9809e410 0x7f4f981c04b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000bcc0 tx=0x7f4f9000a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.310+0000 7f4f94ff9700 1 -- 172.21.15.72:0/1567834320 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90003a20 con 0x7f4f9809e410 2023-10-03T10:13:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.310+0000 7f4f94ff9700 1 -- 172.21.15.72:0/1567834320 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f90003b80 con 0x7f4f9809e410 2023-10-03T10:13:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.310+0000 7f4f94ff9700 1 -- 172.21.15.72:0/1567834320 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90004030 con 0x7f4f9809e410 2023-10-03T10:13:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.310+0000 7f4f9e4e4700 1 -- 172.21.15.72:0/1567834320 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f981be8b0 con 0x7f4f9809e410 2023-10-03T10:13:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.310+0000 7f4f9e4e4700 1 -- 172.21.15.72:0/1567834320 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f981bcfc0 con 0x7f4f9809e410 2023-10-03T10:13:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.311+0000 7f4f9e4e4700 1 -- 172.21.15.72:0/1567834320 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f981becc0 con 0x7f4f9809e410 2023-10-03T10:13:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.311+0000 7f4f94ff9700 1 -- 172.21.15.72:0/1567834320 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f9000b040 con 0x7f4f9809e410 2023-10-03T10:13:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.312+0000 7f4f94ff9700 1 -- 172.21.15.72:0/1567834320 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4f9003fbe0 con 0x7f4f9809e410 2023-10-03T10:13:46.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.316+0000 7f4f94ff9700 1 -- 172.21.15.72:0/1567834320 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f90020710 con 0x7f4f9809e410 2023-10-03T10:13:46.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.320+0000 7fc04b47a700 1 Processor -- start 2023-10-03T10:13:46.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.320+0000 7fc04b47a700 1 -- start start 2023-10-03T10:13:46.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc04b47a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc04412cf60 0x7fc04406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc04b47a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc04412f8b0 0x7fc04412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc04b47a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc044130260 0x7fc044136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc04b47a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04412d330 con 0x7fc04412cf60 2023-10-03T10:13:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc04b47a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04412cd90 con 0x7fc044130260 2023-10-03T10:13:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc04b47a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0441306d0 con 0x7fc04412f8b0 2023-10-03T10:13:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc049a17700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc044130260 0x7fc044136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc048a15700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc04412f8b0 0x7fc04412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc049a17700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc044130260 0x7fc044136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40106/0 (socket says 172.21.15.72:40106) 2023-10-03T10:13:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc049a17700 1 -- 172.21.15.72:0/3988254762 learned_addr learned my addr 172.21.15.72:0/3988254762 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc048a15700 1 -- 172.21.15.72:0/3988254762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc044130260 msgr2=0x7fc044136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc048a15700 1 --2- 172.21.15.72:0/3988254762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc044130260 0x7fc044136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc048a15700 1 -- 172.21.15.72:0/3988254762 >> v2:172.21.15.72:3300/0 conn(0x7fc04412cf60 msgr2=0x7fc04406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc048a15700 1 --2- 172.21.15.72:0/3988254762 >> v2:172.21.15.72:3300/0 conn(0x7fc04412cf60 0x7fc04406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc048a15700 1 -- 172.21.15.72:0/3988254762 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc044071780 con 0x7fc04412f8b0 2023-10-03T10:13:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.321+0000 7fc048a15700 1 --2- 172.21.15.72:0/3988254762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc04412f8b0 0x7fc04412fd20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc03400dc90 tx=0x7fc03400f050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13dbf84f4da6cb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.322+0000 7fc03bfff700 1 -- 172.21.15.72:0/3988254762 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc034012070 con 0x7fc04412f8b0 2023-10-03T10:13:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.322+0000 7fc03bfff700 1 -- 172.21.15.72:0/3988254762 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03400d2e0 con 0x7fc04412f8b0 2023-10-03T10:13:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.322+0000 7fc03bfff700 1 -- 172.21.15.72:0/3988254762 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400f8b0 con 0x7fc04412f8b0 2023-10-03T10:13:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.322+0000 7fc04b47a700 1 -- 172.21.15.72:0/3988254762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc04412f8b0 msgr2=0x7fc04412fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.322+0000 7fc04b47a700 1 --2- 172.21.15.72:0/3988254762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc04412f8b0 0x7fc04412fd20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc03400dc90 tx=0x7fc03400f050 comp rx=0 tx=0).stop 2023-10-03T10:13:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.322+0000 7fc04b47a700 1 -- 172.21.15.72:0/3988254762 shutdown_connections 2023-10-03T10:13:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.322+0000 7fc04b47a700 1 --2- 172.21.15.72:0/3988254762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc044130260 0x7fc044136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.322+0000 7fc04b47a700 1 --2- 172.21.15.72:0/3988254762 >> v2:172.21.15.72:3300/0 conn(0x7fc04412cf60 0x7fc04406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.322+0000 7fc04b47a700 1 --2- 172.21.15.72:0/3988254762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc04412f8b0 0x7fc04412fd20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.322+0000 7fc04b47a700 1 -- 172.21.15.72:0/3988254762 >> 172.21.15.72:0/3988254762 conn(0x7fc0440a2aa0 msgr2=0x7fc0440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.323+0000 7fc04b47a700 1 -- 172.21.15.72:0/3988254762 shutdown_connections 2023-10-03T10:13:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.323+0000 7fc04b47a700 1 -- 172.21.15.72:0/3988254762 wait complete. 2023-10-03T10:13:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.323+0000 7fc04b47a700 1 Processor -- start 2023-10-03T10:13:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.323+0000 7fc04b47a700 1 -- start start 2023-10-03T10:13:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.324+0000 7fc04b47a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc04412cf60 0x7fc04409bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.324+0000 7fc04b47a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc04412f8b0 0x7fc04409c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.324+0000 7fc04b47a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc044130260 0x7fc0441c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.324+0000 7fc04b47a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04409e850 con 0x7fc04412f8b0 2023-10-03T10:13:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.324+0000 7fc04b47a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc044129b00 con 0x7fc044130260 2023-10-03T10:13:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.324+0000 7fc04b47a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc04409b7c0 con 0x7fc04412cf60 2023-10-03T10:13:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.324+0000 7fc049216700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc04412cf60 0x7fc04409bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.324+0000 7fc049a17700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc044130260 0x7fc0441c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.324+0000 7fc049a17700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc044130260 0x7fc0441c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40120/0 (socket says 172.21.15.72:40120) 2023-10-03T10:13:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.324+0000 7fc049216700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc04412cf60 0x7fc04409bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38676/0 (socket says 172.21.15.72:38676) 2023-10-03T10:13:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.324+0000 7fc049a17700 1 -- 172.21.15.72:0/3835897234 learned_addr learned my addr 172.21.15.72:0/3835897234 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.324+0000 7fc048a15700 1 --2- 172.21.15.72:0/3835897234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc04412f8b0 0x7fc04409c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.325+0000 7fc049a17700 1 -- 172.21.15.72:0/3835897234 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc04412cf60 msgr2=0x7fc04409bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.325+0000 7fc049a17700 1 --2- 172.21.15.72:0/3835897234 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc04412cf60 0x7fc04409bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.325+0000 7fc049a17700 1 -- 172.21.15.72:0/3835897234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc04412f8b0 msgr2=0x7fc04409c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.325+0000 7fc049a17700 1 --2- 172.21.15.72:0/3835897234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc04412f8b0 0x7fc04409c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.325+0000 7fc049a17700 1 -- 172.21.15.72:0/3835897234 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03400d940 con 0x7fc044130260 2023-10-03T10:13:46.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.325+0000 7fc049a17700 1 --2- 172.21.15.72:0/3835897234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc044130260 0x7fc0441c41c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00bf10 tx=0x7fc03c008500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:46.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.325+0000 7fc039ffb700 1 -- 172.21.15.72:0/3835897234 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c010040 con 0x7fc044130260 2023-10-03T10:13:46.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.325+0000 7fc039ffb700 1 -- 172.21.15.72:0/3835897234 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c008e70 con 0x7fc044130260 2023-10-03T10:13:46.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.325+0000 7fc039ffb700 1 -- 172.21.15.72:0/3835897234 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c016630 con 0x7fc044130260 2023-10-03T10:13:46.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.325+0000 7fc04b47a700 1 -- 172.21.15.72:0/3835897234 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04409ea80 con 0x7fc044130260 2023-10-03T10:13:46.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.325+0000 7fc04b47a700 1 -- 172.21.15.72:0/3835897234 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04409d400 con 0x7fc044130260 2023-10-03T10:13:46.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.326+0000 7fc039ffb700 1 -- 172.21.15.72:0/3835897234 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc03c016790 con 0x7fc044130260 2023-10-03T10:13:46.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.326+0000 7fc04b47a700 1 -- 172.21.15.72:0/3835897234 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04412f400 con 0x7fc044130260 2023-10-03T10:13:46.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.326+0000 7fc039ffb700 1 -- 172.21.15.72:0/3835897234 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc03c041860 con 0x7fc044130260 2023-10-03T10:13:46.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.335+0000 7fc039ffb700 1 -- 172.21.15.72:0/3835897234 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc03c045060 con 0x7fc044130260 2023-10-03T10:13:46.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.413+0000 7f72efe09700 1 -- 172.21.15.72:0/1697135830 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f72e8122620 con 0x7f72e81338a0 2023-10-03T10:13:46.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.414+0000 7f72de7fc700 1 -- 172.21.15.72:0/1697135830 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72e0018030 con 0x7f72e81338a0 2023-10-03T10:13:46.415 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:46.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.416+0000 7f72efe09700 1 -- 172.21.15.72:0/1697135830 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f72e81338a0 msgr2=0x7f72e811f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.416+0000 7f72efe09700 1 --2- 172.21.15.72:0/1697135830 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f72e81338a0 0x7f72e811f7a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f72e000efc0 tx=0x7f72e000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.416+0000 7f72efe09700 1 -- 172.21.15.72:0/1697135830 shutdown_connections 2023-10-03T10:13:46.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.416+0000 7f72efe09700 1 --2- 172.21.15.72:0/1697135830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72e809de50 0x7f72e811ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.416+0000 7f72efe09700 1 --2- 172.21.15.72:0/1697135830 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f72e81338a0 0x7f72e811f7a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.416+0000 7f72efe09700 1 --2- 172.21.15.72:0/1697135830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72e809e760 0x7f72e811f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.416+0000 7f72efe09700 1 -- 172.21.15.72:0/1697135830 >> 172.21.15.72:0/1697135830 conn(0x7f72e80a2aa0 msgr2=0x7f72e809ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.417+0000 7f72efe09700 1 -- 172.21.15.72:0/1697135830 shutdown_connections 2023-10-03T10:13:46.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.417+0000 7f72efe09700 1 -- 172.21.15.72:0/1697135830 wait complete. 2023-10-03T10:13:46.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.497+0000 7fecf212d700 1 -- 172.21.15.72:0/1909036509 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feccc005590 con 0x7fecec06e570 2023-10-03T10:13:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.498+0000 7fecd3fff700 1 -- 172.21.15.72:0/1909036509 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fecdc019a70 con 0x7fecec06e570 2023-10-03T10:13:46.500 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.501+0000 7fecf212d700 1 -- 172.21.15.72:0/1909036509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecec06e570 msgr2=0x7fecec1214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.501+0000 7fecf212d700 1 --2- 172.21.15.72:0/1909036509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecec06e570 0x7fecec1214e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00c520 tx=0x7fecdc00c830 comp rx=0 tx=0).stop 2023-10-03T10:13:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.501+0000 7fecf212d700 1 -- 172.21.15.72:0/1909036509 shutdown_connections 2023-10-03T10:13:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.501+0000 7fecf212d700 1 --2- 172.21.15.72:0/1909036509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fecec121f60 0x7fecec1d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.501+0000 7fecf212d700 1 --2- 172.21.15.72:0/1909036509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecec06e570 0x7fecec1214e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.501+0000 7fecf212d700 1 --2- 172.21.15.72:0/1909036509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecec06f050 0x7fecec121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.501+0000 7fecf212d700 1 -- 172.21.15.72:0/1909036509 >> 172.21.15.72:0/1909036509 conn(0x7fecec0a2aa0 msgr2=0x7fecec0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.501+0000 7fecf212d700 1 -- 172.21.15.72:0/1909036509 shutdown_connections 2023-10-03T10:13:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.501+0000 7fecf212d700 1 -- 172.21.15.72:0/1909036509 wait complete. 2023-10-03T10:13:46.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:46.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.525+0000 7f4f9e4e4700 1 -- 172.21.15.72:0/1567834320 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4f98074ea0 con 0x7f4f9809e410 2023-10-03T10:13:46.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.525+0000 7f4f94ff9700 1 -- 172.21.15.72:0/1567834320 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f90020350 con 0x7f4f9809e410 2023-10-03T10:13:46.526 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:46.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.528+0000 7f4f9e4e4700 1 -- 172.21.15.72:0/1567834320 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f9809e410 msgr2=0x7f4f981c04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.528+0000 7f4f9e4e4700 1 --2- 172.21.15.72:0/1567834320 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f9809e410 0x7f4f981c04b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000bcc0 tx=0x7f4f9000a560 comp rx=0 tx=0).stop 2023-10-03T10:13:46.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.528+0000 7f4f9e4e4700 1 -- 172.21.15.72:0/1567834320 shutdown_connections 2023-10-03T10:13:46.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.528+0000 7f4f9e4e4700 1 --2- 172.21.15.72:0/1567834320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f9809d6f0 0x7f4f981bfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.528+0000 7f4f9e4e4700 1 --2- 172.21.15.72:0/1567834320 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f9809e410 0x7f4f981c04b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.528+0000 7f4f9e4e4700 1 --2- 172.21.15.72:0/1567834320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f9809e000 0x7f4f981bff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.528+0000 7f4f9e4e4700 1 -- 172.21.15.72:0/1567834320 >> 172.21.15.72:0/1567834320 conn(0x7f4f98066f50 msgr2=0x7f4f98070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.528+0000 7f4f9e4e4700 1 -- 172.21.15.72:0/1567834320 shutdown_connections 2023-10-03T10:13:46.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.528+0000 7f4f9e4e4700 1 -- 172.21.15.72:0/1567834320 wait complete. 2023-10-03T10:13:46.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.531+0000 7fc04b47a700 1 -- 172.21.15.72:0/3835897234 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc044074ea0 con 0x7fc044130260 2023-10-03T10:13:46.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.532+0000 7fc039ffb700 1 -- 172.21.15.72:0/3835897234 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc03c045020 con 0x7fc044130260 2023-10-03T10:13:46.532 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:46.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.534+0000 7fc04b47a700 1 -- 172.21.15.72:0/3835897234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc044130260 msgr2=0x7fc0441c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:46.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.534+0000 7fc04b47a700 1 --2- 172.21.15.72:0/3835897234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc044130260 0x7fc0441c41c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00bf10 tx=0x7fc03c008500 comp rx=0 tx=0).stop 2023-10-03T10:13:46.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.534+0000 7fc04b47a700 1 -- 172.21.15.72:0/3835897234 shutdown_connections 2023-10-03T10:13:46.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.534+0000 7fc04b47a700 1 --2- 172.21.15.72:0/3835897234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc044130260 0x7fc0441c41c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.534+0000 7fc04b47a700 1 --2- 172.21.15.72:0/3835897234 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc04412cf60 0x7fc04409bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.534+0000 7fc04b47a700 1 --2- 172.21.15.72:0/3835897234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc04412f8b0 0x7fc04409c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:46.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.534+0000 7fc04b47a700 1 -- 172.21.15.72:0/3835897234 >> 172.21.15.72:0/3835897234 conn(0x7fc0440a2aa0 msgr2=0x7fc04406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:46.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.534+0000 7fc04b47a700 1 -- 172.21.15.72:0/3835897234 shutdown_connections 2023-10-03T10:13:46.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:46.534+0000 7fc04b47a700 1 -- 172.21.15.72:0/3835897234 wait complete. 2023-10-03T10:13:46.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:46.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:47.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:47.519 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:47.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:47.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.560+0000 7f84dfe67700 1 Processor -- start 2023-10-03T10:13:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.560+0000 7f84dfe67700 1 -- start start 2023-10-03T10:13:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.560+0000 7f84dfe67700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84d806b250 0x7f84d8136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.560+0000 7f84dfe67700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d8136d80 0x7f84d8139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.560+0000 7f84dfe67700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d809ece0 con 0x7f84d806a770 2023-10-03T10:13:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.560+0000 7f84dfe67700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d809e760 con 0x7f84d806b250 2023-10-03T10:13:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.560+0000 7f84dfe67700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d809e040 con 0x7f84d8136d80 2023-10-03T10:13:47.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.560+0000 7f84ddc03700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f84d806a770 0x7f84d806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50686/0 (socket says 172.21.15.72:50686) 2023-10-03T10:13:47.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.560+0000 7f84ddc03700 1 -- 172.21.15.72:0/2682519668 learned_addr learned my addr 172.21.15.72:0/2682519668 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:47.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.561+0000 7f84dd402700 1 --2- 172.21.15.72:0/2682519668 >> v2:172.21.15.72:3300/0 conn(0x7f84d806b250 0x7f84d8136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.561+0000 7f84de404700 1 --2- 172.21.15.72:0/2682519668 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d8136d80 0x7f84d8139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.561+0000 7f84de404700 1 -- 172.21.15.72:0/2682519668 >> v2:172.21.15.72:3300/0 conn(0x7f84d806b250 msgr2=0x7f84d8136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:47.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.561+0000 7f84de404700 1 --2- 172.21.15.72:0/2682519668 >> v2:172.21.15.72:3300/0 conn(0x7f84d806b250 0x7f84d8136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.561+0000 7f84de404700 1 -- 172.21.15.72:0/2682519668 >> v1:172.21.15.72:6789/0 conn(0x7f84d806a770 legacy=0x7f84d806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.561+0000 7f84de404700 1 -- 172.21.15.72:0/2682519668 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d809f630 con 0x7f84d8136d80 2023-10-03T10:13:47.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.561+0000 7f84dd402700 1 --2- 172.21.15.72:0/2682519668 >> v2:172.21.15.72:3300/0 conn(0x7f84d806b250 0x7f84d8136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:47.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.561+0000 7f84dcc01700 1 -- 172.21.15.72:0/2682519668 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621565173 0 0) 0x7f84d809ece0 con 0x7f84d806a770 2023-10-03T10:13:47.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.561+0000 7f84de404700 1 --2- 172.21.15.72:0/2682519668 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d8136d80 0x7f84d8139160 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009d90 tx=0x7f84d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e19bbf6969fbc8e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.561+0000 7f84dcc01700 1 -- 172.21.15.72:0/2682519668 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d000e070 con 0x7f84d8136d80 2023-10-03T10:13:47.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.561+0000 7f84dcc01700 1 -- 172.21.15.72:0/2682519668 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d000bb20 con 0x7f84d8136d80 2023-10-03T10:13:47.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.561+0000 7f84dcc01700 1 -- 172.21.15.72:0/2682519668 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0012430 con 0x7f84d8136d80 2023-10-03T10:13:47.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.562+0000 7f84dfe67700 1 -- 172.21.15.72:0/2682519668 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d8136d80 msgr2=0x7f84d8139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.562+0000 7f84dfe67700 1 --2- 172.21.15.72:0/2682519668 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d8136d80 0x7f84d8139160 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009d90 tx=0x7f84d000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.562+0000 7f84dfe67700 1 -- 172.21.15.72:0/2682519668 shutdown_connections 2023-10-03T10:13:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.562+0000 7f84dfe67700 1 --2- 172.21.15.72:0/2682519668 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d8136d80 0x7f84d8139160 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.562+0000 7f84dfe67700 1 --2- 172.21.15.72:0/2682519668 >> v2:172.21.15.72:3300/0 conn(0x7f84d806b250 0x7f84d8136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.562+0000 7f84dfe67700 1 -- 172.21.15.72:0/2682519668 >> 172.21.15.72:0/2682519668 conn(0x7f84d8066f50 msgr2=0x7f84d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.562+0000 7f84dfe67700 1 -- 172.21.15.72:0/2682519668 shutdown_connections 2023-10-03T10:13:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.562+0000 7f84dfe67700 1 -- 172.21.15.72:0/2682519668 wait complete. 2023-10-03T10:13:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.564+0000 7f84dfe67700 1 Processor -- start 2023-10-03T10:13:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.564+0000 7f84dfe67700 1 -- start start 2023-10-03T10:13:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.564+0000 7f84dfe67700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d806a770 0x7f84d81c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.564+0000 7f84dfe67700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d806b250 0x7f84d81c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.564+0000 7f84dfe67700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d8136d80 0x7f84d81c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.564+0000 7f84dfe67700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d806ece0 con 0x7f84d8136d80 2023-10-03T10:13:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.564+0000 7f84dfe67700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8121fc0 con 0x7f84d806b250 2023-10-03T10:13:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.564+0000 7f84dfe67700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84d81322b0 con 0x7f84d806a770 2023-10-03T10:13:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84ddc03700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d806a770 0x7f84d81c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84ddc03700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d806a770 0x7f84d81c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38684/0 (socket says 172.21.15.72:38684) 2023-10-03T10:13:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84ddc03700 1 -- 172.21.15.72:0/3649806808 learned_addr learned my addr 172.21.15.72:0/3649806808 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84de404700 1 --2- 172.21.15.72:0/3649806808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d8136d80 0x7f84d81c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84dd402700 1 --2- 172.21.15.72:0/3649806808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d806b250 0x7f84d81c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84ddc03700 1 -- 172.21.15.72:0/3649806808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d806b250 msgr2=0x7f84d81c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84ddc03700 1 --2- 172.21.15.72:0/3649806808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d806b250 0x7f84d81c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84ddc03700 1 -- 172.21.15.72:0/3649806808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d8136d80 msgr2=0x7f84d81c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84ddc03700 1 --2- 172.21.15.72:0/3649806808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d8136d80 0x7f84d81c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84ddc03700 1 -- 172.21.15.72:0/3649806808 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c80094a0 con 0x7f84d806a770 2023-10-03T10:13:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84de404700 1 --2- 172.21.15.72:0/3649806808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d8136d80 0x7f84d81c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84ddc03700 1 --2- 172.21.15.72:0/3649806808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d806a770 0x7f84d81c81a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f84d400c520 tx=0x7f84d400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84ce7fc700 1 -- 172.21.15.72:0/3649806808 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d4004c80 con 0x7f84d806a770 2023-10-03T10:13:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84ce7fc700 1 -- 172.21.15.72:0/3649806808 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d4004de0 con 0x7f84d806a770 2023-10-03T10:13:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84ce7fc700 1 -- 172.21.15.72:0/3649806808 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d4007310 con 0x7f84d806a770 2023-10-03T10:13:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84dfe67700 1 -- 172.21.15.72:0/3649806808 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d0009a70 con 0x7f84d806a770 2023-10-03T10:13:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.565+0000 7f84dfe67700 1 -- 172.21.15.72:0/3649806808 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d809bfd0 con 0x7f84d806a770 2023-10-03T10:13:47.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.566+0000 7f84ce7fc700 1 -- 172.21.15.72:0/3649806808 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84d4007470 con 0x7f84d806a770 2023-10-03T10:13:47.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.567+0000 7f84ce7fc700 1 -- 172.21.15.72:0/3649806808 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f84d403f3a0 con 0x7f84d806a770 2023-10-03T10:13:47.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.567+0000 7f84dfe67700 1 -- 172.21.15.72:0/3649806808 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d8074ea0 con 0x7f84d806a770 2023-10-03T10:13:47.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.572+0000 7f84ce7fc700 1 -- 172.21.15.72:0/3649806808 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84d40123b0 con 0x7f84d806a770 2023-10-03T10:13:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.652+0000 7f935627c700 1 Processor -- start 2023-10-03T10:13:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.652+0000 7f935627c700 1 -- start start 2023-10-03T10:13:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.652+0000 7f935627c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93501338c0 0x7f9350133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.652+0000 7f935627c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f935009e560 0x7f935013b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.652+0000 7f935627c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935006f720 con 0x7f93501341d0 2023-10-03T10:13:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.652+0000 7f935627c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9350070c80 con 0x7f935009e560 2023-10-03T10:13:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.652+0000 7f935627c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935006fce0 con 0x7f93501338c0 2023-10-03T10:13:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.653+0000 7f9354819700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f935009e560 0x7f935013b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.653+0000 7f9354819700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f935009e560 0x7f935013b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46820/0 (socket says 172.21.15.72:46820) 2023-10-03T10:13:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.653+0000 7f934ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93501338c0 0x7f9350133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.653+0000 7f9354819700 1 -- 172.21.15.72:0/4172361789 learned_addr learned my addr 172.21.15.72:0/4172361789 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.653+0000 7f9354819700 1 -- 172.21.15.72:0/4172361789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93501338c0 msgr2=0x7f9350133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.653+0000 7f9354819700 1 --2- 172.21.15.72:0/4172361789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93501338c0 0x7f9350133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.653+0000 7f9354819700 1 -- 172.21.15.72:0/4172361789 >> v1:172.21.15.72:6789/0 conn(0x7f93501341d0 legacy=0x7f935009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.653+0000 7f934effd700 1 -- 172.21.15.72:0/4172361789 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575488960 0 0) 0x7f935006f720 con 0x7f93501341d0 2023-10-03T10:13:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.653+0000 7f9354819700 1 -- 172.21.15.72:0/4172361789 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93501336a0 con 0x7f935009e560 2023-10-03T10:13:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.653+0000 7f9354819700 1 --2- 172.21.15.72:0/4172361789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935009e560 0x7f935013b860 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9348009e50 tx=0x7f934800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86661b0019572367 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.653+0000 7f934effd700 1 -- 172.21.15.72:0/4172361789 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934800e070 con 0x7f935009e560 2023-10-03T10:13:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.653+0000 7f934effd700 1 -- 172.21.15.72:0/4172361789 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934800b910 con 0x7f935009e560 2023-10-03T10:13:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.653+0000 7f934effd700 1 -- 172.21.15.72:0/4172361789 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934800bcc0 con 0x7f935009e560 2023-10-03T10:13:47.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.654+0000 7f935627c700 1 -- 172.21.15.72:0/4172361789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935009e560 msgr2=0x7f935013b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.654+0000 7f935627c700 1 --2- 172.21.15.72:0/4172361789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935009e560 0x7f935013b860 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9348009e50 tx=0x7f934800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:47.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.655+0000 7f935627c700 1 -- 172.21.15.72:0/4172361789 shutdown_connections 2023-10-03T10:13:47.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.655+0000 7f935627c700 1 --2- 172.21.15.72:0/4172361789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935009e560 0x7f935013b860 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.655+0000 7f935627c700 1 --2- 172.21.15.72:0/4172361789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93501338c0 0x7f9350133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.655+0000 7f935627c700 1 -- 172.21.15.72:0/4172361789 >> 172.21.15.72:0/4172361789 conn(0x7f93500a2aa0 msgr2=0x7f93500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.655+0000 7f935627c700 1 -- 172.21.15.72:0/4172361789 shutdown_connections 2023-10-03T10:13:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.655+0000 7f935627c700 1 -- 172.21.15.72:0/4172361789 wait complete. 2023-10-03T10:13:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.656+0000 7f935627c700 1 Processor -- start 2023-10-03T10:13:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.656+0000 7f935627c700 1 -- start start 2023-10-03T10:13:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.657+0000 7f935627c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f935009e560 0x7f935011a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.657+0000 7f935627c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93501338c0 0x7f935011ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.657+0000 7f935627c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93501341d0 0x7f935011b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.657+0000 7f935627c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935011de50 con 0x7f93501338c0 2023-10-03T10:13:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.657+0000 7f935627c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935011e050 con 0x7f93501341d0 2023-10-03T10:13:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.657+0000 7f935627c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f935011cf40 con 0x7f935009e560 2023-10-03T10:13:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.657+0000 7f934f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93501338c0 0x7f935011ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.657+0000 7f934f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93501338c0 0x7f935011ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46826/0 (socket says 172.21.15.72:46826) 2023-10-03T10:13:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.657+0000 7f934f7fe700 1 -- 172.21.15.72:0/894253545 learned_addr learned my addr 172.21.15.72:0/894253545 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.657+0000 7f9354819700 1 --2- 172.21.15.72:0/894253545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93501341d0 0x7f935011b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.657+0000 7f934ffff700 1 --2- 172.21.15.72:0/894253545 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f935009e560 0x7f935011a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.658+0000 7f934f7fe700 1 -- 172.21.15.72:0/894253545 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f935009e560 msgr2=0x7f935011a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.658+0000 7f934f7fe700 1 --2- 172.21.15.72:0/894253545 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f935009e560 0x7f935011a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.658+0000 7f934f7fe700 1 -- 172.21.15.72:0/894253545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93501341d0 msgr2=0x7f935011b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.658+0000 7f934f7fe700 1 --2- 172.21.15.72:0/894253545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93501341d0 0x7f935011b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.658+0000 7f934f7fe700 1 -- 172.21.15.72:0/894253545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9348009b30 con 0x7f93501338c0 2023-10-03T10:13:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.658+0000 7f9354819700 1 --2- 172.21.15.72:0/894253545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93501341d0 0x7f935011b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:47.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.658+0000 7f934f7fe700 1 --2- 172.21.15.72:0/894253545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93501338c0 0x7f935011ab10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f934400c520 tx=0x7f934400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.658+0000 7f934cff9700 1 -- 172.21.15.72:0/894253545 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93440054e0 con 0x7f93501338c0 2023-10-03T10:13:47.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.658+0000 7f934cff9700 1 -- 172.21.15.72:0/894253545 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9344003680 con 0x7f93501338c0 2023-10-03T10:13:47.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.658+0000 7f934cff9700 1 -- 172.21.15.72:0/894253545 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344003a30 con 0x7f93501338c0 2023-10-03T10:13:47.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.658+0000 7f935627c700 1 -- 172.21.15.72:0/894253545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935011c1e0 con 0x7f93501338c0 2023-10-03T10:13:47.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.658+0000 7f935627c700 1 -- 172.21.15.72:0/894253545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935012fe90 con 0x7f93501338c0 2023-10-03T10:13:47.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.659+0000 7f935627c700 1 -- 172.21.15.72:0/894253545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9350074ea0 con 0x7f93501338c0 2023-10-03T10:13:47.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.660+0000 7f934cff9700 1 -- 172.21.15.72:0/894253545 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9344003b90 con 0x7f93501338c0 2023-10-03T10:13:47.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.660+0000 7f934cff9700 1 -- 172.21.15.72:0/894253545 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f934403f070 con 0x7f93501338c0 2023-10-03T10:13:47.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.669+0000 7f934cff9700 1 -- 172.21.15.72:0/894253545 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9344003e40 con 0x7f93501338c0 2023-10-03T10:13:47.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.694+0000 7f45e7959700 1 Processor -- start 2023-10-03T10:13:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.694+0000 7f45e7959700 1 -- start start 2023-10-03T10:13:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.695+0000 7f45e7959700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f45e009e930 0x7f45e009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.695+0000 7f45e7959700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45e009f650 0x7f45e0131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.695+0000 7f45e7959700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e0070940 con 0x7f45e009f240 2023-10-03T10:13:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.695+0000 7f45e7959700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e006fd60 con 0x7f45e009f650 2023-10-03T10:13:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.695+0000 7f45e7959700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45e006fa80 con 0x7f45e009e930 2023-10-03T10:13:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.695+0000 7f45e5ef6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45e009f650 0x7f45e0131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.695+0000 7f45e4ef4700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f45e009f240 0x7f45e01317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50692/0 (socket says 172.21.15.72:50692) 2023-10-03T10:13:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.695+0000 7f45e4ef4700 1 -- 172.21.15.72:0/16889993 learned_addr learned my addr 172.21.15.72:0/16889993 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.696+0000 7f18a0477700 1 Processor -- start 2023-10-03T10:13:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.696+0000 7f45e5ef6700 1 -- 172.21.15.72:0/16889993 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f45e009e930 msgr2=0x7f45e009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.696+0000 7f45e5ef6700 1 --2- 172.21.15.72:0/16889993 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f45e009e930 0x7f45e009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.696+0000 7f45e5ef6700 1 -- 172.21.15.72:0/16889993 >> v1:172.21.15.72:6789/0 conn(0x7f45e009f240 legacy=0x7f45e01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.696+0000 7f45e5ef6700 1 -- 172.21.15.72:0/16889993 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e009fb60 con 0x7f45e009f650 2023-10-03T10:13:47.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.696+0000 7f18a0477700 1 -- start start 2023-10-03T10:13:47.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.696+0000 7f45e5ef6700 1 --2- 172.21.15.72:0/16889993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e009f650 0x7f45e0131f00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f45d8009d90 tx=0x7f45d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b7e840f105cc5f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.696+0000 7f45d7fff700 1 -- 172.21.15.72:0/16889993 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d800e070 con 0x7f45e009f650 2023-10-03T10:13:47.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.696+0000 7f45d7fff700 1 -- 172.21.15.72:0/16889993 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d800bbd0 con 0x7f45e009f650 2023-10-03T10:13:47.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.696+0000 7f45d7fff700 1 -- 172.21.15.72:0/16889993 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d8012430 con 0x7f45e009f650 2023-10-03T10:13:47.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.696+0000 7f18a0477700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1898136830 0x7f1898138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.696+0000 7f18a0477700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1898139150 0x7f189813b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.696+0000 7f18a0477700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189806f720 con 0x7f18981338c0 2023-10-03T10:13:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.696+0000 7f18a0477700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1898070c80 con 0x7f1898139150 2023-10-03T10:13:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f18a0477700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189806fce0 con 0x7f1898136830 2023-10-03T10:13:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f189e213700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f18981338c0 0x7f1898133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50700/0 (socket says 172.21.15.72:50700) 2023-10-03T10:13:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f189e213700 1 -- 172.21.15.72:0/535768560 learned_addr learned my addr 172.21.15.72:0/535768560 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f189ea14700 1 --2- 172.21.15.72:0/535768560 >> v2:172.21.15.72:3300/0 conn(0x7f1898139150 0x7f189813b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f189ea14700 1 -- 172.21.15.72:0/535768560 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1898136830 msgr2=0x7f1898138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f189ea14700 1 --2- 172.21.15.72:0/535768560 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1898136830 0x7f1898138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f45e7959700 1 -- 172.21.15.72:0/16889993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e009f650 msgr2=0x7f45e0131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f45e7959700 1 --2- 172.21.15.72:0/16889993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e009f650 0x7f45e0131f00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f45d8009d90 tx=0x7f45d800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f189ea14700 1 -- 172.21.15.72:0/535768560 >> v1:172.21.15.72:6789/0 conn(0x7f18981338c0 legacy=0x7f1898133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f189ea14700 1 -- 172.21.15.72:0/535768560 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18981336a0 con 0x7f1898139150 2023-10-03T10:13:47.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f45e7959700 1 -- 172.21.15.72:0/16889993 shutdown_connections 2023-10-03T10:13:47.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f45e7959700 1 --2- 172.21.15.72:0/16889993 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e009f650 0x7f45e0131f00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f45e7959700 1 --2- 172.21.15.72:0/16889993 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f45e009e930 0x7f45e009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f45e7959700 1 -- 172.21.15.72:0/16889993 >> 172.21.15.72:0/16889993 conn(0x7f45e00a4210 msgr2=0x7f45e00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f189ea14700 1 --2- 172.21.15.72:0/535768560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1898139150 0x7f189813b530 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1890009d90 tx=0x7f189000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de844a900468b25c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f189d211700 1 -- 172.21.15.72:0/535768560 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189000e070 con 0x7f1898139150 2023-10-03T10:13:47.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f45e7959700 1 -- 172.21.15.72:0/16889993 shutdown_connections 2023-10-03T10:13:47.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f189d211700 1 -- 172.21.15.72:0/535768560 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189000bbd0 con 0x7f1898139150 2023-10-03T10:13:47.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f189d211700 1 -- 172.21.15.72:0/535768560 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890012430 con 0x7f1898139150 2023-10-03T10:13:47.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.697+0000 7f45e7959700 1 -- 172.21.15.72:0/16889993 wait complete. 2023-10-03T10:13:47.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.698+0000 7f18a0477700 1 -- 172.21.15.72:0/535768560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1898139150 msgr2=0x7f189813b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.698+0000 7f18a0477700 1 --2- 172.21.15.72:0/535768560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1898139150 0x7f189813b530 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1890009d90 tx=0x7f189000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:47.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.698+0000 7f18a0477700 1 -- 172.21.15.72:0/535768560 shutdown_connections 2023-10-03T10:13:47.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.698+0000 7f18a0477700 1 --2- 172.21.15.72:0/535768560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1898139150 0x7f189813b530 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.698+0000 7f18a0477700 1 --2- 172.21.15.72:0/535768560 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1898136830 0x7f1898138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.698+0000 7f18a0477700 1 -- 172.21.15.72:0/535768560 >> 172.21.15.72:0/535768560 conn(0x7f18980a2aa0 msgr2=0x7f18980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.698+0000 7f18a0477700 1 -- 172.21.15.72:0/535768560 shutdown_connections 2023-10-03T10:13:47.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.698+0000 7f18a0477700 1 -- 172.21.15.72:0/535768560 wait complete. 2023-10-03T10:13:47.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.699+0000 7f45e7959700 1 Processor -- start 2023-10-03T10:13:47.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.699+0000 7f45e7959700 1 -- start start 2023-10-03T10:13:47.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.699+0000 7f18a0477700 1 Processor -- start 2023-10-03T10:13:47.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.699+0000 7f45e7959700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e009e930 0x7f45e01315c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.699+0000 7f45e7959700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45e009f240 0x7f45e0131b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.699+0000 7f45e7959700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f45e009f650 0x7f45e0132040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.699+0000 7f45e7959700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e012fd20 con 0x7f45e009e930 2023-10-03T10:13:47.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.699+0000 7f45e7959700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0071d20 con 0x7f45e009f240 2023-10-03T10:13:47.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.699+0000 7f45e7959700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45e012f0b0 con 0x7f45e009f650 2023-10-03T10:13:47.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.699+0000 7f45e56f5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e009e930 0x7f45e01315c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f45e56f5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e009e930 0x7f45e01315c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46864/0 (socket says 172.21.15.72:46864) 2023-10-03T10:13:47.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f45e56f5700 1 -- 172.21.15.72:0/2295670604 learned_addr learned my addr 172.21.15.72:0/2295670604 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:47.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f45e5ef6700 1 --2- 172.21.15.72:0/2295670604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f45e009f650 0x7f45e0132040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f45e56f5700 1 -- 172.21.15.72:0/2295670604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f45e009f650 msgr2=0x7f45e0132040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f18a0477700 1 -- start start 2023-10-03T10:13:47.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f45e56f5700 1 --2- 172.21.15.72:0/2295670604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f45e009f650 0x7f45e0132040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f45e56f5700 1 -- 172.21.15.72:0/2295670604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45e009f240 msgr2=0x7f45e0131b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f45e56f5700 1 --2- 172.21.15.72:0/2295670604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45e009f240 0x7f45e0131b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f45e56f5700 1 -- 172.21.15.72:0/2295670604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d8009a70 con 0x7f45e009e930 2023-10-03T10:13:47.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f45e56f5700 1 --2- 172.21.15.72:0/2295670604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e009e930 0x7f45e01315c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f45dc00b560 tx=0x7f45dc00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f45d5ffb700 1 -- 172.21.15.72:0/2295670604 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc011830 con 0x7f45e009e930 2023-10-03T10:13:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f18a0477700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18981338c0 0x7f18981cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f18a0477700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1898136830 0x7f18981ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f18a0477700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1898139150 0x7f18981cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f18a0477700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189809d500 con 0x7f1898139150 2023-10-03T10:13:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f18a0477700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1898136100 con 0x7f1898136830 2023-10-03T10:13:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f18a0477700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f189809da80 con 0x7f18981338c0 2023-10-03T10:13:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f189ea14700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1898139150 0x7f18981cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f189e213700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18981338c0 0x7f18981cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f189ea14700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1898139150 0x7f18981cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46868/0 (socket says 172.21.15.72:46868) 2023-10-03T10:13:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f189ea14700 1 -- 172.21.15.72:0/1385478444 learned_addr learned my addr 172.21.15.72:0/1385478444 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:47.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.701+0000 7f189e213700 1 -- 172.21.15.72:0/1385478444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1898136830 msgr2=0x7f18981ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.701+0000 7f189e213700 1 --2- 172.21.15.72:0/1385478444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1898136830 0x7f18981ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.701+0000 7f189e213700 1 -- 172.21.15.72:0/1385478444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1898139150 msgr2=0x7f18981cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.701+0000 7f189e213700 1 --2- 172.21.15.72:0/1385478444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1898139150 0x7f18981cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.701+0000 7f189e213700 1 -- 172.21.15.72:0/1385478444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1890009a70 con 0x7f18981338c0 2023-10-03T10:13:47.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.701+0000 7f189e213700 1 --2- 172.21.15.72:0/1385478444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18981338c0 0x7f18981cc700 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f189400c500 tx=0x7f189400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f45e7959700 1 -- 172.21.15.72:0/2295670604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e00a0190 con 0x7f45e009e930 2023-10-03T10:13:47.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f45d5ffb700 1 -- 172.21.15.72:0/2295670604 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc0119b0 con 0x7f45e009e930 2023-10-03T10:13:47.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f45d5ffb700 1 -- 172.21.15.72:0/2295670604 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc011d60 con 0x7f45e009e930 2023-10-03T10:13:47.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.700+0000 7f45e7959700 1 -- 172.21.15.72:0/2295670604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e0130170 con 0x7f45e009e930 2023-10-03T10:13:47.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.701+0000 7f188effd700 1 -- 172.21.15.72:0/1385478444 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894005d70 con 0x7f18981338c0 2023-10-03T10:13:47.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.702+0000 7f188effd700 1 -- 172.21.15.72:0/1385478444 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18940070d0 con 0x7f18981338c0 2023-10-03T10:13:47.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.702+0000 7f188effd700 1 -- 172.21.15.72:0/1385478444 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894007440 con 0x7f18981338c0 2023-10-03T10:13:47.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.702+0000 7f18a0477700 1 -- 172.21.15.72:0/1385478444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189809dcf0 con 0x7f18981338c0 2023-10-03T10:13:47.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.702+0000 7f18a0477700 1 -- 172.21.15.72:0/1385478444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1898122600 con 0x7f18981338c0 2023-10-03T10:13:47.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.702+0000 7f45e7959700 1 -- 172.21.15.72:0/2295670604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e0074ea0 con 0x7f45e009e930 2023-10-03T10:13:47.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.702+0000 7f45d5ffb700 1 -- 172.21.15.72:0/2295670604 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45dc01a400 con 0x7f45e009e930 2023-10-03T10:13:47.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.702+0000 7f45d5ffb700 1 -- 172.21.15.72:0/2295670604 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f45dc03f810 con 0x7f45e009e930 2023-10-03T10:13:47.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.703+0000 7f188effd700 1 -- 172.21.15.72:0/1385478444 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18940075a0 con 0x7f18981338c0 2023-10-03T10:13:47.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.703+0000 7f188effd700 1 -- 172.21.15.72:0/1385478444 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f189403ead0 con 0x7f18981338c0 2023-10-03T10:13:47.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.703+0000 7f18a0477700 1 -- 172.21.15.72:0/1385478444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1898074ea0 con 0x7f18981338c0 2023-10-03T10:13:47.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.707+0000 7f45d5ffb700 1 -- 172.21.15.72:0/2295670604 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45dc01ae60 con 0x7f45e009e930 2023-10-03T10:13:47.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.708+0000 7f188effd700 1 -- 172.21.15.72:0/1385478444 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1894019d20 con 0x7f18981338c0 2023-10-03T10:13:47.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.820+0000 7f84dfe67700 1 -- 172.21.15.72:0/3649806808 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f84d80a28a0 con 0x7f84d806a770 2023-10-03T10:13:47.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.820+0000 7f84ce7fc700 1 -- 172.21.15.72:0/3649806808 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84d4011360 con 0x7f84d806a770 2023-10-03T10:13:47.821 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:47.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.823+0000 7f84dfe67700 1 -- 172.21.15.72:0/3649806808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d806a770 msgr2=0x7f84d81c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.823+0000 7f84dfe67700 1 --2- 172.21.15.72:0/3649806808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d806a770 0x7f84d81c81a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f84d400c520 tx=0x7f84d400c830 comp rx=0 tx=0).stop 2023-10-03T10:13:47.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.823+0000 7f84dfe67700 1 -- 172.21.15.72:0/3649806808 shutdown_connections 2023-10-03T10:13:47.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.823+0000 7f84dfe67700 1 --2- 172.21.15.72:0/3649806808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d8136d80 0x7f84d81c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.823+0000 7f84dfe67700 1 --2- 172.21.15.72:0/3649806808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d806a770 0x7f84d81c81a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.823+0000 7f84dfe67700 1 --2- 172.21.15.72:0/3649806808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d806b250 0x7f84d81c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.823+0000 7f84dfe67700 1 -- 172.21.15.72:0/3649806808 >> 172.21.15.72:0/3649806808 conn(0x7f84d8066f50 msgr2=0x7f84d81347a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.823+0000 7f84dfe67700 1 -- 172.21.15.72:0/3649806808 shutdown_connections 2023-10-03T10:13:47.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.823+0000 7f84dfe67700 1 -- 172.21.15.72:0/3649806808 wait complete. 2023-10-03T10:13:47.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:47.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.879+0000 7f935627c700 1 -- 172.21.15.72:0/894253545 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f935006b9e0 con 0x7f93501338c0 2023-10-03T10:13:47.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.879+0000 7f934cff9700 1 -- 172.21.15.72:0/894253545 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9344017030 con 0x7f93501338c0 2023-10-03T10:13:47.880 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.881+0000 7f935627c700 1 -- 172.21.15.72:0/894253545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93501338c0 msgr2=0x7f935011ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.881+0000 7f935627c700 1 --2- 172.21.15.72:0/894253545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93501338c0 0x7f935011ab10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f934400c520 tx=0x7f934400c830 comp rx=0 tx=0).stop 2023-10-03T10:13:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.881+0000 7f935627c700 1 -- 172.21.15.72:0/894253545 shutdown_connections 2023-10-03T10:13:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.881+0000 7f935627c700 1 --2- 172.21.15.72:0/894253545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93501341d0 0x7f935011b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.881+0000 7f935627c700 1 --2- 172.21.15.72:0/894253545 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f935009e560 0x7f935011a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.881+0000 7f935627c700 1 --2- 172.21.15.72:0/894253545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93501338c0 0x7f935011ab10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.881+0000 7f935627c700 1 -- 172.21.15.72:0/894253545 >> 172.21.15.72:0/894253545 conn(0x7f93500a2aa0 msgr2=0x7f935012f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.882+0000 7f935627c700 1 -- 172.21.15.72:0/894253545 shutdown_connections 2023-10-03T10:13:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.882+0000 7f935627c700 1 -- 172.21.15.72:0/894253545 wait complete. 2023-10-03T10:13:47.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:47.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.913+0000 7f45e7959700 1 -- 172.21.15.72:0/2295670604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f45e0130360 con 0x7f45e009e930 2023-10-03T10:13:47.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.913+0000 7f45d5ffb700 1 -- 172.21.15.72:0/2295670604 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45dc022350 con 0x7f45e009e930 2023-10-03T10:13:47.914 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:47.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.915+0000 7f45e7959700 1 -- 172.21.15.72:0/2295670604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e009e930 msgr2=0x7f45e01315c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.915+0000 7f45e7959700 1 --2- 172.21.15.72:0/2295670604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e009e930 0x7f45e01315c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f45dc00b560 tx=0x7f45dc00b870 comp rx=0 tx=0).stop 2023-10-03T10:13:47.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.915+0000 7f45e7959700 1 -- 172.21.15.72:0/2295670604 shutdown_connections 2023-10-03T10:13:47.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.915+0000 7f45e7959700 1 --2- 172.21.15.72:0/2295670604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45e009e930 0x7f45e01315c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.915+0000 7f45e7959700 1 --2- 172.21.15.72:0/2295670604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f45e009f650 0x7f45e0132040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.915+0000 7f45e7959700 1 --2- 172.21.15.72:0/2295670604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f45e009f240 0x7f45e0131b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.915+0000 7f45e7959700 1 -- 172.21.15.72:0/2295670604 >> 172.21.15.72:0/2295670604 conn(0x7f45e00a4210 msgr2=0x7f45e006c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.915+0000 7f45e7959700 1 -- 172.21.15.72:0/2295670604 shutdown_connections 2023-10-03T10:13:47.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.915+0000 7f45e7959700 1 -- 172.21.15.72:0/2295670604 wait complete. 2023-10-03T10:13:47.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.945+0000 7f18a0477700 1 -- 172.21.15.72:0/1385478444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f189806b9e0 con 0x7f18981338c0 2023-10-03T10:13:47.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.945+0000 7f188effd700 1 -- 172.21.15.72:0/1385478444 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1894017020 con 0x7f18981338c0 2023-10-03T10:13:47.946 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:47.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.947+0000 7f18a0477700 1 -- 172.21.15.72:0/1385478444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18981338c0 msgr2=0x7f18981cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.947+0000 7f18a0477700 1 --2- 172.21.15.72:0/1385478444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18981338c0 0x7f18981cc700 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f189400c500 tx=0x7f189400c810 comp rx=0 tx=0).stop 2023-10-03T10:13:47.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.947+0000 7f18a0477700 1 -- 172.21.15.72:0/1385478444 shutdown_connections 2023-10-03T10:13:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.947+0000 7f18a0477700 1 --2- 172.21.15.72:0/1385478444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1898139150 0x7f18981cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.947+0000 7f18a0477700 1 --2- 172.21.15.72:0/1385478444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18981338c0 0x7f18981cc700 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.947+0000 7f18a0477700 1 --2- 172.21.15.72:0/1385478444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1898136830 0x7f18981ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.947+0000 7f18a0477700 1 -- 172.21.15.72:0/1385478444 >> 172.21.15.72:0/1385478444 conn(0x7f18980a2aa0 msgr2=0x7f1898134e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.947+0000 7f18a0477700 1 -- 172.21.15.72:0/1385478444 shutdown_connections 2023-10-03T10:13:47.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:47.947+0000 7f18a0477700 1 -- 172.21.15.72:0/1385478444 wait complete. 2023-10-03T10:13:47.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:48.841 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:48.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:48.929 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:48.961 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:48.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.984+0000 7f0fb0df1700 1 Processor -- start 2023-10-03T10:13:48.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.985+0000 7f0fb0df1700 1 -- start start 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.985+0000 7f0fb0df1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fac1338a0 0x7f0fac133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.985+0000 7f0fb0df1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fac09de50 0x7f0fac09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.985+0000 7f0fb0df1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac06ef30 con 0x7f0fac09e760 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.985+0000 7f0fb0df1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac06fef0 con 0x7f0fac09de50 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.985+0000 7f0fb0df1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac1334b0 con 0x7f0fac1338a0 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.985+0000 7f0fa9d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fac09de50 0x7f0fac09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.985+0000 7f0fa9d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fac09de50 0x7f0fac09e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43470/0 (socket says 172.21.15.72:43470) 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.985+0000 7f0fa9d9b700 1 -- 172.21.15.72:0/1990676607 learned_addr learned my addr 172.21.15.72:0/1990676607 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.986+0000 7f0faa59c700 1 --2- 172.21.15.72:0/1990676607 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fac1338a0 0x7f0fac133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.986+0000 7f0fa9d9b700 1 -- 172.21.15.72:0/1990676607 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fac1338a0 msgr2=0x7f0fac133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:48.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.986+0000 7f0fa9d9b700 1 --2- 172.21.15.72:0/1990676607 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fac1338a0 0x7f0fac133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.986+0000 7f0fa9d9b700 1 -- 172.21.15.72:0/1990676607 >> v1:172.21.15.72:6789/0 conn(0x7f0fac09e760 legacy=0x7f0fac13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.986+0000 7f0fa9d9b700 1 -- 172.21.15.72:0/1990676607 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac06fc30 con 0x7f0fac09de50 2023-10-03T10:13:48.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.986+0000 7f0fa9d9b700 1 --2- 172.21.15.72:0/1990676607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac09de50 0x7f0fac09e220 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00098f0 tx=0x7f0fa0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e295c86a24f9dae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.986+0000 7f0fa959a700 1 -- 172.21.15.72:0/1990676607 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000b8a0 con 0x7f0fac09de50 2023-10-03T10:13:48.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.986+0000 7f0fa959a700 1 -- 172.21.15.72:0/1990676607 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa000ba00 con 0x7f0fac09de50 2023-10-03T10:13:48.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.986+0000 7f0fa959a700 1 -- 172.21.15.72:0/1990676607 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000bd90 con 0x7f0fac09de50 2023-10-03T10:13:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.987+0000 7f0fb0df1700 1 -- 172.21.15.72:0/1990676607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac09de50 msgr2=0x7f0fac09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.987+0000 7f0fb0df1700 1 --2- 172.21.15.72:0/1990676607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac09de50 0x7f0fac09e220 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00098f0 tx=0x7f0fa0009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.987+0000 7f0fb0df1700 1 -- 172.21.15.72:0/1990676607 shutdown_connections 2023-10-03T10:13:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.987+0000 7f0fb0df1700 1 --2- 172.21.15.72:0/1990676607 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fac1338a0 0x7f0fac133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.987+0000 7f0fb0df1700 1 --2- 172.21.15.72:0/1990676607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac09de50 0x7f0fac09e220 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.987+0000 7f0fb0df1700 1 -- 172.21.15.72:0/1990676607 >> 172.21.15.72:0/1990676607 conn(0x7f0fac0a2aa0 msgr2=0x7f0fac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.987+0000 7f0fb0df1700 1 -- 172.21.15.72:0/1990676607 shutdown_connections 2023-10-03T10:13:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.987+0000 7f0fb0df1700 1 -- 172.21.15.72:0/1990676607 wait complete. 2023-10-03T10:13:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.989+0000 7f0fb0df1700 1 Processor -- start 2023-10-03T10:13:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.989+0000 7f0fb0df1700 1 -- start start 2023-10-03T10:13:48.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.989+0000 7f0fb0df1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fac09de50 0x7f0fac11d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.989+0000 7f0fb0df1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fac09e760 0x7f0fac11dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.989+0000 7f0fb0df1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac1338a0 0x7f0fac11e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:48.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.989+0000 7f0fb0df1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac1211b0 con 0x7f0fac1338a0 2023-10-03T10:13:48.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.989+0000 7f0fb0df1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac11f340 con 0x7f0fac09de50 2023-10-03T10:13:48.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.989+0000 7f0fb0df1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0a1040 con 0x7f0fac09e760 2023-10-03T10:13:48.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.989+0000 7f0faa59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fac09de50 0x7f0fac11d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.989+0000 7f0faa59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fac09de50 0x7f0fac11d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42536/0 (socket says 172.21.15.72:42536) 2023-10-03T10:13:48.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.989+0000 7f0faa59c700 1 -- 172.21.15.72:0/1565758850 learned_addr learned my addr 172.21.15.72:0/1565758850 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:48.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.990+0000 7f0fa9d9b700 1 --2- 172.21.15.72:0/1565758850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fac09e760 0x7f0fac11dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.990+0000 7f0faad9d700 1 --2- 172.21.15.72:0/1565758850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac1338a0 0x7f0fac11e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:48.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.990+0000 7f0faa59c700 1 -- 172.21.15.72:0/1565758850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fac09e760 msgr2=0x7f0fac11dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.990+0000 7f0faa59c700 1 --2- 172.21.15.72:0/1565758850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fac09e760 0x7f0fac11dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.990+0000 7f0faa59c700 1 -- 172.21.15.72:0/1565758850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac1338a0 msgr2=0x7f0fac11e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.990+0000 7f0faa59c700 1 --2- 172.21.15.72:0/1565758850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac1338a0 0x7f0fac11e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.990+0000 7f0faa59c700 1 -- 172.21.15.72:0/1565758850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa0009550 con 0x7f0fac09de50 2023-10-03T10:13:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.990+0000 7f0faa59c700 1 --2- 172.21.15.72:0/1565758850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fac09de50 0x7f0fac11d690 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00e810 tx=0x7f0f9c00eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.990+0000 7f0f9affd700 1 -- 172.21.15.72:0/1565758850 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c00c070 con 0x7f0fac09de50 2023-10-03T10:13:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.990+0000 7f0f9affd700 1 -- 172.21.15.72:0/1565758850 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c013610 con 0x7f0fac09de50 2023-10-03T10:13:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.990+0000 7f0fb0df1700 1 -- 172.21.15.72:0/1565758850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fac06f640 con 0x7f0fac09de50 2023-10-03T10:13:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.991+0000 7f0f9affd700 1 -- 172.21.15.72:0/1565758850 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0139a0 con 0x7f0fac09de50 2023-10-03T10:13:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.991+0000 7f0fb0df1700 1 -- 172.21.15.72:0/1565758850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac1205c0 con 0x7f0fac09de50 2023-10-03T10:13:48.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.991+0000 7f0f9affd700 1 -- 172.21.15.72:0/1565758850 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f9c013b00 con 0x7f0fac09de50 2023-10-03T10:13:48.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.992+0000 7f0f9affd700 1 -- 172.21.15.72:0/1565758850 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0f9c03f4d0 con 0x7f0fac09de50 2023-10-03T10:13:48.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.992+0000 7f0fb0df1700 1 -- 172.21.15.72:0/1565758850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac074ea0 con 0x7f0fac09de50 2023-10-03T10:13:48.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:48.997+0000 7f0f9affd700 1 -- 172.21.15.72:0/1565758850 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f9c01c400 con 0x7f0fac09de50 2023-10-03T10:13:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.032+0000 7f01cc37c700 1 Processor -- start 2023-10-03T10:13:49.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.032+0000 7f01cc37c700 1 -- start start 2023-10-03T10:13:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.032+0000 7f01cc37c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c4130540 0x7f01c4130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.032+0000 7f01cc37c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01c406fcf0 0x7f01c4138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.032+0000 7f01cc37c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c40716a0 con 0x7f01c4130e50 2023-10-03T10:13:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.032+0000 7f01cc37c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c409a390 con 0x7f01c406fcf0 2023-10-03T10:13:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.032+0000 7f01cc37c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c4071290 con 0x7f01c4130540 2023-10-03T10:13:49.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.033+0000 7f01ca118700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c4130540 0x7f01c4130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.033+0000 7f01c9917700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f01c4130e50 0x7f01c406f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42994/0 (socket says 172.21.15.72:42994) 2023-10-03T10:13:49.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.033+0000 7f01ca118700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c4130540 0x7f01c4130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42538/0 (socket says 172.21.15.72:42538) 2023-10-03T10:13:49.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.033+0000 7f01ca919700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01c406fcf0 0x7f01c4138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.033+0000 7f01c9917700 1 -- 172.21.15.72:0/947759631 learned_addr learned my addr 172.21.15.72:0/947759631 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.033+0000 7f01ca118700 1 -- 172.21.15.72:0/947759631 >> v2:172.21.15.72:3300/0 conn(0x7f01c406fcf0 msgr2=0x7f01c4138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.033+0000 7f01ca118700 1 --2- 172.21.15.72:0/947759631 >> v2:172.21.15.72:3300/0 conn(0x7f01c406fcf0 0x7f01c4138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.033+0000 7f01ca118700 1 -- 172.21.15.72:0/947759631 >> v1:172.21.15.72:6789/0 conn(0x7f01c4130e50 legacy=0x7f01c406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.033+0000 7f01ca118700 1 -- 172.21.15.72:0/947759631 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c4130340 con 0x7f01c4130540 2023-10-03T10:13:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.033+0000 7f01ca118700 1 --2- 172.21.15.72:0/947759631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c4130540 0x7f01c4130910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009870 tx=0x7f01c0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4c02caf766d6f6a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.033+0000 7f01c9116700 1 -- 172.21.15.72:0/947759631 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0011830 con 0x7f01c4130540 2023-10-03T10:13:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.033+0000 7f01c9116700 1 -- 172.21.15.72:0/947759631 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c0011990 con 0x7f01c4130540 2023-10-03T10:13:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.033+0000 7f01c9116700 1 -- 172.21.15.72:0/947759631 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0011d20 con 0x7f01c4130540 2023-10-03T10:13:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.034+0000 7f01cc37c700 1 -- 172.21.15.72:0/947759631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c4130540 msgr2=0x7f01c4130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.034+0000 7f01cc37c700 1 --2- 172.21.15.72:0/947759631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c4130540 0x7f01c4130910 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009870 tx=0x7f01c0009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.034+0000 7f01cc37c700 1 -- 172.21.15.72:0/947759631 shutdown_connections 2023-10-03T10:13:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.034+0000 7f01cc37c700 1 --2- 172.21.15.72:0/947759631 >> v2:172.21.15.72:3300/0 conn(0x7f01c406fcf0 0x7f01c4138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.034+0000 7f01cc37c700 1 --2- 172.21.15.72:0/947759631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c4130540 0x7f01c4130910 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.034+0000 7f01cc37c700 1 -- 172.21.15.72:0/947759631 >> 172.21.15.72:0/947759631 conn(0x7f01c40a2aa0 msgr2=0x7f01c40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.034+0000 7f01cc37c700 1 -- 172.21.15.72:0/947759631 shutdown_connections 2023-10-03T10:13:49.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.034+0000 7f01cc37c700 1 -- 172.21.15.72:0/947759631 wait complete. 2023-10-03T10:13:49.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.035+0000 7f01cc37c700 1 Processor -- start 2023-10-03T10:13:49.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.035+0000 7f01cc37c700 1 -- start start 2023-10-03T10:13:49.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01cc37c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01c406fcf0 0x7f01c406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01cc37c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c4130540 0x7f01c406ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01cc37c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c4130e50 0x7f01c406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01cc37c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c4119230 con 0x7f01c4130540 2023-10-03T10:13:49.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01cc37c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c40a1e30 con 0x7f01c4130e50 2023-10-03T10:13:49.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01cc37c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01c40718e0 con 0x7f01c406fcf0 2023-10-03T10:13:49.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01ca919700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c4130e50 0x7f01c406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01ca919700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c4130e50 0x7f01c406ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42542/0 (socket says 172.21.15.72:42542) 2023-10-03T10:13:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01ca919700 1 -- 172.21.15.72:0/3794015822 learned_addr learned my addr 172.21.15.72:0/3794015822 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01ca118700 1 --2- 172.21.15.72:0/3794015822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01c406fcf0 0x7f01c406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01c9917700 1 --2- 172.21.15.72:0/3794015822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c4130540 0x7f01c406ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01ca118700 1 -- 172.21.15.72:0/3794015822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c4130e50 msgr2=0x7f01c406ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01ca118700 1 --2- 172.21.15.72:0/3794015822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c4130e50 0x7f01c406ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01ca118700 1 -- 172.21.15.72:0/3794015822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c4130540 msgr2=0x7f01c406ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01ca118700 1 --2- 172.21.15.72:0/3794015822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c4130540 0x7f01c406ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01ca118700 1 -- 172.21.15.72:0/3794015822 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c00094a0 con 0x7f01c406fcf0 2023-10-03T10:13:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01ca919700 1 --2- 172.21.15.72:0/3794015822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c4130e50 0x7f01c406ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.036+0000 7f01ca118700 1 --2- 172.21.15.72:0/3794015822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01c406fcf0 0x7f01c406e4d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f01c0016000 tx=0x7f01c0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.037+0000 7f01baffd700 1 -- 172.21.15.72:0/3794015822 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0004400 con 0x7f01c406fcf0 2023-10-03T10:13:49.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.037+0000 7f01cc37c700 1 -- 172.21.15.72:0/3794015822 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c4119700 con 0x7f01c406fcf0 2023-10-03T10:13:49.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.037+0000 7f01baffd700 1 -- 172.21.15.72:0/3794015822 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c0027070 con 0x7f01c406fcf0 2023-10-03T10:13:49.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.037+0000 7f01baffd700 1 -- 172.21.15.72:0/3794015822 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c00038a0 con 0x7f01c406fcf0 2023-10-03T10:13:49.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.037+0000 7f01cc37c700 1 -- 172.21.15.72:0/3794015822 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c409e2f0 con 0x7f01c406fcf0 2023-10-03T10:13:49.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.038+0000 7f01baffd700 1 -- 172.21.15.72:0/3794015822 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01c0029030 con 0x7f01c406fcf0 2023-10-03T10:13:49.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.038+0000 7f01baffd700 1 -- 172.21.15.72:0/3794015822 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f01c00494c0 con 0x7f01c406fcf0 2023-10-03T10:13:49.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.038+0000 7f01cc37c700 1 -- 172.21.15.72:0/3794015822 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c4074ea0 con 0x7f01c406fcf0 2023-10-03T10:13:49.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.046+0000 7f01baffd700 1 -- 172.21.15.72:0/3794015822 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01c0015020 con 0x7f01c406fcf0 2023-10-03T10:13:49.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.083+0000 7fda8582d700 1 Processor -- start 2023-10-03T10:13:49.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.083+0000 7fda8582d700 1 -- start start 2023-10-03T10:13:49.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.084+0000 7fda8582d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda8009e930 0x7fda8009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.084+0000 7fda8582d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda8009f240 0x7fda801317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.084+0000 7fda8582d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fda8009f650 0x7fda80131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.084+0000 7fda8582d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda80070940 con 0x7fda8009f650 2023-10-03T10:13:49.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.084+0000 7fda8582d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8006fd60 con 0x7fda8009f240 2023-10-03T10:13:49.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.084+0000 7fda8582d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda8006fa80 con 0x7fda8009e930 2023-10-03T10:13:49.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.084+0000 7fda7effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda8009e930 0x7fda8009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.084+0000 7fda7effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda8009e930 0x7fda8009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57390/0 (socket says 172.21.15.72:57390) 2023-10-03T10:13:49.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.084+0000 7fda7effd700 1 -- 172.21.15.72:0/3992271155 learned_addr learned my addr 172.21.15.72:0/3992271155 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:49.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.084+0000 7fda7f7fe700 1 --2- 172.21.15.72:0/3992271155 >> v2:172.21.15.72:3300/0 conn(0x7fda8009f650 0x7fda80131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.084+0000 7fda7e7fc700 1 --2- 172.21.15.72:0/3992271155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda8009f240 0x7fda801317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.085+0000 7fda7f7fe700 1 -- 172.21.15.72:0/3992271155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda8009e930 msgr2=0x7fda8009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:49.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.085+0000 7fda7f7fe700 1 --2- 172.21.15.72:0/3992271155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda8009e930 0x7fda8009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.085+0000 7fda7f7fe700 1 -- 172.21.15.72:0/3992271155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda8009f240 msgr2=0x7fda801317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:49.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.085+0000 7fda7f7fe700 1 --2- 172.21.15.72:0/3992271155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda8009f240 0x7fda801317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.085+0000 7fda7f7fe700 1 -- 172.21.15.72:0/3992271155 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8009fb60 con 0x7fda8009f650 2023-10-03T10:13:49.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.085+0000 7fda7effd700 1 --2- 172.21.15.72:0/3992271155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda8009e930 0x7fda8009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:49.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.085+0000 7fda7e7fc700 1 --2- 172.21.15.72:0/3992271155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda8009f240 0x7fda801317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:49.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.085+0000 7fda7f7fe700 1 --2- 172.21.15.72:0/3992271155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8009f650 0x7fda80131d30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fda78009d90 tx=0x7fda7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab249659b185ff1c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.085+0000 7fda7dffb700 1 -- 172.21.15.72:0/3992271155 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7800e070 con 0x7fda8009f650 2023-10-03T10:13:49.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.085+0000 7fda7dffb700 1 -- 172.21.15.72:0/3992271155 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7800bb20 con 0x7fda8009f650 2023-10-03T10:13:49.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.085+0000 7fda7dffb700 1 -- 172.21.15.72:0/3992271155 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78012430 con 0x7fda8009f650 2023-10-03T10:13:49.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.086+0000 7fda8582d700 1 -- 172.21.15.72:0/3992271155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8009f650 msgr2=0x7fda80131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.086+0000 7fda8582d700 1 --2- 172.21.15.72:0/3992271155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8009f650 0x7fda80131d30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fda78009d90 tx=0x7fda7800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:49.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.086+0000 7fda8582d700 1 -- 172.21.15.72:0/3992271155 shutdown_connections 2023-10-03T10:13:49.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.086+0000 7fda8582d700 1 --2- 172.21.15.72:0/3992271155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8009f650 0x7fda80131d30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.086+0000 7fda8582d700 1 --2- 172.21.15.72:0/3992271155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda8009e930 0x7fda8009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.086+0000 7fda8582d700 1 --2- 172.21.15.72:0/3992271155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda8009f240 0x7fda801317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.086+0000 7fda8582d700 1 -- 172.21.15.72:0/3992271155 >> 172.21.15.72:0/3992271155 conn(0x7fda800a4210 msgr2=0x7fda800a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.086+0000 7fda8582d700 1 -- 172.21.15.72:0/3992271155 shutdown_connections 2023-10-03T10:13:49.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.086+0000 7fda8582d700 1 -- 172.21.15.72:0/3992271155 wait complete. 2023-10-03T10:13:49.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.087+0000 7fda8582d700 1 Processor -- start 2023-10-03T10:13:49.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.088+0000 7fda8582d700 1 -- start start 2023-10-03T10:13:49.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.088+0000 7fda8582d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda8009e930 0x7fda801a68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.088+0000 7fda8582d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8009f240 0x7fda801a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.088+0000 7fda8582d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda8009f650 0x7fda801c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.088+0000 7fda8582d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda801b9730 con 0x7fda8009f240 2023-10-03T10:13:49.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.088+0000 7fda8582d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda801a8ad0 con 0x7fda8009e930 2023-10-03T10:13:49.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.088+0000 7fda8582d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda801a9330 con 0x7fda8009f650 2023-10-03T10:13:49.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.088+0000 7fda7effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda8009e930 0x7fda801a68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.088+0000 7fda7effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda8009e930 0x7fda801a68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42568/0 (socket says 172.21.15.72:42568) 2023-10-03T10:13:49.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.088+0000 7fda7effd700 1 -- 172.21.15.72:0/636618469 learned_addr learned my addr 172.21.15.72:0/636618469 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:49.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.088+0000 7fda7e7fc700 1 --2- 172.21.15.72:0/636618469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8009f240 0x7fda801a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.089+0000 7fda7f7fe700 1 --2- 172.21.15.72:0/636618469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda8009f650 0x7fda801c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.089+0000 7fda7e7fc700 1 -- 172.21.15.72:0/636618469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda8009f650 msgr2=0x7fda801c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.089+0000 7fda7e7fc700 1 --2- 172.21.15.72:0/636618469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda8009f650 0x7fda801c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.089+0000 7fda7e7fc700 1 -- 172.21.15.72:0/636618469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda8009e930 msgr2=0x7fda801a68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.089+0000 7fda7e7fc700 1 --2- 172.21.15.72:0/636618469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda8009e930 0x7fda801a68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.089+0000 7fda7e7fc700 1 -- 172.21.15.72:0/636618469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda70009550 con 0x7fda8009f240 2023-10-03T10:13:49.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.089+0000 7fda7f7fe700 1 --2- 172.21.15.72:0/636618469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda8009f650 0x7fda801c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:49.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.089+0000 7fda7e7fc700 1 --2- 172.21.15.72:0/636618469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8009f240 0x7fda801a6de0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fda7400e980 tx=0x7fda7400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.089+0000 7fda67fff700 1 -- 172.21.15.72:0/636618469 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7400c690 con 0x7fda8009f240 2023-10-03T10:13:49.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.089+0000 7fda67fff700 1 -- 172.21.15.72:0/636618469 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7400c7f0 con 0x7fda8009f240 2023-10-03T10:13:49.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.089+0000 7fda67fff700 1 -- 172.21.15.72:0/636618469 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7400cb80 con 0x7fda8009f240 2023-10-03T10:13:49.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.089+0000 7fda8582d700 1 -- 172.21.15.72:0/636618469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda740094a0 con 0x7fda8009f240 2023-10-03T10:13:49.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.089+0000 7fda8582d700 1 -- 172.21.15.72:0/636618469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda78009a70 con 0x7fda8009f240 2023-10-03T10:13:49.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.090+0000 7fda67fff700 1 -- 172.21.15.72:0/636618469 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda7400cce0 con 0x7fda8009f240 2023-10-03T10:13:49.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.091+0000 7fda8582d700 1 -- 172.21.15.72:0/636618469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda80074ea0 con 0x7fda8009f240 2023-10-03T10:13:49.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.091+0000 7fda67fff700 1 -- 172.21.15.72:0/636618469 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fda7403f6e0 con 0x7fda8009f240 2023-10-03T10:13:49.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.095+0000 7fda67fff700 1 -- 172.21.15.72:0/636618469 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda7401bdf0 con 0x7fda8009f240 2023-10-03T10:13:49.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.112+0000 7f6268c66700 1 Processor -- start 2023-10-03T10:13:49.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.112+0000 7f6268c66700 1 -- start start 2023-10-03T10:13:49.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f6268c66700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f626409d6f0 0x7f626409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f6268c66700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f626409e000 0x7f62641339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f6268c66700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f626409e410 0x7f6264133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f6268c66700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626406b460 con 0x7f626409d6f0 2023-10-03T10:13:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f6268c66700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626409b120 con 0x7f626409e410 2023-10-03T10:13:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f6268c66700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f626409a7e0 con 0x7f626409e000 2023-10-03T10:13:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f626259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f626409d6f0 0x7f626409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f626259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f626409d6f0 0x7f626409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43514/0 (socket says 172.21.15.72:43514) 2023-10-03T10:13:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f626259c700 1 -- 172.21.15.72:0/2715298584 learned_addr learned my addr 172.21.15.72:0/2715298584 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f6261d9b700 1 --2- 172.21.15.72:0/2715298584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f626409e000 0x7f62641339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f6262d9d700 1 --2- 172.21.15.72:0/2715298584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f626409e410 0x7f6264133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f626259c700 1 -- 172.21.15.72:0/2715298584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f626409e000 msgr2=0x7f62641339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f626259c700 1 --2- 172.21.15.72:0/2715298584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f626409e000 0x7f62641339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f626259c700 1 -- 172.21.15.72:0/2715298584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f626409e410 msgr2=0x7f6264133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:49.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f626259c700 1 --2- 172.21.15.72:0/2715298584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f626409e410 0x7f6264133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.113+0000 7f626259c700 1 -- 172.21.15.72:0/2715298584 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626409a500 con 0x7f626409d6f0 2023-10-03T10:13:49.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.114+0000 7f626259c700 1 --2- 172.21.15.72:0/2715298584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f626409d6f0 0x7f626409dac0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f62540098f0 tx=0x7f6254009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0ddcf8b416b000 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.114+0000 7f626159a700 1 -- 172.21.15.72:0/2715298584 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254011830 con 0x7f626409d6f0 2023-10-03T10:13:49.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.114+0000 7f626159a700 1 -- 172.21.15.72:0/2715298584 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6254011990 con 0x7f626409d6f0 2023-10-03T10:13:49.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.114+0000 7f626159a700 1 -- 172.21.15.72:0/2715298584 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254011d20 con 0x7f626409d6f0 2023-10-03T10:13:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.114+0000 7f6268c66700 1 -- 172.21.15.72:0/2715298584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f626409d6f0 msgr2=0x7f626409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.114+0000 7f6268c66700 1 --2- 172.21.15.72:0/2715298584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f626409d6f0 0x7f626409dac0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f62540098f0 tx=0x7f6254009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.115+0000 7f6268c66700 1 -- 172.21.15.72:0/2715298584 shutdown_connections 2023-10-03T10:13:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.115+0000 7f6268c66700 1 --2- 172.21.15.72:0/2715298584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f626409e410 0x7f6264133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.115+0000 7f6268c66700 1 --2- 172.21.15.72:0/2715298584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f626409d6f0 0x7f626409dac0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.115+0000 7f6268c66700 1 --2- 172.21.15.72:0/2715298584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f626409e000 0x7f62641339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.115+0000 7f6268c66700 1 -- 172.21.15.72:0/2715298584 >> 172.21.15.72:0/2715298584 conn(0x7f6264066f50 msgr2=0x7f626409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.115+0000 7f6268c66700 1 -- 172.21.15.72:0/2715298584 shutdown_connections 2023-10-03T10:13:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.115+0000 7f6268c66700 1 -- 172.21.15.72:0/2715298584 wait complete. 2023-10-03T10:13:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.116+0000 7f6268c66700 1 Processor -- start 2023-10-03T10:13:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.116+0000 7f6268c66700 1 -- start start 2023-10-03T10:13:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.116+0000 7f6268c66700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f626409d6f0 0x7f62641c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.116+0000 7f6268c66700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f626409e000 0x7f62641c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.116+0000 7f6268c66700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f626409e410 0x7f62641c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.116+0000 7f6268c66700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62641a65a0 con 0x7f626409e000 2023-10-03T10:13:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.116+0000 7f6268c66700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62641a63b0 con 0x7f626409d6f0 2023-10-03T10:13:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.116+0000 7f6268c66700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62641a82c0 con 0x7f626409e410 2023-10-03T10:13:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.117+0000 7f6261d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f626409e000 0x7f62641c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.117+0000 7f6261d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f626409e000 0x7f62641c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43530/0 (socket says 172.21.15.72:43530) 2023-10-03T10:13:49.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.117+0000 7f626259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f626409d6f0 0x7f62641c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.117+0000 7f6261d9b700 1 -- 172.21.15.72:0/1901393972 learned_addr learned my addr 172.21.15.72:0/1901393972 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:49.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.117+0000 7f6262d9d700 1 --2- 172.21.15.72:0/1901393972 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f626409e410 0x7f62641c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:49.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.117+0000 7f626259c700 1 -- 172.21.15.72:0/1901393972 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f626409e410 msgr2=0x7f62641c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.117+0000 7f626259c700 1 --2- 172.21.15.72:0/1901393972 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f626409e410 0x7f62641c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.117+0000 7f626259c700 1 -- 172.21.15.72:0/1901393972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f626409e000 msgr2=0x7f62641c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.117+0000 7f626259c700 1 --2- 172.21.15.72:0/1901393972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f626409e000 0x7f62641c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.117+0000 7f626259c700 1 -- 172.21.15.72:0/1901393972 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6254009550 con 0x7f626409d6f0 2023-10-03T10:13:49.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.117+0000 7f6261d9b700 1 --2- 172.21.15.72:0/1901393972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f626409e000 0x7f62641c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:49.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.117+0000 7f626259c700 1 --2- 172.21.15.72:0/1901393972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f626409d6f0 0x7f62641c8040 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f62540098f0 tx=0x7f6254004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:49.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.117+0000 7f6252ffd700 1 -- 172.21.15.72:0/1901393972 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254004300 con 0x7f626409d6f0 2023-10-03T10:13:49.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.117+0000 7f6252ffd700 1 -- 172.21.15.72:0/1901393972 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625401f070 con 0x7f626409d6f0 2023-10-03T10:13:49.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.117+0000 7f6252ffd700 1 -- 172.21.15.72:0/1901393972 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62540036a0 con 0x7f626409d6f0 2023-10-03T10:13:49.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.118+0000 7f6268c66700 1 -- 172.21.15.72:0/1901393972 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62640a1f70 con 0x7f626409d6f0 2023-10-03T10:13:49.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.118+0000 7f6268c66700 1 -- 172.21.15.72:0/1901393972 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62641a7fe0 con 0x7f626409d6f0 2023-10-03T10:13:49.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.119+0000 7f6268c66700 1 -- 172.21.15.72:0/1901393972 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62641a7e40 con 0x7f626409d6f0 2023-10-03T10:13:49.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.119+0000 7f6252ffd700 1 -- 172.21.15.72:0/1901393972 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6254021030 con 0x7f626409d6f0 2023-10-03T10:13:49.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.120+0000 7f6252ffd700 1 -- 172.21.15.72:0/1901393972 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6254040830 con 0x7f626409d6f0 2023-10-03T10:13:49.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.128+0000 7f6252ffd700 1 -- 172.21.15.72:0/1901393972 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62641a7e40 con 0x7f626409d6f0 2023-10-03T10:13:49.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.204+0000 7f0fb0df1700 1 -- 172.21.15.72:0/1565758850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0fac06b9e0 con 0x7f0fac09de50 2023-10-03T10:13:49.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.204+0000 7f0f9affd700 1 -- 172.21.15.72:0/1565758850 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f9c010310 con 0x7f0fac09de50 2023-10-03T10:13:49.205 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:49.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.206+0000 7f0fb0df1700 1 -- 172.21.15.72:0/1565758850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fac09de50 msgr2=0x7f0fac11d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.206+0000 7f0fb0df1700 1 --2- 172.21.15.72:0/1565758850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fac09de50 0x7f0fac11d690 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00e810 tx=0x7f0f9c00eb20 comp rx=0 tx=0).stop 2023-10-03T10:13:49.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.206+0000 7f0fb0df1700 1 -- 172.21.15.72:0/1565758850 shutdown_connections 2023-10-03T10:13:49.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.206+0000 7f0fb0df1700 1 --2- 172.21.15.72:0/1565758850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fac1338a0 0x7f0fac11e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.206+0000 7f0fb0df1700 1 --2- 172.21.15.72:0/1565758850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fac09de50 0x7f0fac11d690 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.206+0000 7f0fb0df1700 1 --2- 172.21.15.72:0/1565758850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fac09e760 0x7f0fac11dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.206+0000 7f0fb0df1700 1 -- 172.21.15.72:0/1565758850 >> 172.21.15.72:0/1565758850 conn(0x7f0fac0a2aa0 msgr2=0x7f0fac1b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.206+0000 7f0fb0df1700 1 -- 172.21.15.72:0/1565758850 shutdown_connections 2023-10-03T10:13:49.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.206+0000 7f0fb0df1700 1 -- 172.21.15.72:0/1565758850 wait complete. 2023-10-03T10:13:49.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:49.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.254+0000 7f01cc37c700 1 -- 172.21.15.72:0/3794015822 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f01c406b9e0 con 0x7f01c406fcf0 2023-10-03T10:13:49.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.254+0000 7f01baffd700 1 -- 172.21.15.72:0/3794015822 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f01c0003a00 con 0x7f01c406fcf0 2023-10-03T10:13:49.255 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:49.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.256+0000 7f01cc37c700 1 -- 172.21.15.72:0/3794015822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01c406fcf0 msgr2=0x7f01c406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.256+0000 7f01cc37c700 1 --2- 172.21.15.72:0/3794015822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01c406fcf0 0x7f01c406e4d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f01c0016000 tx=0x7f01c0004750 comp rx=0 tx=0).stop 2023-10-03T10:13:49.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.257+0000 7f01cc37c700 1 -- 172.21.15.72:0/3794015822 shutdown_connections 2023-10-03T10:13:49.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.257+0000 7f01cc37c700 1 --2- 172.21.15.72:0/3794015822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c4130e50 0x7f01c406ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.257+0000 7f01cc37c700 1 --2- 172.21.15.72:0/3794015822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01c406fcf0 0x7f01c406e4d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.257+0000 7f01cc37c700 1 --2- 172.21.15.72:0/3794015822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c4130540 0x7f01c406ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.257+0000 7f01cc37c700 1 -- 172.21.15.72:0/3794015822 >> 172.21.15.72:0/3794015822 conn(0x7f01c40a2aa0 msgr2=0x7f01c412d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.257+0000 7f01cc37c700 1 -- 172.21.15.72:0/3794015822 shutdown_connections 2023-10-03T10:13:49.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.257+0000 7f01cc37c700 1 -- 172.21.15.72:0/3794015822 wait complete. 2023-10-03T10:13:49.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:49.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.292+0000 7fda8582d700 1 -- 172.21.15.72:0/636618469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fda801a6270 con 0x7fda8009f240 2023-10-03T10:13:49.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.293+0000 7fda67fff700 1 -- 172.21.15.72:0/636618469 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fda74021070 con 0x7fda8009f240 2023-10-03T10:13:49.293 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:49.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.295+0000 7fda8582d700 1 -- 172.21.15.72:0/636618469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8009f240 msgr2=0x7fda801a6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.295+0000 7fda8582d700 1 --2- 172.21.15.72:0/636618469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8009f240 0x7fda801a6de0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fda7400e980 tx=0x7fda7400ec90 comp rx=0 tx=0).stop 2023-10-03T10:13:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.295+0000 7fda8582d700 1 -- 172.21.15.72:0/636618469 shutdown_connections 2023-10-03T10:13:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.295+0000 7fda8582d700 1 --2- 172.21.15.72:0/636618469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda8009f650 0x7fda801c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.295+0000 7fda8582d700 1 --2- 172.21.15.72:0/636618469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda8009e930 0x7fda801a68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.295+0000 7fda8582d700 1 --2- 172.21.15.72:0/636618469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8009f240 0x7fda801a6de0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.295+0000 7fda8582d700 1 -- 172.21.15.72:0/636618469 >> 172.21.15.72:0/636618469 conn(0x7fda800a4210 msgr2=0x7fda801bae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.295+0000 7fda8582d700 1 -- 172.21.15.72:0/636618469 shutdown_connections 2023-10-03T10:13:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.295+0000 7fda8582d700 1 -- 172.21.15.72:0/636618469 wait complete. 2023-10-03T10:13:49.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:49.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.323+0000 7f6268c66700 1 -- 172.21.15.72:0/1901393972 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f62641a7e40 con 0x7f626409d6f0 2023-10-03T10:13:49.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.323+0000 7f6252ffd700 1 -- 172.21.15.72:0/1901393972 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f62641a7e40 con 0x7f626409d6f0 2023-10-03T10:13:49.324 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:49.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.325+0000 7f6268c66700 1 -- 172.21.15.72:0/1901393972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f626409d6f0 msgr2=0x7f62641c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:49.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.325+0000 7f6268c66700 1 --2- 172.21.15.72:0/1901393972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f626409d6f0 0x7f62641c8040 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f62540098f0 tx=0x7f6254004750 comp rx=0 tx=0).stop 2023-10-03T10:13:49.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.325+0000 7f6268c66700 1 -- 172.21.15.72:0/1901393972 shutdown_connections 2023-10-03T10:13:49.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.325+0000 7f6268c66700 1 --2- 172.21.15.72:0/1901393972 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f626409e410 0x7f62641c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.325+0000 7f6268c66700 1 --2- 172.21.15.72:0/1901393972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f626409d6f0 0x7f62641c8040 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.325+0000 7f6268c66700 1 --2- 172.21.15.72:0/1901393972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f626409e000 0x7f62641c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:49.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.325+0000 7f6268c66700 1 -- 172.21.15.72:0/1901393972 >> 172.21.15.72:0/1901393972 conn(0x7f6264066f50 msgr2=0x7f62641bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:49.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.325+0000 7f6268c66700 1 -- 172.21.15.72:0/1901393972 shutdown_connections 2023-10-03T10:13:49.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:49.326+0000 7f6268c66700 1 -- 172.21.15.72:0/1901393972 wait complete. 2023-10-03T10:13:49.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:50.220 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:50.270 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:50.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:50.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.358+0000 7f703b81c700 1 Processor -- start 2023-10-03T10:13:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.358+0000 7f703b81c700 1 -- start start 2023-10-03T10:13:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.358+0000 7f703b81c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f703412cf60 0x7f703406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.358+0000 7f703b81c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7034130430 0x7f7034137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.358+0000 7f703b81c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703412cd90 con 0x7f703412f8b0 2023-10-03T10:13:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.358+0000 7f703b81c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703412d330 con 0x7f7034130430 2023-10-03T10:13:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.358+0000 7f703b81c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7034071780 con 0x7f703412cf60 2023-10-03T10:13:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.358+0000 7f70395b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f703412cf60 0x7f703406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.358+0000 7f70395b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f703412cf60 0x7f703406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42600/0 (socket says 172.21.15.72:42600) 2023-10-03T10:13:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.358+0000 7f7039db9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7034130430 0x7f7034137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.358+0000 7f70395b8700 1 -- 172.21.15.72:0/3842190685 learned_addr learned my addr 172.21.15.72:0/3842190685 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.359+0000 7f70395b8700 1 -- 172.21.15.72:0/3842190685 >> v2:172.21.15.72:3300/0 conn(0x7f7034130430 msgr2=0x7f7034137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.359+0000 7f70395b8700 1 --2- 172.21.15.72:0/3842190685 >> v2:172.21.15.72:3300/0 conn(0x7f7034130430 0x7f7034137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.359+0000 7f70395b8700 1 -- 172.21.15.72:0/3842190685 >> v1:172.21.15.72:6789/0 conn(0x7f703412f8b0 legacy=0x7f703412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.359+0000 7f70395b8700 1 -- 172.21.15.72:0/3842190685 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7034071a40 con 0x7f703412cf60 2023-10-03T10:13:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.359+0000 7f70395b8700 1 --2- 172.21.15.72:0/3842190685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f703412cf60 0x7f703406f5d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f70300098f0 tx=0x7f7030009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb781469232ab07c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.359+0000 7f702bfff700 1 -- 172.21.15.72:0/3842190685 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030011830 con 0x7f703412cf60 2023-10-03T10:13:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.359+0000 7f702bfff700 1 -- 172.21.15.72:0/3842190685 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7030011990 con 0x7f703412cf60 2023-10-03T10:13:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.359+0000 7f702bfff700 1 -- 172.21.15.72:0/3842190685 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030011d20 con 0x7f703412cf60 2023-10-03T10:13:50.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.360+0000 7f703b81c700 1 -- 172.21.15.72:0/3842190685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f703412cf60 msgr2=0x7f703406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.360+0000 7f703b81c700 1 --2- 172.21.15.72:0/3842190685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f703412cf60 0x7f703406f5d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f70300098f0 tx=0x7f7030009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.360+0000 7f703b81c700 1 -- 172.21.15.72:0/3842190685 shutdown_connections 2023-10-03T10:13:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.360+0000 7f703b81c700 1 --2- 172.21.15.72:0/3842190685 >> v2:172.21.15.72:3300/0 conn(0x7f7034130430 0x7f7034137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.360+0000 7f703b81c700 1 --2- 172.21.15.72:0/3842190685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f703412cf60 0x7f703406f5d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.360+0000 7f703b81c700 1 -- 172.21.15.72:0/3842190685 >> 172.21.15.72:0/3842190685 conn(0x7f70340a2aa0 msgr2=0x7f70340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.360+0000 7f703b81c700 1 -- 172.21.15.72:0/3842190685 shutdown_connections 2023-10-03T10:13:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.360+0000 7f703b81c700 1 -- 172.21.15.72:0/3842190685 wait complete. 2023-10-03T10:13:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.361+0000 7f703b81c700 1 Processor -- start 2023-10-03T10:13:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.361+0000 7f703b81c700 1 -- start start 2023-10-03T10:13:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f703b81c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f703412f8b0 0x7f703411d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f703b81c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7034130430 0x7f703411d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f703b81c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f703411db60 0x7f70341c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f703b81c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703411e740 con 0x7f7034130430 2023-10-03T10:13:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f703b81c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70340a0580 con 0x7f703411db60 2023-10-03T10:13:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f703b81c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7034129fa0 con 0x7f703412f8b0 2023-10-03T10:13:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f70395b8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f703412f8b0 0x7f703411d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f70395b8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f703412f8b0 0x7f703411d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57408/0 (socket says 172.21.15.72:57408) 2023-10-03T10:13:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f70395b8700 1 -- 172.21.15.72:0/445311783 learned_addr learned my addr 172.21.15.72:0/445311783 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f7039db9700 1 --2- 172.21.15.72:0/445311783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f703411db60 0x7f70341c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f7038db7700 1 --2- 172.21.15.72:0/445311783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7034130430 0x7f703411d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f7039db9700 1 -- 172.21.15.72:0/445311783 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f703412f8b0 msgr2=0x7f703411d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f7039db9700 1 --2- 172.21.15.72:0/445311783 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f703412f8b0 0x7f703411d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f7039db9700 1 -- 172.21.15.72:0/445311783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7034130430 msgr2=0x7f703411d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f7039db9700 1 --2- 172.21.15.72:0/445311783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7034130430 0x7f703411d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f7039db9700 1 -- 172.21.15.72:0/445311783 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030009550 con 0x7f703411db60 2023-10-03T10:13:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f70395b8700 1 --2- 172.21.15.72:0/445311783 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f703412f8b0 0x7f703411d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.362+0000 7f7039db9700 1 --2- 172.21.15.72:0/445311783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f703411db60 0x7f70341c8a30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f702c009e00 tx=0x7f702c0074d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.363+0000 7f7029ffb700 1 -- 172.21.15.72:0/445311783 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00add0 con 0x7f703411db60 2023-10-03T10:13:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.363+0000 7f7029ffb700 1 -- 172.21.15.72:0/445311783 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c010040 con 0x7f703411db60 2023-10-03T10:13:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.363+0000 7f7029ffb700 1 -- 172.21.15.72:0/445311783 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c007bf0 con 0x7f703411db60 2023-10-03T10:13:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.363+0000 7f703b81c700 1 -- 172.21.15.72:0/445311783 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7034120240 con 0x7f703411db60 2023-10-03T10:13:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.363+0000 7f703b81c700 1 -- 172.21.15.72:0/445311783 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703409eaa0 con 0x7f703411db60 2023-10-03T10:13:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.364+0000 7f7029ffb700 1 -- 172.21.15.72:0/445311783 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f702c007d50 con 0x7f703411db60 2023-10-03T10:13:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.364+0000 7f703b81c700 1 -- 172.21.15.72:0/445311783 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7034074ea0 con 0x7f703411db60 2023-10-03T10:13:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.364+0000 7f7029ffb700 1 -- 172.21.15.72:0/445311783 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f702c045060 con 0x7f703411db60 2023-10-03T10:13:50.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.369+0000 7f7029ffb700 1 -- 172.21.15.72:0/445311783 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f702c01b2c0 con 0x7f703411db60 2023-10-03T10:13:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.415+0000 7fefc9ff2700 1 Processor -- start 2023-10-03T10:13:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.415+0000 7fefc9ff2700 1 -- start start 2023-10-03T10:13:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.415+0000 7fefc9ff2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fefc409e1d0 0x7fefc4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.415+0000 7fefc9ff2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefc4139170 0x7fefc413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.415+0000 7fefc9ff2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc409b120 con 0x7fefc409d6f0 2023-10-03T10:13:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.415+0000 7fefc9ff2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc406b460 con 0x7fefc409e1d0 2023-10-03T10:13:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.415+0000 7fefc9ff2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc409a7e0 con 0x7fefc4139170 2023-10-03T10:13:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.416+0000 7fefc3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefc4139170 0x7fefc413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.416+0000 7fefc2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fefc409e1d0 0x7fefc4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.416+0000 7fefc2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fefc409e1d0 0x7fefc4138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43558/0 (socket says 172.21.15.72:43558) 2023-10-03T10:13:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.416+0000 7fefc3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefc4139170 0x7fefc413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42620/0 (socket says 172.21.15.72:42620) 2023-10-03T10:13:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.416+0000 7fefc2ffd700 1 -- 172.21.15.72:0/2167195358 learned_addr learned my addr 172.21.15.72:0/2167195358 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.416+0000 7fefc3fff700 1 -- 172.21.15.72:0/2167195358 >> v2:172.21.15.72:3300/0 conn(0x7fefc409e1d0 msgr2=0x7fefc4138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.416+0000 7fefc3fff700 1 --2- 172.21.15.72:0/2167195358 >> v2:172.21.15.72:3300/0 conn(0x7fefc409e1d0 0x7fefc4138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.416+0000 7fefc3fff700 1 -- 172.21.15.72:0/2167195358 >> v1:172.21.15.72:6789/0 conn(0x7fefc409d6f0 legacy=0x7fefc409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.416+0000 7fefc3fff700 1 -- 172.21.15.72:0/2167195358 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc409a500 con 0x7fefc4139170 2023-10-03T10:13:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.416+0000 7fefc3fff700 1 --2- 172.21.15.72:0/2167195358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefc4139170 0x7fefc413b550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009dc0 tx=0x7fefbc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4459d5b3ba8150e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.416+0000 7fefc27fc700 1 -- 172.21.15.72:0/2167195358 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc00e070 con 0x7fefc4139170 2023-10-03T10:13:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.416+0000 7fefc27fc700 1 -- 172.21.15.72:0/2167195358 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefbc00bae0 con 0x7fefc4139170 2023-10-03T10:13:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.416+0000 7fefc27fc700 1 -- 172.21.15.72:0/2167195358 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc00be90 con 0x7fefc4139170 2023-10-03T10:13:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.417+0000 7fefc9ff2700 1 -- 172.21.15.72:0/2167195358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefc4139170 msgr2=0x7fefc413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.417+0000 7fefc9ff2700 1 --2- 172.21.15.72:0/2167195358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefc4139170 0x7fefc413b550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009dc0 tx=0x7fefbc00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.417+0000 7fefc9ff2700 1 -- 172.21.15.72:0/2167195358 shutdown_connections 2023-10-03T10:13:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.417+0000 7fefc9ff2700 1 --2- 172.21.15.72:0/2167195358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefc4139170 0x7fefc413b550 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.417+0000 7fefc9ff2700 1 --2- 172.21.15.72:0/2167195358 >> v2:172.21.15.72:3300/0 conn(0x7fefc409e1d0 0x7fefc4138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.417+0000 7fefc9ff2700 1 -- 172.21.15.72:0/2167195358 >> 172.21.15.72:0/2167195358 conn(0x7fefc4066f50 msgr2=0x7fefc409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.417+0000 7fefc9ff2700 1 -- 172.21.15.72:0/2167195358 shutdown_connections 2023-10-03T10:13:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.417+0000 7fefc9ff2700 1 -- 172.21.15.72:0/2167195358 wait complete. 2023-10-03T10:13:50.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.419+0000 7fefc9ff2700 1 Processor -- start 2023-10-03T10:13:50.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.419+0000 7fefc9ff2700 1 -- start start 2023-10-03T10:13:50.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc9ff2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefc409d6f0 0x7fefc411e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc9ff2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefc409e1d0 0x7fefc411ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc9ff2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefc4139170 0x7fefc411f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc9ff2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc4121e90 con 0x7fefc4139170 2023-10-03T10:13:50.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc9ff2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc409c710 con 0x7fefc409d6f0 2023-10-03T10:13:50.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc9ff2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefc4120550 con 0x7fefc409e1d0 2023-10-03T10:13:50.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefc409d6f0 0x7fefc411e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefc409d6f0 0x7fefc411e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42634/0 (socket says 172.21.15.72:42634) 2023-10-03T10:13:50.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc37fe700 1 -- 172.21.15.72:0/2496870382 learned_addr learned my addr 172.21.15.72:0/2496870382 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:50.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc3fff700 1 --2- 172.21.15.72:0/2496870382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefc4139170 0x7fefc411f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc37fe700 1 -- 172.21.15.72:0/2496870382 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefc409e1d0 msgr2=0x7fefc411ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc37fe700 1 --2- 172.21.15.72:0/2496870382 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefc409e1d0 0x7fefc411ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc37fe700 1 -- 172.21.15.72:0/2496870382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefc4139170 msgr2=0x7fefc411f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc37fe700 1 --2- 172.21.15.72:0/2496870382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefc4139170 0x7fefc411f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc37fe700 1 -- 172.21.15.72:0/2496870382 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc009a70 con 0x7fefc409d6f0 2023-10-03T10:13:50.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefc37fe700 1 --2- 172.21.15.72:0/2496870382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefc409d6f0 0x7fefc411e8c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c4e0 tx=0x7fefb400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.420+0000 7fefabfff700 1 -- 172.21.15.72:0/2496870382 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb40052d0 con 0x7fefc409d6f0 2023-10-03T10:13:50.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.421+0000 7fefc9ff2700 1 -- 172.21.15.72:0/2496870382 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc40a1a10 con 0x7fefc409d6f0 2023-10-03T10:13:50.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.421+0000 7fefabfff700 1 -- 172.21.15.72:0/2496870382 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb4005430 con 0x7fefc409d6f0 2023-10-03T10:13:50.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.421+0000 7fefabfff700 1 -- 172.21.15.72:0/2496870382 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb40038c0 con 0x7fefc409d6f0 2023-10-03T10:13:50.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.421+0000 7fefc9ff2700 1 -- 172.21.15.72:0/2496870382 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc4120c30 con 0x7fefc409d6f0 2023-10-03T10:13:50.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.422+0000 7fefabfff700 1 -- 172.21.15.72:0/2496870382 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fefb4003a20 con 0x7fefc409d6f0 2023-10-03T10:13:50.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.422+0000 7fefc9ff2700 1 -- 172.21.15.72:0/2496870382 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc4074ea0 con 0x7fefc409d6f0 2023-10-03T10:13:50.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.422+0000 7fefabfff700 1 -- 172.21.15.72:0/2496870382 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fefb403eb50 con 0x7fefc409d6f0 2023-10-03T10:13:50.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.431+0000 7fefabfff700 1 -- 172.21.15.72:0/2496870382 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fefb4018260 con 0x7fefc409d6f0 2023-10-03T10:13:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.450+0000 7f445cce3700 1 Processor -- start 2023-10-03T10:13:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.450+0000 7f445cce3700 1 -- start start 2023-10-03T10:13:50.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f445cce3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445806a770 0x7f445809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f445cce3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445809dc30 0x7f445809e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f445cce3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f445813c1e0 0x7f445813e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f445cce3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445806ab40 con 0x7f445813c1e0 2023-10-03T10:13:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f445cce3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445809ebc0 con 0x7f445809dc30 2023-10-03T10:13:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f445cce3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f445809a810 con 0x7f445806a770 2023-10-03T10:13:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f4456d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f445813c1e0 0x7f445813e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f445659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445806a770 0x7f445809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f4456d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f445813c1e0 0x7f445813e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43576/0 (socket says 172.21.15.72:43576) 2023-10-03T10:13:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f4455d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445809dc30 0x7f445809e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f4456d9d700 1 -- 172.21.15.72:0/1851089692 learned_addr learned my addr 172.21.15.72:0/1851089692 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f4455d9b700 1 -- 172.21.15.72:0/1851089692 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445806a770 msgr2=0x7f445809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f4455d9b700 1 --2- 172.21.15.72:0/1851089692 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445806a770 0x7f445809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f4455d9b700 1 -- 172.21.15.72:0/1851089692 >> v2:172.21.15.72:3300/0 conn(0x7f445813c1e0 msgr2=0x7f445813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f4455d9b700 1 --2- 172.21.15.72:0/1851089692 >> v2:172.21.15.72:3300/0 conn(0x7f445813c1e0 0x7f445813e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.451+0000 7f4455d9b700 1 -- 172.21.15.72:0/1851089692 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445809e920 con 0x7f445809dc30 2023-10-03T10:13:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.452+0000 7f4456d9d700 1 --2- 172.21.15.72:0/1851089692 >> v2:172.21.15.72:3300/0 conn(0x7f445813c1e0 0x7f445813e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.452+0000 7f4455d9b700 1 --2- 172.21.15.72:0/1851089692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445809dc30 0x7f445809e080 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f444c009870 tx=0x7f444c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9b973c615dd9b86 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.452+0000 7f445559a700 1 -- 172.21.15.72:0/1851089692 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c011830 con 0x7f445809dc30 2023-10-03T10:13:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.452+0000 7f445559a700 1 -- 172.21.15.72:0/1851089692 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c011990 con 0x7f445809dc30 2023-10-03T10:13:50.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.452+0000 7f445559a700 1 -- 172.21.15.72:0/1851089692 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c011d20 con 0x7f445809dc30 2023-10-03T10:13:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.453+0000 7f445cce3700 1 -- 172.21.15.72:0/1851089692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445809dc30 msgr2=0x7f445809e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.453+0000 7f445cce3700 1 --2- 172.21.15.72:0/1851089692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445809dc30 0x7f445809e080 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f444c009870 tx=0x7f444c009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.453+0000 7f445cce3700 1 -- 172.21.15.72:0/1851089692 shutdown_connections 2023-10-03T10:13:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.453+0000 7f445cce3700 1 --2- 172.21.15.72:0/1851089692 >> v2:172.21.15.72:3300/0 conn(0x7f445813c1e0 0x7f445813e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.453+0000 7f445cce3700 1 --2- 172.21.15.72:0/1851089692 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445806a770 0x7f445809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.453+0000 7f445cce3700 1 --2- 172.21.15.72:0/1851089692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445809dc30 0x7f445809e080 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.453+0000 7f445cce3700 1 -- 172.21.15.72:0/1851089692 >> 172.21.15.72:0/1851089692 conn(0x7f4458066f50 msgr2=0x7f445809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.453+0000 7f445cce3700 1 -- 172.21.15.72:0/1851089692 shutdown_connections 2023-10-03T10:13:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.453+0000 7f445cce3700 1 -- 172.21.15.72:0/1851089692 wait complete. 2023-10-03T10:13:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.454+0000 7f445cce3700 1 Processor -- start 2023-10-03T10:13:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.454+0000 7f445cce3700 1 -- start start 2023-10-03T10:13:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.455+0000 7f445cce3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445806a770 0x7f4458126cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.455+0000 7f445cce3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f445809dc30 0x7f4458127200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.455+0000 7f445cce3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445813c1e0 0x7f44581cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.455+0000 7f445cce3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4458129df0 con 0x7f445809dc30 2023-10-03T10:13:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.455+0000 7f445cce3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445813ac60 con 0x7f445813c1e0 2023-10-03T10:13:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.455+0000 7f445cce3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4458126820 con 0x7f445806a770 2023-10-03T10:13:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.455+0000 7f4455d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f445809dc30 0x7f4458127200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.455+0000 7f445659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445806a770 0x7f4458126cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.455+0000 7f445659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445806a770 0x7f4458126cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57432/0 (socket says 172.21.15.72:57432) 2023-10-03T10:13:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.455+0000 7f4455d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f445809dc30 0x7f4458127200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43588/0 (socket says 172.21.15.72:43588) 2023-10-03T10:13:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.455+0000 7f445659c700 1 -- 172.21.15.72:0/1244491696 learned_addr learned my addr 172.21.15.72:0/1244491696 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.455+0000 7f4456d9d700 1 --2- 172.21.15.72:0/1244491696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445813c1e0 0x7f44581cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.456+0000 7f445659c700 1 -- 172.21.15.72:0/1244491696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445813c1e0 msgr2=0x7f44581cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.456+0000 7f445659c700 1 --2- 172.21.15.72:0/1244491696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445813c1e0 0x7f44581cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.456+0000 7f445659c700 1 -- 172.21.15.72:0/1244491696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f445809dc30 msgr2=0x7f4458127200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.456+0000 7f445659c700 1 --2- 172.21.15.72:0/1244491696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f445809dc30 0x7f4458127200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.456+0000 7f445659c700 1 -- 172.21.15.72:0/1244491696 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4450009b30 con 0x7f445806a770 2023-10-03T10:13:50.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.456+0000 7f445659c700 1 --2- 172.21.15.72:0/1244491696 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445806a770 0x7f4458126cc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f444800e9e0 tx=0x7f444800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.456+0000 7f4446ffd700 1 -- 172.21.15.72:0/1244491696 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444800ee80 con 0x7f445806a770 2023-10-03T10:13:50.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.456+0000 7f4446ffd700 1 -- 172.21.15.72:0/1244491696 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444800c850 con 0x7f445806a770 2023-10-03T10:13:50.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.456+0000 7f445cce3700 1 -- 172.21.15.72:0/1244491696 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444c0094a0 con 0x7f445806a770 2023-10-03T10:13:50.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.456+0000 7f4446ffd700 1 -- 172.21.15.72:0/1244491696 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444800cbc0 con 0x7f445806a770 2023-10-03T10:13:50.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.456+0000 7f445cce3700 1 -- 172.21.15.72:0/1244491696 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4458127740 con 0x7f445806a770 2023-10-03T10:13:50.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.457+0000 7f4446ffd700 1 -- 172.21.15.72:0/1244491696 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f444800cd20 con 0x7f445806a770 2023-10-03T10:13:50.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.457+0000 7f445cce3700 1 -- 172.21.15.72:0/1244491696 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4458128730 con 0x7f445806a770 2023-10-03T10:13:50.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.457+0000 7f4446ffd700 1 -- 172.21.15.72:0/1244491696 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f444803f690 con 0x7f445806a770 2023-10-03T10:13:50.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.466+0000 7f4446ffd700 1 -- 172.21.15.72:0/1244491696 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44480232f0 con 0x7f445806a770 2023-10-03T10:13:50.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.499+0000 7fb81148b700 1 Processor -- start 2023-10-03T10:13:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.499+0000 7fb81148b700 1 -- start start 2023-10-03T10:13:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.499+0000 7fb81148b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb80c09d6f0 0x7fb80c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.499+0000 7fb81148b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb80c09e000 0x7fb80c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.499+0000 7fb81148b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80c09e410 0x7fb80c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.499+0000 7fb81148b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb80c09f520 con 0x7fb80c09e000 2023-10-03T10:13:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.499+0000 7fb81148b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c09f130 con 0x7fb80c09d6f0 2023-10-03T10:13:50.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.499+0000 7fb81148b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c09e930 con 0x7fb80c09e410 2023-10-03T10:13:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb80a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb80c09e000 0x7fb80c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb80affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb80c09d6f0 0x7fb80c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb80a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb80c09e000 0x7fb80c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43592/0 (socket says 172.21.15.72:43592) 2023-10-03T10:13:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb80a7fc700 1 -- 172.21.15.72:0/3416443877 learned_addr learned my addr 172.21.15.72:0/3416443877 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb80affd700 1 --2- 172.21.15.72:0/3416443877 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb80c09d6f0 0x7fb80c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42664/0 (socket says 172.21.15.72:42664) 2023-10-03T10:13:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb80b7fe700 1 --2- 172.21.15.72:0/3416443877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80c09e410 0x7fb80c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb80affd700 1 -- 172.21.15.72:0/3416443877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80c09e410 msgr2=0x7fb80c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb80affd700 1 --2- 172.21.15.72:0/3416443877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80c09e410 0x7fb80c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb80affd700 1 -- 172.21.15.72:0/3416443877 >> v2:172.21.15.72:3300/0 conn(0x7fb80c09e000 msgr2=0x7fb80c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb80affd700 1 --2- 172.21.15.72:0/3416443877 >> v2:172.21.15.72:3300/0 conn(0x7fb80c09e000 0x7fb80c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb80affd700 1 -- 172.21.15.72:0/3416443877 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c09b2d0 con 0x7fb80c09d6f0 2023-10-03T10:13:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb80a7fc700 1 --2- 172.21.15.72:0/3416443877 >> v2:172.21.15.72:3300/0 conn(0x7fb80c09e000 0x7fb80c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb80affd700 1 --2- 172.21.15.72:0/3416443877 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb80c09d6f0 0x7fb80c09dac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009840 tx=0x7fb7fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b41a61518f770bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb809ffb700 1 -- 172.21.15.72:0/3416443877 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc011830 con 0x7fb80c09d6f0 2023-10-03T10:13:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb809ffb700 1 -- 172.21.15.72:0/3416443877 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc011990 con 0x7fb80c09d6f0 2023-10-03T10:13:50.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.500+0000 7fb809ffb700 1 -- 172.21.15.72:0/3416443877 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc011d20 con 0x7fb80c09d6f0 2023-10-03T10:13:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.501+0000 7fb81148b700 1 -- 172.21.15.72:0/3416443877 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb80c09d6f0 msgr2=0x7fb80c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.501+0000 7fb81148b700 1 --2- 172.21.15.72:0/3416443877 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb80c09d6f0 0x7fb80c09dac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009840 tx=0x7fb7fc009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.501+0000 7fb81148b700 1 -- 172.21.15.72:0/3416443877 shutdown_connections 2023-10-03T10:13:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.501+0000 7fb81148b700 1 --2- 172.21.15.72:0/3416443877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80c09e410 0x7fb80c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.501+0000 7fb81148b700 1 --2- 172.21.15.72:0/3416443877 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb80c09d6f0 0x7fb80c09dac0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.501+0000 7fb81148b700 1 --2- 172.21.15.72:0/3416443877 >> v2:172.21.15.72:3300/0 conn(0x7fb80c09e000 0x7fb80c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.501+0000 7fb81148b700 1 -- 172.21.15.72:0/3416443877 >> 172.21.15.72:0/3416443877 conn(0x7fb80c066f50 msgr2=0x7fb80c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.501+0000 7fb81148b700 1 -- 172.21.15.72:0/3416443877 shutdown_connections 2023-10-03T10:13:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.501+0000 7fb81148b700 1 -- 172.21.15.72:0/3416443877 wait complete. 2023-10-03T10:13:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.502+0000 7fb81148b700 1 Processor -- start 2023-10-03T10:13:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.503+0000 7fb81148b700 1 -- start start 2023-10-03T10:13:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.503+0000 7fb81148b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb80c09d6f0 0x7fb80c1221e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.503+0000 7fb81148b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb80c09e000 0x7fb80c122720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.503+0000 7fb81148b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80c09e410 0x7fb80c122c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.503+0000 7fb81148b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c125d00 con 0x7fb80c09e000 2023-10-03T10:13:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.503+0000 7fb81148b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c123df0 con 0x7fb80c09d6f0 2023-10-03T10:13:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.503+0000 7fb81148b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c0a1640 con 0x7fb80c09e410 2023-10-03T10:13:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.503+0000 7fb80a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb80c09e000 0x7fb80c122720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.503+0000 7fb80b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80c09e410 0x7fb80c122c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.503+0000 7fb80affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb80c09d6f0 0x7fb80c1221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.503+0000 7fb80a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb80c09e000 0x7fb80c122720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43600/0 (socket says 172.21.15.72:43600) 2023-10-03T10:13:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.503+0000 7fb80a7fc700 1 -- 172.21.15.72:0/2523330886 learned_addr learned my addr 172.21.15.72:0/2523330886 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.504+0000 7fb80a7fc700 1 -- 172.21.15.72:0/2523330886 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80c09e410 msgr2=0x7fb80c122c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.504+0000 7fb80a7fc700 1 --2- 172.21.15.72:0/2523330886 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80c09e410 0x7fb80c122c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.504+0000 7fb80a7fc700 1 -- 172.21.15.72:0/2523330886 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb80c09d6f0 msgr2=0x7fb80c1221e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.504+0000 7fb80a7fc700 1 --2- 172.21.15.72:0/2523330886 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb80c09d6f0 0x7fb80c1221e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.504+0000 7fb80a7fc700 1 -- 172.21.15.72:0/2523330886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800009550 con 0x7fb80c09e000 2023-10-03T10:13:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.504+0000 7fb80a7fc700 1 --2- 172.21.15.72:0/2523330886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb80c09e000 0x7fb80c122720 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb80000ebb0 tx=0x7fb80000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.504+0000 7fb7f37fe700 1 -- 172.21.15.72:0/2523330886 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800004240 con 0x7fb80c09e000 2023-10-03T10:13:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.504+0000 7fb7f37fe700 1 -- 172.21.15.72:0/2523330886 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8000043a0 con 0x7fb80c09e000 2023-10-03T10:13:50.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.504+0000 7fb81148b700 1 -- 172.21.15.72:0/2523330886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc0094a0 con 0x7fb80c09e000 2023-10-03T10:13:50.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.504+0000 7fb7f37fe700 1 -- 172.21.15.72:0/2523330886 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8000036a0 con 0x7fb80c09e000 2023-10-03T10:13:50.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.504+0000 7fb81148b700 1 -- 172.21.15.72:0/2523330886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80c1245e0 con 0x7fb80c09e000 2023-10-03T10:13:50.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.505+0000 7fb7f37fe700 1 -- 172.21.15.72:0/2523330886 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb800003800 con 0x7fb80c09e000 2023-10-03T10:13:50.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.505+0000 7fb7f37fe700 1 -- 172.21.15.72:0/2523330886 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb80003fa00 con 0x7fb80c09e000 2023-10-03T10:13:50.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.505+0000 7fb81148b700 1 -- 172.21.15.72:0/2523330886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80c074ea0 con 0x7fb80c09e000 2023-10-03T10:13:50.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.514+0000 7fb7f37fe700 1 -- 172.21.15.72:0/2523330886 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb800011350 con 0x7fb80c09e000 2023-10-03T10:13:50.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.582+0000 7f703b81c700 1 -- 172.21.15.72:0/445311783 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f70340713a0 con 0x7f703411db60 2023-10-03T10:13:50.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.582+0000 7f7029ffb700 1 -- 172.21.15.72:0/445311783 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f702c019070 con 0x7f703411db60 2023-10-03T10:13:50.583 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:50.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.585+0000 7f703b81c700 1 -- 172.21.15.72:0/445311783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f703411db60 msgr2=0x7f70341c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.585+0000 7f703b81c700 1 --2- 172.21.15.72:0/445311783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f703411db60 0x7f70341c8a30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f702c009e00 tx=0x7f702c0074d0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.585+0000 7f703b81c700 1 -- 172.21.15.72:0/445311783 shutdown_connections 2023-10-03T10:13:50.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.585+0000 7f703b81c700 1 --2- 172.21.15.72:0/445311783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f703411db60 0x7f70341c8a30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.585+0000 7f703b81c700 1 --2- 172.21.15.72:0/445311783 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f703412f8b0 0x7f703411d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.585+0000 7f703b81c700 1 --2- 172.21.15.72:0/445311783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7034130430 0x7f703411d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.585+0000 7f703b81c700 1 -- 172.21.15.72:0/445311783 >> 172.21.15.72:0/445311783 conn(0x7f70340a2aa0 msgr2=0x7f703412ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.586+0000 7f703b81c700 1 -- 172.21.15.72:0/445311783 shutdown_connections 2023-10-03T10:13:50.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.586+0000 7f703b81c700 1 -- 172.21.15.72:0/445311783 wait complete. 2023-10-03T10:13:50.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:50.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.631+0000 7fefc9ff2700 1 -- 172.21.15.72:0/2496870382 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fefc406c360 con 0x7fefc409d6f0 2023-10-03T10:13:50.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.631+0000 7fefabfff700 1 -- 172.21.15.72:0/2496870382 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fefb4017030 con 0x7fefc409d6f0 2023-10-03T10:13:50.632 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:50.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.633+0000 7fefc9ff2700 1 -- 172.21.15.72:0/2496870382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefc409d6f0 msgr2=0x7fefc411e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.633+0000 7fefc9ff2700 1 --2- 172.21.15.72:0/2496870382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefc409d6f0 0x7fefc411e8c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c4e0 tx=0x7fefb400c7f0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.633+0000 7fefc9ff2700 1 -- 172.21.15.72:0/2496870382 shutdown_connections 2023-10-03T10:13:50.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.633+0000 7fefc9ff2700 1 --2- 172.21.15.72:0/2496870382 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefc4139170 0x7fefc411f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.633+0000 7fefc9ff2700 1 --2- 172.21.15.72:0/2496870382 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefc409d6f0 0x7fefc411e8c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.633+0000 7fefc9ff2700 1 --2- 172.21.15.72:0/2496870382 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefc409e1d0 0x7fefc411ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.633+0000 7fefc9ff2700 1 -- 172.21.15.72:0/2496870382 >> 172.21.15.72:0/2496870382 conn(0x7fefc4066f50 msgr2=0x7fefc409b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.633+0000 7fefc9ff2700 1 -- 172.21.15.72:0/2496870382 shutdown_connections 2023-10-03T10:13:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.633+0000 7fefc9ff2700 1 -- 172.21.15.72:0/2496870382 wait complete. 2023-10-03T10:13:50.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:50.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.685+0000 7f445cce3700 1 -- 172.21.15.72:0/1244491696 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4458074ea0 con 0x7f445806a770 2023-10-03T10:13:50.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.685+0000 7f4446ffd700 1 -- 172.21.15.72:0/1244491696 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4448021070 con 0x7f445806a770 2023-10-03T10:13:50.686 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:50.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.687+0000 7f445cce3700 1 -- 172.21.15.72:0/1244491696 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445806a770 msgr2=0x7f4458126cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.687+0000 7f445cce3700 1 --2- 172.21.15.72:0/1244491696 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445806a770 0x7f4458126cc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f444800e9e0 tx=0x7f444800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.687+0000 7f445cce3700 1 -- 172.21.15.72:0/1244491696 shutdown_connections 2023-10-03T10:13:50.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.687+0000 7f445cce3700 1 --2- 172.21.15.72:0/1244491696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f445813c1e0 0x7f44581cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.687+0000 7f445cce3700 1 --2- 172.21.15.72:0/1244491696 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445806a770 0x7f4458126cc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.687+0000 7f445cce3700 1 --2- 172.21.15.72:0/1244491696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f445809dc30 0x7f4458127200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.687+0000 7f445cce3700 1 -- 172.21.15.72:0/1244491696 >> 172.21.15.72:0/1244491696 conn(0x7f4458066f50 msgr2=0x7f445813b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.687+0000 7f445cce3700 1 -- 172.21.15.72:0/1244491696 shutdown_connections 2023-10-03T10:13:50.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.687+0000 7f445cce3700 1 -- 172.21.15.72:0/1244491696 wait complete. 2023-10-03T10:13:50.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:50.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.722+0000 7fb81148b700 1 -- 172.21.15.72:0/2523330886 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb80c1257d0 con 0x7fb80c09e000 2023-10-03T10:13:50.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.722+0000 7fb7f37fe700 1 -- 172.21.15.72:0/2523330886 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb800013e60 con 0x7fb80c09e000 2023-10-03T10:13:50.723 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:50.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.724+0000 7fb81148b700 1 -- 172.21.15.72:0/2523330886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb80c09e000 msgr2=0x7fb80c122720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.724+0000 7fb81148b700 1 --2- 172.21.15.72:0/2523330886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb80c09e000 0x7fb80c122720 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb80000ebb0 tx=0x7fb80000eec0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.724+0000 7fb81148b700 1 -- 172.21.15.72:0/2523330886 shutdown_connections 2023-10-03T10:13:50.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.724+0000 7fb81148b700 1 --2- 172.21.15.72:0/2523330886 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80c09e410 0x7fb80c122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.724+0000 7fb81148b700 1 --2- 172.21.15.72:0/2523330886 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb80c09d6f0 0x7fb80c1221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.724+0000 7fb81148b700 1 --2- 172.21.15.72:0/2523330886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb80c09e000 0x7fb80c122720 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.724+0000 7fb81148b700 1 -- 172.21.15.72:0/2523330886 >> 172.21.15.72:0/2523330886 conn(0x7fb80c066f50 msgr2=0x7fb80c130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.724+0000 7fb81148b700 1 -- 172.21.15.72:0/2523330886 shutdown_connections 2023-10-03T10:13:50.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:50.724+0000 7fb81148b700 1 -- 172.21.15.72:0/2523330886 wait complete. 2023-10-03T10:13:50.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:51.600 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:51.647 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:51.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.737+0000 7ff9573ae700 1 Processor -- start 2023-10-03T10:13:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.737+0000 7ff9573ae700 1 -- start start 2023-10-03T10:13:51.738 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:51.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.737+0000 7ff9573ae700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9501337f0 0x7ff950138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.737+0000 7ff9573ae700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff950138dc0 0x7ff95013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.737+0000 7ff9573ae700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff95006b990 con 0x7ff950133420 2023-10-03T10:13:51.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.737+0000 7ff9573ae700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff95009b0e0 con 0x7ff9501337f0 2023-10-03T10:13:51.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.737+0000 7ff9573ae700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff950133c20 con 0x7ff950138dc0 2023-10-03T10:13:51.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.737+0000 7ff954949700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9501337f0 0x7ff950138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.737+0000 7ff954949700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9501337f0 0x7ff950138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43606/0 (socket says 172.21.15.72:43606) 2023-10-03T10:13:51.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.737+0000 7ff954949700 1 -- 172.21.15.72:0/3948329144 learned_addr learned my addr 172.21.15.72:0/3948329144 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:51.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.738+0000 7ff95594b700 1 --2- 172.21.15.72:0/3948329144 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff950138dc0 0x7ff95013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.738+0000 7ff954949700 1 -- 172.21.15.72:0/3948329144 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff950138dc0 msgr2=0x7ff95013b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.738+0000 7ff954949700 1 --2- 172.21.15.72:0/3948329144 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff950138dc0 0x7ff95013b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.738+0000 7ff954949700 1 -- 172.21.15.72:0/3948329144 >> v1:172.21.15.72:6789/0 conn(0x7ff950133420 legacy=0x7ff950133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.738+0000 7ff954949700 1 -- 172.21.15.72:0/3948329144 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9500a0590 con 0x7ff9501337f0 2023-10-03T10:13:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.738+0000 7ff954949700 1 --2- 172.21.15.72:0/3948329144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9501337f0 0x7ff950138880 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff9400098f0 tx=0x7ff940009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6997a3021e40d922 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.738+0000 7ff947fff700 1 -- 172.21.15.72:0/3948329144 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940011830 con 0x7ff9501337f0 2023-10-03T10:13:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.738+0000 7ff947fff700 1 -- 172.21.15.72:0/3948329144 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff940011990 con 0x7ff9501337f0 2023-10-03T10:13:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.738+0000 7ff947fff700 1 -- 172.21.15.72:0/3948329144 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940011d20 con 0x7ff9501337f0 2023-10-03T10:13:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.739+0000 7ff9573ae700 1 -- 172.21.15.72:0/3948329144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9501337f0 msgr2=0x7ff950138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.739+0000 7ff9573ae700 1 --2- 172.21.15.72:0/3948329144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9501337f0 0x7ff950138880 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff9400098f0 tx=0x7ff940009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.739+0000 7ff9573ae700 1 -- 172.21.15.72:0/3948329144 shutdown_connections 2023-10-03T10:13:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.739+0000 7ff9573ae700 1 --2- 172.21.15.72:0/3948329144 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff950138dc0 0x7ff95013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.739+0000 7ff9573ae700 1 --2- 172.21.15.72:0/3948329144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9501337f0 0x7ff950138880 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.739+0000 7ff9573ae700 1 -- 172.21.15.72:0/3948329144 >> 172.21.15.72:0/3948329144 conn(0x7ff9500a4210 msgr2=0x7ff9500a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.739+0000 7ff9573ae700 1 -- 172.21.15.72:0/3948329144 shutdown_connections 2023-10-03T10:13:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.739+0000 7ff9573ae700 1 -- 172.21.15.72:0/3948329144 wait complete. 2023-10-03T10:13:51.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.740+0000 7ff9573ae700 1 Processor -- start 2023-10-03T10:13:51.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.740+0000 7ff9573ae700 1 -- start start 2023-10-03T10:13:51.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff9573ae700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff950133420 0x7ff95012ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff9573ae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9501337f0 0x7ff95012f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff9573ae700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff950138dc0 0x7ff95012f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff9573ae700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95009d9b0 con 0x7ff950138dc0 2023-10-03T10:13:51.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff9573ae700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9501388a0 con 0x7ff9501337f0 2023-10-03T10:13:51.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff9573ae700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff95009c590 con 0x7ff950133420 2023-10-03T10:13:51.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff95514a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff950133420 0x7ff95012ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff95514a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff950133420 0x7ff95012ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57462/0 (socket says 172.21.15.72:57462) 2023-10-03T10:13:51.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff95514a700 1 -- 172.21.15.72:0/4212801265 learned_addr learned my addr 172.21.15.72:0/4212801265 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:51.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff95594b700 1 --2- 172.21.15.72:0/4212801265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff950138dc0 0x7ff95012f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff954949700 1 --2- 172.21.15.72:0/4212801265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9501337f0 0x7ff95012f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff95514a700 1 -- 172.21.15.72:0/4212801265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9501337f0 msgr2=0x7ff95012f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff95514a700 1 --2- 172.21.15.72:0/4212801265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9501337f0 0x7ff95012f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff95514a700 1 -- 172.21.15.72:0/4212801265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff950138dc0 msgr2=0x7ff95012f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff95514a700 1 --2- 172.21.15.72:0/4212801265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff950138dc0 0x7ff95012f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff95514a700 1 -- 172.21.15.72:0/4212801265 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff940009550 con 0x7ff950133420 2023-10-03T10:13:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.741+0000 7ff95594b700 1 --2- 172.21.15.72:0/4212801265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff950138dc0 0x7ff95012f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.742+0000 7ff95514a700 1 --2- 172.21.15.72:0/4212801265 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff950133420 0x7ff95012ee50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00c4e0 tx=0x7ff94c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.742+0000 7ff945ffb700 1 -- 172.21.15.72:0/4212801265 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c0052d0 con 0x7ff950133420 2023-10-03T10:13:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.742+0000 7ff945ffb700 1 -- 172.21.15.72:0/4212801265 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c005430 con 0x7ff950133420 2023-10-03T10:13:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.742+0000 7ff9573ae700 1 -- 172.21.15.72:0/4212801265 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95009b6b0 con 0x7ff950133420 2023-10-03T10:13:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.742+0000 7ff945ffb700 1 -- 172.21.15.72:0/4212801265 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c0038c0 con 0x7ff950133420 2023-10-03T10:13:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.742+0000 7ff9573ae700 1 -- 172.21.15.72:0/4212801265 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95009d2d0 con 0x7ff950133420 2023-10-03T10:13:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.743+0000 7ff945ffb700 1 -- 172.21.15.72:0/4212801265 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff94c003a20 con 0x7ff950133420 2023-10-03T10:13:51.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.743+0000 7ff945ffb700 1 -- 172.21.15.72:0/4212801265 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff94c03ea70 con 0x7ff950133420 2023-10-03T10:13:51.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.743+0000 7ff9573ae700 1 -- 172.21.15.72:0/4212801265 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff95009ffb0 con 0x7ff950133420 2023-10-03T10:13:51.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.749+0000 7ff945ffb700 1 -- 172.21.15.72:0/4212801265 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff94c018260 con 0x7ff950133420 2023-10-03T10:13:51.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.783+0000 7f04e6473700 1 Processor -- start 2023-10-03T10:13:51.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.783+0000 7f04e6473700 1 -- start start 2023-10-03T10:13:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.783+0000 7f04e6473700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04e009f410 0x7f04e0136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.783+0000 7f04e6473700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f04e0136fe0 0x7f04e01393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.783+0000 7f04e6473700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e0070940 con 0x7f04e009e930 2023-10-03T10:13:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.783+0000 7f04e6473700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e006fd60 con 0x7f04e0136fe0 2023-10-03T10:13:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.783+0000 7f04e6473700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04e006fa80 con 0x7f04e009f410 2023-10-03T10:13:51.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.784+0000 7f04dffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f04e009e930 0x7f04e009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43034/0 (socket says 172.21.15.72:43034) 2023-10-03T10:13:51.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.784+0000 7f04e4a10700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f04e0136fe0 0x7f04e01393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.784+0000 7f04df7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04e009f410 0x7f04e0136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.784+0000 7f04dffff700 1 -- 172.21.15.72:0/3862337063 learned_addr learned my addr 172.21.15.72:0/3862337063 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:51.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.784+0000 7f04df7fe700 1 -- 172.21.15.72:0/3862337063 >> v2:172.21.15.72:3300/0 conn(0x7f04e0136fe0 msgr2=0x7f04e01393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:51.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.784+0000 7f04df7fe700 1 --2- 172.21.15.72:0/3862337063 >> v2:172.21.15.72:3300/0 conn(0x7f04e0136fe0 0x7f04e01393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.784+0000 7f04df7fe700 1 -- 172.21.15.72:0/3862337063 >> v1:172.21.15.72:6789/0 conn(0x7f04e009e930 legacy=0x7f04e009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.784+0000 7f04df7fe700 1 -- 172.21.15.72:0/3862337063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e009fb60 con 0x7f04e009f410 2023-10-03T10:13:51.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.784+0000 7f04df7fe700 1 --2- 172.21.15.72:0/3862337063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04e009f410 0x7f04e0136aa0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009840 tx=0x7f04d4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d47c0ad2656842cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.784+0000 7f04deffd700 1 -- 172.21.15.72:0/3862337063 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4011830 con 0x7f04e009f410 2023-10-03T10:13:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.785+0000 7f04deffd700 1 -- 172.21.15.72:0/3862337063 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d4011990 con 0x7f04e009f410 2023-10-03T10:13:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.785+0000 7f04deffd700 1 -- 172.21.15.72:0/3862337063 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4011d20 con 0x7f04e009f410 2023-10-03T10:13:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.785+0000 7f04e6473700 1 -- 172.21.15.72:0/3862337063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04e009f410 msgr2=0x7f04e0136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.785+0000 7f04e6473700 1 --2- 172.21.15.72:0/3862337063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04e009f410 0x7f04e0136aa0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009840 tx=0x7f04d4009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.785+0000 7f04e6473700 1 -- 172.21.15.72:0/3862337063 shutdown_connections 2023-10-03T10:13:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.785+0000 7f04e6473700 1 --2- 172.21.15.72:0/3862337063 >> v2:172.21.15.72:3300/0 conn(0x7f04e0136fe0 0x7f04e01393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.785+0000 7f04e6473700 1 --2- 172.21.15.72:0/3862337063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04e009f410 0x7f04e0136aa0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.786+0000 7f04e6473700 1 -- 172.21.15.72:0/3862337063 >> 172.21.15.72:0/3862337063 conn(0x7f04e00a4210 msgr2=0x7f04e00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.786+0000 7f04e6473700 1 -- 172.21.15.72:0/3862337063 shutdown_connections 2023-10-03T10:13:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.786+0000 7f04e6473700 1 -- 172.21.15.72:0/3862337063 wait complete. 2023-10-03T10:13:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.787+0000 7f04e6473700 1 Processor -- start 2023-10-03T10:13:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.787+0000 7f04e6473700 1 -- start start 2023-10-03T10:13:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04e6473700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04e009e930 0x7f04e01c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04e6473700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04e009f410 0x7f04e01c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04e6473700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04e0136fe0 0x7f04e01c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04e6473700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e0122130 con 0x7f04e009f410 2023-10-03T10:13:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04e6473700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e006d4c0 con 0x7f04e0136fe0 2023-10-03T10:13:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04e6473700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04e0132190 con 0x7f04e009e930 2023-10-03T10:13:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04df7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04e009f410 0x7f04e01c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04df7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04e009f410 0x7f04e01c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43640/0 (socket says 172.21.15.72:43640) 2023-10-03T10:13:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04df7fe700 1 -- 172.21.15.72:0/2916025380 learned_addr learned my addr 172.21.15.72:0/2916025380 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04dffff700 1 --2- 172.21.15.72:0/2916025380 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04e009e930 0x7f04e01c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04df7fe700 1 -- 172.21.15.72:0/2916025380 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04e009e930 msgr2=0x7f04e01c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04df7fe700 1 --2- 172.21.15.72:0/2916025380 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04e009e930 0x7f04e01c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04df7fe700 1 -- 172.21.15.72:0/2916025380 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04e0136fe0 msgr2=0x7f04e01c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04df7fe700 1 --2- 172.21.15.72:0/2916025380 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04e0136fe0 0x7f04e01c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04df7fe700 1 -- 172.21.15.72:0/2916025380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d40094a0 con 0x7f04e009f410 2023-10-03T10:13:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.788+0000 7f04df7fe700 1 --2- 172.21.15.72:0/2916025380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04e009f410 0x7f04e01c87a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f04d40090b0 tx=0x7f04d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.789+0000 7f04dcff9700 1 -- 172.21.15.72:0/2916025380 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4004550 con 0x7f04e009f410 2023-10-03T10:13:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.789+0000 7f04dcff9700 1 -- 172.21.15.72:0/2916025380 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d401f070 con 0x7f04e009f410 2023-10-03T10:13:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.789+0000 7f04e6473700 1 -- 172.21.15.72:0/2916025380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e0071d20 con 0x7f04e009f410 2023-10-03T10:13:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.789+0000 7f04e6473700 1 -- 172.21.15.72:0/2916025380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e0121090 con 0x7f04e009f410 2023-10-03T10:13:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.789+0000 7f04dcff9700 1 -- 172.21.15.72:0/2916025380 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d40038e0 con 0x7f04e009f410 2023-10-03T10:13:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.790+0000 7f04e6473700 1 -- 172.21.15.72:0/2916025380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e0074ea0 con 0x7f04e009f410 2023-10-03T10:13:51.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.791+0000 7f04dcff9700 1 -- 172.21.15.72:0/2916025380 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04d4003a40 con 0x7f04e009f410 2023-10-03T10:13:51.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.791+0000 7f04dcff9700 1 -- 172.21.15.72:0/2916025380 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f04d4021070 con 0x7f04e009f410 2023-10-03T10:13:51.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.800+0000 7f04dcff9700 1 -- 172.21.15.72:0/2916025380 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04d4024970 con 0x7f04e009f410 2023-10-03T10:13:51.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.832+0000 7f5146b65700 1 Processor -- start 2023-10-03T10:13:51.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.832+0000 7f5146b65700 1 -- start start 2023-10-03T10:13:51.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.832+0000 7f5146b65700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f514006a770 0x7f514006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.832+0000 7f5146b65700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f514006b080 0x7f5140131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.832+0000 7f5146b65700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514009ece0 con 0x7f5140131b40 2023-10-03T10:13:51.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.832+0000 7f5146b65700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514009e760 con 0x7f514006a770 2023-10-03T10:13:51.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.832+0000 7f5146b65700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f514009e040 con 0x7f514006b080 2023-10-03T10:13:51.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.833+0000 7f5144901700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f514006a770 0x7f514006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.833+0000 7f5144901700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f514006a770 0x7f514006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42696/0 (socket says 172.21.15.72:42696) 2023-10-03T10:13:51.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.833+0000 7f5144901700 1 -- 172.21.15.72:0/3364944695 learned_addr learned my addr 172.21.15.72:0/3364944695 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:51.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.833+0000 7f513ffff700 1 --2- 172.21.15.72:0/3364944695 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f514006b080 0x7f5140131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.833+0000 7f513ffff700 1 -- 172.21.15.72:0/3364944695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f514006a770 msgr2=0x7f514006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:51.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.833+0000 7f513ffff700 1 --2- 172.21.15.72:0/3364944695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f514006a770 0x7f514006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.833+0000 7f513ffff700 1 -- 172.21.15.72:0/3364944695 >> v1:172.21.15.72:6789/0 conn(0x7f5140131b40 legacy=0x7f5140138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.833+0000 7f513ffff700 1 -- 172.21.15.72:0/3364944695 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514009f630 con 0x7f514006b080 2023-10-03T10:13:51.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.833+0000 7f513ffff700 1 --2- 172.21.15.72:0/3364944695 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f514006b080 0x7f5140131600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f512c009870 tx=0x7f512c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89304ed5e050a420 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.833+0000 7f513f7fe700 1 -- 172.21.15.72:0/3364944695 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c011830 con 0x7f514006b080 2023-10-03T10:13:51.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.833+0000 7f513f7fe700 1 -- 172.21.15.72:0/3364944695 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c011990 con 0x7f514006b080 2023-10-03T10:13:51.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.833+0000 7f513f7fe700 1 -- 172.21.15.72:0/3364944695 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c011d20 con 0x7f514006b080 2023-10-03T10:13:51.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.834+0000 7f5146b65700 1 -- 172.21.15.72:0/3364944695 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f514006b080 msgr2=0x7f5140131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.834+0000 7f5146b65700 1 --2- 172.21.15.72:0/3364944695 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f514006b080 0x7f5140131600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f512c009870 tx=0x7f512c009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:51.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.834+0000 7f5146b65700 1 -- 172.21.15.72:0/3364944695 shutdown_connections 2023-10-03T10:13:51.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.834+0000 7f5146b65700 1 --2- 172.21.15.72:0/3364944695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f514006a770 0x7f514006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.834+0000 7f5146b65700 1 --2- 172.21.15.72:0/3364944695 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f514006b080 0x7f5140131600 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.834+0000 7f5146b65700 1 -- 172.21.15.72:0/3364944695 >> 172.21.15.72:0/3364944695 conn(0x7f5140066f50 msgr2=0x7f514009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.834+0000 7f5146b65700 1 -- 172.21.15.72:0/3364944695 shutdown_connections 2023-10-03T10:13:51.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.834+0000 7f5146b65700 1 -- 172.21.15.72:0/3364944695 wait complete. 2023-10-03T10:13:51.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.836+0000 7f5146b65700 1 Processor -- start 2023-10-03T10:13:51.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.836+0000 7f5146b65700 1 -- start start 2023-10-03T10:13:51.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f5146b65700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f514006a770 0x7f51401c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f5146b65700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f514006b080 0x7f51401c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f5146b65700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5140131b40 0x7f514011c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f5146b65700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5140071e60 con 0x7f5140131b40 2023-10-03T10:13:51.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f5146b65700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51401c6ec0 con 0x7f514006a770 2023-10-03T10:13:51.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f5146b65700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5140131160 con 0x7f514006b080 2023-10-03T10:13:51.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f5144901700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f514006a770 0x7f51401c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f5144901700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f514006a770 0x7f51401c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42700/0 (socket says 172.21.15.72:42700) 2023-10-03T10:13:51.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f5144901700 1 -- 172.21.15.72:0/214454122 learned_addr learned my addr 172.21.15.72:0/214454122 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:51.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f513ffff700 1 --2- 172.21.15.72:0/214454122 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f514006b080 0x7f51401c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f5145102700 1 --2- 172.21.15.72:0/214454122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5140131b40 0x7f514011c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f513ffff700 1 -- 172.21.15.72:0/214454122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f514006a770 msgr2=0x7f51401c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f513ffff700 1 --2- 172.21.15.72:0/214454122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f514006a770 0x7f51401c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f513ffff700 1 -- 172.21.15.72:0/214454122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5140131b40 msgr2=0x7f514011c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f513ffff700 1 --2- 172.21.15.72:0/214454122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5140131b40 0x7f514011c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f513ffff700 1 -- 172.21.15.72:0/214454122 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c0094a0 con 0x7f514006b080 2023-10-03T10:13:51.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f5144901700 1 --2- 172.21.15.72:0/214454122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f514006a770 0x7f51401c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:51.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.837+0000 7f513ffff700 1 --2- 172.21.15.72:0/214454122 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f514006b080 0x7f51401c6980 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5140072200 tx=0x7f512c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.838+0000 7f513d7fa700 1 -- 172.21.15.72:0/214454122 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c004550 con 0x7f514006b080 2023-10-03T10:13:51.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.838+0000 7f513d7fa700 1 -- 172.21.15.72:0/214454122 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c01f070 con 0x7f514006b080 2023-10-03T10:13:51.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.838+0000 7f513d7fa700 1 -- 172.21.15.72:0/214454122 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0038e0 con 0x7f514006b080 2023-10-03T10:13:51.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.838+0000 7f5146b65700 1 -- 172.21.15.72:0/214454122 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514011fb20 con 0x7f514006b080 2023-10-03T10:13:51.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.838+0000 7f5146b65700 1 -- 172.21.15.72:0/214454122 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5140120850 con 0x7f514006b080 2023-10-03T10:13:51.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.839+0000 7f513d7fa700 1 -- 172.21.15.72:0/214454122 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f512c003a40 con 0x7f514006b080 2023-10-03T10:13:51.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.839+0000 7f5146b65700 1 -- 172.21.15.72:0/214454122 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5140074ea0 con 0x7f514006b080 2023-10-03T10:13:51.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.839+0000 7f513d7fa700 1 -- 172.21.15.72:0/214454122 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f512c021070 con 0x7f514006b080 2023-10-03T10:13:51.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.844+0000 7f513d7fa700 1 -- 172.21.15.72:0/214454122 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f512c010380 con 0x7f514006b080 2023-10-03T10:13:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.872+0000 7fe438d21700 1 Processor -- start 2023-10-03T10:13:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.872+0000 7fe438d21700 1 -- start start 2023-10-03T10:13:51.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.873+0000 7fe438d21700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe434133420 0x7fe4341337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.873+0000 7fe438d21700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe434134260 0x7fe4341306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.873+0000 7fe438d21700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43406b990 con 0x7fe434133e30 2023-10-03T10:13:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.873+0000 7fe438d21700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4340a0590 con 0x7fe434133420 2023-10-03T10:13:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.873+0000 7fe438d21700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe43409fb80 con 0x7fe434134260 2023-10-03T10:13:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.873+0000 7fe43259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe434133420 0x7fe4341337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.873+0000 7fe43259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe434133420 0x7fe4341337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42712/0 (socket says 172.21.15.72:42712) 2023-10-03T10:13:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.873+0000 7fe43259c700 1 -- 172.21.15.72:0/2370931102 learned_addr learned my addr 172.21.15.72:0/2370931102 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.873+0000 7fe432d9d700 1 --2- 172.21.15.72:0/2370931102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe434134260 0x7fe4341306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.874+0000 7fe43259c700 1 -- 172.21.15.72:0/2370931102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe434134260 msgr2=0x7fe4341306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.874+0000 7fe43259c700 1 --2- 172.21.15.72:0/2370931102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe434134260 0x7fe4341306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.874+0000 7fe43259c700 1 -- 172.21.15.72:0/2370931102 >> v1:172.21.15.72:6789/0 conn(0x7fe434133e30 legacy=0x7fe43412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.874+0000 7fe43259c700 1 -- 172.21.15.72:0/2370931102 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4340a0030 con 0x7fe434133420 2023-10-03T10:13:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.874+0000 7fe43259c700 1 --2- 172.21.15.72:0/2370931102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe434133420 0x7fe4341337f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe424009920 tx=0x7fe424009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75e58163058ed0cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.874+0000 7fe43159a700 1 -- 172.21.15.72:0/2370931102 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42400ba60 con 0x7fe434133420 2023-10-03T10:13:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.874+0000 7fe43159a700 1 -- 172.21.15.72:0/2370931102 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42400bbc0 con 0x7fe434133420 2023-10-03T10:13:51.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.874+0000 7fe43159a700 1 -- 172.21.15.72:0/2370931102 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424009e70 con 0x7fe434133420 2023-10-03T10:13:51.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.875+0000 7fe438d21700 1 -- 172.21.15.72:0/2370931102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe434133420 msgr2=0x7fe4341337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.875+0000 7fe438d21700 1 --2- 172.21.15.72:0/2370931102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe434133420 0x7fe4341337f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe424009920 tx=0x7fe424009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:51.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.875+0000 7fe438d21700 1 -- 172.21.15.72:0/2370931102 shutdown_connections 2023-10-03T10:13:51.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.875+0000 7fe438d21700 1 --2- 172.21.15.72:0/2370931102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe434134260 0x7fe4341306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.875+0000 7fe438d21700 1 --2- 172.21.15.72:0/2370931102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe434133420 0x7fe4341337f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.875+0000 7fe438d21700 1 -- 172.21.15.72:0/2370931102 >> 172.21.15.72:0/2370931102 conn(0x7fe4340a4210 msgr2=0x7fe4340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.875+0000 7fe438d21700 1 -- 172.21.15.72:0/2370931102 shutdown_connections 2023-10-03T10:13:51.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.875+0000 7fe438d21700 1 -- 172.21.15.72:0/2370931102 wait complete. 2023-10-03T10:13:51.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.876+0000 7fe438d21700 1 Processor -- start 2023-10-03T10:13:51.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.876+0000 7fe438d21700 1 -- start start 2023-10-03T10:13:51.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.876+0000 7fe438d21700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe434133420 0x7fe4341c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.876+0000 7fe438d21700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe434133e30 0x7fe4341c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.876+0000 7fe438d21700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe434134260 0x7fe4341c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:51.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.876+0000 7fe438d21700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe434121060 con 0x7fe434133420 2023-10-03T10:13:51.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.876+0000 7fe438d21700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe434120560 con 0x7fe434134260 2023-10-03T10:13:51.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.876+0000 7fe438d21700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe43411fee0 con 0x7fe434133e30 2023-10-03T10:13:51.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe43259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe434133420 0x7fe4341c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe43259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe434133420 0x7fe4341c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43654/0 (socket says 172.21.15.72:43654) 2023-10-03T10:13:51.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe43259c700 1 -- 172.21.15.72:0/3544337318 learned_addr learned my addr 172.21.15.72:0/3544337318 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:51.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe432d9d700 1 --2- 172.21.15.72:0/3544337318 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe434134260 0x7fe4341c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe431d9b700 1 --2- 172.21.15.72:0/3544337318 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe434133e30 0x7fe4341c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:51.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe43259c700 1 -- 172.21.15.72:0/3544337318 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe434133e30 msgr2=0x7fe4341c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe43259c700 1 --2- 172.21.15.72:0/3544337318 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe434133e30 0x7fe4341c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe43259c700 1 -- 172.21.15.72:0/3544337318 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe434134260 msgr2=0x7fe4341c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe43259c700 1 --2- 172.21.15.72:0/3544337318 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe434134260 0x7fe4341c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe43259c700 1 -- 172.21.15.72:0/3544337318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe424009550 con 0x7fe434133420 2023-10-03T10:13:51.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe431d9b700 1 --2- 172.21.15.72:0/3544337318 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe434133e30 0x7fe4341c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:51.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe43259c700 1 --2- 172.21.15.72:0/3544337318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe434133420 0x7fe4341c8660 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe424009c70 tx=0x7fe424004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:51.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe422ffd700 1 -- 172.21.15.72:0/3544337318 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424004450 con 0x7fe434133420 2023-10-03T10:13:51.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe422ffd700 1 -- 172.21.15.72:0/3544337318 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4240045b0 con 0x7fe434133420 2023-10-03T10:13:51.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe422ffd700 1 -- 172.21.15.72:0/3544337318 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4240038c0 con 0x7fe434133420 2023-10-03T10:13:51.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe438d21700 1 -- 172.21.15.72:0/3544337318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4341201a0 con 0x7fe434133420 2023-10-03T10:13:51.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.877+0000 7fe438d21700 1 -- 172.21.15.72:0/3544337318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe434072580 con 0x7fe434133420 2023-10-03T10:13:51.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.879+0000 7fe422ffd700 1 -- 172.21.15.72:0/3544337318 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe424021070 con 0x7fe434133420 2023-10-03T10:13:51.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.879+0000 7fe438d21700 1 -- 172.21.15.72:0/3544337318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43412d8e0 con 0x7fe434133420 2023-10-03T10:13:51.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.879+0000 7fe422ffd700 1 -- 172.21.15.72:0/3544337318 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe424040a50 con 0x7fe434133420 2023-10-03T10:13:51.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.883+0000 7fe422ffd700 1 -- 172.21.15.72:0/3544337318 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe424024470 con 0x7fe434133420 2023-10-03T10:13:51.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.985+0000 7ff9573ae700 1 -- 172.21.15.72:0/4212801265 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff950074ea0 con 0x7ff950133420 2023-10-03T10:13:51.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.985+0000 7ff945ffb700 1 -- 172.21.15.72:0/4212801265 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff94c017030 con 0x7ff950133420 2023-10-03T10:13:51.986 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:51.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.988+0000 7ff9573ae700 1 -- 172.21.15.72:0/4212801265 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff950133420 msgr2=0x7ff95012ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:51.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.988+0000 7ff9573ae700 1 --2- 172.21.15.72:0/4212801265 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff950133420 0x7ff95012ee50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00c4e0 tx=0x7ff94c00c7f0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.988+0000 7ff9573ae700 1 -- 172.21.15.72:0/4212801265 shutdown_connections 2023-10-03T10:13:51.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.988+0000 7ff9573ae700 1 --2- 172.21.15.72:0/4212801265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff950138dc0 0x7ff95012f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.988+0000 7ff9573ae700 1 --2- 172.21.15.72:0/4212801265 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff950133420 0x7ff95012ee50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.988+0000 7ff9573ae700 1 --2- 172.21.15.72:0/4212801265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9501337f0 0x7ff95012f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:51.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.988+0000 7ff9573ae700 1 -- 172.21.15.72:0/4212801265 >> 172.21.15.72:0/4212801265 conn(0x7ff9500a4210 msgr2=0x7ff950131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:51.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.988+0000 7ff9573ae700 1 -- 172.21.15.72:0/4212801265 shutdown_connections 2023-10-03T10:13:51.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:51.988+0000 7ff9573ae700 1 -- 172.21.15.72:0/4212801265 wait complete. 2023-10-03T10:13:52.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:52.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.062+0000 7f04e6473700 1 -- 172.21.15.72:0/2916025380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f04e006b250 con 0x7f04e009f410 2023-10-03T10:13:52.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.062+0000 7f04dcff9700 1 -- 172.21.15.72:0/2916025380 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f04d402b020 con 0x7f04e009f410 2023-10-03T10:13:52.063 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:52.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.064+0000 7f04e6473700 1 -- 172.21.15.72:0/2916025380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04e009f410 msgr2=0x7f04e01c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.064+0000 7f04e6473700 1 --2- 172.21.15.72:0/2916025380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04e009f410 0x7f04e01c87a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f04d40090b0 tx=0x7f04d4004750 comp rx=0 tx=0).stop 2023-10-03T10:13:52.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.064+0000 7f04e6473700 1 -- 172.21.15.72:0/2916025380 shutdown_connections 2023-10-03T10:13:52.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.064+0000 7f04e6473700 1 --2- 172.21.15.72:0/2916025380 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04e0136fe0 0x7f04e01c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.064+0000 7f04e6473700 1 --2- 172.21.15.72:0/2916025380 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04e009e930 0x7f04e01c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.064+0000 7f04e6473700 1 --2- 172.21.15.72:0/2916025380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04e009f410 0x7f04e01c87a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.064+0000 7f04e6473700 1 -- 172.21.15.72:0/2916025380 >> 172.21.15.72:0/2916025380 conn(0x7f04e00a4210 msgr2=0x7f04e0134b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.064+0000 7f04e6473700 1 -- 172.21.15.72:0/2916025380 shutdown_connections 2023-10-03T10:13:52.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.064+0000 7f04e6473700 1 -- 172.21.15.72:0/2916025380 wait complete. 2023-10-03T10:13:52.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:52.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.102+0000 7f5146b65700 1 -- 172.21.15.72:0/214454122 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f514006c360 con 0x7f514006b080 2023-10-03T10:13:52.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.102+0000 7f513d7fa700 1 -- 172.21.15.72:0/214454122 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f512c015030 con 0x7f514006b080 2023-10-03T10:13:52.103 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:52.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.104+0000 7f5146b65700 1 -- 172.21.15.72:0/214454122 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f514006b080 msgr2=0x7f51401c6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.104+0000 7f5146b65700 1 --2- 172.21.15.72:0/214454122 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f514006b080 0x7f51401c6980 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5140072200 tx=0x7f512c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:52.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.104+0000 7f5146b65700 1 -- 172.21.15.72:0/214454122 shutdown_connections 2023-10-03T10:13:52.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.104+0000 7f5146b65700 1 --2- 172.21.15.72:0/214454122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5140131b40 0x7f514011c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.104+0000 7f5146b65700 1 --2- 172.21.15.72:0/214454122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f514006a770 0x7f51401c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.104+0000 7f5146b65700 1 --2- 172.21.15.72:0/214454122 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f514006b080 0x7f51401c6980 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.104+0000 7f5146b65700 1 -- 172.21.15.72:0/214454122 >> 172.21.15.72:0/214454122 conn(0x7f5140066f50 msgr2=0x7f51400a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.104+0000 7f5146b65700 1 -- 172.21.15.72:0/214454122 shutdown_connections 2023-10-03T10:13:52.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.104+0000 7f5146b65700 1 -- 172.21.15.72:0/214454122 wait complete. 2023-10-03T10:13:52.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.109+0000 7fe438d21700 1 -- 172.21.15.72:0/3544337318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe434120390 con 0x7fe434133420 2023-10-03T10:13:52.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.109+0000 7fe422ffd700 1 -- 172.21.15.72:0/3544337318 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe424015070 con 0x7fe434133420 2023-10-03T10:13:52.110 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:52.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.111+0000 7fe438d21700 1 -- 172.21.15.72:0/3544337318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe434133420 msgr2=0x7fe4341c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:52.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.111+0000 7fe438d21700 1 --2- 172.21.15.72:0/3544337318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe434133420 0x7fe4341c8660 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe424009c70 tx=0x7fe424004750 comp rx=0 tx=0).stop 2023-10-03T10:13:52.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.111+0000 7fe438d21700 1 -- 172.21.15.72:0/3544337318 shutdown_connections 2023-10-03T10:13:52.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.111+0000 7fe438d21700 1 --2- 172.21.15.72:0/3544337318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe434133420 0x7fe4341c8660 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.111+0000 7fe438d21700 1 --2- 172.21.15.72:0/3544337318 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe434134260 0x7fe4341c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.111+0000 7fe438d21700 1 --2- 172.21.15.72:0/3544337318 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe434133e30 0x7fe4341c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:52.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.111+0000 7fe438d21700 1 -- 172.21.15.72:0/3544337318 >> 172.21.15.72:0/3544337318 conn(0x7fe4340a4210 msgr2=0x7fe4340a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:52.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.112+0000 7fe438d21700 1 -- 172.21.15.72:0/3544337318 shutdown_connections 2023-10-03T10:13:52.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:52.112+0000 7fe438d21700 1 -- 172.21.15.72:0/3544337318 wait complete. 2023-10-03T10:13:52.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:52.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:53.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:53.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:53.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:53.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:53.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.138+0000 7f58d91bc700 1 Processor -- start 2023-10-03T10:13:53.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.138+0000 7f58d91bc700 1 -- start start 2023-10-03T10:13:53.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.139+0000 7f58d91bc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f58d4131810 0x7f58d4131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.139+0000 7f58d91bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58d409a580 0x7f58d4139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.139+0000 7f58d91bc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d41313c0 con 0x7f58d4099a40 2023-10-03T10:13:53.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.139+0000 7f58d91bc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d406e8c0 con 0x7f58d4131810 2023-10-03T10:13:53.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.139+0000 7f58d91bc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d4071d20 con 0x7f58d409a580 2023-10-03T10:13:53.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.139+0000 7f58d2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f58d4131810 0x7f58d4131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.139+0000 7f58d359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58d409a580 0x7f58d4139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.139+0000 7f58d2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f58d4131810 0x7f58d4131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43656/0 (socket says 172.21.15.72:43656) 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.139+0000 7f58d359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58d409a580 0x7f58d4139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42730/0 (socket says 172.21.15.72:42730) 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.139+0000 7f58d2d9d700 1 -- 172.21.15.72:0/937657559 learned_addr learned my addr 172.21.15.72:0/937657559 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.139+0000 7f58d359e700 1 -- 172.21.15.72:0/937657559 >> v2:172.21.15.72:3300/0 conn(0x7f58d4131810 msgr2=0x7f58d4131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.140+0000 7f58d359e700 1 --2- 172.21.15.72:0/937657559 >> v2:172.21.15.72:3300/0 conn(0x7f58d4131810 0x7f58d4131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.139+0000 7f58d1d9b700 1 -- 172.21.15.72:0/937657559 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872525012 0 0) 0x7f58d41313c0 con 0x7f58d4099a40 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.140+0000 7f58d359e700 1 -- 172.21.15.72:0/937657559 >> v1:172.21.15.72:6789/0 conn(0x7f58d4099a40 legacy=0x7f58d4099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.140+0000 7f58d359e700 1 -- 172.21.15.72:0/937657559 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d40721a0 con 0x7f58d409a580 2023-10-03T10:13:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.140+0000 7f58d2d9d700 1 --2- 172.21.15.72:0/937657559 >> v2:172.21.15.72:3300/0 conn(0x7f58d4131810 0x7f58d4131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.140+0000 7f58d359e700 1 --2- 172.21.15.72:0/937657559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58d409a580 0x7f58d4139660 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009d90 tx=0x7f58cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccae651ee82b7a67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.140+0000 7f58d1d9b700 1 -- 172.21.15.72:0/937657559 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc00e070 con 0x7f58d409a580 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.140+0000 7f58d1d9b700 1 -- 172.21.15.72:0/937657559 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc00bb20 con 0x7f58d409a580 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.140+0000 7f58d1d9b700 1 -- 172.21.15.72:0/937657559 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc012430 con 0x7f58d409a580 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.141+0000 7f58d91bc700 1 -- 172.21.15.72:0/937657559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58d409a580 msgr2=0x7f58d4139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.141+0000 7f58d91bc700 1 --2- 172.21.15.72:0/937657559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58d409a580 0x7f58d4139660 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009d90 tx=0x7f58cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.141+0000 7f58d91bc700 1 -- 172.21.15.72:0/937657559 shutdown_connections 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.141+0000 7f58d91bc700 1 --2- 172.21.15.72:0/937657559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58d409a580 0x7f58d4139660 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.141+0000 7f58d91bc700 1 --2- 172.21.15.72:0/937657559 >> v2:172.21.15.72:3300/0 conn(0x7f58d4131810 0x7f58d4131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.141+0000 7f58d91bc700 1 -- 172.21.15.72:0/937657559 >> 172.21.15.72:0/937657559 conn(0x7f58d40a2aa0 msgr2=0x7f58d40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.141+0000 7f58d91bc700 1 -- 172.21.15.72:0/937657559 shutdown_connections 2023-10-03T10:13:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.141+0000 7f58d91bc700 1 -- 172.21.15.72:0/937657559 wait complete. 2023-10-03T10:13:53.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.142+0000 7f58d91bc700 1 Processor -- start 2023-10-03T10:13:53.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.142+0000 7f58d91bc700 1 -- start start 2023-10-03T10:13:53.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.143+0000 7f58d91bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58d4099a40 0x7f58d41195c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.143+0000 7f58d91bc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58d409a580 0x7f58d4119b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.143+0000 7f58d91bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58d4131810 0x7f58d411a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.143+0000 7f58d91bc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d411d9e0 con 0x7f58d4099a40 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.143+0000 7f58d91bc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d406eb00 con 0x7f58d4131810 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.143+0000 7f58d91bc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58d411b1d0 con 0x7f58d409a580 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.143+0000 7f58d2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58d4099a40 0x7f58d41195c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.143+0000 7f58d2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58d4099a40 0x7f58d41195c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43662/0 (socket says 172.21.15.72:43662) 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.143+0000 7f58d2d9d700 1 -- 172.21.15.72:0/426869861 learned_addr learned my addr 172.21.15.72:0/426869861 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.143+0000 7f58d259c700 1 --2- 172.21.15.72:0/426869861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58d409a580 0x7f58d4119b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.144+0000 7f58d2d9d700 1 -- 172.21.15.72:0/426869861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58d409a580 msgr2=0x7f58d4119b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.144+0000 7f58d2d9d700 1 --2- 172.21.15.72:0/426869861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58d409a580 0x7f58d4119b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.144+0000 7f58d2d9d700 1 -- 172.21.15.72:0/426869861 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58d4131810 msgr2=0x7f58d411a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.144+0000 7f58d2d9d700 1 --2- 172.21.15.72:0/426869861 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58d4131810 0x7f58d411a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.144+0000 7f58d2d9d700 1 -- 172.21.15.72:0/426869861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c4009550 con 0x7f58d4099a40 2023-10-03T10:13:53.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.144+0000 7f58d2d9d700 1 --2- 172.21.15.72:0/426869861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58d4099a40 0x7f58d41195c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009e70 tx=0x7f58c400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.144+0000 7f58bb7fe700 1 -- 172.21.15.72:0/426869861 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4013860 con 0x7f58d4099a40 2023-10-03T10:13:53.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.144+0000 7f58bb7fe700 1 -- 172.21.15.72:0/426869861 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c40139c0 con 0x7f58d4099a40 2023-10-03T10:13:53.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.144+0000 7f58d91bc700 1 -- 172.21.15.72:0/426869861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58cc009a70 con 0x7f58d4099a40 2023-10-03T10:13:53.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.144+0000 7f58bb7fe700 1 -- 172.21.15.72:0/426869861 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4013d30 con 0x7f58d4099a40 2023-10-03T10:13:53.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.144+0000 7f58d91bc700 1 -- 172.21.15.72:0/426869861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d411cdb0 con 0x7f58d4099a40 2023-10-03T10:13:53.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.145+0000 7f58bb7fe700 1 -- 172.21.15.72:0/426869861 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f58c400c640 con 0x7f58d4099a40 2023-10-03T10:13:53.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.145+0000 7f58bb7fe700 1 -- 172.21.15.72:0/426869861 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f58c4043550 con 0x7f58d4099a40 2023-10-03T10:13:53.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.146+0000 7f58d91bc700 1 -- 172.21.15.72:0/426869861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d411cdb0 con 0x7f58d4099a40 2023-10-03T10:13:53.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.151+0000 7f58bb7fe700 1 -- 172.21.15.72:0/426869861 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58d411cdb0 con 0x7f58d4099a40 2023-10-03T10:13:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.210+0000 7efe58cc9700 1 Processor -- start 2023-10-03T10:13:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.210+0000 7efe58cc9700 1 -- start start 2023-10-03T10:13:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.210+0000 7efe58cc9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efe5409e1d0 0x7efe54138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.211+0000 7efe58cc9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe54139170 0x7efe5413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.211+0000 7efe58cc9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5409b120 con 0x7efe5409d6f0 2023-10-03T10:13:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.211+0000 7efe58cc9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5406b460 con 0x7efe5409e1d0 2023-10-03T10:13:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.211+0000 7efe58cc9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5409a7e0 con 0x7efe54139170 2023-10-03T10:13:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.211+0000 7efe51d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efe5409e1d0 0x7efe54138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.211+0000 7efe51d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efe5409e1d0 0x7efe54138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43674/0 (socket says 172.21.15.72:43674) 2023-10-03T10:13:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.211+0000 7efe51d9b700 1 -- 172.21.15.72:0/618692983 learned_addr learned my addr 172.21.15.72:0/618692983 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.211+0000 7efe52d9d700 1 --2- 172.21.15.72:0/618692983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe54139170 0x7efe5413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.211+0000 7efe5159a700 1 -- 172.21.15.72:0/618692983 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432395547 0 0) 0x7efe5409b120 con 0x7efe5409d6f0 2023-10-03T10:13:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.211+0000 7efe5159a700 1 -- 172.21.15.72:0/618692983 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe3c0035b0 con 0x7efe5409d6f0 2023-10-03T10:13:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.211+0000 7efe51d9b700 1 -- 172.21.15.72:0/618692983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe54139170 msgr2=0x7efe5413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.211+0000 7efe51d9b700 1 --2- 172.21.15.72:0/618692983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe54139170 0x7efe5413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.211+0000 7efe51d9b700 1 -- 172.21.15.72:0/618692983 >> v1:172.21.15.72:6789/0 conn(0x7efe5409d6f0 legacy=0x7efe5409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.211+0000 7efe51d9b700 1 -- 172.21.15.72:0/618692983 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5409a500 con 0x7efe5409e1d0 2023-10-03T10:13:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.211+0000 7efe51d9b700 1 --2- 172.21.15.72:0/618692983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe5409e1d0 0x7efe54138c30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efe48009920 tx=0x7efe48009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7dfd2d9af9b4ad1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.212+0000 7efe5159a700 1 -- 172.21.15.72:0/618692983 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48004230 con 0x7efe5409e1d0 2023-10-03T10:13:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.212+0000 7efe5159a700 1 -- 172.21.15.72:0/618692983 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe48004390 con 0x7efe5409e1d0 2023-10-03T10:13:53.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.212+0000 7efe5159a700 1 -- 172.21.15.72:0/618692983 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe480036a0 con 0x7efe5409e1d0 2023-10-03T10:13:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.212+0000 7efe58cc9700 1 -- 172.21.15.72:0/618692983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe5409e1d0 msgr2=0x7efe54138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.212+0000 7efe58cc9700 1 --2- 172.21.15.72:0/618692983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe5409e1d0 0x7efe54138c30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efe48009920 tx=0x7efe48009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.212+0000 7efe58cc9700 1 -- 172.21.15.72:0/618692983 shutdown_connections 2023-10-03T10:13:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.212+0000 7efe58cc9700 1 --2- 172.21.15.72:0/618692983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe54139170 0x7efe5413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.212+0000 7efe58cc9700 1 --2- 172.21.15.72:0/618692983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe5409e1d0 0x7efe54138c30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.212+0000 7efe58cc9700 1 -- 172.21.15.72:0/618692983 >> 172.21.15.72:0/618692983 conn(0x7efe54066f50 msgr2=0x7efe5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.213+0000 7efe58cc9700 1 -- 172.21.15.72:0/618692983 shutdown_connections 2023-10-03T10:13:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.213+0000 7efe58cc9700 1 -- 172.21.15.72:0/618692983 wait complete. 2023-10-03T10:13:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.214+0000 7efe58cc9700 1 Processor -- start 2023-10-03T10:13:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.214+0000 7efe58cc9700 1 -- start start 2023-10-03T10:13:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.214+0000 7efe58cc9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe5409d6f0 0x7efe541c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.214+0000 7efe58cc9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efe5409e1d0 0x7efe541c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.214+0000 7efe58cc9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe54139170 0x7efe541207c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.214+0000 7efe58cc9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe541240e0 con 0x7efe54139170 2023-10-03T10:13:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.214+0000 7efe58cc9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe541223d0 con 0x7efe5409d6f0 2023-10-03T10:13:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.214+0000 7efe58cc9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe54136690 con 0x7efe5409e1d0 2023-10-03T10:13:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.214+0000 7efe51d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efe5409e1d0 0x7efe541c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.214+0000 7efe51d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efe5409e1d0 0x7efe541c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57534/0 (socket says 172.21.15.72:57534) 2023-10-03T10:13:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.214+0000 7efe51d9b700 1 -- 172.21.15.72:0/2155892974 learned_addr learned my addr 172.21.15.72:0/2155892974 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.214+0000 7efe52d9d700 1 --2- 172.21.15.72:0/2155892974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe54139170 0x7efe541207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.214+0000 7efe5259c700 1 --2- 172.21.15.72:0/2155892974 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe5409d6f0 0x7efe541c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.215+0000 7efe52d9d700 1 -- 172.21.15.72:0/2155892974 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efe5409e1d0 msgr2=0x7efe541c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.215+0000 7efe52d9d700 1 --2- 172.21.15.72:0/2155892974 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efe5409e1d0 0x7efe541c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.215+0000 7efe52d9d700 1 -- 172.21.15.72:0/2155892974 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe5409d6f0 msgr2=0x7efe541c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.215+0000 7efe52d9d700 1 --2- 172.21.15.72:0/2155892974 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe5409d6f0 0x7efe541c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.215+0000 7efe52d9d700 1 -- 172.21.15.72:0/2155892974 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe48009550 con 0x7efe54139170 2023-10-03T10:13:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.215+0000 7efe5259c700 1 --2- 172.21.15.72:0/2155892974 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe5409d6f0 0x7efe541c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.215+0000 7efe52d9d700 1 --2- 172.21.15.72:0/2155892974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe54139170 0x7efe541207c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00ef90 tx=0x7efe4c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.215+0000 7efe42ffd700 1 -- 172.21.15.72:0/2155892974 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c00cc90 con 0x7efe54139170 2023-10-03T10:13:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.215+0000 7efe42ffd700 1 -- 172.21.15.72:0/2155892974 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c00f040 con 0x7efe54139170 2023-10-03T10:13:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.215+0000 7efe42ffd700 1 -- 172.21.15.72:0/2155892974 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c009e60 con 0x7efe54139170 2023-10-03T10:13:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.215+0000 7efe58cc9700 1 -- 172.21.15.72:0/2155892974 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe540a3b20 con 0x7efe54139170 2023-10-03T10:13:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.215+0000 7efe58cc9700 1 -- 172.21.15.72:0/2155892974 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe541c9080 con 0x7efe54139170 2023-10-03T10:13:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.216+0000 7efe42ffd700 1 -- 172.21.15.72:0/2155892974 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe4c014480 con 0x7efe54139170 2023-10-03T10:13:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.216+0000 7efe42ffd700 1 -- 172.21.15.72:0/2155892974 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efe4c040330 con 0x7efe54139170 2023-10-03T10:13:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.216+0000 7efe58cc9700 1 -- 172.21.15.72:0/2155892974 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5409c530 con 0x7efe54139170 2023-10-03T10:13:53.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.225+0000 7efe42ffd700 1 -- 172.21.15.72:0/2155892974 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe4c018020 con 0x7efe54139170 2023-10-03T10:13:53.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.251+0000 7f5efff7c700 1 Processor -- start 2023-10-03T10:13:53.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.251+0000 7f5efff7c700 1 -- start start 2023-10-03T10:13:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.251+0000 7f5efff7c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ef809e930 0x7f5ef809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efff7c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ef809f240 0x7f5ef81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efff7c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef809f650 0x7f5ef8131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efff7c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef8070940 con 0x7f5ef809e930 2023-10-03T10:13:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efff7c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef806fd60 con 0x7f5ef809f650 2023-10-03T10:13:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efff7c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef806fa80 con 0x7f5ef809f240 2023-10-03T10:13:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efe519700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef809f650 0x7f5ef8131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efe519700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef809f650 0x7f5ef8131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42772/0 (socket says 172.21.15.72:42772) 2023-10-03T10:13:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efe519700 1 -- 172.21.15.72:0/697856727 learned_addr learned my addr 172.21.15.72:0/697856727 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efdd18700 1 --2- 172.21.15.72:0/697856727 >> v2:172.21.15.72:3300/0 conn(0x7f5ef809e930 0x7f5ef809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efd517700 1 --2- 172.21.15.72:0/697856727 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ef809f240 0x7f5ef81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efdd18700 1 -- 172.21.15.72:0/697856727 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ef809f240 msgr2=0x7f5ef81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efdd18700 1 --2- 172.21.15.72:0/697856727 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ef809f240 0x7f5ef81317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efdd18700 1 -- 172.21.15.72:0/697856727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef809f650 msgr2=0x7f5ef8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efdd18700 1 --2- 172.21.15.72:0/697856727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef809f650 0x7f5ef8131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efdd18700 1 -- 172.21.15.72:0/697856727 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef809fb60 con 0x7f5ef809e930 2023-10-03T10:13:53.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.252+0000 7f5efdd18700 1 --2- 172.21.15.72:0/697856727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef809e930 0x7f5ef809ed00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009840 tx=0x7f5ef4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6ca90ca5ec4eaf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.253+0000 7f5efcd16700 1 -- 172.21.15.72:0/697856727 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4011830 con 0x7f5ef809e930 2023-10-03T10:13:53.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.253+0000 7f5efcd16700 1 -- 172.21.15.72:0/697856727 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef4011990 con 0x7f5ef809e930 2023-10-03T10:13:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.253+0000 7f5efcd16700 1 -- 172.21.15.72:0/697856727 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4011d20 con 0x7f5ef809e930 2023-10-03T10:13:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.253+0000 7f5efff7c700 1 -- 172.21.15.72:0/697856727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef809e930 msgr2=0x7f5ef809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.253+0000 7f5efff7c700 1 --2- 172.21.15.72:0/697856727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef809e930 0x7f5ef809ed00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009840 tx=0x7f5ef4009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.253+0000 7f5efff7c700 1 -- 172.21.15.72:0/697856727 shutdown_connections 2023-10-03T10:13:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.253+0000 7f5efff7c700 1 --2- 172.21.15.72:0/697856727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef809f650 0x7f5ef8131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.253+0000 7f5efff7c700 1 --2- 172.21.15.72:0/697856727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef809e930 0x7f5ef809ed00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.253+0000 7f5efff7c700 1 --2- 172.21.15.72:0/697856727 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ef809f240 0x7f5ef81317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.253+0000 7f5efff7c700 1 -- 172.21.15.72:0/697856727 >> 172.21.15.72:0/697856727 conn(0x7f5ef80a4210 msgr2=0x7f5ef80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.253+0000 7f5efff7c700 1 -- 172.21.15.72:0/697856727 shutdown_connections 2023-10-03T10:13:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.253+0000 7f5efff7c700 1 -- 172.21.15.72:0/697856727 wait complete. 2023-10-03T10:13:53.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.254+0000 7f5efff7c700 1 Processor -- start 2023-10-03T10:13:53.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.254+0000 7f5efff7c700 1 -- start start 2023-10-03T10:13:53.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efff7c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef809e930 0x7f5ef81a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efff7c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ef809f240 0x7f5ef81a4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efff7c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef809f650 0x7f5ef81a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efff7c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef8071d20 con 0x7f5ef809e930 2023-10-03T10:13:53.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efff7c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef81a5880 con 0x7f5ef809f650 2023-10-03T10:13:53.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efff7c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef81a7410 con 0x7f5ef809f240 2023-10-03T10:13:53.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efd517700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ef809f240 0x7f5ef81a4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efd517700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ef809f240 0x7f5ef81a4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57554/0 (socket says 172.21.15.72:57554) 2023-10-03T10:13:53.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efd517700 1 -- 172.21.15.72:0/3258107247 learned_addr learned my addr 172.21.15.72:0/3258107247 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:53.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efdd18700 1 --2- 172.21.15.72:0/3258107247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef809e930 0x7f5ef81a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efe519700 1 --2- 172.21.15.72:0/3258107247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef809f650 0x7f5ef81a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efd517700 1 -- 172.21.15.72:0/3258107247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef809f650 msgr2=0x7f5ef81a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efd517700 1 --2- 172.21.15.72:0/3258107247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef809f650 0x7f5ef81a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efd517700 1 -- 172.21.15.72:0/3258107247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef809e930 msgr2=0x7f5ef81a3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efd517700 1 --2- 172.21.15.72:0/3258107247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef809e930 0x7f5ef81a3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efd517700 1 -- 172.21.15.72:0/3258107247 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef40094a0 con 0x7f5ef809f240 2023-10-03T10:13:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.255+0000 7f5efd517700 1 --2- 172.21.15.72:0/3258107247 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ef809f240 0x7f5ef81a4110 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800e930 tx=0x7f5ee800ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.256+0000 7f5eee7fc700 1 -- 172.21.15.72:0/3258107247 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8013680 con 0x7f5ef809f240 2023-10-03T10:13:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.256+0000 7f5eee7fc700 1 -- 172.21.15.72:0/3258107247 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee80137e0 con 0x7f5ef809f240 2023-10-03T10:13:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.256+0000 7f5eee7fc700 1 -- 172.21.15.72:0/3258107247 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8013b70 con 0x7f5ef809f240 2023-10-03T10:13:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.256+0000 7f5efff7c700 1 -- 172.21.15.72:0/3258107247 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef80a0190 con 0x7f5ef809f240 2023-10-03T10:13:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.256+0000 7f5efff7c700 1 -- 172.21.15.72:0/3258107247 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef81a6a30 con 0x7f5ef809f240 2023-10-03T10:13:53.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.257+0000 7f5eee7fc700 1 -- 172.21.15.72:0/3258107247 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ee8013cd0 con 0x7f5ef809f240 2023-10-03T10:13:53.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.257+0000 7f5eee7fc700 1 -- 172.21.15.72:0/3258107247 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5ee8043ce0 con 0x7f5ef809f240 2023-10-03T10:13:53.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.257+0000 7f5efff7c700 1 -- 172.21.15.72:0/3258107247 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef81a0b30 con 0x7f5ef809f240 2023-10-03T10:13:53.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.262+0000 7f5eee7fc700 1 -- 172.21.15.72:0/3258107247 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ee8019e60 con 0x7f5ef809f240 2023-10-03T10:13:53.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.288+0000 7f1a6eb57700 1 Processor -- start 2023-10-03T10:13:53.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.289+0000 7f1a6eb57700 1 -- start start 2023-10-03T10:13:53.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.289+0000 7f1a6eb57700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a68133420 0x7f1a681337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.289+0000 7f1a6eb57700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a68134260 0x7f1a681306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.289+0000 7f1a6eb57700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6806b990 con 0x7f1a68133e30 2023-10-03T10:13:53.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.289+0000 7f1a6eb57700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a680a0590 con 0x7f1a68133420 2023-10-03T10:13:53.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.289+0000 7f1a6eb57700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6809fb80 con 0x7f1a68134260 2023-10-03T10:13:53.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.289+0000 7f1a6c8f3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a68133420 0x7f1a681337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.289+0000 7f1a6c8f3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a68133420 0x7f1a681337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42794/0 (socket says 172.21.15.72:42794) 2023-10-03T10:13:53.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.290+0000 7f1a6c8f3700 1 -- 172.21.15.72:0/640505616 learned_addr learned my addr 172.21.15.72:0/640505616 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:53.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.290+0000 7f1a6d0f4700 1 --2- 172.21.15.72:0/640505616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a68134260 0x7f1a681306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.290+0000 7f1a6d0f4700 1 -- 172.21.15.72:0/640505616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a68133420 msgr2=0x7f1a681337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:53.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.290+0000 7f1a6d0f4700 1 --2- 172.21.15.72:0/640505616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a68133420 0x7f1a681337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.290+0000 7f1a6d0f4700 1 -- 172.21.15.72:0/640505616 >> v1:172.21.15.72:6789/0 conn(0x7f1a68133e30 legacy=0x7f1a6812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.290+0000 7f1a6d0f4700 1 -- 172.21.15.72:0/640505616 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a680a0030 con 0x7f1a68134260 2023-10-03T10:13:53.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.290+0000 7f1a6c8f3700 1 --2- 172.21.15.72:0/640505616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a68133420 0x7f1a681337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:53.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.290+0000 7f1a6d0f4700 1 --2- 172.21.15.72:0/640505616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a68134260 0x7f1a681306a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009dc0 tx=0x7f1a6000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=435e3b6531a325e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.290+0000 7f1a677fe700 1 -- 172.21.15.72:0/640505616 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6000e070 con 0x7f1a68134260 2023-10-03T10:13:53.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.290+0000 7f1a677fe700 1 -- 172.21.15.72:0/640505616 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6000bb20 con 0x7f1a68134260 2023-10-03T10:13:53.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.290+0000 7f1a677fe700 1 -- 172.21.15.72:0/640505616 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60012430 con 0x7f1a68134260 2023-10-03T10:13:53.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.291+0000 7f1a6eb57700 1 -- 172.21.15.72:0/640505616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a68134260 msgr2=0x7f1a681306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.291+0000 7f1a6eb57700 1 --2- 172.21.15.72:0/640505616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a68134260 0x7f1a681306a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009dc0 tx=0x7f1a6000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:53.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.291+0000 7f1a6eb57700 1 -- 172.21.15.72:0/640505616 shutdown_connections 2023-10-03T10:13:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.291+0000 7f1a6eb57700 1 --2- 172.21.15.72:0/640505616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a68134260 0x7f1a681306a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.291+0000 7f1a6eb57700 1 --2- 172.21.15.72:0/640505616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a68133420 0x7f1a681337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.291+0000 7f1a6eb57700 1 -- 172.21.15.72:0/640505616 >> 172.21.15.72:0/640505616 conn(0x7f1a680a4210 msgr2=0x7f1a680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.291+0000 7f1a6eb57700 1 -- 172.21.15.72:0/640505616 shutdown_connections 2023-10-03T10:13:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.291+0000 7f1a6eb57700 1 -- 172.21.15.72:0/640505616 wait complete. 2023-10-03T10:13:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.293+0000 7f1a6eb57700 1 Processor -- start 2023-10-03T10:13:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.293+0000 7f1a6eb57700 1 -- start start 2023-10-03T10:13:53.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6eb57700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a68133420 0x7f1a680709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6eb57700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a68133e30 0x7f1a68070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6eb57700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a68134260 0x7f1a68071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6eb57700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a681317b0 con 0x7f1a68134260 2023-10-03T10:13:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6eb57700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6811fda0 con 0x7f1a68133420 2023-10-03T10:13:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6eb57700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6812d770 con 0x7f1a68133e30 2023-10-03T10:13:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6c8f3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a68133420 0x7f1a680709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6c8f3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a68133420 0x7f1a680709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42798/0 (socket says 172.21.15.72:42798) 2023-10-03T10:13:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6c8f3700 1 -- 172.21.15.72:0/168775601 learned_addr learned my addr 172.21.15.72:0/168775601 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6d0f4700 1 --2- 172.21.15.72:0/168775601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a68134260 0x7f1a68071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6c8f3700 1 -- 172.21.15.72:0/168775601 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a68133e30 msgr2=0x7f1a68070ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:53.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6c8f3700 1 --2- 172.21.15.72:0/168775601 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a68133e30 0x7f1a68070ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6c8f3700 1 -- 172.21.15.72:0/168775601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a68134260 msgr2=0x7f1a68071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6c8f3700 1 --2- 172.21.15.72:0/168775601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a68134260 0x7f1a68071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6c8f3700 1 -- 172.21.15.72:0/168775601 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c009550 con 0x7f1a68133420 2023-10-03T10:13:53.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6c8f3700 1 --2- 172.21.15.72:0/168775601 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a68133420 0x7f1a680709a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00ebe0 tx=0x7f1a5c009e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:53.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a657fa700 1 -- 172.21.15.72:0/168775601 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00c8b0 con 0x7f1a68133420 2023-10-03T10:13:53.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a657fa700 1 -- 172.21.15.72:0/168775601 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c00ca10 con 0x7f1a68133420 2023-10-03T10:13:53.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6eb57700 1 -- 172.21.15.72:0/168775601 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a60009a70 con 0x7f1a68133420 2023-10-03T10:13:53.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a657fa700 1 -- 172.21.15.72:0/168775601 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00cd80 con 0x7f1a68133420 2023-10-03T10:13:53.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.294+0000 7f1a6eb57700 1 -- 172.21.15.72:0/168775601 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a68120340 con 0x7f1a68133420 2023-10-03T10:13:53.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.295+0000 7f1a657fa700 1 -- 172.21.15.72:0/168775601 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a5c013470 con 0x7f1a68133420 2023-10-03T10:13:53.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.295+0000 7f1a657fa700 1 -- 172.21.15.72:0/168775601 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1a5c03fcf0 con 0x7f1a68133420 2023-10-03T10:13:53.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.296+0000 7f1a6eb57700 1 -- 172.21.15.72:0/168775601 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a68074ea0 con 0x7f1a68133420 2023-10-03T10:13:53.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.301+0000 7f1a657fa700 1 -- 172.21.15.72:0/168775601 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a5c01b3b0 con 0x7f1a68133420 2023-10-03T10:13:53.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.359+0000 7f58d91bc700 1 -- 172.21.15.72:0/426869861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f58d411cdb0 con 0x7f58d4099a40 2023-10-03T10:13:53.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.360+0000 7f58bb7fe700 1 -- 172.21.15.72:0/426869861 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58d411cdb0 con 0x7f58d4099a40 2023-10-03T10:13:53.360 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:53.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.362+0000 7f58d91bc700 1 -- 172.21.15.72:0/426869861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58d4099a40 msgr2=0x7f58d41195c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.362+0000 7f58d91bc700 1 --2- 172.21.15.72:0/426869861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58d4099a40 0x7f58d41195c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009e70 tx=0x7f58c400eec0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.363+0000 7f58d91bc700 1 -- 172.21.15.72:0/426869861 shutdown_connections 2023-10-03T10:13:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.363+0000 7f58d91bc700 1 --2- 172.21.15.72:0/426869861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f58d4099a40 0x7f58d41195c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.363+0000 7f58d91bc700 1 --2- 172.21.15.72:0/426869861 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f58d4131810 0x7f58d411a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.363+0000 7f58d91bc700 1 --2- 172.21.15.72:0/426869861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58d409a580 0x7f58d4119b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.363+0000 7f58d91bc700 1 -- 172.21.15.72:0/426869861 >> 172.21.15.72:0/426869861 conn(0x7f58d40a2aa0 msgr2=0x7f58d412e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.363+0000 7f58d91bc700 1 -- 172.21.15.72:0/426869861 shutdown_connections 2023-10-03T10:13:53.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.363+0000 7f58d91bc700 1 -- 172.21.15.72:0/426869861 wait complete. 2023-10-03T10:13:53.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:53.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.458+0000 7f5efff7c700 1 -- 172.21.15.72:0/3258107247 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ef8074ea0 con 0x7f5ef809f240 2023-10-03T10:13:53.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.459+0000 7f5eee7fc700 1 -- 172.21.15.72:0/3258107247 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ee8021360 con 0x7f5ef809f240 2023-10-03T10:13:53.460 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:53.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.461+0000 7f5efff7c700 1 -- 172.21.15.72:0/3258107247 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ef809f240 msgr2=0x7f5ef81a4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.461+0000 7f5efff7c700 1 --2- 172.21.15.72:0/3258107247 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ef809f240 0x7f5ef81a4110 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800e930 tx=0x7f5ee800ec40 comp rx=0 tx=0).stop 2023-10-03T10:13:53.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.461+0000 7f5efff7c700 1 -- 172.21.15.72:0/3258107247 shutdown_connections 2023-10-03T10:13:53.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.461+0000 7f5efff7c700 1 --2- 172.21.15.72:0/3258107247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef809e930 0x7f5ef81a3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.461+0000 7f5efff7c700 1 --2- 172.21.15.72:0/3258107247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef809f650 0x7f5ef81a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.461+0000 7f5efff7c700 1 --2- 172.21.15.72:0/3258107247 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ef809f240 0x7f5ef81a4110 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.461+0000 7f5efff7c700 1 -- 172.21.15.72:0/3258107247 >> 172.21.15.72:0/3258107247 conn(0x7f5ef80a4210 msgr2=0x7f5ef81b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.461+0000 7f5efff7c700 1 -- 172.21.15.72:0/3258107247 shutdown_connections 2023-10-03T10:13:53.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.461+0000 7f5efff7c700 1 -- 172.21.15.72:0/3258107247 wait complete. 2023-10-03T10:13:53.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:53.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.478+0000 7efe58cc9700 1 -- 172.21.15.72:0/2155892974 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efe5409f420 con 0x7efe54139170 2023-10-03T10:13:53.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.479+0000 7efe42ffd700 1 -- 172.21.15.72:0/2155892974 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efe4c02c090 con 0x7efe54139170 2023-10-03T10:13:53.479 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:53.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.481+0000 7efe58cc9700 1 -- 172.21.15.72:0/2155892974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe54139170 msgr2=0x7efe541207c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.481+0000 7efe58cc9700 1 --2- 172.21.15.72:0/2155892974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe54139170 0x7efe541207c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00ef90 tx=0x7efe4c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.481+0000 7efe58cc9700 1 -- 172.21.15.72:0/2155892974 shutdown_connections 2023-10-03T10:13:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.481+0000 7efe58cc9700 1 --2- 172.21.15.72:0/2155892974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe54139170 0x7efe541207c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.481+0000 7efe58cc9700 1 --2- 172.21.15.72:0/2155892974 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efe5409d6f0 0x7efe541c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.481+0000 7efe58cc9700 1 --2- 172.21.15.72:0/2155892974 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efe5409e1d0 0x7efe541c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.481+0000 7efe58cc9700 1 -- 172.21.15.72:0/2155892974 >> 172.21.15.72:0/2155892974 conn(0x7efe54066f50 msgr2=0x7efe54136a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.481+0000 7efe58cc9700 1 -- 172.21.15.72:0/2155892974 shutdown_connections 2023-10-03T10:13:53.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.481+0000 7efe58cc9700 1 -- 172.21.15.72:0/2155892974 wait complete. 2023-10-03T10:13:53.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:53.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.518+0000 7f1a6eb57700 1 -- 172.21.15.72:0/168775601 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1a6806b250 con 0x7f1a68133420 2023-10-03T10:13:53.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.518+0000 7f1a657fa700 1 -- 172.21.15.72:0/168775601 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1a5c02b090 con 0x7f1a68133420 2023-10-03T10:13:53.519 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:53.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.520+0000 7f1a6eb57700 1 -- 172.21.15.72:0/168775601 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a68133420 msgr2=0x7f1a680709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:53.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.520+0000 7f1a6eb57700 1 --2- 172.21.15.72:0/168775601 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a68133420 0x7f1a680709a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00ebe0 tx=0x7f1a5c009e70 comp rx=0 tx=0).stop 2023-10-03T10:13:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.520+0000 7f1a6eb57700 1 -- 172.21.15.72:0/168775601 shutdown_connections 2023-10-03T10:13:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.520+0000 7f1a6eb57700 1 --2- 172.21.15.72:0/168775601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a68134260 0x7f1a68071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.520+0000 7f1a6eb57700 1 --2- 172.21.15.72:0/168775601 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a68133420 0x7f1a680709a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.520+0000 7f1a6eb57700 1 --2- 172.21.15.72:0/168775601 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a68133e30 0x7f1a68070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.520+0000 7f1a6eb57700 1 -- 172.21.15.72:0/168775601 >> 172.21.15.72:0/168775601 conn(0x7f1a680a4210 msgr2=0x7f1a680a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.521+0000 7f1a6eb57700 1 -- 172.21.15.72:0/168775601 shutdown_connections 2023-10-03T10:13:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:53.521+0000 7f1a6eb57700 1 -- 172.21.15.72:0/168775601 wait complete. 2023-10-03T10:13:53.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:54.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:54.474 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:54.494 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:54.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.517+0000 7faf44058700 1 Processor -- start 2023-10-03T10:13:54.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.517+0000 7faf44058700 1 -- start start 2023-10-03T10:13:54.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.517+0000 7faf44058700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf3c0a1510 0x7faf3c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.517+0000 7faf44058700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf3c139250 0x7faf3c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.517+0000 7faf44058700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c09edd0 con 0x7faf3c0a0a30 2023-10-03T10:13:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.517+0000 7faf44058700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c0a18e0 con 0x7faf3c139250 2023-10-03T10:13:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.517+0000 7faf44058700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c09e1f0 con 0x7faf3c0a1510 2023-10-03T10:13:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.518+0000 7faf415f3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf3c0a1510 0x7faf3c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.518+0000 7faf415f3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf3c0a1510 0x7faf3c138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57572/0 (socket says 172.21.15.72:57572) 2023-10-03T10:13:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.518+0000 7faf415f3700 1 -- 172.21.15.72:0/3805893219 learned_addr learned my addr 172.21.15.72:0/3805893219 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.518+0000 7faf425f5700 1 --2- 172.21.15.72:0/3805893219 >> v2:172.21.15.72:3300/0 conn(0x7faf3c139250 0x7faf3c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.518+0000 7faf415f3700 1 -- 172.21.15.72:0/3805893219 >> v2:172.21.15.72:3300/0 conn(0x7faf3c139250 msgr2=0x7faf3c13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.518+0000 7faf415f3700 1 --2- 172.21.15.72:0/3805893219 >> v2:172.21.15.72:3300/0 conn(0x7faf3c139250 0x7faf3c13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.518+0000 7faf415f3700 1 -- 172.21.15.72:0/3805893219 >> v1:172.21.15.72:6789/0 conn(0x7faf3c0a0a30 legacy=0x7faf3c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.518+0000 7faf415f3700 1 -- 172.21.15.72:0/3805893219 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c09dc50 con 0x7faf3c0a1510 2023-10-03T10:13:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.518+0000 7faf425f5700 1 --2- 172.21.15.72:0/3805893219 >> v2:172.21.15.72:3300/0 conn(0x7faf3c139250 0x7faf3c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.518+0000 7faf415f3700 1 --2- 172.21.15.72:0/3805893219 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf3c0a1510 0x7faf3c138d10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009920 tx=0x7faf2c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2934ff98081d5781 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.518+0000 7faf40df2700 1 -- 172.21.15.72:0/3805893219 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c011830 con 0x7faf3c0a1510 2023-10-03T10:13:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.518+0000 7faf40df2700 1 -- 172.21.15.72:0/3805893219 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c011990 con 0x7faf3c0a1510 2023-10-03T10:13:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.518+0000 7faf40df2700 1 -- 172.21.15.72:0/3805893219 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c011d20 con 0x7faf3c0a1510 2023-10-03T10:13:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.519+0000 7faf44058700 1 -- 172.21.15.72:0/3805893219 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf3c0a1510 msgr2=0x7faf3c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.519+0000 7faf44058700 1 --2- 172.21.15.72:0/3805893219 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf3c0a1510 0x7faf3c138d10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009920 tx=0x7faf2c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.519+0000 7faf44058700 1 -- 172.21.15.72:0/3805893219 shutdown_connections 2023-10-03T10:13:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.519+0000 7faf44058700 1 --2- 172.21.15.72:0/3805893219 >> v2:172.21.15.72:3300/0 conn(0x7faf3c139250 0x7faf3c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.519+0000 7faf44058700 1 --2- 172.21.15.72:0/3805893219 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf3c0a1510 0x7faf3c138d10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.519+0000 7faf44058700 1 -- 172.21.15.72:0/3805893219 >> 172.21.15.72:0/3805893219 conn(0x7faf3c0a6550 msgr2=0x7faf3c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.519+0000 7faf44058700 1 -- 172.21.15.72:0/3805893219 shutdown_connections 2023-10-03T10:13:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.519+0000 7faf44058700 1 -- 172.21.15.72:0/3805893219 wait complete. 2023-10-03T10:13:54.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.520+0000 7faf44058700 1 Processor -- start 2023-10-03T10:13:54.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.520+0000 7faf44058700 1 -- start start 2023-10-03T10:13:54.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf44058700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf3c0a0a30 0x7faf3c1c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf44058700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf3c0a1510 0x7faf3c1c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf44058700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf3c139250 0x7faf3c122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf44058700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c125eb0 con 0x7faf3c0a0a30 2023-10-03T10:13:54.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf44058700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c138dd0 con 0x7faf3c0a1510 2023-10-03T10:13:54.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf44058700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c1be3d0 con 0x7faf3c139250 2023-10-03T10:13:54.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf41df4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf3c0a0a30 0x7faf3c1c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf41df4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf3c0a0a30 0x7faf3c1c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43742/0 (socket says 172.21.15.72:43742) 2023-10-03T10:13:54.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf41df4700 1 -- 172.21.15.72:0/4160845310 learned_addr learned my addr 172.21.15.72:0/4160845310 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:54.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf415f3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf3c0a1510 0x7faf3c1c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf425f5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf3c139250 0x7faf3c122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf425f5700 1 -- 172.21.15.72:0/4160845310 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf3c0a1510 msgr2=0x7faf3c1c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf425f5700 1 --2- 172.21.15.72:0/4160845310 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf3c0a1510 0x7faf3c1c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf425f5700 1 -- 172.21.15.72:0/4160845310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf3c0a0a30 msgr2=0x7faf3c1c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf425f5700 1 --2- 172.21.15.72:0/4160845310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf3c0a0a30 0x7faf3c1c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf425f5700 1 -- 172.21.15.72:0/4160845310 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf34009a70 con 0x7faf3c139250 2023-10-03T10:13:54.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf41df4700 1 --2- 172.21.15.72:0/4160845310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf3c0a0a30 0x7faf3c1c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf415f3700 1 --2- 172.21.15.72:0/4160845310 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf3c0a1510 0x7faf3c1c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.521+0000 7faf425f5700 1 --2- 172.21.15.72:0/4160845310 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf3c139250 0x7faf3c122930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faf3400ef90 tx=0x7faf3400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.522+0000 7faf327fc700 1 -- 172.21.15.72:0/4160845310 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3400ca30 con 0x7faf3c139250 2023-10-03T10:13:54.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.522+0000 7faf327fc700 1 -- 172.21.15.72:0/4160845310 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3400f040 con 0x7faf3c139250 2023-10-03T10:13:54.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.522+0000 7faf44058700 1 -- 172.21.15.72:0/4160845310 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2c009550 con 0x7faf3c139250 2023-10-03T10:13:54.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.522+0000 7faf327fc700 1 -- 172.21.15.72:0/4160845310 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3400cdd0 con 0x7faf3c139250 2023-10-03T10:13:54.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.522+0000 7faf44058700 1 -- 172.21.15.72:0/4160845310 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c126450 con 0x7faf3c139250 2023-10-03T10:13:54.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.522+0000 7faf327fc700 1 -- 172.21.15.72:0/4160845310 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf34014480 con 0x7faf3c139250 2023-10-03T10:13:54.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.523+0000 7faf327fc700 1 -- 172.21.15.72:0/4160845310 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faf3403fbf0 con 0x7faf3c139250 2023-10-03T10:13:54.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.523+0000 7faf44058700 1 -- 172.21.15.72:0/4160845310 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c074ea0 con 0x7faf3c139250 2023-10-03T10:13:54.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.532+0000 7faf327fc700 1 -- 172.21.15.72:0/4160845310 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf34012930 con 0x7faf3c139250 2023-10-03T10:13:54.533 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:54.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.622+0000 7fe00be5a700 1 Processor -- start 2023-10-03T10:13:54.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.623+0000 7fe00be5a700 1 -- start start 2023-10-03T10:13:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.623+0000 7fe00be5a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0040a0a30 0x7fe0040a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.623+0000 7fe00be5a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0040a1340 0x7fe004133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.623+0000 7fe00be5a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00409edd0 con 0x7fe004133fa0 2023-10-03T10:13:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.623+0000 7fe00be5a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00409e1f0 con 0x7fe0040a0a30 2023-10-03T10:13:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.624+0000 7fe00be5a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe00409dc50 con 0x7fe0040a1340 2023-10-03T10:13:54.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.624+0000 7fe009bf6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0040a0a30 0x7fe0040a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.624+0000 7fe00a3f7700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe004133fa0 0x7fe00413ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43088/0 (socket says 172.21.15.72:43088) 2023-10-03T10:13:54.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.624+0000 7fe00a3f7700 1 -- 172.21.15.72:0/3188948170 learned_addr learned my addr 172.21.15.72:0/3188948170 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:54.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.624+0000 7fe0093f5700 1 --2- 172.21.15.72:0/3188948170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0040a1340 0x7fe004133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.624+0000 7fe008bf4700 1 -- 172.21.15.72:0/3188948170 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356122757 0 0) 0x7fe00409edd0 con 0x7fe004133fa0 2023-10-03T10:13:54.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.624+0000 7fe008bf4700 1 -- 172.21.15.72:0/3188948170 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff00035b0 con 0x7fe004133fa0 2023-10-03T10:13:54.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.624+0000 7fe0093f5700 1 -- 172.21.15.72:0/3188948170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0040a0a30 msgr2=0x7fe0040a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.624+0000 7fe0093f5700 1 --2- 172.21.15.72:0/3188948170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0040a0a30 0x7fe0040a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.624+0000 7fe0093f5700 1 -- 172.21.15.72:0/3188948170 >> v1:172.21.15.72:6789/0 conn(0x7fe004133fa0 legacy=0x7fe00413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.624+0000 7fe0093f5700 1 -- 172.21.15.72:0/3188948170 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0040a1fe0 con 0x7fe0040a1340 2023-10-03T10:13:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.624+0000 7fe009bf6700 1 --2- 172.21.15.72:0/3188948170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0040a0a30 0x7fe0040a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.624+0000 7fe0093f5700 1 --2- 172.21.15.72:0/3188948170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0040a1340 0x7fe004133a60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009870 tx=0x7fdff4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cda94c911543920 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.625+0000 7fe008bf4700 1 -- 172.21.15.72:0/3188948170 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff4011830 con 0x7fe0040a1340 2023-10-03T10:13:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.625+0000 7fe008bf4700 1 -- 172.21.15.72:0/3188948170 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff4011990 con 0x7fe0040a1340 2023-10-03T10:13:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.625+0000 7fe008bf4700 1 -- 172.21.15.72:0/3188948170 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff4011d20 con 0x7fe0040a1340 2023-10-03T10:13:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.625+0000 7fe00be5a700 1 -- 172.21.15.72:0/3188948170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0040a1340 msgr2=0x7fe004133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.625+0000 7fe00be5a700 1 --2- 172.21.15.72:0/3188948170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0040a1340 0x7fe004133a60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009870 tx=0x7fdff4009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.625+0000 7fe00be5a700 1 -- 172.21.15.72:0/3188948170 shutdown_connections 2023-10-03T10:13:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.625+0000 7fe00be5a700 1 --2- 172.21.15.72:0/3188948170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0040a0a30 0x7fe0040a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.625+0000 7fe00be5a700 1 --2- 172.21.15.72:0/3188948170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0040a1340 0x7fe004133a60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.625+0000 7fe00be5a700 1 -- 172.21.15.72:0/3188948170 >> 172.21.15.72:0/3188948170 conn(0x7fe0040a6550 msgr2=0x7fe0040a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.626+0000 7fe00be5a700 1 -- 172.21.15.72:0/3188948170 shutdown_connections 2023-10-03T10:13:54.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.626+0000 7fe00be5a700 1 -- 172.21.15.72:0/3188948170 wait complete. 2023-10-03T10:13:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.627+0000 7fe00be5a700 1 Processor -- start 2023-10-03T10:13:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.627+0000 7fe00be5a700 1 -- start start 2023-10-03T10:13:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe00be5a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0040a0a30 0x7fe004122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe00be5a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0040a1340 0x7fe004122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe00be5a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe004133fa0 0x7fe0041231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe00be5a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe004133780 con 0x7fe0040a1340 2023-10-03T10:13:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe00be5a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0040a3680 con 0x7fe0040a0a30 2023-10-03T10:13:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe00be5a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe004124470 con 0x7fe004133fa0 2023-10-03T10:13:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe009bf6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0040a0a30 0x7fe004122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe009bf6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0040a0a30 0x7fe004122750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42814/0 (socket says 172.21.15.72:42814) 2023-10-03T10:13:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe009bf6700 1 -- 172.21.15.72:0/111930959 learned_addr learned my addr 172.21.15.72:0/111930959 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe00a3f7700 1 --2- 172.21.15.72:0/111930959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe004133fa0 0x7fe0041231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe0093f5700 1 --2- 172.21.15.72:0/111930959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0040a1340 0x7fe004122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe009bf6700 1 -- 172.21.15.72:0/111930959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe004133fa0 msgr2=0x7fe0041231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe009bf6700 1 --2- 172.21.15.72:0/111930959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe004133fa0 0x7fe0041231d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe009bf6700 1 -- 172.21.15.72:0/111930959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0040a1340 msgr2=0x7fe004122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe009bf6700 1 --2- 172.21.15.72:0/111930959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0040a1340 0x7fe004122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe009bf6700 1 -- 172.21.15.72:0/111930959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0000094a0 con 0x7fe0040a0a30 2023-10-03T10:13:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.628+0000 7fe009bf6700 1 --2- 172.21.15.72:0/111930959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0040a0a30 0x7fe004122750 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe00000b3f0 tx=0x7fe00000b700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.629+0000 7fdffa7fc700 1 -- 172.21.15.72:0/111930959 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000019070 con 0x7fe0040a0a30 2023-10-03T10:13:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.629+0000 7fdffa7fc700 1 -- 172.21.15.72:0/111930959 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00001d410 con 0x7fe0040a0a30 2023-10-03T10:13:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.629+0000 7fdffa7fc700 1 -- 172.21.15.72:0/111930959 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00001d780 con 0x7fe0040a0a30 2023-10-03T10:13:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.629+0000 7fe00be5a700 1 -- 172.21.15.72:0/111930959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff40094a0 con 0x7fe0040a0a30 2023-10-03T10:13:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.629+0000 7fe00be5a700 1 -- 172.21.15.72:0/111930959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0040a25e0 con 0x7fe0040a0a30 2023-10-03T10:13:54.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.630+0000 7fdffa7fc700 1 -- 172.21.15.72:0/111930959 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe00001d8e0 con 0x7fe0040a0a30 2023-10-03T10:13:54.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.630+0000 7fe00be5a700 1 -- 172.21.15.72:0/111930959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe004074ea0 con 0x7fe0040a0a30 2023-10-03T10:13:54.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.630+0000 7fdffa7fc700 1 -- 172.21.15.72:0/111930959 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe000047410 con 0x7fe0040a0a30 2023-10-03T10:13:54.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.635+0000 7fdffa7fc700 1 -- 172.21.15.72:0/111930959 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0000263b0 con 0x7fe0040a0a30 2023-10-03T10:13:54.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.652+0000 7fe74ccc0700 1 Processor -- start 2023-10-03T10:13:54.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.652+0000 7fe74ccc0700 1 -- start start 2023-10-03T10:13:54.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe74ccc0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe74809e1d0 0x7fe748135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe74ccc0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe748135e50 0x7fe748138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe74ccc0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74809f130 con 0x7fe74809d6f0 2023-10-03T10:13:54.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe74ccc0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74809f520 con 0x7fe748135e50 2023-10-03T10:13:54.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe74ccc0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74809e930 con 0x7fe74809e1d0 2023-10-03T10:13:54.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe746d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe748135e50 0x7fe748138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe745d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe74809e1d0 0x7fe748135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe746d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe748135e50 0x7fe748138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43772/0 (socket says 172.21.15.72:43772) 2023-10-03T10:13:54.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe74659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe74809d6f0 0x7fe74809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43098/0 (socket says 172.21.15.72:43098) 2023-10-03T10:13:54.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe746d9d700 1 -- 172.21.15.72:0/478644409 learned_addr learned my addr 172.21.15.72:0/478644409 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:54.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe745d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe74809e1d0 0x7fe748135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42816/0 (socket says 172.21.15.72:42816) 2023-10-03T10:13:54.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe746d9d700 1 -- 172.21.15.72:0/478644409 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe74809e1d0 msgr2=0x7fe748135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe746d9d700 1 --2- 172.21.15.72:0/478644409 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe74809e1d0 0x7fe748135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe74559a700 1 -- 172.21.15.72:0/478644409 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237288913 0 0) 0x7fe74809f130 con 0x7fe74809d6f0 2023-10-03T10:13:54.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe746d9d700 1 -- 172.21.15.72:0/478644409 >> v1:172.21.15.72:6789/0 conn(0x7fe74809d6f0 legacy=0x7fe74809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe746d9d700 1 -- 172.21.15.72:0/478644409 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74809b2d0 con 0x7fe748135e50 2023-10-03T10:13:54.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe745d9b700 1 --2- 172.21.15.72:0/478644409 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe74809e1d0 0x7fe748135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:54.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe746d9d700 1 --2- 172.21.15.72:0/478644409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe748135e50 0x7fe748138230 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe740009eb0 tx=0x7fe74000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351a69f2dddab303 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.653+0000 7fe74559a700 1 -- 172.21.15.72:0/478644409 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74000e070 con 0x7fe748135e50 2023-10-03T10:13:54.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.654+0000 7fe74559a700 1 -- 172.21.15.72:0/478644409 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74000b890 con 0x7fe748135e50 2023-10-03T10:13:54.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.654+0000 7fe74559a700 1 -- 172.21.15.72:0/478644409 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74000bc40 con 0x7fe748135e50 2023-10-03T10:13:54.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.654+0000 7fe74ccc0700 1 -- 172.21.15.72:0/478644409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe748135e50 msgr2=0x7fe748138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.654+0000 7fe74ccc0700 1 --2- 172.21.15.72:0/478644409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe748135e50 0x7fe748138230 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe740009eb0 tx=0x7fe74000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:54.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.654+0000 7fe74ccc0700 1 -- 172.21.15.72:0/478644409 shutdown_connections 2023-10-03T10:13:54.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.654+0000 7fe74ccc0700 1 --2- 172.21.15.72:0/478644409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe748135e50 0x7fe748138230 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.654+0000 7fe74ccc0700 1 --2- 172.21.15.72:0/478644409 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe74809e1d0 0x7fe748135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.654+0000 7fe74ccc0700 1 -- 172.21.15.72:0/478644409 >> 172.21.15.72:0/478644409 conn(0x7fe748066f50 msgr2=0x7fe74809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.654+0000 7fe74ccc0700 1 -- 172.21.15.72:0/478644409 shutdown_connections 2023-10-03T10:13:54.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.654+0000 7fe74ccc0700 1 -- 172.21.15.72:0/478644409 wait complete. 2023-10-03T10:13:54.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.655+0000 7fe74ccc0700 1 Processor -- start 2023-10-03T10:13:54.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.655+0000 7fe74ccc0700 1 -- start start 2023-10-03T10:13:54.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe74ccc0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe74809d6f0 0x7fe7481397b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe74ccc0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe74809e1d0 0x7fe748139cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe74ccc0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe748135e50 0x7fe74813a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe74ccc0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe748121220 con 0x7fe74809e1d0 2023-10-03T10:13:54.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe74ccc0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74811fb90 con 0x7fe74809d6f0 2023-10-03T10:13:54.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe74ccc0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7480a2020 con 0x7fe748135e50 2023-10-03T10:13:54.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe746d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe748135e50 0x7fe74813a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe746d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe748135e50 0x7fe74813a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57606/0 (socket says 172.21.15.72:57606) 2023-10-03T10:13:54.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe746d9d700 1 -- 172.21.15.72:0/2046429925 learned_addr learned my addr 172.21.15.72:0/2046429925 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:54.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe74659c700 1 --2- 172.21.15.72:0/2046429925 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe74809d6f0 0x7fe7481397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe745d9b700 1 --2- 172.21.15.72:0/2046429925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe74809e1d0 0x7fe748139cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe746d9d700 1 -- 172.21.15.72:0/2046429925 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe74809d6f0 msgr2=0x7fe7481397b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe746d9d700 1 --2- 172.21.15.72:0/2046429925 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe74809d6f0 0x7fe7481397b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe746d9d700 1 -- 172.21.15.72:0/2046429925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe74809e1d0 msgr2=0x7fe748139cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe746d9d700 1 --2- 172.21.15.72:0/2046429925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe74809e1d0 0x7fe748139cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.656+0000 7fe746d9d700 1 -- 172.21.15.72:0/2046429925 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c0094a0 con 0x7fe748135e50 2023-10-03T10:13:54.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.657+0000 7fe746d9d700 1 --2- 172.21.15.72:0/2046429925 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe748135e50 0x7fe74813a230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe740012000 tx=0x7fe740004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.657+0000 7fe736ffd700 1 -- 172.21.15.72:0/2046429925 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7400092e0 con 0x7fe748135e50 2023-10-03T10:13:54.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.657+0000 7fe736ffd700 1 -- 172.21.15.72:0/2046429925 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe740004250 con 0x7fe748135e50 2023-10-03T10:13:54.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.657+0000 7fe74ccc0700 1 -- 172.21.15.72:0/2046429925 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe740009b30 con 0x7fe748135e50 2023-10-03T10:13:54.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.657+0000 7fe736ffd700 1 -- 172.21.15.72:0/2046429925 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740004600 con 0x7fe748135e50 2023-10-03T10:13:54.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.657+0000 7fe74ccc0700 1 -- 172.21.15.72:0/2046429925 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74809c750 con 0x7fe748135e50 2023-10-03T10:13:54.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.658+0000 7fe74ccc0700 1 -- 172.21.15.72:0/2046429925 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe748071700 con 0x7fe748135e50 2023-10-03T10:13:54.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.658+0000 7fe736ffd700 1 -- 172.21.15.72:0/2046429925 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe740004760 con 0x7fe748135e50 2023-10-03T10:13:54.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.659+0000 7fe736ffd700 1 -- 172.21.15.72:0/2046429925 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe740040c70 con 0x7fe748135e50 2023-10-03T10:13:54.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.664+0000 7fe736ffd700 1 -- 172.21.15.72:0/2046429925 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe740019350 con 0x7fe748135e50 2023-10-03T10:13:54.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.668+0000 7f9c944d7700 1 Processor -- start 2023-10-03T10:13:54.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.668+0000 7f9c944d7700 1 -- start start 2023-10-03T10:13:54.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c944d7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c8c09d6f0 0x7f9c8c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c944d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c8c09e000 0x7f9c8c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c944d7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c8c09e410 0x7f9c8c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c944d7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8c09f520 con 0x7f9c8c09e410 2023-10-03T10:13:54.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c944d7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c09f130 con 0x7f9c8c09e000 2023-10-03T10:13:54.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c944d7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c09e930 con 0x7f9c8c09d6f0 2023-10-03T10:13:54.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c92a74700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c8c09e410 0x7f9c8c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c92273700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c8c09d6f0 0x7f9c8c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c92a74700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c8c09e410 0x7f9c8c130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43794/0 (socket says 172.21.15.72:43794) 2023-10-03T10:13:54.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c92a74700 1 -- 172.21.15.72:0/131014621 learned_addr learned my addr 172.21.15.72:0/131014621 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:54.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c91a72700 1 --2- 172.21.15.72:0/131014621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c8c09e000 0x7f9c8c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c92273700 1 -- 172.21.15.72:0/131014621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c8c09e000 msgr2=0x7f9c8c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c92273700 1 --2- 172.21.15.72:0/131014621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c8c09e000 0x7f9c8c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c92273700 1 -- 172.21.15.72:0/131014621 >> v2:172.21.15.72:3300/0 conn(0x7f9c8c09e410 msgr2=0x7f9c8c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:54.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c92273700 1 --2- 172.21.15.72:0/131014621 >> v2:172.21.15.72:3300/0 conn(0x7f9c8c09e410 0x7f9c8c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c92273700 1 -- 172.21.15.72:0/131014621 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c09b2d0 con 0x7f9c8c09d6f0 2023-10-03T10:13:54.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.669+0000 7f9c92273700 1 --2- 172.21.15.72:0/131014621 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c8c09d6f0 0x7f9c8c09dac0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009870 tx=0x7f9c88009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f9da72fb0220116 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.670+0000 7f9c91271700 1 -- 172.21.15.72:0/131014621 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c88011830 con 0x7f9c8c09d6f0 2023-10-03T10:13:54.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.670+0000 7f9c91271700 1 -- 172.21.15.72:0/131014621 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c88011990 con 0x7f9c8c09d6f0 2023-10-03T10:13:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.670+0000 7f9c91271700 1 -- 172.21.15.72:0/131014621 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c88011d20 con 0x7f9c8c09d6f0 2023-10-03T10:13:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.670+0000 7f9c944d7700 1 -- 172.21.15.72:0/131014621 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c8c09d6f0 msgr2=0x7f9c8c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.670+0000 7f9c944d7700 1 --2- 172.21.15.72:0/131014621 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c8c09d6f0 0x7f9c8c09dac0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009870 tx=0x7f9c88009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.670+0000 7f9c944d7700 1 -- 172.21.15.72:0/131014621 shutdown_connections 2023-10-03T10:13:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.670+0000 7f9c944d7700 1 --2- 172.21.15.72:0/131014621 >> v2:172.21.15.72:3300/0 conn(0x7f9c8c09e410 0x7f9c8c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.670+0000 7f9c944d7700 1 --2- 172.21.15.72:0/131014621 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c8c09d6f0 0x7f9c8c09dac0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.670+0000 7f9c944d7700 1 --2- 172.21.15.72:0/131014621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c8c09e000 0x7f9c8c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.670+0000 7f9c944d7700 1 -- 172.21.15.72:0/131014621 >> 172.21.15.72:0/131014621 conn(0x7f9c8c066f50 msgr2=0x7f9c8c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.670+0000 7f9c944d7700 1 -- 172.21.15.72:0/131014621 shutdown_connections 2023-10-03T10:13:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.671+0000 7f9c944d7700 1 -- 172.21.15.72:0/131014621 wait complete. 2023-10-03T10:13:54.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.672+0000 7f9c944d7700 1 Processor -- start 2023-10-03T10:13:54.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.672+0000 7f9c944d7700 1 -- start start 2023-10-03T10:13:54.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.672+0000 7f9c944d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c8c09d6f0 0x7f9c8c11de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.672+0000 7f9c944d7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c8c09e000 0x7f9c8c11e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.672+0000 7f9c944d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c8c09e410 0x7f9c8c11e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:54.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.672+0000 7f9c944d7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c11fa60 con 0x7f9c8c09d6f0 2023-10-03T10:13:54.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.672+0000 7f9c944d7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c120080 con 0x7f9c8c09e410 2023-10-03T10:13:54.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.672+0000 7f9c944d7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c120cb0 con 0x7f9c8c09e000 2023-10-03T10:13:54.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.673+0000 7f9c91a72700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c8c09e000 0x7f9c8c11e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.673+0000 7f9c91a72700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c8c09e000 0x7f9c8c11e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57632/0 (socket says 172.21.15.72:57632) 2023-10-03T10:13:54.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.673+0000 7f9c91a72700 1 -- 172.21.15.72:0/3010244928 learned_addr learned my addr 172.21.15.72:0/3010244928 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:54.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.673+0000 7f9c92a74700 1 --2- 172.21.15.72:0/3010244928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c8c09e410 0x7f9c8c11e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.673+0000 7f9c92273700 1 --2- 172.21.15.72:0/3010244928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c8c09d6f0 0x7f9c8c11de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:54.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.673+0000 7f9c91a72700 1 -- 172.21.15.72:0/3010244928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c8c09e410 msgr2=0x7f9c8c11e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.673+0000 7f9c91a72700 1 --2- 172.21.15.72:0/3010244928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c8c09e410 0x7f9c8c11e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.673+0000 7f9c91a72700 1 -- 172.21.15.72:0/3010244928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c8c09d6f0 msgr2=0x7f9c8c11de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.673+0000 7f9c91a72700 1 --2- 172.21.15.72:0/3010244928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c8c09d6f0 0x7f9c8c11de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.673+0000 7f9c91a72700 1 -- 172.21.15.72:0/3010244928 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c880094a0 con 0x7f9c8c09e000 2023-10-03T10:13:54.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.673+0000 7f9c92a74700 1 --2- 172.21.15.72:0/3010244928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c8c09e410 0x7f9c8c11e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:54.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.673+0000 7f9c91a72700 1 --2- 172.21.15.72:0/3010244928 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c8c09e000 0x7f9c8c11e390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00e810 tx=0x7f9c7c00ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:54.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.673+0000 7f9c82ffd700 1 -- 172.21.15.72:0/3010244928 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c004230 con 0x7f9c8c09e000 2023-10-03T10:13:54.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.673+0000 7f9c82ffd700 1 -- 172.21.15.72:0/3010244928 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c004390 con 0x7f9c8c09e000 2023-10-03T10:13:54.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.674+0000 7f9c944d7700 1 -- 172.21.15.72:0/3010244928 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8c121690 con 0x7f9c8c09e000 2023-10-03T10:13:54.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.674+0000 7f9c82ffd700 1 -- 172.21.15.72:0/3010244928 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0036a0 con 0x7f9c8c09e000 2023-10-03T10:13:54.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.674+0000 7f9c944d7700 1 -- 172.21.15.72:0/3010244928 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8c09c700 con 0x7f9c8c09e000 2023-10-03T10:13:54.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.674+0000 7f9c944d7700 1 -- 172.21.15.72:0/3010244928 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c074ea0 con 0x7f9c8c09e000 2023-10-03T10:13:54.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.675+0000 7f9c82ffd700 1 -- 172.21.15.72:0/3010244928 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c7c003800 con 0x7f9c8c09e000 2023-10-03T10:13:54.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.675+0000 7f9c82ffd700 1 -- 172.21.15.72:0/3010244928 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9c7c03f9b0 con 0x7f9c8c09e000 2023-10-03T10:13:54.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.680+0000 7f9c82ffd700 1 -- 172.21.15.72:0/3010244928 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c7c0257a0 con 0x7f9c8c09e000 2023-10-03T10:13:54.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.795+0000 7faf44058700 1 -- 172.21.15.72:0/4160845310 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faf3c0a1d10 con 0x7faf3c139250 2023-10-03T10:13:54.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.795+0000 7faf327fc700 1 -- 172.21.15.72:0/4160845310 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf34012340 con 0x7faf3c139250 2023-10-03T10:13:54.796 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:54.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.797+0000 7faf44058700 1 -- 172.21.15.72:0/4160845310 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf3c139250 msgr2=0x7faf3c122930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.797+0000 7faf44058700 1 --2- 172.21.15.72:0/4160845310 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf3c139250 0x7faf3c122930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faf3400ef90 tx=0x7faf3400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.797+0000 7faf44058700 1 -- 172.21.15.72:0/4160845310 shutdown_connections 2023-10-03T10:13:54.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.797+0000 7faf44058700 1 --2- 172.21.15.72:0/4160845310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf3c0a0a30 0x7faf3c1c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.797+0000 7faf44058700 1 --2- 172.21.15.72:0/4160845310 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf3c139250 0x7faf3c122930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.797+0000 7faf44058700 1 --2- 172.21.15.72:0/4160845310 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf3c0a1510 0x7faf3c1c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.797+0000 7faf44058700 1 -- 172.21.15.72:0/4160845310 >> 172.21.15.72:0/4160845310 conn(0x7faf3c0a6550 msgr2=0x7faf3c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.797+0000 7faf44058700 1 -- 172.21.15.72:0/4160845310 shutdown_connections 2023-10-03T10:13:54.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.797+0000 7faf44058700 1 -- 172.21.15.72:0/4160845310 wait complete. 2023-10-03T10:13:54.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:54.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.861+0000 7fe74ccc0700 1 -- 172.21.15.72:0/2046429925 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe748120da0 con 0x7fe748135e50 2023-10-03T10:13:54.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.861+0000 7fe736ffd700 1 -- 172.21.15.72:0/2046429925 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe748120da0 con 0x7fe748135e50 2023-10-03T10:13:54.862 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:54.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.863+0000 7fe74ccc0700 1 -- 172.21.15.72:0/2046429925 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe748135e50 msgr2=0x7fe74813a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.863+0000 7fe74ccc0700 1 --2- 172.21.15.72:0/2046429925 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe748135e50 0x7fe74813a230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe740012000 tx=0x7fe740004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.863+0000 7fe74ccc0700 1 -- 172.21.15.72:0/2046429925 shutdown_connections 2023-10-03T10:13:54.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.863+0000 7fe74ccc0700 1 --2- 172.21.15.72:0/2046429925 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe748135e50 0x7fe74813a230 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.863+0000 7fe74ccc0700 1 --2- 172.21.15.72:0/2046429925 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe74809d6f0 0x7fe7481397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.863+0000 7fe74ccc0700 1 --2- 172.21.15.72:0/2046429925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe74809e1d0 0x7fe748139cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.863+0000 7fe74ccc0700 1 -- 172.21.15.72:0/2046429925 >> 172.21.15.72:0/2046429925 conn(0x7fe748066f50 msgr2=0x7fe74806e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.863+0000 7fe74ccc0700 1 -- 172.21.15.72:0/2046429925 shutdown_connections 2023-10-03T10:13:54.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.863+0000 7fe74ccc0700 1 -- 172.21.15.72:0/2046429925 wait complete. 2023-10-03T10:13:54.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:54.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.877+0000 7f9c944d7700 1 -- 172.21.15.72:0/3010244928 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9c8c06c360 con 0x7f9c8c09e000 2023-10-03T10:13:54.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.877+0000 7f9c82ffd700 1 -- 172.21.15.72:0/3010244928 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9c7c02b090 con 0x7f9c8c09e000 2023-10-03T10:13:54.878 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:54.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.879+0000 7fe00be5a700 1 -- 172.21.15.72:0/111930959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe0040a28e0 con 0x7fe0040a0a30 2023-10-03T10:13:54.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.879+0000 7f9c944d7700 1 -- 172.21.15.72:0/3010244928 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c8c09e000 msgr2=0x7f9c8c11e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.879+0000 7f9c944d7700 1 --2- 172.21.15.72:0/3010244928 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c8c09e000 0x7f9c8c11e390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00e810 tx=0x7f9c7c00ebd0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.879+0000 7f9c944d7700 1 -- 172.21.15.72:0/3010244928 shutdown_connections 2023-10-03T10:13:54.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.879+0000 7f9c944d7700 1 --2- 172.21.15.72:0/3010244928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c8c09d6f0 0x7f9c8c11de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.879+0000 7f9c944d7700 1 --2- 172.21.15.72:0/3010244928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c8c09e410 0x7f9c8c11e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.879+0000 7f9c944d7700 1 --2- 172.21.15.72:0/3010244928 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c8c09e000 0x7f9c8c11e390 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.879+0000 7f9c944d7700 1 -- 172.21.15.72:0/3010244928 >> 172.21.15.72:0/3010244928 conn(0x7f9c8c066f50 msgr2=0x7f9c8c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.879+0000 7fdffa7fc700 1 -- 172.21.15.72:0/111930959 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0000242c0 con 0x7fe0040a0a30 2023-10-03T10:13:54.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.879+0000 7f9c944d7700 1 -- 172.21.15.72:0/3010244928 shutdown_connections 2023-10-03T10:13:54.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.879+0000 7f9c944d7700 1 -- 172.21.15.72:0/3010244928 wait complete. 2023-10-03T10:13:54.881 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:54.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.881+0000 7fe00be5a700 1 -- 172.21.15.72:0/111930959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0040a0a30 msgr2=0x7fe004122750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:54.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.881+0000 7fe00be5a700 1 --2- 172.21.15.72:0/111930959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0040a0a30 0x7fe004122750 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe00000b3f0 tx=0x7fe00000b700 comp rx=0 tx=0).stop 2023-10-03T10:13:54.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.881+0000 7fe00be5a700 1 -- 172.21.15.72:0/111930959 shutdown_connections 2023-10-03T10:13:54.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.881+0000 7fe00be5a700 1 --2- 172.21.15.72:0/111930959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe004133fa0 0x7fe0041231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.881+0000 7fe00be5a700 1 --2- 172.21.15.72:0/111930959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0040a0a30 0x7fe004122750 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.881+0000 7fe00be5a700 1 --2- 172.21.15.72:0/111930959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0040a1340 0x7fe004122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:54.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.881+0000 7fe00be5a700 1 -- 172.21.15.72:0/111930959 >> 172.21.15.72:0/111930959 conn(0x7fe0040a6550 msgr2=0x7fe00411c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:54.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.881+0000 7fe00be5a700 1 -- 172.21.15.72:0/111930959 shutdown_connections 2023-10-03T10:13:54.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:54.881+0000 7fe00be5a700 1 -- 172.21.15.72:0/111930959 wait complete. 2023-10-03T10:13:54.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:54.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:55.811 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:55.876 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:55.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:55.896 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:55.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.953+0000 7fe4b76dc700 1 Processor -- start 2023-10-03T10:13:55.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.954+0000 7fe4b76dc700 1 -- start start 2023-10-03T10:13:55.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.954+0000 7fe4b76dc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4b0136830 0x7fe4b0138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.954+0000 7fe4b76dc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4b0139150 0x7fe4b013b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.954+0000 7fe4b76dc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b006f720 con 0x7fe4b01338c0 2023-10-03T10:13:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.954+0000 7fe4b76dc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b0070c80 con 0x7fe4b0139150 2023-10-03T10:13:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.954+0000 7fe4b76dc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b006fce0 con 0x7fe4b0136830 2023-10-03T10:13:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.955+0000 7fe4b5c79700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4b0139150 0x7fe4b013b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.955+0000 7fe4b5c79700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4b0139150 0x7fe4b013b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43808/0 (socket says 172.21.15.72:43808) 2023-10-03T10:13:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.955+0000 7fe4b5c79700 1 -- 172.21.15.72:0/3152586475 learned_addr learned my addr 172.21.15.72:0/3152586475 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.955+0000 7fe4b5c79700 1 -- 172.21.15.72:0/3152586475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4b0136830 msgr2=0x7fe4b0138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.955+0000 7fe4b5c79700 1 --2- 172.21.15.72:0/3152586475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4b0136830 0x7fe4b0138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.955+0000 7fe4b5c79700 1 -- 172.21.15.72:0/3152586475 >> v1:172.21.15.72:6789/0 conn(0x7fe4b01338c0 legacy=0x7fe4b0133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.955+0000 7fe4b5c79700 1 -- 172.21.15.72:0/3152586475 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b01336a0 con 0x7fe4b0139150 2023-10-03T10:13:55.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.955+0000 7fe4b5c79700 1 --2- 172.21.15.72:0/3152586475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4b0139150 0x7fe4b013b530 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8009e50 tx=0x7fe4a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b043c1d39fd38dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.955+0000 7fe4a7fff700 1 -- 172.21.15.72:0/3152586475 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a800e070 con 0x7fe4b0139150 2023-10-03T10:13:55.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.955+0000 7fe4a7fff700 1 -- 172.21.15.72:0/3152586475 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a800b9c0 con 0x7fe4b0139150 2023-10-03T10:13:55.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.955+0000 7fe4a7fff700 1 -- 172.21.15.72:0/3152586475 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a800bd70 con 0x7fe4b0139150 2023-10-03T10:13:55.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.956+0000 7fe4b76dc700 1 -- 172.21.15.72:0/3152586475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4b0139150 msgr2=0x7fe4b013b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.956+0000 7fe4b76dc700 1 --2- 172.21.15.72:0/3152586475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4b0139150 0x7fe4b013b530 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8009e50 tx=0x7fe4a800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:55.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.956+0000 7fe4b76dc700 1 -- 172.21.15.72:0/3152586475 shutdown_connections 2023-10-03T10:13:55.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.956+0000 7fe4b76dc700 1 --2- 172.21.15.72:0/3152586475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4b0139150 0x7fe4b013b530 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.956+0000 7fe4b76dc700 1 --2- 172.21.15.72:0/3152586475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4b0136830 0x7fe4b0138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.956+0000 7fe4b76dc700 1 -- 172.21.15.72:0/3152586475 >> 172.21.15.72:0/3152586475 conn(0x7fe4b00a2aa0 msgr2=0x7fe4b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:55.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.957+0000 7fe4b76dc700 1 -- 172.21.15.72:0/3152586475 shutdown_connections 2023-10-03T10:13:55.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.957+0000 7fe4b76dc700 1 -- 172.21.15.72:0/3152586475 wait complete. 2023-10-03T10:13:55.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.957+0000 7fe4b76dc700 1 Processor -- start 2023-10-03T10:13:55.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.958+0000 7fe4b76dc700 1 -- start start 2023-10-03T10:13:55.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.958+0000 7fe4b76dc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4b01338c0 0x7fe4b01c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.958+0000 7fe4b76dc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4b0136830 0x7fe4b01c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.958+0000 7fe4b76dc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4b0139150 0x7fe4b0119d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:55.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.958+0000 7fe4b76dc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b011bab0 con 0x7fe4b0136830 2023-10-03T10:13:55.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.958+0000 7fe4b76dc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b011b8c0 con 0x7fe4b0139150 2023-10-03T10:13:55.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.958+0000 7fe4b76dc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b006f960 con 0x7fe4b01338c0 2023-10-03T10:13:55.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.958+0000 7fe4b4c77700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4b0136830 0x7fe4b01c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.958+0000 7fe4b4c77700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4b0136830 0x7fe4b01c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43812/0 (socket says 172.21.15.72:43812) 2023-10-03T10:13:55.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.958+0000 7fe4b4c77700 1 -- 172.21.15.72:0/3509043781 learned_addr learned my addr 172.21.15.72:0/3509043781 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:55.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.958+0000 7fe4b5c79700 1 --2- 172.21.15.72:0/3509043781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4b0139150 0x7fe4b0119d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.958+0000 7fe4b5478700 1 --2- 172.21.15.72:0/3509043781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4b01338c0 0x7fe4b01c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:55.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.958+0000 7fe4b4c77700 1 -- 172.21.15.72:0/3509043781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4b01338c0 msgr2=0x7fe4b01c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.958+0000 7fe4b4c77700 1 --2- 172.21.15.72:0/3509043781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4b01338c0 0x7fe4b01c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.959+0000 7fe4b4c77700 1 -- 172.21.15.72:0/3509043781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4b0139150 msgr2=0x7fe4b0119d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:55.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.959+0000 7fe4b4c77700 1 --2- 172.21.15.72:0/3509043781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4b0139150 0x7fe4b0119d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:55.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.959+0000 7fe4b4c77700 1 -- 172.21.15.72:0/3509043781 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a8009b30 con 0x7fe4b0136830 2023-10-03T10:13:55.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.959+0000 7fe4b5c79700 1 --2- 172.21.15.72:0/3509043781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4b0139150 0x7fe4b0119d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:55.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.959+0000 7fe4b4c77700 1 --2- 172.21.15.72:0/3509043781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4b0136830 0x7fe4b01c8a80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000b500 tx=0x7fe4a000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:55.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.959+0000 7fe4a5ffb700 1 -- 172.21.15.72:0/3509043781 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0011830 con 0x7fe4b0136830 2023-10-03T10:13:55.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.959+0000 7fe4a5ffb700 1 -- 172.21.15.72:0/3509043781 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a0011990 con 0x7fe4b0136830 2023-10-03T10:13:55.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.959+0000 7fe4b76dc700 1 -- 172.21.15.72:0/3509043781 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b011d7d0 con 0x7fe4b0136830 2023-10-03T10:13:55.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.959+0000 7fe4a5ffb700 1 -- 172.21.15.72:0/3509043781 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0011d40 con 0x7fe4b0136830 2023-10-03T10:13:55.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.959+0000 7fe4b76dc700 1 -- 172.21.15.72:0/3509043781 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b011d4f0 con 0x7fe4b0136830 2023-10-03T10:13:55.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.960+0000 7fe4a5ffb700 1 -- 172.21.15.72:0/3509043781 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4a001a400 con 0x7fe4b0136830 2023-10-03T10:13:55.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.960+0000 7fe4b76dc700 1 -- 172.21.15.72:0/3509043781 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b011d190 con 0x7fe4b0136830 2023-10-03T10:13:55.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.960+0000 7fe4a5ffb700 1 -- 172.21.15.72:0/3509043781 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe4a003f750 con 0x7fe4b0136830 2023-10-03T10:13:55.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:55.969+0000 7fe4a5ffb700 1 -- 172.21.15.72:0/3509043781 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4b011d190 con 0x7fe4b0136830 2023-10-03T10:13:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.042+0000 7f466ba91700 1 Processor -- start 2023-10-03T10:13:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.042+0000 7f466ba91700 1 -- start start 2023-10-03T10:13:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.043+0000 7f466ba91700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f46641316c0 0x7f4664131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.043+0000 7f466ba91700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f466409d9f0 0x7f466406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.043+0000 7f466ba91700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466409e130 con 0x7f466406acb0 2023-10-03T10:13:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.043+0000 7f466ba91700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46641312b0 con 0x7f46641316c0 2023-10-03T10:13:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.043+0000 7f466ba91700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f466409f6e0 con 0x7f466409d9f0 2023-10-03T10:13:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.043+0000 7f466982d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f46641316c0 0x7f4664131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.043+0000 7f466a02e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f466406acb0 0x7f4664138540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43118/0 (socket says 172.21.15.72:43118) 2023-10-03T10:13:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.043+0000 7f466a02e700 1 -- 172.21.15.72:0/3293214655 learned_addr learned my addr 172.21.15.72:0/3293214655 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.044+0000 7f466902c700 1 --2- 172.21.15.72:0/3293214655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f466409d9f0 0x7f466406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.044+0000 7f466982d700 1 -- 172.21.15.72:0/3293214655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f466409d9f0 msgr2=0x7f466406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.044+0000 7f466982d700 1 --2- 172.21.15.72:0/3293214655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f466409d9f0 0x7f466406a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.044+0000 7f466982d700 1 -- 172.21.15.72:0/3293214655 >> v1:172.21.15.72:6789/0 conn(0x7f466406acb0 legacy=0x7f4664138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.044+0000 7f466982d700 1 -- 172.21.15.72:0/3293214655 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466409e760 con 0x7f46641316c0 2023-10-03T10:13:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.044+0000 7f466882b700 1 -- 172.21.15.72:0/3293214655 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269340867 0 0) 0x7f465c001490 con 0x7f466406acb0 2023-10-03T10:13:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.044+0000 7f466982d700 1 --2- 172.21.15.72:0/3293214655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46641316c0 0x7f4664131a90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4660009840 tx=0x7f4660009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fab402e095a2425 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.044+0000 7f466882b700 1 -- 172.21.15.72:0/3293214655 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660011830 con 0x7f46641316c0 2023-10-03T10:13:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.044+0000 7f466882b700 1 -- 172.21.15.72:0/3293214655 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4660011990 con 0x7f46641316c0 2023-10-03T10:13:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.044+0000 7f466882b700 1 -- 172.21.15.72:0/3293214655 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660011d20 con 0x7f46641316c0 2023-10-03T10:13:56.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.045+0000 7f466ba91700 1 -- 172.21.15.72:0/3293214655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46641316c0 msgr2=0x7f4664131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.045+0000 7f466ba91700 1 --2- 172.21.15.72:0/3293214655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46641316c0 0x7f4664131a90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4660009840 tx=0x7f4660009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:56.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.045+0000 7f466ba91700 1 -- 172.21.15.72:0/3293214655 shutdown_connections 2023-10-03T10:13:56.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.045+0000 7f466ba91700 1 --2- 172.21.15.72:0/3293214655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46641316c0 0x7f4664131a90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.045+0000 7f466ba91700 1 --2- 172.21.15.72:0/3293214655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f466409d9f0 0x7f466406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.045+0000 7f466ba91700 1 -- 172.21.15.72:0/3293214655 >> 172.21.15.72:0/3293214655 conn(0x7f4664066f50 msgr2=0x7f466409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.045+0000 7f466ba91700 1 -- 172.21.15.72:0/3293214655 shutdown_connections 2023-10-03T10:13:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.045+0000 7f466ba91700 1 -- 172.21.15.72:0/3293214655 wait complete. 2023-10-03T10:13:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.046+0000 7f466ba91700 1 Processor -- start 2023-10-03T10:13:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.047+0000 7f466ba91700 1 -- start start 2023-10-03T10:13:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.047+0000 7f466ba91700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f466406acb0 0x7f46641c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.047+0000 7f466ba91700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f466409d9f0 0x7f46641c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.047+0000 7f466ba91700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46641316c0 0x7f46641c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.047+0000 7f466ba91700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466409c3d0 con 0x7f466406acb0 2023-10-03T10:13:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.047+0000 7f466ba91700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466409bdd0 con 0x7f46641316c0 2023-10-03T10:13:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.047+0000 7f466ba91700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f466409a8c0 con 0x7f466409d9f0 2023-10-03T10:13:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.047+0000 7f466982d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f466406acb0 0x7f46641c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.047+0000 7f466982d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f466406acb0 0x7f46641c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43836/0 (socket says 172.21.15.72:43836) 2023-10-03T10:13:56.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.047+0000 7f466982d700 1 -- 172.21.15.72:0/294251757 learned_addr learned my addr 172.21.15.72:0/294251757 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:56.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.047+0000 7f466a02e700 1 --2- 172.21.15.72:0/294251757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46641316c0 0x7f46641c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.047+0000 7f466902c700 1 --2- 172.21.15.72:0/294251757 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f466409d9f0 0x7f46641c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.048+0000 7f466982d700 1 -- 172.21.15.72:0/294251757 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f466409d9f0 msgr2=0x7f46641c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.048+0000 7f466982d700 1 --2- 172.21.15.72:0/294251757 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f466409d9f0 0x7f46641c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.048+0000 7f466982d700 1 -- 172.21.15.72:0/294251757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46641316c0 msgr2=0x7f46641c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.048+0000 7f466982d700 1 --2- 172.21.15.72:0/294251757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46641316c0 0x7f46641c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.048+0000 7f466982d700 1 -- 172.21.15.72:0/294251757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46600094a0 con 0x7f466406acb0 2023-10-03T10:13:56.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.048+0000 7f466a02e700 1 --2- 172.21.15.72:0/294251757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46641316c0 0x7f46641c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.048+0000 7f466982d700 1 --2- 172.21.15.72:0/294251757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f466406acb0 0x7f46641c8330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f46600090b0 tx=0x7f4660004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.048+0000 7f465a7fc700 1 -- 172.21.15.72:0/294251757 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660004550 con 0x7f466406acb0 2023-10-03T10:13:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.048+0000 7f465a7fc700 1 -- 172.21.15.72:0/294251757 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466001f070 con 0x7f466406acb0 2023-10-03T10:13:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.048+0000 7f465a7fc700 1 -- 172.21.15.72:0/294251757 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46600038e0 con 0x7f466406acb0 2023-10-03T10:13:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.048+0000 7f466ba91700 1 -- 172.21.15.72:0/294251757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46640a35d0 con 0x7f466406acb0 2023-10-03T10:13:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.048+0000 7f466ba91700 1 -- 172.21.15.72:0/294251757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46640707c0 con 0x7f466406acb0 2023-10-03T10:13:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.049+0000 7f465a7fc700 1 -- 172.21.15.72:0/294251757 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4660003a40 con 0x7f466406acb0 2023-10-03T10:13:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.049+0000 7f466ba91700 1 -- 172.21.15.72:0/294251757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466409b8a0 con 0x7f466406acb0 2023-10-03T10:13:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.049+0000 7f465a7fc700 1 -- 172.21.15.72:0/294251757 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4660021070 con 0x7f466406acb0 2023-10-03T10:13:56.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.053+0000 7f0528b7e700 1 Processor -- start 2023-10-03T10:13:56.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.053+0000 7f0528b7e700 1 -- start start 2023-10-03T10:13:56.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.054+0000 7f0528b7e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f052409d6f0 0x7f052409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.054+0000 7f0528b7e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f052409e410 0x7f0524130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.054+0000 7f0528b7e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052409f130 con 0x7f052409e000 2023-10-03T10:13:56.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.054+0000 7f0528b7e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052409f520 con 0x7f052409d6f0 2023-10-03T10:13:56.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.054+0000 7f0528b7e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f052409e930 con 0x7f052409e410 2023-10-03T10:13:56.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.054+0000 7f0522d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f052409e410 0x7f0524130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.054+0000 7f0522d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f052409e410 0x7f0524130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57694/0 (socket says 172.21.15.72:57694) 2023-10-03T10:13:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.054+0000 7f0522d9d700 1 -- 172.21.15.72:0/1872920669 learned_addr learned my addr 172.21.15.72:0/1872920669 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.054+0000 7f052259c700 1 --2- 172.21.15.72:0/1872920669 >> v2:172.21.15.72:3300/0 conn(0x7f052409d6f0 0x7f052409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.054+0000 7f052259c700 1 -- 172.21.15.72:0/1872920669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f052409e410 msgr2=0x7f0524130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.054+0000 7f052259c700 1 --2- 172.21.15.72:0/1872920669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f052409e410 0x7f0524130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.054+0000 7f052259c700 1 -- 172.21.15.72:0/1872920669 >> v1:172.21.15.72:6789/0 conn(0x7f052409e000 legacy=0x7f0524130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.054+0000 7f052259c700 1 -- 172.21.15.72:0/1872920669 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052409b2d0 con 0x7f052409d6f0 2023-10-03T10:13:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.054+0000 7f0522d9d700 1 --2- 172.21.15.72:0/1872920669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f052409e410 0x7f0524130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.054+0000 7f052259c700 1 --2- 172.21.15.72:0/1872920669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052409d6f0 0x7f052409dac0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0514009840 tx=0x7f0514009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877ff5f725dcd4ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.055+0000 7f21acfec700 1 Processor -- start 2023-10-03T10:13:56.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.056+0000 7f21acfec700 1 -- start start 2023-10-03T10:13:56.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.056+0000 7f21acfec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21a809d6f0 0x7f21a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.056+0000 7f21acfec700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21a809e410 0x7f21a8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.056+0000 7f21acfec700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a809f130 con 0x7f21a809e000 2023-10-03T10:13:56.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.056+0000 7f21acfec700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a809f520 con 0x7f21a809e410 2023-10-03T10:13:56.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.056+0000 7f21acfec700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21a809e930 con 0x7f21a809d6f0 2023-10-03T10:13:56.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.056+0000 7f21a659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21a809d6f0 0x7f21a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.056+0000 7f21a6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21a809e410 0x7f21a8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.056+0000 7f21a659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21a809d6f0 0x7f21a809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57696/0 (socket says 172.21.15.72:57696) 2023-10-03T10:13:56.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.056+0000 7f21a659c700 1 -- 172.21.15.72:0/1693289448 learned_addr learned my addr 172.21.15.72:0/1693289448 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:56.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.057+0000 7f21a659c700 1 -- 172.21.15.72:0/1693289448 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21a809e410 msgr2=0x7f21a8130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:56.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.057+0000 7f21a659c700 1 --2- 172.21.15.72:0/1693289448 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21a809e410 0x7f21a8130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.057+0000 7f21a659c700 1 -- 172.21.15.72:0/1693289448 >> v1:172.21.15.72:6789/0 conn(0x7f21a809e000 legacy=0x7f21a8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.057+0000 7f21a659c700 1 -- 172.21.15.72:0/1693289448 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a809b2d0 con 0x7f21a809d6f0 2023-10-03T10:13:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.057+0000 7f21a6d9d700 1 --2- 172.21.15.72:0/1693289448 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21a809e410 0x7f21a8130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.057+0000 7f21a659c700 1 --2- 172.21.15.72:0/1693289448 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21a809d6f0 0x7f21a809dac0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2198009920 tx=0x7f2198009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2f76f1e1965e18f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.057+0000 7f21a559a700 1 -- 172.21.15.72:0/1693289448 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198011830 con 0x7f21a809d6f0 2023-10-03T10:13:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.057+0000 7f21a559a700 1 -- 172.21.15.72:0/1693289448 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2198011990 con 0x7f21a809d6f0 2023-10-03T10:13:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.057+0000 7f21a559a700 1 -- 172.21.15.72:0/1693289448 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198011d20 con 0x7f21a809d6f0 2023-10-03T10:13:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.057+0000 7f21acfec700 1 -- 172.21.15.72:0/1693289448 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21a809d6f0 msgr2=0x7f21a809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.057+0000 7f21acfec700 1 --2- 172.21.15.72:0/1693289448 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21a809d6f0 0x7f21a809dac0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2198009920 tx=0x7f2198009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.058+0000 7f21acfec700 1 -- 172.21.15.72:0/1693289448 shutdown_connections 2023-10-03T10:13:56.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.058+0000 7f21acfec700 1 --2- 172.21.15.72:0/1693289448 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21a809e410 0x7f21a8130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.058+0000 7f21acfec700 1 --2- 172.21.15.72:0/1693289448 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21a809d6f0 0x7f21a809dac0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.058+0000 7f21acfec700 1 -- 172.21.15.72:0/1693289448 >> 172.21.15.72:0/1693289448 conn(0x7f21a8066f50 msgr2=0x7f21a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.058+0000 7f21acfec700 1 -- 172.21.15.72:0/1693289448 shutdown_connections 2023-10-03T10:13:56.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.058+0000 7f21acfec700 1 -- 172.21.15.72:0/1693289448 wait complete. 2023-10-03T10:13:56.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.058+0000 7f052159a700 1 -- 172.21.15.72:0/1872920669 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0514011830 con 0x7f052409d6f0 2023-10-03T10:13:56.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.058+0000 7f052159a700 1 -- 172.21.15.72:0/1872920669 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0514011990 con 0x7f052409d6f0 2023-10-03T10:13:56.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.058+0000 7f465a7fc700 1 -- 172.21.15.72:0/294251757 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4660024380 con 0x7f466406acb0 2023-10-03T10:13:56.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.058+0000 7f052159a700 1 -- 172.21.15.72:0/1872920669 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0514011d20 con 0x7f052409d6f0 2023-10-03T10:13:56.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.059+0000 7f21acfec700 1 Processor -- start 2023-10-03T10:13:56.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.059+0000 7f0528b7e700 1 -- 172.21.15.72:0/1872920669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052409d6f0 msgr2=0x7f052409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.059+0000 7f0528b7e700 1 --2- 172.21.15.72:0/1872920669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052409d6f0 0x7f052409dac0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0514009840 tx=0x7f0514009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:56.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.059+0000 7f21acfec700 1 -- start start 2023-10-03T10:13:56.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.059+0000 7f21acfec700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21a809d6f0 0x7f21a81ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.059+0000 7f21acfec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21a809e000 0x7f21a81cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.059+0000 7f21acfec700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a809e410 0x7f21a812dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.059+0000 7f21acfec700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a81cc730 con 0x7f21a809e410 2023-10-03T10:13:56.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.059+0000 7f21acfec700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a8125540 con 0x7f21a809d6f0 2023-10-03T10:13:56.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.059+0000 7f21acfec700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21a812f2a0 con 0x7f21a809e000 2023-10-03T10:13:56.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.059+0000 7f21a6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a809e410 0x7f21a812dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.059+0000 7f21a6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a809e410 0x7f21a812dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43854/0 (socket says 172.21.15.72:43854) 2023-10-03T10:13:56.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.059+0000 7f21a6d9d700 1 -- 172.21.15.72:0/2477194423 learned_addr learned my addr 172.21.15.72:0/2477194423 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:56.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.059+0000 7f21a5d9b700 1 --2- 172.21.15.72:0/2477194423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21a809e000 0x7f21a81cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.060+0000 7f21a6d9d700 1 -- 172.21.15.72:0/2477194423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21a809e000 msgr2=0x7f21a81cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.060+0000 7f21a6d9d700 1 --2- 172.21.15.72:0/2477194423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21a809e000 0x7f21a81cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.060+0000 7f21a6d9d700 1 -- 172.21.15.72:0/2477194423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21a809d6f0 msgr2=0x7f21a81ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.060+0000 7f21a6d9d700 1 --2- 172.21.15.72:0/2477194423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21a809d6f0 0x7f21a81ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.060+0000 7f21a6d9d700 1 -- 172.21.15.72:0/2477194423 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a0009a70 con 0x7f21a809e410 2023-10-03T10:13:56.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.060+0000 7f0528b7e700 1 -- 172.21.15.72:0/1872920669 shutdown_connections 2023-10-03T10:13:56.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.060+0000 7f0528b7e700 1 --2- 172.21.15.72:0/1872920669 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f052409e410 0x7f0524130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.060+0000 7f0528b7e700 1 --2- 172.21.15.72:0/1872920669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052409d6f0 0x7f052409dac0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.060+0000 7f0528b7e700 1 -- 172.21.15.72:0/1872920669 >> 172.21.15.72:0/1872920669 conn(0x7f0524066f50 msgr2=0x7f052409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.060+0000 7f21a6d9d700 1 --2- 172.21.15.72:0/2477194423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a809e410 0x7f21a812dfa0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009f00 tx=0x7f21a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.060+0000 7f2196ffd700 1 -- 172.21.15.72:0/2477194423 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a000cc00 con 0x7f21a809e410 2023-10-03T10:13:56.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.060+0000 7f2196ffd700 1 -- 172.21.15.72:0/2477194423 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a000f040 con 0x7f21a809e410 2023-10-03T10:13:56.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.060+0000 7f2196ffd700 1 -- 172.21.15.72:0/2477194423 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0003a20 con 0x7f21a809e410 2023-10-03T10:13:56.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.060+0000 7f21acfec700 1 -- 172.21.15.72:0/2477194423 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2198009550 con 0x7f21a809e410 2023-10-03T10:13:56.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.060+0000 7f21acfec700 1 -- 172.21.15.72:0/2477194423 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a806b370 con 0x7f21a809e410 2023-10-03T10:13:56.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.061+0000 7f2196ffd700 1 -- 172.21.15.72:0/2477194423 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21a0014480 con 0x7f21a809e410 2023-10-03T10:13:56.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.061+0000 7f21acfec700 1 -- 172.21.15.72:0/2477194423 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a812f060 con 0x7f21a809e410 2023-10-03T10:13:56.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.061+0000 7f2196ffd700 1 -- 172.21.15.72:0/2477194423 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f21a00400a0 con 0x7f21a809e410 2023-10-03T10:13:56.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.063+0000 7f0528b7e700 1 -- 172.21.15.72:0/1872920669 shutdown_connections 2023-10-03T10:13:56.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.063+0000 7f0528b7e700 1 -- 172.21.15.72:0/1872920669 wait complete. 2023-10-03T10:13:56.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.064+0000 7f0528b7e700 1 Processor -- start 2023-10-03T10:13:56.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.064+0000 7f0528b7e700 1 -- start start 2023-10-03T10:13:56.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.064+0000 7f0528b7e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f052409d6f0 0x7f052411df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.064+0000 7f0528b7e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f052409e000 0x7f052411e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.064+0000 7f0528b7e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052409e410 0x7f052411e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.064+0000 7f0528b7e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052411f420 con 0x7f052409e410 2023-10-03T10:13:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.064+0000 7f0528b7e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0524130330 con 0x7f052409e000 2023-10-03T10:13:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.064+0000 7f0528b7e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0524120db0 con 0x7f052409d6f0 2023-10-03T10:13:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.064+0000 7f052259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f052409d6f0 0x7f052411df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.064+0000 7f052259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f052409d6f0 0x7f052411df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57708/0 (socket says 172.21.15.72:57708) 2023-10-03T10:13:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.064+0000 7f052259c700 1 -- 172.21.15.72:0/2076633164 learned_addr learned my addr 172.21.15.72:0/2076633164 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.065+0000 7f0521d9b700 1 --2- 172.21.15.72:0/2076633164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f052409e000 0x7f052411e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.065+0000 7f052259c700 1 -- 172.21.15.72:0/2076633164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f052409e000 msgr2=0x7f052411e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.065+0000 7f052259c700 1 --2- 172.21.15.72:0/2076633164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f052409e000 0x7f052411e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.065+0000 7f052259c700 1 -- 172.21.15.72:0/2076633164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052409e410 msgr2=0x7f052411e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.065+0000 7f052259c700 1 --2- 172.21.15.72:0/2076633164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052409e410 0x7f052411e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.065+0000 7f052259c700 1 -- 172.21.15.72:0/2076633164 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c009b30 con 0x7f052409d6f0 2023-10-03T10:13:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.065+0000 7f052259c700 1 --2- 172.21.15.72:0/2076633164 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f052409d6f0 0x7f052411df50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0514009fd0 tx=0x7f0514004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.065+0000 7f0512ffd700 1 -- 172.21.15.72:0/2076633164 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05140036a0 con 0x7f052409d6f0 2023-10-03T10:13:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.065+0000 7f0512ffd700 1 -- 172.21.15.72:0/2076633164 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051401f070 con 0x7f052409d6f0 2023-10-03T10:13:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.065+0000 7f0528b7e700 1 -- 172.21.15.72:0/2076633164 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05140094a0 con 0x7f052409d6f0 2023-10-03T10:13:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.065+0000 7f0512ffd700 1 -- 172.21.15.72:0/2076633164 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0514003a60 con 0x7f052409d6f0 2023-10-03T10:13:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.065+0000 7f0528b7e700 1 -- 172.21.15.72:0/2076633164 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0524120170 con 0x7f052409d6f0 2023-10-03T10:13:56.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.066+0000 7f0528b7e700 1 -- 172.21.15.72:0/2076633164 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05240a1d60 con 0x7f052409d6f0 2023-10-03T10:13:56.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.067+0000 7f0512ffd700 1 -- 172.21.15.72:0/2076633164 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0514003bc0 con 0x7f052409d6f0 2023-10-03T10:13:56.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.067+0000 7f0512ffd700 1 -- 172.21.15.72:0/2076633164 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0514021070 con 0x7f052409d6f0 2023-10-03T10:13:56.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.070+0000 7f2196ffd700 1 -- 172.21.15.72:0/2477194423 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21a0012930 con 0x7f21a809e410 2023-10-03T10:13:56.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.072+0000 7f0512ffd700 1 -- 172.21.15.72:0/2076633164 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f051401a430 con 0x7f052409d6f0 2023-10-03T10:13:56.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.204+0000 7fe4b76dc700 1 -- 172.21.15.72:0/3509043781 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe4b011d190 con 0x7fe4b0136830 2023-10-03T10:13:56.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.205+0000 7fe4a5ffb700 1 -- 172.21.15.72:0/3509043781 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4a0015020 con 0x7fe4b0136830 2023-10-03T10:13:56.206 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.207+0000 7fe4b76dc700 1 -- 172.21.15.72:0/3509043781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4b0136830 msgr2=0x7fe4b01c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.207+0000 7fe4b76dc700 1 --2- 172.21.15.72:0/3509043781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4b0136830 0x7fe4b01c8a80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe4a000b500 tx=0x7fe4a000b8c0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.207+0000 7fe4b76dc700 1 -- 172.21.15.72:0/3509043781 shutdown_connections 2023-10-03T10:13:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.207+0000 7fe4b76dc700 1 --2- 172.21.15.72:0/3509043781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4b0139150 0x7fe4b0119d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.207+0000 7fe4b76dc700 1 --2- 172.21.15.72:0/3509043781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4b01338c0 0x7fe4b01c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.207+0000 7fe4b76dc700 1 --2- 172.21.15.72:0/3509043781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4b0136830 0x7fe4b01c8a80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.207+0000 7fe4b76dc700 1 -- 172.21.15.72:0/3509043781 >> 172.21.15.72:0/3509043781 conn(0x7fe4b00a2aa0 msgr2=0x7fe4b009de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.207+0000 7fe4b76dc700 1 -- 172.21.15.72:0/3509043781 shutdown_connections 2023-10-03T10:13:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.207+0000 7fe4b76dc700 1 -- 172.21.15.72:0/3509043781 wait complete. 2023-10-03T10:13:56.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:56.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.265+0000 7f0528b7e700 1 -- 172.21.15.72:0/2076633164 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0524120170 con 0x7f052409d6f0 2023-10-03T10:13:56.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.266+0000 7f0512ffd700 1 -- 172.21.15.72:0/2076633164 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0524120170 con 0x7f052409d6f0 2023-10-03T10:13:56.267 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.268+0000 7f0528b7e700 1 -- 172.21.15.72:0/2076633164 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f052409d6f0 msgr2=0x7f052411df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.268+0000 7f0528b7e700 1 --2- 172.21.15.72:0/2076633164 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f052409d6f0 0x7f052411df50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0514009fd0 tx=0x7f0514004750 comp rx=0 tx=0).stop 2023-10-03T10:13:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.268+0000 7f0528b7e700 1 -- 172.21.15.72:0/2076633164 shutdown_connections 2023-10-03T10:13:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.268+0000 7f0528b7e700 1 --2- 172.21.15.72:0/2076633164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f052409e410 0x7f052411e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.268+0000 7f0528b7e700 1 --2- 172.21.15.72:0/2076633164 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f052409d6f0 0x7f052411df50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.268+0000 7f0528b7e700 1 --2- 172.21.15.72:0/2076633164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f052409e000 0x7f052411e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.268+0000 7f0528b7e700 1 -- 172.21.15.72:0/2076633164 >> 172.21.15.72:0/2076633164 conn(0x7f0524066f50 msgr2=0x7f05240a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.268+0000 7f0528b7e700 1 -- 172.21.15.72:0/2076633164 shutdown_connections 2023-10-03T10:13:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.268+0000 7f0528b7e700 1 -- 172.21.15.72:0/2076633164 wait complete. 2023-10-03T10:13:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.272+0000 7f466ba91700 1 -- 172.21.15.72:0/294251757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f466409b6f0 con 0x7f466406acb0 2023-10-03T10:13:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.273+0000 7f465a7fc700 1 -- 172.21.15.72:0/294251757 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4660015070 con 0x7f466406acb0 2023-10-03T10:13:56.273 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:56.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.275+0000 7f466ba91700 1 -- 172.21.15.72:0/294251757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f466406acb0 msgr2=0x7f46641c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.275+0000 7f466ba91700 1 --2- 172.21.15.72:0/294251757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f466406acb0 0x7f46641c8330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f46600090b0 tx=0x7f4660004750 comp rx=0 tx=0).stop 2023-10-03T10:13:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.275+0000 7f466ba91700 1 -- 172.21.15.72:0/294251757 shutdown_connections 2023-10-03T10:13:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.275+0000 7f466ba91700 1 --2- 172.21.15.72:0/294251757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f466406acb0 0x7f46641c8330 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.275+0000 7f466ba91700 1 --2- 172.21.15.72:0/294251757 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46641316c0 0x7f46641c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.275+0000 7f466ba91700 1 --2- 172.21.15.72:0/294251757 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f466409d9f0 0x7f46641c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.275+0000 7f466ba91700 1 -- 172.21.15.72:0/294251757 >> 172.21.15.72:0/294251757 conn(0x7f4664066f50 msgr2=0x7f46640a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.275+0000 7f466ba91700 1 -- 172.21.15.72:0/294251757 shutdown_connections 2023-10-03T10:13:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.275+0000 7f466ba91700 1 -- 172.21.15.72:0/294251757 wait complete. 2023-10-03T10:13:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.280+0000 7f21acfec700 1 -- 172.21.15.72:0/2477194423 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f21a8074ea0 con 0x7f21a809e410 2023-10-03T10:13:56.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.280+0000 7f2196ffd700 1 -- 172.21.15.72:0/2477194423 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f21a0012340 con 0x7f21a809e410 2023-10-03T10:13:56.281 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:56.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:56.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.282+0000 7f21acfec700 1 -- 172.21.15.72:0/2477194423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a809e410 msgr2=0x7f21a812dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.282+0000 7f21acfec700 1 --2- 172.21.15.72:0/2477194423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a809e410 0x7f21a812dfa0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009f00 tx=0x7f21a000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.282+0000 7f21acfec700 1 -- 172.21.15.72:0/2477194423 shutdown_connections 2023-10-03T10:13:56.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.282+0000 7f21acfec700 1 --2- 172.21.15.72:0/2477194423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21a809e410 0x7f21a812dfa0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.282+0000 7f21acfec700 1 --2- 172.21.15.72:0/2477194423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21a809d6f0 0x7f21a81ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.282+0000 7f21acfec700 1 --2- 172.21.15.72:0/2477194423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21a809e000 0x7f21a81cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.282+0000 7f21acfec700 1 -- 172.21.15.72:0/2477194423 >> 172.21.15.72:0/2477194423 conn(0x7f21a8066f50 msgr2=0x7f21a8071560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.282+0000 7f21acfec700 1 -- 172.21.15.72:0/2477194423 shutdown_connections 2023-10-03T10:13:56.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:56.282+0000 7f21acfec700 1 -- 172.21.15.72:0/2477194423 wait complete. 2023-10-03T10:13:56.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:56.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:57.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:57.282 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:57.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:57.297 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.361+0000 7f2952c98700 1 Processor -- start 2023-10-03T10:13:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.362+0000 7f2952c98700 1 -- start start 2023-10-03T10:13:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.362+0000 7f2952c98700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c1316c0 0x7f294c131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.362+0000 7f2952c98700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c06ae80 0x7f294c139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.362+0000 7f2952c98700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294c09e130 con 0x7f294c09d9f0 2023-10-03T10:13:57.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.362+0000 7f2952c98700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c1312b0 con 0x7f294c06ae80 2023-10-03T10:13:57.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.362+0000 7f2952c98700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f294c09f6e0 con 0x7f294c1316c0 2023-10-03T10:13:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.362+0000 7f2950a34700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c1316c0 0x7f294c131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.362+0000 7f294bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f294c09d9f0 0x7f294c06a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43158/0 (socket says 172.21.15.72:43158) 2023-10-03T10:13:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.362+0000 7f294bfff700 1 -- 172.21.15.72:0/3393253199 learned_addr learned my addr 172.21.15.72:0/3393253199 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.363+0000 7f2951235700 1 --2- 172.21.15.72:0/3393253199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c06ae80 0x7f294c139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.363+0000 7f294b7fe700 1 -- 172.21.15.72:0/3393253199 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722499571 0 0) 0x7f2938001110 con 0x7f294c09d9f0 2023-10-03T10:13:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.363+0000 7f294b7fe700 1 -- 172.21.15.72:0/3393253199 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f293c0035b0 con 0x7f294c09d9f0 2023-10-03T10:13:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.363+0000 7f2950a34700 1 -- 172.21.15.72:0/3393253199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c06ae80 msgr2=0x7f294c139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.363+0000 7f2950a34700 1 --2- 172.21.15.72:0/3393253199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c06ae80 0x7f294c139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.363+0000 7f2950a34700 1 -- 172.21.15.72:0/3393253199 >> v1:172.21.15.72:6789/0 conn(0x7f294c09d9f0 legacy=0x7f294c06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.363+0000 7f2950a34700 1 -- 172.21.15.72:0/3393253199 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c09e760 con 0x7f294c1316c0 2023-10-03T10:13:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.363+0000 7f2950a34700 1 --2- 172.21.15.72:0/3393253199 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c1316c0 0x7f294c131a90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2940009870 tx=0x7f2940009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a55dbc8ec4bbc8b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.363+0000 7f294b7fe700 1 -- 172.21.15.72:0/3393253199 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940011830 con 0x7f294c1316c0 2023-10-03T10:13:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.363+0000 7f294b7fe700 1 -- 172.21.15.72:0/3393253199 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2940011990 con 0x7f294c1316c0 2023-10-03T10:13:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.363+0000 7f294b7fe700 1 -- 172.21.15.72:0/3393253199 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940011d20 con 0x7f294c1316c0 2023-10-03T10:13:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.364+0000 7f2952c98700 1 -- 172.21.15.72:0/3393253199 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c1316c0 msgr2=0x7f294c131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.364+0000 7f2952c98700 1 --2- 172.21.15.72:0/3393253199 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c1316c0 0x7f294c131a90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2940009870 tx=0x7f2940009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.364+0000 7f2952c98700 1 -- 172.21.15.72:0/3393253199 shutdown_connections 2023-10-03T10:13:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.364+0000 7f2952c98700 1 --2- 172.21.15.72:0/3393253199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c06ae80 0x7f294c139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.364+0000 7f2952c98700 1 --2- 172.21.15.72:0/3393253199 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c1316c0 0x7f294c131a90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.364+0000 7f2952c98700 1 -- 172.21.15.72:0/3393253199 >> 172.21.15.72:0/3393253199 conn(0x7f294c066f50 msgr2=0x7f294c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.364+0000 7f2952c98700 1 -- 172.21.15.72:0/3393253199 shutdown_connections 2023-10-03T10:13:57.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.364+0000 7f2952c98700 1 -- 172.21.15.72:0/3393253199 wait complete. 2023-10-03T10:13:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.365+0000 7f2952c98700 1 Processor -- start 2023-10-03T10:13:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.365+0000 7f2952c98700 1 -- start start 2023-10-03T10:13:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2952c98700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c06ae80 0x7f294c1206c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2952c98700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c09d9f0 0x7f294c11d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2952c98700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c1316c0 0x7f294c11ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2952c98700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c120da0 con 0x7f294c1316c0 2023-10-03T10:13:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2952c98700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c11fc20 con 0x7f294c09d9f0 2023-10-03T10:13:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2952c98700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f294c12b640 con 0x7f294c06ae80 2023-10-03T10:13:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2951235700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c1316c0 0x7f294c11ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2951235700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c1316c0 0x7f294c11ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43864/0 (socket says 172.21.15.72:43864) 2023-10-03T10:13:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2951235700 1 -- 172.21.15.72:0/924459386 learned_addr learned my addr 172.21.15.72:0/924459386 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f294bfff700 1 --2- 172.21.15.72:0/924459386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c09d9f0 0x7f294c11d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2950a34700 1 --2- 172.21.15.72:0/924459386 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c06ae80 0x7f294c1206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2951235700 1 -- 172.21.15.72:0/924459386 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c06ae80 msgr2=0x7f294c1206c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2951235700 1 --2- 172.21.15.72:0/924459386 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c06ae80 0x7f294c1206c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2951235700 1 -- 172.21.15.72:0/924459386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c09d9f0 msgr2=0x7f294c11d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2951235700 1 --2- 172.21.15.72:0/924459386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c09d9f0 0x7f294c11d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2951235700 1 -- 172.21.15.72:0/924459386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29400094a0 con 0x7f294c1316c0 2023-10-03T10:13:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f2950a34700 1 --2- 172.21.15.72:0/924459386 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c06ae80 0x7f294c1206c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.366+0000 7f294bfff700 1 --2- 172.21.15.72:0/924459386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c09d9f0 0x7f294c11d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.367+0000 7f2951235700 1 --2- 172.21.15.72:0/924459386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c1316c0 0x7f294c11ddd0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f294400efc0 tx=0x7f294400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.367+0000 7f29497fa700 1 -- 172.21.15.72:0/924459386 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2944009ea0 con 0x7f294c1316c0 2023-10-03T10:13:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.367+0000 7f29497fa700 1 -- 172.21.15.72:0/924459386 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294400f040 con 0x7f294c1316c0 2023-10-03T10:13:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.367+0000 7f29497fa700 1 -- 172.21.15.72:0/924459386 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294400ced0 con 0x7f294c1316c0 2023-10-03T10:13:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.367+0000 7f2952c98700 1 -- 172.21.15.72:0/924459386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294c11fee0 con 0x7f294c1316c0 2023-10-03T10:13:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.367+0000 7f2952c98700 1 -- 172.21.15.72:0/924459386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294c11e310 con 0x7f294c1316c0 2023-10-03T10:13:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.368+0000 7f29497fa700 1 -- 172.21.15.72:0/924459386 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2944014480 con 0x7f294c1316c0 2023-10-03T10:13:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.368+0000 7f29497fa700 1 -- 172.21.15.72:0/924459386 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f294403fe30 con 0x7f294c1316c0 2023-10-03T10:13:57.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.368+0000 7f2952c98700 1 -- 172.21.15.72:0/924459386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294c1200d0 con 0x7f294c1316c0 2023-10-03T10:13:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.373+0000 7f29497fa700 1 -- 172.21.15.72:0/924459386 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2944018020 con 0x7f294c1316c0 2023-10-03T10:13:57.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.437+0000 7f33e1a49700 1 Processor -- start 2023-10-03T10:13:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.437+0000 7f33e1a49700 1 -- start start 2023-10-03T10:13:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.437+0000 7f33e1a49700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f33dc09d6f0 0x7f33dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.437+0000 7f33e1a49700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33dc09e000 0x7f33dc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.437+0000 7f33e1a49700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33dc09f130 con 0x7f33dc09e410 2023-10-03T10:13:57.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.437+0000 7f33e1a49700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc09f520 con 0x7f33dc09e000 2023-10-03T10:13:57.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.437+0000 7f33e1a49700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc09e930 con 0x7f33dc09d6f0 2023-10-03T10:13:57.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.437+0000 7f33daffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f33dc09d6f0 0x7f33dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.437+0000 7f33daffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f33dc09d6f0 0x7f33dc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57728/0 (socket says 172.21.15.72:57728) 2023-10-03T10:13:57.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.437+0000 7f33daffd700 1 -- 172.21.15.72:0/2272611769 learned_addr learned my addr 172.21.15.72:0/2272611769 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:57.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.437+0000 7f33da7fc700 1 --2- 172.21.15.72:0/2272611769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33dc09e000 0x7f33dc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.438+0000 7f33daffd700 1 -- 172.21.15.72:0/2272611769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33dc09e000 msgr2=0x7f33dc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.438+0000 7f33daffd700 1 --2- 172.21.15.72:0/2272611769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33dc09e000 0x7f33dc130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.438+0000 7f33daffd700 1 -- 172.21.15.72:0/2272611769 >> v1:172.21.15.72:6789/0 conn(0x7f33dc09e410 legacy=0x7f33dc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.438+0000 7f33daffd700 1 -- 172.21.15.72:0/2272611769 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc09b2d0 con 0x7f33dc09d6f0 2023-10-03T10:13:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.438+0000 7f33daffd700 1 --2- 172.21.15.72:0/2272611769 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f33dc09d6f0 0x7f33dc09dac0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009950 tx=0x7f33cc009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1ccd3e635a7bca5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.438+0000 7f33d9ffb700 1 -- 172.21.15.72:0/2272611769 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc004230 con 0x7f33dc09d6f0 2023-10-03T10:13:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.438+0000 7f33d9ffb700 1 -- 172.21.15.72:0/2272611769 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33cc004390 con 0x7f33dc09d6f0 2023-10-03T10:13:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.438+0000 7f33d9ffb700 1 -- 172.21.15.72:0/2272611769 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc0036a0 con 0x7f33dc09d6f0 2023-10-03T10:13:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.439+0000 7f33e1a49700 1 -- 172.21.15.72:0/2272611769 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f33dc09d6f0 msgr2=0x7f33dc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.439+0000 7f33e1a49700 1 --2- 172.21.15.72:0/2272611769 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f33dc09d6f0 0x7f33dc09dac0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009950 tx=0x7f33cc009c60 comp rx=0 tx=0).stop 2023-10-03T10:13:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.439+0000 7f33e1a49700 1 -- 172.21.15.72:0/2272611769 shutdown_connections 2023-10-03T10:13:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.439+0000 7f33e1a49700 1 --2- 172.21.15.72:0/2272611769 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f33dc09d6f0 0x7f33dc09dac0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.439+0000 7f33e1a49700 1 --2- 172.21.15.72:0/2272611769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33dc09e000 0x7f33dc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.439+0000 7f33e1a49700 1 -- 172.21.15.72:0/2272611769 >> 172.21.15.72:0/2272611769 conn(0x7f33dc066f50 msgr2=0x7f33dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.439+0000 7f33e1a49700 1 -- 172.21.15.72:0/2272611769 shutdown_connections 2023-10-03T10:13:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.439+0000 7f33e1a49700 1 -- 172.21.15.72:0/2272611769 wait complete. 2023-10-03T10:13:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.440+0000 7f33e1a49700 1 Processor -- start 2023-10-03T10:13:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.440+0000 7f33e1a49700 1 -- start start 2023-10-03T10:13:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33e1a49700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc09d6f0 0x7f33dc120200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33e1a49700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33dc09e000 0x7f33dc120740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33e1a49700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f33dc09e410 0x7f33dc120c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33e1a49700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc123cd0 con 0x7f33dc09d6f0 2023-10-03T10:13:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33e1a49700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc1223e0 con 0x7f33dc09e000 2023-10-03T10:13:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33e1a49700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc09c700 con 0x7f33dc09e410 2023-10-03T10:13:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33daffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc09d6f0 0x7f33dc120200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33daffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc09d6f0 0x7f33dc120200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43876/0 (socket says 172.21.15.72:43876) 2023-10-03T10:13:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33daffd700 1 -- 172.21.15.72:0/823380041 learned_addr learned my addr 172.21.15.72:0/823380041 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33db7fe700 1 --2- 172.21.15.72:0/823380041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f33dc09e410 0x7f33dc120c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33da7fc700 1 --2- 172.21.15.72:0/823380041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33dc09e000 0x7f33dc120740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33daffd700 1 -- 172.21.15.72:0/823380041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f33dc09e410 msgr2=0x7f33dc120c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33daffd700 1 --2- 172.21.15.72:0/823380041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f33dc09e410 0x7f33dc120c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33daffd700 1 -- 172.21.15.72:0/823380041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33dc09e000 msgr2=0x7f33dc120740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33daffd700 1 --2- 172.21.15.72:0/823380041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33dc09e000 0x7f33dc120740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.441+0000 7f33daffd700 1 -- 172.21.15.72:0/823380041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc009550 con 0x7f33dc09d6f0 2023-10-03T10:13:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.442+0000 7f33daffd700 1 --2- 172.21.15.72:0/823380041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc09d6f0 0x7f33dc120200 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f33cc006d30 tx=0x7f33cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.442+0000 7f33c3fff700 1 -- 172.21.15.72:0/823380041 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc003c70 con 0x7f33dc09d6f0 2023-10-03T10:13:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.442+0000 7f33c3fff700 1 -- 172.21.15.72:0/823380041 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33cc003dd0 con 0x7f33dc09d6f0 2023-10-03T10:13:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.442+0000 7f33c3fff700 1 -- 172.21.15.72:0/823380041 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc01fa70 con 0x7f33dc09d6f0 2023-10-03T10:13:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.442+0000 7f33e1a49700 1 -- 172.21.15.72:0/823380041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33dc0a1e80 con 0x7f33dc09d6f0 2023-10-03T10:13:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.442+0000 7f33e1a49700 1 -- 172.21.15.72:0/823380041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33dc124460 con 0x7f33dc09d6f0 2023-10-03T10:13:57.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.443+0000 7f33e1a49700 1 -- 172.21.15.72:0/823380041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33dc074ea0 con 0x7f33dc09d6f0 2023-10-03T10:13:57.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.443+0000 7f33c3fff700 1 -- 172.21.15.72:0/823380041 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33cc025070 con 0x7f33dc09d6f0 2023-10-03T10:13:57.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.444+0000 7f33c3fff700 1 -- 172.21.15.72:0/823380041 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f33cc045060 con 0x7f33dc09d6f0 2023-10-03T10:13:57.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.448+0000 7f33c3fff700 1 -- 172.21.15.72:0/823380041 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33cc01fe10 con 0x7f33dc09d6f0 2023-10-03T10:13:57.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.463+0000 7f03b5cf6700 1 Processor -- start 2023-10-03T10:13:57.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.463+0000 7f03b5cf6700 1 -- start start 2023-10-03T10:13:57.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.463+0000 7f03b5cf6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f03b006f5d0 0x7f03b012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.463+0000 7f03b5cf6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f03b0135c20 0x7f03b0138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.463+0000 7f03b5cf6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b006fa40 con 0x7f03b012cf60 2023-10-03T10:13:57.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.463+0000 7f03b5cf6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b012cd90 con 0x7f03b0135c20 2023-10-03T10:13:57.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.463+0000 7f03b5cf6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03b0071780 con 0x7f03b006f5d0 2023-10-03T10:13:57.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.463+0000 7f03aeffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f03b006f5d0 0x7f03b012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.463+0000 7f03affff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f03b0135c20 0x7f03b0138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.463+0000 7f03aeffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f03b006f5d0 0x7f03b012ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57738/0 (socket says 172.21.15.72:57738) 2023-10-03T10:13:57.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.463+0000 7f03aeffd700 1 -- 172.21.15.72:0/2964635038 learned_addr learned my addr 172.21.15.72:0/2964635038 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:57.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.464+0000 7f03affff700 1 -- 172.21.15.72:0/2964635038 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f03b006f5d0 msgr2=0x7f03b012ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.464+0000 7f03affff700 1 --2- 172.21.15.72:0/2964635038 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f03b006f5d0 0x7f03b012ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.464+0000 7f03affff700 1 -- 172.21.15.72:0/2964635038 >> v1:172.21.15.72:6789/0 conn(0x7f03b012cf60 legacy=0x7f03b012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.464+0000 7f03affff700 1 -- 172.21.15.72:0/2964635038 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b0071a40 con 0x7f03b0135c20 2023-10-03T10:13:57.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.464+0000 7f03affff700 1 --2- 172.21.15.72:0/2964635038 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f03b0135c20 0x7f03b0138000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009dc0 tx=0x7f03a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea7e17b64e98bf46 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.464+0000 7f03ae7fc700 1 -- 172.21.15.72:0/2964635038 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a800e070 con 0x7f03b0135c20 2023-10-03T10:13:57.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.464+0000 7f03ae7fc700 1 -- 172.21.15.72:0/2964635038 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a800bb20 con 0x7f03b0135c20 2023-10-03T10:13:57.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.464+0000 7f03ae7fc700 1 -- 172.21.15.72:0/2964635038 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8012430 con 0x7f03b0135c20 2023-10-03T10:13:57.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.465+0000 7f03b5cf6700 1 -- 172.21.15.72:0/2964635038 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f03b0135c20 msgr2=0x7f03b0138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.465+0000 7f03b5cf6700 1 --2- 172.21.15.72:0/2964635038 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f03b0135c20 0x7f03b0138000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009dc0 tx=0x7f03a800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:57.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.465+0000 7f03b5cf6700 1 -- 172.21.15.72:0/2964635038 shutdown_connections 2023-10-03T10:13:57.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.465+0000 7f03b5cf6700 1 --2- 172.21.15.72:0/2964635038 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f03b0135c20 0x7f03b0138000 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.465+0000 7f03b5cf6700 1 --2- 172.21.15.72:0/2964635038 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f03b006f5d0 0x7f03b012ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.465+0000 7f03b5cf6700 1 -- 172.21.15.72:0/2964635038 >> 172.21.15.72:0/2964635038 conn(0x7f03b00a2aa0 msgr2=0x7f03b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.465+0000 7f03b5cf6700 1 -- 172.21.15.72:0/2964635038 shutdown_connections 2023-10-03T10:13:57.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.465+0000 7f03b5cf6700 1 -- 172.21.15.72:0/2964635038 wait complete. 2023-10-03T10:13:57.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.466+0000 7f03b5cf6700 1 Processor -- start 2023-10-03T10:13:57.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.466+0000 7f03b5cf6700 1 -- start start 2023-10-03T10:13:57.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.467+0000 7f03b5cf6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03b006f5d0 0x7f03b0134a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.467+0000 7f03b5cf6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f03b012cf60 0x7f03b0134fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.467+0000 7f03b5cf6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f03b0135c20 0x7f03b01c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.467+0000 7f03b5cf6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b012f9d0 con 0x7f03b006f5d0 2023-10-03T10:13:57.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.467+0000 7f03b5cf6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b012ed40 con 0x7f03b012cf60 2023-10-03T10:13:57.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.467+0000 7f03b5cf6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03b00a1620 con 0x7f03b0135c20 2023-10-03T10:13:57.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.467+0000 7f03af7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03b006f5d0 0x7f03b0134a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.467+0000 7f03af7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03b006f5d0 0x7f03b0134a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43888/0 (socket says 172.21.15.72:43888) 2023-10-03T10:13:57.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.467+0000 7f03af7fe700 1 -- 172.21.15.72:0/1074171464 learned_addr learned my addr 172.21.15.72:0/1074171464 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:57.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.467+0000 7f03aeffd700 1 --2- 172.21.15.72:0/1074171464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f03b012cf60 0x7f03b0134fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.467+0000 7f03affff700 1 --2- 172.21.15.72:0/1074171464 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f03b0135c20 0x7f03b01c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.468+0000 7f03af7fe700 1 -- 172.21.15.72:0/1074171464 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f03b0135c20 msgr2=0x7f03b01c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.468+0000 7f03af7fe700 1 --2- 172.21.15.72:0/1074171464 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f03b0135c20 0x7f03b01c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.468+0000 7f03af7fe700 1 -- 172.21.15.72:0/1074171464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f03b012cf60 msgr2=0x7f03b0134fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.468+0000 7f03af7fe700 1 --2- 172.21.15.72:0/1074171464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f03b012cf60 0x7f03b0134fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.468+0000 7f03af7fe700 1 -- 172.21.15.72:0/1074171464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a8009a70 con 0x7f03b006f5d0 2023-10-03T10:13:57.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.468+0000 7f03aeffd700 1 --2- 172.21.15.72:0/1074171464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f03b012cf60 0x7f03b0134fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:57.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.468+0000 7f03af7fe700 1 --2- 172.21.15.72:0/1074171464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03b006f5d0 0x7f03b0134a80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f03a000c4e0 tx=0x7f03a000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.468+0000 7f0397fff700 1 -- 172.21.15.72:0/1074171464 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00052d0 con 0x7f03b006f5d0 2023-10-03T10:13:57.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.468+0000 7f0397fff700 1 -- 172.21.15.72:0/1074171464 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a0005430 con 0x7f03b006f5d0 2023-10-03T10:13:57.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.468+0000 7f03b5cf6700 1 -- 172.21.15.72:0/1074171464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b01345c0 con 0x7f03b006f5d0 2023-10-03T10:13:57.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.468+0000 7f0397fff700 1 -- 172.21.15.72:0/1074171464 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00038c0 con 0x7f03b006f5d0 2023-10-03T10:13:57.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.468+0000 7f03b5cf6700 1 -- 172.21.15.72:0/1074171464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b0135500 con 0x7f03b006f5d0 2023-10-03T10:13:57.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.469+0000 7f0397fff700 1 -- 172.21.15.72:0/1074171464 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03a0003a20 con 0x7f03b006f5d0 2023-10-03T10:13:57.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.469+0000 7f0397fff700 1 -- 172.21.15.72:0/1074171464 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f03a003ea70 con 0x7f03b006f5d0 2023-10-03T10:13:57.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.470+0000 7f03b5cf6700 1 -- 172.21.15.72:0/1074171464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b0074ea0 con 0x7f03b006f5d0 2023-10-03T10:13:57.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.474+0000 7f0397fff700 1 -- 172.21.15.72:0/1074171464 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03a0018260 con 0x7f03b006f5d0 2023-10-03T10:13:57.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.482+0000 7fa73679b700 1 Processor -- start 2023-10-03T10:13:57.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.482+0000 7fa73679b700 1 -- start start 2023-10-03T10:13:57.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.483+0000 7fa73679b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73009de00 0x7fa73009e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.483+0000 7fa73679b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73013d1f0 0x7fa73013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.483+0000 7fa73679b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73009a810 con 0x7fa73006a770 2023-10-03T10:13:57.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.483+0000 7fa73679b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73006ab40 con 0x7fa73009de00 2023-10-03T10:13:57.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.483+0000 7fa73679b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa73009ebc0 con 0x7fa73013d1f0 2023-10-03T10:13:57.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.483+0000 7fa734d38700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73013d1f0 0x7fa73013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.483+0000 7fa72f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73009de00 0x7fa73009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.483+0000 7fa734d38700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73013d1f0 0x7fa73013f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57756/0 (socket says 172.21.15.72:57756) 2023-10-03T10:13:57.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.483+0000 7fa734d38700 1 -- 172.21.15.72:0/3337728616 learned_addr learned my addr 172.21.15.72:0/3337728616 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:57.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.484+0000 7fa72f7fe700 1 -- 172.21.15.72:0/3337728616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73013d1f0 msgr2=0x7fa73013f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.484+0000 7fa72f7fe700 1 --2- 172.21.15.72:0/3337728616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73013d1f0 0x7fa73013f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.484+0000 7fa72f7fe700 1 -- 172.21.15.72:0/3337728616 >> v1:172.21.15.72:6789/0 conn(0x7fa73006a770 legacy=0x7fa73009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.484+0000 7fa72f7fe700 1 -- 172.21.15.72:0/3337728616 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73009e920 con 0x7fa73009de00 2023-10-03T10:13:57.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.484+0000 7fa72f7fe700 1 --2- 172.21.15.72:0/3337728616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73009de00 0x7fa73009e250 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa724009870 tx=0x7fa724009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71ab9712a9e9dfb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.484+0000 7fa72effd700 1 -- 172.21.15.72:0/3337728616 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724011830 con 0x7fa73009de00 2023-10-03T10:13:57.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.484+0000 7fa72effd700 1 -- 172.21.15.72:0/3337728616 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa724011990 con 0x7fa73009de00 2023-10-03T10:13:57.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.484+0000 7fa72effd700 1 -- 172.21.15.72:0/3337728616 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724011d20 con 0x7fa73009de00 2023-10-03T10:13:57.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.484+0000 7fa73679b700 1 -- 172.21.15.72:0/3337728616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73009de00 msgr2=0x7fa73009e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.484+0000 7fa73679b700 1 --2- 172.21.15.72:0/3337728616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73009de00 0x7fa73009e250 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa724009870 tx=0x7fa724009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:57.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.485+0000 7fa73679b700 1 -- 172.21.15.72:0/3337728616 shutdown_connections 2023-10-03T10:13:57.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.485+0000 7fa73679b700 1 --2- 172.21.15.72:0/3337728616 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73013d1f0 0x7fa73013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.485+0000 7fa73679b700 1 --2- 172.21.15.72:0/3337728616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73009de00 0x7fa73009e250 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.485+0000 7fa73679b700 1 -- 172.21.15.72:0/3337728616 >> 172.21.15.72:0/3337728616 conn(0x7fa730066f50 msgr2=0x7fa73009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.485+0000 7fa73679b700 1 -- 172.21.15.72:0/3337728616 shutdown_connections 2023-10-03T10:13:57.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.485+0000 7fa73679b700 1 -- 172.21.15.72:0/3337728616 wait complete. 2023-10-03T10:13:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.486+0000 7fa73679b700 1 Processor -- start 2023-10-03T10:13:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.486+0000 7fa73679b700 1 -- start start 2023-10-03T10:13:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.486+0000 7fa73679b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73006a770 0x7fa73013b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.486+0000 7fa73679b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73009de00 0x7fa73013bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.486+0000 7fa73679b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73013d1f0 0x7fa73013c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.486+0000 7fa73679b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa730135e00 con 0x7fa73006a770 2023-10-03T10:13:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.486+0000 7fa73679b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73011df20 con 0x7fa73009de00 2023-10-03T10:13:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.486+0000 7fa73679b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa730072370 con 0x7fa73013d1f0 2023-10-03T10:13:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.486+0000 7fa734d38700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73013d1f0 0x7fa73013c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.486+0000 7fa734d38700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73013d1f0 0x7fa73013c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57762/0 (socket says 172.21.15.72:57762) 2023-10-03T10:13:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.486+0000 7fa734d38700 1 -- 172.21.15.72:0/2153979959 learned_addr learned my addr 172.21.15.72:0/2153979959 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.486+0000 7fa72f7fe700 1 --2- 172.21.15.72:0/2153979959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73009de00 0x7fa73013bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.486+0000 7fa72ffff700 1 --2- 172.21.15.72:0/2153979959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73006a770 0x7fa73013b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.487+0000 7fa734d38700 1 -- 172.21.15.72:0/2153979959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73009de00 msgr2=0x7fa73013bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.487+0000 7fa734d38700 1 --2- 172.21.15.72:0/2153979959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73009de00 0x7fa73013bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.487+0000 7fa734d38700 1 -- 172.21.15.72:0/2153979959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73006a770 msgr2=0x7fa73013b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.487+0000 7fa734d38700 1 --2- 172.21.15.72:0/2153979959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73006a770 0x7fa73013b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.487+0000 7fa734d38700 1 -- 172.21.15.72:0/2153979959 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7240094a0 con 0x7fa73013d1f0 2023-10-03T10:13:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.487+0000 7fa734d38700 1 --2- 172.21.15.72:0/2153979959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73013d1f0 0x7fa73013c140 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa728009d90 tx=0x7fa72800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.487+0000 7fa72cff9700 1 -- 172.21.15.72:0/2153979959 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728003c20 con 0x7fa73013d1f0 2023-10-03T10:13:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.487+0000 7fa72cff9700 1 -- 172.21.15.72:0/2153979959 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72800f040 con 0x7fa73013d1f0 2023-10-03T10:13:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.487+0000 7fa73679b700 1 -- 172.21.15.72:0/2153979959 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73011f130 con 0x7fa73013d1f0 2023-10-03T10:13:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.487+0000 7fa72cff9700 1 -- 172.21.15.72:0/2153979959 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72800c880 con 0x7fa73013d1f0 2023-10-03T10:13:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.487+0000 7fa73679b700 1 -- 172.21.15.72:0/2153979959 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73011ea90 con 0x7fa73013d1f0 2023-10-03T10:13:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.488+0000 7fa72cff9700 1 -- 172.21.15.72:0/2153979959 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa72800c9e0 con 0x7fa73013d1f0 2023-10-03T10:13:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.488+0000 7fa73679b700 1 -- 172.21.15.72:0/2153979959 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa730074ea0 con 0x7fa73013d1f0 2023-10-03T10:13:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.488+0000 7fa72cff9700 1 -- 172.21.15.72:0/2153979959 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa72803f8a0 con 0x7fa73013d1f0 2023-10-03T10:13:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.497+0000 7fa72cff9700 1 -- 172.21.15.72:0/2153979959 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa72801c360 con 0x7fa73013d1f0 2023-10-03T10:13:57.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.579+0000 7f2952c98700 1 -- 172.21.15.72:0/924459386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f294c074ea0 con 0x7f294c1316c0 2023-10-03T10:13:57.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.579+0000 7f29497fa700 1 -- 172.21.15.72:0/924459386 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f294401a680 con 0x7f294c1316c0 2023-10-03T10:13:57.581 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:57.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.581+0000 7f2952c98700 1 -- 172.21.15.72:0/924459386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c1316c0 msgr2=0x7f294c11ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.581+0000 7f2952c98700 1 --2- 172.21.15.72:0/924459386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c1316c0 0x7f294c11ddd0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f294400efc0 tx=0x7f294400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.581+0000 7f2952c98700 1 -- 172.21.15.72:0/924459386 shutdown_connections 2023-10-03T10:13:57.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.581+0000 7f2952c98700 1 --2- 172.21.15.72:0/924459386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c1316c0 0x7f294c11ddd0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.581+0000 7f2952c98700 1 --2- 172.21.15.72:0/924459386 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c06ae80 0x7f294c1206c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.581+0000 7f2952c98700 1 --2- 172.21.15.72:0/924459386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c09d9f0 0x7f294c11d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.581+0000 7f2952c98700 1 -- 172.21.15.72:0/924459386 >> 172.21.15.72:0/924459386 conn(0x7f294c066f50 msgr2=0x7f294c1301b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.581+0000 7f2952c98700 1 -- 172.21.15.72:0/924459386 shutdown_connections 2023-10-03T10:13:57.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.581+0000 7f2952c98700 1 -- 172.21.15.72:0/924459386 wait complete. 2023-10-03T10:13:57.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.648+0000 7f33e1a49700 1 -- 172.21.15.72:0/823380041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f33dc123870 con 0x7f33dc09d6f0 2023-10-03T10:13:57.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.649+0000 7f33c3fff700 1 -- 172.21.15.72:0/823380041 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33cc02d070 con 0x7f33dc09d6f0 2023-10-03T10:13:57.650 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.651+0000 7f33e1a49700 1 -- 172.21.15.72:0/823380041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc09d6f0 msgr2=0x7f33dc120200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.651+0000 7f33e1a49700 1 --2- 172.21.15.72:0/823380041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc09d6f0 0x7f33dc120200 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f33cc006d30 tx=0x7f33cc004750 comp rx=0 tx=0).stop 2023-10-03T10:13:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.651+0000 7f33e1a49700 1 -- 172.21.15.72:0/823380041 shutdown_connections 2023-10-03T10:13:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.651+0000 7f33e1a49700 1 --2- 172.21.15.72:0/823380041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33dc09d6f0 0x7f33dc120200 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.651+0000 7f33e1a49700 1 --2- 172.21.15.72:0/823380041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f33dc09e410 0x7f33dc120c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.651+0000 7f33e1a49700 1 --2- 172.21.15.72:0/823380041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33dc09e000 0x7f33dc120740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.651+0000 7f33e1a49700 1 -- 172.21.15.72:0/823380041 >> 172.21.15.72:0/823380041 conn(0x7f33dc066f50 msgr2=0x7f33dc06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.651+0000 7f33e1a49700 1 -- 172.21.15.72:0/823380041 shutdown_connections 2023-10-03T10:13:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.651+0000 7f33e1a49700 1 -- 172.21.15.72:0/823380041 wait complete. 2023-10-03T10:13:57.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:57.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.675+0000 7f03b5cf6700 1 -- 172.21.15.72:0/1074171464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f03b00713a0 con 0x7f03b006f5d0 2023-10-03T10:13:57.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.676+0000 7f0397fff700 1 -- 172.21.15.72:0/1074171464 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f03a0017020 con 0x7f03b006f5d0 2023-10-03T10:13:57.677 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:57.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.678+0000 7f03b5cf6700 1 -- 172.21.15.72:0/1074171464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03b006f5d0 msgr2=0x7f03b0134a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.678+0000 7f03b5cf6700 1 --2- 172.21.15.72:0/1074171464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03b006f5d0 0x7f03b0134a80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f03a000c4e0 tx=0x7f03a000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.678+0000 7f03b5cf6700 1 -- 172.21.15.72:0/1074171464 shutdown_connections 2023-10-03T10:13:57.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.678+0000 7f03b5cf6700 1 --2- 172.21.15.72:0/1074171464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03b006f5d0 0x7f03b0134a80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.678+0000 7f03b5cf6700 1 --2- 172.21.15.72:0/1074171464 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f03b0135c20 0x7f03b01c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.678+0000 7f03b5cf6700 1 --2- 172.21.15.72:0/1074171464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f03b012cf60 0x7f03b0134fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.678+0000 7f03b5cf6700 1 -- 172.21.15.72:0/1074171464 >> 172.21.15.72:0/1074171464 conn(0x7f03b00a2aa0 msgr2=0x7f03b012a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.678+0000 7f03b5cf6700 1 -- 172.21.15.72:0/1074171464 shutdown_connections 2023-10-03T10:13:57.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.678+0000 7f03b5cf6700 1 -- 172.21.15.72:0/1074171464 wait complete. 2023-10-03T10:13:57.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:57.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.696+0000 7fa73679b700 1 -- 172.21.15.72:0/2153979959 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa73009a3d0 con 0x7fa73013d1f0 2023-10-03T10:13:57.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.696+0000 7fa72cff9700 1 -- 172.21.15.72:0/2153979959 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa728014e00 con 0x7fa73013d1f0 2023-10-03T10:13:57.697 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:57.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.698+0000 7fa73679b700 1 -- 172.21.15.72:0/2153979959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73013d1f0 msgr2=0x7fa73013c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.698+0000 7fa73679b700 1 --2- 172.21.15.72:0/2153979959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73013d1f0 0x7fa73013c140 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa728009d90 tx=0x7fa72800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.698+0000 7fa73679b700 1 -- 172.21.15.72:0/2153979959 shutdown_connections 2023-10-03T10:13:57.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.698+0000 7fa73679b700 1 --2- 172.21.15.72:0/2153979959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73006a770 0x7fa73013b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.698+0000 7fa73679b700 1 --2- 172.21.15.72:0/2153979959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73013d1f0 0x7fa73013c140 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.698+0000 7fa73679b700 1 --2- 172.21.15.72:0/2153979959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73009de00 0x7fa73013bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.698+0000 7fa73679b700 1 -- 172.21.15.72:0/2153979959 >> 172.21.15.72:0/2153979959 conn(0x7fa730066f50 msgr2=0x7fa73009b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.698+0000 7fa73679b700 1 -- 172.21.15.72:0/2153979959 shutdown_connections 2023-10-03T10:13:57.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:57.698+0000 7fa73679b700 1 -- 172.21.15.72:0/2153979959 wait complete. 2023-10-03T10:13:57.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:58.596 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:58.665 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:58.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:58.712 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:58.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.734+0000 7f51072fd700 1 Processor -- start 2023-10-03T10:13:58.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.734+0000 7f51072fd700 1 -- start start 2023-10-03T10:13:58.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.735+0000 7f51072fd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5100131810 0x7f5100131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.735+0000 7f51072fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5100099a40 0x7f5100099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.735+0000 7f51072fd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51001313c0 con 0x7f510009a3b0 2023-10-03T10:13:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.735+0000 7f51072fd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510009b580 con 0x7f5100099a40 2023-10-03T10:13:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.735+0000 7f51072fd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f510006e8c0 con 0x7f5100131810 2023-10-03T10:13:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.735+0000 7f5105099700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5100131810 0x7f5100131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.735+0000 7f5105099700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5100131810 0x7f5100131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50482/0 (socket says 172.21.15.72:50482) 2023-10-03T10:13:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.735+0000 7f5105099700 1 -- 172.21.15.72:0/3172972447 learned_addr learned my addr 172.21.15.72:0/3172972447 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.735+0000 7f510589a700 1 --1- 172.21.15.72:0/3172972447 >> v1:172.21.15.72:6789/0 conn(0x7f510009a3b0 0x7f5100138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42252/0 (socket says 172.21.15.72:42252) 2023-10-03T10:13:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.735+0000 7f5105099700 1 -- 172.21.15.72:0/3172972447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5100099a40 msgr2=0x7f5100099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.735+0000 7f5105099700 1 --2- 172.21.15.72:0/3172972447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5100099a40 0x7f5100099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.735+0000 7f5105099700 1 -- 172.21.15.72:0/3172972447 >> v1:172.21.15.72:6789/0 conn(0x7f510009a3b0 legacy=0x7f5100138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.735+0000 7f5105099700 1 -- 172.21.15.72:0/3172972447 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510009a820 con 0x7f5100131810 2023-10-03T10:13:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.735+0000 7f5105099700 1 --2- 172.21.15.72:0/3172972447 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5100131810 0x7f5100131be0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009920 tx=0x7f50fc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=136be74dd48ee12 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.735+0000 7f50f7fff700 1 -- 172.21.15.72:0/3172972447 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc004230 con 0x7f5100131810 2023-10-03T10:13:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.736+0000 7f50f7fff700 1 -- 172.21.15.72:0/3172972447 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc004390 con 0x7f5100131810 2023-10-03T10:13:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.736+0000 7f50f7fff700 1 -- 172.21.15.72:0/3172972447 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc009e70 con 0x7f5100131810 2023-10-03T10:13:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.736+0000 7f51072fd700 1 -- 172.21.15.72:0/3172972447 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5100131810 msgr2=0x7f5100131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.736+0000 7f51072fd700 1 --2- 172.21.15.72:0/3172972447 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5100131810 0x7f5100131be0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009920 tx=0x7f50fc009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.736+0000 7f51072fd700 1 -- 172.21.15.72:0/3172972447 shutdown_connections 2023-10-03T10:13:58.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.736+0000 7f51072fd700 1 --2- 172.21.15.72:0/3172972447 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5100131810 0x7f5100131be0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.736+0000 7f51072fd700 1 --2- 172.21.15.72:0/3172972447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5100099a40 0x7f5100099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.736+0000 7f51072fd700 1 -- 172.21.15.72:0/3172972447 >> 172.21.15.72:0/3172972447 conn(0x7f51000a2aa0 msgr2=0x7f51000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.736+0000 7f51072fd700 1 -- 172.21.15.72:0/3172972447 shutdown_connections 2023-10-03T10:13:58.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.736+0000 7f51072fd700 1 -- 172.21.15.72:0/3172972447 wait complete. 2023-10-03T10:13:58.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.737+0000 7f51072fd700 1 Processor -- start 2023-10-03T10:13:58.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.738+0000 7f51072fd700 1 -- start start 2023-10-03T10:13:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.738+0000 7f51072fd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5100099a40 0x7f510011b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.738+0000 7f51072fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f510009a3b0 0x7f510011bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.738+0000 7f51072fd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5100131810 0x7f510011c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.738+0000 7f51072fd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510011f300 con 0x7f5100099a40 2023-10-03T10:13:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.738+0000 7f51072fd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510012ec90 con 0x7f510009a3b0 2023-10-03T10:13:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.738+0000 7f51072fd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5100130a70 con 0x7f5100131810 2023-10-03T10:13:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.738+0000 7f5105099700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5100099a40 0x7f510011b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.738+0000 7f5105099700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5100099a40 0x7f510011b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58938/0 (socket says 172.21.15.72:58938) 2023-10-03T10:13:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.738+0000 7f5105099700 1 -- 172.21.15.72:0/1712227707 learned_addr learned my addr 172.21.15.72:0/1712227707 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.738+0000 7f510589a700 1 --2- 172.21.15.72:0/1712227707 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5100131810 0x7f510011c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.738+0000 7f5104898700 1 --2- 172.21.15.72:0/1712227707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f510009a3b0 0x7f510011bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.739+0000 7f5105099700 1 -- 172.21.15.72:0/1712227707 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5100131810 msgr2=0x7f510011c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.739+0000 7f5105099700 1 --2- 172.21.15.72:0/1712227707 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5100131810 0x7f510011c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.739+0000 7f5105099700 1 -- 172.21.15.72:0/1712227707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f510009a3b0 msgr2=0x7f510011bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.739+0000 7f5105099700 1 --2- 172.21.15.72:0/1712227707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f510009a3b0 0x7f510011bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.739+0000 7f5105099700 1 -- 172.21.15.72:0/1712227707 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc009550 con 0x7f5100099a40 2023-10-03T10:13:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.739+0000 7f5105099700 1 --2- 172.21.15.72:0/1712227707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5100099a40 0x7f510011b7e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009130 tx=0x7f50fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.739+0000 7f50f5ffb700 1 -- 172.21.15.72:0/1712227707 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc00bdb0 con 0x7f5100099a40 2023-10-03T10:13:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.739+0000 7f50f5ffb700 1 -- 172.21.15.72:0/1712227707 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc0036a0 con 0x7f5100099a40 2023-10-03T10:13:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.739+0000 7f51072fd700 1 -- 172.21.15.72:0/1712227707 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510006eb00 con 0x7f5100099a40 2023-10-03T10:13:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.739+0000 7f50f5ffb700 1 -- 172.21.15.72:0/1712227707 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc003a10 con 0x7f5100099a40 2023-10-03T10:13:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.739+0000 7f51072fd700 1 -- 172.21.15.72:0/1712227707 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510011e1f0 con 0x7f5100099a40 2023-10-03T10:13:58.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.740+0000 7f50f5ffb700 1 -- 172.21.15.72:0/1712227707 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50fc022020 con 0x7f5100099a40 2023-10-03T10:13:58.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.740+0000 7f51072fd700 1 -- 172.21.15.72:0/1712227707 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510011ef80 con 0x7f5100099a40 2023-10-03T10:13:58.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.741+0000 7f50f5ffb700 1 -- 172.21.15.72:0/1712227707 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f50fc040dc0 con 0x7f5100099a40 2023-10-03T10:13:58.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.746+0000 7f50f5ffb700 1 -- 172.21.15.72:0/1712227707 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50fc01b470 con 0x7f5100099a40 2023-10-03T10:13:58.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.809+0000 7f5b00a14700 1 Processor -- start 2023-10-03T10:13:58.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.809+0000 7f5b00a14700 1 -- start start 2023-10-03T10:13:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.810+0000 7f5b00a14700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5afc09d630 0x7f5afc0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.810+0000 7f5b00a14700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5afc138d80 0x7f5afc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.810+0000 7f5b00a14700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc0a2a70 con 0x7f5afc0a0a30 2023-10-03T10:13:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.810+0000 7f5b00a14700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5afc0a01d0 con 0x7f5afc138d80 2023-10-03T10:13:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.810+0000 7f5b00a14700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc09e2b0 con 0x7f5afc09d630 2023-10-03T10:13:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.810+0000 7f5afad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5afc138d80 0x7f5afc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.810+0000 7f5afad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5afc138d80 0x7f5afc13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58954/0 (socket says 172.21.15.72:58954) 2023-10-03T10:13:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.810+0000 7f5afa59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5afc0a0a30 0x7f5afc0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42262/0 (socket says 172.21.15.72:42262) 2023-10-03T10:13:58.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.810+0000 7f5afad9d700 1 -- 172.21.15.72:0/3654345216 learned_addr learned my addr 172.21.15.72:0/3654345216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:58.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.811+0000 7f5afad9d700 1 -- 172.21.15.72:0/3654345216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5afc09d630 msgr2=0x7f5afc0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.811+0000 7f5afad9d700 1 --2- 172.21.15.72:0/3654345216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5afc09d630 0x7f5afc0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.811+0000 7f5afad9d700 1 -- 172.21.15.72:0/3654345216 >> v1:172.21.15.72:6789/0 conn(0x7f5afc0a0a30 legacy=0x7f5afc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.811+0000 7f5af959a700 1 -- 172.21.15.72:0/3654345216 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591508403 0 0) 0x7f5afc0a2a70 con 0x7f5afc0a0a30 2023-10-03T10:13:58.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.811+0000 7f5afad9d700 1 -- 172.21.15.72:0/3654345216 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc09dc50 con 0x7f5afc138d80 2023-10-03T10:13:58.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.811+0000 7f5afad9d700 1 --2- 172.21.15.72:0/3654345216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5afc138d80 0x7f5afc13b160 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5af4009e50 tx=0x7f5af400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520bb4c5b4e4ac58 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.811+0000 7f5af959a700 1 -- 172.21.15.72:0/3654345216 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400e070 con 0x7f5afc138d80 2023-10-03T10:13:58.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.811+0000 7f5af959a700 1 -- 172.21.15.72:0/3654345216 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af400b9c0 con 0x7f5afc138d80 2023-10-03T10:13:58.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.811+0000 7f5af959a700 1 -- 172.21.15.72:0/3654345216 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400bd70 con 0x7f5afc138d80 2023-10-03T10:13:58.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.812+0000 7f5b00a14700 1 -- 172.21.15.72:0/3654345216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5afc138d80 msgr2=0x7f5afc13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.812+0000 7f5b00a14700 1 --2- 172.21.15.72:0/3654345216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5afc138d80 0x7f5afc13b160 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5af4009e50 tx=0x7f5af400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:58.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.812+0000 7f5b00a14700 1 -- 172.21.15.72:0/3654345216 shutdown_connections 2023-10-03T10:13:58.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.812+0000 7f5b00a14700 1 --2- 172.21.15.72:0/3654345216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5afc138d80 0x7f5afc13b160 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.812+0000 7f5b00a14700 1 --2- 172.21.15.72:0/3654345216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5afc09d630 0x7f5afc0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.812+0000 7f5b00a14700 1 -- 172.21.15.72:0/3654345216 >> 172.21.15.72:0/3654345216 conn(0x7f5afc0a3050 msgr2=0x7f5afc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.812+0000 7f5b00a14700 1 -- 172.21.15.72:0/3654345216 shutdown_connections 2023-10-03T10:13:58.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.812+0000 7f5b00a14700 1 -- 172.21.15.72:0/3654345216 wait complete. 2023-10-03T10:13:58.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.814+0000 7f5b00a14700 1 Processor -- start 2023-10-03T10:13:58.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.814+0000 7f5b00a14700 1 -- start start 2023-10-03T10:13:58.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.814+0000 7f5b00a14700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5afc09d630 0x7f5afc133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.814+0000 7f5b00a14700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5afc0a0a30 0x7f5afc133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.814+0000 7f5b00a14700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5afc138d80 0x7f5afc1341e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.814+0000 7f5b00a14700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc136900 con 0x7f5afc09d630 2023-10-03T10:13:58.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.814+0000 7f5b00a14700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc135b30 con 0x7f5afc138d80 2023-10-03T10:13:58.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.814+0000 7f5b00a14700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0a4980 con 0x7f5afc0a0a30 2023-10-03T10:13:58.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.815+0000 7f5af9d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5afc0a0a30 0x7f5afc133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.815+0000 7f5af9d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5afc0a0a30 0x7f5afc133ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50524/0 (socket says 172.21.15.72:50524) 2023-10-03T10:13:58.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.815+0000 7f5af9d9b700 1 -- 172.21.15.72:0/2224577781 learned_addr learned my addr 172.21.15.72:0/2224577781 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:58.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.815+0000 7f5afa59c700 1 --2- 172.21.15.72:0/2224577781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5afc09d630 0x7f5afc133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.815+0000 7f5afad9d700 1 --2- 172.21.15.72:0/2224577781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5afc138d80 0x7f5afc1341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.815+0000 7f5afad9d700 1 -- 172.21.15.72:0/2224577781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5afc0a0a30 msgr2=0x7f5afc133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.815+0000 7f5afad9d700 1 --2- 172.21.15.72:0/2224577781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5afc0a0a30 0x7f5afc133ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.815+0000 7f5afad9d700 1 -- 172.21.15.72:0/2224577781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5afc09d630 msgr2=0x7f5afc133760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.815+0000 7f5afad9d700 1 --2- 172.21.15.72:0/2224577781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5afc09d630 0x7f5afc133760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.815+0000 7f5afad9d700 1 -- 172.21.15.72:0/2224577781 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af4009b30 con 0x7f5afc138d80 2023-10-03T10:13:58.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.815+0000 7f5af9d9b700 1 --2- 172.21.15.72:0/2224577781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5afc0a0a30 0x7f5afc133ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.815+0000 7f5afad9d700 1 --2- 172.21.15.72:0/2224577781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5afc138d80 0x7f5afc1341e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0a1fb0 tx=0x7f5af4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.815+0000 7f5aeaffd700 1 -- 172.21.15.72:0/2224577781 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af4004840 con 0x7f5afc138d80 2023-10-03T10:13:58.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.816+0000 7f5aeaffd700 1 -- 172.21.15.72:0/2224577781 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af40092e0 con 0x7f5afc138d80 2023-10-03T10:13:58.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.816+0000 7f5b00a14700 1 -- 172.21.15.72:0/2224577781 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc136bd0 con 0x7f5afc138d80 2023-10-03T10:13:58.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.816+0000 7f5aeaffd700 1 -- 172.21.15.72:0/2224577781 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af401c660 con 0x7f5afc138d80 2023-10-03T10:13:58.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.816+0000 7f5b00a14700 1 -- 172.21.15.72:0/2224577781 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc136510 con 0x7f5afc138d80 2023-10-03T10:13:58.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.817+0000 7f5aeaffd700 1 -- 172.21.15.72:0/2224577781 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5af401c7c0 con 0x7f5afc138d80 2023-10-03T10:13:58.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.817+0000 7f5aeaffd700 1 -- 172.21.15.72:0/2224577781 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5af40410b0 con 0x7f5afc138d80 2023-10-03T10:13:58.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.817+0000 7f5b00a14700 1 -- 172.21.15.72:0/2224577781 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5afc137de0 con 0x7f5afc138d80 2023-10-03T10:13:58.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.822+0000 7f5aeaffd700 1 -- 172.21.15.72:0/2224577781 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5af40123f0 con 0x7f5afc138d80 2023-10-03T10:13:58.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.861+0000 7f65941b9700 1 Processor -- start 2023-10-03T10:13:58.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.862+0000 7f65941b9700 1 -- start start 2023-10-03T10:13:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.862+0000 7f65941b9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f658c09d6f0 0x7f658c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.862+0000 7f65941b9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f658c09e440 0x7f658c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.862+0000 7f65941b9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658c09b120 con 0x7f658c09e000 2023-10-03T10:13:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.862+0000 7f65941b9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658c06b460 con 0x7f658c09d6f0 2023-10-03T10:13:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.862+0000 7f65941b9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c09a7e0 con 0x7f658c09e440 2023-10-03T10:13:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.862+0000 7f6592756700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f658c09e440 0x7f658c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.862+0000 7f6592756700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f658c09e440 0x7f658c134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43580/0 (socket says 172.21.15.72:43580) 2023-10-03T10:13:58.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.862+0000 7f6591754700 1 --1- 172.21.15.72:0/2949594293 >> v1:172.21.15.72:6789/0 conn(0x7f658c09e000 0x7f658c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42270/0 (socket says 172.21.15.72:42270) 2023-10-03T10:13:58.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.862+0000 7f6592756700 1 -- 172.21.15.72:0/2949594293 learned_addr learned my addr 172.21.15.72:0/2949594293 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:58.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.863+0000 7f6591f55700 1 --2- 172.21.15.72:0/2949594293 >> v2:172.21.15.72:3300/0 conn(0x7f658c09d6f0 0x7f658c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.863+0000 7f6590f53700 1 -- 172.21.15.72:0/2949594293 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084435963 0 0) 0x7f658c09b120 con 0x7f658c09e000 2023-10-03T10:13:58.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.863+0000 7f6590f53700 1 -- 172.21.15.72:0/2949594293 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65780035b0 con 0x7f658c09e000 2023-10-03T10:13:58.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.863+0000 7f6591f55700 1 -- 172.21.15.72:0/2949594293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f658c09e440 msgr2=0x7f658c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.863+0000 7f6591f55700 1 --2- 172.21.15.72:0/2949594293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f658c09e440 0x7f658c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.863+0000 7f6591f55700 1 -- 172.21.15.72:0/2949594293 >> v1:172.21.15.72:6789/0 conn(0x7f658c09e000 legacy=0x7f658c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.863+0000 7f6591f55700 1 -- 172.21.15.72:0/2949594293 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c09a500 con 0x7f658c09d6f0 2023-10-03T10:13:58.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.863+0000 7f6591f55700 1 --2- 172.21.15.72:0/2949594293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c09d6f0 0x7f658c09dac0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6588009870 tx=0x7f6588009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dacb2ecf37b5f99 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.863+0000 7f6590f53700 1 -- 172.21.15.72:0/2949594293 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6588011830 con 0x7f658c09d6f0 2023-10-03T10:13:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.863+0000 7f6590f53700 1 -- 172.21.15.72:0/2949594293 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6588011990 con 0x7f658c09d6f0 2023-10-03T10:13:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.863+0000 7f6590f53700 1 -- 172.21.15.72:0/2949594293 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6588011d20 con 0x7f658c09d6f0 2023-10-03T10:13:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.864+0000 7f65941b9700 1 -- 172.21.15.72:0/2949594293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c09d6f0 msgr2=0x7f658c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.864+0000 7f65941b9700 1 --2- 172.21.15.72:0/2949594293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c09d6f0 0x7f658c09dac0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6588009870 tx=0x7f6588009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.864+0000 7f65941b9700 1 -- 172.21.15.72:0/2949594293 shutdown_connections 2023-10-03T10:13:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.864+0000 7f65941b9700 1 --2- 172.21.15.72:0/2949594293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f658c09e440 0x7f658c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.864+0000 7f65941b9700 1 --2- 172.21.15.72:0/2949594293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c09d6f0 0x7f658c09dac0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.864+0000 7f65941b9700 1 -- 172.21.15.72:0/2949594293 >> 172.21.15.72:0/2949594293 conn(0x7f658c066f50 msgr2=0x7f658c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.864+0000 7f65941b9700 1 -- 172.21.15.72:0/2949594293 shutdown_connections 2023-10-03T10:13:58.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.864+0000 7f65941b9700 1 -- 172.21.15.72:0/2949594293 wait complete. 2023-10-03T10:13:58.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.865+0000 7f65941b9700 1 Processor -- start 2023-10-03T10:13:58.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.865+0000 7f65941b9700 1 -- start start 2023-10-03T10:13:58.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.866+0000 7f992ab36700 1 Processor -- start 2023-10-03T10:13:58.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.866+0000 7f992ab36700 1 -- start start 2023-10-03T10:13:58.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.866+0000 7f65941b9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f658c09d6f0 0x7f658c1a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.866+0000 7f65941b9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c09e000 0x7f658c1c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.866+0000 7f65941b9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f658c09e440 0x7f658c1c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.866+0000 7f65941b9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c09c710 con 0x7f658c09e000 2023-10-03T10:13:58.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.866+0000 7f65941b9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c1a52f0 con 0x7f658c09d6f0 2023-10-03T10:13:58.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.866+0000 7f65941b9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f658c1a7da0 con 0x7f658c09e440 2023-10-03T10:13:58.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.866+0000 7f6591f55700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f658c09d6f0 0x7f658c1a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.866+0000 7f6591f55700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f658c09d6f0 0x7f658c1a5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43596/0 (socket says 172.21.15.72:43596) 2023-10-03T10:13:58.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.866+0000 7f6591f55700 1 -- 172.21.15.72:0/3378559387 learned_addr learned my addr 172.21.15.72:0/3378559387 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:58.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.866+0000 7f6591754700 1 --2- 172.21.15.72:0/3378559387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c09e000 0x7f658c1c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f992ab36700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9924131810 0x7f9924131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f992ab36700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9924099a40 0x7f9924099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f992ab36700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992409a850 con 0x7f992409a3b0 2023-10-03T10:13:58.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f992ab36700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992409b580 con 0x7f9924099a40 2023-10-03T10:13:58.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f992ab36700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99241313c0 con 0x7f9924131810 2023-10-03T10:13:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f6591f55700 1 -- 172.21.15.72:0/3378559387 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f658c09e440 msgr2=0x7f658c1c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f6591f55700 1 --2- 172.21.15.72:0/3378559387 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f658c09e440 0x7f658c1c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f6591f55700 1 -- 172.21.15.72:0/3378559387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c09e000 msgr2=0x7f658c1c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f6591f55700 1 --2- 172.21.15.72:0/3378559387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c09e000 0x7f658c1c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f6591f55700 1 -- 172.21.15.72:0/3378559387 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65880094a0 con 0x7f658c09d6f0 2023-10-03T10:13:58.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f99288d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9924131810 0x7f9924131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f99290d3700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f992409a3b0 0x7f9924138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42276/0 (socket says 172.21.15.72:42276) 2023-10-03T10:13:58.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f99290d3700 1 -- 172.21.15.72:0/1668298344 learned_addr learned my addr 172.21.15.72:0/1668298344 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:13:58.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f99237fe700 1 -- 172.21.15.72:0/1668298344 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871470586 0 0) 0x7f992409a850 con 0x7f992409a3b0 2023-10-03T10:13:58.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f99237fe700 1 -- 172.21.15.72:0/1668298344 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99140035b0 con 0x7f992409a3b0 2023-10-03T10:13:58.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f6591f55700 1 --2- 172.21.15.72:0/3378559387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f658c09d6f0 0x7f658c1a5740 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6588000c00 tx=0x7f6588004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f99288d2700 1 -- 172.21.15.72:0/1668298344 >> v2:172.21.15.72:3300/0 conn(0x7f9924099a40 msgr2=0x7f9924099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f99288d2700 1 --2- 172.21.15.72:0/1668298344 >> v2:172.21.15.72:3300/0 conn(0x7f9924099a40 0x7f9924099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f99288d2700 1 -- 172.21.15.72:0/1668298344 >> v1:172.21.15.72:6789/0 conn(0x7f992409a3b0 legacy=0x7f9924138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f99288d2700 1 -- 172.21.15.72:0/1668298344 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992406e8c0 con 0x7f9924131810 2023-10-03T10:13:58.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f65827fc700 1 -- 172.21.15.72:0/3378559387 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65880036a0 con 0x7f658c09d6f0 2023-10-03T10:13:58.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f65827fc700 1 -- 172.21.15.72:0/3378559387 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658801f070 con 0x7f658c09d6f0 2023-10-03T10:13:58.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.867+0000 7f65827fc700 1 -- 172.21.15.72:0/3378559387 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6588003a40 con 0x7f658c09d6f0 2023-10-03T10:13:58.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.868+0000 7f65941b9700 1 -- 172.21.15.72:0/3378559387 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f658c1a8060 con 0x7f658c09d6f0 2023-10-03T10:13:58.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.868+0000 7f65941b9700 1 -- 172.21.15.72:0/3378559387 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f658c1a4ee0 con 0x7f658c09d6f0 2023-10-03T10:13:58.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.868+0000 7f99288d2700 1 --2- 172.21.15.72:0/1668298344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9924131810 0x7f9924131be0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9918009870 tx=0x7f9918009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf6cb44a75b10e94 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.868+0000 7f99237fe700 1 -- 172.21.15.72:0/1668298344 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918011830 con 0x7f9924131810 2023-10-03T10:13:58.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.868+0000 7f99237fe700 1 -- 172.21.15.72:0/1668298344 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9918011990 con 0x7f9924131810 2023-10-03T10:13:58.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.868+0000 7f99237fe700 1 -- 172.21.15.72:0/1668298344 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918011d20 con 0x7f9924131810 2023-10-03T10:13:58.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.869+0000 7f65827fc700 1 -- 172.21.15.72:0/3378559387 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6588003ba0 con 0x7f658c09d6f0 2023-10-03T10:13:58.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.869+0000 7f65827fc700 1 -- 172.21.15.72:0/3378559387 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6588021070 con 0x7f658c09d6f0 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.869+0000 7f992ab36700 1 -- 172.21.15.72:0/1668298344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9924131810 msgr2=0x7f9924131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.869+0000 7f992ab36700 1 --2- 172.21.15.72:0/1668298344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9924131810 0x7f9924131be0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9918009870 tx=0x7f9918009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.869+0000 7f992ab36700 1 -- 172.21.15.72:0/1668298344 shutdown_connections 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.869+0000 7f992ab36700 1 --2- 172.21.15.72:0/1668298344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9924131810 0x7f9924131be0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.869+0000 7f992ab36700 1 --2- 172.21.15.72:0/1668298344 >> v2:172.21.15.72:3300/0 conn(0x7f9924099a40 0x7f9924099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.869+0000 7f992ab36700 1 -- 172.21.15.72:0/1668298344 >> 172.21.15.72:0/1668298344 conn(0x7f99240a2aa0 msgr2=0x7f99240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.869+0000 7f992ab36700 1 -- 172.21.15.72:0/1668298344 shutdown_connections 2023-10-03T10:13:58.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.869+0000 7f992ab36700 1 -- 172.21.15.72:0/1668298344 wait complete. 2023-10-03T10:13:58.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.869+0000 7f65941b9700 1 -- 172.21.15.72:0/3378559387 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658c074ea0 con 0x7f658c09d6f0 2023-10-03T10:13:58.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.870+0000 7f992ab36700 1 Processor -- start 2023-10-03T10:13:58.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.870+0000 7f992ab36700 1 -- start start 2023-10-03T10:13:58.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.871+0000 7f992ab36700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9924099a40 0x7f9924127170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.871+0000 7f992ab36700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f992409a3b0 0x7f99241276b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.871+0000 7f992ab36700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9924131810 0x7f99241c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.871+0000 7f992ab36700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992412dcc0 con 0x7f9924131810 2023-10-03T10:13:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.871+0000 7f992ab36700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992406eb00 con 0x7f9924099a40 2023-10-03T10:13:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.871+0000 7f992ab36700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f992412a580 con 0x7f992409a3b0 2023-10-03T10:13:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.871+0000 7f99288d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9924099a40 0x7f9924127170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.871+0000 7f99288d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9924099a40 0x7f9924127170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43626/0 (socket says 172.21.15.72:43626) 2023-10-03T10:13:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.871+0000 7f99288d2700 1 -- 172.21.15.72:0/3121228830 learned_addr learned my addr 172.21.15.72:0/3121228830 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:13:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.872+0000 7f99290d3700 1 --2- 172.21.15.72:0/3121228830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9924131810 0x7f99241c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.872+0000 7f9923fff700 1 --2- 172.21.15.72:0/3121228830 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f992409a3b0 0x7f99241276b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.872+0000 7f99288d2700 1 -- 172.21.15.72:0/3121228830 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f992409a3b0 msgr2=0x7f99241276b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.872+0000 7f99288d2700 1 --2- 172.21.15.72:0/3121228830 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f992409a3b0 0x7f99241276b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.872+0000 7f99288d2700 1 -- 172.21.15.72:0/3121228830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9924131810 msgr2=0x7f99241c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.872+0000 7f99288d2700 1 --2- 172.21.15.72:0/3121228830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9924131810 0x7f99241c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.872+0000 7f99288d2700 1 -- 172.21.15.72:0/3121228830 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99180094a0 con 0x7f9924099a40 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.872+0000 7f99290d3700 1 --2- 172.21.15.72:0/3121228830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9924131810 0x7f99241c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.872+0000 7f99288d2700 1 --2- 172.21.15.72:0/3121228830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9924099a40 0x7f9924127170 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9918009bc0 tx=0x7f9918004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.874+0000 7f99217fa700 1 -- 172.21.15.72:0/3121228830 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918004400 con 0x7f9924099a40 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.874+0000 7f992ab36700 1 -- 172.21.15.72:0/3121228830 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992413a8a0 con 0x7f9924099a40 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.875+0000 7f992ab36700 1 -- 172.21.15.72:0/3121228830 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9924127bf0 con 0x7f9924099a40 2023-10-03T10:13:58.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.875+0000 7f65827fc700 1 -- 172.21.15.72:0/3378559387 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f658802b020 con 0x7f658c09d6f0 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.876+0000 7f99217fa700 1 -- 172.21.15.72:0/3121228830 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991801f070 con 0x7f9924099a40 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.876+0000 7f99217fa700 1 -- 172.21.15.72:0/3121228830 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99180038c0 con 0x7f9924099a40 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.876+0000 7f99217fa700 1 -- 172.21.15.72:0/3121228830 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9918021030 con 0x7f9924099a40 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.876+0000 7f992ab36700 1 -- 172.21.15.72:0/3121228830 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992412d860 con 0x7f9924099a40 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.876+0000 7f99217fa700 1 -- 172.21.15.72:0/3121228830 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9918040930 con 0x7f9924099a40 2023-10-03T10:13:58.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.881+0000 7f99217fa700 1 -- 172.21.15.72:0/3121228830 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9918019960 con 0x7f9924099a40 2023-10-03T10:13:58.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.953+0000 7f51072fd700 1 -- 172.21.15.72:0/1712227707 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5100074ea0 con 0x7f5100099a40 2023-10-03T10:13:58.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.953+0000 7f50f5ffb700 1 -- 172.21.15.72:0/1712227707 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50fc01abc0 con 0x7f5100099a40 2023-10-03T10:13:58.954 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:13:58.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.957+0000 7f51072fd700 1 -- 172.21.15.72:0/1712227707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5100099a40 msgr2=0x7f510011b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.957+0000 7f51072fd700 1 --2- 172.21.15.72:0/1712227707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5100099a40 0x7f510011b7e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009130 tx=0x7f50fc004750 comp rx=0 tx=0).stop 2023-10-03T10:13:58.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.957+0000 7f51072fd700 1 -- 172.21.15.72:0/1712227707 shutdown_connections 2023-10-03T10:13:58.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.957+0000 7f51072fd700 1 --2- 172.21.15.72:0/1712227707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5100099a40 0x7f510011b7e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.957+0000 7f51072fd700 1 --2- 172.21.15.72:0/1712227707 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5100131810 0x7f510011c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.957+0000 7f51072fd700 1 --2- 172.21.15.72:0/1712227707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f510009a3b0 0x7f510011bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.957+0000 7f51072fd700 1 -- 172.21.15.72:0/1712227707 >> 172.21.15.72:0/1712227707 conn(0x7f51000a2aa0 msgr2=0x7f51001b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.957+0000 7f51072fd700 1 -- 172.21.15.72:0/1712227707 shutdown_connections 2023-10-03T10:13:58.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:58.957+0000 7f51072fd700 1 -- 172.21.15.72:0/1712227707 wait complete. 2023-10-03T10:13:58.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:13:59.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.033+0000 7f5b00a14700 1 -- 172.21.15.72:0/2224577781 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5afc0747f0 con 0x7f5afc138d80 2023-10-03T10:13:59.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.034+0000 7f5aeaffd700 1 -- 172.21.15.72:0/2224577781 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5af4033090 con 0x7f5afc138d80 2023-10-03T10:13:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:13:59.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.036+0000 7f5b00a14700 1 -- 172.21.15.72:0/2224577781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5afc138d80 msgr2=0x7f5afc1341e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.036+0000 7f5b00a14700 1 --2- 172.21.15.72:0/2224577781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5afc138d80 0x7f5afc1341e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0a1fb0 tx=0x7f5af4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.036+0000 7f5b00a14700 1 -- 172.21.15.72:0/2224577781 shutdown_connections 2023-10-03T10:13:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.036+0000 7f5b00a14700 1 --2- 172.21.15.72:0/2224577781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5afc09d630 0x7f5afc133760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.036+0000 7f5b00a14700 1 --2- 172.21.15.72:0/2224577781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5afc138d80 0x7f5afc1341e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.036+0000 7f5b00a14700 1 --2- 172.21.15.72:0/2224577781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5afc0a0a30 0x7f5afc133ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.036+0000 7f5b00a14700 1 -- 172.21.15.72:0/2224577781 >> 172.21.15.72:0/2224577781 conn(0x7f5afc0a3050 msgr2=0x7f5afc09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.036+0000 7f5b00a14700 1 -- 172.21.15.72:0/2224577781 shutdown_connections 2023-10-03T10:13:59.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.036+0000 7f5b00a14700 1 -- 172.21.15.72:0/2224577781 wait complete. 2023-10-03T10:13:59.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:13:59.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.072+0000 7f65941b9700 1 -- 172.21.15.72:0/3378559387 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f658c09f420 con 0x7f658c09d6f0 2023-10-03T10:13:59.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.072+0000 7f65827fc700 1 -- 172.21.15.72:0/3378559387 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6588015070 con 0x7f658c09d6f0 2023-10-03T10:13:59.073 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:59.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.074+0000 7f65941b9700 1 -- 172.21.15.72:0/3378559387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f658c09d6f0 msgr2=0x7f658c1a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.074+0000 7f65941b9700 1 --2- 172.21.15.72:0/3378559387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f658c09d6f0 0x7f658c1a5740 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6588000c00 tx=0x7f6588004750 comp rx=0 tx=0).stop 2023-10-03T10:13:59.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.074+0000 7f65941b9700 1 -- 172.21.15.72:0/3378559387 shutdown_connections 2023-10-03T10:13:59.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.074+0000 7f65941b9700 1 --2- 172.21.15.72:0/3378559387 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f658c09e440 0x7f658c1c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.074+0000 7f65941b9700 1 --2- 172.21.15.72:0/3378559387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f658c09d6f0 0x7f658c1a5740 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.074+0000 7f65941b9700 1 --2- 172.21.15.72:0/3378559387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c09e000 0x7f658c1c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.074+0000 7f65941b9700 1 -- 172.21.15.72:0/3378559387 >> 172.21.15.72:0/3378559387 conn(0x7f658c066f50 msgr2=0x7f658c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.074+0000 7f65941b9700 1 -- 172.21.15.72:0/3378559387 shutdown_connections 2023-10-03T10:13:59.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.074+0000 7f65941b9700 1 -- 172.21.15.72:0/3378559387 wait complete. 2023-10-03T10:13:59.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.083+0000 7f992ab36700 1 -- 172.21.15.72:0/3121228830 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9924071db0 con 0x7f9924099a40 2023-10-03T10:13:59.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.084+0000 7f99217fa700 1 -- 172.21.15.72:0/3121228830 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9918015070 con 0x7f9924099a40 2023-10-03T10:13:59.084 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:13:59.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.086+0000 7f992ab36700 1 -- 172.21.15.72:0/3121228830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9924099a40 msgr2=0x7f9924127170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.086+0000 7f992ab36700 1 --2- 172.21.15.72:0/3121228830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9924099a40 0x7f9924127170 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9918009bc0 tx=0x7f9918004750 comp rx=0 tx=0).stop 2023-10-03T10:13:59.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.086+0000 7f992ab36700 1 -- 172.21.15.72:0/3121228830 shutdown_connections 2023-10-03T10:13:59.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.086+0000 7f992ab36700 1 --2- 172.21.15.72:0/3121228830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9924131810 0x7f99241c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.086+0000 7f992ab36700 1 --2- 172.21.15.72:0/3121228830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9924099a40 0x7f9924127170 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.086+0000 7f992ab36700 1 --2- 172.21.15.72:0/3121228830 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f992409a3b0 0x7f99241276b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.086+0000 7f992ab36700 1 -- 172.21.15.72:0/3121228830 >> 172.21.15.72:0/3121228830 conn(0x7f99240a2aa0 msgr2=0x7f99240a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.087+0000 7f992ab36700 1 -- 172.21.15.72:0/3121228830 shutdown_connections 2023-10-03T10:13:59.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:13:59.087+0000 7f992ab36700 1 -- 172.21.15.72:0/3121228830 wait complete. 2023-10-03T10:13:59.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:13:59.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:13:59.974 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:00.049 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:00.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:00.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:00.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.108+0000 7fc6dc07a700 1 Processor -- start 2023-10-03T10:14:00.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.108+0000 7fc6dc07a700 1 -- start start 2023-10-03T10:14:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.108+0000 7fc6dc07a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6d409d9f0 0x7fc6d4136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.109+0000 7fc6dc07a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6d4136a70 0x7fc6d4138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.109+0000 7fc6dc07a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d409e130 con 0x7fc6d41316c0 2023-10-03T10:14:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.109+0000 7fc6dc07a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d41321a0 con 0x7fc6d409d9f0 2023-10-03T10:14:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.109+0000 7fc6dc07a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d41312b0 con 0x7fc6d4136a70 2023-10-03T10:14:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.109+0000 7fc6d9615700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6d409d9f0 0x7fc6d4136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.109+0000 7fc6d9615700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6d409d9f0 0x7fc6d4136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59010/0 (socket says 172.21.15.72:59010) 2023-10-03T10:14:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.109+0000 7fc6d9615700 1 -- 172.21.15.72:0/2527734276 learned_addr learned my addr 172.21.15.72:0/2527734276 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.109+0000 7fc6d9615700 1 -- 172.21.15.72:0/2527734276 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6d4136a70 msgr2=0x7fc6d4138e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:14:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.109+0000 7fc6d9615700 1 --2- 172.21.15.72:0/2527734276 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6d4136a70 0x7fc6d4138e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.109+0000 7fc6d9615700 1 -- 172.21.15.72:0/2527734276 >> v1:172.21.15.72:6789/0 conn(0x7fc6d41316c0 legacy=0x7fc6d4131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.109+0000 7fc6d9615700 1 -- 172.21.15.72:0/2527734276 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d409f6e0 con 0x7fc6d409d9f0 2023-10-03T10:14:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.109+0000 7fc6d9615700 1 --2- 172.21.15.72:0/2527734276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d409d9f0 0x7fc6d4136530 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc6c40098f0 tx=0x7fc6c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525c493e08294100 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.109+0000 7fc6d8e14700 1 -- 172.21.15.72:0/2527734276 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c400b8a0 con 0x7fc6d409d9f0 2023-10-03T10:14:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.109+0000 7fc6d8e14700 1 -- 172.21.15.72:0/2527734276 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c400ba00 con 0x7fc6d409d9f0 2023-10-03T10:14:00.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.109+0000 7fc6d8e14700 1 -- 172.21.15.72:0/2527734276 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c400bd90 con 0x7fc6d409d9f0 2023-10-03T10:14:00.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.110+0000 7fc6dc07a700 1 -- 172.21.15.72:0/2527734276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d409d9f0 msgr2=0x7fc6d4136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.110+0000 7fc6dc07a700 1 --2- 172.21.15.72:0/2527734276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d409d9f0 0x7fc6d4136530 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc6c40098f0 tx=0x7fc6c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.110+0000 7fc6dc07a700 1 -- 172.21.15.72:0/2527734276 shutdown_connections 2023-10-03T10:14:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.110+0000 7fc6dc07a700 1 --2- 172.21.15.72:0/2527734276 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6d4136a70 0x7fc6d4138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.110+0000 7fc6dc07a700 1 --2- 172.21.15.72:0/2527734276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d409d9f0 0x7fc6d4136530 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.111+0000 7fc6dc07a700 1 -- 172.21.15.72:0/2527734276 >> 172.21.15.72:0/2527734276 conn(0x7fc6d4066f50 msgr2=0x7fc6d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.111+0000 7fc6dc07a700 1 -- 172.21.15.72:0/2527734276 shutdown_connections 2023-10-03T10:14:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.111+0000 7fc6dc07a700 1 -- 172.21.15.72:0/2527734276 wait complete. 2023-10-03T10:14:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.112+0000 7fc6dc07a700 1 Processor -- start 2023-10-03T10:14:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.112+0000 7fc6dc07a700 1 -- start start 2023-10-03T10:14:00.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6dc07a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6d409d9f0 0x7fc6d4132300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6dc07a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d41316c0 0x7fc6d4132840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6dc07a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6d4136a70 0x7fc6d4132d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6dc07a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d4134c20 con 0x7fc6d41316c0 2023-10-03T10:14:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6dc07a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d412e960 con 0x7fc6d4136a70 2023-10-03T10:14:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6dc07a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d412e730 con 0x7fc6d409d9f0 2023-10-03T10:14:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6d9e16700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6d409d9f0 0x7fc6d4132300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6d9e16700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6d409d9f0 0x7fc6d4132300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50564/0 (socket says 172.21.15.72:50564) 2023-10-03T10:14:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6d9e16700 1 -- 172.21.15.72:0/1088295572 learned_addr learned my addr 172.21.15.72:0/1088295572 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6da617700 1 --2- 172.21.15.72:0/1088295572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6d4136a70 0x7fc6d4132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6d9615700 1 --2- 172.21.15.72:0/1088295572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d41316c0 0x7fc6d4132840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6da617700 1 -- 172.21.15.72:0/1088295572 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6d409d9f0 msgr2=0x7fc6d4132300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6da617700 1 --2- 172.21.15.72:0/1088295572 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6d409d9f0 0x7fc6d4132300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6da617700 1 -- 172.21.15.72:0/1088295572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d41316c0 msgr2=0x7fc6d4132840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6da617700 1 --2- 172.21.15.72:0/1088295572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d41316c0 0x7fc6d4132840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6da617700 1 -- 172.21.15.72:0/1088295572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c4009550 con 0x7fc6d4136a70 2023-10-03T10:14:00.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.113+0000 7fc6da617700 1 --2- 172.21.15.72:0/1088295572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6d4136a70 0x7fc6d4132d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00bdd0 tx=0x7fc6cc009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.114+0000 7fc6d9e16700 1 --2- 172.21.15.72:0/1088295572 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6d409d9f0 0x7fc6d4132300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.114+0000 7fc6ca7fc700 1 -- 172.21.15.72:0/1088295572 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc00cb30 con 0x7fc6d4136a70 2023-10-03T10:14:00.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.114+0000 7fc6ca7fc700 1 -- 172.21.15.72:0/1088295572 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6cc00cc90 con 0x7fc6d4136a70 2023-10-03T10:14:00.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.114+0000 7fc6ca7fc700 1 -- 172.21.15.72:0/1088295572 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc014440 con 0x7fc6d4136a70 2023-10-03T10:14:00.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.114+0000 7fc6dc07a700 1 -- 172.21.15.72:0/1088295572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d4138ef0 con 0x7fc6d4136a70 2023-10-03T10:14:00.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.114+0000 7fc6dc07a700 1 -- 172.21.15.72:0/1088295572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d41336e0 con 0x7fc6d4136a70 2023-10-03T10:14:00.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.115+0000 7fc6ca7fc700 1 -- 172.21.15.72:0/1088295572 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6cc0145a0 con 0x7fc6d4136a70 2023-10-03T10:14:00.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.115+0000 7fc6ca7fc700 1 -- 172.21.15.72:0/1088295572 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc6cc03f530 con 0x7fc6d4136a70 2023-10-03T10:14:00.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.116+0000 7fc6dc07a700 1 -- 172.21.15.72:0/1088295572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d4134a80 con 0x7fc6d4136a70 2023-10-03T10:14:00.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.124+0000 7fc6ca7fc700 1 -- 172.21.15.72:0/1088295572 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6d4134a80 con 0x7fc6d4136a70 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.185+0000 7fddba798700 1 Processor -- start 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.185+0000 7fddba798700 1 -- start start 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.186+0000 7fddba798700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fddb406a770 0x7fddb409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.186+0000 7fddba798700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddb409dc30 0x7fddb409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.186+0000 7fddba798700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddb413c1e0 0x7fddb413e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.186+0000 7fddba798700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb406ab40 con 0x7fddb406a770 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.186+0000 7fddba798700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb409ebc0 con 0x7fddb409dc30 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.186+0000 7fddba798700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddb409a810 con 0x7fddb413c1e0 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.186+0000 7fddb37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddb409dc30 0x7fddb409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.186+0000 7fddb37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddb409dc30 0x7fddb409e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43638/0 (socket says 172.21.15.72:43638) 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.186+0000 7fddb37fe700 1 -- 172.21.15.72:0/592840755 learned_addr learned my addr 172.21.15.72:0/592840755 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.186+0000 7fddb8d35700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddb413c1e0 0x7fddb413e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.186+0000 7fddb3fff700 1 --2- 172.21.15.72:0/592840755 >> v2:172.21.15.72:3300/0 conn(0x7fddb406a770 0x7fddb409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.186+0000 7fddb37fe700 1 -- 172.21.15.72:0/592840755 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddb413c1e0 msgr2=0x7fddb413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.186+0000 7fddb37fe700 1 --2- 172.21.15.72:0/592840755 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddb413c1e0 0x7fddb413e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.186+0000 7fddb37fe700 1 -- 172.21.15.72:0/592840755 >> v2:172.21.15.72:3300/0 conn(0x7fddb406a770 msgr2=0x7fddb409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.186+0000 7fddb37fe700 1 --2- 172.21.15.72:0/592840755 >> v2:172.21.15.72:3300/0 conn(0x7fddb406a770 0x7fddb409d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.187+0000 7fddb37fe700 1 -- 172.21.15.72:0/592840755 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb409e920 con 0x7fddb409dc30 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.187+0000 7fddb37fe700 1 --2- 172.21.15.72:0/592840755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddb409dc30 0x7fddb409e080 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdda80098f0 tx=0x7fdda8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=314a73c758c91cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.187+0000 7fddb2ffd700 1 -- 172.21.15.72:0/592840755 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8011830 con 0x7fddb409dc30 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.187+0000 7fddb2ffd700 1 -- 172.21.15.72:0/592840755 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda8011990 con 0x7fddb409dc30 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.187+0000 7fddb2ffd700 1 -- 172.21.15.72:0/592840755 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8011d20 con 0x7fddb409dc30 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.188+0000 7fddba798700 1 -- 172.21.15.72:0/592840755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddb409dc30 msgr2=0x7fddb409e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.188+0000 7fddba798700 1 --2- 172.21.15.72:0/592840755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddb409dc30 0x7fddb409e080 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdda80098f0 tx=0x7fdda8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.188+0000 7fddba798700 1 -- 172.21.15.72:0/592840755 shutdown_connections 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.188+0000 7fddba798700 1 --2- 172.21.15.72:0/592840755 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddb413c1e0 0x7fddb413e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.188+0000 7fddba798700 1 --2- 172.21.15.72:0/592840755 >> v2:172.21.15.72:3300/0 conn(0x7fddb406a770 0x7fddb409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.188+0000 7fddba798700 1 --2- 172.21.15.72:0/592840755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddb409dc30 0x7fddb409e080 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.188+0000 7fddba798700 1 -- 172.21.15.72:0/592840755 >> 172.21.15.72:0/592840755 conn(0x7fddb4066f50 msgr2=0x7fddb409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.188+0000 7fddba798700 1 -- 172.21.15.72:0/592840755 shutdown_connections 2023-10-03T10:14:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.188+0000 7fddba798700 1 -- 172.21.15.72:0/592840755 wait complete. 2023-10-03T10:14:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.189+0000 7fddba798700 1 Processor -- start 2023-10-03T10:14:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.189+0000 7fddba798700 1 -- start start 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.189+0000 7fddba798700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddb406a770 0x7fddb411d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.189+0000 7fddba798700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddb409dc30 0x7fddb413a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.189+0000 7fddba798700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddb413c1e0 0x7fddb413aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.189+0000 7fddba798700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4120030 con 0x7fddb406a770 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.189+0000 7fddba798700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb40a3920 con 0x7fddb413c1e0 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.189+0000 7fddba798700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddb411f9f0 con 0x7fddb409dc30 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.189+0000 7fddb8d35700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddb413c1e0 0x7fddb413aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.189+0000 7fddb8d35700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddb413c1e0 0x7fddb413aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43654/0 (socket says 172.21.15.72:43654) 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.189+0000 7fddb8d35700 1 -- 172.21.15.72:0/244055605 learned_addr learned my addr 172.21.15.72:0/244055605 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.190+0000 7fddb3fff700 1 --2- 172.21.15.72:0/244055605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddb406a770 0x7fddb411d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.190+0000 7fddb37fe700 1 --2- 172.21.15.72:0/244055605 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddb409dc30 0x7fddb413a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.190+0000 7fddb8d35700 1 -- 172.21.15.72:0/244055605 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddb409dc30 msgr2=0x7fddb413a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.190+0000 7fddb8d35700 1 --2- 172.21.15.72:0/244055605 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddb409dc30 0x7fddb413a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.190+0000 7fddb8d35700 1 -- 172.21.15.72:0/244055605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddb406a770 msgr2=0x7fddb411d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.190+0000 7fddb8d35700 1 --2- 172.21.15.72:0/244055605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddb406a770 0x7fddb411d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.190+0000 7fddb8d35700 1 -- 172.21.15.72:0/244055605 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda8009550 con 0x7fddb413c1e0 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.190+0000 7fddb8d35700 1 --2- 172.21.15.72:0/244055605 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddb413c1e0 0x7fddb413aa20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fddac00efc0 tx=0x7fddac00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.190+0000 7fddb37fe700 1 --2- 172.21.15.72:0/244055605 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddb409dc30 0x7fddb413a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.190+0000 7fddb0ff9700 1 -- 172.21.15.72:0/244055605 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac009ea0 con 0x7fddb413c1e0 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.190+0000 7fddb0ff9700 1 -- 172.21.15.72:0/244055605 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddac00f040 con 0x7fddb413c1e0 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.190+0000 7fddba798700 1 -- 172.21.15.72:0/244055605 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb411e200 con 0x7fddb413c1e0 2023-10-03T10:14:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.190+0000 7fddb0ff9700 1 -- 172.21.15.72:0/244055605 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac014480 con 0x7fddb413c1e0 2023-10-03T10:14:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.190+0000 7fddba798700 1 -- 172.21.15.72:0/244055605 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb411fcb0 con 0x7fddb413c1e0 2023-10-03T10:14:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.191+0000 7fddb0ff9700 1 -- 172.21.15.72:0/244055605 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddac0145e0 con 0x7fddb413c1e0 2023-10-03T10:14:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.191+0000 7fddb0ff9700 1 -- 172.21.15.72:0/244055605 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fddac041810 con 0x7fddb413c1e0 2023-10-03T10:14:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.191+0000 7fddba798700 1 -- 172.21.15.72:0/244055605 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb4074ea0 con 0x7fddb413c1e0 2023-10-03T10:14:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.196+0000 7fddb0ff9700 1 -- 172.21.15.72:0/244055605 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddac045060 con 0x7fddb413c1e0 2023-10-03T10:14:00.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.231+0000 7fb49c7fe700 1 Processor -- start 2023-10-03T10:14:00.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.231+0000 7fb49c7fe700 1 -- start start 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.232+0000 7fb49c7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4940a0a30 0x7fb4940a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.232+0000 7fb49c7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb49409d630 0x7fb4940a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.232+0000 7fb49c7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb494133930 0x7fb494133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.232+0000 7fb49c7fe700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4940a2a70 con 0x7fb494133930 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.232+0000 7fb49c7fe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4940a01d0 con 0x7fb4940a0a30 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.232+0000 7fb49c7fe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb49409e2b0 con 0x7fb49409d630 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.232+0000 7fb49a59a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4940a0a30 0x7fb4940a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.232+0000 7fb49a59a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4940a0a30 0x7fb4940a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43660/0 (socket says 172.21.15.72:43660) 2023-10-03T10:14:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.232+0000 7fb49a59a700 1 -- 172.21.15.72:0/830668723 learned_addr learned my addr 172.21.15.72:0/830668723 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:00.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.232+0000 7fb499d99700 1 --2- 172.21.15.72:0/830668723 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb49409d630 0x7fb4940a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.232+0000 7fb49a59a700 1 -- 172.21.15.72:0/830668723 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb49409d630 msgr2=0x7fb4940a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.232+0000 7fb49a59a700 1 --2- 172.21.15.72:0/830668723 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb49409d630 0x7fb4940a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.232+0000 7fb49a59a700 1 -- 172.21.15.72:0/830668723 >> v2:172.21.15.72:3300/0 conn(0x7fb494133930 msgr2=0x7fb494133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.232+0000 7fb49ad9b700 1 --2- 172.21.15.72:0/830668723 >> v2:172.21.15.72:3300/0 conn(0x7fb494133930 0x7fb494133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.233+0000 7fb49a59a700 1 --2- 172.21.15.72:0/830668723 >> v2:172.21.15.72:3300/0 conn(0x7fb494133930 0x7fb494133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.233+0000 7fb49a59a700 1 -- 172.21.15.72:0/830668723 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49409dc50 con 0x7fb4940a0a30 2023-10-03T10:14:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.233+0000 7fb499d99700 1 --2- 172.21.15.72:0/830668723 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb49409d630 0x7fb4940a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.233+0000 7fb49ad9b700 1 --2- 172.21.15.72:0/830668723 >> v2:172.21.15.72:3300/0 conn(0x7fb494133930 0x7fb494133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.233+0000 7fb49a59a700 1 --2- 172.21.15.72:0/830668723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4940a0a30 0x7fb4940a0e00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb4900098f0 tx=0x7fb490009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ece073c2d422047b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.233+0000 7fb499598700 1 -- 172.21.15.72:0/830668723 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49000b8a0 con 0x7fb4940a0a30 2023-10-03T10:14:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.233+0000 7fb499598700 1 -- 172.21.15.72:0/830668723 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49000ba00 con 0x7fb4940a0a30 2023-10-03T10:14:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.233+0000 7fb499598700 1 -- 172.21.15.72:0/830668723 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49000bd90 con 0x7fb4940a0a30 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.234+0000 7fb49c7fe700 1 -- 172.21.15.72:0/830668723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4940a0a30 msgr2=0x7fb4940a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.234+0000 7fb49c7fe700 1 --2- 172.21.15.72:0/830668723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4940a0a30 0x7fb4940a0e00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb4900098f0 tx=0x7fb490009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.234+0000 7fb49c7fe700 1 -- 172.21.15.72:0/830668723 shutdown_connections 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.234+0000 7fb49c7fe700 1 --2- 172.21.15.72:0/830668723 >> v2:172.21.15.72:3300/0 conn(0x7fb494133930 0x7fb494133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.234+0000 7fb49c7fe700 1 --2- 172.21.15.72:0/830668723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4940a0a30 0x7fb4940a0e00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.234+0000 7fb49c7fe700 1 --2- 172.21.15.72:0/830668723 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb49409d630 0x7fb4940a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.234+0000 7fb49c7fe700 1 -- 172.21.15.72:0/830668723 >> 172.21.15.72:0/830668723 conn(0x7fb4940a3050 msgr2=0x7fb4940a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.234+0000 7fb49c7fe700 1 -- 172.21.15.72:0/830668723 shutdown_connections 2023-10-03T10:14:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.234+0000 7fb49c7fe700 1 -- 172.21.15.72:0/830668723 wait complete. 2023-10-03T10:14:00.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.235+0000 7fb49c7fe700 1 Processor -- start 2023-10-03T10:14:00.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.235+0000 7fb49c7fe700 1 -- start start 2023-10-03T10:14:00.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.235+0000 7fb49c7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb49409d630 0x7fb49411f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.235+0000 7fb49c7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4940a0a30 0x7fb49411fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.235+0000 7fb49c7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb494133930 0x7fb4941c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.235+0000 7fb49c7fe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49411f110 con 0x7fb49409d630 2023-10-03T10:14:00.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.235+0000 7fb49c7fe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4941220e0 con 0x7fb494133930 2023-10-03T10:14:00.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.235+0000 7fb49c7fe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb494133610 con 0x7fb4940a0a30 2023-10-03T10:14:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.235+0000 7fb49ad9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb494133930 0x7fb4941c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.235+0000 7fb49ad9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb494133930 0x7fb4941c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43670/0 (socket says 172.21.15.72:43670) 2023-10-03T10:14:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.235+0000 7fb49ad9b700 1 -- 172.21.15.72:0/1785483075 learned_addr learned my addr 172.21.15.72:0/1785483075 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.235+0000 7fb499d99700 1 --2- 172.21.15.72:0/1785483075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4940a0a30 0x7fb49411fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.236+0000 7fb49a59a700 1 --2- 172.21.15.72:0/1785483075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb49409d630 0x7fb49411f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.236+0000 7fb49ad9b700 1 -- 172.21.15.72:0/1785483075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4940a0a30 msgr2=0x7fb49411fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.236+0000 7fb49ad9b700 1 --2- 172.21.15.72:0/1785483075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4940a0a30 0x7fb49411fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.236+0000 7fb49ad9b700 1 -- 172.21.15.72:0/1785483075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb49409d630 msgr2=0x7fb49411f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.236+0000 7fb49ad9b700 1 --2- 172.21.15.72:0/1785483075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb49409d630 0x7fb49411f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.236+0000 7fb49ad9b700 1 -- 172.21.15.72:0/1785483075 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb490009550 con 0x7fb494133930 2023-10-03T10:14:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.236+0000 7fb49a59a700 1 --2- 172.21.15.72:0/1785483075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb49409d630 0x7fb49411f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:00.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.236+0000 7fb49ad9b700 1 --2- 172.21.15.72:0/1785483075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb494133930 0x7fb4941c7eb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00cef0 tx=0x7fb48c00cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.236+0000 7fb48affd700 1 -- 172.21.15.72:0/1785483075 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00adb0 con 0x7fb494133930 2023-10-03T10:14:00.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.236+0000 7fb48affd700 1 -- 172.21.15.72:0/1785483075 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c015440 con 0x7fb494133930 2023-10-03T10:14:00.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.236+0000 7fb48affd700 1 -- 172.21.15.72:0/1785483075 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c0157f0 con 0x7fb494133930 2023-10-03T10:14:00.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.237+0000 7fb49c7fe700 1 -- 172.21.15.72:0/1785483075 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4940a4030 con 0x7fb494133930 2023-10-03T10:14:00.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.237+0000 7fb49c7fe700 1 -- 172.21.15.72:0/1785483075 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49411ff50 con 0x7fb494133930 2023-10-03T10:14:00.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.238+0000 7fb48affd700 1 -- 172.21.15.72:0/1785483075 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb48c00d430 con 0x7fb494133930 2023-10-03T10:14:00.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.238+0000 7fb48affd700 1 -- 172.21.15.72:0/1785483075 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb48c03fbf0 con 0x7fb494133930 2023-10-03T10:14:00.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.238+0000 7febf0304700 1 Processor -- start 2023-10-03T10:14:00.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.238+0000 7fb49c7fe700 1 -- 172.21.15.72:0/1785483075 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb494121000 con 0x7fb494133930 2023-10-03T10:14:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.238+0000 7febf0304700 1 -- start start 2023-10-03T10:14:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.239+0000 7febf0304700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febe806e570 0x7febe806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.239+0000 7febf0304700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febe809eca0 0x7febe806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.239+0000 7febf0304700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7febe8134610 0x7febe8134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.239+0000 7febf0304700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe8070ee0 con 0x7febe8134610 2023-10-03T10:14:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.239+0000 7febf0304700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe8071480 con 0x7febe809eca0 2023-10-03T10:14:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.239+0000 7febf0304700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febe806f3c0 con 0x7febe806e570 2023-10-03T10:14:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.239+0000 7febed89f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febe809eca0 0x7febe806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.239+0000 7febed89f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febe809eca0 0x7febe806ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43674/0 (socket says 172.21.15.72:43674) 2023-10-03T10:14:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.239+0000 7febee0a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febe806e570 0x7febe806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.239+0000 7febed89f700 1 -- 172.21.15.72:0/1355230399 learned_addr learned my addr 172.21.15.72:0/1355230399 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.239+0000 7febed89f700 1 -- 172.21.15.72:0/1355230399 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febe806e570 msgr2=0x7febe806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.239+0000 7febed89f700 1 --2- 172.21.15.72:0/1355230399 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febe806e570 0x7febe806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.239+0000 7febed89f700 1 -- 172.21.15.72:0/1355230399 >> v2:172.21.15.72:3300/0 conn(0x7febe8134610 msgr2=0x7febe8134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.239+0000 7febed89f700 1 --2- 172.21.15.72:0/1355230399 >> v2:172.21.15.72:3300/0 conn(0x7febe8134610 0x7febe8134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.239+0000 7febed89f700 1 -- 172.21.15.72:0/1355230399 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8071b90 con 0x7febe809eca0 2023-10-03T10:14:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.240+0000 7febed89f700 1 --2- 172.21.15.72:0/1355230399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febe809eca0 0x7febe806ee80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7febd80098f0 tx=0x7febd8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3ec2f2e1e6d972a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.243+0000 7febed09e700 1 -- 172.21.15.72:0/1355230399 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd8011830 con 0x7febe809eca0 2023-10-03T10:14:00.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.243+0000 7febed09e700 1 -- 172.21.15.72:0/1355230399 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd8011990 con 0x7febe809eca0 2023-10-03T10:14:00.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.243+0000 7febed09e700 1 -- 172.21.15.72:0/1355230399 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd8011d20 con 0x7febe809eca0 2023-10-03T10:14:00.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.243+0000 7fb48affd700 1 -- 172.21.15.72:0/1785483075 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb494121000 con 0x7fb494133930 2023-10-03T10:14:00.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.244+0000 7febf0304700 1 -- 172.21.15.72:0/1355230399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febe809eca0 msgr2=0x7febe806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.244+0000 7febf0304700 1 --2- 172.21.15.72:0/1355230399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febe809eca0 0x7febe806ee80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7febd80098f0 tx=0x7febd8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:00.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.244+0000 7febf0304700 1 -- 172.21.15.72:0/1355230399 shutdown_connections 2023-10-03T10:14:00.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.244+0000 7febf0304700 1 --2- 172.21.15.72:0/1355230399 >> v2:172.21.15.72:3300/0 conn(0x7febe8134610 0x7febe8134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.244+0000 7febf0304700 1 --2- 172.21.15.72:0/1355230399 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febe806e570 0x7febe806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.244+0000 7febf0304700 1 --2- 172.21.15.72:0/1355230399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febe809eca0 0x7febe806ee80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.244+0000 7febf0304700 1 -- 172.21.15.72:0/1355230399 >> 172.21.15.72:0/1355230399 conn(0x7febe80a2aa0 msgr2=0x7febe80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.246+0000 7febf0304700 1 -- 172.21.15.72:0/1355230399 shutdown_connections 2023-10-03T10:14:00.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.246+0000 7febf0304700 1 -- 172.21.15.72:0/1355230399 wait complete. 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.247+0000 7febf0304700 1 Processor -- start 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.247+0000 7febf0304700 1 -- start start 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.247+0000 7febf0304700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febe806e570 0x7febe8127360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.247+0000 7febf0304700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febe8134610 0x7febe8125ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.247+0000 7febf0304700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febe81278a0 0x7febe81263e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.247+0000 7febf0304700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe8070610 con 0x7febe8134610 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.247+0000 7febf0304700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe813eb90 con 0x7febe806e570 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.247+0000 7febf0304700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febe813d490 con 0x7febe81278a0 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.247+0000 7febee0a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febe806e570 0x7febe8127360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.247+0000 7febee0a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febe806e570 0x7febe8127360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43688/0 (socket says 172.21.15.72:43688) 2023-10-03T10:14:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.247+0000 7febee0a0700 1 -- 172.21.15.72:0/3760816180 learned_addr learned my addr 172.21.15.72:0/3760816180 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.248+0000 7febee0a0700 1 -- 172.21.15.72:0/3760816180 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febe81278a0 msgr2=0x7febe81263e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.248+0000 7febee0a0700 1 --2- 172.21.15.72:0/3760816180 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febe81278a0 0x7febe81263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.248+0000 7febee0a0700 1 -- 172.21.15.72:0/3760816180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febe8134610 msgr2=0x7febe8125ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.248+0000 7febee0a0700 1 --2- 172.21.15.72:0/3760816180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febe8134610 0x7febe8125ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.248+0000 7febee0a0700 1 -- 172.21.15.72:0/3760816180 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd8009550 con 0x7febe806e570 2023-10-03T10:14:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.248+0000 7febee0a0700 1 --2- 172.21.15.72:0/3760816180 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febe806e570 0x7febe8127360 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7febe400e9b0 tx=0x7febe400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.248+0000 7febdeffd700 1 -- 172.21.15.72:0/3760816180 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4009710 con 0x7febe806e570 2023-10-03T10:14:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.248+0000 7febdeffd700 1 -- 172.21.15.72:0/3760816180 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe400c850 con 0x7febe806e570 2023-10-03T10:14:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.248+0000 7febf0304700 1 -- 172.21.15.72:0/3760816180 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe813d750 con 0x7febe806e570 2023-10-03T10:14:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.248+0000 7febf0304700 1 -- 172.21.15.72:0/3760816180 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe813bab0 con 0x7febe806e570 2023-10-03T10:14:00.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.248+0000 7febdeffd700 1 -- 172.21.15.72:0/3760816180 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400cbc0 con 0x7febe806e570 2023-10-03T10:14:00.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.249+0000 7febf0304700 1 -- 172.21.15.72:0/3760816180 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe809d1f0 con 0x7febe806e570 2023-10-03T10:14:00.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.250+0000 7febdeffd700 1 -- 172.21.15.72:0/3760816180 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7febe400cd20 con 0x7febe806e570 2023-10-03T10:14:00.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.250+0000 7febdeffd700 1 -- 172.21.15.72:0/3760816180 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7febe4040200 con 0x7febe806e570 2023-10-03T10:14:00.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.254+0000 7febdeffd700 1 -- 172.21.15.72:0/3760816180 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febe401a360 con 0x7febe806e570 2023-10-03T10:14:00.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.325+0000 7fc6dc07a700 1 -- 172.21.15.72:0/1088295572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc6d4134a80 con 0x7fc6d4136a70 2023-10-03T10:14:00.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.326+0000 7fc6ca7fc700 1 -- 172.21.15.72:0/1088295572 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6d4134a80 con 0x7fc6d4136a70 2023-10-03T10:14:00.326 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:00.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.328+0000 7fc6dc07a700 1 -- 172.21.15.72:0/1088295572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6d4136a70 msgr2=0x7fc6d4132d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.328+0000 7fc6dc07a700 1 --2- 172.21.15.72:0/1088295572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6d4136a70 0x7fc6d4132d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00bdd0 tx=0x7fc6cc009ed0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.328+0000 7fc6dc07a700 1 -- 172.21.15.72:0/1088295572 shutdown_connections 2023-10-03T10:14:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.328+0000 7fc6dc07a700 1 --2- 172.21.15.72:0/1088295572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6d4136a70 0x7fc6d4132d80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.328+0000 7fc6dc07a700 1 --2- 172.21.15.72:0/1088295572 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6d409d9f0 0x7fc6d4132300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.328+0000 7fc6dc07a700 1 --2- 172.21.15.72:0/1088295572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d41316c0 0x7fc6d4132840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.328+0000 7fc6dc07a700 1 -- 172.21.15.72:0/1088295572 >> 172.21.15.72:0/1088295572 conn(0x7fc6d4066f50 msgr2=0x7fc6d40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.328+0000 7fc6dc07a700 1 -- 172.21.15.72:0/1088295572 shutdown_connections 2023-10-03T10:14:00.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.328+0000 7fc6dc07a700 1 -- 172.21.15.72:0/1088295572 wait complete. 2023-10-03T10:14:00.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:00.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.450+0000 7febf0304700 1 -- 172.21.15.72:0/3760816180 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7febe8074ea0 con 0x7febe806e570 2023-10-03T10:14:00.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.451+0000 7febdeffd700 1 -- 172.21.15.72:0/3760816180 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7febe4017020 con 0x7febe806e570 2023-10-03T10:14:00.452 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:00.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.453+0000 7febf0304700 1 -- 172.21.15.72:0/3760816180 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febe806e570 msgr2=0x7febe8127360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.453+0000 7febf0304700 1 --2- 172.21.15.72:0/3760816180 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febe806e570 0x7febe8127360 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7febe400e9b0 tx=0x7febe400ed70 comp rx=0 tx=0).stop 2023-10-03T10:14:00.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.453+0000 7febf0304700 1 -- 172.21.15.72:0/3760816180 shutdown_connections 2023-10-03T10:14:00.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.453+0000 7febf0304700 1 --2- 172.21.15.72:0/3760816180 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febe81278a0 0x7febe81263e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.453+0000 7febf0304700 1 --2- 172.21.15.72:0/3760816180 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febe806e570 0x7febe8127360 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.453+0000 7febf0304700 1 --2- 172.21.15.72:0/3760816180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febe8134610 0x7febe8125ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.453+0000 7febf0304700 1 -- 172.21.15.72:0/3760816180 >> 172.21.15.72:0/3760816180 conn(0x7febe80a2aa0 msgr2=0x7febe8137ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.453+0000 7febf0304700 1 -- 172.21.15.72:0/3760816180 shutdown_connections 2023-10-03T10:14:00.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.453+0000 7febf0304700 1 -- 172.21.15.72:0/3760816180 wait complete. 2023-10-03T10:14:00.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:00.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.468+0000 7fddba798700 1 -- 172.21.15.72:0/244055605 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fddb406c360 con 0x7fddb413c1e0 2023-10-03T10:14:00.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.469+0000 7fddb0ff9700 1 -- 172.21.15.72:0/244055605 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddac0118b0 con 0x7fddb413c1e0 2023-10-03T10:14:00.469 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:00.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.471+0000 7fddba798700 1 -- 172.21.15.72:0/244055605 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddb413c1e0 msgr2=0x7fddb413aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.471+0000 7fddba798700 1 --2- 172.21.15.72:0/244055605 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddb413c1e0 0x7fddb413aa20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fddac00efc0 tx=0x7fddac00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.471+0000 7fddba798700 1 -- 172.21.15.72:0/244055605 shutdown_connections 2023-10-03T10:14:00.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.471+0000 7fddba798700 1 --2- 172.21.15.72:0/244055605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddb406a770 0x7fddb411d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.471+0000 7fddba798700 1 --2- 172.21.15.72:0/244055605 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddb413c1e0 0x7fddb413aa20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.471+0000 7fddba798700 1 --2- 172.21.15.72:0/244055605 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddb409dc30 0x7fddb413a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.471+0000 7fddba798700 1 -- 172.21.15.72:0/244055605 >> 172.21.15.72:0/244055605 conn(0x7fddb4066f50 msgr2=0x7fddb40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.471+0000 7fddba798700 1 -- 172.21.15.72:0/244055605 shutdown_connections 2023-10-03T10:14:00.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.471+0000 7fddba798700 1 -- 172.21.15.72:0/244055605 wait complete. 2023-10-03T10:14:00.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:00.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.502+0000 7fb49c7fe700 1 -- 172.21.15.72:0/1785483075 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb494121000 con 0x7fb494133930 2023-10-03T10:14:00.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.503+0000 7fb48affd700 1 -- 172.21.15.72:0/1785483075 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb494121000 con 0x7fb494133930 2023-10-03T10:14:00.503 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:00.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.505+0000 7fb49c7fe700 1 -- 172.21.15.72:0/1785483075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb494133930 msgr2=0x7fb4941c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.505+0000 7fb49c7fe700 1 --2- 172.21.15.72:0/1785483075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb494133930 0x7fb4941c7eb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00cef0 tx=0x7fb48c00cf20 comp rx=0 tx=0).stop 2023-10-03T10:14:00.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.505+0000 7fb49c7fe700 1 -- 172.21.15.72:0/1785483075 shutdown_connections 2023-10-03T10:14:00.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.505+0000 7fb49c7fe700 1 --2- 172.21.15.72:0/1785483075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb49409d630 0x7fb49411f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.505+0000 7fb49c7fe700 1 --2- 172.21.15.72:0/1785483075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb494133930 0x7fb4941c7eb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.505+0000 7fb49c7fe700 1 --2- 172.21.15.72:0/1785483075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4940a0a30 0x7fb49411fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.505+0000 7fb49c7fe700 1 -- 172.21.15.72:0/1785483075 >> 172.21.15.72:0/1785483075 conn(0x7fb4940a3050 msgr2=0x7fb49409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.505+0000 7fb49c7fe700 1 -- 172.21.15.72:0/1785483075 shutdown_connections 2023-10-03T10:14:00.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:00.505+0000 7fb49c7fe700 1 -- 172.21.15.72:0/1785483075 wait complete. 2023-10-03T10:14:00.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:01.342 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:01.466 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:01.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.470+0000 7f5844567700 1 Processor -- start 2023-10-03T10:14:01.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.471+0000 7f5844567700 1 -- start start 2023-10-03T10:14:01.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.471+0000 7f5844567700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c09d6f0 0x7f583c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.471+0000 7f5844567700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f583c09e000 0x7f583c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.471+0000 7f5844567700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09e410 0x7f583c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.471+0000 7f5844567700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583c09f520 con 0x7f583c09e000 2023-10-03T10:14:01.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.471+0000 7f5844567700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c09f130 con 0x7f583c09e410 2023-10-03T10:14:01.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.471+0000 7f5844567700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f583c09e930 con 0x7f583c09d6f0 2023-10-03T10:14:01.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.471+0000 7f5842b04700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09e410 0x7f583c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.471+0000 7f5842303700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c09d6f0 0x7f583c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.471+0000 7f5842b04700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09e410 0x7f583c130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43694/0 (socket says 172.21.15.72:43694) 2023-10-03T10:14:01.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.471+0000 7f5842b04700 1 -- 172.21.15.72:0/2105158024 learned_addr learned my addr 172.21.15.72:0/2105158024 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:01.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.471+0000 7f5841b02700 1 --2- 172.21.15.72:0/2105158024 >> v2:172.21.15.72:3300/0 conn(0x7f583c09e000 0x7f583c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.472+0000 7f5842303700 1 -- 172.21.15.72:0/2105158024 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09e410 msgr2=0x7f583c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.472+0000 7f5842303700 1 --2- 172.21.15.72:0/2105158024 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09e410 0x7f583c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.472+0000 7f5842303700 1 -- 172.21.15.72:0/2105158024 >> v2:172.21.15.72:3300/0 conn(0x7f583c09e000 msgr2=0x7f583c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.472+0000 7f5842303700 1 --2- 172.21.15.72:0/2105158024 >> v2:172.21.15.72:3300/0 conn(0x7f583c09e000 0x7f583c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.472+0000 7f5842303700 1 -- 172.21.15.72:0/2105158024 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c09b2d0 con 0x7f583c09d6f0 2023-10-03T10:14:01.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.472+0000 7f5841b02700 1 --2- 172.21.15.72:0/2105158024 >> v2:172.21.15.72:3300/0 conn(0x7f583c09e000 0x7f583c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.472+0000 7f5842b04700 1 --2- 172.21.15.72:0/2105158024 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09e410 0x7f583c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.472+0000 7f5842303700 1 --2- 172.21.15.72:0/2105158024 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c09d6f0 0x7f583c09dac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5838009870 tx=0x7f5838009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29357f22c986150a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.472+0000 7f5841301700 1 -- 172.21.15.72:0/2105158024 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838011830 con 0x7f583c09d6f0 2023-10-03T10:14:01.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.472+0000 7f5841301700 1 -- 172.21.15.72:0/2105158024 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5838011990 con 0x7f583c09d6f0 2023-10-03T10:14:01.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.472+0000 7f5841301700 1 -- 172.21.15.72:0/2105158024 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838011d20 con 0x7f583c09d6f0 2023-10-03T10:14:01.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.473+0000 7f5844567700 1 -- 172.21.15.72:0/2105158024 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c09d6f0 msgr2=0x7f583c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.473+0000 7f5844567700 1 --2- 172.21.15.72:0/2105158024 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c09d6f0 0x7f583c09dac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5838009870 tx=0x7f5838009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:01.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.473+0000 7f5844567700 1 -- 172.21.15.72:0/2105158024 shutdown_connections 2023-10-03T10:14:01.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.473+0000 7f5844567700 1 --2- 172.21.15.72:0/2105158024 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09e410 0x7f583c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.473+0000 7f5844567700 1 --2- 172.21.15.72:0/2105158024 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c09d6f0 0x7f583c09dac0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.473+0000 7f5844567700 1 --2- 172.21.15.72:0/2105158024 >> v2:172.21.15.72:3300/0 conn(0x7f583c09e000 0x7f583c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.473+0000 7f5844567700 1 -- 172.21.15.72:0/2105158024 >> 172.21.15.72:0/2105158024 conn(0x7f583c066f50 msgr2=0x7f583c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.473+0000 7f5844567700 1 -- 172.21.15.72:0/2105158024 shutdown_connections 2023-10-03T10:14:01.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.473+0000 7f5844567700 1 -- 172.21.15.72:0/2105158024 wait complete. 2023-10-03T10:14:01.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.474+0000 7f5844567700 1 Processor -- start 2023-10-03T10:14:01.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.474+0000 7f5844567700 1 -- start start 2023-10-03T10:14:01.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.474+0000 7f5844567700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c09d6f0 0x7f583c132dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.474+0000 7f5844567700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09e000 0x7f583c133300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.474+0000 7f5844567700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c09e410 0x7f583c133840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.474+0000 7f5844567700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c0a1d00 con 0x7f583c09d6f0 2023-10-03T10:14:01.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.474+0000 7f5844567700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c09c700 con 0x7f583c09e000 2023-10-03T10:14:01.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.474+0000 7f5844567700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f583c134ae0 con 0x7f583c09e410 2023-10-03T10:14:01.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.474+0000 7f5842303700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c09d6f0 0x7f583c132dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.474+0000 7f5842303700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c09d6f0 0x7f583c132dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59106/0 (socket says 172.21.15.72:59106) 2023-10-03T10:14:01.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.474+0000 7f5842303700 1 -- 172.21.15.72:0/3713350396 learned_addr learned my addr 172.21.15.72:0/3713350396 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:01.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.474+0000 7f5842b04700 1 --2- 172.21.15.72:0/3713350396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c09e410 0x7f583c133840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.474+0000 7f5841b02700 1 --2- 172.21.15.72:0/3713350396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09e000 0x7f583c133300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.475+0000 7f5842303700 1 -- 172.21.15.72:0/3713350396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c09e410 msgr2=0x7f583c133840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.475+0000 7f5842303700 1 --2- 172.21.15.72:0/3713350396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c09e410 0x7f583c133840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.475+0000 7f5842303700 1 -- 172.21.15.72:0/3713350396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09e000 msgr2=0x7f583c133300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.475+0000 7f5842303700 1 --2- 172.21.15.72:0/3713350396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09e000 0x7f583c133300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.475+0000 7f5842303700 1 -- 172.21.15.72:0/3713350396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0094a0 con 0x7f583c09d6f0 2023-10-03T10:14:01.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.475+0000 7f5842b04700 1 --2- 172.21.15.72:0/3713350396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c09e410 0x7f583c133840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.475+0000 7f5841b02700 1 --2- 172.21.15.72:0/3713350396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09e000 0x7f583c133300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.475+0000 7f5842303700 1 --2- 172.21.15.72:0/3713350396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c09d6f0 0x7f583c132dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5838000c00 tx=0x7f5838004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.475+0000 7f5832ffd700 1 -- 172.21.15.72:0/3713350396 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838004450 con 0x7f583c09d6f0 2023-10-03T10:14:01.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.475+0000 7f5832ffd700 1 -- 172.21.15.72:0/3713350396 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583801f070 con 0x7f583c09d6f0 2023-10-03T10:14:01.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.475+0000 7f5844567700 1 -- 172.21.15.72:0/3713350396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5834009b30 con 0x7f583c09d6f0 2023-10-03T10:14:01.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.475+0000 7f5832ffd700 1 -- 172.21.15.72:0/3713350396 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58380038a0 con 0x7f583c09d6f0 2023-10-03T10:14:01.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.475+0000 7f5844567700 1 -- 172.21.15.72:0/3713350396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58380094a0 con 0x7f583c09d6f0 2023-10-03T10:14:01.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.476+0000 7f5832ffd700 1 -- 172.21.15.72:0/3713350396 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5838003a00 con 0x7f583c09d6f0 2023-10-03T10:14:01.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.476+0000 7f5832ffd700 1 -- 172.21.15.72:0/3713350396 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5838021070 con 0x7f583c09d6f0 2023-10-03T10:14:01.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.476+0000 7f5844567700 1 -- 172.21.15.72:0/3713350396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c09ed10 con 0x7f583c09d6f0 2023-10-03T10:14:01.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.482+0000 7f5832ffd700 1 -- 172.21.15.72:0/3713350396 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5838015020 con 0x7f583c09d6f0 2023-10-03T10:14:01.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:01.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:01.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.598+0000 7f8ec74e5700 1 Processor -- start 2023-10-03T10:14:01.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.599+0000 7f8ec74e5700 1 -- start start 2023-10-03T10:14:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.599+0000 7f8ec74e5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec0130540 0x7f8ec0130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.599+0000 7f8ec74e5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec006fcf0 0x7f8ec0138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.599+0000 7f8ec74e5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec00716a0 con 0x7f8ec0130e50 2023-10-03T10:14:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.599+0000 7f8ec74e5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec009a390 con 0x7f8ec0130540 2023-10-03T10:14:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.599+0000 7f8ec74e5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0071290 con 0x7f8ec006fcf0 2023-10-03T10:14:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.599+0000 7f8ec5a82700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec006fcf0 0x7f8ec0138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.599+0000 7f8ec5a82700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec006fcf0 0x7f8ec0138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50656/0 (socket says 172.21.15.72:50656) 2023-10-03T10:14:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.599+0000 7f8ec5281700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec0130540 0x7f8ec0130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.599+0000 7f8ec5a82700 1 -- 172.21.15.72:0/3636088597 learned_addr learned my addr 172.21.15.72:0/3636088597 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:01.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.599+0000 7f8ec5a82700 1 -- 172.21.15.72:0/3636088597 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec0130540 msgr2=0x7f8ec0130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.599+0000 7f8ec5a82700 1 --2- 172.21.15.72:0/3636088597 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec0130540 0x7f8ec0130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.600+0000 7f8ec5a82700 1 -- 172.21.15.72:0/3636088597 >> v1:172.21.15.72:6789/0 conn(0x7f8ec0130e50 legacy=0x7f8ec006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.600+0000 7f8ec5a82700 1 -- 172.21.15.72:0/3636088597 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec0130340 con 0x7f8ec006fcf0 2023-10-03T10:14:01.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.600+0000 7f8eb7fff700 1 -- 172.21.15.72:0/3636088597 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210039658 0 0) 0x7f8ec00716a0 con 0x7f8ec0130e50 2023-10-03T10:14:01.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.600+0000 7f8ec5a82700 1 --2- 172.21.15.72:0/3636088597 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec006fcf0 0x7f8ec0138570 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8009e80 tx=0x7f8eb800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ac395a5521d4f72 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.600+0000 7f8eb7fff700 1 -- 172.21.15.72:0/3636088597 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb800e070 con 0x7f8ec006fcf0 2023-10-03T10:14:01.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.600+0000 7f8eb7fff700 1 -- 172.21.15.72:0/3636088597 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb800b910 con 0x7f8ec006fcf0 2023-10-03T10:14:01.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.600+0000 7f8eb7fff700 1 -- 172.21.15.72:0/3636088597 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb800bcc0 con 0x7f8ec006fcf0 2023-10-03T10:14:01.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.600+0000 7f8ec74e5700 1 -- 172.21.15.72:0/3636088597 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec006fcf0 msgr2=0x7f8ec0138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.600+0000 7f8ec74e5700 1 --2- 172.21.15.72:0/3636088597 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec006fcf0 0x7f8ec0138570 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8009e80 tx=0x7f8eb800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:01.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.601+0000 7f8ec74e5700 1 -- 172.21.15.72:0/3636088597 shutdown_connections 2023-10-03T10:14:01.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.601+0000 7f8ec74e5700 1 --2- 172.21.15.72:0/3636088597 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec006fcf0 0x7f8ec0138570 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.601+0000 7f8ec74e5700 1 --2- 172.21.15.72:0/3636088597 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec0130540 0x7f8ec0130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.601+0000 7f8ec74e5700 1 -- 172.21.15.72:0/3636088597 >> 172.21.15.72:0/3636088597 conn(0x7f8ec00a2aa0 msgr2=0x7f8ec00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.601+0000 7f8ec74e5700 1 -- 172.21.15.72:0/3636088597 shutdown_connections 2023-10-03T10:14:01.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.601+0000 7f8ec74e5700 1 -- 172.21.15.72:0/3636088597 wait complete. 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec74e5700 1 Processor -- start 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec74e5700 1 -- start start 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec74e5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec006fcf0 0x7f8ec01260f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec74e5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec0130540 0x7f8ec0126630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec74e5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec0130e50 0x7f8ec01c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec74e5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec012b300 con 0x7f8ec0130540 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec74e5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0139840 con 0x7f8ec006fcf0 2023-10-03T10:14:01.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec74e5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec012ce90 con 0x7f8ec0130e50 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec5281700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec006fcf0 0x7f8ec01260f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec5a82700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec0130e50 0x7f8ec01c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec5281700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec006fcf0 0x7f8ec01260f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43714/0 (socket says 172.21.15.72:43714) 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec5281700 1 -- 172.21.15.72:0/3463841458 learned_addr learned my addr 172.21.15.72:0/3463841458 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec5a82700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec0130e50 0x7f8ec01c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50670/0 (socket says 172.21.15.72:50670) 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec4a80700 1 --2- 172.21.15.72:0/3463841458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec0130540 0x7f8ec0126630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec5a82700 1 -- 172.21.15.72:0/3463841458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec006fcf0 msgr2=0x7f8ec01260f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec5a82700 1 --2- 172.21.15.72:0/3463841458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec006fcf0 0x7f8ec01260f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec5a82700 1 -- 172.21.15.72:0/3463841458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec0130540 msgr2=0x7f8ec0126630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec5a82700 1 --2- 172.21.15.72:0/3463841458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec0130540 0x7f8ec0126630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.602+0000 7f8ec5a82700 1 -- 172.21.15.72:0/3463841458 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb8009b30 con 0x7f8ec0130e50 2023-10-03T10:14:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.603+0000 7f8ec5a82700 1 --2- 172.21.15.72:0/3463841458 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec0130e50 0x7f8ec01c5cb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8015000 tx=0x7f8eb8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.603+0000 7f8eb5ffb700 1 -- 172.21.15.72:0/3463841458 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80092e0 con 0x7f8ec0130e50 2023-10-03T10:14:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.603+0000 7f8eb5ffb700 1 -- 172.21.15.72:0/3463841458 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb801c440 con 0x7f8ec0130e50 2023-10-03T10:14:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.603+0000 7f8ec74e5700 1 -- 172.21.15.72:0/3463841458 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec0139430 con 0x7f8ec0130e50 2023-10-03T10:14:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.603+0000 7f8eb5ffb700 1 -- 172.21.15.72:0/3463841458 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb801c810 con 0x7f8ec0130e50 2023-10-03T10:14:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.603+0000 7f8ec74e5700 1 -- 172.21.15.72:0/3463841458 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec012d900 con 0x7f8ec0130e50 2023-10-03T10:14:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.604+0000 7f8eb5ffb700 1 -- 172.21.15.72:0/3463841458 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8eb801c970 con 0x7f8ec0130e50 2023-10-03T10:14:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.604+0000 7f8eb5ffb700 1 -- 172.21.15.72:0/3463841458 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8eb8040e20 con 0x7f8ec0130e50 2023-10-03T10:14:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.604+0000 7f8ec74e5700 1 -- 172.21.15.72:0/3463841458 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec012ccd0 con 0x7f8ec0130e50 2023-10-03T10:14:01.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.609+0000 7f8eb5ffb700 1 -- 172.21.15.72:0/3463841458 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8eb8019330 con 0x7f8ec0130e50 2023-10-03T10:14:01.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.623+0000 7f3a324d9700 1 Processor -- start 2023-10-03T10:14:01.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.623+0000 7f3a324d9700 1 -- start start 2023-10-03T10:14:01.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a324d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a2c09d630 0x7f3a2c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a324d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c138d80 0x7f3a2c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a324d9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2c0a2a70 con 0x7f3a2c0a0a30 2023-10-03T10:14:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a324d9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0a01d0 con 0x7f3a2c138d80 2023-10-03T10:14:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a324d9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c09e2b0 con 0x7f3a2c09d630 2023-10-03T10:14:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a2b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a2c09d630 0x7f3a2c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a2b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a2c09d630 0x7f3a2c0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50680/0 (socket says 172.21.15.72:50680) 2023-10-03T10:14:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a2b7fe700 1 -- 172.21.15.72:0/3020316112 learned_addr learned my addr 172.21.15.72:0/3020316112 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a30a76700 1 --2- 172.21.15.72:0/3020316112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c138d80 0x7f3a2c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a2b7fe700 1 -- 172.21.15.72:0/3020316112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c138d80 msgr2=0x7f3a2c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a2b7fe700 1 --2- 172.21.15.72:0/3020316112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c138d80 0x7f3a2c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a2b7fe700 1 -- 172.21.15.72:0/3020316112 >> v1:172.21.15.72:6789/0 conn(0x7f3a2c0a0a30 legacy=0x7f3a2c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a2b7fe700 1 -- 172.21.15.72:0/3020316112 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c09dc50 con 0x7f3a2c09d630 2023-10-03T10:14:01.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a2b7fe700 1 --2- 172.21.15.72:0/3020316112 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a2c09d630 0x7f3a2c0a1510 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009920 tx=0x7f3a20009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=552dedc01ff15778 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a2affd700 1 -- 172.21.15.72:0/3020316112 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20011830 con 0x7f3a2c09d630 2023-10-03T10:14:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a2affd700 1 -- 172.21.15.72:0/3020316112 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a20011990 con 0x7f3a2c09d630 2023-10-03T10:14:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.624+0000 7f3a2affd700 1 -- 172.21.15.72:0/3020316112 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20011d20 con 0x7f3a2c09d630 2023-10-03T10:14:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.625+0000 7f3a324d9700 1 -- 172.21.15.72:0/3020316112 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a2c09d630 msgr2=0x7f3a2c0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.625+0000 7f3a324d9700 1 --2- 172.21.15.72:0/3020316112 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a2c09d630 0x7f3a2c0a1510 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009920 tx=0x7f3a20009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.625+0000 7f3a324d9700 1 -- 172.21.15.72:0/3020316112 shutdown_connections 2023-10-03T10:14:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.625+0000 7f3a324d9700 1 --2- 172.21.15.72:0/3020316112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c138d80 0x7f3a2c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.625+0000 7f3a324d9700 1 --2- 172.21.15.72:0/3020316112 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a2c09d630 0x7f3a2c0a1510 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.625+0000 7f3a324d9700 1 -- 172.21.15.72:0/3020316112 >> 172.21.15.72:0/3020316112 conn(0x7f3a2c0a3050 msgr2=0x7f3a2c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.625+0000 7f3a324d9700 1 -- 172.21.15.72:0/3020316112 shutdown_connections 2023-10-03T10:14:01.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.625+0000 7f3a324d9700 1 -- 172.21.15.72:0/3020316112 wait complete. 2023-10-03T10:14:01.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.626+0000 7f3a324d9700 1 Processor -- start 2023-10-03T10:14:01.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.626+0000 7f3a324d9700 1 -- start start 2023-10-03T10:14:01.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a324d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a2c09d630 0x7f3a2c120890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a324d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0a0a30 0x7f3a2c120dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a324d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c138d80 0x7f3a2c121310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a324d9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c122e60 con 0x7f3a2c138d80 2023-10-03T10:14:01.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a324d9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c122540 con 0x7f3a2c0a0a30 2023-10-03T10:14:01.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a324d9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0a0410 con 0x7f3a2c09d630 2023-10-03T10:14:01.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a2bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a2c09d630 0x7f3a2c120890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a2bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a2c09d630 0x7f3a2c120890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50684/0 (socket says 172.21.15.72:50684) 2023-10-03T10:14:01.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a2bfff700 1 -- 172.21.15.72:0/3445702444 learned_addr learned my addr 172.21.15.72:0/3445702444 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:01.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a2b7fe700 1 --2- 172.21.15.72:0/3445702444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0a0a30 0x7f3a2c120dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a30a76700 1 --2- 172.21.15.72:0/3445702444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c138d80 0x7f3a2c121310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a30a76700 1 -- 172.21.15.72:0/3445702444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a2c09d630 msgr2=0x7f3a2c120890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a30a76700 1 --2- 172.21.15.72:0/3445702444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a2c09d630 0x7f3a2c120890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a30a76700 1 -- 172.21.15.72:0/3445702444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0a0a30 msgr2=0x7f3a2c120dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a30a76700 1 --2- 172.21.15.72:0/3445702444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0a0a30 0x7f3a2c120dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.627+0000 7f3a30a76700 1 -- 172.21.15.72:0/3445702444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a20009550 con 0x7f3a2c138d80 2023-10-03T10:14:01.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.628+0000 7f3a30a76700 1 --2- 172.21.15.72:0/3445702444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c138d80 0x7f3a2c121310 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0a23a0 tx=0x7f3a2400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.628+0000 7f3a28ff9700 1 -- 172.21.15.72:0/3445702444 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2400cc20 con 0x7f3a2c138d80 2023-10-03T10:14:01.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.628+0000 7f3a28ff9700 1 -- 172.21.15.72:0/3445702444 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2400f040 con 0x7f3a2c138d80 2023-10-03T10:14:01.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.628+0000 7f3a28ff9700 1 -- 172.21.15.72:0/3445702444 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24009e60 con 0x7f3a2c138d80 2023-10-03T10:14:01.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.628+0000 7f3a324d9700 1 -- 172.21.15.72:0/3445702444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c1242d0 con 0x7f3a2c138d80 2023-10-03T10:14:01.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.628+0000 7f3a324d9700 1 -- 172.21.15.72:0/3445702444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c123ff0 con 0x7f3a2c138d80 2023-10-03T10:14:01.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.629+0000 7f3a28ff9700 1 -- 172.21.15.72:0/3445702444 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a24014480 con 0x7f3a2c138d80 2023-10-03T10:14:01.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.629+0000 7f3a28ff9700 1 -- 172.21.15.72:0/3445702444 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3a240402e0 con 0x7f3a2c138d80 2023-10-03T10:14:01.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.629+0000 7f3a324d9700 1 -- 172.21.15.72:0/3445702444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c0747f0 con 0x7f3a2c138d80 2023-10-03T10:14:01.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.634+0000 7f3a28ff9700 1 -- 172.21.15.72:0/3445702444 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a24018020 con 0x7f3a2c138d80 2023-10-03T10:14:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.676+0000 7fc87494e700 1 Processor -- start 2023-10-03T10:14:01.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.676+0000 7fc87494e700 1 -- start start 2023-10-03T10:14:01.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.677+0000 7fc87494e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc87009d630 0x7fc8700a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.677+0000 7fc87494e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc870138d80 0x7fc87013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.677+0000 7fc87494e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8700a2a70 con 0x7fc8700a0a30 2023-10-03T10:14:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.677+0000 7fc87494e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8700a01d0 con 0x7fc870138d80 2023-10-03T10:14:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.677+0000 7fc87494e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87009e2b0 con 0x7fc87009d630 2023-10-03T10:14:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.677+0000 7fc86ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc870138d80 0x7fc87013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.677+0000 7fc86ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc870138d80 0x7fc87013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59134/0 (socket says 172.21.15.72:59134) 2023-10-03T10:14:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.677+0000 7fc86ed9d700 1 -- 172.21.15.72:0/2239262706 learned_addr learned my addr 172.21.15.72:0/2239262706 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:01.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.677+0000 7fc86dd9b700 1 --2- 172.21.15.72:0/2239262706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc87009d630 0x7fc8700a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.677+0000 7fc86ed9d700 1 -- 172.21.15.72:0/2239262706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc87009d630 msgr2=0x7fc8700a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.677+0000 7fc86ed9d700 1 --2- 172.21.15.72:0/2239262706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc87009d630 0x7fc8700a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.677+0000 7fc86ed9d700 1 -- 172.21.15.72:0/2239262706 >> v1:172.21.15.72:6789/0 conn(0x7fc8700a0a30 legacy=0x7fc8700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.677+0000 7fc86ed9d700 1 -- 172.21.15.72:0/2239262706 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87009dc50 con 0x7fc870138d80 2023-10-03T10:14:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.677+0000 7fc86d59a700 1 -- 172.21.15.72:0/2239262706 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104329299 0 0) 0x7fc8700a2a70 con 0x7fc8700a0a30 2023-10-03T10:14:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.677+0000 7fc86ed9d700 1 --2- 172.21.15.72:0/2239262706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc870138d80 0x7fc87013b160 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc868009e50 tx=0x7fc86800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f8e5f2399f9fd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.678+0000 7fc86d59a700 1 -- 172.21.15.72:0/2239262706 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86800e070 con 0x7fc870138d80 2023-10-03T10:14:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.678+0000 7fc86d59a700 1 -- 172.21.15.72:0/2239262706 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86800b910 con 0x7fc870138d80 2023-10-03T10:14:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.678+0000 7fc86d59a700 1 -- 172.21.15.72:0/2239262706 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86800bcc0 con 0x7fc870138d80 2023-10-03T10:14:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.678+0000 7fc87494e700 1 -- 172.21.15.72:0/2239262706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc870138d80 msgr2=0x7fc87013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.678+0000 7fc87494e700 1 --2- 172.21.15.72:0/2239262706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc870138d80 0x7fc87013b160 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc868009e50 tx=0x7fc86800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.678+0000 7fc87494e700 1 -- 172.21.15.72:0/2239262706 shutdown_connections 2023-10-03T10:14:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.678+0000 7fc87494e700 1 --2- 172.21.15.72:0/2239262706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc870138d80 0x7fc87013b160 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.678+0000 7fc87494e700 1 --2- 172.21.15.72:0/2239262706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc87009d630 0x7fc8700a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.678+0000 7fc87494e700 1 -- 172.21.15.72:0/2239262706 >> 172.21.15.72:0/2239262706 conn(0x7fc8700a3050 msgr2=0x7fc8700a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.678+0000 7fc87494e700 1 -- 172.21.15.72:0/2239262706 shutdown_connections 2023-10-03T10:14:01.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.678+0000 7fc87494e700 1 -- 172.21.15.72:0/2239262706 wait complete. 2023-10-03T10:14:01.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.680+0000 7fc87494e700 1 Processor -- start 2023-10-03T10:14:01.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.680+0000 7fc87494e700 1 -- start start 2023-10-03T10:14:01.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc87494e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc87009d630 0x7fc8701335f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc87494e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8700a0a30 0x7fc870133b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc87494e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc870138d80 0x7fc870134070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc87494e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8701371a0 con 0x7fc8700a0a30 2023-10-03T10:14:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc87494e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700a49c0 con 0x7fc87009d630 2023-10-03T10:14:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc87494e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8700a0410 con 0x7fc870138d80 2023-10-03T10:14:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc86e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc87009d630 0x7fc8701335f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc86dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8700a0a30 0x7fc870133b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc86e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc87009d630 0x7fc8701335f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43758/0 (socket says 172.21.15.72:43758) 2023-10-03T10:14:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc86e59c700 1 -- 172.21.15.72:0/1863967400 learned_addr learned my addr 172.21.15.72:0/1863967400 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc86ed9d700 1 --2- 172.21.15.72:0/1863967400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc870138d80 0x7fc870134070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc86ed9d700 1 -- 172.21.15.72:0/1863967400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc87009d630 msgr2=0x7fc8701335f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc86ed9d700 1 --2- 172.21.15.72:0/1863967400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc87009d630 0x7fc8701335f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc86ed9d700 1 -- 172.21.15.72:0/1863967400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8700a0a30 msgr2=0x7fc870133b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc86ed9d700 1 --2- 172.21.15.72:0/1863967400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8700a0a30 0x7fc870133b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc86ed9d700 1 -- 172.21.15.72:0/1863967400 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc868009b30 con 0x7fc870138d80 2023-10-03T10:14:01.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc86e59c700 1 --2- 172.21.15.72:0/1863967400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc87009d630 0x7fc8701335f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.681+0000 7fc86dd9b700 1 --2- 172.21.15.72:0/1863967400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8700a0a30 0x7fc870133b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.682+0000 7fc86ed9d700 1 --2- 172.21.15.72:0/1863967400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc870138d80 0x7fc870134070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc868015000 tx=0x7fc868004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.682+0000 7fc85effd700 1 -- 172.21.15.72:0/1863967400 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc868004450 con 0x7fc870138d80 2023-10-03T10:14:01.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.682+0000 7fc85effd700 1 -- 172.21.15.72:0/1863967400 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8680045d0 con 0x7fc870138d80 2023-10-03T10:14:01.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.682+0000 7fc87494e700 1 -- 172.21.15.72:0/1863967400 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc870136af0 con 0x7fc870138d80 2023-10-03T10:14:01.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.682+0000 7fc85effd700 1 -- 172.21.15.72:0/1863967400 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8680092e0 con 0x7fc870138d80 2023-10-03T10:14:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.682+0000 7fc87494e700 1 -- 172.21.15.72:0/1863967400 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc870137820 con 0x7fc870138d80 2023-10-03T10:14:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.683+0000 7fc85effd700 1 -- 172.21.15.72:0/1863967400 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc8680123f0 con 0x7fc870138d80 2023-10-03T10:14:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.683+0000 7fc85effd700 1 -- 172.21.15.72:0/1863967400 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc8680489c0 con 0x7fc870138d80 2023-10-03T10:14:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.683+0000 7fc87494e700 1 -- 172.21.15.72:0/1863967400 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8700747f0 con 0x7fc870138d80 2023-10-03T10:14:01.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.692+0000 7fc85effd700 1 -- 172.21.15.72:0/1863967400 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8680102f0 con 0x7fc870138d80 2023-10-03T10:14:01.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.721+0000 7f5844567700 1 -- 172.21.15.72:0/3713350396 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f583c074ea0 con 0x7f583c09d6f0 2023-10-03T10:14:01.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.721+0000 7f5832ffd700 1 -- 172.21.15.72:0/3713350396 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f583803ee60 con 0x7f583c09d6f0 2023-10-03T10:14:01.721 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:01.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.723+0000 7f5844567700 1 -- 172.21.15.72:0/3713350396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c09d6f0 msgr2=0x7f583c132dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.723+0000 7f5844567700 1 --2- 172.21.15.72:0/3713350396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c09d6f0 0x7f583c132dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5838000c00 tx=0x7f5838004750 comp rx=0 tx=0).stop 2023-10-03T10:14:01.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.723+0000 7f5844567700 1 -- 172.21.15.72:0/3713350396 shutdown_connections 2023-10-03T10:14:01.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.723+0000 7f5844567700 1 --2- 172.21.15.72:0/3713350396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c09d6f0 0x7f583c132dc0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.723+0000 7f5844567700 1 --2- 172.21.15.72:0/3713350396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c09e410 0x7f583c133840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.723+0000 7f5844567700 1 --2- 172.21.15.72:0/3713350396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09e000 0x7f583c133300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.723+0000 7f5844567700 1 -- 172.21.15.72:0/3713350396 >> 172.21.15.72:0/3713350396 conn(0x7f583c066f50 msgr2=0x7f583c070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.723+0000 7f5844567700 1 -- 172.21.15.72:0/3713350396 shutdown_connections 2023-10-03T10:14:01.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.723+0000 7f5844567700 1 -- 172.21.15.72:0/3713350396 wait complete. 2023-10-03T10:14:01.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:01.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.842+0000 7f8ec74e5700 1 -- 172.21.15.72:0/3463841458 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8ec012cae0 con 0x7f8ec0130e50 2023-10-03T10:14:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.842+0000 7f8eb5ffb700 1 -- 172.21.15.72:0/3463841458 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8eb8026ba0 con 0x7f8ec0130e50 2023-10-03T10:14:01.842 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.844+0000 7f8ec74e5700 1 -- 172.21.15.72:0/3463841458 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec0130e50 msgr2=0x7f8ec01c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.844+0000 7f8ec74e5700 1 --2- 172.21.15.72:0/3463841458 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec0130e50 0x7f8ec01c5cb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8015000 tx=0x7f8eb8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.844+0000 7f8ec74e5700 1 -- 172.21.15.72:0/3463841458 shutdown_connections 2023-10-03T10:14:01.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.844+0000 7f8ec74e5700 1 --2- 172.21.15.72:0/3463841458 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec0130e50 0x7f8ec01c5cb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.844+0000 7f8ec74e5700 1 --2- 172.21.15.72:0/3463841458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec006fcf0 0x7f8ec01260f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.844+0000 7f8ec74e5700 1 --2- 172.21.15.72:0/3463841458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec0130540 0x7f8ec0126630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.844+0000 7f8ec74e5700 1 -- 172.21.15.72:0/3463841458 >> 172.21.15.72:0/3463841458 conn(0x7f8ec00a2aa0 msgr2=0x7f8ec0126eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.844+0000 7f8ec74e5700 1 -- 172.21.15.72:0/3463841458 shutdown_connections 2023-10-03T10:14:01.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.844+0000 7f8ec74e5700 1 -- 172.21.15.72:0/3463841458 wait complete. 2023-10-03T10:14:01.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:01.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.961+0000 7f3a324d9700 1 -- 172.21.15.72:0/3445702444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3a2c1389e0 con 0x7f3a2c138d80 2023-10-03T10:14:01.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.961+0000 7f3a28ff9700 1 -- 172.21.15.72:0/3445702444 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a2402b090 con 0x7f3a2c138d80 2023-10-03T10:14:01.961 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:01.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.964+0000 7f3a324d9700 1 -- 172.21.15.72:0/3445702444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c138d80 msgr2=0x7f3a2c121310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.964+0000 7f3a324d9700 1 --2- 172.21.15.72:0/3445702444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c138d80 0x7f3a2c121310 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0a23a0 tx=0x7f3a2400ef90 comp rx=0 tx=0).stop 2023-10-03T10:14:01.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.964+0000 7f3a324d9700 1 -- 172.21.15.72:0/3445702444 shutdown_connections 2023-10-03T10:14:01.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.964+0000 7f3a324d9700 1 --2- 172.21.15.72:0/3445702444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c138d80 0x7f3a2c121310 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.964+0000 7f3a324d9700 1 --2- 172.21.15.72:0/3445702444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a2c09d630 0x7f3a2c120890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.964+0000 7f3a324d9700 1 --2- 172.21.15.72:0/3445702444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0a0a30 0x7f3a2c120dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.964+0000 7f3a324d9700 1 -- 172.21.15.72:0/3445702444 >> 172.21.15.72:0/3445702444 conn(0x7f3a2c0a3050 msgr2=0x7f3a2c0a5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.964+0000 7f3a324d9700 1 -- 172.21.15.72:0/3445702444 shutdown_connections 2023-10-03T10:14:01.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:01.964+0000 7f3a324d9700 1 -- 172.21.15.72:0/3445702444 wait complete. 2023-10-03T10:14:01.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.005+0000 7fc87494e700 1 -- 172.21.15.72:0/1863967400 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc870072980 con 0x7fc870138d80 2023-10-03T10:14:02.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.005+0000 7fc85effd700 1 -- 172.21.15.72:0/1863967400 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc86802e030 con 0x7fc870138d80 2023-10-03T10:14:02.005 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:02.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.007+0000 7fc87494e700 1 -- 172.21.15.72:0/1863967400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc870138d80 msgr2=0x7fc870134070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.007+0000 7fc87494e700 1 --2- 172.21.15.72:0/1863967400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc870138d80 0x7fc870134070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc868015000 tx=0x7fc868004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.007+0000 7fc87494e700 1 -- 172.21.15.72:0/1863967400 shutdown_connections 2023-10-03T10:14:02.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.007+0000 7fc87494e700 1 --2- 172.21.15.72:0/1863967400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc870138d80 0x7fc870134070 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.007+0000 7fc87494e700 1 --2- 172.21.15.72:0/1863967400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc87009d630 0x7fc8701335f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.007+0000 7fc87494e700 1 --2- 172.21.15.72:0/1863967400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8700a0a30 0x7fc870133b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.007+0000 7fc87494e700 1 -- 172.21.15.72:0/1863967400 >> 172.21.15.72:0/1863967400 conn(0x7fc8700a3050 msgr2=0x7fc87013ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.007+0000 7fc87494e700 1 -- 172.21.15.72:0/1863967400 shutdown_connections 2023-10-03T10:14:02.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.007+0000 7fc87494e700 1 -- 172.21.15.72:0/1863967400 wait complete. 2023-10-03T10:14:02.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:02.736 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:02.857 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:02.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.870+0000 7f9287442700 1 Processor -- start 2023-10-03T10:14:02.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.870+0000 7f9287442700 1 -- start start 2023-10-03T10:14:02.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f9287442700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92801305f0 0x7f92801309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f9287442700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928006f660 0x7f928006fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f9287442700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92801301c0 con 0x7f928006ff90 2023-10-03T10:14:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f9287442700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9280071ff0 con 0x7f92801305f0 2023-10-03T10:14:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f9287442700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9280070e70 con 0x7f928006f660 2023-10-03T10:14:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f92851de700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92801305f0 0x7f92801309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f92849dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928006f660 0x7f928006fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f92851de700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92801305f0 0x7f92801309c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59152/0 (socket says 172.21.15.72:59152) 2023-10-03T10:14:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f92849dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928006f660 0x7f928006fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50714/0 (socket says 172.21.15.72:50714) 2023-10-03T10:14:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f92851de700 1 -- 172.21.15.72:0/3963416787 learned_addr learned my addr 172.21.15.72:0/3963416787 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f92849dd700 1 -- 172.21.15.72:0/3963416787 >> v2:172.21.15.72:3300/0 conn(0x7f92801305f0 msgr2=0x7f92801309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f92849dd700 1 --2- 172.21.15.72:0/3963416787 >> v2:172.21.15.72:3300/0 conn(0x7f92801305f0 0x7f92801309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f92849dd700 1 -- 172.21.15.72:0/3963416787 >> v1:172.21.15.72:6789/0 conn(0x7f928006ff90 legacy=0x7f9280137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f92849dd700 1 -- 172.21.15.72:0/3963416787 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92800722b0 con 0x7f928006f660 2023-10-03T10:14:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f92851de700 1 --2- 172.21.15.72:0/3963416787 >> v2:172.21.15.72:3300/0 conn(0x7f92801305f0 0x7f92801309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f92849dd700 1 --2- 172.21.15.72:0/3963416787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928006f660 0x7f928006fa50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f927000bae0 tx=0x7f927000bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bc93a9e412bd489 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.871+0000 7f9277fff700 1 -- 172.21.15.72:0/3963416787 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927000dc70 con 0x7f928006f660 2023-10-03T10:14:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.872+0000 7f9277fff700 1 -- 172.21.15.72:0/3963416787 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927000ddd0 con 0x7f928006f660 2023-10-03T10:14:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.872+0000 7f9277fff700 1 -- 172.21.15.72:0/3963416787 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270010690 con 0x7f928006f660 2023-10-03T10:14:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.872+0000 7f9287442700 1 -- 172.21.15.72:0/3963416787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928006f660 msgr2=0x7f928006fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.872+0000 7f9287442700 1 --2- 172.21.15.72:0/3963416787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928006f660 0x7f928006fa50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f927000bae0 tx=0x7f927000bdf0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.872+0000 7f9287442700 1 -- 172.21.15.72:0/3963416787 shutdown_connections 2023-10-03T10:14:02.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.872+0000 7f9287442700 1 --2- 172.21.15.72:0/3963416787 >> v2:172.21.15.72:3300/0 conn(0x7f92801305f0 0x7f92801309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.872+0000 7f9287442700 1 --2- 172.21.15.72:0/3963416787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928006f660 0x7f928006fa50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.872+0000 7f9287442700 1 -- 172.21.15.72:0/3963416787 >> 172.21.15.72:0/3963416787 conn(0x7f92800a2aa0 msgr2=0x7f92800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.872+0000 7f9287442700 1 -- 172.21.15.72:0/3963416787 shutdown_connections 2023-10-03T10:14:02.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.872+0000 7f9287442700 1 -- 172.21.15.72:0/3963416787 wait complete. 2023-10-03T10:14:02.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.873+0000 7f9287442700 1 Processor -- start 2023-10-03T10:14:02.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.873+0000 7f9287442700 1 -- start start 2023-10-03T10:14:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f9287442700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928006f660 0x7f928011ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f9287442700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928006ff90 0x7f928011bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f9287442700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92801305f0 0x7f928011c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f9287442700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928011f540 con 0x7f92801305f0 2023-10-03T10:14:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f9287442700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928011ce60 con 0x7f928006f660 2023-10-03T10:14:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f9287442700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f928011d630 con 0x7f928006ff90 2023-10-03T10:14:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f92859df700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92801305f0 0x7f928011c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f92859df700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92801305f0 0x7f928011c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59162/0 (socket says 172.21.15.72:59162) 2023-10-03T10:14:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f92859df700 1 -- 172.21.15.72:0/525388803 learned_addr learned my addr 172.21.15.72:0/525388803 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f92849dd700 1 --2- 172.21.15.72:0/525388803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928006ff90 0x7f928011bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f92851de700 1 --2- 172.21.15.72:0/525388803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928006f660 0x7f928011ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f92859df700 1 -- 172.21.15.72:0/525388803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928006ff90 msgr2=0x7f928011bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f92859df700 1 --2- 172.21.15.72:0/525388803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928006ff90 0x7f928011bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f92859df700 1 -- 172.21.15.72:0/525388803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928006f660 msgr2=0x7f928011ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f92859df700 1 --2- 172.21.15.72:0/525388803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928006f660 0x7f928011ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f92859df700 1 -- 172.21.15.72:0/525388803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c009550 con 0x7f92801305f0 2023-10-03T10:14:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f92851de700 1 --2- 172.21.15.72:0/525388803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928006f660 0x7f928011ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f92849dd700 1 --2- 172.21.15.72:0/525388803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928006ff90 0x7f928011bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f92859df700 1 --2- 172.21.15.72:0/525388803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92801305f0 0x7f928011c4a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f927800cc80 tx=0x7f927800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.874+0000 7f9275ffb700 1 -- 172.21.15.72:0/525388803 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278003c00 con 0x7f92801305f0 2023-10-03T10:14:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.875+0000 7f9275ffb700 1 -- 172.21.15.72:0/525388803 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9278003d60 con 0x7f92801305f0 2023-10-03T10:14:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.875+0000 7f9287442700 1 -- 172.21.15.72:0/525388803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927000b740 con 0x7f92801305f0 2023-10-03T10:14:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.875+0000 7f9275ffb700 1 -- 172.21.15.72:0/525388803 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927800aaa0 con 0x7f92801305f0 2023-10-03T10:14:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.875+0000 7f9287442700 1 -- 172.21.15.72:0/525388803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9280071820 con 0x7f92801305f0 2023-10-03T10:14:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.876+0000 7f9287442700 1 -- 172.21.15.72:0/525388803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9280066a10 con 0x7f92801305f0 2023-10-03T10:14:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.876+0000 7f9275ffb700 1 -- 172.21.15.72:0/525388803 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f927800ac00 con 0x7f92801305f0 2023-10-03T10:14:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.876+0000 7f9275ffb700 1 -- 172.21.15.72:0/525388803 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f927803f660 con 0x7f92801305f0 2023-10-03T10:14:02.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.881+0000 7f9275ffb700 1 -- 172.21.15.72:0/525388803 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92780198f0 con 0x7f92801305f0 2023-10-03T10:14:02.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.983+0000 7f4928555700 1 Processor -- start 2023-10-03T10:14:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.983+0000 7f4928555700 1 -- start start 2023-10-03T10:14:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4928555700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f49201338a0 0x7f4920133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4928555700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492009de50 0x7f492009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4928555700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492009e760 0x7f492013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4928555700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492006fef0 con 0x7f49201338a0 2023-10-03T10:14:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4928555700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492006ef30 con 0x7f492009de50 2023-10-03T10:14:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4928555700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49201334b0 con 0x7f492009e760 2023-10-03T10:14:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4926af2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492009e760 0x7f492013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4925af0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492009de50 0x7f492009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4926af2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492009e760 0x7f492013a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50738/0 (socket says 172.21.15.72:50738) 2023-10-03T10:14:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4926af2700 1 -- 172.21.15.72:0/528906166 learned_addr learned my addr 172.21.15.72:0/528906166 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f49262f1700 1 --2- 172.21.15.72:0/528906166 >> v2:172.21.15.72:3300/0 conn(0x7f49201338a0 0x7f4920133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4925af0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492009de50 0x7f492009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43786/0 (socket says 172.21.15.72:43786) 2023-10-03T10:14:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4926af2700 1 -- 172.21.15.72:0/528906166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492009de50 msgr2=0x7f492009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4926af2700 1 --2- 172.21.15.72:0/528906166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492009de50 0x7f492009e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4926af2700 1 -- 172.21.15.72:0/528906166 >> v2:172.21.15.72:3300/0 conn(0x7f49201338a0 msgr2=0x7f4920133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4926af2700 1 --2- 172.21.15.72:0/528906166 >> v2:172.21.15.72:3300/0 conn(0x7f49201338a0 0x7f4920133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4926af2700 1 -- 172.21.15.72:0/528906166 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492006fc30 con 0x7f492009e760 2023-10-03T10:14:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4925af0700 1 --2- 172.21.15.72:0/528906166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492009de50 0x7f492009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f49262f1700 1 --2- 172.21.15.72:0/528906166 >> v2:172.21.15.72:3300/0 conn(0x7f49201338a0 0x7f4920133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.984+0000 7f4926af2700 1 --2- 172.21.15.72:0/528906166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492009e760 0x7f492013a730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4918009e50 tx=0x7f491800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bb7a79cdddd1ea6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.985+0000 7f49252ef700 1 -- 172.21.15.72:0/528906166 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491800e070 con 0x7f492009e760 2023-10-03T10:14:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.985+0000 7f49252ef700 1 -- 172.21.15.72:0/528906166 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491800b910 con 0x7f492009e760 2023-10-03T10:14:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.985+0000 7f49252ef700 1 -- 172.21.15.72:0/528906166 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491800bcc0 con 0x7f492009e760 2023-10-03T10:14:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.985+0000 7f4928555700 1 -- 172.21.15.72:0/528906166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492009e760 msgr2=0x7f492013a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.985+0000 7f4928555700 1 --2- 172.21.15.72:0/528906166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492009e760 0x7f492013a730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4918009e50 tx=0x7f491800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.985+0000 7f4928555700 1 -- 172.21.15.72:0/528906166 shutdown_connections 2023-10-03T10:14:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.985+0000 7f4928555700 1 --2- 172.21.15.72:0/528906166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492009e760 0x7f492013a730 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.985+0000 7f4928555700 1 --2- 172.21.15.72:0/528906166 >> v2:172.21.15.72:3300/0 conn(0x7f49201338a0 0x7f4920133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.985+0000 7f4928555700 1 --2- 172.21.15.72:0/528906166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492009de50 0x7f492009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.985+0000 7f4928555700 1 -- 172.21.15.72:0/528906166 >> 172.21.15.72:0/528906166 conn(0x7f49200a2aa0 msgr2=0x7f49200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.985+0000 7f4928555700 1 -- 172.21.15.72:0/528906166 shutdown_connections 2023-10-03T10:14:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.985+0000 7f4928555700 1 -- 172.21.15.72:0/528906166 wait complete. 2023-10-03T10:14:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.986+0000 7f4928555700 1 Processor -- start 2023-10-03T10:14:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.986+0000 7f4928555700 1 -- start start 2023-10-03T10:14:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4928555700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492009de50 0x7f492011d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4928555700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492009e760 0x7f492011de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4928555700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49201338a0 0x7f492011e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4928555700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492011f990 con 0x7f49201338a0 2023-10-03T10:14:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4928555700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4920130b40 con 0x7f492009e760 2023-10-03T10:14:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4928555700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f492006f640 con 0x7f492009de50 2023-10-03T10:14:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4925af0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492009e760 0x7f492011de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4925af0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492009e760 0x7f492011de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43788/0 (socket says 172.21.15.72:43788) 2023-10-03T10:14:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4925af0700 1 -- 172.21.15.72:0/1532183971 learned_addr learned my addr 172.21.15.72:0/1532183971 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f49262f1700 1 --2- 172.21.15.72:0/1532183971 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492009de50 0x7f492011d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4926af2700 1 --2- 172.21.15.72:0/1532183971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49201338a0 0x7f492011e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4925af0700 1 -- 172.21.15.72:0/1532183971 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492009de50 msgr2=0x7f492011d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4925af0700 1 --2- 172.21.15.72:0/1532183971 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492009de50 0x7f492011d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4925af0700 1 -- 172.21.15.72:0/1532183971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49201338a0 msgr2=0x7f492011e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4925af0700 1 --2- 172.21.15.72:0/1532183971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49201338a0 0x7f492011e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4925af0700 1 -- 172.21.15.72:0/1532183971 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49100094a0 con 0x7f492009e760 2023-10-03T10:14:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f49262f1700 1 --2- 172.21.15.72:0/1532183971 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492009de50 0x7f492011d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.987+0000 7f4926af2700 1 --2- 172.21.15.72:0/1532183971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49201338a0 0x7f492011e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.988+0000 7f4925af0700 1 --2- 172.21.15.72:0/1532183971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492009e760 0x7f492011de40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f491000ec10 tx=0x7f491000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.988+0000 7f4916ffd700 1 -- 172.21.15.72:0/1532183971 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491000c850 con 0x7f492009e760 2023-10-03T10:14:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.988+0000 7f4916ffd700 1 -- 172.21.15.72:0/1532183971 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491000c9b0 con 0x7f492009e760 2023-10-03T10:14:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.988+0000 7f4916ffd700 1 -- 172.21.15.72:0/1532183971 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491000cd40 con 0x7f492009e760 2023-10-03T10:14:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.988+0000 7f4928555700 1 -- 172.21.15.72:0/1532183971 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c0094a0 con 0x7f492009e760 2023-10-03T10:14:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.988+0000 7f4928555700 1 -- 172.21.15.72:0/1532183971 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4918009b30 con 0x7f492009e760 2023-10-03T10:14:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.989+0000 7f4916ffd700 1 -- 172.21.15.72:0/1532183971 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4910013470 con 0x7f492009e760 2023-10-03T10:14:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.989+0000 7f4928555700 1 -- 172.21.15.72:0/1532183971 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4920120610 con 0x7f492009e760 2023-10-03T10:14:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.989+0000 7f4916ffd700 1 -- 172.21.15.72:0/1532183971 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f491003fa70 con 0x7f492009e760 2023-10-03T10:14:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:02.998+0000 7f4916ffd700 1 -- 172.21.15.72:0/1532183971 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4910041e60 con 0x7f492009e760 2023-10-03T10:14:03.020 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:03.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.084+0000 7f9287442700 1 -- 172.21.15.72:0/525388803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9280074ea0 con 0x7f92801305f0 2023-10-03T10:14:03.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.085+0000 7f9275ffb700 1 -- 172.21.15.72:0/525388803 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9278019300 con 0x7f92801305f0 2023-10-03T10:14:03.085 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.087+0000 7f9287442700 1 -- 172.21.15.72:0/525388803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92801305f0 msgr2=0x7f928011c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.087+0000 7f9287442700 1 --2- 172.21.15.72:0/525388803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92801305f0 0x7f928011c4a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f927800cc80 tx=0x7f927800cf90 comp rx=0 tx=0).stop 2023-10-03T10:14:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.087+0000 7f9287442700 1 -- 172.21.15.72:0/525388803 shutdown_connections 2023-10-03T10:14:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.087+0000 7f9287442700 1 --2- 172.21.15.72:0/525388803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92801305f0 0x7f928011c4a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.087+0000 7f9287442700 1 --2- 172.21.15.72:0/525388803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928006f660 0x7f928011ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.087+0000 7f9287442700 1 --2- 172.21.15.72:0/525388803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928006ff90 0x7f928011bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.087+0000 7f9287442700 1 -- 172.21.15.72:0/525388803 >> 172.21.15.72:0/525388803 conn(0x7f92800a2aa0 msgr2=0x7f928009f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.087+0000 7f9287442700 1 -- 172.21.15.72:0/525388803 shutdown_connections 2023-10-03T10:14:03.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.087+0000 7f9287442700 1 -- 172.21.15.72:0/525388803 wait complete. 2023-10-03T10:14:03.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:03.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.117+0000 7f2e6e75c700 1 Processor -- start 2023-10-03T10:14:03.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.117+0000 7f2e6e75c700 1 -- start start 2023-10-03T10:14:03.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.118+0000 7f2e6e75c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e68136820 0x7f2e68138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.118+0000 7f2e6e75c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e68139140 0x7f2e6813b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.118+0000 7f2e6e75c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6806bc00 con 0x7f2e68133a80 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.118+0000 7f2e6e75c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6806c570 con 0x7f2e68136820 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.118+0000 7f2e6e75c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e680a0040 con 0x7f2e68139140 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.118+0000 7f2e677fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e68136820 0x7f2e68138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.118+0000 7f2e6ccf9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e68139140 0x7f2e6813b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.118+0000 7f2e677fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e68136820 0x7f2e68138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59184/0 (socket says 172.21.15.72:59184) 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.118+0000 7f2e677fe700 1 -- 172.21.15.72:0/1417126942 learned_addr learned my addr 172.21.15.72:0/1417126942 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.118+0000 7f2e6ccf9700 1 -- 172.21.15.72:0/1417126942 >> v2:172.21.15.72:3300/0 conn(0x7f2e68136820 msgr2=0x7f2e68138c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.118+0000 7f2e6ccf9700 1 --2- 172.21.15.72:0/1417126942 >> v2:172.21.15.72:3300/0 conn(0x7f2e68136820 0x7f2e68138c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.118+0000 7f2e6ccf9700 1 -- 172.21.15.72:0/1417126942 >> v1:172.21.15.72:6789/0 conn(0x7f2e68133a80 legacy=0x7f2e68133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.118+0000 7f2e6ccf9700 1 -- 172.21.15.72:0/1417126942 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e68133860 con 0x7f2e68139140 2023-10-03T10:14:03.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.118+0000 7f2e677fe700 1 --2- 172.21.15.72:0/1417126942 >> v2:172.21.15.72:3300/0 conn(0x7f2e68136820 0x7f2e68138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.118+0000 7f2e6ccf9700 1 --2- 172.21.15.72:0/1417126942 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e68139140 0x7f2e6813b520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009d90 tx=0x7f2e6000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2610ab93089e7bd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.119+0000 7f2e66ffd700 1 -- 172.21.15.72:0/1417126942 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000e070 con 0x7f2e68139140 2023-10-03T10:14:03.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.119+0000 7f2e66ffd700 1 -- 172.21.15.72:0/1417126942 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6000bb20 con 0x7f2e68139140 2023-10-03T10:14:03.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.119+0000 7f2e66ffd700 1 -- 172.21.15.72:0/1417126942 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60012430 con 0x7f2e68139140 2023-10-03T10:14:03.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.119+0000 7f2e6e75c700 1 -- 172.21.15.72:0/1417126942 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e68139140 msgr2=0x7f2e6813b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.119+0000 7f2e6e75c700 1 --2- 172.21.15.72:0/1417126942 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e68139140 0x7f2e6813b520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009d90 tx=0x7f2e6000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.119+0000 7f2e6e75c700 1 -- 172.21.15.72:0/1417126942 shutdown_connections 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.119+0000 7f2e6e75c700 1 --2- 172.21.15.72:0/1417126942 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e68139140 0x7f2e6813b520 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.119+0000 7f2e6e75c700 1 --2- 172.21.15.72:0/1417126942 >> v2:172.21.15.72:3300/0 conn(0x7f2e68136820 0x7f2e68138c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.119+0000 7f2e6e75c700 1 -- 172.21.15.72:0/1417126942 >> 172.21.15.72:0/1417126942 conn(0x7f2e680a4210 msgr2=0x7f2e680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.120+0000 7f2e6e75c700 1 -- 172.21.15.72:0/1417126942 shutdown_connections 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.120+0000 7f2e6e75c700 1 -- 172.21.15.72:0/1417126942 wait complete. 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.121+0000 7f2e6e75c700 1 Processor -- start 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.121+0000 7f2e6e75c700 1 -- start start 2023-10-03T10:14:03.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e6e75c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e68133a80 0x7f2e6809b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e6e75c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e68136820 0x7f2e6809b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e6e75c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e68139140 0x7f2e6809beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e6e75c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6812e150 con 0x7f2e68136820 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e6e75c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e68136610 con 0x7f2e68139140 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e6e75c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6809dcd0 con 0x7f2e68133a80 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e677fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e68136820 0x7f2e6809b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e67fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e68133a80 0x7f2e6809b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e6ccf9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e68139140 0x7f2e6809beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e67fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e68133a80 0x7f2e6809b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50762/0 (socket says 172.21.15.72:50762) 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e677fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e68136820 0x7f2e6809b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59188/0 (socket says 172.21.15.72:59188) 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e67fff700 1 -- 172.21.15.72:0/3629669990 learned_addr learned my addr 172.21.15.72:0/3629669990 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:03.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e67fff700 1 -- 172.21.15.72:0/3629669990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e68139140 msgr2=0x7f2e6809beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e67fff700 1 --2- 172.21.15.72:0/3629669990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e68139140 0x7f2e6809beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e67fff700 1 -- 172.21.15.72:0/3629669990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e68136820 msgr2=0x7f2e6809b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e67fff700 1 --2- 172.21.15.72:0/3629669990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e68136820 0x7f2e6809b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e67fff700 1 -- 172.21.15.72:0/3629669990 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c009550 con 0x7f2e68133a80 2023-10-03T10:14:03.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e6ccf9700 1 --2- 172.21.15.72:0/3629669990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e68139140 0x7f2e6809beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.122+0000 7f2e677fe700 1 --2- 172.21.15.72:0/3629669990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e68136820 0x7f2e6809b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.123+0000 7f2e67fff700 1 --2- 172.21.15.72:0/3629669990 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e68133a80 0x7f2e6809b430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800c4e0 tx=0x7f2e5800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.123+0000 7f2e64ff9700 1 -- 172.21.15.72:0/3629669990 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580052d0 con 0x7f2e68133a80 2023-10-03T10:14:03.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.123+0000 7f2e64ff9700 1 -- 172.21.15.72:0/3629669990 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e58005430 con 0x7f2e68133a80 2023-10-03T10:14:03.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.123+0000 7f2e6e75c700 1 -- 172.21.15.72:0/3629669990 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e60009a70 con 0x7f2e68133a80 2023-10-03T10:14:03.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.123+0000 7f2e64ff9700 1 -- 172.21.15.72:0/3629669990 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580038c0 con 0x7f2e68133a80 2023-10-03T10:14:03.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.123+0000 7f2e6e75c700 1 -- 172.21.15.72:0/3629669990 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6812e380 con 0x7f2e68133a80 2023-10-03T10:14:03.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.123+0000 7f2e64ff9700 1 -- 172.21.15.72:0/3629669990 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e58003a20 con 0x7f2e68133a80 2023-10-03T10:14:03.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.124+0000 7f2e64ff9700 1 -- 172.21.15.72:0/3629669990 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2e5803ea70 con 0x7f2e68133a80 2023-10-03T10:14:03.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.124+0000 7f2e6e75c700 1 -- 172.21.15.72:0/3629669990 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6809c440 con 0x7f2e68133a80 2023-10-03T10:14:03.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.133+0000 7f2e64ff9700 1 -- 172.21.15.72:0/3629669990 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e58018260 con 0x7f2e68133a80 2023-10-03T10:14:03.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.162+0000 7f0db776b700 1 Processor -- start 2023-10-03T10:14:03.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.162+0000 7f0db776b700 1 -- start start 2023-10-03T10:14:03.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.163+0000 7f0db776b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0db01316c0 0x7f0db0131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.163+0000 7f0db776b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0db009d9f0 0x7f0db006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.163+0000 7f0db776b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db009e130 con 0x7f0db006acb0 2023-10-03T10:14:03.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.163+0000 7f0db776b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db01312b0 con 0x7f0db009d9f0 2023-10-03T10:14:03.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.163+0000 7f0db776b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0db009f6e0 con 0x7f0db01316c0 2023-10-03T10:14:03.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.163+0000 7f0db5507700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0db01316c0 0x7f0db0131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.163+0000 7f0db5507700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0db01316c0 0x7f0db0131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50772/0 (socket says 172.21.15.72:50772) 2023-10-03T10:14:03.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.163+0000 7f0db5507700 1 -- 172.21.15.72:0/3413064299 learned_addr learned my addr 172.21.15.72:0/3413064299 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:03.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.163+0000 7f0db4d06700 1 --2- 172.21.15.72:0/3413064299 >> v2:172.21.15.72:3300/0 conn(0x7f0db009d9f0 0x7f0db006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.163+0000 7f0db4d06700 1 -- 172.21.15.72:0/3413064299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0db01316c0 msgr2=0x7f0db0131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.163+0000 7f0db4d06700 1 --2- 172.21.15.72:0/3413064299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0db01316c0 0x7f0db0131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.163+0000 7f0db4d06700 1 -- 172.21.15.72:0/3413064299 >> v1:172.21.15.72:6789/0 conn(0x7f0db006acb0 legacy=0x7f0db0138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.163+0000 7f0da7fff700 1 -- 172.21.15.72:0/3413064299 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213066246 0 0) 0x7f0da8001490 con 0x7f0db006acb0 2023-10-03T10:14:03.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.163+0000 7f0db4d06700 1 -- 172.21.15.72:0/3413064299 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db009e760 con 0x7f0db009d9f0 2023-10-03T10:14:03.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.163+0000 7f0db5507700 1 --2- 172.21.15.72:0/3413064299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0db01316c0 0x7f0db0131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.164+0000 7f0db4d06700 1 --2- 172.21.15.72:0/3413064299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0db009d9f0 0x7f0db006a770 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0da0009840 tx=0x7f0da0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4501e12368c14a7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.164+0000 7f0da7fff700 1 -- 172.21.15.72:0/3413064299 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0011830 con 0x7f0db009d9f0 2023-10-03T10:14:03.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.164+0000 7f0da7fff700 1 -- 172.21.15.72:0/3413064299 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da0011990 con 0x7f0db009d9f0 2023-10-03T10:14:03.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.164+0000 7f0da7fff700 1 -- 172.21.15.72:0/3413064299 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0011d20 con 0x7f0db009d9f0 2023-10-03T10:14:03.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.164+0000 7f0db776b700 1 -- 172.21.15.72:0/3413064299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0db009d9f0 msgr2=0x7f0db006a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.164+0000 7f0db776b700 1 --2- 172.21.15.72:0/3413064299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0db009d9f0 0x7f0db006a770 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0da0009840 tx=0x7f0da0009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.164+0000 7f0db776b700 1 -- 172.21.15.72:0/3413064299 shutdown_connections 2023-10-03T10:14:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.164+0000 7f0db776b700 1 --2- 172.21.15.72:0/3413064299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0db01316c0 0x7f0db0131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.164+0000 7f0db776b700 1 --2- 172.21.15.72:0/3413064299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0db009d9f0 0x7f0db006a770 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.164+0000 7f0db776b700 1 -- 172.21.15.72:0/3413064299 >> 172.21.15.72:0/3413064299 conn(0x7f0db0066f50 msgr2=0x7f0db009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.165+0000 7f0db776b700 1 -- 172.21.15.72:0/3413064299 shutdown_connections 2023-10-03T10:14:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.165+0000 7f0db776b700 1 -- 172.21.15.72:0/3413064299 wait complete. 2023-10-03T10:14:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.166+0000 7f0db776b700 1 Processor -- start 2023-10-03T10:14:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.166+0000 7f0db776b700 1 -- start start 2023-10-03T10:14:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db776b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0db006acb0 0x7f0db0070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db776b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0db009d9f0 0x7f0db0070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db776b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0db01316c0 0x7f0db00713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db776b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db011a800 con 0x7f0db006acb0 2023-10-03T10:14:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db776b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db00a36d0 con 0x7f0db009d9f0 2023-10-03T10:14:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db776b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0db0119680 con 0x7f0db01316c0 2023-10-03T10:14:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db5507700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0db006acb0 0x7f0db0070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db5507700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0db006acb0 0x7f0db0070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59204/0 (socket says 172.21.15.72:59204) 2023-10-03T10:14:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db5507700 1 -- 172.21.15.72:0/2257959361 learned_addr learned my addr 172.21.15.72:0/2257959361 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db5d08700 1 --2- 172.21.15.72:0/2257959361 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0db01316c0 0x7f0db00713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db5507700 1 -- 172.21.15.72:0/2257959361 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0db01316c0 msgr2=0x7f0db00713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db5507700 1 --2- 172.21.15.72:0/2257959361 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0db01316c0 0x7f0db00713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db5507700 1 -- 172.21.15.72:0/2257959361 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0db009d9f0 msgr2=0x7f0db0070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db5507700 1 --2- 172.21.15.72:0/2257959361 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0db009d9f0 0x7f0db0070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db5507700 1 -- 172.21.15.72:0/2257959361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac009550 con 0x7f0db006acb0 2023-10-03T10:14:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db5507700 1 --2- 172.21.15.72:0/2257959361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0db006acb0 0x7f0db0070960 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00ec10 tx=0x7f0dac00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0da5ffb700 1 -- 172.21.15.72:0/2257959361 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac00c850 con 0x7f0db006acb0 2023-10-03T10:14:03.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0da5ffb700 1 -- 172.21.15.72:0/2257959361 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac00c9b0 con 0x7f0db006acb0 2023-10-03T10:14:03.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0db776b700 1 -- 172.21.15.72:0/2257959361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da00094a0 con 0x7f0db006acb0 2023-10-03T10:14:03.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.167+0000 7f0da5ffb700 1 -- 172.21.15.72:0/2257959361 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac00cd20 con 0x7f0db006acb0 2023-10-03T10:14:03.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.168+0000 7f0db776b700 1 -- 172.21.15.72:0/2257959361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db0119be0 con 0x7f0db006acb0 2023-10-03T10:14:03.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.169+0000 7f0da5ffb700 1 -- 172.21.15.72:0/2257959361 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0dac013470 con 0x7f0db006acb0 2023-10-03T10:14:03.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.169+0000 7f0db776b700 1 -- 172.21.15.72:0/2257959361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db0074ea0 con 0x7f0db006acb0 2023-10-03T10:14:03.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.169+0000 7f0da5ffb700 1 -- 172.21.15.72:0/2257959361 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0dac03fc00 con 0x7f0db006acb0 2023-10-03T10:14:03.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.173+0000 7f0da5ffb700 1 -- 172.21.15.72:0/2257959361 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0dac013720 con 0x7f0db006acb0 2023-10-03T10:14:03.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.205+0000 7f4928555700 1 -- 172.21.15.72:0/1532183971 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4920074ea0 con 0x7f492009e760 2023-10-03T10:14:03.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.205+0000 7f4916ffd700 1 -- 172.21.15.72:0/1532183971 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4910021030 con 0x7f492009e760 2023-10-03T10:14:03.205 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:03.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.207+0000 7f4928555700 1 -- 172.21.15.72:0/1532183971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492009e760 msgr2=0x7f492011de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.207+0000 7f4928555700 1 --2- 172.21.15.72:0/1532183971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492009e760 0x7f492011de40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f491000ec10 tx=0x7f491000ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:03.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.207+0000 7f4928555700 1 -- 172.21.15.72:0/1532183971 shutdown_connections 2023-10-03T10:14:03.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.207+0000 7f4928555700 1 --2- 172.21.15.72:0/1532183971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49201338a0 0x7f492011e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.207+0000 7f4928555700 1 --2- 172.21.15.72:0/1532183971 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492009de50 0x7f492011d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.207+0000 7f4928555700 1 --2- 172.21.15.72:0/1532183971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492009e760 0x7f492011de40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.207+0000 7f4928555700 1 -- 172.21.15.72:0/1532183971 >> 172.21.15.72:0/1532183971 conn(0x7f49200a2aa0 msgr2=0x7f49201b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.207+0000 7f4928555700 1 -- 172.21.15.72:0/1532183971 shutdown_connections 2023-10-03T10:14:03.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.207+0000 7f4928555700 1 -- 172.21.15.72:0/1532183971 wait complete. 2023-10-03T10:14:03.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:03.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.333+0000 7f2e6e75c700 1 -- 172.21.15.72:0/3629669990 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e68074ea0 con 0x7f2e68133a80 2023-10-03T10:14:03.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.333+0000 7f2e64ff9700 1 -- 172.21.15.72:0/3629669990 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e58017020 con 0x7f2e68133a80 2023-10-03T10:14:03.333 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:03.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.335+0000 7f2e6e75c700 1 -- 172.21.15.72:0/3629669990 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e68133a80 msgr2=0x7f2e6809b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.335+0000 7f2e6e75c700 1 --2- 172.21.15.72:0/3629669990 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e68133a80 0x7f2e6809b430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800c4e0 tx=0x7f2e5800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.335+0000 7f2e6e75c700 1 -- 172.21.15.72:0/3629669990 shutdown_connections 2023-10-03T10:14:03.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.335+0000 7f2e6e75c700 1 --2- 172.21.15.72:0/3629669990 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e68139140 0x7f2e6809beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.335+0000 7f2e6e75c700 1 --2- 172.21.15.72:0/3629669990 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e68133a80 0x7f2e6809b430 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.335+0000 7f2e6e75c700 1 --2- 172.21.15.72:0/3629669990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e68136820 0x7f2e6809b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.335+0000 7f2e6e75c700 1 -- 172.21.15.72:0/3629669990 >> 172.21.15.72:0/3629669990 conn(0x7f2e680a4210 msgr2=0x7f2e68134600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.335+0000 7f2e6e75c700 1 -- 172.21.15.72:0/3629669990 shutdown_connections 2023-10-03T10:14:03.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.335+0000 7f2e6e75c700 1 -- 172.21.15.72:0/3629669990 wait complete. 2023-10-03T10:14:03.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:03.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.368+0000 7f0db776b700 1 -- 172.21.15.72:0/2257959361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0db011a9e0 con 0x7f0db006acb0 2023-10-03T10:14:03.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.368+0000 7f0da5ffb700 1 -- 172.21.15.72:0/2257959361 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0dac021030 con 0x7f0db006acb0 2023-10-03T10:14:03.368 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.370+0000 7f0db776b700 1 -- 172.21.15.72:0/2257959361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0db006acb0 msgr2=0x7f0db0070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.370+0000 7f0db776b700 1 --2- 172.21.15.72:0/2257959361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0db006acb0 0x7f0db0070960 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00ec10 tx=0x7f0dac00ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:03.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.370+0000 7f0db776b700 1 -- 172.21.15.72:0/2257959361 shutdown_connections 2023-10-03T10:14:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.370+0000 7f0db776b700 1 --2- 172.21.15.72:0/2257959361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0db006acb0 0x7f0db0070960 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.370+0000 7f0db776b700 1 --2- 172.21.15.72:0/2257959361 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0db01316c0 0x7f0db00713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.370+0000 7f0db776b700 1 --2- 172.21.15.72:0/2257959361 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0db009d9f0 0x7f0db0070ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.370+0000 7f0db776b700 1 -- 172.21.15.72:0/2257959361 >> 172.21.15.72:0/2257959361 conn(0x7f0db0066f50 msgr2=0x7f0db00a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.370+0000 7f0db776b700 1 -- 172.21.15.72:0/2257959361 shutdown_connections 2023-10-03T10:14:03.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:03.370+0000 7f0db776b700 1 -- 172.21.15.72:0/2257959361 wait complete. 2023-10-03T10:14:03.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:04.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:04.220 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:04.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.224+0000 7f4309ae1700 1 Processor -- start 2023-10-03T10:14:04.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.224+0000 7f4309ae1700 1 -- start start 2023-10-03T10:14:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f4309ae1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4304131810 0x7f4304131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f4309ae1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4304099a40 0x7f4304099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f4309ae1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43041313c0 con 0x7f430409a3b0 2023-10-03T10:14:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f4309ae1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430409b580 con 0x7f4304131810 2023-10-03T10:14:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f4309ae1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f430406e8c0 con 0x7f4304099a40 2023-10-03T10:14:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f4302ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4304099a40 0x7f4304099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f43037fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4304131810 0x7f4304131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f4302ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4304099a40 0x7f4304099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50788/0 (socket says 172.21.15.72:50788) 2023-10-03T10:14:04.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f4302ffd700 1 -- 172.21.15.72:0/761084692 learned_addr learned my addr 172.21.15.72:0/761084692 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f4302ffd700 1 -- 172.21.15.72:0/761084692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4304131810 msgr2=0x7f4304131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f4302ffd700 1 --2- 172.21.15.72:0/761084692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4304131810 0x7f4304131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f4302ffd700 1 -- 172.21.15.72:0/761084692 >> v1:172.21.15.72:6789/0 conn(0x7f430409a3b0 legacy=0x7f4304138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f4302ffd700 1 -- 172.21.15.72:0/761084692 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430409a820 con 0x7f4304099a40 2023-10-03T10:14:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f43027fc700 1 -- 172.21.15.72:0/761084692 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765467760 0 0) 0x7f43041313c0 con 0x7f430409a3b0 2023-10-03T10:14:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f43037fe700 1 --2- 172.21.15.72:0/761084692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4304131810 0x7f4304131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.225+0000 7f4302ffd700 1 --2- 172.21.15.72:0/761084692 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4304099a40 0x7f4304099e70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009920 tx=0x7f42f8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=affae6aec294fd4a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.226+0000 7f43027fc700 1 -- 172.21.15.72:0/761084692 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8011830 con 0x7f4304099a40 2023-10-03T10:14:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.226+0000 7f43027fc700 1 -- 172.21.15.72:0/761084692 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f8011990 con 0x7f4304099a40 2023-10-03T10:14:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.226+0000 7f43027fc700 1 -- 172.21.15.72:0/761084692 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8011d20 con 0x7f4304099a40 2023-10-03T10:14:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.226+0000 7f4309ae1700 1 -- 172.21.15.72:0/761084692 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4304099a40 msgr2=0x7f4304099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.226+0000 7f4309ae1700 1 --2- 172.21.15.72:0/761084692 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4304099a40 0x7f4304099e70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009920 tx=0x7f42f8009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:04.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.226+0000 7f4309ae1700 1 -- 172.21.15.72:0/761084692 shutdown_connections 2023-10-03T10:14:04.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.226+0000 7f4309ae1700 1 --2- 172.21.15.72:0/761084692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4304131810 0x7f4304131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.226+0000 7f4309ae1700 1 --2- 172.21.15.72:0/761084692 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4304099a40 0x7f4304099e70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.226+0000 7f4309ae1700 1 -- 172.21.15.72:0/761084692 >> 172.21.15.72:0/761084692 conn(0x7f43040a2aa0 msgr2=0x7f43040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.226+0000 7f4309ae1700 1 -- 172.21.15.72:0/761084692 shutdown_connections 2023-10-03T10:14:04.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.226+0000 7f4309ae1700 1 -- 172.21.15.72:0/761084692 wait complete. 2023-10-03T10:14:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.227+0000 7f4309ae1700 1 Processor -- start 2023-10-03T10:14:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.227+0000 7f4309ae1700 1 -- start start 2023-10-03T10:14:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4309ae1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4304099a40 0x7f4304119720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4309ae1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430409a3b0 0x7f4304119c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4309ae1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4304131810 0x7f430411a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4309ae1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430411b330 con 0x7f430409a3b0 2023-10-03T10:14:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4309ae1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430411c580 con 0x7f4304099a40 2023-10-03T10:14:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4309ae1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f430411b910 con 0x7f4304131810 2023-10-03T10:14:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4302ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430409a3b0 0x7f4304119c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4302ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430409a3b0 0x7f4304119c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59216/0 (socket says 172.21.15.72:59216) 2023-10-03T10:14:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4302ffd700 1 -- 172.21.15.72:0/2866440482 learned_addr learned my addr 172.21.15.72:0/2866440482 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4303fff700 1 --2- 172.21.15.72:0/2866440482 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4304131810 0x7f430411a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f43037fe700 1 --2- 172.21.15.72:0/2866440482 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4304099a40 0x7f4304119720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4302ffd700 1 -- 172.21.15.72:0/2866440482 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4304131810 msgr2=0x7f430411a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4302ffd700 1 --2- 172.21.15.72:0/2866440482 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4304131810 0x7f430411a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4302ffd700 1 -- 172.21.15.72:0/2866440482 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4304099a40 msgr2=0x7f4304119720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4302ffd700 1 --2- 172.21.15.72:0/2866440482 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4304099a40 0x7f4304119720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4302ffd700 1 -- 172.21.15.72:0/2866440482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f400d940 con 0x7f430409a3b0 2023-10-03T10:14:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.228+0000 7f4302ffd700 1 --2- 172.21.15.72:0/2866440482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430409a3b0 0x7f4304119c60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f42f80098f0 tx=0x7f42f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.229+0000 7f42ebfff700 1 -- 172.21.15.72:0/2866440482 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8004450 con 0x7f430409a3b0 2023-10-03T10:14:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.229+0000 7f42ebfff700 1 -- 172.21.15.72:0/2866440482 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f80045b0 con 0x7f430409a3b0 2023-10-03T10:14:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.229+0000 7f42ebfff700 1 -- 172.21.15.72:0/2866440482 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f80038c0 con 0x7f430409a3b0 2023-10-03T10:14:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.229+0000 7f4309ae1700 1 -- 172.21.15.72:0/2866440482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f8009550 con 0x7f430409a3b0 2023-10-03T10:14:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.229+0000 7f4309ae1700 1 -- 172.21.15.72:0/2866440482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4304130870 con 0x7f430409a3b0 2023-10-03T10:14:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.229+0000 7f42ebfff700 1 -- 172.21.15.72:0/2866440482 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f42f8003a20 con 0x7f430409a3b0 2023-10-03T10:14:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.230+0000 7f42ebfff700 1 -- 172.21.15.72:0/2866440482 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f42f8021030 con 0x7f430409a3b0 2023-10-03T10:14:04.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.230+0000 7f4309ae1700 1 -- 172.21.15.72:0/2866440482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430406eb00 con 0x7f430409a3b0 2023-10-03T10:14:04.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.234+0000 7f42ebfff700 1 -- 172.21.15.72:0/2866440482 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42f801a430 con 0x7f430409a3b0 2023-10-03T10:14:04.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.346+0000 7fc310e6f700 1 Processor -- start 2023-10-03T10:14:04.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.346+0000 7fc310e6f700 1 -- start start 2023-10-03T10:14:04.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.346+0000 7fc310e6f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c09d6f0 0x7fc30c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.346+0000 7fc310e6f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c09e000 0x7fc30c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.346+0000 7fc310e6f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c09b120 con 0x7fc30c09e410 2023-10-03T10:14:04.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.346+0000 7fc310e6f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c06b460 con 0x7fc30c09d6f0 2023-10-03T10:14:04.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.346+0000 7fc310e6f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c09a7e0 con 0x7fc30c09e000 2023-10-03T10:14:04.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.347+0000 7fc30ad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc30c09e410 0x7fc30c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42344/0 (socket says 172.21.15.72:42344) 2023-10-03T10:14:04.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.347+0000 7fc309d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c09e000 0x7fc30c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.347+0000 7fc30ad9d700 1 -- 172.21.15.72:0/3366297987 learned_addr learned my addr 172.21.15.72:0/3366297987 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:04.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.347+0000 7fc30a59c700 1 --2- 172.21.15.72:0/3366297987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c09d6f0 0x7fc30c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.347+0000 7fc30959a700 1 -- 172.21.15.72:0/3366297987 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198842299 0 0) 0x7fc30c09b120 con 0x7fc30c09e410 2023-10-03T10:14:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.347+0000 7fc309d9b700 1 -- 172.21.15.72:0/3366297987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c09d6f0 msgr2=0x7fc30c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.347+0000 7fc309d9b700 1 --2- 172.21.15.72:0/3366297987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c09d6f0 0x7fc30c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.347+0000 7fc309d9b700 1 -- 172.21.15.72:0/3366297987 >> v1:172.21.15.72:6789/0 conn(0x7fc30c09e410 legacy=0x7fc30c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.347+0000 7fc309d9b700 1 -- 172.21.15.72:0/3366297987 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c09a500 con 0x7fc30c09e000 2023-10-03T10:14:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.347+0000 7fc30a59c700 1 --2- 172.21.15.72:0/3366297987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c09d6f0 0x7fc30c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.347+0000 7fc309d9b700 1 --2- 172.21.15.72:0/3366297987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c09e000 0x7fc30c1339f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc3000098a0 tx=0x7fc300009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbec842a5a03c855 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.347+0000 7fc30959a700 1 -- 172.21.15.72:0/3366297987 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc300011830 con 0x7fc30c09e000 2023-10-03T10:14:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.347+0000 7fc30959a700 1 -- 172.21.15.72:0/3366297987 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc300011990 con 0x7fc30c09e000 2023-10-03T10:14:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.347+0000 7fc30959a700 1 -- 172.21.15.72:0/3366297987 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc300011d40 con 0x7fc30c09e000 2023-10-03T10:14:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.348+0000 7fc310e6f700 1 -- 172.21.15.72:0/3366297987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c09e000 msgr2=0x7fc30c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.348+0000 7fc310e6f700 1 --2- 172.21.15.72:0/3366297987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c09e000 0x7fc30c1339f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc3000098a0 tx=0x7fc300009bb0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.348+0000 7fc310e6f700 1 -- 172.21.15.72:0/3366297987 shutdown_connections 2023-10-03T10:14:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.348+0000 7fc310e6f700 1 --2- 172.21.15.72:0/3366297987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c09d6f0 0x7fc30c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.348+0000 7fc310e6f700 1 --2- 172.21.15.72:0/3366297987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c09e000 0x7fc30c1339f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.348+0000 7fc310e6f700 1 -- 172.21.15.72:0/3366297987 >> 172.21.15.72:0/3366297987 conn(0x7fc30c066f50 msgr2=0x7fc30c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.348+0000 7fc310e6f700 1 -- 172.21.15.72:0/3366297987 shutdown_connections 2023-10-03T10:14:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.348+0000 7fc310e6f700 1 -- 172.21.15.72:0/3366297987 wait complete. 2023-10-03T10:14:04.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.349+0000 7fc310e6f700 1 Processor -- start 2023-10-03T10:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.349+0000 7fc310e6f700 1 -- start start 2023-10-03T10:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.349+0000 7fc310e6f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c09d6f0 0x7fc30c1a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.349+0000 7fc310e6f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c09e000 0x7fc30c1a5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.349+0000 7fc310e6f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30c09e410 0x7fc30c1c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.349+0000 7fc310e6f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c0a2e20 con 0x7fc30c09e410 2023-10-03T10:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.349+0000 7fc310e6f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c1a80c0 con 0x7fc30c09d6f0 2023-10-03T10:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.349+0000 7fc310e6f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c1a85e0 con 0x7fc30c09e000 2023-10-03T10:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.349+0000 7fc309d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c09e000 0x7fc30c1a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.349+0000 7fc309d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c09e000 0x7fc30c1a5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50802/0 (socket says 172.21.15.72:50802) 2023-10-03T10:14:04.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.349+0000 7fc309d9b700 1 -- 172.21.15.72:0/1583870002 learned_addr learned my addr 172.21.15.72:0/1583870002 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:04.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.350+0000 7fc30a59c700 1 --2- 172.21.15.72:0/1583870002 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c09d6f0 0x7fc30c1a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.350+0000 7fc30ad9d700 1 --2- 172.21.15.72:0/1583870002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30c09e410 0x7fc30c1c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.350+0000 7fc309d9b700 1 -- 172.21.15.72:0/1583870002 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c09d6f0 msgr2=0x7fc30c1a52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.350+0000 7fc309d9b700 1 --2- 172.21.15.72:0/1583870002 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c09d6f0 0x7fc30c1a52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.350+0000 7fc309d9b700 1 -- 172.21.15.72:0/1583870002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30c09e410 msgr2=0x7fc30c1c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.350+0000 7fc309d9b700 1 --2- 172.21.15.72:0/1583870002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30c09e410 0x7fc30c1c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.350+0000 7fc309d9b700 1 -- 172.21.15.72:0/1583870002 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3000094a0 con 0x7fc30c09e000 2023-10-03T10:14:04.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.350+0000 7fc309d9b700 1 --2- 172.21.15.72:0/1583870002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c09e000 0x7fc30c1a5820 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc300013000 tx=0x7fc300004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.350+0000 7fc2faffd700 1 -- 172.21.15.72:0/1583870002 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc300024620 con 0x7fc30c09e000 2023-10-03T10:14:04.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.350+0000 7fc2faffd700 1 -- 172.21.15.72:0/1583870002 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3000247a0 con 0x7fc30c09e000 2023-10-03T10:14:04.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.350+0000 7fc2faffd700 1 -- 172.21.15.72:0/1583870002 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc300024b50 con 0x7fc30c09e000 2023-10-03T10:14:04.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.350+0000 7fc310e6f700 1 -- 172.21.15.72:0/1583870002 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c1b9210 con 0x7fc30c09e000 2023-10-03T10:14:04.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.350+0000 7fc310e6f700 1 -- 172.21.15.72:0/1583870002 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30c1a4d90 con 0x7fc30c09e000 2023-10-03T10:14:04.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.351+0000 7fc310e6f700 1 -- 172.21.15.72:0/1583870002 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30c074ea0 con 0x7fc30c09e000 2023-10-03T10:14:04.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.351+0000 7fc2faffd700 1 -- 172.21.15.72:0/1583870002 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc300022070 con 0x7fc30c09e000 2023-10-03T10:14:04.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.352+0000 7fc2faffd700 1 -- 172.21.15.72:0/1583870002 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc300040e30 con 0x7fc30c09e000 2023-10-03T10:14:04.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.356+0000 7fc2faffd700 1 -- 172.21.15.72:0/1583870002 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc30002b760 con 0x7fc30c09e000 2023-10-03T10:14:04.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:04.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.441+0000 7f4309ae1700 1 -- 172.21.15.72:0/2866440482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f430411ce50 con 0x7f430409a3b0 2023-10-03T10:14:04.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.442+0000 7f42ebfff700 1 -- 172.21.15.72:0/2866440482 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f42f802b030 con 0x7f430409a3b0 2023-10-03T10:14:04.442 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.444+0000 7f4309ae1700 1 -- 172.21.15.72:0/2866440482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430409a3b0 msgr2=0x7f4304119c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.444+0000 7f4309ae1700 1 --2- 172.21.15.72:0/2866440482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430409a3b0 0x7f4304119c60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f42f80098f0 tx=0x7f42f8004750 comp rx=0 tx=0).stop 2023-10-03T10:14:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.444+0000 7f4309ae1700 1 -- 172.21.15.72:0/2866440482 shutdown_connections 2023-10-03T10:14:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.444+0000 7f4309ae1700 1 --2- 172.21.15.72:0/2866440482 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4304131810 0x7f430411a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.444+0000 7f4309ae1700 1 --2- 172.21.15.72:0/2866440482 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4304099a40 0x7f4304119720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.444+0000 7f4309ae1700 1 --2- 172.21.15.72:0/2866440482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f430409a3b0 0x7f4304119c60 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.444+0000 7f4309ae1700 1 -- 172.21.15.72:0/2866440482 >> 172.21.15.72:0/2866440482 conn(0x7f43040a2aa0 msgr2=0x7f430412e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.444+0000 7f4309ae1700 1 -- 172.21.15.72:0/2866440482 shutdown_connections 2023-10-03T10:14:04.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.444+0000 7f4309ae1700 1 -- 172.21.15.72:0/2866440482 wait complete. 2023-10-03T10:14:04.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:04.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.482+0000 7fea6e205700 1 Processor -- start 2023-10-03T10:14:04.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.482+0000 7fea6e205700 1 -- start start 2023-10-03T10:14:04.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.482+0000 7fea6e205700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea6809e930 0x7fea6809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.482+0000 7fea6e205700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea6809f240 0x7fea681317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.482+0000 7fea6e205700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea68070940 con 0x7fea6809f650 2023-10-03T10:14:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.482+0000 7fea6e205700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6806fd60 con 0x7fea6809f240 2023-10-03T10:14:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.482+0000 7fea6e205700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea6806fa80 con 0x7fea6809e930 2023-10-03T10:14:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.482+0000 7fea677fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea6809e930 0x7fea6809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.482+0000 7fea677fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea6809e930 0x7fea6809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50808/0 (socket says 172.21.15.72:50808) 2023-10-03T10:14:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.482+0000 7fea677fe700 1 -- 172.21.15.72:0/2812510009 learned_addr learned my addr 172.21.15.72:0/2812510009 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.482+0000 7fea66ffd700 1 --2- 172.21.15.72:0/2812510009 >> v2:172.21.15.72:3300/0 conn(0x7fea6809f240 0x7fea681317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.483+0000 7fea677fe700 1 -- 172.21.15.72:0/2812510009 >> v2:172.21.15.72:3300/0 conn(0x7fea6809f240 msgr2=0x7fea681317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.483+0000 7fea677fe700 1 --2- 172.21.15.72:0/2812510009 >> v2:172.21.15.72:3300/0 conn(0x7fea6809f240 0x7fea681317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.483+0000 7fea677fe700 1 -- 172.21.15.72:0/2812510009 >> v1:172.21.15.72:6789/0 conn(0x7fea6809f650 legacy=0x7fea68131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.483+0000 7fea667fc700 1 -- 172.21.15.72:0/2812510009 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640689855 0 0) 0x7fea68070940 con 0x7fea6809f650 2023-10-03T10:14:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.483+0000 7fea677fe700 1 -- 172.21.15.72:0/2812510009 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6809fb60 con 0x7fea6809e930 2023-10-03T10:14:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.483+0000 7fea677fe700 1 --2- 172.21.15.72:0/2812510009 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea6809e930 0x7fea6809ed00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea580098f0 tx=0x7fea58009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bee144be7372d75 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.483+0000 7fea667fc700 1 -- 172.21.15.72:0/2812510009 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5800b8a0 con 0x7fea6809e930 2023-10-03T10:14:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.483+0000 7fea667fc700 1 -- 172.21.15.72:0/2812510009 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5800ba00 con 0x7fea6809e930 2023-10-03T10:14:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.483+0000 7fea667fc700 1 -- 172.21.15.72:0/2812510009 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5800bd90 con 0x7fea6809e930 2023-10-03T10:14:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.484+0000 7fea6e205700 1 -- 172.21.15.72:0/2812510009 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea6809e930 msgr2=0x7fea6809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.484+0000 7fea6e205700 1 --2- 172.21.15.72:0/2812510009 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea6809e930 0x7fea6809ed00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea580098f0 tx=0x7fea58009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.484+0000 7fea6e205700 1 -- 172.21.15.72:0/2812510009 shutdown_connections 2023-10-03T10:14:04.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.484+0000 7fea6e205700 1 --2- 172.21.15.72:0/2812510009 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea6809e930 0x7fea6809ed00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.484+0000 7fea6e205700 1 --2- 172.21.15.72:0/2812510009 >> v2:172.21.15.72:3300/0 conn(0x7fea6809f240 0x7fea681317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.484+0000 7fea6e205700 1 -- 172.21.15.72:0/2812510009 >> 172.21.15.72:0/2812510009 conn(0x7fea680a4210 msgr2=0x7fea680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.484+0000 7fea6e205700 1 -- 172.21.15.72:0/2812510009 shutdown_connections 2023-10-03T10:14:04.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.484+0000 7fea6e205700 1 -- 172.21.15.72:0/2812510009 wait complete. 2023-10-03T10:14:04.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.485+0000 7fea6e205700 1 Processor -- start 2023-10-03T10:14:04.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.485+0000 7fea6e205700 1 -- start start 2023-10-03T10:14:04.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.485+0000 7fea6e205700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea6809e930 0x7fea6806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.485+0000 7fea6e205700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea6809f240 0x7fea6806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.485+0000 7fea6e205700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea6809f650 0x7fea6806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.485+0000 7fea6e205700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea681a87a0 con 0x7fea6809f240 2023-10-03T10:14:04.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.485+0000 7fea6e205700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea681a97e0 con 0x7fea6809e930 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.485+0000 7fea6e205700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea680a31d0 con 0x7fea6809f650 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.485+0000 7fea66ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea6809f240 0x7fea6806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.485+0000 7fea66ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea6809f240 0x7fea6806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59226/0 (socket says 172.21.15.72:59226) 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.485+0000 7fea66ffd700 1 -- 172.21.15.72:0/1035856411 learned_addr learned my addr 172.21.15.72:0/1035856411 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.485+0000 7fea67fff700 1 --2- 172.21.15.72:0/1035856411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea6809f650 0x7fea6806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.485+0000 7fea677fe700 1 --2- 172.21.15.72:0/1035856411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea6809e930 0x7fea6806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.486+0000 7fea67fff700 1 -- 172.21.15.72:0/1035856411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea6809e930 msgr2=0x7fea6806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.486+0000 7fea67fff700 1 --2- 172.21.15.72:0/1035856411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea6809e930 0x7fea6806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.486+0000 7fea67fff700 1 -- 172.21.15.72:0/1035856411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea6809f240 msgr2=0x7fea6806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.486+0000 7fea67fff700 1 --2- 172.21.15.72:0/1035856411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea6809f240 0x7fea6806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.486+0000 7fea67fff700 1 -- 172.21.15.72:0/1035856411 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea58009550 con 0x7fea6809f650 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.486+0000 7fea66ffd700 1 --2- 172.21.15.72:0/1035856411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea6809f240 0x7fea6806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.486+0000 7fea67fff700 1 --2- 172.21.15.72:0/1035856411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea6809f650 0x7fea6806c330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fea6000c7c0 tx=0x7fea6000cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.486+0000 7fea4ffff700 1 -- 172.21.15.72:0/1035856411 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea60003e30 con 0x7fea6809f650 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.486+0000 7fea4ffff700 1 -- 172.21.15.72:0/1035856411 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea60005070 con 0x7fea6809f650 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.486+0000 7fea4ffff700 1 -- 172.21.15.72:0/1035856411 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea60005420 con 0x7fea6809f650 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.486+0000 7fea6e205700 1 -- 172.21.15.72:0/1035856411 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea680a0190 con 0x7fea6809f650 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.486+0000 7fea6e205700 1 -- 172.21.15.72:0/1035856411 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea681a9240 con 0x7fea6809f650 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.487+0000 7fea4ffff700 1 -- 172.21.15.72:0/1035856411 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea60005580 con 0x7fea6809f650 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.487+0000 7fea4ffff700 1 -- 172.21.15.72:0/1035856411 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fea6003ec60 con 0x7fea6809f650 2023-10-03T10:14:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.488+0000 7fea6e205700 1 -- 172.21.15.72:0/1035856411 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea68074ea0 con 0x7fea6809f650 2023-10-03T10:14:04.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.492+0000 7fea4ffff700 1 -- 172.21.15.72:0/1035856411 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea60017070 con 0x7fea6809f650 2023-10-03T10:14:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.526+0000 7fd15280b700 1 Processor -- start 2023-10-03T10:14:04.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.526+0000 7fd15280b700 1 -- start start 2023-10-03T10:14:04.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.527+0000 7fd15280b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd14c1337f0 0x7fd14c138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.527+0000 7fd15280b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c138dc0 0x7fd14c13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.527+0000 7fd15280b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd14c06b990 con 0x7fd14c133420 2023-10-03T10:14:04.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.527+0000 7fd15280b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14c09b0e0 con 0x7fd14c1337f0 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.527+0000 7fd15280b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c133c20 con 0x7fd14c138dc0 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.527+0000 7fd14b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd14c1337f0 0x7fd14c138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.527+0000 7fd14b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd14c1337f0 0x7fd14c138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59228/0 (socket says 172.21.15.72:59228) 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.527+0000 7fd14b7fe700 1 -- 172.21.15.72:0/59974748 learned_addr learned my addr 172.21.15.72:0/59974748 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.527+0000 7fd150da8700 1 --2- 172.21.15.72:0/59974748 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c138dc0 0x7fd14c13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.527+0000 7fd150da8700 1 -- 172.21.15.72:0/59974748 >> v2:172.21.15.72:3300/0 conn(0x7fd14c1337f0 msgr2=0x7fd14c138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.527+0000 7fd150da8700 1 --2- 172.21.15.72:0/59974748 >> v2:172.21.15.72:3300/0 conn(0x7fd14c1337f0 0x7fd14c138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.527+0000 7fd150da8700 1 -- 172.21.15.72:0/59974748 >> v1:172.21.15.72:6789/0 conn(0x7fd14c133420 legacy=0x7fd14c133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.527+0000 7fd150da8700 1 -- 172.21.15.72:0/59974748 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c0a0590 con 0x7fd14c138dc0 2023-10-03T10:14:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.527+0000 7fd14affd700 1 -- 172.21.15.72:0/59974748 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509588991 0 0) 0x7fd14c06b990 con 0x7fd14c133420 2023-10-03T10:14:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.527+0000 7fd14b7fe700 1 --2- 172.21.15.72:0/59974748 >> v2:172.21.15.72:3300/0 conn(0x7fd14c1337f0 0x7fd14c138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.528+0000 7fd150da8700 1 --2- 172.21.15.72:0/59974748 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c138dc0 0x7fd14c13b1a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd144009d90 tx=0x7fd14400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=872cd5748432a760 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.528+0000 7fd14affd700 1 -- 172.21.15.72:0/59974748 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14400e070 con 0x7fd14c138dc0 2023-10-03T10:14:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.528+0000 7fd14affd700 1 -- 172.21.15.72:0/59974748 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14400bb20 con 0x7fd14c138dc0 2023-10-03T10:14:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.528+0000 7fd14affd700 1 -- 172.21.15.72:0/59974748 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144012430 con 0x7fd14c138dc0 2023-10-03T10:14:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.528+0000 7fd15280b700 1 -- 172.21.15.72:0/59974748 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c138dc0 msgr2=0x7fd14c13b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.528+0000 7fd15280b700 1 --2- 172.21.15.72:0/59974748 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c138dc0 0x7fd14c13b1a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd144009d90 tx=0x7fd14400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.528+0000 7fd15280b700 1 -- 172.21.15.72:0/59974748 shutdown_connections 2023-10-03T10:14:04.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.528+0000 7fd15280b700 1 --2- 172.21.15.72:0/59974748 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c138dc0 0x7fd14c13b1a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.528+0000 7fd15280b700 1 --2- 172.21.15.72:0/59974748 >> v2:172.21.15.72:3300/0 conn(0x7fd14c1337f0 0x7fd14c138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.528+0000 7fd15280b700 1 -- 172.21.15.72:0/59974748 >> 172.21.15.72:0/59974748 conn(0x7fd14c0a4210 msgr2=0x7fd14c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.528+0000 7fd15280b700 1 -- 172.21.15.72:0/59974748 shutdown_connections 2023-10-03T10:14:04.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.528+0000 7fd15280b700 1 -- 172.21.15.72:0/59974748 wait complete. 2023-10-03T10:14:04.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.529+0000 7fd15280b700 1 Processor -- start 2023-10-03T10:14:04.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd15280b700 1 -- start start 2023-10-03T10:14:04.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd15280b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c133420 0x7fd14c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd15280b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c1337f0 0x7fd14c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd15280b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c138dc0 0x7fd14c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd15280b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c12e840 con 0x7fd14c133420 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd15280b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c1388a0 con 0x7fd14c1337f0 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd15280b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c130cc0 con 0x7fd14c138dc0 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd150da8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c138dc0 0x7fd14c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd14bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c133420 0x7fd14c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd150da8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c138dc0 0x7fd14c09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50848/0 (socket says 172.21.15.72:50848) 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd14bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c133420 0x7fd14c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59232/0 (socket says 172.21.15.72:59232) 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd150da8700 1 -- 172.21.15.72:0/746700899 learned_addr learned my addr 172.21.15.72:0/746700899 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd14b7fe700 1 --2- 172.21.15.72:0/746700899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c1337f0 0x7fd14c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd14bfff700 1 -- 172.21.15.72:0/746700899 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c138dc0 msgr2=0x7fd14c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd14bfff700 1 --2- 172.21.15.72:0/746700899 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c138dc0 0x7fd14c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd14bfff700 1 -- 172.21.15.72:0/746700899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c1337f0 msgr2=0x7fd14c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd14bfff700 1 --2- 172.21.15.72:0/746700899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c1337f0 0x7fd14c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.530+0000 7fd14bfff700 1 -- 172.21.15.72:0/746700899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd140009550 con 0x7fd14c133420 2023-10-03T10:14:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.531+0000 7fd150da8700 1 --2- 172.21.15.72:0/746700899 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c138dc0 0x7fd14c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.531+0000 7fd14bfff700 1 --2- 172.21.15.72:0/746700899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c133420 0x7fd14c09c480 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00c430 tx=0x7fd13c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.531+0000 7fd148ff9700 1 -- 172.21.15.72:0/746700899 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c0054e0 con 0x7fd14c133420 2023-10-03T10:14:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.531+0000 7fd148ff9700 1 -- 172.21.15.72:0/746700899 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c00ce40 con 0x7fd14c133420 2023-10-03T10:14:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.531+0000 7fd15280b700 1 -- 172.21.15.72:0/746700899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd144009a70 con 0x7fd14c133420 2023-10-03T10:14:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.531+0000 7fd148ff9700 1 -- 172.21.15.72:0/746700899 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c0038c0 con 0x7fd14c133420 2023-10-03T10:14:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.531+0000 7fd15280b700 1 -- 172.21.15.72:0/746700899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14c12f0a0 con 0x7fd14c133420 2023-10-03T10:14:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.532+0000 7fd148ff9700 1 -- 172.21.15.72:0/746700899 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd13c003a20 con 0x7fd14c133420 2023-10-03T10:14:04.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.532+0000 7fd15280b700 1 -- 172.21.15.72:0/746700899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14c074ea0 con 0x7fd14c133420 2023-10-03T10:14:04.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.532+0000 7fd148ff9700 1 -- 172.21.15.72:0/746700899 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd13c03e9f0 con 0x7fd14c133420 2023-10-03T10:14:04.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.537+0000 7fd148ff9700 1 -- 172.21.15.72:0/746700899 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd13c019b20 con 0x7fd14c133420 2023-10-03T10:14:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.556+0000 7fc310e6f700 1 -- 172.21.15.72:0/1583870002 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc30c1a69e0 con 0x7fc30c09e000 2023-10-03T10:14:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.557+0000 7fc2faffd700 1 -- 172.21.15.72:0/1583870002 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc300015070 con 0x7fc30c09e000 2023-10-03T10:14:04.556 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:04.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.559+0000 7fc310e6f700 1 -- 172.21.15.72:0/1583870002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c09e000 msgr2=0x7fc30c1a5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.559+0000 7fc310e6f700 1 --2- 172.21.15.72:0/1583870002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c09e000 0x7fc30c1a5820 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc300013000 tx=0x7fc300004750 comp rx=0 tx=0).stop 2023-10-03T10:14:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.559+0000 7fc310e6f700 1 -- 172.21.15.72:0/1583870002 shutdown_connections 2023-10-03T10:14:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.559+0000 7fc310e6f700 1 --2- 172.21.15.72:0/1583870002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30c09e410 0x7fc30c1c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.559+0000 7fc310e6f700 1 --2- 172.21.15.72:0/1583870002 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c09d6f0 0x7fc30c1a52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.559+0000 7fc310e6f700 1 --2- 172.21.15.72:0/1583870002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c09e000 0x7fc30c1a5820 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.559+0000 7fc310e6f700 1 -- 172.21.15.72:0/1583870002 >> 172.21.15.72:0/1583870002 conn(0x7fc30c066f50 msgr2=0x7fc30c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.559+0000 7fc310e6f700 1 -- 172.21.15.72:0/1583870002 shutdown_connections 2023-10-03T10:14:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.559+0000 7fc310e6f700 1 -- 172.21.15.72:0/1583870002 wait complete. 2023-10-03T10:14:04.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:04.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.688+0000 7fea6e205700 1 -- 172.21.15.72:0/1035856411 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fea6806b250 con 0x7fea6809f650 2023-10-03T10:14:04.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.688+0000 7fea4ffff700 1 -- 172.21.15.72:0/1035856411 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea60017020 con 0x7fea6809f650 2023-10-03T10:14:04.688 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:04.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.690+0000 7fea6e205700 1 -- 172.21.15.72:0/1035856411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea6809f650 msgr2=0x7fea6806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.690+0000 7fea6e205700 1 --2- 172.21.15.72:0/1035856411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea6809f650 0x7fea6806c330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fea6000c7c0 tx=0x7fea6000cad0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.690+0000 7fea6e205700 1 -- 172.21.15.72:0/1035856411 shutdown_connections 2023-10-03T10:14:04.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.690+0000 7fea6e205700 1 --2- 172.21.15.72:0/1035856411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea6809f650 0x7fea6806c330 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.690+0000 7fea6e205700 1 --2- 172.21.15.72:0/1035856411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea6809e930 0x7fea6806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.690+0000 7fea6e205700 1 --2- 172.21.15.72:0/1035856411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea6809f240 0x7fea6806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.690+0000 7fea6e205700 1 -- 172.21.15.72:0/1035856411 >> 172.21.15.72:0/1035856411 conn(0x7fea680a4210 msgr2=0x7fea681b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.691+0000 7fea6e205700 1 -- 172.21.15.72:0/1035856411 shutdown_connections 2023-10-03T10:14:04.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.691+0000 7fea6e205700 1 -- 172.21.15.72:0/1035856411 wait complete. 2023-10-03T10:14:04.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:04.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.732+0000 7fd15280b700 1 -- 172.21.15.72:0/746700899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd14c06b250 con 0x7fd14c133420 2023-10-03T10:14:04.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.733+0000 7fd148ff9700 1 -- 172.21.15.72:0/746700899 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd13c017030 con 0x7fd14c133420 2023-10-03T10:14:04.732 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:04.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.735+0000 7fd15280b700 1 -- 172.21.15.72:0/746700899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c133420 msgr2=0x7fd14c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.735+0000 7fd15280b700 1 --2- 172.21.15.72:0/746700899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c133420 0x7fd14c09c480 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00c430 tx=0x7fd13c00c740 comp rx=0 tx=0).stop 2023-10-03T10:14:04.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.735+0000 7fd15280b700 1 -- 172.21.15.72:0/746700899 shutdown_connections 2023-10-03T10:14:04.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.735+0000 7fd15280b700 1 --2- 172.21.15.72:0/746700899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c133420 0x7fd14c09c480 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.735+0000 7fd15280b700 1 --2- 172.21.15.72:0/746700899 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c138dc0 0x7fd14c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.735+0000 7fd15280b700 1 --2- 172.21.15.72:0/746700899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c1337f0 0x7fd14c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.735+0000 7fd15280b700 1 -- 172.21.15.72:0/746700899 >> 172.21.15.72:0/746700899 conn(0x7fd14c0a4210 msgr2=0x7fd14c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.735+0000 7fd15280b700 1 -- 172.21.15.72:0/746700899 shutdown_connections 2023-10-03T10:14:04.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:04.735+0000 7fd15280b700 1 -- 172.21.15.72:0/746700899 wait complete. 2023-10-03T10:14:04.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:05.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:05.571 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:05.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.590+0000 7fef20c64700 1 Processor -- start 2023-10-03T10:14:05.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.590+0000 7fef20c64700 1 -- start start 2023-10-03T10:14:05.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef20c64700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef1c09d6f0 0x7fef1c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef20c64700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef1c09e410 0x7fef1c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef20c64700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1c09b120 con 0x7fef1c09e000 2023-10-03T10:14:05.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef20c64700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c06b460 con 0x7fef1c09d6f0 2023-10-03T10:14:05.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef20c64700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c09a7e0 con 0x7fef1c09e410 2023-10-03T10:14:05.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef1ad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef1c09e410 0x7fef1c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef1a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef1c09d6f0 0x7fef1c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef19d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fef1c09e000 0x7fef1c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42368/0 (socket says 172.21.15.72:42368) 2023-10-03T10:14:05.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef1ad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef1c09e410 0x7fef1c134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50852/0 (socket says 172.21.15.72:50852) 2023-10-03T10:14:05.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef1ad9d700 1 -- 172.21.15.72:0/2062127874 learned_addr learned my addr 172.21.15.72:0/2062127874 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:05.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef1a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef1c09d6f0 0x7fef1c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43856/0 (socket says 172.21.15.72:43856) 2023-10-03T10:14:05.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef1959a700 1 -- 172.21.15.72:0/2062127874 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642990783 0 0) 0x7fef1c09b120 con 0x7fef1c09e000 2023-10-03T10:14:05.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef1ad9d700 1 -- 172.21.15.72:0/2062127874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef1c09d6f0 msgr2=0x7fef1c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef1ad9d700 1 --2- 172.21.15.72:0/2062127874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef1c09d6f0 0x7fef1c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef1ad9d700 1 -- 172.21.15.72:0/2062127874 >> v1:172.21.15.72:6789/0 conn(0x7fef1c09e000 legacy=0x7fef1c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef1ad9d700 1 -- 172.21.15.72:0/2062127874 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c09a500 con 0x7fef1c09e410 2023-10-03T10:14:05.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef1a59c700 1 --2- 172.21.15.72:0/2062127874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef1c09d6f0 0x7fef1c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.591+0000 7fef1ad9d700 1 --2- 172.21.15.72:0/2062127874 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef1c09e410 0x7fef1c134100 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fef14009eb0 tx=0x7fef1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=131e86a025b71f83 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.592+0000 7fef1959a700 1 -- 172.21.15.72:0/2062127874 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1400e070 con 0x7fef1c09e410 2023-10-03T10:14:05.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.592+0000 7fef1959a700 1 -- 172.21.15.72:0/2062127874 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1400b8d0 con 0x7fef1c09e410 2023-10-03T10:14:05.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.592+0000 7fef1959a700 1 -- 172.21.15.72:0/2062127874 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1400bc80 con 0x7fef1c09e410 2023-10-03T10:14:05.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.592+0000 7fef20c64700 1 -- 172.21.15.72:0/2062127874 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef1c09e410 msgr2=0x7fef1c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.592+0000 7fef20c64700 1 --2- 172.21.15.72:0/2062127874 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef1c09e410 0x7fef1c134100 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fef14009eb0 tx=0x7fef1400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:05.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.592+0000 7fef20c64700 1 -- 172.21.15.72:0/2062127874 shutdown_connections 2023-10-03T10:14:05.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.592+0000 7fef20c64700 1 --2- 172.21.15.72:0/2062127874 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef1c09e410 0x7fef1c134100 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.592+0000 7fef20c64700 1 --2- 172.21.15.72:0/2062127874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef1c09d6f0 0x7fef1c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.592+0000 7fef20c64700 1 -- 172.21.15.72:0/2062127874 >> 172.21.15.72:0/2062127874 conn(0x7fef1c066f50 msgr2=0x7fef1c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.592+0000 7fef20c64700 1 -- 172.21.15.72:0/2062127874 shutdown_connections 2023-10-03T10:14:05.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.592+0000 7fef20c64700 1 -- 172.21.15.72:0/2062127874 wait complete. 2023-10-03T10:14:05.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.594+0000 7fef20c64700 1 Processor -- start 2023-10-03T10:14:05.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.594+0000 7fef20c64700 1 -- start start 2023-10-03T10:14:05.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.594+0000 7fef20c64700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef1c09d6f0 0x7fef1c122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.594+0000 7fef20c64700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef1c09e000 0x7fef1c122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.594+0000 7fef20c64700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef1c09e410 0x7fef1c122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.594+0000 7fef20c64700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c1237f0 con 0x7fef1c09e410 2023-10-03T10:14:05.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.594+0000 7fef20c64700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c124e00 con 0x7fef1c09d6f0 2023-10-03T10:14:05.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.594+0000 7fef20c64700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c125e40 con 0x7fef1c09e000 2023-10-03T10:14:05.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.594+0000 7fef19d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef1c09e000 0x7fef1c122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.594+0000 7fef1ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef1c09e410 0x7fef1c122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.594+0000 7fef19d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef1c09e000 0x7fef1c122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50864/0 (socket says 172.21.15.72:50864) 2023-10-03T10:14:05.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.594+0000 7fef19d9b700 1 -- 172.21.15.72:0/2806866467 learned_addr learned my addr 172.21.15.72:0/2806866467 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:05.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.595+0000 7fef1a59c700 1 --2- 172.21.15.72:0/2806866467 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef1c09d6f0 0x7fef1c122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.595+0000 7fef19d9b700 1 -- 172.21.15.72:0/2806866467 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef1c09d6f0 msgr2=0x7fef1c122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.595+0000 7fef19d9b700 1 --2- 172.21.15.72:0/2806866467 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef1c09d6f0 0x7fef1c122320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.595+0000 7fef19d9b700 1 -- 172.21.15.72:0/2806866467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef1c09e410 msgr2=0x7fef1c122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.595+0000 7fef19d9b700 1 --2- 172.21.15.72:0/2806866467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef1c09e410 0x7fef1c122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.595+0000 7fef19d9b700 1 -- 172.21.15.72:0/2806866467 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c0094a0 con 0x7fef1c09e000 2023-10-03T10:14:05.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.595+0000 7fef1ad9d700 1 --2- 172.21.15.72:0/2806866467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef1c09e410 0x7fef1c122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.595+0000 7fef19d9b700 1 --2- 172.21.15.72:0/2806866467 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef1c09e000 0x7fef1c122860 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fef10001eb0 tx=0x7fef1000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.595+0000 7fef0affd700 1 -- 172.21.15.72:0/2806866467 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10004c80 con 0x7fef1c09e000 2023-10-03T10:14:05.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.595+0000 7fef0affd700 1 -- 172.21.15.72:0/2806866467 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef10004de0 con 0x7fef1c09e000 2023-10-03T10:14:05.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.595+0000 7fef20c64700 1 -- 172.21.15.72:0/2806866467 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef14009b30 con 0x7fef1c09e000 2023-10-03T10:14:05.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.595+0000 7fef0affd700 1 -- 172.21.15.72:0/2806866467 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10007310 con 0x7fef1c09e000 2023-10-03T10:14:05.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.595+0000 7fef20c64700 1 -- 172.21.15.72:0/2806866467 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1c0a2020 con 0x7fef1c09e000 2023-10-03T10:14:05.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.596+0000 7fef0affd700 1 -- 172.21.15.72:0/2806866467 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef10007470 con 0x7fef1c09e000 2023-10-03T10:14:05.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.596+0000 7fef0affd700 1 -- 172.21.15.72:0/2806866467 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef1003f3d0 con 0x7fef1c09e000 2023-10-03T10:14:05.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.596+0000 7fef20c64700 1 -- 172.21.15.72:0/2806866467 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1c11f030 con 0x7fef1c09e000 2023-10-03T10:14:05.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.601+0000 7fef0affd700 1 -- 172.21.15.72:0/2806866467 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef100123b0 con 0x7fef1c09e000 2023-10-03T10:14:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.697+0000 7f1397da3700 1 Processor -- start 2023-10-03T10:14:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.697+0000 7f1397da3700 1 -- start start 2023-10-03T10:14:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1397da3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f13900a0a30 0x7f13900a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1397da3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1390134170 0x7f139013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1397da3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139009edd0 con 0x7f13900a1340 2023-10-03T10:14:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1397da3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139009e1f0 con 0x7f13900a0a30 2023-10-03T10:14:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1397da3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139009dc50 con 0x7f1390134170 2023-10-03T10:14:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1395b3f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f13900a0a30 0x7f13900a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1396340700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1390134170 0x7f139013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1395b3f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f13900a0a30 0x7f13900a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59240/0 (socket says 172.21.15.72:59240) 2023-10-03T10:14:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1396340700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1390134170 0x7f139013bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43876/0 (socket says 172.21.15.72:43876) 2023-10-03T10:14:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1395b3f700 1 -- 172.21.15.72:0/4203178483 learned_addr learned my addr 172.21.15.72:0/4203178483 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f139533e700 1 --1- 172.21.15.72:0/4203178483 >> v1:172.21.15.72:6789/0 conn(0x7f13900a1340 0x7f1390133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42372/0 (socket says 172.21.15.72:42372) 2023-10-03T10:14:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1395b3f700 1 -- 172.21.15.72:0/4203178483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1390134170 msgr2=0x7f139013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1395b3f700 1 --2- 172.21.15.72:0/4203178483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1390134170 0x7f139013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1395b3f700 1 -- 172.21.15.72:0/4203178483 >> v1:172.21.15.72:6789/0 conn(0x7f13900a1340 legacy=0x7f1390133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1394b3d700 1 -- 172.21.15.72:0/4203178483 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649891000 0 0) 0x7f139009edd0 con 0x7f13900a1340 2023-10-03T10:14:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1395b3f700 1 -- 172.21.15.72:0/4203178483 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13900a1fe0 con 0x7f13900a0a30 2023-10-03T10:14:05.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1396340700 1 --2- 172.21.15.72:0/4203178483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1390134170 0x7f139013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.698+0000 7f1395b3f700 1 --2- 172.21.15.72:0/4203178483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13900a0a30 0x7f13900a0e00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f138c0098f0 tx=0x7f138c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccfaf31bab0b0aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.699+0000 7f1394b3d700 1 -- 172.21.15.72:0/4203178483 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c011830 con 0x7f13900a0a30 2023-10-03T10:14:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.699+0000 7f1394b3d700 1 -- 172.21.15.72:0/4203178483 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c011990 con 0x7f13900a0a30 2023-10-03T10:14:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.699+0000 7f1394b3d700 1 -- 172.21.15.72:0/4203178483 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c011d20 con 0x7f13900a0a30 2023-10-03T10:14:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.699+0000 7f1397da3700 1 -- 172.21.15.72:0/4203178483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13900a0a30 msgr2=0x7f13900a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.699+0000 7f1397da3700 1 --2- 172.21.15.72:0/4203178483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13900a0a30 0x7f13900a0e00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f138c0098f0 tx=0x7f138c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.699+0000 7f1397da3700 1 -- 172.21.15.72:0/4203178483 shutdown_connections 2023-10-03T10:14:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.699+0000 7f1397da3700 1 --2- 172.21.15.72:0/4203178483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1390134170 0x7f139013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.699+0000 7f1397da3700 1 --2- 172.21.15.72:0/4203178483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13900a0a30 0x7f13900a0e00 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.699+0000 7f1397da3700 1 -- 172.21.15.72:0/4203178483 >> 172.21.15.72:0/4203178483 conn(0x7f13900a6550 msgr2=0x7f13900a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.699+0000 7f1397da3700 1 -- 172.21.15.72:0/4203178483 shutdown_connections 2023-10-03T10:14:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.699+0000 7f1397da3700 1 -- 172.21.15.72:0/4203178483 wait complete. 2023-10-03T10:14:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.700+0000 7f1397da3700 1 Processor -- start 2023-10-03T10:14:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.700+0000 7f1397da3700 1 -- start start 2023-10-03T10:14:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.701+0000 7f1397da3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13900a0a30 0x7f1390122670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.701+0000 7f1397da3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13900a1340 0x7f1390122bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.701+0000 7f1397da3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1390134170 0x7f13901230f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.701+0000 7f1397da3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1390126190 con 0x7f13900a1340 2023-10-03T10:14:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.701+0000 7f1397da3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1390125bf0 con 0x7f1390134170 2023-10-03T10:14:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.701+0000 7f1397da3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1390124320 con 0x7f13900a0a30 2023-10-03T10:14:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.701+0000 7f139533e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13900a1340 0x7f1390122bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.701+0000 7f139533e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13900a1340 0x7f1390122bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59244/0 (socket says 172.21.15.72:59244) 2023-10-03T10:14:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.701+0000 7f139533e700 1 -- 172.21.15.72:0/3390420225 learned_addr learned my addr 172.21.15.72:0/3390420225 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.701+0000 7f1395b3f700 1 --2- 172.21.15.72:0/3390420225 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13900a0a30 0x7f1390122670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.701+0000 7f1396340700 1 --2- 172.21.15.72:0/3390420225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1390134170 0x7f13901230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.702+0000 7f139533e700 1 -- 172.21.15.72:0/3390420225 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13900a0a30 msgr2=0x7f1390122670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.702+0000 7f139533e700 1 --2- 172.21.15.72:0/3390420225 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13900a0a30 0x7f1390122670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.702+0000 7f139533e700 1 -- 172.21.15.72:0/3390420225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1390134170 msgr2=0x7f13901230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.702+0000 7f139533e700 1 --2- 172.21.15.72:0/3390420225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1390134170 0x7f13901230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.702+0000 7f139533e700 1 -- 172.21.15.72:0/3390420225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1388009a70 con 0x7f13900a1340 2023-10-03T10:14:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.702+0000 7f1395b3f700 1 --2- 172.21.15.72:0/3390420225 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13900a0a30 0x7f1390122670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.702+0000 7f139533e700 1 --2- 172.21.15.72:0/3390420225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13900a1340 0x7f1390122bb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f138000c520 tx=0x7f138000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.702+0000 7f13867fc700 1 -- 172.21.15.72:0/3390420225 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380004c80 con 0x7f13900a1340 2023-10-03T10:14:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.702+0000 7f13867fc700 1 -- 172.21.15.72:0/3390420225 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1380004e00 con 0x7f13900a1340 2023-10-03T10:14:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.702+0000 7f1397da3700 1 -- 172.21.15.72:0/3390420225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138c009550 con 0x7f13900a1340 2023-10-03T10:14:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.702+0000 7f13867fc700 1 -- 172.21.15.72:0/3390420225 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380007310 con 0x7f13900a1340 2023-10-03T10:14:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.702+0000 7f1397da3700 1 -- 172.21.15.72:0/3390420225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13900a25e0 con 0x7f13900a1340 2023-10-03T10:14:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.703+0000 7f13867fc700 1 -- 172.21.15.72:0/3390420225 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1380007470 con 0x7f13900a1340 2023-10-03T10:14:05.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.703+0000 7f13867fc700 1 -- 172.21.15.72:0/3390420225 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f138003f2b0 con 0x7f13900a1340 2023-10-03T10:14:05.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.703+0000 7f1397da3700 1 -- 172.21.15.72:0/3390420225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13900a0220 con 0x7f13900a1340 2023-10-03T10:14:05.707 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:05.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.708+0000 7f13867fc700 1 -- 172.21.15.72:0/3390420225 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13800123b0 con 0x7f13900a1340 2023-10-03T10:14:05.747 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:05.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.798+0000 7fef20c64700 1 -- 172.21.15.72:0/2806866467 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fef1c074ea0 con 0x7fef1c09e000 2023-10-03T10:14:05.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.798+0000 7fef0affd700 1 -- 172.21.15.72:0/2806866467 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef100102c0 con 0x7fef1c09e000 2023-10-03T10:14:05.798 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:05.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.802+0000 7fef20c64700 1 -- 172.21.15.72:0/2806866467 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef1c09e000 msgr2=0x7fef1c122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.802+0000 7fef20c64700 1 --2- 172.21.15.72:0/2806866467 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef1c09e000 0x7fef1c122860 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fef10001eb0 tx=0x7fef1000c800 comp rx=0 tx=0).stop 2023-10-03T10:14:05.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.802+0000 7fef20c64700 1 -- 172.21.15.72:0/2806866467 shutdown_connections 2023-10-03T10:14:05.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.802+0000 7fef20c64700 1 --2- 172.21.15.72:0/2806866467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef1c09e410 0x7fef1c122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.802+0000 7fef20c64700 1 --2- 172.21.15.72:0/2806866467 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef1c09d6f0 0x7fef1c122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.802+0000 7fef20c64700 1 --2- 172.21.15.72:0/2806866467 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef1c09e000 0x7fef1c122860 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.802+0000 7fef20c64700 1 -- 172.21.15.72:0/2806866467 >> 172.21.15.72:0/2806866467 conn(0x7fef1c066f50 msgr2=0x7fef1c133de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.802+0000 7fef20c64700 1 -- 172.21.15.72:0/2806866467 shutdown_connections 2023-10-03T10:14:05.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.802+0000 7fef20c64700 1 -- 172.21.15.72:0/2806866467 wait complete. 2023-10-03T10:14:05.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:05.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.844+0000 7f648915e700 1 Processor -- start 2023-10-03T10:14:05.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.844+0000 7f648915e700 1 -- start start 2023-10-03T10:14:05.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648915e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f648409c650 0x7f648409ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648915e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64840a0090 0x7f648409cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648915e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6484131970 0x7f6484131e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648915e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648409ba70 con 0x7f64840a0090 2023-10-03T10:14:05.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648915e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648409d4a0 con 0x7f6484131970 2023-10-03T10:14:05.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648915e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f648409e8f0 con 0x7f648409c650 2023-10-03T10:14:05.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64840a0090 0x7f648409cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f6482d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f648409c650 0x7f648409ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64840a0090 0x7f648409cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59254/0 (socket says 172.21.15.72:59254) 2023-10-03T10:14:05.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f6482d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f648409c650 0x7f648409ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50886/0 (socket says 172.21.15.72:50886) 2023-10-03T10:14:05.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648259c700 1 -- 172.21.15.72:0/4100620750 learned_addr learned my addr 172.21.15.72:0/4100620750 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:05.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648359e700 1 --2- 172.21.15.72:0/4100620750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6484131970 0x7f6484131e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648259c700 1 -- 172.21.15.72:0/4100620750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f648409c650 msgr2=0x7f648409ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648259c700 1 --2- 172.21.15.72:0/4100620750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f648409c650 0x7f648409ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648259c700 1 -- 172.21.15.72:0/4100620750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6484131970 msgr2=0x7f6484131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648259c700 1 --2- 172.21.15.72:0/4100620750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6484131970 0x7f6484131e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648259c700 1 -- 172.21.15.72:0/4100620750 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64840a0760 con 0x7f64840a0090 2023-10-03T10:14:05.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f6482d9d700 1 --2- 172.21.15.72:0/4100620750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f648409c650 0x7f648409ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.845+0000 7f648359e700 1 --2- 172.21.15.72:0/4100620750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6484131970 0x7f6484131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.846+0000 7f648259c700 1 --2- 172.21.15.72:0/4100620750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64840a0090 0x7f648409cf60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f64780098f0 tx=0x7f6478009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c72f5a74cf180d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.846+0000 7f6481d9b700 1 -- 172.21.15.72:0/4100620750 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478011830 con 0x7f64840a0090 2023-10-03T10:14:05.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.846+0000 7f6481d9b700 1 -- 172.21.15.72:0/4100620750 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6478011990 con 0x7f64840a0090 2023-10-03T10:14:05.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.846+0000 7f6481d9b700 1 -- 172.21.15.72:0/4100620750 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478011d20 con 0x7f64840a0090 2023-10-03T10:14:05.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.846+0000 7f648915e700 1 -- 172.21.15.72:0/4100620750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64840a0090 msgr2=0x7f648409cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.846+0000 7f648915e700 1 --2- 172.21.15.72:0/4100620750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64840a0090 0x7f648409cf60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f64780098f0 tx=0x7f6478009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:05.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.846+0000 7f648915e700 1 -- 172.21.15.72:0/4100620750 shutdown_connections 2023-10-03T10:14:05.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.846+0000 7f648915e700 1 --2- 172.21.15.72:0/4100620750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6484131970 0x7f6484131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.846+0000 7f648915e700 1 --2- 172.21.15.72:0/4100620750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f648409c650 0x7f648409ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.846+0000 7f648915e700 1 --2- 172.21.15.72:0/4100620750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64840a0090 0x7f648409cf60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.846+0000 7f648915e700 1 -- 172.21.15.72:0/4100620750 >> 172.21.15.72:0/4100620750 conn(0x7f64840a3f70 msgr2=0x7f64840a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.846+0000 7f648915e700 1 -- 172.21.15.72:0/4100620750 shutdown_connections 2023-10-03T10:14:05.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.846+0000 7f648915e700 1 -- 172.21.15.72:0/4100620750 wait complete. 2023-10-03T10:14:05.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.848+0000 7f648915e700 1 Processor -- start 2023-10-03T10:14:05.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.848+0000 7f648915e700 1 -- start start 2023-10-03T10:14:05.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.848+0000 7f648915e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f648409c650 0x7f648411c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.848+0000 7f648915e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64840a0090 0x7f648411c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.848+0000 7f648915e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6484131970 0x7f648411cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.848+0000 7f648915e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648411d5f0 con 0x7f6484131970 2023-10-03T10:14:05.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.848+0000 7f648915e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648412f510 con 0x7f64840a0090 2023-10-03T10:14:05.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.848+0000 7f648915e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f648411e350 con 0x7f648409c650 2023-10-03T10:14:05.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.848+0000 7f6482d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f648409c650 0x7f648411c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.848+0000 7f6482d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f648409c650 0x7f648411c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50898/0 (socket says 172.21.15.72:50898) 2023-10-03T10:14:05.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.848+0000 7f6482d9d700 1 -- 172.21.15.72:0/3632963063 learned_addr learned my addr 172.21.15.72:0/3632963063 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:05.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.848+0000 7f648259c700 1 --2- 172.21.15.72:0/3632963063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64840a0090 0x7f648411c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.848+0000 7f648359e700 1 --2- 172.21.15.72:0/3632963063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6484131970 0x7f648411cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.849+0000 7f6482d9d700 1 -- 172.21.15.72:0/3632963063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64840a0090 msgr2=0x7f648411c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.849+0000 7f6482d9d700 1 --2- 172.21.15.72:0/3632963063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64840a0090 0x7f648411c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.849+0000 7f6482d9d700 1 -- 172.21.15.72:0/3632963063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6484131970 msgr2=0x7f648411cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.849+0000 7f6482d9d700 1 --2- 172.21.15.72:0/3632963063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6484131970 0x7f648411cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.849+0000 7f6482d9d700 1 -- 172.21.15.72:0/3632963063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64740094a0 con 0x7f648409c650 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.849+0000 7f6482d9d700 1 --2- 172.21.15.72:0/3632963063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f648409c650 0x7f648411c120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f647400ec10 tx=0x7f647400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.849+0000 7f646b7fe700 1 -- 172.21.15.72:0/3632963063 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647400c850 con 0x7f648409c650 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.849+0000 7f646b7fe700 1 -- 172.21.15.72:0/3632963063 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647400c9b0 con 0x7f648409c650 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.849+0000 7f648915e700 1 -- 172.21.15.72:0/3632963063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647c009a70 con 0x7f648409c650 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.849+0000 7f646b7fe700 1 -- 172.21.15.72:0/3632963063 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647400cd20 con 0x7f648409c650 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.849+0000 7f648915e700 1 -- 172.21.15.72:0/3632963063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6478009550 con 0x7f648409c650 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.850+0000 7f648915e700 1 -- 172.21.15.72:0/3632963063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64840a45f0 con 0x7f648409c650 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.850+0000 7f646b7fe700 1 -- 172.21.15.72:0/3632963063 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6474013470 con 0x7f648409c650 2023-10-03T10:14:05.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.851+0000 7f646b7fe700 1 -- 172.21.15.72:0/3632963063 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f647403f870 con 0x7f648409c650 2023-10-03T10:14:05.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.855+0000 7f646b7fe700 1 -- 172.21.15.72:0/3632963063 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6474013720 con 0x7f648409c650 2023-10-03T10:14:05.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.880+0000 7f051b282700 1 Processor -- start 2023-10-03T10:14:05.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.880+0000 7f051b282700 1 -- start start 2023-10-03T10:14:05.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051b282700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05140a0a30 0x7f05140a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051b282700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f051409d630 0x7f05140a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051b282700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0514133930 0x7f0514133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051b282700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05140a2a70 con 0x7f051409d630 2023-10-03T10:14:05.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051b282700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05140a01d0 con 0x7f0514133930 2023-10-03T10:14:05.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051b282700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f051409e2b0 con 0x7f05140a0a30 2023-10-03T10:14:05.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051901e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05140a0a30 0x7f05140a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051881d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f051409d630 0x7f05140a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051901e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05140a0a30 0x7f05140a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50910/0 (socket says 172.21.15.72:50910) 2023-10-03T10:14:05.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051901e700 1 -- 172.21.15.72:0/2904111570 learned_addr learned my addr 172.21.15.72:0/2904111570 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051881d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f051409d630 0x7f05140a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59276/0 (socket says 172.21.15.72:59276) 2023-10-03T10:14:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051981f700 1 --2- 172.21.15.72:0/2904111570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0514133930 0x7f0514133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051881d700 1 -- 172.21.15.72:0/2904111570 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05140a0a30 msgr2=0x7f05140a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051881d700 1 --2- 172.21.15.72:0/2904111570 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05140a0a30 0x7f05140a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051881d700 1 -- 172.21.15.72:0/2904111570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0514133930 msgr2=0x7f0514133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051881d700 1 --2- 172.21.15.72:0/2904111570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0514133930 0x7f0514133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051881d700 1 -- 172.21.15.72:0/2904111570 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051409dc50 con 0x7f051409d630 2023-10-03T10:14:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051981f700 1 --2- 172.21.15.72:0/2904111570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0514133930 0x7f0514133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f051881d700 1 --2- 172.21.15.72:0/2904111570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f051409d630 0x7f05140a1340 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0504009840 tx=0x7f0504009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f30259487699e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f050bfff700 1 -- 172.21.15.72:0/2904111570 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504011830 con 0x7f051409d630 2023-10-03T10:14:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f050bfff700 1 -- 172.21.15.72:0/2904111570 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0504011990 con 0x7f051409d630 2023-10-03T10:14:05.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.881+0000 7f050bfff700 1 -- 172.21.15.72:0/2904111570 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504011d20 con 0x7f051409d630 2023-10-03T10:14:05.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.882+0000 7f051b282700 1 -- 172.21.15.72:0/2904111570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f051409d630 msgr2=0x7f05140a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.882+0000 7f051b282700 1 --2- 172.21.15.72:0/2904111570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f051409d630 0x7f05140a1340 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0504009840 tx=0x7f0504009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:05.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.882+0000 7f051b282700 1 -- 172.21.15.72:0/2904111570 shutdown_connections 2023-10-03T10:14:05.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.882+0000 7f051b282700 1 --2- 172.21.15.72:0/2904111570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0514133930 0x7f0514133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.882+0000 7f051b282700 1 --2- 172.21.15.72:0/2904111570 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05140a0a30 0x7f05140a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.882+0000 7f051b282700 1 --2- 172.21.15.72:0/2904111570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f051409d630 0x7f05140a1340 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.882+0000 7f051b282700 1 -- 172.21.15.72:0/2904111570 >> 172.21.15.72:0/2904111570 conn(0x7f05140a3050 msgr2=0x7f05140a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.882+0000 7f051b282700 1 -- 172.21.15.72:0/2904111570 shutdown_connections 2023-10-03T10:14:05.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.882+0000 7f051b282700 1 -- 172.21.15.72:0/2904111570 wait complete. 2023-10-03T10:14:05.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.883+0000 7f051b282700 1 Processor -- start 2023-10-03T10:14:05.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.883+0000 7f051b282700 1 -- start start 2023-10-03T10:14:05.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.884+0000 7f051b282700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f051409d630 0x7f051411f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.884+0000 7f051b282700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05140a0a30 0x7f051411fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.884+0000 7f051b282700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0514133930 0x7f05141c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.884+0000 7f051b282700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05141222e0 con 0x7f051409d630 2023-10-03T10:14:05.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.884+0000 7f051b282700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0514122800 con 0x7f05140a0a30 2023-10-03T10:14:05.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.884+0000 7f051b282700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0514133430 con 0x7f0514133930 2023-10-03T10:14:05.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.884+0000 7f051901e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f051409d630 0x7f051411f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.884+0000 7f051901e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f051409d630 0x7f051411f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59292/0 (socket says 172.21.15.72:59292) 2023-10-03T10:14:05.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.884+0000 7f051901e700 1 -- 172.21.15.72:0/1475999412 learned_addr learned my addr 172.21.15.72:0/1475999412 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:05.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.884+0000 7f051881d700 1 --2- 172.21.15.72:0/1475999412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05140a0a30 0x7f051411fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.884+0000 7f051981f700 1 --2- 172.21.15.72:0/1475999412 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0514133930 0x7f05141c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.885+0000 7f051881d700 1 -- 172.21.15.72:0/1475999412 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0514133930 msgr2=0x7f05141c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.885+0000 7f051881d700 1 --2- 172.21.15.72:0/1475999412 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0514133930 0x7f05141c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.885+0000 7f051881d700 1 -- 172.21.15.72:0/1475999412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f051409d630 msgr2=0x7f051411f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.885+0000 7f051881d700 1 --2- 172.21.15.72:0/1475999412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f051409d630 0x7f051411f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.885+0000 7f051881d700 1 -- 172.21.15.72:0/1475999412 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c009a70 con 0x7f05140a0a30 2023-10-03T10:14:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.885+0000 7f051901e700 1 --2- 172.21.15.72:0/1475999412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f051409d630 0x7f051411f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.885+0000 7f051981f700 1 --2- 172.21.15.72:0/1475999412 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0514133930 0x7f05141c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.885+0000 7f051881d700 1 --2- 172.21.15.72:0/1475999412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05140a0a30 0x7f051411fa40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f05140672b0 tx=0x7f0504004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.885+0000 7f0509ffb700 1 -- 172.21.15.72:0/1475999412 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504004240 con 0x7f05140a0a30 2023-10-03T10:14:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.885+0000 7f0509ffb700 1 -- 172.21.15.72:0/1475999412 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050401f070 con 0x7f05140a0a30 2023-10-03T10:14:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.885+0000 7f051b282700 1 -- 172.21.15.72:0/1475999412 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05040094a0 con 0x7f05140a0a30 2023-10-03T10:14:05.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.885+0000 7f0509ffb700 1 -- 172.21.15.72:0/1475999412 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05040045a0 con 0x7f05140a0a30 2023-10-03T10:14:05.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.885+0000 7f051b282700 1 -- 172.21.15.72:0/1475999412 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0514120ea0 con 0x7f05140a0a30 2023-10-03T10:14:05.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.886+0000 7f0509ffb700 1 -- 172.21.15.72:0/1475999412 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0504021030 con 0x7f05140a0a30 2023-10-03T10:14:05.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.886+0000 7f0509ffb700 1 -- 172.21.15.72:0/1475999412 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0504040520 con 0x7f05140a0a30 2023-10-03T10:14:05.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.886+0000 7f051b282700 1 -- 172.21.15.72:0/1475999412 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0514122420 con 0x7f05140a0a30 2023-10-03T10:14:05.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.891+0000 7f0509ffb700 1 -- 172.21.15.72:0/1475999412 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0514122420 con 0x7f05140a0a30 2023-10-03T10:14:05.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.966+0000 7f1397da3700 1 -- 172.21.15.72:0/3390420225 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1390074ea0 con 0x7f13900a1340 2023-10-03T10:14:05.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.967+0000 7f13867fc700 1 -- 172.21.15.72:0/3390420225 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f138000ce60 con 0x7f13900a1340 2023-10-03T10:14:05.967 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.970+0000 7f1397da3700 1 -- 172.21.15.72:0/3390420225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13900a1340 msgr2=0x7f1390122bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.970+0000 7f1397da3700 1 --2- 172.21.15.72:0/3390420225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13900a1340 0x7f1390122bb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f138000c520 tx=0x7f138000c830 comp rx=0 tx=0).stop 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.970+0000 7f1397da3700 1 -- 172.21.15.72:0/3390420225 shutdown_connections 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.970+0000 7f1397da3700 1 --2- 172.21.15.72:0/3390420225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1390134170 0x7f13901230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.970+0000 7f1397da3700 1 --2- 172.21.15.72:0/3390420225 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13900a0a30 0x7f1390122670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.970+0000 7f1397da3700 1 --2- 172.21.15.72:0/3390420225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13900a1340 0x7f1390122bb0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.970+0000 7f1397da3700 1 -- 172.21.15.72:0/3390420225 >> 172.21.15.72:0/3390420225 conn(0x7f13900a6550 msgr2=0x7f139009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.970+0000 7f1397da3700 1 -- 172.21.15.72:0/3390420225 shutdown_connections 2023-10-03T10:14:05.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:05.970+0000 7f1397da3700 1 -- 172.21.15.72:0/3390420225 wait complete. 2023-10-03T10:14:05.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:06.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.074+0000 7f648915e700 1 -- 172.21.15.72:0/3632963063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f64840747f0 con 0x7f648409c650 2023-10-03T10:14:06.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.074+0000 7f646b7fe700 1 -- 172.21.15.72:0/3632963063 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6474021030 con 0x7f648409c650 2023-10-03T10:14:06.074 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.077+0000 7f648915e700 1 -- 172.21.15.72:0/3632963063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f648409c650 msgr2=0x7f648411c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.077+0000 7f648915e700 1 --2- 172.21.15.72:0/3632963063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f648409c650 0x7f648411c120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f647400ec10 tx=0x7f647400ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:06.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.077+0000 7f648915e700 1 -- 172.21.15.72:0/3632963063 shutdown_connections 2023-10-03T10:14:06.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.077+0000 7f648915e700 1 --2- 172.21.15.72:0/3632963063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6484131970 0x7f648411cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.077+0000 7f648915e700 1 --2- 172.21.15.72:0/3632963063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f648409c650 0x7f648411c120 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.077+0000 7f648915e700 1 --2- 172.21.15.72:0/3632963063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64840a0090 0x7f648411c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.077+0000 7f648915e700 1 -- 172.21.15.72:0/3632963063 >> 172.21.15.72:0/3632963063 conn(0x7f64840a3f70 msgr2=0x7f64841b75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.077+0000 7f648915e700 1 -- 172.21.15.72:0/3632963063 shutdown_connections 2023-10-03T10:14:06.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.077+0000 7f648915e700 1 -- 172.21.15.72:0/3632963063 wait complete. 2023-10-03T10:14:06.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:06.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.114+0000 7f051b282700 1 -- 172.21.15.72:0/1475999412 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0514121f60 con 0x7f05140a0a30 2023-10-03T10:14:06.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.114+0000 7f0509ffb700 1 -- 172.21.15.72:0/1475999412 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0514121f60 con 0x7f05140a0a30 2023-10-03T10:14:06.114 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.116+0000 7f051b282700 1 -- 172.21.15.72:0/1475999412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05140a0a30 msgr2=0x7f051411fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.116+0000 7f051b282700 1 --2- 172.21.15.72:0/1475999412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05140a0a30 0x7f051411fa40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f05140672b0 tx=0x7f0504004750 comp rx=0 tx=0).stop 2023-10-03T10:14:06.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.116+0000 7f051b282700 1 -- 172.21.15.72:0/1475999412 shutdown_connections 2023-10-03T10:14:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.116+0000 7f051b282700 1 --2- 172.21.15.72:0/1475999412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f051409d630 0x7f051411f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.116+0000 7f051b282700 1 --2- 172.21.15.72:0/1475999412 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0514133930 0x7f05141c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.116+0000 7f051b282700 1 --2- 172.21.15.72:0/1475999412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05140a0a30 0x7f051411fa40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.116+0000 7f051b282700 1 -- 172.21.15.72:0/1475999412 >> 172.21.15.72:0/1475999412 conn(0x7f05140a3050 msgr2=0x7f05141bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.116+0000 7f051b282700 1 -- 172.21.15.72:0/1475999412 shutdown_connections 2023-10-03T10:14:06.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.116+0000 7f051b282700 1 -- 172.21.15.72:0/1475999412 wait complete. 2023-10-03T10:14:06.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:06.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.950+0000 7f093575b700 1 Processor -- start 2023-10-03T10:14:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.950+0000 7f093575b700 1 -- start start 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f093575b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09300a09c0 0x7f09300a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f093575b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093009d5c0 0x7f09300a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f093575b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0930133920 0x7f0930133d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f093575b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09300a1810 con 0x7f0930133920 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f093575b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093009ea10 con 0x7f09300a09c0 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f093575b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f093009e210 con 0x7f093009d5c0 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f092effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09300a09c0 0x7f09300a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f092effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09300a09c0 0x7f09300a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43934/0 (socket says 172.21.15.72:43934) 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f092effd700 1 -- 172.21.15.72:0/3665439768 learned_addr learned my addr 172.21.15.72:0/3665439768 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f092f7fe700 1 --2- 172.21.15.72:0/3665439768 >> v2:172.21.15.72:3300/0 conn(0x7f0930133920 0x7f0930133d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f092e7fc700 1 --2- 172.21.15.72:0/3665439768 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093009d5c0 0x7f09300a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f092effd700 1 -- 172.21.15.72:0/3665439768 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093009d5c0 msgr2=0x7f09300a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f092effd700 1 --2- 172.21.15.72:0/3665439768 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093009d5c0 0x7f09300a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f092effd700 1 -- 172.21.15.72:0/3665439768 >> v2:172.21.15.72:3300/0 conn(0x7f0930133920 msgr2=0x7f0930133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f092effd700 1 --2- 172.21.15.72:0/3665439768 >> v2:172.21.15.72:3300/0 conn(0x7f0930133920 0x7f0930133d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f092effd700 1 -- 172.21.15.72:0/3665439768 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09300a26f0 con 0x7f09300a09c0 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.951+0000 7f092f7fe700 1 --2- 172.21.15.72:0/3665439768 >> v2:172.21.15.72:3300/0 conn(0x7f0930133920 0x7f0930133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.952+0000 7f092effd700 1 --2- 172.21.15.72:0/3665439768 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09300a09c0 0x7f09300a0d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f09180098f0 tx=0x7f0918009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=149814af468c2002 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.952+0000 7f092dffb700 1 -- 172.21.15.72:0/3665439768 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0918011830 con 0x7f09300a09c0 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.952+0000 7f092dffb700 1 -- 172.21.15.72:0/3665439768 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0918011990 con 0x7f09300a09c0 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.952+0000 7f092dffb700 1 -- 172.21.15.72:0/3665439768 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0918011d20 con 0x7f09300a09c0 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.952+0000 7f093575b700 1 -- 172.21.15.72:0/3665439768 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09300a09c0 msgr2=0x7f09300a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.952+0000 7f093575b700 1 --2- 172.21.15.72:0/3665439768 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09300a09c0 0x7f09300a0d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f09180098f0 tx=0x7f0918009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:06.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.952+0000 7f093575b700 1 -- 172.21.15.72:0/3665439768 shutdown_connections 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.952+0000 7f093575b700 1 --2- 172.21.15.72:0/3665439768 >> v2:172.21.15.72:3300/0 conn(0x7f0930133920 0x7f0930133d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.952+0000 7f093575b700 1 --2- 172.21.15.72:0/3665439768 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09300a09c0 0x7f09300a0d90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.952+0000 7f093575b700 1 --2- 172.21.15.72:0/3665439768 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093009d5c0 0x7f09300a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.952+0000 7f093575b700 1 -- 172.21.15.72:0/3665439768 >> 172.21.15.72:0/3665439768 conn(0x7f09300a2fe0 msgr2=0x7f09300a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.952+0000 7f093575b700 1 -- 172.21.15.72:0/3665439768 shutdown_connections 2023-10-03T10:14:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.952+0000 7f093575b700 1 -- 172.21.15.72:0/3665439768 wait complete. 2023-10-03T10:14:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.954+0000 7f093575b700 1 Processor -- start 2023-10-03T10:14:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.954+0000 7f093575b700 1 -- start start 2023-10-03T10:14:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.954+0000 7f093575b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093009d5c0 0x7f093011f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.954+0000 7f093575b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09300a09c0 0x7f093011fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.954+0000 7f093575b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0930133920 0x7f09301c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.954+0000 7f093575b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09301206a0 con 0x7f09300a09c0 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.954+0000 7f093575b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0930120890 con 0x7f093009d5c0 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.954+0000 7f093575b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0930122080 con 0x7f0930133920 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.954+0000 7f092effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093009d5c0 0x7f093011f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.954+0000 7f092effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093009d5c0 0x7f093011f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43950/0 (socket says 172.21.15.72:43950) 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.954+0000 7f092f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0930133920 0x7f09301c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.955+0000 7f092effd700 1 -- 172.21.15.72:0/1758497001 learned_addr learned my addr 172.21.15.72:0/1758497001 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.955+0000 7f092e7fc700 1 --2- 172.21.15.72:0/1758497001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09300a09c0 0x7f093011fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.955+0000 7f092f7fe700 1 -- 172.21.15.72:0/1758497001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093009d5c0 msgr2=0x7f093011f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.955+0000 7f092f7fe700 1 --2- 172.21.15.72:0/1758497001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093009d5c0 0x7f093011f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.955+0000 7f092f7fe700 1 -- 172.21.15.72:0/1758497001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09300a09c0 msgr2=0x7f093011fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.955+0000 7f092f7fe700 1 --2- 172.21.15.72:0/1758497001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09300a09c0 0x7f093011fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.955+0000 7f092f7fe700 1 -- 172.21.15.72:0/1758497001 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0928009a70 con 0x7f0930133920 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.955+0000 7f092effd700 1 --2- 172.21.15.72:0/1758497001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093009d5c0 0x7f093011f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.955+0000 7f092f7fe700 1 --2- 172.21.15.72:0/1758497001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0930133920 0x7f09301c81f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0928009e50 tx=0x7f092800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.955+0000 7f09277fe700 1 -- 172.21.15.72:0/1758497001 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092800ca90 con 0x7f0930133920 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.955+0000 7f09277fe700 1 -- 172.21.15.72:0/1758497001 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092800f040 con 0x7f0930133920 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.955+0000 7f093575b700 1 -- 172.21.15.72:0/1758497001 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0918009550 con 0x7f0930133920 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.955+0000 7f09277fe700 1 -- 172.21.15.72:0/1758497001 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092800ce50 con 0x7f0930133920 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.955+0000 7f093575b700 1 -- 172.21.15.72:0/1758497001 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09300a4060 con 0x7f0930133920 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.956+0000 7f09277fe700 1 -- 172.21.15.72:0/1758497001 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0928014480 con 0x7f0930133920 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.956+0000 7f09277fe700 1 -- 172.21.15.72:0/1758497001 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f092803fce0 con 0x7f0930133920 2023-10-03T10:14:06.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.956+0000 7f093575b700 1 -- 172.21.15.72:0/1758497001 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0930120040 con 0x7f0930133920 2023-10-03T10:14:06.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:06.961+0000 7f09277fe700 1 -- 172.21.15.72:0/1758497001 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0928012930 con 0x7f0930133920 2023-10-03T10:14:06.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:07.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:07.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.114+0000 7f289cd19700 1 Processor -- start 2023-10-03T10:14:07.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.114+0000 7f289cd19700 1 -- start start 2023-10-03T10:14:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.115+0000 7f289cd19700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28980a0a30 0x7f28980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.115+0000 7f289cd19700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2898138d80 0x7f289813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.115+0000 7f289cd19700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28980a2a70 con 0x7f289809d630 2023-10-03T10:14:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.115+0000 7f289cd19700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28980a01d0 con 0x7f2898138d80 2023-10-03T10:14:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.115+0000 7f289cd19700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f289809e2b0 con 0x7f28980a0a30 2023-10-03T10:14:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.115+0000 7f289659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28980a0a30 0x7f28980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.115+0000 7f289659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28980a0a30 0x7f28980a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50940/0 (socket says 172.21.15.72:50940) 2023-10-03T10:14:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.115+0000 7f289659c700 1 -- 172.21.15.72:0/4217542812 learned_addr learned my addr 172.21.15.72:0/4217542812 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.115+0000 7f2896d9d700 1 --2- 172.21.15.72:0/4217542812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2898138d80 0x7f289813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.115+0000 7f289659c700 1 -- 172.21.15.72:0/4217542812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2898138d80 msgr2=0x7f289813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.115+0000 7f289659c700 1 --2- 172.21.15.72:0/4217542812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2898138d80 0x7f289813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.115+0000 7f289659c700 1 -- 172.21.15.72:0/4217542812 >> v1:172.21.15.72:6789/0 conn(0x7f289809d630 legacy=0x7f28980a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.115+0000 7f289659c700 1 -- 172.21.15.72:0/4217542812 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289809dc50 con 0x7f28980a0a30 2023-10-03T10:14:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.115+0000 7f289659c700 1 --2- 172.21.15.72:0/4217542812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28980a0a30 0x7f28980a0e00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2888009920 tx=0x7f2888009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b734ae34ea62436f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.116+0000 7f289559a700 1 -- 172.21.15.72:0/4217542812 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2888011830 con 0x7f28980a0a30 2023-10-03T10:14:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.116+0000 7f289559a700 1 -- 172.21.15.72:0/4217542812 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2888011990 con 0x7f28980a0a30 2023-10-03T10:14:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.116+0000 7f289559a700 1 -- 172.21.15.72:0/4217542812 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2888011d20 con 0x7f28980a0a30 2023-10-03T10:14:07.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.116+0000 7f289cd19700 1 -- 172.21.15.72:0/4217542812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28980a0a30 msgr2=0x7f28980a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.116+0000 7f289cd19700 1 --2- 172.21.15.72:0/4217542812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28980a0a30 0x7f28980a0e00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2888009920 tx=0x7f2888009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:07.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.116+0000 7f289cd19700 1 -- 172.21.15.72:0/4217542812 shutdown_connections 2023-10-03T10:14:07.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.116+0000 7f289cd19700 1 --2- 172.21.15.72:0/4217542812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2898138d80 0x7f289813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.116+0000 7f289cd19700 1 --2- 172.21.15.72:0/4217542812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28980a0a30 0x7f28980a0e00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.116+0000 7f289cd19700 1 -- 172.21.15.72:0/4217542812 >> 172.21.15.72:0/4217542812 conn(0x7f28980a3050 msgr2=0x7f28980a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.116+0000 7f289cd19700 1 -- 172.21.15.72:0/4217542812 shutdown_connections 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.116+0000 7f289cd19700 1 -- 172.21.15.72:0/4217542812 wait complete. 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.118+0000 7f289cd19700 1 Processor -- start 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.118+0000 7f289cd19700 1 -- start start 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.118+0000 7f289cd19700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f289809d630 0x7f289811d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.118+0000 7f289cd19700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28980a0a30 0x7f289811d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.118+0000 7f289cd19700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2898138d80 0x7f289811de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.118+0000 7f289cd19700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289811fe50 con 0x7f28980a0a30 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.118+0000 7f289cd19700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289811e790 con 0x7f289809d630 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.118+0000 7f289cd19700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28980a4e20 con 0x7f2898138d80 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.118+0000 7f2895d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28980a0a30 0x7f289811d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.118+0000 7f2895d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28980a0a30 0x7f289811d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59320/0 (socket says 172.21.15.72:59320) 2023-10-03T10:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.118+0000 7f2895d9b700 1 -- 172.21.15.72:0/1043081840 learned_addr learned my addr 172.21.15.72:0/1043081840 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.118+0000 7f2896d9d700 1 --2- 172.21.15.72:0/1043081840 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2898138d80 0x7f289811de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.118+0000 7f289659c700 1 --2- 172.21.15.72:0/1043081840 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f289809d630 0x7f289811d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.118+0000 7f2895d9b700 1 -- 172.21.15.72:0/1043081840 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2898138d80 msgr2=0x7f289811de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.119+0000 7f2895d9b700 1 --2- 172.21.15.72:0/1043081840 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2898138d80 0x7f289811de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.119+0000 7f2895d9b700 1 -- 172.21.15.72:0/1043081840 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f289809d630 msgr2=0x7f289811d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.119+0000 7f2895d9b700 1 --2- 172.21.15.72:0/1043081840 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f289809d630 0x7f289811d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.119+0000 7f2895d9b700 1 -- 172.21.15.72:0/1043081840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2888009550 con 0x7f28980a0a30 2023-10-03T10:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.119+0000 7f289659c700 1 --2- 172.21.15.72:0/1043081840 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f289809d630 0x7f289811d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.119+0000 7f2895d9b700 1 --2- 172.21.15.72:0/1043081840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28980a0a30 0x7f289811d900 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f288c00c4b0 tx=0x7f288c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.119+0000 7f2886ffd700 1 -- 172.21.15.72:0/1043081840 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c0052d0 con 0x7f28980a0a30 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.119+0000 7f2886ffd700 1 -- 172.21.15.72:0/1043081840 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c005430 con 0x7f28980a0a30 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.119+0000 7f289cd19700 1 -- 172.21.15.72:0/1043081840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28980a0410 con 0x7f28980a0a30 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.119+0000 7f2886ffd700 1 -- 172.21.15.72:0/1043081840 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c0038c0 con 0x7f28980a0a30 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.119+0000 7f289cd19700 1 -- 172.21.15.72:0/1043081840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28981215e0 con 0x7f28980a0a30 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.120+0000 7f2886ffd700 1 -- 172.21.15.72:0/1043081840 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f288c003a20 con 0x7f28980a0a30 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.120+0000 7f289cd19700 1 -- 172.21.15.72:0/1043081840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28980747f0 con 0x7f28980a0a30 2023-10-03T10:14:07.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.120+0000 7f2886ffd700 1 -- 172.21.15.72:0/1043081840 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f288c03eae0 con 0x7f28980a0a30 2023-10-03T10:14:07.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.125+0000 7f2886ffd700 1 -- 172.21.15.72:0/1043081840 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f288c019e60 con 0x7f28980a0a30 2023-10-03T10:14:07.128 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:07.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.164+0000 7f093575b700 1 -- 172.21.15.72:0/1758497001 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0930122580 con 0x7f0930133920 2023-10-03T10:14:07.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.165+0000 7f09277fe700 1 -- 172.21.15.72:0/1758497001 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0930122580 con 0x7f0930133920 2023-10-03T10:14:07.164 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.168+0000 7f093575b700 1 -- 172.21.15.72:0/1758497001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0930133920 msgr2=0x7f09301c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.168+0000 7f093575b700 1 --2- 172.21.15.72:0/1758497001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0930133920 0x7f09301c81f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0928009e50 tx=0x7f092800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.168+0000 7f093575b700 1 -- 172.21.15.72:0/1758497001 shutdown_connections 2023-10-03T10:14:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.168+0000 7f093575b700 1 --2- 172.21.15.72:0/1758497001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0930133920 0x7f09301c81f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.168+0000 7f093575b700 1 --2- 172.21.15.72:0/1758497001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093009d5c0 0x7f093011f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.168+0000 7f093575b700 1 --2- 172.21.15.72:0/1758497001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09300a09c0 0x7f093011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.168+0000 7f093575b700 1 -- 172.21.15.72:0/1758497001 >> 172.21.15.72:0/1758497001 conn(0x7f09300a2fe0 msgr2=0x7f093009ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.168+0000 7f093575b700 1 -- 172.21.15.72:0/1758497001 shutdown_connections 2023-10-03T10:14:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.168+0000 7f093575b700 1 -- 172.21.15.72:0/1758497001 wait complete. 2023-10-03T10:14:07.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:07.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.222+0000 7f86b4711700 1 Processor -- start 2023-10-03T10:14:07.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.222+0000 7f86b4711700 1 -- start start 2023-10-03T10:14:07.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.223+0000 7f86b4711700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86ac09c650 0x7f86ac09ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.223+0000 7f86b4711700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86ac0a0090 0x7f86ac09cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.223+0000 7f86b4711700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86ac131970 0x7f86ac131df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.223+0000 7f86b4711700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ac09ba70 con 0x7f86ac09c650 2023-10-03T10:14:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.223+0000 7f86b4711700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac09d4a0 con 0x7f86ac131970 2023-10-03T10:14:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.223+0000 7f86b4711700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac09e8f0 con 0x7f86ac0a0090 2023-10-03T10:14:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.223+0000 7f86b24ad700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86ac09c650 0x7f86ac09ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.224+0000 7f86b24ad700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86ac09c650 0x7f86ac09ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59326/0 (socket says 172.21.15.72:59326) 2023-10-03T10:14:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.224+0000 7f86b24ad700 1 -- 172.21.15.72:0/4155612400 learned_addr learned my addr 172.21.15.72:0/4155612400 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:07.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.224+0000 7f86b2cae700 1 --2- 172.21.15.72:0/4155612400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86ac131970 0x7f86ac131df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.224+0000 7f86b1cac700 1 --2- 172.21.15.72:0/4155612400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86ac0a0090 0x7f86ac09cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.224+0000 7f86b24ad700 1 -- 172.21.15.72:0/4155612400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86ac0a0090 msgr2=0x7f86ac09cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.224+0000 7f86b24ad700 1 --2- 172.21.15.72:0/4155612400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86ac0a0090 0x7f86ac09cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.224+0000 7f86b24ad700 1 -- 172.21.15.72:0/4155612400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86ac131970 msgr2=0x7f86ac131df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.224+0000 7f86b24ad700 1 --2- 172.21.15.72:0/4155612400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86ac131970 0x7f86ac131df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.224+0000 7f86b24ad700 1 -- 172.21.15.72:0/4155612400 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac0a0760 con 0x7f86ac09c650 2023-10-03T10:14:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.224+0000 7f86b2cae700 1 --2- 172.21.15.72:0/4155612400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86ac131970 0x7f86ac131df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.224+0000 7f86b24ad700 1 --2- 172.21.15.72:0/4155612400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86ac09c650 0x7f86ac09ca20 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f86a80098f0 tx=0x7f86a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14999f3090e1c37 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.224+0000 7f86b14ab700 1 -- 172.21.15.72:0/4155612400 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8011830 con 0x7f86ac09c650 2023-10-03T10:14:07.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.224+0000 7f86b14ab700 1 -- 172.21.15.72:0/4155612400 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a8011990 con 0x7f86ac09c650 2023-10-03T10:14:07.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.224+0000 7f86b14ab700 1 -- 172.21.15.72:0/4155612400 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8011d20 con 0x7f86ac09c650 2023-10-03T10:14:07.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.225+0000 7f86b4711700 1 -- 172.21.15.72:0/4155612400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86ac09c650 msgr2=0x7f86ac09ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.225+0000 7f86b4711700 1 --2- 172.21.15.72:0/4155612400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86ac09c650 0x7f86ac09ca20 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f86a80098f0 tx=0x7f86a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:07.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.225+0000 7f86b4711700 1 -- 172.21.15.72:0/4155612400 shutdown_connections 2023-10-03T10:14:07.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.225+0000 7f86b4711700 1 --2- 172.21.15.72:0/4155612400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86ac131970 0x7f86ac131df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.225+0000 7f86b4711700 1 --2- 172.21.15.72:0/4155612400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86ac09c650 0x7f86ac09ca20 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.225+0000 7f86b4711700 1 --2- 172.21.15.72:0/4155612400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86ac0a0090 0x7f86ac09cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.225+0000 7f86b4711700 1 -- 172.21.15.72:0/4155612400 >> 172.21.15.72:0/4155612400 conn(0x7f86ac0a3f70 msgr2=0x7f86ac0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.225+0000 7f86b4711700 1 -- 172.21.15.72:0/4155612400 shutdown_connections 2023-10-03T10:14:07.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.225+0000 7f86b4711700 1 -- 172.21.15.72:0/4155612400 wait complete. 2023-10-03T10:14:07.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.226+0000 7f86b4711700 1 Processor -- start 2023-10-03T10:14:07.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.226+0000 7f86b4711700 1 -- start start 2023-10-03T10:14:07.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.226+0000 7f86b4711700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86ac09c650 0x7f86ac06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.226+0000 7f86b4711700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86ac0a0090 0x7f86ac06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.226+0000 7f86b4711700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86ac131970 0x7f86ac06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.226+0000 7f86b4711700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac11fa70 con 0x7f86ac09c650 2023-10-03T10:14:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.226+0000 7f86b4711700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac12d560 con 0x7f86ac0a0090 2023-10-03T10:14:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.226+0000 7f86b4711700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac09d9f0 con 0x7f86ac131970 2023-10-03T10:14:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86b24ad700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86ac09c650 0x7f86ac06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86b24ad700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86ac09c650 0x7f86ac06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59328/0 (socket says 172.21.15.72:59328) 2023-10-03T10:14:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86b24ad700 1 -- 172.21.15.72:0/1996352792 learned_addr learned my addr 172.21.15.72:0/1996352792 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86b2cae700 1 --2- 172.21.15.72:0/1996352792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86ac131970 0x7f86ac06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86b1cac700 1 --2- 172.21.15.72:0/1996352792 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86ac0a0090 0x7f86ac06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86b24ad700 1 -- 172.21.15.72:0/1996352792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86ac131970 msgr2=0x7f86ac06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86b24ad700 1 --2- 172.21.15.72:0/1996352792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86ac131970 0x7f86ac06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86b24ad700 1 -- 172.21.15.72:0/1996352792 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86ac0a0090 msgr2=0x7f86ac06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86b24ad700 1 --2- 172.21.15.72:0/1996352792 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86ac0a0090 0x7f86ac06bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86b24ad700 1 -- 172.21.15.72:0/1996352792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a4009a70 con 0x7f86ac09c650 2023-10-03T10:14:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86b2cae700 1 --2- 172.21.15.72:0/1996352792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86ac131970 0x7f86ac06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86b24ad700 1 --2- 172.21.15.72:0/1996352792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86ac09c650 0x7f86ac06b880 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009c40 tx=0x7f86a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86a2ffd700 1 -- 172.21.15.72:0/1996352792 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8004240 con 0x7f86ac09c650 2023-10-03T10:14:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86a2ffd700 1 -- 172.21.15.72:0/1996352792 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a801f070 con 0x7f86ac09c650 2023-10-03T10:14:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86a2ffd700 1 -- 172.21.15.72:0/1996352792 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a80045c0 con 0x7f86ac09c650 2023-10-03T10:14:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86b4711700 1 -- 172.21.15.72:0/1996352792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a8009550 con 0x7f86ac09c650 2023-10-03T10:14:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.227+0000 7f86b4711700 1 -- 172.21.15.72:0/1996352792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ac11f4b0 con 0x7f86ac09c650 2023-10-03T10:14:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.228+0000 7f86a2ffd700 1 -- 172.21.15.72:0/1996352792 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86a8021030 con 0x7f86ac09c650 2023-10-03T10:14:07.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.228+0000 7f86b4711700 1 -- 172.21.15.72:0/1996352792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ac0a3610 con 0x7f86ac09c650 2023-10-03T10:14:07.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.228+0000 7f86a2ffd700 1 -- 172.21.15.72:0/1996352792 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f86a8040830 con 0x7f86ac09c650 2023-10-03T10:14:07.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.233+0000 7f86a2ffd700 1 -- 172.21.15.72:0/1996352792 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86a80199a0 con 0x7f86ac09c650 2023-10-03T10:14:07.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.262+0000 7f56f3d0b700 1 Processor -- start 2023-10-03T10:14:07.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.263+0000 7f56f3d0b700 1 -- start start 2023-10-03T10:14:07.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.263+0000 7f56f3d0b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56ec0a0a30 0x7f56ec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.263+0000 7f56f3d0b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56ec09d630 0x7f56ec0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.263+0000 7f56f3d0b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56ec133930 0x7f56ec133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.263+0000 7f56f3d0b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ec0a2a70 con 0x7f56ec0a0a30 2023-10-03T10:14:07.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.263+0000 7f56f3d0b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0a01d0 con 0x7f56ec133930 2023-10-03T10:14:07.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.263+0000 7f56f3d0b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec09e2b0 con 0x7f56ec09d630 2023-10-03T10:14:07.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.263+0000 7f56f12a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56ec09d630 0x7f56ec0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.263+0000 7f56f12a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56ec09d630 0x7f56ec0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50972/0 (socket says 172.21.15.72:50972) 2023-10-03T10:14:07.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.263+0000 7f56f12a6700 1 -- 172.21.15.72:0/4049567873 learned_addr learned my addr 172.21.15.72:0/4049567873 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:07.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.263+0000 7f56f1aa7700 1 --2- 172.21.15.72:0/4049567873 >> v2:172.21.15.72:3300/0 conn(0x7f56ec0a0a30 0x7f56ec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.263+0000 7f56f22a8700 1 --2- 172.21.15.72:0/4049567873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56ec133930 0x7f56ec133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.263+0000 7f56f12a6700 1 -- 172.21.15.72:0/4049567873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56ec133930 msgr2=0x7f56ec133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.263+0000 7f56f12a6700 1 --2- 172.21.15.72:0/4049567873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56ec133930 0x7f56ec133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.264+0000 7f56f12a6700 1 -- 172.21.15.72:0/4049567873 >> v2:172.21.15.72:3300/0 conn(0x7f56ec0a0a30 msgr2=0x7f56ec0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.264+0000 7f56f12a6700 1 --2- 172.21.15.72:0/4049567873 >> v2:172.21.15.72:3300/0 conn(0x7f56ec0a0a30 0x7f56ec0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.264+0000 7f56f12a6700 1 -- 172.21.15.72:0/4049567873 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec09dc50 con 0x7f56ec09d630 2023-10-03T10:14:07.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.264+0000 7f56f1aa7700 1 --2- 172.21.15.72:0/4049567873 >> v2:172.21.15.72:3300/0 conn(0x7f56ec0a0a30 0x7f56ec0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:07.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.264+0000 7f56f12a6700 1 --2- 172.21.15.72:0/4049567873 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56ec09d630 0x7f56ec0a1340 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0098f0 tx=0x7f56dc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3dd2cfc2bf6ba87 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.264+0000 7f56f0aa5700 1 -- 172.21.15.72:0/4049567873 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc011830 con 0x7f56ec09d630 2023-10-03T10:14:07.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.264+0000 7f56f0aa5700 1 -- 172.21.15.72:0/4049567873 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc011990 con 0x7f56ec09d630 2023-10-03T10:14:07.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.264+0000 7f56f0aa5700 1 -- 172.21.15.72:0/4049567873 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc011d20 con 0x7f56ec09d630 2023-10-03T10:14:07.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.264+0000 7f56f3d0b700 1 -- 172.21.15.72:0/4049567873 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56ec09d630 msgr2=0x7f56ec0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.264+0000 7f56f3d0b700 1 --2- 172.21.15.72:0/4049567873 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56ec09d630 0x7f56ec0a1340 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0098f0 tx=0x7f56dc009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:07.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.264+0000 7f56f3d0b700 1 -- 172.21.15.72:0/4049567873 shutdown_connections 2023-10-03T10:14:07.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.264+0000 7f56f3d0b700 1 --2- 172.21.15.72:0/4049567873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56ec133930 0x7f56ec133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.264+0000 7f56f3d0b700 1 --2- 172.21.15.72:0/4049567873 >> v2:172.21.15.72:3300/0 conn(0x7f56ec0a0a30 0x7f56ec0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.264+0000 7f56f3d0b700 1 --2- 172.21.15.72:0/4049567873 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56ec09d630 0x7f56ec0a1340 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.264+0000 7f56f3d0b700 1 -- 172.21.15.72:0/4049567873 >> 172.21.15.72:0/4049567873 conn(0x7f56ec0a3050 msgr2=0x7f56ec0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.265+0000 7f56f3d0b700 1 -- 172.21.15.72:0/4049567873 shutdown_connections 2023-10-03T10:14:07.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.265+0000 7f56f3d0b700 1 -- 172.21.15.72:0/4049567873 wait complete. 2023-10-03T10:14:07.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.265+0000 7f56f3d0b700 1 Processor -- start 2023-10-03T10:14:07.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.265+0000 7f56f3d0b700 1 -- start start 2023-10-03T10:14:07.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f3d0b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56ec09d630 0x7f56ec11f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f3d0b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56ec0a0a30 0x7f56ec11f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f3d0b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56ec133930 0x7f56ec1c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f3d0b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec1204f0 con 0x7f56ec133930 2023-10-03T10:14:07.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f3d0b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec11fde0 con 0x7f56ec0a0a30 2023-10-03T10:14:07.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f3d0b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec133270 con 0x7f56ec09d630 2023-10-03T10:14:07.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f12a6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56ec0a0a30 0x7f56ec11f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f12a6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56ec0a0a30 0x7f56ec11f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43986/0 (socket says 172.21.15.72:43986) 2023-10-03T10:14:07.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f12a6700 1 -- 172.21.15.72:0/2399086820 learned_addr learned my addr 172.21.15.72:0/2399086820 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:07.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f22a8700 1 --2- 172.21.15.72:0/2399086820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56ec133930 0x7f56ec1c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f1aa7700 1 --2- 172.21.15.72:0/2399086820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56ec09d630 0x7f56ec11f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f12a6700 1 -- 172.21.15.72:0/2399086820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56ec09d630 msgr2=0x7f56ec11f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f12a6700 1 --2- 172.21.15.72:0/2399086820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56ec09d630 0x7f56ec11f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f12a6700 1 -- 172.21.15.72:0/2399086820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56ec133930 msgr2=0x7f56ec1c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f12a6700 1 --2- 172.21.15.72:0/2399086820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56ec133930 0x7f56ec1c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.266+0000 7f56f12a6700 1 -- 172.21.15.72:0/2399086820 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc009550 con 0x7f56ec0a0a30 2023-10-03T10:14:07.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.267+0000 7f56f22a8700 1 --2- 172.21.15.72:0/2399086820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56ec133930 0x7f56ec1c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.267+0000 7f56f12a6700 1 --2- 172.21.15.72:0/2399086820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56ec0a0a30 0x7f56ec11f8a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f56dc000c00 tx=0x7f56dc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.267+0000 7f56e27fc700 1 -- 172.21.15.72:0/2399086820 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc004510 con 0x7f56ec0a0a30 2023-10-03T10:14:07.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.267+0000 7f56e27fc700 1 -- 172.21.15.72:0/2399086820 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc0036a0 con 0x7f56ec0a0a30 2023-10-03T10:14:07.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.267+0000 7f56f3d0b700 1 -- 172.21.15.72:0/2399086820 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ec0a40c0 con 0x7f56ec0a0a30 2023-10-03T10:14:07.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.267+0000 7f56e27fc700 1 -- 172.21.15.72:0/2399086820 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc003a50 con 0x7f56ec0a0a30 2023-10-03T10:14:07.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.267+0000 7f56f3d0b700 1 -- 172.21.15.72:0/2399086820 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ec120ce0 con 0x7f56ec0a0a30 2023-10-03T10:14:07.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.268+0000 7f56e27fc700 1 -- 172.21.15.72:0/2399086820 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56dc021070 con 0x7f56ec0a0a30 2023-10-03T10:14:07.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.268+0000 7f56e27fc700 1 -- 172.21.15.72:0/2399086820 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f56dc0409d0 con 0x7f56ec0a0a30 2023-10-03T10:14:07.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.268+0000 7f56f3d0b700 1 -- 172.21.15.72:0/2399086820 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ec121dc0 con 0x7f56ec0a0a30 2023-10-03T10:14:07.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.277+0000 7f56e27fc700 1 -- 172.21.15.72:0/2399086820 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56ec121dc0 con 0x7f56ec0a0a30 2023-10-03T10:14:07.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.327+0000 7f289cd19700 1 -- 172.21.15.72:0/1043081840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2898072980 con 0x7f28980a0a30 2023-10-03T10:14:07.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.327+0000 7f2886ffd700 1 -- 172.21.15.72:0/1043081840 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f288c019a70 con 0x7f28980a0a30 2023-10-03T10:14:07.327 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:07.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.329+0000 7f289cd19700 1 -- 172.21.15.72:0/1043081840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28980a0a30 msgr2=0x7f289811d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.329+0000 7f289cd19700 1 --2- 172.21.15.72:0/1043081840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28980a0a30 0x7f289811d900 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f288c00c4b0 tx=0x7f288c00c7c0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.329+0000 7f289cd19700 1 -- 172.21.15.72:0/1043081840 shutdown_connections 2023-10-03T10:14:07.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.329+0000 7f289cd19700 1 --2- 172.21.15.72:0/1043081840 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2898138d80 0x7f289811de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.329+0000 7f289cd19700 1 --2- 172.21.15.72:0/1043081840 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f289809d630 0x7f289811d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.329+0000 7f289cd19700 1 --2- 172.21.15.72:0/1043081840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28980a0a30 0x7f289811d900 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.329+0000 7f289cd19700 1 -- 172.21.15.72:0/1043081840 >> 172.21.15.72:0/1043081840 conn(0x7f28980a3050 msgr2=0x7f28980a5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.329+0000 7f289cd19700 1 -- 172.21.15.72:0/1043081840 shutdown_connections 2023-10-03T10:14:07.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.329+0000 7f289cd19700 1 -- 172.21.15.72:0/1043081840 wait complete. 2023-10-03T10:14:07.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:07.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.427+0000 7f86b4711700 1 -- 172.21.15.72:0/1996352792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f86ac0747f0 con 0x7f86ac09c650 2023-10-03T10:14:07.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.427+0000 7f86a2ffd700 1 -- 172.21.15.72:0/1996352792 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86a8015030 con 0x7f86ac09c650 2023-10-03T10:14:07.427 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:07.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.429+0000 7f86b4711700 1 -- 172.21.15.72:0/1996352792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86ac09c650 msgr2=0x7f86ac06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.429+0000 7f86b4711700 1 --2- 172.21.15.72:0/1996352792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86ac09c650 0x7f86ac06b880 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009c40 tx=0x7f86a8004750 comp rx=0 tx=0).stop 2023-10-03T10:14:07.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.429+0000 7f86b4711700 1 -- 172.21.15.72:0/1996352792 shutdown_connections 2023-10-03T10:14:07.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.429+0000 7f86b4711700 1 --2- 172.21.15.72:0/1996352792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86ac09c650 0x7f86ac06b880 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.429+0000 7f86b4711700 1 --2- 172.21.15.72:0/1996352792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86ac131970 0x7f86ac06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.429+0000 7f86b4711700 1 --2- 172.21.15.72:0/1996352792 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86ac0a0090 0x7f86ac06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.429+0000 7f86b4711700 1 -- 172.21.15.72:0/1996352792 >> 172.21.15.72:0/1996352792 conn(0x7f86ac0a3f70 msgr2=0x7f86ac12ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.429+0000 7f86b4711700 1 -- 172.21.15.72:0/1996352792 shutdown_connections 2023-10-03T10:14:07.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.429+0000 7f86b4711700 1 -- 172.21.15.72:0/1996352792 wait complete. 2023-10-03T10:14:07.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:07.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.472+0000 7f56f3d0b700 1 -- 172.21.15.72:0/2399086820 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f56ec121dc0 con 0x7f56ec0a0a30 2023-10-03T10:14:07.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.472+0000 7f56e27fc700 1 -- 172.21.15.72:0/2399086820 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f56dc015020 con 0x7f56ec0a0a30 2023-10-03T10:14:07.472 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.474+0000 7f56f3d0b700 1 -- 172.21.15.72:0/2399086820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56ec0a0a30 msgr2=0x7f56ec11f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.474+0000 7f56f3d0b700 1 --2- 172.21.15.72:0/2399086820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56ec0a0a30 0x7f56ec11f8a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f56dc000c00 tx=0x7f56dc004750 comp rx=0 tx=0).stop 2023-10-03T10:14:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.474+0000 7f56f3d0b700 1 -- 172.21.15.72:0/2399086820 shutdown_connections 2023-10-03T10:14:07.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.474+0000 7f56f3d0b700 1 --2- 172.21.15.72:0/2399086820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56ec133930 0x7f56ec1c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.474+0000 7f56f3d0b700 1 --2- 172.21.15.72:0/2399086820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56ec09d630 0x7f56ec11f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.474+0000 7f56f3d0b700 1 --2- 172.21.15.72:0/2399086820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56ec0a0a30 0x7f56ec11f8a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.474+0000 7f56f3d0b700 1 -- 172.21.15.72:0/2399086820 >> 172.21.15.72:0/2399086820 conn(0x7f56ec0a3050 msgr2=0x7f56ec09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.474+0000 7f56f3d0b700 1 -- 172.21.15.72:0/2399086820 shutdown_connections 2023-10-03T10:14:07.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:07.474+0000 7f56f3d0b700 1 -- 172.21.15.72:0/2399086820 wait complete. 2023-10-03T10:14:07.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:08.187 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.313+0000 7fcd18a75700 1 Processor -- start 2023-10-03T10:14:08.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.313+0000 7fcd18a75700 1 -- start start 2023-10-03T10:14:08.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.313+0000 7fcd18a75700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd1409e1d0 0x7fcd14138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.313+0000 7fcd18a75700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd14139170 0x7fcd1413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.313+0000 7fcd18a75700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1409b120 con 0x7fcd1409d6f0 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.313+0000 7fcd18a75700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1406b460 con 0x7fcd1409e1d0 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.313+0000 7fcd18a75700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1409a7e0 con 0x7fcd14139170 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.314+0000 7fcd11d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd1409e1d0 0x7fcd14138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.314+0000 7fcd12d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd14139170 0x7fcd1413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.314+0000 7fcd12d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd14139170 0x7fcd1413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60174/0 (socket says 172.21.15.72:60174) 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.314+0000 7fcd11d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd1409e1d0 0x7fcd14138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35392/0 (socket says 172.21.15.72:35392) 2023-10-03T10:14:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.314+0000 7fcd12d9d700 1 -- 172.21.15.72:0/1096681162 learned_addr learned my addr 172.21.15.72:0/1096681162 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.314+0000 7fcd11d9b700 1 -- 172.21.15.72:0/1096681162 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd14139170 msgr2=0x7fcd1413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.314+0000 7fcd11d9b700 1 --2- 172.21.15.72:0/1096681162 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd14139170 0x7fcd1413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.314+0000 7fcd11d9b700 1 -- 172.21.15.72:0/1096681162 >> v1:172.21.15.72:6789/0 conn(0x7fcd1409d6f0 legacy=0x7fcd1409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.314+0000 7fcd11d9b700 1 -- 172.21.15.72:0/1096681162 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1409a500 con 0x7fcd1409e1d0 2023-10-03T10:14:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.314+0000 7fcd12d9d700 1 --2- 172.21.15.72:0/1096681162 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd14139170 0x7fcd1413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.314+0000 7fcd11d9b700 1 --2- 172.21.15.72:0/1096681162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd1409e1d0 0x7fcd14138c30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009870 tx=0x7fcd08009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88abf1fb7e89fcef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.314+0000 7fcd1159a700 1 -- 172.21.15.72:0/1096681162 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08011830 con 0x7fcd1409e1d0 2023-10-03T10:14:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.314+0000 7fcd1159a700 1 -- 172.21.15.72:0/1096681162 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd08011990 con 0x7fcd1409e1d0 2023-10-03T10:14:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.314+0000 7fcd1159a700 1 -- 172.21.15.72:0/1096681162 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08011d20 con 0x7fcd1409e1d0 2023-10-03T10:14:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.315+0000 7fcd18a75700 1 -- 172.21.15.72:0/1096681162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd1409e1d0 msgr2=0x7fcd14138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.315+0000 7fcd18a75700 1 --2- 172.21.15.72:0/1096681162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd1409e1d0 0x7fcd14138c30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009870 tx=0x7fcd08009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.315+0000 7fcd18a75700 1 -- 172.21.15.72:0/1096681162 shutdown_connections 2023-10-03T10:14:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.315+0000 7fcd18a75700 1 --2- 172.21.15.72:0/1096681162 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd14139170 0x7fcd1413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.315+0000 7fcd18a75700 1 --2- 172.21.15.72:0/1096681162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd1409e1d0 0x7fcd14138c30 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.315+0000 7fcd18a75700 1 -- 172.21.15.72:0/1096681162 >> 172.21.15.72:0/1096681162 conn(0x7fcd14066f50 msgr2=0x7fcd1409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.315+0000 7fcd18a75700 1 -- 172.21.15.72:0/1096681162 shutdown_connections 2023-10-03T10:14:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.315+0000 7fcd18a75700 1 -- 172.21.15.72:0/1096681162 wait complete. 2023-10-03T10:14:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.316+0000 7fcd18a75700 1 Processor -- start 2023-10-03T10:14:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.316+0000 7fcd18a75700 1 -- start start 2023-10-03T10:14:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd18a75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd1409d6f0 0x7fcd141c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd18a75700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd1409e1d0 0x7fcd141c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd18a75700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd14139170 0x7fcd1411e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd18a75700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd14121d90 con 0x7fcd1409e1d0 2023-10-03T10:14:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd18a75700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140a1a80 con 0x7fcd1409d6f0 2023-10-03T10:14:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd18a75700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd141be2f0 con 0x7fcd14139170 2023-10-03T10:14:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd1259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd1409d6f0 0x7fcd141c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd12d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd14139170 0x7fcd1411e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd12d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd14139170 0x7fcd1411e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60190/0 (socket says 172.21.15.72:60190) 2023-10-03T10:14:08.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd1259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd1409d6f0 0x7fcd141c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54288/0 (socket says 172.21.15.72:54288) 2023-10-03T10:14:08.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd12d9d700 1 -- 172.21.15.72:0/1445332185 learned_addr learned my addr 172.21.15.72:0/1445332185 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:08.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd11d9b700 1 --2- 172.21.15.72:0/1445332185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd1409e1d0 0x7fcd141c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd12d9d700 1 -- 172.21.15.72:0/1445332185 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd1409d6f0 msgr2=0x7fcd141c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd12d9d700 1 --2- 172.21.15.72:0/1445332185 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd1409d6f0 0x7fcd141c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd12d9d700 1 -- 172.21.15.72:0/1445332185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd1409e1d0 msgr2=0x7fcd141c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd12d9d700 1 --2- 172.21.15.72:0/1445332185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd1409e1d0 0x7fcd141c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd12d9d700 1 -- 172.21.15.72:0/1445332185 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c009b30 con 0x7fcd14139170 2023-10-03T10:14:08.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.317+0000 7fcd11d9b700 1 --2- 172.21.15.72:0/1445332185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd1409e1d0 0x7fcd141c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.318+0000 7fcd12d9d700 1 --2- 172.21.15.72:0/1445332185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd14139170 0x7fcd1411e8a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00efc0 tx=0x7fcd0c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.318+0000 7fcd02ffd700 1 -- 172.21.15.72:0/1445332185 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00ca80 con 0x7fcd14139170 2023-10-03T10:14:08.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.318+0000 7fcd02ffd700 1 -- 172.21.15.72:0/1445332185 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c00f040 con 0x7fcd14139170 2023-10-03T10:14:08.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.318+0000 7fcd18a75700 1 -- 172.21.15.72:0/1445332185 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd080094a0 con 0x7fcd14139170 2023-10-03T10:14:08.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.318+0000 7fcd02ffd700 1 -- 172.21.15.72:0/1445332185 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00ce20 con 0x7fcd14139170 2023-10-03T10:14:08.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.318+0000 7fcd18a75700 1 -- 172.21.15.72:0/1445332185 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1409c710 con 0x7fcd14139170 2023-10-03T10:14:08.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.318+0000 7fcd02ffd700 1 -- 172.21.15.72:0/1445332185 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd0c014480 con 0x7fcd14139170 2023-10-03T10:14:08.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.318+0000 7fcd02ffd700 1 -- 172.21.15.72:0/1445332185 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd0c03fbc0 con 0x7fcd14139170 2023-10-03T10:14:08.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.319+0000 7fcd18a75700 1 -- 172.21.15.72:0/1445332185 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd14074ea0 con 0x7fcd14139170 2023-10-03T10:14:08.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.323+0000 7fcd02ffd700 1 -- 172.21.15.72:0/1445332185 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd0c014910 con 0x7fcd14139170 2023-10-03T10:14:08.343 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:08.441 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:08.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.469+0000 7ff414d78700 1 Processor -- start 2023-10-03T10:14:08.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.469+0000 7ff414d78700 1 -- start start 2023-10-03T10:14:08.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff414d78700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff41006f5d0 0x7ff41012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff414d78700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff410135c20 0x7ff410138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff414d78700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41006fa40 con 0x7ff41012cf60 2023-10-03T10:14:08.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff414d78700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41012cd90 con 0x7ff410135c20 2023-10-03T10:14:08.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff414d78700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff410071780 con 0x7ff41006f5d0 2023-10-03T10:14:08.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff40dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff41006f5d0 0x7ff41012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff40e59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff41012cf60 0x7ff41012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48036/0 (socket says 172.21.15.72:48036) 2023-10-03T10:14:08.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff40dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff41006f5d0 0x7ff41012ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60192/0 (socket says 172.21.15.72:60192) 2023-10-03T10:14:08.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff40e59c700 1 -- 172.21.15.72:0/2971624200 learned_addr learned my addr 172.21.15.72:0/2971624200 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:08.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff40ed9d700 1 --2- 172.21.15.72:0/2971624200 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff410135c20 0x7ff410138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff40dd9b700 1 -- 172.21.15.72:0/2971624200 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff410135c20 msgr2=0x7ff410138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:08.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff40dd9b700 1 --2- 172.21.15.72:0/2971624200 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff410135c20 0x7ff410138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff40d59a700 1 -- 172.21.15.72:0/2971624200 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689211456 0 0) 0x7ff41006fa40 con 0x7ff41012cf60 2023-10-03T10:14:08.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff40dd9b700 1 -- 172.21.15.72:0/2971624200 >> v1:172.21.15.72:6789/0 conn(0x7ff41012cf60 legacy=0x7ff41012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff40dd9b700 1 -- 172.21.15.72:0/2971624200 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff410071a40 con 0x7ff41006f5d0 2023-10-03T10:14:08.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.470+0000 7ff40ed9d700 1 --2- 172.21.15.72:0/2971624200 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff410135c20 0x7ff410138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.471+0000 7ff40dd9b700 1 --2- 172.21.15.72:0/2971624200 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff41006f5d0 0x7ff41012ffc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff4040098a0 tx=0x7ff404009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e00b96ccb187f490 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.471+0000 7ff40d59a700 1 -- 172.21.15.72:0/2971624200 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404011830 con 0x7ff41006f5d0 2023-10-03T10:14:08.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.471+0000 7ff40d59a700 1 -- 172.21.15.72:0/2971624200 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff404011990 con 0x7ff41006f5d0 2023-10-03T10:14:08.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.471+0000 7ff40d59a700 1 -- 172.21.15.72:0/2971624200 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404011d20 con 0x7ff41006f5d0 2023-10-03T10:14:08.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.471+0000 7ff414d78700 1 -- 172.21.15.72:0/2971624200 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff41006f5d0 msgr2=0x7ff41012ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.471+0000 7ff414d78700 1 --2- 172.21.15.72:0/2971624200 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff41006f5d0 0x7ff41012ffc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff4040098a0 tx=0x7ff404009bb0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.472+0000 7ff414d78700 1 -- 172.21.15.72:0/2971624200 shutdown_connections 2023-10-03T10:14:08.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.472+0000 7ff414d78700 1 --2- 172.21.15.72:0/2971624200 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff410135c20 0x7ff410138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.472+0000 7ff414d78700 1 --2- 172.21.15.72:0/2971624200 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff41006f5d0 0x7ff41012ffc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.472+0000 7ff414d78700 1 -- 172.21.15.72:0/2971624200 >> 172.21.15.72:0/2971624200 conn(0x7ff4100a2aa0 msgr2=0x7ff4100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.472+0000 7ff414d78700 1 -- 172.21.15.72:0/2971624200 shutdown_connections 2023-10-03T10:14:08.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.472+0000 7ff414d78700 1 -- 172.21.15.72:0/2971624200 wait complete. 2023-10-03T10:14:08.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.473+0000 7ff414d78700 1 Processor -- start 2023-10-03T10:14:08.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.473+0000 7ff414d78700 1 -- start start 2023-10-03T10:14:08.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.473+0000 7ff414d78700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41006f5d0 0x7ff41009c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.473+0000 7ff414d78700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff41012cf60 0x7ff41009cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.473+0000 7ff414d78700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff410135c20 0x7ff41009d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.473+0000 7ff414d78700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff410135610 con 0x7ff41006f5d0 2023-10-03T10:14:08.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.473+0000 7ff414d78700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff410129fa0 con 0x7ff410135c20 2023-10-03T10:14:08.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.473+0000 7ff414d78700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff41009de20 con 0x7ff41012cf60 2023-10-03T10:14:08.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.473+0000 7ff40e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41006f5d0 0x7ff41009c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.473+0000 7ff40dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff41012cf60 0x7ff41009cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.473+0000 7ff40dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff41012cf60 0x7ff41009cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60208/0 (socket says 172.21.15.72:60208) 2023-10-03T10:14:08.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.473+0000 7ff40dd9b700 1 -- 172.21.15.72:0/3585522175 learned_addr learned my addr 172.21.15.72:0/3585522175 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:08.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.473+0000 7ff40e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41006f5d0 0x7ff41009c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35404/0 (socket says 172.21.15.72:35404) 2023-10-03T10:14:08.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.473+0000 7ff40ed9d700 1 --2- 172.21.15.72:0/3585522175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff410135c20 0x7ff41009d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.474+0000 7ff40ed9d700 1 -- 172.21.15.72:0/3585522175 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff41012cf60 msgr2=0x7ff41009cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.474+0000 7ff40ed9d700 1 --2- 172.21.15.72:0/3585522175 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff41012cf60 0x7ff41009cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.474+0000 7ff40ed9d700 1 -- 172.21.15.72:0/3585522175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41006f5d0 msgr2=0x7ff41009c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.474+0000 7ff40ed9d700 1 --2- 172.21.15.72:0/3585522175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41006f5d0 0x7ff41009c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.474+0000 7ff40ed9d700 1 -- 172.21.15.72:0/3585522175 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff408009a70 con 0x7ff410135c20 2023-10-03T10:14:08.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.474+0000 7ff40e59c700 1 --2- 172.21.15.72:0/3585522175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41006f5d0 0x7ff41009c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.474+0000 7ff40dd9b700 1 --2- 172.21.15.72:0/3585522175 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff41012cf60 0x7ff41009cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.474+0000 7ff40ed9d700 1 --2- 172.21.15.72:0/3585522175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff410135c20 0x7ff41009d460 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff410072e70 tx=0x7ff40800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.474+0000 7ff3feffd700 1 -- 172.21.15.72:0/3585522175 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408003a20 con 0x7ff410135c20 2023-10-03T10:14:08.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.474+0000 7ff3feffd700 1 -- 172.21.15.72:0/3585522175 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40800f040 con 0x7ff410135c20 2023-10-03T10:14:08.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.474+0000 7ff414d78700 1 -- 172.21.15.72:0/3585522175 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4040094a0 con 0x7ff410135c20 2023-10-03T10:14:08.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.474+0000 7ff3feffd700 1 -- 172.21.15.72:0/3585522175 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408003dc0 con 0x7ff410135c20 2023-10-03T10:14:08.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.474+0000 7ff414d78700 1 -- 172.21.15.72:0/3585522175 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4100a0f00 con 0x7ff410135c20 2023-10-03T10:14:08.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.475+0000 7ff3feffd700 1 -- 172.21.15.72:0/3585522175 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff40800ca20 con 0x7ff410135c20 2023-10-03T10:14:08.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.475+0000 7ff3feffd700 1 -- 172.21.15.72:0/3585522175 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff40803fe10 con 0x7ff410135c20 2023-10-03T10:14:08.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.475+0000 7ff414d78700 1 -- 172.21.15.72:0/3585522175 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41012e870 con 0x7ff410135c20 2023-10-03T10:14:08.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.484+0000 7ff3feffd700 1 -- 172.21.15.72:0/3585522175 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff41012e870 con 0x7ff410135c20 2023-10-03T10:14:08.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:08.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.526+0000 7fcd18a75700 1 -- 172.21.15.72:0/1445332185 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcd1409f420 con 0x7fcd14139170 2023-10-03T10:14:08.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.526+0000 7fcd02ffd700 1 -- 172.21.15.72:0/1445332185 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd0c012340 con 0x7fcd14139170 2023-10-03T10:14:08.526 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:08.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.530+0000 7fcd18a75700 1 -- 172.21.15.72:0/1445332185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd14139170 msgr2=0x7fcd1411e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.530+0000 7fcd18a75700 1 --2- 172.21.15.72:0/1445332185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd14139170 0x7fcd1411e8a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00efc0 tx=0x7fcd0c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.530+0000 7fcd18a75700 1 -- 172.21.15.72:0/1445332185 shutdown_connections 2023-10-03T10:14:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.530+0000 7fcd18a75700 1 --2- 172.21.15.72:0/1445332185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd14139170 0x7fcd1411e8a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.530+0000 7fcd18a75700 1 --2- 172.21.15.72:0/1445332185 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd1409d6f0 0x7fcd141c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.530+0000 7fcd18a75700 1 --2- 172.21.15.72:0/1445332185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd1409e1d0 0x7fcd141c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.530+0000 7fcd18a75700 1 -- 172.21.15.72:0/1445332185 >> 172.21.15.72:0/1445332185 conn(0x7fcd14066f50 msgr2=0x7fcd1409b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.530+0000 7fcd18a75700 1 -- 172.21.15.72:0/1445332185 shutdown_connections 2023-10-03T10:14:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.530+0000 7fcd18a75700 1 -- 172.21.15.72:0/1445332185 wait complete. 2023-10-03T10:14:08.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:08.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.573+0000 7faebfbee700 1 Processor -- start 2023-10-03T10:14:08.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.573+0000 7faebfbee700 1 -- start start 2023-10-03T10:14:08.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.573+0000 7faebfbee700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faeb809c650 0x7faeb809ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.573+0000 7faebfbee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faeb80a0090 0x7faeb809cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.573+0000 7faebfbee700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faeb8131970 0x7faeb8131e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.573+0000 7faebfbee700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb809ba70 con 0x7faeb8131970 2023-10-03T10:14:08.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.573+0000 7faebfbee700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb809d4a0 con 0x7faeb80a0090 2023-10-03T10:14:08.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.573+0000 7faebfbee700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faeb809e8f0 con 0x7faeb809c650 2023-10-03T10:14:08.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebd189700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faeb80a0090 0x7faeb809cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebd98a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faeb809c650 0x7faeb809ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebd189700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faeb80a0090 0x7faeb809cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54310/0 (socket says 172.21.15.72:54310) 2023-10-03T10:14:08.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebd189700 1 -- 172.21.15.72:0/1793960190 learned_addr learned my addr 172.21.15.72:0/1793960190 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:08.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebe18b700 1 --2- 172.21.15.72:0/1793960190 >> v2:172.21.15.72:3300/0 conn(0x7faeb8131970 0x7faeb8131e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebd189700 1 -- 172.21.15.72:0/1793960190 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faeb809c650 msgr2=0x7faeb809ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:08.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebd189700 1 --2- 172.21.15.72:0/1793960190 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faeb809c650 0x7faeb809ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebd189700 1 -- 172.21.15.72:0/1793960190 >> v2:172.21.15.72:3300/0 conn(0x7faeb8131970 msgr2=0x7faeb8131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:08.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebd189700 1 --2- 172.21.15.72:0/1793960190 >> v2:172.21.15.72:3300/0 conn(0x7faeb8131970 0x7faeb8131e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebd189700 1 -- 172.21.15.72:0/1793960190 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80a0760 con 0x7faeb80a0090 2023-10-03T10:14:08.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebd98a700 1 --2- 172.21.15.72:0/1793960190 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faeb809c650 0x7faeb809ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebe18b700 1 --2- 172.21.15.72:0/1793960190 >> v2:172.21.15.72:3300/0 conn(0x7faeb8131970 0x7faeb8131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebd189700 1 --2- 172.21.15.72:0/1793960190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faeb80a0090 0x7faeb809cf60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faea8009920 tx=0x7faea8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49be166b966ccfd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebc988700 1 -- 172.21.15.72:0/1793960190 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8011830 con 0x7faeb80a0090 2023-10-03T10:14:08.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebc988700 1 -- 172.21.15.72:0/1793960190 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea8011990 con 0x7faeb80a0090 2023-10-03T10:14:08.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.574+0000 7faebc988700 1 -- 172.21.15.72:0/1793960190 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8011d20 con 0x7faeb80a0090 2023-10-03T10:14:08.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.575+0000 7faebfbee700 1 -- 172.21.15.72:0/1793960190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faeb80a0090 msgr2=0x7faeb809cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.575+0000 7faebfbee700 1 --2- 172.21.15.72:0/1793960190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faeb80a0090 0x7faeb809cf60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faea8009920 tx=0x7faea8009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:08.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.575+0000 7faebfbee700 1 -- 172.21.15.72:0/1793960190 shutdown_connections 2023-10-03T10:14:08.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.575+0000 7faebfbee700 1 --2- 172.21.15.72:0/1793960190 >> v2:172.21.15.72:3300/0 conn(0x7faeb8131970 0x7faeb8131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.575+0000 7faebfbee700 1 --2- 172.21.15.72:0/1793960190 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faeb809c650 0x7faeb809ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.575+0000 7faebfbee700 1 --2- 172.21.15.72:0/1793960190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faeb80a0090 0x7faeb809cf60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.575+0000 7faebfbee700 1 -- 172.21.15.72:0/1793960190 >> 172.21.15.72:0/1793960190 conn(0x7faeb80a3f70 msgr2=0x7faeb80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.575+0000 7faebfbee700 1 -- 172.21.15.72:0/1793960190 shutdown_connections 2023-10-03T10:14:08.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.575+0000 7faebfbee700 1 -- 172.21.15.72:0/1793960190 wait complete. 2023-10-03T10:14:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.576+0000 7faebfbee700 1 Processor -- start 2023-10-03T10:14:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.576+0000 7faebfbee700 1 -- start start 2023-10-03T10:14:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.576+0000 7faebfbee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faeb809c650 0x7faeb806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.576+0000 7faebfbee700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faeb80a0090 0x7faeb806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.576+0000 7faebfbee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faeb8131970 0x7faeb806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.576+0000 7faebfbee700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb8122980 con 0x7faeb809c650 2023-10-03T10:14:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.576+0000 7faebfbee700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb8122740 con 0x7faeb8131970 2023-10-03T10:14:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.576+0000 7faebfbee700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faeb8121870 con 0x7faeb80a0090 2023-10-03T10:14:08.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.576+0000 7faebd98a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faeb809c650 0x7faeb806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.576+0000 7faebe18b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faeb8131970 0x7faeb806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.576+0000 7faebd98a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faeb809c650 0x7faeb806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35424/0 (socket says 172.21.15.72:35424) 2023-10-03T10:14:08.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.576+0000 7faebe18b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faeb8131970 0x7faeb806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54318/0 (socket says 172.21.15.72:54318) 2023-10-03T10:14:08.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.576+0000 7faebd98a700 1 -- 172.21.15.72:0/173464659 learned_addr learned my addr 172.21.15.72:0/173464659 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:08.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.577+0000 7faebd189700 1 --2- 172.21.15.72:0/173464659 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faeb80a0090 0x7faeb806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.577+0000 7faebd98a700 1 -- 172.21.15.72:0/173464659 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faeb80a0090 msgr2=0x7faeb806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.577+0000 7faebd98a700 1 --2- 172.21.15.72:0/173464659 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faeb80a0090 0x7faeb806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.577+0000 7faebd98a700 1 -- 172.21.15.72:0/173464659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faeb8131970 msgr2=0x7faeb806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.577+0000 7faebd98a700 1 --2- 172.21.15.72:0/173464659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faeb8131970 0x7faeb806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.577+0000 7faebd98a700 1 -- 172.21.15.72:0/173464659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb40094a0 con 0x7faeb809c650 2023-10-03T10:14:08.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.577+0000 7faebe18b700 1 --2- 172.21.15.72:0/173464659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faeb8131970 0x7faeb806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.577+0000 7faebd98a700 1 --2- 172.21.15.72:0/173464659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faeb809c650 0x7faeb806b8b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7faeb400ebe0 tx=0x7faeb400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.577+0000 7faeae7fc700 1 -- 172.21.15.72:0/173464659 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4009800 con 0x7faeb809c650 2023-10-03T10:14:08.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.577+0000 7faeae7fc700 1 -- 172.21.15.72:0/173464659 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb400c850 con 0x7faeb809c650 2023-10-03T10:14:08.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.577+0000 7faebfbee700 1 -- 172.21.15.72:0/173464659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb0009a70 con 0x7faeb809c650 2023-10-03T10:14:08.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.577+0000 7faeae7fc700 1 -- 172.21.15.72:0/173464659 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb400cbc0 con 0x7faeb809c650 2023-10-03T10:14:08.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.577+0000 7faebfbee700 1 -- 172.21.15.72:0/173464659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea8009550 con 0x7faeb809c650 2023-10-03T10:14:08.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.578+0000 7faeae7fc700 1 -- 172.21.15.72:0/173464659 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faeb400cd20 con 0x7faeb809c650 2023-10-03T10:14:08.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.578+0000 7faebfbee700 1 -- 172.21.15.72:0/173464659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb809d9e0 con 0x7faeb809c650 2023-10-03T10:14:08.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.580+0000 7faeae7fc700 1 -- 172.21.15.72:0/173464659 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faeb401acf0 con 0x7faeb809c650 2023-10-03T10:14:08.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.585+0000 7faeae7fc700 1 -- 172.21.15.72:0/173464659 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faeb4021020 con 0x7faeb809c650 2023-10-03T10:14:08.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.621+0000 7fcb9c1eb700 1 Processor -- start 2023-10-03T10:14:08.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.621+0000 7fcb9c1eb700 1 -- start start 2023-10-03T10:14:08.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.621+0000 7fcb9c1eb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb941338a0 0x7fcb94133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.621+0000 7fcb9c1eb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9409e930 0x7fcb9413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.622+0000 7fcb9c1eb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9406ef30 con 0x7fcb9409de50 2023-10-03T10:14:08.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.622+0000 7fcb9c1eb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9406fef0 con 0x7fcb941338a0 2023-10-03T10:14:08.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.622+0000 7fcb9c1eb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb941334b0 con 0x7fcb9409e930 2023-10-03T10:14:08.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.622+0000 7fcb99786700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcb9409de50 0x7fcb9409e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48038/0 (socket says 172.21.15.72:48038) 2023-10-03T10:14:08.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.622+0000 7fcb9a788700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9409e930 0x7fcb9413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.622+0000 7fcb99786700 1 -- 172.21.15.72:0/647104767 learned_addr learned my addr 172.21.15.72:0/647104767 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.622+0000 7fcb99f87700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb941338a0 0x7fcb94133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.622+0000 7fcb99f87700 1 -- 172.21.15.72:0/647104767 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9409e930 msgr2=0x7fcb9413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.622+0000 7fcb99f87700 1 --2- 172.21.15.72:0/647104767 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9409e930 0x7fcb9413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.622+0000 7fcb99f87700 1 -- 172.21.15.72:0/647104767 >> v1:172.21.15.72:6789/0 conn(0x7fcb9409de50 legacy=0x7fcb9409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.622+0000 7fcb99f87700 1 -- 172.21.15.72:0/647104767 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9406fc30 con 0x7fcb941338a0 2023-10-03T10:14:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.622+0000 7fcb99f87700 1 --2- 172.21.15.72:0/647104767 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb941338a0 0x7fcb94133c70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009870 tx=0x7fcb90009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f7be8ac81e2efe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.622+0000 7fcb98f85700 1 -- 172.21.15.72:0/647104767 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90011830 con 0x7fcb941338a0 2023-10-03T10:14:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.622+0000 7fcb98f85700 1 -- 172.21.15.72:0/647104767 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb90011990 con 0x7fcb941338a0 2023-10-03T10:14:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.622+0000 7fcb98f85700 1 -- 172.21.15.72:0/647104767 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90011d20 con 0x7fcb941338a0 2023-10-03T10:14:08.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.623+0000 7fcb9c1eb700 1 -- 172.21.15.72:0/647104767 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb941338a0 msgr2=0x7fcb94133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.623+0000 7fcb9c1eb700 1 --2- 172.21.15.72:0/647104767 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb941338a0 0x7fcb94133c70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009870 tx=0x7fcb90009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:08.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.623+0000 7fcb9c1eb700 1 -- 172.21.15.72:0/647104767 shutdown_connections 2023-10-03T10:14:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.623+0000 7fcb9c1eb700 1 --2- 172.21.15.72:0/647104767 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9409e930 0x7fcb9413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.623+0000 7fcb9c1eb700 1 --2- 172.21.15.72:0/647104767 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb941338a0 0x7fcb94133c70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.623+0000 7fcb9c1eb700 1 -- 172.21.15.72:0/647104767 >> 172.21.15.72:0/647104767 conn(0x7fcb940a2aa0 msgr2=0x7fcb940a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.623+0000 7fcb9c1eb700 1 -- 172.21.15.72:0/647104767 shutdown_connections 2023-10-03T10:14:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.623+0000 7fcb9c1eb700 1 -- 172.21.15.72:0/647104767 wait complete. 2023-10-03T10:14:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.624+0000 7fcb9c1eb700 1 Processor -- start 2023-10-03T10:14:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.624+0000 7fcb9c1eb700 1 -- start start 2023-10-03T10:14:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb9c1eb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9409de50 0x7fcb9411eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb9c1eb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9409e930 0x7fcb9411f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb9c1eb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb941338a0 0x7fcb9411f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb9c1eb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9406f640 con 0x7fcb9409de50 2023-10-03T10:14:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb9c1eb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94122260 con 0x7fcb941338a0 2023-10-03T10:14:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb9c1eb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940a1060 con 0x7fcb9409e930 2023-10-03T10:14:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb99f87700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9409de50 0x7fcb9411eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb99786700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9409e930 0x7fcb9411f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb99f87700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9409de50 0x7fcb9411eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35426/0 (socket says 172.21.15.72:35426) 2023-10-03T10:14:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb99f87700 1 -- 172.21.15.72:0/3217076996 learned_addr learned my addr 172.21.15.72:0/3217076996 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb9a788700 1 --2- 172.21.15.72:0/3217076996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb941338a0 0x7fcb9411f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb99f87700 1 -- 172.21.15.72:0/3217076996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9409e930 msgr2=0x7fcb9411f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb99f87700 1 --2- 172.21.15.72:0/3217076996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9409e930 0x7fcb9411f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb99f87700 1 -- 172.21.15.72:0/3217076996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb941338a0 msgr2=0x7fcb9411f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb99f87700 1 --2- 172.21.15.72:0/3217076996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb941338a0 0x7fcb9411f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.625+0000 7fcb99f87700 1 -- 172.21.15.72:0/3217076996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb900094a0 con 0x7fcb9409de50 2023-10-03T10:14:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.626+0000 7fcb99f87700 1 --2- 172.21.15.72:0/3217076996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9409de50 0x7fcb9411eac0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009bc0 tx=0x7fcb90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.626+0000 7fcb8a7fc700 1 -- 172.21.15.72:0/3217076996 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90004510 con 0x7fcb9409de50 2023-10-03T10:14:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.626+0000 7fcb8a7fc700 1 -- 172.21.15.72:0/3217076996 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb900036a0 con 0x7fcb9409de50 2023-10-03T10:14:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.626+0000 7fcb9c1eb700 1 -- 172.21.15.72:0/3217076996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb94120e90 con 0x7fcb9409de50 2023-10-03T10:14:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.626+0000 7fcb8a7fc700 1 -- 172.21.15.72:0/3217076996 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90003a10 con 0x7fcb9409de50 2023-10-03T10:14:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.626+0000 7fcb9c1eb700 1 -- 172.21.15.72:0/3217076996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb94122cd0 con 0x7fcb9409de50 2023-10-03T10:14:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.627+0000 7fcb8a7fc700 1 -- 172.21.15.72:0/3217076996 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb90003b70 con 0x7fcb9409de50 2023-10-03T10:14:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.627+0000 7fcb9c1eb700 1 -- 172.21.15.72:0/3217076996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb94074ea0 con 0x7fcb9409de50 2023-10-03T10:14:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.627+0000 7fcb8a7fc700 1 -- 172.21.15.72:0/3217076996 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcb90040950 con 0x7fcb9409de50 2023-10-03T10:14:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.631+0000 7fcb8a7fc700 1 -- 172.21.15.72:0/3217076996 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb9001a420 con 0x7fcb9409de50 2023-10-03T10:14:08.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.700+0000 7ff414d78700 1 -- 172.21.15.72:0/3585522175 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff41012e870 con 0x7ff410135c20 2023-10-03T10:14:08.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.701+0000 7ff3feffd700 1 -- 172.21.15.72:0/3585522175 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff41012e870 con 0x7ff410135c20 2023-10-03T10:14:08.701 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:08.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.703+0000 7ff414d78700 1 -- 172.21.15.72:0/3585522175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff410135c20 msgr2=0x7ff41009d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.703+0000 7ff414d78700 1 --2- 172.21.15.72:0/3585522175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff410135c20 0x7ff41009d460 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff410072e70 tx=0x7ff40800ef90 comp rx=0 tx=0).stop 2023-10-03T10:14:08.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.703+0000 7ff414d78700 1 -- 172.21.15.72:0/3585522175 shutdown_connections 2023-10-03T10:14:08.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.703+0000 7ff414d78700 1 --2- 172.21.15.72:0/3585522175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff41006f5d0 0x7ff41009c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.703+0000 7ff414d78700 1 --2- 172.21.15.72:0/3585522175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff410135c20 0x7ff41009d460 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.703+0000 7ff414d78700 1 --2- 172.21.15.72:0/3585522175 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff41012cf60 0x7ff41009cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.703+0000 7ff414d78700 1 -- 172.21.15.72:0/3585522175 >> 172.21.15.72:0/3585522175 conn(0x7ff4100a2aa0 msgr2=0x7ff41012bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.703+0000 7ff414d78700 1 -- 172.21.15.72:0/3585522175 shutdown_connections 2023-10-03T10:14:08.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.703+0000 7ff414d78700 1 -- 172.21.15.72:0/3585522175 wait complete. 2023-10-03T10:14:08.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:08.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.796+0000 7faebfbee700 1 -- 172.21.15.72:0/173464659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faeb80747f0 con 0x7faeb809c650 2023-10-03T10:14:08.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.796+0000 7faeae7fc700 1 -- 172.21.15.72:0/173464659 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faeb402b090 con 0x7faeb809c650 2023-10-03T10:14:08.796 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:08.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.798+0000 7faebfbee700 1 -- 172.21.15.72:0/173464659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faeb809c650 msgr2=0x7faeb806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.798+0000 7faebfbee700 1 --2- 172.21.15.72:0/173464659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faeb809c650 0x7faeb806b8b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7faeb400ebe0 tx=0x7faeb400eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.798+0000 7faebfbee700 1 -- 172.21.15.72:0/173464659 shutdown_connections 2023-10-03T10:14:08.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.798+0000 7faebfbee700 1 --2- 172.21.15.72:0/173464659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faeb809c650 0x7faeb806b8b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.798+0000 7faebfbee700 1 --2- 172.21.15.72:0/173464659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faeb8131970 0x7faeb806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.798+0000 7faebfbee700 1 --2- 172.21.15.72:0/173464659 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faeb80a0090 0x7faeb806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.798+0000 7faebfbee700 1 -- 172.21.15.72:0/173464659 >> 172.21.15.72:0/173464659 conn(0x7faeb80a3f70 msgr2=0x7faeb809ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.798+0000 7faebfbee700 1 -- 172.21.15.72:0/173464659 shutdown_connections 2023-10-03T10:14:08.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.798+0000 7faebfbee700 1 -- 172.21.15.72:0/173464659 wait complete. 2023-10-03T10:14:08.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:08.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.826+0000 7fcb9c1eb700 1 -- 172.21.15.72:0/3217076996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcb9406b9e0 con 0x7fcb9409de50 2023-10-03T10:14:08.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.826+0000 7fcb8a7fc700 1 -- 172.21.15.72:0/3217076996 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcb90015070 con 0x7fcb9409de50 2023-10-03T10:14:08.826 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:08.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.828+0000 7fcb9c1eb700 1 -- 172.21.15.72:0/3217076996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9409de50 msgr2=0x7fcb9411eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.828+0000 7fcb9c1eb700 1 --2- 172.21.15.72:0/3217076996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9409de50 0x7fcb9411eac0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009bc0 tx=0x7fcb90004750 comp rx=0 tx=0).stop 2023-10-03T10:14:08.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.828+0000 7fcb9c1eb700 1 -- 172.21.15.72:0/3217076996 shutdown_connections 2023-10-03T10:14:08.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.828+0000 7fcb9c1eb700 1 --2- 172.21.15.72:0/3217076996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9409de50 0x7fcb9411eac0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.828+0000 7fcb9c1eb700 1 --2- 172.21.15.72:0/3217076996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb941338a0 0x7fcb9411f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.828+0000 7fcb9c1eb700 1 --2- 172.21.15.72:0/3217076996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9409e930 0x7fcb9411f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.828+0000 7fcb9c1eb700 1 -- 172.21.15.72:0/3217076996 >> 172.21.15.72:0/3217076996 conn(0x7fcb940a2aa0 msgr2=0x7fcb941312a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.828+0000 7fcb9c1eb700 1 -- 172.21.15.72:0/3217076996 shutdown_connections 2023-10-03T10:14:08.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:08.828+0000 7fcb9c1eb700 1 -- 172.21.15.72:0/3217076996 wait complete. 2023-10-03T10:14:08.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:09.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:09.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.671+0000 7f162a846700 1 Processor -- start 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.671+0000 7f162a846700 1 -- start start 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.671+0000 7f162a846700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16241316c0 0x7f1624131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.671+0000 7f162a846700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162406ae80 0x7f1624139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.671+0000 7f162a846700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162409e130 con 0x7f162409d9f0 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.671+0000 7f162a846700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16241312b0 con 0x7f16241316c0 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.671+0000 7f162a846700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f162409f6e0 con 0x7f162406ae80 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.671+0000 7f1628de3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162406ae80 0x7f1624139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.671+0000 7f1623fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16241316c0 0x7f1624131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.671+0000 7f16237fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f162409d9f0 0x7f162406a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48054/0 (socket says 172.21.15.72:48054) 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.671+0000 7f16237fe700 1 -- 172.21.15.72:0/4192798576 learned_addr learned my addr 172.21.15.72:0/4192798576 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.672+0000 7f1628de3700 1 -- 172.21.15.72:0/4192798576 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16241316c0 msgr2=0x7f1624131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.672+0000 7f1622ffd700 1 -- 172.21.15.72:0/4192798576 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511453537 0 0) 0x7f1618001110 con 0x7f162409d9f0 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.672+0000 7f1628de3700 1 --2- 172.21.15.72:0/4192798576 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16241316c0 0x7f1624131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.672+0000 7f1628de3700 1 -- 172.21.15.72:0/4192798576 >> v1:172.21.15.72:6789/0 conn(0x7f162409d9f0 legacy=0x7f162406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.672+0000 7f1628de3700 1 -- 172.21.15.72:0/4192798576 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162409e760 con 0x7f162406ae80 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.672+0000 7f1628de3700 1 --2- 172.21.15.72:0/4192798576 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162406ae80 0x7f1624139550 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f161c009dc0 tx=0x7f161c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0b5177a3f6041f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.672+0000 7f1622ffd700 1 -- 172.21.15.72:0/4192798576 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c00e070 con 0x7f162406ae80 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.672+0000 7f1622ffd700 1 -- 172.21.15.72:0/4192798576 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c00bb20 con 0x7f162406ae80 2023-10-03T10:14:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.672+0000 7f1622ffd700 1 -- 172.21.15.72:0/4192798576 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c012430 con 0x7f162406ae80 2023-10-03T10:14:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.672+0000 7f162a846700 1 -- 172.21.15.72:0/4192798576 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162406ae80 msgr2=0x7f1624139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.672+0000 7f162a846700 1 --2- 172.21.15.72:0/4192798576 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162406ae80 0x7f1624139550 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f161c009dc0 tx=0x7f161c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.673+0000 7f162a846700 1 -- 172.21.15.72:0/4192798576 shutdown_connections 2023-10-03T10:14:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.673+0000 7f162a846700 1 --2- 172.21.15.72:0/4192798576 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162406ae80 0x7f1624139550 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.673+0000 7f162a846700 1 --2- 172.21.15.72:0/4192798576 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f16241316c0 0x7f1624131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.673+0000 7f162a846700 1 -- 172.21.15.72:0/4192798576 >> 172.21.15.72:0/4192798576 conn(0x7f1624066f50 msgr2=0x7f162409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.673+0000 7f162a846700 1 -- 172.21.15.72:0/4192798576 shutdown_connections 2023-10-03T10:14:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.673+0000 7f162a846700 1 -- 172.21.15.72:0/4192798576 wait complete. 2023-10-03T10:14:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.673+0000 7f162a846700 1 Processor -- start 2023-10-03T10:14:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f162a846700 1 -- start start 2023-10-03T10:14:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f162a846700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f162406ae80 0x7f162409a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f162a846700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162409d9f0 0x7f162409a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f162a846700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16241316c0 0x7f162409ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f162a846700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162411f760 con 0x7f16241316c0 2023-10-03T10:14:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f162a846700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162409bf50 con 0x7f162406ae80 2023-10-03T10:14:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f162a846700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16240a3760 con 0x7f162409d9f0 2023-10-03T10:14:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f16237fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162409d9f0 0x7f162409a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f1628de3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16241316c0 0x7f162409ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f1623fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f162406ae80 0x7f162409a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f1628de3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16241316c0 0x7f162409ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35442/0 (socket says 172.21.15.72:35442) 2023-10-03T10:14:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f16237fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162409d9f0 0x7f162409a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60276/0 (socket says 172.21.15.72:60276) 2023-10-03T10:14:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f1628de3700 1 -- 172.21.15.72:0/4226226742 learned_addr learned my addr 172.21.15.72:0/4226226742 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f1623fff700 1 -- 172.21.15.72:0/4226226742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162409d9f0 msgr2=0x7f162409a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f1623fff700 1 --2- 172.21.15.72:0/4226226742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162409d9f0 0x7f162409a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f1623fff700 1 -- 172.21.15.72:0/4226226742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16241316c0 msgr2=0x7f162409ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.674+0000 7f1623fff700 1 --2- 172.21.15.72:0/4226226742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16241316c0 0x7f162409ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.675+0000 7f1623fff700 1 -- 172.21.15.72:0/4226226742 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c009a70 con 0x7f162406ae80 2023-10-03T10:14:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.675+0000 7f16237fe700 1 --2- 172.21.15.72:0/4226226742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162409d9f0 0x7f162409a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.675+0000 7f1628de3700 1 --2- 172.21.15.72:0/4226226742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16241316c0 0x7f162409ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.675+0000 7f1623fff700 1 --2- 172.21.15.72:0/4226226742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f162406ae80 0x7f162409a400 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f161400e900 tx=0x7f161400ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.675+0000 7f1620ff9700 1 -- 172.21.15.72:0/4226226742 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614013680 con 0x7f162406ae80 2023-10-03T10:14:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.675+0000 7f1620ff9700 1 -- 172.21.15.72:0/4226226742 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16140137e0 con 0x7f162406ae80 2023-10-03T10:14:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.675+0000 7f1620ff9700 1 -- 172.21.15.72:0/4226226742 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614013b50 con 0x7f162406ae80 2023-10-03T10:14:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.675+0000 7f162a846700 1 -- 172.21.15.72:0/4226226742 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162412b900 con 0x7f162406ae80 2023-10-03T10:14:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.675+0000 7f162a846700 1 -- 172.21.15.72:0/4226226742 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16241200d0 con 0x7f162406ae80 2023-10-03T10:14:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.676+0000 7f162a846700 1 -- 172.21.15.72:0/4226226742 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162409eaa0 con 0x7f162406ae80 2023-10-03T10:14:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.676+0000 7f1620ff9700 1 -- 172.21.15.72:0/4226226742 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1614013cb0 con 0x7f162406ae80 2023-10-03T10:14:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.676+0000 7f1620ff9700 1 -- 172.21.15.72:0/4226226742 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f161403fc00 con 0x7f162406ae80 2023-10-03T10:14:09.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.681+0000 7f1620ff9700 1 -- 172.21.15.72:0/4226226742 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f161401a360 con 0x7f162406ae80 2023-10-03T10:14:09.716 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:09.811 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:09.841 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:09.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.844+0000 7fecebe1f700 1 Processor -- start 2023-10-03T10:14:09.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.844+0000 7fecebe1f700 1 -- start start 2023-10-03T10:14:09.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.845+0000 7fecebe1f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fece409d6f0 0x7fece409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.845+0000 7fecebe1f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fece409e000 0x7fece4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.845+0000 7fecebe1f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fece409e410 0x7fece4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.845+0000 7fecebe1f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece409f520 con 0x7fece409d6f0 2023-10-03T10:14:09.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.845+0000 7fecebe1f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece409f130 con 0x7fece409e410 2023-10-03T10:14:09.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.845+0000 7fecebe1f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece409e930 con 0x7fece409e000 2023-10-03T10:14:09.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.845+0000 7fece93ba700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fece409e000 0x7fece4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.845+0000 7fece9bbb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fece409d6f0 0x7fece409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.845+0000 7fece93ba700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fece409e000 0x7fece4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60292/0 (socket says 172.21.15.72:60292) 2023-10-03T10:14:09.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.845+0000 7fece93ba700 1 -- 172.21.15.72:0/1241254750 learned_addr learned my addr 172.21.15.72:0/1241254750 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:09.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.845+0000 7fecea3bc700 1 --2- 172.21.15.72:0/1241254750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fece409e410 0x7fece4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.846+0000 7fecea3bc700 1 -- 172.21.15.72:0/1241254750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fece409e000 msgr2=0x7fece4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.846+0000 7fecea3bc700 1 --2- 172.21.15.72:0/1241254750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fece409e000 0x7fece4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.846+0000 7fecea3bc700 1 -- 172.21.15.72:0/1241254750 >> v2:172.21.15.72:3300/0 conn(0x7fece409d6f0 msgr2=0x7fece409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.846+0000 7fecea3bc700 1 --2- 172.21.15.72:0/1241254750 >> v2:172.21.15.72:3300/0 conn(0x7fece409d6f0 0x7fece409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.846+0000 7fecea3bc700 1 -- 172.21.15.72:0/1241254750 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece409b2d0 con 0x7fece409e410 2023-10-03T10:14:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.846+0000 7fece93ba700 1 --2- 172.21.15.72:0/1241254750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fece409e000 0x7fece4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.846+0000 7fecea3bc700 1 --2- 172.21.15.72:0/1241254750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fece409e410 0x7fece4130ba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009d90 tx=0x7fecdc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83e56d3a0738939a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.846+0000 7fece8bb9700 1 -- 172.21.15.72:0/1241254750 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00e070 con 0x7fece409e410 2023-10-03T10:14:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.846+0000 7fece8bb9700 1 -- 172.21.15.72:0/1241254750 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc00bb20 con 0x7fece409e410 2023-10-03T10:14:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.846+0000 7fece8bb9700 1 -- 172.21.15.72:0/1241254750 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc012430 con 0x7fece409e410 2023-10-03T10:14:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.847+0000 7fecebe1f700 1 -- 172.21.15.72:0/1241254750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fece409e410 msgr2=0x7fece4130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.847+0000 7fecebe1f700 1 --2- 172.21.15.72:0/1241254750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fece409e410 0x7fece4130ba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009d90 tx=0x7fecdc00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.847+0000 7fecebe1f700 1 -- 172.21.15.72:0/1241254750 shutdown_connections 2023-10-03T10:14:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.847+0000 7fecebe1f700 1 --2- 172.21.15.72:0/1241254750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fece409e410 0x7fece4130ba0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.847+0000 7fecebe1f700 1 --2- 172.21.15.72:0/1241254750 >> v2:172.21.15.72:3300/0 conn(0x7fece409d6f0 0x7fece409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.847+0000 7fecebe1f700 1 --2- 172.21.15.72:0/1241254750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fece409e000 0x7fece4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.847+0000 7fecebe1f700 1 -- 172.21.15.72:0/1241254750 >> 172.21.15.72:0/1241254750 conn(0x7fece4066f50 msgr2=0x7fece409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.847+0000 7fecebe1f700 1 -- 172.21.15.72:0/1241254750 shutdown_connections 2023-10-03T10:14:09.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.847+0000 7fecebe1f700 1 -- 172.21.15.72:0/1241254750 wait complete. 2023-10-03T10:14:09.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.848+0000 7fecebe1f700 1 Processor -- start 2023-10-03T10:14:09.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.848+0000 7fecebe1f700 1 -- start start 2023-10-03T10:14:09.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.849+0000 7fecebe1f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fece409d6f0 0x7fece411de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.849+0000 7fecebe1f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fece409e000 0x7fece411e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.849+0000 7fecebe1f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fece409e410 0x7fece411e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.849+0000 7fecebe1f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece4121030 con 0x7fece409e410 2023-10-03T10:14:09.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.849+0000 7fecebe1f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece409c700 con 0x7fece409e000 2023-10-03T10:14:09.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.849+0000 7fecebe1f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece40a1600 con 0x7fece409d6f0 2023-10-03T10:14:09.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.849+0000 7fece93ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fece409e000 0x7fece411e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.849+0000 7fece93ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fece409e000 0x7fece411e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54372/0 (socket says 172.21.15.72:54372) 2023-10-03T10:14:09.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.849+0000 7fece93ba700 1 -- 172.21.15.72:0/1597324545 learned_addr learned my addr 172.21.15.72:0/1597324545 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:09.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.849+0000 7fece9bbb700 1 --2- 172.21.15.72:0/1597324545 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fece409d6f0 0x7fece411de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.849+0000 7fecea3bc700 1 --2- 172.21.15.72:0/1597324545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fece409e410 0x7fece411e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.850+0000 7fece9bbb700 1 -- 172.21.15.72:0/1597324545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fece409e000 msgr2=0x7fece411e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.850+0000 7fece9bbb700 1 --2- 172.21.15.72:0/1597324545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fece409e000 0x7fece411e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.850+0000 7fece9bbb700 1 -- 172.21.15.72:0/1597324545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fece409e410 msgr2=0x7fece411e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.850+0000 7fece9bbb700 1 --2- 172.21.15.72:0/1597324545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fece409e410 0x7fece411e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.850+0000 7fece9bbb700 1 -- 172.21.15.72:0/1597324545 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd400b600 con 0x7fece409d6f0 2023-10-03T10:14:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.850+0000 7fece9bbb700 1 --2- 172.21.15.72:0/1597324545 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fece409d6f0 0x7fece411de10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fece0012b20 tx=0x7fece0012e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.850+0000 7fecda7fc700 1 -- 172.21.15.72:0/1597324545 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0014040 con 0x7fece409d6f0 2023-10-03T10:14:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.850+0000 7fecda7fc700 1 -- 172.21.15.72:0/1597324545 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece000f7a0 con 0x7fece409d6f0 2023-10-03T10:14:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.850+0000 7fecebe1f700 1 -- 172.21.15.72:0/1597324545 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc009a70 con 0x7fece409d6f0 2023-10-03T10:14:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.850+0000 7fecda7fc700 1 -- 172.21.15.72:0/1597324545 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece000fb10 con 0x7fece409d6f0 2023-10-03T10:14:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.850+0000 7fecebe1f700 1 -- 172.21.15.72:0/1597324545 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece4120be0 con 0x7fece409d6f0 2023-10-03T10:14:09.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.851+0000 7fecebe1f700 1 -- 172.21.15.72:0/1597324545 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece411ac20 con 0x7fece409d6f0 2023-10-03T10:14:09.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.852+0000 7fecda7fc700 1 -- 172.21.15.72:0/1597324545 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fece000fc70 con 0x7fece409d6f0 2023-10-03T10:14:09.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.852+0000 7fecda7fc700 1 -- 172.21.15.72:0/1597324545 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fece0043050 con 0x7fece409d6f0 2023-10-03T10:14:09.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.861+0000 7fecda7fc700 1 -- 172.21.15.72:0/1597324545 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fece001f720 con 0x7fece409d6f0 2023-10-03T10:14:09.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.887+0000 7f162a846700 1 -- 172.21.15.72:0/4226226742 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f16241200d0 con 0x7f162406ae80 2023-10-03T10:14:09.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.887+0000 7f1620ff9700 1 -- 172.21.15.72:0/4226226742 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16241200d0 con 0x7f162406ae80 2023-10-03T10:14:09.887 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:09.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.890+0000 7f162a846700 1 -- 172.21.15.72:0/4226226742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f162406ae80 msgr2=0x7f162409a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.890+0000 7f162a846700 1 --2- 172.21.15.72:0/4226226742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f162406ae80 0x7f162409a400 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f161400e900 tx=0x7f161400ec10 comp rx=0 tx=0).stop 2023-10-03T10:14:09.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.890+0000 7f162a846700 1 -- 172.21.15.72:0/4226226742 shutdown_connections 2023-10-03T10:14:09.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.890+0000 7f162a846700 1 --2- 172.21.15.72:0/4226226742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16241316c0 0x7f162409ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.890+0000 7f162a846700 1 --2- 172.21.15.72:0/4226226742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f162406ae80 0x7f162409a400 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.890+0000 7f162a846700 1 --2- 172.21.15.72:0/4226226742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f162409d9f0 0x7f162409a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.890+0000 7f162a846700 1 -- 172.21.15.72:0/4226226742 >> 172.21.15.72:0/4226226742 conn(0x7f1624066f50 msgr2=0x7f16240a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.890+0000 7f162a846700 1 -- 172.21.15.72:0/4226226742 shutdown_connections 2023-10-03T10:14:09.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.890+0000 7f162a846700 1 -- 172.21.15.72:0/4226226742 wait complete. 2023-10-03T10:14:09.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:09.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.943+0000 7f97e89eb700 1 Processor -- start 2023-10-03T10:14:09.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.943+0000 7f97e89eb700 1 -- start start 2023-10-03T10:14:09.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.943+0000 7f97e89eb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e409d6f0 0x7f97e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.943+0000 7f97e89eb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97e409e000 0x7f97e41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.943+0000 7f97e89eb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e409b120 con 0x7f97e409e410 2023-10-03T10:14:09.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.943+0000 7f97e89eb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e406b460 con 0x7f97e409e000 2023-10-03T10:14:09.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.943+0000 7f97e89eb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e409a7e0 con 0x7f97e409d6f0 2023-10-03T10:14:09.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.943+0000 7f97e1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97e409e000 0x7f97e41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.943+0000 7f97e1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97e409e000 0x7f97e41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35464/0 (socket says 172.21.15.72:35464) 2023-10-03T10:14:09.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.943+0000 7f97e1d9b700 1 -- 172.21.15.72:0/3515489001 learned_addr learned my addr 172.21.15.72:0/3515489001 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:09.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.943+0000 7f97e259c700 1 --2- 172.21.15.72:0/3515489001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e409d6f0 0x7f97e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.944+0000 7f97e1d9b700 1 -- 172.21.15.72:0/3515489001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e409d6f0 msgr2=0x7f97e409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.944+0000 7f97e1d9b700 1 --2- 172.21.15.72:0/3515489001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e409d6f0 0x7f97e409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.944+0000 7f97e1d9b700 1 -- 172.21.15.72:0/3515489001 >> v1:172.21.15.72:6789/0 conn(0x7f97e409e410 legacy=0x7f97e4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.944+0000 7f97e1d9b700 1 -- 172.21.15.72:0/3515489001 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e409a500 con 0x7f97e409e000 2023-10-03T10:14:09.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.944+0000 7f97e1d9b700 1 --2- 172.21.15.72:0/3515489001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97e409e000 0x7f97e41339f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f97d80098f0 tx=0x7f97d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c8f1f11de6fcfc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.944+0000 7f97e159a700 1 -- 172.21.15.72:0/3515489001 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8011830 con 0x7f97e409e000 2023-10-03T10:14:09.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.944+0000 7f97e159a700 1 -- 172.21.15.72:0/3515489001 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d8011990 con 0x7f97e409e000 2023-10-03T10:14:09.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.944+0000 7f97e159a700 1 -- 172.21.15.72:0/3515489001 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8011d20 con 0x7f97e409e000 2023-10-03T10:14:09.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.945+0000 7f97e89eb700 1 -- 172.21.15.72:0/3515489001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97e409e000 msgr2=0x7f97e41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.945+0000 7f97e89eb700 1 --2- 172.21.15.72:0/3515489001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97e409e000 0x7f97e41339f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f97d80098f0 tx=0x7f97d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:09.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.945+0000 7f97e89eb700 1 -- 172.21.15.72:0/3515489001 shutdown_connections 2023-10-03T10:14:09.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.945+0000 7f97e89eb700 1 --2- 172.21.15.72:0/3515489001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e409d6f0 0x7f97e409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.945+0000 7f97e89eb700 1 --2- 172.21.15.72:0/3515489001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97e409e000 0x7f97e41339f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.945+0000 7f97e89eb700 1 -- 172.21.15.72:0/3515489001 >> 172.21.15.72:0/3515489001 conn(0x7f97e4066f50 msgr2=0x7f97e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.945+0000 7f97e89eb700 1 -- 172.21.15.72:0/3515489001 shutdown_connections 2023-10-03T10:14:09.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.945+0000 7f97e89eb700 1 -- 172.21.15.72:0/3515489001 wait complete. 2023-10-03T10:14:09.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.946+0000 7f97e89eb700 1 Processor -- start 2023-10-03T10:14:09.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.946+0000 7f97e89eb700 1 -- start start 2023-10-03T10:14:09.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.946+0000 7f97e89eb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e409d6f0 0x7f97e41a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.946+0000 7f97e89eb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97e409e000 0x7f97e41a5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.946+0000 7f97e89eb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97e409e410 0x7f97e41a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.946+0000 7f97e89eb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e41a8800 con 0x7f97e409e000 2023-10-03T10:14:09.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.946+0000 7f97e89eb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e41a6510 con 0x7f97e409d6f0 2023-10-03T10:14:09.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.946+0000 7f97e89eb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97e40a2fd0 con 0x7f97e409e410 2023-10-03T10:14:09.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.946+0000 7f97e259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e409d6f0 0x7f97e41a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.946+0000 7f97e259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e409d6f0 0x7f97e41a5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54378/0 (socket says 172.21.15.72:54378) 2023-10-03T10:14:09.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.946+0000 7f97e259c700 1 -- 172.21.15.72:0/3688619423 learned_addr learned my addr 172.21.15.72:0/3688619423 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:09.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.947+0000 7f97e1d9b700 1 --2- 172.21.15.72:0/3688619423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97e409e000 0x7f97e41a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.947+0000 7f97e2d9d700 1 --2- 172.21.15.72:0/3688619423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97e409e410 0x7f97e41a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.947+0000 7f97e259c700 1 -- 172.21.15.72:0/3688619423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97e409e410 msgr2=0x7f97e41a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.947+0000 7f97e259c700 1 --2- 172.21.15.72:0/3688619423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97e409e410 0x7f97e41a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.947+0000 7f97e259c700 1 -- 172.21.15.72:0/3688619423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97e409e000 msgr2=0x7f97e41a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.947+0000 7f97e259c700 1 --2- 172.21.15.72:0/3688619423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97e409e000 0x7f97e41a5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.947+0000 7f97e259c700 1 -- 172.21.15.72:0/3688619423 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d8009550 con 0x7f97e409d6f0 2023-10-03T10:14:09.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.947+0000 7f97e259c700 1 --2- 172.21.15.72:0/3688619423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e409d6f0 0x7f97e41a5120 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f97d400e9e0 tx=0x7f97d400ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.947+0000 7f97d2ffd700 1 -- 172.21.15.72:0/3688619423 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4009710 con 0x7f97e409d6f0 2023-10-03T10:14:09.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.947+0000 7f97d2ffd700 1 -- 172.21.15.72:0/3688619423 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d400c850 con 0x7f97e409d6f0 2023-10-03T10:14:09.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.947+0000 7f97e89eb700 1 -- 172.21.15.72:0/3688619423 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e41a6ce0 con 0x7f97e409d6f0 2023-10-03T10:14:09.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.947+0000 7f97d2ffd700 1 -- 172.21.15.72:0/3688619423 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d400cbc0 con 0x7f97e409d6f0 2023-10-03T10:14:09.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.947+0000 7f97e89eb700 1 -- 172.21.15.72:0/3688619423 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e41a7e20 con 0x7f97e409d6f0 2023-10-03T10:14:09.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.948+0000 7f97d2ffd700 1 -- 172.21.15.72:0/3688619423 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f97d400cd20 con 0x7f97e409d6f0 2023-10-03T10:14:09.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.948+0000 7f97d2ffd700 1 -- 172.21.15.72:0/3688619423 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f97d403fba0 con 0x7f97e409d6f0 2023-10-03T10:14:09.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.948+0000 7f97e89eb700 1 -- 172.21.15.72:0/3688619423 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e4074ea0 con 0x7f97e409d6f0 2023-10-03T10:14:09.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.953+0000 7f97d2ffd700 1 -- 172.21.15.72:0/3688619423 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97d4017080 con 0x7f97e409d6f0 2023-10-03T10:14:09.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.973+0000 7f6a995c9700 1 Processor -- start 2023-10-03T10:14:09.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.973+0000 7f6a995c9700 1 -- start start 2023-10-03T10:14:09.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.973+0000 7f6a995c9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a9409d630 0x7f6a940a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.973+0000 7f6a995c9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a94138d80 0x7f6a9413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.973+0000 7f6a995c9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a940a2a70 con 0x7f6a940a0a30 2023-10-03T10:14:09.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.973+0000 7f6a995c9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a940a01d0 con 0x7f6a9409d630 2023-10-03T10:14:09.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.973+0000 7f6a995c9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9409e2b0 con 0x7f6a94138d80 2023-10-03T10:14:09.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.973+0000 7f6a927fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a9409d630 0x7f6a940a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.973+0000 7f6a927fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a9409d630 0x7f6a940a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35484/0 (socket says 172.21.15.72:35484) 2023-10-03T10:14:09.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.973+0000 7f6a927fc700 1 -- 172.21.15.72:0/2917250702 learned_addr learned my addr 172.21.15.72:0/2917250702 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:09.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.974+0000 7f6a937fe700 1 --2- 172.21.15.72:0/2917250702 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a94138d80 0x7f6a9413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.974+0000 7f6a927fc700 1 -- 172.21.15.72:0/2917250702 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a94138d80 msgr2=0x7f6a9413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.974+0000 7f6a927fc700 1 --2- 172.21.15.72:0/2917250702 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a94138d80 0x7f6a9413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.974+0000 7f6a927fc700 1 -- 172.21.15.72:0/2917250702 >> v1:172.21.15.72:6789/0 conn(0x7f6a940a0a30 legacy=0x7f6a940a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.974+0000 7f6a927fc700 1 -- 172.21.15.72:0/2917250702 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9409dc50 con 0x7f6a9409d630 2023-10-03T10:14:09.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.974+0000 7f6a927fc700 1 --2- 172.21.15.72:0/2917250702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9409d630 0x7f6a940a1510 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6a880098f0 tx=0x7f6a88009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d751d3dc1d143ef2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.974+0000 7f6a91ffb700 1 -- 172.21.15.72:0/2917250702 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88011830 con 0x7f6a9409d630 2023-10-03T10:14:09.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.974+0000 7f6a91ffb700 1 -- 172.21.15.72:0/2917250702 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a88011990 con 0x7f6a9409d630 2023-10-03T10:14:09.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.974+0000 7f6a91ffb700 1 -- 172.21.15.72:0/2917250702 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88011d20 con 0x7f6a9409d630 2023-10-03T10:14:09.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.975+0000 7f6a995c9700 1 -- 172.21.15.72:0/2917250702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9409d630 msgr2=0x7f6a940a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.975+0000 7f6a995c9700 1 --2- 172.21.15.72:0/2917250702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9409d630 0x7f6a940a1510 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6a880098f0 tx=0x7f6a88009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:09.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.975+0000 7f6a995c9700 1 -- 172.21.15.72:0/2917250702 shutdown_connections 2023-10-03T10:14:09.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.975+0000 7f6a995c9700 1 --2- 172.21.15.72:0/2917250702 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a94138d80 0x7f6a9413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.975+0000 7f6a995c9700 1 --2- 172.21.15.72:0/2917250702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9409d630 0x7f6a940a1510 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.975+0000 7f6a995c9700 1 -- 172.21.15.72:0/2917250702 >> 172.21.15.72:0/2917250702 conn(0x7f6a940a3050 msgr2=0x7f6a940a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.975+0000 7f6a995c9700 1 -- 172.21.15.72:0/2917250702 shutdown_connections 2023-10-03T10:14:09.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.975+0000 7f6a995c9700 1 -- 172.21.15.72:0/2917250702 wait complete. 2023-10-03T10:14:09.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.977+0000 7f6a995c9700 1 Processor -- start 2023-10-03T10:14:09.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.977+0000 7f6a995c9700 1 -- start start 2023-10-03T10:14:09.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.977+0000 7f6a995c9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9409d630 0x7f6a941338d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.977+0000 7f6a995c9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a940a0a30 0x7f6a94133e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.977+0000 7f6a995c9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a94138d80 0x7f6a94134350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.977+0000 7f6a995c9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a941363f0 con 0x7f6a9409d630 2023-10-03T10:14:09.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.977+0000 7f6a995c9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a94137110 con 0x7f6a94138d80 2023-10-03T10:14:09.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.977+0000 7f6a995c9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a940a4d00 con 0x7f6a940a0a30 2023-10-03T10:14:09.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.977+0000 7f6a927fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a940a0a30 0x7f6a94133e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.977+0000 7f6a92ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9409d630 0x7f6a941338d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.978+0000 7f6a927fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a940a0a30 0x7f6a94133e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60326/0 (socket says 172.21.15.72:60326) 2023-10-03T10:14:09.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.978+0000 7f6a927fc700 1 -- 172.21.15.72:0/685390052 learned_addr learned my addr 172.21.15.72:0/685390052 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:09.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.978+0000 7f6a937fe700 1 --2- 172.21.15.72:0/685390052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a94138d80 0x7f6a94134350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.978+0000 7f6a92ffd700 1 -- 172.21.15.72:0/685390052 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a940a0a30 msgr2=0x7f6a94133e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.978+0000 7f6a92ffd700 1 --2- 172.21.15.72:0/685390052 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a940a0a30 0x7f6a94133e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.978+0000 7f6a92ffd700 1 -- 172.21.15.72:0/685390052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a94138d80 msgr2=0x7f6a94134350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.978+0000 7f6a92ffd700 1 --2- 172.21.15.72:0/685390052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a94138d80 0x7f6a94134350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.978+0000 7f6a92ffd700 1 -- 172.21.15.72:0/685390052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a88009550 con 0x7f6a9409d630 2023-10-03T10:14:09.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.978+0000 7f6a92ffd700 1 --2- 172.21.15.72:0/685390052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9409d630 0x7f6a941338d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6a84000f60 tx=0x7f6a8400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.978+0000 7f6a7b7fe700 1 -- 172.21.15.72:0/685390052 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840052d0 con 0x7f6a9409d630 2023-10-03T10:14:09.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.978+0000 7f6a7b7fe700 1 -- 172.21.15.72:0/685390052 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a84005430 con 0x7f6a9409d630 2023-10-03T10:14:09.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.978+0000 7f6a7b7fe700 1 -- 172.21.15.72:0/685390052 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840038c0 con 0x7f6a9409d630 2023-10-03T10:14:09.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.978+0000 7f6a995c9700 1 -- 172.21.15.72:0/685390052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a940a0410 con 0x7f6a9409d630 2023-10-03T10:14:09.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.978+0000 7f6a995c9700 1 -- 172.21.15.72:0/685390052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a941373f0 con 0x7f6a9409d630 2023-10-03T10:14:09.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.979+0000 7f6a7b7fe700 1 -- 172.21.15.72:0/685390052 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a84003a20 con 0x7f6a9409d630 2023-10-03T10:14:09.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.979+0000 7f6a7b7fe700 1 -- 172.21.15.72:0/685390052 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6a8403e990 con 0x7f6a9409d630 2023-10-03T10:14:09.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.980+0000 7f6a995c9700 1 -- 172.21.15.72:0/685390052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a94136f50 con 0x7f6a9409d630 2023-10-03T10:14:09.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:09.988+0000 7f6a7b7fe700 1 -- 172.21.15.72:0/685390052 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a84017080 con 0x7f6a9409d630 2023-10-03T10:14:10.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.063+0000 7fecebe1f700 1 -- 172.21.15.72:0/1597324545 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fece4121440 con 0x7fece409d6f0 2023-10-03T10:14:10.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.063+0000 7fecda7fc700 1 -- 172.21.15.72:0/1597324545 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fece001f310 con 0x7fece409d6f0 2023-10-03T10:14:10.063 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:10.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.066+0000 7fecebe1f700 1 -- 172.21.15.72:0/1597324545 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fece409d6f0 msgr2=0x7fece411de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.066+0000 7fecebe1f700 1 --2- 172.21.15.72:0/1597324545 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fece409d6f0 0x7fece411de10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fece0012b20 tx=0x7fece0012e30 comp rx=0 tx=0).stop 2023-10-03T10:14:10.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.066+0000 7fecebe1f700 1 -- 172.21.15.72:0/1597324545 shutdown_connections 2023-10-03T10:14:10.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.066+0000 7fecebe1f700 1 --2- 172.21.15.72:0/1597324545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fece409e410 0x7fece411e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.066+0000 7fecebe1f700 1 --2- 172.21.15.72:0/1597324545 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fece409d6f0 0x7fece411de10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.066+0000 7fecebe1f700 1 --2- 172.21.15.72:0/1597324545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fece409e000 0x7fece411e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.066+0000 7fecebe1f700 1 -- 172.21.15.72:0/1597324545 >> 172.21.15.72:0/1597324545 conn(0x7fece4066f50 msgr2=0x7fece4130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.066+0000 7fecebe1f700 1 -- 172.21.15.72:0/1597324545 shutdown_connections 2023-10-03T10:14:10.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.066+0000 7fecebe1f700 1 -- 172.21.15.72:0/1597324545 wait complete. 2023-10-03T10:14:10.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:10.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.154+0000 7f97e89eb700 1 -- 172.21.15.72:0/3688619423 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f97e406c360 con 0x7f97e409d6f0 2023-10-03T10:14:10.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.154+0000 7f97d2ffd700 1 -- 172.21.15.72:0/3688619423 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97d4021020 con 0x7f97e409d6f0 2023-10-03T10:14:10.154 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:10.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.156+0000 7f97e89eb700 1 -- 172.21.15.72:0/3688619423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e409d6f0 msgr2=0x7f97e41a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.156+0000 7f97e89eb700 1 --2- 172.21.15.72:0/3688619423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e409d6f0 0x7f97e41a5120 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f97d400e9e0 tx=0x7f97d400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.156+0000 7f97e89eb700 1 -- 172.21.15.72:0/3688619423 shutdown_connections 2023-10-03T10:14:10.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.156+0000 7f97e89eb700 1 --2- 172.21.15.72:0/3688619423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97e409e410 0x7f97e41a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.156+0000 7f97e89eb700 1 --2- 172.21.15.72:0/3688619423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e409d6f0 0x7f97e41a5120 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.156+0000 7f97e89eb700 1 --2- 172.21.15.72:0/3688619423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97e409e000 0x7f97e41a5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.156+0000 7f97e89eb700 1 -- 172.21.15.72:0/3688619423 >> 172.21.15.72:0/3688619423 conn(0x7f97e4066f50 msgr2=0x7f97e41bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.156+0000 7f97e89eb700 1 -- 172.21.15.72:0/3688619423 shutdown_connections 2023-10-03T10:14:10.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.156+0000 7f97e89eb700 1 -- 172.21.15.72:0/3688619423 wait complete. 2023-10-03T10:14:10.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:10.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.182+0000 7f6a995c9700 1 -- 172.21.15.72:0/685390052 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6a940747f0 con 0x7f6a9409d630 2023-10-03T10:14:10.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.182+0000 7f6a7b7fe700 1 -- 172.21.15.72:0/685390052 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6a84011590 con 0x7f6a9409d630 2023-10-03T10:14:10.182 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:10.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.184+0000 7f6a995c9700 1 -- 172.21.15.72:0/685390052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9409d630 msgr2=0x7f6a941338d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.184+0000 7f6a995c9700 1 --2- 172.21.15.72:0/685390052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9409d630 0x7f6a941338d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6a84000f60 tx=0x7f6a8400c730 comp rx=0 tx=0).stop 2023-10-03T10:14:10.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.184+0000 7f6a995c9700 1 -- 172.21.15.72:0/685390052 shutdown_connections 2023-10-03T10:14:10.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.184+0000 7f6a995c9700 1 --2- 172.21.15.72:0/685390052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9409d630 0x7f6a941338d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.184+0000 7f6a995c9700 1 --2- 172.21.15.72:0/685390052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a94138d80 0x7f6a94134350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.184+0000 7f6a995c9700 1 --2- 172.21.15.72:0/685390052 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a940a0a30 0x7f6a94133e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.184+0000 7f6a995c9700 1 -- 172.21.15.72:0/685390052 >> 172.21.15.72:0/685390052 conn(0x7f6a940a3050 msgr2=0x7f6a9409f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.184+0000 7f6a995c9700 1 -- 172.21.15.72:0/685390052 shutdown_connections 2023-10-03T10:14:10.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:10.185+0000 7f6a995c9700 1 -- 172.21.15.72:0/685390052 wait complete. 2023-10-03T10:14:10.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:10.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:11.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.029+0000 7f03288c4700 1 Processor -- start 2023-10-03T10:14:11.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.029+0000 7f03288c4700 1 -- start start 2023-10-03T10:14:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.030+0000 7f03288c4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f032409d6f0 0x7f032409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.030+0000 7f03288c4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f032409e410 0x7f0324130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.030+0000 7f03288c4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f032409f130 con 0x7f032409e000 2023-10-03T10:14:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.030+0000 7f03288c4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032409f520 con 0x7f032409d6f0 2023-10-03T10:14:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.030+0000 7f03288c4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f032409e930 con 0x7f032409e410 2023-10-03T10:14:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.030+0000 7f032259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f032409d6f0 0x7f032409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.030+0000 7f0322d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f032409e410 0x7f0324130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.030+0000 7f0322d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f032409e410 0x7f0324130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60332/0 (socket says 172.21.15.72:60332) 2023-10-03T10:14:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.030+0000 7f032259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f032409d6f0 0x7f032409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35498/0 (socket says 172.21.15.72:35498) 2023-10-03T10:14:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.030+0000 7f0322d9d700 1 -- 172.21.15.72:0/1087750282 learned_addr learned my addr 172.21.15.72:0/1087750282 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.030+0000 7f0322d9d700 1 -- 172.21.15.72:0/1087750282 >> v2:172.21.15.72:3300/0 conn(0x7f032409d6f0 msgr2=0x7f032409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.030+0000 7f0322d9d700 1 --2- 172.21.15.72:0/1087750282 >> v2:172.21.15.72:3300/0 conn(0x7f032409d6f0 0x7f032409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.030+0000 7f0322d9d700 1 -- 172.21.15.72:0/1087750282 >> v1:172.21.15.72:6789/0 conn(0x7f032409e000 legacy=0x7f0324130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.030+0000 7f0322d9d700 1 -- 172.21.15.72:0/1087750282 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032409b2d0 con 0x7f032409e410 2023-10-03T10:14:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.030+0000 7f032259c700 1 --2- 172.21.15.72:0/1087750282 >> v2:172.21.15.72:3300/0 conn(0x7f032409d6f0 0x7f032409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.031+0000 7f0322d9d700 1 --2- 172.21.15.72:0/1087750282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f032409e410 0x7f0324130d70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f031c009e50 tx=0x7f031c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7c7968141b88fa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.031+0000 7f032159a700 1 -- 172.21.15.72:0/1087750282 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c00e070 con 0x7f032409e410 2023-10-03T10:14:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.031+0000 7f032159a700 1 -- 172.21.15.72:0/1087750282 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031c00b910 con 0x7f032409e410 2023-10-03T10:14:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.031+0000 7f032159a700 1 -- 172.21.15.72:0/1087750282 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c00bcc0 con 0x7f032409e410 2023-10-03T10:14:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.031+0000 7f03288c4700 1 -- 172.21.15.72:0/1087750282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f032409e410 msgr2=0x7f0324130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.031+0000 7f03288c4700 1 --2- 172.21.15.72:0/1087750282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f032409e410 0x7f0324130d70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f031c009e50 tx=0x7f031c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.031+0000 7f03288c4700 1 -- 172.21.15.72:0/1087750282 shutdown_connections 2023-10-03T10:14:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.031+0000 7f03288c4700 1 --2- 172.21.15.72:0/1087750282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f032409e410 0x7f0324130d70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.031+0000 7f03288c4700 1 --2- 172.21.15.72:0/1087750282 >> v2:172.21.15.72:3300/0 conn(0x7f032409d6f0 0x7f032409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.031+0000 7f03288c4700 1 -- 172.21.15.72:0/1087750282 >> 172.21.15.72:0/1087750282 conn(0x7f0324066f50 msgr2=0x7f032409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.031+0000 7f03288c4700 1 -- 172.21.15.72:0/1087750282 shutdown_connections 2023-10-03T10:14:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.031+0000 7f03288c4700 1 -- 172.21.15.72:0/1087750282 wait complete. 2023-10-03T10:14:11.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.032+0000 7f03288c4700 1 Processor -- start 2023-10-03T10:14:11.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.032+0000 7f03288c4700 1 -- start start 2023-10-03T10:14:11.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f03288c4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f032409d6f0 0x7f03241c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f03288c4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f032409e000 0x7f03241c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f03288c4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f032409e410 0x7f03241c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f03288c4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0324125800 con 0x7f032409d6f0 2023-10-03T10:14:11.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f03288c4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0324120f20 con 0x7f032409e000 2023-10-03T10:14:11.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f03288c4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0324125e10 con 0x7f032409e410 2023-10-03T10:14:11.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f032259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f032409d6f0 0x7f03241c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f032259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f032409d6f0 0x7f03241c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35504/0 (socket says 172.21.15.72:35504) 2023-10-03T10:14:11.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f032259c700 1 -- 172.21.15.72:0/2167049365 learned_addr learned my addr 172.21.15.72:0/2167049365 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:11.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f0322d9d700 1 --2- 172.21.15.72:0/2167049365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f032409e410 0x7f03241c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f0321d9b700 1 --2- 172.21.15.72:0/2167049365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f032409e000 0x7f03241c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f032259c700 1 -- 172.21.15.72:0/2167049365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f032409e410 msgr2=0x7f03241c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f032259c700 1 --2- 172.21.15.72:0/2167049365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f032409e410 0x7f03241c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f032259c700 1 -- 172.21.15.72:0/2167049365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f032409e000 msgr2=0x7f03241c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f032259c700 1 --2- 172.21.15.72:0/2167049365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f032409e000 0x7f03241c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f032259c700 1 -- 172.21.15.72:0/2167049365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03180094a0 con 0x7f032409d6f0 2023-10-03T10:14:11.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f0322d9d700 1 --2- 172.21.15.72:0/2167049365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f032409e410 0x7f03241c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.033+0000 7f032259c700 1 --2- 172.21.15.72:0/2167049365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f032409d6f0 0x7f03241c8470 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f031800ebe0 tx=0x7f031800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.034+0000 7f0312ffd700 1 -- 172.21.15.72:0/2167049365 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031800c850 con 0x7f032409d6f0 2023-10-03T10:14:11.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.034+0000 7f0312ffd700 1 -- 172.21.15.72:0/2167049365 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031800c9b0 con 0x7f032409d6f0 2023-10-03T10:14:11.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.034+0000 7f0312ffd700 1 -- 172.21.15.72:0/2167049365 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031800cd40 con 0x7f032409d6f0 2023-10-03T10:14:11.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.034+0000 7f03288c4700 1 -- 172.21.15.72:0/2167049365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031c009b30 con 0x7f032409d6f0 2023-10-03T10:14:11.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.034+0000 7f03288c4700 1 -- 172.21.15.72:0/2167049365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0324072690 con 0x7f032409d6f0 2023-10-03T10:14:11.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.034+0000 7f0312ffd700 1 -- 172.21.15.72:0/2167049365 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0318013470 con 0x7f032409d6f0 2023-10-03T10:14:11.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.034+0000 7f0312ffd700 1 -- 172.21.15.72:0/2167049365 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f031803f7e0 con 0x7f032409d6f0 2023-10-03T10:14:11.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.035+0000 7f03288c4700 1 -- 172.21.15.72:0/2167049365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0324125c50 con 0x7f032409d6f0 2023-10-03T10:14:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.039+0000 7f0312ffd700 1 -- 172.21.15.72:0/2167049365 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0318013720 con 0x7f032409d6f0 2023-10-03T10:14:11.078 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:11.169 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:11.196 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:11.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.203+0000 7fbca0a1d700 1 Processor -- start 2023-10-03T10:14:11.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.204+0000 7fbca0a1d700 1 -- start start 2023-10-03T10:14:11.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.204+0000 7fbca0a1d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c09d6f0 0x7fbc9c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.204+0000 7fbca0a1d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbc9c09e000 0x7fbc9c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.204+0000 7fbca0a1d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9c09b120 con 0x7fbc9c09e410 2023-10-03T10:14:11.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.204+0000 7fbca0a1d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c06b460 con 0x7fbc9c09d6f0 2023-10-03T10:14:11.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.204+0000 7fbca0a1d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c09a7e0 con 0x7fbc9c09e000 2023-10-03T10:14:11.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.204+0000 7fbc9a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c09d6f0 0x7fbc9c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.204+0000 7fbc9ad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbc9c09e410 0x7fbc9c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48076/0 (socket says 172.21.15.72:48076) 2023-10-03T10:14:11.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.204+0000 7fbc9ad9d700 1 -- 172.21.15.72:0/2270363500 learned_addr learned my addr 172.21.15.72:0/2270363500 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:11.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.204+0000 7fbc99d9b700 1 --2- 172.21.15.72:0/2270363500 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbc9c09e000 0x7fbc9c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.205+0000 7fbc9959a700 1 -- 172.21.15.72:0/2270363500 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043506329 0 0) 0x7fbc9c09b120 con 0x7fbc9c09e410 2023-10-03T10:14:11.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.205+0000 7fbc9959a700 1 -- 172.21.15.72:0/2270363500 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc840035b0 con 0x7fbc9c09e410 2023-10-03T10:14:11.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.205+0000 7fbc99d9b700 1 -- 172.21.15.72:0/2270363500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c09d6f0 msgr2=0x7fbc9c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.205+0000 7fbc99d9b700 1 --2- 172.21.15.72:0/2270363500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c09d6f0 0x7fbc9c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.205+0000 7fbc99d9b700 1 -- 172.21.15.72:0/2270363500 >> v1:172.21.15.72:6789/0 conn(0x7fbc9c09e410 legacy=0x7fbc9c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.205+0000 7fbc99d9b700 1 -- 172.21.15.72:0/2270363500 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c09a500 con 0x7fbc9c09e000 2023-10-03T10:14:11.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.205+0000 7fbc99d9b700 1 --2- 172.21.15.72:0/2270363500 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbc9c09e000 0x7fbc9c1339f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbc900098a0 tx=0x7fbc90009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=899e7fb5632d23ac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.205+0000 7fbc9959a700 1 -- 172.21.15.72:0/2270363500 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90011830 con 0x7fbc9c09e000 2023-10-03T10:14:11.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.205+0000 7fbc9959a700 1 -- 172.21.15.72:0/2270363500 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc90011990 con 0x7fbc9c09e000 2023-10-03T10:14:11.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.205+0000 7fbc9959a700 1 -- 172.21.15.72:0/2270363500 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90011d00 con 0x7fbc9c09e000 2023-10-03T10:14:11.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.206+0000 7fbca0a1d700 1 -- 172.21.15.72:0/2270363500 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbc9c09e000 msgr2=0x7fbc9c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.206+0000 7fbca0a1d700 1 --2- 172.21.15.72:0/2270363500 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbc9c09e000 0x7fbc9c1339f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbc900098a0 tx=0x7fbc90009bb0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.206+0000 7fbca0a1d700 1 -- 172.21.15.72:0/2270363500 shutdown_connections 2023-10-03T10:14:11.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.206+0000 7fbca0a1d700 1 --2- 172.21.15.72:0/2270363500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c09d6f0 0x7fbc9c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.206+0000 7fbca0a1d700 1 --2- 172.21.15.72:0/2270363500 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbc9c09e000 0x7fbc9c1339f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.206+0000 7fbca0a1d700 1 -- 172.21.15.72:0/2270363500 >> 172.21.15.72:0/2270363500 conn(0x7fbc9c066f50 msgr2=0x7fbc9c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.206+0000 7fbca0a1d700 1 -- 172.21.15.72:0/2270363500 shutdown_connections 2023-10-03T10:14:11.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.206+0000 7fbca0a1d700 1 -- 172.21.15.72:0/2270363500 wait complete. 2023-10-03T10:14:11.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.207+0000 7fbca0a1d700 1 Processor -- start 2023-10-03T10:14:11.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.207+0000 7fbca0a1d700 1 -- start start 2023-10-03T10:14:11.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbca0a1d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c09d6f0 0x7fbc9c1c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbca0a1d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbc9c09e000 0x7fbc9c1c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbca0a1d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc9c09e410 0x7fbc9c1cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbca0a1d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c1322a0 con 0x7fbc9c09e410 2023-10-03T10:14:11.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbca0a1d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c1ca120 con 0x7fbc9c09d6f0 2023-10-03T10:14:11.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbca0a1d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c0a2f60 con 0x7fbc9c09e000 2023-10-03T10:14:11.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbc99d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbc9c09e000 0x7fbc9c1c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbc99d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbc9c09e000 0x7fbc9c1c9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60354/0 (socket says 172.21.15.72:60354) 2023-10-03T10:14:11.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbc99d9b700 1 -- 172.21.15.72:0/824013935 learned_addr learned my addr 172.21.15.72:0/824013935 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:11.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbc9ad9d700 1 --2- 172.21.15.72:0/824013935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc9c09e410 0x7fbc9c1cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbc9a59c700 1 --2- 172.21.15.72:0/824013935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c09d6f0 0x7fbc9c1c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbc99d9b700 1 -- 172.21.15.72:0/824013935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c09d6f0 msgr2=0x7fbc9c1c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbc99d9b700 1 --2- 172.21.15.72:0/824013935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c09d6f0 0x7fbc9c1c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbc99d9b700 1 -- 172.21.15.72:0/824013935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc9c09e410 msgr2=0x7fbc9c1cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbc99d9b700 1 --2- 172.21.15.72:0/824013935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc9c09e410 0x7fbc9c1cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbc99d9b700 1 -- 172.21.15.72:0/824013935 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc900094a0 con 0x7fbc9c09e000 2023-10-03T10:14:11.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbc9ad9d700 1 --2- 172.21.15.72:0/824013935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc9c09e410 0x7fbc9c1cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.208+0000 7fbc99d9b700 1 --2- 172.21.15.72:0/824013935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbc9c09e000 0x7fbc9c1c9be0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbc90000c00 tx=0x7fbc90004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.209+0000 7fbc8affd700 1 -- 172.21.15.72:0/824013935 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc900044d0 con 0x7fbc9c09e000 2023-10-03T10:14:11.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.209+0000 7fbc8affd700 1 -- 172.21.15.72:0/824013935 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9001f070 con 0x7fbc9c09e000 2023-10-03T10:14:11.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.209+0000 7fbca0a1d700 1 -- 172.21.15.72:0/824013935 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9c09c710 con 0x7fbc9c09e000 2023-10-03T10:14:11.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.209+0000 7fbc8affd700 1 -- 172.21.15.72:0/824013935 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc900038e0 con 0x7fbc9c09e000 2023-10-03T10:14:11.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.209+0000 7fbca0a1d700 1 -- 172.21.15.72:0/824013935 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9c133690 con 0x7fbc9c09e000 2023-10-03T10:14:11.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.210+0000 7fbca0a1d700 1 -- 172.21.15.72:0/824013935 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9c074ea0 con 0x7fbc9c09e000 2023-10-03T10:14:11.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.210+0000 7fbc8affd700 1 -- 172.21.15.72:0/824013935 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc90003a40 con 0x7fbc9c09e000 2023-10-03T10:14:11.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.210+0000 7fbc8affd700 1 -- 172.21.15.72:0/824013935 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbc90021070 con 0x7fbc9c09e000 2023-10-03T10:14:11.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.218+0000 7fbc8affd700 1 -- 172.21.15.72:0/824013935 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc90026480 con 0x7fbc9c09e000 2023-10-03T10:14:11.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.243+0000 7f03288c4700 1 -- 172.21.15.72:0/2167049365 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0324074ea0 con 0x7f032409d6f0 2023-10-03T10:14:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.243+0000 7f0312ffd700 1 -- 172.21.15.72:0/2167049365 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f031801b9c0 con 0x7f032409d6f0 2023-10-03T10:14:11.243 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:11.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.246+0000 7f03288c4700 1 -- 172.21.15.72:0/2167049365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f032409d6f0 msgr2=0x7f03241c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.246+0000 7f03288c4700 1 --2- 172.21.15.72:0/2167049365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f032409d6f0 0x7f03241c8470 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f031800ebe0 tx=0x7f031800eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.246+0000 7f03288c4700 1 -- 172.21.15.72:0/2167049365 shutdown_connections 2023-10-03T10:14:11.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.246+0000 7f03288c4700 1 --2- 172.21.15.72:0/2167049365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f032409d6f0 0x7f03241c8470 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.246+0000 7f03288c4700 1 --2- 172.21.15.72:0/2167049365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f032409e410 0x7f03241c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.246+0000 7f03288c4700 1 --2- 172.21.15.72:0/2167049365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f032409e000 0x7f03241c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.246+0000 7f03288c4700 1 -- 172.21.15.72:0/2167049365 >> 172.21.15.72:0/2167049365 conn(0x7f0324066f50 msgr2=0x7f03240a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.246+0000 7f03288c4700 1 -- 172.21.15.72:0/2167049365 shutdown_connections 2023-10-03T10:14:11.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.246+0000 7f03288c4700 1 -- 172.21.15.72:0/2167049365 wait complete. 2023-10-03T10:14:11.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:11.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.303+0000 7fde901ab700 1 Processor -- start 2023-10-03T10:14:11.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.303+0000 7fde901ab700 1 -- start start 2023-10-03T10:14:11.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde901ab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde8809d6f0 0x7fde8809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde901ab700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde8809e000 0x7fde88130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde901ab700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8809f130 con 0x7fde8809e410 2023-10-03T10:14:11.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde901ab700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8809f520 con 0x7fde8809d6f0 2023-10-03T10:14:11.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde901ab700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde8809e930 con 0x7fde8809e000 2023-10-03T10:14:11.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde8d746700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde8809e000 0x7fde88130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde8df47700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde8809d6f0 0x7fde8809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde8d746700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde8809e000 0x7fde88130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60366/0 (socket says 172.21.15.72:60366) 2023-10-03T10:14:11.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde8d746700 1 -- 172.21.15.72:0/2440469678 learned_addr learned my addr 172.21.15.72:0/2440469678 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:11.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde8df47700 1 -- 172.21.15.72:0/2440469678 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde8809e000 msgr2=0x7fde88130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde8df47700 1 --2- 172.21.15.72:0/2440469678 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde8809e000 0x7fde88130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde8cf45700 1 -- 172.21.15.72:0/2440469678 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118823680 0 0) 0x7fde8809f130 con 0x7fde8809e410 2023-10-03T10:14:11.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde8df47700 1 -- 172.21.15.72:0/2440469678 >> v1:172.21.15.72:6789/0 conn(0x7fde8809e410 legacy=0x7fde88130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde8df47700 1 -- 172.21.15.72:0/2440469678 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8809b2d0 con 0x7fde8809d6f0 2023-10-03T10:14:11.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde8d746700 1 --2- 172.21.15.72:0/2440469678 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde8809e000 0x7fde88130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.304+0000 7fde8df47700 1 --2- 172.21.15.72:0/2440469678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde8809d6f0 0x7fde8809dac0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fde84009870 tx=0x7fde84009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab88d7be9bf795b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.305+0000 7fde8cf45700 1 -- 172.21.15.72:0/2440469678 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84011830 con 0x7fde8809d6f0 2023-10-03T10:14:11.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.305+0000 7fde8cf45700 1 -- 172.21.15.72:0/2440469678 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde84011990 con 0x7fde8809d6f0 2023-10-03T10:14:11.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.305+0000 7fde8cf45700 1 -- 172.21.15.72:0/2440469678 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84011d20 con 0x7fde8809d6f0 2023-10-03T10:14:11.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.305+0000 7fde901ab700 1 -- 172.21.15.72:0/2440469678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde8809d6f0 msgr2=0x7fde8809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.305+0000 7fde901ab700 1 --2- 172.21.15.72:0/2440469678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde8809d6f0 0x7fde8809dac0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fde84009870 tx=0x7fde84009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:11.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.305+0000 7fde901ab700 1 -- 172.21.15.72:0/2440469678 shutdown_connections 2023-10-03T10:14:11.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.305+0000 7fde901ab700 1 --2- 172.21.15.72:0/2440469678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde8809d6f0 0x7fde8809dac0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.305+0000 7fde901ab700 1 --2- 172.21.15.72:0/2440469678 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde8809e000 0x7fde88130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.305+0000 7fde901ab700 1 -- 172.21.15.72:0/2440469678 >> 172.21.15.72:0/2440469678 conn(0x7fde88066f50 msgr2=0x7fde8809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.305+0000 7fde901ab700 1 -- 172.21.15.72:0/2440469678 shutdown_connections 2023-10-03T10:14:11.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.305+0000 7fde901ab700 1 -- 172.21.15.72:0/2440469678 wait complete. 2023-10-03T10:14:11.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.307+0000 7fde901ab700 1 Processor -- start 2023-10-03T10:14:11.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.307+0000 7fde901ab700 1 -- start start 2023-10-03T10:14:11.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.307+0000 7fde901ab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde8809d6f0 0x7fde8811ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.307+0000 7fde901ab700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde8809e000 0x7fde8811f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde901ab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde8809e410 0x7fde8811f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde901ab700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde881209f0 con 0x7fde8809e410 2023-10-03T10:14:11.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde901ab700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde88121880 con 0x7fde8809d6f0 2023-10-03T10:14:11.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde901ab700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde88122360 con 0x7fde8809e000 2023-10-03T10:14:11.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde8df47700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde8809d6f0 0x7fde8811ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde8df47700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde8809d6f0 0x7fde8811ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54430/0 (socket says 172.21.15.72:54430) 2023-10-03T10:14:11.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde8df47700 1 -- 172.21.15.72:0/135638812 learned_addr learned my addr 172.21.15.72:0/135638812 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:11.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde8d746700 1 --2- 172.21.15.72:0/135638812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde8809e000 0x7fde8811f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde8e748700 1 --2- 172.21.15.72:0/135638812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde8809e410 0x7fde8811f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde8df47700 1 -- 172.21.15.72:0/135638812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde8809e000 msgr2=0x7fde8811f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde8df47700 1 --2- 172.21.15.72:0/135638812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde8809e000 0x7fde8811f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde8df47700 1 -- 172.21.15.72:0/135638812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde8809e410 msgr2=0x7fde8811f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde8df47700 1 --2- 172.21.15.72:0/135638812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde8809e410 0x7fde8811f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde8df47700 1 -- 172.21.15.72:0/135638812 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde78009550 con 0x7fde8809d6f0 2023-10-03T10:14:11.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde8df47700 1 --2- 172.21.15.72:0/135638812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde8809d6f0 0x7fde8811ede0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fde84000c00 tx=0x7fde84004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde7e7fc700 1 -- 172.21.15.72:0/135638812 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8401a6e0 con 0x7fde8809d6f0 2023-10-03T10:14:11.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde7e7fc700 1 -- 172.21.15.72:0/135638812 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8401a840 con 0x7fde8809d6f0 2023-10-03T10:14:11.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde901ab700 1 -- 172.21.15.72:0/135638812 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde840094a0 con 0x7fde8809d6f0 2023-10-03T10:14:11.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde7e7fc700 1 -- 172.21.15.72:0/135638812 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8401abb0 con 0x7fde8809d6f0 2023-10-03T10:14:11.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.308+0000 7fde901ab700 1 -- 172.21.15.72:0/135638812 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8809c700 con 0x7fde8809d6f0 2023-10-03T10:14:11.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.309+0000 7fde7e7fc700 1 -- 172.21.15.72:0/135638812 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde84022070 con 0x7fde8809d6f0 2023-10-03T10:14:11.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.309+0000 7fde7e7fc700 1 -- 172.21.15.72:0/135638812 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fde84040790 con 0x7fde8809d6f0 2023-10-03T10:14:11.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.310+0000 7fde901ab700 1 -- 172.21.15.72:0/135638812 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde881224a0 con 0x7fde8809d6f0 2023-10-03T10:14:11.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.314+0000 7fde7e7fc700 1 -- 172.21.15.72:0/135638812 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde8401ad10 con 0x7fde8809d6f0 2023-10-03T10:14:11.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.339+0000 7fcd5e69d700 1 Processor -- start 2023-10-03T10:14:11.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.339+0000 7fcd5e69d700 1 -- start start 2023-10-03T10:14:11.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.339+0000 7fcd5e69d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd5809e1d0 0x7fcd58138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.339+0000 7fcd5e69d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd58139170 0x7fcd5813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.339+0000 7fcd5e69d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5809b120 con 0x7fcd5809d6f0 2023-10-03T10:14:11.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.339+0000 7fcd5e69d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5806b460 con 0x7fcd58139170 2023-10-03T10:14:11.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.339+0000 7fcd5e69d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5809a7e0 con 0x7fcd5809e1d0 2023-10-03T10:14:11.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.339+0000 7fcd577fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd5809e1d0 0x7fcd58138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.339+0000 7fcd57fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcd5809d6f0 0x7fcd5809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48104/0 (socket says 172.21.15.72:48104) 2023-10-03T10:14:11.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.339+0000 7fcd57fff700 1 -- 172.21.15.72:0/3455341558 learned_addr learned my addr 172.21.15.72:0/3455341558 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.339+0000 7fcd5cc3a700 1 --2- 172.21.15.72:0/3455341558 >> v2:172.21.15.72:3300/0 conn(0x7fcd58139170 0x7fcd5813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd5cc3a700 1 -- 172.21.15.72:0/3455341558 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd5809e1d0 msgr2=0x7fcd58138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd5cc3a700 1 --2- 172.21.15.72:0/3455341558 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd5809e1d0 0x7fcd58138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd5cc3a700 1 -- 172.21.15.72:0/3455341558 >> v1:172.21.15.72:6789/0 conn(0x7fcd5809d6f0 legacy=0x7fcd5809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd5cc3a700 1 -- 172.21.15.72:0/3455341558 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5809a500 con 0x7fcd58139170 2023-10-03T10:14:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd56ffd700 1 -- 172.21.15.72:0/3455341558 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939458374 0 0) 0x7fcd5809b120 con 0x7fcd5809d6f0 2023-10-03T10:14:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd577fe700 1 --2- 172.21.15.72:0/3455341558 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd5809e1d0 0x7fcd58138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd5cc3a700 1 --2- 172.21.15.72:0/3455341558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd58139170 0x7fcd5813b550 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009d90 tx=0x7fcd5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc617dcad79112b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd56ffd700 1 -- 172.21.15.72:0/3455341558 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5000e070 con 0x7fcd58139170 2023-10-03T10:14:11.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd56ffd700 1 -- 172.21.15.72:0/3455341558 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5000bb20 con 0x7fcd58139170 2023-10-03T10:14:11.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd56ffd700 1 -- 172.21.15.72:0/3455341558 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd50012430 con 0x7fcd58139170 2023-10-03T10:14:11.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd5e69d700 1 -- 172.21.15.72:0/3455341558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd58139170 msgr2=0x7fcd5813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd5e69d700 1 --2- 172.21.15.72:0/3455341558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd58139170 0x7fcd5813b550 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009d90 tx=0x7fcd5000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:11.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd5e69d700 1 -- 172.21.15.72:0/3455341558 shutdown_connections 2023-10-03T10:14:11.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd5e69d700 1 --2- 172.21.15.72:0/3455341558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd58139170 0x7fcd5813b550 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd5e69d700 1 --2- 172.21.15.72:0/3455341558 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd5809e1d0 0x7fcd58138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.340+0000 7fcd5e69d700 1 -- 172.21.15.72:0/3455341558 >> 172.21.15.72:0/3455341558 conn(0x7fcd58066f50 msgr2=0x7fcd5809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.341+0000 7fcd5e69d700 1 -- 172.21.15.72:0/3455341558 shutdown_connections 2023-10-03T10:14:11.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.341+0000 7fcd5e69d700 1 -- 172.21.15.72:0/3455341558 wait complete. 2023-10-03T10:14:11.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.341+0000 7fcd5e69d700 1 Processor -- start 2023-10-03T10:14:11.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd5e69d700 1 -- start start 2023-10-03T10:14:11.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd5e69d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd5809d6f0 0x7fcd5811e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd5e69d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5809e1d0 0x7fcd5811edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd5e69d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd58139170 0x7fcd5811f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd5e69d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd580720b0 con 0x7fcd58139170 2023-10-03T10:14:11.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd5e69d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd581205d0 con 0x7fcd5809e1d0 2023-10-03T10:14:11.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd5e69d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd58121e30 con 0x7fcd5809d6f0 2023-10-03T10:14:11.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd577fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5809e1d0 0x7fcd5811edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd5cc3a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd58139170 0x7fcd5811f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd577fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5809e1d0 0x7fcd5811edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54440/0 (socket says 172.21.15.72:54440) 2023-10-03T10:14:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd57fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd5809d6f0 0x7fcd5811e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd577fe700 1 -- 172.21.15.72:0/2080017819 learned_addr learned my addr 172.21.15.72:0/2080017819 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd577fe700 1 -- 172.21.15.72:0/2080017819 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd5809d6f0 msgr2=0x7fcd5811e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd577fe700 1 --2- 172.21.15.72:0/2080017819 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd5809d6f0 0x7fcd5811e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd577fe700 1 -- 172.21.15.72:0/2080017819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd58139170 msgr2=0x7fcd5811f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd577fe700 1 --2- 172.21.15.72:0/2080017819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd58139170 0x7fcd5811f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.342+0000 7fcd577fe700 1 -- 172.21.15.72:0/2080017819 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c0094a0 con 0x7fcd5809e1d0 2023-10-03T10:14:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.343+0000 7fcd577fe700 1 --2- 172.21.15.72:0/2080017819 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5809e1d0 0x7fcd5811edf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00ebe0 tx=0x7fcd4c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.343+0000 7fcd54ff9700 1 -- 172.21.15.72:0/2080017819 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c00c850 con 0x7fcd5809e1d0 2023-10-03T10:14:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.343+0000 7fcd54ff9700 1 -- 172.21.15.72:0/2080017819 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c00c9b0 con 0x7fcd5809e1d0 2023-10-03T10:14:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.343+0000 7fcd54ff9700 1 -- 172.21.15.72:0/2080017819 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c00cd40 con 0x7fcd5809e1d0 2023-10-03T10:14:11.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.343+0000 7fcd5e69d700 1 -- 172.21.15.72:0/2080017819 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd50009a70 con 0x7fcd5809e1d0 2023-10-03T10:14:11.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.343+0000 7fcd5e69d700 1 -- 172.21.15.72:0/2080017819 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd581220f0 con 0x7fcd5809e1d0 2023-10-03T10:14:11.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.344+0000 7fcd54ff9700 1 -- 172.21.15.72:0/2080017819 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd4c013470 con 0x7fcd5809e1d0 2023-10-03T10:14:11.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.344+0000 7fcd5e69d700 1 -- 172.21.15.72:0/2080017819 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd58074ea0 con 0x7fcd5809e1d0 2023-10-03T10:14:11.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.344+0000 7fcd54ff9700 1 -- 172.21.15.72:0/2080017819 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd4c03fb30 con 0x7fcd5809e1d0 2023-10-03T10:14:11.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.349+0000 7fcd54ff9700 1 -- 172.21.15.72:0/2080017819 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd4c013720 con 0x7fcd5809e1d0 2023-10-03T10:14:11.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.417+0000 7fbca0a1d700 1 -- 172.21.15.72:0/824013935 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbc9c133460 con 0x7fbc9c09e000 2023-10-03T10:14:11.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.417+0000 7fbc8affd700 1 -- 172.21.15.72:0/824013935 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbc90015020 con 0x7fbc9c09e000 2023-10-03T10:14:11.417 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:11.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.419+0000 7fbca0a1d700 1 -- 172.21.15.72:0/824013935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbc9c09e000 msgr2=0x7fbc9c1c9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.419+0000 7fbca0a1d700 1 --2- 172.21.15.72:0/824013935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbc9c09e000 0x7fbc9c1c9be0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbc90000c00 tx=0x7fbc90004750 comp rx=0 tx=0).stop 2023-10-03T10:14:11.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.419+0000 7fbca0a1d700 1 -- 172.21.15.72:0/824013935 shutdown_connections 2023-10-03T10:14:11.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.419+0000 7fbca0a1d700 1 --2- 172.21.15.72:0/824013935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc9c09e410 0x7fbc9c1cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.419+0000 7fbca0a1d700 1 --2- 172.21.15.72:0/824013935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc9c09d6f0 0x7fbc9c1c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.419+0000 7fbca0a1d700 1 --2- 172.21.15.72:0/824013935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbc9c09e000 0x7fbc9c1c9be0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.419+0000 7fbca0a1d700 1 -- 172.21.15.72:0/824013935 >> 172.21.15.72:0/824013935 conn(0x7fbc9c066f50 msgr2=0x7fbc9c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.419+0000 7fbca0a1d700 1 -- 172.21.15.72:0/824013935 shutdown_connections 2023-10-03T10:14:11.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.419+0000 7fbca0a1d700 1 -- 172.21.15.72:0/824013935 wait complete. 2023-10-03T10:14:11.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:11.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.509+0000 7fde901ab700 1 -- 172.21.15.72:0/135638812 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fde88074ea0 con 0x7fde8809d6f0 2023-10-03T10:14:11.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.510+0000 7fde7e7fc700 1 -- 172.21.15.72:0/135638812 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde84029030 con 0x7fde8809d6f0 2023-10-03T10:14:11.510 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:11.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.512+0000 7fde901ab700 1 -- 172.21.15.72:0/135638812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde8809d6f0 msgr2=0x7fde8811ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.512+0000 7fde901ab700 1 --2- 172.21.15.72:0/135638812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde8809d6f0 0x7fde8811ede0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fde84000c00 tx=0x7fde84004750 comp rx=0 tx=0).stop 2023-10-03T10:14:11.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.512+0000 7fde901ab700 1 -- 172.21.15.72:0/135638812 shutdown_connections 2023-10-03T10:14:11.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.512+0000 7fde901ab700 1 --2- 172.21.15.72:0/135638812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde8809e410 0x7fde8811f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.512+0000 7fde901ab700 1 --2- 172.21.15.72:0/135638812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde8809d6f0 0x7fde8811ede0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.512+0000 7fde901ab700 1 --2- 172.21.15.72:0/135638812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde8809e000 0x7fde8811f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.512+0000 7fde901ab700 1 -- 172.21.15.72:0/135638812 >> 172.21.15.72:0/135638812 conn(0x7fde88066f50 msgr2=0x7fde880a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.512+0000 7fde901ab700 1 -- 172.21.15.72:0/135638812 shutdown_connections 2023-10-03T10:14:11.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.512+0000 7fde901ab700 1 -- 172.21.15.72:0/135638812 wait complete. 2023-10-03T10:14:11.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:11.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.541+0000 7fcd5e69d700 1 -- 172.21.15.72:0/2080017819 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcd58071e90 con 0x7fcd5809e1d0 2023-10-03T10:14:11.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.542+0000 7fcd54ff9700 1 -- 172.21.15.72:0/2080017819 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcd4c017070 con 0x7fcd5809e1d0 2023-10-03T10:14:11.542 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:11.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.544+0000 7fcd5e69d700 1 -- 172.21.15.72:0/2080017819 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5809e1d0 msgr2=0x7fcd5811edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.544+0000 7fcd5e69d700 1 --2- 172.21.15.72:0/2080017819 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5809e1d0 0x7fcd5811edf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00ebe0 tx=0x7fcd4c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.544+0000 7fcd5e69d700 1 -- 172.21.15.72:0/2080017819 shutdown_connections 2023-10-03T10:14:11.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.544+0000 7fcd5e69d700 1 --2- 172.21.15.72:0/2080017819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd58139170 0x7fcd5811f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.544+0000 7fcd5e69d700 1 --2- 172.21.15.72:0/2080017819 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd5809d6f0 0x7fcd5811e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.544+0000 7fcd5e69d700 1 --2- 172.21.15.72:0/2080017819 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5809e1d0 0x7fcd5811edf0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.544+0000 7fcd5e69d700 1 -- 172.21.15.72:0/2080017819 >> 172.21.15.72:0/2080017819 conn(0x7fcd58066f50 msgr2=0x7fcd58136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.544+0000 7fcd5e69d700 1 -- 172.21.15.72:0/2080017819 shutdown_connections 2023-10-03T10:14:11.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:11.544+0000 7fcd5e69d700 1 -- 172.21.15.72:0/2080017819 wait complete. 2023-10-03T10:14:11.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:12.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.394+0000 7f18eca07700 1 Processor -- start 2023-10-03T10:14:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.394+0000 7f18eca07700 1 -- start start 2023-10-03T10:14:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.394+0000 7f18eca07700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18e809e930 0x7f18e809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.394+0000 7f18eca07700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18e809f650 0x7f18e8131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.394+0000 7f18eca07700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e8070940 con 0x7f18e809f240 2023-10-03T10:14:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.394+0000 7f18eca07700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e806fd60 con 0x7f18e809e930 2023-10-03T10:14:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.394+0000 7f18eca07700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18e806fa80 con 0x7f18e809f650 2023-10-03T10:14:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.394+0000 7f18e659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18e809e930 0x7f18e809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.394+0000 7f18e5d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f18e809f240 0x7f18e81317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48106/0 (socket says 172.21.15.72:48106) 2023-10-03T10:14:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.394+0000 7f18e6d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18e809f650 0x7f18e8131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.394+0000 7f18e5d9b700 1 -- 172.21.15.72:0/547071201 learned_addr learned my addr 172.21.15.72:0/547071201 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.395+0000 7f18e559a700 1 -- 172.21.15.72:0/547071201 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682405833 0 0) 0x7f18e8070940 con 0x7f18e809f240 2023-10-03T10:14:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.395+0000 7f18e559a700 1 -- 172.21.15.72:0/547071201 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18d00035b0 con 0x7f18e809f240 2023-10-03T10:14:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.395+0000 7f18e6d9d700 1 -- 172.21.15.72:0/547071201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18e809e930 msgr2=0x7f18e809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.395+0000 7f18e6d9d700 1 --2- 172.21.15.72:0/547071201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18e809e930 0x7f18e809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.395+0000 7f18e6d9d700 1 -- 172.21.15.72:0/547071201 >> v1:172.21.15.72:6789/0 conn(0x7f18e809f240 legacy=0x7f18e81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.395+0000 7f18e6d9d700 1 -- 172.21.15.72:0/547071201 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e809fb60 con 0x7f18e809f650 2023-10-03T10:14:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.395+0000 7f18e659c700 1 --2- 172.21.15.72:0/547071201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18e809e930 0x7f18e809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.395+0000 7f18e6d9d700 1 --2- 172.21.15.72:0/547071201 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18e809f650 0x7f18e8131f00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009dc0 tx=0x7f18e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f97efacc191e59a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.395+0000 7f18e559a700 1 -- 172.21.15.72:0/547071201 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e000e070 con 0x7f18e809f650 2023-10-03T10:14:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.395+0000 7f18e559a700 1 -- 172.21.15.72:0/547071201 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e000bb20 con 0x7f18e809f650 2023-10-03T10:14:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.395+0000 7f18e559a700 1 -- 172.21.15.72:0/547071201 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0012430 con 0x7f18e809f650 2023-10-03T10:14:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.395+0000 7f18eca07700 1 -- 172.21.15.72:0/547071201 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18e809f650 msgr2=0x7f18e8131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.396+0000 7f18eca07700 1 --2- 172.21.15.72:0/547071201 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18e809f650 0x7f18e8131f00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009dc0 tx=0x7f18e000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.396+0000 7f18eca07700 1 -- 172.21.15.72:0/547071201 shutdown_connections 2023-10-03T10:14:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.396+0000 7f18eca07700 1 --2- 172.21.15.72:0/547071201 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18e809f650 0x7f18e8131f00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.396+0000 7f18eca07700 1 --2- 172.21.15.72:0/547071201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18e809e930 0x7f18e809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.396+0000 7f18eca07700 1 -- 172.21.15.72:0/547071201 >> 172.21.15.72:0/547071201 conn(0x7f18e80a4210 msgr2=0x7f18e80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.396+0000 7f18eca07700 1 -- 172.21.15.72:0/547071201 shutdown_connections 2023-10-03T10:14:12.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.396+0000 7f18eca07700 1 -- 172.21.15.72:0/547071201 wait complete. 2023-10-03T10:14:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.397+0000 7f18eca07700 1 Processor -- start 2023-10-03T10:14:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.397+0000 7f18eca07700 1 -- start start 2023-10-03T10:14:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.397+0000 7f18eca07700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18e809e930 0x7f18e806c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.397+0000 7f18eca07700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18e809f240 0x7f18e806c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.397+0000 7f18eca07700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e809f650 0x7f18e81c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.397+0000 7f18eca07700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e806d5f0 con 0x7f18e809f650 2023-10-03T10:14:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.397+0000 7f18eca07700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e806d400 con 0x7f18e809e930 2023-10-03T10:14:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.397+0000 7f18eca07700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18e81b7140 con 0x7f18e809f240 2023-10-03T10:14:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.397+0000 7f18e5d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18e809f240 0x7f18e806c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.397+0000 7f18e6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e809f650 0x7f18e81c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.397+0000 7f18e5d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18e809f240 0x7f18e806c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60428/0 (socket says 172.21.15.72:60428) 2023-10-03T10:14:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.397+0000 7f18e5d9b700 1 -- 172.21.15.72:0/2074010137 learned_addr learned my addr 172.21.15.72:0/2074010137 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.397+0000 7f18e659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18e809e930 0x7f18e806c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.398+0000 7f18e659c700 1 -- 172.21.15.72:0/2074010137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18e809f240 msgr2=0x7f18e806c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.398+0000 7f18e659c700 1 --2- 172.21.15.72:0/2074010137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18e809f240 0x7f18e806c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.398+0000 7f18e659c700 1 -- 172.21.15.72:0/2074010137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e809f650 msgr2=0x7f18e81c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.398+0000 7f18e659c700 1 --2- 172.21.15.72:0/2074010137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e809f650 0x7f18e81c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.398+0000 7f18e659c700 1 -- 172.21.15.72:0/2074010137 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d80094a0 con 0x7f18e809e930 2023-10-03T10:14:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.398+0000 7f18e6d9d700 1 --2- 172.21.15.72:0/2074010137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e809f650 0x7f18e81c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.398+0000 7f18e5d9b700 1 --2- 172.21.15.72:0/2074010137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18e809f240 0x7f18e806c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.398+0000 7f18e659c700 1 --2- 172.21.15.72:0/2074010137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18e809e930 0x7f18e806c1d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f18d800e9b0 tx=0x7f18d800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.398+0000 7f18d6ffd700 1 -- 172.21.15.72:0/2074010137 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800ee50 con 0x7f18e809e930 2023-10-03T10:14:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.398+0000 7f18d6ffd700 1 -- 172.21.15.72:0/2074010137 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d800c850 con 0x7f18e809e930 2023-10-03T10:14:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.398+0000 7f18eca07700 1 -- 172.21.15.72:0/2074010137 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e0009a70 con 0x7f18e809e930 2023-10-03T10:14:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.398+0000 7f18d6ffd700 1 -- 172.21.15.72:0/2074010137 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800cc00 con 0x7f18e809e930 2023-10-03T10:14:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.398+0000 7f18eca07700 1 -- 172.21.15.72:0/2074010137 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e80a0190 con 0x7f18e809e930 2023-10-03T10:14:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.399+0000 7f18d6ffd700 1 -- 172.21.15.72:0/2074010137 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18d8013470 con 0x7f18e809e930 2023-10-03T10:14:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.399+0000 7f18d6ffd700 1 -- 172.21.15.72:0/2074010137 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f18d803f760 con 0x7f18e809e930 2023-10-03T10:14:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.399+0000 7f18eca07700 1 -- 172.21.15.72:0/2074010137 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e8071d80 con 0x7f18e809e930 2023-10-03T10:14:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.403+0000 7f18d6ffd700 1 -- 172.21.15.72:0/2074010137 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18d8013720 con 0x7f18e809e930 2023-10-03T10:14:12.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:12.524 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:12.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:12.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.559+0000 7f8757faa700 1 Processor -- start 2023-10-03T10:14:12.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.559+0000 7f8757faa700 1 -- start start 2023-10-03T10:14:12.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.559+0000 7f8757faa700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f875009e1d0 0x7f8750138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.559+0000 7f8757faa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8750139170 0x7f875013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.559+0000 7f8757faa700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f875009b120 con 0x7f875009d6f0 2023-10-03T10:14:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.559+0000 7f8757faa700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f875006b460 con 0x7f875009e1d0 2023-10-03T10:14:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.559+0000 7f8757faa700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f875009a7e0 con 0x7f8750139170 2023-10-03T10:14:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.559+0000 7f8756547700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8750139170 0x7f875013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.559+0000 7f8755545700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f875009e1d0 0x7f8750138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.559+0000 7f8756547700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8750139170 0x7f875013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60444/0 (socket says 172.21.15.72:60444) 2023-10-03T10:14:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.560+0000 7f8755545700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f875009e1d0 0x7f8750138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35566/0 (socket says 172.21.15.72:35566) 2023-10-03T10:14:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.560+0000 7f8756547700 1 -- 172.21.15.72:0/1643188600 learned_addr learned my addr 172.21.15.72:0/1643188600 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.560+0000 7f8755545700 1 -- 172.21.15.72:0/1643188600 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8750139170 msgr2=0x7f875013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.560+0000 7f8755545700 1 --2- 172.21.15.72:0/1643188600 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8750139170 0x7f875013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.560+0000 7f8755545700 1 -- 172.21.15.72:0/1643188600 >> v1:172.21.15.72:6789/0 conn(0x7f875009d6f0 legacy=0x7f875009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.560+0000 7f8755545700 1 -- 172.21.15.72:0/1643188600 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875009a500 con 0x7f875009e1d0 2023-10-03T10:14:12.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.560+0000 7f8756547700 1 --2- 172.21.15.72:0/1643188600 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8750139170 0x7f875013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:12.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.560+0000 7f8755545700 1 --2- 172.21.15.72:0/1643188600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875009e1d0 0x7f8750138c30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8740009870 tx=0x7f8740009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde9163babc4f7ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.560+0000 7f8754d44700 1 -- 172.21.15.72:0/1643188600 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740011830 con 0x7f875009e1d0 2023-10-03T10:14:12.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.560+0000 7f8754d44700 1 -- 172.21.15.72:0/1643188600 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8740011990 con 0x7f875009e1d0 2023-10-03T10:14:12.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.560+0000 7f8754d44700 1 -- 172.21.15.72:0/1643188600 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740011d20 con 0x7f875009e1d0 2023-10-03T10:14:12.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.561+0000 7f8757faa700 1 -- 172.21.15.72:0/1643188600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875009e1d0 msgr2=0x7f8750138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.561+0000 7f8757faa700 1 --2- 172.21.15.72:0/1643188600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875009e1d0 0x7f8750138c30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8740009870 tx=0x7f8740009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:12.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.561+0000 7f8757faa700 1 -- 172.21.15.72:0/1643188600 shutdown_connections 2023-10-03T10:14:12.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.561+0000 7f8757faa700 1 --2- 172.21.15.72:0/1643188600 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8750139170 0x7f875013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.561+0000 7f8757faa700 1 --2- 172.21.15.72:0/1643188600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875009e1d0 0x7f8750138c30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.561+0000 7f8757faa700 1 -- 172.21.15.72:0/1643188600 >> 172.21.15.72:0/1643188600 conn(0x7f8750066f50 msgr2=0x7f875009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.561+0000 7f8757faa700 1 -- 172.21.15.72:0/1643188600 shutdown_connections 2023-10-03T10:14:12.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.561+0000 7f8757faa700 1 -- 172.21.15.72:0/1643188600 wait complete. 2023-10-03T10:14:12.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.562+0000 7f8757faa700 1 Processor -- start 2023-10-03T10:14:12.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.562+0000 7f8757faa700 1 -- start start 2023-10-03T10:14:12.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.562+0000 7f8757faa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875009d6f0 0x7f875011e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.562+0000 7f8757faa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875009e1d0 0x7f875011ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.562+0000 7f8757faa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8750139170 0x7f875011f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.562+0000 7f8757faa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87500a1a70 con 0x7f875009d6f0 2023-10-03T10:14:12.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.562+0000 7f8757faa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8750121bf0 con 0x7f8750139170 2023-10-03T10:14:12.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.562+0000 7f8757faa700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8750122190 con 0x7f875009e1d0 2023-10-03T10:14:12.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.563+0000 7f8756547700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8750139170 0x7f875011f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.563+0000 7f8756547700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8750139170 0x7f875011f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54466/0 (socket says 172.21.15.72:54466) 2023-10-03T10:14:12.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.563+0000 7f8756547700 1 -- 172.21.15.72:0/4287609263 learned_addr learned my addr 172.21.15.72:0/4287609263 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:12.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.563+0000 7f8756547700 1 -- 172.21.15.72:0/4287609263 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875009e1d0 msgr2=0x7f875011ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.563+0000 7f8755545700 1 --2- 172.21.15.72:0/4287609263 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875009e1d0 0x7f875011ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.563+0000 7f8756547700 1 --2- 172.21.15.72:0/4287609263 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875009e1d0 0x7f875011ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.563+0000 7f8756547700 1 -- 172.21.15.72:0/4287609263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875009d6f0 msgr2=0x7f875011e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.563+0000 7f8756547700 1 --2- 172.21.15.72:0/4287609263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875009d6f0 0x7f875011e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.563+0000 7f8756547700 1 -- 172.21.15.72:0/4287609263 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8748009b30 con 0x7f8750139170 2023-10-03T10:14:12.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.563+0000 7f8755545700 1 --2- 172.21.15.72:0/4287609263 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875009e1d0 0x7f875011ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:12.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.563+0000 7f8756547700 1 --2- 172.21.15.72:0/4287609263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8750139170 0x7f875011f0f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8748009ef0 tx=0x7f874800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.563+0000 7f87467fc700 1 -- 172.21.15.72:0/4287609263 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874800cc20 con 0x7f8750139170 2023-10-03T10:14:12.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.563+0000 7f87467fc700 1 -- 172.21.15.72:0/4287609263 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874800f040 con 0x7f8750139170 2023-10-03T10:14:12.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.564+0000 7f87467fc700 1 -- 172.21.15.72:0/4287609263 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748014480 con 0x7f8750139170 2023-10-03T10:14:12.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.564+0000 7f8757faa700 1 -- 172.21.15.72:0/4287609263 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87400094a0 con 0x7f8750139170 2023-10-03T10:14:12.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.564+0000 7f8757faa700 1 -- 172.21.15.72:0/4287609263 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8750120460 con 0x7f8750139170 2023-10-03T10:14:12.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.564+0000 7f87467fc700 1 -- 172.21.15.72:0/4287609263 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87480145e0 con 0x7f8750139170 2023-10-03T10:14:12.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.565+0000 7f87467fc700 1 -- 172.21.15.72:0/4287609263 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f874803fba0 con 0x7f8750139170 2023-10-03T10:14:12.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.565+0000 7f8757faa700 1 -- 172.21.15.72:0/4287609263 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8750120400 con 0x7f8750139170 2023-10-03T10:14:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.574+0000 7f87467fc700 1 -- 172.21.15.72:0/4287609263 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8748014890 con 0x7f8750139170 2023-10-03T10:14:12.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.607+0000 7f18eca07700 1 -- 172.21.15.72:0/2074010137 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f18e8074ea0 con 0x7f18e809e930 2023-10-03T10:14:12.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.607+0000 7f18d6ffd700 1 -- 172.21.15.72:0/2074010137 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18d8021030 con 0x7f18e809e930 2023-10-03T10:14:12.607 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:12.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.610+0000 7f18eca07700 1 -- 172.21.15.72:0/2074010137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18e809e930 msgr2=0x7f18e806c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.611+0000 7f18eca07700 1 --2- 172.21.15.72:0/2074010137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18e809e930 0x7f18e806c1d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f18d800e9b0 tx=0x7f18d800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.611+0000 7f18eca07700 1 -- 172.21.15.72:0/2074010137 shutdown_connections 2023-10-03T10:14:12.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.611+0000 7f18eca07700 1 --2- 172.21.15.72:0/2074010137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18e809f650 0x7f18e81c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.611+0000 7f18eca07700 1 --2- 172.21.15.72:0/2074010137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18e809e930 0x7f18e806c1d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.611+0000 7f18eca07700 1 --2- 172.21.15.72:0/2074010137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18e809f240 0x7f18e806c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.611+0000 7f18eca07700 1 -- 172.21.15.72:0/2074010137 >> 172.21.15.72:0/2074010137 conn(0x7f18e80a4210 msgr2=0x7f18e81b9990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.611+0000 7f18eca07700 1 -- 172.21.15.72:0/2074010137 shutdown_connections 2023-10-03T10:14:12.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.611+0000 7f18eca07700 1 -- 172.21.15.72:0/2074010137 wait complete. 2023-10-03T10:14:12.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:12.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.663+0000 7ff50440e700 1 Processor -- start 2023-10-03T10:14:12.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.663+0000 7ff50440e700 1 -- start start 2023-10-03T10:14:12.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff50440e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4fc09d6f0 0x7ff4fc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff50440e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4fc09e410 0x7ff4fc130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff50440e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4fc09f130 con 0x7ff4fc09e000 2023-10-03T10:14:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff50440e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4fc09f520 con 0x7ff4fc09e410 2023-10-03T10:14:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff50440e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc09e930 con 0x7ff4fc09d6f0 2023-10-03T10:14:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff5021aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4fc09d6f0 0x7ff4fc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff5029ab700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4fc09e410 0x7ff4fc130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff5029ab700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4fc09e410 0x7ff4fc130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35584/0 (socket says 172.21.15.72:35584) 2023-10-03T10:14:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff5021aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4fc09d6f0 0x7ff4fc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54472/0 (socket says 172.21.15.72:54472) 2023-10-03T10:14:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff5029ab700 1 -- 172.21.15.72:0/3131017329 learned_addr learned my addr 172.21.15.72:0/3131017329 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff5029ab700 1 -- 172.21.15.72:0/3131017329 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4fc09d6f0 msgr2=0x7ff4fc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff5029ab700 1 --2- 172.21.15.72:0/3131017329 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4fc09d6f0 0x7ff4fc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff5029ab700 1 -- 172.21.15.72:0/3131017329 >> v1:172.21.15.72:6789/0 conn(0x7ff4fc09e000 legacy=0x7ff4fc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff5029ab700 1 -- 172.21.15.72:0/3131017329 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc09b2d0 con 0x7ff4fc09e410 2023-10-03T10:14:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff5029ab700 1 --2- 172.21.15.72:0/3131017329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4fc09e410 0x7ff4fc130d70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4009e80 tx=0x7ff4f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1e81ac892f1a95 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.664+0000 7ff5011a8700 1 -- 172.21.15.72:0/3131017329 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f400e070 con 0x7ff4fc09e410 2023-10-03T10:14:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.665+0000 7ff5011a8700 1 -- 172.21.15.72:0/3131017329 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f400b8d0 con 0x7ff4fc09e410 2023-10-03T10:14:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.665+0000 7ff5011a8700 1 -- 172.21.15.72:0/3131017329 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f400bc80 con 0x7ff4fc09e410 2023-10-03T10:14:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.665+0000 7ff50440e700 1 -- 172.21.15.72:0/3131017329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4fc09e410 msgr2=0x7ff4fc130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.665+0000 7ff50440e700 1 --2- 172.21.15.72:0/3131017329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4fc09e410 0x7ff4fc130d70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4009e80 tx=0x7ff4f400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.665+0000 7ff50440e700 1 -- 172.21.15.72:0/3131017329 shutdown_connections 2023-10-03T10:14:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.665+0000 7ff50440e700 1 --2- 172.21.15.72:0/3131017329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4fc09e410 0x7ff4fc130d70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.665+0000 7ff50440e700 1 --2- 172.21.15.72:0/3131017329 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4fc09d6f0 0x7ff4fc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.665+0000 7ff50440e700 1 -- 172.21.15.72:0/3131017329 >> 172.21.15.72:0/3131017329 conn(0x7ff4fc066f50 msgr2=0x7ff4fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.665+0000 7ff50440e700 1 -- 172.21.15.72:0/3131017329 shutdown_connections 2023-10-03T10:14:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.665+0000 7ff50440e700 1 -- 172.21.15.72:0/3131017329 wait complete. 2023-10-03T10:14:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.666+0000 7ff50440e700 1 Processor -- start 2023-10-03T10:14:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.666+0000 7ff50440e700 1 -- start start 2023-10-03T10:14:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff50440e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4fc09d6f0 0x7ff4fc1315f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff50440e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4fc09e000 0x7ff4fc131b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff50440e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4fc09e410 0x7ff4fc132070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff50440e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc133920 con 0x7ff4fc09e000 2023-10-03T10:14:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff50440e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc130170 con 0x7ff4fc09e410 2023-10-03T10:14:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff50440e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc134090 con 0x7ff4fc09d6f0 2023-10-03T10:14:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff5021aa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4fc09d6f0 0x7ff4fc1315f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff5021aa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4fc09d6f0 0x7ff4fc1315f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60472/0 (socket says 172.21.15.72:60472) 2023-10-03T10:14:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff5029ab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4fc09e410 0x7ff4fc132070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff5021aa700 1 -- 172.21.15.72:0/3553776341 learned_addr learned my addr 172.21.15.72:0/3553776341 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff5019a9700 1 --2- 172.21.15.72:0/3553776341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4fc09e000 0x7ff4fc131b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff5021aa700 1 -- 172.21.15.72:0/3553776341 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4fc09e410 msgr2=0x7ff4fc132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff5021aa700 1 --2- 172.21.15.72:0/3553776341 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4fc09e410 0x7ff4fc132070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff5021aa700 1 -- 172.21.15.72:0/3553776341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4fc09e000 msgr2=0x7ff4fc131b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff5021aa700 1 --2- 172.21.15.72:0/3553776341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4fc09e000 0x7ff4fc131b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff5021aa700 1 -- 172.21.15.72:0/3553776341 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f4009b30 con 0x7ff4fc09d6f0 2023-10-03T10:14:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff5019a9700 1 --2- 172.21.15.72:0/3553776341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4fc09e000 0x7ff4fc131b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff5029ab700 1 --2- 172.21.15.72:0/3553776341 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4fc09e410 0x7ff4fc132070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff5021aa700 1 --2- 172.21.15.72:0/3553776341 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4fc09d6f0 0x7ff4fc1315f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800e9b0 tx=0x7ff4f800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.667+0000 7ff4f2ffd700 1 -- 172.21.15.72:0/3553776341 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8009710 con 0x7ff4fc09d6f0 2023-10-03T10:14:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.668+0000 7ff4f2ffd700 1 -- 172.21.15.72:0/3553776341 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f800ee50 con 0x7ff4fc09d6f0 2023-10-03T10:14:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.668+0000 7ff50440e700 1 -- 172.21.15.72:0/3553776341 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4fc09c700 con 0x7ff4fc09d6f0 2023-10-03T10:14:12.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.668+0000 7ff4f2ffd700 1 -- 172.21.15.72:0/3553776341 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f800ca50 con 0x7ff4fc09d6f0 2023-10-03T10:14:12.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.668+0000 7ff50440e700 1 -- 172.21.15.72:0/3553776341 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4fc1328f0 con 0x7ff4fc09d6f0 2023-10-03T10:14:12.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.668+0000 7ff4f2ffd700 1 -- 172.21.15.72:0/3553776341 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4f800cbb0 con 0x7ff4fc09d6f0 2023-10-03T10:14:12.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.668+0000 7ff4f2ffd700 1 -- 172.21.15.72:0/3553776341 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff4f803f860 con 0x7ff4fc09d6f0 2023-10-03T10:14:12.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.668+0000 7ff50440e700 1 -- 172.21.15.72:0/3553776341 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4fc074ea0 con 0x7ff4fc09d6f0 2023-10-03T10:14:12.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.673+0000 7ff4f2ffd700 1 -- 172.21.15.72:0/3553776341 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4f8021030 con 0x7ff4fc09d6f0 2023-10-03T10:14:12.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.690+0000 7fd0b5a5c700 1 Processor -- start 2023-10-03T10:14:12.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.690+0000 7fd0b5a5c700 1 -- start start 2023-10-03T10:14:12.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.690+0000 7fd0b5a5c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd0b00a1510 0x7fd0b0138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.690+0000 7fd0b5a5c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0b0139250 0x7fd0b013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.690+0000 7fd0b5a5c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b009edd0 con 0x7fd0b00a0a30 2023-10-03T10:14:12.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.690+0000 7fd0b5a5c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b00a18e0 con 0x7fd0b0139250 2023-10-03T10:14:12.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.690+0000 7fd0b5a5c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b009e1f0 con 0x7fd0b00a1510 2023-10-03T10:14:12.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.691+0000 7fd0ae7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd0b00a1510 0x7fd0b0138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.691+0000 7fd0af7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0b0139250 0x7fd0b013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.691+0000 7fd0ae7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd0b00a1510 0x7fd0b0138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60488/0 (socket says 172.21.15.72:60488) 2023-10-03T10:14:12.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.691+0000 7fd0ae7fc700 1 -- 172.21.15.72:0/3225335843 learned_addr learned my addr 172.21.15.72:0/3225335843 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:12.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.691+0000 7fd0af7fe700 1 -- 172.21.15.72:0/3225335843 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd0b00a1510 msgr2=0x7fd0b0138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:12.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.691+0000 7fd0af7fe700 1 --2- 172.21.15.72:0/3225335843 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd0b00a1510 0x7fd0b0138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.691+0000 7fd0af7fe700 1 -- 172.21.15.72:0/3225335843 >> v1:172.21.15.72:6789/0 conn(0x7fd0b00a0a30 legacy=0x7fd0b00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.691+0000 7fd0af7fe700 1 -- 172.21.15.72:0/3225335843 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b009dc50 con 0x7fd0b0139250 2023-10-03T10:14:12.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.691+0000 7fd0af7fe700 1 --2- 172.21.15.72:0/3225335843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0b0139250 0x7fd0b013b630 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009dc0 tx=0x7fd0a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ecae0f537d4ba8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.691+0000 7fd0adffb700 1 -- 172.21.15.72:0/3225335843 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a800e070 con 0x7fd0b0139250 2023-10-03T10:14:12.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.691+0000 7fd0adffb700 1 -- 172.21.15.72:0/3225335843 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a800bae0 con 0x7fd0b0139250 2023-10-03T10:14:12.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.691+0000 7fd0adffb700 1 -- 172.21.15.72:0/3225335843 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a800be90 con 0x7fd0b0139250 2023-10-03T10:14:12.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.692+0000 7fd0b5a5c700 1 -- 172.21.15.72:0/3225335843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0b0139250 msgr2=0x7fd0b013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.692+0000 7fd0b5a5c700 1 --2- 172.21.15.72:0/3225335843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0b0139250 0x7fd0b013b630 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009dc0 tx=0x7fd0a800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.692+0000 7fd0b5a5c700 1 -- 172.21.15.72:0/3225335843 shutdown_connections 2023-10-03T10:14:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.692+0000 7fd0b5a5c700 1 --2- 172.21.15.72:0/3225335843 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0b0139250 0x7fd0b013b630 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.692+0000 7fd0b5a5c700 1 --2- 172.21.15.72:0/3225335843 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd0b00a1510 0x7fd0b0138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.692+0000 7fd0b5a5c700 1 -- 172.21.15.72:0/3225335843 >> 172.21.15.72:0/3225335843 conn(0x7fd0b00a6550 msgr2=0x7fd0b00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.692+0000 7fd0b5a5c700 1 -- 172.21.15.72:0/3225335843 shutdown_connections 2023-10-03T10:14:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.692+0000 7fd0b5a5c700 1 -- 172.21.15.72:0/3225335843 wait complete. 2023-10-03T10:14:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.693+0000 7fd0b5a5c700 1 Processor -- start 2023-10-03T10:14:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.693+0000 7fd0b5a5c700 1 -- start start 2023-10-03T10:14:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0b5a5c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0b00a0a30 0x7fd0b01228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0b5a5c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd0b00a1510 0x7fd0b0122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0b5a5c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0b0139250 0x7fd0b0123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0b5a5c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b01261f0 con 0x7fd0b0139250 2023-10-03T10:14:12.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0b5a5c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b01263d0 con 0x7fd0b00a0a30 2023-10-03T10:14:12.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0b5a5c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00a0220 con 0x7fd0b00a1510 2023-10-03T10:14:12.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0ae7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd0b00a1510 0x7fd0b0122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0ae7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd0b00a1510 0x7fd0b0122df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60504/0 (socket says 172.21.15.72:60504) 2023-10-03T10:14:12.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0ae7fc700 1 -- 172.21.15.72:0/555617577 learned_addr learned my addr 172.21.15.72:0/555617577 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:12.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0af7fe700 1 --2- 172.21.15.72:0/555617577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0b0139250 0x7fd0b0123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0ae7fc700 1 -- 172.21.15.72:0/555617577 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0b00a0a30 msgr2=0x7fd0b01228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0ae7fc700 1 --2- 172.21.15.72:0/555617577 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0b00a0a30 0x7fd0b01228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0ae7fc700 1 -- 172.21.15.72:0/555617577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0b0139250 msgr2=0x7fd0b0123330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0ae7fc700 1 --2- 172.21.15.72:0/555617577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0b0139250 0x7fd0b0123330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0ae7fc700 1 -- 172.21.15.72:0/555617577 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a8009a70 con 0x7fd0b00a1510 2023-10-03T10:14:12.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0af7fe700 1 --2- 172.21.15.72:0/555617577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0b0139250 0x7fd0b0123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:12.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0ae7fc700 1 --2- 172.21.15.72:0/555617577 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd0b00a1510 0x7fd0b0122df0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400e940 tx=0x7fd0a400ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd097fff700 1 -- 172.21.15.72:0/555617577 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a40096a0 con 0x7fd0b00a1510 2023-10-03T10:14:12.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd097fff700 1 -- 172.21.15.72:0/555617577 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a400ee90 con 0x7fd0b00a1510 2023-10-03T10:14:12.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd0b5a5c700 1 -- 172.21.15.72:0/555617577 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b01387a0 con 0x7fd0b00a1510 2023-10-03T10:14:12.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.694+0000 7fd097fff700 1 -- 172.21.15.72:0/555617577 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a400ca90 con 0x7fd0b00a1510 2023-10-03T10:14:12.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.695+0000 7fd0b5a5c700 1 -- 172.21.15.72:0/555617577 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b0124c70 con 0x7fd0b00a1510 2023-10-03T10:14:12.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.695+0000 7fd097fff700 1 -- 172.21.15.72:0/555617577 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd0a400cbf0 con 0x7fd0b00a1510 2023-10-03T10:14:12.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.695+0000 7fd097fff700 1 -- 172.21.15.72:0/555617577 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd0a40421c0 con 0x7fd0b00a1510 2023-10-03T10:14:12.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.696+0000 7fd0b5a5c700 1 -- 172.21.15.72:0/555617577 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b0074ea0 con 0x7fd0b00a1510 2023-10-03T10:14:12.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.701+0000 7fd097fff700 1 -- 172.21.15.72:0/555617577 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd0a4017020 con 0x7fd0b00a1510 2023-10-03T10:14:12.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.777+0000 7f8757faa700 1 -- 172.21.15.72:0/4287609263 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f875009f420 con 0x7f8750139170 2023-10-03T10:14:12.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.778+0000 7f87467fc700 1 -- 172.21.15.72:0/4287609263 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8748012340 con 0x7f8750139170 2023-10-03T10:14:12.777 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:12.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.780+0000 7f8757faa700 1 -- 172.21.15.72:0/4287609263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8750139170 msgr2=0x7f875011f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.780+0000 7f8757faa700 1 --2- 172.21.15.72:0/4287609263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8750139170 0x7f875011f0f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8748009ef0 tx=0x7f874800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.780+0000 7f8757faa700 1 -- 172.21.15.72:0/4287609263 shutdown_connections 2023-10-03T10:14:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.780+0000 7f8757faa700 1 --2- 172.21.15.72:0/4287609263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875009d6f0 0x7f875011e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.780+0000 7f8757faa700 1 --2- 172.21.15.72:0/4287609263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8750139170 0x7f875011f0f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.780+0000 7f8757faa700 1 --2- 172.21.15.72:0/4287609263 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875009e1d0 0x7f875011ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.780+0000 7f8757faa700 1 -- 172.21.15.72:0/4287609263 >> 172.21.15.72:0/4287609263 conn(0x7f8750066f50 msgr2=0x7f875009b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.780+0000 7f8757faa700 1 -- 172.21.15.72:0/4287609263 shutdown_connections 2023-10-03T10:14:12.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.780+0000 7f8757faa700 1 -- 172.21.15.72:0/4287609263 wait complete. 2023-10-03T10:14:12.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:12.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.873+0000 7ff50440e700 1 -- 172.21.15.72:0/3553776341 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff4fc1336a0 con 0x7ff4fc09d6f0 2023-10-03T10:14:12.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.873+0000 7ff4f2ffd700 1 -- 172.21.15.72:0/3553776341 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4f802a090 con 0x7ff4fc09d6f0 2023-10-03T10:14:12.873 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:12.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.875+0000 7ff50440e700 1 -- 172.21.15.72:0/3553776341 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4fc09d6f0 msgr2=0x7ff4fc1315f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.875+0000 7ff50440e700 1 --2- 172.21.15.72:0/3553776341 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4fc09d6f0 0x7ff4fc1315f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800e9b0 tx=0x7ff4f800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.875+0000 7ff50440e700 1 -- 172.21.15.72:0/3553776341 shutdown_connections 2023-10-03T10:14:12.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.875+0000 7ff50440e700 1 --2- 172.21.15.72:0/3553776341 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4fc09e410 0x7ff4fc132070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.875+0000 7ff50440e700 1 --2- 172.21.15.72:0/3553776341 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4fc09d6f0 0x7ff4fc1315f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.875+0000 7ff50440e700 1 --2- 172.21.15.72:0/3553776341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4fc09e000 0x7ff4fc131b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.875+0000 7ff50440e700 1 -- 172.21.15.72:0/3553776341 >> 172.21.15.72:0/3553776341 conn(0x7ff4fc066f50 msgr2=0x7ff4fc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.875+0000 7ff50440e700 1 -- 172.21.15.72:0/3553776341 shutdown_connections 2023-10-03T10:14:12.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.875+0000 7ff50440e700 1 -- 172.21.15.72:0/3553776341 wait complete. 2023-10-03T10:14:12.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:12.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.895+0000 7fd0b5a5c700 1 -- 172.21.15.72:0/555617577 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd0b0126050 con 0x7fd0b00a1510 2023-10-03T10:14:12.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.896+0000 7fd097fff700 1 -- 172.21.15.72:0/555617577 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd0b0126050 con 0x7fd0b00a1510 2023-10-03T10:14:12.895 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.898+0000 7fd0b5a5c700 1 -- 172.21.15.72:0/555617577 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd0b00a1510 msgr2=0x7fd0b0122df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.898+0000 7fd0b5a5c700 1 --2- 172.21.15.72:0/555617577 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd0b00a1510 0x7fd0b0122df0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400e940 tx=0x7fd0a400ec50 comp rx=0 tx=0).stop 2023-10-03T10:14:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.898+0000 7fd0b5a5c700 1 -- 172.21.15.72:0/555617577 shutdown_connections 2023-10-03T10:14:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.898+0000 7fd0b5a5c700 1 --2- 172.21.15.72:0/555617577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0b0139250 0x7fd0b0123330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.898+0000 7fd0b5a5c700 1 --2- 172.21.15.72:0/555617577 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0b00a0a30 0x7fd0b01228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.898+0000 7fd0b5a5c700 1 --2- 172.21.15.72:0/555617577 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd0b00a1510 0x7fd0b0122df0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.898+0000 7fd0b5a5c700 1 -- 172.21.15.72:0/555617577 >> 172.21.15.72:0/555617577 conn(0x7fd0b00a6550 msgr2=0x7fd0b009ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.898+0000 7fd0b5a5c700 1 -- 172.21.15.72:0/555617577 shutdown_connections 2023-10-03T10:14:12.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:12.898+0000 7fd0b5a5c700 1 -- 172.21.15.72:0/555617577 wait complete. 2023-10-03T10:14:12.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:13.629 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:13.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.758+0000 7f56fee1f700 1 Processor -- start 2023-10-03T10:14:13.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.758+0000 7f56fee1f700 1 -- start start 2023-10-03T10:14:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.758+0000 7f56fee1f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f81338a0 0x7f56f8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.758+0000 7f56fee1f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56f809de50 0x7f56f809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.758+0000 7f56fee1f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f806ef30 con 0x7f56f809e760 2023-10-03T10:14:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.758+0000 7f56fee1f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f806fef0 con 0x7f56f809de50 2023-10-03T10:14:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.758+0000 7f56fee1f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f81334b0 con 0x7f56f81338a0 2023-10-03T10:14:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.758+0000 7f56fcbbb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f81338a0 0x7f56f8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.758+0000 7f56f7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56f809de50 0x7f56f809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.758+0000 7f56f7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56f809de50 0x7f56f809e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35610/0 (socket says 172.21.15.72:35610) 2023-10-03T10:14:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.758+0000 7f56fcbbb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f81338a0 0x7f56f8133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54502/0 (socket says 172.21.15.72:54502) 2023-10-03T10:14:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.758+0000 7f56f7fff700 1 -- 172.21.15.72:0/1350113593 learned_addr learned my addr 172.21.15.72:0/1350113593 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.759+0000 7f56f7fff700 1 -- 172.21.15.72:0/1350113593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f81338a0 msgr2=0x7f56f8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.759+0000 7f56f7fff700 1 --2- 172.21.15.72:0/1350113593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f81338a0 0x7f56f8133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.759+0000 7f56f7fff700 1 -- 172.21.15.72:0/1350113593 >> v1:172.21.15.72:6789/0 conn(0x7f56f809e760 legacy=0x7f56f813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.759+0000 7f56f7fff700 1 -- 172.21.15.72:0/1350113593 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f806fc30 con 0x7f56f809de50 2023-10-03T10:14:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.759+0000 7f56fcbbb700 1 --2- 172.21.15.72:0/1350113593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f81338a0 0x7f56f8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.759+0000 7f56f7fff700 1 --2- 172.21.15.72:0/1350113593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f809de50 0x7f56f809e220 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f56e40098f0 tx=0x7f56e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8343af4d947e87e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.759+0000 7f56f77fe700 1 -- 172.21.15.72:0/1350113593 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4011830 con 0x7f56f809de50 2023-10-03T10:14:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.759+0000 7f56f77fe700 1 -- 172.21.15.72:0/1350113593 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e4011990 con 0x7f56f809de50 2023-10-03T10:14:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.759+0000 7f56f77fe700 1 -- 172.21.15.72:0/1350113593 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4011d20 con 0x7f56f809de50 2023-10-03T10:14:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.759+0000 7f56fee1f700 1 -- 172.21.15.72:0/1350113593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f809de50 msgr2=0x7f56f809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.759+0000 7f56fee1f700 1 --2- 172.21.15.72:0/1350113593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f809de50 0x7f56f809e220 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f56e40098f0 tx=0x7f56e4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.760+0000 7f56fee1f700 1 -- 172.21.15.72:0/1350113593 shutdown_connections 2023-10-03T10:14:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.760+0000 7f56fee1f700 1 --2- 172.21.15.72:0/1350113593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f81338a0 0x7f56f8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.760+0000 7f56fee1f700 1 --2- 172.21.15.72:0/1350113593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f809de50 0x7f56f809e220 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.760+0000 7f56fee1f700 1 -- 172.21.15.72:0/1350113593 >> 172.21.15.72:0/1350113593 conn(0x7f56f80a2aa0 msgr2=0x7f56f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.760+0000 7f56fee1f700 1 -- 172.21.15.72:0/1350113593 shutdown_connections 2023-10-03T10:14:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.760+0000 7f56fee1f700 1 -- 172.21.15.72:0/1350113593 wait complete. 2023-10-03T10:14:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.760+0000 7f56fee1f700 1 Processor -- start 2023-10-03T10:14:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.760+0000 7f56fee1f700 1 -- start start 2023-10-03T10:14:13.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56fee1f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f809de50 0x7f56f811eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56fee1f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f809e760 0x7f56f811f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56fee1f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56f81338a0 0x7f56f811f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56fee1f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f8121ea0 con 0x7f56f809de50 2023-10-03T10:14:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56fee1f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f8122080 con 0x7f56f809e760 2023-10-03T10:14:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56fee1f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56f812f690 con 0x7f56f81338a0 2023-10-03T10:14:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56fcbbb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f809de50 0x7f56f811eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56f7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f809e760 0x7f56f811f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56fcbbb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f809de50 0x7f56f811eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35620/0 (socket says 172.21.15.72:35620) 2023-10-03T10:14:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56fcbbb700 1 -- 172.21.15.72:0/1895381390 learned_addr learned my addr 172.21.15.72:0/1895381390 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56fd3bc700 1 --2- 172.21.15.72:0/1895381390 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56f81338a0 0x7f56f811f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56f7fff700 1 -- 172.21.15.72:0/1895381390 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56f81338a0 msgr2=0x7f56f811f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56f7fff700 1 --2- 172.21.15.72:0/1895381390 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56f81338a0 0x7f56f811f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56f7fff700 1 -- 172.21.15.72:0/1895381390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f809de50 msgr2=0x7f56f811eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56f7fff700 1 --2- 172.21.15.72:0/1895381390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f809de50 0x7f56f811eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56f7fff700 1 -- 172.21.15.72:0/1895381390 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec0094a0 con 0x7f56f809e760 2023-10-03T10:14:13.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.761+0000 7f56fcbbb700 1 --2- 172.21.15.72:0/1895381390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f809de50 0x7f56f811eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:13.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.762+0000 7f56f7fff700 1 --2- 172.21.15.72:0/1895381390 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f809e760 0x7f56f811f040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f56e4016000 tx=0x7f56e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.762+0000 7f56f57fa700 1 -- 172.21.15.72:0/1895381390 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4004510 con 0x7f56f809e760 2023-10-03T10:14:13.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.762+0000 7f56f57fa700 1 -- 172.21.15.72:0/1895381390 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e401e070 con 0x7f56f809e760 2023-10-03T10:14:13.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.762+0000 7f56fee1f700 1 -- 172.21.15.72:0/1895381390 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e4009550 con 0x7f56f809e760 2023-10-03T10:14:13.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.762+0000 7f56f57fa700 1 -- 172.21.15.72:0/1895381390 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e40038e0 con 0x7f56f809e760 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.762+0000 7f56fee1f700 1 -- 172.21.15.72:0/1895381390 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f806f640 con 0x7f56f809e760 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.762+0000 7f56f57fa700 1 -- 172.21.15.72:0/1895381390 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56e4003a40 con 0x7f56f809e760 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.763+0000 7f56f57fa700 1 -- 172.21.15.72:0/1895381390 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f56e4040420 con 0x7f56f809e760 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.763+0000 7f56fee1f700 1 -- 172.21.15.72:0/1895381390 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f8074ea0 con 0x7f56f809e760 2023-10-03T10:14:13.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.767+0000 7f56f57fa700 1 -- 172.21.15.72:0/1895381390 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56e4015080 con 0x7f56f809e760 2023-10-03T10:14:13.797 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:13.888 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:13.910 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:13.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.924+0000 7f28c91e3700 1 Processor -- start 2023-10-03T10:14:13.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.924+0000 7f28c91e3700 1 -- start start 2023-10-03T10:14:13.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c91e3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28c409d6f0 0x7f28c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c91e3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f28c409e000 0x7f28c41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c91e3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28c409e410 0x7f28c4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c91e3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c406b460 con 0x7f28c409e000 2023-10-03T10:14:13.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c91e3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c409b120 con 0x7f28c409d6f0 2023-10-03T10:14:13.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c91e3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28c409a7e0 con 0x7f28c409e410 2023-10-03T10:14:13.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f28c409e000 0x7f28c41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f28c409e000 0x7f28c41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35622/0 (socket says 172.21.15.72:35622) 2023-10-03T10:14:13.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c259c700 1 -- 172.21.15.72:0/246326065 learned_addr learned my addr 172.21.15.72:0/246326065 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:13.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c2d9d700 1 --2- 172.21.15.72:0/246326065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28c409d6f0 0x7f28c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c359e700 1 --2- 172.21.15.72:0/246326065 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28c409e410 0x7f28c4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c259c700 1 -- 172.21.15.72:0/246326065 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28c409e410 msgr2=0x7f28c4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c259c700 1 --2- 172.21.15.72:0/246326065 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28c409e410 0x7f28c4133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c259c700 1 -- 172.21.15.72:0/246326065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28c409d6f0 msgr2=0x7f28c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:13.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c259c700 1 --2- 172.21.15.72:0/246326065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28c409d6f0 0x7f28c409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c259c700 1 -- 172.21.15.72:0/246326065 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c409a500 con 0x7f28c409e000 2023-10-03T10:14:13.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.925+0000 7f28c259c700 1 --2- 172.21.15.72:0/246326065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c409e000 0x7f28c41339f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f28b80098f0 tx=0x7f28b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2732ab04c229684e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.926+0000 7f28c1d9b700 1 -- 172.21.15.72:0/246326065 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8011830 con 0x7f28c409e000 2023-10-03T10:14:13.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.926+0000 7f28c1d9b700 1 -- 172.21.15.72:0/246326065 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b8011990 con 0x7f28c409e000 2023-10-03T10:14:13.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.926+0000 7f28c1d9b700 1 -- 172.21.15.72:0/246326065 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8011d20 con 0x7f28c409e000 2023-10-03T10:14:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.926+0000 7f28c91e3700 1 -- 172.21.15.72:0/246326065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c409e000 msgr2=0x7f28c41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.926+0000 7f28c91e3700 1 --2- 172.21.15.72:0/246326065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c409e000 0x7f28c41339f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f28b80098f0 tx=0x7f28b8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.926+0000 7f28c91e3700 1 -- 172.21.15.72:0/246326065 shutdown_connections 2023-10-03T10:14:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.926+0000 7f28c91e3700 1 --2- 172.21.15.72:0/246326065 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28c409e410 0x7f28c4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.926+0000 7f28c91e3700 1 --2- 172.21.15.72:0/246326065 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28c409d6f0 0x7f28c409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.926+0000 7f28c91e3700 1 --2- 172.21.15.72:0/246326065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c409e000 0x7f28c41339f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.926+0000 7f28c91e3700 1 -- 172.21.15.72:0/246326065 >> 172.21.15.72:0/246326065 conn(0x7f28c4066f50 msgr2=0x7f28c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.926+0000 7f28c91e3700 1 -- 172.21.15.72:0/246326065 shutdown_connections 2023-10-03T10:14:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.926+0000 7f28c91e3700 1 -- 172.21.15.72:0/246326065 wait complete. 2023-10-03T10:14:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.928+0000 7f28c91e3700 1 Processor -- start 2023-10-03T10:14:13.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.928+0000 7f28c91e3700 1 -- start start 2023-10-03T10:14:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.928+0000 7f28c91e3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28c409d6f0 0x7f28c41a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.928+0000 7f28c91e3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28c409e000 0x7f28c41a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.928+0000 7f28c91e3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c409e410 0x7f28c41a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.928+0000 7f28c91e3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c41a7bc0 con 0x7f28c409e410 2023-10-03T10:14:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.928+0000 7f28c91e3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c41a81e0 con 0x7f28c409e000 2023-10-03T10:14:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.928+0000 7f28c91e3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28c41a8e10 con 0x7f28c409d6f0 2023-10-03T10:14:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28c2d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28c409d6f0 0x7f28c41a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28c2d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28c409d6f0 0x7f28c41a5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60526/0 (socket says 172.21.15.72:60526) 2023-10-03T10:14:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28c2d9d700 1 -- 172.21.15.72:0/4051207533 learned_addr learned my addr 172.21.15.72:0/4051207533 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28c259c700 1 --2- 172.21.15.72:0/4051207533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28c409e000 0x7f28c41a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28c359e700 1 --2- 172.21.15.72:0/4051207533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c409e410 0x7f28c41a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:13.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28c2d9d700 1 -- 172.21.15.72:0/4051207533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28c409e000 msgr2=0x7f28c41a64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28c2d9d700 1 --2- 172.21.15.72:0/4051207533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28c409e000 0x7f28c41a64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28c2d9d700 1 -- 172.21.15.72:0/4051207533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c409e410 msgr2=0x7f28c41a6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28c2d9d700 1 --2- 172.21.15.72:0/4051207533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c409e410 0x7f28c41a6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28c2d9d700 1 -- 172.21.15.72:0/4051207533 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b8009550 con 0x7f28c409d6f0 2023-10-03T10:14:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28c259c700 1 --2- 172.21.15.72:0/4051207533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28c409e000 0x7f28c41a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28c2d9d700 1 --2- 172.21.15.72:0/4051207533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28c409d6f0 0x7f28c41a5fb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f28b400e9b0 tx=0x7f28b400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28ab7fe700 1 -- 172.21.15.72:0/4051207533 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4009710 con 0x7f28c409d6f0 2023-10-03T10:14:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28ab7fe700 1 -- 172.21.15.72:0/4051207533 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b400ee50 con 0x7f28c409d6f0 2023-10-03T10:14:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28c91e3700 1 -- 172.21.15.72:0/4051207533 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c41a97f0 con 0x7f28c409d6f0 2023-10-03T10:14:13.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28ab7fe700 1 -- 172.21.15.72:0/4051207533 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b400ca50 con 0x7f28c409d6f0 2023-10-03T10:14:13.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.929+0000 7f28c91e3700 1 -- 172.21.15.72:0/4051207533 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c409c710 con 0x7f28c409d6f0 2023-10-03T10:14:13.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.930+0000 7f28ab7fe700 1 -- 172.21.15.72:0/4051207533 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28b400cbb0 con 0x7f28c409d6f0 2023-10-03T10:14:13.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.930+0000 7f28ab7fe700 1 -- 172.21.15.72:0/4051207533 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f28b403f6e0 con 0x7f28c409d6f0 2023-10-03T10:14:13.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.931+0000 7f28c91e3700 1 -- 172.21.15.72:0/4051207533 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c409de20 con 0x7f28c409d6f0 2023-10-03T10:14:13.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.935+0000 7f28ab7fe700 1 -- 172.21.15.72:0/4051207533 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28b40232f0 con 0x7f28c409d6f0 2023-10-03T10:14:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.973+0000 7f56fee1f700 1 -- 172.21.15.72:0/1895381390 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f56f806b9e0 con 0x7f56f809e760 2023-10-03T10:14:13.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.973+0000 7f56f57fa700 1 -- 172.21.15.72:0/1895381390 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56e402d450 con 0x7f56f809e760 2023-10-03T10:14:13.973 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.975+0000 7f56fee1f700 1 -- 172.21.15.72:0/1895381390 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f809e760 msgr2=0x7f56f811f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.975+0000 7f56fee1f700 1 --2- 172.21.15.72:0/1895381390 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f809e760 0x7f56f811f040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f56e4016000 tx=0x7f56e4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.975+0000 7f56fee1f700 1 -- 172.21.15.72:0/1895381390 shutdown_connections 2023-10-03T10:14:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.975+0000 7f56fee1f700 1 --2- 172.21.15.72:0/1895381390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f809de50 0x7f56f811eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.975+0000 7f56fee1f700 1 --2- 172.21.15.72:0/1895381390 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56f81338a0 0x7f56f811f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.975+0000 7f56fee1f700 1 --2- 172.21.15.72:0/1895381390 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f809e760 0x7f56f811f040 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.975+0000 7f56fee1f700 1 -- 172.21.15.72:0/1895381390 >> 172.21.15.72:0/1895381390 conn(0x7f56f80a2aa0 msgr2=0x7f56f809edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.975+0000 7f56fee1f700 1 -- 172.21.15.72:0/1895381390 shutdown_connections 2023-10-03T10:14:13.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:13.975+0000 7f56fee1f700 1 -- 172.21.15.72:0/1895381390 wait complete. 2023-10-03T10:14:13.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:14.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.024+0000 7f887e3f3700 1 Processor -- start 2023-10-03T10:14:14.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.024+0000 7f887e3f3700 1 -- start start 2023-10-03T10:14:14.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.025+0000 7f887e3f3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88780a0a30 0x7f88780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.025+0000 7f887e3f3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f887809d630 0x7f88780a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.025+0000 7f887e3f3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88780a2a70 con 0x7f8878133930 2023-10-03T10:14:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.025+0000 7f887e3f3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88780a01d0 con 0x7f887809d630 2023-10-03T10:14:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.025+0000 7f887e3f3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887809e2b0 con 0x7f88780a0a30 2023-10-03T10:14:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.025+0000 7f8877fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88780a0a30 0x7f88780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.025+0000 7f8877fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88780a0a30 0x7f88780a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54536/0 (socket says 172.21.15.72:54536) 2023-10-03T10:14:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.025+0000 7f8877fff700 1 -- 172.21.15.72:0/2696786152 learned_addr learned my addr 172.21.15.72:0/2696786152 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.025+0000 7f88777fe700 1 --2- 172.21.15.72:0/2696786152 >> v2:172.21.15.72:3300/0 conn(0x7f887809d630 0x7f88780a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.025+0000 7f8877fff700 1 -- 172.21.15.72:0/2696786152 >> v2:172.21.15.72:3300/0 conn(0x7f887809d630 msgr2=0x7f88780a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.025+0000 7f8877fff700 1 --2- 172.21.15.72:0/2696786152 >> v2:172.21.15.72:3300/0 conn(0x7f887809d630 0x7f88780a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.025+0000 7f8877fff700 1 -- 172.21.15.72:0/2696786152 >> v1:172.21.15.72:6789/0 conn(0x7f8878133930 legacy=0x7f8878133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.025+0000 7f8877fff700 1 -- 172.21.15.72:0/2696786152 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887809dc50 con 0x7f88780a0a30 2023-10-03T10:14:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.025+0000 7f88777fe700 1 --2- 172.21.15.72:0/2696786152 >> v2:172.21.15.72:3300/0 conn(0x7f887809d630 0x7f88780a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.026+0000 7f8877fff700 1 --2- 172.21.15.72:0/2696786152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88780a0a30 0x7f88780a0e00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f88680098f0 tx=0x7f8868009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=839d0c83e8cf3b0e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.026+0000 7f8876ffd700 1 -- 172.21.15.72:0/2696786152 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868011830 con 0x7f88780a0a30 2023-10-03T10:14:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.026+0000 7f8876ffd700 1 -- 172.21.15.72:0/2696786152 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8868011990 con 0x7f88780a0a30 2023-10-03T10:14:14.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.026+0000 7f8876ffd700 1 -- 172.21.15.72:0/2696786152 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868011d20 con 0x7f88780a0a30 2023-10-03T10:14:14.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.026+0000 7f887e3f3700 1 -- 172.21.15.72:0/2696786152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88780a0a30 msgr2=0x7f88780a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.026+0000 7f887e3f3700 1 --2- 172.21.15.72:0/2696786152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88780a0a30 0x7f88780a0e00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f88680098f0 tx=0x7f8868009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:14.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.026+0000 7f887e3f3700 1 -- 172.21.15.72:0/2696786152 shutdown_connections 2023-10-03T10:14:14.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.026+0000 7f887e3f3700 1 --2- 172.21.15.72:0/2696786152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88780a0a30 0x7f88780a0e00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.026+0000 7f887e3f3700 1 --2- 172.21.15.72:0/2696786152 >> v2:172.21.15.72:3300/0 conn(0x7f887809d630 0x7f88780a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.026+0000 7f887e3f3700 1 -- 172.21.15.72:0/2696786152 >> 172.21.15.72:0/2696786152 conn(0x7f88780a3050 msgr2=0x7f88780a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.026+0000 7f887e3f3700 1 -- 172.21.15.72:0/2696786152 shutdown_connections 2023-10-03T10:14:14.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.026+0000 7f887e3f3700 1 -- 172.21.15.72:0/2696786152 wait complete. 2023-10-03T10:14:14.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.027+0000 7f887e3f3700 1 Processor -- start 2023-10-03T10:14:14.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f887e3f3700 1 -- start start 2023-10-03T10:14:14.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f887e3f3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f887809d630 0x7f88781c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f887e3f3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88780a0a30 0x7f88781c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f887e3f3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8878133930 0x7f88781c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f887e3f3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8878122430 con 0x7f887809d630 2023-10-03T10:14:14.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f887e3f3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8878120720 con 0x7f88780a0a30 2023-10-03T10:14:14.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f887e3f3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88780a5040 con 0x7f8878133930 2023-10-03T10:14:14.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f88777fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88780a0a30 0x7f88781c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f88777fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88780a0a30 0x7f88781c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54542/0 (socket says 172.21.15.72:54542) 2023-10-03T10:14:14.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f88777fe700 1 -- 172.21.15.72:0/2645688399 learned_addr learned my addr 172.21.15.72:0/2645688399 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:14.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f8877fff700 1 --2- 172.21.15.72:0/2645688399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f887809d630 0x7f88781c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f887c990700 1 --2- 172.21.15.72:0/2645688399 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8878133930 0x7f88781c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f88777fe700 1 -- 172.21.15.72:0/2645688399 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8878133930 msgr2=0x7f88781c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f88777fe700 1 --2- 172.21.15.72:0/2645688399 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8878133930 0x7f88781c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f88777fe700 1 -- 172.21.15.72:0/2645688399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f887809d630 msgr2=0x7f88781c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f88777fe700 1 --2- 172.21.15.72:0/2645688399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f887809d630 0x7f88781c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f88777fe700 1 -- 172.21.15.72:0/2645688399 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c0094a0 con 0x7f88780a0a30 2023-10-03T10:14:14.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.028+0000 7f8877fff700 1 --2- 172.21.15.72:0/2645688399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f887809d630 0x7f88781c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.029+0000 7f88777fe700 1 --2- 172.21.15.72:0/2645688399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88780a0a30 0x7f88781c86e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f886c00ebb0 tx=0x7f886c00eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.029+0000 7f8874ff9700 1 -- 172.21.15.72:0/2645688399 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c00c850 con 0x7f88780a0a30 2023-10-03T10:14:14.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.029+0000 7f8874ff9700 1 -- 172.21.15.72:0/2645688399 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c00c9b0 con 0x7f88780a0a30 2023-10-03T10:14:14.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.029+0000 7f887e3f3700 1 -- 172.21.15.72:0/2645688399 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8868009550 con 0x7f88780a0a30 2023-10-03T10:14:14.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.029+0000 7f8874ff9700 1 -- 172.21.15.72:0/2645688399 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c00cd40 con 0x7f88780a0a30 2023-10-03T10:14:14.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.029+0000 7f887e3f3700 1 -- 172.21.15.72:0/2645688399 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88781335c0 con 0x7f88780a0a30 2023-10-03T10:14:14.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.030+0000 7f8874ff9700 1 -- 172.21.15.72:0/2645688399 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f886c013470 con 0x7f88780a0a30 2023-10-03T10:14:14.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.030+0000 7f8874ff9700 1 -- 172.21.15.72:0/2645688399 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f886c03faf0 con 0x7f88780a0a30 2023-10-03T10:14:14.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.030+0000 7f887e3f3700 1 -- 172.21.15.72:0/2645688399 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88780747f0 con 0x7f88780a0a30 2023-10-03T10:14:14.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.035+0000 7f8874ff9700 1 -- 172.21.15.72:0/2645688399 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f886c01b3b0 con 0x7f88780a0a30 2023-10-03T10:14:14.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.055+0000 7f2f32048700 1 Processor -- start 2023-10-03T10:14:14.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.056+0000 7f2f32048700 1 -- start start 2023-10-03T10:14:14.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.056+0000 7f2f32048700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f2c09e1d0 0x7f2f2c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.056+0000 7f2f32048700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f2c135e50 0x7f2f2c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.056+0000 7f2f32048700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c09f130 con 0x7f2f2c09d6f0 2023-10-03T10:14:14.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.056+0000 7f2f32048700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c09f520 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.056+0000 7f2f32048700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c09e930 con 0x7f2f2c135e50 2023-10-03T10:14:14.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.056+0000 7f2f2affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f2c09e1d0 0x7f2f2c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.056+0000 7f2f2affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f2c09e1d0 0x7f2f2c135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35672/0 (socket says 172.21.15.72:35672) 2023-10-03T10:14:14.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.056+0000 7f2f2affd700 1 -- 172.21.15.72:0/222716014 learned_addr learned my addr 172.21.15.72:0/222716014 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:14.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.056+0000 7f2f2bfff700 1 --2- 172.21.15.72:0/222716014 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f2c135e50 0x7f2f2c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.056+0000 7f2f2affd700 1 -- 172.21.15.72:0/222716014 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f2c135e50 msgr2=0x7f2f2c138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.056+0000 7f2f2affd700 1 --2- 172.21.15.72:0/222716014 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f2c135e50 0x7f2f2c138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.056+0000 7f2f2affd700 1 -- 172.21.15.72:0/222716014 >> v1:172.21.15.72:6789/0 conn(0x7f2f2c09d6f0 legacy=0x7f2f2c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.057+0000 7f2f2affd700 1 -- 172.21.15.72:0/222716014 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c09b2d0 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.057+0000 7f2f2bfff700 1 --2- 172.21.15.72:0/222716014 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f2c135e50 0x7f2f2c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.057+0000 7f2f2affd700 1 --2- 172.21.15.72:0/222716014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f2c09e1d0 0x7f2f2c135910 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2f200098f0 tx=0x7f2f20009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0223e470fd0e67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.057+0000 7f2f2a7fc700 1 -- 172.21.15.72:0/222716014 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f20011830 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.057+0000 7f2f2a7fc700 1 -- 172.21.15.72:0/222716014 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f20011990 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.057+0000 7f2f2a7fc700 1 -- 172.21.15.72:0/222716014 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f20011d20 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.057+0000 7f2f32048700 1 -- 172.21.15.72:0/222716014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f2c09e1d0 msgr2=0x7f2f2c135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.057+0000 7f2f32048700 1 --2- 172.21.15.72:0/222716014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f2c09e1d0 0x7f2f2c135910 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2f200098f0 tx=0x7f2f20009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:14.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.058+0000 7f2f32048700 1 -- 172.21.15.72:0/222716014 shutdown_connections 2023-10-03T10:14:14.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.058+0000 7f2f32048700 1 --2- 172.21.15.72:0/222716014 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f2c135e50 0x7f2f2c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.058+0000 7f2f32048700 1 --2- 172.21.15.72:0/222716014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f2c09e1d0 0x7f2f2c135910 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.058+0000 7f2f32048700 1 -- 172.21.15.72:0/222716014 >> 172.21.15.72:0/222716014 conn(0x7f2f2c066f50 msgr2=0x7f2f2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.058+0000 7f2f32048700 1 -- 172.21.15.72:0/222716014 shutdown_connections 2023-10-03T10:14:14.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.058+0000 7f2f32048700 1 -- 172.21.15.72:0/222716014 wait complete. 2023-10-03T10:14:14.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.058+0000 7f2f32048700 1 Processor -- start 2023-10-03T10:14:14.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f32048700 1 -- start start 2023-10-03T10:14:14.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f32048700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f2c09d6f0 0x7f2f2c132850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f32048700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f2c09e1d0 0x7f2f2c132d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f32048700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f2c135e50 0x7f2f2c1332d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f32048700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c134a70 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f32048700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c0a2260 con 0x7f2f2c135e50 2023-10-03T10:14:14.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f32048700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c130400 con 0x7f2f2c09d6f0 2023-10-03T10:14:14.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f2affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f2c09e1d0 0x7f2f2c132d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f2affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f2c09e1d0 0x7f2f2c132d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35684/0 (socket says 172.21.15.72:35684) 2023-10-03T10:14:14.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f2affd700 1 -- 172.21.15.72:0/3733264865 learned_addr learned my addr 172.21.15.72:0/3733264865 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:14.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f2b7fe700 1 --2- 172.21.15.72:0/3733264865 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f2c09d6f0 0x7f2f2c132850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f2bfff700 1 --2- 172.21.15.72:0/3733264865 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f2c135e50 0x7f2f2c1332d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f2affd700 1 -- 172.21.15.72:0/3733264865 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f2c09d6f0 msgr2=0x7f2f2c132850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f2affd700 1 --2- 172.21.15.72:0/3733264865 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f2c09d6f0 0x7f2f2c132850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f2affd700 1 -- 172.21.15.72:0/3733264865 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f2c135e50 msgr2=0x7f2f2c1332d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.059+0000 7f2f2affd700 1 --2- 172.21.15.72:0/3733264865 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f2c135e50 0x7f2f2c1332d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.060+0000 7f2f2affd700 1 -- 172.21.15.72:0/3733264865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f24009a70 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.060+0000 7f2f2affd700 1 --2- 172.21.15.72:0/3733264865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f2c09e1d0 0x7f2f2c132d90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2f20000c00 tx=0x7f2f20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.060+0000 7f2f13fff700 1 -- 172.21.15.72:0/3733264865 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f20004480 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.060+0000 7f2f13fff700 1 -- 172.21.15.72:0/3733264865 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f20027070 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.060+0000 7f2f32048700 1 -- 172.21.15.72:0/3733264865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f20009550 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.060+0000 7f2f13fff700 1 -- 172.21.15.72:0/3733264865 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f200038e0 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.060+0000 7f2f32048700 1 -- 172.21.15.72:0/3733264865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c134c50 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.061+0000 7f2f13fff700 1 -- 172.21.15.72:0/3733264865 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f20029030 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.061+0000 7f2f13fff700 1 -- 172.21.15.72:0/3733264865 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2f20049690 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.061+0000 7f2f11ffb700 1 -- 172.21.15.72:0/3733264865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2c074ea0 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.066+0000 7f2f13fff700 1 -- 172.21.15.72:0/3733264865 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f20015020 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.134+0000 7f28c91e3700 1 -- 172.21.15.72:0/4051207533 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f28c4074ea0 con 0x7f28c409d6f0 2023-10-03T10:14:14.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.135+0000 7f28ab7fe700 1 -- 172.21.15.72:0/4051207533 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f28b4021020 con 0x7f28c409d6f0 2023-10-03T10:14:14.134 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:14.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.137+0000 7f28c91e3700 1 -- 172.21.15.72:0/4051207533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28c409d6f0 msgr2=0x7f28c41a5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.137+0000 7f28c91e3700 1 --2- 172.21.15.72:0/4051207533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28c409d6f0 0x7f28c41a5fb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f28b400e9b0 tx=0x7f28b400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.137+0000 7f28c91e3700 1 -- 172.21.15.72:0/4051207533 shutdown_connections 2023-10-03T10:14:14.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.137+0000 7f28c91e3700 1 --2- 172.21.15.72:0/4051207533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28c409e410 0x7f28c41a6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.137+0000 7f28c91e3700 1 --2- 172.21.15.72:0/4051207533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28c409d6f0 0x7f28c41a5fb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.137+0000 7f28c91e3700 1 --2- 172.21.15.72:0/4051207533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28c409e000 0x7f28c41a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.137+0000 7f28c91e3700 1 -- 172.21.15.72:0/4051207533 >> 172.21.15.72:0/4051207533 conn(0x7f28c4066f50 msgr2=0x7f28c41baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.137+0000 7f28c91e3700 1 -- 172.21.15.72:0/4051207533 shutdown_connections 2023-10-03T10:14:14.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.137+0000 7f28c91e3700 1 -- 172.21.15.72:0/4051207533 wait complete. 2023-10-03T10:14:14.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:14.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.232+0000 7f887e3f3700 1 -- 172.21.15.72:0/2645688399 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8878072980 con 0x7f88780a0a30 2023-10-03T10:14:14.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.233+0000 7f8874ff9700 1 -- 172.21.15.72:0/2645688399 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f886c017020 con 0x7f88780a0a30 2023-10-03T10:14:14.232 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.235+0000 7f887e3f3700 1 -- 172.21.15.72:0/2645688399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88780a0a30 msgr2=0x7f88781c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.235+0000 7f887e3f3700 1 --2- 172.21.15.72:0/2645688399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88780a0a30 0x7f88781c86e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f886c00ebb0 tx=0x7f886c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.235+0000 7f887e3f3700 1 -- 172.21.15.72:0/2645688399 shutdown_connections 2023-10-03T10:14:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.235+0000 7f887e3f3700 1 --2- 172.21.15.72:0/2645688399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f887809d630 0x7f88781c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.235+0000 7f887e3f3700 1 --2- 172.21.15.72:0/2645688399 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8878133930 0x7f88781c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.235+0000 7f887e3f3700 1 --2- 172.21.15.72:0/2645688399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88780a0a30 0x7f88781c86e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.235+0000 7f887e3f3700 1 -- 172.21.15.72:0/2645688399 >> 172.21.15.72:0/2645688399 conn(0x7f88780a3050 msgr2=0x7f88780a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.235+0000 7f887e3f3700 1 -- 172.21.15.72:0/2645688399 shutdown_connections 2023-10-03T10:14:14.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.235+0000 7f887e3f3700 1 -- 172.21.15.72:0/2645688399 wait complete. 2023-10-03T10:14:14.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:14.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.263+0000 7f2f11ffb700 1 -- 172.21.15.72:0/3733264865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2f2c119790 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.263+0000 7f2f13fff700 1 -- 172.21.15.72:0/3733264865 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2f2000b7a0 con 0x7f2f2c09e1d0 2023-10-03T10:14:14.263 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:14.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.265+0000 7f2f11ffb700 1 -- 172.21.15.72:0/3733264865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f2c09e1d0 msgr2=0x7f2f2c132d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.265+0000 7f2f11ffb700 1 --2- 172.21.15.72:0/3733264865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f2c09e1d0 0x7f2f2c132d90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2f20000c00 tx=0x7f2f20004750 comp rx=0 tx=0).stop 2023-10-03T10:14:14.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.265+0000 7f2f11ffb700 1 -- 172.21.15.72:0/3733264865 shutdown_connections 2023-10-03T10:14:14.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.265+0000 7f2f11ffb700 1 --2- 172.21.15.72:0/3733264865 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f2c135e50 0x7f2f2c1332d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.265+0000 7f2f11ffb700 1 --2- 172.21.15.72:0/3733264865 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f2c09d6f0 0x7f2f2c132850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.265+0000 7f2f11ffb700 1 --2- 172.21.15.72:0/3733264865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f2c09e1d0 0x7f2f2c132d90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.265+0000 7f2f11ffb700 1 -- 172.21.15.72:0/3733264865 >> 172.21.15.72:0/3733264865 conn(0x7f2f2c066f50 msgr2=0x7f2f2c06e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.265+0000 7f2f11ffb700 1 -- 172.21.15.72:0/3733264865 shutdown_connections 2023-10-03T10:14:14.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:14.265+0000 7f2f11ffb700 1 -- 172.21.15.72:0/3733264865 wait complete. 2023-10-03T10:14:14.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:14.994 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:15.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.121+0000 7f0ac6d97700 1 Processor -- start 2023-10-03T10:14:15.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.121+0000 7f0ac6d97700 1 -- start start 2023-10-03T10:14:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.121+0000 7f0ac6d97700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ac009d6f0 0x7f0ac009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.121+0000 7f0ac6d97700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ac009e000 0x7f0ac0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.121+0000 7f0ac6d97700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ac009e410 0x7f0ac0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.121+0000 7f0ac6d97700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac009f520 con 0x7f0ac009e000 2023-10-03T10:14:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.121+0000 7f0ac6d97700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac009f130 con 0x7f0ac009e410 2023-10-03T10:14:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.121+0000 7f0ac6d97700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac009e930 con 0x7f0ac009d6f0 2023-10-03T10:14:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.121+0000 7f0ac5334700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ac009e410 0x7f0ac0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.121+0000 7f0ac4b33700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ac009d6f0 0x7f0ac009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.121+0000 7f0abffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ac009e000 0x7f0ac0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.121+0000 7f0ac5334700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ac009e410 0x7f0ac0130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54552/0 (socket says 172.21.15.72:54552) 2023-10-03T10:14:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.121+0000 7f0ac4b33700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ac009d6f0 0x7f0ac009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60562/0 (socket says 172.21.15.72:60562) 2023-10-03T10:14:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.121+0000 7f0ac5334700 1 -- 172.21.15.72:0/1624542844 learned_addr learned my addr 172.21.15.72:0/1624542844 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0ac5334700 1 -- 172.21.15.72:0/1624542844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ac009d6f0 msgr2=0x7f0ac009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0ac5334700 1 --2- 172.21.15.72:0/1624542844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ac009d6f0 0x7f0ac009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0ac5334700 1 -- 172.21.15.72:0/1624542844 >> v2:172.21.15.72:3300/0 conn(0x7f0ac009e000 msgr2=0x7f0ac0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0ac5334700 1 --2- 172.21.15.72:0/1624542844 >> v2:172.21.15.72:3300/0 conn(0x7f0ac009e000 0x7f0ac0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0ac5334700 1 -- 172.21.15.72:0/1624542844 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac009b2d0 con 0x7f0ac009e410 2023-10-03T10:14:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0ac4b33700 1 --2- 172.21.15.72:0/1624542844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ac009d6f0 0x7f0ac009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0ac5334700 1 --2- 172.21.15.72:0/1624542844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ac009e410 0x7f0ac0130ba0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800d150 tx=0x7f0ab800d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e41b4bc567ad720f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0abf7fe700 1 -- 172.21.15.72:0/1624542844 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8010070 con 0x7f0ac009e410 2023-10-03T10:14:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0abf7fe700 1 -- 172.21.15.72:0/1624542844 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab800dd10 con 0x7f0ac009e410 2023-10-03T10:14:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0abf7fe700 1 -- 172.21.15.72:0/1624542844 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab800b310 con 0x7f0ac009e410 2023-10-03T10:14:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0ac6d97700 1 -- 172.21.15.72:0/1624542844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ac009e410 msgr2=0x7f0ac0130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0ac6d97700 1 --2- 172.21.15.72:0/1624542844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ac009e410 0x7f0ac0130ba0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800d150 tx=0x7f0ab800d460 comp rx=0 tx=0).stop 2023-10-03T10:14:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0ac6d97700 1 -- 172.21.15.72:0/1624542844 shutdown_connections 2023-10-03T10:14:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0ac6d97700 1 --2- 172.21.15.72:0/1624542844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ac009e410 0x7f0ac0130ba0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0ac6d97700 1 --2- 172.21.15.72:0/1624542844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ac009d6f0 0x7f0ac009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.122+0000 7f0ac6d97700 1 --2- 172.21.15.72:0/1624542844 >> v2:172.21.15.72:3300/0 conn(0x7f0ac009e000 0x7f0ac0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.123+0000 7f0ac6d97700 1 -- 172.21.15.72:0/1624542844 >> 172.21.15.72:0/1624542844 conn(0x7f0ac0066f50 msgr2=0x7f0ac009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.123+0000 7f0ac6d97700 1 -- 172.21.15.72:0/1624542844 shutdown_connections 2023-10-03T10:14:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.123+0000 7f0ac6d97700 1 -- 172.21.15.72:0/1624542844 wait complete. 2023-10-03T10:14:15.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.123+0000 7f0ac6d97700 1 Processor -- start 2023-10-03T10:14:15.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.123+0000 7f0ac6d97700 1 -- start start 2023-10-03T10:14:15.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0ac6d97700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac009d6f0 0x7f0ac011e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0ac6d97700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ac009e000 0x7f0ac011e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0ac6d97700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ac009e410 0x7f0ac011ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0ac6d97700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac01303f0 con 0x7f0ac009d6f0 2023-10-03T10:14:15.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0ac6d97700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac0120240 con 0x7f0ac009e410 2023-10-03T10:14:15.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0ac6d97700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac0120e70 con 0x7f0ac009e000 2023-10-03T10:14:15.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0abffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ac009e000 0x7f0ac011e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0ac4b33700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac009d6f0 0x7f0ac011e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0abffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ac009e000 0x7f0ac011e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60570/0 (socket says 172.21.15.72:60570) 2023-10-03T10:14:15.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0abffff700 1 -- 172.21.15.72:0/1082766372 learned_addr learned my addr 172.21.15.72:0/1082766372 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:15.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0ac5334700 1 --2- 172.21.15.72:0/1082766372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ac009e410 0x7f0ac011ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0ac4b33700 1 -- 172.21.15.72:0/1082766372 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ac009e000 msgr2=0x7f0ac011e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0ac4b33700 1 --2- 172.21.15.72:0/1082766372 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ac009e000 0x7f0ac011e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0ac4b33700 1 -- 172.21.15.72:0/1082766372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ac009e410 msgr2=0x7f0ac011ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0ac4b33700 1 --2- 172.21.15.72:0/1082766372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ac009e410 0x7f0ac011ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0ac4b33700 1 -- 172.21.15.72:0/1082766372 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab40094a0 con 0x7f0ac009d6f0 2023-10-03T10:14:15.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.124+0000 7f0abffff700 1 --2- 172.21.15.72:0/1082766372 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ac009e000 0x7f0ac011e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:15.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.125+0000 7f0ac4b33700 1 --2- 172.21.15.72:0/1082766372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac009d6f0 0x7f0ac011e010 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400e9b0 tx=0x7f0ab400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.125+0000 7f0abd7fa700 1 -- 172.21.15.72:0/1082766372 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab400ee50 con 0x7f0ac009d6f0 2023-10-03T10:14:15.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.125+0000 7f0abd7fa700 1 -- 172.21.15.72:0/1082766372 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab4004030 con 0x7f0ac009d6f0 2023-10-03T10:14:15.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.125+0000 7f0ac6d97700 1 -- 172.21.15.72:0/1082766372 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab800bd40 con 0x7f0ac009d6f0 2023-10-03T10:14:15.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.125+0000 7f0abd7fa700 1 -- 172.21.15.72:0/1082766372 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40043c0 con 0x7f0ac009d6f0 2023-10-03T10:14:15.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.125+0000 7f0ac6d97700 1 -- 172.21.15.72:0/1082766372 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac009c700 con 0x7f0ac009d6f0 2023-10-03T10:14:15.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.125+0000 7f0abd7fa700 1 -- 172.21.15.72:0/1082766372 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ab400c7f0 con 0x7f0ac009d6f0 2023-10-03T10:14:15.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.126+0000 7f0abd7fa700 1 -- 172.21.15.72:0/1082766372 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0ab403f830 con 0x7f0ac009d6f0 2023-10-03T10:14:15.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.126+0000 7f0ac6d97700 1 -- 172.21.15.72:0/1082766372 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac0074ea0 con 0x7f0ac009d6f0 2023-10-03T10:14:15.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.130+0000 7f0abd7fa700 1 -- 172.21.15.72:0/1082766372 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ab4020080 con 0x7f0ac009d6f0 2023-10-03T10:14:15.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:15.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:15.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.274+0000 7fd49b2a3700 1 Processor -- start 2023-10-03T10:14:15.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.274+0000 7fd49b2a3700 1 -- start start 2023-10-03T10:14:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd49b2a3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd49409f330 0x7fd494138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd49b2a3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4941393e0 0x7fd49413b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd49b2a3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49409f960 con 0x7fd49409e850 2023-10-03T10:14:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd49b2a3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49409f720 con 0x7fd49409f330 2023-10-03T10:14:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd49b2a3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd49409ae60 con 0x7fd4941393e0 2023-10-03T10:14:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd49883e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd49409f330 0x7fd494138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd49903f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd49409e850 0x7fd49409ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48156/0 (socket says 172.21.15.72:48156) 2023-10-03T10:14:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd49903f700 1 -- 172.21.15.72:0/4017722820 learned_addr learned my addr 172.21.15.72:0/4017722820 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd499840700 1 --2- 172.21.15.72:0/4017722820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4941393e0 0x7fd49413b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd493fff700 1 -- 172.21.15.72:0/4017722820 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978143246 0 0) 0x7fd49409f960 con 0x7fd49409e850 2023-10-03T10:14:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd493fff700 1 -- 172.21.15.72:0/4017722820 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd47c0035b0 con 0x7fd49409e850 2023-10-03T10:14:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd49883e700 1 -- 172.21.15.72:0/4017722820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4941393e0 msgr2=0x7fd49413b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd49883e700 1 --2- 172.21.15.72:0/4017722820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4941393e0 0x7fd49413b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd49883e700 1 -- 172.21.15.72:0/4017722820 >> v1:172.21.15.72:6789/0 conn(0x7fd49409e850 legacy=0x7fd49409ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd49883e700 1 -- 172.21.15.72:0/4017722820 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49406cb10 con 0x7fd49409f330 2023-10-03T10:14:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.275+0000 7fd499840700 1 --2- 172.21.15.72:0/4017722820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4941393e0 0x7fd49413b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.276+0000 7fd49883e700 1 --2- 172.21.15.72:0/4017722820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd49409f330 0x7fd494138ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd488009870 tx=0x7fd488009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb8a84c5b7fed2dc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.276+0000 7fd493fff700 1 -- 172.21.15.72:0/4017722820 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488011830 con 0x7fd49409f330 2023-10-03T10:14:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.276+0000 7fd493fff700 1 -- 172.21.15.72:0/4017722820 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd488011990 con 0x7fd49409f330 2023-10-03T10:14:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.276+0000 7fd493fff700 1 -- 172.21.15.72:0/4017722820 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488011d20 con 0x7fd49409f330 2023-10-03T10:14:15.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:15.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.276+0000 7fd49b2a3700 1 -- 172.21.15.72:0/4017722820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd49409f330 msgr2=0x7fd494138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.276+0000 7fd49b2a3700 1 --2- 172.21.15.72:0/4017722820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd49409f330 0x7fd494138ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd488009870 tx=0x7fd488009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.276+0000 7fd49b2a3700 1 -- 172.21.15.72:0/4017722820 shutdown_connections 2023-10-03T10:14:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.276+0000 7fd49b2a3700 1 --2- 172.21.15.72:0/4017722820 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4941393e0 0x7fd49413b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.276+0000 7fd49b2a3700 1 --2- 172.21.15.72:0/4017722820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd49409f330 0x7fd494138ea0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.276+0000 7fd49b2a3700 1 -- 172.21.15.72:0/4017722820 >> 172.21.15.72:0/4017722820 conn(0x7fd4940a3f70 msgr2=0x7fd4940a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.277+0000 7fd49b2a3700 1 -- 172.21.15.72:0/4017722820 shutdown_connections 2023-10-03T10:14:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.277+0000 7fd49b2a3700 1 -- 172.21.15.72:0/4017722820 wait complete. 2023-10-03T10:14:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.277+0000 7fd49b2a3700 1 Processor -- start 2023-10-03T10:14:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.277+0000 7fd49b2a3700 1 -- start start 2023-10-03T10:14:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49b2a3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd49409e850 0x7fd49411ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49b2a3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd49409f330 0x7fd49411ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49b2a3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4941393e0 0x7fd49411f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49b2a3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd494120440 con 0x7fd49409f330 2023-10-03T10:14:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49b2a3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd494121a40 con 0x7fd49409e850 2023-10-03T10:14:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49b2a3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd49406fa80 con 0x7fd4941393e0 2023-10-03T10:14:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49883e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd49409f330 0x7fd49411ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49903f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd49409e850 0x7fd49411ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49883e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd49409f330 0x7fd49411ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35708/0 (socket says 172.21.15.72:35708) 2023-10-03T10:14:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49883e700 1 -- 172.21.15.72:0/2938103538 learned_addr learned my addr 172.21.15.72:0/2938103538 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd499840700 1 --2- 172.21.15.72:0/2938103538 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4941393e0 0x7fd49411f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49903f700 1 -- 172.21.15.72:0/2938103538 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4941393e0 msgr2=0x7fd49411f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49903f700 1 --2- 172.21.15.72:0/2938103538 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4941393e0 0x7fd49411f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49903f700 1 -- 172.21.15.72:0/2938103538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd49409f330 msgr2=0x7fd49411ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49903f700 1 --2- 172.21.15.72:0/2938103538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd49409f330 0x7fd49411ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49903f700 1 -- 172.21.15.72:0/2938103538 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd484009a70 con 0x7fd49409e850 2023-10-03T10:14:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.278+0000 7fd49883e700 1 --2- 172.21.15.72:0/2938103538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd49409f330 0x7fd49411ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.279+0000 7fd49903f700 1 --2- 172.21.15.72:0/2938103538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd49409e850 0x7fd49411ea30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00c4c0 tx=0x7fd48c00c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.279+0000 7fd491ffb700 1 -- 172.21.15.72:0/2938103538 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c005d70 con 0x7fd49409e850 2023-10-03T10:14:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.279+0000 7fd491ffb700 1 -- 172.21.15.72:0/2938103538 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c0070d0 con 0x7fd49409e850 2023-10-03T10:14:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.279+0000 7fd49b2a3700 1 -- 172.21.15.72:0/2938103538 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4880094a0 con 0x7fd49409e850 2023-10-03T10:14:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.279+0000 7fd491ffb700 1 -- 172.21.15.72:0/2938103538 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c007440 con 0x7fd49409e850 2023-10-03T10:14:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.279+0000 7fd49b2a3700 1 -- 172.21.15.72:0/2938103538 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4941220e0 con 0x7fd49409e850 2023-10-03T10:14:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.280+0000 7fd491ffb700 1 -- 172.21.15.72:0/2938103538 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd48c0075a0 con 0x7fd49409e850 2023-10-03T10:14:15.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.280+0000 7fd491ffb700 1 -- 172.21.15.72:0/2938103538 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd48c03eb80 con 0x7fd49409e850 2023-10-03T10:14:15.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.280+0000 7fd49b2a3700 1 -- 172.21.15.72:0/2938103538 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49406cd90 con 0x7fd49409e850 2023-10-03T10:14:15.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.285+0000 7fd491ffb700 1 -- 172.21.15.72:0/2938103538 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd48c03ee60 con 0x7fd49409e850 2023-10-03T10:14:15.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.328+0000 7f0ac6d97700 1 -- 172.21.15.72:0/1082766372 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0ac011f470 con 0x7f0ac009d6f0 2023-10-03T10:14:15.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.329+0000 7f0abd7fa700 1 -- 172.21.15.72:0/1082766372 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ab4011db0 con 0x7f0ac009d6f0 2023-10-03T10:14:15.329 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.331+0000 7f0ac6d97700 1 -- 172.21.15.72:0/1082766372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac009d6f0 msgr2=0x7f0ac011e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.331+0000 7f0ac6d97700 1 --2- 172.21.15.72:0/1082766372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac009d6f0 0x7f0ac011e010 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400e9b0 tx=0x7f0ab400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.331+0000 7f0ac6d97700 1 -- 172.21.15.72:0/1082766372 shutdown_connections 2023-10-03T10:14:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.331+0000 7f0ac6d97700 1 --2- 172.21.15.72:0/1082766372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ac009d6f0 0x7f0ac011e010 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.331+0000 7f0ac6d97700 1 --2- 172.21.15.72:0/1082766372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ac009e410 0x7f0ac011ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.331+0000 7f0ac6d97700 1 --2- 172.21.15.72:0/1082766372 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ac009e000 0x7f0ac011e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.331+0000 7f0ac6d97700 1 -- 172.21.15.72:0/1082766372 >> 172.21.15.72:0/1082766372 conn(0x7f0ac0066f50 msgr2=0x7f0ac006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.331+0000 7f0ac6d97700 1 -- 172.21.15.72:0/1082766372 shutdown_connections 2023-10-03T10:14:15.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.331+0000 7f0ac6d97700 1 -- 172.21.15.72:0/1082766372 wait complete. 2023-10-03T10:14:15.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:15.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.413+0000 7ff48dabe700 1 Processor -- start 2023-10-03T10:14:15.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.413+0000 7ff48dabe700 1 -- start start 2023-10-03T10:14:15.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.413+0000 7ff48dabe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff48809d6f0 0x7ff48809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.413+0000 7ff48dabe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48809e440 0x7ff488134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.413+0000 7ff48dabe700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48809b120 con 0x7ff48809e000 2023-10-03T10:14:15.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.413+0000 7ff48dabe700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48806b460 con 0x7ff48809d6f0 2023-10-03T10:14:15.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.413+0000 7ff48dabe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48809a7e0 con 0x7ff48809e440 2023-10-03T10:14:15.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7f4852f7a700 1 Processor -- start 2023-10-03T10:14:15.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7ff4877fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff48809d6f0 0x7ff48809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7ff487fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48809e440 0x7ff488134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7ff487fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48809e440 0x7ff488134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54606/0 (socket says 172.21.15.72:54606) 2023-10-03T10:14:15.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7ff4877fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff48809d6f0 0x7ff48809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35724/0 (socket says 172.21.15.72:35724) 2023-10-03T10:14:15.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7ff487fff700 1 -- 172.21.15.72:0/1994829912 learned_addr learned my addr 172.21.15.72:0/1994829912 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:15.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7f4852f7a700 1 -- start start 2023-10-03T10:14:15.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7ff487fff700 1 -- 172.21.15.72:0/1994829912 >> v2:172.21.15.72:3300/0 conn(0x7ff48809d6f0 msgr2=0x7ff48809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7ff487fff700 1 --2- 172.21.15.72:0/1994829912 >> v2:172.21.15.72:3300/0 conn(0x7ff48809d6f0 0x7ff48809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7ff487fff700 1 -- 172.21.15.72:0/1994829912 >> v1:172.21.15.72:6789/0 conn(0x7ff48809e000 legacy=0x7ff4881339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7ff487fff700 1 -- 172.21.15.72:0/1994829912 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48809a500 con 0x7ff48809e440 2023-10-03T10:14:15.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7ff487fff700 1 --2- 172.21.15.72:0/1994829912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48809e440 0x7ff488134100 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff480009e80 tx=0x7ff48000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79a3694fc8222624 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7ff4867fc700 1 -- 172.21.15.72:0/1994829912 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48000e070 con 0x7ff48809e440 2023-10-03T10:14:15.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7f4852f7a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484c1338c0 0x7f484c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7f4852f7a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484c1341d0 0x7f484c09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7ff4867fc700 1 -- 172.21.15.72:0/1994829912 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48000b8d0 con 0x7ff48809e440 2023-10-03T10:14:15.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7ff4867fc700 1 -- 172.21.15.72:0/1994829912 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48000bc80 con 0x7ff48809e440 2023-10-03T10:14:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7f4852f7a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484c06f720 con 0x7f484c09e390 2023-10-03T10:14:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7f4852f7a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484c070c80 con 0x7f484c1341d0 2023-10-03T10:14:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.414+0000 7f4852f7a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f484c06fce0 con 0x7f484c1338c0 2023-10-03T10:14:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7f4851517700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f484c09e390 0x7f484c13a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48164/0 (socket says 172.21.15.72:48164) 2023-10-03T10:14:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7f4851517700 1 -- 172.21.15.72:0/808267727 learned_addr learned my addr 172.21.15.72:0/808267727 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7f484bfff700 1 --2- 172.21.15.72:0/808267727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484c1341d0 0x7f484c09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7f484b7fe700 1 -- 172.21.15.72:0/808267727 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501426674 0 0) 0x7f484c06f720 con 0x7f484c09e390 2023-10-03T10:14:15.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7f484b7fe700 1 -- 172.21.15.72:0/808267727 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f483c0035b0 con 0x7f484c09e390 2023-10-03T10:14:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7f484bfff700 1 -- 172.21.15.72:0/808267727 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484c1338c0 msgr2=0x7f484c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7f484bfff700 1 --2- 172.21.15.72:0/808267727 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484c1338c0 0x7f484c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7f484bfff700 1 -- 172.21.15.72:0/808267727 >> v1:172.21.15.72:6789/0 conn(0x7f484c09e390 legacy=0x7f484c13a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7f484bfff700 1 -- 172.21.15.72:0/808267727 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c1336a0 con 0x7f484c1341d0 2023-10-03T10:14:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7f484bfff700 1 --2- 172.21.15.72:0/808267727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484c1341d0 0x7f484c09de50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4838009870 tx=0x7f4838009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=314b49eec69961f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7ff48dabe700 1 -- 172.21.15.72:0/1994829912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48809e440 msgr2=0x7ff488134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7ff48dabe700 1 --2- 172.21.15.72:0/1994829912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48809e440 0x7ff488134100 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff480009e80 tx=0x7ff48000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7f484b7fe700 1 -- 172.21.15.72:0/808267727 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838004230 con 0x7f484c1341d0 2023-10-03T10:14:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7ff48dabe700 1 -- 172.21.15.72:0/1994829912 shutdown_connections 2023-10-03T10:14:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7ff48dabe700 1 --2- 172.21.15.72:0/1994829912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48809e440 0x7ff488134100 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7f484b7fe700 1 -- 172.21.15.72:0/808267727 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4838004390 con 0x7f484c1341d0 2023-10-03T10:14:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7ff48dabe700 1 --2- 172.21.15.72:0/1994829912 >> v2:172.21.15.72:3300/0 conn(0x7ff48809d6f0 0x7ff48809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7ff48dabe700 1 -- 172.21.15.72:0/1994829912 >> 172.21.15.72:0/1994829912 conn(0x7ff488066f50 msgr2=0x7ff48809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7f484b7fe700 1 -- 172.21.15.72:0/808267727 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380036a0 con 0x7f484c1341d0 2023-10-03T10:14:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.415+0000 7ff48dabe700 1 -- 172.21.15.72:0/1994829912 shutdown_connections 2023-10-03T10:14:15.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.416+0000 7ff48dabe700 1 -- 172.21.15.72:0/1994829912 wait complete. 2023-10-03T10:14:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.416+0000 7f4852f7a700 1 -- 172.21.15.72:0/808267727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484c1341d0 msgr2=0x7f484c09de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.416+0000 7f4852f7a700 1 --2- 172.21.15.72:0/808267727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484c1341d0 0x7f484c09de50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4838009870 tx=0x7f4838009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.416+0000 7f4852f7a700 1 -- 172.21.15.72:0/808267727 shutdown_connections 2023-10-03T10:14:15.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.416+0000 7f4852f7a700 1 --2- 172.21.15.72:0/808267727 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484c1338c0 0x7f484c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.416+0000 7f4852f7a700 1 --2- 172.21.15.72:0/808267727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484c1341d0 0x7f484c09de50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.416+0000 7f4852f7a700 1 -- 172.21.15.72:0/808267727 >> 172.21.15.72:0/808267727 conn(0x7f484c0a2aa0 msgr2=0x7f484c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.416+0000 7f4852f7a700 1 -- 172.21.15.72:0/808267727 shutdown_connections 2023-10-03T10:14:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.416+0000 7f4852f7a700 1 -- 172.21.15.72:0/808267727 wait complete. 2023-10-03T10:14:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.417+0000 7ff48dabe700 1 Processor -- start 2023-10-03T10:14:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.417+0000 7f4852f7a700 1 Processor -- start 2023-10-03T10:14:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.417+0000 7f4852f7a700 1 -- start start 2023-10-03T10:14:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.417+0000 7ff48dabe700 1 -- start start 2023-10-03T10:14:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.417+0000 7ff48dabe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff48809d6f0 0x7ff4881a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.417+0000 7ff48dabe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48809e000 0x7ff4881a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.417+0000 7ff48dabe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff48809e440 0x7ff4881a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.417+0000 7ff48dabe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4881a99d0 con 0x7ff48809e440 2023-10-03T10:14:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.417+0000 7ff48dabe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4881a7b60 con 0x7ff48809e000 2023-10-03T10:14:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.417+0000 7ff48dabe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880a1f90 con 0x7ff48809d6f0 2023-10-03T10:14:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4852f7a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484c09e390 0x7f484c130120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4852f7a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f484c1338c0 0x7f484c130660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4852f7a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484c1341d0 0x7f484c1c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4852f7a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c11e4f0 con 0x7f484c1338c0 2023-10-03T10:14:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4852f7a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484c11f810 con 0x7f484c09e390 2023-10-03T10:14:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4852f7a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f484c06f9d0 con 0x7f484c1341d0 2023-10-03T10:14:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4851517700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484c1341d0 0x7f484c1c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7ff4877fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff48809d6f0 0x7ff4881a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7ff4877fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff48809d6f0 0x7ff4881a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60608/0 (socket says 172.21.15.72:60608) 2023-10-03T10:14:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7ff4877fe700 1 -- 172.21.15.72:0/712732812 learned_addr learned my addr 172.21.15.72:0/712732812 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4851517700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484c1341d0 0x7f484c1c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60612/0 (socket says 172.21.15.72:60612) 2023-10-03T10:14:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4851517700 1 -- 172.21.15.72:0/2172598090 learned_addr learned my addr 172.21.15.72:0/2172598090 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:15.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7ff487fff700 1 --2- 172.21.15.72:0/712732812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff48809e440 0x7ff4881a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f484bfff700 1 --2- 172.21.15.72:0/2172598090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f484c1338c0 0x7f484c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4850d16700 1 --2- 172.21.15.72:0/2172598090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484c09e390 0x7f484c130120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7ff486ffd700 1 --2- 172.21.15.72:0/712732812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48809e000 0x7ff4881a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4851517700 1 -- 172.21.15.72:0/2172598090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484c09e390 msgr2=0x7f484c130120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4851517700 1 --2- 172.21.15.72:0/2172598090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484c09e390 0x7f484c130120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4851517700 1 -- 172.21.15.72:0/2172598090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f484c1338c0 msgr2=0x7f484c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4851517700 1 --2- 172.21.15.72:0/2172598090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f484c1338c0 0x7f484c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4851517700 1 -- 172.21.15.72:0/2172598090 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48380094a0 con 0x7f484c1341d0 2023-10-03T10:14:15.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7ff487fff700 1 -- 172.21.15.72:0/712732812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff48809d6f0 msgr2=0x7ff4881a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7ff487fff700 1 --2- 172.21.15.72:0/712732812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff48809d6f0 0x7ff4881a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7ff487fff700 1 -- 172.21.15.72:0/712732812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48809e000 msgr2=0x7ff4881a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7ff487fff700 1 --2- 172.21.15.72:0/712732812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48809e000 0x7ff4881a63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7ff487fff700 1 -- 172.21.15.72:0/712732812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480009b30 con 0x7ff48809e440 2023-10-03T10:14:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f484bfff700 1 --2- 172.21.15.72:0/2172598090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f484c1338c0 0x7f484c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7ff487fff700 1 --2- 172.21.15.72:0/712732812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff48809e440 0x7ff4881a6930 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff480015000 tx=0x7ff480004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7f4851517700 1 --2- 172.21.15.72:0/2172598090 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484c1341d0 0x7f484c1c7ed0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f484400cca0 tx=0x7f484400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.418+0000 7ff46ffff700 1 -- 172.21.15.72:0/712732812 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4800048b0 con 0x7ff48809e440 2023-10-03T10:14:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.419+0000 7ff46ffff700 1 -- 172.21.15.72:0/712732812 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4800092e0 con 0x7ff48809e440 2023-10-03T10:14:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.419+0000 7ff48dabe700 1 -- 172.21.15.72:0/712732812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48809c710 con 0x7ff48809e440 2023-10-03T10:14:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.419+0000 7ff46ffff700 1 -- 172.21.15.72:0/712732812 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48001c660 con 0x7ff48809e440 2023-10-03T10:14:15.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.419+0000 7ff48dabe700 1 -- 172.21.15.72:0/712732812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4881a8dd0 con 0x7ff48809e440 2023-10-03T10:14:15.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.419+0000 7f48497fa700 1 -- 172.21.15.72:0/2172598090 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400ab70 con 0x7f484c1341d0 2023-10-03T10:14:15.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.419+0000 7f4852f7a700 1 -- 172.21.15.72:0/2172598090 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484c11c4c0 con 0x7f484c1341d0 2023-10-03T10:14:15.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.419+0000 7f4852f7a700 1 -- 172.21.15.72:0/2172598090 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484c11dbe0 con 0x7f484c1341d0 2023-10-03T10:14:15.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.419+0000 7f48497fa700 1 -- 172.21.15.72:0/2172598090 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484400acd0 con 0x7f484c1341d0 2023-10-03T10:14:15.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.419+0000 7f48497fa700 1 -- 172.21.15.72:0/2172598090 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48440072d0 con 0x7f484c1341d0 2023-10-03T10:14:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.419+0000 7ff46ffff700 1 -- 172.21.15.72:0/712732812 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff48001c7c0 con 0x7ff48809e440 2023-10-03T10:14:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.420+0000 7ff46ffff700 1 -- 172.21.15.72:0/712732812 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff480041000 con 0x7ff48809e440 2023-10-03T10:14:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.420+0000 7f4852f7a700 1 -- 172.21.15.72:0/2172598090 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482c0052e0 con 0x7f484c1341d0 2023-10-03T10:14:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.420+0000 7ff48dabe700 1 -- 172.21.15.72:0/712732812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff488074ea0 con 0x7ff48809e440 2023-10-03T10:14:15.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.421+0000 7f48497fa700 1 -- 172.21.15.72:0/2172598090 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4844007430 con 0x7f484c1341d0 2023-10-03T10:14:15.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.421+0000 7f48497fa700 1 -- 172.21.15.72:0/2172598090 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f484403fad0 con 0x7f484c1341d0 2023-10-03T10:14:15.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.425+0000 7ff46ffff700 1 -- 172.21.15.72:0/712732812 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4800123f0 con 0x7ff48809e440 2023-10-03T10:14:15.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.425+0000 7f48497fa700 1 -- 172.21.15.72:0/2172598090 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f484401c3b0 con 0x7f484c1341d0 2023-10-03T10:14:15.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.543+0000 7fd49b2a3700 1 -- 172.21.15.72:0/2938103538 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd4940747f0 con 0x7fd49409e850 2023-10-03T10:14:15.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.543+0000 7fd491ffb700 1 -- 172.21.15.72:0/2938103538 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd48c01bb10 con 0x7fd49409e850 2023-10-03T10:14:15.543 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:15.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.545+0000 7fd49b2a3700 1 -- 172.21.15.72:0/2938103538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd49409e850 msgr2=0x7fd49411ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.545+0000 7fd49b2a3700 1 --2- 172.21.15.72:0/2938103538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd49409e850 0x7fd49411ea30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00c4c0 tx=0x7fd48c00c7d0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.546+0000 7fd49b2a3700 1 -- 172.21.15.72:0/2938103538 shutdown_connections 2023-10-03T10:14:15.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.546+0000 7fd49b2a3700 1 --2- 172.21.15.72:0/2938103538 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4941393e0 0x7fd49411f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.546+0000 7fd49b2a3700 1 --2- 172.21.15.72:0/2938103538 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd49409e850 0x7fd49411ea30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.546+0000 7fd49b2a3700 1 --2- 172.21.15.72:0/2938103538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd49409f330 0x7fd49411ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.546+0000 7fd49b2a3700 1 -- 172.21.15.72:0/2938103538 >> 172.21.15.72:0/2938103538 conn(0x7fd4940a3f70 msgr2=0x7fd494136f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.546+0000 7fd49b2a3700 1 -- 172.21.15.72:0/2938103538 shutdown_connections 2023-10-03T10:14:15.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.546+0000 7fd49b2a3700 1 -- 172.21.15.72:0/2938103538 wait complete. 2023-10-03T10:14:15.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:15.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.620+0000 7f4852f7a700 1 -- 172.21.15.72:0/2172598090 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f482c005860 con 0x7f484c1341d0 2023-10-03T10:14:15.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.620+0000 7f48497fa700 1 -- 172.21.15.72:0/2172598090 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4844010300 con 0x7f484c1341d0 2023-10-03T10:14:15.620 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.622+0000 7f4852f7a700 1 -- 172.21.15.72:0/2172598090 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484c1341d0 msgr2=0x7f484c1c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.622+0000 7f4852f7a700 1 --2- 172.21.15.72:0/2172598090 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484c1341d0 0x7f484c1c7ed0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f484400cca0 tx=0x7f484400a060 comp rx=0 tx=0).stop 2023-10-03T10:14:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.622+0000 7f4852f7a700 1 -- 172.21.15.72:0/2172598090 shutdown_connections 2023-10-03T10:14:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.622+0000 7f4852f7a700 1 --2- 172.21.15.72:0/2172598090 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484c1341d0 0x7f484c1c7ed0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.622+0000 7f4852f7a700 1 --2- 172.21.15.72:0/2172598090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484c09e390 0x7f484c130120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.622+0000 7f4852f7a700 1 --2- 172.21.15.72:0/2172598090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f484c1338c0 0x7f484c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.622+0000 7f4852f7a700 1 -- 172.21.15.72:0/2172598090 >> 172.21.15.72:0/2172598090 conn(0x7f484c0a2aa0 msgr2=0x7f484c09f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.622+0000 7f4852f7a700 1 -- 172.21.15.72:0/2172598090 shutdown_connections 2023-10-03T10:14:15.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.622+0000 7f4852f7a700 1 -- 172.21.15.72:0/2172598090 wait complete. 2023-10-03T10:14:15.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:15.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.634+0000 7ff48dabe700 1 -- 172.21.15.72:0/712732812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff48809f420 con 0x7ff48809e440 2023-10-03T10:14:15.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.635+0000 7ff46ffff700 1 -- 172.21.15.72:0/712732812 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff480034090 con 0x7ff48809e440 2023-10-03T10:14:15.635 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:15.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.637+0000 7ff48dabe700 1 -- 172.21.15.72:0/712732812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff48809e440 msgr2=0x7ff4881a6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.637+0000 7ff48dabe700 1 --2- 172.21.15.72:0/712732812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff48809e440 0x7ff4881a6930 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff480015000 tx=0x7ff480004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.637+0000 7ff48dabe700 1 -- 172.21.15.72:0/712732812 shutdown_connections 2023-10-03T10:14:15.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.637+0000 7ff48dabe700 1 --2- 172.21.15.72:0/712732812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff48809e440 0x7ff4881a6930 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.637+0000 7ff48dabe700 1 --2- 172.21.15.72:0/712732812 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff48809d6f0 0x7ff4881a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.637+0000 7ff48dabe700 1 --2- 172.21.15.72:0/712732812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff48809e000 0x7ff4881a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.637+0000 7ff48dabe700 1 -- 172.21.15.72:0/712732812 >> 172.21.15.72:0/712732812 conn(0x7ff488066f50 msgr2=0x7ff4881badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.637+0000 7ff48dabe700 1 -- 172.21.15.72:0/712732812 shutdown_connections 2023-10-03T10:14:15.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:15.637+0000 7ff48dabe700 1 -- 172.21.15.72:0/712732812 wait complete. 2023-10-03T10:14:15.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:16.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.476+0000 7fd695aba700 1 Processor -- start 2023-10-03T10:14:16.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.476+0000 7fd695aba700 1 -- start start 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd695aba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd69009e930 0x7fd69009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd695aba700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd69009f240 0x7fd6901317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd695aba700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd690070940 con 0x7fd69009f650 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd695aba700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69006fd60 con 0x7fd69009f240 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd695aba700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69006fa80 con 0x7fd69009e930 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd68f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd69009e930 0x7fd69009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd68effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd69009f240 0x7fd6901317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd68f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd69009e930 0x7fd69009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54628/0 (socket says 172.21.15.72:54628) 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd68effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd69009f240 0x7fd6901317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35750/0 (socket says 172.21.15.72:35750) 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd68f7fe700 1 -- 172.21.15.72:0/1057036617 learned_addr learned my addr 172.21.15.72:0/1057036617 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd68f7fe700 1 -- 172.21.15.72:0/1057036617 >> v2:172.21.15.72:3300/0 conn(0x7fd69009f240 msgr2=0x7fd6901317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd68f7fe700 1 --2- 172.21.15.72:0/1057036617 >> v2:172.21.15.72:3300/0 conn(0x7fd69009f240 0x7fd6901317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd68f7fe700 1 -- 172.21.15.72:0/1057036617 >> v1:172.21.15.72:6789/0 conn(0x7fd69009f650 legacy=0x7fd690131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd68f7fe700 1 -- 172.21.15.72:0/1057036617 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69009fb60 con 0x7fd69009e930 2023-10-03T10:14:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd68effd700 1 --2- 172.21.15.72:0/1057036617 >> v2:172.21.15.72:3300/0 conn(0x7fd69009f240 0x7fd6901317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.477+0000 7fd68f7fe700 1 --2- 172.21.15.72:0/1057036617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd69009e930 0x7fd69009ed00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd6780098f0 tx=0x7fd678009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9794028a8e4524b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.478+0000 7fd68e7fc700 1 -- 172.21.15.72:0/1057036617 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678011830 con 0x7fd69009e930 2023-10-03T10:14:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.478+0000 7fd68e7fc700 1 -- 172.21.15.72:0/1057036617 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678011990 con 0x7fd69009e930 2023-10-03T10:14:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.478+0000 7fd68e7fc700 1 -- 172.21.15.72:0/1057036617 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678011d20 con 0x7fd69009e930 2023-10-03T10:14:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.478+0000 7fd695aba700 1 -- 172.21.15.72:0/1057036617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd69009e930 msgr2=0x7fd69009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.478+0000 7fd695aba700 1 --2- 172.21.15.72:0/1057036617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd69009e930 0x7fd69009ed00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd6780098f0 tx=0x7fd678009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.478+0000 7fd695aba700 1 -- 172.21.15.72:0/1057036617 shutdown_connections 2023-10-03T10:14:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.478+0000 7fd695aba700 1 --2- 172.21.15.72:0/1057036617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd69009e930 0x7fd69009ed00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.478+0000 7fd695aba700 1 --2- 172.21.15.72:0/1057036617 >> v2:172.21.15.72:3300/0 conn(0x7fd69009f240 0x7fd6901317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.478+0000 7fd695aba700 1 -- 172.21.15.72:0/1057036617 >> 172.21.15.72:0/1057036617 conn(0x7fd6900a4210 msgr2=0x7fd6900a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.478+0000 7fd695aba700 1 -- 172.21.15.72:0/1057036617 shutdown_connections 2023-10-03T10:14:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.478+0000 7fd695aba700 1 -- 172.21.15.72:0/1057036617 wait complete. 2023-10-03T10:14:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.479+0000 7fd695aba700 1 Processor -- start 2023-10-03T10:14:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.479+0000 7fd695aba700 1 -- start start 2023-10-03T10:14:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd695aba700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd69009e930 0x7fd69006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd695aba700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd69009f240 0x7fd69006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd695aba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd69009f650 0x7fd69006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd695aba700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6901b72d0 con 0x7fd69009f240 2023-10-03T10:14:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd695aba700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6901a9480 con 0x7fd69009f650 2023-10-03T10:14:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd695aba700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6901a89a0 con 0x7fd69009e930 2023-10-03T10:14:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd68f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd69009e930 0x7fd69006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd68effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd69009f240 0x7fd69006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd68ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd69009f650 0x7fd69006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd68effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd69009f240 0x7fd69006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35752/0 (socket says 172.21.15.72:35752) 2023-10-03T10:14:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd68f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd69009e930 0x7fd69006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60614/0 (socket says 172.21.15.72:60614) 2023-10-03T10:14:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd68effd700 1 -- 172.21.15.72:0/630108151 learned_addr learned my addr 172.21.15.72:0/630108151 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd68effd700 1 -- 172.21.15.72:0/630108151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd69009e930 msgr2=0x7fd69006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd68effd700 1 --2- 172.21.15.72:0/630108151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd69009e930 0x7fd69006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd68effd700 1 -- 172.21.15.72:0/630108151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd69009f650 msgr2=0x7fd69006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd68effd700 1 --2- 172.21.15.72:0/630108151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd69009f650 0x7fd69006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd68effd700 1 -- 172.21.15.72:0/630108151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6800094a0 con 0x7fd69009f240 2023-10-03T10:14:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd68ffff700 1 --2- 172.21.15.72:0/630108151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd69009f650 0x7fd69006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd68f7fe700 1 --2- 172.21.15.72:0/630108151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd69009e930 0x7fd69006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd68effd700 1 --2- 172.21.15.72:0/630108151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd69009f240 0x7fd69006bdf0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd68000ebe0 tx=0x7fd68000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd687fff700 1 -- 172.21.15.72:0/630108151 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68000c850 con 0x7fd69009f240 2023-10-03T10:14:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd687fff700 1 -- 172.21.15.72:0/630108151 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68000c9b0 con 0x7fd69009f240 2023-10-03T10:14:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd687fff700 1 -- 172.21.15.72:0/630108151 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68000cd40 con 0x7fd69009f240 2023-10-03T10:14:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd695aba700 1 -- 172.21.15.72:0/630108151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd678009550 con 0x7fd69009f240 2023-10-03T10:14:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.480+0000 7fd695aba700 1 -- 172.21.15.72:0/630108151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6900a0190 con 0x7fd69009f240 2023-10-03T10:14:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.481+0000 7fd687fff700 1 -- 172.21.15.72:0/630108151 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd680013470 con 0x7fd69009f240 2023-10-03T10:14:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.481+0000 7fd687fff700 1 -- 172.21.15.72:0/630108151 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd68003fab0 con 0x7fd69009f240 2023-10-03T10:14:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.481+0000 7fd695aba700 1 -- 172.21.15.72:0/630108151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6901a0b30 con 0x7fd69009f240 2023-10-03T10:14:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.486+0000 7fd687fff700 1 -- 172.21.15.72:0/630108151 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd680021080 con 0x7fd69009f240 2023-10-03T10:14:16.558 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:16.635 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:16.649 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:16.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.677+0000 7fd695aba700 1 -- 172.21.15.72:0/630108151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd6900a34c0 con 0x7fd69009f240 2023-10-03T10:14:16.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.677+0000 7fd687fff700 1 -- 172.21.15.72:0/630108151 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd680017020 con 0x7fd69009f240 2023-10-03T10:14:16.679 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:16.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.679+0000 7fd695aba700 1 -- 172.21.15.72:0/630108151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd69009f240 msgr2=0x7fd69006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.679+0000 7fd695aba700 1 --2- 172.21.15.72:0/630108151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd69009f240 0x7fd69006bdf0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd68000ebe0 tx=0x7fd68000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.680+0000 7fd695aba700 1 -- 172.21.15.72:0/630108151 shutdown_connections 2023-10-03T10:14:16.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.680+0000 7fd695aba700 1 --2- 172.21.15.72:0/630108151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd69009f650 0x7fd69006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.680+0000 7fd695aba700 1 --2- 172.21.15.72:0/630108151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd69009e930 0x7fd69006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.680+0000 7fd695aba700 1 --2- 172.21.15.72:0/630108151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd69009f240 0x7fd69006bdf0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.680+0000 7fd695aba700 1 -- 172.21.15.72:0/630108151 >> 172.21.15.72:0/630108151 conn(0x7fd6900a4210 msgr2=0x7fd6901b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.680+0000 7fd695aba700 1 -- 172.21.15.72:0/630108151 shutdown_connections 2023-10-03T10:14:16.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.680+0000 7fd695aba700 1 -- 172.21.15.72:0/630108151 wait complete. 2023-10-03T10:14:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.685+0000 7faed812f700 1 Processor -- start 2023-10-03T10:14:16.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.685+0000 7faed812f700 1 -- start start 2023-10-03T10:14:16.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.686+0000 7faed812f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faed009d6f0 0x7faed009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.686+0000 7faed812f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faed009e000 0x7faed01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.686+0000 7faed812f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faed009e410 0x7faed0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.686+0000 7faed812f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed006b460 con 0x7faed009e410 2023-10-03T10:14:16.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.686+0000 7faed812f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed009b120 con 0x7faed009e000 2023-10-03T10:14:16.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.686+0000 7faed812f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faed009a7e0 con 0x7faed009d6f0 2023-10-03T10:14:16.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.686+0000 7faed5ecb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faed009d6f0 0x7faed009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.686+0000 7faed5ecb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faed009d6f0 0x7faed009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60626/0 (socket says 172.21.15.72:60626) 2023-10-03T10:14:16.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.686+0000 7faed5ecb700 1 -- 172.21.15.72:0/662914927 learned_addr learned my addr 172.21.15.72:0/662914927 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:16.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.686+0000 7faed56ca700 1 --2- 172.21.15.72:0/662914927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faed009e000 0x7faed01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.686+0000 7faed66cc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faed009e410 0x7faed0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.687+0000 7faed56ca700 1 -- 172.21.15.72:0/662914927 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faed009d6f0 msgr2=0x7faed009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.687+0000 7faed56ca700 1 --2- 172.21.15.72:0/662914927 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faed009d6f0 0x7faed009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.687+0000 7faed56ca700 1 -- 172.21.15.72:0/662914927 >> v2:172.21.15.72:3300/0 conn(0x7faed009e410 msgr2=0x7faed0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.687+0000 7faed56ca700 1 --2- 172.21.15.72:0/662914927 >> v2:172.21.15.72:3300/0 conn(0x7faed009e410 0x7faed0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.687+0000 7faed56ca700 1 -- 172.21.15.72:0/662914927 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed009a500 con 0x7faed009e000 2023-10-03T10:14:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.687+0000 7faed5ecb700 1 --2- 172.21.15.72:0/662914927 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faed009d6f0 0x7faed009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.687+0000 7faed56ca700 1 --2- 172.21.15.72:0/662914927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faed009e000 0x7faed01339f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7faec0009870 tx=0x7faec0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c819efae1d28b00a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.687+0000 7faed4ec9700 1 -- 172.21.15.72:0/662914927 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0011830 con 0x7faed009e000 2023-10-03T10:14:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.687+0000 7faed4ec9700 1 -- 172.21.15.72:0/662914927 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec0011990 con 0x7faed009e000 2023-10-03T10:14:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.687+0000 7faed4ec9700 1 -- 172.21.15.72:0/662914927 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0011d20 con 0x7faed009e000 2023-10-03T10:14:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.688+0000 7faed812f700 1 -- 172.21.15.72:0/662914927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faed009e000 msgr2=0x7faed01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.688+0000 7faed812f700 1 --2- 172.21.15.72:0/662914927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faed009e000 0x7faed01339f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7faec0009870 tx=0x7faec0009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.688+0000 7faed812f700 1 -- 172.21.15.72:0/662914927 shutdown_connections 2023-10-03T10:14:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.688+0000 7faed812f700 1 --2- 172.21.15.72:0/662914927 >> v2:172.21.15.72:3300/0 conn(0x7faed009e410 0x7faed0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.688+0000 7faed812f700 1 --2- 172.21.15.72:0/662914927 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faed009d6f0 0x7faed009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.688+0000 7faed812f700 1 --2- 172.21.15.72:0/662914927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faed009e000 0x7faed01339f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.688+0000 7faed812f700 1 -- 172.21.15.72:0/662914927 >> 172.21.15.72:0/662914927 conn(0x7faed0066f50 msgr2=0x7faed009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.688+0000 7faed812f700 1 -- 172.21.15.72:0/662914927 shutdown_connections 2023-10-03T10:14:16.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.688+0000 7faed812f700 1 -- 172.21.15.72:0/662914927 wait complete. 2023-10-03T10:14:16.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.689+0000 7faed812f700 1 Processor -- start 2023-10-03T10:14:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.689+0000 7faed812f700 1 -- start start 2023-10-03T10:14:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.690+0000 7faed812f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed009d6f0 0x7faed01a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.690+0000 7faed812f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faed009e000 0x7faed01a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.690+0000 7faed812f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faed009e410 0x7faed01a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.690+0000 7faed812f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed01a91f0 con 0x7faed009d6f0 2023-10-03T10:14:16.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.690+0000 7faed812f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed01aa340 con 0x7faed009e410 2023-10-03T10:14:16.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.690+0000 7faed812f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faed01a8cc0 con 0x7faed009e000 2023-10-03T10:14:16.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.690+0000 7faed56ca700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faed009e000 0x7faed01a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.690+0000 7faed66cc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faed009e410 0x7faed01a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.690+0000 7faed56ca700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faed009e000 0x7faed01a63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60634/0 (socket says 172.21.15.72:60634) 2023-10-03T10:14:16.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.690+0000 7faed56ca700 1 -- 172.21.15.72:0/1438066941 learned_addr learned my addr 172.21.15.72:0/1438066941 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.690+0000 7faed5ecb700 1 --2- 172.21.15.72:0/1438066941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed009d6f0 0x7faed01a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.691+0000 7faed66cc700 1 -- 172.21.15.72:0/1438066941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faed009e000 msgr2=0x7faed01a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.691+0000 7faed66cc700 1 --2- 172.21.15.72:0/1438066941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faed009e000 0x7faed01a63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.691+0000 7faed66cc700 1 -- 172.21.15.72:0/1438066941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed009d6f0 msgr2=0x7faed01a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.691+0000 7faed66cc700 1 --2- 172.21.15.72:0/1438066941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed009d6f0 0x7faed01a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.691+0000 7faed66cc700 1 -- 172.21.15.72:0/1438066941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc009550 con 0x7faed009e410 2023-10-03T10:14:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.691+0000 7faed5ecb700 1 --2- 172.21.15.72:0/1438066941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed009d6f0 0x7faed01a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.691+0000 7faed66cc700 1 --2- 172.21.15.72:0/1438066941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faed009e410 0x7faed01a6930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faec800efc0 tx=0x7faec800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.691+0000 7faec67fc700 1 -- 172.21.15.72:0/1438066941 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec800cc90 con 0x7faed009e410 2023-10-03T10:14:16.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.691+0000 7faec67fc700 1 -- 172.21.15.72:0/1438066941 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec800f040 con 0x7faed009e410 2023-10-03T10:14:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.691+0000 7faed812f700 1 -- 172.21.15.72:0/1438066941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec00094a0 con 0x7faed009e410 2023-10-03T10:14:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.691+0000 7faec67fc700 1 -- 172.21.15.72:0/1438066941 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8009e60 con 0x7faed009e410 2023-10-03T10:14:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.691+0000 7faed812f700 1 -- 172.21.15.72:0/1438066941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed00a3090 con 0x7faed009e410 2023-10-03T10:14:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.692+0000 7faec67fc700 1 -- 172.21.15.72:0/1438066941 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faec8014480 con 0x7faed009e410 2023-10-03T10:14:16.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.693+0000 7faec67fc700 1 -- 172.21.15.72:0/1438066941 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faec80400c0 con 0x7faed009e410 2023-10-03T10:14:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.693+0000 7faed812f700 1 -- 172.21.15.72:0/1438066941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed0074ea0 con 0x7faed009e410 2023-10-03T10:14:16.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:16.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.698+0000 7faec67fc700 1 -- 172.21.15.72:0/1438066941 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faec8007920 con 0x7faed009e410 2023-10-03T10:14:16.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.766+0000 7faa35183700 1 Processor -- start 2023-10-03T10:14:16.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.766+0000 7faa35183700 1 -- start start 2023-10-03T10:14:16.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.767+0000 7faa35183700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa3009e930 0x7faa3009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.767+0000 7faa35183700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faa3009f240 0x7faa301317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.767+0000 7faa35183700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa30070940 con 0x7faa3009f650 2023-10-03T10:14:16.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.767+0000 7faa35183700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3006fd60 con 0x7faa3009e930 2023-10-03T10:14:16.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.767+0000 7faa35183700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa3006fa80 con 0x7faa3009f240 2023-10-03T10:14:16.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.767+0000 7faa2ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa3009e930 0x7faa3009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.767+0000 7faa2f59e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faa3009f650 0x7faa30131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48172/0 (socket says 172.21.15.72:48172) 2023-10-03T10:14:16.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.767+0000 7faa2f59e700 1 -- 172.21.15.72:0/2573963040 learned_addr learned my addr 172.21.15.72:0/2573963040 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:16.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.767+0000 7faa2e59c700 1 --2- 172.21.15.72:0/2573963040 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faa3009f240 0x7faa301317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.767+0000 7faa2dd9b700 1 -- 172.21.15.72:0/2573963040 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705571520 0 0) 0x7faa30070940 con 0x7faa3009f650 2023-10-03T10:14:16.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.767+0000 7faa2dd9b700 1 -- 172.21.15.72:0/2573963040 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa180035b0 con 0x7faa3009f650 2023-10-03T10:14:16.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.767+0000 7faa2ed9d700 1 -- 172.21.15.72:0/2573963040 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faa3009f240 msgr2=0x7faa301317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.767+0000 7faa2ed9d700 1 --2- 172.21.15.72:0/2573963040 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faa3009f240 0x7faa301317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.767+0000 7faa2ed9d700 1 -- 172.21.15.72:0/2573963040 >> v1:172.21.15.72:6789/0 conn(0x7faa3009f650 legacy=0x7faa30131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.768+0000 7faa2ed9d700 1 -- 172.21.15.72:0/2573963040 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3009fb60 con 0x7faa3009e930 2023-10-03T10:14:16.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.768+0000 7faa2e59c700 1 --2- 172.21.15.72:0/2573963040 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faa3009f240 0x7faa301317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:16.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.768+0000 7faa2ed9d700 1 --2- 172.21.15.72:0/2573963040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa3009e930 0x7faa3009ed00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faa20009870 tx=0x7faa20009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6908f1587017c111 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.768+0000 7faa2dd9b700 1 -- 172.21.15.72:0/2573963040 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa20011830 con 0x7faa3009e930 2023-10-03T10:14:16.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.768+0000 7faa2dd9b700 1 -- 172.21.15.72:0/2573963040 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa20011990 con 0x7faa3009e930 2023-10-03T10:14:16.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.768+0000 7faa2dd9b700 1 -- 172.21.15.72:0/2573963040 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa20011d20 con 0x7faa3009e930 2023-10-03T10:14:16.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.768+0000 7faa35183700 1 -- 172.21.15.72:0/2573963040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa3009e930 msgr2=0x7faa3009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.768+0000 7faa35183700 1 --2- 172.21.15.72:0/2573963040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa3009e930 0x7faa3009ed00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7faa20009870 tx=0x7faa20009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:16.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.768+0000 7faa35183700 1 -- 172.21.15.72:0/2573963040 shutdown_connections 2023-10-03T10:14:16.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.768+0000 7faa35183700 1 --2- 172.21.15.72:0/2573963040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa3009e930 0x7faa3009ed00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.768+0000 7faa35183700 1 --2- 172.21.15.72:0/2573963040 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faa3009f240 0x7faa301317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.768+0000 7faa35183700 1 -- 172.21.15.72:0/2573963040 >> 172.21.15.72:0/2573963040 conn(0x7faa300a4210 msgr2=0x7faa300a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.769+0000 7faa35183700 1 -- 172.21.15.72:0/2573963040 shutdown_connections 2023-10-03T10:14:16.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.769+0000 7faa35183700 1 -- 172.21.15.72:0/2573963040 wait complete. 2023-10-03T10:14:16.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.770+0000 7faa35183700 1 Processor -- start 2023-10-03T10:14:16.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.770+0000 7faa35183700 1 -- start start 2023-10-03T10:14:16.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.770+0000 7faa35183700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa3009e930 0x7faa301a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.770+0000 7faa35183700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faa3009f240 0x7faa301a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.770+0000 7faa35183700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa3009f650 0x7faa301a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.770+0000 7faa35183700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa30071ce0 con 0x7faa3009f650 2023-10-03T10:14:16.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.770+0000 7faa35183700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa301a5d50 con 0x7faa3009e930 2023-10-03T10:14:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.770+0000 7faa35183700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa300a3410 con 0x7faa3009f240 2023-10-03T10:14:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.770+0000 7faa2e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faa3009f240 0x7faa301a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.770+0000 7faa2e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faa3009f240 0x7faa301a4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60652/0 (socket says 172.21.15.72:60652) 2023-10-03T10:14:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.770+0000 7faa2e59c700 1 -- 172.21.15.72:0/2340850233 learned_addr learned my addr 172.21.15.72:0/2340850233 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.770+0000 7faa2ed9d700 1 --2- 172.21.15.72:0/2340850233 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa3009e930 0x7faa301a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.770+0000 7faa2f59e700 1 --2- 172.21.15.72:0/2340850233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa3009f650 0x7faa301a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.771+0000 7faa2e59c700 1 -- 172.21.15.72:0/2340850233 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa3009e930 msgr2=0x7faa301a3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.771+0000 7faa2e59c700 1 --2- 172.21.15.72:0/2340850233 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa3009e930 0x7faa301a3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.771+0000 7faa2e59c700 1 -- 172.21.15.72:0/2340850233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa3009f650 msgr2=0x7faa301a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.771+0000 7faa2e59c700 1 --2- 172.21.15.72:0/2340850233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa3009f650 0x7faa301a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.771+0000 7faa2e59c700 1 -- 172.21.15.72:0/2340850233 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa240094a0 con 0x7faa3009f240 2023-10-03T10:14:16.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.771+0000 7faa2f59e700 1 --2- 172.21.15.72:0/2340850233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa3009f650 0x7faa301a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:16.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.771+0000 7faa2e59c700 1 --2- 172.21.15.72:0/2340850233 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faa3009f240 0x7faa301a4170 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faa2400ebe0 tx=0x7faa2400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.771+0000 7faa177fe700 1 -- 172.21.15.72:0/2340850233 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2400c850 con 0x7faa3009f240 2023-10-03T10:14:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.771+0000 7faa177fe700 1 -- 172.21.15.72:0/2340850233 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2400c9b0 con 0x7faa3009f240 2023-10-03T10:14:16.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.771+0000 7faa177fe700 1 -- 172.21.15.72:0/2340850233 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2400cd40 con 0x7faa3009f240 2023-10-03T10:14:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.771+0000 7faa35183700 1 -- 172.21.15.72:0/2340850233 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa200094a0 con 0x7faa3009f240 2023-10-03T10:14:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.771+0000 7faa35183700 1 -- 172.21.15.72:0/2340850233 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa300a0190 con 0x7faa3009f240 2023-10-03T10:14:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.772+0000 7faa177fe700 1 -- 172.21.15.72:0/2340850233 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faa24013470 con 0x7faa3009f240 2023-10-03T10:14:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.772+0000 7faa35183700 1 -- 172.21.15.72:0/2340850233 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa301a0b30 con 0x7faa3009f240 2023-10-03T10:14:16.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.772+0000 7faa177fe700 1 -- 172.21.15.72:0/2340850233 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faa24012d90 con 0x7faa3009f240 2023-10-03T10:14:16.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.777+0000 7faa177fe700 1 -- 172.21.15.72:0/2340850233 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faa24013720 con 0x7faa3009f240 2023-10-03T10:14:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.811+0000 7f89b634a700 1 Processor -- start 2023-10-03T10:14:16.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.811+0000 7f89b634a700 1 -- start start 2023-10-03T10:14:16.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89b634a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89b009e930 0x7f89b009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89b634a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b009f240 0x7f89b01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89b634a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b009f650 0x7f89b0131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89b634a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b0070940 con 0x7f89b009e930 2023-10-03T10:14:16.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89b634a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b006fd60 con 0x7f89b009f240 2023-10-03T10:14:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89b634a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89b006fa80 con 0x7f89b009f650 2023-10-03T10:14:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89affff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89b009e930 0x7f89b009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89affff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89b009e930 0x7f89b009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35772/0 (socket says 172.21.15.72:35772) 2023-10-03T10:14:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89affff700 1 -- 172.21.15.72:0/4062240330 learned_addr learned my addr 172.21.15.72:0/4062240330 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:16.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89af7fe700 1 --2- 172.21.15.72:0/4062240330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b009f240 0x7f89b01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89b48e7700 1 --2- 172.21.15.72:0/4062240330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b009f650 0x7f89b0131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89af7fe700 1 -- 172.21.15.72:0/4062240330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b009f650 msgr2=0x7f89b0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89af7fe700 1 --2- 172.21.15.72:0/4062240330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b009f650 0x7f89b0131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89af7fe700 1 -- 172.21.15.72:0/4062240330 >> v2:172.21.15.72:3300/0 conn(0x7f89b009e930 msgr2=0x7f89b009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:16.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89af7fe700 1 --2- 172.21.15.72:0/4062240330 >> v2:172.21.15.72:3300/0 conn(0x7f89b009e930 0x7f89b009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89af7fe700 1 -- 172.21.15.72:0/4062240330 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b009fb60 con 0x7f89b009f240 2023-10-03T10:14:16.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.812+0000 7f89af7fe700 1 --2- 172.21.15.72:0/4062240330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b009f240 0x7f89b01317f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009840 tx=0x7f89a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11da0202380bee8a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.813+0000 7f89aeffd700 1 -- 172.21.15.72:0/4062240330 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4011830 con 0x7f89b009f240 2023-10-03T10:14:16.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.813+0000 7f89aeffd700 1 -- 172.21.15.72:0/4062240330 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a4011990 con 0x7f89b009f240 2023-10-03T10:14:16.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.813+0000 7f89aeffd700 1 -- 172.21.15.72:0/4062240330 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4011d20 con 0x7f89b009f240 2023-10-03T10:14:16.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.813+0000 7f89b634a700 1 -- 172.21.15.72:0/4062240330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b009f240 msgr2=0x7f89b01317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.813+0000 7f89b634a700 1 --2- 172.21.15.72:0/4062240330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b009f240 0x7f89b01317f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009840 tx=0x7f89a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:16.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.813+0000 7f89b634a700 1 -- 172.21.15.72:0/4062240330 shutdown_connections 2023-10-03T10:14:16.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.813+0000 7f89b634a700 1 --2- 172.21.15.72:0/4062240330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b009f650 0x7f89b0131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.813+0000 7f89b634a700 1 --2- 172.21.15.72:0/4062240330 >> v2:172.21.15.72:3300/0 conn(0x7f89b009e930 0x7f89b009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.813+0000 7f89b634a700 1 --2- 172.21.15.72:0/4062240330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b009f240 0x7f89b01317f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.813+0000 7f89b634a700 1 -- 172.21.15.72:0/4062240330 >> 172.21.15.72:0/4062240330 conn(0x7f89b00a4210 msgr2=0x7f89b00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.813+0000 7f89b634a700 1 -- 172.21.15.72:0/4062240330 shutdown_connections 2023-10-03T10:14:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.813+0000 7f89b634a700 1 -- 172.21.15.72:0/4062240330 wait complete. 2023-10-03T10:14:16.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.814+0000 7f89b634a700 1 Processor -- start 2023-10-03T10:14:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.815+0000 7f89b634a700 1 -- start start 2023-10-03T10:14:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.815+0000 7f89b634a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b009e930 0x7f89b006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.815+0000 7f89b634a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b009f240 0x7f89b006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.815+0000 7f89b634a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b009f650 0x7f89b006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.815+0000 7f89b634a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b01b71e0 con 0x7f89b009e930 2023-10-03T10:14:16.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.815+0000 7f89b634a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b01a9390 con 0x7f89b009f240 2023-10-03T10:14:16.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.815+0000 7f89b634a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89b01a88b0 con 0x7f89b009f650 2023-10-03T10:14:16.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.815+0000 7f89affff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b009e930 0x7f89b006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.815+0000 7f89affff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b009e930 0x7f89b006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35780/0 (socket says 172.21.15.72:35780) 2023-10-03T10:14:16.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.815+0000 7f89affff700 1 -- 172.21.15.72:0/630550478 learned_addr learned my addr 172.21.15.72:0/630550478 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:16.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.815+0000 7f89af7fe700 1 --2- 172.21.15.72:0/630550478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b009f240 0x7f89b006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.816+0000 7f89b48e7700 1 --2- 172.21.15.72:0/630550478 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b009f650 0x7f89b006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:16.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.816+0000 7f89affff700 1 -- 172.21.15.72:0/630550478 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b009f650 msgr2=0x7f89b006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.816+0000 7f89affff700 1 --2- 172.21.15.72:0/630550478 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b009f650 0x7f89b006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.816+0000 7f89affff700 1 -- 172.21.15.72:0/630550478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b009f240 msgr2=0x7f89b006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.816+0000 7f89affff700 1 --2- 172.21.15.72:0/630550478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b009f240 0x7f89b006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.816+0000 7f89affff700 1 -- 172.21.15.72:0/630550478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a40094a0 con 0x7f89b009e930 2023-10-03T10:14:16.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.816+0000 7f89affff700 1 --2- 172.21.15.72:0/630550478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b009e930 0x7f89b006b8b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f89a000e990 tx=0x7f89a000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:16.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.816+0000 7f89acff9700 1 -- 172.21.15.72:0/630550478 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a000eee0 con 0x7f89b009e930 2023-10-03T10:14:16.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.816+0000 7f89acff9700 1 -- 172.21.15.72:0/630550478 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a000c850 con 0x7f89b009e930 2023-10-03T10:14:16.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.816+0000 7f89acff9700 1 -- 172.21.15.72:0/630550478 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a000cbc0 con 0x7f89b009e930 2023-10-03T10:14:16.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.816+0000 7f89b634a700 1 -- 172.21.15.72:0/630550478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b00a0190 con 0x7f89b009e930 2023-10-03T10:14:16.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.816+0000 7f89b634a700 1 -- 172.21.15.72:0/630550478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b01a90c0 con 0x7f89b009e930 2023-10-03T10:14:16.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.817+0000 7f89acff9700 1 -- 172.21.15.72:0/630550478 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89a000cd20 con 0x7f89b009e930 2023-10-03T10:14:16.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.817+0000 7f89b634a700 1 -- 172.21.15.72:0/630550478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b01a0b30 con 0x7f89b009e930 2023-10-03T10:14:16.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.818+0000 7f89acff9700 1 -- 172.21.15.72:0/630550478 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f89a003fba0 con 0x7f89b009e930 2023-10-03T10:14:16.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.826+0000 7f89acff9700 1 -- 172.21.15.72:0/630550478 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89a0011ab0 con 0x7f89b009e930 2023-10-03T10:14:16.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.900+0000 7faed812f700 1 -- 172.21.15.72:0/1438066941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faed006c360 con 0x7faed009e410 2023-10-03T10:14:16.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.900+0000 7faec67fc700 1 -- 172.21.15.72:0/1438066941 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7faec802a030 con 0x7faed009e410 2023-10-03T10:14:16.901 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:16.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.903+0000 7faed812f700 1 -- 172.21.15.72:0/1438066941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faed009e410 msgr2=0x7faed01a6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.903+0000 7faed812f700 1 --2- 172.21.15.72:0/1438066941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faed009e410 0x7faed01a6930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faec800efc0 tx=0x7faec800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.903+0000 7faed812f700 1 -- 172.21.15.72:0/1438066941 shutdown_connections 2023-10-03T10:14:16.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.903+0000 7faed812f700 1 --2- 172.21.15.72:0/1438066941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faed009d6f0 0x7faed01a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.903+0000 7faed812f700 1 --2- 172.21.15.72:0/1438066941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faed009e410 0x7faed01a6930 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.903+0000 7faed812f700 1 --2- 172.21.15.72:0/1438066941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faed009e000 0x7faed01a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.903+0000 7faed812f700 1 -- 172.21.15.72:0/1438066941 >> 172.21.15.72:0/1438066941 conn(0x7faed0066f50 msgr2=0x7faed01baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.903+0000 7faed812f700 1 -- 172.21.15.72:0/1438066941 shutdown_connections 2023-10-03T10:14:16.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.903+0000 7faed812f700 1 -- 172.21.15.72:0/1438066941 wait complete. 2023-10-03T10:14:16.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:16.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.975+0000 7faa35183700 1 -- 172.21.15.72:0/2340850233 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faa30074ea0 con 0x7faa3009f240 2023-10-03T10:14:16.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.975+0000 7faa177fe700 1 -- 172.21.15.72:0/2340850233 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa2401b3b0 con 0x7faa3009f240 2023-10-03T10:14:16.976 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:16.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.977+0000 7faa35183700 1 -- 172.21.15.72:0/2340850233 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faa3009f240 msgr2=0x7faa301a4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.977+0000 7faa35183700 1 --2- 172.21.15.72:0/2340850233 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faa3009f240 0x7faa301a4170 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faa2400ebe0 tx=0x7faa2400eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.977+0000 7faa35183700 1 -- 172.21.15.72:0/2340850233 shutdown_connections 2023-10-03T10:14:16.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.977+0000 7faa35183700 1 --2- 172.21.15.72:0/2340850233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa3009f650 0x7faa301a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.977+0000 7faa35183700 1 --2- 172.21.15.72:0/2340850233 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa3009e930 0x7faa301a3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.977+0000 7faa35183700 1 --2- 172.21.15.72:0/2340850233 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faa3009f240 0x7faa301a4170 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.977+0000 7faa35183700 1 -- 172.21.15.72:0/2340850233 >> 172.21.15.72:0/2340850233 conn(0x7faa300a4210 msgr2=0x7faa301b8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.977+0000 7faa35183700 1 -- 172.21.15.72:0/2340850233 shutdown_connections 2023-10-03T10:14:16.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:16.977+0000 7faa35183700 1 -- 172.21.15.72:0/2340850233 wait complete. 2023-10-03T10:14:16.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:17.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.018+0000 7f89b634a700 1 -- 172.21.15.72:0/630550478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f89b009ffe0 con 0x7f89b009e930 2023-10-03T10:14:17.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.018+0000 7f89acff9700 1 -- 172.21.15.72:0/630550478 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f89a0021020 con 0x7f89b009e930 2023-10-03T10:14:17.019 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.020+0000 7f89b634a700 1 -- 172.21.15.72:0/630550478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b009e930 msgr2=0x7f89b006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.020+0000 7f89b634a700 1 --2- 172.21.15.72:0/630550478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b009e930 0x7f89b006b8b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f89a000e990 tx=0x7f89a000eca0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.020+0000 7f89b634a700 1 -- 172.21.15.72:0/630550478 shutdown_connections 2023-10-03T10:14:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.021+0000 7f89b634a700 1 --2- 172.21.15.72:0/630550478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b009e930 0x7f89b006b8b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.021+0000 7f89b634a700 1 --2- 172.21.15.72:0/630550478 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89b009f650 0x7f89b006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.021+0000 7f89b634a700 1 --2- 172.21.15.72:0/630550478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b009f240 0x7f89b006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.021+0000 7f89b634a700 1 -- 172.21.15.72:0/630550478 >> 172.21.15.72:0/630550478 conn(0x7f89b00a4210 msgr2=0x7f89b01b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.021+0000 7f89b634a700 1 -- 172.21.15.72:0/630550478 shutdown_connections 2023-10-03T10:14:17.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.021+0000 7f89b634a700 1 -- 172.21.15.72:0/630550478 wait complete. 2023-10-03T10:14:17.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:17.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:17.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.837+0000 7f3d063da700 1 Processor -- start 2023-10-03T10:14:17.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.837+0000 7f3d063da700 1 -- start start 2023-10-03T10:14:17.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3d063da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d00131810 0x7f3d00131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3d063da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d0009a580 0x7f3d00139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3d063da700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d001313c0 con 0x7f3d00099a40 2023-10-03T10:14:17.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3d063da700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0006e8c0 con 0x7f3d0009a580 2023-10-03T10:14:17.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3d063da700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d00071d20 con 0x7f3d00131810 2023-10-03T10:14:17.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3cfffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d00131810 0x7f3d00131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3cff7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3d00099a40 0x7f3d00099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48176/0 (socket says 172.21.15.72:48176) 2023-10-03T10:14:17.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3cff7fe700 1 -- 172.21.15.72:0/3936699920 learned_addr learned my addr 172.21.15.72:0/3936699920 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:17.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3d04977700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d0009a580 0x7f3d00139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3cfffff700 1 -- 172.21.15.72:0/3936699920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d0009a580 msgr2=0x7f3d00139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3cfffff700 1 --2- 172.21.15.72:0/3936699920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d0009a580 0x7f3d00139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3cfffff700 1 -- 172.21.15.72:0/3936699920 >> v1:172.21.15.72:6789/0 conn(0x7f3d00099a40 legacy=0x7f3d00099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3cfeffd700 1 -- 172.21.15.72:0/3936699920 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432355226 0 0) 0x7f3d001313c0 con 0x7f3d00099a40 2023-10-03T10:14:17.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3cfffff700 1 -- 172.21.15.72:0/3936699920 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d000721a0 con 0x7f3d00131810 2023-10-03T10:14:17.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3d04977700 1 --2- 172.21.15.72:0/3936699920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d0009a580 0x7f3d00139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3cfffff700 1 --2- 172.21.15.72:0/3936699920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d00131810 0x7f3d00131be0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009870 tx=0x7f3cf4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eec78f05240652b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3cfeffd700 1 -- 172.21.15.72:0/3936699920 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4011830 con 0x7f3d00131810 2023-10-03T10:14:17.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3cfeffd700 1 -- 172.21.15.72:0/3936699920 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf4011990 con 0x7f3d00131810 2023-10-03T10:14:17.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.838+0000 7f3cfeffd700 1 -- 172.21.15.72:0/3936699920 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4011d20 con 0x7f3d00131810 2023-10-03T10:14:17.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.839+0000 7f3d063da700 1 -- 172.21.15.72:0/3936699920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d00131810 msgr2=0x7f3d00131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.839+0000 7f3d063da700 1 --2- 172.21.15.72:0/3936699920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d00131810 0x7f3d00131be0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009870 tx=0x7f3cf4009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:17.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.839+0000 7f3d063da700 1 -- 172.21.15.72:0/3936699920 shutdown_connections 2023-10-03T10:14:17.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.839+0000 7f3d063da700 1 --2- 172.21.15.72:0/3936699920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d0009a580 0x7f3d00139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.839+0000 7f3d063da700 1 --2- 172.21.15.72:0/3936699920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d00131810 0x7f3d00131be0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.839+0000 7f3d063da700 1 -- 172.21.15.72:0/3936699920 >> 172.21.15.72:0/3936699920 conn(0x7f3d000a2aa0 msgr2=0x7f3d000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.839+0000 7f3d063da700 1 -- 172.21.15.72:0/3936699920 shutdown_connections 2023-10-03T10:14:17.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.839+0000 7f3d063da700 1 -- 172.21.15.72:0/3936699920 wait complete. 2023-10-03T10:14:17.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.840+0000 7f3d063da700 1 Processor -- start 2023-10-03T10:14:17.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.840+0000 7f3d063da700 1 -- start start 2023-10-03T10:14:17.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.840+0000 7f3d063da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d00099a40 0x7f3d0011b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.840+0000 7f3d063da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d0009a580 0x7f3d0011bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.840+0000 7f3d063da700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d00131810 0x7f3d0011c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.840+0000 7f3d063da700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0011e910 con 0x7f3d00131810 2023-10-03T10:14:17.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.840+0000 7f3d063da700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0006eb00 con 0x7f3d0009a580 2023-10-03T10:14:17.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.840+0000 7f3d063da700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d000a1a80 con 0x7f3d00099a40 2023-10-03T10:14:17.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.840+0000 7f3cff7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d0009a580 0x7f3d0011bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.840+0000 7f3cfffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d00099a40 0x7f3d0011b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.840+0000 7f3cfffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d00099a40 0x7f3d0011b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60690/0 (socket says 172.21.15.72:60690) 2023-10-03T10:14:17.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.840+0000 7f3cff7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d0009a580 0x7f3d0011bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54698/0 (socket says 172.21.15.72:54698) 2023-10-03T10:14:17.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.840+0000 7f3cfffff700 1 -- 172.21.15.72:0/2793459332 learned_addr learned my addr 172.21.15.72:0/2793459332 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:17.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.840+0000 7f3d04977700 1 --2- 172.21.15.72:0/2793459332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d00131810 0x7f3d0011c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.841+0000 7f3cfffff700 1 -- 172.21.15.72:0/2793459332 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d0009a580 msgr2=0x7f3d0011bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.841+0000 7f3cfffff700 1 --2- 172.21.15.72:0/2793459332 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d0009a580 0x7f3d0011bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.841+0000 7f3cfffff700 1 -- 172.21.15.72:0/2793459332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d00131810 msgr2=0x7f3d0011c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.841+0000 7f3cfffff700 1 --2- 172.21.15.72:0/2793459332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d00131810 0x7f3d0011c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.841+0000 7f3cfffff700 1 -- 172.21.15.72:0/2793459332 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf8009a70 con 0x7f3d00099a40 2023-10-03T10:14:17.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.841+0000 7f3cff7fe700 1 --2- 172.21.15.72:0/2793459332 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d0009a580 0x7f3d0011bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.841+0000 7f3d04977700 1 --2- 172.21.15.72:0/2793459332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d00131810 0x7f3d0011c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.841+0000 7f3cfffff700 1 --2- 172.21.15.72:0/2793459332 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d00099a40 0x7f3d0011b6f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009bc0 tx=0x7f3cf4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.841+0000 7f3cfcff9700 1 -- 172.21.15.72:0/2793459332 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4004550 con 0x7f3d00099a40 2023-10-03T10:14:17.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.841+0000 7f3cfcff9700 1 -- 172.21.15.72:0/2793459332 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf40036a0 con 0x7f3d00099a40 2023-10-03T10:14:17.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.841+0000 7f3cfcff9700 1 -- 172.21.15.72:0/2793459332 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4003a30 con 0x7f3d00099a40 2023-10-03T10:14:17.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.841+0000 7f3d063da700 1 -- 172.21.15.72:0/2793459332 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf40094a0 con 0x7f3d00099a40 2023-10-03T10:14:17.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.841+0000 7f3d063da700 1 -- 172.21.15.72:0/2793459332 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0011e4c0 con 0x7f3d00099a40 2023-10-03T10:14:17.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.842+0000 7f3cfcff9700 1 -- 172.21.15.72:0/2793459332 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3cf4003b90 con 0x7f3d00099a40 2023-10-03T10:14:17.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.842+0000 7f3cfcff9700 1 -- 172.21.15.72:0/2793459332 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3cf4040280 con 0x7f3d00099a40 2023-10-03T10:14:17.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.842+0000 7f3d063da700 1 -- 172.21.15.72:0/2793459332 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0011ed20 con 0x7f3d00099a40 2023-10-03T10:14:17.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:17.847+0000 7f3cfcff9700 1 -- 172.21.15.72:0/2793459332 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3cf401a420 con 0x7f3d00099a40 2023-10-03T10:14:17.915 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:17.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:18.034 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:18.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.043+0000 7f36e7781700 1 Processor -- start 2023-10-03T10:14:18.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.044+0000 7f36e7781700 1 -- start start 2023-10-03T10:14:18.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.044+0000 7f36e7781700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36e006a770 0x7f36e006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.044+0000 7f36e7781700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36e006b080 0x7f36e0131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.044+0000 7f36e7781700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36e0131b40 0x7f36e0131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.044+0000 7f36e7781700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e009ece0 con 0x7f36e006a770 2023-10-03T10:14:18.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.044+0000 7f36e7781700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e009e760 con 0x7f36e0131b40 2023-10-03T10:14:18.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.044+0000 7f36e7781700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36e009e040 con 0x7f36e006b080 2023-10-03T10:14:18.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.044+0000 7f36e4d1c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36e006b080 0x7f36e0131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.044+0000 7f36e4d1c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36e006b080 0x7f36e0131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60706/0 (socket says 172.21.15.72:60706) 2023-10-03T10:14:18.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.044+0000 7f36e4d1c700 1 -- 172.21.15.72:0/3303318184 learned_addr learned my addr 172.21.15.72:0/3303318184 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:18.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.045+0000 7f36e551d700 1 --2- 172.21.15.72:0/3303318184 >> v2:172.21.15.72:3300/0 conn(0x7f36e006a770 0x7f36e006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.045+0000 7f36e4d1c700 1 -- 172.21.15.72:0/3303318184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36e0131b40 msgr2=0x7f36e0131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.045+0000 7f36e4d1c700 1 --2- 172.21.15.72:0/3303318184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36e0131b40 0x7f36e0131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.045+0000 7f36e4d1c700 1 -- 172.21.15.72:0/3303318184 >> v2:172.21.15.72:3300/0 conn(0x7f36e006a770 msgr2=0x7f36e006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.045+0000 7f36e4d1c700 1 --2- 172.21.15.72:0/3303318184 >> v2:172.21.15.72:3300/0 conn(0x7f36e006a770 0x7f36e006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.045+0000 7f36e4d1c700 1 -- 172.21.15.72:0/3303318184 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e009f630 con 0x7f36e006b080 2023-10-03T10:14:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.045+0000 7f36e4d1c700 1 --2- 172.21.15.72:0/3303318184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36e006b080 0x7f36e0131600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f36d00098f0 tx=0x7f36d0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64102fb7351a1ec8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.045+0000 7f36d7fff700 1 -- 172.21.15.72:0/3303318184 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d000b8a0 con 0x7f36e006b080 2023-10-03T10:14:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.045+0000 7f36d7fff700 1 -- 172.21.15.72:0/3303318184 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d000ba00 con 0x7f36e006b080 2023-10-03T10:14:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.045+0000 7f36d7fff700 1 -- 172.21.15.72:0/3303318184 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d000bd90 con 0x7f36e006b080 2023-10-03T10:14:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.046+0000 7f36e7781700 1 -- 172.21.15.72:0/3303318184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36e006b080 msgr2=0x7f36e0131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.046+0000 7f36e7781700 1 --2- 172.21.15.72:0/3303318184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36e006b080 0x7f36e0131600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f36d00098f0 tx=0x7f36d0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.046+0000 7f3d063da700 1 -- 172.21.15.72:0/2793459332 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3d00074ea0 con 0x7f3d00099a40 2023-10-03T10:14:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.046+0000 7f36e7781700 1 -- 172.21.15.72:0/3303318184 shutdown_connections 2023-10-03T10:14:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.046+0000 7f36e7781700 1 --2- 172.21.15.72:0/3303318184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36e0131b40 0x7f36e0131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.046+0000 7f36e7781700 1 --2- 172.21.15.72:0/3303318184 >> v2:172.21.15.72:3300/0 conn(0x7f36e006a770 0x7f36e006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.046+0000 7f36e7781700 1 --2- 172.21.15.72:0/3303318184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36e006b080 0x7f36e0131600 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.046+0000 7f36e7781700 1 -- 172.21.15.72:0/3303318184 >> 172.21.15.72:0/3303318184 conn(0x7f36e0066f50 msgr2=0x7f36e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.046+0000 7f36e7781700 1 -- 172.21.15.72:0/3303318184 shutdown_connections 2023-10-03T10:14:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.046+0000 7f36e7781700 1 -- 172.21.15.72:0/3303318184 wait complete. 2023-10-03T10:14:18.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.047+0000 7f3cfcff9700 1 -- 172.21.15.72:0/2793459332 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3cf4015020 con 0x7f3d00099a40 2023-10-03T10:14:18.051 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:18.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.047+0000 7f36e7781700 1 Processor -- start 2023-10-03T10:14:18.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.047+0000 7f36e7781700 1 -- start start 2023-10-03T10:14:18.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.048+0000 7f36e7781700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e006a770 0x7f36e01c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.048+0000 7f36e7781700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36e006b080 0x7f36e01c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.048+0000 7f36e7781700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36e0131b40 0x7f36e01c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.048+0000 7f36e7781700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e0121bb0 con 0x7f36e006a770 2023-10-03T10:14:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.048+0000 7f36e7781700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e01215b0 con 0x7f36e0131b40 2023-10-03T10:14:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.048+0000 7f36e7781700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36e0121f10 con 0x7f36e006b080 2023-10-03T10:14:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.048+0000 7f36e5d1e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36e0131b40 0x7f36e01c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.048+0000 7f36e5d1e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36e0131b40 0x7f36e01c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54704/0 (socket says 172.21.15.72:54704) 2023-10-03T10:14:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.048+0000 7f36e5d1e700 1 -- 172.21.15.72:0/907040219 learned_addr learned my addr 172.21.15.72:0/907040219 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.048+0000 7f36e4d1c700 1 --2- 172.21.15.72:0/907040219 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36e006b080 0x7f36e01c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.048+0000 7f36e5d1e700 1 -- 172.21.15.72:0/907040219 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36e006b080 msgr2=0x7f36e01c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.048+0000 7f36e5d1e700 1 --2- 172.21.15.72:0/907040219 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36e006b080 0x7f36e01c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.048+0000 7f36e5d1e700 1 -- 172.21.15.72:0/907040219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e006a770 msgr2=0x7f36e01c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.048+0000 7f36e5d1e700 1 --2- 172.21.15.72:0/907040219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e006a770 0x7f36e01c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.048+0000 7f36e5d1e700 1 -- 172.21.15.72:0/907040219 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d0009550 con 0x7f36e0131b40 2023-10-03T10:14:18.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.049+0000 7f36e5d1e700 1 --2- 172.21.15.72:0/907040219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36e0131b40 0x7f36e01c8e40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f36d800b970 tx=0x7f36d800bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.049+0000 7f36d5ffb700 1 -- 172.21.15.72:0/907040219 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d800c930 con 0x7f36e0131b40 2023-10-03T10:14:18.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.049+0000 7f36d5ffb700 1 -- 172.21.15.72:0/907040219 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d800cab0 con 0x7f36e0131b40 2023-10-03T10:14:18.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.049+0000 7f36e7781700 1 -- 172.21.15.72:0/907040219 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e01315b0 con 0x7f36e0131b40 2023-10-03T10:14:18.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.049+0000 7f36d5ffb700 1 -- 172.21.15.72:0/907040219 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d800ce60 con 0x7f36e0131b40 2023-10-03T10:14:18.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.049+0000 7f36e7781700 1 -- 172.21.15.72:0/907040219 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e009c010 con 0x7f36e0131b40 2023-10-03T10:14:18.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.050+0000 7f36d5ffb700 1 -- 172.21.15.72:0/907040219 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36d801d3b0 con 0x7f36e0131b40 2023-10-03T10:14:18.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.050+0000 7f36d5ffb700 1 -- 172.21.15.72:0/907040219 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f36d8006e40 con 0x7f36e0131b40 2023-10-03T10:14:18.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.050+0000 7f36e7781700 1 -- 172.21.15.72:0/907040219 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c00052e0 con 0x7f36e0131b40 2023-10-03T10:14:18.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.050+0000 7f3d063da700 1 -- 172.21.15.72:0/2793459332 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d00099a40 msgr2=0x7f3d0011b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.050+0000 7f3d063da700 1 --2- 172.21.15.72:0/2793459332 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d00099a40 0x7f3d0011b6f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009bc0 tx=0x7f3cf4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:18.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.050+0000 7f3d063da700 1 -- 172.21.15.72:0/2793459332 shutdown_connections 2023-10-03T10:14:18.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.050+0000 7f3d063da700 1 --2- 172.21.15.72:0/2793459332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d00131810 0x7f3d0011c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.050+0000 7f3d063da700 1 --2- 172.21.15.72:0/2793459332 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d00099a40 0x7f3d0011b6f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.050+0000 7f3d063da700 1 --2- 172.21.15.72:0/2793459332 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d0009a580 0x7f3d0011bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.050+0000 7f3d063da700 1 -- 172.21.15.72:0/2793459332 >> 172.21.15.72:0/2793459332 conn(0x7f3d000a2aa0 msgr2=0x7f3d001b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.050+0000 7f3d063da700 1 -- 172.21.15.72:0/2793459332 shutdown_connections 2023-10-03T10:14:18.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.050+0000 7f3d063da700 1 -- 172.21.15.72:0/2793459332 wait complete. 2023-10-03T10:14:18.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.055+0000 7f36d5ffb700 1 -- 172.21.15.72:0/907040219 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36d8019080 con 0x7f36e0131b40 2023-10-03T10:14:18.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:18.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.123+0000 7f6887836700 1 Processor -- start 2023-10-03T10:14:18.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.123+0000 7f6887836700 1 -- start start 2023-10-03T10:14:18.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.124+0000 7f6887836700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f688009f410 0x7f6880136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.124+0000 7f6887836700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6880136fe0 0x7f68801393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.124+0000 7f6887836700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6880070940 con 0x7f688009e930 2023-10-03T10:14:18.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.124+0000 7f6887836700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688006fd60 con 0x7f6880136fe0 2023-10-03T10:14:18.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.124+0000 7f6887836700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688006fa80 con 0x7f688009f410 2023-10-03T10:14:18.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.124+0000 7f6884dd1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f688009f410 0x7f6880136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.124+0000 7f6884dd1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f688009f410 0x7f6880136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54708/0 (socket says 172.21.15.72:54708) 2023-10-03T10:14:18.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.124+0000 7f6885dd3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6880136fe0 0x7f68801393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.124+0000 7f6884dd1700 1 -- 172.21.15.72:0/1641505614 learned_addr learned my addr 172.21.15.72:0/1641505614 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:18.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.124+0000 7f6885dd3700 1 -- 172.21.15.72:0/1641505614 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f688009f410 msgr2=0x7f6880136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.124+0000 7f6885dd3700 1 --2- 172.21.15.72:0/1641505614 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f688009f410 0x7f6880136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.124+0000 7f6885dd3700 1 -- 172.21.15.72:0/1641505614 >> v1:172.21.15.72:6789/0 conn(0x7f688009e930 legacy=0x7f688009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.124+0000 7f6885dd3700 1 -- 172.21.15.72:0/1641505614 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688009fb60 con 0x7f6880136fe0 2023-10-03T10:14:18.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.124+0000 7f6884dd1700 1 --2- 172.21.15.72:0/1641505614 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f688009f410 0x7f6880136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.124+0000 7f6885dd3700 1 --2- 172.21.15.72:0/1641505614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6880136fe0 0x7f68801393c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6878009d90 tx=0x7f687800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181f27a9ea4dcf89 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.125+0000 7f6877fff700 1 -- 172.21.15.72:0/1641505614 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687800e070 con 0x7f6880136fe0 2023-10-03T10:14:18.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.125+0000 7f6877fff700 1 -- 172.21.15.72:0/1641505614 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687800bb20 con 0x7f6880136fe0 2023-10-03T10:14:18.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.125+0000 7f6877fff700 1 -- 172.21.15.72:0/1641505614 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878012430 con 0x7f6880136fe0 2023-10-03T10:14:18.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.125+0000 7f6887836700 1 -- 172.21.15.72:0/1641505614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6880136fe0 msgr2=0x7f68801393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.125+0000 7f6887836700 1 --2- 172.21.15.72:0/1641505614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6880136fe0 0x7f68801393c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6878009d90 tx=0x7f687800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:18.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.125+0000 7f6887836700 1 -- 172.21.15.72:0/1641505614 shutdown_connections 2023-10-03T10:14:18.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.125+0000 7f6887836700 1 --2- 172.21.15.72:0/1641505614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6880136fe0 0x7f68801393c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.125+0000 7f6887836700 1 --2- 172.21.15.72:0/1641505614 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f688009f410 0x7f6880136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.125+0000 7f6887836700 1 -- 172.21.15.72:0/1641505614 >> 172.21.15.72:0/1641505614 conn(0x7f68800a4210 msgr2=0x7f68800a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.125+0000 7f6887836700 1 -- 172.21.15.72:0/1641505614 shutdown_connections 2023-10-03T10:14:18.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.125+0000 7f6887836700 1 -- 172.21.15.72:0/1641505614 wait complete. 2023-10-03T10:14:18.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.126+0000 7f6887836700 1 Processor -- start 2023-10-03T10:14:18.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.126+0000 7f6887836700 1 -- start start 2023-10-03T10:14:18.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f6887836700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f688009e930 0x7f6880121970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f6887836700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f688009f410 0x7f6880121eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f6887836700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6880136fe0 0x7f68801223f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f6887836700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6880125490 con 0x7f6880136fe0 2023-10-03T10:14:18.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f6887836700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6880124ef0 con 0x7f688009e930 2023-10-03T10:14:18.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f6887836700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6880123580 con 0x7f688009f410 2023-10-03T10:14:18.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f68855d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f688009e930 0x7f6880121970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f68855d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f688009e930 0x7f6880121970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54712/0 (socket says 172.21.15.72:54712) 2023-10-03T10:14:18.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f68855d2700 1 -- 172.21.15.72:0/1804348411 learned_addr learned my addr 172.21.15.72:0/1804348411 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:18.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f6884dd1700 1 --2- 172.21.15.72:0/1804348411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f688009f410 0x7f6880121eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f6885dd3700 1 --2- 172.21.15.72:0/1804348411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6880136fe0 0x7f68801223f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f68855d2700 1 -- 172.21.15.72:0/1804348411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f688009f410 msgr2=0x7f6880121eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f68855d2700 1 --2- 172.21.15.72:0/1804348411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f688009f410 0x7f6880121eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f68855d2700 1 -- 172.21.15.72:0/1804348411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6880136fe0 msgr2=0x7f68801223f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f68855d2700 1 --2- 172.21.15.72:0/1804348411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6880136fe0 0x7f68801223f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f68855d2700 1 -- 172.21.15.72:0/1804348411 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6870009550 con 0x7f688009e930 2023-10-03T10:14:18.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f6885dd3700 1 --2- 172.21.15.72:0/1804348411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6880136fe0 0x7f68801223f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.127+0000 7f68855d2700 1 --2- 172.21.15.72:0/1804348411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f688009e930 0x7f6880121970 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f687c00c4e0 tx=0x7f687c00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.128+0000 7f6875ffb700 1 -- 172.21.15.72:0/1804348411 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c0052d0 con 0x7f688009e930 2023-10-03T10:14:18.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.128+0000 7f6887836700 1 -- 172.21.15.72:0/1804348411 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6878009a70 con 0x7f688009e930 2023-10-03T10:14:18.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.128+0000 7f6875ffb700 1 -- 172.21.15.72:0/1804348411 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c005430 con 0x7f688009e930 2023-10-03T10:14:18.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.128+0000 7f6875ffb700 1 -- 172.21.15.72:0/1804348411 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c0038c0 con 0x7f688009e930 2023-10-03T10:14:18.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.128+0000 7f6887836700 1 -- 172.21.15.72:0/1804348411 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6880123d30 con 0x7f688009e930 2023-10-03T10:14:18.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.129+0000 7f6875ffb700 1 -- 172.21.15.72:0/1804348411 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f687c003a20 con 0x7f688009e930 2023-10-03T10:14:18.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.129+0000 7f6875ffb700 1 -- 172.21.15.72:0/1804348411 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f687c040ab0 con 0x7f688009e930 2023-10-03T10:14:18.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.129+0000 7f6887836700 1 -- 172.21.15.72:0/1804348411 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6880074ea0 con 0x7f688009e930 2023-10-03T10:14:18.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.138+0000 7f6875ffb700 1 -- 172.21.15.72:0/1804348411 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f687c017080 con 0x7f688009e930 2023-10-03T10:14:18.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.172+0000 7fd3f6f0d700 1 Processor -- start 2023-10-03T10:14:18.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.172+0000 7fd3f6f0d700 1 -- start start 2023-10-03T10:14:18.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.172+0000 7fd3f6f0d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3f009e1d0 0x7fd3f0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.172+0000 7fd3f6f0d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd3f0139170 0x7fd3f013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.172+0000 7fd3f6f0d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f009b120 con 0x7fd3f009d6f0 2023-10-03T10:14:18.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.172+0000 7fd3f6f0d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f006b460 con 0x7fd3f0139170 2023-10-03T10:14:18.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.172+0000 7fd3f6f0d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f009a7e0 con 0x7fd3f009e1d0 2023-10-03T10:14:18.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.172+0000 7fd3effff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3f009e1d0 0x7fd3f0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.172+0000 7fd3effff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3f009e1d0 0x7fd3f0138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54720/0 (socket says 172.21.15.72:54720) 2023-10-03T10:14:18.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.172+0000 7fd3f54aa700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd3f0139170 0x7fd3f013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.172+0000 7fd3effff700 1 -- 172.21.15.72:0/4267288729 learned_addr learned my addr 172.21.15.72:0/4267288729 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:18.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.173+0000 7fd3effff700 1 -- 172.21.15.72:0/4267288729 >> v2:172.21.15.72:3300/0 conn(0x7fd3f0139170 msgr2=0x7fd3f013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.173+0000 7fd3effff700 1 --2- 172.21.15.72:0/4267288729 >> v2:172.21.15.72:3300/0 conn(0x7fd3f0139170 0x7fd3f013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.173+0000 7fd3effff700 1 -- 172.21.15.72:0/4267288729 >> v1:172.21.15.72:6789/0 conn(0x7fd3f009d6f0 legacy=0x7fd3f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.173+0000 7fd3effff700 1 -- 172.21.15.72:0/4267288729 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f009a500 con 0x7fd3f009e1d0 2023-10-03T10:14:18.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.173+0000 7fd3f54aa700 1 --2- 172.21.15.72:0/4267288729 >> v2:172.21.15.72:3300/0 conn(0x7fd3f0139170 0x7fd3f013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.173+0000 7fd3effff700 1 --2- 172.21.15.72:0/4267288729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3f009e1d0 0x7fd3f0138c30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009920 tx=0x7fd3dc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25b1605ca997228 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.173+0000 7fd3ef7fe700 1 -- 172.21.15.72:0/4267288729 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc011830 con 0x7fd3f009e1d0 2023-10-03T10:14:18.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.173+0000 7fd3ef7fe700 1 -- 172.21.15.72:0/4267288729 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc011990 con 0x7fd3f009e1d0 2023-10-03T10:14:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.173+0000 7fd3ef7fe700 1 -- 172.21.15.72:0/4267288729 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc011d20 con 0x7fd3f009e1d0 2023-10-03T10:14:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.174+0000 7fd3f6f0d700 1 -- 172.21.15.72:0/4267288729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3f009e1d0 msgr2=0x7fd3f0138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.174+0000 7fd3f6f0d700 1 --2- 172.21.15.72:0/4267288729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3f009e1d0 0x7fd3f0138c30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009920 tx=0x7fd3dc009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.174+0000 7fd3f6f0d700 1 -- 172.21.15.72:0/4267288729 shutdown_connections 2023-10-03T10:14:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.174+0000 7fd3f6f0d700 1 --2- 172.21.15.72:0/4267288729 >> v2:172.21.15.72:3300/0 conn(0x7fd3f0139170 0x7fd3f013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.174+0000 7fd3f6f0d700 1 --2- 172.21.15.72:0/4267288729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3f009e1d0 0x7fd3f0138c30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.174+0000 7fd3f6f0d700 1 -- 172.21.15.72:0/4267288729 >> 172.21.15.72:0/4267288729 conn(0x7fd3f0066f50 msgr2=0x7fd3f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.174+0000 7fd3f6f0d700 1 -- 172.21.15.72:0/4267288729 shutdown_connections 2023-10-03T10:14:18.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.174+0000 7fd3f6f0d700 1 -- 172.21.15.72:0/4267288729 wait complete. 2023-10-03T10:14:18.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.175+0000 7fd3f6f0d700 1 Processor -- start 2023-10-03T10:14:18.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.175+0000 7fd3f6f0d700 1 -- start start 2023-10-03T10:14:18.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.175+0000 7fd3f6f0d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3f009d6f0 0x7fd3f011e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.175+0000 7fd3f6f0d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3f009e1d0 0x7fd3f011edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.175+0000 7fd3f6f0d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f0139170 0x7fd3f011f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.175+0000 7fd3f6f0d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f009c710 con 0x7fd3f0139170 2023-10-03T10:14:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.175+0000 7fd3f6f0d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f01220c0 con 0x7fd3f009e1d0 2023-10-03T10:14:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.175+0000 7fd3f6f0d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f01205a0 con 0x7fd3f009d6f0 2023-10-03T10:14:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3effff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3f009e1d0 0x7fd3f011edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3effff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3f009e1d0 0x7fd3f011edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54734/0 (socket says 172.21.15.72:54734) 2023-10-03T10:14:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3effff700 1 -- 172.21.15.72:0/1901797945 learned_addr learned my addr 172.21.15.72:0/1901797945 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3f4ca9700 1 --2- 172.21.15.72:0/1901797945 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3f009d6f0 0x7fd3f011e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3f54aa700 1 --2- 172.21.15.72:0/1901797945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f0139170 0x7fd3f011f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3effff700 1 -- 172.21.15.72:0/1901797945 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3f009d6f0 msgr2=0x7fd3f011e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3effff700 1 --2- 172.21.15.72:0/1901797945 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3f009d6f0 0x7fd3f011e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3effff700 1 -- 172.21.15.72:0/1901797945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f0139170 msgr2=0x7fd3f011f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3effff700 1 --2- 172.21.15.72:0/1901797945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f0139170 0x7fd3f011f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3effff700 1 -- 172.21.15.72:0/1901797945 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e8009a70 con 0x7fd3f009e1d0 2023-10-03T10:14:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3f54aa700 1 --2- 172.21.15.72:0/1901797945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f0139170 0x7fd3f011f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3effff700 1 --2- 172.21.15.72:0/1901797945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3f009e1d0 0x7fd3f011edc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009870 tx=0x7fd3dc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3ed7fa700 1 -- 172.21.15.72:0/1901797945 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc004380 con 0x7fd3f009e1d0 2023-10-03T10:14:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3ed7fa700 1 -- 172.21.15.72:0/1901797945 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc01f070 con 0x7fd3f009e1d0 2023-10-03T10:14:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3ed7fa700 1 -- 172.21.15.72:0/1901797945 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0036a0 con 0x7fd3f009e1d0 2023-10-03T10:14:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3f6f0d700 1 -- 172.21.15.72:0/1901797945 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3dc009550 con 0x7fd3f009e1d0 2023-10-03T10:14:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.176+0000 7fd3f6f0d700 1 -- 172.21.15.72:0/1901797945 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f0120c50 con 0x7fd3f009e1d0 2023-10-03T10:14:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.177+0000 7fd3f6f0d700 1 -- 172.21.15.72:0/1901797945 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f0121ce0 con 0x7fd3f009e1d0 2023-10-03T10:14:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.177+0000 7fd3ed7fa700 1 -- 172.21.15.72:0/1901797945 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3dc021030 con 0x7fd3f009e1d0 2023-10-03T10:14:18.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.178+0000 7fd3ed7fa700 1 -- 172.21.15.72:0/1901797945 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd3dc040930 con 0x7fd3f009e1d0 2023-10-03T10:14:18.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.186+0000 7fd3ed7fa700 1 -- 172.21.15.72:0/1901797945 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3dc0199a0 con 0x7fd3f009e1d0 2023-10-03T10:14:18.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.262+0000 7f36e7781700 1 -- 172.21.15.72:0/907040219 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f36c0005590 con 0x7f36e0131b40 2023-10-03T10:14:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.262+0000 7f36d5ffb700 1 -- 172.21.15.72:0/907040219 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f36d8007370 con 0x7f36e0131b40 2023-10-03T10:14:18.263 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:18.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.264+0000 7f36e7781700 1 -- 172.21.15.72:0/907040219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36e0131b40 msgr2=0x7f36e01c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.264+0000 7f36e7781700 1 --2- 172.21.15.72:0/907040219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36e0131b40 0x7f36e01c8e40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f36d800b970 tx=0x7f36d800bc80 comp rx=0 tx=0).stop 2023-10-03T10:14:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.264+0000 7f36e7781700 1 -- 172.21.15.72:0/907040219 shutdown_connections 2023-10-03T10:14:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.264+0000 7f36e7781700 1 --2- 172.21.15.72:0/907040219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e006a770 0x7f36e01c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.264+0000 7f36e7781700 1 --2- 172.21.15.72:0/907040219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36e0131b40 0x7f36e01c8e40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.264+0000 7f36e7781700 1 --2- 172.21.15.72:0/907040219 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36e006b080 0x7f36e01c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.264+0000 7f36e7781700 1 -- 172.21.15.72:0/907040219 >> 172.21.15.72:0/907040219 conn(0x7f36e0066f50 msgr2=0x7f36e0070110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.265+0000 7f36e7781700 1 -- 172.21.15.72:0/907040219 shutdown_connections 2023-10-03T10:14:18.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.265+0000 7f36e7781700 1 -- 172.21.15.72:0/907040219 wait complete. 2023-10-03T10:14:18.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:18.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.343+0000 7f6887836700 1 -- 172.21.15.72:0/1804348411 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f688006b250 con 0x7f688009e930 2023-10-03T10:14:18.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.344+0000 7f6875ffb700 1 -- 172.21.15.72:0/1804348411 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f687c044060 con 0x7f688009e930 2023-10-03T10:14:18.344 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:18.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.346+0000 7f6887836700 1 -- 172.21.15.72:0/1804348411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f688009e930 msgr2=0x7f6880121970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.346+0000 7f6887836700 1 --2- 172.21.15.72:0/1804348411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f688009e930 0x7f6880121970 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f687c00c4e0 tx=0x7f687c00c7f0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.346+0000 7f6887836700 1 -- 172.21.15.72:0/1804348411 shutdown_connections 2023-10-03T10:14:18.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.346+0000 7f6887836700 1 --2- 172.21.15.72:0/1804348411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6880136fe0 0x7f68801223f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.346+0000 7f6887836700 1 --2- 172.21.15.72:0/1804348411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f688009e930 0x7f6880121970 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.346+0000 7f6887836700 1 --2- 172.21.15.72:0/1804348411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f688009f410 0x7f6880121eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.346+0000 7f6887836700 1 -- 172.21.15.72:0/1804348411 >> 172.21.15.72:0/1804348411 conn(0x7f68800a4210 msgr2=0x7f68800a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.346+0000 7f6887836700 1 -- 172.21.15.72:0/1804348411 shutdown_connections 2023-10-03T10:14:18.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.346+0000 7f6887836700 1 -- 172.21.15.72:0/1804348411 wait complete. 2023-10-03T10:14:18.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.379+0000 7fd3f6f0d700 1 -- 172.21.15.72:0/1901797945 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd3f0074ea0 con 0x7fd3f009e1d0 2023-10-03T10:14:18.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.379+0000 7fd3ed7fa700 1 -- 172.21.15.72:0/1901797945 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd3dc015030 con 0x7fd3f009e1d0 2023-10-03T10:14:18.380 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:18.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.381+0000 7fd3f6f0d700 1 -- 172.21.15.72:0/1901797945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3f009e1d0 msgr2=0x7fd3f011edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.381+0000 7fd3f6f0d700 1 --2- 172.21.15.72:0/1901797945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3f009e1d0 0x7fd3f011edc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009870 tx=0x7fd3dc004750 comp rx=0 tx=0).stop 2023-10-03T10:14:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.381+0000 7fd3f6f0d700 1 -- 172.21.15.72:0/1901797945 shutdown_connections 2023-10-03T10:14:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.381+0000 7fd3f6f0d700 1 --2- 172.21.15.72:0/1901797945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3f0139170 0x7fd3f011f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.381+0000 7fd3f6f0d700 1 --2- 172.21.15.72:0/1901797945 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3f009d6f0 0x7fd3f011e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.381+0000 7fd3f6f0d700 1 --2- 172.21.15.72:0/1901797945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3f009e1d0 0x7fd3f011edc0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.381+0000 7fd3f6f0d700 1 -- 172.21.15.72:0/1901797945 >> 172.21.15.72:0/1901797945 conn(0x7fd3f0066f50 msgr2=0x7fd3f009b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.381+0000 7fd3f6f0d700 1 -- 172.21.15.72:0/1901797945 shutdown_connections 2023-10-03T10:14:18.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:18.381+0000 7fd3f6f0d700 1 -- 172.21.15.72:0/1901797945 wait complete. 2023-10-03T10:14:18.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:19.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:19.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbfdd8b700 1 Processor -- start 2023-10-03T10:14:19.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbfdd8b700 1 -- start start 2023-10-03T10:14:19.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbfdd8b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf809e1d0 0x7fcbf8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbfdd8b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbf8139170 0x7fcbf813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbfdd8b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf809b120 con 0x7fcbf809d6f0 2023-10-03T10:14:19.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbfdd8b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf806b460 con 0x7fcbf809e1d0 2023-10-03T10:14:19.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbfdd8b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf809a7e0 con 0x7fcbf8139170 2023-10-03T10:14:19.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbf6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf809e1d0 0x7fcbf8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbf77fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcbf809d6f0 0x7fcbf809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39100/0 (socket says 172.21.15.72:39100) 2023-10-03T10:14:19.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbf77fe700 1 -- 172.21.15.72:0/2385969688 learned_addr learned my addr 172.21.15.72:0/2385969688 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:19.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbf7fff700 1 --2- 172.21.15.72:0/2385969688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbf8139170 0x7fcbf813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbf7fff700 1 -- 172.21.15.72:0/2385969688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf809e1d0 msgr2=0x7fcbf8138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:19.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbf67fc700 1 -- 172.21.15.72:0/2385969688 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931751678 0 0) 0x7fcbf809b120 con 0x7fcbf809d6f0 2023-10-03T10:14:19.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbf7fff700 1 --2- 172.21.15.72:0/2385969688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf809e1d0 0x7fcbf8138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbf7fff700 1 -- 172.21.15.72:0/2385969688 >> v1:172.21.15.72:6789/0 conn(0x7fcbf809d6f0 legacy=0x7fcbf809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbf7fff700 1 -- 172.21.15.72:0/2385969688 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf809a500 con 0x7fcbf8139170 2023-10-03T10:14:19.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.197+0000 7fcbf6ffd700 1 --2- 172.21.15.72:0/2385969688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf809e1d0 0x7fcbf8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:19.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.198+0000 7fcbf7fff700 1 --2- 172.21.15.72:0/2385969688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbf8139170 0x7fcbf813b550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009df0 tx=0x7fcbf000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e515572423c594a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.198+0000 7fcbf67fc700 1 -- 172.21.15.72:0/2385969688 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf000e070 con 0x7fcbf8139170 2023-10-03T10:14:19.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.198+0000 7fcbf67fc700 1 -- 172.21.15.72:0/2385969688 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf000bae0 con 0x7fcbf8139170 2023-10-03T10:14:19.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.198+0000 7fcbf67fc700 1 -- 172.21.15.72:0/2385969688 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf000be90 con 0x7fcbf8139170 2023-10-03T10:14:19.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.198+0000 7fcbfdd8b700 1 -- 172.21.15.72:0/2385969688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbf8139170 msgr2=0x7fcbf813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.198+0000 7fcbfdd8b700 1 --2- 172.21.15.72:0/2385969688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbf8139170 0x7fcbf813b550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009df0 tx=0x7fcbf000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:19.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.198+0000 7fcbfdd8b700 1 -- 172.21.15.72:0/2385969688 shutdown_connections 2023-10-03T10:14:19.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.198+0000 7fcbfdd8b700 1 --2- 172.21.15.72:0/2385969688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbf8139170 0x7fcbf813b550 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.198+0000 7fcbfdd8b700 1 --2- 172.21.15.72:0/2385969688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf809e1d0 0x7fcbf8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.198+0000 7fcbfdd8b700 1 -- 172.21.15.72:0/2385969688 >> 172.21.15.72:0/2385969688 conn(0x7fcbf8066f50 msgr2=0x7fcbf809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.198+0000 7fcbfdd8b700 1 -- 172.21.15.72:0/2385969688 shutdown_connections 2023-10-03T10:14:19.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.198+0000 7fcbfdd8b700 1 -- 172.21.15.72:0/2385969688 wait complete. 2023-10-03T10:14:19.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.199+0000 7fcbfdd8b700 1 Processor -- start 2023-10-03T10:14:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.199+0000 7fcbfdd8b700 1 -- start start 2023-10-03T10:14:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbfdd8b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbf809d6f0 0x7fcbf81215e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbfdd8b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf809e1d0 0x7fcbf8121b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbfdd8b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbf8139170 0x7fcbf8122060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbfdd8b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf80a3b40 con 0x7fcbf8139170 2023-10-03T10:14:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbfdd8b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf8124e90 con 0x7fcbf809e1d0 2023-10-03T10:14:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbfdd8b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf8125100 con 0x7fcbf809d6f0 2023-10-03T10:14:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbf77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbf809d6f0 0x7fcbf81215e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbf77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbf809d6f0 0x7fcbf81215e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45766/0 (socket says 172.21.15.72:45766) 2023-10-03T10:14:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbf7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbf8139170 0x7fcbf8122060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbf77fe700 1 -- 172.21.15.72:0/725016808 learned_addr learned my addr 172.21.15.72:0/725016808 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbf6ffd700 1 --2- 172.21.15.72:0/725016808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf809e1d0 0x7fcbf8121b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbf77fe700 1 -- 172.21.15.72:0/725016808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf809e1d0 msgr2=0x7fcbf8121b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbf77fe700 1 --2- 172.21.15.72:0/725016808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf809e1d0 0x7fcbf8121b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbf77fe700 1 -- 172.21.15.72:0/725016808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbf8139170 msgr2=0x7fcbf8122060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbf77fe700 1 --2- 172.21.15.72:0/725016808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbf8139170 0x7fcbf8122060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbf77fe700 1 -- 172.21.15.72:0/725016808 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec0094a0 con 0x7fcbf809d6f0 2023-10-03T10:14:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbf7fff700 1 --2- 172.21.15.72:0/725016808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbf8139170 0x7fcbf8122060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.200+0000 7fcbf77fe700 1 --2- 172.21.15.72:0/725016808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbf809d6f0 0x7fcbf81215e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800c520 tx=0x7fcbe800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.201+0000 7fcbdffff700 1 -- 172.21.15.72:0/725016808 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8004c80 con 0x7fcbf809d6f0 2023-10-03T10:14:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.201+0000 7fcbdffff700 1 -- 172.21.15.72:0/725016808 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8004e00 con 0x7fcbf809d6f0 2023-10-03T10:14:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.201+0000 7fcbfdd8b700 1 -- 172.21.15.72:0/725016808 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf0009a70 con 0x7fcbf809d6f0 2023-10-03T10:14:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.201+0000 7fcbdffff700 1 -- 172.21.15.72:0/725016808 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8007310 con 0x7fcbf809d6f0 2023-10-03T10:14:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.201+0000 7fcbfdd8b700 1 -- 172.21.15.72:0/725016808 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf809c710 con 0x7fcbf809d6f0 2023-10-03T10:14:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.201+0000 7fcbdffff700 1 -- 172.21.15.72:0/725016808 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcbe8007470 con 0x7fcbf809d6f0 2023-10-03T10:14:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.201+0000 7fcbdffff700 1 -- 172.21.15.72:0/725016808 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcbe803f290 con 0x7fcbf809d6f0 2023-10-03T10:14:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.202+0000 7fcbfdd8b700 1 -- 172.21.15.72:0/725016808 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf8123250 con 0x7fcbf809d6f0 2023-10-03T10:14:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.206+0000 7fcbdffff700 1 -- 172.21.15.72:0/725016808 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcbe80123b0 con 0x7fcbf809d6f0 2023-10-03T10:14:19.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:19.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:19.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:19.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.402+0000 7fcbfdd8b700 1 -- 172.21.15.72:0/725016808 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcbf8124bb0 con 0x7fcbf809d6f0 2023-10-03T10:14:19.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.403+0000 7fcbdffff700 1 -- 172.21.15.72:0/725016808 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcbe8011360 con 0x7fcbf809d6f0 2023-10-03T10:14:19.403 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.404+0000 7f70a4788700 1 Processor -- start 2023-10-03T10:14:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.404+0000 7f70a4788700 1 -- start start 2023-10-03T10:14:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.405+0000 7fcbfdd8b700 1 -- 172.21.15.72:0/725016808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbf809d6f0 msgr2=0x7fcbf81215e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.405+0000 7fcbfdd8b700 1 --2- 172.21.15.72:0/725016808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbf809d6f0 0x7fcbf81215e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800c520 tx=0x7fcbe800c830 comp rx=0 tx=0).stop 2023-10-03T10:14:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.405+0000 7fcbfdd8b700 1 -- 172.21.15.72:0/725016808 shutdown_connections 2023-10-03T10:14:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.405+0000 7fcbfdd8b700 1 --2- 172.21.15.72:0/725016808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbf8139170 0x7fcbf8122060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.405+0000 7fcbfdd8b700 1 --2- 172.21.15.72:0/725016808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbf809d6f0 0x7fcbf81215e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.405+0000 7fcbfdd8b700 1 --2- 172.21.15.72:0/725016808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbf809e1d0 0x7fcbf8121b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.405+0000 7fcbfdd8b700 1 -- 172.21.15.72:0/725016808 >> 172.21.15.72:0/725016808 conn(0x7fcbf8066f50 msgr2=0x7fcbf8070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.405+0000 7fcbfdd8b700 1 -- 172.21.15.72:0/725016808 shutdown_connections 2023-10-03T10:14:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.405+0000 7f70a4788700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f709c06f5d0 0x7f709c12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.405+0000 7f70a4788700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f709c135c20 0x7f709c138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.405+0000 7f70a4788700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c06fa40 con 0x7f709c12cf60 2023-10-03T10:14:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.405+0000 7f70a4788700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c12cd90 con 0x7f709c135c20 2023-10-03T10:14:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.405+0000 7f70a4788700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c071780 con 0x7f709c06f5d0 2023-10-03T10:14:19.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.405+0000 7fcbfdd8b700 1 -- 172.21.15.72:0/725016808 wait complete. 2023-10-03T10:14:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.406+0000 7f70a1d23700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f709c06f5d0 0x7f709c12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.406+0000 7f70a2d25700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f709c135c20 0x7f709c138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.406+0000 7f70a1d23700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f709c06f5d0 0x7f709c12ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44676/0 (socket says 172.21.15.72:44676) 2023-10-03T10:14:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.406+0000 7f70a2d25700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f709c135c20 0x7f709c138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42600/0 (socket says 172.21.15.72:42600) 2023-10-03T10:14:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.406+0000 7f70a1d23700 1 -- 172.21.15.72:0/2272925340 learned_addr learned my addr 172.21.15.72:0/2272925340 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.406+0000 7f70a1d23700 1 -- 172.21.15.72:0/2272925340 >> v2:172.21.15.72:3300/0 conn(0x7f709c135c20 msgr2=0x7f709c138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.406+0000 7f70a1d23700 1 --2- 172.21.15.72:0/2272925340 >> v2:172.21.15.72:3300/0 conn(0x7f709c135c20 0x7f709c138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.406+0000 7f70a1d23700 1 -- 172.21.15.72:0/2272925340 >> v1:172.21.15.72:6789/0 conn(0x7f709c12cf60 legacy=0x7f709c12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.406+0000 7f70a1d23700 1 -- 172.21.15.72:0/2272925340 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c071a40 con 0x7f709c06f5d0 2023-10-03T10:14:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.406+0000 7f70a1d23700 1 --2- 172.21.15.72:0/2272925340 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f709c06f5d0 0x7f709c12ffc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f708c0098f0 tx=0x7f708c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9342f87356814e7c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.406+0000 7f70a1522700 1 -- 172.21.15.72:0/2272925340 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c011830 con 0x7f709c06f5d0 2023-10-03T10:14:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.406+0000 7f70a1522700 1 -- 172.21.15.72:0/2272925340 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c011990 con 0x7f709c06f5d0 2023-10-03T10:14:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.406+0000 7f70a1522700 1 -- 172.21.15.72:0/2272925340 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c011d20 con 0x7f709c06f5d0 2023-10-03T10:14:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.407+0000 7f70a4788700 1 -- 172.21.15.72:0/2272925340 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f709c06f5d0 msgr2=0x7f709c12ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.407+0000 7f70a4788700 1 --2- 172.21.15.72:0/2272925340 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f709c06f5d0 0x7f709c12ffc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f708c0098f0 tx=0x7f708c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.407+0000 7f70a4788700 1 -- 172.21.15.72:0/2272925340 shutdown_connections 2023-10-03T10:14:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.407+0000 7f70a4788700 1 --2- 172.21.15.72:0/2272925340 >> v2:172.21.15.72:3300/0 conn(0x7f709c135c20 0x7f709c138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.407+0000 7f70a4788700 1 --2- 172.21.15.72:0/2272925340 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f709c06f5d0 0x7f709c12ffc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.407+0000 7f70a4788700 1 -- 172.21.15.72:0/2272925340 >> 172.21.15.72:0/2272925340 conn(0x7f709c0a2aa0 msgr2=0x7f709c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.407+0000 7f70a4788700 1 -- 172.21.15.72:0/2272925340 shutdown_connections 2023-10-03T10:14:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.407+0000 7f70a4788700 1 -- 172.21.15.72:0/2272925340 wait complete. 2023-10-03T10:14:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.408+0000 7f70a4788700 1 Processor -- start 2023-10-03T10:14:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.408+0000 7f70a4788700 1 -- start start 2023-10-03T10:14:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.409+0000 7f70a4788700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c06f5d0 0x7f709c1c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.409+0000 7f70a4788700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f709c12cf60 0x7f709c1c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.409+0000 7f70a4788700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f709c135c20 0x7f709c1c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.409+0000 7f70a4788700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c09d720 con 0x7f709c06f5d0 2023-10-03T10:14:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.409+0000 7f70a4788700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c09cfd0 con 0x7f709c12cf60 2023-10-03T10:14:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.409+0000 7f70a4788700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f709c0a2260 con 0x7f709c135c20 2023-10-03T10:14:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.409+0000 7f70a2d25700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f709c135c20 0x7f709c1c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.409+0000 7f70a2d25700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f709c135c20 0x7f709c1c6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45774/0 (socket says 172.21.15.72:45774) 2023-10-03T10:14:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.409+0000 7f70a2d25700 1 -- 172.21.15.72:0/644035123 learned_addr learned my addr 172.21.15.72:0/644035123 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.409+0000 7f70a1d23700 1 --2- 172.21.15.72:0/644035123 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f709c12cf60 0x7f709c1c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.409+0000 7f70a2d25700 1 -- 172.21.15.72:0/644035123 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f709c12cf60 msgr2=0x7f709c1c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.409+0000 7f70a2d25700 1 --2- 172.21.15.72:0/644035123 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f709c12cf60 0x7f709c1c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.409+0000 7f70a2d25700 1 -- 172.21.15.72:0/644035123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c06f5d0 msgr2=0x7f709c1c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.409+0000 7f70a2d25700 1 --2- 172.21.15.72:0/644035123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c06f5d0 0x7f709c1c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.409+0000 7f70a2d25700 1 -- 172.21.15.72:0/644035123 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c009550 con 0x7f709c135c20 2023-10-03T10:14:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.410+0000 7f70a2d25700 1 --2- 172.21.15.72:0/644035123 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f709c135c20 0x7f709c1c6bb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f709400ef90 tx=0x7f709400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.410+0000 7f7092ffd700 1 -- 172.21.15.72:0/644035123 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709400cd40 con 0x7f709c135c20 2023-10-03T10:14:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.410+0000 7f7092ffd700 1 -- 172.21.15.72:0/644035123 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709400f040 con 0x7f709c135c20 2023-10-03T10:14:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.410+0000 7f70a4788700 1 -- 172.21.15.72:0/644035123 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c129fa0 con 0x7f709c135c20 2023-10-03T10:14:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.410+0000 7f7092ffd700 1 -- 172.21.15.72:0/644035123 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709400cea0 con 0x7f709c135c20 2023-10-03T10:14:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.410+0000 7f70a4788700 1 -- 172.21.15.72:0/644035123 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c129b00 con 0x7f709c135c20 2023-10-03T10:14:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.411+0000 7f7092ffd700 1 -- 172.21.15.72:0/644035123 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70940146c0 con 0x7f709c135c20 2023-10-03T10:14:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.411+0000 7f70a4788700 1 -- 172.21.15.72:0/644035123 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c074ea0 con 0x7f709c135c20 2023-10-03T10:14:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.411+0000 7f7092ffd700 1 -- 172.21.15.72:0/644035123 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f70940403c0 con 0x7f709c135c20 2023-10-03T10:14:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.417+0000 7f7092ffd700 1 -- 172.21.15.72:0/644035123 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7094012930 con 0x7f709c135c20 2023-10-03T10:14:19.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:19.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.495+0000 7fd6525c0700 1 Processor -- start 2023-10-03T10:14:19.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.495+0000 7fd6525c0700 1 -- start start 2023-10-03T10:14:19.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.495+0000 7fd6525c0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd64c0a0a30 0x7fd64c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.495+0000 7fd6525c0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd64c0a1340 0x7fd64c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.495+0000 7fd6525c0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd64c133fa0 0x7fd64c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.495+0000 7fd6525c0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64c09edd0 con 0x7fd64c0a0a30 2023-10-03T10:14:19.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.495+0000 7fd6525c0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c09e1f0 con 0x7fd64c133fa0 2023-10-03T10:14:19.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.495+0000 7fd6525c0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c09dc50 con 0x7fd64c0a1340 2023-10-03T10:14:19.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.496+0000 7fd64b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd64c0a1340 0x7fd64c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.496+0000 7fd64b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd64c0a1340 0x7fd64c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45776/0 (socket says 172.21.15.72:45776) 2023-10-03T10:14:19.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.496+0000 7fd64b7fe700 1 -- 172.21.15.72:0/1121441752 learned_addr learned my addr 172.21.15.72:0/1121441752 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:19.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.496+0000 7fd650b5d700 1 --2- 172.21.15.72:0/1121441752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd64c133fa0 0x7fd64c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.496+0000 7fd64bfff700 1 --2- 172.21.15.72:0/1121441752 >> v2:172.21.15.72:3300/0 conn(0x7fd64c0a0a30 0x7fd64c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.496+0000 7fd64b7fe700 1 -- 172.21.15.72:0/1121441752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd64c133fa0 msgr2=0x7fd64c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:19.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.496+0000 7fd64b7fe700 1 --2- 172.21.15.72:0/1121441752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd64c133fa0 0x7fd64c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.496+0000 7fd64b7fe700 1 -- 172.21.15.72:0/1121441752 >> v2:172.21.15.72:3300/0 conn(0x7fd64c0a0a30 msgr2=0x7fd64c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:19.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.496+0000 7fd64b7fe700 1 --2- 172.21.15.72:0/1121441752 >> v2:172.21.15.72:3300/0 conn(0x7fd64c0a0a30 0x7fd64c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.496+0000 7fd64b7fe700 1 -- 172.21.15.72:0/1121441752 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c0a1fe0 con 0x7fd64c0a1340 2023-10-03T10:14:19.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.496+0000 7fd64bfff700 1 --2- 172.21.15.72:0/1121441752 >> v2:172.21.15.72:3300/0 conn(0x7fd64c0a0a30 0x7fd64c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:19.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.496+0000 7fd64b7fe700 1 --2- 172.21.15.72:0/1121441752 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd64c0a1340 0x7fd64c133a60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd640009920 tx=0x7fd640009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=761aef5c6c4747a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.496+0000 7fd64affd700 1 -- 172.21.15.72:0/1121441752 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640011830 con 0x7fd64c0a1340 2023-10-03T10:14:19.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.496+0000 7fd64affd700 1 -- 172.21.15.72:0/1121441752 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd640011990 con 0x7fd64c0a1340 2023-10-03T10:14:19.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.496+0000 7fd64affd700 1 -- 172.21.15.72:0/1121441752 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640011d20 con 0x7fd64c0a1340 2023-10-03T10:14:19.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.497+0000 7fd6525c0700 1 -- 172.21.15.72:0/1121441752 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd64c0a1340 msgr2=0x7fd64c133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.497+0000 7fd6525c0700 1 --2- 172.21.15.72:0/1121441752 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd64c0a1340 0x7fd64c133a60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd640009920 tx=0x7fd640009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:19.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.497+0000 7fd6525c0700 1 -- 172.21.15.72:0/1121441752 shutdown_connections 2023-10-03T10:14:19.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.497+0000 7fd6525c0700 1 --2- 172.21.15.72:0/1121441752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd64c133fa0 0x7fd64c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.497+0000 7fd6525c0700 1 --2- 172.21.15.72:0/1121441752 >> v2:172.21.15.72:3300/0 conn(0x7fd64c0a0a30 0x7fd64c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.497+0000 7fd6525c0700 1 --2- 172.21.15.72:0/1121441752 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd64c0a1340 0x7fd64c133a60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.497+0000 7fd6525c0700 1 -- 172.21.15.72:0/1121441752 >> 172.21.15.72:0/1121441752 conn(0x7fd64c0a6550 msgr2=0x7fd64c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.497+0000 7fd6525c0700 1 -- 172.21.15.72:0/1121441752 shutdown_connections 2023-10-03T10:14:19.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.497+0000 7fd6525c0700 1 -- 172.21.15.72:0/1121441752 wait complete. 2023-10-03T10:14:19.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.499+0000 7fd6525c0700 1 Processor -- start 2023-10-03T10:14:19.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.499+0000 7fd6525c0700 1 -- start start 2023-10-03T10:14:19.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.499+0000 7fd6525c0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd64c0a0a30 0x7fd64c1201b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd6525c0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd64c0a1340 0x7fd64c1206f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd6525c0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd64c133fa0 0x7fd64c120c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd6525c0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c123cd0 con 0x7fd64c133fa0 2023-10-03T10:14:19.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd6525c0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c0a3730 con 0x7fd64c0a0a30 2023-10-03T10:14:19.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd6525c0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c123460 con 0x7fd64c0a1340 2023-10-03T10:14:19.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd64b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd64c0a1340 0x7fd64c1206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd64b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd64c0a1340 0x7fd64c1206f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45786/0 (socket says 172.21.15.72:45786) 2023-10-03T10:14:19.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd64b7fe700 1 -- 172.21.15.72:0/2310921301 learned_addr learned my addr 172.21.15.72:0/2310921301 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:19.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd64bfff700 1 --2- 172.21.15.72:0/2310921301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd64c0a0a30 0x7fd64c1201b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd650b5d700 1 --2- 172.21.15.72:0/2310921301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd64c133fa0 0x7fd64c120c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd64b7fe700 1 -- 172.21.15.72:0/2310921301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd64c0a0a30 msgr2=0x7fd64c1201b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd64b7fe700 1 --2- 172.21.15.72:0/2310921301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd64c0a0a30 0x7fd64c1201b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd64b7fe700 1 -- 172.21.15.72:0/2310921301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd64c133fa0 msgr2=0x7fd64c120c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd64b7fe700 1 --2- 172.21.15.72:0/2310921301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd64c133fa0 0x7fd64c120c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd64b7fe700 1 -- 172.21.15.72:0/2310921301 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c0094a0 con 0x7fd64c0a1340 2023-10-03T10:14:19.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd650b5d700 1 --2- 172.21.15.72:0/2310921301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd64c133fa0 0x7fd64c120c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:19.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd64b7fe700 1 --2- 172.21.15.72:0/2310921301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd64c0a1340 0x7fd64c1206f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd640009130 tx=0x7fd640004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd648ff9700 1 -- 172.21.15.72:0/2310921301 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640004450 con 0x7fd64c0a1340 2023-10-03T10:14:19.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd648ff9700 1 -- 172.21.15.72:0/2310921301 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64001e070 con 0x7fd64c0a1340 2023-10-03T10:14:19.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd6525c0700 1 -- 172.21.15.72:0/2310921301 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd640009550 con 0x7fd64c0a1340 2023-10-03T10:14:19.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd648ff9700 1 -- 172.21.15.72:0/2310921301 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6400038e0 con 0x7fd64c0a1340 2023-10-03T10:14:19.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.500+0000 7fd6525c0700 1 -- 172.21.15.72:0/2310921301 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64c0a0270 con 0x7fd64c0a1340 2023-10-03T10:14:19.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.501+0000 7fd648ff9700 1 -- 172.21.15.72:0/2310921301 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd640003a40 con 0x7fd64c0a1340 2023-10-03T10:14:19.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.501+0000 7fd648ff9700 1 -- 172.21.15.72:0/2310921301 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd640020070 con 0x7fd64c0a1340 2023-10-03T10:14:19.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.502+0000 7fd6525c0700 1 -- 172.21.15.72:0/2310921301 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64c123690 con 0x7fd64c0a1340 2023-10-03T10:14:19.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.506+0000 7fd648ff9700 1 -- 172.21.15.72:0/2310921301 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd64c123690 con 0x7fd64c0a1340 2023-10-03T10:14:19.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.540+0000 7f4457442700 1 Processor -- start 2023-10-03T10:14:19.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.540+0000 7f4457442700 1 -- start start 2023-10-03T10:14:19.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.541+0000 7f4457442700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f44500a0a30 0x7f44500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.541+0000 7f4457442700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445009d630 0x7f44500a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.541+0000 7f4457442700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44500a2a70 con 0x7f4450133930 2023-10-03T10:14:19.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.541+0000 7f4457442700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44500a01d0 con 0x7f44500a0a30 2023-10-03T10:14:19.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.541+0000 7f4457442700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f445009e2b0 con 0x7f445009d630 2023-10-03T10:14:19.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.541+0000 7f44549dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445009d630 0x7f44500a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.541+0000 7f44549dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445009d630 0x7f44500a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45798/0 (socket says 172.21.15.72:45798) 2023-10-03T10:14:19.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.541+0000 7f44549dd700 1 -- 172.21.15.72:0/919162245 learned_addr learned my addr 172.21.15.72:0/919162245 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:19.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.541+0000 7f44551de700 1 --2- 172.21.15.72:0/919162245 >> v2:172.21.15.72:3300/0 conn(0x7f44500a0a30 0x7f44500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.541+0000 7f44549dd700 1 -- 172.21.15.72:0/919162245 >> v2:172.21.15.72:3300/0 conn(0x7f44500a0a30 msgr2=0x7f44500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:19.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.541+0000 7f44549dd700 1 --2- 172.21.15.72:0/919162245 >> v2:172.21.15.72:3300/0 conn(0x7f44500a0a30 0x7f44500a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.541+0000 7f44549dd700 1 -- 172.21.15.72:0/919162245 >> v1:172.21.15.72:6789/0 conn(0x7f4450133930 legacy=0x7f4450133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.541+0000 7f44549dd700 1 -- 172.21.15.72:0/919162245 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445009dc50 con 0x7f445009d630 2023-10-03T10:14:19.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.542+0000 7f44549dd700 1 --2- 172.21.15.72:0/919162245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445009d630 0x7f44500a1340 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f44400098f0 tx=0x7f4440009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a85a4843dd1627e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.542+0000 7f4447fff700 1 -- 172.21.15.72:0/919162245 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440011830 con 0x7f445009d630 2023-10-03T10:14:19.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.542+0000 7f4447fff700 1 -- 172.21.15.72:0/919162245 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4440011990 con 0x7f445009d630 2023-10-03T10:14:19.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.542+0000 7f4447fff700 1 -- 172.21.15.72:0/919162245 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440011d20 con 0x7f445009d630 2023-10-03T10:14:19.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.542+0000 7f4457442700 1 -- 172.21.15.72:0/919162245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445009d630 msgr2=0x7f44500a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.542+0000 7f4457442700 1 --2- 172.21.15.72:0/919162245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445009d630 0x7f44500a1340 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f44400098f0 tx=0x7f4440009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:19.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.542+0000 7f4457442700 1 -- 172.21.15.72:0/919162245 shutdown_connections 2023-10-03T10:14:19.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.542+0000 7f4457442700 1 --2- 172.21.15.72:0/919162245 >> v2:172.21.15.72:3300/0 conn(0x7f44500a0a30 0x7f44500a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.542+0000 7f4457442700 1 --2- 172.21.15.72:0/919162245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445009d630 0x7f44500a1340 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.542+0000 7f4457442700 1 -- 172.21.15.72:0/919162245 >> 172.21.15.72:0/919162245 conn(0x7f44500a3050 msgr2=0x7f44500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.543+0000 7f4457442700 1 -- 172.21.15.72:0/919162245 shutdown_connections 2023-10-03T10:14:19.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.543+0000 7f4457442700 1 -- 172.21.15.72:0/919162245 wait complete. 2023-10-03T10:14:19.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.543+0000 7f4457442700 1 Processor -- start 2023-10-03T10:14:19.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f4457442700 1 -- start start 2023-10-03T10:14:19.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f4457442700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445009d630 0x7f4450121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f4457442700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44500a0a30 0x7f4450121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f4457442700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4450133930 0x7f4450121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f4457442700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44501225b0 con 0x7f44500a0a30 2023-10-03T10:14:19.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f4457442700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4450124bd0 con 0x7f4450133930 2023-10-03T10:14:19.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f4457442700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4450124630 con 0x7f445009d630 2023-10-03T10:14:19.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f44551de700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445009d630 0x7f4450121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f44549dd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44500a0a30 0x7f4450121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f44551de700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445009d630 0x7f4450121100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45810/0 (socket says 172.21.15.72:45810) 2023-10-03T10:14:19.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f44551de700 1 -- 172.21.15.72:0/987554469 learned_addr learned my addr 172.21.15.72:0/987554469 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:19.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f44559df700 1 --2- 172.21.15.72:0/987554469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4450133930 0x7f4450121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f44549dd700 1 -- 172.21.15.72:0/987554469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445009d630 msgr2=0x7f4450121100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f44549dd700 1 --2- 172.21.15.72:0/987554469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445009d630 0x7f4450121100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f44549dd700 1 -- 172.21.15.72:0/987554469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4450133930 msgr2=0x7f4450121b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f44549dd700 1 --2- 172.21.15.72:0/987554469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4450133930 0x7f4450121b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.544+0000 7f44549dd700 1 -- 172.21.15.72:0/987554469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4440009550 con 0x7f44500a0a30 2023-10-03T10:14:19.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.545+0000 7f44549dd700 1 --2- 172.21.15.72:0/987554469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44500a0a30 0x7f4450121640 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4440016000 tx=0x7f4440004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.545+0000 7f4445ffb700 1 -- 172.21.15.72:0/987554469 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44400036a0 con 0x7f44500a0a30 2023-10-03T10:14:19.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.545+0000 7f4445ffb700 1 -- 172.21.15.72:0/987554469 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4440003800 con 0x7f44500a0a30 2023-10-03T10:14:19.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.545+0000 7f4457442700 1 -- 172.21.15.72:0/987554469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4450122dc0 con 0x7f44500a0a30 2023-10-03T10:14:19.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.545+0000 7f4445ffb700 1 -- 172.21.15.72:0/987554469 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440003b90 con 0x7f44500a0a30 2023-10-03T10:14:19.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.545+0000 7f4457442700 1 -- 172.21.15.72:0/987554469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4450123ac0 con 0x7f44500a0a30 2023-10-03T10:14:19.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.546+0000 7f4445ffb700 1 -- 172.21.15.72:0/987554469 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4440021070 con 0x7f44500a0a30 2023-10-03T10:14:19.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.546+0000 7f4445ffb700 1 -- 172.21.15.72:0/987554469 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4440040850 con 0x7f44500a0a30 2023-10-03T10:14:19.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.546+0000 7f4457442700 1 -- 172.21.15.72:0/987554469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4450124850 con 0x7f44500a0a30 2023-10-03T10:14:19.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.551+0000 7f4445ffb700 1 -- 172.21.15.72:0/987554469 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4450124850 con 0x7f44500a0a30 2023-10-03T10:14:19.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.618+0000 7f70a4788700 1 -- 172.21.15.72:0/644035123 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f709c0713a0 con 0x7f709c135c20 2023-10-03T10:14:19.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.619+0000 7f7092ffd700 1 -- 172.21.15.72:0/644035123 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7094012340 con 0x7f709c135c20 2023-10-03T10:14:19.619 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.621+0000 7f70a4788700 1 -- 172.21.15.72:0/644035123 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f709c135c20 msgr2=0x7f709c1c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.621+0000 7f70a4788700 1 --2- 172.21.15.72:0/644035123 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f709c135c20 0x7f709c1c6bb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f709400ef90 tx=0x7f709400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.621+0000 7f70a4788700 1 -- 172.21.15.72:0/644035123 shutdown_connections 2023-10-03T10:14:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.621+0000 7f70a4788700 1 --2- 172.21.15.72:0/644035123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f709c06f5d0 0x7f709c1c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.621+0000 7f70a4788700 1 --2- 172.21.15.72:0/644035123 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f709c135c20 0x7f709c1c6bb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.621+0000 7f70a4788700 1 --2- 172.21.15.72:0/644035123 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f709c12cf60 0x7f709c1c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.621+0000 7f70a4788700 1 -- 172.21.15.72:0/644035123 >> 172.21.15.72:0/644035123 conn(0x7f709c0a2aa0 msgr2=0x7f709c12fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.621+0000 7f70a4788700 1 -- 172.21.15.72:0/644035123 shutdown_connections 2023-10-03T10:14:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.621+0000 7f70a4788700 1 -- 172.21.15.72:0/644035123 wait complete. 2023-10-03T10:14:19.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:19.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.732+0000 7fd6525c0700 1 -- 172.21.15.72:0/2310921301 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd64c123690 con 0x7fd64c0a1340 2023-10-03T10:14:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.735+0000 7fd648ff9700 1 -- 172.21.15.72:0/2310921301 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd64c123690 con 0x7fd64c0a1340 2023-10-03T10:14:19.736 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:19.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.737+0000 7fd6525c0700 1 -- 172.21.15.72:0/2310921301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd64c0a1340 msgr2=0x7fd64c1206f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.737+0000 7fd6525c0700 1 --2- 172.21.15.72:0/2310921301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd64c0a1340 0x7fd64c1206f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd640009130 tx=0x7fd640004750 comp rx=0 tx=0).stop 2023-10-03T10:14:19.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.737+0000 7fd6525c0700 1 -- 172.21.15.72:0/2310921301 shutdown_connections 2023-10-03T10:14:19.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.737+0000 7fd6525c0700 1 --2- 172.21.15.72:0/2310921301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd64c133fa0 0x7fd64c120c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.737+0000 7fd6525c0700 1 --2- 172.21.15.72:0/2310921301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd64c0a0a30 0x7fd64c1201b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.737+0000 7fd6525c0700 1 --2- 172.21.15.72:0/2310921301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd64c0a1340 0x7fd64c1206f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.737+0000 7fd6525c0700 1 -- 172.21.15.72:0/2310921301 >> 172.21.15.72:0/2310921301 conn(0x7fd64c0a6550 msgr2=0x7fd64c1bb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.738+0000 7fd6525c0700 1 -- 172.21.15.72:0/2310921301 shutdown_connections 2023-10-03T10:14:19.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.738+0000 7fd6525c0700 1 -- 172.21.15.72:0/2310921301 wait complete. 2023-10-03T10:14:19.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:19.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.762+0000 7f4457442700 1 -- 172.21.15.72:0/987554469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4450124850 con 0x7f44500a0a30 2023-10-03T10:14:19.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.762+0000 7f4445ffb700 1 -- 172.21.15.72:0/987554469 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4450124850 con 0x7f44500a0a30 2023-10-03T10:14:19.763 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:19.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.764+0000 7f4457442700 1 -- 172.21.15.72:0/987554469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44500a0a30 msgr2=0x7f4450121640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.764+0000 7f4457442700 1 --2- 172.21.15.72:0/987554469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44500a0a30 0x7f4450121640 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4440016000 tx=0x7f4440004750 comp rx=0 tx=0).stop 2023-10-03T10:14:19.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.764+0000 7f4457442700 1 -- 172.21.15.72:0/987554469 shutdown_connections 2023-10-03T10:14:19.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.764+0000 7f4457442700 1 --2- 172.21.15.72:0/987554469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4450133930 0x7f4450121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.764+0000 7f4457442700 1 --2- 172.21.15.72:0/987554469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f445009d630 0x7f4450121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.764+0000 7f4457442700 1 --2- 172.21.15.72:0/987554469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44500a0a30 0x7f4450121640 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.764+0000 7f4457442700 1 -- 172.21.15.72:0/987554469 >> 172.21.15.72:0/987554469 conn(0x7f44500a3050 msgr2=0x7f4450133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.764+0000 7f4457442700 1 -- 172.21.15.72:0/987554469 shutdown_connections 2023-10-03T10:14:19.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:19.764+0000 7f4457442700 1 -- 172.21.15.72:0/987554469 wait complete. 2023-10-03T10:14:19.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:20.427 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:20.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.558+0000 7f09396c1700 1 Processor -- start 2023-10-03T10:14:20.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.558+0000 7f09396c1700 1 -- start start 2023-10-03T10:14:20.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f09396c1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093409d6f0 0x7f093409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f09396c1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093409e000 0x7f0934130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f09396c1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f093409e410 0x7f0934130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f09396c1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093409f520 con 0x7f093409e410 2023-10-03T10:14:20.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f09396c1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093409f130 con 0x7f093409e000 2023-10-03T10:14:20.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f09396c1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f093409e930 con 0x7f093409d6f0 2023-10-03T10:14:20.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f0932ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093409d6f0 0x7f093409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f09327fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093409e000 0x7f0934130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f0932ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093409d6f0 0x7f093409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45818/0 (socket says 172.21.15.72:45818) 2023-10-03T10:14:20.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f09337fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f093409e410 0x7f0934130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f0932ffd700 1 -- 172.21.15.72:0/3787557034 learned_addr learned my addr 172.21.15.72:0/3787557034 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:20.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f0932ffd700 1 -- 172.21.15.72:0/3787557034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093409e000 msgr2=0x7f0934130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f0932ffd700 1 --2- 172.21.15.72:0/3787557034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093409e000 0x7f0934130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f0932ffd700 1 -- 172.21.15.72:0/3787557034 >> v2:172.21.15.72:3300/0 conn(0x7f093409e410 msgr2=0x7f0934130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f0932ffd700 1 --2- 172.21.15.72:0/3787557034 >> v2:172.21.15.72:3300/0 conn(0x7f093409e410 0x7f0934130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f0932ffd700 1 -- 172.21.15.72:0/3787557034 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093409b2d0 con 0x7f093409d6f0 2023-10-03T10:14:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f09337fe700 1 --2- 172.21.15.72:0/3787557034 >> v2:172.21.15.72:3300/0 conn(0x7f093409e410 0x7f0934130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.559+0000 7f0932ffd700 1 --2- 172.21.15.72:0/3787557034 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093409d6f0 0x7f093409dac0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0928009920 tx=0x7f0928009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb7ecb3314a5eb7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.560+0000 7f0931ffb700 1 -- 172.21.15.72:0/3787557034 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928011830 con 0x7f093409d6f0 2023-10-03T10:14:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.560+0000 7f0931ffb700 1 -- 172.21.15.72:0/3787557034 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0928011990 con 0x7f093409d6f0 2023-10-03T10:14:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.560+0000 7f0931ffb700 1 -- 172.21.15.72:0/3787557034 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928011d20 con 0x7f093409d6f0 2023-10-03T10:14:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.560+0000 7f09396c1700 1 -- 172.21.15.72:0/3787557034 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093409d6f0 msgr2=0x7f093409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.560+0000 7f09396c1700 1 --2- 172.21.15.72:0/3787557034 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093409d6f0 0x7f093409dac0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0928009920 tx=0x7f0928009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.560+0000 7f09396c1700 1 -- 172.21.15.72:0/3787557034 shutdown_connections 2023-10-03T10:14:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.560+0000 7f09396c1700 1 --2- 172.21.15.72:0/3787557034 >> v2:172.21.15.72:3300/0 conn(0x7f093409e410 0x7f0934130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.560+0000 7f09396c1700 1 --2- 172.21.15.72:0/3787557034 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093409d6f0 0x7f093409dac0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.560+0000 7f09396c1700 1 --2- 172.21.15.72:0/3787557034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093409e000 0x7f0934130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.560+0000 7f09396c1700 1 -- 172.21.15.72:0/3787557034 >> 172.21.15.72:0/3787557034 conn(0x7f0934066f50 msgr2=0x7f093409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.560+0000 7f09396c1700 1 -- 172.21.15.72:0/3787557034 shutdown_connections 2023-10-03T10:14:20.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.560+0000 7f09396c1700 1 -- 172.21.15.72:0/3787557034 wait complete. 2023-10-03T10:14:20.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.561+0000 7f09396c1700 1 Processor -- start 2023-10-03T10:14:20.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.561+0000 7f09396c1700 1 -- start start 2023-10-03T10:14:20.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f09396c1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093409d6f0 0x7f0934132f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f09396c1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f093409e000 0x7f09341334d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f09396c1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093409e410 0x7f0934133a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f09396c1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09340725f0 con 0x7f093409e000 2023-10-03T10:14:20.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f09396c1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093409c700 con 0x7f093409d6f0 2023-10-03T10:14:20.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f09396c1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0934136470 con 0x7f093409e410 2023-10-03T10:14:20.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f0932ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093409d6f0 0x7f0934132f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f0932ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093409d6f0 0x7f0934132f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44712/0 (socket says 172.21.15.72:44712) 2023-10-03T10:14:20.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f09337fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093409e410 0x7f0934133a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f0932ffd700 1 -- 172.21.15.72:0/1494596826 learned_addr learned my addr 172.21.15.72:0/1494596826 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:20.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f09327fc700 1 --2- 172.21.15.72:0/1494596826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f093409e000 0x7f09341334d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f0932ffd700 1 -- 172.21.15.72:0/1494596826 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093409e410 msgr2=0x7f0934133a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f0932ffd700 1 --2- 172.21.15.72:0/1494596826 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093409e410 0x7f0934133a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f0932ffd700 1 -- 172.21.15.72:0/1494596826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f093409e000 msgr2=0x7f09341334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f0932ffd700 1 --2- 172.21.15.72:0/1494596826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f093409e000 0x7f09341334d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f0932ffd700 1 -- 172.21.15.72:0/1494596826 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c009a70 con 0x7f093409d6f0 2023-10-03T10:14:20.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f09327fc700 1 --2- 172.21.15.72:0/1494596826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f093409e000 0x7f09341334d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f09337fe700 1 --2- 172.21.15.72:0/1494596826 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093409e410 0x7f0934133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f0932ffd700 1 --2- 172.21.15.72:0/1494596826 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093409d6f0 0x7f0934132f90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0928000c00 tx=0x7f0928004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f091b7fe700 1 -- 172.21.15.72:0/1494596826 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928004240 con 0x7f093409d6f0 2023-10-03T10:14:20.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f091b7fe700 1 -- 172.21.15.72:0/1494596826 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092801f070 con 0x7f093409d6f0 2023-10-03T10:14:20.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f09396c1700 1 -- 172.21.15.72:0/1494596826 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0928009550 con 0x7f093409d6f0 2023-10-03T10:14:20.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f091b7fe700 1 -- 172.21.15.72:0/1494596826 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09280045c0 con 0x7f093409d6f0 2023-10-03T10:14:20.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.562+0000 7f09396c1700 1 -- 172.21.15.72:0/1494596826 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09341352f0 con 0x7f093409d6f0 2023-10-03T10:14:20.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.563+0000 7f091b7fe700 1 -- 172.21.15.72:0/1494596826 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0928021030 con 0x7f093409d6f0 2023-10-03T10:14:20.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.563+0000 7f091b7fe700 1 -- 172.21.15.72:0/1494596826 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0928040730 con 0x7f093409d6f0 2023-10-03T10:14:20.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.563+0000 7f09396c1700 1 -- 172.21.15.72:0/1494596826 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0934074ea0 con 0x7f093409d6f0 2023-10-03T10:14:20.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.568+0000 7f091b7fe700 1 -- 172.21.15.72:0/1494596826 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0928015080 con 0x7f093409d6f0 2023-10-03T10:14:20.635 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:20.751 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:20.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.760+0000 7f8c2f85f700 1 Processor -- start 2023-10-03T10:14:20.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.760+0000 7f8c2f85f700 1 -- start start 2023-10-03T10:14:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c2f85f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c280a0a30 0x7f8c280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c2f85f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c28134170 0x7f8c2813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c2f85f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2809edd0 con 0x7f8c280a1340 2023-10-03T10:14:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c2f85f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2809e1f0 con 0x7f8c28134170 2023-10-03T10:14:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c2f85f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2809dc50 con 0x7f8c280a0a30 2023-10-03T10:14:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c2d5fb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c280a0a30 0x7f8c280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c2d5fb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c280a0a30 0x7f8c280a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45832/0 (socket says 172.21.15.72:45832) 2023-10-03T10:14:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c2d5fb700 1 -- 172.21.15.72:0/1832599112 learned_addr learned my addr 172.21.15.72:0/1832599112 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c2cdfa700 1 --1- 172.21.15.72:0/1832599112 >> v1:172.21.15.72:6789/0 conn(0x7f8c280a1340 0x7f8c28133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39114/0 (socket says 172.21.15.72:39114) 2023-10-03T10:14:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c2ddfc700 1 --2- 172.21.15.72:0/1832599112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c28134170 0x7f8c2813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c1ffff700 1 -- 172.21.15.72:0/1832599112 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197699839 0 0) 0x7f8c2809edd0 con 0x7f8c280a1340 2023-10-03T10:14:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c2ddfc700 1 -- 172.21.15.72:0/1832599112 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c280a0a30 msgr2=0x7f8c280a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c2ddfc700 1 --2- 172.21.15.72:0/1832599112 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c280a0a30 0x7f8c280a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c2ddfc700 1 -- 172.21.15.72:0/1832599112 >> v1:172.21.15.72:6789/0 conn(0x7f8c280a1340 legacy=0x7f8c28133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c2ddfc700 1 -- 172.21.15.72:0/1832599112 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c280a1fe0 con 0x7f8c28134170 2023-10-03T10:14:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.761+0000 7f8c2ddfc700 1 --2- 172.21.15.72:0/1832599112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c28134170 0x7f8c2813bd30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009dc0 tx=0x7f8c2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d1f78a8a5d8d262 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.762+0000 7f8c1ffff700 1 -- 172.21.15.72:0/1832599112 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2000e070 con 0x7f8c28134170 2023-10-03T10:14:20.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.762+0000 7f8c1ffff700 1 -- 172.21.15.72:0/1832599112 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2000bb20 con 0x7f8c28134170 2023-10-03T10:14:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.762+0000 7f8c1ffff700 1 -- 172.21.15.72:0/1832599112 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20012430 con 0x7f8c28134170 2023-10-03T10:14:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.762+0000 7f8c2f85f700 1 -- 172.21.15.72:0/1832599112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c28134170 msgr2=0x7f8c2813bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.762+0000 7f8c2f85f700 1 --2- 172.21.15.72:0/1832599112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c28134170 0x7f8c2813bd30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009dc0 tx=0x7f8c2000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.762+0000 7f8c2f85f700 1 -- 172.21.15.72:0/1832599112 shutdown_connections 2023-10-03T10:14:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.762+0000 7f8c2f85f700 1 --2- 172.21.15.72:0/1832599112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c28134170 0x7f8c2813bd30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.762+0000 7f8c2f85f700 1 --2- 172.21.15.72:0/1832599112 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c280a0a30 0x7f8c280a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.762+0000 7f8c2f85f700 1 -- 172.21.15.72:0/1832599112 >> 172.21.15.72:0/1832599112 conn(0x7f8c280a6550 msgr2=0x7f8c280a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.763+0000 7f8c2f85f700 1 -- 172.21.15.72:0/1832599112 shutdown_connections 2023-10-03T10:14:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.763+0000 7f8c2f85f700 1 -- 172.21.15.72:0/1832599112 wait complete. 2023-10-03T10:14:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.763+0000 7f8c2f85f700 1 Processor -- start 2023-10-03T10:14:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.763+0000 7f8c2f85f700 1 -- start start 2023-10-03T10:14:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2f85f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c280a0a30 0x7f8c281228b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2f85f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c280a1340 0x7f8c28122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2f85f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c28134170 0x7f8c28123330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2f85f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280a4da0 con 0x7f8c280a1340 2023-10-03T10:14:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2f85f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c281332f0 con 0x7f8c28134170 2023-10-03T10:14:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2f85f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c281244f0 con 0x7f8c280a0a30 2023-10-03T10:14:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2d5fb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c280a0a30 0x7f8c281228b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2cdfa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c280a1340 0x7f8c28122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2d5fb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c280a0a30 0x7f8c281228b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45844/0 (socket says 172.21.15.72:45844) 2023-10-03T10:14:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2cdfa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c280a1340 0x7f8c28122df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42666/0 (socket says 172.21.15.72:42666) 2023-10-03T10:14:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2d5fb700 1 -- 172.21.15.72:0/1453081684 learned_addr learned my addr 172.21.15.72:0/1453081684 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2ddfc700 1 --2- 172.21.15.72:0/1453081684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c28134170 0x7f8c28123330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2ddfc700 1 -- 172.21.15.72:0/1453081684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c280a0a30 msgr2=0x7f8c281228b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2ddfc700 1 --2- 172.21.15.72:0/1453081684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c280a0a30 0x7f8c281228b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2ddfc700 1 -- 172.21.15.72:0/1453081684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c280a1340 msgr2=0x7f8c28122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2ddfc700 1 --2- 172.21.15.72:0/1453081684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c280a1340 0x7f8c28122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2ddfc700 1 -- 172.21.15.72:0/1453081684 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c20009a70 con 0x7f8c28134170 2023-10-03T10:14:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.764+0000 7f8c2cdfa700 1 --2- 172.21.15.72:0/1453081684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c280a1340 0x7f8c28122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.765+0000 7f8c2ddfc700 1 --2- 172.21.15.72:0/1453081684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c28134170 0x7f8c28123330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8c20016000 tx=0x7f8c20004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.765+0000 7f8c1dffb700 1 -- 172.21.15.72:0/1453081684 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20004880 con 0x7f8c28134170 2023-10-03T10:14:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.765+0000 7f8c1dffb700 1 -- 172.21.15.72:0/1453081684 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c20020070 con 0x7f8c28134170 2023-10-03T10:14:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.765+0000 7f8c2f85f700 1 -- 172.21.15.72:0/1453081684 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c280a25e0 con 0x7f8c28134170 2023-10-03T10:14:20.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.765+0000 7f8c1dffb700 1 -- 172.21.15.72:0/1453081684 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c200276c0 con 0x7f8c28134170 2023-10-03T10:14:20.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.765+0000 7f8c2f85f700 1 -- 172.21.15.72:0/1453081684 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c28126010 con 0x7f8c28134170 2023-10-03T10:14:20.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.766+0000 7f8c1dffb700 1 -- 172.21.15.72:0/1453081684 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c20027820 con 0x7f8c28134170 2023-10-03T10:14:20.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.766+0000 7f09396c1700 1 -- 172.21.15.72:0/1494596826 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f093406c360 con 0x7f093409d6f0 2023-10-03T10:14:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.766+0000 7f8c1dffb700 1 -- 172.21.15.72:0/1453081684 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c20022070 con 0x7f8c28134170 2023-10-03T10:14:20.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.766+0000 7f8c2f85f700 1 -- 172.21.15.72:0/1453081684 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c28074ea0 con 0x7f8c28134170 2023-10-03T10:14:20.770 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:20.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.766+0000 7f091b7fe700 1 -- 172.21.15.72:0/1494596826 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0928003e00 con 0x7f093409d6f0 2023-10-03T10:14:20.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.768+0000 7f09396c1700 1 -- 172.21.15.72:0/1494596826 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093409d6f0 msgr2=0x7f0934132f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.768+0000 7f09396c1700 1 --2- 172.21.15.72:0/1494596826 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093409d6f0 0x7f0934132f90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0928000c00 tx=0x7f0928004750 comp rx=0 tx=0).stop 2023-10-03T10:14:20.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.768+0000 7f09396c1700 1 -- 172.21.15.72:0/1494596826 shutdown_connections 2023-10-03T10:14:20.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.768+0000 7f09396c1700 1 --2- 172.21.15.72:0/1494596826 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f093409e410 0x7f0934133a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.768+0000 7f09396c1700 1 --2- 172.21.15.72:0/1494596826 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f093409d6f0 0x7f0934132f90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.768+0000 7f09396c1700 1 --2- 172.21.15.72:0/1494596826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f093409e000 0x7f09341334d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.768+0000 7f09396c1700 1 -- 172.21.15.72:0/1494596826 >> 172.21.15.72:0/1494596826 conn(0x7f0934066f50 msgr2=0x7f093406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.769+0000 7f09396c1700 1 -- 172.21.15.72:0/1494596826 shutdown_connections 2023-10-03T10:14:20.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.769+0000 7f09396c1700 1 -- 172.21.15.72:0/1494596826 wait complete. 2023-10-03T10:14:20.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.772+0000 7f8c1dffb700 1 -- 172.21.15.72:0/1453081684 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c20011390 con 0x7f8c28134170 2023-10-03T10:14:20.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:20.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:20.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.880+0000 7fe05a476700 1 Processor -- start 2023-10-03T10:14:20.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.880+0000 7fe05a476700 1 -- start start 2023-10-03T10:14:20.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.881+0000 7fe05a476700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05409f410 0x7fe054136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.881+0000 7fe05a476700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe054136fe0 0x7fe0541393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.881+0000 7fe05a476700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe054070940 con 0x7fe05409e930 2023-10-03T10:14:20.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.881+0000 7fe05a476700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05406fd60 con 0x7fe054136fe0 2023-10-03T10:14:20.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.881+0000 7fe05a476700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05406fa80 con 0x7fe05409f410 2023-10-03T10:14:20.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.881+0000 7fe0537fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05409f410 0x7fe054136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.881+0000 7fe053fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe05409e930 0x7fe05409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39130/0 (socket says 172.21.15.72:39130) 2023-10-03T10:14:20.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.881+0000 7fe053fff700 1 -- 172.21.15.72:0/933287636 learned_addr learned my addr 172.21.15.72:0/933287636 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:20.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.881+0000 7fe058a13700 1 --2- 172.21.15.72:0/933287636 >> v2:172.21.15.72:3300/0 conn(0x7fe054136fe0 0x7fe0541393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.882+0000 7fe052ffd700 1 -- 172.21.15.72:0/933287636 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356041768 0 0) 0x7fe054070940 con 0x7fe05409e930 2023-10-03T10:14:20.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.882+0000 7fe0537fe700 1 -- 172.21.15.72:0/933287636 >> v2:172.21.15.72:3300/0 conn(0x7fe054136fe0 msgr2=0x7fe0541393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.882+0000 7fe0537fe700 1 --2- 172.21.15.72:0/933287636 >> v2:172.21.15.72:3300/0 conn(0x7fe054136fe0 0x7fe0541393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.882+0000 7fe0537fe700 1 -- 172.21.15.72:0/933287636 >> v1:172.21.15.72:6789/0 conn(0x7fe05409e930 legacy=0x7fe05409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.882+0000 7fe0537fe700 1 -- 172.21.15.72:0/933287636 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05409fb60 con 0x7fe05409f410 2023-10-03T10:14:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.882+0000 7fe0537fe700 1 --2- 172.21.15.72:0/933287636 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05409f410 0x7fe054136aa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe048009840 tx=0x7fe048009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30c2173be9ff20a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.882+0000 7fe052ffd700 1 -- 172.21.15.72:0/933287636 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048011830 con 0x7fe05409f410 2023-10-03T10:14:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.882+0000 7fe052ffd700 1 -- 172.21.15.72:0/933287636 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe048011990 con 0x7fe05409f410 2023-10-03T10:14:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.882+0000 7fe052ffd700 1 -- 172.21.15.72:0/933287636 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048011d20 con 0x7fe05409f410 2023-10-03T10:14:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.883+0000 7fe05a476700 1 -- 172.21.15.72:0/933287636 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05409f410 msgr2=0x7fe054136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.883+0000 7fe05a476700 1 --2- 172.21.15.72:0/933287636 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05409f410 0x7fe054136aa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe048009840 tx=0x7fe048009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.883+0000 7fe05a476700 1 -- 172.21.15.72:0/933287636 shutdown_connections 2023-10-03T10:14:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.883+0000 7fe05a476700 1 --2- 172.21.15.72:0/933287636 >> v2:172.21.15.72:3300/0 conn(0x7fe054136fe0 0x7fe0541393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.883+0000 7fe05a476700 1 --2- 172.21.15.72:0/933287636 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05409f410 0x7fe054136aa0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.883+0000 7fe05a476700 1 -- 172.21.15.72:0/933287636 >> 172.21.15.72:0/933287636 conn(0x7fe0540a4210 msgr2=0x7fe0540a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.883+0000 7fe05a476700 1 -- 172.21.15.72:0/933287636 shutdown_connections 2023-10-03T10:14:20.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.883+0000 7fe05a476700 1 -- 172.21.15.72:0/933287636 wait complete. 2023-10-03T10:14:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.884+0000 7fe05a476700 1 Processor -- start 2023-10-03T10:14:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.884+0000 7fe05a476700 1 -- start start 2023-10-03T10:14:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe05a476700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05409e930 0x7fe0541c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe05a476700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05409f410 0x7fe0541c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe05a476700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe054136fe0 0x7fe05406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe05a476700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe054121eb0 con 0x7fe05409f410 2023-10-03T10:14:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe05a476700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0541bc0c0 con 0x7fe05409e930 2023-10-03T10:14:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe05a476700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe054132220 con 0x7fe054136fe0 2023-10-03T10:14:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe053fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05409e930 0x7fe0541c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe0537fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05409f410 0x7fe0541c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe053fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05409e930 0x7fe0541c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44746/0 (socket says 172.21.15.72:44746) 2023-10-03T10:14:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe053fff700 1 -- 172.21.15.72:0/166541019 learned_addr learned my addr 172.21.15.72:0/166541019 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe058a13700 1 --2- 172.21.15.72:0/166541019 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe054136fe0 0x7fe05406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe0537fe700 1 -- 172.21.15.72:0/166541019 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe054136fe0 msgr2=0x7fe05406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe0537fe700 1 --2- 172.21.15.72:0/166541019 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe054136fe0 0x7fe05406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe0537fe700 1 -- 172.21.15.72:0/166541019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05409e930 msgr2=0x7fe0541c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe0537fe700 1 --2- 172.21.15.72:0/166541019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05409e930 0x7fe0541c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe0537fe700 1 -- 172.21.15.72:0/166541019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0480094a0 con 0x7fe05409f410 2023-10-03T10:14:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.885+0000 7fe053fff700 1 --2- 172.21.15.72:0/166541019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05409e930 0x7fe0541c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.886+0000 7fe0537fe700 1 --2- 172.21.15.72:0/166541019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05409f410 0x7fe0541c8950 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe048016000 tx=0x7fe048004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.886+0000 7fe050ff9700 1 -- 172.21.15.72:0/166541019 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0480036a0 con 0x7fe05409f410 2023-10-03T10:14:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.886+0000 7fe050ff9700 1 -- 172.21.15.72:0/166541019 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04801f070 con 0x7fe05409f410 2023-10-03T10:14:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.886+0000 7fe050ff9700 1 -- 172.21.15.72:0/166541019 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048003a20 con 0x7fe05409f410 2023-10-03T10:14:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.886+0000 7fe05a476700 1 -- 172.21.15.72:0/166541019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05409df30 con 0x7fe05409f410 2023-10-03T10:14:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.886+0000 7fe05a476700 1 -- 172.21.15.72:0/166541019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05406d4c0 con 0x7fe05409f410 2023-10-03T10:14:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.886+0000 7fe050ff9700 1 -- 172.21.15.72:0/166541019 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe048003b80 con 0x7fe05409f410 2023-10-03T10:14:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.887+0000 7fe050ff9700 1 -- 172.21.15.72:0/166541019 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe048021070 con 0x7fe05409f410 2023-10-03T10:14:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.887+0000 7fe05a476700 1 -- 172.21.15.72:0/166541019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe054121ff0 con 0x7fe05409f410 2023-10-03T10:14:20.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.892+0000 7fe050ff9700 1 -- 172.21.15.72:0/166541019 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe054121ff0 con 0x7fe05409f410 2023-10-03T10:14:20.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.903+0000 7f3200b4f700 1 Processor -- start 2023-10-03T10:14:20.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.903+0000 7f3200b4f700 1 -- start start 2023-10-03T10:14:20.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.903+0000 7f3200b4f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31fc12c2f0 0x7f31fc130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.903+0000 7f3200b4f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31fc12cff0 0x7f31fc137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.903+0000 7f3200b4f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31fc09a510 con 0x7f31fc12cc20 2023-10-03T10:14:20.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.903+0000 7f3200b4f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc12c7d0 con 0x7f31fc12cff0 2023-10-03T10:14:20.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.903+0000 7f3200b4f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc09c190 con 0x7f31fc12c2f0 2023-10-03T10:14:20.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.904+0000 7f31fa59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f31fc12cc20 0x7f31fc12f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39134/0 (socket says 172.21.15.72:39134) 2023-10-03T10:14:20.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.904+0000 7f31fa59c700 1 -- 172.21.15.72:0/2320055784 learned_addr learned my addr 172.21.15.72:0/2320055784 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:20.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.904+0000 7f31f9d9b700 1 --2- 172.21.15.72:0/2320055784 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31fc12c2f0 0x7f31fc130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.904+0000 7f31fad9d700 1 --2- 172.21.15.72:0/2320055784 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31fc12cff0 0x7f31fc137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.904+0000 7f31f959a700 1 -- 172.21.15.72:0/2320055784 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201710454 0 0) 0x7f31fc09a510 con 0x7f31fc12cc20 2023-10-03T10:14:20.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.904+0000 7f31f959a700 1 -- 172.21.15.72:0/2320055784 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e40035b0 con 0x7f31fc12cc20 2023-10-03T10:14:20.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.904+0000 7f31f9d9b700 1 -- 172.21.15.72:0/2320055784 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31fc12cff0 msgr2=0x7f31fc137cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.904+0000 7f31f9d9b700 1 --2- 172.21.15.72:0/2320055784 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31fc12cff0 0x7f31fc137cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.904+0000 7f31f9d9b700 1 -- 172.21.15.72:0/2320055784 >> v1:172.21.15.72:6789/0 conn(0x7f31fc12cc20 legacy=0x7f31fc12f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.904+0000 7f31f9d9b700 1 -- 172.21.15.72:0/2320055784 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc09b540 con 0x7f31fc12c2f0 2023-10-03T10:14:20.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.904+0000 7f31fad9d700 1 --2- 172.21.15.72:0/2320055784 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31fc12cff0 0x7f31fc137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.904+0000 7f31f9d9b700 1 --2- 172.21.15.72:0/2320055784 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31fc12c2f0 0x7f31fc130040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009870 tx=0x7f31f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ea88acabbbe7131 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.904+0000 7f31f959a700 1 -- 172.21.15.72:0/2320055784 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0012b80 con 0x7f31fc12c2f0 2023-10-03T10:14:20.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.904+0000 7f31f959a700 1 -- 172.21.15.72:0/2320055784 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f000c070 con 0x7f31fc12c2f0 2023-10-03T10:14:20.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.904+0000 7f31f959a700 1 -- 172.21.15.72:0/2320055784 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000d4b0 con 0x7f31fc12c2f0 2023-10-03T10:14:20.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.905+0000 7f3200b4f700 1 -- 172.21.15.72:0/2320055784 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31fc12c2f0 msgr2=0x7f31fc130040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.905+0000 7f3200b4f700 1 --2- 172.21.15.72:0/2320055784 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31fc12c2f0 0x7f31fc130040 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009870 tx=0x7f31f0009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:20.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.905+0000 7f3200b4f700 1 -- 172.21.15.72:0/2320055784 shutdown_connections 2023-10-03T10:14:20.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.905+0000 7f3200b4f700 1 --2- 172.21.15.72:0/2320055784 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31fc12cff0 0x7f31fc137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.905+0000 7f3200b4f700 1 --2- 172.21.15.72:0/2320055784 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31fc12c2f0 0x7f31fc130040 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.905+0000 7f3200b4f700 1 -- 172.21.15.72:0/2320055784 >> 172.21.15.72:0/2320055784 conn(0x7f31fc09f470 msgr2=0x7f31fc0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.905+0000 7f3200b4f700 1 -- 172.21.15.72:0/2320055784 shutdown_connections 2023-10-03T10:14:20.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.905+0000 7f3200b4f700 1 -- 172.21.15.72:0/2320055784 wait complete. 2023-10-03T10:14:20.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.906+0000 7f3200b4f700 1 Processor -- start 2023-10-03T10:14:20.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.907+0000 7f3200b4f700 1 -- start start 2023-10-03T10:14:20.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.907+0000 7f3200b4f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31fc12c2f0 0x7f31fc0984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.907+0000 7f3200b4f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31fc12cc20 0x7f31fc098a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.907+0000 7f3200b4f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31fc12cff0 0x7f31fc1280b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.907+0000 7f3200b4f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc098f70 con 0x7f31fc12cff0 2023-10-03T10:14:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.907+0000 7f3200b4f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc06fd60 con 0x7f31fc12cc20 2023-10-03T10:14:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.907+0000 7f3200b4f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc06ebe0 con 0x7f31fc12c2f0 2023-10-03T10:14:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.907+0000 7f31fad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31fc12cff0 0x7f31fc1280b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.907+0000 7f31fad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31fc12cff0 0x7f31fc1280b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42700/0 (socket says 172.21.15.72:42700) 2023-10-03T10:14:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.907+0000 7f31fad9d700 1 -- 172.21.15.72:0/1339422483 learned_addr learned my addr 172.21.15.72:0/1339422483 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.907+0000 7f31fa59c700 1 --2- 172.21.15.72:0/1339422483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31fc12c2f0 0x7f31fc0984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.907+0000 7f31f9d9b700 1 --2- 172.21.15.72:0/1339422483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31fc12cc20 0x7f31fc098a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.908+0000 7f31fad9d700 1 -- 172.21.15.72:0/1339422483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31fc12c2f0 msgr2=0x7f31fc0984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.908+0000 7f31fad9d700 1 --2- 172.21.15.72:0/1339422483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31fc12c2f0 0x7f31fc0984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.908+0000 7f31fad9d700 1 -- 172.21.15.72:0/1339422483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31fc12cc20 msgr2=0x7f31fc098a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.908+0000 7f31fad9d700 1 --2- 172.21.15.72:0/1339422483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31fc12cc20 0x7f31fc098a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.908+0000 7f31fad9d700 1 -- 172.21.15.72:0/1339422483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f400aa90 con 0x7f31fc12cff0 2023-10-03T10:14:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.908+0000 7f31fa59c700 1 --2- 172.21.15.72:0/1339422483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31fc12c2f0 0x7f31fc0984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.908+0000 7f31f9d9b700 1 --2- 172.21.15.72:0/1339422483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31fc12cc20 0x7f31fc098a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.908+0000 7f31fad9d700 1 --2- 172.21.15.72:0/1339422483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31fc12cff0 0x7f31fc1280b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f31f4007fc0 tx=0x7f31f400e410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.908+0000 7f31eaffd700 1 -- 172.21.15.72:0/1339422483 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4018070 con 0x7f31fc12cff0 2023-10-03T10:14:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.908+0000 7f31eaffd700 1 -- 172.21.15.72:0/1339422483 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f400a2e0 con 0x7f31fc12cff0 2023-10-03T10:14:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.908+0000 7f3200b4f700 1 -- 172.21.15.72:0/1339422483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f00094a0 con 0x7f31fc12cff0 2023-10-03T10:14:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.908+0000 7f31eaffd700 1 -- 172.21.15.72:0/1339422483 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f400f040 con 0x7f31fc12cff0 2023-10-03T10:14:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.908+0000 7f3200b4f700 1 -- 172.21.15.72:0/1339422483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31fc070000 con 0x7f31fc12cff0 2023-10-03T10:14:20.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.909+0000 7f31eaffd700 1 -- 172.21.15.72:0/1339422483 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31f400ecb0 con 0x7f31fc12cff0 2023-10-03T10:14:20.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.909+0000 7f31eaffd700 1 -- 172.21.15.72:0/1339422483 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f31f403f790 con 0x7f31fc12cff0 2023-10-03T10:14:20.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.909+0000 7f3200b4f700 1 -- 172.21.15.72:0/1339422483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31fc0747f0 con 0x7f31fc12cff0 2023-10-03T10:14:20.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.914+0000 7f31eaffd700 1 -- 172.21.15.72:0/1339422483 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31f4008440 con 0x7f31fc12cff0 2023-10-03T10:14:20.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.969+0000 7f8c2f85f700 1 -- 172.21.15.72:0/1453081684 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8c28125e00 con 0x7f8c28134170 2023-10-03T10:14:20.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.969+0000 7f8c1dffb700 1 -- 172.21.15.72:0/1453081684 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8c20035090 con 0x7f8c28134170 2023-10-03T10:14:20.970 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:20.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.971+0000 7f8c2f85f700 1 -- 172.21.15.72:0/1453081684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c28134170 msgr2=0x7f8c28123330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.971+0000 7f8c2f85f700 1 --2- 172.21.15.72:0/1453081684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c28134170 0x7f8c28123330 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8c20016000 tx=0x7f8c20004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.971+0000 7f8c2f85f700 1 -- 172.21.15.72:0/1453081684 shutdown_connections 2023-10-03T10:14:20.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.971+0000 7f8c2f85f700 1 --2- 172.21.15.72:0/1453081684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c28134170 0x7f8c28123330 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.971+0000 7f8c2f85f700 1 --2- 172.21.15.72:0/1453081684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c280a0a30 0x7f8c281228b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.971+0000 7f8c2f85f700 1 --2- 172.21.15.72:0/1453081684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c280a1340 0x7f8c28122df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.971+0000 7f8c2f85f700 1 -- 172.21.15.72:0/1453081684 >> 172.21.15.72:0/1453081684 conn(0x7f8c280a6550 msgr2=0x7f8c2809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.971+0000 7f8c2f85f700 1 -- 172.21.15.72:0/1453081684 shutdown_connections 2023-10-03T10:14:20.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:20.971+0000 7f8c2f85f700 1 -- 172.21.15.72:0/1453081684 wait complete. 2023-10-03T10:14:20.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:21.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.086+0000 7fe05a476700 1 -- 172.21.15.72:0/166541019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe054121ff0 con 0x7fe05409f410 2023-10-03T10:14:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.086+0000 7fe050ff9700 1 -- 172.21.15.72:0/166541019 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe054121ff0 con 0x7fe05409f410 2023-10-03T10:14:21.087 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.088+0000 7fe05a476700 1 -- 172.21.15.72:0/166541019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05409f410 msgr2=0x7fe0541c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.088+0000 7fe05a476700 1 --2- 172.21.15.72:0/166541019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05409f410 0x7fe0541c8950 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe048016000 tx=0x7fe048004750 comp rx=0 tx=0).stop 2023-10-03T10:14:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.088+0000 7fe05a476700 1 -- 172.21.15.72:0/166541019 shutdown_connections 2023-10-03T10:14:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.088+0000 7fe05a476700 1 --2- 172.21.15.72:0/166541019 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe054136fe0 0x7fe05406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.088+0000 7fe05a476700 1 --2- 172.21.15.72:0/166541019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05409e930 0x7fe0541c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.088+0000 7fe05a476700 1 --2- 172.21.15.72:0/166541019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05409f410 0x7fe0541c8950 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.088+0000 7fe05a476700 1 -- 172.21.15.72:0/166541019 >> 172.21.15.72:0/166541019 conn(0x7fe0540a4210 msgr2=0x7fe054134ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.088+0000 7fe05a476700 1 -- 172.21.15.72:0/166541019 shutdown_connections 2023-10-03T10:14:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.088+0000 7fe05a476700 1 -- 172.21.15.72:0/166541019 wait complete. 2023-10-03T10:14:21.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:21.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.108+0000 7f3200b4f700 1 -- 172.21.15.72:0/1339422483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f31fc06b250 con 0x7f31fc12cff0 2023-10-03T10:14:21.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.108+0000 7f31eaffd700 1 -- 172.21.15.72:0/1339422483 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f31f401c3c0 con 0x7f31fc12cff0 2023-10-03T10:14:21.109 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:21.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.110+0000 7f3200b4f700 1 -- 172.21.15.72:0/1339422483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31fc12cff0 msgr2=0x7f31fc1280b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.110+0000 7f3200b4f700 1 --2- 172.21.15.72:0/1339422483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31fc12cff0 0x7f31fc1280b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f31f4007fc0 tx=0x7f31f400e410 comp rx=0 tx=0).stop 2023-10-03T10:14:21.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.110+0000 7f3200b4f700 1 -- 172.21.15.72:0/1339422483 shutdown_connections 2023-10-03T10:14:21.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.110+0000 7f3200b4f700 1 --2- 172.21.15.72:0/1339422483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31fc12cff0 0x7f31fc1280b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.110+0000 7f3200b4f700 1 --2- 172.21.15.72:0/1339422483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31fc12c2f0 0x7f31fc0984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.110+0000 7f3200b4f700 1 --2- 172.21.15.72:0/1339422483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31fc12cc20 0x7f31fc098a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.110+0000 7f3200b4f700 1 -- 172.21.15.72:0/1339422483 >> 172.21.15.72:0/1339422483 conn(0x7f31fc09f470 msgr2=0x7f31fc0a0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.110+0000 7f3200b4f700 1 -- 172.21.15.72:0/1339422483 shutdown_connections 2023-10-03T10:14:21.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.110+0000 7f3200b4f700 1 -- 172.21.15.72:0/1339422483 wait complete. 2023-10-03T10:14:21.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:21.784 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:21.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.914+0000 7f3825efd700 1 Processor -- start 2023-10-03T10:14:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.914+0000 7f3825efd700 1 -- start start 2023-10-03T10:14:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.914+0000 7f3825efd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f382009d6f0 0x7f382009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.914+0000 7f3825efd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009e410 0x7f3820134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.914+0000 7f3825efd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382009b120 con 0x7f382009e000 2023-10-03T10:14:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.914+0000 7f3825efd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382006b460 con 0x7f382009e410 2023-10-03T10:14:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.914+0000 7f3825efd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382009a7e0 con 0x7f382009d6f0 2023-10-03T10:14:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.914+0000 7f381f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f382009d6f0 0x7f382009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.914+0000 7f381ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009e410 0x7f3820134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.914+0000 7f381ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009e410 0x7f3820134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44774/0 (socket says 172.21.15.72:44774) 2023-10-03T10:14:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.914+0000 7f381f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f382009d6f0 0x7f382009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45892/0 (socket says 172.21.15.72:45892) 2023-10-03T10:14:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.914+0000 7f381ffff700 1 -- 172.21.15.72:0/3131663299 learned_addr learned my addr 172.21.15.72:0/3131663299 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.915+0000 7f381ffff700 1 -- 172.21.15.72:0/3131663299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f382009d6f0 msgr2=0x7f382009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.915+0000 7f381ffff700 1 --2- 172.21.15.72:0/3131663299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f382009d6f0 0x7f382009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.915+0000 7f381ffff700 1 -- 172.21.15.72:0/3131663299 >> v1:172.21.15.72:6789/0 conn(0x7f382009e000 legacy=0x7f38201339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.915+0000 7f381ffff700 1 -- 172.21.15.72:0/3131663299 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382009a500 con 0x7f382009e410 2023-10-03T10:14:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.915+0000 7f381e7fc700 1 -- 172.21.15.72:0/3131663299 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025136131 0 0) 0x7f382009b120 con 0x7f382009e000 2023-10-03T10:14:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.915+0000 7f381f7fe700 1 --2- 172.21.15.72:0/3131663299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f382009d6f0 0x7f382009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.915+0000 7f381ffff700 1 --2- 172.21.15.72:0/3131663299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009e410 0x7f3820134100 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3818009e80 tx=0x7f381800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d344a72c33678190 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.915+0000 7f381e7fc700 1 -- 172.21.15.72:0/3131663299 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800e070 con 0x7f382009e410 2023-10-03T10:14:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.915+0000 7f381e7fc700 1 -- 172.21.15.72:0/3131663299 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381800b910 con 0x7f382009e410 2023-10-03T10:14:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.915+0000 7f381e7fc700 1 -- 172.21.15.72:0/3131663299 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800bcc0 con 0x7f382009e410 2023-10-03T10:14:21.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.915+0000 7f3825efd700 1 -- 172.21.15.72:0/3131663299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009e410 msgr2=0x7f3820134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.915+0000 7f3825efd700 1 --2- 172.21.15.72:0/3131663299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009e410 0x7f3820134100 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3818009e80 tx=0x7f381800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:21.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.916+0000 7f3825efd700 1 -- 172.21.15.72:0/3131663299 shutdown_connections 2023-10-03T10:14:21.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.916+0000 7f3825efd700 1 --2- 172.21.15.72:0/3131663299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009e410 0x7f3820134100 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.916+0000 7f3825efd700 1 --2- 172.21.15.72:0/3131663299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f382009d6f0 0x7f382009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.916+0000 7f3825efd700 1 -- 172.21.15.72:0/3131663299 >> 172.21.15.72:0/3131663299 conn(0x7f3820066f50 msgr2=0x7f382009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.916+0000 7f3825efd700 1 -- 172.21.15.72:0/3131663299 shutdown_connections 2023-10-03T10:14:21.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.916+0000 7f3825efd700 1 -- 172.21.15.72:0/3131663299 wait complete. 2023-10-03T10:14:21.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.916+0000 7f3825efd700 1 Processor -- start 2023-10-03T10:14:21.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f3825efd700 1 -- start start 2023-10-03T10:14:21.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f3825efd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009d6f0 0x7f3820122350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f3825efd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f382009e000 0x7f3820122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f3825efd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f382009e410 0x7f3820122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f3825efd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3820125ba0 con 0x7f382009e000 2023-10-03T10:14:21.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f3825efd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3820133690 con 0x7f382009d6f0 2023-10-03T10:14:21.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f3825efd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3820124d60 con 0x7f382009e410 2023-10-03T10:14:21.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f381f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009d6f0 0x7f3820122350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f381effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f382009e000 0x7f3820122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f381f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009d6f0 0x7f3820122350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44784/0 (socket says 172.21.15.72:44784) 2023-10-03T10:14:21.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f381f7fe700 1 -- 172.21.15.72:0/2200815093 learned_addr learned my addr 172.21.15.72:0/2200815093 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:21.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f381ffff700 1 --2- 172.21.15.72:0/2200815093 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f382009e410 0x7f3820122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f381f7fe700 1 -- 172.21.15.72:0/2200815093 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f382009e410 msgr2=0x7f3820122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f381f7fe700 1 --2- 172.21.15.72:0/2200815093 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f382009e410 0x7f3820122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f381f7fe700 1 -- 172.21.15.72:0/2200815093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f382009e000 msgr2=0x7f3820122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.917+0000 7f381f7fe700 1 --2- 172.21.15.72:0/2200815093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f382009e000 0x7f3820122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.918+0000 7f381f7fe700 1 -- 172.21.15.72:0/2200815093 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38100094a0 con 0x7f382009d6f0 2023-10-03T10:14:21.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.918+0000 7f381effd700 1 --2- 172.21.15.72:0/2200815093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f382009e000 0x7f3820122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.918+0000 7f381f7fe700 1 --2- 172.21.15.72:0/2200815093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009d6f0 0x7f3820122350 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f381000ebe0 tx=0x7f381000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.918+0000 7f3807fff700 1 -- 172.21.15.72:0/2200815093 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381000c850 con 0x7f382009d6f0 2023-10-03T10:14:21.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.918+0000 7f3807fff700 1 -- 172.21.15.72:0/2200815093 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381000c9b0 con 0x7f382009d6f0 2023-10-03T10:14:21.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.918+0000 7f3825efd700 1 -- 172.21.15.72:0/2200815093 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3818009b30 con 0x7f382009d6f0 2023-10-03T10:14:21.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.918+0000 7f3807fff700 1 -- 172.21.15.72:0/2200815093 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381000cd40 con 0x7f382009d6f0 2023-10-03T10:14:21.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.918+0000 7f3825efd700 1 -- 172.21.15.72:0/2200815093 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3820072050 con 0x7f382009d6f0 2023-10-03T10:14:21.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.919+0000 7f3807fff700 1 -- 172.21.15.72:0/2200815093 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3810013470 con 0x7f382009d6f0 2023-10-03T10:14:21.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.919+0000 7f3807fff700 1 -- 172.21.15.72:0/2200815093 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f381003f700 con 0x7f382009d6f0 2023-10-03T10:14:21.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.919+0000 7f3825efd700 1 -- 172.21.15.72:0/2200815093 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3820125120 con 0x7f382009d6f0 2023-10-03T10:14:21.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:21.923+0000 7f3807fff700 1 -- 172.21.15.72:0/2200815093 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3810021020 con 0x7f382009d6f0 2023-10-03T10:14:21.985 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:22.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:22.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.106+0000 7f0ede11a700 1 Processor -- start 2023-10-03T10:14:22.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.107+0000 7f0ede11a700 1 -- start start 2023-10-03T10:14:22.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.107+0000 7f0ede11a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ed81338a0 0x7f0ed8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.107+0000 7f0ede11a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ed809de50 0x7f0ed809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.107+0000 7f0ede11a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed806ef30 con 0x7f0ed809e760 2023-10-03T10:14:22.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.107+0000 7f0ede11a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed806fef0 con 0x7f0ed809de50 2023-10-03T10:14:22.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.107+0000 7f0ede11a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed81334b0 con 0x7f0ed81338a0 2023-10-03T10:14:22.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.107+0000 7f0ed6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ed809de50 0x7f0ed809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.107+0000 7f0ed6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0ed809de50 0x7f0ed809e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42716/0 (socket says 172.21.15.72:42716) 2023-10-03T10:14:22.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.107+0000 7f0ed6ffd700 1 -- 172.21.15.72:0/214581332 learned_addr learned my addr 172.21.15.72:0/214581332 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:22.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.107+0000 7f0ed77fe700 1 --2- 172.21.15.72:0/214581332 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ed81338a0 0x7f0ed8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.108+0000 7f0ed6ffd700 1 -- 172.21.15.72:0/214581332 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ed81338a0 msgr2=0x7f0ed8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:22.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.108+0000 7f0ed6ffd700 1 --2- 172.21.15.72:0/214581332 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ed81338a0 0x7f0ed8133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.108+0000 7f0ed6ffd700 1 -- 172.21.15.72:0/214581332 >> v1:172.21.15.72:6789/0 conn(0x7f0ed809e760 legacy=0x7f0ed813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.108+0000 7f0ed67fc700 1 -- 172.21.15.72:0/214581332 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223316488 0 0) 0x7f0ed806ef30 con 0x7f0ed809e760 2023-10-03T10:14:22.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.108+0000 7f0ed6ffd700 1 -- 172.21.15.72:0/214581332 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed806fc30 con 0x7f0ed809de50 2023-10-03T10:14:22.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.108+0000 7f0ed77fe700 1 --2- 172.21.15.72:0/214581332 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ed81338a0 0x7f0ed8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.108+0000 7f0ed6ffd700 1 --2- 172.21.15.72:0/214581332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed809de50 0x7f0ed809e220 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0098f0 tx=0x7f0ecc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1005c50f98480a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.108+0000 7f0ed67fc700 1 -- 172.21.15.72:0/214581332 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc011830 con 0x7f0ed809de50 2023-10-03T10:14:22.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.108+0000 7f0ed67fc700 1 -- 172.21.15.72:0/214581332 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc011990 con 0x7f0ed809de50 2023-10-03T10:14:22.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.108+0000 7f0ed67fc700 1 -- 172.21.15.72:0/214581332 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc011d20 con 0x7f0ed809de50 2023-10-03T10:14:22.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.109+0000 7f0ede11a700 1 -- 172.21.15.72:0/214581332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed809de50 msgr2=0x7f0ed809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.109+0000 7f0ede11a700 1 --2- 172.21.15.72:0/214581332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed809de50 0x7f0ed809e220 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0098f0 tx=0x7f0ecc009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:22.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.109+0000 7f0ede11a700 1 -- 172.21.15.72:0/214581332 shutdown_connections 2023-10-03T10:14:22.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.109+0000 7f0ede11a700 1 --2- 172.21.15.72:0/214581332 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ed81338a0 0x7f0ed8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.109+0000 7f0ede11a700 1 --2- 172.21.15.72:0/214581332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed809de50 0x7f0ed809e220 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.109+0000 7f0ede11a700 1 -- 172.21.15.72:0/214581332 >> 172.21.15.72:0/214581332 conn(0x7f0ed80a2aa0 msgr2=0x7f0ed80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.109+0000 7f0ede11a700 1 -- 172.21.15.72:0/214581332 shutdown_connections 2023-10-03T10:14:22.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.109+0000 7f0ede11a700 1 -- 172.21.15.72:0/214581332 wait complete. 2023-10-03T10:14:22.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.110+0000 7f0ede11a700 1 Processor -- start 2023-10-03T10:14:22.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.110+0000 7f0ede11a700 1 -- start start 2023-10-03T10:14:22.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ede11a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed809de50 0x7f0ed811b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ede11a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ed809e760 0x7f0ed811bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ede11a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ed81338a0 0x7f0ed811c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ede11a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed811ca40 con 0x7f0ed809de50 2023-10-03T10:14:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ede11a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed811d780 con 0x7f0ed81338a0 2023-10-03T10:14:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ede11a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed811e840 con 0x7f0ed809e760 2023-10-03T10:14:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ed77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed809de50 0x7f0ed811b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ed7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ed81338a0 0x7f0ed811c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ed77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed809de50 0x7f0ed811b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42722/0 (socket says 172.21.15.72:42722) 2023-10-03T10:14:22.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ed77fe700 1 -- 172.21.15.72:0/2129635378 learned_addr learned my addr 172.21.15.72:0/2129635378 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:22.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ed6ffd700 1 --2- 172.21.15.72:0/2129635378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ed809e760 0x7f0ed811bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ed7fff700 1 -- 172.21.15.72:0/2129635378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ed809e760 msgr2=0x7f0ed811bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ed7fff700 1 --2- 172.21.15.72:0/2129635378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ed809e760 0x7f0ed811bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ed7fff700 1 -- 172.21.15.72:0/2129635378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed809de50 msgr2=0x7f0ed811b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ed7fff700 1 --2- 172.21.15.72:0/2129635378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed809de50 0x7f0ed811b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ed7fff700 1 -- 172.21.15.72:0/2129635378 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec80094a0 con 0x7f0ed81338a0 2023-10-03T10:14:22.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ed6ffd700 1 --2- 172.21.15.72:0/2129635378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ed809e760 0x7f0ed811bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.111+0000 7f0ed77fe700 1 --2- 172.21.15.72:0/2129635378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed809de50 0x7f0ed811b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.112+0000 7f0ed7fff700 1 --2- 172.21.15.72:0/2129635378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ed81338a0 0x7f0ed811c060 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000c7c0 tx=0x7f0ed000cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.112+0000 7f0ebffff700 1 -- 172.21.15.72:0/2129635378 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0003e30 con 0x7f0ed81338a0 2023-10-03T10:14:22.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.112+0000 7f0ebffff700 1 -- 172.21.15.72:0/2129635378 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed0005070 con 0x7f0ed81338a0 2023-10-03T10:14:22.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.112+0000 7f0ebffff700 1 -- 172.21.15.72:0/2129635378 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0005420 con 0x7f0ed81338a0 2023-10-03T10:14:22.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.112+0000 7f0ede11a700 1 -- 172.21.15.72:0/2129635378 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ecc009550 con 0x7f0ed81338a0 2023-10-03T10:14:22.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.112+0000 7f0ede11a700 1 -- 172.21.15.72:0/2129635378 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed80a0e20 con 0x7f0ed81338a0 2023-10-03T10:14:22.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.113+0000 7f0ebffff700 1 -- 172.21.15.72:0/2129635378 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ed0005580 con 0x7f0ed81338a0 2023-10-03T10:14:22.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.113+0000 7f0ebffff700 1 -- 172.21.15.72:0/2129635378 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0ed003ec60 con 0x7f0ed81338a0 2023-10-03T10:14:22.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.113+0000 7f0ede11a700 1 -- 172.21.15.72:0/2129635378 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed811ec50 con 0x7f0ed81338a0 2023-10-03T10:14:22.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.114+0000 7f3825efd700 1 -- 172.21.15.72:0/2200815093 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3820074ea0 con 0x7f382009d6f0 2023-10-03T10:14:22.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.118+0000 7f3807fff700 1 -- 172.21.15.72:0/2200815093 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f381000cea0 con 0x7f382009d6f0 2023-10-03T10:14:22.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.118+0000 7f0ebffff700 1 -- 172.21.15.72:0/2129635378 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ed0010d40 con 0x7f0ed81338a0 2023-10-03T10:14:22.119 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.120+0000 7f3825efd700 1 -- 172.21.15.72:0/2200815093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009d6f0 msgr2=0x7f3820122350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.120+0000 7f3825efd700 1 --2- 172.21.15.72:0/2200815093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009d6f0 0x7f3820122350 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f381000ebe0 tx=0x7f381000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.120+0000 7f3825efd700 1 -- 172.21.15.72:0/2200815093 shutdown_connections 2023-10-03T10:14:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.120+0000 7f3825efd700 1 --2- 172.21.15.72:0/2200815093 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f382009e410 0x7f3820122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.120+0000 7f3825efd700 1 --2- 172.21.15.72:0/2200815093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009d6f0 0x7f3820122350 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.120+0000 7f3825efd700 1 --2- 172.21.15.72:0/2200815093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f382009e000 0x7f3820122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.120+0000 7f3825efd700 1 -- 172.21.15.72:0/2200815093 >> 172.21.15.72:0/2200815093 conn(0x7f3820066f50 msgr2=0x7f3820070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.120+0000 7f3825efd700 1 -- 172.21.15.72:0/2200815093 shutdown_connections 2023-10-03T10:14:22.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.120+0000 7f3825efd700 1 -- 172.21.15.72:0/2200815093 wait complete. 2023-10-03T10:14:22.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:22.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.230+0000 7fe473ac5700 1 Processor -- start 2023-10-03T10:14:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.230+0000 7fe473ac5700 1 -- start start 2023-10-03T10:14:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe473ac5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe46c09d6d0 0x7fe46c09daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe473ac5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe46c133cd0 0x7fe46c13ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe473ac5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46c09a570 con 0x7fe46c09dfe0 2023-10-03T10:14:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe473ac5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe46c09b1c0 con 0x7fe46c09d6d0 2023-10-03T10:14:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe473ac5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c09f240 con 0x7fe46c133cd0 2023-10-03T10:14:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe471861700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe46c09d6d0 0x7fe46c09daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe472062700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe46c133cd0 0x7fe46c13ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe472062700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe46c133cd0 0x7fe46c13ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45910/0 (socket says 172.21.15.72:45910) 2023-10-03T10:14:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe471861700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe46c09d6d0 0x7fe46c09daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42728/0 (socket says 172.21.15.72:42728) 2023-10-03T10:14:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe472062700 1 -- 172.21.15.72:0/4186259611 learned_addr learned my addr 172.21.15.72:0/4186259611 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:22.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe472062700 1 -- 172.21.15.72:0/4186259611 >> v2:172.21.15.72:3300/0 conn(0x7fe46c09d6d0 msgr2=0x7fe46c09daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:22.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe472062700 1 --2- 172.21.15.72:0/4186259611 >> v2:172.21.15.72:3300/0 conn(0x7fe46c09d6d0 0x7fe46c09daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe472062700 1 -- 172.21.15.72:0/4186259611 >> v1:172.21.15.72:6789/0 conn(0x7fe46c09dfe0 legacy=0x7fe46c1335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe472062700 1 -- 172.21.15.72:0/4186259611 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c09a2d0 con 0x7fe46c133cd0 2023-10-03T10:14:22.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe471861700 1 --2- 172.21.15.72:0/4186259611 >> v2:172.21.15.72:3300/0 conn(0x7fe46c09d6d0 0x7fe46c09daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.231+0000 7fe472062700 1 --2- 172.21.15.72:0/4186259611 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe46c133cd0 0x7fe46c13ba30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0098f0 tx=0x7fe45c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dcab84a98e8695d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.232+0000 7fe47085f700 1 -- 172.21.15.72:0/4186259611 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c011830 con 0x7fe46c133cd0 2023-10-03T10:14:22.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.232+0000 7fe47085f700 1 -- 172.21.15.72:0/4186259611 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45c011990 con 0x7fe46c133cd0 2023-10-03T10:14:22.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.232+0000 7fe47085f700 1 -- 172.21.15.72:0/4186259611 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c011d20 con 0x7fe46c133cd0 2023-10-03T10:14:22.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.232+0000 7fe473ac5700 1 -- 172.21.15.72:0/4186259611 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe46c133cd0 msgr2=0x7fe46c13ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.232+0000 7fe473ac5700 1 --2- 172.21.15.72:0/4186259611 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe46c133cd0 0x7fe46c13ba30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0098f0 tx=0x7fe45c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.232+0000 7fe473ac5700 1 -- 172.21.15.72:0/4186259611 shutdown_connections 2023-10-03T10:14:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.232+0000 7fe473ac5700 1 --2- 172.21.15.72:0/4186259611 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe46c133cd0 0x7fe46c13ba30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.232+0000 7fe473ac5700 1 --2- 172.21.15.72:0/4186259611 >> v2:172.21.15.72:3300/0 conn(0x7fe46c09d6d0 0x7fe46c09daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.232+0000 7fe473ac5700 1 -- 172.21.15.72:0/4186259611 >> 172.21.15.72:0/4186259611 conn(0x7fe46c099c20 msgr2=0x7fe46c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.232+0000 7fe473ac5700 1 -- 172.21.15.72:0/4186259611 shutdown_connections 2023-10-03T10:14:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.232+0000 7fe473ac5700 1 -- 172.21.15.72:0/4186259611 wait complete. 2023-10-03T10:14:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.233+0000 7fe473ac5700 1 Processor -- start 2023-10-03T10:14:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.233+0000 7fe473ac5700 1 -- start start 2023-10-03T10:14:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe473ac5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe46c09d6d0 0x7fe46c11f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe473ac5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe46c09dfe0 0x7fe46c11f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe473ac5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe46c133cd0 0x7fe46c11fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe473ac5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c122140 con 0x7fe46c133cd0 2023-10-03T10:14:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe473ac5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c1216e0 con 0x7fe46c09d6d0 2023-10-03T10:14:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe473ac5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c122d90 con 0x7fe46c09dfe0 2023-10-03T10:14:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe471060700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe46c09dfe0 0x7fe46c11f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe471060700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe46c09dfe0 0x7fe46c11f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45916/0 (socket says 172.21.15.72:45916) 2023-10-03T10:14:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe471060700 1 -- 172.21.15.72:0/1394587313 learned_addr learned my addr 172.21.15.72:0/1394587313 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe471060700 1 -- 172.21.15.72:0/1394587313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe46c09d6d0 msgr2=0x7fe46c11f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe471060700 1 --2- 172.21.15.72:0/1394587313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe46c09d6d0 0x7fe46c11f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe471060700 1 -- 172.21.15.72:0/1394587313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe46c133cd0 msgr2=0x7fe46c11fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe471060700 1 --2- 172.21.15.72:0/1394587313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe46c133cd0 0x7fe46c11fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe471060700 1 -- 172.21.15.72:0/1394587313 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe464009a70 con 0x7fe46c09dfe0 2023-10-03T10:14:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe471060700 1 --2- 172.21.15.72:0/1394587313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe46c09dfe0 0x7fe46c11f7b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe46000c480 tx=0x7fe46000c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe46a7fc700 1 -- 172.21.15.72:0/1394587313 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600052d0 con 0x7fe46c09dfe0 2023-10-03T10:14:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe46a7fc700 1 -- 172.21.15.72:0/1394587313 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe460005430 con 0x7fe46c09dfe0 2023-10-03T10:14:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe46a7fc700 1 -- 172.21.15.72:0/1394587313 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600038c0 con 0x7fe46c09dfe0 2023-10-03T10:14:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe473ac5700 1 -- 172.21.15.72:0/1394587313 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45c009550 con 0x7fe46c09dfe0 2023-10-03T10:14:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.234+0000 7fe473ac5700 1 -- 172.21.15.72:0/1394587313 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46c09c900 con 0x7fe46c09dfe0 2023-10-03T10:14:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.235+0000 7fe473ac5700 1 -- 172.21.15.72:0/1394587313 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46c04f2a0 con 0x7fe46c09dfe0 2023-10-03T10:14:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.235+0000 7fe46a7fc700 1 -- 172.21.15.72:0/1394587313 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe460003a20 con 0x7fe46c09dfe0 2023-10-03T10:14:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.236+0000 7fe46a7fc700 1 -- 172.21.15.72:0/1394587313 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe46003eb10 con 0x7fe46c09dfe0 2023-10-03T10:14:22.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.240+0000 7fe46a7fc700 1 -- 172.21.15.72:0/1394587313 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe460018260 con 0x7fe46c09dfe0 2023-10-03T10:14:22.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.251+0000 7f9e1219f700 1 Processor -- start 2023-10-03T10:14:22.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.251+0000 7f9e1219f700 1 -- start start 2023-10-03T10:14:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.251+0000 7f9e1219f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e0c09e7e0 0x7f9e0c09ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.251+0000 7f9e1219f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e0c09f0f0 0x7f9e0c137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.251+0000 7f9e1219f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9e0c137ff0 0x7f9e0c13a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.251+0000 7f9e1219f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c06bd70 con 0x7f9e0c137ff0 2023-10-03T10:14:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.251+0000 7f9e1219f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c06cc30 con 0x7f9e0c09f0f0 2023-10-03T10:14:22.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.251+0000 7f9e1219f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c06d870 con 0x7f9e0c09e7e0 2023-10-03T10:14:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.252+0000 7f9e0bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9e0c137ff0 0x7f9e0c13a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.252+0000 7f9e0bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9e0c137ff0 0x7f9e0c13a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42748/0 (socket says 172.21.15.72:42748) 2023-10-03T10:14:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.252+0000 7f9e0bfff700 1 -- 172.21.15.72:0/1785381190 learned_addr learned my addr 172.21.15.72:0/1785381190 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.252+0000 7f9e0affd700 1 --2- 172.21.15.72:0/1785381190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e0c09f0f0 0x7f9e0c137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.252+0000 7f9e0b7fe700 1 --2- 172.21.15.72:0/1785381190 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e0c09e7e0 0x7f9e0c09ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.252+0000 7f9e0affd700 1 -- 172.21.15.72:0/1785381190 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e0c09e7e0 msgr2=0x7f9e0c09ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.252+0000 7f9e0affd700 1 --2- 172.21.15.72:0/1785381190 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e0c09e7e0 0x7f9e0c09ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.252+0000 7f9e0affd700 1 -- 172.21.15.72:0/1785381190 >> v2:172.21.15.72:3300/0 conn(0x7f9e0c137ff0 msgr2=0x7f9e0c13a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.252+0000 7f9e0affd700 1 --2- 172.21.15.72:0/1785381190 >> v2:172.21.15.72:3300/0 conn(0x7f9e0c137ff0 0x7f9e0c13a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.252+0000 7f9e0affd700 1 -- 172.21.15.72:0/1785381190 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c06bab0 con 0x7f9e0c09f0f0 2023-10-03T10:14:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.252+0000 7f9e0bfff700 1 --2- 172.21.15.72:0/1785381190 >> v2:172.21.15.72:3300/0 conn(0x7f9e0c137ff0 0x7f9e0c13a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.252+0000 7f9e0affd700 1 --2- 172.21.15.72:0/1785381190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e0c09f0f0 0x7f9e0c137ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009840 tx=0x7f9e00009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=179faa930870e160 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.252+0000 7f9e0a7fc700 1 -- 172.21.15.72:0/1785381190 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e00011830 con 0x7f9e0c09f0f0 2023-10-03T10:14:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.252+0000 7f9e0a7fc700 1 -- 172.21.15.72:0/1785381190 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e00011990 con 0x7f9e0c09f0f0 2023-10-03T10:14:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.252+0000 7f9e0a7fc700 1 -- 172.21.15.72:0/1785381190 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e00011d20 con 0x7f9e0c09f0f0 2023-10-03T10:14:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.253+0000 7f9e1219f700 1 -- 172.21.15.72:0/1785381190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e0c09f0f0 msgr2=0x7f9e0c137ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.253+0000 7f9e1219f700 1 --2- 172.21.15.72:0/1785381190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e0c09f0f0 0x7f9e0c137ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009840 tx=0x7f9e00009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.253+0000 7f9e1219f700 1 -- 172.21.15.72:0/1785381190 shutdown_connections 2023-10-03T10:14:22.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.253+0000 7f9e1219f700 1 --2- 172.21.15.72:0/1785381190 >> v2:172.21.15.72:3300/0 conn(0x7f9e0c137ff0 0x7f9e0c13a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.253+0000 7f9e1219f700 1 --2- 172.21.15.72:0/1785381190 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e0c09e7e0 0x7f9e0c09ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.253+0000 7f9e1219f700 1 --2- 172.21.15.72:0/1785381190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e0c09f0f0 0x7f9e0c137ab0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.253+0000 7f9e1219f700 1 -- 172.21.15.72:0/1785381190 >> 172.21.15.72:0/1785381190 conn(0x7f9e0c0a4300 msgr2=0x7f9e0c0a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.253+0000 7f9e1219f700 1 -- 172.21.15.72:0/1785381190 shutdown_connections 2023-10-03T10:14:22.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.253+0000 7f9e1219f700 1 -- 172.21.15.72:0/1785381190 wait complete. 2023-10-03T10:14:22.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.254+0000 7f9e1219f700 1 Processor -- start 2023-10-03T10:14:22.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.255+0000 7f9e1219f700 1 -- start start 2023-10-03T10:14:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.255+0000 7f9e1219f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e0c09e7e0 0x7f9e0c122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.255+0000 7f9e1219f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e0c09f0f0 0x7f9e0c122e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.255+0000 7f9e1219f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e0c137ff0 0x7f9e0c123390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.255+0000 7f9e1219f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c126150 con 0x7f9e0c137ff0 2023-10-03T10:14:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.255+0000 7f9e1219f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c124630 con 0x7f9e0c09f0f0 2023-10-03T10:14:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.255+0000 7f9e1219f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0a3470 con 0x7f9e0c09e7e0 2023-10-03T10:14:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.255+0000 7f9e0b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e0c09e7e0 0x7f9e0c122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.255+0000 7f9e0b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e0c09e7e0 0x7f9e0c122910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45924/0 (socket says 172.21.15.72:45924) 2023-10-03T10:14:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.255+0000 7f9e0b7fe700 1 -- 172.21.15.72:0/1669174410 learned_addr learned my addr 172.21.15.72:0/1669174410 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.255+0000 7f9e0affd700 1 --2- 172.21.15.72:0/1669174410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e0c09f0f0 0x7f9e0c122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.256+0000 7f9e0bfff700 1 --2- 172.21.15.72:0/1669174410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e0c137ff0 0x7f9e0c123390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.256+0000 7f9e0b7fe700 1 -- 172.21.15.72:0/1669174410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e0c09f0f0 msgr2=0x7f9e0c122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.256+0000 7f9e0b7fe700 1 --2- 172.21.15.72:0/1669174410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e0c09f0f0 0x7f9e0c122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.256+0000 7f9e0b7fe700 1 -- 172.21.15.72:0/1669174410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e0c137ff0 msgr2=0x7f9e0c123390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.256+0000 7f9e0b7fe700 1 --2- 172.21.15.72:0/1669174410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e0c137ff0 0x7f9e0c123390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.256+0000 7f9e0b7fe700 1 -- 172.21.15.72:0/1669174410 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e04009b30 con 0x7f9e0c09e7e0 2023-10-03T10:14:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.256+0000 7f9e0affd700 1 --2- 172.21.15.72:0/1669174410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e0c09f0f0 0x7f9e0c122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.256+0000 7f9e0b7fe700 1 --2- 172.21.15.72:0/1669174410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e0c09e7e0 0x7f9e0c122910 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00e9b0 tx=0x7f9dfc00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.256+0000 7f9df3fff700 1 -- 172.21.15.72:0/1669174410 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc009710 con 0x7f9e0c09e7e0 2023-10-03T10:14:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.256+0000 7f9df3fff700 1 -- 172.21.15.72:0/1669174410 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc00ee50 con 0x7f9e0c09e7e0 2023-10-03T10:14:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.256+0000 7f9df3fff700 1 -- 172.21.15.72:0/1669174410 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc00ca50 con 0x7f9e0c09e7e0 2023-10-03T10:14:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.256+0000 7f9e1219f700 1 -- 172.21.15.72:0/1669174410 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e000094a0 con 0x7f9e0c09e7e0 2023-10-03T10:14:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.256+0000 7f9e1219f700 1 -- 172.21.15.72:0/1669174410 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c126430 con 0x7f9e0c09e7e0 2023-10-03T10:14:22.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.257+0000 7f9df3fff700 1 -- 172.21.15.72:0/1669174410 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9dfc00cbb0 con 0x7f9e0c09e7e0 2023-10-03T10:14:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.257+0000 7f9df3fff700 1 -- 172.21.15.72:0/1669174410 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9dfc03fb10 con 0x7f9e0c09e7e0 2023-10-03T10:14:22.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.257+0000 7f9e1219f700 1 -- 172.21.15.72:0/1669174410 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c04f2a0 con 0x7f9e0c09e7e0 2023-10-03T10:14:22.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.266+0000 7f9df3fff700 1 -- 172.21.15.72:0/1669174410 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9dfc017020 con 0x7f9e0c09e7e0 2023-10-03T10:14:22.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.325+0000 7f0ede11a700 1 -- 172.21.15.72:0/2129635378 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ed8074ea0 con 0x7f0ed81338a0 2023-10-03T10:14:22.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.325+0000 7f0ebffff700 1 -- 172.21.15.72:0/2129635378 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0ed0010300 con 0x7f0ed81338a0 2023-10-03T10:14:22.326 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:22.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.328+0000 7f0ede11a700 1 -- 172.21.15.72:0/2129635378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ed81338a0 msgr2=0x7f0ed811c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.328+0000 7f0ede11a700 1 --2- 172.21.15.72:0/2129635378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ed81338a0 0x7f0ed811c060 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000c7c0 tx=0x7f0ed000cad0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.328+0000 7f0ede11a700 1 -- 172.21.15.72:0/2129635378 shutdown_connections 2023-10-03T10:14:22.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.328+0000 7f0ede11a700 1 --2- 172.21.15.72:0/2129635378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed809de50 0x7f0ed811b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.328+0000 7f0ede11a700 1 --2- 172.21.15.72:0/2129635378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ed81338a0 0x7f0ed811c060 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.328+0000 7f0ede11a700 1 --2- 172.21.15.72:0/2129635378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ed809e760 0x7f0ed811bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.328+0000 7f0ede11a700 1 -- 172.21.15.72:0/2129635378 >> 172.21.15.72:0/2129635378 conn(0x7f0ed80a2aa0 msgr2=0x7f0ed81305a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.328+0000 7f0ede11a700 1 -- 172.21.15.72:0/2129635378 shutdown_connections 2023-10-03T10:14:22.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.328+0000 7f0ede11a700 1 -- 172.21.15.72:0/2129635378 wait complete. 2023-10-03T10:14:22.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.437+0000 7fe473ac5700 1 -- 172.21.15.72:0/1394587313 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe46c0a1e00 con 0x7fe46c09dfe0 2023-10-03T10:14:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.438+0000 7fe46a7fc700 1 -- 172.21.15.72:0/1394587313 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe460017070 con 0x7fe46c09dfe0 2023-10-03T10:14:22.439 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:22.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.439+0000 7fe473ac5700 1 -- 172.21.15.72:0/1394587313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe46c09dfe0 msgr2=0x7fe46c11f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.439+0000 7fe473ac5700 1 --2- 172.21.15.72:0/1394587313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe46c09dfe0 0x7fe46c11f7b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe46000c480 tx=0x7fe46000c840 comp rx=0 tx=0).stop 2023-10-03T10:14:22.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.439+0000 7fe473ac5700 1 -- 172.21.15.72:0/1394587313 shutdown_connections 2023-10-03T10:14:22.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.439+0000 7fe473ac5700 1 --2- 172.21.15.72:0/1394587313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe46c133cd0 0x7fe46c11fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.439+0000 7fe473ac5700 1 --2- 172.21.15.72:0/1394587313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe46c09d6d0 0x7fe46c11f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.439+0000 7fe473ac5700 1 --2- 172.21.15.72:0/1394587313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe46c09dfe0 0x7fe46c11f7b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.439+0000 7fe473ac5700 1 -- 172.21.15.72:0/1394587313 >> 172.21.15.72:0/1394587313 conn(0x7fe46c099c20 msgr2=0x7fe46c0a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.440+0000 7fe473ac5700 1 -- 172.21.15.72:0/1394587313 shutdown_connections 2023-10-03T10:14:22.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.440+0000 7fe473ac5700 1 -- 172.21.15.72:0/1394587313 wait complete. 2023-10-03T10:14:22.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:22.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.461+0000 7f9e1219f700 1 -- 172.21.15.72:0/1669174410 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9e0c0a05d0 con 0x7f9e0c09e7e0 2023-10-03T10:14:22.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.461+0000 7f9df3fff700 1 -- 172.21.15.72:0/1669174410 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9dfc01b3b0 con 0x7f9e0c09e7e0 2023-10-03T10:14:22.462 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:22.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.463+0000 7f9e1219f700 1 -- 172.21.15.72:0/1669174410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e0c09e7e0 msgr2=0x7f9e0c122910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.463+0000 7f9e1219f700 1 --2- 172.21.15.72:0/1669174410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e0c09e7e0 0x7f9e0c122910 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00e9b0 tx=0x7f9dfc00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.463+0000 7f9e1219f700 1 -- 172.21.15.72:0/1669174410 shutdown_connections 2023-10-03T10:14:22.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.463+0000 7f9e1219f700 1 --2- 172.21.15.72:0/1669174410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e0c137ff0 0x7f9e0c123390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.463+0000 7f9e1219f700 1 --2- 172.21.15.72:0/1669174410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e0c09e7e0 0x7f9e0c122910 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.463+0000 7f9e1219f700 1 --2- 172.21.15.72:0/1669174410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e0c09f0f0 0x7f9e0c122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.463+0000 7f9e1219f700 1 -- 172.21.15.72:0/1669174410 >> 172.21.15.72:0/1669174410 conn(0x7f9e0c0a4300 msgr2=0x7f9e0c070db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.463+0000 7f9e1219f700 1 -- 172.21.15.72:0/1669174410 shutdown_connections 2023-10-03T10:14:22.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:22.463+0000 7f9e1219f700 1 -- 172.21.15.72:0/1669174410 wait complete. 2023-10-03T10:14:22.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:23.140 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:23.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.268+0000 7f5df2eb5700 1 Processor -- start 2023-10-03T10:14:23.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.268+0000 7f5df2eb5700 1 -- start start 2023-10-03T10:14:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df2eb5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dec133420 0x7f5dec1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df2eb5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5dec133e30 0x7f5dec12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df2eb5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dec134260 0x7f5dec1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df2eb5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dec06b990 con 0x7f5dec133e30 2023-10-03T10:14:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df2eb5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec0a0590 con 0x7f5dec133420 2023-10-03T10:14:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df2eb5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec09fb80 con 0x7f5dec134260 2023-10-03T10:14:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5debfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5dec133e30 0x7f5dec12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df0c51700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dec133420 0x7f5dec1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df1452700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dec134260 0x7f5dec1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df0c51700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dec133420 0x7f5dec1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44846/0 (socket says 172.21.15.72:44846) 2023-10-03T10:14:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df1452700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dec134260 0x7f5dec1304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45934/0 (socket says 172.21.15.72:45934) 2023-10-03T10:14:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df0c51700 1 -- 172.21.15.72:0/3941773569 learned_addr learned my addr 172.21.15.72:0/3941773569 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5debfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5dec133e30 0x7f5dec12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42762/0 (socket says 172.21.15.72:42762) 2023-10-03T10:14:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df1452700 1 -- 172.21.15.72:0/3941773569 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dec133420 msgr2=0x7f5dec1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df1452700 1 --2- 172.21.15.72:0/3941773569 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dec133420 0x7f5dec1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df1452700 1 -- 172.21.15.72:0/3941773569 >> v2:172.21.15.72:3300/0 conn(0x7f5dec133e30 msgr2=0x7f5dec12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df1452700 1 --2- 172.21.15.72:0/3941773569 >> v2:172.21.15.72:3300/0 conn(0x7f5dec133e30 0x7f5dec12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df1452700 1 -- 172.21.15.72:0/3941773569 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec0a0030 con 0x7f5dec134260 2023-10-03T10:14:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5debfff700 1 --2- 172.21.15.72:0/3941773569 >> v2:172.21.15.72:3300/0 conn(0x7f5dec133e30 0x7f5dec12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5df1452700 1 --2- 172.21.15.72:0/3941773569 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dec134260 0x7f5dec1304d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009d90 tx=0x7f5de400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7b25405da8e255a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5deb7fe700 1 -- 172.21.15.72:0/3941773569 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de400e070 con 0x7f5dec134260 2023-10-03T10:14:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5deb7fe700 1 -- 172.21.15.72:0/3941773569 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de400bb20 con 0x7f5dec134260 2023-10-03T10:14:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.269+0000 7f5deb7fe700 1 -- 172.21.15.72:0/3941773569 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de4012430 con 0x7f5dec134260 2023-10-03T10:14:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.270+0000 7f5df2eb5700 1 -- 172.21.15.72:0/3941773569 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dec134260 msgr2=0x7f5dec1304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.270+0000 7f5df2eb5700 1 --2- 172.21.15.72:0/3941773569 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dec134260 0x7f5dec1304d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009d90 tx=0x7f5de400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.270+0000 7f5df2eb5700 1 -- 172.21.15.72:0/3941773569 shutdown_connections 2023-10-03T10:14:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.270+0000 7f5df2eb5700 1 --2- 172.21.15.72:0/3941773569 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dec134260 0x7f5dec1304d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.270+0000 7f5df2eb5700 1 --2- 172.21.15.72:0/3941773569 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dec133420 0x7f5dec1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.270+0000 7f5df2eb5700 1 --2- 172.21.15.72:0/3941773569 >> v2:172.21.15.72:3300/0 conn(0x7f5dec133e30 0x7f5dec12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.270+0000 7f5df2eb5700 1 -- 172.21.15.72:0/3941773569 >> 172.21.15.72:0/3941773569 conn(0x7f5dec0a4210 msgr2=0x7f5dec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.270+0000 7f5df2eb5700 1 -- 172.21.15.72:0/3941773569 shutdown_connections 2023-10-03T10:14:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.270+0000 7f5df2eb5700 1 -- 172.21.15.72:0/3941773569 wait complete. 2023-10-03T10:14:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.271+0000 7f5df2eb5700 1 Processor -- start 2023-10-03T10:14:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.271+0000 7f5df2eb5700 1 -- start start 2023-10-03T10:14:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.271+0000 7f5df2eb5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dec133420 0x7f5dec09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.271+0000 7f5df2eb5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dec133e30 0x7f5dec09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.271+0000 7f5df2eb5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dec134260 0x7f5dec09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5df2eb5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec11f990 con 0x7f5dec133e30 2023-10-03T10:14:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5df2eb5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec11fbd0 con 0x7f5dec134260 2023-10-03T10:14:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5df2eb5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec09df00 con 0x7f5dec133420 2023-10-03T10:14:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5df0c51700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dec133420 0x7f5dec09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5df0c51700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dec133420 0x7f5dec09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45948/0 (socket says 172.21.15.72:45948) 2023-10-03T10:14:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5df0c51700 1 -- 172.21.15.72:0/2818470278 learned_addr learned my addr 172.21.15.72:0/2818470278 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5debfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dec133e30 0x7f5dec09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5df1452700 1 --2- 172.21.15.72:0/2818470278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dec134260 0x7f5dec09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5df0c51700 1 -- 172.21.15.72:0/2818470278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dec134260 msgr2=0x7f5dec09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5df0c51700 1 --2- 172.21.15.72:0/2818470278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dec134260 0x7f5dec09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5df0c51700 1 -- 172.21.15.72:0/2818470278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dec133e30 msgr2=0x7f5dec09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5df0c51700 1 --2- 172.21.15.72:0/2818470278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dec133e30 0x7f5dec09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5df0c51700 1 -- 172.21.15.72:0/2818470278 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd80094a0 con 0x7f5dec133420 2023-10-03T10:14:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5debfff700 1 --2- 172.21.15.72:0/2818470278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dec133e30 0x7f5dec09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5df0c51700 1 --2- 172.21.15.72:0/2818470278 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dec133420 0x7f5dec09c480 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5de000e910 tx=0x7f5de000ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5de97fa700 1 -- 172.21.15.72:0/2818470278 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de00096a0 con 0x7f5dec133420 2023-10-03T10:14:23.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5de97fa700 1 -- 172.21.15.72:0/2818470278 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de0013680 con 0x7f5dec133420 2023-10-03T10:14:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5de97fa700 1 -- 172.21.15.72:0/2818470278 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0013a30 con 0x7f5dec133420 2023-10-03T10:14:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5df2eb5700 1 -- 172.21.15.72:0/2818470278 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de4009a70 con 0x7f5dec133420 2023-10-03T10:14:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.272+0000 7f5df2eb5700 1 -- 172.21.15.72:0/2818470278 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dec11fe90 con 0x7f5dec133420 2023-10-03T10:14:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.273+0000 7f5de97fa700 1 -- 172.21.15.72:0/2818470278 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5de0013b90 con 0x7f5dec133420 2023-10-03T10:14:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.273+0000 7f5de97fa700 1 -- 172.21.15.72:0/2818470278 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5de003fa10 con 0x7f5dec133420 2023-10-03T10:14:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.273+0000 7f5df2eb5700 1 -- 172.21.15.72:0/2818470278 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dec074ea0 con 0x7f5dec133420 2023-10-03T10:14:23.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.278+0000 7f5de97fa700 1 -- 172.21.15.72:0/2818470278 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5de0021080 con 0x7f5dec133420 2023-10-03T10:14:23.342 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:23.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:23.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.465+0000 7f69cc50c700 1 Processor -- start 2023-10-03T10:14:23.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.465+0000 7f69cc50c700 1 -- start start 2023-10-03T10:14:23.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69cc50c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f69c409d6f0 0x7f69c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69cc50c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69c409e000 0x7f69c41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69cc50c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c409b120 con 0x7f69c409e410 2023-10-03T10:14:23.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69cc50c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c406b460 con 0x7f69c409e000 2023-10-03T10:14:23.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69cc50c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69c409a7e0 con 0x7f69c409d6f0 2023-10-03T10:14:23.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69c9aa7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69c409e000 0x7f69c41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69caaa9700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f69c409e410 0x7f69c4133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39168/0 (socket says 172.21.15.72:39168) 2023-10-03T10:14:23.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69caaa9700 1 -- 172.21.15.72:0/631188702 learned_addr learned my addr 172.21.15.72:0/631188702 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:23.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69ca2a8700 1 --2- 172.21.15.72:0/631188702 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f69c409d6f0 0x7f69c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69c9aa7700 1 -- 172.21.15.72:0/631188702 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f69c409d6f0 msgr2=0x7f69c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69c9aa7700 1 --2- 172.21.15.72:0/631188702 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f69c409d6f0 0x7f69c409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69c9aa7700 1 -- 172.21.15.72:0/631188702 >> v1:172.21.15.72:6789/0 conn(0x7f69c409e410 legacy=0x7f69c4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69c92a6700 1 -- 172.21.15.72:0/631188702 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728180197 0 0) 0x7f69c409b120 con 0x7f69c409e410 2023-10-03T10:14:23.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69c9aa7700 1 -- 172.21.15.72:0/631188702 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c409a500 con 0x7f69c409e000 2023-10-03T10:14:23.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69ca2a8700 1 --2- 172.21.15.72:0/631188702 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f69c409d6f0 0x7f69c409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69c9aa7700 1 --2- 172.21.15.72:0/631188702 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69c409e000 0x7f69c41339f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009870 tx=0x7f69b8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd229a9a2121337b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69c92a6700 1 -- 172.21.15.72:0/631188702 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b8011830 con 0x7f69c409e000 2023-10-03T10:14:23.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69c92a6700 1 -- 172.21.15.72:0/631188702 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b8011990 con 0x7f69c409e000 2023-10-03T10:14:23.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.466+0000 7f69c92a6700 1 -- 172.21.15.72:0/631188702 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b8011d20 con 0x7f69c409e000 2023-10-03T10:14:23.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.467+0000 7f69cc50c700 1 -- 172.21.15.72:0/631188702 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69c409e000 msgr2=0x7f69c41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.467+0000 7f69cc50c700 1 --2- 172.21.15.72:0/631188702 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69c409e000 0x7f69c41339f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009870 tx=0x7f69b8009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:23.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.467+0000 7f69cc50c700 1 -- 172.21.15.72:0/631188702 shutdown_connections 2023-10-03T10:14:23.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.467+0000 7f69cc50c700 1 --2- 172.21.15.72:0/631188702 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f69c409d6f0 0x7f69c409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.467+0000 7f69cc50c700 1 --2- 172.21.15.72:0/631188702 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69c409e000 0x7f69c41339f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.467+0000 7f69cc50c700 1 -- 172.21.15.72:0/631188702 >> 172.21.15.72:0/631188702 conn(0x7f69c4066f50 msgr2=0x7f69c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.467+0000 7f69cc50c700 1 -- 172.21.15.72:0/631188702 shutdown_connections 2023-10-03T10:14:23.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.467+0000 7f69cc50c700 1 -- 172.21.15.72:0/631188702 wait complete. 2023-10-03T10:14:23.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.468+0000 7f69cc50c700 1 Processor -- start 2023-10-03T10:14:23.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.468+0000 7f69cc50c700 1 -- start start 2023-10-03T10:14:23.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69cc50c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69c409d6f0 0x7f69c41a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69cc50c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f69c409e000 0x7f69c41a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69cc50c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69c409e410 0x7f69c41a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69cc50c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c41a9780 con 0x7f69c409e410 2023-10-03T10:14:23.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69cc50c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c41a7ab0 con 0x7f69c409d6f0 2023-10-03T10:14:23.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69cc50c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69c41a8d00 con 0x7f69c409e000 2023-10-03T10:14:23.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69c9aa7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f69c409e000 0x7f69c41a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69ca2a8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69c409d6f0 0x7f69c41a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69c9aa7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f69c409e000 0x7f69c41a63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45968/0 (socket says 172.21.15.72:45968) 2023-10-03T10:14:23.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69c9aa7700 1 -- 172.21.15.72:0/1589410454 learned_addr learned my addr 172.21.15.72:0/1589410454 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:23.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69caaa9700 1 --2- 172.21.15.72:0/1589410454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69c409e410 0x7f69c41a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69ca2a8700 1 -- 172.21.15.72:0/1589410454 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f69c409e000 msgr2=0x7f69c41a63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69ca2a8700 1 --2- 172.21.15.72:0/1589410454 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f69c409e000 0x7f69c41a63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69ca2a8700 1 -- 172.21.15.72:0/1589410454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69c409e410 msgr2=0x7f69c41a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69ca2a8700 1 --2- 172.21.15.72:0/1589410454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69c409e410 0x7f69c41a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69ca2a8700 1 -- 172.21.15.72:0/1589410454 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b4009a70 con 0x7f69c409d6f0 2023-10-03T10:14:23.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69ca2a8700 1 --2- 172.21.15.72:0/1589410454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69c409d6f0 0x7f69c41a5ea0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009e60 tx=0x7f69b400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.469+0000 7f69c2ffd700 1 -- 172.21.15.72:0/1589410454 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b400cd10 con 0x7f69c409d6f0 2023-10-03T10:14:23.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.470+0000 7f69c2ffd700 1 -- 172.21.15.72:0/1589410454 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b400f040 con 0x7f69c409d6f0 2023-10-03T10:14:23.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.470+0000 7f69c2ffd700 1 -- 172.21.15.72:0/1589410454 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b40146c0 con 0x7f69c409d6f0 2023-10-03T10:14:23.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.470+0000 7f69cc50c700 1 -- 172.21.15.72:0/1589410454 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b80094a0 con 0x7f69c409d6f0 2023-10-03T10:14:23.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.470+0000 7f69cc50c700 1 -- 172.21.15.72:0/1589410454 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c41a80d0 con 0x7f69c409d6f0 2023-10-03T10:14:23.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.471+0000 7f69c2ffd700 1 -- 172.21.15.72:0/1589410454 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f69b4014820 con 0x7f69c409d6f0 2023-10-03T10:14:23.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.470+0000 7f69cc50c700 1 -- 172.21.15.72:0/1589410454 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c409c710 con 0x7f69c409d6f0 2023-10-03T10:14:23.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.471+0000 7f69c2ffd700 1 -- 172.21.15.72:0/1589410454 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f69b40402e0 con 0x7f69c409d6f0 2023-10-03T10:14:23.476 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:23.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.475+0000 7f69c2ffd700 1 -- 172.21.15.72:0/1589410454 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f69b4007920 con 0x7f69c409d6f0 2023-10-03T10:14:23.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.480+0000 7f5df2eb5700 1 -- 172.21.15.72:0/2818470278 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5dec06b250 con 0x7f5dec133420 2023-10-03T10:14:23.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.480+0000 7f5de97fa700 1 -- 172.21.15.72:0/2818470278 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5de0011d90 con 0x7f5dec133420 2023-10-03T10:14:23.481 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:23.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.483+0000 7f5df2eb5700 1 -- 172.21.15.72:0/2818470278 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dec133420 msgr2=0x7f5dec09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.483+0000 7f5df2eb5700 1 --2- 172.21.15.72:0/2818470278 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dec133420 0x7f5dec09c480 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5de000e910 tx=0x7f5de000ec20 comp rx=0 tx=0).stop 2023-10-03T10:14:23.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.483+0000 7f5df2eb5700 1 -- 172.21.15.72:0/2818470278 shutdown_connections 2023-10-03T10:14:23.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.483+0000 7f5df2eb5700 1 --2- 172.21.15.72:0/2818470278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5dec134260 0x7f5dec09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.483+0000 7f5df2eb5700 1 --2- 172.21.15.72:0/2818470278 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5dec133420 0x7f5dec09c480 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.483+0000 7f5df2eb5700 1 --2- 172.21.15.72:0/2818470278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5dec133e30 0x7f5dec09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.483+0000 7f5df2eb5700 1 -- 172.21.15.72:0/2818470278 >> 172.21.15.72:0/2818470278 conn(0x7f5dec0a4210 msgr2=0x7f5dec0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.483+0000 7f5df2eb5700 1 -- 172.21.15.72:0/2818470278 shutdown_connections 2023-10-03T10:14:23.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.483+0000 7f5df2eb5700 1 -- 172.21.15.72:0/2818470278 wait complete. 2023-10-03T10:14:23.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:23.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.588+0000 7ff93969d700 1 Processor -- start 2023-10-03T10:14:23.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.588+0000 7ff93969d700 1 -- start start 2023-10-03T10:14:23.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.588+0000 7ff93969d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff934133420 0x7ff9341337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.588+0000 7ff93969d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff934133e30 0x7ff93412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.588+0000 7ff93969d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff934134260 0x7ff9341304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.588+0000 7ff93969d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93406b990 con 0x7ff934133420 2023-10-03T10:14:23.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.588+0000 7ff93969d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340a0590 con 0x7ff934134260 2023-10-03T10:14:23.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.588+0000 7ff93969d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff93409fb80 con 0x7ff934133e30 2023-10-03T10:14:23.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff932ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff934133420 0x7ff9341337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff9327fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff934133e30 0x7ff93412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff9337fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff934134260 0x7ff9341304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff9327fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff934133e30 0x7ff93412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45984/0 (socket says 172.21.15.72:45984) 2023-10-03T10:14:23.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff932ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff934133420 0x7ff9341337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42786/0 (socket says 172.21.15.72:42786) 2023-10-03T10:14:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff9327fc700 1 -- 172.21.15.72:0/2337551256 learned_addr learned my addr 172.21.15.72:0/2337551256 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff9327fc700 1 -- 172.21.15.72:0/2337551256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff934134260 msgr2=0x7ff9341304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff9327fc700 1 --2- 172.21.15.72:0/2337551256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff934134260 0x7ff9341304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff9327fc700 1 -- 172.21.15.72:0/2337551256 >> v2:172.21.15.72:3300/0 conn(0x7ff934133420 msgr2=0x7ff9341337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff9327fc700 1 --2- 172.21.15.72:0/2337551256 >> v2:172.21.15.72:3300/0 conn(0x7ff934133420 0x7ff9341337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff9327fc700 1 -- 172.21.15.72:0/2337551256 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340a0030 con 0x7ff934133e30 2023-10-03T10:14:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff932ffd700 1 --2- 172.21.15.72:0/2337551256 >> v2:172.21.15.72:3300/0 conn(0x7ff934133420 0x7ff9341337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff9327fc700 1 --2- 172.21.15.72:0/2337551256 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff934133e30 0x7ff93412ff90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff9280098f0 tx=0x7ff928009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ee738fd41009321 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff931ffb700 1 -- 172.21.15.72:0/2337551256 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928011830 con 0x7ff934133e30 2023-10-03T10:14:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff931ffb700 1 -- 172.21.15.72:0/2337551256 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff928011990 con 0x7ff934133e30 2023-10-03T10:14:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.589+0000 7ff931ffb700 1 -- 172.21.15.72:0/2337551256 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928011d20 con 0x7ff934133e30 2023-10-03T10:14:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.590+0000 7ff93969d700 1 -- 172.21.15.72:0/2337551256 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff934133e30 msgr2=0x7ff93412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.590+0000 7ff93969d700 1 --2- 172.21.15.72:0/2337551256 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff934133e30 0x7ff93412ff90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff9280098f0 tx=0x7ff928009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.590+0000 7ff93969d700 1 -- 172.21.15.72:0/2337551256 shutdown_connections 2023-10-03T10:14:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.590+0000 7ff93969d700 1 --2- 172.21.15.72:0/2337551256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff934134260 0x7ff9341304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.590+0000 7ff93969d700 1 --2- 172.21.15.72:0/2337551256 >> v2:172.21.15.72:3300/0 conn(0x7ff934133420 0x7ff9341337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.590+0000 7ff93969d700 1 --2- 172.21.15.72:0/2337551256 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff934133e30 0x7ff93412ff90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.590+0000 7ff93969d700 1 -- 172.21.15.72:0/2337551256 >> 172.21.15.72:0/2337551256 conn(0x7ff9340a4210 msgr2=0x7ff9340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.590+0000 7ff93969d700 1 -- 172.21.15.72:0/2337551256 shutdown_connections 2023-10-03T10:14:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.590+0000 7ff93969d700 1 -- 172.21.15.72:0/2337551256 wait complete. 2023-10-03T10:14:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.591+0000 7ff93969d700 1 Processor -- start 2023-10-03T10:14:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.591+0000 7ff93969d700 1 -- start start 2023-10-03T10:14:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.591+0000 7ff93969d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff934133420 0x7ff93409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.591+0000 7ff93969d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff934133e30 0x7ff93409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.591+0000 7ff93969d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff934134260 0x7ff93409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.591+0000 7ff93969d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93412d950 con 0x7ff934133e30 2023-10-03T10:14:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.591+0000 7ff93969d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93411fb90 con 0x7ff934133420 2023-10-03T10:14:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.591+0000 7ff93969d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff93411f450 con 0x7ff934134260 2023-10-03T10:14:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff932ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff934133420 0x7ff93409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff932ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff934133420 0x7ff93409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44886/0 (socket says 172.21.15.72:44886) 2023-10-03T10:14:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff932ffd700 1 -- 172.21.15.72:0/770538799 learned_addr learned my addr 172.21.15.72:0/770538799 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff9337fe700 1 --2- 172.21.15.72:0/770538799 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff934134260 0x7ff93409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff9327fc700 1 --2- 172.21.15.72:0/770538799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff934133e30 0x7ff93409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff932ffd700 1 -- 172.21.15.72:0/770538799 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff934134260 msgr2=0x7ff93409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff932ffd700 1 --2- 172.21.15.72:0/770538799 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff934134260 0x7ff93409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff932ffd700 1 -- 172.21.15.72:0/770538799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff934133e30 msgr2=0x7ff93409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff932ffd700 1 --2- 172.21.15.72:0/770538799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff934133e30 0x7ff93409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff932ffd700 1 -- 172.21.15.72:0/770538799 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9240094a0 con 0x7ff934133420 2023-10-03T10:14:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff932ffd700 1 --2- 172.21.15.72:0/770538799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff934133420 0x7ff93409c480 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff92400ebe0 tx=0x7ff92400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff91b7fe700 1 -- 172.21.15.72:0/770538799 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92400c850 con 0x7ff934133420 2023-10-03T10:14:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff91b7fe700 1 -- 172.21.15.72:0/770538799 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92400c9b0 con 0x7ff934133420 2023-10-03T10:14:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff93969d700 1 -- 172.21.15.72:0/770538799 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff928009550 con 0x7ff934133420 2023-10-03T10:14:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff91b7fe700 1 -- 172.21.15.72:0/770538799 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92400cd40 con 0x7ff934133420 2023-10-03T10:14:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.592+0000 7ff93969d700 1 -- 172.21.15.72:0/770538799 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9341208c0 con 0x7ff934133420 2023-10-03T10:14:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.593+0000 7ff91b7fe700 1 -- 172.21.15.72:0/770538799 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff924013470 con 0x7ff934133420 2023-10-03T10:14:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.593+0000 7ff91b7fe700 1 -- 172.21.15.72:0/770538799 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff92403f740 con 0x7ff934133420 2023-10-03T10:14:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.594+0000 7ff93969d700 1 -- 172.21.15.72:0/770538799 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff934074ea0 con 0x7ff934133420 2023-10-03T10:14:23.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.602+0000 7ff91b7fe700 1 -- 172.21.15.72:0/770538799 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff924013720 con 0x7ff934133420 2023-10-03T10:14:23.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.617+0000 7fed9a503700 1 Processor -- start 2023-10-03T10:14:23.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.617+0000 7fed9a503700 1 -- start start 2023-10-03T10:14:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.617+0000 7fed9a503700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed9412c2f0 0x7fed94130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.617+0000 7fed9a503700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed9412cff0 0x7fed94137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.617+0000 7fed9a503700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9409a510 con 0x7fed9412cc20 2023-10-03T10:14:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.617+0000 7fed9a503700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9412c7d0 con 0x7fed9412c2f0 2023-10-03T10:14:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.617+0000 7fed9a503700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed9409c190 con 0x7fed9412cff0 2023-10-03T10:14:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.617+0000 7fed937fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed9412c2f0 0x7fed94130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.617+0000 7fed98aa0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed9412cff0 0x7fed94137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.617+0000 7fed937fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed9412c2f0 0x7fed94130040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44900/0 (socket says 172.21.15.72:44900) 2023-10-03T10:14:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.617+0000 7fed937fe700 1 -- 172.21.15.72:0/1125957753 learned_addr learned my addr 172.21.15.72:0/1125957753 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.618+0000 7fed937fe700 1 -- 172.21.15.72:0/1125957753 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed9412cff0 msgr2=0x7fed94137cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.618+0000 7fed937fe700 1 --2- 172.21.15.72:0/1125957753 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed9412cff0 0x7fed94137cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.618+0000 7fed937fe700 1 -- 172.21.15.72:0/1125957753 >> v1:172.21.15.72:6789/0 conn(0x7fed9412cc20 legacy=0x7fed9412f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.618+0000 7fed937fe700 1 -- 172.21.15.72:0/1125957753 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9409b540 con 0x7fed9412c2f0 2023-10-03T10:14:23.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.618+0000 7fed937fe700 1 --2- 172.21.15.72:0/1125957753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed9412c2f0 0x7fed94130040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fed88009920 tx=0x7fed88009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a150490db699b90f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.618+0000 7fed92ffd700 1 -- 172.21.15.72:0/1125957753 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88011830 con 0x7fed9412c2f0 2023-10-03T10:14:23.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.618+0000 7fed92ffd700 1 -- 172.21.15.72:0/1125957753 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed88011990 con 0x7fed9412c2f0 2023-10-03T10:14:23.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.618+0000 7fed92ffd700 1 -- 172.21.15.72:0/1125957753 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88011d20 con 0x7fed9412c2f0 2023-10-03T10:14:23.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.619+0000 7fed9a503700 1 -- 172.21.15.72:0/1125957753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed9412c2f0 msgr2=0x7fed94130040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.619+0000 7fed9a503700 1 --2- 172.21.15.72:0/1125957753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed9412c2f0 0x7fed94130040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fed88009920 tx=0x7fed88009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:23.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.619+0000 7fed9a503700 1 -- 172.21.15.72:0/1125957753 shutdown_connections 2023-10-03T10:14:23.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.619+0000 7fed9a503700 1 --2- 172.21.15.72:0/1125957753 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed9412cff0 0x7fed94137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.619+0000 7fed9a503700 1 --2- 172.21.15.72:0/1125957753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed9412c2f0 0x7fed94130040 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.619+0000 7fed9a503700 1 -- 172.21.15.72:0/1125957753 >> 172.21.15.72:0/1125957753 conn(0x7fed9409f470 msgr2=0x7fed940a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.619+0000 7fed9a503700 1 -- 172.21.15.72:0/1125957753 shutdown_connections 2023-10-03T10:14:23.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.619+0000 7fed9a503700 1 -- 172.21.15.72:0/1125957753 wait complete. 2023-10-03T10:14:23.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.620+0000 7fed9a503700 1 Processor -- start 2023-10-03T10:14:23.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.620+0000 7fed9a503700 1 -- start start 2023-10-03T10:14:23.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.620+0000 7fed9a503700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed9412c2f0 0x7fed941c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.620+0000 7fed9a503700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed9412cc20 0x7fed941c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.620+0000 7fed9a503700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed9412cff0 0x7fed941c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:23.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.620+0000 7fed9a503700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed94129f10 con 0x7fed9412cc20 2023-10-03T10:14:23.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.620+0000 7fed9a503700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9409fdf0 con 0x7fed9412c2f0 2023-10-03T10:14:23.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.620+0000 7fed9a503700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed9412aaf0 con 0x7fed9412cff0 2023-10-03T10:14:23.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.620+0000 7fed937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed9412cc20 0x7fed941c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.620+0000 7fed93fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed9412c2f0 0x7fed941c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.620+0000 7fed937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed9412cc20 0x7fed941c8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42802/0 (socket says 172.21.15.72:42802) 2023-10-03T10:14:23.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.620+0000 7fed937fe700 1 -- 172.21.15.72:0/2624976630 learned_addr learned my addr 172.21.15.72:0/2624976630 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:23.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.620+0000 7fed98aa0700 1 --2- 172.21.15.72:0/2624976630 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed9412cff0 0x7fed941c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:23.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.621+0000 7fed98aa0700 1 -- 172.21.15.72:0/2624976630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed9412c2f0 msgr2=0x7fed941c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.621+0000 7fed98aa0700 1 --2- 172.21.15.72:0/2624976630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed9412c2f0 0x7fed941c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.621+0000 7fed98aa0700 1 -- 172.21.15.72:0/2624976630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed9412cc20 msgr2=0x7fed941c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.621+0000 7fed98aa0700 1 --2- 172.21.15.72:0/2624976630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed9412cc20 0x7fed941c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.621+0000 7fed98aa0700 1 -- 172.21.15.72:0/2624976630 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed88009550 con 0x7fed9412cff0 2023-10-03T10:14:23.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.621+0000 7fed937fe700 1 --2- 172.21.15.72:0/2624976630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed9412cc20 0x7fed941c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.621+0000 7fed93fff700 1 --2- 172.21.15.72:0/2624976630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed9412c2f0 0x7fed941c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:23.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.621+0000 7fed98aa0700 1 --2- 172.21.15.72:0/2624976630 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed9412cff0 0x7fed941c8ea0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009e30 tx=0x7fed8c0074d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:23.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.621+0000 7fed90ff9700 1 -- 172.21.15.72:0/2624976630 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c00add0 con 0x7fed9412cff0 2023-10-03T10:14:23.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.621+0000 7fed90ff9700 1 -- 172.21.15.72:0/2624976630 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c010040 con 0x7fed9412cff0 2023-10-03T10:14:23.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.621+0000 7fed9a503700 1 -- 172.21.15.72:0/2624976630 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed941298a0 con 0x7fed9412cff0 2023-10-03T10:14:23.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.621+0000 7fed90ff9700 1 -- 172.21.15.72:0/2624976630 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c007bf0 con 0x7fed9412cff0 2023-10-03T10:14:23.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.621+0000 7fed9a503700 1 -- 172.21.15.72:0/2624976630 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed94071d10 con 0x7fed9412cff0 2023-10-03T10:14:23.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.622+0000 7fed9a503700 1 -- 172.21.15.72:0/2624976630 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed940a1a10 con 0x7fed9412cff0 2023-10-03T10:14:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.623+0000 7fed90ff9700 1 -- 172.21.15.72:0/2624976630 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed8c007d50 con 0x7fed9412cff0 2023-10-03T10:14:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.623+0000 7fed90ff9700 1 -- 172.21.15.72:0/2624976630 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fed8c03f850 con 0x7fed9412cff0 2023-10-03T10:14:23.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.627+0000 7fed90ff9700 1 -- 172.21.15.72:0/2624976630 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed8c003e30 con 0x7fed9412cff0 2023-10-03T10:14:23.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.681+0000 7f69cc50c700 1 -- 172.21.15.72:0/1589410454 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f69c4074ea0 con 0x7f69c409d6f0 2023-10-03T10:14:23.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.681+0000 7f69c2ffd700 1 -- 172.21.15.72:0/1589410454 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f69b4007330 con 0x7f69c409d6f0 2023-10-03T10:14:23.682 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:23.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.683+0000 7f69cc50c700 1 -- 172.21.15.72:0/1589410454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69c409d6f0 msgr2=0x7f69c41a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.683+0000 7f69cc50c700 1 --2- 172.21.15.72:0/1589410454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69c409d6f0 0x7f69c41a5ea0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009e60 tx=0x7f69b400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.683+0000 7f69cc50c700 1 -- 172.21.15.72:0/1589410454 shutdown_connections 2023-10-03T10:14:23.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.683+0000 7f69cc50c700 1 --2- 172.21.15.72:0/1589410454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69c409e410 0x7f69c41a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.683+0000 7f69cc50c700 1 --2- 172.21.15.72:0/1589410454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69c409d6f0 0x7f69c41a5ea0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.683+0000 7f69cc50c700 1 --2- 172.21.15.72:0/1589410454 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f69c409e000 0x7f69c41a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.683+0000 7f69cc50c700 1 -- 172.21.15.72:0/1589410454 >> 172.21.15.72:0/1589410454 conn(0x7f69c4066f50 msgr2=0x7f69c41bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.683+0000 7f69cc50c700 1 -- 172.21.15.72:0/1589410454 shutdown_connections 2023-10-03T10:14:23.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.683+0000 7f69cc50c700 1 -- 172.21.15.72:0/1589410454 wait complete. 2023-10-03T10:14:23.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:23.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.798+0000 7ff93969d700 1 -- 172.21.15.72:0/770538799 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff93409de40 con 0x7ff934133420 2023-10-03T10:14:23.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.799+0000 7ff91b7fe700 1 -- 172.21.15.72:0/770538799 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff924021020 con 0x7ff934133420 2023-10-03T10:14:23.800 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:23.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.801+0000 7ff93969d700 1 -- 172.21.15.72:0/770538799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff934133420 msgr2=0x7ff93409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.801+0000 7ff93969d700 1 --2- 172.21.15.72:0/770538799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff934133420 0x7ff93409c480 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff92400ebe0 tx=0x7ff92400eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.801+0000 7ff93969d700 1 -- 172.21.15.72:0/770538799 shutdown_connections 2023-10-03T10:14:23.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.801+0000 7ff93969d700 1 --2- 172.21.15.72:0/770538799 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff934134260 0x7ff93409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.801+0000 7ff93969d700 1 --2- 172.21.15.72:0/770538799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff934133420 0x7ff93409c480 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.801+0000 7ff93969d700 1 --2- 172.21.15.72:0/770538799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff934133e30 0x7ff93409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.801+0000 7ff93969d700 1 -- 172.21.15.72:0/770538799 >> 172.21.15.72:0/770538799 conn(0x7ff9340a4210 msgr2=0x7ff9341302c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.801+0000 7ff93969d700 1 -- 172.21.15.72:0/770538799 shutdown_connections 2023-10-03T10:14:23.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.801+0000 7ff93969d700 1 -- 172.21.15.72:0/770538799 wait complete. 2023-10-03T10:14:23.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:23.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.822+0000 7fed9a503700 1 -- 172.21.15.72:0/2624976630 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fed940a06f0 con 0x7fed9412cff0 2023-10-03T10:14:23.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.822+0000 7fed90ff9700 1 -- 172.21.15.72:0/2624976630 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fed8c012ae0 con 0x7fed9412cff0 2023-10-03T10:14:23.823 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:23.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.824+0000 7fed9a503700 1 -- 172.21.15.72:0/2624976630 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed9412cff0 msgr2=0x7fed941c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.824+0000 7fed9a503700 1 --2- 172.21.15.72:0/2624976630 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed9412cff0 0x7fed941c8ea0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009e30 tx=0x7fed8c0074d0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.824+0000 7fed9a503700 1 -- 172.21.15.72:0/2624976630 shutdown_connections 2023-10-03T10:14:23.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.824+0000 7fed9a503700 1 --2- 172.21.15.72:0/2624976630 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed9412cff0 0x7fed941c8ea0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.824+0000 7fed9a503700 1 --2- 172.21.15.72:0/2624976630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed9412c2f0 0x7fed941c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.824+0000 7fed9a503700 1 --2- 172.21.15.72:0/2624976630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed9412cc20 0x7fed941c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.824+0000 7fed9a503700 1 -- 172.21.15.72:0/2624976630 >> 172.21.15.72:0/2624976630 conn(0x7fed9409f470 msgr2=0x7fed940992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.824+0000 7fed9a503700 1 -- 172.21.15.72:0/2624976630 shutdown_connections 2023-10-03T10:14:23.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:23.824+0000 7fed9a503700 1 -- 172.21.15.72:0/2624976630 wait complete. 2023-10-03T10:14:23.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:24.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:24.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.625+0000 7f0d5ffbe700 1 Processor -- start 2023-10-03T10:14:24.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.625+0000 7f0d5ffbe700 1 -- start start 2023-10-03T10:14:24.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5ffbe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d5809e1d0 0x7f0d58135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5ffbe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d58135e50 0x7f0d58138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5ffbe700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5809f130 con 0x7f0d5809d6f0 2023-10-03T10:14:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5ffbe700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5809f520 con 0x7f0d5809e1d0 2023-10-03T10:14:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5ffbe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5809e930 con 0x7f0d58135e50 2023-10-03T10:14:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5d559700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d5809e1d0 0x7f0d58135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5e55b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d58135e50 0x7f0d58138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5d559700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d5809e1d0 0x7f0d58135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42804/0 (socket says 172.21.15.72:42804) 2023-10-03T10:14:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5e55b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d58135e50 0x7f0d58138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44930/0 (socket says 172.21.15.72:44930) 2023-10-03T10:14:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5d559700 1 -- 172.21.15.72:0/514177218 learned_addr learned my addr 172.21.15.72:0/514177218 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5e55b700 1 -- 172.21.15.72:0/514177218 >> v2:172.21.15.72:3300/0 conn(0x7f0d5809e1d0 msgr2=0x7f0d58135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5e55b700 1 --2- 172.21.15.72:0/514177218 >> v2:172.21.15.72:3300/0 conn(0x7f0d5809e1d0 0x7f0d58135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5e55b700 1 -- 172.21.15.72:0/514177218 >> v1:172.21.15.72:6789/0 conn(0x7f0d5809d6f0 legacy=0x7f0d5809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5e55b700 1 -- 172.21.15.72:0/514177218 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5809b2d0 con 0x7f0d58135e50 2023-10-03T10:14:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5d559700 1 --2- 172.21.15.72:0/514177218 >> v2:172.21.15.72:3300/0 conn(0x7f0d5809e1d0 0x7f0d58135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5cd58700 1 -- 172.21.15.72:0/514177218 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478270852 0 0) 0x7f0d5809f130 con 0x7f0d5809d6f0 2023-10-03T10:14:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.626+0000 7f0d5e55b700 1 --2- 172.21.15.72:0/514177218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d58135e50 0x7f0d58138230 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009d90 tx=0x7f0d5000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdc28c71881e10db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.627+0000 7f0d5cd58700 1 -- 172.21.15.72:0/514177218 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5000e070 con 0x7f0d58135e50 2023-10-03T10:14:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.627+0000 7f0d5cd58700 1 -- 172.21.15.72:0/514177218 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5000bb20 con 0x7f0d58135e50 2023-10-03T10:14:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.627+0000 7f0d5cd58700 1 -- 172.21.15.72:0/514177218 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50012430 con 0x7f0d58135e50 2023-10-03T10:14:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.627+0000 7f0d5ffbe700 1 -- 172.21.15.72:0/514177218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d58135e50 msgr2=0x7f0d58138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.627+0000 7f0d5ffbe700 1 --2- 172.21.15.72:0/514177218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d58135e50 0x7f0d58138230 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0d50009d90 tx=0x7f0d5000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.627+0000 7f0d5ffbe700 1 -- 172.21.15.72:0/514177218 shutdown_connections 2023-10-03T10:14:24.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.627+0000 7f0d5ffbe700 1 --2- 172.21.15.72:0/514177218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d58135e50 0x7f0d58138230 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.627+0000 7f0d5ffbe700 1 --2- 172.21.15.72:0/514177218 >> v2:172.21.15.72:3300/0 conn(0x7f0d5809e1d0 0x7f0d58135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.627+0000 7f0d5ffbe700 1 -- 172.21.15.72:0/514177218 >> 172.21.15.72:0/514177218 conn(0x7f0d58066f50 msgr2=0x7f0d5809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.627+0000 7f0d5ffbe700 1 -- 172.21.15.72:0/514177218 shutdown_connections 2023-10-03T10:14:24.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.627+0000 7f0d5ffbe700 1 -- 172.21.15.72:0/514177218 wait complete. 2023-10-03T10:14:24.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.628+0000 7f0d5ffbe700 1 Processor -- start 2023-10-03T10:14:24.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.628+0000 7f0d5ffbe700 1 -- start start 2023-10-03T10:14:24.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.628+0000 7f0d5ffbe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d5809d6f0 0x7f0d58120910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.628+0000 7f0d5ffbe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d5809e1d0 0x7f0d58120e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.628+0000 7f0d5ffbe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d58135e50 0x7f0d58121390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.628+0000 7f0d5ffbe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d58124080 con 0x7f0d5809e1d0 2023-10-03T10:14:24.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.628+0000 7f0d5ffbe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d58122aa0 con 0x7f0d5809d6f0 2023-10-03T10:14:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.628+0000 7f0d5ffbe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d580a1f50 con 0x7f0d58135e50 2023-10-03T10:14:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d5dd5a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d5809d6f0 0x7f0d58120910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d5dd5a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d5809d6f0 0x7f0d58120910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44932/0 (socket says 172.21.15.72:44932) 2023-10-03T10:14:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d5e55b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d58135e50 0x7f0d58121390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d5dd5a700 1 -- 172.21.15.72:0/1394504275 learned_addr learned my addr 172.21.15.72:0/1394504275 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d5d559700 1 --2- 172.21.15.72:0/1394504275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d5809e1d0 0x7f0d58120e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d5dd5a700 1 -- 172.21.15.72:0/1394504275 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d58135e50 msgr2=0x7f0d58121390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d5dd5a700 1 --2- 172.21.15.72:0/1394504275 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d58135e50 0x7f0d58121390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d5dd5a700 1 -- 172.21.15.72:0/1394504275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d5809e1d0 msgr2=0x7f0d58120e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d5dd5a700 1 --2- 172.21.15.72:0/1394504275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d5809e1d0 0x7f0d58120e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d5dd5a700 1 -- 172.21.15.72:0/1394504275 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54009550 con 0x7f0d5809d6f0 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d5dd5a700 1 --2- 172.21.15.72:0/1394504275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d5809d6f0 0x7f0d58120910 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800c450 tx=0x7f0d4800c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d4e7fc700 1 -- 172.21.15.72:0/1394504275 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d480054e0 con 0x7f0d5809d6f0 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d4e7fc700 1 -- 172.21.15.72:0/1394504275 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4800ce60 con 0x7f0d5809d6f0 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d5ffbe700 1 -- 172.21.15.72:0/1394504275 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d50009a70 con 0x7f0d5809d6f0 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d4e7fc700 1 -- 172.21.15.72:0/1394504275 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d480038c0 con 0x7f0d5809d6f0 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.629+0000 7f0d5ffbe700 1 -- 172.21.15.72:0/1394504275 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d58124360 con 0x7f0d5809d6f0 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.630+0000 7f0d4e7fc700 1 -- 172.21.15.72:0/1394504275 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d48003a20 con 0x7f0d5809d6f0 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.630+0000 7f0d4e7fc700 1 -- 172.21.15.72:0/1394504275 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0d4803eb70 con 0x7f0d5809d6f0 2023-10-03T10:14:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.630+0000 7f0d5ffbe700 1 -- 172.21.15.72:0/1394504275 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d58074ea0 con 0x7f0d5809d6f0 2023-10-03T10:14:24.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.635+0000 7f0d4e7fc700 1 -- 172.21.15.72:0/1394504275 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d48019cd0 con 0x7f0d5809d6f0 2023-10-03T10:14:24.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:24.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:24.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.820+0000 7f01b0ec7700 1 Processor -- start 2023-10-03T10:14:24.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.820+0000 7f01b0ec7700 1 -- start start 2023-10-03T10:14:24.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01b0ec7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ac09d6f0 0x7f01ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01b0ec7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01ac09e410 0x7f01ac134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01b0ec7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac09b120 con 0x7f01ac09e000 2023-10-03T10:14:24.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01b0ec7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac06b460 con 0x7f01ac09d6f0 2023-10-03T10:14:24.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01b0ec7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac09a7e0 con 0x7f01ac09e410 2023-10-03T10:14:24.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01aa59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ac09d6f0 0x7f01ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01aad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01ac09e410 0x7f01ac134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01aa59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ac09d6f0 0x7f01ac09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44944/0 (socket says 172.21.15.72:44944) 2023-10-03T10:14:24.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01aa59c700 1 -- 172.21.15.72:0/904519843 learned_addr learned my addr 172.21.15.72:0/904519843 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:24.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01aa59c700 1 -- 172.21.15.72:0/904519843 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01ac09e410 msgr2=0x7f01ac134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01aa59c700 1 --2- 172.21.15.72:0/904519843 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01ac09e410 0x7f01ac134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01aa59c700 1 -- 172.21.15.72:0/904519843 >> v1:172.21.15.72:6789/0 conn(0x7f01ac09e000 legacy=0x7f01ac1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01a959a700 1 -- 172.21.15.72:0/904519843 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216353949 0 0) 0x7f01ac09b120 con 0x7f01ac09e000 2023-10-03T10:14:24.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01aa59c700 1 -- 172.21.15.72:0/904519843 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac09a500 con 0x7f01ac09d6f0 2023-10-03T10:14:24.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01aad9d700 1 --2- 172.21.15.72:0/904519843 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01ac09e410 0x7f01ac134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.821+0000 7f01aa59c700 1 --2- 172.21.15.72:0/904519843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ac09d6f0 0x7f01ac09dac0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f019c009920 tx=0x7f019c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=194e4a28609484d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.822+0000 7f01a959a700 1 -- 172.21.15.72:0/904519843 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c011830 con 0x7f01ac09d6f0 2023-10-03T10:14:24.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.822+0000 7f01a959a700 1 -- 172.21.15.72:0/904519843 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c011990 con 0x7f01ac09d6f0 2023-10-03T10:14:24.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.822+0000 7f01a959a700 1 -- 172.21.15.72:0/904519843 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c011d20 con 0x7f01ac09d6f0 2023-10-03T10:14:24.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.822+0000 7f01b0ec7700 1 -- 172.21.15.72:0/904519843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ac09d6f0 msgr2=0x7f01ac09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.822+0000 7f01b0ec7700 1 --2- 172.21.15.72:0/904519843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ac09d6f0 0x7f01ac09dac0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f019c009920 tx=0x7f019c009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:24.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.822+0000 7f01b0ec7700 1 -- 172.21.15.72:0/904519843 shutdown_connections 2023-10-03T10:14:24.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.822+0000 7f01b0ec7700 1 --2- 172.21.15.72:0/904519843 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01ac09e410 0x7f01ac134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.822+0000 7f01b0ec7700 1 --2- 172.21.15.72:0/904519843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ac09d6f0 0x7f01ac09dac0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.822+0000 7f01b0ec7700 1 -- 172.21.15.72:0/904519843 >> 172.21.15.72:0/904519843 conn(0x7f01ac066f50 msgr2=0x7f01ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.823+0000 7f01b0ec7700 1 -- 172.21.15.72:0/904519843 shutdown_connections 2023-10-03T10:14:24.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.823+0000 7f01b0ec7700 1 -- 172.21.15.72:0/904519843 wait complete. 2023-10-03T10:14:24.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.824+0000 7f01b0ec7700 1 Processor -- start 2023-10-03T10:14:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.824+0000 7f01b0ec7700 1 -- start start 2023-10-03T10:14:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.824+0000 7f01b0ec7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01ac09d6f0 0x7f01ac1225d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.824+0000 7f01b0ec7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac09e000 0x7f01ac122b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.824+0000 7f01b0ec7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ac09e410 0x7f01ac123050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.824+0000 7f01b0ec7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac125ab0 con 0x7f01ac09e000 2023-10-03T10:14:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.824+0000 7f01b0ec7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac124980 con 0x7f01ac09e410 2023-10-03T10:14:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.824+0000 7f01b0ec7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac0a1af0 con 0x7f01ac09d6f0 2023-10-03T10:14:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.824+0000 7f01a9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac09e000 0x7f01ac122b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.824+0000 7f01aa59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01ac09d6f0 0x7f01ac1225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.824+0000 7f01aa59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01ac09d6f0 0x7f01ac1225d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46034/0 (socket says 172.21.15.72:46034) 2023-10-03T10:14:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.824+0000 7f01a9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac09e000 0x7f01ac122b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42818/0 (socket says 172.21.15.72:42818) 2023-10-03T10:14:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.824+0000 7f01aa59c700 1 -- 172.21.15.72:0/1864410810 learned_addr learned my addr 172.21.15.72:0/1864410810 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.824+0000 7f01aad9d700 1 --2- 172.21.15.72:0/1864410810 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ac09e410 0x7f01ac123050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.825+0000 7f01aa59c700 1 -- 172.21.15.72:0/1864410810 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ac09e410 msgr2=0x7f01ac123050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.825+0000 7f01aa59c700 1 --2- 172.21.15.72:0/1864410810 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ac09e410 0x7f01ac123050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.825+0000 7f01aa59c700 1 -- 172.21.15.72:0/1864410810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac09e000 msgr2=0x7f01ac122b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.825+0000 7f01aa59c700 1 --2- 172.21.15.72:0/1864410810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac09e000 0x7f01ac122b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.825+0000 7f01aa59c700 1 -- 172.21.15.72:0/1864410810 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a4009a70 con 0x7f01ac09d6f0 2023-10-03T10:14:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.825+0000 7f01aa59c700 1 --2- 172.21.15.72:0/1864410810 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01ac09d6f0 0x7f01ac1225d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f019c009c70 tx=0x7f019c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.825+0000 7f019affd700 1 -- 172.21.15.72:0/1864410810 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c004240 con 0x7f01ac09d6f0 2023-10-03T10:14:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.825+0000 7f019affd700 1 -- 172.21.15.72:0/1864410810 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c01f070 con 0x7f01ac09d6f0 2023-10-03T10:14:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.825+0000 7f019affd700 1 -- 172.21.15.72:0/1864410810 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c0045a0 con 0x7f01ac09d6f0 2023-10-03T10:14:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.825+0000 7f01b0ec7700 1 -- 172.21.15.72:0/1864410810 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019c009550 con 0x7f01ac09d6f0 2023-10-03T10:14:24.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.825+0000 7f01b0ec7700 1 -- 172.21.15.72:0/1864410810 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac1267e0 con 0x7f01ac09d6f0 2023-10-03T10:14:24.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.826+0000 7f019affd700 1 -- 172.21.15.72:0/1864410810 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f019c021030 con 0x7f01ac09d6f0 2023-10-03T10:14:24.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.826+0000 7f01b0ec7700 1 -- 172.21.15.72:0/1864410810 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ac11f030 con 0x7f01ac09d6f0 2023-10-03T10:14:24.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.826+0000 7f019affd700 1 -- 172.21.15.72:0/1864410810 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f019c040840 con 0x7f01ac09d6f0 2023-10-03T10:14:24.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.832+0000 7f019affd700 1 -- 172.21.15.72:0/1864410810 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f019c003e00 con 0x7f01ac09d6f0 2023-10-03T10:14:24.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.833+0000 7f0d5ffbe700 1 -- 172.21.15.72:0/1394504275 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0d58122c40 con 0x7f0d5809d6f0 2023-10-03T10:14:24.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.833+0000 7f0d4e7fc700 1 -- 172.21.15.72:0/1394504275 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d48017030 con 0x7f0d5809d6f0 2023-10-03T10:14:24.834 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.835+0000 7f0d5ffbe700 1 -- 172.21.15.72:0/1394504275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d5809d6f0 msgr2=0x7f0d58120910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.835+0000 7f0d5ffbe700 1 --2- 172.21.15.72:0/1394504275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d5809d6f0 0x7f0d58120910 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800c450 tx=0x7f0d4800c760 comp rx=0 tx=0).stop 2023-10-03T10:14:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.835+0000 7f0d5ffbe700 1 -- 172.21.15.72:0/1394504275 shutdown_connections 2023-10-03T10:14:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.835+0000 7f0d5ffbe700 1 --2- 172.21.15.72:0/1394504275 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d58135e50 0x7f0d58121390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.835+0000 7f0d5ffbe700 1 --2- 172.21.15.72:0/1394504275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d5809d6f0 0x7f0d58120910 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.835+0000 7f0d5ffbe700 1 --2- 172.21.15.72:0/1394504275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d5809e1d0 0x7f0d58120e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.835+0000 7f0d5ffbe700 1 -- 172.21.15.72:0/1394504275 >> 172.21.15.72:0/1394504275 conn(0x7f0d58066f50 msgr2=0x7f0d5806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.835+0000 7f0d5ffbe700 1 -- 172.21.15.72:0/1394504275 shutdown_connections 2023-10-03T10:14:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.835+0000 7f0d5ffbe700 1 -- 172.21.15.72:0/1394504275 wait complete. 2023-10-03T10:14:24.838 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:24.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:24.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.942+0000 7fdb10d03700 1 Processor -- start 2023-10-03T10:14:24.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.943+0000 7fdb10d03700 1 -- start start 2023-10-03T10:14:24.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.943+0000 7fdb10d03700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0c09e930 0x7fdb0c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.943+0000 7fdb10d03700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb0c09f240 0x7fdb0c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.943+0000 7fdb10d03700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c070940 con 0x7fdb0c09f650 2023-10-03T10:14:24.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.943+0000 7fdb10d03700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c06fd60 con 0x7fdb0c09f240 2023-10-03T10:14:24.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.943+0000 7fdb10d03700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c06fa80 con 0x7fdb0c09e930 2023-10-03T10:14:24.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.943+0000 7fdb09d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb0c09f240 0x7fdb0c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.943+0000 7fdb0a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0c09e930 0x7fdb0c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.943+0000 7fdb09d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb0c09f240 0x7fdb0c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42828/0 (socket says 172.21.15.72:42828) 2023-10-03T10:14:24.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.943+0000 7fdb09d9b700 1 -- 172.21.15.72:0/2034349977 learned_addr learned my addr 172.21.15.72:0/2034349977 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:24.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.943+0000 7fdb0ad9d700 1 --1- 172.21.15.72:0/2034349977 >> v1:172.21.15.72:6789/0 conn(0x7fdb0c09f650 0x7fdb0c131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39200/0 (socket says 172.21.15.72:39200) 2023-10-03T10:14:24.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.944+0000 7fdb0a59c700 1 -- 172.21.15.72:0/2034349977 >> v2:172.21.15.72:3300/0 conn(0x7fdb0c09f240 msgr2=0x7fdb0c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.944+0000 7fdb0a59c700 1 --2- 172.21.15.72:0/2034349977 >> v2:172.21.15.72:3300/0 conn(0x7fdb0c09f240 0x7fdb0c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.944+0000 7fdb0a59c700 1 -- 172.21.15.72:0/2034349977 >> v1:172.21.15.72:6789/0 conn(0x7fdb0c09f650 legacy=0x7fdb0c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.944+0000 7fdb0a59c700 1 -- 172.21.15.72:0/2034349977 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c09fb60 con 0x7fdb0c09e930 2023-10-03T10:14:24.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.944+0000 7fdb09d9b700 1 --2- 172.21.15.72:0/2034349977 >> v2:172.21.15.72:3300/0 conn(0x7fdb0c09f240 0x7fdb0c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.944+0000 7fdb0a59c700 1 --2- 172.21.15.72:0/2034349977 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0c09e930 0x7fdb0c09ed00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009840 tx=0x7fdafc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b047989297c7d3db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.944+0000 7fdb0959a700 1 -- 172.21.15.72:0/2034349977 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc011830 con 0x7fdb0c09e930 2023-10-03T10:14:24.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.944+0000 7fdb0959a700 1 -- 172.21.15.72:0/2034349977 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc011990 con 0x7fdb0c09e930 2023-10-03T10:14:24.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.944+0000 7fdb0959a700 1 -- 172.21.15.72:0/2034349977 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc011d20 con 0x7fdb0c09e930 2023-10-03T10:14:24.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.945+0000 7fdb10d03700 1 -- 172.21.15.72:0/2034349977 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0c09e930 msgr2=0x7fdb0c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.945+0000 7fdb10d03700 1 --2- 172.21.15.72:0/2034349977 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0c09e930 0x7fdb0c09ed00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009840 tx=0x7fdafc009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.945+0000 7fdb10d03700 1 -- 172.21.15.72:0/2034349977 shutdown_connections 2023-10-03T10:14:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.945+0000 7fdb10d03700 1 --2- 172.21.15.72:0/2034349977 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0c09e930 0x7fdb0c09ed00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.945+0000 7fdb10d03700 1 --2- 172.21.15.72:0/2034349977 >> v2:172.21.15.72:3300/0 conn(0x7fdb0c09f240 0x7fdb0c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.945+0000 7fdb10d03700 1 -- 172.21.15.72:0/2034349977 >> 172.21.15.72:0/2034349977 conn(0x7fdb0c0a4210 msgr2=0x7fdb0c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.945+0000 7fdb10d03700 1 -- 172.21.15.72:0/2034349977 shutdown_connections 2023-10-03T10:14:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.945+0000 7fdb10d03700 1 -- 172.21.15.72:0/2034349977 wait complete. 2023-10-03T10:14:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.946+0000 7fdb10d03700 1 Processor -- start 2023-10-03T10:14:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.946+0000 7fdb10d03700 1 -- start start 2023-10-03T10:14:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.946+0000 7fdb10d03700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb0c09e930 0x7fdb0c1c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb10d03700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb0c09f240 0x7fdb0c1c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb10d03700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0c09f650 0x7fdb0c1c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb10d03700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c1a73d0 con 0x7fdb0c09e930 2023-10-03T10:14:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb10d03700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c1a7a80 con 0x7fdb0c09f240 2023-10-03T10:14:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb10d03700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c1a9460 con 0x7fdb0c09f650 2023-10-03T10:14:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb09d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb0c09f240 0x7fdb0c1c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb0ad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0c09f650 0x7fdb0c1c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb09d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb0c09f240 0x7fdb0c1c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44952/0 (socket says 172.21.15.72:44952) 2023-10-03T10:14:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb09d9b700 1 -- 172.21.15.72:0/585168283 learned_addr learned my addr 172.21.15.72:0/585168283 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb0a59c700 1 --2- 172.21.15.72:0/585168283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb0c09e930 0x7fdb0c1c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb09d9b700 1 -- 172.21.15.72:0/585168283 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0c09f650 msgr2=0x7fdb0c1c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb09d9b700 1 --2- 172.21.15.72:0/585168283 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0c09f650 0x7fdb0c1c4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb09d9b700 1 -- 172.21.15.72:0/585168283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb0c09e930 msgr2=0x7fdb0c1c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb09d9b700 1 --2- 172.21.15.72:0/585168283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb0c09e930 0x7fdb0c1c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb09d9b700 1 -- 172.21.15.72:0/585168283 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00009550 con 0x7fdb0c09f240 2023-10-03T10:14:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb0a59c700 1 --2- 172.21.15.72:0/585168283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb0c09e930 0x7fdb0c1c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb09d9b700 1 --2- 172.21.15.72:0/585168283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb0c09f240 0x7fdb0c1c8b40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000ebe0 tx=0x7fdb0000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdafaffd700 1 -- 172.21.15.72:0/585168283 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000c850 con 0x7fdb0c09f240 2023-10-03T10:14:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdafaffd700 1 -- 172.21.15.72:0/585168283 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0000c9b0 con 0x7fdb0c09f240 2023-10-03T10:14:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdb10d03700 1 -- 172.21.15.72:0/585168283 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdafc0094a0 con 0x7fdb0c09f240 2023-10-03T10:14:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.947+0000 7fdafaffd700 1 -- 172.21.15.72:0/585168283 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000cd60 con 0x7fdb0c09f240 2023-10-03T10:14:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.948+0000 7fdb10d03700 1 -- 172.21.15.72:0/585168283 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c0a0190 con 0x7fdb0c09f240 2023-10-03T10:14:24.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.948+0000 7fdafaffd700 1 -- 172.21.15.72:0/585168283 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb00013470 con 0x7fdb0c09f240 2023-10-03T10:14:24.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.948+0000 7fdb10d03700 1 -- 172.21.15.72:0/585168283 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c1a9960 con 0x7fdb0c09f240 2023-10-03T10:14:24.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.949+0000 7fdafaffd700 1 -- 172.21.15.72:0/585168283 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdb0003f720 con 0x7fdb0c09f240 2023-10-03T10:14:24.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.953+0000 7fdafaffd700 1 -- 172.21.15.72:0/585168283 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb000232f0 con 0x7fdb0c09f240 2023-10-03T10:14:24.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.966+0000 7f7efa64f700 1 Processor -- start 2023-10-03T10:14:24.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.966+0000 7f7efa64f700 1 -- start start 2023-10-03T10:14:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.967+0000 7f7efa64f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef4134630 0x7f7ef4136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.967+0000 7f7efa64f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ef4136f50 0x7f7ef4139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.967+0000 7f7efa64f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef409b4f0 con 0x7f7ef4131810 2023-10-03T10:14:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.967+0000 7f7efa64f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef41313c0 con 0x7f7ef4136f50 2023-10-03T10:14:24.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.967+0000 7f7efa64f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef406e8c0 con 0x7f7ef4134630 2023-10-03T10:14:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.967+0000 7f7ef37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef4134630 0x7f7ef4136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.967+0000 7f7ef37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef4134630 0x7f7ef4136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44962/0 (socket says 172.21.15.72:44962) 2023-10-03T10:14:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.967+0000 7f7ef37fe700 1 -- 172.21.15.72:0/3442534719 learned_addr learned my addr 172.21.15.72:0/3442534719 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.967+0000 7f7ef8bec700 1 --2- 172.21.15.72:0/3442534719 >> v2:172.21.15.72:3300/0 conn(0x7f7ef4136f50 0x7f7ef4139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.967+0000 7f7ef37fe700 1 -- 172.21.15.72:0/3442534719 >> v2:172.21.15.72:3300/0 conn(0x7f7ef4136f50 msgr2=0x7f7ef4139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.967+0000 7f7ef37fe700 1 --2- 172.21.15.72:0/3442534719 >> v2:172.21.15.72:3300/0 conn(0x7f7ef4136f50 0x7f7ef4139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.967+0000 7f7ef37fe700 1 -- 172.21.15.72:0/3442534719 >> v1:172.21.15.72:6789/0 conn(0x7f7ef4131810 legacy=0x7f7ef4131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.967+0000 7f7ef37fe700 1 -- 172.21.15.72:0/3442534719 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4071d20 con 0x7f7ef4134630 2023-10-03T10:14:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.968+0000 7f7ef37fe700 1 --2- 172.21.15.72:0/3442534719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef4134630 0x7f7ef4136a10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80098f0 tx=0x7f7ee8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b6047d20e968c9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.968+0000 7f7ef2ffd700 1 -- 172.21.15.72:0/3442534719 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8011830 con 0x7f7ef4134630 2023-10-03T10:14:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.968+0000 7f7ef2ffd700 1 -- 172.21.15.72:0/3442534719 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee8011990 con 0x7f7ef4134630 2023-10-03T10:14:24.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.968+0000 7f7ef2ffd700 1 -- 172.21.15.72:0/3442534719 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8011d20 con 0x7f7ef4134630 2023-10-03T10:14:24.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.968+0000 7f7efa64f700 1 -- 172.21.15.72:0/3442534719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef4134630 msgr2=0x7f7ef4136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.968+0000 7f7efa64f700 1 --2- 172.21.15.72:0/3442534719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef4134630 0x7f7ef4136a10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80098f0 tx=0x7f7ee8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:24.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.968+0000 7f7efa64f700 1 -- 172.21.15.72:0/3442534719 shutdown_connections 2023-10-03T10:14:24.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.968+0000 7f7efa64f700 1 --2- 172.21.15.72:0/3442534719 >> v2:172.21.15.72:3300/0 conn(0x7f7ef4136f50 0x7f7ef4139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.969+0000 7f7efa64f700 1 --2- 172.21.15.72:0/3442534719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef4134630 0x7f7ef4136a10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.969+0000 7f7efa64f700 1 -- 172.21.15.72:0/3442534719 >> 172.21.15.72:0/3442534719 conn(0x7f7ef40a2aa0 msgr2=0x7f7ef40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.969+0000 7f7efa64f700 1 -- 172.21.15.72:0/3442534719 shutdown_connections 2023-10-03T10:14:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.969+0000 7f7efa64f700 1 -- 172.21.15.72:0/3442534719 wait complete. 2023-10-03T10:14:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.969+0000 7f7efa64f700 1 Processor -- start 2023-10-03T10:14:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.970+0000 7f7efa64f700 1 -- start start 2023-10-03T10:14:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.970+0000 7f7efa64f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef4131810 0x7f7ef41c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.970+0000 7f7efa64f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ef4134630 0x7f7ef41c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.970+0000 7f7efa64f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ef4136f50 0x7f7ef41c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.970+0000 7f7efa64f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef411b6b0 con 0x7f7ef4134630 2023-10-03T10:14:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.970+0000 7f7efa64f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef411abc0 con 0x7f7ef4131810 2023-10-03T10:14:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.970+0000 7f7efa64f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef411b2a0 con 0x7f7ef4136f50 2023-10-03T10:14:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.970+0000 7f7ef3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef4131810 0x7f7ef41c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.971+0000 7f7ef3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef4131810 0x7f7ef41c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44966/0 (socket says 172.21.15.72:44966) 2023-10-03T10:14:24.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.971+0000 7f7ef3fff700 1 -- 172.21.15.72:0/2016720503 learned_addr learned my addr 172.21.15.72:0/2016720503 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.971+0000 7f7ef37fe700 1 --2- 172.21.15.72:0/2016720503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ef4134630 0x7f7ef41c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.971+0000 7f7ef8bec700 1 --2- 172.21.15.72:0/2016720503 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ef4136f50 0x7f7ef41c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.971+0000 7f7ef37fe700 1 -- 172.21.15.72:0/2016720503 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ef4136f50 msgr2=0x7f7ef41c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.971+0000 7f7ef37fe700 1 --2- 172.21.15.72:0/2016720503 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ef4136f50 0x7f7ef41c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.971+0000 7f7ef37fe700 1 -- 172.21.15.72:0/2016720503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef4131810 msgr2=0x7f7ef41c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.971+0000 7f7ef37fe700 1 --2- 172.21.15.72:0/2016720503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef4131810 0x7f7ef41c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.971+0000 7f7ef37fe700 1 -- 172.21.15.72:0/2016720503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee8009550 con 0x7f7ef4134630 2023-10-03T10:14:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.971+0000 7f7ef37fe700 1 --2- 172.21.15.72:0/2016720503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ef4134630 0x7f7ef41c6680 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8016000 tx=0x7f7ee8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.971+0000 7f7ef0ff9700 1 -- 172.21.15.72:0/2016720503 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8004400 con 0x7f7ef4134630 2023-10-03T10:14:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.971+0000 7f7ef0ff9700 1 -- 172.21.15.72:0/2016720503 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee801f070 con 0x7f7ef4134630 2023-10-03T10:14:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.971+0000 7f7ef0ff9700 1 -- 172.21.15.72:0/2016720503 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80038e0 con 0x7f7ef4134630 2023-10-03T10:14:24.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.971+0000 7f7efa64f700 1 -- 172.21.15.72:0/2016720503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef411c950 con 0x7f7ef4134630 2023-10-03T10:14:24.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.971+0000 7f7efa64f700 1 -- 172.21.15.72:0/2016720503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef40a2130 con 0x7f7ef4134630 2023-10-03T10:14:24.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.972+0000 7f7efa64f700 1 -- 172.21.15.72:0/2016720503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef411c790 con 0x7f7ef4134630 2023-10-03T10:14:24.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.972+0000 7f7ef0ff9700 1 -- 172.21.15.72:0/2016720503 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ee8021030 con 0x7f7ef4134630 2023-10-03T10:14:24.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.973+0000 7f7ef0ff9700 1 -- 172.21.15.72:0/2016720503 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ee8040870 con 0x7f7ef4134630 2023-10-03T10:14:24.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:24.978+0000 7f7ef0ff9700 1 -- 172.21.15.72:0/2016720503 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ee80239c0 con 0x7f7ef4134630 2023-10-03T10:14:25.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.034+0000 7f01b0ec7700 1 -- 172.21.15.72:0/1864410810 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f01ac074ea0 con 0x7f01ac09d6f0 2023-10-03T10:14:25.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.034+0000 7f019affd700 1 -- 172.21.15.72:0/1864410810 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f019c015070 con 0x7f01ac09d6f0 2023-10-03T10:14:25.035 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.036+0000 7f01b0ec7700 1 -- 172.21.15.72:0/1864410810 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01ac09d6f0 msgr2=0x7f01ac1225d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.036+0000 7f01b0ec7700 1 --2- 172.21.15.72:0/1864410810 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01ac09d6f0 0x7f01ac1225d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f019c009c70 tx=0x7f019c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.036+0000 7f01b0ec7700 1 -- 172.21.15.72:0/1864410810 shutdown_connections 2023-10-03T10:14:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.036+0000 7f01b0ec7700 1 --2- 172.21.15.72:0/1864410810 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ac09e410 0x7f01ac123050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.036+0000 7f01b0ec7700 1 --2- 172.21.15.72:0/1864410810 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01ac09d6f0 0x7f01ac1225d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.036+0000 7f01b0ec7700 1 --2- 172.21.15.72:0/1864410810 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ac09e000 0x7f01ac122b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.036+0000 7f01b0ec7700 1 -- 172.21.15.72:0/1864410810 >> 172.21.15.72:0/1864410810 conn(0x7f01ac066f50 msgr2=0x7f01ac133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.037+0000 7f01b0ec7700 1 -- 172.21.15.72:0/1864410810 shutdown_connections 2023-10-03T10:14:25.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.037+0000 7f01b0ec7700 1 -- 172.21.15.72:0/1864410810 wait complete. 2023-10-03T10:14:25.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:25.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.144+0000 7fdb10d03700 1 -- 172.21.15.72:0/585168283 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdb0c071d20 con 0x7fdb0c09f240 2023-10-03T10:14:25.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.145+0000 7fdafaffd700 1 -- 172.21.15.72:0/585168283 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb00021070 con 0x7fdb0c09f240 2023-10-03T10:14:25.145 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:25.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.146+0000 7fdb10d03700 1 -- 172.21.15.72:0/585168283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb0c09f240 msgr2=0x7fdb0c1c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.146+0000 7fdb10d03700 1 --2- 172.21.15.72:0/585168283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb0c09f240 0x7fdb0c1c8b40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000ebe0 tx=0x7fdb0000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.147+0000 7fdb10d03700 1 -- 172.21.15.72:0/585168283 shutdown_connections 2023-10-03T10:14:25.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.147+0000 7fdb10d03700 1 --2- 172.21.15.72:0/585168283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb0c09e930 0x7fdb0c1c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.147+0000 7fdb10d03700 1 --2- 172.21.15.72:0/585168283 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0c09f650 0x7fdb0c1c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.147+0000 7fdb10d03700 1 --2- 172.21.15.72:0/585168283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb0c09f240 0x7fdb0c1c8b40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.147+0000 7fdb10d03700 1 -- 172.21.15.72:0/585168283 >> 172.21.15.72:0/585168283 conn(0x7fdb0c0a4210 msgr2=0x7fdb0c1baec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.147+0000 7fdb10d03700 1 -- 172.21.15.72:0/585168283 shutdown_connections 2023-10-03T10:14:25.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.147+0000 7fdb10d03700 1 -- 172.21.15.72:0/585168283 wait complete. 2023-10-03T10:14:25.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:25.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.168+0000 7f7efa64f700 1 -- 172.21.15.72:0/2016720503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7ef4074ea0 con 0x7f7ef4134630 2023-10-03T10:14:25.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.169+0000 7f7ef0ff9700 1 -- 172.21.15.72:0/2016720503 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7ee8015070 con 0x7f7ef4134630 2023-10-03T10:14:25.169 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:25.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.171+0000 7f7efa64f700 1 -- 172.21.15.72:0/2016720503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ef4134630 msgr2=0x7f7ef41c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.171+0000 7f7efa64f700 1 --2- 172.21.15.72:0/2016720503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ef4134630 0x7f7ef41c6680 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8016000 tx=0x7f7ee8004750 comp rx=0 tx=0).stop 2023-10-03T10:14:25.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.171+0000 7f7efa64f700 1 -- 172.21.15.72:0/2016720503 shutdown_connections 2023-10-03T10:14:25.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.171+0000 7f7efa64f700 1 --2- 172.21.15.72:0/2016720503 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ef4136f50 0x7f7ef41c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.171+0000 7f7efa64f700 1 --2- 172.21.15.72:0/2016720503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ef4131810 0x7f7ef41c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.171+0000 7f7efa64f700 1 --2- 172.21.15.72:0/2016720503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ef4134630 0x7f7ef41c6680 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.171+0000 7f7efa64f700 1 -- 172.21.15.72:0/2016720503 >> 172.21.15.72:0/2016720503 conn(0x7f7ef40a2aa0 msgr2=0x7f7ef41331f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.171+0000 7f7efa64f700 1 -- 172.21.15.72:0/2016720503 shutdown_connections 2023-10-03T10:14:25.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.171+0000 7f7efa64f700 1 -- 172.21.15.72:0/2016720503 wait complete. 2023-10-03T10:14:25.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:25.851 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:25.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.975+0000 7fd9fb429700 1 Processor -- start 2023-10-03T10:14:25.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9fb429700 1 -- start start 2023-10-03T10:14:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9fb429700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9f409d6f0 0x7fd9f409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9fb429700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd9f409e000 0x7fd9f4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9fb429700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9f409e410 0x7fd9f4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9fb429700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f409f520 con 0x7fd9f409e000 2023-10-03T10:14:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9fb429700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f409f130 con 0x7fd9f409d6f0 2023-10-03T10:14:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9fb429700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f409e930 con 0x7fd9f409e410 2023-10-03T10:14:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9f89c4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd9f409e000 0x7fd9f4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9f91c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9f409d6f0 0x7fd9f409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9f99c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9f409e410 0x7fd9f4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9f89c4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd9f409e000 0x7fd9f4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42866/0 (socket says 172.21.15.72:42866) 2023-10-03T10:14:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9f99c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9f409e410 0x7fd9f4130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46084/0 (socket says 172.21.15.72:46084) 2023-10-03T10:14:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9f91c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9f409d6f0 0x7fd9f409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44974/0 (socket says 172.21.15.72:44974) 2023-10-03T10:14:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9f89c4700 1 -- 172.21.15.72:0/481625306 learned_addr learned my addr 172.21.15.72:0/481625306 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9f89c4700 1 -- 172.21.15.72:0/481625306 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9f409e410 msgr2=0x7fd9f4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9f89c4700 1 --2- 172.21.15.72:0/481625306 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9f409e410 0x7fd9f4130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9f89c4700 1 -- 172.21.15.72:0/481625306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9f409d6f0 msgr2=0x7fd9f409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9f89c4700 1 --2- 172.21.15.72:0/481625306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9f409d6f0 0x7fd9f409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9f89c4700 1 -- 172.21.15.72:0/481625306 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f409b2d0 con 0x7fd9f409e000 2023-10-03T10:14:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9f99c6700 1 --2- 172.21.15.72:0/481625306 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9f409e410 0x7fd9f4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.976+0000 7fd9f91c5700 1 --2- 172.21.15.72:0/481625306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9f409d6f0 0x7fd9f409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.977+0000 7fd9f89c4700 1 --2- 172.21.15.72:0/481625306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f409e000 0x7fd9f4130660 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0009920 tx=0x7fd9f0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f0338295ce7bae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.977+0000 7fd9ebfff700 1 -- 172.21.15.72:0/481625306 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0011830 con 0x7fd9f409e000 2023-10-03T10:14:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.977+0000 7fd9ebfff700 1 -- 172.21.15.72:0/481625306 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f0011990 con 0x7fd9f409e000 2023-10-03T10:14:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.977+0000 7fd9ebfff700 1 -- 172.21.15.72:0/481625306 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0011d20 con 0x7fd9f409e000 2023-10-03T10:14:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.977+0000 7fd9fb429700 1 -- 172.21.15.72:0/481625306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f409e000 msgr2=0x7fd9f4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.977+0000 7fd9fb429700 1 --2- 172.21.15.72:0/481625306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f409e000 0x7fd9f4130660 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0009920 tx=0x7fd9f0009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.977+0000 7fd9fb429700 1 -- 172.21.15.72:0/481625306 shutdown_connections 2023-10-03T10:14:25.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.977+0000 7fd9fb429700 1 --2- 172.21.15.72:0/481625306 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9f409e410 0x7fd9f4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.977+0000 7fd9fb429700 1 --2- 172.21.15.72:0/481625306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9f409d6f0 0x7fd9f409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.977+0000 7fd9fb429700 1 --2- 172.21.15.72:0/481625306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f409e000 0x7fd9f4130660 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.977+0000 7fd9fb429700 1 -- 172.21.15.72:0/481625306 >> 172.21.15.72:0/481625306 conn(0x7fd9f4066f50 msgr2=0x7fd9f409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.977+0000 7fd9fb429700 1 -- 172.21.15.72:0/481625306 shutdown_connections 2023-10-03T10:14:25.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.977+0000 7fd9fb429700 1 -- 172.21.15.72:0/481625306 wait complete. 2023-10-03T10:14:25.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.978+0000 7fd9fb429700 1 Processor -- start 2023-10-03T10:14:25.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.978+0000 7fd9fb429700 1 -- start start 2023-10-03T10:14:25.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9fb429700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f409d6f0 0x7fd9f411df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9fb429700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9f409e000 0x7fd9f411e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9fb429700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9f409e410 0x7fd9f411e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9fb429700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f4121a40 con 0x7fd9f409d6f0 2023-10-03T10:14:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9fb429700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f409c700 con 0x7fd9f409e410 2023-10-03T10:14:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9fb429700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f4120110 con 0x7fd9f409e000 2023-10-03T10:14:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9f91c5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f409d6f0 0x7fd9f411df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9f89c4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9f409e000 0x7fd9f411e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9f99c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9f409e410 0x7fd9f411e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9f91c5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f409d6f0 0x7fd9f411df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42870/0 (socket says 172.21.15.72:42870) 2023-10-03T10:14:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9f91c5700 1 -- 172.21.15.72:0/2604131899 learned_addr learned my addr 172.21.15.72:0/2604131899 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9f89c4700 1 -- 172.21.15.72:0/2604131899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9f409e410 msgr2=0x7fd9f411e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9f89c4700 1 --2- 172.21.15.72:0/2604131899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9f409e410 0x7fd9f411e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9f89c4700 1 -- 172.21.15.72:0/2604131899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f409d6f0 msgr2=0x7fd9f411df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9f89c4700 1 --2- 172.21.15.72:0/2604131899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f409d6f0 0x7fd9f411df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9f89c4700 1 -- 172.21.15.72:0/2604131899 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e40094a0 con 0x7fd9f409e000 2023-10-03T10:14:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9f99c6700 1 --2- 172.21.15.72:0/2604131899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9f409e410 0x7fd9f411e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9f91c5700 1 --2- 172.21.15.72:0/2604131899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f409d6f0 0x7fd9f411df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9f89c4700 1 --2- 172.21.15.72:0/2604131899 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9f409e000 0x7fd9f411e460 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0016000 tx=0x7fd9f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9e9ffb700 1 -- 172.21.15.72:0/2604131899 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0004450 con 0x7fd9f409e000 2023-10-03T10:14:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9e9ffb700 1 -- 172.21.15.72:0/2604131899 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f001f070 con 0x7fd9f409e000 2023-10-03T10:14:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9fb429700 1 -- 172.21.15.72:0/2604131899 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec00bc80 con 0x7fd9f409e000 2023-10-03T10:14:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.979+0000 7fd9e9ffb700 1 -- 172.21.15.72:0/2604131899 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f00045f0 con 0x7fd9f409e000 2023-10-03T10:14:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.980+0000 7fd9fb429700 1 -- 172.21.15.72:0/2604131899 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f0009550 con 0x7fd9f409e000 2023-10-03T10:14:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.980+0000 7fd9fb429700 1 -- 172.21.15.72:0/2604131899 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f41215e0 con 0x7fd9f409e000 2023-10-03T10:14:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.981+0000 7fd9e9ffb700 1 -- 172.21.15.72:0/2604131899 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9f00038e0 con 0x7fd9f409e000 2023-10-03T10:14:25.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.981+0000 7fd9e9ffb700 1 -- 172.21.15.72:0/2604131899 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd9f0021070 con 0x7fd9f409e000 2023-10-03T10:14:25.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:25.985+0000 7fd9e9ffb700 1 -- 172.21.15.72:0/2604131899 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9f001a430 con 0x7fd9f409e000 2023-10-03T10:14:26.050 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:26.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:26.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.172+0000 7f9a025bd700 1 Processor -- start 2023-10-03T10:14:26.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.172+0000 7f9a025bd700 1 -- start start 2023-10-03T10:14:26.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f9a025bd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99fc1338a0 0x7f99fc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f9a025bd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99fc09de50 0x7f99fc09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f9a025bd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc06ef30 con 0x7f99fc09e760 2023-10-03T10:14:26.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f9a025bd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc06fef0 con 0x7f99fc1338a0 2023-10-03T10:14:26.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f9a025bd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc1334b0 con 0x7f99fc09de50 2023-10-03T10:14:26.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f99fbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99fc1338a0 0x7f99fc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f99fb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99fc09de50 0x7f99fc09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f99fb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99fc09de50 0x7f99fc09e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46106/0 (socket says 172.21.15.72:46106) 2023-10-03T10:14:26.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f99fbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99fc1338a0 0x7f99fc133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44988/0 (socket says 172.21.15.72:44988) 2023-10-03T10:14:26.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f99fb7fe700 1 -- 172.21.15.72:0/4055891829 learned_addr learned my addr 172.21.15.72:0/4055891829 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:26.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f9a00b5a700 1 --1- 172.21.15.72:0/4055891829 >> v1:172.21.15.72:6789/0 conn(0x7f99fc09e760 0x7f99fc13a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39230/0 (socket says 172.21.15.72:39230) 2023-10-03T10:14:26.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f99fb7fe700 1 -- 172.21.15.72:0/4055891829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99fc1338a0 msgr2=0x7f99fc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:26.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f99fb7fe700 1 --2- 172.21.15.72:0/4055891829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99fc1338a0 0x7f99fc133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f99fb7fe700 1 -- 172.21.15.72:0/4055891829 >> v1:172.21.15.72:6789/0 conn(0x7f99fc09e760 legacy=0x7f99fc13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f99fb7fe700 1 -- 172.21.15.72:0/4055891829 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc06fc30 con 0x7f99fc09de50 2023-10-03T10:14:26.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.173+0000 7f99fb7fe700 1 --2- 172.21.15.72:0/4055891829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99fc09de50 0x7f99fc09e220 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009950 tx=0x7f99f0009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a03df3c585a93926 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:26.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.174+0000 7f99faffd700 1 -- 172.21.15.72:0/4055891829 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0011830 con 0x7f99fc09de50 2023-10-03T10:14:26.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.174+0000 7f99faffd700 1 -- 172.21.15.72:0/4055891829 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f0011990 con 0x7f99fc09de50 2023-10-03T10:14:26.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.174+0000 7f99faffd700 1 -- 172.21.15.72:0/4055891829 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0011d40 con 0x7f99fc09de50 2023-10-03T10:14:26.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.174+0000 7f9a025bd700 1 -- 172.21.15.72:0/4055891829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99fc09de50 msgr2=0x7f99fc09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.174+0000 7f9a025bd700 1 --2- 172.21.15.72:0/4055891829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99fc09de50 0x7f99fc09e220 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009950 tx=0x7f99f0009c60 comp rx=0 tx=0).stop 2023-10-03T10:14:26.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.174+0000 7f9a025bd700 1 -- 172.21.15.72:0/4055891829 shutdown_connections 2023-10-03T10:14:26.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.174+0000 7f9a025bd700 1 --2- 172.21.15.72:0/4055891829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99fc1338a0 0x7f99fc133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.174+0000 7f9a025bd700 1 --2- 172.21.15.72:0/4055891829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99fc09de50 0x7f99fc09e220 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.174+0000 7f9a025bd700 1 -- 172.21.15.72:0/4055891829 >> 172.21.15.72:0/4055891829 conn(0x7f99fc0a2aa0 msgr2=0x7f99fc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.174+0000 7f9a025bd700 1 -- 172.21.15.72:0/4055891829 shutdown_connections 2023-10-03T10:14:26.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.174+0000 7f9a025bd700 1 -- 172.21.15.72:0/4055891829 wait complete. 2023-10-03T10:14:26.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.175+0000 7f9a025bd700 1 Processor -- start 2023-10-03T10:14:26.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.175+0000 7f9a025bd700 1 -- start start 2023-10-03T10:14:26.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f9a025bd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99fc09de50 0x7f99fc11eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f9a025bd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc09e760 0x7f99fc11f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f9a025bd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99fc1338a0 0x7f99fc11f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f9a025bd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc120700 con 0x7f99fc09e760 2023-10-03T10:14:26.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f9a025bd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc121cf0 con 0x7f99fc1338a0 2023-10-03T10:14:26.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f9a025bd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0a10d0 con 0x7f99fc09de50 2023-10-03T10:14:26.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f99fbfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99fc09de50 0x7f99fc11eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f99fbfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99fc09de50 0x7f99fc11eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46122/0 (socket says 172.21.15.72:46122) 2023-10-03T10:14:26.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f99fbfff700 1 -- 172.21.15.72:0/2041205454 learned_addr learned my addr 172.21.15.72:0/2041205454 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:26.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f9a00b5a700 1 --2- 172.21.15.72:0/2041205454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99fc1338a0 0x7f99fc11f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f99fb7fe700 1 --2- 172.21.15.72:0/2041205454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc09e760 0x7f99fc11f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f9a00b5a700 1 -- 172.21.15.72:0/2041205454 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99fc09de50 msgr2=0x7f99fc11eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f9a00b5a700 1 --2- 172.21.15.72:0/2041205454 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99fc09de50 0x7f99fc11eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f9a00b5a700 1 -- 172.21.15.72:0/2041205454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc09e760 msgr2=0x7f99fc11f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f9a00b5a700 1 --2- 172.21.15.72:0/2041205454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc09e760 0x7f99fc11f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f9a00b5a700 1 -- 172.21.15.72:0/2041205454 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f0009550 con 0x7f99fc1338a0 2023-10-03T10:14:26.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.176+0000 7f99fbfff700 1 --2- 172.21.15.72:0/2041205454 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99fc09de50 0x7f99fc11eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:26.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.177+0000 7f9a00b5a700 1 --2- 172.21.15.72:0/2041205454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99fc1338a0 0x7f99fc11f600 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f99f400cb10 tx=0x7f99f400ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:26.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.177+0000 7f99f8ff9700 1 -- 172.21.15.72:0/2041205454 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400aaa0 con 0x7f99fc1338a0 2023-10-03T10:14:26.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.177+0000 7f99f8ff9700 1 -- 172.21.15.72:0/2041205454 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f400ac00 con 0x7f99fc1338a0 2023-10-03T10:14:26.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.177+0000 7f9a025bd700 1 -- 172.21.15.72:0/2041205454 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99fc06f640 con 0x7f99fc1338a0 2023-10-03T10:14:26.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.177+0000 7f99f8ff9700 1 -- 172.21.15.72:0/2041205454 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4007070 con 0x7f99fc1338a0 2023-10-03T10:14:26.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.177+0000 7f9a025bd700 1 -- 172.21.15.72:0/2041205454 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc122610 con 0x7f99fc1338a0 2023-10-03T10:14:26.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.177+0000 7f99f8ff9700 1 -- 172.21.15.72:0/2041205454 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99f40071d0 con 0x7f99fc1338a0 2023-10-03T10:14:26.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.178+0000 7fd9fb429700 1 -- 172.21.15.72:0/2604131899 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd9f4074ea0 con 0x7fd9f409e000 2023-10-03T10:14:26.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.178+0000 7f99f8ff9700 1 -- 172.21.15.72:0/2041205454 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f99f403f3b0 con 0x7f99fc1338a0 2023-10-03T10:14:26.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.178+0000 7f9a025bd700 1 -- 172.21.15.72:0/2041205454 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc074ea0 con 0x7f99fc1338a0 2023-10-03T10:14:26.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.178+0000 7fd9e9ffb700 1 -- 172.21.15.72:0/2604131899 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9f0015020 con 0x7fd9f409e000 2023-10-03T10:14:26.183 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:26.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.180+0000 7fd9fb429700 1 -- 172.21.15.72:0/2604131899 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9f409e000 msgr2=0x7fd9f411e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.180+0000 7fd9fb429700 1 --2- 172.21.15.72:0/2604131899 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9f409e000 0x7fd9f411e460 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0016000 tx=0x7fd9f0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:26.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.181+0000 7fd9fb429700 1 -- 172.21.15.72:0/2604131899 shutdown_connections 2023-10-03T10:14:26.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.181+0000 7fd9fb429700 1 --2- 172.21.15.72:0/2604131899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9f409d6f0 0x7fd9f411df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.181+0000 7fd9fb429700 1 --2- 172.21.15.72:0/2604131899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd9f409e410 0x7fd9f411e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.181+0000 7fd9fb429700 1 --2- 172.21.15.72:0/2604131899 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd9f409e000 0x7fd9f411e460 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.181+0000 7fd9fb429700 1 -- 172.21.15.72:0/2604131899 >> 172.21.15.72:0/2604131899 conn(0x7fd9f4066f50 msgr2=0x7fd9f406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.181+0000 7fd9fb429700 1 -- 172.21.15.72:0/2604131899 shutdown_connections 2023-10-03T10:14:26.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.181+0000 7fd9fb429700 1 -- 172.21.15.72:0/2604131899 wait complete. 2023-10-03T10:14:26.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.183+0000 7f99f8ff9700 1 -- 172.21.15.72:0/2041205454 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99f4017020 con 0x7f99fc1338a0 2023-10-03T10:14:26.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:26.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.287+0000 7f242be4f700 1 Processor -- start 2023-10-03T10:14:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.287+0000 7f242be4f700 1 -- start start 2023-10-03T10:14:26.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f242be4f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24241316c0 0x7f2424131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f242be4f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f242409d9f0 0x7f242406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f242be4f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f242406acb0 0x7f242406b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f242be4f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242406b630 con 0x7f242409d9f0 2023-10-03T10:14:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f242be4f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242409e130 con 0x7f24241316c0 2023-10-03T10:14:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f242be4f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24241312b0 con 0x7f242406acb0 2023-10-03T10:14:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f24293ea700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f242409d9f0 0x7f242406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f24293ea700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f242409d9f0 0x7f242406a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42892/0 (socket says 172.21.15.72:42892) 2023-10-03T10:14:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f24293ea700 1 -- 172.21.15.72:0/1910649282 learned_addr learned my addr 172.21.15.72:0/1910649282 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:26.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f2429beb700 1 --2- 172.21.15.72:0/1910649282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24241316c0 0x7f2424131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f242a3ec700 1 --2- 172.21.15.72:0/1910649282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f242406acb0 0x7f242406b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f24293ea700 1 -- 172.21.15.72:0/1910649282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f242406acb0 msgr2=0x7f242406b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:26.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f24293ea700 1 --2- 172.21.15.72:0/1910649282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f242406acb0 0x7f242406b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f24293ea700 1 -- 172.21.15.72:0/1910649282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24241316c0 msgr2=0x7f2424131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:26.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f24293ea700 1 --2- 172.21.15.72:0/1910649282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24241316c0 0x7f2424131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f24293ea700 1 -- 172.21.15.72:0/1910649282 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242409f6e0 con 0x7f242409d9f0 2023-10-03T10:14:26.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.288+0000 7f2429beb700 1 --2- 172.21.15.72:0/1910649282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24241316c0 0x7f2424131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:26.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.289+0000 7f24293ea700 1 --2- 172.21.15.72:0/1910649282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f242409d9f0 0x7f242406a770 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f24140098f0 tx=0x7f2414009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9484676cb09298 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.289+0000 7f2428be9700 1 -- 172.21.15.72:0/1910649282 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414011830 con 0x7f242409d9f0 2023-10-03T10:14:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.289+0000 7f2428be9700 1 -- 172.21.15.72:0/1910649282 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2414011990 con 0x7f242409d9f0 2023-10-03T10:14:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.289+0000 7f2428be9700 1 -- 172.21.15.72:0/1910649282 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414011d20 con 0x7f242409d9f0 2023-10-03T10:14:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.289+0000 7f242be4f700 1 -- 172.21.15.72:0/1910649282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f242409d9f0 msgr2=0x7f242406a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.289+0000 7f242be4f700 1 --2- 172.21.15.72:0/1910649282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f242409d9f0 0x7f242406a770 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f24140098f0 tx=0x7f2414009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.289+0000 7f242be4f700 1 -- 172.21.15.72:0/1910649282 shutdown_connections 2023-10-03T10:14:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.289+0000 7f242be4f700 1 --2- 172.21.15.72:0/1910649282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f242406acb0 0x7f242406b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.289+0000 7f242be4f700 1 --2- 172.21.15.72:0/1910649282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24241316c0 0x7f2424131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.289+0000 7f242be4f700 1 --2- 172.21.15.72:0/1910649282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f242409d9f0 0x7f242406a770 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.289+0000 7f242be4f700 1 -- 172.21.15.72:0/1910649282 >> 172.21.15.72:0/1910649282 conn(0x7f2424066f50 msgr2=0x7f242409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.290+0000 7f242be4f700 1 -- 172.21.15.72:0/1910649282 shutdown_connections 2023-10-03T10:14:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.290+0000 7f242be4f700 1 -- 172.21.15.72:0/1910649282 wait complete. 2023-10-03T10:14:26.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.290+0000 7f242be4f700 1 Processor -- start 2023-10-03T10:14:26.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f242be4f700 1 -- start start 2023-10-03T10:14:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f242be4f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f242406acb0 0x7f242409a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f242be4f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f242409d9f0 0x7f242409a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f242be4f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24241316c0 0x7f242409ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f242be4f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242412b900 con 0x7f242406acb0 2023-10-03T10:14:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f242be4f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2424128200 con 0x7f24241316c0 2023-10-03T10:14:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f242be4f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2424071870 con 0x7f242409d9f0 2023-10-03T10:14:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f2429beb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f242406acb0 0x7f242409a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f24293ea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f242409d9f0 0x7f242409a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f2429beb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f242406acb0 0x7f242409a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42900/0 (socket says 172.21.15.72:42900) 2023-10-03T10:14:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f24293ea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f242409d9f0 0x7f242409a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46130/0 (socket says 172.21.15.72:46130) 2023-10-03T10:14:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f2429beb700 1 -- 172.21.15.72:0/1222240716 learned_addr learned my addr 172.21.15.72:0/1222240716 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f2429beb700 1 -- 172.21.15.72:0/1222240716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f242409d9f0 msgr2=0x7f242409a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f2429beb700 1 --2- 172.21.15.72:0/1222240716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f242409d9f0 0x7f242409a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f2429beb700 1 -- 172.21.15.72:0/1222240716 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24241316c0 msgr2=0x7f242409ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f2429beb700 1 --2- 172.21.15.72:0/1222240716 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24241316c0 0x7f242409ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.291+0000 7f2429beb700 1 -- 172.21.15.72:0/1222240716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24200094a0 con 0x7f242406acb0 2023-10-03T10:14:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.292+0000 7f2429beb700 1 --2- 172.21.15.72:0/1222240716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f242406acb0 0x7f242409a400 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f242000ebe0 tx=0x7f242000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.292+0000 7f241a7fc700 1 -- 172.21.15.72:0/1222240716 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420009800 con 0x7f242406acb0 2023-10-03T10:14:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.292+0000 7f241a7fc700 1 -- 172.21.15.72:0/1222240716 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242000c890 con 0x7f242406acb0 2023-10-03T10:14:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.292+0000 7f242be4f700 1 -- 172.21.15.72:0/1222240716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2414009550 con 0x7f242406acb0 2023-10-03T10:14:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.292+0000 7f241a7fc700 1 -- 172.21.15.72:0/1222240716 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000cc00 con 0x7f242406acb0 2023-10-03T10:14:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.292+0000 7f242be4f700 1 -- 172.21.15.72:0/1222240716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24240725a0 con 0x7f242406acb0 2023-10-03T10:14:26.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.293+0000 7f241a7fc700 1 -- 172.21.15.72:0/1222240716 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f242000cd60 con 0x7f242406acb0 2023-10-03T10:14:26.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.293+0000 7f241a7fc700 1 -- 172.21.15.72:0/1222240716 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f242003fae0 con 0x7f242406acb0 2023-10-03T10:14:26.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.293+0000 7f242be4f700 1 -- 172.21.15.72:0/1222240716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2424074ea0 con 0x7f242406acb0 2023-10-03T10:14:26.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.302+0000 7f241a7fc700 1 -- 172.21.15.72:0/1222240716 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f242001adc0 con 0x7f242406acb0 2023-10-03T10:14:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.314+0000 7f8a1cc9e700 1 Processor -- start 2023-10-03T10:14:26.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.314+0000 7f8a1cc9e700 1 -- start start 2023-10-03T10:14:26.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.315+0000 7f8a1cc9e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a1809e930 0x7f8a1809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.315+0000 7f8a1cc9e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a1809f240 0x7f8a181317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.315+0000 7f8a1cc9e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a1809f650 0x7f8a18131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.315+0000 7f8a1cc9e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a18070940 con 0x7f8a1809f650 2023-10-03T10:14:26.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.315+0000 7f8a1cc9e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1806fd60 con 0x7f8a1809e930 2023-10-03T10:14:26.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.315+0000 7f8a1cc9e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1806fa80 con 0x7f8a1809f240 2023-10-03T10:14:26.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.316+0000 7f8a1659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a1809e930 0x7f8a1809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.316+0000 7f8a1659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a1809e930 0x7f8a1809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45028/0 (socket says 172.21.15.72:45028) 2023-10-03T10:14:26.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.316+0000 7f8a1659c700 1 -- 172.21.15.72:0/2783153046 learned_addr learned my addr 172.21.15.72:0/2783153046 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:26.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.316+0000 7f8a15d9b700 1 --2- 172.21.15.72:0/2783153046 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a1809f240 0x7f8a181317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.316+0000 7f8a16d9d700 1 --2- 172.21.15.72:0/2783153046 >> v2:172.21.15.72:3300/0 conn(0x7f8a1809f650 0x7f8a18131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.316+0000 7f8a1659c700 1 -- 172.21.15.72:0/2783153046 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a1809f240 msgr2=0x7f8a181317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:26.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.316+0000 7f8a1659c700 1 --2- 172.21.15.72:0/2783153046 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a1809f240 0x7f8a181317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.316+0000 7f8a1659c700 1 -- 172.21.15.72:0/2783153046 >> v2:172.21.15.72:3300/0 conn(0x7f8a1809f650 msgr2=0x7f8a18131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:26.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.316+0000 7f8a1659c700 1 --2- 172.21.15.72:0/2783153046 >> v2:172.21.15.72:3300/0 conn(0x7f8a1809f650 0x7f8a18131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.316+0000 7f8a1659c700 1 -- 172.21.15.72:0/2783153046 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1809fb60 con 0x7f8a1809e930 2023-10-03T10:14:26.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.316+0000 7f8a16d9d700 1 --2- 172.21.15.72:0/2783153046 >> v2:172.21.15.72:3300/0 conn(0x7f8a1809f650 0x7f8a18131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:26.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.316+0000 7f8a1659c700 1 --2- 172.21.15.72:0/2783153046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a1809e930 0x7f8a1809ed00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8a080098f0 tx=0x7f8a08009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b8f63bb377cd928 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:26.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.316+0000 7f8a1559a700 1 -- 172.21.15.72:0/2783153046 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a08011830 con 0x7f8a1809e930 2023-10-03T10:14:26.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.316+0000 7f8a1559a700 1 -- 172.21.15.72:0/2783153046 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a08011990 con 0x7f8a1809e930 2023-10-03T10:14:26.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.316+0000 7f8a1559a700 1 -- 172.21.15.72:0/2783153046 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a08011d20 con 0x7f8a1809e930 2023-10-03T10:14:26.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.317+0000 7f8a1cc9e700 1 -- 172.21.15.72:0/2783153046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a1809e930 msgr2=0x7f8a1809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.317+0000 7f8a1cc9e700 1 --2- 172.21.15.72:0/2783153046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a1809e930 0x7f8a1809ed00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8a080098f0 tx=0x7f8a08009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:26.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.317+0000 7f8a1cc9e700 1 -- 172.21.15.72:0/2783153046 shutdown_connections 2023-10-03T10:14:26.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.317+0000 7f8a1cc9e700 1 --2- 172.21.15.72:0/2783153046 >> v2:172.21.15.72:3300/0 conn(0x7f8a1809f650 0x7f8a18131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.317+0000 7f8a1cc9e700 1 --2- 172.21.15.72:0/2783153046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a1809e930 0x7f8a1809ed00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.317+0000 7f8a1cc9e700 1 --2- 172.21.15.72:0/2783153046 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a1809f240 0x7f8a181317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.317+0000 7f8a1cc9e700 1 -- 172.21.15.72:0/2783153046 >> 172.21.15.72:0/2783153046 conn(0x7f8a180a4210 msgr2=0x7f8a180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.317+0000 7f8a1cc9e700 1 -- 172.21.15.72:0/2783153046 shutdown_connections 2023-10-03T10:14:26.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.317+0000 7f8a1cc9e700 1 -- 172.21.15.72:0/2783153046 wait complete. 2023-10-03T10:14:26.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.318+0000 7f8a1cc9e700 1 Processor -- start 2023-10-03T10:14:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.318+0000 7f8a1cc9e700 1 -- start start 2023-10-03T10:14:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a1cc9e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a1809e930 0x7f8a1806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a1cc9e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a1809f240 0x7f8a1806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a1cc9e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1809f650 0x7f8a1806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a1cc9e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a181a89e0 con 0x7f8a1809f650 2023-10-03T10:14:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a1cc9e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a181a8170 con 0x7f8a1809e930 2023-10-03T10:14:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a1cc9e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a181b6290 con 0x7f8a1809f240 2023-10-03T10:14:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a15d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a1809f240 0x7f8a1806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a15d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a1809f240 0x7f8a1806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46158/0 (socket says 172.21.15.72:46158) 2023-10-03T10:14:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a15d9b700 1 -- 172.21.15.72:0/3481447594 learned_addr learned my addr 172.21.15.72:0/3481447594 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a1659c700 1 --2- 172.21.15.72:0/3481447594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a1809e930 0x7f8a1806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a16d9d700 1 --2- 172.21.15.72:0/3481447594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1809f650 0x7f8a1806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a15d9b700 1 -- 172.21.15.72:0/3481447594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a1809e930 msgr2=0x7f8a1806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a15d9b700 1 --2- 172.21.15.72:0/3481447594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a1809e930 0x7f8a1806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a15d9b700 1 -- 172.21.15.72:0/3481447594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1809f650 msgr2=0x7f8a1806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a15d9b700 1 --2- 172.21.15.72:0/3481447594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1809f650 0x7f8a1806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a15d9b700 1 -- 172.21.15.72:0/3481447594 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a10009a70 con 0x7f8a1809f240 2023-10-03T10:14:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a16d9d700 1 --2- 172.21.15.72:0/3481447594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1809f650 0x7f8a1806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a15d9b700 1 --2- 172.21.15.72:0/3481447594 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a1809f240 0x7f8a1806bdf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00e900 tx=0x7f8a0c00ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.319+0000 7f8a06ffd700 1 -- 172.21.15.72:0/3481447594 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c013680 con 0x7f8a1809f240 2023-10-03T10:14:26.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.320+0000 7f8a06ffd700 1 -- 172.21.15.72:0/3481447594 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c0137e0 con 0x7f8a1809f240 2023-10-03T10:14:26.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.320+0000 7f8a1cc9e700 1 -- 172.21.15.72:0/3481447594 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a08009550 con 0x7f8a1809f240 2023-10-03T10:14:26.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.320+0000 7f8a06ffd700 1 -- 172.21.15.72:0/3481447594 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c013b70 con 0x7f8a1809f240 2023-10-03T10:14:26.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.320+0000 7f8a1cc9e700 1 -- 172.21.15.72:0/3481447594 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a180a0190 con 0x7f8a1809f240 2023-10-03T10:14:26.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.320+0000 7f8a1cc9e700 1 -- 172.21.15.72:0/3481447594 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a180a3580 con 0x7f8a1809f240 2023-10-03T10:14:26.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.321+0000 7f8a06ffd700 1 -- 172.21.15.72:0/3481447594 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a0c013cd0 con 0x7f8a1809f240 2023-10-03T10:14:26.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.321+0000 7f8a06ffd700 1 -- 172.21.15.72:0/3481447594 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8a0c03f9d0 con 0x7f8a1809f240 2023-10-03T10:14:26.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.330+0000 7f8a06ffd700 1 -- 172.21.15.72:0/3481447594 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a0c011bd0 con 0x7f8a1809f240 2023-10-03T10:14:26.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.389+0000 7f9a025bd700 1 -- 172.21.15.72:0/2041205454 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f99fc06b9e0 con 0x7f99fc1338a0 2023-10-03T10:14:26.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.389+0000 7f99f8ff9700 1 -- 172.21.15.72:0/2041205454 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f99f401b3b0 con 0x7f99fc1338a0 2023-10-03T10:14:26.390 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:26.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.391+0000 7f9a025bd700 1 -- 172.21.15.72:0/2041205454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99fc1338a0 msgr2=0x7f99fc11f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.391+0000 7f9a025bd700 1 --2- 172.21.15.72:0/2041205454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99fc1338a0 0x7f99fc11f600 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f99f400cb10 tx=0x7f99f400ce20 comp rx=0 tx=0).stop 2023-10-03T10:14:26.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.391+0000 7f9a025bd700 1 -- 172.21.15.72:0/2041205454 shutdown_connections 2023-10-03T10:14:26.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.391+0000 7f9a025bd700 1 --2- 172.21.15.72:0/2041205454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99fc1338a0 0x7f99fc11f600 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.391+0000 7f9a025bd700 1 --2- 172.21.15.72:0/2041205454 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99fc09de50 0x7f99fc11eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.391+0000 7f9a025bd700 1 --2- 172.21.15.72:0/2041205454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99fc09e760 0x7f99fc11f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.391+0000 7f9a025bd700 1 -- 172.21.15.72:0/2041205454 >> 172.21.15.72:0/2041205454 conn(0x7f99fc0a2aa0 msgr2=0x7f99fc09ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.391+0000 7f9a025bd700 1 -- 172.21.15.72:0/2041205454 shutdown_connections 2023-10-03T10:14:26.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.391+0000 7f9a025bd700 1 -- 172.21.15.72:0/2041205454 wait complete. 2023-10-03T10:14:26.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:26.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.496+0000 7f242be4f700 1 -- 172.21.15.72:0/1222240716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f242409e980 con 0x7f242406acb0 2023-10-03T10:14:26.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.497+0000 7f241a7fc700 1 -- 172.21.15.72:0/1222240716 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2420021030 con 0x7f242406acb0 2023-10-03T10:14:26.498 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:26.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.499+0000 7f242be4f700 1 -- 172.21.15.72:0/1222240716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f242406acb0 msgr2=0x7f242409a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.499+0000 7f242be4f700 1 --2- 172.21.15.72:0/1222240716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f242406acb0 0x7f242409a400 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f242000ebe0 tx=0x7f242000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.499+0000 7f242be4f700 1 -- 172.21.15.72:0/1222240716 shutdown_connections 2023-10-03T10:14:26.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.499+0000 7f242be4f700 1 --2- 172.21.15.72:0/1222240716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f242406acb0 0x7f242409a400 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.499+0000 7f242be4f700 1 --2- 172.21.15.72:0/1222240716 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24241316c0 0x7f242409ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.499+0000 7f242be4f700 1 --2- 172.21.15.72:0/1222240716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f242409d9f0 0x7f242409a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.499+0000 7f242be4f700 1 -- 172.21.15.72:0/1222240716 >> 172.21.15.72:0/1222240716 conn(0x7f2424066f50 msgr2=0x7f242412b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.499+0000 7f242be4f700 1 -- 172.21.15.72:0/1222240716 shutdown_connections 2023-10-03T10:14:26.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.499+0000 7f242be4f700 1 -- 172.21.15.72:0/1222240716 wait complete. 2023-10-03T10:14:26.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:26.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.525+0000 7f8a1cc9e700 1 -- 172.21.15.72:0/3481447594 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8a18071d20 con 0x7f8a1809f240 2023-10-03T10:14:26.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.526+0000 7f8a06ffd700 1 -- 172.21.15.72:0/3481447594 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8a0c017030 con 0x7f8a1809f240 2023-10-03T10:14:26.527 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:26.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.528+0000 7f8a1cc9e700 1 -- 172.21.15.72:0/3481447594 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a1809f240 msgr2=0x7f8a1806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.528+0000 7f8a1cc9e700 1 --2- 172.21.15.72:0/3481447594 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a1809f240 0x7f8a1806bdf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00e900 tx=0x7f8a0c00ec10 comp rx=0 tx=0).stop 2023-10-03T10:14:26.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.528+0000 7f8a1cc9e700 1 -- 172.21.15.72:0/3481447594 shutdown_connections 2023-10-03T10:14:26.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.528+0000 7f8a1cc9e700 1 --2- 172.21.15.72:0/3481447594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1809f650 0x7f8a1806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.528+0000 7f8a1cc9e700 1 --2- 172.21.15.72:0/3481447594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a1809e930 0x7f8a1806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.528+0000 7f8a1cc9e700 1 --2- 172.21.15.72:0/3481447594 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a1809f240 0x7f8a1806bdf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.528+0000 7f8a1cc9e700 1 -- 172.21.15.72:0/3481447594 >> 172.21.15.72:0/3481447594 conn(0x7f8a180a4210 msgr2=0x7f8a1809c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.528+0000 7f8a1cc9e700 1 -- 172.21.15.72:0/3481447594 shutdown_connections 2023-10-03T10:14:26.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:26.528+0000 7f8a1cc9e700 1 -- 172.21.15.72:0/3481447594 wait complete. 2023-10-03T10:14:26.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:27.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.329+0000 7f35e9585700 1 Processor -- start 2023-10-03T10:14:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.329+0000 7f35e9585700 1 -- start start 2023-10-03T10:14:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e9585700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35e40a09c0 0x7f35e40a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e9585700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35e409d5c0 0x7f35e40a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e9585700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e40a1810 con 0x7f35e4133920 2023-10-03T10:14:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e9585700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e409ea10 con 0x7f35e409d5c0 2023-10-03T10:14:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e9585700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e409e210 con 0x7f35e40a09c0 2023-10-03T10:14:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35e40a09c0 0x7f35e40a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e27fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35e409d5c0 0x7f35e40a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e27fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35e409d5c0 0x7f35e40a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42944/0 (socket says 172.21.15.72:42944) 2023-10-03T10:14:27.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35e40a09c0 0x7f35e40a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45044/0 (socket says 172.21.15.72:45044) 2023-10-03T10:14:27.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e27fc700 1 -- 172.21.15.72:0/855907665 learned_addr learned my addr 172.21.15.72:0/855907665 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:27.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e2ffd700 1 -- 172.21.15.72:0/855907665 >> v2:172.21.15.72:3300/0 conn(0x7f35e409d5c0 msgr2=0x7f35e40a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e2ffd700 1 --2- 172.21.15.72:0/855907665 >> v2:172.21.15.72:3300/0 conn(0x7f35e409d5c0 0x7f35e40a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e2ffd700 1 -- 172.21.15.72:0/855907665 >> v1:172.21.15.72:6789/0 conn(0x7f35e4133920 legacy=0x7f35e4133da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e2ffd700 1 -- 172.21.15.72:0/855907665 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e40a26f0 con 0x7f35e40a09c0 2023-10-03T10:14:27.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e27fc700 1 --2- 172.21.15.72:0/855907665 >> v2:172.21.15.72:3300/0 conn(0x7f35e409d5c0 0x7f35e40a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.330+0000 7f35e2ffd700 1 --2- 172.21.15.72:0/855907665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35e40a09c0 0x7f35e40a0d90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009840 tx=0x7f35dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33d6463da1e343c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.331+0000 7f35e1ffb700 1 -- 172.21.15.72:0/855907665 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc011830 con 0x7f35e40a09c0 2023-10-03T10:14:27.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.331+0000 7f35e1ffb700 1 -- 172.21.15.72:0/855907665 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc011990 con 0x7f35e40a09c0 2023-10-03T10:14:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.331+0000 7f35e1ffb700 1 -- 172.21.15.72:0/855907665 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc011d20 con 0x7f35e40a09c0 2023-10-03T10:14:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.331+0000 7f35e9585700 1 -- 172.21.15.72:0/855907665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35e40a09c0 msgr2=0x7f35e40a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.331+0000 7f35e9585700 1 --2- 172.21.15.72:0/855907665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35e40a09c0 0x7f35e40a0d90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009840 tx=0x7f35dc009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.331+0000 7f35e9585700 1 -- 172.21.15.72:0/855907665 shutdown_connections 2023-10-03T10:14:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.331+0000 7f35e9585700 1 --2- 172.21.15.72:0/855907665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35e40a09c0 0x7f35e40a0d90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.331+0000 7f35e9585700 1 --2- 172.21.15.72:0/855907665 >> v2:172.21.15.72:3300/0 conn(0x7f35e409d5c0 0x7f35e40a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.331+0000 7f35e9585700 1 -- 172.21.15.72:0/855907665 >> 172.21.15.72:0/855907665 conn(0x7f35e40a2fe0 msgr2=0x7f35e40a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.331+0000 7f35e9585700 1 -- 172.21.15.72:0/855907665 shutdown_connections 2023-10-03T10:14:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.331+0000 7f35e9585700 1 -- 172.21.15.72:0/855907665 wait complete. 2023-10-03T10:14:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.332+0000 7f35e9585700 1 Processor -- start 2023-10-03T10:14:27.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.332+0000 7f35e9585700 1 -- start start 2023-10-03T10:14:27.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e9585700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35e409d5c0 0x7f35e411f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e9585700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35e40a09c0 0x7f35e411fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e9585700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e4133920 0x7f35e41c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e9585700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e41225e0 con 0x7f35e4133920 2023-10-03T10:14:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e9585700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e411eec0 con 0x7f35e409d5c0 2023-10-03T10:14:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e9585700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35e41205d0 con 0x7f35e40a09c0 2023-10-03T10:14:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35e40a09c0 0x7f35e411fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e4133920 0x7f35e41c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35e40a09c0 0x7f35e411fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46162/0 (socket says 172.21.15.72:46162) 2023-10-03T10:14:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e27fc700 1 -- 172.21.15.72:0/340707691 learned_addr learned my addr 172.21.15.72:0/340707691 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e2ffd700 1 --2- 172.21.15.72:0/340707691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35e409d5c0 0x7f35e411f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e37fe700 1 -- 172.21.15.72:0/340707691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35e40a09c0 msgr2=0x7f35e411fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e37fe700 1 --2- 172.21.15.72:0/340707691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35e40a09c0 0x7f35e411fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e37fe700 1 -- 172.21.15.72:0/340707691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35e409d5c0 msgr2=0x7f35e411f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e37fe700 1 --2- 172.21.15.72:0/340707691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35e409d5c0 0x7f35e411f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e37fe700 1 -- 172.21.15.72:0/340707691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc009550 con 0x7f35e4133920 2023-10-03T10:14:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e27fc700 1 --2- 172.21.15.72:0/340707691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35e40a09c0 0x7f35e411fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e2ffd700 1 --2- 172.21.15.72:0/340707691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35e409d5c0 0x7f35e411f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35e37fe700 1 --2- 172.21.15.72:0/340707691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e4133920 0x7f35e41c8110 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f35d400cb90 tx=0x7f35d400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.333+0000 7f35db7fe700 1 -- 172.21.15.72:0/340707691 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4003c00 con 0x7f35e4133920 2023-10-03T10:14:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.334+0000 7f35db7fe700 1 -- 172.21.15.72:0/340707691 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d4003d60 con 0x7f35e4133920 2023-10-03T10:14:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.334+0000 7f35db7fe700 1 -- 172.21.15.72:0/340707691 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d400aa80 con 0x7f35e4133920 2023-10-03T10:14:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.334+0000 7f35e9585700 1 -- 172.21.15.72:0/340707691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35dc0094a0 con 0x7f35e4133920 2023-10-03T10:14:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.334+0000 7f35e9585700 1 -- 172.21.15.72:0/340707691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e409cec0 con 0x7f35e4133920 2023-10-03T10:14:27.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.334+0000 7f35db7fe700 1 -- 172.21.15.72:0/340707691 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f35d400abe0 con 0x7f35e4133920 2023-10-03T10:14:27.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.334+0000 7f35e9585700 1 -- 172.21.15.72:0/340707691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e40747f0 con 0x7f35e4133920 2023-10-03T10:14:27.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.334+0000 7f35db7fe700 1 -- 172.21.15.72:0/340707691 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f35d403f500 con 0x7f35e4133920 2023-10-03T10:14:27.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.339+0000 7f35db7fe700 1 -- 172.21.15.72:0/340707691 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35d40198f0 con 0x7f35e4133920 2023-10-03T10:14:27.406 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:27.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.529+0000 7f3d8cf9e700 1 Processor -- start 2023-10-03T10:14:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.529+0000 7f3d8cf9e700 1 -- start start 2023-10-03T10:14:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.529+0000 7f3d8cf9e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d8809e670 0x7f3d8809ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.529+0000 7f3d8cf9e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d88131cf0 0x7f3d881398b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.529+0000 7f3d8cf9e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8809ff50 con 0x7f3d8809ef80 2023-10-03T10:14:27.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.529+0000 7f3d8cf9e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8809bb90 con 0x7f3d8809e670 2023-10-03T10:14:27.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.529+0000 7f3d8cf9e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8809b510 con 0x7f3d88131cf0 2023-10-03T10:14:27.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.529+0000 7f3d877fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d8809e670 0x7f3d8809ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.529+0000 7f3d877fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d8809e670 0x7f3d8809ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42950/0 (socket says 172.21.15.72:42950) 2023-10-03T10:14:27.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.529+0000 7f3d877fe700 1 -- 172.21.15.72:0/4210157405 learned_addr learned my addr 172.21.15.72:0/4210157405 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:27.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.529+0000 7f3d87fff700 1 --2- 172.21.15.72:0/4210157405 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d88131cf0 0x7f3d881398b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.529+0000 7f3d86ffd700 1 --1- 172.21.15.72:0/4210157405 >> v1:172.21.15.72:6789/0 conn(0x7f3d8809ef80 0x7f3d881315e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39260/0 (socket says 172.21.15.72:39260) 2023-10-03T10:14:27.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.530+0000 7f3d877fe700 1 -- 172.21.15.72:0/4210157405 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d88131cf0 msgr2=0x7f3d881398b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.530+0000 7f3d877fe700 1 --2- 172.21.15.72:0/4210157405 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d88131cf0 0x7f3d881398b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.530+0000 7f3d877fe700 1 -- 172.21.15.72:0/4210157405 >> v1:172.21.15.72:6789/0 conn(0x7f3d8809ef80 legacy=0x7f3d881315e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.530+0000 7f3d877fe700 1 -- 172.21.15.72:0/4210157405 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d880a0360 con 0x7f3d8809e670 2023-10-03T10:14:27.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.530+0000 7f3d87fff700 1 --2- 172.21.15.72:0/4210157405 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d88131cf0 0x7f3d881398b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.530+0000 7f3d877fe700 1 --2- 172.21.15.72:0/4210157405 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d8809e670 0x7f3d8809ea40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3d780098f0 tx=0x7f3d78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a40871f3bcc9a99 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.530+0000 7f3d867fc700 1 -- 172.21.15.72:0/4210157405 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78011830 con 0x7f3d8809e670 2023-10-03T10:14:27.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.530+0000 7f3d867fc700 1 -- 172.21.15.72:0/4210157405 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d78011990 con 0x7f3d8809e670 2023-10-03T10:14:27.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.530+0000 7f3d867fc700 1 -- 172.21.15.72:0/4210157405 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78011d20 con 0x7f3d8809e670 2023-10-03T10:14:27.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.531+0000 7f3d8cf9e700 1 -- 172.21.15.72:0/4210157405 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d8809e670 msgr2=0x7f3d8809ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.531+0000 7f3d8cf9e700 1 --2- 172.21.15.72:0/4210157405 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d8809e670 0x7f3d8809ea40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3d780098f0 tx=0x7f3d78009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:27.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.531+0000 7f3d8cf9e700 1 -- 172.21.15.72:0/4210157405 shutdown_connections 2023-10-03T10:14:27.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.531+0000 7f3d8cf9e700 1 --2- 172.21.15.72:0/4210157405 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d88131cf0 0x7f3d881398b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.531+0000 7f3d8cf9e700 1 --2- 172.21.15.72:0/4210157405 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d8809e670 0x7f3d8809ea40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.531+0000 7f3d8cf9e700 1 -- 172.21.15.72:0/4210157405 >> 172.21.15.72:0/4210157405 conn(0x7f3d880a0c90 msgr2=0x7f3d880a1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.531+0000 7f3d8cf9e700 1 -- 172.21.15.72:0/4210157405 shutdown_connections 2023-10-03T10:14:27.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.531+0000 7f3d8cf9e700 1 -- 172.21.15.72:0/4210157405 wait complete. 2023-10-03T10:14:27.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.532+0000 7f3d8cf9e700 1 Processor -- start 2023-10-03T10:14:27.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.532+0000 7f3d8cf9e700 1 -- start start 2023-10-03T10:14:27.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.532+0000 7f3d8cf9e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d8809e670 0x7f3d881c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.532+0000 7f3d8cf9e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d8809ef80 0x7f3d881c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.532+0000 7f3d8cf9e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d88131cf0 0x7f3d881c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.532+0000 7f3d8cf9e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8806d4c0 con 0x7f3d8809e670 2023-10-03T10:14:27.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.532+0000 7f3d8cf9e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88125b60 con 0x7f3d88131cf0 2023-10-03T10:14:27.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.532+0000 7f3d8cf9e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d88131550 con 0x7f3d8809ef80 2023-10-03T10:14:27.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d86ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d8809ef80 0x7f3d881c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d87fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d88131cf0 0x7f3d881c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d86ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d8809ef80 0x7f3d881c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46172/0 (socket says 172.21.15.72:46172) 2023-10-03T10:14:27.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d86ffd700 1 -- 172.21.15.72:0/397652674 learned_addr learned my addr 172.21.15.72:0/397652674 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:27.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d877fe700 1 --2- 172.21.15.72:0/397652674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d8809e670 0x7f3d881c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d86ffd700 1 -- 172.21.15.72:0/397652674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d88131cf0 msgr2=0x7f3d881c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d86ffd700 1 --2- 172.21.15.72:0/397652674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d88131cf0 0x7f3d881c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d86ffd700 1 -- 172.21.15.72:0/397652674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d8809e670 msgr2=0x7f3d881c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d86ffd700 1 --2- 172.21.15.72:0/397652674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d8809e670 0x7f3d881c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d86ffd700 1 -- 172.21.15.72:0/397652674 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80009a70 con 0x7f3d8809ef80 2023-10-03T10:14:27.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d87fff700 1 --2- 172.21.15.72:0/397652674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d88131cf0 0x7f3d881c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d877fe700 1 --2- 172.21.15.72:0/397652674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d8809e670 0x7f3d881c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d86ffd700 1 --2- 172.21.15.72:0/397652674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d8809ef80 0x7f3d881c8530 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00c520 tx=0x7f3d7c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f35e9585700 1 -- 172.21.15.72:0/340707691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f35e4133470 con 0x7f35e4133920 2023-10-03T10:14:27.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d6ffff700 1 -- 172.21.15.72:0/397652674 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c005cb0 con 0x7f3d8809ef80 2023-10-03T10:14:27.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d6ffff700 1 -- 172.21.15.72:0/397652674 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c005e10 con 0x7f3d8809ef80 2023-10-03T10:14:27.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d8cf9e700 1 -- 172.21.15.72:0/397652674 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d78009550 con 0x7f3d8809ef80 2023-10-03T10:14:27.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d6ffff700 1 -- 172.21.15.72:0/397652674 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0072d0 con 0x7f3d8809ef80 2023-10-03T10:14:27.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.533+0000 7f3d8cf9e700 1 -- 172.21.15.72:0/397652674 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d88126190 con 0x7f3d8809ef80 2023-10-03T10:14:27.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.534+0000 7f3d6ffff700 1 -- 172.21.15.72:0/397652674 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d7c007430 con 0x7f3d8809ef80 2023-10-03T10:14:27.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.534+0000 7f35db7fe700 1 -- 172.21.15.72:0/340707691 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35d4019300 con 0x7f35e4133920 2023-10-03T10:14:27.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.534+0000 7f3d6ffff700 1 -- 172.21.15.72:0/397652674 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3d7c03ea50 con 0x7f3d8809ef80 2023-10-03T10:14:27.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.534+0000 7f3d8cf9e700 1 -- 172.21.15.72:0/397652674 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d88124ec0 con 0x7f3d8809ef80 2023-10-03T10:14:27.550 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:27.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:27.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.537+0000 7f35e9585700 1 -- 172.21.15.72:0/340707691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e4133920 msgr2=0x7f35e41c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.537+0000 7f35e9585700 1 --2- 172.21.15.72:0/340707691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e4133920 0x7f35e41c8110 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f35d400cb90 tx=0x7f35d400cea0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.538+0000 7f35e9585700 1 -- 172.21.15.72:0/340707691 shutdown_connections 2023-10-03T10:14:27.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.538+0000 7f35e9585700 1 --2- 172.21.15.72:0/340707691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35e4133920 0x7f35e41c8110 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.538+0000 7f35e9585700 1 --2- 172.21.15.72:0/340707691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35e409d5c0 0x7f35e411f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.538+0000 7f35e9585700 1 --2- 172.21.15.72:0/340707691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35e40a09c0 0x7f35e411fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.538+0000 7f35e9585700 1 -- 172.21.15.72:0/340707691 >> 172.21.15.72:0/340707691 conn(0x7f35e40a2fe0 msgr2=0x7f35e41bbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.538+0000 7f35e9585700 1 -- 172.21.15.72:0/340707691 shutdown_connections 2023-10-03T10:14:27.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.538+0000 7f35e9585700 1 -- 172.21.15.72:0/340707691 wait complete. 2023-10-03T10:14:27.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.539+0000 7f3d6ffff700 1 -- 172.21.15.72:0/397652674 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d7c017070 con 0x7f3d8809ef80 2023-10-03T10:14:27.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:27.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.643+0000 7f363c2c1700 1 Processor -- start 2023-10-03T10:14:27.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.643+0000 7f363c2c1700 1 -- start start 2023-10-03T10:14:27.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.643+0000 7f363c2c1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f363409f410 0x7f3634136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.643+0000 7f363c2c1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3634136fe0 0x7f36341393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.643+0000 7f363c2c1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3634070940 con 0x7f363409e930 2023-10-03T10:14:27.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.643+0000 7f363c2c1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363406fd60 con 0x7f363409f410 2023-10-03T10:14:27.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.643+0000 7f363c2c1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f363406fa80 con 0x7f3634136fe0 2023-10-03T10:14:27.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.643+0000 7f363a05d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f363409e930 0x7f363409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39264/0 (socket says 172.21.15.72:39264) 2023-10-03T10:14:27.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.643+0000 7f363a05d700 1 -- 172.21.15.72:0/2888984236 learned_addr learned my addr 172.21.15.72:0/2888984236 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:27.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.643+0000 7f363985c700 1 --2- 172.21.15.72:0/2888984236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f363409f410 0x7f3634136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.644+0000 7f363a85e700 1 --2- 172.21.15.72:0/2888984236 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3634136fe0 0x7f36341393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.644+0000 7f363905b700 1 -- 172.21.15.72:0/2888984236 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499467493 0 0) 0x7f3634070940 con 0x7f363409e930 2023-10-03T10:14:27.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.644+0000 7f363905b700 1 -- 172.21.15.72:0/2888984236 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36200035b0 con 0x7f363409e930 2023-10-03T10:14:27.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.644+0000 7f363985c700 1 -- 172.21.15.72:0/2888984236 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3634136fe0 msgr2=0x7f36341393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.644+0000 7f363985c700 1 --2- 172.21.15.72:0/2888984236 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3634136fe0 0x7f36341393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.644+0000 7f363985c700 1 -- 172.21.15.72:0/2888984236 >> v1:172.21.15.72:6789/0 conn(0x7f363409e930 legacy=0x7f363409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.644+0000 7f363985c700 1 -- 172.21.15.72:0/2888984236 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363409fb60 con 0x7f363409f410 2023-10-03T10:14:27.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.644+0000 7f363985c700 1 --2- 172.21.15.72:0/2888984236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f363409f410 0x7f3634136aa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3624009870 tx=0x7f3624009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5670eaf244df60dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.644+0000 7f363905b700 1 -- 172.21.15.72:0/2888984236 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624011830 con 0x7f363409f410 2023-10-03T10:14:27.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.644+0000 7f363905b700 1 -- 172.21.15.72:0/2888984236 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3624011990 con 0x7f363409f410 2023-10-03T10:14:27.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.644+0000 7f363905b700 1 -- 172.21.15.72:0/2888984236 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624011d20 con 0x7f363409f410 2023-10-03T10:14:27.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.645+0000 7f363c2c1700 1 -- 172.21.15.72:0/2888984236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f363409f410 msgr2=0x7f3634136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.645+0000 7f363c2c1700 1 --2- 172.21.15.72:0/2888984236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f363409f410 0x7f3634136aa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3624009870 tx=0x7f3624009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:27.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.645+0000 7f363c2c1700 1 -- 172.21.15.72:0/2888984236 shutdown_connections 2023-10-03T10:14:27.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.645+0000 7f363c2c1700 1 --2- 172.21.15.72:0/2888984236 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3634136fe0 0x7f36341393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.645+0000 7f363c2c1700 1 --2- 172.21.15.72:0/2888984236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f363409f410 0x7f3634136aa0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.645+0000 7f363c2c1700 1 -- 172.21.15.72:0/2888984236 >> 172.21.15.72:0/2888984236 conn(0x7f36340a4210 msgr2=0x7f36340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.645+0000 7f363c2c1700 1 -- 172.21.15.72:0/2888984236 shutdown_connections 2023-10-03T10:14:27.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.645+0000 7f363c2c1700 1 -- 172.21.15.72:0/2888984236 wait complete. 2023-10-03T10:14:27.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.646+0000 7f363c2c1700 1 Processor -- start 2023-10-03T10:14:27.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.646+0000 7f363c2c1700 1 -- start start 2023-10-03T10:14:27.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.646+0000 7f363c2c1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f363409e930 0x7f363411f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.646+0000 7f363c2c1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f363409f410 0x7f363411fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.646+0000 7f363c2c1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3634136fe0 0x7f36341c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.646+0000 7f363c2c1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363411ef40 con 0x7f363409f410 2023-10-03T10:14:27.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.646+0000 7f363c2c1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3634071db0 con 0x7f3634136fe0 2023-10-03T10:14:27.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.646+0000 7f363c2c1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f363411f120 con 0x7f363409e930 2023-10-03T10:14:27.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.646+0000 7f363a05d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f363409e930 0x7f363411f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.646+0000 7f363a05d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f363409e930 0x7f363411f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46182/0 (socket says 172.21.15.72:46182) 2023-10-03T10:14:27.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.646+0000 7f363a05d700 1 -- 172.21.15.72:0/364888949 learned_addr learned my addr 172.21.15.72:0/364888949 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:27.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.647+0000 7f363985c700 1 --2- 172.21.15.72:0/364888949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f363409f410 0x7f363411fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.647+0000 7f363a85e700 1 --2- 172.21.15.72:0/364888949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3634136fe0 0x7f36341c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.647+0000 7f363a05d700 1 -- 172.21.15.72:0/364888949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3634136fe0 msgr2=0x7f36341c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.647+0000 7f363a05d700 1 --2- 172.21.15.72:0/364888949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3634136fe0 0x7f36341c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.647+0000 7f363a05d700 1 -- 172.21.15.72:0/364888949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f363409f410 msgr2=0x7f363411fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.647+0000 7f363a05d700 1 --2- 172.21.15.72:0/364888949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f363409f410 0x7f363411fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.647+0000 7f363a05d700 1 -- 172.21.15.72:0/364888949 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36240094a0 con 0x7f363409e930 2023-10-03T10:14:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.647+0000 7f363985c700 1 --2- 172.21.15.72:0/364888949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f363409f410 0x7f363411fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.647+0000 7f363a05d700 1 --2- 172.21.15.72:0/364888949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f363409e930 0x7f363411f570 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f363000c760 tx=0x7f363000ca70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.647+0000 7f362affd700 1 -- 172.21.15.72:0/364888949 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630005d70 con 0x7f363409e930 2023-10-03T10:14:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.647+0000 7f362affd700 1 -- 172.21.15.72:0/364888949 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36300070d0 con 0x7f363409e930 2023-10-03T10:14:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.647+0000 7f363c2c1700 1 -- 172.21.15.72:0/364888949 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3634121f40 con 0x7f363409e930 2023-10-03T10:14:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.647+0000 7f362affd700 1 -- 172.21.15.72:0/364888949 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630007440 con 0x7f363409e930 2023-10-03T10:14:27.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.647+0000 7f363c2c1700 1 -- 172.21.15.72:0/364888949 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3634122c70 con 0x7f363409e930 2023-10-03T10:14:27.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.648+0000 7f362affd700 1 -- 172.21.15.72:0/364888949 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36300075a0 con 0x7f363409e930 2023-10-03T10:14:27.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.648+0000 7f362affd700 1 -- 172.21.15.72:0/364888949 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f363003eb40 con 0x7f363409e930 2023-10-03T10:14:27.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.648+0000 7f363c2c1700 1 -- 172.21.15.72:0/364888949 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3634121260 con 0x7f363409e930 2023-10-03T10:14:27.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.653+0000 7f362affd700 1 -- 172.21.15.72:0/364888949 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3630019b40 con 0x7f363409e930 2023-10-03T10:14:27.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.732+0000 7f70549b2700 1 Processor -- start 2023-10-03T10:14:27.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.732+0000 7f70549b2700 1 -- start start 2023-10-03T10:14:27.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f70549b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70500a0a30 0x7f70500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f70549b2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f705009d630 0x7f70500a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f70549b2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70500a2a70 con 0x7f7050133930 2023-10-03T10:14:27.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f70549b2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70500a01d0 con 0x7f705009d630 2023-10-03T10:14:27.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f70549b2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705009e2b0 con 0x7f70500a0a30 2023-10-03T10:14:27.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f704e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70500a0a30 0x7f70500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f704e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70500a0a30 0x7f70500a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:45112/0 (socket says 172.21.15.72:45112) 2023-10-03T10:14:27.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f704e59c700 1 -- 172.21.15.72:0/100206876 learned_addr learned my addr 172.21.15.72:0/100206876 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:27.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f704dd9b700 1 --2- 172.21.15.72:0/100206876 >> v2:172.21.15.72:3300/0 conn(0x7f705009d630 0x7f70500a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f704e59c700 1 -- 172.21.15.72:0/100206876 >> v2:172.21.15.72:3300/0 conn(0x7f705009d630 msgr2=0x7f70500a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f704e59c700 1 --2- 172.21.15.72:0/100206876 >> v2:172.21.15.72:3300/0 conn(0x7f705009d630 0x7f70500a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f704e59c700 1 -- 172.21.15.72:0/100206876 >> v1:172.21.15.72:6789/0 conn(0x7f7050133930 legacy=0x7f7050133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f704e59c700 1 -- 172.21.15.72:0/100206876 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705009dc50 con 0x7f70500a0a30 2023-10-03T10:14:27.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f704d59a700 1 -- 172.21.15.72:0/100206876 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932364298 0 0) 0x7f70500a2a70 con 0x7f7050133930 2023-10-03T10:14:27.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f704dd9b700 1 --2- 172.21.15.72:0/100206876 >> v2:172.21.15.72:3300/0 conn(0x7f705009d630 0x7f70500a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.733+0000 7f704e59c700 1 --2- 172.21.15.72:0/100206876 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70500a0a30 0x7f70500a0e00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f70400098f0 tx=0x7f7040009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcdc03ecad9f3f04 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.734+0000 7f704d59a700 1 -- 172.21.15.72:0/100206876 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040011830 con 0x7f70500a0a30 2023-10-03T10:14:27.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.734+0000 7f704d59a700 1 -- 172.21.15.72:0/100206876 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7040011990 con 0x7f70500a0a30 2023-10-03T10:14:27.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.734+0000 7f704d59a700 1 -- 172.21.15.72:0/100206876 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040011d20 con 0x7f70500a0a30 2023-10-03T10:14:27.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.734+0000 7f70549b2700 1 -- 172.21.15.72:0/100206876 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70500a0a30 msgr2=0x7f70500a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.734+0000 7f70549b2700 1 --2- 172.21.15.72:0/100206876 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70500a0a30 0x7f70500a0e00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f70400098f0 tx=0x7f7040009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:27.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.734+0000 7f70549b2700 1 -- 172.21.15.72:0/100206876 shutdown_connections 2023-10-03T10:14:27.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.734+0000 7f70549b2700 1 --2- 172.21.15.72:0/100206876 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70500a0a30 0x7f70500a0e00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.734+0000 7f70549b2700 1 --2- 172.21.15.72:0/100206876 >> v2:172.21.15.72:3300/0 conn(0x7f705009d630 0x7f70500a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.734+0000 7f70549b2700 1 -- 172.21.15.72:0/100206876 >> 172.21.15.72:0/100206876 conn(0x7f70500a3050 msgr2=0x7f70500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.734+0000 7f70549b2700 1 -- 172.21.15.72:0/100206876 shutdown_connections 2023-10-03T10:14:27.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.734+0000 7f70549b2700 1 -- 172.21.15.72:0/100206876 wait complete. 2023-10-03T10:14:27.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.735+0000 7f70549b2700 1 Processor -- start 2023-10-03T10:14:27.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.735+0000 7f70549b2700 1 -- start start 2023-10-03T10:14:27.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f70549b2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f705009d630 0x7f70501c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f70549b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70500a0a30 0x7f70501c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f70549b2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7050133930 0x7f70501c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f70549b2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7050122450 con 0x7f705009d630 2023-10-03T10:14:27.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f70549b2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70500a0410 con 0x7f70500a0a30 2023-10-03T10:14:27.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f70549b2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7050120740 con 0x7f7050133930 2023-10-03T10:14:27.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f704e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f705009d630 0x7f70501c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f704e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f705009d630 0x7f70501c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42988/0 (socket says 172.21.15.72:42988) 2023-10-03T10:14:27.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f704e59c700 1 -- 172.21.15.72:0/676300798 learned_addr learned my addr 172.21.15.72:0/676300798 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:27.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f704dd9b700 1 --2- 172.21.15.72:0/676300798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70500a0a30 0x7f70501c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f704ed9d700 1 --2- 172.21.15.72:0/676300798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7050133930 0x7f70501c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f704e59c700 1 -- 172.21.15.72:0/676300798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7050133930 msgr2=0x7f70501c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f704e59c700 1 --2- 172.21.15.72:0/676300798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7050133930 0x7f70501c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f704e59c700 1 -- 172.21.15.72:0/676300798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70500a0a30 msgr2=0x7f70501c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f704e59c700 1 --2- 172.21.15.72:0/676300798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70500a0a30 0x7f70501c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f704e59c700 1 -- 172.21.15.72:0/676300798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70440094a0 con 0x7f705009d630 2023-10-03T10:14:27.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.736+0000 7f704dd9b700 1 --2- 172.21.15.72:0/676300798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70500a0a30 0x7f70501c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.737+0000 7f704e59c700 1 --2- 172.21.15.72:0/676300798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f705009d630 0x7f70501c7f20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7040009c40 tx=0x7f7040004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.737+0000 7f703effd700 1 -- 172.21.15.72:0/676300798 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040004550 con 0x7f705009d630 2023-10-03T10:14:27.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.737+0000 7f703effd700 1 -- 172.21.15.72:0/676300798 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70400036a0 con 0x7f705009d630 2023-10-03T10:14:27.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.737+0000 7f703effd700 1 -- 172.21.15.72:0/676300798 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7040003a30 con 0x7f705009d630 2023-10-03T10:14:27.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.737+0000 7f70549b2700 1 -- 172.21.15.72:0/676300798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7040009550 con 0x7f705009d630 2023-10-03T10:14:27.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.737+0000 7f70549b2700 1 -- 172.21.15.72:0/676300798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70500a5340 con 0x7f705009d630 2023-10-03T10:14:27.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.738+0000 7f703effd700 1 -- 172.21.15.72:0/676300798 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7040021070 con 0x7f705009d630 2023-10-03T10:14:27.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.738+0000 7f703effd700 1 -- 172.21.15.72:0/676300798 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7040040ca0 con 0x7f705009d630 2023-10-03T10:14:27.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.738+0000 7f70549b2700 1 -- 172.21.15.72:0/676300798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70500747f0 con 0x7f705009d630 2023-10-03T10:14:27.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.743+0000 7f703effd700 1 -- 172.21.15.72:0/676300798 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7040029080 con 0x7f705009d630 2023-10-03T10:14:27.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.748+0000 7f3d8cf9e700 1 -- 172.21.15.72:0/397652674 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3d8804f2a0 con 0x7f3d8809ef80 2023-10-03T10:14:27.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.748+0000 7f3d6ffff700 1 -- 172.21.15.72:0/397652674 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3d7c01b3b0 con 0x7f3d8809ef80 2023-10-03T10:14:27.749 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:27.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.750+0000 7f3d8cf9e700 1 -- 172.21.15.72:0/397652674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d8809ef80 msgr2=0x7f3d881c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.750+0000 7f3d8cf9e700 1 --2- 172.21.15.72:0/397652674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d8809ef80 0x7f3d881c8530 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00c520 tx=0x7f3d7c00c830 comp rx=0 tx=0).stop 2023-10-03T10:14:27.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.751+0000 7f3d8cf9e700 1 -- 172.21.15.72:0/397652674 shutdown_connections 2023-10-03T10:14:27.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.751+0000 7f3d8cf9e700 1 --2- 172.21.15.72:0/397652674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d8809e670 0x7f3d881c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.751+0000 7f3d8cf9e700 1 --2- 172.21.15.72:0/397652674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d88131cf0 0x7f3d881c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.751+0000 7f3d8cf9e700 1 --2- 172.21.15.72:0/397652674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d8809ef80 0x7f3d881c8530 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.751+0000 7f3d8cf9e700 1 -- 172.21.15.72:0/397652674 >> 172.21.15.72:0/397652674 conn(0x7f3d880a0c90 msgr2=0x7f3d880a2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.751+0000 7f3d8cf9e700 1 -- 172.21.15.72:0/397652674 shutdown_connections 2023-10-03T10:14:27.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.751+0000 7f3d8cf9e700 1 -- 172.21.15.72:0/397652674 wait complete. 2023-10-03T10:14:27.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:27.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.852+0000 7f363c2c1700 1 -- 172.21.15.72:0/364888949 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3634074ea0 con 0x7f363409e930 2023-10-03T10:14:27.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.852+0000 7f362affd700 1 -- 172.21.15.72:0/364888949 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3630017020 con 0x7f363409e930 2023-10-03T10:14:27.853 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:27.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.854+0000 7f363c2c1700 1 -- 172.21.15.72:0/364888949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f363409e930 msgr2=0x7f363411f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.854+0000 7f363c2c1700 1 --2- 172.21.15.72:0/364888949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f363409e930 0x7f363411f570 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f363000c760 tx=0x7f363000ca70 comp rx=0 tx=0).stop 2023-10-03T10:14:27.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.854+0000 7f363c2c1700 1 -- 172.21.15.72:0/364888949 shutdown_connections 2023-10-03T10:14:27.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.854+0000 7f363c2c1700 1 --2- 172.21.15.72:0/364888949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3634136fe0 0x7f36341c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.854+0000 7f363c2c1700 1 --2- 172.21.15.72:0/364888949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f363409e930 0x7f363411f570 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.854+0000 7f363c2c1700 1 --2- 172.21.15.72:0/364888949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f363409f410 0x7f363411fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.854+0000 7f363c2c1700 1 -- 172.21.15.72:0/364888949 >> 172.21.15.72:0/364888949 conn(0x7f36340a4210 msgr2=0x7f3634134920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.854+0000 7f363c2c1700 1 -- 172.21.15.72:0/364888949 shutdown_connections 2023-10-03T10:14:27.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.854+0000 7f363c2c1700 1 -- 172.21.15.72:0/364888949 wait complete. 2023-10-03T10:14:27.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:27.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.937+0000 7f70549b2700 1 -- 172.21.15.72:0/676300798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7050072980 con 0x7f705009d630 2023-10-03T10:14:27.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.937+0000 7f703effd700 1 -- 172.21.15.72:0/676300798 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7040033090 con 0x7f705009d630 2023-10-03T10:14:27.938 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:27.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.940+0000 7f70549b2700 1 -- 172.21.15.72:0/676300798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f705009d630 msgr2=0x7f70501c7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.940+0000 7f70549b2700 1 --2- 172.21.15.72:0/676300798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f705009d630 0x7f70501c7f20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7040009c40 tx=0x7f7040004750 comp rx=0 tx=0).stop 2023-10-03T10:14:27.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.940+0000 7f70549b2700 1 -- 172.21.15.72:0/676300798 shutdown_connections 2023-10-03T10:14:27.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.940+0000 7f70549b2700 1 --2- 172.21.15.72:0/676300798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f705009d630 0x7f70501c7f20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.940+0000 7f70549b2700 1 --2- 172.21.15.72:0/676300798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7050133930 0x7f70501c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.940+0000 7f70549b2700 1 --2- 172.21.15.72:0/676300798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70500a0a30 0x7f70501c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.940+0000 7f70549b2700 1 -- 172.21.15.72:0/676300798 >> 172.21.15.72:0/676300798 conn(0x7f70500a3050 msgr2=0x7f70501bb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.940+0000 7f70549b2700 1 -- 172.21.15.72:0/676300798 shutdown_connections 2023-10-03T10:14:27.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:27.940+0000 7f70549b2700 1 -- 172.21.15.72:0/676300798 wait complete. 2023-10-03T10:14:27.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:28.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:28.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.686+0000 7f19d5363700 1 Processor -- start 2023-10-03T10:14:28.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.686+0000 7f19d5363700 1 -- start start 2023-10-03T10:14:28.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.686+0000 7f19d5363700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f19d012c2f0 0x7f19d0130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.686+0000 7f19d5363700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f19d012cff0 0x7f19d0137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.686+0000 7f19d5363700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d009a510 con 0x7f19d012cc20 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.686+0000 7f19d5363700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d012c7d0 con 0x7f19d012c2f0 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.686+0000 7f19d5363700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d009c190 con 0x7f19d012cff0 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.686+0000 7f19ce7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f19d012c2f0 0x7f19d0130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.686+0000 7f19ce7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f19d012c2f0 0x7f19d0130040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45998/0 (socket says 172.21.15.72:45998) 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.686+0000 7f19cf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f19d012cff0 0x7f19d0137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.686+0000 7f19ce7fc700 1 -- 172.21.15.72:0/3699846090 learned_addr learned my addr 172.21.15.72:0/3699846090 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19ce7fc700 1 -- 172.21.15.72:0/3699846090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f19d012cff0 msgr2=0x7f19d0137cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19ce7fc700 1 --2- 172.21.15.72:0/3699846090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f19d012cff0 0x7f19d0137cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19ce7fc700 1 -- 172.21.15.72:0/3699846090 >> v1:172.21.15.72:6789/0 conn(0x7f19d012cc20 legacy=0x7f19d012f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19ce7fc700 1 -- 172.21.15.72:0/3699846090 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d009b540 con 0x7f19d012c2f0 2023-10-03T10:14:28.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19cf7fe700 1 --2- 172.21.15.72:0/3699846090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f19d012cff0 0x7f19d0137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19ce7fc700 1 --2- 172.21.15.72:0/3699846090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d012c2f0 0x7f19d0130040 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f19c400bb90 tx=0x7f19c400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495882d57e8aa5c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19cdffb700 1 -- 172.21.15.72:0/3699846090 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c400dd30 con 0x7f19d012c2f0 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19cdffb700 1 -- 172.21.15.72:0/3699846090 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c400de90 con 0x7f19d012c2f0 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19cdffb700 1 -- 172.21.15.72:0/3699846090 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4010690 con 0x7f19d012c2f0 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19d5363700 1 -- 172.21.15.72:0/3699846090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d012c2f0 msgr2=0x7f19d0130040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19d5363700 1 --2- 172.21.15.72:0/3699846090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d012c2f0 0x7f19d0130040 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f19c400bb90 tx=0x7f19c400bea0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19d5363700 1 -- 172.21.15.72:0/3699846090 shutdown_connections 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19d5363700 1 --2- 172.21.15.72:0/3699846090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f19d012cff0 0x7f19d0137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19d5363700 1 --2- 172.21.15.72:0/3699846090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d012c2f0 0x7f19d0130040 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19d5363700 1 -- 172.21.15.72:0/3699846090 >> 172.21.15.72:0/3699846090 conn(0x7f19d009f470 msgr2=0x7f19d00a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19d5363700 1 -- 172.21.15.72:0/3699846090 shutdown_connections 2023-10-03T10:14:28.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.687+0000 7f19d5363700 1 -- 172.21.15.72:0/3699846090 wait complete. 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.688+0000 7f19d5363700 1 Processor -- start 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.688+0000 7f19d5363700 1 -- start start 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19d5363700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f19d012c2f0 0x7f19d006f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19d5363700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d012cc20 0x7f19d006f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19d5363700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f19d012cff0 0x7f19d01c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19d5363700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d00a20c0 con 0x7f19d012cc20 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19d5363700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d0072110 con 0x7f19d012c2f0 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19d5363700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19d0071410 con 0x7f19d012cff0 2023-10-03T10:14:28.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19ce7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d012cc20 0x7f19d006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19cf7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f19d012cff0 0x7f19d01c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19ce7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d012cc20 0x7f19d006f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46008/0 (socket says 172.21.15.72:46008) 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19ce7fc700 1 -- 172.21.15.72:0/1802211311 learned_addr learned my addr 172.21.15.72:0/1802211311 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19ceffd700 1 --2- 172.21.15.72:0/1802211311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f19d012c2f0 0x7f19d006f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19ce7fc700 1 -- 172.21.15.72:0/1802211311 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f19d012cff0 msgr2=0x7f19d01c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19ce7fc700 1 --2- 172.21.15.72:0/1802211311 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f19d012cff0 0x7f19d01c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19ce7fc700 1 -- 172.21.15.72:0/1802211311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f19d012c2f0 msgr2=0x7f19d006f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19ce7fc700 1 --2- 172.21.15.72:0/1802211311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f19d012c2f0 0x7f19d006f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19ce7fc700 1 -- 172.21.15.72:0/1802211311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c8009a70 con 0x7f19d012cc20 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19cf7fe700 1 --2- 172.21.15.72:0/1802211311 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f19d012cff0 0x7f19d01c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.689+0000 7f19ce7fc700 1 --2- 172.21.15.72:0/1802211311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d012cc20 0x7f19d006f840 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f19c400bee0 tx=0x7f19c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.690+0000 7f19b77fe700 1 -- 172.21.15.72:0/1802211311 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c401f070 con 0x7f19d012cc20 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.690+0000 7f19b77fe700 1 -- 172.21.15.72:0/1802211311 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c40038b0 con 0x7f19d012cc20 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.690+0000 7f19d5363700 1 -- 172.21.15.72:0/1802211311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c400b7f0 con 0x7f19d012cc20 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.690+0000 7f19b77fe700 1 -- 172.21.15.72:0/1802211311 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4003c40 con 0x7f19d012cc20 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.690+0000 7f19d5363700 1 -- 172.21.15.72:0/1802211311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d0071900 con 0x7f19d012cc20 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.690+0000 7f19d5363700 1 -- 172.21.15.72:0/1802211311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d0070800 con 0x7f19d012cc20 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.691+0000 7f19b77fe700 1 -- 172.21.15.72:0/1802211311 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19c4019400 con 0x7f19d012cc20 2023-10-03T10:14:28.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.691+0000 7f19b77fe700 1 -- 172.21.15.72:0/1802211311 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f19c4042bd0 con 0x7f19d012cc20 2023-10-03T10:14:28.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.695+0000 7f19b77fe700 1 -- 172.21.15.72:0/1802211311 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19c4003da0 con 0x7f19d012cc20 2023-10-03T10:14:28.765 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:28.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:28.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.888+0000 7fcd777cf700 1 Processor -- start 2023-10-03T10:14:28.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.888+0000 7fcd777cf700 1 -- start start 2023-10-03T10:14:28.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.888+0000 7fcd777cf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd70133540 0x7fcd70135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.888+0000 7fcd777cf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd70135e60 0x7fcd70138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.888+0000 7fcd777cf700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd700716a0 con 0x7fcd70130540 2023-10-03T10:14:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.888+0000 7fcd777cf700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd70071290 con 0x7fcd70135e60 2023-10-03T10:14:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.888+0000 7fcd777cf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd70130340 con 0x7fcd70133540 2023-10-03T10:14:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.889+0000 7fcd7556b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcd70130540 0x7fcd70130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35278/0 (socket says 172.21.15.72:35278) 2023-10-03T10:14:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.889+0000 7fcd7556b700 1 -- 172.21.15.72:0/3942062493 learned_addr learned my addr 172.21.15.72:0/3942062493 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.889+0000 7fcd75d6c700 1 --2- 172.21.15.72:0/3942062493 >> v2:172.21.15.72:3300/0 conn(0x7fcd70135e60 0x7fcd70138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.889+0000 7fcd74d6a700 1 --2- 172.21.15.72:0/3942062493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd70133540 0x7fcd70135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.889+0000 7fcd67fff700 1 -- 172.21.15.72:0/3942062493 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640850840 0 0) 0x7fcd700716a0 con 0x7fcd70130540 2023-10-03T10:14:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.889+0000 7fcd67fff700 1 -- 172.21.15.72:0/3942062493 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd5c0035b0 con 0x7fcd70130540 2023-10-03T10:14:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.889+0000 7fcd74d6a700 1 -- 172.21.15.72:0/3942062493 >> v2:172.21.15.72:3300/0 conn(0x7fcd70135e60 msgr2=0x7fcd70138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.889+0000 7fcd74d6a700 1 --2- 172.21.15.72:0/3942062493 >> v2:172.21.15.72:3300/0 conn(0x7fcd70135e60 0x7fcd70138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.889+0000 7fcd74d6a700 1 -- 172.21.15.72:0/3942062493 >> v1:172.21.15.72:6789/0 conn(0x7fcd70130540 legacy=0x7fcd70130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.889+0000 7fcd74d6a700 1 -- 172.21.15.72:0/3942062493 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd70070b80 con 0x7fcd70133540 2023-10-03T10:14:28.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.889+0000 7fcd75d6c700 1 --2- 172.21.15.72:0/3942062493 >> v2:172.21.15.72:3300/0 conn(0x7fcd70135e60 0x7fcd70138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.889+0000 7fcd74d6a700 1 --2- 172.21.15.72:0/3942062493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd70133540 0x7fcd70135920 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009840 tx=0x7fcd60009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c8e1c09396ebf41 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.889+0000 7fcd67fff700 1 -- 172.21.15.72:0/3942062493 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60011830 con 0x7fcd70133540 2023-10-03T10:14:28.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.890+0000 7fcd67fff700 1 -- 172.21.15.72:0/3942062493 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd60011990 con 0x7fcd70133540 2023-10-03T10:14:28.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.890+0000 7fcd67fff700 1 -- 172.21.15.72:0/3942062493 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60011d20 con 0x7fcd70133540 2023-10-03T10:14:28.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.890+0000 7fcd777cf700 1 -- 172.21.15.72:0/3942062493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd70133540 msgr2=0x7fcd70135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.890+0000 7fcd777cf700 1 --2- 172.21.15.72:0/3942062493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd70133540 0x7fcd70135920 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009840 tx=0x7fcd60009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:28.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.890+0000 7fcd777cf700 1 -- 172.21.15.72:0/3942062493 shutdown_connections 2023-10-03T10:14:28.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.890+0000 7fcd777cf700 1 --2- 172.21.15.72:0/3942062493 >> v2:172.21.15.72:3300/0 conn(0x7fcd70135e60 0x7fcd70138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.890+0000 7fcd777cf700 1 --2- 172.21.15.72:0/3942062493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd70133540 0x7fcd70135920 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.890+0000 7fcd777cf700 1 -- 172.21.15.72:0/3942062493 >> 172.21.15.72:0/3942062493 conn(0x7fcd700a2aa0 msgr2=0x7fcd700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.891+0000 7fcd777cf700 1 -- 172.21.15.72:0/3942062493 shutdown_connections 2023-10-03T10:14:28.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.891+0000 7fcd777cf700 1 -- 172.21.15.72:0/3942062493 wait complete. 2023-10-03T10:14:28.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.892+0000 7fcd777cf700 1 Processor -- start 2023-10-03T10:14:28.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.892+0000 7fcd777cf700 1 -- start start 2023-10-03T10:14:28.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd777cf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd70130540 0x7fcd70118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd777cf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd70133540 0x7fcd70119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd777cf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd70135e60 0x7fcd70119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd777cf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7011b6d0 con 0x7fcd70135e60 2023-10-03T10:14:28.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd777cf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7011a5c0 con 0x7fcd70130540 2023-10-03T10:14:28.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd777cf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7009e150 con 0x7fcd70133540 2023-10-03T10:14:28.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd75d6c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd70135e60 0x7fcd70119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd74d6a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd70133540 0x7fcd70119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd75d6c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd70135e60 0x7fcd70119750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46032/0 (socket says 172.21.15.72:46032) 2023-10-03T10:14:28.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd75d6c700 1 -- 172.21.15.72:0/1245900649 learned_addr learned my addr 172.21.15.72:0/1245900649 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:28.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd7556b700 1 --2- 172.21.15.72:0/1245900649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd70130540 0x7fcd70118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd74d6a700 1 -- 172.21.15.72:0/1245900649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd70130540 msgr2=0x7fcd70118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd74d6a700 1 --2- 172.21.15.72:0/1245900649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd70130540 0x7fcd70118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd74d6a700 1 -- 172.21.15.72:0/1245900649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd70135e60 msgr2=0x7fcd70119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd74d6a700 1 --2- 172.21.15.72:0/1245900649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd70135e60 0x7fcd70119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd74d6a700 1 -- 172.21.15.72:0/1245900649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68009a70 con 0x7fcd70133540 2023-10-03T10:14:28.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd75d6c700 1 --2- 172.21.15.72:0/1245900649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd70135e60 0x7fcd70119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7f19d5363700 1 -- 172.21.15.72:0/1802211311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f19d00747f0 con 0x7f19d012cc20 2023-10-03T10:14:28.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.893+0000 7fcd74d6a700 1 --2- 172.21.15.72:0/1245900649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd70133540 0x7fcd70119210 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcd60016000 tx=0x7fcd60004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.894+0000 7f19b77fe700 1 -- 172.21.15.72:0/1802211311 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19c4028070 con 0x7f19d012cc20 2023-10-03T10:14:28.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.894+0000 7fcd65ffb700 1 -- 172.21.15.72:0/1245900649 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60024620 con 0x7fcd70133540 2023-10-03T10:14:28.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.894+0000 7fcd777cf700 1 -- 172.21.15.72:0/1245900649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd600094a0 con 0x7fcd70133540 2023-10-03T10:14:28.898 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.894+0000 7fcd777cf700 1 -- 172.21.15.72:0/1245900649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd700718e0 con 0x7fcd70133540 2023-10-03T10:14:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.894+0000 7fcd65ffb700 1 -- 172.21.15.72:0/1245900649 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd600247a0 con 0x7fcd70133540 2023-10-03T10:14:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.895+0000 7fcd65ffb700 1 -- 172.21.15.72:0/1245900649 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60024b50 con 0x7fcd70133540 2023-10-03T10:14:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.895+0000 7fcd65ffb700 1 -- 172.21.15.72:0/1245900649 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd60022070 con 0x7fcd70133540 2023-10-03T10:14:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.895+0000 7fcd65ffb700 1 -- 172.21.15.72:0/1245900649 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd600427b0 con 0x7fcd70133540 2023-10-03T10:14:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.895+0000 7fcd777cf700 1 -- 172.21.15.72:0/1245900649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd500052e0 con 0x7fcd70133540 2023-10-03T10:14:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.896+0000 7f19d5363700 1 -- 172.21.15.72:0/1802211311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d012cc20 msgr2=0x7f19d006f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.896+0000 7f19d5363700 1 --2- 172.21.15.72:0/1802211311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d012cc20 0x7f19d006f840 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f19c400bee0 tx=0x7f19c4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.896+0000 7f19d5363700 1 -- 172.21.15.72:0/1802211311 shutdown_connections 2023-10-03T10:14:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.896+0000 7f19d5363700 1 --2- 172.21.15.72:0/1802211311 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f19d012cff0 0x7f19d01c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.896+0000 7f19d5363700 1 --2- 172.21.15.72:0/1802211311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f19d012c2f0 0x7f19d006f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.896+0000 7f19d5363700 1 --2- 172.21.15.72:0/1802211311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d012cc20 0x7f19d006f840 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.896+0000 7f19d5363700 1 -- 172.21.15.72:0/1802211311 >> 172.21.15.72:0/1802211311 conn(0x7f19d009f470 msgr2=0x7f19d012fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.896+0000 7f19d5363700 1 -- 172.21.15.72:0/1802211311 shutdown_connections 2023-10-03T10:14:28.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.896+0000 7f19d5363700 1 -- 172.21.15.72:0/1802211311 wait complete. 2023-10-03T10:14:28.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:28.900+0000 7fcd65ffb700 1 -- 172.21.15.72:0/1245900649 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd60015070 con 0x7fcd70133540 2023-10-03T10:14:28.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:28.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:29.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.006+0000 7f99898c6700 1 Processor -- start 2023-10-03T10:14:29.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.006+0000 7f99898c6700 1 -- start start 2023-10-03T10:14:29.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.006+0000 7f99898c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f998409e930 0x7f998409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.006+0000 7f99898c6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f998409f240 0x7f99841317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.006+0000 7f99898c6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9984070940 con 0x7f998409f650 2023-10-03T10:14:29.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.006+0000 7f99898c6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998406fd60 con 0x7f998409f240 2023-10-03T10:14:29.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.006+0000 7f99898c6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f998406fa80 con 0x7f998409e930 2023-10-03T10:14:29.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.007+0000 7f99827fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f998409f240 0x7f99841317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.007+0000 7f99827fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f998409f240 0x7f99841317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46044/0 (socket says 172.21.15.72:46044) 2023-10-03T10:14:29.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.007+0000 7f99827fc700 1 -- 172.21.15.72:0/3004916945 learned_addr learned my addr 172.21.15.72:0/3004916945 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:29.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.007+0000 7f99837fe700 1 --1- 172.21.15.72:0/3004916945 >> v1:172.21.15.72:6789/0 conn(0x7f998409f650 0x7f9984131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35284/0 (socket says 172.21.15.72:35284) 2023-10-03T10:14:29.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.007+0000 7f9982ffd700 1 --2- 172.21.15.72:0/3004916945 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f998409e930 0x7f998409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.007+0000 7f99827fc700 1 -- 172.21.15.72:0/3004916945 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f998409e930 msgr2=0x7f998409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:29.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.007+0000 7f99827fc700 1 --2- 172.21.15.72:0/3004916945 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f998409e930 0x7f998409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.007+0000 7f99827fc700 1 -- 172.21.15.72:0/3004916945 >> v1:172.21.15.72:6789/0 conn(0x7f998409f650 legacy=0x7f9984131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.007+0000 7f99827fc700 1 -- 172.21.15.72:0/3004916945 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998409fb60 con 0x7f998409f240 2023-10-03T10:14:29.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.007+0000 7f9982ffd700 1 --2- 172.21.15.72:0/3004916945 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f998409e930 0x7f998409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:29.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.007+0000 7f99827fc700 1 --2- 172.21.15.72:0/3004916945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f998409f240 0x7f99841317f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f99780098f0 tx=0x7f9978009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5034e274bf2c6c0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.007+0000 7f9981ffb700 1 -- 172.21.15.72:0/3004916945 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997800b8a0 con 0x7f998409f240 2023-10-03T10:14:29.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.007+0000 7f9981ffb700 1 -- 172.21.15.72:0/3004916945 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997800ba00 con 0x7f998409f240 2023-10-03T10:14:29.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.007+0000 7f9981ffb700 1 -- 172.21.15.72:0/3004916945 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997800bd90 con 0x7f998409f240 2023-10-03T10:14:29.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.008+0000 7f99898c6700 1 -- 172.21.15.72:0/3004916945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f998409f240 msgr2=0x7f99841317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.008+0000 7f99898c6700 1 --2- 172.21.15.72:0/3004916945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f998409f240 0x7f99841317f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f99780098f0 tx=0x7f9978009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:29.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.008+0000 7f99898c6700 1 -- 172.21.15.72:0/3004916945 shutdown_connections 2023-10-03T10:14:29.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.008+0000 7f99898c6700 1 --2- 172.21.15.72:0/3004916945 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f998409e930 0x7f998409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.008+0000 7f99898c6700 1 --2- 172.21.15.72:0/3004916945 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f998409f240 0x7f99841317f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.008+0000 7f99898c6700 1 -- 172.21.15.72:0/3004916945 >> 172.21.15.72:0/3004916945 conn(0x7f99840a4210 msgr2=0x7f99840a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:29.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.008+0000 7f99898c6700 1 -- 172.21.15.72:0/3004916945 shutdown_connections 2023-10-03T10:14:29.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.008+0000 7f99898c6700 1 -- 172.21.15.72:0/3004916945 wait complete. 2023-10-03T10:14:29.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.009+0000 7f99898c6700 1 Processor -- start 2023-10-03T10:14:29.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.009+0000 7f99898c6700 1 -- start start 2023-10-03T10:14:29.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.009+0000 7f99898c6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f998409e930 0x7f99841a4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.009+0000 7f99898c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f998409f240 0x7f99841a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.009+0000 7f99898c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f998409f650 0x7f99841a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.009+0000 7f99898c6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99841b7340 con 0x7f998409e930 2023-10-03T10:14:29.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.009+0000 7f99898c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99840a3560 con 0x7f998409f650 2023-10-03T10:14:29.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.009+0000 7f99898c6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9984071d20 con 0x7f998409f240 2023-10-03T10:14:29.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f99827fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f998409f240 0x7f99841a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f99837fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f998409f650 0x7f99841a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f99827fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f998409f240 0x7f99841a4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39534/0 (socket says 172.21.15.72:39534) 2023-10-03T10:14:29.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f99827fc700 1 -- 172.21.15.72:0/1968040649 learned_addr learned my addr 172.21.15.72:0/1968040649 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:29.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f9982ffd700 1 --2- 172.21.15.72:0/1968040649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f998409e930 0x7f99841a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f99827fc700 1 -- 172.21.15.72:0/1968040649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f998409f650 msgr2=0x7f99841a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f99827fc700 1 --2- 172.21.15.72:0/1968040649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f998409f650 0x7f99841a4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f99827fc700 1 -- 172.21.15.72:0/1968040649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f998409e930 msgr2=0x7f99841a4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f99827fc700 1 --2- 172.21.15.72:0/1968040649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f998409e930 0x7f99841a4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f99827fc700 1 -- 172.21.15.72:0/1968040649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9978009550 con 0x7f998409f240 2023-10-03T10:14:29.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f99827fc700 1 --2- 172.21.15.72:0/1968040649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f998409f240 0x7f99841a4570 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9978000c00 tx=0x7f9978004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f996bfff700 1 -- 172.21.15.72:0/1968040649 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978004510 con 0x7f998409f240 2023-10-03T10:14:29.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f996bfff700 1 -- 172.21.15.72:0/1968040649 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99780036a0 con 0x7f998409f240 2023-10-03T10:14:29.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f99898c6700 1 -- 172.21.15.72:0/1968040649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99840a0190 con 0x7f998409f240 2023-10-03T10:14:29.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f996bfff700 1 -- 172.21.15.72:0/1968040649 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978003a30 con 0x7f998409f240 2023-10-03T10:14:29.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.010+0000 7f99898c6700 1 -- 172.21.15.72:0/1968040649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99841a7ad0 con 0x7f998409f240 2023-10-03T10:14:29.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.011+0000 7f996bfff700 1 -- 172.21.15.72:0/1968040649 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9978021070 con 0x7f998409f240 2023-10-03T10:14:29.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.011+0000 7f996bfff700 1 -- 172.21.15.72:0/1968040649 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9978040970 con 0x7f998409f240 2023-10-03T10:14:29.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.012+0000 7f99898c6700 1 -- 172.21.15.72:0/1968040649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99840a3180 con 0x7f998409f240 2023-10-03T10:14:29.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.020+0000 7f996bfff700 1 -- 172.21.15.72:0/1968040649 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9978015080 con 0x7f998409f240 2023-10-03T10:14:29.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.081+0000 7fe34eb08700 1 Processor -- start 2023-10-03T10:14:29.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.081+0000 7fe34eb08700 1 -- start start 2023-10-03T10:14:29.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe34eb08700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe348133420 0x7fe3481337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe34eb08700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe348133e30 0x7fe34812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe34eb08700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34806b990 con 0x7fe348134260 2023-10-03T10:14:29.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe34eb08700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480a0590 con 0x7fe348133420 2023-10-03T10:14:29.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe34eb08700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe34809fb80 con 0x7fe348133e30 2023-10-03T10:14:29.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe34c8a4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe348133420 0x7fe3481337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe34d0a5700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe348134260 0x7fe3481304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35292/0 (socket says 172.21.15.72:35292) 2023-10-03T10:14:29.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe34c8a4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe348133420 0x7fe3481337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40050/0 (socket says 172.21.15.72:40050) 2023-10-03T10:14:29.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe34d0a5700 1 -- 172.21.15.72:0/3078674980 learned_addr learned my addr 172.21.15.72:0/3078674980 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:29.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe347fff700 1 --2- 172.21.15.72:0/3078674980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe348133e30 0x7fe34812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe3477fe700 1 -- 172.21.15.72:0/3078674980 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485667068 0 0) 0x7fe34806b990 con 0x7fe348134260 2023-10-03T10:14:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe3477fe700 1 -- 172.21.15.72:0/3078674980 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3380035b0 con 0x7fe348134260 2023-10-03T10:14:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe34c8a4700 1 -- 172.21.15.72:0/3078674980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe348133e30 msgr2=0x7fe34812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe34c8a4700 1 --2- 172.21.15.72:0/3078674980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe348133e30 0x7fe34812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe34c8a4700 1 -- 172.21.15.72:0/3078674980 >> v1:172.21.15.72:6789/0 conn(0x7fe348134260 legacy=0x7fe3481304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe34c8a4700 1 -- 172.21.15.72:0/3078674980 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3480a0030 con 0x7fe348133420 2023-10-03T10:14:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe347fff700 1 --2- 172.21.15.72:0/3078674980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe348133e30 0x7fe34812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.082+0000 7fe34c8a4700 1 --2- 172.21.15.72:0/3078674980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe348133420 0x7fe3481337f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009870 tx=0x7fe33c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e08dd366fc304799 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.083+0000 7fe3477fe700 1 -- 172.21.15.72:0/3078674980 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c011830 con 0x7fe348133420 2023-10-03T10:14:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.083+0000 7fe3477fe700 1 -- 172.21.15.72:0/3078674980 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c011990 con 0x7fe348133420 2023-10-03T10:14:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.083+0000 7fe3477fe700 1 -- 172.21.15.72:0/3078674980 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c011d20 con 0x7fe348133420 2023-10-03T10:14:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.083+0000 7fe34eb08700 1 -- 172.21.15.72:0/3078674980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe348133420 msgr2=0x7fe3481337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.083+0000 7fe34eb08700 1 --2- 172.21.15.72:0/3078674980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe348133420 0x7fe3481337f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009870 tx=0x7fe33c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.083+0000 7fe34eb08700 1 -- 172.21.15.72:0/3078674980 shutdown_connections 2023-10-03T10:14:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.083+0000 7fe34eb08700 1 --2- 172.21.15.72:0/3078674980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe348133420 0x7fe3481337f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.083+0000 7fe34eb08700 1 --2- 172.21.15.72:0/3078674980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe348133e30 0x7fe34812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.083+0000 7fe34eb08700 1 -- 172.21.15.72:0/3078674980 >> 172.21.15.72:0/3078674980 conn(0x7fe3480a4210 msgr2=0x7fe3480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.083+0000 7fe34eb08700 1 -- 172.21.15.72:0/3078674980 shutdown_connections 2023-10-03T10:14:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.083+0000 7fe34eb08700 1 -- 172.21.15.72:0/3078674980 wait complete. 2023-10-03T10:14:29.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.084+0000 7fe34eb08700 1 Processor -- start 2023-10-03T10:14:29.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.084+0000 7fe34eb08700 1 -- start start 2023-10-03T10:14:29.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34eb08700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe348133420 0x7fe34809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34eb08700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe348133e30 0x7fe34809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34eb08700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe348134260 0x7fe34809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34eb08700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34812d920 con 0x7fe348134260 2023-10-03T10:14:29.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34eb08700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34811f3e0 con 0x7fe348133420 2023-10-03T10:14:29.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34eb08700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe34811fbd0 con 0x7fe348133e30 2023-10-03T10:14:29.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34c8a4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe348133420 0x7fe34809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34c8a4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe348133420 0x7fe34809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40066/0 (socket says 172.21.15.72:40066) 2023-10-03T10:14:29.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34c8a4700 1 -- 172.21.15.72:0/4048068814 learned_addr learned my addr 172.21.15.72:0/4048068814 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:29.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe347fff700 1 --2- 172.21.15.72:0/4048068814 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe348133e30 0x7fe34809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34d0a5700 1 --2- 172.21.15.72:0/4048068814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe348134260 0x7fe34809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34c8a4700 1 -- 172.21.15.72:0/4048068814 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe348133e30 msgr2=0x7fe34809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34c8a4700 1 --2- 172.21.15.72:0/4048068814 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe348133e30 0x7fe34809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34c8a4700 1 -- 172.21.15.72:0/4048068814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe348134260 msgr2=0x7fe34809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34c8a4700 1 --2- 172.21.15.72:0/4048068814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe348134260 0x7fe34809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34c8a4700 1 -- 172.21.15.72:0/4048068814 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3340094a0 con 0x7fe348133420 2023-10-03T10:14:29.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34d0a5700 1 --2- 172.21.15.72:0/4048068814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe348134260 0x7fe34809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:29.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.085+0000 7fe34c8a4700 1 --2- 172.21.15.72:0/4048068814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe348133420 0x7fe34809c480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009bc0 tx=0x7fe33c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.086+0000 7fe3457fa700 1 -- 172.21.15.72:0/4048068814 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c004300 con 0x7fe348133420 2023-10-03T10:14:29.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.086+0000 7fe3457fa700 1 -- 172.21.15.72:0/4048068814 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c01f070 con 0x7fe348133420 2023-10-03T10:14:29.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.086+0000 7fe34eb08700 1 -- 172.21.15.72:0/4048068814 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33c0094a0 con 0x7fe348133420 2023-10-03T10:14:29.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.086+0000 7fe3457fa700 1 -- 172.21.15.72:0/4048068814 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c0036a0 con 0x7fe348133420 2023-10-03T10:14:29.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.086+0000 7fe34eb08700 1 -- 172.21.15.72:0/4048068814 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34811eed0 con 0x7fe348133420 2023-10-03T10:14:29.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.087+0000 7fe34eb08700 1 -- 172.21.15.72:0/4048068814 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe348074ea0 con 0x7fe348133420 2023-10-03T10:14:29.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.087+0000 7fe3457fa700 1 -- 172.21.15.72:0/4048068814 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe33c021030 con 0x7fe348133420 2023-10-03T10:14:29.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.088+0000 7fe3457fa700 1 -- 172.21.15.72:0/4048068814 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe33c040cb0 con 0x7fe348133420 2023-10-03T10:14:29.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.091+0000 7fe3457fa700 1 -- 172.21.15.72:0/4048068814 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe33c0199a0 con 0x7fe348133420 2023-10-03T10:14:29.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.120+0000 7fcd777cf700 1 -- 172.21.15.72:0/1245900649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd50005150 con 0x7fcd70133540 2023-10-03T10:14:29.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.120+0000 7fcd65ffb700 1 -- 172.21.15.72:0/1245900649 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcd60015020 con 0x7fcd70133540 2023-10-03T10:14:29.121 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:29.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.122+0000 7fcd777cf700 1 -- 172.21.15.72:0/1245900649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd70133540 msgr2=0x7fcd70119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.122+0000 7fcd777cf700 1 --2- 172.21.15.72:0/1245900649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd70133540 0x7fcd70119210 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcd60016000 tx=0x7fcd60004750 comp rx=0 tx=0).stop 2023-10-03T10:14:29.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.122+0000 7fcd777cf700 1 -- 172.21.15.72:0/1245900649 shutdown_connections 2023-10-03T10:14:29.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.122+0000 7fcd777cf700 1 --2- 172.21.15.72:0/1245900649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd70135e60 0x7fcd70119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.122+0000 7fcd777cf700 1 --2- 172.21.15.72:0/1245900649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd70130540 0x7fcd70118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.122+0000 7fcd777cf700 1 --2- 172.21.15.72:0/1245900649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd70133540 0x7fcd70119210 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.122+0000 7fcd777cf700 1 -- 172.21.15.72:0/1245900649 >> 172.21.15.72:0/1245900649 conn(0x7fcd700a2aa0 msgr2=0x7fcd70132090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:29.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.122+0000 7fcd777cf700 1 -- 172.21.15.72:0/1245900649 shutdown_connections 2023-10-03T10:14:29.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.122+0000 7fcd777cf700 1 -- 172.21.15.72:0/1245900649 wait complete. 2023-10-03T10:14:29.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:29.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.217+0000 7f99898c6700 1 -- 172.21.15.72:0/1968040649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9984074ea0 con 0x7f998409f240 2023-10-03T10:14:29.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.217+0000 7f996bfff700 1 -- 172.21.15.72:0/1968040649 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9978029020 con 0x7f998409f240 2023-10-03T10:14:29.218 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.219+0000 7f99898c6700 1 -- 172.21.15.72:0/1968040649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f998409f240 msgr2=0x7f99841a4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.219+0000 7f99898c6700 1 --2- 172.21.15.72:0/1968040649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f998409f240 0x7f99841a4570 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9978000c00 tx=0x7f9978004750 comp rx=0 tx=0).stop 2023-10-03T10:14:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.219+0000 7f99898c6700 1 -- 172.21.15.72:0/1968040649 shutdown_connections 2023-10-03T10:14:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.219+0000 7f99898c6700 1 --2- 172.21.15.72:0/1968040649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f998409e930 0x7f99841a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.219+0000 7f99898c6700 1 --2- 172.21.15.72:0/1968040649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f998409f650 0x7f99841a4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.219+0000 7f99898c6700 1 --2- 172.21.15.72:0/1968040649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f998409f240 0x7f99841a4570 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.219+0000 7f99898c6700 1 -- 172.21.15.72:0/1968040649 >> 172.21.15.72:0/1968040649 conn(0x7f99840a4210 msgr2=0x7f99841b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:29.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.219+0000 7f99898c6700 1 -- 172.21.15.72:0/1968040649 shutdown_connections 2023-10-03T10:14:29.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.219+0000 7f99898c6700 1 -- 172.21.15.72:0/1968040649 wait complete. 2023-10-03T10:14:29.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:29.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.283+0000 7fe34eb08700 1 -- 172.21.15.72:0/4048068814 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe34806b250 con 0x7fe348133420 2023-10-03T10:14:29.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.283+0000 7fe3457fa700 1 -- 172.21.15.72:0/4048068814 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe33c015030 con 0x7fe348133420 2023-10-03T10:14:29.284 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:29.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.286+0000 7fe34eb08700 1 -- 172.21.15.72:0/4048068814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe348133420 msgr2=0x7fe34809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.286+0000 7fe34eb08700 1 --2- 172.21.15.72:0/4048068814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe348133420 0x7fe34809c480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009bc0 tx=0x7fe33c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:29.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.286+0000 7fe34eb08700 1 -- 172.21.15.72:0/4048068814 shutdown_connections 2023-10-03T10:14:29.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.286+0000 7fe34eb08700 1 --2- 172.21.15.72:0/4048068814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe348134260 0x7fe34809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.286+0000 7fe34eb08700 1 --2- 172.21.15.72:0/4048068814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe348133420 0x7fe34809c480 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.286+0000 7fe34eb08700 1 --2- 172.21.15.72:0/4048068814 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe348133e30 0x7fe34809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.286+0000 7fe34eb08700 1 -- 172.21.15.72:0/4048068814 >> 172.21.15.72:0/4048068814 conn(0x7fe3480a4210 msgr2=0x7fe3481303c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:29.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.286+0000 7fe34eb08700 1 -- 172.21.15.72:0/4048068814 shutdown_connections 2023-10-03T10:14:29.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:29.286+0000 7fe34eb08700 1 -- 172.21.15.72:0/4048068814 wait complete. 2023-10-03T10:14:29.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:29.910 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:30.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.041+0000 7fc44c31f700 1 Processor -- start 2023-10-03T10:14:30.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.041+0000 7fc44c31f700 1 -- start start 2023-10-03T10:14:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc44c31f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc44409d6f0 0x7fc44409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc44c31f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc44409e000 0x7fc4441339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc44c31f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc44409e410 0x7fc444133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc44c31f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44406b460 con 0x7fc44409e000 2023-10-03T10:14:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc44c31f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44409b120 con 0x7fc44409e410 2023-10-03T10:14:30.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc44c31f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc44409a7e0 con 0x7fc44409d6f0 2023-10-03T10:14:30.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc44a0bb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc44409d6f0 0x7fc44409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc44a8bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc44409e410 0x7fc444133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc4498ba700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc44409e000 0x7fc4441339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc44a0bb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc44409d6f0 0x7fc44409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39564/0 (socket says 172.21.15.72:39564) 2023-10-03T10:14:30.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc44a8bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc44409e410 0x7fc444133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40072/0 (socket says 172.21.15.72:40072) 2023-10-03T10:14:30.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc44a0bb700 1 -- 172.21.15.72:0/1192491375 learned_addr learned my addr 172.21.15.72:0/1192491375 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:30.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc4498ba700 1 -- 172.21.15.72:0/1192491375 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc44409d6f0 msgr2=0x7fc44409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc4498ba700 1 --2- 172.21.15.72:0/1192491375 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc44409d6f0 0x7fc44409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc4498ba700 1 -- 172.21.15.72:0/1192491375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc44409e410 msgr2=0x7fc444133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc4498ba700 1 --2- 172.21.15.72:0/1192491375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc44409e410 0x7fc444133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc4498ba700 1 -- 172.21.15.72:0/1192491375 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44409a500 con 0x7fc44409e000 2023-10-03T10:14:30.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc44a8bc700 1 --2- 172.21.15.72:0/1192491375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc44409e410 0x7fc444133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc44a0bb700 1 --2- 172.21.15.72:0/1192491375 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc44409d6f0 0x7fc44409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.042+0000 7fc4498ba700 1 --2- 172.21.15.72:0/1192491375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc44409e000 0x7fc4441339f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc440009840 tx=0x7fc440009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25eb4ab25d7124b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.043+0000 7fc4490b9700 1 -- 172.21.15.72:0/1192491375 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440011830 con 0x7fc44409e000 2023-10-03T10:14:30.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.043+0000 7fc4490b9700 1 -- 172.21.15.72:0/1192491375 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc440011990 con 0x7fc44409e000 2023-10-03T10:14:30.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.043+0000 7fc4490b9700 1 -- 172.21.15.72:0/1192491375 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440011d20 con 0x7fc44409e000 2023-10-03T10:14:30.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.043+0000 7fc44c31f700 1 -- 172.21.15.72:0/1192491375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc44409e000 msgr2=0x7fc4441339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.043+0000 7fc44c31f700 1 --2- 172.21.15.72:0/1192491375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc44409e000 0x7fc4441339f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc440009840 tx=0x7fc440009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:30.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.043+0000 7fc44c31f700 1 -- 172.21.15.72:0/1192491375 shutdown_connections 2023-10-03T10:14:30.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.043+0000 7fc44c31f700 1 --2- 172.21.15.72:0/1192491375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc44409e410 0x7fc444133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.043+0000 7fc44c31f700 1 --2- 172.21.15.72:0/1192491375 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc44409d6f0 0x7fc44409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.043+0000 7fc44c31f700 1 --2- 172.21.15.72:0/1192491375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc44409e000 0x7fc4441339f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.043+0000 7fc44c31f700 1 -- 172.21.15.72:0/1192491375 >> 172.21.15.72:0/1192491375 conn(0x7fc444066f50 msgr2=0x7fc44409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.043+0000 7fc44c31f700 1 -- 172.21.15.72:0/1192491375 shutdown_connections 2023-10-03T10:14:30.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.043+0000 7fc44c31f700 1 -- 172.21.15.72:0/1192491375 wait complete. 2023-10-03T10:14:30.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.044+0000 7fc44c31f700 1 Processor -- start 2023-10-03T10:14:30.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.044+0000 7fc44c31f700 1 -- start start 2023-10-03T10:14:30.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44c31f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc44409d6f0 0x7fc4441a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44c31f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc44409e000 0x7fc4441a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44c31f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc44409e410 0x7fc4441a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44c31f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440a2090 con 0x7fc44409d6f0 2023-10-03T10:14:30.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44c31f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4441a9310 con 0x7fc44409e000 2023-10-03T10:14:30.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44c31f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc44409c710 con 0x7fc44409e410 2023-10-03T10:14:30.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44a0bb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc44409d6f0 0x7fc4441a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44a8bc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc44409e410 0x7fc4441a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44a0bb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc44409d6f0 0x7fc4441a5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46078/0 (socket says 172.21.15.72:46078) 2023-10-03T10:14:30.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc4498ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc44409e000 0x7fc4441a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44a0bb700 1 -- 172.21.15.72:0/140917825 learned_addr learned my addr 172.21.15.72:0/140917825 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:30.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44a0bb700 1 -- 172.21.15.72:0/140917825 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc44409e410 msgr2=0x7fc4441a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44a0bb700 1 --2- 172.21.15.72:0/140917825 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc44409e410 0x7fc4441a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44a0bb700 1 -- 172.21.15.72:0/140917825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc44409e000 msgr2=0x7fc4441a6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44a0bb700 1 --2- 172.21.15.72:0/140917825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc44409e000 0x7fc4441a6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44a0bb700 1 -- 172.21.15.72:0/140917825 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc438009550 con 0x7fc44409d6f0 2023-10-03T10:14:30.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44a8bc700 1 --2- 172.21.15.72:0/140917825 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc44409e410 0x7fc4441a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44a0bb700 1 --2- 172.21.15.72:0/140917825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc44409d6f0 0x7fc4441a5f40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc43800ebe0 tx=0x7fc43800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc436ffd700 1 -- 172.21.15.72:0/140917825 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43800c850 con 0x7fc44409d6f0 2023-10-03T10:14:30.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc436ffd700 1 -- 172.21.15.72:0/140917825 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43800c9b0 con 0x7fc44409d6f0 2023-10-03T10:14:30.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44c31f700 1 -- 172.21.15.72:0/140917825 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c009a70 con 0x7fc44409d6f0 2023-10-03T10:14:30.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc436ffd700 1 -- 172.21.15.72:0/140917825 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43800cd20 con 0x7fc44409d6f0 2023-10-03T10:14:30.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.045+0000 7fc44c31f700 1 -- 172.21.15.72:0/140917825 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4400094a0 con 0x7fc44409d6f0 2023-10-03T10:14:30.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.046+0000 7fc436ffd700 1 -- 172.21.15.72:0/140917825 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc438013470 con 0x7fc44409d6f0 2023-10-03T10:14:30.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.046+0000 7fc436ffd700 1 -- 172.21.15.72:0/140917825 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc43803f750 con 0x7fc44409d6f0 2023-10-03T10:14:30.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.046+0000 7fc44c31f700 1 -- 172.21.15.72:0/140917825 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4441a9450 con 0x7fc44409d6f0 2023-10-03T10:14:30.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.051+0000 7fc436ffd700 1 -- 172.21.15.72:0/140917825 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc4380232f0 con 0x7fc44409d6f0 2023-10-03T10:14:30.136 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:30.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:30.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.241+0000 7fc44c31f700 1 -- 172.21.15.72:0/140917825 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc444074ea0 con 0x7fc44409d6f0 2023-10-03T10:14:30.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.241+0000 7fc436ffd700 1 -- 172.21.15.72:0/140917825 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc438021020 con 0x7fc44409d6f0 2023-10-03T10:14:30.242 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:30.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.243+0000 7fc44c31f700 1 -- 172.21.15.72:0/140917825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc44409d6f0 msgr2=0x7fc4441a5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.243+0000 7fc44c31f700 1 --2- 172.21.15.72:0/140917825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc44409d6f0 0x7fc4441a5f40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc43800ebe0 tx=0x7fc43800eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.243+0000 7fc44c31f700 1 -- 172.21.15.72:0/140917825 shutdown_connections 2023-10-03T10:14:30.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.243+0000 7fc44c31f700 1 --2- 172.21.15.72:0/140917825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc44409d6f0 0x7fc4441a5f40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.243+0000 7fc44c31f700 1 --2- 172.21.15.72:0/140917825 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc44409e410 0x7fc4441a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.243+0000 7fc44c31f700 1 --2- 172.21.15.72:0/140917825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc44409e000 0x7fc4441a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.243+0000 7fc44c31f700 1 -- 172.21.15.72:0/140917825 >> 172.21.15.72:0/140917825 conn(0x7fc444066f50 msgr2=0x7fc4441bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.243+0000 7fc44c31f700 1 -- 172.21.15.72:0/140917825 shutdown_connections 2023-10-03T10:14:30.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.243+0000 7fc44c31f700 1 -- 172.21.15.72:0/140917825 wait complete. 2023-10-03T10:14:30.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:30.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.261+0000 7f6f9563e700 1 Processor -- start 2023-10-03T10:14:30.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.261+0000 7f6f9563e700 1 -- start start 2023-10-03T10:14:30.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.261+0000 7f6f9563e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f9009e1d0 0x7f6f90135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.261+0000 7f6f9563e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6f90135e50 0x7f6f90138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.261+0000 7f6f9563e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f9009f130 con 0x7f6f9009d6f0 2023-10-03T10:14:30.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f9563e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9009f520 con 0x7f6f90135e50 2023-10-03T10:14:30.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f9563e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9009e930 con 0x7f6f9009e1d0 2023-10-03T10:14:30.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f8e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f9009e1d0 0x7f6f90135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f8f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6f90135e50 0x7f6f90138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f8f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6f90135e50 0x7f6f90138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46088/0 (socket says 172.21.15.72:46088) 2023-10-03T10:14:30.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f8e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f9009e1d0 0x7f6f90135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40088/0 (socket says 172.21.15.72:40088) 2023-10-03T10:14:30.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f8f7fe700 1 -- 172.21.15.72:0/1386065583 learned_addr learned my addr 172.21.15.72:0/1386065583 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:30.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f8f7fe700 1 -- 172.21.15.72:0/1386065583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f9009e1d0 msgr2=0x7f6f90135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f8f7fe700 1 --2- 172.21.15.72:0/1386065583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f9009e1d0 0x7f6f90135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f8f7fe700 1 -- 172.21.15.72:0/1386065583 >> v1:172.21.15.72:6789/0 conn(0x7f6f9009d6f0 legacy=0x7f6f9009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f8f7fe700 1 -- 172.21.15.72:0/1386065583 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9009b2d0 con 0x7f6f90135e50 2023-10-03T10:14:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f8e7fc700 1 --2- 172.21.15.72:0/1386065583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f9009e1d0 0x7f6f90135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f8f7fe700 1 --2- 172.21.15.72:0/1386065583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f90135e50 0x7f6f90138230 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009e80 tx=0x7f6f8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89107ad10dd901c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f8dffb700 1 -- 172.21.15.72:0/1386065583 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800e070 con 0x7f6f90135e50 2023-10-03T10:14:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f8dffb700 1 -- 172.21.15.72:0/1386065583 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8800b8d0 con 0x7f6f90135e50 2023-10-03T10:14:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.262+0000 7f6f8dffb700 1 -- 172.21.15.72:0/1386065583 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800bc80 con 0x7f6f90135e50 2023-10-03T10:14:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.263+0000 7f6f9563e700 1 -- 172.21.15.72:0/1386065583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f90135e50 msgr2=0x7f6f90138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.263+0000 7f6f9563e700 1 --2- 172.21.15.72:0/1386065583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f90135e50 0x7f6f90138230 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009e80 tx=0x7f6f8800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.263+0000 7f6f9563e700 1 -- 172.21.15.72:0/1386065583 shutdown_connections 2023-10-03T10:14:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.263+0000 7f6f9563e700 1 --2- 172.21.15.72:0/1386065583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f90135e50 0x7f6f90138230 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.263+0000 7f6f9563e700 1 --2- 172.21.15.72:0/1386065583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f9009e1d0 0x7f6f90135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.263+0000 7f6f9563e700 1 -- 172.21.15.72:0/1386065583 >> 172.21.15.72:0/1386065583 conn(0x7f6f90066f50 msgr2=0x7f6f9009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.263+0000 7f6f9563e700 1 -- 172.21.15.72:0/1386065583 shutdown_connections 2023-10-03T10:14:30.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.263+0000 7f6f9563e700 1 -- 172.21.15.72:0/1386065583 wait complete. 2023-10-03T10:14:30.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.264+0000 7f6f9563e700 1 Processor -- start 2023-10-03T10:14:30.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.264+0000 7f6f9563e700 1 -- start start 2023-10-03T10:14:30.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.264+0000 7f6f9563e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f9009d6f0 0x7f6f90131800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.264+0000 7f6f9563e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f9009e1d0 0x7f6f90131d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.264+0000 7f6f9563e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f90135e50 0x7f6f901c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.264+0000 7f6f9563e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f901232d0 con 0x7f6f90135e50 2023-10-03T10:14:30.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f9563e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f90070480 con 0x7f6f9009d6f0 2023-10-03T10:14:30.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f9563e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9009a0c0 con 0x7f6f9009e1d0 2023-10-03T10:14:30.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f8f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f90135e50 0x7f6f901c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f8e7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f9009e1d0 0x7f6f90131d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f8f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f90135e50 0x7f6f901c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46094/0 (socket says 172.21.15.72:46094) 2023-10-03T10:14:30.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f8f7fe700 1 -- 172.21.15.72:0/4279428966 learned_addr learned my addr 172.21.15.72:0/4279428966 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:30.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f8effd700 1 --2- 172.21.15.72:0/4279428966 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f9009d6f0 0x7f6f90131800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f8e7fc700 1 -- 172.21.15.72:0/4279428966 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f9009d6f0 msgr2=0x7f6f90131800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f8e7fc700 1 --2- 172.21.15.72:0/4279428966 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f9009d6f0 0x7f6f90131800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f8e7fc700 1 -- 172.21.15.72:0/4279428966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f90135e50 msgr2=0x7f6f901c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f8e7fc700 1 --2- 172.21.15.72:0/4279428966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f90135e50 0x7f6f901c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f8e7fc700 1 -- 172.21.15.72:0/4279428966 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f840094a0 con 0x7f6f9009e1d0 2023-10-03T10:14:30.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f8f7fe700 1 --2- 172.21.15.72:0/4279428966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f90135e50 0x7f6f901c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f8e7fc700 1 --2- 172.21.15.72:0/4279428966 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f9009e1d0 0x7f6f90131d40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400e9e0 tx=0x7f6f8400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f777fe700 1 -- 172.21.15.72:0/4279428966 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400ee80 con 0x7f6f9009e1d0 2023-10-03T10:14:30.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f777fe700 1 -- 172.21.15.72:0/4279428966 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8400c850 con 0x7f6f9009e1d0 2023-10-03T10:14:30.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f9563e700 1 -- 172.21.15.72:0/4279428966 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f88009b30 con 0x7f6f9009e1d0 2023-10-03T10:14:30.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f777fe700 1 -- 172.21.15.72:0/4279428966 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400cc00 con 0x7f6f9009e1d0 2023-10-03T10:14:30.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.265+0000 7f6f9563e700 1 -- 172.21.15.72:0/4279428966 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f90122540 con 0x7f6f9009e1d0 2023-10-03T10:14:30.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.267+0000 7f6f9563e700 1 -- 172.21.15.72:0/4279428966 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f90074ea0 con 0x7f6f9009e1d0 2023-10-03T10:14:30.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.267+0000 7f6f777fe700 1 -- 172.21.15.72:0/4279428966 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f8400cd60 con 0x7f6f9009e1d0 2023-10-03T10:14:30.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.267+0000 7f6f777fe700 1 -- 172.21.15.72:0/4279428966 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6f8403f6b0 con 0x7f6f9009e1d0 2023-10-03T10:14:30.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.271+0000 7f6f777fe700 1 -- 172.21.15.72:0/4279428966 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f840232f0 con 0x7f6f9009e1d0 2023-10-03T10:14:30.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:30.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.402+0000 7fbd16d1e700 1 Processor -- start 2023-10-03T10:14:30.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.403+0000 7fbd16d1e700 1 -- start start 2023-10-03T10:14:30.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.403+0000 7fbd16d1e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbd100a0a30 0x7fbd100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.403+0000 7fbd16d1e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbd1009d630 0x7fbd100a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.403+0000 7fbd16d1e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd10133930 0x7fbd10133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.403+0000 7fbd16d1e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd100a2a70 con 0x7fbd100a0a30 2023-10-03T10:14:30.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.403+0000 7fbd16d1e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd100a01d0 con 0x7fbd10133930 2023-10-03T10:14:30.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.403+0000 7fbd16d1e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1009e2b0 con 0x7fbd1009d630 2023-10-03T10:14:30.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.404+0000 7fbd0ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbd1009d630 0x7fbd100a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.404+0000 7fbd152bb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd10133930 0x7fbd10133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.404+0000 7fbd0ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbd1009d630 0x7fbd100a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39602/0 (socket says 172.21.15.72:39602) 2023-10-03T10:14:30.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.404+0000 7fbd0ffff700 1 -- 172.21.15.72:0/2260876175 learned_addr learned my addr 172.21.15.72:0/2260876175 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:30.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.404+0000 7fbd14aba700 1 --2- 172.21.15.72:0/2260876175 >> v2:172.21.15.72:3300/0 conn(0x7fbd100a0a30 0x7fbd100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.404+0000 7fbd0ffff700 1 -- 172.21.15.72:0/2260876175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd10133930 msgr2=0x7fbd10133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.404+0000 7fbd0ffff700 1 --2- 172.21.15.72:0/2260876175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd10133930 0x7fbd10133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.404+0000 7fbd0ffff700 1 -- 172.21.15.72:0/2260876175 >> v2:172.21.15.72:3300/0 conn(0x7fbd100a0a30 msgr2=0x7fbd100a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.404+0000 7fbd0ffff700 1 --2- 172.21.15.72:0/2260876175 >> v2:172.21.15.72:3300/0 conn(0x7fbd100a0a30 0x7fbd100a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.404+0000 7fbd0ffff700 1 -- 172.21.15.72:0/2260876175 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1009dc50 con 0x7fbd1009d630 2023-10-03T10:14:30.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.404+0000 7fbd0ffff700 1 --2- 172.21.15.72:0/2260876175 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbd1009d630 0x7fbd100a1340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0098f0 tx=0x7fbcfc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=265b16e4b30c3631 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.404+0000 7fbd0f7fe700 1 -- 172.21.15.72:0/2260876175 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc011830 con 0x7fbd1009d630 2023-10-03T10:14:30.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.404+0000 7fbd0f7fe700 1 -- 172.21.15.72:0/2260876175 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcfc011990 con 0x7fbd1009d630 2023-10-03T10:14:30.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.404+0000 7fbd0f7fe700 1 -- 172.21.15.72:0/2260876175 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc011d20 con 0x7fbd1009d630 2023-10-03T10:14:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.405+0000 7fbd16d1e700 1 -- 172.21.15.72:0/2260876175 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbd1009d630 msgr2=0x7fbd100a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.405+0000 7fbd16d1e700 1 --2- 172.21.15.72:0/2260876175 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbd1009d630 0x7fbd100a1340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0098f0 tx=0x7fbcfc009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.405+0000 7fbd16d1e700 1 -- 172.21.15.72:0/2260876175 shutdown_connections 2023-10-03T10:14:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.405+0000 7fbd16d1e700 1 --2- 172.21.15.72:0/2260876175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd10133930 0x7fbd10133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.405+0000 7fbd16d1e700 1 --2- 172.21.15.72:0/2260876175 >> v2:172.21.15.72:3300/0 conn(0x7fbd100a0a30 0x7fbd100a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.405+0000 7fbd16d1e700 1 --2- 172.21.15.72:0/2260876175 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbd1009d630 0x7fbd100a1340 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.405+0000 7fbd16d1e700 1 -- 172.21.15.72:0/2260876175 >> 172.21.15.72:0/2260876175 conn(0x7fbd100a3050 msgr2=0x7fbd100a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.405+0000 7fbd16d1e700 1 -- 172.21.15.72:0/2260876175 shutdown_connections 2023-10-03T10:14:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.405+0000 7fbd16d1e700 1 -- 172.21.15.72:0/2260876175 wait complete. 2023-10-03T10:14:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.406+0000 7fbd16d1e700 1 Processor -- start 2023-10-03T10:14:30.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.406+0000 7fbd16d1e700 1 -- start start 2023-10-03T10:14:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd16d1e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbd1009d630 0x7fbd101c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd16d1e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd100a0a30 0x7fbd101c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd16d1e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd10133930 0x7fbd101c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd16d1e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd10121140 con 0x7fbd100a0a30 2023-10-03T10:14:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd16d1e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd100a4030 con 0x7fbd10133930 2023-10-03T10:14:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd16d1e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd10120570 con 0x7fbd1009d630 2023-10-03T10:14:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd0ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd100a0a30 0x7fbd101c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd0ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd100a0a30 0x7fbd101c8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46100/0 (socket says 172.21.15.72:46100) 2023-10-03T10:14:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd0ffff700 1 -- 172.21.15.72:0/3064460731 learned_addr learned my addr 172.21.15.72:0/3064460731 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd152bb700 1 --2- 172.21.15.72:0/3064460731 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd10133930 0x7fbd101c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd14aba700 1 --2- 172.21.15.72:0/3064460731 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbd1009d630 0x7fbd101c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd0ffff700 1 -- 172.21.15.72:0/3064460731 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbd1009d630 msgr2=0x7fbd101c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd0ffff700 1 --2- 172.21.15.72:0/3064460731 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbd1009d630 0x7fbd101c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd0ffff700 1 -- 172.21.15.72:0/3064460731 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd10133930 msgr2=0x7fbd101c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd0ffff700 1 --2- 172.21.15.72:0/3064460731 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd10133930 0x7fbd101c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd0ffff700 1 -- 172.21.15.72:0/3064460731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc009550 con 0x7fbd100a0a30 2023-10-03T10:14:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd152bb700 1 --2- 172.21.15.72:0/3064460731 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd10133930 0x7fbd101c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd0ffff700 1 --2- 172.21.15.72:0/3064460731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd100a0a30 0x7fbd101c8640 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc000c00 tx=0x7fbcfc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd0d7fa700 1 -- 172.21.15.72:0/3064460731 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc004450 con 0x7fbd100a0a30 2023-10-03T10:14:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.407+0000 7fbd0d7fa700 1 -- 172.21.15.72:0/3064460731 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcfc0045b0 con 0x7fbd100a0a30 2023-10-03T10:14:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.408+0000 7fbd16d1e700 1 -- 172.21.15.72:0/3064460731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd10122090 con 0x7fbd100a0a30 2023-10-03T10:14:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.408+0000 7fbd0d7fa700 1 -- 172.21.15.72:0/3064460731 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc0038c0 con 0x7fbd100a0a30 2023-10-03T10:14:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.408+0000 7fbd16d1e700 1 -- 172.21.15.72:0/3064460731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd10133300 con 0x7fbd100a0a30 2023-10-03T10:14:30.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.408+0000 7fbd0d7fa700 1 -- 172.21.15.72:0/3064460731 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbcfc021070 con 0x7fbd100a0a30 2023-10-03T10:14:30.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.409+0000 7fbd0d7fa700 1 -- 172.21.15.72:0/3064460731 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbcfc0408c0 con 0x7fbd100a0a30 2023-10-03T10:14:30.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.409+0000 7fbd16d1e700 1 -- 172.21.15.72:0/3064460731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd100747f0 con 0x7fbd100a0a30 2023-10-03T10:14:30.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.413+0000 7fbd0d7fa700 1 -- 172.21.15.72:0/3064460731 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbcfc015080 con 0x7fbd100a0a30 2023-10-03T10:14:30.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.425+0000 7f4932c08700 1 Processor -- start 2023-10-03T10:14:30.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.425+0000 7f4932c08700 1 -- start start 2023-10-03T10:14:30.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.425+0000 7f4932c08700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f492c09d6f0 0x7f492c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f4932c08700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492c09e000 0x7f492c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f4932c08700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492c09b120 con 0x7f492c09e410 2023-10-03T10:14:30.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f4932c08700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492c06b460 con 0x7f492c09d6f0 2023-10-03T10:14:30.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f4932c08700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f492c09a7e0 con 0x7f492c09e000 2023-10-03T10:14:30.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f492bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492c09e000 0x7f492c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f49311a5700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f492c09e410 0x7f492c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35314/0 (socket says 172.21.15.72:35314) 2023-10-03T10:14:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f49311a5700 1 -- 172.21.15.72:0/2327627388 learned_addr learned my addr 172.21.15.72:0/2327627388 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f49309a4700 1 --2- 172.21.15.72:0/2327627388 >> v2:172.21.15.72:3300/0 conn(0x7f492c09d6f0 0x7f492c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f49309a4700 1 -- 172.21.15.72:0/2327627388 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492c09e000 msgr2=0x7f492c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f49309a4700 1 --2- 172.21.15.72:0/2327627388 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492c09e000 0x7f492c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f49309a4700 1 -- 172.21.15.72:0/2327627388 >> v1:172.21.15.72:6789/0 conn(0x7f492c09e410 legacy=0x7f492c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f49309a4700 1 -- 172.21.15.72:0/2327627388 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c09a500 con 0x7f492c09d6f0 2023-10-03T10:14:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f492b7fe700 1 -- 172.21.15.72:0/2327627388 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744048148 0 0) 0x7f492c09b120 con 0x7f492c09e410 2023-10-03T10:14:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f492bfff700 1 --2- 172.21.15.72:0/2327627388 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492c09e000 0x7f492c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f49309a4700 1 --2- 172.21.15.72:0/2327627388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c09d6f0 0x7f492c09dac0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4920009840 tx=0x7f4920009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e126c0f169f2d1bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f492b7fe700 1 -- 172.21.15.72:0/2327627388 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920011830 con 0x7f492c09d6f0 2023-10-03T10:14:30.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f492b7fe700 1 -- 172.21.15.72:0/2327627388 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4920011990 con 0x7f492c09d6f0 2023-10-03T10:14:30.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.426+0000 7f492b7fe700 1 -- 172.21.15.72:0/2327627388 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920011d20 con 0x7f492c09d6f0 2023-10-03T10:14:30.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.427+0000 7f4932c08700 1 -- 172.21.15.72:0/2327627388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c09d6f0 msgr2=0x7f492c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.427+0000 7f4932c08700 1 --2- 172.21.15.72:0/2327627388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c09d6f0 0x7f492c09dac0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4920009840 tx=0x7f4920009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:30.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.427+0000 7f4932c08700 1 -- 172.21.15.72:0/2327627388 shutdown_connections 2023-10-03T10:14:30.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.427+0000 7f4932c08700 1 --2- 172.21.15.72:0/2327627388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c09d6f0 0x7f492c09dac0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.427+0000 7f4932c08700 1 --2- 172.21.15.72:0/2327627388 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492c09e000 0x7f492c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.427+0000 7f4932c08700 1 -- 172.21.15.72:0/2327627388 >> 172.21.15.72:0/2327627388 conn(0x7f492c066f50 msgr2=0x7f492c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.427+0000 7f4932c08700 1 -- 172.21.15.72:0/2327627388 shutdown_connections 2023-10-03T10:14:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.427+0000 7f4932c08700 1 -- 172.21.15.72:0/2327627388 wait complete. 2023-10-03T10:14:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.428+0000 7f4932c08700 1 Processor -- start 2023-10-03T10:14:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.428+0000 7f4932c08700 1 -- start start 2023-10-03T10:14:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f4932c08700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c09d6f0 0x7f492c1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f4932c08700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492c09e000 0x7f492c1c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f4932c08700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492c09e410 0x7f492c1c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f4932c08700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1a6c70 con 0x7f492c09d6f0 2023-10-03T10:14:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f4932c08700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1a6520 con 0x7f492c09e000 2023-10-03T10:14:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f4932c08700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f492c0a2d60 con 0x7f492c09e410 2023-10-03T10:14:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f49309a4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c09d6f0 0x7f492c1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f49309a4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c09d6f0 0x7f492c1c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46114/0 (socket says 172.21.15.72:46114) 2023-10-03T10:14:30.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f49309a4700 1 -- 172.21.15.72:0/2036916113 learned_addr learned my addr 172.21.15.72:0/2036916113 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:30.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f492bfff700 1 --2- 172.21.15.72:0/2036916113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492c09e000 0x7f492c1c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f49311a5700 1 --2- 172.21.15.72:0/2036916113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492c09e410 0x7f492c1c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f49309a4700 1 -- 172.21.15.72:0/2036916113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492c09e410 msgr2=0x7f492c1c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f49309a4700 1 --2- 172.21.15.72:0/2036916113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492c09e410 0x7f492c1c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f49309a4700 1 -- 172.21.15.72:0/2036916113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492c09e000 msgr2=0x7f492c1c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f49309a4700 1 --2- 172.21.15.72:0/2036916113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492c09e000 0x7f492c1c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f49309a4700 1 -- 172.21.15.72:0/2036916113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49180094a0 con 0x7f492c09d6f0 2023-10-03T10:14:30.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f49311a5700 1 --2- 172.21.15.72:0/2036916113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492c09e410 0x7f492c1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f492bfff700 1 --2- 172.21.15.72:0/2036916113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492c09e000 0x7f492c1c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.429+0000 7f49309a4700 1 --2- 172.21.15.72:0/2036916113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c09d6f0 0x7f492c1c8020 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f49200090b0 tx=0x7f4920004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.430+0000 7f49297fa700 1 -- 172.21.15.72:0/2036916113 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920004340 con 0x7f492c09d6f0 2023-10-03T10:14:30.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.430+0000 7f49297fa700 1 -- 172.21.15.72:0/2036916113 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492001f070 con 0x7f492c09d6f0 2023-10-03T10:14:30.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.430+0000 7f4932c08700 1 -- 172.21.15.72:0/2036916113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49200094a0 con 0x7f492c09d6f0 2023-10-03T10:14:30.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.430+0000 7f49297fa700 1 -- 172.21.15.72:0/2036916113 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49200036a0 con 0x7f492c09d6f0 2023-10-03T10:14:30.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.430+0000 7f4932c08700 1 -- 172.21.15.72:0/2036916113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492c1a7010 con 0x7f492c09d6f0 2023-10-03T10:14:30.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.430+0000 7f49297fa700 1 -- 172.21.15.72:0/2036916113 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4920021030 con 0x7f492c09d6f0 2023-10-03T10:14:30.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.431+0000 7f4932c08700 1 -- 172.21.15.72:0/2036916113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492c1a8060 con 0x7f492c09d6f0 2023-10-03T10:14:30.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.431+0000 7f49297fa700 1 -- 172.21.15.72:0/2036916113 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4920040870 con 0x7f492c09d6f0 2023-10-03T10:14:30.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.439+0000 7f49297fa700 1 -- 172.21.15.72:0/2036916113 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49200199a0 con 0x7f492c09d6f0 2023-10-03T10:14:30.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.529+0000 7f6f9563e700 1 -- 172.21.15.72:0/4279428966 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6f901322e0 con 0x7f6f9009e1d0 2023-10-03T10:14:30.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.529+0000 7f6f777fe700 1 -- 172.21.15.72:0/4279428966 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6f84021030 con 0x7f6f9009e1d0 2023-10-03T10:14:30.530 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.531+0000 7f6f9563e700 1 -- 172.21.15.72:0/4279428966 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f9009e1d0 msgr2=0x7f6f90131d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.531+0000 7f6f9563e700 1 --2- 172.21.15.72:0/4279428966 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f9009e1d0 0x7f6f90131d40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400e9e0 tx=0x7f6f8400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.531+0000 7f6f9563e700 1 -- 172.21.15.72:0/4279428966 shutdown_connections 2023-10-03T10:14:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.531+0000 7f6f9563e700 1 --2- 172.21.15.72:0/4279428966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f90135e50 0x7f6f901c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.531+0000 7f6f9563e700 1 --2- 172.21.15.72:0/4279428966 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f9009d6f0 0x7f6f90131800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.531+0000 7f6f9563e700 1 --2- 172.21.15.72:0/4279428966 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f9009e1d0 0x7f6f90131d40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.531+0000 7f6f9563e700 1 -- 172.21.15.72:0/4279428966 >> 172.21.15.72:0/4279428966 conn(0x7f6f90066f50 msgr2=0x7f6f900711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.531+0000 7f6f9563e700 1 -- 172.21.15.72:0/4279428966 shutdown_connections 2023-10-03T10:14:30.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.531+0000 7f6f9563e700 1 -- 172.21.15.72:0/4279428966 wait complete. 2023-10-03T10:14:30.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:30.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.609+0000 7fbd16d1e700 1 -- 172.21.15.72:0/3064460731 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbd10072980 con 0x7fbd100a0a30 2023-10-03T10:14:30.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.609+0000 7fbd0d7fa700 1 -- 172.21.15.72:0/3064460731 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbcfc029020 con 0x7fbd100a0a30 2023-10-03T10:14:30.609 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:30.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.611+0000 7fbd16d1e700 1 -- 172.21.15.72:0/3064460731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd100a0a30 msgr2=0x7fbd101c8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.611+0000 7fbd16d1e700 1 --2- 172.21.15.72:0/3064460731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd100a0a30 0x7fbd101c8640 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc000c00 tx=0x7fbcfc004750 comp rx=0 tx=0).stop 2023-10-03T10:14:30.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.611+0000 7fbd16d1e700 1 -- 172.21.15.72:0/3064460731 shutdown_connections 2023-10-03T10:14:30.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.611+0000 7fbd16d1e700 1 --2- 172.21.15.72:0/3064460731 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbd10133930 0x7fbd101c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.611+0000 7fbd16d1e700 1 --2- 172.21.15.72:0/3064460731 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbd1009d630 0x7fbd101c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.611+0000 7fbd16d1e700 1 --2- 172.21.15.72:0/3064460731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd100a0a30 0x7fbd101c8640 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.611+0000 7fbd16d1e700 1 -- 172.21.15.72:0/3064460731 >> 172.21.15.72:0/3064460731 conn(0x7fbd100a3050 msgr2=0x7fbd1009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.611+0000 7fbd16d1e700 1 -- 172.21.15.72:0/3064460731 shutdown_connections 2023-10-03T10:14:30.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.611+0000 7fbd16d1e700 1 -- 172.21.15.72:0/3064460731 wait complete. 2023-10-03T10:14:30.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.637+0000 7f4932c08700 1 -- 172.21.15.72:0/2036916113 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f492c074ea0 con 0x7f492c09d6f0 2023-10-03T10:14:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.637+0000 7f49297fa700 1 -- 172.21.15.72:0/2036916113 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f49200193b0 con 0x7f492c09d6f0 2023-10-03T10:14:30.638 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.639+0000 7f4932c08700 1 -- 172.21.15.72:0/2036916113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c09d6f0 msgr2=0x7f492c1c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.639+0000 7f4932c08700 1 --2- 172.21.15.72:0/2036916113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c09d6f0 0x7f492c1c8020 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f49200090b0 tx=0x7f4920004750 comp rx=0 tx=0).stop 2023-10-03T10:14:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.639+0000 7f4932c08700 1 -- 172.21.15.72:0/2036916113 shutdown_connections 2023-10-03T10:14:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.639+0000 7f4932c08700 1 --2- 172.21.15.72:0/2036916113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c09d6f0 0x7f492c1c8020 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.639+0000 7f4932c08700 1 --2- 172.21.15.72:0/2036916113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f492c09e410 0x7f492c1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.639+0000 7f4932c08700 1 --2- 172.21.15.72:0/2036916113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f492c09e000 0x7f492c1c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.639+0000 7f4932c08700 1 -- 172.21.15.72:0/2036916113 >> 172.21.15.72:0/2036916113 conn(0x7f492c066f50 msgr2=0x7f492c1bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.639+0000 7f4932c08700 1 -- 172.21.15.72:0/2036916113 shutdown_connections 2023-10-03T10:14:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:30.639+0000 7f4932c08700 1 -- 172.21.15.72:0/2036916113 wait complete. 2023-10-03T10:14:30.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:31.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.383+0000 7f3597dd9700 1 Processor -- start 2023-10-03T10:14:31.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.383+0000 7f3597dd9700 1 -- start start 2023-10-03T10:14:31.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3597dd9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35901338a0 0x7f3590133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3597dd9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f359009de50 0x7f359009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3597dd9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359006ef30 con 0x7f359009e760 2023-10-03T10:14:31.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3597dd9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359006fef0 con 0x7f35901338a0 2023-10-03T10:14:31.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3597dd9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35901334b0 con 0x7f359009de50 2023-10-03T10:14:31.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3595b75700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35901338a0 0x7f3590133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3595374700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f359009de50 0x7f359009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3595374700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f359009de50 0x7f359009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40138/0 (socket says 172.21.15.72:40138) 2023-10-03T10:14:31.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3595b75700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35901338a0 0x7f3590133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46122/0 (socket says 172.21.15.72:46122) 2023-10-03T10:14:31.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3595374700 1 -- 172.21.15.72:0/2636637458 learned_addr learned my addr 172.21.15.72:0/2636637458 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:31.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3595374700 1 -- 172.21.15.72:0/2636637458 >> v2:172.21.15.72:3300/0 conn(0x7f35901338a0 msgr2=0x7f3590133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3595374700 1 --2- 172.21.15.72:0/2636637458 >> v2:172.21.15.72:3300/0 conn(0x7f35901338a0 0x7f3590133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3595374700 1 -- 172.21.15.72:0/2636637458 >> v1:172.21.15.72:6789/0 conn(0x7f359009e760 legacy=0x7f359013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3595374700 1 -- 172.21.15.72:0/2636637458 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359006fc30 con 0x7f359009de50 2023-10-03T10:14:31.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3595b75700 1 --2- 172.21.15.72:0/2636637458 >> v2:172.21.15.72:3300/0 conn(0x7f35901338a0 0x7f3590133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3595374700 1 --2- 172.21.15.72:0/2636637458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f359009de50 0x7f359009e220 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f358c0098f0 tx=0x7f358c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cf01c02fbbe63ac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3594b73700 1 -- 172.21.15.72:0/2636637458 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c011830 con 0x7f359009de50 2023-10-03T10:14:31.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3594b73700 1 -- 172.21.15.72:0/2636637458 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c011990 con 0x7f359009de50 2023-10-03T10:14:31.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.384+0000 7f3594b73700 1 -- 172.21.15.72:0/2636637458 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c011d20 con 0x7f359009de50 2023-10-03T10:14:31.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.385+0000 7f3597dd9700 1 -- 172.21.15.72:0/2636637458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f359009de50 msgr2=0x7f359009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.385+0000 7f3597dd9700 1 --2- 172.21.15.72:0/2636637458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f359009de50 0x7f359009e220 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f358c0098f0 tx=0x7f358c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:31.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.385+0000 7f3597dd9700 1 -- 172.21.15.72:0/2636637458 shutdown_connections 2023-10-03T10:14:31.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.385+0000 7f3597dd9700 1 --2- 172.21.15.72:0/2636637458 >> v2:172.21.15.72:3300/0 conn(0x7f35901338a0 0x7f3590133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.385+0000 7f3597dd9700 1 --2- 172.21.15.72:0/2636637458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f359009de50 0x7f359009e220 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.385+0000 7f3597dd9700 1 -- 172.21.15.72:0/2636637458 >> 172.21.15.72:0/2636637458 conn(0x7f35900a2aa0 msgr2=0x7f35900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.385+0000 7f3597dd9700 1 -- 172.21.15.72:0/2636637458 shutdown_connections 2023-10-03T10:14:31.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.385+0000 7f3597dd9700 1 -- 172.21.15.72:0/2636637458 wait complete. 2023-10-03T10:14:31.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.386+0000 7f3597dd9700 1 Processor -- start 2023-10-03T10:14:31.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.386+0000 7f3597dd9700 1 -- start start 2023-10-03T10:14:31.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.386+0000 7f3597dd9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f359009de50 0x7f359011b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.386+0000 7f3597dd9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f359009e760 0x7f359011bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.386+0000 7f3597dd9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35901338a0 0x7f359011c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.386+0000 7f3597dd9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359011cd40 con 0x7f359009e760 2023-10-03T10:14:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.386+0000 7f3597dd9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359012ec60 con 0x7f359009de50 2023-10-03T10:14:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.386+0000 7f3597dd9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f359011daa0 con 0x7f35901338a0 2023-10-03T10:14:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.386+0000 7f3595b75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f359009de50 0x7f359011b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.386+0000 7f3595b75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f359009de50 0x7f359011b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40144/0 (socket says 172.21.15.72:40144) 2023-10-03T10:14:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.386+0000 7f3595b75700 1 -- 172.21.15.72:0/3022648030 learned_addr learned my addr 172.21.15.72:0/3022648030 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.386+0000 7f3595374700 1 --2- 172.21.15.72:0/3022648030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f359009e760 0x7f359011bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.386+0000 7f3596376700 1 --2- 172.21.15.72:0/3022648030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35901338a0 0x7f359011c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.387+0000 7f3595b75700 1 -- 172.21.15.72:0/3022648030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35901338a0 msgr2=0x7f359011c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.387+0000 7f3595b75700 1 --2- 172.21.15.72:0/3022648030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35901338a0 0x7f359011c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.387+0000 7f3595b75700 1 -- 172.21.15.72:0/3022648030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f359009e760 msgr2=0x7f359011bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.387+0000 7f3595b75700 1 --2- 172.21.15.72:0/3022648030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f359009e760 0x7f359011bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.387+0000 7f3595b75700 1 -- 172.21.15.72:0/3022648030 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35800094a0 con 0x7f359009de50 2023-10-03T10:14:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.387+0000 7f3595374700 1 --2- 172.21.15.72:0/3022648030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f359009e760 0x7f359011bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.387+0000 7f3595b75700 1 --2- 172.21.15.72:0/3022648030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f359009de50 0x7f359011b870 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f358000ebe0 tx=0x7f358000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.387+0000 7f35867fc700 1 -- 172.21.15.72:0/3022648030 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358000c850 con 0x7f359009de50 2023-10-03T10:14:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.387+0000 7f35867fc700 1 -- 172.21.15.72:0/3022648030 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358000c9b0 con 0x7f359009de50 2023-10-03T10:14:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.387+0000 7f3597dd9700 1 -- 172.21.15.72:0/3022648030 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c009550 con 0x7f359009de50 2023-10-03T10:14:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.387+0000 7f35867fc700 1 -- 172.21.15.72:0/3022648030 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358000cd40 con 0x7f359009de50 2023-10-03T10:14:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.387+0000 7f3597dd9700 1 -- 172.21.15.72:0/3022648030 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359011f100 con 0x7f359009de50 2023-10-03T10:14:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.388+0000 7f35867fc700 1 -- 172.21.15.72:0/3022648030 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3580013470 con 0x7f359009de50 2023-10-03T10:14:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.388+0000 7f35867fc700 1 -- 172.21.15.72:0/3022648030 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f358003f5d0 con 0x7f359009de50 2023-10-03T10:14:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.388+0000 7f3597dd9700 1 -- 172.21.15.72:0/3022648030 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359011f100 con 0x7f359009de50 2023-10-03T10:14:31.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.393+0000 7f35867fc700 1 -- 172.21.15.72:0/3022648030 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f359011f100 con 0x7f359009de50 2023-10-03T10:14:31.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:31.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.577+0000 7f3597dd9700 1 -- 172.21.15.72:0/3022648030 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f359011f100 con 0x7f359009de50 2023-10-03T10:14:31.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.577+0000 7f35867fc700 1 -- 172.21.15.72:0/3022648030 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f359011f100 con 0x7f359009de50 2023-10-03T10:14:31.578 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:31.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.579+0000 7f3597dd9700 1 -- 172.21.15.72:0/3022648030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f359009de50 msgr2=0x7f359011b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.579+0000 7f3597dd9700 1 --2- 172.21.15.72:0/3022648030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f359009de50 0x7f359011b870 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f358000ebe0 tx=0x7f358000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.579+0000 7f3597dd9700 1 -- 172.21.15.72:0/3022648030 shutdown_connections 2023-10-03T10:14:31.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.579+0000 7f3597dd9700 1 --2- 172.21.15.72:0/3022648030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35901338a0 0x7f359011c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.579+0000 7f3597dd9700 1 --2- 172.21.15.72:0/3022648030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f359009de50 0x7f359011b870 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.579+0000 7f3597dd9700 1 --2- 172.21.15.72:0/3022648030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f359009e760 0x7f359011bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.579+0000 7f3597dd9700 1 -- 172.21.15.72:0/3022648030 >> 172.21.15.72:0/3022648030 conn(0x7f35900a2aa0 msgr2=0x7f3590130610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.579+0000 7f3597dd9700 1 -- 172.21.15.72:0/3022648030 shutdown_connections 2023-10-03T10:14:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.579+0000 7f3597dd9700 1 -- 172.21.15.72:0/3022648030 wait complete. 2023-10-03T10:14:31.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:31.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:31.653 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:31.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.669+0000 7f8a3006a700 1 Processor -- start 2023-10-03T10:14:31.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.669+0000 7f8a3006a700 1 -- start start 2023-10-03T10:14:31.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.670+0000 7f8a3006a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2809f410 0x7f8a28136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.670+0000 7f8a3006a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a28136fe0 0x7f8a281393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.670+0000 7f8a3006a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a28070940 con 0x7f8a2809e930 2023-10-03T10:14:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.670+0000 7f8a3006a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2806fd60 con 0x7f8a28136fe0 2023-10-03T10:14:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.670+0000 7f8a3006a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2806fa80 con 0x7f8a2809f410 2023-10-03T10:14:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.670+0000 7f8a2e607700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a28136fe0 0x7f8a281393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.670+0000 7f8a2d605700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2809f410 0x7f8a28136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.670+0000 7f8a2e607700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a28136fe0 0x7f8a281393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46146/0 (socket says 172.21.15.72:46146) 2023-10-03T10:14:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.670+0000 7f8a2e607700 1 -- 172.21.15.72:0/2238974142 learned_addr learned my addr 172.21.15.72:0/2238974142 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.670+0000 7f8a2d605700 1 -- 172.21.15.72:0/2238974142 >> v2:172.21.15.72:3300/0 conn(0x7f8a28136fe0 msgr2=0x7f8a281393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.670+0000 7f8a2d605700 1 --2- 172.21.15.72:0/2238974142 >> v2:172.21.15.72:3300/0 conn(0x7f8a28136fe0 0x7f8a281393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.670+0000 7f8a2d605700 1 -- 172.21.15.72:0/2238974142 >> v1:172.21.15.72:6789/0 conn(0x7f8a2809e930 legacy=0x7f8a2809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.670+0000 7f8a2d605700 1 -- 172.21.15.72:0/2238974142 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2809fb60 con 0x7f8a2809f410 2023-10-03T10:14:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.670+0000 7f8a2e607700 1 --2- 172.21.15.72:0/2238974142 >> v2:172.21.15.72:3300/0 conn(0x7f8a28136fe0 0x7f8a281393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.671+0000 7f8a2d605700 1 --2- 172.21.15.72:0/2238974142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2809f410 0x7f8a28136aa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009840 tx=0x7f8a18009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d2e09abfe4335e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.671+0000 7f8a2ce04700 1 -- 172.21.15.72:0/2238974142 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18011830 con 0x7f8a2809f410 2023-10-03T10:14:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.671+0000 7f8a2ce04700 1 -- 172.21.15.72:0/2238974142 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a18011990 con 0x7f8a2809f410 2023-10-03T10:14:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.671+0000 7f8a2ce04700 1 -- 172.21.15.72:0/2238974142 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18011d20 con 0x7f8a2809f410 2023-10-03T10:14:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.671+0000 7f8a3006a700 1 -- 172.21.15.72:0/2238974142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2809f410 msgr2=0x7f8a28136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.671+0000 7f8a3006a700 1 --2- 172.21.15.72:0/2238974142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2809f410 0x7f8a28136aa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009840 tx=0x7f8a18009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.671+0000 7f8a3006a700 1 -- 172.21.15.72:0/2238974142 shutdown_connections 2023-10-03T10:14:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.671+0000 7f8a3006a700 1 --2- 172.21.15.72:0/2238974142 >> v2:172.21.15.72:3300/0 conn(0x7f8a28136fe0 0x7f8a281393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.671+0000 7f8a3006a700 1 --2- 172.21.15.72:0/2238974142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a2809f410 0x7f8a28136aa0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.671+0000 7f8a3006a700 1 -- 172.21.15.72:0/2238974142 >> 172.21.15.72:0/2238974142 conn(0x7f8a280a4210 msgr2=0x7f8a280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.671+0000 7f8a3006a700 1 -- 172.21.15.72:0/2238974142 shutdown_connections 2023-10-03T10:14:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.672+0000 7f8a3006a700 1 -- 172.21.15.72:0/2238974142 wait complete. 2023-10-03T10:14:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.672+0000 7f8a3006a700 1 Processor -- start 2023-10-03T10:14:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.672+0000 7f8a3006a700 1 -- start start 2023-10-03T10:14:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a3006a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a2809e930 0x7f8a281c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a3006a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2809f410 0x7f8a281c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a3006a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a28136fe0 0x7f8a281c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a3006a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a281223e0 con 0x7f8a2809f410 2023-10-03T10:14:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a3006a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2806d4c0 con 0x7f8a28136fe0 2023-10-03T10:14:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a3006a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a28121db0 con 0x7f8a2809e930 2023-10-03T10:14:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a2d605700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2809f410 0x7f8a281c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a2d605700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2809f410 0x7f8a281c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46158/0 (socket says 172.21.15.72:46158) 2023-10-03T10:14:31.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a2de06700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a2809e930 0x7f8a281c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a2d605700 1 -- 172.21.15.72:0/1375677022 learned_addr learned my addr 172.21.15.72:0/1375677022 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a2d605700 1 -- 172.21.15.72:0/1375677022 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a2809e930 msgr2=0x7f8a281c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a2d605700 1 --2- 172.21.15.72:0/1375677022 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a2809e930 0x7f8a281c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a2d605700 1 -- 172.21.15.72:0/1375677022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a28136fe0 msgr2=0x7f8a281c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a2d605700 1 --2- 172.21.15.72:0/1375677022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a28136fe0 0x7f8a281c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a2d605700 1 -- 172.21.15.72:0/1375677022 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a20009b30 con 0x7f8a2809f410 2023-10-03T10:14:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a2de06700 1 --2- 172.21.15.72:0/1375677022 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a2809e930 0x7f8a281c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.673+0000 7f8a2d605700 1 --2- 172.21.15.72:0/1375677022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2809f410 0x7f8a281c8830 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009fd0 tx=0x7f8a18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.674+0000 7f8a1e7fc700 1 -- 172.21.15.72:0/1375677022 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a180036a0 con 0x7f8a2809f410 2023-10-03T10:14:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.674+0000 7f8a1e7fc700 1 -- 172.21.15.72:0/1375677022 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1801f070 con 0x7f8a2809f410 2023-10-03T10:14:31.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.674+0000 7f8a3006a700 1 -- 172.21.15.72:0/1375677022 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a180094a0 con 0x7f8a2809f410 2023-10-03T10:14:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.674+0000 7f8a1e7fc700 1 -- 172.21.15.72:0/1375677022 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18003a60 con 0x7f8a2809f410 2023-10-03T10:14:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.674+0000 7f8a3006a700 1 -- 172.21.15.72:0/1375677022 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a28071d20 con 0x7f8a2809f410 2023-10-03T10:14:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.675+0000 7f8a1e7fc700 1 -- 172.21.15.72:0/1375677022 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a18003bc0 con 0x7f8a2809f410 2023-10-03T10:14:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.675+0000 7f8a3006a700 1 -- 172.21.15.72:0/1375677022 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a281221e0 con 0x7f8a2809f410 2023-10-03T10:14:31.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.675+0000 7f8a1e7fc700 1 -- 172.21.15.72:0/1375677022 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8a18021070 con 0x7f8a2809f410 2023-10-03T10:14:31.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.680+0000 7f8a1e7fc700 1 -- 172.21.15.72:0/1375677022 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a18015070 con 0x7f8a2809f410 2023-10-03T10:14:31.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.763+0000 7f2a33a4d700 1 Processor -- start 2023-10-03T10:14:31.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.763+0000 7f2a33a4d700 1 -- start start 2023-10-03T10:14:31.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a33a4d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a2c1316c0 0x7f2a2c131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a33a4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c06ae80 0x7f2a2c139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a33a4d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2c09e130 con 0x7f2a2c09d9f0 2023-10-03T10:14:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a33a4d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c1312b0 con 0x7f2a2c1316c0 2023-10-03T10:14:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a33a4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c09f6e0 con 0x7f2a2c06ae80 2023-10-03T10:14:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a317e9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a2c1316c0 0x7f2a2c131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a30fe8700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2a2c09d9f0 0x7f2a2c06a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35336/0 (socket says 172.21.15.72:35336) 2023-10-03T10:14:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a30fe8700 1 -- 172.21.15.72:0/3910996121 learned_addr learned my addr 172.21.15.72:0/3910996121 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a31fea700 1 --2- 172.21.15.72:0/3910996121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c06ae80 0x7f2a2c139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a23fff700 1 -- 172.21.15.72:0/3910996121 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301901088 0 0) 0x7f2a1c001110 con 0x7f2a2c09d9f0 2023-10-03T10:14:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a23fff700 1 -- 172.21.15.72:0/3910996121 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a180035b0 con 0x7f2a2c09d9f0 2023-10-03T10:14:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a31fea700 1 -- 172.21.15.72:0/3910996121 >> v2:172.21.15.72:3300/0 conn(0x7f2a2c1316c0 msgr2=0x7f2a2c131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a31fea700 1 --2- 172.21.15.72:0/3910996121 >> v2:172.21.15.72:3300/0 conn(0x7f2a2c1316c0 0x7f2a2c131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a31fea700 1 -- 172.21.15.72:0/3910996121 >> v1:172.21.15.72:6789/0 conn(0x7f2a2c09d9f0 legacy=0x7f2a2c06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a31fea700 1 -- 172.21.15.72:0/3910996121 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c09e760 con 0x7f2a2c06ae80 2023-10-03T10:14:31.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a317e9700 1 --2- 172.21.15.72:0/3910996121 >> v2:172.21.15.72:3300/0 conn(0x7f2a2c1316c0 0x7f2a2c131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.764+0000 7f2a31fea700 1 --2- 172.21.15.72:0/3910996121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c06ae80 0x7f2a2c139550 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009d90 tx=0x7f2a2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10fa94d62298daed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.765+0000 7f2a23fff700 1 -- 172.21.15.72:0/3910996121 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2400e070 con 0x7f2a2c06ae80 2023-10-03T10:14:31.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.765+0000 7f2a23fff700 1 -- 172.21.15.72:0/3910996121 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2400bb20 con 0x7f2a2c06ae80 2023-10-03T10:14:31.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.765+0000 7f2a23fff700 1 -- 172.21.15.72:0/3910996121 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2400be90 con 0x7f2a2c06ae80 2023-10-03T10:14:31.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.765+0000 7f2a33a4d700 1 -- 172.21.15.72:0/3910996121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c06ae80 msgr2=0x7f2a2c139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.765+0000 7f2a33a4d700 1 --2- 172.21.15.72:0/3910996121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c06ae80 0x7f2a2c139550 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009d90 tx=0x7f2a2400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:31.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.765+0000 7f2a33a4d700 1 -- 172.21.15.72:0/3910996121 shutdown_connections 2023-10-03T10:14:31.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.765+0000 7f2a33a4d700 1 --2- 172.21.15.72:0/3910996121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c06ae80 0x7f2a2c139550 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.765+0000 7f2a33a4d700 1 --2- 172.21.15.72:0/3910996121 >> v2:172.21.15.72:3300/0 conn(0x7f2a2c1316c0 0x7f2a2c131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.765+0000 7f2a33a4d700 1 -- 172.21.15.72:0/3910996121 >> 172.21.15.72:0/3910996121 conn(0x7f2a2c066f50 msgr2=0x7f2a2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.765+0000 7f2a33a4d700 1 -- 172.21.15.72:0/3910996121 shutdown_connections 2023-10-03T10:14:31.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.765+0000 7f2a33a4d700 1 -- 172.21.15.72:0/3910996121 wait complete. 2023-10-03T10:14:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.766+0000 7f2a33a4d700 1 Processor -- start 2023-10-03T10:14:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.766+0000 7f2a33a4d700 1 -- start start 2023-10-03T10:14:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a33a4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c06ae80 0x7f2a2c11a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a33a4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2c09d9f0 0x7f2a2c11aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a33a4d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c1316c0 0x7f2a2c11af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a33a4d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c11dad0 con 0x7f2a2c09d9f0 2023-10-03T10:14:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a33a4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c11dcb0 con 0x7f2a2c06ae80 2023-10-03T10:14:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a33a4d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c0a3540 con 0x7f2a2c1316c0 2023-10-03T10:14:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a317e9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c06ae80 0x7f2a2c11a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a31fea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c1316c0 0x7f2a2c11af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a317e9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c06ae80 0x7f2a2c11a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40176/0 (socket says 172.21.15.72:40176) 2023-10-03T10:14:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a317e9700 1 -- 172.21.15.72:0/3913773711 learned_addr learned my addr 172.21.15.72:0/3913773711 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a30fe8700 1 --2- 172.21.15.72:0/3913773711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2c09d9f0 0x7f2a2c11aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a31fea700 1 -- 172.21.15.72:0/3913773711 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c06ae80 msgr2=0x7f2a2c11a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a31fea700 1 --2- 172.21.15.72:0/3913773711 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c06ae80 0x7f2a2c11a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a31fea700 1 -- 172.21.15.72:0/3913773711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2c09d9f0 msgr2=0x7f2a2c11aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a31fea700 1 --2- 172.21.15.72:0/3913773711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2c09d9f0 0x7f2a2c11aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a31fea700 1 -- 172.21.15.72:0/3913773711 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a280094a0 con 0x7f2a2c1316c0 2023-10-03T10:14:31.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.767+0000 7f2a31fea700 1 --2- 172.21.15.72:0/3913773711 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c1316c0 0x7f2a2c11af50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2a24016000 tx=0x7f2a24004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.768+0000 7f2a21ffb700 1 -- 172.21.15.72:0/3913773711 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2401f7a0 con 0x7f2a2c1316c0 2023-10-03T10:14:31.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.768+0000 7f2a21ffb700 1 -- 172.21.15.72:0/3913773711 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a24023070 con 0x7f2a2c1316c0 2023-10-03T10:14:31.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.768+0000 7f2a33a4d700 1 -- 172.21.15.72:0/3913773711 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a24009a70 con 0x7f2a2c1316c0 2023-10-03T10:14:31.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.768+0000 7f2a21ffb700 1 -- 172.21.15.72:0/3913773711 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2401fb80 con 0x7f2a2c1316c0 2023-10-03T10:14:31.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.768+0000 7f2a33a4d700 1 -- 172.21.15.72:0/3913773711 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c11c2e0 con 0x7f2a2c1316c0 2023-10-03T10:14:31.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.769+0000 7f2a21ffb700 1 -- 172.21.15.72:0/3913773711 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a2401fce0 con 0x7f2a2c1316c0 2023-10-03T10:14:31.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.769+0000 7f2a21ffb700 1 -- 172.21.15.72:0/3913773711 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2a24025070 con 0x7f2a2c1316c0 2023-10-03T10:14:31.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.769+0000 7f2a33a4d700 1 -- 172.21.15.72:0/3913773711 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c070080 con 0x7f2a2c1316c0 2023-10-03T10:14:31.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.774+0000 7f2a21ffb700 1 -- 172.21.15.72:0/3913773711 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a24029bd0 con 0x7f2a2c1316c0 2023-10-03T10:14:31.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.797+0000 7ff24e42e700 1 Processor -- start 2023-10-03T10:14:31.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.798+0000 7ff24e42e700 1 -- start start 2023-10-03T10:14:31.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.798+0000 7ff24e42e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff24809e1d0 0x7ff248135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.798+0000 7ff24e42e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff248135e50 0x7ff248138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.798+0000 7ff24e42e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24809f130 con 0x7ff24809d6f0 2023-10-03T10:14:31.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.798+0000 7ff24e42e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24809f520 con 0x7ff248135e50 2023-10-03T10:14:31.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.798+0000 7ff24e42e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24809e930 con 0x7ff24809e1d0 2023-10-03T10:14:31.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.798+0000 7ff2477fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff24809e1d0 0x7ff248135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.798+0000 7ff2477fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff24809e1d0 0x7ff248135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40182/0 (socket says 172.21.15.72:40182) 2023-10-03T10:14:31.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.798+0000 7ff2477fe700 1 -- 172.21.15.72:0/1021819431 learned_addr learned my addr 172.21.15.72:0/1021819431 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:31.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.798+0000 7ff24c9cb700 1 --2- 172.21.15.72:0/1021819431 >> v2:172.21.15.72:3300/0 conn(0x7ff248135e50 0x7ff248138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.798+0000 7ff2477fe700 1 -- 172.21.15.72:0/1021819431 >> v2:172.21.15.72:3300/0 conn(0x7ff248135e50 msgr2=0x7ff248138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.798+0000 7ff2477fe700 1 --2- 172.21.15.72:0/1021819431 >> v2:172.21.15.72:3300/0 conn(0x7ff248135e50 0x7ff248138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.798+0000 7ff2477fe700 1 -- 172.21.15.72:0/1021819431 >> v1:172.21.15.72:6789/0 conn(0x7ff24809d6f0 legacy=0x7ff24809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.799+0000 7ff2477fe700 1 -- 172.21.15.72:0/1021819431 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24809b2d0 con 0x7ff24809e1d0 2023-10-03T10:14:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.798+0000 7ff246ffd700 1 -- 172.21.15.72:0/1021819431 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634533607 0 0) 0x7ff24809f130 con 0x7ff24809d6f0 2023-10-03T10:14:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.799+0000 7ff2477fe700 1 --2- 172.21.15.72:0/1021819431 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff24809e1d0 0x7ff248135910 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff23c009920 tx=0x7ff23c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=772acb4758661ba6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.799+0000 7ff246ffd700 1 -- 172.21.15.72:0/1021819431 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c011830 con 0x7ff24809e1d0 2023-10-03T10:14:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.799+0000 7ff246ffd700 1 -- 172.21.15.72:0/1021819431 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c011990 con 0x7ff24809e1d0 2023-10-03T10:14:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.799+0000 7ff246ffd700 1 -- 172.21.15.72:0/1021819431 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c011d20 con 0x7ff24809e1d0 2023-10-03T10:14:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.799+0000 7ff24e42e700 1 -- 172.21.15.72:0/1021819431 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff24809e1d0 msgr2=0x7ff248135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.799+0000 7ff24e42e700 1 --2- 172.21.15.72:0/1021819431 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff24809e1d0 0x7ff248135910 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff23c009920 tx=0x7ff23c009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.799+0000 7ff24e42e700 1 -- 172.21.15.72:0/1021819431 shutdown_connections 2023-10-03T10:14:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.799+0000 7ff24e42e700 1 --2- 172.21.15.72:0/1021819431 >> v2:172.21.15.72:3300/0 conn(0x7ff248135e50 0x7ff248138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.799+0000 7ff24e42e700 1 --2- 172.21.15.72:0/1021819431 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff24809e1d0 0x7ff248135910 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.799+0000 7ff24e42e700 1 -- 172.21.15.72:0/1021819431 >> 172.21.15.72:0/1021819431 conn(0x7ff248066f50 msgr2=0x7ff24809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.799+0000 7ff24e42e700 1 -- 172.21.15.72:0/1021819431 shutdown_connections 2023-10-03T10:14:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.799+0000 7ff24e42e700 1 -- 172.21.15.72:0/1021819431 wait complete. 2023-10-03T10:14:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.800+0000 7ff24e42e700 1 Processor -- start 2023-10-03T10:14:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff24e42e700 1 -- start start 2023-10-03T10:14:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff24e42e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff24809d6f0 0x7ff248119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff24e42e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24809e1d0 0x7ff2481199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff24e42e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff248135e50 0x7ff248119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff24e42e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24811c8e0 con 0x7ff24809e1d0 2023-10-03T10:14:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff24e42e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24809c700 con 0x7ff24809d6f0 2023-10-03T10:14:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff24e42e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff248072630 con 0x7ff248135e50 2023-10-03T10:14:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff2477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24809e1d0 0x7ff2481199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff2477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24809e1d0 0x7ff2481199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46188/0 (socket says 172.21.15.72:46188) 2023-10-03T10:14:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff2477fe700 1 -- 172.21.15.72:0/2306917098 learned_addr learned my addr 172.21.15.72:0/2306917098 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff247fff700 1 --2- 172.21.15.72:0/2306917098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff24809d6f0 0x7ff248119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff24c9cb700 1 --2- 172.21.15.72:0/2306917098 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff248135e50 0x7ff248119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff2477fe700 1 -- 172.21.15.72:0/2306917098 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff248135e50 msgr2=0x7ff248119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff2477fe700 1 --2- 172.21.15.72:0/2306917098 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff248135e50 0x7ff248119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff2477fe700 1 -- 172.21.15.72:0/2306917098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff24809d6f0 msgr2=0x7ff248119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff2477fe700 1 --2- 172.21.15.72:0/2306917098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff24809d6f0 0x7ff248119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.801+0000 7ff2477fe700 1 -- 172.21.15.72:0/2306917098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c009550 con 0x7ff24809e1d0 2023-10-03T10:14:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.802+0000 7ff2477fe700 1 --2- 172.21.15.72:0/2306917098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24809e1d0 0x7ff2481199c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0098f0 tx=0x7ff23c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.802+0000 7ff244ff9700 1 -- 172.21.15.72:0/2306917098 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c004300 con 0x7ff24809e1d0 2023-10-03T10:14:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.802+0000 7ff244ff9700 1 -- 172.21.15.72:0/2306917098 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c01f070 con 0x7ff24809e1d0 2023-10-03T10:14:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.802+0000 7ff244ff9700 1 -- 172.21.15.72:0/2306917098 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c0036a0 con 0x7ff24809e1d0 2023-10-03T10:14:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.802+0000 7ff24e42e700 1 -- 172.21.15.72:0/2306917098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff24811c530 con 0x7ff24809e1d0 2023-10-03T10:14:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.802+0000 7ff24e42e700 1 -- 172.21.15.72:0/2306917098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff24811b680 con 0x7ff24809e1d0 2023-10-03T10:14:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.803+0000 7ff244ff9700 1 -- 172.21.15.72:0/2306917098 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff23c021030 con 0x7ff24809e1d0 2023-10-03T10:14:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.803+0000 7ff244ff9700 1 -- 172.21.15.72:0/2306917098 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff23c040820 con 0x7ff24809e1d0 2023-10-03T10:14:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.803+0000 7ff24e42e700 1 -- 172.21.15.72:0/2306917098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff24811c720 con 0x7ff24809e1d0 2023-10-03T10:14:31.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.808+0000 7ff244ff9700 1 -- 172.21.15.72:0/2306917098 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff23c015080 con 0x7ff24809e1d0 2023-10-03T10:14:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.878+0000 7f8a3006a700 1 -- 172.21.15.72:0/1375677022 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8a281323c0 con 0x7f8a2809f410 2023-10-03T10:14:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.878+0000 7f8a1e7fc700 1 -- 172.21.15.72:0/1375677022 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8a18035090 con 0x7f8a2809f410 2023-10-03T10:14:31.879 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:31.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.880+0000 7f8a3006a700 1 -- 172.21.15.72:0/1375677022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2809f410 msgr2=0x7f8a281c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.880+0000 7f8a3006a700 1 --2- 172.21.15.72:0/1375677022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2809f410 0x7f8a281c8830 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009fd0 tx=0x7f8a18004750 comp rx=0 tx=0).stop 2023-10-03T10:14:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.880+0000 7f8a3006a700 1 -- 172.21.15.72:0/1375677022 shutdown_connections 2023-10-03T10:14:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.880+0000 7f8a3006a700 1 --2- 172.21.15.72:0/1375677022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a28136fe0 0x7f8a281c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.880+0000 7f8a3006a700 1 --2- 172.21.15.72:0/1375677022 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a2809e930 0x7f8a281c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.880+0000 7f8a3006a700 1 --2- 172.21.15.72:0/1375677022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a2809f410 0x7f8a281c8830 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.880+0000 7f8a3006a700 1 -- 172.21.15.72:0/1375677022 >> 172.21.15.72:0/1375677022 conn(0x7f8a280a4210 msgr2=0x7f8a280a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.880+0000 7f8a3006a700 1 -- 172.21.15.72:0/1375677022 shutdown_connections 2023-10-03T10:14:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.880+0000 7f8a3006a700 1 -- 172.21.15.72:0/1375677022 wait complete. 2023-10-03T10:14:31.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:31.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.968+0000 7f2a33a4d700 1 -- 172.21.15.72:0/3913773711 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2a2c074ea0 con 0x7f2a2c1316c0 2023-10-03T10:14:31.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.968+0000 7f2a21ffb700 1 -- 172.21.15.72:0/3913773711 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a2402f020 con 0x7f2a2c1316c0 2023-10-03T10:14:31.969 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:31.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.970+0000 7f2a33a4d700 1 -- 172.21.15.72:0/3913773711 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c1316c0 msgr2=0x7f2a2c11af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.970+0000 7f2a33a4d700 1 --2- 172.21.15.72:0/3913773711 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c1316c0 0x7f2a2c11af50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2a24016000 tx=0x7f2a24004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.970+0000 7f2a33a4d700 1 -- 172.21.15.72:0/3913773711 shutdown_connections 2023-10-03T10:14:31.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.970+0000 7f2a33a4d700 1 --2- 172.21.15.72:0/3913773711 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2c1316c0 0x7f2a2c11af50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.970+0000 7f2a33a4d700 1 --2- 172.21.15.72:0/3913773711 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2c06ae80 0x7f2a2c11a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.970+0000 7f2a33a4d700 1 --2- 172.21.15.72:0/3913773711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2c09d9f0 0x7f2a2c11aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.970+0000 7f2a33a4d700 1 -- 172.21.15.72:0/3913773711 >> 172.21.15.72:0/3913773711 conn(0x7f2a2c066f50 msgr2=0x7f2a2c12e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.971+0000 7f2a33a4d700 1 -- 172.21.15.72:0/3913773711 shutdown_connections 2023-10-03T10:14:31.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:31.971+0000 7f2a33a4d700 1 -- 172.21.15.72:0/3913773711 wait complete. 2023-10-03T10:14:31.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.000+0000 7ff24e42e700 1 -- 172.21.15.72:0/2306917098 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff24811c130 con 0x7ff24809e1d0 2023-10-03T10:14:32.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.000+0000 7ff244ff9700 1 -- 172.21.15.72:0/2306917098 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff23c0239c0 con 0x7ff24809e1d0 2023-10-03T10:14:32.001 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:32.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.002+0000 7ff24e42e700 1 -- 172.21.15.72:0/2306917098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24809e1d0 msgr2=0x7ff2481199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.002+0000 7ff24e42e700 1 --2- 172.21.15.72:0/2306917098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24809e1d0 0x7ff2481199c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0098f0 tx=0x7ff23c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:32.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.002+0000 7ff24e42e700 1 -- 172.21.15.72:0/2306917098 shutdown_connections 2023-10-03T10:14:32.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.002+0000 7ff24e42e700 1 --2- 172.21.15.72:0/2306917098 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff248135e50 0x7ff248119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.002+0000 7ff24e42e700 1 --2- 172.21.15.72:0/2306917098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff24809d6f0 0x7ff248119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.002+0000 7ff24e42e700 1 --2- 172.21.15.72:0/2306917098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff24809e1d0 0x7ff2481199c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.002+0000 7ff24e42e700 1 -- 172.21.15.72:0/2306917098 >> 172.21.15.72:0/2306917098 conn(0x7ff248066f50 msgr2=0x7ff2480a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.002+0000 7ff24e42e700 1 -- 172.21.15.72:0/2306917098 shutdown_connections 2023-10-03T10:14:32.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.002+0000 7ff24e42e700 1 -- 172.21.15.72:0/2306917098 wait complete. 2023-10-03T10:14:32.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:32.594 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:32.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.720+0000 7f5320966700 1 Processor -- start 2023-10-03T10:14:32.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.720+0000 7f5320966700 1 -- start start 2023-10-03T10:14:32.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.721+0000 7f5320966700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f531c09d6f0 0x7f531c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.721+0000 7f5320966700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c09e000 0x7f531c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.721+0000 7f5320966700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531c09f130 con 0x7f531c09e410 2023-10-03T10:14:32.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.721+0000 7f5320966700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c09f520 con 0x7f531c09e000 2023-10-03T10:14:32.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.721+0000 7f5320966700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f531c09e930 con 0x7f531c09d6f0 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.721+0000 7f531a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f531c09d6f0 0x7f531c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.721+0000 7f531ad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f531c09e410 0x7f531c130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35348/0 (socket says 172.21.15.72:35348) 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.721+0000 7f5319d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c09e000 0x7f531c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.721+0000 7f531ad9d700 1 -- 172.21.15.72:0/2704653466 learned_addr learned my addr 172.21.15.72:0/2704653466 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.721+0000 7f531a59c700 1 -- 172.21.15.72:0/2704653466 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c09e000 msgr2=0x7f531c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.721+0000 7f531a59c700 1 --2- 172.21.15.72:0/2704653466 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c09e000 0x7f531c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.721+0000 7f531a59c700 1 -- 172.21.15.72:0/2704653466 >> v1:172.21.15.72:6789/0 conn(0x7f531c09e410 legacy=0x7f531c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.721+0000 7f531959a700 1 -- 172.21.15.72:0/2704653466 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588123196 0 0) 0x7f531c09f130 con 0x7f531c09e410 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.721+0000 7f531a59c700 1 -- 172.21.15.72:0/2704653466 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c09b2d0 con 0x7f531c09d6f0 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.722+0000 7f531a59c700 1 --2- 172.21.15.72:0/2704653466 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f531c09d6f0 0x7f531c09dac0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f53100098a0 tx=0x7f5310009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a4d2138924be076 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.722+0000 7f531959a700 1 -- 172.21.15.72:0/2704653466 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310011830 con 0x7f531c09d6f0 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.722+0000 7f531959a700 1 -- 172.21.15.72:0/2704653466 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310011990 con 0x7f531c09d6f0 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.722+0000 7f531959a700 1 -- 172.21.15.72:0/2704653466 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310011d20 con 0x7f531c09d6f0 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.722+0000 7f5320966700 1 -- 172.21.15.72:0/2704653466 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f531c09d6f0 msgr2=0x7f531c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.722+0000 7f5320966700 1 --2- 172.21.15.72:0/2704653466 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f531c09d6f0 0x7f531c09dac0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f53100098a0 tx=0x7f5310009bb0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.722+0000 7f5320966700 1 -- 172.21.15.72:0/2704653466 shutdown_connections 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.722+0000 7f5320966700 1 --2- 172.21.15.72:0/2704653466 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f531c09d6f0 0x7f531c09dac0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.722+0000 7f5320966700 1 --2- 172.21.15.72:0/2704653466 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c09e000 0x7f531c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.722+0000 7f5320966700 1 -- 172.21.15.72:0/2704653466 >> 172.21.15.72:0/2704653466 conn(0x7f531c066f50 msgr2=0x7f531c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.722+0000 7f5320966700 1 -- 172.21.15.72:0/2704653466 shutdown_connections 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.722+0000 7f5320966700 1 -- 172.21.15.72:0/2704653466 wait complete. 2023-10-03T10:14:32.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.723+0000 7f5320966700 1 Processor -- start 2023-10-03T10:14:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.723+0000 7f5320966700 1 -- start start 2023-10-03T10:14:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f5320966700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f531c09d6f0 0x7f531c11efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f5320966700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c09e000 0x7f531c11f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f5320966700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f531c09e410 0x7f531c11fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f5320966700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c120470 con 0x7f531c09e410 2023-10-03T10:14:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f5320966700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c130320 con 0x7f531c09e000 2023-10-03T10:14:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f5320966700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f531c121db0 con 0x7f531c09d6f0 2023-10-03T10:14:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f531a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f531c09d6f0 0x7f531c11efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f531a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f531c09d6f0 0x7f531c11efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39710/0 (socket says 172.21.15.72:39710) 2023-10-03T10:14:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f531a59c700 1 -- 172.21.15.72:0/625314602 learned_addr learned my addr 172.21.15.72:0/625314602 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f531ad9d700 1 --2- 172.21.15.72:0/625314602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f531c09e410 0x7f531c11fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f5319d9b700 1 --2- 172.21.15.72:0/625314602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c09e000 0x7f531c11f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f531a59c700 1 -- 172.21.15.72:0/625314602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c09e000 msgr2=0x7f531c11f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f531a59c700 1 --2- 172.21.15.72:0/625314602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c09e000 0x7f531c11f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f531a59c700 1 -- 172.21.15.72:0/625314602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f531c09e410 msgr2=0x7f531c11fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f531a59c700 1 --2- 172.21.15.72:0/625314602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f531c09e410 0x7f531c11fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f531a59c700 1 -- 172.21.15.72:0/625314602 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53100094a0 con 0x7f531c09d6f0 2023-10-03T10:14:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f531ad9d700 1 --2- 172.21.15.72:0/625314602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f531c09e410 0x7f531c11fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.724+0000 7f531a59c700 1 --2- 172.21.15.72:0/625314602 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f531c09d6f0 0x7f531c11efa0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f53100090b0 tx=0x7f5310004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.725+0000 7f530affd700 1 -- 172.21.15.72:0/625314602 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310004450 con 0x7f531c09d6f0 2023-10-03T10:14:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.725+0000 7f530affd700 1 -- 172.21.15.72:0/625314602 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531001e070 con 0x7f531c09d6f0 2023-10-03T10:14:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.725+0000 7f530affd700 1 -- 172.21.15.72:0/625314602 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53100038e0 con 0x7f531c09d6f0 2023-10-03T10:14:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.725+0000 7f5320966700 1 -- 172.21.15.72:0/625314602 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531c1219f0 con 0x7f531c09d6f0 2023-10-03T10:14:32.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.725+0000 7f5320966700 1 -- 172.21.15.72:0/625314602 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c09c700 con 0x7f531c09d6f0 2023-10-03T10:14:32.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.725+0000 7f530affd700 1 -- 172.21.15.72:0/625314602 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5310003a40 con 0x7f531c09d6f0 2023-10-03T10:14:32.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.725+0000 7f530affd700 1 -- 172.21.15.72:0/625314602 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f53100403d0 con 0x7f531c09d6f0 2023-10-03T10:14:32.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.726+0000 7f5320966700 1 -- 172.21.15.72:0/625314602 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531c074ea0 con 0x7f531c09d6f0 2023-10-03T10:14:32.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.730+0000 7f530affd700 1 -- 172.21.15.72:0/625314602 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5310003cf0 con 0x7f531c09d6f0 2023-10-03T10:14:32.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:32.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.914+0000 7f5320966700 1 -- 172.21.15.72:0/625314602 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f531c1227f0 con 0x7f531c09d6f0 2023-10-03T10:14:32.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.915+0000 7f530affd700 1 -- 172.21.15.72:0/625314602 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5310015020 con 0x7f531c09d6f0 2023-10-03T10:14:32.915 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:32.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.917+0000 7f5320966700 1 -- 172.21.15.72:0/625314602 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f531c09d6f0 msgr2=0x7f531c11efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.917+0000 7f5320966700 1 --2- 172.21.15.72:0/625314602 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f531c09d6f0 0x7f531c11efa0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f53100090b0 tx=0x7f5310004750 comp rx=0 tx=0).stop 2023-10-03T10:14:32.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.917+0000 7f5320966700 1 -- 172.21.15.72:0/625314602 shutdown_connections 2023-10-03T10:14:32.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.917+0000 7f5320966700 1 --2- 172.21.15.72:0/625314602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f531c09e410 0x7f531c11fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.917+0000 7f5320966700 1 --2- 172.21.15.72:0/625314602 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f531c09d6f0 0x7f531c11efa0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.917+0000 7f5320966700 1 --2- 172.21.15.72:0/625314602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f531c09e000 0x7f531c11f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.917+0000 7f5320966700 1 -- 172.21.15.72:0/625314602 >> 172.21.15.72:0/625314602 conn(0x7f531c066f50 msgr2=0x7f531c119480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.917+0000 7f5320966700 1 -- 172.21.15.72:0/625314602 shutdown_connections 2023-10-03T10:14:32.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:32.917+0000 7f5320966700 1 -- 172.21.15.72:0/625314602 wait complete. 2023-10-03T10:14:32.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:32.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:33.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:33.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.018+0000 7ff33d06a700 1 Processor -- start 2023-10-03T10:14:33.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff33d06a700 1 -- start start 2023-10-03T10:14:33.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff33d06a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff33809d6f0 0x7ff33809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff33d06a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff33809e000 0x7ff3381339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff33d06a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33809e410 0x7ff338133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff33d06a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33806b460 con 0x7ff33809d6f0 2023-10-03T10:14:33.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff33d06a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33809b120 con 0x7ff33809e410 2023-10-03T10:14:33.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff33d06a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff33809a7e0 con 0x7ff33809e000 2023-10-03T10:14:33.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff33759e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33809e410 0x7ff338133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff336d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff33809d6f0 0x7ff33809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff33659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff33809e000 0x7ff3381339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff336d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff33809d6f0 0x7ff33809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46208/0 (socket says 172.21.15.72:46208) 2023-10-03T10:14:33.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff33759e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33809e410 0x7ff338133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40214/0 (socket says 172.21.15.72:40214) 2023-10-03T10:14:33.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff33659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff33809e000 0x7ff3381339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39720/0 (socket says 172.21.15.72:39720) 2023-10-03T10:14:33.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff336d9d700 1 -- 172.21.15.72:0/114451566 learned_addr learned my addr 172.21.15.72:0/114451566 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:33.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff33759e700 1 -- 172.21.15.72:0/114451566 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff33809e000 msgr2=0x7ff3381339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:33.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff33759e700 1 --2- 172.21.15.72:0/114451566 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff33809e000 0x7ff3381339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff33759e700 1 -- 172.21.15.72:0/114451566 >> v2:172.21.15.72:3300/0 conn(0x7ff33809d6f0 msgr2=0x7ff33809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:33.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.019+0000 7ff33759e700 1 --2- 172.21.15.72:0/114451566 >> v2:172.21.15.72:3300/0 conn(0x7ff33809d6f0 0x7ff33809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.020+0000 7ff33759e700 1 -- 172.21.15.72:0/114451566 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33809a500 con 0x7ff33809e410 2023-10-03T10:14:33.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.020+0000 7ff336d9d700 1 --2- 172.21.15.72:0/114451566 >> v2:172.21.15.72:3300/0 conn(0x7ff33809d6f0 0x7ff33809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:33.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.020+0000 7ff33759e700 1 --2- 172.21.15.72:0/114451566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33809e410 0x7ff338133f30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff330009dc0 tx=0x7ff33000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e7cc0b7a6af44b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:33.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.020+0000 7ff335d9b700 1 -- 172.21.15.72:0/114451566 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33000e070 con 0x7ff33809e410 2023-10-03T10:14:33.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.020+0000 7ff335d9b700 1 -- 172.21.15.72:0/114451566 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33000bae0 con 0x7ff33809e410 2023-10-03T10:14:33.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.020+0000 7ff335d9b700 1 -- 172.21.15.72:0/114451566 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33000be90 con 0x7ff33809e410 2023-10-03T10:14:33.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.020+0000 7ff33d06a700 1 -- 172.21.15.72:0/114451566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33809e410 msgr2=0x7ff338133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.020+0000 7ff33d06a700 1 --2- 172.21.15.72:0/114451566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33809e410 0x7ff338133f30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff330009dc0 tx=0x7ff33000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:33.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.021+0000 7ff33d06a700 1 -- 172.21.15.72:0/114451566 shutdown_connections 2023-10-03T10:14:33.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.021+0000 7ff33d06a700 1 --2- 172.21.15.72:0/114451566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33809e410 0x7ff338133f30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.021+0000 7ff33d06a700 1 --2- 172.21.15.72:0/114451566 >> v2:172.21.15.72:3300/0 conn(0x7ff33809d6f0 0x7ff33809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.021+0000 7ff33d06a700 1 --2- 172.21.15.72:0/114451566 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff33809e000 0x7ff3381339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.021+0000 7ff33d06a700 1 -- 172.21.15.72:0/114451566 >> 172.21.15.72:0/114451566 conn(0x7ff338066f50 msgr2=0x7ff33809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.021+0000 7ff33d06a700 1 -- 172.21.15.72:0/114451566 shutdown_connections 2023-10-03T10:14:33.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.021+0000 7ff33d06a700 1 -- 172.21.15.72:0/114451566 wait complete. 2023-10-03T10:14:33.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.022+0000 7ff33d06a700 1 Processor -- start 2023-10-03T10:14:33.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.022+0000 7ff33d06a700 1 -- start start 2023-10-03T10:14:33.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff33d06a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33809d6f0 0x7ff3381c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff33d06a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff33809e000 0x7ff3381c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff33d06a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff33809e410 0x7ff3381c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff33d06a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3381a8a00 con 0x7ff33809e410 2023-10-03T10:14:33.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff33d06a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3381a85d0 con 0x7ff33809d6f0 2023-10-03T10:14:33.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff33d06a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3381a91f0 con 0x7ff33809e000 2023-10-03T10:14:33.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff336d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33809d6f0 0x7ff3381c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff33659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff33809e000 0x7ff3381c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff336d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33809d6f0 0x7ff3381c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40224/0 (socket says 172.21.15.72:40224) 2023-10-03T10:14:33.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff336d9d700 1 -- 172.21.15.72:0/1342455379 learned_addr learned my addr 172.21.15.72:0/1342455379 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:33.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff33759e700 1 --2- 172.21.15.72:0/1342455379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff33809e410 0x7ff3381c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff336d9d700 1 -- 172.21.15.72:0/1342455379 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff33809e000 msgr2=0x7ff3381c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff336d9d700 1 --2- 172.21.15.72:0/1342455379 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff33809e000 0x7ff3381c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff336d9d700 1 -- 172.21.15.72:0/1342455379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff33809e410 msgr2=0x7ff3381c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff336d9d700 1 --2- 172.21.15.72:0/1342455379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff33809e410 0x7ff3381c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff336d9d700 1 -- 172.21.15.72:0/1342455379 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff328009550 con 0x7ff33809d6f0 2023-10-03T10:14:33.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff33759e700 1 --2- 172.21.15.72:0/1342455379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff33809e410 0x7ff3381c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:33.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.023+0000 7ff336d9d700 1 --2- 172.21.15.72:0/1342455379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33809d6f0 0x7ff3381c84f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff32800ebe0 tx=0x7ff32800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:33.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.024+0000 7ff31f7fe700 1 -- 172.21.15.72:0/1342455379 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32800c850 con 0x7ff33809d6f0 2023-10-03T10:14:33.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.024+0000 7ff31f7fe700 1 -- 172.21.15.72:0/1342455379 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32800c9b0 con 0x7ff33809d6f0 2023-10-03T10:14:33.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.024+0000 7ff33d06a700 1 -- 172.21.15.72:0/1342455379 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff330009a70 con 0x7ff33809d6f0 2023-10-03T10:14:33.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.024+0000 7ff31f7fe700 1 -- 172.21.15.72:0/1342455379 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32800cd40 con 0x7ff33809d6f0 2023-10-03T10:14:33.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.024+0000 7ff33d06a700 1 -- 172.21.15.72:0/1342455379 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3381a7880 con 0x7ff33809d6f0 2023-10-03T10:14:33.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.025+0000 7ff33d06a700 1 -- 172.21.15.72:0/1342455379 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff338074ea0 con 0x7ff33809d6f0 2023-10-03T10:14:33.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.025+0000 7ff31f7fe700 1 -- 172.21.15.72:0/1342455379 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff328013470 con 0x7ff33809d6f0 2023-10-03T10:14:33.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.025+0000 7ff31f7fe700 1 -- 172.21.15.72:0/1342455379 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff328040050 con 0x7ff33809d6f0 2023-10-03T10:14:33.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.029+0000 7ff31f7fe700 1 -- 172.21.15.72:0/1342455379 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff328011760 con 0x7ff33809d6f0 2023-10-03T10:14:33.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.114+0000 7f6b036b0700 1 Processor -- start 2023-10-03T10:14:33.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.115+0000 7f6b036b0700 1 -- start start 2023-10-03T10:14:33.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.115+0000 7f6b036b0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6afc0a0a30 0x7f6afc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.115+0000 7f6b036b0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6afc09d630 0x7f6afc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.115+0000 7f6b036b0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6afc0a2a70 con 0x7f6afc133930 2023-10-03T10:14:33.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.115+0000 7f6b036b0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6afc0a01d0 con 0x7f6afc0a0a30 2023-10-03T10:14:33.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.115+0000 7f6b036b0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc09e2b0 con 0x7f6afc09d630 2023-10-03T10:14:33.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.115+0000 7f6b00c4b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6afc09d630 0x7f6afc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.115+0000 7f6b0144c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6afc0a0a30 0x7f6afc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.115+0000 7f6b00c4b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6afc09d630 0x7f6afc0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39732/0 (socket says 172.21.15.72:39732) 2023-10-03T10:14:33.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.115+0000 7f6b00c4b700 1 -- 172.21.15.72:0/1309588985 learned_addr learned my addr 172.21.15.72:0/1309588985 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:33.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.115+0000 7f6b00c4b700 1 -- 172.21.15.72:0/1309588985 >> v2:172.21.15.72:3300/0 conn(0x7f6afc0a0a30 msgr2=0x7f6afc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:33.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.115+0000 7f6b00c4b700 1 --2- 172.21.15.72:0/1309588985 >> v2:172.21.15.72:3300/0 conn(0x7f6afc0a0a30 0x7f6afc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.115+0000 7f6b00c4b700 1 -- 172.21.15.72:0/1309588985 >> v1:172.21.15.72:6789/0 conn(0x7f6afc133930 legacy=0x7f6afc133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.116+0000 7f6b00c4b700 1 -- 172.21.15.72:0/1309588985 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc09dc50 con 0x7f6afc09d630 2023-10-03T10:14:33.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.116+0000 7f6b0144c700 1 --2- 172.21.15.72:0/1309588985 >> v2:172.21.15.72:3300/0 conn(0x7f6afc0a0a30 0x7f6afc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:33.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.116+0000 7f6b00c4b700 1 --2- 172.21.15.72:0/1309588985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6afc09d630 0x7f6afc0a1340 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0098f0 tx=0x7f6aec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fa88d4c2707c236 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:33.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.116+0000 7f6af3fff700 1 -- 172.21.15.72:0/1309588985 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec011830 con 0x7f6afc09d630 2023-10-03T10:14:33.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.116+0000 7f6af3fff700 1 -- 172.21.15.72:0/1309588985 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec011990 con 0x7f6afc09d630 2023-10-03T10:14:33.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.116+0000 7f6af3fff700 1 -- 172.21.15.72:0/1309588985 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec011d20 con 0x7f6afc09d630 2023-10-03T10:14:33.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.116+0000 7f6b036b0700 1 -- 172.21.15.72:0/1309588985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6afc09d630 msgr2=0x7f6afc0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.116+0000 7f6b036b0700 1 --2- 172.21.15.72:0/1309588985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6afc09d630 0x7f6afc0a1340 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0098f0 tx=0x7f6aec009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:33.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.116+0000 7f6b036b0700 1 -- 172.21.15.72:0/1309588985 shutdown_connections 2023-10-03T10:14:33.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.116+0000 7f6b036b0700 1 --2- 172.21.15.72:0/1309588985 >> v2:172.21.15.72:3300/0 conn(0x7f6afc0a0a30 0x7f6afc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.117+0000 7f6b036b0700 1 --2- 172.21.15.72:0/1309588985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6afc09d630 0x7f6afc0a1340 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.117+0000 7f6b036b0700 1 -- 172.21.15.72:0/1309588985 >> 172.21.15.72:0/1309588985 conn(0x7f6afc0a3050 msgr2=0x7f6afc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.117+0000 7f6b036b0700 1 -- 172.21.15.72:0/1309588985 shutdown_connections 2023-10-03T10:14:33.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.117+0000 7f6b036b0700 1 -- 172.21.15.72:0/1309588985 wait complete. 2023-10-03T10:14:33.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.118+0000 7f6b036b0700 1 Processor -- start 2023-10-03T10:14:33.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.118+0000 7f6b036b0700 1 -- start start 2023-10-03T10:14:33.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.118+0000 7f6b036b0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6afc09d630 0x7f6afc1c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.118+0000 7f6b036b0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6afc0a0a30 0x7f6afc1c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.118+0000 7f6b036b0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6afc133930 0x7f6afc1c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.118+0000 7f6b036b0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc133530 con 0x7f6afc0a0a30 2023-10-03T10:14:33.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b036b0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc120710 con 0x7f6afc09d630 2023-10-03T10:14:33.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b036b0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc121f00 con 0x7f6afc133930 2023-10-03T10:14:33.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b00c4b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6afc0a0a30 0x7f6afc1c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b0144c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6afc09d630 0x7f6afc1c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b00c4b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6afc0a0a30 0x7f6afc1c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46242/0 (socket says 172.21.15.72:46242) 2023-10-03T10:14:33.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b0144c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6afc09d630 0x7f6afc1c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40234/0 (socket says 172.21.15.72:40234) 2023-10-03T10:14:33.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b00c4b700 1 -- 172.21.15.72:0/1427548950 learned_addr learned my addr 172.21.15.72:0/1427548950 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:33.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b01c4d700 1 --2- 172.21.15.72:0/1427548950 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6afc133930 0x7f6afc1c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b0144c700 1 -- 172.21.15.72:0/1427548950 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6afc133930 msgr2=0x7f6afc1c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b0144c700 1 --2- 172.21.15.72:0/1427548950 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6afc133930 0x7f6afc1c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b0144c700 1 -- 172.21.15.72:0/1427548950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6afc0a0a30 msgr2=0x7f6afc1c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b0144c700 1 --2- 172.21.15.72:0/1427548950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6afc0a0a30 0x7f6afc1c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b0144c700 1 -- 172.21.15.72:0/1427548950 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af80094a0 con 0x7f6afc09d630 2023-10-03T10:14:33.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b00c4b700 1 --2- 172.21.15.72:0/1427548950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6afc0a0a30 0x7f6afc1c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:33.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b0144c700 1 --2- 172.21.15.72:0/1427548950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6afc09d630 0x7f6afc1c8190 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6af800e9b0 tx=0x7f6af800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:33.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6af1ffb700 1 -- 172.21.15.72:0/1427548950 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af800ee50 con 0x7f6afc09d630 2023-10-03T10:14:33.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6af1ffb700 1 -- 172.21.15.72:0/1427548950 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af800c850 con 0x7f6afc09d630 2023-10-03T10:14:33.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6b036b0700 1 -- 172.21.15.72:0/1427548950 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec009550 con 0x7f6afc09d630 2023-10-03T10:14:33.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.119+0000 7f6af1ffb700 1 -- 172.21.15.72:0/1427548950 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af800cc00 con 0x7f6afc09d630 2023-10-03T10:14:33.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.120+0000 7f6b036b0700 1 -- 172.21.15.72:0/1427548950 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6afc0a0460 con 0x7f6afc09d630 2023-10-03T10:14:33.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.121+0000 7f6b036b0700 1 -- 172.21.15.72:0/1427548950 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6afc122400 con 0x7f6afc09d630 2023-10-03T10:14:33.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.121+0000 7f6af1ffb700 1 -- 172.21.15.72:0/1427548950 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6af8013470 con 0x7f6afc09d630 2023-10-03T10:14:33.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.121+0000 7f6af1ffb700 1 -- 172.21.15.72:0/1427548950 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6af803fe90 con 0x7f6afc09d630 2023-10-03T10:14:33.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.125+0000 7f6af1ffb700 1 -- 172.21.15.72:0/1427548950 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6af8013720 con 0x7f6afc09d630 2023-10-03T10:14:33.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.145+0000 7fc1deb8d700 1 Processor -- start 2023-10-03T10:14:33.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.145+0000 7fc1deb8d700 1 -- start start 2023-10-03T10:14:33.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1deb8d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1d809e1d0 0x7fc1d8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1deb8d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc1d8139170 0x7fc1d813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1deb8d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d809b120 con 0x7fc1d809d6f0 2023-10-03T10:14:33.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1deb8d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d806b460 con 0x7fc1d8139170 2023-10-03T10:14:33.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1deb8d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d809a7e0 con 0x7fc1d809e1d0 2023-10-03T10:14:33.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1dd12a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc1d8139170 0x7fc1d813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1dd12a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc1d8139170 0x7fc1d813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46256/0 (socket says 172.21.15.72:46256) 2023-10-03T10:14:33.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1d7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1d809e1d0 0x7fc1d8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1dd12a700 1 -- 172.21.15.72:0/2557019606 learned_addr learned my addr 172.21.15.72:0/2557019606 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:33.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1dd12a700 1 -- 172.21.15.72:0/2557019606 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1d809e1d0 msgr2=0x7fc1d8138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:33.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1dd12a700 1 --2- 172.21.15.72:0/2557019606 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1d809e1d0 0x7fc1d8138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1dd12a700 1 -- 172.21.15.72:0/2557019606 >> v1:172.21.15.72:6789/0 conn(0x7fc1d809d6f0 legacy=0x7fc1d809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1dd12a700 1 -- 172.21.15.72:0/2557019606 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d809a500 con 0x7fc1d8139170 2023-10-03T10:14:33.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1dd12a700 1 --2- 172.21.15.72:0/2557019606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1d8139170 0x7fc1d813b550 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80098f0 tx=0x7fc1c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64f15f7ab1e107a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:33.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1d77fe700 1 -- 172.21.15.72:0/2557019606 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8011830 con 0x7fc1d8139170 2023-10-03T10:14:33.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1d77fe700 1 -- 172.21.15.72:0/2557019606 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c8011990 con 0x7fc1d8139170 2023-10-03T10:14:33.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.146+0000 7fc1d77fe700 1 -- 172.21.15.72:0/2557019606 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8011d20 con 0x7fc1d8139170 2023-10-03T10:14:33.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.147+0000 7fc1deb8d700 1 -- 172.21.15.72:0/2557019606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1d8139170 msgr2=0x7fc1d813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.147+0000 7fc1deb8d700 1 --2- 172.21.15.72:0/2557019606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1d8139170 0x7fc1d813b550 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80098f0 tx=0x7fc1c8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:33.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.147+0000 7fc1deb8d700 1 -- 172.21.15.72:0/2557019606 shutdown_connections 2023-10-03T10:14:33.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.147+0000 7fc1deb8d700 1 --2- 172.21.15.72:0/2557019606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1d8139170 0x7fc1d813b550 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.147+0000 7fc1deb8d700 1 --2- 172.21.15.72:0/2557019606 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1d809e1d0 0x7fc1d8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.147+0000 7fc1deb8d700 1 -- 172.21.15.72:0/2557019606 >> 172.21.15.72:0/2557019606 conn(0x7fc1d8066f50 msgr2=0x7fc1d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.147+0000 7fc1deb8d700 1 -- 172.21.15.72:0/2557019606 shutdown_connections 2023-10-03T10:14:33.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.147+0000 7fc1deb8d700 1 -- 172.21.15.72:0/2557019606 wait complete. 2023-10-03T10:14:33.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.148+0000 7fc1deb8d700 1 Processor -- start 2023-10-03T10:14:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.148+0000 7fc1deb8d700 1 -- start start 2023-10-03T10:14:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1deb8d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1d809d6f0 0x7fc1d81c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1deb8d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1d809e1d0 0x7fc1d81c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1deb8d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1d8139170 0x7fc1d8120910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1deb8d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d80a18d0 con 0x7fc1d809e1d0 2023-10-03T10:14:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1deb8d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8123d40 con 0x7fc1d8139170 2023-10-03T10:14:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1deb8d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d809c710 con 0x7fc1d809d6f0 2023-10-03T10:14:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1d809e1d0 0x7fc1d81c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1d809e1d0 0x7fc1d81c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46266/0 (socket says 172.21.15.72:46266) 2023-10-03T10:14:33.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1d7fff700 1 -- 172.21.15.72:0/3074850688 learned_addr learned my addr 172.21.15.72:0/3074850688 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:33.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1dd12a700 1 --2- 172.21.15.72:0/3074850688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1d8139170 0x7fc1d8120910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1dc929700 1 --2- 172.21.15.72:0/3074850688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1d809d6f0 0x7fc1d81c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:33.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1d7fff700 1 -- 172.21.15.72:0/3074850688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1d809d6f0 msgr2=0x7fc1d81c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1d7fff700 1 --2- 172.21.15.72:0/3074850688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1d809d6f0 0x7fc1d81c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1d7fff700 1 -- 172.21.15.72:0/3074850688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1d8139170 msgr2=0x7fc1d8120910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1d7fff700 1 --2- 172.21.15.72:0/3074850688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1d8139170 0x7fc1d8120910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1d7fff700 1 -- 172.21.15.72:0/3074850688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c8009550 con 0x7fc1d809e1d0 2023-10-03T10:14:33.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1dc929700 1 --2- 172.21.15.72:0/3074850688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1d809d6f0 0x7fc1d81c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:33.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1d7fff700 1 --2- 172.21.15.72:0/3074850688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1d809e1d0 0x7fc1d81c8a30 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000e9b0 tx=0x7fc1c000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:33.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1d57fa700 1 -- 172.21.15.72:0/3074850688 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0009710 con 0x7fc1d809e1d0 2023-10-03T10:14:33.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1d57fa700 1 -- 172.21.15.72:0/3074850688 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c000c850 con 0x7fc1d809e1d0 2023-10-03T10:14:33.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1d57fa700 1 -- 172.21.15.72:0/3074850688 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000cbc0 con 0x7fc1d809e1d0 2023-10-03T10:14:33.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1deb8d700 1 -- 172.21.15.72:0/3074850688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d8124350 con 0x7fc1d809e1d0 2023-10-03T10:14:33.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.149+0000 7fc1deb8d700 1 -- 172.21.15.72:0/3074850688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d8122440 con 0x7fc1d809e1d0 2023-10-03T10:14:33.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.150+0000 7fc1d57fa700 1 -- 172.21.15.72:0/3074850688 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1c000cd20 con 0x7fc1d809e1d0 2023-10-03T10:14:33.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.150+0000 7fc1d57fa700 1 -- 172.21.15.72:0/3074850688 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc1c003fb40 con 0x7fc1d809e1d0 2023-10-03T10:14:33.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.151+0000 7fc1deb8d700 1 -- 172.21.15.72:0/3074850688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d8074ea0 con 0x7fc1d809e1d0 2023-10-03T10:14:33.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.155+0000 7fc1d57fa700 1 -- 172.21.15.72:0/3074850688 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1c0017080 con 0x7fc1d809e1d0 2023-10-03T10:14:33.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.244+0000 7ff33d06a700 1 -- 172.21.15.72:0/1342455379 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff33806c360 con 0x7ff33809d6f0 2023-10-03T10:14:33.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.245+0000 7ff31f7fe700 1 -- 172.21.15.72:0/1342455379 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff328021020 con 0x7ff33809d6f0 2023-10-03T10:14:33.245 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:33.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.247+0000 7ff33d06a700 1 -- 172.21.15.72:0/1342455379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33809d6f0 msgr2=0x7ff3381c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.247+0000 7ff33d06a700 1 --2- 172.21.15.72:0/1342455379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33809d6f0 0x7ff3381c84f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff32800ebe0 tx=0x7ff32800eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.248+0000 7ff33d06a700 1 -- 172.21.15.72:0/1342455379 shutdown_connections 2023-10-03T10:14:33.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.248+0000 7ff33d06a700 1 --2- 172.21.15.72:0/1342455379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff33809e410 0x7ff3381c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.248+0000 7ff33d06a700 1 --2- 172.21.15.72:0/1342455379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33809d6f0 0x7ff3381c84f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.248+0000 7ff33d06a700 1 --2- 172.21.15.72:0/1342455379 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff33809e000 0x7ff3381c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.248+0000 7ff33d06a700 1 -- 172.21.15.72:0/1342455379 >> 172.21.15.72:0/1342455379 conn(0x7ff338066f50 msgr2=0x7ff3381bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.248+0000 7ff33d06a700 1 -- 172.21.15.72:0/1342455379 shutdown_connections 2023-10-03T10:14:33.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.248+0000 7ff33d06a700 1 -- 172.21.15.72:0/1342455379 wait complete. 2023-10-03T10:14:33.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:33.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.322+0000 7f6b036b0700 1 -- 172.21.15.72:0/1427548950 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6afc122c90 con 0x7f6afc09d630 2023-10-03T10:14:33.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.322+0000 7f6af1ffb700 1 -- 172.21.15.72:0/1427548950 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6af8021070 con 0x7f6afc09d630 2023-10-03T10:14:33.323 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:33.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.324+0000 7f6b036b0700 1 -- 172.21.15.72:0/1427548950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6afc09d630 msgr2=0x7f6afc1c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.324+0000 7f6b036b0700 1 --2- 172.21.15.72:0/1427548950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6afc09d630 0x7f6afc1c8190 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6af800e9b0 tx=0x7f6af800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.324+0000 7f6b036b0700 1 -- 172.21.15.72:0/1427548950 shutdown_connections 2023-10-03T10:14:33.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.324+0000 7f6b036b0700 1 --2- 172.21.15.72:0/1427548950 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6afc133930 0x7f6afc1c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.324+0000 7f6b036b0700 1 --2- 172.21.15.72:0/1427548950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6afc09d630 0x7f6afc1c8190 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.324+0000 7f6b036b0700 1 --2- 172.21.15.72:0/1427548950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6afc0a0a30 0x7f6afc1c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.324+0000 7f6b036b0700 1 -- 172.21.15.72:0/1427548950 >> 172.21.15.72:0/1427548950 conn(0x7f6afc0a3050 msgr2=0x7f6afc1bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.324+0000 7f6b036b0700 1 -- 172.21.15.72:0/1427548950 shutdown_connections 2023-10-03T10:14:33.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.324+0000 7f6b036b0700 1 -- 172.21.15.72:0/1427548950 wait complete. 2023-10-03T10:14:33.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:33.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.367+0000 7fc1deb8d700 1 -- 172.21.15.72:0/3074850688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc1d806c360 con 0x7fc1d809e1d0 2023-10-03T10:14:33.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.368+0000 7fc1d57fa700 1 -- 172.21.15.72:0/3074850688 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc1c0021020 con 0x7fc1d809e1d0 2023-10-03T10:14:33.368 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:33.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.370+0000 7fc1deb8d700 1 -- 172.21.15.72:0/3074850688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1d809e1d0 msgr2=0x7fc1d81c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.370+0000 7fc1deb8d700 1 --2- 172.21.15.72:0/3074850688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1d809e1d0 0x7fc1d81c8a30 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000e9b0 tx=0x7fc1c000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.370+0000 7fc1deb8d700 1 -- 172.21.15.72:0/3074850688 shutdown_connections 2023-10-03T10:14:33.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.370+0000 7fc1deb8d700 1 --2- 172.21.15.72:0/3074850688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1d8139170 0x7fc1d8120910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.370+0000 7fc1deb8d700 1 --2- 172.21.15.72:0/3074850688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1d809d6f0 0x7fc1d81c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.370+0000 7fc1deb8d700 1 --2- 172.21.15.72:0/3074850688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1d809e1d0 0x7fc1d81c8a30 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.370+0000 7fc1deb8d700 1 -- 172.21.15.72:0/3074850688 >> 172.21.15.72:0/3074850688 conn(0x7fc1d8066f50 msgr2=0x7fc1d809b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.370+0000 7fc1deb8d700 1 -- 172.21.15.72:0/3074850688 shutdown_connections 2023-10-03T10:14:33.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:33.370+0000 7fc1deb8d700 1 -- 172.21.15.72:0/3074850688 wait complete. 2023-10-03T10:14:33.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:33.932 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:34.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.065+0000 7f3b825de700 1 Processor -- start 2023-10-03T10:14:34.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.065+0000 7f3b825de700 1 -- start start 2023-10-03T10:14:34.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.065+0000 7f3b825de700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3b7c09e1d0 0x7f3b7c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.065+0000 7f3b825de700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b7c139170 0x7f3b7c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.065+0000 7f3b825de700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7c09b120 con 0x7f3b7c09d6f0 2023-10-03T10:14:34.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.065+0000 7f3b825de700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7c06b460 con 0x7f3b7c09e1d0 2023-10-03T10:14:34.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.065+0000 7f3b825de700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c09a7e0 con 0x7f3b7c139170 2023-10-03T10:14:34.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.066+0000 7f3b7b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3b7c09e1d0 0x7f3b7c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.066+0000 7f3b80b7b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b7c139170 0x7f3b7c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.066+0000 7f3b80b7b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b7c139170 0x7f3b7c13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39768/0 (socket says 172.21.15.72:39768) 2023-10-03T10:14:34.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.066+0000 7f3b7b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3b7c09e1d0 0x7f3b7c138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46270/0 (socket says 172.21.15.72:46270) 2023-10-03T10:14:34.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.066+0000 7f3b80b7b700 1 -- 172.21.15.72:0/678356741 learned_addr learned my addr 172.21.15.72:0/678356741 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:34.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.066+0000 7f3b80b7b700 1 -- 172.21.15.72:0/678356741 >> v2:172.21.15.72:3300/0 conn(0x7f3b7c09e1d0 msgr2=0x7f3b7c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.066+0000 7f3b80b7b700 1 --2- 172.21.15.72:0/678356741 >> v2:172.21.15.72:3300/0 conn(0x7f3b7c09e1d0 0x7f3b7c138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.066+0000 7f3b80b7b700 1 -- 172.21.15.72:0/678356741 >> v1:172.21.15.72:6789/0 conn(0x7f3b7c09d6f0 legacy=0x7f3b7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.066+0000 7f3b80b7b700 1 -- 172.21.15.72:0/678356741 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c09a500 con 0x7f3b7c139170 2023-10-03T10:14:34.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.066+0000 7f3b7b7fe700 1 --2- 172.21.15.72:0/678356741 >> v2:172.21.15.72:3300/0 conn(0x7f3b7c09e1d0 0x7f3b7c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.066+0000 7f3b80b7b700 1 --2- 172.21.15.72:0/678356741 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b7c139170 0x7f3b7c13b550 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009e80 tx=0x7f3b7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afaa517f6ef28ebc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.066+0000 7f3b7affd700 1 -- 172.21.15.72:0/678356741 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7400e070 con 0x7f3b7c139170 2023-10-03T10:14:34.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.066+0000 7f3b7affd700 1 -- 172.21.15.72:0/678356741 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7400b8d0 con 0x7f3b7c139170 2023-10-03T10:14:34.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.066+0000 7f3b7affd700 1 -- 172.21.15.72:0/678356741 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7400bc80 con 0x7f3b7c139170 2023-10-03T10:14:34.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.067+0000 7f3b825de700 1 -- 172.21.15.72:0/678356741 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b7c139170 msgr2=0x7f3b7c13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.067+0000 7f3b825de700 1 --2- 172.21.15.72:0/678356741 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b7c139170 0x7f3b7c13b550 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009e80 tx=0x7f3b7400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:34.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.067+0000 7f3b825de700 1 -- 172.21.15.72:0/678356741 shutdown_connections 2023-10-03T10:14:34.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.067+0000 7f3b825de700 1 --2- 172.21.15.72:0/678356741 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b7c139170 0x7f3b7c13b550 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.067+0000 7f3b825de700 1 --2- 172.21.15.72:0/678356741 >> v2:172.21.15.72:3300/0 conn(0x7f3b7c09e1d0 0x7f3b7c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.067+0000 7f3b825de700 1 -- 172.21.15.72:0/678356741 >> 172.21.15.72:0/678356741 conn(0x7f3b7c066f50 msgr2=0x7f3b7c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.067+0000 7f3b825de700 1 -- 172.21.15.72:0/678356741 shutdown_connections 2023-10-03T10:14:34.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.067+0000 7f3b825de700 1 -- 172.21.15.72:0/678356741 wait complete. 2023-10-03T10:14:34.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.068+0000 7f3b825de700 1 Processor -- start 2023-10-03T10:14:34.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.068+0000 7f3b825de700 1 -- start start 2023-10-03T10:14:34.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.068+0000 7f3b825de700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b7c09d6f0 0x7f3b7c11e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.068+0000 7f3b825de700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b7c09e1d0 0x7f3b7c11ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.068+0000 7f3b825de700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c139170 0x7f3b7c11f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.068+0000 7f3b825de700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c121e90 con 0x7f3b7c09e1d0 2023-10-03T10:14:34.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.068+0000 7f3b825de700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c09c710 con 0x7f3b7c139170 2023-10-03T10:14:34.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.068+0000 7f3b825de700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c120550 con 0x7f3b7c09d6f0 2023-10-03T10:14:34.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.068+0000 7f3b7bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b7c09d6f0 0x7f3b7c11e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.068+0000 7f3b7b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b7c09e1d0 0x7f3b7c11ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.068+0000 7f3b7bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b7c09d6f0 0x7f3b7c11e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39774/0 (socket says 172.21.15.72:39774) 2023-10-03T10:14:34.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.069+0000 7f3b7bfff700 1 -- 172.21.15.72:0/623681842 learned_addr learned my addr 172.21.15.72:0/623681842 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:34.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.069+0000 7f3b80b7b700 1 --2- 172.21.15.72:0/623681842 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c139170 0x7f3b7c11f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.069+0000 7f3b7bfff700 1 -- 172.21.15.72:0/623681842 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c139170 msgr2=0x7f3b7c11f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.069+0000 7f3b7bfff700 1 --2- 172.21.15.72:0/623681842 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c139170 0x7f3b7c11f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.069+0000 7f3b7bfff700 1 -- 172.21.15.72:0/623681842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b7c09e1d0 msgr2=0x7f3b7c11ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.069+0000 7f3b7bfff700 1 --2- 172.21.15.72:0/623681842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b7c09e1d0 0x7f3b7c11ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.069+0000 7f3b7bfff700 1 -- 172.21.15.72:0/623681842 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c0094a0 con 0x7f3b7c09d6f0 2023-10-03T10:14:34.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.069+0000 7f3b7b7fe700 1 --2- 172.21.15.72:0/623681842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b7c09e1d0 0x7f3b7c11ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.069+0000 7f3b7bfff700 1 --2- 172.21.15.72:0/623681842 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b7c09d6f0 0x7f3b7c11e8c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000c510 tx=0x7f3b7000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.069+0000 7f3b78ff9700 1 -- 172.21.15.72:0/623681842 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b700052d0 con 0x7f3b7c09d6f0 2023-10-03T10:14:34.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.069+0000 7f3b78ff9700 1 -- 172.21.15.72:0/623681842 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b70005430 con 0x7f3b7c09d6f0 2023-10-03T10:14:34.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.069+0000 7f3b825de700 1 -- 172.21.15.72:0/623681842 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b74009b30 con 0x7f3b7c09d6f0 2023-10-03T10:14:34.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.069+0000 7f3b78ff9700 1 -- 172.21.15.72:0/623681842 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b700038c0 con 0x7f3b7c09d6f0 2023-10-03T10:14:34.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.069+0000 7f3b825de700 1 -- 172.21.15.72:0/623681842 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c122070 con 0x7f3b7c09d6f0 2023-10-03T10:14:34.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.070+0000 7f3b78ff9700 1 -- 172.21.15.72:0/623681842 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b70003a20 con 0x7f3b7c09d6f0 2023-10-03T10:14:34.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.070+0000 7f3b78ff9700 1 -- 172.21.15.72:0/623681842 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3b7003ea60 con 0x7f3b7c09d6f0 2023-10-03T10:14:34.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.070+0000 7f3b825de700 1 -- 172.21.15.72:0/623681842 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7c121cc0 con 0x7f3b7c09d6f0 2023-10-03T10:14:34.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.075+0000 7f3b78ff9700 1 -- 172.21.15.72:0/623681842 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b70018260 con 0x7f3b7c09d6f0 2023-10-03T10:14:34.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.258+0000 7f3b825de700 1 -- 172.21.15.72:0/623681842 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3b7c09f420 con 0x7f3b7c09d6f0 2023-10-03T10:14:34.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.258+0000 7f3b78ff9700 1 -- 172.21.15.72:0/623681842 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b70017020 con 0x7f3b7c09d6f0 2023-10-03T10:14:34.259 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:34.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.260+0000 7f3b825de700 1 -- 172.21.15.72:0/623681842 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b7c09d6f0 msgr2=0x7f3b7c11e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.260+0000 7f3b825de700 1 --2- 172.21.15.72:0/623681842 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b7c09d6f0 0x7f3b7c11e8c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000c510 tx=0x7f3b7000c820 comp rx=0 tx=0).stop 2023-10-03T10:14:34.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.260+0000 7f3b825de700 1 -- 172.21.15.72:0/623681842 shutdown_connections 2023-10-03T10:14:34.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.260+0000 7f3b825de700 1 --2- 172.21.15.72:0/623681842 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c139170 0x7f3b7c11f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.260+0000 7f3b825de700 1 --2- 172.21.15.72:0/623681842 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b7c09d6f0 0x7f3b7c11e8c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.260+0000 7f3b825de700 1 --2- 172.21.15.72:0/623681842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b7c09e1d0 0x7f3b7c11ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.260+0000 7f3b825de700 1 -- 172.21.15.72:0/623681842 >> 172.21.15.72:0/623681842 conn(0x7f3b7c066f50 msgr2=0x7f3b7c09b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.261+0000 7f3b825de700 1 -- 172.21.15.72:0/623681842 shutdown_connections 2023-10-03T10:14:34.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.261+0000 7f3b825de700 1 -- 172.21.15.72:0/623681842 wait complete. 2023-10-03T10:14:34.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:34.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:34.338 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:34.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:34.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.386+0000 7f782428b700 1 Processor -- start 2023-10-03T10:14:34.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.386+0000 7f782428b700 1 -- start start 2023-10-03T10:14:34.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f782428b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f781c09d6f0 0x7f781c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f782428b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c09e000 0x7f781c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f782428b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c09e410 0x7f781c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f782428b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c06b460 con 0x7f781c09d6f0 2023-10-03T10:14:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f782428b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781c09b120 con 0x7f781c09e000 2023-10-03T10:14:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f782428b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f781c09a7e0 con 0x7f781c09e410 2023-10-03T10:14:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f7822027700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f781c09d6f0 0x7f781c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f7821826700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c09e000 0x7f781c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f7822027700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f781c09d6f0 0x7f781c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46292/0 (socket says 172.21.15.72:46292) 2023-10-03T10:14:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f7821826700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c09e000 0x7f781c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40280/0 (socket says 172.21.15.72:40280) 2023-10-03T10:14:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f7822027700 1 -- 172.21.15.72:0/1296021301 learned_addr learned my addr 172.21.15.72:0/1296021301 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:34.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f7822828700 1 --2- 172.21.15.72:0/1296021301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c09e410 0x7f781c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f7822027700 1 -- 172.21.15.72:0/1296021301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c09e410 msgr2=0x7f781c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f7822027700 1 --2- 172.21.15.72:0/1296021301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c09e410 0x7f781c133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f7822027700 1 -- 172.21.15.72:0/1296021301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c09e000 msgr2=0x7f781c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f7822027700 1 --2- 172.21.15.72:0/1296021301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c09e000 0x7f781c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f7822027700 1 -- 172.21.15.72:0/1296021301 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c09a500 con 0x7f781c09d6f0 2023-10-03T10:14:34.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f7822828700 1 --2- 172.21.15.72:0/1296021301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c09e410 0x7f781c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.387+0000 7f7821826700 1 --2- 172.21.15.72:0/1296021301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c09e000 0x7f781c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.388+0000 7f7822027700 1 --2- 172.21.15.72:0/1296021301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c09d6f0 0x7f781c09dac0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f78180098f0 tx=0x7f7818009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706d1b51d4869745 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.388+0000 7f7821025700 1 -- 172.21.15.72:0/1296021301 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818011830 con 0x7f781c09d6f0 2023-10-03T10:14:34.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.388+0000 7f7821025700 1 -- 172.21.15.72:0/1296021301 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7818011990 con 0x7f781c09d6f0 2023-10-03T10:14:34.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.388+0000 7f7821025700 1 -- 172.21.15.72:0/1296021301 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818011d20 con 0x7f781c09d6f0 2023-10-03T10:14:34.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.389+0000 7f782428b700 1 -- 172.21.15.72:0/1296021301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c09d6f0 msgr2=0x7f781c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.389+0000 7f782428b700 1 --2- 172.21.15.72:0/1296021301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c09d6f0 0x7f781c09dac0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f78180098f0 tx=0x7f7818009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:34.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.389+0000 7f782428b700 1 -- 172.21.15.72:0/1296021301 shutdown_connections 2023-10-03T10:14:34.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.389+0000 7f782428b700 1 --2- 172.21.15.72:0/1296021301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c09e410 0x7f781c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.389+0000 7f782428b700 1 --2- 172.21.15.72:0/1296021301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c09d6f0 0x7f781c09dac0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.389+0000 7f782428b700 1 --2- 172.21.15.72:0/1296021301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c09e000 0x7f781c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.389+0000 7f782428b700 1 -- 172.21.15.72:0/1296021301 >> 172.21.15.72:0/1296021301 conn(0x7f781c066f50 msgr2=0x7f781c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.389+0000 7f782428b700 1 -- 172.21.15.72:0/1296021301 shutdown_connections 2023-10-03T10:14:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.389+0000 7f782428b700 1 -- 172.21.15.72:0/1296021301 wait complete. 2023-10-03T10:14:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.390+0000 7f782428b700 1 Processor -- start 2023-10-03T10:14:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.390+0000 7f782428b700 1 -- start start 2023-10-03T10:14:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.390+0000 7f782428b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c09d6f0 0x7f781c1c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.390+0000 7f782428b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c09e000 0x7f781c1c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.390+0000 7f782428b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c09e410 0x7f781c1c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.390+0000 7f782428b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c1a7190 con 0x7f781c09d6f0 2023-10-03T10:14:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.390+0000 7f782428b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781c1b9320 con 0x7f781c09e410 2023-10-03T10:14:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.390+0000 7f782428b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f781c1a6520 con 0x7f781c09e000 2023-10-03T10:14:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.390+0000 7f7821826700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c09e000 0x7f781c1c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.390+0000 7f7822828700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c09e410 0x7f781c1c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.390+0000 7f7821826700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c09e000 0x7f781c1c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39788/0 (socket says 172.21.15.72:39788) 2023-10-03T10:14:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.390+0000 7f7821826700 1 -- 172.21.15.72:0/1208590308 learned_addr learned my addr 172.21.15.72:0/1208590308 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.390+0000 7f7822027700 1 --2- 172.21.15.72:0/1208590308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c09d6f0 0x7f781c1c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.391+0000 7f7822828700 1 -- 172.21.15.72:0/1208590308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c09e000 msgr2=0x7f781c1c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.391+0000 7f7822828700 1 --2- 172.21.15.72:0/1208590308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c09e000 0x7f781c1c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.391+0000 7f7822828700 1 -- 172.21.15.72:0/1208590308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c09d6f0 msgr2=0x7f781c1c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.391+0000 7f7822828700 1 --2- 172.21.15.72:0/1208590308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c09d6f0 0x7f781c1c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.391+0000 7f7822828700 1 -- 172.21.15.72:0/1208590308 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c0094a0 con 0x7f781c09e410 2023-10-03T10:14:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.391+0000 7f7821826700 1 --2- 172.21.15.72:0/1208590308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c09e000 0x7f781c1c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.391+0000 7f7822027700 1 --2- 172.21.15.72:0/1208590308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c09d6f0 0x7f781c1c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.391+0000 7f7822828700 1 --2- 172.21.15.72:0/1208590308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c09e410 0x7f781c1c8b30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7814009e50 tx=0x7f781400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.391+0000 7f7812ffd700 1 -- 172.21.15.72:0/1208590308 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400ca90 con 0x7f781c09e410 2023-10-03T10:14:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.391+0000 7f7812ffd700 1 -- 172.21.15.72:0/1208590308 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781400f040 con 0x7f781c09e410 2023-10-03T10:14:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.391+0000 7f782428b700 1 -- 172.21.15.72:0/1208590308 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7814009a70 con 0x7f781c09e410 2023-10-03T10:14:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.391+0000 7f7812ffd700 1 -- 172.21.15.72:0/1208590308 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400ce50 con 0x7f781c09e410 2023-10-03T10:14:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.391+0000 7f782428b700 1 -- 172.21.15.72:0/1208590308 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7818009550 con 0x7f781c09e410 2023-10-03T10:14:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.392+0000 7f7812ffd700 1 -- 172.21.15.72:0/1208590308 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7814014480 con 0x7f781c09e410 2023-10-03T10:14:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.392+0000 7f782428b700 1 -- 172.21.15.72:0/1208590308 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781c074ea0 con 0x7f781c09e410 2023-10-03T10:14:34.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.393+0000 7f7812ffd700 1 -- 172.21.15.72:0/1208590308 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f781403fb50 con 0x7f781c09e410 2023-10-03T10:14:34.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.401+0000 7f7812ffd700 1 -- 172.21.15.72:0/1208590308 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7814012930 con 0x7f781c09e410 2023-10-03T10:14:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.468+0000 7f493809a700 1 Processor -- start 2023-10-03T10:14:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.469+0000 7f493809a700 1 -- start start 2023-10-03T10:14:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.469+0000 7f493809a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49300a0a30 0x7f49300a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.469+0000 7f493809a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f493009d630 0x7f49300a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.469+0000 7f493809a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49300a2a70 con 0x7f4930133930 2023-10-03T10:14:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.469+0000 7f493809a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49300a01d0 con 0x7f493009d630 2023-10-03T10:14:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.469+0000 7f493809a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493009e2b0 con 0x7f49300a0a30 2023-10-03T10:14:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.469+0000 7f4935635700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f493009d630 0x7f49300a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.469+0000 7f4935635700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f493009d630 0x7f49300a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46314/0 (socket says 172.21.15.72:46314) 2023-10-03T10:14:34.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.469+0000 7f4935635700 1 -- 172.21.15.72:0/3423952791 learned_addr learned my addr 172.21.15.72:0/3423952791 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.469+0000 7f4935e36700 1 --2- 172.21.15.72:0/3423952791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49300a0a30 0x7f49300a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.470+0000 7f4935635700 1 -- 172.21.15.72:0/3423952791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49300a0a30 msgr2=0x7f49300a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.470+0000 7f4935635700 1 --2- 172.21.15.72:0/3423952791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49300a0a30 0x7f49300a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.470+0000 7f4935635700 1 -- 172.21.15.72:0/3423952791 >> v1:172.21.15.72:6789/0 conn(0x7f4930133930 legacy=0x7f4930133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.470+0000 7f4935635700 1 -- 172.21.15.72:0/3423952791 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493009dc50 con 0x7f493009d630 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.470+0000 7f4935e36700 1 --2- 172.21.15.72:0/3423952791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49300a0a30 0x7f49300a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.470+0000 7f4935635700 1 --2- 172.21.15.72:0/3423952791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f493009d630 0x7f49300a1340 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f49200098f0 tx=0x7f4920009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313f5f1d29fe0b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.470+0000 7f4934e34700 1 -- 172.21.15.72:0/3423952791 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920011830 con 0x7f493009d630 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.470+0000 7f4934e34700 1 -- 172.21.15.72:0/3423952791 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4920011990 con 0x7f493009d630 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.470+0000 7f4934e34700 1 -- 172.21.15.72:0/3423952791 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920011d20 con 0x7f493009d630 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.471+0000 7f493809a700 1 -- 172.21.15.72:0/3423952791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f493009d630 msgr2=0x7f49300a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.471+0000 7f493809a700 1 --2- 172.21.15.72:0/3423952791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f493009d630 0x7f49300a1340 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f49200098f0 tx=0x7f4920009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:34.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.471+0000 7f493809a700 1 -- 172.21.15.72:0/3423952791 shutdown_connections 2023-10-03T10:14:34.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.471+0000 7f493809a700 1 --2- 172.21.15.72:0/3423952791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49300a0a30 0x7f49300a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.471+0000 7f493809a700 1 --2- 172.21.15.72:0/3423952791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f493009d630 0x7f49300a1340 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.471+0000 7f493809a700 1 -- 172.21.15.72:0/3423952791 >> 172.21.15.72:0/3423952791 conn(0x7f49300a3050 msgr2=0x7f49300a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.471+0000 7f493809a700 1 -- 172.21.15.72:0/3423952791 shutdown_connections 2023-10-03T10:14:34.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.471+0000 7f493809a700 1 -- 172.21.15.72:0/3423952791 wait complete. 2023-10-03T10:14:34.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.472+0000 7f493809a700 1 Processor -- start 2023-10-03T10:14:34.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.472+0000 7f493809a700 1 -- start start 2023-10-03T10:14:34.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f493809a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f493009d630 0x7f49301c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f493809a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49300a0a30 0x7f49301c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f493809a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4930133930 0x7f49301c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f493809a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4930120a70 con 0x7f4930133930 2023-10-03T10:14:34.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f493809a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4930120880 con 0x7f493009d630 2023-10-03T10:14:34.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f493809a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4930121920 con 0x7f49300a0a30 2023-10-03T10:14:34.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f4935e36700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f493009d630 0x7f49301c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f4935e36700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f493009d630 0x7f49301c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40310/0 (socket says 172.21.15.72:40310) 2023-10-03T10:14:34.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f4935e36700 1 -- 172.21.15.72:0/1196840523 learned_addr learned my addr 172.21.15.72:0/1196840523 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:34.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f4935635700 1 --2- 172.21.15.72:0/1196840523 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49300a0a30 0x7f49301c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f4936637700 1 --2- 172.21.15.72:0/1196840523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4930133930 0x7f49301c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f4935e36700 1 -- 172.21.15.72:0/1196840523 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49300a0a30 msgr2=0x7f49301c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f4935e36700 1 --2- 172.21.15.72:0/1196840523 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49300a0a30 0x7f49301c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f4935e36700 1 -- 172.21.15.72:0/1196840523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4930133930 msgr2=0x7f49301c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f4935e36700 1 --2- 172.21.15.72:0/1196840523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4930133930 0x7f49301c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f4935e36700 1 -- 172.21.15.72:0/1196840523 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c0094a0 con 0x7f493009d630 2023-10-03T10:14:34.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f4936637700 1 --2- 172.21.15.72:0/1196840523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4930133930 0x7f49301c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:34.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f4935e36700 1 --2- 172.21.15.72:0/1196840523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f493009d630 0x7f49301c8310 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f492c00ebe0 tx=0x7f492c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f49267fc700 1 -- 172.21.15.72:0/1196840523 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c009800 con 0x7f493009d630 2023-10-03T10:14:34.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.473+0000 7f49267fc700 1 -- 172.21.15.72:0/1196840523 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c00c910 con 0x7f493009d630 2023-10-03T10:14:34.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.474+0000 7f493809a700 1 -- 172.21.15.72:0/1196840523 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4920009550 con 0x7f493009d630 2023-10-03T10:14:34.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.474+0000 7f49267fc700 1 -- 172.21.15.72:0/1196840523 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c00cc80 con 0x7f493009d630 2023-10-03T10:14:34.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.474+0000 7f493809a700 1 -- 172.21.15.72:0/1196840523 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49301224b0 con 0x7f493009d630 2023-10-03T10:14:34.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.474+0000 7f493809a700 1 -- 172.21.15.72:0/1196840523 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4930121e90 con 0x7f493009d630 2023-10-03T10:14:34.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.475+0000 7f49267fc700 1 -- 172.21.15.72:0/1196840523 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f492c013470 con 0x7f493009d630 2023-10-03T10:14:34.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.475+0000 7f49267fc700 1 -- 172.21.15.72:0/1196840523 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f492c040020 con 0x7f493009d630 2023-10-03T10:14:34.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.479+0000 7f49267fc700 1 -- 172.21.15.72:0/1196840523 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f492c013720 con 0x7f493009d630 2023-10-03T10:14:34.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.516+0000 7f8dacb2c700 1 Processor -- start 2023-10-03T10:14:34.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.517+0000 7f8dacb2c700 1 -- start start 2023-10-03T10:14:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.517+0000 7f8dacb2c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8da806a770 0x7f8da806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.517+0000 7f8dacb2c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8da8131d10 0x7f8da8139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.517+0000 7f8dacb2c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da809ece0 con 0x7f8da806b080 2023-10-03T10:14:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.517+0000 7f8dacb2c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da809e760 con 0x7f8da8131d10 2023-10-03T10:14:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.517+0000 7f8dacb2c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8da809e040 con 0x7f8da806a770 2023-10-03T10:14:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.517+0000 7f8da659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8da806a770 0x7f8da806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.517+0000 7f8da659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8da806a770 0x7f8da806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39798/0 (socket says 172.21.15.72:39798) 2023-10-03T10:14:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.517+0000 7f8da659c700 1 -- 172.21.15.72:0/490256873 learned_addr learned my addr 172.21.15.72:0/490256873 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.517+0000 7f8da5d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8da806b080 0x7f8da8131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35392/0 (socket says 172.21.15.72:35392) 2023-10-03T10:14:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.517+0000 7f8da6d9d700 1 --2- 172.21.15.72:0/490256873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8da8131d10 0x7f8da8139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.518+0000 7f8da659c700 1 -- 172.21.15.72:0/490256873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8da8131d10 msgr2=0x7f8da8139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.518+0000 7f8da659c700 1 --2- 172.21.15.72:0/490256873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8da8131d10 0x7f8da8139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.518+0000 7f8da659c700 1 -- 172.21.15.72:0/490256873 >> v1:172.21.15.72:6789/0 conn(0x7f8da806b080 legacy=0x7f8da8131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.518+0000 7f8da659c700 1 -- 172.21.15.72:0/490256873 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da809f630 con 0x7f8da806a770 2023-10-03T10:14:34.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.518+0000 7f8da659c700 1 --2- 172.21.15.72:0/490256873 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8da806a770 0x7f8da806ab40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009920 tx=0x7f8d98009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=145bbbe253a98d82 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.518+0000 7f8da559a700 1 -- 172.21.15.72:0/490256873 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98011830 con 0x7f8da806a770 2023-10-03T10:14:34.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.518+0000 7f8da559a700 1 -- 172.21.15.72:0/490256873 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d98011990 con 0x7f8da806a770 2023-10-03T10:14:34.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.518+0000 7f8da559a700 1 -- 172.21.15.72:0/490256873 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98011d20 con 0x7f8da806a770 2023-10-03T10:14:34.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.519+0000 7f8dacb2c700 1 -- 172.21.15.72:0/490256873 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8da806a770 msgr2=0x7f8da806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.519+0000 7f8dacb2c700 1 --2- 172.21.15.72:0/490256873 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8da806a770 0x7f8da806ab40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009920 tx=0x7f8d98009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.519+0000 7f8dacb2c700 1 -- 172.21.15.72:0/490256873 shutdown_connections 2023-10-03T10:14:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.519+0000 7f8dacb2c700 1 --2- 172.21.15.72:0/490256873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8da8131d10 0x7f8da8139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.519+0000 7f8dacb2c700 1 --2- 172.21.15.72:0/490256873 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8da806a770 0x7f8da806ab40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.519+0000 7f8dacb2c700 1 -- 172.21.15.72:0/490256873 >> 172.21.15.72:0/490256873 conn(0x7f8da8066f50 msgr2=0x7f8da809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.519+0000 7f8dacb2c700 1 -- 172.21.15.72:0/490256873 shutdown_connections 2023-10-03T10:14:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.519+0000 7f8dacb2c700 1 -- 172.21.15.72:0/490256873 wait complete. 2023-10-03T10:14:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.520+0000 7f8dacb2c700 1 Processor -- start 2023-10-03T10:14:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.520+0000 7f8dacb2c700 1 -- start start 2023-10-03T10:14:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8dacb2c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8da806a770 0x7f8da81c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8dacb2c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da806b080 0x7f8da81c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8dacb2c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8da8131d10 0x7f8da81c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8dacb2c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da8071e60 con 0x7f8da806b080 2023-10-03T10:14:34.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8dacb2c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da81222e0 con 0x7f8da8131d10 2023-10-03T10:14:34.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8dacb2c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8da8123ad0 con 0x7f8da806a770 2023-10-03T10:14:34.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8da659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8da806a770 0x7f8da81c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8da659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8da806a770 0x7f8da81c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39810/0 (socket says 172.21.15.72:39810) 2023-10-03T10:14:34.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8da659c700 1 -- 172.21.15.72:0/2548424235 learned_addr learned my addr 172.21.15.72:0/2548424235 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:34.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8da5d9b700 1 --2- 172.21.15.72:0/2548424235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da806b080 0x7f8da81c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8da6d9d700 1 --2- 172.21.15.72:0/2548424235 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8da8131d10 0x7f8da81c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8da659c700 1 -- 172.21.15.72:0/2548424235 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8da8131d10 msgr2=0x7f8da81c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8da659c700 1 --2- 172.21.15.72:0/2548424235 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8da8131d10 0x7f8da81c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8da659c700 1 -- 172.21.15.72:0/2548424235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da806b080 msgr2=0x7f8da81c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8da659c700 1 --2- 172.21.15.72:0/2548424235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da806b080 0x7f8da81c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8da659c700 1 -- 172.21.15.72:0/2548424235 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d98009550 con 0x7f8da806a770 2023-10-03T10:14:34.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.521+0000 7f8da5d9b700 1 --2- 172.21.15.72:0/2548424235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da806b080 0x7f8da81c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.522+0000 7f8da659c700 1 --2- 172.21.15.72:0/2548424235 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8da806a770 0x7f8da81c6000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8d98000c00 tx=0x7f8d98004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.522+0000 7f8d96ffd700 1 -- 172.21.15.72:0/2548424235 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98004450 con 0x7f8da806a770 2023-10-03T10:14:34.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.522+0000 7f8d96ffd700 1 -- 172.21.15.72:0/2548424235 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d980045b0 con 0x7f8da806a770 2023-10-03T10:14:34.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.522+0000 7f8dacb2c700 1 -- 172.21.15.72:0/2548424235 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da81315e0 con 0x7f8da806a770 2023-10-03T10:14:34.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.522+0000 7f8d96ffd700 1 -- 172.21.15.72:0/2548424235 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d980038c0 con 0x7f8da806a770 2023-10-03T10:14:34.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.522+0000 7f8dacb2c700 1 -- 172.21.15.72:0/2548424235 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da8124800 con 0x7f8da806a770 2023-10-03T10:14:34.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.523+0000 7f8d96ffd700 1 -- 172.21.15.72:0/2548424235 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d98003a20 con 0x7f8da806a770 2023-10-03T10:14:34.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.523+0000 7f8d96ffd700 1 -- 172.21.15.72:0/2548424235 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8d98021030 con 0x7f8da806a770 2023-10-03T10:14:34.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.523+0000 7f8dacb2c700 1 -- 172.21.15.72:0/2548424235 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da8074ea0 con 0x7f8da806a770 2023-10-03T10:14:34.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.532+0000 7f8d96ffd700 1 -- 172.21.15.72:0/2548424235 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d9801a430 con 0x7f8da806a770 2023-10-03T10:14:34.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.608+0000 7f782428b700 1 -- 172.21.15.72:0/1208590308 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f781c1a7dd0 con 0x7f781c09e410 2023-10-03T10:14:34.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.608+0000 7f7812ffd700 1 -- 172.21.15.72:0/1208590308 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7814012340 con 0x7f781c09e410 2023-10-03T10:14:34.609 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:34.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.611+0000 7f782428b700 1 -- 172.21.15.72:0/1208590308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c09e410 msgr2=0x7f781c1c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.611+0000 7f782428b700 1 --2- 172.21.15.72:0/1208590308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c09e410 0x7f781c1c8b30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7814009e50 tx=0x7f781400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.611+0000 7f782428b700 1 -- 172.21.15.72:0/1208590308 shutdown_connections 2023-10-03T10:14:34.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.611+0000 7f782428b700 1 --2- 172.21.15.72:0/1208590308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c09d6f0 0x7f781c1c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.611+0000 7f782428b700 1 --2- 172.21.15.72:0/1208590308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c09e410 0x7f781c1c8b30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.611+0000 7f782428b700 1 --2- 172.21.15.72:0/1208590308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c09e000 0x7f781c1c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.611+0000 7f782428b700 1 -- 172.21.15.72:0/1208590308 >> 172.21.15.72:0/1208590308 conn(0x7f781c066f50 msgr2=0x7f781c1bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.612+0000 7f782428b700 1 -- 172.21.15.72:0/1208590308 shutdown_connections 2023-10-03T10:14:34.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.612+0000 7f782428b700 1 -- 172.21.15.72:0/1208590308 wait complete. 2023-10-03T10:14:34.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:34.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.687+0000 7f493809a700 1 -- 172.21.15.72:0/1196840523 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4930074770 con 0x7f493009d630 2023-10-03T10:14:34.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.688+0000 7f49267fc700 1 -- 172.21.15.72:0/1196840523 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f492c021020 con 0x7f493009d630 2023-10-03T10:14:34.688 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:34.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.690+0000 7f493809a700 1 -- 172.21.15.72:0/1196840523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f493009d630 msgr2=0x7f49301c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.690+0000 7f493809a700 1 --2- 172.21.15.72:0/1196840523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f493009d630 0x7f49301c8310 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f492c00ebe0 tx=0x7f492c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.690+0000 7f493809a700 1 -- 172.21.15.72:0/1196840523 shutdown_connections 2023-10-03T10:14:34.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.690+0000 7f493809a700 1 --2- 172.21.15.72:0/1196840523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4930133930 0x7f49301c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.690+0000 7f493809a700 1 --2- 172.21.15.72:0/1196840523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f493009d630 0x7f49301c8310 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.690+0000 7f493809a700 1 --2- 172.21.15.72:0/1196840523 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49300a0a30 0x7f49301c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.690+0000 7f493809a700 1 -- 172.21.15.72:0/1196840523 >> 172.21.15.72:0/1196840523 conn(0x7f49300a3050 msgr2=0x7f49301bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.690+0000 7f493809a700 1 -- 172.21.15.72:0/1196840523 shutdown_connections 2023-10-03T10:14:34.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.690+0000 7f493809a700 1 -- 172.21.15.72:0/1196840523 wait complete. 2023-10-03T10:14:34.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:34.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.737+0000 7f8dacb2c700 1 -- 172.21.15.72:0/2548424235 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8da806c360 con 0x7f8da806a770 2023-10-03T10:14:34.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.738+0000 7f8d96ffd700 1 -- 172.21.15.72:0/2548424235 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8d9802b030 con 0x7f8da806a770 2023-10-03T10:14:34.738 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:34.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.740+0000 7f8dacb2c700 1 -- 172.21.15.72:0/2548424235 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8da806a770 msgr2=0x7f8da81c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.740+0000 7f8dacb2c700 1 --2- 172.21.15.72:0/2548424235 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8da806a770 0x7f8da81c6000 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8d98000c00 tx=0x7f8d98004750 comp rx=0 tx=0).stop 2023-10-03T10:14:34.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.740+0000 7f8dacb2c700 1 -- 172.21.15.72:0/2548424235 shutdown_connections 2023-10-03T10:14:34.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.740+0000 7f8dacb2c700 1 --2- 172.21.15.72:0/2548424235 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8da8131d10 0x7f8da81c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.740+0000 7f8dacb2c700 1 --2- 172.21.15.72:0/2548424235 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8da806a770 0x7f8da81c6000 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.740+0000 7f8dacb2c700 1 --2- 172.21.15.72:0/2548424235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8da806b080 0x7f8da81c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.740+0000 7f8dacb2c700 1 -- 172.21.15.72:0/2548424235 >> 172.21.15.72:0/2548424235 conn(0x7f8da8066f50 msgr2=0x7f8da806ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.740+0000 7f8dacb2c700 1 -- 172.21.15.72:0/2548424235 shutdown_connections 2023-10-03T10:14:34.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:34.740+0000 7f8dacb2c700 1 -- 172.21.15.72:0/2548424235 wait complete. 2023-10-03T10:14:34.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:35.275 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:35.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.398+0000 7f541c792700 1 Processor -- start 2023-10-03T10:14:35.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.398+0000 7f541c792700 1 -- start start 2023-10-03T10:14:35.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.399+0000 7f541c792700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f541409e1d0 0x7f5414138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.399+0000 7f541c792700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5414139170 0x7f541413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.399+0000 7f541c792700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541409b120 con 0x7f541409d6f0 2023-10-03T10:14:35.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.399+0000 7f541c792700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541406b460 con 0x7f5414139170 2023-10-03T10:14:35.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.399+0000 7f541c792700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f541409a7e0 con 0x7f541409e1d0 2023-10-03T10:14:35.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.399+0000 7f541ad2f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5414139170 0x7f541413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.399+0000 7f5419d2d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f541409e1d0 0x7f5414138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.399+0000 7f5419d2d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f541409e1d0 0x7f5414138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39814/0 (socket says 172.21.15.72:39814) 2023-10-03T10:14:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.399+0000 7f541ad2f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5414139170 0x7f541413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46342/0 (socket says 172.21.15.72:46342) 2023-10-03T10:14:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.399+0000 7f5419d2d700 1 -- 172.21.15.72:0/3404719603 learned_addr learned my addr 172.21.15.72:0/3404719603 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.399+0000 7f5419d2d700 1 -- 172.21.15.72:0/3404719603 >> v2:172.21.15.72:3300/0 conn(0x7f5414139170 msgr2=0x7f541413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.399+0000 7f5419d2d700 1 --2- 172.21.15.72:0/3404719603 >> v2:172.21.15.72:3300/0 conn(0x7f5414139170 0x7f541413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.399+0000 7f5419d2d700 1 -- 172.21.15.72:0/3404719603 >> v1:172.21.15.72:6789/0 conn(0x7f541409d6f0 legacy=0x7f541409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.399+0000 7f5419d2d700 1 -- 172.21.15.72:0/3404719603 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541409a500 con 0x7f541409e1d0 2023-10-03T10:14:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.399+0000 7f541ad2f700 1 --2- 172.21.15.72:0/3404719603 >> v2:172.21.15.72:3300/0 conn(0x7f5414139170 0x7f541413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.400+0000 7f5419d2d700 1 --2- 172.21.15.72:0/3404719603 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f541409e1d0 0x7f5414138c30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5410009920 tx=0x7f5410009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e3c829ad453c488 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.400+0000 7f541952c700 1 -- 172.21.15.72:0/3404719603 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410011830 con 0x7f541409e1d0 2023-10-03T10:14:35.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.400+0000 7f541952c700 1 -- 172.21.15.72:0/3404719603 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5410011990 con 0x7f541409e1d0 2023-10-03T10:14:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.400+0000 7f541952c700 1 -- 172.21.15.72:0/3404719603 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410011d20 con 0x7f541409e1d0 2023-10-03T10:14:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.400+0000 7f541c792700 1 -- 172.21.15.72:0/3404719603 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f541409e1d0 msgr2=0x7f5414138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.400+0000 7f541c792700 1 --2- 172.21.15.72:0/3404719603 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f541409e1d0 0x7f5414138c30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5410009920 tx=0x7f5410009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.400+0000 7f541c792700 1 -- 172.21.15.72:0/3404719603 shutdown_connections 2023-10-03T10:14:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.400+0000 7f541c792700 1 --2- 172.21.15.72:0/3404719603 >> v2:172.21.15.72:3300/0 conn(0x7f5414139170 0x7f541413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.400+0000 7f541c792700 1 --2- 172.21.15.72:0/3404719603 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f541409e1d0 0x7f5414138c30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.400+0000 7f541c792700 1 -- 172.21.15.72:0/3404719603 >> 172.21.15.72:0/3404719603 conn(0x7f5414066f50 msgr2=0x7f541409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.400+0000 7f541c792700 1 -- 172.21.15.72:0/3404719603 shutdown_connections 2023-10-03T10:14:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.400+0000 7f541c792700 1 -- 172.21.15.72:0/3404719603 wait complete. 2023-10-03T10:14:35.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.401+0000 7f541c792700 1 Processor -- start 2023-10-03T10:14:35.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.401+0000 7f541c792700 1 -- start start 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541c792700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f541409d6f0 0x7f541411e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541c792700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f541409e1d0 0x7f541411edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541c792700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5414139170 0x7f541411f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541c792700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541409c710 con 0x7f5414139170 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541c792700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54141220c0 con 0x7f541409d6f0 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541c792700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54141205a0 con 0x7f541409e1d0 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f5419d2d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f541409e1d0 0x7f541411edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541a52e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f541409d6f0 0x7f541411e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541ad2f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5414139170 0x7f541411f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f5419d2d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f541409e1d0 0x7f541411edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39818/0 (socket says 172.21.15.72:39818) 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f5419d2d700 1 -- 172.21.15.72:0/2833225353 learned_addr learned my addr 172.21.15.72:0/2833225353 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:35.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541a52e700 1 -- 172.21.15.72:0/2833225353 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f541409e1d0 msgr2=0x7f541411edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541a52e700 1 --2- 172.21.15.72:0/2833225353 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f541409e1d0 0x7f541411edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541a52e700 1 -- 172.21.15.72:0/2833225353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5414139170 msgr2=0x7f541411f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541a52e700 1 --2- 172.21.15.72:0/2833225353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5414139170 0x7f541411f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541a52e700 1 -- 172.21.15.72:0/2833225353 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c009a70 con 0x7f541409d6f0 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541ad2f700 1 --2- 172.21.15.72:0/2833225353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5414139170 0x7f541411f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541a52e700 1 --2- 172.21.15.72:0/2833225353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f541409d6f0 0x7f541411e880 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5404000f60 tx=0x7f540400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f540affd700 1 -- 172.21.15.72:0/2833225353 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040052d0 con 0x7f541409d6f0 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f540affd700 1 -- 172.21.15.72:0/2833225353 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5404005430 con 0x7f541409d6f0 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541c792700 1 -- 172.21.15.72:0/2833225353 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5410009550 con 0x7f541409d6f0 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f540affd700 1 -- 172.21.15.72:0/2833225353 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040038c0 con 0x7f541409d6f0 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.402+0000 7f541c792700 1 -- 172.21.15.72:0/2833225353 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5414122b30 con 0x7f541409d6f0 2023-10-03T10:14:35.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.403+0000 7f540affd700 1 -- 172.21.15.72:0/2833225353 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5404003a20 con 0x7f541409d6f0 2023-10-03T10:14:35.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.403+0000 7f540affd700 1 -- 172.21.15.72:0/2833225353 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f540403e950 con 0x7f541409d6f0 2023-10-03T10:14:35.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.403+0000 7f541c792700 1 -- 172.21.15.72:0/2833225353 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5414121ce0 con 0x7f541409d6f0 2023-10-03T10:14:35.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.408+0000 7f540affd700 1 -- 172.21.15.72:0/2833225353 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5404017070 con 0x7f541409d6f0 2023-10-03T10:14:35.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.595+0000 7f541c792700 1 -- 172.21.15.72:0/2833225353 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5414074ea0 con 0x7f541409d6f0 2023-10-03T10:14:35.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.595+0000 7f540affd700 1 -- 172.21.15.72:0/2833225353 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5404011590 con 0x7f541409d6f0 2023-10-03T10:14:35.596 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:35.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.597+0000 7f541c792700 1 -- 172.21.15.72:0/2833225353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f541409d6f0 msgr2=0x7f541411e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.597+0000 7f541c792700 1 --2- 172.21.15.72:0/2833225353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f541409d6f0 0x7f541411e880 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5404000f60 tx=0x7f540400c730 comp rx=0 tx=0).stop 2023-10-03T10:14:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.598+0000 7f541c792700 1 -- 172.21.15.72:0/2833225353 shutdown_connections 2023-10-03T10:14:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.598+0000 7f541c792700 1 --2- 172.21.15.72:0/2833225353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5414139170 0x7f541411f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.598+0000 7f541c792700 1 --2- 172.21.15.72:0/2833225353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f541409d6f0 0x7f541411e880 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.598+0000 7f541c792700 1 --2- 172.21.15.72:0/2833225353 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f541409e1d0 0x7f541411edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.598+0000 7f541c792700 1 -- 172.21.15.72:0/2833225353 >> 172.21.15.72:0/2833225353 conn(0x7f5414066f50 msgr2=0x7f541409b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.598+0000 7f541c792700 1 -- 172.21.15.72:0/2833225353 shutdown_connections 2023-10-03T10:14:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.598+0000 7f541c792700 1 -- 172.21.15.72:0/2833225353 wait complete. 2023-10-03T10:14:35.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:35.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:35.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:35.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:35.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.754+0000 7fe37fec8700 1 Processor -- start 2023-10-03T10:14:35.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.754+0000 7fe37fec8700 1 -- start start 2023-10-03T10:14:35.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.755+0000 7fe37fec8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe37809e930 0x7fe37809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.755+0000 7fe37fec8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe37809f240 0x7fe3781317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.755+0000 7fe37fec8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe378070940 con 0x7fe37809f650 2023-10-03T10:14:35.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.755+0000 7fe37fec8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37806fd60 con 0x7fe37809f240 2023-10-03T10:14:35.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.755+0000 7fe37fec8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe37806fa80 con 0x7fe37809e930 2023-10-03T10:14:35.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.755+0000 7fe37d463700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe37809f240 0x7fe3781317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.755+0000 7fe37dc64700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe37809e930 0x7fe37809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.755+0000 7fe37d463700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe37809f240 0x7fe3781317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46358/0 (socket says 172.21.15.72:46358) 2023-10-03T10:14:35.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.755+0000 7fe37dc64700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe37809e930 0x7fe37809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39822/0 (socket says 172.21.15.72:39822) 2023-10-03T10:14:35.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.755+0000 7fe37d463700 1 -- 172.21.15.72:0/1325339294 learned_addr learned my addr 172.21.15.72:0/1325339294 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:35.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.755+0000 7fe37dc64700 1 -- 172.21.15.72:0/1325339294 >> v2:172.21.15.72:3300/0 conn(0x7fe37809f240 msgr2=0x7fe3781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.755+0000 7fe37dc64700 1 --2- 172.21.15.72:0/1325339294 >> v2:172.21.15.72:3300/0 conn(0x7fe37809f240 0x7fe3781317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.755+0000 7fe37dc64700 1 -- 172.21.15.72:0/1325339294 >> v1:172.21.15.72:6789/0 conn(0x7fe37809f650 legacy=0x7fe378131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.755+0000 7fe37dc64700 1 -- 172.21.15.72:0/1325339294 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37809fb60 con 0x7fe37809e930 2023-10-03T10:14:35.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.755+0000 7fe37d463700 1 --2- 172.21.15.72:0/1325339294 >> v2:172.21.15.72:3300/0 conn(0x7fe37809f240 0x7fe3781317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:35.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.756+0000 7fe37dc64700 1 --2- 172.21.15.72:0/1325339294 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe37809e930 0x7fe37809ed00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe374009840 tx=0x7fe374009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a6dbf524ca1e8b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.756+0000 7fe37cc62700 1 -- 172.21.15.72:0/1325339294 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe374011830 con 0x7fe37809e930 2023-10-03T10:14:35.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.756+0000 7fe37cc62700 1 -- 172.21.15.72:0/1325339294 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe374011990 con 0x7fe37809e930 2023-10-03T10:14:35.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.756+0000 7fe37cc62700 1 -- 172.21.15.72:0/1325339294 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe374011d20 con 0x7fe37809e930 2023-10-03T10:14:35.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.757+0000 7fe37fec8700 1 -- 172.21.15.72:0/1325339294 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe37809e930 msgr2=0x7fe37809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.757+0000 7fe37fec8700 1 --2- 172.21.15.72:0/1325339294 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe37809e930 0x7fe37809ed00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe374009840 tx=0x7fe374009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:35.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.757+0000 7fe37fec8700 1 -- 172.21.15.72:0/1325339294 shutdown_connections 2023-10-03T10:14:35.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.757+0000 7fe37fec8700 1 --2- 172.21.15.72:0/1325339294 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe37809e930 0x7fe37809ed00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.757+0000 7fe37fec8700 1 --2- 172.21.15.72:0/1325339294 >> v2:172.21.15.72:3300/0 conn(0x7fe37809f240 0x7fe3781317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.757+0000 7fe37fec8700 1 -- 172.21.15.72:0/1325339294 >> 172.21.15.72:0/1325339294 conn(0x7fe3780a4210 msgr2=0x7fe3780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.757+0000 7fe37fec8700 1 -- 172.21.15.72:0/1325339294 shutdown_connections 2023-10-03T10:14:35.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.757+0000 7fe37fec8700 1 -- 172.21.15.72:0/1325339294 wait complete. 2023-10-03T10:14:35.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.758+0000 7fe37fec8700 1 Processor -- start 2023-10-03T10:14:35.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.758+0000 7fe37fec8700 1 -- start start 2023-10-03T10:14:35.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.758+0000 7fe37fec8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe37809e930 0x7fe37806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.758+0000 7fe37fec8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe37809f240 0x7fe37806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.758+0000 7fe37fec8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe37809f650 0x7fe37806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.758+0000 7fe37fec8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3781b72b0 con 0x7fe37809f650 2023-10-03T10:14:35.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.758+0000 7fe37fec8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3781a9460 con 0x7fe37809e930 2023-10-03T10:14:35.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.758+0000 7fe37fec8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3781a8980 con 0x7fe37809f240 2023-10-03T10:14:35.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.758+0000 7fe37d463700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe37809f240 0x7fe37806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.758+0000 7fe37dc64700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe37809e930 0x7fe37806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.758+0000 7fe37d463700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe37809f240 0x7fe37806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39828/0 (socket says 172.21.15.72:39828) 2023-10-03T10:14:35.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.758+0000 7fe37d463700 1 -- 172.21.15.72:0/2037853168 learned_addr learned my addr 172.21.15.72:0/2037853168 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:35.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.758+0000 7fe37e465700 1 --2- 172.21.15.72:0/2037853168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe37809f650 0x7fe37806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.759+0000 7fe37d463700 1 -- 172.21.15.72:0/2037853168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe37809e930 msgr2=0x7fe37806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.759+0000 7fe37d463700 1 --2- 172.21.15.72:0/2037853168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe37809e930 0x7fe37806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.759+0000 7fe37d463700 1 -- 172.21.15.72:0/2037853168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe37809f650 msgr2=0x7fe37806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.759+0000 7fe37d463700 1 --2- 172.21.15.72:0/2037853168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe37809f650 0x7fe37806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.759+0000 7fe37d463700 1 -- 172.21.15.72:0/2037853168 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe368009550 con 0x7fe37809f240 2023-10-03T10:14:35.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.759+0000 7fe37d463700 1 --2- 172.21.15.72:0/2037853168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe37809f240 0x7fe37806bdf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe36800ebe0 tx=0x7fe36800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.759+0000 7fe36e7fc700 1 -- 172.21.15.72:0/2037853168 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36800c850 con 0x7fe37809f240 2023-10-03T10:14:35.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.759+0000 7fe36e7fc700 1 -- 172.21.15.72:0/2037853168 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36800c9b0 con 0x7fe37809f240 2023-10-03T10:14:35.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.759+0000 7fe37fec8700 1 -- 172.21.15.72:0/2037853168 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3740094a0 con 0x7fe37809f240 2023-10-03T10:14:35.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.759+0000 7fe36e7fc700 1 -- 172.21.15.72:0/2037853168 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36800cd60 con 0x7fe37809f240 2023-10-03T10:14:35.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.759+0000 7fe37fec8700 1 -- 172.21.15.72:0/2037853168 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3780a0190 con 0x7fe37809f240 2023-10-03T10:14:35.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.760+0000 7fe36e7fc700 1 -- 172.21.15.72:0/2037853168 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe368013470 con 0x7fe37809f240 2023-10-03T10:14:35.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.760+0000 7fe36e7fc700 1 -- 172.21.15.72:0/2037853168 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe36803fc00 con 0x7fe37809f240 2023-10-03T10:14:35.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.760+0000 7fe37fec8700 1 -- 172.21.15.72:0/2037853168 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3781a0b30 con 0x7fe37809f240 2023-10-03T10:14:35.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.765+0000 7fe36e7fc700 1 -- 172.21.15.72:0/2037853168 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe36801b3b0 con 0x7fe37809f240 2023-10-03T10:14:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.830+0000 7fb464999700 1 Processor -- start 2023-10-03T10:14:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.830+0000 7fb464999700 1 -- start start 2023-10-03T10:14:35.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.831+0000 7fb464999700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46009e1d0 0x7fb460138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.831+0000 7fb464999700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb460139170 0x7fb46013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.831+0000 7fb464999700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46009b120 con 0x7fb46009d6f0 2023-10-03T10:14:35.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.831+0000 7fb464999700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46006b460 con 0x7fb460139170 2023-10-03T10:14:35.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.831+0000 7fb464999700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb46009a7e0 con 0x7fb46009e1d0 2023-10-03T10:14:35.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.831+0000 7fb45dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46009e1d0 0x7fb460138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.831+0000 7fb45ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb460139170 0x7fb46013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.831+0000 7fb45dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46009e1d0 0x7fb460138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39840/0 (socket says 172.21.15.72:39840) 2023-10-03T10:14:35.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.831+0000 7fb45dd9b700 1 -- 172.21.15.72:0/1510229908 learned_addr learned my addr 172.21.15.72:0/1510229908 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:35.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.831+0000 7fb45ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb460139170 0x7fb46013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46372/0 (socket says 172.21.15.72:46372) 2023-10-03T10:14:35.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.831+0000 7fb45e59c700 1 --1- 172.21.15.72:0/1510229908 >> v1:172.21.15.72:6789/0 conn(0x7fb46009d6f0 0x7fb46009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35412/0 (socket says 172.21.15.72:35412) 2023-10-03T10:14:35.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.831+0000 7fb45ed9d700 1 -- 172.21.15.72:0/1510229908 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46009e1d0 msgr2=0x7fb460138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.831+0000 7fb45ed9d700 1 --2- 172.21.15.72:0/1510229908 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46009e1d0 0x7fb460138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.831+0000 7fb45ed9d700 1 -- 172.21.15.72:0/1510229908 >> v1:172.21.15.72:6789/0 conn(0x7fb46009d6f0 legacy=0x7fb46009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.831+0000 7fb45ed9d700 1 -- 172.21.15.72:0/1510229908 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46009a500 con 0x7fb460139170 2023-10-03T10:14:35.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.832+0000 7fb45ed9d700 1 --2- 172.21.15.72:0/1510229908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb460139170 0x7fb46013b550 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb458009d90 tx=0x7fb45800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfdad9a232a48695 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.832+0000 7fb45d59a700 1 -- 172.21.15.72:0/1510229908 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45800e070 con 0x7fb460139170 2023-10-03T10:14:35.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.832+0000 7fb45d59a700 1 -- 172.21.15.72:0/1510229908 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45800bbd0 con 0x7fb460139170 2023-10-03T10:14:35.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.832+0000 7fb45d59a700 1 -- 172.21.15.72:0/1510229908 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb458012430 con 0x7fb460139170 2023-10-03T10:14:35.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.832+0000 7fb464999700 1 -- 172.21.15.72:0/1510229908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb460139170 msgr2=0x7fb46013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.832+0000 7fb464999700 1 --2- 172.21.15.72:0/1510229908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb460139170 0x7fb46013b550 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb458009d90 tx=0x7fb45800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:35.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.832+0000 7fb464999700 1 -- 172.21.15.72:0/1510229908 shutdown_connections 2023-10-03T10:14:35.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.832+0000 7fb464999700 1 --2- 172.21.15.72:0/1510229908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb460139170 0x7fb46013b550 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.832+0000 7fb464999700 1 --2- 172.21.15.72:0/1510229908 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46009e1d0 0x7fb460138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.832+0000 7fb464999700 1 -- 172.21.15.72:0/1510229908 >> 172.21.15.72:0/1510229908 conn(0x7fb460066f50 msgr2=0x7fb46009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.833+0000 7fb464999700 1 -- 172.21.15.72:0/1510229908 shutdown_connections 2023-10-03T10:14:35.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.833+0000 7fb464999700 1 -- 172.21.15.72:0/1510229908 wait complete. 2023-10-03T10:14:35.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.834+0000 7fb464999700 1 Processor -- start 2023-10-03T10:14:35.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.834+0000 7fb464999700 1 -- start start 2023-10-03T10:14:35.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.834+0000 7fb464999700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb46009d6f0 0x7fb4601c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.834+0000 7fb464999700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46009e1d0 0x7fb4601c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.834+0000 7fb464999700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb460139170 0x7fb460121840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.834+0000 7fb464999700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb460125160 con 0x7fb46009d6f0 2023-10-03T10:14:35.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.834+0000 7fb464999700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb460123450 con 0x7fb46009e1d0 2023-10-03T10:14:35.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.834+0000 7fb464999700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb460137710 con 0x7fb460139170 2023-10-03T10:14:35.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.834+0000 7fb45dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46009e1d0 0x7fb4601c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.834+0000 7fb45dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46009e1d0 0x7fb4601c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40370/0 (socket says 172.21.15.72:40370) 2023-10-03T10:14:35.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.834+0000 7fb45dd9b700 1 -- 172.21.15.72:0/3186120906 learned_addr learned my addr 172.21.15.72:0/3186120906 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:35.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.834+0000 7fb45ed9d700 1 --2- 172.21.15.72:0/3186120906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb460139170 0x7fb460121840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.834+0000 7fb45e59c700 1 --2- 172.21.15.72:0/3186120906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb46009d6f0 0x7fb4601c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.835+0000 7fb45dd9b700 1 -- 172.21.15.72:0/3186120906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb460139170 msgr2=0x7fb460121840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.835+0000 7fb45dd9b700 1 --2- 172.21.15.72:0/3186120906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb460139170 0x7fb460121840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.835+0000 7fb45dd9b700 1 -- 172.21.15.72:0/3186120906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb46009d6f0 msgr2=0x7fb4601c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.835+0000 7fb45dd9b700 1 --2- 172.21.15.72:0/3186120906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb46009d6f0 0x7fb4601c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.835+0000 7fb45dd9b700 1 -- 172.21.15.72:0/3186120906 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb458009a70 con 0x7fb46009e1d0 2023-10-03T10:14:35.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.835+0000 7fb45dd9b700 1 --2- 172.21.15.72:0/3186120906 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46009e1d0 0x7fb4601c8bb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb45400e7e0 tx=0x7fb45400eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.835+0000 7fb44effd700 1 -- 172.21.15.72:0/3186120906 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400c070 con 0x7fb46009e1d0 2023-10-03T10:14:35.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.835+0000 7fb44effd700 1 -- 172.21.15.72:0/3186120906 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb454013610 con 0x7fb46009e1d0 2023-10-03T10:14:35.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.835+0000 7fb464999700 1 -- 172.21.15.72:0/3186120906 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4600a3ad0 con 0x7fb46009e1d0 2023-10-03T10:14:35.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.835+0000 7fb44effd700 1 -- 172.21.15.72:0/3186120906 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4540139c0 con 0x7fb46009e1d0 2023-10-03T10:14:35.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.835+0000 7fb464999700 1 -- 172.21.15.72:0/3186120906 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4601c90f0 con 0x7fb46009e1d0 2023-10-03T10:14:35.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.836+0000 7fb44effd700 1 -- 172.21.15.72:0/3186120906 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb454013b20 con 0x7fb46009e1d0 2023-10-03T10:14:35.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.836+0000 7fb44effd700 1 -- 172.21.15.72:0/3186120906 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb45403f3e0 con 0x7fb46009e1d0 2023-10-03T10:14:35.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.836+0000 7fb464999700 1 -- 172.21.15.72:0/3186120906 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb460074ea0 con 0x7fb46009e1d0 2023-10-03T10:14:35.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.841+0000 7fb44effd700 1 -- 172.21.15.72:0/3186120906 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb45400f040 con 0x7fb46009e1d0 2023-10-03T10:14:35.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.879+0000 7f6fceb44700 1 Processor -- start 2023-10-03T10:14:35.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.879+0000 7f6fceb44700 1 -- start start 2023-10-03T10:14:35.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.880+0000 7f6fceb44700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6fc809d9f0 0x7f6fc8136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.880+0000 7f6fceb44700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fc8136a70 0x7f6fc8138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.880+0000 7f6fceb44700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc809e130 con 0x7f6fc81316c0 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.880+0000 7f6fceb44700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc81321a0 con 0x7f6fc809d9f0 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.880+0000 7f6fceb44700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc81312b0 con 0x7f6fc8136a70 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.880+0000 7f6fc7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6fc809d9f0 0x7f6fc8136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.880+0000 7f6fcd0e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fc8136a70 0x7f6fc8138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.880+0000 7f6fc7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6fc809d9f0 0x7f6fc8136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46398/0 (socket says 172.21.15.72:46398) 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.880+0000 7f6fc7fff700 1 -- 172.21.15.72:0/632962915 learned_addr learned my addr 172.21.15.72:0/632962915 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.881+0000 7f6fcd0e1700 1 -- 172.21.15.72:0/632962915 >> v2:172.21.15.72:3300/0 conn(0x7f6fc809d9f0 msgr2=0x7f6fc8136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.881+0000 7f6fcd0e1700 1 --2- 172.21.15.72:0/632962915 >> v2:172.21.15.72:3300/0 conn(0x7f6fc809d9f0 0x7f6fc8136530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.881+0000 7f6fcd0e1700 1 -- 172.21.15.72:0/632962915 >> v1:172.21.15.72:6789/0 conn(0x7f6fc81316c0 legacy=0x7f6fc8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.881+0000 7f6fcd0e1700 1 -- 172.21.15.72:0/632962915 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc809f6e0 con 0x7f6fc8136a70 2023-10-03T10:14:35.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.881+0000 7f6fcd0e1700 1 --2- 172.21.15.72:0/632962915 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fc8136a70 0x7f6fc8138e50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009dc0 tx=0x7f6fc000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=238049f368ed60f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.881+0000 7f6fc77fe700 1 -- 172.21.15.72:0/632962915 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000e070 con 0x7f6fc8136a70 2023-10-03T10:14:35.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.881+0000 7f6fc77fe700 1 -- 172.21.15.72:0/632962915 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc000bae0 con 0x7f6fc8136a70 2023-10-03T10:14:35.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.881+0000 7f6fc77fe700 1 -- 172.21.15.72:0/632962915 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc000be90 con 0x7f6fc8136a70 2023-10-03T10:14:35.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.882+0000 7f6fceb44700 1 -- 172.21.15.72:0/632962915 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fc8136a70 msgr2=0x7f6fc8138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.882+0000 7f6fceb44700 1 --2- 172.21.15.72:0/632962915 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fc8136a70 0x7f6fc8138e50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009dc0 tx=0x7f6fc000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.882+0000 7f6fceb44700 1 -- 172.21.15.72:0/632962915 shutdown_connections 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.882+0000 7f6fceb44700 1 --2- 172.21.15.72:0/632962915 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fc8136a70 0x7f6fc8138e50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.882+0000 7f6fceb44700 1 --2- 172.21.15.72:0/632962915 >> v2:172.21.15.72:3300/0 conn(0x7f6fc809d9f0 0x7f6fc8136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.882+0000 7f6fceb44700 1 -- 172.21.15.72:0/632962915 >> 172.21.15.72:0/632962915 conn(0x7f6fc8066f50 msgr2=0x7f6fc809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.882+0000 7f6fceb44700 1 -- 172.21.15.72:0/632962915 shutdown_connections 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.882+0000 7f6fceb44700 1 -- 172.21.15.72:0/632962915 wait complete. 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.883+0000 7f6fceb44700 1 Processor -- start 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.883+0000 7f6fceb44700 1 -- start start 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fceb44700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6fc809d9f0 0x7f6fc81c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fceb44700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fc81316c0 0x7f6fc81c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fceb44700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fc8136a70 0x7f6fc81c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fceb44700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc8070570 con 0x7f6fc81316c0 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fceb44700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc8136160 con 0x7f6fc8136a70 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fceb44700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc8136550 con 0x7f6fc809d9f0 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fc7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fc81316c0 0x7f6fc81c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fcc8e0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6fc809d9f0 0x7f6fc81c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fcd0e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fc8136a70 0x7f6fc81c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fc7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fc81316c0 0x7f6fc81c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46408/0 (socket says 172.21.15.72:46408) 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fc7fff700 1 -- 172.21.15.72:0/1701774492 learned_addr learned my addr 172.21.15.72:0/1701774492 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fcd0e1700 1 -- 172.21.15.72:0/1701774492 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6fc809d9f0 msgr2=0x7f6fc81c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fcd0e1700 1 --2- 172.21.15.72:0/1701774492 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6fc809d9f0 0x7f6fc81c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fcd0e1700 1 -- 172.21.15.72:0/1701774492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fc81316c0 msgr2=0x7f6fc81c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fcd0e1700 1 --2- 172.21.15.72:0/1701774492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fc81316c0 0x7f6fc81c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fcd0e1700 1 -- 172.21.15.72:0/1701774492 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc0009a70 con 0x7f6fc8136a70 2023-10-03T10:14:35.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fc7fff700 1 --2- 172.21.15.72:0/1701774492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fc81316c0 0x7f6fc81c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:35.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fcc8e0700 1 --2- 172.21.15.72:0/1701774492 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6fc809d9f0 0x7f6fc81c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:35.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.884+0000 7f6fcd0e1700 1 --2- 172.21.15.72:0/1701774492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fc8136a70 0x7f6fc81c6d70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0016000 tx=0x7f6fc0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.885+0000 7f6fc57fa700 1 -- 172.21.15.72:0/1701774492 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc00045d0 con 0x7f6fc8136a70 2023-10-03T10:14:35.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.885+0000 7f6fc57fa700 1 -- 172.21.15.72:0/1701774492 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc0020070 con 0x7f6fc8136a70 2023-10-03T10:14:35.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.885+0000 7f6fceb44700 1 -- 172.21.15.72:0/1701774492 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc812b900 con 0x7f6fc8136a70 2023-10-03T10:14:35.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.885+0000 7f6fc57fa700 1 -- 172.21.15.72:0/1701774492 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0027480 con 0x7f6fc8136a70 2023-10-03T10:14:35.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.885+0000 7f6fceb44700 1 -- 172.21.15.72:0/1701774492 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc8070c70 con 0x7f6fc8136a70 2023-10-03T10:14:35.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.886+0000 7f6fceb44700 1 -- 172.21.15.72:0/1701774492 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc8074ea0 con 0x7f6fc8136a70 2023-10-03T10:14:35.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.886+0000 7f6fc57fa700 1 -- 172.21.15.72:0/1701774492 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fc0012430 con 0x7f6fc8136a70 2023-10-03T10:14:35.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.886+0000 7f6fc57fa700 1 -- 172.21.15.72:0/1701774492 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6fc0022070 con 0x7f6fc8136a70 2023-10-03T10:14:35.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.890+0000 7f6fc57fa700 1 -- 172.21.15.72:0/1701774492 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fc0011750 con 0x7f6fc8136a70 2023-10-03T10:14:35.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.962+0000 7fe37fec8700 1 -- 172.21.15.72:0/2037853168 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe3780a3570 con 0x7fe37809f240 2023-10-03T10:14:35.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.962+0000 7fe36e7fc700 1 -- 172.21.15.72:0/2037853168 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe368021030 con 0x7fe37809f240 2023-10-03T10:14:35.963 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:35.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.964+0000 7fe37fec8700 1 -- 172.21.15.72:0/2037853168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe37809f240 msgr2=0x7fe37806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.964+0000 7fe37fec8700 1 --2- 172.21.15.72:0/2037853168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe37809f240 0x7fe37806bdf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe36800ebe0 tx=0x7fe36800eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.964+0000 7fe37fec8700 1 -- 172.21.15.72:0/2037853168 shutdown_connections 2023-10-03T10:14:35.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.964+0000 7fe37fec8700 1 --2- 172.21.15.72:0/2037853168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe37809f650 0x7fe37806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.964+0000 7fe37fec8700 1 --2- 172.21.15.72:0/2037853168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe37809e930 0x7fe37806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.964+0000 7fe37fec8700 1 --2- 172.21.15.72:0/2037853168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe37809f240 0x7fe37806bdf0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.964+0000 7fe37fec8700 1 -- 172.21.15.72:0/2037853168 >> 172.21.15.72:0/2037853168 conn(0x7fe3780a4210 msgr2=0x7fe3781b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.964+0000 7fe37fec8700 1 -- 172.21.15.72:0/2037853168 shutdown_connections 2023-10-03T10:14:35.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:35.964+0000 7fe37fec8700 1 -- 172.21.15.72:0/2037853168 wait complete. 2023-10-03T10:14:35.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:36.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.037+0000 7fb464999700 1 -- 172.21.15.72:0/3186120906 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb46006c360 con 0x7fb46009e1d0 2023-10-03T10:14:36.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.038+0000 7fb44effd700 1 -- 172.21.15.72:0/3186120906 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb45402b090 con 0x7fb46009e1d0 2023-10-03T10:14:36.038 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:36.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.039+0000 7fb464999700 1 -- 172.21.15.72:0/3186120906 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46009e1d0 msgr2=0x7fb4601c8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.039+0000 7fb464999700 1 --2- 172.21.15.72:0/3186120906 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46009e1d0 0x7fb4601c8bb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb45400e7e0 tx=0x7fb45400eaf0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.040+0000 7fb464999700 1 -- 172.21.15.72:0/3186120906 shutdown_connections 2023-10-03T10:14:36.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.040+0000 7fb464999700 1 --2- 172.21.15.72:0/3186120906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb46009d6f0 0x7fb4601c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.040+0000 7fb464999700 1 --2- 172.21.15.72:0/3186120906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb460139170 0x7fb460121840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.040+0000 7fb464999700 1 --2- 172.21.15.72:0/3186120906 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46009e1d0 0x7fb4601c8bb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.040+0000 7fb464999700 1 -- 172.21.15.72:0/3186120906 >> 172.21.15.72:0/3186120906 conn(0x7fb460066f50 msgr2=0x7fb4600a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.040+0000 7fb464999700 1 -- 172.21.15.72:0/3186120906 shutdown_connections 2023-10-03T10:14:36.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.040+0000 7fb464999700 1 -- 172.21.15.72:0/3186120906 wait complete. 2023-10-03T10:14:36.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:36.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.092+0000 7f6fceb44700 1 -- 172.21.15.72:0/1701774492 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6fc81358a0 con 0x7f6fc8136a70 2023-10-03T10:14:36.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.093+0000 7f6fc57fa700 1 -- 172.21.15.72:0/1701774492 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6fc81358a0 con 0x7f6fc8136a70 2023-10-03T10:14:36.093 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:36.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.094+0000 7f6fceb44700 1 -- 172.21.15.72:0/1701774492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fc8136a70 msgr2=0x7f6fc81c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.094+0000 7f6fceb44700 1 --2- 172.21.15.72:0/1701774492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fc8136a70 0x7f6fc81c6d70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0016000 tx=0x7f6fc0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.095+0000 7f6fceb44700 1 -- 172.21.15.72:0/1701774492 shutdown_connections 2023-10-03T10:14:36.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.095+0000 7f6fceb44700 1 --2- 172.21.15.72:0/1701774492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6fc8136a70 0x7f6fc81c6d70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.095+0000 7f6fceb44700 1 --2- 172.21.15.72:0/1701774492 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6fc809d9f0 0x7f6fc81c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.095+0000 7f6fceb44700 1 --2- 172.21.15.72:0/1701774492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fc81316c0 0x7f6fc81c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.095+0000 7f6fceb44700 1 -- 172.21.15.72:0/1701774492 >> 172.21.15.72:0/1701774492 conn(0x7f6fc8066f50 msgr2=0x7f6fc80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.095+0000 7f6fceb44700 1 -- 172.21.15.72:0/1701774492 shutdown_connections 2023-10-03T10:14:36.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.095+0000 7f6fceb44700 1 -- 172.21.15.72:0/1701774492 wait complete. 2023-10-03T10:14:36.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:36.611 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:36.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.738+0000 7efefce21700 1 Processor -- start 2023-10-03T10:14:36.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.738+0000 7efefce21700 1 -- start start 2023-10-03T10:14:36.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efefce21700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efef809d6f0 0x7efef809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efefce21700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efef809e000 0x7efef81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efefce21700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef809b120 con 0x7efef809e410 2023-10-03T10:14:36.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efefce21700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef806b460 con 0x7efef809d6f0 2023-10-03T10:14:36.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efefce21700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efef809a7e0 con 0x7efef809e000 2023-10-03T10:14:36.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efef659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efef809d6f0 0x7efef809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efef5d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efef809e000 0x7efef81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efef5d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efef809e000 0x7efef81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39866/0 (socket says 172.21.15.72:39866) 2023-10-03T10:14:36.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efef659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efef809d6f0 0x7efef809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46414/0 (socket says 172.21.15.72:46414) 2023-10-03T10:14:36.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efef5d9b700 1 -- 172.21.15.72:0/3590158979 learned_addr learned my addr 172.21.15.72:0/3590158979 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:36.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efef659c700 1 -- 172.21.15.72:0/3590158979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efef809e000 msgr2=0x7efef81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:36.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efef659c700 1 --2- 172.21.15.72:0/3590158979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efef809e000 0x7efef81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efef659c700 1 -- 172.21.15.72:0/3590158979 >> v1:172.21.15.72:6789/0 conn(0x7efef809e410 legacy=0x7efef8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efef659c700 1 -- 172.21.15.72:0/3590158979 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef809a500 con 0x7efef809d6f0 2023-10-03T10:14:36.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efef559a700 1 -- 172.21.15.72:0/3590158979 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392043166 0 0) 0x7efef809b120 con 0x7efef809e410 2023-10-03T10:14:36.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efef5d9b700 1 --2- 172.21.15.72:0/3590158979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efef809e000 0x7efef81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:36.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efef659c700 1 --2- 172.21.15.72:0/3590158979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efef809d6f0 0x7efef809dac0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7efeec009840 tx=0x7efeec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d70e2c6c6aec8f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.739+0000 7efef559a700 1 -- 172.21.15.72:0/3590158979 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec011830 con 0x7efef809d6f0 2023-10-03T10:14:36.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.740+0000 7efef559a700 1 -- 172.21.15.72:0/3590158979 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec011990 con 0x7efef809d6f0 2023-10-03T10:14:36.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.740+0000 7efef559a700 1 -- 172.21.15.72:0/3590158979 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec011d20 con 0x7efef809d6f0 2023-10-03T10:14:36.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.740+0000 7efefce21700 1 -- 172.21.15.72:0/3590158979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efef809d6f0 msgr2=0x7efef809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.740+0000 7efefce21700 1 --2- 172.21.15.72:0/3590158979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efef809d6f0 0x7efef809dac0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7efeec009840 tx=0x7efeec009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:36.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.740+0000 7efefce21700 1 -- 172.21.15.72:0/3590158979 shutdown_connections 2023-10-03T10:14:36.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.740+0000 7efefce21700 1 --2- 172.21.15.72:0/3590158979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efef809d6f0 0x7efef809dac0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.740+0000 7efefce21700 1 --2- 172.21.15.72:0/3590158979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efef809e000 0x7efef81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.740+0000 7efefce21700 1 -- 172.21.15.72:0/3590158979 >> 172.21.15.72:0/3590158979 conn(0x7efef8066f50 msgr2=0x7efef809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.740+0000 7efefce21700 1 -- 172.21.15.72:0/3590158979 shutdown_connections 2023-10-03T10:14:36.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.740+0000 7efefce21700 1 -- 172.21.15.72:0/3590158979 wait complete. 2023-10-03T10:14:36.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.741+0000 7efefce21700 1 Processor -- start 2023-10-03T10:14:36.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.741+0000 7efefce21700 1 -- start start 2023-10-03T10:14:36.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efefce21700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efef809d6f0 0x7efef81c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efefce21700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efef809e000 0x7efef81c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efefce21700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efef809e410 0x7efef81c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efefce21700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef81a7680 con 0x7efef809e410 2023-10-03T10:14:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efefce21700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef809c710 con 0x7efef809d6f0 2023-10-03T10:14:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efefce21700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efef80a2ec0 con 0x7efef809e000 2023-10-03T10:14:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efef659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efef809d6f0 0x7efef81c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efef5d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efef809e000 0x7efef81c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efef6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efef809e410 0x7efef81c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efef5d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efef809e000 0x7efef81c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39880/0 (socket says 172.21.15.72:39880) 2023-10-03T10:14:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efef659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efef809d6f0 0x7efef81c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40398/0 (socket says 172.21.15.72:40398) 2023-10-03T10:14:36.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efef5d9b700 1 -- 172.21.15.72:0/1700529096 learned_addr learned my addr 172.21.15.72:0/1700529096 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:36.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efef6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efef809e410 0x7efef81c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46416/0 (socket says 172.21.15.72:46416) 2023-10-03T10:14:36.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efef6d9d700 1 -- 172.21.15.72:0/1700529096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efef809e000 msgr2=0x7efef81c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efef6d9d700 1 --2- 172.21.15.72:0/1700529096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efef809e000 0x7efef81c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efef6d9d700 1 -- 172.21.15.72:0/1700529096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efef809d6f0 msgr2=0x7efef81c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efef6d9d700 1 --2- 172.21.15.72:0/1700529096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efef809d6f0 0x7efef81c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efef6d9d700 1 -- 172.21.15.72:0/1700529096 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee8009550 con 0x7efef809e410 2023-10-03T10:14:36.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efef5d9b700 1 --2- 172.21.15.72:0/1700529096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efef809e000 0x7efef81c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:36.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efef6d9d700 1 --2- 172.21.15.72:0/1700529096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efef809e410 0x7efef81c8c40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efef000c7c0 tx=0x7efef000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efee6ffd700 1 -- 172.21.15.72:0/1700529096 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef0003e30 con 0x7efef809e410 2023-10-03T10:14:36.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efee6ffd700 1 -- 172.21.15.72:0/1700529096 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef0005070 con 0x7efef809e410 2023-10-03T10:14:36.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efefce21700 1 -- 172.21.15.72:0/1700529096 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeec0094a0 con 0x7efef809e410 2023-10-03T10:14:36.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efee6ffd700 1 -- 172.21.15.72:0/1700529096 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef0005420 con 0x7efef809e410 2023-10-03T10:14:36.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.742+0000 7efefce21700 1 -- 172.21.15.72:0/1700529096 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef81a6720 con 0x7efef809e410 2023-10-03T10:14:36.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.743+0000 7efee6ffd700 1 -- 172.21.15.72:0/1700529096 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efef0005580 con 0x7efef809e410 2023-10-03T10:14:36.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.743+0000 7efee6ffd700 1 -- 172.21.15.72:0/1700529096 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efef003ec80 con 0x7efef809e410 2023-10-03T10:14:36.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.743+0000 7efefce21700 1 -- 172.21.15.72:0/1700529096 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef804ea50 con 0x7efef809e410 2023-10-03T10:14:36.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.748+0000 7efee6ffd700 1 -- 172.21.15.72:0/1700529096 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efef0010d60 con 0x7efef809e410 2023-10-03T10:14:36.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.930+0000 7efefce21700 1 -- 172.21.15.72:0/1700529096 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efef81a81e0 con 0x7efef809e410 2023-10-03T10:14:36.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.930+0000 7efee6ffd700 1 -- 172.21.15.72:0/1700529096 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efef81a81e0 con 0x7efef809e410 2023-10-03T10:14:36.931 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:36.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.932+0000 7efefce21700 1 -- 172.21.15.72:0/1700529096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efef809e410 msgr2=0x7efef81c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.932+0000 7efefce21700 1 --2- 172.21.15.72:0/1700529096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efef809e410 0x7efef81c8c40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efef000c7c0 tx=0x7efef000cad0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.932+0000 7efefce21700 1 -- 172.21.15.72:0/1700529096 shutdown_connections 2023-10-03T10:14:36.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.932+0000 7efefce21700 1 --2- 172.21.15.72:0/1700529096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efef809e410 0x7efef81c8c40 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.932+0000 7efefce21700 1 --2- 172.21.15.72:0/1700529096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efef809d6f0 0x7efef81c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.932+0000 7efefce21700 1 --2- 172.21.15.72:0/1700529096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efef809e000 0x7efef81c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.932+0000 7efefce21700 1 -- 172.21.15.72:0/1700529096 >> 172.21.15.72:0/1700529096 conn(0x7efef8066f50 msgr2=0x7efef81bba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.932+0000 7efefce21700 1 -- 172.21.15.72:0/1700529096 shutdown_connections 2023-10-03T10:14:36.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:36.932+0000 7efefce21700 1 -- 172.21.15.72:0/1700529096 wait complete. 2023-10-03T10:14:36.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:36.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:37.058 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:37.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.101+0000 7fc662555700 1 Processor -- start 2023-10-03T10:14:37.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.101+0000 7fc662555700 1 -- start start 2023-10-03T10:14:37.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.101+0000 7fc662555700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc65c09d6f0 0x7fc65c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.101+0000 7fc662555700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc65c09e000 0x7fc65c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.101+0000 7fc662555700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc65c09e410 0x7fc65c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.101+0000 7fc662555700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65c06b460 con 0x7fc65c09e000 2023-10-03T10:14:37.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.101+0000 7fc662555700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c09b120 con 0x7fc65c09d6f0 2023-10-03T10:14:37.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.101+0000 7fc662555700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c09a7e0 con 0x7fc65c09e410 2023-10-03T10:14:37.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.101+0000 7fc65b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc65c09e000 0x7fc65c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.101+0000 7fc65bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc65c09d6f0 0x7fc65c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.101+0000 7fc65bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc65c09d6f0 0x7fc65c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40414/0 (socket says 172.21.15.72:40414) 2023-10-03T10:14:37.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.101+0000 7fc65b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc65c09e000 0x7fc65c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46426/0 (socket says 172.21.15.72:46426) 2023-10-03T10:14:37.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.101+0000 7fc65bfff700 1 -- 172.21.15.72:0/638488157 learned_addr learned my addr 172.21.15.72:0/638488157 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:37.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.101+0000 7fc660af2700 1 --2- 172.21.15.72:0/638488157 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc65c09e410 0x7fc65c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.102+0000 7fc65b7fe700 1 -- 172.21.15.72:0/638488157 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc65c09e410 msgr2=0x7fc65c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.102+0000 7fc65b7fe700 1 --2- 172.21.15.72:0/638488157 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc65c09e410 0x7fc65c133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.102+0000 7fc65b7fe700 1 -- 172.21.15.72:0/638488157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc65c09d6f0 msgr2=0x7fc65c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.102+0000 7fc65b7fe700 1 --2- 172.21.15.72:0/638488157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc65c09d6f0 0x7fc65c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.102+0000 7fc65b7fe700 1 -- 172.21.15.72:0/638488157 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c09a500 con 0x7fc65c09e000 2023-10-03T10:14:37.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.102+0000 7fc65bfff700 1 --2- 172.21.15.72:0/638488157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc65c09d6f0 0x7fc65c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.102+0000 7fc65b7fe700 1 --2- 172.21.15.72:0/638488157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc65c09e000 0x7fc65c1339f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc650009840 tx=0x7fc650009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3e1a26a556fbf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.102+0000 7fc65affd700 1 -- 172.21.15.72:0/638488157 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650011830 con 0x7fc65c09e000 2023-10-03T10:14:37.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.102+0000 7fc65affd700 1 -- 172.21.15.72:0/638488157 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc650011990 con 0x7fc65c09e000 2023-10-03T10:14:37.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.102+0000 7fc65affd700 1 -- 172.21.15.72:0/638488157 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650011d20 con 0x7fc65c09e000 2023-10-03T10:14:37.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.102+0000 7fc662555700 1 -- 172.21.15.72:0/638488157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc65c09e000 msgr2=0x7fc65c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.102+0000 7fc662555700 1 --2- 172.21.15.72:0/638488157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc65c09e000 0x7fc65c1339f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc650009840 tx=0x7fc650009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:37.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.102+0000 7fc662555700 1 -- 172.21.15.72:0/638488157 shutdown_connections 2023-10-03T10:14:37.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.102+0000 7fc662555700 1 --2- 172.21.15.72:0/638488157 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc65c09e410 0x7fc65c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.102+0000 7fc662555700 1 --2- 172.21.15.72:0/638488157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc65c09d6f0 0x7fc65c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.103+0000 7fc662555700 1 --2- 172.21.15.72:0/638488157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc65c09e000 0x7fc65c1339f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.103+0000 7fc662555700 1 -- 172.21.15.72:0/638488157 >> 172.21.15.72:0/638488157 conn(0x7fc65c066f50 msgr2=0x7fc65c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.103+0000 7fc662555700 1 -- 172.21.15.72:0/638488157 shutdown_connections 2023-10-03T10:14:37.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.103+0000 7fc662555700 1 -- 172.21.15.72:0/638488157 wait complete. 2023-10-03T10:14:37.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.104+0000 7fc662555700 1 Processor -- start 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.104+0000 7fc662555700 1 -- start start 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc662555700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc65c09d6f0 0x7fc65c1a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc662555700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc65c09e000 0x7fc65c1a6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc662555700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc65c09e410 0x7fc65c1a6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc662555700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c1a9cf0 con 0x7fc65c09e000 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc662555700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0a1fe0 con 0x7fc65c09e410 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc662555700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c09c710 con 0x7fc65c09d6f0 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc65bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc65c09d6f0 0x7fc65c1a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc660af2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc65c09e410 0x7fc65c1a6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc65b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc65c09e000 0x7fc65c1a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc65bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc65c09d6f0 0x7fc65c1a61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39890/0 (socket says 172.21.15.72:39890) 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc65bfff700 1 -- 172.21.15.72:0/1786905338 learned_addr learned my addr 172.21.15.72:0/1786905338 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc660af2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc65c09e410 0x7fc65c1a6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40420/0 (socket says 172.21.15.72:40420) 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc65b7fe700 1 -- 172.21.15.72:0/1786905338 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc65c09d6f0 msgr2=0x7fc65c1a61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc65b7fe700 1 --2- 172.21.15.72:0/1786905338 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc65c09d6f0 0x7fc65c1a61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc65b7fe700 1 -- 172.21.15.72:0/1786905338 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc65c09e410 msgr2=0x7fc65c1a6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc65b7fe700 1 --2- 172.21.15.72:0/1786905338 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc65c09e410 0x7fc65c1a6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc65b7fe700 1 -- 172.21.15.72:0/1786905338 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c009550 con 0x7fc65c09e000 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc65bfff700 1 --2- 172.21.15.72:0/1786905338 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc65c09d6f0 0x7fc65c1a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc65b7fe700 1 --2- 172.21.15.72:0/1786905338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc65c09e000 0x7fc65c1a6710 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc65c06e510 tx=0x7fc650004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.105+0000 7fc658ff9700 1 -- 172.21.15.72:0/1786905338 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650004450 con 0x7fc65c09e000 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.106+0000 7fc658ff9700 1 -- 172.21.15.72:0/1786905338 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65001f070 con 0x7fc65c09e000 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.106+0000 7fc662555700 1 -- 172.21.15.72:0/1786905338 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6500094a0 con 0x7fc65c09e000 2023-10-03T10:14:37.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.106+0000 7fc658ff9700 1 -- 172.21.15.72:0/1786905338 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6500038c0 con 0x7fc65c09e000 2023-10-03T10:14:37.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.106+0000 7fc662555700 1 -- 172.21.15.72:0/1786905338 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c1a9480 con 0x7fc65c09e000 2023-10-03T10:14:37.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.106+0000 7fc658ff9700 1 -- 172.21.15.72:0/1786905338 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc650003a20 con 0x7fc65c09e000 2023-10-03T10:14:37.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.106+0000 7fc658ff9700 1 -- 172.21.15.72:0/1786905338 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc650021070 con 0x7fc65c09e000 2023-10-03T10:14:37.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.107+0000 7fc662555700 1 -- 172.21.15.72:0/1786905338 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65c1a83f0 con 0x7fc65c09e000 2023-10-03T10:14:37.111 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:37.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.111+0000 7fc658ff9700 1 -- 172.21.15.72:0/1786905338 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc65c1a83f0 con 0x7fc65c09e000 2023-10-03T10:14:37.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.192+0000 7f8ec6be7700 1 Processor -- start 2023-10-03T10:14:37.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.192+0000 7f8ec6be7700 1 -- start start 2023-10-03T10:14:37.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.192+0000 7f8ec6be7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ec009d6f0 0x7f8ec009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ec6be7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec009e000 0x7f8ec0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ec6be7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec009e410 0x7f8ec0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ec6be7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec009f520 con 0x7f8ec009d6f0 2023-10-03T10:14:37.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ec6be7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec009f130 con 0x7f8ec009e410 2023-10-03T10:14:37.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ec6be7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec009e930 con 0x7f8ec009e000 2023-10-03T10:14:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ebffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec009e000 0x7f8ec0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ec4983700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ec009d6f0 0x7f8ec009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ec5184700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec009e410 0x7f8ec0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ebffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec009e000 0x7f8ec0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39892/0 (socket says 172.21.15.72:39892) 2023-10-03T10:14:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ec4983700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ec009d6f0 0x7f8ec009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46450/0 (socket says 172.21.15.72:46450) 2023-10-03T10:14:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ebffff700 1 -- 172.21.15.72:0/2493295286 learned_addr learned my addr 172.21.15.72:0/2493295286 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ebffff700 1 -- 172.21.15.72:0/2493295286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec009e410 msgr2=0x7f8ec0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ebffff700 1 --2- 172.21.15.72:0/2493295286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec009e410 0x7f8ec0130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ebffff700 1 -- 172.21.15.72:0/2493295286 >> v2:172.21.15.72:3300/0 conn(0x7f8ec009d6f0 msgr2=0x7f8ec009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ebffff700 1 --2- 172.21.15.72:0/2493295286 >> v2:172.21.15.72:3300/0 conn(0x7f8ec009d6f0 0x7f8ec009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ebffff700 1 -- 172.21.15.72:0/2493295286 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec009b2d0 con 0x7f8ec009e000 2023-10-03T10:14:37.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ec4983700 1 --2- 172.21.15.72:0/2493295286 >> v2:172.21.15.72:3300/0 conn(0x7f8ec009d6f0 0x7f8ec009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ec5184700 1 --2- 172.21.15.72:0/2493295286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec009e410 0x7f8ec0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ebffff700 1 --2- 172.21.15.72:0/2493295286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec009e000 0x7f8ec0130660 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00bbc0 tx=0x7f8eac00bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d92b5da5f778733c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.193+0000 7f8ebf7fe700 1 -- 172.21.15.72:0/2493295286 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac00dcf0 con 0x7f8ec009e000 2023-10-03T10:14:37.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.194+0000 7f8ebf7fe700 1 -- 172.21.15.72:0/2493295286 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac00de50 con 0x7f8ec009e000 2023-10-03T10:14:37.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.194+0000 7f8ebf7fe700 1 -- 172.21.15.72:0/2493295286 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac010690 con 0x7f8ec009e000 2023-10-03T10:14:37.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.194+0000 7f8ec6be7700 1 -- 172.21.15.72:0/2493295286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec009e000 msgr2=0x7f8ec0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.194+0000 7f8ec6be7700 1 --2- 172.21.15.72:0/2493295286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec009e000 0x7f8ec0130660 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00bbc0 tx=0x7f8eac00bed0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.194+0000 7f8ec6be7700 1 -- 172.21.15.72:0/2493295286 shutdown_connections 2023-10-03T10:14:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.194+0000 7f8ec6be7700 1 --2- 172.21.15.72:0/2493295286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec009e410 0x7f8ec0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.194+0000 7f8ec6be7700 1 --2- 172.21.15.72:0/2493295286 >> v2:172.21.15.72:3300/0 conn(0x7f8ec009d6f0 0x7f8ec009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.194+0000 7f8ec6be7700 1 --2- 172.21.15.72:0/2493295286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec009e000 0x7f8ec0130660 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.194+0000 7f8ec6be7700 1 -- 172.21.15.72:0/2493295286 >> 172.21.15.72:0/2493295286 conn(0x7f8ec0066f50 msgr2=0x7f8ec009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.194+0000 7f8ec6be7700 1 -- 172.21.15.72:0/2493295286 shutdown_connections 2023-10-03T10:14:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.194+0000 7f8ec6be7700 1 -- 172.21.15.72:0/2493295286 wait complete. 2023-10-03T10:14:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.195+0000 7f8ec6be7700 1 Processor -- start 2023-10-03T10:14:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.195+0000 7f8ec6be7700 1 -- start start 2023-10-03T10:14:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.196+0000 7f8ec6be7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec009d6f0 0x7f8ec0122430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.196+0000 7f8ec6be7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec009e000 0x7f8ec0122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.196+0000 7f8ec6be7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec009e410 0x7f8ec0122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.196+0000 7f8ec6be7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0125f40 con 0x7f8ec009e000 2023-10-03T10:14:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.196+0000 7f8ec6be7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec00a1a40 con 0x7f8ec009d6f0 2023-10-03T10:14:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.196+0000 7f8ec6be7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0124030 con 0x7f8ec009e410 2023-10-03T10:14:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.196+0000 7f8ebffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec009e000 0x7f8ec0122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.196+0000 7f8ebffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec009e000 0x7f8ec0122970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46458/0 (socket says 172.21.15.72:46458) 2023-10-03T10:14:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.196+0000 7f8ebffff700 1 -- 172.21.15.72:0/750189701 learned_addr learned my addr 172.21.15.72:0/750189701 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.196+0000 7f8ec4983700 1 --2- 172.21.15.72:0/750189701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec009d6f0 0x7f8ec0122430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.196+0000 7f8ec5184700 1 --2- 172.21.15.72:0/750189701 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec009e410 0x7f8ec0122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.197+0000 7f8ebffff700 1 -- 172.21.15.72:0/750189701 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec009e410 msgr2=0x7f8ec0122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.197+0000 7f8ebffff700 1 --2- 172.21.15.72:0/750189701 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec009e410 0x7f8ec0122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.197+0000 7f8ebffff700 1 -- 172.21.15.72:0/750189701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec009d6f0 msgr2=0x7f8ec0122430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.197+0000 7f8ebffff700 1 --2- 172.21.15.72:0/750189701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec009d6f0 0x7f8ec0122430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.197+0000 7f8ebffff700 1 -- 172.21.15.72:0/750189701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb40094a0 con 0x7f8ec009e000 2023-10-03T10:14:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.197+0000 7f8ec4983700 1 --2- 172.21.15.72:0/750189701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec009d6f0 0x7f8ec0122430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.197+0000 7f8ebffff700 1 --2- 172.21.15.72:0/750189701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec009e000 0x7f8ec0122970 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8ec009ea70 tx=0x7f8eac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.197+0000 7f8ebd7fa700 1 -- 172.21.15.72:0/750189701 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac003ab0 con 0x7f8ec009e000 2023-10-03T10:14:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.197+0000 7f8ebd7fa700 1 -- 172.21.15.72:0/750189701 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac003c10 con 0x7f8ec009e000 2023-10-03T10:14:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.197+0000 7f8ec6be7700 1 -- 172.21.15.72:0/750189701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb8009a70 con 0x7f8ec009e000 2023-10-03T10:14:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.197+0000 7f8ebd7fa700 1 -- 172.21.15.72:0/750189701 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac010470 con 0x7f8ec009e000 2023-10-03T10:14:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.197+0000 7f8ec6be7700 1 -- 172.21.15.72:0/750189701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eac00b7f0 con 0x7f8ec009e000 2023-10-03T10:14:37.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.198+0000 7f8ebd7fa700 1 -- 172.21.15.72:0/750189701 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8eac019400 con 0x7f8ec009e000 2023-10-03T10:14:37.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.198+0000 7f8ebd7fa700 1 -- 172.21.15.72:0/750189701 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8eac040ba0 con 0x7f8ec009e000 2023-10-03T10:14:37.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.199+0000 7f8ec6be7700 1 -- 172.21.15.72:0/750189701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec0125ae0 con 0x7f8ec009e000 2023-10-03T10:14:37.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.207+0000 7f8ebd7fa700 1 -- 172.21.15.72:0/750189701 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ec0125ae0 con 0x7f8ec009e000 2023-10-03T10:14:37.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.246+0000 7f81a3e44700 1 Processor -- start 2023-10-03T10:14:37.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.246+0000 7f81a3e44700 1 -- start start 2023-10-03T10:14:37.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a3e44700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c09e7e0 0x7f819c09ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a3e44700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f819c09f0f0 0x7f819c137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a3e44700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c06bd70 con 0x7f819c137ff0 2023-10-03T10:14:37.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a3e44700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c06cc30 con 0x7f819c09f0f0 2023-10-03T10:14:37.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a3e44700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c06d870 con 0x7f819c09e7e0 2023-10-03T10:14:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a13df700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f819c09f0f0 0x7f819c137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a1be0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c09e7e0 0x7f819c09ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a13df700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f819c09f0f0 0x7f819c137ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46472/0 (socket says 172.21.15.72:46472) 2023-10-03T10:14:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a1be0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c09e7e0 0x7f819c09ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40452/0 (socket says 172.21.15.72:40452) 2023-10-03T10:14:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a23e1700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f819c137ff0 0x7f819c13a3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35444/0 (socket says 172.21.15.72:35444) 2023-10-03T10:14:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a13df700 1 -- 172.21.15.72:0/3986500609 learned_addr learned my addr 172.21.15.72:0/3986500609 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a0bde700 1 -- 172.21.15.72:0/3986500609 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623049601 0 0) 0x7f819c06bd70 con 0x7f819c137ff0 2023-10-03T10:14:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a0bde700 1 -- 172.21.15.72:0/3986500609 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81880035b0 con 0x7f819c137ff0 2023-10-03T10:14:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a1be0700 1 -- 172.21.15.72:0/3986500609 >> v2:172.21.15.72:3300/0 conn(0x7f819c09f0f0 msgr2=0x7f819c137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a1be0700 1 --2- 172.21.15.72:0/3986500609 >> v2:172.21.15.72:3300/0 conn(0x7f819c09f0f0 0x7f819c137ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a1be0700 1 -- 172.21.15.72:0/3986500609 >> v1:172.21.15.72:6789/0 conn(0x7f819c137ff0 legacy=0x7f819c13a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a1be0700 1 -- 172.21.15.72:0/3986500609 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c06bab0 con 0x7f819c09e7e0 2023-10-03T10:14:37.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a13df700 1 --2- 172.21.15.72:0/3986500609 >> v2:172.21.15.72:3300/0 conn(0x7f819c09f0f0 0x7f819c137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:37.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.247+0000 7f81a1be0700 1 --2- 172.21.15.72:0/3986500609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c09e7e0 0x7f819c09ebb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8198009840 tx=0x7f8198009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13a88b30edf2a4fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.248+0000 7f81a0bde700 1 -- 172.21.15.72:0/3986500609 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198011830 con 0x7f819c09e7e0 2023-10-03T10:14:37.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.248+0000 7f81a0bde700 1 -- 172.21.15.72:0/3986500609 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8198011990 con 0x7f819c09e7e0 2023-10-03T10:14:37.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.248+0000 7f81a0bde700 1 -- 172.21.15.72:0/3986500609 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198011d00 con 0x7f819c09e7e0 2023-10-03T10:14:37.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.248+0000 7f81a3e44700 1 -- 172.21.15.72:0/3986500609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c09e7e0 msgr2=0x7f819c09ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.248+0000 7f81a3e44700 1 --2- 172.21.15.72:0/3986500609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c09e7e0 0x7f819c09ebb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8198009840 tx=0x7f8198009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:37.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.248+0000 7f81a3e44700 1 -- 172.21.15.72:0/3986500609 shutdown_connections 2023-10-03T10:14:37.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.248+0000 7f81a3e44700 1 --2- 172.21.15.72:0/3986500609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c09e7e0 0x7f819c09ebb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.248+0000 7f81a3e44700 1 --2- 172.21.15.72:0/3986500609 >> v2:172.21.15.72:3300/0 conn(0x7f819c09f0f0 0x7f819c137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.248+0000 7f81a3e44700 1 -- 172.21.15.72:0/3986500609 >> 172.21.15.72:0/3986500609 conn(0x7f819c0a4300 msgr2=0x7f819c0a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.248+0000 7f81a3e44700 1 -- 172.21.15.72:0/3986500609 shutdown_connections 2023-10-03T10:14:37.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.248+0000 7f81a3e44700 1 -- 172.21.15.72:0/3986500609 wait complete. 2023-10-03T10:14:37.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.249+0000 7f81a3e44700 1 Processor -- start 2023-10-03T10:14:37.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.249+0000 7f81a3e44700 1 -- start start 2023-10-03T10:14:37.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a3e44700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c09e7e0 0x7f819c1219e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a3e44700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f819c09f0f0 0x7f819c121f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a3e44700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f819c137ff0 0x7f819c122460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a3e44700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c125190 con 0x7f819c137ff0 2023-10-03T10:14:37.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a3e44700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c0a3a60 con 0x7f819c09e7e0 2023-10-03T10:14:37.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a3e44700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f819c123600 con 0x7f819c09f0f0 2023-10-03T10:14:37.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a1be0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c09e7e0 0x7f819c1219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a1be0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c09e7e0 0x7f819c1219e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40466/0 (socket says 172.21.15.72:40466) 2023-10-03T10:14:37.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a1be0700 1 -- 172.21.15.72:0/154017288 learned_addr learned my addr 172.21.15.72:0/154017288 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:37.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a23e1700 1 --2- 172.21.15.72:0/154017288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f819c137ff0 0x7f819c122460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a1be0700 1 -- 172.21.15.72:0/154017288 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f819c09f0f0 msgr2=0x7f819c121f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a1be0700 1 --2- 172.21.15.72:0/154017288 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f819c09f0f0 0x7f819c121f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a1be0700 1 -- 172.21.15.72:0/154017288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f819c137ff0 msgr2=0x7f819c122460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a1be0700 1 --2- 172.21.15.72:0/154017288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f819c137ff0 0x7f819c122460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a1be0700 1 -- 172.21.15.72:0/154017288 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c009550 con 0x7f819c09e7e0 2023-10-03T10:14:37.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a1be0700 1 --2- 172.21.15.72:0/154017288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c09e7e0 0x7f819c1219e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f81980090b0 tx=0x7f8198004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81927fc700 1 -- 172.21.15.72:0/154017288 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198004340 con 0x7f819c09e7e0 2023-10-03T10:14:37.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81927fc700 1 -- 172.21.15.72:0/154017288 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819801f070 con 0x7f819c09e7e0 2023-10-03T10:14:37.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a3e44700 1 -- 172.21.15.72:0/154017288 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81980094a0 con 0x7f819c09e7e0 2023-10-03T10:14:37.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81927fc700 1 -- 172.21.15.72:0/154017288 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980036a0 con 0x7f819c09e7e0 2023-10-03T10:14:37.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.250+0000 7f81a3e44700 1 -- 172.21.15.72:0/154017288 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c123ac0 con 0x7f819c09e7e0 2023-10-03T10:14:37.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.251+0000 7f81a3e44700 1 -- 172.21.15.72:0/154017288 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819c04f2a0 con 0x7f819c09e7e0 2023-10-03T10:14:37.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.252+0000 7f81927fc700 1 -- 172.21.15.72:0/154017288 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8198021030 con 0x7f819c09e7e0 2023-10-03T10:14:37.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.252+0000 7f81927fc700 1 -- 172.21.15.72:0/154017288 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8198040e60 con 0x7f819c09e7e0 2023-10-03T10:14:37.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.260+0000 7f81927fc700 1 -- 172.21.15.72:0/154017288 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81980239c0 con 0x7f819c09e7e0 2023-10-03T10:14:37.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.307+0000 7fc662555700 1 -- 172.21.15.72:0/1786905338 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc65c1a83f0 con 0x7fc65c09e000 2023-10-03T10:14:37.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.307+0000 7fc658ff9700 1 -- 172.21.15.72:0/1786905338 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc65c1a83f0 con 0x7fc65c09e000 2023-10-03T10:14:37.308 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:37.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.309+0000 7fc662555700 1 -- 172.21.15.72:0/1786905338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc65c09e000 msgr2=0x7fc65c1a6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.309+0000 7fc662555700 1 --2- 172.21.15.72:0/1786905338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc65c09e000 0x7fc65c1a6710 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc65c06e510 tx=0x7fc650004750 comp rx=0 tx=0).stop 2023-10-03T10:14:37.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.309+0000 7fc662555700 1 -- 172.21.15.72:0/1786905338 shutdown_connections 2023-10-03T10:14:37.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.309+0000 7fc662555700 1 --2- 172.21.15.72:0/1786905338 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc65c09e410 0x7fc65c1a6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.309+0000 7fc662555700 1 --2- 172.21.15.72:0/1786905338 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc65c09d6f0 0x7fc65c1a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.309+0000 7fc662555700 1 --2- 172.21.15.72:0/1786905338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc65c09e000 0x7fc65c1a6710 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.309+0000 7fc662555700 1 -- 172.21.15.72:0/1786905338 >> 172.21.15.72:0/1786905338 conn(0x7fc65c066f50 msgr2=0x7fc65c1bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.309+0000 7fc662555700 1 -- 172.21.15.72:0/1786905338 shutdown_connections 2023-10-03T10:14:37.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.309+0000 7fc662555700 1 -- 172.21.15.72:0/1786905338 wait complete. 2023-10-03T10:14:37.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.406+0000 7f8ec6be7700 1 -- 172.21.15.72:0/750189701 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ec0125ae0 con 0x7f8ec009e000 2023-10-03T10:14:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.407+0000 7f8ebd7fa700 1 -- 172.21.15.72:0/750189701 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ec0125ae0 con 0x7f8ec009e000 2023-10-03T10:14:37.407 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:37.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.408+0000 7f8ec6be7700 1 -- 172.21.15.72:0/750189701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec009e000 msgr2=0x7f8ec0122970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.408+0000 7f8ec6be7700 1 --2- 172.21.15.72:0/750189701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec009e000 0x7f8ec0122970 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8ec009ea70 tx=0x7f8eac004750 comp rx=0 tx=0).stop 2023-10-03T10:14:37.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.409+0000 7f8ec6be7700 1 -- 172.21.15.72:0/750189701 shutdown_connections 2023-10-03T10:14:37.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.409+0000 7f8ec6be7700 1 --2- 172.21.15.72:0/750189701 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ec009e410 0x7f8ec0122eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.409+0000 7f8ec6be7700 1 --2- 172.21.15.72:0/750189701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ec009d6f0 0x7f8ec0122430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.409+0000 7f8ec6be7700 1 --2- 172.21.15.72:0/750189701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ec009e000 0x7f8ec0122970 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.409+0000 7f8ec6be7700 1 -- 172.21.15.72:0/750189701 >> 172.21.15.72:0/750189701 conn(0x7f8ec0066f50 msgr2=0x7f8ec006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.409+0000 7f8ec6be7700 1 -- 172.21.15.72:0/750189701 shutdown_connections 2023-10-03T10:14:37.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.409+0000 7f8ec6be7700 1 -- 172.21.15.72:0/750189701 wait complete. 2023-10-03T10:14:37.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:37.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.462+0000 7f81a3e44700 1 -- 172.21.15.72:0/154017288 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f819c1368e0 con 0x7f819c09e7e0 2023-10-03T10:14:37.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.462+0000 7f81927fc700 1 -- 172.21.15.72:0/154017288 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8198015030 con 0x7f819c09e7e0 2023-10-03T10:14:37.463 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:37.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.464+0000 7f81a3e44700 1 -- 172.21.15.72:0/154017288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c09e7e0 msgr2=0x7f819c1219e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.464+0000 7f81a3e44700 1 --2- 172.21.15.72:0/154017288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c09e7e0 0x7f819c1219e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f81980090b0 tx=0x7f8198004750 comp rx=0 tx=0).stop 2023-10-03T10:14:37.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.464+0000 7f81a3e44700 1 -- 172.21.15.72:0/154017288 shutdown_connections 2023-10-03T10:14:37.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.464+0000 7f81a3e44700 1 --2- 172.21.15.72:0/154017288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f819c137ff0 0x7f819c122460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.464+0000 7f81a3e44700 1 --2- 172.21.15.72:0/154017288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f819c09e7e0 0x7f819c1219e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.464+0000 7f81a3e44700 1 --2- 172.21.15.72:0/154017288 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f819c09f0f0 0x7f819c121f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.464+0000 7f81a3e44700 1 -- 172.21.15.72:0/154017288 >> 172.21.15.72:0/154017288 conn(0x7f819c0a4300 msgr2=0x7f819c136ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.464+0000 7f81a3e44700 1 -- 172.21.15.72:0/154017288 shutdown_connections 2023-10-03T10:14:37.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:37.464+0000 7f81a3e44700 1 -- 172.21.15.72:0/154017288 wait complete. 2023-10-03T10:14:37.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:37.945 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:38.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.068+0000 7fc648bc1700 1 Processor -- start 2023-10-03T10:14:38.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.068+0000 7fc648bc1700 1 -- start start 2023-10-03T10:14:38.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc648bc1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc644133a80 0x7fc644133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc648bc1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc644130a40 0x7fc64413b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc648bc1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64406bc00 con 0x7fc64412ff20 2023-10-03T10:14:38.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc648bc1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64406c570 con 0x7fc644133a80 2023-10-03T10:14:38.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc648bc1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6440a0040 con 0x7fc644130a40 2023-10-03T10:14:38.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc642d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc644130a40 0x7fc64413b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc64259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc644133a80 0x7fc644133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc641d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc64412ff20 0x7fc644130330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35448/0 (socket says 172.21.15.72:35448) 2023-10-03T10:14:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc641d9b700 1 -- 172.21.15.72:0/411900861 learned_addr learned my addr 172.21.15.72:0/411900861 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc64159a700 1 -- 172.21.15.72:0/411900861 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179950696 0 0) 0x7fc64406bc00 con 0x7fc64412ff20 2023-10-03T10:14:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc64259c700 1 -- 172.21.15.72:0/411900861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc644130a40 msgr2=0x7fc64413b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc64259c700 1 --2- 172.21.15.72:0/411900861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc644130a40 0x7fc64413b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc64259c700 1 -- 172.21.15.72:0/411900861 >> v1:172.21.15.72:6789/0 conn(0x7fc64412ff20 legacy=0x7fc644130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc64259c700 1 -- 172.21.15.72:0/411900861 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc644133860 con 0x7fc644133a80 2023-10-03T10:14:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc642d9d700 1 --2- 172.21.15.72:0/411900861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc644130a40 0x7fc64413b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc64259c700 1 --2- 172.21.15.72:0/411900861 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc644133a80 0x7fc644133e50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc638009870 tx=0x7fc638009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f125abcbfbd0d676 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc64159a700 1 -- 172.21.15.72:0/411900861 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638011830 con 0x7fc644133a80 2023-10-03T10:14:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc64159a700 1 -- 172.21.15.72:0/411900861 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc638011990 con 0x7fc644133a80 2023-10-03T10:14:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.069+0000 7fc64159a700 1 -- 172.21.15.72:0/411900861 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638011d20 con 0x7fc644133a80 2023-10-03T10:14:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.070+0000 7fc648bc1700 1 -- 172.21.15.72:0/411900861 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc644133a80 msgr2=0x7fc644133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.070+0000 7fc648bc1700 1 --2- 172.21.15.72:0/411900861 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc644133a80 0x7fc644133e50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc638009870 tx=0x7fc638009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.070+0000 7fc648bc1700 1 -- 172.21.15.72:0/411900861 shutdown_connections 2023-10-03T10:14:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.070+0000 7fc648bc1700 1 --2- 172.21.15.72:0/411900861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc644130a40 0x7fc64413b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.070+0000 7fc648bc1700 1 --2- 172.21.15.72:0/411900861 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc644133a80 0x7fc644133e50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.070+0000 7fc648bc1700 1 -- 172.21.15.72:0/411900861 >> 172.21.15.72:0/411900861 conn(0x7fc6440a4210 msgr2=0x7fc6440a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.070+0000 7fc648bc1700 1 -- 172.21.15.72:0/411900861 shutdown_connections 2023-10-03T10:14:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.070+0000 7fc648bc1700 1 -- 172.21.15.72:0/411900861 wait complete. 2023-10-03T10:14:38.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.071+0000 7fc648bc1700 1 Processor -- start 2023-10-03T10:14:38.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc648bc1700 1 -- start start 2023-10-03T10:14:38.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc648bc1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc64412ff20 0x7fc64409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc648bc1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc644130a40 0x7fc64409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc648bc1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc644133a80 0x7fc64409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc648bc1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64409de50 con 0x7fc644130a40 2023-10-03T10:14:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc648bc1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64409e080 con 0x7fc644133a80 2023-10-03T10:14:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc648bc1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc64411fb90 con 0x7fc64412ff20 2023-10-03T10:14:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc64259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc64412ff20 0x7fc64409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc64259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc64412ff20 0x7fc64409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39924/0 (socket says 172.21.15.72:39924) 2023-10-03T10:14:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc64259c700 1 -- 172.21.15.72:0/498781801 learned_addr learned my addr 172.21.15.72:0/498781801 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc642d9d700 1 --2- 172.21.15.72:0/498781801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc644133a80 0x7fc64409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc641d9b700 1 --2- 172.21.15.72:0/498781801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc644130a40 0x7fc64409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc64259c700 1 -- 172.21.15.72:0/498781801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc644133a80 msgr2=0x7fc64409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc64259c700 1 --2- 172.21.15.72:0/498781801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc644133a80 0x7fc64409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc64259c700 1 -- 172.21.15.72:0/498781801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc644130a40 msgr2=0x7fc64409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc64259c700 1 --2- 172.21.15.72:0/498781801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc644130a40 0x7fc64409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc64259c700 1 -- 172.21.15.72:0/498781801 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c009a70 con 0x7fc64412ff20 2023-10-03T10:14:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.072+0000 7fc64259c700 1 --2- 172.21.15.72:0/498781801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc64412ff20 0x7fc64409c480 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc638009840 tx=0x7fc638004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.073+0000 7fc632ffd700 1 -- 172.21.15.72:0/498781801 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6380044d0 con 0x7fc64412ff20 2023-10-03T10:14:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.073+0000 7fc632ffd700 1 -- 172.21.15.72:0/498781801 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6380036a0 con 0x7fc64412ff20 2023-10-03T10:14:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.073+0000 7fc648bc1700 1 -- 172.21.15.72:0/498781801 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6380094a0 con 0x7fc64412ff20 2023-10-03T10:14:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.073+0000 7fc632ffd700 1 -- 172.21.15.72:0/498781801 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638003a50 con 0x7fc64412ff20 2023-10-03T10:14:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.073+0000 7fc648bc1700 1 -- 172.21.15.72:0/498781801 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64412d990 con 0x7fc64412ff20 2023-10-03T10:14:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.073+0000 7fc632ffd700 1 -- 172.21.15.72:0/498781801 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc638003bb0 con 0x7fc64412ff20 2023-10-03T10:14:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.073+0000 7fc632ffd700 1 -- 172.21.15.72:0/498781801 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc6380408e0 con 0x7fc64412ff20 2023-10-03T10:14:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.074+0000 7fc648bc1700 1 -- 172.21.15.72:0/498781801 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc644074ea0 con 0x7fc64412ff20 2023-10-03T10:14:38.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.078+0000 7fc632ffd700 1 -- 172.21.15.72:0/498781801 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc638015080 con 0x7fc64412ff20 2023-10-03T10:14:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.261+0000 7fc648bc1700 1 -- 172.21.15.72:0/498781801 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc64406b250 con 0x7fc64412ff20 2023-10-03T10:14:38.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.261+0000 7fc632ffd700 1 -- 172.21.15.72:0/498781801 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc63802e970 con 0x7fc64412ff20 2023-10-03T10:14:38.262 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:38.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.263+0000 7fc648bc1700 1 -- 172.21.15.72:0/498781801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc64412ff20 msgr2=0x7fc64409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.263+0000 7fc648bc1700 1 --2- 172.21.15.72:0/498781801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc64412ff20 0x7fc64409c480 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc638009840 tx=0x7fc638004750 comp rx=0 tx=0).stop 2023-10-03T10:14:38.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.263+0000 7fc648bc1700 1 -- 172.21.15.72:0/498781801 shutdown_connections 2023-10-03T10:14:38.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.263+0000 7fc648bc1700 1 --2- 172.21.15.72:0/498781801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc644133a80 0x7fc64409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.263+0000 7fc648bc1700 1 --2- 172.21.15.72:0/498781801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc64412ff20 0x7fc64409c480 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.263+0000 7fc648bc1700 1 --2- 172.21.15.72:0/498781801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc644130a40 0x7fc64409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.263+0000 7fc648bc1700 1 -- 172.21.15.72:0/498781801 >> 172.21.15.72:0/498781801 conn(0x7fc6440a4210 msgr2=0x7fc64409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.263+0000 7fc648bc1700 1 -- 172.21.15.72:0/498781801 shutdown_connections 2023-10-03T10:14:38.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.263+0000 7fc648bc1700 1 -- 172.21.15.72:0/498781801 wait complete. 2023-10-03T10:14:38.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:38.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:38.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:38.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.444+0000 7f6c941ab700 1 Processor -- start 2023-10-03T10:14:38.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.445+0000 7f6c941ab700 1 -- start start 2023-10-03T10:14:38.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.445+0000 7f6c941ab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c09d6f0 0x7f6c8c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.445+0000 7f6c941ab700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c8c09e000 0x7f6c8c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.445+0000 7f6c941ab700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c09b120 con 0x7f6c8c09e410 2023-10-03T10:14:38.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.445+0000 7f6c941ab700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c06b460 con 0x7f6c8c09d6f0 2023-10-03T10:14:38.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.445+0000 7f6c941ab700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c09a7e0 con 0x7f6c8c09e000 2023-10-03T10:14:38.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.445+0000 7f6c91f47700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c09d6f0 0x7f6c8c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.445+0000 7f6c92748700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6c8c09e410 0x7f6c8c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43822/0 (socket says 172.21.15.72:43822) 2023-10-03T10:14:38.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.445+0000 7f6c91746700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c8c09e000 0x7f6c8c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.445+0000 7f6c92748700 1 -- 172.21.15.72:0/588307465 learned_addr learned my addr 172.21.15.72:0/588307465 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:38.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.446+0000 7f6c90f45700 1 -- 172.21.15.72:0/588307465 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430247407 0 0) 0x7f6c8c09b120 con 0x7f6c8c09e410 2023-10-03T10:14:38.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.446+0000 7f6c91f47700 1 -- 172.21.15.72:0/588307465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c8c09e000 msgr2=0x7f6c8c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.446+0000 7f6c91f47700 1 --2- 172.21.15.72:0/588307465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c8c09e000 0x7f6c8c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.446+0000 7f6c91f47700 1 -- 172.21.15.72:0/588307465 >> v1:172.21.15.72:6789/0 conn(0x7f6c8c09e410 legacy=0x7f6c8c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.446+0000 7f6c91f47700 1 -- 172.21.15.72:0/588307465 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c09a500 con 0x7f6c8c09d6f0 2023-10-03T10:14:38.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.446+0000 7f6c91746700 1 --2- 172.21.15.72:0/588307465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c8c09e000 0x7f6c8c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.446+0000 7f6c91f47700 1 --2- 172.21.15.72:0/588307465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c09d6f0 0x7f6c8c09dac0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009870 tx=0x7f6c88009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fd8ba797c1472b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.446+0000 7f6c90f45700 1 -- 172.21.15.72:0/588307465 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88011830 con 0x7f6c8c09d6f0 2023-10-03T10:14:38.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.446+0000 7f6c90f45700 1 -- 172.21.15.72:0/588307465 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c88011990 con 0x7f6c8c09d6f0 2023-10-03T10:14:38.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.446+0000 7f6c90f45700 1 -- 172.21.15.72:0/588307465 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88011d20 con 0x7f6c8c09d6f0 2023-10-03T10:14:38.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.447+0000 7f6c941ab700 1 -- 172.21.15.72:0/588307465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c09d6f0 msgr2=0x7f6c8c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.447+0000 7f6c941ab700 1 --2- 172.21.15.72:0/588307465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c09d6f0 0x7f6c8c09dac0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009870 tx=0x7f6c88009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:38.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.447+0000 7f6c941ab700 1 -- 172.21.15.72:0/588307465 shutdown_connections 2023-10-03T10:14:38.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.447+0000 7f6c941ab700 1 --2- 172.21.15.72:0/588307465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c09d6f0 0x7f6c8c09dac0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.447+0000 7f6c941ab700 1 --2- 172.21.15.72:0/588307465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c8c09e000 0x7f6c8c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.447+0000 7f6c941ab700 1 -- 172.21.15.72:0/588307465 >> 172.21.15.72:0/588307465 conn(0x7f6c8c066f50 msgr2=0x7f6c8c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.447+0000 7f6c941ab700 1 -- 172.21.15.72:0/588307465 shutdown_connections 2023-10-03T10:14:38.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.447+0000 7f6c941ab700 1 -- 172.21.15.72:0/588307465 wait complete. 2023-10-03T10:14:38.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.448+0000 7f6c941ab700 1 Processor -- start 2023-10-03T10:14:38.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.448+0000 7f6c941ab700 1 -- start start 2023-10-03T10:14:38.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.448+0000 7f6c941ab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c8c09d6f0 0x7f6c8c122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.448+0000 7f6c941ab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c09e000 0x7f6c8c122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.448+0000 7f6c941ab700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c8c09e410 0x7f6c8c122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.448+0000 7f6c941ab700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c124980 con 0x7f6c8c09d6f0 2023-10-03T10:14:38.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.448+0000 7f6c941ab700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c09c710 con 0x7f6c8c09e000 2023-10-03T10:14:38.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.448+0000 7f6c941ab700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0a2950 con 0x7f6c8c09e410 2023-10-03T10:14:38.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.448+0000 7f6c91f47700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c8c09d6f0 0x7f6c8c122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.448+0000 7f6c92748700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c8c09e410 0x7f6c8c122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.448+0000 7f6c91f47700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c8c09d6f0 0x7f6c8c122540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43330/0 (socket says 172.21.15.72:43330) 2023-10-03T10:14:38.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.448+0000 7f6c91f47700 1 -- 172.21.15.72:0/1805218423 learned_addr learned my addr 172.21.15.72:0/1805218423 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:38.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.448+0000 7f6c91746700 1 --2- 172.21.15.72:0/1805218423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c09e000 0x7f6c8c122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.449+0000 7f6c91746700 1 -- 172.21.15.72:0/1805218423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c8c09e410 msgr2=0x7f6c8c122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.449+0000 7f6c91746700 1 --2- 172.21.15.72:0/1805218423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c8c09e410 0x7f6c8c122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.449+0000 7f6c91746700 1 -- 172.21.15.72:0/1805218423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c8c09d6f0 msgr2=0x7f6c8c122540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.449+0000 7f6c91746700 1 --2- 172.21.15.72:0/1805218423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c8c09d6f0 0x7f6c8c122540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.449+0000 7f6c91746700 1 -- 172.21.15.72:0/1805218423 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0094a0 con 0x7f6c8c09e000 2023-10-03T10:14:38.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.449+0000 7f6c92748700 1 --2- 172.21.15.72:0/1805218423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c8c09e410 0x7f6c8c122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.449+0000 7f6c91746700 1 --2- 172.21.15.72:0/1805218423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c09e000 0x7f6c8c122a80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00e980 tx=0x7f6c7c00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.449+0000 7f6c827fc700 1 -- 172.21.15.72:0/1805218423 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00c690 con 0x7f6c8c09e000 2023-10-03T10:14:38.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.449+0000 7f6c827fc700 1 -- 172.21.15.72:0/1805218423 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c00c7f0 con 0x7f6c8c09e000 2023-10-03T10:14:38.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.449+0000 7f6c941ab700 1 -- 172.21.15.72:0/1805218423 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c880094a0 con 0x7f6c8c09e000 2023-10-03T10:14:38.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.449+0000 7f6c827fc700 1 -- 172.21.15.72:0/1805218423 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00cb80 con 0x7f6c8c09e000 2023-10-03T10:14:38.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.449+0000 7f6c941ab700 1 -- 172.21.15.72:0/1805218423 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8c126060 con 0x7f6c8c09e000 2023-10-03T10:14:38.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.450+0000 7f6c827fc700 1 -- 172.21.15.72:0/1805218423 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c7c00cce0 con 0x7f6c8c09e000 2023-10-03T10:14:38.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.450+0000 7f6c827fc700 1 -- 172.21.15.72:0/1805218423 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6c7c03f720 con 0x7f6c8c09e000 2023-10-03T10:14:38.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.450+0000 7f6c941ab700 1 -- 172.21.15.72:0/1805218423 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c0a3a60 con 0x7f6c8c09e000 2023-10-03T10:14:38.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.455+0000 7f6c827fc700 1 -- 172.21.15.72:0/1805218423 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c7c017020 con 0x7f6c8c09e000 2023-10-03T10:14:38.477 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:38.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.553+0000 7f2d7e16d700 1 Processor -- start 2023-10-03T10:14:38.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.553+0000 7f2d7e16d700 1 -- start start 2023-10-03T10:14:38.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d7e16d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2d781338a0 0x7f2d78133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d7e16d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d7809de50 0x7f2d7809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d7e16d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d7809e760 0x7f2d7813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d7e16d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7806fef0 con 0x7f2d781338a0 2023-10-03T10:14:38.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d7e16d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7806ef30 con 0x7f2d7809de50 2023-10-03T10:14:38.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d7e16d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d781334b0 con 0x7f2d7809e760 2023-10-03T10:14:38.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d76ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d7809de50 0x7f2d7809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d76ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d7809de50 0x7f2d7809e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39890/0 (socket says 172.21.15.72:39890) 2023-10-03T10:14:38.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d77fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d7809e760 0x7f2d7813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d76ffd700 1 -- 172.21.15.72:0/2569691932 learned_addr learned my addr 172.21.15.72:0/2569691932 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:38.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d777fe700 1 --2- 172.21.15.72:0/2569691932 >> v2:172.21.15.72:3300/0 conn(0x7f2d781338a0 0x7f2d78133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d76ffd700 1 -- 172.21.15.72:0/2569691932 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d7809e760 msgr2=0x7f2d7813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d76ffd700 1 --2- 172.21.15.72:0/2569691932 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d7809e760 0x7f2d7813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d76ffd700 1 -- 172.21.15.72:0/2569691932 >> v2:172.21.15.72:3300/0 conn(0x7f2d781338a0 msgr2=0x7f2d78133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d76ffd700 1 --2- 172.21.15.72:0/2569691932 >> v2:172.21.15.72:3300/0 conn(0x7f2d781338a0 0x7f2d78133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d76ffd700 1 -- 172.21.15.72:0/2569691932 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7806fc30 con 0x7f2d7809de50 2023-10-03T10:14:38.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d77fff700 1 --2- 172.21.15.72:0/2569691932 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d7809e760 0x7f2d7813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d777fe700 1 --2- 172.21.15.72:0/2569691932 >> v2:172.21.15.72:3300/0 conn(0x7f2d781338a0 0x7f2d78133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.554+0000 7f2d76ffd700 1 --2- 172.21.15.72:0/2569691932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d7809de50 0x7f2d7809e220 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c0098f0 tx=0x7f2d6c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=358d47f646aaaafc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.555+0000 7f2d767fc700 1 -- 172.21.15.72:0/2569691932 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c011830 con 0x7f2d7809de50 2023-10-03T10:14:38.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.555+0000 7f2d767fc700 1 -- 172.21.15.72:0/2569691932 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6c011990 con 0x7f2d7809de50 2023-10-03T10:14:38.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.555+0000 7f2d767fc700 1 -- 172.21.15.72:0/2569691932 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c011d20 con 0x7f2d7809de50 2023-10-03T10:14:38.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.555+0000 7f2d7e16d700 1 -- 172.21.15.72:0/2569691932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d7809de50 msgr2=0x7f2d7809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.555+0000 7f2d7e16d700 1 --2- 172.21.15.72:0/2569691932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d7809de50 0x7f2d7809e220 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c0098f0 tx=0x7f2d6c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:38.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.555+0000 7f2d7e16d700 1 -- 172.21.15.72:0/2569691932 shutdown_connections 2023-10-03T10:14:38.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.555+0000 7f2d7e16d700 1 --2- 172.21.15.72:0/2569691932 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d7809e760 0x7f2d7813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.555+0000 7f2d7e16d700 1 --2- 172.21.15.72:0/2569691932 >> v2:172.21.15.72:3300/0 conn(0x7f2d781338a0 0x7f2d78133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.555+0000 7f2d7e16d700 1 --2- 172.21.15.72:0/2569691932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d7809de50 0x7f2d7809e220 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.555+0000 7f2d7e16d700 1 -- 172.21.15.72:0/2569691932 >> 172.21.15.72:0/2569691932 conn(0x7f2d780a2aa0 msgr2=0x7f2d780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.555+0000 7f2d7e16d700 1 -- 172.21.15.72:0/2569691932 shutdown_connections 2023-10-03T10:14:38.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.555+0000 7f2d7e16d700 1 -- 172.21.15.72:0/2569691932 wait complete. 2023-10-03T10:14:38.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.556+0000 7f2d7e16d700 1 Processor -- start 2023-10-03T10:14:38.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.556+0000 7f2d7e16d700 1 -- start start 2023-10-03T10:14:38.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d7e16d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d7809de50 0x7f2d7811ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d7e16d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d7809e760 0x7f2d7811f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d7e16d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d781338a0 0x7f2d7811f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d7e16d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d78121e40 con 0x7f2d781338a0 2023-10-03T10:14:38.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d7e16d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d780a1060 con 0x7f2d7809de50 2023-10-03T10:14:38.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d7e16d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d781226d0 con 0x7f2d7809e760 2023-10-03T10:14:38.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d777fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d7809de50 0x7f2d7811ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d777fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d7809de50 0x7f2d7811ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39892/0 (socket says 172.21.15.72:39892) 2023-10-03T10:14:38.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d76ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d7809e760 0x7f2d7811f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d777fe700 1 -- 172.21.15.72:0/2476560786 learned_addr learned my addr 172.21.15.72:0/2476560786 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:38.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d77fff700 1 --2- 172.21.15.72:0/2476560786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d781338a0 0x7f2d7811f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d777fe700 1 -- 172.21.15.72:0/2476560786 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d7809e760 msgr2=0x7f2d7811f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d777fe700 1 --2- 172.21.15.72:0/2476560786 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d7809e760 0x7f2d7811f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d777fe700 1 -- 172.21.15.72:0/2476560786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d781338a0 msgr2=0x7f2d7811f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d777fe700 1 --2- 172.21.15.72:0/2476560786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d781338a0 0x7f2d7811f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d777fe700 1 -- 172.21.15.72:0/2476560786 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d70009a70 con 0x7f2d7809de50 2023-10-03T10:14:38.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d76ffd700 1 --2- 172.21.15.72:0/2476560786 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d7809e760 0x7f2d7811f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.557+0000 7f2d777fe700 1 --2- 172.21.15.72:0/2476560786 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d7809de50 0x7f2d7811ebb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800ebe0 tx=0x7f2d6800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.558+0000 7f2d5ffff700 1 -- 172.21.15.72:0/2476560786 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6800c850 con 0x7f2d7809de50 2023-10-03T10:14:38.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.558+0000 7f2d5ffff700 1 -- 172.21.15.72:0/2476560786 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6800c9b0 con 0x7f2d7809de50 2023-10-03T10:14:38.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.558+0000 7f2d7e16d700 1 -- 172.21.15.72:0/2476560786 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d680094a0 con 0x7f2d7809de50 2023-10-03T10:14:38.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.558+0000 7f2d5ffff700 1 -- 172.21.15.72:0/2476560786 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6800cd20 con 0x7f2d7809de50 2023-10-03T10:14:38.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.558+0000 7f2d7e16d700 1 -- 172.21.15.72:0/2476560786 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6c009550 con 0x7f2d7809de50 2023-10-03T10:14:38.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.559+0000 7f2d5ffff700 1 -- 172.21.15.72:0/2476560786 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d68013470 con 0x7f2d7809de50 2023-10-03T10:14:38.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.559+0000 7f2d5ffff700 1 -- 172.21.15.72:0/2476560786 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2d6803f710 con 0x7f2d7809de50 2023-10-03T10:14:38.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.559+0000 7f2d7e16d700 1 -- 172.21.15.72:0/2476560786 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d780a16a0 con 0x7f2d7809de50 2023-10-03T10:14:38.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.564+0000 7f2d5ffff700 1 -- 172.21.15.72:0/2476560786 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d68013720 con 0x7f2d7809de50 2023-10-03T10:14:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.603+0000 7f7c4a099700 1 Processor -- start 2023-10-03T10:14:38.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.603+0000 7f7c4a099700 1 -- start start 2023-10-03T10:14:38.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c4a099700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c441316c0 0x7f7c44131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c4a099700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7c4409d9f0 0x7f7c4406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c4a099700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4409e130 con 0x7f7c4406acb0 2023-10-03T10:14:38.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c4a099700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c441312b0 con 0x7f7c4409d9f0 2023-10-03T10:14:38.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c4a099700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4409f6e0 con 0x7f7c441316c0 2023-10-03T10:14:38.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c437fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c441316c0 0x7f7c44131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c42ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7c4409d9f0 0x7f7c4406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c42ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7c4409d9f0 0x7f7c4406a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43364/0 (socket says 172.21.15.72:43364) 2023-10-03T10:14:38.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c437fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c441316c0 0x7f7c44131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51934/0 (socket says 172.21.15.72:51934) 2023-10-03T10:14:38.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c42ffd700 1 -- 172.21.15.72:0/3741680877 learned_addr learned my addr 172.21.15.72:0/3741680877 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c437fe700 1 -- 172.21.15.72:0/3741680877 >> v2:172.21.15.72:3300/0 conn(0x7f7c4409d9f0 msgr2=0x7f7c4406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c437fe700 1 --2- 172.21.15.72:0/3741680877 >> v2:172.21.15.72:3300/0 conn(0x7f7c4409d9f0 0x7f7c4406a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c437fe700 1 -- 172.21.15.72:0/3741680877 >> v1:172.21.15.72:6789/0 conn(0x7f7c4406acb0 legacy=0x7f7c44138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c437fe700 1 -- 172.21.15.72:0/3741680877 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4409e760 con 0x7f7c441316c0 2023-10-03T10:14:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c427fc700 1 -- 172.21.15.72:0/3741680877 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494057141 0 0) 0x7f7c3c001490 con 0x7f7c4406acb0 2023-10-03T10:14:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c42ffd700 1 --2- 172.21.15.72:0/3741680877 >> v2:172.21.15.72:3300/0 conn(0x7f7c4409d9f0 0x7f7c4406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.604+0000 7f7c437fe700 1 --2- 172.21.15.72:0/3741680877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c441316c0 0x7f7c44131a90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009840 tx=0x7f7c34009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceee22952c8ba2d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.605+0000 7f7c427fc700 1 -- 172.21.15.72:0/3741680877 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34011830 con 0x7f7c441316c0 2023-10-03T10:14:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.605+0000 7f7c427fc700 1 -- 172.21.15.72:0/3741680877 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c34011990 con 0x7f7c441316c0 2023-10-03T10:14:38.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.605+0000 7f7c427fc700 1 -- 172.21.15.72:0/3741680877 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34011d20 con 0x7f7c441316c0 2023-10-03T10:14:38.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.605+0000 7f7c4a099700 1 -- 172.21.15.72:0/3741680877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c441316c0 msgr2=0x7f7c44131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.605+0000 7f7c4a099700 1 --2- 172.21.15.72:0/3741680877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c441316c0 0x7f7c44131a90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009840 tx=0x7f7c34009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:38.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.605+0000 7f7c4a099700 1 -- 172.21.15.72:0/3741680877 shutdown_connections 2023-10-03T10:14:38.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.605+0000 7f7c4a099700 1 --2- 172.21.15.72:0/3741680877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c441316c0 0x7f7c44131a90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.605+0000 7f7c4a099700 1 --2- 172.21.15.72:0/3741680877 >> v2:172.21.15.72:3300/0 conn(0x7f7c4409d9f0 0x7f7c4406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.605+0000 7f7c4a099700 1 -- 172.21.15.72:0/3741680877 >> 172.21.15.72:0/3741680877 conn(0x7f7c44066f50 msgr2=0x7f7c4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.606+0000 7f7c4a099700 1 -- 172.21.15.72:0/3741680877 shutdown_connections 2023-10-03T10:14:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.606+0000 7f7c4a099700 1 -- 172.21.15.72:0/3741680877 wait complete. 2023-10-03T10:14:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.607+0000 7f7c4a099700 1 Processor -- start 2023-10-03T10:14:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.607+0000 7f7c4a099700 1 -- start start 2023-10-03T10:14:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c4a099700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4406acb0 0x7f7c44071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c4a099700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c4409d9f0 0x7f7c440715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c4a099700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c441316c0 0x7f7c44071af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c4a099700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4411b280 con 0x7f7c4406acb0 2023-10-03T10:14:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c4a099700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440724d0 con 0x7f7c441316c0 2023-10-03T10:14:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c4a099700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4411b480 con 0x7f7c4409d9f0 2023-10-03T10:14:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c437fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4406acb0 0x7f7c44071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c42ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c4409d9f0 0x7f7c440715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c437fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4406acb0 0x7f7c44071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43380/0 (socket says 172.21.15.72:43380) 2023-10-03T10:14:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c42ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c4409d9f0 0x7f7c440715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51942/0 (socket says 172.21.15.72:51942) 2023-10-03T10:14:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c437fe700 1 -- 172.21.15.72:0/2898595110 learned_addr learned my addr 172.21.15.72:0/2898595110 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c43fff700 1 --2- 172.21.15.72:0/2898595110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c441316c0 0x7f7c44071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c42ffd700 1 -- 172.21.15.72:0/2898595110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c441316c0 msgr2=0x7f7c44071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c42ffd700 1 --2- 172.21.15.72:0/2898595110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c441316c0 0x7f7c44071af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c42ffd700 1 -- 172.21.15.72:0/2898595110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4406acb0 msgr2=0x7f7c44071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c42ffd700 1 --2- 172.21.15.72:0/2898595110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4406acb0 0x7f7c44071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c42ffd700 1 -- 172.21.15.72:0/2898595110 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c38009550 con 0x7f7c4409d9f0 2023-10-03T10:14:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c42ffd700 1 --2- 172.21.15.72:0/2898595110 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c4409d9f0 0x7f7c440715b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7c4409d810 tx=0x7f7c3800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.608+0000 7f7c2bfff700 1 -- 172.21.15.72:0/2898595110 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38004030 con 0x7f7c4409d9f0 2023-10-03T10:14:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.609+0000 7f7c2bfff700 1 -- 172.21.15.72:0/2898595110 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c38004190 con 0x7f7c4409d9f0 2023-10-03T10:14:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.609+0000 7f7c4a099700 1 -- 172.21.15.72:0/2898595110 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c340094a0 con 0x7f7c4409d9f0 2023-10-03T10:14:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.609+0000 7f7c2bfff700 1 -- 172.21.15.72:0/2898595110 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38004520 con 0x7f7c4409d9f0 2023-10-03T10:14:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.609+0000 7f7c4a099700 1 -- 172.21.15.72:0/2898595110 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4409ead0 con 0x7f7c4409d9f0 2023-10-03T10:14:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.609+0000 7f7c2bfff700 1 -- 172.21.15.72:0/2898595110 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c380036a0 con 0x7f7c4409d9f0 2023-10-03T10:14:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.610+0000 7f7c4a099700 1 -- 172.21.15.72:0/2898595110 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c440a37f0 con 0x7f7c4409d9f0 2023-10-03T10:14:38.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.610+0000 7f7c2bfff700 1 -- 172.21.15.72:0/2898595110 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7c3803f410 con 0x7f7c4409d9f0 2023-10-03T10:14:38.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.614+0000 7f7c2bfff700 1 -- 172.21.15.72:0/2898595110 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c380198f0 con 0x7f7c4409d9f0 2023-10-03T10:14:38.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.656+0000 7f6c941ab700 1 -- 172.21.15.72:0/1805218423 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6c8c074ea0 con 0x7f6c8c09e000 2023-10-03T10:14:38.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.657+0000 7f6c827fc700 1 -- 172.21.15.72:0/1805218423 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6c7c0232f0 con 0x7f6c8c09e000 2023-10-03T10:14:38.657 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:38.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.659+0000 7f6c941ab700 1 -- 172.21.15.72:0/1805218423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c09e000 msgr2=0x7f6c8c122a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.659+0000 7f6c941ab700 1 --2- 172.21.15.72:0/1805218423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c09e000 0x7f6c8c122a80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00e980 tx=0x7f6c7c00ec90 comp rx=0 tx=0).stop 2023-10-03T10:14:38.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.659+0000 7f6c941ab700 1 -- 172.21.15.72:0/1805218423 shutdown_connections 2023-10-03T10:14:38.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.659+0000 7f6c941ab700 1 --2- 172.21.15.72:0/1805218423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c8c09d6f0 0x7f6c8c122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.659+0000 7f6c941ab700 1 --2- 172.21.15.72:0/1805218423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c8c09e410 0x7f6c8c122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.659+0000 7f6c941ab700 1 --2- 172.21.15.72:0/1805218423 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c09e000 0x7f6c8c122a80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.659+0000 7f6c941ab700 1 -- 172.21.15.72:0/1805218423 >> 172.21.15.72:0/1805218423 conn(0x7f6c8c066f50 msgr2=0x7f6c8c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.659+0000 7f6c941ab700 1 -- 172.21.15.72:0/1805218423 shutdown_connections 2023-10-03T10:14:38.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.659+0000 7f6c941ab700 1 -- 172.21.15.72:0/1805218423 wait complete. 2023-10-03T10:14:38.671 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.784+0000 7f2d7e16d700 1 -- 172.21.15.72:0/2476560786 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2d78074ea0 con 0x7f2d7809de50 2023-10-03T10:14:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.785+0000 7f2d5ffff700 1 -- 172.21.15.72:0/2476560786 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d68021030 con 0x7f2d7809de50 2023-10-03T10:14:38.786 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:38.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.786+0000 7f2d7e16d700 1 -- 172.21.15.72:0/2476560786 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d7809de50 msgr2=0x7f2d7811ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.786+0000 7f2d7e16d700 1 --2- 172.21.15.72:0/2476560786 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d7809de50 0x7f2d7811ebb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800ebe0 tx=0x7f2d6800eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.787+0000 7f2d7e16d700 1 -- 172.21.15.72:0/2476560786 shutdown_connections 2023-10-03T10:14:38.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.787+0000 7f2d7e16d700 1 --2- 172.21.15.72:0/2476560786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d781338a0 0x7f2d7811f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.787+0000 7f2d7e16d700 1 --2- 172.21.15.72:0/2476560786 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d7809de50 0x7f2d7811ebb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.787+0000 7f2d7e16d700 1 --2- 172.21.15.72:0/2476560786 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d7809e760 0x7f2d7811f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.787+0000 7f2d7e16d700 1 -- 172.21.15.72:0/2476560786 >> 172.21.15.72:0/2476560786 conn(0x7f2d780a2aa0 msgr2=0x7f2d7809ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.787+0000 7f2d7e16d700 1 -- 172.21.15.72:0/2476560786 shutdown_connections 2023-10-03T10:14:38.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.787+0000 7f2d7e16d700 1 -- 172.21.15.72:0/2476560786 wait complete. 2023-10-03T10:14:38.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:38.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.830+0000 7f7c4a099700 1 -- 172.21.15.72:0/2898595110 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7c4412b900 con 0x7f7c4409d9f0 2023-10-03T10:14:38.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.831+0000 7f7c2bfff700 1 -- 172.21.15.72:0/2898595110 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7c38020030 con 0x7f7c4409d9f0 2023-10-03T10:14:38.831 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:38.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.833+0000 7f7c4a099700 1 -- 172.21.15.72:0/2898595110 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c4409d9f0 msgr2=0x7f7c440715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.833+0000 7f7c4a099700 1 --2- 172.21.15.72:0/2898595110 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c4409d9f0 0x7f7c440715b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7c4409d810 tx=0x7f7c3800ec80 comp rx=0 tx=0).stop 2023-10-03T10:14:38.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.833+0000 7f7c4a099700 1 -- 172.21.15.72:0/2898595110 shutdown_connections 2023-10-03T10:14:38.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.833+0000 7f7c4a099700 1 --2- 172.21.15.72:0/2898595110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7c4406acb0 0x7f7c44071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.833+0000 7f7c4a099700 1 --2- 172.21.15.72:0/2898595110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7c441316c0 0x7f7c44071af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.833+0000 7f7c4a099700 1 --2- 172.21.15.72:0/2898595110 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7c4409d9f0 0x7f7c440715b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.833+0000 7f7c4a099700 1 -- 172.21.15.72:0/2898595110 >> 172.21.15.72:0/2898595110 conn(0x7f7c44066f50 msgr2=0x7f7c440a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.833+0000 7f7c4a099700 1 -- 172.21.15.72:0/2898595110 shutdown_connections 2023-10-03T10:14:38.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:38.833+0000 7f7c4a099700 1 -- 172.21.15.72:0/2898595110 wait complete. 2023-10-03T10:14:38.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:39.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:39.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.401+0000 7f9b1a3da700 1 Processor -- start 2023-10-03T10:14:39.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.401+0000 7f9b1a3da700 1 -- start start 2023-10-03T10:14:39.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.401+0000 7f9b1a3da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b1409e1d0 0x7f9b14138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.401+0000 7f9b1a3da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b14139170 0x7f9b1413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.401+0000 7f9b1a3da700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1409b120 con 0x7f9b1409d6f0 2023-10-03T10:14:39.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.401+0000 7f9b1a3da700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1406b460 con 0x7f9b1409e1d0 2023-10-03T10:14:39.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.401+0000 7f9b1a3da700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1409a7e0 con 0x7f9b14139170 2023-10-03T10:14:39.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.402+0000 7f9b137fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b1409e1d0 0x7f9b14138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.402+0000 7f9b18977700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b14139170 0x7f9b1413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.402+0000 7f9b13fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9b1409d6f0 0x7f9b1409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43840/0 (socket says 172.21.15.72:43840) 2023-10-03T10:14:39.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.402+0000 7f9b13fff700 1 -- 172.21.15.72:0/3392089585 learned_addr learned my addr 172.21.15.72:0/3392089585 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:39.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.402+0000 7f9b137fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b1409e1d0 0x7f9b14138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39910/0 (socket says 172.21.15.72:39910) 2023-10-03T10:14:39.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.402+0000 7f9b12ffd700 1 -- 172.21.15.72:0/3392089585 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949368294 0 0) 0x7f9b1409b120 con 0x7f9b1409d6f0 2023-10-03T10:14:39.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.402+0000 7f9b137fe700 1 -- 172.21.15.72:0/3392089585 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b14139170 msgr2=0x7f9b1413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.402+0000 7f9b137fe700 1 --2- 172.21.15.72:0/3392089585 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b14139170 0x7f9b1413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.402+0000 7f9b137fe700 1 -- 172.21.15.72:0/3392089585 >> v1:172.21.15.72:6789/0 conn(0x7f9b1409d6f0 legacy=0x7f9b1409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.402+0000 7f9b137fe700 1 -- 172.21.15.72:0/3392089585 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1409a500 con 0x7f9b1409e1d0 2023-10-03T10:14:39.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.402+0000 7f9b18977700 1 --2- 172.21.15.72:0/3392089585 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b14139170 0x7f9b1413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:39.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.402+0000 7f9b137fe700 1 --2- 172.21.15.72:0/3392089585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b1409e1d0 0x7f9b14138c30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009870 tx=0x7f9b04009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca3aff38a5ab0fc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.402+0000 7f9b12ffd700 1 -- 172.21.15.72:0/3392089585 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04011830 con 0x7f9b1409e1d0 2023-10-03T10:14:39.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.402+0000 7f9b12ffd700 1 -- 172.21.15.72:0/3392089585 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b04011990 con 0x7f9b1409e1d0 2023-10-03T10:14:39.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.402+0000 7f9b12ffd700 1 -- 172.21.15.72:0/3392089585 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04011d20 con 0x7f9b1409e1d0 2023-10-03T10:14:39.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.403+0000 7f9b1a3da700 1 -- 172.21.15.72:0/3392089585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b1409e1d0 msgr2=0x7f9b14138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.403+0000 7f9b1a3da700 1 --2- 172.21.15.72:0/3392089585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b1409e1d0 0x7f9b14138c30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009870 tx=0x7f9b04009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.403+0000 7f9b1a3da700 1 -- 172.21.15.72:0/3392089585 shutdown_connections 2023-10-03T10:14:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.403+0000 7f9b1a3da700 1 --2- 172.21.15.72:0/3392089585 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b14139170 0x7f9b1413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.403+0000 7f9b1a3da700 1 --2- 172.21.15.72:0/3392089585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b1409e1d0 0x7f9b14138c30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.403+0000 7f9b1a3da700 1 -- 172.21.15.72:0/3392089585 >> 172.21.15.72:0/3392089585 conn(0x7f9b14066f50 msgr2=0x7f9b1409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.403+0000 7f9b1a3da700 1 -- 172.21.15.72:0/3392089585 shutdown_connections 2023-10-03T10:14:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.403+0000 7f9b1a3da700 1 -- 172.21.15.72:0/3392089585 wait complete. 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.404+0000 7f9b1a3da700 1 Processor -- start 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.404+0000 7f9b1a3da700 1 -- start start 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.404+0000 7f9b1a3da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b1409d6f0 0x7f9b14120770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.404+0000 7f9b1a3da700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b1409e1d0 0x7f9b14120cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.404+0000 7f9b1a3da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b14139170 0x7f9b141211f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.404+0000 7f9b1a3da700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14123c30 con 0x7f9b1409e1d0 2023-10-03T10:14:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.404+0000 7f9b1a3da700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14124e50 con 0x7f9b14139170 2023-10-03T10:14:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.404+0000 7f9b1a3da700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b14072170 con 0x7f9b1409d6f0 2023-10-03T10:14:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.404+0000 7f9b137fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b1409e1d0 0x7f9b14120cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.404+0000 7f9b18977700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b14139170 0x7f9b141211f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.404+0000 7f9b13fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b1409d6f0 0x7f9b14120770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.404+0000 7f9b137fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b1409e1d0 0x7f9b14120cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43382/0 (socket says 172.21.15.72:43382) 2023-10-03T10:14:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.404+0000 7f9b18977700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b14139170 0x7f9b141211f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39920/0 (socket says 172.21.15.72:39920) 2023-10-03T10:14:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.404+0000 7f9b137fe700 1 -- 172.21.15.72:0/450686034 learned_addr learned my addr 172.21.15.72:0/450686034 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.405+0000 7f9b13fff700 1 -- 172.21.15.72:0/450686034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b14139170 msgr2=0x7f9b141211f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.405+0000 7f9b13fff700 1 --2- 172.21.15.72:0/450686034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b14139170 0x7f9b141211f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.405+0000 7f9b13fff700 1 -- 172.21.15.72:0/450686034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b1409e1d0 msgr2=0x7f9b14120cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.405+0000 7f9b13fff700 1 --2- 172.21.15.72:0/450686034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b1409e1d0 0x7f9b14120cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.405+0000 7f9b13fff700 1 -- 172.21.15.72:0/450686034 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0c009a70 con 0x7f9b1409d6f0 2023-10-03T10:14:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.405+0000 7f9b137fe700 1 --2- 172.21.15.72:0/450686034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b1409e1d0 0x7f9b14120cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.405+0000 7f9b13fff700 1 --2- 172.21.15.72:0/450686034 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b1409d6f0 0x7f9b14120770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800c470 tx=0x7f9b0800c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.405+0000 7f9b10ff9700 1 -- 172.21.15.72:0/450686034 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08004c80 con 0x7f9b1409d6f0 2023-10-03T10:14:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.405+0000 7f9b10ff9700 1 -- 172.21.15.72:0/450686034 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b08004de0 con 0x7f9b1409d6f0 2023-10-03T10:14:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.405+0000 7f9b10ff9700 1 -- 172.21.15.72:0/450686034 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08007310 con 0x7f9b1409d6f0 2023-10-03T10:14:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.405+0000 7f9b1a3da700 1 -- 172.21.15.72:0/450686034 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b040094a0 con 0x7f9b1409d6f0 2023-10-03T10:14:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.405+0000 7f9b1a3da700 1 -- 172.21.15.72:0/450686034 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b141241d0 con 0x7f9b1409d6f0 2023-10-03T10:14:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.406+0000 7f9b10ff9700 1 -- 172.21.15.72:0/450686034 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b08007470 con 0x7f9b1409d6f0 2023-10-03T10:14:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.406+0000 7f9b10ff9700 1 -- 172.21.15.72:0/450686034 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9b0803f1e0 con 0x7f9b1409d6f0 2023-10-03T10:14:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.406+0000 7f9b1a3da700 1 -- 172.21.15.72:0/450686034 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b14123da0 con 0x7f9b1409d6f0 2023-10-03T10:14:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.410+0000 7f9b10ff9700 1 -- 172.21.15.72:0/450686034 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b08007720 con 0x7f9b1409d6f0 2023-10-03T10:14:39.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.596+0000 7f9b1a3da700 1 -- 172.21.15.72:0/450686034 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9b14074ea0 con 0x7f9b1409d6f0 2023-10-03T10:14:39.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.597+0000 7f9b10ff9700 1 -- 172.21.15.72:0/450686034 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b08011360 con 0x7f9b1409d6f0 2023-10-03T10:14:39.597 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:39.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.599+0000 7f9b1a3da700 1 -- 172.21.15.72:0/450686034 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b1409d6f0 msgr2=0x7f9b14120770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.599+0000 7f9b1a3da700 1 --2- 172.21.15.72:0/450686034 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b1409d6f0 0x7f9b14120770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800c470 tx=0x7f9b0800c780 comp rx=0 tx=0).stop 2023-10-03T10:14:39.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.599+0000 7f9b1a3da700 1 -- 172.21.15.72:0/450686034 shutdown_connections 2023-10-03T10:14:39.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.599+0000 7f9b1a3da700 1 --2- 172.21.15.72:0/450686034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b14139170 0x7f9b141211f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.599+0000 7f9b1a3da700 1 --2- 172.21.15.72:0/450686034 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b1409d6f0 0x7f9b14120770 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.599+0000 7f9b1a3da700 1 --2- 172.21.15.72:0/450686034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b1409e1d0 0x7f9b14120cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.599+0000 7f9b1a3da700 1 -- 172.21.15.72:0/450686034 >> 172.21.15.72:0/450686034 conn(0x7f9b14066f50 msgr2=0x7f9b14136b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.599+0000 7f9b1a3da700 1 -- 172.21.15.72:0/450686034 shutdown_connections 2023-10-03T10:14:39.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.599+0000 7f9b1a3da700 1 -- 172.21.15.72:0/450686034 wait complete. 2023-10-03T10:14:39.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:39.672 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:39.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.794+0000 7fa1bf587700 1 Processor -- start 2023-10-03T10:14:39.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.794+0000 7fa1bf587700 1 -- start start 2023-10-03T10:14:39.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.794+0000 7fa1bf587700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa1b8136710 0x7fa1b8138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.794+0000 7fa1bf587700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1b8139030 0x7fa1b813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.794+0000 7fa1bf587700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b806ef30 con 0x7fa1b81338a0 2023-10-03T10:14:39.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.794+0000 7fa1bf587700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b806fef0 con 0x7fa1b8136710 2023-10-03T10:14:39.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.794+0000 7fa1bf587700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b81334b0 con 0x7fa1b8139030 2023-10-03T10:14:39.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.794+0000 7fa1bcb22700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa1b8136710 0x7fa1b8138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.794+0000 7fa1bdb24700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1b8139030 0x7fa1b813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.794+0000 7fa1bcb22700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa1b8136710 0x7fa1b8138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43384/0 (socket says 172.21.15.72:43384) 2023-10-03T10:14:39.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.794+0000 7fa1bdb24700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1b8139030 0x7fa1b813b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39922/0 (socket says 172.21.15.72:39922) 2023-10-03T10:14:39.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.795+0000 7fa1bcb22700 1 -- 172.21.15.72:0/2609625386 learned_addr learned my addr 172.21.15.72:0/2609625386 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:39.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.795+0000 7fa1bcb22700 1 -- 172.21.15.72:0/2609625386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1b8139030 msgr2=0x7fa1b813b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.795+0000 7fa1bcb22700 1 --2- 172.21.15.72:0/2609625386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1b8139030 0x7fa1b813b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.795+0000 7fa1bcb22700 1 -- 172.21.15.72:0/2609625386 >> v1:172.21.15.72:6789/0 conn(0x7fa1b81338a0 legacy=0x7fa1b8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.795+0000 7fa1bcb22700 1 -- 172.21.15.72:0/2609625386 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b806fc30 con 0x7fa1b8136710 2023-10-03T10:14:39.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.795+0000 7fa1bdb24700 1 --2- 172.21.15.72:0/2609625386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1b8139030 0x7fa1b813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:39.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.795+0000 7fa1bcb22700 1 --2- 172.21.15.72:0/2609625386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b8136710 0x7fa1b8138af0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80098f0 tx=0x7fa1a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51451535d8055a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.795+0000 7fa1affff700 1 -- 172.21.15.72:0/2609625386 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8011830 con 0x7fa1b8136710 2023-10-03T10:14:39.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.795+0000 7fa1affff700 1 -- 172.21.15.72:0/2609625386 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a8011990 con 0x7fa1b8136710 2023-10-03T10:14:39.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.795+0000 7fa1affff700 1 -- 172.21.15.72:0/2609625386 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8011d20 con 0x7fa1b8136710 2023-10-03T10:14:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.796+0000 7fa1bf587700 1 -- 172.21.15.72:0/2609625386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b8136710 msgr2=0x7fa1b8138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.796+0000 7fa1bf587700 1 --2- 172.21.15.72:0/2609625386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b8136710 0x7fa1b8138af0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80098f0 tx=0x7fa1a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.796+0000 7fa1bf587700 1 -- 172.21.15.72:0/2609625386 shutdown_connections 2023-10-03T10:14:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.796+0000 7fa1bf587700 1 --2- 172.21.15.72:0/2609625386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1b8139030 0x7fa1b813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.796+0000 7fa1bf587700 1 --2- 172.21.15.72:0/2609625386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b8136710 0x7fa1b8138af0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.796+0000 7fa1bf587700 1 -- 172.21.15.72:0/2609625386 >> 172.21.15.72:0/2609625386 conn(0x7fa1b80a2aa0 msgr2=0x7fa1b80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.796+0000 7fa1bf587700 1 -- 172.21.15.72:0/2609625386 shutdown_connections 2023-10-03T10:14:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.796+0000 7fa1bf587700 1 -- 172.21.15.72:0/2609625386 wait complete. 2023-10-03T10:14:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.796+0000 7fa1bf587700 1 Processor -- start 2023-10-03T10:14:39.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bf587700 1 -- start start 2023-10-03T10:14:39.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:39.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bf587700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1b81338a0 0x7fa1b811ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bf587700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1b8136710 0x7fa1b811b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bf587700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b8139030 0x7fa1b811b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bf587700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b811cad0 con 0x7fa1b8139030 2023-10-03T10:14:39.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bf587700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b811e330 con 0x7fa1b8136710 2023-10-03T10:14:39.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bf587700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b8138b00 con 0x7fa1b81338a0 2023-10-03T10:14:39.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bcb22700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1b8136710 0x7fa1b811b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bcb22700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1b8136710 0x7fa1b811b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39934/0 (socket says 172.21.15.72:39934) 2023-10-03T10:14:39.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bd323700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1b81338a0 0x7fa1b811ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bcb22700 1 -- 172.21.15.72:0/2711816845 learned_addr learned my addr 172.21.15.72:0/2711816845 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bdb24700 1 --2- 172.21.15.72:0/2711816845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b8139030 0x7fa1b811b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bcb22700 1 -- 172.21.15.72:0/2711816845 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1b81338a0 msgr2=0x7fa1b811ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bcb22700 1 --2- 172.21.15.72:0/2711816845 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1b81338a0 0x7fa1b811ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bcb22700 1 -- 172.21.15.72:0/2711816845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b8139030 msgr2=0x7fa1b811b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bcb22700 1 --2- 172.21.15.72:0/2711816845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b8139030 0x7fa1b811b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bcb22700 1 -- 172.21.15.72:0/2711816845 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b0009a70 con 0x7fa1b8136710 2023-10-03T10:14:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.797+0000 7fa1bdb24700 1 --2- 172.21.15.72:0/2711816845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b8139030 0x7fa1b811b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.798+0000 7fa1bcb22700 1 --2- 172.21.15.72:0/2711816845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1b8136710 0x7fa1b811b390 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8000c00 tx=0x7fa1a8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.798+0000 7fa1adffb700 1 -- 172.21.15.72:0/2711816845 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a80043c0 con 0x7fa1b8136710 2023-10-03T10:14:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.798+0000 7fa1adffb700 1 -- 172.21.15.72:0/2711816845 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a801f070 con 0x7fa1b8136710 2023-10-03T10:14:39.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.798+0000 7fa1bf587700 1 -- 172.21.15.72:0/2711816845 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a8009550 con 0x7fa1b8136710 2023-10-03T10:14:39.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.798+0000 7fa1adffb700 1 -- 172.21.15.72:0/2711816845 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a80038c0 con 0x7fa1b8136710 2023-10-03T10:14:39.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.798+0000 7fa1bf587700 1 -- 172.21.15.72:0/2711816845 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b811f060 con 0x7fa1b8136710 2023-10-03T10:14:39.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.798+0000 7fa1adffb700 1 -- 172.21.15.72:0/2711816845 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1a8021030 con 0x7fa1b8136710 2023-10-03T10:14:39.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.799+0000 7fa1adffb700 1 -- 172.21.15.72:0/2711816845 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa1a80409b0 con 0x7fa1b8136710 2023-10-03T10:14:39.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.799+0000 7fa1bf587700 1 -- 172.21.15.72:0/2711816845 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b8074ea0 con 0x7fa1b8136710 2023-10-03T10:14:39.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.803+0000 7fa1adffb700 1 -- 172.21.15.72:0/2711816845 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1a8015080 con 0x7fa1b8136710 2023-10-03T10:14:39.847 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:39.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.928+0000 7f0dcb7f7700 1 Processor -- start 2023-10-03T10:14:39.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.928+0000 7f0dcb7f7700 1 -- start start 2023-10-03T10:14:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dcb7f7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0dc409f410 0x7f0dc4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dcb7f7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0dc4136fe0 0x7f0dc41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dcb7f7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc4070940 con 0x7f0dc409e930 2023-10-03T10:14:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dcb7f7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc406fd60 con 0x7f0dc409f410 2023-10-03T10:14:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dcb7f7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc406fa80 con 0x7f0dc4136fe0 2023-10-03T10:14:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dc9d94700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0dc4136fe0 0x7f0dc41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dc8d92700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0dc409f410 0x7f0dc4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dc8d92700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0dc409f410 0x7f0dc4136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43416/0 (socket says 172.21.15.72:43416) 2023-10-03T10:14:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dc9d94700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0dc4136fe0 0x7f0dc41393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51972/0 (socket says 172.21.15.72:51972) 2023-10-03T10:14:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dc8d92700 1 -- 172.21.15.72:0/2958780950 learned_addr learned my addr 172.21.15.72:0/2958780950 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dc9593700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0dc409e930 0x7f0dc409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43866/0 (socket says 172.21.15.72:43866) 2023-10-03T10:14:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dc8d92700 1 -- 172.21.15.72:0/2958780950 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0dc4136fe0 msgr2=0x7f0dc41393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dc8d92700 1 --2- 172.21.15.72:0/2958780950 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0dc4136fe0 0x7f0dc41393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dc8d92700 1 -- 172.21.15.72:0/2958780950 >> v1:172.21.15.72:6789/0 conn(0x7f0dc409e930 legacy=0x7f0dc409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dc8d92700 1 -- 172.21.15.72:0/2958780950 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc409fb60 con 0x7f0dc409f410 2023-10-03T10:14:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dbbfff700 1 -- 172.21.15.72:0/2958780950 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623253650 0 0) 0x7f0dc4070940 con 0x7f0dc409e930 2023-10-03T10:14:39.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dc9d94700 1 --2- 172.21.15.72:0/2958780950 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0dc4136fe0 0x7f0dc41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.929+0000 7f0dc8d92700 1 --2- 172.21.15.72:0/2958780950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc409f410 0x7f0dc4136aa0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0db40098f0 tx=0x7f0db4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ebe94e0c971502 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.930+0000 7f0dbbfff700 1 -- 172.21.15.72:0/2958780950 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4011830 con 0x7f0dc409f410 2023-10-03T10:14:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.930+0000 7f0dbbfff700 1 -- 172.21.15.72:0/2958780950 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db4011990 con 0x7f0dc409f410 2023-10-03T10:14:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.930+0000 7f0dbbfff700 1 -- 172.21.15.72:0/2958780950 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4011d20 con 0x7f0dc409f410 2023-10-03T10:14:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.930+0000 7f0dcb7f7700 1 -- 172.21.15.72:0/2958780950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc409f410 msgr2=0x7f0dc4136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.930+0000 7f0dcb7f7700 1 --2- 172.21.15.72:0/2958780950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc409f410 0x7f0dc4136aa0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0db40098f0 tx=0x7f0db4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.930+0000 7f0dcb7f7700 1 -- 172.21.15.72:0/2958780950 shutdown_connections 2023-10-03T10:14:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.930+0000 7f0dcb7f7700 1 --2- 172.21.15.72:0/2958780950 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0dc4136fe0 0x7f0dc41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.930+0000 7f0dcb7f7700 1 --2- 172.21.15.72:0/2958780950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc409f410 0x7f0dc4136aa0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.930+0000 7f0dcb7f7700 1 -- 172.21.15.72:0/2958780950 >> 172.21.15.72:0/2958780950 conn(0x7f0dc40a4210 msgr2=0x7f0dc40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.930+0000 7f0dcb7f7700 1 -- 172.21.15.72:0/2958780950 shutdown_connections 2023-10-03T10:14:39.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.930+0000 7f0dcb7f7700 1 -- 172.21.15.72:0/2958780950 wait complete. 2023-10-03T10:14:39.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.931+0000 7f0dcb7f7700 1 Processor -- start 2023-10-03T10:14:39.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.931+0000 7f0dcb7f7700 1 -- start start 2023-10-03T10:14:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dcb7f7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0dc409e930 0x7f0dc411c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dcb7f7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0dc409f410 0x7f0dc411ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dcb7f7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc4136fe0 0x7f0dc411cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dcb7f7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc4131df0 con 0x7f0dc4136fe0 2023-10-03T10:14:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dcb7f7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc41323b0 con 0x7f0dc409f410 2023-10-03T10:14:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dcb7f7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc411ffe0 con 0x7f0dc409e930 2023-10-03T10:14:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dc8d92700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0dc409f410 0x7f0dc411ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dc9593700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0dc409e930 0x7f0dc411c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dc8d92700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0dc409f410 0x7f0dc411ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39936/0 (socket says 172.21.15.72:39936) 2023-10-03T10:14:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dc9593700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0dc409e930 0x7f0dc411c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51980/0 (socket says 172.21.15.72:51980) 2023-10-03T10:14:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dc8d92700 1 -- 172.21.15.72:0/235971800 learned_addr learned my addr 172.21.15.72:0/235971800 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dc9d94700 1 --2- 172.21.15.72:0/235971800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc4136fe0 0x7f0dc411cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dc9d94700 1 -- 172.21.15.72:0/235971800 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0dc409e930 msgr2=0x7f0dc411c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dc9d94700 1 --2- 172.21.15.72:0/235971800 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0dc409e930 0x7f0dc411c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dc9d94700 1 -- 172.21.15.72:0/235971800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0dc409f410 msgr2=0x7f0dc411ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dc9d94700 1 --2- 172.21.15.72:0/235971800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0dc409f410 0x7f0dc411ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dc9d94700 1 -- 172.21.15.72:0/235971800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc009a70 con 0x7f0dc4136fe0 2023-10-03T10:14:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dc9593700 1 --2- 172.21.15.72:0/235971800 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0dc409e930 0x7f0dc411c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:39.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0dc9d94700 1 --2- 172.21.15.72:0/235971800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc4136fe0 0x7f0dc411cf90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00efc0 tx=0x7f0dbc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.932+0000 7f0db9ffb700 1 -- 172.21.15.72:0/235971800 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00cc90 con 0x7f0dc4136fe0 2023-10-03T10:14:39.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.933+0000 7f0db9ffb700 1 -- 172.21.15.72:0/235971800 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc00f040 con 0x7f0dc4136fe0 2023-10-03T10:14:39.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.933+0000 7f0dcb7f7700 1 -- 172.21.15.72:0/235971800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db4009550 con 0x7f0dc4136fe0 2023-10-03T10:14:39.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.933+0000 7f0db9ffb700 1 -- 172.21.15.72:0/235971800 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc014480 con 0x7f0dc4136fe0 2023-10-03T10:14:39.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.933+0000 7f0dcb7f7700 1 -- 172.21.15.72:0/235971800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc4071d20 con 0x7f0dc4136fe0 2023-10-03T10:14:39.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.934+0000 7f0db9ffb700 1 -- 172.21.15.72:0/235971800 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0dbc0145e0 con 0x7f0dc4136fe0 2023-10-03T10:14:39.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.934+0000 7f0db9ffb700 1 -- 172.21.15.72:0/235971800 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0dbc0403d0 con 0x7f0dc4136fe0 2023-10-03T10:14:39.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.934+0000 7f0dcb7f7700 1 -- 172.21.15.72:0/235971800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc4074ea0 con 0x7f0dc4136fe0 2023-10-03T10:14:39.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.939+0000 7f0db9ffb700 1 -- 172.21.15.72:0/235971800 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0dbc012520 con 0x7f0dc4136fe0 2023-10-03T10:14:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.971+0000 7f1feb786700 1 Processor -- start 2023-10-03T10:14:39.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.972+0000 7f1feb786700 1 -- start start 2023-10-03T10:14:39.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.972+0000 7f1feb786700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1fe40a0a30 0x7f1fe40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.972+0000 7f1feb786700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe409d630 0x7f1fe40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.972+0000 7f1feb786700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe4133930 0x7f1fe4133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.972+0000 7f1feb786700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe40a2a70 con 0x7f1fe40a0a30 2023-10-03T10:14:39.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.972+0000 7f1feb786700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40a01d0 con 0x7f1fe409d630 2023-10-03T10:14:39.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.972+0000 7f1feb786700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe409e2b0 con 0x7f1fe4133930 2023-10-03T10:14:39.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.972+0000 7f1fe8d21700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe409d630 0x7f1fe40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.972+0000 7f1fe9d23700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe4133930 0x7f1fe4133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.972+0000 7f1fe9522700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1fe40a0a30 0x7f1fe40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.973+0000 7f1fe9d23700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe4133930 0x7f1fe4133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51984/0 (socket says 172.21.15.72:51984) 2023-10-03T10:14:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.973+0000 7f1fe9522700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1fe40a0a30 0x7f1fe40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43446/0 (socket says 172.21.15.72:43446) 2023-10-03T10:14:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.973+0000 7f1fe8d21700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe409d630 0x7f1fe40a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39942/0 (socket says 172.21.15.72:39942) 2023-10-03T10:14:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.973+0000 7f1fe9d23700 1 -- 172.21.15.72:0/4203273937 learned_addr learned my addr 172.21.15.72:0/4203273937 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.973+0000 7f1fe9d23700 1 -- 172.21.15.72:0/4203273937 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe409d630 msgr2=0x7f1fe40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.973+0000 7f1fe9d23700 1 --2- 172.21.15.72:0/4203273937 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe409d630 0x7f1fe40a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.973+0000 7f1fe9d23700 1 -- 172.21.15.72:0/4203273937 >> v2:172.21.15.72:3300/0 conn(0x7f1fe40a0a30 msgr2=0x7f1fe40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.973+0000 7f1fe9d23700 1 --2- 172.21.15.72:0/4203273937 >> v2:172.21.15.72:3300/0 conn(0x7f1fe40a0a30 0x7f1fe40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.973+0000 7f1fe9d23700 1 -- 172.21.15.72:0/4203273937 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe409dc50 con 0x7f1fe4133930 2023-10-03T10:14:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.973+0000 7f1fe8d21700 1 --2- 172.21.15.72:0/4203273937 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe409d630 0x7f1fe40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:39.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.973+0000 7f1fe9d23700 1 --2- 172.21.15.72:0/4203273937 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe4133930 0x7f1fe4133db0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009e50 tx=0x7f1fdc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca901cedcc79456b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.973+0000 7f1fdbfff700 1 -- 172.21.15.72:0/4203273937 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc00e070 con 0x7f1fe4133930 2023-10-03T10:14:39.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.973+0000 7f1fdbfff700 1 -- 172.21.15.72:0/4203273937 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc00b910 con 0x7f1fe4133930 2023-10-03T10:14:39.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.973+0000 7f1fdbfff700 1 -- 172.21.15.72:0/4203273937 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc00bcc0 con 0x7f1fe4133930 2023-10-03T10:14:39.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.974+0000 7f1feb786700 1 -- 172.21.15.72:0/4203273937 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe4133930 msgr2=0x7f1fe4133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.974+0000 7f1feb786700 1 --2- 172.21.15.72:0/4203273937 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe4133930 0x7f1fe4133db0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009e50 tx=0x7f1fdc00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:39.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.974+0000 7f1feb786700 1 -- 172.21.15.72:0/4203273937 shutdown_connections 2023-10-03T10:14:39.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.974+0000 7f1feb786700 1 --2- 172.21.15.72:0/4203273937 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe4133930 0x7f1fe4133db0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.974+0000 7f1feb786700 1 --2- 172.21.15.72:0/4203273937 >> v2:172.21.15.72:3300/0 conn(0x7f1fe40a0a30 0x7f1fe40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.974+0000 7f1feb786700 1 --2- 172.21.15.72:0/4203273937 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe409d630 0x7f1fe40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.974+0000 7f1feb786700 1 -- 172.21.15.72:0/4203273937 >> 172.21.15.72:0/4203273937 conn(0x7f1fe40a3050 msgr2=0x7f1fe40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.974+0000 7f1feb786700 1 -- 172.21.15.72:0/4203273937 shutdown_connections 2023-10-03T10:14:39.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.974+0000 7f1feb786700 1 -- 172.21.15.72:0/4203273937 wait complete. 2023-10-03T10:14:39.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.975+0000 7f1feb786700 1 Processor -- start 2023-10-03T10:14:39.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.975+0000 7f1feb786700 1 -- start start 2023-10-03T10:14:39.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1feb786700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe409d630 0x7f1fe41c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1feb786700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe40a0a30 0x7f1fe41c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1feb786700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe4133930 0x7f1fe41c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1feb786700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4122720 con 0x7f1fe4133930 2023-10-03T10:14:39.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1feb786700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe41209b0 con 0x7f1fe409d630 2023-10-03T10:14:39.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1feb786700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4120780 con 0x7f1fe40a0a30 2023-10-03T10:14:39.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1fe9522700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe409d630 0x7f1fe41c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1fe9522700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe409d630 0x7f1fe41c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39948/0 (socket says 172.21.15.72:39948) 2023-10-03T10:14:39.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1fe9522700 1 -- 172.21.15.72:0/3243889276 learned_addr learned my addr 172.21.15.72:0/3243889276 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:39.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1fe8d21700 1 --2- 172.21.15.72:0/3243889276 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe40a0a30 0x7f1fe41c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1fe9d23700 1 --2- 172.21.15.72:0/3243889276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe4133930 0x7f1fe41c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1fe9522700 1 -- 172.21.15.72:0/3243889276 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe40a0a30 msgr2=0x7f1fe41c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1fe9522700 1 --2- 172.21.15.72:0/3243889276 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe40a0a30 0x7f1fe41c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1fe9522700 1 -- 172.21.15.72:0/3243889276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe4133930 msgr2=0x7f1fe41c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1fe9522700 1 --2- 172.21.15.72:0/3243889276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe4133930 0x7f1fe41c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1fe9522700 1 -- 172.21.15.72:0/3243889276 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd40094a0 con 0x7f1fe409d630 2023-10-03T10:14:39.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.976+0000 7f1fe9522700 1 --2- 172.21.15.72:0/3243889276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe409d630 0x7f1fe41c8090 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000e9b0 tx=0x7f1fe000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.977+0000 7f1fd9ffb700 1 -- 172.21.15.72:0/3243889276 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0009710 con 0x7f1fe409d630 2023-10-03T10:14:39.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.977+0000 7f1fd9ffb700 1 -- 172.21.15.72:0/3243889276 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe000ee50 con 0x7f1fe409d630 2023-10-03T10:14:39.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.977+0000 7f1feb786700 1 -- 172.21.15.72:0/3243889276 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc009b30 con 0x7f1fe409d630 2023-10-03T10:14:39.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.977+0000 7f1fd9ffb700 1 -- 172.21.15.72:0/3243889276 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe000ca50 con 0x7f1fe409d630 2023-10-03T10:14:39.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.977+0000 7f1feb786700 1 -- 172.21.15.72:0/3243889276 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe4121700 con 0x7f1fe409d630 2023-10-03T10:14:39.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.977+0000 7f1fd9ffb700 1 -- 172.21.15.72:0/3243889276 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fe000cbb0 con 0x7f1fe409d630 2023-10-03T10:14:39.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.978+0000 7f1fd9ffb700 1 -- 172.21.15.72:0/3243889276 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1fe003f610 con 0x7f1fe409d630 2023-10-03T10:14:39.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.978+0000 7f1feb786700 1 -- 172.21.15.72:0/3243889276 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe40747f0 con 0x7f1fe409d630 2023-10-03T10:14:39.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:39.983+0000 7f1fd9ffb700 1 -- 172.21.15.72:0/3243889276 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fe0013470 con 0x7f1fe409d630 2023-10-03T10:14:40.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.018+0000 7fa1bf587700 1 -- 172.21.15.72:0/2711816845 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa1b806b9e0 con 0x7fa1b8136710 2023-10-03T10:14:40.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.019+0000 7fa1adffb700 1 -- 172.21.15.72:0/2711816845 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa1a8004560 con 0x7fa1b8136710 2023-10-03T10:14:40.019 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:40.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.022+0000 7fa1bf587700 1 -- 172.21.15.72:0/2711816845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1b8136710 msgr2=0x7fa1b811b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.022+0000 7fa1bf587700 1 --2- 172.21.15.72:0/2711816845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1b8136710 0x7fa1b811b390 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8000c00 tx=0x7fa1a8004750 comp rx=0 tx=0).stop 2023-10-03T10:14:40.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.022+0000 7fa1bf587700 1 -- 172.21.15.72:0/2711816845 shutdown_connections 2023-10-03T10:14:40.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.022+0000 7fa1bf587700 1 --2- 172.21.15.72:0/2711816845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1b8139030 0x7fa1b811b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.022+0000 7fa1bf587700 1 --2- 172.21.15.72:0/2711816845 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1b81338a0 0x7fa1b811ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.022+0000 7fa1bf587700 1 --2- 172.21.15.72:0/2711816845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1b8136710 0x7fa1b811b390 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.022+0000 7fa1bf587700 1 -- 172.21.15.72:0/2711816845 >> 172.21.15.72:0/2711816845 conn(0x7fa1b80a2aa0 msgr2=0x7fa1b8137360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.022+0000 7fa1bf587700 1 -- 172.21.15.72:0/2711816845 shutdown_connections 2023-10-03T10:14:40.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.022+0000 7fa1bf587700 1 -- 172.21.15.72:0/2711816845 wait complete. 2023-10-03T10:14:40.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:40.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.138+0000 7f0dcb7f7700 1 -- 172.21.15.72:0/235971800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0dc406b250 con 0x7f0dc4136fe0 2023-10-03T10:14:40.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.138+0000 7f0db9ffb700 1 -- 172.21.15.72:0/235971800 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0dbc018020 con 0x7f0dc4136fe0 2023-10-03T10:14:40.139 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.140+0000 7f0dcb7f7700 1 -- 172.21.15.72:0/235971800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc4136fe0 msgr2=0x7f0dc411cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.140+0000 7f0dcb7f7700 1 --2- 172.21.15.72:0/235971800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc4136fe0 0x7f0dc411cf90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00efc0 tx=0x7f0dbc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.140+0000 7f0dcb7f7700 1 -- 172.21.15.72:0/235971800 shutdown_connections 2023-10-03T10:14:40.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.140+0000 7f0dcb7f7700 1 --2- 172.21.15.72:0/235971800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc4136fe0 0x7f0dc411cf90 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.140+0000 7f0dcb7f7700 1 --2- 172.21.15.72:0/235971800 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0dc409e930 0x7f0dc411c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.140+0000 7f0dcb7f7700 1 --2- 172.21.15.72:0/235971800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0dc409f410 0x7f0dc411ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.140+0000 7f0dcb7f7700 1 -- 172.21.15.72:0/235971800 >> 172.21.15.72:0/235971800 conn(0x7f0dc40a4210 msgr2=0x7f0dc4134b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.141+0000 7f0dcb7f7700 1 -- 172.21.15.72:0/235971800 shutdown_connections 2023-10-03T10:14:40.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.141+0000 7f0dcb7f7700 1 -- 172.21.15.72:0/235971800 wait complete. 2023-10-03T10:14:40.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.194+0000 7f1feb786700 1 -- 172.21.15.72:0/3243889276 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1fe4122580 con 0x7f1fe409d630 2023-10-03T10:14:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.194+0000 7f1fd9ffb700 1 -- 172.21.15.72:0/3243889276 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1fe4122580 con 0x7f1fe409d630 2023-10-03T10:14:40.195 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:40.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.196+0000 7f1feb786700 1 -- 172.21.15.72:0/3243889276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe409d630 msgr2=0x7f1fe41c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.196+0000 7f1feb786700 1 --2- 172.21.15.72:0/3243889276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe409d630 0x7f1fe41c8090 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000e9b0 tx=0x7f1fe000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.197+0000 7f1feb786700 1 -- 172.21.15.72:0/3243889276 shutdown_connections 2023-10-03T10:14:40.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.197+0000 7f1feb786700 1 --2- 172.21.15.72:0/3243889276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe4133930 0x7f1fe41c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.197+0000 7f1feb786700 1 --2- 172.21.15.72:0/3243889276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe409d630 0x7f1fe41c8090 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.197+0000 7f1feb786700 1 --2- 172.21.15.72:0/3243889276 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe40a0a30 0x7f1fe41c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.197+0000 7f1feb786700 1 -- 172.21.15.72:0/3243889276 >> 172.21.15.72:0/3243889276 conn(0x7f1fe40a3050 msgr2=0x7f1fe409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.197+0000 7f1feb786700 1 -- 172.21.15.72:0/3243889276 shutdown_connections 2023-10-03T10:14:40.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.197+0000 7f1feb786700 1 -- 172.21.15.72:0/3243889276 wait complete. 2023-10-03T10:14:40.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:40.612 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:40.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.735+0000 7fb24a114700 1 Processor -- start 2023-10-03T10:14:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.735+0000 7fb24a114700 1 -- start start 2023-10-03T10:14:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.735+0000 7fb24a114700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb244133540 0x7fb244135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.735+0000 7fb24a114700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb244135e60 0x7fb244138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.735+0000 7fb24a114700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2440716a0 con 0x7fb244130540 2023-10-03T10:14:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.735+0000 7fb24a114700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb244071290 con 0x7fb244135e60 2023-10-03T10:14:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.735+0000 7fb24a114700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb244130340 con 0x7fb244133540 2023-10-03T10:14:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.736+0000 7fb242ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb244133540 0x7fb244135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.736+0000 7fb242ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb244133540 0x7fb244135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52000/0 (socket says 172.21.15.72:52000) 2023-10-03T10:14:40.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.736+0000 7fb243fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb244135e60 0x7fb244138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.736+0000 7fb242ffd700 1 -- 172.21.15.72:0/1544115001 learned_addr learned my addr 172.21.15.72:0/1544115001 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:40.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.736+0000 7fb243fff700 1 -- 172.21.15.72:0/1544115001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb244133540 msgr2=0x7fb244135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:40.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.736+0000 7fb243fff700 1 --2- 172.21.15.72:0/1544115001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb244133540 0x7fb244135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.736+0000 7fb243fff700 1 -- 172.21.15.72:0/1544115001 >> v1:172.21.15.72:6789/0 conn(0x7fb244130540 legacy=0x7fb244130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.736+0000 7fb243fff700 1 -- 172.21.15.72:0/1544115001 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb244070b80 con 0x7fb244135e60 2023-10-03T10:14:40.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.736+0000 7fb242ffd700 1 --2- 172.21.15.72:0/1544115001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb244133540 0x7fb244135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:40.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.736+0000 7fb243fff700 1 --2- 172.21.15.72:0/1544115001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244135e60 0x7fb244138240 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009d90 tx=0x7fb23c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8f41d01a198767 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.736+0000 7fb2427fc700 1 -- 172.21.15.72:0/1544115001 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c00e070 con 0x7fb244135e60 2023-10-03T10:14:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.736+0000 7fb2427fc700 1 -- 172.21.15.72:0/1544115001 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c00bb20 con 0x7fb244135e60 2023-10-03T10:14:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.736+0000 7fb2427fc700 1 -- 172.21.15.72:0/1544115001 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c012430 con 0x7fb244135e60 2023-10-03T10:14:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.737+0000 7fb24a114700 1 -- 172.21.15.72:0/1544115001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244135e60 msgr2=0x7fb244138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.737+0000 7fb24a114700 1 --2- 172.21.15.72:0/1544115001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244135e60 0x7fb244138240 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009d90 tx=0x7fb23c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.737+0000 7fb24a114700 1 -- 172.21.15.72:0/1544115001 shutdown_connections 2023-10-03T10:14:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.737+0000 7fb24a114700 1 --2- 172.21.15.72:0/1544115001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244135e60 0x7fb244138240 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.737+0000 7fb24a114700 1 --2- 172.21.15.72:0/1544115001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb244133540 0x7fb244135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.737+0000 7fb24a114700 1 -- 172.21.15.72:0/1544115001 >> 172.21.15.72:0/1544115001 conn(0x7fb2440a2aa0 msgr2=0x7fb2440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.737+0000 7fb24a114700 1 -- 172.21.15.72:0/1544115001 shutdown_connections 2023-10-03T10:14:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.737+0000 7fb24a114700 1 -- 172.21.15.72:0/1544115001 wait complete. 2023-10-03T10:14:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.738+0000 7fb24a114700 1 Processor -- start 2023-10-03T10:14:40.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.738+0000 7fb24a114700 1 -- start start 2023-10-03T10:14:40.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.738+0000 7fb24a114700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb244130540 0x7fb2441342a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.738+0000 7fb24a114700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb244133540 0x7fb2441347e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.738+0000 7fb24a114700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244135e60 0x7fb2441c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:40.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.738+0000 7fb24a114700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24412d910 con 0x7fb244135e60 2023-10-03T10:14:40.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.738+0000 7fb24a114700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb244133e00 con 0x7fb244133540 2023-10-03T10:14:40.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.738+0000 7fb24a114700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb244135550 con 0x7fb244130540 2023-10-03T10:14:40.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.738+0000 7fb2437fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb244130540 0x7fb2441342a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.738+0000 7fb243fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244135e60 0x7fb2441c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.738+0000 7fb2437fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb244130540 0x7fb2441342a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52004/0 (socket says 172.21.15.72:52004) 2023-10-03T10:14:40.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.738+0000 7fb2437fe700 1 -- 172.21.15.72:0/699174312 learned_addr learned my addr 172.21.15.72:0/699174312 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:40.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.738+0000 7fb242ffd700 1 --2- 172.21.15.72:0/699174312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb244133540 0x7fb2441347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:40.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.739+0000 7fb2437fe700 1 -- 172.21.15.72:0/699174312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb244133540 msgr2=0x7fb2441347e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.739+0000 7fb2437fe700 1 --2- 172.21.15.72:0/699174312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb244133540 0x7fb2441347e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.739+0000 7fb2437fe700 1 -- 172.21.15.72:0/699174312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244135e60 msgr2=0x7fb2441c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.739+0000 7fb2437fe700 1 --2- 172.21.15.72:0/699174312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244135e60 0x7fb2441c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.739+0000 7fb2437fe700 1 -- 172.21.15.72:0/699174312 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c009550 con 0x7fb244130540 2023-10-03T10:14:40.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.739+0000 7fb243fff700 1 --2- 172.21.15.72:0/699174312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244135e60 0x7fb2441c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:40.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.739+0000 7fb242ffd700 1 --2- 172.21.15.72:0/699174312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb244133540 0x7fb2441347e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:40.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.739+0000 7fb2437fe700 1 --2- 172.21.15.72:0/699174312 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb244130540 0x7fb2441342a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb23400c450 tx=0x7fb23400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:40.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.739+0000 7fb23bfff700 1 -- 172.21.15.72:0/699174312 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2340052d0 con 0x7fb244130540 2023-10-03T10:14:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.739+0000 7fb23bfff700 1 -- 172.21.15.72:0/699174312 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb234005430 con 0x7fb244130540 2023-10-03T10:14:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.739+0000 7fb24a114700 1 -- 172.21.15.72:0/699174312 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23c009a70 con 0x7fb244130540 2023-10-03T10:14:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.739+0000 7fb23bfff700 1 -- 172.21.15.72:0/699174312 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2340038c0 con 0x7fb244130540 2023-10-03T10:14:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.739+0000 7fb24a114700 1 -- 172.21.15.72:0/699174312 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2440718e0 con 0x7fb244130540 2023-10-03T10:14:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.740+0000 7fb23bfff700 1 -- 172.21.15.72:0/699174312 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb234003a20 con 0x7fb244130540 2023-10-03T10:14:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.740+0000 7fb23bfff700 1 -- 172.21.15.72:0/699174312 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb23403e9e0 con 0x7fb244130540 2023-10-03T10:14:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.740+0000 7fb24a114700 1 -- 172.21.15.72:0/699174312 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24411e440 con 0x7fb244130540 2023-10-03T10:14:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.745+0000 7fb23bfff700 1 -- 172.21.15.72:0/699174312 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb24411e440 con 0x7fb244130540 2023-10-03T10:14:40.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.930+0000 7fb24a114700 1 -- 172.21.15.72:0/699174312 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb24411e440 con 0x7fb244130540 2023-10-03T10:14:40.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.930+0000 7fb23bfff700 1 -- 172.21.15.72:0/699174312 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb24411e440 con 0x7fb244130540 2023-10-03T10:14:40.931 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.932+0000 7fb24a114700 1 -- 172.21.15.72:0/699174312 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb244130540 msgr2=0x7fb2441342a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.932+0000 7fb24a114700 1 --2- 172.21.15.72:0/699174312 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb244130540 0x7fb2441342a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb23400c450 tx=0x7fb23400c760 comp rx=0 tx=0).stop 2023-10-03T10:14:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.932+0000 7fb24a114700 1 -- 172.21.15.72:0/699174312 shutdown_connections 2023-10-03T10:14:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.932+0000 7fb24a114700 1 --2- 172.21.15.72:0/699174312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244135e60 0x7fb2441c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.932+0000 7fb24a114700 1 --2- 172.21.15.72:0/699174312 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb244130540 0x7fb2441342a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.932+0000 7fb24a114700 1 --2- 172.21.15.72:0/699174312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb244133540 0x7fb2441347e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.932+0000 7fb24a114700 1 -- 172.21.15.72:0/699174312 >> 172.21.15.72:0/699174312 conn(0x7fb2440a2aa0 msgr2=0x7fb24412e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.932+0000 7fb24a114700 1 -- 172.21.15.72:0/699174312 shutdown_connections 2023-10-03T10:14:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:40.932+0000 7fb24a114700 1 -- 172.21.15.72:0/699174312 wait complete. 2023-10-03T10:14:40.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:41.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:41.154 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:41.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.159+0000 7fa74279c700 1 Processor -- start 2023-10-03T10:14:41.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.159+0000 7fa74279c700 1 -- start start 2023-10-03T10:14:41.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.159+0000 7fa74279c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73c131810 0x7fa73c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.159+0000 7fa74279c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73c099a40 0x7fa73c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.159+0000 7fa74279c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c1313c0 con 0x7fa73c09a3b0 2023-10-03T10:14:41.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.159+0000 7fa74279c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c09b580 con 0x7fa73c131810 2023-10-03T10:14:41.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.159+0000 7fa74279c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c06e8c0 con 0x7fa73c099a40 2023-10-03T10:14:41.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.159+0000 7fa73b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73c099a40 0x7fa73c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.159+0000 7fa73bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73c131810 0x7fa73c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.159+0000 7fa73b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73c099a40 0x7fa73c099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52008/0 (socket says 172.21.15.72:52008) 2023-10-03T10:14:41.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.159+0000 7fa73b7fe700 1 -- 172.21.15.72:0/1052325218 learned_addr learned my addr 172.21.15.72:0/1052325218 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:41.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.160+0000 7fa73affd700 1 -- 172.21.15.72:0/1052325218 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358692880 0 0) 0x7fa73c1313c0 con 0x7fa73c09a3b0 2023-10-03T10:14:41.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.160+0000 7fa73b7fe700 1 -- 172.21.15.72:0/1052325218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73c131810 msgr2=0x7fa73c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.160+0000 7fa73b7fe700 1 --2- 172.21.15.72:0/1052325218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73c131810 0x7fa73c131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.160+0000 7fa73b7fe700 1 -- 172.21.15.72:0/1052325218 >> v1:172.21.15.72:6789/0 conn(0x7fa73c09a3b0 legacy=0x7fa73c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.160+0000 7fa73b7fe700 1 -- 172.21.15.72:0/1052325218 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c09a820 con 0x7fa73c099a40 2023-10-03T10:14:41.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.160+0000 7fa73bfff700 1 --2- 172.21.15.72:0/1052325218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73c131810 0x7fa73c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:41.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.160+0000 7fa73b7fe700 1 --2- 172.21.15.72:0/1052325218 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73c099a40 0x7fa73c099e70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa730009920 tx=0x7fa730009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d98d80d24bd6a5b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.160+0000 7fa73affd700 1 -- 172.21.15.72:0/1052325218 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73000ba60 con 0x7fa73c099a40 2023-10-03T10:14:41.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.160+0000 7fa73affd700 1 -- 172.21.15.72:0/1052325218 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73000bbc0 con 0x7fa73c099a40 2023-10-03T10:14:41.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.160+0000 7fa73affd700 1 -- 172.21.15.72:0/1052325218 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730009e70 con 0x7fa73c099a40 2023-10-03T10:14:41.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.161+0000 7fa74279c700 1 -- 172.21.15.72:0/1052325218 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73c099a40 msgr2=0x7fa73c099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.161+0000 7fa74279c700 1 --2- 172.21.15.72:0/1052325218 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73c099a40 0x7fa73c099e70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa730009920 tx=0x7fa730009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:41.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.161+0000 7fa74279c700 1 -- 172.21.15.72:0/1052325218 shutdown_connections 2023-10-03T10:14:41.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.161+0000 7fa74279c700 1 --2- 172.21.15.72:0/1052325218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73c131810 0x7fa73c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.161+0000 7fa74279c700 1 --2- 172.21.15.72:0/1052325218 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73c099a40 0x7fa73c099e70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.161+0000 7fa74279c700 1 -- 172.21.15.72:0/1052325218 >> 172.21.15.72:0/1052325218 conn(0x7fa73c0a2aa0 msgr2=0x7fa73c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.161+0000 7fa74279c700 1 -- 172.21.15.72:0/1052325218 shutdown_connections 2023-10-03T10:14:41.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.161+0000 7fa74279c700 1 -- 172.21.15.72:0/1052325218 wait complete. 2023-10-03T10:14:41.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.162+0000 7fa74279c700 1 Processor -- start 2023-10-03T10:14:41.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.162+0000 7fa74279c700 1 -- start start 2023-10-03T10:14:41.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.162+0000 7fa74279c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73c099a40 0x7fa73c119510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.162+0000 7fa74279c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73c09a3b0 0x7fa73c119a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.162+0000 7fa74279c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73c131810 0x7fa73c119f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.162+0000 7fa74279c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c11d9f0 con 0x7fa73c09a3b0 2023-10-03T10:14:41.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.162+0000 7fa74279c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c11bf20 con 0x7fa73c131810 2023-10-03T10:14:41.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.162+0000 7fa74279c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c11b1c0 con 0x7fa73c099a40 2023-10-03T10:14:41.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.162+0000 7fa73bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73c099a40 0x7fa73c119510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.162+0000 7fa740d39700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73c131810 0x7fa73c119f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.162+0000 7fa73bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73c099a40 0x7fa73c119510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52014/0 (socket says 172.21.15.72:52014) 2023-10-03T10:14:41.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.162+0000 7fa73bfff700 1 -- 172.21.15.72:0/3853181402 learned_addr learned my addr 172.21.15.72:0/3853181402 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:41.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.162+0000 7fa740d39700 1 --2- 172.21.15.72:0/3853181402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73c131810 0x7fa73c119f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39976/0 (socket says 172.21.15.72:39976) 2023-10-03T10:14:41.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.162+0000 7fa73b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73c09a3b0 0x7fa73c119a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.163+0000 7fa73bfff700 1 -- 172.21.15.72:0/3853181402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73c131810 msgr2=0x7fa73c119f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.163+0000 7fa73bfff700 1 --2- 172.21.15.72:0/3853181402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73c131810 0x7fa73c119f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.163+0000 7fa73bfff700 1 -- 172.21.15.72:0/3853181402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73c09a3b0 msgr2=0x7fa73c119a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.163+0000 7fa73bfff700 1 --2- 172.21.15.72:0/3853181402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73c09a3b0 0x7fa73c119a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.163+0000 7fa73bfff700 1 -- 172.21.15.72:0/3853181402 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa730009550 con 0x7fa73c099a40 2023-10-03T10:14:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.163+0000 7fa740d39700 1 --2- 172.21.15.72:0/3853181402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73c131810 0x7fa73c119f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.163+0000 7fa73b7fe700 1 --2- 172.21.15.72:0/3853181402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73c09a3b0 0x7fa73c119a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.163+0000 7fa73bfff700 1 --2- 172.21.15.72:0/3853181402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73c099a40 0x7fa73c119510 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00bb80 tx=0x7fa72c00be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.163+0000 7fa738ff9700 1 -- 172.21.15.72:0/3853181402 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c011a90 con 0x7fa73c099a40 2023-10-03T10:14:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.163+0000 7fa738ff9700 1 -- 172.21.15.72:0/3853181402 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c013040 con 0x7fa73c099a40 2023-10-03T10:14:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.163+0000 7fa74279c700 1 -- 172.21.15.72:0/3853181402 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c1307a0 con 0x7fa73c099a40 2023-10-03T10:14:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.163+0000 7fa738ff9700 1 -- 172.21.15.72:0/3853181402 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c011df0 con 0x7fa73c099a40 2023-10-03T10:14:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.163+0000 7fa74279c700 1 -- 172.21.15.72:0/3853181402 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c11d030 con 0x7fa73c099a40 2023-10-03T10:14:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.164+0000 7fa738ff9700 1 -- 172.21.15.72:0/3853181402 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa72c021460 con 0x7fa73c099a40 2023-10-03T10:14:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.164+0000 7fa738ff9700 1 -- 172.21.15.72:0/3853181402 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa72c0435d0 con 0x7fa73c099a40 2023-10-03T10:14:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.164+0000 7fa74279c700 1 -- 172.21.15.72:0/3853181402 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c074ea0 con 0x7fa73c099a40 2023-10-03T10:14:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.169+0000 7fa738ff9700 1 -- 172.21.15.72:0/3853181402 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa72c0218f0 con 0x7fa73c099a40 2023-10-03T10:14:41.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:41.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.279+0000 7f6bf267e700 1 Processor -- start 2023-10-03T10:14:41.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.279+0000 7f6bf267e700 1 -- start start 2023-10-03T10:14:41.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.279+0000 7f6bf267e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bec0a0a30 0x7f6bec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.279+0000 7f6bf267e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bec09d630 0x7f6bec0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.279+0000 7f6bf267e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6bec133930 0x7f6bec133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.279+0000 7f6bf267e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec0a2a70 con 0x7f6bec133930 2023-10-03T10:14:41.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.279+0000 7f6bf267e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0a01d0 con 0x7f6bec0a0a30 2023-10-03T10:14:41.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.279+0000 7f6bf267e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec09e2b0 con 0x7f6bec09d630 2023-10-03T10:14:41.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.279+0000 7f6beb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bec09d630 0x7f6bec0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.279+0000 7f6beb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bec09d630 0x7f6bec0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52016/0 (socket says 172.21.15.72:52016) 2023-10-03T10:14:41.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.279+0000 7f6beb7fe700 1 -- 172.21.15.72:0/4134281124 learned_addr learned my addr 172.21.15.72:0/4134281124 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:41.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.280+0000 7f6bf0c1b700 1 --2- 172.21.15.72:0/4134281124 >> v2:172.21.15.72:3300/0 conn(0x7f6bec133930 0x7f6bec133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.280+0000 7f6bebfff700 1 --2- 172.21.15.72:0/4134281124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bec0a0a30 0x7f6bec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.280+0000 7f6beb7fe700 1 -- 172.21.15.72:0/4134281124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bec0a0a30 msgr2=0x7f6bec0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.280+0000 7f6beb7fe700 1 --2- 172.21.15.72:0/4134281124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bec0a0a30 0x7f6bec0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.280+0000 7f6beb7fe700 1 -- 172.21.15.72:0/4134281124 >> v2:172.21.15.72:3300/0 conn(0x7f6bec133930 msgr2=0x7f6bec133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.280+0000 7f6beb7fe700 1 --2- 172.21.15.72:0/4134281124 >> v2:172.21.15.72:3300/0 conn(0x7f6bec133930 0x7f6bec133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.280+0000 7f6beb7fe700 1 -- 172.21.15.72:0/4134281124 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec09dc50 con 0x7f6bec09d630 2023-10-03T10:14:41.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.280+0000 7f6beb7fe700 1 --2- 172.21.15.72:0/4134281124 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bec09d630 0x7f6bec0a1340 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6be00098f0 tx=0x7f6be0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10192a3787e0ecb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.280+0000 7f6beaffd700 1 -- 172.21.15.72:0/4134281124 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0011830 con 0x7f6bec09d630 2023-10-03T10:14:41.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.280+0000 7f6beaffd700 1 -- 172.21.15.72:0/4134281124 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be0011990 con 0x7f6bec09d630 2023-10-03T10:14:41.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.280+0000 7f6beaffd700 1 -- 172.21.15.72:0/4134281124 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0011d20 con 0x7f6bec09d630 2023-10-03T10:14:41.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.281+0000 7f6bf267e700 1 -- 172.21.15.72:0/4134281124 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bec09d630 msgr2=0x7f6bec0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.281+0000 7f6bf267e700 1 --2- 172.21.15.72:0/4134281124 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bec09d630 0x7f6bec0a1340 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6be00098f0 tx=0x7f6be0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:41.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.281+0000 7f6bf267e700 1 -- 172.21.15.72:0/4134281124 shutdown_connections 2023-10-03T10:14:41.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.281+0000 7f6bf267e700 1 --2- 172.21.15.72:0/4134281124 >> v2:172.21.15.72:3300/0 conn(0x7f6bec133930 0x7f6bec133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.281+0000 7f6bf267e700 1 --2- 172.21.15.72:0/4134281124 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bec0a0a30 0x7f6bec0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.281+0000 7f6bf267e700 1 --2- 172.21.15.72:0/4134281124 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bec09d630 0x7f6bec0a1340 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.281+0000 7f6bf267e700 1 -- 172.21.15.72:0/4134281124 >> 172.21.15.72:0/4134281124 conn(0x7f6bec0a3050 msgr2=0x7f6bec0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.281+0000 7f6bf267e700 1 -- 172.21.15.72:0/4134281124 shutdown_connections 2023-10-03T10:14:41.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.281+0000 7f6bf267e700 1 -- 172.21.15.72:0/4134281124 wait complete. 2023-10-03T10:14:41.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.282+0000 7f6bf267e700 1 Processor -- start 2023-10-03T10:14:41.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.283+0000 7f6bf267e700 1 -- start start 2023-10-03T10:14:41.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.283+0000 7f6bf267e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bec09d630 0x7f6bec1c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.283+0000 7f6bf267e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bec0a0a30 0x7f6bec1c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.283+0000 7f6bf267e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bec133930 0x7f6bec1c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.283+0000 7f6bf267e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec1206b0 con 0x7f6bec09d630 2023-10-03T10:14:41.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.283+0000 7f6bf267e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec1204c0 con 0x7f6bec0a0a30 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.283+0000 7f6bf267e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec1223d0 con 0x7f6bec133930 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.283+0000 7f6bebfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bec09d630 0x7f6bec1c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.283+0000 7f6bebfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bec09d630 0x7f6bec1c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43510/0 (socket says 172.21.15.72:43510) 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.283+0000 7f6beb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bec0a0a30 0x7f6bec1c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.283+0000 7f6bebfff700 1 -- 172.21.15.72:0/3554469766 learned_addr learned my addr 172.21.15.72:0/3554469766 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.283+0000 7f6bf0c1b700 1 --2- 172.21.15.72:0/3554469766 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bec133930 0x7f6bec1c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.284+0000 7f6beb7fe700 1 -- 172.21.15.72:0/3554469766 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bec133930 msgr2=0x7f6bec1c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.284+0000 7f6beb7fe700 1 --2- 172.21.15.72:0/3554469766 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bec133930 0x7f6bec1c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.284+0000 7f6beb7fe700 1 -- 172.21.15.72:0/3554469766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bec09d630 msgr2=0x7f6bec1c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.284+0000 7f6beb7fe700 1 --2- 172.21.15.72:0/3554469766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bec09d630 0x7f6bec1c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.284+0000 7f6beb7fe700 1 -- 172.21.15.72:0/3554469766 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0009550 con 0x7f6bec0a0a30 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.284+0000 7f6beb7fe700 1 --2- 172.21.15.72:0/3554469766 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bec0a0a30 0x7f6bec1c8640 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6be0016000 tx=0x7f6be0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.284+0000 7f6be8ff9700 1 -- 172.21.15.72:0/3554469766 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0004380 con 0x7f6bec0a0a30 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.284+0000 7f6be8ff9700 1 -- 172.21.15.72:0/3554469766 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be001f070 con 0x7f6bec0a0a30 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.284+0000 7f6be8ff9700 1 -- 172.21.15.72:0/3554469766 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be00036a0 con 0x7f6bec0a0a30 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.284+0000 7f6bf267e700 1 -- 172.21.15.72:0/3554469766 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bec0a4030 con 0x7f6bec0a0a30 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.284+0000 7f6bf267e700 1 -- 172.21.15.72:0/3554469766 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec0a0470 con 0x7f6bec0a0a30 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.285+0000 7f6bf267e700 1 -- 172.21.15.72:0/3554469766 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec120d10 con 0x7f6bec0a0a30 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.286+0000 7f6be8ff9700 1 -- 172.21.15.72:0/3554469766 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6be0021030 con 0x7f6bec0a0a30 2023-10-03T10:14:41.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.286+0000 7f6be8ff9700 1 -- 172.21.15.72:0/3554469766 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6be0040c60 con 0x7f6bec0a0a30 2023-10-03T10:14:41.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.290+0000 7f6be8ff9700 1 -- 172.21.15.72:0/3554469766 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6be000b9d0 con 0x7f6bec0a0a30 2023-10-03T10:14:41.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.335+0000 7f3f225b8700 1 Processor -- start 2023-10-03T10:14:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.335+0000 7f3f225b8700 1 -- start start 2023-10-03T10:14:41.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.335+0000 7f3f225b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f1c09e930 0x7f3f1c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.335+0000 7f3f225b8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f1c09f240 0x7f3f1c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.335+0000 7f3f225b8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3f1c09f650 0x7f3f1c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.335+0000 7f3f225b8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1c070940 con 0x7f3f1c09f650 2023-10-03T10:14:41.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.335+0000 7f3f225b8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c06fd60 con 0x7f3f1c09e930 2023-10-03T10:14:41.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.335+0000 7f3f225b8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c06fa80 con 0x7f3f1c09f240 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.336+0000 7f3f1b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f1c09f240 0x7f3f1c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.336+0000 7f3f1bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f1c09e930 0x7f3f1c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.336+0000 7f3f1b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f1c09f240 0x7f3f1c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52040/0 (socket says 172.21.15.72:52040) 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.336+0000 7f3f1b7fe700 1 -- 172.21.15.72:0/1739223682 learned_addr learned my addr 172.21.15.72:0/1739223682 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.336+0000 7f3f20b55700 1 --2- 172.21.15.72:0/1739223682 >> v2:172.21.15.72:3300/0 conn(0x7f3f1c09f650 0x7f3f1c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.336+0000 7f3f1bfff700 1 -- 172.21.15.72:0/1739223682 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f1c09f240 msgr2=0x7f3f1c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.336+0000 7f3f1bfff700 1 --2- 172.21.15.72:0/1739223682 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f1c09f240 0x7f3f1c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.336+0000 7f3f1bfff700 1 -- 172.21.15.72:0/1739223682 >> v2:172.21.15.72:3300/0 conn(0x7f3f1c09f650 msgr2=0x7f3f1c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.336+0000 7f3f1bfff700 1 --2- 172.21.15.72:0/1739223682 >> v2:172.21.15.72:3300/0 conn(0x7f3f1c09f650 0x7f3f1c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.336+0000 7f3f1bfff700 1 -- 172.21.15.72:0/1739223682 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c09fb60 con 0x7f3f1c09e930 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.336+0000 7f3f1b7fe700 1 --2- 172.21.15.72:0/1739223682 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f1c09f240 0x7f3f1c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.336+0000 7f3f20b55700 1 --2- 172.21.15.72:0/1739223682 >> v2:172.21.15.72:3300/0 conn(0x7f3f1c09f650 0x7f3f1c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.336+0000 7f3f1bfff700 1 --2- 172.21.15.72:0/1739223682 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f1c09e930 0x7f3f1c09ed00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009840 tx=0x7f3f0c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94398111c5ade8ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.336+0000 7f3f1affd700 1 -- 172.21.15.72:0/1739223682 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c011830 con 0x7f3f1c09e930 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.337+0000 7f3f1affd700 1 -- 172.21.15.72:0/1739223682 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c011990 con 0x7f3f1c09e930 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.337+0000 7f3f1affd700 1 -- 172.21.15.72:0/1739223682 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c011d20 con 0x7f3f1c09e930 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.337+0000 7f3f225b8700 1 -- 172.21.15.72:0/1739223682 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f1c09e930 msgr2=0x7f3f1c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.337+0000 7f3f225b8700 1 --2- 172.21.15.72:0/1739223682 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f1c09e930 0x7f3f1c09ed00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009840 tx=0x7f3f0c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.337+0000 7f3f225b8700 1 -- 172.21.15.72:0/1739223682 shutdown_connections 2023-10-03T10:14:41.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.337+0000 7f3f225b8700 1 --2- 172.21.15.72:0/1739223682 >> v2:172.21.15.72:3300/0 conn(0x7f3f1c09f650 0x7f3f1c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.337+0000 7f3f225b8700 1 --2- 172.21.15.72:0/1739223682 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f1c09e930 0x7f3f1c09ed00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.337+0000 7f3f225b8700 1 --2- 172.21.15.72:0/1739223682 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f1c09f240 0x7f3f1c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.337+0000 7f3f225b8700 1 -- 172.21.15.72:0/1739223682 >> 172.21.15.72:0/1739223682 conn(0x7f3f1c0a4210 msgr2=0x7f3f1c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.337+0000 7f3f225b8700 1 -- 172.21.15.72:0/1739223682 shutdown_connections 2023-10-03T10:14:41.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.337+0000 7f3f225b8700 1 -- 172.21.15.72:0/1739223682 wait complete. 2023-10-03T10:14:41.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.338+0000 7f3f225b8700 1 Processor -- start 2023-10-03T10:14:41.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.338+0000 7f3f225b8700 1 -- start start 2023-10-03T10:14:41.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f225b8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f1c09e930 0x7f3f1c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f225b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f1c09f240 0x7f3f1c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f225b8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f1c09f650 0x7f3f1c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f225b8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c1a89e0 con 0x7f3f1c09e930 2023-10-03T10:14:41.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f225b8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c1a8170 con 0x7f3f1c09f240 2023-10-03T10:14:41.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f225b8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c1b6290 con 0x7f3f1c09f650 2023-10-03T10:14:41.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f20b55700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f1c09f650 0x7f3f1c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f20b55700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f1c09f650 0x7f3f1c06c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52042/0 (socket says 172.21.15.72:52042) 2023-10-03T10:14:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f20b55700 1 -- 172.21.15.72:0/2877684032 learned_addr learned my addr 172.21.15.72:0/2877684032 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f1b7fe700 1 --2- 172.21.15.72:0/2877684032 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f1c09f240 0x7f3f1c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f1bfff700 1 --2- 172.21.15.72:0/2877684032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f1c09e930 0x7f3f1c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f20b55700 1 -- 172.21.15.72:0/2877684032 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f1c09f240 msgr2=0x7f3f1c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f20b55700 1 --2- 172.21.15.72:0/2877684032 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f1c09f240 0x7f3f1c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f20b55700 1 -- 172.21.15.72:0/2877684032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f1c09e930 msgr2=0x7f3f1c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f20b55700 1 --2- 172.21.15.72:0/2877684032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f1c09e930 0x7f3f1c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f20b55700 1 -- 172.21.15.72:0/2877684032 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f10009550 con 0x7f3f1c09f650 2023-10-03T10:14:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.339+0000 7f3f1bfff700 1 --2- 172.21.15.72:0/2877684032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f1c09e930 0x7f3f1c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.340+0000 7f3f20b55700 1 --2- 172.21.15.72:0/2877684032 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f1c09f650 0x7f3f1c06c330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400ef90 tx=0x7f3f1400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.340+0000 7f3f18ff9700 1 -- 172.21.15.72:0/2877684032 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1400cc90 con 0x7f3f1c09f650 2023-10-03T10:14:41.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.340+0000 7f3f18ff9700 1 -- 172.21.15.72:0/2877684032 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1400f040 con 0x7f3f1c09f650 2023-10-03T10:14:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.340+0000 7f3f18ff9700 1 -- 172.21.15.72:0/2877684032 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f140146c0 con 0x7f3f1c09f650 2023-10-03T10:14:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.340+0000 7f3f225b8700 1 -- 172.21.15.72:0/2877684032 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f14009a70 con 0x7f3f1c09f650 2023-10-03T10:14:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.340+0000 7f3f225b8700 1 -- 172.21.15.72:0/2877684032 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c0094a0 con 0x7f3f1c09f650 2023-10-03T10:14:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.341+0000 7f3f18ff9700 1 -- 172.21.15.72:0/2877684032 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f14014820 con 0x7f3f1c09f650 2023-10-03T10:14:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.341+0000 7f3f225b8700 1 -- 172.21.15.72:0/2877684032 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1c0a3580 con 0x7f3f1c09f650 2023-10-03T10:14:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.341+0000 7f3f18ff9700 1 -- 172.21.15.72:0/2877684032 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3f14040400 con 0x7f3f1c09f650 2023-10-03T10:14:41.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.346+0000 7f3f18ff9700 1 -- 172.21.15.72:0/2877684032 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f140076f0 con 0x7f3f1c09f650 2023-10-03T10:14:41.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.365+0000 7fa74279c700 1 -- 172.21.15.72:0/3853181402 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa73c06eb00 con 0x7fa73c099a40 2023-10-03T10:14:41.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.366+0000 7fa738ff9700 1 -- 172.21.15.72:0/3853181402 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa72c016350 con 0x7fa73c099a40 2023-10-03T10:14:41.366 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.369+0000 7fa74279c700 1 -- 172.21.15.72:0/3853181402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73c099a40 msgr2=0x7fa73c119510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.369+0000 7fa74279c700 1 --2- 172.21.15.72:0/3853181402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73c099a40 0x7fa73c119510 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00bb80 tx=0x7fa72c00be90 comp rx=0 tx=0).stop 2023-10-03T10:14:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.369+0000 7fa74279c700 1 -- 172.21.15.72:0/3853181402 shutdown_connections 2023-10-03T10:14:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.369+0000 7fa74279c700 1 --2- 172.21.15.72:0/3853181402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa73c131810 0x7fa73c119f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.369+0000 7fa74279c700 1 --2- 172.21.15.72:0/3853181402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa73c099a40 0x7fa73c119510 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.369+0000 7fa74279c700 1 --2- 172.21.15.72:0/3853181402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa73c09a3b0 0x7fa73c119a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.369+0000 7fa74279c700 1 -- 172.21.15.72:0/3853181402 >> 172.21.15.72:0/3853181402 conn(0x7fa73c0a2aa0 msgr2=0x7fa73c12e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.369+0000 7fa74279c700 1 -- 172.21.15.72:0/3853181402 shutdown_connections 2023-10-03T10:14:41.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.369+0000 7fa74279c700 1 -- 172.21.15.72:0/3853181402 wait complete. 2023-10-03T10:14:41.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:41.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.486+0000 7f6bf267e700 1 -- 172.21.15.72:0/3554469766 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6bec0747f0 con 0x7f6bec0a0a30 2023-10-03T10:14:41.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.486+0000 7f6be8ff9700 1 -- 172.21.15.72:0/3554469766 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6be0015070 con 0x7f6bec0a0a30 2023-10-03T10:14:41.487 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.488+0000 7f6bf267e700 1 -- 172.21.15.72:0/3554469766 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bec0a0a30 msgr2=0x7f6bec1c8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.488+0000 7f6bf267e700 1 --2- 172.21.15.72:0/3554469766 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bec0a0a30 0x7f6bec1c8640 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6be0016000 tx=0x7f6be0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.488+0000 7f6bf267e700 1 -- 172.21.15.72:0/3554469766 shutdown_connections 2023-10-03T10:14:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.488+0000 7f6bf267e700 1 --2- 172.21.15.72:0/3554469766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bec09d630 0x7f6bec1c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.488+0000 7f6bf267e700 1 --2- 172.21.15.72:0/3554469766 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bec133930 0x7f6bec1c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.488+0000 7f6bf267e700 1 --2- 172.21.15.72:0/3554469766 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bec0a0a30 0x7f6bec1c8640 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.488+0000 7f6bf267e700 1 -- 172.21.15.72:0/3554469766 >> 172.21.15.72:0/3554469766 conn(0x7f6bec0a3050 msgr2=0x7f6bec09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.488+0000 7f6bf267e700 1 -- 172.21.15.72:0/3554469766 shutdown_connections 2023-10-03T10:14:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.488+0000 7f6bf267e700 1 -- 172.21.15.72:0/3554469766 wait complete. 2023-10-03T10:14:41.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:41.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.546+0000 7f3f225b8700 1 -- 172.21.15.72:0/2877684032 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3f1c071d20 con 0x7f3f1c09f650 2023-10-03T10:14:41.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.546+0000 7f3f18ff9700 1 -- 172.21.15.72:0/2877684032 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3f14033380 con 0x7f3f1c09f650 2023-10-03T10:14:41.547 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:41.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.548+0000 7f3f225b8700 1 -- 172.21.15.72:0/2877684032 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f1c09f650 msgr2=0x7f3f1c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.548+0000 7f3f225b8700 1 --2- 172.21.15.72:0/2877684032 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f1c09f650 0x7f3f1c06c330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400ef90 tx=0x7f3f1400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.548+0000 7f3f225b8700 1 -- 172.21.15.72:0/2877684032 shutdown_connections 2023-10-03T10:14:41.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.548+0000 7f3f225b8700 1 --2- 172.21.15.72:0/2877684032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f1c09e930 0x7f3f1c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.548+0000 7f3f225b8700 1 --2- 172.21.15.72:0/2877684032 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3f1c09f650 0x7f3f1c06c330 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.548+0000 7f3f225b8700 1 --2- 172.21.15.72:0/2877684032 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3f1c09f240 0x7f3f1c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.548+0000 7f3f225b8700 1 -- 172.21.15.72:0/2877684032 >> 172.21.15.72:0/2877684032 conn(0x7f3f1c0a4210 msgr2=0x7f3f1c09c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.548+0000 7f3f225b8700 1 -- 172.21.15.72:0/2877684032 shutdown_connections 2023-10-03T10:14:41.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:41.548+0000 7f3f225b8700 1 -- 172.21.15.72:0/2877684032 wait complete. 2023-10-03T10:14:41.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:41.946 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:42.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.067+0000 7fd7552ff700 1 Processor -- start 2023-10-03T10:14:42.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.067+0000 7fd7552ff700 1 -- start start 2023-10-03T10:14:42.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.067+0000 7fd7552ff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7500a0a30 0x7fd7500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.067+0000 7fd7552ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd75009d630 0x7fd7500a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.067+0000 7fd7552ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7500a2a70 con 0x7fd750133930 2023-10-03T10:14:42.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.067+0000 7fd7552ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7500a01d0 con 0x7fd75009d630 2023-10-03T10:14:42.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.067+0000 7fd7552ff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75009e2b0 con 0x7fd7500a0a30 2023-10-03T10:14:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.067+0000 7fd74effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7500a0a30 0x7fd7500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.068+0000 7fd74effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7500a0a30 0x7fd7500a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40008/0 (socket says 172.21.15.72:40008) 2023-10-03T10:14:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.068+0000 7fd74e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd75009d630 0x7fd7500a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.068+0000 7fd74effd700 1 -- 172.21.15.72:0/1484059836 learned_addr learned my addr 172.21.15.72:0/1484059836 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.068+0000 7fd74e7fc700 1 -- 172.21.15.72:0/1484059836 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7500a0a30 msgr2=0x7fd7500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.068+0000 7fd74e7fc700 1 --2- 172.21.15.72:0/1484059836 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7500a0a30 0x7fd7500a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.068+0000 7fd74e7fc700 1 -- 172.21.15.72:0/1484059836 >> v1:172.21.15.72:6789/0 conn(0x7fd750133930 legacy=0x7fd750133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.068+0000 7fd74e7fc700 1 -- 172.21.15.72:0/1484059836 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75009dc50 con 0x7fd75009d630 2023-10-03T10:14:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.068+0000 7fd74effd700 1 --2- 172.21.15.72:0/1484059836 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7500a0a30 0x7fd7500a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.068+0000 7fd74e7fc700 1 --2- 172.21.15.72:0/1484059836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd75009d630 0x7fd7500a1340 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd740009840 tx=0x7fd740009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea7ddb6a2fb8ff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.068+0000 7fd74dffb700 1 -- 172.21.15.72:0/1484059836 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd740011830 con 0x7fd75009d630 2023-10-03T10:14:42.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.068+0000 7fd74dffb700 1 -- 172.21.15.72:0/1484059836 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd740011990 con 0x7fd75009d630 2023-10-03T10:14:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.068+0000 7fd74dffb700 1 -- 172.21.15.72:0/1484059836 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd740011d20 con 0x7fd75009d630 2023-10-03T10:14:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.069+0000 7fd7552ff700 1 -- 172.21.15.72:0/1484059836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd75009d630 msgr2=0x7fd7500a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.069+0000 7fd7552ff700 1 --2- 172.21.15.72:0/1484059836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd75009d630 0x7fd7500a1340 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd740009840 tx=0x7fd740009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.069+0000 7fd7552ff700 1 -- 172.21.15.72:0/1484059836 shutdown_connections 2023-10-03T10:14:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.069+0000 7fd7552ff700 1 --2- 172.21.15.72:0/1484059836 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7500a0a30 0x7fd7500a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.069+0000 7fd7552ff700 1 --2- 172.21.15.72:0/1484059836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd75009d630 0x7fd7500a1340 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.069+0000 7fd7552ff700 1 -- 172.21.15.72:0/1484059836 >> 172.21.15.72:0/1484059836 conn(0x7fd7500a3050 msgr2=0x7fd7500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.069+0000 7fd7552ff700 1 -- 172.21.15.72:0/1484059836 shutdown_connections 2023-10-03T10:14:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.069+0000 7fd7552ff700 1 -- 172.21.15.72:0/1484059836 wait complete. 2023-10-03T10:14:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.070+0000 7fd7552ff700 1 Processor -- start 2023-10-03T10:14:42.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.070+0000 7fd7552ff700 1 -- start start 2023-10-03T10:14:42.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.070+0000 7fd7552ff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd75009d630 0x7fd7501c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.070+0000 7fd7552ff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7500a0a30 0x7fd7501c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.070+0000 7fd7552ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd750133930 0x7fd7501c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.070+0000 7fd7552ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd750120a70 con 0x7fd750133930 2023-10-03T10:14:42.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.070+0000 7fd7552ff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd750120880 con 0x7fd75009d630 2023-10-03T10:14:42.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.070+0000 7fd7552ff700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd750121920 con 0x7fd7500a0a30 2023-10-03T10:14:42.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.070+0000 7fd74effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd75009d630 0x7fd7501c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.070+0000 7fd74f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd750133930 0x7fd7501c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.070+0000 7fd74e7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7500a0a30 0x7fd7501c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.070+0000 7fd74effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd75009d630 0x7fd7501c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40022/0 (socket says 172.21.15.72:40022) 2023-10-03T10:14:42.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.070+0000 7fd74effd700 1 -- 172.21.15.72:0/4255099154 learned_addr learned my addr 172.21.15.72:0/4255099154 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:42.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.070+0000 7fd74f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd750133930 0x7fd7501c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43540/0 (socket says 172.21.15.72:43540) 2023-10-03T10:14:42.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.070+0000 7fd74e7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7500a0a30 0x7fd7501c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52054/0 (socket says 172.21.15.72:52054) 2023-10-03T10:14:42.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.071+0000 7fd74f7fe700 1 -- 172.21.15.72:0/4255099154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7500a0a30 msgr2=0x7fd7501c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.071+0000 7fd74f7fe700 1 --2- 172.21.15.72:0/4255099154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7500a0a30 0x7fd7501c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.071+0000 7fd74f7fe700 1 -- 172.21.15.72:0/4255099154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd75009d630 msgr2=0x7fd7501c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.071+0000 7fd74f7fe700 1 --2- 172.21.15.72:0/4255099154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd75009d630 0x7fd7501c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.071+0000 7fd74f7fe700 1 -- 172.21.15.72:0/4255099154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd744009550 con 0x7fd750133930 2023-10-03T10:14:42.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.071+0000 7fd74f7fe700 1 --2- 172.21.15.72:0/4255099154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd750133930 0x7fd7501c8d90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd74800cb90 tx=0x7fd74800cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.071+0000 7fd7377fe700 1 -- 172.21.15.72:0/4255099154 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748003c00 con 0x7fd750133930 2023-10-03T10:14:42.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.071+0000 7fd7377fe700 1 -- 172.21.15.72:0/4255099154 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd748003d60 con 0x7fd750133930 2023-10-03T10:14:42.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.071+0000 7fd7552ff700 1 -- 172.21.15.72:0/4255099154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7400094a0 con 0x7fd750133930 2023-10-03T10:14:42.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.071+0000 7fd7377fe700 1 -- 172.21.15.72:0/4255099154 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74800aa80 con 0x7fd750133930 2023-10-03T10:14:42.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.071+0000 7fd7552ff700 1 -- 172.21.15.72:0/4255099154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7501224b0 con 0x7fd750133930 2023-10-03T10:14:42.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.071+0000 7fd7377fe700 1 -- 172.21.15.72:0/4255099154 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd74800abe0 con 0x7fd750133930 2023-10-03T10:14:42.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.072+0000 7fd7377fe700 1 -- 172.21.15.72:0/4255099154 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd74803f570 con 0x7fd750133930 2023-10-03T10:14:42.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.072+0000 7fd7552ff700 1 -- 172.21.15.72:0/4255099154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd750121e90 con 0x7fd750133930 2023-10-03T10:14:42.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.076+0000 7fd7377fe700 1 -- 172.21.15.72:0/4255099154 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7480198f0 con 0x7fd750133930 2023-10-03T10:14:42.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.259+0000 7fd7552ff700 1 -- 172.21.15.72:0/4255099154 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd750074770 con 0x7fd750133930 2023-10-03T10:14:42.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.259+0000 7fd7377fe700 1 -- 172.21.15.72:0/4255099154 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd748019300 con 0x7fd750133930 2023-10-03T10:14:42.260 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.261+0000 7fd7552ff700 1 -- 172.21.15.72:0/4255099154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd750133930 msgr2=0x7fd7501c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.261+0000 7fd7552ff700 1 --2- 172.21.15.72:0/4255099154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd750133930 0x7fd7501c8d90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd74800cb90 tx=0x7fd74800cea0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.262+0000 7fd7552ff700 1 -- 172.21.15.72:0/4255099154 shutdown_connections 2023-10-03T10:14:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.262+0000 7fd7552ff700 1 --2- 172.21.15.72:0/4255099154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd750133930 0x7fd7501c8d90 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.262+0000 7fd7552ff700 1 --2- 172.21.15.72:0/4255099154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd75009d630 0x7fd7501c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.262+0000 7fd7552ff700 1 --2- 172.21.15.72:0/4255099154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7500a0a30 0x7fd7501c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.262+0000 7fd7552ff700 1 -- 172.21.15.72:0/4255099154 >> 172.21.15.72:0/4255099154 conn(0x7fd7500a3050 msgr2=0x7fd7501bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.262+0000 7fd7552ff700 1 -- 172.21.15.72:0/4255099154 shutdown_connections 2023-10-03T10:14:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.262+0000 7fd7552ff700 1 -- 172.21.15.72:0/4255099154 wait complete. 2023-10-03T10:14:42.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:42.387 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:42.501 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:42.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.508+0000 7f09f7777700 1 Processor -- start 2023-10-03T10:14:42.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.508+0000 7f09f7777700 1 -- start start 2023-10-03T10:14:42.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.509+0000 7f09f7777700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09f009e930 0x7f09f009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.509+0000 7f09f7777700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f009f240 0x7f09f01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.509+0000 7f09f7777700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f0070940 con 0x7f09f009f650 2023-10-03T10:14:42.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.509+0000 7f09f7777700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f006fd60 con 0x7f09f009f240 2023-10-03T10:14:42.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.509+0000 7f09f7777700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09f006fa80 con 0x7f09f009e930 2023-10-03T10:14:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.509+0000 7f09f5513700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09f009e930 0x7f09f009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.509+0000 7f09f5d14700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f09f009f650 0x7f09f0131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43904/0 (socket says 172.21.15.72:43904) 2023-10-03T10:14:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.509+0000 7f09f5d14700 1 -- 172.21.15.72:0/3760106295 learned_addr learned my addr 172.21.15.72:0/3760106295 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.509+0000 7f09f4d12700 1 --2- 172.21.15.72:0/3760106295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f009f240 0x7f09f01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.509+0000 7f09f5513700 1 -- 172.21.15.72:0/3760106295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f009f240 msgr2=0x7f09f01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.509+0000 7f09f5513700 1 --2- 172.21.15.72:0/3760106295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f009f240 0x7f09f01317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.509+0000 7f09f5513700 1 -- 172.21.15.72:0/3760106295 >> v1:172.21.15.72:6789/0 conn(0x7f09f009f650 legacy=0x7f09f0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.509+0000 7f09e7fff700 1 -- 172.21.15.72:0/3760106295 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93339627 0 0) 0x7f09f0070940 con 0x7f09f009f650 2023-10-03T10:14:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.509+0000 7f09f5513700 1 -- 172.21.15.72:0/3760106295 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f009fb60 con 0x7f09f009e930 2023-10-03T10:14:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.509+0000 7f09f5513700 1 --2- 172.21.15.72:0/3760106295 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09f009e930 0x7f09f009ed00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009870 tx=0x7f09ec009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d1ce7a1d4e38c67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.510+0000 7f09e7fff700 1 -- 172.21.15.72:0/3760106295 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec011830 con 0x7f09f009e930 2023-10-03T10:14:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.510+0000 7f09e7fff700 1 -- 172.21.15.72:0/3760106295 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec011990 con 0x7f09f009e930 2023-10-03T10:14:42.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.510+0000 7f09e7fff700 1 -- 172.21.15.72:0/3760106295 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec011d20 con 0x7f09f009e930 2023-10-03T10:14:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.510+0000 7f09f7777700 1 -- 172.21.15.72:0/3760106295 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09f009e930 msgr2=0x7f09f009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.510+0000 7f09f7777700 1 --2- 172.21.15.72:0/3760106295 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09f009e930 0x7f09f009ed00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009870 tx=0x7f09ec009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.510+0000 7f09f7777700 1 -- 172.21.15.72:0/3760106295 shutdown_connections 2023-10-03T10:14:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.510+0000 7f09f7777700 1 --2- 172.21.15.72:0/3760106295 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09f009e930 0x7f09f009ed00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.510+0000 7f09f7777700 1 --2- 172.21.15.72:0/3760106295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f009f240 0x7f09f01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.510+0000 7f09f7777700 1 -- 172.21.15.72:0/3760106295 >> 172.21.15.72:0/3760106295 conn(0x7f09f00a4210 msgr2=0x7f09f00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.510+0000 7f09f7777700 1 -- 172.21.15.72:0/3760106295 shutdown_connections 2023-10-03T10:14:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.510+0000 7f09f7777700 1 -- 172.21.15.72:0/3760106295 wait complete. 2023-10-03T10:14:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.512+0000 7f09f7777700 1 Processor -- start 2023-10-03T10:14:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.512+0000 7f09f7777700 1 -- start start 2023-10-03T10:14:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.512+0000 7f09f7777700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f009e930 0x7f09f01a3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.512+0000 7f09f7777700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09f009f240 0x7f09f01a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.512+0000 7f09f7777700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09f009f650 0x7f09f01a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.512+0000 7f09f7777700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f01a5350 con 0x7f09f009f650 2023-10-03T10:14:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.512+0000 7f09f7777700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f01a79a0 con 0x7f09f009e930 2023-10-03T10:14:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.512+0000 7f09f7777700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09f01a60b0 con 0x7f09f009f240 2023-10-03T10:14:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.513+0000 7f09f4d12700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09f009f240 0x7f09f01a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.513+0000 7f09f5d14700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09f009f650 0x7f09f01a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.513+0000 7f09f4d12700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09f009f240 0x7f09f01a43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52076/0 (socket says 172.21.15.72:52076) 2023-10-03T10:14:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.513+0000 7f09f4d12700 1 -- 172.21.15.72:0/1070791974 learned_addr learned my addr 172.21.15.72:0/1070791974 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.513+0000 7f09f5513700 1 --2- 172.21.15.72:0/1070791974 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f009e930 0x7f09f01a3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.513+0000 7f09f4d12700 1 -- 172.21.15.72:0/1070791974 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f009e930 msgr2=0x7f09f01a3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.513+0000 7f09f4d12700 1 --2- 172.21.15.72:0/1070791974 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f009e930 0x7f09f01a3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.513+0000 7f09f4d12700 1 -- 172.21.15.72:0/1070791974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09f009f650 msgr2=0x7f09f01a4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.513+0000 7f09f4d12700 1 --2- 172.21.15.72:0/1070791974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09f009f650 0x7f09f01a4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.513+0000 7f09f4d12700 1 -- 172.21.15.72:0/1070791974 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec0094a0 con 0x7f09f009f240 2023-10-03T10:14:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.513+0000 7f09f4d12700 1 --2- 172.21.15.72:0/1070791974 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09f009f240 0x7f09f01a43c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f09e000e9b0 tx=0x7f09e000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.513+0000 7f09e5ffb700 1 -- 172.21.15.72:0/1070791974 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0009710 con 0x7f09f009f240 2023-10-03T10:14:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.513+0000 7f09e5ffb700 1 -- 172.21.15.72:0/1070791974 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e000ee50 con 0x7f09f009f240 2023-10-03T10:14:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.513+0000 7f09f7777700 1 -- 172.21.15.72:0/1070791974 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f00a0190 con 0x7f09f009f240 2023-10-03T10:14:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.513+0000 7f09e5ffb700 1 -- 172.21.15.72:0/1070791974 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000ca70 con 0x7f09f009f240 2023-10-03T10:14:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.514+0000 7f09f7777700 1 -- 172.21.15.72:0/1070791974 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f00a33a0 con 0x7f09f009f240 2023-10-03T10:14:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.514+0000 7f09e5ffb700 1 -- 172.21.15.72:0/1070791974 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09e000cbd0 con 0x7f09f009f240 2023-10-03T10:14:42.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.515+0000 7f09e5ffb700 1 -- 172.21.15.72:0/1070791974 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09e003f710 con 0x7f09f009f240 2023-10-03T10:14:42.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.515+0000 7f09f7777700 1 -- 172.21.15.72:0/1070791974 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f01a0b30 con 0x7f09f009f240 2023-10-03T10:14:42.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.520+0000 7f09e5ffb700 1 -- 172.21.15.72:0/1070791974 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09e00232f0 con 0x7f09f009f240 2023-10-03T10:14:42.561 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:42.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.631+0000 7f47302f4700 1 Processor -- start 2023-10-03T10:14:42.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.631+0000 7f47302f4700 1 -- start start 2023-10-03T10:14:42.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.632+0000 7f47302f4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f472809c650 0x7f472809ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.632+0000 7f47302f4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47280a0090 0x7f472809cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.632+0000 7f47302f4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472809ba70 con 0x7f4728131970 2023-10-03T10:14:42.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.632+0000 7f47302f4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472809d4a0 con 0x7f472809c650 2023-10-03T10:14:42.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.632+0000 7f47302f4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472809e8f0 con 0x7f47280a0090 2023-10-03T10:14:42.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.632+0000 7f472e090700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f472809c650 0x7f472809ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.632+0000 7f472d88f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47280a0090 0x7f472809cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.632+0000 7f472e090700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f472809c650 0x7f472809ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43566/0 (socket says 172.21.15.72:43566) 2023-10-03T10:14:42.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.632+0000 7f472e090700 1 -- 172.21.15.72:0/895765253 learned_addr learned my addr 172.21.15.72:0/895765253 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:42.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.632+0000 7f472d88f700 1 -- 172.21.15.72:0/895765253 >> v2:172.21.15.72:3300/0 conn(0x7f472809c650 msgr2=0x7f472809ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.632+0000 7f472d88f700 1 --2- 172.21.15.72:0/895765253 >> v2:172.21.15.72:3300/0 conn(0x7f472809c650 0x7f472809ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.633+0000 7f472d88f700 1 -- 172.21.15.72:0/895765253 >> v1:172.21.15.72:6789/0 conn(0x7f4728131970 legacy=0x7f4728131db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.633+0000 7f472d88f700 1 -- 172.21.15.72:0/895765253 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280a0760 con 0x7f47280a0090 2023-10-03T10:14:42.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.633+0000 7f472e090700 1 --2- 172.21.15.72:0/895765253 >> v2:172.21.15.72:3300/0 conn(0x7f472809c650 0x7f472809ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:42.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.633+0000 7f472d88f700 1 --2- 172.21.15.72:0/895765253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47280a0090 0x7f472809cf60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4718009840 tx=0x7f4718009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bffb6bb1a6cc0992 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.633+0000 7f472d08e700 1 -- 172.21.15.72:0/895765253 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718011830 con 0x7f47280a0090 2023-10-03T10:14:42.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.633+0000 7f472d08e700 1 -- 172.21.15.72:0/895765253 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4718011990 con 0x7f47280a0090 2023-10-03T10:14:42.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.633+0000 7f472d08e700 1 -- 172.21.15.72:0/895765253 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718011d20 con 0x7f47280a0090 2023-10-03T10:14:42.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.633+0000 7f47302f4700 1 -- 172.21.15.72:0/895765253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47280a0090 msgr2=0x7f472809cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.633+0000 7f47302f4700 1 --2- 172.21.15.72:0/895765253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47280a0090 0x7f472809cf60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4718009840 tx=0x7f4718009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:42.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.634+0000 7f47302f4700 1 -- 172.21.15.72:0/895765253 shutdown_connections 2023-10-03T10:14:42.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.634+0000 7f47302f4700 1 --2- 172.21.15.72:0/895765253 >> v2:172.21.15.72:3300/0 conn(0x7f472809c650 0x7f472809ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.634+0000 7f47302f4700 1 --2- 172.21.15.72:0/895765253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47280a0090 0x7f472809cf60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.634+0000 7f47302f4700 1 -- 172.21.15.72:0/895765253 >> 172.21.15.72:0/895765253 conn(0x7f47280a3f70 msgr2=0x7f47280a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.634+0000 7f47302f4700 1 -- 172.21.15.72:0/895765253 shutdown_connections 2023-10-03T10:14:42.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.634+0000 7f47302f4700 1 -- 172.21.15.72:0/895765253 wait complete. 2023-10-03T10:14:42.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.634+0000 7f47302f4700 1 Processor -- start 2023-10-03T10:14:42.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f47302f4700 1 -- start start 2023-10-03T10:14:42.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f47302f4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f472809c650 0x7f472806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f47302f4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47280a0090 0x7f472806bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f47302f4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4728131970 0x7f472806c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f47302f4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472806d780 con 0x7f4728131970 2023-10-03T10:14:42.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f47302f4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472806d4c0 con 0x7f472809c650 2023-10-03T10:14:42.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f47302f4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f472811fdb0 con 0x7f47280a0090 2023-10-03T10:14:42.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f472e891700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4728131970 0x7f472806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f472d88f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47280a0090 0x7f472806bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f472e891700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4728131970 0x7f472806c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43572/0 (socket says 172.21.15.72:43572) 2023-10-03T10:14:42.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f472e891700 1 -- 172.21.15.72:0/1726002528 learned_addr learned my addr 172.21.15.72:0/1726002528 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:42.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f472e090700 1 --2- 172.21.15.72:0/1726002528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f472809c650 0x7f472806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f472e891700 1 -- 172.21.15.72:0/1726002528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47280a0090 msgr2=0x7f472806bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f472e891700 1 --2- 172.21.15.72:0/1726002528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47280a0090 0x7f472806bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f472e891700 1 -- 172.21.15.72:0/1726002528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f472809c650 msgr2=0x7f472806b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f472e891700 1 --2- 172.21.15.72:0/1726002528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f472809c650 0x7f472806b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f472e891700 1 -- 172.21.15.72:0/1726002528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4724009550 con 0x7f4728131970 2023-10-03T10:14:42.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.635+0000 7f472e090700 1 --2- 172.21.15.72:0/1726002528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f472809c650 0x7f472806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:42.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.636+0000 7f472e891700 1 --2- 172.21.15.72:0/1726002528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4728131970 0x7f472806c300 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f472000cc50 tx=0x7f472000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.636+0000 7f471effd700 1 -- 172.21.15.72:0/1726002528 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720003c00 con 0x7f4728131970 2023-10-03T10:14:42.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.636+0000 7f471effd700 1 -- 172.21.15.72:0/1726002528 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4720003d60 con 0x7f4728131970 2023-10-03T10:14:42.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.636+0000 7f47302f4700 1 -- 172.21.15.72:0/1726002528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47180094a0 con 0x7f4728131970 2023-10-03T10:14:42.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.636+0000 7f471effd700 1 -- 172.21.15.72:0/1726002528 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000ab60 con 0x7f4728131970 2023-10-03T10:14:42.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.636+0000 7f47302f4700 1 -- 172.21.15.72:0/1726002528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472812d610 con 0x7f4728131970 2023-10-03T10:14:42.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.637+0000 7f47302f4700 1 -- 172.21.15.72:0/1726002528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47280747f0 con 0x7f4728131970 2023-10-03T10:14:42.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.637+0000 7f471effd700 1 -- 172.21.15.72:0/1726002528 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f472000acc0 con 0x7f4728131970 2023-10-03T10:14:42.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.637+0000 7f471effd700 1 -- 172.21.15.72:0/1726002528 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f472003f6e0 con 0x7f4728131970 2023-10-03T10:14:42.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.641+0000 7f471effd700 1 -- 172.21.15.72:0/1726002528 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47200196c0 con 0x7f4728131970 2023-10-03T10:14:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.689+0000 7f256f5a5700 1 Processor -- start 2023-10-03T10:14:42.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.689+0000 7f256f5a5700 1 -- start start 2023-10-03T10:14:42.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.689+0000 7f256f5a5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f256809f410 0x7f2568136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.689+0000 7f256f5a5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2568136fe0 0x7f25681393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.689+0000 7f256f5a5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2568070940 con 0x7f256809e930 2023-10-03T10:14:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.689+0000 7f256f5a5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256806fd60 con 0x7f2568136fe0 2023-10-03T10:14:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.689+0000 7f256f5a5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f256806fa80 con 0x7f256809f410 2023-10-03T10:14:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.690+0000 7f256d341700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f256809e930 0x7f256809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43930/0 (socket says 172.21.15.72:43930) 2023-10-03T10:14:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.690+0000 7f256cb40700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f256809f410 0x7f2568136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.690+0000 7f256d341700 1 -- 172.21.15.72:0/707914410 learned_addr learned my addr 172.21.15.72:0/707914410 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.690+0000 7f256db42700 1 --2- 172.21.15.72:0/707914410 >> v2:172.21.15.72:3300/0 conn(0x7f2568136fe0 0x7f25681393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.690+0000 7f255ffff700 1 -- 172.21.15.72:0/707914410 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088893792 0 0) 0x7f2568070940 con 0x7f256809e930 2023-10-03T10:14:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.690+0000 7f255ffff700 1 -- 172.21.15.72:0/707914410 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25540035b0 con 0x7f256809e930 2023-10-03T10:14:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.690+0000 7f256cb40700 1 -- 172.21.15.72:0/707914410 >> v2:172.21.15.72:3300/0 conn(0x7f2568136fe0 msgr2=0x7f25681393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.690+0000 7f256cb40700 1 --2- 172.21.15.72:0/707914410 >> v2:172.21.15.72:3300/0 conn(0x7f2568136fe0 0x7f25681393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.690+0000 7f256cb40700 1 -- 172.21.15.72:0/707914410 >> v1:172.21.15.72:6789/0 conn(0x7f256809e930 legacy=0x7f256809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.690+0000 7f256cb40700 1 -- 172.21.15.72:0/707914410 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256809fb60 con 0x7f256809f410 2023-10-03T10:14:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.690+0000 7f256cb40700 1 --2- 172.21.15.72:0/707914410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f256809f410 0x7f2568136aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2558009840 tx=0x7f2558009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61a11b16296fc2bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.690+0000 7f255ffff700 1 -- 172.21.15.72:0/707914410 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558011830 con 0x7f256809f410 2023-10-03T10:14:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.690+0000 7f255ffff700 1 -- 172.21.15.72:0/707914410 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2558011990 con 0x7f256809f410 2023-10-03T10:14:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.690+0000 7f255ffff700 1 -- 172.21.15.72:0/707914410 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558011d20 con 0x7f256809f410 2023-10-03T10:14:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.691+0000 7f256f5a5700 1 -- 172.21.15.72:0/707914410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f256809f410 msgr2=0x7f2568136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.691+0000 7f256f5a5700 1 --2- 172.21.15.72:0/707914410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f256809f410 0x7f2568136aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2558009840 tx=0x7f2558009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:42.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.691+0000 7f256f5a5700 1 -- 172.21.15.72:0/707914410 shutdown_connections 2023-10-03T10:14:42.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.691+0000 7f256f5a5700 1 --2- 172.21.15.72:0/707914410 >> v2:172.21.15.72:3300/0 conn(0x7f2568136fe0 0x7f25681393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.691+0000 7f256f5a5700 1 --2- 172.21.15.72:0/707914410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f256809f410 0x7f2568136aa0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.691+0000 7f256f5a5700 1 -- 172.21.15.72:0/707914410 >> 172.21.15.72:0/707914410 conn(0x7f25680a4210 msgr2=0x7f25680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.691+0000 7f256f5a5700 1 -- 172.21.15.72:0/707914410 shutdown_connections 2023-10-03T10:14:42.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.691+0000 7f256f5a5700 1 -- 172.21.15.72:0/707914410 wait complete. 2023-10-03T10:14:42.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.692+0000 7f256f5a5700 1 Processor -- start 2023-10-03T10:14:42.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.692+0000 7f256f5a5700 1 -- start start 2023-10-03T10:14:42.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.692+0000 7f256f5a5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f256809e930 0x7f2568121960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.692+0000 7f256f5a5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f256809f410 0x7f2568121ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.692+0000 7f256f5a5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2568136fe0 0x7f25681223e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.692+0000 7f256f5a5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2568136310 con 0x7f2568136fe0 2023-10-03T10:14:42.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.692+0000 7f256f5a5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2568123570 con 0x7f256809e930 2023-10-03T10:14:42.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.692+0000 7f256f5a5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2568123b90 con 0x7f256809f410 2023-10-03T10:14:42.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.692+0000 7f256db42700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2568136fe0 0x7f25681223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.692+0000 7f256cb40700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f256809f410 0x7f2568121ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.692+0000 7f256db42700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2568136fe0 0x7f25681223e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43596/0 (socket says 172.21.15.72:43596) 2023-10-03T10:14:42.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.693+0000 7f256db42700 1 -- 172.21.15.72:0/2788515326 learned_addr learned my addr 172.21.15.72:0/2788515326 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:42.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.693+0000 7f256d341700 1 --2- 172.21.15.72:0/2788515326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f256809e930 0x7f2568121960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.693+0000 7f256cb40700 1 -- 172.21.15.72:0/2788515326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f256809e930 msgr2=0x7f2568121960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.693+0000 7f256cb40700 1 --2- 172.21.15.72:0/2788515326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f256809e930 0x7f2568121960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.693+0000 7f256cb40700 1 -- 172.21.15.72:0/2788515326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2568136fe0 msgr2=0x7f25681223e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.693+0000 7f256cb40700 1 --2- 172.21.15.72:0/2788515326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2568136fe0 0x7f25681223e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.693+0000 7f256cb40700 1 -- 172.21.15.72:0/2788515326 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25580094a0 con 0x7f256809f410 2023-10-03T10:14:42.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.693+0000 7f256db42700 1 --2- 172.21.15.72:0/2788515326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2568136fe0 0x7f25681223e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:42.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.693+0000 7f256cb40700 1 --2- 172.21.15.72:0/2788515326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f256809f410 0x7f2568121ea0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2558016000 tx=0x7f2558004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.693+0000 7f255dffb700 1 -- 172.21.15.72:0/2788515326 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558004590 con 0x7f256809f410 2023-10-03T10:14:42.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.693+0000 7f255dffb700 1 -- 172.21.15.72:0/2788515326 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255801f070 con 0x7f256809f410 2023-10-03T10:14:42.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.693+0000 7f255dffb700 1 -- 172.21.15.72:0/2788515326 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25580038e0 con 0x7f256809f410 2023-10-03T10:14:42.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.693+0000 7f256f5a5700 1 -- 172.21.15.72:0/2788515326 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2568071d90 con 0x7f256809f410 2023-10-03T10:14:42.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.693+0000 7f256f5a5700 1 -- 172.21.15.72:0/2788515326 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25681251a0 con 0x7f256809f410 2023-10-03T10:14:42.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.695+0000 7f256f5a5700 1 -- 172.21.15.72:0/2788515326 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25681368f0 con 0x7f256809f410 2023-10-03T10:14:42.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.695+0000 7f255dffb700 1 -- 172.21.15.72:0/2788515326 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2558003a40 con 0x7f256809f410 2023-10-03T10:14:42.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.695+0000 7f255dffb700 1 -- 172.21.15.72:0/2788515326 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2558021070 con 0x7f256809f410 2023-10-03T10:14:42.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.700+0000 7f255dffb700 1 -- 172.21.15.72:0/2788515326 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f255802f990 con 0x7f256809f410 2023-10-03T10:14:42.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.723+0000 7f09f7777700 1 -- 172.21.15.72:0/1070791974 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f09f01a7520 con 0x7f09f009f240 2023-10-03T10:14:42.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.724+0000 7f09e5ffb700 1 -- 172.21.15.72:0/1070791974 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f09e001bba0 con 0x7f09f009f240 2023-10-03T10:14:42.725 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:42.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.726+0000 7f09f7777700 1 -- 172.21.15.72:0/1070791974 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09f009f240 msgr2=0x7f09f01a43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.726+0000 7f09f7777700 1 --2- 172.21.15.72:0/1070791974 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09f009f240 0x7f09f01a43c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f09e000e9b0 tx=0x7f09e000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.726+0000 7f09f7777700 1 -- 172.21.15.72:0/1070791974 shutdown_connections 2023-10-03T10:14:42.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.726+0000 7f09f7777700 1 --2- 172.21.15.72:0/1070791974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09f009f650 0x7f09f01a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.726+0000 7f09f7777700 1 --2- 172.21.15.72:0/1070791974 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f009e930 0x7f09f01a3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.726+0000 7f09f7777700 1 --2- 172.21.15.72:0/1070791974 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09f009f240 0x7f09f01a43c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.726+0000 7f09f7777700 1 -- 172.21.15.72:0/1070791974 >> 172.21.15.72:0/1070791974 conn(0x7f09f00a4210 msgr2=0x7f09f01b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.726+0000 7f09f7777700 1 -- 172.21.15.72:0/1070791974 shutdown_connections 2023-10-03T10:14:42.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.726+0000 7f09f7777700 1 -- 172.21.15.72:0/1070791974 wait complete. 2023-10-03T10:14:42.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:42.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.835+0000 7f47302f4700 1 -- 172.21.15.72:0/1726002528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4728072820 con 0x7f4728131970 2023-10-03T10:14:42.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.836+0000 7f471effd700 1 -- 172.21.15.72:0/1726002528 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4720011380 con 0x7f4728131970 2023-10-03T10:14:42.837 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:42.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.838+0000 7f47302f4700 1 -- 172.21.15.72:0/1726002528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4728131970 msgr2=0x7f472806c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.838+0000 7f47302f4700 1 --2- 172.21.15.72:0/1726002528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4728131970 0x7f472806c300 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f472000cc50 tx=0x7f472000cf60 comp rx=0 tx=0).stop 2023-10-03T10:14:42.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.838+0000 7f47302f4700 1 -- 172.21.15.72:0/1726002528 shutdown_connections 2023-10-03T10:14:42.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.838+0000 7f47302f4700 1 --2- 172.21.15.72:0/1726002528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4728131970 0x7f472806c300 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.838+0000 7f47302f4700 1 --2- 172.21.15.72:0/1726002528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f472809c650 0x7f472806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.838+0000 7f47302f4700 1 --2- 172.21.15.72:0/1726002528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47280a0090 0x7f472806bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.838+0000 7f47302f4700 1 -- 172.21.15.72:0/1726002528 >> 172.21.15.72:0/1726002528 conn(0x7f47280a3f70 msgr2=0x7f472812efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.838+0000 7f47302f4700 1 -- 172.21.15.72:0/1726002528 shutdown_connections 2023-10-03T10:14:42.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.838+0000 7f47302f4700 1 -- 172.21.15.72:0/1726002528 wait complete. 2023-10-03T10:14:42.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:42.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.892+0000 7f256f5a5700 1 -- 172.21.15.72:0/2788515326 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2568074ea0 con 0x7f256809f410 2023-10-03T10:14:42.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.892+0000 7f255dffb700 1 -- 172.21.15.72:0/2788515326 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f255802b020 con 0x7f256809f410 2023-10-03T10:14:42.893 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:42.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.894+0000 7f256f5a5700 1 -- 172.21.15.72:0/2788515326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f256809f410 msgr2=0x7f2568121ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.894+0000 7f256f5a5700 1 --2- 172.21.15.72:0/2788515326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f256809f410 0x7f2568121ea0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2558016000 tx=0x7f2558004750 comp rx=0 tx=0).stop 2023-10-03T10:14:42.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.894+0000 7f256f5a5700 1 -- 172.21.15.72:0/2788515326 shutdown_connections 2023-10-03T10:14:42.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.894+0000 7f256f5a5700 1 --2- 172.21.15.72:0/2788515326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2568136fe0 0x7f25681223e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.894+0000 7f256f5a5700 1 --2- 172.21.15.72:0/2788515326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f256809e930 0x7f2568121960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.894+0000 7f256f5a5700 1 --2- 172.21.15.72:0/2788515326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f256809f410 0x7f2568121ea0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.894+0000 7f256f5a5700 1 -- 172.21.15.72:0/2788515326 >> 172.21.15.72:0/2788515326 conn(0x7f25680a4210 msgr2=0x7f25681bc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.894+0000 7f256f5a5700 1 -- 172.21.15.72:0/2788515326 shutdown_connections 2023-10-03T10:14:42.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:42.894+0000 7f256f5a5700 1 -- 172.21.15.72:0/2788515326 wait complete. 2023-10-03T10:14:42.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:43.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:43.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.484+0000 7f181a4aa700 1 Processor -- start 2023-10-03T10:14:43.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.484+0000 7f181a4aa700 1 -- start start 2023-10-03T10:14:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.484+0000 7f181a4aa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18141338a0 0x7f1814133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.484+0000 7f181a4aa700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f181409de50 0x7f181409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.484+0000 7f181a4aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f181409e760 0x7f181413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.484+0000 7f181a4aa700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181406fef0 con 0x7f181409de50 2023-10-03T10:14:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.484+0000 7f181a4aa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181406ef30 con 0x7f181409e760 2023-10-03T10:14:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.484+0000 7f181a4aa700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18141334b0 con 0x7f18141338a0 2023-10-03T10:14:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f18137fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f181409de50 0x7f181409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f1813fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18141338a0 0x7f1814133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f1818a47700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f181409e760 0x7f181413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f18137fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f181409de50 0x7f181409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43614/0 (socket says 172.21.15.72:43614) 2023-10-03T10:14:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f1813fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18141338a0 0x7f1814133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52104/0 (socket says 172.21.15.72:52104) 2023-10-03T10:14:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f18137fe700 1 -- 172.21.15.72:0/2663858109 learned_addr learned my addr 172.21.15.72:0/2663858109 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f18137fe700 1 -- 172.21.15.72:0/2663858109 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18141338a0 msgr2=0x7f1814133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f18137fe700 1 --2- 172.21.15.72:0/2663858109 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18141338a0 0x7f1814133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f18137fe700 1 -- 172.21.15.72:0/2663858109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f181409e760 msgr2=0x7f181413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f18137fe700 1 --2- 172.21.15.72:0/2663858109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f181409e760 0x7f181413a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f18137fe700 1 -- 172.21.15.72:0/2663858109 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181406fc30 con 0x7f181409de50 2023-10-03T10:14:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f1818a47700 1 --2- 172.21.15.72:0/2663858109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f181409e760 0x7f181413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f18137fe700 1 --2- 172.21.15.72:0/2663858109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f181409de50 0x7f181409e220 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f18040098f0 tx=0x7f1804009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf302eb8ebe0af4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:43.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f1812ffd700 1 -- 172.21.15.72:0/2663858109 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804011830 con 0x7f181409de50 2023-10-03T10:14:43.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f1812ffd700 1 -- 172.21.15.72:0/2663858109 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1804011990 con 0x7f181409de50 2023-10-03T10:14:43.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.485+0000 7f1812ffd700 1 -- 172.21.15.72:0/2663858109 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804011d20 con 0x7f181409de50 2023-10-03T10:14:43.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.486+0000 7f181a4aa700 1 -- 172.21.15.72:0/2663858109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f181409de50 msgr2=0x7f181409e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.486+0000 7f181a4aa700 1 --2- 172.21.15.72:0/2663858109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f181409de50 0x7f181409e220 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f18040098f0 tx=0x7f1804009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:43.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.486+0000 7f181a4aa700 1 -- 172.21.15.72:0/2663858109 shutdown_connections 2023-10-03T10:14:43.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.486+0000 7f181a4aa700 1 --2- 172.21.15.72:0/2663858109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f181409e760 0x7f181413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.486+0000 7f181a4aa700 1 --2- 172.21.15.72:0/2663858109 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18141338a0 0x7f1814133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.486+0000 7f181a4aa700 1 --2- 172.21.15.72:0/2663858109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f181409de50 0x7f181409e220 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.486+0000 7f181a4aa700 1 -- 172.21.15.72:0/2663858109 >> 172.21.15.72:0/2663858109 conn(0x7f18140a2aa0 msgr2=0x7f18140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.486+0000 7f181a4aa700 1 -- 172.21.15.72:0/2663858109 shutdown_connections 2023-10-03T10:14:43.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.486+0000 7f181a4aa700 1 -- 172.21.15.72:0/2663858109 wait complete. 2023-10-03T10:14:43.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.487+0000 7f181a4aa700 1 Processor -- start 2023-10-03T10:14:43.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.487+0000 7f181a4aa700 1 -- start start 2023-10-03T10:14:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.487+0000 7f181a4aa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f181409de50 0x7f181411b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.487+0000 7f181a4aa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f181409e760 0x7f181411bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.487+0000 7f181a4aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18141338a0 0x7f181411c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.487+0000 7f181a4aa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181412eb40 con 0x7f181409de50 2023-10-03T10:14:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.487+0000 7f181a4aa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181411f250 con 0x7f18141338a0 2023-10-03T10:14:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.487+0000 7f181a4aa700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f181411e600 con 0x7f181409e760 2023-10-03T10:14:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.487+0000 7f1813fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f181409de50 0x7f181411b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.487+0000 7f1813fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f181409de50 0x7f181411b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43626/0 (socket says 172.21.15.72:43626) 2023-10-03T10:14:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.487+0000 7f1813fff700 1 -- 172.21.15.72:0/3148170181 learned_addr learned my addr 172.21.15.72:0/3148170181 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.487+0000 7f18137fe700 1 --2- 172.21.15.72:0/3148170181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f181409e760 0x7f181411bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.487+0000 7f1818a47700 1 --2- 172.21.15.72:0/3148170181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18141338a0 0x7f181411c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.488+0000 7f1813fff700 1 -- 172.21.15.72:0/3148170181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f181409e760 msgr2=0x7f181411bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.488+0000 7f1813fff700 1 --2- 172.21.15.72:0/3148170181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f181409e760 0x7f181411bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.488+0000 7f1813fff700 1 -- 172.21.15.72:0/3148170181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18141338a0 msgr2=0x7f181411c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.488+0000 7f1813fff700 1 --2- 172.21.15.72:0/3148170181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18141338a0 0x7f181411c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.488+0000 7f1813fff700 1 -- 172.21.15.72:0/3148170181 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c009a70 con 0x7f181409de50 2023-10-03T10:14:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.488+0000 7f1818a47700 1 --2- 172.21.15.72:0/3148170181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18141338a0 0x7f181411c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.488+0000 7f1813fff700 1 --2- 172.21.15.72:0/3148170181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f181409de50 0x7f181411b7d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f180800e9b0 tx=0x7f180800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.488+0000 7f1810ff9700 1 -- 172.21.15.72:0/3148170181 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808009710 con 0x7f181409de50 2023-10-03T10:14:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.488+0000 7f1810ff9700 1 -- 172.21.15.72:0/3148170181 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180800ee40 con 0x7f181409de50 2023-10-03T10:14:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.488+0000 7f1810ff9700 1 -- 172.21.15.72:0/3148170181 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180800ca50 con 0x7f181409de50 2023-10-03T10:14:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.488+0000 7f181a4aa700 1 -- 172.21.15.72:0/3148170181 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1804009550 con 0x7f181409de50 2023-10-03T10:14:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.488+0000 7f181a4aa700 1 -- 172.21.15.72:0/3148170181 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18140a1090 con 0x7f181409de50 2023-10-03T10:14:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.489+0000 7f1810ff9700 1 -- 172.21.15.72:0/3148170181 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f180800cbb0 con 0x7f181409de50 2023-10-03T10:14:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.489+0000 7f1810ff9700 1 -- 172.21.15.72:0/3148170181 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f180803fa10 con 0x7f181409de50 2023-10-03T10:14:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.489+0000 7f181a4aa700 1 -- 172.21.15.72:0/3148170181 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181411f090 con 0x7f181409de50 2023-10-03T10:14:43.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.494+0000 7f1810ff9700 1 -- 172.21.15.72:0/3148170181 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f180801ad70 con 0x7f181409de50 2023-10-03T10:14:43.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.677+0000 7f181a4aa700 1 -- 172.21.15.72:0/3148170181 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1814074ea0 con 0x7f181409de50 2023-10-03T10:14:43.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.678+0000 7f1810ff9700 1 -- 172.21.15.72:0/3148170181 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1808021030 con 0x7f181409de50 2023-10-03T10:14:43.679 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:43.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.680+0000 7f181a4aa700 1 -- 172.21.15.72:0/3148170181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f181409de50 msgr2=0x7f181411b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.680+0000 7f181a4aa700 1 --2- 172.21.15.72:0/3148170181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f181409de50 0x7f181411b7d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f180800e9b0 tx=0x7f180800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.680+0000 7f181a4aa700 1 -- 172.21.15.72:0/3148170181 shutdown_connections 2023-10-03T10:14:43.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.680+0000 7f181a4aa700 1 --2- 172.21.15.72:0/3148170181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f181409de50 0x7f181411b7d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.680+0000 7f181a4aa700 1 --2- 172.21.15.72:0/3148170181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18141338a0 0x7f181411c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.680+0000 7f181a4aa700 1 --2- 172.21.15.72:0/3148170181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f181409e760 0x7f181411bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.680+0000 7f181a4aa700 1 -- 172.21.15.72:0/3148170181 >> 172.21.15.72:0/3148170181 conn(0x7f18140a2aa0 msgr2=0x7f18141305a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.680+0000 7f181a4aa700 1 -- 172.21.15.72:0/3148170181 shutdown_connections 2023-10-03T10:14:43.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.680+0000 7f181a4aa700 1 -- 172.21.15.72:0/3148170181 wait complete. 2023-10-03T10:14:43.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:43.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:43.851 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:43.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.862+0000 7fe7f68e4700 1 Processor -- start 2023-10-03T10:14:43.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.862+0000 7fe7f68e4700 1 -- start start 2023-10-03T10:14:43.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7f68e4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7f009d6f0 0x7fe7f009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7f68e4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7f009e000 0x7fe7f01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7f68e4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f009e410 0x7fe7f0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7f68e4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f006b460 con 0x7fe7f009d6f0 2023-10-03T10:14:43.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7f68e4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f009b120 con 0x7fe7f009e410 2023-10-03T10:14:43.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7f68e4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f009a7e0 con 0x7fe7f009e000 2023-10-03T10:14:43.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7effff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7f009d6f0 0x7fe7f009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7f4e81700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f009e410 0x7fe7f0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7ef7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7f009e000 0x7fe7f01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7effff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7f009d6f0 0x7fe7f009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43630/0 (socket says 172.21.15.72:43630) 2023-10-03T10:14:43.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7f4e81700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f009e410 0x7fe7f0133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40082/0 (socket says 172.21.15.72:40082) 2023-10-03T10:14:43.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7effff700 1 -- 172.21.15.72:0/1608657012 learned_addr learned my addr 172.21.15.72:0/1608657012 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:43.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7f4e81700 1 -- 172.21.15.72:0/1608657012 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7f009e000 msgr2=0x7fe7f01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:43.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7f4e81700 1 --2- 172.21.15.72:0/1608657012 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7f009e000 0x7fe7f01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7f4e81700 1 -- 172.21.15.72:0/1608657012 >> v2:172.21.15.72:3300/0 conn(0x7fe7f009d6f0 msgr2=0x7fe7f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:43.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7f4e81700 1 --2- 172.21.15.72:0/1608657012 >> v2:172.21.15.72:3300/0 conn(0x7fe7f009d6f0 0x7fe7f009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7f4e81700 1 -- 172.21.15.72:0/1608657012 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f009a500 con 0x7fe7f009e410 2023-10-03T10:14:43.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7effff700 1 --2- 172.21.15.72:0/1608657012 >> v2:172.21.15.72:3300/0 conn(0x7fe7f009d6f0 0x7fe7f009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:43.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7ef7fe700 1 --2- 172.21.15.72:0/1608657012 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7f009e000 0x7fe7f01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:43.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.863+0000 7fe7f4e81700 1 --2- 172.21.15.72:0/1608657012 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f009e410 0x7fe7f0133f30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8009dc0 tx=0x7fe7e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fddbff80f55ab4d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:43.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.864+0000 7fe7eeffd700 1 -- 172.21.15.72:0/1608657012 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800e070 con 0x7fe7f009e410 2023-10-03T10:14:43.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.864+0000 7fe7eeffd700 1 -- 172.21.15.72:0/1608657012 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e800bae0 con 0x7fe7f009e410 2023-10-03T10:14:43.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.864+0000 7fe7eeffd700 1 -- 172.21.15.72:0/1608657012 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800be90 con 0x7fe7f009e410 2023-10-03T10:14:43.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.864+0000 7fe7f68e4700 1 -- 172.21.15.72:0/1608657012 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f009e410 msgr2=0x7fe7f0133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.864+0000 7fe7f68e4700 1 --2- 172.21.15.72:0/1608657012 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f009e410 0x7fe7f0133f30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8009dc0 tx=0x7fe7e800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:43.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.864+0000 7fe7f68e4700 1 -- 172.21.15.72:0/1608657012 shutdown_connections 2023-10-03T10:14:43.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.864+0000 7fe7f68e4700 1 --2- 172.21.15.72:0/1608657012 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f009e410 0x7fe7f0133f30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.864+0000 7fe7f68e4700 1 --2- 172.21.15.72:0/1608657012 >> v2:172.21.15.72:3300/0 conn(0x7fe7f009d6f0 0x7fe7f009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.864+0000 7fe7f68e4700 1 --2- 172.21.15.72:0/1608657012 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7f009e000 0x7fe7f01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.864+0000 7fe7f68e4700 1 -- 172.21.15.72:0/1608657012 >> 172.21.15.72:0/1608657012 conn(0x7fe7f0066f50 msgr2=0x7fe7f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.864+0000 7fe7f68e4700 1 -- 172.21.15.72:0/1608657012 shutdown_connections 2023-10-03T10:14:43.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.864+0000 7fe7f68e4700 1 -- 172.21.15.72:0/1608657012 wait complete. 2023-10-03T10:14:43.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.865+0000 7fe7f68e4700 1 Processor -- start 2023-10-03T10:14:43.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.865+0000 7fe7f68e4700 1 -- start start 2023-10-03T10:14:43.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7f68e4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f009d6f0 0x7fe7f01a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7f68e4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f009e000 0x7fe7f01a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7f68e4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7f009e410 0x7fe7f01a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7f68e4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f01a5260 con 0x7fe7f009d6f0 2023-10-03T10:14:43.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7f68e4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00a2000 con 0x7fe7f009e000 2023-10-03T10:14:43.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7f68e4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f009c710 con 0x7fe7f009e410 2023-10-03T10:14:43.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7ef7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f009e000 0x7fe7f01a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7effff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f009d6f0 0x7fe7f01a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7ef7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f009e000 0x7fe7f01a3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40088/0 (socket says 172.21.15.72:40088) 2023-10-03T10:14:43.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7ef7fe700 1 -- 172.21.15.72:0/3311206954 learned_addr learned my addr 172.21.15.72:0/3311206954 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:43.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7ef7fe700 1 -- 172.21.15.72:0/3311206954 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7f009e410 msgr2=0x7fe7f01a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7ef7fe700 1 --2- 172.21.15.72:0/3311206954 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7f009e410 0x7fe7f01a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7ef7fe700 1 -- 172.21.15.72:0/3311206954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f009d6f0 msgr2=0x7fe7f01a36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7ef7fe700 1 --2- 172.21.15.72:0/3311206954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f009d6f0 0x7fe7f01a36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7ef7fe700 1 -- 172.21.15.72:0/3311206954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e0009550 con 0x7fe7f009e000 2023-10-03T10:14:43.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7effff700 1 --2- 172.21.15.72:0/3311206954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f009d6f0 0x7fe7f01a36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:43.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.866+0000 7fe7ef7fe700 1 --2- 172.21.15.72:0/3311206954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f009e000 0x7fe7f01a3c30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400ec10 tx=0x7fe7e400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:43.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.867+0000 7fe7ecff9700 1 -- 172.21.15.72:0/3311206954 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e400c910 con 0x7fe7f009e000 2023-10-03T10:14:43.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.867+0000 7fe7ecff9700 1 -- 172.21.15.72:0/3311206954 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e400ca70 con 0x7fe7f009e000 2023-10-03T10:14:43.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.867+0000 7fe7ecff9700 1 -- 172.21.15.72:0/3311206954 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e400cde0 con 0x7fe7f009e000 2023-10-03T10:14:43.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.867+0000 7fe7f68e4700 1 -- 172.21.15.72:0/3311206954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e40094a0 con 0x7fe7f009e000 2023-10-03T10:14:43.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.867+0000 7fe7f68e4700 1 -- 172.21.15.72:0/3311206954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e8009a70 con 0x7fe7f009e000 2023-10-03T10:14:43.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.868+0000 7fe7f68e4700 1 -- 172.21.15.72:0/3311206954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f0074ea0 con 0x7fe7f009e000 2023-10-03T10:14:43.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.868+0000 7fe7ecff9700 1 -- 172.21.15.72:0/3311206954 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe7e4013470 con 0x7fe7f009e000 2023-10-03T10:14:43.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.868+0000 7fe7ecff9700 1 -- 172.21.15.72:0/3311206954 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe7e403ffc0 con 0x7fe7f009e000 2023-10-03T10:14:43.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.872+0000 7fe7ecff9700 1 -- 172.21.15.72:0/3311206954 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7e4024760 con 0x7fe7f009e000 2023-10-03T10:14:43.908 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:43.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.977+0000 7fcb74e66700 1 Processor -- start 2023-10-03T10:14:43.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.977+0000 7fcb74e66700 1 -- start start 2023-10-03T10:14:43.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb74e66700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb7009d6f0 0x7fcb7009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb74e66700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb7009e000 0x7fcb701339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb74e66700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb7009e410 0x7fcb70133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb74e66700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7006b460 con 0x7fcb7009e000 2023-10-03T10:14:43.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb74e66700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7009b120 con 0x7fcb7009d6f0 2023-10-03T10:14:43.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb74e66700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7009a7e0 con 0x7fcb7009e410 2023-10-03T10:14:43.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb6e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb7009d6f0 0x7fcb7009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb6dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb7009e000 0x7fcb701339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb6dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb7009e000 0x7fcb701339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43644/0 (socket says 172.21.15.72:43644) 2023-10-03T10:14:43.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb6e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb7009d6f0 0x7fcb7009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40096/0 (socket says 172.21.15.72:40096) 2023-10-03T10:14:43.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb6dd9b700 1 -- 172.21.15.72:0/3273138282 learned_addr learned my addr 172.21.15.72:0/3273138282 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:43.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb6ed9d700 1 --2- 172.21.15.72:0/3273138282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb7009e410 0x7fcb70133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb6e59c700 1 -- 172.21.15.72:0/3273138282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb7009e410 msgr2=0x7fcb70133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:43.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb6e59c700 1 --2- 172.21.15.72:0/3273138282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb7009e410 0x7fcb70133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb6e59c700 1 -- 172.21.15.72:0/3273138282 >> v2:172.21.15.72:3300/0 conn(0x7fcb7009e000 msgr2=0x7fcb701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:43.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb6e59c700 1 --2- 172.21.15.72:0/3273138282 >> v2:172.21.15.72:3300/0 conn(0x7fcb7009e000 0x7fcb701339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb6e59c700 1 -- 172.21.15.72:0/3273138282 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7009a500 con 0x7fcb7009d6f0 2023-10-03T10:14:43.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb6dd9b700 1 --2- 172.21.15.72:0/3273138282 >> v2:172.21.15.72:3300/0 conn(0x7fcb7009e000 0x7fcb701339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:43.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.978+0000 7fcb6e59c700 1 --2- 172.21.15.72:0/3273138282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb7009d6f0 0x7fcb7009dac0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009870 tx=0x7fcb60009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2885dbf5b640e254 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:43.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.979+0000 7fcb6d59a700 1 -- 172.21.15.72:0/3273138282 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60011830 con 0x7fcb7009d6f0 2023-10-03T10:14:43.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.979+0000 7fcb6d59a700 1 -- 172.21.15.72:0/3273138282 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb60011990 con 0x7fcb7009d6f0 2023-10-03T10:14:43.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.979+0000 7fcb6d59a700 1 -- 172.21.15.72:0/3273138282 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60011d20 con 0x7fcb7009d6f0 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.979+0000 7fcb74e66700 1 -- 172.21.15.72:0/3273138282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb7009d6f0 msgr2=0x7fcb7009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.979+0000 7fcb74e66700 1 --2- 172.21.15.72:0/3273138282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb7009d6f0 0x7fcb7009dac0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009870 tx=0x7fcb60009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.979+0000 7fcb74e66700 1 -- 172.21.15.72:0/3273138282 shutdown_connections 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.979+0000 7fcb74e66700 1 --2- 172.21.15.72:0/3273138282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb7009e410 0x7fcb70133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.979+0000 7fcb74e66700 1 --2- 172.21.15.72:0/3273138282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb7009d6f0 0x7fcb7009dac0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.979+0000 7fcb74e66700 1 --2- 172.21.15.72:0/3273138282 >> v2:172.21.15.72:3300/0 conn(0x7fcb7009e000 0x7fcb701339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.979+0000 7fcb74e66700 1 -- 172.21.15.72:0/3273138282 >> 172.21.15.72:0/3273138282 conn(0x7fcb70066f50 msgr2=0x7fcb7009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.979+0000 7fcb74e66700 1 -- 172.21.15.72:0/3273138282 shutdown_connections 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.979+0000 7fcb74e66700 1 -- 172.21.15.72:0/3273138282 wait complete. 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.980+0000 7fcb74e66700 1 Processor -- start 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.980+0000 7fcb74e66700 1 -- start start 2023-10-03T10:14:43.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb74e66700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7009d6f0 0x7fcb701c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb74e66700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb7009e000 0x7fcb701c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb74e66700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb7009e410 0x7fcb701c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb74e66700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb701a58d0 con 0x7fcb7009d6f0 2023-10-03T10:14:43.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb74e66700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700a2020 con 0x7fcb7009e410 2023-10-03T10:14:43.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb74e66700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb701a5430 con 0x7fcb7009e000 2023-10-03T10:14:43.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb6e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7009d6f0 0x7fcb701c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb6dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb7009e000 0x7fcb701c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb6e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7009d6f0 0x7fcb701c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43658/0 (socket says 172.21.15.72:43658) 2023-10-03T10:14:43.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb6e59c700 1 -- 172.21.15.72:0/4064524184 learned_addr learned my addr 172.21.15.72:0/4064524184 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:43.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb6ed9d700 1 --2- 172.21.15.72:0/4064524184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb7009e410 0x7fcb701c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb6dd9b700 1 -- 172.21.15.72:0/4064524184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb7009e410 msgr2=0x7fcb701c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb6dd9b700 1 --2- 172.21.15.72:0/4064524184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb7009e410 0x7fcb701c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb6dd9b700 1 -- 172.21.15.72:0/4064524184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7009d6f0 msgr2=0x7fcb701c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb6dd9b700 1 --2- 172.21.15.72:0/4064524184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7009d6f0 0x7fcb701c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb6dd9b700 1 -- 172.21.15.72:0/4064524184 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb64009550 con 0x7fcb7009e000 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.981+0000 7fcb6e59c700 1 --2- 172.21.15.72:0/4064524184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7009d6f0 0x7fcb701c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.982+0000 7fcb6dd9b700 1 --2- 172.21.15.72:0/4064524184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb7009e000 0x7fcb701c8640 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcb7006e510 tx=0x7fcb6400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.982+0000 7fcb5effd700 1 -- 172.21.15.72:0/4064524184 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64004240 con 0x7fcb7009e000 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.982+0000 7fcb5effd700 1 -- 172.21.15.72:0/4064524184 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb640043a0 con 0x7fcb7009e000 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.982+0000 7fcb74e66700 1 -- 172.21.15.72:0/4064524184 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb600094a0 con 0x7fcb7009e000 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.982+0000 7fcb5effd700 1 -- 172.21.15.72:0/4064524184 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb640036a0 con 0x7fcb7009e000 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.982+0000 7fcb74e66700 1 -- 172.21.15.72:0/4064524184 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb701a5bc0 con 0x7fcb7009e000 2023-10-03T10:14:43.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.983+0000 7fcb5effd700 1 -- 172.21.15.72:0/4064524184 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb64003800 con 0x7fcb7009e000 2023-10-03T10:14:43.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.983+0000 7fcb74e66700 1 -- 172.21.15.72:0/4064524184 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb701a6bf0 con 0x7fcb7009e000 2023-10-03T10:14:43.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.983+0000 7fcb5effd700 1 -- 172.21.15.72:0/4064524184 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcb6403f7f0 con 0x7fcb7009e000 2023-10-03T10:14:43.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:43.992+0000 7fcb5effd700 1 -- 172.21.15.72:0/4064524184 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb64011350 con 0x7fcb7009e000 2023-10-03T10:14:44.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.035+0000 7fefaf1c2700 1 Processor -- start 2023-10-03T10:14:44.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.035+0000 7fefaf1c2700 1 -- start start 2023-10-03T10:14:44.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.035+0000 7fefaf1c2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fefa809d6f0 0x7fefa809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.035+0000 7fefaf1c2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefa809e000 0x7fefa81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.035+0000 7fefaf1c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefa809e410 0x7fefa8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.035+0000 7fefaf1c2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa806b460 con 0x7fefa809d6f0 2023-10-03T10:14:44.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.035+0000 7fefaf1c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa809b120 con 0x7fefa809e410 2023-10-03T10:14:44.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.035+0000 7fefaf1c2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefa809a7e0 con 0x7fefa809e000 2023-10-03T10:14:44.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefad75f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefa809e410 0x7fefa8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefa7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefa809e000 0x7fefa81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefacf5e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fefa809d6f0 0x7fefa809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefa7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefa809e000 0x7fefa81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52154/0 (socket says 172.21.15.72:52154) 2023-10-03T10:14:44.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefad75f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefa809e410 0x7fefa8133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40116/0 (socket says 172.21.15.72:40116) 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefa7fff700 1 -- 172.21.15.72:0/2498275762 learned_addr learned my addr 172.21.15.72:0/2498275762 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefa7fff700 1 -- 172.21.15.72:0/2498275762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefa809e410 msgr2=0x7fefa8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefa7fff700 1 --2- 172.21.15.72:0/2498275762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefa809e410 0x7fefa8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefa7fff700 1 -- 172.21.15.72:0/2498275762 >> v2:172.21.15.72:3300/0 conn(0x7fefa809d6f0 msgr2=0x7fefa809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefa7fff700 1 --2- 172.21.15.72:0/2498275762 >> v2:172.21.15.72:3300/0 conn(0x7fefa809d6f0 0x7fefa809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefa7fff700 1 -- 172.21.15.72:0/2498275762 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa809a500 con 0x7fefa809e000 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefacf5e700 1 --2- 172.21.15.72:0/2498275762 >> v2:172.21.15.72:3300/0 conn(0x7fefa809d6f0 0x7fefa809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefa7fff700 1 --2- 172.21.15.72:0/2498275762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefa809e000 0x7fefa81339f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fef94009920 tx=0x7fef94009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5c636cfd95abdb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefa77fe700 1 -- 172.21.15.72:0/2498275762 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94011830 con 0x7fefa809e000 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefa77fe700 1 -- 172.21.15.72:0/2498275762 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef94011990 con 0x7fefa809e000 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.036+0000 7fefa77fe700 1 -- 172.21.15.72:0/2498275762 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94011d20 con 0x7fefa809e000 2023-10-03T10:14:44.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.037+0000 7fefaf1c2700 1 -- 172.21.15.72:0/2498275762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefa809e000 msgr2=0x7fefa81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.037+0000 7fefaf1c2700 1 --2- 172.21.15.72:0/2498275762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefa809e000 0x7fefa81339f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fef94009920 tx=0x7fef94009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:44.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.037+0000 7fefaf1c2700 1 -- 172.21.15.72:0/2498275762 shutdown_connections 2023-10-03T10:14:44.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.037+0000 7fefaf1c2700 1 --2- 172.21.15.72:0/2498275762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefa809e410 0x7fefa8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.037+0000 7fefaf1c2700 1 --2- 172.21.15.72:0/2498275762 >> v2:172.21.15.72:3300/0 conn(0x7fefa809d6f0 0x7fefa809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.037+0000 7fefaf1c2700 1 --2- 172.21.15.72:0/2498275762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefa809e000 0x7fefa81339f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.037+0000 7fefaf1c2700 1 -- 172.21.15.72:0/2498275762 >> 172.21.15.72:0/2498275762 conn(0x7fefa8066f50 msgr2=0x7fefa809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.037+0000 7fefaf1c2700 1 -- 172.21.15.72:0/2498275762 shutdown_connections 2023-10-03T10:14:44.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.037+0000 7fefaf1c2700 1 -- 172.21.15.72:0/2498275762 wait complete. 2023-10-03T10:14:44.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.038+0000 7fefaf1c2700 1 Processor -- start 2023-10-03T10:14:44.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.038+0000 7fefaf1c2700 1 -- start start 2023-10-03T10:14:44.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.038+0000 7fefaf1c2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefa809d6f0 0x7fefa81c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.038+0000 7fefaf1c2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefa809e000 0x7fefa81c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefaf1c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefa809e410 0x7fefa81c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefaf1c2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa81a9500 con 0x7fefa809d6f0 2023-10-03T10:14:44.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefaf1c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa81c5a80 con 0x7fefa809e410 2023-10-03T10:14:44.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefaf1c2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefa809c710 con 0x7fefa809e000 2023-10-03T10:14:44.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefa7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefa809e000 0x7fefa81c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefacf5e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefa809d6f0 0x7fefa81c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefacf5e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefa809d6f0 0x7fefa81c5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43678/0 (socket says 172.21.15.72:43678) 2023-10-03T10:14:44.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefa7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefa809e000 0x7fefa81c5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52158/0 (socket says 172.21.15.72:52158) 2023-10-03T10:14:44.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefacf5e700 1 -- 172.21.15.72:0/1169133523 learned_addr learned my addr 172.21.15.72:0/1169133523 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:44.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefad75f700 1 --2- 172.21.15.72:0/1169133523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefa809e410 0x7fefa81c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefad75f700 1 -- 172.21.15.72:0/1169133523 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefa809e000 msgr2=0x7fefa81c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefad75f700 1 --2- 172.21.15.72:0/1169133523 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefa809e000 0x7fefa81c5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefad75f700 1 -- 172.21.15.72:0/1169133523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefa809d6f0 msgr2=0x7fefa81c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefad75f700 1 --2- 172.21.15.72:0/1169133523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefa809d6f0 0x7fefa81c5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefad75f700 1 -- 172.21.15.72:0/1169133523 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c0094a0 con 0x7fefa809e410 2023-10-03T10:14:44.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefa7fff700 1 --2- 172.21.15.72:0/1169133523 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefa809e000 0x7fefa81c5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefacf5e700 1 --2- 172.21.15.72:0/1169133523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefa809d6f0 0x7fefa81c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefad75f700 1 --2- 172.21.15.72:0/1169133523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefa809e410 0x7fefa81c8040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fefa000efc0 tx=0x7fefa000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefa57fa700 1 -- 172.21.15.72:0/1169133523 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa000cc90 con 0x7fefa809e410 2023-10-03T10:14:44.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefa57fa700 1 -- 172.21.15.72:0/1169133523 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa000f040 con 0x7fefa809e410 2023-10-03T10:14:44.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefaf1c2700 1 -- 172.21.15.72:0/1169133523 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef94009550 con 0x7fefa809e410 2023-10-03T10:14:44.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.039+0000 7fefa57fa700 1 -- 172.21.15.72:0/1169133523 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa00146c0 con 0x7fefa809e410 2023-10-03T10:14:44.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.040+0000 7fefaf1c2700 1 -- 172.21.15.72:0/1169133523 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa81a79b0 con 0x7fefa809e410 2023-10-03T10:14:44.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.040+0000 7fefa57fa700 1 -- 172.21.15.72:0/1169133523 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fefa0014820 con 0x7fefa809e410 2023-10-03T10:14:44.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.040+0000 7fefa57fa700 1 -- 172.21.15.72:0/1169133523 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fefa0040180 con 0x7fefa809e410 2023-10-03T10:14:44.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.041+0000 7fefaf1c2700 1 -- 172.21.15.72:0/1169133523 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa8074ea0 con 0x7fefa809e410 2023-10-03T10:14:44.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.045+0000 7fefa57fa700 1 -- 172.21.15.72:0/1169133523 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fefa001d400 con 0x7fefa809e410 2023-10-03T10:14:44.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.079+0000 7fe7f68e4700 1 -- 172.21.15.72:0/3311206954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe7f006c360 con 0x7fe7f009e000 2023-10-03T10:14:44.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.079+0000 7fe7ecff9700 1 -- 172.21.15.72:0/3311206954 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe7e4017070 con 0x7fe7f009e000 2023-10-03T10:14:44.080 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:44.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.081+0000 7fe7f68e4700 1 -- 172.21.15.72:0/3311206954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f009e000 msgr2=0x7fe7f01a3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.081+0000 7fe7f68e4700 1 --2- 172.21.15.72:0/3311206954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f009e000 0x7fe7f01a3c30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400ec10 tx=0x7fe7e400ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:44.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.081+0000 7fe7f68e4700 1 -- 172.21.15.72:0/3311206954 shutdown_connections 2023-10-03T10:14:44.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.081+0000 7fe7f68e4700 1 --2- 172.21.15.72:0/3311206954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f009d6f0 0x7fe7f01a36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.081+0000 7fe7f68e4700 1 --2- 172.21.15.72:0/3311206954 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7f009e410 0x7fe7f01a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.081+0000 7fe7f68e4700 1 --2- 172.21.15.72:0/3311206954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f009e000 0x7fe7f01a3c30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.081+0000 7fe7f68e4700 1 -- 172.21.15.72:0/3311206954 >> 172.21.15.72:0/3311206954 conn(0x7fe7f0066f50 msgr2=0x7fe7f006f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.081+0000 7fe7f68e4700 1 -- 172.21.15.72:0/3311206954 shutdown_connections 2023-10-03T10:14:44.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.081+0000 7fe7f68e4700 1 -- 172.21.15.72:0/3311206954 wait complete. 2023-10-03T10:14:44.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:44.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.217+0000 7fcb74e66700 1 -- 172.21.15.72:0/4064524184 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcb70074ea0 con 0x7fcb7009e000 2023-10-03T10:14:44.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.217+0000 7fcb5effd700 1 -- 172.21.15.72:0/4064524184 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb6401bb60 con 0x7fcb7009e000 2023-10-03T10:14:44.218 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.220+0000 7fcb74e66700 1 -- 172.21.15.72:0/4064524184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb7009e000 msgr2=0x7fcb701c8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.220+0000 7fcb74e66700 1 --2- 172.21.15.72:0/4064524184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb7009e000 0x7fcb701c8640 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcb7006e510 tx=0x7fcb6400ec80 comp rx=0 tx=0).stop 2023-10-03T10:14:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.220+0000 7fcb74e66700 1 -- 172.21.15.72:0/4064524184 shutdown_connections 2023-10-03T10:14:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.220+0000 7fcb74e66700 1 --2- 172.21.15.72:0/4064524184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7009d6f0 0x7fcb701c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.220+0000 7fcb74e66700 1 --2- 172.21.15.72:0/4064524184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb7009e410 0x7fcb701c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.220+0000 7fcb74e66700 1 --2- 172.21.15.72:0/4064524184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb7009e000 0x7fcb701c8640 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.220+0000 7fcb74e66700 1 -- 172.21.15.72:0/4064524184 >> 172.21.15.72:0/4064524184 conn(0x7fcb70066f50 msgr2=0x7fcb701bbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.220+0000 7fcb74e66700 1 -- 172.21.15.72:0/4064524184 shutdown_connections 2023-10-03T10:14:44.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.220+0000 7fcb74e66700 1 -- 172.21.15.72:0/4064524184 wait complete. 2023-10-03T10:14:44.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:44.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.275+0000 7fefaf1c2700 1 -- 172.21.15.72:0/1169133523 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fefa81a85e0 con 0x7fefa809e410 2023-10-03T10:14:44.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.276+0000 7fefa57fa700 1 -- 172.21.15.72:0/1169133523 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fefa002a030 con 0x7fefa809e410 2023-10-03T10:14:44.276 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.278+0000 7fefaf1c2700 1 -- 172.21.15.72:0/1169133523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefa809e410 msgr2=0x7fefa81c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.278+0000 7fefaf1c2700 1 --2- 172.21.15.72:0/1169133523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefa809e410 0x7fefa81c8040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fefa000efc0 tx=0x7fefa000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.278+0000 7fefaf1c2700 1 -- 172.21.15.72:0/1169133523 shutdown_connections 2023-10-03T10:14:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.278+0000 7fefaf1c2700 1 --2- 172.21.15.72:0/1169133523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefa809d6f0 0x7fefa81c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.278+0000 7fefaf1c2700 1 --2- 172.21.15.72:0/1169133523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefa809e410 0x7fefa81c8040 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.278+0000 7fefaf1c2700 1 --2- 172.21.15.72:0/1169133523 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefa809e000 0x7fefa81c5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.278+0000 7fefaf1c2700 1 -- 172.21.15.72:0/1169133523 >> 172.21.15.72:0/1169133523 conn(0x7fefa8066f50 msgr2=0x7fefa81bac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.278+0000 7fefaf1c2700 1 -- 172.21.15.72:0/1169133523 shutdown_connections 2023-10-03T10:14:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.278+0000 7fefaf1c2700 1 -- 172.21.15.72:0/1169133523 wait complete. 2023-10-03T10:14:44.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:44.693 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.817+0000 7f65ad13a700 1 Processor -- start 2023-10-03T10:14:44.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.817+0000 7f65ad13a700 1 -- start start 2023-10-03T10:14:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65ad13a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65a809d6f0 0x7f65a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65ad13a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65a809e410 0x7f65a8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65ad13a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a809f130 con 0x7f65a809e000 2023-10-03T10:14:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65ad13a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a809f520 con 0x7f65a809e410 2023-10-03T10:14:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65ad13a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a809e930 con 0x7f65a809d6f0 2023-10-03T10:14:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65a759e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65a809e410 0x7f65a8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65a6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65a809d6f0 0x7f65a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65a6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65a809d6f0 0x7f65a809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40130/0 (socket says 172.21.15.72:40130) 2023-10-03T10:14:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65a759e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65a809e410 0x7f65a8130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43690/0 (socket says 172.21.15.72:43690) 2023-10-03T10:14:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65a6d9d700 1 -- 172.21.15.72:0/977433296 learned_addr learned my addr 172.21.15.72:0/977433296 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65a759e700 1 -- 172.21.15.72:0/977433296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65a809d6f0 msgr2=0x7f65a809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65a759e700 1 --2- 172.21.15.72:0/977433296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65a809d6f0 0x7f65a809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65a759e700 1 -- 172.21.15.72:0/977433296 >> v1:172.21.15.72:6789/0 conn(0x7f65a809e000 legacy=0x7f65a8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65a759e700 1 -- 172.21.15.72:0/977433296 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a809b2d0 con 0x7f65a809e410 2023-10-03T10:14:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65a5d9b700 1 -- 172.21.15.72:0/977433296 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010878588 0 0) 0x7f65a809f130 con 0x7f65a809e000 2023-10-03T10:14:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65a6d9d700 1 --2- 172.21.15.72:0/977433296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65a809d6f0 0x7f65a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.818+0000 7f65a759e700 1 --2- 172.21.15.72:0/977433296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a809e410 0x7f65a8130d70 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f65a000bfa0 tx=0x7f65a000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41619a4ad82c02b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.819+0000 7f65a5d9b700 1 -- 172.21.15.72:0/977433296 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a0010070 con 0x7f65a809e410 2023-10-03T10:14:44.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.819+0000 7f65a5d9b700 1 -- 172.21.15.72:0/977433296 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a000b2e0 con 0x7f65a809e410 2023-10-03T10:14:44.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.819+0000 7f65a5d9b700 1 -- 172.21.15.72:0/977433296 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a000dc40 con 0x7f65a809e410 2023-10-03T10:14:44.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.819+0000 7f65ad13a700 1 -- 172.21.15.72:0/977433296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a809e410 msgr2=0x7f65a8130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.819+0000 7f65ad13a700 1 --2- 172.21.15.72:0/977433296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a809e410 0x7f65a8130d70 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f65a000bfa0 tx=0x7f65a000d330 comp rx=0 tx=0).stop 2023-10-03T10:14:44.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.819+0000 7f65ad13a700 1 -- 172.21.15.72:0/977433296 shutdown_connections 2023-10-03T10:14:44.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.819+0000 7f65ad13a700 1 --2- 172.21.15.72:0/977433296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a809e410 0x7f65a8130d70 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.819+0000 7f65ad13a700 1 --2- 172.21.15.72:0/977433296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65a809d6f0 0x7f65a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.819+0000 7f65ad13a700 1 -- 172.21.15.72:0/977433296 >> 172.21.15.72:0/977433296 conn(0x7f65a8066f50 msgr2=0x7f65a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.819+0000 7f65ad13a700 1 -- 172.21.15.72:0/977433296 shutdown_connections 2023-10-03T10:14:44.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.819+0000 7f65ad13a700 1 -- 172.21.15.72:0/977433296 wait complete. 2023-10-03T10:14:44.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.821+0000 7f65ad13a700 1 Processor -- start 2023-10-03T10:14:44.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.821+0000 7f65ad13a700 1 -- start start 2023-10-03T10:14:44.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.821+0000 7f65ad13a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65a809d6f0 0x7f65a811e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.821+0000 7f65ad13a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a809e000 0x7f65a811e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.821+0000 7f65ad13a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f65a809e410 0x7f65a811ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.821+0000 7f65ad13a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a809c790 con 0x7f65a809e000 2023-10-03T10:14:44.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.821+0000 7f65ad13a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a809a0c0 con 0x7f65a809d6f0 2023-10-03T10:14:44.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.821+0000 7f65ad13a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65a8120480 con 0x7f65a809e410 2023-10-03T10:14:44.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.821+0000 7f65a6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65a809d6f0 0x7f65a811e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.821+0000 7f65a759e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f65a809e410 0x7f65a811ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.821+0000 7f65a659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a809e000 0x7f65a811e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.821+0000 7f65a6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65a809d6f0 0x7f65a811e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40140/0 (socket says 172.21.15.72:40140) 2023-10-03T10:14:44.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.821+0000 7f65a6d9d700 1 -- 172.21.15.72:0/4230024762 learned_addr learned my addr 172.21.15.72:0/4230024762 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:44.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.822+0000 7f65a6d9d700 1 -- 172.21.15.72:0/4230024762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f65a809e410 msgr2=0x7f65a811ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.822+0000 7f65a6d9d700 1 --2- 172.21.15.72:0/4230024762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f65a809e410 0x7f65a811ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.822+0000 7f65a6d9d700 1 -- 172.21.15.72:0/4230024762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a809e000 msgr2=0x7f65a811e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.822+0000 7f65a6d9d700 1 --2- 172.21.15.72:0/4230024762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a809e000 0x7f65a811e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.822+0000 7f65a6d9d700 1 -- 172.21.15.72:0/4230024762 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c009550 con 0x7f65a809d6f0 2023-10-03T10:14:44.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.822+0000 7f65a659c700 1 --2- 172.21.15.72:0/4230024762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a809e000 0x7f65a811e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.822+0000 7f65a6d9d700 1 --2- 172.21.15.72:0/4230024762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65a809d6f0 0x7f65a811e010 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f659c010d20 tx=0x7f659c00b420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.822+0000 7f658f7fe700 1 -- 172.21.15.72:0/4230024762 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c015070 con 0x7f65a809d6f0 2023-10-03T10:14:44.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.822+0000 7f658f7fe700 1 -- 172.21.15.72:0/4230024762 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c00bb90 con 0x7f65a809d6f0 2023-10-03T10:14:44.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.822+0000 7f65ad13a700 1 -- 172.21.15.72:0/4230024762 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a000bc80 con 0x7f65a809d6f0 2023-10-03T10:14:44.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.822+0000 7f658f7fe700 1 -- 172.21.15.72:0/4230024762 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c019410 con 0x7f65a809d6f0 2023-10-03T10:14:44.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.822+0000 7f65ad13a700 1 -- 172.21.15.72:0/4230024762 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a8121850 con 0x7f65a809d6f0 2023-10-03T10:14:44.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.823+0000 7f658f7fe700 1 -- 172.21.15.72:0/4230024762 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f659c019570 con 0x7f65a809d6f0 2023-10-03T10:14:44.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.823+0000 7f658f7fe700 1 -- 172.21.15.72:0/4230024762 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f659c0430d0 con 0x7f65a809d6f0 2023-10-03T10:14:44.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.823+0000 7f65ad13a700 1 -- 172.21.15.72:0/4230024762 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a8074ea0 con 0x7f65a809d6f0 2023-10-03T10:14:44.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:44.828+0000 7f658f7fe700 1 -- 172.21.15.72:0/4230024762 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f659c01e020 con 0x7f65a809d6f0 2023-10-03T10:14:45.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.012+0000 7f65ad13a700 1 -- 172.21.15.72:0/4230024762 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f65a80a21b0 con 0x7f65a809d6f0 2023-10-03T10:14:45.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.012+0000 7f658f7fe700 1 -- 172.21.15.72:0/4230024762 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f659c020890 con 0x7f65a809d6f0 2023-10-03T10:14:45.013 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:45.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.014+0000 7f65ad13a700 1 -- 172.21.15.72:0/4230024762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65a809d6f0 msgr2=0x7f65a811e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.014+0000 7f65ad13a700 1 --2- 172.21.15.72:0/4230024762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65a809d6f0 0x7f65a811e010 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f659c010d20 tx=0x7f659c00b420 comp rx=0 tx=0).stop 2023-10-03T10:14:45.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.014+0000 7f65ad13a700 1 -- 172.21.15.72:0/4230024762 shutdown_connections 2023-10-03T10:14:45.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.014+0000 7f65ad13a700 1 --2- 172.21.15.72:0/4230024762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f65a809e410 0x7f65a811ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.014+0000 7f65ad13a700 1 --2- 172.21.15.72:0/4230024762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65a809d6f0 0x7f65a811e010 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.014+0000 7f65ad13a700 1 --2- 172.21.15.72:0/4230024762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a809e000 0x7f65a811e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.014+0000 7f65ad13a700 1 -- 172.21.15.72:0/4230024762 >> 172.21.15.72:0/4230024762 conn(0x7f65a8066f50 msgr2=0x7f65a8070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.014+0000 7f65ad13a700 1 -- 172.21.15.72:0/4230024762 shutdown_connections 2023-10-03T10:14:45.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.014+0000 7f65ad13a700 1 -- 172.21.15.72:0/4230024762 wait complete. 2023-10-03T10:14:45.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:45.095 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:45.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.215+0000 7f3d171fe700 1 Processor -- start 2023-10-03T10:14:45.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.215+0000 7f3d171fe700 1 -- start start 2023-10-03T10:14:45.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.215+0000 7f3d171fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d1009d6f0 0x7f3d1009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.215+0000 7f3d171fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d1009e410 0x7f3d10134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.215+0000 7f3d171fe700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1009b120 con 0x7f3d1009e000 2023-10-03T10:14:45.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.215+0000 7f3d171fe700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1006b460 con 0x7f3d1009e410 2023-10-03T10:14:45.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.215+0000 7f3d171fe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1009a7e0 con 0x7f3d1009d6f0 2023-10-03T10:14:45.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.216+0000 7f3d14f9a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d1009d6f0 0x7f3d1009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.216+0000 7f3d1579b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d1009e410 0x7f3d10134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.216+0000 7f3d14f9a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d1009d6f0 0x7f3d1009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52176/0 (socket says 172.21.15.72:52176) 2023-10-03T10:14:45.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.216+0000 7f3d1579b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d1009e410 0x7f3d10134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43714/0 (socket says 172.21.15.72:43714) 2023-10-03T10:14:45.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.216+0000 7f3d14f9a700 1 -- 172.21.15.72:0/292962691 learned_addr learned my addr 172.21.15.72:0/292962691 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:45.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.216+0000 7f3d14f9a700 1 -- 172.21.15.72:0/292962691 >> v2:172.21.15.72:3300/0 conn(0x7f3d1009e410 msgr2=0x7f3d10134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.216+0000 7f3d14f9a700 1 --2- 172.21.15.72:0/292962691 >> v2:172.21.15.72:3300/0 conn(0x7f3d1009e410 0x7f3d10134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.216+0000 7f3d14f9a700 1 -- 172.21.15.72:0/292962691 >> v1:172.21.15.72:6789/0 conn(0x7f3d1009e000 legacy=0x7f3d101339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.216+0000 7f3d14f9a700 1 -- 172.21.15.72:0/292962691 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1009a500 con 0x7f3d1009d6f0 2023-10-03T10:14:45.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.216+0000 7f3d1579b700 1 --2- 172.21.15.72:0/292962691 >> v2:172.21.15.72:3300/0 conn(0x7f3d1009e410 0x7f3d10134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.216+0000 7f3d14f9a700 1 --2- 172.21.15.72:0/292962691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d1009d6f0 0x7f3d1009dac0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009920 tx=0x7f3d04009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b482f6fd3256a9b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.216+0000 7f3d0f7fe700 1 -- 172.21.15.72:0/292962691 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04011830 con 0x7f3d1009d6f0 2023-10-03T10:14:45.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.216+0000 7f3d0f7fe700 1 -- 172.21.15.72:0/292962691 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d04011990 con 0x7f3d1009d6f0 2023-10-03T10:14:45.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.216+0000 7f3d0f7fe700 1 -- 172.21.15.72:0/292962691 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04011d20 con 0x7f3d1009d6f0 2023-10-03T10:14:45.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.217+0000 7f3d171fe700 1 -- 172.21.15.72:0/292962691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d1009d6f0 msgr2=0x7f3d1009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.217+0000 7f3d171fe700 1 --2- 172.21.15.72:0/292962691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d1009d6f0 0x7f3d1009dac0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009920 tx=0x7f3d04009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:45.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.217+0000 7f3d171fe700 1 -- 172.21.15.72:0/292962691 shutdown_connections 2023-10-03T10:14:45.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.217+0000 7f3d171fe700 1 --2- 172.21.15.72:0/292962691 >> v2:172.21.15.72:3300/0 conn(0x7f3d1009e410 0x7f3d10134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.217+0000 7f3d171fe700 1 --2- 172.21.15.72:0/292962691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d1009d6f0 0x7f3d1009dac0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.217+0000 7f3d171fe700 1 -- 172.21.15.72:0/292962691 >> 172.21.15.72:0/292962691 conn(0x7f3d10066f50 msgr2=0x7f3d1009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.217+0000 7f3d171fe700 1 -- 172.21.15.72:0/292962691 shutdown_connections 2023-10-03T10:14:45.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.217+0000 7f3d171fe700 1 -- 172.21.15.72:0/292962691 wait complete. 2023-10-03T10:14:45.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.218+0000 7f3d171fe700 1 Processor -- start 2023-10-03T10:14:45.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.218+0000 7f3d171fe700 1 -- start start 2023-10-03T10:14:45.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d171fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d1009d6f0 0x7f3d101a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d171fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d1009e000 0x7f3d101a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d171fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d1009e410 0x7f3d101a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d171fe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d100a3480 con 0x7f3d1009d6f0 2023-10-03T10:14:45.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d171fe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d101a6b90 con 0x7f3d1009e000 2023-10-03T10:14:45.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d171fe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d101a7d40 con 0x7f3d1009e410 2023-10-03T10:14:45.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d14f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d1009d6f0 0x7f3d101a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d1579b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d1009e410 0x7f3d101a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d14f9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d1009d6f0 0x7f3d101a4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43730/0 (socket says 172.21.15.72:43730) 2023-10-03T10:14:45.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d1579b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d1009e410 0x7f3d101a5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52190/0 (socket says 172.21.15.72:52190) 2023-10-03T10:14:45.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d14f9a700 1 -- 172.21.15.72:0/1506051279 learned_addr learned my addr 172.21.15.72:0/1506051279 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:45.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d0ffff700 1 --2- 172.21.15.72:0/1506051279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d1009e000 0x7f3d101a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d14f9a700 1 -- 172.21.15.72:0/1506051279 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d1009e410 msgr2=0x7f3d101a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d14f9a700 1 --2- 172.21.15.72:0/1506051279 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d1009e410 0x7f3d101a5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d14f9a700 1 -- 172.21.15.72:0/1506051279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d1009e000 msgr2=0x7f3d101a5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d14f9a700 1 --2- 172.21.15.72:0/1506051279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d1009e000 0x7f3d101a5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d14f9a700 1 -- 172.21.15.72:0/1506051279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d08009a70 con 0x7f3d1009d6f0 2023-10-03T10:14:45.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d1579b700 1 --2- 172.21.15.72:0/1506051279 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d1009e410 0x7f3d101a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d0ffff700 1 --2- 172.21.15.72:0/1506051279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d1009e000 0x7f3d101a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d14f9a700 1 --2- 172.21.15.72:0/1506051279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d1009d6f0 0x7f3d101a4f00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009870 tx=0x7f3d04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.219+0000 7f3d0d7fa700 1 -- 172.21.15.72:0/1506051279 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d040042c0 con 0x7f3d1009d6f0 2023-10-03T10:14:45.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.220+0000 7f3d0d7fa700 1 -- 172.21.15.72:0/1506051279 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0401f070 con 0x7f3d1009d6f0 2023-10-03T10:14:45.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.220+0000 7f3d171fe700 1 -- 172.21.15.72:0/1506051279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d04009550 con 0x7f3d1009d6f0 2023-10-03T10:14:45.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.220+0000 7f3d0d7fa700 1 -- 172.21.15.72:0/1506051279 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d040036a0 con 0x7f3d1009d6f0 2023-10-03T10:14:45.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.220+0000 7f3d171fe700 1 -- 172.21.15.72:0/1506051279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d101a8990 con 0x7f3d1009d6f0 2023-10-03T10:14:45.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.220+0000 7f3d0d7fa700 1 -- 172.21.15.72:0/1506051279 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d04021030 con 0x7f3d1009d6f0 2023-10-03T10:14:45.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.220+0000 7f3d0d7fa700 1 -- 172.21.15.72:0/1506051279 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3d040408e0 con 0x7f3d1009d6f0 2023-10-03T10:14:45.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.221+0000 7f3d171fe700 1 -- 172.21.15.72:0/1506051279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d101a82d0 con 0x7f3d1009d6f0 2023-10-03T10:14:45.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.225+0000 7f3d0d7fa700 1 -- 172.21.15.72:0/1506051279 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d04015080 con 0x7f3d1009d6f0 2023-10-03T10:14:45.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:45.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:45.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.362+0000 7f31b0ac8700 1 Processor -- start 2023-10-03T10:14:45.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.362+0000 7f31b0ac8700 1 -- start start 2023-10-03T10:14:45.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31b0ac8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31ac136710 0x7f31ac138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31b0ac8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31ac139030 0x7f31ac13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31b0ac8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ac06ef30 con 0x7f31ac1338a0 2023-10-03T10:14:45.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31b0ac8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ac06fef0 con 0x7f31ac139030 2023-10-03T10:14:45.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31b0ac8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac1334b0 con 0x7f31ac136710 2023-10-03T10:14:45.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31a9d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31ac136710 0x7f31ac138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31aad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31ac139030 0x7f31ac13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31a9d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31ac136710 0x7f31ac138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52196/0 (socket says 172.21.15.72:52196) 2023-10-03T10:14:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31a9d9b700 1 -- 172.21.15.72:0/571142150 learned_addr learned my addr 172.21.15.72:0/571142150 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31aad9d700 1 -- 172.21.15.72:0/571142150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31ac136710 msgr2=0x7f31ac138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31aad9d700 1 --2- 172.21.15.72:0/571142150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31ac136710 0x7f31ac138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31aad9d700 1 -- 172.21.15.72:0/571142150 >> v1:172.21.15.72:6789/0 conn(0x7f31ac1338a0 legacy=0x7f31ac133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31aad9d700 1 -- 172.21.15.72:0/571142150 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac06fc30 con 0x7f31ac139030 2023-10-03T10:14:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31a9d9b700 1 --2- 172.21.15.72:0/571142150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31ac136710 0x7f31ac138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31aad9d700 1 --2- 172.21.15.72:0/571142150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac139030 0x7f31ac13b410 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009d90 tx=0x7f31a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a033614a99cca98 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.363+0000 7f31a959a700 1 -- 172.21.15.72:0/571142150 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a400e070 con 0x7f31ac139030 2023-10-03T10:14:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.364+0000 7f31a959a700 1 -- 172.21.15.72:0/571142150 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a400bb20 con 0x7f31ac139030 2023-10-03T10:14:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.364+0000 7f31a959a700 1 -- 172.21.15.72:0/571142150 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a4012430 con 0x7f31ac139030 2023-10-03T10:14:45.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.364+0000 7f31b0ac8700 1 -- 172.21.15.72:0/571142150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac139030 msgr2=0x7f31ac13b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.364+0000 7f31b0ac8700 1 --2- 172.21.15.72:0/571142150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac139030 0x7f31ac13b410 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009d90 tx=0x7f31a400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:45.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.364+0000 7f31b0ac8700 1 -- 172.21.15.72:0/571142150 shutdown_connections 2023-10-03T10:14:45.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.364+0000 7f31b0ac8700 1 --2- 172.21.15.72:0/571142150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac139030 0x7f31ac13b410 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.364+0000 7f31b0ac8700 1 --2- 172.21.15.72:0/571142150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31ac136710 0x7f31ac138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.364+0000 7f31b0ac8700 1 -- 172.21.15.72:0/571142150 >> 172.21.15.72:0/571142150 conn(0x7f31ac0a2aa0 msgr2=0x7f31ac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.364+0000 7f31b0ac8700 1 -- 172.21.15.72:0/571142150 shutdown_connections 2023-10-03T10:14:45.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.364+0000 7f31b0ac8700 1 -- 172.21.15.72:0/571142150 wait complete. 2023-10-03T10:14:45.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.365+0000 7f31b0ac8700 1 Processor -- start 2023-10-03T10:14:45.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.365+0000 7f31b0ac8700 1 -- start start 2023-10-03T10:14:45.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31b0ac8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31ac1338a0 0x7f31ac11af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31b0ac8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac136710 0x7f31ac11b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31b0ac8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31ac139030 0x7f31ac11b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31b0ac8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac11ca00 con 0x7f31ac136710 2023-10-03T10:14:45.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31b0ac8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac11eb10 con 0x7f31ac1338a0 2023-10-03T10:14:45.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31b0ac8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31ac11e0a0 con 0x7f31ac139030 2023-10-03T10:14:45.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31aad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31ac139030 0x7f31ac11b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31aad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31ac139030 0x7f31ac11b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52200/0 (socket says 172.21.15.72:52200) 2023-10-03T10:14:45.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31a9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac136710 0x7f31ac11b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31aad9d700 1 -- 172.21.15.72:0/3680487999 learned_addr learned my addr 172.21.15.72:0/3680487999 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:45.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31a9d9b700 1 -- 172.21.15.72:0/3680487999 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31ac139030 msgr2=0x7f31ac11b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31a9d9b700 1 --2- 172.21.15.72:0/3680487999 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31ac139030 0x7f31ac11b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31a9d9b700 1 -- 172.21.15.72:0/3680487999 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31ac1338a0 msgr2=0x7f31ac11af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31a9d9b700 1 --2- 172.21.15.72:0/3680487999 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31ac1338a0 0x7f31ac11af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31a9d9b700 1 -- 172.21.15.72:0/3680487999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a0009550 con 0x7f31ac136710 2023-10-03T10:14:45.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31aad9d700 1 --2- 172.21.15.72:0/3680487999 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31ac139030 0x7f31ac11b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.366+0000 7f31a9d9b700 1 --2- 172.21.15.72:0/3680487999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac136710 0x7f31ac11b490 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f31a000e9a0 tx=0x7f31a000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.367+0000 7f319affd700 1 -- 172.21.15.72:0/3680487999 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0004030 con 0x7f31ac136710 2023-10-03T10:14:45.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.367+0000 7f319affd700 1 -- 172.21.15.72:0/3680487999 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a0004190 con 0x7f31ac136710 2023-10-03T10:14:45.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.367+0000 7f319affd700 1 -- 172.21.15.72:0/3680487999 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0004520 con 0x7f31ac136710 2023-10-03T10:14:45.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.367+0000 7f31b0ac8700 1 -- 172.21.15.72:0/3680487999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a4009a70 con 0x7f31ac136710 2023-10-03T10:14:45.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.367+0000 7f31b0ac8700 1 -- 172.21.15.72:0/3680487999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ac11e630 con 0x7f31ac136710 2023-10-03T10:14:45.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.368+0000 7f31b0ac8700 1 -- 172.21.15.72:0/3680487999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ac074ea0 con 0x7f31ac136710 2023-10-03T10:14:45.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.368+0000 7f319affd700 1 -- 172.21.15.72:0/3680487999 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31a000c850 con 0x7f31ac136710 2023-10-03T10:14:45.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.368+0000 7f319affd700 1 -- 172.21.15.72:0/3680487999 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f31a003fe40 con 0x7f31ac136710 2023-10-03T10:14:45.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.376+0000 7f319affd700 1 -- 172.21.15.72:0/3680487999 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31a0044060 con 0x7f31ac136710 2023-10-03T10:14:45.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.418+0000 7fbe0ddfe700 1 Processor -- start 2023-10-03T10:14:45.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.418+0000 7fbe0ddfe700 1 -- start start 2023-10-03T10:14:45.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.419+0000 7fbe0ddfe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbe08131630 0x7fbe08131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.419+0000 7fbe0ddfe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbe0806eba0 0x7fbe08139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.419+0000 7fbe0ddfe700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe08071a00 con 0x7fbe08131f40 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.419+0000 7fbe0ddfe700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe08131430 con 0x7fbe08131630 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.419+0000 7fbe0ddfe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0809a510 con 0x7fbe0806eba0 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.419+0000 7fbe077fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbe08131630 0x7fbe08131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.419+0000 7fbe07fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbe0806eba0 0x7fbe08139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.419+0000 7fbe06ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbe08131f40 0x7fbe0806e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43964/0 (socket says 172.21.15.72:43964) 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.419+0000 7fbe077fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbe08131630 0x7fbe08131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43766/0 (socket says 172.21.15.72:43766) 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.419+0000 7fbe06ffd700 1 -- 172.21.15.72:0/3663405591 learned_addr learned my addr 172.21.15.72:0/3663405591 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:45.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.419+0000 7fbe07fff700 1 -- 172.21.15.72:0/3663405591 >> v2:172.21.15.72:3300/0 conn(0x7fbe08131630 msgr2=0x7fbe08131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.419+0000 7fbe07fff700 1 --2- 172.21.15.72:0/3663405591 >> v2:172.21.15.72:3300/0 conn(0x7fbe08131630 0x7fbe08131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.419+0000 7fbe07fff700 1 -- 172.21.15.72:0/3663405591 >> v1:172.21.15.72:6789/0 conn(0x7fbe08131f40 legacy=0x7fbe0806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.419+0000 7fbe07fff700 1 -- 172.21.15.72:0/3663405591 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe080721c0 con 0x7fbe0806eba0 2023-10-03T10:14:45.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.420+0000 7fbe077fe700 1 --2- 172.21.15.72:0/3663405591 >> v2:172.21.15.72:3300/0 conn(0x7fbe08131630 0x7fbe08131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.420+0000 7fbe07fff700 1 --2- 172.21.15.72:0/3663405591 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbe0806eba0 0x7fbe08139660 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009d90 tx=0x7fbe0000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebad0b98acf82776 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.420+0000 7fbe067fc700 1 -- 172.21.15.72:0/3663405591 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0000e070 con 0x7fbe0806eba0 2023-10-03T10:14:45.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.420+0000 7fbe067fc700 1 -- 172.21.15.72:0/3663405591 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0000bb20 con 0x7fbe0806eba0 2023-10-03T10:14:45.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.420+0000 7fbe067fc700 1 -- 172.21.15.72:0/3663405591 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00012430 con 0x7fbe0806eba0 2023-10-03T10:14:45.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.421+0000 7fbe0ddfe700 1 -- 172.21.15.72:0/3663405591 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbe0806eba0 msgr2=0x7fbe08139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.421+0000 7fbe0ddfe700 1 --2- 172.21.15.72:0/3663405591 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbe0806eba0 0x7fbe08139660 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009d90 tx=0x7fbe0000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:45.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.421+0000 7fbe0ddfe700 1 -- 172.21.15.72:0/3663405591 shutdown_connections 2023-10-03T10:14:45.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.421+0000 7fbe0ddfe700 1 --2- 172.21.15.72:0/3663405591 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbe0806eba0 0x7fbe08139660 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.421+0000 7fbe0ddfe700 1 --2- 172.21.15.72:0/3663405591 >> v2:172.21.15.72:3300/0 conn(0x7fbe08131630 0x7fbe08131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.421+0000 7fbe0ddfe700 1 -- 172.21.15.72:0/3663405591 >> 172.21.15.72:0/3663405591 conn(0x7fbe080a2aa0 msgr2=0x7fbe080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.421+0000 7fbe0ddfe700 1 -- 172.21.15.72:0/3663405591 shutdown_connections 2023-10-03T10:14:45.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.421+0000 7fbe0ddfe700 1 -- 172.21.15.72:0/3663405591 wait complete. 2023-10-03T10:14:45.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.422+0000 7fbe0ddfe700 1 Processor -- start 2023-10-03T10:14:45.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.422+0000 7fbe0ddfe700 1 -- start start 2023-10-03T10:14:45.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7f3d171fe700 1 -- 172.21.15.72:0/1506051279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3d10074ea0 con 0x7f3d1009d6f0 2023-10-03T10:14:45.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe0ddfe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe0806eba0 0x7fbe0806f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe0ddfe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbe08131630 0x7fbe0806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe0ddfe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe08131f40 0x7fbe08070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe0ddfe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08121060 con 0x7fbe08131f40 2023-10-03T10:14:45.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe0ddfe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08121260 con 0x7fbe0806eba0 2023-10-03T10:14:45.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe0ddfe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08120150 con 0x7fbe08131630 2023-10-03T10:14:45.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7f3d0d7fa700 1 -- 172.21.15.72:0/1506051279 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3d040239c0 con 0x7f3d1009d6f0 2023-10-03T10:14:45.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe06ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbe08131630 0x7fbe0806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe077fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe0806eba0 0x7fbe0806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe07fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe08131f40 0x7fbe08070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe077fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe0806eba0 0x7fbe0806f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40166/0 (socket says 172.21.15.72:40166) 2023-10-03T10:14:45.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe07fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe08131f40 0x7fbe08070090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43782/0 (socket says 172.21.15.72:43782) 2023-10-03T10:14:45.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe06ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbe08131630 0x7fbe0806fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52230/0 (socket says 172.21.15.72:52230) 2023-10-03T10:14:45.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe077fe700 1 -- 172.21.15.72:0/1255335803 learned_addr learned my addr 172.21.15.72:0/1255335803 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:45.427 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:45.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe07fff700 1 -- 172.21.15.72:0/1255335803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbe08131630 msgr2=0x7fbe0806fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe07fff700 1 --2- 172.21.15.72:0/1255335803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbe08131630 0x7fbe0806fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe07fff700 1 -- 172.21.15.72:0/1255335803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe0806eba0 msgr2=0x7fbe0806f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe07fff700 1 --2- 172.21.15.72:0/1255335803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe0806eba0 0x7fbe0806f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.423+0000 7fbe07fff700 1 -- 172.21.15.72:0/1255335803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80094a0 con 0x7fbe08131f40 2023-10-03T10:14:45.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.424+0000 7fbe07fff700 1 --2- 172.21.15.72:0/1255335803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe08131f40 0x7fbe08070090 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fbe00016000 tx=0x7fbe00004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.424+0000 7fbdeffff700 1 -- 172.21.15.72:0/1255335803 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00012430 con 0x7fbe08131f40 2023-10-03T10:14:45.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.424+0000 7fbdeffff700 1 -- 172.21.15.72:0/1255335803 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe00020070 con 0x7fbe08131f40 2023-10-03T10:14:45.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.424+0000 7fbdeffff700 1 -- 172.21.15.72:0/1255335803 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00004280 con 0x7fbe08131f40 2023-10-03T10:14:45.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.424+0000 7fbe0ddfe700 1 -- 172.21.15.72:0/1255335803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe00009a70 con 0x7fbe08131f40 2023-10-03T10:14:45.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.424+0000 7fbe0ddfe700 1 -- 172.21.15.72:0/1255335803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0812ec20 con 0x7fbe08131f40 2023-10-03T10:14:45.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.425+0000 7fbdeffff700 1 -- 172.21.15.72:0/1255335803 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe000043e0 con 0x7fbe08131f40 2023-10-03T10:14:45.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.425+0000 7fbdeffff700 1 -- 172.21.15.72:0/1255335803 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbe00022070 con 0x7fbe08131f40 2023-10-03T10:14:45.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.425+0000 7fbe0ddfe700 1 -- 172.21.15.72:0/1255335803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe08120ea0 con 0x7fbe08131f40 2023-10-03T10:14:45.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.425+0000 7f3d171fe700 1 -- 172.21.15.72:0/1506051279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d1009d6f0 msgr2=0x7f3d101a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.425+0000 7f3d171fe700 1 --2- 172.21.15.72:0/1506051279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d1009d6f0 0x7f3d101a4f00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009870 tx=0x7f3d04004750 comp rx=0 tx=0).stop 2023-10-03T10:14:45.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.426+0000 7f3d171fe700 1 -- 172.21.15.72:0/1506051279 shutdown_connections 2023-10-03T10:14:45.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.426+0000 7f3d171fe700 1 --2- 172.21.15.72:0/1506051279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d1009d6f0 0x7f3d101a4f00 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.426+0000 7f3d171fe700 1 --2- 172.21.15.72:0/1506051279 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3d1009e410 0x7f3d101a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.426+0000 7f3d171fe700 1 --2- 172.21.15.72:0/1506051279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d1009e000 0x7f3d101a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.426+0000 7f3d171fe700 1 -- 172.21.15.72:0/1506051279 >> 172.21.15.72:0/1506051279 conn(0x7f3d10066f50 msgr2=0x7f3d101bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.426+0000 7f3d171fe700 1 -- 172.21.15.72:0/1506051279 shutdown_connections 2023-10-03T10:14:45.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.426+0000 7f3d171fe700 1 -- 172.21.15.72:0/1506051279 wait complete. 2023-10-03T10:14:45.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.430+0000 7fbdeffff700 1 -- 172.21.15.72:0/1255335803 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe0002c080 con 0x7fbe08131f40 2023-10-03T10:14:45.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:45.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.575+0000 7f31b0ac8700 1 -- 172.21.15.72:0/3680487999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f31ac11d1f0 con 0x7f31ac136710 2023-10-03T10:14:45.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.575+0000 7f319affd700 1 -- 172.21.15.72:0/3680487999 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31a0044070 con 0x7f31ac136710 2023-10-03T10:14:45.576 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:45.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.577+0000 7f31b0ac8700 1 -- 172.21.15.72:0/3680487999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac136710 msgr2=0x7f31ac11b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.577+0000 7f31b0ac8700 1 --2- 172.21.15.72:0/3680487999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac136710 0x7f31ac11b490 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f31a000e9a0 tx=0x7f31a000ecb0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.577+0000 7f31b0ac8700 1 -- 172.21.15.72:0/3680487999 shutdown_connections 2023-10-03T10:14:45.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.577+0000 7f31b0ac8700 1 --2- 172.21.15.72:0/3680487999 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31ac139030 0x7f31ac11b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.577+0000 7f31b0ac8700 1 --2- 172.21.15.72:0/3680487999 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31ac1338a0 0x7f31ac11af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.577+0000 7f31b0ac8700 1 --2- 172.21.15.72:0/3680487999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31ac136710 0x7f31ac11b490 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.577+0000 7f31b0ac8700 1 -- 172.21.15.72:0/3680487999 >> 172.21.15.72:0/3680487999 conn(0x7f31ac0a2aa0 msgr2=0x7f31ac137200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.577+0000 7f31b0ac8700 1 -- 172.21.15.72:0/3680487999 shutdown_connections 2023-10-03T10:14:45.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.578+0000 7f31b0ac8700 1 -- 172.21.15.72:0/3680487999 wait complete. 2023-10-03T10:14:45.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:45.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.626+0000 7fbe0ddfe700 1 -- 172.21.15.72:0/1255335803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbe08099f20 con 0x7fbe08131f40 2023-10-03T10:14:45.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.626+0000 7fbdeffff700 1 -- 172.21.15.72:0/1255335803 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbe0001c400 con 0x7fbe08131f40 2023-10-03T10:14:45.627 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:45.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.628+0000 7fbe0ddfe700 1 -- 172.21.15.72:0/1255335803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe08131f40 msgr2=0x7fbe08070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.628+0000 7fbe0ddfe700 1 --2- 172.21.15.72:0/1255335803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe08131f40 0x7fbe08070090 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fbe00016000 tx=0x7fbe00004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.628+0000 7fbe0ddfe700 1 -- 172.21.15.72:0/1255335803 shutdown_connections 2023-10-03T10:14:45.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.628+0000 7fbe0ddfe700 1 --2- 172.21.15.72:0/1255335803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe08131f40 0x7fbe08070090 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.628+0000 7fbe0ddfe700 1 --2- 172.21.15.72:0/1255335803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe0806eba0 0x7fbe0806f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.628+0000 7fbe0ddfe700 1 --2- 172.21.15.72:0/1255335803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbe08131630 0x7fbe0806fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.628+0000 7fbe0ddfe700 1 -- 172.21.15.72:0/1255335803 >> 172.21.15.72:0/1255335803 conn(0x7fbe080a2aa0 msgr2=0x7fbe081b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.629+0000 7fbe0ddfe700 1 -- 172.21.15.72:0/1255335803 shutdown_connections 2023-10-03T10:14:45.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:45.629+0000 7fbe0ddfe700 1 -- 172.21.15.72:0/1255335803 wait complete. 2023-10-03T10:14:45.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:46.028 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:46.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.150+0000 7fb6cc6da700 1 Processor -- start 2023-10-03T10:14:46.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.150+0000 7fb6cc6da700 1 -- start start 2023-10-03T10:14:46.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6cc6da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6c409e1d0 0x7fb6c4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6cc6da700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6c4139170 0x7fb6c413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6cc6da700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c409b120 con 0x7fb6c409d6f0 2023-10-03T10:14:46.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6cc6da700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c406b460 con 0x7fb6c4139170 2023-10-03T10:14:46.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6cc6da700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c409a7e0 con 0x7fb6c409e1d0 2023-10-03T10:14:46.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6c9c75700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6c409e1d0 0x7fb6c4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6c9c75700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6c409e1d0 0x7fb6c4138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52234/0 (socket says 172.21.15.72:52234) 2023-10-03T10:14:46.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6c9c75700 1 -- 172.21.15.72:0/3142282288 learned_addr learned my addr 172.21.15.72:0/3142282288 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:46.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6cac77700 1 --2- 172.21.15.72:0/3142282288 >> v2:172.21.15.72:3300/0 conn(0x7fb6c4139170 0x7fb6c413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6c9c75700 1 -- 172.21.15.72:0/3142282288 >> v2:172.21.15.72:3300/0 conn(0x7fb6c4139170 msgr2=0x7fb6c413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6c9c75700 1 --2- 172.21.15.72:0/3142282288 >> v2:172.21.15.72:3300/0 conn(0x7fb6c4139170 0x7fb6c413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6c9c75700 1 -- 172.21.15.72:0/3142282288 >> v1:172.21.15.72:6789/0 conn(0x7fb6c409d6f0 legacy=0x7fb6c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6c9c75700 1 -- 172.21.15.72:0/3142282288 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c409a500 con 0x7fb6c409e1d0 2023-10-03T10:14:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6c9c75700 1 --2- 172.21.15.72:0/3142282288 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6c409e1d0 0x7fb6c4138c30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009920 tx=0x7fb6c0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efd60981dac00dba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6c9474700 1 -- 172.21.15.72:0/3142282288 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0011830 con 0x7fb6c409e1d0 2023-10-03T10:14:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6c9474700 1 -- 172.21.15.72:0/3142282288 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c0011990 con 0x7fb6c409e1d0 2023-10-03T10:14:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.151+0000 7fb6c9474700 1 -- 172.21.15.72:0/3142282288 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0011d20 con 0x7fb6c409e1d0 2023-10-03T10:14:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.152+0000 7fb6cc6da700 1 -- 172.21.15.72:0/3142282288 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6c409e1d0 msgr2=0x7fb6c4138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.152+0000 7fb6cc6da700 1 --2- 172.21.15.72:0/3142282288 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6c409e1d0 0x7fb6c4138c30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009920 tx=0x7fb6c0009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.152+0000 7fb6cc6da700 1 -- 172.21.15.72:0/3142282288 shutdown_connections 2023-10-03T10:14:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.152+0000 7fb6cc6da700 1 --2- 172.21.15.72:0/3142282288 >> v2:172.21.15.72:3300/0 conn(0x7fb6c4139170 0x7fb6c413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.152+0000 7fb6cc6da700 1 --2- 172.21.15.72:0/3142282288 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6c409e1d0 0x7fb6c4138c30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.152+0000 7fb6cc6da700 1 -- 172.21.15.72:0/3142282288 >> 172.21.15.72:0/3142282288 conn(0x7fb6c4066f50 msgr2=0x7fb6c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.152+0000 7fb6cc6da700 1 -- 172.21.15.72:0/3142282288 shutdown_connections 2023-10-03T10:14:46.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.152+0000 7fb6cc6da700 1 -- 172.21.15.72:0/3142282288 wait complete. 2023-10-03T10:14:46.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.153+0000 7fb6cc6da700 1 Processor -- start 2023-10-03T10:14:46.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.153+0000 7fb6cc6da700 1 -- start start 2023-10-03T10:14:46.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.153+0000 7fb6cc6da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6c409d6f0 0x7fb6c41209f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.153+0000 7fb6cc6da700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c409e1d0 0x7fb6c4120f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.153+0000 7fb6cc6da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6c4139170 0x7fb6c4121470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.153+0000 7fb6cc6da700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c4122780 con 0x7fb6c409e1d0 2023-10-03T10:14:46.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.153+0000 7fb6cc6da700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c4124730 con 0x7fb6c409d6f0 2023-10-03T10:14:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.153+0000 7fb6cc6da700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c4124230 con 0x7fb6c4139170 2023-10-03T10:14:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.153+0000 7fb6c9c75700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c409e1d0 0x7fb6c4120f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.153+0000 7fb6ca476700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6c409d6f0 0x7fb6c41209f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.153+0000 7fb6c9c75700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c409e1d0 0x7fb6c4120f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43800/0 (socket says 172.21.15.72:43800) 2023-10-03T10:14:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.153+0000 7fb6c9c75700 1 -- 172.21.15.72:0/778997417 learned_addr learned my addr 172.21.15.72:0/778997417 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.153+0000 7fb6cac77700 1 --2- 172.21.15.72:0/778997417 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6c4139170 0x7fb6c4121470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.154+0000 7fb6c9c75700 1 -- 172.21.15.72:0/778997417 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6c4139170 msgr2=0x7fb6c4121470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.154+0000 7fb6c9c75700 1 --2- 172.21.15.72:0/778997417 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6c4139170 0x7fb6c4121470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.154+0000 7fb6c9c75700 1 -- 172.21.15.72:0/778997417 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6c409d6f0 msgr2=0x7fb6c41209f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.154+0000 7fb6c9c75700 1 --2- 172.21.15.72:0/778997417 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6c409d6f0 0x7fb6c41209f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.154+0000 7fb6c9c75700 1 -- 172.21.15.72:0/778997417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c0009550 con 0x7fb6c409e1d0 2023-10-03T10:14:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.154+0000 7fb6c9c75700 1 --2- 172.21.15.72:0/778997417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c409e1d0 0x7fb6c4120f30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009870 tx=0x7fb6c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.154+0000 7fb6baffd700 1 -- 172.21.15.72:0/778997417 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0004300 con 0x7fb6c409e1d0 2023-10-03T10:14:46.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.154+0000 7fb6baffd700 1 -- 172.21.15.72:0/778997417 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c001f070 con 0x7fb6c409e1d0 2023-10-03T10:14:46.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.154+0000 7fb6baffd700 1 -- 172.21.15.72:0/778997417 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c00036a0 con 0x7fb6c409e1d0 2023-10-03T10:14:46.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.154+0000 7fb6cc6da700 1 -- 172.21.15.72:0/778997417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c4123ca0 con 0x7fb6c409e1d0 2023-10-03T10:14:46.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.154+0000 7fb6cc6da700 1 -- 172.21.15.72:0/778997417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c4122e00 con 0x7fb6c409e1d0 2023-10-03T10:14:46.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.155+0000 7fb6baffd700 1 -- 172.21.15.72:0/778997417 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6c0021030 con 0x7fb6c409e1d0 2023-10-03T10:14:46.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.155+0000 7fb6baffd700 1 -- 172.21.15.72:0/778997417 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb6c0040870 con 0x7fb6c409e1d0 2023-10-03T10:14:46.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.155+0000 7fb6cc6da700 1 -- 172.21.15.72:0/778997417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c4074ea0 con 0x7fb6c409e1d0 2023-10-03T10:14:46.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.159+0000 7fb6baffd700 1 -- 172.21.15.72:0/778997417 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6c0015070 con 0x7fb6c409e1d0 2023-10-03T10:14:46.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.342+0000 7fb6cc6da700 1 -- 172.21.15.72:0/778997417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb6c406c360 con 0x7fb6c409e1d0 2023-10-03T10:14:46.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.342+0000 7fb6baffd700 1 -- 172.21.15.72:0/778997417 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6c00239c0 con 0x7fb6c409e1d0 2023-10-03T10:14:46.343 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.344+0000 7fb6cc6da700 1 -- 172.21.15.72:0/778997417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c409e1d0 msgr2=0x7fb6c4120f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.344+0000 7fb6cc6da700 1 --2- 172.21.15.72:0/778997417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c409e1d0 0x7fb6c4120f30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009870 tx=0x7fb6c0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.344+0000 7fb6cc6da700 1 -- 172.21.15.72:0/778997417 shutdown_connections 2023-10-03T10:14:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.344+0000 7fb6cc6da700 1 --2- 172.21.15.72:0/778997417 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6c4139170 0x7fb6c4121470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.344+0000 7fb6cc6da700 1 --2- 172.21.15.72:0/778997417 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6c409d6f0 0x7fb6c41209f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.344+0000 7fb6cc6da700 1 --2- 172.21.15.72:0/778997417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c409e1d0 0x7fb6c4120f30 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.344+0000 7fb6cc6da700 1 -- 172.21.15.72:0/778997417 >> 172.21.15.72:0/778997417 conn(0x7fb6c4066f50 msgr2=0x7fb6c409b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.344+0000 7fb6cc6da700 1 -- 172.21.15.72:0/778997417 shutdown_connections 2023-10-03T10:14:46.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.344+0000 7fb6cc6da700 1 -- 172.21.15.72:0/778997417 wait complete. 2023-10-03T10:14:46.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:46.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:46.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.562+0000 7fd1e7498700 1 Processor -- start 2023-10-03T10:14:46.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.562+0000 7fd1e7498700 1 -- start start 2023-10-03T10:14:46.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e7498700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1e009e1d0 0x7fd1e0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e7498700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1e0139170 0x7fd1e013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e7498700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e009b120 con 0x7fd1e009d6f0 2023-10-03T10:14:46.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e7498700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e006b460 con 0x7fd1e009e1d0 2023-10-03T10:14:46.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e7498700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e009a7e0 con 0x7fd1e0139170 2023-10-03T10:14:46.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e4a33700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1e009e1d0 0x7fd1e0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e5a35700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1e0139170 0x7fd1e013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e4a33700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1e009e1d0 0x7fd1e0138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43810/0 (socket says 172.21.15.72:43810) 2023-10-03T10:14:46.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e5a35700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1e0139170 0x7fd1e013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52254/0 (socket says 172.21.15.72:52254) 2023-10-03T10:14:46.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e4a33700 1 -- 172.21.15.72:0/1659397739 learned_addr learned my addr 172.21.15.72:0/1659397739 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:46.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e4a33700 1 -- 172.21.15.72:0/1659397739 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1e0139170 msgr2=0x7fd1e013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:46.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e4a33700 1 --2- 172.21.15.72:0/1659397739 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1e0139170 0x7fd1e013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e4a33700 1 -- 172.21.15.72:0/1659397739 >> v1:172.21.15.72:6789/0 conn(0x7fd1e009d6f0 legacy=0x7fd1e009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e4a33700 1 -- 172.21.15.72:0/1659397739 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e009a500 con 0x7fd1e009e1d0 2023-10-03T10:14:46.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e5a35700 1 --2- 172.21.15.72:0/1659397739 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1e0139170 0x7fd1e013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:46.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1e4a33700 1 --2- 172.21.15.72:0/1659397739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e009e1d0 0x7fd1e0138c30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009920 tx=0x7fd1d0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25add64d58ea0334 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.563+0000 7fd1d7fff700 1 -- 172.21.15.72:0/1659397739 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0011830 con 0x7fd1e009e1d0 2023-10-03T10:14:46.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.564+0000 7fd1d7fff700 1 -- 172.21.15.72:0/1659397739 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d0011990 con 0x7fd1e009e1d0 2023-10-03T10:14:46.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.564+0000 7fd1d7fff700 1 -- 172.21.15.72:0/1659397739 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0011d20 con 0x7fd1e009e1d0 2023-10-03T10:14:46.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.564+0000 7fd1e7498700 1 -- 172.21.15.72:0/1659397739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e009e1d0 msgr2=0x7fd1e0138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.564+0000 7fd1e7498700 1 --2- 172.21.15.72:0/1659397739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e009e1d0 0x7fd1e0138c30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009920 tx=0x7fd1d0009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:46.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.564+0000 7fd1e7498700 1 -- 172.21.15.72:0/1659397739 shutdown_connections 2023-10-03T10:14:46.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.564+0000 7fd1e7498700 1 --2- 172.21.15.72:0/1659397739 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1e0139170 0x7fd1e013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.564+0000 7fd1e7498700 1 --2- 172.21.15.72:0/1659397739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e009e1d0 0x7fd1e0138c30 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.564+0000 7fd1e7498700 1 -- 172.21.15.72:0/1659397739 >> 172.21.15.72:0/1659397739 conn(0x7fd1e0066f50 msgr2=0x7fd1e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.564+0000 7fd1e7498700 1 -- 172.21.15.72:0/1659397739 shutdown_connections 2023-10-03T10:14:46.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.564+0000 7fd1e7498700 1 -- 172.21.15.72:0/1659397739 wait complete. 2023-10-03T10:14:46.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.565+0000 7fd1e7498700 1 Processor -- start 2023-10-03T10:14:46.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.565+0000 7fd1e7498700 1 -- start start 2023-10-03T10:14:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.565+0000 7fd1e7498700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1e009d6f0 0x7fd1e011f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.565+0000 7fd1e7498700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1e009e1d0 0x7fd1e011fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.565+0000 7fd1e7498700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e0139170 0x7fd1e01c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e7498700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e0121f20 con 0x7fd1e0139170 2023-10-03T10:14:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e7498700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00a1b40 con 0x7fd1e009e1d0 2023-10-03T10:14:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e7498700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e009c710 con 0x7fd1e009d6f0 2023-10-03T10:14:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e5a35700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e0139170 0x7fd1e01c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e4a33700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1e009e1d0 0x7fd1e011fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e5a35700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e0139170 0x7fd1e01c8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43820/0 (socket says 172.21.15.72:43820) 2023-10-03T10:14:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e5a35700 1 -- 172.21.15.72:0/3684210088 learned_addr learned my addr 172.21.15.72:0/3684210088 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:46.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e5234700 1 --2- 172.21.15.72:0/3684210088 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1e009d6f0 0x7fd1e011f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e5a35700 1 -- 172.21.15.72:0/3684210088 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1e009d6f0 msgr2=0x7fd1e011f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e5a35700 1 --2- 172.21.15.72:0/3684210088 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1e009d6f0 0x7fd1e011f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e5a35700 1 -- 172.21.15.72:0/3684210088 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1e009e1d0 msgr2=0x7fd1e011fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e5a35700 1 --2- 172.21.15.72:0/3684210088 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1e009e1d0 0x7fd1e011fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e5a35700 1 -- 172.21.15.72:0/3684210088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d8009a70 con 0x7fd1e0139170 2023-10-03T10:14:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e4a33700 1 --2- 172.21.15.72:0/3684210088 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1e009e1d0 0x7fd1e011fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e5a35700 1 --2- 172.21.15.72:0/3684210088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e0139170 0x7fd1e01c8670 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800ef90 tx=0x7fd1d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1d5ffb700 1 -- 172.21.15.72:0/3684210088 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800cc90 con 0x7fd1e0139170 2023-10-03T10:14:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1d5ffb700 1 -- 172.21.15.72:0/3684210088 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d800f040 con 0x7fd1e0139170 2023-10-03T10:14:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e7498700 1 -- 172.21.15.72:0/3684210088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d0009550 con 0x7fd1e0139170 2023-10-03T10:14:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1d5ffb700 1 -- 172.21.15.72:0/3684210088 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d80146c0 con 0x7fd1e0139170 2023-10-03T10:14:46.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.566+0000 7fd1e7498700 1 -- 172.21.15.72:0/3684210088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e011ffa0 con 0x7fd1e0139170 2023-10-03T10:14:46.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.567+0000 7fd1d5ffb700 1 -- 172.21.15.72:0/3684210088 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1d8014820 con 0x7fd1e0139170 2023-10-03T10:14:46.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.567+0000 7fd1d5ffb700 1 -- 172.21.15.72:0/3684210088 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd1d8040320 con 0x7fd1e0139170 2023-10-03T10:14:46.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.567+0000 7fd1e7498700 1 -- 172.21.15.72:0/3684210088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e009c920 con 0x7fd1e0139170 2023-10-03T10:14:46.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.572+0000 7fd1d5ffb700 1 -- 172.21.15.72:0/3684210088 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1d8018030 con 0x7fd1e0139170 2023-10-03T10:14:46.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:46.642 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:46.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.722+0000 7f9db9115700 1 Processor -- start 2023-10-03T10:14:46.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.722+0000 7f9db9115700 1 -- start start 2023-10-03T10:14:46.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.723+0000 7f9db9115700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9db40a0090 0x7f9db4136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.723+0000 7f9db9115700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9db409d130 0x7f9db4139170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.723+0000 7f9db9115700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db409ba70 con 0x7f9db409c650 2023-10-03T10:14:46.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.723+0000 7f9db9115700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db409e8f0 con 0x7f9db409d130 2023-10-03T10:14:46.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.723+0000 7f9db9115700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40a0760 con 0x7f9db40a0090 2023-10-03T10:14:46.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.723+0000 7f9db359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9db409d130 0x7f9db4139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.723+0000 7f9db359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9db409d130 0x7f9db4139170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40190/0 (socket says 172.21.15.72:40190) 2023-10-03T10:14:46.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.723+0000 7f9db259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9db40a0090 0x7f9db4136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.723+0000 7f9db359e700 1 -- 172.21.15.72:0/2061476444 learned_addr learned my addr 172.21.15.72:0/2061476444 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:46.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.723+0000 7f9db359e700 1 -- 172.21.15.72:0/2061476444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9db40a0090 msgr2=0x7f9db4136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:46.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.723+0000 7f9db359e700 1 --2- 172.21.15.72:0/2061476444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9db40a0090 0x7f9db4136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.723+0000 7f9db359e700 1 -- 172.21.15.72:0/2061476444 >> v1:172.21.15.72:6789/0 conn(0x7f9db409c650 legacy=0x7f9db409ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.723+0000 7f9db359e700 1 -- 172.21.15.72:0/2061476444 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db409a080 con 0x7f9db409d130 2023-10-03T10:14:46.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.724+0000 7f9db359e700 1 --2- 172.21.15.72:0/2061476444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9db409d130 0x7f9db4139170 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009e80 tx=0x7f9dac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70343afda94a811d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.724+0000 7f9db1d9b700 1 -- 172.21.15.72:0/2061476444 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00e070 con 0x7f9db409d130 2023-10-03T10:14:46.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.724+0000 7f9db1d9b700 1 -- 172.21.15.72:0/2061476444 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac00b910 con 0x7f9db409d130 2023-10-03T10:14:46.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.724+0000 7f9db1d9b700 1 -- 172.21.15.72:0/2061476444 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00bcc0 con 0x7f9db409d130 2023-10-03T10:14:46.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.724+0000 7f9db9115700 1 -- 172.21.15.72:0/2061476444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9db409d130 msgr2=0x7f9db4139170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.724+0000 7f9db9115700 1 --2- 172.21.15.72:0/2061476444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9db409d130 0x7f9db4139170 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009e80 tx=0x7f9dac00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:46.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.724+0000 7f9db9115700 1 -- 172.21.15.72:0/2061476444 shutdown_connections 2023-10-03T10:14:46.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.724+0000 7f9db9115700 1 --2- 172.21.15.72:0/2061476444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9db409d130 0x7f9db4139170 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.724+0000 7f9db9115700 1 --2- 172.21.15.72:0/2061476444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9db40a0090 0x7f9db4136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.724+0000 7f9db9115700 1 -- 172.21.15.72:0/2061476444 >> 172.21.15.72:0/2061476444 conn(0x7f9db40a3f70 msgr2=0x7f9db40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.724+0000 7f9db9115700 1 -- 172.21.15.72:0/2061476444 shutdown_connections 2023-10-03T10:14:46.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.724+0000 7f9db9115700 1 -- 172.21.15.72:0/2061476444 wait complete. 2023-10-03T10:14:46.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.726+0000 7f9db9115700 1 Processor -- start 2023-10-03T10:14:46.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.726+0000 7f9db9115700 1 -- start start 2023-10-03T10:14:46.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db9115700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9db409c650 0x7f9db4135330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db9115700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9db409d130 0x7f9db4135870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db9115700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9db40a0090 0x7f9db4135db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db9115700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4138540 con 0x7f9db409d130 2023-10-03T10:14:46.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db9115700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db409d980 con 0x7f9db409c650 2023-10-03T10:14:46.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db9115700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4130880 con 0x7f9db40a0090 2023-10-03T10:14:46.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9db409d130 0x7f9db4135870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9db409c650 0x7f9db4135330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9db409d130 0x7f9db4135870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43832/0 (socket says 172.21.15.72:43832) 2023-10-03T10:14:46.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9db409c650 0x7f9db4135330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40198/0 (socket says 172.21.15.72:40198) 2023-10-03T10:14:46.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db259c700 1 -- 172.21.15.72:0/3139278904 learned_addr learned my addr 172.21.15.72:0/3139278904 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:46.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db359e700 1 --2- 172.21.15.72:0/3139278904 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9db40a0090 0x7f9db4135db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db259c700 1 -- 172.21.15.72:0/3139278904 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9db40a0090 msgr2=0x7f9db4135db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db259c700 1 --2- 172.21.15.72:0/3139278904 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9db40a0090 0x7f9db4135db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db259c700 1 -- 172.21.15.72:0/3139278904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9db409c650 msgr2=0x7f9db4135330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db259c700 1 --2- 172.21.15.72:0/3139278904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9db409c650 0x7f9db4135330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db259c700 1 -- 172.21.15.72:0/3139278904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac009b30 con 0x7f9db409d130 2023-10-03T10:14:46.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db2d9d700 1 --2- 172.21.15.72:0/3139278904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9db409c650 0x7f9db4135330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:46.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db359e700 1 --2- 172.21.15.72:0/3139278904 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9db40a0090 0x7f9db4135db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:46.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.727+0000 7f9db259c700 1 --2- 172.21.15.72:0/3139278904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9db409d130 0x7f9db4135870 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9da800e9b0 tx=0x7f9da800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.728+0000 7f9d9b7fe700 1 -- 172.21.15.72:0/3139278904 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8009710 con 0x7f9db409d130 2023-10-03T10:14:46.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.728+0000 7f9d9b7fe700 1 -- 172.21.15.72:0/3139278904 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da800ee50 con 0x7f9db409d130 2023-10-03T10:14:46.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.728+0000 7f9db9115700 1 -- 172.21.15.72:0/3139278904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db412f450 con 0x7f9db409d130 2023-10-03T10:14:46.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.728+0000 7f9d9b7fe700 1 -- 172.21.15.72:0/3139278904 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da800ca50 con 0x7f9db409d130 2023-10-03T10:14:46.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.728+0000 7f9db9115700 1 -- 172.21.15.72:0/3139278904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db411b2c0 con 0x7f9db409d130 2023-10-03T10:14:46.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.728+0000 7f9d9b7fe700 1 -- 172.21.15.72:0/3139278904 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9da800cbb0 con 0x7f9db409d130 2023-10-03T10:14:46.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.729+0000 7f9d9b7fe700 1 -- 172.21.15.72:0/3139278904 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9da803f750 con 0x7f9db409d130 2023-10-03T10:14:46.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.729+0000 7f9db9115700 1 -- 172.21.15.72:0/3139278904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db40747f0 con 0x7f9db409d130 2023-10-03T10:14:46.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.734+0000 7f9d9b7fe700 1 -- 172.21.15.72:0/3139278904 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9da8021020 con 0x7f9db409d130 2023-10-03T10:14:46.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.766+0000 7fcf1fd62700 1 Processor -- start 2023-10-03T10:14:46.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.766+0000 7fcf1fd62700 1 -- start start 2023-10-03T10:14:46.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.767+0000 7fcf1fd62700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf180a0a30 0x7fcf180a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.767+0000 7fcf1fd62700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf1809d630 0x7fcf180a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.767+0000 7fcf1fd62700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf180a2a70 con 0x7fcf18133930 2023-10-03T10:14:46.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.767+0000 7fcf1fd62700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf180a01d0 con 0x7fcf1809d630 2023-10-03T10:14:46.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.767+0000 7fcf1fd62700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1809e2b0 con 0x7fcf180a0a30 2023-10-03T10:14:46.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.767+0000 7fcf1d2fd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf1809d630 0x7fcf180a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.767+0000 7fcf1e2ff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcf18133930 0x7fcf18133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:43992/0 (socket says 172.21.15.72:43992) 2023-10-03T10:14:46.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.767+0000 7fcf1dafe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf180a0a30 0x7fcf180a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.767+0000 7fcf1e2ff700 1 -- 172.21.15.72:0/2604194815 learned_addr learned my addr 172.21.15.72:0/2604194815 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.767+0000 7fcf1d2fd700 1 -- 172.21.15.72:0/2604194815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf180a0a30 msgr2=0x7fcf180a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.767+0000 7fcf1d2fd700 1 --2- 172.21.15.72:0/2604194815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf180a0a30 0x7fcf180a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.767+0000 7fcf1d2fd700 1 -- 172.21.15.72:0/2604194815 >> v1:172.21.15.72:6789/0 conn(0x7fcf18133930 legacy=0x7fcf18133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.767+0000 7fcf1d2fd700 1 -- 172.21.15.72:0/2604194815 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1809dc50 con 0x7fcf1809d630 2023-10-03T10:14:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.767+0000 7fcf1d2fd700 1 --2- 172.21.15.72:0/2604194815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf1809d630 0x7fcf180a1340 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009840 tx=0x7fcf08009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef7511b42004eee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.768+0000 7fcf1cafc700 1 -- 172.21.15.72:0/2604194815 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf08011830 con 0x7fcf1809d630 2023-10-03T10:14:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.768+0000 7fcf1cafc700 1 -- 172.21.15.72:0/2604194815 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf08011990 con 0x7fcf1809d630 2023-10-03T10:14:46.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.768+0000 7fcf1cafc700 1 -- 172.21.15.72:0/2604194815 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf08011d20 con 0x7fcf1809d630 2023-10-03T10:14:46.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.768+0000 7fcf1fd62700 1 -- 172.21.15.72:0/2604194815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf1809d630 msgr2=0x7fcf180a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.768+0000 7fcf1fd62700 1 --2- 172.21.15.72:0/2604194815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf1809d630 0x7fcf180a1340 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009840 tx=0x7fcf08009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:46.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.768+0000 7fcf1fd62700 1 -- 172.21.15.72:0/2604194815 shutdown_connections 2023-10-03T10:14:46.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.768+0000 7fcf1fd62700 1 --2- 172.21.15.72:0/2604194815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf180a0a30 0x7fcf180a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.768+0000 7fcf1fd62700 1 --2- 172.21.15.72:0/2604194815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf1809d630 0x7fcf180a1340 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.768+0000 7fcf1fd62700 1 -- 172.21.15.72:0/2604194815 >> 172.21.15.72:0/2604194815 conn(0x7fcf180a3050 msgr2=0x7fcf180a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.768+0000 7fcf1fd62700 1 -- 172.21.15.72:0/2604194815 shutdown_connections 2023-10-03T10:14:46.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.768+0000 7fcf1fd62700 1 -- 172.21.15.72:0/2604194815 wait complete. 2023-10-03T10:14:46.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.770+0000 7fcf1fd62700 1 Processor -- start 2023-10-03T10:14:46.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.770+0000 7fcf1fd62700 1 -- start start 2023-10-03T10:14:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.770+0000 7fcf1fd62700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf1809d630 0x7fcf181c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.770+0000 7fcf1fd62700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf180a0a30 0x7fcf181c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.770+0000 7fcf1fd62700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf18133930 0x7fcf1811e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.770+0000 7fcf1fd62700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf181bcfe0 con 0x7fcf18133930 2023-10-03T10:14:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.770+0000 7fcf1fd62700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf18121d80 con 0x7fcf180a0a30 2023-10-03T10:14:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.770+0000 7fcf1fd62700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf18122420 con 0x7fcf1809d630 2023-10-03T10:14:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.770+0000 7fcf1e2ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf18133930 0x7fcf1811e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.770+0000 7fcf1e2ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf18133930 0x7fcf1811e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43850/0 (socket says 172.21.15.72:43850) 2023-10-03T10:14:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.770+0000 7fcf1e2ff700 1 -- 172.21.15.72:0/2104306313 learned_addr learned my addr 172.21.15.72:0/2104306313 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:46.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.770+0000 7fcf1d2fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf180a0a30 0x7fcf181c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.771+0000 7fcf1dafe700 1 --2- 172.21.15.72:0/2104306313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf1809d630 0x7fcf181c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.771+0000 7fcf1e2ff700 1 -- 172.21.15.72:0/2104306313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf1809d630 msgr2=0x7fcf181c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.771+0000 7fcf1e2ff700 1 --2- 172.21.15.72:0/2104306313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf1809d630 0x7fcf181c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.771+0000 7fcf1e2ff700 1 -- 172.21.15.72:0/2104306313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf180a0a30 msgr2=0x7fcf181c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.771+0000 7fcf1e2ff700 1 --2- 172.21.15.72:0/2104306313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf180a0a30 0x7fcf181c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.771+0000 7fcf1e2ff700 1 -- 172.21.15.72:0/2104306313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf080094a0 con 0x7fcf18133930 2023-10-03T10:14:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.771+0000 7fcf1dafe700 1 --2- 172.21.15.72:0/2104306313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf1809d630 0x7fcf181c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.771+0000 7fcf1d2fd700 1 --2- 172.21.15.72:0/2104306313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf180a0a30 0x7fcf181c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.771+0000 7fcf1e2ff700 1 --2- 172.21.15.72:0/2104306313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf18133930 0x7fcf1811e890 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000cbc0 tx=0x7fcf1000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.771+0000 7fcf0e7fc700 1 -- 172.21.15.72:0/2104306313 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000aaa0 con 0x7fcf18133930 2023-10-03T10:14:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.771+0000 7fcf0e7fc700 1 -- 172.21.15.72:0/2104306313 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1000ac00 con 0x7fcf18133930 2023-10-03T10:14:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.771+0000 7fcf1fd62700 1 -- 172.21.15.72:0/2104306313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf180a4030 con 0x7fcf18133930 2023-10-03T10:14:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.771+0000 7fcf0e7fc700 1 -- 172.21.15.72:0/2104306313 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10012400 con 0x7fcf18133930 2023-10-03T10:14:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.771+0000 7fcf1fd62700 1 -- 172.21.15.72:0/2104306313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf18122ab0 con 0x7fcf18133930 2023-10-03T10:14:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.772+0000 7fcf0e7fc700 1 -- 172.21.15.72:0/2104306313 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf1001b3b0 con 0x7fcf18133930 2023-10-03T10:14:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.772+0000 7fcf0e7fc700 1 -- 172.21.15.72:0/2104306313 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcf1003f300 con 0x7fcf18133930 2023-10-03T10:14:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.773+0000 7fcf1fd62700 1 -- 172.21.15.72:0/2104306313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf180747f0 con 0x7fcf18133930 2023-10-03T10:14:46.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.777+0000 7fcf0e7fc700 1 -- 172.21.15.72:0/2104306313 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf10017080 con 0x7fcf18133930 2023-10-03T10:14:46.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.795+0000 7fd1e7498700 1 -- 172.21.15.72:0/3684210088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd1e009f420 con 0x7fd1e0139170 2023-10-03T10:14:46.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.796+0000 7fd1d5ffb700 1 -- 172.21.15.72:0/3684210088 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd1d802b090 con 0x7fd1e0139170 2023-10-03T10:14:46.796 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:46.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.798+0000 7fd1e7498700 1 -- 172.21.15.72:0/3684210088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e0139170 msgr2=0x7fd1e01c8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.798+0000 7fd1e7498700 1 --2- 172.21.15.72:0/3684210088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e0139170 0x7fd1e01c8670 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800ef90 tx=0x7fd1d800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.798+0000 7fd1e7498700 1 -- 172.21.15.72:0/3684210088 shutdown_connections 2023-10-03T10:14:46.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.798+0000 7fd1e7498700 1 --2- 172.21.15.72:0/3684210088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1e0139170 0x7fd1e01c8670 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.798+0000 7fd1e7498700 1 --2- 172.21.15.72:0/3684210088 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1e009d6f0 0x7fd1e011f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.798+0000 7fd1e7498700 1 --2- 172.21.15.72:0/3684210088 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1e009e1d0 0x7fd1e011fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.798+0000 7fd1e7498700 1 -- 172.21.15.72:0/3684210088 >> 172.21.15.72:0/3684210088 conn(0x7fd1e0066f50 msgr2=0x7fd1e0136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.798+0000 7fd1e7498700 1 -- 172.21.15.72:0/3684210088 shutdown_connections 2023-10-03T10:14:46.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.798+0000 7fd1e7498700 1 -- 172.21.15.72:0/3684210088 wait complete. 2023-10-03T10:14:46.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:46.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.938+0000 7f9db9115700 1 -- 172.21.15.72:0/3139278904 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9db4072840 con 0x7f9db409d130 2023-10-03T10:14:46.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.938+0000 7f9d9b7fe700 1 -- 172.21.15.72:0/3139278904 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9da801be10 con 0x7f9db409d130 2023-10-03T10:14:46.939 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.940+0000 7f9db9115700 1 -- 172.21.15.72:0/3139278904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9db409d130 msgr2=0x7f9db4135870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.940+0000 7f9db9115700 1 --2- 172.21.15.72:0/3139278904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9db409d130 0x7f9db4135870 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9da800e9b0 tx=0x7f9da800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.940+0000 7f9db9115700 1 -- 172.21.15.72:0/3139278904 shutdown_connections 2023-10-03T10:14:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.940+0000 7f9db9115700 1 --2- 172.21.15.72:0/3139278904 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9db40a0090 0x7f9db4135db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.940+0000 7f9db9115700 1 --2- 172.21.15.72:0/3139278904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9db409c650 0x7f9db4135330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.940+0000 7f9db9115700 1 --2- 172.21.15.72:0/3139278904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9db409d130 0x7f9db4135870 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.940+0000 7f9db9115700 1 -- 172.21.15.72:0/3139278904 >> 172.21.15.72:0/3139278904 conn(0x7f9db40a3f70 msgr2=0x7f9db40a26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.940+0000 7f9db9115700 1 -- 172.21.15.72:0/3139278904 shutdown_connections 2023-10-03T10:14:46.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.940+0000 7f9db9115700 1 -- 172.21.15.72:0/3139278904 wait complete. 2023-10-03T10:14:46.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:46.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.967+0000 7fcf1fd62700 1 -- 172.21.15.72:0/2104306313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcf18122280 con 0x7fcf18133930 2023-10-03T10:14:46.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.967+0000 7fcf0e7fc700 1 -- 172.21.15.72:0/2104306313 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcf18122280 con 0x7fcf18133930 2023-10-03T10:14:46.968 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:46.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.969+0000 7fcf1fd62700 1 -- 172.21.15.72:0/2104306313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf18133930 msgr2=0x7fcf1811e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.969+0000 7fcf1fd62700 1 --2- 172.21.15.72:0/2104306313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf18133930 0x7fcf1811e890 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000cbc0 tx=0x7fcf1000ced0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.969+0000 7fcf1fd62700 1 -- 172.21.15.72:0/2104306313 shutdown_connections 2023-10-03T10:14:46.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.969+0000 7fcf1fd62700 1 --2- 172.21.15.72:0/2104306313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf18133930 0x7fcf1811e890 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.969+0000 7fcf1fd62700 1 --2- 172.21.15.72:0/2104306313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf1809d630 0x7fcf181c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.969+0000 7fcf1fd62700 1 --2- 172.21.15.72:0/2104306313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf180a0a30 0x7fcf181c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.969+0000 7fcf1fd62700 1 -- 172.21.15.72:0/2104306313 >> 172.21.15.72:0/2104306313 conn(0x7fcf180a3050 msgr2=0x7fcf181bbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.969+0000 7fcf1fd62700 1 -- 172.21.15.72:0/2104306313 shutdown_connections 2023-10-03T10:14:46.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:46.969+0000 7fcf1fd62700 1 -- 172.21.15.72:0/2104306313 wait complete. 2023-10-03T10:14:46.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:47.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:47.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.479+0000 7f06d882b700 1 Processor -- start 2023-10-03T10:14:47.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.479+0000 7f06d882b700 1 -- start start 2023-10-03T10:14:47.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d882b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06d409e930 0x7f06d409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d882b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06d409f240 0x7f06d41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d882b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06d409f650 0x7f06d4131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d882b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d4070940 con 0x7f06d409e930 2023-10-03T10:14:47.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d882b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d406fd60 con 0x7f06d409f650 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d882b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06d406fa80 con 0x7f06d409f240 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d1d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06d409f240 0x7f06d41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06d409e930 0x7f06d409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06d409f650 0x7f06d4131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d1d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06d409f240 0x7f06d41317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52312/0 (socket says 172.21.15.72:52312) 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06d409e930 0x7f06d409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43856/0 (socket says 172.21.15.72:43856) 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d1d9b700 1 -- 172.21.15.72:0/3283934027 learned_addr learned my addr 172.21.15.72:0/3283934027 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06d409f650 0x7f06d4131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40202/0 (socket says 172.21.15.72:40202) 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d1d9b700 1 -- 172.21.15.72:0/3283934027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06d409f650 msgr2=0x7f06d4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d1d9b700 1 --2- 172.21.15.72:0/3283934027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06d409f650 0x7f06d4131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d1d9b700 1 -- 172.21.15.72:0/3283934027 >> v2:172.21.15.72:3300/0 conn(0x7f06d409e930 msgr2=0x7f06d409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d1d9b700 1 --2- 172.21.15.72:0/3283934027 >> v2:172.21.15.72:3300/0 conn(0x7f06d409e930 0x7f06d409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d1d9b700 1 -- 172.21.15.72:0/3283934027 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d409fb60 con 0x7f06d409f240 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d2d9d700 1 --2- 172.21.15.72:0/3283934027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06d409f650 0x7f06d4131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d259c700 1 --2- 172.21.15.72:0/3283934027 >> v2:172.21.15.72:3300/0 conn(0x7f06d409e930 0x7f06d409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.480+0000 7f06d1d9b700 1 --2- 172.21.15.72:0/3283934027 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06d409f240 0x7f06d41317f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f06c40098f0 tx=0x7f06c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a7b0c7bdef6d5b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.481+0000 7f06d159a700 1 -- 172.21.15.72:0/3283934027 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4011830 con 0x7f06d409f240 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.481+0000 7f06d159a700 1 -- 172.21.15.72:0/3283934027 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c4011990 con 0x7f06d409f240 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.481+0000 7f06d159a700 1 -- 172.21.15.72:0/3283934027 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4011d20 con 0x7f06d409f240 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.481+0000 7f06d882b700 1 -- 172.21.15.72:0/3283934027 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06d409f240 msgr2=0x7f06d41317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.481+0000 7f06d882b700 1 --2- 172.21.15.72:0/3283934027 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06d409f240 0x7f06d41317f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f06c40098f0 tx=0x7f06c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.481+0000 7f06d882b700 1 -- 172.21.15.72:0/3283934027 shutdown_connections 2023-10-03T10:14:47.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.481+0000 7f06d882b700 1 --2- 172.21.15.72:0/3283934027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06d409f650 0x7f06d4131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.481+0000 7f06d882b700 1 --2- 172.21.15.72:0/3283934027 >> v2:172.21.15.72:3300/0 conn(0x7f06d409e930 0x7f06d409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.481+0000 7f06d882b700 1 --2- 172.21.15.72:0/3283934027 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06d409f240 0x7f06d41317f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.481+0000 7f06d882b700 1 -- 172.21.15.72:0/3283934027 >> 172.21.15.72:0/3283934027 conn(0x7f06d40a4210 msgr2=0x7f06d40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.481+0000 7f06d882b700 1 -- 172.21.15.72:0/3283934027 shutdown_connections 2023-10-03T10:14:47.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.481+0000 7f06d882b700 1 -- 172.21.15.72:0/3283934027 wait complete. 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.482+0000 7f06d882b700 1 Processor -- start 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.482+0000 7f06d882b700 1 -- start start 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d882b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06d409e930 0x7f06d41a3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d882b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06d409f240 0x7f06d41a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d882b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06d409f650 0x7f06d41a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d882b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d41a51b0 con 0x7f06d409f650 2023-10-03T10:14:47.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d882b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d41a5870 con 0x7f06d409f240 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d882b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06d41a6ac0 con 0x7f06d409e930 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06d409e930 0x7f06d41a3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06d409e930 0x7f06d41a3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52316/0 (socket says 172.21.15.72:52316) 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d259c700 1 -- 172.21.15.72:0/2180561516 learned_addr learned my addr 172.21.15.72:0/2180561516 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d1d9b700 1 --2- 172.21.15.72:0/2180561516 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06d409f240 0x7f06d41a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d2d9d700 1 --2- 172.21.15.72:0/2180561516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06d409f650 0x7f06d41a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d1d9b700 1 -- 172.21.15.72:0/2180561516 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06d409e930 msgr2=0x7f06d41a3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d1d9b700 1 --2- 172.21.15.72:0/2180561516 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06d409e930 0x7f06d41a3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d1d9b700 1 -- 172.21.15.72:0/2180561516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06d409f650 msgr2=0x7f06d41a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d1d9b700 1 --2- 172.21.15.72:0/2180561516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06d409f650 0x7f06d41a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d1d9b700 1 -- 172.21.15.72:0/2180561516 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80094a0 con 0x7f06d409f240 2023-10-03T10:14:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d259c700 1 --2- 172.21.15.72:0/2180561516 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06d409e930 0x7f06d41a3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d1d9b700 1 --2- 172.21.15.72:0/2180561516 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06d409f240 0x7f06d41a4240 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f06c4016000 tx=0x7f06c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06c2ffd700 1 -- 172.21.15.72:0/2180561516 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4004240 con 0x7f06d409f240 2023-10-03T10:14:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06c2ffd700 1 -- 172.21.15.72:0/2180561516 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c401f070 con 0x7f06d409f240 2023-10-03T10:14:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.483+0000 7f06d882b700 1 -- 172.21.15.72:0/2180561516 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06cc009a70 con 0x7f06d409f240 2023-10-03T10:14:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.484+0000 7f06c2ffd700 1 -- 172.21.15.72:0/2180561516 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c40036a0 con 0x7f06d409f240 2023-10-03T10:14:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.484+0000 7f06d882b700 1 -- 172.21.15.72:0/2180561516 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c4009550 con 0x7f06d409f240 2023-10-03T10:14:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.484+0000 7f06c2ffd700 1 -- 172.21.15.72:0/2180561516 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06c4021030 con 0x7f06d409f240 2023-10-03T10:14:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.484+0000 7f06c2ffd700 1 -- 172.21.15.72:0/2180561516 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f06c4040640 con 0x7f06d409f240 2023-10-03T10:14:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.485+0000 7f06d882b700 1 -- 172.21.15.72:0/2180561516 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d41a0b30 con 0x7f06d409f240 2023-10-03T10:14:47.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.489+0000 7f06c2ffd700 1 -- 172.21.15.72:0/2180561516 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06c40199a0 con 0x7f06d409f240 2023-10-03T10:14:47.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.675+0000 7f06d882b700 1 -- 172.21.15.72:0/2180561516 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f06d40a3550 con 0x7f06d409f240 2023-10-03T10:14:47.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.676+0000 7f06c2ffd700 1 -- 172.21.15.72:0/2180561516 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06c40193b0 con 0x7f06d409f240 2023-10-03T10:14:47.676 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.678+0000 7f06d882b700 1 -- 172.21.15.72:0/2180561516 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06d409f240 msgr2=0x7f06d41a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.678+0000 7f06d882b700 1 --2- 172.21.15.72:0/2180561516 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06d409f240 0x7f06d41a4240 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f06c4016000 tx=0x7f06c4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.678+0000 7f06d882b700 1 -- 172.21.15.72:0/2180561516 shutdown_connections 2023-10-03T10:14:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.678+0000 7f06d882b700 1 --2- 172.21.15.72:0/2180561516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06d409f650 0x7f06d41a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.678+0000 7f06d882b700 1 --2- 172.21.15.72:0/2180561516 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f06d409e930 0x7f06d41a3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.678+0000 7f06d882b700 1 --2- 172.21.15.72:0/2180561516 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06d409f240 0x7f06d41a4240 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.678+0000 7f06d882b700 1 -- 172.21.15.72:0/2180561516 >> 172.21.15.72:0/2180561516 conn(0x7f06d40a4210 msgr2=0x7f06d41b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.678+0000 7f06d882b700 1 -- 172.21.15.72:0/2180561516 shutdown_connections 2023-10-03T10:14:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.678+0000 7f06d882b700 1 -- 172.21.15.72:0/2180561516 wait complete. 2023-10-03T10:14:47.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:47.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:47.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.934+0000 7faf26e38700 1 Processor -- start 2023-10-03T10:14:47.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.934+0000 7faf26e38700 1 -- start start 2023-10-03T10:14:47.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.934+0000 7faf26e38700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf2009e1d0 0x7faf20135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.934+0000 7faf26e38700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf20135e50 0x7faf20138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.934+0000 7faf26e38700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2009f130 con 0x7faf2009d6f0 2023-10-03T10:14:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.934+0000 7faf26e38700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2009f520 con 0x7faf20135e50 2023-10-03T10:14:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.934+0000 7faf26e38700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2009e930 con 0x7faf2009e1d0 2023-10-03T10:14:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.934+0000 7faf253d5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf20135e50 0x7faf20138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.934+0000 7faf1ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf2009e1d0 0x7faf20135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.934+0000 7faf253d5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf20135e50 0x7faf20138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43884/0 (socket says 172.21.15.72:43884) 2023-10-03T10:14:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.934+0000 7faf253d5700 1 -- 172.21.15.72:0/4226283865 learned_addr learned my addr 172.21.15.72:0/4226283865 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.934+0000 7faf1ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf2009e1d0 0x7faf20135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40216/0 (socket says 172.21.15.72:40216) 2023-10-03T10:14:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.934+0000 7faf253d5700 1 -- 172.21.15.72:0/4226283865 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf2009e1d0 msgr2=0x7faf20135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.934+0000 7faf253d5700 1 --2- 172.21.15.72:0/4226283865 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf2009e1d0 0x7faf20135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.934+0000 7faf253d5700 1 -- 172.21.15.72:0/4226283865 >> v1:172.21.15.72:6789/0 conn(0x7faf2009d6f0 legacy=0x7faf2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.935+0000 7faf253d5700 1 -- 172.21.15.72:0/4226283865 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2009b2d0 con 0x7faf20135e50 2023-10-03T10:14:47.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.935+0000 7faf1ffff700 1 --2- 172.21.15.72:0/4226283865 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf2009e1d0 0x7faf20135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.935+0000 7faf253d5700 1 --2- 172.21.15.72:0/4226283865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf20135e50 0x7faf20138230 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7faf18009e80 tx=0x7faf1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384f251ac6de47dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.935+0000 7faf1f7fe700 1 -- 172.21.15.72:0/4226283865 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1800bad0 con 0x7faf20135e50 2023-10-03T10:14:47.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.935+0000 7faf1f7fe700 1 -- 172.21.15.72:0/4226283865 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1800bc30 con 0x7faf20135e50 2023-10-03T10:14:47.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.935+0000 7faf1f7fe700 1 -- 172.21.15.72:0/4226283865 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18011460 con 0x7faf20135e50 2023-10-03T10:14:47.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.935+0000 7faf26e38700 1 -- 172.21.15.72:0/4226283865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf20135e50 msgr2=0x7faf20138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.935+0000 7faf26e38700 1 --2- 172.21.15.72:0/4226283865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf20135e50 0x7faf20138230 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7faf18009e80 tx=0x7faf1800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:47.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.935+0000 7faf26e38700 1 -- 172.21.15.72:0/4226283865 shutdown_connections 2023-10-03T10:14:47.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.935+0000 7faf26e38700 1 --2- 172.21.15.72:0/4226283865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf20135e50 0x7faf20138230 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.935+0000 7faf26e38700 1 --2- 172.21.15.72:0/4226283865 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf2009e1d0 0x7faf20135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.935+0000 7faf26e38700 1 -- 172.21.15.72:0/4226283865 >> 172.21.15.72:0/4226283865 conn(0x7faf20066f50 msgr2=0x7faf2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.935+0000 7faf26e38700 1 -- 172.21.15.72:0/4226283865 shutdown_connections 2023-10-03T10:14:47.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.935+0000 7faf26e38700 1 -- 172.21.15.72:0/4226283865 wait complete. 2023-10-03T10:14:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.937+0000 7faf26e38700 1 Processor -- start 2023-10-03T10:14:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.937+0000 7faf26e38700 1 -- start start 2023-10-03T10:14:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.937+0000 7faf26e38700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf2009d6f0 0x7faf2011c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.937+0000 7faf26e38700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf2009e1d0 0x7faf201c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.937+0000 7faf26e38700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf20135e50 0x7faf201c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.937+0000 7faf26e38700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2011d4d0 con 0x7faf20135e50 2023-10-03T10:14:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.937+0000 7faf26e38700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2011d2a0 con 0x7faf2009d6f0 2023-10-03T10:14:47.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.937+0000 7faf26e38700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf2011f2b0 con 0x7faf2009e1d0 2023-10-03T10:14:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf24bd4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf2009d6f0 0x7faf2011c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf1ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf2009e1d0 0x7faf201c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf24bd4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf2009d6f0 0x7faf2011c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40228/0 (socket says 172.21.15.72:40228) 2023-10-03T10:14:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf24bd4700 1 -- 172.21.15.72:0/979580546 learned_addr learned my addr 172.21.15.72:0/979580546 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf253d5700 1 --2- 172.21.15.72:0/979580546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf20135e50 0x7faf201c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf24bd4700 1 -- 172.21.15.72:0/979580546 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf2009e1d0 msgr2=0x7faf201c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf24bd4700 1 --2- 172.21.15.72:0/979580546 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf2009e1d0 0x7faf201c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf24bd4700 1 -- 172.21.15.72:0/979580546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf20135e50 msgr2=0x7faf201c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf24bd4700 1 --2- 172.21.15.72:0/979580546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf20135e50 0x7faf201c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf24bd4700 1 -- 172.21.15.72:0/979580546 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c0094a0 con 0x7faf2009d6f0 2023-10-03T10:14:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf1ffff700 1 --2- 172.21.15.72:0/979580546 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf2009e1d0 0x7faf201c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf253d5700 1 --2- 172.21.15.72:0/979580546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf20135e50 0x7faf201c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf24bd4700 1 --2- 172.21.15.72:0/979580546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf2009d6f0 0x7faf2011c270 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faf1400c510 tx=0x7faf1400c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf1d7fa700 1 -- 172.21.15.72:0/979580546 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf140052d0 con 0x7faf2009d6f0 2023-10-03T10:14:47.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf1d7fa700 1 -- 172.21.15.72:0/979580546 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf14005430 con 0x7faf2009d6f0 2023-10-03T10:14:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf26e38700 1 -- 172.21.15.72:0/979580546 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf18009b30 con 0x7faf2009d6f0 2023-10-03T10:14:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf1d7fa700 1 -- 172.21.15.72:0/979580546 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf140038c0 con 0x7faf2009d6f0 2023-10-03T10:14:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.938+0000 7faf26e38700 1 -- 172.21.15.72:0/979580546 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2011bd20 con 0x7faf2009d6f0 2023-10-03T10:14:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.939+0000 7faf1d7fa700 1 -- 172.21.15.72:0/979580546 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf14003a20 con 0x7faf2009d6f0 2023-10-03T10:14:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.939+0000 7faf1d7fa700 1 -- 172.21.15.72:0/979580546 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faf1403ea60 con 0x7faf2009d6f0 2023-10-03T10:14:47.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.939+0000 7faf26e38700 1 -- 172.21.15.72:0/979580546 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2004ea50 con 0x7faf2009d6f0 2023-10-03T10:14:47.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:47.944+0000 7faf1d7fa700 1 -- 172.21.15.72:0/979580546 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf14018260 con 0x7faf2009d6f0 2023-10-03T10:14:47.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:47.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:48.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.077+0000 7f8eece72700 1 Processor -- start 2023-10-03T10:14:48.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.077+0000 7f8eece72700 1 -- start start 2023-10-03T10:14:48.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.078+0000 7f8eece72700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ee80a0a30 0x7f8ee80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.078+0000 7f8eece72700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ee809d630 0x7f8ee80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.078+0000 7f8eece72700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee80a2a70 con 0x7f8ee8133930 2023-10-03T10:14:48.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.078+0000 7f8eece72700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee80a01d0 con 0x7f8ee809d630 2023-10-03T10:14:48.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.078+0000 7f8eece72700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee809e2b0 con 0x7f8ee80a0a30 2023-10-03T10:14:48.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.078+0000 7f8ee659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ee80a0a30 0x7f8ee80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.078+0000 7f8ee659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ee80a0a30 0x7f8ee80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52348/0 (socket says 172.21.15.72:52348) 2023-10-03T10:14:48.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.078+0000 7f8ee5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ee809d630 0x7f8ee80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.078+0000 7f8ee659c700 1 -- 172.21.15.72:0/3758077815 learned_addr learned my addr 172.21.15.72:0/3758077815 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:48.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.078+0000 7f8ee5d9b700 1 -- 172.21.15.72:0/3758077815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ee80a0a30 msgr2=0x7f8ee80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.078+0000 7f8ee5d9b700 1 --2- 172.21.15.72:0/3758077815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ee80a0a30 0x7f8ee80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.078+0000 7f8ee5d9b700 1 -- 172.21.15.72:0/3758077815 >> v1:172.21.15.72:6789/0 conn(0x7f8ee8133930 legacy=0x7f8ee8133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.078+0000 7f8ee5d9b700 1 -- 172.21.15.72:0/3758077815 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee809dc50 con 0x7f8ee809d630 2023-10-03T10:14:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.079+0000 7f8ee5d9b700 1 --2- 172.21.15.72:0/3758077815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ee809d630 0x7f8ee80a1340 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009840 tx=0x7f8edc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9d3e24c642aeca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.079+0000 7f8ee559a700 1 -- 172.21.15.72:0/3758077815 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc011830 con 0x7f8ee809d630 2023-10-03T10:14:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.079+0000 7f8ee559a700 1 -- 172.21.15.72:0/3758077815 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8edc011990 con 0x7f8ee809d630 2023-10-03T10:14:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.079+0000 7f8ee559a700 1 -- 172.21.15.72:0/3758077815 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc011d20 con 0x7f8ee809d630 2023-10-03T10:14:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.079+0000 7f8eece72700 1 -- 172.21.15.72:0/3758077815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ee809d630 msgr2=0x7f8ee80a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.079+0000 7f8eece72700 1 --2- 172.21.15.72:0/3758077815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ee809d630 0x7f8ee80a1340 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009840 tx=0x7f8edc009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:48.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.079+0000 7f8eece72700 1 -- 172.21.15.72:0/3758077815 shutdown_connections 2023-10-03T10:14:48.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.079+0000 7f8eece72700 1 --2- 172.21.15.72:0/3758077815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ee80a0a30 0x7f8ee80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.079+0000 7f8eece72700 1 --2- 172.21.15.72:0/3758077815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ee809d630 0x7f8ee80a1340 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.079+0000 7f8eece72700 1 -- 172.21.15.72:0/3758077815 >> 172.21.15.72:0/3758077815 conn(0x7f8ee80a3050 msgr2=0x7f8ee80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.079+0000 7f8eece72700 1 -- 172.21.15.72:0/3758077815 shutdown_connections 2023-10-03T10:14:48.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.079+0000 7f8eece72700 1 -- 172.21.15.72:0/3758077815 wait complete. 2023-10-03T10:14:48.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.080+0000 7f8eece72700 1 Processor -- start 2023-10-03T10:14:48.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8eece72700 1 -- start start 2023-10-03T10:14:48.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8eece72700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ee809d630 0x7f8ee81c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8eece72700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ee80a0a30 0x7f8ee81c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8eece72700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ee8133930 0x7f8ee811e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8eece72700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee81bcfe0 con 0x7f8ee80a0a30 2023-10-03T10:14:48.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8eece72700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee8121d80 con 0x7f8ee8133930 2023-10-03T10:14:48.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8eece72700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee8122420 con 0x7f8ee809d630 2023-10-03T10:14:48.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8ee5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ee80a0a30 0x7f8ee81c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8ee5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ee80a0a30 0x7f8ee81c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43918/0 (socket says 172.21.15.72:43918) 2023-10-03T10:14:48.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8ee5d9b700 1 -- 172.21.15.72:0/460979244 learned_addr learned my addr 172.21.15.72:0/460979244 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:48.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8ee6d9d700 1 --2- 172.21.15.72:0/460979244 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ee8133930 0x7f8ee811e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8ee659c700 1 --2- 172.21.15.72:0/460979244 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ee809d630 0x7f8ee81c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8ee5d9b700 1 -- 172.21.15.72:0/460979244 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ee809d630 msgr2=0x7f8ee81c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8ee5d9b700 1 --2- 172.21.15.72:0/460979244 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ee809d630 0x7f8ee81c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8ee5d9b700 1 -- 172.21.15.72:0/460979244 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ee8133930 msgr2=0x7f8ee811e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8ee5d9b700 1 --2- 172.21.15.72:0/460979244 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ee8133930 0x7f8ee811e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.081+0000 7f8ee5d9b700 1 -- 172.21.15.72:0/460979244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc0094a0 con 0x7f8ee80a0a30 2023-10-03T10:14:48.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.082+0000 7f8ee5d9b700 1 --2- 172.21.15.72:0/460979244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ee80a0a30 0x7f8ee81c8990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8edc0090b0 tx=0x7f8edc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.082+0000 7f8ed6ffd700 1 -- 172.21.15.72:0/460979244 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc004400 con 0x7f8ee80a0a30 2023-10-03T10:14:48.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.082+0000 7f8ed6ffd700 1 -- 172.21.15.72:0/460979244 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8edc01f070 con 0x7f8ee80a0a30 2023-10-03T10:14:48.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.082+0000 7f8eece72700 1 -- 172.21.15.72:0/460979244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee80a4030 con 0x7f8ee80a0a30 2023-10-03T10:14:48.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.082+0000 7f8ed6ffd700 1 -- 172.21.15.72:0/460979244 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc0038e0 con 0x7f8ee80a0a30 2023-10-03T10:14:48.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.082+0000 7f8eece72700 1 -- 172.21.15.72:0/460979244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee8122ab0 con 0x7f8ee80a0a30 2023-10-03T10:14:48.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.083+0000 7f8ed6ffd700 1 -- 172.21.15.72:0/460979244 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8edc021030 con 0x7f8ee80a0a30 2023-10-03T10:14:48.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.083+0000 7f8ed6ffd700 1 -- 172.21.15.72:0/460979244 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8edc0408f0 con 0x7f8ee80a0a30 2023-10-03T10:14:48.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.083+0000 7f8eece72700 1 -- 172.21.15.72:0/460979244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee8122280 con 0x7f8ee80a0a30 2023-10-03T10:14:48.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.087+0000 7f8ed6ffd700 1 -- 172.21.15.72:0/460979244 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ee8122280 con 0x7f8ee80a0a30 2023-10-03T10:14:48.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.119+0000 7fe467ded700 1 Processor -- start 2023-10-03T10:14:48.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.119+0000 7fe467ded700 1 -- start start 2023-10-03T10:14:48.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.120+0000 7fe467ded700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe46009d630 0x7fe4600a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.120+0000 7fe467ded700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe460138d80 0x7fe46013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.120+0000 7fe467ded700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4600a2a70 con 0x7fe4600a0a30 2023-10-03T10:14:48.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.120+0000 7fe467ded700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4600a01d0 con 0x7fe460138d80 2023-10-03T10:14:48.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.120+0000 7fe467ded700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46009e2b0 con 0x7fe46009d630 2023-10-03T10:14:48.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.120+0000 7fe465388700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe46009d630 0x7fe4600a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.120+0000 7fe46638a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe460138d80 0x7fe46013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.120+0000 7fe465388700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe46009d630 0x7fe4600a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40256/0 (socket says 172.21.15.72:40256) 2023-10-03T10:14:48.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.120+0000 7fe465388700 1 -- 172.21.15.72:0/78821824 learned_addr learned my addr 172.21.15.72:0/78821824 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:48.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe464b87700 1 -- 172.21.15.72:0/78821824 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925104339 0 0) 0x7fe4600a2a70 con 0x7fe4600a0a30 2023-10-03T10:14:48.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe464b87700 1 -- 172.21.15.72:0/78821824 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe44c0035b0 con 0x7fe4600a0a30 2023-10-03T10:14:48.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe46638a700 1 -- 172.21.15.72:0/78821824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe46009d630 msgr2=0x7fe4600a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe46638a700 1 --2- 172.21.15.72:0/78821824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe46009d630 0x7fe4600a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe46638a700 1 -- 172.21.15.72:0/78821824 >> v1:172.21.15.72:6789/0 conn(0x7fe4600a0a30 legacy=0x7fe4600a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe46638a700 1 -- 172.21.15.72:0/78821824 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46009dc50 con 0x7fe460138d80 2023-10-03T10:14:48.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe465388700 1 --2- 172.21.15.72:0/78821824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe46009d630 0x7fe4600a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe46638a700 1 --2- 172.21.15.72:0/78821824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe460138d80 0x7fe46013b160 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe458009d90 tx=0x7fe45800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb04ac7ff3a22a06 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe464b87700 1 -- 172.21.15.72:0/78821824 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45800e070 con 0x7fe460138d80 2023-10-03T10:14:48.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe464b87700 1 -- 172.21.15.72:0/78821824 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45800bb20 con 0x7fe460138d80 2023-10-03T10:14:48.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe464b87700 1 -- 172.21.15.72:0/78821824 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45800be90 con 0x7fe460138d80 2023-10-03T10:14:48.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe467ded700 1 -- 172.21.15.72:0/78821824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe460138d80 msgr2=0x7fe46013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe467ded700 1 --2- 172.21.15.72:0/78821824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe460138d80 0x7fe46013b160 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe458009d90 tx=0x7fe45800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:48.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe467ded700 1 -- 172.21.15.72:0/78821824 shutdown_connections 2023-10-03T10:14:48.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe467ded700 1 --2- 172.21.15.72:0/78821824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe460138d80 0x7fe46013b160 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe467ded700 1 --2- 172.21.15.72:0/78821824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe46009d630 0x7fe4600a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.121+0000 7fe467ded700 1 -- 172.21.15.72:0/78821824 >> 172.21.15.72:0/78821824 conn(0x7fe4600a3050 msgr2=0x7fe4600a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.122+0000 7fe467ded700 1 -- 172.21.15.72:0/78821824 shutdown_connections 2023-10-03T10:14:48.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.122+0000 7fe467ded700 1 -- 172.21.15.72:0/78821824 wait complete. 2023-10-03T10:14:48.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.123+0000 7fe467ded700 1 Processor -- start 2023-10-03T10:14:48.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.123+0000 7fe467ded700 1 -- start start 2023-10-03T10:14:48.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.123+0000 7fe467ded700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe46009d630 0x7fe460120550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.123+0000 7fe467ded700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4600a0a30 0x7fe460120a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe467ded700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe460138d80 0x7fe460120fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe467ded700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe460122160 con 0x7fe46009d630 2023-10-03T10:14:48.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe467ded700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4601233b0 con 0x7fe4600a0a30 2023-10-03T10:14:48.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe467ded700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4601229c0 con 0x7fe460138d80 2023-10-03T10:14:48.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe465b89700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe46009d630 0x7fe460120550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe465b89700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe46009d630 0x7fe460120550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43938/0 (socket says 172.21.15.72:43938) 2023-10-03T10:14:48.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe465b89700 1 -- 172.21.15.72:0/4217475093 learned_addr learned my addr 172.21.15.72:0/4217475093 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:48.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe46638a700 1 --2- 172.21.15.72:0/4217475093 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe460138d80 0x7fe460120fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe465388700 1 --2- 172.21.15.72:0/4217475093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4600a0a30 0x7fe460120a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe465388700 1 -- 172.21.15.72:0/4217475093 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe460138d80 msgr2=0x7fe460120fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe465388700 1 --2- 172.21.15.72:0/4217475093 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe460138d80 0x7fe460120fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe465388700 1 -- 172.21.15.72:0/4217475093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe46009d630 msgr2=0x7fe460120550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe465388700 1 --2- 172.21.15.72:0/4217475093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe46009d630 0x7fe460120550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe465388700 1 -- 172.21.15.72:0/4217475093 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe450009550 con 0x7fe4600a0a30 2023-10-03T10:14:48.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe465388700 1 --2- 172.21.15.72:0/4217475093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4600a0a30 0x7fe460120a90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe45000e9d0 tx=0x7fe45000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe4567fc700 1 -- 172.21.15.72:0/4217475093 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45000ee70 con 0x7fe4600a0a30 2023-10-03T10:14:48.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe4567fc700 1 -- 172.21.15.72:0/4217475093 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe450004030 con 0x7fe4600a0a30 2023-10-03T10:14:48.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe4567fc700 1 -- 172.21.15.72:0/4217475093 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4500043c0 con 0x7fe4600a0a30 2023-10-03T10:14:48.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe467ded700 1 -- 172.21.15.72:0/4217475093 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe458009a70 con 0x7fe4600a0a30 2023-10-03T10:14:48.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.124+0000 7fe467ded700 1 -- 172.21.15.72:0/4217475093 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4600a4850 con 0x7fe4600a0a30 2023-10-03T10:14:48.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.125+0000 7fe4567fc700 1 -- 172.21.15.72:0/4217475093 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe45000c850 con 0x7fe4600a0a30 2023-10-03T10:14:48.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.125+0000 7fe467ded700 1 -- 172.21.15.72:0/4217475093 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4600747f0 con 0x7fe4600a0a30 2023-10-03T10:14:48.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.125+0000 7fe4567fc700 1 -- 172.21.15.72:0/4217475093 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe45003f570 con 0x7fe4600a0a30 2023-10-03T10:14:48.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.130+0000 7fe4567fc700 1 -- 172.21.15.72:0/4217475093 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe450019d40 con 0x7fe4600a0a30 2023-10-03T10:14:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.147+0000 7faf26e38700 1 -- 172.21.15.72:0/979580546 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faf2009ed70 con 0x7faf2009d6f0 2023-10-03T10:14:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.148+0000 7faf1d7fa700 1 -- 172.21.15.72:0/979580546 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7faf14017020 con 0x7faf2009d6f0 2023-10-03T10:14:48.150 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.150+0000 7faf26e38700 1 -- 172.21.15.72:0/979580546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf2009d6f0 msgr2=0x7faf2011c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.150+0000 7faf26e38700 1 --2- 172.21.15.72:0/979580546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf2009d6f0 0x7faf2011c270 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faf1400c510 tx=0x7faf1400c820 comp rx=0 tx=0).stop 2023-10-03T10:14:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.150+0000 7faf26e38700 1 -- 172.21.15.72:0/979580546 shutdown_connections 2023-10-03T10:14:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.150+0000 7faf26e38700 1 --2- 172.21.15.72:0/979580546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf20135e50 0x7faf201c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.150+0000 7faf26e38700 1 --2- 172.21.15.72:0/979580546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf2009d6f0 0x7faf2011c270 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.150+0000 7faf26e38700 1 --2- 172.21.15.72:0/979580546 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf2009e1d0 0x7faf201c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.150+0000 7faf26e38700 1 -- 172.21.15.72:0/979580546 >> 172.21.15.72:0/979580546 conn(0x7faf20066f50 msgr2=0x7faf200a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.150+0000 7faf26e38700 1 -- 172.21.15.72:0/979580546 shutdown_connections 2023-10-03T10:14:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.150+0000 7faf26e38700 1 -- 172.21.15.72:0/979580546 wait complete. 2023-10-03T10:14:48.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:48.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.280+0000 7f8eece72700 1 -- 172.21.15.72:0/460979244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ee8122280 con 0x7f8ee80a0a30 2023-10-03T10:14:48.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.280+0000 7f8ed6ffd700 1 -- 172.21.15.72:0/460979244 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ee8122280 con 0x7f8ee80a0a30 2023-10-03T10:14:48.281 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:48.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.282+0000 7f8eece72700 1 -- 172.21.15.72:0/460979244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ee80a0a30 msgr2=0x7f8ee81c8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.282+0000 7f8eece72700 1 --2- 172.21.15.72:0/460979244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ee80a0a30 0x7f8ee81c8990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8edc0090b0 tx=0x7f8edc004750 comp rx=0 tx=0).stop 2023-10-03T10:14:48.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.282+0000 7f8eece72700 1 -- 172.21.15.72:0/460979244 shutdown_connections 2023-10-03T10:14:48.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.282+0000 7f8eece72700 1 --2- 172.21.15.72:0/460979244 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ee8133930 0x7f8ee811e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.282+0000 7f8eece72700 1 --2- 172.21.15.72:0/460979244 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ee809d630 0x7f8ee81c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.282+0000 7f8eece72700 1 --2- 172.21.15.72:0/460979244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ee80a0a30 0x7f8ee81c8990 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.282+0000 7f8eece72700 1 -- 172.21.15.72:0/460979244 >> 172.21.15.72:0/460979244 conn(0x7f8ee80a3050 msgr2=0x7f8ee81bbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.282+0000 7f8eece72700 1 -- 172.21.15.72:0/460979244 shutdown_connections 2023-10-03T10:14:48.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.282+0000 7f8eece72700 1 -- 172.21.15.72:0/460979244 wait complete. 2023-10-03T10:14:48.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:48.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.320+0000 7fe467ded700 1 -- 172.21.15.72:0/4217475093 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe460123cd0 con 0x7fe4600a0a30 2023-10-03T10:14:48.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.320+0000 7fe4567fc700 1 -- 172.21.15.72:0/4217475093 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe450019300 con 0x7fe4600a0a30 2023-10-03T10:14:48.321 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.322+0000 7fe467ded700 1 -- 172.21.15.72:0/4217475093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4600a0a30 msgr2=0x7fe460120a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.322+0000 7fe467ded700 1 --2- 172.21.15.72:0/4217475093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4600a0a30 0x7fe460120a90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe45000e9d0 tx=0x7fe45000ece0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.322+0000 7fe467ded700 1 -- 172.21.15.72:0/4217475093 shutdown_connections 2023-10-03T10:14:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.322+0000 7fe467ded700 1 --2- 172.21.15.72:0/4217475093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe46009d630 0x7fe460120550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.322+0000 7fe467ded700 1 --2- 172.21.15.72:0/4217475093 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe460138d80 0x7fe460120fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.322+0000 7fe467ded700 1 --2- 172.21.15.72:0/4217475093 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4600a0a30 0x7fe460120a90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.322+0000 7fe467ded700 1 -- 172.21.15.72:0/4217475093 >> 172.21.15.72:0/4217475093 conn(0x7fe4600a3050 msgr2=0x7fe46009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.322+0000 7fe467ded700 1 -- 172.21.15.72:0/4217475093 shutdown_connections 2023-10-03T10:14:48.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.322+0000 7fe467ded700 1 -- 172.21.15.72:0/4217475093 wait complete. 2023-10-03T10:14:48.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:48.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:48.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.814+0000 7ff563418700 1 Processor -- start 2023-10-03T10:14:48.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff563418700 1 -- start start 2023-10-03T10:14:48.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff563418700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff55c09d6f0 0x7ff55c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff563418700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff55c09e000 0x7ff55c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff563418700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff55c09e410 0x7ff55c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff563418700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55c09f520 con 0x7ff55c09e000 2023-10-03T10:14:48.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff563418700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c09f130 con 0x7ff55c09d6f0 2023-10-03T10:14:48.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff563418700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c09e930 con 0x7ff55c09e410 2023-10-03T10:14:48.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff5611b4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff55c09d6f0 0x7ff55c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff5609b3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff55c09e000 0x7ff55c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff5619b5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff55c09e410 0x7ff55c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff5619b5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff55c09e410 0x7ff55c130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57322/0 (socket says 172.21.15.72:57322) 2023-10-03T10:14:48.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff5611b4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff55c09d6f0 0x7ff55c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46586/0 (socket says 172.21.15.72:46586) 2023-10-03T10:14:48.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff5609b3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff55c09e000 0x7ff55c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56422/0 (socket says 172.21.15.72:56422) 2023-10-03T10:14:48.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff5619b5700 1 -- 172.21.15.72:0/3830165872 learned_addr learned my addr 172.21.15.72:0/3830165872 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:48.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff5619b5700 1 -- 172.21.15.72:0/3830165872 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff55c09d6f0 msgr2=0x7ff55c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff5619b5700 1 --2- 172.21.15.72:0/3830165872 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff55c09d6f0 0x7ff55c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff5619b5700 1 -- 172.21.15.72:0/3830165872 >> v2:172.21.15.72:3300/0 conn(0x7ff55c09e000 msgr2=0x7ff55c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff5619b5700 1 --2- 172.21.15.72:0/3830165872 >> v2:172.21.15.72:3300/0 conn(0x7ff55c09e000 0x7ff55c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff5619b5700 1 -- 172.21.15.72:0/3830165872 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c09b2d0 con 0x7ff55c09e410 2023-10-03T10:14:48.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.815+0000 7ff5611b4700 1 --2- 172.21.15.72:0/3830165872 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff55c09d6f0 0x7ff55c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.816+0000 7ff5619b5700 1 --2- 172.21.15.72:0/3830165872 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff55c09e410 0x7ff55c130ba0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff55400bf20 tx=0x7ff5540093b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1c89b140b5bd9ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.816+0000 7ff54ffff700 1 -- 172.21.15.72:0/3830165872 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55400b4e0 con 0x7ff55c09e410 2023-10-03T10:14:48.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.816+0000 7ff54ffff700 1 -- 172.21.15.72:0/3830165872 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55400c910 con 0x7ff55c09e410 2023-10-03T10:14:48.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.816+0000 7ff54ffff700 1 -- 172.21.15.72:0/3830165872 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55400ccc0 con 0x7ff55c09e410 2023-10-03T10:14:48.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.816+0000 7ff563418700 1 -- 172.21.15.72:0/3830165872 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff55c09e410 msgr2=0x7ff55c130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.816+0000 7ff563418700 1 --2- 172.21.15.72:0/3830165872 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff55c09e410 0x7ff55c130ba0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff55400bf20 tx=0x7ff5540093b0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.816+0000 7ff563418700 1 -- 172.21.15.72:0/3830165872 shutdown_connections 2023-10-03T10:14:48.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.816+0000 7ff563418700 1 --2- 172.21.15.72:0/3830165872 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff55c09e410 0x7ff55c130ba0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.816+0000 7ff563418700 1 --2- 172.21.15.72:0/3830165872 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff55c09d6f0 0x7ff55c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.816+0000 7ff563418700 1 --2- 172.21.15.72:0/3830165872 >> v2:172.21.15.72:3300/0 conn(0x7ff55c09e000 0x7ff55c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.816+0000 7ff563418700 1 -- 172.21.15.72:0/3830165872 >> 172.21.15.72:0/3830165872 conn(0x7ff55c066f50 msgr2=0x7ff55c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.816+0000 7ff563418700 1 -- 172.21.15.72:0/3830165872 shutdown_connections 2023-10-03T10:14:48.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.816+0000 7ff563418700 1 -- 172.21.15.72:0/3830165872 wait complete. 2023-10-03T10:14:48.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.817+0000 7ff563418700 1 Processor -- start 2023-10-03T10:14:48.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.817+0000 7ff563418700 1 -- start start 2023-10-03T10:14:48.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff563418700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff55c09d6f0 0x7ff55c11e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff563418700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c09e000 0x7ff55c11e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff563418700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff55c09e410 0x7ff55c11ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff563418700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c121660 con 0x7ff55c09e000 2023-10-03T10:14:48.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff563418700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c120230 con 0x7ff55c09e410 2023-10-03T10:14:48.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff563418700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c0a19e0 con 0x7ff55c09d6f0 2023-10-03T10:14:48.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff5611b4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff55c09d6f0 0x7ff55c11e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff5609b3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c09e000 0x7ff55c11e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff5611b4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff55c09d6f0 0x7ff55c11e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57328/0 (socket says 172.21.15.72:57328) 2023-10-03T10:14:48.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff5611b4700 1 -- 172.21.15.72:0/3614849014 learned_addr learned my addr 172.21.15.72:0/3614849014 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:48.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff5619b5700 1 --2- 172.21.15.72:0/3614849014 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff55c09e410 0x7ff55c11ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff5609b3700 1 -- 172.21.15.72:0/3614849014 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff55c09d6f0 msgr2=0x7ff55c11e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff5609b3700 1 --2- 172.21.15.72:0/3614849014 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff55c09d6f0 0x7ff55c11e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff5609b3700 1 -- 172.21.15.72:0/3614849014 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff55c09e410 msgr2=0x7ff55c11ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff5609b3700 1 --2- 172.21.15.72:0/3614849014 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff55c09e410 0x7ff55c11ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff5609b3700 1 -- 172.21.15.72:0/3614849014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55000d940 con 0x7ff55c09e000 2023-10-03T10:14:48.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff5611b4700 1 --2- 172.21.15.72:0/3614849014 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff55c09d6f0 0x7ff55c11e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff5619b5700 1 --2- 172.21.15.72:0/3614849014 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff55c09e410 0x7ff55c11ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff5609b3700 1 --2- 172.21.15.72:0/3614849014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c09e000 0x7ff55c11e540 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff55800e900 tx=0x7ff55800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff54dffb700 1 -- 172.21.15.72:0/3614849014 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558013680 con 0x7ff55c09e000 2023-10-03T10:14:48.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff54dffb700 1 -- 172.21.15.72:0/3614849014 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5580137e0 con 0x7ff55c09e000 2023-10-03T10:14:48.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff563418700 1 -- 172.21.15.72:0/3614849014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55400bb50 con 0x7ff55c09e000 2023-10-03T10:14:48.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.818+0000 7ff54dffb700 1 -- 172.21.15.72:0/3614849014 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558013b50 con 0x7ff55c09e000 2023-10-03T10:14:48.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.819+0000 7ff563418700 1 -- 172.21.15.72:0/3614849014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55c121bc0 con 0x7ff55c09e000 2023-10-03T10:14:48.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.819+0000 7ff54dffb700 1 -- 172.21.15.72:0/3614849014 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff558013cb0 con 0x7ff55c09e000 2023-10-03T10:14:48.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.819+0000 7ff563418700 1 -- 172.21.15.72:0/3614849014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55c121490 con 0x7ff55c09e000 2023-10-03T10:14:48.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.820+0000 7ff54dffb700 1 -- 172.21.15.72:0/3614849014 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff55803f5c0 con 0x7ff55c09e000 2023-10-03T10:14:48.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:48.824+0000 7ff54dffb700 1 -- 172.21.15.72:0/3614849014 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff558021080 con 0x7ff55c09e000 2023-10-03T10:14:49.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.011+0000 7ff563418700 1 -- 172.21.15.72:0/3614849014 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff55c074ea0 con 0x7ff55c09e000 2023-10-03T10:14:49.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.011+0000 7ff54dffb700 1 -- 172.21.15.72:0/3614849014 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff558017020 con 0x7ff55c09e000 2023-10-03T10:14:49.012 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:49.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.013+0000 7ff563418700 1 -- 172.21.15.72:0/3614849014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c09e000 msgr2=0x7ff55c11e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.013+0000 7ff563418700 1 --2- 172.21.15.72:0/3614849014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c09e000 0x7ff55c11e540 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff55800e900 tx=0x7ff55800ec10 comp rx=0 tx=0).stop 2023-10-03T10:14:49.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.013+0000 7ff563418700 1 -- 172.21.15.72:0/3614849014 shutdown_connections 2023-10-03T10:14:49.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.013+0000 7ff563418700 1 --2- 172.21.15.72:0/3614849014 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff55c09e410 0x7ff55c11ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.013+0000 7ff563418700 1 --2- 172.21.15.72:0/3614849014 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff55c09d6f0 0x7ff55c11e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.013+0000 7ff563418700 1 --2- 172.21.15.72:0/3614849014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff55c09e000 0x7ff55c11e540 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.013+0000 7ff563418700 1 -- 172.21.15.72:0/3614849014 >> 172.21.15.72:0/3614849014 conn(0x7ff55c066f50 msgr2=0x7ff55c070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.013+0000 7ff563418700 1 -- 172.21.15.72:0/3614849014 shutdown_connections 2023-10-03T10:14:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.013+0000 7ff563418700 1 -- 172.21.15.72:0/3614849014 wait complete. 2023-10-03T10:14:49.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:49.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:49.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.285+0000 7f7b41a29700 1 Processor -- start 2023-10-03T10:14:49.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.285+0000 7f7b41a29700 1 -- start start 2023-10-03T10:14:49.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b41a29700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7b3c09e1d0 0x7f7b3c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b41a29700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b3c135e50 0x7f7b3c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b41a29700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3c09f130 con 0x7f7b3c09d6f0 2023-10-03T10:14:49.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b41a29700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3c09f520 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b41a29700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c09e930 con 0x7f7b3c135e50 2023-10-03T10:14:49.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b3a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7b3c09e1d0 0x7f7b3c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b3b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b3c135e50 0x7f7b3c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b3b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b3c135e50 0x7f7b3c138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57340/0 (socket says 172.21.15.72:57340) 2023-10-03T10:14:49.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b3a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7b3c09e1d0 0x7f7b3c135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56440/0 (socket says 172.21.15.72:56440) 2023-10-03T10:14:49.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b3b7fe700 1 -- 172.21.15.72:0/1647622564 learned_addr learned my addr 172.21.15.72:0/1647622564 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:49.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b3a7fc700 1 -- 172.21.15.72:0/1647622564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b3c135e50 msgr2=0x7f7b3c138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b3a7fc700 1 --2- 172.21.15.72:0/1647622564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b3c135e50 0x7f7b3c138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b3a7fc700 1 -- 172.21.15.72:0/1647622564 >> v1:172.21.15.72:6789/0 conn(0x7f7b3c09d6f0 legacy=0x7f7b3c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b3a7fc700 1 -- 172.21.15.72:0/1647622564 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c09b2d0 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b3b7fe700 1 --2- 172.21.15.72:0/1647622564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b3c135e50 0x7f7b3c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:49.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b3a7fc700 1 --2- 172.21.15.72:0/1647622564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b3c09e1d0 0x7f7b3c135910 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c009840 tx=0x7f7b2c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baaec735e679044a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b39ffb700 1 -- 172.21.15.72:0/1647622564 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c00f8a0 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b39ffb700 1 -- 172.21.15.72:0/1647622564 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c00fa00 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.286+0000 7f7b39ffb700 1 -- 172.21.15.72:0/1647622564 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c00fd90 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.287+0000 7f7b41a29700 1 -- 172.21.15.72:0/1647622564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b3c09e1d0 msgr2=0x7f7b3c135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.287+0000 7f7b41a29700 1 --2- 172.21.15.72:0/1647622564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b3c09e1d0 0x7f7b3c135910 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c009840 tx=0x7f7b2c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:49.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.287+0000 7f7b41a29700 1 -- 172.21.15.72:0/1647622564 shutdown_connections 2023-10-03T10:14:49.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.287+0000 7f7b41a29700 1 --2- 172.21.15.72:0/1647622564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b3c135e50 0x7f7b3c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.287+0000 7f7b41a29700 1 --2- 172.21.15.72:0/1647622564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b3c09e1d0 0x7f7b3c135910 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.287+0000 7f7b41a29700 1 -- 172.21.15.72:0/1647622564 >> 172.21.15.72:0/1647622564 conn(0x7f7b3c066f50 msgr2=0x7f7b3c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.287+0000 7f7b41a29700 1 -- 172.21.15.72:0/1647622564 shutdown_connections 2023-10-03T10:14:49.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.287+0000 7f7b41a29700 1 -- 172.21.15.72:0/1647622564 wait complete. 2023-10-03T10:14:49.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.288+0000 7f7b41a29700 1 Processor -- start 2023-10-03T10:14:49.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.288+0000 7f7b41a29700 1 -- start start 2023-10-03T10:14:49.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.288+0000 7f7b41a29700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b3c09d6f0 0x7f7b3c1c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.288+0000 7f7b41a29700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b3c09e1d0 0x7f7b3c1c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b41a29700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b3c135e50 0x7f7b3c1c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b41a29700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c123240 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b41a29700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c121530 con 0x7f7b3c135e50 2023-10-03T10:14:49.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b41a29700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c0a1f90 con 0x7f7b3c09d6f0 2023-10-03T10:14:49.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b3a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b3c09e1d0 0x7f7b3c1c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b3a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b3c09e1d0 0x7f7b3c1c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56446/0 (socket says 172.21.15.72:56446) 2023-10-03T10:14:49.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b3a7fc700 1 -- 172.21.15.72:0/3803136703 learned_addr learned my addr 172.21.15.72:0/3803136703 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:49.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b3affd700 1 --2- 172.21.15.72:0/3803136703 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b3c09d6f0 0x7f7b3c1c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b3b7fe700 1 --2- 172.21.15.72:0/3803136703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b3c135e50 0x7f7b3c1c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b3a7fc700 1 -- 172.21.15.72:0/3803136703 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b3c09d6f0 msgr2=0x7f7b3c1c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b3a7fc700 1 --2- 172.21.15.72:0/3803136703 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b3c09d6f0 0x7f7b3c1c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b3a7fc700 1 -- 172.21.15.72:0/3803136703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b3c135e50 msgr2=0x7f7b3c1c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b3a7fc700 1 --2- 172.21.15.72:0/3803136703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b3c135e50 0x7f7b3c1c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b3a7fc700 1 -- 172.21.15.72:0/3803136703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b34009b30 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b3a7fc700 1 --2- 172.21.15.72:0/3803136703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b3c09e1d0 0x7f7b3c1c8830 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0090b0 tx=0x7f7b2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b23fff700 1 -- 172.21.15.72:0/3803136703 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c0038a0 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b23fff700 1 -- 172.21.15.72:0/3803136703 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c003a00 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b41a29700 1 -- 172.21.15.72:0/3803136703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2c0094a0 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b23fff700 1 -- 172.21.15.72:0/3803136703 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c003db0 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.289+0000 7f7b41a29700 1 -- 172.21.15.72:0/3803136703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3c123bd0 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.290+0000 7f7b23fff700 1 -- 172.21.15.72:0/3803136703 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b2c02c430 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.290+0000 7f7b23fff700 1 -- 172.21.15.72:0/3803136703 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7b2c040950 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.290+0000 7f7b41a29700 1 -- 172.21.15.72:0/3803136703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3c074ea0 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.297 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:49.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.295+0000 7f7b23fff700 1 -- 172.21.15.72:0/3803136703 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b2c0178f0 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.336 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:49.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.422+0000 7fac56512700 1 Processor -- start 2023-10-03T10:14:49.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.422+0000 7fac56512700 1 -- start start 2023-10-03T10:14:49.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.422+0000 7fac56512700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac500a1510 0x7fac50138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.422+0000 7fac56512700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac50139250 0x7fac5013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.422+0000 7fac56512700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5009edd0 con 0x7fac500a0a30 2023-10-03T10:14:49.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.422+0000 7fac56512700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac500a18e0 con 0x7fac500a1510 2023-10-03T10:14:49.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.422+0000 7fac56512700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac5009e1f0 con 0x7fac50139250 2023-10-03T10:14:49.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.422+0000 7fac4f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac500a1510 0x7fac50138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.423+0000 7fac4f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac500a1510 0x7fac50138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56448/0 (socket says 172.21.15.72:56448) 2023-10-03T10:14:49.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.423+0000 7fac4f7fe700 1 -- 172.21.15.72:0/3395908104 learned_addr learned my addr 172.21.15.72:0/3395908104 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:49.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.423+0000 7fac54aaf700 1 --2- 172.21.15.72:0/3395908104 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac50139250 0x7fac5013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.423+0000 7fac4f7fe700 1 -- 172.21.15.72:0/3395908104 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac50139250 msgr2=0x7fac5013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.423+0000 7fac4f7fe700 1 --2- 172.21.15.72:0/3395908104 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac50139250 0x7fac5013b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.423+0000 7fac4f7fe700 1 -- 172.21.15.72:0/3395908104 >> v1:172.21.15.72:6789/0 conn(0x7fac500a0a30 legacy=0x7fac500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.423+0000 7fac4f7fe700 1 -- 172.21.15.72:0/3395908104 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5009dc50 con 0x7fac500a1510 2023-10-03T10:14:49.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.423+0000 7fac4f7fe700 1 --2- 172.21.15.72:0/3395908104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac500a1510 0x7fac50138d10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fac440098f0 tx=0x7fac44009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60ea38fddf163af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.423+0000 7fac4effd700 1 -- 172.21.15.72:0/3395908104 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44004230 con 0x7fac500a1510 2023-10-03T10:14:49.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.423+0000 7fac4effd700 1 -- 172.21.15.72:0/3395908104 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac44004390 con 0x7fac500a1510 2023-10-03T10:14:49.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.423+0000 7fac4effd700 1 -- 172.21.15.72:0/3395908104 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac440036a0 con 0x7fac500a1510 2023-10-03T10:14:49.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.424+0000 7fac56512700 1 -- 172.21.15.72:0/3395908104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac500a1510 msgr2=0x7fac50138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.424+0000 7fac56512700 1 --2- 172.21.15.72:0/3395908104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac500a1510 0x7fac50138d10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fac440098f0 tx=0x7fac44009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:49.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.424+0000 7fac56512700 1 -- 172.21.15.72:0/3395908104 shutdown_connections 2023-10-03T10:14:49.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.424+0000 7fac56512700 1 --2- 172.21.15.72:0/3395908104 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac50139250 0x7fac5013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.424+0000 7fac56512700 1 --2- 172.21.15.72:0/3395908104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac500a1510 0x7fac50138d10 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.424+0000 7fac56512700 1 -- 172.21.15.72:0/3395908104 >> 172.21.15.72:0/3395908104 conn(0x7fac500a6550 msgr2=0x7fac500a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.424+0000 7fac56512700 1 -- 172.21.15.72:0/3395908104 shutdown_connections 2023-10-03T10:14:49.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.424+0000 7fac56512700 1 -- 172.21.15.72:0/3395908104 wait complete. 2023-10-03T10:14:49.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.425+0000 7fac56512700 1 Processor -- start 2023-10-03T10:14:49.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.425+0000 7fac56512700 1 -- start start 2023-10-03T10:14:49.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.425+0000 7fac56512700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac500a0a30 0x7fac50121870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.425+0000 7fac56512700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac500a1510 0x7fac50121db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.425+0000 7fac56512700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac50139250 0x7fac501222f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.425+0000 7fac56512700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac50125060 con 0x7fac50139250 2023-10-03T10:14:49.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.425+0000 7fac56512700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac50123540 con 0x7fac500a1510 2023-10-03T10:14:49.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.425+0000 7fac56512700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac50138d40 con 0x7fac500a0a30 2023-10-03T10:14:49.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac4ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac500a0a30 0x7fac50121870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac4ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac500a0a30 0x7fac50121870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57374/0 (socket says 172.21.15.72:57374) 2023-10-03T10:14:49.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac4ffff700 1 -- 172.21.15.72:0/1671616635 learned_addr learned my addr 172.21.15.72:0/1671616635 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:49.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac4f7fe700 1 --2- 172.21.15.72:0/1671616635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac500a1510 0x7fac50121db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac54aaf700 1 --2- 172.21.15.72:0/1671616635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac50139250 0x7fac501222f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac4f7fe700 1 -- 172.21.15.72:0/1671616635 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac500a0a30 msgr2=0x7fac50121870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac4f7fe700 1 --2- 172.21.15.72:0/1671616635 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac500a0a30 0x7fac50121870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac4f7fe700 1 -- 172.21.15.72:0/1671616635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac50139250 msgr2=0x7fac501222f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac4f7fe700 1 --2- 172.21.15.72:0/1671616635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac50139250 0x7fac501222f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac4f7fe700 1 -- 172.21.15.72:0/1671616635 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac44009550 con 0x7fac500a1510 2023-10-03T10:14:49.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac4f7fe700 1 --2- 172.21.15.72:0/1671616635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac500a1510 0x7fac50121db0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fac44015000 tx=0x7fac44004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac4cff9700 1 -- 172.21.15.72:0/1671616635 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44011630 con 0x7fac500a1510 2023-10-03T10:14:49.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac4cff9700 1 -- 172.21.15.72:0/1671616635 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac440117d0 con 0x7fac500a1510 2023-10-03T10:14:49.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac56512700 1 -- 172.21.15.72:0/1671616635 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac500a0220 con 0x7fac500a1510 2023-10-03T10:14:49.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac4cff9700 1 -- 172.21.15.72:0/1671616635 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44011b80 con 0x7fac500a1510 2023-10-03T10:14:49.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.426+0000 7fac56512700 1 -- 172.21.15.72:0/1671616635 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac50125ad0 con 0x7fac500a1510 2023-10-03T10:14:49.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.427+0000 7fac4cff9700 1 -- 172.21.15.72:0/1671616635 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac44022070 con 0x7fac500a1510 2023-10-03T10:14:49.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.427+0000 7fac56512700 1 -- 172.21.15.72:0/1671616635 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac50074ea0 con 0x7fac500a1510 2023-10-03T10:14:49.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.427+0000 7fac4cff9700 1 -- 172.21.15.72:0/1671616635 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fac44040f50 con 0x7fac500a1510 2023-10-03T10:14:49.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.432+0000 7fac4cff9700 1 -- 172.21.15.72:0/1671616635 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac4401ad10 con 0x7fac500a1510 2023-10-03T10:14:49.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.465+0000 7fb5eec27700 1 Processor -- start 2023-10-03T10:14:49.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.465+0000 7fb5eec27700 1 -- start start 2023-10-03T10:14:49.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.465+0000 7fb5eec27700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e809e1d0 0x7fb5e8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5eec27700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb5e8135e50 0x7fb5e8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5eec27700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e809f130 con 0x7fb5e809d6f0 2023-10-03T10:14:49.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5eec27700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e809f520 con 0x7fb5e8135e50 2023-10-03T10:14:49.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5eec27700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e809e930 con 0x7fb5e809e1d0 2023-10-03T10:14:49.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5e7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e809e1d0 0x7fb5e8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5e7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e809e1d0 0x7fb5e8135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57382/0 (socket says 172.21.15.72:57382) 2023-10-03T10:14:49.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5e7fff700 1 -- 172.21.15.72:0/1096320008 learned_addr learned my addr 172.21.15.72:0/1096320008 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:49.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5ed1c4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb5e8135e50 0x7fb5e8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5e7fff700 1 -- 172.21.15.72:0/1096320008 >> v2:172.21.15.72:3300/0 conn(0x7fb5e8135e50 msgr2=0x7fb5e8138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5e7fff700 1 --2- 172.21.15.72:0/1096320008 >> v2:172.21.15.72:3300/0 conn(0x7fb5e8135e50 0x7fb5e8138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5e7fff700 1 -- 172.21.15.72:0/1096320008 >> v1:172.21.15.72:6789/0 conn(0x7fb5e809d6f0 legacy=0x7fb5e809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5e7fff700 1 -- 172.21.15.72:0/1096320008 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e809b2d0 con 0x7fb5e809e1d0 2023-10-03T10:14:49.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5e7fff700 1 --2- 172.21.15.72:0/1096320008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e809e1d0 0x7fb5e8135910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400bbc0 tx=0x7fb5d400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50e8769157e01426 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5e77fe700 1 -- 172.21.15.72:0/1096320008 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400dcf0 con 0x7fb5e809e1d0 2023-10-03T10:14:49.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5e77fe700 1 -- 172.21.15.72:0/1096320008 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d400de50 con 0x7fb5e809e1d0 2023-10-03T10:14:49.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.466+0000 7fb5e77fe700 1 -- 172.21.15.72:0/1096320008 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4010690 con 0x7fb5e809e1d0 2023-10-03T10:14:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.467+0000 7fb5eec27700 1 -- 172.21.15.72:0/1096320008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e809e1d0 msgr2=0x7fb5e8135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.467+0000 7fb5eec27700 1 --2- 172.21.15.72:0/1096320008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e809e1d0 0x7fb5e8135910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400bbc0 tx=0x7fb5d400bed0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.467+0000 7fb5eec27700 1 -- 172.21.15.72:0/1096320008 shutdown_connections 2023-10-03T10:14:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.467+0000 7fb5eec27700 1 --2- 172.21.15.72:0/1096320008 >> v2:172.21.15.72:3300/0 conn(0x7fb5e8135e50 0x7fb5e8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.467+0000 7fb5eec27700 1 --2- 172.21.15.72:0/1096320008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e809e1d0 0x7fb5e8135910 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.467+0000 7fb5eec27700 1 -- 172.21.15.72:0/1096320008 >> 172.21.15.72:0/1096320008 conn(0x7fb5e8066f50 msgr2=0x7fb5e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.467+0000 7fb5eec27700 1 -- 172.21.15.72:0/1096320008 shutdown_connections 2023-10-03T10:14:49.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.467+0000 7fb5eec27700 1 -- 172.21.15.72:0/1096320008 wait complete. 2023-10-03T10:14:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.468+0000 7fb5eec27700 1 Processor -- start 2023-10-03T10:14:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.468+0000 7fb5eec27700 1 -- start start 2023-10-03T10:14:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.468+0000 7fb5eec27700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e809d6f0 0x7fb5e81c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.468+0000 7fb5eec27700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e809e1d0 0x7fb5e81c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5eec27700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e8135e50 0x7fb5e81c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5eec27700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e811b420 con 0x7fb5e8135e50 2023-10-03T10:14:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5eec27700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e811b230 con 0x7fb5e809d6f0 2023-10-03T10:14:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5eec27700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e811d120 con 0x7fb5e809e1d0 2023-10-03T10:14:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5e7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e809e1d0 0x7fb5e81c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5e7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e809e1d0 0x7fb5e81c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57398/0 (socket says 172.21.15.72:57398) 2023-10-03T10:14:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5e7fff700 1 -- 172.21.15.72:0/253609420 learned_addr learned my addr 172.21.15.72:0/253609420 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:49.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5ed1c4700 1 --2- 172.21.15.72:0/253609420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e8135e50 0x7fb5e81c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5ec9c3700 1 --2- 172.21.15.72:0/253609420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e809d6f0 0x7fb5e81c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5e7fff700 1 -- 172.21.15.72:0/253609420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e809d6f0 msgr2=0x7fb5e81c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5e7fff700 1 --2- 172.21.15.72:0/253609420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e809d6f0 0x7fb5e81c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5e7fff700 1 -- 172.21.15.72:0/253609420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e8135e50 msgr2=0x7fb5e81c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5e7fff700 1 --2- 172.21.15.72:0/253609420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e8135e50 0x7fb5e81c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5e7fff700 1 -- 172.21.15.72:0/253609420 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d400b7f0 con 0x7fb5e809e1d0 2023-10-03T10:14:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5e7fff700 1 --2- 172.21.15.72:0/253609420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e809e1d0 0x7fb5e81c4670 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5e809ea70 tx=0x7fb5d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5e57fa700 1 -- 172.21.15.72:0/253609420 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d401f070 con 0x7fb5e809e1d0 2023-10-03T10:14:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5e57fa700 1 -- 172.21.15.72:0/253609420 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d4003970 con 0x7fb5e809e1d0 2023-10-03T10:14:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5eec27700 1 -- 172.21.15.72:0/253609420 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e80a1d00 con 0x7fb5e809e1d0 2023-10-03T10:14:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5e57fa700 1 -- 172.21.15.72:0/253609420 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4003d00 con 0x7fb5e809e1d0 2023-10-03T10:14:49.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.469+0000 7fb5eec27700 1 -- 172.21.15.72:0/253609420 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e811ce40 con 0x7fb5e809e1d0 2023-10-03T10:14:49.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.470+0000 7fb5e57fa700 1 -- 172.21.15.72:0/253609420 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5d4019400 con 0x7fb5e809e1d0 2023-10-03T10:14:49.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.470+0000 7fb5eec27700 1 -- 172.21.15.72:0/253609420 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e811cbd0 con 0x7fb5e809e1d0 2023-10-03T10:14:49.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.471+0000 7fb5e57fa700 1 -- 172.21.15.72:0/253609420 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb5d4043040 con 0x7fb5e809e1d0 2023-10-03T10:14:49.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.479+0000 7fb5e57fa700 1 -- 172.21.15.72:0/253609420 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5d4003e60 con 0x7fb5e809e1d0 2023-10-03T10:14:49.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.490+0000 7f7b41a29700 1 -- 172.21.15.72:0/3803136703 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7b3c09c700 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.490+0000 7f7b23fff700 1 -- 172.21.15.72:0/3803136703 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7b2c017300 con 0x7f7b3c09e1d0 2023-10-03T10:14:49.491 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:49.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.492+0000 7f7b41a29700 1 -- 172.21.15.72:0/3803136703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b3c09e1d0 msgr2=0x7f7b3c1c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.492+0000 7f7b41a29700 1 --2- 172.21.15.72:0/3803136703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b3c09e1d0 0x7f7b3c1c8830 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0090b0 tx=0x7f7b2c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:49.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.492+0000 7f7b41a29700 1 -- 172.21.15.72:0/3803136703 shutdown_connections 2023-10-03T10:14:49.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.492+0000 7f7b41a29700 1 --2- 172.21.15.72:0/3803136703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b3c135e50 0x7f7b3c1c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.492+0000 7f7b41a29700 1 --2- 172.21.15.72:0/3803136703 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7b3c09d6f0 0x7f7b3c1c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.492+0000 7f7b41a29700 1 --2- 172.21.15.72:0/3803136703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b3c09e1d0 0x7f7b3c1c8830 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.492+0000 7f7b41a29700 1 -- 172.21.15.72:0/3803136703 >> 172.21.15.72:0/3803136703 conn(0x7f7b3c066f50 msgr2=0x7f7b3c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.493+0000 7f7b41a29700 1 -- 172.21.15.72:0/3803136703 shutdown_connections 2023-10-03T10:14:49.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.493+0000 7f7b41a29700 1 -- 172.21.15.72:0/3803136703 wait complete. 2023-10-03T10:14:49.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:49.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.633+0000 7fac56512700 1 -- 172.21.15.72:0/1671616635 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fac500a28e0 con 0x7fac500a1510 2023-10-03T10:14:49.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.633+0000 7fac4cff9700 1 -- 172.21.15.72:0/1671616635 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac4401ab30 con 0x7fac500a1510 2023-10-03T10:14:49.634 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:49.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.635+0000 7fac56512700 1 -- 172.21.15.72:0/1671616635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac500a1510 msgr2=0x7fac50121db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.635+0000 7fac56512700 1 --2- 172.21.15.72:0/1671616635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac500a1510 0x7fac50121db0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fac44015000 tx=0x7fac44004750 comp rx=0 tx=0).stop 2023-10-03T10:14:49.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.635+0000 7fac56512700 1 -- 172.21.15.72:0/1671616635 shutdown_connections 2023-10-03T10:14:49.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.635+0000 7fac56512700 1 --2- 172.21.15.72:0/1671616635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac50139250 0x7fac501222f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.635+0000 7fac56512700 1 --2- 172.21.15.72:0/1671616635 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac500a0a30 0x7fac50121870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.635+0000 7fac56512700 1 --2- 172.21.15.72:0/1671616635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac500a1510 0x7fac50121db0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.635+0000 7fac56512700 1 -- 172.21.15.72:0/1671616635 >> 172.21.15.72:0/1671616635 conn(0x7fac500a6550 msgr2=0x7fac50137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.636+0000 7fac56512700 1 -- 172.21.15.72:0/1671616635 shutdown_connections 2023-10-03T10:14:49.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.636+0000 7fac56512700 1 -- 172.21.15.72:0/1671616635 wait complete. 2023-10-03T10:14:49.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:49.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.676+0000 7fb5eec27700 1 -- 172.21.15.72:0/253609420 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb5e804ea50 con 0x7fb5e809e1d0 2023-10-03T10:14:49.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.676+0000 7fb5e57fa700 1 -- 172.21.15.72:0/253609420 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb5d4022370 con 0x7fb5e809e1d0 2023-10-03T10:14:49.677 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:49.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.679+0000 7fb5eec27700 1 -- 172.21.15.72:0/253609420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e809e1d0 msgr2=0x7fb5e81c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.679+0000 7fb5eec27700 1 --2- 172.21.15.72:0/253609420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e809e1d0 0x7fb5e81c4670 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5e809ea70 tx=0x7fb5d4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:49.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.679+0000 7fb5eec27700 1 -- 172.21.15.72:0/253609420 shutdown_connections 2023-10-03T10:14:49.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.679+0000 7fb5eec27700 1 --2- 172.21.15.72:0/253609420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5e8135e50 0x7fb5e81c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.679+0000 7fb5eec27700 1 --2- 172.21.15.72:0/253609420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5e809d6f0 0x7fb5e81c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.679+0000 7fb5eec27700 1 --2- 172.21.15.72:0/253609420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5e809e1d0 0x7fb5e81c4670 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.679+0000 7fb5eec27700 1 -- 172.21.15.72:0/253609420 >> 172.21.15.72:0/253609420 conn(0x7fb5e8066f50 msgr2=0x7fb5e80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.679+0000 7fb5eec27700 1 -- 172.21.15.72:0/253609420 shutdown_connections 2023-10-03T10:14:49.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:49.679+0000 7fb5eec27700 1 -- 172.21.15.72:0/253609420 wait complete. 2023-10-03T10:14:49.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:50.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:50.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.150+0000 7f9024e26700 1 Processor -- start 2023-10-03T10:14:50.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.150+0000 7f9024e26700 1 -- start start 2023-10-03T10:14:50.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f9024e26700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f902009d6f0 0x7f902009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f9024e26700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f902009e000 0x7f90201339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f9024e26700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f902009e410 0x7f9020133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f9024e26700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902006b460 con 0x7f902009e410 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f9024e26700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902009b120 con 0x7f902009d6f0 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f9024e26700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f902009a7e0 con 0x7f902009e000 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f901dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f902009e000 0x7f90201339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f901e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f902009d6f0 0x7f902009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f901ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f902009e410 0x7f9020133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f901dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f902009e000 0x7f90201339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57400/0 (socket says 172.21.15.72:57400) 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f901e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f902009d6f0 0x7f902009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46618/0 (socket says 172.21.15.72:46618) 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f901dd9b700 1 -- 172.21.15.72:0/1293576663 learned_addr learned my addr 172.21.15.72:0/1293576663 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f901dd9b700 1 -- 172.21.15.72:0/1293576663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f902009d6f0 msgr2=0x7f902009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f901dd9b700 1 --2- 172.21.15.72:0/1293576663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f902009d6f0 0x7f902009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f901dd9b700 1 -- 172.21.15.72:0/1293576663 >> v2:172.21.15.72:3300/0 conn(0x7f902009e410 msgr2=0x7f9020133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:50.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f901dd9b700 1 --2- 172.21.15.72:0/1293576663 >> v2:172.21.15.72:3300/0 conn(0x7f902009e410 0x7f9020133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f901dd9b700 1 -- 172.21.15.72:0/1293576663 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902009a500 con 0x7f902009e000 2023-10-03T10:14:50.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f901e59c700 1 --2- 172.21.15.72:0/1293576663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f902009d6f0 0x7f902009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:50.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f901ed9d700 1 --2- 172.21.15.72:0/1293576663 >> v2:172.21.15.72:3300/0 conn(0x7f902009e410 0x7f9020133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:50.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.151+0000 7f901dd9b700 1 --2- 172.21.15.72:0/1293576663 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f902009e000 0x7f90201339f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9010009920 tx=0x7f9010009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9faaff21a7fe9527 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.152+0000 7f901d59a700 1 -- 172.21.15.72:0/1293576663 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9010011830 con 0x7f902009e000 2023-10-03T10:14:50.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.152+0000 7f901d59a700 1 -- 172.21.15.72:0/1293576663 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9010011990 con 0x7f902009e000 2023-10-03T10:14:50.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.152+0000 7f901d59a700 1 -- 172.21.15.72:0/1293576663 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9010011d20 con 0x7f902009e000 2023-10-03T10:14:50.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.152+0000 7f9024e26700 1 -- 172.21.15.72:0/1293576663 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f902009e000 msgr2=0x7f90201339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.152+0000 7f9024e26700 1 --2- 172.21.15.72:0/1293576663 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f902009e000 0x7f90201339f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9010009920 tx=0x7f9010009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:50.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.152+0000 7f9024e26700 1 -- 172.21.15.72:0/1293576663 shutdown_connections 2023-10-03T10:14:50.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.152+0000 7f9024e26700 1 --2- 172.21.15.72:0/1293576663 >> v2:172.21.15.72:3300/0 conn(0x7f902009e410 0x7f9020133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.152+0000 7f9024e26700 1 --2- 172.21.15.72:0/1293576663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f902009d6f0 0x7f902009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.152+0000 7f9024e26700 1 --2- 172.21.15.72:0/1293576663 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f902009e000 0x7f90201339f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.152+0000 7f9024e26700 1 -- 172.21.15.72:0/1293576663 >> 172.21.15.72:0/1293576663 conn(0x7f9020066f50 msgr2=0x7f902009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.152+0000 7f9024e26700 1 -- 172.21.15.72:0/1293576663 shutdown_connections 2023-10-03T10:14:50.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.152+0000 7f9024e26700 1 -- 172.21.15.72:0/1293576663 wait complete. 2023-10-03T10:14:50.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.154+0000 7f9024e26700 1 Processor -- start 2023-10-03T10:14:50.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.154+0000 7f9024e26700 1 -- start start 2023-10-03T10:14:50.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.154+0000 7f9024e26700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f902009d6f0 0x7f90201a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.154+0000 7f9024e26700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f902009e000 0x7f90201a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.154+0000 7f9024e26700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f902009e410 0x7f90201a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.154+0000 7f9024e26700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90201a8090 con 0x7f902009e410 2023-10-03T10:14:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.154+0000 7f9024e26700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90201a9150 con 0x7f902009e000 2023-10-03T10:14:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.154+0000 7f9024e26700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f902009c710 con 0x7f902009d6f0 2023-10-03T10:14:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.154+0000 7f901e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f902009d6f0 0x7f90201a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.154+0000 7f901e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f902009d6f0 0x7f90201a5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57408/0 (socket says 172.21.15.72:57408) 2023-10-03T10:14:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.154+0000 7f901e59c700 1 -- 172.21.15.72:0/1495634286 learned_addr learned my addr 172.21.15.72:0/1495634286 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.154+0000 7f901dd9b700 1 --2- 172.21.15.72:0/1495634286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f902009e000 0x7f90201a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.154+0000 7f901ed9d700 1 --2- 172.21.15.72:0/1495634286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f902009e410 0x7f90201a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.155+0000 7f901e59c700 1 -- 172.21.15.72:0/1495634286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f902009e000 msgr2=0x7f90201a6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.155+0000 7f901e59c700 1 --2- 172.21.15.72:0/1495634286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f902009e000 0x7f90201a6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.155+0000 7f901e59c700 1 -- 172.21.15.72:0/1495634286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f902009e410 msgr2=0x7f90201a69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.155+0000 7f901e59c700 1 --2- 172.21.15.72:0/1495634286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f902009e410 0x7f90201a69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.155+0000 7f901e59c700 1 -- 172.21.15.72:0/1495634286 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90140094a0 con 0x7f902009d6f0 2023-10-03T10:14:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.155+0000 7f901e59c700 1 --2- 172.21.15.72:0/1495634286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f902009d6f0 0x7f90201a5f30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f901400ebe0 tx=0x7f901400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.155+0000 7f900effd700 1 -- 172.21.15.72:0/1495634286 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901400c850 con 0x7f902009d6f0 2023-10-03T10:14:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.155+0000 7f900effd700 1 -- 172.21.15.72:0/1495634286 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901400c9b0 con 0x7f902009d6f0 2023-10-03T10:14:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.155+0000 7f9024e26700 1 -- 172.21.15.72:0/1495634286 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9018009a70 con 0x7f902009d6f0 2023-10-03T10:14:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.155+0000 7f900effd700 1 -- 172.21.15.72:0/1495634286 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901400cd40 con 0x7f902009d6f0 2023-10-03T10:14:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.155+0000 7f9024e26700 1 -- 172.21.15.72:0/1495634286 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9010009550 con 0x7f902009d6f0 2023-10-03T10:14:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.156+0000 7f900effd700 1 -- 172.21.15.72:0/1495634286 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9014013470 con 0x7f902009d6f0 2023-10-03T10:14:50.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.156+0000 7f900effd700 1 -- 172.21.15.72:0/1495634286 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f901403f770 con 0x7f902009d6f0 2023-10-03T10:14:50.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.156+0000 7f9024e26700 1 -- 172.21.15.72:0/1495634286 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90201a9540 con 0x7f902009d6f0 2023-10-03T10:14:50.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.162+0000 7f900effd700 1 -- 172.21.15.72:0/1495634286 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90201a9540 con 0x7f902009d6f0 2023-10-03T10:14:50.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.348+0000 7f9024e26700 1 -- 172.21.15.72:0/1495634286 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f90201a9540 con 0x7f902009d6f0 2023-10-03T10:14:50.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.348+0000 7f900effd700 1 -- 172.21.15.72:0/1495634286 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f90201a9540 con 0x7f902009d6f0 2023-10-03T10:14:50.349 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:50.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.350+0000 7f9024e26700 1 -- 172.21.15.72:0/1495634286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f902009d6f0 msgr2=0x7f90201a5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.350+0000 7f9024e26700 1 --2- 172.21.15.72:0/1495634286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f902009d6f0 0x7f90201a5f30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f901400ebe0 tx=0x7f901400eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.350+0000 7f9024e26700 1 -- 172.21.15.72:0/1495634286 shutdown_connections 2023-10-03T10:14:50.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.350+0000 7f9024e26700 1 --2- 172.21.15.72:0/1495634286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f902009e410 0x7f90201a69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.350+0000 7f9024e26700 1 --2- 172.21.15.72:0/1495634286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f902009d6f0 0x7f90201a5f30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.350+0000 7f9024e26700 1 --2- 172.21.15.72:0/1495634286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f902009e000 0x7f90201a6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.350+0000 7f9024e26700 1 -- 172.21.15.72:0/1495634286 >> 172.21.15.72:0/1495634286 conn(0x7f9020066f50 msgr2=0x7f90201baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.350+0000 7f9024e26700 1 -- 172.21.15.72:0/1495634286 shutdown_connections 2023-10-03T10:14:50.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.350+0000 7f9024e26700 1 -- 172.21.15.72:0/1495634286 wait complete. 2023-10-03T10:14:50.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:50.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.633+0000 7fd54a5f9700 1 Processor -- start 2023-10-03T10:14:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.633+0000 7fd54a5f9700 1 -- start start 2023-10-03T10:14:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.633+0000 7fd54a5f9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd54409e930 0x7fd54409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.633+0000 7fd54a5f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd54409f240 0x7fd5441317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.633+0000 7fd54a5f9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd544070940 con 0x7fd54409f650 2023-10-03T10:14:50.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.633+0000 7fd54a5f9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54406fd60 con 0x7fd54409e930 2023-10-03T10:14:50.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.633+0000 7fd54a5f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54406fa80 con 0x7fd54409f240 2023-10-03T10:14:50.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.633+0000 7fd543fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd54409e930 0x7fd54409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.633+0000 7fd5437fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd54409f240 0x7fd5441317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.633+0000 7fd543fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd54409e930 0x7fd54409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56498/0 (socket says 172.21.15.72:56498) 2023-10-03T10:14:50.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.633+0000 7fd543fff700 1 -- 172.21.15.72:0/3317701488 learned_addr learned my addr 172.21.15.72:0/3317701488 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:50.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.634+0000 7fd5437fe700 1 -- 172.21.15.72:0/3317701488 >> v2:172.21.15.72:3300/0 conn(0x7fd54409e930 msgr2=0x7fd54409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:50.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.634+0000 7fd5437fe700 1 --2- 172.21.15.72:0/3317701488 >> v2:172.21.15.72:3300/0 conn(0x7fd54409e930 0x7fd54409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.634+0000 7fd5437fe700 1 -- 172.21.15.72:0/3317701488 >> v1:172.21.15.72:6789/0 conn(0x7fd54409f650 legacy=0x7fd544131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.634+0000 7fd5437fe700 1 -- 172.21.15.72:0/3317701488 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54409fb60 con 0x7fd54409f240 2023-10-03T10:14:50.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.634+0000 7fd543fff700 1 --2- 172.21.15.72:0/3317701488 >> v2:172.21.15.72:3300/0 conn(0x7fd54409e930 0x7fd54409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:50.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.634+0000 7fd5437fe700 1 --2- 172.21.15.72:0/3317701488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd54409f240 0x7fd5441317f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd538009840 tx=0x7fd538009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f063773ce2c87759 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.634+0000 7fd542ffd700 1 -- 172.21.15.72:0/3317701488 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538011830 con 0x7fd54409f240 2023-10-03T10:14:50.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.634+0000 7fd542ffd700 1 -- 172.21.15.72:0/3317701488 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd538011990 con 0x7fd54409f240 2023-10-03T10:14:50.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.634+0000 7fd542ffd700 1 -- 172.21.15.72:0/3317701488 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538011d20 con 0x7fd54409f240 2023-10-03T10:14:50.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.634+0000 7fd54a5f9700 1 -- 172.21.15.72:0/3317701488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd54409f240 msgr2=0x7fd5441317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.634+0000 7fd54a5f9700 1 --2- 172.21.15.72:0/3317701488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd54409f240 0x7fd5441317f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd538009840 tx=0x7fd538009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:50.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.634+0000 7fd54a5f9700 1 -- 172.21.15.72:0/3317701488 shutdown_connections 2023-10-03T10:14:50.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.634+0000 7fd54a5f9700 1 --2- 172.21.15.72:0/3317701488 >> v2:172.21.15.72:3300/0 conn(0x7fd54409e930 0x7fd54409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.634+0000 7fd54a5f9700 1 --2- 172.21.15.72:0/3317701488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd54409f240 0x7fd5441317f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.635+0000 7fd54a5f9700 1 -- 172.21.15.72:0/3317701488 >> 172.21.15.72:0/3317701488 conn(0x7fd5440a4210 msgr2=0x7fd5440a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.635+0000 7fd54a5f9700 1 -- 172.21.15.72:0/3317701488 shutdown_connections 2023-10-03T10:14:50.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.635+0000 7fd54a5f9700 1 -- 172.21.15.72:0/3317701488 wait complete. 2023-10-03T10:14:50.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.635+0000 7fd54a5f9700 1 Processor -- start 2023-10-03T10:14:50.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd54a5f9700 1 -- start start 2023-10-03T10:14:50.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd54a5f9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd54409e930 0x7fd5441a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd54a5f9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd54409f240 0x7fd5441a6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd54a5f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd54409f650 0x7fd5441a6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd54a5f9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5441a71a0 con 0x7fd54409f240 2023-10-03T10:14:50.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd54a5f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5441a78b0 con 0x7fd54409f650 2023-10-03T10:14:50.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd54a5f9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5441a7ed0 con 0x7fd54409e930 2023-10-03T10:14:50.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd5437fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd54409f240 0x7fd5441a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd5437fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd54409f240 0x7fd5441a6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56502/0 (socket says 172.21.15.72:56502) 2023-10-03T10:14:50.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd543fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd54409e930 0x7fd5441a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd5437fe700 1 -- 172.21.15.72:0/1069326408 learned_addr learned my addr 172.21.15.72:0/1069326408 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:50.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd548b96700 1 --2- 172.21.15.72:0/1069326408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd54409f650 0x7fd5441a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd5437fe700 1 -- 172.21.15.72:0/1069326408 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd54409e930 msgr2=0x7fd5441a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd5437fe700 1 --2- 172.21.15.72:0/1069326408 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd54409e930 0x7fd5441a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd5437fe700 1 -- 172.21.15.72:0/1069326408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd54409f650 msgr2=0x7fd5441a6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd5437fe700 1 --2- 172.21.15.72:0/1069326408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd54409f650 0x7fd5441a6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd5437fe700 1 -- 172.21.15.72:0/1069326408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534009550 con 0x7fd54409f240 2023-10-03T10:14:50.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.636+0000 7fd543fff700 1 --2- 172.21.15.72:0/1069326408 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd54409e930 0x7fd5441a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:50.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.637+0000 7fd5437fe700 1 --2- 172.21.15.72:0/1069326408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd54409f240 0x7fd5441a6230 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd5380090b0 tx=0x7fd538004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.637+0000 7fd540ff9700 1 -- 172.21.15.72:0/1069326408 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5380036a0 con 0x7fd54409f240 2023-10-03T10:14:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.637+0000 7fd540ff9700 1 -- 172.21.15.72:0/1069326408 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53801f070 con 0x7fd54409f240 2023-10-03T10:14:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.637+0000 7fd54a5f9700 1 -- 172.21.15.72:0/1069326408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5380094a0 con 0x7fd54409f240 2023-10-03T10:14:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.637+0000 7fd540ff9700 1 -- 172.21.15.72:0/1069326408 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538003a60 con 0x7fd54409f240 2023-10-03T10:14:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.637+0000 7fd54a5f9700 1 -- 172.21.15.72:0/1069326408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5440a0190 con 0x7fd54409f240 2023-10-03T10:14:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.637+0000 7fd540ff9700 1 -- 172.21.15.72:0/1069326408 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd538003bc0 con 0x7fd54409f240 2023-10-03T10:14:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.638+0000 7fd540ff9700 1 -- 172.21.15.72:0/1069326408 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd538021070 con 0x7fd54409f240 2023-10-03T10:14:50.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.638+0000 7fd54a5f9700 1 -- 172.21.15.72:0/1069326408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5441a2b40 con 0x7fd54409f240 2023-10-03T10:14:50.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.642+0000 7fd540ff9700 1 -- 172.21.15.72:0/1069326408 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd53802b080 con 0x7fd54409f240 2023-10-03T10:14:50.649 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:50.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.777+0000 7f157d218700 1 Processor -- start 2023-10-03T10:14:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.777+0000 7f157d218700 1 -- start start 2023-10-03T10:14:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f157d218700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f157809e930 0x7f157809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f157d218700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f157809f240 0x7f15781317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f157d218700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f157809f650 0x7f1578131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f157d218700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1578070940 con 0x7f157809f650 2023-10-03T10:14:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f157d218700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157806fd60 con 0x7f157809e930 2023-10-03T10:14:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f157d218700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f157806fa80 con 0x7f157809f240 2023-10-03T10:14:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f157659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f157809f240 0x7f15781317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f157659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f157809f240 0x7f15781317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57426/0 (socket says 172.21.15.72:57426) 2023-10-03T10:14:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f157659c700 1 -- 172.21.15.72:0/3736657600 learned_addr learned my addr 172.21.15.72:0/3736657600 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f1576d9d700 1 --2- 172.21.15.72:0/3736657600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f157809e930 0x7f157809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f157759e700 1 --2- 172.21.15.72:0/3736657600 >> v2:172.21.15.72:3300/0 conn(0x7f157809f650 0x7f1578131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f1576d9d700 1 -- 172.21.15.72:0/3736657600 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f157809f240 msgr2=0x7f15781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f1576d9d700 1 --2- 172.21.15.72:0/3736657600 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f157809f240 0x7f15781317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f1576d9d700 1 -- 172.21.15.72:0/3736657600 >> v2:172.21.15.72:3300/0 conn(0x7f157809f650 msgr2=0x7f1578131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f1576d9d700 1 --2- 172.21.15.72:0/3736657600 >> v2:172.21.15.72:3300/0 conn(0x7f157809f650 0x7f1578131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f1576d9d700 1 -- 172.21.15.72:0/3736657600 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157809fb60 con 0x7f157809e930 2023-10-03T10:14:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f157659c700 1 --2- 172.21.15.72:0/3736657600 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f157809f240 0x7f15781317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:50.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f157759e700 1 --2- 172.21.15.72:0/3736657600 >> v2:172.21.15.72:3300/0 conn(0x7f157809f650 0x7f1578131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:50.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f1576d9d700 1 --2- 172.21.15.72:0/3736657600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f157809e930 0x7f157809ed00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1568009840 tx=0x7f1568009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbf201052a7cea11 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.778+0000 7f1575d9b700 1 -- 172.21.15.72:0/3736657600 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1568011830 con 0x7f157809e930 2023-10-03T10:14:50.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.779+0000 7f1575d9b700 1 -- 172.21.15.72:0/3736657600 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1568011990 con 0x7f157809e930 2023-10-03T10:14:50.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.779+0000 7f1575d9b700 1 -- 172.21.15.72:0/3736657600 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1568011d20 con 0x7f157809e930 2023-10-03T10:14:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.779+0000 7f157d218700 1 -- 172.21.15.72:0/3736657600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f157809e930 msgr2=0x7f157809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.779+0000 7f157d218700 1 --2- 172.21.15.72:0/3736657600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f157809e930 0x7f157809ed00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1568009840 tx=0x7f1568009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.779+0000 7f157d218700 1 -- 172.21.15.72:0/3736657600 shutdown_connections 2023-10-03T10:14:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.779+0000 7f157d218700 1 --2- 172.21.15.72:0/3736657600 >> v2:172.21.15.72:3300/0 conn(0x7f157809f650 0x7f1578131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.779+0000 7f157d218700 1 --2- 172.21.15.72:0/3736657600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f157809e930 0x7f157809ed00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.779+0000 7f157d218700 1 --2- 172.21.15.72:0/3736657600 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f157809f240 0x7f15781317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.779+0000 7f157d218700 1 -- 172.21.15.72:0/3736657600 >> 172.21.15.72:0/3736657600 conn(0x7f15780a4210 msgr2=0x7f15780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.779+0000 7f157d218700 1 -- 172.21.15.72:0/3736657600 shutdown_connections 2023-10-03T10:14:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.779+0000 7f157d218700 1 -- 172.21.15.72:0/3736657600 wait complete. 2023-10-03T10:14:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.780+0000 7f157d218700 1 Processor -- start 2023-10-03T10:14:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.780+0000 7f157d218700 1 -- start start 2023-10-03T10:14:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f157d218700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f157809e930 0x7f157806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f157d218700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f157809f240 0x7f157806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f157d218700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157809f650 0x7f157806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f157d218700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15781a89e0 con 0x7f157809f650 2023-10-03T10:14:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f157d218700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15781a8170 con 0x7f157809e930 2023-10-03T10:14:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f157d218700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15781b6290 con 0x7f157809f240 2023-10-03T10:14:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f1576d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f157809e930 0x7f157806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f1576d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f157809e930 0x7f157806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46644/0 (socket says 172.21.15.72:46644) 2023-10-03T10:14:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f1576d9d700 1 -- 172.21.15.72:0/3202504430 learned_addr learned my addr 172.21.15.72:0/3202504430 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f157659c700 1 --2- 172.21.15.72:0/3202504430 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f157809f240 0x7f157806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f157759e700 1 --2- 172.21.15.72:0/3202504430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157809f650 0x7f157806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f1576d9d700 1 -- 172.21.15.72:0/3202504430 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f157809f240 msgr2=0x7f157806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f1576d9d700 1 --2- 172.21.15.72:0/3202504430 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f157809f240 0x7f157806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f1576d9d700 1 -- 172.21.15.72:0/3202504430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157809f650 msgr2=0x7f157806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f1576d9d700 1 --2- 172.21.15.72:0/3202504430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157809f650 0x7f157806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f1576d9d700 1 -- 172.21.15.72:0/3202504430 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c009550 con 0x7f157809e930 2023-10-03T10:14:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.781+0000 7f1576d9d700 1 --2- 172.21.15.72:0/3202504430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f157809e930 0x7f157806b8b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f15680090b0 tx=0x7f1568004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.782+0000 7f155f7fe700 1 -- 172.21.15.72:0/3202504430 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1568004450 con 0x7f157809e930 2023-10-03T10:14:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.782+0000 7f155f7fe700 1 -- 172.21.15.72:0/3202504430 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156801f070 con 0x7f157809e930 2023-10-03T10:14:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.782+0000 7f157d218700 1 -- 172.21.15.72:0/3202504430 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1570009a70 con 0x7f157809e930 2023-10-03T10:14:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.782+0000 7f155f7fe700 1 -- 172.21.15.72:0/3202504430 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15680038a0 con 0x7f157809e930 2023-10-03T10:14:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.782+0000 7f157d218700 1 -- 172.21.15.72:0/3202504430 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15680094a0 con 0x7f157809e930 2023-10-03T10:14:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.783+0000 7f155f7fe700 1 -- 172.21.15.72:0/3202504430 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1568003a00 con 0x7f157809e930 2023-10-03T10:14:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.783+0000 7f157d218700 1 -- 172.21.15.72:0/3202504430 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15781a7d20 con 0x7f157809e930 2023-10-03T10:14:50.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.783+0000 7f155f7fe700 1 -- 172.21.15.72:0/3202504430 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1568021070 con 0x7f157809e930 2023-10-03T10:14:50.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.791+0000 7f155f7fe700 1 -- 172.21.15.72:0/3202504430 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1568026480 con 0x7f157809e930 2023-10-03T10:14:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.822+0000 7fd7bbca0700 1 Processor -- start 2023-10-03T10:14:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.823+0000 7fd7bbca0700 1 -- start start 2023-10-03T10:14:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.823+0000 7fd7bbca0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b40a0a30 0x7fd7b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.823+0000 7fd7bbca0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd7b409d630 0x7fd7b40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.823+0000 7fd7bbca0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b4133930 0x7fd7b4133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.823+0000 7fd7bbca0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b40a2a70 con 0x7fd7b409d630 2023-10-03T10:14:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.823+0000 7fd7bbca0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b40a01d0 con 0x7fd7b4133930 2023-10-03T10:14:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.823+0000 7fd7bbca0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b409e2b0 con 0x7fd7b40a0a30 2023-10-03T10:14:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.823+0000 7fd7b9a3c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b40a0a30 0x7fd7b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.823+0000 7fd7ba23d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b4133930 0x7fd7b4133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.823+0000 7fd7b9a3c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b40a0a30 0x7fd7b40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57442/0 (socket says 172.21.15.72:57442) 2023-10-03T10:14:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.823+0000 7fd7ba23d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b4133930 0x7fd7b4133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46650/0 (socket says 172.21.15.72:46650) 2023-10-03T10:14:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.823+0000 7fd7b923b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd7b409d630 0x7fd7b40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.823+0000 7fd7b9a3c700 1 -- 172.21.15.72:0/2095383808 learned_addr learned my addr 172.21.15.72:0/2095383808 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.824+0000 7fd7ba23d700 1 -- 172.21.15.72:0/2095383808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b40a0a30 msgr2=0x7fd7b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.824+0000 7fd7ba23d700 1 --2- 172.21.15.72:0/2095383808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b40a0a30 0x7fd7b40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.824+0000 7fd7ba23d700 1 -- 172.21.15.72:0/2095383808 >> v2:172.21.15.72:3300/0 conn(0x7fd7b409d630 msgr2=0x7fd7b40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.824+0000 7fd7ba23d700 1 --2- 172.21.15.72:0/2095383808 >> v2:172.21.15.72:3300/0 conn(0x7fd7b409d630 0x7fd7b40a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.824+0000 7fd7ba23d700 1 -- 172.21.15.72:0/2095383808 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b409dc50 con 0x7fd7b4133930 2023-10-03T10:14:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.824+0000 7fd7b923b700 1 --2- 172.21.15.72:0/2095383808 >> v2:172.21.15.72:3300/0 conn(0x7fd7b409d630 0x7fd7b40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.824+0000 7fd7b9a3c700 1 --2- 172.21.15.72:0/2095383808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b40a0a30 0x7fd7b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.824+0000 7fd7ba23d700 1 --2- 172.21.15.72:0/2095383808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b4133930 0x7fd7b4133dd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009d90 tx=0x7fd7ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a51b24791d852c86 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.824+0000 7fd7b8a3a700 1 -- 172.21.15.72:0/2095383808 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac00e070 con 0x7fd7b4133930 2023-10-03T10:14:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.824+0000 7fd7b8a3a700 1 -- 172.21.15.72:0/2095383808 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac00bb20 con 0x7fd7b4133930 2023-10-03T10:14:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.824+0000 7fd7b8a3a700 1 -- 172.21.15.72:0/2095383808 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac012430 con 0x7fd7b4133930 2023-10-03T10:14:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.824+0000 7fd7bbca0700 1 -- 172.21.15.72:0/2095383808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b4133930 msgr2=0x7fd7b4133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.825+0000 7fd7bbca0700 1 --2- 172.21.15.72:0/2095383808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b4133930 0x7fd7b4133dd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009d90 tx=0x7fd7ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:50.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.825+0000 7fd7bbca0700 1 -- 172.21.15.72:0/2095383808 shutdown_connections 2023-10-03T10:14:50.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.825+0000 7fd7bbca0700 1 --2- 172.21.15.72:0/2095383808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b4133930 0x7fd7b4133dd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.825+0000 7fd7bbca0700 1 --2- 172.21.15.72:0/2095383808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b40a0a30 0x7fd7b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.825+0000 7fd7bbca0700 1 --2- 172.21.15.72:0/2095383808 >> v2:172.21.15.72:3300/0 conn(0x7fd7b409d630 0x7fd7b40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.825+0000 7fd7bbca0700 1 -- 172.21.15.72:0/2095383808 >> 172.21.15.72:0/2095383808 conn(0x7fd7b40a3050 msgr2=0x7fd7b40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.825+0000 7fd7bbca0700 1 -- 172.21.15.72:0/2095383808 shutdown_connections 2023-10-03T10:14:50.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.825+0000 7fd7bbca0700 1 -- 172.21.15.72:0/2095383808 wait complete. 2023-10-03T10:14:50.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7bbca0700 1 Processor -- start 2023-10-03T10:14:50.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7bbca0700 1 -- start start 2023-10-03T10:14:50.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7bbca0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b409d630 0x7fd7b411e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7bbca0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b40a0a30 0x7fd7b411ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7bbca0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b4133930 0x7fd7b411f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:50.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7bbca0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b4120bb0 con 0x7fd7b40a0a30 2023-10-03T10:14:50.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7bbca0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b40a5040 con 0x7fd7b409d630 2023-10-03T10:14:50.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7bbca0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b40a0410 con 0x7fd7b4133930 2023-10-03T10:14:50.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7b9a3c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b409d630 0x7fd7b411e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7b9a3c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b409d630 0x7fd7b411e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46656/0 (socket says 172.21.15.72:46656) 2023-10-03T10:14:50.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7b9a3c700 1 -- 172.21.15.72:0/3838887163 learned_addr learned my addr 172.21.15.72:0/3838887163 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:50.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7ba23d700 1 --2- 172.21.15.72:0/3838887163 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b4133930 0x7fd7b411f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7b923b700 1 --2- 172.21.15.72:0/3838887163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b40a0a30 0x7fd7b411ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:50.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7b9a3c700 1 -- 172.21.15.72:0/3838887163 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b4133930 msgr2=0x7fd7b411f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7b9a3c700 1 --2- 172.21.15.72:0/3838887163 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b4133930 0x7fd7b411f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7b9a3c700 1 -- 172.21.15.72:0/3838887163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b40a0a30 msgr2=0x7fd7b411ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7b9a3c700 1 --2- 172.21.15.72:0/3838887163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b40a0a30 0x7fd7b411ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.826+0000 7fd7b9a3c700 1 -- 172.21.15.72:0/3838887163 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a40094a0 con 0x7fd7b409d630 2023-10-03T10:14:50.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.827+0000 7fd7b9a3c700 1 --2- 172.21.15.72:0/3838887163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b409d630 0x7fd7b411e820 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000ebe0 tx=0x7fd7b000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:50.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.827+0000 7fd7aa7fc700 1 -- 172.21.15.72:0/3838887163 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b000c850 con 0x7fd7b409d630 2023-10-03T10:14:50.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.827+0000 7fd7aa7fc700 1 -- 172.21.15.72:0/3838887163 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b000c9b0 con 0x7fd7b409d630 2023-10-03T10:14:50.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.827+0000 7fd7bbca0700 1 -- 172.21.15.72:0/3838887163 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b0009550 con 0x7fd7b409d630 2023-10-03T10:14:50.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.827+0000 7fd7aa7fc700 1 -- 172.21.15.72:0/3838887163 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b000cd40 con 0x7fd7b409d630 2023-10-03T10:14:50.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.827+0000 7fd7bbca0700 1 -- 172.21.15.72:0/3838887163 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ac009a70 con 0x7fd7b409d630 2023-10-03T10:14:50.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.827+0000 7fd7aa7fc700 1 -- 172.21.15.72:0/3838887163 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd7b0013470 con 0x7fd7b409d630 2023-10-03T10:14:50.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.828+0000 7fd7aa7fc700 1 -- 172.21.15.72:0/3838887163 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd7b003f7a0 con 0x7fd7b409d630 2023-10-03T10:14:50.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.828+0000 7fd7bbca0700 1 -- 172.21.15.72:0/3838887163 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b40747f0 con 0x7fd7b409d630 2023-10-03T10:14:50.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.832+0000 7fd7aa7fc700 1 -- 172.21.15.72:0/3838887163 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7b00232f0 con 0x7fd7b409d630 2023-10-03T10:14:50.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.850+0000 7fd54a5f9700 1 -- 172.21.15.72:0/1069326408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd5440a34f0 con 0x7fd54409f240 2023-10-03T10:14:50.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.851+0000 7fd540ff9700 1 -- 172.21.15.72:0/1069326408 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd538015020 con 0x7fd54409f240 2023-10-03T10:14:50.851 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.853+0000 7fd54a5f9700 1 -- 172.21.15.72:0/1069326408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd54409f240 msgr2=0x7fd5441a6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.853+0000 7fd54a5f9700 1 --2- 172.21.15.72:0/1069326408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd54409f240 0x7fd5441a6230 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd5380090b0 tx=0x7fd538004750 comp rx=0 tx=0).stop 2023-10-03T10:14:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.853+0000 7fd54a5f9700 1 -- 172.21.15.72:0/1069326408 shutdown_connections 2023-10-03T10:14:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.853+0000 7fd54a5f9700 1 --2- 172.21.15.72:0/1069326408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd54409f650 0x7fd5441a6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.853+0000 7fd54a5f9700 1 --2- 172.21.15.72:0/1069326408 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd54409e930 0x7fd5441a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.853+0000 7fd54a5f9700 1 --2- 172.21.15.72:0/1069326408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd54409f240 0x7fd5441a6230 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.853+0000 7fd54a5f9700 1 -- 172.21.15.72:0/1069326408 >> 172.21.15.72:0/1069326408 conn(0x7fd5440a4210 msgr2=0x7fd54409dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.853+0000 7fd54a5f9700 1 -- 172.21.15.72:0/1069326408 shutdown_connections 2023-10-03T10:14:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.853+0000 7fd54a5f9700 1 -- 172.21.15.72:0/1069326408 wait complete. 2023-10-03T10:14:50.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.986+0000 7f157d218700 1 -- 172.21.15.72:0/3202504430 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f15780a3580 con 0x7f157809e930 2023-10-03T10:14:50.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.987+0000 7f155f7fe700 1 -- 172.21.15.72:0/3202504430 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1568015020 con 0x7f157809e930 2023-10-03T10:14:50.987 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:50.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.989+0000 7f157d218700 1 -- 172.21.15.72:0/3202504430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f157809e930 msgr2=0x7f157806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.989+0000 7f157d218700 1 --2- 172.21.15.72:0/3202504430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f157809e930 0x7f157806b8b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f15680090b0 tx=0x7f1568004750 comp rx=0 tx=0).stop 2023-10-03T10:14:50.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.989+0000 7f157d218700 1 -- 172.21.15.72:0/3202504430 shutdown_connections 2023-10-03T10:14:50.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.989+0000 7f157d218700 1 --2- 172.21.15.72:0/3202504430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f157809f650 0x7f157806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.989+0000 7f157d218700 1 --2- 172.21.15.72:0/3202504430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f157809e930 0x7f157806b8b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.989+0000 7f157d218700 1 --2- 172.21.15.72:0/3202504430 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f157809f240 0x7f157806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.989+0000 7f157d218700 1 -- 172.21.15.72:0/3202504430 >> 172.21.15.72:0/3202504430 conn(0x7f15780a4210 msgr2=0x7f157809c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.989+0000 7f157d218700 1 -- 172.21.15.72:0/3202504430 shutdown_connections 2023-10-03T10:14:50.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:50.989+0000 7f157d218700 1 -- 172.21.15.72:0/3202504430 wait complete. 2023-10-03T10:14:51.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:51.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.025+0000 7fd7bbca0700 1 -- 172.21.15.72:0/3838887163 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd7b41331f0 con 0x7fd7b409d630 2023-10-03T10:14:51.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.026+0000 7fd7aa7fc700 1 -- 172.21.15.72:0/3838887163 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd7b0021030 con 0x7fd7b409d630 2023-10-03T10:14:51.025 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:51.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.028+0000 7fd7bbca0700 1 -- 172.21.15.72:0/3838887163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b409d630 msgr2=0x7fd7b411e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.028+0000 7fd7bbca0700 1 --2- 172.21.15.72:0/3838887163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b409d630 0x7fd7b411e820 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000ebe0 tx=0x7fd7b000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.028+0000 7fd7bbca0700 1 -- 172.21.15.72:0/3838887163 shutdown_connections 2023-10-03T10:14:51.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.028+0000 7fd7bbca0700 1 --2- 172.21.15.72:0/3838887163 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b4133930 0x7fd7b411f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.028+0000 7fd7bbca0700 1 --2- 172.21.15.72:0/3838887163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b409d630 0x7fd7b411e820 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.028+0000 7fd7bbca0700 1 --2- 172.21.15.72:0/3838887163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b40a0a30 0x7fd7b411ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.028+0000 7fd7bbca0700 1 -- 172.21.15.72:0/3838887163 >> 172.21.15.72:0/3838887163 conn(0x7fd7b40a3050 msgr2=0x7fd7b40a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.028+0000 7fd7bbca0700 1 -- 172.21.15.72:0/3838887163 shutdown_connections 2023-10-03T10:14:51.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.028+0000 7fd7bbca0700 1 -- 172.21.15.72:0/3838887163 wait complete. 2023-10-03T10:14:51.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:51.364 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:51.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.486+0000 7fc31769d700 1 Processor -- start 2023-10-03T10:14:51.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.486+0000 7fc31769d700 1 -- start start 2023-10-03T10:14:51.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc31769d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc31009e1d0 0x7fc310138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc31769d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc310139170 0x7fc31013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc31769d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31009b120 con 0x7fc31009d6f0 2023-10-03T10:14:51.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc31769d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31006b460 con 0x7fc31009e1d0 2023-10-03T10:14:51.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc31769d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc31009a7e0 con 0x7fc310139170 2023-10-03T10:14:51.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc315c3a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc310139170 0x7fc31013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc315439700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc31009d6f0 0x7fc31009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51534/0 (socket says 172.21.15.72:51534) 2023-10-03T10:14:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc315439700 1 -- 172.21.15.72:0/1668946581 learned_addr learned my addr 172.21.15.72:0/1668946581 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc314c38700 1 --2- 172.21.15.72:0/1668946581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc31009e1d0 0x7fc310138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc314c38700 1 -- 172.21.15.72:0/1668946581 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc310139170 msgr2=0x7fc31013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc314c38700 1 --2- 172.21.15.72:0/1668946581 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc310139170 0x7fc31013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc314c38700 1 -- 172.21.15.72:0/1668946581 >> v1:172.21.15.72:6789/0 conn(0x7fc31009d6f0 legacy=0x7fc31009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc307fff700 1 -- 172.21.15.72:0/1668946581 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046196720 0 0) 0x7fc31009b120 con 0x7fc31009d6f0 2023-10-03T10:14:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc314c38700 1 -- 172.21.15.72:0/1668946581 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31009a500 con 0x7fc31009e1d0 2023-10-03T10:14:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc315c3a700 1 --2- 172.21.15.72:0/1668946581 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc310139170 0x7fc31013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.487+0000 7fc314c38700 1 --2- 172.21.15.72:0/1668946581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc31009e1d0 0x7fc310138c30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009870 tx=0x7fc30c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfba5c706930f7e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.488+0000 7fc307fff700 1 -- 172.21.15.72:0/1668946581 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c011830 con 0x7fc31009e1d0 2023-10-03T10:14:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.488+0000 7fc307fff700 1 -- 172.21.15.72:0/1668946581 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c011990 con 0x7fc31009e1d0 2023-10-03T10:14:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.488+0000 7fc307fff700 1 -- 172.21.15.72:0/1668946581 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c011d20 con 0x7fc31009e1d0 2023-10-03T10:14:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.488+0000 7fc31769d700 1 -- 172.21.15.72:0/1668946581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc31009e1d0 msgr2=0x7fc310138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.488+0000 7fc31769d700 1 --2- 172.21.15.72:0/1668946581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc31009e1d0 0x7fc310138c30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009870 tx=0x7fc30c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.488+0000 7fc31769d700 1 -- 172.21.15.72:0/1668946581 shutdown_connections 2023-10-03T10:14:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.488+0000 7fc31769d700 1 --2- 172.21.15.72:0/1668946581 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc310139170 0x7fc31013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.488+0000 7fc31769d700 1 --2- 172.21.15.72:0/1668946581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc31009e1d0 0x7fc310138c30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.488+0000 7fc31769d700 1 -- 172.21.15.72:0/1668946581 >> 172.21.15.72:0/1668946581 conn(0x7fc310066f50 msgr2=0x7fc31009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.488+0000 7fc31769d700 1 -- 172.21.15.72:0/1668946581 shutdown_connections 2023-10-03T10:14:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.488+0000 7fc31769d700 1 -- 172.21.15.72:0/1668946581 wait complete. 2023-10-03T10:14:51.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.489+0000 7fc31769d700 1 Processor -- start 2023-10-03T10:14:51.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.489+0000 7fc31769d700 1 -- start start 2023-10-03T10:14:51.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.490+0000 7fc31769d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc31009d6f0 0x7fc310120770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.490+0000 7fc31769d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc31009e1d0 0x7fc310120cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.490+0000 7fc31769d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc310139170 0x7fc3101211f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.490+0000 7fc31769d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc310122ba0 con 0x7fc31009e1d0 2023-10-03T10:14:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.490+0000 7fc31769d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc310136610 con 0x7fc310139170 2023-10-03T10:14:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.490+0000 7fc31769d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc31009c710 con 0x7fc31009d6f0 2023-10-03T10:14:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.490+0000 7fc315439700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc31009d6f0 0x7fc310120770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.490+0000 7fc314c38700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc31009e1d0 0x7fc310120cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.490+0000 7fc315c3a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc310139170 0x7fc3101211f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.490+0000 7fc314c38700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc31009e1d0 0x7fc310120cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56546/0 (socket says 172.21.15.72:56546) 2023-10-03T10:14:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.490+0000 7fc315439700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc31009d6f0 0x7fc310120770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57470/0 (socket says 172.21.15.72:57470) 2023-10-03T10:14:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.490+0000 7fc314c38700 1 -- 172.21.15.72:0/1088239276 learned_addr learned my addr 172.21.15.72:0/1088239276 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.490+0000 7fc314c38700 1 -- 172.21.15.72:0/1088239276 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc31009d6f0 msgr2=0x7fc310120770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.490+0000 7fc314c38700 1 --2- 172.21.15.72:0/1088239276 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc31009d6f0 0x7fc310120770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.491+0000 7fc314c38700 1 -- 172.21.15.72:0/1088239276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc310139170 msgr2=0x7fc3101211f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.491+0000 7fc314c38700 1 --2- 172.21.15.72:0/1088239276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc310139170 0x7fc3101211f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.491+0000 7fc314c38700 1 -- 172.21.15.72:0/1088239276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc308009a70 con 0x7fc31009e1d0 2023-10-03T10:14:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.491+0000 7fc315439700 1 --2- 172.21.15.72:0/1088239276 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc31009d6f0 0x7fc310120770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.491+0000 7fc315c3a700 1 --2- 172.21.15.72:0/1088239276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc310139170 0x7fc3101211f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.491+0000 7fc314c38700 1 --2- 172.21.15.72:0/1088239276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc31009e1d0 0x7fc310120cb0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc30c000c00 tx=0x7fc30c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.491+0000 7fc305ffb700 1 -- 172.21.15.72:0/1088239276 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c024620 con 0x7fc31009e1d0 2023-10-03T10:14:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.491+0000 7fc305ffb700 1 -- 172.21.15.72:0/1088239276 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c024780 con 0x7fc31009e1d0 2023-10-03T10:14:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.491+0000 7fc305ffb700 1 -- 172.21.15.72:0/1088239276 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c024b10 con 0x7fc31009e1d0 2023-10-03T10:14:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.491+0000 7fc31769d700 1 -- 172.21.15.72:0/1088239276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c0094a0 con 0x7fc31009e1d0 2023-10-03T10:14:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.491+0000 7fc31769d700 1 -- 172.21.15.72:0/1088239276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc310072150 con 0x7fc31009e1d0 2023-10-03T10:14:51.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.492+0000 7fc305ffb700 1 -- 172.21.15.72:0/1088239276 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc30c022070 con 0x7fc31009e1d0 2023-10-03T10:14:51.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.492+0000 7fc305ffb700 1 -- 172.21.15.72:0/1088239276 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc30c0409b0 con 0x7fc31009e1d0 2023-10-03T10:14:51.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.492+0000 7fc31769d700 1 -- 172.21.15.72:0/1088239276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc310074ea0 con 0x7fc31009e1d0 2023-10-03T10:14:51.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.496+0000 7fc305ffb700 1 -- 172.21.15.72:0/1088239276 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc30c029080 con 0x7fc31009e1d0 2023-10-03T10:14:51.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.678+0000 7fc31769d700 1 -- 172.21.15.72:0/1088239276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc31006c360 con 0x7fc31009e1d0 2023-10-03T10:14:51.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.679+0000 7fc305ffb700 1 -- 172.21.15.72:0/1088239276 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc30c015020 con 0x7fc31009e1d0 2023-10-03T10:14:51.678 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.680+0000 7fc31769d700 1 -- 172.21.15.72:0/1088239276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc31009e1d0 msgr2=0x7fc310120cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.680+0000 7fc31769d700 1 --2- 172.21.15.72:0/1088239276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc31009e1d0 0x7fc310120cb0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc30c000c00 tx=0x7fc30c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.680+0000 7fc31769d700 1 -- 172.21.15.72:0/1088239276 shutdown_connections 2023-10-03T10:14:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.680+0000 7fc31769d700 1 --2- 172.21.15.72:0/1088239276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc310139170 0x7fc3101211f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.680+0000 7fc31769d700 1 --2- 172.21.15.72:0/1088239276 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc31009d6f0 0x7fc310120770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.680+0000 7fc31769d700 1 --2- 172.21.15.72:0/1088239276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc31009e1d0 0x7fc310120cb0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.680+0000 7fc31769d700 1 -- 172.21.15.72:0/1088239276 >> 172.21.15.72:0/1088239276 conn(0x7fc310066f50 msgr2=0x7fc310136b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.680+0000 7fc31769d700 1 -- 172.21.15.72:0/1088239276 shutdown_connections 2023-10-03T10:14:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.680+0000 7fc31769d700 1 -- 172.21.15.72:0/1088239276 wait complete. 2023-10-03T10:14:51.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:51.866 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:51.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.989+0000 7f55a8576700 1 Processor -- start 2023-10-03T10:14:51.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.989+0000 7f55a8576700 1 -- start start 2023-10-03T10:14:51.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a8576700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f55a0133b10 0x7f55a0133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a8576700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a009de50 0x7f55a009e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a8576700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a01334b0 con 0x7f55a009e7e0 2023-10-03T10:14:51.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a8576700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a0134420 con 0x7f55a0133b10 2023-10-03T10:14:51.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a8576700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0070bc0 con 0x7f55a009de50 2023-10-03T10:14:51.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a6312700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f55a0133b10 0x7f55a0133ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a5b11700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a009de50 0x7f55a009e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a5b11700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a009de50 0x7f55a009e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46678/0 (socket says 172.21.15.72:46678) 2023-10-03T10:14:51.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a6312700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f55a0133b10 0x7f55a0133ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56556/0 (socket says 172.21.15.72:56556) 2023-10-03T10:14:51.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a5b11700 1 -- 172.21.15.72:0/699146830 learned_addr learned my addr 172.21.15.72:0/699146830 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:51.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a6312700 1 -- 172.21.15.72:0/699146830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a009de50 msgr2=0x7f55a009e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a6312700 1 --2- 172.21.15.72:0/699146830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a009de50 0x7f55a009e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a6312700 1 -- 172.21.15.72:0/699146830 >> v1:172.21.15.72:6789/0 conn(0x7f55a009e7e0 legacy=0x7f55a013a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a5310700 1 -- 172.21.15.72:0/699146830 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641895946 0 0) 0x7f55a01334b0 con 0x7f55a009e7e0 2023-10-03T10:14:51.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a6312700 1 -- 172.21.15.72:0/699146830 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a0070350 con 0x7f55a0133b10 2023-10-03T10:14:51.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a5b11700 1 --2- 172.21.15.72:0/699146830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a009de50 0x7f55a009e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a6312700 1 --2- 172.21.15.72:0/699146830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55a0133b10 0x7f55a0133ee0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5590009840 tx=0x7f5590009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6a598fb8973d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a5310700 1 -- 172.21.15.72:0/699146830 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590011830 con 0x7f55a0133b10 2023-10-03T10:14:51.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a5310700 1 -- 172.21.15.72:0/699146830 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5590011990 con 0x7f55a0133b10 2023-10-03T10:14:51.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.990+0000 7f55a5310700 1 -- 172.21.15.72:0/699146830 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590011d20 con 0x7f55a0133b10 2023-10-03T10:14:51.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.991+0000 7f55a8576700 1 -- 172.21.15.72:0/699146830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55a0133b10 msgr2=0x7f55a0133ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.991+0000 7f55a8576700 1 --2- 172.21.15.72:0/699146830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55a0133b10 0x7f55a0133ee0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5590009840 tx=0x7f5590009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:51.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.991+0000 7f55a8576700 1 -- 172.21.15.72:0/699146830 shutdown_connections 2023-10-03T10:14:51.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.991+0000 7f55a8576700 1 --2- 172.21.15.72:0/699146830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55a0133b10 0x7f55a0133ee0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.991+0000 7f55a8576700 1 --2- 172.21.15.72:0/699146830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a009de50 0x7f55a009e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.991+0000 7f55a8576700 1 -- 172.21.15.72:0/699146830 >> 172.21.15.72:0/699146830 conn(0x7f55a00a2aa0 msgr2=0x7f55a00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.991+0000 7f55a8576700 1 -- 172.21.15.72:0/699146830 shutdown_connections 2023-10-03T10:14:51.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.991+0000 7f55a8576700 1 -- 172.21.15.72:0/699146830 wait complete. 2023-10-03T10:14:51.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.992+0000 7f55a8576700 1 Processor -- start 2023-10-03T10:14:51.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.992+0000 7f55a8576700 1 -- start start 2023-10-03T10:14:51.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.992+0000 7f55a8576700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55a009de50 0x7f55a011d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.992+0000 7f55a8576700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a009e7e0 0x7f55a011df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.992+0000 7f55a8576700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55a0133b10 0x7f55a011e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.992+0000 7f55a8576700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a011fb90 con 0x7f55a009de50 2023-10-03T10:14:51.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.992+0000 7f55a8576700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a00a0f60 con 0x7f55a009e7e0 2023-10-03T10:14:51.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.992+0000 7f55a8576700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55a006f910 con 0x7f55a0133b10 2023-10-03T10:14:51.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f55a6312700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55a009de50 0x7f55a011d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f55a5b11700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a009e7e0 0x7f55a011df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f55a6b13700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55a0133b10 0x7f55a011e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f55a6312700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55a009de50 0x7f55a011d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56562/0 (socket says 172.21.15.72:56562) 2023-10-03T10:14:51.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f55a6312700 1 -- 172.21.15.72:0/2578774272 learned_addr learned my addr 172.21.15.72:0/2578774272 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:51.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f55a5b11700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a009e7e0 0x7f55a011df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46680/0 (socket says 172.21.15.72:46680) 2023-10-03T10:14:51.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f55a6312700 1 -- 172.21.15.72:0/2578774272 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55a0133b10 msgr2=0x7f55a011e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f55a6312700 1 --2- 172.21.15.72:0/2578774272 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55a0133b10 0x7f55a011e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f55a6312700 1 -- 172.21.15.72:0/2578774272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a009e7e0 msgr2=0x7f55a011df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f55a6312700 1 --2- 172.21.15.72:0/2578774272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a009e7e0 0x7f55a011df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f55a6312700 1 -- 172.21.15.72:0/2578774272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c009550 con 0x7f55a009de50 2023-10-03T10:14:51.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f55a6b13700 1 --2- 172.21.15.72:0/2578774272 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55a0133b10 0x7f55a011e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:51.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f55a6312700 1 --2- 172.21.15.72:0/2578774272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55a009de50 0x7f55a011d9d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5590009fd0 tx=0x7f5590004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f5596ffd700 1 -- 172.21.15.72:0/2578774272 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55900036a0 con 0x7f55a009de50 2023-10-03T10:14:51.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f5596ffd700 1 -- 172.21.15.72:0/2578774272 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559001f070 con 0x7f55a009de50 2023-10-03T10:14:51.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f55a8576700 1 -- 172.21.15.72:0/2578774272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55900094a0 con 0x7f55a009de50 2023-10-03T10:14:51.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f5596ffd700 1 -- 172.21.15.72:0/2578774272 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590003a20 con 0x7f55a009de50 2023-10-03T10:14:51.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.993+0000 7f55a8576700 1 -- 172.21.15.72:0/2578774272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a0121210 con 0x7f55a009de50 2023-10-03T10:14:51.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.994+0000 7f5596ffd700 1 -- 172.21.15.72:0/2578774272 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5590003b80 con 0x7f55a009de50 2023-10-03T10:14:51.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.994+0000 7f55a8576700 1 -- 172.21.15.72:0/2578774272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a0120e60 con 0x7f55a009de50 2023-10-03T10:14:51.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.994+0000 7f5596ffd700 1 -- 172.21.15.72:0/2578774272 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5590021070 con 0x7f55a009de50 2023-10-03T10:14:51.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:51.998+0000 7f5596ffd700 1 -- 172.21.15.72:0/2578774272 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5590003e30 con 0x7f55a009de50 2023-10-03T10:14:52.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:52.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:52.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.134+0000 7fe1309e4700 1 Processor -- start 2023-10-03T10:14:52.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.134+0000 7fe1309e4700 1 -- start start 2023-10-03T10:14:52.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe1309e4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe12c0a0090 0x7fe12c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe1309e4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe12c09d130 0x7fe12c139170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe1309e4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12c09ba70 con 0x7fe12c09c650 2023-10-03T10:14:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe1309e4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12c09e8f0 con 0x7fe12c0a0090 2023-10-03T10:14:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe1309e4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c0a0760 con 0x7fe12c09d130 2023-10-03T10:14:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe12ad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe12c09d130 0x7fe12c139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe12a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe12c09c650 0x7fe12c09ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51554/0 (socket says 172.21.15.72:51554) 2023-10-03T10:14:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe12a59c700 1 -- 172.21.15.72:0/1610469367 learned_addr learned my addr 172.21.15.72:0/1610469367 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe129d9b700 1 --2- 172.21.15.72:0/1610469367 >> v2:172.21.15.72:3300/0 conn(0x7fe12c0a0090 0x7fe12c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe12959a700 1 -- 172.21.15.72:0/1610469367 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411316584 0 0) 0x7fe12c09ba70 con 0x7fe12c09c650 2023-10-03T10:14:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe12959a700 1 -- 172.21.15.72:0/1610469367 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1140035b0 con 0x7fe12c09c650 2023-10-03T10:14:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe12ad9d700 1 -- 172.21.15.72:0/1610469367 >> v2:172.21.15.72:3300/0 conn(0x7fe12c0a0090 msgr2=0x7fe12c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe12ad9d700 1 --2- 172.21.15.72:0/1610469367 >> v2:172.21.15.72:3300/0 conn(0x7fe12c0a0090 0x7fe12c136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe12ad9d700 1 -- 172.21.15.72:0/1610469367 >> v1:172.21.15.72:6789/0 conn(0x7fe12c09c650 legacy=0x7fe12c09ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe12ad9d700 1 -- 172.21.15.72:0/1610469367 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c09a080 con 0x7fe12c09d130 2023-10-03T10:14:52.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe129d9b700 1 --2- 172.21.15.72:0/1610469367 >> v2:172.21.15.72:3300/0 conn(0x7fe12c0a0090 0x7fe12c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.135+0000 7fe12ad9d700 1 --2- 172.21.15.72:0/1610469367 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe12c09d130 0x7fe12c139170 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe124009d90 tx=0x7fe12400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dbac10da8c65832 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.136+0000 7fe12959a700 1 -- 172.21.15.72:0/1610469367 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12400e070 con 0x7fe12c09d130 2023-10-03T10:14:52.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.136+0000 7fe12959a700 1 -- 172.21.15.72:0/1610469367 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12400bb20 con 0x7fe12c09d130 2023-10-03T10:14:52.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.136+0000 7fe12959a700 1 -- 172.21.15.72:0/1610469367 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe124012430 con 0x7fe12c09d130 2023-10-03T10:14:52.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.136+0000 7fe1309e4700 1 -- 172.21.15.72:0/1610469367 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe12c09d130 msgr2=0x7fe12c139170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.136+0000 7fe1309e4700 1 --2- 172.21.15.72:0/1610469367 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe12c09d130 0x7fe12c139170 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe124009d90 tx=0x7fe12400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:52.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.136+0000 7fe1309e4700 1 -- 172.21.15.72:0/1610469367 shutdown_connections 2023-10-03T10:14:52.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.136+0000 7fe1309e4700 1 --2- 172.21.15.72:0/1610469367 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe12c09d130 0x7fe12c139170 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.136+0000 7fe1309e4700 1 --2- 172.21.15.72:0/1610469367 >> v2:172.21.15.72:3300/0 conn(0x7fe12c0a0090 0x7fe12c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.136+0000 7fe1309e4700 1 -- 172.21.15.72:0/1610469367 >> 172.21.15.72:0/1610469367 conn(0x7fe12c0a3f70 msgr2=0x7fe12c0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.136+0000 7fe1309e4700 1 -- 172.21.15.72:0/1610469367 shutdown_connections 2023-10-03T10:14:52.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.136+0000 7fe1309e4700 1 -- 172.21.15.72:0/1610469367 wait complete. 2023-10-03T10:14:52.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.137+0000 7fe1309e4700 1 Processor -- start 2023-10-03T10:14:52.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.137+0000 7fe1309e4700 1 -- start start 2023-10-03T10:14:52.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe1309e4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe12c09c650 0x7fe12c11a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe1309e4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe12c09d130 0x7fe12c11ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe1309e4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe12c0a0090 0x7fe12c11b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe1309e4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c11c910 con 0x7fe12c09d130 2023-10-03T10:14:52.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe1309e4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c09d980 con 0x7fe12c09c650 2023-10-03T10:14:52.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe1309e4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c11b740 con 0x7fe12c0a0090 2023-10-03T10:14:52.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe12a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe12c09c650 0x7fe12c11a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe12a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe12c09c650 0x7fe12c11a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46694/0 (socket says 172.21.15.72:46694) 2023-10-03T10:14:52.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe12a59c700 1 -- 172.21.15.72:0/293815102 learned_addr learned my addr 172.21.15.72:0/293815102 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:52.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe129d9b700 1 --2- 172.21.15.72:0/293815102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe12c09d130 0x7fe12c11ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe12ad9d700 1 --2- 172.21.15.72:0/293815102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe12c0a0090 0x7fe12c11b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe12a59c700 1 -- 172.21.15.72:0/293815102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe12c0a0090 msgr2=0x7fe12c11b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe12a59c700 1 --2- 172.21.15.72:0/293815102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe12c0a0090 0x7fe12c11b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe12a59c700 1 -- 172.21.15.72:0/293815102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe12c09d130 msgr2=0x7fe12c11ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe12a59c700 1 --2- 172.21.15.72:0/293815102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe12c09d130 0x7fe12c11ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe12a59c700 1 -- 172.21.15.72:0/293815102 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1200094a0 con 0x7fe12c09c650 2023-10-03T10:14:52.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.138+0000 7fe129d9b700 1 --2- 172.21.15.72:0/293815102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe12c09d130 0x7fe12c11ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.139+0000 7fe12a59c700 1 --2- 172.21.15.72:0/293815102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe12c09c650 0x7fe12c11a620 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe11c00c730 tx=0x7fe11c00ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.139+0000 7fe11affd700 1 -- 172.21.15.72:0/293815102 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c005d70 con 0x7fe12c09c650 2023-10-03T10:14:52.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.139+0000 7fe11affd700 1 -- 172.21.15.72:0/293815102 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c0070d0 con 0x7fe12c09c650 2023-10-03T10:14:52.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.139+0000 7fe1309e4700 1 -- 172.21.15.72:0/293815102 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe124009a70 con 0x7fe12c09c650 2023-10-03T10:14:52.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.139+0000 7fe11affd700 1 -- 172.21.15.72:0/293815102 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c007440 con 0x7fe12c09c650 2023-10-03T10:14:52.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.139+0000 7fe1309e4700 1 -- 172.21.15.72:0/293815102 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12c11bfc0 con 0x7fe12c09c650 2023-10-03T10:14:52.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.139+0000 7fe11affd700 1 -- 172.21.15.72:0/293815102 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe11c0075a0 con 0x7fe12c09c650 2023-10-03T10:14:52.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.140+0000 7fe11affd700 1 -- 172.21.15.72:0/293815102 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe11c03eb20 con 0x7fe12c09c650 2023-10-03T10:14:52.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.140+0000 7fe1309e4700 1 -- 172.21.15.72:0/293815102 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12c11c560 con 0x7fe12c09c650 2023-10-03T10:14:52.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.145+0000 7fe11affd700 1 -- 172.21.15.72:0/293815102 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe11c019b40 con 0x7fe12c09c650 2023-10-03T10:14:52.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.176+0000 7f484d259700 1 Processor -- start 2023-10-03T10:14:52.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.176+0000 7f484d259700 1 -- start start 2023-10-03T10:14:52.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.176+0000 7f484d259700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484809d6f0 0x7f484809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.176+0000 7f484d259700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484809e000 0x7f48481339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.176+0000 7f484d259700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f484809e410 0x7f4848133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.176+0000 7f484d259700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484806b460 con 0x7f484809e410 2023-10-03T10:14:52.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.176+0000 7f484d259700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484809b120 con 0x7f484809d6f0 2023-10-03T10:14:52.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.176+0000 7f484d259700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f484809a7e0 con 0x7f484809e000 2023-10-03T10:14:52.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.177+0000 7f4846d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484809d6f0 0x7f484809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.177+0000 7f4846d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484809d6f0 0x7f484809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46696/0 (socket says 172.21.15.72:46696) 2023-10-03T10:14:52.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.177+0000 7f4846d9d700 1 -- 172.21.15.72:0/881752260 learned_addr learned my addr 172.21.15.72:0/881752260 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:52.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.177+0000 7f484659c700 1 --2- 172.21.15.72:0/881752260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484809e000 0x7f48481339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.177+0000 7f484759e700 1 --2- 172.21.15.72:0/881752260 >> v2:172.21.15.72:3300/0 conn(0x7f484809e410 0x7f4848133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.177+0000 7f4846d9d700 1 -- 172.21.15.72:0/881752260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484809e000 msgr2=0x7f48481339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.177+0000 7f4846d9d700 1 --2- 172.21.15.72:0/881752260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484809e000 0x7f48481339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.177+0000 7f4846d9d700 1 -- 172.21.15.72:0/881752260 >> v2:172.21.15.72:3300/0 conn(0x7f484809e410 msgr2=0x7f4848133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.177+0000 7f4846d9d700 1 --2- 172.21.15.72:0/881752260 >> v2:172.21.15.72:3300/0 conn(0x7f484809e410 0x7f4848133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.177+0000 7f4846d9d700 1 -- 172.21.15.72:0/881752260 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484809a500 con 0x7f484809d6f0 2023-10-03T10:14:52.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.177+0000 7f4846d9d700 1 --2- 172.21.15.72:0/881752260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484809d6f0 0x7f484809dac0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4838009920 tx=0x7f4838009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8436e0ac4cd748e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.177+0000 7f4845d9b700 1 -- 172.21.15.72:0/881752260 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838011830 con 0x7f484809d6f0 2023-10-03T10:14:52.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.177+0000 7f4845d9b700 1 -- 172.21.15.72:0/881752260 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4838011990 con 0x7f484809d6f0 2023-10-03T10:14:52.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.177+0000 7f4845d9b700 1 -- 172.21.15.72:0/881752260 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838011d20 con 0x7f484809d6f0 2023-10-03T10:14:52.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.178+0000 7f484d259700 1 -- 172.21.15.72:0/881752260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484809d6f0 msgr2=0x7f484809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.178+0000 7f484d259700 1 --2- 172.21.15.72:0/881752260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484809d6f0 0x7f484809dac0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4838009920 tx=0x7f4838009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:52.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.178+0000 7f484d259700 1 -- 172.21.15.72:0/881752260 shutdown_connections 2023-10-03T10:14:52.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.178+0000 7f484d259700 1 --2- 172.21.15.72:0/881752260 >> v2:172.21.15.72:3300/0 conn(0x7f484809e410 0x7f4848133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.178+0000 7f484d259700 1 --2- 172.21.15.72:0/881752260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484809d6f0 0x7f484809dac0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.178+0000 7f484d259700 1 --2- 172.21.15.72:0/881752260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484809e000 0x7f48481339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.178+0000 7f484d259700 1 -- 172.21.15.72:0/881752260 >> 172.21.15.72:0/881752260 conn(0x7f4848066f50 msgr2=0x7f484809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.178+0000 7f484d259700 1 -- 172.21.15.72:0/881752260 shutdown_connections 2023-10-03T10:14:52.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.178+0000 7f484d259700 1 -- 172.21.15.72:0/881752260 wait complete. 2023-10-03T10:14:52.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.179+0000 7f484d259700 1 Processor -- start 2023-10-03T10:14:52.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.179+0000 7f484d259700 1 -- start start 2023-10-03T10:14:52.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.179+0000 7f484d259700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484809d6f0 0x7f48481c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.179+0000 7f484d259700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484809e000 0x7f48481c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.179+0000 7f484d259700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f484809e410 0x7f48481c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.179+0000 7f484d259700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48481a5590 con 0x7f484809e410 2023-10-03T10:14:52.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f484d259700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48481a53a0 con 0x7f484809d6f0 2023-10-03T10:14:52.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f484d259700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48480a30c0 con 0x7f484809e000 2023-10-03T10:14:52.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f484659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484809e000 0x7f48481c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f484659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484809e000 0x7f48481c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57498/0 (socket says 172.21.15.72:57498) 2023-10-03T10:14:52.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f484659c700 1 -- 172.21.15.72:0/4107633923 learned_addr learned my addr 172.21.15.72:0/4107633923 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:52.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f4846d9d700 1 --2- 172.21.15.72:0/4107633923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484809d6f0 0x7f48481c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f484759e700 1 --2- 172.21.15.72:0/4107633923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f484809e410 0x7f48481c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f4846d9d700 1 -- 172.21.15.72:0/4107633923 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484809e000 msgr2=0x7f48481c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f4846d9d700 1 --2- 172.21.15.72:0/4107633923 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484809e000 0x7f48481c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f4846d9d700 1 -- 172.21.15.72:0/4107633923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f484809e410 msgr2=0x7f48481c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f4846d9d700 1 --2- 172.21.15.72:0/4107633923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f484809e410 0x7f48481c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f4846d9d700 1 -- 172.21.15.72:0/4107633923 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4838009550 con 0x7f484809d6f0 2023-10-03T10:14:52.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f484659c700 1 --2- 172.21.15.72:0/4107633923 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484809e000 0x7f48481c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f4846d9d700 1 --2- 172.21.15.72:0/4107633923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484809d6f0 0x7f48481c8190 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4838016000 tx=0x7f4838004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f482f7fe700 1 -- 172.21.15.72:0/4107633923 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838004240 con 0x7f484809d6f0 2023-10-03T10:14:52.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f482f7fe700 1 -- 172.21.15.72:0/4107633923 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483801f070 con 0x7f484809d6f0 2023-10-03T10:14:52.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f484d259700 1 -- 172.21.15.72:0/4107633923 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484809c710 con 0x7f484809d6f0 2023-10-03T10:14:52.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f482f7fe700 1 -- 172.21.15.72:0/4107633923 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380036a0 con 0x7f484809d6f0 2023-10-03T10:14:52.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.180+0000 7f484d259700 1 -- 172.21.15.72:0/4107633923 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48481b84f0 con 0x7f484809d6f0 2023-10-03T10:14:52.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.181+0000 7f482f7fe700 1 -- 172.21.15.72:0/4107633923 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4838021030 con 0x7f484809d6f0 2023-10-03T10:14:52.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.181+0000 7f482f7fe700 1 -- 172.21.15.72:0/4107633923 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4838040860 con 0x7f484809d6f0 2023-10-03T10:14:52.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.181+0000 7f484d259700 1 -- 172.21.15.72:0/4107633923 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48481a6c70 con 0x7f484809d6f0 2023-10-03T10:14:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.190+0000 7f482f7fe700 1 -- 172.21.15.72:0/4107633923 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48380239c0 con 0x7f484809d6f0 2023-10-03T10:14:52.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.199+0000 7f55a8576700 1 -- 172.21.15.72:0/2578774272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f55a006eec0 con 0x7f55a009de50 2023-10-03T10:14:52.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.200+0000 7f5596ffd700 1 -- 172.21.15.72:0/2578774272 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5590015030 con 0x7f55a009de50 2023-10-03T10:14:52.199 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:52.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.202+0000 7f55a8576700 1 -- 172.21.15.72:0/2578774272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55a009de50 msgr2=0x7f55a011d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.202+0000 7f55a8576700 1 --2- 172.21.15.72:0/2578774272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55a009de50 0x7f55a011d9d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5590009fd0 tx=0x7f5590004750 comp rx=0 tx=0).stop 2023-10-03T10:14:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.202+0000 7f55a8576700 1 -- 172.21.15.72:0/2578774272 shutdown_connections 2023-10-03T10:14:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.202+0000 7f55a8576700 1 --2- 172.21.15.72:0/2578774272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55a009de50 0x7f55a011d9d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.202+0000 7f55a8576700 1 --2- 172.21.15.72:0/2578774272 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f55a0133b10 0x7f55a011e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.202+0000 7f55a8576700 1 --2- 172.21.15.72:0/2578774272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f55a009e7e0 0x7f55a011df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.202+0000 7f55a8576700 1 -- 172.21.15.72:0/2578774272 >> 172.21.15.72:0/2578774272 conn(0x7f55a00a2aa0 msgr2=0x7f55a01b94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.202+0000 7f55a8576700 1 -- 172.21.15.72:0/2578774272 shutdown_connections 2023-10-03T10:14:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.202+0000 7f55a8576700 1 -- 172.21.15.72:0/2578774272 wait complete. 2023-10-03T10:14:52.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:52.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.347+0000 7fe1309e4700 1 -- 172.21.15.72:0/293815102 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe12c0747f0 con 0x7fe12c09c650 2023-10-03T10:14:52.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.347+0000 7fe11affd700 1 -- 172.21.15.72:0/293815102 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe11c017020 con 0x7fe12c09c650 2023-10-03T10:14:52.347 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:52.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.349+0000 7fe1309e4700 1 -- 172.21.15.72:0/293815102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe12c09c650 msgr2=0x7fe12c11a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.349+0000 7fe1309e4700 1 --2- 172.21.15.72:0/293815102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe12c09c650 0x7fe12c11a620 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe11c00c730 tx=0x7fe11c00ca40 comp rx=0 tx=0).stop 2023-10-03T10:14:52.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.350+0000 7fe1309e4700 1 -- 172.21.15.72:0/293815102 shutdown_connections 2023-10-03T10:14:52.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.350+0000 7fe1309e4700 1 --2- 172.21.15.72:0/293815102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe12c0a0090 0x7fe12c11b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.350+0000 7fe1309e4700 1 --2- 172.21.15.72:0/293815102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe12c09c650 0x7fe12c11a620 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.350+0000 7fe1309e4700 1 --2- 172.21.15.72:0/293815102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe12c09d130 0x7fe12c11ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.350+0000 7fe1309e4700 1 -- 172.21.15.72:0/293815102 >> 172.21.15.72:0/293815102 conn(0x7fe12c0a3f70 msgr2=0x7fe12c0a2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.350+0000 7fe1309e4700 1 -- 172.21.15.72:0/293815102 shutdown_connections 2023-10-03T10:14:52.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.350+0000 7fe1309e4700 1 -- 172.21.15.72:0/293815102 wait complete. 2023-10-03T10:14:52.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:52.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.385+0000 7f484d259700 1 -- 172.21.15.72:0/4107633923 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4848074ea0 con 0x7f484809d6f0 2023-10-03T10:14:52.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.385+0000 7f482f7fe700 1 -- 172.21.15.72:0/4107633923 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f483801b430 con 0x7f484809d6f0 2023-10-03T10:14:52.385 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:52.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.387+0000 7f484d259700 1 -- 172.21.15.72:0/4107633923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484809d6f0 msgr2=0x7f48481c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.387+0000 7f484d259700 1 --2- 172.21.15.72:0/4107633923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484809d6f0 0x7f48481c8190 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4838016000 tx=0x7f4838004750 comp rx=0 tx=0).stop 2023-10-03T10:14:52.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.387+0000 7f484d259700 1 -- 172.21.15.72:0/4107633923 shutdown_connections 2023-10-03T10:14:52.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.387+0000 7f484d259700 1 --2- 172.21.15.72:0/4107633923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f484809e410 0x7f48481c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.387+0000 7f484d259700 1 --2- 172.21.15.72:0/4107633923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f484809d6f0 0x7f48481c8190 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.387+0000 7f484d259700 1 --2- 172.21.15.72:0/4107633923 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f484809e000 0x7f48481c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.387+0000 7f484d259700 1 -- 172.21.15.72:0/4107633923 >> 172.21.15.72:0/4107633923 conn(0x7f4848066f50 msgr2=0x7f48481bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.387+0000 7f484d259700 1 -- 172.21.15.72:0/4107633923 shutdown_connections 2023-10-03T10:14:52.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.387+0000 7f484d259700 1 -- 172.21.15.72:0/4107633923 wait complete. 2023-10-03T10:14:52.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:52.693 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:52.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd455a2b700 1 Processor -- start 2023-10-03T10:14:52.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd455a2b700 1 -- start start 2023-10-03T10:14:52.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd455a2b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4500a0a30 0x7fd4500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd455a2b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd45009d630 0x7fd4500a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd455a2b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd450133930 0x7fd450133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd455a2b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4500a2a70 con 0x7fd4500a0a30 2023-10-03T10:14:52.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd455a2b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4500a01d0 con 0x7fd450133930 2023-10-03T10:14:52.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd455a2b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd45009e2b0 con 0x7fd45009d630 2023-10-03T10:14:52.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd44e7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd45009d630 0x7fd4500a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd44effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4500a0a30 0x7fd4500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd44e7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd45009d630 0x7fd4500a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57508/0 (socket says 172.21.15.72:57508) 2023-10-03T10:14:52.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd44effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4500a0a30 0x7fd4500a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56600/0 (socket says 172.21.15.72:56600) 2023-10-03T10:14:52.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd44e7fc700 1 -- 172.21.15.72:0/1411168473 learned_addr learned my addr 172.21.15.72:0/1411168473 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:52.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd44f7fe700 1 --2- 172.21.15.72:0/1411168473 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd450133930 0x7fd450133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd44effd700 1 -- 172.21.15.72:0/1411168473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd45009d630 msgr2=0x7fd4500a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.817+0000 7fd44effd700 1 --2- 172.21.15.72:0/1411168473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd45009d630 0x7fd4500a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd44effd700 1 -- 172.21.15.72:0/1411168473 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd450133930 msgr2=0x7fd450133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd44effd700 1 --2- 172.21.15.72:0/1411168473 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd450133930 0x7fd450133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd44effd700 1 -- 172.21.15.72:0/1411168473 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45009dc50 con 0x7fd4500a0a30 2023-10-03T10:14:52.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd44e7fc700 1 --2- 172.21.15.72:0/1411168473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd45009d630 0x7fd4500a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd44f7fe700 1 --2- 172.21.15.72:0/1411168473 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd450133930 0x7fd450133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd44effd700 1 --2- 172.21.15.72:0/1411168473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4500a0a30 0x7fd4500a0e00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd440009840 tx=0x7fd440009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae938884f58445b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd44dffb700 1 -- 172.21.15.72:0/1411168473 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440011830 con 0x7fd4500a0a30 2023-10-03T10:14:52.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd44dffb700 1 -- 172.21.15.72:0/1411168473 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd440011990 con 0x7fd4500a0a30 2023-10-03T10:14:52.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd44dffb700 1 -- 172.21.15.72:0/1411168473 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440011d20 con 0x7fd4500a0a30 2023-10-03T10:14:52.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd455a2b700 1 -- 172.21.15.72:0/1411168473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4500a0a30 msgr2=0x7fd4500a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd455a2b700 1 --2- 172.21.15.72:0/1411168473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4500a0a30 0x7fd4500a0e00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd440009840 tx=0x7fd440009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:52.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd455a2b700 1 -- 172.21.15.72:0/1411168473 shutdown_connections 2023-10-03T10:14:52.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd455a2b700 1 --2- 172.21.15.72:0/1411168473 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd450133930 0x7fd450133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd455a2b700 1 --2- 172.21.15.72:0/1411168473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4500a0a30 0x7fd4500a0e00 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd455a2b700 1 --2- 172.21.15.72:0/1411168473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd45009d630 0x7fd4500a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd455a2b700 1 -- 172.21.15.72:0/1411168473 >> 172.21.15.72:0/1411168473 conn(0x7fd4500a3050 msgr2=0x7fd4500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd455a2b700 1 -- 172.21.15.72:0/1411168473 shutdown_connections 2023-10-03T10:14:52.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.818+0000 7fd455a2b700 1 -- 172.21.15.72:0/1411168473 wait complete. 2023-10-03T10:14:52.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.819+0000 7fd455a2b700 1 Processor -- start 2023-10-03T10:14:52.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd455a2b700 1 -- start start 2023-10-03T10:14:52.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd455a2b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd45009d630 0x7fd45011f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd455a2b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4500a0a30 0x7fd45011f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd455a2b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd450133930 0x7fd4501c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd455a2b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45011ff00 con 0x7fd4500a0a30 2023-10-03T10:14:52.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd455a2b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4501332f0 con 0x7fd450133930 2023-10-03T10:14:52.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd455a2b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd45011ef90 con 0x7fd45009d630 2023-10-03T10:14:52.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd44effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd45009d630 0x7fd45011f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd44f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd450133930 0x7fd4501c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd44effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd45009d630 0x7fd45011f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57524/0 (socket says 172.21.15.72:57524) 2023-10-03T10:14:52.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd44f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd450133930 0x7fd4501c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46712/0 (socket says 172.21.15.72:46712) 2023-10-03T10:14:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd44e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4500a0a30 0x7fd45011f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd44f7fe700 1 -- 172.21.15.72:0/2580045712 learned_addr learned my addr 172.21.15.72:0/2580045712 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd44effd700 1 -- 172.21.15.72:0/2580045712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd450133930 msgr2=0x7fd4501c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd44effd700 1 --2- 172.21.15.72:0/2580045712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd450133930 0x7fd4501c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd44effd700 1 -- 172.21.15.72:0/2580045712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4500a0a30 msgr2=0x7fd45011f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd44effd700 1 --2- 172.21.15.72:0/2580045712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4500a0a30 0x7fd45011f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd44effd700 1 -- 172.21.15.72:0/2580045712 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd444009550 con 0x7fd45009d630 2023-10-03T10:14:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.820+0000 7fd44e7fc700 1 --2- 172.21.15.72:0/2580045712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4500a0a30 0x7fd45011f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.821+0000 7fd44effd700 1 --2- 172.21.15.72:0/2580045712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd45009d630 0x7fd45011f480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd440016000 tx=0x7fd440004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.821+0000 7fd437fff700 1 -- 172.21.15.72:0/2580045712 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd440004240 con 0x7fd45009d630 2023-10-03T10:14:52.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.821+0000 7fd437fff700 1 -- 172.21.15.72:0/2580045712 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44001f070 con 0x7fd45009d630 2023-10-03T10:14:52.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.821+0000 7fd437fff700 1 -- 172.21.15.72:0/2580045712 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4400036a0 con 0x7fd45009d630 2023-10-03T10:14:52.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.821+0000 7fd455a2b700 1 -- 172.21.15.72:0/2580045712 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd448009a70 con 0x7fd45009d630 2023-10-03T10:14:52.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.821+0000 7fd455a2b700 1 -- 172.21.15.72:0/2580045712 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4400094a0 con 0x7fd45009d630 2023-10-03T10:14:52.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.821+0000 7fd437fff700 1 -- 172.21.15.72:0/2580045712 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd440021030 con 0x7fd45009d630 2023-10-03T10:14:52.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.822+0000 7fd437fff700 1 -- 172.21.15.72:0/2580045712 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd4400405d0 con 0x7fd45009d630 2023-10-03T10:14:52.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.822+0000 7fd455a2b700 1 -- 172.21.15.72:0/2580045712 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4500747f0 con 0x7fd45009d630 2023-10-03T10:14:52.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:52.826+0000 7fd437fff700 1 -- 172.21.15.72:0/2580045712 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd440015020 con 0x7fd45009d630 2023-10-03T10:14:53.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.010+0000 7fd455a2b700 1 -- 172.21.15.72:0/2580045712 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd4501211e0 con 0x7fd45009d630 2023-10-03T10:14:53.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.011+0000 7fd437fff700 1 -- 172.21.15.72:0/2580045712 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd440010970 con 0x7fd45009d630 2023-10-03T10:14:53.011 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:53.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.013+0000 7fd455a2b700 1 -- 172.21.15.72:0/2580045712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd45009d630 msgr2=0x7fd45011f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.013+0000 7fd455a2b700 1 --2- 172.21.15.72:0/2580045712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd45009d630 0x7fd45011f480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd440016000 tx=0x7fd440004750 comp rx=0 tx=0).stop 2023-10-03T10:14:53.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.013+0000 7fd455a2b700 1 -- 172.21.15.72:0/2580045712 shutdown_connections 2023-10-03T10:14:53.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.013+0000 7fd455a2b700 1 --2- 172.21.15.72:0/2580045712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd450133930 0x7fd4501c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.013+0000 7fd455a2b700 1 --2- 172.21.15.72:0/2580045712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd45009d630 0x7fd45011f480 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.013+0000 7fd455a2b700 1 --2- 172.21.15.72:0/2580045712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4500a0a30 0x7fd45011f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.013+0000 7fd455a2b700 1 -- 172.21.15.72:0/2580045712 >> 172.21.15.72:0/2580045712 conn(0x7fd4500a3050 msgr2=0x7fd4500a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.013+0000 7fd455a2b700 1 -- 172.21.15.72:0/2580045712 shutdown_connections 2023-10-03T10:14:53.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.013+0000 7fd455a2b700 1 -- 172.21.15.72:0/2580045712 wait complete. 2023-10-03T10:14:53.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:53.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.337+0000 7ffb4ad3e700 1 Processor -- start 2023-10-03T10:14:53.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.337+0000 7ffb4ad3e700 1 -- start start 2023-10-03T10:14:53.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.338+0000 7ffb4ad3e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb4409e1d0 0x7ffb44138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.338+0000 7ffb4ad3e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb44139170 0x7ffb4413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.338+0000 7ffb4ad3e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4409b120 con 0x7ffb4409d6f0 2023-10-03T10:14:53.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.338+0000 7ffb4ad3e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4406b460 con 0x7ffb4409e1d0 2023-10-03T10:14:53.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.338+0000 7ffb4ad3e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4409a7e0 con 0x7ffb44139170 2023-10-03T10:14:53.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.338+0000 7ffb43fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb4409e1d0 0x7ffb44138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.338+0000 7ffb48ada700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffb4409d6f0 0x7ffb4409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51566/0 (socket says 172.21.15.72:51566) 2023-10-03T10:14:53.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.338+0000 7ffb48ada700 1 -- 172.21.15.72:0/3566653967 learned_addr learned my addr 172.21.15.72:0/3566653967 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:53.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.338+0000 7ffb492db700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb44139170 0x7ffb4413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.338+0000 7ffb437fe700 1 -- 172.21.15.72:0/3566653967 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799523348 0 0) 0x7ffb4409b120 con 0x7ffb4409d6f0 2023-10-03T10:14:53.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.338+0000 7ffb492db700 1 -- 172.21.15.72:0/3566653967 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb4409e1d0 msgr2=0x7ffb44138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:53.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.338+0000 7ffb492db700 1 --2- 172.21.15.72:0/3566653967 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb4409e1d0 0x7ffb44138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.338+0000 7ffb492db700 1 -- 172.21.15.72:0/3566653967 >> v1:172.21.15.72:6789/0 conn(0x7ffb4409d6f0 legacy=0x7ffb4409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.338+0000 7ffb492db700 1 -- 172.21.15.72:0/3566653967 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4409a500 con 0x7ffb44139170 2023-10-03T10:14:53.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.339+0000 7ffb492db700 1 --2- 172.21.15.72:0/3566653967 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb44139170 0x7ffb4413b550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c009df0 tx=0x7ffb3c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=932325ad0472cd7a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.339+0000 7ffb437fe700 1 -- 172.21.15.72:0/3566653967 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c00e070 con 0x7ffb44139170 2023-10-03T10:14:53.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.339+0000 7ffb437fe700 1 -- 172.21.15.72:0/3566653967 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c00bae0 con 0x7ffb44139170 2023-10-03T10:14:53.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.339+0000 7ffb437fe700 1 -- 172.21.15.72:0/3566653967 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c00be90 con 0x7ffb44139170 2023-10-03T10:14:53.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.339+0000 7ffb4ad3e700 1 -- 172.21.15.72:0/3566653967 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb44139170 msgr2=0x7ffb4413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.339+0000 7ffb4ad3e700 1 --2- 172.21.15.72:0/3566653967 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb44139170 0x7ffb4413b550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c009df0 tx=0x7ffb3c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:53.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.339+0000 7ffb4ad3e700 1 -- 172.21.15.72:0/3566653967 shutdown_connections 2023-10-03T10:14:53.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.339+0000 7ffb4ad3e700 1 --2- 172.21.15.72:0/3566653967 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb44139170 0x7ffb4413b550 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.339+0000 7ffb4ad3e700 1 --2- 172.21.15.72:0/3566653967 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb4409e1d0 0x7ffb44138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.339+0000 7ffb4ad3e700 1 -- 172.21.15.72:0/3566653967 >> 172.21.15.72:0/3566653967 conn(0x7ffb44066f50 msgr2=0x7ffb4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.339+0000 7ffb4ad3e700 1 -- 172.21.15.72:0/3566653967 shutdown_connections 2023-10-03T10:14:53.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.339+0000 7ffb4ad3e700 1 -- 172.21.15.72:0/3566653967 wait complete. 2023-10-03T10:14:53.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.340+0000 7ffb4ad3e700 1 Processor -- start 2023-10-03T10:14:53.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.340+0000 7ffb4ad3e700 1 -- start start 2023-10-03T10:14:53.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.341+0000 7ffb4ad3e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb4409d6f0 0x7ffb441205d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.341+0000 7ffb4ad3e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb4409e1d0 0x7ffb44120b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.341+0000 7ffb4ad3e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb44139170 0x7ffb44121050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.341+0000 7ffb4ad3e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb441240f0 con 0x7ffb44139170 2023-10-03T10:14:53.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.341+0000 7ffb4ad3e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb44122800 con 0x7ffb4409e1d0 2023-10-03T10:14:53.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.341+0000 7ffb4ad3e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4409c710 con 0x7ffb4409d6f0 2023-10-03T10:14:53.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.341+0000 7ffb48ada700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb4409d6f0 0x7ffb441205d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.341+0000 7ffb48ada700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb4409d6f0 0x7ffb441205d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57538/0 (socket says 172.21.15.72:57538) 2023-10-03T10:14:53.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.341+0000 7ffb48ada700 1 -- 172.21.15.72:0/3396395425 learned_addr learned my addr 172.21.15.72:0/3396395425 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:53.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.341+0000 7ffb492db700 1 --2- 172.21.15.72:0/3396395425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb44139170 0x7ffb44121050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.341+0000 7ffb43fff700 1 --2- 172.21.15.72:0/3396395425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb4409e1d0 0x7ffb44120b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.342+0000 7ffb48ada700 1 -- 172.21.15.72:0/3396395425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb4409e1d0 msgr2=0x7ffb44120b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.342+0000 7ffb48ada700 1 --2- 172.21.15.72:0/3396395425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb4409e1d0 0x7ffb44120b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.342+0000 7ffb48ada700 1 -- 172.21.15.72:0/3396395425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb44139170 msgr2=0x7ffb44121050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.342+0000 7ffb48ada700 1 --2- 172.21.15.72:0/3396395425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb44139170 0x7ffb44121050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.342+0000 7ffb48ada700 1 -- 172.21.15.72:0/3396395425 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c009a70 con 0x7ffb4409d6f0 2023-10-03T10:14:53.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.342+0000 7ffb43fff700 1 --2- 172.21.15.72:0/3396395425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb4409e1d0 0x7ffb44120b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:53.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.342+0000 7ffb48ada700 1 --2- 172.21.15.72:0/3396395425 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb4409d6f0 0x7ffb441205d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800c520 tx=0x7ffb3800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.342+0000 7ffb417fa700 1 -- 172.21.15.72:0/3396395425 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38004c80 con 0x7ffb4409d6f0 2023-10-03T10:14:53.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.342+0000 7ffb417fa700 1 -- 172.21.15.72:0/3396395425 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb38004e00 con 0x7ffb4409d6f0 2023-10-03T10:14:53.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.342+0000 7ffb4ad3e700 1 -- 172.21.15.72:0/3396395425 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb441221e0 con 0x7ffb4409d6f0 2023-10-03T10:14:53.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.342+0000 7ffb417fa700 1 -- 172.21.15.72:0/3396395425 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38007310 con 0x7ffb4409d6f0 2023-10-03T10:14:53.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.342+0000 7ffb4ad3e700 1 -- 172.21.15.72:0/3396395425 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb441229d0 con 0x7ffb4409d6f0 2023-10-03T10:14:53.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.343+0000 7ffb417fa700 1 -- 172.21.15.72:0/3396395425 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb38007470 con 0x7ffb4409d6f0 2023-10-03T10:14:53.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.343+0000 7ffb417fa700 1 -- 172.21.15.72:0/3396395425 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb3803f2b0 con 0x7ffb4409d6f0 2023-10-03T10:14:53.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.343+0000 7ffb4ad3e700 1 -- 172.21.15.72:0/3396395425 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb44074ea0 con 0x7ffb4409d6f0 2023-10-03T10:14:53.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.348+0000 7ffb417fa700 1 -- 172.21.15.72:0/3396395425 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb380123b0 con 0x7ffb4409d6f0 2023-10-03T10:14:53.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:53.400 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:53.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.496+0000 7f9cc4771700 1 Processor -- start 2023-10-03T10:14:53.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.496+0000 7f9cc4771700 1 -- start start 2023-10-03T10:14:53.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc4771700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cbc09e850 0x7f9cbc09ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc4771700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cbc09f160 0x7f9cbc133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc4771700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cbc09f960 con 0x7f9cbc134130 2023-10-03T10:14:53.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc4771700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cbc09ae60 con 0x7f9cbc09e850 2023-10-03T10:14:53.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc4771700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc06cb10 con 0x7f9cbc09f160 2023-10-03T10:14:53.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc1d0c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cbc09f160 0x7f9cbc133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc250d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cbc09e850 0x7f9cbc09ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc250d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cbc09e850 0x7f9cbc09ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56626/0 (socket says 172.21.15.72:56626) 2023-10-03T10:14:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc1d0c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cbc09f160 0x7f9cbc133bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57542/0 (socket says 172.21.15.72:57542) 2023-10-03T10:14:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc250d700 1 -- 172.21.15.72:0/3946448054 learned_addr learned my addr 172.21.15.72:0/3946448054 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc250d700 1 -- 172.21.15.72:0/3946448054 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cbc09f160 msgr2=0x7f9cbc133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc250d700 1 --2- 172.21.15.72:0/3946448054 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cbc09f160 0x7f9cbc133bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc250d700 1 -- 172.21.15.72:0/3946448054 >> v1:172.21.15.72:6789/0 conn(0x7f9cbc134130 legacy=0x7f9cbc13aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc250d700 1 -- 172.21.15.72:0/3946448054 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc06b990 con 0x7f9cbc09e850 2023-10-03T10:14:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc1d0c700 1 --2- 172.21.15.72:0/3946448054 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cbc09f160 0x7f9cbc133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:53.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc250d700 1 --2- 172.21.15.72:0/3946448054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cbc09e850 0x7f9cbc09ec20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80098f0 tx=0x7f9cb8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e6215281948b24 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc150b700 1 -- 172.21.15.72:0/3946448054 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8011830 con 0x7f9cbc09e850 2023-10-03T10:14:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc150b700 1 -- 172.21.15.72:0/3946448054 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb8011990 con 0x7f9cbc09e850 2023-10-03T10:14:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.497+0000 7f9cc150b700 1 -- 172.21.15.72:0/3946448054 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8011d20 con 0x7f9cbc09e850 2023-10-03T10:14:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.498+0000 7f9cc4771700 1 -- 172.21.15.72:0/3946448054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cbc09e850 msgr2=0x7f9cbc09ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.498+0000 7f9cc4771700 1 --2- 172.21.15.72:0/3946448054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cbc09e850 0x7f9cbc09ec20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80098f0 tx=0x7f9cb8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.498+0000 7f9cc4771700 1 -- 172.21.15.72:0/3946448054 shutdown_connections 2023-10-03T10:14:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.498+0000 7f9cc4771700 1 --2- 172.21.15.72:0/3946448054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cbc09e850 0x7f9cbc09ec20 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.498+0000 7f9cc4771700 1 --2- 172.21.15.72:0/3946448054 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cbc09f160 0x7f9cbc133bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.498+0000 7f9cc4771700 1 -- 172.21.15.72:0/3946448054 >> 172.21.15.72:0/3946448054 conn(0x7f9cbc0a3f70 msgr2=0x7f9cbc0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.498+0000 7f9cc4771700 1 -- 172.21.15.72:0/3946448054 shutdown_connections 2023-10-03T10:14:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.498+0000 7f9cc4771700 1 -- 172.21.15.72:0/3946448054 wait complete. 2023-10-03T10:14:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.499+0000 7f9cc4771700 1 Processor -- start 2023-10-03T10:14:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.499+0000 7f9cc4771700 1 -- start start 2023-10-03T10:14:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc4771700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cbc09e850 0x7f9cbc123540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc4771700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cbc09f160 0x7f9cbc123a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc4771700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cbc134130 0x7f9cbc1c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc4771700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc1265b0 con 0x7f9cbc134130 2023-10-03T10:14:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc4771700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc125150 con 0x7f9cbc09f160 2023-10-03T10:14:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc4771700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc126790 con 0x7f9cbc09e850 2023-10-03T10:14:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc250d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cbc09e850 0x7f9cbc123540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc250d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cbc09e850 0x7f9cbc123540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57556/0 (socket says 172.21.15.72:57556) 2023-10-03T10:14:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc250d700 1 -- 172.21.15.72:0/124711500 learned_addr learned my addr 172.21.15.72:0/124711500 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc2d0e700 1 --2- 172.21.15.72:0/124711500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cbc134130 0x7f9cbc1c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc1d0c700 1 --2- 172.21.15.72:0/124711500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cbc09f160 0x7f9cbc123a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc250d700 1 -- 172.21.15.72:0/124711500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cbc09f160 msgr2=0x7f9cbc123a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc250d700 1 --2- 172.21.15.72:0/124711500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cbc09f160 0x7f9cbc123a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc250d700 1 -- 172.21.15.72:0/124711500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cbc134130 msgr2=0x7f9cbc1c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc250d700 1 --2- 172.21.15.72:0/124711500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cbc134130 0x7f9cbc1c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc250d700 1 -- 172.21.15.72:0/124711500 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac0094a0 con 0x7f9cbc09e850 2023-10-03T10:14:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.500+0000 7f9cc2d0e700 1 --2- 172.21.15.72:0/124711500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cbc134130 0x7f9cbc1c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.501+0000 7f9cc250d700 1 --2- 172.21.15.72:0/124711500 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cbc09e850 0x7f9cbc123540 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009c40 tx=0x7f9cb8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.501+0000 7f9cb2ffd700 1 -- 172.21.15.72:0/124711500 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8004400 con 0x7f9cbc09e850 2023-10-03T10:14:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.501+0000 7f9cb2ffd700 1 -- 172.21.15.72:0/124711500 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb801f070 con 0x7f9cbc09e850 2023-10-03T10:14:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.501+0000 7f9cb2ffd700 1 -- 172.21.15.72:0/124711500 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80038e0 con 0x7f9cbc09e850 2023-10-03T10:14:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.501+0000 7f9cc4771700 1 -- 172.21.15.72:0/124711500 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb8009550 con 0x7f9cbc09e850 2023-10-03T10:14:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.501+0000 7f9cc4771700 1 -- 172.21.15.72:0/124711500 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc124880 con 0x7f9cbc09e850 2023-10-03T10:14:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.502+0000 7f9cc4771700 1 -- 172.21.15.72:0/124711500 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc0747f0 con 0x7f9cbc09e850 2023-10-03T10:14:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.503+0000 7f9cb2ffd700 1 -- 172.21.15.72:0/124711500 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9cb8021030 con 0x7f9cbc09e850 2023-10-03T10:14:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.503+0000 7f9cb2ffd700 1 -- 172.21.15.72:0/124711500 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9cb8040df0 con 0x7f9cbc09e850 2023-10-03T10:14:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.507+0000 7f9cb2ffd700 1 -- 172.21.15.72:0/124711500 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cb800b9d0 con 0x7f9cbc09e850 2023-10-03T10:14:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.539+0000 7f4d439de700 1 Processor -- start 2023-10-03T10:14:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.540+0000 7f4d439de700 1 -- start start 2023-10-03T10:14:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.540+0000 7f4d439de700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e1d0 0x7f4d3c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.540+0000 7f4d439de700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c135e50 0x7f4d3c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.540+0000 7f4d439de700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3c09f130 con 0x7f4d3c09d6f0 2023-10-03T10:14:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.540+0000 7f4d439de700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c09f520 con 0x7f4d3c09e1d0 2023-10-03T10:14:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.540+0000 7f4d439de700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c09e930 con 0x7f4d3c135e50 2023-10-03T10:14:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.540+0000 7f4d4177a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4d3c09d6f0 0x7f4d3c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51590/0 (socket says 172.21.15.72:51590) 2023-10-03T10:14:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.540+0000 7f4d4177a700 1 -- 172.21.15.72:0/512469375 learned_addr learned my addr 172.21.15.72:0/512469375 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.540+0000 7f4d41f7b700 1 --2- 172.21.15.72:0/512469375 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c135e50 0x7f4d3c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.540+0000 7f4d40f79700 1 --2- 172.21.15.72:0/512469375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e1d0 0x7f4d3c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.541+0000 7f4d33fff700 1 -- 172.21.15.72:0/512469375 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515366825 0 0) 0x7f4d3c09f130 con 0x7f4d3c09d6f0 2023-10-03T10:14:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.541+0000 7f4d40f79700 1 -- 172.21.15.72:0/512469375 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c135e50 msgr2=0x7f4d3c138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:53.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.541+0000 7f4d40f79700 1 --2- 172.21.15.72:0/512469375 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c135e50 0x7f4d3c138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.541+0000 7f4d40f79700 1 -- 172.21.15.72:0/512469375 >> v1:172.21.15.72:6789/0 conn(0x7f4d3c09d6f0 legacy=0x7f4d3c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.541+0000 7f4d40f79700 1 -- 172.21.15.72:0/512469375 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c09b2d0 con 0x7f4d3c09e1d0 2023-10-03T10:14:53.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.541+0000 7f4d40f79700 1 --2- 172.21.15.72:0/512469375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e1d0 0x7f4d3c135910 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009870 tx=0x7f4d2c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3464bac6b0e3c82 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.541+0000 7f4d33fff700 1 -- 172.21.15.72:0/512469375 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c011830 con 0x7f4d3c09e1d0 2023-10-03T10:14:53.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.541+0000 7f4d33fff700 1 -- 172.21.15.72:0/512469375 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c011990 con 0x7f4d3c09e1d0 2023-10-03T10:14:53.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.541+0000 7f4d33fff700 1 -- 172.21.15.72:0/512469375 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c011d20 con 0x7f4d3c09e1d0 2023-10-03T10:14:53.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.541+0000 7f4d439de700 1 -- 172.21.15.72:0/512469375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e1d0 msgr2=0x7f4d3c135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.541+0000 7f4d439de700 1 --2- 172.21.15.72:0/512469375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e1d0 0x7f4d3c135910 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009870 tx=0x7f4d2c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:53.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.542+0000 7f4d439de700 1 -- 172.21.15.72:0/512469375 shutdown_connections 2023-10-03T10:14:53.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.542+0000 7f4d439de700 1 --2- 172.21.15.72:0/512469375 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c135e50 0x7f4d3c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.542+0000 7f4d439de700 1 --2- 172.21.15.72:0/512469375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e1d0 0x7f4d3c135910 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.542+0000 7f4d439de700 1 -- 172.21.15.72:0/512469375 >> 172.21.15.72:0/512469375 conn(0x7f4d3c066f50 msgr2=0x7f4d3c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.542+0000 7f4d439de700 1 -- 172.21.15.72:0/512469375 shutdown_connections 2023-10-03T10:14:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.542+0000 7f4d439de700 1 -- 172.21.15.72:0/512469375 wait complete. 2023-10-03T10:14:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.543+0000 7f4d439de700 1 Processor -- start 2023-10-03T10:14:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.543+0000 7f4d439de700 1 -- start start 2023-10-03T10:14:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.543+0000 7f4d439de700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d3c09d6f0 0x7f4d3c11d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d439de700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09e1d0 0x7f4d3c11dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d439de700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c135e50 0x7f4d3c11e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d439de700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c06b350 con 0x7f4d3c09d6f0 2023-10-03T10:14:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d439de700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c11e8c0 con 0x7f4d3c135e50 2023-10-03T10:14:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d439de700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c1201b0 con 0x7f4d3c09e1d0 2023-10-03T10:14:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d41f7b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c135e50 0x7f4d3c11e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d41f7b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c135e50 0x7f4d3c11e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46770/0 (socket says 172.21.15.72:46770) 2023-10-03T10:14:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d41f7b700 1 -- 172.21.15.72:0/4129020607 learned_addr learned my addr 172.21.15.72:0/4129020607 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d40f79700 1 --2- 172.21.15.72:0/4129020607 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09e1d0 0x7f4d3c11dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d4177a700 1 --2- 172.21.15.72:0/4129020607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d3c09d6f0 0x7f4d3c11d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d4177a700 1 -- 172.21.15.72:0/4129020607 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09e1d0 msgr2=0x7f4d3c11dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d4177a700 1 --2- 172.21.15.72:0/4129020607 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09e1d0 0x7f4d3c11dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d4177a700 1 -- 172.21.15.72:0/4129020607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c135e50 msgr2=0x7f4d3c11e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d4177a700 1 --2- 172.21.15.72:0/4129020607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c135e50 0x7f4d3c11e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d4177a700 1 -- 172.21.15.72:0/4129020607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0094a0 con 0x7f4d3c09d6f0 2023-10-03T10:14:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d41f7b700 1 --2- 172.21.15.72:0/4129020607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c135e50 0x7f4d3c11e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d40f79700 1 --2- 172.21.15.72:0/4129020607 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09e1d0 0x7f4d3c11dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d4177a700 1 --2- 172.21.15.72:0/4129020607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d3c09d6f0 0x7f4d3c11d790 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800c3f0 tx=0x7f4d3800c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d31ffb700 1 -- 172.21.15.72:0/4129020607 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38004a70 con 0x7f4d3c09d6f0 2023-10-03T10:14:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d31ffb700 1 -- 172.21.15.72:0/4129020607 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d38004c10 con 0x7f4d3c09d6f0 2023-10-03T10:14:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d439de700 1 -- 172.21.15.72:0/4129020607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3c09c700 con 0x7f4d3c09d6f0 2023-10-03T10:14:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.544+0000 7f4d31ffb700 1 -- 172.21.15.72:0/4129020607 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d380070d0 con 0x7f4d3c09d6f0 2023-10-03T10:14:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.545+0000 7f4d439de700 1 -- 172.21.15.72:0/4129020607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3c11ea90 con 0x7f4d3c09d6f0 2023-10-03T10:14:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.545+0000 7f4d31ffb700 1 -- 172.21.15.72:0/4129020607 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d38007230 con 0x7f4d3c09d6f0 2023-10-03T10:14:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.546+0000 7f4d31ffb700 1 -- 172.21.15.72:0/4129020607 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d3803f1b0 con 0x7f4d3c09d6f0 2023-10-03T10:14:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.546+0000 7f4d439de700 1 -- 172.21.15.72:0/4129020607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3c074ea0 con 0x7f4d3c09d6f0 2023-10-03T10:14:53.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.548+0000 7ffb4ad3e700 1 -- 172.21.15.72:0/3396395425 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffb4406c360 con 0x7ffb4409d6f0 2023-10-03T10:14:53.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.548+0000 7ffb417fa700 1 -- 172.21.15.72:0/3396395425 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffb380102c0 con 0x7ffb4409d6f0 2023-10-03T10:14:53.549 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.550+0000 7ffb4ad3e700 1 -- 172.21.15.72:0/3396395425 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb4409d6f0 msgr2=0x7ffb441205d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.550+0000 7ffb4ad3e700 1 --2- 172.21.15.72:0/3396395425 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb4409d6f0 0x7ffb441205d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800c520 tx=0x7ffb3800c830 comp rx=0 tx=0).stop 2023-10-03T10:14:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.550+0000 7ffb4ad3e700 1 -- 172.21.15.72:0/3396395425 shutdown_connections 2023-10-03T10:14:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.550+0000 7ffb4ad3e700 1 --2- 172.21.15.72:0/3396395425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb44139170 0x7ffb44121050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.550+0000 7ffb4ad3e700 1 --2- 172.21.15.72:0/3396395425 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb4409d6f0 0x7ffb441205d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.550+0000 7ffb4ad3e700 1 --2- 172.21.15.72:0/3396395425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb4409e1d0 0x7ffb44120b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.550+0000 7ffb4ad3e700 1 -- 172.21.15.72:0/3396395425 >> 172.21.15.72:0/3396395425 conn(0x7ffb44066f50 msgr2=0x7ffb44136a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.550+0000 7f4d31ffb700 1 -- 172.21.15.72:0/4129020607 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d3801bda0 con 0x7f4d3c09d6f0 2023-10-03T10:14:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.551+0000 7ffb4ad3e700 1 -- 172.21.15.72:0/3396395425 shutdown_connections 2023-10-03T10:14:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.551+0000 7ffb4ad3e700 1 -- 172.21.15.72:0/3396395425 wait complete. 2023-10-03T10:14:53.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:53.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.702+0000 7f9cc4771700 1 -- 172.21.15.72:0/124711500 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9cbc06bbb0 con 0x7f9cbc09e850 2023-10-03T10:14:53.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.703+0000 7f9cb2ffd700 1 -- 172.21.15.72:0/124711500 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cb8015070 con 0x7f9cbc09e850 2023-10-03T10:14:53.703 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:53.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.705+0000 7f9cc4771700 1 -- 172.21.15.72:0/124711500 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cbc09e850 msgr2=0x7f9cbc123540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.705+0000 7f9cc4771700 1 --2- 172.21.15.72:0/124711500 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cbc09e850 0x7f9cbc123540 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009c40 tx=0x7f9cb8004750 comp rx=0 tx=0).stop 2023-10-03T10:14:53.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.705+0000 7f9cc4771700 1 -- 172.21.15.72:0/124711500 shutdown_connections 2023-10-03T10:14:53.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.705+0000 7f9cc4771700 1 --2- 172.21.15.72:0/124711500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cbc134130 0x7f9cbc1c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.705+0000 7f9cc4771700 1 --2- 172.21.15.72:0/124711500 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cbc09e850 0x7f9cbc123540 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.705+0000 7f9cc4771700 1 --2- 172.21.15.72:0/124711500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cbc09f160 0x7f9cbc123a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.705+0000 7f9cc4771700 1 -- 172.21.15.72:0/124711500 >> 172.21.15.72:0/124711500 conn(0x7f9cbc0a3f70 msgr2=0x7f9cbc070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.705+0000 7f9cc4771700 1 -- 172.21.15.72:0/124711500 shutdown_connections 2023-10-03T10:14:53.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.705+0000 7f9cc4771700 1 -- 172.21.15.72:0/124711500 wait complete. 2023-10-03T10:14:53.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.746+0000 7f4d439de700 1 -- 172.21.15.72:0/4129020607 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4d3c072140 con 0x7f4d3c09d6f0 2023-10-03T10:14:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.746+0000 7f4d31ffb700 1 -- 172.21.15.72:0/4129020607 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4d3801b340 con 0x7f4d3c09d6f0 2023-10-03T10:14:53.748 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:53.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.748+0000 7f4d439de700 1 -- 172.21.15.72:0/4129020607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d3c09d6f0 msgr2=0x7f4d3c11d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:53.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.748+0000 7f4d439de700 1 --2- 172.21.15.72:0/4129020607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d3c09d6f0 0x7f4d3c11d790 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800c3f0 tx=0x7f4d3800c700 comp rx=0 tx=0).stop 2023-10-03T10:14:53.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.748+0000 7f4d439de700 1 -- 172.21.15.72:0/4129020607 shutdown_connections 2023-10-03T10:14:53.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.748+0000 7f4d439de700 1 --2- 172.21.15.72:0/4129020607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d3c09d6f0 0x7f4d3c11d790 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.748+0000 7f4d439de700 1 --2- 172.21.15.72:0/4129020607 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c135e50 0x7f4d3c11e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.748+0000 7f4d439de700 1 --2- 172.21.15.72:0/4129020607 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09e1d0 0x7f4d3c11dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:53.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.748+0000 7f4d439de700 1 -- 172.21.15.72:0/4129020607 >> 172.21.15.72:0/4129020607 conn(0x7f4d3c066f50 msgr2=0x7f4d3c133950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:53.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.749+0000 7f4d439de700 1 -- 172.21.15.72:0/4129020607 shutdown_connections 2023-10-03T10:14:53.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:53.749+0000 7f4d439de700 1 -- 172.21.15.72:0/4129020607 wait complete. 2023-10-03T10:14:53.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:54.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:54.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.149+0000 7f61013c6700 1 Processor -- start 2023-10-03T10:14:54.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.149+0000 7f61013c6700 1 -- start start 2023-10-03T10:14:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.149+0000 7f61013c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60fc0a09c0 0x7f60fc0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.149+0000 7f61013c6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f60fc09d5c0 0x7f60fc0a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.149+0000 7f61013c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60fc133920 0x7f60fc133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.149+0000 7f61013c6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60fc0a1810 con 0x7f60fc09d5c0 2023-10-03T10:14:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.149+0000 7f61013c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc09ea10 con 0x7f60fc0a09c0 2023-10-03T10:14:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.149+0000 7f61013c6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc09e210 con 0x7f60fc133920 2023-10-03T10:14:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.149+0000 7f60fa7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f60fc09d5c0 0x7f60fc0a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.149+0000 7f60fb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60fc133920 0x7f60fc133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.149+0000 7f60faffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60fc0a09c0 0x7f60fc0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.149+0000 7f60fa7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f60fc09d5c0 0x7f60fc0a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56646/0 (socket says 172.21.15.72:56646) 2023-10-03T10:14:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.149+0000 7f60fb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60fc133920 0x7f60fc133dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57576/0 (socket says 172.21.15.72:57576) 2023-10-03T10:14:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.149+0000 7f60faffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60fc0a09c0 0x7f60fc0a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46772/0 (socket says 172.21.15.72:46772) 2023-10-03T10:14:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.149+0000 7f60fa7fc700 1 -- 172.21.15.72:0/3242937393 learned_addr learned my addr 172.21.15.72:0/3242937393 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.150+0000 7f60fa7fc700 1 -- 172.21.15.72:0/3242937393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60fc133920 msgr2=0x7f60fc133dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.150+0000 7f60fa7fc700 1 --2- 172.21.15.72:0/3242937393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60fc133920 0x7f60fc133dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.150+0000 7f60fa7fc700 1 -- 172.21.15.72:0/3242937393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60fc0a09c0 msgr2=0x7f60fc0a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.150+0000 7f60fa7fc700 1 --2- 172.21.15.72:0/3242937393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60fc0a09c0 0x7f60fc0a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.150+0000 7f60fa7fc700 1 -- 172.21.15.72:0/3242937393 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc0a26f0 con 0x7f60fc09d5c0 2023-10-03T10:14:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.150+0000 7f60faffd700 1 --2- 172.21.15.72:0/3242937393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60fc0a09c0 0x7f60fc0a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:54.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.150+0000 7f60fb7fe700 1 --2- 172.21.15.72:0/3242937393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60fc133920 0x7f60fc133dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.150+0000 7f60fa7fc700 1 --2- 172.21.15.72:0/3242937393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60fc09d5c0 0x7f60fc0a12d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f60f00098f0 tx=0x7f60f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce11a68e998bfff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.150+0000 7f60f9ffb700 1 -- 172.21.15.72:0/3242937393 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0011830 con 0x7f60fc09d5c0 2023-10-03T10:14:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.150+0000 7f60f9ffb700 1 -- 172.21.15.72:0/3242937393 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f0011990 con 0x7f60fc09d5c0 2023-10-03T10:14:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.150+0000 7f60f9ffb700 1 -- 172.21.15.72:0/3242937393 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0011d20 con 0x7f60fc09d5c0 2023-10-03T10:14:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.151+0000 7f61013c6700 1 -- 172.21.15.72:0/3242937393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60fc09d5c0 msgr2=0x7f60fc0a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.151+0000 7f61013c6700 1 --2- 172.21.15.72:0/3242937393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60fc09d5c0 0x7f60fc0a12d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f60f00098f0 tx=0x7f60f0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.151+0000 7f61013c6700 1 -- 172.21.15.72:0/3242937393 shutdown_connections 2023-10-03T10:14:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.151+0000 7f61013c6700 1 --2- 172.21.15.72:0/3242937393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60fc133920 0x7f60fc133dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.151+0000 7f61013c6700 1 --2- 172.21.15.72:0/3242937393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60fc0a09c0 0x7f60fc0a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.151+0000 7f61013c6700 1 --2- 172.21.15.72:0/3242937393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60fc09d5c0 0x7f60fc0a12d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.151+0000 7f61013c6700 1 -- 172.21.15.72:0/3242937393 >> 172.21.15.72:0/3242937393 conn(0x7f60fc0a2fe0 msgr2=0x7f60fc0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.151+0000 7f61013c6700 1 -- 172.21.15.72:0/3242937393 shutdown_connections 2023-10-03T10:14:54.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.151+0000 7f61013c6700 1 -- 172.21.15.72:0/3242937393 wait complete. 2023-10-03T10:14:54.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f61013c6700 1 Processor -- start 2023-10-03T10:14:54.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f61013c6700 1 -- start start 2023-10-03T10:14:54.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f61013c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60fc09d5c0 0x7f60fc126010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f61013c6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60fc0a09c0 0x7f60fc126550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f61013c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60fc133920 0x7f60fc126a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f61013c6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc12a280 con 0x7f60fc0a09c0 2023-10-03T10:14:54.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f61013c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc09cec0 con 0x7f60fc09d5c0 2023-10-03T10:14:54.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f61013c6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc1299a0 con 0x7f60fc133920 2023-10-03T10:14:54.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f60fa7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60fc0a09c0 0x7f60fc126550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f60faffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60fc09d5c0 0x7f60fc126010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f60fa7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60fc0a09c0 0x7f60fc126550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56650/0 (socket says 172.21.15.72:56650) 2023-10-03T10:14:54.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f60fb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60fc133920 0x7f60fc126a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f60fa7fc700 1 -- 172.21.15.72:0/2924886173 learned_addr learned my addr 172.21.15.72:0/2924886173 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:54.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f60faffd700 1 -- 172.21.15.72:0/2924886173 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60fc133920 msgr2=0x7f60fc126a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f60faffd700 1 --2- 172.21.15.72:0/2924886173 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60fc133920 0x7f60fc126a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f60faffd700 1 -- 172.21.15.72:0/2924886173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60fc0a09c0 msgr2=0x7f60fc126550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f60faffd700 1 --2- 172.21.15.72:0/2924886173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60fc0a09c0 0x7f60fc126550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f60faffd700 1 -- 172.21.15.72:0/2924886173 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec0094a0 con 0x7f60fc09d5c0 2023-10-03T10:14:54.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f60fb7fe700 1 --2- 172.21.15.72:0/2924886173 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60fc133920 0x7f60fc126a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:54.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.152+0000 7f60fa7fc700 1 --2- 172.21.15.72:0/2924886173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60fc0a09c0 0x7f60fc126550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:54.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.153+0000 7f60faffd700 1 --2- 172.21.15.72:0/2924886173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60fc09d5c0 0x7f60fc126010 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00e9e0 tx=0x7f60ec00ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.153+0000 7f60e37fe700 1 -- 172.21.15.72:0/2924886173 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec00ee70 con 0x7f60fc09d5c0 2023-10-03T10:14:54.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.153+0000 7f60e37fe700 1 -- 172.21.15.72:0/2924886173 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec00c850 con 0x7f60fc09d5c0 2023-10-03T10:14:54.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.153+0000 7f61013c6700 1 -- 172.21.15.72:0/2924886173 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f4009a70 con 0x7f60fc09d5c0 2023-10-03T10:14:54.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.153+0000 7f60e37fe700 1 -- 172.21.15.72:0/2924886173 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec00cc00 con 0x7f60fc09d5c0 2023-10-03T10:14:54.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.153+0000 7f61013c6700 1 -- 172.21.15.72:0/2924886173 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f0009550 con 0x7f60fc09d5c0 2023-10-03T10:14:54.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.154+0000 7f60e37fe700 1 -- 172.21.15.72:0/2924886173 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f60ec00cd60 con 0x7f60fc09d5c0 2023-10-03T10:14:54.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.154+0000 7f60e37fe700 1 -- 172.21.15.72:0/2924886173 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f60ec03f730 con 0x7f60fc09d5c0 2023-10-03T10:14:54.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.154+0000 7f61013c6700 1 -- 172.21.15.72:0/2924886173 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60fc0747f0 con 0x7f60fc09d5c0 2023-10-03T10:14:54.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.158+0000 7f60e37fe700 1 -- 172.21.15.72:0/2924886173 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f60ec017020 con 0x7f60fc09d5c0 2023-10-03T10:14:54.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.341+0000 7f61013c6700 1 -- 172.21.15.72:0/2924886173 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f60fc072980 con 0x7f60fc09d5c0 2023-10-03T10:14:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.341+0000 7f60e37fe700 1 -- 172.21.15.72:0/2924886173 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f60ec01bde0 con 0x7f60fc09d5c0 2023-10-03T10:14:54.345 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.343+0000 7f61013c6700 1 -- 172.21.15.72:0/2924886173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60fc09d5c0 msgr2=0x7f60fc126010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.343+0000 7f61013c6700 1 --2- 172.21.15.72:0/2924886173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60fc09d5c0 0x7f60fc126010 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00e9e0 tx=0x7f60ec00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.343+0000 7f61013c6700 1 -- 172.21.15.72:0/2924886173 shutdown_connections 2023-10-03T10:14:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.343+0000 7f61013c6700 1 --2- 172.21.15.72:0/2924886173 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60fc133920 0x7f60fc126a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.343+0000 7f61013c6700 1 --2- 172.21.15.72:0/2924886173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60fc09d5c0 0x7f60fc126010 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.343+0000 7f61013c6700 1 --2- 172.21.15.72:0/2924886173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60fc0a09c0 0x7f60fc126550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.343+0000 7f61013c6700 1 -- 172.21.15.72:0/2924886173 >> 172.21.15.72:0/2924886173 conn(0x7f60fc0a2fe0 msgr2=0x7f60fc09ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.344+0000 7f61013c6700 1 -- 172.21.15.72:0/2924886173 shutdown_connections 2023-10-03T10:14:54.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.344+0000 7f61013c6700 1 -- 172.21.15.72:0/2924886173 wait complete. 2023-10-03T10:14:54.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:54.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:54.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.689+0000 7f34ca1a5700 1 Processor -- start 2023-10-03T10:14:54.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.689+0000 7f34ca1a5700 1 -- start start 2023-10-03T10:14:54.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34ca1a5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c409d6f0 0x7f34c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34ca1a5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c409e000 0x7f34c41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34ca1a5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c409b120 con 0x7f34c409e410 2023-10-03T10:14:54.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34ca1a5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c406b460 con 0x7f34c409e000 2023-10-03T10:14:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34ca1a5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34c409a7e0 con 0x7f34c409d6f0 2023-10-03T10:14:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34c37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c409d6f0 0x7f34c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34c2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c409e000 0x7f34c41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34c37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c409d6f0 0x7f34c409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57598/0 (socket says 172.21.15.72:57598) 2023-10-03T10:14:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34c3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f34c409e410 0x7f34c4133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51594/0 (socket says 172.21.15.72:51594) 2023-10-03T10:14:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34c37fe700 1 -- 172.21.15.72:0/1268961076 learned_addr learned my addr 172.21.15.72:0/1268961076 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34c2ffd700 1 -- 172.21.15.72:0/1268961076 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c409d6f0 msgr2=0x7f34c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34c2ffd700 1 --2- 172.21.15.72:0/1268961076 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c409d6f0 0x7f34c409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34c2ffd700 1 -- 172.21.15.72:0/1268961076 >> v1:172.21.15.72:6789/0 conn(0x7f34c409e410 legacy=0x7f34c4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34c27fc700 1 -- 172.21.15.72:0/1268961076 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419605751 0 0) 0x7f34c409b120 con 0x7f34c409e410 2023-10-03T10:14:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34c2ffd700 1 -- 172.21.15.72:0/1268961076 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c409a500 con 0x7f34c409e000 2023-10-03T10:14:54.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34c37fe700 1 --2- 172.21.15.72:0/1268961076 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c409d6f0 0x7f34c409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:54.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34c2ffd700 1 --2- 172.21.15.72:0/1268961076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c409e000 0x7f34c41339f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f34b4009870 tx=0x7f34b4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1117faa1362f28b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.690+0000 7f34c27fc700 1 -- 172.21.15.72:0/1268961076 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4011830 con 0x7f34c409e000 2023-10-03T10:14:54.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.691+0000 7f34c27fc700 1 -- 172.21.15.72:0/1268961076 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b4011990 con 0x7f34c409e000 2023-10-03T10:14:54.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.691+0000 7f34c27fc700 1 -- 172.21.15.72:0/1268961076 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4011d20 con 0x7f34c409e000 2023-10-03T10:14:54.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.691+0000 7f34ca1a5700 1 -- 172.21.15.72:0/1268961076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c409e000 msgr2=0x7f34c41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.691+0000 7f34ca1a5700 1 --2- 172.21.15.72:0/1268961076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c409e000 0x7f34c41339f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f34b4009870 tx=0x7f34b4009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:54.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.691+0000 7f34ca1a5700 1 -- 172.21.15.72:0/1268961076 shutdown_connections 2023-10-03T10:14:54.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.691+0000 7f34ca1a5700 1 --2- 172.21.15.72:0/1268961076 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c409d6f0 0x7f34c409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.691+0000 7f34ca1a5700 1 --2- 172.21.15.72:0/1268961076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c409e000 0x7f34c41339f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.691+0000 7f34ca1a5700 1 -- 172.21.15.72:0/1268961076 >> 172.21.15.72:0/1268961076 conn(0x7f34c4066f50 msgr2=0x7f34c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.691+0000 7f34ca1a5700 1 -- 172.21.15.72:0/1268961076 shutdown_connections 2023-10-03T10:14:54.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.691+0000 7f34ca1a5700 1 -- 172.21.15.72:0/1268961076 wait complete. 2023-10-03T10:14:54.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.692+0000 7f34ca1a5700 1 Processor -- start 2023-10-03T10:14:54.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.692+0000 7f34ca1a5700 1 -- start start 2023-10-03T10:14:54.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34ca1a5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c409d6f0 0x7f34c4122470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34ca1a5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c409e000 0x7f34c41229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34ca1a5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c409e410 0x7f34c4122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34ca1a5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c4125cb0 con 0x7f34c409d6f0 2023-10-03T10:14:54.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34ca1a5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c4125f90 con 0x7f34c409e410 2023-10-03T10:14:54.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34ca1a5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34c40a30d0 con 0x7f34c409e000 2023-10-03T10:14:54.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34c2ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c409e000 0x7f34c41229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34c37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c409d6f0 0x7f34c4122470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34c3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c409e410 0x7f34c4122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34c37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c409d6f0 0x7f34c4122470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56652/0 (socket says 172.21.15.72:56652) 2023-10-03T10:14:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34c2ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c409e000 0x7f34c41229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57610/0 (socket says 172.21.15.72:57610) 2023-10-03T10:14:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34c37fe700 1 -- 172.21.15.72:0/527834309 learned_addr learned my addr 172.21.15.72:0/527834309 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34c3fff700 1 --2- 172.21.15.72:0/527834309 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c409e410 0x7f34c4122ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46810/0 (socket says 172.21.15.72:46810) 2023-10-03T10:14:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34c2ffd700 1 -- 172.21.15.72:0/527834309 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c409e410 msgr2=0x7f34c4122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34c2ffd700 1 --2- 172.21.15.72:0/527834309 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c409e410 0x7f34c4122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34c2ffd700 1 -- 172.21.15.72:0/527834309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c409d6f0 msgr2=0x7f34c4122470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34c2ffd700 1 --2- 172.21.15.72:0/527834309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c409d6f0 0x7f34c4122470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34c2ffd700 1 -- 172.21.15.72:0/527834309 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac009550 con 0x7f34c409e000 2023-10-03T10:14:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34c3fff700 1 --2- 172.21.15.72:0/527834309 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c409e410 0x7f34c4122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34c37fe700 1 --2- 172.21.15.72:0/527834309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c409d6f0 0x7f34c4122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:54.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34c2ffd700 1 --2- 172.21.15.72:0/527834309 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c409e000 0x7f34c41229b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f34c406e510 tx=0x7f34b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34bbfff700 1 -- 172.21.15.72:0/527834309 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4024620 con 0x7f34c409e000 2023-10-03T10:14:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34bbfff700 1 -- 172.21.15.72:0/527834309 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b40247a0 con 0x7f34c409e000 2023-10-03T10:14:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34ca1a5700 1 -- 172.21.15.72:0/527834309 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b40094a0 con 0x7f34c409e000 2023-10-03T10:14:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34bbfff700 1 -- 172.21.15.72:0/527834309 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4024b50 con 0x7f34c409e000 2023-10-03T10:14:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.693+0000 7f34ca1a5700 1 -- 172.21.15.72:0/527834309 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c4124ea0 con 0x7f34c409e000 2023-10-03T10:14:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.694+0000 7f34bbfff700 1 -- 172.21.15.72:0/527834309 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f34b4022070 con 0x7f34c409e000 2023-10-03T10:14:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.694+0000 7f34bbfff700 1 -- 172.21.15.72:0/527834309 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f34b40408e0 con 0x7f34c409e000 2023-10-03T10:14:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.694+0000 7f34ca1a5700 1 -- 172.21.15.72:0/527834309 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c4125b10 con 0x7f34c409e000 2023-10-03T10:14:54.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.699+0000 7f34bbfff700 1 -- 172.21.15.72:0/527834309 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34c4125b10 con 0x7f34c409e000 2023-10-03T10:14:54.719 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:54.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:54.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.844+0000 7f340dbd9700 1 Processor -- start 2023-10-03T10:14:54.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.844+0000 7f340dbd9700 1 -- start start 2023-10-03T10:14:54.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.845+0000 7f340dbd9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3408133540 0x7f3408135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.845+0000 7f340dbd9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3408135e60 0x7f3408138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.845+0000 7f340dbd9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34080716a0 con 0x7f3408130540 2023-10-03T10:14:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.845+0000 7f340dbd9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3408071290 con 0x7f3408135e60 2023-10-03T10:14:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.845+0000 7f340dbd9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3408130340 con 0x7f3408133540 2023-10-03T10:14:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.845+0000 7f3407fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3408135e60 0x7f3408138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.845+0000 7f3407fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3408135e60 0x7f3408138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56660/0 (socket says 172.21.15.72:56660) 2023-10-03T10:14:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.845+0000 7f3407fff700 1 -- 172.21.15.72:0/854851421 learned_addr learned my addr 172.21.15.72:0/854851421 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.845+0000 7f3406ffd700 1 --2- 172.21.15.72:0/854851421 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3408133540 0x7f3408135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.845+0000 7f3407fff700 1 -- 172.21.15.72:0/854851421 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3408133540 msgr2=0x7f3408135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.845+0000 7f3407fff700 1 --2- 172.21.15.72:0/854851421 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3408133540 0x7f3408135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.845+0000 7f3407fff700 1 -- 172.21.15.72:0/854851421 >> v1:172.21.15.72:6789/0 conn(0x7f3408130540 legacy=0x7f3408130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.845+0000 7f3407fff700 1 -- 172.21.15.72:0/854851421 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3408070b80 con 0x7f3408135e60 2023-10-03T10:14:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.846+0000 7f3407fff700 1 --2- 172.21.15.72:0/854851421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3408135e60 0x7f3408138240 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f340000d150 tx=0x7f340000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b201dae46793d6b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.846+0000 7f34067fc700 1 -- 172.21.15.72:0/854851421 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400010070 con 0x7f3408135e60 2023-10-03T10:14:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.846+0000 7f34067fc700 1 -- 172.21.15.72:0/854851421 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340000dd10 con 0x7f3408135e60 2023-10-03T10:14:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.846+0000 7f34067fc700 1 -- 172.21.15.72:0/854851421 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000b310 con 0x7f3408135e60 2023-10-03T10:14:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.846+0000 7f340dbd9700 1 -- 172.21.15.72:0/854851421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3408135e60 msgr2=0x7f3408138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.846+0000 7f340dbd9700 1 --2- 172.21.15.72:0/854851421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3408135e60 0x7f3408138240 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f340000d150 tx=0x7f340000d460 comp rx=0 tx=0).stop 2023-10-03T10:14:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.846+0000 7f340dbd9700 1 -- 172.21.15.72:0/854851421 shutdown_connections 2023-10-03T10:14:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.846+0000 7f340dbd9700 1 --2- 172.21.15.72:0/854851421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3408135e60 0x7f3408138240 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.846+0000 7f340dbd9700 1 --2- 172.21.15.72:0/854851421 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3408133540 0x7f3408135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.846+0000 7f340dbd9700 1 -- 172.21.15.72:0/854851421 >> 172.21.15.72:0/854851421 conn(0x7f34080a2aa0 msgr2=0x7f34080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.846+0000 7f340dbd9700 1 -- 172.21.15.72:0/854851421 shutdown_connections 2023-10-03T10:14:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.846+0000 7f340dbd9700 1 -- 172.21.15.72:0/854851421 wait complete. 2023-10-03T10:14:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.848+0000 7f340dbd9700 1 Processor -- start 2023-10-03T10:14:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.848+0000 7f340dbd9700 1 -- start start 2023-10-03T10:14:54.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f340dbd9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3408130540 0x7f34081c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f340dbd9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3408133540 0x7f34081c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f340dbd9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3408135e60 0x7f3408119150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f340dbd9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340811b550 con 0x7f3408130540 2023-10-03T10:14:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f340dbd9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340811aca0 con 0x7f3408133540 2023-10-03T10:14:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f340dbd9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f340812fee0 con 0x7f3408135e60 2023-10-03T10:14:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f34077fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3408130540 0x7f34081c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f34077fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3408130540 0x7f34081c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56666/0 (socket says 172.21.15.72:56666) 2023-10-03T10:14:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f3406ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3408133540 0x7f34081c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f34077fe700 1 -- 172.21.15.72:0/4042372442 learned_addr learned my addr 172.21.15.72:0/4042372442 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f3407fff700 1 --2- 172.21.15.72:0/4042372442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3408135e60 0x7f3408119150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f3406ffd700 1 -- 172.21.15.72:0/4042372442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3408135e60 msgr2=0x7f3408119150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f3406ffd700 1 --2- 172.21.15.72:0/4042372442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3408135e60 0x7f3408119150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f3406ffd700 1 -- 172.21.15.72:0/4042372442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3408130540 msgr2=0x7f34081c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f3406ffd700 1 --2- 172.21.15.72:0/4042372442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3408130540 0x7f34081c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f3406ffd700 1 -- 172.21.15.72:0/4042372442 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340000bd40 con 0x7f3408133540 2023-10-03T10:14:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f34077fe700 1 --2- 172.21.15.72:0/4042372442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3408130540 0x7f34081c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f3406ffd700 1 --2- 172.21.15.72:0/4042372442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3408133540 0x7f34081c48b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00e900 tx=0x7f33fc00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f33effff700 1 -- 172.21.15.72:0/4042372442 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc013920 con 0x7f3408133540 2023-10-03T10:14:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f33effff700 1 -- 172.21.15.72:0/4042372442 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc013a80 con 0x7f3408133540 2023-10-03T10:14:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f340dbd9700 1 -- 172.21.15.72:0/4042372442 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34080a2340 con 0x7f3408133540 2023-10-03T10:14:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.849+0000 7f33effff700 1 -- 172.21.15.72:0/4042372442 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc013df0 con 0x7f3408133540 2023-10-03T10:14:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.850+0000 7f340dbd9700 1 -- 172.21.15.72:0/4042372442 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34081c4e40 con 0x7f3408133540 2023-10-03T10:14:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.850+0000 7f340dbd9700 1 -- 172.21.15.72:0/4042372442 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3408074ea0 con 0x7f3408133540 2023-10-03T10:14:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.850+0000 7f33effff700 1 -- 172.21.15.72:0/4042372442 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33fc01b440 con 0x7f3408133540 2023-10-03T10:14:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.851+0000 7f33effff700 1 -- 172.21.15.72:0/4042372442 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f33fc043340 con 0x7f3408133540 2023-10-03T10:14:54.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.855+0000 7f33effff700 1 -- 172.21.15.72:0/4042372442 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33fc01ad70 con 0x7f3408133540 2023-10-03T10:14:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.891+0000 7fa11ff8e700 1 Processor -- start 2023-10-03T10:14:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.891+0000 7fa11ff8e700 1 -- start start 2023-10-03T10:14:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.891+0000 7fa11ff8e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa11809e1d0 0x7fa118138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.891+0000 7fa11ff8e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa118139170 0x7fa11813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11ff8e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11809b120 con 0x7fa11809d6f0 2023-10-03T10:14:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11ff8e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa11806b460 con 0x7fa11809e1d0 2023-10-03T10:14:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11ff8e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11809a7e0 con 0x7fa118139170 2023-10-03T10:14:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11d529700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa11809e1d0 0x7fa118138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11e52b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa118139170 0x7fa11813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11d529700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa11809e1d0 0x7fa118138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56682/0 (socket says 172.21.15.72:56682) 2023-10-03T10:14:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11e52b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa118139170 0x7fa11813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46832/0 (socket says 172.21.15.72:46832) 2023-10-03T10:14:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11d529700 1 -- 172.21.15.72:0/4244389595 learned_addr learned my addr 172.21.15.72:0/4244389595 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11d529700 1 -- 172.21.15.72:0/4244389595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa118139170 msgr2=0x7fa11813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11d529700 1 --2- 172.21.15.72:0/4244389595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa118139170 0x7fa11813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11d529700 1 -- 172.21.15.72:0/4244389595 >> v1:172.21.15.72:6789/0 conn(0x7fa11809d6f0 legacy=0x7fa11809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11d529700 1 -- 172.21.15.72:0/4244389595 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11809a500 con 0x7fa11809e1d0 2023-10-03T10:14:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11cd28700 1 -- 172.21.15.72:0/4244389595 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270601850 0 0) 0x7fa11809b120 con 0x7fa11809d6f0 2023-10-03T10:14:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11e52b700 1 --2- 172.21.15.72:0/4244389595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa118139170 0x7fa11813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11d529700 1 --2- 172.21.15.72:0/4244389595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa11809e1d0 0x7fa118138c30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa108009920 tx=0x7fa108009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4656c596bc326fc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11cd28700 1 -- 172.21.15.72:0/4244389595 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108011830 con 0x7fa11809e1d0 2023-10-03T10:14:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11cd28700 1 -- 172.21.15.72:0/4244389595 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa108011990 con 0x7fa11809e1d0 2023-10-03T10:14:54.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.892+0000 7fa11cd28700 1 -- 172.21.15.72:0/4244389595 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108011d20 con 0x7fa11809e1d0 2023-10-03T10:14:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.893+0000 7fa11ff8e700 1 -- 172.21.15.72:0/4244389595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa11809e1d0 msgr2=0x7fa118138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.893+0000 7fa11ff8e700 1 --2- 172.21.15.72:0/4244389595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa11809e1d0 0x7fa118138c30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa108009920 tx=0x7fa108009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.893+0000 7fa11ff8e700 1 -- 172.21.15.72:0/4244389595 shutdown_connections 2023-10-03T10:14:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.893+0000 7fa11ff8e700 1 --2- 172.21.15.72:0/4244389595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa118139170 0x7fa11813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.893+0000 7fa11ff8e700 1 --2- 172.21.15.72:0/4244389595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa11809e1d0 0x7fa118138c30 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.893+0000 7fa11ff8e700 1 -- 172.21.15.72:0/4244389595 >> 172.21.15.72:0/4244389595 conn(0x7fa118066f50 msgr2=0x7fa11809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.893+0000 7fa11ff8e700 1 -- 172.21.15.72:0/4244389595 shutdown_connections 2023-10-03T10:14:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.893+0000 7fa11ff8e700 1 -- 172.21.15.72:0/4244389595 wait complete. 2023-10-03T10:14:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.894+0000 7fa11ff8e700 1 Processor -- start 2023-10-03T10:14:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.894+0000 7fa11ff8e700 1 -- start start 2023-10-03T10:14:54.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7f34ca1a5700 1 -- 172.21.15.72:0/527834309 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f34c4125b10 con 0x7f34c409e000 2023-10-03T10:14:54.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11ff8e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa11809d6f0 0x7fa11811e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11ff8e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa11809e1d0 0x7fa11811ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7f34bbfff700 1 -- 172.21.15.72:0/527834309 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f34c4125b10 con 0x7f34c409e000 2023-10-03T10:14:54.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11ff8e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa118139170 0x7fa11811f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11ff8e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1181222a0 con 0x7fa11809d6f0 2023-10-03T10:14:54.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11ff8e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1180a2190 con 0x7fa118139170 2023-10-03T10:14:54.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11ff8e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa11809c710 con 0x7fa11809e1d0 2023-10-03T10:14:54.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11e52b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa118139170 0x7fa11811f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11d529700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa11809e1d0 0x7fa11811ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11e52b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa118139170 0x7fa11811f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46844/0 (socket says 172.21.15.72:46844) 2023-10-03T10:14:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11e52b700 1 -- 172.21.15.72:0/776393584 learned_addr learned my addr 172.21.15.72:0/776393584 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11dd2a700 1 --2- 172.21.15.72:0/776393584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa11809d6f0 0x7fa11811e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.898 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11d529700 1 -- 172.21.15.72:0/776393584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa118139170 msgr2=0x7fa11811f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11d529700 1 --2- 172.21.15.72:0/776393584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa118139170 0x7fa11811f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11d529700 1 -- 172.21.15.72:0/776393584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa11809d6f0 msgr2=0x7fa11811e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11d529700 1 --2- 172.21.15.72:0/776393584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa11809d6f0 0x7fa11811e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.895+0000 7fa11d529700 1 -- 172.21.15.72:0/776393584 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa110009a70 con 0x7fa11809e1d0 2023-10-03T10:14:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.896+0000 7fa11d529700 1 --2- 172.21.15.72:0/776393584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa11809e1d0 0x7fa11811ed00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa108016000 tx=0x7fa108004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.896+0000 7fa10e7fc700 1 -- 172.21.15.72:0/776393584 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108004590 con 0x7fa11809e1d0 2023-10-03T10:14:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.896+0000 7fa10e7fc700 1 -- 172.21.15.72:0/776393584 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1080036a0 con 0x7fa11809e1d0 2023-10-03T10:14:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.896+0000 7fa11ff8e700 1 -- 172.21.15.72:0/776393584 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa108009550 con 0x7fa11809e1d0 2023-10-03T10:14:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.896+0000 7fa10e7fc700 1 -- 172.21.15.72:0/776393584 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108003a50 con 0x7fa11809e1d0 2023-10-03T10:14:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.896+0000 7fa11ff8e700 1 -- 172.21.15.72:0/776393584 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa118120ae0 con 0x7fa11809e1d0 2023-10-03T10:14:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.897+0000 7fa10e7fc700 1 -- 172.21.15.72:0/776393584 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa108003bb0 con 0x7fa11809e1d0 2023-10-03T10:14:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.897+0000 7fa11ff8e700 1 -- 172.21.15.72:0/776393584 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa118121b70 con 0x7fa11809e1d0 2023-10-03T10:14:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.897+0000 7fa10e7fc700 1 -- 172.21.15.72:0/776393584 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa108021030 con 0x7fa11809e1d0 2023-10-03T10:14:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.898+0000 7f34ca1a5700 1 -- 172.21.15.72:0/527834309 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c409e000 msgr2=0x7f34c41229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.898+0000 7f34ca1a5700 1 --2- 172.21.15.72:0/527834309 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c409e000 0x7f34c41229b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f34c406e510 tx=0x7f34b4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.898+0000 7f34ca1a5700 1 -- 172.21.15.72:0/527834309 shutdown_connections 2023-10-03T10:14:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.898+0000 7f34ca1a5700 1 --2- 172.21.15.72:0/527834309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c409d6f0 0x7f34c4122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.898+0000 7f34ca1a5700 1 --2- 172.21.15.72:0/527834309 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c409e410 0x7f34c4122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.898+0000 7f34ca1a5700 1 --2- 172.21.15.72:0/527834309 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c409e000 0x7f34c41229b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.898+0000 7f34ca1a5700 1 -- 172.21.15.72:0/527834309 >> 172.21.15.72:0/527834309 conn(0x7f34c4066f50 msgr2=0x7f34c4070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.898+0000 7f34ca1a5700 1 -- 172.21.15.72:0/527834309 shutdown_connections 2023-10-03T10:14:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.898+0000 7f34ca1a5700 1 -- 172.21.15.72:0/527834309 wait complete. 2023-10-03T10:14:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:54.902+0000 7fa10e7fc700 1 -- 172.21.15.72:0/776393584 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa10801a430 con 0x7fa11809e1d0 2023-10-03T10:14:54.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:55.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.054+0000 7f340dbd9700 1 -- 172.21.15.72:0/4042372442 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f34081c4e40 con 0x7f3408133540 2023-10-03T10:14:55.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.054+0000 7f33effff700 1 -- 172.21.15.72:0/4042372442 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34081c4e40 con 0x7f3408133540 2023-10-03T10:14:55.054 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:55.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.056+0000 7f340dbd9700 1 -- 172.21.15.72:0/4042372442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3408133540 msgr2=0x7f34081c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.056+0000 7f340dbd9700 1 --2- 172.21.15.72:0/4042372442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3408133540 0x7f34081c48b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00e900 tx=0x7f33fc00ec10 comp rx=0 tx=0).stop 2023-10-03T10:14:55.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.056+0000 7f340dbd9700 1 -- 172.21.15.72:0/4042372442 shutdown_connections 2023-10-03T10:14:55.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.056+0000 7f340dbd9700 1 --2- 172.21.15.72:0/4042372442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3408130540 0x7f34081c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.056+0000 7f340dbd9700 1 --2- 172.21.15.72:0/4042372442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3408135e60 0x7f3408119150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.056+0000 7f340dbd9700 1 --2- 172.21.15.72:0/4042372442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3408133540 0x7f34081c48b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.056+0000 7f340dbd9700 1 -- 172.21.15.72:0/4042372442 >> 172.21.15.72:0/4042372442 conn(0x7f34080a2aa0 msgr2=0x7f3408131320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.057+0000 7f340dbd9700 1 -- 172.21.15.72:0/4042372442 shutdown_connections 2023-10-03T10:14:55.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.057+0000 7f340dbd9700 1 -- 172.21.15.72:0/4042372442 wait complete. 2023-10-03T10:14:55.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:55.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.101+0000 7fa11ff8e700 1 -- 172.21.15.72:0/776393584 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa1181345d0 con 0x7fa11809e1d0 2023-10-03T10:14:55.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.101+0000 7fa10e7fc700 1 -- 172.21.15.72:0/776393584 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa108015030 con 0x7fa11809e1d0 2023-10-03T10:14:55.101 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:55.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.103+0000 7fa11ff8e700 1 -- 172.21.15.72:0/776393584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa11809e1d0 msgr2=0x7fa11811ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.103+0000 7fa11ff8e700 1 --2- 172.21.15.72:0/776393584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa11809e1d0 0x7fa11811ed00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa108016000 tx=0x7fa108004750 comp rx=0 tx=0).stop 2023-10-03T10:14:55.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.103+0000 7fa11ff8e700 1 -- 172.21.15.72:0/776393584 shutdown_connections 2023-10-03T10:14:55.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.103+0000 7fa11ff8e700 1 --2- 172.21.15.72:0/776393584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa11809d6f0 0x7fa11811e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.103+0000 7fa11ff8e700 1 --2- 172.21.15.72:0/776393584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa118139170 0x7fa11811f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.103+0000 7fa11ff8e700 1 --2- 172.21.15.72:0/776393584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa11809e1d0 0x7fa11811ed00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.103+0000 7fa11ff8e700 1 -- 172.21.15.72:0/776393584 >> 172.21.15.72:0/776393584 conn(0x7fa118066f50 msgr2=0x7fa118136c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.103+0000 7fa11ff8e700 1 -- 172.21.15.72:0/776393584 shutdown_connections 2023-10-03T10:14:55.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.103+0000 7fa11ff8e700 1 -- 172.21.15.72:0/776393584 wait complete. 2023-10-03T10:14:55.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:55.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:55.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.480+0000 7f7d0bb28700 1 Processor -- start 2023-10-03T10:14:55.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.480+0000 7f7d0bb28700 1 -- start start 2023-10-03T10:14:55.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d0bb28700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d0409d6f0 0x7f7d0409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d0bb28700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7d0409e410 0x7f7d04130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d0bb28700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0409f130 con 0x7f7d0409e000 2023-10-03T10:14:55.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d0bb28700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0409f520 con 0x7f7d0409e410 2023-10-03T10:14:55.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d0bb28700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0409e930 con 0x7f7d0409d6f0 2023-10-03T10:14:55.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d0a0c5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7d0409e410 0x7f7d04130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d098c4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d0409d6f0 0x7f7d0409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d0a0c5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7d0409e410 0x7f7d04130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56700/0 (socket says 172.21.15.72:56700) 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d098c4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d0409d6f0 0x7f7d0409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57638/0 (socket says 172.21.15.72:57638) 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d0a0c5700 1 -- 172.21.15.72:0/477452130 learned_addr learned my addr 172.21.15.72:0/477452130 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d0a0c5700 1 -- 172.21.15.72:0/477452130 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d0409d6f0 msgr2=0x7f7d0409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d0a0c5700 1 --2- 172.21.15.72:0/477452130 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d0409d6f0 0x7f7d0409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d0a0c5700 1 -- 172.21.15.72:0/477452130 >> v1:172.21.15.72:6789/0 conn(0x7f7d0409e000 legacy=0x7f7d04130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d0a0c5700 1 -- 172.21.15.72:0/477452130 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0409b2d0 con 0x7f7d0409e410 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d098c4700 1 --2- 172.21.15.72:0/477452130 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d0409d6f0 0x7f7d0409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d0a0c5700 1 --2- 172.21.15.72:0/477452130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0409e410 0x7f7d04130d70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00d150 tx=0x7f7cfc00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da38d3fca8eb2e77 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d088c2700 1 -- 172.21.15.72:0/477452130 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc010070 con 0x7f7d0409e410 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d088c2700 1 -- 172.21.15.72:0/477452130 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00dd10 con 0x7f7d0409e410 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.481+0000 7f7d088c2700 1 -- 172.21.15.72:0/477452130 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00b310 con 0x7f7d0409e410 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.482+0000 7f7d0bb28700 1 -- 172.21.15.72:0/477452130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0409e410 msgr2=0x7f7d04130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.482+0000 7f7d0bb28700 1 --2- 172.21.15.72:0/477452130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0409e410 0x7f7d04130d70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00d150 tx=0x7f7cfc00d460 comp rx=0 tx=0).stop 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.482+0000 7f7d0bb28700 1 -- 172.21.15.72:0/477452130 shutdown_connections 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.482+0000 7f7d0bb28700 1 --2- 172.21.15.72:0/477452130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0409e410 0x7f7d04130d70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.482+0000 7f7d0bb28700 1 --2- 172.21.15.72:0/477452130 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d0409d6f0 0x7f7d0409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.482+0000 7f7d0bb28700 1 -- 172.21.15.72:0/477452130 >> 172.21.15.72:0/477452130 conn(0x7f7d04066f50 msgr2=0x7f7d0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.482+0000 7f7d0bb28700 1 -- 172.21.15.72:0/477452130 shutdown_connections 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.482+0000 7f7d0bb28700 1 -- 172.21.15.72:0/477452130 wait complete. 2023-10-03T10:14:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.483+0000 7f7d0bb28700 1 Processor -- start 2023-10-03T10:14:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.483+0000 7f7d0bb28700 1 -- start start 2023-10-03T10:14:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d0bb28700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0409d6f0 0x7f7d04122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d0bb28700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d0409e000 0x7f7d04122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d0bb28700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0409e410 0x7f7d04123280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d0bb28700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d04125d70 con 0x7f7d0409d6f0 2023-10-03T10:14:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d0bb28700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d04126280 con 0x7f7d0409e410 2023-10-03T10:14:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d0bb28700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d040a1d00 con 0x7f7d0409e000 2023-10-03T10:14:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d098c4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0409d6f0 0x7f7d04122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d090c3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d0409e000 0x7f7d04122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d098c4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0409d6f0 0x7f7d04122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56702/0 (socket says 172.21.15.72:56702) 2023-10-03T10:14:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d098c4700 1 -- 172.21.15.72:0/3743768976 learned_addr learned my addr 172.21.15.72:0/3743768976 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d0a0c5700 1 --2- 172.21.15.72:0/3743768976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0409e410 0x7f7d04123280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d090c3700 1 -- 172.21.15.72:0/3743768976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0409e410 msgr2=0x7f7d04123280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d090c3700 1 --2- 172.21.15.72:0/3743768976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0409e410 0x7f7d04123280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d090c3700 1 -- 172.21.15.72:0/3743768976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0409d6f0 msgr2=0x7f7d04122800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d090c3700 1 --2- 172.21.15.72:0/3743768976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0409d6f0 0x7f7d04122800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d090c3700 1 -- 172.21.15.72:0/3743768976 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40094a0 con 0x7f7d0409e000 2023-10-03T10:14:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d098c4700 1 --2- 172.21.15.72:0/3743768976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0409d6f0 0x7f7d04122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d0a0c5700 1 --2- 172.21.15.72:0/3743768976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0409e410 0x7f7d04123280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.484+0000 7f7d090c3700 1 --2- 172.21.15.72:0/3743768976 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d0409e000 0x7f7d04122d40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7d00000f60 tx=0x7f7d0000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.485+0000 7f7cfa7fc700 1 -- 172.21.15.72:0/3743768976 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d000050d0 con 0x7f7d0409e000 2023-10-03T10:14:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.485+0000 7f7cfa7fc700 1 -- 172.21.15.72:0/3743768976 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d00005230 con 0x7f7d0409e000 2023-10-03T10:14:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.485+0000 7f7d0bb28700 1 -- 172.21.15.72:0/3743768976 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cfc00bd40 con 0x7f7d0409e000 2023-10-03T10:14:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.485+0000 7f7cfa7fc700 1 -- 172.21.15.72:0/3743768976 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00003680 con 0x7f7d0409e000 2023-10-03T10:14:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.485+0000 7f7d0bb28700 1 -- 172.21.15.72:0/3743768976 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0409c750 con 0x7f7d0409e000 2023-10-03T10:14:55.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.485+0000 7f7cfa7fc700 1 -- 172.21.15.72:0/3743768976 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d000037e0 con 0x7f7d0409e000 2023-10-03T10:14:55.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.485+0000 7f7cfa7fc700 1 -- 172.21.15.72:0/3743768976 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d0003e9a0 con 0x7f7d0409e000 2023-10-03T10:14:55.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.486+0000 7f7d0bb28700 1 -- 172.21.15.72:0/3743768976 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d041260c0 con 0x7f7d0409e000 2023-10-03T10:14:55.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.490+0000 7f7cfa7fc700 1 -- 172.21.15.72:0/3743768976 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d00011590 con 0x7f7d0409e000 2023-10-03T10:14:55.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.678+0000 7f7d0bb28700 1 -- 172.21.15.72:0/3743768976 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7d04074ea0 con 0x7f7d0409e000 2023-10-03T10:14:55.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.678+0000 7f7cfa7fc700 1 -- 172.21.15.72:0/3743768976 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d000192c0 con 0x7f7d0409e000 2023-10-03T10:14:55.678 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:55.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.680+0000 7f7d0bb28700 1 -- 172.21.15.72:0/3743768976 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d0409e000 msgr2=0x7f7d04122d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.680+0000 7f7d0bb28700 1 --2- 172.21.15.72:0/3743768976 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d0409e000 0x7f7d04122d40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7d00000f60 tx=0x7f7d0000c730 comp rx=0 tx=0).stop 2023-10-03T10:14:55.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.680+0000 7f7d0bb28700 1 -- 172.21.15.72:0/3743768976 shutdown_connections 2023-10-03T10:14:55.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.680+0000 7f7d0bb28700 1 --2- 172.21.15.72:0/3743768976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0409d6f0 0x7f7d04122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.680+0000 7f7d0bb28700 1 --2- 172.21.15.72:0/3743768976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0409e410 0x7f7d04123280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.680+0000 7f7d0bb28700 1 --2- 172.21.15.72:0/3743768976 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d0409e000 0x7f7d04122d40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.680+0000 7f7d0bb28700 1 -- 172.21.15.72:0/3743768976 >> 172.21.15.72:0/3743768976 conn(0x7f7d04066f50 msgr2=0x7f7d040710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.680+0000 7f7d0bb28700 1 -- 172.21.15.72:0/3743768976 shutdown_connections 2023-10-03T10:14:55.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:55.680+0000 7f7d0bb28700 1 -- 172.21.15.72:0/3743768976 wait complete. 2023-10-03T10:14:55.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:55.914 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:56.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.036+0000 7f81d0882700 1 Processor -- start 2023-10-03T10:14:56.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.036+0000 7f81d0882700 1 -- start start 2023-10-03T10:14:56.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81d0882700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81cc09d6f0 0x7f81cc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81d0882700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81d0882700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81cc09b120 con 0x7f81cc09e000 2023-10-03T10:14:56.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81d0882700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81cc06b460 con 0x7f81cc09d6f0 2023-10-03T10:14:56.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81d0882700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc09a7e0 con 0x7f81cc09e440 2023-10-03T10:14:56.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81ca59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81cc09d6f0 0x7f81cc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81cad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81ca59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81cc09d6f0 0x7f81cc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56718/0 (socket says 172.21.15.72:56718) 2023-10-03T10:14:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81cad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57642/0 (socket says 172.21.15.72:57642) 2023-10-03T10:14:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81ca59c700 1 -- 172.21.15.72:0/2379350483 learned_addr learned my addr 172.21.15.72:0/2379350483 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81ca59c700 1 -- 172.21.15.72:0/2379350483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 msgr2=0x7f81cc134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81ca59c700 1 --2- 172.21.15.72:0/2379350483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81ca59c700 1 -- 172.21.15.72:0/2379350483 >> v1:172.21.15.72:6789/0 conn(0x7f81cc09e000 legacy=0x7f81cc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81ca59c700 1 -- 172.21.15.72:0/2379350483 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc09a500 con 0x7f81cc09d6f0 2023-10-03T10:14:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81cad9d700 1 --2- 172.21.15.72:0/2379350483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81ca59c700 1 --2- 172.21.15.72:0/2379350483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09d6f0 0x7f81cc09dac0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009920 tx=0x7f81c0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e81035a36062f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81c959a700 1 -- 172.21.15.72:0/2379350483 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0011830 con 0x7f81cc09d6f0 2023-10-03T10:14:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.037+0000 7f81c959a700 1 -- 172.21.15.72:0/2379350483 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c0011990 con 0x7f81cc09d6f0 2023-10-03T10:14:56.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.038+0000 7f81c959a700 1 -- 172.21.15.72:0/2379350483 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0011d20 con 0x7f81cc09d6f0 2023-10-03T10:14:56.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.038+0000 7f81d0882700 1 -- 172.21.15.72:0/2379350483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09d6f0 msgr2=0x7f81cc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.038+0000 7f81d0882700 1 --2- 172.21.15.72:0/2379350483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09d6f0 0x7f81cc09dac0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009920 tx=0x7f81c0009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:56.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.038+0000 7f81d0882700 1 -- 172.21.15.72:0/2379350483 shutdown_connections 2023-10-03T10:14:56.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.038+0000 7f81d0882700 1 --2- 172.21.15.72:0/2379350483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.038+0000 7f81d0882700 1 --2- 172.21.15.72:0/2379350483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09d6f0 0x7f81cc09dac0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.038+0000 7f81d0882700 1 -- 172.21.15.72:0/2379350483 >> 172.21.15.72:0/2379350483 conn(0x7f81cc066f50 msgr2=0x7f81cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.038+0000 7f81d0882700 1 -- 172.21.15.72:0/2379350483 shutdown_connections 2023-10-03T10:14:56.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.038+0000 7f81d0882700 1 -- 172.21.15.72:0/2379350483 wait complete. 2023-10-03T10:14:56.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.039+0000 7f81d0882700 1 Processor -- start 2023-10-03T10:14:56.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.039+0000 7f81d0882700 1 -- start start 2023-10-03T10:14:56.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81d0882700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81cc09d6f0 0x7f81cc1c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81d0882700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09e000 0x7f81cc1c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81d0882700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc1c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81d0882700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc1a7170 con 0x7f81cc09e000 2023-10-03T10:14:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81d0882700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc1a8bd0 con 0x7f81cc09d6f0 2023-10-03T10:14:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81d0882700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc1a9280 con 0x7f81cc09e440 2023-10-03T10:14:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81cad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc1c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81ca59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81cc09d6f0 0x7f81cc1c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81c9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09e000 0x7f81cc1c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81cad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc1c4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57656/0 (socket says 172.21.15.72:57656) 2023-10-03T10:14:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81ca59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81cc09d6f0 0x7f81cc1c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46860/0 (socket says 172.21.15.72:46860) 2023-10-03T10:14:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81cad9d700 1 -- 172.21.15.72:0/2266254452 learned_addr learned my addr 172.21.15.72:0/2266254452 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81cad9d700 1 -- 172.21.15.72:0/2266254452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81cc09d6f0 msgr2=0x7f81cc1c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81cad9d700 1 --2- 172.21.15.72:0/2266254452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81cc09d6f0 0x7f81cc1c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81cad9d700 1 -- 172.21.15.72:0/2266254452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09e000 msgr2=0x7f81cc1c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81cad9d700 1 --2- 172.21.15.72:0/2266254452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09e000 0x7f81cc1c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81cad9d700 1 -- 172.21.15.72:0/2266254452 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4009a70 con 0x7f81cc09e440 2023-10-03T10:14:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81c9d9b700 1 --2- 172.21.15.72:0/2266254452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09e000 0x7f81cc1c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81cad9d700 1 --2- 172.21.15.72:0/2266254452 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc1c4ad0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f81c400efc0 tx=0x7f81c400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81baffd700 1 -- 172.21.15.72:0/2266254452 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c400ca90 con 0x7f81cc09e440 2023-10-03T10:14:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81baffd700 1 -- 172.21.15.72:0/2266254452 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c400f040 con 0x7f81cc09e440 2023-10-03T10:14:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81d0882700 1 -- 172.21.15.72:0/2266254452 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c0009550 con 0x7f81cc09e440 2023-10-03T10:14:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81baffd700 1 -- 172.21.15.72:0/2266254452 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c400ce10 con 0x7f81cc09e440 2023-10-03T10:14:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.040+0000 7f81d0882700 1 -- 172.21.15.72:0/2266254452 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81cc1a8710 con 0x7f81cc09e440 2023-10-03T10:14:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.041+0000 7f81baffd700 1 -- 172.21.15.72:0/2266254452 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81c4014480 con 0x7f81cc09e440 2023-10-03T10:14:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.041+0000 7f81baffd700 1 -- 172.21.15.72:0/2266254452 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f81c403fd60 con 0x7f81cc09e440 2023-10-03T10:14:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.041+0000 7f81d0882700 1 -- 172.21.15.72:0/2266254452 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81cc074ea0 con 0x7f81cc09e440 2023-10-03T10:14:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.046+0000 7f81baffd700 1 -- 172.21.15.72:0/2266254452 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81c4012930 con 0x7f81cc09e440 2023-10-03T10:14:56.069 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:56.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:56.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.204+0000 7fbb4baa4700 1 Processor -- start 2023-10-03T10:14:56.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.204+0000 7fbb4baa4700 1 -- start start 2023-10-03T10:14:56.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4baa4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb4409f330 0x7fbb44138e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4baa4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb44139370 0x7fbb4413b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4baa4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4406bc50 con 0x7fbb4409e850 2023-10-03T10:14:56.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4baa4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4409ae60 con 0x7fbb44139370 2023-10-03T10:14:56.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4baa4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4406b990 con 0x7fbb4409f330 2023-10-03T10:14:56.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4903f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb4409f330 0x7fbb44138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4903f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb4409f330 0x7fbb44138e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57664/0 (socket says 172.21.15.72:57664) 2023-10-03T10:14:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4a041700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb44139370 0x7fbb4413b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4903f700 1 -- 172.21.15.72:0/1672172185 learned_addr learned my addr 172.21.15.72:0/1672172185 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4a041700 1 -- 172.21.15.72:0/1672172185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb4409f330 msgr2=0x7fbb44138e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4a041700 1 --2- 172.21.15.72:0/1672172185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb4409f330 0x7fbb44138e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4a041700 1 -- 172.21.15.72:0/1672172185 >> v1:172.21.15.72:6789/0 conn(0x7fbb4409e850 legacy=0x7fbb4409ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4a041700 1 -- 172.21.15.72:0/1672172185 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4406cb10 con 0x7fbb44139370 2023-10-03T10:14:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4903f700 1 --2- 172.21.15.72:0/1672172185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb4409f330 0x7fbb44138e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4a041700 1 --2- 172.21.15.72:0/1672172185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb44139370 0x7fbb4413b750 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009d90 tx=0x7fbb3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356c9b6e04eef1e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4883e700 1 -- 172.21.15.72:0/1672172185 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c00e070 con 0x7fbb44139370 2023-10-03T10:14:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4883e700 1 -- 172.21.15.72:0/1672172185 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3c00bb20 con 0x7fbb44139370 2023-10-03T10:14:56.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.205+0000 7fbb4883e700 1 -- 172.21.15.72:0/1672172185 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c012430 con 0x7fbb44139370 2023-10-03T10:14:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.206+0000 7fbb4baa4700 1 -- 172.21.15.72:0/1672172185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb44139370 msgr2=0x7fbb4413b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.206+0000 7fbb4baa4700 1 --2- 172.21.15.72:0/1672172185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb44139370 0x7fbb4413b750 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009d90 tx=0x7fbb3c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.206+0000 7fbb4baa4700 1 -- 172.21.15.72:0/1672172185 shutdown_connections 2023-10-03T10:14:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.206+0000 7fbb4baa4700 1 --2- 172.21.15.72:0/1672172185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb44139370 0x7fbb4413b750 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.206+0000 7fbb4baa4700 1 --2- 172.21.15.72:0/1672172185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb4409f330 0x7fbb44138e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.206+0000 7fbb4baa4700 1 -- 172.21.15.72:0/1672172185 >> 172.21.15.72:0/1672172185 conn(0x7fbb440a3f70 msgr2=0x7fbb440a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.206+0000 7fbb4baa4700 1 -- 172.21.15.72:0/1672172185 shutdown_connections 2023-10-03T10:14:56.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.206+0000 7fbb4baa4700 1 -- 172.21.15.72:0/1672172185 wait complete. 2023-10-03T10:14:56.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.207+0000 7fbb4baa4700 1 Processor -- start 2023-10-03T10:14:56.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.207+0000 7fbb4baa4700 1 -- start start 2023-10-03T10:14:56.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4baa4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4409e850 0x7fbb4411f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4baa4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb4409f330 0x7fbb4411fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4baa4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb44139370 0x7fbb441c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4baa4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb44122470 con 0x7fbb4409e850 2023-10-03T10:14:56.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4baa4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4411f2c0 con 0x7fbb4409f330 2023-10-03T10:14:56.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4baa4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb441221b0 con 0x7fbb44139370 2023-10-03T10:14:56.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4903f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb4409f330 0x7fbb4411fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4903f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb4409f330 0x7fbb4411fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46862/0 (socket says 172.21.15.72:46862) 2023-10-03T10:14:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4903f700 1 -- 172.21.15.72:0/2364995969 learned_addr learned my addr 172.21.15.72:0/2364995969 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb49840700 1 --2- 172.21.15.72:0/2364995969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4409e850 0x7fbb4411f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4a041700 1 --2- 172.21.15.72:0/2364995969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb44139370 0x7fbb441c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4903f700 1 -- 172.21.15.72:0/2364995969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb44139370 msgr2=0x7fbb441c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4903f700 1 --2- 172.21.15.72:0/2364995969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb44139370 0x7fbb441c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4903f700 1 -- 172.21.15.72:0/2364995969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4409e850 msgr2=0x7fbb4411f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4903f700 1 --2- 172.21.15.72:0/2364995969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4409e850 0x7fbb4411f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4903f700 1 -- 172.21.15.72:0/2364995969 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb34009550 con 0x7fbb4409f330 2023-10-03T10:14:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb49840700 1 --2- 172.21.15.72:0/2364995969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4409e850 0x7fbb4411f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4903f700 1 --2- 172.21.15.72:0/2364995969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb4409f330 0x7fbb4411fb90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400ebe0 tx=0x7fbb3400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb3a7fc700 1 -- 172.21.15.72:0/2364995969 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3400c850 con 0x7fbb4409f330 2023-10-03T10:14:56.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb3a7fc700 1 -- 172.21.15.72:0/2364995969 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3400c9b0 con 0x7fbb4409f330 2023-10-03T10:14:56.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4baa4700 1 -- 172.21.15.72:0/2364995969 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3c009a70 con 0x7fbb4409f330 2023-10-03T10:14:56.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb3a7fc700 1 -- 172.21.15.72:0/2364995969 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3400cd40 con 0x7fbb4409f330 2023-10-03T10:14:56.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.208+0000 7fbb4baa4700 1 -- 172.21.15.72:0/2364995969 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb441200d0 con 0x7fbb4409f330 2023-10-03T10:14:56.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.209+0000 7fbb3a7fc700 1 -- 172.21.15.72:0/2364995969 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb34013470 con 0x7fbb4409f330 2023-10-03T10:14:56.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.209+0000 7fbb3a7fc700 1 -- 172.21.15.72:0/2364995969 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbb3403f970 con 0x7fbb4409f330 2023-10-03T10:14:56.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.210+0000 7fbb4baa4700 1 -- 172.21.15.72:0/2364995969 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb441226b0 con 0x7fbb4409f330 2023-10-03T10:14:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.218+0000 7fbb3a7fc700 1 -- 172.21.15.72:0/2364995969 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb34017080 con 0x7fbb4409f330 2023-10-03T10:14:56.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.248+0000 7f81d0882700 1 -- 172.21.15.72:0/2266254452 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f81cc1a9780 con 0x7f81cc09e440 2023-10-03T10:14:56.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.248+0000 7f81baffd700 1 -- 172.21.15.72:0/2266254452 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f81c402b090 con 0x7f81cc09e440 2023-10-03T10:14:56.248 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:56.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.250+0000 7f81d0882700 1 -- 172.21.15.72:0/2266254452 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 msgr2=0x7f81cc1c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.250+0000 7f81d0882700 1 --2- 172.21.15.72:0/2266254452 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc1c4ad0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f81c400efc0 tx=0x7f81c400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.250+0000 7f81d0882700 1 -- 172.21.15.72:0/2266254452 shutdown_connections 2023-10-03T10:14:56.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.250+0000 7f81d0882700 1 --2- 172.21.15.72:0/2266254452 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc1c4ad0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.250+0000 7f81d0882700 1 --2- 172.21.15.72:0/2266254452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81cc09d6f0 0x7f81cc1c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.250+0000 7f81d0882700 1 --2- 172.21.15.72:0/2266254452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09e000 0x7f81cc1c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.250+0000 7f81d0882700 1 -- 172.21.15.72:0/2266254452 >> 172.21.15.72:0/2266254452 conn(0x7f81cc066f50 msgr2=0x7f81cc1bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.250+0000 7f81d0882700 1 -- 172.21.15.72:0/2266254452 shutdown_connections 2023-10-03T10:14:56.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.250+0000 7f81d0882700 1 -- 172.21.15.72:0/2266254452 wait complete. 2023-10-03T10:14:56.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:56.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.272+0000 7f0c7dfb4700 1 Processor -- start 2023-10-03T10:14:56.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.272+0000 7f0c7dfb4700 1 -- start start 2023-10-03T10:14:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.272+0000 7f0c7dfb4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0c7809d6f0 0x7f0c7809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.272+0000 7f0c7dfb4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0c7809e410 0x7f0c78130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.272+0000 7f0c7dfb4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7809f130 con 0x7f0c7809e000 2023-10-03T10:14:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.272+0000 7f0c7dfb4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7809f520 con 0x7f0c7809d6f0 2023-10-03T10:14:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.272+0000 7f0c7dfb4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7809e930 con 0x7f0c7809e410 2023-10-03T10:14:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.273+0000 7f0c777fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0c7809d6f0 0x7f0c7809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.273+0000 7f0c77fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0c7809e410 0x7f0c78130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.273+0000 7f0c777fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0c7809d6f0 0x7f0c7809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56770/0 (socket says 172.21.15.72:56770) 2023-10-03T10:14:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.273+0000 7f0c77fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0c7809e410 0x7f0c78130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57684/0 (socket says 172.21.15.72:57684) 2023-10-03T10:14:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.273+0000 7f0c777fe700 1 -- 172.21.15.72:0/3758332848 learned_addr learned my addr 172.21.15.72:0/3758332848 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:56.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.273+0000 7f0c77fff700 1 -- 172.21.15.72:0/3758332848 >> v2:172.21.15.72:3300/0 conn(0x7f0c7809d6f0 msgr2=0x7f0c7809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.273+0000 7f0c77fff700 1 --2- 172.21.15.72:0/3758332848 >> v2:172.21.15.72:3300/0 conn(0x7f0c7809d6f0 0x7f0c7809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.273+0000 7f0c77fff700 1 -- 172.21.15.72:0/3758332848 >> v1:172.21.15.72:6789/0 conn(0x7f0c7809e000 legacy=0x7f0c78130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.273+0000 7f0c77fff700 1 -- 172.21.15.72:0/3758332848 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7809b2d0 con 0x7f0c7809e410 2023-10-03T10:14:56.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.273+0000 7f0c77fff700 1 --2- 172.21.15.72:0/3758332848 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0c7809e410 0x7f0c78130d70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009d90 tx=0x7f0c6800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69154e074717d70e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.273+0000 7f0c767fc700 1 -- 172.21.15.72:0/3758332848 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6800e070 con 0x7f0c7809e410 2023-10-03T10:14:56.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.273+0000 7f0c767fc700 1 -- 172.21.15.72:0/3758332848 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6800bb20 con 0x7f0c7809e410 2023-10-03T10:14:56.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.273+0000 7f0c767fc700 1 -- 172.21.15.72:0/3758332848 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68012430 con 0x7f0c7809e410 2023-10-03T10:14:56.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.274+0000 7f0c7dfb4700 1 -- 172.21.15.72:0/3758332848 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0c7809e410 msgr2=0x7f0c78130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.274+0000 7f0c7dfb4700 1 --2- 172.21.15.72:0/3758332848 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0c7809e410 0x7f0c78130d70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009d90 tx=0x7f0c6800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:56.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.274+0000 7f0c7dfb4700 1 -- 172.21.15.72:0/3758332848 shutdown_connections 2023-10-03T10:14:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.274+0000 7f0c7dfb4700 1 --2- 172.21.15.72:0/3758332848 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0c7809e410 0x7f0c78130d70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.274+0000 7f0c7dfb4700 1 --2- 172.21.15.72:0/3758332848 >> v2:172.21.15.72:3300/0 conn(0x7f0c7809d6f0 0x7f0c7809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.274+0000 7f0c7dfb4700 1 -- 172.21.15.72:0/3758332848 >> 172.21.15.72:0/3758332848 conn(0x7f0c78066f50 msgr2=0x7f0c7809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.274+0000 7f0c7dfb4700 1 -- 172.21.15.72:0/3758332848 shutdown_connections 2023-10-03T10:14:56.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.274+0000 7f0c7dfb4700 1 -- 172.21.15.72:0/3758332848 wait complete. 2023-10-03T10:14:56.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.275+0000 7f0c7dfb4700 1 Processor -- start 2023-10-03T10:14:56.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.275+0000 7f0c7dfb4700 1 -- start start 2023-10-03T10:14:56.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.276+0000 7f0c7dfb4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c7809d6f0 0x7f0c78121110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.276+0000 7f0c7dfb4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0c7809e000 0x7f0c78121650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.276+0000 7f0c7dfb4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0c7809e410 0x7f0c78121b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.276+0000 7f0c7dfb4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c781245f0 con 0x7f0c7809d6f0 2023-10-03T10:14:56.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.276+0000 7f0c7dfb4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7809c700 con 0x7f0c7809e000 2023-10-03T10:14:56.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.276+0000 7f0c7dfb4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c78072640 con 0x7f0c7809e410 2023-10-03T10:14:56.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.276+0000 7f0c77fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0c7809e410 0x7f0c78121b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.276+0000 7f0c77fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0c7809e410 0x7f0c78121b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57694/0 (socket says 172.21.15.72:57694) 2023-10-03T10:14:56.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.276+0000 7f0c77fff700 1 -- 172.21.15.72:0/2375263771 learned_addr learned my addr 172.21.15.72:0/2375263771 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:56.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.276+0000 7f0c777fe700 1 --2- 172.21.15.72:0/2375263771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c7809d6f0 0x7f0c78121110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.276+0000 7f0c77fff700 1 -- 172.21.15.72:0/2375263771 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0c7809e000 msgr2=0x7f0c78121650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.276+0000 7f0c77fff700 1 --2- 172.21.15.72:0/2375263771 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0c7809e000 0x7f0c78121650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.276+0000 7f0c77fff700 1 -- 172.21.15.72:0/2375263771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c7809d6f0 msgr2=0x7f0c78121110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.276+0000 7f0c77fff700 1 --2- 172.21.15.72:0/2375263771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c7809d6f0 0x7f0c78121110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.276+0000 7f0c77fff700 1 -- 172.21.15.72:0/2375263771 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c68009a70 con 0x7f0c7809e410 2023-10-03T10:14:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.277+0000 7f0c77fff700 1 --2- 172.21.15.72:0/2375263771 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0c7809e410 0x7f0c78121b90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c68014040 tx=0x7f0c68004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.277+0000 7f0c6ffff700 1 -- 172.21.15.72:0/2375263771 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68012430 con 0x7f0c7809e410 2023-10-03T10:14:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.277+0000 7f0c6ffff700 1 -- 172.21.15.72:0/2375263771 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c68020070 con 0x7f0c7809e410 2023-10-03T10:14:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.277+0000 7f0c7dfb4700 1 -- 172.21.15.72:0/2375263771 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c781233a0 con 0x7f0c7809e410 2023-10-03T10:14:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.277+0000 7f0c6ffff700 1 -- 172.21.15.72:0/2375263771 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68003ea0 con 0x7f0c7809e410 2023-10-03T10:14:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.277+0000 7f0c7dfb4700 1 -- 172.21.15.72:0/2375263771 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c781224f0 con 0x7f0c7809e410 2023-10-03T10:14:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.278+0000 7f0c6ffff700 1 -- 172.21.15.72:0/2375263771 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c68004280 con 0x7f0c7809e410 2023-10-03T10:14:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.278+0000 7f0c6ffff700 1 -- 172.21.15.72:0/2375263771 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0c68022070 con 0x7f0c7809e410 2023-10-03T10:14:56.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.278+0000 7f0c7dfb4700 1 -- 172.21.15.72:0/2375263771 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c78074ea0 con 0x7f0c7809e410 2023-10-03T10:14:56.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.283+0000 7f0c6ffff700 1 -- 172.21.15.72:0/2375263771 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c680263e0 con 0x7f0c7809e410 2023-10-03T10:14:56.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.439+0000 7fbb4baa4700 1 -- 172.21.15.72:0/2364995969 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbb440747f0 con 0x7fbb4409f330 2023-10-03T10:14:56.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.439+0000 7fbb3a7fc700 1 -- 172.21.15.72:0/2364995969 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb340232f0 con 0x7fbb4409f330 2023-10-03T10:14:56.439 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:56.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.441+0000 7fbb4baa4700 1 -- 172.21.15.72:0/2364995969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb4409f330 msgr2=0x7fbb4411fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.441+0000 7fbb4baa4700 1 --2- 172.21.15.72:0/2364995969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb4409f330 0x7fbb4411fb90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400ebe0 tx=0x7fbb3400eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.441+0000 7fbb4baa4700 1 -- 172.21.15.72:0/2364995969 shutdown_connections 2023-10-03T10:14:56.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.441+0000 7fbb4baa4700 1 --2- 172.21.15.72:0/2364995969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb4409e850 0x7fbb4411f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.441+0000 7fbb4baa4700 1 --2- 172.21.15.72:0/2364995969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb44139370 0x7fbb441c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.441+0000 7fbb4baa4700 1 --2- 172.21.15.72:0/2364995969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb4409f330 0x7fbb4411fb90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.441+0000 7fbb4baa4700 1 -- 172.21.15.72:0/2364995969 >> 172.21.15.72:0/2364995969 conn(0x7fbb440a3f70 msgr2=0x7fbb440710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.441+0000 7fbb4baa4700 1 -- 172.21.15.72:0/2364995969 shutdown_connections 2023-10-03T10:14:56.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.441+0000 7fbb4baa4700 1 -- 172.21.15.72:0/2364995969 wait complete. 2023-10-03T10:14:56.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:56.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.476+0000 7f0c7dfb4700 1 -- 172.21.15.72:0/2375263771 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0c7806c360 con 0x7f0c7809e410 2023-10-03T10:14:56.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.477+0000 7f0c6ffff700 1 -- 172.21.15.72:0/2375263771 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0c6801ab70 con 0x7f0c7809e410 2023-10-03T10:14:56.476 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.479+0000 7f0c7dfb4700 1 -- 172.21.15.72:0/2375263771 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0c7809e410 msgr2=0x7f0c78121b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.479+0000 7f0c7dfb4700 1 --2- 172.21.15.72:0/2375263771 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0c7809e410 0x7f0c78121b90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0c68014040 tx=0x7f0c68004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.479+0000 7f0c7dfb4700 1 -- 172.21.15.72:0/2375263771 shutdown_connections 2023-10-03T10:14:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.479+0000 7f0c7dfb4700 1 --2- 172.21.15.72:0/2375263771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c7809d6f0 0x7f0c78121110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.479+0000 7f0c7dfb4700 1 --2- 172.21.15.72:0/2375263771 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0c7809e410 0x7f0c78121b90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.479+0000 7f0c7dfb4700 1 --2- 172.21.15.72:0/2375263771 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0c7809e000 0x7f0c78121650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.479+0000 7f0c7dfb4700 1 -- 172.21.15.72:0/2375263771 >> 172.21.15.72:0/2375263771 conn(0x7f0c78066f50 msgr2=0x7f0c780a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.479+0000 7f0c7dfb4700 1 -- 172.21.15.72:0/2375263771 shutdown_connections 2023-10-03T10:14:56.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.479+0000 7f0c7dfb4700 1 -- 172.21.15.72:0/2375263771 wait complete. 2023-10-03T10:14:56.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:56.693 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:56.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.816+0000 7f67d4bb5700 1 Processor -- start 2023-10-03T10:14:56.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.816+0000 7f67d4bb5700 1 -- start start 2023-10-03T10:14:56.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.816+0000 7f67d4bb5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f67d009d6f0 0x7f67d009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.816+0000 7f67d4bb5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f67d009e440 0x7f67d0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.816+0000 7f67d4bb5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d009b120 con 0x7f67d009e000 2023-10-03T10:14:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.816+0000 7f67d4bb5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d006b460 con 0x7f67d009d6f0 2023-10-03T10:14:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.816+0000 7f67d4bb5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67d009a7e0 con 0x7f67d009e440 2023-10-03T10:14:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.816+0000 7f67ced9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f67d009e440 0x7f67d0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.816+0000 7f67ce59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f67d009d6f0 0x7f67d009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.816+0000 7f67ced9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f67d009e440 0x7f67d0134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57710/0 (socket says 172.21.15.72:57710) 2023-10-03T10:14:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.816+0000 7f67ced9d700 1 -- 172.21.15.72:0/1431969114 learned_addr learned my addr 172.21.15.72:0/1431969114 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:56.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.817+0000 7f67ced9d700 1 -- 172.21.15.72:0/1431969114 >> v2:172.21.15.72:3300/0 conn(0x7f67d009d6f0 msgr2=0x7f67d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.817+0000 7f67ced9d700 1 --2- 172.21.15.72:0/1431969114 >> v2:172.21.15.72:3300/0 conn(0x7f67d009d6f0 0x7f67d009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.817+0000 7f67ced9d700 1 -- 172.21.15.72:0/1431969114 >> v1:172.21.15.72:6789/0 conn(0x7f67d009e000 legacy=0x7f67d01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.817+0000 7f67ced9d700 1 -- 172.21.15.72:0/1431969114 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d009a500 con 0x7f67d009e440 2023-10-03T10:14:56.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.817+0000 7f67ce59c700 1 --2- 172.21.15.72:0/1431969114 >> v2:172.21.15.72:3300/0 conn(0x7f67d009d6f0 0x7f67d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.817+0000 7f67ced9d700 1 --2- 172.21.15.72:0/1431969114 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f67d009e440 0x7f67d0134100 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009e80 tx=0x7f67c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb6c3f1e719a9df0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.817+0000 7f67cd59a700 1 -- 172.21.15.72:0/1431969114 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c800e070 con 0x7f67d009e440 2023-10-03T10:14:56.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.817+0000 7f67cd59a700 1 -- 172.21.15.72:0/1431969114 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c800b8d0 con 0x7f67d009e440 2023-10-03T10:14:56.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.817+0000 7f67cd59a700 1 -- 172.21.15.72:0/1431969114 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c800bc80 con 0x7f67d009e440 2023-10-03T10:14:56.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.817+0000 7f67d4bb5700 1 -- 172.21.15.72:0/1431969114 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f67d009e440 msgr2=0x7f67d0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.817+0000 7f67d4bb5700 1 --2- 172.21.15.72:0/1431969114 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f67d009e440 0x7f67d0134100 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009e80 tx=0x7f67c800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:56.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.818+0000 7f67d4bb5700 1 -- 172.21.15.72:0/1431969114 shutdown_connections 2023-10-03T10:14:56.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.818+0000 7f67d4bb5700 1 --2- 172.21.15.72:0/1431969114 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f67d009e440 0x7f67d0134100 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.818+0000 7f67d4bb5700 1 --2- 172.21.15.72:0/1431969114 >> v2:172.21.15.72:3300/0 conn(0x7f67d009d6f0 0x7f67d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.818+0000 7f67d4bb5700 1 -- 172.21.15.72:0/1431969114 >> 172.21.15.72:0/1431969114 conn(0x7f67d0066f50 msgr2=0x7f67d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.818+0000 7f67d4bb5700 1 -- 172.21.15.72:0/1431969114 shutdown_connections 2023-10-03T10:14:56.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.818+0000 7f67d4bb5700 1 -- 172.21.15.72:0/1431969114 wait complete. 2023-10-03T10:14:56.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.819+0000 7f67d4bb5700 1 Processor -- start 2023-10-03T10:14:56.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.819+0000 7f67d4bb5700 1 -- start start 2023-10-03T10:14:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67d4bb5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f67d009d6f0 0x7f67d01a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67d4bb5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f67d009e000 0x7f67d01a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67d4bb5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67d009e440 0x7f67d01a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67d4bb5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d01aa360 con 0x7f67d009e440 2023-10-03T10:14:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67d4bb5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d01a99a0 con 0x7f67d009e000 2023-10-03T10:14:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67d4bb5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67d01a8ce0 con 0x7f67d009d6f0 2023-10-03T10:14:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67ce59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f67d009d6f0 0x7f67d01a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67ce59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f67d009d6f0 0x7f67d01a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57722/0 (socket says 172.21.15.72:57722) 2023-10-03T10:14:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67ce59c700 1 -- 172.21.15.72:0/4154172005 learned_addr learned my addr 172.21.15.72:0/4154172005 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:56.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67cdd9b700 1 --2- 172.21.15.72:0/4154172005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f67d009e000 0x7f67d01a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67ced9d700 1 --2- 172.21.15.72:0/4154172005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67d009e440 0x7f67d01a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67ce59c700 1 -- 172.21.15.72:0/4154172005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f67d009e000 msgr2=0x7f67d01a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67ce59c700 1 --2- 172.21.15.72:0/4154172005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f67d009e000 0x7f67d01a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67ce59c700 1 -- 172.21.15.72:0/4154172005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67d009e440 msgr2=0x7f67d01a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67ce59c700 1 --2- 172.21.15.72:0/4154172005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67d009e440 0x7f67d01a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67ce59c700 1 -- 172.21.15.72:0/4154172005 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c00094a0 con 0x7f67d009d6f0 2023-10-03T10:14:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67ce59c700 1 --2- 172.21.15.72:0/4154172005 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f67d009d6f0 0x7f67d01a5ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f67c000ec10 tx=0x7f67c000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67beffd700 1 -- 172.21.15.72:0/4154172005 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c000c850 con 0x7f67d009d6f0 2023-10-03T10:14:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67beffd700 1 -- 172.21.15.72:0/4154172005 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c000c9b0 con 0x7f67d009d6f0 2023-10-03T10:14:56.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.820+0000 7f67d4bb5700 1 -- 172.21.15.72:0/4154172005 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c8009b30 con 0x7f67d009d6f0 2023-10-03T10:14:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.821+0000 7f67beffd700 1 -- 172.21.15.72:0/4154172005 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c000cd20 con 0x7f67d009d6f0 2023-10-03T10:14:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.821+0000 7f67d4bb5700 1 -- 172.21.15.72:0/4154172005 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d01a7a90 con 0x7f67d009d6f0 2023-10-03T10:14:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.821+0000 7f67beffd700 1 -- 172.21.15.72:0/4154172005 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67c0013470 con 0x7f67d009d6f0 2023-10-03T10:14:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.821+0000 7f67beffd700 1 -- 172.21.15.72:0/4154172005 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f67c003fb60 con 0x7f67d009d6f0 2023-10-03T10:14:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.821+0000 7f67d4bb5700 1 -- 172.21.15.72:0/4154172005 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d01a9540 con 0x7f67d009d6f0 2023-10-03T10:14:56.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:56.826+0000 7f67beffd700 1 -- 172.21.15.72:0/4154172005 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67c0021080 con 0x7f67d009d6f0 2023-10-03T10:14:57.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.011+0000 7f67d4bb5700 1 -- 172.21.15.72:0/4154172005 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f67d009f420 con 0x7f67d009d6f0 2023-10-03T10:14:57.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.011+0000 7f67beffd700 1 -- 172.21.15.72:0/4154172005 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f67c000ce80 con 0x7f67d009d6f0 2023-10-03T10:14:57.011 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:57.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.013+0000 7f67d4bb5700 1 -- 172.21.15.72:0/4154172005 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f67d009d6f0 msgr2=0x7f67d01a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.013+0000 7f67d4bb5700 1 --2- 172.21.15.72:0/4154172005 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f67d009d6f0 0x7f67d01a5ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f67c000ec10 tx=0x7f67c000ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:57.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.013+0000 7f67d4bb5700 1 -- 172.21.15.72:0/4154172005 shutdown_connections 2023-10-03T10:14:57.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.013+0000 7f67d4bb5700 1 --2- 172.21.15.72:0/4154172005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67d009e440 0x7f67d01a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.013+0000 7f67d4bb5700 1 --2- 172.21.15.72:0/4154172005 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f67d009d6f0 0x7f67d01a5ed0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.013+0000 7f67d4bb5700 1 --2- 172.21.15.72:0/4154172005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f67d009e000 0x7f67d01a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.013+0000 7f67d4bb5700 1 -- 172.21.15.72:0/4154172005 >> 172.21.15.72:0/4154172005 conn(0x7f67d0066f50 msgr2=0x7f67d01baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.013+0000 7f67d4bb5700 1 -- 172.21.15.72:0/4154172005 shutdown_connections 2023-10-03T10:14:57.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.013+0000 7f67d4bb5700 1 -- 172.21.15.72:0/4154172005 wait complete. 2023-10-03T10:14:57.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:57.263 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:57.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.385+0000 7fd6ef65f700 1 Processor -- start 2023-10-03T10:14:57.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.385+0000 7fd6ef65f700 1 -- start start 2023-10-03T10:14:57.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6ef65f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6e80a0a30 0x7fd6e80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6ef65f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6e8134170 0x7fd6e813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6ef65f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e809edd0 con 0x7fd6e80a1340 2023-10-03T10:14:57.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6ef65f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e809e1f0 con 0x7fd6e80a0a30 2023-10-03T10:14:57.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6ef65f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e809dc50 con 0x7fd6e8134170 2023-10-03T10:14:57.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6ed3fb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6e80a0a30 0x7fd6e80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6edbfc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6e8134170 0x7fd6e813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6ecbfa700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd6e80a1340 0x7fd6e8133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51664/0 (socket says 172.21.15.72:51664) 2023-10-03T10:14:57.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6ecbfa700 1 -- 172.21.15.72:0/4016830781 learned_addr learned my addr 172.21.15.72:0/4016830781 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:14:57.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6dffff700 1 -- 172.21.15.72:0/4016830781 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822011844 0 0) 0x7fd6e809edd0 con 0x7fd6e80a1340 2023-10-03T10:14:57.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6ed3fb700 1 -- 172.21.15.72:0/4016830781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6e8134170 msgr2=0x7fd6e813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:57.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6ed3fb700 1 --2- 172.21.15.72:0/4016830781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6e8134170 0x7fd6e813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6ed3fb700 1 -- 172.21.15.72:0/4016830781 >> v1:172.21.15.72:6789/0 conn(0x7fd6e80a1340 legacy=0x7fd6e8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6ed3fb700 1 -- 172.21.15.72:0/4016830781 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e80a1fe0 con 0x7fd6e80a0a30 2023-10-03T10:14:57.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6edbfc700 1 --2- 172.21.15.72:0/4016830781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6e8134170 0x7fd6e813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:57.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6ed3fb700 1 --2- 172.21.15.72:0/4016830781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6e80a0a30 0x7fd6e80a0e00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009870 tx=0x7fd6d8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81bbff1cb3e5a45b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6dffff700 1 -- 172.21.15.72:0/4016830781 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8011830 con 0x7fd6e80a0a30 2023-10-03T10:14:57.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6dffff700 1 -- 172.21.15.72:0/4016830781 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d8011990 con 0x7fd6e80a0a30 2023-10-03T10:14:57.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.386+0000 7fd6dffff700 1 -- 172.21.15.72:0/4016830781 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8011d20 con 0x7fd6e80a0a30 2023-10-03T10:14:57.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.387+0000 7fd6ef65f700 1 -- 172.21.15.72:0/4016830781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6e80a0a30 msgr2=0x7fd6e80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.387+0000 7fd6ef65f700 1 --2- 172.21.15.72:0/4016830781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6e80a0a30 0x7fd6e80a0e00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009870 tx=0x7fd6d8009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:57.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.387+0000 7fd6ef65f700 1 -- 172.21.15.72:0/4016830781 shutdown_connections 2023-10-03T10:14:57.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.387+0000 7fd6ef65f700 1 --2- 172.21.15.72:0/4016830781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6e8134170 0x7fd6e813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.387+0000 7fd6ef65f700 1 --2- 172.21.15.72:0/4016830781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6e80a0a30 0x7fd6e80a0e00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.387+0000 7fd6ef65f700 1 -- 172.21.15.72:0/4016830781 >> 172.21.15.72:0/4016830781 conn(0x7fd6e80a6550 msgr2=0x7fd6e80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.387+0000 7fd6ef65f700 1 -- 172.21.15.72:0/4016830781 shutdown_connections 2023-10-03T10:14:57.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.387+0000 7fd6ef65f700 1 -- 172.21.15.72:0/4016830781 wait complete. 2023-10-03T10:14:57.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.388+0000 7fd6ef65f700 1 Processor -- start 2023-10-03T10:14:57.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.388+0000 7fd6ef65f700 1 -- start start 2023-10-03T10:14:57.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.388+0000 7fd6ef65f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6e80a0a30 0x7fd6e81c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.388+0000 7fd6ef65f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6e80a1340 0x7fd6e81c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.388+0000 7fd6ef65f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6e8134170 0x7fd6e81c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.388+0000 7fd6ef65f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e8126440 con 0x7fd6e80a1340 2023-10-03T10:14:57.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.388+0000 7fd6ef65f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e81246d0 con 0x7fd6e8134170 2023-10-03T10:14:57.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.388+0000 7fd6ef65f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e81244a0 con 0x7fd6e80a0a30 2023-10-03T10:14:57.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ecbfa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6e80a1340 0x7fd6e81c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ecbfa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6e80a1340 0x7fd6e81c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56810/0 (socket says 172.21.15.72:56810) 2023-10-03T10:14:57.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ecbfa700 1 -- 172.21.15.72:0/2509921785 learned_addr learned my addr 172.21.15.72:0/2509921785 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:57.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ed3fb700 1 --2- 172.21.15.72:0/2509921785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6e80a0a30 0x7fd6e81c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6edbfc700 1 --2- 172.21.15.72:0/2509921785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6e8134170 0x7fd6e81c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ed3fb700 1 -- 172.21.15.72:0/2509921785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6e8134170 msgr2=0x7fd6e81c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ed3fb700 1 --2- 172.21.15.72:0/2509921785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6e8134170 0x7fd6e81c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ed3fb700 1 -- 172.21.15.72:0/2509921785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6e80a1340 msgr2=0x7fd6e81c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ed3fb700 1 --2- 172.21.15.72:0/2509921785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6e80a1340 0x7fd6e81c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ed3fb700 1 -- 172.21.15.72:0/2509921785 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e0009a70 con 0x7fd6e80a0a30 2023-10-03T10:14:57.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ecbfa700 1 --2- 172.21.15.72:0/2509921785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6e80a1340 0x7fd6e81c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:57.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ed3fb700 1 --2- 172.21.15.72:0/2509921785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6e80a0a30 0x7fd6e81c8450 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8016000 tx=0x7fd6d8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ddffb700 1 -- 172.21.15.72:0/2509921785 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d80044d0 con 0x7fd6e80a0a30 2023-10-03T10:14:57.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ddffb700 1 -- 172.21.15.72:0/2509921785 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d801f070 con 0x7fd6e80a0a30 2023-10-03T10:14:57.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ef65f700 1 -- 172.21.15.72:0/2509921785 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d80094a0 con 0x7fd6e80a0a30 2023-10-03T10:14:57.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ddffb700 1 -- 172.21.15.72:0/2509921785 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d80038c0 con 0x7fd6e80a0a30 2023-10-03T10:14:57.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.389+0000 7fd6ef65f700 1 -- 172.21.15.72:0/2509921785 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e80a25e0 con 0x7fd6e80a0a30 2023-10-03T10:14:57.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.390+0000 7fd6ddffb700 1 -- 172.21.15.72:0/2509921785 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6d8003a20 con 0x7fd6e80a0a30 2023-10-03T10:14:57.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.390+0000 7fd6ef65f700 1 -- 172.21.15.72:0/2509921785 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e8126260 con 0x7fd6e80a0a30 2023-10-03T10:14:57.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.390+0000 7fd6ddffb700 1 -- 172.21.15.72:0/2509921785 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd6d8021070 con 0x7fd6e80a0a30 2023-10-03T10:14:57.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.395+0000 7fd6ddffb700 1 -- 172.21.15.72:0/2509921785 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6d8010d50 con 0x7fd6e80a0a30 2023-10-03T10:14:57.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:57.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:57.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.581+0000 7f276e7e2700 1 Processor -- start 2023-10-03T10:14:57.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.581+0000 7f276e7e2700 1 -- start start 2023-10-03T10:14:57.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.582+0000 7f276e7e2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27681337f0 0x7f2768138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.582+0000 7f276e7e2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2768138dc0 0x7f276813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.582+0000 7f276e7e2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276806b990 con 0x7f2768133420 2023-10-03T10:14:57.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.582+0000 7f276e7e2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276809b0e0 con 0x7f2768138dc0 2023-10-03T10:14:57.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.582+0000 7f276e7e2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2768133c20 con 0x7f27681337f0 2023-10-03T10:14:57.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.582+0000 7f27677fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27681337f0 0x7f2768138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.582+0000 7f27677fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27681337f0 0x7f2768138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57740/0 (socket says 172.21.15.72:57740) 2023-10-03T10:14:57.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.582+0000 7f27677fe700 1 -- 172.21.15.72:0/1488113226 learned_addr learned my addr 172.21.15.72:0/1488113226 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:57.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.582+0000 7f276cd7f700 1 --2- 172.21.15.72:0/1488113226 >> v2:172.21.15.72:3300/0 conn(0x7f2768138dc0 0x7f276813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.582+0000 7f27677fe700 1 -- 172.21.15.72:0/1488113226 >> v2:172.21.15.72:3300/0 conn(0x7f2768138dc0 msgr2=0x7f276813b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:57.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.582+0000 7f27677fe700 1 --2- 172.21.15.72:0/1488113226 >> v2:172.21.15.72:3300/0 conn(0x7f2768138dc0 0x7f276813b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.582+0000 7f27677fe700 1 -- 172.21.15.72:0/1488113226 >> v1:172.21.15.72:6789/0 conn(0x7f2768133420 legacy=0x7f2768133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.582+0000 7f27677fe700 1 -- 172.21.15.72:0/1488113226 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27680a0590 con 0x7f27681337f0 2023-10-03T10:14:57.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.582+0000 7f276cd7f700 1 --2- 172.21.15.72:0/1488113226 >> v2:172.21.15.72:3300/0 conn(0x7f2768138dc0 0x7f276813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:57.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.582+0000 7f27677fe700 1 --2- 172.21.15.72:0/1488113226 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27681337f0 0x7f2768138880 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f275c0098f0 tx=0x7f275c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d11af7093e3f98c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.583+0000 7f2766ffd700 1 -- 172.21.15.72:0/1488113226 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c011830 con 0x7f27681337f0 2023-10-03T10:14:57.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.583+0000 7f2766ffd700 1 -- 172.21.15.72:0/1488113226 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c011990 con 0x7f27681337f0 2023-10-03T10:14:57.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.583+0000 7f2766ffd700 1 -- 172.21.15.72:0/1488113226 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c011d20 con 0x7f27681337f0 2023-10-03T10:14:57.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.583+0000 7f276e7e2700 1 -- 172.21.15.72:0/1488113226 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27681337f0 msgr2=0x7f2768138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.583+0000 7f276e7e2700 1 --2- 172.21.15.72:0/1488113226 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27681337f0 0x7f2768138880 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f275c0098f0 tx=0x7f275c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:57.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.583+0000 7f276e7e2700 1 -- 172.21.15.72:0/1488113226 shutdown_connections 2023-10-03T10:14:57.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.583+0000 7f276e7e2700 1 --2- 172.21.15.72:0/1488113226 >> v2:172.21.15.72:3300/0 conn(0x7f2768138dc0 0x7f276813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.583+0000 7f276e7e2700 1 --2- 172.21.15.72:0/1488113226 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27681337f0 0x7f2768138880 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.583+0000 7f276e7e2700 1 -- 172.21.15.72:0/1488113226 >> 172.21.15.72:0/1488113226 conn(0x7f27680a4210 msgr2=0x7f27680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.583+0000 7f276e7e2700 1 -- 172.21.15.72:0/1488113226 shutdown_connections 2023-10-03T10:14:57.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.583+0000 7f276e7e2700 1 -- 172.21.15.72:0/1488113226 wait complete. 2023-10-03T10:14:57.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.584+0000 7f276e7e2700 1 Processor -- start 2023-10-03T10:14:57.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.584+0000 7f276e7e2700 1 -- start start 2023-10-03T10:14:57.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f276e7e2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2768133420 0x7f27680709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f276e7e2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27681337f0 0x7f2768070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f276e7e2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2768138dc0 0x7f2768071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f276e7e2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276809ca90 con 0x7f27681337f0 2023-10-03T10:14:57.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f276e7e2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276809d640 con 0x7f2768133420 2023-10-03T10:14:57.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f276e7e2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f276809c7d0 con 0x7f2768138dc0 2023-10-03T10:14:57.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f2767fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2768133420 0x7f27680709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f2767fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2768133420 0x7f27680709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46920/0 (socket says 172.21.15.72:46920) 2023-10-03T10:14:57.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f2767fff700 1 -- 172.21.15.72:0/82392671 learned_addr learned my addr 172.21.15.72:0/82392671 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:57.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f27677fe700 1 --2- 172.21.15.72:0/82392671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27681337f0 0x7f2768070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f276cd7f700 1 --2- 172.21.15.72:0/82392671 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2768138dc0 0x7f2768071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f2767fff700 1 -- 172.21.15.72:0/82392671 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2768138dc0 msgr2=0x7f2768071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f2767fff700 1 --2- 172.21.15.72:0/82392671 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2768138dc0 0x7f2768071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f2767fff700 1 -- 172.21.15.72:0/82392671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27681337f0 msgr2=0x7f2768070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f2767fff700 1 --2- 172.21.15.72:0/82392671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27681337f0 0x7f2768070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f2767fff700 1 -- 172.21.15.72:0/82392671 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2760009a70 con 0x7f2768133420 2023-10-03T10:14:57.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.585+0000 7f27677fe700 1 --2- 172.21.15.72:0/82392671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27681337f0 0x7f2768070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:57.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.586+0000 7f2767fff700 1 --2- 172.21.15.72:0/82392671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2768133420 0x7f27680709a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f275800c4e0 tx=0x7f275800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.586+0000 7f2764ff9700 1 -- 172.21.15.72:0/82392671 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27580052d0 con 0x7f2768133420 2023-10-03T10:14:57.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.586+0000 7f2764ff9700 1 -- 172.21.15.72:0/82392671 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2758005430 con 0x7f2768133420 2023-10-03T10:14:57.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.586+0000 7f2764ff9700 1 -- 172.21.15.72:0/82392671 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27580038c0 con 0x7f2768133420 2023-10-03T10:14:57.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.586+0000 7f276e7e2700 1 -- 172.21.15.72:0/82392671 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275c009550 con 0x7f2768133420 2023-10-03T10:14:57.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.586+0000 7f276e7e2700 1 -- 172.21.15.72:0/82392671 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27680724f0 con 0x7f2768133420 2023-10-03T10:14:57.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.587+0000 7f2764ff9700 1 -- 172.21.15.72:0/82392671 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2758003a20 con 0x7f2768133420 2023-10-03T10:14:57.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.587+0000 7f2764ff9700 1 -- 172.21.15.72:0/82392671 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f275803eb70 con 0x7f2768133420 2023-10-03T10:14:57.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.587+0000 7f276e7e2700 1 -- 172.21.15.72:0/82392671 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276809cbe0 con 0x7f2768133420 2023-10-03T10:14:57.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.596+0000 7f2764ff9700 1 -- 172.21.15.72:0/82392671 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2758017080 con 0x7f2768133420 2023-10-03T10:14:57.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.596+0000 7fd6ef65f700 1 -- 172.21.15.72:0/2509921785 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd6e809c7e0 con 0x7fd6e80a0a30 2023-10-03T10:14:57.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.597+0000 7fd6ddffb700 1 -- 172.21.15.72:0/2509921785 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd6d8015020 con 0x7fd6e80a0a30 2023-10-03T10:14:57.596 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.599+0000 7fd6ef65f700 1 -- 172.21.15.72:0/2509921785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6e80a0a30 msgr2=0x7fd6e81c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.599+0000 7fd6ef65f700 1 --2- 172.21.15.72:0/2509921785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6e80a0a30 0x7fd6e81c8450 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8016000 tx=0x7fd6d8004750 comp rx=0 tx=0).stop 2023-10-03T10:14:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.599+0000 7fd6ef65f700 1 -- 172.21.15.72:0/2509921785 shutdown_connections 2023-10-03T10:14:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.599+0000 7fd6ef65f700 1 --2- 172.21.15.72:0/2509921785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6e8134170 0x7fd6e81c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.599+0000 7fd6ef65f700 1 --2- 172.21.15.72:0/2509921785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6e80a0a30 0x7fd6e81c8450 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.599+0000 7fd6ef65f700 1 --2- 172.21.15.72:0/2509921785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6e80a1340 0x7fd6e81c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.599+0000 7fd6ef65f700 1 -- 172.21.15.72:0/2509921785 >> 172.21.15.72:0/2509921785 conn(0x7fd6e80a6550 msgr2=0x7fd6e809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.599+0000 7fd6ef65f700 1 -- 172.21.15.72:0/2509921785 shutdown_connections 2023-10-03T10:14:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.599+0000 7fd6ef65f700 1 -- 172.21.15.72:0/2509921785 wait complete. 2023-10-03T10:14:57.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.625+0000 7f98a969f700 1 Processor -- start 2023-10-03T10:14:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.625+0000 7f98a969f700 1 -- start start 2023-10-03T10:14:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a969f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a41338c0 0x7f98a4133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a969f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98a41341d0 0x7f98a409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a969f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e390 0x7f98a409e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a969f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a4070c80 con 0x7f98a41341d0 2023-10-03T10:14:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a969f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a409ed20 con 0x7f98a41338c0 2023-10-03T10:14:57.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a969f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98a406f720 con 0x7f98a409e390 2023-10-03T10:14:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e390 0x7f98a409e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a41338c0 0x7f98a4133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a41338c0 0x7f98a4133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46928/0 (socket says 172.21.15.72:46928) 2023-10-03T10:14:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e390 0x7f98a409e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57770/0 (socket says 172.21.15.72:57770) 2023-10-03T10:14:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a27fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98a41341d0 0x7f98a409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a2ffd700 1 -- 172.21.15.72:0/4189631003 learned_addr learned my addr 172.21.15.72:0/4189631003 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a2ffd700 1 -- 172.21.15.72:0/4189631003 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e390 msgr2=0x7f98a409e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a2ffd700 1 --2- 172.21.15.72:0/4189631003 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e390 0x7f98a409e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a2ffd700 1 -- 172.21.15.72:0/4189631003 >> v2:172.21.15.72:3300/0 conn(0x7f98a41341d0 msgr2=0x7f98a409de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a2ffd700 1 --2- 172.21.15.72:0/4189631003 >> v2:172.21.15.72:3300/0 conn(0x7f98a41341d0 0x7f98a409de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a2ffd700 1 -- 172.21.15.72:0/4189631003 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a406fce0 con 0x7f98a41338c0 2023-10-03T10:14:57.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a37fe700 1 --2- 172.21.15.72:0/4189631003 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e390 0x7f98a409e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a27fc700 1 --2- 172.21.15.72:0/4189631003 >> v2:172.21.15.72:3300/0 conn(0x7f98a41341d0 0x7f98a409de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a2ffd700 1 --2- 172.21.15.72:0/4189631003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a41338c0 0x7f98a4133c90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9898009920 tx=0x7f9898009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4c57ff9b19660d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a1ffb700 1 -- 172.21.15.72:0/4189631003 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898011830 con 0x7f98a41338c0 2023-10-03T10:14:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a1ffb700 1 -- 172.21.15.72:0/4189631003 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9898011990 con 0x7f98a41338c0 2023-10-03T10:14:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.626+0000 7f98a1ffb700 1 -- 172.21.15.72:0/4189631003 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898011d20 con 0x7f98a41338c0 2023-10-03T10:14:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.627+0000 7f98a969f700 1 -- 172.21.15.72:0/4189631003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a41338c0 msgr2=0x7f98a4133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.627+0000 7f98a969f700 1 --2- 172.21.15.72:0/4189631003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a41338c0 0x7f98a4133c90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9898009920 tx=0x7f9898009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.627+0000 7f98a969f700 1 -- 172.21.15.72:0/4189631003 shutdown_connections 2023-10-03T10:14:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.627+0000 7f98a969f700 1 --2- 172.21.15.72:0/4189631003 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e390 0x7f98a409e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.627+0000 7f98a969f700 1 --2- 172.21.15.72:0/4189631003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a41338c0 0x7f98a4133c90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.627+0000 7f98a969f700 1 --2- 172.21.15.72:0/4189631003 >> v2:172.21.15.72:3300/0 conn(0x7f98a41341d0 0x7f98a409de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.627+0000 7f98a969f700 1 -- 172.21.15.72:0/4189631003 >> 172.21.15.72:0/4189631003 conn(0x7f98a40a2aa0 msgr2=0x7f98a40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.627+0000 7f98a969f700 1 -- 172.21.15.72:0/4189631003 shutdown_connections 2023-10-03T10:14:57.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.627+0000 7f98a969f700 1 -- 172.21.15.72:0/4189631003 wait complete. 2023-10-03T10:14:57.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.628+0000 7f98a969f700 1 Processor -- start 2023-10-03T10:14:57.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.628+0000 7f98a969f700 1 -- start start 2023-10-03T10:14:57.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.628+0000 7f98a969f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a409e390 0x7f98a411e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.628+0000 7f98a969f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a41338c0 0x7f98a411ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.628+0000 7f98a969f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a41341d0 0x7f98a411f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.628+0000 7f98a969f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a4121460 con 0x7f98a41338c0 2023-10-03T10:14:57.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.628+0000 7f98a969f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a4130d20 con 0x7f98a409e390 2023-10-03T10:14:57.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.628+0000 7f98a969f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98a406f960 con 0x7f98a41341d0 2023-10-03T10:14:57.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f98a2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a409e390 0x7f98a411e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f98a37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a41341d0 0x7f98a411f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f98a2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a409e390 0x7f98a411e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46938/0 (socket says 172.21.15.72:46938) 2023-10-03T10:14:57.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f98a2ffd700 1 -- 172.21.15.72:0/4032317026 learned_addr learned my addr 172.21.15.72:0/4032317026 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:57.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f98a27fc700 1 --2- 172.21.15.72:0/4032317026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a41338c0 0x7f98a411ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f98a2ffd700 1 -- 172.21.15.72:0/4032317026 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a41341d0 msgr2=0x7f98a411f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f98a2ffd700 1 --2- 172.21.15.72:0/4032317026 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a41341d0 0x7f98a411f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f98a2ffd700 1 -- 172.21.15.72:0/4032317026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a41338c0 msgr2=0x7f98a411ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f98a2ffd700 1 --2- 172.21.15.72:0/4032317026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a41338c0 0x7f98a411ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f98a2ffd700 1 -- 172.21.15.72:0/4032317026 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c009a70 con 0x7f98a409e390 2023-10-03T10:14:57.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f98a2ffd700 1 --2- 172.21.15.72:0/4032317026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a409e390 0x7f98a411e9d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f98980098f0 tx=0x7f9898004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f988b7fe700 1 -- 172.21.15.72:0/4032317026 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898004240 con 0x7f98a409e390 2023-10-03T10:14:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f988b7fe700 1 -- 172.21.15.72:0/4032317026 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989801f070 con 0x7f98a409e390 2023-10-03T10:14:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f988b7fe700 1 -- 172.21.15.72:0/4032317026 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98980045e0 con 0x7f98a409e390 2023-10-03T10:14:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f98a969f700 1 -- 172.21.15.72:0/4032317026 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98940094a0 con 0x7f98a409e390 2023-10-03T10:14:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.629+0000 7f98a969f700 1 -- 172.21.15.72:0/4032317026 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9898009550 con 0x7f98a409e390 2023-10-03T10:14:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.630+0000 7f988b7fe700 1 -- 172.21.15.72:0/4032317026 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9898021030 con 0x7f98a409e390 2023-10-03T10:14:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.630+0000 7f988b7fe700 1 -- 172.21.15.72:0/4032317026 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f98980407c0 con 0x7f98a409e390 2023-10-03T10:14:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.630+0000 7f98a969f700 1 -- 172.21.15.72:0/4032317026 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a4074ea0 con 0x7f98a409e390 2023-10-03T10:14:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.635+0000 7f988b7fe700 1 -- 172.21.15.72:0/4032317026 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f989801a450 con 0x7f98a409e390 2023-10-03T10:14:57.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.790+0000 7f276e7e2700 1 -- 172.21.15.72:0/82392671 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2768074ea0 con 0x7f2768133420 2023-10-03T10:14:57.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.790+0000 7f2764ff9700 1 -- 172.21.15.72:0/82392671 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2758018260 con 0x7f2768133420 2023-10-03T10:14:57.790 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:57.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.792+0000 7f276e7e2700 1 -- 172.21.15.72:0/82392671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2768133420 msgr2=0x7f27680709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.792+0000 7f276e7e2700 1 --2- 172.21.15.72:0/82392671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2768133420 0x7f27680709a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f275800c4e0 tx=0x7f275800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.792+0000 7f276e7e2700 1 -- 172.21.15.72:0/82392671 shutdown_connections 2023-10-03T10:14:57.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.792+0000 7f276e7e2700 1 --2- 172.21.15.72:0/82392671 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2768138dc0 0x7f2768071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.792+0000 7f276e7e2700 1 --2- 172.21.15.72:0/82392671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2768133420 0x7f27680709a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.792+0000 7f276e7e2700 1 --2- 172.21.15.72:0/82392671 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27681337f0 0x7f2768070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.792+0000 7f276e7e2700 1 -- 172.21.15.72:0/82392671 >> 172.21.15.72:0/82392671 conn(0x7f27680a4210 msgr2=0x7f2768131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.792+0000 7f276e7e2700 1 -- 172.21.15.72:0/82392671 shutdown_connections 2023-10-03T10:14:57.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.792+0000 7f276e7e2700 1 -- 172.21.15.72:0/82392671 wait complete. 2023-10-03T10:14:57.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:57.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.828+0000 7f98a969f700 1 -- 172.21.15.72:0/4032317026 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f98a406b9e0 con 0x7f98a409e390 2023-10-03T10:14:57.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.829+0000 7f988b7fe700 1 -- 172.21.15.72:0/4032317026 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f98980233d0 con 0x7f98a409e390 2023-10-03T10:14:57.828 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:57.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.831+0000 7f98a969f700 1 -- 172.21.15.72:0/4032317026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a409e390 msgr2=0x7f98a411e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.831+0000 7f98a969f700 1 --2- 172.21.15.72:0/4032317026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a409e390 0x7f98a411e9d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f98980098f0 tx=0x7f9898004750 comp rx=0 tx=0).stop 2023-10-03T10:14:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.831+0000 7f98a969f700 1 -- 172.21.15.72:0/4032317026 shutdown_connections 2023-10-03T10:14:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.831+0000 7f98a969f700 1 --2- 172.21.15.72:0/4032317026 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a41341d0 0x7f98a411f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.831+0000 7f98a969f700 1 --2- 172.21.15.72:0/4032317026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a409e390 0x7f98a411e9d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.831+0000 7f98a969f700 1 --2- 172.21.15.72:0/4032317026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a41338c0 0x7f98a411ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.831+0000 7f98a969f700 1 -- 172.21.15.72:0/4032317026 >> 172.21.15.72:0/4032317026 conn(0x7f98a40a2aa0 msgr2=0x7f98a409f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.831+0000 7f98a969f700 1 -- 172.21.15.72:0/4032317026 shutdown_connections 2023-10-03T10:14:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:57.831+0000 7f98a969f700 1 -- 172.21.15.72:0/4032317026 wait complete. 2023-10-03T10:14:57.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:58.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:58.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.148+0000 7fb0e1ad0700 1 Processor -- start 2023-10-03T10:14:58.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.148+0000 7fb0e1ad0700 1 -- start start 2023-10-03T10:14:58.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.148+0000 7fb0e1ad0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0dc09e930 0x7fb0dc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0e1ad0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0dc09f650 0x7fb0dc131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0e1ad0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0dc070940 con 0x7fb0dc09f240 2023-10-03T10:14:58.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0e1ad0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0dc06fd60 con 0x7fb0dc09f650 2023-10-03T10:14:58.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0e1ad0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc06fa80 con 0x7fb0dc09e930 2023-10-03T10:14:58.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0db7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0dc09e930 0x7fb0dc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0dbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0dc09f650 0x7fb0dc131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0dbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0dc09f650 0x7fb0dc131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56868/0 (socket says 172.21.15.72:56868) 2023-10-03T10:14:58.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0db7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0dc09e930 0x7fb0dc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:57788/0 (socket says 172.21.15.72:57788) 2023-10-03T10:14:58.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0dbfff700 1 -- 172.21.15.72:0/2587867822 learned_addr learned my addr 172.21.15.72:0/2587867822 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:58.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0dbfff700 1 -- 172.21.15.72:0/2587867822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0dc09e930 msgr2=0x7fb0dc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0dbfff700 1 --2- 172.21.15.72:0/2587867822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0dc09e930 0x7fb0dc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0dbfff700 1 -- 172.21.15.72:0/2587867822 >> v1:172.21.15.72:6789/0 conn(0x7fb0dc09f240 legacy=0x7fb0dc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0dbfff700 1 -- 172.21.15.72:0/2587867822 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc09fb60 con 0x7fb0dc09f650 2023-10-03T10:14:58.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0dbfff700 1 --2- 172.21.15.72:0/2587867822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0dc09f650 0x7fb0dc131f00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009e50 tx=0x7fb0d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8caffdd7b9c702a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0da7fc700 1 -- 172.21.15.72:0/2587867822 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d400e070 con 0x7fb0dc09f650 2023-10-03T10:14:58.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0da7fc700 1 -- 172.21.15.72:0/2587867822 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d400b910 con 0x7fb0dc09f650 2023-10-03T10:14:58.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.149+0000 7fb0da7fc700 1 -- 172.21.15.72:0/2587867822 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d400bcc0 con 0x7fb0dc09f650 2023-10-03T10:14:58.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.150+0000 7fb0e1ad0700 1 -- 172.21.15.72:0/2587867822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0dc09f650 msgr2=0x7fb0dc131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.150+0000 7fb0e1ad0700 1 --2- 172.21.15.72:0/2587867822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0dc09f650 0x7fb0dc131f00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009e50 tx=0x7fb0d400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:58.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.150+0000 7fb0e1ad0700 1 -- 172.21.15.72:0/2587867822 shutdown_connections 2023-10-03T10:14:58.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.150+0000 7fb0e1ad0700 1 --2- 172.21.15.72:0/2587867822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0dc09f650 0x7fb0dc131f00 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.150+0000 7fb0e1ad0700 1 --2- 172.21.15.72:0/2587867822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0dc09e930 0x7fb0dc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.150+0000 7fb0e1ad0700 1 -- 172.21.15.72:0/2587867822 >> 172.21.15.72:0/2587867822 conn(0x7fb0dc0a4210 msgr2=0x7fb0dc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.150+0000 7fb0e1ad0700 1 -- 172.21.15.72:0/2587867822 shutdown_connections 2023-10-03T10:14:58.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.150+0000 7fb0e1ad0700 1 -- 172.21.15.72:0/2587867822 wait complete. 2023-10-03T10:14:58.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.151+0000 7fb0e1ad0700 1 Processor -- start 2023-10-03T10:14:58.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.151+0000 7fb0e1ad0700 1 -- start start 2023-10-03T10:14:58.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.151+0000 7fb0e1ad0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0dc09e930 0x7fb0dc1a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.151+0000 7fb0e1ad0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0dc09f240 0x7fb0dc1a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.151+0000 7fb0e1ad0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0dc09f650 0x7fb0dc1a2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.151+0000 7fb0e1ad0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc1a5730 con 0x7fb0dc09e930 2023-10-03T10:14:58.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.151+0000 7fb0e1ad0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc1a3e40 con 0x7fb0dc09f650 2023-10-03T10:14:58.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.151+0000 7fb0e1ad0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc1a4b00 con 0x7fb0dc09f240 2023-10-03T10:14:58.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.151+0000 7fb0db7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0dc09e930 0x7fb0dc1a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0db7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0dc09e930 0x7fb0dc1a1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:56878/0 (socket says 172.21.15.72:56878) 2023-10-03T10:14:58.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0db7fe700 1 -- 172.21.15.72:0/2424101787 learned_addr learned my addr 172.21.15.72:0/2424101787 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:58.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0daffd700 1 --2- 172.21.15.72:0/2424101787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0dc09f240 0x7fb0dc1a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0dbfff700 1 --2- 172.21.15.72:0/2424101787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0dc09f650 0x7fb0dc1a2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0db7fe700 1 -- 172.21.15.72:0/2424101787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0dc09f240 msgr2=0x7fb0dc1a2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0db7fe700 1 --2- 172.21.15.72:0/2424101787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0dc09f240 0x7fb0dc1a2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0db7fe700 1 -- 172.21.15.72:0/2424101787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0dc09f650 msgr2=0x7fb0dc1a2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0db7fe700 1 --2- 172.21.15.72:0/2424101787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0dc09f650 0x7fb0dc1a2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0db7fe700 1 -- 172.21.15.72:0/2424101787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d4009b30 con 0x7fb0dc09e930 2023-10-03T10:14:58.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0daffd700 1 --2- 172.21.15.72:0/2424101787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0dc09f240 0x7fb0dc1a2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0db7fe700 1 --2- 172.21.15.72:0/2424101787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0dc09e930 0x7fb0dc1a1c10 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00dd40 tx=0x7fb0cc0103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0c3fff700 1 -- 172.21.15.72:0/2424101787 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc00dbb0 con 0x7fb0dc09e930 2023-10-03T10:14:58.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0c3fff700 1 -- 172.21.15.72:0/2424101787 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc013040 con 0x7fb0dc09e930 2023-10-03T10:14:58.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0e1ad0700 1 -- 172.21.15.72:0/2424101787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0dc0a0190 con 0x7fb0dc09e930 2023-10-03T10:14:58.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0c3fff700 1 -- 172.21.15.72:0/2424101787 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc010d00 con 0x7fb0dc09e930 2023-10-03T10:14:58.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.152+0000 7fb0e1ad0700 1 -- 172.21.15.72:0/2424101787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0dc071d20 con 0x7fb0dc09e930 2023-10-03T10:14:58.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.153+0000 7fb0c3fff700 1 -- 172.21.15.72:0/2424101787 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0cc018480 con 0x7fb0dc09e930 2023-10-03T10:14:58.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.153+0000 7fb0c3fff700 1 -- 172.21.15.72:0/2424101787 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb0cc0439c0 con 0x7fb0dc09e930 2023-10-03T10:14:58.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.153+0000 7fb0e1ad0700 1 -- 172.21.15.72:0/2424101787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0dc09efc0 con 0x7fb0dc09e930 2023-10-03T10:14:58.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.158+0000 7fb0c3fff700 1 -- 172.21.15.72:0/2424101787 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0cc010e60 con 0x7fb0dc09e930 2023-10-03T10:14:58.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.343+0000 7fb0e1ad0700 1 -- 172.21.15.72:0/2424101787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb0dc074ea0 con 0x7fb0dc09e930 2023-10-03T10:14:58.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.344+0000 7fb0c3fff700 1 -- 172.21.15.72:0/2424101787 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0cc020360 con 0x7fb0dc09e930 2023-10-03T10:14:58.343 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:58.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.345+0000 7fb0e1ad0700 1 -- 172.21.15.72:0/2424101787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0dc09e930 msgr2=0x7fb0dc1a1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.345+0000 7fb0e1ad0700 1 --2- 172.21.15.72:0/2424101787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0dc09e930 0x7fb0dc1a1c10 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00dd40 tx=0x7fb0cc0103a0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.346+0000 7fb0e1ad0700 1 -- 172.21.15.72:0/2424101787 shutdown_connections 2023-10-03T10:14:58.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.346+0000 7fb0e1ad0700 1 --2- 172.21.15.72:0/2424101787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0dc09e930 0x7fb0dc1a1c10 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.346+0000 7fb0e1ad0700 1 --2- 172.21.15.72:0/2424101787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0dc09f650 0x7fb0dc1a2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.346+0000 7fb0e1ad0700 1 --2- 172.21.15.72:0/2424101787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0dc09f240 0x7fb0dc1a2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.346+0000 7fb0e1ad0700 1 -- 172.21.15.72:0/2424101787 >> 172.21.15.72:0/2424101787 conn(0x7fb0dc0a4210 msgr2=0x7fb0dc1b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.346+0000 7fb0e1ad0700 1 -- 172.21.15.72:0/2424101787 shutdown_connections 2023-10-03T10:14:58.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.346+0000 7fb0e1ad0700 1 -- 172.21.15.72:0/2424101787 wait complete. 2023-10-03T10:14:58.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:58.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:58.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.735+0000 7f79bcc59700 1 Processor -- start 2023-10-03T10:14:58.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.735+0000 7f79bcc59700 1 -- start start 2023-10-03T10:14:58.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79bcc59700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b81338a0 0x7f79b8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79bcc59700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79b809de50 0x7f79b809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79bcc59700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b806ef30 con 0x7f79b809e760 2023-10-03T10:14:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79bcc59700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b806fef0 con 0x7f79b809de50 2023-10-03T10:14:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79bcc59700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79b81334b0 con 0x7f79b81338a0 2023-10-03T10:14:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79b659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b81338a0 0x7f79b8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79b5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79b809de50 0x7f79b809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79b659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b81338a0 0x7f79b8133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41688/0 (socket says 172.21.15.72:41688) 2023-10-03T10:14:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79b659c700 1 -- 172.21.15.72:0/3553567006 learned_addr learned my addr 172.21.15.72:0/3553567006 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79b5d9b700 1 -- 172.21.15.72:0/3553567006 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b81338a0 msgr2=0x7f79b8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79b5d9b700 1 --2- 172.21.15.72:0/3553567006 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b81338a0 0x7f79b8133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79b5d9b700 1 -- 172.21.15.72:0/3553567006 >> v1:172.21.15.72:6789/0 conn(0x7f79b809e760 legacy=0x7f79b813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79b5d9b700 1 -- 172.21.15.72:0/3553567006 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b806fc30 con 0x7f79b809de50 2023-10-03T10:14:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79b659c700 1 --2- 172.21.15.72:0/3553567006 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b81338a0 0x7f79b8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79b5d9b700 1 --2- 172.21.15.72:0/3553567006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b809de50 0x7f79b809e220 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009840 tx=0x7f79ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55e3e512725443c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79b559a700 1 -- 172.21.15.72:0/3553567006 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac011830 con 0x7f79b809de50 2023-10-03T10:14:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79b559a700 1 -- 172.21.15.72:0/3553567006 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac011990 con 0x7f79b809de50 2023-10-03T10:14:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.736+0000 7f79b559a700 1 -- 172.21.15.72:0/3553567006 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac011d20 con 0x7f79b809de50 2023-10-03T10:14:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.737+0000 7f79bcc59700 1 -- 172.21.15.72:0/3553567006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b809de50 msgr2=0x7f79b809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.737+0000 7f79bcc59700 1 --2- 172.21.15.72:0/3553567006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b809de50 0x7f79b809e220 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009840 tx=0x7f79ac009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.737+0000 7f79bcc59700 1 -- 172.21.15.72:0/3553567006 shutdown_connections 2023-10-03T10:14:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.737+0000 7f79bcc59700 1 --2- 172.21.15.72:0/3553567006 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b81338a0 0x7f79b8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.737+0000 7f79bcc59700 1 --2- 172.21.15.72:0/3553567006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b809de50 0x7f79b809e220 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.737+0000 7f79bcc59700 1 -- 172.21.15.72:0/3553567006 >> 172.21.15.72:0/3553567006 conn(0x7f79b80a2aa0 msgr2=0x7f79b80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.737+0000 7f79bcc59700 1 -- 172.21.15.72:0/3553567006 shutdown_connections 2023-10-03T10:14:58.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.737+0000 7f79bcc59700 1 -- 172.21.15.72:0/3553567006 wait complete. 2023-10-03T10:14:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.738+0000 7f79bcc59700 1 Processor -- start 2023-10-03T10:14:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.738+0000 7f79bcc59700 1 -- start start 2023-10-03T10:14:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.738+0000 7f79bcc59700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79b809de50 0x7f79b811eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.738+0000 7f79bcc59700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b809e760 0x7f79b811f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.738+0000 7f79bcc59700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b81338a0 0x7f79b811f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.738+0000 7f79bcc59700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b8121ea0 con 0x7f79b809e760 2023-10-03T10:14:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.738+0000 7f79bcc59700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b8122080 con 0x7f79b809de50 2023-10-03T10:14:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.738+0000 7f79bcc59700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79b812f690 con 0x7f79b81338a0 2023-10-03T10:14:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79b5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b809e760 0x7f79b811f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79b6d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b81338a0 0x7f79b811f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79b5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b809e760 0x7f79b811f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41300/0 (socket says 172.21.15.72:41300) 2023-10-03T10:14:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79b659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79b809de50 0x7f79b811eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79b5d9b700 1 -- 172.21.15.72:0/2904356788 learned_addr learned my addr 172.21.15.72:0/2904356788 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79b5d9b700 1 -- 172.21.15.72:0/2904356788 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b81338a0 msgr2=0x7f79b811f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79b5d9b700 1 --2- 172.21.15.72:0/2904356788 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b81338a0 0x7f79b811f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79b5d9b700 1 -- 172.21.15.72:0/2904356788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79b809de50 msgr2=0x7f79b811eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79b5d9b700 1 --2- 172.21.15.72:0/2904356788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79b809de50 0x7f79b811eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79b5d9b700 1 -- 172.21.15.72:0/2904356788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a8009550 con 0x7f79b809e760 2023-10-03T10:14:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79b5d9b700 1 --2- 172.21.15.72:0/2904356788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b809e760 0x7f79b811f040 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f79ac000c00 tx=0x7f79ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79a6ffd700 1 -- 172.21.15.72:0/2904356788 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0036a0 con 0x7f79b809e760 2023-10-03T10:14:58.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79a6ffd700 1 -- 172.21.15.72:0/2904356788 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac01e070 con 0x7f79b809e760 2023-10-03T10:14:58.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79bcc59700 1 -- 172.21.15.72:0/2904356788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ac0094a0 con 0x7f79b809e760 2023-10-03T10:14:58.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79a6ffd700 1 -- 172.21.15.72:0/2904356788 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac003a80 con 0x7f79b809e760 2023-10-03T10:14:58.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.739+0000 7f79bcc59700 1 -- 172.21.15.72:0/2904356788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b806f640 con 0x7f79b809e760 2023-10-03T10:14:58.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.740+0000 7f79a6ffd700 1 -- 172.21.15.72:0/2904356788 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79ac003be0 con 0x7f79b809e760 2023-10-03T10:14:58.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.740+0000 7f79a6ffd700 1 -- 172.21.15.72:0/2904356788 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f79ac040520 con 0x7f79b809e760 2023-10-03T10:14:58.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.740+0000 7f79bcc59700 1 -- 172.21.15.72:0/2904356788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b8074ea0 con 0x7f79b809e760 2023-10-03T10:14:58.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.745+0000 7f79a6ffd700 1 -- 172.21.15.72:0/2904356788 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79ac015020 con 0x7f79b809e760 2023-10-03T10:14:58.805 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:58.843 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.931+0000 7f12cc4dd700 1 Processor -- start 2023-10-03T10:14:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.931+0000 7f12cc4dd700 1 -- start start 2023-10-03T10:14:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.932+0000 7f12cc4dd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12c40a0a30 0x7f12c40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.932+0000 7f12cc4dd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12c40a1340 0x7f12c4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.932+0000 7f12cc4dd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c409edd0 con 0x7f12c4133fa0 2023-10-03T10:14:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.932+0000 7f12cc4dd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c409e1f0 con 0x7f12c40a1340 2023-10-03T10:14:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.932+0000 7f12cc4dd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c409dc50 con 0x7f12c40a0a30 2023-10-03T10:14:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.932+0000 7f12ca279700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12c40a0a30 0x7f12c40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.932+0000 7f12ca279700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12c40a0a30 0x7f12c40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48440/0 (socket says 172.21.15.72:48440) 2023-10-03T10:14:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.932+0000 7f12ca279700 1 -- 172.21.15.72:0/26929522 learned_addr learned my addr 172.21.15.72:0/26929522 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.932+0000 7f12c9a78700 1 --2- 172.21.15.72:0/26929522 >> v2:172.21.15.72:3300/0 conn(0x7f12c40a1340 0x7f12c4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.932+0000 7f12ca279700 1 -- 172.21.15.72:0/26929522 >> v2:172.21.15.72:3300/0 conn(0x7f12c40a1340 msgr2=0x7f12c4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.932+0000 7f12ca279700 1 --2- 172.21.15.72:0/26929522 >> v2:172.21.15.72:3300/0 conn(0x7f12c40a1340 0x7f12c4133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.932+0000 7f12ca279700 1 -- 172.21.15.72:0/26929522 >> v1:172.21.15.72:6789/0 conn(0x7f12c4133fa0 legacy=0x7f12c413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.932+0000 7f12ca279700 1 -- 172.21.15.72:0/26929522 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c40a1fe0 con 0x7f12c40a0a30 2023-10-03T10:14:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.932+0000 7f12ca279700 1 --2- 172.21.15.72:0/26929522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12c40a0a30 0x7f12c40a0e00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f12c00098f0 tx=0x7f12c0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fefb975c733501c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.932+0000 7f12c9277700 1 -- 172.21.15.72:0/26929522 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c0004230 con 0x7f12c40a0a30 2023-10-03T10:14:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.933+0000 7f12c9277700 1 -- 172.21.15.72:0/26929522 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c0004390 con 0x7f12c40a0a30 2023-10-03T10:14:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.933+0000 7f12c9277700 1 -- 172.21.15.72:0/26929522 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c00036a0 con 0x7f12c40a0a30 2023-10-03T10:14:58.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.933+0000 7f12cc4dd700 1 -- 172.21.15.72:0/26929522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12c40a0a30 msgr2=0x7f12c40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.933+0000 7f12cc4dd700 1 --2- 172.21.15.72:0/26929522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12c40a0a30 0x7f12c40a0e00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f12c00098f0 tx=0x7f12c0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:58.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.933+0000 7f12cc4dd700 1 -- 172.21.15.72:0/26929522 shutdown_connections 2023-10-03T10:14:58.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.933+0000 7f12cc4dd700 1 --2- 172.21.15.72:0/26929522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12c40a0a30 0x7f12c40a0e00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.933+0000 7f12cc4dd700 1 --2- 172.21.15.72:0/26929522 >> v2:172.21.15.72:3300/0 conn(0x7f12c40a1340 0x7f12c4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.933+0000 7f12cc4dd700 1 -- 172.21.15.72:0/26929522 >> 172.21.15.72:0/26929522 conn(0x7f12c40a6550 msgr2=0x7f12c40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.934+0000 7f12cc4dd700 1 -- 172.21.15.72:0/26929522 shutdown_connections 2023-10-03T10:14:58.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.934+0000 7f12cc4dd700 1 -- 172.21.15.72:0/26929522 wait complete. 2023-10-03T10:14:58.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.934+0000 7f12cc4dd700 1 Processor -- start 2023-10-03T10:14:58.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.934+0000 7f12cc4dd700 1 -- start start 2023-10-03T10:14:58.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12cc4dd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12c40a0a30 0x7f12c411e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12cc4dd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12c40a1340 0x7f12c411eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12cc4dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12c4133fa0 0x7f12c411f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12cc4dd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c40a37c0 con 0x7f12c40a1340 2023-10-03T10:14:58.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12cc4dd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c4120bd0 con 0x7f12c40a0a30 2023-10-03T10:14:58.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12cc4dd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12c4120480 con 0x7f12c4133fa0 2023-10-03T10:14:58.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12c9a78700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12c40a1340 0x7f12c411eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12c9a78700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12c40a1340 0x7f12c411eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41322/0 (socket says 172.21.15.72:41322) 2023-10-03T10:14:58.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12c9a78700 1 -- 172.21.15.72:0/2675474934 learned_addr learned my addr 172.21.15.72:0/2675474934 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:58.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12caa7a700 1 --2- 172.21.15.72:0/2675474934 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12c4133fa0 0x7f12c411f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12ca279700 1 --2- 172.21.15.72:0/2675474934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12c40a0a30 0x7f12c411e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12caa7a700 1 -- 172.21.15.72:0/2675474934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12c40a0a30 msgr2=0x7f12c411e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12caa7a700 1 --2- 172.21.15.72:0/2675474934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12c40a0a30 0x7f12c411e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12caa7a700 1 -- 172.21.15.72:0/2675474934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12c40a1340 msgr2=0x7f12c411eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12caa7a700 1 --2- 172.21.15.72:0/2675474934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12c40a1340 0x7f12c411eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12caa7a700 1 -- 172.21.15.72:0/2675474934 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c0009550 con 0x7f12c4133fa0 2023-10-03T10:14:58.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.935+0000 7f12c9a78700 1 --2- 172.21.15.72:0/2675474934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12c40a1340 0x7f12c411eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.936+0000 7f12caa7a700 1 --2- 172.21.15.72:0/2675474934 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12c4133fa0 0x7f12c411f1e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00c890 tx=0x7f12bc00cba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.936+0000 7f12baffd700 1 -- 172.21.15.72:0/2675474934 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc003e30 con 0x7f12c4133fa0 2023-10-03T10:14:58.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.936+0000 7f12baffd700 1 -- 172.21.15.72:0/2675474934 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc005070 con 0x7f12c4133fa0 2023-10-03T10:14:58.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.936+0000 7f12baffd700 1 -- 172.21.15.72:0/2675474934 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0053e0 con 0x7f12c4133fa0 2023-10-03T10:14:58.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.936+0000 7f12cc4dd700 1 -- 172.21.15.72:0/2675474934 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c40a0220 con 0x7f12c4133fa0 2023-10-03T10:14:58.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.936+0000 7f12cc4dd700 1 -- 172.21.15.72:0/2675474934 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c4122280 con 0x7f12c4133fa0 2023-10-03T10:14:58.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.936+0000 7f12baffd700 1 -- 172.21.15.72:0/2675474934 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12bc005540 con 0x7f12c4133fa0 2023-10-03T10:14:58.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.937+0000 7f12baffd700 1 -- 172.21.15.72:0/2675474934 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f12bc03e8a0 con 0x7f12c4133fa0 2023-10-03T10:14:58.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.937+0000 7f12cc4dd700 1 -- 172.21.15.72:0/2675474934 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c4074ea0 con 0x7f12c4133fa0 2023-10-03T10:14:58.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.938+0000 7f79bcc59700 1 -- 172.21.15.72:0/2904356788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f79b806b9e0 con 0x7f79b809e760 2023-10-03T10:14:58.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.939+0000 7f79a6ffd700 1 -- 172.21.15.72:0/2904356788 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f79ac02d970 con 0x7f79b809e760 2023-10-03T10:14:58.940 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:58.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.941+0000 7f79bcc59700 1 -- 172.21.15.72:0/2904356788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b809e760 msgr2=0x7f79b811f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.941+0000 7f79bcc59700 1 --2- 172.21.15.72:0/2904356788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b809e760 0x7f79b811f040 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f79ac000c00 tx=0x7f79ac004750 comp rx=0 tx=0).stop 2023-10-03T10:14:58.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.941+0000 7f79bcc59700 1 -- 172.21.15.72:0/2904356788 shutdown_connections 2023-10-03T10:14:58.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.941+0000 7f79bcc59700 1 --2- 172.21.15.72:0/2904356788 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b81338a0 0x7f79b811f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.941+0000 7f79bcc59700 1 --2- 172.21.15.72:0/2904356788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79b809de50 0x7f79b811eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.941+0000 7f79bcc59700 1 --2- 172.21.15.72:0/2904356788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b809e760 0x7f79b811f040 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.941+0000 7f79bcc59700 1 -- 172.21.15.72:0/2904356788 >> 172.21.15.72:0/2904356788 conn(0x7f79b80a2aa0 msgr2=0x7f79b809edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.941+0000 7f79bcc59700 1 -- 172.21.15.72:0/2904356788 shutdown_connections 2023-10-03T10:14:58.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.941+0000 7f79bcc59700 1 -- 172.21.15.72:0/2904356788 wait complete. 2023-10-03T10:14:58.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.942+0000 7f12baffd700 1 -- 172.21.15.72:0/2675474934 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12bc00ab60 con 0x7f12c4133fa0 2023-10-03T10:14:58.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:14:58.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.975+0000 7f9ddd3df700 1 Processor -- start 2023-10-03T10:14:58.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.975+0000 7f9ddd3df700 1 -- start start 2023-10-03T10:14:58.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9ddd3df700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dd812cd70 0x7f9dd812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9ddd3df700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9dd8135c10 0x7f9dd8137ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9ddd3df700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd809a870 con 0x7f9dd812c9a0 2023-10-03T10:14:58.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9ddd3df700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd809b890 con 0x7f9dd8135c10 2023-10-03T10:14:58.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9ddd3df700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd809b2f0 con 0x7f9dd812cd70 2023-10-03T10:14:58.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9dd67fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dd812cd70 0x7f9dd812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9dd67fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dd812cd70 0x7f9dd812ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41708/0 (socket says 172.21.15.72:41708) 2023-10-03T10:14:58.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9dd67fc700 1 -- 172.21.15.72:0/709064227 learned_addr learned my addr 172.21.15.72:0/709064227 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:58.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9dd77fe700 1 --2- 172.21.15.72:0/709064227 >> v2:172.21.15.72:3300/0 conn(0x7f9dd8135c10 0x7f9dd8137ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9dd67fc700 1 -- 172.21.15.72:0/709064227 >> v2:172.21.15.72:3300/0 conn(0x7f9dd8135c10 msgr2=0x7f9dd8137ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9dd67fc700 1 --2- 172.21.15.72:0/709064227 >> v2:172.21.15.72:3300/0 conn(0x7f9dd8135c10 0x7f9dd8137ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9dd67fc700 1 -- 172.21.15.72:0/709064227 >> v1:172.21.15.72:6789/0 conn(0x7f9dd812c9a0 legacy=0x7f9dd812f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9dd67fc700 1 -- 172.21.15.72:0/709064227 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd809a170 con 0x7f9dd812cd70 2023-10-03T10:14:58.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9dd77fe700 1 --2- 172.21.15.72:0/709064227 >> v2:172.21.15.72:3300/0 conn(0x7f9dd8135c10 0x7f9dd8137ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9dd67fc700 1 --2- 172.21.15.72:0/709064227 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dd812cd70 0x7f9dd812ff90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009920 tx=0x7f9dcc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42574696d65ab5a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9dd5ffb700 1 -- 172.21.15.72:0/709064227 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc010800 con 0x7f9dd812cd70 2023-10-03T10:14:58.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9dd5ffb700 1 -- 172.21.15.72:0/709064227 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc010960 con 0x7f9dd812cd70 2023-10-03T10:14:58.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.976+0000 7f9dd5ffb700 1 -- 172.21.15.72:0/709064227 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc010cf0 con 0x7f9dd812cd70 2023-10-03T10:14:58.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.977+0000 7f9ddd3df700 1 -- 172.21.15.72:0/709064227 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dd812cd70 msgr2=0x7f9dd812ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.977+0000 7f9ddd3df700 1 --2- 172.21.15.72:0/709064227 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dd812cd70 0x7f9dd812ff90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009920 tx=0x7f9dcc009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:58.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.977+0000 7f9ddd3df700 1 -- 172.21.15.72:0/709064227 shutdown_connections 2023-10-03T10:14:58.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.977+0000 7f9ddd3df700 1 --2- 172.21.15.72:0/709064227 >> v2:172.21.15.72:3300/0 conn(0x7f9dd8135c10 0x7f9dd8137ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.977+0000 7f9ddd3df700 1 --2- 172.21.15.72:0/709064227 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dd812cd70 0x7f9dd812ff90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.977+0000 7f9ddd3df700 1 -- 172.21.15.72:0/709064227 >> 172.21.15.72:0/709064227 conn(0x7f9dd80a2360 msgr2=0x7f9dd80a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.977+0000 7f9ddd3df700 1 -- 172.21.15.72:0/709064227 shutdown_connections 2023-10-03T10:14:58.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.977+0000 7f9ddd3df700 1 -- 172.21.15.72:0/709064227 wait complete. 2023-10-03T10:14:58.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.978+0000 7f9ddd3df700 1 Processor -- start 2023-10-03T10:14:58.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.978+0000 7f9ddd3df700 1 -- start start 2023-10-03T10:14:58.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.978+0000 7f9ddd3df700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dd812c9a0 0x7f9dd8071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9ddd3df700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dd812cd70 0x7f9dd80721c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9ddd3df700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dd8135c10 0x7f9dd81c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9ddd3df700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd8130de0 con 0x7f9dd812cd70 2023-10-03T10:14:58.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9ddd3df700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd809adf0 con 0x7f9dd812c9a0 2023-10-03T10:14:58.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9ddd3df700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd8130bb0 con 0x7f9dd8135c10 2023-10-03T10:14:58.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dd6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dd812c9a0 0x7f9dd8071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dd67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dd812cd70 0x7f9dd80721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dd67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dd812cd70 0x7f9dd80721c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41338/0 (socket says 172.21.15.72:41338) 2023-10-03T10:14:58.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dd6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dd812c9a0 0x7f9dd8071c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48456/0 (socket says 172.21.15.72:48456) 2023-10-03T10:14:58.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dd67fc700 1 -- 172.21.15.72:0/2406969835 learned_addr learned my addr 172.21.15.72:0/2406969835 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:58.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dd77fe700 1 --2- 172.21.15.72:0/2406969835 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dd8135c10 0x7f9dd81c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dd67fc700 1 -- 172.21.15.72:0/2406969835 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dd8135c10 msgr2=0x7f9dd81c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dd67fc700 1 --2- 172.21.15.72:0/2406969835 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dd8135c10 0x7f9dd81c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dd67fc700 1 -- 172.21.15.72:0/2406969835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dd812c9a0 msgr2=0x7f9dd8071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dd67fc700 1 --2- 172.21.15.72:0/2406969835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dd812c9a0 0x7f9dd8071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dd67fc700 1 -- 172.21.15.72:0/2406969835 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd0009a70 con 0x7f9dd812cd70 2023-10-03T10:14:58.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dd77fe700 1 --2- 172.21.15.72:0/2406969835 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dd8135c10 0x7f9dd81c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dd6ffd700 1 --2- 172.21.15.72:0/2406969835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dd812c9a0 0x7f9dd8071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dd67fc700 1 --2- 172.21.15.72:0/2406969835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dd812cd70 0x7f9dd80721c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0098f0 tx=0x7f9dcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dbf7fe700 1 -- 172.21.15.72:0/2406969835 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc003ab0 con 0x7f9dd812cd70 2023-10-03T10:14:58.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dbf7fe700 1 -- 172.21.15.72:0/2406969835 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc003c10 con 0x7f9dd812cd70 2023-10-03T10:14:58.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9ddd3df700 1 -- 172.21.15.72:0/2406969835 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dcc009550 con 0x7f9dd812cd70 2023-10-03T10:14:58.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9dbf7fe700 1 -- 172.21.15.72:0/2406969835 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc004560 con 0x7f9dd812cd70 2023-10-03T10:14:58.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.979+0000 7f9ddd3df700 1 -- 172.21.15.72:0/2406969835 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd809c5f0 con 0x7f9dd812cd70 2023-10-03T10:14:58.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.980+0000 7f9dbf7fe700 1 -- 172.21.15.72:0/2406969835 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9dcc018400 con 0x7f9dd812cd70 2023-10-03T10:14:58.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.980+0000 7f9dbf7fe700 1 -- 172.21.15.72:0/2406969835 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9dcc040520 con 0x7f9dd812cd70 2023-10-03T10:14:58.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.980+0000 7f9ddd3df700 1 -- 172.21.15.72:0/2406969835 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd8074ea0 con 0x7f9dd812cd70 2023-10-03T10:14:58.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:58.989+0000 7f9dbf7fe700 1 -- 172.21.15.72:0/2406969835 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9dcc026070 con 0x7f9dd812cd70 2023-10-03T10:14:59.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.143+0000 7f12cc4dd700 1 -- 172.21.15.72:0/2675474934 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f12c40a28e0 con 0x7f12c4133fa0 2023-10-03T10:14:59.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.143+0000 7f12baffd700 1 -- 172.21.15.72:0/2675474934 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12bc017030 con 0x7f12c4133fa0 2023-10-03T10:14:59.143 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:14:59.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.145+0000 7f12cc4dd700 1 -- 172.21.15.72:0/2675474934 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12c4133fa0 msgr2=0x7f12c411f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.145+0000 7f12cc4dd700 1 --2- 172.21.15.72:0/2675474934 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12c4133fa0 0x7f12c411f1e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00c890 tx=0x7f12bc00cba0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.145+0000 7f12cc4dd700 1 -- 172.21.15.72:0/2675474934 shutdown_connections 2023-10-03T10:14:59.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.145+0000 7f12cc4dd700 1 --2- 172.21.15.72:0/2675474934 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12c4133fa0 0x7f12c411f1e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.145+0000 7f12cc4dd700 1 --2- 172.21.15.72:0/2675474934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12c40a0a30 0x7f12c411e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.145+0000 7f12cc4dd700 1 --2- 172.21.15.72:0/2675474934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12c40a1340 0x7f12c411eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.145+0000 7f12cc4dd700 1 -- 172.21.15.72:0/2675474934 >> 172.21.15.72:0/2675474934 conn(0x7f12c40a6550 msgr2=0x7f12c41b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.145+0000 7f12cc4dd700 1 -- 172.21.15.72:0/2675474934 shutdown_connections 2023-10-03T10:14:59.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.145+0000 7f12cc4dd700 1 -- 172.21.15.72:0/2675474934 wait complete. 2023-10-03T10:14:59.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:14:59.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.183+0000 7f9ddd3df700 1 -- 172.21.15.72:0/2406969835 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9dd8131b30 con 0x7f9dd812cd70 2023-10-03T10:14:59.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.183+0000 7f9dbf7fe700 1 -- 172.21.15.72:0/2406969835 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9dcc016300 con 0x7f9dd812cd70 2023-10-03T10:14:59.183 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:14:59.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.185+0000 7f9ddd3df700 1 -- 172.21.15.72:0/2406969835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dd812cd70 msgr2=0x7f9dd80721c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.185+0000 7f9ddd3df700 1 --2- 172.21.15.72:0/2406969835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dd812cd70 0x7f9dd80721c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0098f0 tx=0x7f9dcc004750 comp rx=0 tx=0).stop 2023-10-03T10:14:59.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.185+0000 7f9ddd3df700 1 -- 172.21.15.72:0/2406969835 shutdown_connections 2023-10-03T10:14:59.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.185+0000 7f9ddd3df700 1 --2- 172.21.15.72:0/2406969835 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9dd8135c10 0x7f9dd81c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.185+0000 7f9ddd3df700 1 --2- 172.21.15.72:0/2406969835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9dd812c9a0 0x7f9dd8071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.185+0000 7f9ddd3df700 1 --2- 172.21.15.72:0/2406969835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9dd812cd70 0x7f9dd80721c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.185+0000 7f9ddd3df700 1 -- 172.21.15.72:0/2406969835 >> 172.21.15.72:0/2406969835 conn(0x7f9dd80a2360 msgr2=0x7f9dd80a0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.185+0000 7f9ddd3df700 1 -- 172.21.15.72:0/2406969835 shutdown_connections 2023-10-03T10:14:59.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.185+0000 7f9ddd3df700 1 -- 172.21.15.72:0/2406969835 wait complete. 2023-10-03T10:14:59.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:14:59.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:59.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.481+0000 7fb201fae700 1 Processor -- start 2023-10-03T10:14:59.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.481+0000 7fb201fae700 1 -- start start 2023-10-03T10:14:59.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.481+0000 7fb201fae700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1fc133510 0x7fb1fc1358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.481+0000 7fb201fae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1fc135e30 0x7fb1fc138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.481+0000 7fb201fae700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc130260 con 0x7fb1fc130670 2023-10-03T10:14:59.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.481+0000 7fb201fae700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc09a350 con 0x7fb1fc135e30 2023-10-03T10:14:59.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.481+0000 7fb201fae700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc071ff0 con 0x7fb1fc133510 2023-10-03T10:14:59.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.481+0000 7fb1faffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1fc133510 0x7fb1fc1358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.481+0000 7fb1fbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1fc135e30 0x7fb1fc138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.481+0000 7fb1faffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1fc133510 0x7fb1fc1358f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41728/0 (socket says 172.21.15.72:41728) 2023-10-03T10:14:59.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.481+0000 7fb1fb7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb1fc130670 0x7fb1fc130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35302/0 (socket says 172.21.15.72:35302) 2023-10-03T10:14:59.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.481+0000 7fb1faffd700 1 -- 172.21.15.72:0/269115335 learned_addr learned my addr 172.21.15.72:0/269115335 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:59.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb1faffd700 1 -- 172.21.15.72:0/269115335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1fc135e30 msgr2=0x7fb1fc138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb1faffd700 1 --2- 172.21.15.72:0/269115335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1fc135e30 0x7fb1fc138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb1fa7fc700 1 -- 172.21.15.72:0/269115335 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804635093 0 0) 0x7fb1fc130260 con 0x7fb1fc130670 2023-10-03T10:14:59.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb1faffd700 1 -- 172.21.15.72:0/269115335 >> v1:172.21.15.72:6789/0 conn(0x7fb1fc130670 legacy=0x7fb1fc130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb1faffd700 1 -- 172.21.15.72:0/269115335 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc09ecf0 con 0x7fb1fc133510 2023-10-03T10:14:59.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb1fbfff700 1 --2- 172.21.15.72:0/269115335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1fc135e30 0x7fb1fc138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb1faffd700 1 --2- 172.21.15.72:0/269115335 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1fc133510 0x7fb1fc1358f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009920 tx=0x7fb1f0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=526d98f068f2a22b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb1fa7fc700 1 -- 172.21.15.72:0/269115335 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0011830 con 0x7fb1fc133510 2023-10-03T10:14:59.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb1fa7fc700 1 -- 172.21.15.72:0/269115335 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f0011990 con 0x7fb1fc133510 2023-10-03T10:14:59.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb1fa7fc700 1 -- 172.21.15.72:0/269115335 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0011d20 con 0x7fb1fc133510 2023-10-03T10:14:59.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb201fae700 1 -- 172.21.15.72:0/269115335 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1fc133510 msgr2=0x7fb1fc1358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb201fae700 1 --2- 172.21.15.72:0/269115335 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1fc133510 0x7fb1fc1358f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009920 tx=0x7fb1f0009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:59.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb201fae700 1 -- 172.21.15.72:0/269115335 shutdown_connections 2023-10-03T10:14:59.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb201fae700 1 --2- 172.21.15.72:0/269115335 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1fc135e30 0x7fb1fc138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb201fae700 1 --2- 172.21.15.72:0/269115335 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1fc133510 0x7fb1fc1358f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb201fae700 1 -- 172.21.15.72:0/269115335 >> 172.21.15.72:0/269115335 conn(0x7fb1fc0a2aa0 msgr2=0x7fb1fc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.482+0000 7fb201fae700 1 -- 172.21.15.72:0/269115335 shutdown_connections 2023-10-03T10:14:59.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.483+0000 7fb201fae700 1 -- 172.21.15.72:0/269115335 wait complete. 2023-10-03T10:14:59.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.484+0000 7fb201fae700 1 Processor -- start 2023-10-03T10:14:59.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.484+0000 7fb201fae700 1 -- start start 2023-10-03T10:14:59.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.484+0000 7fb201fae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1fc130670 0x7fb1fc09c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.484+0000 7fb201fae700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1fc133510 0x7fb1fc09caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb201fae700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1fc135e30 0x7fb1fc09d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb201fae700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc135970 con 0x7fb1fc133510 2023-10-03T10:14:59.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb201fae700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc11a170 con 0x7fb1fc130670 2023-10-03T10:14:59.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb201fae700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc119ac0 con 0x7fb1fc135e30 2023-10-03T10:14:59.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1faffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1fc133510 0x7fb1fc09caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1fbfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1fc135e30 0x7fb1fc09d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1fb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1fc130670 0x7fb1fc09c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1faffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1fc133510 0x7fb1fc09caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41344/0 (socket says 172.21.15.72:41344) 2023-10-03T10:14:59.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1faffd700 1 -- 172.21.15.72:0/245799118 learned_addr learned my addr 172.21.15.72:0/245799118 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:14:59.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1fbfff700 1 -- 172.21.15.72:0/245799118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1fc130670 msgr2=0x7fb1fc09c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1fbfff700 1 --2- 172.21.15.72:0/245799118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1fc130670 0x7fb1fc09c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1fbfff700 1 -- 172.21.15.72:0/245799118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1fc133510 msgr2=0x7fb1fc09caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1fbfff700 1 --2- 172.21.15.72:0/245799118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1fc133510 0x7fb1fc09caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1fbfff700 1 -- 172.21.15.72:0/245799118 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f400bc80 con 0x7fb1fc135e30 2023-10-03T10:14:59.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1fb7fe700 1 --2- 172.21.15.72:0/245799118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1fc130670 0x7fb1fc09c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1faffd700 1 --2- 172.21.15.72:0/245799118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1fc133510 0x7fb1fc09caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1fbfff700 1 --2- 172.21.15.72:0/245799118 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1fc135e30 0x7fb1fc09d030 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc09f150 tx=0x7fb1f400e3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1e3fff700 1 -- 172.21.15.72:0/245799118 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400e9a0 con 0x7fb1fc135e30 2023-10-03T10:14:59.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1e3fff700 1 -- 172.21.15.72:0/245799118 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f4011040 con 0x7fb1fc135e30 2023-10-03T10:14:59.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb1e3fff700 1 -- 172.21.15.72:0/245799118 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400ed20 con 0x7fb1fc135e30 2023-10-03T10:14:59.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb201fae700 1 -- 172.21.15.72:0/245799118 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f0009550 con 0x7fb1fc135e30 2023-10-03T10:14:59.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.485+0000 7fb201fae700 1 -- 172.21.15.72:0/245799118 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc118cd0 con 0x7fb1fc135e30 2023-10-03T10:14:59.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.486+0000 7fb1e3fff700 1 -- 172.21.15.72:0/245799118 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1f4009540 con 0x7fb1fc135e30 2023-10-03T10:14:59.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.486+0000 7fb1e3fff700 1 -- 172.21.15.72:0/245799118 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb1f4041e30 con 0x7fb1fc135e30 2023-10-03T10:14:59.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.486+0000 7fb201fae700 1 -- 172.21.15.72:0/245799118 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1fc11a2b0 con 0x7fb1fc135e30 2023-10-03T10:14:59.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.491+0000 7fb1e3fff700 1 -- 172.21.15.72:0/245799118 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1f400ee80 con 0x7fb1fc135e30 2023-10-03T10:14:59.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.676+0000 7fb201fae700 1 -- 172.21.15.72:0/245799118 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb1fc074ea0 con 0x7fb1fc135e30 2023-10-03T10:14:59.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.677+0000 7fb1e3fff700 1 -- 172.21.15.72:0/245799118 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1f401e360 con 0x7fb1fc135e30 2023-10-03T10:14:59.676 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:14:59.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.678+0000 7fb201fae700 1 -- 172.21.15.72:0/245799118 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1fc135e30 msgr2=0x7fb1fc09d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.678+0000 7fb201fae700 1 --2- 172.21.15.72:0/245799118 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1fc135e30 0x7fb1fc09d030 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc09f150 tx=0x7fb1f400e3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.678+0000 7fb201fae700 1 -- 172.21.15.72:0/245799118 shutdown_connections 2023-10-03T10:14:59.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.678+0000 7fb201fae700 1 --2- 172.21.15.72:0/245799118 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1fc135e30 0x7fb1fc09d030 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.678+0000 7fb201fae700 1 --2- 172.21.15.72:0/245799118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1fc130670 0x7fb1fc09c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.679+0000 7fb201fae700 1 --2- 172.21.15.72:0/245799118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1fc133510 0x7fb1fc09caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.679+0000 7fb201fae700 1 -- 172.21.15.72:0/245799118 >> 172.21.15.72:0/245799118 conn(0x7fb1fc0a2aa0 msgr2=0x7fb1fc132390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.679+0000 7fb201fae700 1 -- 172.21.15.72:0/245799118 shutdown_connections 2023-10-03T10:14:59.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:14:59.679+0000 7fb201fae700 1 -- 172.21.15.72:0/245799118 wait complete. 2023-10-03T10:14:59.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:14:59.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:00.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.077+0000 7f3be30a2700 1 Processor -- start 2023-10-03T10:15:00.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.077+0000 7f3be30a2700 1 -- start start 2023-10-03T10:15:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.077+0000 7f3be30a2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bdc1338c0 0x7f3bdc133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.077+0000 7f3be30a2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bdc09e560 0x7f3bdc13b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.077+0000 7f3be30a2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc06f720 con 0x7f3bdc1341d0 2023-10-03T10:15:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.077+0000 7f3be30a2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bdc070c80 con 0x7f3bdc1338c0 2023-10-03T10:15:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.077+0000 7f3be30a2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc06fce0 con 0x7f3bdc09e560 2023-10-03T10:15:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.077+0000 7f3be0e3e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bdc1338c0 0x7f3bdc133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.077+0000 7f3be163f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bdc09e560 0x7f3bdc13b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.077+0000 7f3be0e3e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bdc1338c0 0x7f3bdc133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41350/0 (socket says 172.21.15.72:41350) 2023-10-03T10:15:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.077+0000 7f3be0e3e700 1 -- 172.21.15.72:0/3070158897 learned_addr learned my addr 172.21.15.72:0/3070158897 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3be0e3e700 1 -- 172.21.15.72:0/3070158897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bdc09e560 msgr2=0x7f3bdc13b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3be0e3e700 1 --2- 172.21.15.72:0/3070158897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bdc09e560 0x7f3bdc13b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3be0e3e700 1 -- 172.21.15.72:0/3070158897 >> v1:172.21.15.72:6789/0 conn(0x7f3bdc1341d0 legacy=0x7f3bdc09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3be0e3e700 1 -- 172.21.15.72:0/3070158897 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc1336a0 con 0x7f3bdc1338c0 2023-10-03T10:15:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3be163f700 1 --2- 172.21.15.72:0/3070158897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bdc09e560 0x7f3bdc13b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3be0e3e700 1 --2- 172.21.15.72:0/3070158897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bdc1338c0 0x7f3bdc133c90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00098f0 tx=0x7f3bd0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ec10842ab2ab2c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3bdb7fe700 1 -- 172.21.15.72:0/3070158897 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0011830 con 0x7f3bdc1338c0 2023-10-03T10:15:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3bdb7fe700 1 -- 172.21.15.72:0/3070158897 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd0011990 con 0x7f3bdc1338c0 2023-10-03T10:15:00.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3bdb7fe700 1 -- 172.21.15.72:0/3070158897 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0011d20 con 0x7f3bdc1338c0 2023-10-03T10:15:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3be30a2700 1 -- 172.21.15.72:0/3070158897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bdc1338c0 msgr2=0x7f3bdc133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3be30a2700 1 --2- 172.21.15.72:0/3070158897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bdc1338c0 0x7f3bdc133c90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00098f0 tx=0x7f3bd0009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3be30a2700 1 -- 172.21.15.72:0/3070158897 shutdown_connections 2023-10-03T10:15:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3be30a2700 1 --2- 172.21.15.72:0/3070158897 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bdc09e560 0x7f3bdc13b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3be30a2700 1 --2- 172.21.15.72:0/3070158897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bdc1338c0 0x7f3bdc133c90 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3be30a2700 1 -- 172.21.15.72:0/3070158897 >> 172.21.15.72:0/3070158897 conn(0x7f3bdc0a2aa0 msgr2=0x7f3bdc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3be30a2700 1 -- 172.21.15.72:0/3070158897 shutdown_connections 2023-10-03T10:15:00.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.078+0000 7f3be30a2700 1 -- 172.21.15.72:0/3070158897 wait complete. 2023-10-03T10:15:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.079+0000 7f3be30a2700 1 Processor -- start 2023-10-03T10:15:00.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.079+0000 7f3be30a2700 1 -- start start 2023-10-03T10:15:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be30a2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bdc09e560 0x7f3bdc11fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be30a2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bdc1338c0 0x7f3bdc11ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be30a2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bdc1341d0 0x7f3bdc120490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be30a2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0a12c0 con 0x7f3bdc09e560 2023-10-03T10:15:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be30a2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc06f960 con 0x7f3bdc1338c0 2023-10-03T10:15:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be30a2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc1223b0 con 0x7f3bdc1341d0 2023-10-03T10:15:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be0e3e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bdc09e560 0x7f3bdc11fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be0e3e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bdc09e560 0x7f3bdc11fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41366/0 (socket says 172.21.15.72:41366) 2023-10-03T10:15:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be0e3e700 1 -- 172.21.15.72:0/528225774 learned_addr learned my addr 172.21.15.72:0/528225774 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:00.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be163f700 1 --2- 172.21.15.72:0/528225774 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bdc1341d0 0x7f3bdc120490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3bdbfff700 1 --2- 172.21.15.72:0/528225774 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bdc1338c0 0x7f3bdc11ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be0e3e700 1 -- 172.21.15.72:0/528225774 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bdc1341d0 msgr2=0x7f3bdc120490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be0e3e700 1 --2- 172.21.15.72:0/528225774 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bdc1341d0 0x7f3bdc120490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be0e3e700 1 -- 172.21.15.72:0/528225774 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bdc1338c0 msgr2=0x7f3bdc11ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be0e3e700 1 --2- 172.21.15.72:0/528225774 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bdc1338c0 0x7f3bdc11ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be0e3e700 1 -- 172.21.15.72:0/528225774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd4009a70 con 0x7f3bdc09e560 2023-10-03T10:15:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.080+0000 7f3be0e3e700 1 --2- 172.21.15.72:0/528225774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bdc09e560 0x7f3bdc11fa10 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0000c00 tx=0x7f3bd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.081+0000 7f3bd97fa700 1 -- 172.21.15.72:0/528225774 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00043c0 con 0x7f3bdc09e560 2023-10-03T10:15:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.081+0000 7f3bd97fa700 1 -- 172.21.15.72:0/528225774 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd001f070 con 0x7f3bdc09e560 2023-10-03T10:15:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.081+0000 7f3bd97fa700 1 -- 172.21.15.72:0/528225774 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00038c0 con 0x7f3bdc09e560 2023-10-03T10:15:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.081+0000 7f3be30a2700 1 -- 172.21.15.72:0/528225774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd0009550 con 0x7f3bdc09e560 2023-10-03T10:15:00.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.081+0000 7f3be30a2700 1 -- 172.21.15.72:0/528225774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bdc1231c0 con 0x7f3bdc09e560 2023-10-03T10:15:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.081+0000 7f3bd97fa700 1 -- 172.21.15.72:0/528225774 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3bd0021030 con 0x7f3bdc09e560 2023-10-03T10:15:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.082+0000 7f3bd97fa700 1 -- 172.21.15.72:0/528225774 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3bd0040970 con 0x7f3bdc09e560 2023-10-03T10:15:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.082+0000 7f3be30a2700 1 -- 172.21.15.72:0/528225774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bdc074ea0 con 0x7f3bdc09e560 2023-10-03T10:15:00.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.086+0000 7f3bd97fa700 1 -- 172.21.15.72:0/528225774 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bd00199a0 con 0x7f3bdc09e560 2023-10-03T10:15:00.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:00.198 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:00.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.282+0000 7f8ceea85700 1 Processor -- start 2023-10-03T10:15:00.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.282+0000 7f8ceea85700 1 -- start start 2023-10-03T10:15:00.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.283+0000 7f8ceea85700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ce80a0a30 0x7f8ce80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.283+0000 7f8ceea85700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ce8138d80 0x7f8ce813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.283+0000 7f8ceea85700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce80a2a70 con 0x7f8ce809d630 2023-10-03T10:15:00.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.283+0000 7f8ceea85700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce80a01d0 con 0x7f8ce8138d80 2023-10-03T10:15:00.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.283+0000 7f8ceea85700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce809e2b0 con 0x7f8ce80a0a30 2023-10-03T10:15:00.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.283+0000 7f8cec821700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ce80a0a30 0x7f8ce80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.283+0000 7f8cec821700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ce80a0a30 0x7f8ce80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41748/0 (socket says 172.21.15.72:41748) 2023-10-03T10:15:00.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.283+0000 7f8cec821700 1 -- 172.21.15.72:0/483020109 learned_addr learned my addr 172.21.15.72:0/483020109 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:00.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.283+0000 7f8ced022700 1 --2- 172.21.15.72:0/483020109 >> v2:172.21.15.72:3300/0 conn(0x7f8ce8138d80 0x7f8ce813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.283+0000 7f8cec821700 1 -- 172.21.15.72:0/483020109 >> v2:172.21.15.72:3300/0 conn(0x7f8ce8138d80 msgr2=0x7f8ce813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.283+0000 7f8cec821700 1 --2- 172.21.15.72:0/483020109 >> v2:172.21.15.72:3300/0 conn(0x7f8ce8138d80 0x7f8ce813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.283+0000 7f8cec821700 1 -- 172.21.15.72:0/483020109 >> v1:172.21.15.72:6789/0 conn(0x7f8ce809d630 legacy=0x7f8ce80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.283+0000 7f8cec821700 1 -- 172.21.15.72:0/483020109 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce809dc50 con 0x7f8ce80a0a30 2023-10-03T10:15:00.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.284+0000 7f8cec821700 1 --2- 172.21.15.72:0/483020109 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ce80a0a30 0x7f8ce80a0e00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0098f0 tx=0x7f8cdc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4a028f4ab47d51 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.284+0000 7f8ce77fe700 1 -- 172.21.15.72:0/483020109 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc011830 con 0x7f8ce80a0a30 2023-10-03T10:15:00.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.284+0000 7f8ce77fe700 1 -- 172.21.15.72:0/483020109 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc011990 con 0x7f8ce80a0a30 2023-10-03T10:15:00.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.284+0000 7f8ce77fe700 1 -- 172.21.15.72:0/483020109 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc011d20 con 0x7f8ce80a0a30 2023-10-03T10:15:00.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.284+0000 7f8ceea85700 1 -- 172.21.15.72:0/483020109 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ce80a0a30 msgr2=0x7f8ce80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.284+0000 7f8ceea85700 1 --2- 172.21.15.72:0/483020109 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ce80a0a30 0x7f8ce80a0e00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0098f0 tx=0x7f8cdc009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:00.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.284+0000 7f8ceea85700 1 -- 172.21.15.72:0/483020109 shutdown_connections 2023-10-03T10:15:00.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.284+0000 7f8ceea85700 1 --2- 172.21.15.72:0/483020109 >> v2:172.21.15.72:3300/0 conn(0x7f8ce8138d80 0x7f8ce813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.284+0000 7f8ceea85700 1 --2- 172.21.15.72:0/483020109 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ce80a0a30 0x7f8ce80a0e00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.284+0000 7f8ceea85700 1 -- 172.21.15.72:0/483020109 >> 172.21.15.72:0/483020109 conn(0x7f8ce80a3050 msgr2=0x7f8ce80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.284+0000 7f8ceea85700 1 -- 172.21.15.72:0/483020109 shutdown_connections 2023-10-03T10:15:00.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.284+0000 7f8ceea85700 1 -- 172.21.15.72:0/483020109 wait complete. 2023-10-03T10:15:00.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.285+0000 7f3be30a2700 1 -- 172.21.15.72:0/528225774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3bdc122e10 con 0x7f3bdc09e560 2023-10-03T10:15:00.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.285+0000 7f3bd97fa700 1 -- 172.21.15.72:0/528225774 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3bd00193b0 con 0x7f3bdc09e560 2023-10-03T10:15:00.287 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:00.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.286+0000 7f8ceea85700 1 Processor -- start 2023-10-03T10:15:00.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.286+0000 7f8ceea85700 1 -- start start 2023-10-03T10:15:00.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.286+0000 7f8ceea85700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ce809d630 0x7f8ce81208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.286+0000 7f8ceea85700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ce80a0a30 0x7f8ce8120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.286+0000 7f8ceea85700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce8138d80 0x7f8ce8121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.286+0000 7f8ceea85700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce8122470 con 0x7f8ce8138d80 2023-10-03T10:15:00.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.286+0000 7f8ceea85700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce81237c0 con 0x7f8ce80a0a30 2023-10-03T10:15:00.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.286+0000 7f8ceea85700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce8121d50 con 0x7f8ce809d630 2023-10-03T10:15:00.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.286+0000 7f8cec821700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ce809d630 0x7f8ce81208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.286+0000 7f8ced022700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce8138d80 0x7f8ce8121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.286+0000 7f8cec821700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ce809d630 0x7f8ce81208f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41754/0 (socket says 172.21.15.72:41754) 2023-10-03T10:15:00.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.286+0000 7f8ced022700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce8138d80 0x7f8ce8121370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41374/0 (socket says 172.21.15.72:41374) 2023-10-03T10:15:00.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.286+0000 7f8cec821700 1 -- 172.21.15.72:0/3862008432 learned_addr learned my addr 172.21.15.72:0/3862008432 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:00.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.287+0000 7f8cec821700 1 -- 172.21.15.72:0/3862008432 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ce80a0a30 msgr2=0x7f8ce8120e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.287+0000 7f8cec821700 1 --2- 172.21.15.72:0/3862008432 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ce80a0a30 0x7f8ce8120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.287+0000 7f8cec821700 1 -- 172.21.15.72:0/3862008432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce8138d80 msgr2=0x7f8ce8121370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.287+0000 7f8cec821700 1 --2- 172.21.15.72:0/3862008432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce8138d80 0x7f8ce8121370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.287+0000 7f8cec821700 1 -- 172.21.15.72:0/3862008432 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc009550 con 0x7f8ce809d630 2023-10-03T10:15:00.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.287+0000 7f8ced022700 1 --2- 172.21.15.72:0/3862008432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce8138d80 0x7f8ce8121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:00.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.287+0000 7f8cec821700 1 --2- 172.21.15.72:0/3862008432 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ce809d630 0x7f8ce81208f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc000c00 tx=0x7f8cdc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.287+0000 7f8ce57fa700 1 -- 172.21.15.72:0/3862008432 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc004480 con 0x7f8ce809d630 2023-10-03T10:15:00.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.287+0000 7f8ce57fa700 1 -- 172.21.15.72:0/3862008432 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc01f070 con 0x7f8ce809d630 2023-10-03T10:15:00.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.287+0000 7f8ceea85700 1 -- 172.21.15.72:0/3862008432 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce8124380 con 0x7f8ce809d630 2023-10-03T10:15:00.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.287+0000 7f8ce57fa700 1 -- 172.21.15.72:0/3862008432 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0038c0 con 0x7f8ce809d630 2023-10-03T10:15:00.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.287+0000 7f8ceea85700 1 -- 172.21.15.72:0/3862008432 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce813b0c0 con 0x7f8ce809d630 2023-10-03T10:15:00.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.288+0000 7f3be30a2700 1 -- 172.21.15.72:0/528225774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bdc09e560 msgr2=0x7f3bdc11fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.288+0000 7f3be30a2700 1 --2- 172.21.15.72:0/528225774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bdc09e560 0x7f3bdc11fa10 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0000c00 tx=0x7f3bd0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:00.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.288+0000 7f3be30a2700 1 -- 172.21.15.72:0/528225774 shutdown_connections 2023-10-03T10:15:00.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.288+0000 7f3be30a2700 1 --2- 172.21.15.72:0/528225774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bdc09e560 0x7f3bdc11fa10 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.288+0000 7f3be30a2700 1 --2- 172.21.15.72:0/528225774 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bdc1341d0 0x7f3bdc120490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.288+0000 7f3be30a2700 1 --2- 172.21.15.72:0/528225774 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bdc1338c0 0x7f3bdc11ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.288+0000 7f3be30a2700 1 -- 172.21.15.72:0/528225774 >> 172.21.15.72:0/528225774 conn(0x7f3bdc0a2aa0 msgr2=0x7f3bdc09f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.288+0000 7f8ceea85700 1 -- 172.21.15.72:0/3862008432 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce8123f00 con 0x7f8ce809d630 2023-10-03T10:15:00.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.288+0000 7f3be30a2700 1 -- 172.21.15.72:0/528225774 shutdown_connections 2023-10-03T10:15:00.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.288+0000 7f3be30a2700 1 -- 172.21.15.72:0/528225774 wait complete. 2023-10-03T10:15:00.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.289+0000 7f8ce57fa700 1 -- 172.21.15.72:0/3862008432 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8cdc021030 con 0x7f8ce809d630 2023-10-03T10:15:00.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.289+0000 7f8ce57fa700 1 -- 172.21.15.72:0/3862008432 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8cdc040ca0 con 0x7f8ce809d630 2023-10-03T10:15:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.297+0000 7f8ce57fa700 1 -- 172.21.15.72:0/3862008432 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8cdc019590 con 0x7f8ce809d630 2023-10-03T10:15:00.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:00.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.330+0000 7fb69d943700 1 Processor -- start 2023-10-03T10:15:00.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.330+0000 7fb69d943700 1 -- start start 2023-10-03T10:15:00.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.330+0000 7fb69d943700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6980a0a30 0x7fb6980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.330+0000 7fb69d943700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb69809d630 0x7fb6980a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.330+0000 7fb69d943700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb698133930 0x7fb698133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.330+0000 7fb69d943700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6980a2a70 con 0x7fb69809d630 2023-10-03T10:15:00.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.330+0000 7fb69d943700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6980a01d0 con 0x7fb698133930 2023-10-03T10:15:00.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.330+0000 7fb69d943700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb69809e2b0 con 0x7fb6980a0a30 2023-10-03T10:15:00.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb6967fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb69809d630 0x7fb6980a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb696ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6980a0a30 0x7fb6980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb6977fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb698133930 0x7fb698133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb6967fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb69809d630 0x7fb6980a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41384/0 (socket says 172.21.15.72:41384) 2023-10-03T10:15:00.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb696ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6980a0a30 0x7fb6980a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41770/0 (socket says 172.21.15.72:41770) 2023-10-03T10:15:00.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb6967fc700 1 -- 172.21.15.72:0/3680802501 learned_addr learned my addr 172.21.15.72:0/3680802501 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:00.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb6967fc700 1 -- 172.21.15.72:0/3680802501 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6980a0a30 msgr2=0x7fb6980a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb6967fc700 1 --2- 172.21.15.72:0/3680802501 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6980a0a30 0x7fb6980a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb6967fc700 1 -- 172.21.15.72:0/3680802501 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb698133930 msgr2=0x7fb698133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb6967fc700 1 --2- 172.21.15.72:0/3680802501 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb698133930 0x7fb698133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb6967fc700 1 -- 172.21.15.72:0/3680802501 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69809dc50 con 0x7fb69809d630 2023-10-03T10:15:00.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb6977fe700 1 --2- 172.21.15.72:0/3680802501 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb698133930 0x7fb698133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:00.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb6967fc700 1 --2- 172.21.15.72:0/3680802501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb69809d630 0x7fb6980a1340 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0098f0 tx=0x7fb68c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4c27f9447a0571 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb695ffb700 1 -- 172.21.15.72:0/3680802501 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c011830 con 0x7fb69809d630 2023-10-03T10:15:00.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb695ffb700 1 -- 172.21.15.72:0/3680802501 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c011990 con 0x7fb69809d630 2023-10-03T10:15:00.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.331+0000 7fb695ffb700 1 -- 172.21.15.72:0/3680802501 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c011d20 con 0x7fb69809d630 2023-10-03T10:15:00.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.332+0000 7fb69d943700 1 -- 172.21.15.72:0/3680802501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb69809d630 msgr2=0x7fb6980a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.332+0000 7fb69d943700 1 --2- 172.21.15.72:0/3680802501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb69809d630 0x7fb6980a1340 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0098f0 tx=0x7fb68c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:00.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.332+0000 7fb69d943700 1 -- 172.21.15.72:0/3680802501 shutdown_connections 2023-10-03T10:15:00.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.332+0000 7fb69d943700 1 --2- 172.21.15.72:0/3680802501 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb698133930 0x7fb698133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.332+0000 7fb69d943700 1 --2- 172.21.15.72:0/3680802501 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6980a0a30 0x7fb6980a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.332+0000 7fb69d943700 1 --2- 172.21.15.72:0/3680802501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb69809d630 0x7fb6980a1340 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.332+0000 7fb69d943700 1 -- 172.21.15.72:0/3680802501 >> 172.21.15.72:0/3680802501 conn(0x7fb6980a3050 msgr2=0x7fb6980a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.332+0000 7fb69d943700 1 -- 172.21.15.72:0/3680802501 shutdown_connections 2023-10-03T10:15:00.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.332+0000 7fb69d943700 1 -- 172.21.15.72:0/3680802501 wait complete. 2023-10-03T10:15:00.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.333+0000 7fb69d943700 1 Processor -- start 2023-10-03T10:15:00.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.333+0000 7fb69d943700 1 -- start start 2023-10-03T10:15:00.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.333+0000 7fb69d943700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb69809d630 0x7fb69811f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.333+0000 7fb69d943700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6980a0a30 0x7fb69811fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.333+0000 7fb69d943700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb698133930 0x7fb6981c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.333+0000 7fb69d943700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6981222e0 con 0x7fb698133930 2023-10-03T10:15:00.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.333+0000 7fb69d943700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb698122800 con 0x7fb69809d630 2023-10-03T10:15:00.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.333+0000 7fb69d943700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb698133430 con 0x7fb6980a0a30 2023-10-03T10:15:00.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.333+0000 7fb6967fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6980a0a30 0x7fb69811fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb6967fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6980a0a30 0x7fb69811fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41786/0 (socket says 172.21.15.72:41786) 2023-10-03T10:15:00.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb696ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb69809d630 0x7fb69811f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb6967fc700 1 -- 172.21.15.72:0/2942716775 learned_addr learned my addr 172.21.15.72:0/2942716775 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:00.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb6977fe700 1 --2- 172.21.15.72:0/2942716775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb698133930 0x7fb6981c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb6967fc700 1 -- 172.21.15.72:0/2942716775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb69809d630 msgr2=0x7fb69811f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb6967fc700 1 --2- 172.21.15.72:0/2942716775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb69809d630 0x7fb69811f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb6967fc700 1 -- 172.21.15.72:0/2942716775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb698133930 msgr2=0x7fb6981c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb6967fc700 1 --2- 172.21.15.72:0/2942716775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb698133930 0x7fb6981c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb6967fc700 1 -- 172.21.15.72:0/2942716775 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690009a70 con 0x7fb6980a0a30 2023-10-03T10:15:00.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb6977fe700 1 --2- 172.21.15.72:0/2942716775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb698133930 0x7fb6981c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:00.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb6967fc700 1 --2- 172.21.15.72:0/2942716775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6980a0a30 0x7fb69811fa40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009c40 tx=0x7fb68c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb67ffff700 1 -- 172.21.15.72:0/2942716775 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c004450 con 0x7fb6980a0a30 2023-10-03T10:15:00.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb67ffff700 1 -- 172.21.15.72:0/2942716775 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c0045b0 con 0x7fb6980a0a30 2023-10-03T10:15:00.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb69d943700 1 -- 172.21.15.72:0/2942716775 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68c009550 con 0x7fb6980a0a30 2023-10-03T10:15:00.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb67ffff700 1 -- 172.21.15.72:0/2942716775 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0038c0 con 0x7fb6980a0a30 2023-10-03T10:15:00.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.334+0000 7fb69d943700 1 -- 172.21.15.72:0/2942716775 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb698120ea0 con 0x7fb6980a0a30 2023-10-03T10:15:00.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.335+0000 7fb67ffff700 1 -- 172.21.15.72:0/2942716775 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb68c021070 con 0x7fb6980a0a30 2023-10-03T10:15:00.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.335+0000 7fb67ffff700 1 -- 172.21.15.72:0/2942716775 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb68c040a20 con 0x7fb6980a0a30 2023-10-03T10:15:00.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.335+0000 7fb69d943700 1 -- 172.21.15.72:0/2942716775 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb698120cc0 con 0x7fb6980a0a30 2023-10-03T10:15:00.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.340+0000 7fb67ffff700 1 -- 172.21.15.72:0/2942716775 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb698120cc0 con 0x7fb6980a0a30 2023-10-03T10:15:00.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.490+0000 7f8ceea85700 1 -- 172.21.15.72:0/3862008432 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ce8123f00 con 0x7f8ce809d630 2023-10-03T10:15:00.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.491+0000 7f8ce57fa700 1 -- 172.21.15.72:0/3862008432 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ce8123f00 con 0x7f8ce809d630 2023-10-03T10:15:00.491 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:00.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.493+0000 7f8ceea85700 1 -- 172.21.15.72:0/3862008432 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ce809d630 msgr2=0x7f8ce81208f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.493+0000 7f8ceea85700 1 --2- 172.21.15.72:0/3862008432 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ce809d630 0x7f8ce81208f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc000c00 tx=0x7f8cdc004750 comp rx=0 tx=0).stop 2023-10-03T10:15:00.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.493+0000 7f8ceea85700 1 -- 172.21.15.72:0/3862008432 shutdown_connections 2023-10-03T10:15:00.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.493+0000 7f8ceea85700 1 --2- 172.21.15.72:0/3862008432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ce8138d80 0x7f8ce8121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.493+0000 7f8ceea85700 1 --2- 172.21.15.72:0/3862008432 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ce809d630 0x7f8ce81208f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.493+0000 7f8ceea85700 1 --2- 172.21.15.72:0/3862008432 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ce80a0a30 0x7f8ce8120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.493+0000 7f8ceea85700 1 -- 172.21.15.72:0/3862008432 >> 172.21.15.72:0/3862008432 conn(0x7f8ce80a3050 msgr2=0x7f8ce8139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.493+0000 7f8ceea85700 1 -- 172.21.15.72:0/3862008432 shutdown_connections 2023-10-03T10:15:00.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.493+0000 7f8ceea85700 1 -- 172.21.15.72:0/3862008432 wait complete. 2023-10-03T10:15:00.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:00.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.528+0000 7fb69d943700 1 -- 172.21.15.72:0/2942716775 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb698122420 con 0x7fb6980a0a30 2023-10-03T10:15:00.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.529+0000 7fb67ffff700 1 -- 172.21.15.72:0/2942716775 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb698122420 con 0x7fb6980a0a30 2023-10-03T10:15:00.529 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:00.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.531+0000 7fb69d943700 1 -- 172.21.15.72:0/2942716775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6980a0a30 msgr2=0x7fb69811fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.531+0000 7fb69d943700 1 --2- 172.21.15.72:0/2942716775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6980a0a30 0x7fb69811fa40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009c40 tx=0x7fb68c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.531+0000 7fb69d943700 1 -- 172.21.15.72:0/2942716775 shutdown_connections 2023-10-03T10:15:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.531+0000 7fb69d943700 1 --2- 172.21.15.72:0/2942716775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb698133930 0x7fb6981c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.531+0000 7fb69d943700 1 --2- 172.21.15.72:0/2942716775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb69809d630 0x7fb69811f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.531+0000 7fb69d943700 1 --2- 172.21.15.72:0/2942716775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6980a0a30 0x7fb69811fa40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.531+0000 7fb69d943700 1 -- 172.21.15.72:0/2942716775 >> 172.21.15.72:0/2942716775 conn(0x7fb6980a3050 msgr2=0x7fb6981bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.531+0000 7fb69d943700 1 -- 172.21.15.72:0/2942716775 shutdown_connections 2023-10-03T10:15:00.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.531+0000 7fb69d943700 1 -- 172.21.15.72:0/2942716775 wait complete. 2023-10-03T10:15:00.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:00.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:00.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.814+0000 7fee68b33700 1 Processor -- start 2023-10-03T10:15:00.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.814+0000 7fee68b33700 1 -- start start 2023-10-03T10:15:00.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee68b33700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee6409e930 0x7fee6409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee68b33700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee6409f650 0x7fee64131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee68b33700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee64070940 con 0x7fee6409f240 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee68b33700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6406fd60 con 0x7fee6409e930 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee68b33700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6406fa80 con 0x7fee6409f650 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee6259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee6409e930 0x7fee6409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee62d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee6409f650 0x7fee64131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee62d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee6409f650 0x7fee64131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48504/0 (socket says 172.21.15.72:48504) 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee6259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee6409e930 0x7fee6409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41396/0 (socket says 172.21.15.72:41396) 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee62d9d700 1 -- 172.21.15.72:0/2213004793 learned_addr learned my addr 172.21.15.72:0/2213004793 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:00.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee61d9b700 1 --1- 172.21.15.72:0/2213004793 >> v1:172.21.15.72:6789/0 conn(0x7fee6409f240 0x7fee641317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35342/0 (socket says 172.21.15.72:35342) 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee62d9d700 1 -- 172.21.15.72:0/2213004793 >> v2:172.21.15.72:3300/0 conn(0x7fee6409e930 msgr2=0x7fee6409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee62d9d700 1 --2- 172.21.15.72:0/2213004793 >> v2:172.21.15.72:3300/0 conn(0x7fee6409e930 0x7fee6409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee62d9d700 1 -- 172.21.15.72:0/2213004793 >> v1:172.21.15.72:6789/0 conn(0x7fee6409f240 legacy=0x7fee641317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee62d9d700 1 -- 172.21.15.72:0/2213004793 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6409fb60 con 0x7fee6409f650 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee6259c700 1 --2- 172.21.15.72:0/2213004793 >> v2:172.21.15.72:3300/0 conn(0x7fee6409e930 0x7fee6409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.815+0000 7fee62d9d700 1 --2- 172.21.15.72:0/2213004793 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee6409f650 0x7fee64131f00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009e50 tx=0x7fee5c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97bb4f6cb5cc23b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.816+0000 7fee6159a700 1 -- 172.21.15.72:0/2213004793 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c00e070 con 0x7fee6409f650 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.816+0000 7fee6159a700 1 -- 172.21.15.72:0/2213004793 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c00b910 con 0x7fee6409f650 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.816+0000 7fee6159a700 1 -- 172.21.15.72:0/2213004793 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c00bcc0 con 0x7fee6409f650 2023-10-03T10:15:00.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.816+0000 7fee68b33700 1 -- 172.21.15.72:0/2213004793 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee6409f650 msgr2=0x7fee64131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.816+0000 7fee68b33700 1 --2- 172.21.15.72:0/2213004793 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee6409f650 0x7fee64131f00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009e50 tx=0x7fee5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:00.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.816+0000 7fee68b33700 1 -- 172.21.15.72:0/2213004793 shutdown_connections 2023-10-03T10:15:00.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.816+0000 7fee68b33700 1 --2- 172.21.15.72:0/2213004793 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee6409f650 0x7fee64131f00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.816+0000 7fee68b33700 1 --2- 172.21.15.72:0/2213004793 >> v2:172.21.15.72:3300/0 conn(0x7fee6409e930 0x7fee6409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.816+0000 7fee68b33700 1 -- 172.21.15.72:0/2213004793 >> 172.21.15.72:0/2213004793 conn(0x7fee640a4210 msgr2=0x7fee640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.816+0000 7fee68b33700 1 -- 172.21.15.72:0/2213004793 shutdown_connections 2023-10-03T10:15:00.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.816+0000 7fee68b33700 1 -- 172.21.15.72:0/2213004793 wait complete. 2023-10-03T10:15:00.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.817+0000 7fee68b33700 1 Processor -- start 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.817+0000 7fee68b33700 1 -- start start 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee68b33700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee6409e930 0x7fee641c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee68b33700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6409f240 0x7fee641c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee68b33700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee6409f650 0x7fee641c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee68b33700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee641a7420 con 0x7fee6409f240 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee68b33700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee641a6960 con 0x7fee6409e930 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee68b33700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee641c3980 con 0x7fee6409f650 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee61d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6409f240 0x7fee641c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee6259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee6409e930 0x7fee641c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee61d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6409f240 0x7fee641c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41408/0 (socket says 172.21.15.72:41408) 2023-10-03T10:15:00.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee61d9b700 1 -- 172.21.15.72:0/643897168 learned_addr learned my addr 172.21.15.72:0/643897168 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:00.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee62d9d700 1 --2- 172.21.15.72:0/643897168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee6409f650 0x7fee641c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:00.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee61d9b700 1 -- 172.21.15.72:0/643897168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee6409f650 msgr2=0x7fee641c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee61d9b700 1 --2- 172.21.15.72:0/643897168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee6409f650 0x7fee641c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee61d9b700 1 -- 172.21.15.72:0/643897168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee6409e930 msgr2=0x7fee641c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee61d9b700 1 --2- 172.21.15.72:0/643897168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee6409e930 0x7fee641c2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee61d9b700 1 -- 172.21.15.72:0/643897168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee580094a0 con 0x7fee6409f240 2023-10-03T10:15:00.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee61d9b700 1 --2- 172.21.15.72:0/643897168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6409f240 0x7fee641c3440 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fee5400c520 tx=0x7fee5400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:00.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee52ffd700 1 -- 172.21.15.72:0/643897168 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54005cb0 con 0x7fee6409f240 2023-10-03T10:15:00.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee52ffd700 1 -- 172.21.15.72:0/643897168 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee54005e10 con 0x7fee6409f240 2023-10-03T10:15:00.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee68b33700 1 -- 172.21.15.72:0/643897168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c009b30 con 0x7fee6409f240 2023-10-03T10:15:00.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.818+0000 7fee52ffd700 1 -- 172.21.15.72:0/643897168 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540072d0 con 0x7fee6409f240 2023-10-03T10:15:00.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.819+0000 7fee68b33700 1 -- 172.21.15.72:0/643897168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee640a0190 con 0x7fee6409f240 2023-10-03T10:15:00.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.819+0000 7fee52ffd700 1 -- 172.21.15.72:0/643897168 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee54007430 con 0x7fee6409f240 2023-10-03T10:15:00.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.819+0000 7fee52ffd700 1 -- 172.21.15.72:0/643897168 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fee5403e9e0 con 0x7fee6409f240 2023-10-03T10:15:00.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.819+0000 7fee68b33700 1 -- 172.21.15.72:0/643897168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee640a3630 con 0x7fee6409f240 2023-10-03T10:15:00.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:00.824+0000 7fee52ffd700 1 -- 172.21.15.72:0/643897168 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee54017080 con 0x7fee6409f240 2023-10-03T10:15:01.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.008+0000 7fee68b33700 1 -- 172.21.15.72:0/643897168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fee64074ea0 con 0x7fee6409f240 2023-10-03T10:15:01.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.008+0000 7fee52ffd700 1 -- 172.21.15.72:0/643897168 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee5401b3b0 con 0x7fee6409f240 2023-10-03T10:15:01.008 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.010+0000 7fee68b33700 1 -- 172.21.15.72:0/643897168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6409f240 msgr2=0x7fee641c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.010+0000 7fee68b33700 1 --2- 172.21.15.72:0/643897168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6409f240 0x7fee641c3440 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fee5400c520 tx=0x7fee5400c830 comp rx=0 tx=0).stop 2023-10-03T10:15:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.010+0000 7fee68b33700 1 -- 172.21.15.72:0/643897168 shutdown_connections 2023-10-03T10:15:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.010+0000 7fee68b33700 1 --2- 172.21.15.72:0/643897168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee6409f650 0x7fee641c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.010+0000 7fee68b33700 1 --2- 172.21.15.72:0/643897168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee6409e930 0x7fee641c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.010+0000 7fee68b33700 1 --2- 172.21.15.72:0/643897168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee6409f240 0x7fee641c3440 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.010+0000 7fee68b33700 1 -- 172.21.15.72:0/643897168 >> 172.21.15.72:0/643897168 conn(0x7fee640a4210 msgr2=0x7fee641b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.010+0000 7fee68b33700 1 -- 172.21.15.72:0/643897168 shutdown_connections 2023-10-03T10:15:01.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.010+0000 7fee68b33700 1 -- 172.21.15.72:0/643897168 wait complete. 2023-10-03T10:15:01.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:01.303 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:01.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.427+0000 7fbff7924700 1 Processor -- start 2023-10-03T10:15:01.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.427+0000 7fbff7924700 1 -- start start 2023-10-03T10:15:01.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.427+0000 7fbff7924700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbff00a09c0 0x7fbff00a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.427+0000 7fbff7924700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbff009d5c0 0x7fbff00a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.427+0000 7fbff7924700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbff0133920 0x7fbff0133d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.427+0000 7fbff7924700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff00a1810 con 0x7fbff00a09c0 2023-10-03T10:15:01.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbff7924700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff009ea10 con 0x7fbff0133920 2023-10-03T10:15:01.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbff7924700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbff009e210 con 0x7fbff009d5c0 2023-10-03T10:15:01.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbff4ebf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbff009d5c0 0x7fbff00a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbff56c0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbff00a09c0 0x7fbff00a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbff5ec1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbff0133920 0x7fbff0133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbff56c0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbff00a09c0 0x7fbff00a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41416/0 (socket says 172.21.15.72:41416) 2023-10-03T10:15:01.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbff56c0700 1 -- 172.21.15.72:0/2220510326 learned_addr learned my addr 172.21.15.72:0/2220510326 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:01.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbff4ebf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbff009d5c0 0x7fbff00a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41812/0 (socket says 172.21.15.72:41812) 2023-10-03T10:15:01.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbff56c0700 1 -- 172.21.15.72:0/2220510326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbff009d5c0 msgr2=0x7fbff00a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbff56c0700 1 --2- 172.21.15.72:0/2220510326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbff009d5c0 0x7fbff00a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbff56c0700 1 -- 172.21.15.72:0/2220510326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbff0133920 msgr2=0x7fbff0133d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbff56c0700 1 --2- 172.21.15.72:0/2220510326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbff0133920 0x7fbff0133d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbff56c0700 1 -- 172.21.15.72:0/2220510326 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff00a26f0 con 0x7fbff00a09c0 2023-10-03T10:15:01.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbff5ec1700 1 --2- 172.21.15.72:0/2220510326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbff0133920 0x7fbff0133d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:01.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbff56c0700 1 --2- 172.21.15.72:0/2220510326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff00a09c0 0x7fbff00a0d90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0098f0 tx=0x7fbfec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3910796e6ce76346 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbfe7fff700 1 -- 172.21.15.72:0/2220510326 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec011830 con 0x7fbff00a09c0 2023-10-03T10:15:01.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbfe7fff700 1 -- 172.21.15.72:0/2220510326 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec011990 con 0x7fbff00a09c0 2023-10-03T10:15:01.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.428+0000 7fbfe7fff700 1 -- 172.21.15.72:0/2220510326 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec011d20 con 0x7fbff00a09c0 2023-10-03T10:15:01.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.429+0000 7fbff7924700 1 -- 172.21.15.72:0/2220510326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff00a09c0 msgr2=0x7fbff00a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.429+0000 7fbff7924700 1 --2- 172.21.15.72:0/2220510326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff00a09c0 0x7fbff00a0d90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0098f0 tx=0x7fbfec009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:01.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.429+0000 7fbff7924700 1 -- 172.21.15.72:0/2220510326 shutdown_connections 2023-10-03T10:15:01.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.429+0000 7fbff7924700 1 --2- 172.21.15.72:0/2220510326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbff0133920 0x7fbff0133d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.429+0000 7fbff7924700 1 --2- 172.21.15.72:0/2220510326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff00a09c0 0x7fbff00a0d90 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.429+0000 7fbff7924700 1 --2- 172.21.15.72:0/2220510326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbff009d5c0 0x7fbff00a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.429+0000 7fbff7924700 1 -- 172.21.15.72:0/2220510326 >> 172.21.15.72:0/2220510326 conn(0x7fbff00a2fe0 msgr2=0x7fbff00a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.429+0000 7fbff7924700 1 -- 172.21.15.72:0/2220510326 shutdown_connections 2023-10-03T10:15:01.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.429+0000 7fbff7924700 1 -- 172.21.15.72:0/2220510326 wait complete. 2023-10-03T10:15:01.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.430+0000 7fbff7924700 1 Processor -- start 2023-10-03T10:15:01.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.430+0000 7fbff7924700 1 -- start start 2023-10-03T10:15:01.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.430+0000 7fbff7924700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbff009d5c0 0x7fbff0132440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.430+0000 7fbff7924700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff00a09c0 0x7fbff01211a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.430+0000 7fbff7924700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbff0133920 0x7fbff01216e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.430+0000 7fbff7924700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff01245f0 con 0x7fbff00a09c0 2023-10-03T10:15:01.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.430+0000 7fbff7924700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff01248b0 con 0x7fbff0133920 2023-10-03T10:15:01.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.430+0000 7fbff7924700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbff0122d90 con 0x7fbff009d5c0 2023-10-03T10:15:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.430+0000 7fbff56c0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbff009d5c0 0x7fbff0132440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.430+0000 7fbff4ebf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff00a09c0 0x7fbff01211a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.430+0000 7fbff5ec1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbff0133920 0x7fbff01216e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.430+0000 7fbff56c0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbff009d5c0 0x7fbff0132440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41828/0 (socket says 172.21.15.72:41828) 2023-10-03T10:15:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.430+0000 7fbff56c0700 1 -- 172.21.15.72:0/6377440 learned_addr learned my addr 172.21.15.72:0/6377440 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.430+0000 7fbff4ebf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff00a09c0 0x7fbff01211a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41418/0 (socket says 172.21.15.72:41418) 2023-10-03T10:15:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.431+0000 7fbff56c0700 1 -- 172.21.15.72:0/6377440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbff0133920 msgr2=0x7fbff01216e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.431+0000 7fbff56c0700 1 --2- 172.21.15.72:0/6377440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbff0133920 0x7fbff01216e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.431+0000 7fbff56c0700 1 -- 172.21.15.72:0/6377440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff00a09c0 msgr2=0x7fbff01211a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.431+0000 7fbff56c0700 1 --2- 172.21.15.72:0/6377440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff00a09c0 0x7fbff01211a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.431+0000 7fbff56c0700 1 -- 172.21.15.72:0/6377440 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe8009a70 con 0x7fbff009d5c0 2023-10-03T10:15:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.431+0000 7fbff56c0700 1 --2- 172.21.15.72:0/6377440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbff009d5c0 0x7fbff0132440 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbfec000c00 tx=0x7fbfec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.431+0000 7fbfe5ffb700 1 -- 172.21.15.72:0/6377440 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec004450 con 0x7fbff009d5c0 2023-10-03T10:15:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.431+0000 7fbfe5ffb700 1 -- 172.21.15.72:0/6377440 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec0045b0 con 0x7fbff009d5c0 2023-10-03T10:15:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.431+0000 7fbff7924700 1 -- 172.21.15.72:0/6377440 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfec009550 con 0x7fbff009d5c0 2023-10-03T10:15:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.431+0000 7fbfe5ffb700 1 -- 172.21.15.72:0/6377440 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0038c0 con 0x7fbff009d5c0 2023-10-03T10:15:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.431+0000 7fbff7924700 1 -- 172.21.15.72:0/6377440 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff00a4440 con 0x7fbff009d5c0 2023-10-03T10:15:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.432+0000 7fbfe5ffb700 1 -- 172.21.15.72:0/6377440 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbfec021070 con 0x7fbff009d5c0 2023-10-03T10:15:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.432+0000 7fbfe5ffb700 1 -- 172.21.15.72:0/6377440 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbfec0407e0 con 0x7fbff009d5c0 2023-10-03T10:15:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.432+0000 7fbff7924700 1 -- 172.21.15.72:0/6377440 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff0124cb0 con 0x7fbff009d5c0 2023-10-03T10:15:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.437+0000 7fbfe5ffb700 1 -- 172.21.15.72:0/6377440 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfec015080 con 0x7fbff009d5c0 2023-10-03T10:15:01.506 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:01.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:01.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.629+0000 7fbff7924700 1 -- 172.21.15.72:0/6377440 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbff00747f0 con 0x7fbff009d5c0 2023-10-03T10:15:01.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.629+0000 7fbfe5ffb700 1 -- 172.21.15.72:0/6377440 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbfec003a20 con 0x7fbff009d5c0 2023-10-03T10:15:01.629 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:01.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.633+0000 7fbff7924700 1 -- 172.21.15.72:0/6377440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbff009d5c0 msgr2=0x7fbff0132440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.633+0000 7fbff7924700 1 --2- 172.21.15.72:0/6377440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbff009d5c0 0x7fbff0132440 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbfec000c00 tx=0x7fbfec004750 comp rx=0 tx=0).stop 2023-10-03T10:15:01.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.633+0000 7fbff7924700 1 -- 172.21.15.72:0/6377440 shutdown_connections 2023-10-03T10:15:01.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.633+0000 7fbff7924700 1 --2- 172.21.15.72:0/6377440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbff0133920 0x7fbff01216e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.633+0000 7fbff7924700 1 --2- 172.21.15.72:0/6377440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbff009d5c0 0x7fbff0132440 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.633+0000 7fbff7924700 1 --2- 172.21.15.72:0/6377440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbff00a09c0 0x7fbff01211a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.633+0000 7fbff7924700 1 -- 172.21.15.72:0/6377440 >> 172.21.15.72:0/6377440 conn(0x7fbff00a2fe0 msgr2=0x7fbff009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.633+0000 7fbff7924700 1 -- 172.21.15.72:0/6377440 shutdown_connections 2023-10-03T10:15:01.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.633+0000 7fbff7924700 1 -- 172.21.15.72:0/6377440 wait complete. 2023-10-03T10:15:01.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.636+0000 7f0fae8f9700 1 Processor -- start 2023-10-03T10:15:01.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.636+0000 7f0fae8f9700 1 -- start start 2023-10-03T10:15:01.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0fae8f9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa809d6f0 0x7f0fa809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0fae8f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa809e410 0x7f0fa8134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0fae8f9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa809b120 con 0x7f0fa809e000 2023-10-03T10:15:01.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0fae8f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa806b460 con 0x7f0fa809e410 2023-10-03T10:15:01.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0fae8f9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa809a7e0 con 0x7f0fa809d6f0 2023-10-03T10:15:01.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0fa7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa809d6f0 0x7f0fa809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0face96700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa809e410 0x7f0fa8134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0fa7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa809d6f0 0x7f0fa809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41832/0 (socket says 172.21.15.72:41832) 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0fa7fff700 1 -- 172.21.15.72:0/2506853727 learned_addr learned my addr 172.21.15.72:0/2506853727 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0face96700 1 -- 172.21.15.72:0/2506853727 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa809d6f0 msgr2=0x7f0fa809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0face96700 1 --2- 172.21.15.72:0/2506853727 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa809d6f0 0x7f0fa809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0face96700 1 -- 172.21.15.72:0/2506853727 >> v1:172.21.15.72:6789/0 conn(0x7f0fa809e000 legacy=0x7f0fa81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0fa6ffd700 1 -- 172.21.15.72:0/2506853727 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325542448 0 0) 0x7f0fa809b120 con 0x7f0fa809e000 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0face96700 1 -- 172.21.15.72:0/2506853727 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa809a500 con 0x7f0fa809e410 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0face96700 1 --2- 172.21.15.72:0/2506853727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa809e410 0x7f0fa8134100 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0009dc0 tx=0x7f0fa000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cfc676f89e4541d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0fa6ffd700 1 -- 172.21.15.72:0/2506853727 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000e070 con 0x7f0fa809e410 2023-10-03T10:15:01.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0fa6ffd700 1 -- 172.21.15.72:0/2506853727 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa000bb20 con 0x7f0fa809e410 2023-10-03T10:15:01.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.637+0000 7f0fa6ffd700 1 -- 172.21.15.72:0/2506853727 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0012430 con 0x7f0fa809e410 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.638+0000 7f0fae8f9700 1 -- 172.21.15.72:0/2506853727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa809e410 msgr2=0x7f0fa8134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.638+0000 7f0fae8f9700 1 --2- 172.21.15.72:0/2506853727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa809e410 0x7f0fa8134100 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0009dc0 tx=0x7f0fa000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.638+0000 7f0fae8f9700 1 -- 172.21.15.72:0/2506853727 shutdown_connections 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.638+0000 7f0fae8f9700 1 --2- 172.21.15.72:0/2506853727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa809e410 0x7f0fa8134100 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.638+0000 7f0fae8f9700 1 --2- 172.21.15.72:0/2506853727 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa809d6f0 0x7f0fa809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.638+0000 7f0fae8f9700 1 -- 172.21.15.72:0/2506853727 >> 172.21.15.72:0/2506853727 conn(0x7f0fa8066f50 msgr2=0x7f0fa809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.638+0000 7f0fae8f9700 1 -- 172.21.15.72:0/2506853727 shutdown_connections 2023-10-03T10:15:01.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.638+0000 7f0fae8f9700 1 -- 172.21.15.72:0/2506853727 wait complete. 2023-10-03T10:15:01.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.639+0000 7f0fae8f9700 1 Processor -- start 2023-10-03T10:15:01.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.639+0000 7f0fae8f9700 1 -- start start 2023-10-03T10:15:01.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fae8f9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa809d6f0 0x7f0fa8122350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fae8f9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa809e000 0x7f0fa8122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fae8f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa809e410 0x7f0fa8122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fae8f9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa8125ba0 con 0x7f0fa809e000 2023-10-03T10:15:01.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fae8f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa8133690 con 0x7f0fa809e410 2023-10-03T10:15:01.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fae8f9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa8124d60 con 0x7f0fa809d6f0 2023-10-03T10:15:01.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fa7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa809d6f0 0x7f0fa8122350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fa77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa809e000 0x7f0fa8122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fa7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa809d6f0 0x7f0fa8122350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41848/0 (socket says 172.21.15.72:41848) 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fa77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa809e000 0x7f0fa8122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41428/0 (socket says 172.21.15.72:41428) 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fa7fff700 1 -- 172.21.15.72:0/3905926809 learned_addr learned my addr 172.21.15.72:0/3905926809 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0face96700 1 --2- 172.21.15.72:0/3905926809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa809e410 0x7f0fa8122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fa7fff700 1 -- 172.21.15.72:0/3905926809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa809e410 msgr2=0x7f0fa8122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fa7fff700 1 --2- 172.21.15.72:0/3905926809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa809e410 0x7f0fa8122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fa7fff700 1 -- 172.21.15.72:0/3905926809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa809e000 msgr2=0x7f0fa8122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fa7fff700 1 --2- 172.21.15.72:0/3905926809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa809e000 0x7f0fa8122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fa7fff700 1 -- 172.21.15.72:0/3905926809 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa0009a70 con 0x7f0fa809d6f0 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.640+0000 7f0fa7fff700 1 --2- 172.21.15.72:0/3905926809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa809d6f0 0x7f0fa8122350 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800e940 tx=0x7f0f9800ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.641+0000 7f0fa4ff9700 1 -- 172.21.15.72:0/3905926809 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f980096a0 con 0x7f0fa809d6f0 2023-10-03T10:15:01.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.641+0000 7f0fa4ff9700 1 -- 172.21.15.72:0/3905926809 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f98013680 con 0x7f0fa809d6f0 2023-10-03T10:15:01.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.641+0000 7f0fa4ff9700 1 -- 172.21.15.72:0/3905926809 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98013a30 con 0x7f0fa809d6f0 2023-10-03T10:15:01.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.641+0000 7f0fae8f9700 1 -- 172.21.15.72:0/3905926809 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa8072000 con 0x7f0fa809d6f0 2023-10-03T10:15:01.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.641+0000 7f0fae8f9700 1 -- 172.21.15.72:0/3905926809 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa8125570 con 0x7f0fa809d6f0 2023-10-03T10:15:01.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.641+0000 7f0fa4ff9700 1 -- 172.21.15.72:0/3905926809 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f98013b90 con 0x7f0fa809d6f0 2023-10-03T10:15:01.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.642+0000 7f0fa4ff9700 1 -- 172.21.15.72:0/3905926809 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0f9803f5c0 con 0x7f0fa809d6f0 2023-10-03T10:15:01.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.642+0000 7f0fae8f9700 1 -- 172.21.15.72:0/3905926809 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa8125120 con 0x7f0fa809d6f0 2023-10-03T10:15:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.646+0000 7f0fa4ff9700 1 -- 172.21.15.72:0/3905926809 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f98021080 con 0x7f0fa809d6f0 2023-10-03T10:15:01.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.684+0000 7fa025b4d700 1 Processor -- start 2023-10-03T10:15:01.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.684+0000 7fa025b4d700 1 -- start start 2023-10-03T10:15:01.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa025b4d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa02009e930 0x7fa02009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa025b4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02009f240 0x7fa0201317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa025b4d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa02009f650 0x7fa020131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa025b4d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa020070940 con 0x7fa02009e930 2023-10-03T10:15:01.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa025b4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02006fd60 con 0x7fa02009f240 2023-10-03T10:15:01.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa025b4d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa02006fa80 con 0x7fa02009f650 2023-10-03T10:15:01.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa01f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa02009e930 0x7fa02009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa01effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02009f240 0x7fa0201317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa01f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa02009e930 0x7fa02009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41432/0 (socket says 172.21.15.72:41432) 2023-10-03T10:15:01.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa01f7fe700 1 -- 172.21.15.72:0/148828785 learned_addr learned my addr 172.21.15.72:0/148828785 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:01.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa01ffff700 1 --2- 172.21.15.72:0/148828785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa02009f650 0x7fa020131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa01effd700 1 -- 172.21.15.72:0/148828785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa02009f650 msgr2=0x7fa020131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa01effd700 1 --2- 172.21.15.72:0/148828785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa02009f650 0x7fa020131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa01effd700 1 -- 172.21.15.72:0/148828785 >> v2:172.21.15.72:3300/0 conn(0x7fa02009e930 msgr2=0x7fa02009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa01effd700 1 --2- 172.21.15.72:0/148828785 >> v2:172.21.15.72:3300/0 conn(0x7fa02009e930 0x7fa02009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa01effd700 1 -- 172.21.15.72:0/148828785 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02009fb60 con 0x7fa02009f240 2023-10-03T10:15:01.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa01ffff700 1 --2- 172.21.15.72:0/148828785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa02009f650 0x7fa020131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:01.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.685+0000 7fa01f7fe700 1 --2- 172.21.15.72:0/148828785 >> v2:172.21.15.72:3300/0 conn(0x7fa02009e930 0x7fa02009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:01.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.686+0000 7fa01effd700 1 --2- 172.21.15.72:0/148828785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02009f240 0x7fa0201317f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa008009840 tx=0x7fa008009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dcc440d23e07e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.686+0000 7fa01e7fc700 1 -- 172.21.15.72:0/148828785 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008011830 con 0x7fa02009f240 2023-10-03T10:15:01.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.686+0000 7fa01e7fc700 1 -- 172.21.15.72:0/148828785 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa008011990 con 0x7fa02009f240 2023-10-03T10:15:01.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.686+0000 7fa01e7fc700 1 -- 172.21.15.72:0/148828785 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008011d20 con 0x7fa02009f240 2023-10-03T10:15:01.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.686+0000 7fa025b4d700 1 -- 172.21.15.72:0/148828785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02009f240 msgr2=0x7fa0201317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.686+0000 7fa025b4d700 1 --2- 172.21.15.72:0/148828785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02009f240 0x7fa0201317f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa008009840 tx=0x7fa008009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:01.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.686+0000 7fa025b4d700 1 -- 172.21.15.72:0/148828785 shutdown_connections 2023-10-03T10:15:01.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.686+0000 7fa025b4d700 1 --2- 172.21.15.72:0/148828785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa02009f650 0x7fa020131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.686+0000 7fa025b4d700 1 --2- 172.21.15.72:0/148828785 >> v2:172.21.15.72:3300/0 conn(0x7fa02009e930 0x7fa02009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.686+0000 7fa025b4d700 1 --2- 172.21.15.72:0/148828785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02009f240 0x7fa0201317f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.686+0000 7fa025b4d700 1 -- 172.21.15.72:0/148828785 >> 172.21.15.72:0/148828785 conn(0x7fa0200a4210 msgr2=0x7fa0200a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.686+0000 7fa025b4d700 1 -- 172.21.15.72:0/148828785 shutdown_connections 2023-10-03T10:15:01.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.686+0000 7fa025b4d700 1 -- 172.21.15.72:0/148828785 wait complete. 2023-10-03T10:15:01.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.688+0000 7fa025b4d700 1 Processor -- start 2023-10-03T10:15:01.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.688+0000 7fa025b4d700 1 -- start start 2023-10-03T10:15:01.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.688+0000 7fa025b4d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa02009e930 0x7fa0201a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.688+0000 7fa025b4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02009f240 0x7fa0201a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.688+0000 7fa025b4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa02009f650 0x7fa0201a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.688+0000 7fa025b4d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0201a5850 con 0x7fa02009f650 2023-10-03T10:15:01.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa025b4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0201a6aa0 con 0x7fa02009f240 2023-10-03T10:15:01.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa025b4d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0201a5e30 con 0x7fa02009e930 2023-10-03T10:15:01.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa01effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02009f240 0x7fa0201a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa01ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa02009f650 0x7fa0201a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa01effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02009f240 0x7fa0201a4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48552/0 (socket says 172.21.15.72:48552) 2023-10-03T10:15:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa01f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa02009e930 0x7fa0201a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa01effd700 1 -- 172.21.15.72:0/518343349 learned_addr learned my addr 172.21.15.72:0/518343349 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa01effd700 1 -- 172.21.15.72:0/518343349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa02009e930 msgr2=0x7fa0201a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa01effd700 1 --2- 172.21.15.72:0/518343349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa02009e930 0x7fa0201a3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa01effd700 1 -- 172.21.15.72:0/518343349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa02009f650 msgr2=0x7fa0201a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa01effd700 1 --2- 172.21.15.72:0/518343349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa02009f650 0x7fa0201a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa01effd700 1 -- 172.21.15.72:0/518343349 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa018009550 con 0x7fa02009f240 2023-10-03T10:15:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa01ffff700 1 --2- 172.21.15.72:0/518343349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa02009f650 0x7fa0201a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:01.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa01effd700 1 --2- 172.21.15.72:0/518343349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02009f240 0x7fa0201a4180 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa008000c00 tx=0x7fa008004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa017fff700 1 -- 172.21.15.72:0/518343349 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080044d0 con 0x7fa02009f240 2023-10-03T10:15:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa017fff700 1 -- 172.21.15.72:0/518343349 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00801f070 con 0x7fa02009f240 2023-10-03T10:15:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa025b4d700 1 -- 172.21.15.72:0/518343349 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa010009a70 con 0x7fa02009f240 2023-10-03T10:15:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa017fff700 1 -- 172.21.15.72:0/518343349 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080038e0 con 0x7fa02009f240 2023-10-03T10:15:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.689+0000 7fa025b4d700 1 -- 172.21.15.72:0/518343349 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0080094a0 con 0x7fa02009f240 2023-10-03T10:15:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.690+0000 7fa017fff700 1 -- 172.21.15.72:0/518343349 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa008003a40 con 0x7fa02009f240 2023-10-03T10:15:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.690+0000 7fa025b4d700 1 -- 172.21.15.72:0/518343349 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0201a0b30 con 0x7fa02009f240 2023-10-03T10:15:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.690+0000 7fa017fff700 1 -- 172.21.15.72:0/518343349 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa008021070 con 0x7fa02009f240 2023-10-03T10:15:01.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.695+0000 7fa017fff700 1 -- 172.21.15.72:0/518343349 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa008015020 con 0x7fa02009f240 2023-10-03T10:15:01.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.841+0000 7f0fae8f9700 1 -- 172.21.15.72:0/3905926809 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0fa8125760 con 0x7f0fa809d6f0 2023-10-03T10:15:01.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.841+0000 7f0fa4ff9700 1 -- 172.21.15.72:0/3905926809 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f98017020 con 0x7f0fa809d6f0 2023-10-03T10:15:01.841 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.843+0000 7f0fae8f9700 1 -- 172.21.15.72:0/3905926809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa809d6f0 msgr2=0x7f0fa8122350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.843+0000 7f0fae8f9700 1 --2- 172.21.15.72:0/3905926809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa809d6f0 0x7f0fa8122350 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800e940 tx=0x7f0f9800ec50 comp rx=0 tx=0).stop 2023-10-03T10:15:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.843+0000 7f0fae8f9700 1 -- 172.21.15.72:0/3905926809 shutdown_connections 2023-10-03T10:15:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.843+0000 7f0fae8f9700 1 --2- 172.21.15.72:0/3905926809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa809e410 0x7f0fa8122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.843+0000 7f0fae8f9700 1 --2- 172.21.15.72:0/3905926809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa809d6f0 0x7f0fa8122350 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.843+0000 7f0fae8f9700 1 --2- 172.21.15.72:0/3905926809 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa809e000 0x7f0fa8122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.843+0000 7f0fae8f9700 1 -- 172.21.15.72:0/3905926809 >> 172.21.15.72:0/3905926809 conn(0x7f0fa8066f50 msgr2=0x7f0fa8070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.843+0000 7f0fae8f9700 1 -- 172.21.15.72:0/3905926809 shutdown_connections 2023-10-03T10:15:01.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.843+0000 7f0fae8f9700 1 -- 172.21.15.72:0/3905926809 wait complete. 2023-10-03T10:15:01.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:01.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.886+0000 7fa025b4d700 1 -- 172.21.15.72:0/518343349 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa0200a3550 con 0x7fa02009f240 2023-10-03T10:15:01.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.887+0000 7fa017fff700 1 -- 172.21.15.72:0/518343349 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa008034090 con 0x7fa02009f240 2023-10-03T10:15:01.886 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:01.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.889+0000 7fa025b4d700 1 -- 172.21.15.72:0/518343349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02009f240 msgr2=0x7fa0201a4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.889+0000 7fa025b4d700 1 --2- 172.21.15.72:0/518343349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02009f240 0x7fa0201a4180 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa008000c00 tx=0x7fa008004750 comp rx=0 tx=0).stop 2023-10-03T10:15:01.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.889+0000 7fa025b4d700 1 -- 172.21.15.72:0/518343349 shutdown_connections 2023-10-03T10:15:01.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.889+0000 7fa025b4d700 1 --2- 172.21.15.72:0/518343349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa02009f650 0x7fa0201a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.889+0000 7fa025b4d700 1 --2- 172.21.15.72:0/518343349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa02009e930 0x7fa0201a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.889+0000 7fa025b4d700 1 --2- 172.21.15.72:0/518343349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa02009f240 0x7fa0201a4180 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.889+0000 7fa025b4d700 1 -- 172.21.15.72:0/518343349 >> 172.21.15.72:0/518343349 conn(0x7fa0200a4210 msgr2=0x7fa0201b8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.889+0000 7fa025b4d700 1 -- 172.21.15.72:0/518343349 shutdown_connections 2023-10-03T10:15:01.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:01.889+0000 7fa025b4d700 1 -- 172.21.15.72:0/518343349 wait complete. 2023-10-03T10:15:01.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:02.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:02.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.146+0000 7f20c9929700 1 Processor -- start 2023-10-03T10:15:02.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.146+0000 7f20c9929700 1 -- start start 2023-10-03T10:15:02.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c9929700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20c409d6f0 0x7f20c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c9929700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20c409e000 0x7f20c4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c9929700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20c409e410 0x7f20c4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c9929700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c409f520 con 0x7f20c409d6f0 2023-10-03T10:15:02.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c9929700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c409f130 con 0x7f20c409e410 2023-10-03T10:15:02.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c9929700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20c409e930 con 0x7f20c409e000 2023-10-03T10:15:02.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20c409d6f0 0x7f20c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20c409e000 0x7f20c4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20c409e410 0x7f20c4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20c409d6f0 0x7f20c409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41456/0 (socket says 172.21.15.72:41456) 2023-10-03T10:15:02.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c2ffd700 1 -- 172.21.15.72:0/1487598422 learned_addr learned my addr 172.21.15.72:0/1487598422 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:02.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c2ffd700 1 -- 172.21.15.72:0/1487598422 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20c409e000 msgr2=0x7f20c4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c2ffd700 1 --2- 172.21.15.72:0/1487598422 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20c409e000 0x7f20c4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c2ffd700 1 -- 172.21.15.72:0/1487598422 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20c409e410 msgr2=0x7f20c4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c2ffd700 1 --2- 172.21.15.72:0/1487598422 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20c409e410 0x7f20c4130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c2ffd700 1 -- 172.21.15.72:0/1487598422 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c409b2d0 con 0x7f20c409d6f0 2023-10-03T10:15:02.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c27fc700 1 --2- 172.21.15.72:0/1487598422 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20c409e000 0x7f20c4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c37fe700 1 --2- 172.21.15.72:0/1487598422 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20c409e410 0x7f20c4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.147+0000 7f20c2ffd700 1 --2- 172.21.15.72:0/1487598422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c409d6f0 0x7f20c409dac0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f20b800bbc0 tx=0x7f20b800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7060f98a1bbb7b68 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.148+0000 7f20c1ffb700 1 -- 172.21.15.72:0/1487598422 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b800dcf0 con 0x7f20c409d6f0 2023-10-03T10:15:02.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.148+0000 7f20c1ffb700 1 -- 172.21.15.72:0/1487598422 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b800de50 con 0x7f20c409d6f0 2023-10-03T10:15:02.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.148+0000 7f20c1ffb700 1 -- 172.21.15.72:0/1487598422 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8010690 con 0x7f20c409d6f0 2023-10-03T10:15:02.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.148+0000 7f20c9929700 1 -- 172.21.15.72:0/1487598422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c409d6f0 msgr2=0x7f20c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.148+0000 7f20c9929700 1 --2- 172.21.15.72:0/1487598422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c409d6f0 0x7f20c409dac0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f20b800bbc0 tx=0x7f20b800bed0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.148+0000 7f20c9929700 1 -- 172.21.15.72:0/1487598422 shutdown_connections 2023-10-03T10:15:02.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.148+0000 7f20c9929700 1 --2- 172.21.15.72:0/1487598422 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20c409e410 0x7f20c4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.148+0000 7f20c9929700 1 --2- 172.21.15.72:0/1487598422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c409d6f0 0x7f20c409dac0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.148+0000 7f20c9929700 1 --2- 172.21.15.72:0/1487598422 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20c409e000 0x7f20c4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.148+0000 7f20c9929700 1 -- 172.21.15.72:0/1487598422 >> 172.21.15.72:0/1487598422 conn(0x7f20c4066f50 msgr2=0x7f20c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.148+0000 7f20c9929700 1 -- 172.21.15.72:0/1487598422 shutdown_connections 2023-10-03T10:15:02.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.148+0000 7f20c9929700 1 -- 172.21.15.72:0/1487598422 wait complete. 2023-10-03T10:15:02.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.149+0000 7f20c9929700 1 Processor -- start 2023-10-03T10:15:02.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.149+0000 7f20c9929700 1 -- start start 2023-10-03T10:15:02.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c9929700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20c409d6f0 0x7f20c411e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c9929700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20c409e000 0x7f20c411e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c9929700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c409e410 0x7f20c411ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c9929700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c40a1a80 con 0x7f20c409e410 2023-10-03T10:15:02.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c9929700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c41202a0 con 0x7f20c409e000 2023-10-03T10:15:02.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c9929700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20c409c700 con 0x7f20c409d6f0 2023-10-03T10:15:02.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c27fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20c409e000 0x7f20c411e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c2ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20c409d6f0 0x7f20c411e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c27fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20c409e000 0x7f20c411e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48574/0 (socket says 172.21.15.72:48574) 2023-10-03T10:15:02.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c27fc700 1 -- 172.21.15.72:0/2296391427 learned_addr learned my addr 172.21.15.72:0/2296391427 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:02.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c37fe700 1 --2- 172.21.15.72:0/2296391427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c409e410 0x7f20c411ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c2ffd700 1 -- 172.21.15.72:0/2296391427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20c409e000 msgr2=0x7f20c411e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c2ffd700 1 --2- 172.21.15.72:0/2296391427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20c409e000 0x7f20c411e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c2ffd700 1 -- 172.21.15.72:0/2296391427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c409e410 msgr2=0x7f20c411ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c2ffd700 1 --2- 172.21.15.72:0/2296391427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c409e410 0x7f20c411ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c2ffd700 1 -- 172.21.15.72:0/2296391427 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b40094a0 con 0x7f20c409d6f0 2023-10-03T10:15:02.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c27fc700 1 --2- 172.21.15.72:0/2296391427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20c409e000 0x7f20c411e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c2ffd700 1 --2- 172.21.15.72:0/2296391427 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20c409d6f0 0x7f20c411e130 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f20b8018000 tx=0x7f20b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20abfff700 1 -- 172.21.15.72:0/2296391427 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b801f070 con 0x7f20c409d6f0 2023-10-03T10:15:02.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20abfff700 1 -- 172.21.15.72:0/2296391427 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b80038b0 con 0x7f20c409d6f0 2023-10-03T10:15:02.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c9929700 1 -- 172.21.15.72:0/2296391427 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20bc009a70 con 0x7f20c409d6f0 2023-10-03T10:15:02.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20abfff700 1 -- 172.21.15.72:0/2296391427 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8003c40 con 0x7f20c409d6f0 2023-10-03T10:15:02.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.150+0000 7f20c9929700 1 -- 172.21.15.72:0/2296391427 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b800b7f0 con 0x7f20c409d6f0 2023-10-03T10:15:02.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.151+0000 7f20abfff700 1 -- 172.21.15.72:0/2296391427 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20b8019400 con 0x7f20c409d6f0 2023-10-03T10:15:02.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.151+0000 7f20abfff700 1 -- 172.21.15.72:0/2296391427 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f20b8042790 con 0x7f20c409d6f0 2023-10-03T10:15:02.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.151+0000 7f20c9929700 1 -- 172.21.15.72:0/2296391427 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c4121570 con 0x7f20c409d6f0 2023-10-03T10:15:02.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.156+0000 7f20abfff700 1 -- 172.21.15.72:0/2296391427 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20b8003da0 con 0x7f20c409d6f0 2023-10-03T10:15:02.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.339+0000 7f20c9929700 1 -- 172.21.15.72:0/2296391427 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f20c4074ea0 con 0x7f20c409d6f0 2023-10-03T10:15:02.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.339+0000 7f20abfff700 1 -- 172.21.15.72:0/2296391427 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20b8028030 con 0x7f20c409d6f0 2023-10-03T10:15:02.339 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:02.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.341+0000 7f20c9929700 1 -- 172.21.15.72:0/2296391427 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20c409d6f0 msgr2=0x7f20c411e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.341+0000 7f20c9929700 1 --2- 172.21.15.72:0/2296391427 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20c409d6f0 0x7f20c411e130 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f20b8018000 tx=0x7f20b8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:02.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.341+0000 7f20c9929700 1 -- 172.21.15.72:0/2296391427 shutdown_connections 2023-10-03T10:15:02.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.341+0000 7f20c9929700 1 --2- 172.21.15.72:0/2296391427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20c409e410 0x7f20c411ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.341+0000 7f20c9929700 1 --2- 172.21.15.72:0/2296391427 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20c409d6f0 0x7f20c411e130 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.341+0000 7f20c9929700 1 --2- 172.21.15.72:0/2296391427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20c409e000 0x7f20c411e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.341+0000 7f20c9929700 1 -- 172.21.15.72:0/2296391427 >> 172.21.15.72:0/2296391427 conn(0x7f20c4066f50 msgr2=0x7f20c406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.341+0000 7f20c9929700 1 -- 172.21.15.72:0/2296391427 shutdown_connections 2023-10-03T10:15:02.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.341+0000 7f20c9929700 1 -- 172.21.15.72:0/2296391427 wait complete. 2023-10-03T10:15:02.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:02.652 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:02.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.776+0000 7f27e4cf6700 1 Processor -- start 2023-10-03T10:15:02.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.776+0000 7f27e4cf6700 1 -- start start 2023-10-03T10:15:02.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.776+0000 7f27e4cf6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27e009d6f0 0x7f27e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.776+0000 7f27e4cf6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27e009e000 0x7f27e01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.776+0000 7f27e4cf6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e009b120 con 0x7f27e009e410 2023-10-03T10:15:02.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.776+0000 7f27e4cf6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e006b460 con 0x7f27e009d6f0 2023-10-03T10:15:02.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.776+0000 7f27e4cf6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27e009a7e0 con 0x7f27e009e000 2023-10-03T10:15:02.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.776+0000 7f27ddd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27e009e000 0x7f27e01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.776+0000 7f27de59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27e009d6f0 0x7f27e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.776+0000 7f27ddd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27e009e000 0x7f27e01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41880/0 (socket says 172.21.15.72:41880) 2023-10-03T10:15:02.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.776+0000 7f27ddd9b700 1 -- 172.21.15.72:0/3928448777 learned_addr learned my addr 172.21.15.72:0/3928448777 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:02.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.777+0000 7f27de59c700 1 -- 172.21.15.72:0/3928448777 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27e009e000 msgr2=0x7f27e01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.777+0000 7f27de59c700 1 --2- 172.21.15.72:0/3928448777 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27e009e000 0x7f27e01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.777+0000 7f27de59c700 1 -- 172.21.15.72:0/3928448777 >> v1:172.21.15.72:6789/0 conn(0x7f27e009e410 legacy=0x7f27e0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.777+0000 7f27de59c700 1 -- 172.21.15.72:0/3928448777 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e009a500 con 0x7f27e009d6f0 2023-10-03T10:15:02.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.777+0000 7f27ddd9b700 1 --2- 172.21.15.72:0/3928448777 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27e009e000 0x7f27e01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.777+0000 7f27de59c700 1 --2- 172.21.15.72:0/3928448777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27e009d6f0 0x7f27e009dac0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009840 tx=0x7f27d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17787a8f6fb7514 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.777+0000 7f27dd59a700 1 -- 172.21.15.72:0/3928448777 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0011830 con 0x7f27e009d6f0 2023-10-03T10:15:02.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.777+0000 7f27dd59a700 1 -- 172.21.15.72:0/3928448777 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d0011990 con 0x7f27e009d6f0 2023-10-03T10:15:02.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.777+0000 7f27dd59a700 1 -- 172.21.15.72:0/3928448777 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0011d20 con 0x7f27e009d6f0 2023-10-03T10:15:02.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.778+0000 7f27e4cf6700 1 -- 172.21.15.72:0/3928448777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27e009d6f0 msgr2=0x7f27e009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.778+0000 7f27e4cf6700 1 --2- 172.21.15.72:0/3928448777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27e009d6f0 0x7f27e009dac0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009840 tx=0x7f27d0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:02.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.778+0000 7f27e4cf6700 1 -- 172.21.15.72:0/3928448777 shutdown_connections 2023-10-03T10:15:02.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.778+0000 7f27e4cf6700 1 --2- 172.21.15.72:0/3928448777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27e009d6f0 0x7f27e009dac0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.778+0000 7f27e4cf6700 1 --2- 172.21.15.72:0/3928448777 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27e009e000 0x7f27e01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.778+0000 7f27e4cf6700 1 -- 172.21.15.72:0/3928448777 >> 172.21.15.72:0/3928448777 conn(0x7f27e0066f50 msgr2=0x7f27e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.778+0000 7f27e4cf6700 1 -- 172.21.15.72:0/3928448777 shutdown_connections 2023-10-03T10:15:02.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.778+0000 7f27e4cf6700 1 -- 172.21.15.72:0/3928448777 wait complete. 2023-10-03T10:15:02.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.779+0000 7f27e4cf6700 1 Processor -- start 2023-10-03T10:15:02.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.779+0000 7f27e4cf6700 1 -- start start 2023-10-03T10:15:02.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.779+0000 7f27e4cf6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27e009d6f0 0x7f27e01a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.779+0000 7f27e4cf6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27e009e000 0x7f27e01a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.779+0000 7f27e4cf6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27e009e410 0x7f27e01a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.779+0000 7f27e4cf6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e01a7340 con 0x7f27e009e000 2023-10-03T10:15:02.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.779+0000 7f27e4cf6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e01a7ac0 con 0x7f27e009e410 2023-10-03T10:15:02.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.779+0000 7f27e4cf6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27e01a80e0 con 0x7f27e009d6f0 2023-10-03T10:15:02.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.779+0000 7f27de59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27e009d6f0 0x7f27e01a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.779+0000 7f27ddd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27e009e000 0x7f27e01a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.779+0000 7f27de59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27e009d6f0 0x7f27e01a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41894/0 (socket says 172.21.15.72:41894) 2023-10-03T10:15:02.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.779+0000 7f27de59c700 1 -- 172.21.15.72:0/1823960839 learned_addr learned my addr 172.21.15.72:0/1823960839 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:02.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.779+0000 7f27ded9d700 1 --2- 172.21.15.72:0/1823960839 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27e009e410 0x7f27e01a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.780+0000 7f27ddd9b700 1 -- 172.21.15.72:0/1823960839 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27e009d6f0 msgr2=0x7f27e01a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.780+0000 7f27ddd9b700 1 --2- 172.21.15.72:0/1823960839 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27e009d6f0 0x7f27e01a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.780+0000 7f27ddd9b700 1 -- 172.21.15.72:0/1823960839 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27e009e410 msgr2=0x7f27e01a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.780+0000 7f27ddd9b700 1 --2- 172.21.15.72:0/1823960839 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27e009e410 0x7f27e01a6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.780+0000 7f27ddd9b700 1 -- 172.21.15.72:0/1823960839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d4009550 con 0x7f27e009e000 2023-10-03T10:15:02.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.780+0000 7f27ddd9b700 1 --2- 172.21.15.72:0/1823960839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27e009e000 0x7f27e01a63f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f27d400e9d0 tx=0x7f27d400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.780+0000 7f27ceffd700 1 -- 172.21.15.72:0/1823960839 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d400ee70 con 0x7f27e009e000 2023-10-03T10:15:02.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.780+0000 7f27ceffd700 1 -- 172.21.15.72:0/1823960839 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d4004030 con 0x7f27e009e000 2023-10-03T10:15:02.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.780+0000 7f27e4cf6700 1 -- 172.21.15.72:0/1823960839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d00094a0 con 0x7f27e009e000 2023-10-03T10:15:02.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.780+0000 7f27ceffd700 1 -- 172.21.15.72:0/1823960839 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d40043c0 con 0x7f27e009e000 2023-10-03T10:15:02.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.780+0000 7f27e4cf6700 1 -- 172.21.15.72:0/1823960839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e00a3220 con 0x7f27e009e000 2023-10-03T10:15:02.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.781+0000 7f27ceffd700 1 -- 172.21.15.72:0/1823960839 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f27d400c850 con 0x7f27e009e000 2023-10-03T10:15:02.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.781+0000 7f27ceffd700 1 -- 172.21.15.72:0/1823960839 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f27d403f530 con 0x7f27e009e000 2023-10-03T10:15:02.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.781+0000 7f27e4cf6700 1 -- 172.21.15.72:0/1823960839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e009c770 con 0x7f27e009e000 2023-10-03T10:15:02.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.786+0000 7f27ceffd700 1 -- 172.21.15.72:0/1823960839 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27d4019d40 con 0x7f27e009e000 2023-10-03T10:15:02.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:02.901 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:02.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.977+0000 7f27e4cf6700 1 -- 172.21.15.72:0/1823960839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f27e0074ea0 con 0x7f27e009e000 2023-10-03T10:15:02.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.978+0000 7f27ceffd700 1 -- 172.21.15.72:0/1823960839 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f27d4019300 con 0x7f27e009e000 2023-10-03T10:15:02.978 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:02.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.980+0000 7f27e4cf6700 1 -- 172.21.15.72:0/1823960839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27e009e000 msgr2=0x7f27e01a63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.980+0000 7f27e4cf6700 1 --2- 172.21.15.72:0/1823960839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27e009e000 0x7f27e01a63f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f27d400e9d0 tx=0x7f27d400ece0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.980+0000 7f27e4cf6700 1 -- 172.21.15.72:0/1823960839 shutdown_connections 2023-10-03T10:15:02.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.980+0000 7f27e4cf6700 1 --2- 172.21.15.72:0/1823960839 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27e009e410 0x7f27e01a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.980+0000 7f27e4cf6700 1 --2- 172.21.15.72:0/1823960839 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27e009d6f0 0x7f27e01a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.980+0000 7f27e4cf6700 1 --2- 172.21.15.72:0/1823960839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27e009e000 0x7f27e01a63f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.980+0000 7f27e4cf6700 1 -- 172.21.15.72:0/1823960839 >> 172.21.15.72:0/1823960839 conn(0x7f27e0066f50 msgr2=0x7f27e01badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.980+0000 7f27e4cf6700 1 -- 172.21.15.72:0/1823960839 shutdown_connections 2023-10-03T10:15:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.980+0000 7f27e4cf6700 1 -- 172.21.15.72:0/1823960839 wait complete. 2023-10-03T10:15:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.981+0000 7fdff13c3700 1 Processor -- start 2023-10-03T10:15:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.981+0000 7fdff13c3700 1 -- start start 2023-10-03T10:15:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.982+0000 7fdff13c3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdfec131810 0x7fdfec131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.982+0000 7fdff13c3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfec09a580 0x7fdfec139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.982+0000 7fdff13c3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfec1313c0 con 0x7fdfec099a40 2023-10-03T10:15:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.982+0000 7fdff13c3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfec06e8c0 con 0x7fdfec131810 2023-10-03T10:15:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.982+0000 7fdff13c3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec071d20 con 0x7fdfec09a580 2023-10-03T10:15:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.982+0000 7fdfeaffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdfec131810 0x7fdfec131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.982+0000 7fdfeb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfec09a580 0x7fdfec139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.982+0000 7fdfea7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdfec099a40 0x7fdfec099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35362/0 (socket says 172.21.15.72:35362) 2023-10-03T10:15:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.982+0000 7fdfeaffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdfec131810 0x7fdfec131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41482/0 (socket says 172.21.15.72:41482) 2023-10-03T10:15:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.982+0000 7fdfeaffd700 1 -- 172.21.15.72:0/2747212714 learned_addr learned my addr 172.21.15.72:0/2747212714 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.982+0000 7fdfeb7fe700 1 -- 172.21.15.72:0/2747212714 >> v2:172.21.15.72:3300/0 conn(0x7fdfec131810 msgr2=0x7fdfec131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.982+0000 7fdfeb7fe700 1 --2- 172.21.15.72:0/2747212714 >> v2:172.21.15.72:3300/0 conn(0x7fdfec131810 0x7fdfec131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.982+0000 7fdfeb7fe700 1 -- 172.21.15.72:0/2747212714 >> v1:172.21.15.72:6789/0 conn(0x7fdfec099a40 legacy=0x7fdfec099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.982+0000 7fdfeb7fe700 1 -- 172.21.15.72:0/2747212714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec0721a0 con 0x7fdfec09a580 2023-10-03T10:15:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.982+0000 7fdfeaffd700 1 --2- 172.21.15.72:0/2747212714 >> v2:172.21.15.72:3300/0 conn(0x7fdfec131810 0x7fdfec131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.983+0000 7fdfeb7fe700 1 --2- 172.21.15.72:0/2747212714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfec09a580 0x7fdfec139660 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009d90 tx=0x7fdfe400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58b8c9b634a413dc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.983+0000 7fdfe9ffb700 1 -- 172.21.15.72:0/2747212714 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe400e070 con 0x7fdfec09a580 2023-10-03T10:15:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.983+0000 7fdfe9ffb700 1 -- 172.21.15.72:0/2747212714 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe400bb20 con 0x7fdfec09a580 2023-10-03T10:15:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.983+0000 7fdfe9ffb700 1 -- 172.21.15.72:0/2747212714 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4012430 con 0x7fdfec09a580 2023-10-03T10:15:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.983+0000 7fdff13c3700 1 -- 172.21.15.72:0/2747212714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfec09a580 msgr2=0x7fdfec139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.983+0000 7fdff13c3700 1 --2- 172.21.15.72:0/2747212714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfec09a580 0x7fdfec139660 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009d90 tx=0x7fdfe400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.984+0000 7fdff13c3700 1 -- 172.21.15.72:0/2747212714 shutdown_connections 2023-10-03T10:15:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.984+0000 7fdff13c3700 1 --2- 172.21.15.72:0/2747212714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfec09a580 0x7fdfec139660 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.984+0000 7fdff13c3700 1 --2- 172.21.15.72:0/2747212714 >> v2:172.21.15.72:3300/0 conn(0x7fdfec131810 0x7fdfec131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.984+0000 7fdff13c3700 1 -- 172.21.15.72:0/2747212714 >> 172.21.15.72:0/2747212714 conn(0x7fdfec0a2aa0 msgr2=0x7fdfec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.984+0000 7fdff13c3700 1 -- 172.21.15.72:0/2747212714 shutdown_connections 2023-10-03T10:15:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.984+0000 7fdff13c3700 1 -- 172.21.15.72:0/2747212714 wait complete. 2023-10-03T10:15:02.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.985+0000 7fdff13c3700 1 Processor -- start 2023-10-03T10:15:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.985+0000 7fdff13c3700 1 -- start start 2023-10-03T10:15:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.985+0000 7fdff13c3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfec099a40 0x7fdfec1197c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.985+0000 7fdff13c3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfec09a580 0x7fdfec119d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.985+0000 7fdff13c3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfec131810 0x7fdfec11a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.985+0000 7fdff13c3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec11d0a0 con 0x7fdfec09a580 2023-10-03T10:15:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.985+0000 7fdff13c3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec12cbb0 con 0x7fdfec131810 2023-10-03T10:15:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.985+0000 7fdff13c3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec11c620 con 0x7fdfec099a40 2023-10-03T10:15:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.985+0000 7fdfeb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfec131810 0x7fdfec11a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.985+0000 7fdfea7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfec09a580 0x7fdfec119d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.985+0000 7fdfeb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfec131810 0x7fdfec11a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48590/0 (socket says 172.21.15.72:48590) 2023-10-03T10:15:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.985+0000 7fdfeb7fe700 1 -- 172.21.15.72:0/2934815017 learned_addr learned my addr 172.21.15.72:0/2934815017 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:02.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.986+0000 7fdfeaffd700 1 --2- 172.21.15.72:0/2934815017 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfec099a40 0x7fdfec1197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.986+0000 7fdfea7fc700 1 -- 172.21.15.72:0/2934815017 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfec099a40 msgr2=0x7fdfec1197c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.986+0000 7fdfea7fc700 1 --2- 172.21.15.72:0/2934815017 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfec099a40 0x7fdfec1197c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.986+0000 7fdfea7fc700 1 -- 172.21.15.72:0/2934815017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfec131810 msgr2=0x7fdfec11a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.986+0000 7fdfea7fc700 1 --2- 172.21.15.72:0/2934815017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfec131810 0x7fdfec11a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.986+0000 7fdfea7fc700 1 -- 172.21.15.72:0/2934815017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc009550 con 0x7fdfec09a580 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.986+0000 7fdfeb7fe700 1 --2- 172.21.15.72:0/2934815017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfec131810 0x7fdfec11a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.986+0000 7fdfea7fc700 1 --2- 172.21.15.72:0/2934815017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfec09a580 0x7fdfec119d00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000c450 tx=0x7fdfe000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.986+0000 7fdfd37fe700 1 -- 172.21.15.72:0/2934815017 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0005cb0 con 0x7fdfec09a580 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.986+0000 7fdfd37fe700 1 -- 172.21.15.72:0/2934815017 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe0005e10 con 0x7fdfec09a580 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.986+0000 7fdff13c3700 1 -- 172.21.15.72:0/2934815017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe4009a70 con 0x7fdfec09a580 2023-10-03T10:15:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.986+0000 7fdfd37fe700 1 -- 172.21.15.72:0/2934815017 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe00072d0 con 0x7fdfec09a580 2023-10-03T10:15:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.986+0000 7fdff13c3700 1 -- 172.21.15.72:0/2934815017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfec11cac0 con 0x7fdfec09a580 2023-10-03T10:15:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.987+0000 7fdfd37fe700 1 -- 172.21.15.72:0/2934815017 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdfe0007430 con 0x7fdfec09a580 2023-10-03T10:15:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.987+0000 7fdff13c3700 1 -- 172.21.15.72:0/2934815017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfec074ea0 con 0x7fdfec09a580 2023-10-03T10:15:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.987+0000 7fdfd37fe700 1 -- 172.21.15.72:0/2934815017 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdfe003ea00 con 0x7fdfec09a580 2023-10-03T10:15:02.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:02.992+0000 7fdfd37fe700 1 -- 172.21.15.72:0/2934815017 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdfe0017080 con 0x7fdfec09a580 2023-10-03T10:15:02.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:03.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.027+0000 7f89c8c0e700 1 Processor -- start 2023-10-03T10:15:03.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.027+0000 7f89c8c0e700 1 -- start start 2023-10-03T10:15:03.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.028+0000 7f89c8c0e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89c409f410 0x7f89c4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.028+0000 7f89c8c0e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89c4136fe0 0x7f89c41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.028+0000 7f89c8c0e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c4070940 con 0x7f89c409e930 2023-10-03T10:15:03.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.028+0000 7f89c8c0e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c406fd60 con 0x7f89c409f410 2023-10-03T10:15:03.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.028+0000 7f89c8c0e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c406fa80 con 0x7f89c4136fe0 2023-10-03T10:15:03.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.029+0000 7f89c2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89c4136fe0 0x7f89c41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.029+0000 7f89c1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89c409f410 0x7f89c4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.029+0000 7f89c2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89c4136fe0 0x7f89c41393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48594/0 (socket says 172.21.15.72:48594) 2023-10-03T10:15:03.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.029+0000 7f89c259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f89c409e930 0x7f89c409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35376/0 (socket says 172.21.15.72:35376) 2023-10-03T10:15:03.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.029+0000 7f89c2d9d700 1 -- 172.21.15.72:0/2879279853 learned_addr learned my addr 172.21.15.72:0/2879279853 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:03.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.029+0000 7f89c1d9b700 1 -- 172.21.15.72:0/2879279853 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89c4136fe0 msgr2=0x7f89c41393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.029+0000 7f89c1d9b700 1 --2- 172.21.15.72:0/2879279853 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89c4136fe0 0x7f89c41393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.029+0000 7f89c1d9b700 1 -- 172.21.15.72:0/2879279853 >> v1:172.21.15.72:6789/0 conn(0x7f89c409e930 legacy=0x7f89c409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.029+0000 7f89c1d9b700 1 -- 172.21.15.72:0/2879279853 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c409fb60 con 0x7f89c409f410 2023-10-03T10:15:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.029+0000 7f89c2d9d700 1 --2- 172.21.15.72:0/2879279853 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89c4136fe0 0x7f89c41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.029+0000 7f89c1d9b700 1 --2- 172.21.15.72:0/2879279853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89c409f410 0x7f89c4136aa0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009840 tx=0x7f89b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2711e59173da8aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.029+0000 7f89c159a700 1 -- 172.21.15.72:0/2879279853 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b8011830 con 0x7f89c409f410 2023-10-03T10:15:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.029+0000 7f89c159a700 1 -- 172.21.15.72:0/2879279853 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b8011990 con 0x7f89c409f410 2023-10-03T10:15:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.029+0000 7f89c159a700 1 -- 172.21.15.72:0/2879279853 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b8011d20 con 0x7f89c409f410 2023-10-03T10:15:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.030+0000 7f89c8c0e700 1 -- 172.21.15.72:0/2879279853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89c409f410 msgr2=0x7f89c4136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.030+0000 7f89c8c0e700 1 --2- 172.21.15.72:0/2879279853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89c409f410 0x7f89c4136aa0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009840 tx=0x7f89b8009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.030+0000 7f89c8c0e700 1 -- 172.21.15.72:0/2879279853 shutdown_connections 2023-10-03T10:15:03.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.030+0000 7f89c8c0e700 1 --2- 172.21.15.72:0/2879279853 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89c4136fe0 0x7f89c41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.030+0000 7f89c8c0e700 1 --2- 172.21.15.72:0/2879279853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89c409f410 0x7f89c4136aa0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.030+0000 7f89c8c0e700 1 -- 172.21.15.72:0/2879279853 >> 172.21.15.72:0/2879279853 conn(0x7f89c40a4210 msgr2=0x7f89c40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.030+0000 7f89c8c0e700 1 -- 172.21.15.72:0/2879279853 shutdown_connections 2023-10-03T10:15:03.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.030+0000 7f89c8c0e700 1 -- 172.21.15.72:0/2879279853 wait complete. 2023-10-03T10:15:03.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.031+0000 7f89c8c0e700 1 Processor -- start 2023-10-03T10:15:03.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.031+0000 7f89c8c0e700 1 -- start start 2023-10-03T10:15:03.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c8c0e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89c409e930 0x7f89c41319f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c8c0e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89c409f410 0x7f89c4131f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c8c0e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89c4136fe0 0x7f89c41c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c8c0e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c4120520 con 0x7f89c409e930 2023-10-03T10:15:03.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c8c0e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c411e7a0 con 0x7f89c409f410 2023-10-03T10:15:03.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c8c0e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89c411f840 con 0x7f89c4136fe0 2023-10-03T10:15:03.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89c409e930 0x7f89c41319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c2d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89c4136fe0 0x7f89c41c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89c409e930 0x7f89c41319f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41494/0 (socket says 172.21.15.72:41494) 2023-10-03T10:15:03.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c259c700 1 -- 172.21.15.72:0/939005272 learned_addr learned my addr 172.21.15.72:0/939005272 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:03.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c1d9b700 1 --2- 172.21.15.72:0/939005272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89c409f410 0x7f89c4131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c2d9d700 1 -- 172.21.15.72:0/939005272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89c409f410 msgr2=0x7f89c4131f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c2d9d700 1 --2- 172.21.15.72:0/939005272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89c409f410 0x7f89c4131f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c2d9d700 1 -- 172.21.15.72:0/939005272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89c409e930 msgr2=0x7f89c41319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c2d9d700 1 --2- 172.21.15.72:0/939005272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89c409e930 0x7f89c41319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c2d9d700 1 -- 172.21.15.72:0/939005272 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89bc009b30 con 0x7f89c4136fe0 2023-10-03T10:15:03.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.032+0000 7f89c259c700 1 --2- 172.21.15.72:0/939005272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89c409e930 0x7f89c41319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:03.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.033+0000 7f89c2d9d700 1 --2- 172.21.15.72:0/939005272 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89c4136fe0 0x7f89c41c6550 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00efc0 tx=0x7f89bc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.033+0000 7f89b2ffd700 1 -- 172.21.15.72:0/939005272 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc018070 con 0x7f89c4136fe0 2023-10-03T10:15:03.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.033+0000 7f89b2ffd700 1 -- 172.21.15.72:0/939005272 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc00f040 con 0x7f89c4136fe0 2023-10-03T10:15:03.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.033+0000 7f89c8c0e700 1 -- 172.21.15.72:0/939005272 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b80094a0 con 0x7f89c4136fe0 2023-10-03T10:15:03.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.033+0000 7f89b2ffd700 1 -- 172.21.15.72:0/939005272 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc003c60 con 0x7f89c4136fe0 2023-10-03T10:15:03.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.033+0000 7f89c8c0e700 1 -- 172.21.15.72:0/939005272 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c411f410 con 0x7f89c4136fe0 2023-10-03T10:15:03.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.034+0000 7f89b2ffd700 1 -- 172.21.15.72:0/939005272 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89bc00c880 con 0x7f89c4136fe0 2023-10-03T10:15:03.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.034+0000 7f89b2ffd700 1 -- 172.21.15.72:0/939005272 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f89bc03f730 con 0x7f89c4136fe0 2023-10-03T10:15:03.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.034+0000 7f89c8c0e700 1 -- 172.21.15.72:0/939005272 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c409e190 con 0x7f89c4136fe0 2023-10-03T10:15:03.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.038+0000 7f89b2ffd700 1 -- 172.21.15.72:0/939005272 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89bc003dc0 con 0x7f89c4136fe0 2023-10-03T10:15:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.186+0000 7fdff13c3700 1 -- 172.21.15.72:0/2934815017 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdfec06b9e0 con 0x7fdfec09a580 2023-10-03T10:15:03.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.186+0000 7fdfd37fe700 1 -- 172.21.15.72:0/2934815017 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdfe001b3b0 con 0x7fdfec09a580 2023-10-03T10:15:03.186 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:03.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.189+0000 7fdff13c3700 1 -- 172.21.15.72:0/2934815017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfec09a580 msgr2=0x7fdfec119d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.189+0000 7fdff13c3700 1 --2- 172.21.15.72:0/2934815017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfec09a580 0x7fdfec119d00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000c450 tx=0x7fdfe000c760 comp rx=0 tx=0).stop 2023-10-03T10:15:03.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.189+0000 7fdff13c3700 1 -- 172.21.15.72:0/2934815017 shutdown_connections 2023-10-03T10:15:03.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.189+0000 7fdff13c3700 1 --2- 172.21.15.72:0/2934815017 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfec131810 0x7fdfec11a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.189+0000 7fdff13c3700 1 --2- 172.21.15.72:0/2934815017 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfec099a40 0x7fdfec1197c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.189+0000 7fdff13c3700 1 --2- 172.21.15.72:0/2934815017 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfec09a580 0x7fdfec119d00 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.189+0000 7fdff13c3700 1 -- 172.21.15.72:0/2934815017 >> 172.21.15.72:0/2934815017 conn(0x7fdfec0a2aa0 msgr2=0x7fdfec12e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.189+0000 7fdff13c3700 1 -- 172.21.15.72:0/2934815017 shutdown_connections 2023-10-03T10:15:03.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.189+0000 7fdff13c3700 1 -- 172.21.15.72:0/2934815017 wait complete. 2023-10-03T10:15:03.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:03.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.230+0000 7f89c8c0e700 1 -- 172.21.15.72:0/939005272 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f89c40a3de0 con 0x7f89c4136fe0 2023-10-03T10:15:03.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.231+0000 7f89b2ffd700 1 -- 172.21.15.72:0/939005272 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f89bc01cbb0 con 0x7f89c4136fe0 2023-10-03T10:15:03.230 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:03.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.233+0000 7f89c8c0e700 1 -- 172.21.15.72:0/939005272 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89c4136fe0 msgr2=0x7f89c41c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.233+0000 7f89c8c0e700 1 --2- 172.21.15.72:0/939005272 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89c4136fe0 0x7f89c41c6550 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00efc0 tx=0x7f89bc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.233+0000 7f89c8c0e700 1 -- 172.21.15.72:0/939005272 shutdown_connections 2023-10-03T10:15:03.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.233+0000 7f89c8c0e700 1 --2- 172.21.15.72:0/939005272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89c409e930 0x7f89c41319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.233+0000 7f89c8c0e700 1 --2- 172.21.15.72:0/939005272 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f89c4136fe0 0x7f89c41c6550 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.233+0000 7f89c8c0e700 1 --2- 172.21.15.72:0/939005272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89c409f410 0x7f89c4131f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.233+0000 7f89c8c0e700 1 -- 172.21.15.72:0/939005272 >> 172.21.15.72:0/939005272 conn(0x7f89c40a4210 msgr2=0x7f89c4134b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.233+0000 7f89c8c0e700 1 -- 172.21.15.72:0/939005272 shutdown_connections 2023-10-03T10:15:03.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.233+0000 7f89c8c0e700 1 -- 172.21.15.72:0/939005272 wait complete. 2023-10-03T10:15:03.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:03.353 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:03.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.475+0000 7febc54c6700 1 Processor -- start 2023-10-03T10:15:03.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.475+0000 7febc54c6700 1 -- start start 2023-10-03T10:15:03.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febc54c6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7febc009d6f0 0x7febc009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febc54c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc009e440 0x7febc0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febc54c6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc009b120 con 0x7febc009e000 2023-10-03T10:15:03.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febc54c6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc006b460 con 0x7febc009d6f0 2023-10-03T10:15:03.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febc54c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc009a7e0 con 0x7febc009e440 2023-10-03T10:15:03.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febbeffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7febc009d6f0 0x7febc009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febbf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc009e440 0x7febc0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febbf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc009e440 0x7febc0134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48612/0 (socket says 172.21.15.72:48612) 2023-10-03T10:15:03.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febbeffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7febc009d6f0 0x7febc009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41504/0 (socket says 172.21.15.72:41504) 2023-10-03T10:15:03.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febbf7fe700 1 -- 172.21.15.72:0/1790954942 learned_addr learned my addr 172.21.15.72:0/1790954942 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:03.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febbf7fe700 1 -- 172.21.15.72:0/1790954942 >> v2:172.21.15.72:3300/0 conn(0x7febc009d6f0 msgr2=0x7febc009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:03.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febbf7fe700 1 --2- 172.21.15.72:0/1790954942 >> v2:172.21.15.72:3300/0 conn(0x7febc009d6f0 0x7febc009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febbf7fe700 1 -- 172.21.15.72:0/1790954942 >> v1:172.21.15.72:6789/0 conn(0x7febc009e000 legacy=0x7febc01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febbf7fe700 1 -- 172.21.15.72:0/1790954942 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc009a500 con 0x7febc009e440 2023-10-03T10:15:03.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febbeffd700 1 --2- 172.21.15.72:0/1790954942 >> v2:172.21.15.72:3300/0 conn(0x7febc009d6f0 0x7febc009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:03.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febbf7fe700 1 --2- 172.21.15.72:0/1790954942 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc009e440 0x7febc0134100 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7febb8009e80 tx=0x7febb800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cd62e14cf806d14 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febbdffb700 1 -- 172.21.15.72:0/1790954942 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800e070 con 0x7febc009e440 2023-10-03T10:15:03.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febbdffb700 1 -- 172.21.15.72:0/1790954942 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb800b8d0 con 0x7febc009e440 2023-10-03T10:15:03.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.476+0000 7febbdffb700 1 -- 172.21.15.72:0/1790954942 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800bc80 con 0x7febc009e440 2023-10-03T10:15:03.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.477+0000 7febc54c6700 1 -- 172.21.15.72:0/1790954942 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc009e440 msgr2=0x7febc0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.477+0000 7febc54c6700 1 --2- 172.21.15.72:0/1790954942 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc009e440 0x7febc0134100 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7febb8009e80 tx=0x7febb800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:03.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.477+0000 7febc54c6700 1 -- 172.21.15.72:0/1790954942 shutdown_connections 2023-10-03T10:15:03.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.477+0000 7febc54c6700 1 --2- 172.21.15.72:0/1790954942 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc009e440 0x7febc0134100 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.477+0000 7febc54c6700 1 --2- 172.21.15.72:0/1790954942 >> v2:172.21.15.72:3300/0 conn(0x7febc009d6f0 0x7febc009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.477+0000 7febc54c6700 1 -- 172.21.15.72:0/1790954942 >> 172.21.15.72:0/1790954942 conn(0x7febc0066f50 msgr2=0x7febc009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.477+0000 7febc54c6700 1 -- 172.21.15.72:0/1790954942 shutdown_connections 2023-10-03T10:15:03.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.477+0000 7febc54c6700 1 -- 172.21.15.72:0/1790954942 wait complete. 2023-10-03T10:15:03.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.478+0000 7febc54c6700 1 Processor -- start 2023-10-03T10:15:03.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.478+0000 7febc54c6700 1 -- start start 2023-10-03T10:15:03.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.478+0000 7febc54c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febc009d6f0 0x7febc01a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.478+0000 7febc54c6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc009e000 0x7febc01a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.478+0000 7febc54c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc009e440 0x7febc01a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:03.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.478+0000 7febc54c6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc01aa360 con 0x7febc009e000 2023-10-03T10:15:03.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.478+0000 7febc54c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc01a99a0 con 0x7febc009e440 2023-10-03T10:15:03.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.478+0000 7febc54c6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febc01a8ce0 con 0x7febc009d6f0 2023-10-03T10:15:03.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.478+0000 7febbe7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc009e000 0x7febc01a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7febbeffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febc009d6f0 0x7febc01a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.478+0000 7febbf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc009e440 0x7febc01a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:03.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7febbeffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febc009d6f0 0x7febc01a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41930/0 (socket says 172.21.15.72:41930) 2023-10-03T10:15:03.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7febbf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc009e440 0x7febc01a6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48624/0 (socket says 172.21.15.72:48624) 2023-10-03T10:15:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7febbe7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc009e000 0x7febc01a6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41506/0 (socket says 172.21.15.72:41506) 2023-10-03T10:15:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7febbeffd700 1 -- 172.21.15.72:0/1449634154 learned_addr learned my addr 172.21.15.72:0/1449634154 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7febbeffd700 1 -- 172.21.15.72:0/1449634154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc009e440 msgr2=0x7febc01a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7febbeffd700 1 --2- 172.21.15.72:0/1449634154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc009e440 0x7febc01a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7febbeffd700 1 -- 172.21.15.72:0/1449634154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc009e000 msgr2=0x7febc01a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7febbeffd700 1 --2- 172.21.15.72:0/1449634154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc009e000 0x7febc01a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7febbeffd700 1 -- 172.21.15.72:0/1449634154 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb40094a0 con 0x7febc009d6f0 2023-10-03T10:15:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7febbf7fe700 1 --2- 172.21.15.72:0/1449634154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc009e440 0x7febc01a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7febbe7fc700 1 --2- 172.21.15.72:0/1449634154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc009e000 0x7febc01a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7febbeffd700 1 --2- 172.21.15.72:0/1449634154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febc009d6f0 0x7febc01a5ed0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7febb400ec10 tx=0x7febb400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7feba77fe700 1 -- 172.21.15.72:0/1449634154 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400c850 con 0x7febc009d6f0 2023-10-03T10:15:03.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7feba77fe700 1 -- 172.21.15.72:0/1449634154 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb400c9b0 con 0x7febc009d6f0 2023-10-03T10:15:03.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7febc54c6700 1 -- 172.21.15.72:0/1449634154 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb8009b30 con 0x7febc009d6f0 2023-10-03T10:15:03.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7feba77fe700 1 -- 172.21.15.72:0/1449634154 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400cd20 con 0x7febc009d6f0 2023-10-03T10:15:03.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.479+0000 7febc54c6700 1 -- 172.21.15.72:0/1449634154 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc01a7a90 con 0x7febc009d6f0 2023-10-03T10:15:03.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.480+0000 7feba77fe700 1 -- 172.21.15.72:0/1449634154 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7febb4013470 con 0x7febc009d6f0 2023-10-03T10:15:03.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.480+0000 7feba77fe700 1 -- 172.21.15.72:0/1449634154 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7febb403fb30 con 0x7febc009d6f0 2023-10-03T10:15:03.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.480+0000 7febc54c6700 1 -- 172.21.15.72:0/1449634154 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc0074ea0 con 0x7febc009d6f0 2023-10-03T10:15:03.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.485+0000 7feba77fe700 1 -- 172.21.15.72:0/1449634154 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7febb4021080 con 0x7febc009d6f0 2023-10-03T10:15:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.670+0000 7febc54c6700 1 -- 172.21.15.72:0/1449634154 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7febc009f420 con 0x7febc009d6f0 2023-10-03T10:15:03.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.670+0000 7feba77fe700 1 -- 172.21.15.72:0/1449634154 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7febb4013720 con 0x7febc009d6f0 2023-10-03T10:15:03.670 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.672+0000 7febc54c6700 1 -- 172.21.15.72:0/1449634154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febc009d6f0 msgr2=0x7febc01a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.672+0000 7febc54c6700 1 --2- 172.21.15.72:0/1449634154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febc009d6f0 0x7febc01a5ed0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7febb400ec10 tx=0x7febb400ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.672+0000 7febc54c6700 1 -- 172.21.15.72:0/1449634154 shutdown_connections 2023-10-03T10:15:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.672+0000 7febc54c6700 1 --2- 172.21.15.72:0/1449634154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7febc009e440 0x7febc01a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.672+0000 7febc54c6700 1 --2- 172.21.15.72:0/1449634154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7febc009d6f0 0x7febc01a5ed0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.672+0000 7febc54c6700 1 --2- 172.21.15.72:0/1449634154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febc009e000 0x7febc01a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.672+0000 7febc54c6700 1 -- 172.21.15.72:0/1449634154 >> 172.21.15.72:0/1449634154 conn(0x7febc0066f50 msgr2=0x7febc01baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.672+0000 7febc54c6700 1 -- 172.21.15.72:0/1449634154 shutdown_connections 2023-10-03T10:15:03.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:03.672+0000 7febc54c6700 1 -- 172.21.15.72:0/1449634154 wait complete. 2023-10-03T10:15:03.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:03.995 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:04.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.118+0000 7f22c0bcc700 1 Processor -- start 2023-10-03T10:15:04.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.118+0000 7f22c0bcc700 1 -- start start 2023-10-03T10:15:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.119+0000 7f22c0bcc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22bc133a80 0x7f22bc133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.119+0000 7f22c0bcc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22bc130a70 0x7f22bc13b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.119+0000 7f22c0bcc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc06bc00 con 0x7f22bc12ff20 2023-10-03T10:15:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.119+0000 7f22c0bcc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc06c570 con 0x7f22bc133a80 2023-10-03T10:15:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.119+0000 7f22c0bcc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0a0040 con 0x7f22bc130a70 2023-10-03T10:15:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.119+0000 7f22bad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22bc130a70 0x7f22bc13b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.119+0000 7f22ba59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22bc133a80 0x7f22bc133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.119+0000 7f22bad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22bc130a70 0x7f22bc13b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48638/0 (socket says 172.21.15.72:48638) 2023-10-03T10:15:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.119+0000 7f22bad9d700 1 -- 172.21.15.72:0/2420806662 learned_addr learned my addr 172.21.15.72:0/2420806662 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.119+0000 7f22ba59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22bc133a80 0x7f22bc133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41514/0 (socket says 172.21.15.72:41514) 2023-10-03T10:15:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.119+0000 7f22ba59c700 1 -- 172.21.15.72:0/2420806662 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22bc130a70 msgr2=0x7f22bc13b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.119+0000 7f22ba59c700 1 --2- 172.21.15.72:0/2420806662 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22bc130a70 0x7f22bc13b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.119+0000 7f22ba59c700 1 -- 172.21.15.72:0/2420806662 >> v1:172.21.15.72:6789/0 conn(0x7f22bc12ff20 legacy=0x7f22bc130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.119+0000 7f22ba59c700 1 -- 172.21.15.72:0/2420806662 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc133860 con 0x7f22bc133a80 2023-10-03T10:15:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.119+0000 7f22bad9d700 1 --2- 172.21.15.72:0/2420806662 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22bc130a70 0x7f22bc13b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.120+0000 7f22ba59c700 1 --2- 172.21.15.72:0/2420806662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22bc133a80 0x7f22bc133e50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009840 tx=0x7f22a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929560044f5270b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.120+0000 7f22b959a700 1 -- 172.21.15.72:0/2420806662 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4011830 con 0x7f22bc133a80 2023-10-03T10:15:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.120+0000 7f22b959a700 1 -- 172.21.15.72:0/2420806662 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a4011990 con 0x7f22bc133a80 2023-10-03T10:15:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.120+0000 7f22b959a700 1 -- 172.21.15.72:0/2420806662 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4011d20 con 0x7f22bc133a80 2023-10-03T10:15:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.120+0000 7f22c0bcc700 1 -- 172.21.15.72:0/2420806662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22bc133a80 msgr2=0x7f22bc133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.120+0000 7f22c0bcc700 1 --2- 172.21.15.72:0/2420806662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22bc133a80 0x7f22bc133e50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009840 tx=0x7f22a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.120+0000 7f22c0bcc700 1 -- 172.21.15.72:0/2420806662 shutdown_connections 2023-10-03T10:15:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.120+0000 7f22c0bcc700 1 --2- 172.21.15.72:0/2420806662 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22bc130a70 0x7f22bc13b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.120+0000 7f22c0bcc700 1 --2- 172.21.15.72:0/2420806662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22bc133a80 0x7f22bc133e50 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.120+0000 7f22c0bcc700 1 -- 172.21.15.72:0/2420806662 >> 172.21.15.72:0/2420806662 conn(0x7f22bc0a4210 msgr2=0x7f22bc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.120+0000 7f22c0bcc700 1 -- 172.21.15.72:0/2420806662 shutdown_connections 2023-10-03T10:15:04.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.120+0000 7f22c0bcc700 1 -- 172.21.15.72:0/2420806662 wait complete. 2023-10-03T10:15:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.121+0000 7f22c0bcc700 1 Processor -- start 2023-10-03T10:15:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.121+0000 7f22c0bcc700 1 -- start start 2023-10-03T10:15:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22c0bcc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22bc12ff20 0x7f22bc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22c0bcc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22bc130a70 0x7f22bc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22c0bcc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22bc133a80 0x7f22bc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22c0bcc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc11ed70 con 0x7f22bc130a70 2023-10-03T10:15:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22c0bcc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc11ea90 con 0x7f22bc12ff20 2023-10-03T10:15:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22c0bcc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc120090 con 0x7f22bc133a80 2023-10-03T10:15:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22b9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22bc130a70 0x7f22bc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22bad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22bc133a80 0x7f22bc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22ba59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22bc12ff20 0x7f22bc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22bad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22bc133a80 0x7f22bc09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41936/0 (socket says 172.21.15.72:41936) 2023-10-03T10:15:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22b9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22bc130a70 0x7f22bc09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41520/0 (socket says 172.21.15.72:41520) 2023-10-03T10:15:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22ba59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22bc12ff20 0x7f22bc09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48648/0 (socket says 172.21.15.72:48648) 2023-10-03T10:15:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22bad9d700 1 -- 172.21.15.72:0/598634631 learned_addr learned my addr 172.21.15.72:0/598634631 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22ba59c700 1 -- 172.21.15.72:0/598634631 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22bc133a80 msgr2=0x7f22bc09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22ba59c700 1 --2- 172.21.15.72:0/598634631 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22bc133a80 0x7f22bc09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22ba59c700 1 -- 172.21.15.72:0/598634631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22bc130a70 msgr2=0x7f22bc09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22ba59c700 1 --2- 172.21.15.72:0/598634631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22bc130a70 0x7f22bc09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22ba59c700 1 -- 172.21.15.72:0/598634631 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b4009b30 con 0x7f22bc12ff20 2023-10-03T10:15:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22b9d9b700 1 --2- 172.21.15.72:0/598634631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22bc130a70 0x7f22bc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22bad9d700 1 --2- 172.21.15.72:0/598634631 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22bc133a80 0x7f22bc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.122+0000 7f22ba59c700 1 --2- 172.21.15.72:0/598634631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22bc12ff20 0x7f22bc09c480 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f22a4016000 tx=0x7f22a4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.123+0000 7f22b2ffd700 1 -- 172.21.15.72:0/598634631 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a40045d0 con 0x7f22bc12ff20 2023-10-03T10:15:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.123+0000 7f22b2ffd700 1 -- 172.21.15.72:0/598634631 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a401f070 con 0x7f22bc12ff20 2023-10-03T10:15:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.123+0000 7f22c0bcc700 1 -- 172.21.15.72:0/598634631 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a40094a0 con 0x7f22bc12ff20 2023-10-03T10:15:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.123+0000 7f22b2ffd700 1 -- 172.21.15.72:0/598634631 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a40038e0 con 0x7f22bc12ff20 2023-10-03T10:15:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.123+0000 7f22c0bcc700 1 -- 172.21.15.72:0/598634631 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc12d300 con 0x7f22bc12ff20 2023-10-03T10:15:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.123+0000 7f22b2ffd700 1 -- 172.21.15.72:0/598634631 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22a4003a40 con 0x7f22bc12ff20 2023-10-03T10:15:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.123+0000 7f22b2ffd700 1 -- 172.21.15.72:0/598634631 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f22a4021070 con 0x7f22bc12ff20 2023-10-03T10:15:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.124+0000 7f22c0bcc700 1 -- 172.21.15.72:0/598634631 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22bc0a20c0 con 0x7f22bc12ff20 2023-10-03T10:15:04.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.128+0000 7f22b2ffd700 1 -- 172.21.15.72:0/598634631 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22a4015070 con 0x7f22bc12ff20 2023-10-03T10:15:04.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:04.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.318+0000 7f22c0bcc700 1 -- 172.21.15.72:0/598634631 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f22bc074ea0 con 0x7f22bc12ff20 2023-10-03T10:15:04.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.318+0000 7f22b2ffd700 1 -- 172.21.15.72:0/598634631 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f22a4010380 con 0x7f22bc12ff20 2023-10-03T10:15:04.318 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:04.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.321+0000 7f22c0bcc700 1 -- 172.21.15.72:0/598634631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22bc12ff20 msgr2=0x7f22bc09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.321+0000 7f22c0bcc700 1 --2- 172.21.15.72:0/598634631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22bc12ff20 0x7f22bc09c480 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f22a4016000 tx=0x7f22a4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:04.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.321+0000 7f22c0bcc700 1 -- 172.21.15.72:0/598634631 shutdown_connections 2023-10-03T10:15:04.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.321+0000 7f22c0bcc700 1 --2- 172.21.15.72:0/598634631 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22bc133a80 0x7f22bc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.321+0000 7f22c0bcc700 1 --2- 172.21.15.72:0/598634631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22bc12ff20 0x7f22bc09c480 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.321+0000 7f22c0bcc700 1 --2- 172.21.15.72:0/598634631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22bc130a70 0x7f22bc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.321+0000 7f22c0bcc700 1 -- 172.21.15.72:0/598634631 >> 172.21.15.72:0/598634631 conn(0x7f22bc0a4210 msgr2=0x7f22bc09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.321+0000 7f22c0bcc700 1 -- 172.21.15.72:0/598634631 shutdown_connections 2023-10-03T10:15:04.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.321+0000 7f22c0bcc700 1 -- 172.21.15.72:0/598634631 wait complete. 2023-10-03T10:15:04.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.326+0000 7fb504d5f700 1 Processor -- start 2023-10-03T10:15:04.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.326+0000 7fb504d5f700 1 -- start start 2023-10-03T10:15:04.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.327+0000 7fb504d5f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb50009e1d0 0x7fb500135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.327+0000 7fb504d5f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb500135e50 0x7fb500138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.327+0000 7fb504d5f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50009f130 con 0x7fb50009d6f0 2023-10-03T10:15:04.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.327+0000 7fb504d5f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50009f520 con 0x7fb500135e50 2023-10-03T10:15:04.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.327+0000 7fb504d5f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb50009e930 con 0x7fb50009e1d0 2023-10-03T10:15:04.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.327+0000 7fb4fdd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb50009e1d0 0x7fb500135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.327+0000 7fb4fdd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb50009e1d0 0x7fb500135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41942/0 (socket says 172.21.15.72:41942) 2023-10-03T10:15:04.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.327+0000 7fb4fe59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb50009d6f0 0x7fb50009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35404/0 (socket says 172.21.15.72:35404) 2023-10-03T10:15:04.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.327+0000 7fb4fdd9b700 1 -- 172.21.15.72:0/4098790414 learned_addr learned my addr 172.21.15.72:0/4098790414 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:04.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.327+0000 7fb4fed9d700 1 --2- 172.21.15.72:0/4098790414 >> v2:172.21.15.72:3300/0 conn(0x7fb500135e50 0x7fb500138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.327+0000 7fb4fdd9b700 1 -- 172.21.15.72:0/4098790414 >> v2:172.21.15.72:3300/0 conn(0x7fb500135e50 msgr2=0x7fb500138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.327+0000 7fb4fdd9b700 1 --2- 172.21.15.72:0/4098790414 >> v2:172.21.15.72:3300/0 conn(0x7fb500135e50 0x7fb500138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.327+0000 7fb4fdd9b700 1 -- 172.21.15.72:0/4098790414 >> v1:172.21.15.72:6789/0 conn(0x7fb50009d6f0 legacy=0x7fb50009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.327+0000 7fb4fdd9b700 1 -- 172.21.15.72:0/4098790414 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50009b2d0 con 0x7fb50009e1d0 2023-10-03T10:15:04.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.328+0000 7fb4fdd9b700 1 --2- 172.21.15.72:0/4098790414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb50009e1d0 0x7fb500135910 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400bbc0 tx=0x7fb4f400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cd67329b2ed3e61 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.328+0000 7fb4fd59a700 1 -- 172.21.15.72:0/4098790414 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400dcf0 con 0x7fb50009e1d0 2023-10-03T10:15:04.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.328+0000 7fb4fd59a700 1 -- 172.21.15.72:0/4098790414 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f400de50 con 0x7fb50009e1d0 2023-10-03T10:15:04.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.328+0000 7fb4fd59a700 1 -- 172.21.15.72:0/4098790414 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4010690 con 0x7fb50009e1d0 2023-10-03T10:15:04.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.328+0000 7fb504d5f700 1 -- 172.21.15.72:0/4098790414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb50009e1d0 msgr2=0x7fb500135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.328+0000 7fb504d5f700 1 --2- 172.21.15.72:0/4098790414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb50009e1d0 0x7fb500135910 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400bbc0 tx=0x7fb4f400bed0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.329+0000 7fb504d5f700 1 -- 172.21.15.72:0/4098790414 shutdown_connections 2023-10-03T10:15:04.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.329+0000 7fb504d5f700 1 --2- 172.21.15.72:0/4098790414 >> v2:172.21.15.72:3300/0 conn(0x7fb500135e50 0x7fb500138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.329+0000 7fb504d5f700 1 --2- 172.21.15.72:0/4098790414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb50009e1d0 0x7fb500135910 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.329+0000 7fb504d5f700 1 -- 172.21.15.72:0/4098790414 >> 172.21.15.72:0/4098790414 conn(0x7fb500066f50 msgr2=0x7fb50009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.329+0000 7fb504d5f700 1 -- 172.21.15.72:0/4098790414 shutdown_connections 2023-10-03T10:15:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.329+0000 7fb504d5f700 1 -- 172.21.15.72:0/4098790414 wait complete. 2023-10-03T10:15:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.330+0000 7fb504d5f700 1 Processor -- start 2023-10-03T10:15:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.330+0000 7fb504d5f700 1 -- start start 2023-10-03T10:15:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb504d5f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb50009d6f0 0x7fb5001c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb504d5f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb50009e1d0 0x7fb5001c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb504d5f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb500135e50 0x7fb5001c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb504d5f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50011b420 con 0x7fb500135e50 2023-10-03T10:15:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb504d5f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50011b230 con 0x7fb50009e1d0 2023-10-03T10:15:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb504d5f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb50011d120 con 0x7fb50009d6f0 2023-10-03T10:15:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb4fe59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb50009d6f0 0x7fb5001c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb4fe59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb50009d6f0 0x7fb5001c4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41948/0 (socket says 172.21.15.72:41948) 2023-10-03T10:15:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb4fe59c700 1 -- 172.21.15.72:0/243884710 learned_addr learned my addr 172.21.15.72:0/243884710 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb4fed9d700 1 --2- 172.21.15.72:0/243884710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb500135e50 0x7fb5001c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb4fdd9b700 1 --2- 172.21.15.72:0/243884710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb50009e1d0 0x7fb5001c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb4fe59c700 1 -- 172.21.15.72:0/243884710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb50009e1d0 msgr2=0x7fb5001c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb4fe59c700 1 --2- 172.21.15.72:0/243884710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb50009e1d0 0x7fb5001c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb4fe59c700 1 -- 172.21.15.72:0/243884710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb500135e50 msgr2=0x7fb5001c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb4fe59c700 1 --2- 172.21.15.72:0/243884710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb500135e50 0x7fb5001c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb4fe59c700 1 -- 172.21.15.72:0/243884710 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f400b7f0 con 0x7fb50009d6f0 2023-10-03T10:15:04.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.331+0000 7fb4fe59c700 1 --2- 172.21.15.72:0/243884710 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb50009d6f0 0x7fb5001c4130 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000c550 tx=0x7fb4f000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.332+0000 7fb4eeffd700 1 -- 172.21.15.72:0/243884710 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0005cb0 con 0x7fb50009d6f0 2023-10-03T10:15:04.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.332+0000 7fb4eeffd700 1 -- 172.21.15.72:0/243884710 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f0005e10 con 0x7fb50009d6f0 2023-10-03T10:15:04.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.332+0000 7fb504d5f700 1 -- 172.21.15.72:0/243884710 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5000a1d00 con 0x7fb50009d6f0 2023-10-03T10:15:04.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.332+0000 7fb4eeffd700 1 -- 172.21.15.72:0/243884710 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00072d0 con 0x7fb50009d6f0 2023-10-03T10:15:04.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.332+0000 7fb504d5f700 1 -- 172.21.15.72:0/243884710 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50011ce40 con 0x7fb50009d6f0 2023-10-03T10:15:04.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.333+0000 7fb504d5f700 1 -- 172.21.15.72:0/243884710 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb50011cbd0 con 0x7fb50009d6f0 2023-10-03T10:15:04.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.333+0000 7fb4eeffd700 1 -- 172.21.15.72:0/243884710 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4f0007430 con 0x7fb50009d6f0 2023-10-03T10:15:04.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.333+0000 7fb4eeffd700 1 -- 172.21.15.72:0/243884710 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb4f003eec0 con 0x7fb50009d6f0 2023-10-03T10:15:04.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:04.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.338+0000 7fb4eeffd700 1 -- 172.21.15.72:0/243884710 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4f001b3b0 con 0x7fb50009d6f0 2023-10-03T10:15:04.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.373+0000 7f53f192a700 1 Processor -- start 2023-10-03T10:15:04.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.373+0000 7f53f192a700 1 -- start start 2023-10-03T10:15:04.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.373+0000 7f53f192a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f53ec0a0a30 0x7f53ec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.373+0000 7f53f192a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53ec0a1340 0x7f53ec133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.373+0000 7f53f192a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ec09edd0 con 0x7f53ec133fa0 2023-10-03T10:15:04.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.373+0000 7f53f192a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ec09e1f0 con 0x7f53ec0a0a30 2023-10-03T10:15:04.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.373+0000 7f53f192a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec09dc50 con 0x7f53ec0a1340 2023-10-03T10:15:04.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.373+0000 7f53eaffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f53ec0a0a30 0x7f53ec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.373+0000 7f53ea7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53ec0a1340 0x7f53ec133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.374+0000 7f53eaffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f53ec0a0a30 0x7f53ec0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41550/0 (socket says 172.21.15.72:41550) 2023-10-03T10:15:04.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.374+0000 7f53eaffd700 1 -- 172.21.15.72:0/2518256306 learned_addr learned my addr 172.21.15.72:0/2518256306 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:04.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.374+0000 7f53eb7fe700 1 --1- 172.21.15.72:0/2518256306 >> v1:172.21.15.72:6789/0 conn(0x7f53ec133fa0 0x7f53ec13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35416/0 (socket says 172.21.15.72:35416) 2023-10-03T10:15:04.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.374+0000 7f53eaffd700 1 -- 172.21.15.72:0/2518256306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53ec0a1340 msgr2=0x7f53ec133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.374+0000 7f53eaffd700 1 --2- 172.21.15.72:0/2518256306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53ec0a1340 0x7f53ec133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.374+0000 7f53eaffd700 1 -- 172.21.15.72:0/2518256306 >> v1:172.21.15.72:6789/0 conn(0x7f53ec133fa0 legacy=0x7f53ec13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.374+0000 7f53e9ffb700 1 -- 172.21.15.72:0/2518256306 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100847531 0 0) 0x7f53ec09edd0 con 0x7f53ec133fa0 2023-10-03T10:15:04.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.374+0000 7f53eaffd700 1 -- 172.21.15.72:0/2518256306 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec0a1fe0 con 0x7f53ec0a0a30 2023-10-03T10:15:04.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.374+0000 7f53eaffd700 1 --2- 172.21.15.72:0/2518256306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53ec0a0a30 0x7f53ec0a0e00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0098f0 tx=0x7f53dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2540ad8cddb95f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.374+0000 7f53e9ffb700 1 -- 172.21.15.72:0/2518256306 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc011830 con 0x7f53ec0a0a30 2023-10-03T10:15:04.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.374+0000 7f53e9ffb700 1 -- 172.21.15.72:0/2518256306 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc011990 con 0x7f53ec0a0a30 2023-10-03T10:15:04.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.374+0000 7f53e9ffb700 1 -- 172.21.15.72:0/2518256306 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc011d20 con 0x7f53ec0a0a30 2023-10-03T10:15:04.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.375+0000 7f53f192a700 1 -- 172.21.15.72:0/2518256306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53ec0a0a30 msgr2=0x7f53ec0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.375+0000 7f53f192a700 1 --2- 172.21.15.72:0/2518256306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53ec0a0a30 0x7f53ec0a0e00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0098f0 tx=0x7f53dc009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:04.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.375+0000 7f53f192a700 1 -- 172.21.15.72:0/2518256306 shutdown_connections 2023-10-03T10:15:04.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.375+0000 7f53f192a700 1 --2- 172.21.15.72:0/2518256306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53ec0a0a30 0x7f53ec0a0e00 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.375+0000 7f53f192a700 1 --2- 172.21.15.72:0/2518256306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53ec0a1340 0x7f53ec133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.375+0000 7f53f192a700 1 -- 172.21.15.72:0/2518256306 >> 172.21.15.72:0/2518256306 conn(0x7f53ec0a6550 msgr2=0x7f53ec0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.375+0000 7f53f192a700 1 -- 172.21.15.72:0/2518256306 shutdown_connections 2023-10-03T10:15:04.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.375+0000 7f53f192a700 1 -- 172.21.15.72:0/2518256306 wait complete. 2023-10-03T10:15:04.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.376+0000 7f53f192a700 1 Processor -- start 2023-10-03T10:15:04.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.376+0000 7f53f192a700 1 -- start start 2023-10-03T10:15:04.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.376+0000 7f53f192a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f53ec0a0a30 0x7f53ec122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.376+0000 7f53f192a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53ec0a1340 0x7f53ec122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.376+0000 7f53f192a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53ec133fa0 0x7f53ec123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.376+0000 7f53f192a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec124520 con 0x7f53ec133fa0 2023-10-03T10:15:04.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.376+0000 7f53f192a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec133320 con 0x7f53ec0a1340 2023-10-03T10:15:04.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.376+0000 7f53f192a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53ec1262b0 con 0x7f53ec0a0a30 2023-10-03T10:15:04.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.376+0000 7f53eb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53ec133fa0 0x7f53ec123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.376+0000 7f53ea7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53ec0a1340 0x7f53ec122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.376+0000 7f53ea7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53ec0a1340 0x7f53ec122cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48676/0 (socket says 172.21.15.72:48676) 2023-10-03T10:15:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.376+0000 7f53eb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53ec133fa0 0x7f53ec123210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41554/0 (socket says 172.21.15.72:41554) 2023-10-03T10:15:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.376+0000 7f53ea7fc700 1 -- 172.21.15.72:0/2524510768 learned_addr learned my addr 172.21.15.72:0/2524510768 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.376+0000 7f53eaffd700 1 --2- 172.21.15.72:0/2524510768 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f53ec0a0a30 0x7f53ec122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.377+0000 7f53ea7fc700 1 -- 172.21.15.72:0/2524510768 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f53ec0a0a30 msgr2=0x7f53ec122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.377+0000 7f53ea7fc700 1 --2- 172.21.15.72:0/2524510768 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f53ec0a0a30 0x7f53ec122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.377+0000 7f53ea7fc700 1 -- 172.21.15.72:0/2524510768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53ec133fa0 msgr2=0x7f53ec123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.377+0000 7f53ea7fc700 1 --2- 172.21.15.72:0/2524510768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53ec133fa0 0x7f53ec123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.377+0000 7f53ea7fc700 1 -- 172.21.15.72:0/2524510768 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc009550 con 0x7f53ec0a1340 2023-10-03T10:15:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.377+0000 7f53ea7fc700 1 --2- 172.21.15.72:0/2524510768 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53ec0a1340 0x7f53ec122cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f53e000e9b0 tx=0x7f53e000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.377+0000 7f53d3fff700 1 -- 172.21.15.72:0/2524510768 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e0009710 con 0x7f53ec0a1340 2023-10-03T10:15:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.377+0000 7f53d3fff700 1 -- 172.21.15.72:0/2524510768 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e000ee50 con 0x7f53ec0a1340 2023-10-03T10:15:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.377+0000 7f53f192a700 1 -- 172.21.15.72:0/2524510768 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ec0a5220 con 0x7f53ec0a1340 2023-10-03T10:15:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.377+0000 7f53d3fff700 1 -- 172.21.15.72:0/2524510768 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e000ca50 con 0x7f53ec0a1340 2023-10-03T10:15:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.377+0000 7f53f192a700 1 -- 172.21.15.72:0/2524510768 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ec125fd0 con 0x7f53ec0a1340 2023-10-03T10:15:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.378+0000 7f53d3fff700 1 -- 172.21.15.72:0/2524510768 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53e000cbb0 con 0x7f53ec0a1340 2023-10-03T10:15:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.378+0000 7f53d3fff700 1 -- 172.21.15.72:0/2524510768 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f53e003fa60 con 0x7f53ec0a1340 2023-10-03T10:15:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.378+0000 7f53f192a700 1 -- 172.21.15.72:0/2524510768 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ec074ea0 con 0x7f53ec0a1340 2023-10-03T10:15:04.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.382+0000 7f53d3fff700 1 -- 172.21.15.72:0/2524510768 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53e0017030 con 0x7f53ec0a1340 2023-10-03T10:15:04.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.532+0000 7fb504d5f700 1 -- 172.21.15.72:0/243884710 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb50004ea50 con 0x7fb50009d6f0 2023-10-03T10:15:04.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.533+0000 7fb4eeffd700 1 -- 172.21.15.72:0/243884710 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4f0017020 con 0x7fb50009d6f0 2023-10-03T10:15:04.532 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:04.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.535+0000 7fb504d5f700 1 -- 172.21.15.72:0/243884710 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb50009d6f0 msgr2=0x7fb5001c4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.535+0000 7fb504d5f700 1 --2- 172.21.15.72:0/243884710 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb50009d6f0 0x7fb5001c4130 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000c550 tx=0x7fb4f000c860 comp rx=0 tx=0).stop 2023-10-03T10:15:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.535+0000 7fb504d5f700 1 -- 172.21.15.72:0/243884710 shutdown_connections 2023-10-03T10:15:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.535+0000 7fb504d5f700 1 --2- 172.21.15.72:0/243884710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb500135e50 0x7fb5001c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.535+0000 7fb504d5f700 1 --2- 172.21.15.72:0/243884710 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb50009d6f0 0x7fb5001c4130 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.535+0000 7fb504d5f700 1 --2- 172.21.15.72:0/243884710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb50009e1d0 0x7fb5001c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.535+0000 7fb504d5f700 1 -- 172.21.15.72:0/243884710 >> 172.21.15.72:0/243884710 conn(0x7fb500066f50 msgr2=0x7fb5000a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.535+0000 7fb504d5f700 1 -- 172.21.15.72:0/243884710 shutdown_connections 2023-10-03T10:15:04.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.535+0000 7fb504d5f700 1 -- 172.21.15.72:0/243884710 wait complete. 2023-10-03T10:15:04.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:04.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.576+0000 7f53f192a700 1 -- 172.21.15.72:0/2524510768 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f53ec0a28e0 con 0x7f53ec0a1340 2023-10-03T10:15:04.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.576+0000 7f53d3fff700 1 -- 172.21.15.72:0/2524510768 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f53e002b090 con 0x7f53ec0a1340 2023-10-03T10:15:04.576 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:04.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.578+0000 7f53f192a700 1 -- 172.21.15.72:0/2524510768 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53ec0a1340 msgr2=0x7f53ec122cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.578+0000 7f53f192a700 1 --2- 172.21.15.72:0/2524510768 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53ec0a1340 0x7f53ec122cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f53e000e9b0 tx=0x7f53e000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.578+0000 7f53f192a700 1 -- 172.21.15.72:0/2524510768 shutdown_connections 2023-10-03T10:15:04.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.578+0000 7f53f192a700 1 --2- 172.21.15.72:0/2524510768 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53ec133fa0 0x7f53ec123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.578+0000 7f53f192a700 1 --2- 172.21.15.72:0/2524510768 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f53ec0a0a30 0x7f53ec122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.578+0000 7f53f192a700 1 --2- 172.21.15.72:0/2524510768 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53ec0a1340 0x7f53ec122cd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.578+0000 7f53f192a700 1 -- 172.21.15.72:0/2524510768 >> 172.21.15.72:0/2524510768 conn(0x7f53ec0a6550 msgr2=0x7f53ec0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.578+0000 7f53f192a700 1 -- 172.21.15.72:0/2524510768 shutdown_connections 2023-10-03T10:15:04.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.578+0000 7f53f192a700 1 -- 172.21.15.72:0/2524510768 wait complete. 2023-10-03T10:15:04.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:04.685 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:04.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.807+0000 7f4960381700 1 Processor -- start 2023-10-03T10:15:04.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.807+0000 7f4960381700 1 -- start start 2023-10-03T10:15:04.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f4960381700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495809d6f0 0x7f495809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f4960381700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f495809e410 0x7f4958130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f4960381700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f495809f130 con 0x7f495809e000 2023-10-03T10:15:04.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f4960381700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495809f520 con 0x7f495809e410 2023-10-03T10:15:04.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f4960381700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495809e930 con 0x7f495809d6f0 2023-10-03T10:15:04.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f495e91e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f495809e410 0x7f4958130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f495e11d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495809d6f0 0x7f495809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f495e11d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495809d6f0 0x7f495809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48682/0 (socket says 172.21.15.72:48682) 2023-10-03T10:15:04.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f495e91e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f495809e410 0x7f4958130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41568/0 (socket says 172.21.15.72:41568) 2023-10-03T10:15:04.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f495e11d700 1 -- 172.21.15.72:0/3817488189 learned_addr learned my addr 172.21.15.72:0/3817488189 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:04.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f495e91e700 1 -- 172.21.15.72:0/3817488189 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495809d6f0 msgr2=0x7f495809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f495e91e700 1 --2- 172.21.15.72:0/3817488189 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495809d6f0 0x7f495809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f495e91e700 1 -- 172.21.15.72:0/3817488189 >> v1:172.21.15.72:6789/0 conn(0x7f495809e000 legacy=0x7f4958130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f495e91e700 1 -- 172.21.15.72:0/3817488189 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495809b2d0 con 0x7f495809e410 2023-10-03T10:15:04.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f495d11b700 1 -- 172.21.15.72:0/3817488189 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662357227 0 0) 0x7f495809f130 con 0x7f495809e000 2023-10-03T10:15:04.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f495e11d700 1 --2- 172.21.15.72:0/3817488189 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495809d6f0 0x7f495809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f495e91e700 1 --2- 172.21.15.72:0/3817488189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495809e410 0x7f4958130d70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4950009d90 tx=0x7f495000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fc2f27fb098101 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f495d11b700 1 -- 172.21.15.72:0/3817488189 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495000e070 con 0x7f495809e410 2023-10-03T10:15:04.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f495d11b700 1 -- 172.21.15.72:0/3817488189 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495000bb20 con 0x7f495809e410 2023-10-03T10:15:04.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.808+0000 7f495d11b700 1 -- 172.21.15.72:0/3817488189 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4950012430 con 0x7f495809e410 2023-10-03T10:15:04.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.809+0000 7f4960381700 1 -- 172.21.15.72:0/3817488189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495809e410 msgr2=0x7f4958130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.809+0000 7f4960381700 1 --2- 172.21.15.72:0/3817488189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495809e410 0x7f4958130d70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4950009d90 tx=0x7f495000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:04.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.809+0000 7f4960381700 1 -- 172.21.15.72:0/3817488189 shutdown_connections 2023-10-03T10:15:04.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.809+0000 7f4960381700 1 --2- 172.21.15.72:0/3817488189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495809e410 0x7f4958130d70 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.809+0000 7f4960381700 1 --2- 172.21.15.72:0/3817488189 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495809d6f0 0x7f495809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.809+0000 7f4960381700 1 -- 172.21.15.72:0/3817488189 >> 172.21.15.72:0/3817488189 conn(0x7f4958066f50 msgr2=0x7f495809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.809+0000 7f4960381700 1 -- 172.21.15.72:0/3817488189 shutdown_connections 2023-10-03T10:15:04.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.809+0000 7f4960381700 1 -- 172.21.15.72:0/3817488189 wait complete. 2023-10-03T10:15:04.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.810+0000 7f4960381700 1 Processor -- start 2023-10-03T10:15:04.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.810+0000 7f4960381700 1 -- start start 2023-10-03T10:15:04.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f4960381700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495809d6f0 0x7f495811e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f4960381700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495809e000 0x7f495811e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f4960381700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f495809e410 0x7f495811ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f4960381700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495809c790 con 0x7f495809e000 2023-10-03T10:15:04.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f4960381700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495809a0c0 con 0x7f495809d6f0 2023-10-03T10:15:04.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f4960381700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4958120480 con 0x7f495809e410 2023-10-03T10:15:04.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f495d91c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495809e000 0x7f495811e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f495e11d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495809d6f0 0x7f495811e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f495d91c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495809e000 0x7f495811e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41582/0 (socket says 172.21.15.72:41582) 2023-10-03T10:15:04.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f495e11d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495809d6f0 0x7f495811e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48698/0 (socket says 172.21.15.72:48698) 2023-10-03T10:15:04.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f495d91c700 1 -- 172.21.15.72:0/2008742775 learned_addr learned my addr 172.21.15.72:0/2008742775 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:04.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f495e91e700 1 --2- 172.21.15.72:0/2008742775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f495809e410 0x7f495811ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f495d91c700 1 -- 172.21.15.72:0/2008742775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f495809e410 msgr2=0x7f495811ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f495d91c700 1 --2- 172.21.15.72:0/2008742775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f495809e410 0x7f495811ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f495d91c700 1 -- 172.21.15.72:0/2008742775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495809d6f0 msgr2=0x7f495811e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f495d91c700 1 --2- 172.21.15.72:0/2008742775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495809d6f0 0x7f495811e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f495d91c700 1 -- 172.21.15.72:0/2008742775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494800b7f0 con 0x7f495809e000 2023-10-03T10:15:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.811+0000 7f495e11d700 1 --2- 172.21.15.72:0/2008742775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495809d6f0 0x7f495811e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.812+0000 7f495d91c700 1 --2- 172.21.15.72:0/2008742775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495809e000 0x7f495811e550 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f495400c580 tx=0x7f495400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.812+0000 7f494effd700 1 -- 172.21.15.72:0/2008742775 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49540054e0 con 0x7f495809e000 2023-10-03T10:15:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.812+0000 7f494effd700 1 -- 172.21.15.72:0/2008742775 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4954003680 con 0x7f495809e000 2023-10-03T10:15:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.812+0000 7f494effd700 1 -- 172.21.15.72:0/2008742775 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954003a30 con 0x7f495809e000 2023-10-03T10:15:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.812+0000 7f4960381700 1 -- 172.21.15.72:0/2008742775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4950009a70 con 0x7f495809e000 2023-10-03T10:15:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.812+0000 7f4960381700 1 -- 172.21.15.72:0/2008742775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4958121850 con 0x7f495809e000 2023-10-03T10:15:04.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.812+0000 7f494effd700 1 -- 172.21.15.72:0/2008742775 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4954003b90 con 0x7f495809e000 2023-10-03T10:15:04.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.812+0000 7f494effd700 1 -- 172.21.15.72:0/2008742775 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f495403ea80 con 0x7f495809e000 2023-10-03T10:15:04.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.813+0000 7f4960381700 1 -- 172.21.15.72:0/2008742775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4958074ea0 con 0x7f495809e000 2023-10-03T10:15:04.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.817+0000 7f494effd700 1 -- 172.21.15.72:0/2008742775 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4954017080 con 0x7f495809e000 2023-10-03T10:15:04.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:04.999+0000 7f4960381700 1 -- 172.21.15.72:0/2008742775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f49580a21b0 con 0x7f495809e000 2023-10-03T10:15:04.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.000+0000 7f494effd700 1 -- 172.21.15.72:0/2008742775 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f495403ce60 con 0x7f495809e000 2023-10-03T10:15:04.999 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:05.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.001+0000 7f4960381700 1 -- 172.21.15.72:0/2008742775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495809e000 msgr2=0x7f495811e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.002+0000 7f4960381700 1 --2- 172.21.15.72:0/2008742775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495809e000 0x7f495811e550 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f495400c580 tx=0x7f495400c890 comp rx=0 tx=0).stop 2023-10-03T10:15:05.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.002+0000 7f4960381700 1 -- 172.21.15.72:0/2008742775 shutdown_connections 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.002+0000 7f4960381700 1 --2- 172.21.15.72:0/2008742775 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f495809e410 0x7f495811ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.002+0000 7f4960381700 1 --2- 172.21.15.72:0/2008742775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495809d6f0 0x7f495811e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.002+0000 7f4960381700 1 --2- 172.21.15.72:0/2008742775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495809e000 0x7f495811e550 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.002+0000 7f4960381700 1 -- 172.21.15.72:0/2008742775 >> 172.21.15.72:0/2008742775 conn(0x7f4958066f50 msgr2=0x7f4958070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.002+0000 7f4960381700 1 -- 172.21.15.72:0/2008742775 shutdown_connections 2023-10-03T10:15:05.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.002+0000 7f4960381700 1 -- 172.21.15.72:0/2008742775 wait complete. 2023-10-03T10:15:05.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:05.338 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.461+0000 7f05eb365700 1 Processor -- start 2023-10-03T10:15:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.462+0000 7f05eb365700 1 -- start start 2023-10-03T10:15:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.462+0000 7f05eb365700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05e409d6f0 0x7f05e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.462+0000 7f05eb365700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05e409e410 0x7f05e4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.462+0000 7f05eb365700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e409b120 con 0x7f05e409e000 2023-10-03T10:15:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.462+0000 7f05eb365700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e406b460 con 0x7f05e409e410 2023-10-03T10:15:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.462+0000 7f05eb365700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05e409a7e0 con 0x7f05e409d6f0 2023-10-03T10:15:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.462+0000 7f05e9902700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05e409e410 0x7f05e4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.462+0000 7f05e9101700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05e409d6f0 0x7f05e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.462+0000 7f05e8900700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f05e409e000 0x7f05e41339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35432/0 (socket says 172.21.15.72:35432) 2023-10-03T10:15:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.462+0000 7f05e8900700 1 -- 172.21.15.72:0/63475293 learned_addr learned my addr 172.21.15.72:0/63475293 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.462+0000 7f05e9101700 1 -- 172.21.15.72:0/63475293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05e409e410 msgr2=0x7f05e4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.462+0000 7f05e9101700 1 --2- 172.21.15.72:0/63475293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05e409e410 0x7f05e4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.463+0000 7f05e9101700 1 -- 172.21.15.72:0/63475293 >> v1:172.21.15.72:6789/0 conn(0x7f05e409e000 legacy=0x7f05e41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.462+0000 7f05d7fff700 1 -- 172.21.15.72:0/63475293 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855797113 0 0) 0x7f05e409b120 con 0x7f05e409e000 2023-10-03T10:15:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.463+0000 7f05e9101700 1 -- 172.21.15.72:0/63475293 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e409a500 con 0x7f05e409d6f0 2023-10-03T10:15:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.463+0000 7f05e9902700 1 --2- 172.21.15.72:0/63475293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05e409e410 0x7f05e4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.463+0000 7f05e9101700 1 --2- 172.21.15.72:0/63475293 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05e409d6f0 0x7f05e409dac0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f05d80098a0 tx=0x7f05d8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23d3b0beaea33a9d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.463+0000 7f05d7fff700 1 -- 172.21.15.72:0/63475293 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8011830 con 0x7f05e409d6f0 2023-10-03T10:15:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.463+0000 7f05d7fff700 1 -- 172.21.15.72:0/63475293 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d8011990 con 0x7f05e409d6f0 2023-10-03T10:15:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.463+0000 7f05d7fff700 1 -- 172.21.15.72:0/63475293 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8011d20 con 0x7f05e409d6f0 2023-10-03T10:15:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.463+0000 7f05eb365700 1 -- 172.21.15.72:0/63475293 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05e409d6f0 msgr2=0x7f05e409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.463+0000 7f05eb365700 1 --2- 172.21.15.72:0/63475293 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05e409d6f0 0x7f05e409dac0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f05d80098a0 tx=0x7f05d8009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.463+0000 7f05eb365700 1 -- 172.21.15.72:0/63475293 shutdown_connections 2023-10-03T10:15:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.463+0000 7f05eb365700 1 --2- 172.21.15.72:0/63475293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05e409e410 0x7f05e4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.463+0000 7f05eb365700 1 --2- 172.21.15.72:0/63475293 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05e409d6f0 0x7f05e409dac0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.463+0000 7f05eb365700 1 -- 172.21.15.72:0/63475293 >> 172.21.15.72:0/63475293 conn(0x7f05e4066f50 msgr2=0x7f05e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.463+0000 7f05eb365700 1 -- 172.21.15.72:0/63475293 shutdown_connections 2023-10-03T10:15:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.463+0000 7f05eb365700 1 -- 172.21.15.72:0/63475293 wait complete. 2023-10-03T10:15:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.464+0000 7f05eb365700 1 Processor -- start 2023-10-03T10:15:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.464+0000 7f05eb365700 1 -- start start 2023-10-03T10:15:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05eb365700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05e409d6f0 0x7f05e4122630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05eb365700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05e409e000 0x7f05e4122b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05eb365700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e409e410 0x7f05e41230b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05eb365700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e4125d40 con 0x7f05e409e410 2023-10-03T10:15:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05eb365700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e4126020 con 0x7f05e409d6f0 2023-10-03T10:15:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05eb365700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05e40a19d0 con 0x7f05e409e000 2023-10-03T10:15:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05e9101700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05e409d6f0 0x7f05e4122630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05e9101700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05e409d6f0 0x7f05e4122630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48718/0 (socket says 172.21.15.72:48718) 2023-10-03T10:15:05.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05e9101700 1 -- 172.21.15.72:0/3093799223 learned_addr learned my addr 172.21.15.72:0/3093799223 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:05.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05e9902700 1 --2- 172.21.15.72:0/3093799223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e409e410 0x7f05e41230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05e8900700 1 --2- 172.21.15.72:0/3093799223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05e409e000 0x7f05e4122b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05e9101700 1 -- 172.21.15.72:0/3093799223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05e409e000 msgr2=0x7f05e4122b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05e9101700 1 --2- 172.21.15.72:0/3093799223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05e409e000 0x7f05e4122b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05e9101700 1 -- 172.21.15.72:0/3093799223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e409e410 msgr2=0x7f05e41230b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05e9101700 1 --2- 172.21.15.72:0/3093799223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e409e410 0x7f05e41230b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05e9101700 1 -- 172.21.15.72:0/3093799223 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc009a70 con 0x7f05e409d6f0 2023-10-03T10:15:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05e9101700 1 --2- 172.21.15.72:0/3093799223 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05e409d6f0 0x7f05e4122630 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f05d8000c00 tx=0x7f05d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05d5ffb700 1 -- 172.21.15.72:0/3093799223 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8004550 con 0x7f05e409d6f0 2023-10-03T10:15:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05d5ffb700 1 -- 172.21.15.72:0/3093799223 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d801f070 con 0x7f05e409d6f0 2023-10-03T10:15:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05eb365700 1 -- 172.21.15.72:0/3093799223 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d80094a0 con 0x7f05e409d6f0 2023-10-03T10:15:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.465+0000 7f05d5ffb700 1 -- 172.21.15.72:0/3093799223 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d80038e0 con 0x7f05e409d6f0 2023-10-03T10:15:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.466+0000 7f05eb365700 1 -- 172.21.15.72:0/3093799223 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e4125360 con 0x7f05e409d6f0 2023-10-03T10:15:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.466+0000 7f05d5ffb700 1 -- 172.21.15.72:0/3093799223 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05d8003a40 con 0x7f05e409d6f0 2023-10-03T10:15:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.466+0000 7f05d5ffb700 1 -- 172.21.15.72:0/3093799223 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f05d8021070 con 0x7f05e409d6f0 2023-10-03T10:15:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.467+0000 7f05eb365700 1 -- 172.21.15.72:0/3093799223 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e4074ea0 con 0x7f05e409d6f0 2023-10-03T10:15:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.471+0000 7f05d5ffb700 1 -- 172.21.15.72:0/3093799223 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05d8015080 con 0x7f05e409d6f0 2023-10-03T10:15:05.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:05.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:05.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.673+0000 7f05eb365700 1 -- 172.21.15.72:0/3093799223 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f05e40a29a0 con 0x7f05e409d6f0 2023-10-03T10:15:05.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.674+0000 7f05d5ffb700 1 -- 172.21.15.72:0/3093799223 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f05d8035090 con 0x7f05e409d6f0 2023-10-03T10:15:05.673 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:05.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.675+0000 7f24bb60e700 1 Processor -- start 2023-10-03T10:15:05.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.675+0000 7f24bb60e700 1 -- start start 2023-10-03T10:15:05.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f24bb60e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b409d6f0 0x7f24b409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f05eb365700 1 -- 172.21.15.72:0/3093799223 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05e409d6f0 msgr2=0x7f05e4122630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f05eb365700 1 --2- 172.21.15.72:0/3093799223 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05e409d6f0 0x7f05e4122630 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f05d8000c00 tx=0x7f05d8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:05.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f24bb60e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24b409e410 0x7f24b4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f24bb60e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b409b120 con 0x7f24b409e000 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f24bb60e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b406b460 con 0x7f24b409d6f0 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f24bb60e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24b409a7e0 con 0x7f24b409e410 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f24b93aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b409d6f0 0x7f24b409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f24b93aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b409d6f0 0x7f24b409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48728/0 (socket says 172.21.15.72:48728) 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f24b93aa700 1 -- 172.21.15.72:0/333689424 learned_addr learned my addr 172.21.15.72:0/333689424 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:05.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f05eb365700 1 -- 172.21.15.72:0/3093799223 shutdown_connections 2023-10-03T10:15:05.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f05eb365700 1 --2- 172.21.15.72:0/3093799223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05e409e410 0x7f05e41230b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f05eb365700 1 --2- 172.21.15.72:0/3093799223 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05e409d6f0 0x7f05e4122630 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f05eb365700 1 --2- 172.21.15.72:0/3093799223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05e409e000 0x7f05e4122b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f05eb365700 1 -- 172.21.15.72:0/3093799223 >> 172.21.15.72:0/3093799223 conn(0x7f05e4066f50 msgr2=0x7f05e409b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f24b9bab700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24b409e410 0x7f24b4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f05eb365700 1 -- 172.21.15.72:0/3093799223 shutdown_connections 2023-10-03T10:15:05.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f05eb365700 1 -- 172.21.15.72:0/3093799223 wait complete. 2023-10-03T10:15:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.677+0000 7f24b93aa700 1 -- 172.21.15.72:0/333689424 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24b409e410 msgr2=0x7f24b4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.676+0000 7f24abfff700 1 -- 172.21.15.72:0/333689424 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533142550 0 0) 0x7f24b409b120 con 0x7f24b409e000 2023-10-03T10:15:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.677+0000 7f24b93aa700 1 --2- 172.21.15.72:0/333689424 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24b409e410 0x7f24b4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.677+0000 7f24b93aa700 1 -- 172.21.15.72:0/333689424 >> v1:172.21.15.72:6789/0 conn(0x7f24b409e000 legacy=0x7f24b41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.677+0000 7f24b93aa700 1 -- 172.21.15.72:0/333689424 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b409a500 con 0x7f24b409d6f0 2023-10-03T10:15:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.677+0000 7f24b93aa700 1 --2- 172.21.15.72:0/333689424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b409d6f0 0x7f24b409dac0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009920 tx=0x7f24b0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9e61148f75d2c92 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.677+0000 7f24abfff700 1 -- 172.21.15.72:0/333689424 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0011830 con 0x7f24b409d6f0 2023-10-03T10:15:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.677+0000 7f24abfff700 1 -- 172.21.15.72:0/333689424 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b0011990 con 0x7f24b409d6f0 2023-10-03T10:15:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.677+0000 7f24abfff700 1 -- 172.21.15.72:0/333689424 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0011d20 con 0x7f24b409d6f0 2023-10-03T10:15:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.678+0000 7f24bb60e700 1 -- 172.21.15.72:0/333689424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b409d6f0 msgr2=0x7f24b409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.678+0000 7f24bb60e700 1 --2- 172.21.15.72:0/333689424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b409d6f0 0x7f24b409dac0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009920 tx=0x7f24b0009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.678+0000 7f24bb60e700 1 -- 172.21.15.72:0/333689424 shutdown_connections 2023-10-03T10:15:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.678+0000 7f24bb60e700 1 --2- 172.21.15.72:0/333689424 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24b409e410 0x7f24b4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.678+0000 7f24bb60e700 1 --2- 172.21.15.72:0/333689424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b409d6f0 0x7f24b409dac0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.678+0000 7f24bb60e700 1 -- 172.21.15.72:0/333689424 >> 172.21.15.72:0/333689424 conn(0x7f24b4066f50 msgr2=0x7f24b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.678+0000 7f24bb60e700 1 -- 172.21.15.72:0/333689424 shutdown_connections 2023-10-03T10:15:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.678+0000 7f24bb60e700 1 -- 172.21.15.72:0/333689424 wait complete. 2023-10-03T10:15:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.679+0000 7f24bb60e700 1 Processor -- start 2023-10-03T10:15:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.679+0000 7f24bb60e700 1 -- start start 2023-10-03T10:15:05.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.679+0000 7f24bb60e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b409d6f0 0x7f24b41224d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.679+0000 7f24bb60e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b409e000 0x7f24b4122a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.679+0000 7f24bb60e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24b409e410 0x7f24b4122f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.679+0000 7f24bb60e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b4125f60 con 0x7f24b409e000 2023-10-03T10:15:05.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.679+0000 7f24bb60e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b409c780 con 0x7f24b409d6f0 2023-10-03T10:15:05.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.679+0000 7f24bb60e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40a19d0 con 0x7f24b409e410 2023-10-03T10:15:05.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.679+0000 7f24b93aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b409d6f0 0x7f24b41224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.679+0000 7f24b93aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b409d6f0 0x7f24b41224d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48738/0 (socket says 172.21.15.72:48738) 2023-10-03T10:15:05.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.679+0000 7f24b93aa700 1 -- 172.21.15.72:0/3152031602 learned_addr learned my addr 172.21.15.72:0/3152031602 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:05.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.679+0000 7f24b9bab700 1 --2- 172.21.15.72:0/3152031602 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24b409e410 0x7f24b4122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.679+0000 7f24b8ba9700 1 --2- 172.21.15.72:0/3152031602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b409e000 0x7f24b4122a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.680+0000 7f24b93aa700 1 -- 172.21.15.72:0/3152031602 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24b409e410 msgr2=0x7f24b4122f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.680+0000 7f24b93aa700 1 --2- 172.21.15.72:0/3152031602 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24b409e410 0x7f24b4122f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.680+0000 7f24b93aa700 1 -- 172.21.15.72:0/3152031602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b409e000 msgr2=0x7f24b4122a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.680+0000 7f24b93aa700 1 --2- 172.21.15.72:0/3152031602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b409e000 0x7f24b4122a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.680+0000 7f24b93aa700 1 -- 172.21.15.72:0/3152031602 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b0009550 con 0x7f24b409d6f0 2023-10-03T10:15:05.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.680+0000 7f24b93aa700 1 --2- 172.21.15.72:0/3152031602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b409d6f0 0x7f24b41224d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009c70 tx=0x7f24b0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.680+0000 7f24a9ffb700 1 -- 172.21.15.72:0/3152031602 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0004240 con 0x7f24b409d6f0 2023-10-03T10:15:05.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.680+0000 7f24a9ffb700 1 -- 172.21.15.72:0/3152031602 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b001f070 con 0x7f24b409d6f0 2023-10-03T10:15:05.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.680+0000 7f24a9ffb700 1 -- 172.21.15.72:0/3152031602 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b00045a0 con 0x7f24b409d6f0 2023-10-03T10:15:05.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.680+0000 7f24bb60e700 1 -- 172.21.15.72:0/3152031602 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b4124870 con 0x7f24b409d6f0 2023-10-03T10:15:05.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.680+0000 7f24bb60e700 1 -- 172.21.15.72:0/3152031602 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b4124e70 con 0x7f24b409d6f0 2023-10-03T10:15:05.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.681+0000 7f24a9ffb700 1 -- 172.21.15.72:0/3152031602 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24b0021030 con 0x7f24b409d6f0 2023-10-03T10:15:05.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.681+0000 7f24a9ffb700 1 -- 172.21.15.72:0/3152031602 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f24b00408a0 con 0x7f24b409d6f0 2023-10-03T10:15:05.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.682+0000 7f24bb60e700 1 -- 172.21.15.72:0/3152031602 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b4074ea0 con 0x7f24b409d6f0 2023-10-03T10:15:05.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.687+0000 7f24a9ffb700 1 -- 172.21.15.72:0/3152031602 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24b001a450 con 0x7f24b409d6f0 2023-10-03T10:15:05.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:05.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.721+0000 7fb199b55700 1 Processor -- start 2023-10-03T10:15:05.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.721+0000 7fb199b55700 1 -- start start 2023-10-03T10:15:05.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.722+0000 7fb199b55700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1940a1510 0x7fb194138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.722+0000 7fb199b55700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb194139250 0x7fb19413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.722+0000 7fb199b55700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19409edd0 con 0x7fb1940a0a30 2023-10-03T10:15:05.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.722+0000 7fb199b55700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1940a18e0 con 0x7fb194139250 2023-10-03T10:15:05.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.722+0000 7fb199b55700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19409e1f0 con 0x7fb1940a1510 2023-10-03T10:15:05.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.722+0000 7fb192ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1940a1510 0x7fb194138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.722+0000 7fb193fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb194139250 0x7fb19413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.722+0000 7fb193fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb194139250 0x7fb19413b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41600/0 (socket says 172.21.15.72:41600) 2023-10-03T10:15:05.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.722+0000 7fb192ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1940a1510 0x7fb194138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48742/0 (socket says 172.21.15.72:48742) 2023-10-03T10:15:05.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.722+0000 7fb193fff700 1 -- 172.21.15.72:0/1688422511 learned_addr learned my addr 172.21.15.72:0/1688422511 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:05.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.722+0000 7fb192ffd700 1 -- 172.21.15.72:0/1688422511 >> v2:172.21.15.72:3300/0 conn(0x7fb194139250 msgr2=0x7fb19413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.722+0000 7fb192ffd700 1 --2- 172.21.15.72:0/1688422511 >> v2:172.21.15.72:3300/0 conn(0x7fb194139250 0x7fb19413b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.722+0000 7fb192ffd700 1 -- 172.21.15.72:0/1688422511 >> v1:172.21.15.72:6789/0 conn(0x7fb1940a0a30 legacy=0x7fb1940a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.722+0000 7fb192ffd700 1 -- 172.21.15.72:0/1688422511 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19409dc50 con 0x7fb1940a1510 2023-10-03T10:15:05.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.722+0000 7fb193fff700 1 --2- 172.21.15.72:0/1688422511 >> v2:172.21.15.72:3300/0 conn(0x7fb194139250 0x7fb19413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:05.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.723+0000 7fb192ffd700 1 --2- 172.21.15.72:0/1688422511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1940a1510 0x7fb194138d10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009870 tx=0x7fb17c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=162520cce684baa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.723+0000 7fb1927fc700 1 -- 172.21.15.72:0/1688422511 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c011830 con 0x7fb1940a1510 2023-10-03T10:15:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.723+0000 7fb1927fc700 1 -- 172.21.15.72:0/1688422511 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c011990 con 0x7fb1940a1510 2023-10-03T10:15:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.723+0000 7fb1927fc700 1 -- 172.21.15.72:0/1688422511 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c011d20 con 0x7fb1940a1510 2023-10-03T10:15:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.723+0000 7fb199b55700 1 -- 172.21.15.72:0/1688422511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1940a1510 msgr2=0x7fb194138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.723+0000 7fb199b55700 1 --2- 172.21.15.72:0/1688422511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1940a1510 0x7fb194138d10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009870 tx=0x7fb17c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.723+0000 7fb199b55700 1 -- 172.21.15.72:0/1688422511 shutdown_connections 2023-10-03T10:15:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.723+0000 7fb199b55700 1 --2- 172.21.15.72:0/1688422511 >> v2:172.21.15.72:3300/0 conn(0x7fb194139250 0x7fb19413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.723+0000 7fb199b55700 1 --2- 172.21.15.72:0/1688422511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1940a1510 0x7fb194138d10 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.723+0000 7fb199b55700 1 -- 172.21.15.72:0/1688422511 >> 172.21.15.72:0/1688422511 conn(0x7fb1940a6550 msgr2=0x7fb1940a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.723+0000 7fb199b55700 1 -- 172.21.15.72:0/1688422511 shutdown_connections 2023-10-03T10:15:05.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.723+0000 7fb199b55700 1 -- 172.21.15.72:0/1688422511 wait complete. 2023-10-03T10:15:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.724+0000 7fb199b55700 1 Processor -- start 2023-10-03T10:15:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.724+0000 7fb199b55700 1 -- start start 2023-10-03T10:15:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb199b55700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1940a0a30 0x7fb1941c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb199b55700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1940a1510 0x7fb1941c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb199b55700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb194139250 0x7fb194122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb199b55700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940a0220 con 0x7fb1940a0a30 2023-10-03T10:15:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb199b55700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1941261b0 con 0x7fb1940a1510 2023-10-03T10:15:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb199b55700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1941be330 con 0x7fb194139250 2023-10-03T10:15:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb192ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1940a1510 0x7fb1941c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb1937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1940a0a30 0x7fb1941c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb192ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1940a1510 0x7fb1941c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48752/0 (socket says 172.21.15.72:48752) 2023-10-03T10:15:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb1937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1940a0a30 0x7fb1941c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41610/0 (socket says 172.21.15.72:41610) 2023-10-03T10:15:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb192ffd700 1 -- 172.21.15.72:0/4110909456 learned_addr learned my addr 172.21.15.72:0/4110909456 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb193fff700 1 --2- 172.21.15.72:0/4110909456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb194139250 0x7fb194122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb1937fe700 1 -- 172.21.15.72:0/4110909456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb194139250 msgr2=0x7fb194122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb1937fe700 1 --2- 172.21.15.72:0/4110909456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb194139250 0x7fb194122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb1937fe700 1 -- 172.21.15.72:0/4110909456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1940a1510 msgr2=0x7fb1941c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb1937fe700 1 --2- 172.21.15.72:0/4110909456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1940a1510 0x7fb1941c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb1937fe700 1 -- 172.21.15.72:0/4110909456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c009550 con 0x7fb1940a0a30 2023-10-03T10:15:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb193fff700 1 --2- 172.21.15.72:0/4110909456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb194139250 0x7fb194122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb192ffd700 1 --2- 172.21.15.72:0/4110909456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1940a1510 0x7fb1941c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb1937fe700 1 --2- 172.21.15.72:0/4110909456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1940a0a30 0x7fb1941c8660 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb18400cbe0 tx=0x7fb18400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.725+0000 7fb18bfff700 1 -- 172.21.15.72:0/4110909456 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184003c00 con 0x7fb1940a0a30 2023-10-03T10:15:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.726+0000 7fb18bfff700 1 -- 172.21.15.72:0/4110909456 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb184003d60 con 0x7fb1940a0a30 2023-10-03T10:15:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.726+0000 7fb199b55700 1 -- 172.21.15.72:0/4110909456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c0094a0 con 0x7fb1940a0a30 2023-10-03T10:15:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.726+0000 7fb18bfff700 1 -- 172.21.15.72:0/4110909456 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18400ab50 con 0x7fb1940a0a30 2023-10-03T10:15:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.726+0000 7fb199b55700 1 -- 172.21.15.72:0/4110909456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb194124580 con 0x7fb1940a0a30 2023-10-03T10:15:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.726+0000 7fb18bfff700 1 -- 172.21.15.72:0/4110909456 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb18400acb0 con 0x7fb1940a0a30 2023-10-03T10:15:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.726+0000 7fb18bfff700 1 -- 172.21.15.72:0/4110909456 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb18403f6b0 con 0x7fb1940a0a30 2023-10-03T10:15:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.726+0000 7fb199b55700 1 -- 172.21.15.72:0/4110909456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1941262f0 con 0x7fb1940a0a30 2023-10-03T10:15:05.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.731+0000 7fb18bfff700 1 -- 172.21.15.72:0/4110909456 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1941262f0 con 0x7fb1940a0a30 2023-10-03T10:15:05.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.882+0000 7f24bb60e700 1 -- 172.21.15.72:0/3152031602 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f24b406c360 con 0x7f24b409d6f0 2023-10-03T10:15:05.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.883+0000 7f24a9ffb700 1 -- 172.21.15.72:0/3152031602 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24b0015020 con 0x7f24b409d6f0 2023-10-03T10:15:05.883 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:05.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.885+0000 7f24bb60e700 1 -- 172.21.15.72:0/3152031602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b409d6f0 msgr2=0x7f24b41224d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.885+0000 7f24bb60e700 1 --2- 172.21.15.72:0/3152031602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b409d6f0 0x7f24b41224d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009c70 tx=0x7f24b0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:05.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.885+0000 7f24bb60e700 1 -- 172.21.15.72:0/3152031602 shutdown_connections 2023-10-03T10:15:05.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.885+0000 7f24bb60e700 1 --2- 172.21.15.72:0/3152031602 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24b409e410 0x7f24b4122f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.885+0000 7f24bb60e700 1 --2- 172.21.15.72:0/3152031602 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b409d6f0 0x7f24b41224d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.885+0000 7f24bb60e700 1 --2- 172.21.15.72:0/3152031602 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b409e000 0x7f24b4122a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.885+0000 7f24bb60e700 1 -- 172.21.15.72:0/3152031602 >> 172.21.15.72:0/3152031602 conn(0x7f24b4066f50 msgr2=0x7f24b409b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.885+0000 7f24bb60e700 1 -- 172.21.15.72:0/3152031602 shutdown_connections 2023-10-03T10:15:05.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.885+0000 7f24bb60e700 1 -- 172.21.15.72:0/3152031602 wait complete. 2023-10-03T10:15:05.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:05.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.924+0000 7fb199b55700 1 -- 172.21.15.72:0/4110909456 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb1941262f0 con 0x7fb1940a0a30 2023-10-03T10:15:05.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.925+0000 7fb18bfff700 1 -- 172.21.15.72:0/4110909456 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb1941262f0 con 0x7fb1940a0a30 2023-10-03T10:15:05.925 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.927+0000 7fb199b55700 1 -- 172.21.15.72:0/4110909456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1940a0a30 msgr2=0x7fb1941c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.927+0000 7fb199b55700 1 --2- 172.21.15.72:0/4110909456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1940a0a30 0x7fb1941c8660 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb18400cbe0 tx=0x7fb18400cef0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.927+0000 7fb199b55700 1 -- 172.21.15.72:0/4110909456 shutdown_connections 2023-10-03T10:15:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.927+0000 7fb199b55700 1 --2- 172.21.15.72:0/4110909456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1940a0a30 0x7fb1941c8660 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.927+0000 7fb199b55700 1 --2- 172.21.15.72:0/4110909456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb194139250 0x7fb194122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.927+0000 7fb199b55700 1 --2- 172.21.15.72:0/4110909456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1940a1510 0x7fb1941c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.927+0000 7fb199b55700 1 -- 172.21.15.72:0/4110909456 >> 172.21.15.72:0/4110909456 conn(0x7fb1940a6550 msgr2=0x7fb1940a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.927+0000 7fb199b55700 1 -- 172.21.15.72:0/4110909456 shutdown_connections 2023-10-03T10:15:05.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:05.927+0000 7fb199b55700 1 -- 172.21.15.72:0/4110909456 wait complete. 2023-10-03T10:15:05.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:06.014 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.136+0000 7f4b00c50700 1 Processor -- start 2023-10-03T10:15:06.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.136+0000 7f4b00c50700 1 -- start start 2023-10-03T10:15:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.136+0000 7f4b00c50700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4afc09d6f0 0x7f4afc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.136+0000 7f4b00c50700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4afc09e440 0x7f4afc134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.136+0000 7f4b00c50700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4afc09b120 con 0x7f4afc09e000 2023-10-03T10:15:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.136+0000 7f4b00c50700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4afc06b460 con 0x7f4afc09d6f0 2023-10-03T10:15:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.136+0000 7f4b00c50700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc09a7e0 con 0x7f4afc09e440 2023-10-03T10:15:06.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.136+0000 7f4afa59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4afc09d6f0 0x7f4afc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.137+0000 7f4afa59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4afc09d6f0 0x7f4afc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41624/0 (socket says 172.21.15.72:41624) 2023-10-03T10:15:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.137+0000 7f4afad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4afc09e440 0x7f4afc134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.137+0000 7f4afa59c700 1 -- 172.21.15.72:0/2746517469 learned_addr learned my addr 172.21.15.72:0/2746517469 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.137+0000 7f4afa59c700 1 -- 172.21.15.72:0/2746517469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4afc09e440 msgr2=0x7f4afc134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.137+0000 7f4afa59c700 1 --2- 172.21.15.72:0/2746517469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4afc09e440 0x7f4afc134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.137+0000 7f4afa59c700 1 -- 172.21.15.72:0/2746517469 >> v1:172.21.15.72:6789/0 conn(0x7f4afc09e000 legacy=0x7f4afc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.137+0000 7f4af959a700 1 -- 172.21.15.72:0/2746517469 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069795576 0 0) 0x7f4afc09b120 con 0x7f4afc09e000 2023-10-03T10:15:06.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.137+0000 7f4afa59c700 1 -- 172.21.15.72:0/2746517469 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc09a500 con 0x7f4afc09d6f0 2023-10-03T10:15:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.137+0000 7f4afad9d700 1 --2- 172.21.15.72:0/2746517469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4afc09e440 0x7f4afc134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.137+0000 7f4afa59c700 1 --2- 172.21.15.72:0/2746517469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4afc09d6f0 0x7f4afc09dac0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009920 tx=0x7f4aec009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3c60cd58ff90bb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.137+0000 7f4af959a700 1 -- 172.21.15.72:0/2746517469 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec011830 con 0x7f4afc09d6f0 2023-10-03T10:15:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.137+0000 7f4af959a700 1 -- 172.21.15.72:0/2746517469 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec011990 con 0x7f4afc09d6f0 2023-10-03T10:15:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.137+0000 7f4af959a700 1 -- 172.21.15.72:0/2746517469 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec011d20 con 0x7f4afc09d6f0 2023-10-03T10:15:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.138+0000 7f4b00c50700 1 -- 172.21.15.72:0/2746517469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4afc09d6f0 msgr2=0x7f4afc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.138+0000 7f4b00c50700 1 --2- 172.21.15.72:0/2746517469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4afc09d6f0 0x7f4afc09dac0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009920 tx=0x7f4aec009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.138+0000 7f4b00c50700 1 -- 172.21.15.72:0/2746517469 shutdown_connections 2023-10-03T10:15:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.138+0000 7f4b00c50700 1 --2- 172.21.15.72:0/2746517469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4afc09e440 0x7f4afc134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.138+0000 7f4b00c50700 1 --2- 172.21.15.72:0/2746517469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4afc09d6f0 0x7f4afc09dac0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.138+0000 7f4b00c50700 1 -- 172.21.15.72:0/2746517469 >> 172.21.15.72:0/2746517469 conn(0x7f4afc066f50 msgr2=0x7f4afc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.138+0000 7f4b00c50700 1 -- 172.21.15.72:0/2746517469 shutdown_connections 2023-10-03T10:15:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.138+0000 7f4b00c50700 1 -- 172.21.15.72:0/2746517469 wait complete. 2023-10-03T10:15:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.139+0000 7f4b00c50700 1 Processor -- start 2023-10-03T10:15:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.139+0000 7f4b00c50700 1 -- start start 2023-10-03T10:15:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.139+0000 7f4b00c50700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4afc09d6f0 0x7f4afc1a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.139+0000 7f4b00c50700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4afc09e000 0x7f4afc1a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.139+0000 7f4b00c50700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4afc09e440 0x7f4afc1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.139+0000 7f4b00c50700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc1a8140 con 0x7f4afc09d6f0 2023-10-03T10:15:06.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.139+0000 7f4b00c50700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc1a8320 con 0x7f4afc09e000 2023-10-03T10:15:06.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.139+0000 7f4b00c50700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc1b93c0 con 0x7f4afc09e440 2023-10-03T10:15:06.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.139+0000 7f4afa59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4afc09d6f0 0x7f4afc1a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.139+0000 7f4afad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4afc09e440 0x7f4afc1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.139+0000 7f4afa59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4afc09d6f0 0x7f4afc1a5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41640/0 (socket says 172.21.15.72:41640) 2023-10-03T10:15:06.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.139+0000 7f4afa59c700 1 -- 172.21.15.72:0/1597625508 learned_addr learned my addr 172.21.15.72:0/1597625508 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:06.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.139+0000 7f4af9d9b700 1 --2- 172.21.15.72:0/1597625508 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4afc09e000 0x7f4afc1a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.140+0000 7f4afad9d700 1 -- 172.21.15.72:0/1597625508 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4afc09e000 msgr2=0x7f4afc1a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.140+0000 7f4afad9d700 1 --2- 172.21.15.72:0/1597625508 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4afc09e000 0x7f4afc1a58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.140+0000 7f4afad9d700 1 -- 172.21.15.72:0/1597625508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4afc09d6f0 msgr2=0x7f4afc1a5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.140+0000 7f4afad9d700 1 --2- 172.21.15.72:0/1597625508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4afc09d6f0 0x7f4afc1a5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.140+0000 7f4afad9d700 1 -- 172.21.15.72:0/1597625508 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af4009a70 con 0x7f4afc09e440 2023-10-03T10:15:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.140+0000 7f4afa59c700 1 --2- 172.21.15.72:0/1597625508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4afc09d6f0 0x7f4afc1a5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.140+0000 7f4afad9d700 1 --2- 172.21.15.72:0/1597625508 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4afc09e440 0x7f4afc1c8020 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4af4009e50 tx=0x7f4af400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.140+0000 7f4aeaffd700 1 -- 172.21.15.72:0/1597625508 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af400ca90 con 0x7f4afc09e440 2023-10-03T10:15:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.140+0000 7f4aeaffd700 1 -- 172.21.15.72:0/1597625508 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af400f040 con 0x7f4afc09e440 2023-10-03T10:15:06.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.140+0000 7f4aeaffd700 1 -- 172.21.15.72:0/1597625508 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af400ce50 con 0x7f4afc09e440 2023-10-03T10:15:06.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.140+0000 7f4b00c50700 1 -- 172.21.15.72:0/1597625508 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec009550 con 0x7f4afc09e440 2023-10-03T10:15:06.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.140+0000 7f4b00c50700 1 -- 172.21.15.72:0/1597625508 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4afc09c710 con 0x7f4afc09e440 2023-10-03T10:15:06.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.141+0000 7f4aeaffd700 1 -- 172.21.15.72:0/1597625508 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4af4014480 con 0x7f4afc09e440 2023-10-03T10:15:06.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.141+0000 7f4aeaffd700 1 -- 172.21.15.72:0/1597625508 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4af403fd40 con 0x7f4afc09e440 2023-10-03T10:15:06.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.141+0000 7f4b00c50700 1 -- 172.21.15.72:0/1597625508 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4afc074ea0 con 0x7f4afc09e440 2023-10-03T10:15:06.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.146+0000 7f4aeaffd700 1 -- 172.21.15.72:0/1597625508 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4af4012340 con 0x7f4afc09e440 2023-10-03T10:15:06.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.329+0000 7f4b00c50700 1 -- 172.21.15.72:0/1597625508 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4afc09f420 con 0x7f4afc09e440 2023-10-03T10:15:06.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.330+0000 7f4aeaffd700 1 -- 172.21.15.72:0/1597625508 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4af4012340 con 0x7f4afc09e440 2023-10-03T10:15:06.330 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.332+0000 7f4b00c50700 1 -- 172.21.15.72:0/1597625508 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4afc09e440 msgr2=0x7f4afc1c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.332+0000 7f4b00c50700 1 --2- 172.21.15.72:0/1597625508 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4afc09e440 0x7f4afc1c8020 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4af4009e50 tx=0x7f4af400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.332+0000 7f4b00c50700 1 -- 172.21.15.72:0/1597625508 shutdown_connections 2023-10-03T10:15:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.332+0000 7f4b00c50700 1 --2- 172.21.15.72:0/1597625508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4afc09d6f0 0x7f4afc1a5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.332+0000 7f4b00c50700 1 --2- 172.21.15.72:0/1597625508 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4afc09e440 0x7f4afc1c8020 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.332+0000 7f4b00c50700 1 --2- 172.21.15.72:0/1597625508 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4afc09e000 0x7f4afc1a58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.332+0000 7f4b00c50700 1 -- 172.21.15.72:0/1597625508 >> 172.21.15.72:0/1597625508 conn(0x7f4afc066f50 msgr2=0x7f4afc1bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.332+0000 7f4b00c50700 1 -- 172.21.15.72:0/1597625508 shutdown_connections 2023-10-03T10:15:06.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.332+0000 7f4b00c50700 1 -- 172.21.15.72:0/1597625508 wait complete. 2023-10-03T10:15:06.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:06.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:06.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.813+0000 7fc839206700 1 Processor -- start 2023-10-03T10:15:06.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.813+0000 7fc839206700 1 -- start start 2023-10-03T10:15:06.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc839206700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8341338c0 0x7fc834133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc839206700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc8341341d0 0x7fc83409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc839206700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83406f720 con 0x7fc83409e390 2023-10-03T10:15:06.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc839206700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc834070c80 con 0x7fc8341338c0 2023-10-03T10:15:06.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc839206700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc83406fce0 con 0x7fc8341341d0 2023-10-03T10:15:06.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc832d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8341338c0 0x7fc834133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc83359e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc83409e390 0x7fc83413a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35462/0 (socket says 172.21.15.72:35462) 2023-10-03T10:15:06.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc83359e700 1 -- 172.21.15.72:0/3167189230 learned_addr learned my addr 172.21.15.72:0/3167189230 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:06.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc83259c700 1 --2- 172.21.15.72:0/3167189230 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc8341341d0 0x7fc83409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc831d9b700 1 -- 172.21.15.72:0/3167189230 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552778309 0 0) 0x7fc83406f720 con 0x7fc83409e390 2023-10-03T10:15:06.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc831d9b700 1 -- 172.21.15.72:0/3167189230 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc81c0035b0 con 0x7fc83409e390 2023-10-03T10:15:06.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc832d9d700 1 -- 172.21.15.72:0/3167189230 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc8341341d0 msgr2=0x7fc83409de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc832d9d700 1 --2- 172.21.15.72:0/3167189230 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc8341341d0 0x7fc83409de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc832d9d700 1 -- 172.21.15.72:0/3167189230 >> v1:172.21.15.72:6789/0 conn(0x7fc83409e390 legacy=0x7fc83413a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc832d9d700 1 -- 172.21.15.72:0/3167189230 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8341336a0 con 0x7fc8341338c0 2023-10-03T10:15:06.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc83259c700 1 --2- 172.21.15.72:0/3167189230 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc8341341d0 0x7fc83409de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc832d9d700 1 --2- 172.21.15.72:0/3167189230 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8341338c0 0x7fc834133c90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc828009870 tx=0x7fc828009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb514473db888693 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc831d9b700 1 -- 172.21.15.72:0/3167189230 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828011830 con 0x7fc8341338c0 2023-10-03T10:15:06.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc831d9b700 1 -- 172.21.15.72:0/3167189230 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc828011990 con 0x7fc8341338c0 2023-10-03T10:15:06.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.814+0000 7fc831d9b700 1 -- 172.21.15.72:0/3167189230 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828011d20 con 0x7fc8341338c0 2023-10-03T10:15:06.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.815+0000 7fc839206700 1 -- 172.21.15.72:0/3167189230 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8341338c0 msgr2=0x7fc834133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.815+0000 7fc839206700 1 --2- 172.21.15.72:0/3167189230 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8341338c0 0x7fc834133c90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc828009870 tx=0x7fc828009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:06.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.815+0000 7fc839206700 1 -- 172.21.15.72:0/3167189230 shutdown_connections 2023-10-03T10:15:06.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.815+0000 7fc839206700 1 --2- 172.21.15.72:0/3167189230 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8341338c0 0x7fc834133c90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.815+0000 7fc839206700 1 --2- 172.21.15.72:0/3167189230 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc8341341d0 0x7fc83409de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.815+0000 7fc839206700 1 -- 172.21.15.72:0/3167189230 >> 172.21.15.72:0/3167189230 conn(0x7fc8340a2aa0 msgr2=0x7fc8340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.815+0000 7fc839206700 1 -- 172.21.15.72:0/3167189230 shutdown_connections 2023-10-03T10:15:06.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.815+0000 7fc839206700 1 -- 172.21.15.72:0/3167189230 wait complete. 2023-10-03T10:15:06.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.816+0000 7fc839206700 1 Processor -- start 2023-10-03T10:15:06.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.816+0000 7fc839206700 1 -- start start 2023-10-03T10:15:06.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc839206700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc83409e390 0x7fc83411c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc839206700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8341338c0 0x7fc83411cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc839206700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc8341341d0 0x7fc83411d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc839206700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83411f680 con 0x7fc83409e390 2023-10-03T10:15:06.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc839206700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83412dcb0 con 0x7fc8341338c0 2023-10-03T10:15:06.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc839206700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc83411fd30 con 0x7fc8341341d0 2023-10-03T10:15:06.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc83259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8341338c0 0x7fc83411cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc832d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc83409e390 0x7fc83411c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc83359e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc8341341d0 0x7fc83411d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc83259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8341338c0 0x7fc83411cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48782/0 (socket says 172.21.15.72:48782) 2023-10-03T10:15:06.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc83259c700 1 -- 172.21.15.72:0/590838591 learned_addr learned my addr 172.21.15.72:0/590838591 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:06.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc83359e700 1 -- 172.21.15.72:0/590838591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8341338c0 msgr2=0x7fc83411cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc83359e700 1 --2- 172.21.15.72:0/590838591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8341338c0 0x7fc83411cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc83359e700 1 -- 172.21.15.72:0/590838591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc83409e390 msgr2=0x7fc83411c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc83359e700 1 --2- 172.21.15.72:0/590838591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc83409e390 0x7fc83411c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc83359e700 1 -- 172.21.15.72:0/590838591 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8240094a0 con 0x7fc8341341d0 2023-10-03T10:15:06.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc832d9d700 1 --2- 172.21.15.72:0/590838591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc83409e390 0x7fc83411c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc83259c700 1 --2- 172.21.15.72:0/590838591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8341338c0 0x7fc83411cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc83359e700 1 --2- 172.21.15.72:0/590838591 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc8341341d0 0x7fc83411d280 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00caa0 tx=0x7fc82c00cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc81b7fe700 1 -- 172.21.15.72:0/590838591 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00a9e0 con 0x7fc8341341d0 2023-10-03T10:15:06.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc81b7fe700 1 -- 172.21.15.72:0/590838591 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c00ab40 con 0x7fc8341341d0 2023-10-03T10:15:06.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc81b7fe700 1 -- 172.21.15.72:0/590838591 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c012400 con 0x7fc8341341d0 2023-10-03T10:15:06.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc839206700 1 -- 172.21.15.72:0/590838591 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8280094a0 con 0x7fc8341341d0 2023-10-03T10:15:06.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.817+0000 7fc839206700 1 -- 172.21.15.72:0/590838591 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83411f1c0 con 0x7fc8341341d0 2023-10-03T10:15:06.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.818+0000 7fc81b7fe700 1 -- 172.21.15.72:0/590838591 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc82c01b3b0 con 0x7fc8341341d0 2023-10-03T10:15:06.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.818+0000 7fc81b7fe700 1 -- 172.21.15.72:0/590838591 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc82c03f180 con 0x7fc8341341d0 2023-10-03T10:15:06.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.818+0000 7fc839206700 1 -- 172.21.15.72:0/590838591 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc834074ea0 con 0x7fc8341341d0 2023-10-03T10:15:06.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:06.823+0000 7fc81b7fe700 1 -- 172.21.15.72:0/590838591 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc82c0192c0 con 0x7fc8341341d0 2023-10-03T10:15:06.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:06.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:07.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.014+0000 7fc839206700 1 -- 172.21.15.72:0/590838591 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc834120ac0 con 0x7fc8341341d0 2023-10-03T10:15:07.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.014+0000 7fc81b7fe700 1 -- 172.21.15.72:0/590838591 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc82c017020 con 0x7fc8341341d0 2023-10-03T10:15:07.015 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:07.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.016+0000 7fc839206700 1 -- 172.21.15.72:0/590838591 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc8341341d0 msgr2=0x7fc83411d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.016+0000 7fc839206700 1 --2- 172.21.15.72:0/590838591 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc8341341d0 0x7fc83411d280 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00caa0 tx=0x7fc82c00cdb0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.017+0000 7fc839206700 1 -- 172.21.15.72:0/590838591 shutdown_connections 2023-10-03T10:15:07.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.017+0000 7fc839206700 1 --2- 172.21.15.72:0/590838591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc83409e390 0x7fc83411c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.017+0000 7fc839206700 1 --2- 172.21.15.72:0/590838591 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc8341341d0 0x7fc83411d280 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.017+0000 7fc839206700 1 --2- 172.21.15.72:0/590838591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8341338c0 0x7fc83411cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.017+0000 7fc839206700 1 -- 172.21.15.72:0/590838591 >> 172.21.15.72:0/590838591 conn(0x7fc8340a2aa0 msgr2=0x7fc83409f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.018+0000 7fc839206700 1 -- 172.21.15.72:0/590838591 shutdown_connections 2023-10-03T10:15:07.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.018+0000 7fc839206700 1 -- 172.21.15.72:0/590838591 wait complete. 2023-10-03T10:15:07.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.022+0000 7f6b08eb2700 1 Processor -- start 2023-10-03T10:15:07.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.022+0000 7f6b08eb2700 1 -- start start 2023-10-03T10:15:07.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.023+0000 7f6b08eb2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6b04131630 0x7f6b04131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.023+0000 7f6b08eb2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b0406eba0 0x7f6b04139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.023+0000 7f6b08eb2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b04071a00 con 0x7f6b04131f40 2023-10-03T10:15:07.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.023+0000 7f6b08eb2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b04131430 con 0x7f6b04131630 2023-10-03T10:15:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.023+0000 7f6b08eb2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0409a510 con 0x7f6b0406eba0 2023-10-03T10:15:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.023+0000 7f6b0259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6b04131630 0x7f6b04131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.024+0000 7f6b0259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6b04131630 0x7f6b04131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41658/0 (socket says 172.21.15.72:41658) 2023-10-03T10:15:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.024+0000 7f6b0259c700 1 -- 172.21.15.72:0/625784412 learned_addr learned my addr 172.21.15.72:0/625784412 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.024+0000 7f6b01d9b700 1 --1- 172.21.15.72:0/625784412 >> v1:172.21.15.72:6789/0 conn(0x7f6b04131f40 0x7f6b0406e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35474/0 (socket says 172.21.15.72:35474) 2023-10-03T10:15:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.024+0000 7f6b02d9d700 1 --2- 172.21.15.72:0/625784412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b0406eba0 0x7f6b04139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.024+0000 7f6b0259c700 1 -- 172.21.15.72:0/625784412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b0406eba0 msgr2=0x7f6b04139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.024+0000 7f6b0259c700 1 --2- 172.21.15.72:0/625784412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b0406eba0 0x7f6b04139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.024+0000 7f6b0259c700 1 -- 172.21.15.72:0/625784412 >> v1:172.21.15.72:6789/0 conn(0x7f6b04131f40 legacy=0x7f6b0406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.024+0000 7f6b0259c700 1 -- 172.21.15.72:0/625784412 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b040721c0 con 0x7f6b04131630 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.024+0000 7f6b02d9d700 1 --2- 172.21.15.72:0/625784412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b0406eba0 0x7f6b04139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.024+0000 7f6b0259c700 1 --2- 172.21.15.72:0/625784412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b04131630 0x7f6b04131a00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6af40098f0 tx=0x7f6af4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6ed8cfa4fd8d68 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.024+0000 7f6b0159a700 1 -- 172.21.15.72:0/625784412 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af4011830 con 0x7f6b04131630 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.024+0000 7f6b0159a700 1 -- 172.21.15.72:0/625784412 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af4011990 con 0x7f6b04131630 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.024+0000 7f6b0159a700 1 -- 172.21.15.72:0/625784412 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af4011d20 con 0x7f6b04131630 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.025+0000 7f6b08eb2700 1 -- 172.21.15.72:0/625784412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b04131630 msgr2=0x7f6b04131a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.025+0000 7f6b08eb2700 1 --2- 172.21.15.72:0/625784412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b04131630 0x7f6b04131a00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6af40098f0 tx=0x7f6af4009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.025+0000 7f6b08eb2700 1 -- 172.21.15.72:0/625784412 shutdown_connections 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.025+0000 7f6b08eb2700 1 --2- 172.21.15.72:0/625784412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b0406eba0 0x7f6b04139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.025+0000 7f6b08eb2700 1 --2- 172.21.15.72:0/625784412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b04131630 0x7f6b04131a00 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.025+0000 7f6b08eb2700 1 -- 172.21.15.72:0/625784412 >> 172.21.15.72:0/625784412 conn(0x7f6b040a2aa0 msgr2=0x7f6b040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.025+0000 7f6b08eb2700 1 -- 172.21.15.72:0/625784412 shutdown_connections 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.025+0000 7f6b08eb2700 1 -- 172.21.15.72:0/625784412 wait complete. 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.026+0000 7f6b08eb2700 1 Processor -- start 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.026+0000 7f6b08eb2700 1 -- start start 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b08eb2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b0406eba0 0x7f6b0406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b08eb2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b04131630 0x7f6b0406fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b08eb2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b04131f40 0x7f6b04070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b08eb2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b04070a70 con 0x7f6b04131630 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b08eb2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0406e660 con 0x7f6b0406eba0 2023-10-03T10:15:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b08eb2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b04099f20 con 0x7f6b04131f40 2023-10-03T10:15:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b0259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b0406eba0 0x7f6b0406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b0259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b0406eba0 0x7f6b0406f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48786/0 (socket says 172.21.15.72:48786) 2023-10-03T10:15:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b0259c700 1 -- 172.21.15.72:0/3646075473 learned_addr learned my addr 172.21.15.72:0/3646075473 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b01d9b700 1 --2- 172.21.15.72:0/3646075473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b04131630 0x7f6b0406fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b02d9d700 1 --2- 172.21.15.72:0/3646075473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b04131f40 0x7f6b04070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b01d9b700 1 -- 172.21.15.72:0/3646075473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b04131f40 msgr2=0x7f6b04070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b01d9b700 1 --2- 172.21.15.72:0/3646075473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b04131f40 0x7f6b04070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b01d9b700 1 -- 172.21.15.72:0/3646075473 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b0406eba0 msgr2=0x7f6b0406f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b01d9b700 1 --2- 172.21.15.72:0/3646075473 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b0406eba0 0x7f6b0406f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b01d9b700 1 -- 172.21.15.72:0/3646075473 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc009a70 con 0x7f6b04131630 2023-10-03T10:15:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b0259c700 1 --2- 172.21.15.72:0/3646075473 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b0406eba0 0x7f6b0406f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b02d9d700 1 --2- 172.21.15.72:0/3646075473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b04131f40 0x7f6b04070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.027+0000 7f6b01d9b700 1 --2- 172.21.15.72:0/3646075473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b04131630 0x7f6b0406fb50 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6af800c450 tx=0x7f6af800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.028+0000 7f6af2ffd700 1 -- 172.21.15.72:0/3646075473 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8005cb0 con 0x7f6b04131630 2023-10-03T10:15:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.028+0000 7f6af2ffd700 1 -- 172.21.15.72:0/3646075473 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af8005e10 con 0x7f6b04131630 2023-10-03T10:15:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.028+0000 7f6b08eb2700 1 -- 172.21.15.72:0/3646075473 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af4009550 con 0x7f6b04131630 2023-10-03T10:15:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.028+0000 7f6af2ffd700 1 -- 172.21.15.72:0/3646075473 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af80072d0 con 0x7f6b04131630 2023-10-03T10:15:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.028+0000 7f6b08eb2700 1 -- 172.21.15.72:0/3646075473 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b04120410 con 0x7f6b04131630 2023-10-03T10:15:07.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.028+0000 7f6af2ffd700 1 -- 172.21.15.72:0/3646075473 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6af8007430 con 0x7f6b04131630 2023-10-03T10:15:07.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.029+0000 7f6af2ffd700 1 -- 172.21.15.72:0/3646075473 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6af803e940 con 0x7f6b04131630 2023-10-03T10:15:07.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.029+0000 7f6b08eb2700 1 -- 172.21.15.72:0/3646075473 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b04120e10 con 0x7f6b04131630 2023-10-03T10:15:07.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:07.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.034+0000 7f6af2ffd700 1 -- 172.21.15.72:0/3646075473 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b04120e10 con 0x7f6b04131630 2023-10-03T10:15:07.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.065+0000 7f23e4443700 1 Processor -- start 2023-10-03T10:15:07.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.065+0000 7f23e4443700 1 -- start start 2023-10-03T10:15:07.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e4443700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc09e1d0 0x7f23dc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e4443700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc139170 0x7f23dc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e4443700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc09b120 con 0x7f23dc09d6f0 2023-10-03T10:15:07.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e4443700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc06b460 con 0x7f23dc09e1d0 2023-10-03T10:15:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e4443700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc09a7e0 con 0x7f23dc139170 2023-10-03T10:15:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e29e0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc139170 0x7f23dc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e19de700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc09e1d0 0x7f23dc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e29e0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc139170 0x7f23dc13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42074/0 (socket says 172.21.15.72:42074) 2023-10-03T10:15:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e19de700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc09e1d0 0x7f23dc138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48790/0 (socket says 172.21.15.72:48790) 2023-10-03T10:15:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e29e0700 1 -- 172.21.15.72:0/1934724399 learned_addr learned my addr 172.21.15.72:0/1934724399 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e19de700 1 -- 172.21.15.72:0/1934724399 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc139170 msgr2=0x7f23dc13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e19de700 1 --2- 172.21.15.72:0/1934724399 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc139170 0x7f23dc13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e19de700 1 -- 172.21.15.72:0/1934724399 >> v1:172.21.15.72:6789/0 conn(0x7f23dc09d6f0 legacy=0x7f23dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e19de700 1 -- 172.21.15.72:0/1934724399 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc09a500 con 0x7f23dc09e1d0 2023-10-03T10:15:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e29e0700 1 --2- 172.21.15.72:0/1934724399 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc139170 0x7f23dc13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.066+0000 7f23e19de700 1 --2- 172.21.15.72:0/1934724399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc09e1d0 0x7f23dc138c30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009870 tx=0x7f23cc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=508e4b9e19d50ee6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.067+0000 7f23e11dd700 1 -- 172.21.15.72:0/1934724399 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc011830 con 0x7f23dc09e1d0 2023-10-03T10:15:07.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.067+0000 7f23e11dd700 1 -- 172.21.15.72:0/1934724399 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc011990 con 0x7f23dc09e1d0 2023-10-03T10:15:07.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.067+0000 7f23e11dd700 1 -- 172.21.15.72:0/1934724399 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc011d20 con 0x7f23dc09e1d0 2023-10-03T10:15:07.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.067+0000 7f23e4443700 1 -- 172.21.15.72:0/1934724399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc09e1d0 msgr2=0x7f23dc138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.067+0000 7f23e4443700 1 --2- 172.21.15.72:0/1934724399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc09e1d0 0x7f23dc138c30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009870 tx=0x7f23cc009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:07.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.067+0000 7f23e4443700 1 -- 172.21.15.72:0/1934724399 shutdown_connections 2023-10-03T10:15:07.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.067+0000 7f23e4443700 1 --2- 172.21.15.72:0/1934724399 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc139170 0x7f23dc13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.067+0000 7f23e4443700 1 --2- 172.21.15.72:0/1934724399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc09e1d0 0x7f23dc138c30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.067+0000 7f23e4443700 1 -- 172.21.15.72:0/1934724399 >> 172.21.15.72:0/1934724399 conn(0x7f23dc066f50 msgr2=0x7f23dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.067+0000 7f23e4443700 1 -- 172.21.15.72:0/1934724399 shutdown_connections 2023-10-03T10:15:07.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.067+0000 7f23e4443700 1 -- 172.21.15.72:0/1934724399 wait complete. 2023-10-03T10:15:07.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.069+0000 7f23e4443700 1 Processor -- start 2023-10-03T10:15:07.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.069+0000 7f23e4443700 1 -- start start 2023-10-03T10:15:07.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.069+0000 7f23e4443700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc09d6f0 0x7f23dc121480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.069+0000 7f23e4443700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc09e1d0 0x7f23dc1219c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.069+0000 7f23e4443700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc139170 0x7f23dc1c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.069+0000 7f23e4443700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc121030 con 0x7f23dc09e1d0 2023-10-03T10:15:07.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.069+0000 7f23e4443700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc121f00 con 0x7f23dc09d6f0 2023-10-03T10:15:07.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.069+0000 7f23e4443700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc124350 con 0x7f23dc139170 2023-10-03T10:15:07.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.069+0000 7f23e19de700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc09e1d0 0x7f23dc1219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.069+0000 7f23e29e0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc139170 0x7f23dc1c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.069+0000 7f23e19de700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc09e1d0 0x7f23dc1219c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41686/0 (socket says 172.21.15.72:41686) 2023-10-03T10:15:07.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.069+0000 7f23e29e0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc139170 0x7f23dc1c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42078/0 (socket says 172.21.15.72:42078) 2023-10-03T10:15:07.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.069+0000 7f23e19de700 1 -- 172.21.15.72:0/711579635 learned_addr learned my addr 172.21.15.72:0/711579635 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:07.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.069+0000 7f23e21df700 1 --2- 172.21.15.72:0/711579635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc09d6f0 0x7f23dc121480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.070+0000 7f23e19de700 1 -- 172.21.15.72:0/711579635 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc139170 msgr2=0x7f23dc1c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.070+0000 7f23e19de700 1 --2- 172.21.15.72:0/711579635 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc139170 0x7f23dc1c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.070+0000 7f23e19de700 1 -- 172.21.15.72:0/711579635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc09d6f0 msgr2=0x7f23dc121480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.070+0000 7f23e19de700 1 --2- 172.21.15.72:0/711579635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc09d6f0 0x7f23dc121480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.070+0000 7f23e19de700 1 -- 172.21.15.72:0/711579635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d4009b30 con 0x7f23dc09e1d0 2023-10-03T10:15:07.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.070+0000 7f23e29e0700 1 --2- 172.21.15.72:0/711579635 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc139170 0x7f23dc1c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.070+0000 7f23e21df700 1 --2- 172.21.15.72:0/711579635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc09d6f0 0x7f23dc121480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.070+0000 7f23e19de700 1 --2- 172.21.15.72:0/711579635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc09e1d0 0x7f23dc1219c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009840 tx=0x7f23cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.070+0000 7f23d2ffd700 1 -- 172.21.15.72:0/711579635 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc004510 con 0x7f23dc09e1d0 2023-10-03T10:15:07.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.070+0000 7f23d2ffd700 1 -- 172.21.15.72:0/711579635 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc01f070 con 0x7f23dc09e1d0 2023-10-03T10:15:07.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.070+0000 7f23e4443700 1 -- 172.21.15.72:0/711579635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23cc0094a0 con 0x7f23dc09e1d0 2023-10-03T10:15:07.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.070+0000 7f23d2ffd700 1 -- 172.21.15.72:0/711579635 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0038e0 con 0x7f23dc09e1d0 2023-10-03T10:15:07.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.070+0000 7f23e4443700 1 -- 172.21.15.72:0/711579635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23dc123300 con 0x7f23dc09e1d0 2023-10-03T10:15:07.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.071+0000 7f23d2ffd700 1 -- 172.21.15.72:0/711579635 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23cc003a40 con 0x7f23dc09e1d0 2023-10-03T10:15:07.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.071+0000 7f23d2ffd700 1 -- 172.21.15.72:0/711579635 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f23cc021070 con 0x7f23dc09e1d0 2023-10-03T10:15:07.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.071+0000 7f23e4443700 1 -- 172.21.15.72:0/711579635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23dc074ea0 con 0x7f23dc09e1d0 2023-10-03T10:15:07.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.076+0000 7f23d2ffd700 1 -- 172.21.15.72:0/711579635 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23cc015080 con 0x7f23dc09e1d0 2023-10-03T10:15:07.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.228+0000 7f6b08eb2700 1 -- 172.21.15.72:0/3646075473 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6b04120e10 con 0x7f6b04131630 2023-10-03T10:15:07.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.228+0000 7f6af2ffd700 1 -- 172.21.15.72:0/3646075473 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b04120e10 con 0x7f6b04131630 2023-10-03T10:15:07.229 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.230+0000 7f6b08eb2700 1 -- 172.21.15.72:0/3646075473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b04131630 msgr2=0x7f6b0406fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.230+0000 7f6b08eb2700 1 --2- 172.21.15.72:0/3646075473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b04131630 0x7f6b0406fb50 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6af800c450 tx=0x7f6af800c760 comp rx=0 tx=0).stop 2023-10-03T10:15:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.230+0000 7f6b08eb2700 1 -- 172.21.15.72:0/3646075473 shutdown_connections 2023-10-03T10:15:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.230+0000 7f6b08eb2700 1 --2- 172.21.15.72:0/3646075473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b04131f40 0x7f6b04070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.230+0000 7f6b08eb2700 1 --2- 172.21.15.72:0/3646075473 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b0406eba0 0x7f6b0406f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.230+0000 7f6b08eb2700 1 --2- 172.21.15.72:0/3646075473 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b04131630 0x7f6b0406fb50 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.230+0000 7f6b08eb2700 1 -- 172.21.15.72:0/3646075473 >> 172.21.15.72:0/3646075473 conn(0x7f6b040a2aa0 msgr2=0x7f6b0409d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.230+0000 7f6b08eb2700 1 -- 172.21.15.72:0/3646075473 shutdown_connections 2023-10-03T10:15:07.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.230+0000 7f6b08eb2700 1 -- 172.21.15.72:0/3646075473 wait complete. 2023-10-03T10:15:07.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:07.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.270+0000 7f23e4443700 1 -- 172.21.15.72:0/711579635 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f23dc124490 con 0x7f23dc09e1d0 2023-10-03T10:15:07.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.270+0000 7f23d2ffd700 1 -- 172.21.15.72:0/711579635 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f23cc010380 con 0x7f23dc09e1d0 2023-10-03T10:15:07.271 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:07.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.272+0000 7f23e4443700 1 -- 172.21.15.72:0/711579635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc09e1d0 msgr2=0x7f23dc1219c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.272+0000 7f23e4443700 1 --2- 172.21.15.72:0/711579635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc09e1d0 0x7f23dc1219c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009840 tx=0x7f23cc004750 comp rx=0 tx=0).stop 2023-10-03T10:15:07.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.272+0000 7f23e4443700 1 -- 172.21.15.72:0/711579635 shutdown_connections 2023-10-03T10:15:07.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.272+0000 7f23e4443700 1 --2- 172.21.15.72:0/711579635 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc139170 0x7f23dc1c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.272+0000 7f23e4443700 1 --2- 172.21.15.72:0/711579635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc09d6f0 0x7f23dc121480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.272+0000 7f23e4443700 1 --2- 172.21.15.72:0/711579635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc09e1d0 0x7f23dc1219c0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.272+0000 7f23e4443700 1 -- 172.21.15.72:0/711579635 >> 172.21.15.72:0/711579635 conn(0x7f23dc066f50 msgr2=0x7f23dc09b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.272+0000 7f23e4443700 1 -- 172.21.15.72:0/711579635 shutdown_connections 2023-10-03T10:15:07.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.272+0000 7f23e4443700 1 -- 172.21.15.72:0/711579635 wait complete. 2023-10-03T10:15:07.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:07.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:07.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.465+0000 7f2c743fc700 1 Processor -- start 2023-10-03T10:15:07.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.465+0000 7f2c743fc700 1 -- start start 2023-10-03T10:15:07.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c743fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c6c09d6f0 0x7f2c6c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c743fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c6c09e000 0x7f2c6c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c743fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c6c09e410 0x7f2c6c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c743fc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6c06b460 con 0x7f2c6c09e000 2023-10-03T10:15:07.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c743fc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c09b120 con 0x7f2c6c09e410 2023-10-03T10:15:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c743fc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c09a7e0 con 0x7f2c6c09d6f0 2023-10-03T10:15:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c72198700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c6c09d6f0 0x7f2c6c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c71997700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c6c09e000 0x7f2c6c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c72999700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c6c09e410 0x7f2c6c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c71997700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c6c09e000 0x7f2c6c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41700/0 (socket says 172.21.15.72:41700) 2023-10-03T10:15:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c72198700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c6c09d6f0 0x7f2c6c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42090/0 (socket says 172.21.15.72:42090) 2023-10-03T10:15:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c71997700 1 -- 172.21.15.72:0/3825817528 learned_addr learned my addr 172.21.15.72:0/3825817528 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c72999700 1 -- 172.21.15.72:0/3825817528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c6c09d6f0 msgr2=0x7f2c6c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c72999700 1 --2- 172.21.15.72:0/3825817528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c6c09d6f0 0x7f2c6c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c72999700 1 -- 172.21.15.72:0/3825817528 >> v2:172.21.15.72:3300/0 conn(0x7f2c6c09e000 msgr2=0x7f2c6c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c72999700 1 --2- 172.21.15.72:0/3825817528 >> v2:172.21.15.72:3300/0 conn(0x7f2c6c09e000 0x7f2c6c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c72999700 1 -- 172.21.15.72:0/3825817528 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c09a500 con 0x7f2c6c09e410 2023-10-03T10:15:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c71997700 1 --2- 172.21.15.72:0/3825817528 >> v2:172.21.15.72:3300/0 conn(0x7f2c6c09e000 0x7f2c6c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c72198700 1 --2- 172.21.15.72:0/3825817528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c6c09d6f0 0x7f2c6c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.466+0000 7f2c72999700 1 --2- 172.21.15.72:0/3825817528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c6c09e410 0x7f2c6c133f30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009dc0 tx=0x7f2c6400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2666463aef8128be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.467+0000 7f2c71196700 1 -- 172.21.15.72:0/3825817528 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400e070 con 0x7f2c6c09e410 2023-10-03T10:15:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.467+0000 7f2c71196700 1 -- 172.21.15.72:0/3825817528 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6400bae0 con 0x7f2c6c09e410 2023-10-03T10:15:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.467+0000 7f2c71196700 1 -- 172.21.15.72:0/3825817528 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400be90 con 0x7f2c6c09e410 2023-10-03T10:15:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.467+0000 7f2c743fc700 1 -- 172.21.15.72:0/3825817528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c6c09e410 msgr2=0x7f2c6c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.467+0000 7f2c743fc700 1 --2- 172.21.15.72:0/3825817528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c6c09e410 0x7f2c6c133f30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009dc0 tx=0x7f2c6400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.467+0000 7f2c743fc700 1 -- 172.21.15.72:0/3825817528 shutdown_connections 2023-10-03T10:15:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.467+0000 7f2c743fc700 1 --2- 172.21.15.72:0/3825817528 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c6c09e410 0x7f2c6c133f30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.467+0000 7f2c743fc700 1 --2- 172.21.15.72:0/3825817528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c6c09d6f0 0x7f2c6c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.467+0000 7f2c743fc700 1 --2- 172.21.15.72:0/3825817528 >> v2:172.21.15.72:3300/0 conn(0x7f2c6c09e000 0x7f2c6c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.467+0000 7f2c743fc700 1 -- 172.21.15.72:0/3825817528 >> 172.21.15.72:0/3825817528 conn(0x7f2c6c066f50 msgr2=0x7f2c6c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.467+0000 7f2c743fc700 1 -- 172.21.15.72:0/3825817528 shutdown_connections 2023-10-03T10:15:07.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.467+0000 7f2c743fc700 1 -- 172.21.15.72:0/3825817528 wait complete. 2023-10-03T10:15:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.468+0000 7f2c743fc700 1 Processor -- start 2023-10-03T10:15:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.468+0000 7f2c743fc700 1 -- start start 2023-10-03T10:15:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.469+0000 7f2c743fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c09d6f0 0x7f2c6c1c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.469+0000 7f2c743fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c6c09e000 0x7f2c6c1c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.469+0000 7f2c743fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c6c09e410 0x7f2c6c1c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.469+0000 7f2c743fc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c1b95b0 con 0x7f2c6c09d6f0 2023-10-03T10:15:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.469+0000 7f2c743fc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c1a70e0 con 0x7f2c6c09e000 2023-10-03T10:15:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.469+0000 7f2c743fc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c1a79b0 con 0x7f2c6c09e410 2023-10-03T10:15:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.469+0000 7f2c72198700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c09d6f0 0x7f2c6c1c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.469+0000 7f2c71997700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c6c09e000 0x7f2c6c1c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.469+0000 7f2c72198700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c09d6f0 0x7f2c6c1c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41704/0 (socket says 172.21.15.72:41704) 2023-10-03T10:15:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.469+0000 7f2c72198700 1 -- 172.21.15.72:0/3467344923 learned_addr learned my addr 172.21.15.72:0/3467344923 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.469+0000 7f2c72999700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c6c09e410 0x7f2c6c1c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.469+0000 7f2c71997700 1 -- 172.21.15.72:0/3467344923 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c6c09e410 msgr2=0x7f2c6c1c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.469+0000 7f2c71997700 1 --2- 172.21.15.72:0/3467344923 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c6c09e410 0x7f2c6c1c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.469+0000 7f2c71997700 1 -- 172.21.15.72:0/3467344923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c09d6f0 msgr2=0x7f2c6c1c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.469+0000 7f2c71997700 1 --2- 172.21.15.72:0/3467344923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c09d6f0 0x7f2c6c1c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.470+0000 7f2c71997700 1 -- 172.21.15.72:0/3467344923 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c0094a0 con 0x7f2c6c09e000 2023-10-03T10:15:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.470+0000 7f2c72198700 1 --2- 172.21.15.72:0/3467344923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c09d6f0 0x7f2c6c1c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.470+0000 7f2c71997700 1 --2- 172.21.15.72:0/3467344923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c6c09e000 0x7f2c6c1c55a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c06e510 tx=0x7f2c6800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.470+0000 7f2c62ffd700 1 -- 172.21.15.72:0/3467344923 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68004240 con 0x7f2c6c09e000 2023-10-03T10:15:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.470+0000 7f2c62ffd700 1 -- 172.21.15.72:0/3467344923 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c680043a0 con 0x7f2c6c09e000 2023-10-03T10:15:07.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.470+0000 7f2c62ffd700 1 -- 172.21.15.72:0/3467344923 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c680036a0 con 0x7f2c6c09e000 2023-10-03T10:15:07.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.470+0000 7f2c743fc700 1 -- 172.21.15.72:0/3467344923 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c68009550 con 0x7f2c6c09e000 2023-10-03T10:15:07.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.470+0000 7f2c743fc700 1 -- 172.21.15.72:0/3467344923 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c64009a70 con 0x7f2c6c09e000 2023-10-03T10:15:07.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.471+0000 7f2c62ffd700 1 -- 172.21.15.72:0/3467344923 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c68003800 con 0x7f2c6c09e000 2023-10-03T10:15:07.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.471+0000 7f2c62ffd700 1 -- 172.21.15.72:0/3467344923 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2c6803f770 con 0x7f2c6c09e000 2023-10-03T10:15:07.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.471+0000 7f2c743fc700 1 -- 172.21.15.72:0/3467344923 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c1a9270 con 0x7f2c6c09e000 2023-10-03T10:15:07.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.475+0000 7f2c62ffd700 1 -- 172.21.15.72:0/3467344923 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c68013470 con 0x7f2c6c09e000 2023-10-03T10:15:07.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.661+0000 7f2c743fc700 1 -- 172.21.15.72:0/3467344923 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2c6c074ea0 con 0x7f2c6c09e000 2023-10-03T10:15:07.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.662+0000 7f2c62ffd700 1 -- 172.21.15.72:0/3467344923 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c6801bb60 con 0x7f2c6c09e000 2023-10-03T10:15:07.662 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:07.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.664+0000 7f2c743fc700 1 -- 172.21.15.72:0/3467344923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c6c09e000 msgr2=0x7f2c6c1c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.664+0000 7f2c743fc700 1 --2- 172.21.15.72:0/3467344923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c6c09e000 0x7f2c6c1c55a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c06e510 tx=0x7f2c6800ec80 comp rx=0 tx=0).stop 2023-10-03T10:15:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.664+0000 7f2c743fc700 1 -- 172.21.15.72:0/3467344923 shutdown_connections 2023-10-03T10:15:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.664+0000 7f2c743fc700 1 --2- 172.21.15.72:0/3467344923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c6c09d6f0 0x7f2c6c1c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.664+0000 7f2c743fc700 1 --2- 172.21.15.72:0/3467344923 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c6c09e410 0x7f2c6c1c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.664+0000 7f2c743fc700 1 --2- 172.21.15.72:0/3467344923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c6c09e000 0x7f2c6c1c55a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.664+0000 7f2c743fc700 1 -- 172.21.15.72:0/3467344923 >> 172.21.15.72:0/3467344923 conn(0x7f2c6c066f50 msgr2=0x7f2c6c1bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.664+0000 7f2c743fc700 1 -- 172.21.15.72:0/3467344923 shutdown_connections 2023-10-03T10:15:07.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:07.664+0000 7f2c743fc700 1 -- 172.21.15.72:0/3467344923 wait complete. 2023-10-03T10:15:07.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:08.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:08.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.156+0000 7ff4b40a8700 1 Processor -- start 2023-10-03T10:15:08.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.156+0000 7ff4b40a8700 1 -- start start 2023-10-03T10:15:08.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b40a8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4ac09d6f0 0x7ff4ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b40a8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4ac09e410 0x7ff4ac134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b40a8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ac09b120 con 0x7ff4ac09e000 2023-10-03T10:15:08.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b40a8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac06b460 con 0x7ff4ac09e410 2023-10-03T10:15:08.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b40a8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac09a7e0 con 0x7ff4ac09d6f0 2023-10-03T10:15:08.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b2645700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4ac09e410 0x7ff4ac134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b1e44700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4ac09d6f0 0x7ff4ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b2645700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4ac09e410 0x7ff4ac134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41708/0 (socket says 172.21.15.72:41708) 2023-10-03T10:15:08.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b1e44700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4ac09d6f0 0x7ff4ac09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42108/0 (socket says 172.21.15.72:42108) 2023-10-03T10:15:08.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b2645700 1 -- 172.21.15.72:0/1189494106 learned_addr learned my addr 172.21.15.72:0/1189494106 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:08.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b2645700 1 -- 172.21.15.72:0/1189494106 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4ac09d6f0 msgr2=0x7ff4ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b2645700 1 --2- 172.21.15.72:0/1189494106 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4ac09d6f0 0x7ff4ac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b2645700 1 -- 172.21.15.72:0/1189494106 >> v1:172.21.15.72:6789/0 conn(0x7ff4ac09e000 legacy=0x7ff4ac1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b2645700 1 -- 172.21.15.72:0/1189494106 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac09a500 con 0x7ff4ac09e410 2023-10-03T10:15:08.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b1e44700 1 --2- 172.21.15.72:0/1189494106 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4ac09d6f0 0x7ff4ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.157+0000 7ff4b2645700 1 --2- 172.21.15.72:0/1189494106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac09e410 0x7ff4ac134100 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009e50 tx=0x7ff4a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce8c7f6b99df42d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.158+0000 7ff4b0e42700 1 -- 172.21.15.72:0/1189494106 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400e070 con 0x7ff4ac09e410 2023-10-03T10:15:08.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.158+0000 7ff4b0e42700 1 -- 172.21.15.72:0/1189494106 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a400b910 con 0x7ff4ac09e410 2023-10-03T10:15:08.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.158+0000 7ff4b0e42700 1 -- 172.21.15.72:0/1189494106 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400bcc0 con 0x7ff4ac09e410 2023-10-03T10:15:08.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.158+0000 7ff4b40a8700 1 -- 172.21.15.72:0/1189494106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac09e410 msgr2=0x7ff4ac134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.158+0000 7ff4b40a8700 1 --2- 172.21.15.72:0/1189494106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac09e410 0x7ff4ac134100 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009e50 tx=0x7ff4a400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:08.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.158+0000 7ff4b40a8700 1 -- 172.21.15.72:0/1189494106 shutdown_connections 2023-10-03T10:15:08.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.158+0000 7ff4b40a8700 1 --2- 172.21.15.72:0/1189494106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac09e410 0x7ff4ac134100 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.158+0000 7ff4b40a8700 1 --2- 172.21.15.72:0/1189494106 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4ac09d6f0 0x7ff4ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.158+0000 7ff4b40a8700 1 -- 172.21.15.72:0/1189494106 >> 172.21.15.72:0/1189494106 conn(0x7ff4ac066f50 msgr2=0x7ff4ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.158+0000 7ff4b40a8700 1 -- 172.21.15.72:0/1189494106 shutdown_connections 2023-10-03T10:15:08.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.158+0000 7ff4b40a8700 1 -- 172.21.15.72:0/1189494106 wait complete. 2023-10-03T10:15:08.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.159+0000 7ff4b40a8700 1 Processor -- start 2023-10-03T10:15:08.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.159+0000 7ff4b40a8700 1 -- start start 2023-10-03T10:15:08.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b40a8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4ac09d6f0 0x7ff4ac1a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b40a8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac09e000 0x7ff4ac1a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b40a8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4ac09e410 0x7ff4ac1a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b40a8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac1a9870 con 0x7ff4ac09e000 2023-10-03T10:15:08.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b40a8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac1a7b90 con 0x7ff4ac09e410 2023-10-03T10:15:08.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b40a8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac1a9a70 con 0x7ff4ac09d6f0 2023-10-03T10:15:08.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b1e44700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4ac09d6f0 0x7ff4ac1a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b1e44700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4ac09d6f0 0x7ff4ac1a60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42122/0 (socket says 172.21.15.72:42122) 2023-10-03T10:15:08.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b1e44700 1 -- 172.21.15.72:0/1363112016 learned_addr learned my addr 172.21.15.72:0/1363112016 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:08.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b2645700 1 --2- 172.21.15.72:0/1363112016 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4ac09e410 0x7ff4ac1a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b1643700 1 --2- 172.21.15.72:0/1363112016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac09e000 0x7ff4ac1a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b1e44700 1 -- 172.21.15.72:0/1363112016 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4ac09e410 msgr2=0x7ff4ac1a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b1e44700 1 --2- 172.21.15.72:0/1363112016 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4ac09e410 0x7ff4ac1a6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b1e44700 1 -- 172.21.15.72:0/1363112016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac09e000 msgr2=0x7ff4ac1a65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b1e44700 1 --2- 172.21.15.72:0/1363112016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac09e000 0x7ff4ac1a65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b1e44700 1 -- 172.21.15.72:0/1363112016 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a80094a0 con 0x7ff4ac09d6f0 2023-10-03T10:15:08.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b1e44700 1 --2- 172.21.15.72:0/1363112016 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4ac09d6f0 0x7ff4ac1a60a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800ec10 tx=0x7ff4a800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4a27fc700 1 -- 172.21.15.72:0/1363112016 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800c850 con 0x7ff4ac09d6f0 2023-10-03T10:15:08.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4a27fc700 1 -- 172.21.15.72:0/1363112016 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a800c9b0 con 0x7ff4ac09d6f0 2023-10-03T10:15:08.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b40a8700 1 -- 172.21.15.72:0/1363112016 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a4009b30 con 0x7ff4ac09d6f0 2023-10-03T10:15:08.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4a27fc700 1 -- 172.21.15.72:0/1363112016 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800cd20 con 0x7ff4ac09d6f0 2023-10-03T10:15:08.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.160+0000 7ff4b40a8700 1 -- 172.21.15.72:0/1363112016 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ac1a88f0 con 0x7ff4ac09d6f0 2023-10-03T10:15:08.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.161+0000 7ff4a27fc700 1 -- 172.21.15.72:0/1363112016 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4a8013470 con 0x7ff4ac09d6f0 2023-10-03T10:15:08.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.161+0000 7ff4a27fc700 1 -- 172.21.15.72:0/1363112016 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff4a803f7f0 con 0x7ff4ac09d6f0 2023-10-03T10:15:08.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.161+0000 7ff4b40a8700 1 -- 172.21.15.72:0/1363112016 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ac074ea0 con 0x7ff4ac09d6f0 2023-10-03T10:15:08.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.166+0000 7ff4a27fc700 1 -- 172.21.15.72:0/1363112016 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4a8013720 con 0x7ff4ac09d6f0 2023-10-03T10:15:08.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:08.285 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:08.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.358+0000 7ff4b40a8700 1 -- 172.21.15.72:0/1363112016 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff4ac1aa3a0 con 0x7ff4ac09d6f0 2023-10-03T10:15:08.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.358+0000 7ff4a27fc700 1 -- 172.21.15.72:0/1363112016 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff4a801bb60 con 0x7ff4ac09d6f0 2023-10-03T10:15:08.359 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:08.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.360+0000 7ff4b40a8700 1 -- 172.21.15.72:0/1363112016 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4ac09d6f0 msgr2=0x7ff4ac1a60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.360+0000 7ff4b40a8700 1 --2- 172.21.15.72:0/1363112016 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4ac09d6f0 0x7ff4ac1a60a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800ec10 tx=0x7ff4a800ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:08.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.360+0000 7ff4b40a8700 1 -- 172.21.15.72:0/1363112016 shutdown_connections 2023-10-03T10:15:08.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.360+0000 7ff4b40a8700 1 --2- 172.21.15.72:0/1363112016 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4ac09e410 0x7ff4ac1a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.360+0000 7ff4b40a8700 1 --2- 172.21.15.72:0/1363112016 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4ac09d6f0 0x7ff4ac1a60a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.360+0000 7ff4b40a8700 1 --2- 172.21.15.72:0/1363112016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4ac09e000 0x7ff4ac1a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.360+0000 7ff4b40a8700 1 -- 172.21.15.72:0/1363112016 >> 172.21.15.72:0/1363112016 conn(0x7ff4ac066f50 msgr2=0x7ff4ac1baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.360+0000 7ff4b40a8700 1 -- 172.21.15.72:0/1363112016 shutdown_connections 2023-10-03T10:15:08.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.360+0000 7ff4b40a8700 1 -- 172.21.15.72:0/1363112016 wait complete. 2023-10-03T10:15:08.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.369+0000 7fcea7afd700 1 Processor -- start 2023-10-03T10:15:08.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.369+0000 7fcea7afd700 1 -- start start 2023-10-03T10:15:08.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea7afd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcea009d6f0 0x7fcea009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea7afd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcea009e000 0x7fcea01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea7afd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcea009e410 0x7fcea0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea7afd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea006b460 con 0x7fcea009e000 2023-10-03T10:15:08.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea7afd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea009b120 con 0x7fcea009e410 2023-10-03T10:15:08.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea7afd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcea009a7e0 con 0x7fcea009d6f0 2023-10-03T10:15:08.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea5899700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcea009d6f0 0x7fcea009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea5098700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcea009e000 0x7fcea01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea5899700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcea009d6f0 0x7fcea009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59692/0 (socket says 172.21.15.72:59692) 2023-10-03T10:15:08.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea5098700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcea009e000 0x7fcea01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54856/0 (socket says 172.21.15.72:54856) 2023-10-03T10:15:08.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea5899700 1 -- 172.21.15.72:0/1225363651 learned_addr learned my addr 172.21.15.72:0/1225363651 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:08.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea609a700 1 --2- 172.21.15.72:0/1225363651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcea009e410 0x7fcea0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea5098700 1 -- 172.21.15.72:0/1225363651 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcea009d6f0 msgr2=0x7fcea009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea5098700 1 --2- 172.21.15.72:0/1225363651 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcea009d6f0 0x7fcea009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea5098700 1 -- 172.21.15.72:0/1225363651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcea009e410 msgr2=0x7fcea0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea5098700 1 --2- 172.21.15.72:0/1225363651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcea009e410 0x7fcea0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea5098700 1 -- 172.21.15.72:0/1225363651 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea009a500 con 0x7fcea009e000 2023-10-03T10:15:08.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea5899700 1 --2- 172.21.15.72:0/1225363651 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcea009d6f0 0x7fcea009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea5098700 1 --2- 172.21.15.72:0/1225363651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcea009e000 0x7fcea01339f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fce90009840 tx=0x7fce90009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2210d72e7afca2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.370+0000 7fcea4897700 1 -- 172.21.15.72:0/1225363651 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90011830 con 0x7fcea009e000 2023-10-03T10:15:08.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.371+0000 7fcea4897700 1 -- 172.21.15.72:0/1225363651 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce90011990 con 0x7fcea009e000 2023-10-03T10:15:08.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.371+0000 7fcea4897700 1 -- 172.21.15.72:0/1225363651 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90011d20 con 0x7fcea009e000 2023-10-03T10:15:08.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.371+0000 7fcea7afd700 1 -- 172.21.15.72:0/1225363651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcea009e000 msgr2=0x7fcea01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.371+0000 7fcea7afd700 1 --2- 172.21.15.72:0/1225363651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcea009e000 0x7fcea01339f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fce90009840 tx=0x7fce90009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:08.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.371+0000 7fcea7afd700 1 -- 172.21.15.72:0/1225363651 shutdown_connections 2023-10-03T10:15:08.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.371+0000 7fcea7afd700 1 --2- 172.21.15.72:0/1225363651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcea009e410 0x7fcea0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.371+0000 7fcea7afd700 1 --2- 172.21.15.72:0/1225363651 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcea009d6f0 0x7fcea009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.371+0000 7fcea7afd700 1 --2- 172.21.15.72:0/1225363651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcea009e000 0x7fcea01339f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.371+0000 7fcea7afd700 1 -- 172.21.15.72:0/1225363651 >> 172.21.15.72:0/1225363651 conn(0x7fcea0066f50 msgr2=0x7fcea009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.371+0000 7fcea7afd700 1 -- 172.21.15.72:0/1225363651 shutdown_connections 2023-10-03T10:15:08.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.371+0000 7fcea7afd700 1 -- 172.21.15.72:0/1225363651 wait complete. 2023-10-03T10:15:08.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.372+0000 7fcea7afd700 1 Processor -- start 2023-10-03T10:15:08.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.372+0000 7fcea7afd700 1 -- start start 2023-10-03T10:15:08.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea7afd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcea009d6f0 0x7fcea01c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea7afd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcea009e000 0x7fcea01c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:08.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea7afd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcea009e410 0x7fcea01c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea7afd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea01a9230 con 0x7fcea009e410 2023-10-03T10:15:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea7afd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea01c5aa0 con 0x7fcea009d6f0 2023-10-03T10:15:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea7afd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcea01a70d0 con 0x7fcea009e000 2023-10-03T10:15:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea5098700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcea009e000 0x7fcea01c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea5098700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcea009e000 0x7fcea01c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59708/0 (socket says 172.21.15.72:59708) 2023-10-03T10:15:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea5098700 1 -- 172.21.15.72:0/2213411389 learned_addr learned my addr 172.21.15.72:0/2213411389 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea609a700 1 --2- 172.21.15.72:0/2213411389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcea009e410 0x7fcea01c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea5899700 1 --2- 172.21.15.72:0/2213411389 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcea009d6f0 0x7fcea01c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea5098700 1 -- 172.21.15.72:0/2213411389 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcea009d6f0 msgr2=0x7fcea01c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea5098700 1 --2- 172.21.15.72:0/2213411389 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcea009d6f0 0x7fcea01c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea5098700 1 -- 172.21.15.72:0/2213411389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcea009e410 msgr2=0x7fcea01c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea5098700 1 --2- 172.21.15.72:0/2213411389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcea009e410 0x7fcea01c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea5098700 1 -- 172.21.15.72:0/2213411389 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c009550 con 0x7fcea009e000 2023-10-03T10:15:08.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.373+0000 7fcea609a700 1 --2- 172.21.15.72:0/2213411389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcea009e410 0x7fcea01c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.374+0000 7fcea5098700 1 --2- 172.21.15.72:0/2213411389 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcea009e000 0x7fcea01c5560 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fce900090b0 tx=0x7fce90004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.374+0000 7fce967fc700 1 -- 172.21.15.72:0/2213411389 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce90004450 con 0x7fcea009e000 2023-10-03T10:15:08.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.374+0000 7fce967fc700 1 -- 172.21.15.72:0/2213411389 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9001f070 con 0x7fcea009e000 2023-10-03T10:15:08.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.374+0000 7fcea7afd700 1 -- 172.21.15.72:0/2213411389 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce900094a0 con 0x7fcea009e000 2023-10-03T10:15:08.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.374+0000 7fce967fc700 1 -- 172.21.15.72:0/2213411389 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce900038e0 con 0x7fcea009e000 2023-10-03T10:15:08.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.374+0000 7fcea7afd700 1 -- 172.21.15.72:0/2213411389 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea01a8b80 con 0x7fcea009e000 2023-10-03T10:15:08.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.374+0000 7fce967fc700 1 -- 172.21.15.72:0/2213411389 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce90003a40 con 0x7fcea009e000 2023-10-03T10:15:08.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.374+0000 7fce967fc700 1 -- 172.21.15.72:0/2213411389 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fce90021070 con 0x7fcea009e000 2023-10-03T10:15:08.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.375+0000 7fcea7afd700 1 -- 172.21.15.72:0/2213411389 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea01a9730 con 0x7fcea009e000 2023-10-03T10:15:08.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.380+0000 7fce967fc700 1 -- 172.21.15.72:0/2213411389 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce90015070 con 0x7fcea009e000 2023-10-03T10:15:08.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.412+0000 7f407622e700 1 Processor -- start 2023-10-03T10:15:08.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.412+0000 7f407622e700 1 -- start start 2023-10-03T10:15:08.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f407622e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40701305f0 0x7f40701309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f407622e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4070070160 0x7f4070138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f407622e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40701301c0 con 0x7f407006f660 2023-10-03T10:15:08.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f407622e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4070071ff0 con 0x7f40701305f0 2023-10-03T10:15:08.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f407622e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4070070e70 con 0x7f4070070160 2023-10-03T10:15:08.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f406effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f407006f660 0x7f407006fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59610/0 (socket says 172.21.15.72:59610) 2023-10-03T10:15:08.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f406ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4070070160 0x7f4070138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f406effd700 1 -- 172.21.15.72:0/776412644 learned_addr learned my addr 172.21.15.72:0/776412644 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:08.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f406f7fe700 1 --2- 172.21.15.72:0/776412644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40701305f0 0x7f40701309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f406e7fc700 1 -- 172.21.15.72:0/776412644 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001359380 0 0) 0x7f40701301c0 con 0x7f407006f660 2023-10-03T10:15:08.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f406e7fc700 1 -- 172.21.15.72:0/776412644 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f405c0035b0 con 0x7f407006f660 2023-10-03T10:15:08.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f406f7fe700 1 -- 172.21.15.72:0/776412644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4070070160 msgr2=0x7f4070138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f406f7fe700 1 --2- 172.21.15.72:0/776412644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4070070160 0x7f4070138540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f406f7fe700 1 -- 172.21.15.72:0/776412644 >> v1:172.21.15.72:6789/0 conn(0x7f407006f660 legacy=0x7f407006fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f406f7fe700 1 -- 172.21.15.72:0/776412644 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40700722b0 con 0x7f40701305f0 2023-10-03T10:15:08.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.413+0000 7f406ffff700 1 --2- 172.21.15.72:0/776412644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4070070160 0x7f4070138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.414+0000 7f406f7fe700 1 --2- 172.21.15.72:0/776412644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40701305f0 0x7f40701309c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4060009870 tx=0x7f4060009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e9d78ce4e57ee6e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.414+0000 7f406e7fc700 1 -- 172.21.15.72:0/776412644 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060011830 con 0x7f40701305f0 2023-10-03T10:15:08.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.414+0000 7f406e7fc700 1 -- 172.21.15.72:0/776412644 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4060011990 con 0x7f40701305f0 2023-10-03T10:15:08.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.414+0000 7f406e7fc700 1 -- 172.21.15.72:0/776412644 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060011d20 con 0x7f40701305f0 2023-10-03T10:15:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.414+0000 7f407622e700 1 -- 172.21.15.72:0/776412644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40701305f0 msgr2=0x7f40701309c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.414+0000 7f407622e700 1 --2- 172.21.15.72:0/776412644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40701305f0 0x7f40701309c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4060009870 tx=0x7f4060009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.414+0000 7f407622e700 1 -- 172.21.15.72:0/776412644 shutdown_connections 2023-10-03T10:15:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.414+0000 7f407622e700 1 --2- 172.21.15.72:0/776412644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4070070160 0x7f4070138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.414+0000 7f407622e700 1 --2- 172.21.15.72:0/776412644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40701305f0 0x7f40701309c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.414+0000 7f407622e700 1 -- 172.21.15.72:0/776412644 >> 172.21.15.72:0/776412644 conn(0x7f40700a2aa0 msgr2=0x7f40700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.414+0000 7f407622e700 1 -- 172.21.15.72:0/776412644 shutdown_connections 2023-10-03T10:15:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.414+0000 7f407622e700 1 -- 172.21.15.72:0/776412644 wait complete. 2023-10-03T10:15:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.415+0000 7f407622e700 1 Processor -- start 2023-10-03T10:15:08.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f407622e700 1 -- start start 2023-10-03T10:15:08.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f407622e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f407006f660 0x7f407011c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f407622e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4070070160 0x7f407011cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f407622e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40701305f0 0x7f407011d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f407622e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407011f350 con 0x7f40701305f0 2023-10-03T10:15:08.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f407622e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40700a1f60 con 0x7f407006f660 2023-10-03T10:15:08.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f407622e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f407012dc60 con 0x7f4070070160 2023-10-03T10:15:08.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f406ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40701305f0 0x7f407011d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f406effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4070070160 0x7f407011cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f406f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f407006f660 0x7f407011c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f406ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40701305f0 0x7f407011d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54874/0 (socket says 172.21.15.72:54874) 2023-10-03T10:15:08.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f406f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f407006f660 0x7f407011c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44108/0 (socket says 172.21.15.72:44108) 2023-10-03T10:15:08.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f406ffff700 1 -- 172.21.15.72:0/3777642070 learned_addr learned my addr 172.21.15.72:0/3777642070 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:08.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f406f7fe700 1 -- 172.21.15.72:0/3777642070 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4070070160 msgr2=0x7f407011cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f406f7fe700 1 --2- 172.21.15.72:0/3777642070 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4070070160 0x7f407011cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f406f7fe700 1 -- 172.21.15.72:0/3777642070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40701305f0 msgr2=0x7f407011d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f406f7fe700 1 --2- 172.21.15.72:0/3777642070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40701305f0 0x7f407011d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f406f7fe700 1 -- 172.21.15.72:0/3777642070 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4068009a70 con 0x7f407006f660 2023-10-03T10:15:08.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f406effd700 1 --2- 172.21.15.72:0/3777642070 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4070070160 0x7f407011cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.416+0000 7f406ffff700 1 --2- 172.21.15.72:0/3777642070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40701305f0 0x7f407011d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.417+0000 7f406f7fe700 1 --2- 172.21.15.72:0/3777642070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f407006f660 0x7f407011c890 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4060016000 tx=0x7f4060004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.417+0000 7f4067fff700 1 -- 172.21.15.72:0/3777642070 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060020070 con 0x7f407006f660 2023-10-03T10:15:08.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.417+0000 7f4067fff700 1 -- 172.21.15.72:0/3777642070 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4060004040 con 0x7f407006f660 2023-10-03T10:15:08.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.417+0000 7f4067fff700 1 -- 172.21.15.72:0/3777642070 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40600043f0 con 0x7f407006f660 2023-10-03T10:15:08.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.417+0000 7f407622e700 1 -- 172.21.15.72:0/3777642070 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40600094a0 con 0x7f407006f660 2023-10-03T10:15:08.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.417+0000 7f407622e700 1 -- 172.21.15.72:0/3777642070 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407011fe10 con 0x7f407006f660 2023-10-03T10:15:08.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.418+0000 7f4067fff700 1 -- 172.21.15.72:0/3777642070 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4060024070 con 0x7f407006f660 2023-10-03T10:15:08.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.418+0000 7f407622e700 1 -- 172.21.15.72:0/3777642070 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4070074ea0 con 0x7f407006f660 2023-10-03T10:15:08.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.418+0000 7f4067fff700 1 -- 172.21.15.72:0/3777642070 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4060041d60 con 0x7f407006f660 2023-10-03T10:15:08.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.422+0000 7f4067fff700 1 -- 172.21.15.72:0/3777642070 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4060004550 con 0x7f407006f660 2023-10-03T10:15:08.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.576+0000 7fcea7afd700 1 -- 172.21.15.72:0/2213411389 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcea01a78c0 con 0x7fcea009e000 2023-10-03T10:15:08.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.576+0000 7fce967fc700 1 -- 172.21.15.72:0/2213411389 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce9002b020 con 0x7fcea009e000 2023-10-03T10:15:08.577 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.578+0000 7fcea7afd700 1 -- 172.21.15.72:0/2213411389 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcea009e000 msgr2=0x7fcea01c5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.578+0000 7fcea7afd700 1 --2- 172.21.15.72:0/2213411389 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcea009e000 0x7fcea01c5560 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fce900090b0 tx=0x7fce90004750 comp rx=0 tx=0).stop 2023-10-03T10:15:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.578+0000 7fcea7afd700 1 -- 172.21.15.72:0/2213411389 shutdown_connections 2023-10-03T10:15:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.578+0000 7fcea7afd700 1 --2- 172.21.15.72:0/2213411389 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcea009e410 0x7fcea01c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.578+0000 7fcea7afd700 1 --2- 172.21.15.72:0/2213411389 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcea009d6f0 0x7fcea01c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.578+0000 7fcea7afd700 1 --2- 172.21.15.72:0/2213411389 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcea009e000 0x7fcea01c5560 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.578+0000 7fcea7afd700 1 -- 172.21.15.72:0/2213411389 >> 172.21.15.72:0/2213411389 conn(0x7fcea0066f50 msgr2=0x7fcea01bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.578+0000 7fcea7afd700 1 -- 172.21.15.72:0/2213411389 shutdown_connections 2023-10-03T10:15:08.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.578+0000 7fcea7afd700 1 -- 172.21.15.72:0/2213411389 wait complete. 2023-10-03T10:15:08.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:08.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.613+0000 7f407622e700 1 -- 172.21.15.72:0/3777642070 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f407006b9e0 con 0x7f407006f660 2023-10-03T10:15:08.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.614+0000 7f4067fff700 1 -- 172.21.15.72:0/3777642070 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f406002b020 con 0x7f407006f660 2023-10-03T10:15:08.614 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:08.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.616+0000 7f407622e700 1 -- 172.21.15.72:0/3777642070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f407006f660 msgr2=0x7f407011c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.616+0000 7f407622e700 1 --2- 172.21.15.72:0/3777642070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f407006f660 0x7f407011c890 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4060016000 tx=0x7f4060004750 comp rx=0 tx=0).stop 2023-10-03T10:15:08.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.616+0000 7f407622e700 1 -- 172.21.15.72:0/3777642070 shutdown_connections 2023-10-03T10:15:08.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.616+0000 7f407622e700 1 --2- 172.21.15.72:0/3777642070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40701305f0 0x7f407011d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.616+0000 7f407622e700 1 --2- 172.21.15.72:0/3777642070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f407006f660 0x7f407011c890 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.616+0000 7f407622e700 1 --2- 172.21.15.72:0/3777642070 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4070070160 0x7f407011cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.616+0000 7f407622e700 1 -- 172.21.15.72:0/3777642070 >> 172.21.15.72:0/3777642070 conn(0x7f40700a2aa0 msgr2=0x7f40700a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.616+0000 7f407622e700 1 -- 172.21.15.72:0/3777642070 shutdown_connections 2023-10-03T10:15:08.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.616+0000 7f407622e700 1 -- 172.21.15.72:0/3777642070 wait complete. 2023-10-03T10:15:08.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:08.677 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:08.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.799+0000 7f9f1f751700 1 Processor -- start 2023-10-03T10:15:08.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.799+0000 7f9f1f751700 1 -- start start 2023-10-03T10:15:08.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.799+0000 7f9f1f751700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f1809d6f0 0x7f9f1809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.799+0000 7f9f1f751700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f1809e000 0x7f9f181339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.799+0000 7f9f1f751700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f1809e410 0x7f9f18133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.799+0000 7f9f1f751700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f1806b460 con 0x7f9f1809e410 2023-10-03T10:15:08.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.799+0000 7f9f1f751700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1809b120 con 0x7f9f1809d6f0 2023-10-03T10:15:08.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.799+0000 7f9f1f751700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1809a7e0 con 0x7f9f1809e000 2023-10-03T10:15:08.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f1dcee700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f1809e410 0x7f9f18133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f1d4ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f1809d6f0 0x7f9f1809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f1ccec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f1809e000 0x7f9f181339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f1dcee700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f1809e410 0x7f9f18133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54890/0 (socket says 172.21.15.72:54890) 2023-10-03T10:15:08.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f1d4ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f1809d6f0 0x7f9f1809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44118/0 (socket says 172.21.15.72:44118) 2023-10-03T10:15:08.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f1dcee700 1 -- 172.21.15.72:0/1216285101 learned_addr learned my addr 172.21.15.72:0/1216285101 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:08.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f1dcee700 1 -- 172.21.15.72:0/1216285101 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f1809e000 msgr2=0x7f9f181339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f1dcee700 1 --2- 172.21.15.72:0/1216285101 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f1809e000 0x7f9f181339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f1dcee700 1 -- 172.21.15.72:0/1216285101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f1809d6f0 msgr2=0x7f9f1809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f1dcee700 1 --2- 172.21.15.72:0/1216285101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f1809d6f0 0x7f9f1809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f1dcee700 1 -- 172.21.15.72:0/1216285101 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1809a500 con 0x7f9f1809e410 2023-10-03T10:15:08.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f1ccec700 1 --2- 172.21.15.72:0/1216285101 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f1809e000 0x7f9f181339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f1d4ed700 1 --2- 172.21.15.72:0/1216285101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f1809d6f0 0x7f9f1809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f1dcee700 1 --2- 172.21.15.72:0/1216285101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f1809e410 0x7f9f18133f30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009e50 tx=0x7f9f1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a74e68f57cabc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f0ffff700 1 -- 172.21.15.72:0/1216285101 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1000e070 con 0x7f9f1809e410 2023-10-03T10:15:08.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f0ffff700 1 -- 172.21.15.72:0/1216285101 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1000b910 con 0x7f9f1809e410 2023-10-03T10:15:08.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.800+0000 7f9f0ffff700 1 -- 172.21.15.72:0/1216285101 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1000bcc0 con 0x7f9f1809e410 2023-10-03T10:15:08.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.801+0000 7f9f1f751700 1 -- 172.21.15.72:0/1216285101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f1809e410 msgr2=0x7f9f18133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.801+0000 7f9f1f751700 1 --2- 172.21.15.72:0/1216285101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f1809e410 0x7f9f18133f30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009e50 tx=0x7f9f1000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:08.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.801+0000 7f9f1f751700 1 -- 172.21.15.72:0/1216285101 shutdown_connections 2023-10-03T10:15:08.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.801+0000 7f9f1f751700 1 --2- 172.21.15.72:0/1216285101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f1809e410 0x7f9f18133f30 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.801+0000 7f9f1f751700 1 --2- 172.21.15.72:0/1216285101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f1809d6f0 0x7f9f1809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.801+0000 7f9f1f751700 1 --2- 172.21.15.72:0/1216285101 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f1809e000 0x7f9f181339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.801+0000 7f9f1f751700 1 -- 172.21.15.72:0/1216285101 >> 172.21.15.72:0/1216285101 conn(0x7f9f18066f50 msgr2=0x7f9f1809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.801+0000 7f9f1f751700 1 -- 172.21.15.72:0/1216285101 shutdown_connections 2023-10-03T10:15:08.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.801+0000 7f9f1f751700 1 -- 172.21.15.72:0/1216285101 wait complete. 2023-10-03T10:15:08.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.802+0000 7f9f1f751700 1 Processor -- start 2023-10-03T10:15:08.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.802+0000 7f9f1f751700 1 -- start start 2023-10-03T10:15:08.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.802+0000 7f9f1f751700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f1809d6f0 0x7f9f181c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.802+0000 7f9f1f751700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f1809e000 0x7f9f181c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.802+0000 7f9f1f751700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f1809e410 0x7f9f181c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.802+0000 7f9f1f751700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f181a65c0 con 0x7f9f1809d6f0 2023-10-03T10:15:08.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.802+0000 7f9f1f751700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f181a63d0 con 0x7f9f1809e410 2023-10-03T10:15:08.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.802+0000 7f9f1f751700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1809c710 con 0x7f9f1809e000 2023-10-03T10:15:08.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.802+0000 7f9f1d4ed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f1809d6f0 0x7f9f181c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.802+0000 7f9f1ccec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f1809e000 0x7f9f181c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.802+0000 7f9f1d4ed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f1809d6f0 0x7f9f181c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54906/0 (socket says 172.21.15.72:54906) 2023-10-03T10:15:08.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.802+0000 7f9f1d4ed700 1 -- 172.21.15.72:0/1076995343 learned_addr learned my addr 172.21.15.72:0/1076995343 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:08.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.802+0000 7f9f1dcee700 1 --2- 172.21.15.72:0/1076995343 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f1809e410 0x7f9f181c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.803+0000 7f9f1ccec700 1 -- 172.21.15.72:0/1076995343 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f1809e410 msgr2=0x7f9f181c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.803+0000 7f9f1ccec700 1 --2- 172.21.15.72:0/1076995343 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f1809e410 0x7f9f181c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.803+0000 7f9f1ccec700 1 -- 172.21.15.72:0/1076995343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f1809d6f0 msgr2=0x7f9f181c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.803+0000 7f9f1ccec700 1 --2- 172.21.15.72:0/1076995343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f1809d6f0 0x7f9f181c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.803+0000 7f9f1ccec700 1 -- 172.21.15.72:0/1076995343 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f140094a0 con 0x7f9f1809e000 2023-10-03T10:15:08.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.803+0000 7f9f1d4ed700 1 --2- 172.21.15.72:0/1076995343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f1809d6f0 0x7f9f181c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.803+0000 7f9f1dcee700 1 --2- 172.21.15.72:0/1076995343 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f1809e410 0x7f9f181c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.803+0000 7f9f1ccec700 1 --2- 172.21.15.72:0/1076995343 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f1809e000 0x7f9f181c8580 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800e980 tx=0x7f9f0800ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.803+0000 7f9f0dffb700 1 -- 172.21.15.72:0/1076995343 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0800c690 con 0x7f9f1809e000 2023-10-03T10:15:08.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.803+0000 7f9f0dffb700 1 -- 172.21.15.72:0/1076995343 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0800c7f0 con 0x7f9f1809e000 2023-10-03T10:15:08.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.803+0000 7f9f1f751700 1 -- 172.21.15.72:0/1076995343 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f080094a0 con 0x7f9f1809e000 2023-10-03T10:15:08.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.803+0000 7f9f0dffb700 1 -- 172.21.15.72:0/1076995343 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0800cb80 con 0x7f9f1809e000 2023-10-03T10:15:08.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.803+0000 7f9f1f751700 1 -- 172.21.15.72:0/1076995343 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f10009b30 con 0x7f9f1809e000 2023-10-03T10:15:08.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.804+0000 7f9f0dffb700 1 -- 172.21.15.72:0/1076995343 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f0800cce0 con 0x7f9f1809e000 2023-10-03T10:15:08.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.804+0000 7f9f0dffb700 1 -- 172.21.15.72:0/1076995343 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9f0803f650 con 0x7f9f1809e000 2023-10-03T10:15:08.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.804+0000 7f9f1f751700 1 -- 172.21.15.72:0/1076995343 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f181a7ca0 con 0x7f9f1809e000 2023-10-03T10:15:08.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.809+0000 7f9f0dffb700 1 -- 172.21.15.72:0/1076995343 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f181a7ca0 con 0x7f9f1809e000 2023-10-03T10:15:08.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.993+0000 7f9f1f751700 1 -- 172.21.15.72:0/1076995343 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9f181a7ca0 con 0x7f9f1809e000 2023-10-03T10:15:08.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.993+0000 7f9f0dffb700 1 -- 172.21.15.72:0/1076995343 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f181a7ca0 con 0x7f9f1809e000 2023-10-03T10:15:08.994 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.995+0000 7f9f1f751700 1 -- 172.21.15.72:0/1076995343 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f1809e000 msgr2=0x7f9f181c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.995+0000 7f9f1f751700 1 --2- 172.21.15.72:0/1076995343 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f1809e000 0x7f9f181c8580 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800e980 tx=0x7f9f0800ec90 comp rx=0 tx=0).stop 2023-10-03T10:15:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.995+0000 7f9f1f751700 1 -- 172.21.15.72:0/1076995343 shutdown_connections 2023-10-03T10:15:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.995+0000 7f9f1f751700 1 --2- 172.21.15.72:0/1076995343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f1809d6f0 0x7f9f181c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.995+0000 7f9f1f751700 1 --2- 172.21.15.72:0/1076995343 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f1809e410 0x7f9f181c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.995+0000 7f9f1f751700 1 --2- 172.21.15.72:0/1076995343 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f1809e000 0x7f9f181c8580 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.995+0000 7f9f1f751700 1 -- 172.21.15.72:0/1076995343 >> 172.21.15.72:0/1076995343 conn(0x7f9f18066f50 msgr2=0x7f9f181bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.995+0000 7f9f1f751700 1 -- 172.21.15.72:0/1076995343 shutdown_connections 2023-10-03T10:15:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:08.995+0000 7f9f1f751700 1 -- 172.21.15.72:0/1076995343 wait complete. 2023-10-03T10:15:09.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:09.378 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:09.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.500+0000 7fb794b78700 1 Processor -- start 2023-10-03T10:15:09.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.500+0000 7fb794b78700 1 -- start start 2023-10-03T10:15:09.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb794b78700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb79009d6f0 0x7fb79009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb794b78700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb79009e000 0x7fb7901339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb794b78700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79009b120 con 0x7fb79009e410 2023-10-03T10:15:09.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb794b78700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79006b460 con 0x7fb79009e000 2023-10-03T10:15:09.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb794b78700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb79009a7e0 con 0x7fb79009d6f0 2023-10-03T10:15:09.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb78e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb79009d6f0 0x7fb79009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb78dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb79009e000 0x7fb7901339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb78ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb79009e410 0x7fb790133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59614/0 (socket says 172.21.15.72:59614) 2023-10-03T10:15:09.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb78e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb79009d6f0 0x7fb79009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59748/0 (socket says 172.21.15.72:59748) 2023-10-03T10:15:09.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb78ed9d700 1 -- 172.21.15.72:0/3084520987 learned_addr learned my addr 172.21.15.72:0/3084520987 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:09.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb78dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb79009e000 0x7fb7901339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44148/0 (socket says 172.21.15.72:44148) 2023-10-03T10:15:09.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb78e59c700 1 -- 172.21.15.72:0/3084520987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb79009e000 msgr2=0x7fb7901339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb78e59c700 1 --2- 172.21.15.72:0/3084520987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb79009e000 0x7fb7901339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb78e59c700 1 -- 172.21.15.72:0/3084520987 >> v1:172.21.15.72:6789/0 conn(0x7fb79009e410 legacy=0x7fb790133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb78d59a700 1 -- 172.21.15.72:0/3084520987 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375770674 0 0) 0x7fb79009b120 con 0x7fb79009e410 2023-10-03T10:15:09.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb78e59c700 1 -- 172.21.15.72:0/3084520987 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79009a500 con 0x7fb79009d6f0 2023-10-03T10:15:09.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.501+0000 7fb78dd9b700 1 --2- 172.21.15.72:0/3084520987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb79009e000 0x7fb7901339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:09.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.502+0000 7fb78e59c700 1 --2- 172.21.15.72:0/3084520987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb79009d6f0 0x7fb79009dac0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb7840098a0 tx=0x7fb784009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d9af9747c7471d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.502+0000 7fb78d59a700 1 -- 172.21.15.72:0/3084520987 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784011830 con 0x7fb79009d6f0 2023-10-03T10:15:09.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.502+0000 7fb78d59a700 1 -- 172.21.15.72:0/3084520987 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb784011990 con 0x7fb79009d6f0 2023-10-03T10:15:09.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.502+0000 7fb78d59a700 1 -- 172.21.15.72:0/3084520987 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784011d20 con 0x7fb79009d6f0 2023-10-03T10:15:09.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.502+0000 7fb794b78700 1 -- 172.21.15.72:0/3084520987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb79009d6f0 msgr2=0x7fb79009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.502+0000 7fb794b78700 1 --2- 172.21.15.72:0/3084520987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb79009d6f0 0x7fb79009dac0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb7840098a0 tx=0x7fb784009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.502+0000 7fb794b78700 1 -- 172.21.15.72:0/3084520987 shutdown_connections 2023-10-03T10:15:09.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.502+0000 7fb794b78700 1 --2- 172.21.15.72:0/3084520987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb79009d6f0 0x7fb79009dac0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.502+0000 7fb794b78700 1 --2- 172.21.15.72:0/3084520987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb79009e000 0x7fb7901339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.502+0000 7fb794b78700 1 -- 172.21.15.72:0/3084520987 >> 172.21.15.72:0/3084520987 conn(0x7fb790066f50 msgr2=0x7fb79009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.502+0000 7fb794b78700 1 -- 172.21.15.72:0/3084520987 shutdown_connections 2023-10-03T10:15:09.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.502+0000 7fb794b78700 1 -- 172.21.15.72:0/3084520987 wait complete. 2023-10-03T10:15:09.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.503+0000 7fb794b78700 1 Processor -- start 2023-10-03T10:15:09.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.503+0000 7fb794b78700 1 -- start start 2023-10-03T10:15:09.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb794b78700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb79009d6f0 0x7fb7901b8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb794b78700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb79009e000 0x7fb7901b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb794b78700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb79009e410 0x7fb7901c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb794b78700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7901a4c00 con 0x7fb79009d6f0 2023-10-03T10:15:09.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb794b78700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7901a8070 con 0x7fb79009e000 2023-10-03T10:15:09.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb794b78700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7901a6360 con 0x7fb79009e410 2023-10-03T10:15:09.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb78e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb79009d6f0 0x7fb7901b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb78e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb79009d6f0 0x7fb7901b8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54922/0 (socket says 172.21.15.72:54922) 2023-10-03T10:15:09.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb78e59c700 1 -- 172.21.15.72:0/3671403844 learned_addr learned my addr 172.21.15.72:0/3671403844 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:09.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb78ed9d700 1 --2- 172.21.15.72:0/3671403844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb79009e410 0x7fb7901c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb78dd9b700 1 --2- 172.21.15.72:0/3671403844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb79009e000 0x7fb7901b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb78e59c700 1 -- 172.21.15.72:0/3671403844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb79009e410 msgr2=0x7fb7901c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb78e59c700 1 --2- 172.21.15.72:0/3671403844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb79009e410 0x7fb7901c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb78e59c700 1 -- 172.21.15.72:0/3671403844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb79009e000 msgr2=0x7fb7901b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb78e59c700 1 --2- 172.21.15.72:0/3671403844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb79009e000 0x7fb7901b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb78e59c700 1 -- 172.21.15.72:0/3671403844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7800094a0 con 0x7fb79009d6f0 2023-10-03T10:15:09.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.504+0000 7fb78e59c700 1 --2- 172.21.15.72:0/3671403844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb79009d6f0 0x7fb7901b8530 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb7840090b0 tx=0x7fb784004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.505+0000 7fb77effd700 1 -- 172.21.15.72:0/3671403844 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78401a720 con 0x7fb79009d6f0 2023-10-03T10:15:09.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.505+0000 7fb77effd700 1 -- 172.21.15.72:0/3671403844 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78401a880 con 0x7fb79009d6f0 2023-10-03T10:15:09.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.505+0000 7fb794b78700 1 -- 172.21.15.72:0/3671403844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7840094a0 con 0x7fb79009d6f0 2023-10-03T10:15:09.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.505+0000 7fb77effd700 1 -- 172.21.15.72:0/3671403844 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78401ac30 con 0x7fb79009d6f0 2023-10-03T10:15:09.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.505+0000 7fb794b78700 1 -- 172.21.15.72:0/3671403844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7900a2df0 con 0x7fb79009d6f0 2023-10-03T10:15:09.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.505+0000 7fb77effd700 1 -- 172.21.15.72:0/3671403844 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb784022070 con 0x7fb79009d6f0 2023-10-03T10:15:09.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.505+0000 7fb77effd700 1 -- 172.21.15.72:0/3671403844 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb7840403e0 con 0x7fb79009d6f0 2023-10-03T10:15:09.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.506+0000 7fb794b78700 1 -- 172.21.15.72:0/3671403844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7901b9010 con 0x7fb79009d6f0 2023-10-03T10:15:09.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.510+0000 7fb77effd700 1 -- 172.21.15.72:0/3671403844 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb784015080 con 0x7fb79009d6f0 2023-10-03T10:15:09.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:09.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:09.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.712+0000 7fb794b78700 1 -- 172.21.15.72:0/3671403844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb790074ea0 con 0x7fb79009d6f0 2023-10-03T10:15:09.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.712+0000 7fb77effd700 1 -- 172.21.15.72:0/3671403844 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb784029020 con 0x7fb79009d6f0 2023-10-03T10:15:09.713 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:09.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.714+0000 7fb794b78700 1 -- 172.21.15.72:0/3671403844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb79009d6f0 msgr2=0x7fb7901b8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.714+0000 7fb794b78700 1 --2- 172.21.15.72:0/3671403844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb79009d6f0 0x7fb7901b8530 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb7840090b0 tx=0x7fb784004750 comp rx=0 tx=0).stop 2023-10-03T10:15:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.715+0000 7fb794b78700 1 -- 172.21.15.72:0/3671403844 shutdown_connections 2023-10-03T10:15:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.715+0000 7fb794b78700 1 --2- 172.21.15.72:0/3671403844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb79009d6f0 0x7fb7901b8530 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.715+0000 7fb794b78700 1 --2- 172.21.15.72:0/3671403844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb79009e410 0x7fb7901c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.715+0000 7fb794b78700 1 --2- 172.21.15.72:0/3671403844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb79009e000 0x7fb7901b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.715+0000 7fb794b78700 1 -- 172.21.15.72:0/3671403844 >> 172.21.15.72:0/3671403844 conn(0x7fb790066f50 msgr2=0x7fb7901bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.715+0000 7fb794b78700 1 -- 172.21.15.72:0/3671403844 shutdown_connections 2023-10-03T10:15:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.715+0000 7fb794b78700 1 -- 172.21.15.72:0/3671403844 wait complete. 2023-10-03T10:15:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.716+0000 7fd3cc168700 1 Processor -- start 2023-10-03T10:15:09.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.716+0000 7fd3cc168700 1 -- start start 2023-10-03T10:15:09.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.717+0000 7fd3cc168700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd3c412cf60 0x7fd3c406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.717+0000 7fd3cc168700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c4130430 0x7fd3c4137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.717+0000 7fd3cc168700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c412cd90 con 0x7fd3c412f8b0 2023-10-03T10:15:09.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.717+0000 7fd3cc168700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c412d330 con 0x7fd3c412cf60 2023-10-03T10:15:09.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.717+0000 7fd3cc168700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c4071780 con 0x7fd3c4130430 2023-10-03T10:15:09.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.717+0000 7fd3c9f04700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd3c412cf60 0x7fd3c406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.717+0000 7fd3ca705700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c4130430 0x7fd3c4137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.717+0000 7fd3c9f04700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd3c412cf60 0x7fd3c406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54930/0 (socket says 172.21.15.72:54930) 2023-10-03T10:15:09.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.717+0000 7fd3ca705700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c4130430 0x7fd3c4137c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44160/0 (socket says 172.21.15.72:44160) 2023-10-03T10:15:09.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.717+0000 7fd3c9f04700 1 -- 172.21.15.72:0/2413222920 learned_addr learned my addr 172.21.15.72:0/2413222920 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:09.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.717+0000 7fd3c9703700 1 --1- 172.21.15.72:0/2413222920 >> v1:172.21.15.72:6789/0 conn(0x7fd3c412f8b0 0x7fd3c412fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59620/0 (socket says 172.21.15.72:59620) 2023-10-03T10:15:09.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.718+0000 7fd3ca705700 1 -- 172.21.15.72:0/2413222920 >> v2:172.21.15.72:3300/0 conn(0x7fd3c412cf60 msgr2=0x7fd3c406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.718+0000 7fd3ca705700 1 --2- 172.21.15.72:0/2413222920 >> v2:172.21.15.72:3300/0 conn(0x7fd3c412cf60 0x7fd3c406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.718+0000 7fd3ca705700 1 -- 172.21.15.72:0/2413222920 >> v1:172.21.15.72:6789/0 conn(0x7fd3c412f8b0 legacy=0x7fd3c412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.718+0000 7fd3ca705700 1 -- 172.21.15.72:0/2413222920 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c4071a40 con 0x7fd3c4130430 2023-10-03T10:15:09.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.718+0000 7fd3c9f04700 1 --2- 172.21.15.72:0/2413222920 >> v2:172.21.15.72:3300/0 conn(0x7fd3c412cf60 0x7fd3c406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:09.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.718+0000 7fd3ca705700 1 --2- 172.21.15.72:0/2413222920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c4130430 0x7fd3c4137c30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009d90 tx=0x7fd3bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb1ddd38fed97e50 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.718+0000 7fd3c8f02700 1 -- 172.21.15.72:0/2413222920 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00e070 con 0x7fd3c4130430 2023-10-03T10:15:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.718+0000 7fd3c8f02700 1 -- 172.21.15.72:0/2413222920 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc00bb20 con 0x7fd3c4130430 2023-10-03T10:15:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.718+0000 7fd3c8f02700 1 -- 172.21.15.72:0/2413222920 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc012430 con 0x7fd3c4130430 2023-10-03T10:15:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.719+0000 7fd3cc168700 1 -- 172.21.15.72:0/2413222920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c4130430 msgr2=0x7fd3c4137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.719+0000 7fd3cc168700 1 --2- 172.21.15.72:0/2413222920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c4130430 0x7fd3c4137c30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009d90 tx=0x7fd3bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.719+0000 7fd3cc168700 1 -- 172.21.15.72:0/2413222920 shutdown_connections 2023-10-03T10:15:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.719+0000 7fd3cc168700 1 --2- 172.21.15.72:0/2413222920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c4130430 0x7fd3c4137c30 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.719+0000 7fd3cc168700 1 --2- 172.21.15.72:0/2413222920 >> v2:172.21.15.72:3300/0 conn(0x7fd3c412cf60 0x7fd3c406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.719+0000 7fd3cc168700 1 -- 172.21.15.72:0/2413222920 >> 172.21.15.72:0/2413222920 conn(0x7fd3c40a2aa0 msgr2=0x7fd3c40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.719+0000 7fd3cc168700 1 -- 172.21.15.72:0/2413222920 shutdown_connections 2023-10-03T10:15:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.719+0000 7fd3cc168700 1 -- 172.21.15.72:0/2413222920 wait complete. 2023-10-03T10:15:09.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.720+0000 7fd3cc168700 1 Processor -- start 2023-10-03T10:15:09.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.720+0000 7fd3cc168700 1 -- start start 2023-10-03T10:15:09.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3cc168700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c412cf60 0x7fd3c4128dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3cc168700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3c412f8b0 0x7fd3c4129310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3cc168700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3c4130430 0x7fd3c4129850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3cc168700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c409ea80 con 0x7fd3c4130430 2023-10-03T10:15:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3cc168700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c409e890 con 0x7fd3c412cf60 2023-10-03T10:15:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3cc168700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c409ec70 con 0x7fd3c412f8b0 2023-10-03T10:15:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3ca705700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3c4130430 0x7fd3c4129850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3c9703700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3c412f8b0 0x7fd3c4129310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3ca705700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3c4130430 0x7fd3c4129850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54934/0 (socket says 172.21.15.72:54934) 2023-10-03T10:15:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3ca705700 1 -- 172.21.15.72:0/2613614949 learned_addr learned my addr 172.21.15.72:0/2613614949 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3c9f04700 1 --2- 172.21.15.72:0/2613614949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c412cf60 0x7fd3c4128dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3c9703700 1 -- 172.21.15.72:0/2613614949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c412cf60 msgr2=0x7fd3c4128dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3c9703700 1 --2- 172.21.15.72:0/2613614949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c412cf60 0x7fd3c4128dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3c9703700 1 -- 172.21.15.72:0/2613614949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3c4130430 msgr2=0x7fd3c4129850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3c9703700 1 --2- 172.21.15.72:0/2613614949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3c4130430 0x7fd3c4129850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3c9703700 1 -- 172.21.15.72:0/2613614949 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0009550 con 0x7fd3c412f8b0 2023-10-03T10:15:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3ca705700 1 --2- 172.21.15.72:0/2613614949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3c4130430 0x7fd3c4129850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3c9703700 1 --2- 172.21.15.72:0/2613614949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3c412f8b0 0x7fd3c4129310 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400c480 tx=0x7fd3b400c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3ba7fc700 1 -- 172.21.15.72:0/2613614949 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4005cb0 con 0x7fd3c412f8b0 2023-10-03T10:15:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3ba7fc700 1 -- 172.21.15.72:0/2613614949 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b4005e10 con 0x7fd3c412f8b0 2023-10-03T10:15:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3cc168700 1 -- 172.21.15.72:0/2613614949 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc009a70 con 0x7fd3c412f8b0 2023-10-03T10:15:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.721+0000 7fd3ba7fc700 1 -- 172.21.15.72:0/2613614949 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40072d0 con 0x7fd3c412f8b0 2023-10-03T10:15:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.722+0000 7fd3cc168700 1 -- 172.21.15.72:0/2613614949 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c4139420 con 0x7fd3c412f8b0 2023-10-03T10:15:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.722+0000 7fd3ba7fc700 1 -- 172.21.15.72:0/2613614949 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3b4007430 con 0x7fd3c412f8b0 2023-10-03T10:15:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.723+0000 7fd3ba7fc700 1 -- 172.21.15.72:0/2613614949 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd3b403e910 con 0x7fd3c412f8b0 2023-10-03T10:15:09.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.723+0000 7fd3cc168700 1 -- 172.21.15.72:0/2613614949 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c4135130 con 0x7fd3c412f8b0 2023-10-03T10:15:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.728+0000 7fd3ba7fc700 1 -- 172.21.15.72:0/2613614949 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3b4017030 con 0x7fd3c412f8b0 2023-10-03T10:15:09.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:09.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.759+0000 7f3fe479f700 1 Processor -- start 2023-10-03T10:15:09.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.759+0000 7f3fe479f700 1 -- start start 2023-10-03T10:15:09.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.759+0000 7f3fe479f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fdc0a0a30 0x7f3fdc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.759+0000 7f3fe479f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fdc09d630 0x7f3fdc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.759+0000 7f3fe479f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fdc0a2a70 con 0x7f3fdc133930 2023-10-03T10:15:09.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.759+0000 7f3fe479f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0a01d0 con 0x7f3fdc09d630 2023-10-03T10:15:09.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.759+0000 7f3fe479f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc09e2b0 con 0x7f3fdc0a0a30 2023-10-03T10:15:09.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.759+0000 7f3fe253b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fdc0a0a30 0x7f3fdc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.760+0000 7f3fe253b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fdc0a0a30 0x7f3fdc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59760/0 (socket says 172.21.15.72:59760) 2023-10-03T10:15:09.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.760+0000 7f3fe1d3a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fdc09d630 0x7f3fdc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.760+0000 7f3fe253b700 1 -- 172.21.15.72:0/4115691728 learned_addr learned my addr 172.21.15.72:0/4115691728 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:09.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.760+0000 7f3fe2d3c700 1 --1- 172.21.15.72:0/4115691728 >> v1:172.21.15.72:6789/0 conn(0x7f3fdc133930 0x7f3fdc133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59628/0 (socket says 172.21.15.72:59628) 2023-10-03T10:15:09.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.760+0000 7f3fe1d3a700 1 -- 172.21.15.72:0/4115691728 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fdc0a0a30 msgr2=0x7f3fdc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.760+0000 7f3fe1d3a700 1 --2- 172.21.15.72:0/4115691728 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fdc0a0a30 0x7f3fdc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.760+0000 7f3fe1d3a700 1 -- 172.21.15.72:0/4115691728 >> v1:172.21.15.72:6789/0 conn(0x7f3fdc133930 legacy=0x7f3fdc133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.760+0000 7f3fe1539700 1 -- 172.21.15.72:0/4115691728 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217660311 0 0) 0x7f3fdc0a2a70 con 0x7f3fdc133930 2023-10-03T10:15:09.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.760+0000 7f3fe1d3a700 1 -- 172.21.15.72:0/4115691728 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc09dc50 con 0x7f3fdc09d630 2023-10-03T10:15:09.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.760+0000 7f3fe253b700 1 --2- 172.21.15.72:0/4115691728 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fdc0a0a30 0x7f3fdc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:09.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.760+0000 7f3fe1d3a700 1 --2- 172.21.15.72:0/4115691728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fdc09d630 0x7f3fdc0a1340 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009870 tx=0x7f3fcc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=402d40f6b554332e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.760+0000 7f3fe1539700 1 -- 172.21.15.72:0/4115691728 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc011830 con 0x7f3fdc09d630 2023-10-03T10:15:09.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.760+0000 7f3fe1539700 1 -- 172.21.15.72:0/4115691728 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fcc011990 con 0x7f3fdc09d630 2023-10-03T10:15:09.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.760+0000 7f3fe1539700 1 -- 172.21.15.72:0/4115691728 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc011d20 con 0x7f3fdc09d630 2023-10-03T10:15:09.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.761+0000 7f3fe479f700 1 -- 172.21.15.72:0/4115691728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fdc09d630 msgr2=0x7f3fdc0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.761+0000 7f3fe479f700 1 --2- 172.21.15.72:0/4115691728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fdc09d630 0x7f3fdc0a1340 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc009870 tx=0x7f3fcc009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:09.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.761+0000 7f3fe479f700 1 -- 172.21.15.72:0/4115691728 shutdown_connections 2023-10-03T10:15:09.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.761+0000 7f3fe479f700 1 --2- 172.21.15.72:0/4115691728 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fdc0a0a30 0x7f3fdc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.761+0000 7f3fe479f700 1 --2- 172.21.15.72:0/4115691728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fdc09d630 0x7f3fdc0a1340 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.761+0000 7f3fe479f700 1 -- 172.21.15.72:0/4115691728 >> 172.21.15.72:0/4115691728 conn(0x7f3fdc0a3050 msgr2=0x7f3fdc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.761+0000 7f3fe479f700 1 -- 172.21.15.72:0/4115691728 shutdown_connections 2023-10-03T10:15:09.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.761+0000 7f3fe479f700 1 -- 172.21.15.72:0/4115691728 wait complete. 2023-10-03T10:15:09.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.762+0000 7f3fe479f700 1 Processor -- start 2023-10-03T10:15:09.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.762+0000 7f3fe479f700 1 -- start start 2023-10-03T10:15:09.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.762+0000 7f3fe479f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fdc09d630 0x7f3fdc1c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.762+0000 7f3fe479f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fdc0a0a30 0x7f3fdc1c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.762+0000 7f3fe479f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fdc133930 0x7f3fdc1c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.762+0000 7f3fe479f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc120650 con 0x7f3fdc0a0a30 2023-10-03T10:15:09.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.762+0000 7f3fe479f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0a0410 con 0x7f3fdc09d630 2023-10-03T10:15:09.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.762+0000 7f3fe479f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc121e40 con 0x7f3fdc133930 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.762+0000 7f3fe1d3a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fdc0a0a30 0x7f3fdc1c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.762+0000 7f3fe2d3c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fdc133930 0x7f3fdc1c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.762+0000 7f3fe1d3a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fdc0a0a30 0x7f3fdc1c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54944/0 (socket says 172.21.15.72:54944) 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.762+0000 7f3fe2d3c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fdc133930 0x7f3fdc1c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59776/0 (socket says 172.21.15.72:59776) 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.762+0000 7f3fe1d3a700 1 -- 172.21.15.72:0/4035582444 learned_addr learned my addr 172.21.15.72:0/4035582444 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.762+0000 7f3fe253b700 1 --2- 172.21.15.72:0/4035582444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fdc09d630 0x7f3fdc1c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.763+0000 7f3fe2d3c700 1 -- 172.21.15.72:0/4035582444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fdc09d630 msgr2=0x7f3fdc1c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.763+0000 7f3fe2d3c700 1 --2- 172.21.15.72:0/4035582444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fdc09d630 0x7f3fdc1c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.763+0000 7f3fe2d3c700 1 -- 172.21.15.72:0/4035582444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fdc0a0a30 msgr2=0x7f3fdc1c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.763+0000 7f3fe2d3c700 1 --2- 172.21.15.72:0/4035582444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fdc0a0a30 0x7f3fdc1c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.763+0000 7f3fe2d3c700 1 -- 172.21.15.72:0/4035582444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd8009550 con 0x7f3fdc133930 2023-10-03T10:15:09.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.763+0000 7f3fe253b700 1 --2- 172.21.15.72:0/4035582444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fdc09d630 0x7f3fdc1c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:09.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.763+0000 7f3fe1d3a700 1 --2- 172.21.15.72:0/4035582444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fdc0a0a30 0x7f3fdc1c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:09.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.763+0000 7f3fe2d3c700 1 --2- 172.21.15.72:0/4035582444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fdc133930 0x7f3fdc1c8a10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400cbe0 tx=0x7f3fd400cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.763+0000 7f3fd2ffd700 1 -- 172.21.15.72:0/4035582444 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd400aa40 con 0x7f3fdc133930 2023-10-03T10:15:09.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.763+0000 7f3fd2ffd700 1 -- 172.21.15.72:0/4035582444 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd400abc0 con 0x7f3fdc133930 2023-10-03T10:15:09.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.763+0000 7f3fd2ffd700 1 -- 172.21.15.72:0/4035582444 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd40070d0 con 0x7f3fdc133930 2023-10-03T10:15:09.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.763+0000 7f3fe479f700 1 -- 172.21.15.72:0/4035582444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fcc0094a0 con 0x7f3fdc133930 2023-10-03T10:15:09.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.763+0000 7f3fe479f700 1 -- 172.21.15.72:0/4035582444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fdc121140 con 0x7f3fdc133930 2023-10-03T10:15:09.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.764+0000 7f3fd2ffd700 1 -- 172.21.15.72:0/4035582444 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3fd4007230 con 0x7f3fdc133930 2023-10-03T10:15:09.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.764+0000 7f3fd2ffd700 1 -- 172.21.15.72:0/4035582444 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3fd403f040 con 0x7f3fdc133930 2023-10-03T10:15:09.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.764+0000 7f3fe479f700 1 -- 172.21.15.72:0/4035582444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fdc0747f0 con 0x7f3fdc133930 2023-10-03T10:15:09.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.769+0000 7f3fd2ffd700 1 -- 172.21.15.72:0/4035582444 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fd4018020 con 0x7f3fdc133930 2023-10-03T10:15:09.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.923+0000 7fd3cc168700 1 -- 172.21.15.72:0/2613614949 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd3c4074ea0 con 0x7fd3c412f8b0 2023-10-03T10:15:09.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.923+0000 7fd3ba7fc700 1 -- 172.21.15.72:0/2613614949 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3b40076e0 con 0x7fd3c412f8b0 2023-10-03T10:15:09.924 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:09.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.925+0000 7fd3cc168700 1 -- 172.21.15.72:0/2613614949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3c412f8b0 msgr2=0x7fd3c4129310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.925+0000 7fd3cc168700 1 --2- 172.21.15.72:0/2613614949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3c412f8b0 0x7fd3c4129310 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400c480 tx=0x7fd3b400c790 comp rx=0 tx=0).stop 2023-10-03T10:15:09.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.925+0000 7fd3cc168700 1 -- 172.21.15.72:0/2613614949 shutdown_connections 2023-10-03T10:15:09.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.925+0000 7fd3cc168700 1 --2- 172.21.15.72:0/2613614949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3c4130430 0x7fd3c4129850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.925+0000 7fd3cc168700 1 --2- 172.21.15.72:0/2613614949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c412cf60 0x7fd3c4128dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.925+0000 7fd3cc168700 1 --2- 172.21.15.72:0/2613614949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3c412f8b0 0x7fd3c4129310 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.925+0000 7fd3cc168700 1 -- 172.21.15.72:0/2613614949 >> 172.21.15.72:0/2613614949 conn(0x7fd3c40a2aa0 msgr2=0x7fd3c406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.925+0000 7fd3cc168700 1 -- 172.21.15.72:0/2613614949 shutdown_connections 2023-10-03T10:15:09.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.925+0000 7fd3cc168700 1 -- 172.21.15.72:0/2613614949 wait complete. 2023-10-03T10:15:09.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:09.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.962+0000 7f3fe479f700 1 -- 172.21.15.72:0/4035582444 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3fdc072980 con 0x7f3fdc133930 2023-10-03T10:15:09.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.962+0000 7f3fd2ffd700 1 -- 172.21.15.72:0/4035582444 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3fd40074e0 con 0x7f3fdc133930 2023-10-03T10:15:09.963 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:09.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.964+0000 7f3fe479f700 1 -- 172.21.15.72:0/4035582444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fdc133930 msgr2=0x7f3fdc1c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.964+0000 7f3fe479f700 1 --2- 172.21.15.72:0/4035582444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fdc133930 0x7f3fdc1c8a10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400cbe0 tx=0x7f3fd400cef0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.964+0000 7f3fe479f700 1 -- 172.21.15.72:0/4035582444 shutdown_connections 2023-10-03T10:15:09.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.964+0000 7f3fe479f700 1 --2- 172.21.15.72:0/4035582444 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fdc133930 0x7f3fdc1c8a10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.964+0000 7f3fe479f700 1 --2- 172.21.15.72:0/4035582444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fdc09d630 0x7f3fdc1c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.964+0000 7f3fe479f700 1 --2- 172.21.15.72:0/4035582444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fdc0a0a30 0x7f3fdc1c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.964+0000 7f3fe479f700 1 -- 172.21.15.72:0/4035582444 >> 172.21.15.72:0/4035582444 conn(0x7f3fdc0a3050 msgr2=0x7f3fdc1bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.964+0000 7f3fe479f700 1 -- 172.21.15.72:0/4035582444 shutdown_connections 2023-10-03T10:15:09.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:09.964+0000 7f3fe479f700 1 -- 172.21.15.72:0/4035582444 wait complete. 2023-10-03T10:15:09.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:10.008 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:10.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.138+0000 7f79b3784700 1 Processor -- start 2023-10-03T10:15:10.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.138+0000 7f79b3784700 1 -- start start 2023-10-03T10:15:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.138+0000 7f79b3784700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79ac09e930 0x7f79ac09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.138+0000 7f79b3784700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79ac09f240 0x7f79ac1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.138+0000 7f79b3784700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79ac09f650 0x7f79ac131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.138+0000 7f79b3784700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ac070940 con 0x7f79ac09f240 2023-10-03T10:15:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.138+0000 7f79b3784700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac06fd60 con 0x7f79ac09e930 2023-10-03T10:15:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.138+0000 7f79b3784700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac06fa80 con 0x7f79ac09f650 2023-10-03T10:15:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.138+0000 7f79b0d1f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79ac09f240 0x7f79ac1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.138+0000 7f79b1520700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79ac09e930 0x7f79ac09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.138+0000 7f79b1d21700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79ac09f650 0x7f79ac131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.138+0000 7f79b0d1f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79ac09f240 0x7f79ac1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54946/0 (socket says 172.21.15.72:54946) 2023-10-03T10:15:10.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.138+0000 7f79b1520700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79ac09e930 0x7f79ac09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44200/0 (socket says 172.21.15.72:44200) 2023-10-03T10:15:10.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.138+0000 7f79b1d21700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79ac09f650 0x7f79ac131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59780/0 (socket says 172.21.15.72:59780) 2023-10-03T10:15:10.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.138+0000 7f79b0d1f700 1 -- 172.21.15.72:0/3665771404 learned_addr learned my addr 172.21.15.72:0/3665771404 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:10.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.139+0000 7f79b0d1f700 1 -- 172.21.15.72:0/3665771404 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79ac09f650 msgr2=0x7f79ac131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.139+0000 7f79b0d1f700 1 --2- 172.21.15.72:0/3665771404 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79ac09f650 0x7f79ac131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.139+0000 7f79b0d1f700 1 -- 172.21.15.72:0/3665771404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79ac09e930 msgr2=0x7f79ac09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.139+0000 7f79b0d1f700 1 --2- 172.21.15.72:0/3665771404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79ac09e930 0x7f79ac09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.139+0000 7f79b0d1f700 1 -- 172.21.15.72:0/3665771404 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac09fb60 con 0x7f79ac09f240 2023-10-03T10:15:10.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.139+0000 7f79b1520700 1 --2- 172.21.15.72:0/3665771404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79ac09e930 0x7f79ac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:10.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.139+0000 7f79b1d21700 1 --2- 172.21.15.72:0/3665771404 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79ac09f650 0x7f79ac131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:10.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.139+0000 7f79b0d1f700 1 --2- 172.21.15.72:0/3665771404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ac09f240 0x7f79ac1317f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f799c0098f0 tx=0x7f799c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c17d888d2bdd65 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.139+0000 7f79a3fff700 1 -- 172.21.15.72:0/3665771404 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c011830 con 0x7f79ac09f240 2023-10-03T10:15:10.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.139+0000 7f79a3fff700 1 -- 172.21.15.72:0/3665771404 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c011990 con 0x7f79ac09f240 2023-10-03T10:15:10.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.139+0000 7f79a3fff700 1 -- 172.21.15.72:0/3665771404 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c011d20 con 0x7f79ac09f240 2023-10-03T10:15:10.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.140+0000 7f79b3784700 1 -- 172.21.15.72:0/3665771404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ac09f240 msgr2=0x7f79ac1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.140+0000 7f79b3784700 1 --2- 172.21.15.72:0/3665771404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ac09f240 0x7f79ac1317f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f799c0098f0 tx=0x7f799c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:10.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.140+0000 7f79b3784700 1 -- 172.21.15.72:0/3665771404 shutdown_connections 2023-10-03T10:15:10.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.140+0000 7f79b3784700 1 --2- 172.21.15.72:0/3665771404 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79ac09f650 0x7f79ac131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.140+0000 7f79b3784700 1 --2- 172.21.15.72:0/3665771404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79ac09e930 0x7f79ac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.140+0000 7f79b3784700 1 --2- 172.21.15.72:0/3665771404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ac09f240 0x7f79ac1317f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.140+0000 7f79b3784700 1 -- 172.21.15.72:0/3665771404 >> 172.21.15.72:0/3665771404 conn(0x7f79ac0a4210 msgr2=0x7f79ac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.140+0000 7f79b3784700 1 -- 172.21.15.72:0/3665771404 shutdown_connections 2023-10-03T10:15:10.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.140+0000 7f79b3784700 1 -- 172.21.15.72:0/3665771404 wait complete. 2023-10-03T10:15:10.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b3784700 1 Processor -- start 2023-10-03T10:15:10.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b3784700 1 -- start start 2023-10-03T10:15:10.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b3784700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ac09e930 0x7f79ac1a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b3784700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79ac09f240 0x7f79ac1a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b3784700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79ac09f650 0x7f79ac1a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b3784700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac1a5180 con 0x7f79ac09e930 2023-10-03T10:15:10.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b3784700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac1a58e0 con 0x7f79ac09f650 2023-10-03T10:15:10.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b3784700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac1a6b30 con 0x7f79ac09f240 2023-10-03T10:15:10.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b0d1f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79ac09f240 0x7f79ac1a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b1d21700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79ac09f650 0x7f79ac1a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b0d1f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79ac09f240 0x7f79ac1a4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59784/0 (socket says 172.21.15.72:59784) 2023-10-03T10:15:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b1d21700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79ac09f650 0x7f79ac1a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44206/0 (socket says 172.21.15.72:44206) 2023-10-03T10:15:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b0d1f700 1 -- 172.21.15.72:0/3748422939 learned_addr learned my addr 172.21.15.72:0/3748422939 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b1520700 1 --2- 172.21.15.72:0/3748422939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ac09e930 0x7f79ac1a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b1520700 1 -- 172.21.15.72:0/3748422939 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79ac09f240 msgr2=0x7f79ac1a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b1520700 1 --2- 172.21.15.72:0/3748422939 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79ac09f240 0x7f79ac1a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b1520700 1 -- 172.21.15.72:0/3748422939 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79ac09f650 msgr2=0x7f79ac1a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b1520700 1 --2- 172.21.15.72:0/3748422939 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79ac09f650 0x7f79ac1a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b1520700 1 -- 172.21.15.72:0/3748422939 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80094a0 con 0x7f79ac09e930 2023-10-03T10:15:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b0d1f700 1 --2- 172.21.15.72:0/3748422939 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79ac09f240 0x7f79ac1a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.141+0000 7f79b1d21700 1 --2- 172.21.15.72:0/3748422939 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79ac09f650 0x7f79ac1a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:10.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.142+0000 7f79b1520700 1 --2- 172.21.15.72:0/3748422939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ac09e930 0x7f79ac1a3cd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f79a800e9b0 tx=0x7f79a800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.142+0000 7f79a1ffb700 1 -- 172.21.15.72:0/3748422939 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a800ee50 con 0x7f79ac09e930 2023-10-03T10:15:10.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.142+0000 7f79a1ffb700 1 -- 172.21.15.72:0/3748422939 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a8004030 con 0x7f79ac09e930 2023-10-03T10:15:10.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.142+0000 7f79b3784700 1 -- 172.21.15.72:0/3748422939 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a4009a70 con 0x7f79ac09e930 2023-10-03T10:15:10.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.142+0000 7f79a1ffb700 1 -- 172.21.15.72:0/3748422939 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a80043c0 con 0x7f79ac09e930 2023-10-03T10:15:10.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.142+0000 7f79b3784700 1 -- 172.21.15.72:0/3748422939 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c009550 con 0x7f79ac09e930 2023-10-03T10:15:10.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.143+0000 7f79a1ffb700 1 -- 172.21.15.72:0/3748422939 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79a800c7f0 con 0x7f79ac09e930 2023-10-03T10:15:10.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.143+0000 7f79a1ffb700 1 -- 172.21.15.72:0/3748422939 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f79a803f4b0 con 0x7f79ac09e930 2023-10-03T10:15:10.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.143+0000 7f79b3784700 1 -- 172.21.15.72:0/3748422939 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ac1a0b30 con 0x7f79ac09e930 2023-10-03T10:15:10.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.147+0000 7f79a1ffb700 1 -- 172.21.15.72:0/3748422939 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79a8019d60 con 0x7f79ac09e930 2023-10-03T10:15:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.330+0000 7f79b3784700 1 -- 172.21.15.72:0/3748422939 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f79ac1a5ec0 con 0x7f79ac09e930 2023-10-03T10:15:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.330+0000 7f79a1ffb700 1 -- 172.21.15.72:0/3748422939 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79a8019300 con 0x7f79ac09e930 2023-10-03T10:15:10.331 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:10.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.332+0000 7f79b3784700 1 -- 172.21.15.72:0/3748422939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ac09e930 msgr2=0x7f79ac1a3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.332+0000 7f79b3784700 1 --2- 172.21.15.72:0/3748422939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ac09e930 0x7f79ac1a3cd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f79a800e9b0 tx=0x7f79a800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.332+0000 7f79b3784700 1 -- 172.21.15.72:0/3748422939 shutdown_connections 2023-10-03T10:15:10.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.332+0000 7f79b3784700 1 --2- 172.21.15.72:0/3748422939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79ac09e930 0x7f79ac1a3cd0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.332+0000 7f79b3784700 1 --2- 172.21.15.72:0/3748422939 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79ac09f650 0x7f79ac1a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.332+0000 7f79b3784700 1 --2- 172.21.15.72:0/3748422939 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79ac09f240 0x7f79ac1a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.332+0000 7f79b3784700 1 -- 172.21.15.72:0/3748422939 >> 172.21.15.72:0/3748422939 conn(0x7f79ac0a4210 msgr2=0x7f79ac1b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.332+0000 7f79b3784700 1 -- 172.21.15.72:0/3748422939 shutdown_connections 2023-10-03T10:15:10.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.332+0000 7f79b3784700 1 -- 172.21.15.72:0/3748422939 wait complete. 2023-10-03T10:15:10.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:10.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:10.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.854+0000 7f922044a700 1 Processor -- start 2023-10-03T10:15:10.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.854+0000 7f922044a700 1 -- start start 2023-10-03T10:15:10.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.855+0000 7f922044a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9218131810 0x7f9218131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.855+0000 7f922044a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f921809a580 0x7f9218139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.855+0000 7f922044a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92181313c0 con 0x7f9218099a40 2023-10-03T10:15:10.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.855+0000 7f922044a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921806e8c0 con 0x7f9218131810 2023-10-03T10:15:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.855+0000 7f921e9e7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f921809a580 0x7f9218139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.855+0000 7f921e1e6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9218131810 0x7f9218131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.855+0000 7f922044a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9218071d20 con 0x7f921809a580 2023-10-03T10:15:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.855+0000 7f921d9e5700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9218099a40 0x7f9218099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59642/0 (socket says 172.21.15.72:59642) 2023-10-03T10:15:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.855+0000 7f921d9e5700 1 -- 172.21.15.72:0/2304474024 learned_addr learned my addr 172.21.15.72:0/2304474024 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.855+0000 7f921e9e7700 1 -- 172.21.15.72:0/2304474024 >> v2:172.21.15.72:3300/0 conn(0x7f9218131810 msgr2=0x7f9218131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.855+0000 7f921e9e7700 1 --2- 172.21.15.72:0/2304474024 >> v2:172.21.15.72:3300/0 conn(0x7f9218131810 0x7f9218131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.855+0000 7f921e9e7700 1 -- 172.21.15.72:0/2304474024 >> v1:172.21.15.72:6789/0 conn(0x7f9218099a40 legacy=0x7f9218099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.855+0000 7f921e9e7700 1 -- 172.21.15.72:0/2304474024 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92180721a0 con 0x7f921809a580 2023-10-03T10:15:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.855+0000 7f921e1e6700 1 --2- 172.21.15.72:0/2304474024 >> v2:172.21.15.72:3300/0 conn(0x7f9218131810 0x7f9218131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:10.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.855+0000 7f921e9e7700 1 --2- 172.21.15.72:0/2304474024 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f921809a580 0x7f9218139660 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9210009d90 tx=0x7f921000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b366318127212e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.856+0000 7f921d1e4700 1 -- 172.21.15.72:0/2304474024 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921000e070 con 0x7f921809a580 2023-10-03T10:15:10.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.856+0000 7f921d1e4700 1 -- 172.21.15.72:0/2304474024 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921000bb20 con 0x7f921809a580 2023-10-03T10:15:10.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.856+0000 7f921d1e4700 1 -- 172.21.15.72:0/2304474024 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210012430 con 0x7f921809a580 2023-10-03T10:15:10.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.856+0000 7f922044a700 1 -- 172.21.15.72:0/2304474024 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f921809a580 msgr2=0x7f9218139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.856+0000 7f922044a700 1 --2- 172.21.15.72:0/2304474024 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f921809a580 0x7f9218139660 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9210009d90 tx=0x7f921000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:10.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.856+0000 7f922044a700 1 -- 172.21.15.72:0/2304474024 shutdown_connections 2023-10-03T10:15:10.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.856+0000 7f922044a700 1 --2- 172.21.15.72:0/2304474024 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f921809a580 0x7f9218139660 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.856+0000 7f922044a700 1 --2- 172.21.15.72:0/2304474024 >> v2:172.21.15.72:3300/0 conn(0x7f9218131810 0x7f9218131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.856+0000 7f922044a700 1 -- 172.21.15.72:0/2304474024 >> 172.21.15.72:0/2304474024 conn(0x7f92180a2aa0 msgr2=0x7f92180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.856+0000 7f922044a700 1 -- 172.21.15.72:0/2304474024 shutdown_connections 2023-10-03T10:15:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.856+0000 7f922044a700 1 -- 172.21.15.72:0/2304474024 wait complete. 2023-10-03T10:15:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.857+0000 7f922044a700 1 Processor -- start 2023-10-03T10:15:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.857+0000 7f922044a700 1 -- start start 2023-10-03T10:15:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f922044a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9218099a40 0x7f92181197c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f922044a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f921809a580 0x7f9218119d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f922044a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9218131810 0x7f921811a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f922044a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921811d0a0 con 0x7f921809a580 2023-10-03T10:15:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f922044a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921812cbb0 con 0x7f9218131810 2023-10-03T10:15:10.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f922044a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f921811c620 con 0x7f9218099a40 2023-10-03T10:15:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f921e1e6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9218099a40 0x7f92181197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f921e1e6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9218099a40 0x7f92181197c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59810/0 (socket says 172.21.15.72:59810) 2023-10-03T10:15:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f921d9e5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f921809a580 0x7f9218119d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f921e1e6700 1 -- 172.21.15.72:0/272542684 learned_addr learned my addr 172.21.15.72:0/272542684 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f921e9e7700 1 --2- 172.21.15.72:0/272542684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9218131810 0x7f921811a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f921e1e6700 1 -- 172.21.15.72:0/272542684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9218131810 msgr2=0x7f921811a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f921e1e6700 1 --2- 172.21.15.72:0/272542684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9218131810 0x7f921811a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f921e1e6700 1 -- 172.21.15.72:0/272542684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f921809a580 msgr2=0x7f9218119d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f921e1e6700 1 --2- 172.21.15.72:0/272542684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f921809a580 0x7f9218119d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f921e1e6700 1 -- 172.21.15.72:0/272542684 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92080094a0 con 0x7f9218099a40 2023-10-03T10:15:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f921d9e5700 1 --2- 172.21.15.72:0/272542684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f921809a580 0x7f9218119d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:10.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f921e1e6700 1 --2- 172.21.15.72:0/272542684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9218099a40 0x7f92181197c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f920800ec10 tx=0x7f920800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:10.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f920effd700 1 -- 172.21.15.72:0/272542684 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920800c850 con 0x7f9218099a40 2023-10-03T10:15:10.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f920effd700 1 -- 172.21.15.72:0/272542684 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920800c9b0 con 0x7f9218099a40 2023-10-03T10:15:10.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f922044a700 1 -- 172.21.15.72:0/272542684 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9210009a70 con 0x7f9218099a40 2023-10-03T10:15:10.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f920effd700 1 -- 172.21.15.72:0/272542684 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920800cd20 con 0x7f9218099a40 2023-10-03T10:15:10.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.858+0000 7f922044a700 1 -- 172.21.15.72:0/272542684 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921811cac0 con 0x7f9218099a40 2023-10-03T10:15:10.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.859+0000 7f920effd700 1 -- 172.21.15.72:0/272542684 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9208013470 con 0x7f9218099a40 2023-10-03T10:15:10.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.859+0000 7f920effd700 1 -- 172.21.15.72:0/272542684 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f920803fb30 con 0x7f9218099a40 2023-10-03T10:15:10.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.859+0000 7f922044a700 1 -- 172.21.15.72:0/272542684 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9218074ea0 con 0x7f9218099a40 2023-10-03T10:15:10.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:10.864+0000 7f920effd700 1 -- 172.21.15.72:0/272542684 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9208021080 con 0x7f9218099a40 2023-10-03T10:15:10.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:10.977 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:11.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.054+0000 7f922044a700 1 -- 172.21.15.72:0/272542684 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f921811cca0 con 0x7f9218099a40 2023-10-03T10:15:11.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.055+0000 7f920effd700 1 -- 172.21.15.72:0/272542684 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9208013720 con 0x7f9218099a40 2023-10-03T10:15:11.055 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:11.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.058+0000 7f922044a700 1 -- 172.21.15.72:0/272542684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9218099a40 msgr2=0x7f92181197c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.058+0000 7f922044a700 1 --2- 172.21.15.72:0/272542684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9218099a40 0x7f92181197c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f920800ec10 tx=0x7f920800ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:11.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.058+0000 7f922044a700 1 -- 172.21.15.72:0/272542684 shutdown_connections 2023-10-03T10:15:11.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.058+0000 7f922044a700 1 --2- 172.21.15.72:0/272542684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9218131810 0x7f921811a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.058+0000 7f922044a700 1 --2- 172.21.15.72:0/272542684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9218099a40 0x7f92181197c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.058+0000 7f922044a700 1 --2- 172.21.15.72:0/272542684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f921809a580 0x7f9218119d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.058+0000 7f922044a700 1 -- 172.21.15.72:0/272542684 >> 172.21.15.72:0/272542684 conn(0x7f92180a2aa0 msgr2=0x7f921812e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.058+0000 7f922044a700 1 -- 172.21.15.72:0/272542684 shutdown_connections 2023-10-03T10:15:11.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.058+0000 7f922044a700 1 -- 172.21.15.72:0/272542684 wait complete. 2023-10-03T10:15:11.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.066+0000 7fe7dd87a700 1 Processor -- start 2023-10-03T10:15:11.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.066+0000 7fe7dd87a700 1 -- start start 2023-10-03T10:15:11.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7dd87a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d81338a0 0x7fe7d8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7dd87a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7d809de50 0x7fe7d809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7dd87a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7d809e760 0x7fe7d813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7dd87a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d806fef0 con 0x7fe7d809e760 2023-10-03T10:15:11.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7dd87a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d806ef30 con 0x7fe7d81338a0 2023-10-03T10:15:11.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7dd87a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d81334b0 con 0x7fe7d809de50 2023-10-03T10:15:11.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7d67fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7d809de50 0x7fe7d809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7d6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d81338a0 0x7fe7d8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7d77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7d809e760 0x7fe7d813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7d67fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7d809de50 0x7fe7d809e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59814/0 (socket says 172.21.15.72:59814) 2023-10-03T10:15:11.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7d6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d81338a0 0x7fe7d8133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44212/0 (socket says 172.21.15.72:44212) 2023-10-03T10:15:11.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7d67fc700 1 -- 172.21.15.72:0/3002795440 learned_addr learned my addr 172.21.15.72:0/3002795440 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:11.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7d77fe700 1 --2- 172.21.15.72:0/3002795440 >> v2:172.21.15.72:3300/0 conn(0x7fe7d809e760 0x7fe7d813a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54988/0 (socket says 172.21.15.72:54988) 2023-10-03T10:15:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7d77fe700 1 -- 172.21.15.72:0/3002795440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7d809de50 msgr2=0x7fe7d809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7d77fe700 1 --2- 172.21.15.72:0/3002795440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7d809de50 0x7fe7d809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7d77fe700 1 -- 172.21.15.72:0/3002795440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d81338a0 msgr2=0x7fe7d8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7d77fe700 1 --2- 172.21.15.72:0/3002795440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d81338a0 0x7fe7d8133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7d77fe700 1 -- 172.21.15.72:0/3002795440 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d806fc30 con 0x7fe7d809e760 2023-10-03T10:15:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7d67fc700 1 --2- 172.21.15.72:0/3002795440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7d809de50 0x7fe7d809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7d6ffd700 1 --2- 172.21.15.72:0/3002795440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d81338a0 0x7fe7d8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.067+0000 7fe7d77fe700 1 --2- 172.21.15.72:0/3002795440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d809e760 0x7fe7d813a730 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009d90 tx=0x7fe7d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1832e374091a7601 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.068+0000 7fe7d5ffb700 1 -- 172.21.15.72:0/3002795440 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d000e070 con 0x7fe7d809e760 2023-10-03T10:15:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.068+0000 7fe7d5ffb700 1 -- 172.21.15.72:0/3002795440 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d000bb20 con 0x7fe7d809e760 2023-10-03T10:15:11.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.068+0000 7fe7d5ffb700 1 -- 172.21.15.72:0/3002795440 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0012430 con 0x7fe7d809e760 2023-10-03T10:15:11.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.068+0000 7fe7dd87a700 1 -- 172.21.15.72:0/3002795440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d809e760 msgr2=0x7fe7d813a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.068+0000 7fe7dd87a700 1 --2- 172.21.15.72:0/3002795440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d809e760 0x7fe7d813a730 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009d90 tx=0x7fe7d000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:11.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.068+0000 7fe7dd87a700 1 -- 172.21.15.72:0/3002795440 shutdown_connections 2023-10-03T10:15:11.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.068+0000 7fe7dd87a700 1 --2- 172.21.15.72:0/3002795440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d809e760 0x7fe7d813a730 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.068+0000 7fe7dd87a700 1 --2- 172.21.15.72:0/3002795440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d81338a0 0x7fe7d8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.068+0000 7fe7dd87a700 1 --2- 172.21.15.72:0/3002795440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7d809de50 0x7fe7d809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.068+0000 7fe7dd87a700 1 -- 172.21.15.72:0/3002795440 >> 172.21.15.72:0/3002795440 conn(0x7fe7d80a2aa0 msgr2=0x7fe7d80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.068+0000 7fe7dd87a700 1 -- 172.21.15.72:0/3002795440 shutdown_connections 2023-10-03T10:15:11.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.069+0000 7fe7dd87a700 1 -- 172.21.15.72:0/3002795440 wait complete. 2023-10-03T10:15:11.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.070+0000 7fe7dd87a700 1 Processor -- start 2023-10-03T10:15:11.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.070+0000 7fe7dd87a700 1 -- start start 2023-10-03T10:15:11.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7dd87a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7d809de50 0x7fe7d811ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7dd87a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d809e760 0x7fe7d811f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7dd87a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d81338a0 0x7fe7d811f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7dd87a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d81210e0 con 0x7fe7d81338a0 2023-10-03T10:15:11.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7dd87a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d81200b0 con 0x7fe7d809e760 2023-10-03T10:15:11.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7dd87a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d8120920 con 0x7fe7d809de50 2023-10-03T10:15:11.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7d67fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d809e760 0x7fe7d811f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7d6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7d809de50 0x7fe7d811ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7d67fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d809e760 0x7fe7d811f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44214/0 (socket says 172.21.15.72:44214) 2023-10-03T10:15:11.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7d6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7d809de50 0x7fe7d811ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59826/0 (socket says 172.21.15.72:59826) 2023-10-03T10:15:11.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7d67fc700 1 -- 172.21.15.72:0/3468869050 learned_addr learned my addr 172.21.15.72:0/3468869050 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:11.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7d77fe700 1 --2- 172.21.15.72:0/3468869050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d81338a0 0x7fe7d811f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7d77fe700 1 -- 172.21.15.72:0/3468869050 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7d809de50 msgr2=0x7fe7d811ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7d77fe700 1 --2- 172.21.15.72:0/3468869050 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7d809de50 0x7fe7d811ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7d77fe700 1 -- 172.21.15.72:0/3468869050 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d809e760 msgr2=0x7fe7d811f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7d77fe700 1 --2- 172.21.15.72:0/3468869050 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d809e760 0x7fe7d811f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7d77fe700 1 -- 172.21.15.72:0/3468869050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc009550 con 0x7fe7d81338a0 2023-10-03T10:15:11.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7d6ffd700 1 --2- 172.21.15.72:0/3468869050 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7d809de50 0x7fe7d811ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7d67fc700 1 --2- 172.21.15.72:0/3468869050 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d809e760 0x7fe7d811f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.071+0000 7fe7d77fe700 1 --2- 172.21.15.72:0/3468869050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d81338a0 0x7fe7d811f6d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009d90 tx=0x7fe7d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.072+0000 7fe7bffff700 1 -- 172.21.15.72:0/3468869050 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0004880 con 0x7fe7d81338a0 2023-10-03T10:15:11.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.072+0000 7fe7bffff700 1 -- 172.21.15.72:0/3468869050 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d0020070 con 0x7fe7d81338a0 2023-10-03T10:15:11.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.072+0000 7fe7dd87a700 1 -- 172.21.15.72:0/3468869050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c80094a0 con 0x7fe7d81338a0 2023-10-03T10:15:11.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.072+0000 7fe7bffff700 1 -- 172.21.15.72:0/3468869050 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00276c0 con 0x7fe7d81338a0 2023-10-03T10:15:11.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.072+0000 7fe7dd87a700 1 -- 172.21.15.72:0/3468869050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d0009a70 con 0x7fe7d81338a0 2023-10-03T10:15:11.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:11.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.072+0000 7fe7bffff700 1 -- 172.21.15.72:0/3468869050 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe7d0012430 con 0x7fe7d81338a0 2023-10-03T10:15:11.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.073+0000 7fe7bffff700 1 -- 172.21.15.72:0/3468869050 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe7d0022070 con 0x7fe7d81338a0 2023-10-03T10:15:11.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.073+0000 7fe7dd87a700 1 -- 172.21.15.72:0/3468869050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d812f780 con 0x7fe7d81338a0 2023-10-03T10:15:11.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.077+0000 7fe7bffff700 1 -- 172.21.15.72:0/3468869050 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7d0025790 con 0x7fe7d81338a0 2023-10-03T10:15:11.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.106+0000 7f2928daa700 1 Processor -- start 2023-10-03T10:15:11.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.106+0000 7f2928daa700 1 -- start start 2023-10-03T10:15:11.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f2928daa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240a0a30 0x7f29240a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f2928daa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2924138d80 0x7f292413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f2928daa700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29240a2a70 con 0x7f292409d630 2023-10-03T10:15:11.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f2928daa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29240a01d0 con 0x7f29240a0a30 2023-10-03T10:15:11.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f2928daa700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f292409e2b0 con 0x7f2924138d80 2023-10-03T10:15:11.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f2921d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f292409d630 0x7f29240a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59656/0 (socket says 172.21.15.72:59656) 2023-10-03T10:15:11.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f2921d9b700 1 -- 172.21.15.72:0/4259705515 learned_addr learned my addr 172.21.15.72:0/4259705515 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:11.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f2922d9d700 1 --2- 172.21.15.72:0/4259705515 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2924138d80 0x7f292413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f292259c700 1 --2- 172.21.15.72:0/4259705515 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240a0a30 0x7f29240a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f292159a700 1 -- 172.21.15.72:0/4259705515 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370335082 0 0) 0x7f29240a2a70 con 0x7f292409d630 2023-10-03T10:15:11.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f292259c700 1 -- 172.21.15.72:0/4259705515 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2924138d80 msgr2=0x7f292413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f292259c700 1 --2- 172.21.15.72:0/4259705515 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2924138d80 0x7f292413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f292259c700 1 -- 172.21.15.72:0/4259705515 >> v1:172.21.15.72:6789/0 conn(0x7f292409d630 legacy=0x7f29240a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f292259c700 1 -- 172.21.15.72:0/4259705515 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292409dc50 con 0x7f29240a0a30 2023-10-03T10:15:11.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f2922d9d700 1 --2- 172.21.15.72:0/4259705515 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2924138d80 0x7f292413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f292259c700 1 --2- 172.21.15.72:0/4259705515 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240a0a30 0x7f29240a0e00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2914009870 tx=0x7f2914009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45ea5f40247e96d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f292159a700 1 -- 172.21.15.72:0/4259705515 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914011830 con 0x7f29240a0a30 2023-10-03T10:15:11.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f292159a700 1 -- 172.21.15.72:0/4259705515 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2914011990 con 0x7f29240a0a30 2023-10-03T10:15:11.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.107+0000 7f292159a700 1 -- 172.21.15.72:0/4259705515 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914011d20 con 0x7f29240a0a30 2023-10-03T10:15:11.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.108+0000 7f2928daa700 1 -- 172.21.15.72:0/4259705515 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240a0a30 msgr2=0x7f29240a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.108+0000 7f2928daa700 1 --2- 172.21.15.72:0/4259705515 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240a0a30 0x7f29240a0e00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2914009870 tx=0x7f2914009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:11.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.108+0000 7f2928daa700 1 -- 172.21.15.72:0/4259705515 shutdown_connections 2023-10-03T10:15:11.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.108+0000 7f2928daa700 1 --2- 172.21.15.72:0/4259705515 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2924138d80 0x7f292413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.108+0000 7f2928daa700 1 --2- 172.21.15.72:0/4259705515 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240a0a30 0x7f29240a0e00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.108+0000 7f2928daa700 1 -- 172.21.15.72:0/4259705515 >> 172.21.15.72:0/4259705515 conn(0x7f29240a3050 msgr2=0x7f29240a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.108+0000 7f2928daa700 1 -- 172.21.15.72:0/4259705515 shutdown_connections 2023-10-03T10:15:11.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.108+0000 7f2928daa700 1 -- 172.21.15.72:0/4259705515 wait complete. 2023-10-03T10:15:11.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.110+0000 7f2928daa700 1 Processor -- start 2023-10-03T10:15:11.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.110+0000 7f2928daa700 1 -- start start 2023-10-03T10:15:11.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.110+0000 7f2928daa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f292409d630 0x7f2924133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.110+0000 7f2928daa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240a0a30 0x7f2924133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.110+0000 7f2928daa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2924138d80 0x7f2924134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.110+0000 7f2928daa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2924137d30 con 0x7f292409d630 2023-10-03T10:15:11.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.110+0000 7f2928daa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29240a4bf0 con 0x7f29240a0a30 2023-10-03T10:15:11.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.110+0000 7f2928daa700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29240a0410 con 0x7f2924138d80 2023-10-03T10:15:11.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.110+0000 7f2921d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240a0a30 0x7f2924133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.110+0000 7f2922d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2924138d80 0x7f2924134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.110+0000 7f2922d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2924138d80 0x7f2924134180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59844/0 (socket says 172.21.15.72:59844) 2023-10-03T10:15:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.110+0000 7f2922d9d700 1 -- 172.21.15.72:0/2477753023 learned_addr learned my addr 172.21.15.72:0/2477753023 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.110+0000 7f2921d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240a0a30 0x7f2924133c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44228/0 (socket says 172.21.15.72:44228) 2023-10-03T10:15:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.110+0000 7f292259c700 1 --2- 172.21.15.72:0/2477753023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f292409d630 0x7f2924133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.111+0000 7f2922d9d700 1 -- 172.21.15.72:0/2477753023 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240a0a30 msgr2=0x7f2924133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.111+0000 7f2922d9d700 1 --2- 172.21.15.72:0/2477753023 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240a0a30 0x7f2924133c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.111+0000 7f2922d9d700 1 -- 172.21.15.72:0/2477753023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f292409d630 msgr2=0x7f2924133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.111+0000 7f2922d9d700 1 --2- 172.21.15.72:0/2477753023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f292409d630 0x7f2924133700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.111+0000 7f2922d9d700 1 -- 172.21.15.72:0/2477753023 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c009a70 con 0x7f2924138d80 2023-10-03T10:15:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.111+0000 7f2922d9d700 1 --2- 172.21.15.72:0/2477753023 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2924138d80 0x7f2924134180 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f291c00efc0 tx=0x7f291c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.111+0000 7f2912ffd700 1 -- 172.21.15.72:0/2477753023 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c00cc90 con 0x7f2924138d80 2023-10-03T10:15:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.111+0000 7f2912ffd700 1 -- 172.21.15.72:0/2477753023 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c00f040 con 0x7f2924138d80 2023-10-03T10:15:11.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.111+0000 7f2928daa700 1 -- 172.21.15.72:0/2477753023 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29140094a0 con 0x7f2924138d80 2023-10-03T10:15:11.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.111+0000 7f2912ffd700 1 -- 172.21.15.72:0/2477753023 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c014480 con 0x7f2924138d80 2023-10-03T10:15:11.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.111+0000 7f2928daa700 1 -- 172.21.15.72:0/2477753023 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2924136500 con 0x7f2924138d80 2023-10-03T10:15:11.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.112+0000 7f2912ffd700 1 -- 172.21.15.72:0/2477753023 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f291c0145e0 con 0x7f2924138d80 2023-10-03T10:15:11.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.112+0000 7f2912ffd700 1 -- 172.21.15.72:0/2477753023 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f291c03ff70 con 0x7f2924138d80 2023-10-03T10:15:11.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.112+0000 7f2928daa700 1 -- 172.21.15.72:0/2477753023 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29240747f0 con 0x7f2924138d80 2023-10-03T10:15:11.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.117+0000 7f2912ffd700 1 -- 172.21.15.72:0/2477753023 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f291c018020 con 0x7f2924138d80 2023-10-03T10:15:11.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.270+0000 7fe7dd87a700 1 -- 172.21.15.72:0/3468869050 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe7d81344f0 con 0x7fe7d81338a0 2023-10-03T10:15:11.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.271+0000 7fe7bffff700 1 -- 172.21.15.72:0/3468869050 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe7d0035090 con 0x7fe7d81338a0 2023-10-03T10:15:11.272 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:11.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.273+0000 7fe7dd87a700 1 -- 172.21.15.72:0/3468869050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d81338a0 msgr2=0x7fe7d811f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.273+0000 7fe7dd87a700 1 --2- 172.21.15.72:0/3468869050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d81338a0 0x7fe7d811f6d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009d90 tx=0x7fe7d0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.273+0000 7fe7dd87a700 1 -- 172.21.15.72:0/3468869050 shutdown_connections 2023-10-03T10:15:11.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.273+0000 7fe7dd87a700 1 --2- 172.21.15.72:0/3468869050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d81338a0 0x7fe7d811f6d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.273+0000 7fe7dd87a700 1 --2- 172.21.15.72:0/3468869050 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7d809de50 0x7fe7d811ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.273+0000 7fe7dd87a700 1 --2- 172.21.15.72:0/3468869050 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d809e760 0x7fe7d811f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.273+0000 7fe7dd87a700 1 -- 172.21.15.72:0/3468869050 >> 172.21.15.72:0/3468869050 conn(0x7fe7d80a2aa0 msgr2=0x7fe7d809ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.273+0000 7fe7dd87a700 1 -- 172.21.15.72:0/3468869050 shutdown_connections 2023-10-03T10:15:11.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.273+0000 7fe7dd87a700 1 -- 172.21.15.72:0/3468869050 wait complete. 2023-10-03T10:15:11.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:11.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.309+0000 7f2928daa700 1 -- 172.21.15.72:0/2477753023 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2924072980 con 0x7f2924138d80 2023-10-03T10:15:11.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.309+0000 7f2912ffd700 1 -- 172.21.15.72:0/2477753023 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f291c011680 con 0x7f2924138d80 2023-10-03T10:15:11.310 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:11.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.311+0000 7f2928daa700 1 -- 172.21.15.72:0/2477753023 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2924138d80 msgr2=0x7f2924134180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.311+0000 7f2928daa700 1 --2- 172.21.15.72:0/2477753023 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2924138d80 0x7f2924134180 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f291c00efc0 tx=0x7f291c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.311+0000 7f2928daa700 1 -- 172.21.15.72:0/2477753023 shutdown_connections 2023-10-03T10:15:11.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.311+0000 7f2928daa700 1 --2- 172.21.15.72:0/2477753023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f292409d630 0x7f2924133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.311+0000 7f2928daa700 1 --2- 172.21.15.72:0/2477753023 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2924138d80 0x7f2924134180 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.311+0000 7f2928daa700 1 --2- 172.21.15.72:0/2477753023 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240a0a30 0x7f2924133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.311+0000 7f2928daa700 1 -- 172.21.15.72:0/2477753023 >> 172.21.15.72:0/2477753023 conn(0x7f29240a3050 msgr2=0x7f292413add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.311+0000 7f2928daa700 1 -- 172.21.15.72:0/2477753023 shutdown_connections 2023-10-03T10:15:11.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.311+0000 7f2928daa700 1 -- 172.21.15.72:0/2477753023 wait complete. 2023-10-03T10:15:11.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:11.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:11.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.485+0000 7fcbab868700 1 Processor -- start 2023-10-03T10:15:11.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.485+0000 7fcbab868700 1 -- start start 2023-10-03T10:15:11.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.485+0000 7fcbab868700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcba409d6f0 0x7fcba409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.485+0000 7fcbab868700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcba409e000 0x7fcba41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.485+0000 7fcbab868700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba409b120 con 0x7fcba409e410 2023-10-03T10:15:11.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.485+0000 7fcbab868700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba406b460 con 0x7fcba409e000 2023-10-03T10:15:11.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.485+0000 7fcbab868700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba409a7e0 con 0x7fcba409d6f0 2023-10-03T10:15:11.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.486+0000 7fcba9e05700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcba409e410 0x7fcba4133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59660/0 (socket says 172.21.15.72:59660) 2023-10-03T10:15:11.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.486+0000 7fcba9e05700 1 -- 172.21.15.72:0/3583601845 learned_addr learned my addr 172.21.15.72:0/3583601845 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:11.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.486+0000 7fcba8e03700 1 --2- 172.21.15.72:0/3583601845 >> v2:172.21.15.72:3300/0 conn(0x7fcba409e000 0x7fcba41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.486+0000 7fcba9604700 1 --2- 172.21.15.72:0/3583601845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcba409d6f0 0x7fcba409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.486+0000 7fcb9bfff700 1 -- 172.21.15.72:0/3583601845 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611253111 0 0) 0x7fcba409b120 con 0x7fcba409e410 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.486+0000 7fcb9bfff700 1 -- 172.21.15.72:0/3583601845 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb900035b0 con 0x7fcba409e410 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.486+0000 7fcba8e03700 1 -- 172.21.15.72:0/3583601845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcba409d6f0 msgr2=0x7fcba409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.486+0000 7fcba8e03700 1 --2- 172.21.15.72:0/3583601845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcba409d6f0 0x7fcba409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.486+0000 7fcba8e03700 1 -- 172.21.15.72:0/3583601845 >> v1:172.21.15.72:6789/0 conn(0x7fcba409e410 legacy=0x7fcba4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.486+0000 7fcba8e03700 1 -- 172.21.15.72:0/3583601845 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba409a500 con 0x7fcba409e000 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.486+0000 7fcba9604700 1 --2- 172.21.15.72:0/3583601845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcba409d6f0 0x7fcba409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.486+0000 7fcba8e03700 1 --2- 172.21.15.72:0/3583601845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcba409e000 0x7fcba41339f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009840 tx=0x7fcb94009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341b010fe15a375f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.486+0000 7fcb9bfff700 1 -- 172.21.15.72:0/3583601845 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94011830 con 0x7fcba409e000 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.486+0000 7fcb9bfff700 1 -- 172.21.15.72:0/3583601845 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb94011990 con 0x7fcba409e000 2023-10-03T10:15:11.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.486+0000 7fcb9bfff700 1 -- 172.21.15.72:0/3583601845 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94011d00 con 0x7fcba409e000 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.487+0000 7fcbab868700 1 -- 172.21.15.72:0/3583601845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcba409e000 msgr2=0x7fcba41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.487+0000 7fcbab868700 1 --2- 172.21.15.72:0/3583601845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcba409e000 0x7fcba41339f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009840 tx=0x7fcb94009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.487+0000 7fcbab868700 1 -- 172.21.15.72:0/3583601845 shutdown_connections 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.487+0000 7fcbab868700 1 --2- 172.21.15.72:0/3583601845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcba409d6f0 0x7fcba409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.487+0000 7fcbab868700 1 --2- 172.21.15.72:0/3583601845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcba409e000 0x7fcba41339f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.487+0000 7fcbab868700 1 -- 172.21.15.72:0/3583601845 >> 172.21.15.72:0/3583601845 conn(0x7fcba4066f50 msgr2=0x7fcba409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.487+0000 7fcbab868700 1 -- 172.21.15.72:0/3583601845 shutdown_connections 2023-10-03T10:15:11.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.487+0000 7fcbab868700 1 -- 172.21.15.72:0/3583601845 wait complete. 2023-10-03T10:15:11.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.488+0000 7fcbab868700 1 Processor -- start 2023-10-03T10:15:11.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.488+0000 7fcbab868700 1 -- start start 2023-10-03T10:15:11.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.488+0000 7fcbab868700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcba409d6f0 0x7fcba41c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.488+0000 7fcbab868700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcba409e000 0x7fcba41c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.488+0000 7fcbab868700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcba409e410 0x7fcba41c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.488+0000 7fcbab868700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba41a4c80 con 0x7fcba409e000 2023-10-03T10:15:11.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.488+0000 7fcbab868700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba41a65d0 con 0x7fcba409d6f0 2023-10-03T10:15:11.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.488+0000 7fcbab868700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcba41a63e0 con 0x7fcba409e410 2023-10-03T10:15:11.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcba9604700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcba409d6f0 0x7fcba41c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcba9604700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcba409d6f0 0x7fcba41c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44240/0 (socket says 172.21.15.72:44240) 2023-10-03T10:15:11.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcba9604700 1 -- 172.21.15.72:0/3623919970 learned_addr learned my addr 172.21.15.72:0/3623919970 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:11.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcba8e03700 1 --2- 172.21.15.72:0/3623919970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcba409e000 0x7fcba41c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcba9e05700 1 --2- 172.21.15.72:0/3623919970 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcba409e410 0x7fcba41c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcba9604700 1 -- 172.21.15.72:0/3623919970 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcba409e410 msgr2=0x7fcba41c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcba9604700 1 --2- 172.21.15.72:0/3623919970 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcba409e410 0x7fcba41c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcba9604700 1 -- 172.21.15.72:0/3623919970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcba409e000 msgr2=0x7fcba41c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcba9604700 1 --2- 172.21.15.72:0/3623919970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcba409e000 0x7fcba41c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcba9604700 1 -- 172.21.15.72:0/3623919970 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba00094a0 con 0x7fcba409d6f0 2023-10-03T10:15:11.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcba8e03700 1 --2- 172.21.15.72:0/3623919970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcba409e000 0x7fcba41c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcba9604700 1 --2- 172.21.15.72:0/3623919970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcba409d6f0 0x7fcba41c8040 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcba000ebe0 tx=0x7fcba000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcb99ffb700 1 -- 172.21.15.72:0/3623919970 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba000c850 con 0x7fcba409d6f0 2023-10-03T10:15:11.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcb99ffb700 1 -- 172.21.15.72:0/3623919970 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba000c9b0 con 0x7fcba409d6f0 2023-10-03T10:15:11.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcbab868700 1 -- 172.21.15.72:0/3623919970 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb940094a0 con 0x7fcba409d6f0 2023-10-03T10:15:11.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcb99ffb700 1 -- 172.21.15.72:0/3623919970 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba000cd40 con 0x7fcba409d6f0 2023-10-03T10:15:11.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.489+0000 7fcbab868700 1 -- 172.21.15.72:0/3623919970 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba41a8010 con 0x7fcba409d6f0 2023-10-03T10:15:11.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.490+0000 7fcbab868700 1 -- 172.21.15.72:0/3623919970 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba41a8200 con 0x7fcba409d6f0 2023-10-03T10:15:11.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.491+0000 7fcb99ffb700 1 -- 172.21.15.72:0/3623919970 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcba0013470 con 0x7fcba409d6f0 2023-10-03T10:15:11.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.491+0000 7fcb99ffb700 1 -- 172.21.15.72:0/3623919970 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcba003ff90 con 0x7fcba409d6f0 2023-10-03T10:15:11.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.495+0000 7fcb99ffb700 1 -- 172.21.15.72:0/3623919970 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcba0013720 con 0x7fcba409d6f0 2023-10-03T10:15:11.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.681+0000 7fcbab868700 1 -- 172.21.15.72:0/3623919970 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcba4074ea0 con 0x7fcba409d6f0 2023-10-03T10:15:11.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.681+0000 7fcb99ffb700 1 -- 172.21.15.72:0/3623919970 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcba0021070 con 0x7fcba409d6f0 2023-10-03T10:15:11.682 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:11.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.683+0000 7fcbab868700 1 -- 172.21.15.72:0/3623919970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcba409d6f0 msgr2=0x7fcba41c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.683+0000 7fcbab868700 1 --2- 172.21.15.72:0/3623919970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcba409d6f0 0x7fcba41c8040 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcba000ebe0 tx=0x7fcba000eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.683+0000 7fcbab868700 1 -- 172.21.15.72:0/3623919970 shutdown_connections 2023-10-03T10:15:11.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.683+0000 7fcbab868700 1 --2- 172.21.15.72:0/3623919970 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcba409e410 0x7fcba41c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.683+0000 7fcbab868700 1 --2- 172.21.15.72:0/3623919970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcba409d6f0 0x7fcba41c8040 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.683+0000 7fcbab868700 1 --2- 172.21.15.72:0/3623919970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcba409e000 0x7fcba41c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.683+0000 7fcbab868700 1 -- 172.21.15.72:0/3623919970 >> 172.21.15.72:0/3623919970 conn(0x7fcba4066f50 msgr2=0x7fcba40a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.683+0000 7fcbab868700 1 -- 172.21.15.72:0/3623919970 shutdown_connections 2023-10-03T10:15:11.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:11.683+0000 7fcbab868700 1 -- 172.21.15.72:0/3623919970 wait complete. 2023-10-03T10:15:11.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:12.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:12.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.199+0000 7f9a777b6700 1 Processor -- start 2023-10-03T10:15:12.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.199+0000 7f9a777b6700 1 -- start start 2023-10-03T10:15:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a777b6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9a70131810 0x7f9a70131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a777b6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a70099a40 0x7f9a70099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a777b6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a7009a3b0 0x7f9a70138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a777b6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a701313c0 con 0x7f9a70131810 2023-10-03T10:15:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a777b6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7006e8c0 con 0x7f9a70099a40 2023-10-03T10:15:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a777b6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a70071d20 con 0x7f9a7009a3b0 2023-10-03T10:15:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a74d51700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a70099a40 0x7f9a70099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a75552700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9a70131810 0x7f9a70131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a75d53700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a7009a3b0 0x7f9a70138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a74d51700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a70099a40 0x7f9a70099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44254/0 (socket says 172.21.15.72:44254) 2023-10-03T10:15:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a75552700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9a70131810 0x7f9a70131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55044/0 (socket says 172.21.15.72:55044) 2023-10-03T10:15:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a74d51700 1 -- 172.21.15.72:0/3906873173 learned_addr learned my addr 172.21.15.72:0/3906873173 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a74d51700 1 -- 172.21.15.72:0/3906873173 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a7009a3b0 msgr2=0x7f9a70138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a74d51700 1 --2- 172.21.15.72:0/3906873173 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a7009a3b0 0x7f9a70138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a74d51700 1 -- 172.21.15.72:0/3906873173 >> v2:172.21.15.72:3300/0 conn(0x7f9a70131810 msgr2=0x7f9a70131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a74d51700 1 --2- 172.21.15.72:0/3906873173 >> v2:172.21.15.72:3300/0 conn(0x7f9a70131810 0x7f9a70131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a74d51700 1 -- 172.21.15.72:0/3906873173 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a700721a0 con 0x7f9a70099a40 2023-10-03T10:15:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a75d53700 1 --2- 172.21.15.72:0/3906873173 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a7009a3b0 0x7f9a70138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a75552700 1 --2- 172.21.15.72:0/3906873173 >> v2:172.21.15.72:3300/0 conn(0x7f9a70131810 0x7f9a70131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a74d51700 1 --2- 172.21.15.72:0/3906873173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a70099a40 0x7f9a70099e70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0098f0 tx=0x7f9a6c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e30ca5931a65d086 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a67fff700 1 -- 172.21.15.72:0/3906873173 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c011830 con 0x7f9a70099a40 2023-10-03T10:15:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a67fff700 1 -- 172.21.15.72:0/3906873173 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c011990 con 0x7f9a70099a40 2023-10-03T10:15:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.200+0000 7f9a67fff700 1 -- 172.21.15.72:0/3906873173 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c011d20 con 0x7f9a70099a40 2023-10-03T10:15:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.201+0000 7f9a777b6700 1 -- 172.21.15.72:0/3906873173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a70099a40 msgr2=0x7f9a70099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.201+0000 7f9a777b6700 1 --2- 172.21.15.72:0/3906873173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a70099a40 0x7f9a70099e70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0098f0 tx=0x7f9a6c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.201+0000 7f9a777b6700 1 -- 172.21.15.72:0/3906873173 shutdown_connections 2023-10-03T10:15:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.201+0000 7f9a777b6700 1 --2- 172.21.15.72:0/3906873173 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a7009a3b0 0x7f9a70138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.201+0000 7f9a777b6700 1 --2- 172.21.15.72:0/3906873173 >> v2:172.21.15.72:3300/0 conn(0x7f9a70131810 0x7f9a70131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.201+0000 7f9a777b6700 1 --2- 172.21.15.72:0/3906873173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a70099a40 0x7f9a70099e70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.201+0000 7f9a777b6700 1 -- 172.21.15.72:0/3906873173 >> 172.21.15.72:0/3906873173 conn(0x7f9a700a2aa0 msgr2=0x7f9a700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.201+0000 7f9a777b6700 1 -- 172.21.15.72:0/3906873173 shutdown_connections 2023-10-03T10:15:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.201+0000 7f9a777b6700 1 -- 172.21.15.72:0/3906873173 wait complete. 2023-10-03T10:15:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.202+0000 7f9a777b6700 1 Processor -- start 2023-10-03T10:15:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.202+0000 7f9a777b6700 1 -- start start 2023-10-03T10:15:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a777b6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a70099a40 0x7f9a7011b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a777b6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a7009a3b0 0x7f9a7011bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a777b6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a70131810 0x7f9a7011c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a777b6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7011cbf0 con 0x7f9a70131810 2023-10-03T10:15:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a777b6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7011d2c0 con 0x7f9a7009a3b0 2023-10-03T10:15:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a777b6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7011e510 con 0x7f9a70099a40 2023-10-03T10:15:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a75552700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a70099a40 0x7f9a7011b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a75552700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a70099a40 0x7f9a7011b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59866/0 (socket says 172.21.15.72:59866) 2023-10-03T10:15:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a75552700 1 -- 172.21.15.72:0/1224305416 learned_addr learned my addr 172.21.15.72:0/1224305416 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a74d51700 1 --2- 172.21.15.72:0/1224305416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a7009a3b0 0x7f9a7011bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a75d53700 1 --2- 172.21.15.72:0/1224305416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a70131810 0x7f9a7011c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a74d51700 1 -- 172.21.15.72:0/1224305416 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a70099a40 msgr2=0x7f9a7011b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a74d51700 1 --2- 172.21.15.72:0/1224305416 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a70099a40 0x7f9a7011b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a74d51700 1 -- 172.21.15.72:0/1224305416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a70131810 msgr2=0x7f9a7011c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a74d51700 1 --2- 172.21.15.72:0/1224305416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a70131810 0x7f9a7011c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a74d51700 1 -- 172.21.15.72:0/1224305416 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a68009a70 con 0x7f9a7009a3b0 2023-10-03T10:15:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.203+0000 7f9a75d53700 1 --2- 172.21.15.72:0/1224305416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a70131810 0x7f9a7011c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.204+0000 7f9a74d51700 1 --2- 172.21.15.72:0/1224305416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a7009a3b0 0x7f9a7011bc80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c016000 tx=0x7f9a6c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.204+0000 7f9a65ffb700 1 -- 172.21.15.72:0/1224305416 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c004240 con 0x7f9a7009a3b0 2023-10-03T10:15:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.204+0000 7f9a65ffb700 1 -- 172.21.15.72:0/1224305416 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c01f070 con 0x7f9a7009a3b0 2023-10-03T10:15:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.204+0000 7f9a777b6700 1 -- 172.21.15.72:0/1224305416 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a600094a0 con 0x7f9a7009a3b0 2023-10-03T10:15:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.204+0000 7f9a65ffb700 1 -- 172.21.15.72:0/1224305416 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c0036a0 con 0x7f9a7009a3b0 2023-10-03T10:15:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.204+0000 7f9a777b6700 1 -- 172.21.15.72:0/1224305416 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6c009550 con 0x7f9a7009a3b0 2023-10-03T10:15:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.205+0000 7f9a65ffb700 1 -- 172.21.15.72:0/1224305416 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a6c021030 con 0x7f9a7009a3b0 2023-10-03T10:15:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.205+0000 7f9a65ffb700 1 -- 172.21.15.72:0/1224305416 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9a6c040730 con 0x7f9a7009a3b0 2023-10-03T10:15:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.205+0000 7f9a777b6700 1 -- 172.21.15.72:0/1224305416 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a70130960 con 0x7f9a7009a3b0 2023-10-03T10:15:12.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.209+0000 7f9a65ffb700 1 -- 172.21.15.72:0/1224305416 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a6c015020 con 0x7f9a7009a3b0 2023-10-03T10:15:12.286 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:12.325 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.399+0000 7f9a777b6700 1 -- 172.21.15.72:0/1224305416 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9a7006eb00 con 0x7f9a7009a3b0 2023-10-03T10:15:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.399+0000 7f9a65ffb700 1 -- 172.21.15.72:0/1224305416 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9a6c0199a0 con 0x7f9a7009a3b0 2023-10-03T10:15:12.400 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.401+0000 7f9a777b6700 1 -- 172.21.15.72:0/1224305416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a7009a3b0 msgr2=0x7f9a7011bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.401+0000 7f9a777b6700 1 --2- 172.21.15.72:0/1224305416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a7009a3b0 0x7f9a7011bc80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c016000 tx=0x7f9a6c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.401+0000 7f9a777b6700 1 -- 172.21.15.72:0/1224305416 shutdown_connections 2023-10-03T10:15:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.401+0000 7f9a777b6700 1 --2- 172.21.15.72:0/1224305416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a70131810 0x7f9a7011c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.401+0000 7f9a777b6700 1 --2- 172.21.15.72:0/1224305416 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a70099a40 0x7f9a7011b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.401+0000 7f9a777b6700 1 --2- 172.21.15.72:0/1224305416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a7009a3b0 0x7f9a7011bc80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.401+0000 7f9a777b6700 1 -- 172.21.15.72:0/1224305416 >> 172.21.15.72:0/1224305416 conn(0x7f9a700a2aa0 msgr2=0x7f9a701b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.402+0000 7f9a777b6700 1 -- 172.21.15.72:0/1224305416 shutdown_connections 2023-10-03T10:15:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.402+0000 7f9a777b6700 1 -- 172.21.15.72:0/1224305416 wait complete. 2023-10-03T10:15:12.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.410+0000 7faf06fdc700 1 Processor -- start 2023-10-03T10:15:12.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.411+0000 7faf06fdc700 1 -- start start 2023-10-03T10:15:12.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.411+0000 7faf06fdc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf001338a0 0x7faf00133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.411+0000 7faf06fdc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf0009de50 0x7faf0009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.411+0000 7faf06fdc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0006ef30 con 0x7faf0009e760 2023-10-03T10:15:12.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.411+0000 7faf06fdc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0006fef0 con 0x7faf0009de50 2023-10-03T10:15:12.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.411+0000 7faf06fdc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf001334b0 con 0x7faf001338a0 2023-10-03T10:15:12.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.411+0000 7faf04d78700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf001338a0 0x7faf00133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.411+0000 7faf04d78700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf001338a0 0x7faf00133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59874/0 (socket says 172.21.15.72:59874) 2023-10-03T10:15:12.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.411+0000 7faf04d78700 1 -- 172.21.15.72:0/3436713068 learned_addr learned my addr 172.21.15.72:0/3436713068 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:12.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.411+0000 7faefffff700 1 --2- 172.21.15.72:0/3436713068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf0009de50 0x7faf0009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.411+0000 7faeff7fe700 1 -- 172.21.15.72:0/3436713068 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2915101262 0 0) 0x7faf0006ef30 con 0x7faf0009e760 2023-10-03T10:15:12.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.412+0000 7faeff7fe700 1 -- 172.21.15.72:0/3436713068 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef00035b0 con 0x7faf0009e760 2023-10-03T10:15:12.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.412+0000 7faefffff700 1 -- 172.21.15.72:0/3436713068 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf001338a0 msgr2=0x7faf00133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.412+0000 7faefffff700 1 --2- 172.21.15.72:0/3436713068 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf001338a0 0x7faf00133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.412+0000 7faefffff700 1 -- 172.21.15.72:0/3436713068 >> v1:172.21.15.72:6789/0 conn(0x7faf0009e760 legacy=0x7faf0013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.412+0000 7faefffff700 1 -- 172.21.15.72:0/3436713068 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0006fc30 con 0x7faf0009de50 2023-10-03T10:15:12.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.412+0000 7faf04d78700 1 --2- 172.21.15.72:0/3436713068 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf001338a0 0x7faf00133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.412+0000 7faefffff700 1 --2- 172.21.15.72:0/3436713068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf0009de50 0x7faf0009e220 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7faeec009870 tx=0x7faeec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8a9f2c9385fc34c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.412+0000 7faeff7fe700 1 -- 172.21.15.72:0/3436713068 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec011830 con 0x7faf0009de50 2023-10-03T10:15:12.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.412+0000 7faeff7fe700 1 -- 172.21.15.72:0/3436713068 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec011990 con 0x7faf0009de50 2023-10-03T10:15:12.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.412+0000 7faeff7fe700 1 -- 172.21.15.72:0/3436713068 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec011d20 con 0x7faf0009de50 2023-10-03T10:15:12.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.413+0000 7faf06fdc700 1 -- 172.21.15.72:0/3436713068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf0009de50 msgr2=0x7faf0009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.413+0000 7faf06fdc700 1 --2- 172.21.15.72:0/3436713068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf0009de50 0x7faf0009e220 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7faeec009870 tx=0x7faeec009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:12.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.413+0000 7faf06fdc700 1 -- 172.21.15.72:0/3436713068 shutdown_connections 2023-10-03T10:15:12.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.413+0000 7faf06fdc700 1 --2- 172.21.15.72:0/3436713068 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf001338a0 0x7faf00133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.413+0000 7faf06fdc700 1 --2- 172.21.15.72:0/3436713068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf0009de50 0x7faf0009e220 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.413+0000 7faf06fdc700 1 -- 172.21.15.72:0/3436713068 >> 172.21.15.72:0/3436713068 conn(0x7faf000a2aa0 msgr2=0x7faf000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.413+0000 7faf06fdc700 1 -- 172.21.15.72:0/3436713068 shutdown_connections 2023-10-03T10:15:12.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.413+0000 7faf06fdc700 1 -- 172.21.15.72:0/3436713068 wait complete. 2023-10-03T10:15:12.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:12.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.414+0000 7faf06fdc700 1 Processor -- start 2023-10-03T10:15:12.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.414+0000 7faf06fdc700 1 -- start start 2023-10-03T10:15:12.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf06fdc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf0009de50 0x7faf0011a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf06fdc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf0009e760 0x7faf0011ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf06fdc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf001338a0 0x7faf0011b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf06fdc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0011c2b0 con 0x7faf001338a0 2023-10-03T10:15:12.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf06fdc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0011d500 con 0x7faf0009e760 2023-10-03T10:15:12.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf06fdc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf0011df80 con 0x7faf0009de50 2023-10-03T10:15:12.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf04d78700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf0009de50 0x7faf0011a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf04d78700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf0009de50 0x7faf0011a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59886/0 (socket says 172.21.15.72:59886) 2023-10-03T10:15:12.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faefffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf0009e760 0x7faf0011ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf04d78700 1 -- 172.21.15.72:0/3755484790 learned_addr learned my addr 172.21.15.72:0/3755484790 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:12.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf05579700 1 --2- 172.21.15.72:0/3755484790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf001338a0 0x7faf0011b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf04d78700 1 -- 172.21.15.72:0/3755484790 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf0009e760 msgr2=0x7faf0011ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf04d78700 1 --2- 172.21.15.72:0/3755484790 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf0009e760 0x7faf0011ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf04d78700 1 -- 172.21.15.72:0/3755484790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf001338a0 msgr2=0x7faf0011b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf04d78700 1 --2- 172.21.15.72:0/3755484790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf001338a0 0x7faf0011b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf04d78700 1 -- 172.21.15.72:0/3755484790 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4009550 con 0x7faf0009de50 2023-10-03T10:15:12.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faefffff700 1 --2- 172.21.15.72:0/3755484790 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf0009e760 0x7faf0011ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf05579700 1 --2- 172.21.15.72:0/3755484790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf001338a0 0x7faf0011b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.415+0000 7faf04d78700 1 --2- 172.21.15.72:0/3755484790 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf0009de50 0x7faf0011a6f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faef400ebe0 tx=0x7faef400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.416+0000 7faefd7fa700 1 -- 172.21.15.72:0/3755484790 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef400c850 con 0x7faf0009de50 2023-10-03T10:15:12.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.416+0000 7faefd7fa700 1 -- 172.21.15.72:0/3755484790 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef400c9b0 con 0x7faf0009de50 2023-10-03T10:15:12.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.416+0000 7faf06fdc700 1 -- 172.21.15.72:0/3755484790 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec0094a0 con 0x7faf0009de50 2023-10-03T10:15:12.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.416+0000 7faefd7fa700 1 -- 172.21.15.72:0/3755484790 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef400cd40 con 0x7faf0009de50 2023-10-03T10:15:12.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.416+0000 7faf06fdc700 1 -- 172.21.15.72:0/3755484790 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf000a0d70 con 0x7faf0009de50 2023-10-03T10:15:12.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.416+0000 7faefd7fa700 1 -- 172.21.15.72:0/3755484790 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faef4013470 con 0x7faf0009de50 2023-10-03T10:15:12.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.417+0000 7faefd7fa700 1 -- 172.21.15.72:0/3755484790 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faef403fde0 con 0x7faf0009de50 2023-10-03T10:15:12.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.417+0000 7faf06fdc700 1 -- 172.21.15.72:0/3755484790 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0006f6a0 con 0x7faf0009de50 2023-10-03T10:15:12.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.422+0000 7faefd7fa700 1 -- 172.21.15.72:0/3755484790 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faef401b3b0 con 0x7faf0009de50 2023-10-03T10:15:12.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.453+0000 7fee9fd17700 1 Processor -- start 2023-10-03T10:15:12.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.454+0000 7fee9fd17700 1 -- start start 2023-10-03T10:15:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.454+0000 7fee9fd17700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9809e930 0x7fee9809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.454+0000 7fee9fd17700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee9809f240 0x7fee981317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.454+0000 7fee9fd17700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee9809f650 0x7fee98131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.454+0000 7fee9fd17700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee98070940 con 0x7fee9809f650 2023-10-03T10:15:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.454+0000 7fee9fd17700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9806fd60 con 0x7fee9809e930 2023-10-03T10:15:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.454+0000 7fee9fd17700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee9806fa80 con 0x7fee9809f240 2023-10-03T10:15:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9d2b2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee9809f240 0x7fee981317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9dab3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9809e930 0x7fee9809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9e2b4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee9809f650 0x7fee98131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9dab3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9809e930 0x7fee9809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44276/0 (socket says 172.21.15.72:44276) 2023-10-03T10:15:12.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9d2b2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee9809f240 0x7fee981317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59898/0 (socket says 172.21.15.72:59898) 2023-10-03T10:15:12.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9dab3700 1 -- 172.21.15.72:0/4173265312 learned_addr learned my addr 172.21.15.72:0/4173265312 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:12.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9d2b2700 1 -- 172.21.15.72:0/4173265312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9809e930 msgr2=0x7fee9809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9d2b2700 1 --2- 172.21.15.72:0/4173265312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9809e930 0x7fee9809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9d2b2700 1 -- 172.21.15.72:0/4173265312 >> v2:172.21.15.72:3300/0 conn(0x7fee9809f650 msgr2=0x7fee98131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9d2b2700 1 --2- 172.21.15.72:0/4173265312 >> v2:172.21.15.72:3300/0 conn(0x7fee9809f650 0x7fee98131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9d2b2700 1 -- 172.21.15.72:0/4173265312 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9809fb60 con 0x7fee9809f240 2023-10-03T10:15:12.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9e2b4700 1 --2- 172.21.15.72:0/4173265312 >> v2:172.21.15.72:3300/0 conn(0x7fee9809f650 0x7fee98131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9dab3700 1 --2- 172.21.15.72:0/4173265312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9809e930 0x7fee9809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9d2b2700 1 --2- 172.21.15.72:0/4173265312 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee9809f240 0x7fee981317f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fee88009840 tx=0x7fee88009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f219ce1f2ffc362 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9cab1700 1 -- 172.21.15.72:0/4173265312 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88011830 con 0x7fee9809f240 2023-10-03T10:15:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9cab1700 1 -- 172.21.15.72:0/4173265312 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee88011990 con 0x7fee9809f240 2023-10-03T10:15:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.455+0000 7fee9cab1700 1 -- 172.21.15.72:0/4173265312 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88011d20 con 0x7fee9809f240 2023-10-03T10:15:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.456+0000 7fee9fd17700 1 -- 172.21.15.72:0/4173265312 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee9809f240 msgr2=0x7fee981317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.456+0000 7fee9fd17700 1 --2- 172.21.15.72:0/4173265312 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee9809f240 0x7fee981317f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fee88009840 tx=0x7fee88009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.456+0000 7fee9fd17700 1 -- 172.21.15.72:0/4173265312 shutdown_connections 2023-10-03T10:15:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.456+0000 7fee9fd17700 1 --2- 172.21.15.72:0/4173265312 >> v2:172.21.15.72:3300/0 conn(0x7fee9809f650 0x7fee98131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.456+0000 7fee9fd17700 1 --2- 172.21.15.72:0/4173265312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9809e930 0x7fee9809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.456+0000 7fee9fd17700 1 --2- 172.21.15.72:0/4173265312 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee9809f240 0x7fee981317f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.456+0000 7fee9fd17700 1 -- 172.21.15.72:0/4173265312 >> 172.21.15.72:0/4173265312 conn(0x7fee980a4210 msgr2=0x7fee980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.456+0000 7fee9fd17700 1 -- 172.21.15.72:0/4173265312 shutdown_connections 2023-10-03T10:15:12.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.456+0000 7fee9fd17700 1 -- 172.21.15.72:0/4173265312 wait complete. 2023-10-03T10:15:12.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.457+0000 7fee9fd17700 1 Processor -- start 2023-10-03T10:15:12.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.457+0000 7fee9fd17700 1 -- start start 2023-10-03T10:15:12.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9fd17700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee9809e930 0x7fee981a3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9fd17700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9809f240 0x7fee981a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9fd17700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9809f650 0x7fee981a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9fd17700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee981a5220 con 0x7fee9809f650 2023-10-03T10:15:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9fd17700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee981a6fe0 con 0x7fee9809f240 2023-10-03T10:15:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9fd17700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee980a3550 con 0x7fee9809e930 2023-10-03T10:15:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9e2b4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9809f650 0x7fee981a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9dab3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee9809e930 0x7fee981a3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9e2b4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9809f650 0x7fee981a4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55084/0 (socket says 172.21.15.72:55084) 2023-10-03T10:15:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9dab3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee9809e930 0x7fee981a3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59900/0 (socket says 172.21.15.72:59900) 2023-10-03T10:15:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9d2b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9809f240 0x7fee981a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9e2b4700 1 -- 172.21.15.72:0/1313942174 learned_addr learned my addr 172.21.15.72:0/1313942174 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:12.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9e2b4700 1 -- 172.21.15.72:0/1313942174 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee9809e930 msgr2=0x7fee981a3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9e2b4700 1 --2- 172.21.15.72:0/1313942174 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee9809e930 0x7fee981a3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9e2b4700 1 -- 172.21.15.72:0/1313942174 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9809f240 msgr2=0x7fee981a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9e2b4700 1 --2- 172.21.15.72:0/1313942174 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9809f240 0x7fee981a4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.458+0000 7fee9e2b4700 1 -- 172.21.15.72:0/1313942174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94009550 con 0x7fee9809f650 2023-10-03T10:15:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.459+0000 7fee9dab3700 1 --2- 172.21.15.72:0/1313942174 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee9809e930 0x7fee981a3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.459+0000 7fee9e2b4700 1 --2- 172.21.15.72:0/1313942174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9809f650 0x7fee981a4860 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fee9000ef90 tx=0x7fee9000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.459+0000 7fee8e7fc700 1 -- 172.21.15.72:0/1313942174 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9000cd40 con 0x7fee9809f650 2023-10-03T10:15:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.459+0000 7fee8e7fc700 1 -- 172.21.15.72:0/1313942174 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9000f040 con 0x7fee9809f650 2023-10-03T10:15:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.459+0000 7fee9fd17700 1 -- 172.21.15.72:0/1313942174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee90009a70 con 0x7fee9809f650 2023-10-03T10:15:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.459+0000 7fee8e7fc700 1 -- 172.21.15.72:0/1313942174 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee900146c0 con 0x7fee9809f650 2023-10-03T10:15:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.459+0000 7fee9fd17700 1 -- 172.21.15.72:0/1313942174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee880094a0 con 0x7fee9809f650 2023-10-03T10:15:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.460+0000 7fee9fd17700 1 -- 172.21.15.72:0/1313942174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee981a7560 con 0x7fee9809f650 2023-10-03T10:15:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.460+0000 7fee8e7fc700 1 -- 172.21.15.72:0/1313942174 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee90014820 con 0x7fee9809f650 2023-10-03T10:15:12.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.461+0000 7fee8e7fc700 1 -- 172.21.15.72:0/1313942174 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fee900402e0 con 0x7fee9809f650 2023-10-03T10:15:12.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.469+0000 7fee8e7fc700 1 -- 172.21.15.72:0/1313942174 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee90014e00 con 0x7fee9809f650 2023-10-03T10:15:12.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.623+0000 7faf06fdc700 1 -- 172.21.15.72:0/3755484790 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faf00074ea0 con 0x7faf0009de50 2023-10-03T10:15:12.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.624+0000 7faefd7fa700 1 -- 172.21.15.72:0/3755484790 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faef4011b40 con 0x7faf0009de50 2023-10-03T10:15:12.625 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:12.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.626+0000 7faf06fdc700 1 -- 172.21.15.72:0/3755484790 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf0009de50 msgr2=0x7faf0011a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.626+0000 7faf06fdc700 1 --2- 172.21.15.72:0/3755484790 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf0009de50 0x7faf0011a6f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faef400ebe0 tx=0x7faef400eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.626+0000 7faf06fdc700 1 -- 172.21.15.72:0/3755484790 shutdown_connections 2023-10-03T10:15:12.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.626+0000 7faf06fdc700 1 --2- 172.21.15.72:0/3755484790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf001338a0 0x7faf0011b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.626+0000 7faf06fdc700 1 --2- 172.21.15.72:0/3755484790 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf0009de50 0x7faf0011a6f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.626+0000 7faf06fdc700 1 --2- 172.21.15.72:0/3755484790 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf0009e760 0x7faf0011ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.626+0000 7faf06fdc700 1 -- 172.21.15.72:0/3755484790 >> 172.21.15.72:0/3755484790 conn(0x7faf000a2aa0 msgr2=0x7faf00130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.626+0000 7faf06fdc700 1 -- 172.21.15.72:0/3755484790 shutdown_connections 2023-10-03T10:15:12.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.626+0000 7faf06fdc700 1 -- 172.21.15.72:0/3755484790 wait complete. 2023-10-03T10:15:12.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.663+0000 7fee9fd17700 1 -- 172.21.15.72:0/1313942174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fee98074ea0 con 0x7fee9809f650 2023-10-03T10:15:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.663+0000 7fee8e7fc700 1 -- 172.21.15.72:0/1313942174 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fee90018020 con 0x7fee9809f650 2023-10-03T10:15:12.666 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.665+0000 7fee9fd17700 1 -- 172.21.15.72:0/1313942174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9809f650 msgr2=0x7fee981a4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.665+0000 7fee9fd17700 1 --2- 172.21.15.72:0/1313942174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9809f650 0x7fee981a4860 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fee9000ef90 tx=0x7fee9000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.665+0000 7fee9fd17700 1 -- 172.21.15.72:0/1313942174 shutdown_connections 2023-10-03T10:15:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.665+0000 7fee9fd17700 1 --2- 172.21.15.72:0/1313942174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9809f650 0x7fee981a4860 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.665+0000 7fee9fd17700 1 --2- 172.21.15.72:0/1313942174 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fee9809e930 0x7fee981a3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.665+0000 7fee9fd17700 1 --2- 172.21.15.72:0/1313942174 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9809f240 0x7fee981a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.665+0000 7fee9fd17700 1 -- 172.21.15.72:0/1313942174 >> 172.21.15.72:0/1313942174 conn(0x7fee980a4210 msgr2=0x7fee981b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.665+0000 7fee9fd17700 1 -- 172.21.15.72:0/1313942174 shutdown_connections 2023-10-03T10:15:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.665+0000 7fee9fd17700 1 -- 172.21.15.72:0/1313942174 wait complete. 2023-10-03T10:15:12.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:12.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:12.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.841+0000 7fd3bb304700 1 Processor -- start 2023-10-03T10:15:12.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.841+0000 7fd3bb304700 1 -- start start 2023-10-03T10:15:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.841+0000 7fd3bb304700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3b409d6f0 0x7fd3b409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.841+0000 7fd3bb304700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3b409e410 0x7fd3b4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.841+0000 7fd3bb304700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b409b120 con 0x7fd3b409e000 2023-10-03T10:15:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.841+0000 7fd3bb304700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b406b460 con 0x7fd3b409d6f0 2023-10-03T10:15:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.841+0000 7fd3bb304700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b409a7e0 con 0x7fd3b409e410 2023-10-03T10:15:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.841+0000 7fd3b90a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3b409d6f0 0x7fd3b409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.841+0000 7fd3b98a1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3b409e410 0x7fd3b4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.841+0000 7fd3b889f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd3b409e000 0x7fd3b41339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59676/0 (socket says 172.21.15.72:59676) 2023-10-03T10:15:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.841+0000 7fd3b889f700 1 -- 172.21.15.72:0/756367794 learned_addr learned my addr 172.21.15.72:0/756367794 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:12.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.842+0000 7fd3abfff700 1 -- 172.21.15.72:0/756367794 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609659872 0 0) 0x7fd3b409b120 con 0x7fd3b409e000 2023-10-03T10:15:12.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.842+0000 7fd3b98a1700 1 -- 172.21.15.72:0/756367794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3b409d6f0 msgr2=0x7fd3b409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.842+0000 7fd3b98a1700 1 --2- 172.21.15.72:0/756367794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3b409d6f0 0x7fd3b409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.842+0000 7fd3b98a1700 1 -- 172.21.15.72:0/756367794 >> v1:172.21.15.72:6789/0 conn(0x7fd3b409e000 legacy=0x7fd3b41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.842+0000 7fd3b98a1700 1 -- 172.21.15.72:0/756367794 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b409a500 con 0x7fd3b409e410 2023-10-03T10:15:12.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.842+0000 7fd3b90a0700 1 --2- 172.21.15.72:0/756367794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3b409d6f0 0x7fd3b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.842+0000 7fd3b98a1700 1 --2- 172.21.15.72:0/756367794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3b409e410 0x7fd3b4134100 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009df0 tx=0x7fd3ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e303daee1828cdcb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.842+0000 7fd3abfff700 1 -- 172.21.15.72:0/756367794 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00e070 con 0x7fd3b409e410 2023-10-03T10:15:12.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.842+0000 7fd3abfff700 1 -- 172.21.15.72:0/756367794 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac00bae0 con 0x7fd3b409e410 2023-10-03T10:15:12.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.842+0000 7fd3abfff700 1 -- 172.21.15.72:0/756367794 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00be90 con 0x7fd3b409e410 2023-10-03T10:15:12.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.842+0000 7fd3bb304700 1 -- 172.21.15.72:0/756367794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3b409e410 msgr2=0x7fd3b4134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.842+0000 7fd3bb304700 1 --2- 172.21.15.72:0/756367794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3b409e410 0x7fd3b4134100 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009df0 tx=0x7fd3ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:12.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.843+0000 7fd3bb304700 1 -- 172.21.15.72:0/756367794 shutdown_connections 2023-10-03T10:15:12.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.843+0000 7fd3bb304700 1 --2- 172.21.15.72:0/756367794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3b409e410 0x7fd3b4134100 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.843+0000 7fd3bb304700 1 --2- 172.21.15.72:0/756367794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3b409d6f0 0x7fd3b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.843+0000 7fd3bb304700 1 -- 172.21.15.72:0/756367794 >> 172.21.15.72:0/756367794 conn(0x7fd3b4066f50 msgr2=0x7fd3b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.843+0000 7fd3bb304700 1 -- 172.21.15.72:0/756367794 shutdown_connections 2023-10-03T10:15:12.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.843+0000 7fd3bb304700 1 -- 172.21.15.72:0/756367794 wait complete. 2023-10-03T10:15:12.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.843+0000 7fd3bb304700 1 Processor -- start 2023-10-03T10:15:12.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3bb304700 1 -- start start 2023-10-03T10:15:12.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3bb304700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3b409d6f0 0x7fd3b4122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3bb304700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3b409e000 0x7fd3b4122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3bb304700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3b409e410 0x7fd3b4122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3bb304700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b41237f0 con 0x7fd3b409e000 2023-10-03T10:15:12.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3bb304700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b4124e00 con 0x7fd3b409d6f0 2023-10-03T10:15:12.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3bb304700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b4125e40 con 0x7fd3b409e410 2023-10-03T10:15:12.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3b98a1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3b409e410 0x7fd3b4122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3b90a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3b409d6f0 0x7fd3b4122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3b889f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3b409e000 0x7fd3b4122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3b98a1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3b409e410 0x7fd3b4122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59908/0 (socket says 172.21.15.72:59908) 2023-10-03T10:15:12.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3b98a1700 1 -- 172.21.15.72:0/2330896236 learned_addr learned my addr 172.21.15.72:0/2330896236 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:12.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3b90a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3b409d6f0 0x7fd3b4122320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44304/0 (socket says 172.21.15.72:44304) 2023-10-03T10:15:12.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3b98a1700 1 -- 172.21.15.72:0/2330896236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3b409d6f0 msgr2=0x7fd3b4122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3b98a1700 1 --2- 172.21.15.72:0/2330896236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3b409d6f0 0x7fd3b4122320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3b98a1700 1 -- 172.21.15.72:0/2330896236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3b409e000 msgr2=0x7fd3b4122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3b98a1700 1 --2- 172.21.15.72:0/2330896236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3b409e000 0x7fd3b4122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3b98a1700 1 -- 172.21.15.72:0/2330896236 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b00094a0 con 0x7fd3b409e410 2023-10-03T10:15:12.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3b90a0700 1 --2- 172.21.15.72:0/2330896236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3b409d6f0 0x7fd3b4122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.844+0000 7fd3b98a1700 1 --2- 172.21.15.72:0/2330896236 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3b409e410 0x7fd3b4122da0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00d010 tx=0x7fd3ac004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.845+0000 7fd3a9ffb700 1 -- 172.21.15.72:0/2330896236 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0045d0 con 0x7fd3b409e410 2023-10-03T10:15:12.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.845+0000 7fd3a9ffb700 1 -- 172.21.15.72:0/2330896236 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac020070 con 0x7fd3b409e410 2023-10-03T10:15:12.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.845+0000 7fd3bb304700 1 -- 172.21.15.72:0/2330896236 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ac009a70 con 0x7fd3b409e410 2023-10-03T10:15:12.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.845+0000 7fd3a9ffb700 1 -- 172.21.15.72:0/2330896236 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac004970 con 0x7fd3b409e410 2023-10-03T10:15:12.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.845+0000 7fd3bb304700 1 -- 172.21.15.72:0/2330896236 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b40a2020 con 0x7fd3b409e410 2023-10-03T10:15:12.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.845+0000 7fd3a9ffb700 1 -- 172.21.15.72:0/2330896236 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3ac012430 con 0x7fd3b409e410 2023-10-03T10:15:12.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.846+0000 7fd3a9ffb700 1 -- 172.21.15.72:0/2330896236 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd3ac022070 con 0x7fd3b409e410 2023-10-03T10:15:12.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.846+0000 7fd3bb304700 1 -- 172.21.15.72:0/2330896236 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b411f030 con 0x7fd3b409e410 2023-10-03T10:15:12.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:12.850+0000 7fd3a9ffb700 1 -- 172.21.15.72:0/2330896236 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3ac01a970 con 0x7fd3b409e410 2023-10-03T10:15:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.032+0000 7fd3bb304700 1 -- 172.21.15.72:0/2330896236 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd3b409c710 con 0x7fd3b409e410 2023-10-03T10:15:13.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.033+0000 7fd3a9ffb700 1 -- 172.21.15.72:0/2330896236 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3ac01a380 con 0x7fd3b409e410 2023-10-03T10:15:13.034 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.035+0000 7fd3bb304700 1 -- 172.21.15.72:0/2330896236 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3b409e410 msgr2=0x7fd3b4122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.035+0000 7fd3bb304700 1 --2- 172.21.15.72:0/2330896236 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3b409e410 0x7fd3b4122da0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00d010 tx=0x7fd3ac004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.035+0000 7fd3bb304700 1 -- 172.21.15.72:0/2330896236 shutdown_connections 2023-10-03T10:15:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.035+0000 7fd3bb304700 1 --2- 172.21.15.72:0/2330896236 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd3b409e410 0x7fd3b4122da0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.035+0000 7fd3bb304700 1 --2- 172.21.15.72:0/2330896236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3b409d6f0 0x7fd3b4122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.035+0000 7fd3bb304700 1 --2- 172.21.15.72:0/2330896236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3b409e000 0x7fd3b4122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.035+0000 7fd3bb304700 1 -- 172.21.15.72:0/2330896236 >> 172.21.15.72:0/2330896236 conn(0x7fd3b4066f50 msgr2=0x7fd3b4133de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.035+0000 7fd3bb304700 1 -- 172.21.15.72:0/2330896236 shutdown_connections 2023-10-03T10:15:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.035+0000 7fd3bb304700 1 -- 172.21.15.72:0/2330896236 wait complete. 2023-10-03T10:15:13.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:13.417 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:13.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.541+0000 7fcee0a3e700 1 Processor -- start 2023-10-03T10:15:13.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.541+0000 7fcee0a3e700 1 -- start start 2023-10-03T10:15:13.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.541+0000 7fcee0a3e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcedc09eca0 0x7fcedc13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.541+0000 7fcee0a3e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcedc06f050 0x7fcedc13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.541+0000 7fcee0a3e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc070ee0 con 0x7fcedc06e570 2023-10-03T10:15:13.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.541+0000 7fcee0a3e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc071980 con 0x7fcedc06f050 2023-10-03T10:15:13.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.542+0000 7fcee0a3e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc071480 con 0x7fcedc09eca0 2023-10-03T10:15:13.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.542+0000 7fced9d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcedc09eca0 0x7fcedc13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.542+0000 7fcedad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcedc06f050 0x7fcedc13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.542+0000 7fced9d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcedc09eca0 0x7fcedc13cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59924/0 (socket says 172.21.15.72:59924) 2023-10-03T10:15:13.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.542+0000 7fced9d9b700 1 -- 172.21.15.72:0/2905082263 learned_addr learned my addr 172.21.15.72:0/2905082263 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:13.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.542+0000 7fced9d9b700 1 -- 172.21.15.72:0/2905082263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcedc06f050 msgr2=0x7fcedc13f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:13.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.542+0000 7fced9d9b700 1 --2- 172.21.15.72:0/2905082263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcedc06f050 0x7fcedc13f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.542+0000 7fced9d9b700 1 -- 172.21.15.72:0/2905082263 >> v1:172.21.15.72:6789/0 conn(0x7fcedc06e570 legacy=0x7fcedc06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.542+0000 7fced9d9b700 1 -- 172.21.15.72:0/2905082263 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc071b90 con 0x7fcedc09eca0 2023-10-03T10:15:13.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.542+0000 7fced959a700 1 -- 172.21.15.72:0/2905082263 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201444115 0 0) 0x7fcedc070ee0 con 0x7fcedc06e570 2023-10-03T10:15:13.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.542+0000 7fcedad9d700 1 --2- 172.21.15.72:0/2905082263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcedc06f050 0x7fcedc13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:13.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.542+0000 7fced9d9b700 1 --2- 172.21.15.72:0/2905082263 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcedc09eca0 0x7fcedc13cea0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fced0009920 tx=0x7fced0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ca1126db3000a01 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.542+0000 7fced959a700 1 -- 172.21.15.72:0/2905082263 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0011830 con 0x7fcedc09eca0 2023-10-03T10:15:13.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.542+0000 7fced959a700 1 -- 172.21.15.72:0/2905082263 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced0011990 con 0x7fcedc09eca0 2023-10-03T10:15:13.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.542+0000 7fced959a700 1 -- 172.21.15.72:0/2905082263 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced0011d20 con 0x7fcedc09eca0 2023-10-03T10:15:13.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.543+0000 7fcee0a3e700 1 -- 172.21.15.72:0/2905082263 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcedc09eca0 msgr2=0x7fcedc13cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.543+0000 7fcee0a3e700 1 --2- 172.21.15.72:0/2905082263 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcedc09eca0 0x7fcedc13cea0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fced0009920 tx=0x7fced0009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:13.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.543+0000 7fcee0a3e700 1 -- 172.21.15.72:0/2905082263 shutdown_connections 2023-10-03T10:15:13.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.543+0000 7fcee0a3e700 1 --2- 172.21.15.72:0/2905082263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcedc06f050 0x7fcedc13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.543+0000 7fcee0a3e700 1 --2- 172.21.15.72:0/2905082263 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcedc09eca0 0x7fcedc13cea0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.543+0000 7fcee0a3e700 1 -- 172.21.15.72:0/2905082263 >> 172.21.15.72:0/2905082263 conn(0x7fcedc0a2aa0 msgr2=0x7fcedc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.543+0000 7fcee0a3e700 1 -- 172.21.15.72:0/2905082263 shutdown_connections 2023-10-03T10:15:13.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.543+0000 7fcee0a3e700 1 -- 172.21.15.72:0/2905082263 wait complete. 2023-10-03T10:15:13.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.544+0000 7fcee0a3e700 1 Processor -- start 2023-10-03T10:15:13.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.544+0000 7fcee0a3e700 1 -- start start 2023-10-03T10:15:13.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.544+0000 7fcee0a3e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcedc06e570 0x7fcedc136640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.544+0000 7fcee0a3e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcedc06f050 0x7fcedc136b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.544+0000 7fcee0a3e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcedc13e8f0 0x7fcedc1370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.544+0000 7fcee0a3e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc138440 con 0x7fcedc06e570 2023-10-03T10:15:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.544+0000 7fcee0a3e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc138250 con 0x7fcedc06f050 2023-10-03T10:15:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.544+0000 7fcee0a3e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc138ac0 con 0x7fcedc13e8f0 2023-10-03T10:15:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.544+0000 7fceda59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcedc06e570 0x7fcedc136640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.544+0000 7fced9d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcedc06f050 0x7fcedc136b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fcedad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcedc13e8f0 0x7fcedc1370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fceda59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcedc06e570 0x7fcedc136640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55104/0 (socket says 172.21.15.72:55104) 2023-10-03T10:15:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fced9d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcedc06f050 0x7fcedc136b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44324/0 (socket says 172.21.15.72:44324) 2023-10-03T10:15:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fceda59c700 1 -- 172.21.15.72:0/2298613442 learned_addr learned my addr 172.21.15.72:0/2298613442 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fcedad9d700 1 --2- 172.21.15.72:0/2298613442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcedc13e8f0 0x7fcedc1370c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59928/0 (socket says 172.21.15.72:59928) 2023-10-03T10:15:13.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fceda59c700 1 -- 172.21.15.72:0/2298613442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcedc13e8f0 msgr2=0x7fcedc1370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fceda59c700 1 --2- 172.21.15.72:0/2298613442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcedc13e8f0 0x7fcedc1370c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fceda59c700 1 -- 172.21.15.72:0/2298613442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcedc06f050 msgr2=0x7fcedc136b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fceda59c700 1 --2- 172.21.15.72:0/2298613442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcedc06f050 0x7fcedc136b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fceda59c700 1 -- 172.21.15.72:0/2298613442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced4009a70 con 0x7fcedc06e570 2023-10-03T10:15:13.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fceda59c700 1 --2- 172.21.15.72:0/2298613442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcedc06e570 0x7fcedc136640 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fcecc001eb0 tx=0x7fcecc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fcecaffd700 1 -- 172.21.15.72:0/2298613442 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0054e0 con 0x7fcedc06e570 2023-10-03T10:15:13.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fcecaffd700 1 -- 172.21.15.72:0/2298613442 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc003680 con 0x7fcedc06e570 2023-10-03T10:15:13.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fcee0a3e700 1 -- 172.21.15.72:0/2298613442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced0009550 con 0x7fcedc06e570 2023-10-03T10:15:13.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fcecaffd700 1 -- 172.21.15.72:0/2298613442 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0039f0 con 0x7fcedc06e570 2023-10-03T10:15:13.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.545+0000 7fcee0a3e700 1 -- 172.21.15.72:0/2298613442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcedc13a1b0 con 0x7fcedc06e570 2023-10-03T10:15:13.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.546+0000 7fcecaffd700 1 -- 172.21.15.72:0/2298613442 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcecc003b50 con 0x7fcedc06e570 2023-10-03T10:15:13.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.546+0000 7fcecaffd700 1 -- 172.21.15.72:0/2298613442 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcecc03e830 con 0x7fcedc06e570 2023-10-03T10:15:13.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.546+0000 7fcee0a3e700 1 -- 172.21.15.72:0/2298613442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcedc139530 con 0x7fcedc06e570 2023-10-03T10:15:13.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.550+0000 7fcecaffd700 1 -- 172.21.15.72:0/2298613442 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcecc003e00 con 0x7fcedc06e570 2023-10-03T10:15:13.640 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:13.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.741+0000 7fcee0a3e700 1 -- 172.21.15.72:0/2298613442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcedc0a1a50 con 0x7fcedc06e570 2023-10-03T10:15:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.741+0000 7fcecaffd700 1 -- 172.21.15.72:0/2298613442 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcecc017020 con 0x7fcedc06e570 2023-10-03T10:15:13.742 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:13.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.743+0000 7fcee0a3e700 1 -- 172.21.15.72:0/2298613442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcedc06e570 msgr2=0x7fcedc136640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.743+0000 7fcee0a3e700 1 --2- 172.21.15.72:0/2298613442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcedc06e570 0x7fcedc136640 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fcecc001eb0 tx=0x7fcecc00c800 comp rx=0 tx=0).stop 2023-10-03T10:15:13.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.743+0000 7fcee0a3e700 1 -- 172.21.15.72:0/2298613442 shutdown_connections 2023-10-03T10:15:13.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.743+0000 7fcee0a3e700 1 --2- 172.21.15.72:0/2298613442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcedc06e570 0x7fcedc136640 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.743+0000 7fcee0a3e700 1 --2- 172.21.15.72:0/2298613442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcedc13e8f0 0x7fcedc1370c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.743+0000 7fcee0a3e700 1 --2- 172.21.15.72:0/2298613442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcedc06f050 0x7fcedc136b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.743+0000 7fcee0a3e700 1 -- 172.21.15.72:0/2298613442 >> 172.21.15.72:0/2298613442 conn(0x7fcedc0a2aa0 msgr2=0x7fcedc09cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.743+0000 7fcee0a3e700 1 -- 172.21.15.72:0/2298613442 shutdown_connections 2023-10-03T10:15:13.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.743+0000 7fcee0a3e700 1 -- 172.21.15.72:0/2298613442 wait complete. 2023-10-03T10:15:13.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.765+0000 7fadbafc8700 1 Processor -- start 2023-10-03T10:15:13.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.765+0000 7fadbafc8700 1 -- start start 2023-10-03T10:15:13.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.765+0000 7fadbafc8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fadb406b250 0x7fadb4136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.765+0000 7fadbafc8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb4136d80 0x7fadb4139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.765+0000 7fadbafc8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb409ece0 con 0x7fadb406a770 2023-10-03T10:15:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.765+0000 7fadbafc8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb409e760 con 0x7fadb406b250 2023-10-03T10:15:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.765+0000 7fadbafc8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb409e040 con 0x7fadb4136d80 2023-10-03T10:15:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.765+0000 7fadb3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fadb406b250 0x7fadb4136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.765+0000 7fadb9565700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb4136d80 0x7fadb4139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.765+0000 7fadb9565700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb4136d80 0x7fadb4139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44330/0 (socket says 172.21.15.72:44330) 2023-10-03T10:15:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.765+0000 7fadb9565700 1 -- 172.21.15.72:0/624455742 learned_addr learned my addr 172.21.15.72:0/624455742 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.765+0000 7fadb3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fadb406b250 0x7fadb4136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55118/0 (socket says 172.21.15.72:55118) 2023-10-03T10:15:13.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.766+0000 7fadb9565700 1 -- 172.21.15.72:0/624455742 >> v2:172.21.15.72:3300/0 conn(0x7fadb406b250 msgr2=0x7fadb4136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:13.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.766+0000 7fadb9565700 1 --2- 172.21.15.72:0/624455742 >> v2:172.21.15.72:3300/0 conn(0x7fadb406b250 0x7fadb4136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.766+0000 7fadb9565700 1 -- 172.21.15.72:0/624455742 >> v1:172.21.15.72:6789/0 conn(0x7fadb406a770 legacy=0x7fadb406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.766+0000 7fadb9565700 1 -- 172.21.15.72:0/624455742 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb409f630 con 0x7fadb4136d80 2023-10-03T10:15:13.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.766+0000 7fadb9565700 1 --2- 172.21.15.72:0/624455742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb4136d80 0x7fadb4139160 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fadac009e50 tx=0x7fadac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=583f2b25d5584c1a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.766+0000 7fadb37fe700 1 -- 172.21.15.72:0/624455742 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac00e070 con 0x7fadb4136d80 2023-10-03T10:15:13.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.766+0000 7fadb37fe700 1 -- 172.21.15.72:0/624455742 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac00b910 con 0x7fadb4136d80 2023-10-03T10:15:13.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.766+0000 7fadb37fe700 1 -- 172.21.15.72:0/624455742 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac00bcc0 con 0x7fadb4136d80 2023-10-03T10:15:13.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.767+0000 7fadbafc8700 1 -- 172.21.15.72:0/624455742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb4136d80 msgr2=0x7fadb4139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.767+0000 7fadbafc8700 1 --2- 172.21.15.72:0/624455742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb4136d80 0x7fadb4139160 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fadac009e50 tx=0x7fadac00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:13.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.767+0000 7fadbafc8700 1 -- 172.21.15.72:0/624455742 shutdown_connections 2023-10-03T10:15:13.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.767+0000 7fadbafc8700 1 --2- 172.21.15.72:0/624455742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb4136d80 0x7fadb4139160 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.767+0000 7fadbafc8700 1 --2- 172.21.15.72:0/624455742 >> v2:172.21.15.72:3300/0 conn(0x7fadb406b250 0x7fadb4136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.767+0000 7fadbafc8700 1 -- 172.21.15.72:0/624455742 >> 172.21.15.72:0/624455742 conn(0x7fadb4066f50 msgr2=0x7fadb409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.767+0000 7fadbafc8700 1 -- 172.21.15.72:0/624455742 shutdown_connections 2023-10-03T10:15:13.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.767+0000 7fadbafc8700 1 -- 172.21.15.72:0/624455742 wait complete. 2023-10-03T10:15:13.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.768+0000 7fadbafc8700 1 Processor -- start 2023-10-03T10:15:13.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.768+0000 7fadbafc8700 1 -- start start 2023-10-03T10:15:13.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadbafc8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb406a770 0x7fadb41c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadbafc8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb406b250 0x7fadb41c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadbafc8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadb4136d80 0x7fadb41c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadbafc8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb411e340 con 0x7fadb4136d80 2023-10-03T10:15:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadbafc8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb411ee30 con 0x7fadb406a770 2023-10-03T10:15:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadbafc8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadb411ea20 con 0x7fadb406b250 2023-10-03T10:15:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadb3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb406b250 0x7fadb41c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadb8d64700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb406a770 0x7fadb41c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadb3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb406b250 0x7fadb41c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59944/0 (socket says 172.21.15.72:59944) 2023-10-03T10:15:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadb3fff700 1 -- 172.21.15.72:0/1758338143 learned_addr learned my addr 172.21.15.72:0/1758338143 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadb9565700 1 --2- 172.21.15.72:0/1758338143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadb4136d80 0x7fadb41c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadb3fff700 1 -- 172.21.15.72:0/1758338143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb406a770 msgr2=0x7fadb41c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadb3fff700 1 --2- 172.21.15.72:0/1758338143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb406a770 0x7fadb41c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadb3fff700 1 -- 172.21.15.72:0/1758338143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadb4136d80 msgr2=0x7fadb41c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadb3fff700 1 --2- 172.21.15.72:0/1758338143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadb4136d80 0x7fadb41c69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadb3fff700 1 -- 172.21.15.72:0/1758338143 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac009b30 con 0x7fadb406b250 2023-10-03T10:15:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadb8d64700 1 --2- 172.21.15.72:0/1758338143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb406a770 0x7fadb41c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.769+0000 7fadb3fff700 1 --2- 172.21.15.72:0/1758338143 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb406b250 0x7fadb41c64b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fada000e9e0 tx=0x7fada000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.770+0000 7fadb17fa700 1 -- 172.21.15.72:0/1758338143 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada0009710 con 0x7fadb406b250 2023-10-03T10:15:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.770+0000 7fadb17fa700 1 -- 172.21.15.72:0/1758338143 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada000ee80 con 0x7fadb406b250 2023-10-03T10:15:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.770+0000 7fadbafc8700 1 -- 172.21.15.72:0/1758338143 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb41200d0 con 0x7fadb406b250 2023-10-03T10:15:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.770+0000 7fadb17fa700 1 -- 172.21.15.72:0/1758338143 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada000ca50 con 0x7fadb406b250 2023-10-03T10:15:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.770+0000 7fadbafc8700 1 -- 172.21.15.72:0/1758338143 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb411fdf0 con 0x7fadb406b250 2023-10-03T10:15:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.770+0000 7fadb17fa700 1 -- 172.21.15.72:0/1758338143 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fada000cbb0 con 0x7fadb406b250 2023-10-03T10:15:13.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.770+0000 7fadb17fa700 1 -- 172.21.15.72:0/1758338143 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fada003f700 con 0x7fadb406b250 2023-10-03T10:15:13.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.771+0000 7fadbafc8700 1 -- 172.21.15.72:0/1758338143 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb4074ea0 con 0x7fadb406b250 2023-10-03T10:15:13.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.775+0000 7fadb17fa700 1 -- 172.21.15.72:0/1758338143 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fada00232f0 con 0x7fadb406b250 2023-10-03T10:15:13.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.816+0000 7f877d735700 1 Processor -- start 2023-10-03T10:15:13.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.816+0000 7f877d735700 1 -- start start 2023-10-03T10:15:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.816+0000 7f877d735700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f877809e930 0x7f877809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.816+0000 7f877d735700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f877809f240 0x7f87781317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f877d735700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8778070940 con 0x7f877809f650 2023-10-03T10:15:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f877d735700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877806fd60 con 0x7f877809f240 2023-10-03T10:15:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f877d735700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f877806fa80 con 0x7f877809e930 2023-10-03T10:15:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f8776ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f877809e930 0x7f877809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f87767fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f877809f240 0x7f87781317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f87777fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f877809f650 0x7f8778131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59700/0 (socket says 172.21.15.72:59700) 2023-10-03T10:15:13.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f8776ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f877809e930 0x7f877809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59946/0 (socket says 172.21.15.72:59946) 2023-10-03T10:15:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f8776ffd700 1 -- 172.21.15.72:0/3846709418 learned_addr learned my addr 172.21.15.72:0/3846709418 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f8776ffd700 1 -- 172.21.15.72:0/3846709418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f877809f240 msgr2=0x7f87781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f8775ffb700 1 -- 172.21.15.72:0/3846709418 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320231808 0 0) 0x7f8778070940 con 0x7f877809f650 2023-10-03T10:15:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f8776ffd700 1 --2- 172.21.15.72:0/3846709418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f877809f240 0x7f87781317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f8776ffd700 1 -- 172.21.15.72:0/3846709418 >> v1:172.21.15.72:6789/0 conn(0x7f877809f650 legacy=0x7f8778131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f8776ffd700 1 -- 172.21.15.72:0/3846709418 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877809fb60 con 0x7f877809e930 2023-10-03T10:15:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f87767fc700 1 --2- 172.21.15.72:0/3846709418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f877809f240 0x7f87781317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f8776ffd700 1 --2- 172.21.15.72:0/3846709418 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f877809e930 0x7f877809ed00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8768009920 tx=0x7f8768009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d94444f43d087b87 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f8775ffb700 1 -- 172.21.15.72:0/3846709418 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768011830 con 0x7f877809e930 2023-10-03T10:15:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f8775ffb700 1 -- 172.21.15.72:0/3846709418 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8768011990 con 0x7f877809e930 2023-10-03T10:15:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.817+0000 7f8775ffb700 1 -- 172.21.15.72:0/3846709418 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768011d20 con 0x7f877809e930 2023-10-03T10:15:13.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.818+0000 7f877d735700 1 -- 172.21.15.72:0/3846709418 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f877809e930 msgr2=0x7f877809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.818+0000 7f877d735700 1 --2- 172.21.15.72:0/3846709418 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f877809e930 0x7f877809ed00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8768009920 tx=0x7f8768009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.818+0000 7f877d735700 1 -- 172.21.15.72:0/3846709418 shutdown_connections 2023-10-03T10:15:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.818+0000 7f877d735700 1 --2- 172.21.15.72:0/3846709418 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f877809e930 0x7f877809ed00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.818+0000 7f877d735700 1 --2- 172.21.15.72:0/3846709418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f877809f240 0x7f87781317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.818+0000 7f877d735700 1 -- 172.21.15.72:0/3846709418 >> 172.21.15.72:0/3846709418 conn(0x7f87780a4210 msgr2=0x7f87780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.818+0000 7f877d735700 1 -- 172.21.15.72:0/3846709418 shutdown_connections 2023-10-03T10:15:13.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.818+0000 7f877d735700 1 -- 172.21.15.72:0/3846709418 wait complete. 2023-10-03T10:15:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.819+0000 7f877d735700 1 Processor -- start 2023-10-03T10:15:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.819+0000 7f877d735700 1 -- start start 2023-10-03T10:15:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f877d735700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f877809e930 0x7f877806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f877d735700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f877809f240 0x7f877806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f877d735700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f877809f650 0x7f877806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f877d735700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87781a8980 con 0x7f877809f650 2023-10-03T10:15:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f877d735700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87781a9990 con 0x7f877809e930 2023-10-03T10:15:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f877d735700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f877806cd10 con 0x7f877809f240 2023-10-03T10:15:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f87777fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f877809f650 0x7f877806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f87767fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f877809f240 0x7f877806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f87767fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f877809f240 0x7f877806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59962/0 (socket says 172.21.15.72:59962) 2023-10-03T10:15:13.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f87777fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f877809f650 0x7f877806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55140/0 (socket says 172.21.15.72:55140) 2023-10-03T10:15:13.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f87767fc700 1 -- 172.21.15.72:0/1861654013 learned_addr learned my addr 172.21.15.72:0/1861654013 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:13.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f8776ffd700 1 --2- 172.21.15.72:0/1861654013 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f877809e930 0x7f877806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:13.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f87767fc700 1 -- 172.21.15.72:0/1861654013 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f877809e930 msgr2=0x7f877806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f87767fc700 1 --2- 172.21.15.72:0/1861654013 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f877809e930 0x7f877806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f87767fc700 1 -- 172.21.15.72:0/1861654013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f877809f650 msgr2=0x7f877806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f87767fc700 1 --2- 172.21.15.72:0/1861654013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f877809f650 0x7f877806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.820+0000 7f87767fc700 1 -- 172.21.15.72:0/1861654013 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c0094a0 con 0x7f877809f240 2023-10-03T10:15:13.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.821+0000 7f87767fc700 1 --2- 172.21.15.72:0/1861654013 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f877809f240 0x7f877806bdf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f876c00ebe0 tx=0x7f876c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:13.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.821+0000 7f875f7fe700 1 -- 172.21.15.72:0/1861654013 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c00c850 con 0x7f877809f240 2023-10-03T10:15:13.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.821+0000 7f875f7fe700 1 -- 172.21.15.72:0/1861654013 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876c00c9b0 con 0x7f877809f240 2023-10-03T10:15:13.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.821+0000 7f877d735700 1 -- 172.21.15.72:0/1861654013 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8768009550 con 0x7f877809f240 2023-10-03T10:15:13.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.821+0000 7f875f7fe700 1 -- 172.21.15.72:0/1861654013 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c00cd40 con 0x7f877809f240 2023-10-03T10:15:13.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.821+0000 7f877d735700 1 -- 172.21.15.72:0/1861654013 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87780a0190 con 0x7f877809f240 2023-10-03T10:15:13.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.821+0000 7f875f7fe700 1 -- 172.21.15.72:0/1861654013 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f876c013470 con 0x7f877809f240 2023-10-03T10:15:13.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.822+0000 7f875f7fe700 1 -- 172.21.15.72:0/1861654013 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f876c03f890 con 0x7f877809f240 2023-10-03T10:15:13.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.822+0000 7f877d735700 1 -- 172.21.15.72:0/1861654013 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87781a0b30 con 0x7f877809f240 2023-10-03T10:15:13.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.826+0000 7f875f7fe700 1 -- 172.21.15.72:0/1861654013 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f876c017020 con 0x7f877809f240 2023-10-03T10:15:13.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.970+0000 7fadbafc8700 1 -- 172.21.15.72:0/1758338143 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fadb411fa90 con 0x7fadb406b250 2023-10-03T10:15:13.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.970+0000 7fadb17fa700 1 -- 172.21.15.72:0/1758338143 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fada001ae80 con 0x7fadb406b250 2023-10-03T10:15:13.971 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:13.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.972+0000 7fadbafc8700 1 -- 172.21.15.72:0/1758338143 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb406b250 msgr2=0x7fadb41c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:13.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.972+0000 7fadbafc8700 1 --2- 172.21.15.72:0/1758338143 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb406b250 0x7fadb41c64b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fada000e9e0 tx=0x7fada000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.972+0000 7fadbafc8700 1 -- 172.21.15.72:0/1758338143 shutdown_connections 2023-10-03T10:15:13.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.972+0000 7fadbafc8700 1 --2- 172.21.15.72:0/1758338143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadb4136d80 0x7fadb41c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.972+0000 7fadbafc8700 1 --2- 172.21.15.72:0/1758338143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb406a770 0x7fadb41c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.972+0000 7fadbafc8700 1 --2- 172.21.15.72:0/1758338143 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb406b250 0x7fadb41c64b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:13.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.972+0000 7fadbafc8700 1 -- 172.21.15.72:0/1758338143 >> 172.21.15.72:0/1758338143 conn(0x7fadb4066f50 msgr2=0x7fadb40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:13.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.973+0000 7fadbafc8700 1 -- 172.21.15.72:0/1758338143 shutdown_connections 2023-10-03T10:15:13.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:13.973+0000 7fadbafc8700 1 -- 172.21.15.72:0/1758338143 wait complete. 2023-10-03T10:15:13.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:14.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.018+0000 7f877d735700 1 -- 172.21.15.72:0/1861654013 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8778071d20 con 0x7f877809f240 2023-10-03T10:15:14.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.019+0000 7f875f7fe700 1 -- 172.21.15.72:0/1861654013 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f876c02a090 con 0x7f877809f240 2023-10-03T10:15:14.019 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:14.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.020+0000 7f877d735700 1 -- 172.21.15.72:0/1861654013 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f877809f240 msgr2=0x7f877806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.020+0000 7f877d735700 1 --2- 172.21.15.72:0/1861654013 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f877809f240 0x7f877806bdf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f876c00ebe0 tx=0x7f876c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.021+0000 7f877d735700 1 -- 172.21.15.72:0/1861654013 shutdown_connections 2023-10-03T10:15:14.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.021+0000 7f877d735700 1 --2- 172.21.15.72:0/1861654013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f877809f650 0x7f877806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.021+0000 7f877d735700 1 --2- 172.21.15.72:0/1861654013 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f877809e930 0x7f877806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.021+0000 7f877d735700 1 --2- 172.21.15.72:0/1861654013 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f877809f240 0x7f877806bdf0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.021+0000 7f877d735700 1 -- 172.21.15.72:0/1861654013 >> 172.21.15.72:0/1861654013 conn(0x7f87780a4210 msgr2=0x7f87781b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.021+0000 7f877d735700 1 -- 172.21.15.72:0/1861654013 shutdown_connections 2023-10-03T10:15:14.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.021+0000 7f877d735700 1 -- 172.21.15.72:0/1861654013 wait complete. 2023-10-03T10:15:14.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:14.048 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:14.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.194+0000 7fc81e850700 1 Processor -- start 2023-10-03T10:15:14.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.194+0000 7fc81e850700 1 -- start start 2023-10-03T10:15:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.194+0000 7fc81e850700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc81809d6f0 0x7fc81809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.194+0000 7fc81e850700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc81809e000 0x7fc818130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.194+0000 7fc81e850700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81809f130 con 0x7fc81809e410 2023-10-03T10:15:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.194+0000 7fc81e850700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81809f520 con 0x7fc81809e000 2023-10-03T10:15:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.194+0000 7fc81e850700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc81809e930 con 0x7fc81809d6f0 2023-10-03T10:15:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.194+0000 7fc8177fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc81809e000 0x7fc818130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.194+0000 7fc817fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc81809d6f0 0x7fc81809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.194+0000 7fc8177fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc81809e000 0x7fc818130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55146/0 (socket says 172.21.15.72:55146) 2023-10-03T10:15:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.194+0000 7fc817fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc81809d6f0 0x7fc81809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59970/0 (socket says 172.21.15.72:59970) 2023-10-03T10:15:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.194+0000 7fc8177fe700 1 -- 172.21.15.72:0/279060240 learned_addr learned my addr 172.21.15.72:0/279060240 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:14.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.195+0000 7fc817fff700 1 -- 172.21.15.72:0/279060240 >> v2:172.21.15.72:3300/0 conn(0x7fc81809e000 msgr2=0x7fc818130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.195+0000 7fc817fff700 1 --2- 172.21.15.72:0/279060240 >> v2:172.21.15.72:3300/0 conn(0x7fc81809e000 0x7fc818130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.195+0000 7fc817fff700 1 -- 172.21.15.72:0/279060240 >> v1:172.21.15.72:6789/0 conn(0x7fc81809e410 legacy=0x7fc818130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.195+0000 7fc817fff700 1 -- 172.21.15.72:0/279060240 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81809b2d0 con 0x7fc81809d6f0 2023-10-03T10:15:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.195+0000 7fc8177fe700 1 --2- 172.21.15.72:0/279060240 >> v2:172.21.15.72:3300/0 conn(0x7fc81809e000 0x7fc818130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.195+0000 7fc817fff700 1 --2- 172.21.15.72:0/279060240 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc81809d6f0 0x7fc81809dac0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc808009840 tx=0x7fc808009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d332bdf603ecf2e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.195+0000 7fc816ffd700 1 -- 172.21.15.72:0/279060240 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808011830 con 0x7fc81809d6f0 2023-10-03T10:15:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.195+0000 7fc816ffd700 1 -- 172.21.15.72:0/279060240 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc808011990 con 0x7fc81809d6f0 2023-10-03T10:15:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.195+0000 7fc816ffd700 1 -- 172.21.15.72:0/279060240 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808011d20 con 0x7fc81809d6f0 2023-10-03T10:15:14.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.196+0000 7fc81e850700 1 -- 172.21.15.72:0/279060240 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc81809d6f0 msgr2=0x7fc81809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.196+0000 7fc81e850700 1 --2- 172.21.15.72:0/279060240 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc81809d6f0 0x7fc81809dac0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc808009840 tx=0x7fc808009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.196+0000 7fc81e850700 1 -- 172.21.15.72:0/279060240 shutdown_connections 2023-10-03T10:15:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.196+0000 7fc81e850700 1 --2- 172.21.15.72:0/279060240 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc81809d6f0 0x7fc81809dac0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.196+0000 7fc81e850700 1 --2- 172.21.15.72:0/279060240 >> v2:172.21.15.72:3300/0 conn(0x7fc81809e000 0x7fc818130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.196+0000 7fc81e850700 1 -- 172.21.15.72:0/279060240 >> 172.21.15.72:0/279060240 conn(0x7fc818066f50 msgr2=0x7fc81809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.196+0000 7fc81e850700 1 -- 172.21.15.72:0/279060240 shutdown_connections 2023-10-03T10:15:14.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.196+0000 7fc81e850700 1 -- 172.21.15.72:0/279060240 wait complete. 2023-10-03T10:15:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.197+0000 7fc81e850700 1 Processor -- start 2023-10-03T10:15:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.197+0000 7fc81e850700 1 -- start start 2023-10-03T10:15:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc81e850700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81809d6f0 0x7fc81811f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc81e850700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc81809e000 0x7fc81811f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc81e850700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc81809e410 0x7fc81811fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc81e850700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8181207d0 con 0x7fc81809d6f0 2023-10-03T10:15:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc81e850700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81809c700 con 0x7fc81809e000 2023-10-03T10:15:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc81e850700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc81806e8f0 con 0x7fc81809e410 2023-10-03T10:15:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc817fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81809d6f0 0x7fc81811f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc817fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81809d6f0 0x7fc81811f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55162/0 (socket says 172.21.15.72:55162) 2023-10-03T10:15:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc817fff700 1 -- 172.21.15.72:0/50232582 learned_addr learned my addr 172.21.15.72:0/50232582 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc81cded700 1 --2- 172.21.15.72:0/50232582 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc81809e410 0x7fc81811fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc8177fe700 1 --2- 172.21.15.72:0/50232582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc81809e000 0x7fc81811f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc817fff700 1 -- 172.21.15.72:0/50232582 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc81809e410 msgr2=0x7fc81811fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc817fff700 1 --2- 172.21.15.72:0/50232582 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc81809e410 0x7fc81811fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc817fff700 1 -- 172.21.15.72:0/50232582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc81809e000 msgr2=0x7fc81811f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc817fff700 1 --2- 172.21.15.72:0/50232582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc81809e000 0x7fc81811f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc817fff700 1 -- 172.21.15.72:0/50232582 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c009550 con 0x7fc81809d6f0 2023-10-03T10:15:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc81cded700 1 --2- 172.21.15.72:0/50232582 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc81809e410 0x7fc81811fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc817fff700 1 --2- 172.21.15.72:0/50232582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81809d6f0 0x7fc81811f370 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc8080090b0 tx=0x7fc808004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc814ff9700 1 -- 172.21.15.72:0/50232582 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8080036a0 con 0x7fc81809d6f0 2023-10-03T10:15:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc814ff9700 1 -- 172.21.15.72:0/50232582 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80801e070 con 0x7fc81809d6f0 2023-10-03T10:15:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc814ff9700 1 -- 172.21.15.72:0/50232582 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808003a40 con 0x7fc81809d6f0 2023-10-03T10:15:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc81e850700 1 -- 172.21.15.72:0/50232582 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8080094a0 con 0x7fc81809d6f0 2023-10-03T10:15:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.198+0000 7fc81e850700 1 -- 172.21.15.72:0/50232582 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8181216b0 con 0x7fc81809d6f0 2023-10-03T10:15:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.199+0000 7fc814ff9700 1 -- 172.21.15.72:0/50232582 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc808003ba0 con 0x7fc81809d6f0 2023-10-03T10:15:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.199+0000 7fc814ff9700 1 -- 172.21.15.72:0/50232582 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc808040620 con 0x7fc81809d6f0 2023-10-03T10:15:14.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.199+0000 7fc81e850700 1 -- 172.21.15.72:0/50232582 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc818074ea0 con 0x7fc81809d6f0 2023-10-03T10:15:14.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.204+0000 7fc814ff9700 1 -- 172.21.15.72:0/50232582 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc808015070 con 0x7fc81809d6f0 2023-10-03T10:15:14.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.389+0000 7fc81e850700 1 -- 172.21.15.72:0/50232582 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc8181228e0 con 0x7fc81809d6f0 2023-10-03T10:15:14.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.389+0000 7fc814ff9700 1 -- 172.21.15.72:0/50232582 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc80802d7d0 con 0x7fc81809d6f0 2023-10-03T10:15:14.390 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:14.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.391+0000 7fc81e850700 1 -- 172.21.15.72:0/50232582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81809d6f0 msgr2=0x7fc81811f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.391+0000 7fc81e850700 1 --2- 172.21.15.72:0/50232582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81809d6f0 0x7fc81811f370 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc8080090b0 tx=0x7fc808004750 comp rx=0 tx=0).stop 2023-10-03T10:15:14.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.391+0000 7fc81e850700 1 -- 172.21.15.72:0/50232582 shutdown_connections 2023-10-03T10:15:14.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.391+0000 7fc81e850700 1 --2- 172.21.15.72:0/50232582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc81809d6f0 0x7fc81811f370 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.391+0000 7fc81e850700 1 --2- 172.21.15.72:0/50232582 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc81809e410 0x7fc81811fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.391+0000 7fc81e850700 1 --2- 172.21.15.72:0/50232582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc81809e000 0x7fc81811f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.391+0000 7fc81e850700 1 -- 172.21.15.72:0/50232582 >> 172.21.15.72:0/50232582 conn(0x7fc818066f50 msgr2=0x7fc818119480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.391+0000 7fc81e850700 1 -- 172.21.15.72:0/50232582 shutdown_connections 2023-10-03T10:15:14.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.391+0000 7fc81e850700 1 -- 172.21.15.72:0/50232582 wait complete. 2023-10-03T10:15:14.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:14.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:14.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.884+0000 7f81d394f700 1 Processor -- start 2023-10-03T10:15:14.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.884+0000 7f81d394f700 1 -- start start 2023-10-03T10:15:14.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d394f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81cc09d6f0 0x7f81cc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d394f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d394f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81cc09b120 con 0x7f81cc09e000 2023-10-03T10:15:14.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d394f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81cc06b460 con 0x7f81cc09d6f0 2023-10-03T10:15:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d394f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc09a7e0 con 0x7f81cc09e440 2023-10-03T10:15:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d1eec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d16eb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81cc09d6f0 0x7f81cc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d16eb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81cc09d6f0 0x7f81cc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55178/0 (socket says 172.21.15.72:55178) 2023-10-03T10:15:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d1eec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59994/0 (socket says 172.21.15.72:59994) 2023-10-03T10:15:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d16eb700 1 -- 172.21.15.72:0/1486665005 learned_addr learned my addr 172.21.15.72:0/1486665005 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d1eec700 1 -- 172.21.15.72:0/1486665005 >> v2:172.21.15.72:3300/0 conn(0x7f81cc09d6f0 msgr2=0x7f81cc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d1eec700 1 --2- 172.21.15.72:0/1486665005 >> v2:172.21.15.72:3300/0 conn(0x7f81cc09d6f0 0x7f81cc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d1eec700 1 -- 172.21.15.72:0/1486665005 >> v1:172.21.15.72:6789/0 conn(0x7f81cc09e000 legacy=0x7f81cc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d1eec700 1 -- 172.21.15.72:0/1486665005 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc09a500 con 0x7f81cc09e440 2023-10-03T10:15:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d16eb700 1 --2- 172.21.15.72:0/1486665005 >> v2:172.21.15.72:3300/0 conn(0x7f81cc09d6f0 0x7f81cc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.885+0000 7f81d1eec700 1 --2- 172.21.15.72:0/1486665005 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc134100 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009dc0 tx=0x7f81c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba283235e152f1c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.886+0000 7f81c3fff700 1 -- 172.21.15.72:0/1486665005 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c400e070 con 0x7f81cc09e440 2023-10-03T10:15:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.886+0000 7f81c3fff700 1 -- 172.21.15.72:0/1486665005 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c400bae0 con 0x7f81cc09e440 2023-10-03T10:15:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.886+0000 7f81c3fff700 1 -- 172.21.15.72:0/1486665005 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c400be90 con 0x7f81cc09e440 2023-10-03T10:15:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.886+0000 7f81d394f700 1 -- 172.21.15.72:0/1486665005 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 msgr2=0x7f81cc134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.886+0000 7f81d394f700 1 --2- 172.21.15.72:0/1486665005 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc134100 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009dc0 tx=0x7f81c400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.886+0000 7f81d394f700 1 -- 172.21.15.72:0/1486665005 shutdown_connections 2023-10-03T10:15:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.886+0000 7f81d394f700 1 --2- 172.21.15.72:0/1486665005 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09e440 0x7f81cc134100 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.886+0000 7f81d394f700 1 --2- 172.21.15.72:0/1486665005 >> v2:172.21.15.72:3300/0 conn(0x7f81cc09d6f0 0x7f81cc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.886+0000 7f81d394f700 1 -- 172.21.15.72:0/1486665005 >> 172.21.15.72:0/1486665005 conn(0x7f81cc066f50 msgr2=0x7f81cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.886+0000 7f81d394f700 1 -- 172.21.15.72:0/1486665005 shutdown_connections 2023-10-03T10:15:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.886+0000 7f81d394f700 1 -- 172.21.15.72:0/1486665005 wait complete. 2023-10-03T10:15:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.887+0000 7f81d394f700 1 Processor -- start 2023-10-03T10:15:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.887+0000 7f81d394f700 1 -- start start 2023-10-03T10:15:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.887+0000 7f81d394f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09d6f0 0x7f81cc1a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.887+0000 7f81d394f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09e000 0x7f81cc1a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.887+0000 7f81d394f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81cc09e440 0x7f81cc1a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.887+0000 7f81d394f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc1a81f0 con 0x7f81cc09e000 2023-10-03T10:15:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.887+0000 7f81d394f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc1a6b10 con 0x7f81cc09e440 2023-10-03T10:15:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.887+0000 7f81d394f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc1a86a0 con 0x7f81cc09d6f0 2023-10-03T10:15:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81d16eb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09d6f0 0x7f81cc1a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81d0eea700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09e000 0x7f81cc1a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81d1eec700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81cc09e440 0x7f81cc1a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81d16eb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09d6f0 0x7f81cc1a4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59998/0 (socket says 172.21.15.72:59998) 2023-10-03T10:15:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81d16eb700 1 -- 172.21.15.72:0/1166196290 learned_addr learned my addr 172.21.15.72:0/1166196290 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81d0eea700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09e000 0x7f81cc1a53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55190/0 (socket says 172.21.15.72:55190) 2023-10-03T10:15:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81d0eea700 1 -- 172.21.15.72:0/1166196290 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09d6f0 msgr2=0x7f81cc1a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81d0eea700 1 --2- 172.21.15.72:0/1166196290 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09d6f0 0x7f81cc1a4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81d0eea700 1 -- 172.21.15.72:0/1166196290 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81cc09e440 msgr2=0x7f81cc1a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81d0eea700 1 --2- 172.21.15.72:0/1166196290 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81cc09e440 0x7f81cc1a58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81d0eea700 1 -- 172.21.15.72:0/1166196290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc009550 con 0x7f81cc09e000 2023-10-03T10:15:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81d1eec700 1 --2- 172.21.15.72:0/1166196290 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81cc09e440 0x7f81cc1a58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81d0eea700 1 --2- 172.21.15.72:0/1166196290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09e000 0x7f81cc1a53a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f81c8000f60 tx=0x7f81c800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81c1ffb700 1 -- 172.21.15.72:0/1166196290 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80052d0 con 0x7f81cc09e000 2023-10-03T10:15:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81c1ffb700 1 -- 172.21.15.72:0/1166196290 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c8005430 con 0x7f81cc09e000 2023-10-03T10:15:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81d394f700 1 -- 172.21.15.72:0/1166196290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c4009a70 con 0x7f81cc09e000 2023-10-03T10:15:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81c1ffb700 1 -- 172.21.15.72:0/1166196290 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80038c0 con 0x7f81cc09e000 2023-10-03T10:15:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.888+0000 7f81d394f700 1 -- 172.21.15.72:0/1166196290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81cc1a7cc0 con 0x7f81cc09e000 2023-10-03T10:15:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.889+0000 7f81c1ffb700 1 -- 172.21.15.72:0/1166196290 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81c8003a20 con 0x7f81cc09e000 2023-10-03T10:15:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.889+0000 7f81c1ffb700 1 -- 172.21.15.72:0/1166196290 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f81c803e990 con 0x7f81cc09e000 2023-10-03T10:15:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.889+0000 7f81d394f700 1 -- 172.21.15.72:0/1166196290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81cc074ea0 con 0x7f81cc09e000 2023-10-03T10:15:14.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:14.894+0000 7f81c1ffb700 1 -- 172.21.15.72:0/1166196290 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81c8017080 con 0x7f81cc09e000 2023-10-03T10:15:14.986 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:15.034 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:15.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.086+0000 7f81d394f700 1 -- 172.21.15.72:0/1166196290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f81cc09f420 con 0x7f81cc09e000 2023-10-03T10:15:15.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.086+0000 7f81c1ffb700 1 -- 172.21.15.72:0/1166196290 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f81c8011590 con 0x7f81cc09e000 2023-10-03T10:15:15.087 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:15.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.088+0000 7f81d394f700 1 -- 172.21.15.72:0/1166196290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09e000 msgr2=0x7f81cc1a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.088+0000 7f81d394f700 1 --2- 172.21.15.72:0/1166196290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09e000 0x7f81cc1a53a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f81c8000f60 tx=0x7f81c800c730 comp rx=0 tx=0).stop 2023-10-03T10:15:15.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.088+0000 7f81d394f700 1 -- 172.21.15.72:0/1166196290 shutdown_connections 2023-10-03T10:15:15.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.088+0000 7f81d394f700 1 --2- 172.21.15.72:0/1166196290 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81cc09e440 0x7f81cc1a58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.088+0000 7f81d394f700 1 --2- 172.21.15.72:0/1166196290 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81cc09d6f0 0x7f81cc1a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.088+0000 7f81d394f700 1 --2- 172.21.15.72:0/1166196290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81cc09e000 0x7f81cc1a53a0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.088+0000 7f81d394f700 1 -- 172.21.15.72:0/1166196290 >> 172.21.15.72:0/1166196290 conn(0x7f81cc066f50 msgr2=0x7f81cc1b9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.088+0000 7f81d394f700 1 -- 172.21.15.72:0/1166196290 shutdown_connections 2023-10-03T10:15:15.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.088+0000 7f81d394f700 1 -- 172.21.15.72:0/1166196290 wait complete. 2023-10-03T10:15:15.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:15.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.115+0000 7f76d96c9700 1 Processor -- start 2023-10-03T10:15:15.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.115+0000 7f76d96c9700 1 -- start start 2023-10-03T10:15:15.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d96c9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d40a0a30 0x7f76d40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d96c9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76d409d630 0x7f76d40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d96c9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76d4133930 0x7f76d4133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d96c9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d40a2a70 con 0x7f76d4133930 2023-10-03T10:15:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d96c9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d40a01d0 con 0x7f76d40a0a30 2023-10-03T10:15:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d96c9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76d409e2b0 con 0x7f76d409d630 2023-10-03T10:15:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d40a0a30 0x7f76d40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76d4133930 0x7f76d4133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d40a0a30 0x7f76d40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44396/0 (socket says 172.21.15.72:44396) 2023-10-03T10:15:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76d409d630 0x7f76d40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d2ffd700 1 -- 172.21.15.72:0/1581335365 learned_addr learned my addr 172.21.15.72:0/1581335365 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d2ffd700 1 -- 172.21.15.72:0/1581335365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76d409d630 msgr2=0x7f76d40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d2ffd700 1 --2- 172.21.15.72:0/1581335365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76d409d630 0x7f76d40a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d2ffd700 1 -- 172.21.15.72:0/1581335365 >> v2:172.21.15.72:3300/0 conn(0x7f76d4133930 msgr2=0x7f76d4133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d2ffd700 1 --2- 172.21.15.72:0/1581335365 >> v2:172.21.15.72:3300/0 conn(0x7f76d4133930 0x7f76d4133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d2ffd700 1 -- 172.21.15.72:0/1581335365 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d409dc50 con 0x7f76d40a0a30 2023-10-03T10:15:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d37fe700 1 --2- 172.21.15.72:0/1581335365 >> v2:172.21.15.72:3300/0 conn(0x7f76d4133930 0x7f76d4133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.116+0000 7f76d2ffd700 1 --2- 172.21.15.72:0/1581335365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d40a0a30 0x7f76d40a0e00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f76c40098f0 tx=0x7f76c4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a00c88dc2daad4f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.117+0000 7f76d1ffb700 1 -- 172.21.15.72:0/1581335365 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4011830 con 0x7f76d40a0a30 2023-10-03T10:15:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.117+0000 7f76d1ffb700 1 -- 172.21.15.72:0/1581335365 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c4011990 con 0x7f76d40a0a30 2023-10-03T10:15:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.117+0000 7f76d1ffb700 1 -- 172.21.15.72:0/1581335365 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4011d20 con 0x7f76d40a0a30 2023-10-03T10:15:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.117+0000 7f76d96c9700 1 -- 172.21.15.72:0/1581335365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d40a0a30 msgr2=0x7f76d40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.117+0000 7f76d96c9700 1 --2- 172.21.15.72:0/1581335365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d40a0a30 0x7f76d40a0e00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f76c40098f0 tx=0x7f76c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:15.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.117+0000 7f76d96c9700 1 -- 172.21.15.72:0/1581335365 shutdown_connections 2023-10-03T10:15:15.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.117+0000 7f76d96c9700 1 --2- 172.21.15.72:0/1581335365 >> v2:172.21.15.72:3300/0 conn(0x7f76d4133930 0x7f76d4133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.117+0000 7f76d96c9700 1 --2- 172.21.15.72:0/1581335365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d40a0a30 0x7f76d40a0e00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.117+0000 7f76d96c9700 1 --2- 172.21.15.72:0/1581335365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76d409d630 0x7f76d40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.117+0000 7f76d96c9700 1 -- 172.21.15.72:0/1581335365 >> 172.21.15.72:0/1581335365 conn(0x7f76d40a3050 msgr2=0x7f76d40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.117+0000 7f76d96c9700 1 -- 172.21.15.72:0/1581335365 shutdown_connections 2023-10-03T10:15:15.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.117+0000 7f76d96c9700 1 -- 172.21.15.72:0/1581335365 wait complete. 2023-10-03T10:15:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.119+0000 7f76d96c9700 1 Processor -- start 2023-10-03T10:15:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.119+0000 7f76d96c9700 1 -- start start 2023-10-03T10:15:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.119+0000 7f76d96c9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d409d630 0x7f76d411f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.119+0000 7f76d96c9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76d40a0a30 0x7f76d41c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.119+0000 7f76d96c9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76d4133930 0x7f76d41c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.119+0000 7f76d96c9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d4121310 con 0x7f76d4133930 2023-10-03T10:15:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.119+0000 7f76d96c9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d4133320 con 0x7f76d409d630 2023-10-03T10:15:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.119+0000 7f76d96c9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76d4121f10 con 0x7f76d40a0a30 2023-10-03T10:15:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.119+0000 7f76d2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d409d630 0x7f76d411f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.119+0000 7f76d37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76d4133930 0x7f76d41c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.119+0000 7f76d2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d409d630 0x7f76d411f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44408/0 (socket says 172.21.15.72:44408) 2023-10-03T10:15:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.119+0000 7f76d2ffd700 1 -- 172.21.15.72:0/3607747220 learned_addr learned my addr 172.21.15.72:0/3607747220 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.119+0000 7f76d27fc700 1 --2- 172.21.15.72:0/3607747220 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76d40a0a30 0x7f76d41c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.120+0000 7f76d2ffd700 1 -- 172.21.15.72:0/3607747220 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76d40a0a30 msgr2=0x7f76d41c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.120+0000 7f76d2ffd700 1 --2- 172.21.15.72:0/3607747220 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76d40a0a30 0x7f76d41c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.120+0000 7f76d2ffd700 1 -- 172.21.15.72:0/3607747220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76d4133930 msgr2=0x7f76d41c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.120+0000 7f76d2ffd700 1 --2- 172.21.15.72:0/3607747220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76d4133930 0x7f76d41c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.120+0000 7f76d2ffd700 1 -- 172.21.15.72:0/3607747220 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc009a70 con 0x7f76d409d630 2023-10-03T10:15:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.120+0000 7f76d37fe700 1 --2- 172.21.15.72:0/3607747220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76d4133930 0x7f76d41c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.120+0000 7f76d2ffd700 1 --2- 172.21.15.72:0/3607747220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d409d630 0x7f76d411f610 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f76c4000c00 tx=0x7f76c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.120+0000 7f76bb7fe700 1 -- 172.21.15.72:0/3607747220 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4004450 con 0x7f76d409d630 2023-10-03T10:15:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.120+0000 7f76bb7fe700 1 -- 172.21.15.72:0/3607747220 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c40045b0 con 0x7f76d409d630 2023-10-03T10:15:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.120+0000 7f76d96c9700 1 -- 172.21.15.72:0/3607747220 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c4009550 con 0x7f76d409d630 2023-10-03T10:15:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.120+0000 7f76bb7fe700 1 -- 172.21.15.72:0/3607747220 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c40038c0 con 0x7f76d409d630 2023-10-03T10:15:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.120+0000 7f76d96c9700 1 -- 172.21.15.72:0/3607747220 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d41221d0 con 0x7f76d409d630 2023-10-03T10:15:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.121+0000 7f76bb7fe700 1 -- 172.21.15.72:0/3607747220 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f76c4021070 con 0x7f76d409d630 2023-10-03T10:15:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.121+0000 7f76d96c9700 1 -- 172.21.15.72:0/3607747220 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d40747f0 con 0x7f76d409d630 2023-10-03T10:15:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.121+0000 7f76bb7fe700 1 -- 172.21.15.72:0/3607747220 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f76c40407e0 con 0x7f76d409d630 2023-10-03T10:15:15.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.126+0000 7f76bb7fe700 1 -- 172.21.15.72:0/3607747220 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76c400b9d0 con 0x7f76d409d630 2023-10-03T10:15:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.171+0000 7fd634b98700 1 Processor -- start 2023-10-03T10:15:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.171+0000 7fd634b98700 1 -- start start 2023-10-03T10:15:15.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.171+0000 7fd634b98700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd63009d630 0x7fd6300a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.171+0000 7fd634b98700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd630138d80 0x7fd63013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.171+0000 7fd634b98700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6300a2a70 con 0x7fd6300a0a30 2023-10-03T10:15:15.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.171+0000 7fd634b98700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6300a01d0 con 0x7fd630138d80 2023-10-03T10:15:15.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.171+0000 7fd634b98700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63009e2b0 con 0x7fd63009d630 2023-10-03T10:15:15.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.171+0000 7fd62dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd63009d630 0x7fd6300a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.171+0000 7fd62ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd630138d80 0x7fd63013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.171+0000 7fd62dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd63009d630 0x7fd6300a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44414/0 (socket says 172.21.15.72:44414) 2023-10-03T10:15:15.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.171+0000 7fd62dd9b700 1 -- 172.21.15.72:0/1531205834 learned_addr learned my addr 172.21.15.72:0/1531205834 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.172+0000 7fd62dd9b700 1 -- 172.21.15.72:0/1531205834 >> v2:172.21.15.72:3300/0 conn(0x7fd630138d80 msgr2=0x7fd63013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.172+0000 7fd62dd9b700 1 --2- 172.21.15.72:0/1531205834 >> v2:172.21.15.72:3300/0 conn(0x7fd630138d80 0x7fd63013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.172+0000 7fd62dd9b700 1 -- 172.21.15.72:0/1531205834 >> v1:172.21.15.72:6789/0 conn(0x7fd6300a0a30 legacy=0x7fd6300a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.172+0000 7fd62dd9b700 1 -- 172.21.15.72:0/1531205834 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63009dc50 con 0x7fd63009d630 2023-10-03T10:15:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.172+0000 7fd62ed9d700 1 --2- 172.21.15.72:0/1531205834 >> v2:172.21.15.72:3300/0 conn(0x7fd630138d80 0x7fd63013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.172+0000 7fd62dd9b700 1 --2- 172.21.15.72:0/1531205834 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd63009d630 0x7fd6300a1510 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd6240098f0 tx=0x7fd624009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4e2c73b358484f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.172+0000 7fd62d59a700 1 -- 172.21.15.72:0/1531205834 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624011830 con 0x7fd63009d630 2023-10-03T10:15:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.172+0000 7fd62d59a700 1 -- 172.21.15.72:0/1531205834 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd624011990 con 0x7fd63009d630 2023-10-03T10:15:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.172+0000 7fd62d59a700 1 -- 172.21.15.72:0/1531205834 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624011d20 con 0x7fd63009d630 2023-10-03T10:15:15.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.173+0000 7fd634b98700 1 -- 172.21.15.72:0/1531205834 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd63009d630 msgr2=0x7fd6300a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.173+0000 7fd634b98700 1 --2- 172.21.15.72:0/1531205834 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd63009d630 0x7fd6300a1510 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd6240098f0 tx=0x7fd624009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:15.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.173+0000 7fd634b98700 1 -- 172.21.15.72:0/1531205834 shutdown_connections 2023-10-03T10:15:15.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.173+0000 7fd634b98700 1 --2- 172.21.15.72:0/1531205834 >> v2:172.21.15.72:3300/0 conn(0x7fd630138d80 0x7fd63013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.173+0000 7fd634b98700 1 --2- 172.21.15.72:0/1531205834 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd63009d630 0x7fd6300a1510 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.173+0000 7fd634b98700 1 -- 172.21.15.72:0/1531205834 >> 172.21.15.72:0/1531205834 conn(0x7fd6300a3050 msgr2=0x7fd6300a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.173+0000 7fd634b98700 1 -- 172.21.15.72:0/1531205834 shutdown_connections 2023-10-03T10:15:15.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.173+0000 7fd634b98700 1 -- 172.21.15.72:0/1531205834 wait complete. 2023-10-03T10:15:15.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.174+0000 7fd634b98700 1 Processor -- start 2023-10-03T10:15:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.174+0000 7fd634b98700 1 -- start start 2023-10-03T10:15:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.174+0000 7fd634b98700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd63009d630 0x7fd630133b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.174+0000 7fd634b98700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6300a0a30 0x7fd630134090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.174+0000 7fd634b98700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd630138d80 0x7fd6301345d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.174+0000 7fd634b98700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd630135010 con 0x7fd630138d80 2023-10-03T10:15:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.174+0000 7fd634b98700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63013afc0 con 0x7fd63009d630 2023-10-03T10:15:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.174+0000 7fd634b98700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd630135c30 con 0x7fd6300a0a30 2023-10-03T10:15:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.174+0000 7fd62dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6300a0a30 0x7fd630134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.174+0000 7fd62e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd63009d630 0x7fd630133b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.174+0000 7fd62dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6300a0a30 0x7fd630134090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60026/0 (socket says 172.21.15.72:60026) 2023-10-03T10:15:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.174+0000 7fd62dd9b700 1 -- 172.21.15.72:0/600583739 learned_addr learned my addr 172.21.15.72:0/600583739 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:15.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.174+0000 7fd62ed9d700 1 --2- 172.21.15.72:0/600583739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd630138d80 0x7fd6301345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.175+0000 7fd62dd9b700 1 -- 172.21.15.72:0/600583739 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd63009d630 msgr2=0x7fd630133b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.175+0000 7fd62dd9b700 1 --2- 172.21.15.72:0/600583739 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd63009d630 0x7fd630133b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.175+0000 7fd62dd9b700 1 -- 172.21.15.72:0/600583739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd630138d80 msgr2=0x7fd6301345d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.175+0000 7fd62dd9b700 1 --2- 172.21.15.72:0/600583739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd630138d80 0x7fd6301345d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.175+0000 7fd62dd9b700 1 -- 172.21.15.72:0/600583739 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd628009a70 con 0x7fd6300a0a30 2023-10-03T10:15:15.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.175+0000 7fd62ed9d700 1 --2- 172.21.15.72:0/600583739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd630138d80 0x7fd6301345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:15.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.175+0000 7fd62dd9b700 1 --2- 172.21.15.72:0/600583739 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6300a0a30 0x7fd630134090 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd624009c40 tx=0x7fd624004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.175+0000 7fd61effd700 1 -- 172.21.15.72:0/600583739 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6240036a0 con 0x7fd6300a0a30 2023-10-03T10:15:15.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.175+0000 7fd61effd700 1 -- 172.21.15.72:0/600583739 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd624003800 con 0x7fd6300a0a30 2023-10-03T10:15:15.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.175+0000 7fd634b98700 1 -- 172.21.15.72:0/600583739 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd624009550 con 0x7fd6300a0a30 2023-10-03T10:15:15.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.175+0000 7fd61effd700 1 -- 172.21.15.72:0/600583739 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624003b90 con 0x7fd6300a0a30 2023-10-03T10:15:15.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.175+0000 7fd634b98700 1 -- 172.21.15.72:0/600583739 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd630137590 con 0x7fd6300a0a30 2023-10-03T10:15:15.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.176+0000 7fd634b98700 1 -- 172.21.15.72:0/600583739 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6300747f0 con 0x7fd6300a0a30 2023-10-03T10:15:15.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.176+0000 7fd61effd700 1 -- 172.21.15.72:0/600583739 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd624021070 con 0x7fd6300a0a30 2023-10-03T10:15:15.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.177+0000 7fd61effd700 1 -- 172.21.15.72:0/600583739 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd624040f80 con 0x7fd6300a0a30 2023-10-03T10:15:15.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.185+0000 7fd61effd700 1 -- 172.21.15.72:0/600583739 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd624010380 con 0x7fd6300a0a30 2023-10-03T10:15:15.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.334+0000 7f76d96c9700 1 -- 172.21.15.72:0/3607747220 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f76d4133710 con 0x7f76d409d630 2023-10-03T10:15:15.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.335+0000 7f76bb7fe700 1 -- 172.21.15.72:0/3607747220 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f76c4015020 con 0x7f76d409d630 2023-10-03T10:15:15.336 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:15.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.337+0000 7f76d96c9700 1 -- 172.21.15.72:0/3607747220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d409d630 msgr2=0x7f76d411f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.337+0000 7f76d96c9700 1 --2- 172.21.15.72:0/3607747220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d409d630 0x7f76d411f610 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f76c4000c00 tx=0x7f76c4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:15.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.337+0000 7f76d96c9700 1 -- 172.21.15.72:0/3607747220 shutdown_connections 2023-10-03T10:15:15.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.337+0000 7f76d96c9700 1 --2- 172.21.15.72:0/3607747220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76d4133930 0x7f76d41c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.337+0000 7f76d96c9700 1 --2- 172.21.15.72:0/3607747220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76d409d630 0x7f76d411f610 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.337+0000 7f76d96c9700 1 --2- 172.21.15.72:0/3607747220 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76d40a0a30 0x7f76d41c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.337+0000 7f76d96c9700 1 -- 172.21.15.72:0/3607747220 >> 172.21.15.72:0/3607747220 conn(0x7f76d40a3050 msgr2=0x7f76d41bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.337+0000 7f76d96c9700 1 -- 172.21.15.72:0/3607747220 shutdown_connections 2023-10-03T10:15:15.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.337+0000 7f76d96c9700 1 -- 172.21.15.72:0/3607747220 wait complete. 2023-10-03T10:15:15.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:15.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.379+0000 7fd634b98700 1 -- 172.21.15.72:0/600583739 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd630072980 con 0x7fd6300a0a30 2023-10-03T10:15:15.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.380+0000 7fd61effd700 1 -- 172.21.15.72:0/600583739 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd624015030 con 0x7fd6300a0a30 2023-10-03T10:15:15.380 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:15.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.382+0000 7fd634b98700 1 -- 172.21.15.72:0/600583739 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6300a0a30 msgr2=0x7fd630134090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.382+0000 7fd634b98700 1 --2- 172.21.15.72:0/600583739 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6300a0a30 0x7fd630134090 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd624009c40 tx=0x7fd624004750 comp rx=0 tx=0).stop 2023-10-03T10:15:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.382+0000 7fd634b98700 1 -- 172.21.15.72:0/600583739 shutdown_connections 2023-10-03T10:15:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.382+0000 7fd634b98700 1 --2- 172.21.15.72:0/600583739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd630138d80 0x7fd6301345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.382+0000 7fd634b98700 1 --2- 172.21.15.72:0/600583739 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd63009d630 0x7fd630133b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.382+0000 7fd634b98700 1 --2- 172.21.15.72:0/600583739 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6300a0a30 0x7fd630134090 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.382+0000 7fd634b98700 1 -- 172.21.15.72:0/600583739 >> 172.21.15.72:0/600583739 conn(0x7fd6300a3050 msgr2=0x7fd63009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.382+0000 7fd634b98700 1 -- 172.21.15.72:0/600583739 shutdown_connections 2023-10-03T10:15:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.382+0000 7fd634b98700 1 -- 172.21.15.72:0/600583739 wait complete. 2023-10-03T10:15:15.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:15.404 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:15.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.558+0000 7f465d283700 1 Processor -- start 2023-10-03T10:15:15.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.558+0000 7f465d283700 1 -- start start 2023-10-03T10:15:15.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.558+0000 7f465d283700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46580a09c0 0x7f46580a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.558+0000 7f465d283700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f46580a12d0 0x7f4658134030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.558+0000 7f465d283700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465809ea10 con 0x7f465809d5c0 2023-10-03T10:15:15.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.558+0000 7f465d283700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465809e210 con 0x7f46580a09c0 2023-10-03T10:15:15.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.558+0000 7f465d283700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46580a26f0 con 0x7f46580a12d0 2023-10-03T10:15:15.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.559+0000 7f46577fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f46580a12d0 0x7f4658134030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.559+0000 7f4656ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46580a09c0 0x7f46580a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.559+0000 7f46567fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f465809d5c0 0x7f4658133920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59730/0 (socket says 172.21.15.72:59730) 2023-10-03T10:15:15.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.559+0000 7f46567fc700 1 -- 172.21.15.72:0/4178722560 learned_addr learned my addr 172.21.15.72:0/4178722560 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:15.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.559+0000 7f4655ffb700 1 -- 172.21.15.72:0/4178722560 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946118246 0 0) 0x7f465809ea10 con 0x7f465809d5c0 2023-10-03T10:15:15.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.559+0000 7f4656ffd700 1 -- 172.21.15.72:0/4178722560 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f46580a12d0 msgr2=0x7f4658134030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.559+0000 7f4656ffd700 1 --2- 172.21.15.72:0/4178722560 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f46580a12d0 0x7f4658134030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.559+0000 7f4656ffd700 1 -- 172.21.15.72:0/4178722560 >> v1:172.21.15.72:6789/0 conn(0x7f465809d5c0 legacy=0x7f4658133920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.559+0000 7f4656ffd700 1 -- 172.21.15.72:0/4178722560 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465809db70 con 0x7f46580a09c0 2023-10-03T10:15:15.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.559+0000 7f46577fe700 1 --2- 172.21.15.72:0/4178722560 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f46580a12d0 0x7f4658134030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.559+0000 7f4656ffd700 1 --2- 172.21.15.72:0/4178722560 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46580a09c0 0x7f46580a0d90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f464c009870 tx=0x7f464c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48a7d708638ed315 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.559+0000 7f4655ffb700 1 -- 172.21.15.72:0/4178722560 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c011830 con 0x7f46580a09c0 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.559+0000 7f4655ffb700 1 -- 172.21.15.72:0/4178722560 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c011990 con 0x7f46580a09c0 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.559+0000 7f4655ffb700 1 -- 172.21.15.72:0/4178722560 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c011d20 con 0x7f46580a09c0 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.560+0000 7f465d283700 1 -- 172.21.15.72:0/4178722560 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46580a09c0 msgr2=0x7f46580a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.560+0000 7f465d283700 1 --2- 172.21.15.72:0/4178722560 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46580a09c0 0x7f46580a0d90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f464c009870 tx=0x7f464c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.560+0000 7f465d283700 1 -- 172.21.15.72:0/4178722560 shutdown_connections 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.560+0000 7f465d283700 1 --2- 172.21.15.72:0/4178722560 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f46580a12d0 0x7f4658134030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.560+0000 7f465d283700 1 --2- 172.21.15.72:0/4178722560 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46580a09c0 0x7f46580a0d90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.560+0000 7f465d283700 1 -- 172.21.15.72:0/4178722560 >> 172.21.15.72:0/4178722560 conn(0x7f46580a2fe0 msgr2=0x7f46580a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.560+0000 7f465d283700 1 -- 172.21.15.72:0/4178722560 shutdown_connections 2023-10-03T10:15:15.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.560+0000 7f465d283700 1 -- 172.21.15.72:0/4178722560 wait complete. 2023-10-03T10:15:15.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.561+0000 7f465d283700 1 Processor -- start 2023-10-03T10:15:15.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.561+0000 7f465d283700 1 -- start start 2023-10-03T10:15:15.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f465d283700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f465809d5c0 0x7f465811f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f465d283700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46580a09c0 0x7f465811f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f465d283700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46580a12d0 0x7f46581c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f465d283700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4658122340 con 0x7f46580a12d0 2023-10-03T10:15:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f465d283700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4658122520 con 0x7f46580a09c0 2023-10-03T10:15:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f465d283700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4658133390 con 0x7f465809d5c0 2023-10-03T10:15:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f4656ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f465809d5c0 0x7f465811f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f46567fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46580a09c0 0x7f465811f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f4656ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f465809d5c0 0x7f465811f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60042/0 (socket says 172.21.15.72:60042) 2023-10-03T10:15:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f4656ffd700 1 -- 172.21.15.72:0/2302185349 learned_addr learned my addr 172.21.15.72:0/2302185349 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:15.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f46577fe700 1 --2- 172.21.15.72:0/2302185349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46580a12d0 0x7f46581c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f4656ffd700 1 -- 172.21.15.72:0/2302185349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46580a09c0 msgr2=0x7f465811f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f4656ffd700 1 --2- 172.21.15.72:0/2302185349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46580a09c0 0x7f465811f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f4656ffd700 1 -- 172.21.15.72:0/2302185349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46580a12d0 msgr2=0x7f46581c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f4656ffd700 1 --2- 172.21.15.72:0/2302185349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46580a12d0 0x7f46581c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f4656ffd700 1 -- 172.21.15.72:0/2302185349 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4650009a70 con 0x7f465809d5c0 2023-10-03T10:15:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f4656ffd700 1 --2- 172.21.15.72:0/2302185349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f465809d5c0 0x7f465811f3d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f464c0090b0 tx=0x7f464c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.562+0000 7f463f7fe700 1 -- 172.21.15.72:0/2302185349 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c0044d0 con 0x7f465809d5c0 2023-10-03T10:15:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.563+0000 7f463f7fe700 1 -- 172.21.15.72:0/2302185349 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c01f070 con 0x7f465809d5c0 2023-10-03T10:15:15.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.563+0000 7f465d283700 1 -- 172.21.15.72:0/2302185349 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464c0094a0 con 0x7f465809d5c0 2023-10-03T10:15:15.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.563+0000 7f463f7fe700 1 -- 172.21.15.72:0/2302185349 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c0038e0 con 0x7f465809d5c0 2023-10-03T10:15:15.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.563+0000 7f465d283700 1 -- 172.21.15.72:0/2302185349 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465809c3d0 con 0x7f465809d5c0 2023-10-03T10:15:15.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.563+0000 7f463f7fe700 1 -- 172.21.15.72:0/2302185349 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f464c003a40 con 0x7f465809d5c0 2023-10-03T10:15:15.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.563+0000 7f463f7fe700 1 -- 172.21.15.72:0/2302185349 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f464c021070 con 0x7f465809d5c0 2023-10-03T10:15:15.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.563+0000 7f465d283700 1 -- 172.21.15.72:0/2302185349 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465811eee0 con 0x7f465809d5c0 2023-10-03T10:15:15.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.568+0000 7f463f7fe700 1 -- 172.21.15.72:0/2302185349 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f464c015020 con 0x7f465809d5c0 2023-10-03T10:15:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.754+0000 7f465d283700 1 -- 172.21.15.72:0/2302185349 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f46580747f0 con 0x7f465809d5c0 2023-10-03T10:15:15.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.754+0000 7f463f7fe700 1 -- 172.21.15.72:0/2302185349 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f464c010380 con 0x7f465809d5c0 2023-10-03T10:15:15.755 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.756+0000 7f465d283700 1 -- 172.21.15.72:0/2302185349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f465809d5c0 msgr2=0x7f465811f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.756+0000 7f465d283700 1 --2- 172.21.15.72:0/2302185349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f465809d5c0 0x7f465811f3d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f464c0090b0 tx=0x7f464c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.756+0000 7f465d283700 1 -- 172.21.15.72:0/2302185349 shutdown_connections 2023-10-03T10:15:15.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.756+0000 7f465d283700 1 --2- 172.21.15.72:0/2302185349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46580a12d0 0x7f46581c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.756+0000 7f465d283700 1 --2- 172.21.15.72:0/2302185349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f465809d5c0 0x7f465811f3d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.756+0000 7f465d283700 1 --2- 172.21.15.72:0/2302185349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46580a09c0 0x7f465811f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.756+0000 7f465d283700 1 -- 172.21.15.72:0/2302185349 >> 172.21.15.72:0/2302185349 conn(0x7f46580a2fe0 msgr2=0x7f46581bbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.756+0000 7f465d283700 1 -- 172.21.15.72:0/2302185349 shutdown_connections 2023-10-03T10:15:15.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:15.756+0000 7f465d283700 1 -- 172.21.15.72:0/2302185349 wait complete. 2023-10-03T10:15:15.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:16.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:16.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.224+0000 7f5375d3b700 1 Processor -- start 2023-10-03T10:15:16.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.224+0000 7f5375d3b700 1 -- start start 2023-10-03T10:15:16.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f5375d3b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f537009d6f0 0x7f537009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f5375d3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f537009e000 0x7f53701339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f5375d3b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f537009e410 0x7f5370133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f5375d3b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537006b460 con 0x7f537009d6f0 2023-10-03T10:15:16.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f5375d3b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537009b120 con 0x7f537009e000 2023-10-03T10:15:16.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f5375d3b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f537009a7e0 con 0x7f537009e410 2023-10-03T10:15:16.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f537009d6f0 0x7f537009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f537009e410 0x7f5370133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f537009e000 0x7f53701339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f537009e410 0x7f5370133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60054/0 (socket says 172.21.15.72:60054) 2023-10-03T10:15:16.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f537009d6f0 0x7f537009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55268/0 (socket says 172.21.15.72:55268) 2023-10-03T10:15:16.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f537009e000 0x7f53701339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44446/0 (socket says 172.21.15.72:44446) 2023-10-03T10:15:16.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536ffff700 1 -- 172.21.15.72:0/4252337916 learned_addr learned my addr 172.21.15.72:0/4252337916 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:16.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536f7fe700 1 -- 172.21.15.72:0/4252337916 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f537009e410 msgr2=0x7f5370133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536f7fe700 1 --2- 172.21.15.72:0/4252337916 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f537009e410 0x7f5370133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536f7fe700 1 -- 172.21.15.72:0/4252337916 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f537009e000 msgr2=0x7f53701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536f7fe700 1 --2- 172.21.15.72:0/4252337916 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f537009e000 0x7f53701339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536f7fe700 1 -- 172.21.15.72:0/4252337916 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537009a500 con 0x7f537009d6f0 2023-10-03T10:15:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536ffff700 1 --2- 172.21.15.72:0/4252337916 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f537009e410 0x7f5370133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536f7fe700 1 --2- 172.21.15.72:0/4252337916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f537009d6f0 0x7f537009dac0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5358009840 tx=0x7f5358009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6faf5a1003c7f36e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536e7fc700 1 -- 172.21.15.72:0/4252337916 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358011830 con 0x7f537009d6f0 2023-10-03T10:15:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536e7fc700 1 -- 172.21.15.72:0/4252337916 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5358011990 con 0x7f537009d6f0 2023-10-03T10:15:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.225+0000 7f536e7fc700 1 -- 172.21.15.72:0/4252337916 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358011d20 con 0x7f537009d6f0 2023-10-03T10:15:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.226+0000 7f5375d3b700 1 -- 172.21.15.72:0/4252337916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f537009d6f0 msgr2=0x7f537009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.226+0000 7f5375d3b700 1 --2- 172.21.15.72:0/4252337916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f537009d6f0 0x7f537009dac0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5358009840 tx=0x7f5358009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:16.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.226+0000 7f5375d3b700 1 -- 172.21.15.72:0/4252337916 shutdown_connections 2023-10-03T10:15:16.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.226+0000 7f5375d3b700 1 --2- 172.21.15.72:0/4252337916 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f537009e410 0x7f5370133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.226+0000 7f5375d3b700 1 --2- 172.21.15.72:0/4252337916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f537009d6f0 0x7f537009dac0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.226+0000 7f5375d3b700 1 --2- 172.21.15.72:0/4252337916 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f537009e000 0x7f53701339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.226+0000 7f5375d3b700 1 -- 172.21.15.72:0/4252337916 >> 172.21.15.72:0/4252337916 conn(0x7f5370066f50 msgr2=0x7f537009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.226+0000 7f5375d3b700 1 -- 172.21.15.72:0/4252337916 shutdown_connections 2023-10-03T10:15:16.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.226+0000 7f5375d3b700 1 -- 172.21.15.72:0/4252337916 wait complete. 2023-10-03T10:15:16.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.227+0000 7f5375d3b700 1 Processor -- start 2023-10-03T10:15:16.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.228+0000 7f5375d3b700 1 -- start start 2023-10-03T10:15:16.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.228+0000 7f5375d3b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f537009d6f0 0x7f53701c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.228+0000 7f5375d3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f537009e000 0x7f53701c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.228+0000 7f5375d3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f537009e410 0x7f53701c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.228+0000 7f5375d3b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53701a7190 con 0x7f537009e410 2023-10-03T10:15:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.228+0000 7f5375d3b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53701b9320 con 0x7f537009e000 2023-10-03T10:15:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.228+0000 7f5375d3b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53701a6520 con 0x7f537009d6f0 2023-10-03T10:15:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.228+0000 7f536f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f537009d6f0 0x7f53701c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.228+0000 7f536effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f537009e000 0x7f53701c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.228+0000 7f536f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f537009d6f0 0x7f53701c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60064/0 (socket says 172.21.15.72:60064) 2023-10-03T10:15:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.228+0000 7f536effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f537009e000 0x7f53701c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44460/0 (socket says 172.21.15.72:44460) 2023-10-03T10:15:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.228+0000 7f536f7fe700 1 -- 172.21.15.72:0/1695819728 learned_addr learned my addr 172.21.15.72:0/1695819728 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.228+0000 7f536ffff700 1 --2- 172.21.15.72:0/1695819728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f537009e410 0x7f53701c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.229+0000 7f536f7fe700 1 -- 172.21.15.72:0/1695819728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f537009e000 msgr2=0x7f53701c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.229+0000 7f536f7fe700 1 --2- 172.21.15.72:0/1695819728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f537009e000 0x7f53701c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.229+0000 7f536f7fe700 1 -- 172.21.15.72:0/1695819728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f537009e410 msgr2=0x7f53701c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.229+0000 7f536f7fe700 1 --2- 172.21.15.72:0/1695819728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f537009e410 0x7f53701c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.229+0000 7f536f7fe700 1 -- 172.21.15.72:0/1695819728 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5368009b30 con 0x7f537009d6f0 2023-10-03T10:15:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.229+0000 7f536ffff700 1 --2- 172.21.15.72:0/1695819728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f537009e410 0x7f53701c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.229+0000 7f536f7fe700 1 --2- 172.21.15.72:0/1695819728 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f537009d6f0 0x7f53701c80b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5358009fd0 tx=0x7f5358004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.229+0000 7f5367fff700 1 -- 172.21.15.72:0/1695819728 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358004450 con 0x7f537009d6f0 2023-10-03T10:15:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.229+0000 7f5367fff700 1 -- 172.21.15.72:0/1695819728 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535801f070 con 0x7f537009d6f0 2023-10-03T10:15:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.229+0000 7f5375d3b700 1 -- 172.21.15.72:0/1695819728 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53580094a0 con 0x7f537009d6f0 2023-10-03T10:15:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.229+0000 7f5367fff700 1 -- 172.21.15.72:0/1695819728 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53580038e0 con 0x7f537009d6f0 2023-10-03T10:15:16.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.229+0000 7f5375d3b700 1 -- 172.21.15.72:0/1695819728 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53701a7d10 con 0x7f537009d6f0 2023-10-03T10:15:16.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.230+0000 7f5367fff700 1 -- 172.21.15.72:0/1695819728 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5358003a40 con 0x7f537009d6f0 2023-10-03T10:15:16.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.230+0000 7f5367fff700 1 -- 172.21.15.72:0/1695819728 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5358021070 con 0x7f537009d6f0 2023-10-03T10:15:16.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.230+0000 7f5375d3b700 1 -- 172.21.15.72:0/1695819728 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5370074ea0 con 0x7f537009d6f0 2023-10-03T10:15:16.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.235+0000 7f5367fff700 1 -- 172.21.15.72:0/1695819728 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f535801a430 con 0x7f537009d6f0 2023-10-03T10:15:16.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:16.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:16.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.432+0000 7f5375d3b700 1 -- 172.21.15.72:0/1695819728 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f537006c360 con 0x7f537009d6f0 2023-10-03T10:15:16.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.432+0000 7f5367fff700 1 -- 172.21.15.72:0/1695819728 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f535802b030 con 0x7f537009d6f0 2023-10-03T10:15:16.433 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:16.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.434+0000 7f5375d3b700 1 -- 172.21.15.72:0/1695819728 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f537009d6f0 msgr2=0x7f53701c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.434+0000 7f5375d3b700 1 --2- 172.21.15.72:0/1695819728 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f537009d6f0 0x7f53701c80b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5358009fd0 tx=0x7f5358004750 comp rx=0 tx=0).stop 2023-10-03T10:15:16.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.435+0000 7f5375d3b700 1 -- 172.21.15.72:0/1695819728 shutdown_connections 2023-10-03T10:15:16.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.435+0000 7f5375d3b700 1 --2- 172.21.15.72:0/1695819728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f537009e410 0x7f53701c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.435+0000 7f5375d3b700 1 --2- 172.21.15.72:0/1695819728 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f537009d6f0 0x7f53701c80b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.435+0000 7f5375d3b700 1 --2- 172.21.15.72:0/1695819728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f537009e000 0x7f53701c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.435+0000 7f5375d3b700 1 -- 172.21.15.72:0/1695819728 >> 172.21.15.72:0/1695819728 conn(0x7f5370066f50 msgr2=0x7f53701bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.435+0000 7f5375d3b700 1 -- 172.21.15.72:0/1695819728 shutdown_connections 2023-10-03T10:15:16.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.435+0000 7f5375d3b700 1 -- 172.21.15.72:0/1695819728 wait complete. 2023-10-03T10:15:16.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:16.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.478+0000 7f63f4a25700 1 Processor -- start 2023-10-03T10:15:16.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.478+0000 7f63f4a25700 1 -- start start 2023-10-03T10:15:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.478+0000 7f63f4a25700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009f410 0x7f63f0136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.478+0000 7f63f4a25700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63f0136fe0 0x7f63f01393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.478+0000 7f63f4a25700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f0070940 con 0x7f63f009e930 2023-10-03T10:15:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.478+0000 7f63f4a25700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f006fd60 con 0x7f63f0136fe0 2023-10-03T10:15:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.478+0000 7f63f4a25700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f006fa80 con 0x7f63f009f410 2023-10-03T10:15:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.479+0000 7f63eed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63f0136fe0 0x7f63f01393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.479+0000 7f63edd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009f410 0x7f63f0136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.479+0000 7f63edd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009f410 0x7f63f0136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44464/0 (socket says 172.21.15.72:44464) 2023-10-03T10:15:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.479+0000 7f63eed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63f0136fe0 0x7f63f01393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55284/0 (socket says 172.21.15.72:55284) 2023-10-03T10:15:16.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.479+0000 7f63edd9b700 1 -- 172.21.15.72:0/300819726 learned_addr learned my addr 172.21.15.72:0/300819726 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.479+0000 7f63edd9b700 1 -- 172.21.15.72:0/300819726 >> v2:172.21.15.72:3300/0 conn(0x7f63f0136fe0 msgr2=0x7f63f01393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.479+0000 7f63edd9b700 1 --2- 172.21.15.72:0/300819726 >> v2:172.21.15.72:3300/0 conn(0x7f63f0136fe0 0x7f63f01393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.479+0000 7f63edd9b700 1 -- 172.21.15.72:0/300819726 >> v1:172.21.15.72:6789/0 conn(0x7f63f009e930 legacy=0x7f63f009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.479+0000 7f63edd9b700 1 -- 172.21.15.72:0/300819726 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f009fb60 con 0x7f63f009f410 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.479+0000 7f63eed9d700 1 --2- 172.21.15.72:0/300819726 >> v2:172.21.15.72:3300/0 conn(0x7f63f0136fe0 0x7f63f01393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.479+0000 7f63edd9b700 1 --2- 172.21.15.72:0/300819726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009f410 0x7f63f0136aa0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f63e40098f0 tx=0x7f63e4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24b9269fdc497192 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.479+0000 7f63ed59a700 1 -- 172.21.15.72:0/300819726 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4011830 con 0x7f63f009f410 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.479+0000 7f63ed59a700 1 -- 172.21.15.72:0/300819726 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e4011990 con 0x7f63f009f410 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.479+0000 7f63ed59a700 1 -- 172.21.15.72:0/300819726 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4011d20 con 0x7f63f009f410 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.480+0000 7f63f4a25700 1 -- 172.21.15.72:0/300819726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009f410 msgr2=0x7f63f0136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.480+0000 7f63f4a25700 1 --2- 172.21.15.72:0/300819726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009f410 0x7f63f0136aa0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f63e40098f0 tx=0x7f63e4009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.480+0000 7f63f4a25700 1 -- 172.21.15.72:0/300819726 shutdown_connections 2023-10-03T10:15:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.480+0000 7f63f4a25700 1 --2- 172.21.15.72:0/300819726 >> v2:172.21.15.72:3300/0 conn(0x7f63f0136fe0 0x7f63f01393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.480+0000 7f63f4a25700 1 --2- 172.21.15.72:0/300819726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009f410 0x7f63f0136aa0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.480+0000 7f63f4a25700 1 -- 172.21.15.72:0/300819726 >> 172.21.15.72:0/300819726 conn(0x7f63f00a4210 msgr2=0x7f63f00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.480+0000 7f63f4a25700 1 -- 172.21.15.72:0/300819726 shutdown_connections 2023-10-03T10:15:16.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.480+0000 7f63f4a25700 1 -- 172.21.15.72:0/300819726 wait complete. 2023-10-03T10:15:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.481+0000 7f63f4a25700 1 Processor -- start 2023-10-03T10:15:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.481+0000 7f63f4a25700 1 -- start start 2023-10-03T10:15:16.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63f4a25700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009e930 0x7f63f011a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63f4a25700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009f410 0x7f63f011abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63f4a25700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f0136fe0 0x7f63f011b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63f4a25700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f011ddf0 con 0x7f63f009e930 2023-10-03T10:15:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63f4a25700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f011c0e0 con 0x7f63f009f410 2023-10-03T10:15:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63f4a25700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63f011c690 con 0x7f63f0136fe0 2023-10-03T10:15:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63ee59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009e930 0x7f63f011a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63eed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f0136fe0 0x7f63f011b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63edd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009f410 0x7f63f011abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63ee59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009e930 0x7f63f011a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55300/0 (socket says 172.21.15.72:55300) 2023-10-03T10:15:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63eed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f0136fe0 0x7f63f011b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60074/0 (socket says 172.21.15.72:60074) 2023-10-03T10:15:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63ee59c700 1 -- 172.21.15.72:0/357351578 learned_addr learned my addr 172.21.15.72:0/357351578 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:16.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63ee59c700 1 -- 172.21.15.72:0/357351578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f0136fe0 msgr2=0x7f63f011b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63ee59c700 1 --2- 172.21.15.72:0/357351578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f0136fe0 0x7f63f011b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63ee59c700 1 -- 172.21.15.72:0/357351578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009f410 msgr2=0x7f63f011abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.482+0000 7f63ee59c700 1 --2- 172.21.15.72:0/357351578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009f410 0x7f63f011abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.483+0000 7f63ee59c700 1 -- 172.21.15.72:0/357351578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e800f050 con 0x7f63f009e930 2023-10-03T10:15:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.483+0000 7f63eed9d700 1 --2- 172.21.15.72:0/357351578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f0136fe0 0x7f63f011b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.483+0000 7f63edd9b700 1 --2- 172.21.15.72:0/357351578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009f410 0x7f63f011abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.483+0000 7f63ee59c700 1 --2- 172.21.15.72:0/357351578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009e930 0x7f63f011a680 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f63e000c4e0 tx=0x7f63e000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.483+0000 7f63deffd700 1 -- 172.21.15.72:0/357351578 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e00052d0 con 0x7f63f009e930 2023-10-03T10:15:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.483+0000 7f63deffd700 1 -- 172.21.15.72:0/357351578 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e0005430 con 0x7f63f009e930 2023-10-03T10:15:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.483+0000 7f63f4a25700 1 -- 172.21.15.72:0/357351578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e4009550 con 0x7f63f009e930 2023-10-03T10:15:16.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.483+0000 7f63deffd700 1 -- 172.21.15.72:0/357351578 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e00038c0 con 0x7f63f009e930 2023-10-03T10:15:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.483+0000 7f63f4a25700 1 -- 172.21.15.72:0/357351578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f011e780 con 0x7f63f009e930 2023-10-03T10:15:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.484+0000 7f63f4a25700 1 -- 172.21.15.72:0/357351578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f0074ea0 con 0x7f63f009e930 2023-10-03T10:15:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.484+0000 7f63deffd700 1 -- 172.21.15.72:0/357351578 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63e0003a20 con 0x7f63f009e930 2023-10-03T10:15:16.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.484+0000 7f63deffd700 1 -- 172.21.15.72:0/357351578 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f63e003ea70 con 0x7f63f009e930 2023-10-03T10:15:16.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.489+0000 7f63deffd700 1 -- 172.21.15.72:0/357351578 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63e0040e60 con 0x7f63f009e930 2023-10-03T10:15:16.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.524+0000 7fa3d2e0f700 1 Processor -- start 2023-10-03T10:15:16.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.524+0000 7fa3d2e0f700 1 -- start start 2023-10-03T10:15:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.524+0000 7fa3d2e0f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa3cc0a0a30 0x7fa3cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.524+0000 7fa3d2e0f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa3cc09d630 0x7fa3cc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.524+0000 7fa3d2e0f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3cc133930 0x7fa3cc133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.524+0000 7fa3d2e0f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3cc0a2a70 con 0x7fa3cc09d630 2023-10-03T10:15:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.524+0000 7fa3d2e0f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc0a01d0 con 0x7fa3cc133930 2023-10-03T10:15:16.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.524+0000 7fa3d2e0f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc09e2b0 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.524+0000 7fa3d13ac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3cc133930 0x7fa3cc133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.524+0000 7fa3d13ac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3cc133930 0x7fa3cc133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44482/0 (socket says 172.21.15.72:44482) 2023-10-03T10:15:16.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.524+0000 7fa3d0bab700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa3cc0a0a30 0x7fa3cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.524+0000 7fa3d13ac700 1 -- 172.21.15.72:0/2535886985 learned_addr learned my addr 172.21.15.72:0/2535886985 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:16.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.524+0000 7fa3cbfff700 1 --2- 172.21.15.72:0/2535886985 >> v2:172.21.15.72:3300/0 conn(0x7fa3cc09d630 0x7fa3cc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.525+0000 7fa3d0bab700 1 -- 172.21.15.72:0/2535886985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3cc133930 msgr2=0x7fa3cc133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.525+0000 7fa3d0bab700 1 --2- 172.21.15.72:0/2535886985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3cc133930 0x7fa3cc133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.525+0000 7fa3d0bab700 1 -- 172.21.15.72:0/2535886985 >> v2:172.21.15.72:3300/0 conn(0x7fa3cc09d630 msgr2=0x7fa3cc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.525+0000 7fa3d0bab700 1 --2- 172.21.15.72:0/2535886985 >> v2:172.21.15.72:3300/0 conn(0x7fa3cc09d630 0x7fa3cc0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.525+0000 7fa3d0bab700 1 -- 172.21.15.72:0/2535886985 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc09dc50 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.525+0000 7fa3d13ac700 1 --2- 172.21.15.72:0/2535886985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3cc133930 0x7fa3cc133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.525+0000 7fa3cbfff700 1 --2- 172.21.15.72:0/2535886985 >> v2:172.21.15.72:3300/0 conn(0x7fa3cc09d630 0x7fa3cc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.525+0000 7fa3d0bab700 1 --2- 172.21.15.72:0/2535886985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa3cc0a0a30 0x7fa3cc0a0e00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009840 tx=0x7fa3c0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d035f051c994d3c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.525+0000 7fa3cb7fe700 1 -- 172.21.15.72:0/2535886985 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0011830 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.525+0000 7fa3cb7fe700 1 -- 172.21.15.72:0/2535886985 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c0011990 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.525+0000 7fa3cb7fe700 1 -- 172.21.15.72:0/2535886985 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0011d20 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.526+0000 7fa3d2e0f700 1 -- 172.21.15.72:0/2535886985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa3cc0a0a30 msgr2=0x7fa3cc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.526+0000 7fa3d2e0f700 1 --2- 172.21.15.72:0/2535886985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa3cc0a0a30 0x7fa3cc0a0e00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009840 tx=0x7fa3c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.526+0000 7fa3d2e0f700 1 -- 172.21.15.72:0/2535886985 shutdown_connections 2023-10-03T10:15:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.526+0000 7fa3d2e0f700 1 --2- 172.21.15.72:0/2535886985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3cc133930 0x7fa3cc133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.526+0000 7fa3d2e0f700 1 --2- 172.21.15.72:0/2535886985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa3cc0a0a30 0x7fa3cc0a0e00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.526+0000 7fa3d2e0f700 1 --2- 172.21.15.72:0/2535886985 >> v2:172.21.15.72:3300/0 conn(0x7fa3cc09d630 0x7fa3cc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.526+0000 7fa3d2e0f700 1 -- 172.21.15.72:0/2535886985 >> 172.21.15.72:0/2535886985 conn(0x7fa3cc0a3050 msgr2=0x7fa3cc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.526+0000 7fa3d2e0f700 1 -- 172.21.15.72:0/2535886985 shutdown_connections 2023-10-03T10:15:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.526+0000 7fa3d2e0f700 1 -- 172.21.15.72:0/2535886985 wait complete. 2023-10-03T10:15:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.526+0000 7fa3d2e0f700 1 Processor -- start 2023-10-03T10:15:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.527+0000 7fa3d2e0f700 1 -- start start 2023-10-03T10:15:16.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.527+0000 7fa3d2e0f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3cc09d630 0x7fa3cc1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.527+0000 7fa3d2e0f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa3cc0a0a30 0x7fa3cc1c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.527+0000 7fa3d2e0f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3cc133930 0x7fa3cc1c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.527+0000 7fa3d2e0f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc133530 con 0x7fa3cc09d630 2023-10-03T10:15:16.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.527+0000 7fa3d2e0f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc120730 con 0x7fa3cc133930 2023-10-03T10:15:16.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.527+0000 7fa3d2e0f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc0a5040 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.527+0000 7fa3cbfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa3cc0a0a30 0x7fa3cc1c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.527+0000 7fa3cbfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa3cc0a0a30 0x7fa3cc1c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60092/0 (socket says 172.21.15.72:60092) 2023-10-03T10:15:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.527+0000 7fa3cbfff700 1 -- 172.21.15.72:0/3561718337 learned_addr learned my addr 172.21.15.72:0/3561718337 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.527+0000 7fa3d13ac700 1 --2- 172.21.15.72:0/3561718337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3cc133930 0x7fa3cc1c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.527+0000 7fa3d0bab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3cc09d630 0x7fa3cc1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.527+0000 7fa3cbfff700 1 -- 172.21.15.72:0/3561718337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3cc133930 msgr2=0x7fa3cc1c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.528+0000 7fa3cbfff700 1 --2- 172.21.15.72:0/3561718337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3cc133930 0x7fa3cc1c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.528+0000 7fa3cbfff700 1 -- 172.21.15.72:0/3561718337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3cc09d630 msgr2=0x7fa3cc1c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.528+0000 7fa3cbfff700 1 --2- 172.21.15.72:0/3561718337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3cc09d630 0x7fa3cc1c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.528+0000 7fa3cbfff700 1 -- 172.21.15.72:0/3561718337 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b80094a0 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.528+0000 7fa3d0bab700 1 --2- 172.21.15.72:0/3561718337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3cc09d630 0x7fa3cc1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.528+0000 7fa3d13ac700 1 --2- 172.21.15.72:0/3561718337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3cc133930 0x7fa3cc1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.528+0000 7fa3cbfff700 1 --2- 172.21.15.72:0/3561718337 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa3cc0a0a30 0x7fa3cc1c8560 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800ebb0 tx=0x7fa3b800eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.528+0000 7fa3c97fa700 1 -- 172.21.15.72:0/3561718337 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800c850 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.528+0000 7fa3c97fa700 1 -- 172.21.15.72:0/3561718337 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b800c9b0 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.528+0000 7fa3d2e0f700 1 -- 172.21.15.72:0/3561718337 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c4009b30 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.528+0000 7fa3c97fa700 1 -- 172.21.15.72:0/3561718337 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800cd40 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.528+0000 7fa3d2e0f700 1 -- 172.21.15.72:0/3561718337 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c00094a0 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.529+0000 7fa3d2e0f700 1 -- 172.21.15.72:0/3561718337 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3cc0747f0 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.529+0000 7fa3c97fa700 1 -- 172.21.15.72:0/3561718337 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa3b8013470 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.529+0000 7fa3c97fa700 1 -- 172.21.15.72:0/3561718337 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa3b803ffb0 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.538+0000 7fa3c97fa700 1 -- 172.21.15.72:0/3561718337 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3b8011760 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.687+0000 7f63f4a25700 1 -- 172.21.15.72:0/357351578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f63f011da50 con 0x7f63f009e930 2023-10-03T10:15:16.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.688+0000 7f63deffd700 1 -- 172.21.15.72:0/357351578 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63e0017070 con 0x7f63f009e930 2023-10-03T10:15:16.688 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:16.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.689+0000 7f63f4a25700 1 -- 172.21.15.72:0/357351578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009e930 msgr2=0x7f63f011a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.689+0000 7f63f4a25700 1 --2- 172.21.15.72:0/357351578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009e930 0x7f63f011a680 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f63e000c4e0 tx=0x7f63e000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.689+0000 7f63f4a25700 1 -- 172.21.15.72:0/357351578 shutdown_connections 2023-10-03T10:15:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.689+0000 7f63f4a25700 1 --2- 172.21.15.72:0/357351578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009e930 0x7f63f011a680 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.689+0000 7f63f4a25700 1 --2- 172.21.15.72:0/357351578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f0136fe0 0x7f63f011b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.689+0000 7f63f4a25700 1 --2- 172.21.15.72:0/357351578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009f410 0x7f63f011abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.690+0000 7f63f4a25700 1 -- 172.21.15.72:0/357351578 >> 172.21.15.72:0/357351578 conn(0x7f63f00a4210 msgr2=0x7f63f00a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.690+0000 7f63f4a25700 1 -- 172.21.15.72:0/357351578 shutdown_connections 2023-10-03T10:15:16.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.690+0000 7f63f4a25700 1 -- 172.21.15.72:0/357351578 wait complete. 2023-10-03T10:15:16.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.731+0000 7fa3d2e0f700 1 -- 172.21.15.72:0/3561718337 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa3cc072980 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.732+0000 7fa3c97fa700 1 -- 172.21.15.72:0/3561718337 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa3b8017030 con 0x7fa3cc0a0a30 2023-10-03T10:15:16.732 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:16.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.734+0000 7fa3d2e0f700 1 -- 172.21.15.72:0/3561718337 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa3cc0a0a30 msgr2=0x7fa3cc1c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.734+0000 7fa3d2e0f700 1 --2- 172.21.15.72:0/3561718337 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa3cc0a0a30 0x7fa3cc1c8560 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800ebb0 tx=0x7fa3b800eec0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.734+0000 7fa3d2e0f700 1 -- 172.21.15.72:0/3561718337 shutdown_connections 2023-10-03T10:15:16.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.734+0000 7fa3d2e0f700 1 --2- 172.21.15.72:0/3561718337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3cc09d630 0x7fa3cc1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.734+0000 7fa3d2e0f700 1 --2- 172.21.15.72:0/3561718337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3cc133930 0x7fa3cc1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.734+0000 7fa3d2e0f700 1 --2- 172.21.15.72:0/3561718337 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa3cc0a0a30 0x7fa3cc1c8560 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.734+0000 7fa3d2e0f700 1 -- 172.21.15.72:0/3561718337 >> 172.21.15.72:0/3561718337 conn(0x7fa3cc0a3050 msgr2=0x7fa3cc0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.734+0000 7fa3d2e0f700 1 -- 172.21.15.72:0/3561718337 shutdown_connections 2023-10-03T10:15:16.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.734+0000 7fa3d2e0f700 1 -- 172.21.15.72:0/3561718337 wait complete. 2023-10-03T10:15:16.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:16.770 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:16.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.908+0000 7f97a0941700 1 Processor -- start 2023-10-03T10:15:16.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.908+0000 7f97a0941700 1 -- start start 2023-10-03T10:15:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.908+0000 7f97a0941700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f979c09e930 0x7f979c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.908+0000 7f97a0941700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f979c09f240 0x7f979c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.908+0000 7f97a0941700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979c070940 con 0x7f979c09f650 2023-10-03T10:15:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.908+0000 7f97a0941700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979c06fd60 con 0x7f979c09e930 2023-10-03T10:15:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.908+0000 7f97a0941700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979c06fa80 con 0x7f979c09f240 2023-10-03T10:15:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.908+0000 7f9799d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f979c09f240 0x7f979c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.908+0000 7f979a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f979c09e930 0x7f979c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.908+0000 7f979a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f979c09e930 0x7f979c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55324/0 (socket says 172.21.15.72:55324) 2023-10-03T10:15:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.908+0000 7f9799d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f979c09f240 0x7f979c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44498/0 (socket says 172.21.15.72:44498) 2023-10-03T10:15:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.908+0000 7f979a59c700 1 -- 172.21.15.72:0/3178418775 learned_addr learned my addr 172.21.15.72:0/3178418775 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.909+0000 7f979a59c700 1 -- 172.21.15.72:0/3178418775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f979c09f240 msgr2=0x7f979c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.909+0000 7f979a59c700 1 --2- 172.21.15.72:0/3178418775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f979c09f240 0x7f979c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.909+0000 7f979a59c700 1 -- 172.21.15.72:0/3178418775 >> v1:172.21.15.72:6789/0 conn(0x7f979c09f650 legacy=0x7f979c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.909+0000 7f979a59c700 1 -- 172.21.15.72:0/3178418775 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c09fb60 con 0x7f979c09e930 2023-10-03T10:15:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.909+0000 7f9799d9b700 1 --2- 172.21.15.72:0/3178418775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f979c09f240 0x7f979c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.909+0000 7f979a59c700 1 --2- 172.21.15.72:0/3178418775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c09e930 0x7f979c09ed00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f978c0098f0 tx=0x7f978c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b328f1edbda57dc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.909+0000 7f979959a700 1 -- 172.21.15.72:0/3178418775 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c011830 con 0x7f979c09e930 2023-10-03T10:15:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.909+0000 7f979959a700 1 -- 172.21.15.72:0/3178418775 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c011990 con 0x7f979c09e930 2023-10-03T10:15:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.909+0000 7f979959a700 1 -- 172.21.15.72:0/3178418775 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c011d20 con 0x7f979c09e930 2023-10-03T10:15:16.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.909+0000 7f97a0941700 1 -- 172.21.15.72:0/3178418775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c09e930 msgr2=0x7f979c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.909+0000 7f97a0941700 1 --2- 172.21.15.72:0/3178418775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c09e930 0x7f979c09ed00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f978c0098f0 tx=0x7f978c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:16.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.910+0000 7f97a0941700 1 -- 172.21.15.72:0/3178418775 shutdown_connections 2023-10-03T10:15:16.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.910+0000 7f97a0941700 1 --2- 172.21.15.72:0/3178418775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c09e930 0x7f979c09ed00 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.910+0000 7f97a0941700 1 --2- 172.21.15.72:0/3178418775 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f979c09f240 0x7f979c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.910+0000 7f97a0941700 1 -- 172.21.15.72:0/3178418775 >> 172.21.15.72:0/3178418775 conn(0x7f979c0a4210 msgr2=0x7f979c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.910+0000 7f97a0941700 1 -- 172.21.15.72:0/3178418775 shutdown_connections 2023-10-03T10:15:16.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.910+0000 7f97a0941700 1 -- 172.21.15.72:0/3178418775 wait complete. 2023-10-03T10:15:16.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f97a0941700 1 Processor -- start 2023-10-03T10:15:16.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f97a0941700 1 -- start start 2023-10-03T10:15:16.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f97a0941700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979c09e930 0x7f979c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f97a0941700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f979c09f240 0x7f979c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f97a0941700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c09f650 0x7f979c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f97a0941700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c1b7350 con 0x7f979c09f650 2023-10-03T10:15:16.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f97a0941700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979c1a9500 con 0x7f979c09f240 2023-10-03T10:15:16.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f97a0941700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f979c1a8a20 con 0x7f979c09e930 2023-10-03T10:15:16.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f979a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979c09e930 0x7f979c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f9799d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f979c09f240 0x7f979c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f979a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979c09e930 0x7f979c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60102/0 (socket says 172.21.15.72:60102) 2023-10-03T10:15:16.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f979a59c700 1 -- 172.21.15.72:0/2621085380 learned_addr learned my addr 172.21.15.72:0/2621085380 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:16.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f9799d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f979c09f240 0x7f979c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44502/0 (socket says 172.21.15.72:44502) 2023-10-03T10:15:16.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f979ad9d700 1 --2- 172.21.15.72:0/2621085380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c09f650 0x7f979c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f9799d9b700 1 -- 172.21.15.72:0/2621085380 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979c09e930 msgr2=0x7f979c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f9799d9b700 1 --2- 172.21.15.72:0/2621085380 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979c09e930 0x7f979c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f9799d9b700 1 -- 172.21.15.72:0/2621085380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c09f650 msgr2=0x7f979c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f9799d9b700 1 --2- 172.21.15.72:0/2621085380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c09f650 0x7f979c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.911+0000 7f9799d9b700 1 -- 172.21.15.72:0/2621085380 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97900094a0 con 0x7f979c09f240 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.912+0000 7f9799d9b700 1 --2- 172.21.15.72:0/2621085380 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f979c09f240 0x7f979c06bdf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f979000e9e0 tx=0x7f979000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.912+0000 7f978affd700 1 -- 172.21.15.72:0/2621085380 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979000ee80 con 0x7f979c09f240 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.912+0000 7f978affd700 1 -- 172.21.15.72:0/2621085380 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979000c850 con 0x7f979c09f240 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.912+0000 7f97a0941700 1 -- 172.21.15.72:0/2621085380 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978c009550 con 0x7f979c09f240 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.912+0000 7f978affd700 1 -- 172.21.15.72:0/2621085380 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979000cc00 con 0x7f979c09f240 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.912+0000 7f97a0941700 1 -- 172.21.15.72:0/2621085380 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979c0a0190 con 0x7f979c09f240 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.913+0000 7f978affd700 1 -- 172.21.15.72:0/2621085380 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f979000cd60 con 0x7f979c09f240 2023-10-03T10:15:16.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.913+0000 7f978affd700 1 -- 172.21.15.72:0/2621085380 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f979003fa60 con 0x7f979c09f240 2023-10-03T10:15:16.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.913+0000 7f97a0941700 1 -- 172.21.15.72:0/2621085380 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979c0a3530 con 0x7f979c09f240 2023-10-03T10:15:16.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:16.918+0000 7f978affd700 1 -- 172.21.15.72:0/2621085380 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9790017080 con 0x7f979c09f240 2023-10-03T10:15:17.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.102+0000 7f97a0941700 1 -- 172.21.15.72:0/2621085380 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f979c071d20 con 0x7f979c09f240 2023-10-03T10:15:17.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.102+0000 7f978affd700 1 -- 172.21.15.72:0/2621085380 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9790021020 con 0x7f979c09f240 2023-10-03T10:15:17.103 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:17.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.104+0000 7f97a0941700 1 -- 172.21.15.72:0/2621085380 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f979c09f240 msgr2=0x7f979c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.104+0000 7f97a0941700 1 --2- 172.21.15.72:0/2621085380 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f979c09f240 0x7f979c06bdf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f979000e9e0 tx=0x7f979000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.104+0000 7f97a0941700 1 -- 172.21.15.72:0/2621085380 shutdown_connections 2023-10-03T10:15:17.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.104+0000 7f97a0941700 1 --2- 172.21.15.72:0/2621085380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f979c09f650 0x7f979c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.104+0000 7f97a0941700 1 --2- 172.21.15.72:0/2621085380 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979c09e930 0x7f979c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.104+0000 7f97a0941700 1 --2- 172.21.15.72:0/2621085380 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f979c09f240 0x7f979c06bdf0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.104+0000 7f97a0941700 1 -- 172.21.15.72:0/2621085380 >> 172.21.15.72:0/2621085380 conn(0x7f979c0a4210 msgr2=0x7f979c1b8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.104+0000 7f97a0941700 1 -- 172.21.15.72:0/2621085380 shutdown_connections 2023-10-03T10:15:17.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.104+0000 7f97a0941700 1 -- 172.21.15.72:0/2621085380 wait complete. 2023-10-03T10:15:17.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:17.449 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:17.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.573+0000 7fcb60759700 1 Processor -- start 2023-10-03T10:15:17.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.573+0000 7fcb60759700 1 -- start start 2023-10-03T10:15:17.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.573+0000 7fcb60759700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb5806b250 0x7fcb58136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.573+0000 7fcb60759700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb58136d80 0x7fcb58139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.573+0000 7fcb60759700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5809ece0 con 0x7fcb5806a770 2023-10-03T10:15:17.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.573+0000 7fcb60759700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5806b640 con 0x7fcb58136d80 2023-10-03T10:15:17.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.573+0000 7fcb60759700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5809e760 con 0x7fcb5806b250 2023-10-03T10:15:17.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.573+0000 7fcb5dcf4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb5806b250 0x7fcb58136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.573+0000 7fcb5e4f5700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcb5806a770 0x7fcb5806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59754/0 (socket says 172.21.15.72:59754) 2023-10-03T10:15:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.573+0000 7fcb5e4f5700 1 -- 172.21.15.72:0/3783872604 learned_addr learned my addr 172.21.15.72:0/3783872604 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.573+0000 7fcb5ecf6700 1 --2- 172.21.15.72:0/3783872604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb58136d80 0x7fcb58139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.574+0000 7fcb5dcf4700 1 -- 172.21.15.72:0/3783872604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb58136d80 msgr2=0x7fcb58139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.574+0000 7fcb5dcf4700 1 --2- 172.21.15.72:0/3783872604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb58136d80 0x7fcb58139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.574+0000 7fcb5d4f3700 1 -- 172.21.15.72:0/3783872604 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970147215 0 0) 0x7fcb5809ece0 con 0x7fcb5806a770 2023-10-03T10:15:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.574+0000 7fcb5dcf4700 1 -- 172.21.15.72:0/3783872604 >> v1:172.21.15.72:6789/0 conn(0x7fcb5806a770 legacy=0x7fcb5806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.574+0000 7fcb5dcf4700 1 -- 172.21.15.72:0/3783872604 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5809e040 con 0x7fcb5806b250 2023-10-03T10:15:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.574+0000 7fcb5ecf6700 1 --2- 172.21.15.72:0/3783872604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb58136d80 0x7fcb58139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.574+0000 7fcb5dcf4700 1 --2- 172.21.15.72:0/3783872604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb5806b250 0x7fcb58136840 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009870 tx=0x7fcb48009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd6cf8d784da0ae1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.574+0000 7fcb5d4f3700 1 -- 172.21.15.72:0/3783872604 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48011830 con 0x7fcb5806b250 2023-10-03T10:15:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.574+0000 7fcb5d4f3700 1 -- 172.21.15.72:0/3783872604 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb48011990 con 0x7fcb5806b250 2023-10-03T10:15:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.574+0000 7fcb5d4f3700 1 -- 172.21.15.72:0/3783872604 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48011d20 con 0x7fcb5806b250 2023-10-03T10:15:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.575+0000 7fcb60759700 1 -- 172.21.15.72:0/3783872604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb5806b250 msgr2=0x7fcb58136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.575+0000 7fcb60759700 1 --2- 172.21.15.72:0/3783872604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb5806b250 0x7fcb58136840 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009870 tx=0x7fcb48009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.575+0000 7fcb60759700 1 -- 172.21.15.72:0/3783872604 shutdown_connections 2023-10-03T10:15:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.575+0000 7fcb60759700 1 --2- 172.21.15.72:0/3783872604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb58136d80 0x7fcb58139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.575+0000 7fcb60759700 1 --2- 172.21.15.72:0/3783872604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb5806b250 0x7fcb58136840 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.575+0000 7fcb60759700 1 -- 172.21.15.72:0/3783872604 >> 172.21.15.72:0/3783872604 conn(0x7fcb58066f50 msgr2=0x7fcb5809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.575+0000 7fcb60759700 1 -- 172.21.15.72:0/3783872604 shutdown_connections 2023-10-03T10:15:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.575+0000 7fcb60759700 1 -- 172.21.15.72:0/3783872604 wait complete. 2023-10-03T10:15:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb60759700 1 Processor -- start 2023-10-03T10:15:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb60759700 1 -- start start 2023-10-03T10:15:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb60759700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb5806a770 0x7fcb5811a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb60759700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb5806b250 0x7fcb5811a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb60759700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb58136d80 0x7fcb5811ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb60759700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb58131c40 con 0x7fcb5806a770 2023-10-03T10:15:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb60759700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5811cd90 con 0x7fcb5806b250 2023-10-03T10:15:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb60759700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5811dc30 con 0x7fcb58136d80 2023-10-03T10:15:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb5e4f5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb5806a770 0x7fcb5811a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb5ecf6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb58136d80 0x7fcb5811ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb5dcf4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb5806b250 0x7fcb5811a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb5dcf4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb5806b250 0x7fcb5811a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44510/0 (socket says 172.21.15.72:44510) 2023-10-03T10:15:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb5e4f5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb5806a770 0x7fcb5811a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55344/0 (socket says 172.21.15.72:55344) 2023-10-03T10:15:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb5ecf6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb58136d80 0x7fcb5811ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60118/0 (socket says 172.21.15.72:60118) 2023-10-03T10:15:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb5dcf4700 1 -- 172.21.15.72:0/1768588958 learned_addr learned my addr 172.21.15.72:0/1768588958 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb5ecf6700 1 -- 172.21.15.72:0/1768588958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb5806b250 msgr2=0x7fcb5811a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb5ecf6700 1 --2- 172.21.15.72:0/1768588958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb5806b250 0x7fcb5811a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb5ecf6700 1 -- 172.21.15.72:0/1768588958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb5806a770 msgr2=0x7fcb5811a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb5ecf6700 1 --2- 172.21.15.72:0/1768588958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb5806a770 0x7fcb5811a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb5ecf6700 1 -- 172.21.15.72:0/1768588958 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5000f050 con 0x7fcb58136d80 2023-10-03T10:15:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb5dcf4700 1 --2- 172.21.15.72:0/1768588958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb5806b250 0x7fcb5811a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.576+0000 7fcb5e4f5700 1 --2- 172.21.15.72:0/1768588958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb5806a770 0x7fcb5811a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.577+0000 7fcb5ecf6700 1 --2- 172.21.15.72:0/1768588958 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb58136d80 0x7fcb5811ae50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000f530 tx=0x7fcb5000f840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.577+0000 7fcb4effd700 1 -- 172.21.15.72:0/1768588958 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50012050 con 0x7fcb58136d80 2023-10-03T10:15:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.577+0000 7fcb4effd700 1 -- 172.21.15.72:0/1768588958 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb50013040 con 0x7fcb58136d80 2023-10-03T10:15:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.577+0000 7fcb60759700 1 -- 172.21.15.72:0/1768588958 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb480094a0 con 0x7fcb58136d80 2023-10-03T10:15:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.577+0000 7fcb4effd700 1 -- 172.21.15.72:0/1768588958 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50003e20 con 0x7fcb58136d80 2023-10-03T10:15:17.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.577+0000 7fcb60759700 1 -- 172.21.15.72:0/1768588958 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5811d2a0 con 0x7fcb58136d80 2023-10-03T10:15:17.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.577+0000 7fcb4effd700 1 -- 172.21.15.72:0/1768588958 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb50003f80 con 0x7fcb58136d80 2023-10-03T10:15:17.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.578+0000 7fcb4effd700 1 -- 172.21.15.72:0/1768588958 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcb50043fc0 con 0x7fcb58136d80 2023-10-03T10:15:17.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.578+0000 7fcb60759700 1 -- 172.21.15.72:0/1768588958 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5811de00 con 0x7fcb58136d80 2023-10-03T10:15:17.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.582+0000 7fcb4effd700 1 -- 172.21.15.72:0/1768588958 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb50022950 con 0x7fcb58136d80 2023-10-03T10:15:17.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:17.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:17.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.775+0000 7fcb60759700 1 -- 172.21.15.72:0/1768588958 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcb5809f6b0 con 0x7fcb58136d80 2023-10-03T10:15:17.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.775+0000 7fcb4effd700 1 -- 172.21.15.72:0/1768588958 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcb50022360 con 0x7fcb58136d80 2023-10-03T10:15:17.776 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:17.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.777+0000 7fcb60759700 1 -- 172.21.15.72:0/1768588958 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb58136d80 msgr2=0x7fcb5811ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.777+0000 7fcb60759700 1 --2- 172.21.15.72:0/1768588958 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb58136d80 0x7fcb5811ae50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000f530 tx=0x7fcb5000f840 comp rx=0 tx=0).stop 2023-10-03T10:15:17.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.777+0000 7fcb60759700 1 -- 172.21.15.72:0/1768588958 shutdown_connections 2023-10-03T10:15:17.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.777+0000 7fcb60759700 1 --2- 172.21.15.72:0/1768588958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb5806a770 0x7fcb5811a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.777+0000 7fcb60759700 1 --2- 172.21.15.72:0/1768588958 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb58136d80 0x7fcb5811ae50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.777+0000 7fcb60759700 1 --2- 172.21.15.72:0/1768588958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb5806b250 0x7fcb5811a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.777+0000 7fcb60759700 1 -- 172.21.15.72:0/1768588958 >> 172.21.15.72:0/1768588958 conn(0x7fcb58066f50 msgr2=0x7fcb58132710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.780+0000 7fcb60759700 1 -- 172.21.15.72:0/1768588958 shutdown_connections 2023-10-03T10:15:17.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.780+0000 7fcb60759700 1 -- 172.21.15.72:0/1768588958 wait complete. 2023-10-03T10:15:17.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:17.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.829+0000 7f41824bb700 1 Processor -- start 2023-10-03T10:15:17.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.829+0000 7f41824bb700 1 -- start start 2023-10-03T10:15:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.830+0000 7f41824bb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f417c09d6f0 0x7f417c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.830+0000 7f41824bb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f417c09e410 0x7f417c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.830+0000 7f41824bb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417c09f130 con 0x7f417c09e000 2023-10-03T10:15:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.830+0000 7f41824bb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417c09f520 con 0x7f417c09d6f0 2023-10-03T10:15:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.830+0000 7f41824bb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c09e930 con 0x7f417c09e410 2023-10-03T10:15:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.830+0000 7f417bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f417c09d6f0 0x7f417c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.830+0000 7f4180a58700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f417c09e410 0x7f417c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.830+0000 7f417bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f417c09d6f0 0x7f417c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55348/0 (socket says 172.21.15.72:55348) 2023-10-03T10:15:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.830+0000 7f417bfff700 1 -- 172.21.15.72:0/3731405163 learned_addr learned my addr 172.21.15.72:0/3731405163 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.831+0000 7f417bfff700 1 -- 172.21.15.72:0/3731405163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f417c09e410 msgr2=0x7f417c130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.831+0000 7f417bfff700 1 --2- 172.21.15.72:0/3731405163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f417c09e410 0x7f417c130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.831+0000 7f417bfff700 1 -- 172.21.15.72:0/3731405163 >> v1:172.21.15.72:6789/0 conn(0x7f417c09e000 legacy=0x7f417c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.831+0000 7f417bfff700 1 -- 172.21.15.72:0/3731405163 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c09b2d0 con 0x7f417c09d6f0 2023-10-03T10:15:17.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.831+0000 7f4180a58700 1 --2- 172.21.15.72:0/3731405163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f417c09e410 0x7f417c130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:17.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.831+0000 7f417bfff700 1 --2- 172.21.15.72:0/3731405163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f417c09d6f0 0x7f417c09dac0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f416c0098f0 tx=0x7f416c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9b078bd9ad93ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.831+0000 7f417affd700 1 -- 172.21.15.72:0/3731405163 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c011830 con 0x7f417c09d6f0 2023-10-03T10:15:17.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.831+0000 7f417affd700 1 -- 172.21.15.72:0/3731405163 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c011990 con 0x7f417c09d6f0 2023-10-03T10:15:17.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.831+0000 7f417affd700 1 -- 172.21.15.72:0/3731405163 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c011d20 con 0x7f417c09d6f0 2023-10-03T10:15:17.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.832+0000 7f41824bb700 1 -- 172.21.15.72:0/3731405163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f417c09d6f0 msgr2=0x7f417c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.832+0000 7f41824bb700 1 --2- 172.21.15.72:0/3731405163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f417c09d6f0 0x7f417c09dac0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f416c0098f0 tx=0x7f416c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:17.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.832+0000 7f41824bb700 1 -- 172.21.15.72:0/3731405163 shutdown_connections 2023-10-03T10:15:17.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.832+0000 7f41824bb700 1 --2- 172.21.15.72:0/3731405163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f417c09e410 0x7f417c130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.832+0000 7f41824bb700 1 --2- 172.21.15.72:0/3731405163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f417c09d6f0 0x7f417c09dac0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.832+0000 7f41824bb700 1 -- 172.21.15.72:0/3731405163 >> 172.21.15.72:0/3731405163 conn(0x7f417c066f50 msgr2=0x7f417c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.832+0000 7f41824bb700 1 -- 172.21.15.72:0/3731405163 shutdown_connections 2023-10-03T10:15:17.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.832+0000 7f41824bb700 1 -- 172.21.15.72:0/3731405163 wait complete. 2023-10-03T10:15:17.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.833+0000 7f41824bb700 1 Processor -- start 2023-10-03T10:15:17.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.833+0000 7f41824bb700 1 -- start start 2023-10-03T10:15:17.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f41824bb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f417c09d6f0 0x7f417c1c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f41824bb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f417c09e000 0x7f417c1c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f41824bb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f417c09e410 0x7f417c1c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f41824bb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c1248a0 con 0x7f417c09e410 2023-10-03T10:15:17.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f41824bb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c09c700 con 0x7f417c09e000 2023-10-03T10:15:17.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f41824bb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f417c06b510 con 0x7f417c09d6f0 2023-10-03T10:15:17.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f417bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f417c09d6f0 0x7f417c1c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f417b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f417c09e000 0x7f417c1c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f417bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f417c09d6f0 0x7f417c1c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60122/0 (socket says 172.21.15.72:60122) 2023-10-03T10:15:17.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f417b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f417c09e000 0x7f417c1c6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44526/0 (socket says 172.21.15.72:44526) 2023-10-03T10:15:17.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f417bfff700 1 -- 172.21.15.72:0/299763437 learned_addr learned my addr 172.21.15.72:0/299763437 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:17.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f4180a58700 1 --2- 172.21.15.72:0/299763437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f417c09e410 0x7f417c1c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f417b7fe700 1 -- 172.21.15.72:0/299763437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f417c09d6f0 msgr2=0x7f417c1c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f417b7fe700 1 --2- 172.21.15.72:0/299763437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f417c09d6f0 0x7f417c1c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f417b7fe700 1 -- 172.21.15.72:0/299763437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f417c09e410 msgr2=0x7f417c1c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f417b7fe700 1 --2- 172.21.15.72:0/299763437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f417c09e410 0x7f417c1c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f417b7fe700 1 -- 172.21.15.72:0/299763437 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4174009a70 con 0x7f417c09e000 2023-10-03T10:15:17.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f417bfff700 1 --2- 172.21.15.72:0/299763437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f417c09d6f0 0x7f417c1c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:17.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f4180a58700 1 --2- 172.21.15.72:0/299763437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f417c09e410 0x7f417c1c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:17.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f417b7fe700 1 --2- 172.21.15.72:0/299763437 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f417c09e000 0x7f417c1c6990 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4170000f60 tx=0x7f417000c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f4178ff9700 1 -- 172.21.15.72:0/299763437 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700052d0 con 0x7f417c09e000 2023-10-03T10:15:17.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.834+0000 7f4178ff9700 1 -- 172.21.15.72:0/299763437 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4170005430 con 0x7f417c09e000 2023-10-03T10:15:17.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.835+0000 7f41824bb700 1 -- 172.21.15.72:0/299763437 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416c009550 con 0x7f417c09e000 2023-10-03T10:15:17.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.835+0000 7f4178ff9700 1 -- 172.21.15.72:0/299763437 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700038c0 con 0x7f417c09e000 2023-10-03T10:15:17.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.835+0000 7f41824bb700 1 -- 172.21.15.72:0/299763437 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417c122780 con 0x7f417c09e000 2023-10-03T10:15:17.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.835+0000 7f41824bb700 1 -- 172.21.15.72:0/299763437 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417c09de20 con 0x7f417c09e000 2023-10-03T10:15:17.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.836+0000 7f4178ff9700 1 -- 172.21.15.72:0/299763437 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4170003a20 con 0x7f417c09e000 2023-10-03T10:15:17.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.836+0000 7f4178ff9700 1 -- 172.21.15.72:0/299763437 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f417003edf0 con 0x7f417c09e000 2023-10-03T10:15:17.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.844+0000 7f4178ff9700 1 -- 172.21.15.72:0/299763437 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4170011590 con 0x7f417c09e000 2023-10-03T10:15:17.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.876+0000 7f3477a9f700 1 Processor -- start 2023-10-03T10:15:17.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.876+0000 7f3477a9f700 1 -- start start 2023-10-03T10:15:17.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f3477a9f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34700a0a30 0x7f34700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f3477a9f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f347009d630 0x7f34700a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f3477a9f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3470133930 0x7f3470133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f3477a9f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34700a2a70 con 0x7f34700a0a30 2023-10-03T10:15:17.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f3477a9f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34700a01d0 con 0x7f347009d630 2023-10-03T10:15:17.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f3477a9f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f347009e2b0 con 0x7f3470133930 2023-10-03T10:15:17.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f347583b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34700a0a30 0x7f34700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f347603c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3470133930 0x7f3470133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f347503a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f347009d630 0x7f34700a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f347583b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34700a0a30 0x7f34700a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55366/0 (socket says 172.21.15.72:55366) 2023-10-03T10:15:17.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f347603c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3470133930 0x7f3470133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60130/0 (socket says 172.21.15.72:60130) 2023-10-03T10:15:17.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f347583b700 1 -- 172.21.15.72:0/3301712373 learned_addr learned my addr 172.21.15.72:0/3301712373 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:17.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f347583b700 1 -- 172.21.15.72:0/3301712373 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3470133930 msgr2=0x7f3470133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f347583b700 1 --2- 172.21.15.72:0/3301712373 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3470133930 0x7f3470133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f347583b700 1 -- 172.21.15.72:0/3301712373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f347009d630 msgr2=0x7f34700a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f347583b700 1 --2- 172.21.15.72:0/3301712373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f347009d630 0x7f34700a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f347583b700 1 -- 172.21.15.72:0/3301712373 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347009dc50 con 0x7f34700a0a30 2023-10-03T10:15:17.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f347603c700 1 --2- 172.21.15.72:0/3301712373 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3470133930 0x7f3470133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f347503a700 1 --2- 172.21.15.72:0/3301712373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f347009d630 0x7f34700a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.877+0000 7f347583b700 1 --2- 172.21.15.72:0/3301712373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34700a0a30 0x7f34700a0e00 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f346c0098f0 tx=0x7f346c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a493addb267823 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.878+0000 7f3474839700 1 -- 172.21.15.72:0/3301712373 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c011830 con 0x7f34700a0a30 2023-10-03T10:15:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.878+0000 7f3474839700 1 -- 172.21.15.72:0/3301712373 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346c011990 con 0x7f34700a0a30 2023-10-03T10:15:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.878+0000 7f3474839700 1 -- 172.21.15.72:0/3301712373 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c011d20 con 0x7f34700a0a30 2023-10-03T10:15:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.878+0000 7f3477a9f700 1 -- 172.21.15.72:0/3301712373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34700a0a30 msgr2=0x7f34700a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.878+0000 7f3477a9f700 1 --2- 172.21.15.72:0/3301712373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34700a0a30 0x7f34700a0e00 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f346c0098f0 tx=0x7f346c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.878+0000 7f3477a9f700 1 -- 172.21.15.72:0/3301712373 shutdown_connections 2023-10-03T10:15:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.878+0000 7f3477a9f700 1 --2- 172.21.15.72:0/3301712373 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3470133930 0x7f3470133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.878+0000 7f3477a9f700 1 --2- 172.21.15.72:0/3301712373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34700a0a30 0x7f34700a0e00 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.878+0000 7f3477a9f700 1 --2- 172.21.15.72:0/3301712373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f347009d630 0x7f34700a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.878+0000 7f3477a9f700 1 -- 172.21.15.72:0/3301712373 >> 172.21.15.72:0/3301712373 conn(0x7f34700a3050 msgr2=0x7f34700a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.878+0000 7f3477a9f700 1 -- 172.21.15.72:0/3301712373 shutdown_connections 2023-10-03T10:15:17.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.878+0000 7f3477a9f700 1 -- 172.21.15.72:0/3301712373 wait complete. 2023-10-03T10:15:17.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.879+0000 7f3477a9f700 1 Processor -- start 2023-10-03T10:15:17.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.879+0000 7f3477a9f700 1 -- start start 2023-10-03T10:15:17.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f3477a9f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f347009d630 0x7f34701c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f3477a9f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34700a0a30 0x7f34701c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f3477a9f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3470133930 0x7f34701c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f3477a9f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3470120590 con 0x7f347009d630 2023-10-03T10:15:17.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f3477a9f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3470122250 con 0x7f34700a0a30 2023-10-03T10:15:17.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f3477a9f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34700a40c0 con 0x7f3470133930 2023-10-03T10:15:17.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f347503a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34700a0a30 0x7f34701c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f347603c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3470133930 0x7f34701c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f347503a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34700a0a30 0x7f34701c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:44546/0 (socket says 172.21.15.72:44546) 2023-10-03T10:15:17.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f347503a700 1 -- 172.21.15.72:0/705939855 learned_addr learned my addr 172.21.15.72:0/705939855 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:17.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f347583b700 1 --2- 172.21.15.72:0/705939855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f347009d630 0x7f34701c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f347503a700 1 -- 172.21.15.72:0/705939855 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3470133930 msgr2=0x7f34701c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f347503a700 1 --2- 172.21.15.72:0/705939855 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3470133930 0x7f34701c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f347503a700 1 -- 172.21.15.72:0/705939855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f347009d630 msgr2=0x7f34701c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f347503a700 1 --2- 172.21.15.72:0/705939855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f347009d630 0x7f34701c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f347503a700 1 -- 172.21.15.72:0/705939855 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34600094a0 con 0x7f34700a0a30 2023-10-03T10:15:17.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f347503a700 1 --2- 172.21.15.72:0/705939855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34700a0a30 0x7f34701c8540 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f346000ebe0 tx=0x7f346000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f34667fc700 1 -- 172.21.15.72:0/705939855 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460009800 con 0x7f34700a0a30 2023-10-03T10:15:17.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f34667fc700 1 -- 172.21.15.72:0/705939855 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346000c850 con 0x7f34700a0a30 2023-10-03T10:15:17.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f34667fc700 1 -- 172.21.15.72:0/705939855 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346000cbc0 con 0x7f34700a0a30 2023-10-03T10:15:17.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.880+0000 7f3477a9f700 1 -- 172.21.15.72:0/705939855 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3468009a70 con 0x7f34700a0a30 2023-10-03T10:15:17.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.881+0000 7f3477a9f700 1 -- 172.21.15.72:0/705939855 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c009550 con 0x7f34700a0a30 2023-10-03T10:15:17.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.881+0000 7f3477a9f700 1 -- 172.21.15.72:0/705939855 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34700747f0 con 0x7f34700a0a30 2023-10-03T10:15:17.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.881+0000 7f34667fc700 1 -- 172.21.15.72:0/705939855 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f346000cd20 con 0x7f34700a0a30 2023-10-03T10:15:17.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.882+0000 7f34667fc700 1 -- 172.21.15.72:0/705939855 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f346003f790 con 0x7f34700a0a30 2023-10-03T10:15:17.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:17.886+0000 7f34667fc700 1 -- 172.21.15.72:0/705939855 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f346001bde0 con 0x7f34700a0a30 2023-10-03T10:15:18.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.038+0000 7f41824bb700 1 -- 172.21.15.72:0/299763437 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f417c074ea0 con 0x7f417c09e000 2023-10-03T10:15:18.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.038+0000 7f4178ff9700 1 -- 172.21.15.72:0/299763437 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4170017030 con 0x7f417c09e000 2023-10-03T10:15:18.039 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:18.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.041+0000 7f41824bb700 1 -- 172.21.15.72:0/299763437 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f417c09e000 msgr2=0x7f417c1c6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.041+0000 7f41824bb700 1 --2- 172.21.15.72:0/299763437 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f417c09e000 0x7f417c1c6990 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4170000f60 tx=0x7f417000c730 comp rx=0 tx=0).stop 2023-10-03T10:15:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.041+0000 7f41824bb700 1 -- 172.21.15.72:0/299763437 shutdown_connections 2023-10-03T10:15:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.041+0000 7f41824bb700 1 --2- 172.21.15.72:0/299763437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f417c09e410 0x7f417c1c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.041+0000 7f41824bb700 1 --2- 172.21.15.72:0/299763437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f417c09d6f0 0x7f417c1c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.041+0000 7f41824bb700 1 --2- 172.21.15.72:0/299763437 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f417c09e000 0x7f417c1c6990 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.041+0000 7f41824bb700 1 -- 172.21.15.72:0/299763437 >> 172.21.15.72:0/299763437 conn(0x7f417c066f50 msgr2=0x7f417c119480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.041+0000 7f41824bb700 1 -- 172.21.15.72:0/299763437 shutdown_connections 2023-10-03T10:15:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.041+0000 7f41824bb700 1 -- 172.21.15.72:0/299763437 wait complete. 2023-10-03T10:15:18.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:18.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.078+0000 7f3477a9f700 1 -- 172.21.15.72:0/705939855 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f34701220b0 con 0x7f34700a0a30 2023-10-03T10:15:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.078+0000 7f34667fc700 1 -- 172.21.15.72:0/705939855 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f34701220b0 con 0x7f34700a0a30 2023-10-03T10:15:18.079 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.080+0000 7f3477a9f700 1 -- 172.21.15.72:0/705939855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34700a0a30 msgr2=0x7f34701c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.080+0000 7f3477a9f700 1 --2- 172.21.15.72:0/705939855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34700a0a30 0x7f34701c8540 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f346000ebe0 tx=0x7f346000eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.080+0000 7f3477a9f700 1 -- 172.21.15.72:0/705939855 shutdown_connections 2023-10-03T10:15:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.080+0000 7f3477a9f700 1 --2- 172.21.15.72:0/705939855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f347009d630 0x7f34701c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.080+0000 7f3477a9f700 1 --2- 172.21.15.72:0/705939855 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3470133930 0x7f34701c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.080+0000 7f3477a9f700 1 --2- 172.21.15.72:0/705939855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34700a0a30 0x7f34701c8540 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.080+0000 7f3477a9f700 1 -- 172.21.15.72:0/705939855 >> 172.21.15.72:0/705939855 conn(0x7f34700a3050 msgr2=0x7f347009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.080+0000 7f3477a9f700 1 -- 172.21.15.72:0/705939855 shutdown_connections 2023-10-03T10:15:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.080+0000 7f3477a9f700 1 -- 172.21.15.72:0/705939855 wait complete. 2023-10-03T10:15:18.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:18.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.254+0000 7f5b31b05700 1 Processor -- start 2023-10-03T10:15:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.254+0000 7f5b31b05700 1 -- start start 2023-10-03T10:15:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.254+0000 7f5b31b05700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5b2c09d9f0 0x7f5b2c136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.254+0000 7f5b31b05700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b2c136a70 0x7f5b2c138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.254+0000 7f5b31b05700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2c09e130 con 0x7f5b2c1316c0 2023-10-03T10:15:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.254+0000 7f5b31b05700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c1321a0 con 0x7f5b2c09d9f0 2023-10-03T10:15:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.254+0000 7f5b31b05700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c1312b0 con 0x7f5b2c136a70 2023-10-03T10:15:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.255+0000 7f5b2affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5b2c09d9f0 0x7f5b2c136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.255+0000 7f5b2bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b2c136a70 0x7f5b2c138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.255+0000 7f5b2affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5b2c09d9f0 0x7f5b2c136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49148/0 (socket says 172.21.15.72:49148) 2023-10-03T10:15:18.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.255+0000 7f5b2affd700 1 -- 172.21.15.72:0/519789221 learned_addr learned my addr 172.21.15.72:0/519789221 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:18.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.255+0000 7f5b2bfff700 1 -- 172.21.15.72:0/519789221 >> v2:172.21.15.72:3300/0 conn(0x7f5b2c09d9f0 msgr2=0x7f5b2c136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.255+0000 7f5b2bfff700 1 --2- 172.21.15.72:0/519789221 >> v2:172.21.15.72:3300/0 conn(0x7f5b2c09d9f0 0x7f5b2c136530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.255+0000 7f5b2bfff700 1 -- 172.21.15.72:0/519789221 >> v1:172.21.15.72:6789/0 conn(0x7f5b2c1316c0 legacy=0x7f5b2c131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.255+0000 7f5b2bfff700 1 -- 172.21.15.72:0/519789221 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c09f6e0 con 0x7f5b2c136a70 2023-10-03T10:15:18.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.255+0000 7f5b2bfff700 1 --2- 172.21.15.72:0/519789221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b2c136a70 0x7f5b2c138e50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009dc0 tx=0x7f5b2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f38b48b12c79621d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.255+0000 7f5b2a7fc700 1 -- 172.21.15.72:0/519789221 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2400e070 con 0x7f5b2c136a70 2023-10-03T10:15:18.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.255+0000 7f5b2a7fc700 1 -- 172.21.15.72:0/519789221 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2400bae0 con 0x7f5b2c136a70 2023-10-03T10:15:18.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.255+0000 7f5b2a7fc700 1 -- 172.21.15.72:0/519789221 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2400be90 con 0x7f5b2c136a70 2023-10-03T10:15:18.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.256+0000 7f5b31b05700 1 -- 172.21.15.72:0/519789221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b2c136a70 msgr2=0x7f5b2c138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.256+0000 7f5b31b05700 1 --2- 172.21.15.72:0/519789221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b2c136a70 0x7f5b2c138e50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009dc0 tx=0x7f5b2400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.256+0000 7f5b31b05700 1 -- 172.21.15.72:0/519789221 shutdown_connections 2023-10-03T10:15:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.256+0000 7f5b31b05700 1 --2- 172.21.15.72:0/519789221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b2c136a70 0x7f5b2c138e50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.256+0000 7f5b31b05700 1 --2- 172.21.15.72:0/519789221 >> v2:172.21.15.72:3300/0 conn(0x7f5b2c09d9f0 0x7f5b2c136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.256+0000 7f5b31b05700 1 -- 172.21.15.72:0/519789221 >> 172.21.15.72:0/519789221 conn(0x7f5b2c066f50 msgr2=0x7f5b2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.256+0000 7f5b31b05700 1 -- 172.21.15.72:0/519789221 shutdown_connections 2023-10-03T10:15:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.256+0000 7f5b31b05700 1 -- 172.21.15.72:0/519789221 wait complete. 2023-10-03T10:15:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.257+0000 7f5b31b05700 1 Processor -- start 2023-10-03T10:15:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.257+0000 7f5b31b05700 1 -- start start 2023-10-03T10:15:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.257+0000 7f5b31b05700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b2c09d9f0 0x7f5b2c070de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.257+0000 7f5b31b05700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b2c1316c0 0x7f5b2c071320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.257+0000 7f5b31b05700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b2c136a70 0x7f5b2c071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.257+0000 7f5b31b05700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c135570 con 0x7f5b2c09d9f0 2023-10-03T10:15:18.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.257+0000 7f5b31b05700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c06fc60 con 0x7f5b2c1316c0 2023-10-03T10:15:18.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.257+0000 7f5b31b05700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c070200 con 0x7f5b2c136a70 2023-10-03T10:15:18.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.257+0000 7f5b2b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b2c09d9f0 0x7f5b2c070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.257+0000 7f5b2bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b2c136a70 0x7f5b2c071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.257+0000 7f5b2affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b2c1316c0 0x7f5b2c071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.257+0000 7f5b2b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b2c09d9f0 0x7f5b2c070de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49160/0 (socket says 172.21.15.72:49160) 2023-10-03T10:15:18.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.257+0000 7f5b2b7fe700 1 -- 172.21.15.72:0/2669878417 learned_addr learned my addr 172.21.15.72:0/2669878417 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:18.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.258+0000 7f5b2b7fe700 1 -- 172.21.15.72:0/2669878417 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b2c136a70 msgr2=0x7f5b2c071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.258+0000 7f5b2b7fe700 1 --2- 172.21.15.72:0/2669878417 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b2c136a70 0x7f5b2c071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.258+0000 7f5b2b7fe700 1 -- 172.21.15.72:0/2669878417 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b2c1316c0 msgr2=0x7f5b2c071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.258+0000 7f5b2b7fe700 1 --2- 172.21.15.72:0/2669878417 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b2c1316c0 0x7f5b2c071320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.258+0000 7f5b2b7fe700 1 -- 172.21.15.72:0/2669878417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b24009a70 con 0x7f5b2c09d9f0 2023-10-03T10:15:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.258+0000 7f5b2bfff700 1 --2- 172.21.15.72:0/2669878417 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b2c136a70 0x7f5b2c071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.258+0000 7f5b2affd700 1 --2- 172.21.15.72:0/2669878417 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b2c1316c0 0x7f5b2c071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.258+0000 7f5b2b7fe700 1 --2- 172.21.15.72:0/2669878417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b2c09d9f0 0x7f5b2c070de0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000c4e0 tx=0x7f5b2000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.258+0000 7f5b13fff700 1 -- 172.21.15.72:0/2669878417 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200052d0 con 0x7f5b2c09d9f0 2023-10-03T10:15:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.258+0000 7f5b13fff700 1 -- 172.21.15.72:0/2669878417 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b20005430 con 0x7f5b2c09d9f0 2023-10-03T10:15:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.258+0000 7f5b31b05700 1 -- 172.21.15.72:0/2669878417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c071da0 con 0x7f5b2c09d9f0 2023-10-03T10:15:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.258+0000 7f5b13fff700 1 -- 172.21.15.72:0/2669878417 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200038c0 con 0x7f5b2c09d9f0 2023-10-03T10:15:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.258+0000 7f5b31b05700 1 -- 172.21.15.72:0/2669878417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c070990 con 0x7f5b2c09d9f0 2023-10-03T10:15:18.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.259+0000 7f5b13fff700 1 -- 172.21.15.72:0/2669878417 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b20003a20 con 0x7f5b2c09d9f0 2023-10-03T10:15:18.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.259+0000 7f5b13fff700 1 -- 172.21.15.72:0/2669878417 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5b2003e8f0 con 0x7f5b2c09d9f0 2023-10-03T10:15:18.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.259+0000 7f5b31b05700 1 -- 172.21.15.72:0/2669878417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c135e20 con 0x7f5b2c09d9f0 2023-10-03T10:15:18.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.263+0000 7f5b13fff700 1 -- 172.21.15.72:0/2669878417 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b20017070 con 0x7f5b2c09d9f0 2023-10-03T10:15:18.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.447+0000 7f5b31b05700 1 -- 172.21.15.72:0/2669878417 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5b2c09e130 con 0x7f5b2c09d9f0 2023-10-03T10:15:18.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.447+0000 7f5b13fff700 1 -- 172.21.15.72:0/2669878417 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b2c09e130 con 0x7f5b2c09d9f0 2023-10-03T10:15:18.448 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:18.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.449+0000 7f5b31b05700 1 -- 172.21.15.72:0/2669878417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b2c09d9f0 msgr2=0x7f5b2c070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.449+0000 7f5b31b05700 1 --2- 172.21.15.72:0/2669878417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b2c09d9f0 0x7f5b2c070de0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000c4e0 tx=0x7f5b2000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.449+0000 7f5b31b05700 1 -- 172.21.15.72:0/2669878417 shutdown_connections 2023-10-03T10:15:18.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.450+0000 7f5b31b05700 1 --2- 172.21.15.72:0/2669878417 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b2c09d9f0 0x7f5b2c070de0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.450+0000 7f5b31b05700 1 --2- 172.21.15.72:0/2669878417 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b2c136a70 0x7f5b2c071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.450+0000 7f5b31b05700 1 --2- 172.21.15.72:0/2669878417 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b2c1316c0 0x7f5b2c071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.450+0000 7f5b31b05700 1 -- 172.21.15.72:0/2669878417 >> 172.21.15.72:0/2669878417 conn(0x7f5b2c066f50 msgr2=0x7f5b2c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.450+0000 7f5b31b05700 1 -- 172.21.15.72:0/2669878417 shutdown_connections 2023-10-03T10:15:18.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.450+0000 7f5b31b05700 1 -- 172.21.15.72:0/2669878417 wait complete. 2023-10-03T10:15:18.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:18.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:18.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.917+0000 7f12723d2700 1 Processor -- start 2023-10-03T10:15:18.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.917+0000 7f12723d2700 1 -- start start 2023-10-03T10:15:18.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.918+0000 7f12723d2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f126c12cf60 0x7f126c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.918+0000 7f12723d2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f126c12f8b0 0x7f126c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.918+0000 7f12723d2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c12cd90 con 0x7f126c130260 2023-10-03T10:15:18.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.918+0000 7f12723d2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c12d330 con 0x7f126c12f8b0 2023-10-03T10:15:18.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.918+0000 7f12723d2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f126c1306e0 con 0x7f126c12cf60 2023-10-03T10:15:18.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.918+0000 7f126b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f126c12f8b0 0x7f126c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.918+0000 7f126bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f126c12cf60 0x7f126c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.918+0000 7f126b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f126c12f8b0 0x7f126c12fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49166/0 (socket says 172.21.15.72:49166) 2023-10-03T10:15:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.918+0000 7f126bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f126c12cf60 0x7f126c06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41936/0 (socket says 172.21.15.72:41936) 2023-10-03T10:15:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.918+0000 7f126b7fe700 1 -- 172.21.15.72:0/2294170661 learned_addr learned my addr 172.21.15.72:0/2294170661 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.918+0000 7f126b7fe700 1 -- 172.21.15.72:0/2294170661 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f126c12cf60 msgr2=0x7f126c06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.918+0000 7f126b7fe700 1 --2- 172.21.15.72:0/2294170661 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f126c12cf60 0x7f126c06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.918+0000 7f126b7fe700 1 -- 172.21.15.72:0/2294170661 >> v1:172.21.15.72:6789/0 conn(0x7f126c130260 legacy=0x7f126c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.918+0000 7f126b7fe700 1 -- 172.21.15.72:0/2294170661 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c071780 con 0x7f126c12f8b0 2023-10-03T10:15:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.919+0000 7f126b7fe700 1 --2- 172.21.15.72:0/2294170661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c12f8b0 0x7f126c12fd20 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f125c0098f0 tx=0x7f125c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb890349d24da58a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.919+0000 7f126affd700 1 -- 172.21.15.72:0/2294170661 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c00f8a0 con 0x7f126c12f8b0 2023-10-03T10:15:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.919+0000 7f126affd700 1 -- 172.21.15.72:0/2294170661 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c00fa00 con 0x7f126c12f8b0 2023-10-03T10:15:18.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.919+0000 7f126affd700 1 -- 172.21.15.72:0/2294170661 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c00fd90 con 0x7f126c12f8b0 2023-10-03T10:15:18.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.919+0000 7f12723d2700 1 -- 172.21.15.72:0/2294170661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c12f8b0 msgr2=0x7f126c12fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.919+0000 7f12723d2700 1 --2- 172.21.15.72:0/2294170661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c12f8b0 0x7f126c12fd20 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f125c0098f0 tx=0x7f125c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:18.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.919+0000 7f12723d2700 1 -- 172.21.15.72:0/2294170661 shutdown_connections 2023-10-03T10:15:18.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.919+0000 7f12723d2700 1 --2- 172.21.15.72:0/2294170661 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f126c12cf60 0x7f126c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.919+0000 7f12723d2700 1 --2- 172.21.15.72:0/2294170661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c12f8b0 0x7f126c12fd20 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.919+0000 7f12723d2700 1 -- 172.21.15.72:0/2294170661 >> 172.21.15.72:0/2294170661 conn(0x7f126c0a2aa0 msgr2=0x7f126c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.919+0000 7f12723d2700 1 -- 172.21.15.72:0/2294170661 shutdown_connections 2023-10-03T10:15:18.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.919+0000 7f12723d2700 1 -- 172.21.15.72:0/2294170661 wait complete. 2023-10-03T10:15:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.920+0000 7f12723d2700 1 Processor -- start 2023-10-03T10:15:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.921+0000 7f12723d2700 1 -- start start 2023-10-03T10:15:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.921+0000 7f12723d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f126c12cf60 0x7f126c09bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.921+0000 7f12723d2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f126c12f8b0 0x7f126c09c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.921+0000 7f12723d2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c130260 0x7f126c1c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.921+0000 7f12723d2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c12f6f0 con 0x7f126c130260 2023-10-03T10:15:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.921+0000 7f12723d2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c09e990 con 0x7f126c12cf60 2023-10-03T10:15:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.921+0000 7f12723d2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f126c09b6c0 con 0x7f126c12f8b0 2023-10-03T10:15:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.921+0000 7f126bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f126c12cf60 0x7f126c09bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.921+0000 7f127096f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c130260 0x7f126c1c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.921+0000 7f126bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f126c12cf60 0x7f126c09bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58444/0 (socket says 172.21.15.72:58444) 2023-10-03T10:15:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.921+0000 7f126bfff700 1 -- 172.21.15.72:0/2498895313 learned_addr learned my addr 172.21.15.72:0/2498895313 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.922+0000 7f126b7fe700 1 --2- 172.21.15.72:0/2498895313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f126c12f8b0 0x7f126c09c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.922+0000 7f126bfff700 1 -- 172.21.15.72:0/2498895313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f126c12f8b0 msgr2=0x7f126c09c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.922+0000 7f126bfff700 1 --2- 172.21.15.72:0/2498895313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f126c12f8b0 0x7f126c09c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.922+0000 7f126bfff700 1 -- 172.21.15.72:0/2498895313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c130260 msgr2=0x7f126c1c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.922+0000 7f126bfff700 1 --2- 172.21.15.72:0/2498895313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c130260 0x7f126c1c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.922+0000 7f126bfff700 1 -- 172.21.15.72:0/2498895313 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c009550 con 0x7f126c12cf60 2023-10-03T10:15:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.922+0000 7f127096f700 1 --2- 172.21.15.72:0/2498895313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c130260 0x7f126c1c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.922+0000 7f126bfff700 1 --2- 172.21.15.72:0/2498895313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f126c12cf60 0x7f126c09bbb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f126000e9b0 tx=0x7f126000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.922+0000 7f1268ff9700 1 -- 172.21.15.72:0/2498895313 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260009710 con 0x7f126c12cf60 2023-10-03T10:15:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.922+0000 7f1268ff9700 1 -- 172.21.15.72:0/2498895313 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126000ee50 con 0x7f126c12cf60 2023-10-03T10:15:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.922+0000 7f12723d2700 1 -- 172.21.15.72:0/2498895313 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c09c630 con 0x7f126c12cf60 2023-10-03T10:15:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.922+0000 7f1268ff9700 1 -- 172.21.15.72:0/2498895313 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126000ca50 con 0x7f126c12cf60 2023-10-03T10:15:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.922+0000 7f12723d2700 1 -- 172.21.15.72:0/2498895313 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c09cdc0 con 0x7f126c12cf60 2023-10-03T10:15:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.923+0000 7f1268ff9700 1 -- 172.21.15.72:0/2498895313 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f126000cbb0 con 0x7f126c12cf60 2023-10-03T10:15:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.923+0000 7f1268ff9700 1 -- 172.21.15.72:0/2498895313 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f126003f9f0 con 0x7f126c12cf60 2023-10-03T10:15:18.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.923+0000 7f12723d2700 1 -- 172.21.15.72:0/2498895313 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c09e7f0 con 0x7f126c12cf60 2023-10-03T10:15:18.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:18.928+0000 7f1268ff9700 1 -- 172.21.15.72:0/2498895313 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f126c09e7f0 con 0x7f126c12cf60 2023-10-03T10:15:19.055 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:19.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:19.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.116+0000 7f12723d2700 1 -- 172.21.15.72:0/2498895313 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f126c09e7f0 con 0x7f126c12cf60 2023-10-03T10:15:19.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.116+0000 7f1268ff9700 1 -- 172.21.15.72:0/2498895313 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f126c09e7f0 con 0x7f126c12cf60 2023-10-03T10:15:19.117 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:19.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.119+0000 7f12723d2700 1 -- 172.21.15.72:0/2498895313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f126c12cf60 msgr2=0x7f126c09bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.119+0000 7f12723d2700 1 --2- 172.21.15.72:0/2498895313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f126c12cf60 0x7f126c09bbb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f126000e9b0 tx=0x7f126000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.119+0000 7f12723d2700 1 -- 172.21.15.72:0/2498895313 shutdown_connections 2023-10-03T10:15:19.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.119+0000 7f12723d2700 1 --2- 172.21.15.72:0/2498895313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f126c130260 0x7f126c1c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.119+0000 7f12723d2700 1 --2- 172.21.15.72:0/2498895313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f126c12cf60 0x7f126c09bbb0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.119+0000 7f12723d2700 1 --2- 172.21.15.72:0/2498895313 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f126c12f8b0 0x7f126c09c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.119+0000 7f12723d2700 1 -- 172.21.15.72:0/2498895313 >> 172.21.15.72:0/2498895313 conn(0x7f126c0a2aa0 msgr2=0x7f126c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.120+0000 7f12723d2700 1 -- 172.21.15.72:0/2498895313 shutdown_connections 2023-10-03T10:15:19.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.120+0000 7f12723d2700 1 -- 172.21.15.72:0/2498895313 wait complete. 2023-10-03T10:15:19.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.179+0000 7fdab8c37700 1 Processor -- start 2023-10-03T10:15:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.180+0000 7fdab8c37700 1 -- start start 2023-10-03T10:15:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.180+0000 7fdab8c37700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdab4130540 0x7fdab4130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.180+0000 7fdab8c37700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdab4130e50 0x7fdab406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.180+0000 7fdab8c37700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdab406fb20 0x7fdab406ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab8c37700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab40704b0 con 0x7fdab4130e50 2023-10-03T10:15:19.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab8c37700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab409a390 con 0x7fdab406fb20 2023-10-03T10:15:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab8c37700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40716a0 con 0x7fdab4130540 2023-10-03T10:15:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdab4130540 0x7fdab4130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdab406fb20 0x7fdab406ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdab4130e50 0x7fdab406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdab4130540 0x7fdab4130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41952/0 (socket says 172.21.15.72:41952) 2023-10-03T10:15:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdab406fb20 0x7fdab406ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58452/0 (socket says 172.21.15.72:58452) 2023-10-03T10:15:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab259c700 1 -- 172.21.15.72:0/2417114786 learned_addr learned my addr 172.21.15.72:0/2417114786 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab259c700 1 -- 172.21.15.72:0/2417114786 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdab406fb20 msgr2=0x7fdab406ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab259c700 1 --2- 172.21.15.72:0/2417114786 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdab406fb20 0x7fdab406ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab259c700 1 -- 172.21.15.72:0/2417114786 >> v2:172.21.15.72:3300/0 conn(0x7fdab4130e50 msgr2=0x7fdab406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab259c700 1 --2- 172.21.15.72:0/2417114786 >> v2:172.21.15.72:3300/0 conn(0x7fdab4130e50 0x7fdab406f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab259c700 1 -- 172.21.15.72:0/2417114786 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab4071290 con 0x7fdab4130540 2023-10-03T10:15:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab2d9d700 1 --2- 172.21.15.72:0/2417114786 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdab406fb20 0x7fdab406ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab1d9b700 1 --2- 172.21.15.72:0/2417114786 >> v2:172.21.15.72:3300/0 conn(0x7fdab4130e50 0x7fdab406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab259c700 1 --2- 172.21.15.72:0/2417114786 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdab4130540 0x7fdab4130910 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400bbc0 tx=0x7fdaa400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbb89178f5ce69d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab159a700 1 -- 172.21.15.72:0/2417114786 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa400dcf0 con 0x7fdab4130540 2023-10-03T10:15:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab159a700 1 -- 172.21.15.72:0/2417114786 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa400de50 con 0x7fdab4130540 2023-10-03T10:15:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.181+0000 7fdab159a700 1 -- 172.21.15.72:0/2417114786 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4010690 con 0x7fdab4130540 2023-10-03T10:15:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.182+0000 7fdab8c37700 1 -- 172.21.15.72:0/2417114786 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdab4130540 msgr2=0x7fdab4130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.182+0000 7fdab8c37700 1 --2- 172.21.15.72:0/2417114786 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdab4130540 0x7fdab4130910 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400bbc0 tx=0x7fdaa400bed0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.182+0000 7fdab8c37700 1 -- 172.21.15.72:0/2417114786 shutdown_connections 2023-10-03T10:15:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.182+0000 7fdab8c37700 1 --2- 172.21.15.72:0/2417114786 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdab406fb20 0x7fdab406ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.182+0000 7fdab8c37700 1 --2- 172.21.15.72:0/2417114786 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdab4130540 0x7fdab4130910 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.182+0000 7fdab8c37700 1 --2- 172.21.15.72:0/2417114786 >> v2:172.21.15.72:3300/0 conn(0x7fdab4130e50 0x7fdab406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.182+0000 7fdab8c37700 1 -- 172.21.15.72:0/2417114786 >> 172.21.15.72:0/2417114786 conn(0x7fdab40a2aa0 msgr2=0x7fdab40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.182+0000 7fdab8c37700 1 -- 172.21.15.72:0/2417114786 shutdown_connections 2023-10-03T10:15:19.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.182+0000 7fdab8c37700 1 -- 172.21.15.72:0/2417114786 wait complete. 2023-10-03T10:15:19.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.183+0000 7fdab8c37700 1 Processor -- start 2023-10-03T10:15:19.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.184+0000 7fdab8c37700 1 -- start start 2023-10-03T10:15:19.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.184+0000 7fdab8c37700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdab406fb20 0x7fdab4118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.184+0000 7fdab8c37700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdab4130540 0x7fdab4119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.184+0000 7fdab8c37700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdab4130e50 0x7fdab4119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.184+0000 7fdab8c37700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab411b430 con 0x7fdab4130e50 2023-10-03T10:15:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.184+0000 7fdab8c37700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40a0ce0 con 0x7fdab406fb20 2023-10-03T10:15:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.184+0000 7fdab8c37700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdab411a710 con 0x7fdab4130540 2023-10-03T10:15:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.184+0000 7fdab2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdab4130e50 0x7fdab4119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.184+0000 7fdab259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdab406fb20 0x7fdab4118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.184+0000 7fdab1d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdab4130540 0x7fdab4119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.184+0000 7fdab259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdab406fb20 0x7fdab4118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58454/0 (socket says 172.21.15.72:58454) 2023-10-03T10:15:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.184+0000 7fdab259c700 1 -- 172.21.15.72:0/695417398 learned_addr learned my addr 172.21.15.72:0/695417398 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.185+0000 7fdab2d9d700 1 -- 172.21.15.72:0/695417398 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdab4130540 msgr2=0x7fdab4119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.185+0000 7fdab2d9d700 1 --2- 172.21.15.72:0/695417398 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdab4130540 0x7fdab4119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.185+0000 7fdab2d9d700 1 -- 172.21.15.72:0/695417398 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdab406fb20 msgr2=0x7fdab4118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.185+0000 7fdab2d9d700 1 --2- 172.21.15.72:0/695417398 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdab406fb20 0x7fdab4118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.185+0000 7fdab2d9d700 1 -- 172.21.15.72:0/695417398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac009a70 con 0x7fdab4130e50 2023-10-03T10:15:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.185+0000 7fdab1d9b700 1 --2- 172.21.15.72:0/695417398 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdab4130540 0x7fdab4119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.185+0000 7fdab259c700 1 --2- 172.21.15.72:0/695417398 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdab406fb20 0x7fdab4118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.185+0000 7fdab2d9d700 1 --2- 172.21.15.72:0/695417398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdab4130e50 0x7fdab4119750 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00efc0 tx=0x7fdaac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.185+0000 7fdaa2ffd700 1 -- 172.21.15.72:0/695417398 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac00ca90 con 0x7fdab4130e50 2023-10-03T10:15:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.185+0000 7fdaa2ffd700 1 -- 172.21.15.72:0/695417398 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac00f040 con 0x7fdab4130e50 2023-10-03T10:15:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.185+0000 7fdab8c37700 1 -- 172.21.15.72:0/695417398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa80094a0 con 0x7fdab4130e50 2023-10-03T10:15:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.185+0000 7fdaa2ffd700 1 -- 172.21.15.72:0/695417398 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac00ce30 con 0x7fdab4130e50 2023-10-03T10:15:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.185+0000 7fdab8c37700 1 -- 172.21.15.72:0/695417398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa400b7f0 con 0x7fdab4130e50 2023-10-03T10:15:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.186+0000 7fdaa2ffd700 1 -- 172.21.15.72:0/695417398 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdaac014480 con 0x7fdab4130e50 2023-10-03T10:15:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.186+0000 7fdab8c37700 1 -- 172.21.15.72:0/695417398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab411a1b0 con 0x7fdab4130e50 2023-10-03T10:15:19.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.186+0000 7fdaa2ffd700 1 -- 172.21.15.72:0/695417398 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdaac03fcb0 con 0x7fdab4130e50 2023-10-03T10:15:19.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.191+0000 7fdaa2ffd700 1 -- 172.21.15.72:0/695417398 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdaac012340 con 0x7fdab4130e50 2023-10-03T10:15:19.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.223+0000 7fb3017c7700 1 Processor -- start 2023-10-03T10:15:19.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.223+0000 7fb3017c7700 1 -- start start 2023-10-03T10:15:19.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb3017c7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2fc09e930 0x7fb2fc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb3017c7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2fc09f240 0x7fb2fc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb3017c7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2fc070940 con 0x7fb2fc09f650 2023-10-03T10:15:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb3017c7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc06fd60 con 0x7fb2fc09f240 2023-10-03T10:15:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb3017c7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc06fa80 con 0x7fb2fc09e930 2023-10-03T10:15:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb2faffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2fc09e930 0x7fb2fc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb2fa7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2fc09f240 0x7fb2fc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb2fa7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2fc09f240 0x7fb2fc1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49226/0 (socket says 172.21.15.72:49226) 2023-10-03T10:15:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb2faffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2fc09e930 0x7fb2fc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58470/0 (socket says 172.21.15.72:58470) 2023-10-03T10:15:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb2fa7fc700 1 -- 172.21.15.72:0/2190475169 learned_addr learned my addr 172.21.15.72:0/2190475169 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:19.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb2faffd700 1 -- 172.21.15.72:0/2190475169 >> v2:172.21.15.72:3300/0 conn(0x7fb2fc09f240 msgr2=0x7fb2fc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb2faffd700 1 --2- 172.21.15.72:0/2190475169 >> v2:172.21.15.72:3300/0 conn(0x7fb2fc09f240 0x7fb2fc1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb2faffd700 1 -- 172.21.15.72:0/2190475169 >> v1:172.21.15.72:6789/0 conn(0x7fb2fc09f650 legacy=0x7fb2fc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb2faffd700 1 -- 172.21.15.72:0/2190475169 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc09fb60 con 0x7fb2fc09e930 2023-10-03T10:15:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb2f9ffb700 1 -- 172.21.15.72:0/2190475169 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787870152 0 0) 0x7fb2fc070940 con 0x7fb2fc09f650 2023-10-03T10:15:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.224+0000 7fb2fa7fc700 1 --2- 172.21.15.72:0/2190475169 >> v2:172.21.15.72:3300/0 conn(0x7fb2fc09f240 0x7fb2fc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.225+0000 7fb2faffd700 1 --2- 172.21.15.72:0/2190475169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2fc09e930 0x7fb2fc09ed00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009840 tx=0x7fb2ec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d1818ed1db9d12f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.225+0000 7fb2f9ffb700 1 -- 172.21.15.72:0/2190475169 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec011830 con 0x7fb2fc09e930 2023-10-03T10:15:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.225+0000 7fb2f9ffb700 1 -- 172.21.15.72:0/2190475169 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec011990 con 0x7fb2fc09e930 2023-10-03T10:15:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.225+0000 7fb2f9ffb700 1 -- 172.21.15.72:0/2190475169 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec011d20 con 0x7fb2fc09e930 2023-10-03T10:15:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.225+0000 7fb3017c7700 1 -- 172.21.15.72:0/2190475169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2fc09e930 msgr2=0x7fb2fc09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.225+0000 7fb3017c7700 1 --2- 172.21.15.72:0/2190475169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2fc09e930 0x7fb2fc09ed00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009840 tx=0x7fb2ec009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:19.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.225+0000 7fb3017c7700 1 -- 172.21.15.72:0/2190475169 shutdown_connections 2023-10-03T10:15:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.225+0000 7fb3017c7700 1 --2- 172.21.15.72:0/2190475169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2fc09e930 0x7fb2fc09ed00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.225+0000 7fb3017c7700 1 --2- 172.21.15.72:0/2190475169 >> v2:172.21.15.72:3300/0 conn(0x7fb2fc09f240 0x7fb2fc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.225+0000 7fb3017c7700 1 -- 172.21.15.72:0/2190475169 >> 172.21.15.72:0/2190475169 conn(0x7fb2fc0a4210 msgr2=0x7fb2fc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.225+0000 7fb3017c7700 1 -- 172.21.15.72:0/2190475169 shutdown_connections 2023-10-03T10:15:19.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.225+0000 7fb3017c7700 1 -- 172.21.15.72:0/2190475169 wait complete. 2023-10-03T10:15:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.227+0000 7fb3017c7700 1 Processor -- start 2023-10-03T10:15:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.227+0000 7fb3017c7700 1 -- start start 2023-10-03T10:15:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.227+0000 7fb3017c7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2fc09e930 0x7fb2fc1c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.227+0000 7fb3017c7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2fc09f240 0x7fb2fc1c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.227+0000 7fb3017c7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2fc09f650 0x7fb2fc1c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.227+0000 7fb3017c7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc1a7400 con 0x7fb2fc09e930 2023-10-03T10:15:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.227+0000 7fb3017c7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc1a75e0 con 0x7fb2fc09f240 2023-10-03T10:15:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.227+0000 7fb3017c7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc1c38a0 con 0x7fb2fc09f650 2023-10-03T10:15:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.227+0000 7fb2fa7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2fc09f240 0x7fb2fc1c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.227+0000 7fb2faffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2fc09e930 0x7fb2fc1c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.228+0000 7fb2fa7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2fc09f240 0x7fb2fc1c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58478/0 (socket says 172.21.15.72:58478) 2023-10-03T10:15:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.228+0000 7fb2fa7fc700 1 -- 172.21.15.72:0/593589480 learned_addr learned my addr 172.21.15.72:0/593589480 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.228+0000 7fb2faffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2fc09e930 0x7fb2fc1c2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49238/0 (socket says 172.21.15.72:49238) 2023-10-03T10:15:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.228+0000 7fb2fb7fe700 1 --2- 172.21.15.72:0/593589480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2fc09f650 0x7fb2fc1c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.228+0000 7fb2fa7fc700 1 -- 172.21.15.72:0/593589480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2fc09f650 msgr2=0x7fb2fc1c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.228+0000 7fb2fa7fc700 1 --2- 172.21.15.72:0/593589480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2fc09f650 0x7fb2fc1c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.228+0000 7fb2fa7fc700 1 -- 172.21.15.72:0/593589480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2fc09e930 msgr2=0x7fb2fc1c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.228+0000 7fb2fa7fc700 1 --2- 172.21.15.72:0/593589480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2fc09e930 0x7fb2fc1c2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.228+0000 7fb2fa7fc700 1 -- 172.21.15.72:0/593589480 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0009550 con 0x7fb2fc09f240 2023-10-03T10:15:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.228+0000 7fb2fa7fc700 1 --2- 172.21.15.72:0/593589480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2fc09f240 0x7fb2fc1c3360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000ec10 tx=0x7fb2f000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.228+0000 7fb2e37fe700 1 -- 172.21.15.72:0/593589480 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000c850 con 0x7fb2fc09f240 2023-10-03T10:15:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.228+0000 7fb2e37fe700 1 -- 172.21.15.72:0/593589480 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000c9b0 con 0x7fb2fc09f240 2023-10-03T10:15:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.228+0000 7fb3017c7700 1 -- 172.21.15.72:0/593589480 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec0094a0 con 0x7fb2fc09f240 2023-10-03T10:15:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.228+0000 7fb2e37fe700 1 -- 172.21.15.72:0/593589480 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000cd60 con 0x7fb2fc09f240 2023-10-03T10:15:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.228+0000 7fb3017c7700 1 -- 172.21.15.72:0/593589480 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc0a0190 con 0x7fb2fc09f240 2023-10-03T10:15:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.229+0000 7fb2e37fe700 1 -- 172.21.15.72:0/593589480 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2f0013470 con 0x7fb2fc09f240 2023-10-03T10:15:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.229+0000 7fb2e37fe700 1 -- 172.21.15.72:0/593589480 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb2f003f770 con 0x7fb2fc09f240 2023-10-03T10:15:19.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.229+0000 7fb3017c7700 1 -- 172.21.15.72:0/593589480 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2fc074ea0 con 0x7fb2fc09f240 2023-10-03T10:15:19.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.234+0000 7fb2e37fe700 1 -- 172.21.15.72:0/593589480 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2f0021070 con 0x7fb2fc09f240 2023-10-03T10:15:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.385+0000 7fdab8c37700 1 -- 172.21.15.72:0/695417398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdab411bc00 con 0x7fdab4130e50 2023-10-03T10:15:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.386+0000 7fdaa2ffd700 1 -- 172.21.15.72:0/695417398 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdaac012340 con 0x7fdab4130e50 2023-10-03T10:15:19.387 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.388+0000 7fdab8c37700 1 -- 172.21.15.72:0/695417398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdab4130e50 msgr2=0x7fdab4119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.388+0000 7fdab8c37700 1 --2- 172.21.15.72:0/695417398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdab4130e50 0x7fdab4119750 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00efc0 tx=0x7fdaac00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.388+0000 7fdab8c37700 1 -- 172.21.15.72:0/695417398 shutdown_connections 2023-10-03T10:15:19.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.388+0000 7fdab8c37700 1 --2- 172.21.15.72:0/695417398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdab4130e50 0x7fdab4119750 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.388+0000 7fdab8c37700 1 --2- 172.21.15.72:0/695417398 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdab406fb20 0x7fdab4118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.388+0000 7fdab8c37700 1 --2- 172.21.15.72:0/695417398 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdab4130540 0x7fdab4119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.388+0000 7fdab8c37700 1 -- 172.21.15.72:0/695417398 >> 172.21.15.72:0/695417398 conn(0x7fdab40a2aa0 msgr2=0x7fdab412d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.388+0000 7fdab8c37700 1 -- 172.21.15.72:0/695417398 shutdown_connections 2023-10-03T10:15:19.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.388+0000 7fdab8c37700 1 -- 172.21.15.72:0/695417398 wait complete. 2023-10-03T10:15:19.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:19.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.427+0000 7fb3017c7700 1 -- 172.21.15.72:0/593589480 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb2fc1a56d0 con 0x7fb2fc09f240 2023-10-03T10:15:19.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.428+0000 7fb2e37fe700 1 -- 172.21.15.72:0/593589480 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb2f00232f0 con 0x7fb2fc09f240 2023-10-03T10:15:19.428 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:19.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.430+0000 7fb3017c7700 1 -- 172.21.15.72:0/593589480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2fc09f240 msgr2=0x7fb2fc1c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.430+0000 7fb3017c7700 1 --2- 172.21.15.72:0/593589480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2fc09f240 0x7fb2fc1c3360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000ec10 tx=0x7fb2f000ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:19.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.430+0000 7fb3017c7700 1 -- 172.21.15.72:0/593589480 shutdown_connections 2023-10-03T10:15:19.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.430+0000 7fb3017c7700 1 --2- 172.21.15.72:0/593589480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2fc09e930 0x7fb2fc1c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.430+0000 7fb3017c7700 1 --2- 172.21.15.72:0/593589480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2fc09f650 0x7fb2fc1c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.430+0000 7fb3017c7700 1 --2- 172.21.15.72:0/593589480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2fc09f240 0x7fb2fc1c3360 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.430+0000 7fb3017c7700 1 -- 172.21.15.72:0/593589480 >> 172.21.15.72:0/593589480 conn(0x7fb2fc0a4210 msgr2=0x7fb2fc1b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.430+0000 7fb3017c7700 1 -- 172.21.15.72:0/593589480 shutdown_connections 2023-10-03T10:15:19.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.430+0000 7fb3017c7700 1 -- 172.21.15.72:0/593589480 wait complete. 2023-10-03T10:15:19.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:19.463 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.604+0000 7fc58ab04700 1 Processor -- start 2023-10-03T10:15:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.604+0000 7fc58ab04700 1 -- start start 2023-10-03T10:15:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc58ab04700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc584133420 0x7fc5841337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc58ab04700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc584133e30 0x7fc58412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc58ab04700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc584134260 0x7fc5841304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc58ab04700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58406b990 con 0x7fc584133e30 2023-10-03T10:15:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc58ab04700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840a0590 con 0x7fc584134260 2023-10-03T10:15:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc58ab04700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc58409fb80 con 0x7fc584133420 2023-10-03T10:15:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc5888a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc584133420 0x7fc5841337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc583fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc584133e30 0x7fc58412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc5890a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc584134260 0x7fc5841304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc5888a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc584133420 0x7fc5841337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41978/0 (socket says 172.21.15.72:41978) 2023-10-03T10:15:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc5890a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc584134260 0x7fc5841304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58490/0 (socket says 172.21.15.72:58490) 2023-10-03T10:15:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc583fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc584133e30 0x7fc58412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49240/0 (socket says 172.21.15.72:49240) 2023-10-03T10:15:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc5888a0700 1 -- 172.21.15.72:0/757638282 learned_addr learned my addr 172.21.15.72:0/757638282 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc5888a0700 1 -- 172.21.15.72:0/757638282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc584134260 msgr2=0x7fc5841304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc5888a0700 1 --2- 172.21.15.72:0/757638282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc584134260 0x7fc5841304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc5888a0700 1 -- 172.21.15.72:0/757638282 >> v2:172.21.15.72:3300/0 conn(0x7fc584133e30 msgr2=0x7fc58412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc5888a0700 1 --2- 172.21.15.72:0/757638282 >> v2:172.21.15.72:3300/0 conn(0x7fc584133e30 0x7fc58412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc5888a0700 1 -- 172.21.15.72:0/757638282 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5840a0030 con 0x7fc584133420 2023-10-03T10:15:19.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc5890a1700 1 --2- 172.21.15.72:0/757638282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc584134260 0x7fc5841304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc583fff700 1 --2- 172.21.15.72:0/757638282 >> v2:172.21.15.72:3300/0 conn(0x7fc584133e30 0x7fc58412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc5888a0700 1 --2- 172.21.15.72:0/757638282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc584133420 0x7fc5841337f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc5780098f0 tx=0x7fc578009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a935c1aceba83dc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc5837fe700 1 -- 172.21.15.72:0/757638282 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578011830 con 0x7fc584133420 2023-10-03T10:15:19.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc5837fe700 1 -- 172.21.15.72:0/757638282 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc578011990 con 0x7fc584133420 2023-10-03T10:15:19.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.605+0000 7fc5837fe700 1 -- 172.21.15.72:0/757638282 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578011d20 con 0x7fc584133420 2023-10-03T10:15:19.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.606+0000 7fc58ab04700 1 -- 172.21.15.72:0/757638282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc584133420 msgr2=0x7fc5841337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.606+0000 7fc58ab04700 1 --2- 172.21.15.72:0/757638282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc584133420 0x7fc5841337f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc5780098f0 tx=0x7fc578009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:19.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.606+0000 7fc58ab04700 1 -- 172.21.15.72:0/757638282 shutdown_connections 2023-10-03T10:15:19.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.606+0000 7fc58ab04700 1 --2- 172.21.15.72:0/757638282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc584134260 0x7fc5841304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.606+0000 7fc58ab04700 1 --2- 172.21.15.72:0/757638282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc584133420 0x7fc5841337f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.606+0000 7fc58ab04700 1 --2- 172.21.15.72:0/757638282 >> v2:172.21.15.72:3300/0 conn(0x7fc584133e30 0x7fc58412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.606+0000 7fc58ab04700 1 -- 172.21.15.72:0/757638282 >> 172.21.15.72:0/757638282 conn(0x7fc5840a4210 msgr2=0x7fc5840a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.606+0000 7fc58ab04700 1 -- 172.21.15.72:0/757638282 shutdown_connections 2023-10-03T10:15:19.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.606+0000 7fc58ab04700 1 -- 172.21.15.72:0/757638282 wait complete. 2023-10-03T10:15:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.607+0000 7fc58ab04700 1 Processor -- start 2023-10-03T10:15:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.607+0000 7fc58ab04700 1 -- start start 2023-10-03T10:15:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.607+0000 7fc58ab04700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc584133420 0x7fc58409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.607+0000 7fc58ab04700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc584133e30 0x7fc58409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.607+0000 7fc58ab04700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc584134260 0x7fc58409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.607+0000 7fc58ab04700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58409dff0 con 0x7fc584133e30 2023-10-03T10:15:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.607+0000 7fc58ab04700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58409de00 con 0x7fc584134260 2023-10-03T10:15:19.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.607+0000 7fc58ab04700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc58411f150 con 0x7fc584133420 2023-10-03T10:15:19.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc5888a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc584133420 0x7fc58409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc5888a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc584133420 0x7fc58409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41984/0 (socket says 172.21.15.72:41984) 2023-10-03T10:15:19.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc5888a0700 1 -- 172.21.15.72:0/3482892537 learned_addr learned my addr 172.21.15.72:0/3482892537 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:19.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc583fff700 1 --2- 172.21.15.72:0/3482892537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc584133e30 0x7fc58409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc5890a1700 1 --2- 172.21.15.72:0/3482892537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc584134260 0x7fc58409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc5888a0700 1 -- 172.21.15.72:0/3482892537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc584134260 msgr2=0x7fc58409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc5888a0700 1 --2- 172.21.15.72:0/3482892537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc584134260 0x7fc58409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc5888a0700 1 -- 172.21.15.72:0/3482892537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc584133e30 msgr2=0x7fc58409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc5888a0700 1 --2- 172.21.15.72:0/3482892537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc584133e30 0x7fc58409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc5888a0700 1 -- 172.21.15.72:0/3482892537 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5700094a0 con 0x7fc584133420 2023-10-03T10:15:19.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc5888a0700 1 --2- 172.21.15.72:0/3482892537 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc584133420 0x7fc58409c480 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc578009c40 tx=0x7fc578004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc5817fa700 1 -- 172.21.15.72:0/3482892537 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578004240 con 0x7fc584133420 2023-10-03T10:15:19.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc5817fa700 1 -- 172.21.15.72:0/3482892537 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57801f070 con 0x7fc584133420 2023-10-03T10:15:19.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc58ab04700 1 -- 172.21.15.72:0/3482892537 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57c009a70 con 0x7fc584133420 2023-10-03T10:15:19.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc5817fa700 1 -- 172.21.15.72:0/3482892537 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5780045c0 con 0x7fc584133420 2023-10-03T10:15:19.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.608+0000 7fc58ab04700 1 -- 172.21.15.72:0/3482892537 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc578009550 con 0x7fc584133420 2023-10-03T10:15:19.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.609+0000 7fc5817fa700 1 -- 172.21.15.72:0/3482892537 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc578021030 con 0x7fc584133420 2023-10-03T10:15:19.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.609+0000 7fc5817fa700 1 -- 172.21.15.72:0/3482892537 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc578040760 con 0x7fc584133420 2023-10-03T10:15:19.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.609+0000 7fc58ab04700 1 -- 172.21.15.72:0/3482892537 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58411f4d0 con 0x7fc584133420 2023-10-03T10:15:19.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.614+0000 7fc5817fa700 1 -- 172.21.15.72:0/3482892537 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc578015080 con 0x7fc584133420 2023-10-03T10:15:19.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.799+0000 7fc58ab04700 1 -- 172.21.15.72:0/3482892537 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc584131490 con 0x7fc584133420 2023-10-03T10:15:19.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.799+0000 7fc5817fa700 1 -- 172.21.15.72:0/3482892537 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc57801a450 con 0x7fc584133420 2023-10-03T10:15:19.800 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:19.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.802+0000 7fc58ab04700 1 -- 172.21.15.72:0/3482892537 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc584133420 msgr2=0x7fc58409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.802+0000 7fc58ab04700 1 --2- 172.21.15.72:0/3482892537 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc584133420 0x7fc58409c480 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc578009c40 tx=0x7fc578004750 comp rx=0 tx=0).stop 2023-10-03T10:15:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.802+0000 7fc58ab04700 1 -- 172.21.15.72:0/3482892537 shutdown_connections 2023-10-03T10:15:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.802+0000 7fc58ab04700 1 --2- 172.21.15.72:0/3482892537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc584134260 0x7fc58409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.802+0000 7fc58ab04700 1 --2- 172.21.15.72:0/3482892537 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc584133420 0x7fc58409c480 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.802+0000 7fc58ab04700 1 --2- 172.21.15.72:0/3482892537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc584133e30 0x7fc58409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.802+0000 7fc58ab04700 1 -- 172.21.15.72:0/3482892537 >> 172.21.15.72:0/3482892537 conn(0x7fc5840a4210 msgr2=0x7fc5840a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.802+0000 7fc58ab04700 1 -- 172.21.15.72:0/3482892537 shutdown_connections 2023-10-03T10:15:19.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:19.802+0000 7fc58ab04700 1 -- 172.21.15.72:0/3482892537 wait complete. 2023-10-03T10:15:19.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:20.135 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:20.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.258+0000 7f600e90d700 1 Processor -- start 2023-10-03T10:15:20.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.258+0000 7f600e90d700 1 -- start start 2023-10-03T10:15:20.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f600e90d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f600809d6f0 0x7f600809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f600e90d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600809e000 0x7f6008130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f600e90d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600809f130 con 0x7f600809e410 2023-10-03T10:15:20.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f600e90d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600809f520 con 0x7f600809d6f0 2023-10-03T10:15:20.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f600e90d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600809e930 con 0x7f600809e000 2023-10-03T10:15:20.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f60077fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600809e000 0x7f6008130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f6007fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f600809d6f0 0x7f600809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f60077fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600809e000 0x7f6008130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58520/0 (socket says 172.21.15.72:58520) 2023-10-03T10:15:20.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f60077fe700 1 -- 172.21.15.72:0/2906511635 learned_addr learned my addr 172.21.15.72:0/2906511635 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:20.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f60077fe700 1 -- 172.21.15.72:0/2906511635 >> v2:172.21.15.72:3300/0 conn(0x7f600809d6f0 msgr2=0x7f600809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:20.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f60077fe700 1 --2- 172.21.15.72:0/2906511635 >> v2:172.21.15.72:3300/0 conn(0x7f600809d6f0 0x7f600809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f60077fe700 1 -- 172.21.15.72:0/2906511635 >> v1:172.21.15.72:6789/0 conn(0x7f600809e410 legacy=0x7f6008130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f60077fe700 1 -- 172.21.15.72:0/2906511635 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600809b2d0 con 0x7f600809e000 2023-10-03T10:15:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f6007fff700 1 --2- 172.21.15.72:0/2906511635 >> v2:172.21.15.72:3300/0 conn(0x7f600809d6f0 0x7f600809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f60077fe700 1 --2- 172.21.15.72:0/2906511635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600809e000 0x7f6008130660 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800bb90 tx=0x7f5ff800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45289fe74792bb4f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f6006ffd700 1 -- 172.21.15.72:0/2906511635 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff800dd30 con 0x7f600809e000 2023-10-03T10:15:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f6006ffd700 1 -- 172.21.15.72:0/2906511635 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff800de90 con 0x7f600809e000 2023-10-03T10:15:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.259+0000 7f6006ffd700 1 -- 172.21.15.72:0/2906511635 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8010690 con 0x7f600809e000 2023-10-03T10:15:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.260+0000 7f600e90d700 1 -- 172.21.15.72:0/2906511635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600809e000 msgr2=0x7f6008130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.260+0000 7f600e90d700 1 --2- 172.21.15.72:0/2906511635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600809e000 0x7f6008130660 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800bb90 tx=0x7f5ff800bea0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.260+0000 7f600e90d700 1 -- 172.21.15.72:0/2906511635 shutdown_connections 2023-10-03T10:15:20.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.260+0000 7f600e90d700 1 --2- 172.21.15.72:0/2906511635 >> v2:172.21.15.72:3300/0 conn(0x7f600809d6f0 0x7f600809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.260+0000 7f600e90d700 1 --2- 172.21.15.72:0/2906511635 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600809e000 0x7f6008130660 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.260+0000 7f600e90d700 1 -- 172.21.15.72:0/2906511635 >> 172.21.15.72:0/2906511635 conn(0x7f6008066f50 msgr2=0x7f600809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.260+0000 7f600e90d700 1 -- 172.21.15.72:0/2906511635 shutdown_connections 2023-10-03T10:15:20.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.260+0000 7f600e90d700 1 -- 172.21.15.72:0/2906511635 wait complete. 2023-10-03T10:15:20.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.261+0000 7f600e90d700 1 Processor -- start 2023-10-03T10:15:20.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.261+0000 7f600e90d700 1 -- start start 2023-10-03T10:15:20.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.261+0000 7f600e90d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600809d6f0 0x7f600811e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.261+0000 7f600e90d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600809e000 0x7f600811e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.261+0000 7f600e90d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600809e410 0x7f600811eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.261+0000 7f600e90d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6008121930 con 0x7f600809e410 2023-10-03T10:15:20.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.261+0000 7f600e90d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600809c700 con 0x7f600809d6f0 2023-10-03T10:15:20.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.261+0000 7f600e90d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6008130390 con 0x7f600809e000 2023-10-03T10:15:20.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.261+0000 7f60077fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600809e000 0x7f600811e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.261+0000 7f6007fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600809d6f0 0x7f600811e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.261+0000 7f600ceaa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600809e410 0x7f600811eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.261+0000 7f60077fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600809e000 0x7f600811e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41992/0 (socket says 172.21.15.72:41992) 2023-10-03T10:15:20.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.261+0000 7f6007fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600809d6f0 0x7f600811e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58522/0 (socket says 172.21.15.72:58522) 2023-10-03T10:15:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.261+0000 7f60077fe700 1 -- 172.21.15.72:0/4115818134 learned_addr learned my addr 172.21.15.72:0/4115818134 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.262+0000 7f60077fe700 1 -- 172.21.15.72:0/4115818134 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600809d6f0 msgr2=0x7f600811e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.262+0000 7f60077fe700 1 --2- 172.21.15.72:0/4115818134 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600809d6f0 0x7f600811e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.262+0000 7f60077fe700 1 -- 172.21.15.72:0/4115818134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600809e410 msgr2=0x7f600811eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.262+0000 7f60077fe700 1 --2- 172.21.15.72:0/4115818134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600809e410 0x7f600811eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.262+0000 7f60077fe700 1 -- 172.21.15.72:0/4115818134 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc0094a0 con 0x7f600809e000 2023-10-03T10:15:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.262+0000 7f600ceaa700 1 --2- 172.21.15.72:0/4115818134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600809e410 0x7f600811eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.262+0000 7f60077fe700 1 --2- 172.21.15.72:0/4115818134 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600809e000 0x7f600811e5d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800bee0 tx=0x7f5ff8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.262+0000 7f6004ff9700 1 -- 172.21.15.72:0/4115818134 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff801f070 con 0x7f600809e000 2023-10-03T10:15:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.262+0000 7f6004ff9700 1 -- 172.21.15.72:0/4115818134 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff8003970 con 0x7f600809e000 2023-10-03T10:15:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.262+0000 7f600e90d700 1 -- 172.21.15.72:0/4115818134 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff800b7f0 con 0x7f600809e000 2023-10-03T10:15:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.262+0000 7f6004ff9700 1 -- 172.21.15.72:0/4115818134 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8003d40 con 0x7f600809e000 2023-10-03T10:15:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.262+0000 7f600e90d700 1 -- 172.21.15.72:0/4115818134 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6008120960 con 0x7f600809e000 2023-10-03T10:15:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.263+0000 7f6004ff9700 1 -- 172.21.15.72:0/4115818134 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ff8019400 con 0x7f600809e000 2023-10-03T10:15:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.263+0000 7f6004ff9700 1 -- 172.21.15.72:0/4115818134 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5ff8043160 con 0x7f600809e000 2023-10-03T10:15:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.263+0000 7f600e90d700 1 -- 172.21.15.72:0/4115818134 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6008121a70 con 0x7f600809e000 2023-10-03T10:15:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.268+0000 7f6004ff9700 1 -- 172.21.15.72:0/4115818134 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ff8019890 con 0x7f600809e000 2023-10-03T10:15:20.401 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:20.443 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:20.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.456+0000 7f600e90d700 1 -- 172.21.15.72:0/4115818134 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6008074ea0 con 0x7f600809e000 2023-10-03T10:15:20.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.456+0000 7f6004ff9700 1 -- 172.21.15.72:0/4115818134 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5ff8022370 con 0x7f600809e000 2023-10-03T10:15:20.457 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:20.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.459+0000 7f600e90d700 1 -- 172.21.15.72:0/4115818134 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600809e000 msgr2=0x7f600811e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.459+0000 7f600e90d700 1 --2- 172.21.15.72:0/4115818134 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600809e000 0x7f600811e5d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800bee0 tx=0x7f5ff8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:20.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.459+0000 7f600e90d700 1 -- 172.21.15.72:0/4115818134 shutdown_connections 2023-10-03T10:15:20.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.459+0000 7f600e90d700 1 --2- 172.21.15.72:0/4115818134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600809e410 0x7f600811eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.459+0000 7f600e90d700 1 --2- 172.21.15.72:0/4115818134 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600809d6f0 0x7f600811e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.459+0000 7f600e90d700 1 --2- 172.21.15.72:0/4115818134 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600809e000 0x7f600811e5d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.459+0000 7f600e90d700 1 -- 172.21.15.72:0/4115818134 >> 172.21.15.72:0/4115818134 conn(0x7f6008066f50 msgr2=0x7f600806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.459+0000 7f600e90d700 1 -- 172.21.15.72:0/4115818134 shutdown_connections 2023-10-03T10:15:20.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.459+0000 7f600e90d700 1 -- 172.21.15.72:0/4115818134 wait complete. 2023-10-03T10:15:20.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.530+0000 7f134a8d4700 1 Processor -- start 2023-10-03T10:15:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.530+0000 7f134a8d4700 1 -- start start 2023-10-03T10:15:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f134a8d4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f134409d6f0 0x7f134409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f134a8d4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f134409e440 0x7f1344134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f134a8d4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134409b120 con 0x7f134409e000 2023-10-03T10:15:20.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f134a8d4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134406b460 con 0x7f134409d6f0 2023-10-03T10:15:20.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f134a8d4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134409a7e0 con 0x7f134409e440 2023-10-03T10:15:20.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f1343fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f134409d6f0 0x7f134409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f1348e71700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f134409e440 0x7f1344134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f1348e71700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f134409e440 0x7f1344134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58524/0 (socket says 172.21.15.72:58524) 2023-10-03T10:15:20.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f1343fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f134409d6f0 0x7f134409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49266/0 (socket says 172.21.15.72:49266) 2023-10-03T10:15:20.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f1348e71700 1 -- 172.21.15.72:0/2109949519 learned_addr learned my addr 172.21.15.72:0/2109949519 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:20.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f1348e71700 1 -- 172.21.15.72:0/2109949519 >> v2:172.21.15.72:3300/0 conn(0x7f134409d6f0 msgr2=0x7f134409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:20.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f1348e71700 1 --2- 172.21.15.72:0/2109949519 >> v2:172.21.15.72:3300/0 conn(0x7f134409d6f0 0x7f134409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f1348e71700 1 -- 172.21.15.72:0/2109949519 >> v1:172.21.15.72:6789/0 conn(0x7f134409e000 legacy=0x7f13441339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f1348e71700 1 -- 172.21.15.72:0/2109949519 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134409a500 con 0x7f134409e440 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f1342ffd700 1 -- 172.21.15.72:0/2109949519 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172686186 0 0) 0x7f134409b120 con 0x7f134409e000 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f1343fff700 1 --2- 172.21.15.72:0/2109949519 >> v2:172.21.15.72:3300/0 conn(0x7f134409d6f0 0x7f134409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f1348e71700 1 --2- 172.21.15.72:0/2109949519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f134409e440 0x7f1344134100 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f133c009e80 tx=0x7f133c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23df94f1c7d94a67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.531+0000 7f1342ffd700 1 -- 172.21.15.72:0/2109949519 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c00e070 con 0x7f134409e440 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.532+0000 7f1342ffd700 1 -- 172.21.15.72:0/2109949519 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c00b8d0 con 0x7f134409e440 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.532+0000 7f1342ffd700 1 -- 172.21.15.72:0/2109949519 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c00bc80 con 0x7f134409e440 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.532+0000 7f134a8d4700 1 -- 172.21.15.72:0/2109949519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f134409e440 msgr2=0x7f1344134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.532+0000 7f134a8d4700 1 --2- 172.21.15.72:0/2109949519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f134409e440 0x7f1344134100 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f133c009e80 tx=0x7f133c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.532+0000 7f134a8d4700 1 -- 172.21.15.72:0/2109949519 shutdown_connections 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.532+0000 7f134a8d4700 1 --2- 172.21.15.72:0/2109949519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f134409e440 0x7f1344134100 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.532+0000 7f134a8d4700 1 --2- 172.21.15.72:0/2109949519 >> v2:172.21.15.72:3300/0 conn(0x7f134409d6f0 0x7f134409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.532+0000 7f134a8d4700 1 -- 172.21.15.72:0/2109949519 >> 172.21.15.72:0/2109949519 conn(0x7f1344066f50 msgr2=0x7f134409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.532+0000 7f134a8d4700 1 -- 172.21.15.72:0/2109949519 shutdown_connections 2023-10-03T10:15:20.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.532+0000 7f134a8d4700 1 -- 172.21.15.72:0/2109949519 wait complete. 2023-10-03T10:15:20.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.533+0000 7f134a8d4700 1 Processor -- start 2023-10-03T10:15:20.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.533+0000 7f134a8d4700 1 -- start start 2023-10-03T10:15:20.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f134a8d4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f134409d6f0 0x7f13441a5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f134a8d4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f134409e000 0x7f13441a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f134a8d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f134409e440 0x7f13441c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f134a8d4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13441a4e30 con 0x7f134409e440 2023-10-03T10:15:20.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f134a8d4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13441b9180 con 0x7f134409e000 2023-10-03T10:15:20.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f134a8d4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13440a2c20 con 0x7f134409d6f0 2023-10-03T10:15:20.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f1348e71700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f134409e440 0x7f13441c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f13437fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f134409e000 0x7f13441a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f1348e71700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f134409e440 0x7f13441c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49272/0 (socket says 172.21.15.72:49272) 2023-10-03T10:15:20.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f1348e71700 1 -- 172.21.15.72:0/3978072621 learned_addr learned my addr 172.21.15.72:0/3978072621 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:20.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f1343fff700 1 --2- 172.21.15.72:0/3978072621 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f134409d6f0 0x7f13441a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f1348e71700 1 -- 172.21.15.72:0/3978072621 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f134409d6f0 msgr2=0x7f13441a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f1348e71700 1 --2- 172.21.15.72:0/3978072621 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f134409d6f0 0x7f13441a5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f1348e71700 1 -- 172.21.15.72:0/3978072621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f134409e000 msgr2=0x7f13441a58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f1348e71700 1 --2- 172.21.15.72:0/3978072621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f134409e000 0x7f13441a58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f1348e71700 1 -- 172.21.15.72:0/3978072621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13340094a0 con 0x7f134409e440 2023-10-03T10:15:20.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.534+0000 7f1348e71700 1 --2- 172.21.15.72:0/3978072621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f134409e440 0x7f13441c8020 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f133c00b680 tx=0x7f133c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.535+0000 7f1340ff9700 1 -- 172.21.15.72:0/3978072621 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c0092e0 con 0x7f134409e440 2023-10-03T10:15:20.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.535+0000 7f1340ff9700 1 -- 172.21.15.72:0/3978072621 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c004270 con 0x7f134409e440 2023-10-03T10:15:20.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.535+0000 7f1340ff9700 1 -- 172.21.15.72:0/3978072621 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c004640 con 0x7f134409e440 2023-10-03T10:15:20.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.535+0000 7f134a8d4700 1 -- 172.21.15.72:0/3978072621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c009b30 con 0x7f134409e440 2023-10-03T10:15:20.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.535+0000 7f134a8d4700 1 -- 172.21.15.72:0/3978072621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134409c710 con 0x7f134409e440 2023-10-03T10:15:20.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.536+0000 7f1340ff9700 1 -- 172.21.15.72:0/3978072621 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f133c028070 con 0x7f134409e440 2023-10-03T10:15:20.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.536+0000 7f134a8d4700 1 -- 172.21.15.72:0/3978072621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1344074ea0 con 0x7f134409e440 2023-10-03T10:15:20.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.536+0000 7f1340ff9700 1 -- 172.21.15.72:0/3978072621 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f133c0495b0 con 0x7f134409e440 2023-10-03T10:15:20.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.541+0000 7f1340ff9700 1 -- 172.21.15.72:0/3978072621 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f133c0047a0 con 0x7f134409e440 2023-10-03T10:15:20.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.573+0000 7fe4c75d4700 1 Processor -- start 2023-10-03T10:15:20.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.573+0000 7fe4c75d4700 1 -- start start 2023-10-03T10:15:20.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c75d4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4c00a0a30 0x7fe4c00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c75d4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4c009d630 0x7fe4c00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c75d4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c0133930 0x7fe4c0133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c75d4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c00a2a70 con 0x7fe4c009d630 2023-10-03T10:15:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c75d4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c00a01d0 con 0x7fe4c0133930 2023-10-03T10:15:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c75d4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c009e2b0 con 0x7fe4c00a0a30 2023-10-03T10:15:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c5370700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4c00a0a30 0x7fe4c00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c5b71700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c0133930 0x7fe4c0133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c4b6f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4c009d630 0x7fe4c00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c5b71700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c0133930 0x7fe4c0133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58552/0 (socket says 172.21.15.72:58552) 2023-10-03T10:15:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c5b71700 1 -- 172.21.15.72:0/4257859265 learned_addr learned my addr 172.21.15.72:0/4257859265 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c5370700 1 --2- 172.21.15.72:0/4257859265 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4c00a0a30 0x7fe4c00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42000/0 (socket says 172.21.15.72:42000) 2023-10-03T10:15:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c4b6f700 1 -- 172.21.15.72:0/4257859265 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4c00a0a30 msgr2=0x7fe4c00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c4b6f700 1 --2- 172.21.15.72:0/4257859265 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4c00a0a30 0x7fe4c00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c4b6f700 1 -- 172.21.15.72:0/4257859265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c0133930 msgr2=0x7fe4c0133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:20.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c4b6f700 1 --2- 172.21.15.72:0/4257859265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c0133930 0x7fe4c0133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c4b6f700 1 -- 172.21.15.72:0/4257859265 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c009dc50 con 0x7fe4c009d630 2023-10-03T10:15:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c5370700 1 --2- 172.21.15.72:0/4257859265 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4c00a0a30 0x7fe4c00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.574+0000 7fe4c5b71700 1 --2- 172.21.15.72:0/4257859265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c0133930 0x7fe4c0133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.575+0000 7fe4c4b6f700 1 --2- 172.21.15.72:0/4257859265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c009d630 0x7fe4c00a1340 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0009840 tx=0x7fe4b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2200761c10bba2c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.575+0000 7fe4b7fff700 1 -- 172.21.15.72:0/4257859265 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0011830 con 0x7fe4c009d630 2023-10-03T10:15:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.575+0000 7fe4b7fff700 1 -- 172.21.15.72:0/4257859265 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b0011990 con 0x7fe4c009d630 2023-10-03T10:15:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.575+0000 7fe4b7fff700 1 -- 172.21.15.72:0/4257859265 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0011d20 con 0x7fe4c009d630 2023-10-03T10:15:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.575+0000 7fe4c75d4700 1 -- 172.21.15.72:0/4257859265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c009d630 msgr2=0x7fe4c00a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.575+0000 7fe4c75d4700 1 --2- 172.21.15.72:0/4257859265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c009d630 0x7fe4c00a1340 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0009840 tx=0x7fe4b0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.575+0000 7fe4c75d4700 1 -- 172.21.15.72:0/4257859265 shutdown_connections 2023-10-03T10:15:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.575+0000 7fe4c75d4700 1 --2- 172.21.15.72:0/4257859265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c0133930 0x7fe4c0133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.575+0000 7fe4c75d4700 1 --2- 172.21.15.72:0/4257859265 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4c00a0a30 0x7fe4c00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.575+0000 7fe4c75d4700 1 --2- 172.21.15.72:0/4257859265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c009d630 0x7fe4c00a1340 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.575+0000 7fe4c75d4700 1 -- 172.21.15.72:0/4257859265 >> 172.21.15.72:0/4257859265 conn(0x7fe4c00a3050 msgr2=0x7fe4c00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.575+0000 7fe4c75d4700 1 -- 172.21.15.72:0/4257859265 shutdown_connections 2023-10-03T10:15:20.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.575+0000 7fe4c75d4700 1 -- 172.21.15.72:0/4257859265 wait complete. 2023-10-03T10:15:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.576+0000 7fe4c75d4700 1 Processor -- start 2023-10-03T10:15:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.576+0000 7fe4c75d4700 1 -- start start 2023-10-03T10:15:20.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c75d4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4c009d630 0x7fe4c011f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c75d4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c00a0a30 0x7fe4c011fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c75d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c0133930 0x7fe4c01c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c75d4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c01222e0 con 0x7fe4c0133930 2023-10-03T10:15:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c75d4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c0122800 con 0x7fe4c00a0a30 2023-10-03T10:15:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c75d4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c0133430 con 0x7fe4c009d630 2023-10-03T10:15:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c5370700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4c009d630 0x7fe4c011f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c5370700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4c009d630 0x7fe4c011f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42006/0 (socket says 172.21.15.72:42006) 2023-10-03T10:15:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c5370700 1 -- 172.21.15.72:0/3654474308 learned_addr learned my addr 172.21.15.72:0/3654474308 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c5b71700 1 --2- 172.21.15.72:0/3654474308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c0133930 0x7fe4c01c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c4b6f700 1 --2- 172.21.15.72:0/3654474308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c00a0a30 0x7fe4c011fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c5370700 1 -- 172.21.15.72:0/3654474308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c00a0a30 msgr2=0x7fe4c011fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c5370700 1 --2- 172.21.15.72:0/3654474308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c00a0a30 0x7fe4c011fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c5370700 1 -- 172.21.15.72:0/3654474308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c0133930 msgr2=0x7fe4c01c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c5370700 1 --2- 172.21.15.72:0/3654474308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c0133930 0x7fe4c01c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c5370700 1 -- 172.21.15.72:0/3654474308 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc0094a0 con 0x7fe4c009d630 2023-10-03T10:15:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c5b71700 1 --2- 172.21.15.72:0/3654474308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c0133930 0x7fe4c01c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c4b6f700 1 --2- 172.21.15.72:0/3654474308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c00a0a30 0x7fe4c011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4c5370700 1 --2- 172.21.15.72:0/3654474308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4c009d630 0x7fe4c011f500 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00ec10 tx=0x7fe4bc00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.577+0000 7fe4b5ffb700 1 -- 172.21.15.72:0/3654474308 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc00c910 con 0x7fe4c009d630 2023-10-03T10:15:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.578+0000 7fe4b5ffb700 1 -- 172.21.15.72:0/3654474308 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc00ca70 con 0x7fe4c009d630 2023-10-03T10:15:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.578+0000 7fe4b5ffb700 1 -- 172.21.15.72:0/3654474308 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc00cde0 con 0x7fe4c009d630 2023-10-03T10:15:20.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.578+0000 7fe4c75d4700 1 -- 172.21.15.72:0/3654474308 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b8009b30 con 0x7fe4c009d630 2023-10-03T10:15:20.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.578+0000 7fe4c75d4700 1 -- 172.21.15.72:0/3654474308 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b00094a0 con 0x7fe4c009d630 2023-10-03T10:15:20.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.578+0000 7fe4b5ffb700 1 -- 172.21.15.72:0/3654474308 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4bc013470 con 0x7fe4c009d630 2023-10-03T10:15:20.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.579+0000 7fe4b5ffb700 1 -- 172.21.15.72:0/3654474308 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe4bc03fbe0 con 0x7fe4c009d630 2023-10-03T10:15:20.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.579+0000 7fe4c75d4700 1 -- 172.21.15.72:0/3654474308 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c0122420 con 0x7fe4c009d630 2023-10-03T10:15:20.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.584+0000 7fe4b5ffb700 1 -- 172.21.15.72:0/3654474308 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4c0122420 con 0x7fe4c009d630 2023-10-03T10:15:20.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.738+0000 7f134a8d4700 1 -- 172.21.15.72:0/3978072621 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f134409f420 con 0x7f134409e440 2023-10-03T10:15:20.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.738+0000 7f1340ff9700 1 -- 172.21.15.72:0/3978072621 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f133c02a750 con 0x7f134409e440 2023-10-03T10:15:20.739 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.740+0000 7f134a8d4700 1 -- 172.21.15.72:0/3978072621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f134409e440 msgr2=0x7f13441c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.740+0000 7f134a8d4700 1 --2- 172.21.15.72:0/3978072621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f134409e440 0x7f13441c8020 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f133c00b680 tx=0x7f133c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.740+0000 7f134a8d4700 1 -- 172.21.15.72:0/3978072621 shutdown_connections 2023-10-03T10:15:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.740+0000 7f134a8d4700 1 --2- 172.21.15.72:0/3978072621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f134409e440 0x7f13441c8020 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.740+0000 7f134a8d4700 1 --2- 172.21.15.72:0/3978072621 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f134409d6f0 0x7f13441a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.740+0000 7f134a8d4700 1 --2- 172.21.15.72:0/3978072621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f134409e000 0x7f13441a58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.740+0000 7f134a8d4700 1 -- 172.21.15.72:0/3978072621 >> 172.21.15.72:0/3978072621 conn(0x7f1344066f50 msgr2=0x7f13440a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.740+0000 7f134a8d4700 1 -- 172.21.15.72:0/3978072621 shutdown_connections 2023-10-03T10:15:20.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.740+0000 7f134a8d4700 1 -- 172.21.15.72:0/3978072621 wait complete. 2023-10-03T10:15:20.753 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.775+0000 7fe4c75d4700 1 -- 172.21.15.72:0/3654474308 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe4c0121f60 con 0x7fe4c009d630 2023-10-03T10:15:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.776+0000 7fe4b5ffb700 1 -- 172.21.15.72:0/3654474308 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe4c0121f60 con 0x7fe4c009d630 2023-10-03T10:15:20.776 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:20.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.778+0000 7fe4c75d4700 1 -- 172.21.15.72:0/3654474308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4c009d630 msgr2=0x7fe4c011f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.778+0000 7fe4c75d4700 1 --2- 172.21.15.72:0/3654474308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4c009d630 0x7fe4c011f500 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00ec10 tx=0x7fe4bc00ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:20.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.778+0000 7fe4c75d4700 1 -- 172.21.15.72:0/3654474308 shutdown_connections 2023-10-03T10:15:20.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.778+0000 7fe4c75d4700 1 --2- 172.21.15.72:0/3654474308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c0133930 0x7fe4c01c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.778+0000 7fe4c75d4700 1 --2- 172.21.15.72:0/3654474308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4c009d630 0x7fe4c011f500 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.778+0000 7fe4c75d4700 1 --2- 172.21.15.72:0/3654474308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c00a0a30 0x7fe4c011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.778+0000 7fe4c75d4700 1 -- 172.21.15.72:0/3654474308 >> 172.21.15.72:0/3654474308 conn(0x7fe4c00a3050 msgr2=0x7fe4c01bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.778+0000 7fe4c75d4700 1 -- 172.21.15.72:0/3654474308 shutdown_connections 2023-10-03T10:15:20.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.778+0000 7fe4c75d4700 1 -- 172.21.15.72:0/3654474308 wait complete. 2023-10-03T10:15:20.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:20.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:20.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.951+0000 7f400b22b700 1 Processor -- start 2023-10-03T10:15:20.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.951+0000 7f400b22b700 1 -- start start 2023-10-03T10:15:20.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f400b22b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f400409f410 0x7f4004136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f400b22b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4004136fe0 0x7f40041393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f400b22b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4004070940 con 0x7f400409e930 2023-10-03T10:15:20.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f400b22b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400406fd60 con 0x7f4004136fe0 2023-10-03T10:15:20.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f400b22b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f400406fa80 con 0x7f400409f410 2023-10-03T10:15:20.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f4003fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f400409f410 0x7f4004136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f40097c8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4004136fe0 0x7f40041393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f4008fc7700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f400409e930 0x7f400409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54868/0 (socket says 172.21.15.72:54868) 2023-10-03T10:15:20.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f4008fc7700 1 -- 172.21.15.72:0/4091719804 learned_addr learned my addr 172.21.15.72:0/4091719804 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f4003fff700 1 -- 172.21.15.72:0/4091719804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4004136fe0 msgr2=0x7f40041393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f4003fff700 1 --2- 172.21.15.72:0/4091719804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4004136fe0 0x7f40041393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f40037fe700 1 -- 172.21.15.72:0/4091719804 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141729103 0 0) 0x7f4004070940 con 0x7f400409e930 2023-10-03T10:15:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f4003fff700 1 -- 172.21.15.72:0/4091719804 >> v1:172.21.15.72:6789/0 conn(0x7f400409e930 legacy=0x7f400409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f4003fff700 1 -- 172.21.15.72:0/4091719804 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400409fb60 con 0x7f400409f410 2023-10-03T10:15:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f40097c8700 1 --2- 172.21.15.72:0/4091719804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4004136fe0 0x7f40041393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f4003fff700 1 --2- 172.21.15.72:0/4091719804 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f400409f410 0x7f4004136aa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0009870 tx=0x7f3ff0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b8a889759f36d62 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f40037fe700 1 -- 172.21.15.72:0/4091719804 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0011830 con 0x7f400409f410 2023-10-03T10:15:20.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f40037fe700 1 -- 172.21.15.72:0/4091719804 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff0011990 con 0x7f400409f410 2023-10-03T10:15:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.952+0000 7f40037fe700 1 -- 172.21.15.72:0/4091719804 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0011d20 con 0x7f400409f410 2023-10-03T10:15:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.953+0000 7f400b22b700 1 -- 172.21.15.72:0/4091719804 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f400409f410 msgr2=0x7f4004136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.953+0000 7f400b22b700 1 --2- 172.21.15.72:0/4091719804 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f400409f410 0x7f4004136aa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0009870 tx=0x7f3ff0009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.953+0000 7f400b22b700 1 -- 172.21.15.72:0/4091719804 shutdown_connections 2023-10-03T10:15:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.953+0000 7f400b22b700 1 --2- 172.21.15.72:0/4091719804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4004136fe0 0x7f40041393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.953+0000 7f400b22b700 1 --2- 172.21.15.72:0/4091719804 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f400409f410 0x7f4004136aa0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.953+0000 7f400b22b700 1 -- 172.21.15.72:0/4091719804 >> 172.21.15.72:0/4091719804 conn(0x7f40040a4210 msgr2=0x7f40040a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.953+0000 7f400b22b700 1 -- 172.21.15.72:0/4091719804 shutdown_connections 2023-10-03T10:15:20.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.953+0000 7f400b22b700 1 -- 172.21.15.72:0/4091719804 wait complete. 2023-10-03T10:15:20.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.954+0000 7f400b22b700 1 Processor -- start 2023-10-03T10:15:20.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.954+0000 7f400b22b700 1 -- start start 2023-10-03T10:15:20.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.954+0000 7f400b22b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400409e930 0x7f4004131540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.954+0000 7f400b22b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400409f410 0x7f4004131a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.954+0000 7f400b22b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004136fe0 0x7f400411c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:20.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.954+0000 7f400b22b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4004120490 con 0x7f400409e930 2023-10-03T10:15:20.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.954+0000 7f400b22b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4004071d90 con 0x7f400409f410 2023-10-03T10:15:20.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.954+0000 7f400b22b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f400411e4c0 con 0x7f4004136fe0 2023-10-03T10:15:20.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.954+0000 7f4008fc7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400409e930 0x7f4004131540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f4003fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400409f410 0x7f4004131a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f40097c8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004136fe0 0x7f400411c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:20.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f4008fc7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400409e930 0x7f4004131540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49308/0 (socket says 172.21.15.72:49308) 2023-10-03T10:15:20.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f4008fc7700 1 -- 172.21.15.72:0/3315673854 learned_addr learned my addr 172.21.15.72:0/3315673854 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:20.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f40097c8700 1 -- 172.21.15.72:0/3315673854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400409f410 msgr2=0x7f4004131a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f40097c8700 1 --2- 172.21.15.72:0/3315673854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400409f410 0x7f4004131a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f40097c8700 1 -- 172.21.15.72:0/3315673854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400409e930 msgr2=0x7f4004131540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f40097c8700 1 --2- 172.21.15.72:0/3315673854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400409e930 0x7f4004131540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f40097c8700 1 -- 172.21.15.72:0/3315673854 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc009a70 con 0x7f4004136fe0 2023-10-03T10:15:20.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f4003fff700 1 --2- 172.21.15.72:0/3315673854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400409f410 0x7f4004131a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:20.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f40097c8700 1 --2- 172.21.15.72:0/3315673854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004136fe0 0x7f400411c780 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f40040a07c0 tx=0x7f3ffc00ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:20.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f40017fa700 1 -- 172.21.15.72:0/3315673854 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc00cbc0 con 0x7f4004136fe0 2023-10-03T10:15:20.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f40017fa700 1 -- 172.21.15.72:0/3315673854 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc00f040 con 0x7f4004136fe0 2023-10-03T10:15:20.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f400b22b700 1 -- 172.21.15.72:0/3315673854 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff00094a0 con 0x7f4004136fe0 2023-10-03T10:15:20.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f40017fa700 1 -- 172.21.15.72:0/3315673854 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc014480 con 0x7f4004136fe0 2023-10-03T10:15:20.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.955+0000 7f400b22b700 1 -- 172.21.15.72:0/3315673854 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400411f9e0 con 0x7f4004136fe0 2023-10-03T10:15:20.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.956+0000 7f40017fa700 1 -- 172.21.15.72:0/3315673854 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ffc0145e0 con 0x7f4004136fe0 2023-10-03T10:15:20.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.956+0000 7f40017fa700 1 -- 172.21.15.72:0/3315673854 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3ffc040280 con 0x7f4004136fe0 2023-10-03T10:15:20.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.956+0000 7f400b22b700 1 -- 172.21.15.72:0/3315673854 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40040a4b40 con 0x7f4004136fe0 2023-10-03T10:15:20.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:20.961+0000 7f40017fa700 1 -- 172.21.15.72:0/3315673854 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ffc007920 con 0x7f4004136fe0 2023-10-03T10:15:21.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.144+0000 7f400b22b700 1 -- 172.21.15.72:0/3315673854 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4004074ea0 con 0x7f4004136fe0 2023-10-03T10:15:21.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.144+0000 7f40017fa700 1 -- 172.21.15.72:0/3315673854 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ffc007330 con 0x7f4004136fe0 2023-10-03T10:15:21.145 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:21.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.146+0000 7f400b22b700 1 -- 172.21.15.72:0/3315673854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004136fe0 msgr2=0x7f400411c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.146+0000 7f400b22b700 1 --2- 172.21.15.72:0/3315673854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004136fe0 0x7f400411c780 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f40040a07c0 tx=0x7f3ffc00ef90 comp rx=0 tx=0).stop 2023-10-03T10:15:21.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.146+0000 7f400b22b700 1 -- 172.21.15.72:0/3315673854 shutdown_connections 2023-10-03T10:15:21.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.146+0000 7f400b22b700 1 --2- 172.21.15.72:0/3315673854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f400409e930 0x7f4004131540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.146+0000 7f400b22b700 1 --2- 172.21.15.72:0/3315673854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004136fe0 0x7f400411c780 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.146+0000 7f400b22b700 1 --2- 172.21.15.72:0/3315673854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400409f410 0x7f4004131a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.146+0000 7f400b22b700 1 -- 172.21.15.72:0/3315673854 >> 172.21.15.72:0/3315673854 conn(0x7f40040a4210 msgr2=0x7f40040a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.146+0000 7f400b22b700 1 -- 172.21.15.72:0/3315673854 shutdown_connections 2023-10-03T10:15:21.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.146+0000 7f400b22b700 1 -- 172.21.15.72:0/3315673854 wait complete. 2023-10-03T10:15:21.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:21.473 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:21.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.598+0000 7fabb944a700 1 Processor -- start 2023-10-03T10:15:21.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.598+0000 7fabb944a700 1 -- start start 2023-10-03T10:15:21.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.599+0000 7fabb944a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabb409d6f0 0x7fabb409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.599+0000 7fabb944a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabb409e000 0x7fabb4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.599+0000 7fabb944a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb409f130 con 0x7fabb409e410 2023-10-03T10:15:21.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.599+0000 7fabb944a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb409f520 con 0x7fabb409e000 2023-10-03T10:15:21.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.599+0000 7fabb944a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabb409e930 con 0x7fabb409d6f0 2023-10-03T10:15:21.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.599+0000 7fabb2ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabb409d6f0 0x7fabb409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.599+0000 7fabb27fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabb409e000 0x7fabb4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.599+0000 7fabb2ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabb409d6f0 0x7fabb409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42040/0 (socket says 172.21.15.72:42040) 2023-10-03T10:15:21.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.599+0000 7fabb27fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabb409e000 0x7fabb4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58592/0 (socket says 172.21.15.72:58592) 2023-10-03T10:15:21.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.599+0000 7fabb2ffd700 1 -- 172.21.15.72:0/1937647097 learned_addr learned my addr 172.21.15.72:0/1937647097 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:21.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.600+0000 7fabb27fc700 1 -- 172.21.15.72:0/1937647097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabb409d6f0 msgr2=0x7fabb409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.600+0000 7fabb27fc700 1 --2- 172.21.15.72:0/1937647097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabb409d6f0 0x7fabb409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.600+0000 7fabb27fc700 1 -- 172.21.15.72:0/1937647097 >> v1:172.21.15.72:6789/0 conn(0x7fabb409e410 legacy=0x7fabb4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.600+0000 7fabb27fc700 1 -- 172.21.15.72:0/1937647097 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb409b2d0 con 0x7fabb409e000 2023-10-03T10:15:21.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.600+0000 7fabb1ffb700 1 -- 172.21.15.72:0/1937647097 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279607838 0 0) 0x7fabb409f130 con 0x7fabb409e410 2023-10-03T10:15:21.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.600+0000 7fabb2ffd700 1 --2- 172.21.15.72:0/1937647097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabb409d6f0 0x7fabb409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:21.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.600+0000 7fabb27fc700 1 --2- 172.21.15.72:0/1937647097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabb409e000 0x7fabb4130660 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faba4009870 tx=0x7faba4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb69364ea3373f54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.600+0000 7fabb1ffb700 1 -- 172.21.15.72:0/1937647097 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba4011830 con 0x7fabb409e000 2023-10-03T10:15:21.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.600+0000 7fabb1ffb700 1 -- 172.21.15.72:0/1937647097 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba4011990 con 0x7fabb409e000 2023-10-03T10:15:21.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.600+0000 7fabb1ffb700 1 -- 172.21.15.72:0/1937647097 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba4011d20 con 0x7fabb409e000 2023-10-03T10:15:21.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.600+0000 7fabb944a700 1 -- 172.21.15.72:0/1937647097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabb409e000 msgr2=0x7fabb4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.601+0000 7fabb944a700 1 --2- 172.21.15.72:0/1937647097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabb409e000 0x7fabb4130660 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faba4009870 tx=0x7faba4009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:21.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.601+0000 7fabb944a700 1 -- 172.21.15.72:0/1937647097 shutdown_connections 2023-10-03T10:15:21.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.601+0000 7fabb944a700 1 --2- 172.21.15.72:0/1937647097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabb409d6f0 0x7fabb409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.601+0000 7fabb944a700 1 --2- 172.21.15.72:0/1937647097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabb409e000 0x7fabb4130660 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.601+0000 7fabb944a700 1 -- 172.21.15.72:0/1937647097 >> 172.21.15.72:0/1937647097 conn(0x7fabb4066f50 msgr2=0x7fabb409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.601+0000 7fabb944a700 1 -- 172.21.15.72:0/1937647097 shutdown_connections 2023-10-03T10:15:21.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.601+0000 7fabb944a700 1 -- 172.21.15.72:0/1937647097 wait complete. 2023-10-03T10:15:21.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.602+0000 7fabb944a700 1 Processor -- start 2023-10-03T10:15:21.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.602+0000 7fabb944a700 1 -- start start 2023-10-03T10:15:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb944a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabb409d6f0 0x7fabb411de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb944a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabb409e000 0x7fabb411e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb944a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabb409e410 0x7fabb411e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb944a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb41216c0 con 0x7fabb409d6f0 2023-10-03T10:15:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb944a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb411f9e0 con 0x7fabb409e000 2023-10-03T10:15:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb944a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabb41218c0 con 0x7fabb409e410 2023-10-03T10:15:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabb409d6f0 0x7fabb411de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabb409d6f0 0x7fabb411de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49324/0 (socket says 172.21.15.72:49324) 2023-10-03T10:15:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb2ffd700 1 -- 172.21.15.72:0/1588533481 learned_addr learned my addr 172.21.15.72:0/1588533481 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb37fe700 1 --2- 172.21.15.72:0/1588533481 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabb409e410 0x7fabb411e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb27fc700 1 --2- 172.21.15.72:0/1588533481 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabb409e000 0x7fabb411e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb2ffd700 1 -- 172.21.15.72:0/1588533481 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabb409e410 msgr2=0x7fabb411e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb2ffd700 1 --2- 172.21.15.72:0/1588533481 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabb409e410 0x7fabb411e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb2ffd700 1 -- 172.21.15.72:0/1588533481 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabb409e000 msgr2=0x7fabb411e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb2ffd700 1 --2- 172.21.15.72:0/1588533481 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabb409e000 0x7fabb411e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb2ffd700 1 -- 172.21.15.72:0/1588533481 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba800bb30 con 0x7fabb409d6f0 2023-10-03T10:15:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb2ffd700 1 --2- 172.21.15.72:0/1588533481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabb409d6f0 0x7fabb411de70 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7faba8010fc0 tx=0x7faba800e3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fab9b7fe700 1 -- 172.21.15.72:0/1588533481 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba800eb00 con 0x7fabb409d6f0 2023-10-03T10:15:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fab9b7fe700 1 -- 172.21.15.72:0/1588533481 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba8011040 con 0x7fabb409d6f0 2023-10-03T10:15:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb944a700 1 -- 172.21.15.72:0/1588533481 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba40094a0 con 0x7fabb409d6f0 2023-10-03T10:15:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fab9b7fe700 1 -- 172.21.15.72:0/1588533481 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba800ee80 con 0x7fabb409d6f0 2023-10-03T10:15:21.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.603+0000 7fabb944a700 1 -- 172.21.15.72:0/1588533481 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb4120740 con 0x7fabb409d6f0 2023-10-03T10:15:21.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.604+0000 7fab9b7fe700 1 -- 172.21.15.72:0/1588533481 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faba8016480 con 0x7fabb409d6f0 2023-10-03T10:15:21.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.604+0000 7fab9b7fe700 1 -- 172.21.15.72:0/1588533481 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faba8041f50 con 0x7fabb409d6f0 2023-10-03T10:15:21.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.604+0000 7fabb944a700 1 -- 172.21.15.72:0/1588533481 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb411ac20 con 0x7fabb409d6f0 2023-10-03T10:15:21.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.609+0000 7fab9b7fe700 1 -- 172.21.15.72:0/1588533481 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faba80085d0 con 0x7fabb409d6f0 2023-10-03T10:15:21.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:21.791 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:21.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.798+0000 7fabb944a700 1 -- 172.21.15.72:0/1588533481 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fabb4074ea0 con 0x7fabb409d6f0 2023-10-03T10:15:21.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.798+0000 7fab9b7fe700 1 -- 172.21.15.72:0/1588533481 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7faba802e090 con 0x7fabb409d6f0 2023-10-03T10:15:21.799 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:21.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.800+0000 7fabb944a700 1 -- 172.21.15.72:0/1588533481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabb409d6f0 msgr2=0x7fabb411de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.800+0000 7fabb944a700 1 --2- 172.21.15.72:0/1588533481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabb409d6f0 0x7fabb411de70 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7faba8010fc0 tx=0x7faba800e3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.800+0000 7fabb944a700 1 -- 172.21.15.72:0/1588533481 shutdown_connections 2023-10-03T10:15:21.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.800+0000 7fabb944a700 1 --2- 172.21.15.72:0/1588533481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabb409d6f0 0x7fabb411de70 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.800+0000 7fabb944a700 1 --2- 172.21.15.72:0/1588533481 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabb409e410 0x7fabb411e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.800+0000 7fabb944a700 1 --2- 172.21.15.72:0/1588533481 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabb409e000 0x7fabb411e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.800+0000 7fabb944a700 1 -- 172.21.15.72:0/1588533481 >> 172.21.15.72:0/1588533481 conn(0x7fabb4066f50 msgr2=0x7fabb4130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.800+0000 7fabb944a700 1 -- 172.21.15.72:0/1588533481 shutdown_connections 2023-10-03T10:15:21.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.800+0000 7fabb944a700 1 -- 172.21.15.72:0/1588533481 wait complete. 2023-10-03T10:15:21.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.879+0000 7fc2b29c2700 1 Processor -- start 2023-10-03T10:15:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.880+0000 7fc2b29c2700 1 -- start start 2023-10-03T10:15:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.880+0000 7fc2b29c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ac0a0a30 0x7fc2ac0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.880+0000 7fc2b29c2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2ac09d630 0x7fc2ac0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.880+0000 7fc2b29c2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ac0a2a70 con 0x7fc2ac133930 2023-10-03T10:15:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.880+0000 7fc2b29c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac0a01d0 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.880+0000 7fc2b29c2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac09e2b0 con 0x7fc2ac09d630 2023-10-03T10:15:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.880+0000 7fc2ab7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2ac09d630 0x7fc2ac0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.880+0000 7fc2abfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ac0a0a30 0x7fc2ac0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.880+0000 7fc2b0f5f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc2ac133930 0x7fc2ac133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54876/0 (socket says 172.21.15.72:54876) 2023-10-03T10:15:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.880+0000 7fc2b0f5f700 1 -- 172.21.15.72:0/4147469864 learned_addr learned my addr 172.21.15.72:0/4147469864 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.880+0000 7fc2aaffd700 1 -- 172.21.15.72:0/4147469864 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485303113 0 0) 0x7fc2ac0a2a70 con 0x7fc2ac133930 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.880+0000 7fc2aaffd700 1 -- 172.21.15.72:0/4147469864 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2940035b0 con 0x7fc2ac133930 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.881+0000 7fc2abfff700 1 -- 172.21.15.72:0/4147469864 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2ac09d630 msgr2=0x7fc2ac0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.881+0000 7fc2abfff700 1 --2- 172.21.15.72:0/4147469864 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2ac09d630 0x7fc2ac0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.881+0000 7fc2abfff700 1 -- 172.21.15.72:0/4147469864 >> v1:172.21.15.72:6789/0 conn(0x7fc2ac133930 legacy=0x7fc2ac133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.881+0000 7fc2abfff700 1 -- 172.21.15.72:0/4147469864 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac09dc50 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.881+0000 7fc2ab7fe700 1 --2- 172.21.15.72:0/4147469864 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2ac09d630 0x7fc2ac0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.881+0000 7fc2abfff700 1 --2- 172.21.15.72:0/4147469864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ac0a0a30 0x7fc2ac0a0e00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009870 tx=0x7fc29c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f15075a9ed7bcace server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.881+0000 7fc2aaffd700 1 -- 172.21.15.72:0/4147469864 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c011830 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.881+0000 7fc2aaffd700 1 -- 172.21.15.72:0/4147469864 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c011990 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.881+0000 7fc2aaffd700 1 -- 172.21.15.72:0/4147469864 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c011d20 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.881+0000 7fc2b29c2700 1 -- 172.21.15.72:0/4147469864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ac0a0a30 msgr2=0x7fc2ac0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.881+0000 7fc2b29c2700 1 --2- 172.21.15.72:0/4147469864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ac0a0a30 0x7fc2ac0a0e00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009870 tx=0x7fc29c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.882+0000 7fc2b29c2700 1 -- 172.21.15.72:0/4147469864 shutdown_connections 2023-10-03T10:15:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.882+0000 7fc2b29c2700 1 --2- 172.21.15.72:0/4147469864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ac0a0a30 0x7fc2ac0a0e00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.882+0000 7fc2b29c2700 1 --2- 172.21.15.72:0/4147469864 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2ac09d630 0x7fc2ac0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.882+0000 7fc2b29c2700 1 -- 172.21.15.72:0/4147469864 >> 172.21.15.72:0/4147469864 conn(0x7fc2ac0a3050 msgr2=0x7fc2ac0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.882+0000 7fc2b29c2700 1 -- 172.21.15.72:0/4147469864 shutdown_connections 2023-10-03T10:15:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.882+0000 7fc2b29c2700 1 -- 172.21.15.72:0/4147469864 wait complete. 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.882+0000 7fc2b29c2700 1 Processor -- start 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.883+0000 7fc2b29c2700 1 -- start start 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.883+0000 7fc2b29c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ac09d630 0x7fc2ac1327d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.883+0000 7fc2b29c2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2ac0a0a30 0x7fc2ac132d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.883+0000 7fc2b29c2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ac133930 0x7fc2ac1c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.883+0000 7fc2b29c2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac11eef0 con 0x7fc2ac133930 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.883+0000 7fc2b29c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac120600 con 0x7fc2ac09d630 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.883+0000 7fc2b29c2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac1225f0 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.883+0000 7fc2ab7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2ac0a0a30 0x7fc2ac132d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.883+0000 7fc2b0f5f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ac133930 0x7fc2ac1c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.883+0000 7fc2ab7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2ac0a0a30 0x7fc2ac132d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42056/0 (socket says 172.21.15.72:42056) 2023-10-03T10:15:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.883+0000 7fc2ab7fe700 1 -- 172.21.15.72:0/1176457707 learned_addr learned my addr 172.21.15.72:0/1176457707 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.883+0000 7fc2abfff700 1 --2- 172.21.15.72:0/1176457707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ac09d630 0x7fc2ac1327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.883+0000 7fc2ab7fe700 1 -- 172.21.15.72:0/1176457707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ac09d630 msgr2=0x7fc2ac1327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.883+0000 7fc2ab7fe700 1 --2- 172.21.15.72:0/1176457707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ac09d630 0x7fc2ac1327d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.884+0000 7fc2ab7fe700 1 -- 172.21.15.72:0/1176457707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ac133930 msgr2=0x7fc2ac1c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.884+0000 7fc2ab7fe700 1 --2- 172.21.15.72:0/1176457707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ac133930 0x7fc2ac1c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.884+0000 7fc2ab7fe700 1 -- 172.21.15.72:0/1176457707 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a00094a0 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.884+0000 7fc2b0f5f700 1 --2- 172.21.15.72:0/1176457707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ac133930 0x7fc2ac1c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.884+0000 7fc2abfff700 1 --2- 172.21.15.72:0/1176457707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ac09d630 0x7fc2ac1327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.884+0000 7fc2ab7fe700 1 --2- 172.21.15.72:0/1176457707 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2ac0a0a30 0x7fc2ac132d10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc2a000ebb0 tx=0x7fc2a000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.884+0000 7fc2a8ff9700 1 -- 172.21.15.72:0/1176457707 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000c850 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.884+0000 7fc2a8ff9700 1 -- 172.21.15.72:0/1176457707 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a000c9b0 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.884+0000 7fc2a8ff9700 1 -- 172.21.15.72:0/1176457707 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000cd40 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.884+0000 7fc2b29c2700 1 -- 172.21.15.72:0/1176457707 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c0094a0 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.884+0000 7fc2b29c2700 1 -- 172.21.15.72:0/1176457707 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ac121f70 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.885+0000 7fc2b29c2700 1 -- 172.21.15.72:0/1176457707 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ac0747f0 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.885+0000 7fc2a8ff9700 1 -- 172.21.15.72:0/1176457707 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2a0013470 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.885+0000 7fc2a8ff9700 1 -- 172.21.15.72:0/1176457707 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc2a003faf0 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.890+0000 7fc2a8ff9700 1 -- 172.21.15.72:0/1176457707 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2a001b3b0 con 0x7fc2ac0a0a30 2023-10-03T10:15:21.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.922+0000 7fccb06e3700 1 Processor -- start 2023-10-03T10:15:21.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.922+0000 7fccb06e3700 1 -- start start 2023-10-03T10:15:21.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.922+0000 7fccb06e3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcca8133420 0x7fcca81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.922+0000 7fccb06e3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcca8133e30 0x7fcca812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.922+0000 7fccb06e3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca806b990 con 0x7fcca8134260 2023-10-03T10:15:21.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.922+0000 7fccb06e3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80a0590 con 0x7fcca8133e30 2023-10-03T10:15:21.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.922+0000 7fccb06e3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcca809fb80 con 0x7fcca8133420 2023-10-03T10:15:21.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.922+0000 7fccadc7e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcca8133e30 0x7fcca812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.922+0000 7fccaec80700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcca8134260 0x7fcca81304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54884/0 (socket says 172.21.15.72:54884) 2023-10-03T10:15:21.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.922+0000 7fccaec80700 1 -- 172.21.15.72:0/4238142541 learned_addr learned my addr 172.21.15.72:0/4238142541 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:21.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.922+0000 7fccae47f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcca8133420 0x7fcca81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.923+0000 7fccadc7e700 1 -- 172.21.15.72:0/4238142541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcca8133420 msgr2=0x7fcca81337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.923+0000 7fccadc7e700 1 --2- 172.21.15.72:0/4238142541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcca8133420 0x7fcca81337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.923+0000 7fccadc7e700 1 -- 172.21.15.72:0/4238142541 >> v1:172.21.15.72:6789/0 conn(0x7fcca8134260 legacy=0x7fcca81304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.923+0000 7fccadc7e700 1 -- 172.21.15.72:0/4238142541 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca80a0030 con 0x7fcca8133e30 2023-10-03T10:15:21.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.923+0000 7fccadc7e700 1 --2- 172.21.15.72:0/4238142541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcca8133e30 0x7fcca812ff90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009870 tx=0x7fcc98009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c367a3cc04ca15e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.923+0000 7fccad47d700 1 -- 172.21.15.72:0/4238142541 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98011830 con 0x7fcca8133e30 2023-10-03T10:15:21.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.923+0000 7fccad47d700 1 -- 172.21.15.72:0/4238142541 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc98011990 con 0x7fcca8133e30 2023-10-03T10:15:21.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.923+0000 7fccad47d700 1 -- 172.21.15.72:0/4238142541 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98011d20 con 0x7fcca8133e30 2023-10-03T10:15:21.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.924+0000 7fccb06e3700 1 -- 172.21.15.72:0/4238142541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcca8133e30 msgr2=0x7fcca812ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.924+0000 7fccb06e3700 1 --2- 172.21.15.72:0/4238142541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcca8133e30 0x7fcca812ff90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009870 tx=0x7fcc98009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:21.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.924+0000 7fccb06e3700 1 -- 172.21.15.72:0/4238142541 shutdown_connections 2023-10-03T10:15:21.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.924+0000 7fccb06e3700 1 --2- 172.21.15.72:0/4238142541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcca8133420 0x7fcca81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.924+0000 7fccb06e3700 1 --2- 172.21.15.72:0/4238142541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcca8133e30 0x7fcca812ff90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.924+0000 7fccb06e3700 1 -- 172.21.15.72:0/4238142541 >> 172.21.15.72:0/4238142541 conn(0x7fcca80a4210 msgr2=0x7fcca80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.924+0000 7fccb06e3700 1 -- 172.21.15.72:0/4238142541 shutdown_connections 2023-10-03T10:15:21.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.924+0000 7fccb06e3700 1 -- 172.21.15.72:0/4238142541 wait complete. 2023-10-03T10:15:21.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccb06e3700 1 Processor -- start 2023-10-03T10:15:21.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccb06e3700 1 -- start start 2023-10-03T10:15:21.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccb06e3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca8133420 0x7fcca809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccb06e3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcca8133e30 0x7fcca809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccb06e3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcca8134260 0x7fcca809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccb06e3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca8120320 con 0x7fcca8133420 2023-10-03T10:15:21.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccb06e3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca811fed0 con 0x7fcca8134260 2023-10-03T10:15:21.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccb06e3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcca809dea0 con 0x7fcca8133e30 2023-10-03T10:15:21.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccae47f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca8133420 0x7fcca809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccae47f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca8133420 0x7fcca809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49332/0 (socket says 172.21.15.72:49332) 2023-10-03T10:15:21.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccae47f700 1 -- 172.21.15.72:0/2434211277 learned_addr learned my addr 172.21.15.72:0/2434211277 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccaec80700 1 --2- 172.21.15.72:0/2434211277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcca8134260 0x7fcca809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccadc7e700 1 --2- 172.21.15.72:0/2434211277 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcca8133e30 0x7fcca809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccae47f700 1 -- 172.21.15.72:0/2434211277 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcca8133e30 msgr2=0x7fcca809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccae47f700 1 --2- 172.21.15.72:0/2434211277 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcca8133e30 0x7fcca809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccae47f700 1 -- 172.21.15.72:0/2434211277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcca8134260 msgr2=0x7fcca809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.925+0000 7fccae47f700 1 --2- 172.21.15.72:0/2434211277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcca8134260 0x7fcca809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.926+0000 7fccae47f700 1 -- 172.21.15.72:0/2434211277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc980094a0 con 0x7fcca8133420 2023-10-03T10:15:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.926+0000 7fccadc7e700 1 --2- 172.21.15.72:0/2434211277 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcca8133e30 0x7fcca809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:21.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.926+0000 7fccae47f700 1 --2- 172.21.15.72:0/2434211277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca8133420 0x7fcca809c480 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcca400e9e0 tx=0x7fcca400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.926+0000 7fcc9effd700 1 -- 172.21.15.72:0/2434211277 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4009710 con 0x7fcca8133420 2023-10-03T10:15:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.926+0000 7fcc9effd700 1 -- 172.21.15.72:0/2434211277 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca400c850 con 0x7fcca8133420 2023-10-03T10:15:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.926+0000 7fccb06e3700 1 -- 172.21.15.72:0/2434211277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca811f0a0 con 0x7fcca8133420 2023-10-03T10:15:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.926+0000 7fcc9effd700 1 -- 172.21.15.72:0/2434211277 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca400cbc0 con 0x7fcca8133420 2023-10-03T10:15:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.926+0000 7fccb06e3700 1 -- 172.21.15.72:0/2434211277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca8120940 con 0x7fcca8133420 2023-10-03T10:15:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.927+0000 7fccb06e3700 1 -- 172.21.15.72:0/2434211277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca8120110 con 0x7fcca8133420 2023-10-03T10:15:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.927+0000 7fcc9effd700 1 -- 172.21.15.72:0/2434211277 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcca400cd20 con 0x7fcca8133420 2023-10-03T10:15:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.927+0000 7fcc9effd700 1 -- 172.21.15.72:0/2434211277 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcca403fbe0 con 0x7fcca8133420 2023-10-03T10:15:21.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:21.931+0000 7fcc9effd700 1 -- 172.21.15.72:0/2434211277 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcca401adc0 con 0x7fcca8133420 2023-10-03T10:15:22.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.085+0000 7fc2b29c2700 1 -- 172.21.15.72:0/1176457707 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc2ac133250 con 0x7fc2ac0a0a30 2023-10-03T10:15:22.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.085+0000 7fc2a8ff9700 1 -- 172.21.15.72:0/1176457707 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2a003fe60 con 0x7fc2ac0a0a30 2023-10-03T10:15:22.086 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:22.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.087+0000 7fc2b29c2700 1 -- 172.21.15.72:0/1176457707 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2ac0a0a30 msgr2=0x7fc2ac132d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.087+0000 7fc2b29c2700 1 --2- 172.21.15.72:0/1176457707 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2ac0a0a30 0x7fc2ac132d10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc2a000ebb0 tx=0x7fc2a000eec0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.087+0000 7fc2b29c2700 1 -- 172.21.15.72:0/1176457707 shutdown_connections 2023-10-03T10:15:22.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.087+0000 7fc2b29c2700 1 --2- 172.21.15.72:0/1176457707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ac133930 0x7fc2ac1c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.087+0000 7fc2b29c2700 1 --2- 172.21.15.72:0/1176457707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ac09d630 0x7fc2ac1327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.087+0000 7fc2b29c2700 1 --2- 172.21.15.72:0/1176457707 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc2ac0a0a30 0x7fc2ac132d10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.087+0000 7fc2b29c2700 1 -- 172.21.15.72:0/1176457707 >> 172.21.15.72:0/1176457707 conn(0x7fc2ac0a3050 msgr2=0x7fc2ac09f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.087+0000 7fc2b29c2700 1 -- 172.21.15.72:0/1176457707 shutdown_connections 2023-10-03T10:15:22.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.087+0000 7fc2b29c2700 1 -- 172.21.15.72:0/1176457707 wait complete. 2023-10-03T10:15:22.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.124+0000 7fccb06e3700 1 -- 172.21.15.72:0/2434211277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcca8074ea0 con 0x7fcca8133420 2023-10-03T10:15:22.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.125+0000 7fcc9effd700 1 -- 172.21.15.72:0/2434211277 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcca4017030 con 0x7fcca8133420 2023-10-03T10:15:22.125 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:22.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.127+0000 7fccb06e3700 1 -- 172.21.15.72:0/2434211277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca8133420 msgr2=0x7fcca809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.127+0000 7fccb06e3700 1 --2- 172.21.15.72:0/2434211277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca8133420 0x7fcca809c480 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcca400e9e0 tx=0x7fcca400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.127+0000 7fccb06e3700 1 -- 172.21.15.72:0/2434211277 shutdown_connections 2023-10-03T10:15:22.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.127+0000 7fccb06e3700 1 --2- 172.21.15.72:0/2434211277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcca8133420 0x7fcca809c480 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.127+0000 7fccb06e3700 1 --2- 172.21.15.72:0/2434211277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcca8134260 0x7fcca809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.127+0000 7fccb06e3700 1 --2- 172.21.15.72:0/2434211277 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcca8133e30 0x7fcca809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.127+0000 7fccb06e3700 1 -- 172.21.15.72:0/2434211277 >> 172.21.15.72:0/2434211277 conn(0x7fcca80a4210 msgr2=0x7fcca80a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.127+0000 7fccb06e3700 1 -- 172.21.15.72:0/2434211277 shutdown_connections 2023-10-03T10:15:22.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.127+0000 7fccb06e3700 1 -- 172.21.15.72:0/2434211277 wait complete. 2023-10-03T10:15:22.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:22.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:22.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.300+0000 7fcf2584b700 1 Processor -- start 2023-10-03T10:15:22.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.300+0000 7fcf2584b700 1 -- start start 2023-10-03T10:15:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf2584b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf2009e930 0x7fcf2009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf2584b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf2009f240 0x7fcf201317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf2584b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf20070940 con 0x7fcf2009f650 2023-10-03T10:15:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf2584b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2006fd60 con 0x7fcf2009e930 2023-10-03T10:15:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf2584b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2006fa80 con 0x7fcf2009f240 2023-10-03T10:15:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf1effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf2009e930 0x7fcf2009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf1e7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf2009f240 0x7fcf201317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf1e7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf2009f240 0x7fcf201317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42086/0 (socket says 172.21.15.72:42086) 2023-10-03T10:15:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf1effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf2009e930 0x7fcf2009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49340/0 (socket says 172.21.15.72:49340) 2023-10-03T10:15:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf1e7fc700 1 -- 172.21.15.72:0/3152710176 learned_addr learned my addr 172.21.15.72:0/3152710176 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf1e7fc700 1 -- 172.21.15.72:0/3152710176 >> v2:172.21.15.72:3300/0 conn(0x7fcf2009e930 msgr2=0x7fcf2009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf1e7fc700 1 --2- 172.21.15.72:0/3152710176 >> v2:172.21.15.72:3300/0 conn(0x7fcf2009e930 0x7fcf2009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf1e7fc700 1 -- 172.21.15.72:0/3152710176 >> v1:172.21.15.72:6789/0 conn(0x7fcf2009f650 legacy=0x7fcf20131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf1e7fc700 1 -- 172.21.15.72:0/3152710176 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2009fb60 con 0x7fcf2009f240 2023-10-03T10:15:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf1effd700 1 --2- 172.21.15.72:0/3152710176 >> v2:172.21.15.72:3300/0 conn(0x7fcf2009e930 0x7fcf2009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf1e7fc700 1 --2- 172.21.15.72:0/3152710176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf2009f240 0x7fcf201317f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcf100098f0 tx=0x7fcf10009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17dced3c7342e31e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.301+0000 7fcf1dffb700 1 -- 172.21.15.72:0/3152710176 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10011830 con 0x7fcf2009f240 2023-10-03T10:15:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.302+0000 7fcf1dffb700 1 -- 172.21.15.72:0/3152710176 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf10011990 con 0x7fcf2009f240 2023-10-03T10:15:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.302+0000 7fcf1dffb700 1 -- 172.21.15.72:0/3152710176 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10011d20 con 0x7fcf2009f240 2023-10-03T10:15:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.302+0000 7fcf2584b700 1 -- 172.21.15.72:0/3152710176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf2009f240 msgr2=0x7fcf201317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.302+0000 7fcf2584b700 1 --2- 172.21.15.72:0/3152710176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf2009f240 0x7fcf201317f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcf100098f0 tx=0x7fcf10009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.302+0000 7fcf2584b700 1 -- 172.21.15.72:0/3152710176 shutdown_connections 2023-10-03T10:15:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.302+0000 7fcf2584b700 1 --2- 172.21.15.72:0/3152710176 >> v2:172.21.15.72:3300/0 conn(0x7fcf2009e930 0x7fcf2009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.302+0000 7fcf2584b700 1 --2- 172.21.15.72:0/3152710176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf2009f240 0x7fcf201317f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.302+0000 7fcf2584b700 1 -- 172.21.15.72:0/3152710176 >> 172.21.15.72:0/3152710176 conn(0x7fcf200a4210 msgr2=0x7fcf200a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.302+0000 7fcf2584b700 1 -- 172.21.15.72:0/3152710176 shutdown_connections 2023-10-03T10:15:22.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.302+0000 7fcf2584b700 1 -- 172.21.15.72:0/3152710176 wait complete. 2023-10-03T10:15:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.303+0000 7fcf2584b700 1 Processor -- start 2023-10-03T10:15:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.304+0000 7fcf2584b700 1 -- start start 2023-10-03T10:15:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.304+0000 7fcf2584b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf2009e930 0x7fcf201a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.304+0000 7fcf2584b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf2009f240 0x7fcf201a6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.304+0000 7fcf2584b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf2009f650 0x7fcf201a6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.304+0000 7fcf2584b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf201a71a0 con 0x7fcf2009f650 2023-10-03T10:15:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.304+0000 7fcf2584b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf201a78b0 con 0x7fcf2009f240 2023-10-03T10:15:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.304+0000 7fcf2584b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf201a7ed0 con 0x7fcf2009e930 2023-10-03T10:15:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.304+0000 7fcf1e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf2009f240 0x7fcf201a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.304+0000 7fcf1f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf2009f650 0x7fcf201a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.304+0000 7fcf1e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf2009f240 0x7fcf201a6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58664/0 (socket says 172.21.15.72:58664) 2023-10-03T10:15:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.304+0000 7fcf1e7fc700 1 -- 172.21.15.72:0/3844871867 learned_addr learned my addr 172.21.15.72:0/3844871867 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.304+0000 7fcf1effd700 1 --2- 172.21.15.72:0/3844871867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf2009e930 0x7fcf201a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.305+0000 7fcf1e7fc700 1 -- 172.21.15.72:0/3844871867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf2009e930 msgr2=0x7fcf201a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.305+0000 7fcf1e7fc700 1 --2- 172.21.15.72:0/3844871867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf2009e930 0x7fcf201a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.305+0000 7fcf1e7fc700 1 -- 172.21.15.72:0/3844871867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf2009f650 msgr2=0x7fcf201a6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.305+0000 7fcf1e7fc700 1 --2- 172.21.15.72:0/3844871867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf2009f650 0x7fcf201a6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.305+0000 7fcf1e7fc700 1 -- 172.21.15.72:0/3844871867 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf140094a0 con 0x7fcf2009f240 2023-10-03T10:15:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.305+0000 7fcf1f7fe700 1 --2- 172.21.15.72:0/3844871867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf2009f650 0x7fcf201a6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.305+0000 7fcf1e7fc700 1 --2- 172.21.15.72:0/3844871867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf2009f240 0x7fcf201a6230 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcf10000c00 tx=0x7fcf10004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.305+0000 7fcf07fff700 1 -- 172.21.15.72:0/3844871867 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf100036a0 con 0x7fcf2009f240 2023-10-03T10:15:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.305+0000 7fcf07fff700 1 -- 172.21.15.72:0/3844871867 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf10003800 con 0x7fcf2009f240 2023-10-03T10:15:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.305+0000 7fcf2584b700 1 -- 172.21.15.72:0/3844871867 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf10009550 con 0x7fcf2009f240 2023-10-03T10:15:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.305+0000 7fcf07fff700 1 -- 172.21.15.72:0/3844871867 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10003bb0 con 0x7fcf2009f240 2023-10-03T10:15:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.305+0000 7fcf2584b700 1 -- 172.21.15.72:0/3844871867 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf200a0190 con 0x7fcf2009f240 2023-10-03T10:15:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.306+0000 7fcf07fff700 1 -- 172.21.15.72:0/3844871867 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf10021070 con 0x7fcf2009f240 2023-10-03T10:15:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.306+0000 7fcf2584b700 1 -- 172.21.15.72:0/3844871867 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf201a2b40 con 0x7fcf2009f240 2023-10-03T10:15:22.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.306+0000 7fcf07fff700 1 -- 172.21.15.72:0/3844871867 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcf10040c90 con 0x7fcf2009f240 2023-10-03T10:15:22.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.311+0000 7fcf07fff700 1 -- 172.21.15.72:0/3844871867 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf10029070 con 0x7fcf2009f240 2023-10-03T10:15:22.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.493+0000 7fcf2584b700 1 -- 172.21.15.72:0/3844871867 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcf200a34f0 con 0x7fcf2009f240 2023-10-03T10:15:22.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.494+0000 7fcf07fff700 1 -- 172.21.15.72:0/3844871867 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf10015030 con 0x7fcf2009f240 2023-10-03T10:15:22.494 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:22.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.495+0000 7fcf2584b700 1 -- 172.21.15.72:0/3844871867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf2009f240 msgr2=0x7fcf201a6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.495+0000 7fcf2584b700 1 --2- 172.21.15.72:0/3844871867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf2009f240 0x7fcf201a6230 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcf10000c00 tx=0x7fcf10004750 comp rx=0 tx=0).stop 2023-10-03T10:15:22.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.495+0000 7fcf2584b700 1 -- 172.21.15.72:0/3844871867 shutdown_connections 2023-10-03T10:15:22.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.495+0000 7fcf2584b700 1 --2- 172.21.15.72:0/3844871867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf2009f650 0x7fcf201a6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.495+0000 7fcf2584b700 1 --2- 172.21.15.72:0/3844871867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf2009e930 0x7fcf201a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.495+0000 7fcf2584b700 1 --2- 172.21.15.72:0/3844871867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf2009f240 0x7fcf201a6230 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.495+0000 7fcf2584b700 1 -- 172.21.15.72:0/3844871867 >> 172.21.15.72:0/3844871867 conn(0x7fcf200a4210 msgr2=0x7fcf2009dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.496+0000 7fcf2584b700 1 -- 172.21.15.72:0/3844871867 shutdown_connections 2023-10-03T10:15:22.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.496+0000 7fcf2584b700 1 -- 172.21.15.72:0/3844871867 wait complete. 2023-10-03T10:15:22.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:22.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:22.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.940+0000 7fb927f73700 1 Processor -- start 2023-10-03T10:15:22.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb927f73700 1 -- start start 2023-10-03T10:15:22.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb927f73700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb920133420 0x7fb9201337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb927f73700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb920133e30 0x7fb92012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb927f73700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb920134260 0x7fb9201304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb927f73700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb92006b990 con 0x7fb920133420 2023-10-03T10:15:22.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb927f73700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200a0590 con 0x7fb920134260 2023-10-03T10:15:22.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb927f73700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb92009fb80 con 0x7fb920133e30 2023-10-03T10:15:22.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb925d0f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb920133420 0x7fb9201337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb92550e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb920133e30 0x7fb92012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb926510700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb920134260 0x7fb9201304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb925d0f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb920133420 0x7fb9201337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49366/0 (socket says 172.21.15.72:49366) 2023-10-03T10:15:22.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb92550e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb920133e30 0x7fb92012ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42096/0 (socket says 172.21.15.72:42096) 2023-10-03T10:15:22.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb926510700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb920134260 0x7fb9201304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58678/0 (socket says 172.21.15.72:58678) 2023-10-03T10:15:22.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb925d0f700 1 -- 172.21.15.72:0/2589360109 learned_addr learned my addr 172.21.15.72:0/2589360109 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:22.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb925d0f700 1 -- 172.21.15.72:0/2589360109 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb920133e30 msgr2=0x7fb92012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb925d0f700 1 --2- 172.21.15.72:0/2589360109 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb920133e30 0x7fb92012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb925d0f700 1 -- 172.21.15.72:0/2589360109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb920134260 msgr2=0x7fb9201304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb925d0f700 1 --2- 172.21.15.72:0/2589360109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb920134260 0x7fb9201304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb925d0f700 1 -- 172.21.15.72:0/2589360109 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9200a0030 con 0x7fb920133420 2023-10-03T10:15:22.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb92550e700 1 --2- 172.21.15.72:0/2589360109 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb920133e30 0x7fb92012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.941+0000 7fb926510700 1 --2- 172.21.15.72:0/2589360109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb920134260 0x7fb9201304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.942+0000 7fb925d0f700 1 --2- 172.21.15.72:0/2589360109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb920133420 0x7fb9201337f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb9100098f0 tx=0x7fb910009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30568d1a433a0e0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.942+0000 7fb924d0d700 1 -- 172.21.15.72:0/2589360109 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910011830 con 0x7fb920133420 2023-10-03T10:15:22.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.942+0000 7fb924d0d700 1 -- 172.21.15.72:0/2589360109 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb910011990 con 0x7fb920133420 2023-10-03T10:15:22.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.942+0000 7fb924d0d700 1 -- 172.21.15.72:0/2589360109 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910011d20 con 0x7fb920133420 2023-10-03T10:15:22.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.942+0000 7fb927f73700 1 -- 172.21.15.72:0/2589360109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb920133420 msgr2=0x7fb9201337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.942+0000 7fb927f73700 1 --2- 172.21.15.72:0/2589360109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb920133420 0x7fb9201337f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb9100098f0 tx=0x7fb910009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:22.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.942+0000 7fb927f73700 1 -- 172.21.15.72:0/2589360109 shutdown_connections 2023-10-03T10:15:22.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.942+0000 7fb927f73700 1 --2- 172.21.15.72:0/2589360109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb920134260 0x7fb9201304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.942+0000 7fb927f73700 1 --2- 172.21.15.72:0/2589360109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb920133420 0x7fb9201337f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.942+0000 7fb927f73700 1 --2- 172.21.15.72:0/2589360109 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb920133e30 0x7fb92012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.942+0000 7fb927f73700 1 -- 172.21.15.72:0/2589360109 >> 172.21.15.72:0/2589360109 conn(0x7fb9200a4210 msgr2=0x7fb9200a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.942+0000 7fb927f73700 1 -- 172.21.15.72:0/2589360109 shutdown_connections 2023-10-03T10:15:22.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.942+0000 7fb927f73700 1 -- 172.21.15.72:0/2589360109 wait complete. 2023-10-03T10:15:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.944+0000 7fb927f73700 1 Processor -- start 2023-10-03T10:15:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.944+0000 7fb927f73700 1 -- start start 2023-10-03T10:15:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.944+0000 7fb927f73700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb920133420 0x7fb92009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.944+0000 7fb927f73700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb920133e30 0x7fb92009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.944+0000 7fb927f73700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb920134260 0x7fb92009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.944+0000 7fb927f73700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92011f180 con 0x7fb920134260 2023-10-03T10:15:22.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.944+0000 7fb927f73700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92009df60 con 0x7fb920133e30 2023-10-03T10:15:22.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.944+0000 7fb927f73700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb92009dd70 con 0x7fb920133420 2023-10-03T10:15:22.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.944+0000 7fb925d0f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb920133420 0x7fb92009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.944+0000 7fb92550e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb920133e30 0x7fb92009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.944+0000 7fb92550e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb920133e30 0x7fb92009c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58688/0 (socket says 172.21.15.72:58688) 2023-10-03T10:15:22.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.944+0000 7fb925d0f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb920133420 0x7fb92009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42108/0 (socket says 172.21.15.72:42108) 2023-10-03T10:15:22.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.944+0000 7fb92550e700 1 -- 172.21.15.72:0/2519203173 learned_addr learned my addr 172.21.15.72:0/2519203173 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:22.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.944+0000 7fb926510700 1 --2- 172.21.15.72:0/2519203173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb920134260 0x7fb92009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.945+0000 7fb925d0f700 1 -- 172.21.15.72:0/2519203173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb920133e30 msgr2=0x7fb92009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.945+0000 7fb925d0f700 1 --2- 172.21.15.72:0/2519203173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb920133e30 0x7fb92009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.945+0000 7fb925d0f700 1 -- 172.21.15.72:0/2519203173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb920134260 msgr2=0x7fb92009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.945+0000 7fb925d0f700 1 --2- 172.21.15.72:0/2519203173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb920134260 0x7fb92009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.945+0000 7fb925d0f700 1 -- 172.21.15.72:0/2519203173 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c0094a0 con 0x7fb920133420 2023-10-03T10:15:22.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.945+0000 7fb92550e700 1 --2- 172.21.15.72:0/2519203173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb920133e30 0x7fb92009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.945+0000 7fb926510700 1 --2- 172.21.15.72:0/2519203173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb920134260 0x7fb92009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.945+0000 7fb925d0f700 1 --2- 172.21.15.72:0/2519203173 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb920133420 0x7fb92009c480 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb910016000 tx=0x7fb910004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.945+0000 7fb9167fc700 1 -- 172.21.15.72:0/2519203173 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910004450 con 0x7fb920133420 2023-10-03T10:15:22.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.945+0000 7fb9167fc700 1 -- 172.21.15.72:0/2519203173 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9100045b0 con 0x7fb920133420 2023-10-03T10:15:22.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.945+0000 7fb927f73700 1 -- 172.21.15.72:0/2519203173 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb918009a70 con 0x7fb920133420 2023-10-03T10:15:22.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.945+0000 7fb9167fc700 1 -- 172.21.15.72:0/2519203173 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9100038c0 con 0x7fb920133420 2023-10-03T10:15:22.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.945+0000 7fb927f73700 1 -- 172.21.15.72:0/2519203173 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb910009550 con 0x7fb920133420 2023-10-03T10:15:22.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.946+0000 7fb9167fc700 1 -- 172.21.15.72:0/2519203173 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb910021070 con 0x7fb920133420 2023-10-03T10:15:22.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.946+0000 7fb9167fc700 1 -- 172.21.15.72:0/2519203173 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb910040bc0 con 0x7fb920133420 2023-10-03T10:15:22.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.946+0000 7fb927f73700 1 -- 172.21.15.72:0/2519203173 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb920074ea0 con 0x7fb920133420 2023-10-03T10:15:22.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:22.951+0000 7fb9167fc700 1 -- 172.21.15.72:0/2519203173 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb910029020 con 0x7fb920133420 2023-10-03T10:15:23.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:23.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.138+0000 7fb927f73700 1 -- 172.21.15.72:0/2519203173 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb92011f4d0 con 0x7fb920133420 2023-10-03T10:15:23.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.139+0000 7fb9167fc700 1 -- 172.21.15.72:0/2519203173 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb910032070 con 0x7fb920133420 2023-10-03T10:15:23.139 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:23.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:23.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.141+0000 7fb927f73700 1 -- 172.21.15.72:0/2519203173 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb920133420 msgr2=0x7fb92009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.141+0000 7fb927f73700 1 --2- 172.21.15.72:0/2519203173 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb920133420 0x7fb92009c480 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb910016000 tx=0x7fb910004750 comp rx=0 tx=0).stop 2023-10-03T10:15:23.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.141+0000 7fb927f73700 1 -- 172.21.15.72:0/2519203173 shutdown_connections 2023-10-03T10:15:23.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.141+0000 7fb927f73700 1 --2- 172.21.15.72:0/2519203173 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb920134260 0x7fb92009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.141+0000 7fb927f73700 1 --2- 172.21.15.72:0/2519203173 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb920133420 0x7fb92009c480 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.141+0000 7fb927f73700 1 --2- 172.21.15.72:0/2519203173 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb920133e30 0x7fb92009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.141+0000 7fb927f73700 1 -- 172.21.15.72:0/2519203173 >> 172.21.15.72:0/2519203173 conn(0x7fb9200a4210 msgr2=0x7fb9200a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.141+0000 7fb927f73700 1 -- 172.21.15.72:0/2519203173 shutdown_connections 2023-10-03T10:15:23.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.141+0000 7fb927f73700 1 -- 172.21.15.72:0/2519203173 wait complete. 2023-10-03T10:15:23.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:23.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.229+0000 7efcccfec700 1 Processor -- start 2023-10-03T10:15:23.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.229+0000 7efcccfec700 1 -- start start 2023-10-03T10:15:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.230+0000 7efcccfec700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcc809e930 0x7efcc809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.230+0000 7efcccfec700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efcc809f650 0x7efcc8131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.230+0000 7efcccfec700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc8070940 con 0x7efcc809f240 2023-10-03T10:15:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.230+0000 7efcccfec700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc806fd60 con 0x7efcc809f650 2023-10-03T10:15:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.230+0000 7efcccfec700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc806fa80 con 0x7efcc809e930 2023-10-03T10:15:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.230+0000 7efcc659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcc809e930 0x7efcc809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.230+0000 7efcc6d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efcc809f650 0x7efcc8131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.230+0000 7efcc659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcc809e930 0x7efcc809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58698/0 (socket says 172.21.15.72:58698) 2023-10-03T10:15:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.230+0000 7efcc6d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efcc809f650 0x7efcc8131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49386/0 (socket says 172.21.15.72:49386) 2023-10-03T10:15:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.230+0000 7efcc659c700 1 -- 172.21.15.72:0/831954131 learned_addr learned my addr 172.21.15.72:0/831954131 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.230+0000 7efcc659c700 1 -- 172.21.15.72:0/831954131 >> v2:172.21.15.72:3300/0 conn(0x7efcc809f650 msgr2=0x7efcc8131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.230+0000 7efcc659c700 1 --2- 172.21.15.72:0/831954131 >> v2:172.21.15.72:3300/0 conn(0x7efcc809f650 0x7efcc8131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.230+0000 7efcc659c700 1 -- 172.21.15.72:0/831954131 >> v1:172.21.15.72:6789/0 conn(0x7efcc809f240 legacy=0x7efcc81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.230+0000 7efcc659c700 1 -- 172.21.15.72:0/831954131 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc809fb60 con 0x7efcc809e930 2023-10-03T10:15:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.230+0000 7efcc6d9d700 1 --2- 172.21.15.72:0/831954131 >> v2:172.21.15.72:3300/0 conn(0x7efcc809f650 0x7efcc8131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.231+0000 7efcc659c700 1 --2- 172.21.15.72:0/831954131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcc809e930 0x7efcc809ed00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efcb80098f0 tx=0x7efcb8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9522f08c7d33d2a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.231+0000 7efcc559a700 1 -- 172.21.15.72:0/831954131 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb8011830 con 0x7efcc809e930 2023-10-03T10:15:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.231+0000 7efcc559a700 1 -- 172.21.15.72:0/831954131 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb8011990 con 0x7efcc809e930 2023-10-03T10:15:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.231+0000 7efcc559a700 1 -- 172.21.15.72:0/831954131 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb8011d20 con 0x7efcc809e930 2023-10-03T10:15:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.231+0000 7efcccfec700 1 -- 172.21.15.72:0/831954131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcc809e930 msgr2=0x7efcc809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.231+0000 7efcccfec700 1 --2- 172.21.15.72:0/831954131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcc809e930 0x7efcc809ed00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efcb80098f0 tx=0x7efcb8009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.231+0000 7efcccfec700 1 -- 172.21.15.72:0/831954131 shutdown_connections 2023-10-03T10:15:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.231+0000 7efcccfec700 1 --2- 172.21.15.72:0/831954131 >> v2:172.21.15.72:3300/0 conn(0x7efcc809f650 0x7efcc8131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.231+0000 7efcccfec700 1 --2- 172.21.15.72:0/831954131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcc809e930 0x7efcc809ed00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.231+0000 7efcccfec700 1 -- 172.21.15.72:0/831954131 >> 172.21.15.72:0/831954131 conn(0x7efcc80a4210 msgr2=0x7efcc80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.232+0000 7efcccfec700 1 -- 172.21.15.72:0/831954131 shutdown_connections 2023-10-03T10:15:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.232+0000 7efcccfec700 1 -- 172.21.15.72:0/831954131 wait complete. 2023-10-03T10:15:23.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.233+0000 7efcccfec700 1 Processor -- start 2023-10-03T10:15:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.233+0000 7efcccfec700 1 -- start start 2023-10-03T10:15:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.233+0000 7efcccfec700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcc809e930 0x7efcc806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.233+0000 7efcccfec700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcc809f240 0x7efcc806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.233+0000 7efcccfec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcc809f650 0x7efcc806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.233+0000 7efcccfec700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc81b7240 con 0x7efcc809f240 2023-10-03T10:15:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.233+0000 7efcccfec700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc81a93f0 con 0x7efcc809e930 2023-10-03T10:15:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.233+0000 7efcccfec700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcc81a8910 con 0x7efcc809f650 2023-10-03T10:15:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.233+0000 7efcc659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcc809e930 0x7efcc806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.233+0000 7efcc5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcc809f240 0x7efcc806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.233+0000 7efcc6d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcc809f650 0x7efcc806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.233+0000 7efcc659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcc809e930 0x7efcc806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58710/0 (socket says 172.21.15.72:58710) 2023-10-03T10:15:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.233+0000 7efcc659c700 1 -- 172.21.15.72:0/1443349419 learned_addr learned my addr 172.21.15.72:0/1443349419 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.234+0000 7efcc5d9b700 1 -- 172.21.15.72:0/1443349419 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcc809f650 msgr2=0x7efcc806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.234+0000 7efcc5d9b700 1 --2- 172.21.15.72:0/1443349419 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcc809f650 0x7efcc806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.234+0000 7efcc5d9b700 1 -- 172.21.15.72:0/1443349419 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcc809e930 msgr2=0x7efcc806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.234+0000 7efcc5d9b700 1 --2- 172.21.15.72:0/1443349419 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcc809e930 0x7efcc806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.234+0000 7efcc5d9b700 1 -- 172.21.15.72:0/1443349419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc0009a70 con 0x7efcc809f240 2023-10-03T10:15:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.234+0000 7efcc659c700 1 --2- 172.21.15.72:0/1443349419 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcc809e930 0x7efcc806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.234+0000 7efcc6d9d700 1 --2- 172.21.15.72:0/1443349419 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcc809f650 0x7efcc806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.234+0000 7efcc5d9b700 1 --2- 172.21.15.72:0/1443349419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcc809f240 0x7efcc806bdf0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efcbc000f60 tx=0x7efcbc00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.234+0000 7efcb6ffd700 1 -- 172.21.15.72:0/1443349419 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc0052d0 con 0x7efcc809f240 2023-10-03T10:15:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.234+0000 7efcb6ffd700 1 -- 172.21.15.72:0/1443349419 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcbc005450 con 0x7efcc809f240 2023-10-03T10:15:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.234+0000 7efcb6ffd700 1 -- 172.21.15.72:0/1443349419 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc0038c0 con 0x7efcc809f240 2023-10-03T10:15:23.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.234+0000 7efcccfec700 1 -- 172.21.15.72:0/1443349419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb8009550 con 0x7efcc809f240 2023-10-03T10:15:23.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.234+0000 7efcccfec700 1 -- 172.21.15.72:0/1443349419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc80a0190 con 0x7efcc809f240 2023-10-03T10:15:23.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.235+0000 7efcb6ffd700 1 -- 172.21.15.72:0/1443349419 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efcbc003a20 con 0x7efcc809f240 2023-10-03T10:15:23.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.235+0000 7efcccfec700 1 -- 172.21.15.72:0/1443349419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc81a0b30 con 0x7efcc809f240 2023-10-03T10:15:23.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.235+0000 7efcb6ffd700 1 -- 172.21.15.72:0/1443349419 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efcbc03e8d0 con 0x7efcc809f240 2023-10-03T10:15:23.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.239+0000 7efcb6ffd700 1 -- 172.21.15.72:0/1443349419 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efcbc019d20 con 0x7efcc809f240 2023-10-03T10:15:23.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.268+0000 7f813352d700 1 Processor -- start 2023-10-03T10:15:23.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.268+0000 7f813352d700 1 -- start start 2023-10-03T10:15:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f813352d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f812c0a0a30 0x7f812c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f813352d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f812c09d630 0x7f812c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f813352d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f812c133930 0x7f812c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f813352d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812c0a2a70 con 0x7f812c133930 2023-10-03T10:15:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f813352d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c0a01d0 con 0x7f812c09d630 2023-10-03T10:15:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f813352d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f812c09e2b0 con 0x7f812c0a0a30 2023-10-03T10:15:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f8130ac8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f812c09d630 0x7f812c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f81312c9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f812c0a0a30 0x7f812c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f81312c9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f812c0a0a30 0x7f812c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42126/0 (socket says 172.21.15.72:42126) 2023-10-03T10:15:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f8130ac8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f812c09d630 0x7f812c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58712/0 (socket says 172.21.15.72:58712) 2023-10-03T10:15:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f81312c9700 1 -- 172.21.15.72:0/3283498745 learned_addr learned my addr 172.21.15.72:0/3283498745 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f8131aca700 1 --2- 172.21.15.72:0/3283498745 >> v2:172.21.15.72:3300/0 conn(0x7f812c133930 0x7f812c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f8130ac8700 1 -- 172.21.15.72:0/3283498745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f812c0a0a30 msgr2=0x7f812c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f8130ac8700 1 --2- 172.21.15.72:0/3283498745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f812c0a0a30 0x7f812c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f8130ac8700 1 -- 172.21.15.72:0/3283498745 >> v2:172.21.15.72:3300/0 conn(0x7f812c133930 msgr2=0x7f812c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f8130ac8700 1 --2- 172.21.15.72:0/3283498745 >> v2:172.21.15.72:3300/0 conn(0x7f812c133930 0x7f812c133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f8130ac8700 1 -- 172.21.15.72:0/3283498745 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c09dc50 con 0x7f812c09d630 2023-10-03T10:15:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f81312c9700 1 --2- 172.21.15.72:0/3283498745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f812c0a0a30 0x7f812c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f8131aca700 1 --2- 172.21.15.72:0/3283498745 >> v2:172.21.15.72:3300/0 conn(0x7f812c133930 0x7f812c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.269+0000 7f8130ac8700 1 --2- 172.21.15.72:0/3283498745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f812c09d630 0x7f812c0a1340 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f811c009840 tx=0x7f811c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d6a406e3fb14665 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.270+0000 7f8123fff700 1 -- 172.21.15.72:0/3283498745 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c011830 con 0x7f812c09d630 2023-10-03T10:15:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.270+0000 7f8123fff700 1 -- 172.21.15.72:0/3283498745 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c011990 con 0x7f812c09d630 2023-10-03T10:15:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.270+0000 7f8123fff700 1 -- 172.21.15.72:0/3283498745 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c011d20 con 0x7f812c09d630 2023-10-03T10:15:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.270+0000 7f813352d700 1 -- 172.21.15.72:0/3283498745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f812c09d630 msgr2=0x7f812c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.270+0000 7f813352d700 1 --2- 172.21.15.72:0/3283498745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f812c09d630 0x7f812c0a1340 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f811c009840 tx=0x7f811c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.270+0000 7f813352d700 1 -- 172.21.15.72:0/3283498745 shutdown_connections 2023-10-03T10:15:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.270+0000 7f813352d700 1 --2- 172.21.15.72:0/3283498745 >> v2:172.21.15.72:3300/0 conn(0x7f812c133930 0x7f812c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.270+0000 7f813352d700 1 --2- 172.21.15.72:0/3283498745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f812c0a0a30 0x7f812c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.270+0000 7f813352d700 1 --2- 172.21.15.72:0/3283498745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f812c09d630 0x7f812c0a1340 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.270+0000 7f813352d700 1 -- 172.21.15.72:0/3283498745 >> 172.21.15.72:0/3283498745 conn(0x7f812c0a3050 msgr2=0x7f812c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.270+0000 7f813352d700 1 -- 172.21.15.72:0/3283498745 shutdown_connections 2023-10-03T10:15:23.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.270+0000 7f813352d700 1 -- 172.21.15.72:0/3283498745 wait complete. 2023-10-03T10:15:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.271+0000 7f813352d700 1 Processor -- start 2023-10-03T10:15:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.271+0000 7f813352d700 1 -- start start 2023-10-03T10:15:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f813352d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f812c09d630 0x7f812c11f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f813352d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f812c0a0a30 0x7f812c11fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f813352d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f812c133930 0x7f812c1c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f813352d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c0a0410 con 0x7f812c133930 2023-10-03T10:15:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f813352d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c122640 con 0x7f812c09d630 2023-10-03T10:15:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f813352d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f812c11ef20 con 0x7f812c0a0a30 2023-10-03T10:15:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f8130ac8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f812c0a0a30 0x7f812c11fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f8130ac8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f812c0a0a30 0x7f812c11fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42142/0 (socket says 172.21.15.72:42142) 2023-10-03T10:15:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f8130ac8700 1 -- 172.21.15.72:0/3884008547 learned_addr learned my addr 172.21.15.72:0/3884008547 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f8131aca700 1 --2- 172.21.15.72:0/3884008547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f812c133930 0x7f812c1c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f81312c9700 1 --2- 172.21.15.72:0/3884008547 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f812c09d630 0x7f812c11f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f8130ac8700 1 -- 172.21.15.72:0/3884008547 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f812c09d630 msgr2=0x7f812c11f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f8130ac8700 1 --2- 172.21.15.72:0/3884008547 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f812c09d630 0x7f812c11f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f8130ac8700 1 -- 172.21.15.72:0/3884008547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f812c133930 msgr2=0x7f812c1c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f8130ac8700 1 --2- 172.21.15.72:0/3884008547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f812c133930 0x7f812c1c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f8130ac8700 1 -- 172.21.15.72:0/3884008547 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8128009550 con 0x7f812c0a0a30 2023-10-03T10:15:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f8131aca700 1 --2- 172.21.15.72:0/3884008547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f812c133930 0x7f812c1c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f8130ac8700 1 --2- 172.21.15.72:0/3884008547 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f812c0a0a30 0x7f812c11fa00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f811c000c00 tx=0x7f811c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f8121ffb700 1 -- 172.21.15.72:0/3884008547 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c004450 con 0x7f812c0a0a30 2023-10-03T10:15:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f8121ffb700 1 -- 172.21.15.72:0/3884008547 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c01f070 con 0x7f812c0a0a30 2023-10-03T10:15:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f813352d700 1 -- 172.21.15.72:0/3884008547 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8124009a70 con 0x7f812c0a0a30 2023-10-03T10:15:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.272+0000 7f8121ffb700 1 -- 172.21.15.72:0/3884008547 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0038e0 con 0x7f812c0a0a30 2023-10-03T10:15:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.273+0000 7f813352d700 1 -- 172.21.15.72:0/3884008547 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c0094a0 con 0x7f812c0a0a30 2023-10-03T10:15:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.273+0000 7f8121ffb700 1 -- 172.21.15.72:0/3884008547 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f811c003a40 con 0x7f812c0a0a30 2023-10-03T10:15:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.273+0000 7f8121ffb700 1 -- 172.21.15.72:0/3884008547 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f811c021070 con 0x7f812c0a0a30 2023-10-03T10:15:23.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.274+0000 7f813352d700 1 -- 172.21.15.72:0/3884008547 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812c1220c0 con 0x7f812c0a0a30 2023-10-03T10:15:23.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.282+0000 7f8121ffb700 1 -- 172.21.15.72:0/3884008547 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f812c1220c0 con 0x7f812c0a0a30 2023-10-03T10:15:23.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.438+0000 7efcccfec700 1 -- 172.21.15.72:0/1443349419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efcc80a3570 con 0x7efcc809f240 2023-10-03T10:15:23.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.438+0000 7efcb6ffd700 1 -- 172.21.15.72:0/1443349419 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efcbc0192c0 con 0x7efcc809f240 2023-10-03T10:15:23.439 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:23.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.440+0000 7efcccfec700 1 -- 172.21.15.72:0/1443349419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcc809f240 msgr2=0x7efcc806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.440+0000 7efcccfec700 1 --2- 172.21.15.72:0/1443349419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcc809f240 0x7efcc806bdf0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efcbc000f60 tx=0x7efcbc00c730 comp rx=0 tx=0).stop 2023-10-03T10:15:23.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.440+0000 7efcccfec700 1 -- 172.21.15.72:0/1443349419 shutdown_connections 2023-10-03T10:15:23.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.440+0000 7efcccfec700 1 --2- 172.21.15.72:0/1443349419 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efcc809f650 0x7efcc806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.440+0000 7efcccfec700 1 --2- 172.21.15.72:0/1443349419 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efcc809e930 0x7efcc806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.440+0000 7efcccfec700 1 --2- 172.21.15.72:0/1443349419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efcc809f240 0x7efcc806bdf0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.440+0000 7efcccfec700 1 -- 172.21.15.72:0/1443349419 >> 172.21.15.72:0/1443349419 conn(0x7efcc80a4210 msgr2=0x7efcc81b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.440+0000 7efcccfec700 1 -- 172.21.15.72:0/1443349419 shutdown_connections 2023-10-03T10:15:23.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.440+0000 7efcccfec700 1 -- 172.21.15.72:0/1443349419 wait complete. 2023-10-03T10:15:23.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:23.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.477+0000 7f813352d700 1 -- 172.21.15.72:0/3884008547 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f812c1220c0 con 0x7f812c0a0a30 2023-10-03T10:15:23.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.477+0000 7f8121ffb700 1 -- 172.21.15.72:0/3884008547 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f812c1220c0 con 0x7f812c0a0a30 2023-10-03T10:15:23.478 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:23.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.479+0000 7f813352d700 1 -- 172.21.15.72:0/3884008547 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f812c0a0a30 msgr2=0x7f812c11fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.479+0000 7f813352d700 1 --2- 172.21.15.72:0/3884008547 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f812c0a0a30 0x7f812c11fa00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f811c000c00 tx=0x7f811c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:23.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.479+0000 7f813352d700 1 -- 172.21.15.72:0/3884008547 shutdown_connections 2023-10-03T10:15:23.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.479+0000 7f813352d700 1 --2- 172.21.15.72:0/3884008547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f812c133930 0x7f812c1c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.479+0000 7f813352d700 1 --2- 172.21.15.72:0/3884008547 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f812c09d630 0x7f812c11f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.479+0000 7f813352d700 1 --2- 172.21.15.72:0/3884008547 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f812c0a0a30 0x7f812c11fa00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.479+0000 7f813352d700 1 -- 172.21.15.72:0/3884008547 >> 172.21.15.72:0/3884008547 conn(0x7f812c0a3050 msgr2=0x7f812c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.479+0000 7f813352d700 1 -- 172.21.15.72:0/3884008547 shutdown_connections 2023-10-03T10:15:23.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.479+0000 7f813352d700 1 -- 172.21.15.72:0/3884008547 wait complete. 2023-10-03T10:15:23.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:23.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.655+0000 7f82c78c6700 1 Processor -- start 2023-10-03T10:15:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.655+0000 7f82c78c6700 1 -- start start 2023-10-03T10:15:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.655+0000 7f82c78c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82c009d6f0 0x7f82c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.655+0000 7f82c78c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82c009e000 0x7f82c0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.655+0000 7f82c78c6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c009f130 con 0x7f82c009e410 2023-10-03T10:15:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.655+0000 7f82c78c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c009f520 con 0x7f82c009e000 2023-10-03T10:15:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.655+0000 7f82c78c6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82c009e930 con 0x7f82c009d6f0 2023-10-03T10:15:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.656+0000 7f82c4e61700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82c009e000 0x7f82c0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.656+0000 7f82c5e63700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f82c009e410 0x7f82c0130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54924/0 (socket says 172.21.15.72:54924) 2023-10-03T10:15:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.656+0000 7f82c5662700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82c009d6f0 0x7f82c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.656+0000 7f82c5e63700 1 -- 172.21.15.72:0/1247663927 learned_addr learned my addr 172.21.15.72:0/1247663927 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.656+0000 7f82b7fff700 1 -- 172.21.15.72:0/1247663927 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2981500435 0 0) 0x7f82c009f130 con 0x7f82c009e410 2023-10-03T10:15:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.656+0000 7f82b7fff700 1 -- 172.21.15.72:0/1247663927 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82ac0035b0 con 0x7f82c009e410 2023-10-03T10:15:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.656+0000 7f82c5662700 1 -- 172.21.15.72:0/1247663927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82c009e000 msgr2=0x7f82c0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.656+0000 7f82c5662700 1 --2- 172.21.15.72:0/1247663927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82c009e000 0x7f82c0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.656+0000 7f82c5662700 1 -- 172.21.15.72:0/1247663927 >> v1:172.21.15.72:6789/0 conn(0x7f82c009e410 legacy=0x7f82c0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.656+0000 7f82c5662700 1 -- 172.21.15.72:0/1247663927 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c009b2d0 con 0x7f82c009d6f0 2023-10-03T10:15:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.656+0000 7f82c4e61700 1 --2- 172.21.15.72:0/1247663927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82c009e000 0x7f82c0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.656+0000 7f82c5662700 1 --2- 172.21.15.72:0/1247663927 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82c009d6f0 0x7f82c009dac0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0098a0 tx=0x7f82bc009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17e1ae56637302a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.656+0000 7f82b7fff700 1 -- 172.21.15.72:0/1247663927 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc011830 con 0x7f82c009d6f0 2023-10-03T10:15:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.656+0000 7f82b7fff700 1 -- 172.21.15.72:0/1247663927 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc011990 con 0x7f82c009d6f0 2023-10-03T10:15:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.656+0000 7f82b7fff700 1 -- 172.21.15.72:0/1247663927 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc011d20 con 0x7f82c009d6f0 2023-10-03T10:15:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.657+0000 7f82c78c6700 1 -- 172.21.15.72:0/1247663927 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82c009d6f0 msgr2=0x7f82c009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.657+0000 7f82c78c6700 1 --2- 172.21.15.72:0/1247663927 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82c009d6f0 0x7f82c009dac0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0098a0 tx=0x7f82bc009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.657+0000 7f82c78c6700 1 -- 172.21.15.72:0/1247663927 shutdown_connections 2023-10-03T10:15:23.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.657+0000 7f82c78c6700 1 --2- 172.21.15.72:0/1247663927 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82c009d6f0 0x7f82c009dac0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.657+0000 7f82c78c6700 1 --2- 172.21.15.72:0/1247663927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82c009e000 0x7f82c0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.657+0000 7f82c78c6700 1 -- 172.21.15.72:0/1247663927 >> 172.21.15.72:0/1247663927 conn(0x7f82c0066f50 msgr2=0x7f82c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.657+0000 7f82c78c6700 1 -- 172.21.15.72:0/1247663927 shutdown_connections 2023-10-03T10:15:23.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.657+0000 7f82c78c6700 1 -- 172.21.15.72:0/1247663927 wait complete. 2023-10-03T10:15:23.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.658+0000 7f82c78c6700 1 Processor -- start 2023-10-03T10:15:23.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.658+0000 7f82c78c6700 1 -- start start 2023-10-03T10:15:23.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c78c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82c009d6f0 0x7f82c011f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c78c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82c009e000 0x7f82c011f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c78c6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c009e410 0x7f82c011fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:23.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c78c6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c0121200 con 0x7f82c009e410 2023-10-03T10:15:23.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c78c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c0130000 con 0x7f82c009e000 2023-10-03T10:15:23.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c78c6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82c0122f90 con 0x7f82c009d6f0 2023-10-03T10:15:23.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c5662700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82c009d6f0 0x7f82c011f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c5662700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82c009d6f0 0x7f82c011f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42154/0 (socket says 172.21.15.72:42154) 2023-10-03T10:15:23.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c5662700 1 -- 172.21.15.72:0/564182969 learned_addr learned my addr 172.21.15.72:0/564182969 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:23.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c5e63700 1 --2- 172.21.15.72:0/564182969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c009e410 0x7f82c011fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c4e61700 1 --2- 172.21.15.72:0/564182969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82c009e000 0x7f82c011f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:23.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c5662700 1 -- 172.21.15.72:0/564182969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82c009e000 msgr2=0x7f82c011f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c5662700 1 --2- 172.21.15.72:0/564182969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82c009e000 0x7f82c011f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c5662700 1 -- 172.21.15.72:0/564182969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c009e410 msgr2=0x7f82c011fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c5662700 1 --2- 172.21.15.72:0/564182969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c009e410 0x7f82c011fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c5662700 1 -- 172.21.15.72:0/564182969 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b00094a0 con 0x7f82c009d6f0 2023-10-03T10:15:23.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c5e63700 1 --2- 172.21.15.72:0/564182969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c009e410 0x7f82c011fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:23.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c5662700 1 --2- 172.21.15.72:0/564182969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82c009d6f0 0x7f82c011f470 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f82bc000c00 tx=0x7f82bc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:23.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82b5ffb700 1 -- 172.21.15.72:0/564182969 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc004450 con 0x7f82c009d6f0 2023-10-03T10:15:23.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82b5ffb700 1 -- 172.21.15.72:0/564182969 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc01f070 con 0x7f82c009d6f0 2023-10-03T10:15:23.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82c78c6700 1 -- 172.21.15.72:0/564182969 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc0094a0 con 0x7f82c009d6f0 2023-10-03T10:15:23.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.659+0000 7f82b5ffb700 1 -- 172.21.15.72:0/564182969 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0038e0 con 0x7f82c009d6f0 2023-10-03T10:15:23.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.660+0000 7f82c78c6700 1 -- 172.21.15.72:0/564182969 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c009c700 con 0x7f82c009d6f0 2023-10-03T10:15:23.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.660+0000 7f82b5ffb700 1 -- 172.21.15.72:0/564182969 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82bc003a40 con 0x7f82c009d6f0 2023-10-03T10:15:23.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.660+0000 7f82b5ffb700 1 -- 172.21.15.72:0/564182969 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f82bc021070 con 0x7f82c009d6f0 2023-10-03T10:15:23.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.661+0000 7f82c78c6700 1 -- 172.21.15.72:0/564182969 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c009dcd0 con 0x7f82c009d6f0 2023-10-03T10:15:23.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.665+0000 7f82b5ffb700 1 -- 172.21.15.72:0/564182969 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82bc015020 con 0x7f82c009d6f0 2023-10-03T10:15:23.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.853+0000 7f82c78c6700 1 -- 172.21.15.72:0/564182969 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f82c00a3540 con 0x7f82c009d6f0 2023-10-03T10:15:23.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.854+0000 7f82b5ffb700 1 -- 172.21.15.72:0/564182969 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82bc010380 con 0x7f82c009d6f0 2023-10-03T10:15:23.854 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:23.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.856+0000 7f82c78c6700 1 -- 172.21.15.72:0/564182969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82c009d6f0 msgr2=0x7f82c011f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:23.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.856+0000 7f82c78c6700 1 --2- 172.21.15.72:0/564182969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82c009d6f0 0x7f82c011f470 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f82bc000c00 tx=0x7f82bc004750 comp rx=0 tx=0).stop 2023-10-03T10:15:23.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.856+0000 7f82c78c6700 1 -- 172.21.15.72:0/564182969 shutdown_connections 2023-10-03T10:15:23.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.856+0000 7f82c78c6700 1 --2- 172.21.15.72:0/564182969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82c009e410 0x7f82c011fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.856+0000 7f82c78c6700 1 --2- 172.21.15.72:0/564182969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82c009d6f0 0x7f82c011f470 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.856+0000 7f82c78c6700 1 --2- 172.21.15.72:0/564182969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82c009e000 0x7f82c011f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:23.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.856+0000 7f82c78c6700 1 -- 172.21.15.72:0/564182969 >> 172.21.15.72:0/564182969 conn(0x7f82c0066f50 msgr2=0x7f82c0130b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:23.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.856+0000 7f82c78c6700 1 -- 172.21.15.72:0/564182969 shutdown_connections 2023-10-03T10:15:23.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:23.856+0000 7f82c78c6700 1 -- 172.21.15.72:0/564182969 wait complete. 2023-10-03T10:15:23.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:24.155 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:24.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.279+0000 7f854f056700 1 Processor -- start 2023-10-03T10:15:24.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.279+0000 7f854f056700 1 -- start start 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854f056700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85480a0a30 0x7f85480a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854f056700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85480a1340 0x7f8548133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854f056700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8548133fa0 0x7f8548134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854f056700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854809edd0 con 0x7f8548133fa0 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854f056700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854809e1f0 con 0x7f85480a0a30 2023-10-03T10:15:24.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854f056700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f854809dc50 con 0x7f85480a1340 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854d5f3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8548133fa0 0x7f8548134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854cdf2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85480a0a30 0x7f85480a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854cdf2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85480a0a30 0x7f85480a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58734/0 (socket says 172.21.15.72:58734) 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f8547fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85480a1340 0x7f8548133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854cdf2700 1 -- 172.21.15.72:0/3487301598 learned_addr learned my addr 172.21.15.72:0/3487301598 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854d5f3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8548133fa0 0x7f8548134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49438/0 (socket says 172.21.15.72:49438) 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854d5f3700 1 -- 172.21.15.72:0/3487301598 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85480a1340 msgr2=0x7f8548133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854d5f3700 1 --2- 172.21.15.72:0/3487301598 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85480a1340 0x7f8548133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854d5f3700 1 -- 172.21.15.72:0/3487301598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85480a0a30 msgr2=0x7f85480a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854d5f3700 1 --2- 172.21.15.72:0/3487301598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85480a0a30 0x7f85480a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854d5f3700 1 -- 172.21.15.72:0/3487301598 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85480a1fe0 con 0x7f8548133fa0 2023-10-03T10:15:24.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f854cdf2700 1 --2- 172.21.15.72:0/3487301598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85480a0a30 0x7f85480a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.280+0000 7f8547fff700 1 --2- 172.21.15.72:0/3487301598 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85480a1340 0x7f8548133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.281+0000 7f854d5f3700 1 --2- 172.21.15.72:0/3487301598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8548133fa0 0x7f8548134410 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8540009d90 tx=0x7f854000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dd015e33992db4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.281+0000 7f85477fe700 1 -- 172.21.15.72:0/3487301598 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854000e070 con 0x7f8548133fa0 2023-10-03T10:15:24.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.281+0000 7f85477fe700 1 -- 172.21.15.72:0/3487301598 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854000bb20 con 0x7f8548133fa0 2023-10-03T10:15:24.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.281+0000 7f85477fe700 1 -- 172.21.15.72:0/3487301598 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8540012430 con 0x7f8548133fa0 2023-10-03T10:15:24.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.281+0000 7f854f056700 1 -- 172.21.15.72:0/3487301598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8548133fa0 msgr2=0x7f8548134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.281+0000 7f854f056700 1 --2- 172.21.15.72:0/3487301598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8548133fa0 0x7f8548134410 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8540009d90 tx=0x7f854000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:24.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.281+0000 7f854f056700 1 -- 172.21.15.72:0/3487301598 shutdown_connections 2023-10-03T10:15:24.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.281+0000 7f854f056700 1 --2- 172.21.15.72:0/3487301598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8548133fa0 0x7f8548134410 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.281+0000 7f854f056700 1 --2- 172.21.15.72:0/3487301598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85480a0a30 0x7f85480a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.281+0000 7f854f056700 1 --2- 172.21.15.72:0/3487301598 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85480a1340 0x7f8548133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.281+0000 7f854f056700 1 -- 172.21.15.72:0/3487301598 >> 172.21.15.72:0/3487301598 conn(0x7f85480a6550 msgr2=0x7f85480a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.281+0000 7f854f056700 1 -- 172.21.15.72:0/3487301598 shutdown_connections 2023-10-03T10:15:24.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.281+0000 7f854f056700 1 -- 172.21.15.72:0/3487301598 wait complete. 2023-10-03T10:15:24.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.282+0000 7f854f056700 1 Processor -- start 2023-10-03T10:15:24.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.282+0000 7f854f056700 1 -- start start 2023-10-03T10:15:24.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f854f056700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85480a0a30 0x7f85481200b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f854f056700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85480a1340 0x7f85481205f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f854f056700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8548133fa0 0x7f8548120b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f854f056700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8548123b80 con 0x7f8548133fa0 2023-10-03T10:15:24.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f854f056700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8548123310 con 0x7f85480a1340 2023-10-03T10:15:24.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f854f056700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8548122ec0 con 0x7f85480a0a30 2023-10-03T10:15:24.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f854cdf2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85480a0a30 0x7f85481200b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f854d5f3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8548133fa0 0x7f8548120b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f854cdf2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85480a0a30 0x7f85481200b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42182/0 (socket says 172.21.15.72:42182) 2023-10-03T10:15:24.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f854cdf2700 1 -- 172.21.15.72:0/30950204 learned_addr learned my addr 172.21.15.72:0/30950204 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:24.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f8547fff700 1 --2- 172.21.15.72:0/30950204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85480a1340 0x7f85481205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f8547fff700 1 -- 172.21.15.72:0/30950204 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85480a0a30 msgr2=0x7f85481200b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f8547fff700 1 --2- 172.21.15.72:0/30950204 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85480a0a30 0x7f85481200b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f8547fff700 1 -- 172.21.15.72:0/30950204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8548133fa0 msgr2=0x7f8548120b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f8547fff700 1 --2- 172.21.15.72:0/30950204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8548133fa0 0x7f8548120b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f8547fff700 1 -- 172.21.15.72:0/30950204 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c009550 con 0x7f85480a1340 2023-10-03T10:15:24.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f854cdf2700 1 --2- 172.21.15.72:0/30950204 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85480a0a30 0x7f85481200b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f854d5f3700 1 --2- 172.21.15.72:0/30950204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8548133fa0 0x7f8548120b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f8547fff700 1 --2- 172.21.15.72:0/30950204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85480a1340 0x7f85481205f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f853400e9b0 tx=0x7f853400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.283+0000 7f85457fa700 1 -- 172.21.15.72:0/30950204 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853400ee50 con 0x7f85480a1340 2023-10-03T10:15:24.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.284+0000 7f85457fa700 1 -- 172.21.15.72:0/30950204 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853400c850 con 0x7f85480a1340 2023-10-03T10:15:24.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.284+0000 7f854f056700 1 -- 172.21.15.72:0/30950204 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85340094a0 con 0x7f85480a1340 2023-10-03T10:15:24.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.284+0000 7f85457fa700 1 -- 172.21.15.72:0/30950204 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853400cc00 con 0x7f85480a1340 2023-10-03T10:15:24.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.284+0000 7f854f056700 1 -- 172.21.15.72:0/30950204 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8540009a70 con 0x7f85480a1340 2023-10-03T10:15:24.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.284+0000 7f85457fa700 1 -- 172.21.15.72:0/30950204 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8534013470 con 0x7f85480a1340 2023-10-03T10:15:24.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.284+0000 7f85457fa700 1 -- 172.21.15.72:0/30950204 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f853403fb30 con 0x7f85480a1340 2023-10-03T10:15:24.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.284+0000 7f854f056700 1 -- 172.21.15.72:0/30950204 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85480a0280 con 0x7f85480a1340 2023-10-03T10:15:24.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.289+0000 7f85457fa700 1 -- 172.21.15.72:0/30950204 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8534013720 con 0x7f85480a1340 2023-10-03T10:15:24.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:24.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.481+0000 7f854f056700 1 -- 172.21.15.72:0/30950204 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8548074ea0 con 0x7f85480a1340 2023-10-03T10:15:24.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.481+0000 7f85457fa700 1 -- 172.21.15.72:0/30950204 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8534017020 con 0x7f85480a1340 2023-10-03T10:15:24.482 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.483+0000 7f854f056700 1 -- 172.21.15.72:0/30950204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85480a1340 msgr2=0x7f85481205f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.483+0000 7f854f056700 1 --2- 172.21.15.72:0/30950204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85480a1340 0x7f85481205f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f853400e9b0 tx=0x7f853400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.483+0000 7f854f056700 1 -- 172.21.15.72:0/30950204 shutdown_connections 2023-10-03T10:15:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.483+0000 7f854f056700 1 --2- 172.21.15.72:0/30950204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8548133fa0 0x7f8548120b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.483+0000 7f854f056700 1 --2- 172.21.15.72:0/30950204 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85480a0a30 0x7f85481200b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.483+0000 7f854f056700 1 --2- 172.21.15.72:0/30950204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85480a1340 0x7f85481205f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.483+0000 7f854f056700 1 -- 172.21.15.72:0/30950204 >> 172.21.15.72:0/30950204 conn(0x7f85480a6550 msgr2=0x7f854809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.483+0000 7f854f056700 1 -- 172.21.15.72:0/30950204 shutdown_connections 2023-10-03T10:15:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.483+0000 7f854f056700 1 -- 172.21.15.72:0/30950204 wait complete. 2023-10-03T10:15:24.493 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:24.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:24.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.584+0000 7fb6f2c2c700 1 Processor -- start 2023-10-03T10:15:24.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.584+0000 7fb6f2c2c700 1 -- start start 2023-10-03T10:15:24.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6f2c2c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6ec0a0a30 0x7fb6ec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6f2c2c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6ec134170 0x7fb6ec13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6f2c2c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ec09edd0 con 0x7fb6ec0a1340 2023-10-03T10:15:24.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6f2c2c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec09e1f0 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6f2c2c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec09dc50 con 0x7fb6ec134170 2023-10-03T10:15:24.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6f09c8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6ec0a0a30 0x7fb6ec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6f11c9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6ec134170 0x7fb6ec13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6f11c9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6ec134170 0x7fb6ec13bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42190/0 (socket says 172.21.15.72:42190) 2023-10-03T10:15:24.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6ebfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb6ec0a1340 0x7fb6ec133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54936/0 (socket says 172.21.15.72:54936) 2023-10-03T10:15:24.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6f09c8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6ec0a0a30 0x7fb6ec0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58754/0 (socket says 172.21.15.72:58754) 2023-10-03T10:15:24.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6f11c9700 1 -- 172.21.15.72:0/3710958075 learned_addr learned my addr 172.21.15.72:0/3710958075 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:24.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6eb7fe700 1 -- 172.21.15.72:0/3710958075 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539163511 0 0) 0x7fb6ec09edd0 con 0x7fb6ec0a1340 2023-10-03T10:15:24.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6f09c8700 1 -- 172.21.15.72:0/3710958075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6ec134170 msgr2=0x7fb6ec13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6f09c8700 1 --2- 172.21.15.72:0/3710958075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6ec134170 0x7fb6ec13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6f09c8700 1 -- 172.21.15.72:0/3710958075 >> v1:172.21.15.72:6789/0 conn(0x7fb6ec0a1340 legacy=0x7fb6ec133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6f09c8700 1 -- 172.21.15.72:0/3710958075 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec0a1fe0 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.585+0000 7fb6f11c9700 1 --2- 172.21.15.72:0/3710958075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6ec134170 0x7fb6ec13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.586+0000 7fb6f09c8700 1 --2- 172.21.15.72:0/3710958075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6ec0a0a30 0x7fb6ec0a0e00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009870 tx=0x7fb6e0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19758b26822fcbc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.586+0000 7fb6eb7fe700 1 -- 172.21.15.72:0/3710958075 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0011830 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.586+0000 7fb6eb7fe700 1 -- 172.21.15.72:0/3710958075 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e0011990 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.586+0000 7fb6eb7fe700 1 -- 172.21.15.72:0/3710958075 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0011d20 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.586+0000 7fb6f2c2c700 1 -- 172.21.15.72:0/3710958075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6ec0a0a30 msgr2=0x7fb6ec0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.586+0000 7fb6f2c2c700 1 --2- 172.21.15.72:0/3710958075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6ec0a0a30 0x7fb6ec0a0e00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009870 tx=0x7fb6e0009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.586+0000 7fb6f2c2c700 1 -- 172.21.15.72:0/3710958075 shutdown_connections 2023-10-03T10:15:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.586+0000 7fb6f2c2c700 1 --2- 172.21.15.72:0/3710958075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6ec134170 0x7fb6ec13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.586+0000 7fb6f2c2c700 1 --2- 172.21.15.72:0/3710958075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6ec0a0a30 0x7fb6ec0a0e00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.586+0000 7fb6f2c2c700 1 -- 172.21.15.72:0/3710958075 >> 172.21.15.72:0/3710958075 conn(0x7fb6ec0a6550 msgr2=0x7fb6ec0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.586+0000 7fb6f2c2c700 1 -- 172.21.15.72:0/3710958075 shutdown_connections 2023-10-03T10:15:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.586+0000 7fb6f2c2c700 1 -- 172.21.15.72:0/3710958075 wait complete. 2023-10-03T10:15:24.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.588+0000 7fb6f2c2c700 1 Processor -- start 2023-10-03T10:15:24.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.588+0000 7fb6f2c2c700 1 -- start start 2023-10-03T10:15:24.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f2c2c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6ec0a0a30 0x7fb6ec1c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f2c2c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6ec0a1340 0x7fb6ec1c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f2c2c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec134170 0x7fb6ec1c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f2c2c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec126440 con 0x7fb6ec134170 2023-10-03T10:15:24.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f2c2c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec1246d0 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f2c2c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec1244a0 con 0x7fb6ec0a1340 2023-10-03T10:15:24.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f09c8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6ec0a0a30 0x7fb6ec1c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f09c8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6ec0a0a30 0x7fb6ec1c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58770/0 (socket says 172.21.15.72:58770) 2023-10-03T10:15:24.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f09c8700 1 -- 172.21.15.72:0/1911719997 learned_addr learned my addr 172.21.15.72:0/1911719997 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:24.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6ebfff700 1 --2- 172.21.15.72:0/1911719997 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6ec0a1340 0x7fb6ec1c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f11c9700 1 --2- 172.21.15.72:0/1911719997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec134170 0x7fb6ec1c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f09c8700 1 -- 172.21.15.72:0/1911719997 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6ec0a1340 msgr2=0x7fb6ec1c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f09c8700 1 --2- 172.21.15.72:0/1911719997 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6ec0a1340 0x7fb6ec1c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f09c8700 1 -- 172.21.15.72:0/1911719997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec134170 msgr2=0x7fb6ec1c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f09c8700 1 --2- 172.21.15.72:0/1911719997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec134170 0x7fb6ec1c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f09c8700 1 -- 172.21.15.72:0/1911719997 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e4009b30 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f09c8700 1 --2- 172.21.15.72:0/1911719997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6ec0a0a30 0x7fb6ec1c8450 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009840 tx=0x7fb6e0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6e97fa700 1 -- 172.21.15.72:0/1911719997 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0004510 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6e97fa700 1 -- 172.21.15.72:0/1911719997 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e001f070 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f2c2c700 1 -- 172.21.15.72:0/1911719997 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e00094a0 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6e97fa700 1 -- 172.21.15.72:0/1911719997 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e00038e0 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.589+0000 7fb6f2c2c700 1 -- 172.21.15.72:0/1911719997 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ec0a25e0 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.590+0000 7fb6e97fa700 1 -- 172.21.15.72:0/1911719997 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6e0003a40 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.590+0000 7fb6f2c2c700 1 -- 172.21.15.72:0/1911719997 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ec0a0280 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.591+0000 7fb6e97fa700 1 -- 172.21.15.72:0/1911719997 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb6e0021070 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.595+0000 7fb6e97fa700 1 -- 172.21.15.72:0/1911719997 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6e0010380 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.621+0000 7f7249ee4700 1 Processor -- start 2023-10-03T10:15:24.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.621+0000 7f7249ee4700 1 -- start start 2023-10-03T10:15:24.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.622+0000 7f7249ee4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7244131810 0x7f7244131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.622+0000 7f7249ee4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f724409a580 0x7f7244139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.622+0000 7f7249ee4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72441313c0 con 0x7f7244099a40 2023-10-03T10:15:24.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.622+0000 7f7249ee4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724406e8c0 con 0x7f7244131810 2023-10-03T10:15:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.622+0000 7f7249ee4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7244071d20 con 0x7f724409a580 2023-10-03T10:15:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.622+0000 7f72437fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7244131810 0x7f7244131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.622+0000 7f7243fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f724409a580 0x7f7244139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.622+0000 7f7242ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7244099a40 0x7f7244099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54942/0 (socket says 172.21.15.72:54942) 2023-10-03T10:15:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.622+0000 7f7242ffd700 1 -- 172.21.15.72:0/2282898041 learned_addr learned my addr 172.21.15.72:0/2282898041 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.622+0000 7f7243fff700 1 -- 172.21.15.72:0/2282898041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7244131810 msgr2=0x7f7244131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.622+0000 7f7243fff700 1 --2- 172.21.15.72:0/2282898041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7244131810 0x7f7244131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.622+0000 7f72427fc700 1 -- 172.21.15.72:0/2282898041 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649800887 0 0) 0x7f72441313c0 con 0x7f7244099a40 2023-10-03T10:15:24.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.622+0000 7f7243fff700 1 -- 172.21.15.72:0/2282898041 >> v1:172.21.15.72:6789/0 conn(0x7f7244099a40 legacy=0x7f7244099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.622+0000 7f7243fff700 1 -- 172.21.15.72:0/2282898041 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72440721a0 con 0x7f724409a580 2023-10-03T10:15:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.622+0000 7f72437fe700 1 --2- 172.21.15.72:0/2282898041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7244131810 0x7f7244131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.623+0000 7f7243fff700 1 --2- 172.21.15.72:0/2282898041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f724409a580 0x7f7244139660 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f723c009dc0 tx=0x7f723c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87aeee05bc5ff4cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.623+0000 7f72427fc700 1 -- 172.21.15.72:0/2282898041 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c00e070 con 0x7f724409a580 2023-10-03T10:15:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.623+0000 7f72427fc700 1 -- 172.21.15.72:0/2282898041 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723c00bb20 con 0x7f724409a580 2023-10-03T10:15:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.623+0000 7f72427fc700 1 -- 172.21.15.72:0/2282898041 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c012430 con 0x7f724409a580 2023-10-03T10:15:24.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.623+0000 7f7249ee4700 1 -- 172.21.15.72:0/2282898041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f724409a580 msgr2=0x7f7244139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.623+0000 7f7249ee4700 1 --2- 172.21.15.72:0/2282898041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f724409a580 0x7f7244139660 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f723c009dc0 tx=0x7f723c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:24.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.623+0000 7f7249ee4700 1 -- 172.21.15.72:0/2282898041 shutdown_connections 2023-10-03T10:15:24.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.623+0000 7f7249ee4700 1 --2- 172.21.15.72:0/2282898041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f724409a580 0x7f7244139660 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.623+0000 7f7249ee4700 1 --2- 172.21.15.72:0/2282898041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7244131810 0x7f7244131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.623+0000 7f7249ee4700 1 -- 172.21.15.72:0/2282898041 >> 172.21.15.72:0/2282898041 conn(0x7f72440a2aa0 msgr2=0x7f72440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.623+0000 7f7249ee4700 1 -- 172.21.15.72:0/2282898041 shutdown_connections 2023-10-03T10:15:24.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.623+0000 7f7249ee4700 1 -- 172.21.15.72:0/2282898041 wait complete. 2023-10-03T10:15:24.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.624+0000 7f7249ee4700 1 Processor -- start 2023-10-03T10:15:24.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.624+0000 7f7249ee4700 1 -- start start 2023-10-03T10:15:24.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f7249ee4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7244099a40 0x7f724406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f7249ee4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f724409a580 0x7f724406fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f7249ee4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7244131810 0x7f7244070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f7249ee4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7244070a70 con 0x7f7244099a40 2023-10-03T10:15:24.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f7249ee4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724406eb00 con 0x7f724409a580 2023-10-03T10:15:24.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f7249ee4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72440a1af0 con 0x7f7244131810 2023-10-03T10:15:24.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f72437fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7244099a40 0x7f724406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f7243fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7244131810 0x7f7244070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f7242ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f724409a580 0x7f724406fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f72437fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7244099a40 0x7f724406f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49462/0 (socket says 172.21.15.72:49462) 2023-10-03T10:15:24.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f7243fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7244131810 0x7f7244070090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42220/0 (socket says 172.21.15.72:42220) 2023-10-03T10:15:24.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f72437fe700 1 -- 172.21.15.72:0/541513674 learned_addr learned my addr 172.21.15.72:0/541513674 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f72437fe700 1 -- 172.21.15.72:0/541513674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7244131810 msgr2=0x7f7244070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f72437fe700 1 --2- 172.21.15.72:0/541513674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7244131810 0x7f7244070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f72437fe700 1 -- 172.21.15.72:0/541513674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f724409a580 msgr2=0x7f724406fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f72437fe700 1 --2- 172.21.15.72:0/541513674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f724409a580 0x7f724406fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f72437fe700 1 -- 172.21.15.72:0/541513674 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72380094a0 con 0x7f7244099a40 2023-10-03T10:15:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f7243fff700 1 --2- 172.21.15.72:0/541513674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7244131810 0x7f7244070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.625+0000 7f72437fe700 1 --2- 172.21.15.72:0/541513674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7244099a40 0x7f724406f610 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f723800ebe0 tx=0x7f723800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.626+0000 7f722bfff700 1 -- 172.21.15.72:0/541513674 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723800c850 con 0x7f7244099a40 2023-10-03T10:15:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.626+0000 7f722bfff700 1 -- 172.21.15.72:0/541513674 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723800c9b0 con 0x7f7244099a40 2023-10-03T10:15:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.626+0000 7f7249ee4700 1 -- 172.21.15.72:0/541513674 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723c009a70 con 0x7f7244099a40 2023-10-03T10:15:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.626+0000 7f722bfff700 1 -- 172.21.15.72:0/541513674 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723800cd40 con 0x7f7244099a40 2023-10-03T10:15:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.626+0000 7f7249ee4700 1 -- 172.21.15.72:0/541513674 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7244120c00 con 0x7f7244099a40 2023-10-03T10:15:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.627+0000 7f722bfff700 1 -- 172.21.15.72:0/541513674 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7238013470 con 0x7f7244099a40 2023-10-03T10:15:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.627+0000 7f722bfff700 1 -- 172.21.15.72:0/541513674 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f723803f7e0 con 0x7f7244099a40 2023-10-03T10:15:24.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.627+0000 7f7249ee4700 1 -- 172.21.15.72:0/541513674 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7244071150 con 0x7f7244099a40 2023-10-03T10:15:24.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.631+0000 7f722bfff700 1 -- 172.21.15.72:0/541513674 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7238013720 con 0x7f7244099a40 2023-10-03T10:15:24.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.789+0000 7fb6f2c2c700 1 -- 172.21.15.72:0/1911719997 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb6ec09c7e0 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.789+0000 7fb6e97fa700 1 -- 172.21.15.72:0/1911719997 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6e0024b70 con 0x7fb6ec0a0a30 2023-10-03T10:15:24.791 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:24.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.791+0000 7fb6f2c2c700 1 -- 172.21.15.72:0/1911719997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6ec0a0a30 msgr2=0x7fb6ec1c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.791+0000 7fb6f2c2c700 1 --2- 172.21.15.72:0/1911719997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6ec0a0a30 0x7fb6ec1c8450 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009840 tx=0x7fb6e0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:24.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.791+0000 7fb6f2c2c700 1 -- 172.21.15.72:0/1911719997 shutdown_connections 2023-10-03T10:15:24.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.791+0000 7fb6f2c2c700 1 --2- 172.21.15.72:0/1911719997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6ec134170 0x7fb6ec1c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.791+0000 7fb6f2c2c700 1 --2- 172.21.15.72:0/1911719997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb6ec0a0a30 0x7fb6ec1c8450 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.791+0000 7fb6f2c2c700 1 --2- 172.21.15.72:0/1911719997 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb6ec0a1340 0x7fb6ec1c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.791+0000 7fb6f2c2c700 1 -- 172.21.15.72:0/1911719997 >> 172.21.15.72:0/1911719997 conn(0x7fb6ec0a6550 msgr2=0x7fb6ec09edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.791+0000 7fb6f2c2c700 1 -- 172.21.15.72:0/1911719997 shutdown_connections 2023-10-03T10:15:24.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.791+0000 7fb6f2c2c700 1 -- 172.21.15.72:0/1911719997 wait complete. 2023-10-03T10:15:24.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:24.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.821+0000 7f7249ee4700 1 -- 172.21.15.72:0/541513674 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7244074ea0 con 0x7f7244099a40 2023-10-03T10:15:24.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.821+0000 7f722bfff700 1 -- 172.21.15.72:0/541513674 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f723801b9c0 con 0x7f7244099a40 2023-10-03T10:15:24.822 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:24.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.823+0000 7f7249ee4700 1 -- 172.21.15.72:0/541513674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7244099a40 msgr2=0x7f724406f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.823+0000 7f7249ee4700 1 --2- 172.21.15.72:0/541513674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7244099a40 0x7f724406f610 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f723800ebe0 tx=0x7f723800eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.823+0000 7f7249ee4700 1 -- 172.21.15.72:0/541513674 shutdown_connections 2023-10-03T10:15:24.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.823+0000 7f7249ee4700 1 --2- 172.21.15.72:0/541513674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7244099a40 0x7f724406f610 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.823+0000 7f7249ee4700 1 --2- 172.21.15.72:0/541513674 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7244131810 0x7f7244070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.823+0000 7f7249ee4700 1 --2- 172.21.15.72:0/541513674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f724409a580 0x7f724406fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.823+0000 7f7249ee4700 1 -- 172.21.15.72:0/541513674 >> 172.21.15.72:0/541513674 conn(0x7f72440a2aa0 msgr2=0x7f72441b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.823+0000 7f7249ee4700 1 -- 172.21.15.72:0/541513674 shutdown_connections 2023-10-03T10:15:24.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.823+0000 7f7249ee4700 1 -- 172.21.15.72:0/541513674 wait complete. 2023-10-03T10:15:24.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:24.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.998+0000 7f41d164c700 1 Processor -- start 2023-10-03T10:15:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.998+0000 7f41d164c700 1 -- start start 2023-10-03T10:15:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.998+0000 7f41d164c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41cc0a0a30 0x7f41cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.998+0000 7f41d164c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41cc138d80 0x7f41cc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.998+0000 7f41d164c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41cc0a2a70 con 0x7f41cc09d630 2023-10-03T10:15:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.998+0000 7f41d164c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0a01d0 con 0x7f41cc0a0a30 2023-10-03T10:15:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.998+0000 7f41d164c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc09e2b0 con 0x7f41cc138d80 2023-10-03T10:15:25.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.999+0000 7f41cb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41cc138d80 0x7f41cc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.999+0000 7f41ca7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f41cc09d630 0x7f41cc0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54954/0 (socket says 172.21.15.72:54954) 2023-10-03T10:15:25.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.999+0000 7f41caffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41cc0a0a30 0x7f41cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.999+0000 7f41ca7fc700 1 -- 172.21.15.72:0/1430830745 learned_addr learned my addr 172.21.15.72:0/1430830745 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:25.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.999+0000 7f41cb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41cc138d80 0x7f41cc13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42230/0 (socket says 172.21.15.72:42230) 2023-10-03T10:15:25.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.999+0000 7f41c9ffb700 1 -- 172.21.15.72:0/1430830745 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827711185 0 0) 0x7f41cc0a2a70 con 0x7f41cc09d630 2023-10-03T10:15:25.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.999+0000 7f41caffd700 1 -- 172.21.15.72:0/1430830745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41cc138d80 msgr2=0x7f41cc13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.999+0000 7f41caffd700 1 --2- 172.21.15.72:0/1430830745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41cc138d80 0x7f41cc13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.999+0000 7f41caffd700 1 -- 172.21.15.72:0/1430830745 >> v1:172.21.15.72:6789/0 conn(0x7f41cc09d630 legacy=0x7f41cc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.999+0000 7f41caffd700 1 -- 172.21.15.72:0/1430830745 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc09dc50 con 0x7f41cc0a0a30 2023-10-03T10:15:25.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.999+0000 7f41cb7fe700 1 --2- 172.21.15.72:0/1430830745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41cc138d80 0x7f41cc13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.999+0000 7f41caffd700 1 --2- 172.21.15.72:0/1430830745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41cc0a0a30 0x7f41cc0a0e00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009870 tx=0x7f41c0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cd71f2b0b23bb51 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.999+0000 7f41c9ffb700 1 -- 172.21.15.72:0/1430830745 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0011830 con 0x7f41cc0a0a30 2023-10-03T10:15:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.999+0000 7f41c9ffb700 1 -- 172.21.15.72:0/1430830745 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c0011990 con 0x7f41cc0a0a30 2023-10-03T10:15:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:24.999+0000 7f41c9ffb700 1 -- 172.21.15.72:0/1430830745 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0011d20 con 0x7f41cc0a0a30 2023-10-03T10:15:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.000+0000 7f41d164c700 1 -- 172.21.15.72:0/1430830745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41cc0a0a30 msgr2=0x7f41cc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.000+0000 7f41d164c700 1 --2- 172.21.15.72:0/1430830745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41cc0a0a30 0x7f41cc0a0e00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009870 tx=0x7f41c0009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.000+0000 7f41d164c700 1 -- 172.21.15.72:0/1430830745 shutdown_connections 2023-10-03T10:15:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.000+0000 7f41d164c700 1 --2- 172.21.15.72:0/1430830745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41cc138d80 0x7f41cc13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.000+0000 7f41d164c700 1 --2- 172.21.15.72:0/1430830745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41cc0a0a30 0x7f41cc0a0e00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.000+0000 7f41d164c700 1 -- 172.21.15.72:0/1430830745 >> 172.21.15.72:0/1430830745 conn(0x7f41cc0a3050 msgr2=0x7f41cc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.000+0000 7f41d164c700 1 -- 172.21.15.72:0/1430830745 shutdown_connections 2023-10-03T10:15:25.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.000+0000 7f41d164c700 1 -- 172.21.15.72:0/1430830745 wait complete. 2023-10-03T10:15:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.001+0000 7f41d164c700 1 Processor -- start 2023-10-03T10:15:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.001+0000 7f41d164c700 1 -- start start 2023-10-03T10:15:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41d164c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41cc09d630 0x7f41cc133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41d164c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41cc0a0a30 0x7f41cc133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41d164c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41cc138d80 0x7f41cc134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41d164c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc137d30 con 0x7f41cc0a0a30 2023-10-03T10:15:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41d164c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0a4bf0 con 0x7f41cc09d630 2023-10-03T10:15:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41d164c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0a0410 con 0x7f41cc138d80 2023-10-03T10:15:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41caffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41cc09d630 0x7f41cc133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41ca7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41cc0a0a30 0x7f41cc133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41caffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41cc09d630 0x7f41cc133700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58810/0 (socket says 172.21.15.72:58810) 2023-10-03T10:15:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41caffd700 1 -- 172.21.15.72:0/3229407216 learned_addr learned my addr 172.21.15.72:0/3229407216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41cb7fe700 1 --2- 172.21.15.72:0/3229407216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41cc138d80 0x7f41cc134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41caffd700 1 -- 172.21.15.72:0/3229407216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41cc138d80 msgr2=0x7f41cc134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41caffd700 1 --2- 172.21.15.72:0/3229407216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41cc138d80 0x7f41cc134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41caffd700 1 -- 172.21.15.72:0/3229407216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41cc0a0a30 msgr2=0x7f41cc133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41caffd700 1 --2- 172.21.15.72:0/3229407216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41cc0a0a30 0x7f41cc133c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41caffd700 1 -- 172.21.15.72:0/3229407216 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c4009a70 con 0x7f41cc09d630 2023-10-03T10:15:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.002+0000 7f41caffd700 1 --2- 172.21.15.72:0/3229407216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41cc09d630 0x7f41cc133700 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009840 tx=0x7f41c0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.003+0000 7f41b37fe700 1 -- 172.21.15.72:0/3229407216 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0004510 con 0x7f41cc09d630 2023-10-03T10:15:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.003+0000 7f41b37fe700 1 -- 172.21.15.72:0/3229407216 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c001f070 con 0x7f41cc09d630 2023-10-03T10:15:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.003+0000 7f41b37fe700 1 -- 172.21.15.72:0/3229407216 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c00038e0 con 0x7f41cc09d630 2023-10-03T10:15:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.003+0000 7f41d164c700 1 -- 172.21.15.72:0/3229407216 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c00094a0 con 0x7f41cc09d630 2023-10-03T10:15:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.003+0000 7f41d164c700 1 -- 172.21.15.72:0/3229407216 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41cc136500 con 0x7f41cc09d630 2023-10-03T10:15:25.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.003+0000 7f41b37fe700 1 -- 172.21.15.72:0/3229407216 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41c0003a40 con 0x7f41cc09d630 2023-10-03T10:15:25.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.003+0000 7f41b37fe700 1 -- 172.21.15.72:0/3229407216 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f41c0021070 con 0x7f41cc09d630 2023-10-03T10:15:25.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.004+0000 7f41d164c700 1 -- 172.21.15.72:0/3229407216 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41cc0747f0 con 0x7f41cc09d630 2023-10-03T10:15:25.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.008+0000 7f41b37fe700 1 -- 172.21.15.72:0/3229407216 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41c0015080 con 0x7f41cc09d630 2023-10-03T10:15:25.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.191+0000 7f41d164c700 1 -- 172.21.15.72:0/3229407216 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f41cc136ed0 con 0x7f41cc09d630 2023-10-03T10:15:25.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.191+0000 7f41b37fe700 1 -- 172.21.15.72:0/3229407216 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41c002b020 con 0x7f41cc09d630 2023-10-03T10:15:25.192 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:25.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.193+0000 7f41d164c700 1 -- 172.21.15.72:0/3229407216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41cc09d630 msgr2=0x7f41cc133700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.193+0000 7f41d164c700 1 --2- 172.21.15.72:0/3229407216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41cc09d630 0x7f41cc133700 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009840 tx=0x7f41c0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:25.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.193+0000 7f41d164c700 1 -- 172.21.15.72:0/3229407216 shutdown_connections 2023-10-03T10:15:25.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.193+0000 7f41d164c700 1 --2- 172.21.15.72:0/3229407216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41cc138d80 0x7f41cc134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.193+0000 7f41d164c700 1 --2- 172.21.15.72:0/3229407216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41cc09d630 0x7f41cc133700 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.193+0000 7f41d164c700 1 --2- 172.21.15.72:0/3229407216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41cc0a0a30 0x7f41cc133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.193+0000 7f41d164c700 1 -- 172.21.15.72:0/3229407216 >> 172.21.15.72:0/3229407216 conn(0x7f41cc0a3050 msgr2=0x7f41cc13add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.193+0000 7f41d164c700 1 -- 172.21.15.72:0/3229407216 shutdown_connections 2023-10-03T10:15:25.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.193+0000 7f41d164c700 1 -- 172.21.15.72:0/3229407216 wait complete. 2023-10-03T10:15:25.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:25.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:25.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.620+0000 7f608be98700 1 Processor -- start 2023-10-03T10:15:25.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.620+0000 7f608be98700 1 -- start start 2023-10-03T10:15:25.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f608be98700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6084131630 0x7f6084131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f608be98700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608406eba0 0x7f6084139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f608be98700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6084071a00 con 0x7f6084131f40 2023-10-03T10:15:25.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f608be98700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6084131430 con 0x7f608406eba0 2023-10-03T10:15:25.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f608be98700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f608409a510 con 0x7f6084131630 2023-10-03T10:15:25.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f6089c34700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6084131630 0x7f6084131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f6089433700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6084131f40 0x7f608406e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54970/0 (socket says 172.21.15.72:54970) 2023-10-03T10:15:25.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f6089433700 1 -- 172.21.15.72:0/802451953 learned_addr learned my addr 172.21.15.72:0/802451953 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:25.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f608a435700 1 --2- 172.21.15.72:0/802451953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608406eba0 0x7f6084139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f6088c32700 1 -- 172.21.15.72:0/802451953 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186101936 0 0) 0x7f6084071a00 con 0x7f6084131f40 2023-10-03T10:15:25.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f6089c34700 1 -- 172.21.15.72:0/802451953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608406eba0 msgr2=0x7f6084139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f6089c34700 1 --2- 172.21.15.72:0/802451953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608406eba0 0x7f6084139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f6089c34700 1 -- 172.21.15.72:0/802451953 >> v1:172.21.15.72:6789/0 conn(0x7f6084131f40 legacy=0x7f608406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f6089c34700 1 -- 172.21.15.72:0/802451953 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60840721c0 con 0x7f6084131630 2023-10-03T10:15:25.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f608a435700 1 --2- 172.21.15.72:0/802451953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608406eba0 0x7f6084139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:25.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.621+0000 7f6089c34700 1 --2- 172.21.15.72:0/802451953 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6084131630 0x7f6084131a00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6080009870 tx=0x7f6080009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa90f03278d2023f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.622+0000 7f6088c32700 1 -- 172.21.15.72:0/802451953 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080011830 con 0x7f6084131630 2023-10-03T10:15:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.622+0000 7f6088c32700 1 -- 172.21.15.72:0/802451953 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6080011990 con 0x7f6084131630 2023-10-03T10:15:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.622+0000 7f6088c32700 1 -- 172.21.15.72:0/802451953 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080011d20 con 0x7f6084131630 2023-10-03T10:15:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.622+0000 7f608be98700 1 -- 172.21.15.72:0/802451953 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6084131630 msgr2=0x7f6084131a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.622+0000 7f608be98700 1 --2- 172.21.15.72:0/802451953 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6084131630 0x7f6084131a00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6080009870 tx=0x7f6080009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.622+0000 7f608be98700 1 -- 172.21.15.72:0/802451953 shutdown_connections 2023-10-03T10:15:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.622+0000 7f608be98700 1 --2- 172.21.15.72:0/802451953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608406eba0 0x7f6084139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.622+0000 7f608be98700 1 --2- 172.21.15.72:0/802451953 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6084131630 0x7f6084131a00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.622+0000 7f608be98700 1 -- 172.21.15.72:0/802451953 >> 172.21.15.72:0/802451953 conn(0x7f60840a2aa0 msgr2=0x7f60840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.622+0000 7f608be98700 1 -- 172.21.15.72:0/802451953 shutdown_connections 2023-10-03T10:15:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.622+0000 7f608be98700 1 -- 172.21.15.72:0/802451953 wait complete. 2023-10-03T10:15:25.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.623+0000 7f608be98700 1 Processor -- start 2023-10-03T10:15:25.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.623+0000 7f608be98700 1 -- start start 2023-10-03T10:15:25.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.623+0000 7f608be98700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f608406eba0 0x7f608411b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.623+0000 7f608be98700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6084131630 0x7f608411bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.623+0000 7f608be98700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6084131f40 0x7f608411c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f608be98700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608411cb10 con 0x7f6084131f40 2023-10-03T10:15:25.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f608be98700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608411d290 con 0x7f6084131630 2023-10-03T10:15:25.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f608be98700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f608411d8b0 con 0x7f608406eba0 2023-10-03T10:15:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f6089c34700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f608406eba0 0x7f608411b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f6089c34700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f608406eba0 0x7f608411b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42260/0 (socket says 172.21.15.72:42260) 2023-10-03T10:15:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f6089c34700 1 -- 172.21.15.72:0/1438233098 learned_addr learned my addr 172.21.15.72:0/1438233098 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f608a435700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6084131f40 0x7f608411c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f6089433700 1 --2- 172.21.15.72:0/1438233098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6084131630 0x7f608411bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f6089c34700 1 -- 172.21.15.72:0/1438233098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6084131630 msgr2=0x7f608411bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f6089c34700 1 --2- 172.21.15.72:0/1438233098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6084131630 0x7f608411bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f6089c34700 1 -- 172.21.15.72:0/1438233098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6084131f40 msgr2=0x7f608411c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f6089c34700 1 --2- 172.21.15.72:0/1438233098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6084131f40 0x7f608411c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f6089c34700 1 -- 172.21.15.72:0/1438233098 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c009a70 con 0x7f608406eba0 2023-10-03T10:15:25.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f6089c34700 1 --2- 172.21.15.72:0/1438233098 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f608406eba0 0x7f608411b680 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f608409a6a0 tx=0x7f6080004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f607a7fc700 1 -- 172.21.15.72:0/1438233098 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60800044d0 con 0x7f608406eba0 2023-10-03T10:15:25.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f607a7fc700 1 -- 172.21.15.72:0/1438233098 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608001f070 con 0x7f608406eba0 2023-10-03T10:15:25.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f608be98700 1 -- 172.21.15.72:0/1438233098 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60800094a0 con 0x7f608406eba0 2023-10-03T10:15:25.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f607a7fc700 1 -- 172.21.15.72:0/1438233098 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60800038c0 con 0x7f608406eba0 2023-10-03T10:15:25.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.624+0000 7f608be98700 1 -- 172.21.15.72:0/1438233098 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608406e560 con 0x7f608406eba0 2023-10-03T10:15:25.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.625+0000 7f607a7fc700 1 -- 172.21.15.72:0/1438233098 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6080003a20 con 0x7f608406eba0 2023-10-03T10:15:25.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.625+0000 7f607a7fc700 1 -- 172.21.15.72:0/1438233098 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6080021070 con 0x7f608406eba0 2023-10-03T10:15:25.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.625+0000 7f608be98700 1 -- 172.21.15.72:0/1438233098 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6084074ea0 con 0x7f608406eba0 2023-10-03T10:15:25.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.630+0000 7f607a7fc700 1 -- 172.21.15.72:0/1438233098 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f608001a950 con 0x7f608406eba0 2023-10-03T10:15:25.805 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:25.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.817+0000 7f608be98700 1 -- 172.21.15.72:0/1438233098 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6084099f20 con 0x7f608406eba0 2023-10-03T10:15:25.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.817+0000 7f607a7fc700 1 -- 172.21.15.72:0/1438233098 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6080024b70 con 0x7f608406eba0 2023-10-03T10:15:25.818 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:25.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.819+0000 7f608be98700 1 -- 172.21.15.72:0/1438233098 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f608406eba0 msgr2=0x7f608411b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.819+0000 7f608be98700 1 --2- 172.21.15.72:0/1438233098 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f608406eba0 0x7f608411b680 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f608409a6a0 tx=0x7f6080004750 comp rx=0 tx=0).stop 2023-10-03T10:15:25.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.819+0000 7f608be98700 1 -- 172.21.15.72:0/1438233098 shutdown_connections 2023-10-03T10:15:25.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.819+0000 7f608be98700 1 --2- 172.21.15.72:0/1438233098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6084131f40 0x7f608411c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.819+0000 7f608be98700 1 --2- 172.21.15.72:0/1438233098 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f608406eba0 0x7f608411b680 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.819+0000 7f608be98700 1 --2- 172.21.15.72:0/1438233098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6084131630 0x7f608411bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.819+0000 7f608be98700 1 -- 172.21.15.72:0/1438233098 >> 172.21.15.72:0/1438233098 conn(0x7f60840a2aa0 msgr2=0x7f60841b8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.819+0000 7f608be98700 1 -- 172.21.15.72:0/1438233098 shutdown_connections 2023-10-03T10:15:25.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.819+0000 7f608be98700 1 -- 172.21.15.72:0/1438233098 wait complete. 2023-10-03T10:15:25.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:25.838 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:25.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.930+0000 7fa7a7123700 1 Processor -- start 2023-10-03T10:15:25.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.930+0000 7fa7a7123700 1 -- start start 2023-10-03T10:15:25.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.930+0000 7fa7a7123700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7a009d630 0x7fa7a00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.930+0000 7fa7a7123700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa7a0138d80 0x7fa7a013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.930+0000 7fa7a7123700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a00a2a70 con 0x7fa7a00a0a30 2023-10-03T10:15:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.930+0000 7fa7a7123700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a00a01d0 con 0x7fa7a0138d80 2023-10-03T10:15:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.930+0000 7fa7a7123700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a009e2b0 con 0x7fa7a009d630 2023-10-03T10:15:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.930+0000 7fa7a56c0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa7a0138d80 0x7fa7a013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.930+0000 7fa79ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7a009d630 0x7fa7a00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.930+0000 7fa7a56c0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa7a0138d80 0x7fa7a013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49492/0 (socket says 172.21.15.72:49492) 2023-10-03T10:15:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.930+0000 7fa7a56c0700 1 -- 172.21.15.72:0/2077146908 learned_addr learned my addr 172.21.15.72:0/2077146908 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.931+0000 7fa7a56c0700 1 -- 172.21.15.72:0/2077146908 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7a009d630 msgr2=0x7fa7a00a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.931+0000 7fa7a56c0700 1 --2- 172.21.15.72:0/2077146908 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7a009d630 0x7fa7a00a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.931+0000 7fa7a56c0700 1 -- 172.21.15.72:0/2077146908 >> v1:172.21.15.72:6789/0 conn(0x7fa7a00a0a30 legacy=0x7fa7a00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.931+0000 7fa7a56c0700 1 -- 172.21.15.72:0/2077146908 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a009dc50 con 0x7fa7a0138d80 2023-10-03T10:15:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.931+0000 7fa79ffff700 1 --2- 172.21.15.72:0/2077146908 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7a009d630 0x7fa7a00a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.931+0000 7fa7a56c0700 1 --2- 172.21.15.72:0/2077146908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a0138d80 0x7fa7a013b160 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa798009e50 tx=0x7fa79800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb19d4338d4d660 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.931+0000 7fa79f7fe700 1 -- 172.21.15.72:0/2077146908 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79800e070 con 0x7fa7a0138d80 2023-10-03T10:15:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.931+0000 7fa79f7fe700 1 -- 172.21.15.72:0/2077146908 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79800b910 con 0x7fa7a0138d80 2023-10-03T10:15:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.931+0000 7fa79f7fe700 1 -- 172.21.15.72:0/2077146908 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79800bcc0 con 0x7fa7a0138d80 2023-10-03T10:15:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.932+0000 7fa7a7123700 1 -- 172.21.15.72:0/2077146908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a0138d80 msgr2=0x7fa7a013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.932+0000 7fa7a7123700 1 --2- 172.21.15.72:0/2077146908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a0138d80 0x7fa7a013b160 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa798009e50 tx=0x7fa79800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.932+0000 7fa7a7123700 1 -- 172.21.15.72:0/2077146908 shutdown_connections 2023-10-03T10:15:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.932+0000 7fa7a7123700 1 --2- 172.21.15.72:0/2077146908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a0138d80 0x7fa7a013b160 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.932+0000 7fa7a7123700 1 --2- 172.21.15.72:0/2077146908 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7a009d630 0x7fa7a00a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.932+0000 7fa7a7123700 1 -- 172.21.15.72:0/2077146908 >> 172.21.15.72:0/2077146908 conn(0x7fa7a00a3050 msgr2=0x7fa7a00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.932+0000 7fa7a7123700 1 -- 172.21.15.72:0/2077146908 shutdown_connections 2023-10-03T10:15:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.932+0000 7fa7a7123700 1 -- 172.21.15.72:0/2077146908 wait complete. 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.933+0000 7fa7a7123700 1 Processor -- start 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.933+0000 7fa7a7123700 1 -- start start 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.933+0000 7fa7a7123700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7a009d630 0x7fa7a01339b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.933+0000 7fa7a7123700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a00a0a30 0x7fa7a0133ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.933+0000 7fa7a7123700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7a0138d80 0x7fa7a0134430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.933+0000 7fa7a7123700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a0136550 con 0x7fa7a00a0a30 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.933+0000 7fa7a7123700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a01389b0 con 0x7fa7a009d630 2023-10-03T10:15:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.933+0000 7fa7a7123700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a00a4d10 con 0x7fa7a0138d80 2023-10-03T10:15:25.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.933+0000 7fa79ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a00a0a30 0x7fa7a0133ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.933+0000 7fa7a4ebf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7a009d630 0x7fa7a01339b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.933+0000 7fa79ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a00a0a30 0x7fa7a0133ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49494/0 (socket says 172.21.15.72:49494) 2023-10-03T10:15:25.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.933+0000 7fa79ffff700 1 -- 172.21.15.72:0/2383070815 learned_addr learned my addr 172.21.15.72:0/2383070815 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:25.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.933+0000 7fa7a56c0700 1 --2- 172.21.15.72:0/2383070815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7a0138d80 0x7fa7a0134430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.934+0000 7fa79ffff700 1 -- 172.21.15.72:0/2383070815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7a0138d80 msgr2=0x7fa7a0134430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.934+0000 7fa79ffff700 1 --2- 172.21.15.72:0/2383070815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7a0138d80 0x7fa7a0134430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.934+0000 7fa79ffff700 1 -- 172.21.15.72:0/2383070815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7a009d630 msgr2=0x7fa7a01339b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.934+0000 7fa79ffff700 1 --2- 172.21.15.72:0/2383070815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7a009d630 0x7fa7a01339b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.934+0000 7fa79ffff700 1 -- 172.21.15.72:0/2383070815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c0094a0 con 0x7fa7a00a0a30 2023-10-03T10:15:25.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.934+0000 7fa7a4ebf700 1 --2- 172.21.15.72:0/2383070815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7a009d630 0x7fa7a01339b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:25.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.934+0000 7fa79ffff700 1 --2- 172.21.15.72:0/2383070815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a00a0a30 0x7fa7a0133ef0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00ebe0 tx=0x7fa78c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.934+0000 7fa79d7fa700 1 -- 172.21.15.72:0/2383070815 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c00c850 con 0x7fa7a00a0a30 2023-10-03T10:15:25.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.934+0000 7fa79d7fa700 1 -- 172.21.15.72:0/2383070815 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c00c9b0 con 0x7fa7a00a0a30 2023-10-03T10:15:25.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.934+0000 7fa7a7123700 1 -- 172.21.15.72:0/2383070815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa798009b30 con 0x7fa7a00a0a30 2023-10-03T10:15:25.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.934+0000 7fa79d7fa700 1 -- 172.21.15.72:0/2383070815 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c00cd40 con 0x7fa7a00a0a30 2023-10-03T10:15:25.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.934+0000 7fa7a7123700 1 -- 172.21.15.72:0/2383070815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a00a0410 con 0x7fa7a00a0a30 2023-10-03T10:15:25.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.935+0000 7fa79d7fa700 1 -- 172.21.15.72:0/2383070815 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa78c013470 con 0x7fa7a00a0a30 2023-10-03T10:15:25.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.935+0000 7fa7a7123700 1 -- 172.21.15.72:0/2383070815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a0135bf0 con 0x7fa7a00a0a30 2023-10-03T10:15:25.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.935+0000 7fa79d7fa700 1 -- 172.21.15.72:0/2383070815 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa78c03f7e0 con 0x7fa7a00a0a30 2023-10-03T10:15:25.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.940+0000 7fa79d7fa700 1 -- 172.21.15.72:0/2383070815 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa78c013aa0 con 0x7fa7a00a0a30 2023-10-03T10:15:25.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.999+0000 7f66049b4700 1 Processor -- start 2023-10-03T10:15:25.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:25.999+0000 7f66049b4700 1 -- start start 2023-10-03T10:15:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f66049b4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f66000a0a30 0x7f66000a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f66049b4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660009d630 0x7f66000a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f66049b4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66000a2a70 con 0x7f6600133930 2023-10-03T10:15:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f66049b4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66000a01d0 con 0x7f66000a0a30 2023-10-03T10:15:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f66049b4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f660009e2b0 con 0x7f660009d630 2023-10-03T10:15:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fdd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660009d630 0x7f66000a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fe59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f66000a0a30 0x7f66000a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fdd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660009d630 0x7f66000a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42274/0 (socket says 172.21.15.72:42274) 2023-10-03T10:15:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fe59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f66000a0a30 0x7f66000a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49502/0 (socket says 172.21.15.72:49502) 2023-10-03T10:15:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6600133930 0x7f6600133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54988/0 (socket says 172.21.15.72:54988) 2023-10-03T10:15:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fdd9b700 1 -- 172.21.15.72:0/3847371803 learned_addr learned my addr 172.21.15.72:0/3847371803 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fe59c700 1 -- 172.21.15.72:0/3847371803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660009d630 msgr2=0x7f66000a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fe59c700 1 --2- 172.21.15.72:0/3847371803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660009d630 0x7f66000a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fe59c700 1 -- 172.21.15.72:0/3847371803 >> v1:172.21.15.72:6789/0 conn(0x7f6600133930 legacy=0x7f6600133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fe59c700 1 -- 172.21.15.72:0/3847371803 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660009dc50 con 0x7f66000a0a30 2023-10-03T10:15:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fdd9b700 1 --2- 172.21.15.72:0/3847371803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660009d630 0x7f66000a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fd59a700 1 -- 172.21.15.72:0/3847371803 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507171203 0 0) 0x7f66000a2a70 con 0x7f6600133930 2023-10-03T10:15:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fe59c700 1 --2- 172.21.15.72:0/3847371803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66000a0a30 0x7f66000a0e00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009840 tx=0x7f65f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bdc3828be9bb0f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fd59a700 1 -- 172.21.15.72:0/3847371803 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f0011830 con 0x7f66000a0a30 2023-10-03T10:15:26.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fd59a700 1 -- 172.21.15.72:0/3847371803 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f0011990 con 0x7f66000a0a30 2023-10-03T10:15:26.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.000+0000 7f65fd59a700 1 -- 172.21.15.72:0/3847371803 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f0011d20 con 0x7f66000a0a30 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.001+0000 7f66049b4700 1 -- 172.21.15.72:0/3847371803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66000a0a30 msgr2=0x7f66000a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.001+0000 7f66049b4700 1 --2- 172.21.15.72:0/3847371803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66000a0a30 0x7f66000a0e00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009840 tx=0x7f65f0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.001+0000 7f66049b4700 1 -- 172.21.15.72:0/3847371803 shutdown_connections 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.001+0000 7f66049b4700 1 --2- 172.21.15.72:0/3847371803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66000a0a30 0x7f66000a0e00 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.001+0000 7f66049b4700 1 --2- 172.21.15.72:0/3847371803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660009d630 0x7f66000a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.001+0000 7f66049b4700 1 -- 172.21.15.72:0/3847371803 >> 172.21.15.72:0/3847371803 conn(0x7f66000a3050 msgr2=0x7f66000a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.001+0000 7f66049b4700 1 -- 172.21.15.72:0/3847371803 shutdown_connections 2023-10-03T10:15:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.001+0000 7f66049b4700 1 -- 172.21.15.72:0/3847371803 wait complete. 2023-10-03T10:15:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.002+0000 7f66049b4700 1 Processor -- start 2023-10-03T10:15:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.002+0000 7f66049b4700 1 -- start start 2023-10-03T10:15:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f66049b4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660009d630 0x7f66001c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f66049b4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66000a0a30 0x7f66001c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f66049b4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6600133930 0x7f660011ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f66049b4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66001c8d50 con 0x7f6600133930 2023-10-03T10:15:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f66049b4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6600122460 con 0x7f66000a0a30 2023-10-03T10:15:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f66049b4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6600133500 con 0x7f660009d630 2023-10-03T10:15:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f65fe59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660009d630 0x7f66001c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f65fe59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660009d630 0x7f66001c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42288/0 (socket says 172.21.15.72:42288) 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f65fe59c700 1 -- 172.21.15.72:0/112562269 learned_addr learned my addr 172.21.15.72:0/112562269 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f65fdd9b700 1 --2- 172.21.15.72:0/112562269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66000a0a30 0x7f66001c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f65fed9d700 1 --2- 172.21.15.72:0/112562269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6600133930 0x7f660011ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f65fe59c700 1 -- 172.21.15.72:0/112562269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66000a0a30 msgr2=0x7f66001c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f65fe59c700 1 --2- 172.21.15.72:0/112562269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66000a0a30 0x7f66001c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f65fe59c700 1 -- 172.21.15.72:0/112562269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6600133930 msgr2=0x7f660011ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f65fe59c700 1 --2- 172.21.15.72:0/112562269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6600133930 0x7f660011ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f65fe59c700 1 -- 172.21.15.72:0/112562269 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f4009550 con 0x7f660009d630 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f65fe59c700 1 --2- 172.21.15.72:0/112562269 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660009d630 0x7f66001c82d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009fd0 tx=0x7f65f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f65eeffd700 1 -- 172.21.15.72:0/112562269 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f0004340 con 0x7f660009d630 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f65eeffd700 1 -- 172.21.15.72:0/112562269 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f001f070 con 0x7f660009d630 2023-10-03T10:15:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f66049b4700 1 -- 172.21.15.72:0/112562269 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f00094a0 con 0x7f660009d630 2023-10-03T10:15:26.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.003+0000 7f65eeffd700 1 -- 172.21.15.72:0/112562269 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f00036a0 con 0x7f660009d630 2023-10-03T10:15:26.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.004+0000 7f66049b4700 1 -- 172.21.15.72:0/112562269 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6600122180 con 0x7f660009d630 2023-10-03T10:15:26.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.004+0000 7f65eeffd700 1 -- 172.21.15.72:0/112562269 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65f0021030 con 0x7f660009d630 2023-10-03T10:15:26.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.004+0000 7f65eeffd700 1 -- 172.21.15.72:0/112562269 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f65f0040900 con 0x7f660009d630 2023-10-03T10:15:26.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.005+0000 7f66049b4700 1 -- 172.21.15.72:0/112562269 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6600121150 con 0x7f660009d630 2023-10-03T10:15:26.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.009+0000 7f65eeffd700 1 -- 172.21.15.72:0/112562269 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65f00239c0 con 0x7f660009d630 2023-10-03T10:15:26.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.133+0000 7fa7a7123700 1 -- 172.21.15.72:0/2383070815 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa7a00747f0 con 0x7fa7a00a0a30 2023-10-03T10:15:26.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.133+0000 7fa79d7fa700 1 -- 172.21.15.72:0/2383070815 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa78c01b9c0 con 0x7fa7a00a0a30 2023-10-03T10:15:26.134 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:26.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.135+0000 7fa7a7123700 1 -- 172.21.15.72:0/2383070815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a00a0a30 msgr2=0x7fa7a0133ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.135+0000 7fa7a7123700 1 --2- 172.21.15.72:0/2383070815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a00a0a30 0x7fa7a0133ef0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00ebe0 tx=0x7fa78c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.135+0000 7fa7a7123700 1 -- 172.21.15.72:0/2383070815 shutdown_connections 2023-10-03T10:15:26.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.135+0000 7fa7a7123700 1 --2- 172.21.15.72:0/2383070815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7a0138d80 0x7fa7a0134430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.135+0000 7fa7a7123700 1 --2- 172.21.15.72:0/2383070815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7a009d630 0x7fa7a01339b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.135+0000 7fa7a7123700 1 --2- 172.21.15.72:0/2383070815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7a00a0a30 0x7fa7a0133ef0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.135+0000 7fa7a7123700 1 -- 172.21.15.72:0/2383070815 >> 172.21.15.72:0/2383070815 conn(0x7fa7a00a3050 msgr2=0x7fa7a009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.135+0000 7fa7a7123700 1 -- 172.21.15.72:0/2383070815 shutdown_connections 2023-10-03T10:15:26.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.136+0000 7fa7a7123700 1 -- 172.21.15.72:0/2383070815 wait complete. 2023-10-03T10:15:26.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:26.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.198+0000 7f66049b4700 1 -- 172.21.15.72:0/112562269 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f66000747f0 con 0x7f660009d630 2023-10-03T10:15:26.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.199+0000 7f65eeffd700 1 -- 172.21.15.72:0/112562269 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f65f0015020 con 0x7f660009d630 2023-10-03T10:15:26.199 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:26.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.200+0000 7f66049b4700 1 -- 172.21.15.72:0/112562269 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660009d630 msgr2=0x7f66001c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.200+0000 7f66049b4700 1 --2- 172.21.15.72:0/112562269 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660009d630 0x7f66001c82d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009fd0 tx=0x7f65f0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:26.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.201+0000 7f66049b4700 1 -- 172.21.15.72:0/112562269 shutdown_connections 2023-10-03T10:15:26.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.201+0000 7f66049b4700 1 --2- 172.21.15.72:0/112562269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6600133930 0x7f660011ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.201+0000 7f66049b4700 1 --2- 172.21.15.72:0/112562269 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660009d630 0x7f66001c82d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.201+0000 7f66049b4700 1 --2- 172.21.15.72:0/112562269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66000a0a30 0x7f66001c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.201+0000 7f66049b4700 1 -- 172.21.15.72:0/112562269 >> 172.21.15.72:0/112562269 conn(0x7f66000a3050 msgr2=0x7f66001bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.201+0000 7f66049b4700 1 -- 172.21.15.72:0/112562269 shutdown_connections 2023-10-03T10:15:26.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.201+0000 7f66049b4700 1 -- 172.21.15.72:0/112562269 wait complete. 2023-10-03T10:15:26.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:26.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:26.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.328+0000 7fe83c8ff700 1 Processor -- start 2023-10-03T10:15:26.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.328+0000 7fe83c8ff700 1 -- start start 2023-10-03T10:15:26.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.328+0000 7fe83c8ff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe83809d6f0 0x7fe83809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.328+0000 7fe83c8ff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe83809e000 0x7fe838130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.328+0000 7fe83c8ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe83809e410 0x7fe838130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.328+0000 7fe83c8ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83809f520 con 0x7fe83809e410 2023-10-03T10:15:26.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.328+0000 7fe83c8ff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83809f130 con 0x7fe83809e000 2023-10-03T10:15:26.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.328+0000 7fe83c8ff700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe83809e930 con 0x7fe83809d6f0 2023-10-03T10:15:26.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.328+0000 7fe83659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe83809d6f0 0x7fe83809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.328+0000 7fe836d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe83809e410 0x7fe838130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.328+0000 7fe835d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe83809e000 0x7fe838130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.328+0000 7fe836d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe83809e410 0x7fe838130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49526/0 (socket says 172.21.15.72:49526) 2023-10-03T10:15:26.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.328+0000 7fe83659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe83809d6f0 0x7fe83809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42304/0 (socket says 172.21.15.72:42304) 2023-10-03T10:15:26.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.328+0000 7fe836d9d700 1 -- 172.21.15.72:0/935919021 learned_addr learned my addr 172.21.15.72:0/935919021 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:26.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.328+0000 7fe835d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe83809e000 0x7fe838130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58880/0 (socket says 172.21.15.72:58880) 2023-10-03T10:15:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.329+0000 7fe83659c700 1 -- 172.21.15.72:0/935919021 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe83809e000 msgr2=0x7fe838130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.329+0000 7fe83659c700 1 --2- 172.21.15.72:0/935919021 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe83809e000 0x7fe838130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.329+0000 7fe83659c700 1 -- 172.21.15.72:0/935919021 >> v2:172.21.15.72:3300/0 conn(0x7fe83809e410 msgr2=0x7fe838130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.329+0000 7fe83659c700 1 --2- 172.21.15.72:0/935919021 >> v2:172.21.15.72:3300/0 conn(0x7fe83809e410 0x7fe838130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.329+0000 7fe83659c700 1 -- 172.21.15.72:0/935919021 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83809b2d0 con 0x7fe83809d6f0 2023-10-03T10:15:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.329+0000 7fe835d9b700 1 --2- 172.21.15.72:0/935919021 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe83809e000 0x7fe838130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.329+0000 7fe836d9d700 1 --2- 172.21.15.72:0/935919021 >> v2:172.21.15.72:3300/0 conn(0x7fe83809e410 0x7fe838130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.329+0000 7fe83659c700 1 --2- 172.21.15.72:0/935919021 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe83809d6f0 0x7fe83809dac0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe828009870 tx=0x7fe828009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aabe4b27bb79ac3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.329+0000 7fe83559a700 1 -- 172.21.15.72:0/935919021 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828011830 con 0x7fe83809d6f0 2023-10-03T10:15:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.329+0000 7fe83559a700 1 -- 172.21.15.72:0/935919021 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe828011990 con 0x7fe83809d6f0 2023-10-03T10:15:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.329+0000 7fe83559a700 1 -- 172.21.15.72:0/935919021 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828011d20 con 0x7fe83809d6f0 2023-10-03T10:15:26.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.330+0000 7fe83c8ff700 1 -- 172.21.15.72:0/935919021 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe83809d6f0 msgr2=0x7fe83809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.330+0000 7fe83c8ff700 1 --2- 172.21.15.72:0/935919021 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe83809d6f0 0x7fe83809dac0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe828009870 tx=0x7fe828009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:26.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.330+0000 7fe83c8ff700 1 -- 172.21.15.72:0/935919021 shutdown_connections 2023-10-03T10:15:26.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.330+0000 7fe83c8ff700 1 --2- 172.21.15.72:0/935919021 >> v2:172.21.15.72:3300/0 conn(0x7fe83809e410 0x7fe838130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.330+0000 7fe83c8ff700 1 --2- 172.21.15.72:0/935919021 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe83809d6f0 0x7fe83809dac0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.330+0000 7fe83c8ff700 1 --2- 172.21.15.72:0/935919021 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe83809e000 0x7fe838130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.330+0000 7fe83c8ff700 1 -- 172.21.15.72:0/935919021 >> 172.21.15.72:0/935919021 conn(0x7fe838066f50 msgr2=0x7fe83809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.330+0000 7fe83c8ff700 1 -- 172.21.15.72:0/935919021 shutdown_connections 2023-10-03T10:15:26.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.330+0000 7fe83c8ff700 1 -- 172.21.15.72:0/935919021 wait complete. 2023-10-03T10:15:26.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.331+0000 7fe83c8ff700 1 Processor -- start 2023-10-03T10:15:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.331+0000 7fe83c8ff700 1 -- start start 2023-10-03T10:15:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.331+0000 7fe83c8ff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe83809d6f0 0x7fe83811df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.331+0000 7fe83c8ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe83809e000 0x7fe83811e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.331+0000 7fe83c8ff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe83809e410 0x7fe83811e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.331+0000 7fe83c8ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe838121700 con 0x7fe83809e000 2023-10-03T10:15:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe83c8ff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8380a1660 con 0x7fe83809e410 2023-10-03T10:15:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe83c8ff700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe83809c700 con 0x7fe83809d6f0 2023-10-03T10:15:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe83659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe83809d6f0 0x7fe83811df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe83659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe83809d6f0 0x7fe83811df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42310/0 (socket says 172.21.15.72:42310) 2023-10-03T10:15:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe836d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe83809e410 0x7fe83811e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe83659c700 1 -- 172.21.15.72:0/1788189371 learned_addr learned my addr 172.21.15.72:0/1788189371 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe835d9b700 1 --2- 172.21.15.72:0/1788189371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe83809e000 0x7fe83811e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe83659c700 1 -- 172.21.15.72:0/1788189371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe83809e410 msgr2=0x7fe83811e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe83659c700 1 --2- 172.21.15.72:0/1788189371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe83809e410 0x7fe83811e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe83659c700 1 -- 172.21.15.72:0/1788189371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe83809e000 msgr2=0x7fe83811e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe83659c700 1 --2- 172.21.15.72:0/1788189371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe83809e000 0x7fe83811e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe83659c700 1 -- 172.21.15.72:0/1788189371 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c0094a0 con 0x7fe83809d6f0 2023-10-03T10:15:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe83659c700 1 --2- 172.21.15.72:0/1788189371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe83809d6f0 0x7fe83811df50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe8280090b0 tx=0x7fe828004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe826ffd700 1 -- 172.21.15.72:0/1788189371 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828004450 con 0x7fe83809d6f0 2023-10-03T10:15:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe826ffd700 1 -- 172.21.15.72:0/1788189371 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82801f070 con 0x7fe83809d6f0 2023-10-03T10:15:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe826ffd700 1 -- 172.21.15.72:0/1788189371 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8280038a0 con 0x7fe83809d6f0 2023-10-03T10:15:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe83c8ff700 1 -- 172.21.15.72:0/1788189371 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83000bd40 con 0x7fe83809d6f0 2023-10-03T10:15:26.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.332+0000 7fe83c8ff700 1 -- 172.21.15.72:0/1788189371 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8280094a0 con 0x7fe83809d6f0 2023-10-03T10:15:26.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.333+0000 7fe826ffd700 1 -- 172.21.15.72:0/1788189371 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe828003a00 con 0x7fe83809d6f0 2023-10-03T10:15:26.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.333+0000 7fe826ffd700 1 -- 172.21.15.72:0/1788189371 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe828021070 con 0x7fe83809d6f0 2023-10-03T10:15:26.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.333+0000 7fe83c8ff700 1 -- 172.21.15.72:0/1788189371 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83811ac20 con 0x7fe83809d6f0 2023-10-03T10:15:26.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.338+0000 7fe826ffd700 1 -- 172.21.15.72:0/1788189371 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe82802b080 con 0x7fe83809d6f0 2023-10-03T10:15:26.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.521+0000 7fe83c8ff700 1 -- 172.21.15.72:0/1788189371 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe838074ea0 con 0x7fe83809d6f0 2023-10-03T10:15:26.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.521+0000 7fe826ffd700 1 -- 172.21.15.72:0/1788189371 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe828015020 con 0x7fe83809d6f0 2023-10-03T10:15:26.522 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:26.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.523+0000 7fe83c8ff700 1 -- 172.21.15.72:0/1788189371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe83809d6f0 msgr2=0x7fe83811df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.523+0000 7fe83c8ff700 1 --2- 172.21.15.72:0/1788189371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe83809d6f0 0x7fe83811df50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe8280090b0 tx=0x7fe828004750 comp rx=0 tx=0).stop 2023-10-03T10:15:26.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.523+0000 7fe83c8ff700 1 -- 172.21.15.72:0/1788189371 shutdown_connections 2023-10-03T10:15:26.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.523+0000 7fe83c8ff700 1 --2- 172.21.15.72:0/1788189371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe83809e410 0x7fe83811e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.523+0000 7fe83c8ff700 1 --2- 172.21.15.72:0/1788189371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe83809d6f0 0x7fe83811df50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.523+0000 7fe83c8ff700 1 --2- 172.21.15.72:0/1788189371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe83809e000 0x7fe83811e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.523+0000 7fe83c8ff700 1 -- 172.21.15.72:0/1788189371 >> 172.21.15.72:0/1788189371 conn(0x7fe838066f50 msgr2=0x7fe838130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.523+0000 7fe83c8ff700 1 -- 172.21.15.72:0/1788189371 shutdown_connections 2023-10-03T10:15:26.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.523+0000 7fe83c8ff700 1 -- 172.21.15.72:0/1788189371 wait complete. 2023-10-03T10:15:26.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:26.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:26.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.956+0000 7fbb5e593700 1 Processor -- start 2023-10-03T10:15:26.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb5e593700 1 -- start start 2023-10-03T10:15:26.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb5e593700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb581337f0 0x7fbb58138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb5e593700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb58138dc0 0x7fbb5813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb5e593700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5806b990 con 0x7fbb58133420 2023-10-03T10:15:26.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb5e593700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5809b0e0 con 0x7fbb58138dc0 2023-10-03T10:15:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb5e593700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58133c20 con 0x7fbb581337f0 2023-10-03T10:15:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb5cb30700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb58138dc0 0x7fbb5813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb577fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb581337f0 0x7fbb58138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb5cb30700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb58138dc0 0x7fbb5813b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49554/0 (socket says 172.21.15.72:49554) 2023-10-03T10:15:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb577fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb581337f0 0x7fbb58138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58900/0 (socket says 172.21.15.72:58900) 2023-10-03T10:15:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb5cb30700 1 -- 172.21.15.72:0/2575740444 learned_addr learned my addr 172.21.15.72:0/2575740444 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb5cb30700 1 -- 172.21.15.72:0/2575740444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb581337f0 msgr2=0x7fbb58138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb5cb30700 1 --2- 172.21.15.72:0/2575740444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb581337f0 0x7fbb58138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb5cb30700 1 -- 172.21.15.72:0/2575740444 >> v1:172.21.15.72:6789/0 conn(0x7fbb58133420 legacy=0x7fbb58133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb5cb30700 1 -- 172.21.15.72:0/2575740444 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb580a0590 con 0x7fbb58138dc0 2023-10-03T10:15:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.957+0000 7fbb577fe700 1 --2- 172.21.15.72:0/2575740444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb581337f0 0x7fbb58138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.958+0000 7fbb5cb30700 1 --2- 172.21.15.72:0/2575740444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb58138dc0 0x7fbb5813b1a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009e50 tx=0x7fbb5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3dd7d0c550650cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.958+0000 7fbb56ffd700 1 -- 172.21.15.72:0/2575740444 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5000e070 con 0x7fbb58138dc0 2023-10-03T10:15:26.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.958+0000 7fbb56ffd700 1 -- 172.21.15.72:0/2575740444 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5000b910 con 0x7fbb58138dc0 2023-10-03T10:15:26.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.958+0000 7fbb56ffd700 1 -- 172.21.15.72:0/2575740444 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5000bcc0 con 0x7fbb58138dc0 2023-10-03T10:15:26.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.958+0000 7fbb5e593700 1 -- 172.21.15.72:0/2575740444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb58138dc0 msgr2=0x7fbb5813b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.958+0000 7fbb5e593700 1 --2- 172.21.15.72:0/2575740444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb58138dc0 0x7fbb5813b1a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009e50 tx=0x7fbb5000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:26.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.958+0000 7fbb5e593700 1 -- 172.21.15.72:0/2575740444 shutdown_connections 2023-10-03T10:15:26.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.958+0000 7fbb5e593700 1 --2- 172.21.15.72:0/2575740444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb58138dc0 0x7fbb5813b1a0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.958+0000 7fbb5e593700 1 --2- 172.21.15.72:0/2575740444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb581337f0 0x7fbb58138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.958+0000 7fbb5e593700 1 -- 172.21.15.72:0/2575740444 >> 172.21.15.72:0/2575740444 conn(0x7fbb580a4210 msgr2=0x7fbb580a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.958+0000 7fbb5e593700 1 -- 172.21.15.72:0/2575740444 shutdown_connections 2023-10-03T10:15:26.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.958+0000 7fbb5e593700 1 -- 172.21.15.72:0/2575740444 wait complete. 2023-10-03T10:15:26.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.959+0000 7fbb5e593700 1 Processor -- start 2023-10-03T10:15:26.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.959+0000 7fbb5e593700 1 -- start start 2023-10-03T10:15:26.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb5e593700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb58133420 0x7fbb5812f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb5e593700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb581337f0 0x7fbb5812f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb5e593700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb58138dc0 0x7fbb5812fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb5e593700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb581388a0 con 0x7fbb58133420 2023-10-03T10:15:26.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb5e593700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5809dc90 con 0x7fbb58138dc0 2023-10-03T10:15:26.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb5e593700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5809ca70 con 0x7fbb581337f0 2023-10-03T10:15:26.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb57fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb58133420 0x7fbb5812f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb577fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb581337f0 0x7fbb5812f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb57fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb58133420 0x7fbb5812f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49560/0 (socket says 172.21.15.72:49560) 2023-10-03T10:15:26.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb577fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb581337f0 0x7fbb5812f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42320/0 (socket says 172.21.15.72:42320) 2023-10-03T10:15:26.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb57fff700 1 -- 172.21.15.72:0/4164637425 learned_addr learned my addr 172.21.15.72:0/4164637425 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:26.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb5cb30700 1 --2- 172.21.15.72:0/4164637425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb58138dc0 0x7fbb5812fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb577fe700 1 -- 172.21.15.72:0/4164637425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb58138dc0 msgr2=0x7fbb5812fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb577fe700 1 --2- 172.21.15.72:0/4164637425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb58138dc0 0x7fbb5812fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb577fe700 1 -- 172.21.15.72:0/4164637425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb58133420 msgr2=0x7fbb5812f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb577fe700 1 --2- 172.21.15.72:0/4164637425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb58133420 0x7fbb5812f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb577fe700 1 -- 172.21.15.72:0/4164637425 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c0094a0 con 0x7fbb581337f0 2023-10-03T10:15:26.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb5cb30700 1 --2- 172.21.15.72:0/4164637425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb58138dc0 0x7fbb5812fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb57fff700 1 --2- 172.21.15.72:0/4164637425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb58133420 0x7fbb5812f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb577fe700 1 --2- 172.21.15.72:0/4164637425 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb581337f0 0x7fbb5812f670 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00e9b0 tx=0x7fbb4c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.960+0000 7fbb54ff9700 1 -- 172.21.15.72:0/4164637425 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c00ee50 con 0x7fbb581337f0 2023-10-03T10:15:26.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.961+0000 7fbb54ff9700 1 -- 172.21.15.72:0/4164637425 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c00c850 con 0x7fbb581337f0 2023-10-03T10:15:26.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.961+0000 7fbb5e593700 1 -- 172.21.15.72:0/4164637425 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb50009b30 con 0x7fbb581337f0 2023-10-03T10:15:26.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.961+0000 7fbb54ff9700 1 -- 172.21.15.72:0/4164637425 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c00cc00 con 0x7fbb581337f0 2023-10-03T10:15:26.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.961+0000 7fbb5e593700 1 -- 172.21.15.72:0/4164637425 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5809d510 con 0x7fbb581337f0 2023-10-03T10:15:26.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.961+0000 7fbb54ff9700 1 -- 172.21.15.72:0/4164637425 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb4c013470 con 0x7fbb581337f0 2023-10-03T10:15:26.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.961+0000 7fbb54ff9700 1 -- 172.21.15.72:0/4164637425 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbb4c03fa70 con 0x7fbb581337f0 2023-10-03T10:15:26.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.962+0000 7fbb5e593700 1 -- 172.21.15.72:0/4164637425 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5809f130 con 0x7fbb581337f0 2023-10-03T10:15:26.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:26.966+0000 7fbb54ff9700 1 -- 172.21.15.72:0/4164637425 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb4c013720 con 0x7fbb581337f0 2023-10-03T10:15:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.148+0000 7fbb5e593700 1 -- 172.21.15.72:0/4164637425 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbb58074ea0 con 0x7fbb581337f0 2023-10-03T10:15:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.148+0000 7fbb54ff9700 1 -- 172.21.15.72:0/4164637425 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbb4c021030 con 0x7fbb581337f0 2023-10-03T10:15:27.149 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:27.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:27.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.150+0000 7fbb5e593700 1 -- 172.21.15.72:0/4164637425 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb581337f0 msgr2=0x7fbb5812f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.150+0000 7fbb5e593700 1 --2- 172.21.15.72:0/4164637425 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb581337f0 0x7fbb5812f670 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00e9b0 tx=0x7fbb4c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.150+0000 7fbb5e593700 1 -- 172.21.15.72:0/4164637425 shutdown_connections 2023-10-03T10:15:27.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.150+0000 7fbb5e593700 1 --2- 172.21.15.72:0/4164637425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb58133420 0x7fbb5812f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.150+0000 7fbb5e593700 1 --2- 172.21.15.72:0/4164637425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb58138dc0 0x7fbb5812fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.150+0000 7fbb5e593700 1 --2- 172.21.15.72:0/4164637425 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb581337f0 0x7fbb5812f670 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.150+0000 7fbb5e593700 1 -- 172.21.15.72:0/4164637425 >> 172.21.15.72:0/4164637425 conn(0x7fbb580a4210 msgr2=0x7fbb580a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.150+0000 7fbb5e593700 1 -- 172.21.15.72:0/4164637425 shutdown_connections 2023-10-03T10:15:27.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.150+0000 7fbb5e593700 1 -- 172.21.15.72:0/4164637425 wait complete. 2023-10-03T10:15:27.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:27.214 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:27.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.274+0000 7f7f2dd29700 1 Processor -- start 2023-10-03T10:15:27.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.274+0000 7f7f2dd29700 1 -- start start 2023-10-03T10:15:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f2dd29700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f2809e930 0x7f7f2809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f2dd29700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f2809f240 0x7f7f281317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f2dd29700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f2809f650 0x7f7f28131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f2dd29700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f28070940 con 0x7f7f2809f650 2023-10-03T10:15:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f2dd29700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2806fd60 con 0x7f7f2809e930 2023-10-03T10:15:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f2dd29700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2806fa80 con 0x7f7f2809f240 2023-10-03T10:15:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f26ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f2809f240 0x7f7f281317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f27fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f2809f650 0x7f7f28131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f277fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f2809e930 0x7f7f2809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f26ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f2809f240 0x7f7f281317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42336/0 (socket says 172.21.15.72:42336) 2023-10-03T10:15:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f277fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f2809e930 0x7f7f2809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58908/0 (socket says 172.21.15.72:58908) 2023-10-03T10:15:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f26ffd700 1 -- 172.21.15.72:0/2330485896 learned_addr learned my addr 172.21.15.72:0/2330485896 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f26ffd700 1 -- 172.21.15.72:0/2330485896 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f2809e930 msgr2=0x7f7f2809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f26ffd700 1 --2- 172.21.15.72:0/2330485896 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f2809e930 0x7f7f2809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f26ffd700 1 -- 172.21.15.72:0/2330485896 >> v2:172.21.15.72:3300/0 conn(0x7f7f2809f650 msgr2=0x7f7f28131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f26ffd700 1 --2- 172.21.15.72:0/2330485896 >> v2:172.21.15.72:3300/0 conn(0x7f7f2809f650 0x7f7f28131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f26ffd700 1 -- 172.21.15.72:0/2330485896 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2809fb60 con 0x7f7f2809f240 2023-10-03T10:15:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f27fff700 1 --2- 172.21.15.72:0/2330485896 >> v2:172.21.15.72:3300/0 conn(0x7f7f2809f650 0x7f7f28131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f277fe700 1 --2- 172.21.15.72:0/2330485896 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f2809e930 0x7f7f2809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f26ffd700 1 --2- 172.21.15.72:0/2330485896 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f2809f240 0x7f7f281317f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7f100098f0 tx=0x7f7f10009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a14cef07fe90e2f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.275+0000 7f7f267fc700 1 -- 172.21.15.72:0/2330485896 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10011830 con 0x7f7f2809f240 2023-10-03T10:15:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.276+0000 7f7f267fc700 1 -- 172.21.15.72:0/2330485896 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f10011990 con 0x7f7f2809f240 2023-10-03T10:15:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.276+0000 7f7f267fc700 1 -- 172.21.15.72:0/2330485896 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10011d20 con 0x7f7f2809f240 2023-10-03T10:15:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.276+0000 7f7f2dd29700 1 -- 172.21.15.72:0/2330485896 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f2809f240 msgr2=0x7f7f281317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.276+0000 7f7f2dd29700 1 --2- 172.21.15.72:0/2330485896 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f2809f240 0x7f7f281317f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7f100098f0 tx=0x7f7f10009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.276+0000 7f7f2dd29700 1 -- 172.21.15.72:0/2330485896 shutdown_connections 2023-10-03T10:15:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.276+0000 7f7f2dd29700 1 --2- 172.21.15.72:0/2330485896 >> v2:172.21.15.72:3300/0 conn(0x7f7f2809f650 0x7f7f28131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.276+0000 7f7f2dd29700 1 --2- 172.21.15.72:0/2330485896 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f2809e930 0x7f7f2809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.276+0000 7f7f2dd29700 1 --2- 172.21.15.72:0/2330485896 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f2809f240 0x7f7f281317f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.276+0000 7f7f2dd29700 1 -- 172.21.15.72:0/2330485896 >> 172.21.15.72:0/2330485896 conn(0x7f7f280a4210 msgr2=0x7f7f280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.276+0000 7f7f2dd29700 1 -- 172.21.15.72:0/2330485896 shutdown_connections 2023-10-03T10:15:27.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.276+0000 7f7f2dd29700 1 -- 172.21.15.72:0/2330485896 wait complete. 2023-10-03T10:15:27.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.277+0000 7f7f2dd29700 1 Processor -- start 2023-10-03T10:15:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.277+0000 7f7f2dd29700 1 -- start start 2023-10-03T10:15:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f2dd29700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f2809e930 0x7f7f2806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f2dd29700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f2809f240 0x7f7f2806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f2dd29700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f2809f650 0x7f7f2806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f2dd29700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f281b7240 con 0x7f7f2809f240 2023-10-03T10:15:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f2dd29700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f281a93f0 con 0x7f7f2809f650 2023-10-03T10:15:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f2dd29700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f281a8910 con 0x7f7f2809e930 2023-10-03T10:15:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f277fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f2809e930 0x7f7f2806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f26ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f2809f240 0x7f7f2806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f277fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f2809e930 0x7f7f2806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42346/0 (socket says 172.21.15.72:42346) 2023-10-03T10:15:27.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f277fe700 1 -- 172.21.15.72:0/3880180953 learned_addr learned my addr 172.21.15.72:0/3880180953 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:27.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f27fff700 1 --2- 172.21.15.72:0/3880180953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f2809f650 0x7f7f2806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f26ffd700 1 -- 172.21.15.72:0/3880180953 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f2809e930 msgr2=0x7f7f2806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f26ffd700 1 --2- 172.21.15.72:0/3880180953 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f2809e930 0x7f7f2806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f26ffd700 1 -- 172.21.15.72:0/3880180953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f2809f650 msgr2=0x7f7f2806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f26ffd700 1 --2- 172.21.15.72:0/3880180953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f2809f650 0x7f7f2806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f26ffd700 1 -- 172.21.15.72:0/3880180953 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f20009a70 con 0x7f7f2809f240 2023-10-03T10:15:27.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f27fff700 1 --2- 172.21.15.72:0/3880180953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f2809f650 0x7f7f2806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f277fe700 1 --2- 172.21.15.72:0/3880180953 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f2809e930 0x7f7f2806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f26ffd700 1 --2- 172.21.15.72:0/3880180953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f2809f240 0x7f7f2806bdf0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f7f10016000 tx=0x7f7f10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.278+0000 7f7f1ffff700 1 -- 172.21.15.72:0/3880180953 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10004240 con 0x7f7f2809f240 2023-10-03T10:15:27.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.279+0000 7f7f1ffff700 1 -- 172.21.15.72:0/3880180953 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1001f070 con 0x7f7f2809f240 2023-10-03T10:15:27.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.279+0000 7f7f2dd29700 1 -- 172.21.15.72:0/3880180953 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f180094a0 con 0x7f7f2809f240 2023-10-03T10:15:27.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.279+0000 7f7f1ffff700 1 -- 172.21.15.72:0/3880180953 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100036a0 con 0x7f7f2809f240 2023-10-03T10:15:27.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.279+0000 7f7f2dd29700 1 -- 172.21.15.72:0/3880180953 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f10009550 con 0x7f7f2809f240 2023-10-03T10:15:27.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.279+0000 7f7f1ffff700 1 -- 172.21.15.72:0/3880180953 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f10021030 con 0x7f7f2809f240 2023-10-03T10:15:27.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.279+0000 7f7f1ffff700 1 -- 172.21.15.72:0/3880180953 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7f100408e0 con 0x7f7f2809f240 2023-10-03T10:15:27.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.280+0000 7f7f2dd29700 1 -- 172.21.15.72:0/3880180953 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f281a9180 con 0x7f7f2809f240 2023-10-03T10:15:27.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.284+0000 7f7f1ffff700 1 -- 172.21.15.72:0/3880180953 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f281a9180 con 0x7f7f2809f240 2023-10-03T10:15:27.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.346+0000 7f0fac108700 1 Processor -- start 2023-10-03T10:15:27.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.346+0000 7f0fac108700 1 -- start start 2023-10-03T10:15:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.346+0000 7f0fac108700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa40a0a30 0x7f0fa40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.346+0000 7f0fac108700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa4138d80 0x7f0fa413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.346+0000 7f0fac108700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa40a2a70 con 0x7f0fa409d630 2023-10-03T10:15:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.346+0000 7f0fac108700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40a01d0 con 0x7f0fa40a0a30 2023-10-03T10:15:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.346+0000 7f0fac108700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa409e2b0 con 0x7f0fa4138d80 2023-10-03T10:15:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.346+0000 7f0fa9ea4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa40a0a30 0x7f0fa40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.346+0000 7f0fa96a3700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0fa409d630 0x7f0fa40a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55004/0 (socket says 172.21.15.72:55004) 2023-10-03T10:15:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.346+0000 7f0fa96a3700 1 -- 172.21.15.72:0/2011850162 learned_addr learned my addr 172.21.15.72:0/2011850162 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.346+0000 7f0faa6a5700 1 --2- 172.21.15.72:0/2011850162 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa4138d80 0x7f0fa413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.347+0000 7f0fa8ea2700 1 -- 172.21.15.72:0/2011850162 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656431681 0 0) 0x7f0fa40a2a70 con 0x7f0fa409d630 2023-10-03T10:15:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.347+0000 7f0faa6a5700 1 -- 172.21.15.72:0/2011850162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa40a0a30 msgr2=0x7f0fa40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.347+0000 7f0faa6a5700 1 --2- 172.21.15.72:0/2011850162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa40a0a30 0x7f0fa40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.347+0000 7f0faa6a5700 1 -- 172.21.15.72:0/2011850162 >> v1:172.21.15.72:6789/0 conn(0x7f0fa409d630 legacy=0x7f0fa40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.347+0000 7f0faa6a5700 1 -- 172.21.15.72:0/2011850162 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa409dc50 con 0x7f0fa4138d80 2023-10-03T10:15:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.347+0000 7f0fa9ea4700 1 --2- 172.21.15.72:0/2011850162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa40a0a30 0x7f0fa40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.347+0000 7f0faa6a5700 1 --2- 172.21.15.72:0/2011850162 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa4138d80 0x7f0fa413b160 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009dc0 tx=0x7f0f9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bd2272534c8f689 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.347+0000 7f0fa8ea2700 1 -- 172.21.15.72:0/2011850162 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c00e070 con 0x7f0fa4138d80 2023-10-03T10:15:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.347+0000 7f0fa8ea2700 1 -- 172.21.15.72:0/2011850162 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c00bb20 con 0x7f0fa4138d80 2023-10-03T10:15:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.347+0000 7f0fa8ea2700 1 -- 172.21.15.72:0/2011850162 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c012430 con 0x7f0fa4138d80 2023-10-03T10:15:27.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.348+0000 7f0fac108700 1 -- 172.21.15.72:0/2011850162 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa4138d80 msgr2=0x7f0fa413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.348+0000 7f0fac108700 1 --2- 172.21.15.72:0/2011850162 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa4138d80 0x7f0fa413b160 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009dc0 tx=0x7f0f9c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.348+0000 7f0fac108700 1 -- 172.21.15.72:0/2011850162 shutdown_connections 2023-10-03T10:15:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.348+0000 7f0fac108700 1 --2- 172.21.15.72:0/2011850162 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa4138d80 0x7f0fa413b160 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.348+0000 7f0fac108700 1 --2- 172.21.15.72:0/2011850162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa40a0a30 0x7f0fa40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.348+0000 7f0fac108700 1 -- 172.21.15.72:0/2011850162 >> 172.21.15.72:0/2011850162 conn(0x7f0fa40a3050 msgr2=0x7f0fa40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.348+0000 7f0fac108700 1 -- 172.21.15.72:0/2011850162 shutdown_connections 2023-10-03T10:15:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.348+0000 7f0fac108700 1 -- 172.21.15.72:0/2011850162 wait complete. 2023-10-03T10:15:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.349+0000 7f0fac108700 1 Processor -- start 2023-10-03T10:15:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.349+0000 7f0fac108700 1 -- start start 2023-10-03T10:15:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.349+0000 7f0fac108700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa409d630 0x7f0fa412c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.349+0000 7f0fac108700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa40a0a30 0x7f0fa412ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.349+0000 7f0fac108700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa4138d80 0x7f0fa412cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.349+0000 7f0fac108700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40a49e0 con 0x7f0fa4138d80 2023-10-03T10:15:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.349+0000 7f0fac108700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa412fb00 con 0x7f0fa409d630 2023-10-03T10:15:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.349+0000 7f0fac108700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa412e090 con 0x7f0fa40a0a30 2023-10-03T10:15:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.349+0000 7f0fa96a3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa40a0a30 0x7f0fa412ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.349+0000 7f0faa6a5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa4138d80 0x7f0fa412cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.349+0000 7f0fa96a3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa40a0a30 0x7f0fa412ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42362/0 (socket says 172.21.15.72:42362) 2023-10-03T10:15:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.349+0000 7f0fa96a3700 1 -- 172.21.15.72:0/3386372418 learned_addr learned my addr 172.21.15.72:0/3386372418 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.349+0000 7f0fa9ea4700 1 --2- 172.21.15.72:0/3386372418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa409d630 0x7f0fa412c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.350+0000 7f0fa96a3700 1 -- 172.21.15.72:0/3386372418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa409d630 msgr2=0x7f0fa412c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.350+0000 7f0fa96a3700 1 --2- 172.21.15.72:0/3386372418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa409d630 0x7f0fa412c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.350+0000 7f0fa96a3700 1 -- 172.21.15.72:0/3386372418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa4138d80 msgr2=0x7f0fa412cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.350+0000 7f0fa96a3700 1 --2- 172.21.15.72:0/3386372418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa4138d80 0x7f0fa412cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.350+0000 7f0fa96a3700 1 -- 172.21.15.72:0/3386372418 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa00094a0 con 0x7f0fa40a0a30 2023-10-03T10:15:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.350+0000 7f0faa6a5700 1 --2- 172.21.15.72:0/3386372418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa4138d80 0x7f0fa412cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.350+0000 7f0fa96a3700 1 --2- 172.21.15.72:0/3386372418 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa40a0a30 0x7f0fa412ca00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400c520 tx=0x7f0f9400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.350+0000 7f0f9a7fc700 1 -- 172.21.15.72:0/3386372418 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94004c80 con 0x7f0fa40a0a30 2023-10-03T10:15:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.350+0000 7f0f9a7fc700 1 -- 172.21.15.72:0/3386372418 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f94004de0 con 0x7f0fa40a0a30 2023-10-03T10:15:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.350+0000 7f0f9a7fc700 1 -- 172.21.15.72:0/3386372418 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94007310 con 0x7f0fa40a0a30 2023-10-03T10:15:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.350+0000 7f0fac108700 1 -- 172.21.15.72:0/3386372418 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9c009a70 con 0x7f0fa40a0a30 2023-10-03T10:15:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.350+0000 7f0fac108700 1 -- 172.21.15.72:0/3386372418 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa412ed80 con 0x7f0fa40a0a30 2023-10-03T10:15:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.351+0000 7f0f9a7fc700 1 -- 172.21.15.72:0/3386372418 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f94007470 con 0x7f0fa40a0a30 2023-10-03T10:15:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.351+0000 7f0f9a7fc700 1 -- 172.21.15.72:0/3386372418 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0f9403f250 con 0x7f0fa40a0a30 2023-10-03T10:15:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.351+0000 7f0fac108700 1 -- 172.21.15.72:0/3386372418 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa40747f0 con 0x7f0fa40a0a30 2023-10-03T10:15:27.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.360+0000 7f0f9a7fc700 1 -- 172.21.15.72:0/3386372418 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f940123b0 con 0x7f0fa40a0a30 2023-10-03T10:15:27.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.489+0000 7f7f2dd29700 1 -- 172.21.15.72:0/3880180953 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7f281a9180 con 0x7f7f2809f240 2023-10-03T10:15:27.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.490+0000 7f7f1ffff700 1 -- 172.21.15.72:0/3880180953 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f281a9180 con 0x7f7f2809f240 2023-10-03T10:15:27.490 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:27.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.492+0000 7f7f2dd29700 1 -- 172.21.15.72:0/3880180953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f2809f240 msgr2=0x7f7f2806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.492+0000 7f7f2dd29700 1 --2- 172.21.15.72:0/3880180953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f2809f240 0x7f7f2806bdf0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f7f10016000 tx=0x7f7f10004750 comp rx=0 tx=0).stop 2023-10-03T10:15:27.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.492+0000 7f7f2dd29700 1 -- 172.21.15.72:0/3880180953 shutdown_connections 2023-10-03T10:15:27.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.492+0000 7f7f2dd29700 1 --2- 172.21.15.72:0/3880180953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f2809f650 0x7f7f2806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.492+0000 7f7f2dd29700 1 --2- 172.21.15.72:0/3880180953 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f2809e930 0x7f7f2806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.492+0000 7f7f2dd29700 1 --2- 172.21.15.72:0/3880180953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f2809f240 0x7f7f2806bdf0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.492+0000 7f7f2dd29700 1 -- 172.21.15.72:0/3880180953 >> 172.21.15.72:0/3880180953 conn(0x7f7f280a4210 msgr2=0x7f7f281b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.492+0000 7f7f2dd29700 1 -- 172.21.15.72:0/3880180953 shutdown_connections 2023-10-03T10:15:27.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.492+0000 7f7f2dd29700 1 -- 172.21.15.72:0/3880180953 wait complete. 2023-10-03T10:15:27.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:27.536 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:27.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.555+0000 7f0fac108700 1 -- 172.21.15.72:0/3386372418 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0fa412fd20 con 0x7f0fa40a0a30 2023-10-03T10:15:27.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.555+0000 7f0f9a7fc700 1 -- 172.21.15.72:0/3386372418 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0f94011360 con 0x7f0fa40a0a30 2023-10-03T10:15:27.556 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:27.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.558+0000 7f0fac108700 1 -- 172.21.15.72:0/3386372418 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa40a0a30 msgr2=0x7f0fa412ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.558+0000 7f0fac108700 1 --2- 172.21.15.72:0/3386372418 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa40a0a30 0x7f0fa412ca00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400c520 tx=0x7f0f9400c830 comp rx=0 tx=0).stop 2023-10-03T10:15:27.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.558+0000 7f0fac108700 1 -- 172.21.15.72:0/3386372418 shutdown_connections 2023-10-03T10:15:27.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.558+0000 7f0fac108700 1 --2- 172.21.15.72:0/3386372418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa4138d80 0x7f0fa412cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.558+0000 7f0fac108700 1 --2- 172.21.15.72:0/3386372418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa409d630 0x7f0fa412c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.558+0000 7f0fac108700 1 --2- 172.21.15.72:0/3386372418 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa40a0a30 0x7f0fa412ca00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.558+0000 7f0fac108700 1 -- 172.21.15.72:0/3386372418 >> 172.21.15.72:0/3386372418 conn(0x7f0fa40a3050 msgr2=0x7f0fa409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.558+0000 7f0fac108700 1 -- 172.21.15.72:0/3386372418 shutdown_connections 2023-10-03T10:15:27.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.558+0000 7f0fac108700 1 -- 172.21.15.72:0/3386372418 wait complete. 2023-10-03T10:15:27.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:27.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.659+0000 7fb43a3b6700 1 Processor -- start 2023-10-03T10:15:27.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.659+0000 7fb43a3b6700 1 -- start start 2023-10-03T10:15:27.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.659+0000 7fb43a3b6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb43409d6f0 0x7fb43409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.659+0000 7fb43a3b6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb43409e000 0x7fb4341339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.659+0000 7fb43a3b6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb43409e410 0x7fb434133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.659+0000 7fb43a3b6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43406b460 con 0x7fb43409d6f0 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.659+0000 7fb43a3b6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43409b120 con 0x7fb43409e410 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.659+0000 7fb43a3b6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb43409a7e0 con 0x7fb43409e000 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.659+0000 7fb4337fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb43409e000 0x7fb4341339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.659+0000 7fb438953700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb43409e410 0x7fb434133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.660+0000 7fb433fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb43409d6f0 0x7fb43409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.660+0000 7fb4337fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb43409e000 0x7fb4341339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42364/0 (socket says 172.21.15.72:42364) 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.660+0000 7fb438953700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb43409e410 0x7fb434133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58936/0 (socket says 172.21.15.72:58936) 2023-10-03T10:15:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.660+0000 7fb4337fe700 1 -- 172.21.15.72:0/992964938 learned_addr learned my addr 172.21.15.72:0/992964938 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.660+0000 7fb438953700 1 -- 172.21.15.72:0/992964938 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb43409e000 msgr2=0x7fb4341339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.660+0000 7fb438953700 1 --2- 172.21.15.72:0/992964938 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb43409e000 0x7fb4341339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.660+0000 7fb438953700 1 -- 172.21.15.72:0/992964938 >> v2:172.21.15.72:3300/0 conn(0x7fb43409d6f0 msgr2=0x7fb43409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.660+0000 7fb438953700 1 --2- 172.21.15.72:0/992964938 >> v2:172.21.15.72:3300/0 conn(0x7fb43409d6f0 0x7fb43409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.660+0000 7fb438953700 1 -- 172.21.15.72:0/992964938 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43409a500 con 0x7fb43409e410 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.660+0000 7fb433fff700 1 --2- 172.21.15.72:0/992964938 >> v2:172.21.15.72:3300/0 conn(0x7fb43409d6f0 0x7fb43409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.660+0000 7fb438953700 1 --2- 172.21.15.72:0/992964938 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb43409e410 0x7fb434133f30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb42c009dc0 tx=0x7fb42c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d99c79bff98be134 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.660+0000 7fb432ffd700 1 -- 172.21.15.72:0/992964938 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00e070 con 0x7fb43409e410 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.660+0000 7fb432ffd700 1 -- 172.21.15.72:0/992964938 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c00bae0 con 0x7fb43409e410 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.660+0000 7fb432ffd700 1 -- 172.21.15.72:0/992964938 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00be90 con 0x7fb43409e410 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.661+0000 7fb43a3b6700 1 -- 172.21.15.72:0/992964938 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb43409e410 msgr2=0x7fb434133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.661+0000 7fb43a3b6700 1 --2- 172.21.15.72:0/992964938 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb43409e410 0x7fb434133f30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb42c009dc0 tx=0x7fb42c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:27.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.661+0000 7fb43a3b6700 1 -- 172.21.15.72:0/992964938 shutdown_connections 2023-10-03T10:15:27.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.661+0000 7fb43a3b6700 1 --2- 172.21.15.72:0/992964938 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb43409e410 0x7fb434133f30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.661+0000 7fb43a3b6700 1 --2- 172.21.15.72:0/992964938 >> v2:172.21.15.72:3300/0 conn(0x7fb43409d6f0 0x7fb43409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.661+0000 7fb43a3b6700 1 --2- 172.21.15.72:0/992964938 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb43409e000 0x7fb4341339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.661+0000 7fb43a3b6700 1 -- 172.21.15.72:0/992964938 >> 172.21.15.72:0/992964938 conn(0x7fb434066f50 msgr2=0x7fb43409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.661+0000 7fb43a3b6700 1 -- 172.21.15.72:0/992964938 shutdown_connections 2023-10-03T10:15:27.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.661+0000 7fb43a3b6700 1 -- 172.21.15.72:0/992964938 wait complete. 2023-10-03T10:15:27.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.662+0000 7fb43a3b6700 1 Processor -- start 2023-10-03T10:15:27.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.662+0000 7fb43a3b6700 1 -- start start 2023-10-03T10:15:27.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb43a3b6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb43409d6f0 0x7fb4341c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb43a3b6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb43409e000 0x7fb4341c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb43a3b6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb43409e410 0x7fb4341c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb43a3b6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4341a8a00 con 0x7fb43409e000 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb43a3b6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4341a85d0 con 0x7fb43409d6f0 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb43a3b6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4341a91f0 con 0x7fb43409e410 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb433fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb43409d6f0 0x7fb4341c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb4337fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb43409e000 0x7fb4341c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb433fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb43409d6f0 0x7fb4341c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:58940/0 (socket says 172.21.15.72:58940) 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb433fff700 1 -- 172.21.15.72:0/2373856976 learned_addr learned my addr 172.21.15.72:0/2373856976 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb438953700 1 --2- 172.21.15.72:0/2373856976 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb43409e410 0x7fb4341c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb4337fe700 1 -- 172.21.15.72:0/2373856976 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb43409e410 msgr2=0x7fb4341c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb4337fe700 1 --2- 172.21.15.72:0/2373856976 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb43409e410 0x7fb4341c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb4337fe700 1 -- 172.21.15.72:0/2373856976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb43409d6f0 msgr2=0x7fb4341c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb4337fe700 1 --2- 172.21.15.72:0/2373856976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb43409d6f0 0x7fb4341c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb4337fe700 1 -- 172.21.15.72:0/2373856976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4280094a0 con 0x7fb43409e000 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb433fff700 1 --2- 172.21.15.72:0/2373856976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb43409d6f0 0x7fb4341c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb4337fe700 1 --2- 172.21.15.72:0/2373856976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb43409e000 0x7fb4341c8a30 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb42400e8e0 tx=0x7fb42400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb430ff9700 1 -- 172.21.15.72:0/2373856976 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424013680 con 0x7fb43409e000 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb430ff9700 1 -- 172.21.15.72:0/2373856976 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4240137e0 con 0x7fb43409e000 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb43a3b6700 1 -- 172.21.15.72:0/2373856976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42c009a70 con 0x7fb43409e000 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.663+0000 7fb430ff9700 1 -- 172.21.15.72:0/2373856976 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424013b70 con 0x7fb43409e000 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.664+0000 7fb43a3b6700 1 -- 172.21.15.72:0/2373856976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4341a7880 con 0x7fb43409e000 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.664+0000 7fb430ff9700 1 -- 172.21.15.72:0/2373856976 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb424013cd0 con 0x7fb43409e000 2023-10-03T10:15:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.664+0000 7fb43a3b6700 1 -- 172.21.15.72:0/2373856976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb434074ea0 con 0x7fb43409e000 2023-10-03T10:15:27.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.664+0000 7fb430ff9700 1 -- 172.21.15.72:0/2373856976 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb42403f590 con 0x7fb43409e000 2023-10-03T10:15:27.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.669+0000 7fb430ff9700 1 -- 172.21.15.72:0/2373856976 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb424017020 con 0x7fb43409e000 2023-10-03T10:15:27.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.852+0000 7fb43a3b6700 1 -- 172.21.15.72:0/2373856976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb43406c360 con 0x7fb43409e000 2023-10-03T10:15:27.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.853+0000 7fb430ff9700 1 -- 172.21.15.72:0/2373856976 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb42401bc30 con 0x7fb43409e000 2023-10-03T10:15:27.853 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:27.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.855+0000 7fb43a3b6700 1 -- 172.21.15.72:0/2373856976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb43409e000 msgr2=0x7fb4341c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.855+0000 7fb43a3b6700 1 --2- 172.21.15.72:0/2373856976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb43409e000 0x7fb4341c8a30 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb42400e8e0 tx=0x7fb42400ebf0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.855+0000 7fb43a3b6700 1 -- 172.21.15.72:0/2373856976 shutdown_connections 2023-10-03T10:15:27.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.855+0000 7fb43a3b6700 1 --2- 172.21.15.72:0/2373856976 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb43409e410 0x7fb4341c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.855+0000 7fb43a3b6700 1 --2- 172.21.15.72:0/2373856976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb43409d6f0 0x7fb4341c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.855+0000 7fb43a3b6700 1 --2- 172.21.15.72:0/2373856976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb43409e000 0x7fb4341c8a30 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.855+0000 7fb43a3b6700 1 -- 172.21.15.72:0/2373856976 >> 172.21.15.72:0/2373856976 conn(0x7fb434066f50 msgr2=0x7fb4341bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.855+0000 7fb43a3b6700 1 -- 172.21.15.72:0/2373856976 shutdown_connections 2023-10-03T10:15:27.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:27.855+0000 7fb43a3b6700 1 -- 172.21.15.72:0/2373856976 wait complete. 2023-10-03T10:15:27.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:28.167 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:28.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.290+0000 7f7ba7f30700 1 Processor -- start 2023-10-03T10:15:28.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.290+0000 7f7ba7f30700 1 -- start start 2023-10-03T10:15:28.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.290+0000 7f7ba7f30700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ba009d6f0 0x7f7ba009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.290+0000 7f7ba7f30700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ba009e410 0x7f7ba0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.290+0000 7f7ba7f30700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba009f130 con 0x7f7ba009e000 2023-10-03T10:15:28.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.290+0000 7f7ba7f30700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba009f520 con 0x7f7ba009e410 2023-10-03T10:15:28.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.290+0000 7f7ba7f30700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba009e930 con 0x7f7ba009d6f0 2023-10-03T10:15:28.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.290+0000 7f7ba5ccc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ba009d6f0 0x7f7ba009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.291+0000 7f7ba64cd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ba009e410 0x7f7ba0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.291+0000 7f7ba54cb700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7ba009e000 0x7f7ba0130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54196/0 (socket says 172.21.15.72:54196) 2023-10-03T10:15:28.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.291+0000 7f7ba54cb700 1 -- 172.21.15.72:0/1733429297 learned_addr learned my addr 172.21.15.72:0/1733429297 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:28.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.291+0000 7f7ba5ccc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ba009d6f0 0x7f7ba009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:54960/0 (socket says 172.21.15.72:54960) 2023-10-03T10:15:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.291+0000 7f7ba4cca700 1 -- 172.21.15.72:0/1733429297 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092193689 0 0) 0x7f7ba009f130 con 0x7f7ba009e000 2023-10-03T10:15:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.291+0000 7f7ba5ccc700 1 -- 172.21.15.72:0/1733429297 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ba009e410 msgr2=0x7f7ba0130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.291+0000 7f7ba5ccc700 1 --2- 172.21.15.72:0/1733429297 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ba009e410 0x7f7ba0130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.291+0000 7f7ba5ccc700 1 -- 172.21.15.72:0/1733429297 >> v1:172.21.15.72:6789/0 conn(0x7f7ba009e000 legacy=0x7f7ba0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.291+0000 7f7ba5ccc700 1 -- 172.21.15.72:0/1733429297 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba009b2d0 con 0x7f7ba009d6f0 2023-10-03T10:15:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.291+0000 7f7ba64cd700 1 --2- 172.21.15.72:0/1733429297 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ba009e410 0x7f7ba0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.291+0000 7f7ba5ccc700 1 --2- 172.21.15.72:0/1733429297 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ba009d6f0 0x7f7ba009dac0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009870 tx=0x7f7b9c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63912e6512b6c692 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.291+0000 7f7ba4cca700 1 -- 172.21.15.72:0/1733429297 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c011830 con 0x7f7ba009d6f0 2023-10-03T10:15:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.291+0000 7f7ba4cca700 1 -- 172.21.15.72:0/1733429297 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c011990 con 0x7f7ba009d6f0 2023-10-03T10:15:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.291+0000 7f7ba4cca700 1 -- 172.21.15.72:0/1733429297 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c011d20 con 0x7f7ba009d6f0 2023-10-03T10:15:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.292+0000 7f7ba7f30700 1 -- 172.21.15.72:0/1733429297 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ba009d6f0 msgr2=0x7f7ba009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.292+0000 7f7ba7f30700 1 --2- 172.21.15.72:0/1733429297 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ba009d6f0 0x7f7ba009dac0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009870 tx=0x7f7b9c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:28.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.292+0000 7f7ba7f30700 1 -- 172.21.15.72:0/1733429297 shutdown_connections 2023-10-03T10:15:28.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.292+0000 7f7ba7f30700 1 --2- 172.21.15.72:0/1733429297 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ba009e410 0x7f7ba0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.292+0000 7f7ba7f30700 1 --2- 172.21.15.72:0/1733429297 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ba009d6f0 0x7f7ba009dac0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.292+0000 7f7ba7f30700 1 -- 172.21.15.72:0/1733429297 >> 172.21.15.72:0/1733429297 conn(0x7f7ba0066f50 msgr2=0x7f7ba009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.292+0000 7f7ba7f30700 1 -- 172.21.15.72:0/1733429297 shutdown_connections 2023-10-03T10:15:28.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.292+0000 7f7ba7f30700 1 -- 172.21.15.72:0/1733429297 wait complete. 2023-10-03T10:15:28.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba7f30700 1 Processor -- start 2023-10-03T10:15:28.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba7f30700 1 -- start start 2023-10-03T10:15:28.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba7f30700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ba009d6f0 0x7f7ba006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba7f30700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ba009e000 0x7f7ba006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba7f30700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ba009e410 0x7f7ba006f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba7f30700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba009c700 con 0x7f7ba009e000 2023-10-03T10:15:28.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba7f30700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba0070590 con 0x7f7ba009d6f0 2023-10-03T10:15:28.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba7f30700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba0125a50 con 0x7f7ba009e410 2023-10-03T10:15:28.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba5ccc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ba009d6f0 0x7f7ba006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba5ccc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ba009d6f0 0x7f7ba006e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43292/0 (socket says 172.21.15.72:43292) 2023-10-03T10:15:28.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba54cb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ba009e000 0x7f7ba006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba5ccc700 1 -- 172.21.15.72:0/2470328622 learned_addr learned my addr 172.21.15.72:0/2470328622 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:28.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba64cd700 1 --2- 172.21.15.72:0/2470328622 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ba009e410 0x7f7ba006f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba5ccc700 1 -- 172.21.15.72:0/2470328622 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ba009e410 msgr2=0x7f7ba006f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba5ccc700 1 --2- 172.21.15.72:0/2470328622 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ba009e410 0x7f7ba006f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba5ccc700 1 -- 172.21.15.72:0/2470328622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ba009e000 msgr2=0x7f7ba006edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba5ccc700 1 --2- 172.21.15.72:0/2470328622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ba009e000 0x7f7ba006edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba5ccc700 1 -- 172.21.15.72:0/2470328622 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b98009a70 con 0x7f7ba009d6f0 2023-10-03T10:15:28.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.293+0000 7f7ba54cb700 1 --2- 172.21.15.72:0/2470328622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ba009e000 0x7f7ba006edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.294+0000 7f7ba5ccc700 1 --2- 172.21.15.72:0/2470328622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ba009d6f0 0x7f7ba006e870 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009840 tx=0x7f7b9c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.294+0000 7f7b967fc700 1 -- 172.21.15.72:0/2470328622 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c0044d0 con 0x7f7ba009d6f0 2023-10-03T10:15:28.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.294+0000 7f7b967fc700 1 -- 172.21.15.72:0/2470328622 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c01f070 con 0x7f7ba009d6f0 2023-10-03T10:15:28.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.294+0000 7f7ba7f30700 1 -- 172.21.15.72:0/2470328622 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c0094a0 con 0x7f7ba009d6f0 2023-10-03T10:15:28.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.294+0000 7f7b967fc700 1 -- 172.21.15.72:0/2470328622 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c0038e0 con 0x7f7ba009d6f0 2023-10-03T10:15:28.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.294+0000 7f7ba7f30700 1 -- 172.21.15.72:0/2470328622 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba0124610 con 0x7f7ba009d6f0 2023-10-03T10:15:28.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.294+0000 7f7b967fc700 1 -- 172.21.15.72:0/2470328622 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b9c003a40 con 0x7f7ba009d6f0 2023-10-03T10:15:28.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.295+0000 7f7b967fc700 1 -- 172.21.15.72:0/2470328622 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7b9c021070 con 0x7f7ba009d6f0 2023-10-03T10:15:28.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.295+0000 7f7ba7f30700 1 -- 172.21.15.72:0/2470328622 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba0074ea0 con 0x7f7ba009d6f0 2023-10-03T10:15:28.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.299+0000 7f7b967fc700 1 -- 172.21.15.72:0/2470328622 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b9c015070 con 0x7f7ba009d6f0 2023-10-03T10:15:28.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.484+0000 7f7ba7f30700 1 -- 172.21.15.72:0/2470328622 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7ba0125df0 con 0x7f7ba009d6f0 2023-10-03T10:15:28.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.484+0000 7f7b967fc700 1 -- 172.21.15.72:0/2470328622 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7b9c003cf0 con 0x7f7ba009d6f0 2023-10-03T10:15:28.485 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:28.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.486+0000 7f7ba7f30700 1 -- 172.21.15.72:0/2470328622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ba009d6f0 msgr2=0x7f7ba006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.486+0000 7f7ba7f30700 1 --2- 172.21.15.72:0/2470328622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ba009d6f0 0x7f7ba006e870 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009840 tx=0x7f7b9c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:28.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.487+0000 7f7ba7f30700 1 -- 172.21.15.72:0/2470328622 shutdown_connections 2023-10-03T10:15:28.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.487+0000 7f7ba7f30700 1 --2- 172.21.15.72:0/2470328622 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ba009e410 0x7f7ba006f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.487+0000 7f7ba7f30700 1 --2- 172.21.15.72:0/2470328622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ba009d6f0 0x7f7ba006e870 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.487+0000 7f7ba7f30700 1 --2- 172.21.15.72:0/2470328622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ba009e000 0x7f7ba006edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.487+0000 7f7ba7f30700 1 -- 172.21.15.72:0/2470328622 >> 172.21.15.72:0/2470328622 conn(0x7f7ba0066f50 msgr2=0x7f7ba0071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.487+0000 7f7ba7f30700 1 -- 172.21.15.72:0/2470328622 shutdown_connections 2023-10-03T10:15:28.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.487+0000 7f7ba7f30700 1 -- 172.21.15.72:0/2470328622 wait complete. 2023-10-03T10:15:28.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:28.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:28.571 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:28.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.638+0000 7f9a26f40700 1 Processor -- start 2023-10-03T10:15:28.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.638+0000 7f9a26f40700 1 -- start start 2023-10-03T10:15:28.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.639+0000 7f9a26f40700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a201338c0 0x7f9a20133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.639+0000 7f9a26f40700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9a201341d0 0x7f9a2009de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.639+0000 7f9a26f40700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2006f720 con 0x7f9a2009e390 2023-10-03T10:15:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.639+0000 7f9a26f40700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a20070c80 con 0x7f9a201341d0 2023-10-03T10:15:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.639+0000 7f9a26f40700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2006fce0 con 0x7f9a201338c0 2023-10-03T10:15:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.639+0000 7f9a24cdc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a201338c0 0x7f9a20133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.639+0000 7f9a24cdc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a201338c0 0x7f9a20133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43296/0 (socket says 172.21.15.72:43296) 2023-10-03T10:15:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.639+0000 7f9a1ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9a201341d0 0x7f9a2009de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.639+0000 7f9a24cdc700 1 -- 172.21.15.72:0/2712521903 learned_addr learned my addr 172.21.15.72:0/2712521903 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.639+0000 7f9a24cdc700 1 -- 172.21.15.72:0/2712521903 >> v2:172.21.15.72:3300/0 conn(0x7f9a201341d0 msgr2=0x7f9a2009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.639+0000 7f9a24cdc700 1 --2- 172.21.15.72:0/2712521903 >> v2:172.21.15.72:3300/0 conn(0x7f9a201341d0 0x7f9a2009de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.639+0000 7f9a24cdc700 1 -- 172.21.15.72:0/2712521903 >> v1:172.21.15.72:6789/0 conn(0x7f9a2009e390 legacy=0x7f9a2013a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.639+0000 7f9a24cdc700 1 -- 172.21.15.72:0/2712521903 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a201336a0 con 0x7f9a201338c0 2023-10-03T10:15:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.639+0000 7f9a1ffff700 1 --2- 172.21.15.72:0/2712521903 >> v2:172.21.15.72:3300/0 conn(0x7f9a201341d0 0x7f9a2009de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.639+0000 7f9a24cdc700 1 --2- 172.21.15.72:0/2712521903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a201338c0 0x7f9a20133c90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9a140098f0 tx=0x7f9a14009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4e48a23fcc3c545 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.640+0000 7f9a1f7fe700 1 -- 172.21.15.72:0/2712521903 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14011830 con 0x7f9a201338c0 2023-10-03T10:15:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.640+0000 7f9a1f7fe700 1 -- 172.21.15.72:0/2712521903 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a14011990 con 0x7f9a201338c0 2023-10-03T10:15:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.640+0000 7f9a1f7fe700 1 -- 172.21.15.72:0/2712521903 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14011d20 con 0x7f9a201338c0 2023-10-03T10:15:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.640+0000 7f9a26f40700 1 -- 172.21.15.72:0/2712521903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a201338c0 msgr2=0x7f9a20133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.640+0000 7f9a26f40700 1 --2- 172.21.15.72:0/2712521903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a201338c0 0x7f9a20133c90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9a140098f0 tx=0x7f9a14009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:28.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.640+0000 7f9a26f40700 1 -- 172.21.15.72:0/2712521903 shutdown_connections 2023-10-03T10:15:28.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.640+0000 7f9a26f40700 1 --2- 172.21.15.72:0/2712521903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a201338c0 0x7f9a20133c90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.640+0000 7f9a26f40700 1 --2- 172.21.15.72:0/2712521903 >> v2:172.21.15.72:3300/0 conn(0x7f9a201341d0 0x7f9a2009de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.640+0000 7f9a26f40700 1 -- 172.21.15.72:0/2712521903 >> 172.21.15.72:0/2712521903 conn(0x7f9a200a2aa0 msgr2=0x7f9a200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.640+0000 7f9a26f40700 1 -- 172.21.15.72:0/2712521903 shutdown_connections 2023-10-03T10:15:28.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.640+0000 7f9a26f40700 1 -- 172.21.15.72:0/2712521903 wait complete. 2023-10-03T10:15:28.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.641+0000 7f9a26f40700 1 Processor -- start 2023-10-03T10:15:28.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.641+0000 7f9a26f40700 1 -- start start 2023-10-03T10:15:28.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a26f40700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a2009e390 0x7f9a2011f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a26f40700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a201338c0 0x7f9a2011fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a26f40700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a201341d0 0x7f9a201202f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a26f40700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a201230b0 con 0x7f9a201338c0 2023-10-03T10:15:28.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a26f40700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20122390 con 0x7f9a2009e390 2023-10-03T10:15:28.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a26f40700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a200a1260 con 0x7f9a201341d0 2023-10-03T10:15:28.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a24cdc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a2009e390 0x7f9a2011f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a24cdc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a2009e390 0x7f9a2011f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43302/0 (socket says 172.21.15.72:43302) 2023-10-03T10:15:28.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a24cdc700 1 -- 172.21.15.72:0/404075706 learned_addr learned my addr 172.21.15.72:0/404075706 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:28.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a254dd700 1 --2- 172.21.15.72:0/404075706 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a201341d0 0x7f9a201202f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a1ffff700 1 --2- 172.21.15.72:0/404075706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a201338c0 0x7f9a2011fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a24cdc700 1 -- 172.21.15.72:0/404075706 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a201341d0 msgr2=0x7f9a201202f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a24cdc700 1 --2- 172.21.15.72:0/404075706 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a201341d0 0x7f9a201202f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a24cdc700 1 -- 172.21.15.72:0/404075706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a201338c0 msgr2=0x7f9a2011fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a24cdc700 1 --2- 172.21.15.72:0/404075706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a201338c0 0x7f9a2011fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a24cdc700 1 -- 172.21.15.72:0/404075706 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c0094a0 con 0x7f9a2009e390 2023-10-03T10:15:28.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a1ffff700 1 --2- 172.21.15.72:0/404075706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a201338c0 0x7f9a2011fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:28.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.642+0000 7f9a24cdc700 1 --2- 172.21.15.72:0/404075706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a2009e390 0x7f9a2011f870 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9a14000c00 tx=0x7f9a14004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.643+0000 7f9a1d7fa700 1 -- 172.21.15.72:0/404075706 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14004480 con 0x7f9a2009e390 2023-10-03T10:15:28.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.643+0000 7f9a1d7fa700 1 -- 172.21.15.72:0/404075706 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1401f070 con 0x7f9a2009e390 2023-10-03T10:15:28.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.643+0000 7f9a26f40700 1 -- 172.21.15.72:0/404075706 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a14009550 con 0x7f9a2009e390 2023-10-03T10:15:28.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.643+0000 7f9a1d7fa700 1 -- 172.21.15.72:0/404075706 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a140038c0 con 0x7f9a2009e390 2023-10-03T10:15:28.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.643+0000 7f9a26f40700 1 -- 172.21.15.72:0/404075706 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a20123b20 con 0x7f9a2009e390 2023-10-03T10:15:28.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.643+0000 7f9a1d7fa700 1 -- 172.21.15.72:0/404075706 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a14021030 con 0x7f9a2009e390 2023-10-03T10:15:28.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.643+0000 7f9a1d7fa700 1 -- 172.21.15.72:0/404075706 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9a14040b50 con 0x7f9a2009e390 2023-10-03T10:15:28.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.644+0000 7f9a26f40700 1 -- 172.21.15.72:0/404075706 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2011c480 con 0x7f9a2009e390 2023-10-03T10:15:28.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.648+0000 7f9a1d7fa700 1 -- 172.21.15.72:0/404075706 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a14015080 con 0x7f9a2009e390 2023-10-03T10:15:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.703+0000 7fa1da59d700 1 Processor -- start 2023-10-03T10:15:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.703+0000 7fa1da59d700 1 -- start start 2023-10-03T10:15:28.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.703+0000 7fa1da59d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d409d630 0x7fa1d40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.703+0000 7fa1da59d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1d4138d80 0x7fa1d413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.703+0000 7fa1da59d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d40a2a70 con 0x7fa1d40a0a30 2023-10-03T10:15:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.703+0000 7fa1da59d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d40a01d0 con 0x7fa1d409d630 2023-10-03T10:15:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.703+0000 7fa1da59d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d409e2b0 con 0x7fa1d4138d80 2023-10-03T10:15:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.704+0000 7fa1d37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d409d630 0x7fa1d40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.704+0000 7fa1d3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa1d40a0a30 0x7fa1d40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54206/0 (socket says 172.21.15.72:54206) 2023-10-03T10:15:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.704+0000 7fa1d3fff700 1 -- 172.21.15.72:0/1472444876 learned_addr learned my addr 172.21.15.72:0/1472444876 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.704+0000 7fa1d8b3a700 1 --2- 172.21.15.72:0/1472444876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1d4138d80 0x7fa1d413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.704+0000 7fa1d2ffd700 1 -- 172.21.15.72:0/1472444876 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382680831 0 0) 0x7fa1d40a2a70 con 0x7fa1d40a0a30 2023-10-03T10:15:28.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.704+0000 7fa1d37fe700 1 -- 172.21.15.72:0/1472444876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1d4138d80 msgr2=0x7fa1d413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.704+0000 7fa1d37fe700 1 --2- 172.21.15.72:0/1472444876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1d4138d80 0x7fa1d413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.704+0000 7fa1d37fe700 1 -- 172.21.15.72:0/1472444876 >> v1:172.21.15.72:6789/0 conn(0x7fa1d40a0a30 legacy=0x7fa1d40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.704+0000 7fa1d37fe700 1 -- 172.21.15.72:0/1472444876 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d409dc50 con 0x7fa1d409d630 2023-10-03T10:15:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.704+0000 7fa1d8b3a700 1 --2- 172.21.15.72:0/1472444876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1d4138d80 0x7fa1d413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.704+0000 7fa1d37fe700 1 --2- 172.21.15.72:0/1472444876 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d409d630 0x7fa1d40a1510 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009870 tx=0x7fa1c8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1af03f6339e29a8c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.704+0000 7fa1d2ffd700 1 -- 172.21.15.72:0/1472444876 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8011830 con 0x7fa1d409d630 2023-10-03T10:15:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.704+0000 7fa1d2ffd700 1 -- 172.21.15.72:0/1472444876 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c8011990 con 0x7fa1d409d630 2023-10-03T10:15:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.704+0000 7fa1d2ffd700 1 -- 172.21.15.72:0/1472444876 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8011d20 con 0x7fa1d409d630 2023-10-03T10:15:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.705+0000 7fa1da59d700 1 -- 172.21.15.72:0/1472444876 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d409d630 msgr2=0x7fa1d40a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.705+0000 7fa1da59d700 1 --2- 172.21.15.72:0/1472444876 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d409d630 0x7fa1d40a1510 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009870 tx=0x7fa1c8009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.705+0000 7fa1da59d700 1 -- 172.21.15.72:0/1472444876 shutdown_connections 2023-10-03T10:15:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.705+0000 7fa1da59d700 1 --2- 172.21.15.72:0/1472444876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1d4138d80 0x7fa1d413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.705+0000 7fa1da59d700 1 --2- 172.21.15.72:0/1472444876 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d409d630 0x7fa1d40a1510 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.705+0000 7fa1da59d700 1 -- 172.21.15.72:0/1472444876 >> 172.21.15.72:0/1472444876 conn(0x7fa1d40a3050 msgr2=0x7fa1d40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.705+0000 7fa1da59d700 1 -- 172.21.15.72:0/1472444876 shutdown_connections 2023-10-03T10:15:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.705+0000 7fa1da59d700 1 -- 172.21.15.72:0/1472444876 wait complete. 2023-10-03T10:15:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.706+0000 7fa1da59d700 1 Processor -- start 2023-10-03T10:15:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.707+0000 7fa1da59d700 1 -- start start 2023-10-03T10:15:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.707+0000 7fa1da59d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d409d630 0x7fa1d4133910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.707+0000 7fa1da59d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d40a0a30 0x7fa1d4133e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.707+0000 7fa1da59d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1d4138d80 0x7fa1d4134390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.707+0000 7fa1da59d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d4134de0 con 0x7fa1d409d630 2023-10-03T10:15:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.707+0000 7fa1da59d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d41374b0 con 0x7fa1d40a0a30 2023-10-03T10:15:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.707+0000 7fa1da59d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d4136e00 con 0x7fa1d4138d80 2023-10-03T10:15:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.707+0000 7fa1d3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d409d630 0x7fa1d4133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.707+0000 7fa1d3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d409d630 0x7fa1d4133910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55166/0 (socket says 172.21.15.72:55166) 2023-10-03T10:15:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.707+0000 7fa1d3fff700 1 -- 172.21.15.72:0/405445841 learned_addr learned my addr 172.21.15.72:0/405445841 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.707+0000 7fa1d37fe700 1 --2- 172.21.15.72:0/405445841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d40a0a30 0x7fa1d4133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.707+0000 7fa1d8b3a700 1 --2- 172.21.15.72:0/405445841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1d4138d80 0x7fa1d4134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.708+0000 7fa1d3fff700 1 -- 172.21.15.72:0/405445841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1d4138d80 msgr2=0x7fa1d4134390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.708+0000 7fa1d3fff700 1 --2- 172.21.15.72:0/405445841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1d4138d80 0x7fa1d4134390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.708+0000 7fa1d3fff700 1 -- 172.21.15.72:0/405445841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d40a0a30 msgr2=0x7fa1d4133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.708+0000 7fa1d3fff700 1 --2- 172.21.15.72:0/405445841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d40a0a30 0x7fa1d4133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.708+0000 7fa1d3fff700 1 -- 172.21.15.72:0/405445841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc009a70 con 0x7fa1d409d630 2023-10-03T10:15:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.708+0000 7fa1d3fff700 1 --2- 172.21.15.72:0/405445841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d409d630 0x7fa1d4133910 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa1c400c550 tx=0x7fa1c400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.708+0000 7fa1d0ff9700 1 -- 172.21.15.72:0/405445841 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4004c80 con 0x7fa1d409d630 2023-10-03T10:15:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.708+0000 7fa1d0ff9700 1 -- 172.21.15.72:0/405445841 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c4004e00 con 0x7fa1d409d630 2023-10-03T10:15:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.708+0000 7fa1d0ff9700 1 -- 172.21.15.72:0/405445841 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4007310 con 0x7fa1d409d630 2023-10-03T10:15:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.708+0000 7fa1da59d700 1 -- 172.21.15.72:0/405445841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c80094a0 con 0x7fa1d409d630 2023-10-03T10:15:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.708+0000 7fa1da59d700 1 -- 172.21.15.72:0/405445841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d41370c0 con 0x7fa1d409d630 2023-10-03T10:15:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.709+0000 7fa1d0ff9700 1 -- 172.21.15.72:0/405445841 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1c4007470 con 0x7fa1d409d630 2023-10-03T10:15:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.709+0000 7fa1da59d700 1 -- 172.21.15.72:0/405445841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d4135ce0 con 0x7fa1d409d630 2023-10-03T10:15:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.709+0000 7fa1d0ff9700 1 -- 172.21.15.72:0/405445841 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa1c403f370 con 0x7fa1d409d630 2023-10-03T10:15:28.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.718+0000 7fa1d0ff9700 1 -- 172.21.15.72:0/405445841 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1c406f750 con 0x7fa1d409d630 2023-10-03T10:15:28.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.848+0000 7f9a26f40700 1 -- 172.21.15.72:0/404075706 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9a20074ea0 con 0x7f9a2009e390 2023-10-03T10:15:28.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.848+0000 7f9a1d7fa700 1 -- 172.21.15.72:0/404075706 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a140199a0 con 0x7f9a2009e390 2023-10-03T10:15:28.848 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.850+0000 7f9a26f40700 1 -- 172.21.15.72:0/404075706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a2009e390 msgr2=0x7f9a2011f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.850+0000 7f9a26f40700 1 --2- 172.21.15.72:0/404075706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a2009e390 0x7f9a2011f870 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9a14000c00 tx=0x7f9a14004750 comp rx=0 tx=0).stop 2023-10-03T10:15:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.850+0000 7f9a26f40700 1 -- 172.21.15.72:0/404075706 shutdown_connections 2023-10-03T10:15:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.850+0000 7f9a26f40700 1 --2- 172.21.15.72:0/404075706 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9a201341d0 0x7f9a201202f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.850+0000 7f9a26f40700 1 --2- 172.21.15.72:0/404075706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a2009e390 0x7f9a2011f870 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.850+0000 7f9a26f40700 1 --2- 172.21.15.72:0/404075706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a201338c0 0x7f9a2011fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.850+0000 7f9a26f40700 1 -- 172.21.15.72:0/404075706 >> 172.21.15.72:0/404075706 conn(0x7f9a200a2aa0 msgr2=0x7f9a20131ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.850+0000 7f9a26f40700 1 -- 172.21.15.72:0/404075706 shutdown_connections 2023-10-03T10:15:28.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.850+0000 7f9a26f40700 1 -- 172.21.15.72:0/404075706 wait complete. 2023-10-03T10:15:28.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:28.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.913+0000 7fa1da59d700 1 -- 172.21.15.72:0/405445841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa1d40747f0 con 0x7fa1d409d630 2023-10-03T10:15:28.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.913+0000 7fa1d0ff9700 1 -- 172.21.15.72:0/405445841 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa1c40123b0 con 0x7fa1d409d630 2023-10-03T10:15:28.914 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:28.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.915+0000 7fa1da59d700 1 -- 172.21.15.72:0/405445841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d409d630 msgr2=0x7fa1d4133910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.915+0000 7fa1da59d700 1 --2- 172.21.15.72:0/405445841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d409d630 0x7fa1d4133910 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa1c400c550 tx=0x7fa1c400c860 comp rx=0 tx=0).stop 2023-10-03T10:15:28.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.915+0000 7fa1da59d700 1 -- 172.21.15.72:0/405445841 shutdown_connections 2023-10-03T10:15:28.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.915+0000 7fa1da59d700 1 --2- 172.21.15.72:0/405445841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d409d630 0x7fa1d4133910 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.915+0000 7fa1da59d700 1 --2- 172.21.15.72:0/405445841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1d4138d80 0x7fa1d4134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.915+0000 7fa1da59d700 1 --2- 172.21.15.72:0/405445841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d40a0a30 0x7fa1d4133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.915+0000 7fa1da59d700 1 -- 172.21.15.72:0/405445841 >> 172.21.15.72:0/405445841 conn(0x7fa1d40a3050 msgr2=0x7fa1d409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.915+0000 7fa1da59d700 1 -- 172.21.15.72:0/405445841 shutdown_connections 2023-10-03T10:15:28.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.915+0000 7fa1da59d700 1 -- 172.21.15.72:0/405445841 wait complete. 2023-10-03T10:15:28.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:28.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.993+0000 7f243edec700 1 Processor -- start 2023-10-03T10:15:28.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.993+0000 7f243edec700 1 -- start start 2023-10-03T10:15:28.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.993+0000 7f243edec700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f243809e1d0 0x7f2438138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.993+0000 7f243edec700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2438139170 0x7f243813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.993+0000 7f243edec700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243809b120 con 0x7f243809d6f0 2023-10-03T10:15:28.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f243edec700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243806b460 con 0x7f243809e1d0 2023-10-03T10:15:28.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f243edec700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243809a7e0 con 0x7f2438139170 2023-10-03T10:15:28.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f2437fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f243809e1d0 0x7f2438138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f243d389700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2438139170 0x7f243813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f2437fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f243809e1d0 0x7f2438138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55178/0 (socket says 172.21.15.72:55178) 2023-10-03T10:15:28.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f243d389700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2438139170 0x7f243813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43332/0 (socket says 172.21.15.72:43332) 2023-10-03T10:15:28.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f2437fff700 1 -- 172.21.15.72:0/3700332253 learned_addr learned my addr 172.21.15.72:0/3700332253 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f243d389700 1 -- 172.21.15.72:0/3700332253 >> v2:172.21.15.72:3300/0 conn(0x7f243809e1d0 msgr2=0x7f2438138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f243d389700 1 --2- 172.21.15.72:0/3700332253 >> v2:172.21.15.72:3300/0 conn(0x7f243809e1d0 0x7f2438138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f243d389700 1 -- 172.21.15.72:0/3700332253 >> v1:172.21.15.72:6789/0 conn(0x7f243809d6f0 legacy=0x7f243809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f243d389700 1 -- 172.21.15.72:0/3700332253 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243809a500 con 0x7f2438139170 2023-10-03T10:15:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f2437fff700 1 --2- 172.21.15.72:0/3700332253 >> v2:172.21.15.72:3300/0 conn(0x7f243809e1d0 0x7f2438138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f243d389700 1 --2- 172.21.15.72:0/3700332253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2438139170 0x7f243813b550 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2430009dc0 tx=0x7f243000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22089e19bf656614 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f24377fe700 1 -- 172.21.15.72:0/3700332253 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243000e070 con 0x7f2438139170 2023-10-03T10:15:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f24377fe700 1 -- 172.21.15.72:0/3700332253 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243000bae0 con 0x7f2438139170 2023-10-03T10:15:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.994+0000 7f24377fe700 1 -- 172.21.15.72:0/3700332253 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243000be90 con 0x7f2438139170 2023-10-03T10:15:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.995+0000 7f243edec700 1 -- 172.21.15.72:0/3700332253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2438139170 msgr2=0x7f243813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.995+0000 7f243edec700 1 --2- 172.21.15.72:0/3700332253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2438139170 0x7f243813b550 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2430009dc0 tx=0x7f243000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:28.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.995+0000 7f243edec700 1 -- 172.21.15.72:0/3700332253 shutdown_connections 2023-10-03T10:15:28.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.995+0000 7f243edec700 1 --2- 172.21.15.72:0/3700332253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2438139170 0x7f243813b550 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.995+0000 7f243edec700 1 --2- 172.21.15.72:0/3700332253 >> v2:172.21.15.72:3300/0 conn(0x7f243809e1d0 0x7f2438138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.995+0000 7f243edec700 1 -- 172.21.15.72:0/3700332253 >> 172.21.15.72:0/3700332253 conn(0x7f2438066f50 msgr2=0x7f243809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.995+0000 7f243edec700 1 -- 172.21.15.72:0/3700332253 shutdown_connections 2023-10-03T10:15:28.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.995+0000 7f243edec700 1 -- 172.21.15.72:0/3700332253 wait complete. 2023-10-03T10:15:29.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.996+0000 7f243edec700 1 Processor -- start 2023-10-03T10:15:29.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.996+0000 7f243edec700 1 -- start start 2023-10-03T10:15:29.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243edec700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f243809d6f0 0x7f243811e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243edec700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f243809e1d0 0x7f243811ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243edec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2438139170 0x7f243811f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243edec700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2438121e90 con 0x7f243809d6f0 2023-10-03T10:15:29.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243edec700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243809c710 con 0x7f243809e1d0 2023-10-03T10:15:29.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243edec700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2438120550 con 0x7f2438139170 2023-10-03T10:15:29.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243cb88700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f243809d6f0 0x7f243811e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f2437fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f243809e1d0 0x7f243811ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243cb88700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f243809d6f0 0x7f243811e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55188/0 (socket says 172.21.15.72:55188) 2023-10-03T10:15:29.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f2437fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f243809e1d0 0x7f243811ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43336/0 (socket says 172.21.15.72:43336) 2023-10-03T10:15:29.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243cb88700 1 -- 172.21.15.72:0/4177026776 learned_addr learned my addr 172.21.15.72:0/4177026776 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:29.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243d389700 1 --2- 172.21.15.72:0/4177026776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2438139170 0x7f243811f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243cb88700 1 -- 172.21.15.72:0/4177026776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2438139170 msgr2=0x7f243811f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243cb88700 1 --2- 172.21.15.72:0/4177026776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2438139170 0x7f243811f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243cb88700 1 -- 172.21.15.72:0/4177026776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f243809e1d0 msgr2=0x7f243811ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243cb88700 1 --2- 172.21.15.72:0/4177026776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f243809e1d0 0x7f243811ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243cb88700 1 -- 172.21.15.72:0/4177026776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2424009550 con 0x7f243809d6f0 2023-10-03T10:15:29.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f2437fff700 1 --2- 172.21.15.72:0/4177026776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f243809e1d0 0x7f243811ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.997+0000 7f243cb88700 1 --2- 172.21.15.72:0/4177026776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f243809d6f0 0x7f243811e8c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f242c00c510 tx=0x7f242c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.998+0000 7f24357fa700 1 -- 172.21.15.72:0/4177026776 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c0052d0 con 0x7f243809d6f0 2023-10-03T10:15:29.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.998+0000 7f24357fa700 1 -- 172.21.15.72:0/4177026776 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c005430 con 0x7f243809d6f0 2023-10-03T10:15:29.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.998+0000 7f243edec700 1 -- 172.21.15.72:0/4177026776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2430009a70 con 0x7f243809d6f0 2023-10-03T10:15:29.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.998+0000 7f24357fa700 1 -- 172.21.15.72:0/4177026776 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c0038c0 con 0x7f243809d6f0 2023-10-03T10:15:29.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.998+0000 7f243edec700 1 -- 172.21.15.72:0/4177026776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2438122070 con 0x7f243809d6f0 2023-10-03T10:15:29.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.999+0000 7f243edec700 1 -- 172.21.15.72:0/4177026776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2438121cc0 con 0x7f243809d6f0 2023-10-03T10:15:29.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.999+0000 7f24357fa700 1 -- 172.21.15.72:0/4177026776 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f242c003a20 con 0x7f243809d6f0 2023-10-03T10:15:29.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:28.999+0000 7f24357fa700 1 -- 172.21.15.72:0/4177026776 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f242c03eed0 con 0x7f243809d6f0 2023-10-03T10:15:29.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.003+0000 7f24357fa700 1 -- 172.21.15.72:0/4177026776 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f242c018260 con 0x7f243809d6f0 2023-10-03T10:15:29.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.187+0000 7f243edec700 1 -- 172.21.15.72:0/4177026776 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f243809f420 con 0x7f243809d6f0 2023-10-03T10:15:29.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.187+0000 7f24357fa700 1 -- 172.21.15.72:0/4177026776 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f242c017030 con 0x7f243809d6f0 2023-10-03T10:15:29.188 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:29.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.189+0000 7f243edec700 1 -- 172.21.15.72:0/4177026776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f243809d6f0 msgr2=0x7f243811e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.189+0000 7f243edec700 1 --2- 172.21.15.72:0/4177026776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f243809d6f0 0x7f243811e8c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f242c00c510 tx=0x7f242c00c820 comp rx=0 tx=0).stop 2023-10-03T10:15:29.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.189+0000 7f243edec700 1 -- 172.21.15.72:0/4177026776 shutdown_connections 2023-10-03T10:15:29.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.189+0000 7f243edec700 1 --2- 172.21.15.72:0/4177026776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f243809d6f0 0x7f243811e8c0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.189+0000 7f243edec700 1 --2- 172.21.15.72:0/4177026776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2438139170 0x7f243811f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.189+0000 7f243edec700 1 --2- 172.21.15.72:0/4177026776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f243809e1d0 0x7f243811ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.189+0000 7f243edec700 1 -- 172.21.15.72:0/4177026776 >> 172.21.15.72:0/4177026776 conn(0x7f2438066f50 msgr2=0x7f243809b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.189+0000 7f243edec700 1 -- 172.21.15.72:0/4177026776 shutdown_connections 2023-10-03T10:15:29.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.190+0000 7f243edec700 1 -- 172.21.15.72:0/4177026776 wait complete. 2023-10-03T10:15:29.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:29.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:29.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.623+0000 7fd1b89d9700 1 Processor -- start 2023-10-03T10:15:29.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.623+0000 7fd1b89d9700 1 -- start start 2023-10-03T10:15:29.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b89d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1b409e930 0x7fd1b409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b89d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1b409f240 0x7fd1b41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b89d9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1b409f650 0x7fd1b4131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b89d9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b4070940 con 0x7fd1b409f650 2023-10-03T10:15:29.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b89d9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b406fd60 con 0x7fd1b409e930 2023-10-03T10:15:29.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b89d9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b406fa80 con 0x7fd1b409f240 2023-10-03T10:15:29.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1b409e930 0x7fd1b409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1b409f650 0x7fd1b4131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b1d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1b409f240 0x7fd1b41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1b409e930 0x7fd1b409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43344/0 (socket says 172.21.15.72:43344) 2023-10-03T10:15:29.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b1d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1b409f240 0x7fd1b41317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55024/0 (socket says 172.21.15.72:55024) 2023-10-03T10:15:29.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1b409f650 0x7fd1b4131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55192/0 (socket says 172.21.15.72:55192) 2023-10-03T10:15:29.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b259c700 1 -- 172.21.15.72:0/407711099 learned_addr learned my addr 172.21.15.72:0/407711099 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:29.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b259c700 1 -- 172.21.15.72:0/407711099 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1b409f240 msgr2=0x7fd1b41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b259c700 1 --2- 172.21.15.72:0/407711099 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1b409f240 0x7fd1b41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b259c700 1 -- 172.21.15.72:0/407711099 >> v2:172.21.15.72:3300/0 conn(0x7fd1b409f650 msgr2=0x7fd1b4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b259c700 1 --2- 172.21.15.72:0/407711099 >> v2:172.21.15.72:3300/0 conn(0x7fd1b409f650 0x7fd1b4131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b259c700 1 -- 172.21.15.72:0/407711099 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b409fb60 con 0x7fd1b409e930 2023-10-03T10:15:29.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b1d9b700 1 --2- 172.21.15.72:0/407711099 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1b409f240 0x7fd1b41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b259c700 1 --2- 172.21.15.72:0/407711099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1b409e930 0x7fd1b409ed00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80098f0 tx=0x7fd1a8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f422c5665d38368 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.624+0000 7fd1b159a700 1 -- 172.21.15.72:0/407711099 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8011830 con 0x7fd1b409e930 2023-10-03T10:15:29.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.625+0000 7fd1b159a700 1 -- 172.21.15.72:0/407711099 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a8011990 con 0x7fd1b409e930 2023-10-03T10:15:29.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.625+0000 7fd1b159a700 1 -- 172.21.15.72:0/407711099 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8011d20 con 0x7fd1b409e930 2023-10-03T10:15:29.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.625+0000 7fd1b89d9700 1 -- 172.21.15.72:0/407711099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1b409e930 msgr2=0x7fd1b409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.625+0000 7fd1b89d9700 1 --2- 172.21.15.72:0/407711099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1b409e930 0x7fd1b409ed00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80098f0 tx=0x7fd1a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:29.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.625+0000 7fd1b89d9700 1 -- 172.21.15.72:0/407711099 shutdown_connections 2023-10-03T10:15:29.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.625+0000 7fd1b89d9700 1 --2- 172.21.15.72:0/407711099 >> v2:172.21.15.72:3300/0 conn(0x7fd1b409f650 0x7fd1b4131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.625+0000 7fd1b89d9700 1 --2- 172.21.15.72:0/407711099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1b409e930 0x7fd1b409ed00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.625+0000 7fd1b89d9700 1 --2- 172.21.15.72:0/407711099 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1b409f240 0x7fd1b41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.625+0000 7fd1b89d9700 1 -- 172.21.15.72:0/407711099 >> 172.21.15.72:0/407711099 conn(0x7fd1b40a4210 msgr2=0x7fd1b40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.625+0000 7fd1b89d9700 1 -- 172.21.15.72:0/407711099 shutdown_connections 2023-10-03T10:15:29.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.625+0000 7fd1b89d9700 1 -- 172.21.15.72:0/407711099 wait complete. 2023-10-03T10:15:29.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.626+0000 7fd1b89d9700 1 Processor -- start 2023-10-03T10:15:29.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.626+0000 7fd1b89d9700 1 -- start start 2023-10-03T10:15:29.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b89d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1b409e930 0x7fd1b41a3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b89d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1b409f240 0x7fd1b41a42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b89d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1b409f650 0x7fd1b41a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b89d9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b41a5f50 con 0x7fd1b409f240 2023-10-03T10:15:29.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b89d9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b41a7010 con 0x7fd1b409f650 2023-10-03T10:15:29.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b89d9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4071d20 con 0x7fd1b409e930 2023-10-03T10:15:29.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1b409e930 0x7fd1b41a3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1b409f240 0x7fd1b41a42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1b409f650 0x7fd1b41a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1b409e930 0x7fd1b41a3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55032/0 (socket says 172.21.15.72:55032) 2023-10-03T10:15:29.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b259c700 1 -- 172.21.15.72:0/3745021613 learned_addr learned my addr 172.21.15.72:0/3745021613 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:29.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1b409f240 0x7fd1b41a42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55198/0 (socket says 172.21.15.72:55198) 2023-10-03T10:15:29.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b259c700 1 -- 172.21.15.72:0/3745021613 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1b409f650 msgr2=0x7fd1b41a47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b259c700 1 --2- 172.21.15.72:0/3745021613 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1b409f650 0x7fd1b41a47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b259c700 1 -- 172.21.15.72:0/3745021613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1b409f240 msgr2=0x7fd1b41a42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b259c700 1 --2- 172.21.15.72:0/3745021613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1b409f240 0x7fd1b41a42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b259c700 1 -- 172.21.15.72:0/3745021613 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a40094a0 con 0x7fd1b409e930 2023-10-03T10:15:29.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b1d9b700 1 --2- 172.21.15.72:0/3745021613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1b409f240 0x7fd1b41a42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b259c700 1 --2- 172.21.15.72:0/3745021613 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1b409e930 0x7fd1b41a3d60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8000c00 tx=0x7fd1a8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1a2ffd700 1 -- 172.21.15.72:0/3745021613 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8004240 con 0x7fd1b409e930 2023-10-03T10:15:29.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1a2ffd700 1 -- 172.21.15.72:0/3745021613 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a801f070 con 0x7fd1b409e930 2023-10-03T10:15:29.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b89d9700 1 -- 172.21.15.72:0/3745021613 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a8009550 con 0x7fd1b409e930 2023-10-03T10:15:29.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1a2ffd700 1 -- 172.21.15.72:0/3745021613 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a80045e0 con 0x7fd1b409e930 2023-10-03T10:15:29.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.627+0000 7fd1b89d9700 1 -- 172.21.15.72:0/3745021613 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b40a0190 con 0x7fd1b409e930 2023-10-03T10:15:29.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.628+0000 7fd1a2ffd700 1 -- 172.21.15.72:0/3745021613 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1a8021030 con 0x7fd1b409e930 2023-10-03T10:15:29.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.628+0000 7fd1a2ffd700 1 -- 172.21.15.72:0/3745021613 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd1a8040770 con 0x7fd1b409e930 2023-10-03T10:15:29.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.628+0000 7fd1b89d9700 1 -- 172.21.15.72:0/3745021613 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b4074ea0 con 0x7fd1b409e930 2023-10-03T10:15:29.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.633+0000 7fd1a2ffd700 1 -- 172.21.15.72:0/3745021613 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1a80093b0 con 0x7fd1b409e930 2023-10-03T10:15:29.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.818+0000 7fd1b89d9700 1 -- 172.21.15.72:0/3745021613 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd1b41a5970 con 0x7fd1b409e930 2023-10-03T10:15:29.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.818+0000 7fd1a2ffd700 1 -- 172.21.15.72:0/3745021613 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd1a8015020 con 0x7fd1b409e930 2023-10-03T10:15:29.819 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:29.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.820+0000 7fd1b89d9700 1 -- 172.21.15.72:0/3745021613 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1b409e930 msgr2=0x7fd1b41a3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.820+0000 7fd1b89d9700 1 --2- 172.21.15.72:0/3745021613 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1b409e930 0x7fd1b41a3d60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8000c00 tx=0x7fd1a8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:29.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.820+0000 7fd1b89d9700 1 -- 172.21.15.72:0/3745021613 shutdown_connections 2023-10-03T10:15:29.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.820+0000 7fd1b89d9700 1 --2- 172.21.15.72:0/3745021613 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1b409f650 0x7fd1b41a47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.820+0000 7fd1b89d9700 1 --2- 172.21.15.72:0/3745021613 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1b409e930 0x7fd1b41a3d60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.820+0000 7fd1b89d9700 1 --2- 172.21.15.72:0/3745021613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1b409f240 0x7fd1b41a42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.820+0000 7fd1b89d9700 1 -- 172.21.15.72:0/3745021613 >> 172.21.15.72:0/3745021613 conn(0x7fd1b40a4210 msgr2=0x7fd1b41b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.820+0000 7fd1b89d9700 1 -- 172.21.15.72:0/3745021613 shutdown_connections 2023-10-03T10:15:29.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.820+0000 7fd1b89d9700 1 -- 172.21.15.72:0/3745021613 wait complete. 2023-10-03T10:15:29.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:29.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:29.930 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:29.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.988+0000 7f7bb3fdd700 1 Processor -- start 2023-10-03T10:15:29.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.988+0000 7f7bb3fdd700 1 -- start start 2023-10-03T10:15:29.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.988+0000 7f7bb3fdd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7bac09d630 0x7f7bac0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.988+0000 7f7bb3fdd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bac138d80 0x7f7bac13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.988+0000 7f7bb3fdd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bac0a2a70 con 0x7f7bac0a0a30 2023-10-03T10:15:29.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.988+0000 7f7bb3fdd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bac0a01d0 con 0x7f7bac09d630 2023-10-03T10:15:29.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.988+0000 7f7bb3fdd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac09e2b0 con 0x7f7bac138d80 2023-10-03T10:15:29.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.989+0000 7f7bb1578700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7bac09d630 0x7f7bac0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.989+0000 7f7bb257a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bac138d80 0x7f7bac13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.989+0000 7f7bb1578700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7bac09d630 0x7f7bac0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55210/0 (socket says 172.21.15.72:55210) 2023-10-03T10:15:29.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.989+0000 7f7bb1578700 1 -- 172.21.15.72:0/222484357 learned_addr learned my addr 172.21.15.72:0/222484357 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:29.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.989+0000 7f7bb257a700 1 -- 172.21.15.72:0/222484357 >> v2:172.21.15.72:3300/0 conn(0x7f7bac09d630 msgr2=0x7f7bac0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.989+0000 7f7bb257a700 1 --2- 172.21.15.72:0/222484357 >> v2:172.21.15.72:3300/0 conn(0x7f7bac09d630 0x7f7bac0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.989+0000 7f7bb257a700 1 -- 172.21.15.72:0/222484357 >> v1:172.21.15.72:6789/0 conn(0x7f7bac0a0a30 legacy=0x7f7bac0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.989+0000 7f7bb257a700 1 -- 172.21.15.72:0/222484357 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bac09dc50 con 0x7f7bac138d80 2023-10-03T10:15:29.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.989+0000 7f7bb1578700 1 --2- 172.21.15.72:0/222484357 >> v2:172.21.15.72:3300/0 conn(0x7f7bac09d630 0x7f7bac0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.989+0000 7f7bb257a700 1 --2- 172.21.15.72:0/222484357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bac138d80 0x7f7bac13b160 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4009d90 tx=0x7f7ba400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c94ff1b099cc8d81 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.989+0000 7f7bb0d77700 1 -- 172.21.15.72:0/222484357 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba400e070 con 0x7f7bac138d80 2023-10-03T10:15:29.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.989+0000 7f7bb0d77700 1 -- 172.21.15.72:0/222484357 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba400bb20 con 0x7f7bac138d80 2023-10-03T10:15:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.989+0000 7f7bb0d77700 1 -- 172.21.15.72:0/222484357 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4012430 con 0x7f7bac138d80 2023-10-03T10:15:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.990+0000 7f7bb3fdd700 1 -- 172.21.15.72:0/222484357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bac138d80 msgr2=0x7f7bac13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.990+0000 7f7bb3fdd700 1 --2- 172.21.15.72:0/222484357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bac138d80 0x7f7bac13b160 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4009d90 tx=0x7f7ba400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.990+0000 7f7bb3fdd700 1 -- 172.21.15.72:0/222484357 shutdown_connections 2023-10-03T10:15:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.990+0000 7f7bb3fdd700 1 --2- 172.21.15.72:0/222484357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bac138d80 0x7f7bac13b160 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.990+0000 7f7bb3fdd700 1 --2- 172.21.15.72:0/222484357 >> v2:172.21.15.72:3300/0 conn(0x7f7bac09d630 0x7f7bac0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.990+0000 7f7bb3fdd700 1 -- 172.21.15.72:0/222484357 >> 172.21.15.72:0/222484357 conn(0x7f7bac0a3050 msgr2=0x7f7bac0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.990+0000 7f7bb3fdd700 1 -- 172.21.15.72:0/222484357 shutdown_connections 2023-10-03T10:15:29.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.990+0000 7f7bb3fdd700 1 -- 172.21.15.72:0/222484357 wait complete. 2023-10-03T10:15:29.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.991+0000 7f7bb3fdd700 1 Processor -- start 2023-10-03T10:15:29.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.991+0000 7f7bb3fdd700 1 -- start start 2023-10-03T10:15:29.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb3fdd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac09d630 0x7f7bac120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb3fdd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bac0a0a30 0x7f7bac120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb3fdd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bac138d80 0x7f7bac1210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb3fdd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac124140 con 0x7f7bac09d630 2023-10-03T10:15:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb3fdd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac1234f0 con 0x7f7bac138d80 2023-10-03T10:15:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb3fdd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac138b20 con 0x7f7bac0a0a30 2023-10-03T10:15:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb1578700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bac0a0a30 0x7f7bac120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb257a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bac138d80 0x7f7bac1210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb1578700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bac0a0a30 0x7f7bac120b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55046/0 (socket says 172.21.15.72:55046) 2023-10-03T10:15:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb1578700 1 -- 172.21.15.72:0/3074059732 learned_addr learned my addr 172.21.15.72:0/3074059732 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb1d79700 1 --2- 172.21.15.72:0/3074059732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac09d630 0x7f7bac120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb1578700 1 -- 172.21.15.72:0/3074059732 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bac138d80 msgr2=0x7f7bac1210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb1578700 1 --2- 172.21.15.72:0/3074059732 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bac138d80 0x7f7bac1210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb1578700 1 -- 172.21.15.72:0/3074059732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac09d630 msgr2=0x7f7bac120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb1578700 1 --2- 172.21.15.72:0/3074059732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac09d630 0x7f7bac120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb1578700 1 -- 172.21.15.72:0/3074059732 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c009550 con 0x7f7bac0a0a30 2023-10-03T10:15:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.992+0000 7f7bb1d79700 1 --2- 172.21.15.72:0/3074059732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac09d630 0x7f7bac120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.993+0000 7f7bb1578700 1 --2- 172.21.15.72:0/3074059732 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bac0a0a30 0x7f7bac120b60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00ebe0 tx=0x7f7b9c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.993+0000 7f7ba27fc700 1 -- 172.21.15.72:0/3074059732 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c00c850 con 0x7f7bac0a0a30 2023-10-03T10:15:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.993+0000 7f7ba27fc700 1 -- 172.21.15.72:0/3074059732 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c00c9b0 con 0x7f7bac0a0a30 2023-10-03T10:15:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.993+0000 7f7bb3fdd700 1 -- 172.21.15.72:0/3074059732 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba4009a70 con 0x7f7bac0a0a30 2023-10-03T10:15:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.993+0000 7f7ba27fc700 1 -- 172.21.15.72:0/3074059732 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c00cd40 con 0x7f7bac0a0a30 2023-10-03T10:15:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.993+0000 7f7bb3fdd700 1 -- 172.21.15.72:0/3074059732 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bac0a0460 con 0x7f7bac0a0a30 2023-10-03T10:15:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.993+0000 7f7ba27fc700 1 -- 172.21.15.72:0/3074059732 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b9c013470 con 0x7f7bac0a0a30 2023-10-03T10:15:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.994+0000 7f7ba27fc700 1 -- 172.21.15.72:0/3074059732 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7b9c03fc00 con 0x7f7bac0a0a30 2023-10-03T10:15:29.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.994+0000 7f7bb3fdd700 1 -- 172.21.15.72:0/3074059732 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bac124990 con 0x7f7bac0a0a30 2023-10-03T10:15:29.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:29.998+0000 7f7ba27fc700 1 -- 172.21.15.72:0/3074059732 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b9c01b3b0 con 0x7f7bac0a0a30 2023-10-03T10:15:30.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.055+0000 7f87a529d700 1 Processor -- start 2023-10-03T10:15:30.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.055+0000 7f87a529d700 1 -- start start 2023-10-03T10:15:30.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.055+0000 7f87a529d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87a009e1d0 0x7f87a0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.055+0000 7f87a529d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87a0139170 0x7f87a013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.055+0000 7f87a529d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a009b120 con 0x7f87a009d6f0 2023-10-03T10:15:30.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.055+0000 7f87a529d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a006b460 con 0x7f87a009e1d0 2023-10-03T10:15:30.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.055+0000 7f87a529d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a009a7e0 con 0x7f87a0139170 2023-10-03T10:15:30.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.055+0000 7f879f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87a0139170 0x7f87a013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.055+0000 7f879e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87a009e1d0 0x7f87a0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.056+0000 7f879f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87a0139170 0x7f87a013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43372/0 (socket says 172.21.15.72:43372) 2023-10-03T10:15:30.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.056+0000 7f879e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87a009e1d0 0x7f87a0138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55228/0 (socket says 172.21.15.72:55228) 2023-10-03T10:15:30.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.056+0000 7f879f7fe700 1 -- 172.21.15.72:0/868072976 learned_addr learned my addr 172.21.15.72:0/868072976 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:30.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.056+0000 7f879f7fe700 1 -- 172.21.15.72:0/868072976 >> v2:172.21.15.72:3300/0 conn(0x7f87a009e1d0 msgr2=0x7f87a0138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:30.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.056+0000 7f879f7fe700 1 --2- 172.21.15.72:0/868072976 >> v2:172.21.15.72:3300/0 conn(0x7f87a009e1d0 0x7f87a0138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.056+0000 7f879f7fe700 1 -- 172.21.15.72:0/868072976 >> v1:172.21.15.72:6789/0 conn(0x7f87a009d6f0 legacy=0x7f87a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.056+0000 7f879f7fe700 1 -- 172.21.15.72:0/868072976 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a009a500 con 0x7f87a0139170 2023-10-03T10:15:30.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.056+0000 7f879e7fc700 1 --2- 172.21.15.72:0/868072976 >> v2:172.21.15.72:3300/0 conn(0x7f87a009e1d0 0x7f87a0138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.056+0000 7f879f7fe700 1 --2- 172.21.15.72:0/868072976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87a0139170 0x7f87a013b550 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8798009e80 tx=0x7f879800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be9db251cbd8526b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.056+0000 7f879dffb700 1 -- 172.21.15.72:0/868072976 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879800e070 con 0x7f87a0139170 2023-10-03T10:15:30.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.056+0000 7f879dffb700 1 -- 172.21.15.72:0/868072976 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879800b8d0 con 0x7f87a0139170 2023-10-03T10:15:30.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.056+0000 7f879dffb700 1 -- 172.21.15.72:0/868072976 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879800bc80 con 0x7f87a0139170 2023-10-03T10:15:30.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.057+0000 7f87a529d700 1 -- 172.21.15.72:0/868072976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87a0139170 msgr2=0x7f87a013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.057+0000 7f87a529d700 1 --2- 172.21.15.72:0/868072976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87a0139170 0x7f87a013b550 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8798009e80 tx=0x7f879800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:30.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.057+0000 7f87a529d700 1 -- 172.21.15.72:0/868072976 shutdown_connections 2023-10-03T10:15:30.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.057+0000 7f87a529d700 1 --2- 172.21.15.72:0/868072976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87a0139170 0x7f87a013b550 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.057+0000 7f87a529d700 1 --2- 172.21.15.72:0/868072976 >> v2:172.21.15.72:3300/0 conn(0x7f87a009e1d0 0x7f87a0138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.057+0000 7f87a529d700 1 -- 172.21.15.72:0/868072976 >> 172.21.15.72:0/868072976 conn(0x7f87a0066f50 msgr2=0x7f87a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.057+0000 7f87a529d700 1 -- 172.21.15.72:0/868072976 shutdown_connections 2023-10-03T10:15:30.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.057+0000 7f87a529d700 1 -- 172.21.15.72:0/868072976 wait complete. 2023-10-03T10:15:30.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.058+0000 7f87a529d700 1 Processor -- start 2023-10-03T10:15:30.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.058+0000 7f87a529d700 1 -- start start 2023-10-03T10:15:30.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.058+0000 7f87a529d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87a009d6f0 0x7f87a011e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.058+0000 7f87a529d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87a009e1d0 0x7f87a011ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.058+0000 7f87a529d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87a0139170 0x7f87a011f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.058+0000 7f87a529d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a0121e90 con 0x7f87a0139170 2023-10-03T10:15:30.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.058+0000 7f87a529d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a009c710 con 0x7f87a009e1d0 2023-10-03T10:15:30.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.058+0000 7f87a529d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87a0120550 con 0x7f87a009d6f0 2023-10-03T10:15:30.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.058+0000 7f879f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87a0139170 0x7f87a011f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.058+0000 7f879f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87a0139170 0x7f87a011f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55236/0 (socket says 172.21.15.72:55236) 2023-10-03T10:15:30.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.058+0000 7f879e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87a009e1d0 0x7f87a011ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.058+0000 7f879f7fe700 1 -- 172.21.15.72:0/2546162740 learned_addr learned my addr 172.21.15.72:0/2546162740 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:30.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.058+0000 7f879effd700 1 --2- 172.21.15.72:0/2546162740 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87a009d6f0 0x7f87a011e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.059+0000 7f879e7fc700 1 -- 172.21.15.72:0/2546162740 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87a009d6f0 msgr2=0x7f87a011e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.059+0000 7f879e7fc700 1 --2- 172.21.15.72:0/2546162740 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87a009d6f0 0x7f87a011e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.059+0000 7f879e7fc700 1 -- 172.21.15.72:0/2546162740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87a0139170 msgr2=0x7f87a011f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.059+0000 7f879e7fc700 1 --2- 172.21.15.72:0/2546162740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87a0139170 0x7f87a011f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.059+0000 7f879e7fc700 1 -- 172.21.15.72:0/2546162740 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87940094a0 con 0x7f87a009e1d0 2023-10-03T10:15:30.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.059+0000 7f879f7fe700 1 --2- 172.21.15.72:0/2546162740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87a0139170 0x7f87a011f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.059+0000 7f879e7fc700 1 --2- 172.21.15.72:0/2546162740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87a009e1d0 0x7f87a011ee00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f879400e9b0 tx=0x7f879400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.059+0000 7f87877fe700 1 -- 172.21.15.72:0/2546162740 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879400ee50 con 0x7f87a009e1d0 2023-10-03T10:15:30.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.059+0000 7f87877fe700 1 -- 172.21.15.72:0/2546162740 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879400c850 con 0x7f87a009e1d0 2023-10-03T10:15:30.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.059+0000 7f87a529d700 1 -- 172.21.15.72:0/2546162740 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8798009b30 con 0x7f87a009e1d0 2023-10-03T10:15:30.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.059+0000 7f87877fe700 1 -- 172.21.15.72:0/2546162740 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879400cc00 con 0x7f87a009e1d0 2023-10-03T10:15:30.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.059+0000 7f87a529d700 1 -- 172.21.15.72:0/2546162740 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a0122070 con 0x7f87a009e1d0 2023-10-03T10:15:30.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.060+0000 7f87877fe700 1 -- 172.21.15.72:0/2546162740 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8794013470 con 0x7f87a009e1d0 2023-10-03T10:15:30.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.060+0000 7f87877fe700 1 -- 172.21.15.72:0/2546162740 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f879403f6e0 con 0x7f87a009e1d0 2023-10-03T10:15:30.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.060+0000 7f87a529d700 1 -- 172.21.15.72:0/2546162740 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a0121cc0 con 0x7f87a009e1d0 2023-10-03T10:15:30.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.069+0000 7f87877fe700 1 -- 172.21.15.72:0/2546162740 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8794013720 con 0x7f87a009e1d0 2023-10-03T10:15:30.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.196+0000 7f7bb3fdd700 1 -- 172.21.15.72:0/3074059732 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7bac0747f0 con 0x7f7bac0a0a30 2023-10-03T10:15:30.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.196+0000 7f7ba27fc700 1 -- 172.21.15.72:0/3074059732 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b9c024350 con 0x7f7bac0a0a30 2023-10-03T10:15:30.197 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:30.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.199+0000 7f7bb3fdd700 1 -- 172.21.15.72:0/3074059732 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bac0a0a30 msgr2=0x7f7bac120b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.199+0000 7f7bb3fdd700 1 --2- 172.21.15.72:0/3074059732 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bac0a0a30 0x7f7bac120b60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00ebe0 tx=0x7f7b9c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.199+0000 7f7bb3fdd700 1 -- 172.21.15.72:0/3074059732 shutdown_connections 2023-10-03T10:15:30.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.199+0000 7f7bb3fdd700 1 --2- 172.21.15.72:0/3074059732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bac09d630 0x7f7bac120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.199+0000 7f7bb3fdd700 1 --2- 172.21.15.72:0/3074059732 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bac138d80 0x7f7bac1210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.199+0000 7f7bb3fdd700 1 --2- 172.21.15.72:0/3074059732 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7bac0a0a30 0x7f7bac120b60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.199+0000 7f7bb3fdd700 1 -- 172.21.15.72:0/3074059732 >> 172.21.15.72:0/3074059732 conn(0x7f7bac0a3050 msgr2=0x7f7bac139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.199+0000 7f7bb3fdd700 1 -- 172.21.15.72:0/3074059732 shutdown_connections 2023-10-03T10:15:30.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.199+0000 7f7bb3fdd700 1 -- 172.21.15.72:0/3074059732 wait complete. 2023-10-03T10:15:30.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:30.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:30.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.262+0000 7f87a529d700 1 -- 172.21.15.72:0/2546162740 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f87a0074ea0 con 0x7f87a009e1d0 2023-10-03T10:15:30.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.262+0000 7f87877fe700 1 -- 172.21.15.72:0/2546162740 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8794021030 con 0x7f87a009e1d0 2023-10-03T10:15:30.263 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.264+0000 7f87a529d700 1 -- 172.21.15.72:0/2546162740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87a009e1d0 msgr2=0x7f87a011ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.264+0000 7f87a529d700 1 --2- 172.21.15.72:0/2546162740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87a009e1d0 0x7f87a011ee00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f879400e9b0 tx=0x7f879400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.264+0000 7f87a529d700 1 -- 172.21.15.72:0/2546162740 shutdown_connections 2023-10-03T10:15:30.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.264+0000 7f87a529d700 1 --2- 172.21.15.72:0/2546162740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87a0139170 0x7f87a011f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.264+0000 7f87a529d700 1 --2- 172.21.15.72:0/2546162740 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87a009d6f0 0x7f87a011e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.264+0000 7f87a529d700 1 --2- 172.21.15.72:0/2546162740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87a009e1d0 0x7f87a011ee00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.264+0000 7f87a529d700 1 -- 172.21.15.72:0/2546162740 >> 172.21.15.72:0/2546162740 conn(0x7f87a0066f50 msgr2=0x7f87a009b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.264+0000 7f87a529d700 1 -- 172.21.15.72:0/2546162740 shutdown_connections 2023-10-03T10:15:30.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.264+0000 7f87a529d700 1 -- 172.21.15.72:0/2546162740 wait complete. 2023-10-03T10:15:30.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:30.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.327+0000 7ff743b1d700 1 Processor -- start 2023-10-03T10:15:30.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.327+0000 7ff743b1d700 1 -- start start 2023-10-03T10:15:30.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.327+0000 7ff743b1d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff73c131630 0x7ff73c131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.327+0000 7ff743b1d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff73c131f40 0x7ff73c06e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.327+0000 7ff743b1d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73c071a00 con 0x7ff73c06e9d0 2023-10-03T10:15:30.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.327+0000 7ff743b1d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73c131430 con 0x7ff73c131630 2023-10-03T10:15:30.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.327+0000 7ff743b1d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c09a510 con 0x7ff73c131f40 2023-10-03T10:15:30.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.327+0000 7ff7410b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff73c131f40 0x7ff73c06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.327+0000 7ff7418b9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff73c131630 0x7ff73c131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.327+0000 7ff7410b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff73c131f40 0x7ff73c06e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43390/0 (socket says 172.21.15.72:43390) 2023-10-03T10:15:30.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.327+0000 7ff7418b9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff73c131630 0x7ff73c131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55252/0 (socket says 172.21.15.72:55252) 2023-10-03T10:15:30.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.327+0000 7ff7410b8700 1 -- 172.21.15.72:0/3561931100 learned_addr learned my addr 172.21.15.72:0/3561931100 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:30.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.327+0000 7ff7420ba700 1 --1- 172.21.15.72:0/3561931100 >> v1:172.21.15.72:6789/0 conn(0x7ff73c06e9d0 0x7ff73c138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54238/0 (socket says 172.21.15.72:54238) 2023-10-03T10:15:30.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.328+0000 7ff7410b8700 1 -- 172.21.15.72:0/3561931100 >> v2:172.21.15.72:3300/0 conn(0x7ff73c131630 msgr2=0x7ff73c131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:30.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.328+0000 7ff7410b8700 1 --2- 172.21.15.72:0/3561931100 >> v2:172.21.15.72:3300/0 conn(0x7ff73c131630 0x7ff73c131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.328+0000 7ff7410b8700 1 -- 172.21.15.72:0/3561931100 >> v1:172.21.15.72:6789/0 conn(0x7ff73c06e9d0 legacy=0x7ff73c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.328+0000 7ff7410b8700 1 -- 172.21.15.72:0/3561931100 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c0721c0 con 0x7ff73c131f40 2023-10-03T10:15:30.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.328+0000 7ff7418b9700 1 --2- 172.21.15.72:0/3561931100 >> v2:172.21.15.72:3300/0 conn(0x7ff73c131630 0x7ff73c131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.328+0000 7ff7410b8700 1 --2- 172.21.15.72:0/3561931100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff73c131f40 0x7ff73c06e490 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff7380098f0 tx=0x7ff738009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87b258abfceffc74 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.328+0000 7ff7408b7700 1 -- 172.21.15.72:0/3561931100 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738011830 con 0x7ff73c131f40 2023-10-03T10:15:30.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.328+0000 7ff7408b7700 1 -- 172.21.15.72:0/3561931100 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff738011990 con 0x7ff73c131f40 2023-10-03T10:15:30.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.328+0000 7ff7408b7700 1 -- 172.21.15.72:0/3561931100 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738011d20 con 0x7ff73c131f40 2023-10-03T10:15:30.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.328+0000 7ff743b1d700 1 -- 172.21.15.72:0/3561931100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff73c131f40 msgr2=0x7ff73c06e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.328+0000 7ff743b1d700 1 --2- 172.21.15.72:0/3561931100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff73c131f40 0x7ff73c06e490 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff7380098f0 tx=0x7ff738009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:30.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.328+0000 7ff743b1d700 1 -- 172.21.15.72:0/3561931100 shutdown_connections 2023-10-03T10:15:30.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.328+0000 7ff743b1d700 1 --2- 172.21.15.72:0/3561931100 >> v2:172.21.15.72:3300/0 conn(0x7ff73c131630 0x7ff73c131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.328+0000 7ff743b1d700 1 --2- 172.21.15.72:0/3561931100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff73c131f40 0x7ff73c06e490 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.329+0000 7ff743b1d700 1 -- 172.21.15.72:0/3561931100 >> 172.21.15.72:0/3561931100 conn(0x7ff73c0a2aa0 msgr2=0x7ff73c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.329+0000 7ff743b1d700 1 -- 172.21.15.72:0/3561931100 shutdown_connections 2023-10-03T10:15:30.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.329+0000 7ff743b1d700 1 -- 172.21.15.72:0/3561931100 wait complete. 2023-10-03T10:15:30.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.329+0000 7ff743b1d700 1 Processor -- start 2023-10-03T10:15:30.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.329+0000 7ff743b1d700 1 -- start start 2023-10-03T10:15:30.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff743b1d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff73c06e9d0 0x7ff73c11b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff743b1d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff73c131630 0x7ff73c11bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff743b1d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff73c131f40 0x7ff73c11c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff743b1d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c11cc70 con 0x7ff73c131f40 2023-10-03T10:15:30.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff743b1d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c12eb90 con 0x7ff73c131630 2023-10-03T10:15:30.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff743b1d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c11e600 con 0x7ff73c06e9d0 2023-10-03T10:15:30.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff7410b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff73c131630 0x7ff73c11bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff7420ba700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff73c131f40 0x7ff73c11c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff7418b9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff73c06e9d0 0x7ff73c11b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff7420ba700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff73c131f40 0x7ff73c11c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55256/0 (socket says 172.21.15.72:55256) 2023-10-03T10:15:30.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff7410b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff73c131630 0x7ff73c11bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43406/0 (socket says 172.21.15.72:43406) 2023-10-03T10:15:30.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff7420ba700 1 -- 172.21.15.72:0/2727558504 learned_addr learned my addr 172.21.15.72:0/2727558504 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:30.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff7420ba700 1 -- 172.21.15.72:0/2727558504 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff73c06e9d0 msgr2=0x7ff73c11b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff7420ba700 1 --2- 172.21.15.72:0/2727558504 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff73c06e9d0 0x7ff73c11b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff7420ba700 1 -- 172.21.15.72:0/2727558504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff73c131630 msgr2=0x7ff73c11bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff7420ba700 1 --2- 172.21.15.72:0/2727558504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff73c131630 0x7ff73c11bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff7420ba700 1 -- 172.21.15.72:0/2727558504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c0094a0 con 0x7ff73c131f40 2023-10-03T10:15:30.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff7410b8700 1 --2- 172.21.15.72:0/2727558504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff73c131630 0x7ff73c11bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.330+0000 7ff7420ba700 1 --2- 172.21.15.72:0/2727558504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff73c131f40 0x7ff73c11c220 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff73400cc00 tx=0x7ff73400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.331+0000 7ff7327fc700 1 -- 172.21.15.72:0/2727558504 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73400aa40 con 0x7ff73c131f40 2023-10-03T10:15:30.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.331+0000 7ff7327fc700 1 -- 172.21.15.72:0/2727558504 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73400aba0 con 0x7ff73c131f40 2023-10-03T10:15:30.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.331+0000 7ff743b1d700 1 -- 172.21.15.72:0/2727558504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff738009550 con 0x7ff73c131f40 2023-10-03T10:15:30.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.331+0000 7ff7327fc700 1 -- 172.21.15.72:0/2727558504 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff734007070 con 0x7ff73c131f40 2023-10-03T10:15:30.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.331+0000 7ff743b1d700 1 -- 172.21.15.72:0/2727558504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73c11eab0 con 0x7ff73c131f40 2023-10-03T10:15:30.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.331+0000 7ff7327fc700 1 -- 172.21.15.72:0/2727558504 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7340071d0 con 0x7ff73c131f40 2023-10-03T10:15:30.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.331+0000 7ff7327fc700 1 -- 172.21.15.72:0/2727558504 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff73403f200 con 0x7ff73c131f40 2023-10-03T10:15:30.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.331+0000 7ff743b1d700 1 -- 172.21.15.72:0/2727558504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73c11ea50 con 0x7ff73c131f40 2023-10-03T10:15:30.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.336+0000 7ff7327fc700 1 -- 172.21.15.72:0/2727558504 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff734017030 con 0x7ff73c131f40 2023-10-03T10:15:30.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.522+0000 7ff743b1d700 1 -- 172.21.15.72:0/2727558504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff73c074ea0 con 0x7ff73c131f40 2023-10-03T10:15:30.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.522+0000 7ff7327fc700 1 -- 172.21.15.72:0/2727558504 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff734007480 con 0x7ff73c131f40 2023-10-03T10:15:30.523 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.525+0000 7ff743b1d700 1 -- 172.21.15.72:0/2727558504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff73c131f40 msgr2=0x7ff73c11c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.525+0000 7ff743b1d700 1 --2- 172.21.15.72:0/2727558504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff73c131f40 0x7ff73c11c220 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7ff73400cc00 tx=0x7ff73400cf10 comp rx=0 tx=0).stop 2023-10-03T10:15:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.525+0000 7ff743b1d700 1 -- 172.21.15.72:0/2727558504 shutdown_connections 2023-10-03T10:15:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.525+0000 7ff743b1d700 1 --2- 172.21.15.72:0/2727558504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff73c131f40 0x7ff73c11c220 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.525+0000 7ff743b1d700 1 --2- 172.21.15.72:0/2727558504 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff73c06e9d0 0x7ff73c11b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.525+0000 7ff743b1d700 1 --2- 172.21.15.72:0/2727558504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff73c131630 0x7ff73c11bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.525+0000 7ff743b1d700 1 -- 172.21.15.72:0/2727558504 >> 172.21.15.72:0/2727558504 conn(0x7ff73c0a2aa0 msgr2=0x7ff73c1b8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.525+0000 7ff743b1d700 1 -- 172.21.15.72:0/2727558504 shutdown_connections 2023-10-03T10:15:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.525+0000 7ff743b1d700 1 -- 172.21.15.72:0/2727558504 wait complete. 2023-10-03T10:15:30.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:30.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:30.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.956+0000 7fd56faea700 1 Processor -- start 2023-10-03T10:15:30.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.956+0000 7fd56faea700 1 -- start start 2023-10-03T10:15:30.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56faea700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd56812cf60 0x7fd56806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56faea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd56812f8b0 0x7fd56812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56faea700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd568130260 0x7fd568136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56faea700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56812d330 con 0x7fd568130260 2023-10-03T10:15:30.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56faea700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56812cd90 con 0x7fd56812cf60 2023-10-03T10:15:30.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56faea700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5681306d0 con 0x7fd56812f8b0 2023-10-03T10:15:30.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56e087700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd568130260 0x7fd568136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56d886700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd56812cf60 0x7fd56806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56e087700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd568130260 0x7fd568136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55264/0 (socket says 172.21.15.72:55264) 2023-10-03T10:15:30.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56e087700 1 -- 172.21.15.72:0/2751820385 learned_addr learned my addr 172.21.15.72:0/2751820385 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:30.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56d085700 1 --2- 172.21.15.72:0/2751820385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd56812f8b0 0x7fd56812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56e087700 1 -- 172.21.15.72:0/2751820385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd56812f8b0 msgr2=0x7fd56812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:30.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56e087700 1 --2- 172.21.15.72:0/2751820385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd56812f8b0 0x7fd56812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56e087700 1 -- 172.21.15.72:0/2751820385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd56812cf60 msgr2=0x7fd56806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:30.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56e087700 1 --2- 172.21.15.72:0/2751820385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd56812cf60 0x7fd56806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56e087700 1 -- 172.21.15.72:0/2751820385 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd568071780 con 0x7fd568130260 2023-10-03T10:15:30.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56d886700 1 --2- 172.21.15.72:0/2751820385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd56812cf60 0x7fd56806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56d085700 1 --2- 172.21.15.72:0/2751820385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd56812f8b0 0x7fd56812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56e087700 1 --2- 172.21.15.72:0/2751820385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd568130260 0x7fd568136c20 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd560009e80 tx=0x7fd56000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2797943c02ac3941 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56c884700 1 -- 172.21.15.72:0/2751820385 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56000e070 con 0x7fd568130260 2023-10-03T10:15:30.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56c884700 1 -- 172.21.15.72:0/2751820385 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56000b8d0 con 0x7fd568130260 2023-10-03T10:15:30.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.957+0000 7fd56c884700 1 -- 172.21.15.72:0/2751820385 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56000bc80 con 0x7fd568130260 2023-10-03T10:15:30.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.958+0000 7fd56faea700 1 -- 172.21.15.72:0/2751820385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd568130260 msgr2=0x7fd568136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.958+0000 7fd56faea700 1 --2- 172.21.15.72:0/2751820385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd568130260 0x7fd568136c20 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd560009e80 tx=0x7fd56000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:30.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.958+0000 7fd56faea700 1 -- 172.21.15.72:0/2751820385 shutdown_connections 2023-10-03T10:15:30.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.958+0000 7fd56faea700 1 --2- 172.21.15.72:0/2751820385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd568130260 0x7fd568136c20 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.958+0000 7fd56faea700 1 --2- 172.21.15.72:0/2751820385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd56812cf60 0x7fd56806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.958+0000 7fd56faea700 1 --2- 172.21.15.72:0/2751820385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd56812f8b0 0x7fd56812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.958+0000 7fd56faea700 1 -- 172.21.15.72:0/2751820385 >> 172.21.15.72:0/2751820385 conn(0x7fd5680a2aa0 msgr2=0x7fd5680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.958+0000 7fd56faea700 1 -- 172.21.15.72:0/2751820385 shutdown_connections 2023-10-03T10:15:30.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.958+0000 7fd56faea700 1 -- 172.21.15.72:0/2751820385 wait complete. 2023-10-03T10:15:30.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.959+0000 7fd56faea700 1 Processor -- start 2023-10-03T10:15:30.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.959+0000 7fd56faea700 1 -- start start 2023-10-03T10:15:30.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.959+0000 7fd56faea700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd56812cf60 0x7fd568136fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.959+0000 7fd56faea700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd56812f8b0 0x7fd568137510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.959+0000 7fd56faea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd568130260 0x7fd5681c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:30.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.959+0000 7fd56faea700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56809af20 con 0x7fd56812f8b0 2023-10-03T10:15:30.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.959+0000 7fd56faea700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd568129ca0 con 0x7fd56812cf60 2023-10-03T10:15:30.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.959+0000 7fd56faea700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd568129fa0 con 0x7fd568130260 2023-10-03T10:15:30.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.959+0000 7fd56d085700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd56812f8b0 0x7fd568137510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.959+0000 7fd56e087700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd568130260 0x7fd5681c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.959+0000 7fd56d886700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd56812cf60 0x7fd568136fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:30.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.959+0000 7fd56e087700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd568130260 0x7fd5681c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55098/0 (socket says 172.21.15.72:55098) 2023-10-03T10:15:30.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.959+0000 7fd56d085700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd56812f8b0 0x7fd568137510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55278/0 (socket says 172.21.15.72:55278) 2023-10-03T10:15:30.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.959+0000 7fd56e087700 1 -- 172.21.15.72:0/781618369 learned_addr learned my addr 172.21.15.72:0/781618369 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:30.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.960+0000 7fd56d085700 1 -- 172.21.15.72:0/781618369 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd568130260 msgr2=0x7fd5681c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.960+0000 7fd56d085700 1 --2- 172.21.15.72:0/781618369 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd568130260 0x7fd5681c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.960+0000 7fd56d085700 1 -- 172.21.15.72:0/781618369 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd56812cf60 msgr2=0x7fd568136fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.960+0000 7fd56d085700 1 --2- 172.21.15.72:0/781618369 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd56812cf60 0x7fd568136fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.960+0000 7fd56d085700 1 -- 172.21.15.72:0/781618369 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5580094a0 con 0x7fd56812f8b0 2023-10-03T10:15:30.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.960+0000 7fd56d886700 1 --2- 172.21.15.72:0/781618369 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd56812cf60 0x7fd568136fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:30.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.960+0000 7fd56d085700 1 --2- 172.21.15.72:0/781618369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd56812f8b0 0x7fd568137510 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd56400e980 tx=0x7fd56400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:30.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.960+0000 7fd55e7fc700 1 -- 172.21.15.72:0/781618369 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400c690 con 0x7fd56812f8b0 2023-10-03T10:15:30.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.960+0000 7fd55e7fc700 1 -- 172.21.15.72:0/781618369 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56400c7f0 con 0x7fd56812f8b0 2023-10-03T10:15:30.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.960+0000 7fd56faea700 1 -- 172.21.15.72:0/781618369 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5640094a0 con 0x7fd56812f8b0 2023-10-03T10:15:30.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.960+0000 7fd55e7fc700 1 -- 172.21.15.72:0/781618369 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400cb80 con 0x7fd56812f8b0 2023-10-03T10:15:30.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.960+0000 7fd56faea700 1 -- 172.21.15.72:0/781618369 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd560009b30 con 0x7fd56812f8b0 2023-10-03T10:15:30.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.961+0000 7fd55e7fc700 1 -- 172.21.15.72:0/781618369 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd56400cce0 con 0x7fd56812f8b0 2023-10-03T10:15:30.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.961+0000 7fd55e7fc700 1 -- 172.21.15.72:0/781618369 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd56403f9a0 con 0x7fd56812f8b0 2023-10-03T10:15:30.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.961+0000 7fd56faea700 1 -- 172.21.15.72:0/781618369 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd568071af0 con 0x7fd56812f8b0 2023-10-03T10:15:30.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:30.966+0000 7fd55e7fc700 1 -- 172.21.15.72:0/781618369 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd56401b3b0 con 0x7fd56812f8b0 2023-10-03T10:15:31.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.147+0000 7fd56faea700 1 -- 172.21.15.72:0/781618369 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd56806d4a0 con 0x7fd56812f8b0 2023-10-03T10:15:31.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.147+0000 7fd55e7fc700 1 -- 172.21.15.72:0/781618369 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd564011ab0 con 0x7fd56812f8b0 2023-10-03T10:15:31.148 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:31.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.149+0000 7fd56faea700 1 -- 172.21.15.72:0/781618369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd56812f8b0 msgr2=0x7fd568137510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.149+0000 7fd56faea700 1 --2- 172.21.15.72:0/781618369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd56812f8b0 0x7fd568137510 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd56400e980 tx=0x7fd56400ec90 comp rx=0 tx=0).stop 2023-10-03T10:15:31.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.149+0000 7fd56faea700 1 -- 172.21.15.72:0/781618369 shutdown_connections 2023-10-03T10:15:31.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.149+0000 7fd56faea700 1 --2- 172.21.15.72:0/781618369 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd568130260 0x7fd5681c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.149+0000 7fd56faea700 1 --2- 172.21.15.72:0/781618369 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd56812cf60 0x7fd568136fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.149+0000 7fd56faea700 1 --2- 172.21.15.72:0/781618369 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd56812f8b0 0x7fd568137510 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.149+0000 7fd56faea700 1 -- 172.21.15.72:0/781618369 >> 172.21.15.72:0/781618369 conn(0x7fd5680a2aa0 msgr2=0x7fd56809e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.149+0000 7fd56faea700 1 -- 172.21.15.72:0/781618369 shutdown_connections 2023-10-03T10:15:31.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.149+0000 7fd56faea700 1 -- 172.21.15.72:0/781618369 wait complete. 2023-10-03T10:15:31.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:31.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:31.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:31.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.336+0000 7fe8af649700 1 Processor -- start 2023-10-03T10:15:31.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.336+0000 7fe8af649700 1 -- start start 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe8af649700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8a80a0a30 0x7fe8a80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe8af649700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8a809d630 0x7fe8a80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe8af649700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a80a2a70 con 0x7fe8a8133930 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe8af649700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a80a01d0 con 0x7fe8a80a0a30 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe8af649700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a809e2b0 con 0x7fe8a809d630 2023-10-03T10:15:31.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe8acbe4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8a809d630 0x7fe8a80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe8ad3e5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8a80a0a30 0x7fe8a80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe8acbe4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8a809d630 0x7fe8a80a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55108/0 (socket says 172.21.15.72:55108) 2023-10-03T10:15:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe8acbe4700 1 -- 172.21.15.72:0/1035661592 learned_addr learned my addr 172.21.15.72:0/1035661592 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe8acbe4700 1 -- 172.21.15.72:0/1035661592 >> v2:172.21.15.72:3300/0 conn(0x7fe8a80a0a30 msgr2=0x7fe8a80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe8acbe4700 1 --2- 172.21.15.72:0/1035661592 >> v2:172.21.15.72:3300/0 conn(0x7fe8a80a0a30 0x7fe8a80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe8acbe4700 1 -- 172.21.15.72:0/1035661592 >> v1:172.21.15.72:6789/0 conn(0x7fe8a8133930 legacy=0x7fe8a8133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe8acbe4700 1 -- 172.21.15.72:0/1035661592 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a809dc50 con 0x7fe8a809d630 2023-10-03T10:15:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe8acbe4700 1 --2- 172.21.15.72:0/1035661592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8a809d630 0x7fe8a80a1340 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe8980098f0 tx=0x7fe898009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d25cd0d44dc948c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe89ffff700 1 -- 172.21.15.72:0/1035661592 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe898011830 con 0x7fe8a809d630 2023-10-03T10:15:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe89ffff700 1 -- 172.21.15.72:0/1035661592 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe898011990 con 0x7fe8a809d630 2023-10-03T10:15:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.337+0000 7fe89ffff700 1 -- 172.21.15.72:0/1035661592 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe898011d20 con 0x7fe8a809d630 2023-10-03T10:15:31.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.338+0000 7fe8af649700 1 -- 172.21.15.72:0/1035661592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8a809d630 msgr2=0x7fe8a80a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.338+0000 7fe8af649700 1 --2- 172.21.15.72:0/1035661592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8a809d630 0x7fe8a80a1340 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe8980098f0 tx=0x7fe898009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:31.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.338+0000 7fe8af649700 1 -- 172.21.15.72:0/1035661592 shutdown_connections 2023-10-03T10:15:31.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.338+0000 7fe8af649700 1 --2- 172.21.15.72:0/1035661592 >> v2:172.21.15.72:3300/0 conn(0x7fe8a80a0a30 0x7fe8a80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.338+0000 7fe8af649700 1 --2- 172.21.15.72:0/1035661592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8a809d630 0x7fe8a80a1340 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.338+0000 7fe8af649700 1 -- 172.21.15.72:0/1035661592 >> 172.21.15.72:0/1035661592 conn(0x7fe8a80a3050 msgr2=0x7fe8a80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.338+0000 7fe8af649700 1 -- 172.21.15.72:0/1035661592 shutdown_connections 2023-10-03T10:15:31.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.338+0000 7fe8af649700 1 -- 172.21.15.72:0/1035661592 wait complete. 2023-10-03T10:15:31.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.339+0000 7fe8af649700 1 Processor -- start 2023-10-03T10:15:31.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.339+0000 7fe8af649700 1 -- start start 2023-10-03T10:15:31.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.339+0000 7fe8af649700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8a809d630 0x7fe8a81c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8af649700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8a80a0a30 0x7fe8a81c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8af649700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a8133930 0x7fe8a81c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8af649700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a81207c0 con 0x7fe8a8133930 2023-10-03T10:15:31.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8af649700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a8133570 con 0x7fe8a80a0a30 2023-10-03T10:15:31.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8af649700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a8121f40 con 0x7fe8a809d630 2023-10-03T10:15:31.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8ad3e5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8a809d630 0x7fe8a81c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8adbe6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a8133930 0x7fe8a81c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8ad3e5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8a809d630 0x7fe8a81c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55118/0 (socket says 172.21.15.72:55118) 2023-10-03T10:15:31.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8ad3e5700 1 -- 172.21.15.72:0/804338102 learned_addr learned my addr 172.21.15.72:0/804338102 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:31.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8acbe4700 1 --2- 172.21.15.72:0/804338102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8a80a0a30 0x7fe8a81c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8adbe6700 1 -- 172.21.15.72:0/804338102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8a809d630 msgr2=0x7fe8a81c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8adbe6700 1 --2- 172.21.15.72:0/804338102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8a809d630 0x7fe8a81c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8adbe6700 1 -- 172.21.15.72:0/804338102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8a80a0a30 msgr2=0x7fe8a81c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8adbe6700 1 --2- 172.21.15.72:0/804338102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8a80a0a30 0x7fe8a81c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8adbe6700 1 -- 172.21.15.72:0/804338102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe898009550 con 0x7fe8a8133930 2023-10-03T10:15:31.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8ad3e5700 1 --2- 172.21.15.72:0/804338102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8a809d630 0x7fe8a81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8adbe6700 1 --2- 172.21.15.72:0/804338102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a8133930 0x7fe8a81c8ba0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000cb90 tx=0x7fe8a000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe89dffb700 1 -- 172.21.15.72:0/804338102 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0003c00 con 0x7fe8a8133930 2023-10-03T10:15:31.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe89dffb700 1 -- 172.21.15.72:0/804338102 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a0003d60 con 0x7fe8a8133930 2023-10-03T10:15:31.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe8af649700 1 -- 172.21.15.72:0/804338102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a80a0410 con 0x7fe8a8133930 2023-10-03T10:15:31.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.340+0000 7fe89dffb700 1 -- 172.21.15.72:0/804338102 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a000aa80 con 0x7fe8a8133930 2023-10-03T10:15:31.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.341+0000 7fe8af649700 1 -- 172.21.15.72:0/804338102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a8122c70 con 0x7fe8a8133930 2023-10-03T10:15:31.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.341+0000 7fe89dffb700 1 -- 172.21.15.72:0/804338102 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8a000abe0 con 0x7fe8a8133930 2023-10-03T10:15:31.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.341+0000 7fe89dffb700 1 -- 172.21.15.72:0/804338102 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe8a003f530 con 0x7fe8a8133930 2023-10-03T10:15:31.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.342+0000 7fe8af649700 1 -- 172.21.15.72:0/804338102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a8122440 con 0x7fe8a8133930 2023-10-03T10:15:31.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.346+0000 7fe89dffb700 1 -- 172.21.15.72:0/804338102 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8a00198f0 con 0x7fe8a8133930 2023-10-03T10:15:31.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.405+0000 7f8abf8c0700 1 Processor -- start 2023-10-03T10:15:31.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.405+0000 7f8abf8c0700 1 -- start start 2023-10-03T10:15:31.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abf8c0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ab809e1d0 0x7f8ab8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abf8c0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ab8135e50 0x7f8ab8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abf8c0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab809f130 con 0x7f8ab809d6f0 2023-10-03T10:15:31.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abf8c0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab809f520 con 0x7f8ab8135e50 2023-10-03T10:15:31.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abf8c0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab809e930 con 0x7f8ab809e1d0 2023-10-03T10:15:31.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abce5b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ab809e1d0 0x7f8ab8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abde5d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ab8135e50 0x7f8ab8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abce5b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ab809e1d0 0x7f8ab8135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55130/0 (socket says 172.21.15.72:55130) 2023-10-03T10:15:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abde5d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ab8135e50 0x7f8ab8138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55304/0 (socket says 172.21.15.72:55304) 2023-10-03T10:15:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abce5b700 1 -- 172.21.15.72:0/3829102053 learned_addr learned my addr 172.21.15.72:0/3829102053 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abce5b700 1 -- 172.21.15.72:0/3829102053 >> v2:172.21.15.72:3300/0 conn(0x7f8ab8135e50 msgr2=0x7f8ab8138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abce5b700 1 --2- 172.21.15.72:0/3829102053 >> v2:172.21.15.72:3300/0 conn(0x7f8ab8135e50 0x7f8ab8138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abce5b700 1 -- 172.21.15.72:0/3829102053 >> v1:172.21.15.72:6789/0 conn(0x7f8ab809d6f0 legacy=0x7f8ab809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8aaffff700 1 -- 172.21.15.72:0/3829102053 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238825204 0 0) 0x7f8ab809f130 con 0x7f8ab809d6f0 2023-10-03T10:15:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abce5b700 1 -- 172.21.15.72:0/3829102053 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab809b2d0 con 0x7f8ab809e1d0 2023-10-03T10:15:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abde5d700 1 --2- 172.21.15.72:0/3829102053 >> v2:172.21.15.72:3300/0 conn(0x7f8ab8135e50 0x7f8ab8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8abce5b700 1 --2- 172.21.15.72:0/3829102053 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ab809e1d0 0x7f8ab8135910 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009920 tx=0x7f8aa8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb00799b2c613afe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.406+0000 7f8aaffff700 1 -- 172.21.15.72:0/3829102053 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8011830 con 0x7f8ab809e1d0 2023-10-03T10:15:31.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.407+0000 7f8aaffff700 1 -- 172.21.15.72:0/3829102053 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa8011990 con 0x7f8ab809e1d0 2023-10-03T10:15:31.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.407+0000 7f8aaffff700 1 -- 172.21.15.72:0/3829102053 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8011d20 con 0x7f8ab809e1d0 2023-10-03T10:15:31.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.407+0000 7f8abf8c0700 1 -- 172.21.15.72:0/3829102053 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ab809e1d0 msgr2=0x7f8ab8135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.407+0000 7f8abf8c0700 1 --2- 172.21.15.72:0/3829102053 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ab809e1d0 0x7f8ab8135910 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009920 tx=0x7f8aa8009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:31.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.407+0000 7f8abf8c0700 1 -- 172.21.15.72:0/3829102053 shutdown_connections 2023-10-03T10:15:31.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.407+0000 7f8abf8c0700 1 --2- 172.21.15.72:0/3829102053 >> v2:172.21.15.72:3300/0 conn(0x7f8ab8135e50 0x7f8ab8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.407+0000 7f8abf8c0700 1 --2- 172.21.15.72:0/3829102053 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ab809e1d0 0x7f8ab8135910 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.407+0000 7f8abf8c0700 1 -- 172.21.15.72:0/3829102053 >> 172.21.15.72:0/3829102053 conn(0x7f8ab8066f50 msgr2=0x7f8ab809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.407+0000 7f8abf8c0700 1 -- 172.21.15.72:0/3829102053 shutdown_connections 2023-10-03T10:15:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.407+0000 7f8abf8c0700 1 -- 172.21.15.72:0/3829102053 wait complete. 2023-10-03T10:15:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.408+0000 7f8abf8c0700 1 Processor -- start 2023-10-03T10:15:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.408+0000 7f8abf8c0700 1 -- start start 2023-10-03T10:15:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abf8c0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ab809d6f0 0x7f8ab811e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abf8c0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ab809e1d0 0x7f8ab81c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abf8c0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab8135e50 0x7f8ab81c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abf8c0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab812ffe0 con 0x7f8ab8135e50 2023-10-03T10:15:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abf8c0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab811de40 con 0x7f8ab809d6f0 2023-10-03T10:15:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abf8c0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab809c700 con 0x7f8ab809e1d0 2023-10-03T10:15:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abd65c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ab809d6f0 0x7f8ab811e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abde5d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab8135e50 0x7f8ab81c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abd65c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ab809d6f0 0x7f8ab811e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43444/0 (socket says 172.21.15.72:43444) 2023-10-03T10:15:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abde5d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab8135e50 0x7f8ab81c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55314/0 (socket says 172.21.15.72:55314) 2023-10-03T10:15:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abd65c700 1 -- 172.21.15.72:0/875022999 learned_addr learned my addr 172.21.15.72:0/875022999 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abce5b700 1 --2- 172.21.15.72:0/875022999 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ab809e1d0 0x7f8ab81c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abce5b700 1 -- 172.21.15.72:0/875022999 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ab809d6f0 msgr2=0x7f8ab811e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abce5b700 1 --2- 172.21.15.72:0/875022999 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ab809d6f0 0x7f8ab811e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abce5b700 1 -- 172.21.15.72:0/875022999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab8135e50 msgr2=0x7f8ab81c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abce5b700 1 --2- 172.21.15.72:0/875022999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab8135e50 0x7f8ab81c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abce5b700 1 -- 172.21.15.72:0/875022999 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab0009a70 con 0x7f8ab809e1d0 2023-10-03T10:15:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abde5d700 1 --2- 172.21.15.72:0/875022999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab8135e50 0x7f8ab81c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abce5b700 1 --2- 172.21.15.72:0/875022999 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ab809e1d0 0x7f8ab81c80e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8016000 tx=0x7f8aa8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8aadffb700 1 -- 172.21.15.72:0/875022999 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8004450 con 0x7f8ab809e1d0 2023-10-03T10:15:31.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8aadffb700 1 -- 172.21.15.72:0/875022999 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa80036a0 con 0x7f8ab809e1d0 2023-10-03T10:15:31.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8abf8c0700 1 -- 172.21.15.72:0/875022999 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa8009550 con 0x7f8ab809e1d0 2023-10-03T10:15:31.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.409+0000 7f8aadffb700 1 -- 172.21.15.72:0/875022999 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80045f0 con 0x7f8ab809e1d0 2023-10-03T10:15:31.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.410+0000 7f8abf8c0700 1 -- 172.21.15.72:0/875022999 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab811fef0 con 0x7f8ab809e1d0 2023-10-03T10:15:31.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.410+0000 7f8aadffb700 1 -- 172.21.15.72:0/875022999 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8aa8003a50 con 0x7f8ab809e1d0 2023-10-03T10:15:31.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.410+0000 7f8abf8c0700 1 -- 172.21.15.72:0/875022999 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab8120d00 con 0x7f8ab809e1d0 2023-10-03T10:15:31.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.411+0000 7f8aadffb700 1 -- 172.21.15.72:0/875022999 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8aa8021030 con 0x7f8ab809e1d0 2023-10-03T10:15:31.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.415+0000 7f8aadffb700 1 -- 172.21.15.72:0/875022999 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8aa801a430 con 0x7f8ab809e1d0 2023-10-03T10:15:31.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:31.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.541+0000 7fe8af649700 1 -- 172.21.15.72:0/804338102 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe8a80747f0 con 0x7fe8a8133930 2023-10-03T10:15:31.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.542+0000 7fe89dffb700 1 -- 172.21.15.72:0/804338102 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8a0019300 con 0x7fe8a8133930 2023-10-03T10:15:31.542 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:31.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.544+0000 7fe8af649700 1 -- 172.21.15.72:0/804338102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a8133930 msgr2=0x7fe8a81c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.544+0000 7fe8af649700 1 --2- 172.21.15.72:0/804338102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a8133930 0x7fe8a81c8ba0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000cb90 tx=0x7fe8a000cea0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.544+0000 7fe8af649700 1 -- 172.21.15.72:0/804338102 shutdown_connections 2023-10-03T10:15:31.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.544+0000 7fe8af649700 1 --2- 172.21.15.72:0/804338102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8a8133930 0x7fe8a81c8ba0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.544+0000 7fe8af649700 1 --2- 172.21.15.72:0/804338102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8a809d630 0x7fe8a81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.544+0000 7fe8af649700 1 --2- 172.21.15.72:0/804338102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8a80a0a30 0x7fe8a81c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.544+0000 7fe8af649700 1 -- 172.21.15.72:0/804338102 >> 172.21.15.72:0/804338102 conn(0x7fe8a80a3050 msgr2=0x7fe8a81bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.544+0000 7fe8af649700 1 -- 172.21.15.72:0/804338102 shutdown_connections 2023-10-03T10:15:31.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.544+0000 7fe8af649700 1 -- 172.21.15.72:0/804338102 wait complete. 2023-10-03T10:15:31.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:31.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.612+0000 7f8abf8c0700 1 -- 172.21.15.72:0/875022999 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8ab8074ea0 con 0x7f8ab809e1d0 2023-10-03T10:15:31.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.612+0000 7f8aadffb700 1 -- 172.21.15.72:0/875022999 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8aa8015070 con 0x7f8ab809e1d0 2023-10-03T10:15:31.613 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:31.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.614+0000 7f8abf8c0700 1 -- 172.21.15.72:0/875022999 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ab809e1d0 msgr2=0x7f8ab81c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.614+0000 7f8abf8c0700 1 --2- 172.21.15.72:0/875022999 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ab809e1d0 0x7f8ab81c80e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8016000 tx=0x7f8aa8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:31.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.615+0000 7f8abf8c0700 1 -- 172.21.15.72:0/875022999 shutdown_connections 2023-10-03T10:15:31.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.615+0000 7f8abf8c0700 1 --2- 172.21.15.72:0/875022999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ab8135e50 0x7f8ab81c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.615+0000 7f8abf8c0700 1 --2- 172.21.15.72:0/875022999 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ab809d6f0 0x7f8ab811e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.615+0000 7f8abf8c0700 1 --2- 172.21.15.72:0/875022999 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ab809e1d0 0x7f8ab81c80e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.615+0000 7f8abf8c0700 1 -- 172.21.15.72:0/875022999 >> 172.21.15.72:0/875022999 conn(0x7f8ab8066f50 msgr2=0x7f8ab80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.615+0000 7f8abf8c0700 1 -- 172.21.15.72:0/875022999 shutdown_connections 2023-10-03T10:15:31.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.615+0000 7f8abf8c0700 1 -- 172.21.15.72:0/875022999 wait complete. 2023-10-03T10:15:31.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:31.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.664+0000 7ffb2438e700 1 Processor -- start 2023-10-03T10:15:31.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.664+0000 7ffb2438e700 1 -- start start 2023-10-03T10:15:31.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.664+0000 7ffb2438e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c1338a0 0x7ffb1c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.664+0000 7ffb2438e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09de50 0x7ffb1c09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.664+0000 7ffb2438e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffb1c09e760 0x7ffb1c13a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.664+0000 7ffb2438e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1c06fef0 con 0x7ffb1c09e760 2023-10-03T10:15:31.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.664+0000 7ffb2438e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c06ef30 con 0x7ffb1c1338a0 2023-10-03T10:15:31.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.664+0000 7ffb2438e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c1334b0 con 0x7ffb1c09de50 2023-10-03T10:15:31.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.664+0000 7ffb2292b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffb1c09e760 0x7ffb1c13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.664+0000 7ffb21929700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09de50 0x7ffb1c09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.664+0000 7ffb2212a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c1338a0 0x7ffb1c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.664+0000 7ffb2292b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffb1c09e760 0x7ffb1c13a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55320/0 (socket says 172.21.15.72:55320) 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.664+0000 7ffb2292b700 1 -- 172.21.15.72:0/2219964697 learned_addr learned my addr 172.21.15.72:0/2219964697 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.665+0000 7ffb2212a700 1 -- 172.21.15.72:0/2219964697 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09de50 msgr2=0x7ffb1c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.665+0000 7ffb2212a700 1 --2- 172.21.15.72:0/2219964697 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09de50 0x7ffb1c09e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.665+0000 7ffb2212a700 1 -- 172.21.15.72:0/2219964697 >> v2:172.21.15.72:3300/0 conn(0x7ffb1c09e760 msgr2=0x7ffb1c13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.665+0000 7ffb2212a700 1 --2- 172.21.15.72:0/2219964697 >> v2:172.21.15.72:3300/0 conn(0x7ffb1c09e760 0x7ffb1c13a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.665+0000 7ffb2212a700 1 -- 172.21.15.72:0/2219964697 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c06fc30 con 0x7ffb1c1338a0 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.665+0000 7ffb2292b700 1 --2- 172.21.15.72:0/2219964697 >> v2:172.21.15.72:3300/0 conn(0x7ffb1c09e760 0x7ffb1c13a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.665+0000 7ffb2212a700 1 --2- 172.21.15.72:0/2219964697 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c1338a0 0x7ffb1c133c70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009870 tx=0x7ffb18009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4468c4b762f3ceaa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.665+0000 7ffb21128700 1 -- 172.21.15.72:0/2219964697 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18011830 con 0x7ffb1c1338a0 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.665+0000 7ffb21128700 1 -- 172.21.15.72:0/2219964697 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb18011990 con 0x7ffb1c1338a0 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.665+0000 7ffb21128700 1 -- 172.21.15.72:0/2219964697 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18011d20 con 0x7ffb1c1338a0 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.666+0000 7ffb2438e700 1 -- 172.21.15.72:0/2219964697 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c1338a0 msgr2=0x7ffb1c133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.666+0000 7ffb2438e700 1 --2- 172.21.15.72:0/2219964697 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c1338a0 0x7ffb1c133c70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009870 tx=0x7ffb18009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.666+0000 7ffb2438e700 1 -- 172.21.15.72:0/2219964697 shutdown_connections 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.666+0000 7ffb2438e700 1 --2- 172.21.15.72:0/2219964697 >> v2:172.21.15.72:3300/0 conn(0x7ffb1c09e760 0x7ffb1c13a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.666+0000 7ffb2438e700 1 --2- 172.21.15.72:0/2219964697 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c1338a0 0x7ffb1c133c70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.666+0000 7ffb2438e700 1 --2- 172.21.15.72:0/2219964697 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09de50 0x7ffb1c09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.666+0000 7ffb2438e700 1 -- 172.21.15.72:0/2219964697 >> 172.21.15.72:0/2219964697 conn(0x7ffb1c0a2aa0 msgr2=0x7ffb1c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.666+0000 7ffb2438e700 1 -- 172.21.15.72:0/2219964697 shutdown_connections 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.666+0000 7ffb2438e700 1 -- 172.21.15.72:0/2219964697 wait complete. 2023-10-03T10:15:31.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.667+0000 7ffb2438e700 1 Processor -- start 2023-10-03T10:15:31.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.667+0000 7ffb2438e700 1 -- start start 2023-10-03T10:15:31.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.667+0000 7ffb2438e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09de50 0x7ffb1c11e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.667+0000 7ffb2438e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09e760 0x7ffb1c11ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.667+0000 7ffb2438e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb1c1338a0 0x7ffb1c11f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.667+0000 7ffb2438e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c122510 con 0x7ffb1c1338a0 2023-10-03T10:15:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.667+0000 7ffb2438e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c06f640 con 0x7ffb1c09e760 2023-10-03T10:15:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.667+0000 7ffb2438e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c1206a0 con 0x7ffb1c09de50 2023-10-03T10:15:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.667+0000 7ffb2212a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09de50 0x7ffb1c11e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.667+0000 7ffb21929700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09e760 0x7ffb1c11ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.667+0000 7ffb2212a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09de50 0x7ffb1c11e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55158/0 (socket says 172.21.15.72:55158) 2023-10-03T10:15:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.667+0000 7ffb2212a700 1 -- 172.21.15.72:0/3970798326 learned_addr learned my addr 172.21.15.72:0/3970798326 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.667+0000 7ffb2292b700 1 --2- 172.21.15.72:0/3970798326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb1c1338a0 0x7ffb1c11f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.668+0000 7ffb2212a700 1 -- 172.21.15.72:0/3970798326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09e760 msgr2=0x7ffb1c11ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.668+0000 7ffb2212a700 1 --2- 172.21.15.72:0/3970798326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09e760 0x7ffb1c11ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.668+0000 7ffb2212a700 1 -- 172.21.15.72:0/3970798326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb1c1338a0 msgr2=0x7ffb1c11f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.668+0000 7ffb2212a700 1 --2- 172.21.15.72:0/3970798326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb1c1338a0 0x7ffb1c11f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.668+0000 7ffb2212a700 1 -- 172.21.15.72:0/3970798326 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb14009b30 con 0x7ffb1c09de50 2023-10-03T10:15:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.668+0000 7ffb21929700 1 --2- 172.21.15.72:0/3970798326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09e760 0x7ffb1c11ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.668+0000 7ffb2212a700 1 --2- 172.21.15.72:0/3970798326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09de50 0x7ffb1c11e9f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ffb18000c00 tx=0x7ffb18004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.668+0000 7ffb12ffd700 1 -- 172.21.15.72:0/3970798326 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18004450 con 0x7ffb1c09de50 2023-10-03T10:15:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.668+0000 7ffb12ffd700 1 -- 172.21.15.72:0/3970798326 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb180045b0 con 0x7ffb1c09de50 2023-10-03T10:15:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.668+0000 7ffb2438e700 1 -- 172.21.15.72:0/3970798326 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb180094a0 con 0x7ffb1c09de50 2023-10-03T10:15:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.668+0000 7ffb12ffd700 1 -- 172.21.15.72:0/3970798326 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb180038e0 con 0x7ffb1c09de50 2023-10-03T10:15:31.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.668+0000 7ffb2438e700 1 -- 172.21.15.72:0/3970798326 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c12fd90 con 0x7ffb1c09de50 2023-10-03T10:15:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.669+0000 7ffb12ffd700 1 -- 172.21.15.72:0/3970798326 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb18003a40 con 0x7ffb1c09de50 2023-10-03T10:15:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.669+0000 7ffb12ffd700 1 -- 172.21.15.72:0/3970798326 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb18040830 con 0x7ffb1c09de50 2023-10-03T10:15:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.669+0000 7ffb2438e700 1 -- 172.21.15.72:0/3970798326 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1c122150 con 0x7ffb1c09de50 2023-10-03T10:15:31.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.674+0000 7ffb12ffd700 1 -- 172.21.15.72:0/3970798326 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb1802e970 con 0x7ffb1c09de50 2023-10-03T10:15:31.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.858+0000 7ffb2438e700 1 -- 172.21.15.72:0/3970798326 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb1c074ea0 con 0x7ffb1c09de50 2023-10-03T10:15:31.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.858+0000 7ffb12ffd700 1 -- 172.21.15.72:0/3970798326 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb18015030 con 0x7ffb1c09de50 2023-10-03T10:15:31.859 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:31.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.860+0000 7ffb2438e700 1 -- 172.21.15.72:0/3970798326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09de50 msgr2=0x7ffb1c11e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.860+0000 7ffb2438e700 1 --2- 172.21.15.72:0/3970798326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09de50 0x7ffb1c11e9f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ffb18000c00 tx=0x7ffb18004750 comp rx=0 tx=0).stop 2023-10-03T10:15:31.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.860+0000 7ffb2438e700 1 -- 172.21.15.72:0/3970798326 shutdown_connections 2023-10-03T10:15:31.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.860+0000 7ffb2438e700 1 --2- 172.21.15.72:0/3970798326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb1c1338a0 0x7ffb1c11f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.860+0000 7ffb2438e700 1 --2- 172.21.15.72:0/3970798326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09de50 0x7ffb1c11e9f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.860+0000 7ffb2438e700 1 --2- 172.21.15.72:0/3970798326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09e760 0x7ffb1c11ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.860+0000 7ffb2438e700 1 -- 172.21.15.72:0/3970798326 >> 172.21.15.72:0/3970798326 conn(0x7ffb1c0a2aa0 msgr2=0x7ffb1c09ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.860+0000 7ffb2438e700 1 -- 172.21.15.72:0/3970798326 shutdown_connections 2023-10-03T10:15:31.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:31.860+0000 7ffb2438e700 1 -- 172.21.15.72:0/3970798326 wait complete. 2023-10-03T10:15:31.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:32.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:32.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.286+0000 7fef5b8da700 1 Processor -- start 2023-10-03T10:15:32.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.286+0000 7fef5b8da700 1 -- start start 2023-10-03T10:15:32.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef5b8da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef541338a0 0x7fef54133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef5b8da700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef5409de50 0x7fef5409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef5b8da700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5406ef30 con 0x7fef5409e760 2023-10-03T10:15:32.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef5b8da700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5406fef0 con 0x7fef5409de50 2023-10-03T10:15:32.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef5b8da700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef541334b0 con 0x7fef541338a0 2023-10-03T10:15:32.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef58e75700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef5409de50 0x7fef5409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef59676700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef541338a0 0x7fef54133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef58e75700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef5409de50 0x7fef5409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55346/0 (socket says 172.21.15.72:55346) 2023-10-03T10:15:32.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef59676700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef541338a0 0x7fef54133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55164/0 (socket says 172.21.15.72:55164) 2023-10-03T10:15:32.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef58e75700 1 -- 172.21.15.72:0/4214394508 learned_addr learned my addr 172.21.15.72:0/4214394508 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:32.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef59676700 1 -- 172.21.15.72:0/4214394508 >> v2:172.21.15.72:3300/0 conn(0x7fef5409de50 msgr2=0x7fef5409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef59676700 1 --2- 172.21.15.72:0/4214394508 >> v2:172.21.15.72:3300/0 conn(0x7fef5409de50 0x7fef5409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef59676700 1 -- 172.21.15.72:0/4214394508 >> v1:172.21.15.72:6789/0 conn(0x7fef5409e760 legacy=0x7fef5413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef59676700 1 -- 172.21.15.72:0/4214394508 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5406fc30 con 0x7fef541338a0 2023-10-03T10:15:32.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef58e75700 1 --2- 172.21.15.72:0/4214394508 >> v2:172.21.15.72:3300/0 conn(0x7fef5409de50 0x7fef5409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef59676700 1 --2- 172.21.15.72:0/4214394508 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef541338a0 0x7fef54133c70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fef44009840 tx=0x7fef44009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cfcf6e07374efd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef4bfff700 1 -- 172.21.15.72:0/4214394508 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44011830 con 0x7fef541338a0 2023-10-03T10:15:32.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef4bfff700 1 -- 172.21.15.72:0/4214394508 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef44011990 con 0x7fef541338a0 2023-10-03T10:15:32.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.287+0000 7fef4bfff700 1 -- 172.21.15.72:0/4214394508 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44011d20 con 0x7fef541338a0 2023-10-03T10:15:32.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.288+0000 7fef5b8da700 1 -- 172.21.15.72:0/4214394508 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef541338a0 msgr2=0x7fef54133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.288+0000 7fef5b8da700 1 --2- 172.21.15.72:0/4214394508 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef541338a0 0x7fef54133c70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fef44009840 tx=0x7fef44009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:32.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.288+0000 7fef5b8da700 1 -- 172.21.15.72:0/4214394508 shutdown_connections 2023-10-03T10:15:32.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.288+0000 7fef5b8da700 1 --2- 172.21.15.72:0/4214394508 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef541338a0 0x7fef54133c70 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.288+0000 7fef5b8da700 1 --2- 172.21.15.72:0/4214394508 >> v2:172.21.15.72:3300/0 conn(0x7fef5409de50 0x7fef5409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.288+0000 7fef5b8da700 1 -- 172.21.15.72:0/4214394508 >> 172.21.15.72:0/4214394508 conn(0x7fef540a2aa0 msgr2=0x7fef540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.288+0000 7fef5b8da700 1 -- 172.21.15.72:0/4214394508 shutdown_connections 2023-10-03T10:15:32.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.288+0000 7fef5b8da700 1 -- 172.21.15.72:0/4214394508 wait complete. 2023-10-03T10:15:32.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.289+0000 7fef5b8da700 1 Processor -- start 2023-10-03T10:15:32.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.289+0000 7fef5b8da700 1 -- start start 2023-10-03T10:15:32.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef5b8da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef5409de50 0x7fef5411ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef5b8da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef5409e760 0x7fef5411f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef5b8da700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef541338a0 0x7fef5411f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef5b8da700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef54120830 con 0x7fef541338a0 2023-10-03T10:15:32.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef5b8da700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540a1000 con 0x7fef5409e760 2023-10-03T10:15:32.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef5b8da700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef5406f640 con 0x7fef5409de50 2023-10-03T10:15:32.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef59e77700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef541338a0 0x7fef5411f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef59676700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef5409de50 0x7fef5411ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef58e75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef5409e760 0x7fef5411f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef59676700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef5409de50 0x7fef5411ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55180/0 (socket says 172.21.15.72:55180) 2023-10-03T10:15:32.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef59e77700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef541338a0 0x7fef5411f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55358/0 (socket says 172.21.15.72:55358) 2023-10-03T10:15:32.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef59676700 1 -- 172.21.15.72:0/1589650527 learned_addr learned my addr 172.21.15.72:0/1589650527 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:32.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef58e75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef5409e760 0x7fef5411f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43456/0 (socket says 172.21.15.72:43456) 2023-10-03T10:15:32.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef59676700 1 -- 172.21.15.72:0/1589650527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef5409e760 msgr2=0x7fef5411f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef59676700 1 --2- 172.21.15.72:0/1589650527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef5409e760 0x7fef5411f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef59676700 1 -- 172.21.15.72:0/1589650527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef541338a0 msgr2=0x7fef5411f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef59676700 1 --2- 172.21.15.72:0/1589650527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef541338a0 0x7fef5411f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef59676700 1 -- 172.21.15.72:0/1589650527 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50009550 con 0x7fef5409de50 2023-10-03T10:15:32.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef59e77700 1 --2- 172.21.15.72:0/1589650527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef541338a0 0x7fef5411f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef58e75700 1 --2- 172.21.15.72:0/1589650527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef5409e760 0x7fef5411f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.290+0000 7fef59676700 1 --2- 172.21.15.72:0/1589650527 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef5409de50 0x7fef5411ec20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fef44009fd0 tx=0x7fef44004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.291+0000 7fef49ffb700 1 -- 172.21.15.72:0/1589650527 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef440036a0 con 0x7fef5409de50 2023-10-03T10:15:32.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.291+0000 7fef49ffb700 1 -- 172.21.15.72:0/1589650527 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4401f070 con 0x7fef5409de50 2023-10-03T10:15:32.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.291+0000 7fef5b8da700 1 -- 172.21.15.72:0/1589650527 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef440094a0 con 0x7fef5409de50 2023-10-03T10:15:32.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.291+0000 7fef49ffb700 1 -- 172.21.15.72:0/1589650527 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44003a60 con 0x7fef5409de50 2023-10-03T10:15:32.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.291+0000 7fef5b8da700 1 -- 172.21.15.72:0/1589650527 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5412f740 con 0x7fef5409de50 2023-10-03T10:15:32.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.291+0000 7fef49ffb700 1 -- 172.21.15.72:0/1589650527 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef44003bc0 con 0x7fef5409de50 2023-10-03T10:15:32.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.292+0000 7fef49ffb700 1 -- 172.21.15.72:0/1589650527 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef44021070 con 0x7fef5409de50 2023-10-03T10:15:32.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.292+0000 7fef5b8da700 1 -- 172.21.15.72:0/1589650527 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef54122100 con 0x7fef5409de50 2023-10-03T10:15:32.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.296+0000 7fef49ffb700 1 -- 172.21.15.72:0/1589650527 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef54122100 con 0x7fef5409de50 2023-10-03T10:15:32.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.480+0000 7fef5b8da700 1 -- 172.21.15.72:0/1589650527 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fef54122100 con 0x7fef5409de50 2023-10-03T10:15:32.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.480+0000 7fef49ffb700 1 -- 172.21.15.72:0/1589650527 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fef54122100 con 0x7fef5409de50 2023-10-03T10:15:32.481 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:32.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.482+0000 7fef5b8da700 1 -- 172.21.15.72:0/1589650527 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef5409de50 msgr2=0x7fef5411ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.482+0000 7fef5b8da700 1 --2- 172.21.15.72:0/1589650527 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef5409de50 0x7fef5411ec20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fef44009fd0 tx=0x7fef44004750 comp rx=0 tx=0).stop 2023-10-03T10:15:32.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.482+0000 7fef5b8da700 1 -- 172.21.15.72:0/1589650527 shutdown_connections 2023-10-03T10:15:32.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.482+0000 7fef5b8da700 1 --2- 172.21.15.72:0/1589650527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef541338a0 0x7fef5411f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.482+0000 7fef5b8da700 1 --2- 172.21.15.72:0/1589650527 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef5409de50 0x7fef5411ec20 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.482+0000 7fef5b8da700 1 --2- 172.21.15.72:0/1589650527 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef5409e760 0x7fef5411f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.482+0000 7fef5b8da700 1 -- 172.21.15.72:0/1589650527 >> 172.21.15.72:0/1589650527 conn(0x7fef540a2aa0 msgr2=0x7fef5409edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.482+0000 7fef5b8da700 1 -- 172.21.15.72:0/1589650527 shutdown_connections 2023-10-03T10:15:32.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.482+0000 7fef5b8da700 1 -- 172.21.15.72:0/1589650527 wait complete. 2023-10-03T10:15:32.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:32.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:32.628 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:32.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.682+0000 7f3924b33700 1 Processor -- start 2023-10-03T10:15:32.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.683+0000 7f3924b33700 1 -- start start 2023-10-03T10:15:32.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.683+0000 7f3924b33700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39200a0a30 0x7f39200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.683+0000 7f3924b33700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f392009d630 0x7f39200a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.683+0000 7f3924b33700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3920133930 0x7f3920133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.683+0000 7f3924b33700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39200a2a70 con 0x7f392009d630 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.683+0000 7f3924b33700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39200a01d0 con 0x7f3920133930 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.683+0000 7f3924b33700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f392009e2b0 con 0x7f39200a0a30 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.683+0000 7f391dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f392009d630 0x7f39200a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.683+0000 7f391e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39200a0a30 0x7f39200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.683+0000 7f391ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3920133930 0x7f3920133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.683+0000 7f391dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f392009d630 0x7f39200a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55368/0 (socket says 172.21.15.72:55368) 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.683+0000 7f391e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39200a0a30 0x7f39200a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55186/0 (socket says 172.21.15.72:55186) 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.683+0000 7f391dd9b700 1 -- 172.21.15.72:0/1578762248 learned_addr learned my addr 172.21.15.72:0/1578762248 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.684+0000 7f391e59c700 1 -- 172.21.15.72:0/1578762248 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3920133930 msgr2=0x7f3920133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.684+0000 7f391e59c700 1 --2- 172.21.15.72:0/1578762248 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3920133930 0x7f3920133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.684+0000 7f391e59c700 1 -- 172.21.15.72:0/1578762248 >> v2:172.21.15.72:3300/0 conn(0x7f392009d630 msgr2=0x7f39200a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.684+0000 7f391e59c700 1 --2- 172.21.15.72:0/1578762248 >> v2:172.21.15.72:3300/0 conn(0x7f392009d630 0x7f39200a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.684+0000 7f391e59c700 1 -- 172.21.15.72:0/1578762248 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392009dc50 con 0x7f39200a0a30 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.684+0000 7f391dd9b700 1 --2- 172.21.15.72:0/1578762248 >> v2:172.21.15.72:3300/0 conn(0x7f392009d630 0x7f39200a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.684+0000 7f391e59c700 1 --2- 172.21.15.72:0/1578762248 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39200a0a30 0x7f39200a0e00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3910009840 tx=0x7f3910009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68e888f8d150752f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.684+0000 7f391d59a700 1 -- 172.21.15.72:0/1578762248 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910011830 con 0x7f39200a0a30 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.684+0000 7f391d59a700 1 -- 172.21.15.72:0/1578762248 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3910011990 con 0x7f39200a0a30 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.684+0000 7f391d59a700 1 -- 172.21.15.72:0/1578762248 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910011d20 con 0x7f39200a0a30 2023-10-03T10:15:32.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.685+0000 7f3924b33700 1 -- 172.21.15.72:0/1578762248 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39200a0a30 msgr2=0x7f39200a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.685+0000 7f3924b33700 1 --2- 172.21.15.72:0/1578762248 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39200a0a30 0x7f39200a0e00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3910009840 tx=0x7f3910009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:32.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.685+0000 7f3924b33700 1 -- 172.21.15.72:0/1578762248 shutdown_connections 2023-10-03T10:15:32.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.685+0000 7f3924b33700 1 --2- 172.21.15.72:0/1578762248 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3920133930 0x7f3920133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.685+0000 7f3924b33700 1 --2- 172.21.15.72:0/1578762248 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39200a0a30 0x7f39200a0e00 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.685+0000 7f3924b33700 1 --2- 172.21.15.72:0/1578762248 >> v2:172.21.15.72:3300/0 conn(0x7f392009d630 0x7f39200a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.685+0000 7f3924b33700 1 -- 172.21.15.72:0/1578762248 >> 172.21.15.72:0/1578762248 conn(0x7f39200a3050 msgr2=0x7f39200a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.685+0000 7f3924b33700 1 -- 172.21.15.72:0/1578762248 shutdown_connections 2023-10-03T10:15:32.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.685+0000 7f3924b33700 1 -- 172.21.15.72:0/1578762248 wait complete. 2023-10-03T10:15:32.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.686+0000 7f3924b33700 1 Processor -- start 2023-10-03T10:15:32.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.686+0000 7f3924b33700 1 -- start start 2023-10-03T10:15:32.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.686+0000 7f3924b33700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f392009d630 0x7f392011f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.686+0000 7f3924b33700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39200a0a30 0x7f392011f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.686+0000 7f3924b33700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3920133930 0x7f39201c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.686+0000 7f3924b33700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392011ef70 con 0x7f3920133930 2023-10-03T10:15:32.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.686+0000 7f3924b33700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392011fdb0 con 0x7f39200a0a30 2023-10-03T10:15:32.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.686+0000 7f3924b33700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39200a0410 con 0x7f392009d630 2023-10-03T10:15:32.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.686+0000 7f391e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f392009d630 0x7f392011f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.686+0000 7f391dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39200a0a30 0x7f392011f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.686+0000 7f391e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f392009d630 0x7f392011f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55202/0 (socket says 172.21.15.72:55202) 2023-10-03T10:15:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.686+0000 7f391e59c700 1 -- 172.21.15.72:0/1150542329 learned_addr learned my addr 172.21.15.72:0/1150542329 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.686+0000 7f391ed9d700 1 --2- 172.21.15.72:0/1150542329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3920133930 0x7f39201c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.687+0000 7f391e59c700 1 -- 172.21.15.72:0/1150542329 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39200a0a30 msgr2=0x7f392011f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.687+0000 7f391e59c700 1 --2- 172.21.15.72:0/1150542329 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39200a0a30 0x7f392011f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.687+0000 7f391e59c700 1 -- 172.21.15.72:0/1150542329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3920133930 msgr2=0x7f39201c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.687+0000 7f391e59c700 1 --2- 172.21.15.72:0/1150542329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3920133930 0x7f39201c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.687+0000 7f391e59c700 1 -- 172.21.15.72:0/1150542329 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3914009550 con 0x7f392009d630 2023-10-03T10:15:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.687+0000 7f391dd9b700 1 --2- 172.21.15.72:0/1150542329 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39200a0a30 0x7f392011f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.687+0000 7f391e59c700 1 --2- 172.21.15.72:0/1150542329 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f392009d630 0x7f392011f330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f39100090b0 tx=0x7f3910004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.687+0000 7f390effd700 1 -- 172.21.15.72:0/1150542329 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910004450 con 0x7f392009d630 2023-10-03T10:15:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.687+0000 7f390effd700 1 -- 172.21.15.72:0/1150542329 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391001f070 con 0x7f392009d630 2023-10-03T10:15:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.687+0000 7f390effd700 1 -- 172.21.15.72:0/1150542329 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39100038e0 con 0x7f392009d630 2023-10-03T10:15:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.687+0000 7f3924b33700 1 -- 172.21.15.72:0/1150542329 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39100094a0 con 0x7f392009d630 2023-10-03T10:15:32.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.687+0000 7f3924b33700 1 -- 172.21.15.72:0/1150542329 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3920121ee0 con 0x7f392009d630 2023-10-03T10:15:32.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.688+0000 7f390effd700 1 -- 172.21.15.72:0/1150542329 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3910003a40 con 0x7f392009d630 2023-10-03T10:15:32.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.688+0000 7f3924b33700 1 -- 172.21.15.72:0/1150542329 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39200747f0 con 0x7f392009d630 2023-10-03T10:15:32.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.688+0000 7f390effd700 1 -- 172.21.15.72:0/1150542329 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3910021070 con 0x7f392009d630 2023-10-03T10:15:32.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.693+0000 7f390effd700 1 -- 172.21.15.72:0/1150542329 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39100253e0 con 0x7f392009d630 2023-10-03T10:15:32.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.753+0000 7fd59e09d700 1 Processor -- start 2023-10-03T10:15:32.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.753+0000 7fd59e09d700 1 -- start start 2023-10-03T10:15:32.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd59e09d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd59812cf60 0x7fd59806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd59e09d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd598130430 0x7fd598137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd59e09d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59812cd90 con 0x7fd59812f8b0 2023-10-03T10:15:32.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd59e09d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59812d330 con 0x7fd598130430 2023-10-03T10:15:32.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd59e09d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd598071780 con 0x7fd59812cf60 2023-10-03T10:15:32.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd597fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd598130430 0x7fd598137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd5977fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd59812cf60 0x7fd59806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd597fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd598130430 0x7fd598137c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55392/0 (socket says 172.21.15.72:55392) 2023-10-03T10:15:32.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd5977fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd59812cf60 0x7fd59806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55208/0 (socket says 172.21.15.72:55208) 2023-10-03T10:15:32.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd597fff700 1 -- 172.21.15.72:0/2873730245 learned_addr learned my addr 172.21.15.72:0/2873730245 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:32.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd5977fe700 1 -- 172.21.15.72:0/2873730245 >> v2:172.21.15.72:3300/0 conn(0x7fd598130430 msgr2=0x7fd598137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd5977fe700 1 --2- 172.21.15.72:0/2873730245 >> v2:172.21.15.72:3300/0 conn(0x7fd598130430 0x7fd598137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd5977fe700 1 -- 172.21.15.72:0/2873730245 >> v1:172.21.15.72:6789/0 conn(0x7fd59812f8b0 legacy=0x7fd59812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd5977fe700 1 -- 172.21.15.72:0/2873730245 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd598071a40 con 0x7fd59812cf60 2023-10-03T10:15:32.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd597fff700 1 --2- 172.21.15.72:0/2873730245 >> v2:172.21.15.72:3300/0 conn(0x7fd598130430 0x7fd598137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.754+0000 7fd5977fe700 1 --2- 172.21.15.72:0/2873730245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd59812cf60 0x7fd59806f5d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd588009d90 tx=0x7fd58800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a48be1c329200 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.755+0000 7fd5967fc700 1 -- 172.21.15.72:0/2873730245 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58800e070 con 0x7fd59812cf60 2023-10-03T10:15:32.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.755+0000 7fd5967fc700 1 -- 172.21.15.72:0/2873730245 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58800bb20 con 0x7fd59812cf60 2023-10-03T10:15:32.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.755+0000 7fd5967fc700 1 -- 172.21.15.72:0/2873730245 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588012430 con 0x7fd59812cf60 2023-10-03T10:15:32.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.755+0000 7fd59e09d700 1 -- 172.21.15.72:0/2873730245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd59812cf60 msgr2=0x7fd59806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.755+0000 7fd59e09d700 1 --2- 172.21.15.72:0/2873730245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd59812cf60 0x7fd59806f5d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd588009d90 tx=0x7fd58800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:32.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.755+0000 7fd59e09d700 1 -- 172.21.15.72:0/2873730245 shutdown_connections 2023-10-03T10:15:32.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.755+0000 7fd59e09d700 1 --2- 172.21.15.72:0/2873730245 >> v2:172.21.15.72:3300/0 conn(0x7fd598130430 0x7fd598137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.755+0000 7fd59e09d700 1 --2- 172.21.15.72:0/2873730245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd59812cf60 0x7fd59806f5d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.755+0000 7fd59e09d700 1 -- 172.21.15.72:0/2873730245 >> 172.21.15.72:0/2873730245 conn(0x7fd5980a2aa0 msgr2=0x7fd5980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.755+0000 7fd59e09d700 1 -- 172.21.15.72:0/2873730245 shutdown_connections 2023-10-03T10:15:32.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.755+0000 7fd59e09d700 1 -- 172.21.15.72:0/2873730245 wait complete. 2023-10-03T10:15:32.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.756+0000 7fd59e09d700 1 Processor -- start 2023-10-03T10:15:32.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.756+0000 7fd59e09d700 1 -- start start 2023-10-03T10:15:32.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd59e09d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd59812cf60 0x7fd598138de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd59e09d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd59812f8b0 0x7fd598139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd59e09d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd598130430 0x7fd5981c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd59e09d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59809b1b0 con 0x7fd59812f8b0 2023-10-03T10:15:32.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd59e09d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd598138a50 con 0x7fd598130430 2023-10-03T10:15:32.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd59e09d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5981377a0 con 0x7fd59812cf60 2023-10-03T10:15:32.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd5977fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd59812cf60 0x7fd598138de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd5977fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd59812cf60 0x7fd598138de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55212/0 (socket says 172.21.15.72:55212) 2023-10-03T10:15:32.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd5977fe700 1 -- 172.21.15.72:0/3942794172 learned_addr learned my addr 172.21.15.72:0/3942794172 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:32.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd596ffd700 1 --2- 172.21.15.72:0/3942794172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd59812f8b0 0x7fd598139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd597fff700 1 --2- 172.21.15.72:0/3942794172 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd598130430 0x7fd5981c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd5977fe700 1 -- 172.21.15.72:0/3942794172 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd598130430 msgr2=0x7fd5981c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd5977fe700 1 --2- 172.21.15.72:0/3942794172 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd598130430 0x7fd5981c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd5977fe700 1 -- 172.21.15.72:0/3942794172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd59812f8b0 msgr2=0x7fd598139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd5977fe700 1 --2- 172.21.15.72:0/3942794172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd59812f8b0 0x7fd598139320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd5977fe700 1 -- 172.21.15.72:0/3942794172 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590009550 con 0x7fd59812cf60 2023-10-03T10:15:32.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.757+0000 7fd5977fe700 1 --2- 172.21.15.72:0/3942794172 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd59812cf60 0x7fd598138de0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd59812d470 tx=0x7fd588004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.758+0000 7fd58ffff700 1 -- 172.21.15.72:0/3942794172 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588012430 con 0x7fd59812cf60 2023-10-03T10:15:32.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.758+0000 7fd58ffff700 1 -- 172.21.15.72:0/3942794172 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd588020070 con 0x7fd59812cf60 2023-10-03T10:15:32.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.758+0000 7fd59e09d700 1 -- 172.21.15.72:0/3942794172 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd588009a70 con 0x7fd59812cf60 2023-10-03T10:15:32.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.758+0000 7fd58ffff700 1 -- 172.21.15.72:0/3942794172 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588004280 con 0x7fd59812cf60 2023-10-03T10:15:32.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.758+0000 7fd59e09d700 1 -- 172.21.15.72:0/3942794172 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd598139c80 con 0x7fd59812cf60 2023-10-03T10:15:32.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.758+0000 7fd58ffff700 1 -- 172.21.15.72:0/3942794172 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5880043e0 con 0x7fd59812cf60 2023-10-03T10:15:32.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.759+0000 7fd58ffff700 1 -- 172.21.15.72:0/3942794172 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd588022070 con 0x7fd59812cf60 2023-10-03T10:15:32.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.759+0000 7fd59e09d700 1 -- 172.21.15.72:0/3942794172 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd598074ea0 con 0x7fd59812cf60 2023-10-03T10:15:32.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.763+0000 7fd58ffff700 1 -- 172.21.15.72:0/3942794172 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5880263e0 con 0x7fd59812cf60 2023-10-03T10:15:32.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:32.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.888+0000 7f3924b33700 1 -- 172.21.15.72:0/1150542329 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3920072980 con 0x7f392009d630 2023-10-03T10:15:32.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.888+0000 7f390effd700 1 -- 172.21.15.72:0/1150542329 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3910015030 con 0x7f392009d630 2023-10-03T10:15:32.889 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:32.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.890+0000 7f3924b33700 1 -- 172.21.15.72:0/1150542329 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f392009d630 msgr2=0x7f392011f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.890+0000 7f3924b33700 1 --2- 172.21.15.72:0/1150542329 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f392009d630 0x7f392011f330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f39100090b0 tx=0x7f3910004750 comp rx=0 tx=0).stop 2023-10-03T10:15:32.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.890+0000 7f3924b33700 1 -- 172.21.15.72:0/1150542329 shutdown_connections 2023-10-03T10:15:32.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.890+0000 7f3924b33700 1 --2- 172.21.15.72:0/1150542329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3920133930 0x7f39201c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.890+0000 7f3924b33700 1 --2- 172.21.15.72:0/1150542329 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f392009d630 0x7f392011f330 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.890+0000 7f3924b33700 1 --2- 172.21.15.72:0/1150542329 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39200a0a30 0x7f392011f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.890+0000 7f3924b33700 1 -- 172.21.15.72:0/1150542329 >> 172.21.15.72:0/1150542329 conn(0x7f39200a3050 msgr2=0x7f39201bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.890+0000 7f3924b33700 1 -- 172.21.15.72:0/1150542329 shutdown_connections 2023-10-03T10:15:32.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.890+0000 7f3924b33700 1 -- 172.21.15.72:0/1150542329 wait complete. 2023-10-03T10:15:32.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:32.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.960+0000 7fd59e09d700 1 -- 172.21.15.72:0/3942794172 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd59812b120 con 0x7fd59812cf60 2023-10-03T10:15:32.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.960+0000 7fd58ffff700 1 -- 172.21.15.72:0/3942794172 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd58801ab70 con 0x7fd59812cf60 2023-10-03T10:15:32.961 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:32.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.962+0000 7fd59e09d700 1 -- 172.21.15.72:0/3942794172 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd59812cf60 msgr2=0x7fd598138de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.962+0000 7fd59e09d700 1 --2- 172.21.15.72:0/3942794172 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd59812cf60 0x7fd598138de0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd59812d470 tx=0x7fd588004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.962+0000 7fd59e09d700 1 -- 172.21.15.72:0/3942794172 shutdown_connections 2023-10-03T10:15:32.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.962+0000 7fd59e09d700 1 --2- 172.21.15.72:0/3942794172 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd598130430 0x7fd5981c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.962+0000 7fd59e09d700 1 --2- 172.21.15.72:0/3942794172 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd59812cf60 0x7fd598138de0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.962+0000 7fd59e09d700 1 --2- 172.21.15.72:0/3942794172 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd59812f8b0 0x7fd598139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.962+0000 7fd59e09d700 1 -- 172.21.15.72:0/3942794172 >> 172.21.15.72:0/3942794172 conn(0x7fd5980a2aa0 msgr2=0x7fd59809e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.962+0000 7fd59e09d700 1 -- 172.21.15.72:0/3942794172 shutdown_connections 2023-10-03T10:15:32.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.962+0000 7fd59e09d700 1 -- 172.21.15.72:0/3942794172 wait complete. 2023-10-03T10:15:32.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:32.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.999+0000 7feb6fe4c700 1 Processor -- start 2023-10-03T10:15:32.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.999+0000 7feb6fe4c700 1 -- start start 2023-10-03T10:15:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.999+0000 7feb6fe4c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb6809e930 0x7feb6809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.999+0000 7feb6fe4c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb6809f240 0x7feb681317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.999+0000 7feb6fe4c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb68070940 con 0x7feb6809f650 2023-10-03T10:15:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.999+0000 7feb6fe4c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb6806fd60 con 0x7feb6809e930 2023-10-03T10:15:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:32.999+0000 7feb6fe4c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6806fa80 con 0x7feb6809f240 2023-10-03T10:15:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.000+0000 7feb6dbe8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb6809e930 0x7feb6809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.000+0000 7feb6d3e7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb6809f240 0x7feb681317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.000+0000 7feb6dbe8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb6809e930 0x7feb6809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55402/0 (socket says 172.21.15.72:55402) 2023-10-03T10:15:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.000+0000 7feb6d3e7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb6809f240 0x7feb681317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43478/0 (socket says 172.21.15.72:43478) 2023-10-03T10:15:33.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.000+0000 7feb6dbe8700 1 -- 172.21.15.72:0/639609858 learned_addr learned my addr 172.21.15.72:0/639609858 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.000+0000 7feb6d3e7700 1 -- 172.21.15.72:0/639609858 >> v2:172.21.15.72:3300/0 conn(0x7feb6809e930 msgr2=0x7feb6809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.000+0000 7feb6d3e7700 1 --2- 172.21.15.72:0/639609858 >> v2:172.21.15.72:3300/0 conn(0x7feb6809e930 0x7feb6809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.000+0000 7feb6d3e7700 1 -- 172.21.15.72:0/639609858 >> v1:172.21.15.72:6789/0 conn(0x7feb6809f650 legacy=0x7feb68131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.000+0000 7feb6d3e7700 1 -- 172.21.15.72:0/639609858 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6809fb60 con 0x7feb6809f240 2023-10-03T10:15:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.000+0000 7feb6dbe8700 1 --2- 172.21.15.72:0/639609858 >> v2:172.21.15.72:3300/0 conn(0x7feb6809e930 0x7feb6809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.000+0000 7feb6d3e7700 1 --2- 172.21.15.72:0/639609858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb6809f240 0x7feb681317f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7feb58009840 tx=0x7feb58009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c668e5d487f188ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.000+0000 7feb6cbe6700 1 -- 172.21.15.72:0/639609858 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58011830 con 0x7feb6809f240 2023-10-03T10:15:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.000+0000 7feb6cbe6700 1 -- 172.21.15.72:0/639609858 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb58011990 con 0x7feb6809f240 2023-10-03T10:15:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.000+0000 7feb6cbe6700 1 -- 172.21.15.72:0/639609858 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58011d20 con 0x7feb6809f240 2023-10-03T10:15:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.001+0000 7feb6fe4c700 1 -- 172.21.15.72:0/639609858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb6809f240 msgr2=0x7feb681317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.001+0000 7feb6fe4c700 1 --2- 172.21.15.72:0/639609858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb6809f240 0x7feb681317f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7feb58009840 tx=0x7feb58009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.001+0000 7feb6fe4c700 1 -- 172.21.15.72:0/639609858 shutdown_connections 2023-10-03T10:15:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.001+0000 7feb6fe4c700 1 --2- 172.21.15.72:0/639609858 >> v2:172.21.15.72:3300/0 conn(0x7feb6809e930 0x7feb6809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.001+0000 7feb6fe4c700 1 --2- 172.21.15.72:0/639609858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb6809f240 0x7feb681317f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.001+0000 7feb6fe4c700 1 -- 172.21.15.72:0/639609858 >> 172.21.15.72:0/639609858 conn(0x7feb680a4210 msgr2=0x7feb680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.001+0000 7feb6fe4c700 1 -- 172.21.15.72:0/639609858 shutdown_connections 2023-10-03T10:15:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.001+0000 7feb6fe4c700 1 -- 172.21.15.72:0/639609858 wait complete. 2023-10-03T10:15:33.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.002+0000 7feb6fe4c700 1 Processor -- start 2023-10-03T10:15:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.002+0000 7feb6fe4c700 1 -- start start 2023-10-03T10:15:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.002+0000 7feb6fe4c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb6809e930 0x7feb681a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.002+0000 7feb6fe4c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb6809f240 0x7feb681a6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.002+0000 7feb6fe4c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb6809f650 0x7feb681a6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.002+0000 7feb6fe4c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb681a71a0 con 0x7feb6809f240 2023-10-03T10:15:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.002+0000 7feb6fe4c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb681a78b0 con 0x7feb6809f650 2023-10-03T10:15:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.002+0000 7feb6fe4c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb681a7ed0 con 0x7feb6809e930 2023-10-03T10:15:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.002+0000 7feb6dbe8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb6809e930 0x7feb681a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.002+0000 7feb6e3e9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb6809f650 0x7feb681a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.002+0000 7feb6dbe8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb6809e930 0x7feb681a5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55214/0 (socket says 172.21.15.72:55214) 2023-10-03T10:15:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.002+0000 7feb6dbe8700 1 -- 172.21.15.72:0/3363804396 learned_addr learned my addr 172.21.15.72:0/3363804396 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.002+0000 7feb6d3e7700 1 --2- 172.21.15.72:0/3363804396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb6809f240 0x7feb681a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.003+0000 7feb6e3e9700 1 -- 172.21.15.72:0/3363804396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb6809e930 msgr2=0x7feb681a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.003+0000 7feb6e3e9700 1 --2- 172.21.15.72:0/3363804396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb6809e930 0x7feb681a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.003+0000 7feb6e3e9700 1 -- 172.21.15.72:0/3363804396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb6809f240 msgr2=0x7feb681a6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.003+0000 7feb6e3e9700 1 --2- 172.21.15.72:0/3363804396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb6809f240 0x7feb681a6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.003+0000 7feb6e3e9700 1 -- 172.21.15.72:0/3363804396 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb64009550 con 0x7feb6809f650 2023-10-03T10:15:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.003+0000 7feb6d3e7700 1 --2- 172.21.15.72:0/3363804396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb6809f240 0x7feb681a6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.003+0000 7feb6e3e9700 1 --2- 172.21.15.72:0/3363804396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb6809f650 0x7feb681a6770 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feb6000cb90 tx=0x7feb6000cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.003+0000 7feb5e7fc700 1 -- 172.21.15.72:0/3363804396 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb60003c00 con 0x7feb6809f650 2023-10-03T10:15:33.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.003+0000 7feb5e7fc700 1 -- 172.21.15.72:0/3363804396 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb60003d60 con 0x7feb6809f650 2023-10-03T10:15:33.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.003+0000 7feb6fe4c700 1 -- 172.21.15.72:0/3363804396 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb580094a0 con 0x7feb6809f650 2023-10-03T10:15:33.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.003+0000 7feb5e7fc700 1 -- 172.21.15.72:0/3363804396 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000aa80 con 0x7feb6809f650 2023-10-03T10:15:33.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.003+0000 7feb6fe4c700 1 -- 172.21.15.72:0/3363804396 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb680a0190 con 0x7feb6809f650 2023-10-03T10:15:33.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.004+0000 7feb5e7fc700 1 -- 172.21.15.72:0/3363804396 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb6000abe0 con 0x7feb6809f650 2023-10-03T10:15:33.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.004+0000 7feb5e7fc700 1 -- 172.21.15.72:0/3363804396 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feb6003f4e0 con 0x7feb6809f650 2023-10-03T10:15:33.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.004+0000 7feb6fe4c700 1 -- 172.21.15.72:0/3363804396 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb681a2b40 con 0x7feb6809f650 2023-10-03T10:15:33.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.009+0000 7feb5e7fc700 1 -- 172.21.15.72:0/3363804396 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb600050d0 con 0x7feb6809f650 2023-10-03T10:15:33.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.191+0000 7feb6fe4c700 1 -- 172.21.15.72:0/3363804396 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feb680a34f0 con 0x7feb6809f650 2023-10-03T10:15:33.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.192+0000 7feb5e7fc700 1 -- 172.21.15.72:0/3363804396 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb60011380 con 0x7feb6809f650 2023-10-03T10:15:33.193 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:33.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.194+0000 7feb6fe4c700 1 -- 172.21.15.72:0/3363804396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb6809f650 msgr2=0x7feb681a6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.194+0000 7feb6fe4c700 1 --2- 172.21.15.72:0/3363804396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb6809f650 0x7feb681a6770 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feb6000cb90 tx=0x7feb6000cea0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.194+0000 7feb6fe4c700 1 -- 172.21.15.72:0/3363804396 shutdown_connections 2023-10-03T10:15:33.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.194+0000 7feb6fe4c700 1 --2- 172.21.15.72:0/3363804396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb6809f650 0x7feb681a6770 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.194+0000 7feb6fe4c700 1 --2- 172.21.15.72:0/3363804396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb6809e930 0x7feb681a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.194+0000 7feb6fe4c700 1 --2- 172.21.15.72:0/3363804396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb6809f240 0x7feb681a6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.194+0000 7feb6fe4c700 1 -- 172.21.15.72:0/3363804396 >> 172.21.15.72:0/3363804396 conn(0x7feb680a4210 msgr2=0x7feb6809dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.194+0000 7feb6fe4c700 1 -- 172.21.15.72:0/3363804396 shutdown_connections 2023-10-03T10:15:33.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.194+0000 7feb6fe4c700 1 -- 172.21.15.72:0/3363804396 wait complete. 2023-10-03T10:15:33.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:33.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:33.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.619+0000 7fe737869700 1 Processor -- start 2023-10-03T10:15:33.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.619+0000 7fe737869700 1 -- start start 2023-10-03T10:15:33.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe737869700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe730130540 0x7fe730130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe737869700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe73006fcf0 0x7fe730138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe737869700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7300716a0 con 0x7fe730130e50 2023-10-03T10:15:33.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe737869700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73009a390 con 0x7fe73006fcf0 2023-10-03T10:15:33.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe737869700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe730071290 con 0x7fe730130540 2023-10-03T10:15:33.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe735e06700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe73006fcf0 0x7fe730138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe735605700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe730130540 0x7fe730130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe735e06700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe73006fcf0 0x7fe730138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55418/0 (socket says 172.21.15.72:55418) 2023-10-03T10:15:33.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe735e06700 1 -- 172.21.15.72:0/2041941825 learned_addr learned my addr 172.21.15.72:0/2041941825 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:33.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe735e06700 1 -- 172.21.15.72:0/2041941825 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe730130540 msgr2=0x7fe730130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:33.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe735e06700 1 --2- 172.21.15.72:0/2041941825 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe730130540 0x7fe730130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe735e06700 1 -- 172.21.15.72:0/2041941825 >> v1:172.21.15.72:6789/0 conn(0x7fe730130e50 legacy=0x7fe73006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe735e06700 1 -- 172.21.15.72:0/2041941825 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe730130340 con 0x7fe73006fcf0 2023-10-03T10:15:33.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe735605700 1 --2- 172.21.15.72:0/2041941825 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe730130540 0x7fe730130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:33.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe735e06700 1 --2- 172.21.15.72:0/2041941825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73006fcf0 0x7fe730138570 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe728009e50 tx=0x7fe72800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce90f8efe54fb3b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.620+0000 7fe727fff700 1 -- 172.21.15.72:0/2041941825 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72800e070 con 0x7fe73006fcf0 2023-10-03T10:15:33.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.621+0000 7fe727fff700 1 -- 172.21.15.72:0/2041941825 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72800b910 con 0x7fe73006fcf0 2023-10-03T10:15:33.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.621+0000 7fe727fff700 1 -- 172.21.15.72:0/2041941825 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72800bcc0 con 0x7fe73006fcf0 2023-10-03T10:15:33.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.621+0000 7fe737869700 1 -- 172.21.15.72:0/2041941825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73006fcf0 msgr2=0x7fe730138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.621+0000 7fe737869700 1 --2- 172.21.15.72:0/2041941825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73006fcf0 0x7fe730138570 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe728009e50 tx=0x7fe72800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:33.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.621+0000 7fe737869700 1 -- 172.21.15.72:0/2041941825 shutdown_connections 2023-10-03T10:15:33.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.621+0000 7fe737869700 1 --2- 172.21.15.72:0/2041941825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73006fcf0 0x7fe730138570 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.621+0000 7fe737869700 1 --2- 172.21.15.72:0/2041941825 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe730130540 0x7fe730130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.621+0000 7fe737869700 1 -- 172.21.15.72:0/2041941825 >> 172.21.15.72:0/2041941825 conn(0x7fe7300a2aa0 msgr2=0x7fe7300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.621+0000 7fe737869700 1 -- 172.21.15.72:0/2041941825 shutdown_connections 2023-10-03T10:15:33.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.621+0000 7fe737869700 1 -- 172.21.15.72:0/2041941825 wait complete. 2023-10-03T10:15:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.622+0000 7fe737869700 1 Processor -- start 2023-10-03T10:15:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.622+0000 7fe737869700 1 -- start start 2023-10-03T10:15:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.622+0000 7fe737869700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73006fcf0 0x7fe73011a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.622+0000 7fe737869700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe730130540 0x7fe73011ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.622+0000 7fe737869700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe730130e50 0x7fe73011b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.622+0000 7fe737869700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7300a0bc0 con 0x7fe730130e50 2023-10-03T10:15:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.622+0000 7fe737869700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73011db60 con 0x7fe73006fcf0 2023-10-03T10:15:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.622+0000 7fe737869700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe73011c300 con 0x7fe730130540 2023-10-03T10:15:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe735e06700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe730130e50 0x7fe73011b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe734e04700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe730130540 0x7fe73011ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe735605700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73006fcf0 0x7fe73011a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:33.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe735e06700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe730130e50 0x7fe73011b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55430/0 (socket says 172.21.15.72:55430) 2023-10-03T10:15:33.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe735e06700 1 -- 172.21.15.72:0/630075781 learned_addr learned my addr 172.21.15.72:0/630075781 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:33.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe735e06700 1 -- 172.21.15.72:0/630075781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe730130540 msgr2=0x7fe73011ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe735e06700 1 --2- 172.21.15.72:0/630075781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe730130540 0x7fe73011ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe735e06700 1 -- 172.21.15.72:0/630075781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73006fcf0 msgr2=0x7fe73011a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe735e06700 1 --2- 172.21.15.72:0/630075781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73006fcf0 0x7fe73011a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe735e06700 1 -- 172.21.15.72:0/630075781 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7200094a0 con 0x7fe730130e50 2023-10-03T10:15:33.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe734e04700 1 --2- 172.21.15.72:0/630075781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe730130540 0x7fe73011ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:33.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe735e06700 1 --2- 172.21.15.72:0/630075781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe730130e50 0x7fe73011b1b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe728004270 tx=0x7fe728004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:33.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe725ffb700 1 -- 172.21.15.72:0/630075781 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7280048e0 con 0x7fe730130e50 2023-10-03T10:15:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe725ffb700 1 -- 172.21.15.72:0/630075781 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7280092e0 con 0x7fe730130e50 2023-10-03T10:15:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe737869700 1 -- 172.21.15.72:0/630075781 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe728009b30 con 0x7fe730130e50 2023-10-03T10:15:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe725ffb700 1 -- 172.21.15.72:0/630075781 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72801c660 con 0x7fe730130e50 2023-10-03T10:15:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.623+0000 7fe737869700 1 -- 172.21.15.72:0/630075781 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73011cff0 con 0x7fe730130e50 2023-10-03T10:15:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.624+0000 7fe725ffb700 1 -- 172.21.15.72:0/630075781 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe72801c7c0 con 0x7fe730130e50 2023-10-03T10:15:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.624+0000 7fe725ffb700 1 -- 172.21.15.72:0/630075781 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe728041190 con 0x7fe730130e50 2023-10-03T10:15:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.625+0000 7fe737869700 1 -- 172.21.15.72:0/630075781 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73009cd40 con 0x7fe730130e50 2023-10-03T10:15:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.629+0000 7fe725ffb700 1 -- 172.21.15.72:0/630075781 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7280257d0 con 0x7fe730130e50 2023-10-03T10:15:33.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.812+0000 7fe737869700 1 -- 172.21.15.72:0/630075781 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe730074ea0 con 0x7fe730130e50 2023-10-03T10:15:33.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.813+0000 7fe725ffb700 1 -- 172.21.15.72:0/630075781 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe72802d960 con 0x7fe730130e50 2023-10-03T10:15:33.814 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:33.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.815+0000 7fe737869700 1 -- 172.21.15.72:0/630075781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe730130e50 msgr2=0x7fe73011b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.815+0000 7fe737869700 1 --2- 172.21.15.72:0/630075781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe730130e50 0x7fe73011b1b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe728004270 tx=0x7fe728004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.815+0000 7fe737869700 1 -- 172.21.15.72:0/630075781 shutdown_connections 2023-10-03T10:15:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.815+0000 7fe737869700 1 --2- 172.21.15.72:0/630075781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe730130e50 0x7fe73011b1b0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.815+0000 7fe737869700 1 --2- 172.21.15.72:0/630075781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73006fcf0 0x7fe73011a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.815+0000 7fe737869700 1 --2- 172.21.15.72:0/630075781 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe730130540 0x7fe73011ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.815+0000 7fe737869700 1 -- 172.21.15.72:0/630075781 >> 172.21.15.72:0/630075781 conn(0x7fe7300a2aa0 msgr2=0x7fe73012d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.815+0000 7fe737869700 1 -- 172.21.15.72:0/630075781 shutdown_connections 2023-10-03T10:15:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:33.815+0000 7fe737869700 1 -- 172.21.15.72:0/630075781 wait complete. 2023-10-03T10:15:33.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:33.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:33.976 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:34.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.032+0000 7f2bf5604700 1 Processor -- start 2023-10-03T10:15:34.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.032+0000 7f2bf5604700 1 -- start start 2023-10-03T10:15:34.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.032+0000 7f2bf5604700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2bf009eb30 0x7f2bf009ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.032+0000 7f2bf5604700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bf0133ed0 0x7f2bf013ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2bf5604700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf009dc70 con 0x7f2bf009f440 2023-10-03T10:15:34.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2bf5604700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf00a25d0 con 0x7f2bf009eb30 2023-10-03T10:15:34.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2bf5604700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf00a2780 con 0x7f2bf0133ed0 2023-10-03T10:15:34.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2beeffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2bf009eb30 0x7f2bf009ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2bef7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bf0133ed0 0x7f2bf013ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2bef7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bf0133ed0 0x7f2bf013ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43498/0 (socket says 172.21.15.72:43498) 2023-10-03T10:15:34.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2beeffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2bf009eb30 0x7f2bf009ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55440/0 (socket says 172.21.15.72:55440) 2023-10-03T10:15:34.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2bef7fe700 1 -- 172.21.15.72:0/655196293 learned_addr learned my addr 172.21.15.72:0/655196293 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:34.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2bef7fe700 1 -- 172.21.15.72:0/655196293 >> v2:172.21.15.72:3300/0 conn(0x7f2bf009eb30 msgr2=0x7f2bf009ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2bef7fe700 1 --2- 172.21.15.72:0/655196293 >> v2:172.21.15.72:3300/0 conn(0x7f2bf009eb30 0x7f2bf009ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2bef7fe700 1 -- 172.21.15.72:0/655196293 >> v1:172.21.15.72:6789/0 conn(0x7f2bf009f440 legacy=0x7f2bf01337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2bef7fe700 1 -- 172.21.15.72:0/655196293 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf00a1dc0 con 0x7f2bf0133ed0 2023-10-03T10:15:34.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2beeffd700 1 --2- 172.21.15.72:0/655196293 >> v2:172.21.15.72:3300/0 conn(0x7f2bf009eb30 0x7f2bf009ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2bef7fe700 1 --2- 172.21.15.72:0/655196293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bf0133ed0 0x7f2bf013ba20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009e50 tx=0x7f2be800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c614a9add4f3d58 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2bedffb700 1 -- 172.21.15.72:0/655196293 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be800e070 con 0x7f2bf0133ed0 2023-10-03T10:15:34.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2bedffb700 1 -- 172.21.15.72:0/655196293 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be800b910 con 0x7f2bf0133ed0 2023-10-03T10:15:34.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.033+0000 7f2bedffb700 1 -- 172.21.15.72:0/655196293 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be800bcc0 con 0x7f2bf0133ed0 2023-10-03T10:15:34.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.034+0000 7f2bf5604700 1 -- 172.21.15.72:0/655196293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bf0133ed0 msgr2=0x7f2bf013ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.034+0000 7f2bf5604700 1 --2- 172.21.15.72:0/655196293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bf0133ed0 0x7f2bf013ba20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009e50 tx=0x7f2be800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.034+0000 7f2bf5604700 1 -- 172.21.15.72:0/655196293 shutdown_connections 2023-10-03T10:15:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.034+0000 7f2bf5604700 1 --2- 172.21.15.72:0/655196293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bf0133ed0 0x7f2bf013ba20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.034+0000 7f2bf5604700 1 --2- 172.21.15.72:0/655196293 >> v2:172.21.15.72:3300/0 conn(0x7f2bf009eb30 0x7f2bf009ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.034+0000 7f2bf5604700 1 -- 172.21.15.72:0/655196293 >> 172.21.15.72:0/655196293 conn(0x7f2bf00a6400 msgr2=0x7f2bf00a6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.034+0000 7f2bf5604700 1 -- 172.21.15.72:0/655196293 shutdown_connections 2023-10-03T10:15:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.034+0000 7f2bf5604700 1 -- 172.21.15.72:0/655196293 wait complete. 2023-10-03T10:15:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.035+0000 7f2bf5604700 1 Processor -- start 2023-10-03T10:15:34.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.035+0000 7f2bf5604700 1 -- start start 2023-10-03T10:15:34.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bf5604700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bf009eb30 0x7f2bf0120ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bf5604700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf009f440 0x7f2bf0121530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bf5604700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bf0133ed0 0x7f2bf0121a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bf5604700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf0122c00 con 0x7f2bf009f440 2023-10-03T10:15:34.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bf5604700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf0123a90 con 0x7f2bf009eb30 2023-10-03T10:15:34.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bf5604700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf0124570 con 0x7f2bf0133ed0 2023-10-03T10:15:34.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bef7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bf0133ed0 0x7f2bf0121a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bee7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf009f440 0x7f2bf0121530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bef7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bf0133ed0 0x7f2bf0121a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55238/0 (socket says 172.21.15.72:55238) 2023-10-03T10:15:34.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bef7fe700 1 -- 172.21.15.72:0/2685186081 learned_addr learned my addr 172.21.15.72:0/2685186081 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:34.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2beeffd700 1 --2- 172.21.15.72:0/2685186081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bf009eb30 0x7f2bf0120ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bef7fe700 1 -- 172.21.15.72:0/2685186081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bf009eb30 msgr2=0x7f2bf0120ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bef7fe700 1 --2- 172.21.15.72:0/2685186081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bf009eb30 0x7f2bf0120ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bef7fe700 1 -- 172.21.15.72:0/2685186081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf009f440 msgr2=0x7f2bf0121530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bef7fe700 1 --2- 172.21.15.72:0/2685186081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf009f440 0x7f2bf0121530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bef7fe700 1 -- 172.21.15.72:0/2685186081 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be00094a0 con 0x7f2bf0133ed0 2023-10-03T10:15:34.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.036+0000 7f2bee7fc700 1 --2- 172.21.15.72:0/2685186081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf009f440 0x7f2bf0121530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.037+0000 7f2bef7fe700 1 --2- 172.21.15.72:0/2685186081 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bf0133ed0 0x7f2bf0121a70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00a28c0 tx=0x7f2be8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.037+0000 7f2bd77fe700 1 -- 172.21.15.72:0/2685186081 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be8003ea0 con 0x7f2bf0133ed0 2023-10-03T10:15:34.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.037+0000 7f2bd77fe700 1 -- 172.21.15.72:0/2685186081 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be80048e0 con 0x7f2bf0133ed0 2023-10-03T10:15:34.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.037+0000 7f2bd77fe700 1 -- 172.21.15.72:0/2685186081 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be801c680 con 0x7f2bf0133ed0 2023-10-03T10:15:34.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.037+0000 7f2bf5604700 1 -- 172.21.15.72:0/2685186081 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be8009b30 con 0x7f2bf0133ed0 2023-10-03T10:15:34.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.037+0000 7f2bf5604700 1 -- 172.21.15.72:0/2685186081 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf009cec0 con 0x7f2bf0133ed0 2023-10-03T10:15:34.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.037+0000 7f2bd77fe700 1 -- 172.21.15.72:0/2685186081 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2be801c7e0 con 0x7f2bf0133ed0 2023-10-03T10:15:34.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.038+0000 7f2bd77fe700 1 -- 172.21.15.72:0/2685186081 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2be80414a0 con 0x7f2bf0133ed0 2023-10-03T10:15:34.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.038+0000 7f2bd57fa700 1 -- 172.21.15.72:0/2685186081 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc80052e0 con 0x7f2bf0133ed0 2023-10-03T10:15:34.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.042+0000 7f2bd77fe700 1 -- 172.21.15.72:0/2685186081 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2be80257d0 con 0x7f2bf0133ed0 2023-10-03T10:15:34.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.102+0000 7fd224d7a700 1 Processor -- start 2023-10-03T10:15:34.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.103+0000 7fd224d7a700 1 -- start start 2023-10-03T10:15:34.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.103+0000 7fd224d7a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd22012cf60 0x7fd22006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.103+0000 7fd224d7a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd22012f8b0 0x7fd22012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.103+0000 7fd224d7a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22012cd90 con 0x7fd220130260 2023-10-03T10:15:34.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.103+0000 7fd224d7a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22012d330 con 0x7fd22012cf60 2023-10-03T10:15:34.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.103+0000 7fd224d7a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2201306d0 con 0x7fd22012f8b0 2023-10-03T10:15:34.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.103+0000 7fd21e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd22012cf60 0x7fd22006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.103+0000 7fd21dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd22012f8b0 0x7fd22012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.103+0000 7fd21dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd22012f8b0 0x7fd22012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43520/0 (socket says 172.21.15.72:43520) 2023-10-03T10:15:34.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.103+0000 7fd21dd9b700 1 -- 172.21.15.72:0/2818594122 learned_addr learned my addr 172.21.15.72:0/2818594122 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:34.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.103+0000 7fd21e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd22012cf60 0x7fd22006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55470/0 (socket says 172.21.15.72:55470) 2023-10-03T10:15:34.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.104+0000 7fd21dd9b700 1 -- 172.21.15.72:0/2818594122 >> v2:172.21.15.72:3300/0 conn(0x7fd22012cf60 msgr2=0x7fd22006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.104+0000 7fd21dd9b700 1 --2- 172.21.15.72:0/2818594122 >> v2:172.21.15.72:3300/0 conn(0x7fd22012cf60 0x7fd22006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.104+0000 7fd21dd9b700 1 -- 172.21.15.72:0/2818594122 >> v1:172.21.15.72:6789/0 conn(0x7fd220130260 legacy=0x7fd220136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.104+0000 7fd21dd9b700 1 -- 172.21.15.72:0/2818594122 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd220071780 con 0x7fd22012f8b0 2023-10-03T10:15:34.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.104+0000 7fd21dd9b700 1 --2- 172.21.15.72:0/2818594122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd22012f8b0 0x7fd22012fd20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd2100098f0 tx=0x7fd210009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea18402513d93bf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.104+0000 7fd21d59a700 1 -- 172.21.15.72:0/2818594122 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd210011830 con 0x7fd22012f8b0 2023-10-03T10:15:34.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.104+0000 7fd21d59a700 1 -- 172.21.15.72:0/2818594122 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd210011990 con 0x7fd22012f8b0 2023-10-03T10:15:34.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.104+0000 7fd21d59a700 1 -- 172.21.15.72:0/2818594122 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd210011d20 con 0x7fd22012f8b0 2023-10-03T10:15:34.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.104+0000 7fd224d7a700 1 -- 172.21.15.72:0/2818594122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd22012f8b0 msgr2=0x7fd22012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.104+0000 7fd224d7a700 1 --2- 172.21.15.72:0/2818594122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd22012f8b0 0x7fd22012fd20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd2100098f0 tx=0x7fd210009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:34.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.105+0000 7fd224d7a700 1 -- 172.21.15.72:0/2818594122 shutdown_connections 2023-10-03T10:15:34.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.105+0000 7fd224d7a700 1 --2- 172.21.15.72:0/2818594122 >> v2:172.21.15.72:3300/0 conn(0x7fd22012cf60 0x7fd22006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.105+0000 7fd224d7a700 1 --2- 172.21.15.72:0/2818594122 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd22012f8b0 0x7fd22012fd20 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.105+0000 7fd224d7a700 1 -- 172.21.15.72:0/2818594122 >> 172.21.15.72:0/2818594122 conn(0x7fd2200a2aa0 msgr2=0x7fd2200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.105+0000 7fd224d7a700 1 -- 172.21.15.72:0/2818594122 shutdown_connections 2023-10-03T10:15:34.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.105+0000 7fd224d7a700 1 -- 172.21.15.72:0/2818594122 wait complete. 2023-10-03T10:15:34.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.106+0000 7fd224d7a700 1 Processor -- start 2023-10-03T10:15:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.106+0000 7fd224d7a700 1 -- start start 2023-10-03T10:15:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.106+0000 7fd224d7a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd22012cf60 0x7fd22013a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.106+0000 7fd224d7a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd22012f8b0 0x7fd22013a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.106+0000 7fd224d7a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd220130260 0x7fd22013aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.106+0000 7fd224d7a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd220135120 con 0x7fd22012f8b0 2023-10-03T10:15:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.106+0000 7fd224d7a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd220136210 con 0x7fd22012cf60 2023-10-03T10:15:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.106+0000 7fd224d7a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd22012f520 con 0x7fd220130260 2023-10-03T10:15:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.106+0000 7fd21e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd22012cf60 0x7fd22013a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.106+0000 7fd21dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd22012f8b0 0x7fd22013a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.106+0000 7fd21e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd22012cf60 0x7fd22013a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43534/0 (socket says 172.21.15.72:43534) 2023-10-03T10:15:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.106+0000 7fd21dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd22012f8b0 0x7fd22013a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55484/0 (socket says 172.21.15.72:55484) 2023-10-03T10:15:34.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.106+0000 7fd21e59c700 1 -- 172.21.15.72:0/2485078516 learned_addr learned my addr 172.21.15.72:0/2485078516 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.106+0000 7fd21ed9d700 1 --2- 172.21.15.72:0/2485078516 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd220130260 0x7fd22013aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.107+0000 7fd21e59c700 1 -- 172.21.15.72:0/2485078516 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd220130260 msgr2=0x7fd22013aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.107+0000 7fd21e59c700 1 --2- 172.21.15.72:0/2485078516 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd220130260 0x7fd22013aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.107+0000 7fd21e59c700 1 -- 172.21.15.72:0/2485078516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd22012f8b0 msgr2=0x7fd22013a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.107+0000 7fd21e59c700 1 --2- 172.21.15.72:0/2485078516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd22012f8b0 0x7fd22013a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.107+0000 7fd21e59c700 1 -- 172.21.15.72:0/2485078516 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd210009550 con 0x7fd22012cf60 2023-10-03T10:15:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.107+0000 7fd21dd9b700 1 --2- 172.21.15.72:0/2485078516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd22012f8b0 0x7fd22013a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.107+0000 7fd21e59c700 1 --2- 172.21.15.72:0/2485078516 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd22012cf60 0x7fd22013a460 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd21400e9b0 tx=0x7fd21400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.107+0000 7fd20effd700 1 -- 172.21.15.72:0/2485078516 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214009710 con 0x7fd22012cf60 2023-10-03T10:15:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.107+0000 7fd20effd700 1 -- 172.21.15.72:0/2485078516 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21400ee50 con 0x7fd22012cf60 2023-10-03T10:15:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.107+0000 7fd224d7a700 1 -- 172.21.15.72:0/2485078516 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2201353b0 con 0x7fd22012cf60 2023-10-03T10:15:34.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.107+0000 7fd20effd700 1 -- 172.21.15.72:0/2485078516 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21400ca50 con 0x7fd22012cf60 2023-10-03T10:15:34.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.107+0000 7fd224d7a700 1 -- 172.21.15.72:0/2485078516 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22009e0f0 con 0x7fd22012cf60 2023-10-03T10:15:34.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.108+0000 7fd20effd700 1 -- 172.21.15.72:0/2485078516 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd21400cbb0 con 0x7fd22012cf60 2023-10-03T10:15:34.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.108+0000 7fd20effd700 1 -- 172.21.15.72:0/2485078516 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd21403f750 con 0x7fd22012cf60 2023-10-03T10:15:34.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.108+0000 7fd224d7a700 1 -- 172.21.15.72:0/2485078516 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd220074ea0 con 0x7fd22012cf60 2023-10-03T10:15:34.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.113+0000 7fd20effd700 1 -- 172.21.15.72:0/2485078516 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd214021020 con 0x7fd22012cf60 2023-10-03T10:15:34.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:34.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.239+0000 7f2bd57fa700 1 -- 172.21.15.72:0/2685186081 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2bc8005590 con 0x7f2bf0133ed0 2023-10-03T10:15:34.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.239+0000 7f2bd77fe700 1 -- 172.21.15.72:0/2685186081 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2be8011b80 con 0x7f2bf0133ed0 2023-10-03T10:15:34.240 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:34.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.241+0000 7f2bd57fa700 1 -- 172.21.15.72:0/2685186081 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bf0133ed0 msgr2=0x7f2bf0121a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.241+0000 7f2bd57fa700 1 --2- 172.21.15.72:0/2685186081 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bf0133ed0 0x7f2bf0121a70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00a28c0 tx=0x7f2be8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.241+0000 7f2bd57fa700 1 -- 172.21.15.72:0/2685186081 shutdown_connections 2023-10-03T10:15:34.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.241+0000 7f2bd57fa700 1 --2- 172.21.15.72:0/2685186081 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bf0133ed0 0x7f2bf0121a70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.241+0000 7f2bd57fa700 1 --2- 172.21.15.72:0/2685186081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bf009eb30 0x7f2bf0120ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.241+0000 7f2bd57fa700 1 --2- 172.21.15.72:0/2685186081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf009f440 0x7f2bf0121530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.241+0000 7f2bd57fa700 1 -- 172.21.15.72:0/2685186081 >> 172.21.15.72:0/2685186081 conn(0x7f2bf00a6400 msgr2=0x7f2bf009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.242+0000 7f2bd57fa700 1 -- 172.21.15.72:0/2685186081 shutdown_connections 2023-10-03T10:15:34.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.242+0000 7f2bd57fa700 1 -- 172.21.15.72:0/2685186081 wait complete. 2023-10-03T10:15:34.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:34.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.311+0000 7fd224d7a700 1 -- 172.21.15.72:0/2485078516 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd2200713a0 con 0x7fd22012cf60 2023-10-03T10:15:34.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.311+0000 7fd20effd700 1 -- 172.21.15.72:0/2485078516 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd21401be10 con 0x7fd22012cf60 2023-10-03T10:15:34.312 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.314+0000 7fd224d7a700 1 -- 172.21.15.72:0/2485078516 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd22012cf60 msgr2=0x7fd22013a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.314+0000 7fd224d7a700 1 --2- 172.21.15.72:0/2485078516 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd22012cf60 0x7fd22013a460 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd21400e9b0 tx=0x7fd21400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.314+0000 7fd224d7a700 1 -- 172.21.15.72:0/2485078516 shutdown_connections 2023-10-03T10:15:34.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.314+0000 7fd224d7a700 1 --2- 172.21.15.72:0/2485078516 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd220130260 0x7fd22013aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.314+0000 7fd224d7a700 1 --2- 172.21.15.72:0/2485078516 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd22012cf60 0x7fd22013a460 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.314+0000 7fd224d7a700 1 --2- 172.21.15.72:0/2485078516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd22012f8b0 0x7fd22013a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.314+0000 7fd224d7a700 1 -- 172.21.15.72:0/2485078516 >> 172.21.15.72:0/2485078516 conn(0x7fd2200a2aa0 msgr2=0x7fd22006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.314+0000 7fd224d7a700 1 -- 172.21.15.72:0/2485078516 shutdown_connections 2023-10-03T10:15:34.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.315+0000 7fd224d7a700 1 -- 172.21.15.72:0/2485078516 wait complete. 2023-10-03T10:15:34.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:34.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.340+0000 7f4d4529d700 1 Processor -- start 2023-10-03T10:15:34.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.340+0000 7f4d4529d700 1 -- start start 2023-10-03T10:15:34.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.340+0000 7f4d4529d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4d4009c650 0x7f4d4009ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.340+0000 7f4d4529d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d400a0090 0x7f4d4009cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.340+0000 7f4d4529d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4009ba70 con 0x7f4d40131970 2023-10-03T10:15:34.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.340+0000 7f4d4529d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4009d4a0 con 0x7f4d4009c650 2023-10-03T10:15:34.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.340+0000 7f4d4529d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4009e8f0 con 0x7f4d400a0090 2023-10-03T10:15:34.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.341+0000 7f4d3e7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d400a0090 0x7f4d4009cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.341+0000 7f4d3effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4d4009c650 0x7f4d4009ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.341+0000 7f4d3e7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d400a0090 0x7f4d4009cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55258/0 (socket says 172.21.15.72:55258) 2023-10-03T10:15:34.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.341+0000 7f4d3e7fc700 1 -- 172.21.15.72:0/1309461245 learned_addr learned my addr 172.21.15.72:0/1309461245 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:34.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.341+0000 7f4d3effd700 1 -- 172.21.15.72:0/1309461245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d400a0090 msgr2=0x7f4d4009cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.341+0000 7f4d3effd700 1 --2- 172.21.15.72:0/1309461245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d400a0090 0x7f4d4009cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.341+0000 7f4d3effd700 1 -- 172.21.15.72:0/1309461245 >> v1:172.21.15.72:6789/0 conn(0x7f4d40131970 legacy=0x7f4d40131db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.341+0000 7f4d3effd700 1 -- 172.21.15.72:0/1309461245 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d400a0760 con 0x7f4d4009c650 2023-10-03T10:15:34.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.341+0000 7f4d3e7fc700 1 --2- 172.21.15.72:0/1309461245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d400a0090 0x7f4d4009cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.341+0000 7f4d3effd700 1 --2- 172.21.15.72:0/1309461245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d4009c650 0x7f4d4009ca20 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009840 tx=0x7f4d34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0f6958d360d577 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.341+0000 7f4d3dffb700 1 -- 172.21.15.72:0/1309461245 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34011830 con 0x7f4d4009c650 2023-10-03T10:15:34.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.341+0000 7f4d3dffb700 1 -- 172.21.15.72:0/1309461245 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d34011990 con 0x7f4d4009c650 2023-10-03T10:15:34.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.341+0000 7f4d3dffb700 1 -- 172.21.15.72:0/1309461245 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34011d20 con 0x7f4d4009c650 2023-10-03T10:15:34.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.342+0000 7f4d4529d700 1 -- 172.21.15.72:0/1309461245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d4009c650 msgr2=0x7f4d4009ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.342+0000 7f4d4529d700 1 --2- 172.21.15.72:0/1309461245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d4009c650 0x7f4d4009ca20 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009840 tx=0x7f4d34009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:34.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.342+0000 7f4d4529d700 1 -- 172.21.15.72:0/1309461245 shutdown_connections 2023-10-03T10:15:34.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.342+0000 7f4d4529d700 1 --2- 172.21.15.72:0/1309461245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d4009c650 0x7f4d4009ca20 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.342+0000 7f4d4529d700 1 --2- 172.21.15.72:0/1309461245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d400a0090 0x7f4d4009cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.342+0000 7f4d4529d700 1 -- 172.21.15.72:0/1309461245 >> 172.21.15.72:0/1309461245 conn(0x7f4d400a3f70 msgr2=0x7f4d400a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.342+0000 7f4d4529d700 1 -- 172.21.15.72:0/1309461245 shutdown_connections 2023-10-03T10:15:34.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.342+0000 7f4d4529d700 1 -- 172.21.15.72:0/1309461245 wait complete. 2023-10-03T10:15:34.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.343+0000 7f4d4529d700 1 Processor -- start 2023-10-03T10:15:34.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.343+0000 7f4d4529d700 1 -- start start 2023-10-03T10:15:34.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.343+0000 7f4d4529d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d4009c650 0x7f4d4006b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.343+0000 7f4d4529d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d400a0090 0x7f4d4006bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.343+0000 7f4d4529d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d40131970 0x7f4d4006c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.343+0000 7f4d4529d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4012fff0 con 0x7f4d4009c650 2023-10-03T10:15:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.343+0000 7f4d4529d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d40071320 con 0x7f4d400a0090 2023-10-03T10:15:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.343+0000 7f4d4529d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4006ce50 con 0x7f4d40131970 2023-10-03T10:15:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.343+0000 7f4d3effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d4009c650 0x7f4d4006b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.343+0000 7f4d3effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d4009c650 0x7f4d4006b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55500/0 (socket says 172.21.15.72:55500) 2023-10-03T10:15:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.343+0000 7f4d3e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d400a0090 0x7f4d4006bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.343+0000 7f4d3effd700 1 -- 172.21.15.72:0/803333096 learned_addr learned my addr 172.21.15.72:0/803333096 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.343+0000 7f4d3f7fe700 1 --2- 172.21.15.72:0/803333096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d40131970 0x7f4d4006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.344+0000 7f4d3effd700 1 -- 172.21.15.72:0/803333096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d40131970 msgr2=0x7f4d4006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.344+0000 7f4d3effd700 1 --2- 172.21.15.72:0/803333096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d40131970 0x7f4d4006c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.344+0000 7f4d3effd700 1 -- 172.21.15.72:0/803333096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d400a0090 msgr2=0x7f4d4006bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.344+0000 7f4d3effd700 1 --2- 172.21.15.72:0/803333096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d400a0090 0x7f4d4006bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.344+0000 7f4d3effd700 1 -- 172.21.15.72:0/803333096 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d30009550 con 0x7f4d4009c650 2023-10-03T10:15:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.344+0000 7f4d3f7fe700 1 --2- 172.21.15.72:0/803333096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d40131970 0x7f4d4006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.344+0000 7f4d3e7fc700 1 --2- 172.21.15.72:0/803333096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d400a0090 0x7f4d4006bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.344+0000 7f4d3effd700 1 --2- 172.21.15.72:0/803333096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d4009c650 0x7f4d4006b880 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4d340090b0 tx=0x7f4d34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.344+0000 7f4d277fe700 1 -- 172.21.15.72:0/803333096 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d340036a0 con 0x7f4d4009c650 2023-10-03T10:15:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.344+0000 7f4d277fe700 1 -- 172.21.15.72:0/803333096 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3401f070 con 0x7f4d4009c650 2023-10-03T10:15:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.344+0000 7f4d4529d700 1 -- 172.21.15.72:0/803333096 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d340094a0 con 0x7f4d4009c650 2023-10-03T10:15:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.344+0000 7f4d277fe700 1 -- 172.21.15.72:0/803333096 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34003a60 con 0x7f4d4009c650 2023-10-03T10:15:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.344+0000 7f4d4529d700 1 -- 172.21.15.72:0/803333096 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4006d6d0 con 0x7f4d4009c650 2023-10-03T10:15:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.345+0000 7f4d277fe700 1 -- 172.21.15.72:0/803333096 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d34003bc0 con 0x7f4d4009c650 2023-10-03T10:15:34.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.345+0000 7f4d277fe700 1 -- 172.21.15.72:0/803333096 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d34021070 con 0x7f4d4009c650 2023-10-03T10:15:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.345+0000 7f4d4529d700 1 -- 172.21.15.72:0/803333096 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d400747f0 con 0x7f4d4009c650 2023-10-03T10:15:34.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.349+0000 7f4d277fe700 1 -- 172.21.15.72:0/803333096 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d34015080 con 0x7f4d4009c650 2023-10-03T10:15:34.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.533+0000 7f4d4529d700 1 -- 172.21.15.72:0/803333096 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4d40072840 con 0x7f4d4009c650 2023-10-03T10:15:34.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.533+0000 7f4d277fe700 1 -- 172.21.15.72:0/803333096 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d34035090 con 0x7f4d4009c650 2023-10-03T10:15:34.534 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:34.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.536+0000 7f4d4529d700 1 -- 172.21.15.72:0/803333096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d4009c650 msgr2=0x7f4d4006b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.536+0000 7f4d4529d700 1 --2- 172.21.15.72:0/803333096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d4009c650 0x7f4d4006b880 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4d340090b0 tx=0x7f4d34004750 comp rx=0 tx=0).stop 2023-10-03T10:15:34.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.536+0000 7f4d4529d700 1 -- 172.21.15.72:0/803333096 shutdown_connections 2023-10-03T10:15:34.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.536+0000 7f4d4529d700 1 --2- 172.21.15.72:0/803333096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d4009c650 0x7f4d4006b880 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.536+0000 7f4d4529d700 1 --2- 172.21.15.72:0/803333096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d40131970 0x7f4d4006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.536+0000 7f4d4529d700 1 --2- 172.21.15.72:0/803333096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d400a0090 0x7f4d4006bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.536+0000 7f4d4529d700 1 -- 172.21.15.72:0/803333096 >> 172.21.15.72:0/803333096 conn(0x7f4d400a3f70 msgr2=0x7f4d4009eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.536+0000 7f4d4529d700 1 -- 172.21.15.72:0/803333096 shutdown_connections 2023-10-03T10:15:34.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.536+0000 7f4d4529d700 1 -- 172.21.15.72:0/803333096 wait complete. 2023-10-03T10:15:34.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:34.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.951+0000 7fc7a5964700 1 Processor -- start 2023-10-03T10:15:34.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.951+0000 7fc7a5964700 1 -- start start 2023-10-03T10:15:34.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.951+0000 7fc7a5964700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc7a006a770 0x7fc7a006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.951+0000 7fc7a5964700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7a006b080 0x7fc7a0131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.951+0000 7fc7a5964700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7a0131b40 0x7fc7a0131f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.951+0000 7fc7a5964700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a009e070 con 0x7fc7a006a770 2023-10-03T10:15:34.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.951+0000 7fc7a5964700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a01324b0 con 0x7fc7a006b080 2023-10-03T10:15:34.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.951+0000 7fc7a5964700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a009e810 con 0x7fc7a0131b40 2023-10-03T10:15:34.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.951+0000 7fc79effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc7a006a770 0x7fc7a006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.951+0000 7fc79f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7a0131b40 0x7fc7a0131f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.951+0000 7fc79e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7a006b080 0x7fc7a0131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.952+0000 7fc79effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc7a006a770 0x7fc7a006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55512/0 (socket says 172.21.15.72:55512) 2023-10-03T10:15:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.952+0000 7fc79f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7a0131b40 0x7fc7a0131f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55284/0 (socket says 172.21.15.72:55284) 2023-10-03T10:15:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.952+0000 7fc79effd700 1 -- 172.21.15.72:0/1857813920 learned_addr learned my addr 172.21.15.72:0/1857813920 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.952+0000 7fc79f7fe700 1 -- 172.21.15.72:0/1857813920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7a006b080 msgr2=0x7fc7a0131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.952+0000 7fc79f7fe700 1 --2- 172.21.15.72:0/1857813920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7a006b080 0x7fc7a0131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.952+0000 7fc79f7fe700 1 -- 172.21.15.72:0/1857813920 >> v2:172.21.15.72:3300/0 conn(0x7fc7a006a770 msgr2=0x7fc7a006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.952+0000 7fc79f7fe700 1 --2- 172.21.15.72:0/1857813920 >> v2:172.21.15.72:3300/0 conn(0x7fc7a006a770 0x7fc7a006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.952+0000 7fc79f7fe700 1 -- 172.21.15.72:0/1857813920 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a009ead0 con 0x7fc7a0131b40 2023-10-03T10:15:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.952+0000 7fc79effd700 1 --2- 172.21.15.72:0/1857813920 >> v2:172.21.15.72:3300/0 conn(0x7fc7a006a770 0x7fc7a006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.952+0000 7fc79e7fc700 1 --2- 172.21.15.72:0/1857813920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7a006b080 0x7fc7a0131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.952+0000 7fc79f7fe700 1 --2- 172.21.15.72:0/1857813920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7a0131b40 0x7fc7a0131f70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc798009dc0 tx=0x7fc79800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12e64b1e4f02a75b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.952+0000 7fc79dffb700 1 -- 172.21.15.72:0/1857813920 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79800e070 con 0x7fc7a0131b40 2023-10-03T10:15:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.952+0000 7fc79dffb700 1 -- 172.21.15.72:0/1857813920 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79800bae0 con 0x7fc7a0131b40 2023-10-03T10:15:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.952+0000 7fc79dffb700 1 -- 172.21.15.72:0/1857813920 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79800be90 con 0x7fc7a0131b40 2023-10-03T10:15:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.953+0000 7fc7a5964700 1 -- 172.21.15.72:0/1857813920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7a0131b40 msgr2=0x7fc7a0131f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.953+0000 7fc7a5964700 1 --2- 172.21.15.72:0/1857813920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7a0131b40 0x7fc7a0131f70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc798009dc0 tx=0x7fc79800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.953+0000 7fc7a5964700 1 -- 172.21.15.72:0/1857813920 shutdown_connections 2023-10-03T10:15:34.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.953+0000 7fc7a5964700 1 --2- 172.21.15.72:0/1857813920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7a0131b40 0x7fc7a0131f70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.953+0000 7fc7a5964700 1 --2- 172.21.15.72:0/1857813920 >> v2:172.21.15.72:3300/0 conn(0x7fc7a006a770 0x7fc7a006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.953+0000 7fc7a5964700 1 --2- 172.21.15.72:0/1857813920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7a006b080 0x7fc7a0131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.953+0000 7fc7a5964700 1 -- 172.21.15.72:0/1857813920 >> 172.21.15.72:0/1857813920 conn(0x7fc7a0066f50 msgr2=0x7fc7a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.953+0000 7fc7a5964700 1 -- 172.21.15.72:0/1857813920 shutdown_connections 2023-10-03T10:15:34.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.953+0000 7fc7a5964700 1 -- 172.21.15.72:0/1857813920 wait complete. 2023-10-03T10:15:34.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.954+0000 7fc7a5964700 1 Processor -- start 2023-10-03T10:15:34.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.954+0000 7fc7a5964700 1 -- start start 2023-10-03T10:15:34.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.954+0000 7fc7a5964700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7a006a770 0x7fc7a011ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.954+0000 7fc7a5964700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7a006b080 0x7fc7a011f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.954+0000 7fc7a5964700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7a0131b40 0x7fc7a011f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.954+0000 7fc7a5964700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a0122880 con 0x7fc7a006a770 2023-10-03T10:15:34.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.954+0000 7fc7a5964700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a0121970 con 0x7fc7a0131b40 2023-10-03T10:15:34.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.954+0000 7fc7a5964700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a01303f0 con 0x7fc7a006b080 2023-10-03T10:15:34.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.954+0000 7fc79effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7a006a770 0x7fc7a011ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.954+0000 7fc79e7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7a006b080 0x7fc7a011f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.954+0000 7fc79effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7a006a770 0x7fc7a011ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55514/0 (socket says 172.21.15.72:55514) 2023-10-03T10:15:34.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.954+0000 7fc79effd700 1 -- 172.21.15.72:0/2290045976 learned_addr learned my addr 172.21.15.72:0/2290045976 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:34.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.954+0000 7fc79f7fe700 1 --2- 172.21.15.72:0/2290045976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7a0131b40 0x7fc7a011f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.955+0000 7fc79effd700 1 -- 172.21.15.72:0/2290045976 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7a006b080 msgr2=0x7fc7a011f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.955+0000 7fc79effd700 1 --2- 172.21.15.72:0/2290045976 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7a006b080 0x7fc7a011f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.955+0000 7fc79effd700 1 -- 172.21.15.72:0/2290045976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7a0131b40 msgr2=0x7fc7a011f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.955+0000 7fc79effd700 1 --2- 172.21.15.72:0/2290045976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7a0131b40 0x7fc7a011f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.955+0000 7fc79effd700 1 -- 172.21.15.72:0/2290045976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc790009550 con 0x7fc7a006a770 2023-10-03T10:15:34.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.955+0000 7fc79e7fc700 1 --2- 172.21.15.72:0/2290045976 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7a006b080 0x7fc7a011f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.955+0000 7fc79f7fe700 1 --2- 172.21.15.72:0/2290045976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7a0131b40 0x7fc7a011f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.955+0000 7fc79effd700 1 --2- 172.21.15.72:0/2290045976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7a006a770 0x7fc7a011ef60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc79000ebe0 tx=0x7fc79000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.955+0000 7fc787fff700 1 -- 172.21.15.72:0/2290045976 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79000c850 con 0x7fc7a006a770 2023-10-03T10:15:34.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.955+0000 7fc787fff700 1 -- 172.21.15.72:0/2290045976 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79000c9b0 con 0x7fc7a006a770 2023-10-03T10:15:34.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.955+0000 7fc7a5964700 1 -- 172.21.15.72:0/2290045976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7940094a0 con 0x7fc7a006a770 2023-10-03T10:15:34.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.955+0000 7fc787fff700 1 -- 172.21.15.72:0/2290045976 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79000cd40 con 0x7fc7a006a770 2023-10-03T10:15:34.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.955+0000 7fc7a5964700 1 -- 172.21.15.72:0/2290045976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc798009a70 con 0x7fc7a006a770 2023-10-03T10:15:34.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.956+0000 7fc7a5964700 1 -- 172.21.15.72:0/2290045976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a00747f0 con 0x7fc7a006a770 2023-10-03T10:15:34.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.956+0000 7fc787fff700 1 -- 172.21.15.72:0/2290045976 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc790013470 con 0x7fc7a006a770 2023-10-03T10:15:34.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.956+0000 7fc787fff700 1 -- 172.21.15.72:0/2290045976 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc79003f820 con 0x7fc7a006a770 2023-10-03T10:15:34.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:34.961+0000 7fc787fff700 1 -- 172.21.15.72:0/2290045976 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7900232f0 con 0x7fc7a006a770 2023-10-03T10:15:35.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.147+0000 7fc7a5964700 1 -- 172.21.15.72:0/2290045976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc7a0131920 con 0x7fc7a006a770 2023-10-03T10:15:35.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.147+0000 7fc787fff700 1 -- 172.21.15.72:0/2290045976 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc790021070 con 0x7fc7a006a770 2023-10-03T10:15:35.148 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:35.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.149+0000 7fc7a5964700 1 -- 172.21.15.72:0/2290045976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7a006a770 msgr2=0x7fc7a011ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.149+0000 7fc7a5964700 1 --2- 172.21.15.72:0/2290045976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7a006a770 0x7fc7a011ef60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc79000ebe0 tx=0x7fc79000eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.149+0000 7fc7a5964700 1 -- 172.21.15.72:0/2290045976 shutdown_connections 2023-10-03T10:15:35.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.149+0000 7fc7a5964700 1 --2- 172.21.15.72:0/2290045976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7a006a770 0x7fc7a011ef60 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.149+0000 7fc7a5964700 1 --2- 172.21.15.72:0/2290045976 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7a0131b40 0x7fc7a011f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.149+0000 7fc7a5964700 1 --2- 172.21.15.72:0/2290045976 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7a006b080 0x7fc7a011f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.149+0000 7fc7a5964700 1 -- 172.21.15.72:0/2290045976 >> 172.21.15.72:0/2290045976 conn(0x7fc7a0066f50 msgr2=0x7fc7a01306f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.149+0000 7fc7a5964700 1 -- 172.21.15.72:0/2290045976 shutdown_connections 2023-10-03T10:15:35.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.149+0000 7fc7a5964700 1 -- 172.21.15.72:0/2290045976 wait complete. 2023-10-03T10:15:35.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:35.255 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:35.332 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:35.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.378+0000 7fbf843f8700 1 Processor -- start 2023-10-03T10:15:35.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.378+0000 7fbf843f8700 1 -- start start 2023-10-03T10:15:35.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.379+0000 7fbf843f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf7c09e930 0x7fbf7c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.379+0000 7fbf843f8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf7c09f650 0x7fbf7c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.379+0000 7fbf843f8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c070940 con 0x7fbf7c09f240 2023-10-03T10:15:35.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.379+0000 7fbf843f8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c06fd60 con 0x7fbf7c09e930 2023-10-03T10:15:35.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.379+0000 7fbf843f8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c06fa80 con 0x7fbf7c09f650 2023-10-03T10:15:35.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.379+0000 7fbf82995700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf7c09f650 0x7fbf7c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.379+0000 7fbf82995700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf7c09f650 0x7fbf7c131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55304/0 (socket says 172.21.15.72:55304) 2023-10-03T10:15:35.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.379+0000 7fbf82995700 1 -- 172.21.15.72:0/978956809 learned_addr learned my addr 172.21.15.72:0/978956809 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:35.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.379+0000 7fbf82194700 1 --2- 172.21.15.72:0/978956809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf7c09e930 0x7fbf7c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.379+0000 7fbf81993700 1 --1- 172.21.15.72:0/978956809 >> v1:172.21.15.72:6789/0 conn(0x7fbf7c09f240 0x7fbf7c1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54346/0 (socket says 172.21.15.72:54346) 2023-10-03T10:15:35.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.379+0000 7fbf82995700 1 -- 172.21.15.72:0/978956809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf7c09e930 msgr2=0x7fbf7c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.379+0000 7fbf82995700 1 --2- 172.21.15.72:0/978956809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf7c09e930 0x7fbf7c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.379+0000 7fbf82995700 1 -- 172.21.15.72:0/978956809 >> v1:172.21.15.72:6789/0 conn(0x7fbf7c09f240 legacy=0x7fbf7c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.379+0000 7fbf82995700 1 -- 172.21.15.72:0/978956809 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c09fb60 con 0x7fbf7c09f650 2023-10-03T10:15:35.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.379+0000 7fbf82194700 1 --2- 172.21.15.72:0/978956809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf7c09e930 0x7fbf7c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.380+0000 7fbf82995700 1 --2- 172.21.15.72:0/978956809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf7c09f650 0x7fbf7c131f00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009e80 tx=0x7fbf7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd5ebacc36fb740d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.380+0000 7fbf81192700 1 -- 172.21.15.72:0/978956809 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400e070 con 0x7fbf7c09f650 2023-10-03T10:15:35.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.380+0000 7fbf81192700 1 -- 172.21.15.72:0/978956809 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7400b910 con 0x7fbf7c09f650 2023-10-03T10:15:35.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.380+0000 7fbf81192700 1 -- 172.21.15.72:0/978956809 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400bcc0 con 0x7fbf7c09f650 2023-10-03T10:15:35.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.380+0000 7fbf843f8700 1 -- 172.21.15.72:0/978956809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf7c09f650 msgr2=0x7fbf7c131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.380+0000 7fbf843f8700 1 --2- 172.21.15.72:0/978956809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf7c09f650 0x7fbf7c131f00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009e80 tx=0x7fbf7400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:35.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.380+0000 7fbf843f8700 1 -- 172.21.15.72:0/978956809 shutdown_connections 2023-10-03T10:15:35.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.380+0000 7fbf843f8700 1 --2- 172.21.15.72:0/978956809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf7c09f650 0x7fbf7c131f00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.380+0000 7fbf843f8700 1 --2- 172.21.15.72:0/978956809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf7c09e930 0x7fbf7c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.380+0000 7fbf843f8700 1 -- 172.21.15.72:0/978956809 >> 172.21.15.72:0/978956809 conn(0x7fbf7c0a4210 msgr2=0x7fbf7c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.380+0000 7fbf843f8700 1 -- 172.21.15.72:0/978956809 shutdown_connections 2023-10-03T10:15:35.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.380+0000 7fbf843f8700 1 -- 172.21.15.72:0/978956809 wait complete. 2023-10-03T10:15:35.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.381+0000 7fbf843f8700 1 Processor -- start 2023-10-03T10:15:35.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.381+0000 7fbf843f8700 1 -- start start 2023-10-03T10:15:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf843f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf7c09e930 0x7fbf7c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf843f8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf7c09f240 0x7fbf7c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf843f8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf7c09f650 0x7fbf7c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf843f8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c1a9a20 con 0x7fbf7c09f240 2023-10-03T10:15:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf843f8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c1b7360 con 0x7fbf7c09e930 2023-10-03T10:15:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf843f8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c1a8a30 con 0x7fbf7c09f650 2023-10-03T10:15:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf82194700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf7c09e930 0x7fbf7c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf82995700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf7c09f650 0x7fbf7c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf82194700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf7c09e930 0x7fbf7c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43564/0 (socket says 172.21.15.72:43564) 2023-10-03T10:15:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf82194700 1 -- 172.21.15.72:0/3223355978 learned_addr learned my addr 172.21.15.72:0/3223355978 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:35.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf81993700 1 --2- 172.21.15.72:0/3223355978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf7c09f240 0x7fbf7c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf82995700 1 -- 172.21.15.72:0/3223355978 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf7c09e930 msgr2=0x7fbf7c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf82995700 1 --2- 172.21.15.72:0/3223355978 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf7c09e930 0x7fbf7c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf82995700 1 -- 172.21.15.72:0/3223355978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf7c09f240 msgr2=0x7fbf7c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf82995700 1 --2- 172.21.15.72:0/3223355978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf7c09f240 0x7fbf7c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf82995700 1 -- 172.21.15.72:0/3223355978 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf780094a0 con 0x7fbf7c09f650 2023-10-03T10:15:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf81993700 1 --2- 172.21.15.72:0/3223355978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf7c09f240 0x7fbf7c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf82194700 1 --2- 172.21.15.72:0/3223355978 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf7c09e930 0x7fbf7c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf82995700 1 --2- 172.21.15.72:0/3223355978 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf7c09f650 0x7fbf7c06c330 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbf74015000 tx=0x7fbf74004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.382+0000 7fbf72ffd700 1 -- 172.21.15.72:0/3223355978 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74004450 con 0x7fbf7c09f650 2023-10-03T10:15:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.383+0000 7fbf72ffd700 1 -- 172.21.15.72:0/3223355978 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf740092e0 con 0x7fbf7c09f650 2023-10-03T10:15:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.383+0000 7fbf843f8700 1 -- 172.21.15.72:0/3223355978 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf74009b30 con 0x7fbf7c09f650 2023-10-03T10:15:35.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.383+0000 7fbf72ffd700 1 -- 172.21.15.72:0/3223355978 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74004830 con 0x7fbf7c09f650 2023-10-03T10:15:35.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.383+0000 7fbf843f8700 1 -- 172.21.15.72:0/3223355978 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7c0a0190 con 0x7fbf7c09f650 2023-10-03T10:15:35.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.384+0000 7fbf72ffd700 1 -- 172.21.15.72:0/3223355978 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf7401c410 con 0x7fbf7c09f650 2023-10-03T10:15:35.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.384+0000 7fbf843f8700 1 -- 172.21.15.72:0/3223355978 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7c1a0b30 con 0x7fbf7c09f650 2023-10-03T10:15:35.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.384+0000 7fbf72ffd700 1 -- 172.21.15.72:0/3223355978 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbf740411c0 con 0x7fbf7c09f650 2023-10-03T10:15:35.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.388+0000 7fbf72ffd700 1 -- 172.21.15.72:0/3223355978 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf74011780 con 0x7fbf7c09f650 2023-10-03T10:15:35.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.457+0000 7ff8b0afc700 1 Processor -- start 2023-10-03T10:15:35.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.457+0000 7ff8b0afc700 1 -- start start 2023-10-03T10:15:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8b0afc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff8ac133420 0x7ff8ac1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8b0afc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff8ac134260 0x7ff8ac1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8b0afc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ac06b990 con 0x7ff8ac133e30 2023-10-03T10:15:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8b0afc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ac0a0590 con 0x7ff8ac133420 2023-10-03T10:15:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8b0afc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac09fb80 con 0x7ff8ac134260 2023-10-03T10:15:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8aad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff8ac134260 0x7ff8ac1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8aa59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff8ac133420 0x7ff8ac1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8aad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff8ac134260 0x7ff8ac1306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43580/0 (socket says 172.21.15.72:43580) 2023-10-03T10:15:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8aa59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff8ac133420 0x7ff8ac1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55532/0 (socket says 172.21.15.72:55532) 2023-10-03T10:15:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8aad9d700 1 -- 172.21.15.72:0/380816270 learned_addr learned my addr 172.21.15.72:0/380816270 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8aad9d700 1 -- 172.21.15.72:0/380816270 >> v2:172.21.15.72:3300/0 conn(0x7ff8ac133420 msgr2=0x7ff8ac1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8aad9d700 1 --2- 172.21.15.72:0/380816270 >> v2:172.21.15.72:3300/0 conn(0x7ff8ac133420 0x7ff8ac1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8aad9d700 1 -- 172.21.15.72:0/380816270 >> v1:172.21.15.72:6789/0 conn(0x7ff8ac133e30 legacy=0x7ff8ac12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8aad9d700 1 -- 172.21.15.72:0/380816270 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac0a0030 con 0x7ff8ac134260 2023-10-03T10:15:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8a959a700 1 -- 172.21.15.72:0/380816270 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163738182 0 0) 0x7ff8ac06b990 con 0x7ff8ac133e30 2023-10-03T10:15:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.458+0000 7ff8aa59c700 1 --2- 172.21.15.72:0/380816270 >> v2:172.21.15.72:3300/0 conn(0x7ff8ac133420 0x7ff8ac1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.459+0000 7ff8aad9d700 1 --2- 172.21.15.72:0/380816270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff8ac134260 0x7ff8ac1306a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009e50 tx=0x7ff8a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d6a946b8ac391a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.459+0000 7ff8a959a700 1 -- 172.21.15.72:0/380816270 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a400e070 con 0x7ff8ac134260 2023-10-03T10:15:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.459+0000 7ff8a959a700 1 -- 172.21.15.72:0/380816270 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a400b910 con 0x7ff8ac134260 2023-10-03T10:15:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.459+0000 7ff8a959a700 1 -- 172.21.15.72:0/380816270 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a400bcc0 con 0x7ff8ac134260 2023-10-03T10:15:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.459+0000 7ff8b0afc700 1 -- 172.21.15.72:0/380816270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff8ac134260 msgr2=0x7ff8ac1306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.459+0000 7ff8b0afc700 1 --2- 172.21.15.72:0/380816270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff8ac134260 0x7ff8ac1306a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009e50 tx=0x7ff8a400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.459+0000 7ff8b0afc700 1 -- 172.21.15.72:0/380816270 shutdown_connections 2023-10-03T10:15:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.459+0000 7ff8b0afc700 1 --2- 172.21.15.72:0/380816270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff8ac134260 0x7ff8ac1306a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.459+0000 7ff8b0afc700 1 --2- 172.21.15.72:0/380816270 >> v2:172.21.15.72:3300/0 conn(0x7ff8ac133420 0x7ff8ac1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.459+0000 7ff8b0afc700 1 -- 172.21.15.72:0/380816270 >> 172.21.15.72:0/380816270 conn(0x7ff8ac0a4210 msgr2=0x7ff8ac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.459+0000 7ff8b0afc700 1 -- 172.21.15.72:0/380816270 shutdown_connections 2023-10-03T10:15:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.459+0000 7ff8b0afc700 1 -- 172.21.15.72:0/380816270 wait complete. 2023-10-03T10:15:35.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.460+0000 7ff8b0afc700 1 Processor -- start 2023-10-03T10:15:35.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8b0afc700 1 -- start start 2023-10-03T10:15:35.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8b0afc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff8ac133420 0x7ff8ac09c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8b0afc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8ac133e30 0x7ff8ac09ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8b0afc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8ac134260 0x7ff8ac09d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8b0afc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac09e360 con 0x7ff8ac134260 2023-10-03T10:15:35.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8b0afc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac120360 con 0x7ff8ac133420 2023-10-03T10:15:35.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8b0afc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac120f10 con 0x7ff8ac133e30 2023-10-03T10:15:35.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8aad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8ac134260 0x7ff8ac09d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8a9d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8ac133e30 0x7ff8ac09ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8aad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8ac134260 0x7ff8ac09d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55536/0 (socket says 172.21.15.72:55536) 2023-10-03T10:15:35.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8aad9d700 1 -- 172.21.15.72:0/4035658920 learned_addr learned my addr 172.21.15.72:0/4035658920 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:35.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8a9d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8ac133e30 0x7ff8ac09ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55320/0 (socket says 172.21.15.72:55320) 2023-10-03T10:15:35.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8aa59c700 1 --2- 172.21.15.72:0/4035658920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff8ac133420 0x7ff8ac09c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8aad9d700 1 -- 172.21.15.72:0/4035658920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8ac133e30 msgr2=0x7ff8ac09ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8aad9d700 1 --2- 172.21.15.72:0/4035658920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8ac133e30 0x7ff8ac09ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8aad9d700 1 -- 172.21.15.72:0/4035658920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff8ac133420 msgr2=0x7ff8ac09c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8aad9d700 1 --2- 172.21.15.72:0/4035658920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff8ac133420 0x7ff8ac09c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8aad9d700 1 -- 172.21.15.72:0/4035658920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c0094a0 con 0x7ff8ac134260 2023-10-03T10:15:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.461+0000 7ff8aa59c700 1 --2- 172.21.15.72:0/4035658920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff8ac133420 0x7ff8ac09c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.462+0000 7ff8aad9d700 1 --2- 172.21.15.72:0/4035658920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8ac134260 0x7ff8ac09d340 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4012000 tx=0x7ff8a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.462+0000 7ff89affd700 1 -- 172.21.15.72:0/4035658920 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4003ea0 con 0x7ff8ac134260 2023-10-03T10:15:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.462+0000 7ff89affd700 1 -- 172.21.15.72:0/4035658920 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a40048e0 con 0x7ff8ac134260 2023-10-03T10:15:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.462+0000 7ff8b0afc700 1 -- 172.21.15.72:0/4035658920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a4009b30 con 0x7ff8ac134260 2023-10-03T10:15:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.462+0000 7ff89affd700 1 -- 172.21.15.72:0/4035658920 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a401c680 con 0x7ff8ac134260 2023-10-03T10:15:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.462+0000 7ff8b0afc700 1 -- 172.21.15.72:0/4035658920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ac12dc60 con 0x7ff8ac134260 2023-10-03T10:15:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.463+0000 7ff89affd700 1 -- 172.21.15.72:0/4035658920 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff8a401c7e0 con 0x7ff8ac134260 2023-10-03T10:15:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.463+0000 7ff89affd700 1 -- 172.21.15.72:0/4035658920 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff8a4040c70 con 0x7ff8ac134260 2023-10-03T10:15:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.463+0000 7ff8b0afc700 1 -- 172.21.15.72:0/4035658920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ac12da00 con 0x7ff8ac134260 2023-10-03T10:15:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.467+0000 7ff89affd700 1 -- 172.21.15.72:0/4035658920 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff8a40249a0 con 0x7ff8ac134260 2023-10-03T10:15:35.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:35.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.587+0000 7fbf843f8700 1 -- 172.21.15.72:0/3223355978 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbf7c071d20 con 0x7fbf7c09f650 2023-10-03T10:15:35.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.587+0000 7fbf72ffd700 1 -- 172.21.15.72:0/3223355978 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf7402a030 con 0x7fbf7c09f650 2023-10-03T10:15:35.588 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:35.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.589+0000 7fbf843f8700 1 -- 172.21.15.72:0/3223355978 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf7c09f650 msgr2=0x7fbf7c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.589+0000 7fbf843f8700 1 --2- 172.21.15.72:0/3223355978 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf7c09f650 0x7fbf7c06c330 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbf74015000 tx=0x7fbf74004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.589+0000 7fbf843f8700 1 -- 172.21.15.72:0/3223355978 shutdown_connections 2023-10-03T10:15:35.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.589+0000 7fbf843f8700 1 --2- 172.21.15.72:0/3223355978 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf7c09f650 0x7fbf7c06c330 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.589+0000 7fbf843f8700 1 --2- 172.21.15.72:0/3223355978 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf7c09e930 0x7fbf7c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.589+0000 7fbf843f8700 1 --2- 172.21.15.72:0/3223355978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf7c09f240 0x7fbf7c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.589+0000 7fbf843f8700 1 -- 172.21.15.72:0/3223355978 >> 172.21.15.72:0/3223355978 conn(0x7fbf7c0a4210 msgr2=0x7fbf7c1b8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.590+0000 7fbf843f8700 1 -- 172.21.15.72:0/3223355978 shutdown_connections 2023-10-03T10:15:35.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.590+0000 7fbf843f8700 1 -- 172.21.15.72:0/3223355978 wait complete. 2023-10-03T10:15:35.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:35.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.664+0000 7ff8b0afc700 1 -- 172.21.15.72:0/4035658920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff8ac12dc60 con 0x7ff8ac134260 2023-10-03T10:15:35.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.664+0000 7ff89affd700 1 -- 172.21.15.72:0/4035658920 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff8ac12dc60 con 0x7ff8ac134260 2023-10-03T10:15:35.665 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:35.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.667+0000 7ff8b0afc700 1 -- 172.21.15.72:0/4035658920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8ac134260 msgr2=0x7ff8ac09d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.667+0000 7ff8b0afc700 1 --2- 172.21.15.72:0/4035658920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8ac134260 0x7ff8ac09d340 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4012000 tx=0x7ff8a4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.667+0000 7ff8b0afc700 1 -- 172.21.15.72:0/4035658920 shutdown_connections 2023-10-03T10:15:35.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.667+0000 7ff8b0afc700 1 --2- 172.21.15.72:0/4035658920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8ac134260 0x7ff8ac09d340 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.667+0000 7ff8b0afc700 1 --2- 172.21.15.72:0/4035658920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff8ac133420 0x7ff8ac09c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.667+0000 7ff8b0afc700 1 --2- 172.21.15.72:0/4035658920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8ac133e30 0x7ff8ac09ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.667+0000 7ff8b0afc700 1 -- 172.21.15.72:0/4035658920 >> 172.21.15.72:0/4035658920 conn(0x7ff8ac0a4210 msgr2=0x7ff8ac12de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.667+0000 7ff8b0afc700 1 -- 172.21.15.72:0/4035658920 shutdown_connections 2023-10-03T10:15:35.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.667+0000 7ff8b0afc700 1 -- 172.21.15.72:0/4035658920 wait complete. 2023-10-03T10:15:35.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.675+0000 7fc353c92700 1 Processor -- start 2023-10-03T10:15:35.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.675+0000 7fc353c92700 1 -- start start 2023-10-03T10:15:35.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc353c92700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc34c0a0a30 0x7fc34c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc353c92700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34c138d80 0x7fc34c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc353c92700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34c0a2a70 con 0x7fc34c09d630 2023-10-03T10:15:35.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc353c92700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34c0a01d0 con 0x7fc34c0a0a30 2023-10-03T10:15:35.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc353c92700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c09e2b0 con 0x7fc34c138d80 2023-10-03T10:15:35.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc351a2e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc34c0a0a30 0x7fc34c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc35222f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34c138d80 0x7fc34c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc351a2e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc34c0a0a30 0x7fc34c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55548/0 (socket says 172.21.15.72:55548) 2023-10-03T10:15:35.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc35222f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34c138d80 0x7fc34c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43586/0 (socket says 172.21.15.72:43586) 2023-10-03T10:15:35.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc351a2e700 1 -- 172.21.15.72:0/1109877670 learned_addr learned my addr 172.21.15.72:0/1109877670 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:35.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc351a2e700 1 -- 172.21.15.72:0/1109877670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34c138d80 msgr2=0x7fc34c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc351a2e700 1 --2- 172.21.15.72:0/1109877670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34c138d80 0x7fc34c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc351a2e700 1 -- 172.21.15.72:0/1109877670 >> v1:172.21.15.72:6789/0 conn(0x7fc34c09d630 legacy=0x7fc34c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc350a2c700 1 -- 172.21.15.72:0/1109877670 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962949213 0 0) 0x7fc34c0a2a70 con 0x7fc34c09d630 2023-10-03T10:15:35.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc351a2e700 1 -- 172.21.15.72:0/1109877670 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c09dc50 con 0x7fc34c0a0a30 2023-10-03T10:15:35.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc35222f700 1 --2- 172.21.15.72:0/1109877670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34c138d80 0x7fc34c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.676+0000 7fc351a2e700 1 --2- 172.21.15.72:0/1109877670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34c0a0a30 0x7fc34c0a0e00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc3480098f0 tx=0x7fc348009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2a257b755dc936 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.677+0000 7fc350a2c700 1 -- 172.21.15.72:0/1109877670 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348011830 con 0x7fc34c0a0a30 2023-10-03T10:15:35.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.677+0000 7fc350a2c700 1 -- 172.21.15.72:0/1109877670 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc348011990 con 0x7fc34c0a0a30 2023-10-03T10:15:35.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.677+0000 7fc350a2c700 1 -- 172.21.15.72:0/1109877670 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348011d20 con 0x7fc34c0a0a30 2023-10-03T10:15:35.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.677+0000 7fc353c92700 1 -- 172.21.15.72:0/1109877670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34c0a0a30 msgr2=0x7fc34c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.677+0000 7fc353c92700 1 --2- 172.21.15.72:0/1109877670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34c0a0a30 0x7fc34c0a0e00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc3480098f0 tx=0x7fc348009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:35.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.677+0000 7fc353c92700 1 -- 172.21.15.72:0/1109877670 shutdown_connections 2023-10-03T10:15:35.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.677+0000 7fc353c92700 1 --2- 172.21.15.72:0/1109877670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34c138d80 0x7fc34c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.677+0000 7fc353c92700 1 --2- 172.21.15.72:0/1109877670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34c0a0a30 0x7fc34c0a0e00 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.677+0000 7fc353c92700 1 -- 172.21.15.72:0/1109877670 >> 172.21.15.72:0/1109877670 conn(0x7fc34c0a3050 msgr2=0x7fc34c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.677+0000 7fc353c92700 1 -- 172.21.15.72:0/1109877670 shutdown_connections 2023-10-03T10:15:35.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.677+0000 7fc353c92700 1 -- 172.21.15.72:0/1109877670 wait complete. 2023-10-03T10:15:35.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.678+0000 7fc353c92700 1 Processor -- start 2023-10-03T10:15:35.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.678+0000 7fc353c92700 1 -- start start 2023-10-03T10:15:35.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc353c92700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34c09d630 0x7fc34c133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc353c92700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34c0a0a30 0x7fc34c133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc353c92700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc34c138d80 0x7fc34c1341e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc353c92700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c136fa0 con 0x7fc34c09d630 2023-10-03T10:15:35.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc353c92700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c136630 con 0x7fc34c0a0a30 2023-10-03T10:15:35.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc353c92700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0a4b50 con 0x7fc34c138d80 2023-10-03T10:15:35.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc35122d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34c0a0a30 0x7fc34c133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc351a2e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34c09d630 0x7fc34c133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc35222f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc34c138d80 0x7fc34c1341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc35122d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34c0a0a30 0x7fc34c133ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43598/0 (socket says 172.21.15.72:43598) 2023-10-03T10:15:35.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc351a2e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34c09d630 0x7fc34c133760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55550/0 (socket says 172.21.15.72:55550) 2023-10-03T10:15:35.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc35122d700 1 -- 172.21.15.72:0/2417560262 learned_addr learned my addr 172.21.15.72:0/2417560262 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:35.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:35.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc351a2e700 1 -- 172.21.15.72:0/2417560262 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc34c138d80 msgr2=0x7fc34c1341e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc351a2e700 1 --2- 172.21.15.72:0/2417560262 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc34c138d80 0x7fc34c1341e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc351a2e700 1 -- 172.21.15.72:0/2417560262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34c0a0a30 msgr2=0x7fc34c133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc351a2e700 1 --2- 172.21.15.72:0/2417560262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34c0a0a30 0x7fc34c133ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc351a2e700 1 -- 172.21.15.72:0/2417560262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc344009a70 con 0x7fc34c09d630 2023-10-03T10:15:35.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc35122d700 1 --2- 172.21.15.72:0/2417560262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34c0a0a30 0x7fc34c133ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.679+0000 7fc351a2e700 1 --2- 172.21.15.72:0/2417560262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34c09d630 0x7fc34c133760 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc348016000 tx=0x7fc348004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.680+0000 7fc3427fc700 1 -- 172.21.15.72:0/2417560262 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348004510 con 0x7fc34c09d630 2023-10-03T10:15:35.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.680+0000 7fc3427fc700 1 -- 172.21.15.72:0/2417560262 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3480036a0 con 0x7fc34c09d630 2023-10-03T10:15:35.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.680+0000 7fc353c92700 1 -- 172.21.15.72:0/2417560262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc348009550 con 0x7fc34c09d630 2023-10-03T10:15:35.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.680+0000 7fc3427fc700 1 -- 172.21.15.72:0/2417560262 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348003a30 con 0x7fc34c09d630 2023-10-03T10:15:35.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.680+0000 7fc353c92700 1 -- 172.21.15.72:0/2417560262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34c137a10 con 0x7fc34c09d630 2023-10-03T10:15:35.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.680+0000 7fc3427fc700 1 -- 172.21.15.72:0/2417560262 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc348021070 con 0x7fc34c09d630 2023-10-03T10:15:35.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.680+0000 7fc3427fc700 1 -- 172.21.15.72:0/2417560262 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc348040960 con 0x7fc34c09d630 2023-10-03T10:15:35.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.681+0000 7fc353c92700 1 -- 172.21.15.72:0/2417560262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34c136c40 con 0x7fc34c09d630 2023-10-03T10:15:35.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.685+0000 7fc3427fc700 1 -- 172.21.15.72:0/2417560262 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc348015080 con 0x7fc34c09d630 2023-10-03T10:15:35.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.870+0000 7fc353c92700 1 -- 172.21.15.72:0/2417560262 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc34c0747f0 con 0x7fc34c09d630 2023-10-03T10:15:35.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.870+0000 7fc3427fc700 1 -- 172.21.15.72:0/2417560262 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc34801b430 con 0x7fc34c09d630 2023-10-03T10:15:35.871 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:35.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.872+0000 7fc353c92700 1 -- 172.21.15.72:0/2417560262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34c09d630 msgr2=0x7fc34c133760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.872+0000 7fc353c92700 1 --2- 172.21.15.72:0/2417560262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34c09d630 0x7fc34c133760 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc348016000 tx=0x7fc348004750 comp rx=0 tx=0).stop 2023-10-03T10:15:35.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.872+0000 7fc353c92700 1 -- 172.21.15.72:0/2417560262 shutdown_connections 2023-10-03T10:15:35.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.872+0000 7fc353c92700 1 --2- 172.21.15.72:0/2417560262 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34c09d630 0x7fc34c133760 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.872+0000 7fc353c92700 1 --2- 172.21.15.72:0/2417560262 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc34c138d80 0x7fc34c1341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.872+0000 7fc353c92700 1 --2- 172.21.15.72:0/2417560262 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34c0a0a30 0x7fc34c133ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.872+0000 7fc353c92700 1 -- 172.21.15.72:0/2417560262 >> 172.21.15.72:0/2417560262 conn(0x7fc34c0a3050 msgr2=0x7fc34c13ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.873+0000 7fc353c92700 1 -- 172.21.15.72:0/2417560262 shutdown_connections 2023-10-03T10:15:35.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:35.873+0000 7fc353c92700 1 -- 172.21.15.72:0/2417560262 wait complete. 2023-10-03T10:15:35.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:36.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:36.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.283+0000 7f0d163de700 1 Processor -- start 2023-10-03T10:15:36.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.283+0000 7f0d163de700 1 -- start start 2023-10-03T10:15:36.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d163de700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d10130670 0x7f0d10130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d163de700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d1006f680 0x7f0d1006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d163de700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d1006ffd0 0x7f0d10137530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d163de700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1009a350 con 0x7f0d1006f680 2023-10-03T10:15:36.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d163de700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d10130260 con 0x7f0d10130670 2023-10-03T10:15:36.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d163de700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d10071ff0 con 0x7f0d1006ffd0 2023-10-03T10:15:36.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d1497b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d1006ffd0 0x7f0d10137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d0ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d10130670 0x7f0d10130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d0f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d1006f680 0x7f0d1006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d1497b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d1006ffd0 0x7f0d10137530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55338/0 (socket says 172.21.15.72:55338) 2023-10-03T10:15:36.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d0ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d10130670 0x7f0d10130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43606/0 (socket says 172.21.15.72:43606) 2023-10-03T10:15:36.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d1497b700 1 -- 172.21.15.72:0/732711854 learned_addr learned my addr 172.21.15.72:0/732711854 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:36.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d1497b700 1 -- 172.21.15.72:0/732711854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d10130670 msgr2=0x7f0d10130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:36.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d1497b700 1 --2- 172.21.15.72:0/732711854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d10130670 0x7f0d10130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d1497b700 1 -- 172.21.15.72:0/732711854 >> v2:172.21.15.72:3300/0 conn(0x7f0d1006f680 msgr2=0x7f0d1006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:36.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d1497b700 1 --2- 172.21.15.72:0/732711854 >> v2:172.21.15.72:3300/0 conn(0x7f0d1006f680 0x7f0d1006fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d1497b700 1 -- 172.21.15.72:0/732711854 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d10070470 con 0x7f0d1006ffd0 2023-10-03T10:15:36.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d0f7fe700 1 --2- 172.21.15.72:0/732711854 >> v2:172.21.15.72:3300/0 conn(0x7f0d1006f680 0x7f0d1006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d1497b700 1 --2- 172.21.15.72:0/732711854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d1006ffd0 0x7f0d10137530 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009e80 tx=0x7f0d0800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27e5137d4131455a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d0effd700 1 -- 172.21.15.72:0/732711854 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800e070 con 0x7f0d1006ffd0 2023-10-03T10:15:36.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d0effd700 1 -- 172.21.15.72:0/732711854 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0800b8d0 con 0x7f0d1006ffd0 2023-10-03T10:15:36.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.284+0000 7f0d0effd700 1 -- 172.21.15.72:0/732711854 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800bc80 con 0x7f0d1006ffd0 2023-10-03T10:15:36.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.285+0000 7f0d163de700 1 -- 172.21.15.72:0/732711854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d1006ffd0 msgr2=0x7f0d10137530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.285+0000 7f0d163de700 1 --2- 172.21.15.72:0/732711854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d1006ffd0 0x7f0d10137530 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009e80 tx=0x7f0d0800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:36.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.285+0000 7f0d163de700 1 -- 172.21.15.72:0/732711854 shutdown_connections 2023-10-03T10:15:36.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.285+0000 7f0d163de700 1 --2- 172.21.15.72:0/732711854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d1006ffd0 0x7f0d10137530 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.285+0000 7f0d163de700 1 --2- 172.21.15.72:0/732711854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d10130670 0x7f0d10130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.285+0000 7f0d163de700 1 --2- 172.21.15.72:0/732711854 >> v2:172.21.15.72:3300/0 conn(0x7f0d1006f680 0x7f0d1006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.285+0000 7f0d163de700 1 -- 172.21.15.72:0/732711854 >> 172.21.15.72:0/732711854 conn(0x7f0d100a2aa0 msgr2=0x7f0d100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:36.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.285+0000 7f0d163de700 1 -- 172.21.15.72:0/732711854 shutdown_connections 2023-10-03T10:15:36.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.285+0000 7f0d163de700 1 -- 172.21.15.72:0/732711854 wait complete. 2023-10-03T10:15:36.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.286+0000 7f0d163de700 1 Processor -- start 2023-10-03T10:15:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.286+0000 7f0d163de700 1 -- start start 2023-10-03T10:15:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.286+0000 7f0d163de700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d1006f680 0x7f0d1011a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.286+0000 7f0d163de700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d1006ffd0 0x7f0d1011ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.286+0000 7f0d163de700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d10130670 0x7f0d1011b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.286+0000 7f0d163de700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1011d460 con 0x7f0d10130670 2023-10-03T10:15:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d163de700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1011deb0 con 0x7f0d1006ffd0 2023-10-03T10:15:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d163de700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1011e0b0 con 0x7f0d1006f680 2023-10-03T10:15:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d0ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d1006f680 0x7f0d1011a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d0ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d1006f680 0x7f0d1011a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55352/0 (socket says 172.21.15.72:55352) 2023-10-03T10:15:36.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d1497b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d10130670 0x7f0d1011b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d0ffff700 1 -- 172.21.15.72:0/2161613020 learned_addr learned my addr 172.21.15.72:0/2161613020 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d0f7fe700 1 --2- 172.21.15.72:0/2161613020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d1006ffd0 0x7f0d1011ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d0ffff700 1 -- 172.21.15.72:0/2161613020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d1006ffd0 msgr2=0x7f0d1011ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d0ffff700 1 --2- 172.21.15.72:0/2161613020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d1006ffd0 0x7f0d1011ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d0ffff700 1 -- 172.21.15.72:0/2161613020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d10130670 msgr2=0x7f0d1011b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d0ffff700 1 --2- 172.21.15.72:0/2161613020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d10130670 0x7f0d1011b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d0ffff700 1 -- 172.21.15.72:0/2161613020 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d000094a0 con 0x7f0d1006f680 2023-10-03T10:15:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d1497b700 1 --2- 172.21.15.72:0/2161613020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d10130670 0x7f0d1011b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d0ffff700 1 --2- 172.21.15.72:0/2161613020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d1006f680 0x7f0d1011a620 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800e9e0 tx=0x7f0cf800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d0cff9700 1 -- 172.21.15.72:0/2161613020 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8009710 con 0x7f0d1006f680 2023-10-03T10:15:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d0cff9700 1 -- 172.21.15.72:0/2161613020 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf800ee80 con 0x7f0d1006f680 2023-10-03T10:15:36.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d163de700 1 -- 172.21.15.72:0/2161613020 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d08009b30 con 0x7f0d1006f680 2023-10-03T10:15:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d0cff9700 1 -- 172.21.15.72:0/2161613020 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800ca50 con 0x7f0d1006f680 2023-10-03T10:15:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.287+0000 7f0d163de700 1 -- 172.21.15.72:0/2161613020 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1012e9f0 con 0x7f0d1006f680 2023-10-03T10:15:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.288+0000 7f0d0cff9700 1 -- 172.21.15.72:0/2161613020 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cf800cbb0 con 0x7f0d1006f680 2023-10-03T10:15:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.288+0000 7f0d0cff9700 1 -- 172.21.15.72:0/2161613020 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0cf803f680 con 0x7f0d1006f680 2023-10-03T10:15:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.288+0000 7f0d163de700 1 -- 172.21.15.72:0/2161613020 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d10071820 con 0x7f0d1006f680 2023-10-03T10:15:36.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.293+0000 7f0d0cff9700 1 -- 172.21.15.72:0/2161613020 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cf80232f0 con 0x7f0d1006f680 2023-10-03T10:15:36.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.475+0000 7f0d163de700 1 -- 172.21.15.72:0/2161613020 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d10074ea0 con 0x7f0d1006f680 2023-10-03T10:15:36.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.476+0000 7f0d0cff9700 1 -- 172.21.15.72:0/2161613020 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0cf801ae80 con 0x7f0d1006f680 2023-10-03T10:15:36.476 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.477+0000 7f0d163de700 1 -- 172.21.15.72:0/2161613020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d1006f680 msgr2=0x7f0d1011a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.477+0000 7f0d163de700 1 --2- 172.21.15.72:0/2161613020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d1006f680 0x7f0d1011a620 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800e9e0 tx=0x7f0cf800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.477+0000 7f0d163de700 1 -- 172.21.15.72:0/2161613020 shutdown_connections 2023-10-03T10:15:36.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.477+0000 7f0d163de700 1 --2- 172.21.15.72:0/2161613020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d10130670 0x7f0d1011b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.477+0000 7f0d163de700 1 --2- 172.21.15.72:0/2161613020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d1006f680 0x7f0d1011a620 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.477+0000 7f0d163de700 1 --2- 172.21.15.72:0/2161613020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d1006ffd0 0x7f0d1011ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.477+0000 7f0d163de700 1 -- 172.21.15.72:0/2161613020 >> 172.21.15.72:0/2161613020 conn(0x7f0d100a2aa0 msgr2=0x7f0d100a1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:36.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.478+0000 7f0d163de700 1 -- 172.21.15.72:0/2161613020 shutdown_connections 2023-10-03T10:15:36.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.478+0000 7f0d163de700 1 -- 172.21.15.72:0/2161613020 wait complete. 2023-10-03T10:15:36.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:36.604 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:36.684 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:36.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.727+0000 7fb9fc618700 1 Processor -- start 2023-10-03T10:15:36.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.727+0000 7fb9fc618700 1 -- start start 2023-10-03T10:15:36.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.727+0000 7fb9fc618700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9f409e930 0x7fb9f409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.727+0000 7fb9fc618700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb9f409f650 0x7fb9f4131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.727+0000 7fb9fc618700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f4070940 con 0x7fb9f409f240 2023-10-03T10:15:36.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.728+0000 7fb9fc618700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f406fd60 con 0x7fb9f409f650 2023-10-03T10:15:36.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.728+0000 7fb9fc618700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f406fa80 con 0x7fb9f409e930 2023-10-03T10:15:36.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.728+0000 7fb9fabb5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb9f409f650 0x7fb9f4131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.728+0000 7fb9fa3b4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9f409e930 0x7fb9f409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.728+0000 7fb9fabb5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb9f409f650 0x7fb9f4131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55576/0 (socket says 172.21.15.72:55576) 2023-10-03T10:15:36.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.728+0000 7fb9fabb5700 1 -- 172.21.15.72:0/407723749 learned_addr learned my addr 172.21.15.72:0/407723749 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:36.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.728+0000 7fb9fa3b4700 1 -- 172.21.15.72:0/407723749 >> v2:172.21.15.72:3300/0 conn(0x7fb9f409f650 msgr2=0x7fb9f4131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:36.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.728+0000 7fb9fa3b4700 1 --2- 172.21.15.72:0/407723749 >> v2:172.21.15.72:3300/0 conn(0x7fb9f409f650 0x7fb9f4131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.728+0000 7fb9fa3b4700 1 -- 172.21.15.72:0/407723749 >> v1:172.21.15.72:6789/0 conn(0x7fb9f409f240 legacy=0x7fb9f41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.728+0000 7fb9fa3b4700 1 -- 172.21.15.72:0/407723749 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f409fb60 con 0x7fb9f409e930 2023-10-03T10:15:36.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.728+0000 7fb9fabb5700 1 --2- 172.21.15.72:0/407723749 >> v2:172.21.15.72:3300/0 conn(0x7fb9f409f650 0x7fb9f4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.728+0000 7fb9fa3b4700 1 --2- 172.21.15.72:0/407723749 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9f409e930 0x7fb9f409ed00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0009840 tx=0x7fb9f0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88cc0e3bf6472935 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.728+0000 7fb9f93b2700 1 -- 172.21.15.72:0/407723749 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0011830 con 0x7fb9f409e930 2023-10-03T10:15:36.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.728+0000 7fb9f93b2700 1 -- 172.21.15.72:0/407723749 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f0011990 con 0x7fb9f409e930 2023-10-03T10:15:36.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.728+0000 7fb9f93b2700 1 -- 172.21.15.72:0/407723749 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0011d20 con 0x7fb9f409e930 2023-10-03T10:15:36.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.729+0000 7fb9fc618700 1 -- 172.21.15.72:0/407723749 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9f409e930 msgr2=0x7fb9f409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.729+0000 7fb9fc618700 1 --2- 172.21.15.72:0/407723749 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9f409e930 0x7fb9f409ed00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0009840 tx=0x7fb9f0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:36.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.729+0000 7fb9fc618700 1 -- 172.21.15.72:0/407723749 shutdown_connections 2023-10-03T10:15:36.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.729+0000 7fb9fc618700 1 --2- 172.21.15.72:0/407723749 >> v2:172.21.15.72:3300/0 conn(0x7fb9f409f650 0x7fb9f4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.729+0000 7fb9fc618700 1 --2- 172.21.15.72:0/407723749 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9f409e930 0x7fb9f409ed00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.729+0000 7fb9fc618700 1 -- 172.21.15.72:0/407723749 >> 172.21.15.72:0/407723749 conn(0x7fb9f40a4210 msgr2=0x7fb9f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:36.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.729+0000 7fb9fc618700 1 -- 172.21.15.72:0/407723749 shutdown_connections 2023-10-03T10:15:36.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.729+0000 7fb9fc618700 1 -- 172.21.15.72:0/407723749 wait complete. 2023-10-03T10:15:36.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.730+0000 7fb9fc618700 1 Processor -- start 2023-10-03T10:15:36.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.730+0000 7fb9fc618700 1 -- start start 2023-10-03T10:15:36.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.730+0000 7fb9fc618700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9f409e930 0x7fb9f41a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.730+0000 7fb9fc618700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9f409f240 0x7fb9f41a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.730+0000 7fb9fc618700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9f409f650 0x7fb9f41a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.730+0000 7fb9fc618700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f41a5120 con 0x7fb9f409e930 2023-10-03T10:15:36.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.730+0000 7fb9fc618700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f41a5880 con 0x7fb9f409f650 2023-10-03T10:15:36.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.730+0000 7fb9fc618700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f41a5ea0 con 0x7fb9f409f240 2023-10-03T10:15:36.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.730+0000 7fb9fa3b4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9f409e930 0x7fb9f41a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.730+0000 7fb9fabb5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9f409f650 0x7fb9f41a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.731+0000 7fb9fa3b4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9f409e930 0x7fb9f41a3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55590/0 (socket says 172.21.15.72:55590) 2023-10-03T10:15:36.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.731+0000 7fb9fa3b4700 1 -- 172.21.15.72:0/2472263384 learned_addr learned my addr 172.21.15.72:0/2472263384 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:36.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.731+0000 7fb9f9bb3700 1 --2- 172.21.15.72:0/2472263384 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9f409f240 0x7fb9f41a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.731+0000 7fb9fa3b4700 1 -- 172.21.15.72:0/2472263384 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9f409f240 msgr2=0x7fb9f41a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.731+0000 7fb9fa3b4700 1 --2- 172.21.15.72:0/2472263384 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9f409f240 0x7fb9f41a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.731+0000 7fb9fa3b4700 1 -- 172.21.15.72:0/2472263384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9f409f650 msgr2=0x7fb9f41a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.731+0000 7fb9fa3b4700 1 --2- 172.21.15.72:0/2472263384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9f409f650 0x7fb9f41a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.731+0000 7fb9fa3b4700 1 -- 172.21.15.72:0/2472263384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec009b30 con 0x7fb9f409e930 2023-10-03T10:15:36.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.731+0000 7fb9fabb5700 1 --2- 172.21.15.72:0/2472263384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9f409f650 0x7fb9f41a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.731+0000 7fb9fa3b4700 1 --2- 172.21.15.72:0/2472263384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9f409e930 0x7fb9f41a3c70 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00090b0 tx=0x7fb9f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.731+0000 7fb9eaffd700 1 -- 172.21.15.72:0/2472263384 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f00036a0 con 0x7fb9f409e930 2023-10-03T10:15:36.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.731+0000 7fb9eaffd700 1 -- 172.21.15.72:0/2472263384 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f001f070 con 0x7fb9f409e930 2023-10-03T10:15:36.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.731+0000 7fb9fc618700 1 -- 172.21.15.72:0/2472263384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f00094a0 con 0x7fb9f409e930 2023-10-03T10:15:36.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.731+0000 7fb9eaffd700 1 -- 172.21.15.72:0/2472263384 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0003a60 con 0x7fb9f409e930 2023-10-03T10:15:36.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.731+0000 7fb9fc618700 1 -- 172.21.15.72:0/2472263384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f40a0190 con 0x7fb9f409e930 2023-10-03T10:15:36.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.732+0000 7fb9eaffd700 1 -- 172.21.15.72:0/2472263384 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9f0003bc0 con 0x7fb9f409e930 2023-10-03T10:15:36.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.732+0000 7fb9eaffd700 1 -- 172.21.15.72:0/2472263384 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb9f0021070 con 0x7fb9f409e930 2023-10-03T10:15:36.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.732+0000 7fb9fc618700 1 -- 172.21.15.72:0/2472263384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f41a0b30 con 0x7fb9f409e930 2023-10-03T10:15:36.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.737+0000 7fb9eaffd700 1 -- 172.21.15.72:0/2472263384 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9f001a950 con 0x7fb9f409e930 2023-10-03T10:15:36.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.810+0000 7f0feba63700 1 Processor -- start 2023-10-03T10:15:36.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.811+0000 7f0feba63700 1 -- start start 2023-10-03T10:15:36.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.811+0000 7f0feba63700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe409e930 0x7f0fe409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.811+0000 7f0feba63700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fe409f240 0x7f0fe41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.811+0000 7f0feba63700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fe409f650 0x7f0fe4131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.811+0000 7f0feba63700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe4070940 con 0x7f0fe409f240 2023-10-03T10:15:36.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.811+0000 7f0feba63700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe406fd60 con 0x7f0fe409e930 2023-10-03T10:15:36.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.811+0000 7f0feba63700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe406fa80 con 0x7f0fe409f650 2023-10-03T10:15:36.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.811+0000 7f0fe8ffe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fe409f240 0x7f0fe41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.811+0000 7f0fe97ff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe409e930 0x7f0fe409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.811+0000 7f0fea000700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fe409f650 0x7f0fe4131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.811+0000 7f0fe8ffe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fe409f240 0x7f0fe41317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55606/0 (socket says 172.21.15.72:55606) 2023-10-03T10:15:36.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.811+0000 7f0fe97ff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe409e930 0x7f0fe409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43636/0 (socket says 172.21.15.72:43636) 2023-10-03T10:15:36.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.811+0000 7f0fe8ffe700 1 -- 172.21.15.72:0/461442875 learned_addr learned my addr 172.21.15.72:0/461442875 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:36.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.812+0000 7f0fea000700 1 -- 172.21.15.72:0/461442875 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe409e930 msgr2=0x7f0fe409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:36.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.812+0000 7f0fea000700 1 --2- 172.21.15.72:0/461442875 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe409e930 0x7f0fe409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.812+0000 7f0fea000700 1 -- 172.21.15.72:0/461442875 >> v2:172.21.15.72:3300/0 conn(0x7f0fe409f240 msgr2=0x7f0fe41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:36.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.812+0000 7f0fea000700 1 --2- 172.21.15.72:0/461442875 >> v2:172.21.15.72:3300/0 conn(0x7f0fe409f240 0x7f0fe41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.812+0000 7f0fea000700 1 -- 172.21.15.72:0/461442875 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe409fb60 con 0x7f0fe409f650 2023-10-03T10:15:36.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.812+0000 7f0fe8ffe700 1 --2- 172.21.15.72:0/461442875 >> v2:172.21.15.72:3300/0 conn(0x7f0fe409f240 0x7f0fe41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.812+0000 7f0fe97ff700 1 --2- 172.21.15.72:0/461442875 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe409e930 0x7f0fe409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.812+0000 7f0fea000700 1 --2- 172.21.15.72:0/461442875 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fe409f650 0x7f0fe4131d30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc009d90 tx=0x7f0fdc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=238e8effba62bc20 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.812+0000 7f0fdbfff700 1 -- 172.21.15.72:0/461442875 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc00e070 con 0x7f0fe409f650 2023-10-03T10:15:36.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.812+0000 7f0fdbfff700 1 -- 172.21.15.72:0/461442875 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc00bb20 con 0x7f0fe409f650 2023-10-03T10:15:36.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.812+0000 7f0fdbfff700 1 -- 172.21.15.72:0/461442875 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc012430 con 0x7f0fe409f650 2023-10-03T10:15:36.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.813+0000 7f0feba63700 1 -- 172.21.15.72:0/461442875 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fe409f650 msgr2=0x7f0fe4131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.813+0000 7f0feba63700 1 --2- 172.21.15.72:0/461442875 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fe409f650 0x7f0fe4131d30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc009d90 tx=0x7f0fdc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:36.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.813+0000 7f0feba63700 1 -- 172.21.15.72:0/461442875 shutdown_connections 2023-10-03T10:15:36.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.813+0000 7f0feba63700 1 --2- 172.21.15.72:0/461442875 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fe409f650 0x7f0fe4131d30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.813+0000 7f0feba63700 1 --2- 172.21.15.72:0/461442875 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe409e930 0x7f0fe409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.813+0000 7f0feba63700 1 --2- 172.21.15.72:0/461442875 >> v2:172.21.15.72:3300/0 conn(0x7f0fe409f240 0x7f0fe41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.813+0000 7f0feba63700 1 -- 172.21.15.72:0/461442875 >> 172.21.15.72:0/461442875 conn(0x7f0fe40a4210 msgr2=0x7f0fe40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.813+0000 7f0feba63700 1 -- 172.21.15.72:0/461442875 shutdown_connections 2023-10-03T10:15:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.813+0000 7f0feba63700 1 -- 172.21.15.72:0/461442875 wait complete. 2023-10-03T10:15:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.814+0000 7f0feba63700 1 Processor -- start 2023-10-03T10:15:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.814+0000 7f0feba63700 1 -- start start 2023-10-03T10:15:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.814+0000 7f0feba63700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fe409e930 0x7f0fe41c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.814+0000 7f0feba63700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe409f240 0x7f0fe41c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.814+0000 7f0feba63700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe409f650 0x7f0fe41c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.814+0000 7f0feba63700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe41a4da0 con 0x7f0fe409f650 2023-10-03T10:15:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.814+0000 7f0feba63700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe41a8210 con 0x7f0fe409f240 2023-10-03T10:15:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.814+0000 7f0feba63700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe4071d20 con 0x7f0fe409e930 2023-10-03T10:15:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.814+0000 7f0fe97ff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fe409e930 0x7f0fe41c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.814+0000 7f0fea000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe409f650 0x7f0fe41c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.814+0000 7f0fea000700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe409f650 0x7f0fe41c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55614/0 (socket says 172.21.15.72:55614) 2023-10-03T10:15:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.814+0000 7f0fe97ff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fe409e930 0x7f0fe41c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55388/0 (socket says 172.21.15.72:55388) 2023-10-03T10:15:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.814+0000 7f0fea000700 1 -- 172.21.15.72:0/893585679 learned_addr learned my addr 172.21.15.72:0/893585679 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.814+0000 7f0fe8ffe700 1 --2- 172.21.15.72:0/893585679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe409f240 0x7f0fe41c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.815+0000 7f0fea000700 1 -- 172.21.15.72:0/893585679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fe409e930 msgr2=0x7f0fe41c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.815+0000 7f0fea000700 1 --2- 172.21.15.72:0/893585679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fe409e930 0x7f0fe41c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.815+0000 7f0fea000700 1 -- 172.21.15.72:0/893585679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe409f240 msgr2=0x7f0fe41c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.815+0000 7f0fea000700 1 --2- 172.21.15.72:0/893585679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe409f240 0x7f0fe41c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.815+0000 7f0fea000700 1 -- 172.21.15.72:0/893585679 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe00094a0 con 0x7f0fe409f650 2023-10-03T10:15:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.815+0000 7f0fe8ffe700 1 --2- 172.21.15.72:0/893585679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe409f240 0x7f0fe41c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.815+0000 7f0fea000700 1 --2- 172.21.15.72:0/893585679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe409f650 0x7f0fe41c8c20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc014040 tx=0x7f0fdc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.815+0000 7f0fd9ffb700 1 -- 172.21.15.72:0/893585679 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0044d0 con 0x7f0fe409f650 2023-10-03T10:15:36.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.815+0000 7f0fd9ffb700 1 -- 172.21.15.72:0/893585679 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc020070 con 0x7f0fe409f650 2023-10-03T10:15:36.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.815+0000 7f0feba63700 1 -- 172.21.15.72:0/893585679 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd4009550 con 0x7f0fe409f650 2023-10-03T10:15:36.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.815+0000 7f0fd9ffb700 1 -- 172.21.15.72:0/893585679 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc004890 con 0x7f0fe409f650 2023-10-03T10:15:36.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.815+0000 7f0feba63700 1 -- 172.21.15.72:0/893585679 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fdc009a70 con 0x7f0fe409f650 2023-10-03T10:15:36.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.816+0000 7f0fd9ffb700 1 -- 172.21.15.72:0/893585679 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0fdc012430 con 0x7f0fe409f650 2023-10-03T10:15:36.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.816+0000 7f0feba63700 1 -- 172.21.15.72:0/893585679 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe4074ea0 con 0x7f0fe409f650 2023-10-03T10:15:36.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.816+0000 7f0fd9ffb700 1 -- 172.21.15.72:0/893585679 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0fdc022070 con 0x7f0fe409f650 2023-10-03T10:15:36.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.821+0000 7f0fd9ffb700 1 -- 172.21.15.72:0/893585679 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0fdc0269d0 con 0x7f0fe409f650 2023-10-03T10:15:36.886 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:36.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.933+0000 7fb9fc618700 1 -- 172.21.15.72:0/2472263384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb9f40a3570 con 0x7fb9f409e930 2023-10-03T10:15:36.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.933+0000 7fb9eaffd700 1 -- 172.21.15.72:0/2472263384 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9f0015020 con 0x7fb9f409e930 2023-10-03T10:15:36.934 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:36.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.935+0000 7fb9fc618700 1 -- 172.21.15.72:0/2472263384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9f409e930 msgr2=0x7fb9f41a3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.935+0000 7fb9fc618700 1 --2- 172.21.15.72:0/2472263384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9f409e930 0x7fb9f41a3c70 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00090b0 tx=0x7fb9f0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:36.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.935+0000 7fb9fc618700 1 -- 172.21.15.72:0/2472263384 shutdown_connections 2023-10-03T10:15:36.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.935+0000 7fb9fc618700 1 --2- 172.21.15.72:0/2472263384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9f409e930 0x7fb9f41a3c70 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.935+0000 7fb9fc618700 1 --2- 172.21.15.72:0/2472263384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9f409f650 0x7fb9f41a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.935+0000 7fb9fc618700 1 --2- 172.21.15.72:0/2472263384 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9f409f240 0x7fb9f41a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.935+0000 7fb9fc618700 1 -- 172.21.15.72:0/2472263384 >> 172.21.15.72:0/2472263384 conn(0x7fb9f40a4210 msgr2=0x7fb9f41b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:36.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.935+0000 7fb9fc618700 1 -- 172.21.15.72:0/2472263384 shutdown_connections 2023-10-03T10:15:36.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:36.935+0000 7fb9fc618700 1 -- 172.21.15.72:0/2472263384 wait complete. 2023-10-03T10:15:36.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:37.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.012+0000 7fa8a4a80700 1 Processor -- start 2023-10-03T10:15:37.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.012+0000 7fa8a4a80700 1 -- start start 2023-10-03T10:15:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.012+0000 7fa8a4a80700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8a00a1510 0x7fa8a0138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.012+0000 7fa8a4a80700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8a0139250 0x7fa8a013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.012+0000 7fa8a4a80700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a009edd0 con 0x7fa8a00a0a30 2023-10-03T10:15:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.012+0000 7fa8a4a80700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a00a18e0 con 0x7fa8a0139250 2023-10-03T10:15:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.012+0000 7fa8a4a80700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a009e1f0 con 0x7fa8a00a1510 2023-10-03T10:15:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.013+0000 7fa89dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8a00a1510 0x7fa8a0138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.013+0000 7fa89ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8a0139250 0x7fa8a013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.013+0000 7fa89dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8a00a1510 0x7fa8a0138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55392/0 (socket says 172.21.15.72:55392) 2023-10-03T10:15:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.013+0000 7fa89dd9b700 1 -- 172.21.15.72:0/2166535722 learned_addr learned my addr 172.21.15.72:0/2166535722 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.013+0000 7fa89dd9b700 1 -- 172.21.15.72:0/2166535722 >> v2:172.21.15.72:3300/0 conn(0x7fa8a0139250 msgr2=0x7fa8a013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.013+0000 7fa89dd9b700 1 --2- 172.21.15.72:0/2166535722 >> v2:172.21.15.72:3300/0 conn(0x7fa8a0139250 0x7fa8a013b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.013+0000 7fa89dd9b700 1 -- 172.21.15.72:0/2166535722 >> v1:172.21.15.72:6789/0 conn(0x7fa8a00a0a30 legacy=0x7fa8a00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.013+0000 7fa89dd9b700 1 -- 172.21.15.72:0/2166535722 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a009dc50 con 0x7fa8a00a1510 2023-10-03T10:15:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.013+0000 7fa89d59a700 1 -- 172.21.15.72:0/2166535722 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130140347 0 0) 0x7fa8a009edd0 con 0x7fa8a00a0a30 2023-10-03T10:15:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.013+0000 7fa89ed9d700 1 --2- 172.21.15.72:0/2166535722 >> v2:172.21.15.72:3300/0 conn(0x7fa8a0139250 0x7fa8a013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.013+0000 7fa89dd9b700 1 --2- 172.21.15.72:0/2166535722 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8a00a1510 0x7fa8a0138d10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa894009920 tx=0x7fa894009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6697d0fdd7d5d341 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.013+0000 7fa89d59a700 1 -- 172.21.15.72:0/2166535722 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894011830 con 0x7fa8a00a1510 2023-10-03T10:15:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.013+0000 7fa89d59a700 1 -- 172.21.15.72:0/2166535722 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa894011990 con 0x7fa8a00a1510 2023-10-03T10:15:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.013+0000 7fa89d59a700 1 -- 172.21.15.72:0/2166535722 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894011d20 con 0x7fa8a00a1510 2023-10-03T10:15:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.014+0000 7fa8a4a80700 1 -- 172.21.15.72:0/2166535722 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8a00a1510 msgr2=0x7fa8a0138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.014+0000 7fa8a4a80700 1 --2- 172.21.15.72:0/2166535722 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8a00a1510 0x7fa8a0138d10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa894009920 tx=0x7fa894009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.014+0000 7fa8a4a80700 1 -- 172.21.15.72:0/2166535722 shutdown_connections 2023-10-03T10:15:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.014+0000 7fa8a4a80700 1 --2- 172.21.15.72:0/2166535722 >> v2:172.21.15.72:3300/0 conn(0x7fa8a0139250 0x7fa8a013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.014+0000 7fa8a4a80700 1 --2- 172.21.15.72:0/2166535722 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8a00a1510 0x7fa8a0138d10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.014+0000 7fa8a4a80700 1 -- 172.21.15.72:0/2166535722 >> 172.21.15.72:0/2166535722 conn(0x7fa8a00a6550 msgr2=0x7fa8a00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.014+0000 7fa8a4a80700 1 -- 172.21.15.72:0/2166535722 shutdown_connections 2023-10-03T10:15:37.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.014+0000 7fa8a4a80700 1 -- 172.21.15.72:0/2166535722 wait complete. 2023-10-03T10:15:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.015+0000 7fa8a4a80700 1 Processor -- start 2023-10-03T10:15:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.015+0000 7fa8a4a80700 1 -- start start 2023-10-03T10:15:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.015+0000 7fa8a4a80700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8a00a0a30 0x7fa8a01227c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.015+0000 7fa8a4a80700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8a00a1510 0x7fa8a0122d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.015+0000 7fa8a4a80700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8a0139250 0x7fa8a0123240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.015+0000 7fa8a4a80700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a01243d0 con 0x7fa8a00a1510 2023-10-03T10:15:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.015+0000 7fa8a4a80700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a01386b0 con 0x7fa8a0139250 2023-10-03T10:15:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.015+0000 7fa8a4a80700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a01249e0 con 0x7fa8a00a0a30 2023-10-03T10:15:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.015+0000 7fa89e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8a00a0a30 0x7fa8a01227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.015+0000 7fa89ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8a0139250 0x7fa8a0123240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.015+0000 7fa89dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8a00a1510 0x7fa8a0122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.015+0000 7fa89e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8a00a0a30 0x7fa8a01227c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55394/0 (socket says 172.21.15.72:55394) 2023-10-03T10:15:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.015+0000 7fa89e59c700 1 -- 172.21.15.72:0/1482589278 learned_addr learned my addr 172.21.15.72:0/1482589278 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.015+0000 7fa89ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8a0139250 0x7fa8a0123240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43656/0 (socket says 172.21.15.72:43656) 2023-10-03T10:15:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.016+0000 7fa89dd9b700 1 -- 172.21.15.72:0/1482589278 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8a00a0a30 msgr2=0x7fa8a01227c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.016+0000 7fa89dd9b700 1 --2- 172.21.15.72:0/1482589278 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8a00a0a30 0x7fa8a01227c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.016+0000 7fa89dd9b700 1 -- 172.21.15.72:0/1482589278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8a0139250 msgr2=0x7fa8a0123240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.016+0000 7fa89dd9b700 1 --2- 172.21.15.72:0/1482589278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8a0139250 0x7fa8a0123240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.016+0000 7fa89dd9b700 1 -- 172.21.15.72:0/1482589278 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa898009a70 con 0x7fa8a00a1510 2023-10-03T10:15:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.016+0000 7fa89e59c700 1 --2- 172.21.15.72:0/1482589278 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8a00a0a30 0x7fa8a01227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.016+0000 7fa89dd9b700 1 --2- 172.21.15.72:0/1482589278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8a00a1510 0x7fa8a0122d00 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa894016000 tx=0x7fa894004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.016+0000 7fa88effd700 1 -- 172.21.15.72:0/1482589278 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894004450 con 0x7fa8a00a1510 2023-10-03T10:15:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.016+0000 7fa88effd700 1 -- 172.21.15.72:0/1482589278 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8940045d0 con 0x7fa8a00a1510 2023-10-03T10:15:37.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.016+0000 7fa8a4a80700 1 -- 172.21.15.72:0/1482589278 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa894009550 con 0x7fa8a00a1510 2023-10-03T10:15:37.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.016+0000 7fa88effd700 1 -- 172.21.15.72:0/1482589278 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8940038e0 con 0x7fa8a00a1510 2023-10-03T10:15:37.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.016+0000 7fa8a4a80700 1 -- 172.21.15.72:0/1482589278 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a0126000 con 0x7fa8a00a1510 2023-10-03T10:15:37.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.017+0000 7fa88effd700 1 -- 172.21.15.72:0/1482589278 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa894003a40 con 0x7fa8a00a1510 2023-10-03T10:15:37.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.017+0000 7fa8a4a80700 1 -- 172.21.15.72:0/1482589278 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a01261f0 con 0x7fa8a00a1510 2023-10-03T10:15:37.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.017+0000 7fa88effd700 1 -- 172.21.15.72:0/1482589278 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa894021030 con 0x7fa8a00a1510 2023-10-03T10:15:37.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.021+0000 7f0feba63700 1 -- 172.21.15.72:0/893585679 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0fe41a6cf0 con 0x7f0fe409f650 2023-10-03T10:15:37.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.022+0000 7f0fd9ffb700 1 -- 172.21.15.72:0/893585679 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0fdc011390 con 0x7f0fe409f650 2023-10-03T10:15:37.022 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:37.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.022+0000 7fa88effd700 1 -- 172.21.15.72:0/1482589278 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa89401a7b0 con 0x7fa8a00a1510 2023-10-03T10:15:37.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.024+0000 7f0feba63700 1 -- 172.21.15.72:0/893585679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe409f650 msgr2=0x7f0fe41c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.024+0000 7f0feba63700 1 --2- 172.21.15.72:0/893585679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe409f650 0x7f0fe41c8c20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc014040 tx=0x7f0fdc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.024+0000 7f0feba63700 1 -- 172.21.15.72:0/893585679 shutdown_connections 2023-10-03T10:15:37.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.024+0000 7f0feba63700 1 --2- 172.21.15.72:0/893585679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe409f650 0x7f0fe41c8c20 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.024+0000 7f0feba63700 1 --2- 172.21.15.72:0/893585679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fe409e930 0x7f0fe41c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.024+0000 7f0feba63700 1 --2- 172.21.15.72:0/893585679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe409f240 0x7f0fe41c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.024+0000 7f0feba63700 1 -- 172.21.15.72:0/893585679 >> 172.21.15.72:0/893585679 conn(0x7f0fe40a4210 msgr2=0x7f0fe41bbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.024+0000 7f0feba63700 1 -- 172.21.15.72:0/893585679 shutdown_connections 2023-10-03T10:15:37.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.024+0000 7f0feba63700 1 -- 172.21.15.72:0/893585679 wait complete. 2023-10-03T10:15:37.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:37.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.207+0000 7fa8a4a80700 1 -- 172.21.15.72:0/1482589278 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa8a0074ea0 con 0x7fa8a00a1510 2023-10-03T10:15:37.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.208+0000 7fa88effd700 1 -- 172.21.15.72:0/1482589278 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa894015030 con 0x7fa8a00a1510 2023-10-03T10:15:37.209 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:37.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.210+0000 7fa8a4a80700 1 -- 172.21.15.72:0/1482589278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8a00a1510 msgr2=0x7fa8a0122d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.210+0000 7fa8a4a80700 1 --2- 172.21.15.72:0/1482589278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8a00a1510 0x7fa8a0122d00 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa894016000 tx=0x7fa894004750 comp rx=0 tx=0).stop 2023-10-03T10:15:37.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.210+0000 7fa8a4a80700 1 -- 172.21.15.72:0/1482589278 shutdown_connections 2023-10-03T10:15:37.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.210+0000 7fa8a4a80700 1 --2- 172.21.15.72:0/1482589278 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8a0139250 0x7fa8a0123240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.210+0000 7fa8a4a80700 1 --2- 172.21.15.72:0/1482589278 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa8a00a0a30 0x7fa8a01227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.210+0000 7fa8a4a80700 1 --2- 172.21.15.72:0/1482589278 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8a00a1510 0x7fa8a0122d00 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.210+0000 7fa8a4a80700 1 -- 172.21.15.72:0/1482589278 >> 172.21.15.72:0/1482589278 conn(0x7fa8a00a6550 msgr2=0x7fa8a00a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.210+0000 7fa8a4a80700 1 -- 172.21.15.72:0/1482589278 shutdown_connections 2023-10-03T10:15:37.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.210+0000 7fa8a4a80700 1 -- 172.21.15.72:0/1482589278 wait complete. 2023-10-03T10:15:37.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:37.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:37.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.615+0000 7f40edb93700 1 Processor -- start 2023-10-03T10:15:37.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.615+0000 7f40edb93700 1 -- start start 2023-10-03T10:15:37.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40edb93700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40e81316c0 0x7f40e8131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40edb93700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e806ae80 0x7f40e8139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40edb93700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e809e130 con 0x7f40e809d9f0 2023-10-03T10:15:37.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40edb93700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e81312b0 con 0x7f40e806ae80 2023-10-03T10:15:37.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40edb93700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40e809f6e0 con 0x7f40e81316c0 2023-10-03T10:15:37.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40e7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e806ae80 0x7f40e8139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40e77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40e81316c0 0x7f40e8131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40e7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e806ae80 0x7f40e8139550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43666/0 (socket says 172.21.15.72:43666) 2023-10-03T10:15:37.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40e77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40e81316c0 0x7f40e8131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:55404/0 (socket says 172.21.15.72:55404) 2023-10-03T10:15:37.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40e7fff700 1 -- 172.21.15.72:0/4245927009 learned_addr learned my addr 172.21.15.72:0/4245927009 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:37.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40e7fff700 1 -- 172.21.15.72:0/4245927009 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40e81316c0 msgr2=0x7f40e8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40e7fff700 1 --2- 172.21.15.72:0/4245927009 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40e81316c0 0x7f40e8131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40e7fff700 1 -- 172.21.15.72:0/4245927009 >> v1:172.21.15.72:6789/0 conn(0x7f40e809d9f0 legacy=0x7f40e806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40e67fc700 1 -- 172.21.15.72:0/4245927009 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571139980 0 0) 0x7f40d8001110 con 0x7f40e809d9f0 2023-10-03T10:15:37.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40e7fff700 1 -- 172.21.15.72:0/4245927009 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e809e760 con 0x7f40e806ae80 2023-10-03T10:15:37.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40e7fff700 1 --2- 172.21.15.72:0/4245927009 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e806ae80 0x7f40e8139550 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f40e0009e80 tx=0x7f40e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deeb43d7d3bc9996 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40e67fc700 1 -- 172.21.15.72:0/4245927009 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e000e070 con 0x7f40e806ae80 2023-10-03T10:15:37.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40e67fc700 1 -- 172.21.15.72:0/4245927009 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e000b910 con 0x7f40e806ae80 2023-10-03T10:15:37.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.616+0000 7f40e67fc700 1 -- 172.21.15.72:0/4245927009 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e000bcc0 con 0x7f40e806ae80 2023-10-03T10:15:37.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.617+0000 7f40edb93700 1 -- 172.21.15.72:0/4245927009 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e806ae80 msgr2=0x7f40e8139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.617+0000 7f40edb93700 1 --2- 172.21.15.72:0/4245927009 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e806ae80 0x7f40e8139550 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f40e0009e80 tx=0x7f40e000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:37.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.617+0000 7f40edb93700 1 -- 172.21.15.72:0/4245927009 shutdown_connections 2023-10-03T10:15:37.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.617+0000 7f40edb93700 1 --2- 172.21.15.72:0/4245927009 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e806ae80 0x7f40e8139550 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.617+0000 7f40edb93700 1 --2- 172.21.15.72:0/4245927009 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40e81316c0 0x7f40e8131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.617+0000 7f40edb93700 1 -- 172.21.15.72:0/4245927009 >> 172.21.15.72:0/4245927009 conn(0x7f40e8066f50 msgr2=0x7f40e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.617+0000 7f40edb93700 1 -- 172.21.15.72:0/4245927009 shutdown_connections 2023-10-03T10:15:37.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.617+0000 7f40edb93700 1 -- 172.21.15.72:0/4245927009 wait complete. 2023-10-03T10:15:37.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.618+0000 7f40edb93700 1 Processor -- start 2023-10-03T10:15:37.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.618+0000 7f40edb93700 1 -- start start 2023-10-03T10:15:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40edb93700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e806ae80 0x7f40e80709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40edb93700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40e809d9f0 0x7f40e8070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40edb93700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e81316c0 0x7f40e8071450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40edb93700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e811b0f0 con 0x7f40e806ae80 2023-10-03T10:15:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40edb93700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e811a6c0 con 0x7f40e81316c0 2023-10-03T10:15:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40edb93700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40e80a36d0 con 0x7f40e809d9f0 2023-10-03T10:15:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40e77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e806ae80 0x7f40e80709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40e7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e81316c0 0x7f40e8071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40e6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40e809d9f0 0x7f40e8070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40e77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e806ae80 0x7f40e80709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55644/0 (socket says 172.21.15.72:55644) 2023-10-03T10:15:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40e7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e81316c0 0x7f40e8071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43672/0 (socket says 172.21.15.72:43672) 2023-10-03T10:15:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40e77fe700 1 -- 172.21.15.72:0/3966694351 learned_addr learned my addr 172.21.15.72:0/3966694351 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40e6ffd700 1 -- 172.21.15.72:0/3966694351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e81316c0 msgr2=0x7f40e8071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40e6ffd700 1 --2- 172.21.15.72:0/3966694351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e81316c0 0x7f40e8071450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40e6ffd700 1 -- 172.21.15.72:0/3966694351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e806ae80 msgr2=0x7f40e80709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40e6ffd700 1 --2- 172.21.15.72:0/3966694351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e806ae80 0x7f40e80709d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40e6ffd700 1 -- 172.21.15.72:0/3966694351 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e0009b30 con 0x7f40e809d9f0 2023-10-03T10:15:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40e7fff700 1 --2- 172.21.15.72:0/3966694351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e81316c0 0x7f40e8071450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40e6ffd700 1 --2- 172.21.15.72:0/3966694351 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40e809d9f0 0x7f40e8070f10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f40d8000f60 tx=0x7f40d800ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40dffff700 1 -- 172.21.15.72:0/3966694351 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d80054e0 con 0x7f40e809d9f0 2023-10-03T10:15:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40dffff700 1 -- 172.21.15.72:0/3966694351 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d8001d30 con 0x7f40e809d9f0 2023-10-03T10:15:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40edb93700 1 -- 172.21.15.72:0/3966694351 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e812b900 con 0x7f40e809d9f0 2023-10-03T10:15:37.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40dffff700 1 -- 172.21.15.72:0/3966694351 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d80038c0 con 0x7f40e809d9f0 2023-10-03T10:15:37.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.619+0000 7f40edb93700 1 -- 172.21.15.72:0/3966694351 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e811ad00 con 0x7f40e809d9f0 2023-10-03T10:15:37.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.620+0000 7f40dffff700 1 -- 172.21.15.72:0/3966694351 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40d8003a20 con 0x7f40e809d9f0 2023-10-03T10:15:37.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.620+0000 7f40edb93700 1 -- 172.21.15.72:0/3966694351 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e8074ea0 con 0x7f40e809d9f0 2023-10-03T10:15:37.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.620+0000 7f40dffff700 1 -- 172.21.15.72:0/3966694351 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f40d803e8f0 con 0x7f40e809d9f0 2023-10-03T10:15:37.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.625+0000 7f40dffff700 1 -- 172.21.15.72:0/3966694351 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40d801b3b0 con 0x7f40e809d9f0 2023-10-03T10:15:37.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.809+0000 7f40edb93700 1 -- 172.21.15.72:0/3966694351 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f40e809e130 con 0x7f40e809d9f0 2023-10-03T10:15:37.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.810+0000 7f40dffff700 1 -- 172.21.15.72:0/3966694351 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f40e809e130 con 0x7f40e809d9f0 2023-10-03T10:15:37.810 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:37.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.811+0000 7f40edb93700 1 -- 172.21.15.72:0/3966694351 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40e809d9f0 msgr2=0x7f40e8070f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.811+0000 7f40edb93700 1 --2- 172.21.15.72:0/3966694351 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40e809d9f0 0x7f40e8070f10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f40d8000f60 tx=0x7f40d800ca30 comp rx=0 tx=0).stop 2023-10-03T10:15:37.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.812+0000 7f40edb93700 1 -- 172.21.15.72:0/3966694351 shutdown_connections 2023-10-03T10:15:37.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.812+0000 7f40edb93700 1 --2- 172.21.15.72:0/3966694351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e806ae80 0x7f40e80709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.812+0000 7f40edb93700 1 --2- 172.21.15.72:0/3966694351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e81316c0 0x7f40e8071450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.812+0000 7f40edb93700 1 --2- 172.21.15.72:0/3966694351 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40e809d9f0 0x7f40e8070f10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.812+0000 7f40edb93700 1 -- 172.21.15.72:0/3966694351 >> 172.21.15.72:0/3966694351 conn(0x7f40e8066f50 msgr2=0x7f40e80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.812+0000 7f40edb93700 1 -- 172.21.15.72:0/3966694351 shutdown_connections 2023-10-03T10:15:37.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:37.812+0000 7f40edb93700 1 -- 172.21.15.72:0/3966694351 wait complete. 2023-10-03T10:15:37.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:37.949 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:38.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.073+0000 7f660afc1700 1 Processor -- start 2023-10-03T10:15:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.073+0000 7f660afc1700 1 -- start start 2023-10-03T10:15:38.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.073+0000 7f660afc1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f660409e930 0x7f660409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.073+0000 7f660afc1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f660409f240 0x7f66041317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.073+0000 7f660afc1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6604070940 con 0x7f660409f650 2023-10-03T10:15:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.073+0000 7f660afc1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660406fd60 con 0x7f660409e930 2023-10-03T10:15:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.073+0000 7f660afc1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660406fa80 con 0x7f660409f240 2023-10-03T10:15:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.073+0000 7f6608d5d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f660409e930 0x7f660409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.073+0000 7f6603fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f660409f240 0x7f66041317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.073+0000 7f6608d5d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f660409e930 0x7f660409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55652/0 (socket says 172.21.15.72:55652) 2023-10-03T10:15:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.073+0000 7f6608d5d700 1 -- 172.21.15.72:0/2943279225 learned_addr learned my addr 172.21.15.72:0/2943279225 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.074+0000 7f6608d5d700 1 -- 172.21.15.72:0/2943279225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f660409f240 msgr2=0x7f66041317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.074+0000 7f6608d5d700 1 --2- 172.21.15.72:0/2943279225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f660409f240 0x7f66041317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.074+0000 7f6608d5d700 1 -- 172.21.15.72:0/2943279225 >> v1:172.21.15.72:6789/0 conn(0x7f660409f650 legacy=0x7f6604131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.074+0000 7f6608d5d700 1 -- 172.21.15.72:0/2943279225 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660409fb60 con 0x7f660409e930 2023-10-03T10:15:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.074+0000 7f6603fff700 1 --2- 172.21.15.72:0/2943279225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f660409f240 0x7f66041317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.074+0000 7f6608d5d700 1 --2- 172.21.15.72:0/2943279225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f660409e930 0x7f660409ed00 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f65f80098f0 tx=0x7f65f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea11328775d7b3e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.074+0000 7f66037fe700 1 -- 172.21.15.72:0/2943279225 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8011830 con 0x7f660409e930 2023-10-03T10:15:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.074+0000 7f66037fe700 1 -- 172.21.15.72:0/2943279225 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f8011990 con 0x7f660409e930 2023-10-03T10:15:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.074+0000 7f66037fe700 1 -- 172.21.15.72:0/2943279225 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8011d20 con 0x7f660409e930 2023-10-03T10:15:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.075+0000 7f660afc1700 1 -- 172.21.15.72:0/2943279225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f660409e930 msgr2=0x7f660409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.075+0000 7f660afc1700 1 --2- 172.21.15.72:0/2943279225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f660409e930 0x7f660409ed00 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f65f80098f0 tx=0x7f65f8009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.075+0000 7f660afc1700 1 -- 172.21.15.72:0/2943279225 shutdown_connections 2023-10-03T10:15:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.075+0000 7f660afc1700 1 --2- 172.21.15.72:0/2943279225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f660409e930 0x7f660409ed00 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.075+0000 7f660afc1700 1 --2- 172.21.15.72:0/2943279225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f660409f240 0x7f66041317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.075+0000 7f660afc1700 1 -- 172.21.15.72:0/2943279225 >> 172.21.15.72:0/2943279225 conn(0x7f66040a4210 msgr2=0x7f66040a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.075+0000 7f660afc1700 1 -- 172.21.15.72:0/2943279225 shutdown_connections 2023-10-03T10:15:38.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.075+0000 7f660afc1700 1 -- 172.21.15.72:0/2943279225 wait complete. 2023-10-03T10:15:38.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.076+0000 7f660afc1700 1 Processor -- start 2023-10-03T10:15:38.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.076+0000 7f660afc1700 1 -- start start 2023-10-03T10:15:38.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f660afc1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660409e930 0x7f66041a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f660afc1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f660409f240 0x7f66041a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f660afc1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f660409f650 0x7f66041a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f660afc1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66041a8260 con 0x7f660409f240 2023-10-03T10:15:38.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f660afc1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66041a78a0 con 0x7f660409f650 2023-10-03T10:15:38.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f660afc1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66041a6be0 con 0x7f660409e930 2023-10-03T10:15:38.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f6603fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f660409f240 0x7f66041a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f6608d5d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660409e930 0x7f66041a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f660955e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f660409f650 0x7f66041a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f6603fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f660409f240 0x7f66041a42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55658/0 (socket says 172.21.15.72:55658) 2023-10-03T10:15:38.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f6603fff700 1 -- 172.21.15.72:0/2252299825 learned_addr learned my addr 172.21.15.72:0/2252299825 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:38.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f660955e700 1 -- 172.21.15.72:0/2252299825 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660409e930 msgr2=0x7f66041a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f660955e700 1 --2- 172.21.15.72:0/2252299825 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660409e930 0x7f66041a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f660955e700 1 -- 172.21.15.72:0/2252299825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f660409f240 msgr2=0x7f66041a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f660955e700 1 --2- 172.21.15.72:0/2252299825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f660409f240 0x7f66041a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f660955e700 1 -- 172.21.15.72:0/2252299825 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f00094a0 con 0x7f660409f650 2023-10-03T10:15:38.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f6603fff700 1 --2- 172.21.15.72:0/2252299825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f660409f240 0x7f66041a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.077+0000 7f660955e700 1 --2- 172.21.15.72:0/2252299825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f660409f650 0x7f66041a4800 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00cbc0 tx=0x7f65fc00ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.078+0000 7f66017fa700 1 -- 172.21.15.72:0/2252299825 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc003c00 con 0x7f660409f650 2023-10-03T10:15:38.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.078+0000 7f66017fa700 1 -- 172.21.15.72:0/2252299825 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc003d60 con 0x7f660409f650 2023-10-03T10:15:38.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.078+0000 7f660afc1700 1 -- 172.21.15.72:0/2252299825 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f8009550 con 0x7f660409f650 2023-10-03T10:15:38.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.078+0000 7f66017fa700 1 -- 172.21.15.72:0/2252299825 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc00aa40 con 0x7f660409f650 2023-10-03T10:15:38.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.078+0000 7f660afc1700 1 -- 172.21.15.72:0/2252299825 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66040a0190 con 0x7f660409f650 2023-10-03T10:15:38.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.078+0000 7f660afc1700 1 -- 172.21.15.72:0/2252299825 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66041a59f0 con 0x7f660409f650 2023-10-03T10:15:38.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.079+0000 7f66017fa700 1 -- 172.21.15.72:0/2252299825 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65fc00aba0 con 0x7f660409f650 2023-10-03T10:15:38.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.079+0000 7f66017fa700 1 -- 172.21.15.72:0/2252299825 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f65fc0400f0 con 0x7f660409f650 2023-10-03T10:15:38.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.083+0000 7f66017fa700 1 -- 172.21.15.72:0/2252299825 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65fc011970 con 0x7f660409f650 2023-10-03T10:15:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.163+0000 7f38ceb1d700 1 Processor -- start 2023-10-03T10:15:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.163+0000 7f38ceb1d700 1 -- start start 2023-10-03T10:15:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.163+0000 7f38ceb1d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38c81316c0 0x7f38c8131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.163+0000 7f38ceb1d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38c809d9f0 0x7f38c806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.163+0000 7f38ceb1d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c809e130 con 0x7f38c806acb0 2023-10-03T10:15:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.163+0000 7f38ceb1d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c81312b0 con 0x7f38c81316c0 2023-10-03T10:15:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.163+0000 7f38ceb1d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38c809f6e0 con 0x7f38c809d9f0 2023-10-03T10:15:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.164+0000 7f38cc8b9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38c81316c0 0x7f38c8131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.164+0000 7f38c7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38c809d9f0 0x7f38c806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.164+0000 7f38cd0ba700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f38c806acb0 0x7f38c8138540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54408/0 (socket says 172.21.15.72:54408) 2023-10-03T10:15:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.164+0000 7f38cc8b9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38c81316c0 0x7f38c8131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43696/0 (socket says 172.21.15.72:43696) 2023-10-03T10:15:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.164+0000 7f38cd0ba700 1 -- 172.21.15.72:0/2222648794 learned_addr learned my addr 172.21.15.72:0/2222648794 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.164+0000 7f38cc8b9700 1 -- 172.21.15.72:0/2222648794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38c809d9f0 msgr2=0x7f38c806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.164+0000 7f38cc8b9700 1 --2- 172.21.15.72:0/2222648794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38c809d9f0 0x7f38c806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.164+0000 7f38cc8b9700 1 -- 172.21.15.72:0/2222648794 >> v1:172.21.15.72:6789/0 conn(0x7f38c806acb0 legacy=0x7f38c8138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.164+0000 7f38c77fe700 1 -- 172.21.15.72:0/2222648794 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668947084 0 0) 0x7f38c0001490 con 0x7f38c806acb0 2023-10-03T10:15:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.164+0000 7f38cc8b9700 1 -- 172.21.15.72:0/2222648794 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c809e760 con 0x7f38c81316c0 2023-10-03T10:15:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.164+0000 7f38c7fff700 1 --2- 172.21.15.72:0/2222648794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38c809d9f0 0x7f38c806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.164+0000 7f38cc8b9700 1 --2- 172.21.15.72:0/2222648794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38c81316c0 0x7f38c8131a90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009870 tx=0x7f38bc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2242ed6e271079a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.164+0000 7f38c77fe700 1 -- 172.21.15.72:0/2222648794 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc011830 con 0x7f38c81316c0 2023-10-03T10:15:38.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.164+0000 7f38c77fe700 1 -- 172.21.15.72:0/2222648794 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc011990 con 0x7f38c81316c0 2023-10-03T10:15:38.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.164+0000 7f38c77fe700 1 -- 172.21.15.72:0/2222648794 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc011d20 con 0x7f38c81316c0 2023-10-03T10:15:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.165+0000 7f38ceb1d700 1 -- 172.21.15.72:0/2222648794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38c81316c0 msgr2=0x7f38c8131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.165+0000 7f38ceb1d700 1 --2- 172.21.15.72:0/2222648794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38c81316c0 0x7f38c8131a90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009870 tx=0x7f38bc009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.165+0000 7f38ceb1d700 1 -- 172.21.15.72:0/2222648794 shutdown_connections 2023-10-03T10:15:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.165+0000 7f38ceb1d700 1 --2- 172.21.15.72:0/2222648794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38c81316c0 0x7f38c8131a90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.165+0000 7f38ceb1d700 1 --2- 172.21.15.72:0/2222648794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38c809d9f0 0x7f38c806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.165+0000 7f38ceb1d700 1 -- 172.21.15.72:0/2222648794 >> 172.21.15.72:0/2222648794 conn(0x7f38c8066f50 msgr2=0x7f38c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.165+0000 7f38ceb1d700 1 -- 172.21.15.72:0/2222648794 shutdown_connections 2023-10-03T10:15:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.165+0000 7f38ceb1d700 1 -- 172.21.15.72:0/2222648794 wait complete. 2023-10-03T10:15:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.166+0000 7f38ceb1d700 1 Processor -- start 2023-10-03T10:15:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.166+0000 7f38ceb1d700 1 -- start start 2023-10-03T10:15:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.166+0000 7f38ceb1d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38c806acb0 0x7f38c8070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.166+0000 7f38ceb1d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38c809d9f0 0x7f38c8070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.166+0000 7f38ceb1d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38c81316c0 0x7f38c8071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.166+0000 7f38ceb1d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c81283a0 con 0x7f38c806acb0 2023-10-03T10:15:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.166+0000 7f38ceb1d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c812b900 con 0x7f38c81316c0 2023-10-03T10:15:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.166+0000 7f38ceb1d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38c811abb0 con 0x7f38c809d9f0 2023-10-03T10:15:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38cc8b9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38c806acb0 0x7f38c8070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38cd0ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38c81316c0 0x7f38c8071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38cc8b9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38c806acb0 0x7f38c8070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55664/0 (socket says 172.21.15.72:55664) 2023-10-03T10:15:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38cc8b9700 1 -- 172.21.15.72:0/1252283847 learned_addr learned my addr 172.21.15.72:0/1252283847 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38c7fff700 1 --2- 172.21.15.72:0/1252283847 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38c809d9f0 0x7f38c8070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38c7fff700 1 -- 172.21.15.72:0/1252283847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38c81316c0 msgr2=0x7f38c8071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38c7fff700 1 --2- 172.21.15.72:0/1252283847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38c81316c0 0x7f38c8071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38c7fff700 1 -- 172.21.15.72:0/1252283847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38c806acb0 msgr2=0x7f38c8070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38c7fff700 1 --2- 172.21.15.72:0/1252283847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38c806acb0 0x7f38c8070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38c7fff700 1 -- 172.21.15.72:0/1252283847 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b40094a0 con 0x7f38c809d9f0 2023-10-03T10:15:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38cc8b9700 1 --2- 172.21.15.72:0/1252283847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38c806acb0 0x7f38c8070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38cd0ba700 1 --2- 172.21.15.72:0/1252283847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38c81316c0 0x7f38c8071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38c7fff700 1 --2- 172.21.15.72:0/1252283847 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38c809d9f0 0x7f38c8070f50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f38c806deb0 tx=0x7f38b400ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38c57fa700 1 -- 172.21.15.72:0/1252283847 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4013680 con 0x7f38c809d9f0 2023-10-03T10:15:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38c57fa700 1 -- 172.21.15.72:0/1252283847 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b40137e0 con 0x7f38c809d9f0 2023-10-03T10:15:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38ceb1d700 1 -- 172.21.15.72:0/1252283847 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38bc0094a0 con 0x7f38c809d9f0 2023-10-03T10:15:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38c57fa700 1 -- 172.21.15.72:0/1252283847 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4013b90 con 0x7f38c809d9f0 2023-10-03T10:15:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.167+0000 7f38ceb1d700 1 -- 172.21.15.72:0/1252283847 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c811a8f0 con 0x7f38c809d9f0 2023-10-03T10:15:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.168+0000 7f38c57fa700 1 -- 172.21.15.72:0/1252283847 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38b4013cf0 con 0x7f38c809d9f0 2023-10-03T10:15:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.168+0000 7f38c57fa700 1 -- 172.21.15.72:0/1252283847 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f38b403f690 con 0x7f38c809d9f0 2023-10-03T10:15:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.168+0000 7f38ceb1d700 1 -- 172.21.15.72:0/1252283847 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c811adf0 con 0x7f38c809d9f0 2023-10-03T10:15:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.173+0000 7f38c57fa700 1 -- 172.21.15.72:0/1252283847 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38b4017020 con 0x7f38c809d9f0 2023-10-03T10:15:38.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:38.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.281+0000 7f660afc1700 1 -- 172.21.15.72:0/2252299825 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f66041a7440 con 0x7f660409f650 2023-10-03T10:15:38.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.281+0000 7f66017fa700 1 -- 172.21.15.72:0/2252299825 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65fc011380 con 0x7f660409f650 2023-10-03T10:15:38.282 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:38.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.284+0000 7f660afc1700 1 -- 172.21.15.72:0/2252299825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f660409f650 msgr2=0x7f66041a4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.284+0000 7f660afc1700 1 --2- 172.21.15.72:0/2252299825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f660409f650 0x7f66041a4800 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00cbc0 tx=0x7f65fc00ced0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.284+0000 7f660afc1700 1 -- 172.21.15.72:0/2252299825 shutdown_connections 2023-10-03T10:15:38.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.284+0000 7f660afc1700 1 --2- 172.21.15.72:0/2252299825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f660409f650 0x7f66041a4800 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.284+0000 7f660afc1700 1 --2- 172.21.15.72:0/2252299825 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f660409e930 0x7f66041a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.284+0000 7f660afc1700 1 --2- 172.21.15.72:0/2252299825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f660409f240 0x7f66041a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.284+0000 7f660afc1700 1 -- 172.21.15.72:0/2252299825 >> 172.21.15.72:0/2252299825 conn(0x7f66040a4210 msgr2=0x7f66041b8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.284+0000 7f660afc1700 1 -- 172.21.15.72:0/2252299825 shutdown_connections 2023-10-03T10:15:38.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.284+0000 7f660afc1700 1 -- 172.21.15.72:0/2252299825 wait complete. 2023-10-03T10:15:38.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:38.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.347+0000 7f60a7e6a700 1 Processor -- start 2023-10-03T10:15:38.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.348+0000 7f60a7e6a700 1 -- start start 2023-10-03T10:15:38.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.348+0000 7f60a7e6a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60a009d6f0 0x7f60a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.348+0000 7f60a7e6a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60a009e000 0x7f60a0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.348+0000 7f60a7e6a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f60a009e410 0x7f60a0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.348+0000 7f60a7e6a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a009f520 con 0x7f60a009e410 2023-10-03T10:15:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.348+0000 7f60a7e6a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a009f130 con 0x7f60a009d6f0 2023-10-03T10:15:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.348+0000 7f60a7e6a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60a009e930 con 0x7f60a009e000 2023-10-03T10:15:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.348+0000 7f60a6407700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f60a009e410 0x7f60a0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.349+0000 7f60a5c06700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60a009d6f0 0x7f60a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.349+0000 7f60a6407700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f60a009e410 0x7f60a0130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57940/0 (socket says 172.21.15.72:57940) 2023-10-03T10:15:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.349+0000 7f60a5405700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60a009e000 0x7f60a0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.349+0000 7f60a5c06700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60a009d6f0 0x7f60a009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33706/0 (socket says 172.21.15.72:33706) 2023-10-03T10:15:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.349+0000 7f60a6407700 1 -- 172.21.15.72:0/3606772360 learned_addr learned my addr 172.21.15.72:0/3606772360 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.349+0000 7f60a5405700 1 -- 172.21.15.72:0/3606772360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60a009d6f0 msgr2=0x7f60a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.349+0000 7f60a5405700 1 --2- 172.21.15.72:0/3606772360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60a009d6f0 0x7f60a009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.349+0000 7f60a5405700 1 -- 172.21.15.72:0/3606772360 >> v2:172.21.15.72:3300/0 conn(0x7f60a009e410 msgr2=0x7f60a0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.349+0000 7f60a5405700 1 --2- 172.21.15.72:0/3606772360 >> v2:172.21.15.72:3300/0 conn(0x7f60a009e410 0x7f60a0130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.349+0000 7f60a5405700 1 -- 172.21.15.72:0/3606772360 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a009b2d0 con 0x7f60a009e000 2023-10-03T10:15:38.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.349+0000 7f60a6407700 1 --2- 172.21.15.72:0/3606772360 >> v2:172.21.15.72:3300/0 conn(0x7f60a009e410 0x7f60a0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.349+0000 7f60a5405700 1 --2- 172.21.15.72:0/3606772360 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60a009e000 0x7f60a0130660 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f609000bb10 tx=0x7f609000be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85fa4eaf50a0a08e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.349+0000 7f60a4c04700 1 -- 172.21.15.72:0/3606772360 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609000dc30 con 0x7f60a009e000 2023-10-03T10:15:38.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.349+0000 7f60a4c04700 1 -- 172.21.15.72:0/3606772360 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609000dd90 con 0x7f60a009e000 2023-10-03T10:15:38.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.349+0000 7f60a4c04700 1 -- 172.21.15.72:0/3606772360 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6090010690 con 0x7f60a009e000 2023-10-03T10:15:38.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.350+0000 7f60a7e6a700 1 -- 172.21.15.72:0/3606772360 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60a009e000 msgr2=0x7f60a0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.350+0000 7f60a7e6a700 1 --2- 172.21.15.72:0/3606772360 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60a009e000 0x7f60a0130660 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f609000bb10 tx=0x7f609000be20 comp rx=0 tx=0).stop 2023-10-03T10:15:38.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.350+0000 7f60a7e6a700 1 -- 172.21.15.72:0/3606772360 shutdown_connections 2023-10-03T10:15:38.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.350+0000 7f60a7e6a700 1 --2- 172.21.15.72:0/3606772360 >> v2:172.21.15.72:3300/0 conn(0x7f60a009e410 0x7f60a0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.350+0000 7f60a7e6a700 1 --2- 172.21.15.72:0/3606772360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60a009d6f0 0x7f60a009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.350+0000 7f60a7e6a700 1 --2- 172.21.15.72:0/3606772360 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60a009e000 0x7f60a0130660 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.350+0000 7f60a7e6a700 1 -- 172.21.15.72:0/3606772360 >> 172.21.15.72:0/3606772360 conn(0x7f60a0066f50 msgr2=0x7f60a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.350+0000 7f60a7e6a700 1 -- 172.21.15.72:0/3606772360 shutdown_connections 2023-10-03T10:15:38.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.350+0000 7f60a7e6a700 1 -- 172.21.15.72:0/3606772360 wait complete. 2023-10-03T10:15:38.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.351+0000 7f60a7e6a700 1 Processor -- start 2023-10-03T10:15:38.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.351+0000 7f60a7e6a700 1 -- start start 2023-10-03T10:15:38.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a7e6a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60a009d6f0 0x7f60a011e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a7e6a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60a009e000 0x7f60a011e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a7e6a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60a009e410 0x7f60a011eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a7e6a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a0121bc0 con 0x7f60a009e410 2023-10-03T10:15:38.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a7e6a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00a1b10 con 0x7f60a009e000 2023-10-03T10:15:38.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a7e6a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60a009c700 con 0x7f60a009d6f0 2023-10-03T10:15:38.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a6407700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60a009e410 0x7f60a011eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a6407700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60a009e410 0x7f60a011eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57944/0 (socket says 172.21.15.72:57944) 2023-10-03T10:15:38.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a6407700 1 -- 172.21.15.72:0/1777816975 learned_addr learned my addr 172.21.15.72:0/1777816975 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:38.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a5c06700 1 --2- 172.21.15.72:0/1777816975 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60a009d6f0 0x7f60a011e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a5405700 1 --2- 172.21.15.72:0/1777816975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60a009e000 0x7f60a011e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a6407700 1 -- 172.21.15.72:0/1777816975 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60a009d6f0 msgr2=0x7f60a011e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a6407700 1 --2- 172.21.15.72:0/1777816975 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60a009d6f0 0x7f60a011e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a6407700 1 -- 172.21.15.72:0/1777816975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60a009e000 msgr2=0x7f60a011e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a6407700 1 --2- 172.21.15.72:0/1777816975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60a009e000 0x7f60a011e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a6407700 1 -- 172.21.15.72:0/1777816975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6098009b30 con 0x7f60a009e410 2023-10-03T10:15:38.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a5405700 1 --2- 172.21.15.72:0/1777816975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60a009e000 0x7f60a011e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60a6407700 1 --2- 172.21.15.72:0/1777816975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60a009e410 0x7f60a011eb70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f609800efc0 tx=0x7f609800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60967fc700 1 -- 172.21.15.72:0/1777816975 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098018070 con 0x7f60a009e410 2023-10-03T10:15:38.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.352+0000 7f60967fc700 1 -- 172.21.15.72:0/1777816975 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609800f040 con 0x7f60a009e410 2023-10-03T10:15:38.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.353+0000 7f60a7e6a700 1 -- 172.21.15.72:0/1777816975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609000b740 con 0x7f60a009e410 2023-10-03T10:15:38.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.353+0000 7f60967fc700 1 -- 172.21.15.72:0/1777816975 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098003c20 con 0x7f60a009e410 2023-10-03T10:15:38.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.353+0000 7f60a7e6a700 1 -- 172.21.15.72:0/1777816975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a0121350 con 0x7f60a009e410 2023-10-03T10:15:38.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.353+0000 7f60967fc700 1 -- 172.21.15.72:0/1777816975 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f609800c880 con 0x7f60a009e410 2023-10-03T10:15:38.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.354+0000 7f60a7e6a700 1 -- 172.21.15.72:0/1777816975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a0120260 con 0x7f60a009e410 2023-10-03T10:15:38.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.354+0000 7f60967fc700 1 -- 172.21.15.72:0/1777816975 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f609803f7d0 con 0x7f60a009e410 2023-10-03T10:15:38.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.358+0000 7f60967fc700 1 -- 172.21.15.72:0/1777816975 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6098013c10 con 0x7f60a009e410 2023-10-03T10:15:38.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.385+0000 7f38ceb1d700 1 -- 172.21.15.72:0/1252283847 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f38c8074ea0 con 0x7f38c809d9f0 2023-10-03T10:15:38.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.385+0000 7f38c57fa700 1 -- 172.21.15.72:0/1252283847 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f38b401bc30 con 0x7f38c809d9f0 2023-10-03T10:15:38.386 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.387+0000 7f38ceb1d700 1 -- 172.21.15.72:0/1252283847 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38c809d9f0 msgr2=0x7f38c8070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.387+0000 7f38ceb1d700 1 --2- 172.21.15.72:0/1252283847 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38c809d9f0 0x7f38c8070f50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f38c806deb0 tx=0x7f38b400ec60 comp rx=0 tx=0).stop 2023-10-03T10:15:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.387+0000 7f38ceb1d700 1 -- 172.21.15.72:0/1252283847 shutdown_connections 2023-10-03T10:15:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.387+0000 7f38ceb1d700 1 --2- 172.21.15.72:0/1252283847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f38c806acb0 0x7f38c8070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.387+0000 7f38ceb1d700 1 --2- 172.21.15.72:0/1252283847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38c81316c0 0x7f38c8071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.387+0000 7f38ceb1d700 1 --2- 172.21.15.72:0/1252283847 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38c809d9f0 0x7f38c8070f50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.387+0000 7f38ceb1d700 1 -- 172.21.15.72:0/1252283847 >> 172.21.15.72:0/1252283847 conn(0x7f38c8066f50 msgr2=0x7f38c80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.387+0000 7f38ceb1d700 1 -- 172.21.15.72:0/1252283847 shutdown_connections 2023-10-03T10:15:38.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.387+0000 7f38ceb1d700 1 -- 172.21.15.72:0/1252283847 wait complete. 2023-10-03T10:15:38.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:38.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.545+0000 7f60a7e6a700 1 -- 172.21.15.72:0/1777816975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f60a0074ea0 con 0x7f60a009e410 2023-10-03T10:15:38.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.545+0000 7f60967fc700 1 -- 172.21.15.72:0/1777816975 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f60980133e0 con 0x7f60a009e410 2023-10-03T10:15:38.546 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.547+0000 7f60a7e6a700 1 -- 172.21.15.72:0/1777816975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60a009e410 msgr2=0x7f60a011eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.547+0000 7f60a7e6a700 1 --2- 172.21.15.72:0/1777816975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60a009e410 0x7f60a011eb70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f609800efc0 tx=0x7f609800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.547+0000 7f60a7e6a700 1 -- 172.21.15.72:0/1777816975 shutdown_connections 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.547+0000 7f60a7e6a700 1 --2- 172.21.15.72:0/1777816975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60a009e410 0x7f60a011eb70 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.547+0000 7f60a7e6a700 1 --2- 172.21.15.72:0/1777816975 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60a009d6f0 0x7f60a011e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.547+0000 7f60a7e6a700 1 --2- 172.21.15.72:0/1777816975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60a009e000 0x7f60a011e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.547+0000 7f60a7e6a700 1 -- 172.21.15.72:0/1777816975 >> 172.21.15.72:0/1777816975 conn(0x7f60a0066f50 msgr2=0x7f60a006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.547+0000 7f60a7e6a700 1 -- 172.21.15.72:0/1777816975 shutdown_connections 2023-10-03T10:15:38.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.547+0000 7f60a7e6a700 1 -- 172.21.15.72:0/1777816975 wait complete. 2023-10-03T10:15:38.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:38.825 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:38.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.946+0000 7f60f96c5700 1 Processor -- start 2023-10-03T10:15:38.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f96c5700 1 -- start start 2023-10-03T10:15:38.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f96c5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60f409d630 0x7f60f40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f96c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f4138d80 0x7f60f413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f96c5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f40a2a70 con 0x7f60f40a0a30 2023-10-03T10:15:38.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f96c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40a01d0 con 0x7f60f4138d80 2023-10-03T10:15:38.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f96c5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60f409e2b0 con 0x7f60f409d630 2023-10-03T10:15:38.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f4138d80 0x7f60f413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60f409d630 0x7f60f40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60f409d630 0x7f60f40a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50690/0 (socket says 172.21.15.72:50690) 2023-10-03T10:15:38.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f27fc700 1 -- 172.21.15.72:0/959664890 learned_addr learned my addr 172.21.15.72:0/959664890 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:38.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f4138d80 0x7f60f413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33730/0 (socket says 172.21.15.72:33730) 2023-10-03T10:15:38.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f1ffb700 1 -- 172.21.15.72:0/959664890 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560167511 0 0) 0x7f60f40a2a70 con 0x7f60f40a0a30 2023-10-03T10:15:38.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f37fe700 1 -- 172.21.15.72:0/959664890 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60f409d630 msgr2=0x7f60f40a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f37fe700 1 --2- 172.21.15.72:0/959664890 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60f409d630 0x7f60f40a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f37fe700 1 -- 172.21.15.72:0/959664890 >> v1:172.21.15.72:6789/0 conn(0x7f60f40a0a30 legacy=0x7f60f40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f37fe700 1 -- 172.21.15.72:0/959664890 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f409dc50 con 0x7f60f4138d80 2023-10-03T10:15:38.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.947+0000 7f60f27fc700 1 --2- 172.21.15.72:0/959664890 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60f409d630 0x7f60f40a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.948+0000 7f60f37fe700 1 --2- 172.21.15.72:0/959664890 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f4138d80 0x7f60f413b160 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009dc0 tx=0x7f60ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2adf38e09ea201ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.948+0000 7f60f1ffb700 1 -- 172.21.15.72:0/959664890 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec00e070 con 0x7f60f4138d80 2023-10-03T10:15:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.948+0000 7f60f1ffb700 1 -- 172.21.15.72:0/959664890 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec00bb20 con 0x7f60f4138d80 2023-10-03T10:15:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.948+0000 7f60f1ffb700 1 -- 172.21.15.72:0/959664890 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec012430 con 0x7f60f4138d80 2023-10-03T10:15:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.948+0000 7f60f96c5700 1 -- 172.21.15.72:0/959664890 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f4138d80 msgr2=0x7f60f413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.948+0000 7f60f96c5700 1 --2- 172.21.15.72:0/959664890 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f4138d80 0x7f60f413b160 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009dc0 tx=0x7f60ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.948+0000 7f60f96c5700 1 -- 172.21.15.72:0/959664890 shutdown_connections 2023-10-03T10:15:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.948+0000 7f60f96c5700 1 --2- 172.21.15.72:0/959664890 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f4138d80 0x7f60f413b160 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.948+0000 7f60f96c5700 1 --2- 172.21.15.72:0/959664890 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60f409d630 0x7f60f40a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.948+0000 7f60f96c5700 1 -- 172.21.15.72:0/959664890 >> 172.21.15.72:0/959664890 conn(0x7f60f40a3050 msgr2=0x7f60f40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.948+0000 7f60f96c5700 1 -- 172.21.15.72:0/959664890 shutdown_connections 2023-10-03T10:15:38.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.948+0000 7f60f96c5700 1 -- 172.21.15.72:0/959664890 wait complete. 2023-10-03T10:15:38.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.949+0000 7f60f96c5700 1 Processor -- start 2023-10-03T10:15:38.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.949+0000 7f60f96c5700 1 -- start start 2023-10-03T10:15:38.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f96c5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f409d630 0x7f60f41334a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f96c5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60f40a0a30 0x7f60f41339e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f96c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f4138d80 0x7f60f4133f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f96c5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4136370 con 0x7f60f409d630 2023-10-03T10:15:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f96c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4136ce0 con 0x7f60f4138d80 2023-10-03T10:15:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f96c5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60f413ab60 con 0x7f60f40a0a30 2023-10-03T10:15:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f409d630 0x7f60f41334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f4138d80 0x7f60f4133f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60f40a0a30 0x7f60f41339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f409d630 0x7f60f41334a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57948/0 (socket says 172.21.15.72:57948) 2023-10-03T10:15:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60f40a0a30 0x7f60f41339e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50692/0 (socket says 172.21.15.72:50692) 2023-10-03T10:15:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f2ffd700 1 -- 172.21.15.72:0/2059610520 learned_addr learned my addr 172.21.15.72:0/2059610520 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:38.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f4138d80 0x7f60f4133f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33732/0 (socket says 172.21.15.72:33732) 2023-10-03T10:15:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f37fe700 1 -- 172.21.15.72:0/2059610520 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60f40a0a30 msgr2=0x7f60f41339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f37fe700 1 --2- 172.21.15.72:0/2059610520 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60f40a0a30 0x7f60f41339e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f37fe700 1 -- 172.21.15.72:0/2059610520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f409d630 msgr2=0x7f60f41334a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f37fe700 1 --2- 172.21.15.72:0/2059610520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f409d630 0x7f60f41334a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f37fe700 1 -- 172.21.15.72:0/2059610520 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4009550 con 0x7f60f4138d80 2023-10-03T10:15:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f37fe700 1 --2- 172.21.15.72:0/2059610520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f4138d80 0x7f60f4133f20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f60ec016000 tx=0x7f60ec004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60eb7fe700 1 -- 172.21.15.72:0/2059610520 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec012430 con 0x7f60f4138d80 2023-10-03T10:15:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60eb7fe700 1 -- 172.21.15.72:0/2059610520 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec020070 con 0x7f60f4138d80 2023-10-03T10:15:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f96c5700 1 -- 172.21.15.72:0/2059610520 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ec009a70 con 0x7f60f4138d80 2023-10-03T10:15:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60eb7fe700 1 -- 172.21.15.72:0/2059610520 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec007000 con 0x7f60f4138d80 2023-10-03T10:15:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.950+0000 7f60f96c5700 1 -- 172.21.15.72:0/2059610520 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f4134870 con 0x7f60f4138d80 2023-10-03T10:15:38.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.951+0000 7f60eb7fe700 1 -- 172.21.15.72:0/2059610520 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f60ec004040 con 0x7f60f4138d80 2023-10-03T10:15:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.951+0000 7f60eb7fe700 1 -- 172.21.15.72:0/2059610520 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f60ec022070 con 0x7f60f4138d80 2023-10-03T10:15:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.951+0000 7f60f96c5700 1 -- 172.21.15.72:0/2059610520 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f40747f0 con 0x7f60f4138d80 2023-10-03T10:15:38.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:38.956+0000 7f60eb7fe700 1 -- 172.21.15.72:0/2059610520 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f60ec01a970 con 0x7f60f4138d80 2023-10-03T10:15:39.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.141+0000 7f60f96c5700 1 -- 172.21.15.72:0/2059610520 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f60f4072980 con 0x7f60f4138d80 2023-10-03T10:15:39.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.141+0000 7f60eb7fe700 1 -- 172.21.15.72:0/2059610520 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f60ec02c030 con 0x7f60f4138d80 2023-10-03T10:15:39.142 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:39.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.143+0000 7f60f96c5700 1 -- 172.21.15.72:0/2059610520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f4138d80 msgr2=0x7f60f4133f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.143+0000 7f60f96c5700 1 --2- 172.21.15.72:0/2059610520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f4138d80 0x7f60f4133f20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f60ec016000 tx=0x7f60ec004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.143+0000 7f60f96c5700 1 -- 172.21.15.72:0/2059610520 shutdown_connections 2023-10-03T10:15:39.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.143+0000 7f60f96c5700 1 --2- 172.21.15.72:0/2059610520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f409d630 0x7f60f41334a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.143+0000 7f60f96c5700 1 --2- 172.21.15.72:0/2059610520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f4138d80 0x7f60f4133f20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.143+0000 7f60f96c5700 1 --2- 172.21.15.72:0/2059610520 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f60f40a0a30 0x7f60f41339e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.143+0000 7f60f96c5700 1 -- 172.21.15.72:0/2059610520 >> 172.21.15.72:0/2059610520 conn(0x7f60f40a3050 msgr2=0x7f60f40a68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.143+0000 7f60f96c5700 1 -- 172.21.15.72:0/2059610520 shutdown_connections 2023-10-03T10:15:39.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.143+0000 7f60f96c5700 1 -- 172.21.15.72:0/2059610520 wait complete. 2023-10-03T10:15:39.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:39.303 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:39.401 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:39.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.425+0000 7fddefec4700 1 Processor -- start 2023-10-03T10:15:39.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.426+0000 7fddefec4700 1 -- start start 2023-10-03T10:15:39.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.426+0000 7fddefec4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdde809d6f0 0x7fdde809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.426+0000 7fddefec4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdde809e410 0x7fdde8134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.426+0000 7fddefec4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde809b120 con 0x7fdde809e000 2023-10-03T10:15:39.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.426+0000 7fddefec4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde806b460 con 0x7fdde809e410 2023-10-03T10:15:39.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.426+0000 7fddefec4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdde809a7e0 con 0x7fdde809d6f0 2023-10-03T10:15:39.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.426+0000 7fddee461700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdde809e410 0x7fdde8134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.426+0000 7fddedc60700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdde809d6f0 0x7fdde809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.426+0000 7fddee461700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdde809e410 0x7fdde8134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57958/0 (socket says 172.21.15.72:57958) 2023-10-03T10:15:39.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.426+0000 7fddee461700 1 -- 172.21.15.72:0/2398354112 learned_addr learned my addr 172.21.15.72:0/2398354112 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:39.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.426+0000 7fddedc60700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdde809d6f0 0x7fdde809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50694/0 (socket says 172.21.15.72:50694) 2023-10-03T10:15:39.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.426+0000 7fddedc60700 1 -- 172.21.15.72:0/2398354112 >> v2:172.21.15.72:3300/0 conn(0x7fdde809e410 msgr2=0x7fdde8134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.427+0000 7fddedc60700 1 --2- 172.21.15.72:0/2398354112 >> v2:172.21.15.72:3300/0 conn(0x7fdde809e410 0x7fdde8134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.427+0000 7fddedc60700 1 -- 172.21.15.72:0/2398354112 >> v1:172.21.15.72:6789/0 conn(0x7fdde809e000 legacy=0x7fdde81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.427+0000 7fddedc60700 1 -- 172.21.15.72:0/2398354112 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde809a500 con 0x7fdde809d6f0 2023-10-03T10:15:39.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.427+0000 7fddee461700 1 --2- 172.21.15.72:0/2398354112 >> v2:172.21.15.72:3300/0 conn(0x7fdde809e410 0x7fdde8134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.427+0000 7fddedc60700 1 --2- 172.21.15.72:0/2398354112 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdde809d6f0 0x7fdde809dac0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009870 tx=0x7fdde4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aec722ceec62bd4e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.427+0000 7fddecc5e700 1 -- 172.21.15.72:0/2398354112 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4011830 con 0x7fdde809d6f0 2023-10-03T10:15:39.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.427+0000 7fddecc5e700 1 -- 172.21.15.72:0/2398354112 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde4011990 con 0x7fdde809d6f0 2023-10-03T10:15:39.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.427+0000 7fddecc5e700 1 -- 172.21.15.72:0/2398354112 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4011d20 con 0x7fdde809d6f0 2023-10-03T10:15:39.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.427+0000 7fddefec4700 1 -- 172.21.15.72:0/2398354112 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdde809d6f0 msgr2=0x7fdde809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.427+0000 7fddefec4700 1 --2- 172.21.15.72:0/2398354112 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdde809d6f0 0x7fdde809dac0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009870 tx=0x7fdde4009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:39.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.428+0000 7fddefec4700 1 -- 172.21.15.72:0/2398354112 shutdown_connections 2023-10-03T10:15:39.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.428+0000 7fddefec4700 1 --2- 172.21.15.72:0/2398354112 >> v2:172.21.15.72:3300/0 conn(0x7fdde809e410 0x7fdde8134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.428+0000 7fddefec4700 1 --2- 172.21.15.72:0/2398354112 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdde809d6f0 0x7fdde809dac0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.428+0000 7fddefec4700 1 -- 172.21.15.72:0/2398354112 >> 172.21.15.72:0/2398354112 conn(0x7fdde8066f50 msgr2=0x7fdde809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.428+0000 7fddefec4700 1 -- 172.21.15.72:0/2398354112 shutdown_connections 2023-10-03T10:15:39.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.428+0000 7fddefec4700 1 -- 172.21.15.72:0/2398354112 wait complete. 2023-10-03T10:15:39.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddefec4700 1 Processor -- start 2023-10-03T10:15:39.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddefec4700 1 -- start start 2023-10-03T10:15:39.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddefec4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdde809d6f0 0x7fdde81a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddefec4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdde809e000 0x7fdde81a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddefec4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdde809e410 0x7fdde81a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddefec4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde81a9b00 con 0x7fdde809e410 2023-10-03T10:15:39.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddefec4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde81a81d0 con 0x7fdde809e000 2023-10-03T10:15:39.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddefec4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdde81a9290 con 0x7fdde809d6f0 2023-10-03T10:15:39.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddedc60700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdde809d6f0 0x7fdde81a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddedc60700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdde809d6f0 0x7fdde81a6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50704/0 (socket says 172.21.15.72:50704) 2023-10-03T10:15:39.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fdded45f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdde809e000 0x7fdde81a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddedc60700 1 -- 172.21.15.72:0/3249403726 learned_addr learned my addr 172.21.15.72:0/3249403726 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:39.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddee461700 1 --2- 172.21.15.72:0/3249403726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdde809e410 0x7fdde81a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddedc60700 1 -- 172.21.15.72:0/3249403726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdde809e000 msgr2=0x7fdde81a65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddedc60700 1 --2- 172.21.15.72:0/3249403726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdde809e000 0x7fdde81a65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddedc60700 1 -- 172.21.15.72:0/3249403726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdde809e410 msgr2=0x7fdde81a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddedc60700 1 --2- 172.21.15.72:0/3249403726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdde809e410 0x7fdde81a6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.429+0000 7fddedc60700 1 -- 172.21.15.72:0/3249403726 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde0009b30 con 0x7fdde809d6f0 2023-10-03T10:15:39.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.430+0000 7fddedc60700 1 --2- 172.21.15.72:0/3249403726 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdde809d6f0 0x7fdde81a6070 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdde40097c0 tx=0x7fdde4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.430+0000 7fddde7fc700 1 -- 172.21.15.72:0/3249403726 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde40036a0 con 0x7fdde809d6f0 2023-10-03T10:15:39.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.430+0000 7fddde7fc700 1 -- 172.21.15.72:0/3249403726 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde401f070 con 0x7fdde809d6f0 2023-10-03T10:15:39.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.430+0000 7fddefec4700 1 -- 172.21.15.72:0/3249403726 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde40094a0 con 0x7fdde809d6f0 2023-10-03T10:15:39.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.430+0000 7fddde7fc700 1 -- 172.21.15.72:0/3249403726 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4003a60 con 0x7fdde809d6f0 2023-10-03T10:15:39.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.430+0000 7fddefec4700 1 -- 172.21.15.72:0/3249403726 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde809c760 con 0x7fdde809d6f0 2023-10-03T10:15:39.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.430+0000 7fddde7fc700 1 -- 172.21.15.72:0/3249403726 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdde4003bc0 con 0x7fdde809d6f0 2023-10-03T10:15:39.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.431+0000 7fddde7fc700 1 -- 172.21.15.72:0/3249403726 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdde4021070 con 0x7fdde809d6f0 2023-10-03T10:15:39.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.431+0000 7fddefec4700 1 -- 172.21.15.72:0/3249403726 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde8074ea0 con 0x7fdde809d6f0 2023-10-03T10:15:39.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.436+0000 7fddde7fc700 1 -- 172.21.15.72:0/3249403726 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdde402b080 con 0x7fdde809d6f0 2023-10-03T10:15:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.525+0000 7fcf42e6e700 1 Processor -- start 2023-10-03T10:15:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.525+0000 7fcf42e6e700 1 -- start start 2023-10-03T10:15:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.525+0000 7fcf42e6e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf3c133420 0x7fcf3c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.525+0000 7fcf42e6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf3c133e30 0x7fcf3c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf42e6e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf3c134260 0x7fcf3c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf42e6e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c06b990 con 0x7fcf3c134260 2023-10-03T10:15:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf42e6e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0a0590 con 0x7fcf3c133e30 2023-10-03T10:15:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf42e6e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c09fb80 con 0x7fcf3c133420 2023-10-03T10:15:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf40c0a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf3c133420 0x7fcf3c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf3bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf3c133e30 0x7fcf3c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf4140b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf3c134260 0x7fcf3c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf40c0a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf3c133420 0x7fcf3c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50706/0 (socket says 172.21.15.72:50706) 2023-10-03T10:15:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf3bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf3c133e30 0x7fcf3c12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33754/0 (socket says 172.21.15.72:33754) 2023-10-03T10:15:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf40c0a700 1 -- 172.21.15.72:0/1402945275 learned_addr learned my addr 172.21.15.72:0/1402945275 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf3bfff700 1 -- 172.21.15.72:0/1402945275 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf3c133420 msgr2=0x7fcf3c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf3bfff700 1 --2- 172.21.15.72:0/1402945275 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf3c133420 0x7fcf3c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf3bfff700 1 -- 172.21.15.72:0/1402945275 >> v2:172.21.15.72:3300/0 conn(0x7fcf3c134260 msgr2=0x7fcf3c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf3bfff700 1 --2- 172.21.15.72:0/1402945275 >> v2:172.21.15.72:3300/0 conn(0x7fcf3c134260 0x7fcf3c1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf3bfff700 1 -- 172.21.15.72:0/1402945275 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c0a0030 con 0x7fcf3c133e30 2023-10-03T10:15:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf40c0a700 1 --2- 172.21.15.72:0/1402945275 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf3c133420 0x7fcf3c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf4140b700 1 --2- 172.21.15.72:0/1402945275 >> v2:172.21.15.72:3300/0 conn(0x7fcf3c134260 0x7fcf3c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf3bfff700 1 --2- 172.21.15.72:0/1402945275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf3c133e30 0x7fcf3c12ff90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009840 tx=0x7fcf28009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a67560ec2ea5323 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf3b7fe700 1 -- 172.21.15.72:0/1402945275 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28011830 con 0x7fcf3c133e30 2023-10-03T10:15:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf3b7fe700 1 -- 172.21.15.72:0/1402945275 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf28011990 con 0x7fcf3c133e30 2023-10-03T10:15:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.526+0000 7fcf3b7fe700 1 -- 172.21.15.72:0/1402945275 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28011d20 con 0x7fcf3c133e30 2023-10-03T10:15:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.527+0000 7fcf42e6e700 1 -- 172.21.15.72:0/1402945275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf3c133e30 msgr2=0x7fcf3c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.527+0000 7fcf42e6e700 1 --2- 172.21.15.72:0/1402945275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf3c133e30 0x7fcf3c12ff90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009840 tx=0x7fcf28009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.527+0000 7fcf42e6e700 1 -- 172.21.15.72:0/1402945275 shutdown_connections 2023-10-03T10:15:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.527+0000 7fcf42e6e700 1 --2- 172.21.15.72:0/1402945275 >> v2:172.21.15.72:3300/0 conn(0x7fcf3c134260 0x7fcf3c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.527+0000 7fcf42e6e700 1 --2- 172.21.15.72:0/1402945275 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf3c133420 0x7fcf3c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.527+0000 7fcf42e6e700 1 --2- 172.21.15.72:0/1402945275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf3c133e30 0x7fcf3c12ff90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.527+0000 7fcf42e6e700 1 -- 172.21.15.72:0/1402945275 >> 172.21.15.72:0/1402945275 conn(0x7fcf3c0a4210 msgr2=0x7fcf3c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.527+0000 7fcf42e6e700 1 -- 172.21.15.72:0/1402945275 shutdown_connections 2023-10-03T10:15:39.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.527+0000 7fcf42e6e700 1 -- 172.21.15.72:0/1402945275 wait complete. 2023-10-03T10:15:39.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.528+0000 7fcf42e6e700 1 Processor -- start 2023-10-03T10:15:39.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.528+0000 7fcf42e6e700 1 -- start start 2023-10-03T10:15:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.528+0000 7fcf42e6e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf3c133420 0x7fcf3c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.528+0000 7fcf42e6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf3c133e30 0x7fcf3c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.528+0000 7fcf42e6e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf3c134260 0x7fcf3c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.528+0000 7fcf42e6e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c11ff90 con 0x7fcf3c133420 2023-10-03T10:15:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.528+0000 7fcf42e6e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c120170 con 0x7fcf3c133e30 2023-10-03T10:15:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.528+0000 7fcf42e6e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c12da20 con 0x7fcf3c134260 2023-10-03T10:15:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf3bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf3c133e30 0x7fcf3c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf4140b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf3c134260 0x7fcf3c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf40c0a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf3c133420 0x7fcf3c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf3bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf3c133e30 0x7fcf3c09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33764/0 (socket says 172.21.15.72:33764) 2023-10-03T10:15:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf3bfff700 1 -- 172.21.15.72:0/3873855046 learned_addr learned my addr 172.21.15.72:0/3873855046 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf4140b700 1 -- 172.21.15.72:0/3873855046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf3c133e30 msgr2=0x7fcf3c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf4140b700 1 --2- 172.21.15.72:0/3873855046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf3c133e30 0x7fcf3c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf4140b700 1 -- 172.21.15.72:0/3873855046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf3c133420 msgr2=0x7fcf3c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf4140b700 1 --2- 172.21.15.72:0/3873855046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf3c133420 0x7fcf3c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf4140b700 1 -- 172.21.15.72:0/3873855046 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf30009550 con 0x7fcf3c134260 2023-10-03T10:15:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf3bfff700 1 --2- 172.21.15.72:0/3873855046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf3c133e30 0x7fcf3c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf40c0a700 1 --2- 172.21.15.72:0/3873855046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf3c133420 0x7fcf3c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf4140b700 1 --2- 172.21.15.72:0/3873855046 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf3c134260 0x7fcf3c09cf00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009e50 tx=0x7fcf3400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf397fa700 1 -- 172.21.15.72:0/3873855046 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3400ca90 con 0x7fcf3c134260 2023-10-03T10:15:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf397fa700 1 -- 172.21.15.72:0/3873855046 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3400f040 con 0x7fcf3c134260 2023-10-03T10:15:39.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf42e6e700 1 -- 172.21.15.72:0/3873855046 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf34009a70 con 0x7fcf3c134260 2023-10-03T10:15:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf397fa700 1 -- 172.21.15.72:0/3873855046 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3400ce50 con 0x7fcf3c134260 2023-10-03T10:15:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.529+0000 7fcf42e6e700 1 -- 172.21.15.72:0/3873855046 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf280094a0 con 0x7fcf3c134260 2023-10-03T10:15:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.530+0000 7fcf397fa700 1 -- 172.21.15.72:0/3873855046 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf34014480 con 0x7fcf3c134260 2023-10-03T10:15:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.530+0000 7fcf42e6e700 1 -- 172.21.15.72:0/3873855046 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c074ea0 con 0x7fcf3c134260 2023-10-03T10:15:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.530+0000 7fcf397fa700 1 -- 172.21.15.72:0/3873855046 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcf3403fce0 con 0x7fcf3c134260 2023-10-03T10:15:39.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.535+0000 7fcf397fa700 1 -- 172.21.15.72:0/3873855046 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf34012930 con 0x7fcf3c134260 2023-10-03T10:15:39.561 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:39.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.635+0000 7fddefec4700 1 -- 172.21.15.72:0/3249403726 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdde81a8e40 con 0x7fdde809d6f0 2023-10-03T10:15:39.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.636+0000 7fddde7fc700 1 -- 172.21.15.72:0/3249403726 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdde4015020 con 0x7fdde809d6f0 2023-10-03T10:15:39.636 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:39.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.637+0000 7fddefec4700 1 -- 172.21.15.72:0/3249403726 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdde809d6f0 msgr2=0x7fdde81a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.638+0000 7fddefec4700 1 --2- 172.21.15.72:0/3249403726 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdde809d6f0 0x7fdde81a6070 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdde40097c0 tx=0x7fdde4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.638+0000 7fddefec4700 1 -- 172.21.15.72:0/3249403726 shutdown_connections 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.638+0000 7fddefec4700 1 --2- 172.21.15.72:0/3249403726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdde809e410 0x7fdde81a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.638+0000 7fddefec4700 1 --2- 172.21.15.72:0/3249403726 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdde809d6f0 0x7fdde81a6070 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.638+0000 7fddefec4700 1 --2- 172.21.15.72:0/3249403726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdde809e000 0x7fdde81a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.638+0000 7fddefec4700 1 -- 172.21.15.72:0/3249403726 >> 172.21.15.72:0/3249403726 conn(0x7fdde8066f50 msgr2=0x7fdde81baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.638+0000 7fddefec4700 1 -- 172.21.15.72:0/3249403726 shutdown_connections 2023-10-03T10:15:39.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.638+0000 7fddefec4700 1 -- 172.21.15.72:0/3249403726 wait complete. 2023-10-03T10:15:39.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:39.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.685+0000 7f75d4459700 1 Processor -- start 2023-10-03T10:15:39.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.685+0000 7f75d4459700 1 -- start start 2023-10-03T10:15:39.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.685+0000 7f75d4459700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75cc0a0a30 0x7f75cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d4459700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75cc134170 0x7f75cc13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d4459700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc09edd0 con 0x7f75cc0a1340 2023-10-03T10:15:39.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d4459700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc09e1f0 con 0x7f75cc134170 2023-10-03T10:15:39.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d4459700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc09dc50 con 0x7f75cc0a0a30 2023-10-03T10:15:39.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d21f5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75cc0a0a30 0x7f75cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d19f4700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f75cc0a1340 0x7f75cc133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49444/0 (socket says 172.21.15.72:49444) 2023-10-03T10:15:39.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d19f4700 1 -- 172.21.15.72:0/2572599801 learned_addr learned my addr 172.21.15.72:0/2572599801 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:39.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d29f6700 1 --2- 172.21.15.72:0/2572599801 >> v2:172.21.15.72:3300/0 conn(0x7f75cc134170 0x7f75cc13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d29f6700 1 -- 172.21.15.72:0/2572599801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75cc0a0a30 msgr2=0x7f75cc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d29f6700 1 --2- 172.21.15.72:0/2572599801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75cc0a0a30 0x7f75cc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d29f6700 1 -- 172.21.15.72:0/2572599801 >> v1:172.21.15.72:6789/0 conn(0x7f75cc0a1340 legacy=0x7f75cc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d29f6700 1 -- 172.21.15.72:0/2572599801 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc0a1fe0 con 0x7f75cc134170 2023-10-03T10:15:39.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d11f3700 1 -- 172.21.15.72:0/2572599801 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623000589 0 0) 0x7f75cc09edd0 con 0x7f75cc0a1340 2023-10-03T10:15:39.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d21f5700 1 --2- 172.21.15.72:0/2572599801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75cc0a0a30 0x7f75cc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d29f6700 1 --2- 172.21.15.72:0/2572599801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75cc134170 0x7f75cc13bd30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009d90 tx=0x7f75c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734e143448ea7332 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d11f3700 1 -- 172.21.15.72:0/2572599801 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400e070 con 0x7f75cc134170 2023-10-03T10:15:39.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d11f3700 1 -- 172.21.15.72:0/2572599801 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c400bb20 con 0x7f75cc134170 2023-10-03T10:15:39.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.686+0000 7f75d11f3700 1 -- 172.21.15.72:0/2572599801 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4012430 con 0x7f75cc134170 2023-10-03T10:15:39.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.687+0000 7f75d4459700 1 -- 172.21.15.72:0/2572599801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75cc134170 msgr2=0x7f75cc13bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.687+0000 7f75d4459700 1 --2- 172.21.15.72:0/2572599801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75cc134170 0x7f75cc13bd30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009d90 tx=0x7f75c400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:39.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.687+0000 7f75d4459700 1 -- 172.21.15.72:0/2572599801 shutdown_connections 2023-10-03T10:15:39.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.687+0000 7f75d4459700 1 --2- 172.21.15.72:0/2572599801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75cc134170 0x7f75cc13bd30 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.687+0000 7f75d4459700 1 --2- 172.21.15.72:0/2572599801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75cc0a0a30 0x7f75cc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.687+0000 7f75d4459700 1 -- 172.21.15.72:0/2572599801 >> 172.21.15.72:0/2572599801 conn(0x7f75cc0a6550 msgr2=0x7f75cc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.687+0000 7f75d4459700 1 -- 172.21.15.72:0/2572599801 shutdown_connections 2023-10-03T10:15:39.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.687+0000 7f75d4459700 1 -- 172.21.15.72:0/2572599801 wait complete. 2023-10-03T10:15:39.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.688+0000 7f75d4459700 1 Processor -- start 2023-10-03T10:15:39.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.688+0000 7f75d4459700 1 -- start start 2023-10-03T10:15:39.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d4459700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75cc0a0a30 0x7f75cc122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d4459700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75cc0a1340 0x7f75cc122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d4459700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75cc134170 0x7f75cc123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d4459700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc125f30 con 0x7f75cc0a1340 2023-10-03T10:15:39.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d4459700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0a4dc0 con 0x7f75cc0a0a30 2023-10-03T10:15:39.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d4459700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0a0220 con 0x7f75cc134170 2023-10-03T10:15:39.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d29f6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75cc134170 0x7f75cc123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d29f6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75cc134170 0x7f75cc123200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50744/0 (socket says 172.21.15.72:50744) 2023-10-03T10:15:39.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d29f6700 1 -- 172.21.15.72:0/481564865 learned_addr learned my addr 172.21.15.72:0/481564865 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:39.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d21f5700 1 --2- 172.21.15.72:0/481564865 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75cc0a0a30 0x7f75cc122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d19f4700 1 --2- 172.21.15.72:0/481564865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75cc0a1340 0x7f75cc122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d29f6700 1 -- 172.21.15.72:0/481564865 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75cc0a0a30 msgr2=0x7f75cc122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d29f6700 1 --2- 172.21.15.72:0/481564865 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75cc0a0a30 0x7f75cc122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d29f6700 1 -- 172.21.15.72:0/481564865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75cc0a1340 msgr2=0x7f75cc122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d29f6700 1 --2- 172.21.15.72:0/481564865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75cc0a1340 0x7f75cc122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d29f6700 1 -- 172.21.15.72:0/481564865 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c80094a0 con 0x7f75cc134170 2023-10-03T10:15:39.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.689+0000 7f75d21f5700 1 --2- 172.21.15.72:0/481564865 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75cc0a0a30 0x7f75cc122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:39.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.690+0000 7f75d29f6700 1 --2- 172.21.15.72:0/481564865 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75cc134170 0x7f75cc123200 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f75cc09e330 tx=0x7f75c4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.690+0000 7f75c2ffd700 1 -- 172.21.15.72:0/481564865 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4012430 con 0x7f75cc134170 2023-10-03T10:15:39.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.690+0000 7f75c2ffd700 1 -- 172.21.15.72:0/481564865 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c4020070 con 0x7f75cc134170 2023-10-03T10:15:39.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.690+0000 7f75c2ffd700 1 -- 172.21.15.72:0/481564865 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4004280 con 0x7f75cc134170 2023-10-03T10:15:39.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.690+0000 7f75d4459700 1 -- 172.21.15.72:0/481564865 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c4009a70 con 0x7f75cc134170 2023-10-03T10:15:39.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.690+0000 7f75d4459700 1 -- 172.21.15.72:0/481564865 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc1269a0 con 0x7f75cc134170 2023-10-03T10:15:39.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.690+0000 7f75c2ffd700 1 -- 172.21.15.72:0/481564865 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75c40043e0 con 0x7f75cc134170 2023-10-03T10:15:39.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.691+0000 7f75c2ffd700 1 -- 172.21.15.72:0/481564865 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f75c4022070 con 0x7f75cc134170 2023-10-03T10:15:39.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.691+0000 7f75d4459700 1 -- 172.21.15.72:0/481564865 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75cc125bd0 con 0x7f75cc134170 2023-10-03T10:15:39.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.695+0000 7f75c2ffd700 1 -- 172.21.15.72:0/481564865 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75c401b400 con 0x7f75cc134170 2023-10-03T10:15:39.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.733+0000 7fcf42e6e700 1 -- 172.21.15.72:0/3873855046 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcf3c11f4b0 con 0x7fcf3c134260 2023-10-03T10:15:39.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.733+0000 7fcf397fa700 1 -- 172.21.15.72:0/3873855046 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcf34012340 con 0x7fcf3c134260 2023-10-03T10:15:39.734 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:39.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.735+0000 7fcf42e6e700 1 -- 172.21.15.72:0/3873855046 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf3c134260 msgr2=0x7fcf3c09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.735+0000 7fcf42e6e700 1 --2- 172.21.15.72:0/3873855046 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf3c134260 0x7fcf3c09cf00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009e50 tx=0x7fcf3400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.735+0000 7fcf42e6e700 1 -- 172.21.15.72:0/3873855046 shutdown_connections 2023-10-03T10:15:39.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.735+0000 7fcf42e6e700 1 --2- 172.21.15.72:0/3873855046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf3c133420 0x7fcf3c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.735+0000 7fcf42e6e700 1 --2- 172.21.15.72:0/3873855046 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf3c134260 0x7fcf3c09cf00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.735+0000 7fcf42e6e700 1 --2- 172.21.15.72:0/3873855046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf3c133e30 0x7fcf3c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.735+0000 7fcf42e6e700 1 -- 172.21.15.72:0/3873855046 >> 172.21.15.72:0/3873855046 conn(0x7fcf3c0a4210 msgr2=0x7fcf3c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.735+0000 7fcf42e6e700 1 -- 172.21.15.72:0/3873855046 shutdown_connections 2023-10-03T10:15:39.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.735+0000 7fcf42e6e700 1 -- 172.21.15.72:0/3873855046 wait complete. 2023-10-03T10:15:39.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:39.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.883+0000 7f75d4459700 1 -- 172.21.15.72:0/481564865 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f75cc074ea0 con 0x7f75cc134170 2023-10-03T10:15:39.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.884+0000 7f75c2ffd700 1 -- 172.21.15.72:0/481564865 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75c401a380 con 0x7f75cc134170 2023-10-03T10:15:39.884 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:39.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.885+0000 7f75d4459700 1 -- 172.21.15.72:0/481564865 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75cc134170 msgr2=0x7f75cc123200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.885+0000 7f75d4459700 1 --2- 172.21.15.72:0/481564865 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75cc134170 0x7f75cc123200 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f75cc09e330 tx=0x7f75c4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.886+0000 7f75d4459700 1 -- 172.21.15.72:0/481564865 shutdown_connections 2023-10-03T10:15:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.886+0000 7f75d4459700 1 --2- 172.21.15.72:0/481564865 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75cc134170 0x7f75cc123200 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.886+0000 7f75d4459700 1 --2- 172.21.15.72:0/481564865 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75cc0a0a30 0x7f75cc122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.886+0000 7f75d4459700 1 --2- 172.21.15.72:0/481564865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75cc0a1340 0x7f75cc122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.886+0000 7f75d4459700 1 -- 172.21.15.72:0/481564865 >> 172.21.15.72:0/481564865 conn(0x7f75cc0a6550 msgr2=0x7f75cc09edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.886+0000 7f75d4459700 1 -- 172.21.15.72:0/481564865 shutdown_connections 2023-10-03T10:15:39.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:39.886+0000 7f75d4459700 1 -- 172.21.15.72:0/481564865 wait complete. 2023-10-03T10:15:39.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:40.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:40.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f978aed0700 1 Processor -- start 2023-10-03T10:15:40.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f978aed0700 1 -- start start 2023-10-03T10:15:40.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f978aed0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f978409d6f0 0x7f978409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f978aed0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f978409e000 0x7f97841339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f978aed0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f978409e410 0x7f9784133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f978aed0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978406b460 con 0x7f978409e410 2023-10-03T10:15:40.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f978aed0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978409b120 con 0x7f978409e000 2023-10-03T10:15:40.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f978aed0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f978409a7e0 con 0x7f978409d6f0 2023-10-03T10:15:40.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f9788c6c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f978409d6f0 0x7f978409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f9783fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f978409e000 0x7f97841339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f978946d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f978409e410 0x7f9784133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f9788c6c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f978409d6f0 0x7f978409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50746/0 (socket says 172.21.15.72:50746) 2023-10-03T10:15:40.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f9788c6c700 1 -- 172.21.15.72:0/3755747521 learned_addr learned my addr 172.21.15.72:0/3755747521 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:40.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f9783fff700 1 --2- 172.21.15.72:0/3755747521 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f978409e000 0x7f97841339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33790/0 (socket says 172.21.15.72:33790) 2023-10-03T10:15:40.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f9788c6c700 1 -- 172.21.15.72:0/3755747521 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f978409e000 msgr2=0x7f97841339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:40.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f9788c6c700 1 --2- 172.21.15.72:0/3755747521 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f978409e000 0x7f97841339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f9788c6c700 1 -- 172.21.15.72:0/3755747521 >> v2:172.21.15.72:3300/0 conn(0x7f978409e410 msgr2=0x7f9784133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:40.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f9788c6c700 1 --2- 172.21.15.72:0/3755747521 >> v2:172.21.15.72:3300/0 conn(0x7f978409e410 0x7f9784133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f9788c6c700 1 -- 172.21.15.72:0/3755747521 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978409a500 con 0x7f978409d6f0 2023-10-03T10:15:40.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f978946d700 1 --2- 172.21.15.72:0/3755747521 >> v2:172.21.15.72:3300/0 conn(0x7f978409e410 0x7f9784133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:40.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f9783fff700 1 --2- 172.21.15.72:0/3755747521 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f978409e000 0x7f97841339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:40.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f9788c6c700 1 --2- 172.21.15.72:0/3755747521 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f978409d6f0 0x7f978409dac0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9778009920 tx=0x7f9778009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=730a5bd90e0055f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:40.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f97837fe700 1 -- 172.21.15.72:0/3755747521 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778011830 con 0x7f978409d6f0 2023-10-03T10:15:40.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f97837fe700 1 -- 172.21.15.72:0/3755747521 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9778011990 con 0x7f978409d6f0 2023-10-03T10:15:40.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.282+0000 7f97837fe700 1 -- 172.21.15.72:0/3755747521 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778011d20 con 0x7f978409d6f0 2023-10-03T10:15:40.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.283+0000 7f978aed0700 1 -- 172.21.15.72:0/3755747521 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f978409d6f0 msgr2=0x7f978409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.283+0000 7f978aed0700 1 --2- 172.21.15.72:0/3755747521 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f978409d6f0 0x7f978409dac0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9778009920 tx=0x7f9778009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:40.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.283+0000 7f978aed0700 1 -- 172.21.15.72:0/3755747521 shutdown_connections 2023-10-03T10:15:40.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.283+0000 7f978aed0700 1 --2- 172.21.15.72:0/3755747521 >> v2:172.21.15.72:3300/0 conn(0x7f978409e410 0x7f9784133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.283+0000 7f978aed0700 1 --2- 172.21.15.72:0/3755747521 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f978409d6f0 0x7f978409dac0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.283+0000 7f978aed0700 1 --2- 172.21.15.72:0/3755747521 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f978409e000 0x7f97841339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.283+0000 7f978aed0700 1 -- 172.21.15.72:0/3755747521 >> 172.21.15.72:0/3755747521 conn(0x7f9784066f50 msgr2=0x7f978409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.283+0000 7f978aed0700 1 -- 172.21.15.72:0/3755747521 shutdown_connections 2023-10-03T10:15:40.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.283+0000 7f978aed0700 1 -- 172.21.15.72:0/3755747521 wait complete. 2023-10-03T10:15:40.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.284+0000 7f978aed0700 1 Processor -- start 2023-10-03T10:15:40.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.284+0000 7f978aed0700 1 -- start start 2023-10-03T10:15:40.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.284+0000 7f978aed0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f978409d6f0 0x7f97841c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.284+0000 7f978aed0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f978409e000 0x7f97841c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.284+0000 7f978aed0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f978409e410 0x7f97841c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.284+0000 7f978aed0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97841a5590 con 0x7f978409e410 2023-10-03T10:15:40.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.284+0000 7f978aed0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97841a53a0 con 0x7f978409d6f0 2023-10-03T10:15:40.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.284+0000 7f978aed0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97840a30c0 con 0x7f978409e000 2023-10-03T10:15:40.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.284+0000 7f9783fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f978409e000 0x7f97841c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.284+0000 7f9783fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f978409e000 0x7f97841c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50756/0 (socket says 172.21.15.72:50756) 2023-10-03T10:15:40.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.284+0000 7f9783fff700 1 -- 172.21.15.72:0/3433218975 learned_addr learned my addr 172.21.15.72:0/3433218975 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:40.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.285+0000 7f978946d700 1 --2- 172.21.15.72:0/3433218975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f978409e410 0x7f97841c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.284+0000 7f9788c6c700 1 --2- 172.21.15.72:0/3433218975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f978409d6f0 0x7f97841c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.285+0000 7f9783fff700 1 -- 172.21.15.72:0/3433218975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f978409d6f0 msgr2=0x7f97841c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.285+0000 7f9783fff700 1 --2- 172.21.15.72:0/3433218975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f978409d6f0 0x7f97841c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.285+0000 7f9783fff700 1 -- 172.21.15.72:0/3433218975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f978409e410 msgr2=0x7f97841c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.285+0000 7f9783fff700 1 --2- 172.21.15.72:0/3433218975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f978409e410 0x7f97841c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.285+0000 7f9783fff700 1 -- 172.21.15.72:0/3433218975 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97700094a0 con 0x7f978409e000 2023-10-03T10:15:40.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.285+0000 7f9783fff700 1 --2- 172.21.15.72:0/3433218975 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f978409e000 0x7f97841c86d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f977000ebb0 tx=0x7f977000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:40.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.285+0000 7f97817fa700 1 -- 172.21.15.72:0/3433218975 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977000c850 con 0x7f978409e000 2023-10-03T10:15:40.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.285+0000 7f97817fa700 1 -- 172.21.15.72:0/3433218975 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977000c9b0 con 0x7f978409e000 2023-10-03T10:15:40.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.285+0000 7f97817fa700 1 -- 172.21.15.72:0/3433218975 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977000cd40 con 0x7f978409e000 2023-10-03T10:15:40.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.285+0000 7f978aed0700 1 -- 172.21.15.72:0/3433218975 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c009a70 con 0x7f978409e000 2023-10-03T10:15:40.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.285+0000 7f978aed0700 1 -- 172.21.15.72:0/3433218975 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9778009550 con 0x7f978409e000 2023-10-03T10:15:40.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.286+0000 7f97817fa700 1 -- 172.21.15.72:0/3433218975 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9770013470 con 0x7f978409e000 2023-10-03T10:15:40.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.286+0000 7f97817fa700 1 -- 172.21.15.72:0/3433218975 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f977003f750 con 0x7f978409e000 2023-10-03T10:15:40.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.286+0000 7f978aed0700 1 -- 172.21.15.72:0/3433218975 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97841a7380 con 0x7f978409e000 2023-10-03T10:15:40.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.292+0000 7f97817fa700 1 -- 172.21.15.72:0/3433218975 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97700232f0 con 0x7f978409e000 2023-10-03T10:15:40.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.476+0000 7f978aed0700 1 -- 172.21.15.72:0/3433218975 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9784074ea0 con 0x7f978409e000 2023-10-03T10:15:40.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.476+0000 7f97817fa700 1 -- 172.21.15.72:0/3433218975 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9770021030 con 0x7f978409e000 2023-10-03T10:15:40.476 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:40.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.478+0000 7f978aed0700 1 -- 172.21.15.72:0/3433218975 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f978409e000 msgr2=0x7f97841c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.478+0000 7f978aed0700 1 --2- 172.21.15.72:0/3433218975 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f978409e000 0x7f97841c86d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f977000ebb0 tx=0x7f977000eec0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.478+0000 7f978aed0700 1 -- 172.21.15.72:0/3433218975 shutdown_connections 2023-10-03T10:15:40.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.478+0000 7f978aed0700 1 --2- 172.21.15.72:0/3433218975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f978409e410 0x7f97841c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.478+0000 7f978aed0700 1 --2- 172.21.15.72:0/3433218975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f978409d6f0 0x7f97841c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.478+0000 7f978aed0700 1 --2- 172.21.15.72:0/3433218975 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f978409e000 0x7f97841c86d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.478+0000 7f978aed0700 1 -- 172.21.15.72:0/3433218975 >> 172.21.15.72:0/3433218975 conn(0x7f9784066f50 msgr2=0x7f97841bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.478+0000 7f978aed0700 1 -- 172.21.15.72:0/3433218975 shutdown_connections 2023-10-03T10:15:40.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.478+0000 7f978aed0700 1 -- 172.21.15.72:0/3433218975 wait complete. 2023-10-03T10:15:40.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:40.651 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:40.749 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.777+0000 7f98a8ad7700 1 Processor -- start 2023-10-03T10:15:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.778+0000 7f98a8ad7700 1 -- start start 2023-10-03T10:15:40.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.778+0000 7f98a8ad7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98a409d6f0 0x7f98a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.778+0000 7f98a8ad7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e440 0x7f98a4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.778+0000 7f98a8ad7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a409b120 con 0x7f98a409e000 2023-10-03T10:15:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.778+0000 7f98a8ad7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a406b460 con 0x7f98a409d6f0 2023-10-03T10:15:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.778+0000 7f98a8ad7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98a409a7e0 con 0x7f98a409e440 2023-10-03T10:15:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.778+0000 7f98a259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98a409d6f0 0x7f98a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.778+0000 7f98a259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98a409d6f0 0x7f98a409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58036/0 (socket says 172.21.15.72:58036) 2023-10-03T10:15:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.778+0000 7f98a259c700 1 -- 172.21.15.72:0/3758907395 learned_addr learned my addr 172.21.15.72:0/3758907395 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.778+0000 7f98a2d9d700 1 --2- 172.21.15.72:0/3758907395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e440 0x7f98a4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.779+0000 7f98a259c700 1 -- 172.21.15.72:0/3758907395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e440 msgr2=0x7f98a4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.779+0000 7f98a259c700 1 --2- 172.21.15.72:0/3758907395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e440 0x7f98a4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.779+0000 7f98a259c700 1 -- 172.21.15.72:0/3758907395 >> v1:172.21.15.72:6789/0 conn(0x7f98a409e000 legacy=0x7f98a41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.779+0000 7f98a259c700 1 -- 172.21.15.72:0/3758907395 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a409a500 con 0x7f98a409d6f0 2023-10-03T10:15:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.779+0000 7f98a2d9d700 1 --2- 172.21.15.72:0/3758907395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e440 0x7f98a4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.779+0000 7f98a259c700 1 --2- 172.21.15.72:0/3758907395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a409d6f0 0x7f98a409dac0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9894009920 tx=0x7f9894009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ee8f007823f142 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.779+0000 7f98a159a700 1 -- 172.21.15.72:0/3758907395 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894011830 con 0x7f98a409d6f0 2023-10-03T10:15:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.779+0000 7f98a159a700 1 -- 172.21.15.72:0/3758907395 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9894011990 con 0x7f98a409d6f0 2023-10-03T10:15:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.779+0000 7f98a159a700 1 -- 172.21.15.72:0/3758907395 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894011d20 con 0x7f98a409d6f0 2023-10-03T10:15:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.780+0000 7f98a8ad7700 1 -- 172.21.15.72:0/3758907395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a409d6f0 msgr2=0x7f98a409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.780+0000 7f98a8ad7700 1 --2- 172.21.15.72:0/3758907395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a409d6f0 0x7f98a409dac0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9894009920 tx=0x7f9894009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.780+0000 7f98a8ad7700 1 -- 172.21.15.72:0/3758907395 shutdown_connections 2023-10-03T10:15:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.780+0000 7f98a8ad7700 1 --2- 172.21.15.72:0/3758907395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e440 0x7f98a4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.780+0000 7f98a8ad7700 1 --2- 172.21.15.72:0/3758907395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a409d6f0 0x7f98a409dac0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.780+0000 7f98a8ad7700 1 -- 172.21.15.72:0/3758907395 >> 172.21.15.72:0/3758907395 conn(0x7f98a4066f50 msgr2=0x7f98a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.780+0000 7f98a8ad7700 1 -- 172.21.15.72:0/3758907395 shutdown_connections 2023-10-03T10:15:40.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.780+0000 7f98a8ad7700 1 -- 172.21.15.72:0/3758907395 wait complete. 2023-10-03T10:15:40.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.781+0000 7f98a8ad7700 1 Processor -- start 2023-10-03T10:15:40.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.781+0000 7f98a8ad7700 1 -- start start 2023-10-03T10:15:40.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.781+0000 7f98a8ad7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a409d6f0 0x7f98a41a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.781+0000 7f98a8ad7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a409e000 0x7f98a41a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.781+0000 7f98a8ad7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e440 0x7f98a41a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.781+0000 7f98a8ad7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a41a96f0 con 0x7f98a409e000 2023-10-03T10:15:40.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.781+0000 7f98a8ad7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a41a9940 con 0x7f98a409d6f0 2023-10-03T10:15:40.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.781+0000 7f98a8ad7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98a41a8830 con 0x7f98a409e440 2023-10-03T10:15:40.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.781+0000 7f98a2d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e440 0x7f98a41a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.781+0000 7f98a1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a409e000 0x7f98a41a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.781+0000 7f98a2d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e440 0x7f98a41a68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50776/0 (socket says 172.21.15.72:50776) 2023-10-03T10:15:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.781+0000 7f98a2d9d700 1 -- 172.21.15.72:0/1646338492 learned_addr learned my addr 172.21.15.72:0/1646338492 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.781+0000 7f98a259c700 1 --2- 172.21.15.72:0/1646338492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a409d6f0 0x7f98a41a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.782+0000 7f98a1d9b700 1 -- 172.21.15.72:0/1646338492 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e440 msgr2=0x7f98a41a68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.782+0000 7f98a1d9b700 1 --2- 172.21.15.72:0/1646338492 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e440 0x7f98a41a68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.782+0000 7f98a1d9b700 1 -- 172.21.15.72:0/1646338492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a409d6f0 msgr2=0x7f98a41a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.782+0000 7f98a1d9b700 1 --2- 172.21.15.72:0/1646338492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a409d6f0 0x7f98a41a5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.782+0000 7f98a1d9b700 1 -- 172.21.15.72:0/1646338492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c009a70 con 0x7f98a409e000 2023-10-03T10:15:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.782+0000 7f98a2d9d700 1 --2- 172.21.15.72:0/1646338492 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e440 0x7f98a41a68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.782+0000 7f98a1d9b700 1 --2- 172.21.15.72:0/1646338492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a409e000 0x7f98a41a63a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9898000f60 tx=0x7f989800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.782+0000 7f9892ffd700 1 -- 172.21.15.72:0/1646338492 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98980052d0 con 0x7f98a409e000 2023-10-03T10:15:40.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.782+0000 7f9892ffd700 1 -- 172.21.15.72:0/1646338492 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9898005430 con 0x7f98a409e000 2023-10-03T10:15:40.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.782+0000 7f98a8ad7700 1 -- 172.21.15.72:0/1646338492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9894009550 con 0x7f98a409e000 2023-10-03T10:15:40.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.782+0000 7f9892ffd700 1 -- 172.21.15.72:0/1646338492 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98980038c0 con 0x7f98a409e000 2023-10-03T10:15:40.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.782+0000 7f98a8ad7700 1 -- 172.21.15.72:0/1646338492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a41a7ad0 con 0x7f98a409e000 2023-10-03T10:15:40.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.783+0000 7f9892ffd700 1 -- 172.21.15.72:0/1646338492 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9898003a20 con 0x7f98a409e000 2023-10-03T10:15:40.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.783+0000 7f9892ffd700 1 -- 172.21.15.72:0/1646338492 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f989803e9a0 con 0x7f98a409e000 2023-10-03T10:15:40.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.783+0000 7f98a8ad7700 1 -- 172.21.15.72:0/1646338492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a41a8d50 con 0x7f98a409e000 2023-10-03T10:15:40.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.788+0000 7f9892ffd700 1 -- 172.21.15.72:0/1646338492 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9898011590 con 0x7f98a409e000 2023-10-03T10:15:40.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.877+0000 7f7d78b81700 1 Processor -- start 2023-10-03T10:15:40.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.877+0000 7f7d78b81700 1 -- start start 2023-10-03T10:15:40.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d78b81700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7d740a0a30 0x7f7d740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d78b81700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d74134170 0x7f7d7413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d78b81700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7409edd0 con 0x7f7d740a1340 2023-10-03T10:15:40.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d78b81700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7409e1f0 con 0x7f7d740a0a30 2023-10-03T10:15:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d78b81700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7409dc50 con 0x7f7d74134170 2023-10-03T10:15:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d72d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d74134170 0x7f7d7413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d7259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7d740a0a30 0x7f7d740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d7259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7d740a0a30 0x7f7d740a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58054/0 (socket says 172.21.15.72:58054) 2023-10-03T10:15:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d72d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d74134170 0x7f7d7413bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50784/0 (socket says 172.21.15.72:50784) 2023-10-03T10:15:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d7259c700 1 -- 172.21.15.72:0/1909572047 learned_addr learned my addr 172.21.15.72:0/1909572047 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d71d9b700 1 --1- 172.21.15.72:0/1909572047 >> v1:172.21.15.72:6789/0 conn(0x7f7d740a1340 0x7f7d74133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49458/0 (socket says 172.21.15.72:49458) 2023-10-03T10:15:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d7259c700 1 -- 172.21.15.72:0/1909572047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d74134170 msgr2=0x7f7d7413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d7259c700 1 --2- 172.21.15.72:0/1909572047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d74134170 0x7f7d7413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d7259c700 1 -- 172.21.15.72:0/1909572047 >> v1:172.21.15.72:6789/0 conn(0x7f7d740a1340 legacy=0x7f7d74133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d7259c700 1 -- 172.21.15.72:0/1909572047 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d740a1fe0 con 0x7f7d740a0a30 2023-10-03T10:15:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d7159a700 1 -- 172.21.15.72:0/1909572047 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703082392 0 0) 0x7f7d7409edd0 con 0x7f7d740a1340 2023-10-03T10:15:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.878+0000 7f7d72d9d700 1 --2- 172.21.15.72:0/1909572047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d74134170 0x7f7d7413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.879+0000 7f7d7259c700 1 --2- 172.21.15.72:0/1909572047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d740a0a30 0x7f7d740a0e00 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f7d640098f0 tx=0x7f7d64009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f86c4c913a860bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.879+0000 7f7d7159a700 1 -- 172.21.15.72:0/1909572047 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d64011830 con 0x7f7d740a0a30 2023-10-03T10:15:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.879+0000 7f7d7159a700 1 -- 172.21.15.72:0/1909572047 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d64011990 con 0x7f7d740a0a30 2023-10-03T10:15:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.879+0000 7f7d7159a700 1 -- 172.21.15.72:0/1909572047 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d64011d20 con 0x7f7d740a0a30 2023-10-03T10:15:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.879+0000 7f7d78b81700 1 -- 172.21.15.72:0/1909572047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d740a0a30 msgr2=0x7f7d740a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.879+0000 7f7d78b81700 1 --2- 172.21.15.72:0/1909572047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d740a0a30 0x7f7d740a0e00 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f7d640098f0 tx=0x7f7d64009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.879+0000 7f7d78b81700 1 -- 172.21.15.72:0/1909572047 shutdown_connections 2023-10-03T10:15:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.879+0000 7f7d78b81700 1 --2- 172.21.15.72:0/1909572047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d74134170 0x7f7d7413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.879+0000 7f7d78b81700 1 --2- 172.21.15.72:0/1909572047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d740a0a30 0x7f7d740a0e00 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.879+0000 7f7d78b81700 1 -- 172.21.15.72:0/1909572047 >> 172.21.15.72:0/1909572047 conn(0x7f7d740a6550 msgr2=0x7f7d740a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.879+0000 7f7d78b81700 1 -- 172.21.15.72:0/1909572047 shutdown_connections 2023-10-03T10:15:40.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.879+0000 7f7d78b81700 1 -- 172.21.15.72:0/1909572047 wait complete. 2023-10-03T10:15:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.880+0000 7f7d78b81700 1 Processor -- start 2023-10-03T10:15:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.880+0000 7f7d78b81700 1 -- start start 2023-10-03T10:15:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d78b81700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d740a0a30 0x7f7d74122670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d78b81700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d740a1340 0x7f7d74122bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d78b81700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d74134170 0x7f7d741230f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d78b81700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d74126190 con 0x7f7d740a1340 2023-10-03T10:15:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d78b81700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d74125bf0 con 0x7f7d74134170 2023-10-03T10:15:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d78b81700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d74124320 con 0x7f7d740a0a30 2023-10-03T10:15:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d7259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d740a0a30 0x7f7d74122670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d71d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d740a1340 0x7f7d74122bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d7259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d740a0a30 0x7f7d74122670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50798/0 (socket says 172.21.15.72:50798) 2023-10-03T10:15:40.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d7259c700 1 -- 172.21.15.72:0/1205271260 learned_addr learned my addr 172.21.15.72:0/1205271260 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:40.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d72d9d700 1 --2- 172.21.15.72:0/1205271260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d74134170 0x7f7d741230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:40.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d7259c700 1 -- 172.21.15.72:0/1205271260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d74134170 msgr2=0x7f7d741230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d7259c700 1 --2- 172.21.15.72:0/1205271260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d74134170 0x7f7d741230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d7259c700 1 -- 172.21.15.72:0/1205271260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d740a1340 msgr2=0x7f7d74122bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d7259c700 1 --2- 172.21.15.72:0/1205271260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d740a1340 0x7f7d74122bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d7259c700 1 -- 172.21.15.72:0/1205271260 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c009a70 con 0x7f7d740a0a30 2023-10-03T10:15:40.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d71d9b700 1 --2- 172.21.15.72:0/1205271260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d740a1340 0x7f7d74122bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:40.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d7259c700 1 --2- 172.21.15.72:0/1205271260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d740a0a30 0x7f7d74122670 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7d7409e330 tx=0x7f7d64004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:40.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.881+0000 7f7d62ffd700 1 -- 172.21.15.72:0/1205271260 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d640042c0 con 0x7f7d740a0a30 2023-10-03T10:15:40.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.882+0000 7f7d62ffd700 1 -- 172.21.15.72:0/1205271260 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6401f070 con 0x7f7d740a0a30 2023-10-03T10:15:40.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.882+0000 7f7d78b81700 1 -- 172.21.15.72:0/1205271260 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d64009550 con 0x7f7d740a0a30 2023-10-03T10:15:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.882+0000 7f7d62ffd700 1 -- 172.21.15.72:0/1205271260 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d640036a0 con 0x7f7d740a0a30 2023-10-03T10:15:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.882+0000 7f7d78b81700 1 -- 172.21.15.72:0/1205271260 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d740a25e0 con 0x7f7d740a0a30 2023-10-03T10:15:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.882+0000 7f7d62ffd700 1 -- 172.21.15.72:0/1205271260 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d64021030 con 0x7f7d740a0a30 2023-10-03T10:15:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.882+0000 7f7d78b81700 1 -- 172.21.15.72:0/1205271260 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d740a0220 con 0x7f7d740a0a30 2023-10-03T10:15:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.883+0000 7f7d62ffd700 1 -- 172.21.15.72:0/1205271260 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d64040990 con 0x7f7d740a0a30 2023-10-03T10:15:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.887+0000 7f7d62ffd700 1 -- 172.21.15.72:0/1205271260 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d6401a450 con 0x7f7d740a0a30 2023-10-03T10:15:40.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:40.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.981+0000 7f98a8ad7700 1 -- 172.21.15.72:0/1646338492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f98a41a9300 con 0x7f98a409e000 2023-10-03T10:15:40.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.981+0000 7f9892ffd700 1 -- 172.21.15.72:0/1646338492 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98a41a9300 con 0x7f98a409e000 2023-10-03T10:15:40.981 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:40.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.983+0000 7f98a8ad7700 1 -- 172.21.15.72:0/1646338492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a409e000 msgr2=0x7f98a41a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.983+0000 7f98a8ad7700 1 --2- 172.21.15.72:0/1646338492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a409e000 0x7f98a41a63a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9898000f60 tx=0x7f989800c730 comp rx=0 tx=0).stop 2023-10-03T10:15:40.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.983+0000 7f98a8ad7700 1 -- 172.21.15.72:0/1646338492 shutdown_connections 2023-10-03T10:15:40.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.983+0000 7f98a8ad7700 1 --2- 172.21.15.72:0/1646338492 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98a409e440 0x7f98a41a68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.983+0000 7f98a8ad7700 1 --2- 172.21.15.72:0/1646338492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98a409d6f0 0x7f98a41a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.983+0000 7f98a8ad7700 1 --2- 172.21.15.72:0/1646338492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98a409e000 0x7f98a41a63a0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.983+0000 7f98a8ad7700 1 -- 172.21.15.72:0/1646338492 >> 172.21.15.72:0/1646338492 conn(0x7f98a4066f50 msgr2=0x7f98a41bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.984+0000 7f98a8ad7700 1 -- 172.21.15.72:0/1646338492 shutdown_connections 2023-10-03T10:15:40.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:40.984+0000 7f98a8ad7700 1 -- 172.21.15.72:0/1646338492 wait complete. 2023-10-03T10:15:40.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.023+0000 7f70af9ae700 1 Processor -- start 2023-10-03T10:15:41.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.023+0000 7f70af9ae700 1 -- start start 2023-10-03T10:15:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.024+0000 7f70af9ae700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f70a809e1d0 0x7f70a8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.024+0000 7f70af9ae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a8135e50 0x7f70a8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.024+0000 7f70af9ae700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a809f130 con 0x7f70a809d6f0 2023-10-03T10:15:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.024+0000 7f70af9ae700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a809f520 con 0x7f70a809e1d0 2023-10-03T10:15:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.024+0000 7f70af9ae700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a809e930 con 0x7f70a8135e50 2023-10-03T10:15:41.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.024+0000 7f70adf4b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a8135e50 0x7f70a8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.024+0000 7f70acf49700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f70a809e1d0 0x7f70a8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.024+0000 7f70adf4b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a8135e50 0x7f70a8138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33808/0 (socket says 172.21.15.72:33808) 2023-10-03T10:15:41.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.024+0000 7f70adf4b700 1 -- 172.21.15.72:0/2278249390 learned_addr learned my addr 172.21.15.72:0/2278249390 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:41.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.024+0000 7f70adf4b700 1 -- 172.21.15.72:0/2278249390 >> v2:172.21.15.72:3300/0 conn(0x7f70a809e1d0 msgr2=0x7f70a8135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.024+0000 7f70adf4b700 1 --2- 172.21.15.72:0/2278249390 >> v2:172.21.15.72:3300/0 conn(0x7f70a809e1d0 0x7f70a8135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.024+0000 7f70adf4b700 1 -- 172.21.15.72:0/2278249390 >> v1:172.21.15.72:6789/0 conn(0x7f70a809d6f0 legacy=0x7f70a809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.024+0000 7f70adf4b700 1 -- 172.21.15.72:0/2278249390 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a809b2d0 con 0x7f70a8135e50 2023-10-03T10:15:41.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.024+0000 7f70acf49700 1 --2- 172.21.15.72:0/2278249390 >> v2:172.21.15.72:3300/0 conn(0x7f70a809e1d0 0x7f70a8135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.025+0000 7f70adf4b700 1 --2- 172.21.15.72:0/2278249390 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a8135e50 0x7f70a8138230 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009e50 tx=0x7f70a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e9c644f408bc9a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.025+0000 7f709ffff700 1 -- 172.21.15.72:0/2278249390 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a000e070 con 0x7f70a8135e50 2023-10-03T10:15:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.025+0000 7f709ffff700 1 -- 172.21.15.72:0/2278249390 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a000b910 con 0x7f70a8135e50 2023-10-03T10:15:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.025+0000 7f709ffff700 1 -- 172.21.15.72:0/2278249390 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a000bcc0 con 0x7f70a8135e50 2023-10-03T10:15:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.025+0000 7f70af9ae700 1 -- 172.21.15.72:0/2278249390 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a8135e50 msgr2=0x7f70a8138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.025+0000 7f70af9ae700 1 --2- 172.21.15.72:0/2278249390 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a8135e50 0x7f70a8138230 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009e50 tx=0x7f70a000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.025+0000 7f70af9ae700 1 -- 172.21.15.72:0/2278249390 shutdown_connections 2023-10-03T10:15:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.025+0000 7f70af9ae700 1 --2- 172.21.15.72:0/2278249390 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a8135e50 0x7f70a8138230 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.025+0000 7f70af9ae700 1 --2- 172.21.15.72:0/2278249390 >> v2:172.21.15.72:3300/0 conn(0x7f70a809e1d0 0x7f70a8135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.025+0000 7f70af9ae700 1 -- 172.21.15.72:0/2278249390 >> 172.21.15.72:0/2278249390 conn(0x7f70a8066f50 msgr2=0x7f70a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.025+0000 7f70af9ae700 1 -- 172.21.15.72:0/2278249390 shutdown_connections 2023-10-03T10:15:41.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.025+0000 7f70af9ae700 1 -- 172.21.15.72:0/2278249390 wait complete. 2023-10-03T10:15:41.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.026+0000 7f70af9ae700 1 Processor -- start 2023-10-03T10:15:41.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.026+0000 7f70af9ae700 1 -- start start 2023-10-03T10:15:41.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70af9ae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a809d6f0 0x7f70a8130b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70af9ae700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70a809e1d0 0x7f70a8131040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70af9ae700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70a8135e50 0x7f70a8131580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70af9ae700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a8120da0 con 0x7f70a8135e50 2023-10-03T10:15:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70af9ae700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a809c700 con 0x7f70a809d6f0 2023-10-03T10:15:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70af9ae700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70a806b1f0 con 0x7f70a809e1d0 2023-10-03T10:15:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70adf4b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70a8135e50 0x7f70a8131580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70adf4b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70a8135e50 0x7f70a8131580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58088/0 (socket says 172.21.15.72:58088) 2023-10-03T10:15:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70adf4b700 1 -- 172.21.15.72:0/3850681716 learned_addr learned my addr 172.21.15.72:0/3850681716 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70ad74a700 1 --2- 172.21.15.72:0/3850681716 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a809d6f0 0x7f70a8130b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70acf49700 1 --2- 172.21.15.72:0/3850681716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70a809e1d0 0x7f70a8131040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70ad74a700 1 -- 172.21.15.72:0/3850681716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70a809e1d0 msgr2=0x7f70a8131040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70ad74a700 1 --2- 172.21.15.72:0/3850681716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70a809e1d0 0x7f70a8131040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70ad74a700 1 -- 172.21.15.72:0/3850681716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70a8135e50 msgr2=0x7f70a8131580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70ad74a700 1 --2- 172.21.15.72:0/3850681716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70a8135e50 0x7f70a8131580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70ad74a700 1 -- 172.21.15.72:0/3850681716 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a40094a0 con 0x7f70a809d6f0 2023-10-03T10:15:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70adf4b700 1 --2- 172.21.15.72:0/3850681716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70a8135e50 0x7f70a8131580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.027+0000 7f70ad74a700 1 --2- 172.21.15.72:0/3850681716 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a809d6f0 0x7f70a8130b00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7098000f60 tx=0x7f709800c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.028+0000 7f709dffb700 1 -- 172.21.15.72:0/3850681716 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980052d0 con 0x7f70a809d6f0 2023-10-03T10:15:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.028+0000 7f709dffb700 1 -- 172.21.15.72:0/3850681716 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7098005430 con 0x7f70a809d6f0 2023-10-03T10:15:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.028+0000 7f709dffb700 1 -- 172.21.15.72:0/3850681716 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980038c0 con 0x7f70a809d6f0 2023-10-03T10:15:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.028+0000 7f70af9ae700 1 -- 172.21.15.72:0/3850681716 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a0009b30 con 0x7f70a809d6f0 2023-10-03T10:15:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.028+0000 7f70af9ae700 1 -- 172.21.15.72:0/3850681716 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a806a950 con 0x7f70a809d6f0 2023-10-03T10:15:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.028+0000 7f709dffb700 1 -- 172.21.15.72:0/3850681716 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7098003c30 con 0x7f70a809d6f0 2023-10-03T10:15:41.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.028+0000 7f709dffb700 1 -- 172.21.15.72:0/3850681716 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f709803eb50 con 0x7f70a809d6f0 2023-10-03T10:15:41.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.029+0000 7f70af9ae700 1 -- 172.21.15.72:0/3850681716 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a8074ea0 con 0x7f70a809d6f0 2023-10-03T10:15:41.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.033+0000 7f709dffb700 1 -- 172.21.15.72:0/3850681716 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7098017080 con 0x7f70a809d6f0 2023-10-03T10:15:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.084+0000 7f7d78b81700 1 -- 172.21.15.72:0/1205271260 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7d74074ea0 con 0x7f7d740a0a30 2023-10-03T10:15:41.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.085+0000 7f7d62ffd700 1 -- 172.21.15.72:0/1205271260 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7d64015030 con 0x7f7d740a0a30 2023-10-03T10:15:41.084 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.087+0000 7f7d78b81700 1 -- 172.21.15.72:0/1205271260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d740a0a30 msgr2=0x7f7d74122670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.087+0000 7f7d78b81700 1 --2- 172.21.15.72:0/1205271260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d740a0a30 0x7f7d74122670 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7d7409e330 tx=0x7f7d64004750 comp rx=0 tx=0).stop 2023-10-03T10:15:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.087+0000 7f7d78b81700 1 -- 172.21.15.72:0/1205271260 shutdown_connections 2023-10-03T10:15:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.087+0000 7f7d78b81700 1 --2- 172.21.15.72:0/1205271260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d74134170 0x7f7d741230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.087+0000 7f7d78b81700 1 --2- 172.21.15.72:0/1205271260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d740a0a30 0x7f7d74122670 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.087+0000 7f7d78b81700 1 --2- 172.21.15.72:0/1205271260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d740a1340 0x7f7d74122bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.087+0000 7f7d78b81700 1 -- 172.21.15.72:0/1205271260 >> 172.21.15.72:0/1205271260 conn(0x7f7d740a6550 msgr2=0x7f7d7409edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.087+0000 7f7d78b81700 1 -- 172.21.15.72:0/1205271260 shutdown_connections 2023-10-03T10:15:41.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.087+0000 7f7d78b81700 1 -- 172.21.15.72:0/1205271260 wait complete. 2023-10-03T10:15:41.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:41.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.221+0000 7f70af9ae700 1 -- 172.21.15.72:0/3850681716 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f70a806c360 con 0x7f70a809d6f0 2023-10-03T10:15:41.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.221+0000 7f709dffb700 1 -- 172.21.15.72:0/3850681716 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f709801bb10 con 0x7f70a809d6f0 2023-10-03T10:15:41.221 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:41.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.223+0000 7f70af9ae700 1 -- 172.21.15.72:0/3850681716 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a809d6f0 msgr2=0x7f70a8130b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.223+0000 7f70af9ae700 1 --2- 172.21.15.72:0/3850681716 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a809d6f0 0x7f70a8130b00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7098000f60 tx=0x7f709800c6e0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.223+0000 7f70af9ae700 1 -- 172.21.15.72:0/3850681716 shutdown_connections 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.223+0000 7f70af9ae700 1 --2- 172.21.15.72:0/3850681716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70a8135e50 0x7f70a8131580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.223+0000 7f70af9ae700 1 --2- 172.21.15.72:0/3850681716 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a809d6f0 0x7f70a8130b00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.223+0000 7f70af9ae700 1 --2- 172.21.15.72:0/3850681716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f70a809e1d0 0x7f70a8131040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.223+0000 7f70af9ae700 1 -- 172.21.15.72:0/3850681716 >> 172.21.15.72:0/3850681716 conn(0x7f70a8066f50 msgr2=0x7f70a8134830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.224+0000 7f70af9ae700 1 -- 172.21.15.72:0/3850681716 shutdown_connections 2023-10-03T10:15:41.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.224+0000 7f70af9ae700 1 -- 172.21.15.72:0/3850681716 wait complete. 2023-10-03T10:15:41.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:41.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:41.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.616+0000 7f79942d2700 1 Processor -- start 2023-10-03T10:15:41.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.616+0000 7f79942d2700 1 -- start start 2023-10-03T10:15:41.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f79942d2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f798c133420 0x7f798c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f79942d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f798c133e30 0x7f798c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f79942d2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f798c134260 0x7f798c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f79942d2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798c06b990 con 0x7f798c134260 2023-10-03T10:15:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f79942d2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798c0a0590 con 0x7f798c133e30 2023-10-03T10:15:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f79942d2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f798c09fb80 con 0x7f798c133420 2023-10-03T10:15:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799186d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f798c133e30 0x7f798c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799206e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f798c133420 0x7f798c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799286f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f798c134260 0x7f798c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799186d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f798c133e30 0x7f798c12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33826/0 (socket says 172.21.15.72:33826) 2023-10-03T10:15:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799206e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f798c133420 0x7f798c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50806/0 (socket says 172.21.15.72:50806) 2023-10-03T10:15:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799186d700 1 -- 172.21.15.72:0/1568157795 learned_addr learned my addr 172.21.15.72:0/1568157795 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:41.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799186d700 1 -- 172.21.15.72:0/1568157795 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f798c133420 msgr2=0x7f798c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799186d700 1 --2- 172.21.15.72:0/1568157795 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f798c133420 0x7f798c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799186d700 1 -- 172.21.15.72:0/1568157795 >> v2:172.21.15.72:3300/0 conn(0x7f798c134260 msgr2=0x7f798c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799186d700 1 --2- 172.21.15.72:0/1568157795 >> v2:172.21.15.72:3300/0 conn(0x7f798c134260 0x7f798c1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799186d700 1 -- 172.21.15.72:0/1568157795 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c0a0030 con 0x7f798c133e30 2023-10-03T10:15:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799286f700 1 --2- 172.21.15.72:0/1568157795 >> v2:172.21.15.72:3300/0 conn(0x7f798c134260 0x7f798c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799206e700 1 --2- 172.21.15.72:0/1568157795 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f798c133420 0x7f798c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799186d700 1 --2- 172.21.15.72:0/1568157795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f798c133e30 0x7f798c12ff90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f79880098f0 tx=0x7f7988009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c9b536d6098ddcd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799106c700 1 -- 172.21.15.72:0/1568157795 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7988011830 con 0x7f798c133e30 2023-10-03T10:15:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799106c700 1 -- 172.21.15.72:0/1568157795 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7988011990 con 0x7f798c133e30 2023-10-03T10:15:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.617+0000 7f799106c700 1 -- 172.21.15.72:0/1568157795 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7988011d20 con 0x7f798c133e30 2023-10-03T10:15:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.618+0000 7f79942d2700 1 -- 172.21.15.72:0/1568157795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f798c133e30 msgr2=0x7f798c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.618+0000 7f79942d2700 1 --2- 172.21.15.72:0/1568157795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f798c133e30 0x7f798c12ff90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f79880098f0 tx=0x7f7988009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.618+0000 7f79942d2700 1 -- 172.21.15.72:0/1568157795 shutdown_connections 2023-10-03T10:15:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.618+0000 7f79942d2700 1 --2- 172.21.15.72:0/1568157795 >> v2:172.21.15.72:3300/0 conn(0x7f798c134260 0x7f798c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.618+0000 7f79942d2700 1 --2- 172.21.15.72:0/1568157795 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f798c133420 0x7f798c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.618+0000 7f79942d2700 1 --2- 172.21.15.72:0/1568157795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f798c133e30 0x7f798c12ff90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.618+0000 7f79942d2700 1 -- 172.21.15.72:0/1568157795 >> 172.21.15.72:0/1568157795 conn(0x7f798c0a4210 msgr2=0x7f798c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.618+0000 7f79942d2700 1 -- 172.21.15.72:0/1568157795 shutdown_connections 2023-10-03T10:15:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.618+0000 7f79942d2700 1 -- 172.21.15.72:0/1568157795 wait complete. 2023-10-03T10:15:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.619+0000 7f79942d2700 1 Processor -- start 2023-10-03T10:15:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.619+0000 7f79942d2700 1 -- start start 2023-10-03T10:15:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.619+0000 7f79942d2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c133420 0x7f798c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.619+0000 7f79942d2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f798c133e30 0x7f798c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.619+0000 7f79942d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f798c134260 0x7f798c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.619+0000 7f79942d2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c09e020 con 0x7f798c133420 2023-10-03T10:15:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.619+0000 7f79942d2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798c11f8e0 con 0x7f798c134260 2023-10-03T10:15:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.619+0000 7f79942d2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f798c11fe70 con 0x7f798c133e30 2023-10-03T10:15:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f799186d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f798c133e30 0x7f798c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f799286f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f798c134260 0x7f798c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f799186d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f798c133e30 0x7f798c09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50814/0 (socket says 172.21.15.72:50814) 2023-10-03T10:15:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f799186d700 1 -- 172.21.15.72:0/1453442495 learned_addr learned my addr 172.21.15.72:0/1453442495 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f799206e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c133420 0x7f798c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f799286f700 1 -- 172.21.15.72:0/1453442495 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f798c133e30 msgr2=0x7f798c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f799286f700 1 --2- 172.21.15.72:0/1453442495 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f798c133e30 0x7f798c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f799286f700 1 -- 172.21.15.72:0/1453442495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c133420 msgr2=0x7f798c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f799286f700 1 --2- 172.21.15.72:0/1453442495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c133420 0x7f798c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f799286f700 1 -- 172.21.15.72:0/1453442495 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c0094a0 con 0x7f798c134260 2023-10-03T10:15:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f799186d700 1 --2- 172.21.15.72:0/1453442495 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f798c133e30 0x7f798c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f799286f700 1 --2- 172.21.15.72:0/1453442495 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f798c134260 0x7f798c09cf00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f798400efc0 tx=0x7f798400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f7982ffd700 1 -- 172.21.15.72:0/1453442495 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400ca90 con 0x7f798c134260 2023-10-03T10:15:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f7982ffd700 1 -- 172.21.15.72:0/1453442495 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798400f040 con 0x7f798c134260 2023-10-03T10:15:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f7982ffd700 1 -- 172.21.15.72:0/1453442495 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400ce30 con 0x7f798c134260 2023-10-03T10:15:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f79942d2700 1 -- 172.21.15.72:0/1453442495 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7984009a70 con 0x7f798c134260 2023-10-03T10:15:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.620+0000 7f79942d2700 1 -- 172.21.15.72:0/1453442495 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7988009550 con 0x7f798c134260 2023-10-03T10:15:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.621+0000 7f7982ffd700 1 -- 172.21.15.72:0/1453442495 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7984014480 con 0x7f798c134260 2023-10-03T10:15:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.621+0000 7f7982ffd700 1 -- 172.21.15.72:0/1453442495 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f798403fbe0 con 0x7f798c134260 2023-10-03T10:15:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.621+0000 7f79942d2700 1 -- 172.21.15.72:0/1453442495 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798c074ea0 con 0x7f798c134260 2023-10-03T10:15:41.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.626+0000 7f7982ffd700 1 -- 172.21.15.72:0/1453442495 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7984012930 con 0x7f798c134260 2023-10-03T10:15:41.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.811+0000 7f79942d2700 1 -- 172.21.15.72:0/1453442495 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f798c11ea90 con 0x7f798c134260 2023-10-03T10:15:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.811+0000 7f7982ffd700 1 -- 172.21.15.72:0/1453442495 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7984012340 con 0x7f798c134260 2023-10-03T10:15:41.811 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:41.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.813+0000 7f79942d2700 1 -- 172.21.15.72:0/1453442495 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f798c134260 msgr2=0x7f798c09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.813+0000 7f79942d2700 1 --2- 172.21.15.72:0/1453442495 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f798c134260 0x7f798c09cf00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f798400efc0 tx=0x7f798400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.813+0000 7f79942d2700 1 -- 172.21.15.72:0/1453442495 shutdown_connections 2023-10-03T10:15:41.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.813+0000 7f79942d2700 1 --2- 172.21.15.72:0/1453442495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f798c133420 0x7f798c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.813+0000 7f79942d2700 1 --2- 172.21.15.72:0/1453442495 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f798c134260 0x7f798c09cf00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.813+0000 7f79942d2700 1 --2- 172.21.15.72:0/1453442495 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f798c133e30 0x7f798c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.813+0000 7f79942d2700 1 -- 172.21.15.72:0/1453442495 >> 172.21.15.72:0/1453442495 conn(0x7f798c0a4210 msgr2=0x7f798c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.814+0000 7f79942d2700 1 -- 172.21.15.72:0/1453442495 shutdown_connections 2023-10-03T10:15:41.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:41.814+0000 7f79942d2700 1 -- 172.21.15.72:0/1453442495 wait complete. 2023-10-03T10:15:41.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:41.996 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:42.099 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:42.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.120+0000 7f94e8b33700 1 Processor -- start 2023-10-03T10:15:42.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.120+0000 7f94e8b33700 1 -- start start 2023-10-03T10:15:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.121+0000 7f94e8b33700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94e409e1d0 0x7f94e4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.121+0000 7f94e8b33700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94e4139170 0x7f94e413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.121+0000 7f94e8b33700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e409b120 con 0x7f94e409d6f0 2023-10-03T10:15:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.121+0000 7f94e8b33700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e406b460 con 0x7f94e409e1d0 2023-10-03T10:15:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.121+0000 7f94e8b33700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94e409a7e0 con 0x7f94e4139170 2023-10-03T10:15:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.121+0000 7f94e1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94e409e1d0 0x7f94e4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.121+0000 7f94e2d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94e4139170 0x7f94e413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.121+0000 7f94e1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94e409e1d0 0x7f94e4138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58104/0 (socket says 172.21.15.72:58104) 2023-10-03T10:15:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.121+0000 7f94e2d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94e4139170 0x7f94e413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50822/0 (socket says 172.21.15.72:50822) 2023-10-03T10:15:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.121+0000 7f94e1d9b700 1 -- 172.21.15.72:0/1118156084 learned_addr learned my addr 172.21.15.72:0/1118156084 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.121+0000 7f94e259c700 1 --1- 172.21.15.72:0/1118156084 >> v1:172.21.15.72:6789/0 conn(0x7f94e409d6f0 0x7f94e409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49480/0 (socket says 172.21.15.72:49480) 2023-10-03T10:15:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.122+0000 7f94e1d9b700 1 -- 172.21.15.72:0/1118156084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94e4139170 msgr2=0x7f94e413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.122+0000 7f94e1d9b700 1 --2- 172.21.15.72:0/1118156084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94e4139170 0x7f94e413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.122+0000 7f94e1d9b700 1 -- 172.21.15.72:0/1118156084 >> v1:172.21.15.72:6789/0 conn(0x7f94e409d6f0 legacy=0x7f94e409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.122+0000 7f94e1d9b700 1 -- 172.21.15.72:0/1118156084 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e409a500 con 0x7f94e409e1d0 2023-10-03T10:15:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.122+0000 7f94e159a700 1 -- 172.21.15.72:0/1118156084 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705353937 0 0) 0x7f94e409b120 con 0x7f94e409d6f0 2023-10-03T10:15:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.122+0000 7f94e2d9d700 1 --2- 172.21.15.72:0/1118156084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94e4139170 0x7f94e413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.122+0000 7f94e1d9b700 1 --2- 172.21.15.72:0/1118156084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e409e1d0 0x7f94e4138c30 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009920 tx=0x7f94d8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f880a037a7ba8c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.122+0000 7f94e159a700 1 -- 172.21.15.72:0/1118156084 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8011830 con 0x7f94e409e1d0 2023-10-03T10:15:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.122+0000 7f94e159a700 1 -- 172.21.15.72:0/1118156084 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d8011990 con 0x7f94e409e1d0 2023-10-03T10:15:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.122+0000 7f94e159a700 1 -- 172.21.15.72:0/1118156084 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8011d20 con 0x7f94e409e1d0 2023-10-03T10:15:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.122+0000 7f94e8b33700 1 -- 172.21.15.72:0/1118156084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e409e1d0 msgr2=0x7f94e4138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.122+0000 7f94e8b33700 1 --2- 172.21.15.72:0/1118156084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e409e1d0 0x7f94e4138c30 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009920 tx=0x7f94d8009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.123+0000 7f94e8b33700 1 -- 172.21.15.72:0/1118156084 shutdown_connections 2023-10-03T10:15:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.123+0000 7f94e8b33700 1 --2- 172.21.15.72:0/1118156084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94e4139170 0x7f94e413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.123+0000 7f94e8b33700 1 --2- 172.21.15.72:0/1118156084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e409e1d0 0x7f94e4138c30 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.123+0000 7f94e8b33700 1 -- 172.21.15.72:0/1118156084 >> 172.21.15.72:0/1118156084 conn(0x7f94e4066f50 msgr2=0x7f94e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.123+0000 7f94e8b33700 1 -- 172.21.15.72:0/1118156084 shutdown_connections 2023-10-03T10:15:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.123+0000 7f94e8b33700 1 -- 172.21.15.72:0/1118156084 wait complete. 2023-10-03T10:15:42.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.132+0000 7f94e8b33700 1 Processor -- start 2023-10-03T10:15:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.132+0000 7f94e8b33700 1 -- start start 2023-10-03T10:15:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.132+0000 7f94e8b33700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94e409d6f0 0x7f94e411e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.132+0000 7f94e8b33700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e409e1d0 0x7f94e411ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.132+0000 7f94e8b33700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94e4139170 0x7f94e411f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.132+0000 7f94e8b33700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e41222b0 con 0x7f94e409e1d0 2023-10-03T10:15:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.132+0000 7f94e8b33700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e40a20b0 con 0x7f94e4139170 2023-10-03T10:15:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.132+0000 7f94e8b33700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94e409c710 con 0x7f94e409d6f0 2023-10-03T10:15:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94e1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e409e1d0 0x7f94e411ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94e2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94e4139170 0x7f94e411f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94e1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e409e1d0 0x7f94e411ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58106/0 (socket says 172.21.15.72:58106) 2023-10-03T10:15:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94e1d9b700 1 -- 172.21.15.72:0/1152516100 learned_addr learned my addr 172.21.15.72:0/1152516100 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94e259c700 1 --2- 172.21.15.72:0/1152516100 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94e409d6f0 0x7f94e411e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94e2d9d700 1 -- 172.21.15.72:0/1152516100 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94e409d6f0 msgr2=0x7f94e411e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94e2d9d700 1 --2- 172.21.15.72:0/1152516100 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94e409d6f0 0x7f94e411e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94e2d9d700 1 -- 172.21.15.72:0/1152516100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e409e1d0 msgr2=0x7f94e411ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94e2d9d700 1 --2- 172.21.15.72:0/1152516100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e409e1d0 0x7f94e411ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94e2d9d700 1 -- 172.21.15.72:0/1152516100 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc009a70 con 0x7f94e4139170 2023-10-03T10:15:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94e1d9b700 1 --2- 172.21.15.72:0/1152516100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e409e1d0 0x7f94e411ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94e259c700 1 --2- 172.21.15.72:0/1152516100 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94e409d6f0 0x7f94e411e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94e2d9d700 1 --2- 172.21.15.72:0/1152516100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94e4139170 0x7f94e411f170 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00efc0 tx=0x7f94dc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94d2ffd700 1 -- 172.21.15.72:0/1152516100 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc00cc90 con 0x7f94e4139170 2023-10-03T10:15:42.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94d2ffd700 1 -- 172.21.15.72:0/1152516100 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc00f040 con 0x7f94e4139170 2023-10-03T10:15:42.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94e8b33700 1 -- 172.21.15.72:0/1152516100 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d8009550 con 0x7f94e4139170 2023-10-03T10:15:42.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94d2ffd700 1 -- 172.21.15.72:0/1152516100 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc014480 con 0x7f94e4139170 2023-10-03T10:15:42.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.133+0000 7f94e8b33700 1 -- 172.21.15.72:0/1152516100 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e4121f30 con 0x7f94e4139170 2023-10-03T10:15:42.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.134+0000 7f94d2ffd700 1 -- 172.21.15.72:0/1152516100 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f94dc014600 con 0x7f94e4139170 2023-10-03T10:15:42.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.134+0000 7f94d2ffd700 1 -- 172.21.15.72:0/1152516100 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f94dc03feb0 con 0x7f94e4139170 2023-10-03T10:15:42.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.135+0000 7f94e8b33700 1 -- 172.21.15.72:0/1152516100 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e4121d70 con 0x7f94e4139170 2023-10-03T10:15:42.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.139+0000 7f94d2ffd700 1 -- 172.21.15.72:0/1152516100 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f94dc018080 con 0x7f94e4139170 2023-10-03T10:15:42.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.234+0000 7f50afb14700 1 Processor -- start 2023-10-03T10:15:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.234+0000 7f50afb14700 1 -- start start 2023-10-03T10:15:42.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50afb14700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50a809d6f0 0x7f50a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50afb14700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50a809e410 0x7f50a8134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50afb14700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a809b120 con 0x7f50a809e000 2023-10-03T10:15:42.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50afb14700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a806b460 con 0x7f50a809d6f0 2023-10-03T10:15:42.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50afb14700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50a809a7e0 con 0x7f50a809e410 2023-10-03T10:15:42.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50ad8b0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50a809d6f0 0x7f50a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50ae0b1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50a809e410 0x7f50a8134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50ad0af700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f50a809e000 0x7f50a81339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49486/0 (socket says 172.21.15.72:49486) 2023-10-03T10:15:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50ad0af700 1 -- 172.21.15.72:0/2998258197 learned_addr learned my addr 172.21.15.72:0/2998258197 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50ad8b0700 1 --2- 172.21.15.72:0/2998258197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50a809d6f0 0x7f50a809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33850/0 (socket says 172.21.15.72:33850) 2023-10-03T10:15:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50ae0b1700 1 -- 172.21.15.72:0/2998258197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50a809d6f0 msgr2=0x7f50a809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50ae0b1700 1 --2- 172.21.15.72:0/2998258197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50a809d6f0 0x7f50a809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50ac8ae700 1 -- 172.21.15.72:0/2998258197 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737556769 0 0) 0x7f50a809b120 con 0x7f50a809e000 2023-10-03T10:15:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50ae0b1700 1 -- 172.21.15.72:0/2998258197 >> v1:172.21.15.72:6789/0 conn(0x7f50a809e000 legacy=0x7f50a81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50ae0b1700 1 -- 172.21.15.72:0/2998258197 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a809a500 con 0x7f50a809e410 2023-10-03T10:15:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50ad8b0700 1 --2- 172.21.15.72:0/2998258197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50a809d6f0 0x7f50a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50ae0b1700 1 --2- 172.21.15.72:0/2998258197 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50a809e410 0x7f50a8134100 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009df0 tx=0x7f50a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3626a1ebec074d10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50ac8ae700 1 -- 172.21.15.72:0/2998258197 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a000e070 con 0x7f50a809e410 2023-10-03T10:15:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50ac8ae700 1 -- 172.21.15.72:0/2998258197 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a000bae0 con 0x7f50a809e410 2023-10-03T10:15:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.235+0000 7f50ac8ae700 1 -- 172.21.15.72:0/2998258197 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a000be90 con 0x7f50a809e410 2023-10-03T10:15:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.236+0000 7f50afb14700 1 -- 172.21.15.72:0/2998258197 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50a809e410 msgr2=0x7f50a8134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.236+0000 7f50afb14700 1 --2- 172.21.15.72:0/2998258197 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50a809e410 0x7f50a8134100 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009df0 tx=0x7f50a000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.236+0000 7f50afb14700 1 -- 172.21.15.72:0/2998258197 shutdown_connections 2023-10-03T10:15:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.236+0000 7f50afb14700 1 --2- 172.21.15.72:0/2998258197 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50a809e410 0x7f50a8134100 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.236+0000 7f50afb14700 1 --2- 172.21.15.72:0/2998258197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50a809d6f0 0x7f50a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.236+0000 7f50afb14700 1 -- 172.21.15.72:0/2998258197 >> 172.21.15.72:0/2998258197 conn(0x7f50a8066f50 msgr2=0x7f50a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.236+0000 7f50afb14700 1 -- 172.21.15.72:0/2998258197 shutdown_connections 2023-10-03T10:15:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.236+0000 7f50afb14700 1 -- 172.21.15.72:0/2998258197 wait complete. 2023-10-03T10:15:42.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:42.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.237+0000 7f50afb14700 1 Processor -- start 2023-10-03T10:15:42.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.237+0000 7f50afb14700 1 -- start start 2023-10-03T10:15:42.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50afb14700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a809d6f0 0x7f50a8122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50afb14700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50a809e000 0x7f50a8122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50afb14700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50a809e410 0x7f50a8122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50afb14700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a81237f0 con 0x7f50a809d6f0 2023-10-03T10:15:42.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50afb14700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8124e00 con 0x7f50a809e000 2023-10-03T10:15:42.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50afb14700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8125e40 con 0x7f50a809e410 2023-10-03T10:15:42.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50ad8b0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a809d6f0 0x7f50a8122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50ad8b0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a809d6f0 0x7f50a8122320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58120/0 (socket says 172.21.15.72:58120) 2023-10-03T10:15:42.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50ae0b1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50a809e410 0x7f50a8122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50ad8b0700 1 -- 172.21.15.72:0/581698753 learned_addr learned my addr 172.21.15.72:0/581698753 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:42.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50ad0af700 1 --2- 172.21.15.72:0/581698753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50a809e000 0x7f50a8122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50ad8b0700 1 -- 172.21.15.72:0/581698753 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50a809e410 msgr2=0x7f50a8122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50ad8b0700 1 --2- 172.21.15.72:0/581698753 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50a809e410 0x7f50a8122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50ad8b0700 1 -- 172.21.15.72:0/581698753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50a809e000 msgr2=0x7f50a8122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50ad8b0700 1 --2- 172.21.15.72:0/581698753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50a809e000 0x7f50a8122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50ad8b0700 1 -- 172.21.15.72:0/581698753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a40094a0 con 0x7f50a809d6f0 2023-10-03T10:15:42.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.238+0000 7f50ae0b1700 1 --2- 172.21.15.72:0/581698753 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50a809e410 0x7f50a8122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.239+0000 7f50ad8b0700 1 --2- 172.21.15.72:0/581698753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a809d6f0 0x7f50a8122320 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f50a400ec10 tx=0x7f50a400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.239+0000 7f509e7fc700 1 -- 172.21.15.72:0/581698753 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a400c850 con 0x7f50a809d6f0 2023-10-03T10:15:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.239+0000 7f509e7fc700 1 -- 172.21.15.72:0/581698753 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a400c9b0 con 0x7f50a809d6f0 2023-10-03T10:15:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.239+0000 7f509e7fc700 1 -- 172.21.15.72:0/581698753 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a400cd20 con 0x7f50a809d6f0 2023-10-03T10:15:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.239+0000 7f50afb14700 1 -- 172.21.15.72:0/581698753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a0009a70 con 0x7f50a809d6f0 2023-10-03T10:15:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.239+0000 7f50afb14700 1 -- 172.21.15.72:0/581698753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a80a2020 con 0x7f50a809d6f0 2023-10-03T10:15:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.240+0000 7f50afb14700 1 -- 172.21.15.72:0/581698753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a811f030 con 0x7f50a809d6f0 2023-10-03T10:15:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.240+0000 7f509e7fc700 1 -- 172.21.15.72:0/581698753 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50a4013470 con 0x7f50a809d6f0 2023-10-03T10:15:42.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.240+0000 7f509e7fc700 1 -- 172.21.15.72:0/581698753 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f50a403ffc0 con 0x7f50a809d6f0 2023-10-03T10:15:42.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.249+0000 7f509e7fc700 1 -- 172.21.15.72:0/581698753 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50a4013720 con 0x7f50a809d6f0 2023-10-03T10:15:42.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.352+0000 7f94e8b33700 1 -- 172.21.15.72:0/1152516100 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f94e4134640 con 0x7f94e4139170 2023-10-03T10:15:42.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.352+0000 7f94d2ffd700 1 -- 172.21.15.72:0/1152516100 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f94e4134640 con 0x7f94e4139170 2023-10-03T10:15:42.352 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:42.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.354+0000 7f94e8b33700 1 -- 172.21.15.72:0/1152516100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94e4139170 msgr2=0x7f94e411f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.354+0000 7f94e8b33700 1 --2- 172.21.15.72:0/1152516100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94e4139170 0x7f94e411f170 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00efc0 tx=0x7f94dc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.354+0000 7f94e8b33700 1 -- 172.21.15.72:0/1152516100 shutdown_connections 2023-10-03T10:15:42.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.354+0000 7f94e8b33700 1 --2- 172.21.15.72:0/1152516100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94e4139170 0x7f94e411f170 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.354+0000 7f94e8b33700 1 --2- 172.21.15.72:0/1152516100 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f94e409d6f0 0x7f94e411e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.354+0000 7f94e8b33700 1 --2- 172.21.15.72:0/1152516100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e409e1d0 0x7f94e411ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.354+0000 7f94e8b33700 1 -- 172.21.15.72:0/1152516100 >> 172.21.15.72:0/1152516100 conn(0x7f94e4066f50 msgr2=0x7f94e4136c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.354+0000 7f94e8b33700 1 -- 172.21.15.72:0/1152516100 shutdown_connections 2023-10-03T10:15:42.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.354+0000 7f94e8b33700 1 -- 172.21.15.72:0/1152516100 wait complete. 2023-10-03T10:15:42.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:42.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.370+0000 7fb1c46f3700 1 Processor -- start 2023-10-03T10:15:42.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.370+0000 7fb1c46f3700 1 -- start start 2023-10-03T10:15:42.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.370+0000 7fb1c46f3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1bc0a0a30 0x7fb1bc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.370+0000 7fb1c46f3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1bc0a1340 0x7fb1bc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c46f3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1bc09edd0 con 0x7fb1bc133fa0 2023-10-03T10:15:42.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c46f3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc09e1f0 con 0x7fb1bc0a0a30 2023-10-03T10:15:42.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c46f3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc09dc50 con 0x7fb1bc0a1340 2023-10-03T10:15:42.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c248f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1bc0a0a30 0x7fb1bc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c1c8e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1bc0a1340 0x7fb1bc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c2c90700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb1bc133fa0 0x7fb1bc13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49488/0 (socket says 172.21.15.72:49488) 2023-10-03T10:15:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c2c90700 1 -- 172.21.15.72:0/41576411 learned_addr learned my addr 172.21.15.72:0/41576411 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c148d700 1 -- 172.21.15.72:0/41576411 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301050330 0 0) 0x7fb1bc09edd0 con 0x7fb1bc133fa0 2023-10-03T10:15:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c1c8e700 1 -- 172.21.15.72:0/41576411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1bc0a0a30 msgr2=0x7fb1bc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c1c8e700 1 --2- 172.21.15.72:0/41576411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1bc0a0a30 0x7fb1bc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c1c8e700 1 -- 172.21.15.72:0/41576411 >> v1:172.21.15.72:6789/0 conn(0x7fb1bc133fa0 legacy=0x7fb1bc13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c1c8e700 1 -- 172.21.15.72:0/41576411 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc0a1fe0 con 0x7fb1bc0a1340 2023-10-03T10:15:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c248f700 1 --2- 172.21.15.72:0/41576411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1bc0a0a30 0x7fb1bc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c1c8e700 1 --2- 172.21.15.72:0/41576411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1bc0a1340 0x7fb1bc133a60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009870 tx=0x7fb1ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d85812fe9b312778 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c148d700 1 -- 172.21.15.72:0/41576411 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac011830 con 0x7fb1bc0a1340 2023-10-03T10:15:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c148d700 1 -- 172.21.15.72:0/41576411 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac011990 con 0x7fb1bc0a1340 2023-10-03T10:15:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.371+0000 7fb1c148d700 1 -- 172.21.15.72:0/41576411 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac011d20 con 0x7fb1bc0a1340 2023-10-03T10:15:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.372+0000 7fb1c46f3700 1 -- 172.21.15.72:0/41576411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1bc0a1340 msgr2=0x7fb1bc133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.372+0000 7fb1c46f3700 1 --2- 172.21.15.72:0/41576411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1bc0a1340 0x7fb1bc133a60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009870 tx=0x7fb1ac009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.372+0000 7fb1c46f3700 1 -- 172.21.15.72:0/41576411 shutdown_connections 2023-10-03T10:15:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.372+0000 7fb1c46f3700 1 --2- 172.21.15.72:0/41576411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1bc0a0a30 0x7fb1bc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.372+0000 7fb1c46f3700 1 --2- 172.21.15.72:0/41576411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1bc0a1340 0x7fb1bc133a60 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.372+0000 7fb1c46f3700 1 -- 172.21.15.72:0/41576411 >> 172.21.15.72:0/41576411 conn(0x7fb1bc0a6550 msgr2=0x7fb1bc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.372+0000 7fb1c46f3700 1 -- 172.21.15.72:0/41576411 shutdown_connections 2023-10-03T10:15:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.372+0000 7fb1c46f3700 1 -- 172.21.15.72:0/41576411 wait complete. 2023-10-03T10:15:42.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.373+0000 7fb1c46f3700 1 Processor -- start 2023-10-03T10:15:42.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.373+0000 7fb1c46f3700 1 -- start start 2023-10-03T10:15:42.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.373+0000 7fb1c46f3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1bc0a0a30 0x7fb1bc1c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.373+0000 7fb1c46f3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1bc0a1340 0x7fb1bc1c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.373+0000 7fb1c46f3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1bc133fa0 0x7fb1bc1c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.373+0000 7fb1c46f3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc1244c0 con 0x7fb1bc0a0a30 2023-10-03T10:15:42.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.373+0000 7fb1c46f3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc124d90 con 0x7fb1bc133fa0 2023-10-03T10:15:42.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.373+0000 7fb1c46f3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc122d60 con 0x7fb1bc0a1340 2023-10-03T10:15:42.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.373+0000 7fb1c248f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1bc0a0a30 0x7fb1bc1c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.373+0000 7fb1c1c8e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1bc0a1340 0x7fb1bc1c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.373+0000 7fb1c248f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1bc0a0a30 0x7fb1bc1c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58126/0 (socket says 172.21.15.72:58126) 2023-10-03T10:15:42.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.373+0000 7fb1c248f700 1 -- 172.21.15.72:0/3594378252 learned_addr learned my addr 172.21.15.72:0/3594378252 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:42.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.373+0000 7fb1c2c90700 1 --2- 172.21.15.72:0/3594378252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1bc133fa0 0x7fb1bc1c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.374+0000 7fb1c248f700 1 -- 172.21.15.72:0/3594378252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1bc0a1340 msgr2=0x7fb1bc1c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.374+0000 7fb1c248f700 1 --2- 172.21.15.72:0/3594378252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1bc0a1340 0x7fb1bc1c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.374+0000 7fb1c248f700 1 -- 172.21.15.72:0/3594378252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1bc133fa0 msgr2=0x7fb1bc1c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.374+0000 7fb1c248f700 1 --2- 172.21.15.72:0/3594378252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1bc133fa0 0x7fb1bc1c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.374+0000 7fb1c248f700 1 -- 172.21.15.72:0/3594378252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b80094a0 con 0x7fb1bc0a0a30 2023-10-03T10:15:42.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.374+0000 7fb1c1c8e700 1 --2- 172.21.15.72:0/3594378252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1bc0a1340 0x7fb1bc1c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.374+0000 7fb1c248f700 1 --2- 172.21.15.72:0/3594378252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1bc0a0a30 0x7fb1bc1c8280 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800ebe0 tx=0x7fb1b800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.374+0000 7fb1b2ffd700 1 -- 172.21.15.72:0/3594378252 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800c850 con 0x7fb1bc0a0a30 2023-10-03T10:15:42.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.374+0000 7fb1b2ffd700 1 -- 172.21.15.72:0/3594378252 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b800c9b0 con 0x7fb1bc0a0a30 2023-10-03T10:15:42.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.374+0000 7fb1c46f3700 1 -- 172.21.15.72:0/3594378252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac0094a0 con 0x7fb1bc0a0a30 2023-10-03T10:15:42.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.374+0000 7fb1b2ffd700 1 -- 172.21.15.72:0/3594378252 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800cd40 con 0x7fb1bc0a0a30 2023-10-03T10:15:42.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.374+0000 7fb1c46f3700 1 -- 172.21.15.72:0/3594378252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1bc0a25e0 con 0x7fb1bc0a0a30 2023-10-03T10:15:42.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.375+0000 7fb1b2ffd700 1 -- 172.21.15.72:0/3594378252 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1b8013470 con 0x7fb1bc0a0a30 2023-10-03T10:15:42.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.375+0000 7fb1b2ffd700 1 -- 172.21.15.72:0/3594378252 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb1b803f780 con 0x7fb1bc0a0a30 2023-10-03T10:15:42.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.375+0000 7fb1c46f3700 1 -- 172.21.15.72:0/3594378252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1bc0a0220 con 0x7fb1bc0a0a30 2023-10-03T10:15:42.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.380+0000 7fb1b2ffd700 1 -- 172.21.15.72:0/3594378252 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1b8021020 con 0x7fb1bc0a0a30 2023-10-03T10:15:42.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.444+0000 7f50afb14700 1 -- 172.21.15.72:0/581698753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f50a8074ea0 con 0x7f50a809d6f0 2023-10-03T10:15:42.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.444+0000 7f509e7fc700 1 -- 172.21.15.72:0/581698753 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f50a4017030 con 0x7f50a809d6f0 2023-10-03T10:15:42.444 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:42.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.446+0000 7f50afb14700 1 -- 172.21.15.72:0/581698753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a809d6f0 msgr2=0x7f50a8122320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.446+0000 7f50afb14700 1 --2- 172.21.15.72:0/581698753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a809d6f0 0x7f50a8122320 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f50a400ec10 tx=0x7f50a400ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:42.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.446+0000 7f50afb14700 1 -- 172.21.15.72:0/581698753 shutdown_connections 2023-10-03T10:15:42.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.446+0000 7f50afb14700 1 --2- 172.21.15.72:0/581698753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a809d6f0 0x7f50a8122320 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.446+0000 7f50afb14700 1 --2- 172.21.15.72:0/581698753 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f50a809e410 0x7f50a8122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.446+0000 7f50afb14700 1 --2- 172.21.15.72:0/581698753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50a809e000 0x7f50a8122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.446+0000 7f50afb14700 1 -- 172.21.15.72:0/581698753 >> 172.21.15.72:0/581698753 conn(0x7f50a8066f50 msgr2=0x7f50a8133de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.446+0000 7f50afb14700 1 -- 172.21.15.72:0/581698753 shutdown_connections 2023-10-03T10:15:42.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.446+0000 7f50afb14700 1 -- 172.21.15.72:0/581698753 wait complete. 2023-10-03T10:15:42.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:42.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.569+0000 7fb1c46f3700 1 -- 172.21.15.72:0/3594378252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb1bc074ea0 con 0x7fb1bc0a0a30 2023-10-03T10:15:42.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.569+0000 7fb1b2ffd700 1 -- 172.21.15.72:0/3594378252 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1b800cea0 con 0x7fb1bc0a0a30 2023-10-03T10:15:42.569 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:42.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.571+0000 7fb1c46f3700 1 -- 172.21.15.72:0/3594378252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1bc0a0a30 msgr2=0x7fb1bc1c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.571+0000 7fb1c46f3700 1 --2- 172.21.15.72:0/3594378252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1bc0a0a30 0x7fb1bc1c8280 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800ebe0 tx=0x7fb1b800eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.571+0000 7fb1c46f3700 1 -- 172.21.15.72:0/3594378252 shutdown_connections 2023-10-03T10:15:42.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.571+0000 7fb1c46f3700 1 --2- 172.21.15.72:0/3594378252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1bc0a0a30 0x7fb1bc1c8280 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.571+0000 7fb1c46f3700 1 --2- 172.21.15.72:0/3594378252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1bc133fa0 0x7fb1bc1c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.571+0000 7fb1c46f3700 1 --2- 172.21.15.72:0/3594378252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1bc0a1340 0x7fb1bc1c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.571+0000 7fb1c46f3700 1 -- 172.21.15.72:0/3594378252 >> 172.21.15.72:0/3594378252 conn(0x7fb1bc0a6550 msgr2=0x7fb1bc11c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.571+0000 7fb1c46f3700 1 -- 172.21.15.72:0/3594378252 shutdown_connections 2023-10-03T10:15:42.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.571+0000 7fb1c46f3700 1 -- 172.21.15.72:0/3594378252 wait complete. 2023-10-03T10:15:42.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:42.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:42.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.949+0000 7f42f6f6e700 1 Processor -- start 2023-10-03T10:15:42.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.949+0000 7f42f6f6e700 1 -- start start 2023-10-03T10:15:42.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.949+0000 7f42f6f6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42f009e1d0 0x7f42f0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.949+0000 7f42f6f6e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42f0139170 0x7f42f013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.949+0000 7f42f6f6e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f009b120 con 0x7f42f009d6f0 2023-10-03T10:15:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.949+0000 7f42f6f6e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f006b460 con 0x7f42f009e1d0 2023-10-03T10:15:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.949+0000 7f42f6f6e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42f009a7e0 con 0x7f42f0139170 2023-10-03T10:15:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.949+0000 7f42effff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42f009e1d0 0x7f42f0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.949+0000 7f42f4d0a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f42f009d6f0 0x7f42f009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49498/0 (socket says 172.21.15.72:49498) 2023-10-03T10:15:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.949+0000 7f42f550b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42f0139170 0x7f42f013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.949+0000 7f42f4d0a700 1 -- 172.21.15.72:0/3299239070 learned_addr learned my addr 172.21.15.72:0/3299239070 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.949+0000 7f42ef7fe700 1 -- 172.21.15.72:0/3299239070 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707265880 0 0) 0x7f42f009b120 con 0x7f42f009d6f0 2023-10-03T10:15:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.949+0000 7f42ef7fe700 1 -- 172.21.15.72:0/3299239070 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42e00035b0 con 0x7f42f009d6f0 2023-10-03T10:15:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.949+0000 7f42effff700 1 -- 172.21.15.72:0/3299239070 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42f0139170 msgr2=0x7f42f013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.949+0000 7f42effff700 1 --2- 172.21.15.72:0/3299239070 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42f0139170 0x7f42f013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.950+0000 7f42effff700 1 -- 172.21.15.72:0/3299239070 >> v1:172.21.15.72:6789/0 conn(0x7f42f009d6f0 legacy=0x7f42f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.950+0000 7f42effff700 1 -- 172.21.15.72:0/3299239070 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f009a500 con 0x7f42f009e1d0 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.950+0000 7f42f550b700 1 --2- 172.21.15.72:0/3299239070 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42f0139170 0x7f42f013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.950+0000 7f42effff700 1 --2- 172.21.15.72:0/3299239070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42f009e1d0 0x7f42f0138c30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009870 tx=0x7f42dc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d0c7609e602f4fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.950+0000 7f42ef7fe700 1 -- 172.21.15.72:0/3299239070 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc011830 con 0x7f42f009e1d0 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.950+0000 7f42ef7fe700 1 -- 172.21.15.72:0/3299239070 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc011990 con 0x7f42f009e1d0 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.950+0000 7f42ef7fe700 1 -- 172.21.15.72:0/3299239070 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc011d20 con 0x7f42f009e1d0 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.950+0000 7f42f6f6e700 1 -- 172.21.15.72:0/3299239070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42f009e1d0 msgr2=0x7f42f0138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.950+0000 7f42f6f6e700 1 --2- 172.21.15.72:0/3299239070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42f009e1d0 0x7f42f0138c30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009870 tx=0x7f42dc009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.950+0000 7f42f6f6e700 1 -- 172.21.15.72:0/3299239070 shutdown_connections 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.950+0000 7f42f6f6e700 1 --2- 172.21.15.72:0/3299239070 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42f0139170 0x7f42f013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.950+0000 7f42f6f6e700 1 --2- 172.21.15.72:0/3299239070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42f009e1d0 0x7f42f0138c30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.950+0000 7f42f6f6e700 1 -- 172.21.15.72:0/3299239070 >> 172.21.15.72:0/3299239070 conn(0x7f42f0066f50 msgr2=0x7f42f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.950+0000 7f42f6f6e700 1 -- 172.21.15.72:0/3299239070 shutdown_connections 2023-10-03T10:15:42.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.950+0000 7f42f6f6e700 1 -- 172.21.15.72:0/3299239070 wait complete. 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.951+0000 7f42f6f6e700 1 Processor -- start 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.951+0000 7f42f6f6e700 1 -- start start 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42f6f6e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42f009d6f0 0x7f42f01216a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42f6f6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42f009e1d0 0x7f42f0121be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42f6f6e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f0139170 0x7f42f0122120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42f6f6e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f01251c0 con 0x7f42f0139170 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42f6f6e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f01240b0 con 0x7f42f009e1d0 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42f6f6e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42f00a1780 con 0x7f42f009d6f0 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42f4d0a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42f009d6f0 0x7f42f01216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42effff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42f009e1d0 0x7f42f0121be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42f4d0a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42f009d6f0 0x7f42f01216a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50898/0 (socket says 172.21.15.72:50898) 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42f4d0a700 1 -- 172.21.15.72:0/1996598371 learned_addr learned my addr 172.21.15.72:0/1996598371 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42f550b700 1 --2- 172.21.15.72:0/1996598371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f0139170 0x7f42f0122120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42effff700 1 -- 172.21.15.72:0/1996598371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42f009d6f0 msgr2=0x7f42f01216a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42effff700 1 --2- 172.21.15.72:0/1996598371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42f009d6f0 0x7f42f01216a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42effff700 1 -- 172.21.15.72:0/1996598371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f0139170 msgr2=0x7f42f0122120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42effff700 1 --2- 172.21.15.72:0/1996598371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f0139170 0x7f42f0122120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42effff700 1 -- 172.21.15.72:0/1996598371 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e8009a70 con 0x7f42f009e1d0 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42f550b700 1 --2- 172.21.15.72:0/1996598371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f0139170 0x7f42f0122120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42f4d0a700 1 --2- 172.21.15.72:0/1996598371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42f009d6f0 0x7f42f01216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.952+0000 7f42effff700 1 --2- 172.21.15.72:0/1996598371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42f009e1d0 0x7f42f0121be0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009870 tx=0x7f42dc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.953+0000 7f42ed7fa700 1 -- 172.21.15.72:0/1996598371 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc004450 con 0x7f42f009e1d0 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.953+0000 7f42ed7fa700 1 -- 172.21.15.72:0/1996598371 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc01f070 con 0x7f42f009e1d0 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.953+0000 7f42f6f6e700 1 -- 172.21.15.72:0/1996598371 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42dc0094a0 con 0x7f42f009e1d0 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.953+0000 7f42ed7fa700 1 -- 172.21.15.72:0/1996598371 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc0038e0 con 0x7f42f009e1d0 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.953+0000 7f42f6f6e700 1 -- 172.21.15.72:0/1996598371 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f0123350 con 0x7f42f009e1d0 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.953+0000 7f42ed7fa700 1 -- 172.21.15.72:0/1996598371 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f42dc003a40 con 0x7f42f009e1d0 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.954+0000 7f42ed7fa700 1 -- 172.21.15.72:0/1996598371 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f42dc021070 con 0x7f42f009e1d0 2023-10-03T10:15:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.954+0000 7f42f6f6e700 1 -- 172.21.15.72:0/1996598371 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f0074ea0 con 0x7f42f009e1d0 2023-10-03T10:15:42.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:42.958+0000 7f42ed7fa700 1 -- 172.21.15.72:0/1996598371 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42dc02b070 con 0x7f42f009e1d0 2023-10-03T10:15:43.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.141+0000 7f42f6f6e700 1 -- 172.21.15.72:0/1996598371 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f42f0124570 con 0x7f42f009e1d0 2023-10-03T10:15:43.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.141+0000 7f42ed7fa700 1 -- 172.21.15.72:0/1996598371 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f42dc015030 con 0x7f42f009e1d0 2023-10-03T10:15:43.141 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:43.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.143+0000 7f42f6f6e700 1 -- 172.21.15.72:0/1996598371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42f009e1d0 msgr2=0x7f42f0121be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.143+0000 7f42f6f6e700 1 --2- 172.21.15.72:0/1996598371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42f009e1d0 0x7f42f0121be0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009870 tx=0x7f42dc004750 comp rx=0 tx=0).stop 2023-10-03T10:15:43.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.143+0000 7f42f6f6e700 1 -- 172.21.15.72:0/1996598371 shutdown_connections 2023-10-03T10:15:43.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.143+0000 7f42f6f6e700 1 --2- 172.21.15.72:0/1996598371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42f0139170 0x7f42f0122120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.143+0000 7f42f6f6e700 1 --2- 172.21.15.72:0/1996598371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f42f009d6f0 0x7f42f01216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.143+0000 7f42f6f6e700 1 --2- 172.21.15.72:0/1996598371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42f009e1d0 0x7f42f0121be0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.143+0000 7f42f6f6e700 1 -- 172.21.15.72:0/1996598371 >> 172.21.15.72:0/1996598371 conn(0x7f42f0066f50 msgr2=0x7f42f009b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:43.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.143+0000 7f42f6f6e700 1 -- 172.21.15.72:0/1996598371 shutdown_connections 2023-10-03T10:15:43.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.143+0000 7f42f6f6e700 1 -- 172.21.15.72:0/1996598371 wait complete. 2023-10-03T10:15:43.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:43.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:43.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:43.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.492+0000 7f1a61e24700 1 Processor -- start 2023-10-03T10:15:43.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.492+0000 7f1a61e24700 1 -- start start 2023-10-03T10:15:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.492+0000 7f1a61e24700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1a5c09d6f0 0x7f1a5c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.492+0000 7f1a61e24700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a5c09e000 0x7f1a5c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.492+0000 7f1a61e24700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a5c09e410 0x7f1a5c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.492+0000 7f1a61e24700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5c09f520 con 0x7f1a5c09d6f0 2023-10-03T10:15:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.492+0000 7f1a61e24700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c09f130 con 0x7f1a5c09e410 2023-10-03T10:15:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.492+0000 7f1a61e24700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c09e930 con 0x7f1a5c09e000 2023-10-03T10:15:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.492+0000 7f1a5b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1a5c09d6f0 0x7f1a5c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.492+0000 7f1a5affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a5c09e000 0x7f1a5c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.492+0000 7f1a5b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1a5c09d6f0 0x7f1a5c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58146/0 (socket says 172.21.15.72:58146) 2023-10-03T10:15:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.492+0000 7f1a5b7fe700 1 -- 172.21.15.72:0/682594930 learned_addr learned my addr 172.21.15.72:0/682594930 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.492+0000 7f1a5bfff700 1 --2- 172.21.15.72:0/682594930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a5c09e410 0x7f1a5c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.493+0000 7f1a5b7fe700 1 -- 172.21.15.72:0/682594930 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a5c09e000 msgr2=0x7f1a5c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.493+0000 7f1a5b7fe700 1 --2- 172.21.15.72:0/682594930 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a5c09e000 0x7f1a5c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.493+0000 7f1a5b7fe700 1 -- 172.21.15.72:0/682594930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a5c09e410 msgr2=0x7f1a5c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.493+0000 7f1a5b7fe700 1 --2- 172.21.15.72:0/682594930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a5c09e410 0x7f1a5c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.493+0000 7f1a5b7fe700 1 -- 172.21.15.72:0/682594930 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c09b2d0 con 0x7f1a5c09d6f0 2023-10-03T10:15:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.493+0000 7f1a5bfff700 1 --2- 172.21.15.72:0/682594930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a5c09e410 0x7f1a5c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.493+0000 7f1a5affd700 1 --2- 172.21.15.72:0/682594930 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a5c09e000 0x7f1a5c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.493+0000 7f1a5b7fe700 1 --2- 172.21.15.72:0/682594930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5c09d6f0 0x7f1a5c09dac0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009920 tx=0x7f1a4c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278a2b60a2239740 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.493+0000 7f1a5a7fc700 1 -- 172.21.15.72:0/682594930 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c011830 con 0x7f1a5c09d6f0 2023-10-03T10:15:43.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.493+0000 7f1a5a7fc700 1 -- 172.21.15.72:0/682594930 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c011990 con 0x7f1a5c09d6f0 2023-10-03T10:15:43.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.493+0000 7f1a5a7fc700 1 -- 172.21.15.72:0/682594930 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c011d20 con 0x7f1a5c09d6f0 2023-10-03T10:15:43.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.494+0000 7f1a61e24700 1 -- 172.21.15.72:0/682594930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5c09d6f0 msgr2=0x7f1a5c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.494+0000 7f1a61e24700 1 --2- 172.21.15.72:0/682594930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5c09d6f0 0x7f1a5c09dac0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009920 tx=0x7f1a4c009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:43.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.494+0000 7f1a61e24700 1 -- 172.21.15.72:0/682594930 shutdown_connections 2023-10-03T10:15:43.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.494+0000 7f1a61e24700 1 --2- 172.21.15.72:0/682594930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a5c09e410 0x7f1a5c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.494+0000 7f1a61e24700 1 --2- 172.21.15.72:0/682594930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5c09d6f0 0x7f1a5c09dac0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.494+0000 7f1a61e24700 1 --2- 172.21.15.72:0/682594930 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a5c09e000 0x7f1a5c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.494+0000 7f1a61e24700 1 -- 172.21.15.72:0/682594930 >> 172.21.15.72:0/682594930 conn(0x7f1a5c066f50 msgr2=0x7f1a5c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:43.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.494+0000 7f1a61e24700 1 -- 172.21.15.72:0/682594930 shutdown_connections 2023-10-03T10:15:43.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.494+0000 7f1a61e24700 1 -- 172.21.15.72:0/682594930 wait complete. 2023-10-03T10:15:43.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.495+0000 7f1a61e24700 1 Processor -- start 2023-10-03T10:15:43.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.495+0000 7f1a61e24700 1 -- start start 2023-10-03T10:15:43.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.495+0000 7f1a61e24700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a5c09d6f0 0x7f1a5c136f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.495+0000 7f1a61e24700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a5c09e000 0x7f1a5c132f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.495+0000 7f1a61e24700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5c09e410 0x7f1a5c133470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.495+0000 7f1a61e24700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c09c700 con 0x7f1a5c09e410 2023-10-03T10:15:43.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.495+0000 7f1a61e24700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c1353a0 con 0x7f1a5c09d6f0 2023-10-03T10:15:43.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.495+0000 7f1a61e24700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c136a50 con 0x7f1a5c09e000 2023-10-03T10:15:43.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.495+0000 7f1a5affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a5c09e000 0x7f1a5c132f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.495+0000 7f1a5b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a5c09d6f0 0x7f1a5c136f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.495+0000 7f1a5bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5c09e410 0x7f1a5c133470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.495+0000 7f1a5affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a5c09e000 0x7f1a5c132f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50916/0 (socket says 172.21.15.72:50916) 2023-10-03T10:15:43.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.495+0000 7f1a5affd700 1 -- 172.21.15.72:0/1074032831 learned_addr learned my addr 172.21.15.72:0/1074032831 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:43.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.496+0000 7f1a5affd700 1 -- 172.21.15.72:0/1074032831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a5c09d6f0 msgr2=0x7f1a5c136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.496+0000 7f1a5affd700 1 --2- 172.21.15.72:0/1074032831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a5c09d6f0 0x7f1a5c136f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.496+0000 7f1a5affd700 1 -- 172.21.15.72:0/1074032831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5c09e410 msgr2=0x7f1a5c133470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.496+0000 7f1a5affd700 1 --2- 172.21.15.72:0/1074032831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5c09e410 0x7f1a5c133470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.496+0000 7f1a5affd700 1 -- 172.21.15.72:0/1074032831 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a500094a0 con 0x7f1a5c09e000 2023-10-03T10:15:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.496+0000 7f1a5b7fe700 1 --2- 172.21.15.72:0/1074032831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a5c09d6f0 0x7f1a5c136f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.496+0000 7f1a5bfff700 1 --2- 172.21.15.72:0/1074032831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5c09e410 0x7f1a5c133470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.496+0000 7f1a5affd700 1 --2- 172.21.15.72:0/1074032831 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a5c09e000 0x7f1a5c132f30 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000ec10 tx=0x7f1a5000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.496+0000 7f1a43fff700 1 -- 172.21.15.72:0/1074032831 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50009780 con 0x7f1a5c09e000 2023-10-03T10:15:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.496+0000 7f1a43fff700 1 -- 172.21.15.72:0/1074032831 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5000c850 con 0x7f1a5c09e000 2023-10-03T10:15:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.496+0000 7f1a43fff700 1 -- 172.21.15.72:0/1074032831 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5000cbe0 con 0x7f1a5c09e000 2023-10-03T10:15:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.496+0000 7f1a61e24700 1 -- 172.21.15.72:0/1074032831 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a54009a70 con 0x7f1a5c09e000 2023-10-03T10:15:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.496+0000 7f1a61e24700 1 -- 172.21.15.72:0/1074032831 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4c009550 con 0x7f1a5c09e000 2023-10-03T10:15:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.497+0000 7f1a43fff700 1 -- 172.21.15.72:0/1074032831 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a5000cd40 con 0x7f1a5c09e000 2023-10-03T10:15:43.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.497+0000 7f1a43fff700 1 -- 172.21.15.72:0/1074032831 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1a5003f6f0 con 0x7f1a5c09e000 2023-10-03T10:15:43.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.497+0000 7f1a61e24700 1 -- 172.21.15.72:0/1074032831 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5c074ea0 con 0x7f1a5c09e000 2023-10-03T10:15:43.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.502+0000 7f1a43fff700 1 -- 172.21.15.72:0/1074032831 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a50021080 con 0x7f1a5c09e000 2023-10-03T10:15:43.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.596+0000 7f79be65d700 1 Processor -- start 2023-10-03T10:15:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.597+0000 7f79be65d700 1 -- start start 2023-10-03T10:15:43.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.597+0000 7f79be65d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b80a1510 0x7f79b8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.597+0000 7f79be65d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79b8139250 0x7f79b813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.597+0000 7f79be65d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b809edd0 con 0x7f79b80a0a30 2023-10-03T10:15:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.597+0000 7f79be65d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80a18e0 con 0x7f79b8139250 2023-10-03T10:15:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.597+0000 7f79be65d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79b809e1f0 con 0x7f79b80a1510 2023-10-03T10:15:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.597+0000 7f79b7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f79b80a0a30 0x7f79b80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49514/0 (socket says 172.21.15.72:49514) 2023-10-03T10:15:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.597+0000 7f79b7fff700 1 -- 172.21.15.72:0/1596472515 learned_addr learned my addr 172.21.15.72:0/1596472515 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.597+0000 7f79bcbfa700 1 --2- 172.21.15.72:0/1596472515 >> v2:172.21.15.72:3300/0 conn(0x7f79b8139250 0x7f79b813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.597+0000 7f79b77fe700 1 --2- 172.21.15.72:0/1596472515 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b80a1510 0x7f79b8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.597+0000 7f79b6ffd700 1 -- 172.21.15.72:0/1596472515 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776026383 0 0) 0x7f79b809edd0 con 0x7f79b80a0a30 2023-10-03T10:15:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.598+0000 7f79b6ffd700 1 -- 172.21.15.72:0/1596472515 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79a00035b0 con 0x7f79b80a0a30 2023-10-03T10:15:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.598+0000 7f79b77fe700 1 -- 172.21.15.72:0/1596472515 >> v2:172.21.15.72:3300/0 conn(0x7f79b8139250 msgr2=0x7f79b813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.598+0000 7f79b77fe700 1 --2- 172.21.15.72:0/1596472515 >> v2:172.21.15.72:3300/0 conn(0x7f79b8139250 0x7f79b813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.598+0000 7f79b77fe700 1 -- 172.21.15.72:0/1596472515 >> v1:172.21.15.72:6789/0 conn(0x7f79b80a0a30 legacy=0x7f79b80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.598+0000 7f79b77fe700 1 -- 172.21.15.72:0/1596472515 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b809dc50 con 0x7f79b80a1510 2023-10-03T10:15:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.598+0000 7f79bcbfa700 1 --2- 172.21.15.72:0/1596472515 >> v2:172.21.15.72:3300/0 conn(0x7f79b8139250 0x7f79b813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.598+0000 7f79b77fe700 1 --2- 172.21.15.72:0/1596472515 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b80a1510 0x7f79b8138d10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009870 tx=0x7f79ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67ef380a74d54564 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.598+0000 7f79b6ffd700 1 -- 172.21.15.72:0/1596472515 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac011830 con 0x7f79b80a1510 2023-10-03T10:15:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.598+0000 7f79b6ffd700 1 -- 172.21.15.72:0/1596472515 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac011990 con 0x7f79b80a1510 2023-10-03T10:15:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.598+0000 7f79b6ffd700 1 -- 172.21.15.72:0/1596472515 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac011d20 con 0x7f79b80a1510 2023-10-03T10:15:43.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.599+0000 7f79be65d700 1 -- 172.21.15.72:0/1596472515 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b80a1510 msgr2=0x7f79b8138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.599+0000 7f79be65d700 1 --2- 172.21.15.72:0/1596472515 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b80a1510 0x7f79b8138d10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009870 tx=0x7f79ac009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:43.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.599+0000 7f79be65d700 1 -- 172.21.15.72:0/1596472515 shutdown_connections 2023-10-03T10:15:43.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.599+0000 7f79be65d700 1 --2- 172.21.15.72:0/1596472515 >> v2:172.21.15.72:3300/0 conn(0x7f79b8139250 0x7f79b813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.599+0000 7f79be65d700 1 --2- 172.21.15.72:0/1596472515 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b80a1510 0x7f79b8138d10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.599+0000 7f79be65d700 1 -- 172.21.15.72:0/1596472515 >> 172.21.15.72:0/1596472515 conn(0x7f79b80a6550 msgr2=0x7f79b80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:43.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.599+0000 7f79be65d700 1 -- 172.21.15.72:0/1596472515 shutdown_connections 2023-10-03T10:15:43.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.599+0000 7f79be65d700 1 -- 172.21.15.72:0/1596472515 wait complete. 2023-10-03T10:15:43.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.600+0000 7f79be65d700 1 Processor -- start 2023-10-03T10:15:43.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.600+0000 7f79be65d700 1 -- start start 2023-10-03T10:15:43.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.600+0000 7f79be65d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79b80a0a30 0x7f79b81227e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.600+0000 7f79be65d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b80a1510 0x7f79b8122d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.600+0000 7f79be65d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b8139250 0x7f79b8123260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.600+0000 7f79be65d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b8138980 con 0x7f79b8139250 2023-10-03T10:15:43.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.600+0000 7f79be65d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b8124c30 con 0x7f79b80a0a30 2023-10-03T10:15:43.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.600+0000 7f79be65d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79b8138060 con 0x7f79b80a1510 2023-10-03T10:15:43.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.600+0000 7f79b77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b80a1510 0x7f79b8122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.600+0000 7f79b77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b80a1510 0x7f79b8122d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50942/0 (socket says 172.21.15.72:50942) 2023-10-03T10:15:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.600+0000 7f79b77fe700 1 -- 172.21.15.72:0/1060031242 learned_addr learned my addr 172.21.15.72:0/1060031242 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.600+0000 7f79b7fff700 1 --2- 172.21.15.72:0/1060031242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79b80a0a30 0x7f79b81227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.600+0000 7f79bcbfa700 1 --2- 172.21.15.72:0/1060031242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b8139250 0x7f79b8123260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.601+0000 7f79b77fe700 1 -- 172.21.15.72:0/1060031242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79b80a0a30 msgr2=0x7f79b81227e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.601+0000 7f79b77fe700 1 --2- 172.21.15.72:0/1060031242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79b80a0a30 0x7f79b81227e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.601+0000 7f79b77fe700 1 -- 172.21.15.72:0/1060031242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b8139250 msgr2=0x7f79b8123260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.601+0000 7f79b77fe700 1 --2- 172.21.15.72:0/1060031242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b8139250 0x7f79b8123260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.601+0000 7f79b77fe700 1 -- 172.21.15.72:0/1060031242 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b0009a70 con 0x7f79b80a1510 2023-10-03T10:15:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.601+0000 7f79bcbfa700 1 --2- 172.21.15.72:0/1060031242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b8139250 0x7f79b8123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.601+0000 7f79b77fe700 1 --2- 172.21.15.72:0/1060031242 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b80a1510 0x7f79b8122d20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009840 tx=0x7f79ac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.601+0000 7f79b4ff9700 1 -- 172.21.15.72:0/1060031242 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac004550 con 0x7f79b80a1510 2023-10-03T10:15:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.601+0000 7f79b4ff9700 1 -- 172.21.15.72:0/1060031242 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac01f070 con 0x7f79b80a1510 2023-10-03T10:15:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.601+0000 7f79be65d700 1 -- 172.21.15.72:0/1060031242 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ac0094a0 con 0x7f79b80a1510 2023-10-03T10:15:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.601+0000 7f79b4ff9700 1 -- 172.21.15.72:0/1060031242 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0038c0 con 0x7f79b80a1510 2023-10-03T10:15:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.601+0000 7f79be65d700 1 -- 172.21.15.72:0/1060031242 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b8138640 con 0x7f79b80a1510 2023-10-03T10:15:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.602+0000 7f79b4ff9700 1 -- 172.21.15.72:0/1060031242 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79ac003a20 con 0x7f79b80a1510 2023-10-03T10:15:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.602+0000 7f79be65d700 1 -- 172.21.15.72:0/1060031242 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b8074ea0 con 0x7f79b80a1510 2023-10-03T10:15:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.602+0000 7f79b4ff9700 1 -- 172.21.15.72:0/1060031242 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f79ac021070 con 0x7f79b80a1510 2023-10-03T10:15:43.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.607+0000 7f79b4ff9700 1 -- 172.21.15.72:0/1060031242 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79ac015020 con 0x7f79b80a1510 2023-10-03T10:15:43.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.708+0000 7f7f7e8b7700 1 Processor -- start 2023-10-03T10:15:43.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.708+0000 7f7f7e8b7700 1 -- start start 2023-10-03T10:15:43.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.709+0000 7f7f7e8b7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f7809d6f0 0x7f7f7809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.709+0000 7f7f7e8b7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f7809e000 0x7f7f78130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.709+0000 7f7f7e8b7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f7809f130 con 0x7f7f7809e410 2023-10-03T10:15:43.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.709+0000 7f7f7e8b7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7809f520 con 0x7f7f7809d6f0 2023-10-03T10:15:43.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.709+0000 7f7f7e8b7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7809e930 con 0x7f7f7809e000 2023-10-03T10:15:43.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.709+0000 7f7f777fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f7809e000 0x7f7f78130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.709+0000 7f7f77fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f7809d6f0 0x7f7f7809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.709+0000 7f7f7ce54700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7f7809e410 0x7f7f78130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49530/0 (socket says 172.21.15.72:49530) 2023-10-03T10:15:43.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.709+0000 7f7f7ce54700 1 -- 172.21.15.72:0/325186352 learned_addr learned my addr 172.21.15.72:0/325186352 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.709+0000 7f7f76ffd700 1 -- 172.21.15.72:0/325186352 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192413629 0 0) 0x7f7f7809f130 con 0x7f7f7809e410 2023-10-03T10:15:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.709+0000 7f7f777fe700 1 -- 172.21.15.72:0/325186352 >> v2:172.21.15.72:3300/0 conn(0x7f7f7809d6f0 msgr2=0x7f7f7809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.709+0000 7f7f777fe700 1 --2- 172.21.15.72:0/325186352 >> v2:172.21.15.72:3300/0 conn(0x7f7f7809d6f0 0x7f7f7809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.709+0000 7f7f777fe700 1 -- 172.21.15.72:0/325186352 >> v1:172.21.15.72:6789/0 conn(0x7f7f7809e410 legacy=0x7f7f78130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.709+0000 7f7f777fe700 1 -- 172.21.15.72:0/325186352 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7809b2d0 con 0x7f7f7809e000 2023-10-03T10:15:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.709+0000 7f7f777fe700 1 --2- 172.21.15.72:0/325186352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f7809e000 0x7f7f78130660 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00bae0 tx=0x7f7f6c00bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64a9b661f1648dd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.710+0000 7f7f76ffd700 1 -- 172.21.15.72:0/325186352 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c00dc70 con 0x7f7f7809e000 2023-10-03T10:15:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.710+0000 7f7f76ffd700 1 -- 172.21.15.72:0/325186352 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c00ddd0 con 0x7f7f7809e000 2023-10-03T10:15:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.710+0000 7f7f76ffd700 1 -- 172.21.15.72:0/325186352 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c010690 con 0x7f7f7809e000 2023-10-03T10:15:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.710+0000 7f7f7e8b7700 1 -- 172.21.15.72:0/325186352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f7809e000 msgr2=0x7f7f78130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.710+0000 7f7f7e8b7700 1 --2- 172.21.15.72:0/325186352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f7809e000 0x7f7f78130660 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00bae0 tx=0x7f7f6c00bdf0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.710+0000 7f7f7e8b7700 1 -- 172.21.15.72:0/325186352 shutdown_connections 2023-10-03T10:15:43.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.710+0000 7f7f7e8b7700 1 --2- 172.21.15.72:0/325186352 >> v2:172.21.15.72:3300/0 conn(0x7f7f7809d6f0 0x7f7f7809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.710+0000 7f7f7e8b7700 1 --2- 172.21.15.72:0/325186352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f7809e000 0x7f7f78130660 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.710+0000 7f7f7e8b7700 1 -- 172.21.15.72:0/325186352 >> 172.21.15.72:0/325186352 conn(0x7f7f78066f50 msgr2=0x7f7f7809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:43.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.710+0000 7f7f7e8b7700 1 -- 172.21.15.72:0/325186352 shutdown_connections 2023-10-03T10:15:43.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.710+0000 7f7f7e8b7700 1 -- 172.21.15.72:0/325186352 wait complete. 2023-10-03T10:15:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.711+0000 7f7f7e8b7700 1 Processor -- start 2023-10-03T10:15:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.711+0000 7f7f7e8b7700 1 -- start start 2023-10-03T10:15:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f7e8b7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f7809d6f0 0x7f7f7811dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f7e8b7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f7809e000 0x7f7f7811e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f7e8b7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f7809e410 0x7f7f7811e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f7e8b7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7811ff40 con 0x7f7f7809d6f0 2023-10-03T10:15:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f7e8b7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78121000 con 0x7f7f7809e410 2023-10-03T10:15:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f7e8b7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7809c700 con 0x7f7f7809e000 2023-10-03T10:15:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f77fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f7809d6f0 0x7f7f7811dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f77fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f7809d6f0 0x7f7f7811dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58192/0 (socket says 172.21.15.72:58192) 2023-10-03T10:15:43.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f77fff700 1 -- 172.21.15.72:0/4171073930 learned_addr learned my addr 172.21.15.72:0/4171073930 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f777fe700 1 --2- 172.21.15.72:0/4171073930 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f7809e000 0x7f7f7811e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f7ce54700 1 --2- 172.21.15.72:0/4171073930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f7809e410 0x7f7f7811e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f77fff700 1 -- 172.21.15.72:0/4171073930 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f7809e000 msgr2=0x7f7f7811e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f77fff700 1 --2- 172.21.15.72:0/4171073930 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f7809e000 0x7f7f7811e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f77fff700 1 -- 172.21.15.72:0/4171073930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f7809e410 msgr2=0x7f7f7811e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f77fff700 1 --2- 172.21.15.72:0/4171073930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f7809e410 0x7f7f7811e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f77fff700 1 -- 172.21.15.72:0/4171073930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c00b740 con 0x7f7f7809d6f0 2023-10-03T10:15:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f7ce54700 1 --2- 172.21.15.72:0/4171073930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f7809e410 0x7f7f7811e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.712+0000 7f7f77fff700 1 --2- 172.21.15.72:0/4171073930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f7809d6f0 0x7f7f7811dd50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800e9b0 tx=0x7f7f6800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.713+0000 7f7f74ff9700 1 -- 172.21.15.72:0/4171073930 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68009710 con 0x7f7f7809d6f0 2023-10-03T10:15:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.713+0000 7f7f74ff9700 1 -- 172.21.15.72:0/4171073930 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f68013860 con 0x7f7f7809d6f0 2023-10-03T10:15:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.713+0000 7f7f7e8b7700 1 -- 172.21.15.72:0/4171073930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f780a1f90 con 0x7f7f7809d6f0 2023-10-03T10:15:43.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.713+0000 7f7f74ff9700 1 -- 172.21.15.72:0/4171073930 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68013bd0 con 0x7f7f7809d6f0 2023-10-03T10:15:43.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.713+0000 7f7f7e8b7700 1 -- 172.21.15.72:0/4171073930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f78120bb0 con 0x7f7f7809d6f0 2023-10-03T10:15:43.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.714+0000 7f7f74ff9700 1 -- 172.21.15.72:0/4171073930 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f68013d30 con 0x7f7f7809d6f0 2023-10-03T10:15:43.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.714+0000 7f7f7e8b7700 1 -- 172.21.15.72:0/4171073930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7811ac20 con 0x7f7f7809d6f0 2023-10-03T10:15:43.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.714+0000 7f7f74ff9700 1 -- 172.21.15.72:0/4171073930 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7f68043620 con 0x7f7f7809d6f0 2023-10-03T10:15:43.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.718+0000 7f1a61e24700 1 -- 172.21.15.72:0/1074032831 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1a5c06c360 con 0x7f1a5c09e000 2023-10-03T10:15:43.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.718+0000 7f1a43fff700 1 -- 172.21.15.72:0/1074032831 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a5001bba0 con 0x7f1a5c09e000 2023-10-03T10:15:43.718 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:43.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.718+0000 7f7f74ff9700 1 -- 172.21.15.72:0/4171073930 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f6801a790 con 0x7f7f7809d6f0 2023-10-03T10:15:43.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.721+0000 7f1a61e24700 1 -- 172.21.15.72:0/1074032831 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a5c09e000 msgr2=0x7f1a5c132f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.721+0000 7f1a61e24700 1 --2- 172.21.15.72:0/1074032831 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a5c09e000 0x7f1a5c132f30 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000ec10 tx=0x7f1a5000ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:43.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.721+0000 7f1a61e24700 1 -- 172.21.15.72:0/1074032831 shutdown_connections 2023-10-03T10:15:43.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.721+0000 7f1a61e24700 1 --2- 172.21.15.72:0/1074032831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a5c09e410 0x7f1a5c133470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.721+0000 7f1a61e24700 1 --2- 172.21.15.72:0/1074032831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a5c09d6f0 0x7f1a5c136f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.721+0000 7f1a61e24700 1 --2- 172.21.15.72:0/1074032831 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a5c09e000 0x7f1a5c132f30 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.721+0000 7f1a61e24700 1 -- 172.21.15.72:0/1074032831 >> 172.21.15.72:0/1074032831 conn(0x7f1a5c066f50 msgr2=0x7f1a5c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:43.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.721+0000 7f1a61e24700 1 -- 172.21.15.72:0/1074032831 shutdown_connections 2023-10-03T10:15:43.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.721+0000 7f1a61e24700 1 -- 172.21.15.72:0/1074032831 wait complete. 2023-10-03T10:15:43.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:43.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.803+0000 7f79be65d700 1 -- 172.21.15.72:0/1060031242 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f79b80a1d10 con 0x7f79b80a1510 2023-10-03T10:15:43.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.803+0000 7f79b4ff9700 1 -- 172.21.15.72:0/1060031242 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f79ac01a430 con 0x7f79b80a1510 2023-10-03T10:15:43.803 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:43.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.805+0000 7f79be65d700 1 -- 172.21.15.72:0/1060031242 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b80a1510 msgr2=0x7f79b8122d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.805+0000 7f79be65d700 1 --2- 172.21.15.72:0/1060031242 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b80a1510 0x7f79b8122d20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009840 tx=0x7f79ac004750 comp rx=0 tx=0).stop 2023-10-03T10:15:43.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.805+0000 7f79be65d700 1 -- 172.21.15.72:0/1060031242 shutdown_connections 2023-10-03T10:15:43.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.805+0000 7f79be65d700 1 --2- 172.21.15.72:0/1060031242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79b8139250 0x7f79b8123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.805+0000 7f79be65d700 1 --2- 172.21.15.72:0/1060031242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79b80a0a30 0x7f79b81227e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.805+0000 7f79be65d700 1 --2- 172.21.15.72:0/1060031242 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79b80a1510 0x7f79b8122d20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.805+0000 7f79be65d700 1 -- 172.21.15.72:0/1060031242 >> 172.21.15.72:0/1060031242 conn(0x7f79b80a6550 msgr2=0x7f79b80a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:43.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.805+0000 7f79be65d700 1 -- 172.21.15.72:0/1060031242 shutdown_connections 2023-10-03T10:15:43.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.805+0000 7f79be65d700 1 -- 172.21.15.72:0/1060031242 wait complete. 2023-10-03T10:15:43.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:43.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.910+0000 7f7f7e8b7700 1 -- 172.21.15.72:0/4171073930 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7f78074ea0 con 0x7f7f7809d6f0 2023-10-03T10:15:43.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.911+0000 7f7f74ff9700 1 -- 172.21.15.72:0/4171073930 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f68020030 con 0x7f7f7809d6f0 2023-10-03T10:15:43.911 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:43.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.913+0000 7f7f7e8b7700 1 -- 172.21.15.72:0/4171073930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f7809d6f0 msgr2=0x7f7f7811dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.913+0000 7f7f7e8b7700 1 --2- 172.21.15.72:0/4171073930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f7809d6f0 0x7f7f7811dd50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800e9b0 tx=0x7f7f6800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.913+0000 7f7f7e8b7700 1 -- 172.21.15.72:0/4171073930 shutdown_connections 2023-10-03T10:15:43.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.913+0000 7f7f7e8b7700 1 --2- 172.21.15.72:0/4171073930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f7809d6f0 0x7f7f7811dd50 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.913+0000 7f7f7e8b7700 1 --2- 172.21.15.72:0/4171073930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f7809e410 0x7f7f7811e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.913+0000 7f7f7e8b7700 1 --2- 172.21.15.72:0/4171073930 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7f7809e000 0x7f7f7811e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.913+0000 7f7f7e8b7700 1 -- 172.21.15.72:0/4171073930 >> 172.21.15.72:0/4171073930 conn(0x7f7f78066f50 msgr2=0x7f7f78130a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:43.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.913+0000 7f7f7e8b7700 1 -- 172.21.15.72:0/4171073930 shutdown_connections 2023-10-03T10:15:43.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:43.913+0000 7f7f7e8b7700 1 -- 172.21.15.72:0/4171073930 wait complete. 2023-10-03T10:15:43.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:44.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.278+0000 7fb2b6d4b700 1 Processor -- start 2023-10-03T10:15:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b6d4b700 1 -- start start 2023-10-03T10:15:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b6d4b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2b009d6f0 0x7fb2b009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b6d4b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2b009e410 0x7fb2b0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b6d4b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b009f130 con 0x7fb2b009e000 2023-10-03T10:15:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b6d4b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b009f520 con 0x7fb2b009e410 2023-10-03T10:15:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b6d4b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b009e930 con 0x7fb2b009d6f0 2023-10-03T10:15:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b4ae7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2b009d6f0 0x7fb2b009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b52e8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2b009e410 0x7fb2b0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b4ae7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2b009d6f0 0x7fb2b009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50960/0 (socket says 172.21.15.72:50960) 2023-10-03T10:15:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b4ae7700 1 -- 172.21.15.72:0/3331499688 learned_addr learned my addr 172.21.15.72:0/3331499688 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b52e8700 1 --2- 172.21.15.72:0/3331499688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2b009e410 0x7fb2b0130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33924/0 (socket says 172.21.15.72:33924) 2023-10-03T10:15:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b52e8700 1 -- 172.21.15.72:0/3331499688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2b009d6f0 msgr2=0x7fb2b009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2af7fe700 1 -- 172.21.15.72:0/3331499688 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444815287 0 0) 0x7fb2b009f130 con 0x7fb2b009e000 2023-10-03T10:15:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b52e8700 1 --2- 172.21.15.72:0/3331499688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2b009d6f0 0x7fb2b009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b52e8700 1 -- 172.21.15.72:0/3331499688 >> v1:172.21.15.72:6789/0 conn(0x7fb2b009e000 legacy=0x7fb2b0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b52e8700 1 -- 172.21.15.72:0/3331499688 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b009b2d0 con 0x7fb2b009e410 2023-10-03T10:15:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.279+0000 7fb2b4ae7700 1 --2- 172.21.15.72:0/3331499688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2b009d6f0 0x7fb2b009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.280+0000 7fb2b52e8700 1 --2- 172.21.15.72:0/3331499688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2b009e410 0x7fb2b0130d70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8009dc0 tx=0x7fb2a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=683cc03837edeb5a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.280+0000 7fb2af7fe700 1 -- 172.21.15.72:0/3331499688 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800e070 con 0x7fb2b009e410 2023-10-03T10:15:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.280+0000 7fb2af7fe700 1 -- 172.21.15.72:0/3331499688 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a800bb20 con 0x7fb2b009e410 2023-10-03T10:15:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.280+0000 7fb2af7fe700 1 -- 172.21.15.72:0/3331499688 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8012430 con 0x7fb2b009e410 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.280+0000 7fb2b6d4b700 1 -- 172.21.15.72:0/3331499688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2b009e410 msgr2=0x7fb2b0130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.280+0000 7fb2b6d4b700 1 --2- 172.21.15.72:0/3331499688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2b009e410 0x7fb2b0130d70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8009dc0 tx=0x7fb2a800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.280+0000 7fb2b6d4b700 1 -- 172.21.15.72:0/3331499688 shutdown_connections 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.280+0000 7fb2b6d4b700 1 --2- 172.21.15.72:0/3331499688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2b009e410 0x7fb2b0130d70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.280+0000 7fb2b6d4b700 1 --2- 172.21.15.72:0/3331499688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2b009d6f0 0x7fb2b009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.280+0000 7fb2b6d4b700 1 -- 172.21.15.72:0/3331499688 >> 172.21.15.72:0/3331499688 conn(0x7fb2b0066f50 msgr2=0x7fb2b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.280+0000 7fb2b6d4b700 1 -- 172.21.15.72:0/3331499688 shutdown_connections 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.280+0000 7fb2b6d4b700 1 -- 172.21.15.72:0/3331499688 wait complete. 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.281+0000 7fb2b6d4b700 1 Processor -- start 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.282+0000 7fb2b6d4b700 1 -- start start 2023-10-03T10:15:44.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.282+0000 7fb2b6d4b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2b009d6f0 0x7fb2b011ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.282+0000 7fb2b6d4b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2b009e000 0x7fb2b011e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.282+0000 7fb2b6d4b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2b009e410 0x7fb2b011e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.282+0000 7fb2b6d4b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0121600 con 0x7fb2b009e000 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.282+0000 7fb2b6d4b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b011fae0 con 0x7fb2b009e410 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.282+0000 7fb2b6d4b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0072090 con 0x7fb2b009d6f0 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.282+0000 7fb2b4ae7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2b009d6f0 0x7fb2b011ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.282+0000 7fb2b4ae7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2b009d6f0 0x7fb2b011ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50962/0 (socket says 172.21.15.72:50962) 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.282+0000 7fb2b4ae7700 1 -- 172.21.15.72:0/260857821 learned_addr learned my addr 172.21.15.72:0/260857821 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.282+0000 7fb2b52e8700 1 --2- 172.21.15.72:0/260857821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2b009e410 0x7fb2b011e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.282+0000 7fb2affff700 1 --2- 172.21.15.72:0/260857821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2b009e000 0x7fb2b011e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.283+0000 7fb2b4ae7700 1 -- 172.21.15.72:0/260857821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2b009e410 msgr2=0x7fb2b011e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.283+0000 7fb2b4ae7700 1 --2- 172.21.15.72:0/260857821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2b009e410 0x7fb2b011e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.283+0000 7fb2b4ae7700 1 -- 172.21.15.72:0/260857821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2b009e000 msgr2=0x7fb2b011e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.283+0000 7fb2b4ae7700 1 --2- 172.21.15.72:0/260857821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2b009e000 0x7fb2b011e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.283+0000 7fb2b4ae7700 1 -- 172.21.15.72:0/260857821 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a0009550 con 0x7fb2b009d6f0 2023-10-03T10:15:44.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.283+0000 7fb2b4ae7700 1 --2- 172.21.15.72:0/260857821 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2b009d6f0 0x7fb2b011ddc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000ebe0 tx=0x7fb2a000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.283+0000 7fb2ad7fa700 1 -- 172.21.15.72:0/260857821 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a000c850 con 0x7fb2b009d6f0 2023-10-03T10:15:44.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.283+0000 7fb2ad7fa700 1 -- 172.21.15.72:0/260857821 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a000c9b0 con 0x7fb2b009d6f0 2023-10-03T10:15:44.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.283+0000 7fb2b6d4b700 1 -- 172.21.15.72:0/260857821 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a8009a70 con 0x7fb2b009d6f0 2023-10-03T10:15:44.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.283+0000 7fb2ad7fa700 1 -- 172.21.15.72:0/260857821 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a000cd40 con 0x7fb2b009d6f0 2023-10-03T10:15:44.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.283+0000 7fb2b6d4b700 1 -- 172.21.15.72:0/260857821 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b0120c20 con 0x7fb2b009d6f0 2023-10-03T10:15:44.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.284+0000 7fb2ad7fa700 1 -- 172.21.15.72:0/260857821 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2a0013470 con 0x7fb2b009d6f0 2023-10-03T10:15:44.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.284+0000 7fb2ad7fa700 1 -- 172.21.15.72:0/260857821 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb2a003fc00 con 0x7fb2b009d6f0 2023-10-03T10:15:44.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.284+0000 7fb2b6d4b700 1 -- 172.21.15.72:0/260857821 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b011ac20 con 0x7fb2b009d6f0 2023-10-03T10:15:44.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.289+0000 7fb2ad7fa700 1 -- 172.21.15.72:0/260857821 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2a001b3b0 con 0x7fb2b009d6f0 2023-10-03T10:15:44.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.472+0000 7fb2b6d4b700 1 -- 172.21.15.72:0/260857821 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb2b0074ea0 con 0x7fb2b009d6f0 2023-10-03T10:15:44.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.472+0000 7fb2ad7fa700 1 -- 172.21.15.72:0/260857821 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb2a0024350 con 0x7fb2b009d6f0 2023-10-03T10:15:44.472 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:44.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.474+0000 7fb2b6d4b700 1 -- 172.21.15.72:0/260857821 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2b009d6f0 msgr2=0x7fb2b011ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.474+0000 7fb2b6d4b700 1 --2- 172.21.15.72:0/260857821 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2b009d6f0 0x7fb2b011ddc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000ebe0 tx=0x7fb2a000eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.474+0000 7fb2b6d4b700 1 -- 172.21.15.72:0/260857821 shutdown_connections 2023-10-03T10:15:44.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.474+0000 7fb2b6d4b700 1 --2- 172.21.15.72:0/260857821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2b009e410 0x7fb2b011e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.474+0000 7fb2b6d4b700 1 --2- 172.21.15.72:0/260857821 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2b009d6f0 0x7fb2b011ddc0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.474+0000 7fb2b6d4b700 1 --2- 172.21.15.72:0/260857821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2b009e000 0x7fb2b011e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.474+0000 7fb2b6d4b700 1 -- 172.21.15.72:0/260857821 >> 172.21.15.72:0/260857821 conn(0x7fb2b0066f50 msgr2=0x7fb2b0130a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.474+0000 7fb2b6d4b700 1 -- 172.21.15.72:0/260857821 shutdown_connections 2023-10-03T10:15:44.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.474+0000 7fb2b6d4b700 1 -- 172.21.15.72:0/260857821 wait complete. 2023-10-03T10:15:44.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:44.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:44.817 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:44.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.859+0000 7f1fed51d700 1 Processor -- start 2023-10-03T10:15:44.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.859+0000 7f1fed51d700 1 -- start start 2023-10-03T10:15:44.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.859+0000 7f1fed51d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1fe809d6f0 0x7f1fe809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.859+0000 7f1fed51d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe809e000 0x7f1fe8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.859+0000 7f1fed51d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe809f130 con 0x7f1fe809e410 2023-10-03T10:15:44.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.859+0000 7f1fed51d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe809f520 con 0x7f1fe809d6f0 2023-10-03T10:15:44.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.859+0000 7f1fed51d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe809e930 con 0x7f1fe809e000 2023-10-03T10:15:44.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.860+0000 7f1fe6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1fe809d6f0 0x7f1fe809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.860+0000 7f1fe67fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe809e000 0x7f1fe8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.860+0000 7f1fe6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1fe809d6f0 0x7f1fe809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58196/0 (socket says 172.21.15.72:58196) 2023-10-03T10:15:44.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.860+0000 7f1fe6ffd700 1 -- 172.21.15.72:0/1788737242 learned_addr learned my addr 172.21.15.72:0/1788737242 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:44.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.860+0000 7f1fe67fc700 1 -- 172.21.15.72:0/1788737242 >> v2:172.21.15.72:3300/0 conn(0x7f1fe809d6f0 msgr2=0x7f1fe809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.860+0000 7f1fe67fc700 1 --2- 172.21.15.72:0/1788737242 >> v2:172.21.15.72:3300/0 conn(0x7f1fe809d6f0 0x7f1fe809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.860+0000 7f1fe67fc700 1 -- 172.21.15.72:0/1788737242 >> v1:172.21.15.72:6789/0 conn(0x7f1fe809e410 legacy=0x7f1fe8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.860+0000 7f1fe67fc700 1 -- 172.21.15.72:0/1788737242 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe809b2d0 con 0x7f1fe809e000 2023-10-03T10:15:44.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.860+0000 7f1fe67fc700 1 --2- 172.21.15.72:0/1788737242 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe809e000 0x7f1fe8130660 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009840 tx=0x7f1fdc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=297174b109860fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.860+0000 7f1fe5ffb700 1 -- 172.21.15.72:0/1788737242 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc011830 con 0x7f1fe809e000 2023-10-03T10:15:44.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.860+0000 7f1fe5ffb700 1 -- 172.21.15.72:0/1788737242 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc011990 con 0x7f1fe809e000 2023-10-03T10:15:44.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.860+0000 7f1fe5ffb700 1 -- 172.21.15.72:0/1788737242 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc011d20 con 0x7f1fe809e000 2023-10-03T10:15:44.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.861+0000 7f1fed51d700 1 -- 172.21.15.72:0/1788737242 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe809e000 msgr2=0x7f1fe8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.861+0000 7f1fed51d700 1 --2- 172.21.15.72:0/1788737242 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe809e000 0x7f1fe8130660 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009840 tx=0x7f1fdc009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:44.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.861+0000 7f1fed51d700 1 -- 172.21.15.72:0/1788737242 shutdown_connections 2023-10-03T10:15:44.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.861+0000 7f1fed51d700 1 --2- 172.21.15.72:0/1788737242 >> v2:172.21.15.72:3300/0 conn(0x7f1fe809d6f0 0x7f1fe809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.861+0000 7f1fed51d700 1 --2- 172.21.15.72:0/1788737242 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe809e000 0x7f1fe8130660 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.861+0000 7f1fed51d700 1 -- 172.21.15.72:0/1788737242 >> 172.21.15.72:0/1788737242 conn(0x7f1fe8066f50 msgr2=0x7f1fe809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.861+0000 7f1fed51d700 1 -- 172.21.15.72:0/1788737242 shutdown_connections 2023-10-03T10:15:44.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.861+0000 7f1fed51d700 1 -- 172.21.15.72:0/1788737242 wait complete. 2023-10-03T10:15:44.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.862+0000 7f1fed51d700 1 Processor -- start 2023-10-03T10:15:44.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.862+0000 7f1fed51d700 1 -- start start 2023-10-03T10:15:44.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.862+0000 7f1fed51d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe809d6f0 0x7f1fe8120180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.862+0000 7f1fed51d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe809e000 0x7f1fe81206c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.862+0000 7f1fed51d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe809e410 0x7f1fe8120c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.862+0000 7f1fed51d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe809c700 con 0x7f1fe809e410 2023-10-03T10:15:44.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.862+0000 7f1fed51d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe80a1ca0 con 0x7f1fe809e000 2023-10-03T10:15:44.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.862+0000 7f1fed51d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe81233a0 con 0x7f1fe809d6f0 2023-10-03T10:15:44.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fe6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe809d6f0 0x7f1fe8120180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fe77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe809e410 0x7f1fe8120c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fe6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe809d6f0 0x7f1fe8120180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50978/0 (socket says 172.21.15.72:50978) 2023-10-03T10:15:44.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fe6ffd700 1 -- 172.21.15.72:0/3714256138 learned_addr learned my addr 172.21.15.72:0/3714256138 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:44.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fe67fc700 1 --2- 172.21.15.72:0/3714256138 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe809e000 0x7f1fe81206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fe77fe700 1 -- 172.21.15.72:0/3714256138 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe809d6f0 msgr2=0x7f1fe8120180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fe77fe700 1 --2- 172.21.15.72:0/3714256138 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe809d6f0 0x7f1fe8120180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fe77fe700 1 -- 172.21.15.72:0/3714256138 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe809e000 msgr2=0x7f1fe81206c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fe77fe700 1 --2- 172.21.15.72:0/3714256138 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe809e000 0x7f1fe81206c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fe77fe700 1 -- 172.21.15.72:0/3714256138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0094a0 con 0x7f1fe809e410 2023-10-03T10:15:44.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fe77fe700 1 --2- 172.21.15.72:0/3714256138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe809e410 0x7f1fe8120c00 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000cb90 tx=0x7f1fe000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fcf7fe700 1 -- 172.21.15.72:0/3714256138 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0003c00 con 0x7f1fe809e410 2023-10-03T10:15:44.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fcf7fe700 1 -- 172.21.15.72:0/3714256138 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe0003d60 con 0x7f1fe809e410 2023-10-03T10:15:44.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fed51d700 1 -- 172.21.15.72:0/3714256138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe8123930 con 0x7f1fe809e410 2023-10-03T10:15:44.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fcf7fe700 1 -- 172.21.15.72:0/3714256138 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe000aa80 con 0x7f1fe809e410 2023-10-03T10:15:44.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.863+0000 7f1fed51d700 1 -- 172.21.15.72:0/3714256138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe81243a0 con 0x7f1fe809e410 2023-10-03T10:15:44.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.864+0000 7f1fcf7fe700 1 -- 172.21.15.72:0/3714256138 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fe000abe0 con 0x7f1fe809e410 2023-10-03T10:15:44.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.864+0000 7f1fcf7fe700 1 -- 172.21.15.72:0/3714256138 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1fe003f530 con 0x7f1fe809e410 2023-10-03T10:15:44.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.864+0000 7f1fed51d700 1 -- 172.21.15.72:0/3714256138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe8074ea0 con 0x7f1fe809e410 2023-10-03T10:15:44.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.869+0000 7f1fcf7fe700 1 -- 172.21.15.72:0/3714256138 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fe00198f0 con 0x7f1fe809e410 2023-10-03T10:15:44.926 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:44.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.945+0000 7f8f21783700 1 Processor -- start 2023-10-03T10:15:44.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.945+0000 7f8f21783700 1 -- start start 2023-10-03T10:15:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.945+0000 7f8f21783700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f1c130540 0x7f8f1c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.945+0000 7f8f21783700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c06fcf0 0x7f8f1c138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.945+0000 7f8f21783700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1c0716a0 con 0x7f8f1c130e50 2023-10-03T10:15:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.945+0000 7f8f21783700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1c09a390 con 0x7f8f1c130540 2023-10-03T10:15:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.945+0000 7f8f21783700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c071290 con 0x7f8f1c06fcf0 2023-10-03T10:15:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.945+0000 7f8f1affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f1c130540 0x7f8f1c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.945+0000 7f8f1b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c06fcf0 0x7f8f1c138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.945+0000 7f8f1a7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8f1c130e50 0x7f8f1c06f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49544/0 (socket says 172.21.15.72:49544) 2023-10-03T10:15:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.946+0000 7f8f1a7fc700 1 -- 172.21.15.72:0/3355794831 learned_addr learned my addr 172.21.15.72:0/3355794831 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.946+0000 7f8f19ffb700 1 -- 172.21.15.72:0/3355794831 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993626393 0 0) 0x7f8f1c0716a0 con 0x7f8f1c130e50 2023-10-03T10:15:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.946+0000 7f8f1affd700 1 -- 172.21.15.72:0/3355794831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c06fcf0 msgr2=0x7f8f1c138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.946+0000 7f8f1affd700 1 --2- 172.21.15.72:0/3355794831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c06fcf0 0x7f8f1c138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.946+0000 7f8f1affd700 1 -- 172.21.15.72:0/3355794831 >> v1:172.21.15.72:6789/0 conn(0x7f8f1c130e50 legacy=0x7f8f1c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.946+0000 7f8f1affd700 1 -- 172.21.15.72:0/3355794831 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c130340 con 0x7f8f1c130540 2023-10-03T10:15:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.946+0000 7f8f1b7fe700 1 --2- 172.21.15.72:0/3355794831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c06fcf0 0x7f8f1c138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.946+0000 7f8f1affd700 1 --2- 172.21.15.72:0/3355794831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f1c130540 0x7f8f1c130910 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009840 tx=0x7f8f0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbaaf2b5f9bae49 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.946+0000 7f8f19ffb700 1 -- 172.21.15.72:0/3355794831 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c011830 con 0x7f8f1c130540 2023-10-03T10:15:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.946+0000 7f8f19ffb700 1 -- 172.21.15.72:0/3355794831 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c011990 con 0x7f8f1c130540 2023-10-03T10:15:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.946+0000 7f8f19ffb700 1 -- 172.21.15.72:0/3355794831 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c011d20 con 0x7f8f1c130540 2023-10-03T10:15:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.947+0000 7f8f21783700 1 -- 172.21.15.72:0/3355794831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f1c130540 msgr2=0x7f8f1c130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.947+0000 7f8f21783700 1 --2- 172.21.15.72:0/3355794831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f1c130540 0x7f8f1c130910 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009840 tx=0x7f8f0c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.947+0000 7f8f21783700 1 -- 172.21.15.72:0/3355794831 shutdown_connections 2023-10-03T10:15:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.947+0000 7f8f21783700 1 --2- 172.21.15.72:0/3355794831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c06fcf0 0x7f8f1c138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.947+0000 7f8f21783700 1 --2- 172.21.15.72:0/3355794831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f1c130540 0x7f8f1c130910 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.947+0000 7f8f21783700 1 -- 172.21.15.72:0/3355794831 >> 172.21.15.72:0/3355794831 conn(0x7f8f1c0a2aa0 msgr2=0x7f8f1c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.947+0000 7f8f21783700 1 -- 172.21.15.72:0/3355794831 shutdown_connections 2023-10-03T10:15:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.947+0000 7f8f21783700 1 -- 172.21.15.72:0/3355794831 wait complete. 2023-10-03T10:15:44.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.948+0000 7f8f21783700 1 Processor -- start 2023-10-03T10:15:44.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.948+0000 7f8f21783700 1 -- start start 2023-10-03T10:15:44.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f21783700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f1c06fcf0 0x7f8f1c1c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f21783700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c130540 0x7f8f1c1c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f21783700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f1c130e50 0x7f8f1c1c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f21783700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c12dc20 con 0x7f8f1c130e50 2023-10-03T10:15:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f21783700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c12c570 con 0x7f8f1c130540 2023-10-03T10:15:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f21783700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0a0580 con 0x7f8f1c06fcf0 2023-10-03T10:15:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f1a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c130540 0x7f8f1c1c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f1affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f1c06fcf0 0x7f8f1c1c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f1a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c130540 0x7f8f1c1c61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33980/0 (socket says 172.21.15.72:33980) 2023-10-03T10:15:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f1a7fc700 1 -- 172.21.15.72:0/3072873466 learned_addr learned my addr 172.21.15.72:0/3072873466 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f1b7fe700 1 --2- 172.21.15.72:0/3072873466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f1c130e50 0x7f8f1c1c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f1affd700 1 -- 172.21.15.72:0/3072873466 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c130540 msgr2=0x7f8f1c1c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f1affd700 1 --2- 172.21.15.72:0/3072873466 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c130540 0x7f8f1c1c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f1affd700 1 -- 172.21.15.72:0/3072873466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f1c130e50 msgr2=0x7f8f1c1c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f1affd700 1 --2- 172.21.15.72:0/3072873466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f1c130e50 0x7f8f1c1c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.949+0000 7f8f1affd700 1 -- 172.21.15.72:0/3072873466 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f14009a70 con 0x7f8f1c06fcf0 2023-10-03T10:15:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.950+0000 7f8f1affd700 1 --2- 172.21.15.72:0/3072873466 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f1c06fcf0 0x7f8f1c1c5cb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009840 tx=0x7f8f0c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.950+0000 7f8f037fe700 1 -- 172.21.15.72:0/3072873466 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c01a9b0 con 0x7f8f1c06fcf0 2023-10-03T10:15:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.950+0000 7f8f037fe700 1 -- 172.21.15.72:0/3072873466 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c01ab10 con 0x7f8f1c06fcf0 2023-10-03T10:15:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.950+0000 7f8f21783700 1 -- 172.21.15.72:0/3072873466 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c0094a0 con 0x7f8f1c06fcf0 2023-10-03T10:15:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.950+0000 7f8f037fe700 1 -- 172.21.15.72:0/3072873466 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c0243f0 con 0x7f8f1c06fcf0 2023-10-03T10:15:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.950+0000 7f8f21783700 1 -- 172.21.15.72:0/3072873466 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1c12bff0 con 0x7f8f1c06fcf0 2023-10-03T10:15:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.950+0000 7f8f037fe700 1 -- 172.21.15.72:0/3072873466 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f0c02d450 con 0x7f8f1c06fcf0 2023-10-03T10:15:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.951+0000 7f8f037fe700 1 -- 172.21.15.72:0/3072873466 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8f0c040920 con 0x7f8f1c06fcf0 2023-10-03T10:15:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.951+0000 7f8f21783700 1 -- 172.21.15.72:0/3072873466 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1c12da60 con 0x7f8f1c06fcf0 2023-10-03T10:15:44.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:44.956+0000 7f8f037fe700 1 -- 172.21.15.72:0/3072873466 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f0c015080 con 0x7f8f1c06fcf0 2023-10-03T10:15:45.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.052+0000 7fbfb8305700 1 Processor -- start 2023-10-03T10:15:45.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.052+0000 7fbfb8305700 1 -- start start 2023-10-03T10:15:45.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.053+0000 7fbfb8305700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb01338a0 0x7fbfb0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.053+0000 7fbfb8305700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb009de50 0x7fbfb009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.053+0000 7fbfb8305700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb006ef30 con 0x7fbfb009e760 2023-10-03T10:15:45.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.053+0000 7fbfb8305700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb006fef0 con 0x7fbfb01338a0 2023-10-03T10:15:45.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.053+0000 7fbfb8305700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb01334b0 con 0x7fbfb009de50 2023-10-03T10:15:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.053+0000 7fbfb68a2700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbfb009e760 0x7fbfb013a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49548/0 (socket says 172.21.15.72:49548) 2023-10-03T10:15:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.053+0000 7fbfb68a2700 1 -- 172.21.15.72:0/2542602279 learned_addr learned my addr 172.21.15.72:0/2542602279 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.053+0000 7fbfb60a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb01338a0 0x7fbfb0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.053+0000 7fbfb58a0700 1 --2- 172.21.15.72:0/2542602279 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb009de50 0x7fbfb009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.053+0000 7fbfb58a0700 1 -- 172.21.15.72:0/2542602279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb01338a0 msgr2=0x7fbfb0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.053+0000 7fbfb58a0700 1 --2- 172.21.15.72:0/2542602279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb01338a0 0x7fbfb0133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.053+0000 7fbfb58a0700 1 -- 172.21.15.72:0/2542602279 >> v1:172.21.15.72:6789/0 conn(0x7fbfb009e760 legacy=0x7fbfb013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.053+0000 7fbfb58a0700 1 -- 172.21.15.72:0/2542602279 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb006fc30 con 0x7fbfb009de50 2023-10-03T10:15:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.053+0000 7fbfb60a1700 1 --2- 172.21.15.72:0/2542602279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb01338a0 0x7fbfb0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.053+0000 7fbfb58a0700 1 --2- 172.21.15.72:0/2542602279 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb009de50 0x7fbfb009e220 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00098a0 tx=0x7fbfa0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a69226eaf03804d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.054+0000 7fbfb509f700 1 -- 172.21.15.72:0/2542602279 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0011830 con 0x7fbfb009de50 2023-10-03T10:15:45.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.054+0000 7fbfb509f700 1 -- 172.21.15.72:0/2542602279 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa0011990 con 0x7fbfb009de50 2023-10-03T10:15:45.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.054+0000 7fbfb509f700 1 -- 172.21.15.72:0/2542602279 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0011d20 con 0x7fbfb009de50 2023-10-03T10:15:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.054+0000 7fbfb8305700 1 -- 172.21.15.72:0/2542602279 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb009de50 msgr2=0x7fbfb009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.054+0000 7fbfb8305700 1 --2- 172.21.15.72:0/2542602279 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb009de50 0x7fbfb009e220 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00098a0 tx=0x7fbfa0009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.054+0000 7fbfb8305700 1 -- 172.21.15.72:0/2542602279 shutdown_connections 2023-10-03T10:15:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.054+0000 7fbfb8305700 1 --2- 172.21.15.72:0/2542602279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb01338a0 0x7fbfb0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.054+0000 7fbfb8305700 1 --2- 172.21.15.72:0/2542602279 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb009de50 0x7fbfb009e220 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.054+0000 7fbfb8305700 1 -- 172.21.15.72:0/2542602279 >> 172.21.15.72:0/2542602279 conn(0x7fbfb00a2aa0 msgr2=0x7fbfb00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.054+0000 7fbfb8305700 1 -- 172.21.15.72:0/2542602279 shutdown_connections 2023-10-03T10:15:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.054+0000 7fbfb8305700 1 -- 172.21.15.72:0/2542602279 wait complete. 2023-10-03T10:15:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.055+0000 7fbfb8305700 1 Processor -- start 2023-10-03T10:15:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.055+0000 7fbfb8305700 1 -- start start 2023-10-03T10:15:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb8305700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb009de50 0x7fbfb011eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb8305700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb009e760 0x7fbfb011f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb8305700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb01338a0 0x7fbfb011f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb8305700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb011ff20 con 0x7fbfb009e760 2023-10-03T10:15:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb8305700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0121d80 con 0x7fbfb009de50 2023-10-03T10:15:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb8305700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0122070 con 0x7fbfb01338a0 2023-10-03T10:15:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb68a2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb01338a0 0x7fbfb011f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb68a2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb01338a0 0x7fbfb011f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51000/0 (socket says 172.21.15.72:51000) 2023-10-03T10:15:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb68a2700 1 -- 172.21.15.72:0/1463655165 learned_addr learned my addr 172.21.15.72:0/1463655165 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb60a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb009de50 0x7fbfb011eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb58a0700 1 --2- 172.21.15.72:0/1463655165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb009e760 0x7fbfb011f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb68a2700 1 -- 172.21.15.72:0/1463655165 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb009de50 msgr2=0x7fbfb011eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb68a2700 1 --2- 172.21.15.72:0/1463655165 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb009de50 0x7fbfb011eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb68a2700 1 -- 172.21.15.72:0/1463655165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb009e760 msgr2=0x7fbfb011f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb68a2700 1 --2- 172.21.15.72:0/1463655165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb009e760 0x7fbfb011f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb68a2700 1 -- 172.21.15.72:0/1463655165 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac0094a0 con 0x7fbfb01338a0 2023-10-03T10:15:45.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb60a1700 1 --2- 172.21.15.72:0/1463655165 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb009de50 0x7fbfb011eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.056+0000 7fbfb68a2700 1 --2- 172.21.15.72:0/1463655165 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb01338a0 0x7fbfb011f5b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800cbc0 tx=0x7fbfa800ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.057+0000 7fbfa6ffd700 1 -- 172.21.15.72:0/1463655165 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa800a9e0 con 0x7fbfb01338a0 2023-10-03T10:15:45.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.057+0000 7fbfa6ffd700 1 -- 172.21.15.72:0/1463655165 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa800ab40 con 0x7fbfb01338a0 2023-10-03T10:15:45.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.057+0000 7fbfb8305700 1 -- 172.21.15.72:0/1463655165 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa00094a0 con 0x7fbfb01338a0 2023-10-03T10:15:45.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.057+0000 7fbfa6ffd700 1 -- 172.21.15.72:0/1463655165 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8012400 con 0x7fbfb01338a0 2023-10-03T10:15:45.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.057+0000 7fbfb8305700 1 -- 172.21.15.72:0/1463655165 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb012fab0 con 0x7fbfb01338a0 2023-10-03T10:15:45.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.058+0000 7fbfa6ffd700 1 -- 172.21.15.72:0/1463655165 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbfa801b3b0 con 0x7fbfb01338a0 2023-10-03T10:15:45.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.058+0000 7fbfb8305700 1 -- 172.21.15.72:0/1463655165 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb0074ea0 con 0x7fbfb01338a0 2023-10-03T10:15:45.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.058+0000 7fbfa6ffd700 1 -- 172.21.15.72:0/1463655165 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbfa803f270 con 0x7fbfb01338a0 2023-10-03T10:15:45.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.062+0000 7fbfa6ffd700 1 -- 172.21.15.72:0/1463655165 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfa80192c0 con 0x7fbfb01338a0 2023-10-03T10:15:45.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.068+0000 7f1fed51d700 1 -- 172.21.15.72:0/3714256138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1fe806c360 con 0x7f1fe809e410 2023-10-03T10:15:45.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.068+0000 7f1fcf7fe700 1 -- 172.21.15.72:0/3714256138 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1fe0029090 con 0x7f1fe809e410 2023-10-03T10:15:45.068 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:45.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.070+0000 7f1fed51d700 1 -- 172.21.15.72:0/3714256138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe809e410 msgr2=0x7f1fe8120c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.070+0000 7f1fed51d700 1 --2- 172.21.15.72:0/3714256138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe809e410 0x7f1fe8120c00 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000cb90 tx=0x7f1fe000cea0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.070+0000 7f1fed51d700 1 -- 172.21.15.72:0/3714256138 shutdown_connections 2023-10-03T10:15:45.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.070+0000 7f1fed51d700 1 --2- 172.21.15.72:0/3714256138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fe809e410 0x7f1fe8120c00 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.070+0000 7f1fed51d700 1 --2- 172.21.15.72:0/3714256138 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1fe809d6f0 0x7f1fe8120180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.070+0000 7f1fed51d700 1 --2- 172.21.15.72:0/3714256138 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fe809e000 0x7f1fe81206c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.070+0000 7f1fed51d700 1 -- 172.21.15.72:0/3714256138 >> 172.21.15.72:0/3714256138 conn(0x7f1fe8066f50 msgr2=0x7f1fe8071180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.070+0000 7f1fed51d700 1 -- 172.21.15.72:0/3714256138 shutdown_connections 2023-10-03T10:15:45.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.070+0000 7f1fed51d700 1 -- 172.21.15.72:0/3714256138 wait complete. 2023-10-03T10:15:45.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:45.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.163+0000 7f8f21783700 1 -- 172.21.15.72:0/3072873466 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8f1c074ea0 con 0x7f8f1c06fcf0 2023-10-03T10:15:45.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.164+0000 7f8f037fe700 1 -- 172.21.15.72:0/3072873466 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8f0c02de60 con 0x7f8f1c06fcf0 2023-10-03T10:15:45.163 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:45.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.166+0000 7f8f21783700 1 -- 172.21.15.72:0/3072873466 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f1c06fcf0 msgr2=0x7f8f1c1c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.166+0000 7f8f21783700 1 --2- 172.21.15.72:0/3072873466 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f1c06fcf0 0x7f8f1c1c5cb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009840 tx=0x7f8f0c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:45.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.166+0000 7f8f21783700 1 -- 172.21.15.72:0/3072873466 shutdown_connections 2023-10-03T10:15:45.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.166+0000 7f8f21783700 1 --2- 172.21.15.72:0/3072873466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f1c130e50 0x7f8f1c1c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.166+0000 7f8f21783700 1 --2- 172.21.15.72:0/3072873466 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f1c06fcf0 0x7f8f1c1c5cb0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.166+0000 7f8f21783700 1 --2- 172.21.15.72:0/3072873466 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f1c130540 0x7f8f1c1c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.166+0000 7f8f21783700 1 -- 172.21.15.72:0/3072873466 >> 172.21.15.72:0/3072873466 conn(0x7f8f1c0a2aa0 msgr2=0x7f8f1c12edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.166+0000 7f8f21783700 1 -- 172.21.15.72:0/3072873466 shutdown_connections 2023-10-03T10:15:45.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.166+0000 7f8f21783700 1 -- 172.21.15.72:0/3072873466 wait complete. 2023-10-03T10:15:45.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:45.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.262+0000 7fbfb8305700 1 -- 172.21.15.72:0/1463655165 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbfb006b9e0 con 0x7fbfb01338a0 2023-10-03T10:15:45.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.263+0000 7fbfa6ffd700 1 -- 172.21.15.72:0/1463655165 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbfa8017030 con 0x7fbfb01338a0 2023-10-03T10:15:45.263 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:45.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.265+0000 7fbfb8305700 1 -- 172.21.15.72:0/1463655165 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb01338a0 msgr2=0x7fbfb011f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.265+0000 7fbfb8305700 1 --2- 172.21.15.72:0/1463655165 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb01338a0 0x7fbfb011f5b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800cbc0 tx=0x7fbfa800ced0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.265+0000 7fbfb8305700 1 -- 172.21.15.72:0/1463655165 shutdown_connections 2023-10-03T10:15:45.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.265+0000 7fbfb8305700 1 --2- 172.21.15.72:0/1463655165 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb01338a0 0x7fbfb011f5b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.265+0000 7fbfb8305700 1 --2- 172.21.15.72:0/1463655165 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb009de50 0x7fbfb011eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.265+0000 7fbfb8305700 1 --2- 172.21.15.72:0/1463655165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb009e760 0x7fbfb011f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.265+0000 7fbfb8305700 1 -- 172.21.15.72:0/1463655165 >> 172.21.15.72:0/1463655165 conn(0x7fbfb00a2aa0 msgr2=0x7fbfb009ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.265+0000 7fbfb8305700 1 -- 172.21.15.72:0/1463655165 shutdown_connections 2023-10-03T10:15:45.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.265+0000 7fbfb8305700 1 -- 172.21.15.72:0/1463655165 wait complete. 2023-10-03T10:15:45.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:45.487 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:45.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.614+0000 7f432bf26700 1 Processor -- start 2023-10-03T10:15:45.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.614+0000 7f432bf26700 1 -- start start 2023-10-03T10:15:45.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.614+0000 7f432bf26700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4324134630 0x7f4324136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.614+0000 7f432bf26700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4324136f50 0x7f4324139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.614+0000 7f432bf26700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432409b4f0 con 0x7f4324131810 2023-10-03T10:15:45.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.614+0000 7f432bf26700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43241313c0 con 0x7f4324134630 2023-10-03T10:15:45.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.614+0000 7f432bf26700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f432406e8c0 con 0x7f4324136f50 2023-10-03T10:15:45.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.614+0000 7f432a4c3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4324136f50 0x7f4324139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.614+0000 7f43294c1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4324134630 0x7f4324136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.615+0000 7f43294c1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4324134630 0x7f4324136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58242/0 (socket says 172.21.15.72:58242) 2023-10-03T10:15:45.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.615+0000 7f432a4c3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4324136f50 0x7f4324139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51016/0 (socket says 172.21.15.72:51016) 2023-10-03T10:15:45.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.615+0000 7f43294c1700 1 -- 172.21.15.72:0/1412600698 learned_addr learned my addr 172.21.15.72:0/1412600698 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:45.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.615+0000 7f432a4c3700 1 -- 172.21.15.72:0/1412600698 >> v2:172.21.15.72:3300/0 conn(0x7f4324134630 msgr2=0x7f4324136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.615+0000 7f432a4c3700 1 --2- 172.21.15.72:0/1412600698 >> v2:172.21.15.72:3300/0 conn(0x7f4324134630 0x7f4324136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.615+0000 7f432a4c3700 1 -- 172.21.15.72:0/1412600698 >> v1:172.21.15.72:6789/0 conn(0x7f4324131810 legacy=0x7f4324131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.615+0000 7f432a4c3700 1 -- 172.21.15.72:0/1412600698 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4324071d20 con 0x7f4324136f50 2023-10-03T10:15:45.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.615+0000 7f432a4c3700 1 --2- 172.21.15.72:0/1412600698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4324136f50 0x7f4324139330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f431c009d90 tx=0x7f431c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7623aa7266b2228 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.615+0000 7f4328cc0700 1 -- 172.21.15.72:0/1412600698 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c00e070 con 0x7f4324136f50 2023-10-03T10:15:45.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.615+0000 7f4328cc0700 1 -- 172.21.15.72:0/1412600698 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c00bb20 con 0x7f4324136f50 2023-10-03T10:15:45.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.615+0000 7f4328cc0700 1 -- 172.21.15.72:0/1412600698 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c012430 con 0x7f4324136f50 2023-10-03T10:15:45.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.616+0000 7f432bf26700 1 -- 172.21.15.72:0/1412600698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4324136f50 msgr2=0x7f4324139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.616+0000 7f432bf26700 1 --2- 172.21.15.72:0/1412600698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4324136f50 0x7f4324139330 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f431c009d90 tx=0x7f431c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:45.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.616+0000 7f432bf26700 1 -- 172.21.15.72:0/1412600698 shutdown_connections 2023-10-03T10:15:45.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.616+0000 7f432bf26700 1 --2- 172.21.15.72:0/1412600698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4324136f50 0x7f4324139330 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.616+0000 7f432bf26700 1 --2- 172.21.15.72:0/1412600698 >> v2:172.21.15.72:3300/0 conn(0x7f4324134630 0x7f4324136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.616+0000 7f432bf26700 1 -- 172.21.15.72:0/1412600698 >> 172.21.15.72:0/1412600698 conn(0x7f43240a2aa0 msgr2=0x7f43240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.616+0000 7f432bf26700 1 -- 172.21.15.72:0/1412600698 shutdown_connections 2023-10-03T10:15:45.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.616+0000 7f432bf26700 1 -- 172.21.15.72:0/1412600698 wait complete. 2023-10-03T10:15:45.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f432bf26700 1 Processor -- start 2023-10-03T10:15:45.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f432bf26700 1 -- start start 2023-10-03T10:15:45.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f432bf26700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4324131810 0x7f432406ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f432bf26700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4324134630 0x7f43240704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f432bf26700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4324136f50 0x7f43241c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f432bf26700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432406fac0 con 0x7f4324134630 2023-10-03T10:15:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f432bf26700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432412ec00 con 0x7f4324136f50 2023-10-03T10:15:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f432bf26700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f432412e9c0 con 0x7f4324131810 2023-10-03T10:15:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f4329cc2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4324131810 0x7f432406ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f4329cc2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4324131810 0x7f432406ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51022/0 (socket says 172.21.15.72:51022) 2023-10-03T10:15:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f4329cc2700 1 -- 172.21.15.72:0/4223551273 learned_addr learned my addr 172.21.15.72:0/4223551273 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f43294c1700 1 --2- 172.21.15.72:0/4223551273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4324134630 0x7f43240704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f432a4c3700 1 --2- 172.21.15.72:0/4223551273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4324136f50 0x7f43241c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f4329cc2700 1 -- 172.21.15.72:0/4223551273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4324136f50 msgr2=0x7f43241c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f4329cc2700 1 --2- 172.21.15.72:0/4223551273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4324136f50 0x7f43241c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f4329cc2700 1 -- 172.21.15.72:0/4223551273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4324134630 msgr2=0x7f43240704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.617+0000 7f4329cc2700 1 --2- 172.21.15.72:0/4223551273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4324134630 0x7f43240704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.618+0000 7f4329cc2700 1 -- 172.21.15.72:0/4223551273 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c009a70 con 0x7f4324131810 2023-10-03T10:15:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.618+0000 7f43294c1700 1 --2- 172.21.15.72:0/4223551273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4324134630 0x7f43240704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.618+0000 7f4329cc2700 1 --2- 172.21.15.72:0/4223551273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4324131810 0x7f432406ff70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f432000c480 tx=0x7f432000c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.618+0000 7f431a7fc700 1 -- 172.21.15.72:0/4223551273 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43200052d0 con 0x7f4324131810 2023-10-03T10:15:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.618+0000 7f431a7fc700 1 -- 172.21.15.72:0/4223551273 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4320005430 con 0x7f4324131810 2023-10-03T10:15:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.618+0000 7f431a7fc700 1 -- 172.21.15.72:0/4223551273 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43200038c0 con 0x7f4324131810 2023-10-03T10:15:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.618+0000 7f432bf26700 1 -- 172.21.15.72:0/4223551273 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432411e880 con 0x7f4324131810 2023-10-03T10:15:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.618+0000 7f432bf26700 1 -- 172.21.15.72:0/4223551273 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43240710b0 con 0x7f4324131810 2023-10-03T10:15:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.619+0000 7f431a7fc700 1 -- 172.21.15.72:0/4223551273 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4320003a20 con 0x7f4324131810 2023-10-03T10:15:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.619+0000 7f431a7fc700 1 -- 172.21.15.72:0/4223551273 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f432003ea10 con 0x7f4324131810 2023-10-03T10:15:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.619+0000 7f432bf26700 1 -- 172.21.15.72:0/4223551273 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4324132110 con 0x7f4324131810 2023-10-03T10:15:45.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.623+0000 7f431a7fc700 1 -- 172.21.15.72:0/4223551273 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4320017030 con 0x7f4324131810 2023-10-03T10:15:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.807+0000 7f432bf26700 1 -- 172.21.15.72:0/4223551273 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4324074ea0 con 0x7f4324131810 2023-10-03T10:15:45.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.807+0000 7f431a7fc700 1 -- 172.21.15.72:0/4223551273 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4320011590 con 0x7f4324131810 2023-10-03T10:15:45.807 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.809+0000 7f432bf26700 1 -- 172.21.15.72:0/4223551273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4324131810 msgr2=0x7f432406ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.809+0000 7f432bf26700 1 --2- 172.21.15.72:0/4223551273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4324131810 0x7f432406ff70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f432000c480 tx=0x7f432000c790 comp rx=0 tx=0).stop 2023-10-03T10:15:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.809+0000 7f432bf26700 1 -- 172.21.15.72:0/4223551273 shutdown_connections 2023-10-03T10:15:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.809+0000 7f432bf26700 1 --2- 172.21.15.72:0/4223551273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4324136f50 0x7f43241c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.809+0000 7f432bf26700 1 --2- 172.21.15.72:0/4223551273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4324131810 0x7f432406ff70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.809+0000 7f432bf26700 1 --2- 172.21.15.72:0/4223551273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4324134630 0x7f43240704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.809+0000 7f432bf26700 1 -- 172.21.15.72:0/4223551273 >> 172.21.15.72:0/4223551273 conn(0x7f43240a2aa0 msgr2=0x7f432412f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.809+0000 7f432bf26700 1 -- 172.21.15.72:0/4223551273 shutdown_connections 2023-10-03T10:15:45.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:45.809+0000 7f432bf26700 1 -- 172.21.15.72:0/4223551273 wait complete. 2023-10-03T10:15:45.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:46.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:46.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:46.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.208+0000 7fe4c2567700 1 Processor -- start 2023-10-03T10:15:46.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.208+0000 7fe4c2567700 1 -- start start 2023-10-03T10:15:46.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.208+0000 7fe4c2567700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e930 0x7fe4bc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.208+0000 7fe4c2567700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4bc09f650 0x7fe4bc131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.208+0000 7fe4c2567700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4bc070940 con 0x7fe4bc09f240 2023-10-03T10:15:46.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.208+0000 7fe4c2567700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4bc06fd60 con 0x7fe4bc09f650 2023-10-03T10:15:46.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.208+0000 7fe4c2567700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc06fa80 con 0x7fe4bc09e930 2023-10-03T10:15:46.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.208+0000 7fe4bbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e930 0x7fe4bc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.208+0000 7fe4c0b04700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4bc09f650 0x7fe4bc131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.208+0000 7fe4bbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e930 0x7fe4bc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34018/0 (socket says 172.21.15.72:34018) 2023-10-03T10:15:46.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.208+0000 7fe4c0b04700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4bc09f650 0x7fe4bc131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58254/0 (socket says 172.21.15.72:58254) 2023-10-03T10:15:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.208+0000 7fe4bbfff700 1 -- 172.21.15.72:0/1457857861 learned_addr learned my addr 172.21.15.72:0/1457857861 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.209+0000 7fe4c0b04700 1 -- 172.21.15.72:0/1457857861 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e930 msgr2=0x7fe4bc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.209+0000 7fe4c0b04700 1 --2- 172.21.15.72:0/1457857861 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e930 0x7fe4bc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.209+0000 7fe4c0b04700 1 -- 172.21.15.72:0/1457857861 >> v1:172.21.15.72:6789/0 conn(0x7fe4bc09f240 legacy=0x7fe4bc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.209+0000 7fe4c0b04700 1 -- 172.21.15.72:0/1457857861 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc09fb60 con 0x7fe4bc09f650 2023-10-03T10:15:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.209+0000 7fe4bbfff700 1 --2- 172.21.15.72:0/1457857861 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e930 0x7fe4bc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.209+0000 7fe4c0b04700 1 --2- 172.21.15.72:0/1457857861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09f650 0x7fe4bc131f00 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009d90 tx=0x7fe4b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17607ec7a2c55772 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.209+0000 7fe4baffd700 1 -- 172.21.15.72:0/1457857861 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b400e070 con 0x7fe4bc09f650 2023-10-03T10:15:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.209+0000 7fe4baffd700 1 -- 172.21.15.72:0/1457857861 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b400bb20 con 0x7fe4bc09f650 2023-10-03T10:15:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.209+0000 7fe4baffd700 1 -- 172.21.15.72:0/1457857861 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4012430 con 0x7fe4bc09f650 2023-10-03T10:15:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.210+0000 7fe4c2567700 1 -- 172.21.15.72:0/1457857861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09f650 msgr2=0x7fe4bc131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.210+0000 7fe4c2567700 1 --2- 172.21.15.72:0/1457857861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09f650 0x7fe4bc131f00 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009d90 tx=0x7fe4b400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.210+0000 7fe4c2567700 1 -- 172.21.15.72:0/1457857861 shutdown_connections 2023-10-03T10:15:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.210+0000 7fe4c2567700 1 --2- 172.21.15.72:0/1457857861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09f650 0x7fe4bc131f00 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.210+0000 7fe4c2567700 1 --2- 172.21.15.72:0/1457857861 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e930 0x7fe4bc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.210+0000 7fe4c2567700 1 -- 172.21.15.72:0/1457857861 >> 172.21.15.72:0/1457857861 conn(0x7fe4bc0a4210 msgr2=0x7fe4bc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.210+0000 7fe4c2567700 1 -- 172.21.15.72:0/1457857861 shutdown_connections 2023-10-03T10:15:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.210+0000 7fe4c2567700 1 -- 172.21.15.72:0/1457857861 wait complete. 2023-10-03T10:15:46.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.211+0000 7fe4c2567700 1 Processor -- start 2023-10-03T10:15:46.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.211+0000 7fe4c2567700 1 -- start start 2023-10-03T10:15:46.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4c2567700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e930 0x7fe4bc1a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4c2567700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09f240 0x7fe4bc1a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4c2567700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4bc09f650 0x7fe4bc1a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4c2567700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc1a80e0 con 0x7fe4bc09f240 2023-10-03T10:15:46.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4c2567700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc1a7720 con 0x7fe4bc09e930 2023-10-03T10:15:46.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4c2567700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc1a6a60 con 0x7fe4bc09f650 2023-10-03T10:15:46.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4bbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e930 0x7fe4bc1a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4bbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e930 0x7fe4bc1a3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34020/0 (socket says 172.21.15.72:34020) 2023-10-03T10:15:46.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4bbfff700 1 -- 172.21.15.72:0/1173132710 learned_addr learned my addr 172.21.15.72:0/1173132710 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:46.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4bb7fe700 1 --2- 172.21.15.72:0/1173132710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09f240 0x7fe4bc1a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4c0b04700 1 --2- 172.21.15.72:0/1173132710 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4bc09f650 0x7fe4bc1a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4bbfff700 1 -- 172.21.15.72:0/1173132710 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4bc09f650 msgr2=0x7fe4bc1a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4bbfff700 1 --2- 172.21.15.72:0/1173132710 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4bc09f650 0x7fe4bc1a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4bbfff700 1 -- 172.21.15.72:0/1173132710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09f240 msgr2=0x7fe4bc1a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4bbfff700 1 --2- 172.21.15.72:0/1173132710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09f240 0x7fe4bc1a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4bbfff700 1 -- 172.21.15.72:0/1173132710 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac009550 con 0x7fe4bc09e930 2023-10-03T10:15:46.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4bb7fe700 1 --2- 172.21.15.72:0/1173132710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09f240 0x7fe4bc1a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.212+0000 7fe4bbfff700 1 --2- 172.21.15.72:0/1173132710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e930 0x7fe4bc1a3c00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00ec10 tx=0x7fe4ac00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.213+0000 7fe4b8ff9700 1 -- 172.21.15.72:0/1173132710 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac00c850 con 0x7fe4bc09e930 2023-10-03T10:15:46.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.213+0000 7fe4b8ff9700 1 -- 172.21.15.72:0/1173132710 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ac00c9b0 con 0x7fe4bc09e930 2023-10-03T10:15:46.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.213+0000 7fe4b8ff9700 1 -- 172.21.15.72:0/1173132710 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac00cd40 con 0x7fe4bc09e930 2023-10-03T10:15:46.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.213+0000 7fe4c2567700 1 -- 172.21.15.72:0/1173132710 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b4009a70 con 0x7fe4bc09e930 2023-10-03T10:15:46.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.213+0000 7fe4c2567700 1 -- 172.21.15.72:0/1173132710 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4bc0a0190 con 0x7fe4bc09e930 2023-10-03T10:15:46.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.214+0000 7fe4b8ff9700 1 -- 172.21.15.72:0/1173132710 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4ac013470 con 0x7fe4bc09e930 2023-10-03T10:15:46.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.214+0000 7fe4c2567700 1 -- 172.21.15.72:0/1173132710 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4bc1a0b30 con 0x7fe4bc09e930 2023-10-03T10:15:46.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.214+0000 7fe4b8ff9700 1 -- 172.21.15.72:0/1173132710 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe4ac03fc00 con 0x7fe4bc09e930 2023-10-03T10:15:46.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.218+0000 7fe4b8ff9700 1 -- 172.21.15.72:0/1173132710 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4ac013720 con 0x7fe4bc09e930 2023-10-03T10:15:46.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:46.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.306+0000 7fa68beb4700 1 Processor -- start 2023-10-03T10:15:46.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.306+0000 7fa68beb4700 1 -- start start 2023-10-03T10:15:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.306+0000 7fa68beb4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa68409d6f0 0x7fa68409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.306+0000 7fa68beb4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa68409e000 0x7fa6841339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.306+0000 7fa68beb4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68409b120 con 0x7fa68409e410 2023-10-03T10:15:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.306+0000 7fa68beb4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68406b460 con 0x7fa68409d6f0 2023-10-03T10:15:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.306+0000 7fa68beb4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68409a7e0 con 0x7fa68409e000 2023-10-03T10:15:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.307+0000 7fa689c50700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa68409d6f0 0x7fa68409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.307+0000 7fa68944f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa68409e000 0x7fa6841339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.307+0000 7fa689c50700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa68409d6f0 0x7fa68409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58274/0 (socket says 172.21.15.72:58274) 2023-10-03T10:15:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.307+0000 7fa689c50700 1 -- 172.21.15.72:0/3923196487 learned_addr learned my addr 172.21.15.72:0/3923196487 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.307+0000 7fa68944f700 1 -- 172.21.15.72:0/3923196487 >> v2:172.21.15.72:3300/0 conn(0x7fa68409d6f0 msgr2=0x7fa68409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.307+0000 7fa68944f700 1 --2- 172.21.15.72:0/3923196487 >> v2:172.21.15.72:3300/0 conn(0x7fa68409d6f0 0x7fa68409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.307+0000 7fa68944f700 1 -- 172.21.15.72:0/3923196487 >> v1:172.21.15.72:6789/0 conn(0x7fa68409e410 legacy=0x7fa684133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.307+0000 7fa68944f700 1 -- 172.21.15.72:0/3923196487 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68409a500 con 0x7fa68409e000 2023-10-03T10:15:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.307+0000 7fa689c50700 1 --2- 172.21.15.72:0/3923196487 >> v2:172.21.15.72:3300/0 conn(0x7fa68409d6f0 0x7fa68409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.307+0000 7fa68944f700 1 --2- 172.21.15.72:0/3923196487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa68409e000 0x7fa6841339f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa674009870 tx=0x7fa674009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1eb1acb04aba9da8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.307+0000 7fa688c4e700 1 -- 172.21.15.72:0/3923196487 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674011830 con 0x7fa68409e000 2023-10-03T10:15:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.307+0000 7fa688c4e700 1 -- 172.21.15.72:0/3923196487 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa674011990 con 0x7fa68409e000 2023-10-03T10:15:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.307+0000 7fa688c4e700 1 -- 172.21.15.72:0/3923196487 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674011d20 con 0x7fa68409e000 2023-10-03T10:15:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.308+0000 7fa68beb4700 1 -- 172.21.15.72:0/3923196487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa68409e000 msgr2=0x7fa6841339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.308+0000 7fa68beb4700 1 --2- 172.21.15.72:0/3923196487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa68409e000 0x7fa6841339f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa674009870 tx=0x7fa674009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.308+0000 7fa68beb4700 1 -- 172.21.15.72:0/3923196487 shutdown_connections 2023-10-03T10:15:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.308+0000 7fa68beb4700 1 --2- 172.21.15.72:0/3923196487 >> v2:172.21.15.72:3300/0 conn(0x7fa68409d6f0 0x7fa68409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.308+0000 7fa68beb4700 1 --2- 172.21.15.72:0/3923196487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa68409e000 0x7fa6841339f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.308+0000 7fa68beb4700 1 -- 172.21.15.72:0/3923196487 >> 172.21.15.72:0/3923196487 conn(0x7fa684066f50 msgr2=0x7fa68409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.308+0000 7fa68beb4700 1 -- 172.21.15.72:0/3923196487 shutdown_connections 2023-10-03T10:15:46.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.308+0000 7fa68beb4700 1 -- 172.21.15.72:0/3923196487 wait complete. 2023-10-03T10:15:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.309+0000 7fa68beb4700 1 Processor -- start 2023-10-03T10:15:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.309+0000 7fa68beb4700 1 -- start start 2023-10-03T10:15:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.309+0000 7fa68beb4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa68409d6f0 0x7fa6841a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.309+0000 7fa68beb4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa68409e000 0x7fa6841a6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.309+0000 7fa68beb4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa68409e410 0x7fa6841a6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.309+0000 7fa68beb4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6841a7490 con 0x7fa68409d6f0 2023-10-03T10:15:46.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.309+0000 7fa68beb4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6841a7ba0 con 0x7fa68409e410 2023-10-03T10:15:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.309+0000 7fa68beb4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6841a8df0 con 0x7fa68409e000 2023-10-03T10:15:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa68a451700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa68409e410 0x7fa6841a6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa68944f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa68409e000 0x7fa6841a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa68a451700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa68409e410 0x7fa6841a6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34038/0 (socket says 172.21.15.72:34038) 2023-10-03T10:15:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa68944f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa68409e000 0x7fa6841a6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51046/0 (socket says 172.21.15.72:51046) 2023-10-03T10:15:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa68a451700 1 -- 172.21.15.72:0/1074600422 learned_addr learned my addr 172.21.15.72:0/1074600422 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa689c50700 1 --2- 172.21.15.72:0/1074600422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa68409d6f0 0x7fa6841a5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa68a451700 1 -- 172.21.15.72:0/1074600422 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa68409e000 msgr2=0x7fa6841a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa68a451700 1 --2- 172.21.15.72:0/1074600422 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa68409e000 0x7fa6841a6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa68a451700 1 -- 172.21.15.72:0/1074600422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa68409d6f0 msgr2=0x7fa6841a5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa68a451700 1 --2- 172.21.15.72:0/1074600422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa68409d6f0 0x7fa6841a5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa68a451700 1 -- 172.21.15.72:0/1074600422 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa680009550 con 0x7fa68409e410 2023-10-03T10:15:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa68944f700 1 --2- 172.21.15.72:0/1074600422 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa68409e000 0x7fa6841a6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa689c50700 1 --2- 172.21.15.72:0/1074600422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa68409d6f0 0x7fa6841a5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa68a451700 1 --2- 172.21.15.72:0/1074600422 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa68409e410 0x7fa6841a6a60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00cc50 tx=0x7fa67c00cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa67a7fc700 1 -- 172.21.15.72:0/1074600422 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c003c00 con 0x7fa68409e410 2023-10-03T10:15:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa67a7fc700 1 -- 172.21.15.72:0/1074600422 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c003d60 con 0x7fa68409e410 2023-10-03T10:15:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa68beb4700 1 -- 172.21.15.72:0/1074600422 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6740094a0 con 0x7fa68409e410 2023-10-03T10:15:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa67a7fc700 1 -- 172.21.15.72:0/1074600422 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c00aab0 con 0x7fa68409e410 2023-10-03T10:15:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.310+0000 7fa68beb4700 1 -- 172.21.15.72:0/1074600422 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6840a31b0 con 0x7fa68409e410 2023-10-03T10:15:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.311+0000 7fa67a7fc700 1 -- 172.21.15.72:0/1074600422 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa67c00ac10 con 0x7fa68409e410 2023-10-03T10:15:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.311+0000 7fa67a7fc700 1 -- 172.21.15.72:0/1074600422 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa67c03f5d0 con 0x7fa68409e410 2023-10-03T10:15:46.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.313+0000 7fa68beb4700 1 -- 172.21.15.72:0/1074600422 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa684074ea0 con 0x7fa68409e410 2023-10-03T10:15:46.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.317+0000 7fa67a7fc700 1 -- 172.21.15.72:0/1074600422 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa67c0198f0 con 0x7fa68409e410 2023-10-03T10:15:46.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.414+0000 7fe4c2567700 1 -- 172.21.15.72:0/1173132710 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe4bc1a72c0 con 0x7fe4bc09e930 2023-10-03T10:15:46.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.414+0000 7fe4b8ff9700 1 -- 172.21.15.72:0/1173132710 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4ac021030 con 0x7fe4bc09e930 2023-10-03T10:15:46.414 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:46.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.416+0000 7fe4c2567700 1 -- 172.21.15.72:0/1173132710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e930 msgr2=0x7fe4bc1a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.416+0000 7fe4c2567700 1 --2- 172.21.15.72:0/1173132710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e930 0x7fe4bc1a3c00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00ec10 tx=0x7fe4ac00ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:46.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.416+0000 7fe4c2567700 1 -- 172.21.15.72:0/1173132710 shutdown_connections 2023-10-03T10:15:46.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.416+0000 7fe4c2567700 1 --2- 172.21.15.72:0/1173132710 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe4bc09f650 0x7fe4bc1a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.416+0000 7fe4c2567700 1 --2- 172.21.15.72:0/1173132710 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4bc09e930 0x7fe4bc1a3c00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.416+0000 7fe4c2567700 1 --2- 172.21.15.72:0/1173132710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4bc09f240 0x7fe4bc1a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.416+0000 7fe4c2567700 1 -- 172.21.15.72:0/1173132710 >> 172.21.15.72:0/1173132710 conn(0x7fe4bc0a4210 msgr2=0x7fe4bc1b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.416+0000 7fe4c2567700 1 -- 172.21.15.72:0/1173132710 shutdown_connections 2023-10-03T10:15:46.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.416+0000 7fe4c2567700 1 -- 172.21.15.72:0/1173132710 wait complete. 2023-10-03T10:15:46.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.423+0000 7fea2ead5700 1 Processor -- start 2023-10-03T10:15:46.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.423+0000 7fea2ead5700 1 -- start start 2023-10-03T10:15:46.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.424+0000 7fea2ead5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea2809d6f0 0x7fea2809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.424+0000 7fea2ead5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea2809e000 0x7fea28130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.424+0000 7fea2ead5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2809f130 con 0x7fea2809e410 2023-10-03T10:15:46.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.424+0000 7fea2ead5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea2809f520 con 0x7fea2809e000 2023-10-03T10:15:46.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.424+0000 7fea2ead5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea2809e930 con 0x7fea2809d6f0 2023-10-03T10:15:46.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.424+0000 7fea27fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea2809e000 0x7fea28130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.424+0000 7fea27fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea2809e000 0x7fea28130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58292/0 (socket says 172.21.15.72:58292) 2023-10-03T10:15:46.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.424+0000 7fea27fff700 1 -- 172.21.15.72:0/4138280842 learned_addr learned my addr 172.21.15.72:0/4138280842 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:46.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.424+0000 7fea2c871700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea2809d6f0 0x7fea2809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.424+0000 7fea2c871700 1 -- 172.21.15.72:0/4138280842 >> v2:172.21.15.72:3300/0 conn(0x7fea2809e000 msgr2=0x7fea28130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.424+0000 7fea2c871700 1 --2- 172.21.15.72:0/4138280842 >> v2:172.21.15.72:3300/0 conn(0x7fea2809e000 0x7fea28130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.424+0000 7fea2c871700 1 -- 172.21.15.72:0/4138280842 >> v1:172.21.15.72:6789/0 conn(0x7fea2809e410 legacy=0x7fea28130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.424+0000 7fea2c871700 1 -- 172.21.15.72:0/4138280842 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2809b2d0 con 0x7fea2809d6f0 2023-10-03T10:15:46.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.424+0000 7fea277fe700 1 -- 172.21.15.72:0/4138280842 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044969335 0 0) 0x7fea2809f130 con 0x7fea2809e410 2023-10-03T10:15:46.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.424+0000 7fea27fff700 1 --2- 172.21.15.72:0/4138280842 >> v2:172.21.15.72:3300/0 conn(0x7fea2809e000 0x7fea28130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.425+0000 7fea2c871700 1 --2- 172.21.15.72:0/4138280842 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea2809d6f0 0x7fea2809dac0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009840 tx=0x7fea1c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=192f5c2803d9770c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.425+0000 7fea277fe700 1 -- 172.21.15.72:0/4138280842 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c011830 con 0x7fea2809d6f0 2023-10-03T10:15:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.425+0000 7fea277fe700 1 -- 172.21.15.72:0/4138280842 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c011990 con 0x7fea2809d6f0 2023-10-03T10:15:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.425+0000 7fea277fe700 1 -- 172.21.15.72:0/4138280842 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1c011d20 con 0x7fea2809d6f0 2023-10-03T10:15:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.425+0000 7fea2ead5700 1 -- 172.21.15.72:0/4138280842 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea2809d6f0 msgr2=0x7fea2809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.425+0000 7fea2ead5700 1 --2- 172.21.15.72:0/4138280842 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea2809d6f0 0x7fea2809dac0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009840 tx=0x7fea1c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.426+0000 7fea2ead5700 1 -- 172.21.15.72:0/4138280842 shutdown_connections 2023-10-03T10:15:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.426+0000 7fea2ead5700 1 --2- 172.21.15.72:0/4138280842 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea2809d6f0 0x7fea2809dac0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.426+0000 7fea2ead5700 1 --2- 172.21.15.72:0/4138280842 >> v2:172.21.15.72:3300/0 conn(0x7fea2809e000 0x7fea28130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.426+0000 7fea2ead5700 1 -- 172.21.15.72:0/4138280842 >> 172.21.15.72:0/4138280842 conn(0x7fea28066f50 msgr2=0x7fea2809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.426+0000 7fea2ead5700 1 -- 172.21.15.72:0/4138280842 shutdown_connections 2023-10-03T10:15:46.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.426+0000 7fea2ead5700 1 -- 172.21.15.72:0/4138280842 wait complete. 2023-10-03T10:15:46.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.426+0000 7fea2ead5700 1 Processor -- start 2023-10-03T10:15:46.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.427+0000 7fea2ead5700 1 -- start start 2023-10-03T10:15:46.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.427+0000 7fea2ead5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea2809d6f0 0x7fea2811eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.427+0000 7fea2ead5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea2809e000 0x7fea2811f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.427+0000 7fea2ead5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea2809e410 0x7fea2811f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.427+0000 7fea2ead5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea281219b0 con 0x7fea2809e000 2023-10-03T10:15:46.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.427+0000 7fea2ead5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea28122780 con 0x7fea2809d6f0 2023-10-03T10:15:46.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.427+0000 7fea2ead5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea28130270 con 0x7fea2809e410 2023-10-03T10:15:46.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.427+0000 7fea2d072700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea2809e410 0x7fea2811f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.427+0000 7fea2c871700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea2809d6f0 0x7fea2811eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.427+0000 7fea27fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea2809e000 0x7fea2811f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.427+0000 7fea2d072700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea2809e410 0x7fea2811f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51058/0 (socket says 172.21.15.72:51058) 2023-10-03T10:15:46.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.427+0000 7fea2c871700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea2809d6f0 0x7fea2811eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34042/0 (socket says 172.21.15.72:34042) 2023-10-03T10:15:46.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.427+0000 7fea2d072700 1 -- 172.21.15.72:0/3081886219 learned_addr learned my addr 172.21.15.72:0/3081886219 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:46.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.428+0000 7fea2d072700 1 -- 172.21.15.72:0/3081886219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea2809d6f0 msgr2=0x7fea2811eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.428+0000 7fea2d072700 1 --2- 172.21.15.72:0/3081886219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea2809d6f0 0x7fea2811eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.428+0000 7fea2d072700 1 -- 172.21.15.72:0/3081886219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea2809e000 msgr2=0x7fea2811f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.428+0000 7fea2d072700 1 --2- 172.21.15.72:0/3081886219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea2809e000 0x7fea2811f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.428+0000 7fea2d072700 1 -- 172.21.15.72:0/3081886219 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea14009550 con 0x7fea2809e410 2023-10-03T10:15:46.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.428+0000 7fea27fff700 1 --2- 172.21.15.72:0/3081886219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea2809e000 0x7fea2811f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.428+0000 7fea2c871700 1 --2- 172.21.15.72:0/3081886219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea2809d6f0 0x7fea2811eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.428+0000 7fea2d072700 1 --2- 172.21.15.72:0/3081886219 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea2809e410 0x7fea2811f960 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fea2000eac0 tx=0x7fea2000edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.428+0000 7fea257fa700 1 -- 172.21.15.72:0/3081886219 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20003e30 con 0x7fea2809e410 2023-10-03T10:15:46.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.428+0000 7fea257fa700 1 -- 172.21.15.72:0/3081886219 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2000c7e0 con 0x7fea2809e410 2023-10-03T10:15:46.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.428+0000 7fea2ead5700 1 -- 172.21.15.72:0/3081886219 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c0094a0 con 0x7fea2809e410 2023-10-03T10:15:46.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.428+0000 7fea257fa700 1 -- 172.21.15.72:0/3081886219 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2000cb90 con 0x7fea2809e410 2023-10-03T10:15:46.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.428+0000 7fea2ead5700 1 -- 172.21.15.72:0/3081886219 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea28122420 con 0x7fea2809e410 2023-10-03T10:15:46.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.429+0000 7fea2ead5700 1 -- 172.21.15.72:0/3081886219 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea28121d00 con 0x7fea2809e410 2023-10-03T10:15:46.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.429+0000 7fea257fa700 1 -- 172.21.15.72:0/3081886219 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea2000ccf0 con 0x7fea2809e410 2023-10-03T10:15:46.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.429+0000 7fea257fa700 1 -- 172.21.15.72:0/3081886219 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fea200420a0 con 0x7fea2809e410 2023-10-03T10:15:46.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:46.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.434+0000 7fea257fa700 1 -- 172.21.15.72:0/3081886219 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea2000f770 con 0x7fea2809e410 2023-10-03T10:15:46.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.546+0000 7fa68beb4700 1 -- 172.21.15.72:0/1074600422 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa68409c6d0 con 0x7fa68409e410 2023-10-03T10:15:46.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.546+0000 7fa67a7fc700 1 -- 172.21.15.72:0/1074600422 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa67c011380 con 0x7fa68409e410 2023-10-03T10:15:46.546 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:46.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.548+0000 7fa68beb4700 1 -- 172.21.15.72:0/1074600422 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa68409e410 msgr2=0x7fa6841a6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.548+0000 7fa68beb4700 1 --2- 172.21.15.72:0/1074600422 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa68409e410 0x7fa6841a6a60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00cc50 tx=0x7fa67c00cf60 comp rx=0 tx=0).stop 2023-10-03T10:15:46.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.548+0000 7fa68beb4700 1 -- 172.21.15.72:0/1074600422 shutdown_connections 2023-10-03T10:15:46.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.548+0000 7fa68beb4700 1 --2- 172.21.15.72:0/1074600422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa68409d6f0 0x7fa6841a5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.548+0000 7fa68beb4700 1 --2- 172.21.15.72:0/1074600422 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa68409e410 0x7fa6841a6a60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.548+0000 7fa68beb4700 1 --2- 172.21.15.72:0/1074600422 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa68409e000 0x7fa6841a6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.548+0000 7fa68beb4700 1 -- 172.21.15.72:0/1074600422 >> 172.21.15.72:0/1074600422 conn(0x7fa684066f50 msgr2=0x7fa6841baf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.548+0000 7fa68beb4700 1 -- 172.21.15.72:0/1074600422 shutdown_connections 2023-10-03T10:15:46.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.548+0000 7fa68beb4700 1 -- 172.21.15.72:0/1074600422 wait complete. 2023-10-03T10:15:46.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:46.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.629+0000 7fea2ead5700 1 -- 172.21.15.72:0/3081886219 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fea28122210 con 0x7fea2809e410 2023-10-03T10:15:46.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.629+0000 7fea257fa700 1 -- 172.21.15.72:0/3081886219 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea2001f030 con 0x7fea2809e410 2023-10-03T10:15:46.629 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:46.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.631+0000 7fea2ead5700 1 -- 172.21.15.72:0/3081886219 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea2809e410 msgr2=0x7fea2811f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.631+0000 7fea2ead5700 1 --2- 172.21.15.72:0/3081886219 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea2809e410 0x7fea2811f960 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fea2000eac0 tx=0x7fea2000edd0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.632+0000 7fea2ead5700 1 -- 172.21.15.72:0/3081886219 shutdown_connections 2023-10-03T10:15:46.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.632+0000 7fea2ead5700 1 --2- 172.21.15.72:0/3081886219 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea2809e410 0x7fea2811f960 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.632+0000 7fea2ead5700 1 --2- 172.21.15.72:0/3081886219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea2809d6f0 0x7fea2811eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.632+0000 7fea2ead5700 1 --2- 172.21.15.72:0/3081886219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea2809e000 0x7fea2811f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.632+0000 7fea2ead5700 1 -- 172.21.15.72:0/3081886219 >> 172.21.15.72:0/3081886219 conn(0x7fea28066f50 msgr2=0x7fea28130b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.632+0000 7fea2ead5700 1 -- 172.21.15.72:0/3081886219 shutdown_connections 2023-10-03T10:15:46.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.632+0000 7fea2ead5700 1 -- 172.21.15.72:0/3081886219 wait complete. 2023-10-03T10:15:46.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:46.822 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:46.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.945+0000 7f7e16213700 1 Processor -- start 2023-10-03T10:15:46.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.945+0000 7f7e16213700 1 -- start start 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e16213700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e1009e1d0 0x7f7e10135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e16213700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e10135e50 0x7f7e10138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e16213700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1009f130 con 0x7f7e1009d6f0 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e16213700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1009f520 con 0x7f7e10135e50 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e16213700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1009e930 con 0x7f7e1009e1d0 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e0ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e10135e50 0x7f7e10138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e0effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e1009e1d0 0x7f7e10135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e0ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e10135e50 0x7f7e10138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58318/0 (socket says 172.21.15.72:58318) 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e0effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e1009e1d0 0x7f7e10135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34050/0 (socket says 172.21.15.72:34050) 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e0ffff700 1 -- 172.21.15.72:0/3916105650 learned_addr learned my addr 172.21.15.72:0/3916105650 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e0ffff700 1 -- 172.21.15.72:0/3916105650 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e1009e1d0 msgr2=0x7f7e10135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e0ffff700 1 --2- 172.21.15.72:0/3916105650 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e1009e1d0 0x7f7e10135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e0ffff700 1 -- 172.21.15.72:0/3916105650 >> v1:172.21.15.72:6789/0 conn(0x7f7e1009d6f0 legacy=0x7f7e1009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e0ffff700 1 -- 172.21.15.72:0/3916105650 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1009b2d0 con 0x7f7e10135e50 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e0ffff700 1 --2- 172.21.15.72:0/3916105650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e10135e50 0x7f7e10138230 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009e80 tx=0x7f7e0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e37f8092056d0d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e0e7fc700 1 -- 172.21.15.72:0/3916105650 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0800e070 con 0x7f7e10135e50 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e0e7fc700 1 -- 172.21.15.72:0/3916105650 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0800b8d0 con 0x7f7e10135e50 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.946+0000 7f7e0e7fc700 1 -- 172.21.15.72:0/3916105650 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0800bc80 con 0x7f7e10135e50 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.947+0000 7f7e16213700 1 -- 172.21.15.72:0/3916105650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e10135e50 msgr2=0x7f7e10138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.947+0000 7f7e16213700 1 --2- 172.21.15.72:0/3916105650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e10135e50 0x7f7e10138230 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009e80 tx=0x7f7e0800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.947+0000 7f7e16213700 1 -- 172.21.15.72:0/3916105650 shutdown_connections 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.947+0000 7f7e16213700 1 --2- 172.21.15.72:0/3916105650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e10135e50 0x7f7e10138230 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.947+0000 7f7e16213700 1 --2- 172.21.15.72:0/3916105650 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e1009e1d0 0x7f7e10135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.947+0000 7f7e16213700 1 -- 172.21.15.72:0/3916105650 >> 172.21.15.72:0/3916105650 conn(0x7f7e10066f50 msgr2=0x7f7e1009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.947+0000 7f7e16213700 1 -- 172.21.15.72:0/3916105650 shutdown_connections 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.947+0000 7f7e16213700 1 -- 172.21.15.72:0/3916105650 wait complete. 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.948+0000 7f7e16213700 1 Processor -- start 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.948+0000 7f7e16213700 1 -- start start 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.948+0000 7f7e16213700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e1009d6f0 0x7f7e1011e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.948+0000 7f7e16213700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e1009e1d0 0x7f7e1011e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.948+0000 7f7e16213700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e10135e50 0x7f7e101c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e16213700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e101210f0 con 0x7f7e10135e50 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e16213700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e101212d0 con 0x7f7e1009e1d0 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e16213700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e10132140 con 0x7f7e1009d6f0 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e0ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e10135e50 0x7f7e101c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e0f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e1009d6f0 0x7f7e1011e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e0effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e1009e1d0 0x7f7e1011e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e0ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e10135e50 0x7f7e101c61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58320/0 (socket says 172.21.15.72:58320) 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e0ffff700 1 -- 172.21.15.72:0/4094884924 learned_addr learned my addr 172.21.15.72:0/4094884924 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e0f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e1009d6f0 0x7f7e1011e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51068/0 (socket says 172.21.15.72:51068) 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e0ffff700 1 -- 172.21.15.72:0/4094884924 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e1009d6f0 msgr2=0x7f7e1011e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e0ffff700 1 --2- 172.21.15.72:0/4094884924 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e1009d6f0 0x7f7e1011e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e0ffff700 1 -- 172.21.15.72:0/4094884924 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e1009e1d0 msgr2=0x7f7e1011e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e0ffff700 1 --2- 172.21.15.72:0/4094884924 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e1009e1d0 0x7f7e1011e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e0ffff700 1 -- 172.21.15.72:0/4094884924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08009b30 con 0x7f7e10135e50 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e0ffff700 1 --2- 172.21.15.72:0/4094884924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e10135e50 0x7f7e101c61c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7e1006de00 tx=0x7f7e08004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7df7fff700 1 -- 172.21.15.72:0/4094884924 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08004800 con 0x7f7e10135e50 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7df7fff700 1 -- 172.21.15.72:0/4094884924 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e08004960 con 0x7f7e10135e50 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e16213700 1 -- 172.21.15.72:0/4094884924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1011dc90 con 0x7f7e10135e50 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7df7fff700 1 -- 172.21.15.72:0/4094884924 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0801c680 con 0x7f7e10135e50 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.949+0000 7f7e16213700 1 -- 172.21.15.72:0/4094884924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1009c700 con 0x7f7e10135e50 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.950+0000 7f7df7fff700 1 -- 172.21.15.72:0/4094884924 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e0801c7e0 con 0x7f7e10135e50 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.950+0000 7f7e16213700 1 -- 172.21.15.72:0/4094884924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e10074ea0 con 0x7f7e10135e50 2023-10-03T10:15:46.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.950+0000 7f7df7fff700 1 -- 172.21.15.72:0/4094884924 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e08041180 con 0x7f7e10135e50 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:46.955+0000 7f7df7fff700 1 -- 172.21.15.72:0/4094884924 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e0801a330 con 0x7f7e10135e50 2023-10-03T10:15:47.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.136+0000 7f7e16213700 1 -- 172.21.15.72:0/4094884924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7e100a2270 con 0x7f7e10135e50 2023-10-03T10:15:47.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.136+0000 7f7df7fff700 1 -- 172.21.15.72:0/4094884924 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7e08024ba0 con 0x7f7e10135e50 2023-10-03T10:15:47.136 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:47.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.138+0000 7f7e16213700 1 -- 172.21.15.72:0/4094884924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e10135e50 msgr2=0x7f7e101c61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.138+0000 7f7e16213700 1 --2- 172.21.15.72:0/4094884924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e10135e50 0x7f7e101c61c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7e1006de00 tx=0x7f7e08004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.138+0000 7f7e16213700 1 -- 172.21.15.72:0/4094884924 shutdown_connections 2023-10-03T10:15:47.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.138+0000 7f7e16213700 1 --2- 172.21.15.72:0/4094884924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e10135e50 0x7f7e101c61c0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.138+0000 7f7e16213700 1 --2- 172.21.15.72:0/4094884924 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e1009d6f0 0x7f7e1011e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.138+0000 7f7e16213700 1 --2- 172.21.15.72:0/4094884924 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e1009e1d0 0x7f7e1011e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.138+0000 7f7e16213700 1 -- 172.21.15.72:0/4094884924 >> 172.21.15.72:0/4094884924 conn(0x7f7e10066f50 msgr2=0x7f7e100711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.138+0000 7f7e16213700 1 -- 172.21.15.72:0/4094884924 shutdown_connections 2023-10-03T10:15:47.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.138+0000 7f7e16213700 1 -- 172.21.15.72:0/4094884924 wait complete. 2023-10-03T10:15:47.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:47.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:47.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.557+0000 7f022cfbf700 1 Processor -- start 2023-10-03T10:15:47.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.557+0000 7f022cfbf700 1 -- start start 2023-10-03T10:15:47.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f022cfbf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022809d6f0 0x7f022809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f022cfbf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022809e000 0x7f02281339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f022cfbf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f022809e410 0x7f0228133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f022cfbf700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022806b460 con 0x7f022809e410 2023-10-03T10:15:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f022cfbf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022809b120 con 0x7f022809d6f0 2023-10-03T10:15:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f022cfbf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f022809a7e0 con 0x7f022809e000 2023-10-03T10:15:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f022659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022809d6f0 0x7f022809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f0226d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f022809e410 0x7f0228133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f0225d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022809e000 0x7f02281339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f0226d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f022809e410 0x7f0228133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58326/0 (socket says 172.21.15.72:58326) 2023-10-03T10:15:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f022659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022809d6f0 0x7f022809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34072/0 (socket says 172.21.15.72:34072) 2023-10-03T10:15:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f0226d9d700 1 -- 172.21.15.72:0/290589792 learned_addr learned my addr 172.21.15.72:0/290589792 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f0225d9b700 1 -- 172.21.15.72:0/290589792 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022809d6f0 msgr2=0x7f022809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f0225d9b700 1 --2- 172.21.15.72:0/290589792 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022809d6f0 0x7f022809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f0225d9b700 1 -- 172.21.15.72:0/290589792 >> v2:172.21.15.72:3300/0 conn(0x7f022809e410 msgr2=0x7f0228133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:47.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f0225d9b700 1 --2- 172.21.15.72:0/290589792 >> v2:172.21.15.72:3300/0 conn(0x7f022809e410 0x7f0228133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f0225d9b700 1 -- 172.21.15.72:0/290589792 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022809a500 con 0x7f022809e000 2023-10-03T10:15:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f022659c700 1 --2- 172.21.15.72:0/290589792 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022809d6f0 0x7f022809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f0226d9d700 1 --2- 172.21.15.72:0/290589792 >> v2:172.21.15.72:3300/0 conn(0x7f022809e410 0x7f0228133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f0225d9b700 1 --2- 172.21.15.72:0/290589792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022809e000 0x7f02281339f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0218009870 tx=0x7f0218009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f195a21b6738b864 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f022559a700 1 -- 172.21.15.72:0/290589792 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218011830 con 0x7f022809e000 2023-10-03T10:15:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f022559a700 1 -- 172.21.15.72:0/290589792 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0218011990 con 0x7f022809e000 2023-10-03T10:15:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.558+0000 7f022559a700 1 -- 172.21.15.72:0/290589792 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218011d20 con 0x7f022809e000 2023-10-03T10:15:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.559+0000 7f022cfbf700 1 -- 172.21.15.72:0/290589792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022809e000 msgr2=0x7f02281339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.559+0000 7f022cfbf700 1 --2- 172.21.15.72:0/290589792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022809e000 0x7f02281339f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0218009870 tx=0x7f0218009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.559+0000 7f022cfbf700 1 -- 172.21.15.72:0/290589792 shutdown_connections 2023-10-03T10:15:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.559+0000 7f022cfbf700 1 --2- 172.21.15.72:0/290589792 >> v2:172.21.15.72:3300/0 conn(0x7f022809e410 0x7f0228133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.559+0000 7f022cfbf700 1 --2- 172.21.15.72:0/290589792 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022809d6f0 0x7f022809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.559+0000 7f022cfbf700 1 --2- 172.21.15.72:0/290589792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022809e000 0x7f02281339f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.559+0000 7f022cfbf700 1 -- 172.21.15.72:0/290589792 >> 172.21.15.72:0/290589792 conn(0x7f0228066f50 msgr2=0x7f022809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.559+0000 7f022cfbf700 1 -- 172.21.15.72:0/290589792 shutdown_connections 2023-10-03T10:15:47.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.559+0000 7f022cfbf700 1 -- 172.21.15.72:0/290589792 wait complete. 2023-10-03T10:15:47.562 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:47.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.560+0000 7f022cfbf700 1 Processor -- start 2023-10-03T10:15:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.560+0000 7f022cfbf700 1 -- start start 2023-10-03T10:15:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f022cfbf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022809d6f0 0x7f02281a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f022cfbf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022809e000 0x7f02281a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f022cfbf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022809e410 0x7f02281c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f022cfbf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02281a7010 con 0x7f022809e000 2023-10-03T10:15:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f022cfbf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02281a3c80 con 0x7f022809e410 2023-10-03T10:15:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f022cfbf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f022809c710 con 0x7f022809d6f0 2023-10-03T10:15:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f0226d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022809e410 0x7f02281c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f022659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022809d6f0 0x7f02281a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f0225d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022809e000 0x7f02281a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f0226d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022809e410 0x7f02281c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34076/0 (socket says 172.21.15.72:34076) 2023-10-03T10:15:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f022659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022809d6f0 0x7f02281a4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51084/0 (socket says 172.21.15.72:51084) 2023-10-03T10:15:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f0226d9d700 1 -- 172.21.15.72:0/1406907526 learned_addr learned my addr 172.21.15.72:0/1406907526 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f0225d9b700 1 -- 172.21.15.72:0/1406907526 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022809d6f0 msgr2=0x7f02281a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f0225d9b700 1 --2- 172.21.15.72:0/1406907526 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022809d6f0 0x7f02281a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f0225d9b700 1 -- 172.21.15.72:0/1406907526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022809e410 msgr2=0x7f02281c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f0225d9b700 1 --2- 172.21.15.72:0/1406907526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022809e410 0x7f02281c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f0225d9b700 1 -- 172.21.15.72:0/1406907526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0094a0 con 0x7f022809e000 2023-10-03T10:15:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f0226d9d700 1 --2- 172.21.15.72:0/1406907526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022809e410 0x7f02281c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f022659c700 1 --2- 172.21.15.72:0/1406907526 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022809d6f0 0x7f02281a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f0225d9b700 1 --2- 172.21.15.72:0/1406907526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022809e000 0x7f02281a4680 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0218016000 tx=0x7f0218004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f0216ffd700 1 -- 172.21.15.72:0/1406907526 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218004450 con 0x7f022809e000 2023-10-03T10:15:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f0216ffd700 1 -- 172.21.15.72:0/1406907526 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021801f070 con 0x7f022809e000 2023-10-03T10:15:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f022cfbf700 1 -- 172.21.15.72:0/1406907526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0220009b30 con 0x7f022809e000 2023-10-03T10:15:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f0216ffd700 1 -- 172.21.15.72:0/1406907526 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02180038c0 con 0x7f022809e000 2023-10-03T10:15:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.561+0000 7f022cfbf700 1 -- 172.21.15.72:0/1406907526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02180094a0 con 0x7f022809e000 2023-10-03T10:15:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.562+0000 7f0216ffd700 1 -- 172.21.15.72:0/1406907526 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0218003a20 con 0x7f022809e000 2023-10-03T10:15:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.562+0000 7f0216ffd700 1 -- 172.21.15.72:0/1406907526 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0218021070 con 0x7f022809e000 2023-10-03T10:15:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.562+0000 7f022cfbf700 1 -- 172.21.15.72:0/1406907526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0228074ea0 con 0x7f022809e000 2023-10-03T10:15:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.567+0000 7f0216ffd700 1 -- 172.21.15.72:0/1406907526 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0218015080 con 0x7f022809e000 2023-10-03T10:15:47.643 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:47.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.694+0000 7f087b49f700 1 Processor -- start 2023-10-03T10:15:47.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.695+0000 7f087b49f700 1 -- start start 2023-10-03T10:15:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.695+0000 7f087b49f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f087409e1d0 0x7f0874135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.695+0000 7f087b49f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0874135e50 0x7f0874138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.695+0000 7f087b49f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087409f130 con 0x7f087409d6f0 2023-10-03T10:15:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.695+0000 7f087b49f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087409f520 con 0x7f087409e1d0 2023-10-03T10:15:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.696+0000 7f087b49f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087409e930 con 0x7f0874135e50 2023-10-03T10:15:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.696+0000 7f0878a3a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f087409e1d0 0x7f0874135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.696+0000 7f0878a3a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f087409e1d0 0x7f0874135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58334/0 (socket says 172.21.15.72:58334) 2023-10-03T10:15:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.696+0000 7f0878a3a700 1 -- 172.21.15.72:0/473488146 learned_addr learned my addr 172.21.15.72:0/473488146 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.696+0000 7f087923b700 1 --1- 172.21.15.72:0/473488146 >> v1:172.21.15.72:6789/0 conn(0x7f087409d6f0 0x7f087409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49610/0 (socket says 172.21.15.72:49610) 2023-10-03T10:15:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.696+0000 7f0879a3c700 1 --2- 172.21.15.72:0/473488146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0874135e50 0x7f0874138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.696+0000 7f0878a3a700 1 -- 172.21.15.72:0/473488146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0874135e50 msgr2=0x7f0874138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.696+0000 7f0878a3a700 1 --2- 172.21.15.72:0/473488146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0874135e50 0x7f0874138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.696+0000 7f0878a3a700 1 -- 172.21.15.72:0/473488146 >> v1:172.21.15.72:6789/0 conn(0x7f087409d6f0 legacy=0x7f087409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.696+0000 7f0878a3a700 1 -- 172.21.15.72:0/473488146 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087409b2d0 con 0x7f087409e1d0 2023-10-03T10:15:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.696+0000 7f0878a3a700 1 --2- 172.21.15.72:0/473488146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f087409e1d0 0x7f0874135910 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f086400bb90 tx=0x7f086400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fa534df4fe49d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.696+0000 7f086bfff700 1 -- 172.21.15.72:0/473488146 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400dd30 con 0x7f087409e1d0 2023-10-03T10:15:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.696+0000 7f086bfff700 1 -- 172.21.15.72:0/473488146 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086400de90 con 0x7f087409e1d0 2023-10-03T10:15:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.696+0000 7f086bfff700 1 -- 172.21.15.72:0/473488146 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0864010690 con 0x7f087409e1d0 2023-10-03T10:15:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.697+0000 7f087b49f700 1 -- 172.21.15.72:0/473488146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f087409e1d0 msgr2=0x7f0874135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.697+0000 7f087b49f700 1 --2- 172.21.15.72:0/473488146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f087409e1d0 0x7f0874135910 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f086400bb90 tx=0x7f086400bea0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.697+0000 7f087b49f700 1 -- 172.21.15.72:0/473488146 shutdown_connections 2023-10-03T10:15:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.697+0000 7f087b49f700 1 --2- 172.21.15.72:0/473488146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0874135e50 0x7f0874138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.697+0000 7f087b49f700 1 --2- 172.21.15.72:0/473488146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f087409e1d0 0x7f0874135910 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.697+0000 7f087b49f700 1 -- 172.21.15.72:0/473488146 >> 172.21.15.72:0/473488146 conn(0x7f0874066f50 msgr2=0x7f087409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.697+0000 7f087b49f700 1 -- 172.21.15.72:0/473488146 shutdown_connections 2023-10-03T10:15:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.697+0000 7f087b49f700 1 -- 172.21.15.72:0/473488146 wait complete. 2023-10-03T10:15:47.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.698+0000 7f087b49f700 1 Processor -- start 2023-10-03T10:15:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.698+0000 7f087b49f700 1 -- start start 2023-10-03T10:15:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f087b49f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f087409d6f0 0x7f08741c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f087b49f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f087409e1d0 0x7f08741c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f087b49f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0874135e50 0x7f08741194f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f087b49f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087411d140 con 0x7f087409e1d0 2023-10-03T10:15:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f087b49f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08741baf30 con 0x7f087409d6f0 2023-10-03T10:15:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f087b49f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f087411cd70 con 0x7f0874135e50 2023-10-03T10:15:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f087923b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f087409d6f0 0x7f08741c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f087923b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f087409d6f0 0x7f08741c4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34104/0 (socket says 172.21.15.72:34104) 2023-10-03T10:15:47.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f087923b700 1 -- 172.21.15.72:0/3393511655 learned_addr learned my addr 172.21.15.72:0/3393511655 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f0878a3a700 1 --2- 172.21.15.72:0/3393511655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f087409e1d0 0x7f08741c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f0879a3c700 1 --2- 172.21.15.72:0/3393511655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0874135e50 0x7f08741194f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f087923b700 1 -- 172.21.15.72:0/3393511655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0874135e50 msgr2=0x7f08741194f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f087923b700 1 --2- 172.21.15.72:0/3393511655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0874135e50 0x7f08741194f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f087923b700 1 -- 172.21.15.72:0/3393511655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f087409e1d0 msgr2=0x7f08741c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f087923b700 1 --2- 172.21.15.72:0/3393511655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f087409e1d0 0x7f08741c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.699+0000 7f087923b700 1 -- 172.21.15.72:0/3393511655 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086400b7f0 con 0x7f087409d6f0 2023-10-03T10:15:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.700+0000 7f0878a3a700 1 --2- 172.21.15.72:0/3393511655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f087409e1d0 0x7f08741c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.700+0000 7f087923b700 1 --2- 172.21.15.72:0/3393511655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f087409d6f0 0x7f08741c4410 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f087000c530 tx=0x7f087000c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:47.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.700+0000 7f0869ffb700 1 -- 172.21.15.72:0/3393511655 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087000cea0 con 0x7f087409d6f0 2023-10-03T10:15:47.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.700+0000 7f0869ffb700 1 -- 172.21.15.72:0/3393511655 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870005cb0 con 0x7f087409d6f0 2023-10-03T10:15:47.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.700+0000 7f087b49f700 1 -- 172.21.15.72:0/3393511655 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08741c4e90 con 0x7f087409d6f0 2023-10-03T10:15:47.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.700+0000 7f0869ffb700 1 -- 172.21.15.72:0/3393511655 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08700072d0 con 0x7f087409d6f0 2023-10-03T10:15:47.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.700+0000 7f087b49f700 1 -- 172.21.15.72:0/3393511655 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087409c700 con 0x7f087409d6f0 2023-10-03T10:15:47.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.701+0000 7f0869ffb700 1 -- 172.21.15.72:0/3393511655 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0870007430 con 0x7f087409d6f0 2023-10-03T10:15:47.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.701+0000 7f087b49f700 1 -- 172.21.15.72:0/3393511655 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08741302e0 con 0x7f087409d6f0 2023-10-03T10:15:47.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.701+0000 7f0869ffb700 1 -- 172.21.15.72:0/3393511655 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f087003e960 con 0x7f087409d6f0 2023-10-03T10:15:47.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.710+0000 7f0869ffb700 1 -- 172.21.15.72:0/3393511655 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0870017020 con 0x7f087409d6f0 2023-10-03T10:15:47.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.769+0000 7f022cfbf700 1 -- 172.21.15.72:0/1406907526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f02280008d0 con 0x7f022809e000 2023-10-03T10:15:47.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.770+0000 7f0216ffd700 1 -- 172.21.15.72:0/1406907526 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02180045b0 con 0x7f022809e000 2023-10-03T10:15:47.770 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:47.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.771+0000 7f8019246700 1 Processor -- start 2023-10-03T10:15:47.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.771+0000 7f8019246700 1 -- start start 2023-10-03T10:15:47.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f8019246700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f801409d6f0 0x7f801409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f8019246700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f801409e000 0x7f80141339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f8019246700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801409b120 con 0x7f801409e410 2023-10-03T10:15:47.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f8019246700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801406b460 con 0x7f801409d6f0 2023-10-03T10:15:47.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f8019246700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801409a7e0 con 0x7f801409e000 2023-10-03T10:15:47.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f801259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f801409e000 0x7f80141339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f801259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f801409e000 0x7f80141339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34112/0 (socket says 172.21.15.72:34112) 2023-10-03T10:15:47.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f801359e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f801409e410 0x7f8014133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49612/0 (socket says 172.21.15.72:49612) 2023-10-03T10:15:47.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f801259c700 1 -- 172.21.15.72:0/1845536312 learned_addr learned my addr 172.21.15.72:0/1845536312 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:47.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f8012d9d700 1 --2- 172.21.15.72:0/1845536312 >> v2:172.21.15.72:3300/0 conn(0x7f801409d6f0 0x7f801409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f022cfbf700 1 -- 172.21.15.72:0/1406907526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022809e000 msgr2=0x7f02281a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f022cfbf700 1 --2- 172.21.15.72:0/1406907526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022809e000 0x7f02281a4680 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0218016000 tx=0x7f0218004750 comp rx=0 tx=0).stop 2023-10-03T10:15:47.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f022cfbf700 1 -- 172.21.15.72:0/1406907526 shutdown_connections 2023-10-03T10:15:47.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f022cfbf700 1 --2- 172.21.15.72:0/1406907526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f022809e410 0x7f02281c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f022cfbf700 1 --2- 172.21.15.72:0/1406907526 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f022809d6f0 0x7f02281a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f022cfbf700 1 --2- 172.21.15.72:0/1406907526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022809e000 0x7f02281a4680 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f022cfbf700 1 -- 172.21.15.72:0/1406907526 >> 172.21.15.72:0/1406907526 conn(0x7f0228066f50 msgr2=0x7f02281bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f8012d9d700 1 -- 172.21.15.72:0/1845536312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f801409e000 msgr2=0x7f80141339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:47.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f8012d9d700 1 --2- 172.21.15.72:0/1845536312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f801409e000 0x7f80141339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f8012d9d700 1 -- 172.21.15.72:0/1845536312 >> v1:172.21.15.72:6789/0 conn(0x7f801409e410 legacy=0x7f8014133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.772+0000 7f8012d9d700 1 -- 172.21.15.72:0/1845536312 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801409a500 con 0x7f801409d6f0 2023-10-03T10:15:47.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.773+0000 7f022cfbf700 1 -- 172.21.15.72:0/1406907526 shutdown_connections 2023-10-03T10:15:47.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.773+0000 7f022cfbf700 1 -- 172.21.15.72:0/1406907526 wait complete. 2023-10-03T10:15:47.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.773+0000 7f801259c700 1 --2- 172.21.15.72:0/1845536312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f801409e000 0x7f80141339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.773+0000 7f8012d9d700 1 --2- 172.21.15.72:0/1845536312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f801409d6f0 0x7f801409dac0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f8004009840 tx=0x7f8004009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b964bd1c248f03 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:47.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.773+0000 7f8011d9b700 1 -- 172.21.15.72:0/1845536312 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004011830 con 0x7f801409d6f0 2023-10-03T10:15:47.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.773+0000 7f8011d9b700 1 -- 172.21.15.72:0/1845536312 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8004011990 con 0x7f801409d6f0 2023-10-03T10:15:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.773+0000 7f8011d9b700 1 -- 172.21.15.72:0/1845536312 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004011d20 con 0x7f801409d6f0 2023-10-03T10:15:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.773+0000 7f8019246700 1 -- 172.21.15.72:0/1845536312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f801409d6f0 msgr2=0x7f801409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.773+0000 7f8019246700 1 --2- 172.21.15.72:0/1845536312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f801409d6f0 0x7f801409dac0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f8004009840 tx=0x7f8004009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.774+0000 7f8019246700 1 -- 172.21.15.72:0/1845536312 shutdown_connections 2023-10-03T10:15:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.774+0000 7f8019246700 1 --2- 172.21.15.72:0/1845536312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f801409d6f0 0x7f801409dac0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.774+0000 7f8019246700 1 --2- 172.21.15.72:0/1845536312 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f801409e000 0x7f80141339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.774+0000 7f8019246700 1 -- 172.21.15.72:0/1845536312 >> 172.21.15.72:0/1845536312 conn(0x7f8014066f50 msgr2=0x7f801409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.774+0000 7f8019246700 1 -- 172.21.15.72:0/1845536312 shutdown_connections 2023-10-03T10:15:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.774+0000 7f8019246700 1 -- 172.21.15.72:0/1845536312 wait complete. 2023-10-03T10:15:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.775+0000 7f8019246700 1 Processor -- start 2023-10-03T10:15:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.775+0000 7f8019246700 1 -- start start 2023-10-03T10:15:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.775+0000 7f8019246700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f801409d6f0 0x7f80141a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.775+0000 7f8019246700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f801409e000 0x7f80141a63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.775+0000 7f8019246700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f801409e410 0x7f80141a6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.775+0000 7f8019246700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80141a9130 con 0x7f801409e410 2023-10-03T10:15:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.775+0000 7f8019246700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801409c710 con 0x7f801409e000 2023-10-03T10:15:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.775+0000 7f8019246700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80140a3250 con 0x7f801409d6f0 2023-10-03T10:15:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f8012d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f801409d6f0 0x7f80141a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f801259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f801409e000 0x7f80141a63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f8012d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f801409d6f0 0x7f80141a5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51104/0 (socket says 172.21.15.72:51104) 2023-10-03T10:15:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f8012d9d700 1 -- 172.21.15.72:0/2400374406 learned_addr learned my addr 172.21.15.72:0/2400374406 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f801359e700 1 --2- 172.21.15.72:0/2400374406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f801409e410 0x7f80141a6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f8012d9d700 1 -- 172.21.15.72:0/2400374406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f801409e000 msgr2=0x7f80141a63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f8012d9d700 1 --2- 172.21.15.72:0/2400374406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f801409e000 0x7f80141a63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f8012d9d700 1 -- 172.21.15.72:0/2400374406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f801409e410 msgr2=0x7f80141a6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f8012d9d700 1 --2- 172.21.15.72:0/2400374406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f801409e410 0x7f80141a6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f8012d9d700 1 -- 172.21.15.72:0/2400374406 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8008009550 con 0x7f801409d6f0 2023-10-03T10:15:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f801359e700 1 --2- 172.21.15.72:0/2400374406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f801409e410 0x7f80141a6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f801259c700 1 --2- 172.21.15.72:0/2400374406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f801409e000 0x7f80141a63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f8012d9d700 1 --2- 172.21.15.72:0/2400374406 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f801409d6f0 0x7f80141a5e80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8004009b90 tx=0x7f8004004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f7ffb7fe700 1 -- 172.21.15.72:0/2400374406 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80040036a0 con 0x7f801409d6f0 2023-10-03T10:15:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f7ffb7fe700 1 -- 172.21.15.72:0/2400374406 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800401e070 con 0x7f801409d6f0 2023-10-03T10:15:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f7ffb7fe700 1 -- 172.21.15.72:0/2400374406 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004003a60 con 0x7f801409d6f0 2023-10-03T10:15:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.776+0000 7f8019246700 1 -- 172.21.15.72:0/2400374406 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80040094a0 con 0x7f801409d6f0 2023-10-03T10:15:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.777+0000 7f8019246700 1 -- 172.21.15.72:0/2400374406 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80141a8ce0 con 0x7f801409d6f0 2023-10-03T10:15:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.777+0000 7f7ffb7fe700 1 -- 172.21.15.72:0/2400374406 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8004003bc0 con 0x7f801409d6f0 2023-10-03T10:15:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.778+0000 7f7ffb7fe700 1 -- 172.21.15.72:0/2400374406 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8004040470 con 0x7f801409d6f0 2023-10-03T10:15:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.778+0000 7f8019246700 1 -- 172.21.15.72:0/2400374406 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80141a9540 con 0x7f801409d6f0 2023-10-03T10:15:47.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.783+0000 7f7ffb7fe700 1 -- 172.21.15.72:0/2400374406 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8004015080 con 0x7f801409d6f0 2023-10-03T10:15:47.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:47.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.921+0000 7f087b49f700 1 -- 172.21.15.72:0/3393511655 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0874074ea0 con 0x7f087409d6f0 2023-10-03T10:15:47.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.921+0000 7f0869ffb700 1 -- 172.21.15.72:0/3393511655 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f08700198b0 con 0x7f087409d6f0 2023-10-03T10:15:47.921 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.923+0000 7f087b49f700 1 -- 172.21.15.72:0/3393511655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f087409d6f0 msgr2=0x7f08741c4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.923+0000 7f087b49f700 1 --2- 172.21.15.72:0/3393511655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f087409d6f0 0x7f08741c4410 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f087000c530 tx=0x7f087000c840 comp rx=0 tx=0).stop 2023-10-03T10:15:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.923+0000 7f087b49f700 1 -- 172.21.15.72:0/3393511655 shutdown_connections 2023-10-03T10:15:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.923+0000 7f087b49f700 1 --2- 172.21.15.72:0/3393511655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0874135e50 0x7f08741194f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.923+0000 7f087b49f700 1 --2- 172.21.15.72:0/3393511655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f087409d6f0 0x7f08741c4410 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.923+0000 7f087b49f700 1 --2- 172.21.15.72:0/3393511655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f087409e1d0 0x7f08741c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.923+0000 7f087b49f700 1 -- 172.21.15.72:0/3393511655 >> 172.21.15.72:0/3393511655 conn(0x7f0874066f50 msgr2=0x7f087406f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.923+0000 7f087b49f700 1 -- 172.21.15.72:0/3393511655 shutdown_connections 2023-10-03T10:15:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.923+0000 7f087b49f700 1 -- 172.21.15.72:0/3393511655 wait complete. 2023-10-03T10:15:47.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:47.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.989+0000 7f8019246700 1 -- 172.21.15.72:0/2400374406 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8014074ea0 con 0x7f801409d6f0 2023-10-03T10:15:47.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.989+0000 7f7ffb7fe700 1 -- 172.21.15.72:0/2400374406 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f800402d970 con 0x7f801409d6f0 2023-10-03T10:15:47.989 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:47.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.991+0000 7f8019246700 1 -- 172.21.15.72:0/2400374406 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f801409d6f0 msgr2=0x7f80141a5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.991+0000 7f8019246700 1 --2- 172.21.15.72:0/2400374406 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f801409d6f0 0x7f80141a5e80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8004009b90 tx=0x7f8004004750 comp rx=0 tx=0).stop 2023-10-03T10:15:47.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.991+0000 7f8019246700 1 -- 172.21.15.72:0/2400374406 shutdown_connections 2023-10-03T10:15:47.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.991+0000 7f8019246700 1 --2- 172.21.15.72:0/2400374406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f801409e410 0x7f80141a6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.991+0000 7f8019246700 1 --2- 172.21.15.72:0/2400374406 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f801409d6f0 0x7f80141a5e80 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.991+0000 7f8019246700 1 --2- 172.21.15.72:0/2400374406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f801409e000 0x7f80141a63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.991+0000 7f8019246700 1 -- 172.21.15.72:0/2400374406 >> 172.21.15.72:0/2400374406 conn(0x7f8014066f50 msgr2=0x7f80141bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.991+0000 7f8019246700 1 -- 172.21.15.72:0/2400374406 shutdown_connections 2023-10-03T10:15:47.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:47.991+0000 7f8019246700 1 -- 172.21.15.72:0/2400374406 wait complete. 2023-10-03T10:15:48.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:48.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:48.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.273+0000 7fb503776700 1 Processor -- start 2023-10-03T10:15:48.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.273+0000 7fb503776700 1 -- start start 2023-10-03T10:15:48.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.274+0000 7fb503776700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb4fc09e1d0 0x7fb4fc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.274+0000 7fb503776700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4fc139170 0x7fb4fc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.274+0000 7fb503776700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc09b120 con 0x7fb4fc09d6f0 2023-10-03T10:15:48.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.274+0000 7fb503776700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4fc06b460 con 0x7fb4fc09e1d0 2023-10-03T10:15:48.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.274+0000 7fb503776700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc09a7e0 con 0x7fb4fc139170 2023-10-03T10:15:48.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.274+0000 7fb500d11700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb4fc09e1d0 0x7fb4fc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.274+0000 7fb501d13700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4fc139170 0x7fb4fc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.274+0000 7fb500d11700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb4fc09e1d0 0x7fb4fc138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46280/0 (socket says 172.21.15.72:46280) 2023-10-03T10:15:48.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.274+0000 7fb501d13700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4fc139170 0x7fb4fc13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36380/0 (socket says 172.21.15.72:36380) 2023-10-03T10:15:48.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.274+0000 7fb500d11700 1 -- 172.21.15.72:0/1597694750 learned_addr learned my addr 172.21.15.72:0/1597694750 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:48.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.274+0000 7fb501d13700 1 -- 172.21.15.72:0/1597694750 >> v2:172.21.15.72:3300/0 conn(0x7fb4fc09e1d0 msgr2=0x7fb4fc138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.274+0000 7fb501d13700 1 --2- 172.21.15.72:0/1597694750 >> v2:172.21.15.72:3300/0 conn(0x7fb4fc09e1d0 0x7fb4fc138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.274+0000 7fb501d13700 1 -- 172.21.15.72:0/1597694750 >> v1:172.21.15.72:6789/0 conn(0x7fb4fc09d6f0 legacy=0x7fb4fc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.274+0000 7fb501d13700 1 -- 172.21.15.72:0/1597694750 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc09a500 con 0x7fb4fc139170 2023-10-03T10:15:48.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.274+0000 7fb500d11700 1 --2- 172.21.15.72:0/1597694750 >> v2:172.21.15.72:3300/0 conn(0x7fb4fc09e1d0 0x7fb4fc138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.275+0000 7fb501d13700 1 --2- 172.21.15.72:0/1597694750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4fc139170 0x7fb4fc13b550 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009dc0 tx=0x7fb4f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50b6d5a4642e4871 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.275+0000 7fb4f3fff700 1 -- 172.21.15.72:0/1597694750 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400e070 con 0x7fb4fc139170 2023-10-03T10:15:48.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.275+0000 7fb4f3fff700 1 -- 172.21.15.72:0/1597694750 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f400bae0 con 0x7fb4fc139170 2023-10-03T10:15:48.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.275+0000 7fb4f3fff700 1 -- 172.21.15.72:0/1597694750 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400be90 con 0x7fb4fc139170 2023-10-03T10:15:48.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.275+0000 7fb503776700 1 -- 172.21.15.72:0/1597694750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4fc139170 msgr2=0x7fb4fc13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.275+0000 7fb503776700 1 --2- 172.21.15.72:0/1597694750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4fc139170 0x7fb4fc13b550 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009dc0 tx=0x7fb4f400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:48.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.275+0000 7fb503776700 1 -- 172.21.15.72:0/1597694750 shutdown_connections 2023-10-03T10:15:48.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.275+0000 7fb503776700 1 --2- 172.21.15.72:0/1597694750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4fc139170 0x7fb4fc13b550 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.275+0000 7fb503776700 1 --2- 172.21.15.72:0/1597694750 >> v2:172.21.15.72:3300/0 conn(0x7fb4fc09e1d0 0x7fb4fc138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.275+0000 7fb503776700 1 -- 172.21.15.72:0/1597694750 >> 172.21.15.72:0/1597694750 conn(0x7fb4fc066f50 msgr2=0x7fb4fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.275+0000 7fb503776700 1 -- 172.21.15.72:0/1597694750 shutdown_connections 2023-10-03T10:15:48.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.275+0000 7fb503776700 1 -- 172.21.15.72:0/1597694750 wait complete. 2023-10-03T10:15:48.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.276+0000 7fb503776700 1 Processor -- start 2023-10-03T10:15:48.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.276+0000 7fb503776700 1 -- start start 2023-10-03T10:15:48.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb503776700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4fc09d6f0 0x7fb4fc11e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb503776700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4fc09e1d0 0x7fb4fc11ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb503776700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4fc139170 0x7fb4fc11f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb503776700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc121e90 con 0x7fb4fc139170 2023-10-03T10:15:48.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb503776700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc09c710 con 0x7fb4fc09d6f0 2023-10-03T10:15:48.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb503776700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc120550 con 0x7fb4fc09e1d0 2023-10-03T10:15:48.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb500d11700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4fc09e1d0 0x7fb4fc11ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb501d13700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4fc139170 0x7fb4fc11f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb500d11700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4fc09e1d0 0x7fb4fc11ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36382/0 (socket says 172.21.15.72:36382) 2023-10-03T10:15:48.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb501d13700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4fc139170 0x7fb4fc11f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46286/0 (socket says 172.21.15.72:46286) 2023-10-03T10:15:48.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb500d11700 1 -- 172.21.15.72:0/2263073695 learned_addr learned my addr 172.21.15.72:0/2263073695 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:48.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb501512700 1 --2- 172.21.15.72:0/2263073695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4fc09d6f0 0x7fb4fc11e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb501d13700 1 -- 172.21.15.72:0/2263073695 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4fc09e1d0 msgr2=0x7fb4fc11ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb501d13700 1 --2- 172.21.15.72:0/2263073695 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4fc09e1d0 0x7fb4fc11ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb501d13700 1 -- 172.21.15.72:0/2263073695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4fc09d6f0 msgr2=0x7fb4fc11e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb501d13700 1 --2- 172.21.15.72:0/2263073695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4fc09d6f0 0x7fb4fc11e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb501d13700 1 -- 172.21.15.72:0/2263073695 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f8009550 con 0x7fb4fc139170 2023-10-03T10:15:48.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb500d11700 1 --2- 172.21.15.72:0/2263073695 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4fc09e1d0 0x7fb4fc11ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb501d13700 1 --2- 172.21.15.72:0/2263073695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4fc139170 0x7fb4fc11f340 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc06b640 tx=0x7fb4f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb4f1ffb700 1 -- 172.21.15.72:0/2263073695 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40045d0 con 0x7fb4fc139170 2023-10-03T10:15:48.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb4f1ffb700 1 -- 172.21.15.72:0/2263073695 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f4020070 con 0x7fb4fc139170 2023-10-03T10:15:48.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb503776700 1 -- 172.21.15.72:0/2263073695 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f4009a70 con 0x7fb4fc139170 2023-10-03T10:15:48.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.277+0000 7fb4f1ffb700 1 -- 172.21.15.72:0/2263073695 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4027480 con 0x7fb4fc139170 2023-10-03T10:15:48.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.278+0000 7fb503776700 1 -- 172.21.15.72:0/2263073695 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4fc122070 con 0x7fb4fc139170 2023-10-03T10:15:48.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.279+0000 7fb503776700 1 -- 172.21.15.72:0/2263073695 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4fc121cc0 con 0x7fb4fc139170 2023-10-03T10:15:48.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.279+0000 7fb4f1ffb700 1 -- 172.21.15.72:0/2263073695 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4f4012430 con 0x7fb4fc139170 2023-10-03T10:15:48.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.279+0000 7fb4f1ffb700 1 -- 172.21.15.72:0/2263073695 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb4f4022070 con 0x7fb4fc139170 2023-10-03T10:15:48.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.283+0000 7fb4f1ffb700 1 -- 172.21.15.72:0/2263073695 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4f4011750 con 0x7fb4fc139170 2023-10-03T10:15:48.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.466+0000 7fb503776700 1 -- 172.21.15.72:0/2263073695 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb4fc09f420 con 0x7fb4fc139170 2023-10-03T10:15:48.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.466+0000 7fb4f1ffb700 1 -- 172.21.15.72:0/2263073695 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb4f4035070 con 0x7fb4fc139170 2023-10-03T10:15:48.466 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:48.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.468+0000 7fb503776700 1 -- 172.21.15.72:0/2263073695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4fc139170 msgr2=0x7fb4fc11f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.468+0000 7fb503776700 1 --2- 172.21.15.72:0/2263073695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4fc139170 0x7fb4fc11f340 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc06b640 tx=0x7fb4f4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.468+0000 7fb503776700 1 -- 172.21.15.72:0/2263073695 shutdown_connections 2023-10-03T10:15:48.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.468+0000 7fb503776700 1 --2- 172.21.15.72:0/2263073695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4fc139170 0x7fb4fc11f340 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.468+0000 7fb503776700 1 --2- 172.21.15.72:0/2263073695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4fc09d6f0 0x7fb4fc11e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.468+0000 7fb503776700 1 --2- 172.21.15.72:0/2263073695 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb4fc09e1d0 0x7fb4fc11ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.468+0000 7fb503776700 1 -- 172.21.15.72:0/2263073695 >> 172.21.15.72:0/2263073695 conn(0x7fb4fc066f50 msgr2=0x7fb4fc09b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.468+0000 7fb503776700 1 -- 172.21.15.72:0/2263073695 shutdown_connections 2023-10-03T10:15:48.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.468+0000 7fb503776700 1 -- 172.21.15.72:0/2263073695 wait complete. 2023-10-03T10:15:48.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:48.787 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:48.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.911+0000 7f5f90bcc700 1 Processor -- start 2023-10-03T10:15:48.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.911+0000 7f5f90bcc700 1 -- start start 2023-10-03T10:15:48.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f90bcc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0a0a30 0x7f5f8c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f90bcc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5f8c138d80 0x7f5f8c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f90bcc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8c0a2a70 con 0x7f5f8c09d630 2023-10-03T10:15:48.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f90bcc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8c0a01d0 con 0x7f5f8c138d80 2023-10-03T10:15:48.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f90bcc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c09e2b0 con 0x7f5f8c0a0a30 2023-10-03T10:15:48.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f8ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5f8c138d80 0x7f5f8c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f8a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0a0a30 0x7f5f8c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f8ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5f8c138d80 0x7f5f8c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46302/0 (socket says 172.21.15.72:46302) 2023-10-03T10:15:48.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f8ad9d700 1 -- 172.21.15.72:0/1281620902 learned_addr learned my addr 172.21.15.72:0/1281620902 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:48.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f8a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0a0a30 0x7f5f8c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36394/0 (socket says 172.21.15.72:36394) 2023-10-03T10:15:48.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f8a59c700 1 -- 172.21.15.72:0/1281620902 >> v2:172.21.15.72:3300/0 conn(0x7f5f8c138d80 msgr2=0x7f5f8c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f8a59c700 1 --2- 172.21.15.72:0/1281620902 >> v2:172.21.15.72:3300/0 conn(0x7f5f8c138d80 0x7f5f8c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f8a59c700 1 -- 172.21.15.72:0/1281620902 >> v1:172.21.15.72:6789/0 conn(0x7f5f8c09d630 legacy=0x7f5f8c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f8a59c700 1 -- 172.21.15.72:0/1281620902 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8c09dc50 con 0x7f5f8c0a0a30 2023-10-03T10:15:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f8ad9d700 1 --2- 172.21.15.72:0/1281620902 >> v2:172.21.15.72:3300/0 conn(0x7f5f8c138d80 0x7f5f8c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.912+0000 7f5f8a59c700 1 --2- 172.21.15.72:0/1281620902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0a0a30 0x7f5f8c0a0e00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009840 tx=0x7f5f80009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfa3b196c9350020 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.913+0000 7f5f8959a700 1 -- 172.21.15.72:0/1281620902 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80011830 con 0x7f5f8c0a0a30 2023-10-03T10:15:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.913+0000 7f5f8959a700 1 -- 172.21.15.72:0/1281620902 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f80011990 con 0x7f5f8c0a0a30 2023-10-03T10:15:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.913+0000 7f5f8959a700 1 -- 172.21.15.72:0/1281620902 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80011d20 con 0x7f5f8c0a0a30 2023-10-03T10:15:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.913+0000 7f5f90bcc700 1 -- 172.21.15.72:0/1281620902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0a0a30 msgr2=0x7f5f8c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.913+0000 7f5f90bcc700 1 --2- 172.21.15.72:0/1281620902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0a0a30 0x7f5f8c0a0e00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009840 tx=0x7f5f80009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.913+0000 7f5f90bcc700 1 -- 172.21.15.72:0/1281620902 shutdown_connections 2023-10-03T10:15:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.913+0000 7f5f90bcc700 1 --2- 172.21.15.72:0/1281620902 >> v2:172.21.15.72:3300/0 conn(0x7f5f8c138d80 0x7f5f8c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.913+0000 7f5f90bcc700 1 --2- 172.21.15.72:0/1281620902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c0a0a30 0x7f5f8c0a0e00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.913+0000 7f5f90bcc700 1 -- 172.21.15.72:0/1281620902 >> 172.21.15.72:0/1281620902 conn(0x7f5f8c0a3050 msgr2=0x7f5f8c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.913+0000 7f5f90bcc700 1 -- 172.21.15.72:0/1281620902 shutdown_connections 2023-10-03T10:15:48.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.913+0000 7f5f90bcc700 1 -- 172.21.15.72:0/1281620902 wait complete. 2023-10-03T10:15:48.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.914+0000 7f5f90bcc700 1 Processor -- start 2023-10-03T10:15:48.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.914+0000 7f5f90bcc700 1 -- start start 2023-10-03T10:15:48.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f90bcc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c09d630 0x7f5f8c1208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f90bcc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8c0a0a30 0x7f5f8c120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f90bcc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c138d80 0x7f5f8c121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f90bcc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c122470 con 0x7f5f8c0a0a30 2023-10-03T10:15:48.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f90bcc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c1237c0 con 0x7f5f8c09d630 2023-10-03T10:15:48.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f90bcc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c121d50 con 0x7f5f8c138d80 2023-10-03T10:15:48.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f89d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8c0a0a30 0x7f5f8c120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f8a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c09d630 0x7f5f8c1208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f8a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c09d630 0x7f5f8c1208f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40858/0 (socket says 172.21.15.72:40858) 2023-10-03T10:15:48.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f89d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8c0a0a30 0x7f5f8c120e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46318/0 (socket says 172.21.15.72:46318) 2023-10-03T10:15:48.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f8a59c700 1 -- 172.21.15.72:0/592577850 learned_addr learned my addr 172.21.15.72:0/592577850 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:48.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f8ad9d700 1 --2- 172.21.15.72:0/592577850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c138d80 0x7f5f8c121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f8a59c700 1 -- 172.21.15.72:0/592577850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c138d80 msgr2=0x7f5f8c121370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f8a59c700 1 --2- 172.21.15.72:0/592577850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c138d80 0x7f5f8c121370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f8a59c700 1 -- 172.21.15.72:0/592577850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8c0a0a30 msgr2=0x7f5f8c120e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f8a59c700 1 --2- 172.21.15.72:0/592577850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8c0a0a30 0x7f5f8c120e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f8a59c700 1 -- 172.21.15.72:0/592577850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f84009b30 con 0x7f5f8c09d630 2023-10-03T10:15:48.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f89d9b700 1 --2- 172.21.15.72:0/592577850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8c0a0a30 0x7f5f8c120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f8a59c700 1 --2- 172.21.15.72:0/592577850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c09d630 0x7f5f8c1208f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009fd0 tx=0x7f5f80004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f7affd700 1 -- 172.21.15.72:0/592577850 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f800036a0 con 0x7f5f8c09d630 2023-10-03T10:15:48.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f7affd700 1 -- 172.21.15.72:0/592577850 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8001f070 con 0x7f5f8c09d630 2023-10-03T10:15:48.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.915+0000 7f5f90bcc700 1 -- 172.21.15.72:0/592577850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f800094a0 con 0x7f5f8c09d630 2023-10-03T10:15:48.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.916+0000 7f5f7affd700 1 -- 172.21.15.72:0/592577850 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f80003a60 con 0x7f5f8c09d630 2023-10-03T10:15:48.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.916+0000 7f5f90bcc700 1 -- 172.21.15.72:0/592577850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8c0a0410 con 0x7f5f8c09d630 2023-10-03T10:15:48.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.916+0000 7f5f7affd700 1 -- 172.21.15.72:0/592577850 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f80003bc0 con 0x7f5f8c09d630 2023-10-03T10:15:48.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.916+0000 7f5f7affd700 1 -- 172.21.15.72:0/592577850 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5f80021070 con 0x7f5f8c09d630 2023-10-03T10:15:48.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.916+0000 7f5f90bcc700 1 -- 172.21.15.72:0/592577850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8c123cc0 con 0x7f5f8c09d630 2023-10-03T10:15:48.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:48.921+0000 7f5f7affd700 1 -- 172.21.15.72:0/592577850 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f8002b020 con 0x7f5f8c09d630 2023-10-03T10:15:48.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:49.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.063+0000 7fb1e9e04700 1 Processor -- start 2023-10-03T10:15:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.063+0000 7fb1e9e04700 1 -- start start 2023-10-03T10:15:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.063+0000 7fb1e9e04700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1e40a0a30 0x7fb1e40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.063+0000 7fb1e9e04700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1e409d630 0x7fb1e40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.063+0000 7fb1e9e04700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb1e4133930 0x7fb1e4133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.063+0000 7fb1e9e04700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e40a2a70 con 0x7fb1e4133930 2023-10-03T10:15:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.063+0000 7fb1e9e04700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40a01d0 con 0x7fb1e409d630 2023-10-03T10:15:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.063+0000 7fb1e9e04700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e409e2b0 con 0x7fb1e40a0a30 2023-10-03T10:15:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.063+0000 7fb1e37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1e40a0a30 0x7fb1e40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.063+0000 7fb1e37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1e40a0a30 0x7fb1e40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36416/0 (socket says 172.21.15.72:36416) 2023-10-03T10:15:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.063+0000 7fb1e3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb1e4133930 0x7fb1e4133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.063+0000 7fb1e2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1e409d630 0x7fb1e40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.063+0000 7fb1e37fe700 1 -- 172.21.15.72:0/4279505171 learned_addr learned my addr 172.21.15.72:0/4279505171 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.064+0000 7fb1e3fff700 1 -- 172.21.15.72:0/4279505171 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1e40a0a30 msgr2=0x7fb1e40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.064+0000 7fb1e3fff700 1 --2- 172.21.15.72:0/4279505171 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1e40a0a30 0x7fb1e40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.064+0000 7fb1e3fff700 1 -- 172.21.15.72:0/4279505171 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1e409d630 msgr2=0x7fb1e40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.064+0000 7fb1e3fff700 1 --2- 172.21.15.72:0/4279505171 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1e409d630 0x7fb1e40a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.064+0000 7fb1e3fff700 1 -- 172.21.15.72:0/4279505171 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e409dc50 con 0x7fb1e4133930 2023-10-03T10:15:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.064+0000 7fb1e37fe700 1 --2- 172.21.15.72:0/4279505171 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1e40a0a30 0x7fb1e40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.064+0000 7fb1e3fff700 1 --2- 172.21.15.72:0/4279505171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e4133930 0x7fb1e4133dd0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009d90 tx=0x7fb1dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1dbb9b0198c24a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.064+0000 7fb1e27fc700 1 -- 172.21.15.72:0/4279505171 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc00e070 con 0x7fb1e4133930 2023-10-03T10:15:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.064+0000 7fb1e27fc700 1 -- 172.21.15.72:0/4279505171 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc00bb20 con 0x7fb1e4133930 2023-10-03T10:15:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.064+0000 7fb1e27fc700 1 -- 172.21.15.72:0/4279505171 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc012430 con 0x7fb1e4133930 2023-10-03T10:15:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.065+0000 7fb1e2ffd700 1 --2- 172.21.15.72:0/4279505171 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1e409d630 0x7fb1e40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.065+0000 7fb1e9e04700 1 -- 172.21.15.72:0/4279505171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e4133930 msgr2=0x7fb1e4133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.065+0000 7fb1e9e04700 1 --2- 172.21.15.72:0/4279505171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e4133930 0x7fb1e4133dd0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009d90 tx=0x7fb1dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:49.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.065+0000 7fb1e9e04700 1 -- 172.21.15.72:0/4279505171 shutdown_connections 2023-10-03T10:15:49.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.065+0000 7fb1e9e04700 1 --2- 172.21.15.72:0/4279505171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e4133930 0x7fb1e4133dd0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.065+0000 7fb1e9e04700 1 --2- 172.21.15.72:0/4279505171 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1e40a0a30 0x7fb1e40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.065+0000 7fb1e9e04700 1 --2- 172.21.15.72:0/4279505171 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1e409d630 0x7fb1e40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.065+0000 7fb1e9e04700 1 -- 172.21.15.72:0/4279505171 >> 172.21.15.72:0/4279505171 conn(0x7fb1e40a3050 msgr2=0x7fb1e40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.065+0000 7fb1e9e04700 1 -- 172.21.15.72:0/4279505171 shutdown_connections 2023-10-03T10:15:49.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.065+0000 7fb1e9e04700 1 -- 172.21.15.72:0/4279505171 wait complete. 2023-10-03T10:15:49.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.066+0000 7fb1e9e04700 1 Processor -- start 2023-10-03T10:15:49.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.066+0000 7fb1e9e04700 1 -- start start 2023-10-03T10:15:49.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.066+0000 7fb1e9e04700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1e409d630 0x7fb1e41c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.066+0000 7fb1e9e04700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e40a0a30 0x7fb1e41c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.066+0000 7fb1e9e04700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1e4133930 0x7fb1e41c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.066+0000 7fb1e9e04700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40a0410 con 0x7fb1e40a0a30 2023-10-03T10:15:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.066+0000 7fb1e9e04700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e4122290 con 0x7fb1e409d630 2023-10-03T10:15:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.066+0000 7fb1e9e04700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e4120580 con 0x7fb1e4133930 2023-10-03T10:15:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.066+0000 7fb1e37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1e409d630 0x7fb1e41c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.066+0000 7fb1e37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1e409d630 0x7fb1e41c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40878/0 (socket says 172.21.15.72:40878) 2023-10-03T10:15:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.066+0000 7fb1e37fe700 1 -- 172.21.15.72:0/973356149 learned_addr learned my addr 172.21.15.72:0/973356149 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.066+0000 7fb1e2ffd700 1 --2- 172.21.15.72:0/973356149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e40a0a30 0x7fb1e41c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.066+0000 7fb1e3fff700 1 --2- 172.21.15.72:0/973356149 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1e4133930 0x7fb1e41c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.067+0000 7fb1e37fe700 1 -- 172.21.15.72:0/973356149 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1e4133930 msgr2=0x7fb1e41c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.067+0000 7fb1e37fe700 1 --2- 172.21.15.72:0/973356149 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1e4133930 0x7fb1e41c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.067+0000 7fb1e37fe700 1 -- 172.21.15.72:0/973356149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e40a0a30 msgr2=0x7fb1e41c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.067+0000 7fb1e37fe700 1 --2- 172.21.15.72:0/973356149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e40a0a30 0x7fb1e41c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.067+0000 7fb1e37fe700 1 -- 172.21.15.72:0/973356149 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d4009550 con 0x7fb1e409d630 2023-10-03T10:15:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.067+0000 7fb1e37fe700 1 --2- 172.21.15.72:0/973356149 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1e409d630 0x7fb1e41c7ef0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400ebe0 tx=0x7fb1d400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.067+0000 7fb1cbfff700 1 -- 172.21.15.72:0/973356149 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400c850 con 0x7fb1e409d630 2023-10-03T10:15:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.067+0000 7fb1cbfff700 1 -- 172.21.15.72:0/973356149 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d400c9b0 con 0x7fb1e409d630 2023-10-03T10:15:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.067+0000 7fb1e9e04700 1 -- 172.21.15.72:0/973356149 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1dc009a70 con 0x7fb1e409d630 2023-10-03T10:15:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.067+0000 7fb1cbfff700 1 -- 172.21.15.72:0/973356149 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400cd40 con 0x7fb1e409d630 2023-10-03T10:15:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.067+0000 7fb1e9e04700 1 -- 172.21.15.72:0/973356149 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e4120d70 con 0x7fb1e409d630 2023-10-03T10:15:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.068+0000 7fb1cbfff700 1 -- 172.21.15.72:0/973356149 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1d4013470 con 0x7fb1e409d630 2023-10-03T10:15:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.068+0000 7fb1cbfff700 1 -- 172.21.15.72:0/973356149 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb1d403f760 con 0x7fb1e409d630 2023-10-03T10:15:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.069+0000 7fb1e9e04700 1 -- 172.21.15.72:0/973356149 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e40747f0 con 0x7fb1e409d630 2023-10-03T10:15:49.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.073+0000 7fb1cbfff700 1 -- 172.21.15.72:0/973356149 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1d4017080 con 0x7fb1e409d630 2023-10-03T10:15:49.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.124+0000 7f5f90bcc700 1 -- 172.21.15.72:0/592577850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5f8c0747f0 con 0x7f5f8c09d630 2023-10-03T10:15:49.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.125+0000 7f5f7affd700 1 -- 172.21.15.72:0/592577850 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f80015070 con 0x7f5f8c09d630 2023-10-03T10:15:49.124 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:49.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.127+0000 7f5f90bcc700 1 -- 172.21.15.72:0/592577850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c09d630 msgr2=0x7f5f8c1208f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.127+0000 7f5f90bcc700 1 --2- 172.21.15.72:0/592577850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c09d630 0x7f5f8c1208f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009fd0 tx=0x7f5f80004750 comp rx=0 tx=0).stop 2023-10-03T10:15:49.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.127+0000 7f5f90bcc700 1 -- 172.21.15.72:0/592577850 shutdown_connections 2023-10-03T10:15:49.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.127+0000 7f5f90bcc700 1 --2- 172.21.15.72:0/592577850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f8c138d80 0x7f5f8c121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.127+0000 7f5f90bcc700 1 --2- 172.21.15.72:0/592577850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f8c09d630 0x7f5f8c1208f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.127+0000 7f5f90bcc700 1 --2- 172.21.15.72:0/592577850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f8c0a0a30 0x7f5f8c120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.127+0000 7f5f90bcc700 1 -- 172.21.15.72:0/592577850 >> 172.21.15.72:0/592577850 conn(0x7f5f8c0a3050 msgr2=0x7f5f8c139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.127+0000 7f5f90bcc700 1 -- 172.21.15.72:0/592577850 shutdown_connections 2023-10-03T10:15:49.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.127+0000 7f5f90bcc700 1 -- 172.21.15.72:0/592577850 wait complete. 2023-10-03T10:15:49.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.133+0000 7f17591b2700 1 Processor -- start 2023-10-03T10:15:49.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.133+0000 7f17591b2700 1 -- start start 2023-10-03T10:15:49.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.133+0000 7f17591b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1754133420 0x7f17541337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.133+0000 7f17591b2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1754133e30 0x7f175412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.133+0000 7f17591b2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1754134260 0x7f17541304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.133+0000 7f17591b2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175406b990 con 0x7f1754134260 2023-10-03T10:15:49.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.133+0000 7f17591b2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17540a0590 con 0x7f1754133420 2023-10-03T10:15:49.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.133+0000 7f17591b2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f175409fb80 con 0x7f1754133e30 2023-10-03T10:15:49.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.133+0000 7f175359e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1754134260 0x7f17541304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.133+0000 7f175359e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1754134260 0x7f17541304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46356/0 (socket says 172.21.15.72:46356) 2023-10-03T10:15:49.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.133+0000 7f175359e700 1 -- 172.21.15.72:0/3463326185 learned_addr learned my addr 172.21.15.72:0/3463326185 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:49.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.133+0000 7f1752d9d700 1 --2- 172.21.15.72:0/3463326185 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1754133420 0x7f17541337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.133+0000 7f175259c700 1 --2- 172.21.15.72:0/3463326185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1754133e30 0x7f175412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.134+0000 7f175259c700 1 -- 172.21.15.72:0/3463326185 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1754133420 msgr2=0x7f17541337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.134+0000 7f175259c700 1 --2- 172.21.15.72:0/3463326185 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1754133420 0x7f17541337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.134+0000 7f175259c700 1 -- 172.21.15.72:0/3463326185 >> v2:172.21.15.72:3300/0 conn(0x7f1754134260 msgr2=0x7f17541304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.134+0000 7f175259c700 1 --2- 172.21.15.72:0/3463326185 >> v2:172.21.15.72:3300/0 conn(0x7f1754134260 0x7f17541304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.134+0000 7f175259c700 1 -- 172.21.15.72:0/3463326185 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17540a0030 con 0x7f1754133e30 2023-10-03T10:15:49.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.134+0000 7f175359e700 1 --2- 172.21.15.72:0/3463326185 >> v2:172.21.15.72:3300/0 conn(0x7f1754134260 0x7f17541304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.134+0000 7f175259c700 1 --2- 172.21.15.72:0/3463326185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1754133e30 0x7f175412ff90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1748009840 tx=0x7f1748009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1ea365a67871b69 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.134+0000 7f1751d9b700 1 -- 172.21.15.72:0/3463326185 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748011830 con 0x7f1754133e30 2023-10-03T10:15:49.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.134+0000 7f1751d9b700 1 -- 172.21.15.72:0/3463326185 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1748011990 con 0x7f1754133e30 2023-10-03T10:15:49.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.134+0000 7f1751d9b700 1 -- 172.21.15.72:0/3463326185 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748011d20 con 0x7f1754133e30 2023-10-03T10:15:49.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.135+0000 7f17591b2700 1 -- 172.21.15.72:0/3463326185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1754133e30 msgr2=0x7f175412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.135+0000 7f17591b2700 1 --2- 172.21.15.72:0/3463326185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1754133e30 0x7f175412ff90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1748009840 tx=0x7f1748009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:49.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.135+0000 7f17591b2700 1 -- 172.21.15.72:0/3463326185 shutdown_connections 2023-10-03T10:15:49.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.135+0000 7f17591b2700 1 --2- 172.21.15.72:0/3463326185 >> v2:172.21.15.72:3300/0 conn(0x7f1754134260 0x7f17541304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.135+0000 7f17591b2700 1 --2- 172.21.15.72:0/3463326185 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1754133420 0x7f17541337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.135+0000 7f17591b2700 1 --2- 172.21.15.72:0/3463326185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1754133e30 0x7f175412ff90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.135+0000 7f17591b2700 1 -- 172.21.15.72:0/3463326185 >> 172.21.15.72:0/3463326185 conn(0x7f17540a4210 msgr2=0x7f17540a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.135+0000 7f17591b2700 1 -- 172.21.15.72:0/3463326185 shutdown_connections 2023-10-03T10:15:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.135+0000 7f17591b2700 1 -- 172.21.15.72:0/3463326185 wait complete. 2023-10-03T10:15:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.136+0000 7f17591b2700 1 Processor -- start 2023-10-03T10:15:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.136+0000 7f17591b2700 1 -- start start 2023-10-03T10:15:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f17591b2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1754133420 0x7f175409be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f17591b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1754133e30 0x7f175409c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f17591b2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1754134260 0x7f175409c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f17591b2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175411ac40 con 0x7f1754134260 2023-10-03T10:15:49.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f17591b2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175412dbf0 con 0x7f1754133e30 2023-10-03T10:15:49.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f17591b2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f175412d5d0 con 0x7f1754133420 2023-10-03T10:15:49.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f1752d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1754133420 0x7f175409be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f1752d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1754133420 0x7f175409be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36440/0 (socket says 172.21.15.72:36440) 2023-10-03T10:15:49.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f1752d9d700 1 -- 172.21.15.72:0/654866008 learned_addr learned my addr 172.21.15.72:0/654866008 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:49.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f175359e700 1 --2- 172.21.15.72:0/654866008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1754134260 0x7f175409c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f175259c700 1 --2- 172.21.15.72:0/654866008 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1754133e30 0x7f175409c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f1752d9d700 1 -- 172.21.15.72:0/654866008 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1754133e30 msgr2=0x7f175409c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f1752d9d700 1 --2- 172.21.15.72:0/654866008 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1754133e30 0x7f175409c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f1752d9d700 1 -- 172.21.15.72:0/654866008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1754134260 msgr2=0x7f175409c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f1752d9d700 1 --2- 172.21.15.72:0/654866008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1754134260 0x7f175409c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f1752d9d700 1 -- 172.21.15.72:0/654866008 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c009b30 con 0x7f1754133420 2023-10-03T10:15:49.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f175359e700 1 --2- 172.21.15.72:0/654866008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1754134260 0x7f175409c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f1752d9d700 1 --2- 172.21.15.72:0/654866008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1754133420 0x7f175409be50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1744014360 tx=0x7f1744014670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.137+0000 7f173b7fe700 1 -- 172.21.15.72:0/654866008 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744016050 con 0x7f1754133420 2023-10-03T10:15:49.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.138+0000 7f173b7fe700 1 -- 172.21.15.72:0/654866008 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1744017040 con 0x7f1754133420 2023-10-03T10:15:49.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.138+0000 7f17591b2700 1 -- 172.21.15.72:0/654866008 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17480094a0 con 0x7f1754133420 2023-10-03T10:15:49.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.138+0000 7f173b7fe700 1 -- 172.21.15.72:0/654866008 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17440112d0 con 0x7f1754133420 2023-10-03T10:15:49.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.138+0000 7f17591b2700 1 -- 172.21.15.72:0/654866008 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175411a730 con 0x7f1754133420 2023-10-03T10:15:49.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.139+0000 7f17591b2700 1 -- 172.21.15.72:0/654866008 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1754074ea0 con 0x7f1754133420 2023-10-03T10:15:49.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.139+0000 7f173b7fe700 1 -- 172.21.15.72:0/654866008 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1744011430 con 0x7f1754133420 2023-10-03T10:15:49.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.139+0000 7f173b7fe700 1 -- 172.21.15.72:0/654866008 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1744048040 con 0x7f1754133420 2023-10-03T10:15:49.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:49.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.145+0000 7f173b7fe700 1 -- 172.21.15.72:0/654866008 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f174400f850 con 0x7f1754133420 2023-10-03T10:15:49.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.267+0000 7fb1e9e04700 1 -- 172.21.15.72:0/973356149 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb1e41211f0 con 0x7fb1e409d630 2023-10-03T10:15:49.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.268+0000 7fb1cbfff700 1 -- 172.21.15.72:0/973356149 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb1d4021020 con 0x7fb1e409d630 2023-10-03T10:15:49.267 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:49.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.270+0000 7fb1e9e04700 1 -- 172.21.15.72:0/973356149 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1e409d630 msgr2=0x7fb1e41c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.270+0000 7fb1e9e04700 1 --2- 172.21.15.72:0/973356149 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1e409d630 0x7fb1e41c7ef0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400ebe0 tx=0x7fb1d400eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.270+0000 7fb1e9e04700 1 -- 172.21.15.72:0/973356149 shutdown_connections 2023-10-03T10:15:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.270+0000 7fb1e9e04700 1 --2- 172.21.15.72:0/973356149 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb1e4133930 0x7fb1e41c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.270+0000 7fb1e9e04700 1 --2- 172.21.15.72:0/973356149 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1e409d630 0x7fb1e41c7ef0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.270+0000 7fb1e9e04700 1 --2- 172.21.15.72:0/973356149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e40a0a30 0x7fb1e41c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.270+0000 7fb1e9e04700 1 -- 172.21.15.72:0/973356149 >> 172.21.15.72:0/973356149 conn(0x7fb1e40a3050 msgr2=0x7fb1e40a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.270+0000 7fb1e9e04700 1 -- 172.21.15.72:0/973356149 shutdown_connections 2023-10-03T10:15:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.270+0000 7fb1e9e04700 1 -- 172.21.15.72:0/973356149 wait complete. 2023-10-03T10:15:49.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:49.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.335+0000 7f17591b2700 1 -- 172.21.15.72:0/654866008 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f175406b250 con 0x7f1754133420 2023-10-03T10:15:49.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.335+0000 7f173b7fe700 1 -- 172.21.15.72:0/654866008 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f174401a360 con 0x7f1754133420 2023-10-03T10:15:49.335 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:49.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.337+0000 7f17591b2700 1 -- 172.21.15.72:0/654866008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1754133420 msgr2=0x7f175409be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.337+0000 7f17591b2700 1 --2- 172.21.15.72:0/654866008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1754133420 0x7f175409be50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1744014360 tx=0x7f1744014670 comp rx=0 tx=0).stop 2023-10-03T10:15:49.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.337+0000 7f17591b2700 1 -- 172.21.15.72:0/654866008 shutdown_connections 2023-10-03T10:15:49.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.337+0000 7f17591b2700 1 --2- 172.21.15.72:0/654866008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1754134260 0x7f175409c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.337+0000 7f17591b2700 1 --2- 172.21.15.72:0/654866008 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1754133420 0x7f175409be50 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.337+0000 7f17591b2700 1 --2- 172.21.15.72:0/654866008 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1754133e30 0x7f175409c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.338+0000 7f17591b2700 1 -- 172.21.15.72:0/654866008 >> 172.21.15.72:0/654866008 conn(0x7f17540a4210 msgr2=0x7f1754130150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.338+0000 7f17591b2700 1 -- 172.21.15.72:0/654866008 shutdown_connections 2023-10-03T10:15:49.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.338+0000 7f17591b2700 1 -- 172.21.15.72:0/654866008 wait complete. 2023-10-03T10:15:49.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:49.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:49.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.603+0000 7ffac9e9b700 1 Processor -- start 2023-10-03T10:15:49.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.603+0000 7ffac9e9b700 1 -- start start 2023-10-03T10:15:49.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.603+0000 7ffac9e9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffac4134630 0x7ffac4136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.603+0000 7ffac9e9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffac4136f50 0x7ffac4139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.603+0000 7ffac9e9b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac409b4f0 con 0x7ffac4131810 2023-10-03T10:15:49.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.603+0000 7ffac9e9b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac41313c0 con 0x7ffac4134630 2023-10-03T10:15:49.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.603+0000 7ffac9e9b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffac406e8c0 con 0x7ffac4136f50 2023-10-03T10:15:49.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.604+0000 7ffac2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffac4134630 0x7ffac4136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.604+0000 7ffac3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffac4136f50 0x7ffac4139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.604+0000 7ffac3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffac4136f50 0x7ffac4139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36452/0 (socket says 172.21.15.72:36452) 2023-10-03T10:15:49.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.604+0000 7ffac2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffac4134630 0x7ffac4136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46374/0 (socket says 172.21.15.72:46374) 2023-10-03T10:15:49.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.604+0000 7ffac3fff700 1 -- 172.21.15.72:0/1299173875 learned_addr learned my addr 172.21.15.72:0/1299173875 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:49.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.604+0000 7ffac3fff700 1 -- 172.21.15.72:0/1299173875 >> v2:172.21.15.72:3300/0 conn(0x7ffac4134630 msgr2=0x7ffac4136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.604+0000 7ffac3fff700 1 --2- 172.21.15.72:0/1299173875 >> v2:172.21.15.72:3300/0 conn(0x7ffac4134630 0x7ffac4136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.604+0000 7ffac3fff700 1 -- 172.21.15.72:0/1299173875 >> v1:172.21.15.72:6789/0 conn(0x7ffac4131810 legacy=0x7ffac4131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.604+0000 7ffac3fff700 1 -- 172.21.15.72:0/1299173875 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac4071d20 con 0x7ffac4136f50 2023-10-03T10:15:49.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.604+0000 7ffac2ffd700 1 --2- 172.21.15.72:0/1299173875 >> v2:172.21.15.72:3300/0 conn(0x7ffac4134630 0x7ffac4136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.604+0000 7ffac3fff700 1 --2- 172.21.15.72:0/1299173875 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffac4136f50 0x7ffac4139330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009e50 tx=0x7ffabc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=468ea489636ef992 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.604+0000 7ffac27fc700 1 -- 172.21.15.72:0/1299173875 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc00e070 con 0x7ffac4136f50 2023-10-03T10:15:49.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.604+0000 7ffac27fc700 1 -- 172.21.15.72:0/1299173875 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc00b910 con 0x7ffac4136f50 2023-10-03T10:15:49.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.604+0000 7ffac27fc700 1 -- 172.21.15.72:0/1299173875 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc00bcc0 con 0x7ffac4136f50 2023-10-03T10:15:49.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.605+0000 7ffac9e9b700 1 -- 172.21.15.72:0/1299173875 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffac4136f50 msgr2=0x7ffac4139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.605+0000 7ffac9e9b700 1 --2- 172.21.15.72:0/1299173875 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffac4136f50 0x7ffac4139330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009e50 tx=0x7ffabc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:49.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.605+0000 7ffac9e9b700 1 -- 172.21.15.72:0/1299173875 shutdown_connections 2023-10-03T10:15:49.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.605+0000 7ffac9e9b700 1 --2- 172.21.15.72:0/1299173875 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffac4136f50 0x7ffac4139330 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.605+0000 7ffac9e9b700 1 --2- 172.21.15.72:0/1299173875 >> v2:172.21.15.72:3300/0 conn(0x7ffac4134630 0x7ffac4136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.605+0000 7ffac9e9b700 1 -- 172.21.15.72:0/1299173875 >> 172.21.15.72:0/1299173875 conn(0x7ffac40a2aa0 msgr2=0x7ffac40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.605+0000 7ffac9e9b700 1 -- 172.21.15.72:0/1299173875 shutdown_connections 2023-10-03T10:15:49.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.605+0000 7ffac9e9b700 1 -- 172.21.15.72:0/1299173875 wait complete. 2023-10-03T10:15:49.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.606+0000 7ffac9e9b700 1 Processor -- start 2023-10-03T10:15:49.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.606+0000 7ffac9e9b700 1 -- start start 2023-10-03T10:15:49.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac9e9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac4131810 0x7ffac4119b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac9e9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffac4134630 0x7ffac411a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac9e9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffac4136f50 0x7ffac41c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac9e9b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac411c670 con 0x7ffac4131810 2023-10-03T10:15:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac9e9b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac4136cb0 con 0x7ffac4134630 2023-10-03T10:15:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac9e9b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffac406eb00 con 0x7ffac4136f50 2023-10-03T10:15:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffac4136f50 0x7ffac41c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffac4134630 0x7ffac411a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffac4134630 0x7ffac411a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40910/0 (socket says 172.21.15.72:40910) 2023-10-03T10:15:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffac4136f50 0x7ffac41c63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36464/0 (socket says 172.21.15.72:36464) 2023-10-03T10:15:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac2ffd700 1 -- 172.21.15.72:0/2351679892 learned_addr learned my addr 172.21.15.72:0/2351679892 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac37fe700 1 --2- 172.21.15.72:0/2351679892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac4131810 0x7ffac4119b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac3fff700 1 -- 172.21.15.72:0/2351679892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffac4134630 msgr2=0x7ffac411a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac3fff700 1 --2- 172.21.15.72:0/2351679892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffac4134630 0x7ffac411a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac3fff700 1 -- 172.21.15.72:0/2351679892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac4131810 msgr2=0x7ffac4119b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac3fff700 1 --2- 172.21.15.72:0/2351679892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac4131810 0x7ffac4119b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac3fff700 1 -- 172.21.15.72:0/2351679892 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab40094a0 con 0x7ffac4136f50 2023-10-03T10:15:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac2ffd700 1 --2- 172.21.15.72:0/2351679892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffac4134630 0x7ffac411a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffac3fff700 1 --2- 172.21.15.72:0/2351679892 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffac4136f50 0x7ffac41c63c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ffabc015000 tx=0x7ffabc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.607+0000 7ffaabfff700 1 -- 172.21.15.72:0/2351679892 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc004570 con 0x7ffac4136f50 2023-10-03T10:15:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.608+0000 7ffaabfff700 1 -- 172.21.15.72:0/2351679892 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc0092e0 con 0x7ffac4136f50 2023-10-03T10:15:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.608+0000 7ffac9e9b700 1 -- 172.21.15.72:0/2351679892 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc009b30 con 0x7ffac4136f50 2023-10-03T10:15:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.608+0000 7ffaabfff700 1 -- 172.21.15.72:0/2351679892 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc004910 con 0x7ffac4136f50 2023-10-03T10:15:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.608+0000 7ffac9e9b700 1 -- 172.21.15.72:0/2351679892 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac41195d0 con 0x7ffac4136f50 2023-10-03T10:15:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.608+0000 7ffaabfff700 1 -- 172.21.15.72:0/2351679892 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffabc01c410 con 0x7ffac4136f50 2023-10-03T10:15:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.608+0000 7ffaabfff700 1 -- 172.21.15.72:0/2351679892 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffabc040c80 con 0x7ffac4136f50 2023-10-03T10:15:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.608+0000 7ffac9e9b700 1 -- 172.21.15.72:0/2351679892 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac411a5d0 con 0x7ffac4136f50 2023-10-03T10:15:49.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.613+0000 7ffaabfff700 1 -- 172.21.15.72:0/2351679892 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffabc029020 con 0x7ffac4136f50 2023-10-03T10:15:49.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.798+0000 7ffac9e9b700 1 -- 172.21.15.72:0/2351679892 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffac4074ea0 con 0x7ffac4136f50 2023-10-03T10:15:49.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.799+0000 7ffaabfff700 1 -- 172.21.15.72:0/2351679892 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffabc0123f0 con 0x7ffac4136f50 2023-10-03T10:15:49.798 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.801+0000 7ffac9e9b700 1 -- 172.21.15.72:0/2351679892 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffac4136f50 msgr2=0x7ffac41c63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.801+0000 7ffac9e9b700 1 --2- 172.21.15.72:0/2351679892 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffac4136f50 0x7ffac41c63c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ffabc015000 tx=0x7ffabc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.801+0000 7ffac9e9b700 1 -- 172.21.15.72:0/2351679892 shutdown_connections 2023-10-03T10:15:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.801+0000 7ffac9e9b700 1 --2- 172.21.15.72:0/2351679892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffac4131810 0x7ffac4119b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.801+0000 7ffac9e9b700 1 --2- 172.21.15.72:0/2351679892 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffac4136f50 0x7ffac41c63c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.801+0000 7ffac9e9b700 1 --2- 172.21.15.72:0/2351679892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffac4134630 0x7ffac411a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.801+0000 7ffac9e9b700 1 -- 172.21.15.72:0/2351679892 >> 172.21.15.72:0/2351679892 conn(0x7ffac40a2aa0 msgr2=0x7ffac412f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.801+0000 7ffac9e9b700 1 -- 172.21.15.72:0/2351679892 shutdown_connections 2023-10-03T10:15:49.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:49.801+0000 7ffac9e9b700 1 -- 172.21.15.72:0/2351679892 wait complete. 2023-10-03T10:15:49.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:50.144 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:50.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.268+0000 7fa2d5afe700 1 Processor -- start 2023-10-03T10:15:50.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.268+0000 7fa2d5afe700 1 -- start start 2023-10-03T10:15:50.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.268+0000 7fa2d5afe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa2d006a770 0x7fa2d006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.268+0000 7fa2d5afe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2d006b080 0x7fa2d0131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.268+0000 7fa2d5afe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2d0131b40 0x7fa2d0131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.268+0000 7fa2d5afe700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d009ece0 con 0x7fa2d006a770 2023-10-03T10:15:50.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.268+0000 7fa2d5afe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d009e760 con 0x7fa2d006b080 2023-10-03T10:15:50.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.268+0000 7fa2d5afe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d009e040 con 0x7fa2d0131b40 2023-10-03T10:15:50.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2ceffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2d006b080 0x7fa2d0131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2cffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2d0131b40 0x7fa2d0131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2cf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa2d006a770 0x7fa2d006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2ceffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2d006b080 0x7fa2d0131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40912/0 (socket says 172.21.15.72:40912) 2023-10-03T10:15:50.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2cf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa2d006a770 0x7fa2d006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46388/0 (socket says 172.21.15.72:46388) 2023-10-03T10:15:50.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2ceffd700 1 -- 172.21.15.72:0/1474527474 learned_addr learned my addr 172.21.15.72:0/1474527474 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:50.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2cffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2d0131b40 0x7fa2d0131fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36478/0 (socket says 172.21.15.72:36478) 2023-10-03T10:15:50.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2cffff700 1 -- 172.21.15.72:0/1474527474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2d006b080 msgr2=0x7fa2d0131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:50.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2cffff700 1 --2- 172.21.15.72:0/1474527474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2d006b080 0x7fa2d0131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2cffff700 1 -- 172.21.15.72:0/1474527474 >> v2:172.21.15.72:3300/0 conn(0x7fa2d006a770 msgr2=0x7fa2d006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:50.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2cffff700 1 --2- 172.21.15.72:0/1474527474 >> v2:172.21.15.72:3300/0 conn(0x7fa2d006a770 0x7fa2d006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2cffff700 1 -- 172.21.15.72:0/1474527474 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d009f630 con 0x7fa2d0131b40 2023-10-03T10:15:50.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2ceffd700 1 --2- 172.21.15.72:0/1474527474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2d006b080 0x7fa2d0131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2cf7fe700 1 --2- 172.21.15.72:0/1474527474 >> v2:172.21.15.72:3300/0 conn(0x7fa2d006a770 0x7fa2d006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2cffff700 1 --2- 172.21.15.72:0/1474527474 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2d0131b40 0x7fa2d0131fa0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009d90 tx=0x7fa2c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17591adbd880b132 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2ce7fc700 1 -- 172.21.15.72:0/1474527474 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800e070 con 0x7fa2d0131b40 2023-10-03T10:15:50.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2ce7fc700 1 -- 172.21.15.72:0/1474527474 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c800bb20 con 0x7fa2d0131b40 2023-10-03T10:15:50.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.269+0000 7fa2ce7fc700 1 -- 172.21.15.72:0/1474527474 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8012430 con 0x7fa2d0131b40 2023-10-03T10:15:50.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.270+0000 7fa2d5afe700 1 -- 172.21.15.72:0/1474527474 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2d0131b40 msgr2=0x7fa2d0131fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.270+0000 7fa2d5afe700 1 --2- 172.21.15.72:0/1474527474 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2d0131b40 0x7fa2d0131fa0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009d90 tx=0x7fa2c800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:50.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.270+0000 7fa2d5afe700 1 -- 172.21.15.72:0/1474527474 shutdown_connections 2023-10-03T10:15:50.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.270+0000 7fa2d5afe700 1 --2- 172.21.15.72:0/1474527474 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2d0131b40 0x7fa2d0131fa0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.270+0000 7fa2d5afe700 1 --2- 172.21.15.72:0/1474527474 >> v2:172.21.15.72:3300/0 conn(0x7fa2d006a770 0x7fa2d006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.270+0000 7fa2d5afe700 1 --2- 172.21.15.72:0/1474527474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2d006b080 0x7fa2d0131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.270+0000 7fa2d5afe700 1 -- 172.21.15.72:0/1474527474 >> 172.21.15.72:0/1474527474 conn(0x7fa2d0066f50 msgr2=0x7fa2d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.270+0000 7fa2d5afe700 1 -- 172.21.15.72:0/1474527474 shutdown_connections 2023-10-03T10:15:50.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.270+0000 7fa2d5afe700 1 -- 172.21.15.72:0/1474527474 wait complete. 2023-10-03T10:15:50.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.271+0000 7fa2d5afe700 1 Processor -- start 2023-10-03T10:15:50.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.271+0000 7fa2d5afe700 1 -- start start 2023-10-03T10:15:50.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.271+0000 7fa2d5afe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2d006a770 0x7fa2d011c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.271+0000 7fa2d5afe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2d006b080 0x7fa2d011c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.271+0000 7fa2d5afe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2d0131b40 0x7fa2d011ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.271+0000 7fa2d5afe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d011fbf0 con 0x7fa2d0131b40 2023-10-03T10:15:50.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.271+0000 7fa2d5afe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0071ed0 con 0x7fa2d006b080 2023-10-03T10:15:50.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.271+0000 7fa2d5afe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d011e060 con 0x7fa2d006a770 2023-10-03T10:15:50.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.271+0000 7fa2cf7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2d006a770 0x7fa2d011c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.271+0000 7fa2cf7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2d006a770 0x7fa2d011c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36488/0 (socket says 172.21.15.72:36488) 2023-10-03T10:15:50.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.271+0000 7fa2cf7fe700 1 -- 172.21.15.72:0/594317347 learned_addr learned my addr 172.21.15.72:0/594317347 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:50.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.271+0000 7fa2ceffd700 1 --2- 172.21.15.72:0/594317347 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2d006b080 0x7fa2d011c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.271+0000 7fa2cffff700 1 --2- 172.21.15.72:0/594317347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2d0131b40 0x7fa2d011ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.272+0000 7fa2cf7fe700 1 -- 172.21.15.72:0/594317347 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2d006b080 msgr2=0x7fa2d011c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.272+0000 7fa2cf7fe700 1 --2- 172.21.15.72:0/594317347 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2d006b080 0x7fa2d011c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.272+0000 7fa2cf7fe700 1 -- 172.21.15.72:0/594317347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2d0131b40 msgr2=0x7fa2d011ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.272+0000 7fa2cf7fe700 1 --2- 172.21.15.72:0/594317347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2d0131b40 0x7fa2d011ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.272+0000 7fa2cf7fe700 1 -- 172.21.15.72:0/594317347 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c40094a0 con 0x7fa2d006a770 2023-10-03T10:15:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.272+0000 7fa2cf7fe700 1 --2- 172.21.15.72:0/594317347 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2d006a770 0x7fa2d011c450 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400ebe0 tx=0x7fa2c400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.272+0000 7fa2b7fff700 1 -- 172.21.15.72:0/594317347 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c400c7f0 con 0x7fa2d006a770 2023-10-03T10:15:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.272+0000 7fa2b7fff700 1 -- 172.21.15.72:0/594317347 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c400c950 con 0x7fa2d006a770 2023-10-03T10:15:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.272+0000 7fa2d5afe700 1 -- 172.21.15.72:0/594317347 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c0009550 con 0x7fa2d006a770 2023-10-03T10:15:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.272+0000 7fa2b7fff700 1 -- 172.21.15.72:0/594317347 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c400cce0 con 0x7fa2d006a770 2023-10-03T10:15:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.272+0000 7fa2d5afe700 1 -- 172.21.15.72:0/594317347 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c8009a70 con 0x7fa2d006a770 2023-10-03T10:15:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.273+0000 7fa2b7fff700 1 -- 172.21.15.72:0/594317347 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2c4013470 con 0x7fa2d006a770 2023-10-03T10:15:50.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.273+0000 7fa2d5afe700 1 -- 172.21.15.72:0/594317347 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d0130ec0 con 0x7fa2d006a770 2023-10-03T10:15:50.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.273+0000 7fa2b7fff700 1 -- 172.21.15.72:0/594317347 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa2c403f750 con 0x7fa2d006a770 2023-10-03T10:15:50.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.278+0000 7fa2b7fff700 1 -- 172.21.15.72:0/594317347 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2c4017020 con 0x7fa2d006a770 2023-10-03T10:15:50.282 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:50.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.409+0000 7f53457f3700 1 Processor -- start 2023-10-03T10:15:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.409+0000 7f53457f3700 1 -- start start 2023-10-03T10:15:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f53457f3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f53400a0a30 0x7f53400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f53457f3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5340138d80 0x7f534013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f53457f3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53400a2a70 con 0x7f534009d630 2023-10-03T10:15:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f53457f3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53400a01d0 con 0x7f53400a0a30 2023-10-03T10:15:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f53457f3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534009e2b0 con 0x7f5340138d80 2023-10-03T10:15:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f533effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f53400a0a30 0x7f53400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f533f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5340138d80 0x7f534013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f533effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f53400a0a30 0x7f53400a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46410/0 (socket says 172.21.15.72:46410) 2023-10-03T10:15:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f533f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5340138d80 0x7f534013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40926/0 (socket says 172.21.15.72:40926) 2023-10-03T10:15:50.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f533effd700 1 -- 172.21.15.72:0/2999337187 learned_addr learned my addr 172.21.15.72:0/2999337187 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f533f7fe700 1 -- 172.21.15.72:0/2999337187 >> v2:172.21.15.72:3300/0 conn(0x7f53400a0a30 msgr2=0x7f53400a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f533f7fe700 1 --2- 172.21.15.72:0/2999337187 >> v2:172.21.15.72:3300/0 conn(0x7f53400a0a30 0x7f53400a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f533f7fe700 1 -- 172.21.15.72:0/2999337187 >> v1:172.21.15.72:6789/0 conn(0x7f534009d630 legacy=0x7f53400a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f533f7fe700 1 -- 172.21.15.72:0/2999337187 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534009dc50 con 0x7f5340138d80 2023-10-03T10:15:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f533effd700 1 --2- 172.21.15.72:0/2999337187 >> v2:172.21.15.72:3300/0 conn(0x7f53400a0a30 0x7f53400a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.410+0000 7f533f7fe700 1 --2- 172.21.15.72:0/2999337187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5340138d80 0x7f534013b160 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5338009d90 tx=0x7f533800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f962ea40347a8a17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.411+0000 7f533dffb700 1 -- 172.21.15.72:0/2999337187 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533800e070 con 0x7f5340138d80 2023-10-03T10:15:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.411+0000 7f533dffb700 1 -- 172.21.15.72:0/2999337187 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533800bb20 con 0x7f5340138d80 2023-10-03T10:15:50.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.411+0000 7f533dffb700 1 -- 172.21.15.72:0/2999337187 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338012430 con 0x7f5340138d80 2023-10-03T10:15:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.411+0000 7f53457f3700 1 -- 172.21.15.72:0/2999337187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5340138d80 msgr2=0x7f534013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.411+0000 7f53457f3700 1 --2- 172.21.15.72:0/2999337187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5340138d80 0x7f534013b160 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5338009d90 tx=0x7f533800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.411+0000 7f53457f3700 1 -- 172.21.15.72:0/2999337187 shutdown_connections 2023-10-03T10:15:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.411+0000 7f53457f3700 1 --2- 172.21.15.72:0/2999337187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5340138d80 0x7f534013b160 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.411+0000 7f53457f3700 1 --2- 172.21.15.72:0/2999337187 >> v2:172.21.15.72:3300/0 conn(0x7f53400a0a30 0x7f53400a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.411+0000 7f53457f3700 1 -- 172.21.15.72:0/2999337187 >> 172.21.15.72:0/2999337187 conn(0x7f53400a3050 msgr2=0x7f53400a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.411+0000 7f53457f3700 1 -- 172.21.15.72:0/2999337187 shutdown_connections 2023-10-03T10:15:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.411+0000 7f53457f3700 1 -- 172.21.15.72:0/2999337187 wait complete. 2023-10-03T10:15:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.412+0000 7f53457f3700 1 Processor -- start 2023-10-03T10:15:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.412+0000 7f53457f3700 1 -- start start 2023-10-03T10:15:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f53457f3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f534009d630 0x7f5340133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f53457f3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400a0a30 0x7f5340133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f53457f3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5340138d80 0x7f53401344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f53457f3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5340136b90 con 0x7f53400a0a30 2023-10-03T10:15:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f53457f3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5340138090 con 0x7f534009d630 2023-10-03T10:15:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f53457f3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53401374b0 con 0x7f5340138d80 2023-10-03T10:15:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f533effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f534009d630 0x7f5340133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f533e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400a0a30 0x7f5340133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f533effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f534009d630 0x7f5340133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40936/0 (socket says 172.21.15.72:40936) 2023-10-03T10:15:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f533effd700 1 -- 172.21.15.72:0/416758361 learned_addr learned my addr 172.21.15.72:0/416758361 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f533f7fe700 1 --2- 172.21.15.72:0/416758361 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5340138d80 0x7f53401344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f533e7fc700 1 -- 172.21.15.72:0/416758361 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5340138d80 msgr2=0x7f53401344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f533e7fc700 1 --2- 172.21.15.72:0/416758361 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5340138d80 0x7f53401344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f533e7fc700 1 -- 172.21.15.72:0/416758361 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f534009d630 msgr2=0x7f5340133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f533e7fc700 1 --2- 172.21.15.72:0/416758361 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f534009d630 0x7f5340133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f533e7fc700 1 -- 172.21.15.72:0/416758361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5330009550 con 0x7f53400a0a30 2023-10-03T10:15:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.413+0000 7f533e7fc700 1 --2- 172.21.15.72:0/416758361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400a0a30 0x7f5340133f70 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f533400c450 tx=0x7f533400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.414+0000 7f53277fe700 1 -- 172.21.15.72:0/416758361 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53340052d0 con 0x7f53400a0a30 2023-10-03T10:15:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.414+0000 7f53277fe700 1 -- 172.21.15.72:0/416758361 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5334005430 con 0x7f53400a0a30 2023-10-03T10:15:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.414+0000 7f53277fe700 1 -- 172.21.15.72:0/416758361 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53340038c0 con 0x7f53400a0a30 2023-10-03T10:15:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.414+0000 7f53457f3700 1 -- 172.21.15.72:0/416758361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5338009a70 con 0x7f53400a0a30 2023-10-03T10:15:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.414+0000 7f53457f3700 1 -- 172.21.15.72:0/416758361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53401371d0 con 0x7f53400a0a30 2023-10-03T10:15:50.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.415+0000 7f53277fe700 1 -- 172.21.15.72:0/416758361 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5334003a20 con 0x7f53400a0a30 2023-10-03T10:15:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.415+0000 7f53457f3700 1 -- 172.21.15.72:0/416758361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5340137030 con 0x7f53400a0a30 2023-10-03T10:15:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.415+0000 7f53277fe700 1 -- 172.21.15.72:0/416758361 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f533403e9a0 con 0x7f53400a0a30 2023-10-03T10:15:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.419+0000 7f53277fe700 1 -- 172.21.15.72:0/416758361 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5340137030 con 0x7f53400a0a30 2023-10-03T10:15:50.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.480+0000 7fa2d5afe700 1 -- 172.21.15.72:0/594317347 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa2d0074ea0 con 0x7fa2d006a770 2023-10-03T10:15:50.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.480+0000 7fa2b7fff700 1 -- 172.21.15.72:0/594317347 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2c4013720 con 0x7fa2d006a770 2023-10-03T10:15:50.480 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:50.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.482+0000 7fa2d5afe700 1 -- 172.21.15.72:0/594317347 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2d006a770 msgr2=0x7fa2d011c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.482+0000 7fa2d5afe700 1 --2- 172.21.15.72:0/594317347 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2d006a770 0x7fa2d011c450 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400ebe0 tx=0x7fa2c400eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.482+0000 7fa2d5afe700 1 -- 172.21.15.72:0/594317347 shutdown_connections 2023-10-03T10:15:50.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.482+0000 7fa2d5afe700 1 --2- 172.21.15.72:0/594317347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2d0131b40 0x7fa2d011ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.482+0000 7fa2d5afe700 1 --2- 172.21.15.72:0/594317347 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2d006a770 0x7fa2d011c450 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.483+0000 7fa2d5afe700 1 --2- 172.21.15.72:0/594317347 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2d006b080 0x7fa2d011c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.483+0000 7fa2d5afe700 1 -- 172.21.15.72:0/594317347 >> 172.21.15.72:0/594317347 conn(0x7fa2d0066f50 msgr2=0x7fa2d0070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.483+0000 7fa2d5afe700 1 -- 172.21.15.72:0/594317347 shutdown_connections 2023-10-03T10:15:50.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.483+0000 7fa2d5afe700 1 -- 172.21.15.72:0/594317347 wait complete. 2023-10-03T10:15:50.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.486+0000 7f54ae057700 1 Processor -- start 2023-10-03T10:15:50.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.486+0000 7f54ae057700 1 -- start start 2023-10-03T10:15:50.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.487+0000 7f54ae057700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54a80a1510 0x7f54a8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.487+0000 7f54ae057700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54a8139250 0x7f54a813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.487+0000 7f54ae057700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a809edd0 con 0x7f54a80a0a30 2023-10-03T10:15:50.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.487+0000 7f54ae057700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a80a18e0 con 0x7f54a80a1510 2023-10-03T10:15:50.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.487+0000 7f54ae057700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a809e1f0 con 0x7f54a8139250 2023-10-03T10:15:50.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.487+0000 7f54a6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54a80a1510 0x7f54a8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.487+0000 7f54a77fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f54a80a0a30 0x7f54a80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50348/0 (socket says 172.21.15.72:50348) 2023-10-03T10:15:50.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.487+0000 7f54a77fe700 1 -- 172.21.15.72:0/1101486005 learned_addr learned my addr 172.21.15.72:0/1101486005 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:50.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.487+0000 7f54a7fff700 1 --2- 172.21.15.72:0/1101486005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54a8139250 0x7f54a813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.487+0000 7f54a6ffd700 1 -- 172.21.15.72:0/1101486005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54a8139250 msgr2=0x7f54a813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:50.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.488+0000 7f54a6ffd700 1 --2- 172.21.15.72:0/1101486005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54a8139250 0x7f54a813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.488+0000 7f54a6ffd700 1 -- 172.21.15.72:0/1101486005 >> v1:172.21.15.72:6789/0 conn(0x7f54a80a0a30 legacy=0x7f54a80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.488+0000 7f54a67fc700 1 -- 172.21.15.72:0/1101486005 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075282081 0 0) 0x7f54a809edd0 con 0x7f54a80a0a30 2023-10-03T10:15:50.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.488+0000 7f54a6ffd700 1 -- 172.21.15.72:0/1101486005 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a809dc50 con 0x7f54a80a1510 2023-10-03T10:15:50.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.488+0000 7f54a6ffd700 1 --2- 172.21.15.72:0/1101486005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54a80a1510 0x7f54a8138d10 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f549c009840 tx=0x7f549c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97aeca4f4a0f909d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.488+0000 7f54a67fc700 1 -- 172.21.15.72:0/1101486005 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c011830 con 0x7f54a80a1510 2023-10-03T10:15:50.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.488+0000 7f54a67fc700 1 -- 172.21.15.72:0/1101486005 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c011990 con 0x7f54a80a1510 2023-10-03T10:15:50.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.488+0000 7f54a67fc700 1 -- 172.21.15.72:0/1101486005 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c011d20 con 0x7f54a80a1510 2023-10-03T10:15:50.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.489+0000 7f54ae057700 1 -- 172.21.15.72:0/1101486005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54a80a1510 msgr2=0x7f54a8138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.489+0000 7f54ae057700 1 --2- 172.21.15.72:0/1101486005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54a80a1510 0x7f54a8138d10 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f549c009840 tx=0x7f549c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:50.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.489+0000 7f54ae057700 1 -- 172.21.15.72:0/1101486005 shutdown_connections 2023-10-03T10:15:50.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.489+0000 7f54ae057700 1 --2- 172.21.15.72:0/1101486005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54a8139250 0x7f54a813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.489+0000 7f54ae057700 1 --2- 172.21.15.72:0/1101486005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54a80a1510 0x7f54a8138d10 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.489+0000 7f54ae057700 1 -- 172.21.15.72:0/1101486005 >> 172.21.15.72:0/1101486005 conn(0x7f54a80a6550 msgr2=0x7f54a80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.489+0000 7f54ae057700 1 -- 172.21.15.72:0/1101486005 shutdown_connections 2023-10-03T10:15:50.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.489+0000 7f54ae057700 1 -- 172.21.15.72:0/1101486005 wait complete. 2023-10-03T10:15:50.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.490+0000 7f54ae057700 1 Processor -- start 2023-10-03T10:15:50.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.490+0000 7f54ae057700 1 -- start start 2023-10-03T10:15:50.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54ae057700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54a80a0a30 0x7f54a8122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54ae057700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54a80a1510 0x7f54a8122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54ae057700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54a8139250 0x7f54a81232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54ae057700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a81243e0 con 0x7f54a80a0a30 2023-10-03T10:15:50.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54ae057700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a8124a40 con 0x7f54a8139250 2023-10-03T10:15:50.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54ae057700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54a81386c0 con 0x7f54a80a1510 2023-10-03T10:15:50.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54a77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54a80a0a30 0x7f54a8122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54a6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54a80a1510 0x7f54a8122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54a6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54a80a1510 0x7f54a8122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36506/0 (socket says 172.21.15.72:36506) 2023-10-03T10:15:50.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54a6ffd700 1 -- 172.21.15.72:0/4130294758 learned_addr learned my addr 172.21.15.72:0/4130294758 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:50.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54a77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54a80a0a30 0x7f54a8122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46448/0 (socket says 172.21.15.72:46448) 2023-10-03T10:15:50.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54a7fff700 1 --2- 172.21.15.72:0/4130294758 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54a8139250 0x7f54a81232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54a6ffd700 1 -- 172.21.15.72:0/4130294758 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54a8139250 msgr2=0x7f54a81232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54a6ffd700 1 --2- 172.21.15.72:0/4130294758 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54a8139250 0x7f54a81232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54a6ffd700 1 -- 172.21.15.72:0/4130294758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54a80a0a30 msgr2=0x7f54a8122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54a6ffd700 1 --2- 172.21.15.72:0/4130294758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54a80a0a30 0x7f54a8122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54a6ffd700 1 -- 172.21.15.72:0/4130294758 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c0094a0 con 0x7f54a80a1510 2023-10-03T10:15:50.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.491+0000 7f54a77fe700 1 --2- 172.21.15.72:0/4130294758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54a80a0a30 0x7f54a8122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.492+0000 7f54a6ffd700 1 --2- 172.21.15.72:0/4130294758 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54a80a1510 0x7f54a8122da0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f549c0090b0 tx=0x7f549c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.492+0000 7f548ffff700 1 -- 172.21.15.72:0/4130294758 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0036a0 con 0x7f54a80a1510 2023-10-03T10:15:50.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.492+0000 7f548ffff700 1 -- 172.21.15.72:0/4130294758 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c01f070 con 0x7f54a80a1510 2023-10-03T10:15:50.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.492+0000 7f54ae057700 1 -- 172.21.15.72:0/4130294758 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a81262f0 con 0x7f54a80a1510 2023-10-03T10:15:50.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.492+0000 7f548ffff700 1 -- 172.21.15.72:0/4130294758 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c003a60 con 0x7f54a80a1510 2023-10-03T10:15:50.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.492+0000 7f54ae057700 1 -- 172.21.15.72:0/4130294758 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a8124bd0 con 0x7f54a80a1510 2023-10-03T10:15:50.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.493+0000 7f548ffff700 1 -- 172.21.15.72:0/4130294758 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f549c003bc0 con 0x7f54a80a1510 2023-10-03T10:15:50.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.493+0000 7f548ffff700 1 -- 172.21.15.72:0/4130294758 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f549c021070 con 0x7f54a80a1510 2023-10-03T10:15:50.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.493+0000 7f54ae057700 1 -- 172.21.15.72:0/4130294758 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a8074ea0 con 0x7f54a80a1510 2023-10-03T10:15:50.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:50.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.498+0000 7f548ffff700 1 -- 172.21.15.72:0/4130294758 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f549c015020 con 0x7f54a80a1510 2023-10-03T10:15:50.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.647+0000 7f53457f3700 1 -- 172.21.15.72:0/416758361 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5340137030 con 0x7f53400a0a30 2023-10-03T10:15:50.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.647+0000 7f53277fe700 1 -- 172.21.15.72:0/416758361 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5340137030 con 0x7f53400a0a30 2023-10-03T10:15:50.647 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:50.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.649+0000 7f53457f3700 1 -- 172.21.15.72:0/416758361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400a0a30 msgr2=0x7f5340133f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.649+0000 7f53457f3700 1 --2- 172.21.15.72:0/416758361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400a0a30 0x7f5340133f70 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f533400c450 tx=0x7f533400c760 comp rx=0 tx=0).stop 2023-10-03T10:15:50.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.649+0000 7f53457f3700 1 -- 172.21.15.72:0/416758361 shutdown_connections 2023-10-03T10:15:50.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.649+0000 7f53457f3700 1 --2- 172.21.15.72:0/416758361 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5340138d80 0x7f53401344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.649+0000 7f53457f3700 1 --2- 172.21.15.72:0/416758361 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f534009d630 0x7f5340133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.649+0000 7f53457f3700 1 --2- 172.21.15.72:0/416758361 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53400a0a30 0x7f5340133f70 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.649+0000 7f53457f3700 1 -- 172.21.15.72:0/416758361 >> 172.21.15.72:0/416758361 conn(0x7f53400a3050 msgr2=0x7f534009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.649+0000 7f53457f3700 1 -- 172.21.15.72:0/416758361 shutdown_connections 2023-10-03T10:15:50.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.649+0000 7f53457f3700 1 -- 172.21.15.72:0/416758361 wait complete. 2023-10-03T10:15:50.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:50.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.713+0000 7f54ae057700 1 -- 172.21.15.72:0/4130294758 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f54a80a28e0 con 0x7f54a80a1510 2023-10-03T10:15:50.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.713+0000 7f548ffff700 1 -- 172.21.15.72:0/4130294758 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f549c01a430 con 0x7f54a80a1510 2023-10-03T10:15:50.713 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:50.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.715+0000 7f54ae057700 1 -- 172.21.15.72:0/4130294758 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54a80a1510 msgr2=0x7f54a8122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.715+0000 7f54ae057700 1 --2- 172.21.15.72:0/4130294758 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54a80a1510 0x7f54a8122da0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f549c0090b0 tx=0x7f549c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:50.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.715+0000 7f54ae057700 1 -- 172.21.15.72:0/4130294758 shutdown_connections 2023-10-03T10:15:50.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.715+0000 7f54ae057700 1 --2- 172.21.15.72:0/4130294758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54a80a0a30 0x7f54a8122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.715+0000 7f54ae057700 1 --2- 172.21.15.72:0/4130294758 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54a8139250 0x7f54a81232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.715+0000 7f54ae057700 1 --2- 172.21.15.72:0/4130294758 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54a80a1510 0x7f54a8122da0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.715+0000 7f54ae057700 1 -- 172.21.15.72:0/4130294758 >> 172.21.15.72:0/4130294758 conn(0x7f54a80a6550 msgr2=0x7f54a80a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.715+0000 7f54ae057700 1 -- 172.21.15.72:0/4130294758 shutdown_connections 2023-10-03T10:15:50.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.715+0000 7f54ae057700 1 -- 172.21.15.72:0/4130294758 wait complete. 2023-10-03T10:15:50.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:50.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:50.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.936+0000 7f2011007700 1 Processor -- start 2023-10-03T10:15:50.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.936+0000 7f2011007700 1 -- start start 2023-10-03T10:15:50.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.936+0000 7f2011007700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f200c131810 0x7f200c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.936+0000 7f2011007700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f200c099a40 0x7f200c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.936+0000 7f2011007700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f200c09a3b0 0x7f200c138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.936+0000 7f2011007700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f200c1313c0 con 0x7f200c099a40 2023-10-03T10:15:50.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.936+0000 7f2011007700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200c06e8c0 con 0x7f200c09a3b0 2023-10-03T10:15:50.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.936+0000 7f2011007700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f200c09a820 con 0x7f200c131810 2023-10-03T10:15:50.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.936+0000 7f200ad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f200c131810 0x7f200c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.936+0000 7f200b59e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f200c09a3b0 0x7f200c138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.937+0000 7f200a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f200c099a40 0x7f200c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.937+0000 7f200ad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f200c131810 0x7f200c131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36520/0 (socket says 172.21.15.72:36520) 2023-10-03T10:15:50.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.937+0000 7f200b59e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f200c09a3b0 0x7f200c138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40974/0 (socket says 172.21.15.72:40974) 2023-10-03T10:15:50.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.937+0000 7f200ad9d700 1 -- 172.21.15.72:0/2107527643 learned_addr learned my addr 172.21.15.72:0/2107527643 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:50.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.937+0000 7f200ad9d700 1 -- 172.21.15.72:0/2107527643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f200c09a3b0 msgr2=0x7f200c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:50.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.937+0000 7f200ad9d700 1 --2- 172.21.15.72:0/2107527643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f200c09a3b0 0x7f200c138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.937+0000 7f200ad9d700 1 -- 172.21.15.72:0/2107527643 >> v2:172.21.15.72:3300/0 conn(0x7f200c099a40 msgr2=0x7f200c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:50.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.937+0000 7f200ad9d700 1 --2- 172.21.15.72:0/2107527643 >> v2:172.21.15.72:3300/0 conn(0x7f200c099a40 0x7f200c099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.937+0000 7f200ad9d700 1 -- 172.21.15.72:0/2107527643 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200c071d20 con 0x7f200c131810 2023-10-03T10:15:50.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.937+0000 7f200b59e700 1 --2- 172.21.15.72:0/2107527643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f200c09a3b0 0x7f200c138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.937+0000 7f200a59c700 1 --2- 172.21.15.72:0/2107527643 >> v2:172.21.15.72:3300/0 conn(0x7f200c099a40 0x7f200c099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.937+0000 7f200ad9d700 1 --2- 172.21.15.72:0/2107527643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f200c131810 0x7f200c131be0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f20000098f0 tx=0x7f2000009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4d1df9a2a1a3dc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.937+0000 7f2009d9b700 1 -- 172.21.15.72:0/2107527643 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2000011830 con 0x7f200c131810 2023-10-03T10:15:50.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.937+0000 7f2009d9b700 1 -- 172.21.15.72:0/2107527643 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2000011990 con 0x7f200c131810 2023-10-03T10:15:50.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.937+0000 7f2009d9b700 1 -- 172.21.15.72:0/2107527643 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2000011d20 con 0x7f200c131810 2023-10-03T10:15:50.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.938+0000 7f2011007700 1 -- 172.21.15.72:0/2107527643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f200c131810 msgr2=0x7f200c131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.938+0000 7f2011007700 1 --2- 172.21.15.72:0/2107527643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f200c131810 0x7f200c131be0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f20000098f0 tx=0x7f2000009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:50.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.938+0000 7f2011007700 1 -- 172.21.15.72:0/2107527643 shutdown_connections 2023-10-03T10:15:50.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.938+0000 7f2011007700 1 --2- 172.21.15.72:0/2107527643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f200c09a3b0 0x7f200c138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.938+0000 7f2011007700 1 --2- 172.21.15.72:0/2107527643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f200c131810 0x7f200c131be0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.938+0000 7f2011007700 1 --2- 172.21.15.72:0/2107527643 >> v2:172.21.15.72:3300/0 conn(0x7f200c099a40 0x7f200c099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.938+0000 7f2011007700 1 -- 172.21.15.72:0/2107527643 >> 172.21.15.72:0/2107527643 conn(0x7f200c0a2aa0 msgr2=0x7f200c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.938+0000 7f2011007700 1 -- 172.21.15.72:0/2107527643 shutdown_connections 2023-10-03T10:15:50.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.938+0000 7f2011007700 1 -- 172.21.15.72:0/2107527643 wait complete. 2023-10-03T10:15:50.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.939+0000 7f2011007700 1 Processor -- start 2023-10-03T10:15:50.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.939+0000 7f2011007700 1 -- start start 2023-10-03T10:15:50.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f2011007700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f200c099a40 0x7f200c11b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f2011007700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f200c09a3b0 0x7f200c11ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f2011007700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f200c131810 0x7f200c11bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f2011007700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c11fa30 con 0x7f200c099a40 2023-10-03T10:15:50.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f2011007700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200c11d160 con 0x7f200c09a3b0 2023-10-03T10:15:50.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f2011007700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f200c11e3b0 con 0x7f200c131810 2023-10-03T10:15:50.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f200ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f200c099a40 0x7f200c11b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f200a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f200c09a3b0 0x7f200c11ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f200ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f200c099a40 0x7f200c11b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46462/0 (socket says 172.21.15.72:46462) 2023-10-03T10:15:50.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f200ad9d700 1 -- 172.21.15.72:0/312414759 learned_addr learned my addr 172.21.15.72:0/312414759 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:50.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f200a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f200c09a3b0 0x7f200c11ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40976/0 (socket says 172.21.15.72:40976) 2023-10-03T10:15:50.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f200b59e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f200c131810 0x7f200c11bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f200b59e700 1 -- 172.21.15.72:0/312414759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f200c09a3b0 msgr2=0x7f200c11ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f200b59e700 1 --2- 172.21.15.72:0/312414759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f200c09a3b0 0x7f200c11ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f200b59e700 1 -- 172.21.15.72:0/312414759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f200c099a40 msgr2=0x7f200c11b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f200b59e700 1 --2- 172.21.15.72:0/312414759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f200c099a40 0x7f200c11b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f200b59e700 1 -- 172.21.15.72:0/312414759 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc0094a0 con 0x7f200c131810 2023-10-03T10:15:50.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f200a59c700 1 --2- 172.21.15.72:0/312414759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f200c09a3b0 0x7f200c11ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f200ad9d700 1 --2- 172.21.15.72:0/312414759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f200c099a40 0x7f200c11b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.940+0000 7f200b59e700 1 --2- 172.21.15.72:0/312414759 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f200c131810 0x7f200c11bfd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2004009e50 tx=0x7f200400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.941+0000 7f1ff37fe700 1 -- 172.21.15.72:0/312414759 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200400ca90 con 0x7f200c131810 2023-10-03T10:15:50.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.941+0000 7f1ff37fe700 1 -- 172.21.15.72:0/312414759 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200400f040 con 0x7f200c131810 2023-10-03T10:15:50.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.941+0000 7f2011007700 1 -- 172.21.15.72:0/312414759 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2004009a70 con 0x7f200c131810 2023-10-03T10:15:50.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.941+0000 7f1ff37fe700 1 -- 172.21.15.72:0/312414759 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200400ce50 con 0x7f200c131810 2023-10-03T10:15:50.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.941+0000 7f2011007700 1 -- 172.21.15.72:0/312414759 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2000009550 con 0x7f200c131810 2023-10-03T10:15:50.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.941+0000 7f1ff37fe700 1 -- 172.21.15.72:0/312414759 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2004014480 con 0x7f200c131810 2023-10-03T10:15:50.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.942+0000 7f1ff37fe700 1 -- 172.21.15.72:0/312414759 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f200403fbc0 con 0x7f200c131810 2023-10-03T10:15:50.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.942+0000 7f2011007700 1 -- 172.21.15.72:0/312414759 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200c06eb00 con 0x7f200c131810 2023-10-03T10:15:50.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:50.946+0000 7f1ff37fe700 1 -- 172.21.15.72:0/312414759 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2004012930 con 0x7f200c131810 2023-10-03T10:15:51.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.129+0000 7f2011007700 1 -- 172.21.15.72:0/312414759 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f200c074ea0 con 0x7f200c131810 2023-10-03T10:15:51.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.129+0000 7f1ff37fe700 1 -- 172.21.15.72:0/312414759 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2004012340 con 0x7f200c131810 2023-10-03T10:15:51.129 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:51.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.131+0000 7f2011007700 1 -- 172.21.15.72:0/312414759 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f200c131810 msgr2=0x7f200c11bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.131+0000 7f2011007700 1 --2- 172.21.15.72:0/312414759 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f200c131810 0x7f200c11bfd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2004009e50 tx=0x7f200400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.131+0000 7f2011007700 1 -- 172.21.15.72:0/312414759 shutdown_connections 2023-10-03T10:15:51.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.131+0000 7f2011007700 1 --2- 172.21.15.72:0/312414759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f200c099a40 0x7f200c11b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.131+0000 7f2011007700 1 --2- 172.21.15.72:0/312414759 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f200c131810 0x7f200c11bfd0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.131+0000 7f2011007700 1 --2- 172.21.15.72:0/312414759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f200c09a3b0 0x7f200c11ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.131+0000 7f2011007700 1 -- 172.21.15.72:0/312414759 >> 172.21.15.72:0/312414759 conn(0x7f200c0a2aa0 msgr2=0x7f200c1b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.132+0000 7f2011007700 1 -- 172.21.15.72:0/312414759 shutdown_connections 2023-10-03T10:15:51.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.132+0000 7f2011007700 1 -- 172.21.15.72:0/312414759 wait complete. 2023-10-03T10:15:51.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:51.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:51.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.623+0000 7f3321390700 1 Processor -- start 2023-10-03T10:15:51.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.623+0000 7f3321390700 1 -- start start 2023-10-03T10:15:51.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.623+0000 7f3321390700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f331c09e850 0x7f331c09ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.623+0000 7f3321390700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f331c09f160 0x7f331c133bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.623+0000 7f3321390700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331c09f960 con 0x7f331c134130 2023-10-03T10:15:51.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.623+0000 7f3321390700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331c09ae60 con 0x7f331c09e850 2023-10-03T10:15:51.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.623+0000 7f3321390700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f331c06cb10 con 0x7f331c09f160 2023-10-03T10:15:51.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.623+0000 7f331a7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f331c09f160 0x7f331c133bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.623+0000 7f331affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f331c09e850 0x7f331c09ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.623+0000 7f331a7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f331c09f160 0x7f331c133bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36530/0 (socket says 172.21.15.72:36530) 2023-10-03T10:15:51.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.623+0000 7f331b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f331c134130 0x7f331c13aeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50354/0 (socket says 172.21.15.72:50354) 2023-10-03T10:15:51.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.623+0000 7f331a7fc700 1 -- 172.21.15.72:0/109980752 learned_addr learned my addr 172.21.15.72:0/109980752 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:51.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.623+0000 7f331affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f331c09e850 0x7f331c09ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40980/0 (socket says 172.21.15.72:40980) 2023-10-03T10:15:51.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f331a7fc700 1 -- 172.21.15.72:0/109980752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f331c09e850 msgr2=0x7f331c09ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f331a7fc700 1 --2- 172.21.15.72:0/109980752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f331c09e850 0x7f331c09ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f331a7fc700 1 -- 172.21.15.72:0/109980752 >> v1:172.21.15.72:6789/0 conn(0x7f331c134130 legacy=0x7f331c13aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f3319ffb700 1 -- 172.21.15.72:0/109980752 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117047070 0 0) 0x7f331c09f960 con 0x7f331c134130 2023-10-03T10:15:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f331a7fc700 1 -- 172.21.15.72:0/109980752 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c06b990 con 0x7f331c09f160 2023-10-03T10:15:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f331affd700 1 --2- 172.21.15.72:0/109980752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f331c09e850 0x7f331c09ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f331a7fc700 1 --2- 172.21.15.72:0/109980752 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f331c09f160 0x7f331c133bf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3310009920 tx=0x7f3310009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=682ed7ef160b6b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f3319ffb700 1 -- 172.21.15.72:0/109980752 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310011830 con 0x7f331c09f160 2023-10-03T10:15:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f3319ffb700 1 -- 172.21.15.72:0/109980752 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3310011990 con 0x7f331c09f160 2023-10-03T10:15:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f3319ffb700 1 -- 172.21.15.72:0/109980752 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310011d20 con 0x7f331c09f160 2023-10-03T10:15:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f3321390700 1 -- 172.21.15.72:0/109980752 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f331c09f160 msgr2=0x7f331c133bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f3321390700 1 --2- 172.21.15.72:0/109980752 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f331c09f160 0x7f331c133bf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3310009920 tx=0x7f3310009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:51.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f3321390700 1 -- 172.21.15.72:0/109980752 shutdown_connections 2023-10-03T10:15:51.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f3321390700 1 --2- 172.21.15.72:0/109980752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f331c09e850 0x7f331c09ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f3321390700 1 --2- 172.21.15.72:0/109980752 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f331c09f160 0x7f331c133bf0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.624+0000 7f3321390700 1 -- 172.21.15.72:0/109980752 >> 172.21.15.72:0/109980752 conn(0x7f331c0a3f70 msgr2=0x7f331c0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.625+0000 7f3321390700 1 -- 172.21.15.72:0/109980752 shutdown_connections 2023-10-03T10:15:51.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.625+0000 7f3321390700 1 -- 172.21.15.72:0/109980752 wait complete. 2023-10-03T10:15:51.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.626+0000 7f3321390700 1 Processor -- start 2023-10-03T10:15:51.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.626+0000 7f3321390700 1 -- start start 2023-10-03T10:15:51.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.626+0000 7f3321390700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f331c09e850 0x7f331c123610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f3321390700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f331c09f160 0x7f331c123b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f3321390700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f331c134130 0x7f331c1c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f3321390700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c06cd30 con 0x7f331c09f160 2023-10-03T10:15:51.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f3321390700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331c1262c0 con 0x7f331c09e850 2023-10-03T10:15:51.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f3321390700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f331c126580 con 0x7f331c134130 2023-10-03T10:15:51.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f331affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f331c09e850 0x7f331c123610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f331a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f331c09f160 0x7f331c123b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f331affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f331c09e850 0x7f331c123610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40982/0 (socket says 172.21.15.72:40982) 2023-10-03T10:15:51.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f331affd700 1 -- 172.21.15.72:0/3757589895 learned_addr learned my addr 172.21.15.72:0/3757589895 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:51.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f331b7fe700 1 --2- 172.21.15.72:0/3757589895 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f331c134130 0x7f331c1c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f331affd700 1 -- 172.21.15.72:0/3757589895 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f331c134130 msgr2=0x7f331c1c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f331affd700 1 --2- 172.21.15.72:0/3757589895 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f331c134130 0x7f331c1c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f331affd700 1 -- 172.21.15.72:0/3757589895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f331c09f160 msgr2=0x7f331c123b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f331affd700 1 --2- 172.21.15.72:0/3757589895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f331c09f160 0x7f331c123b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f331affd700 1 -- 172.21.15.72:0/3757589895 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c0094a0 con 0x7f331c09e850 2023-10-03T10:15:51.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f331a7fc700 1 --2- 172.21.15.72:0/3757589895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f331c09f160 0x7f331c123b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f331affd700 1 --2- 172.21.15.72:0/3757589895 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f331c09e850 0x7f331c123610 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f330c00ebe0 tx=0x7f330c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f33037fe700 1 -- 172.21.15.72:0/3757589895 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00c850 con 0x7f331c09e850 2023-10-03T10:15:51.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f33037fe700 1 -- 172.21.15.72:0/3757589895 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c00c9b0 con 0x7f331c09e850 2023-10-03T10:15:51.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f3321390700 1 -- 172.21.15.72:0/3757589895 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3310009550 con 0x7f331c09e850 2023-10-03T10:15:51.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f33037fe700 1 -- 172.21.15.72:0/3757589895 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00cd40 con 0x7f331c09e850 2023-10-03T10:15:51.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.627+0000 7f3321390700 1 -- 172.21.15.72:0/3757589895 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331c126ff0 con 0x7f331c09e850 2023-10-03T10:15:51.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.628+0000 7f33037fe700 1 -- 172.21.15.72:0/3757589895 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f330c013470 con 0x7f331c09e850 2023-10-03T10:15:51.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.628+0000 7f33037fe700 1 -- 172.21.15.72:0/3757589895 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f330c03f770 con 0x7f331c09e850 2023-10-03T10:15:51.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.628+0000 7f3321390700 1 -- 172.21.15.72:0/3757589895 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331c0747f0 con 0x7f331c09e850 2023-10-03T10:15:51.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.633+0000 7f33037fe700 1 -- 172.21.15.72:0/3757589895 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f330c013720 con 0x7f331c09e850 2023-10-03T10:15:51.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:51.728 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.789+0000 7f0639964700 1 Processor -- start 2023-10-03T10:15:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.789+0000 7f0639964700 1 -- start start 2023-10-03T10:15:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.789+0000 7f0639964700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f063409d6f0 0x7f063409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.789+0000 7f0639964700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f063409e000 0x7f0634130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.789+0000 7f0639964700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f063409e410 0x7f0634130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.789+0000 7f0639964700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063409f520 con 0x7f063409d6f0 2023-10-03T10:15:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.789+0000 7f0639964700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063409f130 con 0x7f063409e000 2023-10-03T10:15:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.789+0000 7f0639964700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f063409e930 con 0x7f063409e410 2023-10-03T10:15:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.790+0000 7f0632ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f063409d6f0 0x7f063409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.790+0000 7f0632ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f063409d6f0 0x7f063409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46480/0 (socket says 172.21.15.72:46480) 2023-10-03T10:15:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.790+0000 7f0632ffd700 1 -- 172.21.15.72:0/607580623 learned_addr learned my addr 172.21.15.72:0/607580623 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.790+0000 7f06327fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f063409e000 0x7f0634130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.790+0000 7f06337fe700 1 --2- 172.21.15.72:0/607580623 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f063409e410 0x7f0634130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.790+0000 7f06327fc700 1 -- 172.21.15.72:0/607580623 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f063409e410 msgr2=0x7f0634130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.790+0000 7f06327fc700 1 --2- 172.21.15.72:0/607580623 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f063409e410 0x7f0634130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.790+0000 7f06327fc700 1 -- 172.21.15.72:0/607580623 >> v2:172.21.15.72:3300/0 conn(0x7f063409d6f0 msgr2=0x7f063409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.790+0000 7f06327fc700 1 --2- 172.21.15.72:0/607580623 >> v2:172.21.15.72:3300/0 conn(0x7f063409d6f0 0x7f063409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.790+0000 7f06327fc700 1 -- 172.21.15.72:0/607580623 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063409b2d0 con 0x7f063409e000 2023-10-03T10:15:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.790+0000 7f06337fe700 1 --2- 172.21.15.72:0/607580623 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f063409e410 0x7f0634130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.790+0000 7f06327fc700 1 --2- 172.21.15.72:0/607580623 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f063409e000 0x7f0634130660 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0628009840 tx=0x7f0628009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cde37460e877a55 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.790+0000 7f0631ffb700 1 -- 172.21.15.72:0/607580623 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628011830 con 0x7f063409e000 2023-10-03T10:15:51.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.790+0000 7f0631ffb700 1 -- 172.21.15.72:0/607580623 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0628011990 con 0x7f063409e000 2023-10-03T10:15:51.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.790+0000 7f0631ffb700 1 -- 172.21.15.72:0/607580623 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628011d20 con 0x7f063409e000 2023-10-03T10:15:51.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.791+0000 7f0639964700 1 -- 172.21.15.72:0/607580623 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f063409e000 msgr2=0x7f0634130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.791+0000 7f0639964700 1 --2- 172.21.15.72:0/607580623 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f063409e000 0x7f0634130660 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0628009840 tx=0x7f0628009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:51.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.791+0000 7f0639964700 1 -- 172.21.15.72:0/607580623 shutdown_connections 2023-10-03T10:15:51.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.791+0000 7f0639964700 1 --2- 172.21.15.72:0/607580623 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f063409e410 0x7f0634130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.791+0000 7f0639964700 1 --2- 172.21.15.72:0/607580623 >> v2:172.21.15.72:3300/0 conn(0x7f063409d6f0 0x7f063409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.791+0000 7f0639964700 1 --2- 172.21.15.72:0/607580623 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f063409e000 0x7f0634130660 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.791+0000 7f0639964700 1 -- 172.21.15.72:0/607580623 >> 172.21.15.72:0/607580623 conn(0x7f0634066f50 msgr2=0x7f063409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.791+0000 7f0639964700 1 -- 172.21.15.72:0/607580623 shutdown_connections 2023-10-03T10:15:51.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.791+0000 7f0639964700 1 -- 172.21.15.72:0/607580623 wait complete. 2023-10-03T10:15:51.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.792+0000 7f0639964700 1 Processor -- start 2023-10-03T10:15:51.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.792+0000 7f0639964700 1 -- start start 2023-10-03T10:15:51.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f0639964700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f063409d6f0 0x7f0634122270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f0639964700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f063409e000 0x7f06341227b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f0639964700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f063409e410 0x7f0634122cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f0639964700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0634125b90 con 0x7f063409e410 2023-10-03T10:15:51.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f0639964700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0634123e80 con 0x7f063409e000 2023-10-03T10:15:51.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f0639964700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f063409c700 con 0x7f063409d6f0 2023-10-03T10:15:51.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f0632ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f063409d6f0 0x7f0634122270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f0632ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f063409d6f0 0x7f0634122270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36550/0 (socket says 172.21.15.72:36550) 2023-10-03T10:15:51.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f0632ffd700 1 -- 172.21.15.72:0/240811868 learned_addr learned my addr 172.21.15.72:0/240811868 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f06327fc700 1 --2- 172.21.15.72:0/240811868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f063409e000 0x7f06341227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f06337fe700 1 --2- 172.21.15.72:0/240811868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f063409e410 0x7f0634122cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f0632ffd700 1 -- 172.21.15.72:0/240811868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f063409e000 msgr2=0x7f06341227b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f0632ffd700 1 --2- 172.21.15.72:0/240811868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f063409e000 0x7f06341227b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f0632ffd700 1 -- 172.21.15.72:0/240811868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f063409e410 msgr2=0x7f0634122cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f0632ffd700 1 --2- 172.21.15.72:0/240811868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f063409e410 0x7f0634122cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f0632ffd700 1 -- 172.21.15.72:0/240811868 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c00bc80 con 0x7f063409d6f0 2023-10-03T10:15:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.793+0000 7f0632ffd700 1 --2- 172.21.15.72:0/240811868 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f063409d6f0 0x7f0634122270 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f062400e960 tx=0x7f062400ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.794+0000 7f061bfff700 1 -- 172.21.15.72:0/240811868 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624013680 con 0x7f063409d6f0 2023-10-03T10:15:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.794+0000 7f061bfff700 1 -- 172.21.15.72:0/240811868 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06240137e0 con 0x7f063409d6f0 2023-10-03T10:15:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.794+0000 7f0639964700 1 -- 172.21.15.72:0/240811868 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06280094a0 con 0x7f063409d6f0 2023-10-03T10:15:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.794+0000 7f061bfff700 1 -- 172.21.15.72:0/240811868 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624013b50 con 0x7f063409d6f0 2023-10-03T10:15:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.794+0000 7f0639964700 1 -- 172.21.15.72:0/240811868 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0634124610 con 0x7f063409d6f0 2023-10-03T10:15:51.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.795+0000 7f061bfff700 1 -- 172.21.15.72:0/240811868 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0624013cb0 con 0x7f063409d6f0 2023-10-03T10:15:51.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.795+0000 7f0639964700 1 -- 172.21.15.72:0/240811868 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0634074ea0 con 0x7f063409d6f0 2023-10-03T10:15:51.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.795+0000 7f061bfff700 1 -- 172.21.15.72:0/240811868 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f062403f6c0 con 0x7f063409d6f0 2023-10-03T10:15:51.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.799+0000 7f061bfff700 1 -- 172.21.15.72:0/240811868 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f062401ba00 con 0x7f063409d6f0 2023-10-03T10:15:51.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.833+0000 7f3321390700 1 -- 172.21.15.72:0/3757589895 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f331c126790 con 0x7f331c09e850 2023-10-03T10:15:51.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.834+0000 7f33037fe700 1 -- 172.21.15.72:0/3757589895 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f330c021030 con 0x7f331c09e850 2023-10-03T10:15:51.833 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:51.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.836+0000 7f3321390700 1 -- 172.21.15.72:0/3757589895 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f331c09e850 msgr2=0x7f331c123610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.836+0000 7f3321390700 1 --2- 172.21.15.72:0/3757589895 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f331c09e850 0x7f331c123610 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f330c00ebe0 tx=0x7f330c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.836+0000 7f3321390700 1 -- 172.21.15.72:0/3757589895 shutdown_connections 2023-10-03T10:15:51.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.836+0000 7f3321390700 1 --2- 172.21.15.72:0/3757589895 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f331c134130 0x7f331c1c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.836+0000 7f3321390700 1 --2- 172.21.15.72:0/3757589895 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f331c09e850 0x7f331c123610 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.836+0000 7f3321390700 1 --2- 172.21.15.72:0/3757589895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f331c09f160 0x7f331c123b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.836+0000 7f3321390700 1 -- 172.21.15.72:0/3757589895 >> 172.21.15.72:0/3757589895 conn(0x7f331c0a3f70 msgr2=0x7f331c070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.836+0000 7f3321390700 1 -- 172.21.15.72:0/3757589895 shutdown_connections 2023-10-03T10:15:51.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.836+0000 7f3321390700 1 -- 172.21.15.72:0/3757589895 wait complete. 2023-10-03T10:15:51.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:51.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.864+0000 7fc9ba79a700 1 Processor -- start 2023-10-03T10:15:51.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.864+0000 7fc9ba79a700 1 -- start start 2023-10-03T10:15:51.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.864+0000 7fc9ba79a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9b4133420 0x7fc9b41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.864+0000 7fc9ba79a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9b4133e30 0x7fc9b412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.864+0000 7fc9ba79a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b406b990 con 0x7fc9b4134260 2023-10-03T10:15:51.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.864+0000 7fc9ba79a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b40a0590 con 0x7fc9b4133420 2023-10-03T10:15:51.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.864+0000 7fc9ba79a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b409fb80 con 0x7fc9b4133e30 2023-10-03T10:15:51.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.864+0000 7fc9b3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9b4133420 0x7fc9b41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.864+0000 7fc9b37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9b4133e30 0x7fc9b412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.864+0000 7fc9b3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9b4133420 0x7fc9b41337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41016/0 (socket says 172.21.15.72:41016) 2023-10-03T10:15:51.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.864+0000 7fc9b8d37700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc9b4134260 0x7fc9b41304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50360/0 (socket says 172.21.15.72:50360) 2023-10-03T10:15:51.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.864+0000 7fc9b37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9b4133e30 0x7fc9b412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36552/0 (socket says 172.21.15.72:36552) 2023-10-03T10:15:51.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.864+0000 7fc9b3fff700 1 -- 172.21.15.72:0/2453221041 learned_addr learned my addr 172.21.15.72:0/2453221041 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:51.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.865+0000 7fc9b2ffd700 1 -- 172.21.15.72:0/2453221041 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624897832 0 0) 0x7fc9b406b990 con 0x7fc9b4134260 2023-10-03T10:15:51.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.865+0000 7fc9b2ffd700 1 -- 172.21.15.72:0/2453221041 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc99c0035b0 con 0x7fc9b4134260 2023-10-03T10:15:51.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.865+0000 7fc9b37fe700 1 -- 172.21.15.72:0/2453221041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9b4133420 msgr2=0x7fc9b41337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.865+0000 7fc9b37fe700 1 --2- 172.21.15.72:0/2453221041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9b4133420 0x7fc9b41337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.865+0000 7fc9b37fe700 1 -- 172.21.15.72:0/2453221041 >> v1:172.21.15.72:6789/0 conn(0x7fc9b4134260 legacy=0x7fc9b41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.865+0000 7fc9b37fe700 1 -- 172.21.15.72:0/2453221041 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b40a0030 con 0x7fc9b4133e30 2023-10-03T10:15:51.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.865+0000 7fc9b3fff700 1 --2- 172.21.15.72:0/2453221041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9b4133420 0x7fc9b41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.865+0000 7fc9b37fe700 1 --2- 172.21.15.72:0/2453221041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9b4133e30 0x7fc9b412ff90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8009870 tx=0x7fc9a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a746667360c92f03 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.865+0000 7fc9b2ffd700 1 -- 172.21.15.72:0/2453221041 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8011830 con 0x7fc9b4133e30 2023-10-03T10:15:51.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.865+0000 7fc9b2ffd700 1 -- 172.21.15.72:0/2453221041 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a8011990 con 0x7fc9b4133e30 2023-10-03T10:15:51.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.865+0000 7fc9b2ffd700 1 -- 172.21.15.72:0/2453221041 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8011d20 con 0x7fc9b4133e30 2023-10-03T10:15:51.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.866+0000 7fc9ba79a700 1 -- 172.21.15.72:0/2453221041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9b4133e30 msgr2=0x7fc9b412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.866+0000 7fc9ba79a700 1 --2- 172.21.15.72:0/2453221041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9b4133e30 0x7fc9b412ff90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8009870 tx=0x7fc9a8009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:51.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.866+0000 7fc9ba79a700 1 -- 172.21.15.72:0/2453221041 shutdown_connections 2023-10-03T10:15:51.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.866+0000 7fc9ba79a700 1 --2- 172.21.15.72:0/2453221041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9b4133420 0x7fc9b41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.866+0000 7fc9ba79a700 1 --2- 172.21.15.72:0/2453221041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9b4133e30 0x7fc9b412ff90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.866+0000 7fc9ba79a700 1 -- 172.21.15.72:0/2453221041 >> 172.21.15.72:0/2453221041 conn(0x7fc9b40a4210 msgr2=0x7fc9b40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.866+0000 7fc9ba79a700 1 -- 172.21.15.72:0/2453221041 shutdown_connections 2023-10-03T10:15:51.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.866+0000 7fc9ba79a700 1 -- 172.21.15.72:0/2453221041 wait complete. 2023-10-03T10:15:51.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.867+0000 7fc9ba79a700 1 Processor -- start 2023-10-03T10:15:51.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.867+0000 7fc9ba79a700 1 -- start start 2023-10-03T10:15:51.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9ba79a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9b4133420 0x7fc9b409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9ba79a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9b4133e30 0x7fc9b409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9ba79a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9b4134260 0x7fc9b409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9ba79a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b411ff20 con 0x7fc9b4134260 2023-10-03T10:15:51.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9ba79a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b4120100 con 0x7fc9b4133420 2023-10-03T10:15:51.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9ba79a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b412d920 con 0x7fc9b4133e30 2023-10-03T10:15:51.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9b37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9b4133e30 0x7fc9b409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9b3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9b4133420 0x7fc9b409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9b37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9b4133e30 0x7fc9b409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36560/0 (socket says 172.21.15.72:36560) 2023-10-03T10:15:51.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9b37fe700 1 -- 172.21.15.72:0/1265360018 learned_addr learned my addr 172.21.15.72:0/1265360018 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9b8d37700 1 --2- 172.21.15.72:0/1265360018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9b4134260 0x7fc9b409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9b37fe700 1 -- 172.21.15.72:0/1265360018 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9b4133420 msgr2=0x7fc9b409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9b37fe700 1 --2- 172.21.15.72:0/1265360018 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9b4133420 0x7fc9b409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9b37fe700 1 -- 172.21.15.72:0/1265360018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9b4134260 msgr2=0x7fc9b409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9b37fe700 1 --2- 172.21.15.72:0/1265360018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9b4134260 0x7fc9b409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9b37fe700 1 -- 172.21.15.72:0/1265360018 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4009550 con 0x7fc9b4133e30 2023-10-03T10:15:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9b3fff700 1 --2- 172.21.15.72:0/1265360018 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9b4133420 0x7fc9b409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9b8d37700 1 --2- 172.21.15.72:0/1265360018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9b4134260 0x7fc9b409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.868+0000 7fc9b37fe700 1 --2- 172.21.15.72:0/1265360018 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9b4133e30 0x7fc9b409c9c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80090b0 tx=0x7fc9a8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.869+0000 7fc9b0ff9700 1 -- 172.21.15.72:0/1265360018 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8004450 con 0x7fc9b4133e30 2023-10-03T10:15:51.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.869+0000 7fc9b0ff9700 1 -- 172.21.15.72:0/1265360018 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a801f070 con 0x7fc9b4133e30 2023-10-03T10:15:51.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.869+0000 7fc9ba79a700 1 -- 172.21.15.72:0/1265360018 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a80094a0 con 0x7fc9b4133e30 2023-10-03T10:15:51.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.869+0000 7fc9b0ff9700 1 -- 172.21.15.72:0/1265360018 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a80038e0 con 0x7fc9b4133e30 2023-10-03T10:15:51.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.869+0000 7fc9ba79a700 1 -- 172.21.15.72:0/1265360018 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b411fb60 con 0x7fc9b4133e30 2023-10-03T10:15:51.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.869+0000 7fc9b0ff9700 1 -- 172.21.15.72:0/1265360018 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9a8003a40 con 0x7fc9b4133e30 2023-10-03T10:15:51.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.869+0000 7fc9b0ff9700 1 -- 172.21.15.72:0/1265360018 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc9a8021070 con 0x7fc9b4133e30 2023-10-03T10:15:51.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.870+0000 7fc9ba79a700 1 -- 172.21.15.72:0/1265360018 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b411fd50 con 0x7fc9b4133e30 2023-10-03T10:15:51.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.874+0000 7fc9b0ff9700 1 -- 172.21.15.72:0/1265360018 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9a801a950 con 0x7fc9b4133e30 2023-10-03T10:15:51.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.996+0000 7f0639964700 1 -- 172.21.15.72:0/240811868 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f06341303d0 con 0x7f063409d6f0 2023-10-03T10:15:51.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.996+0000 7f061bfff700 1 -- 172.21.15.72:0/240811868 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0624021070 con 0x7f063409d6f0 2023-10-03T10:15:51.996 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:51.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.998+0000 7f0639964700 1 -- 172.21.15.72:0/240811868 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f063409d6f0 msgr2=0x7f0634122270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.998+0000 7f0639964700 1 --2- 172.21.15.72:0/240811868 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f063409d6f0 0x7f0634122270 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f062400e960 tx=0x7f062400ec70 comp rx=0 tx=0).stop 2023-10-03T10:15:51.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.998+0000 7f0639964700 1 -- 172.21.15.72:0/240811868 shutdown_connections 2023-10-03T10:15:51.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.998+0000 7f0639964700 1 --2- 172.21.15.72:0/240811868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f063409e410 0x7f0634122cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.998+0000 7f0639964700 1 --2- 172.21.15.72:0/240811868 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f063409d6f0 0x7f0634122270 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.998+0000 7f0639964700 1 --2- 172.21.15.72:0/240811868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f063409e000 0x7f06341227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.998+0000 7f0639964700 1 -- 172.21.15.72:0/240811868 >> 172.21.15.72:0/240811868 conn(0x7f0634066f50 msgr2=0x7f063406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.998+0000 7f0639964700 1 -- 172.21.15.72:0/240811868 shutdown_connections 2023-10-03T10:15:51.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:51.998+0000 7f0639964700 1 -- 172.21.15.72:0/240811868 wait complete. 2023-10-03T10:15:52.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:52.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.066+0000 7fc9ba79a700 1 -- 172.21.15.72:0/1265360018 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc9b411f480 con 0x7fc9b4133e30 2023-10-03T10:15:52.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.066+0000 7fc9b0ff9700 1 -- 172.21.15.72:0/1265360018 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc9a802eb90 con 0x7fc9b4133e30 2023-10-03T10:15:52.066 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:52.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.069+0000 7fc9ba79a700 1 -- 172.21.15.72:0/1265360018 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9b4133e30 msgr2=0x7fc9b409c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.069+0000 7fc9ba79a700 1 --2- 172.21.15.72:0/1265360018 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9b4133e30 0x7fc9b409c9c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80090b0 tx=0x7fc9a8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:52.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.069+0000 7fc9ba79a700 1 -- 172.21.15.72:0/1265360018 shutdown_connections 2023-10-03T10:15:52.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.069+0000 7fc9ba79a700 1 --2- 172.21.15.72:0/1265360018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9b4134260 0x7fc9b409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.069+0000 7fc9ba79a700 1 --2- 172.21.15.72:0/1265360018 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9b4133420 0x7fc9b409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.069+0000 7fc9ba79a700 1 --2- 172.21.15.72:0/1265360018 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc9b4133e30 0x7fc9b409c9c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.069+0000 7fc9ba79a700 1 -- 172.21.15.72:0/1265360018 >> 172.21.15.72:0/1265360018 conn(0x7fc9b40a4210 msgr2=0x7fc9b4130460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.069+0000 7fc9ba79a700 1 -- 172.21.15.72:0/1265360018 shutdown_connections 2023-10-03T10:15:52.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.069+0000 7fc9ba79a700 1 -- 172.21.15.72:0/1265360018 wait complete. 2023-10-03T10:15:52.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:52.144 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:52.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.266+0000 7fbdd35f9700 1 Processor -- start 2023-10-03T10:15:52.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.266+0000 7fbdd35f9700 1 -- start start 2023-10-03T10:15:52.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.266+0000 7fbdd35f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc1338a0 0x7fbdcc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.266+0000 7fbdd35f9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbdcc09de50 0x7fbdcc09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.266+0000 7fbdd35f9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc09e760 0x7fbdcc13a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.266+0000 7fbdd35f9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdcc06fef0 con 0x7fbdcc09de50 2023-10-03T10:15:52.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.266+0000 7fbdd35f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc06ef30 con 0x7fbdcc1338a0 2023-10-03T10:15:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.266+0000 7fbdd35f9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc1334b0 con 0x7fbdcc09e760 2023-10-03T10:15:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdd0b94700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbdcc09de50 0x7fbdcc09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdd1395700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc1338a0 0x7fbdcc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdd1b96700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc09e760 0x7fbdcc13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdd1395700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc1338a0 0x7fbdcc133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41034/0 (socket says 172.21.15.72:41034) 2023-10-03T10:15:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdd0b94700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbdcc09de50 0x7fbdcc09e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46516/0 (socket says 172.21.15.72:46516) 2023-10-03T10:15:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdd1b96700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc09e760 0x7fbdcc13a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36562/0 (socket says 172.21.15.72:36562) 2023-10-03T10:15:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdd1395700 1 -- 172.21.15.72:0/2730145964 learned_addr learned my addr 172.21.15.72:0/2730145964 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdd1395700 1 -- 172.21.15.72:0/2730145964 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc09e760 msgr2=0x7fbdcc13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdd1395700 1 --2- 172.21.15.72:0/2730145964 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc09e760 0x7fbdcc13a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdd1395700 1 -- 172.21.15.72:0/2730145964 >> v2:172.21.15.72:3300/0 conn(0x7fbdcc09de50 msgr2=0x7fbdcc09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdd1395700 1 --2- 172.21.15.72:0/2730145964 >> v2:172.21.15.72:3300/0 conn(0x7fbdcc09de50 0x7fbdcc09e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdd1395700 1 -- 172.21.15.72:0/2730145964 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc06fc30 con 0x7fbdcc1338a0 2023-10-03T10:15:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdd1b96700 1 --2- 172.21.15.72:0/2730145964 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc09e760 0x7fbdcc13a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdd0b94700 1 --2- 172.21.15.72:0/2730145964 >> v2:172.21.15.72:3300/0 conn(0x7fbdcc09de50 0x7fbdcc09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdd1395700 1 --2- 172.21.15.72:0/2730145964 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc1338a0 0x7fbdcc133c70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80098f0 tx=0x7fbdc8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e39508d10cc1f3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdc3fff700 1 -- 172.21.15.72:0/2730145964 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8011830 con 0x7fbdcc1338a0 2023-10-03T10:15:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdc3fff700 1 -- 172.21.15.72:0/2730145964 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc8011990 con 0x7fbdcc1338a0 2023-10-03T10:15:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.267+0000 7fbdc3fff700 1 -- 172.21.15.72:0/2730145964 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8011d20 con 0x7fbdcc1338a0 2023-10-03T10:15:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.268+0000 7fbdd35f9700 1 -- 172.21.15.72:0/2730145964 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc1338a0 msgr2=0x7fbdcc133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.268+0000 7fbdd35f9700 1 --2- 172.21.15.72:0/2730145964 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc1338a0 0x7fbdcc133c70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80098f0 tx=0x7fbdc8009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.268+0000 7fbdd35f9700 1 -- 172.21.15.72:0/2730145964 shutdown_connections 2023-10-03T10:15:52.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.268+0000 7fbdd35f9700 1 --2- 172.21.15.72:0/2730145964 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc09e760 0x7fbdcc13a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.268+0000 7fbdd35f9700 1 --2- 172.21.15.72:0/2730145964 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc1338a0 0x7fbdcc133c70 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.268+0000 7fbdd35f9700 1 --2- 172.21.15.72:0/2730145964 >> v2:172.21.15.72:3300/0 conn(0x7fbdcc09de50 0x7fbdcc09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.268+0000 7fbdd35f9700 1 -- 172.21.15.72:0/2730145964 >> 172.21.15.72:0/2730145964 conn(0x7fbdcc0a2aa0 msgr2=0x7fbdcc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.268+0000 7fbdd35f9700 1 -- 172.21.15.72:0/2730145964 shutdown_connections 2023-10-03T10:15:52.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.268+0000 7fbdd35f9700 1 -- 172.21.15.72:0/2730145964 wait complete. 2023-10-03T10:15:52.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.269+0000 7fbdd35f9700 1 Processor -- start 2023-10-03T10:15:52.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.269+0000 7fbdd35f9700 1 -- start start 2023-10-03T10:15:52.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.269+0000 7fbdd35f9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc09de50 0x7fbdcc11eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.269+0000 7fbdd35f9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdcc09e760 0x7fbdcc11f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.269+0000 7fbdd35f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc1338a0 0x7fbdcc11f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.269+0000 7fbdd35f9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc0a10f0 con 0x7fbdcc09e760 2023-10-03T10:15:52.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.269+0000 7fbdd35f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc06f640 con 0x7fbdcc1338a0 2023-10-03T10:15:52.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.269+0000 7fbdd35f9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc122150 con 0x7fbdcc09de50 2023-10-03T10:15:52.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.269+0000 7fbdd1395700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc09de50 0x7fbdcc11eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.269+0000 7fbdd0b94700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdcc09e760 0x7fbdcc11f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.269+0000 7fbdd1b96700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc1338a0 0x7fbdcc11f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.269+0000 7fbdd1395700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc09de50 0x7fbdcc11eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36564/0 (socket says 172.21.15.72:36564) 2023-10-03T10:15:52.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.269+0000 7fbdd1395700 1 -- 172.21.15.72:0/1027468559 learned_addr learned my addr 172.21.15.72:0/1027468559 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:52.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.270+0000 7fbdd1b96700 1 -- 172.21.15.72:0/1027468559 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc09de50 msgr2=0x7fbdcc11eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.270+0000 7fbdd1b96700 1 --2- 172.21.15.72:0/1027468559 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc09de50 0x7fbdcc11eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.270+0000 7fbdd1b96700 1 -- 172.21.15.72:0/1027468559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdcc09e760 msgr2=0x7fbdcc11f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.270+0000 7fbdd1b96700 1 --2- 172.21.15.72:0/1027468559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdcc09e760 0x7fbdcc11f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.270+0000 7fbdd1b96700 1 -- 172.21.15.72:0/1027468559 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc0094a0 con 0x7fbdcc1338a0 2023-10-03T10:15:52.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.270+0000 7fbdd1b96700 1 --2- 172.21.15.72:0/1027468559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc1338a0 0x7fbdcc11f720 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400efc0 tx=0x7fbdc400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.270+0000 7fbdc1ffb700 1 -- 172.21.15.72:0/1027468559 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc400ca90 con 0x7fbdcc1338a0 2023-10-03T10:15:52.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.270+0000 7fbdc1ffb700 1 -- 172.21.15.72:0/1027468559 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc400f040 con 0x7fbdcc1338a0 2023-10-03T10:15:52.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.270+0000 7fbdd35f9700 1 -- 172.21.15.72:0/1027468559 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc4009a70 con 0x7fbdcc1338a0 2023-10-03T10:15:52.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.270+0000 7fbdc1ffb700 1 -- 172.21.15.72:0/1027468559 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc400ce30 con 0x7fbdcc1338a0 2023-10-03T10:15:52.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.270+0000 7fbdd35f9700 1 -- 172.21.15.72:0/1027468559 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc8009550 con 0x7fbdcc1338a0 2023-10-03T10:15:52.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.271+0000 7fbdc1ffb700 1 -- 172.21.15.72:0/1027468559 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbdc4014480 con 0x7fbdcc1338a0 2023-10-03T10:15:52.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.271+0000 7fbdc1ffb700 1 -- 172.21.15.72:0/1027468559 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbdc403fc20 con 0x7fbdcc1338a0 2023-10-03T10:15:52.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.271+0000 7fbdd35f9700 1 -- 172.21.15.72:0/1027468559 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdcc074ea0 con 0x7fbdcc1338a0 2023-10-03T10:15:52.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.276+0000 7fbdc1ffb700 1 -- 172.21.15.72:0/1027468559 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdc4012910 con 0x7fbdcc1338a0 2023-10-03T10:15:52.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.461+0000 7fbdd35f9700 1 -- 172.21.15.72:0/1027468559 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbdcc066a20 con 0x7fbdcc1338a0 2023-10-03T10:15:52.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.461+0000 7fbdc1ffb700 1 -- 172.21.15.72:0/1027468559 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbdc4012340 con 0x7fbdcc1338a0 2023-10-03T10:15:52.461 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:52.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.463+0000 7fbdd35f9700 1 -- 172.21.15.72:0/1027468559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc1338a0 msgr2=0x7fbdcc11f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.463+0000 7fbdd35f9700 1 --2- 172.21.15.72:0/1027468559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc1338a0 0x7fbdcc11f720 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400efc0 tx=0x7fbdc400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.463+0000 7fbdd35f9700 1 -- 172.21.15.72:0/1027468559 shutdown_connections 2023-10-03T10:15:52.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.463+0000 7fbdd35f9700 1 --2- 172.21.15.72:0/1027468559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdcc1338a0 0x7fbdcc11f720 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.463+0000 7fbdd35f9700 1 --2- 172.21.15.72:0/1027468559 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdcc09de50 0x7fbdcc11eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.463+0000 7fbdd35f9700 1 --2- 172.21.15.72:0/1027468559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdcc09e760 0x7fbdcc11f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.463+0000 7fbdd35f9700 1 -- 172.21.15.72:0/1027468559 >> 172.21.15.72:0/1027468559 conn(0x7fbdcc0a2aa0 msgr2=0x7fbdcc09ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.463+0000 7fbdd35f9700 1 -- 172.21.15.72:0/1027468559 shutdown_connections 2023-10-03T10:15:52.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.463+0000 7fbdd35f9700 1 -- 172.21.15.72:0/1027468559 wait complete. 2023-10-03T10:15:52.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:52.853 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:52.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.976+0000 7fa4b59f8700 1 Processor -- start 2023-10-03T10:15:52.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.976+0000 7fa4b59f8700 1 -- start start 2023-10-03T10:15:52.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.976+0000 7fa4b59f8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4b00a0a30 0x7fa4b00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.976+0000 7fa4b59f8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4b0138d80 0x7fa4b013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.976+0000 7fa4b59f8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b00a2a70 con 0x7fa4b009d630 2023-10-03T10:15:52.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.976+0000 7fa4b59f8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b00a01d0 con 0x7fa4b00a0a30 2023-10-03T10:15:52.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.976+0000 7fa4b59f8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b009e2b0 con 0x7fa4b0138d80 2023-10-03T10:15:52.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.977+0000 7fa4aeffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4b00a0a30 0x7fa4b00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.977+0000 7fa4af7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4b0138d80 0x7fa4b013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.977+0000 7fa4aeffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4b00a0a30 0x7fa4b00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46532/0 (socket says 172.21.15.72:46532) 2023-10-03T10:15:52.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.977+0000 7fa4af7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4b0138d80 0x7fa4b013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36570/0 (socket says 172.21.15.72:36570) 2023-10-03T10:15:52.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.977+0000 7fa4aeffd700 1 -- 172.21.15.72:0/1649789423 learned_addr learned my addr 172.21.15.72:0/1649789423 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:52.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.977+0000 7fa4aeffd700 1 -- 172.21.15.72:0/1649789423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4b0138d80 msgr2=0x7fa4b013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.977+0000 7fa4aeffd700 1 --2- 172.21.15.72:0/1649789423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4b0138d80 0x7fa4b013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.977+0000 7fa4aeffd700 1 -- 172.21.15.72:0/1649789423 >> v1:172.21.15.72:6789/0 conn(0x7fa4b009d630 legacy=0x7fa4b00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.977+0000 7fa4aeffd700 1 -- 172.21.15.72:0/1649789423 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b009dc50 con 0x7fa4b00a0a30 2023-10-03T10:15:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.977+0000 7fa4adffb700 1 -- 172.21.15.72:0/1649789423 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023230876 0 0) 0x7fa4b00a2a70 con 0x7fa4b009d630 2023-10-03T10:15:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.977+0000 7fa4af7fe700 1 --2- 172.21.15.72:0/1649789423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4b0138d80 0x7fa4b013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.977+0000 7fa4aeffd700 1 --2- 172.21.15.72:0/1649789423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b00a0a30 0x7fa4b00a0e00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40098f0 tx=0x7fa4a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbabb477dcff0481 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.977+0000 7fa4adffb700 1 -- 172.21.15.72:0/1649789423 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4011830 con 0x7fa4b00a0a30 2023-10-03T10:15:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.977+0000 7fa4adffb700 1 -- 172.21.15.72:0/1649789423 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a4011990 con 0x7fa4b00a0a30 2023-10-03T10:15:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.977+0000 7fa4adffb700 1 -- 172.21.15.72:0/1649789423 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4011d20 con 0x7fa4b00a0a30 2023-10-03T10:15:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.978+0000 7fa4b59f8700 1 -- 172.21.15.72:0/1649789423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b00a0a30 msgr2=0x7fa4b00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.978+0000 7fa4b59f8700 1 --2- 172.21.15.72:0/1649789423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b00a0a30 0x7fa4b00a0e00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40098f0 tx=0x7fa4a4009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.978+0000 7fa4b59f8700 1 -- 172.21.15.72:0/1649789423 shutdown_connections 2023-10-03T10:15:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.978+0000 7fa4b59f8700 1 --2- 172.21.15.72:0/1649789423 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4b0138d80 0x7fa4b013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.978+0000 7fa4b59f8700 1 --2- 172.21.15.72:0/1649789423 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b00a0a30 0x7fa4b00a0e00 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.978+0000 7fa4b59f8700 1 -- 172.21.15.72:0/1649789423 >> 172.21.15.72:0/1649789423 conn(0x7fa4b00a3050 msgr2=0x7fa4b00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.978+0000 7fa4b59f8700 1 -- 172.21.15.72:0/1649789423 shutdown_connections 2023-10-03T10:15:52.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.978+0000 7fa4b59f8700 1 -- 172.21.15.72:0/1649789423 wait complete. 2023-10-03T10:15:52.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.979+0000 7fa4b59f8700 1 Processor -- start 2023-10-03T10:15:52.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.979+0000 7fa4b59f8700 1 -- start start 2023-10-03T10:15:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.979+0000 7fa4b59f8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b009d630 0x7fa4b0133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.979+0000 7fa4b59f8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4b00a0a30 0x7fa4b0133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.979+0000 7fa4b59f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4b0138d80 0x7fa4b01341e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.979+0000 7fa4b59f8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b0136fa0 con 0x7fa4b009d630 2023-10-03T10:15:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.979+0000 7fa4b59f8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b0136630 con 0x7fa4b0138d80 2023-10-03T10:15:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.979+0000 7fa4b59f8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b00a4b50 con 0x7fa4b00a0a30 2023-10-03T10:15:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.979+0000 7fa4aeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b009d630 0x7fa4b0133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.979+0000 7fa4ae7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4b00a0a30 0x7fa4b0133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.979+0000 7fa4aeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b009d630 0x7fa4b0133760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46538/0 (socket says 172.21.15.72:46538) 2023-10-03T10:15:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.979+0000 7fa4ae7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4b00a0a30 0x7fa4b0133ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36582/0 (socket says 172.21.15.72:36582) 2023-10-03T10:15:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.979+0000 7fa4aeffd700 1 -- 172.21.15.72:0/1158976492 learned_addr learned my addr 172.21.15.72:0/1158976492 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.979+0000 7fa4af7fe700 1 --2- 172.21.15.72:0/1158976492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4b0138d80 0x7fa4b01341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.980+0000 7fa4aeffd700 1 -- 172.21.15.72:0/1158976492 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4b00a0a30 msgr2=0x7fa4b0133ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.980+0000 7fa4aeffd700 1 --2- 172.21.15.72:0/1158976492 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4b00a0a30 0x7fa4b0133ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.980+0000 7fa4aeffd700 1 -- 172.21.15.72:0/1158976492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4b0138d80 msgr2=0x7fa4b01341e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.980+0000 7fa4aeffd700 1 --2- 172.21.15.72:0/1158976492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4b0138d80 0x7fa4b01341e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.980+0000 7fa4aeffd700 1 -- 172.21.15.72:0/1158976492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a8009a70 con 0x7fa4b009d630 2023-10-03T10:15:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.980+0000 7fa4aeffd700 1 --2- 172.21.15.72:0/1158976492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b009d630 0x7fa4b0133760 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009c40 tx=0x7fa4a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.980+0000 7fa497fff700 1 -- 172.21.15.72:0/1158976492 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4004510 con 0x7fa4b009d630 2023-10-03T10:15:52.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.980+0000 7fa497fff700 1 -- 172.21.15.72:0/1158976492 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a40036a0 con 0x7fa4b009d630 2023-10-03T10:15:52.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.980+0000 7fa497fff700 1 -- 172.21.15.72:0/1158976492 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4003a50 con 0x7fa4b009d630 2023-10-03T10:15:52.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.980+0000 7fa4b59f8700 1 -- 172.21.15.72:0/1158976492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a4009550 con 0x7fa4b009d630 2023-10-03T10:15:52.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.980+0000 7fa4b59f8700 1 -- 172.21.15.72:0/1158976492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b0137a10 con 0x7fa4b009d630 2023-10-03T10:15:52.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.981+0000 7fa497fff700 1 -- 172.21.15.72:0/1158976492 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4a4021070 con 0x7fa4b009d630 2023-10-03T10:15:52.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.981+0000 7fa497fff700 1 -- 172.21.15.72:0/1158976492 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa4a40409e0 con 0x7fa4b009d630 2023-10-03T10:15:52.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.981+0000 7fa4b59f8700 1 -- 172.21.15.72:0/1158976492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b0136c40 con 0x7fa4b009d630 2023-10-03T10:15:52.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:52.986+0000 7fa497fff700 1 -- 172.21.15.72:0/1158976492 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4a4029080 con 0x7fa4b009d630 2023-10-03T10:15:53.011 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:53.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:53.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.135+0000 7fcd09068700 1 Processor -- start 2023-10-03T10:15:53.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.135+0000 7fcd09068700 1 -- start start 2023-10-03T10:15:53.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd09068700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd040a0a30 0x7fcd040a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd09068700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd04138d80 0x7fcd0413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd09068700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd040a2a70 con 0x7fcd0409d630 2023-10-03T10:15:53.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd09068700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd040a01d0 con 0x7fcd04138d80 2023-10-03T10:15:53.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd09068700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0409e2b0 con 0x7fcd040a0a30 2023-10-03T10:15:53.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd02d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd040a0a30 0x7fcd040a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd0259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcd0409d630 0x7fcd040a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50382/0 (socket says 172.21.15.72:50382) 2023-10-03T10:15:53.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd0259c700 1 -- 172.21.15.72:0/3032070742 learned_addr learned my addr 172.21.15.72:0/3032070742 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:53.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd0359e700 1 --2- 172.21.15.72:0/3032070742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd04138d80 0x7fcd0413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd02d9d700 1 -- 172.21.15.72:0/3032070742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd04138d80 msgr2=0x7fcd0413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd02d9d700 1 --2- 172.21.15.72:0/3032070742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd04138d80 0x7fcd0413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd02d9d700 1 -- 172.21.15.72:0/3032070742 >> v1:172.21.15.72:6789/0 conn(0x7fcd0409d630 legacy=0x7fcd040a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd02d9d700 1 -- 172.21.15.72:0/3032070742 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0409dc50 con 0x7fcd040a0a30 2023-10-03T10:15:53.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd0359e700 1 --2- 172.21.15.72:0/3032070742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd04138d80 0x7fcd0413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:53.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd02d9d700 1 --2- 172.21.15.72:0/3032070742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd040a0a30 0x7fcd040a0e00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009870 tx=0x7fccf4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee7a5d0b8cff8e94 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd01d9b700 1 -- 172.21.15.72:0/3032070742 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4011830 con 0x7fcd040a0a30 2023-10-03T10:15:53.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.136+0000 7fcd01d9b700 1 -- 172.21.15.72:0/3032070742 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4011990 con 0x7fcd040a0a30 2023-10-03T10:15:53.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.137+0000 7fcd01d9b700 1 -- 172.21.15.72:0/3032070742 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4011d20 con 0x7fcd040a0a30 2023-10-03T10:15:53.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.137+0000 7fcd09068700 1 -- 172.21.15.72:0/3032070742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd040a0a30 msgr2=0x7fcd040a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.137+0000 7fcd09068700 1 --2- 172.21.15.72:0/3032070742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd040a0a30 0x7fcd040a0e00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009870 tx=0x7fccf4009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:53.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.137+0000 7fcd09068700 1 -- 172.21.15.72:0/3032070742 shutdown_connections 2023-10-03T10:15:53.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.137+0000 7fcd09068700 1 --2- 172.21.15.72:0/3032070742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd04138d80 0x7fcd0413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.137+0000 7fcd09068700 1 --2- 172.21.15.72:0/3032070742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd040a0a30 0x7fcd040a0e00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.137+0000 7fcd09068700 1 -- 172.21.15.72:0/3032070742 >> 172.21.15.72:0/3032070742 conn(0x7fcd040a3050 msgr2=0x7fcd040a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.137+0000 7fcd09068700 1 -- 172.21.15.72:0/3032070742 shutdown_connections 2023-10-03T10:15:53.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.137+0000 7fcd09068700 1 -- 172.21.15.72:0/3032070742 wait complete. 2023-10-03T10:15:53.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.138+0000 7fcd09068700 1 Processor -- start 2023-10-03T10:15:53.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.138+0000 7fcd09068700 1 -- start start 2023-10-03T10:15:53.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd09068700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd0409d630 0x7fcd041208a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd09068700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd040a0a30 0x7fcd04120de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd09068700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd04138d80 0x7fcd04121320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd09068700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd04124050 con 0x7fcd040a0a30 2023-10-03T10:15:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd09068700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd04123330 con 0x7fcd04138d80 2023-10-03T10:15:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd09068700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd040a4e20 con 0x7fcd0409d630 2023-10-03T10:15:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd02d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd0409d630 0x7fcd041208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd0359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd04138d80 0x7fcd04121320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd02d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd0409d630 0x7fcd041208a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36598/0 (socket says 172.21.15.72:36598) 2023-10-03T10:15:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd0259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd040a0a30 0x7fcd04120de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd0359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd04138d80 0x7fcd04121320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41078/0 (socket says 172.21.15.72:41078) 2023-10-03T10:15:53.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd02d9d700 1 -- 172.21.15.72:0/847965632 learned_addr learned my addr 172.21.15.72:0/847965632 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd0359e700 1 -- 172.21.15.72:0/847965632 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd0409d630 msgr2=0x7fcd041208a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd0359e700 1 --2- 172.21.15.72:0/847965632 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd0409d630 0x7fcd041208a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd0359e700 1 -- 172.21.15.72:0/847965632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd040a0a30 msgr2=0x7fcd04120de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd0359e700 1 --2- 172.21.15.72:0/847965632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd040a0a30 0x7fcd04120de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd0359e700 1 -- 172.21.15.72:0/847965632 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf40094a0 con 0x7fcd04138d80 2023-10-03T10:15:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd02d9d700 1 --2- 172.21.15.72:0/847965632 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd0409d630 0x7fcd041208a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd0259c700 1 --2- 172.21.15.72:0/847965632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd040a0a30 0x7fcd04120de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.139+0000 7fcd0359e700 1 --2- 172.21.15.72:0/847965632 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd04138d80 0x7fcd04121320 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcd040a23a0 tx=0x7fccfc00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.140+0000 7fcceb7fe700 1 -- 172.21.15.72:0/847965632 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00dcf0 con 0x7fcd04138d80 2023-10-03T10:15:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.140+0000 7fcceb7fe700 1 -- 172.21.15.72:0/847965632 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc00f040 con 0x7fcd04138d80 2023-10-03T10:15:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.140+0000 7fcd09068700 1 -- 172.21.15.72:0/847965632 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd040a0410 con 0x7fcd04138d80 2023-10-03T10:15:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.140+0000 7fcceb7fe700 1 -- 172.21.15.72:0/847965632 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc015640 con 0x7fcd04138d80 2023-10-03T10:15:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.140+0000 7fcd09068700 1 -- 172.21.15.72:0/847965632 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd04124330 con 0x7fcd04138d80 2023-10-03T10:15:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.140+0000 7fcceb7fe700 1 -- 172.21.15.72:0/847965632 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fccfc01e3b0 con 0x7fcd04138d80 2023-10-03T10:15:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.141+0000 7fcceb7fe700 1 -- 172.21.15.72:0/847965632 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fccfc03f7d0 con 0x7fcd04138d80 2023-10-03T10:15:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.141+0000 7fcd09068700 1 -- 172.21.15.72:0/847965632 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd040747f0 con 0x7fcd04138d80 2023-10-03T10:15:53.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.150+0000 7fcceb7fe700 1 -- 172.21.15.72:0/847965632 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fccfc01c2c0 con 0x7fcd04138d80 2023-10-03T10:15:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.193+0000 7fa4b59f8700 1 -- 172.21.15.72:0/1158976492 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa4b00747f0 con 0x7fa4b009d630 2023-10-03T10:15:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.194+0000 7fa497fff700 1 -- 172.21.15.72:0/1158976492 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4a4015020 con 0x7fa4b009d630 2023-10-03T10:15:53.193 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:53.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.197+0000 7fa4b59f8700 1 -- 172.21.15.72:0/1158976492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b009d630 msgr2=0x7fa4b0133760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.197+0000 7fa4b59f8700 1 --2- 172.21.15.72:0/1158976492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b009d630 0x7fa4b0133760 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009c40 tx=0x7fa4a4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:53.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.197+0000 7fa4b59f8700 1 -- 172.21.15.72:0/1158976492 shutdown_connections 2023-10-03T10:15:53.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.197+0000 7fa4b59f8700 1 --2- 172.21.15.72:0/1158976492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b009d630 0x7fa4b0133760 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.197+0000 7fa4b59f8700 1 --2- 172.21.15.72:0/1158976492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4b0138d80 0x7fa4b01341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.197+0000 7fa4b59f8700 1 --2- 172.21.15.72:0/1158976492 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4b00a0a30 0x7fa4b0133ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.197+0000 7fa4b59f8700 1 -- 172.21.15.72:0/1158976492 >> 172.21.15.72:0/1158976492 conn(0x7fa4b00a3050 msgr2=0x7fa4b013ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.197+0000 7fa4b59f8700 1 -- 172.21.15.72:0/1158976492 shutdown_connections 2023-10-03T10:15:53.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.197+0000 7fa4b59f8700 1 -- 172.21.15.72:0/1158976492 wait complete. 2023-10-03T10:15:53.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.215+0000 7f47af172700 1 Processor -- start 2023-10-03T10:15:53.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.215+0000 7f47af172700 1 -- start start 2023-10-03T10:15:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47af172700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47a809d6f0 0x7f47a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47af172700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a809e000 0x7f47a81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47af172700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47a809e410 0x7f47a8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47af172700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a806b460 con 0x7f47a809d6f0 2023-10-03T10:15:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47af172700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a809b120 con 0x7f47a809e000 2023-10-03T10:15:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47af172700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47a809a7e0 con 0x7f47a809e410 2023-10-03T10:15:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47a7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a809e000 0x7f47a81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47ad70f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47a809e410 0x7f47a8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47a7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a809e000 0x7f47a81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41080/0 (socket says 172.21.15.72:41080) 2023-10-03T10:15:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47ad70f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47a809e410 0x7f47a8133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36612/0 (socket says 172.21.15.72:36612) 2023-10-03T10:15:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47a7fff700 1 -- 172.21.15.72:0/3273164513 learned_addr learned my addr 172.21.15.72:0/3273164513 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47acf0e700 1 --2- 172.21.15.72:0/3273164513 >> v2:172.21.15.72:3300/0 conn(0x7f47a809d6f0 0x7f47a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47a7fff700 1 -- 172.21.15.72:0/3273164513 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47a809e410 msgr2=0x7f47a8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47a7fff700 1 --2- 172.21.15.72:0/3273164513 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47a809e410 0x7f47a8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47a7fff700 1 -- 172.21.15.72:0/3273164513 >> v2:172.21.15.72:3300/0 conn(0x7f47a809d6f0 msgr2=0x7f47a809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47a7fff700 1 --2- 172.21.15.72:0/3273164513 >> v2:172.21.15.72:3300/0 conn(0x7f47a809d6f0 0x7f47a809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47a7fff700 1 -- 172.21.15.72:0/3273164513 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a809a500 con 0x7f47a809e000 2023-10-03T10:15:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47ad70f700 1 --2- 172.21.15.72:0/3273164513 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47a809e410 0x7f47a8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.216+0000 7f47acf0e700 1 --2- 172.21.15.72:0/3273164513 >> v2:172.21.15.72:3300/0 conn(0x7f47a809d6f0 0x7f47a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.217+0000 7f47a7fff700 1 --2- 172.21.15.72:0/3273164513 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a809e000 0x7f47a81339f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4794009920 tx=0x7f4794009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42fbb0ae282b679a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.217+0000 7f47a77fe700 1 -- 172.21.15.72:0/3273164513 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794011830 con 0x7f47a809e000 2023-10-03T10:15:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.217+0000 7f47a77fe700 1 -- 172.21.15.72:0/3273164513 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4794011990 con 0x7f47a809e000 2023-10-03T10:15:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.217+0000 7f47a77fe700 1 -- 172.21.15.72:0/3273164513 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794011d20 con 0x7f47a809e000 2023-10-03T10:15:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.217+0000 7f47af172700 1 -- 172.21.15.72:0/3273164513 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a809e000 msgr2=0x7f47a81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.217+0000 7f47af172700 1 --2- 172.21.15.72:0/3273164513 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a809e000 0x7f47a81339f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4794009920 tx=0x7f4794009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.217+0000 7f47af172700 1 -- 172.21.15.72:0/3273164513 shutdown_connections 2023-10-03T10:15:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.217+0000 7f47af172700 1 --2- 172.21.15.72:0/3273164513 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47a809e410 0x7f47a8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.217+0000 7f47af172700 1 --2- 172.21.15.72:0/3273164513 >> v2:172.21.15.72:3300/0 conn(0x7f47a809d6f0 0x7f47a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.217+0000 7f47af172700 1 --2- 172.21.15.72:0/3273164513 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a809e000 0x7f47a81339f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.217+0000 7f47af172700 1 -- 172.21.15.72:0/3273164513 >> 172.21.15.72:0/3273164513 conn(0x7f47a8066f50 msgr2=0x7f47a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.217+0000 7f47af172700 1 -- 172.21.15.72:0/3273164513 shutdown_connections 2023-10-03T10:15:53.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.217+0000 7f47af172700 1 -- 172.21.15.72:0/3273164513 wait complete. 2023-10-03T10:15:53.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.218+0000 7f47af172700 1 Processor -- start 2023-10-03T10:15:53.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.218+0000 7f47af172700 1 -- start start 2023-10-03T10:15:53.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47af172700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47a809d6f0 0x7f47a81a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47af172700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a809e000 0x7f47a81a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47af172700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47a809e410 0x7f47a81a6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47af172700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a81a98e0 con 0x7f47a809d6f0 2023-10-03T10:15:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47af172700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a81a7ff0 con 0x7f47a809e000 2023-10-03T10:15:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47af172700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47a81aa280 con 0x7f47a809e410 2023-10-03T10:15:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47acf0e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47a809d6f0 0x7f47a81a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47ad70f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47a809e410 0x7f47a81a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47acf0e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47a809d6f0 0x7f47a81a5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46560/0 (socket says 172.21.15.72:46560) 2023-10-03T10:15:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47acf0e700 1 -- 172.21.15.72:0/758123724 learned_addr learned my addr 172.21.15.72:0/758123724 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47a7fff700 1 --2- 172.21.15.72:0/758123724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a809e000 0x7f47a81a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47a7fff700 1 -- 172.21.15.72:0/758123724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47a809e410 msgr2=0x7f47a81a6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47a7fff700 1 --2- 172.21.15.72:0/758123724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47a809e410 0x7f47a81a6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47a7fff700 1 -- 172.21.15.72:0/758123724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47a809d6f0 msgr2=0x7f47a81a5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47a7fff700 1 --2- 172.21.15.72:0/758123724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47a809d6f0 0x7f47a81a5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47a7fff700 1 -- 172.21.15.72:0/758123724 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c0094a0 con 0x7f47a809e000 2023-10-03T10:15:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47ad70f700 1 --2- 172.21.15.72:0/758123724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47a809e410 0x7f47a81a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.219+0000 7f47a7fff700 1 --2- 172.21.15.72:0/758123724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a809e000 0x7f47a81a6300 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4794016000 tx=0x7f4794004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.220+0000 7f47a57fa700 1 -- 172.21.15.72:0/758123724 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794004450 con 0x7f47a809e000 2023-10-03T10:15:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.220+0000 7f47a57fa700 1 -- 172.21.15.72:0/758123724 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47940045b0 con 0x7f47a809e000 2023-10-03T10:15:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.220+0000 7f47af172700 1 -- 172.21.15.72:0/758123724 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a0009a70 con 0x7f47a809e000 2023-10-03T10:15:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.220+0000 7f47a57fa700 1 -- 172.21.15.72:0/758123724 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47940038e0 con 0x7f47a809e000 2023-10-03T10:15:53.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.220+0000 7f47af172700 1 -- 172.21.15.72:0/758123724 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4794009550 con 0x7f47a809e000 2023-10-03T10:15:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.220+0000 7f47a57fa700 1 -- 172.21.15.72:0/758123724 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4794003a40 con 0x7f47a809e000 2023-10-03T10:15:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.221+0000 7f47a57fa700 1 -- 172.21.15.72:0/758123724 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4794021030 con 0x7f47a809e000 2023-10-03T10:15:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.221+0000 7f47af172700 1 -- 172.21.15.72:0/758123724 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a8074ea0 con 0x7f47a809e000 2023-10-03T10:15:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.225+0000 7f47a57fa700 1 -- 172.21.15.72:0/758123724 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4794015070 con 0x7f47a809e000 2023-10-03T10:15:53.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.347+0000 7fcd09068700 1 -- 172.21.15.72:0/847965632 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcd04072980 con 0x7fcd04138d80 2023-10-03T10:15:53.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.348+0000 7fcceb7fe700 1 -- 172.21.15.72:0/847965632 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fccfc01a020 con 0x7fcd04138d80 2023-10-03T10:15:53.347 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:53.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.350+0000 7fcd09068700 1 -- 172.21.15.72:0/847965632 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd04138d80 msgr2=0x7fcd04121320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.350+0000 7fcd09068700 1 --2- 172.21.15.72:0/847965632 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd04138d80 0x7fcd04121320 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcd040a23a0 tx=0x7fccfc00d3b0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.350+0000 7fcd09068700 1 -- 172.21.15.72:0/847965632 shutdown_connections 2023-10-03T10:15:53.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.350+0000 7fcd09068700 1 --2- 172.21.15.72:0/847965632 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd04138d80 0x7fcd04121320 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.350+0000 7fcd09068700 1 --2- 172.21.15.72:0/847965632 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd0409d630 0x7fcd041208a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.350+0000 7fcd09068700 1 --2- 172.21.15.72:0/847965632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd040a0a30 0x7fcd04120de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.350+0000 7fcd09068700 1 -- 172.21.15.72:0/847965632 >> 172.21.15.72:0/847965632 conn(0x7fcd040a3050 msgr2=0x7fcd040a5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.350+0000 7fcd09068700 1 -- 172.21.15.72:0/847965632 shutdown_connections 2023-10-03T10:15:53.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.350+0000 7fcd09068700 1 -- 172.21.15.72:0/847965632 wait complete. 2023-10-03T10:15:53.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:53.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.416+0000 7f47af172700 1 -- 172.21.15.72:0/758123724 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f47a81a79d0 con 0x7f47a809e000 2023-10-03T10:15:53.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.416+0000 7f47a57fa700 1 -- 172.21.15.72:0/758123724 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f479401a430 con 0x7f47a809e000 2023-10-03T10:15:53.416 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:53.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.419+0000 7f47af172700 1 -- 172.21.15.72:0/758123724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a809e000 msgr2=0x7f47a81a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.419+0000 7f47af172700 1 --2- 172.21.15.72:0/758123724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a809e000 0x7f47a81a6300 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4794016000 tx=0x7f4794004750 comp rx=0 tx=0).stop 2023-10-03T10:15:53.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.419+0000 7f47af172700 1 -- 172.21.15.72:0/758123724 shutdown_connections 2023-10-03T10:15:53.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.419+0000 7f47af172700 1 --2- 172.21.15.72:0/758123724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47a809d6f0 0x7f47a81a5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.419+0000 7f47af172700 1 --2- 172.21.15.72:0/758123724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47a809e410 0x7f47a81a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.419+0000 7f47af172700 1 --2- 172.21.15.72:0/758123724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47a809e000 0x7f47a81a6300 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.419+0000 7f47af172700 1 -- 172.21.15.72:0/758123724 >> 172.21.15.72:0/758123724 conn(0x7f47a8066f50 msgr2=0x7f47a81bab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.419+0000 7f47af172700 1 -- 172.21.15.72:0/758123724 shutdown_connections 2023-10-03T10:15:53.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.419+0000 7f47af172700 1 -- 172.21.15.72:0/758123724 wait complete. 2023-10-03T10:15:53.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:53.476 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:53.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.600+0000 7f6e942ca700 1 Processor -- start 2023-10-03T10:15:53.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.600+0000 7f6e942ca700 1 -- start start 2023-10-03T10:15:53.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.600+0000 7f6e942ca700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e8c1316c0 0x7f6e8c131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.600+0000 7f6e942ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e8c09d9f0 0x7f6e8c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.600+0000 7f6e942ca700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c09e130 con 0x7f6e8c06acb0 2023-10-03T10:15:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.600+0000 7f6e942ca700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c1312b0 con 0x7f6e8c1316c0 2023-10-03T10:15:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.600+0000 7f6e942ca700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c09f6e0 con 0x7f6e8c09d9f0 2023-10-03T10:15:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.601+0000 7f6e91865700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e8c09d9f0 0x7f6e8c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.601+0000 7f6e92066700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e8c1316c0 0x7f6e8c131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.601+0000 7f6e91865700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e8c09d9f0 0x7f6e8c06a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41094/0 (socket says 172.21.15.72:41094) 2023-10-03T10:15:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.601+0000 7f6e92066700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e8c1316c0 0x7f6e8c131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46566/0 (socket says 172.21.15.72:46566) 2023-10-03T10:15:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.601+0000 7f6e91865700 1 -- 172.21.15.72:0/1703978718 learned_addr learned my addr 172.21.15.72:0/1703978718 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.601+0000 7f6e91865700 1 -- 172.21.15.72:0/1703978718 >> v2:172.21.15.72:3300/0 conn(0x7f6e8c1316c0 msgr2=0x7f6e8c131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.601+0000 7f6e91865700 1 --2- 172.21.15.72:0/1703978718 >> v2:172.21.15.72:3300/0 conn(0x7f6e8c1316c0 0x7f6e8c131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.601+0000 7f6e91865700 1 -- 172.21.15.72:0/1703978718 >> v1:172.21.15.72:6789/0 conn(0x7f6e8c06acb0 legacy=0x7f6e8c138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.601+0000 7f6e91865700 1 -- 172.21.15.72:0/1703978718 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c09e760 con 0x7f6e8c09d9f0 2023-10-03T10:15:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.601+0000 7f6e92066700 1 --2- 172.21.15.72:0/1703978718 >> v2:172.21.15.72:3300/0 conn(0x7f6e8c1316c0 0x7f6e8c131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.601+0000 7f6e91865700 1 --2- 172.21.15.72:0/1703978718 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e8c09d9f0 0x7f6e8c06a770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0098f0 tx=0x7f6e7c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4cf479e1593f873 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.601+0000 7f6e91064700 1 -- 172.21.15.72:0/1703978718 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c011830 con 0x7f6e8c09d9f0 2023-10-03T10:15:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.601+0000 7f6e91064700 1 -- 172.21.15.72:0/1703978718 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c011990 con 0x7f6e8c09d9f0 2023-10-03T10:15:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.601+0000 7f6e91064700 1 -- 172.21.15.72:0/1703978718 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c011d20 con 0x7f6e8c09d9f0 2023-10-03T10:15:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.602+0000 7f6e942ca700 1 -- 172.21.15.72:0/1703978718 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e8c09d9f0 msgr2=0x7f6e8c06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.602+0000 7f6e942ca700 1 --2- 172.21.15.72:0/1703978718 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e8c09d9f0 0x7f6e8c06a770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0098f0 tx=0x7f6e7c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.602+0000 7f6e942ca700 1 -- 172.21.15.72:0/1703978718 shutdown_connections 2023-10-03T10:15:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.602+0000 7f6e942ca700 1 --2- 172.21.15.72:0/1703978718 >> v2:172.21.15.72:3300/0 conn(0x7f6e8c1316c0 0x7f6e8c131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.602+0000 7f6e942ca700 1 --2- 172.21.15.72:0/1703978718 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e8c09d9f0 0x7f6e8c06a770 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.602+0000 7f6e942ca700 1 -- 172.21.15.72:0/1703978718 >> 172.21.15.72:0/1703978718 conn(0x7f6e8c066f50 msgr2=0x7f6e8c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.602+0000 7f6e942ca700 1 -- 172.21.15.72:0/1703978718 shutdown_connections 2023-10-03T10:15:53.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.602+0000 7f6e942ca700 1 -- 172.21.15.72:0/1703978718 wait complete. 2023-10-03T10:15:53.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.603+0000 7f6e942ca700 1 Processor -- start 2023-10-03T10:15:53.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.603+0000 7f6e942ca700 1 -- start start 2023-10-03T10:15:53.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.603+0000 7f6e942ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e8c06acb0 0x7f6e8c071440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.603+0000 7f6e942ca700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e8c09d9f0 0x7f6e8c071980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.603+0000 7f6e942ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e8c1316c0 0x7f6e8c1c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.603+0000 7f6e942ca700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0a37d0 con 0x7f6e8c1316c0 2023-10-03T10:15:53.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.603+0000 7f6e942ca700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c12b900 con 0x7f6e8c06acb0 2023-10-03T10:15:53.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.603+0000 7f6e942ca700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c071000 con 0x7f6e8c09d9f0 2023-10-03T10:15:53.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.603+0000 7f6e92066700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e8c06acb0 0x7f6e8c071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.603+0000 7f6e92066700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e8c06acb0 0x7f6e8c071440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41106/0 (socket says 172.21.15.72:41106) 2023-10-03T10:15:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.603+0000 7f6e92066700 1 -- 172.21.15.72:0/1539013533 learned_addr learned my addr 172.21.15.72:0/1539013533 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.603+0000 7f6e91865700 1 --2- 172.21.15.72:0/1539013533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e8c09d9f0 0x7f6e8c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.603+0000 7f6e92867700 1 --2- 172.21.15.72:0/1539013533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e8c1316c0 0x7f6e8c1c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.604+0000 7f6e92066700 1 -- 172.21.15.72:0/1539013533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e8c09d9f0 msgr2=0x7f6e8c071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.604+0000 7f6e92066700 1 --2- 172.21.15.72:0/1539013533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e8c09d9f0 0x7f6e8c071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.604+0000 7f6e92066700 1 -- 172.21.15.72:0/1539013533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e8c1316c0 msgr2=0x7f6e8c1c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.604+0000 7f6e92066700 1 --2- 172.21.15.72:0/1539013533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e8c1316c0 0x7f6e8c1c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.604+0000 7f6e92066700 1 -- 172.21.15.72:0/1539013533 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e880094a0 con 0x7f6e8c06acb0 2023-10-03T10:15:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.604+0000 7f6e92867700 1 --2- 172.21.15.72:0/1539013533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e8c1316c0 0x7f6e8c1c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.604+0000 7f6e92066700 1 --2- 172.21.15.72:0/1539013533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e8c06acb0 0x7f6e8c071440 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800ebe0 tx=0x7f6e8800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.604+0000 7f6e82ffd700 1 -- 172.21.15.72:0/1539013533 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8800c850 con 0x7f6e8c06acb0 2023-10-03T10:15:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.604+0000 7f6e82ffd700 1 -- 172.21.15.72:0/1539013533 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8800c9b0 con 0x7f6e8c06acb0 2023-10-03T10:15:53.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.604+0000 7f6e942ca700 1 -- 172.21.15.72:0/1539013533 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7c009550 con 0x7f6e8c06acb0 2023-10-03T10:15:53.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.604+0000 7f6e82ffd700 1 -- 172.21.15.72:0/1539013533 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8800cd40 con 0x7f6e8c06acb0 2023-10-03T10:15:53.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.604+0000 7f6e942ca700 1 -- 172.21.15.72:0/1539013533 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c09ead0 con 0x7f6e8c06acb0 2023-10-03T10:15:53.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.605+0000 7f6e82ffd700 1 -- 172.21.15.72:0/1539013533 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e88013470 con 0x7f6e8c06acb0 2023-10-03T10:15:53.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.605+0000 7f6e82ffd700 1 -- 172.21.15.72:0/1539013533 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6e8803fb30 con 0x7f6e8c06acb0 2023-10-03T10:15:53.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.605+0000 7f6e942ca700 1 -- 172.21.15.72:0/1539013533 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8c09bbc0 con 0x7f6e8c06acb0 2023-10-03T10:15:53.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.609+0000 7f6e82ffd700 1 -- 172.21.15.72:0/1539013533 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e8c09bbc0 con 0x7f6e8c06acb0 2023-10-03T10:15:53.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.793+0000 7f6e942ca700 1 -- 172.21.15.72:0/1539013533 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6e8c09bbc0 con 0x7f6e8c06acb0 2023-10-03T10:15:53.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.794+0000 7f6e82ffd700 1 -- 172.21.15.72:0/1539013533 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6e8c09bbc0 con 0x7f6e8c06acb0 2023-10-03T10:15:53.794 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:53.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.796+0000 7f6e942ca700 1 -- 172.21.15.72:0/1539013533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e8c06acb0 msgr2=0x7f6e8c071440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.796+0000 7f6e942ca700 1 --2- 172.21.15.72:0/1539013533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e8c06acb0 0x7f6e8c071440 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800ebe0 tx=0x7f6e8800eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.796+0000 7f6e942ca700 1 -- 172.21.15.72:0/1539013533 shutdown_connections 2023-10-03T10:15:53.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.796+0000 7f6e942ca700 1 --2- 172.21.15.72:0/1539013533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e8c1316c0 0x7f6e8c1c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.796+0000 7f6e942ca700 1 --2- 172.21.15.72:0/1539013533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e8c06acb0 0x7f6e8c071440 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.796+0000 7f6e942ca700 1 --2- 172.21.15.72:0/1539013533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e8c09d9f0 0x7f6e8c071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.796+0000 7f6e942ca700 1 -- 172.21.15.72:0/1539013533 >> 172.21.15.72:0/1539013533 conn(0x7f6e8c066f50 msgr2=0x7f6e8c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.796+0000 7f6e942ca700 1 -- 172.21.15.72:0/1539013533 shutdown_connections 2023-10-03T10:15:53.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:53.796+0000 7f6e942ca700 1 -- 172.21.15.72:0/1539013533 wait complete. 2023-10-03T10:15:53.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:54.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:54.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.338+0000 7f4bcb951700 1 Processor -- start 2023-10-03T10:15:54.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.338+0000 7f4bcb951700 1 -- start start 2023-10-03T10:15:54.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.339+0000 7f4bcb951700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4bc41338a0 0x7f4bc4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.339+0000 7f4bcb951700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4bc409de50 0x7f4bc409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.339+0000 7f4bcb951700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc406ef30 con 0x7f4bc409e760 2023-10-03T10:15:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.339+0000 7f4bcb951700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc406fef0 con 0x7f4bc41338a0 2023-10-03T10:15:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.339+0000 7f4bcb951700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc41334b0 con 0x7f4bc409de50 2023-10-03T10:15:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.339+0000 7f4bc8eec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4bc409de50 0x7f4bc409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.339+0000 7f4bc9eee700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4bc409e760 0x7f4bc413a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50394/0 (socket says 172.21.15.72:50394) 2023-10-03T10:15:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.339+0000 7f4bc9eee700 1 -- 172.21.15.72:0/1017824598 learned_addr learned my addr 172.21.15.72:0/1017824598 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.339+0000 7f4bc96ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4bc41338a0 0x7f4bc4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.339+0000 7f4bc8eec700 1 -- 172.21.15.72:0/1017824598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4bc41338a0 msgr2=0x7f4bc4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.339+0000 7f4bc8eec700 1 --2- 172.21.15.72:0/1017824598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4bc41338a0 0x7f4bc4133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.339+0000 7f4bc8eec700 1 -- 172.21.15.72:0/1017824598 >> v1:172.21.15.72:6789/0 conn(0x7f4bc409e760 legacy=0x7f4bc413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.339+0000 7f4bbbfff700 1 -- 172.21.15.72:0/1017824598 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279819639 0 0) 0x7f4bc406ef30 con 0x7f4bc409e760 2023-10-03T10:15:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.339+0000 7f4bc8eec700 1 -- 172.21.15.72:0/1017824598 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc406fc30 con 0x7f4bc409de50 2023-10-03T10:15:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.339+0000 7f4bc8eec700 1 --2- 172.21.15.72:0/1017824598 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4bc409de50 0x7f4bc409e220 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00098a0 tx=0x7f4bc0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39df03cdd96a4235 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.340+0000 7f4bbbfff700 1 -- 172.21.15.72:0/1017824598 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0011830 con 0x7f4bc409de50 2023-10-03T10:15:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.340+0000 7f4bbbfff700 1 -- 172.21.15.72:0/1017824598 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc0011990 con 0x7f4bc409de50 2023-10-03T10:15:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.340+0000 7f4bbbfff700 1 -- 172.21.15.72:0/1017824598 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0011d20 con 0x7f4bc409de50 2023-10-03T10:15:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.340+0000 7f4bcb951700 1 -- 172.21.15.72:0/1017824598 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4bc409de50 msgr2=0x7f4bc409e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.340+0000 7f4bcb951700 1 --2- 172.21.15.72:0/1017824598 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4bc409de50 0x7f4bc409e220 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00098a0 tx=0x7f4bc0009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.340+0000 7f4bcb951700 1 -- 172.21.15.72:0/1017824598 shutdown_connections 2023-10-03T10:15:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.340+0000 7f4bcb951700 1 --2- 172.21.15.72:0/1017824598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4bc41338a0 0x7f4bc4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.340+0000 7f4bcb951700 1 --2- 172.21.15.72:0/1017824598 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4bc409de50 0x7f4bc409e220 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.340+0000 7f4bcb951700 1 -- 172.21.15.72:0/1017824598 >> 172.21.15.72:0/1017824598 conn(0x7f4bc40a2aa0 msgr2=0x7f4bc40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.340+0000 7f4bcb951700 1 -- 172.21.15.72:0/1017824598 shutdown_connections 2023-10-03T10:15:54.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.340+0000 7f4bcb951700 1 -- 172.21.15.72:0/1017824598 wait complete. 2023-10-03T10:15:54.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.341+0000 7f4bcb951700 1 Processor -- start 2023-10-03T10:15:54.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.341+0000 7f4bcb951700 1 -- start start 2023-10-03T10:15:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bcb951700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4bc409de50 0x7f4bc411b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bcb951700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4bc409e760 0x7f4bc411bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bcb951700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc41338a0 0x7f4bc411c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bcb951700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc411f300 con 0x7f4bc41338a0 2023-10-03T10:15:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bcb951700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc411da10 con 0x7f4bc409de50 2023-10-03T10:15:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bcb951700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc411e6d0 con 0x7f4bc409e760 2023-10-03T10:15:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bc96ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4bc409de50 0x7f4bc411b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bc8eec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4bc409e760 0x7f4bc411bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bc96ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4bc409de50 0x7f4bc411b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41116/0 (socket says 172.21.15.72:41116) 2023-10-03T10:15:54.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bc96ed700 1 -- 172.21.15.72:0/1570552863 learned_addr learned my addr 172.21.15.72:0/1570552863 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bc8eec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4bc409e760 0x7f4bc411bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36650/0 (socket says 172.21.15.72:36650) 2023-10-03T10:15:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bc9eee700 1 --2- 172.21.15.72:0/1570552863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc41338a0 0x7f4bc411c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bc96ed700 1 -- 172.21.15.72:0/1570552863 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4bc409e760 msgr2=0x7f4bc411bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bc96ed700 1 --2- 172.21.15.72:0/1570552863 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4bc409e760 0x7f4bc411bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bc96ed700 1 -- 172.21.15.72:0/1570552863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc41338a0 msgr2=0x7f4bc411c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bc96ed700 1 --2- 172.21.15.72:0/1570552863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc41338a0 0x7f4bc411c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bc96ed700 1 -- 172.21.15.72:0/1570552863 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc00094a0 con 0x7f4bc409de50 2023-10-03T10:15:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bc8eec700 1 --2- 172.21.15.72:0/1570552863 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4bc409e760 0x7f4bc411bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bc9eee700 1 --2- 172.21.15.72:0/1570552863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc41338a0 0x7f4bc411c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bc96ed700 1 --2- 172.21.15.72:0/1570552863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4bc409de50 0x7f4bc411b7e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400e9b0 tx=0x7f4bb400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bb9ffb700 1 -- 172.21.15.72:0/1570552863 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4009710 con 0x7f4bc409de50 2023-10-03T10:15:54.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bb9ffb700 1 -- 172.21.15.72:0/1570552863 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb400ee50 con 0x7f4bc409de50 2023-10-03T10:15:54.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bcb951700 1 -- 172.21.15.72:0/1570552863 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc411ea90 con 0x7f4bc409de50 2023-10-03T10:15:54.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.342+0000 7f4bb9ffb700 1 -- 172.21.15.72:0/1570552863 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb400ca50 con 0x7f4bc409de50 2023-10-03T10:15:54.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.343+0000 7f4bcb951700 1 -- 172.21.15.72:0/1570552863 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc406f690 con 0x7f4bc409de50 2023-10-03T10:15:54.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.343+0000 7f4bb9ffb700 1 -- 172.21.15.72:0/1570552863 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bb400cbb0 con 0x7f4bc409de50 2023-10-03T10:15:54.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.343+0000 7f4bcb951700 1 -- 172.21.15.72:0/1570552863 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc411ee80 con 0x7f4bc409de50 2023-10-03T10:15:54.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.343+0000 7f4bb9ffb700 1 -- 172.21.15.72:0/1570552863 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4bb403fba0 con 0x7f4bc409de50 2023-10-03T10:15:54.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.348+0000 7f4bb9ffb700 1 -- 172.21.15.72:0/1570552863 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bc411ee80 con 0x7f4bc409de50 2023-10-03T10:15:54.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:54.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:54.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.495+0000 7f8f78ad7700 1 Processor -- start 2023-10-03T10:15:54.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.495+0000 7f8f78ad7700 1 -- start start 2023-10-03T10:15:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.496+0000 7f8f78ad7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f741338a0 0x7f8f74133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.496+0000 7f8f78ad7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f7409de50 0x7f8f7409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.496+0000 7f8f78ad7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f7409e760 0x7f8f7413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.496+0000 7f8f78ad7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f7406fef0 con 0x7f8f7409e760 2023-10-03T10:15:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.496+0000 7f8f78ad7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7406ef30 con 0x7f8f7409de50 2023-10-03T10:15:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.496+0000 7f8f78ad7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f741334b0 con 0x7f8f741338a0 2023-10-03T10:15:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.496+0000 7f8f7259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f741338a0 0x7f8f74133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.496+0000 7f8f71d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f7409de50 0x7f8f7409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.497+0000 7f8f71d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f7409de50 0x7f8f7409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41118/0 (socket says 172.21.15.72:41118) 2023-10-03T10:15:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.497+0000 7f8f7259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f741338a0 0x7f8f74133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36654/0 (socket says 172.21.15.72:36654) 2023-10-03T10:15:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.497+0000 7f8f71d9b700 1 -- 172.21.15.72:0/14964476 learned_addr learned my addr 172.21.15.72:0/14964476 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.497+0000 7f8f72d9d700 1 --2- 172.21.15.72:0/14964476 >> v2:172.21.15.72:3300/0 conn(0x7f8f7409e760 0x7f8f7413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.497+0000 7f8f7259c700 1 -- 172.21.15.72:0/14964476 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f7409de50 msgr2=0x7f8f7409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.497+0000 7f8f7259c700 1 --2- 172.21.15.72:0/14964476 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f7409de50 0x7f8f7409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.497+0000 7f8f7259c700 1 -- 172.21.15.72:0/14964476 >> v2:172.21.15.72:3300/0 conn(0x7f8f7409e760 msgr2=0x7f8f7413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.497+0000 7f8f7259c700 1 --2- 172.21.15.72:0/14964476 >> v2:172.21.15.72:3300/0 conn(0x7f8f7409e760 0x7f8f7413a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.497+0000 7f8f7259c700 1 -- 172.21.15.72:0/14964476 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7406fc30 con 0x7f8f741338a0 2023-10-03T10:15:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.497+0000 7f8f71d9b700 1 --2- 172.21.15.72:0/14964476 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f7409de50 0x7f8f7409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.497+0000 7f8f7259c700 1 --2- 172.21.15.72:0/14964476 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f741338a0 0x7f8f74133c70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009870 tx=0x7f8f64009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f851870e7fb1468a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:54.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.497+0000 7f8f7159a700 1 -- 172.21.15.72:0/14964476 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64011830 con 0x7f8f741338a0 2023-10-03T10:15:54.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.497+0000 7f8f7159a700 1 -- 172.21.15.72:0/14964476 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f64011990 con 0x7f8f741338a0 2023-10-03T10:15:54.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.497+0000 7f8f7159a700 1 -- 172.21.15.72:0/14964476 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64011d20 con 0x7f8f741338a0 2023-10-03T10:15:54.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.498+0000 7f8f78ad7700 1 -- 172.21.15.72:0/14964476 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f741338a0 msgr2=0x7f8f74133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.498+0000 7f8f78ad7700 1 --2- 172.21.15.72:0/14964476 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f741338a0 0x7f8f74133c70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009870 tx=0x7f8f64009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:54.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.498+0000 7f8f78ad7700 1 -- 172.21.15.72:0/14964476 shutdown_connections 2023-10-03T10:15:54.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.498+0000 7f8f78ad7700 1 --2- 172.21.15.72:0/14964476 >> v2:172.21.15.72:3300/0 conn(0x7f8f7409e760 0x7f8f7413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.498+0000 7f8f78ad7700 1 --2- 172.21.15.72:0/14964476 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f741338a0 0x7f8f74133c70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.498+0000 7f8f78ad7700 1 --2- 172.21.15.72:0/14964476 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f7409de50 0x7f8f7409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.498+0000 7f8f78ad7700 1 -- 172.21.15.72:0/14964476 >> 172.21.15.72:0/14964476 conn(0x7f8f740a2aa0 msgr2=0x7f8f740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.498+0000 7f8f78ad7700 1 -- 172.21.15.72:0/14964476 shutdown_connections 2023-10-03T10:15:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.498+0000 7f8f78ad7700 1 -- 172.21.15.72:0/14964476 wait complete. 2023-10-03T10:15:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.499+0000 7f8f78ad7700 1 Processor -- start 2023-10-03T10:15:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.499+0000 7f8f78ad7700 1 -- start start 2023-10-03T10:15:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.499+0000 7f8f78ad7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f7409de50 0x7f8f7411ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.499+0000 7f8f78ad7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f7409e760 0x7f8f7411ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.499+0000 7f8f78ad7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f741338a0 0x7f8f7411f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.499+0000 7f8f78ad7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f74122530 con 0x7f8f7409de50 2023-10-03T10:15:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.499+0000 7f8f78ad7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f74120620 con 0x7f8f7409e760 2023-10-03T10:15:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.499+0000 7f8f78ad7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f740a1020 con 0x7f8f741338a0 2023-10-03T10:15:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f7259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f7409de50 0x7f8f7411ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f71d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f7409e760 0x7f8f7411ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f7259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f7409de50 0x7f8f7411ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46592/0 (socket says 172.21.15.72:46592) 2023-10-03T10:15:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f7259c700 1 -- 172.21.15.72:0/4147721283 learned_addr learned my addr 172.21.15.72:0/4147721283 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f72d9d700 1 --2- 172.21.15.72:0/4147721283 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f741338a0 0x7f8f7411f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f71d9b700 1 -- 172.21.15.72:0/4147721283 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f741338a0 msgr2=0x7f8f7411f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f71d9b700 1 --2- 172.21.15.72:0/4147721283 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f741338a0 0x7f8f7411f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f71d9b700 1 -- 172.21.15.72:0/4147721283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f7409de50 msgr2=0x7f8f7411ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f71d9b700 1 --2- 172.21.15.72:0/4147721283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f7409de50 0x7f8f7411ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f71d9b700 1 -- 172.21.15.72:0/4147721283 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f68009550 con 0x7f8f7409e760 2023-10-03T10:15:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f71d9b700 1 --2- 172.21.15.72:0/4147721283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f7409e760 0x7f8f7411ef50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8f7406d750 tx=0x7f8f6800ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f7259c700 1 --2- 172.21.15.72:0/4147721283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f7409de50 0x7f8f7411ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f62ffd700 1 -- 172.21.15.72:0/4147721283 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68004240 con 0x7f8f7409e760 2023-10-03T10:15:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f62ffd700 1 -- 172.21.15.72:0/4147721283 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f680043a0 con 0x7f8f7409e760 2023-10-03T10:15:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f62ffd700 1 -- 172.21.15.72:0/4147721283 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f680036a0 con 0x7f8f7409e760 2023-10-03T10:15:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f78ad7700 1 -- 172.21.15.72:0/4147721283 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f640094a0 con 0x7f8f7409e760 2023-10-03T10:15:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.500+0000 7f8f78ad7700 1 -- 172.21.15.72:0/4147721283 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7412f530 con 0x7f8f7409e760 2023-10-03T10:15:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.501+0000 7f8f62ffd700 1 -- 172.21.15.72:0/4147721283 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f68003800 con 0x7f8f7409e760 2023-10-03T10:15:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.501+0000 7f8f62ffd700 1 -- 172.21.15.72:0/4147721283 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8f6803f810 con 0x7f8f7409e760 2023-10-03T10:15:54.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.503+0000 7f8f78ad7700 1 -- 172.21.15.72:0/4147721283 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f74074ea0 con 0x7f8f7409e760 2023-10-03T10:15:54.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.511+0000 7f8f62ffd700 1 -- 172.21.15.72:0/4147721283 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f68013470 con 0x7f8f7409e760 2023-10-03T10:15:54.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.550+0000 7f4bcb951700 1 -- 172.21.15.72:0/1570552863 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4bc411ee80 con 0x7f4bc409de50 2023-10-03T10:15:54.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.550+0000 7f4bb9ffb700 1 -- 172.21.15.72:0/1570552863 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4bb4017020 con 0x7f4bc409de50 2023-10-03T10:15:54.550 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.552+0000 7f4bcb951700 1 -- 172.21.15.72:0/1570552863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4bc409de50 msgr2=0x7f4bc411b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.552+0000 7f4bcb951700 1 --2- 172.21.15.72:0/1570552863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4bc409de50 0x7f4bc411b7e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400e9b0 tx=0x7f4bb400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.553+0000 7f4bcb951700 1 -- 172.21.15.72:0/1570552863 shutdown_connections 2023-10-03T10:15:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.553+0000 7f4bcb951700 1 --2- 172.21.15.72:0/1570552863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4bc41338a0 0x7f4bc411c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.553+0000 7f4bcb951700 1 --2- 172.21.15.72:0/1570552863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4bc409de50 0x7f4bc411b7e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.553+0000 7f4bcb951700 1 --2- 172.21.15.72:0/1570552863 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4bc409e760 0x7f4bc411bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.553+0000 7f4bcb951700 1 -- 172.21.15.72:0/1570552863 >> 172.21.15.72:0/1570552863 conn(0x7f4bc40a2aa0 msgr2=0x7f4bc4130630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.553+0000 7f4bcb951700 1 -- 172.21.15.72:0/1570552863 shutdown_connections 2023-10-03T10:15:54.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.553+0000 7f4bcb951700 1 -- 172.21.15.72:0/1570552863 wait complete. 2023-10-03T10:15:54.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:54.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.568+0000 7f8b08b1a700 1 Processor -- start 2023-10-03T10:15:54.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.568+0000 7f8b08b1a700 1 -- start start 2023-10-03T10:15:54.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b08b1a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8b04071b40 0x7f8b04130420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b08b1a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b04130960 0x7f8b04133570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b08b1a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b04130d50 0x7f8b04133ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b08b1a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b04099ef0 con 0x7f8b04071b40 2023-10-03T10:15:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b08b1a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04099500 con 0x7f8b04130d50 2023-10-03T10:15:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b08b1a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04099c10 con 0x7f8b04130960 2023-10-03T10:15:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b01d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b04130960 0x7f8b04133570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b01d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b04130960 0x7f8b04133570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36660/0 (socket says 172.21.15.72:36660) 2023-10-03T10:15:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b01d9b700 1 -- 172.21.15.72:0/2712591170 learned_addr learned my addr 172.21.15.72:0/2712591170 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b0259c700 1 --2- 172.21.15.72:0/2712591170 >> v2:172.21.15.72:3300/0 conn(0x7f8b04071b40 0x7f8b04130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b02d9d700 1 --2- 172.21.15.72:0/2712591170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b04130d50 0x7f8b04133ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b0259c700 1 -- 172.21.15.72:0/2712591170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b04130960 msgr2=0x7f8b04133570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b0259c700 1 --2- 172.21.15.72:0/2712591170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b04130960 0x7f8b04133570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b0259c700 1 -- 172.21.15.72:0/2712591170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b04130d50 msgr2=0x7f8b04133ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b0259c700 1 --2- 172.21.15.72:0/2712591170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b04130d50 0x7f8b04133ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b0259c700 1 -- 172.21.15.72:0/2712591170 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0409e370 con 0x7f8b04071b40 2023-10-03T10:15:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b01d9b700 1 --2- 172.21.15.72:0/2712591170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b04130960 0x7f8b04133570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.569+0000 7f8b0259c700 1 --2- 172.21.15.72:0/2712591170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b04071b40 0x7f8b04130420 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8af4009840 tx=0x7f8af4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5db27c0d6b45a95 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.570+0000 7f8b0159a700 1 -- 172.21.15.72:0/2712591170 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af4011830 con 0x7f8b04071b40 2023-10-03T10:15:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.570+0000 7f8b0159a700 1 -- 172.21.15.72:0/2712591170 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af4011990 con 0x7f8b04071b40 2023-10-03T10:15:54.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.570+0000 7f8b0159a700 1 -- 172.21.15.72:0/2712591170 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af4011d20 con 0x7f8b04071b40 2023-10-03T10:15:54.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.570+0000 7f8b08b1a700 1 -- 172.21.15.72:0/2712591170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b04071b40 msgr2=0x7f8b04130420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.570+0000 7f8b08b1a700 1 --2- 172.21.15.72:0/2712591170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b04071b40 0x7f8b04130420 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8af4009840 tx=0x7f8af4009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.570+0000 7f8b08b1a700 1 -- 172.21.15.72:0/2712591170 shutdown_connections 2023-10-03T10:15:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.570+0000 7f8b08b1a700 1 --2- 172.21.15.72:0/2712591170 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b04130d50 0x7f8b04133ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.570+0000 7f8b08b1a700 1 --2- 172.21.15.72:0/2712591170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b04071b40 0x7f8b04130420 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.571+0000 7f8b08b1a700 1 --2- 172.21.15.72:0/2712591170 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b04130960 0x7f8b04133570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.571+0000 7f8b08b1a700 1 -- 172.21.15.72:0/2712591170 >> 172.21.15.72:0/2712591170 conn(0x7f8b0409e7e0 msgr2=0x7f8b0409ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.571+0000 7f8b08b1a700 1 -- 172.21.15.72:0/2712591170 shutdown_connections 2023-10-03T10:15:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.571+0000 7f8b08b1a700 1 -- 172.21.15.72:0/2712591170 wait complete. 2023-10-03T10:15:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.572+0000 7f8b08b1a700 1 Processor -- start 2023-10-03T10:15:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.572+0000 7f8b08b1a700 1 -- start start 2023-10-03T10:15:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b08b1a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b04071b40 0x7f8b0412adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b08b1a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b04130960 0x7f8b0412b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b08b1a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b04130d50 0x7f8b0412b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b08b1a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0412df20 con 0x7f8b04130d50 2023-10-03T10:15:54.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b08b1a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0412cf80 con 0x7f8b04071b40 2023-10-03T10:15:54.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b08b1a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0412f420 con 0x7f8b04130960 2023-10-03T10:15:54.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b02d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b04130d50 0x7f8b0412b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b01d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b04130960 0x7f8b0412b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b02d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b04130d50 0x7f8b0412b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46614/0 (socket says 172.21.15.72:46614) 2023-10-03T10:15:54.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b02d9d700 1 -- 172.21.15.72:0/1459416157 learned_addr learned my addr 172.21.15.72:0/1459416157 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:54.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b02d9d700 1 -- 172.21.15.72:0/1459416157 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b04130960 msgr2=0x7f8b0412b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b02d9d700 1 --2- 172.21.15.72:0/1459416157 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b04130960 0x7f8b0412b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b02d9d700 1 -- 172.21.15.72:0/1459416157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b04071b40 msgr2=0x7f8b0412adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b02d9d700 1 --2- 172.21.15.72:0/1459416157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b04071b40 0x7f8b0412adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b02d9d700 1 -- 172.21.15.72:0/1459416157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af8009550 con 0x7f8b04130d50 2023-10-03T10:15:54.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.573+0000 7f8b01d9b700 1 --2- 172.21.15.72:0/1459416157 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b04130960 0x7f8b0412b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:54.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.574+0000 7f8b02d9d700 1 --2- 172.21.15.72:0/1459416157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b04130d50 0x7f8b0412b830 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009dd0 tx=0x7f8afc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:54.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.574+0000 7f8af2ffd700 1 -- 172.21.15.72:0/1459416157 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc009c40 con 0x7f8b04130d50 2023-10-03T10:15:54.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.574+0000 7f8af2ffd700 1 -- 172.21.15.72:0/1459416157 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc00f040 con 0x7f8b04130d50 2023-10-03T10:15:54.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.574+0000 7f8af2ffd700 1 -- 172.21.15.72:0/1459416157 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc014480 con 0x7f8b04130d50 2023-10-03T10:15:54.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.575+0000 7f8b08b1a700 1 -- 172.21.15.72:0/1459416157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af40094a0 con 0x7f8b04130d50 2023-10-03T10:15:54.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.575+0000 7f8b08b1a700 1 -- 172.21.15.72:0/1459416157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0412e8a0 con 0x7f8b04130d50 2023-10-03T10:15:54.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.576+0000 7f8af2ffd700 1 -- 172.21.15.72:0/1459416157 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8afc0145e0 con 0x7f8b04130d50 2023-10-03T10:15:54.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.576+0000 7f8af2ffd700 1 -- 172.21.15.72:0/1459416157 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8afc040150 con 0x7f8b04130d50 2023-10-03T10:15:54.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.576+0000 7f8b08b1a700 1 -- 172.21.15.72:0/1459416157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b04131fb0 con 0x7f8b04130d50 2023-10-03T10:15:54.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.581+0000 7f8af2ffd700 1 -- 172.21.15.72:0/1459416157 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8afc007920 con 0x7f8b04130d50 2023-10-03T10:15:54.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.722+0000 7f8f78ad7700 1 -- 172.21.15.72:0/4147721283 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8f7406b9e0 con 0x7f8f7409e760 2023-10-03T10:15:54.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.723+0000 7f8f62ffd700 1 -- 172.21.15.72:0/4147721283 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8f6802a090 con 0x7f8f7409e760 2023-10-03T10:15:54.722 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.725+0000 7f8f78ad7700 1 -- 172.21.15.72:0/4147721283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f7409e760 msgr2=0x7f8f7411ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.725+0000 7f8f78ad7700 1 --2- 172.21.15.72:0/4147721283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f7409e760 0x7f8f7411ef50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8f7406d750 tx=0x7f8f6800ec60 comp rx=0 tx=0).stop 2023-10-03T10:15:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.725+0000 7f8f78ad7700 1 -- 172.21.15.72:0/4147721283 shutdown_connections 2023-10-03T10:15:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.725+0000 7f8f78ad7700 1 --2- 172.21.15.72:0/4147721283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f7409de50 0x7f8f7411ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.725+0000 7f8f78ad7700 1 --2- 172.21.15.72:0/4147721283 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8f741338a0 0x7f8f7411f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.725+0000 7f8f78ad7700 1 --2- 172.21.15.72:0/4147721283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8f7409e760 0x7f8f7411ef50 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.725+0000 7f8f78ad7700 1 -- 172.21.15.72:0/4147721283 >> 172.21.15.72:0/4147721283 conn(0x7f8f740a2aa0 msgr2=0x7f8f7409ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.725+0000 7f8f78ad7700 1 -- 172.21.15.72:0/4147721283 shutdown_connections 2023-10-03T10:15:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.725+0000 7f8f78ad7700 1 -- 172.21.15.72:0/4147721283 wait complete. 2023-10-03T10:15:54.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:54.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.786+0000 7f8b08b1a700 1 -- 172.21.15.72:0/1459416157 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8b0409b840 con 0x7f8b04130d50 2023-10-03T10:15:54.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.787+0000 7f8af2ffd700 1 -- 172.21.15.72:0/1459416157 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8afc02c090 con 0x7f8b04130d50 2023-10-03T10:15:54.786 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.789+0000 7f8b08b1a700 1 -- 172.21.15.72:0/1459416157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b04130d50 msgr2=0x7f8b0412b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.789+0000 7f8b08b1a700 1 --2- 172.21.15.72:0/1459416157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b04130d50 0x7f8b0412b830 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009dd0 tx=0x7f8afc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.789+0000 7f8b08b1a700 1 -- 172.21.15.72:0/1459416157 shutdown_connections 2023-10-03T10:15:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.789+0000 7f8b08b1a700 1 --2- 172.21.15.72:0/1459416157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b04130d50 0x7f8b0412b830 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.789+0000 7f8b08b1a700 1 --2- 172.21.15.72:0/1459416157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b04071b40 0x7f8b0412adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.789+0000 7f8b08b1a700 1 --2- 172.21.15.72:0/1459416157 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b04130960 0x7f8b0412b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.789+0000 7f8b08b1a700 1 -- 172.21.15.72:0/1459416157 >> 172.21.15.72:0/1459416157 conn(0x7f8b0409e7e0 msgr2=0x7f8b041bae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.789+0000 7f8b08b1a700 1 -- 172.21.15.72:0/1459416157 shutdown_connections 2023-10-03T10:15:54.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.789+0000 7f8b08b1a700 1 -- 172.21.15.72:0/1459416157 wait complete. 2023-10-03T10:15:54.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:54.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.930+0000 7fda278f6700 1 Processor -- start 2023-10-03T10:15:54.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.930+0000 7fda278f6700 1 -- start start 2023-10-03T10:15:54.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.930+0000 7fda278f6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda2009d6f0 0x7fda2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.930+0000 7fda278f6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fda2009e000 0x7fda201339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.930+0000 7fda278f6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda2009e410 0x7fda20133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.930+0000 7fda278f6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2006b460 con 0x7fda2009e000 2023-10-03T10:15:54.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.930+0000 7fda278f6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2009b120 con 0x7fda2009e410 2023-10-03T10:15:54.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.930+0000 7fda278f6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda2009a7e0 con 0x7fda2009d6f0 2023-10-03T10:15:54.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda24e91700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fda2009e000 0x7fda201339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda25e93700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda2009e410 0x7fda20133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda24e91700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fda2009e000 0x7fda201339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46620/0 (socket says 172.21.15.72:46620) 2023-10-03T10:15:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda25e93700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda2009e410 0x7fda20133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41164/0 (socket says 172.21.15.72:41164) 2023-10-03T10:15:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda24e91700 1 -- 172.21.15.72:0/1300861306 learned_addr learned my addr 172.21.15.72:0/1300861306 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda25692700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda2009d6f0 0x7fda2009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda25e93700 1 -- 172.21.15.72:0/1300861306 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda2009d6f0 msgr2=0x7fda2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda25e93700 1 --2- 172.21.15.72:0/1300861306 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda2009d6f0 0x7fda2009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda25e93700 1 -- 172.21.15.72:0/1300861306 >> v2:172.21.15.72:3300/0 conn(0x7fda2009e000 msgr2=0x7fda201339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda25e93700 1 --2- 172.21.15.72:0/1300861306 >> v2:172.21.15.72:3300/0 conn(0x7fda2009e000 0x7fda201339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda25e93700 1 -- 172.21.15.72:0/1300861306 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2009a500 con 0x7fda2009e410 2023-10-03T10:15:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda24e91700 1 --2- 172.21.15.72:0/1300861306 >> v2:172.21.15.72:3300/0 conn(0x7fda2009e000 0x7fda201339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:54.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda25692700 1 --2- 172.21.15.72:0/1300861306 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda2009d6f0 0x7fda2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:54.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda25e93700 1 --2- 172.21.15.72:0/1300861306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda2009e410 0x7fda20133f30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fda18009dc0 tx=0x7fda1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0cfeeaa233f5168 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:54.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda17fff700 1 -- 172.21.15.72:0/1300861306 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1800e070 con 0x7fda2009e410 2023-10-03T10:15:54.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda17fff700 1 -- 172.21.15.72:0/1300861306 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1800bae0 con 0x7fda2009e410 2023-10-03T10:15:54.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.931+0000 7fda17fff700 1 -- 172.21.15.72:0/1300861306 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1800be90 con 0x7fda2009e410 2023-10-03T10:15:54.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.932+0000 7fda278f6700 1 -- 172.21.15.72:0/1300861306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda2009e410 msgr2=0x7fda20133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.932+0000 7fda278f6700 1 --2- 172.21.15.72:0/1300861306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda2009e410 0x7fda20133f30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fda18009dc0 tx=0x7fda1800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:54.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.932+0000 7fda278f6700 1 -- 172.21.15.72:0/1300861306 shutdown_connections 2023-10-03T10:15:54.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.932+0000 7fda278f6700 1 --2- 172.21.15.72:0/1300861306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda2009e410 0x7fda20133f30 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.932+0000 7fda278f6700 1 --2- 172.21.15.72:0/1300861306 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda2009d6f0 0x7fda2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.932+0000 7fda278f6700 1 --2- 172.21.15.72:0/1300861306 >> v2:172.21.15.72:3300/0 conn(0x7fda2009e000 0x7fda201339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.932+0000 7fda278f6700 1 -- 172.21.15.72:0/1300861306 >> 172.21.15.72:0/1300861306 conn(0x7fda20066f50 msgr2=0x7fda2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.932+0000 7fda278f6700 1 -- 172.21.15.72:0/1300861306 shutdown_connections 2023-10-03T10:15:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.932+0000 7fda278f6700 1 -- 172.21.15.72:0/1300861306 wait complete. 2023-10-03T10:15:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.933+0000 7fda278f6700 1 Processor -- start 2023-10-03T10:15:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.933+0000 7fda278f6700 1 -- start start 2023-10-03T10:15:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.933+0000 7fda278f6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda2009d6f0 0x7fda201c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.933+0000 7fda278f6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda2009e000 0x7fda201c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.933+0000 7fda278f6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda2009e410 0x7fda201c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.933+0000 7fda278f6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda201a80f0 con 0x7fda2009d6f0 2023-10-03T10:15:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.933+0000 7fda278f6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda201a63e0 con 0x7fda2009e410 2023-10-03T10:15:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.933+0000 7fda278f6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda200a1d90 con 0x7fda2009e000 2023-10-03T10:15:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.933+0000 7fda25e93700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda2009e410 0x7fda201c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.933+0000 7fda25692700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda2009d6f0 0x7fda201c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.933+0000 7fda24e91700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda2009e000 0x7fda201c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:54.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.933+0000 7fda25e93700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda2009e410 0x7fda201c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41180/0 (socket says 172.21.15.72:41180) 2023-10-03T10:15:54.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.933+0000 7fda25e93700 1 -- 172.21.15.72:0/3592111365 learned_addr learned my addr 172.21.15.72:0/3592111365 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:54.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.934+0000 7fda25e93700 1 -- 172.21.15.72:0/3592111365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda2009e000 msgr2=0x7fda201c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.934+0000 7fda25e93700 1 --2- 172.21.15.72:0/3592111365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda2009e000 0x7fda201c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.934+0000 7fda25e93700 1 -- 172.21.15.72:0/3592111365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda2009d6f0 msgr2=0x7fda201c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.934+0000 7fda25e93700 1 --2- 172.21.15.72:0/3592111365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda2009d6f0 0x7fda201c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.934+0000 7fda25e93700 1 -- 172.21.15.72:0/3592111365 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c0094a0 con 0x7fda2009e410 2023-10-03T10:15:54.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.934+0000 7fda24e91700 1 --2- 172.21.15.72:0/3592111365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda2009e000 0x7fda201c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:54.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.934+0000 7fda25692700 1 --2- 172.21.15.72:0/3592111365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda2009d6f0 0x7fda201c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:54.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.934+0000 7fda25e93700 1 --2- 172.21.15.72:0/3592111365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda2009e410 0x7fda201c8aa0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fda2009b3c0 tx=0x7fda18004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:54.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.934+0000 7fda15ffb700 1 -- 172.21.15.72:0/3592111365 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda180044d0 con 0x7fda2009e410 2023-10-03T10:15:54.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.934+0000 7fda15ffb700 1 -- 172.21.15.72:0/3592111365 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18020070 con 0x7fda2009e410 2023-10-03T10:15:54.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.934+0000 7fda278f6700 1 -- 172.21.15.72:0/3592111365 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda10009550 con 0x7fda2009e410 2023-10-03T10:15:54.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.934+0000 7fda15ffb700 1 -- 172.21.15.72:0/3592111365 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18004870 con 0x7fda2009e410 2023-10-03T10:15:54.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.934+0000 7fda278f6700 1 -- 172.21.15.72:0/3592111365 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda18009a70 con 0x7fda2009e410 2023-10-03T10:15:54.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.935+0000 7fda15ffb700 1 -- 172.21.15.72:0/3592111365 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda18012430 con 0x7fda2009e410 2023-10-03T10:15:54.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.935+0000 7fda15ffb700 1 -- 172.21.15.72:0/3592111365 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fda18022070 con 0x7fda2009e410 2023-10-03T10:15:54.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.935+0000 7fda278f6700 1 -- 172.21.15.72:0/3592111365 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda201a6c30 con 0x7fda2009e410 2023-10-03T10:15:54.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:54.940+0000 7fda15ffb700 1 -- 172.21.15.72:0/3592111365 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda180126e0 con 0x7fda2009e410 2023-10-03T10:15:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.124+0000 7fda278f6700 1 -- 172.21.15.72:0/3592111365 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fda20074ea0 con 0x7fda2009e410 2023-10-03T10:15:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.125+0000 7fda15ffb700 1 -- 172.21.15.72:0/3592111365 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fda18035090 con 0x7fda2009e410 2023-10-03T10:15:55.124 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.127+0000 7fda278f6700 1 -- 172.21.15.72:0/3592111365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda2009e410 msgr2=0x7fda201c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.127+0000 7fda278f6700 1 --2- 172.21.15.72:0/3592111365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda2009e410 0x7fda201c8aa0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fda2009b3c0 tx=0x7fda18004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.127+0000 7fda278f6700 1 -- 172.21.15.72:0/3592111365 shutdown_connections 2023-10-03T10:15:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.127+0000 7fda278f6700 1 --2- 172.21.15.72:0/3592111365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda2009d6f0 0x7fda201c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.127+0000 7fda278f6700 1 --2- 172.21.15.72:0/3592111365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda2009e410 0x7fda201c8aa0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.127+0000 7fda278f6700 1 --2- 172.21.15.72:0/3592111365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda2009e000 0x7fda201c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.127+0000 7fda278f6700 1 -- 172.21.15.72:0/3592111365 >> 172.21.15.72:0/3592111365 conn(0x7fda20066f50 msgr2=0x7fda201bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.127+0000 7fda278f6700 1 -- 172.21.15.72:0/3592111365 shutdown_connections 2023-10-03T10:15:55.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.127+0000 7fda278f6700 1 -- 172.21.15.72:0/3592111365 wait complete. 2023-10-03T10:15:55.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:55.566 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:55.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.693+0000 7f1604535700 1 Processor -- start 2023-10-03T10:15:55.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.693+0000 7f1604535700 1 -- start start 2023-10-03T10:15:55.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f1604535700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15fc1338a0 0x7f15fc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f1604535700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15fc09e930 0x7f15fc13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f1604535700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15fc06ef30 con 0x7f15fc09de50 2023-10-03T10:15:55.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f1604535700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15fc06fef0 con 0x7f15fc1338a0 2023-10-03T10:15:55.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f1604535700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc1334b0 con 0x7f15fc09e930 2023-10-03T10:15:55.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f16022d1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15fc1338a0 0x7f15fc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f1602ad2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15fc09e930 0x7f15fc13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f1602ad2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15fc09e930 0x7f15fc13b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41188/0 (socket says 172.21.15.72:41188) 2023-10-03T10:15:55.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f16022d1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15fc1338a0 0x7f15fc133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46638/0 (socket says 172.21.15.72:46638) 2023-10-03T10:15:55.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f1602ad2700 1 -- 172.21.15.72:0/2353118041 learned_addr learned my addr 172.21.15.72:0/2353118041 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:55.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f1601ad0700 1 --1- 172.21.15.72:0/2353118041 >> v1:172.21.15.72:6789/0 conn(0x7f15fc09de50 0x7f15fc09e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50402/0 (socket says 172.21.15.72:50402) 2023-10-03T10:15:55.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f16022d1700 1 -- 172.21.15.72:0/2353118041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15fc09e930 msgr2=0x7f15fc13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f16022d1700 1 --2- 172.21.15.72:0/2353118041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15fc09e930 0x7f15fc13b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f16022d1700 1 -- 172.21.15.72:0/2353118041 >> v1:172.21.15.72:6789/0 conn(0x7f15fc09de50 legacy=0x7f15fc09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f16022d1700 1 -- 172.21.15.72:0/2353118041 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc06fc30 con 0x7f15fc1338a0 2023-10-03T10:15:55.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f1602ad2700 1 --2- 172.21.15.72:0/2353118041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15fc09e930 0x7f15fc13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.694+0000 7f16022d1700 1 --2- 172.21.15.72:0/2353118041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15fc1338a0 0x7f15fc133c70 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009840 tx=0x7f15ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7576c41fbe55f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.695+0000 7f16012cf700 1 -- 172.21.15.72:0/2353118041 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec011830 con 0x7f15fc1338a0 2023-10-03T10:15:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.695+0000 7f16012cf700 1 -- 172.21.15.72:0/2353118041 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec011990 con 0x7f15fc1338a0 2023-10-03T10:15:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.695+0000 7f16012cf700 1 -- 172.21.15.72:0/2353118041 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec011d20 con 0x7f15fc1338a0 2023-10-03T10:15:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.695+0000 7f1604535700 1 -- 172.21.15.72:0/2353118041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15fc1338a0 msgr2=0x7f15fc133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.695+0000 7f1604535700 1 --2- 172.21.15.72:0/2353118041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15fc1338a0 0x7f15fc133c70 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009840 tx=0x7f15ec009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.695+0000 7f1604535700 1 -- 172.21.15.72:0/2353118041 shutdown_connections 2023-10-03T10:15:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.695+0000 7f1604535700 1 --2- 172.21.15.72:0/2353118041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15fc09e930 0x7f15fc13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.695+0000 7f1604535700 1 --2- 172.21.15.72:0/2353118041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15fc1338a0 0x7f15fc133c70 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.695+0000 7f1604535700 1 -- 172.21.15.72:0/2353118041 >> 172.21.15.72:0/2353118041 conn(0x7f15fc0a2aa0 msgr2=0x7f15fc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.695+0000 7f1604535700 1 -- 172.21.15.72:0/2353118041 shutdown_connections 2023-10-03T10:15:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.695+0000 7f1604535700 1 -- 172.21.15.72:0/2353118041 wait complete. 2023-10-03T10:15:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.696+0000 7f1604535700 1 Processor -- start 2023-10-03T10:15:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.696+0000 7f1604535700 1 -- start start 2023-10-03T10:15:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1604535700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15fc09de50 0x7f15fc11efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1604535700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15fc09e930 0x7f15fc11f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1604535700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15fc1338a0 0x7f15fc11fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1604535700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc1210a0 con 0x7f15fc1338a0 2023-10-03T10:15:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1604535700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc1226e0 con 0x7f15fc09e930 2023-10-03T10:15:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1604535700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc1207d0 con 0x7f15fc09de50 2023-10-03T10:15:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f16022d1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15fc09de50 0x7f15fc11efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1601ad0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15fc09e930 0x7f15fc11f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1602ad2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15fc1338a0 0x7f15fc11fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f16022d1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15fc09de50 0x7f15fc11efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36702/0 (socket says 172.21.15.72:36702) 2023-10-03T10:15:55.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f16022d1700 1 -- 172.21.15.72:0/1180180193 learned_addr learned my addr 172.21.15.72:0/1180180193 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:55.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1602ad2700 1 -- 172.21.15.72:0/1180180193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15fc09de50 msgr2=0x7f15fc11efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1602ad2700 1 --2- 172.21.15.72:0/1180180193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15fc09de50 0x7f15fc11efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1602ad2700 1 -- 172.21.15.72:0/1180180193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15fc09e930 msgr2=0x7f15fc11f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1602ad2700 1 --2- 172.21.15.72:0/1180180193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15fc09e930 0x7f15fc11f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1602ad2700 1 -- 172.21.15.72:0/1180180193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f4009b30 con 0x7f15fc1338a0 2023-10-03T10:15:55.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1601ad0700 1 --2- 172.21.15.72:0/1180180193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15fc09e930 0x7f15fc11f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1602ad2700 1 --2- 172.21.15.72:0/1180180193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15fc1338a0 0x7f15fc11fa20 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009e50 tx=0x7f15f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f15f2ffd700 1 -- 172.21.15.72:0/1180180193 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4018070 con 0x7f15fc1338a0 2023-10-03T10:15:55.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f15f2ffd700 1 -- 172.21.15.72:0/1180180193 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f400f040 con 0x7f15fc1338a0 2023-10-03T10:15:55.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1604535700 1 -- 172.21.15.72:0/1180180193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ec0094a0 con 0x7f15fc1338a0 2023-10-03T10:15:55.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f15f2ffd700 1 -- 172.21.15.72:0/1180180193 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4003c40 con 0x7f15fc1338a0 2023-10-03T10:15:55.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.697+0000 7f1604535700 1 -- 172.21.15.72:0/1180180193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15fc12fb10 con 0x7f15fc1338a0 2023-10-03T10:15:55.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.698+0000 7f15f2ffd700 1 -- 172.21.15.72:0/1180180193 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15f400c880 con 0x7f15fc1338a0 2023-10-03T10:15:55.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.698+0000 7f15f2ffd700 1 -- 172.21.15.72:0/1180180193 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f15f403f740 con 0x7f15fc1338a0 2023-10-03T10:15:55.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.698+0000 7f1604535700 1 -- 172.21.15.72:0/1180180193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15fc1220a0 con 0x7f15fc1338a0 2023-10-03T10:15:55.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.703+0000 7f15f2ffd700 1 -- 172.21.15.72:0/1180180193 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15fc1220a0 con 0x7f15fc1338a0 2023-10-03T10:15:55.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:55.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:55.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.862+0000 7f2950c65700 1 Processor -- start 2023-10-03T10:15:55.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.862+0000 7f2950c65700 1 -- start start 2023-10-03T10:15:55.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.862+0000 7f2950c65700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f294c09e930 0x7f294c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f2950c65700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c09f240 0x7f294c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f2950c65700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294c070940 con 0x7f294c09f650 2023-10-03T10:15:55.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f2950c65700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294c06fd60 con 0x7f294c09e930 2023-10-03T10:15:55.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f2950c65700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f294c06fa80 con 0x7f294c09f240 2023-10-03T10:15:55.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f2949d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c09f240 0x7f294c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f294a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f294c09e930 0x7f294c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f2949d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c09f240 0x7f294c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36704/0 (socket says 172.21.15.72:36704) 2023-10-03T10:15:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f2949d9b700 1 -- 172.21.15.72:0/697091736 learned_addr learned my addr 172.21.15.72:0/697091736 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f2949d9b700 1 -- 172.21.15.72:0/697091736 >> v2:172.21.15.72:3300/0 conn(0x7f294c09e930 msgr2=0x7f294c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f2949d9b700 1 --2- 172.21.15.72:0/697091736 >> v2:172.21.15.72:3300/0 conn(0x7f294c09e930 0x7f294c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f2949d9b700 1 -- 172.21.15.72:0/697091736 >> v1:172.21.15.72:6789/0 conn(0x7f294c09f650 legacy=0x7f294c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f2949d9b700 1 -- 172.21.15.72:0/697091736 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c09fb60 con 0x7f294c09f240 2023-10-03T10:15:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f294959a700 1 -- 172.21.15.72:0/697091736 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351065500 0 0) 0x7f294c070940 con 0x7f294c09f650 2023-10-03T10:15:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f294a59c700 1 --2- 172.21.15.72:0/697091736 >> v2:172.21.15.72:3300/0 conn(0x7f294c09e930 0x7f294c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f2949d9b700 1 --2- 172.21.15.72:0/697091736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c09f240 0x7f294c1317f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f29400098f0 tx=0x7f2940009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7b66ca9f45930c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.863+0000 7f294959a700 1 -- 172.21.15.72:0/697091736 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940011830 con 0x7f294c09f240 2023-10-03T10:15:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.864+0000 7f294959a700 1 -- 172.21.15.72:0/697091736 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2940011990 con 0x7f294c09f240 2023-10-03T10:15:55.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.864+0000 7f294959a700 1 -- 172.21.15.72:0/697091736 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940011d20 con 0x7f294c09f240 2023-10-03T10:15:55.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.864+0000 7f2950c65700 1 -- 172.21.15.72:0/697091736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c09f240 msgr2=0x7f294c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.864+0000 7f2950c65700 1 --2- 172.21.15.72:0/697091736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c09f240 0x7f294c1317f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f29400098f0 tx=0x7f2940009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:55.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.864+0000 7f2950c65700 1 -- 172.21.15.72:0/697091736 shutdown_connections 2023-10-03T10:15:55.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.864+0000 7f2950c65700 1 --2- 172.21.15.72:0/697091736 >> v2:172.21.15.72:3300/0 conn(0x7f294c09e930 0x7f294c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.864+0000 7f2950c65700 1 --2- 172.21.15.72:0/697091736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c09f240 0x7f294c1317f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.864+0000 7f2950c65700 1 -- 172.21.15.72:0/697091736 >> 172.21.15.72:0/697091736 conn(0x7f294c0a4210 msgr2=0x7f294c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.864+0000 7f2950c65700 1 -- 172.21.15.72:0/697091736 shutdown_connections 2023-10-03T10:15:55.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.864+0000 7f2950c65700 1 -- 172.21.15.72:0/697091736 wait complete. 2023-10-03T10:15:55.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.866+0000 7f2950c65700 1 Processor -- start 2023-10-03T10:15:55.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.866+0000 7f2950c65700 1 -- start start 2023-10-03T10:15:55.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.866+0000 7f2950c65700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c09e930 0x7f294c1c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f2950c65700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c09f240 0x7f294c1c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f2950c65700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c09f650 0x7f294c1c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f2950c65700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c1a7740 con 0x7f294c09e930 2023-10-03T10:15:55.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f2950c65700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c1a4f50 con 0x7f294c09f650 2023-10-03T10:15:55.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f2950c65700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0a3260 con 0x7f294c09f240 2023-10-03T10:15:55.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f294a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c09e930 0x7f294c1c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f294a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c09e930 0x7f294c1c6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46668/0 (socket says 172.21.15.72:46668) 2023-10-03T10:15:55.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f294a59c700 1 -- 172.21.15.72:0/2890596140 learned_addr learned my addr 172.21.15.72:0/2890596140 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:55.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f2949d9b700 1 --2- 172.21.15.72:0/2890596140 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c09f240 0x7f294c1c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f294ad9d700 1 --2- 172.21.15.72:0/2890596140 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c09f650 0x7f294c1c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f294a59c700 1 -- 172.21.15.72:0/2890596140 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c09f240 msgr2=0x7f294c1c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f294a59c700 1 --2- 172.21.15.72:0/2890596140 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c09f240 0x7f294c1c6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f294a59c700 1 -- 172.21.15.72:0/2890596140 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c09f650 msgr2=0x7f294c1c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f294a59c700 1 --2- 172.21.15.72:0/2890596140 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c09f650 0x7f294c1c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f294a59c700 1 -- 172.21.15.72:0/2890596140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c0094a0 con 0x7f294c09e930 2023-10-03T10:15:55.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f294ad9d700 1 --2- 172.21.15.72:0/2890596140 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c09f650 0x7f294c1c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:55.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f294a59c700 1 --2- 172.21.15.72:0/2890596140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c09e930 0x7f294c1c6210 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f293c00ec10 tx=0x7f293c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f293affd700 1 -- 172.21.15.72:0/2890596140 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c00c8b0 con 0x7f294c09e930 2023-10-03T10:15:55.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f293affd700 1 -- 172.21.15.72:0/2890596140 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c00ca10 con 0x7f294c09e930 2023-10-03T10:15:55.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f2950c65700 1 -- 172.21.15.72:0/2890596140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2940009550 con 0x7f294c09e930 2023-10-03T10:15:55.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f293affd700 1 -- 172.21.15.72:0/2890596140 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c00cd80 con 0x7f294c09e930 2023-10-03T10:15:55.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.867+0000 7f2950c65700 1 -- 172.21.15.72:0/2890596140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294c0a0190 con 0x7f294c09e930 2023-10-03T10:15:55.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.868+0000 7f2950c65700 1 -- 172.21.15.72:0/2890596140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294c1c6c90 con 0x7f294c09e930 2023-10-03T10:15:55.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.869+0000 7f293affd700 1 -- 172.21.15.72:0/2890596140 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f293c013470 con 0x7f294c09e930 2023-10-03T10:15:55.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.869+0000 7f293affd700 1 -- 172.21.15.72:0/2890596140 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f293c03fff0 con 0x7f294c09e930 2023-10-03T10:15:55.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.873+0000 7f293affd700 1 -- 172.21.15.72:0/2890596140 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f293c011760 con 0x7f294c09e930 2023-10-03T10:15:55.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.905+0000 7f1604535700 1 -- 172.21.15.72:0/1180180193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f15fc1220a0 con 0x7f15fc1338a0 2023-10-03T10:15:55.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.906+0000 7f15f2ffd700 1 -- 172.21.15.72:0/1180180193 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15fc1220a0 con 0x7f15fc1338a0 2023-10-03T10:15:55.905 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:55.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.908+0000 7f1604535700 1 -- 172.21.15.72:0/1180180193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15fc1338a0 msgr2=0x7f15fc11fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.908+0000 7f1604535700 1 --2- 172.21.15.72:0/1180180193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15fc1338a0 0x7f15fc11fa20 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009e50 tx=0x7f15f400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.908+0000 7f1604535700 1 -- 172.21.15.72:0/1180180193 shutdown_connections 2023-10-03T10:15:55.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.908+0000 7f1604535700 1 --2- 172.21.15.72:0/1180180193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15fc1338a0 0x7f15fc11fa20 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.908+0000 7f1604535700 1 --2- 172.21.15.72:0/1180180193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15fc09de50 0x7f15fc11efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.908+0000 7f1604535700 1 --2- 172.21.15.72:0/1180180193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15fc09e930 0x7f15fc11f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.908+0000 7f1604535700 1 -- 172.21.15.72:0/1180180193 >> 172.21.15.72:0/1180180193 conn(0x7f15fc0a2aa0 msgr2=0x7f15fc09ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.908+0000 7f1604535700 1 -- 172.21.15.72:0/1180180193 shutdown_connections 2023-10-03T10:15:55.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.908+0000 7f1604535700 1 -- 172.21.15.72:0/1180180193 wait complete. 2023-10-03T10:15:55.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.927+0000 7f8b7ff0b700 1 Processor -- start 2023-10-03T10:15:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.928+0000 7f8b7ff0b700 1 -- start start 2023-10-03T10:15:55.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.928+0000 7f8b7ff0b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b7809d6f0 0x7f8b7809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.928+0000 7f8b7ff0b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8b7809e410 0x7f8b78134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.928+0000 7f8b7ff0b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7809b120 con 0x7f8b7809e000 2023-10-03T10:15:55.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.928+0000 7f8b7ff0b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7806b460 con 0x7f8b7809e410 2023-10-03T10:15:55.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.928+0000 7f8b7ff0b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7809a7e0 con 0x7f8b7809d6f0 2023-10-03T10:15:55.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.928+0000 7f8b7dca7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b7809d6f0 0x7f8b7809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.928+0000 7f8b7e4a8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8b7809e410 0x7f8b78134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.928+0000 7f8b7d4a6700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8b7809e000 0x7f8b781339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50412/0 (socket says 172.21.15.72:50412) 2023-10-03T10:15:55.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.928+0000 7f8b7dca7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b7809d6f0 0x7f8b7809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41224/0 (socket says 172.21.15.72:41224) 2023-10-03T10:15:55.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.928+0000 7f8b7d4a6700 1 -- 172.21.15.72:0/1014900381 learned_addr learned my addr 172.21.15.72:0/1014900381 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:55.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.929+0000 7f8b7e4a8700 1 -- 172.21.15.72:0/1014900381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b7809d6f0 msgr2=0x7f8b7809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.929+0000 7f8b7e4a8700 1 --2- 172.21.15.72:0/1014900381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b7809d6f0 0x7f8b7809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.929+0000 7f8b7e4a8700 1 -- 172.21.15.72:0/1014900381 >> v1:172.21.15.72:6789/0 conn(0x7f8b7809e000 legacy=0x7f8b781339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.929+0000 7f8b7e4a8700 1 -- 172.21.15.72:0/1014900381 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7809a500 con 0x7f8b7809e410 2023-10-03T10:15:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.929+0000 7f8b7cca5700 1 -- 172.21.15.72:0/1014900381 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274697585 0 0) 0x7f8b7809b120 con 0x7f8b7809e000 2023-10-03T10:15:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.929+0000 7f8b7dca7700 1 --2- 172.21.15.72:0/1014900381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b7809d6f0 0x7f8b7809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.929+0000 7f8b7e4a8700 1 --2- 172.21.15.72:0/1014900381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b7809e410 0x7f8b78134100 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009d90 tx=0x7f8b7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969cad0c35d9d126 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.929+0000 7f8b7cca5700 1 -- 172.21.15.72:0/1014900381 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7000e070 con 0x7f8b7809e410 2023-10-03T10:15:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.929+0000 7f8b7cca5700 1 -- 172.21.15.72:0/1014900381 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7000bb20 con 0x7f8b7809e410 2023-10-03T10:15:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.929+0000 7f8b7cca5700 1 -- 172.21.15.72:0/1014900381 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b70012430 con 0x7f8b7809e410 2023-10-03T10:15:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.929+0000 7f8b7ff0b700 1 -- 172.21.15.72:0/1014900381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b7809e410 msgr2=0x7f8b78134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.929+0000 7f8b7ff0b700 1 --2- 172.21.15.72:0/1014900381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b7809e410 0x7f8b78134100 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009d90 tx=0x7f8b7000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.930+0000 7f8b7ff0b700 1 -- 172.21.15.72:0/1014900381 shutdown_connections 2023-10-03T10:15:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.930+0000 7f8b7ff0b700 1 --2- 172.21.15.72:0/1014900381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b7809e410 0x7f8b78134100 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.930+0000 7f8b7ff0b700 1 --2- 172.21.15.72:0/1014900381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b7809d6f0 0x7f8b7809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.930+0000 7f8b7ff0b700 1 -- 172.21.15.72:0/1014900381 >> 172.21.15.72:0/1014900381 conn(0x7f8b78066f50 msgr2=0x7f8b7809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.930+0000 7f8b7ff0b700 1 -- 172.21.15.72:0/1014900381 shutdown_connections 2023-10-03T10:15:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.930+0000 7f8b7ff0b700 1 -- 172.21.15.72:0/1014900381 wait complete. 2023-10-03T10:15:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.931+0000 7f8b7ff0b700 1 Processor -- start 2023-10-03T10:15:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.931+0000 7f8b7ff0b700 1 -- start start 2023-10-03T10:15:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.931+0000 7f8b7ff0b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b7809d6f0 0x7f8b781c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.931+0000 7f8b7ff0b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b7809e000 0x7f8b781c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.931+0000 7f8b7ff0b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b7809e410 0x7f8b781c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.931+0000 7f8b7ff0b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b781a8a30 con 0x7f8b7809d6f0 2023-10-03T10:15:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.931+0000 7f8b7ff0b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b781a9780 con 0x7f8b7809e410 2023-10-03T10:15:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.931+0000 7f8b7ff0b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b781c8e80 con 0x7f8b7809e000 2023-10-03T10:15:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.931+0000 7f8b7dca7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b7809d6f0 0x7f8b781c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.931+0000 7f8b7dca7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b7809d6f0 0x7f8b781c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46672/0 (socket says 172.21.15.72:46672) 2023-10-03T10:15:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.931+0000 7f8b7dca7700 1 -- 172.21.15.72:0/1946169142 learned_addr learned my addr 172.21.15.72:0/1946169142 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.931+0000 7f8b7d4a6700 1 --2- 172.21.15.72:0/1946169142 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b7809e000 0x7f8b781c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.931+0000 7f8b7e4a8700 1 --2- 172.21.15.72:0/1946169142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b7809e410 0x7f8b781c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.931+0000 7f8b7d4a6700 1 -- 172.21.15.72:0/1946169142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b7809e410 msgr2=0x7f8b781c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.932+0000 7f8b7d4a6700 1 --2- 172.21.15.72:0/1946169142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b7809e410 0x7f8b781c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.932+0000 7f8b7d4a6700 1 -- 172.21.15.72:0/1946169142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b7809d6f0 msgr2=0x7f8b781c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.932+0000 7f8b7d4a6700 1 --2- 172.21.15.72:0/1946169142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b7809d6f0 0x7f8b781c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.932+0000 7f8b7d4a6700 1 -- 172.21.15.72:0/1946169142 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b680094a0 con 0x7f8b7809e000 2023-10-03T10:15:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.932+0000 7f8b7dca7700 1 --2- 172.21.15.72:0/1946169142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b7809d6f0 0x7f8b781c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.932+0000 7f8b7e4a8700 1 --2- 172.21.15.72:0/1946169142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b7809e410 0x7f8b781c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.932+0000 7f8b7d4a6700 1 --2- 172.21.15.72:0/1946169142 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b7809e000 0x7f8b781c8940 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c470 tx=0x7f8b7400c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.932+0000 7f8b6e7fc700 1 -- 172.21.15.72:0/1946169142 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74004c80 con 0x7f8b7809e000 2023-10-03T10:15:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.932+0000 7f8b6e7fc700 1 -- 172.21.15.72:0/1946169142 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b74004de0 con 0x7f8b7809e000 2023-10-03T10:15:55.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.932+0000 7f8b7ff0b700 1 -- 172.21.15.72:0/1946169142 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b70009a70 con 0x7f8b7809e000 2023-10-03T10:15:55.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.932+0000 7f8b6e7fc700 1 -- 172.21.15.72:0/1946169142 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74007310 con 0x7f8b7809e000 2023-10-03T10:15:55.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.932+0000 7f8b7ff0b700 1 -- 172.21.15.72:0/1946169142 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b781a85e0 con 0x7f8b7809e000 2023-10-03T10:15:55.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.933+0000 7f8b6e7fc700 1 -- 172.21.15.72:0/1946169142 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b74007470 con 0x7f8b7809e000 2023-10-03T10:15:55.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.933+0000 7f8b6e7fc700 1 -- 172.21.15.72:0/1946169142 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8b7403f220 con 0x7f8b7809e000 2023-10-03T10:15:55.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.933+0000 7f8b7ff0b700 1 -- 172.21.15.72:0/1946169142 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b78074ea0 con 0x7f8b7809e000 2023-10-03T10:15:55.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:55.938+0000 7f8b6e7fc700 1 -- 172.21.15.72:0/1946169142 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b7400ce40 con 0x7f8b7809e000 2023-10-03T10:15:56.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.068+0000 7f2950c65700 1 -- 172.21.15.72:0/2890596140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f294c1a7170 con 0x7f294c09e930 2023-10-03T10:15:56.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.069+0000 7f293affd700 1 -- 172.21.15.72:0/2890596140 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f293c021020 con 0x7f294c09e930 2023-10-03T10:15:56.069 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:56.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.071+0000 7f2950c65700 1 -- 172.21.15.72:0/2890596140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c09e930 msgr2=0x7f294c1c6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.071+0000 7f2950c65700 1 --2- 172.21.15.72:0/2890596140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c09e930 0x7f294c1c6210 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f293c00ec10 tx=0x7f293c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:56.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.071+0000 7f2950c65700 1 -- 172.21.15.72:0/2890596140 shutdown_connections 2023-10-03T10:15:56.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.071+0000 7f2950c65700 1 --2- 172.21.15.72:0/2890596140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f294c09e930 0x7f294c1c6210 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.071+0000 7f2950c65700 1 --2- 172.21.15.72:0/2890596140 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f294c09f650 0x7f294c1c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.071+0000 7f2950c65700 1 --2- 172.21.15.72:0/2890596140 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f294c09f240 0x7f294c1c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.071+0000 7f2950c65700 1 -- 172.21.15.72:0/2890596140 >> 172.21.15.72:0/2890596140 conn(0x7f294c0a4210 msgr2=0x7f294c1b8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.071+0000 7f2950c65700 1 -- 172.21.15.72:0/2890596140 shutdown_connections 2023-10-03T10:15:56.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.071+0000 7f2950c65700 1 -- 172.21.15.72:0/2890596140 wait complete. 2023-10-03T10:15:56.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:56.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.129+0000 7f8b7ff0b700 1 -- 172.21.15.72:0/1946169142 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8b781a7870 con 0x7f8b7809e000 2023-10-03T10:15:56.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.129+0000 7f8b6e7fc700 1 -- 172.21.15.72:0/1946169142 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b7401b7b0 con 0x7f8b7809e000 2023-10-03T10:15:56.129 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:56.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.131+0000 7f8b7ff0b700 1 -- 172.21.15.72:0/1946169142 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b7809e000 msgr2=0x7f8b781c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.131+0000 7f8b7ff0b700 1 --2- 172.21.15.72:0/1946169142 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b7809e000 0x7f8b781c8940 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c470 tx=0x7f8b7400c780 comp rx=0 tx=0).stop 2023-10-03T10:15:56.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.131+0000 7f8b7ff0b700 1 -- 172.21.15.72:0/1946169142 shutdown_connections 2023-10-03T10:15:56.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.131+0000 7f8b7ff0b700 1 --2- 172.21.15.72:0/1946169142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b7809d6f0 0x7f8b781c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.131+0000 7f8b7ff0b700 1 --2- 172.21.15.72:0/1946169142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b7809e410 0x7f8b781c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.131+0000 7f8b7ff0b700 1 --2- 172.21.15.72:0/1946169142 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b7809e000 0x7f8b781c8940 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.131+0000 7f8b7ff0b700 1 -- 172.21.15.72:0/1946169142 >> 172.21.15.72:0/1946169142 conn(0x7f8b78066f50 msgr2=0x7f8b781bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.132+0000 7f8b7ff0b700 1 -- 172.21.15.72:0/1946169142 shutdown_connections 2023-10-03T10:15:56.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.132+0000 7f8b7ff0b700 1 -- 172.21.15.72:0/1946169142 wait complete. 2023-10-03T10:15:56.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:56.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:56.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.261+0000 7fc1115c9700 1 Processor -- start 2023-10-03T10:15:56.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.261+0000 7fc1115c9700 1 -- start start 2023-10-03T10:15:56.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.261+0000 7fc1115c9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc10c09e850 0x7fc10c09ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.261+0000 7fc1115c9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10c09f160 0x7fc10c133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.261+0000 7fc1115c9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc10c09f550 0x7fc10c1340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.261+0000 7fc1115c9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10c06bce0 con 0x7fc10c09f550 2023-10-03T10:15:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.261+0000 7fc1115c9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c06bec0 con 0x7fc10c09f160 2023-10-03T10:15:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.261+0000 7fc1115c9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c06caa0 con 0x7fc10c09e850 2023-10-03T10:15:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.261+0000 7fc10affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc10c09e850 0x7fc10c09ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.261+0000 7fc10a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10c09f160 0x7fc10c133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.261+0000 7fc10affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc10c09e850 0x7fc10c09ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36720/0 (socket says 172.21.15.72:36720) 2023-10-03T10:15:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.261+0000 7fc10a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10c09f160 0x7fc10c133b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41246/0 (socket says 172.21.15.72:41246) 2023-10-03T10:15:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.261+0000 7fc10b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc10c09f550 0x7fc10c1340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.261+0000 7fc10affd700 1 -- 172.21.15.72:0/3763398734 learned_addr learned my addr 172.21.15.72:0/3763398734 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.262+0000 7fc10affd700 1 -- 172.21.15.72:0/3763398734 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10c09f160 msgr2=0x7fc10c133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.262+0000 7fc10affd700 1 --2- 172.21.15.72:0/3763398734 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10c09f160 0x7fc10c133b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.262+0000 7fc10affd700 1 -- 172.21.15.72:0/3763398734 >> v2:172.21.15.72:3300/0 conn(0x7fc10c09f550 msgr2=0x7fc10c1340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.262+0000 7fc10affd700 1 --2- 172.21.15.72:0/3763398734 >> v2:172.21.15.72:3300/0 conn(0x7fc10c09f550 0x7fc10c1340c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.262+0000 7fc10affd700 1 -- 172.21.15.72:0/3763398734 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c0a00a0 con 0x7fc10c09e850 2023-10-03T10:15:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.262+0000 7fc10b7fe700 1 --2- 172.21.15.72:0/3763398734 >> v2:172.21.15.72:3300/0 conn(0x7fc10c09f550 0x7fc10c1340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.262+0000 7fc10a7fc700 1 --2- 172.21.15.72:0/3763398734 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10c09f160 0x7fc10c133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.262+0000 7fc10affd700 1 --2- 172.21.15.72:0/3763398734 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc10c09e850 0x7fc10c09ec20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009950 tx=0x7fc0fc009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d94db66414cf544b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.262+0000 7fc109ffb700 1 -- 172.21.15.72:0/3763398734 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc011830 con 0x7fc10c09e850 2023-10-03T10:15:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.262+0000 7fc109ffb700 1 -- 172.21.15.72:0/3763398734 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc011990 con 0x7fc10c09e850 2023-10-03T10:15:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.262+0000 7fc109ffb700 1 -- 172.21.15.72:0/3763398734 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc011d40 con 0x7fc10c09e850 2023-10-03T10:15:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.263+0000 7fc1115c9700 1 -- 172.21.15.72:0/3763398734 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc10c09e850 msgr2=0x7fc10c09ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.263+0000 7fc1115c9700 1 --2- 172.21.15.72:0/3763398734 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc10c09e850 0x7fc10c09ec20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009950 tx=0x7fc0fc009c60 comp rx=0 tx=0).stop 2023-10-03T10:15:56.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.263+0000 7fc1115c9700 1 -- 172.21.15.72:0/3763398734 shutdown_connections 2023-10-03T10:15:56.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.263+0000 7fc1115c9700 1 --2- 172.21.15.72:0/3763398734 >> v2:172.21.15.72:3300/0 conn(0x7fc10c09f550 0x7fc10c1340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.263+0000 7fc1115c9700 1 --2- 172.21.15.72:0/3763398734 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc10c09e850 0x7fc10c09ec20 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.263+0000 7fc1115c9700 1 --2- 172.21.15.72:0/3763398734 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10c09f160 0x7fc10c133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.263+0000 7fc1115c9700 1 -- 172.21.15.72:0/3763398734 >> 172.21.15.72:0/3763398734 conn(0x7fc10c0a3f70 msgr2=0x7fc10c0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.263+0000 7fc1115c9700 1 -- 172.21.15.72:0/3763398734 shutdown_connections 2023-10-03T10:15:56.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.263+0000 7fc1115c9700 1 -- 172.21.15.72:0/3763398734 wait complete. 2023-10-03T10:15:56.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc1115c9700 1 Processor -- start 2023-10-03T10:15:56.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc1115c9700 1 -- start start 2023-10-03T10:15:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc1115c9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10c09e850 0x7fc10c122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc1115c9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc10c09f160 0x7fc10c122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc1115c9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc10c09f550 0x7fc10c1232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc1115c9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c125a60 con 0x7fc10c09f550 2023-10-03T10:15:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc1115c9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c133430 con 0x7fc10c09e850 2023-10-03T10:15:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc1115c9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c124470 con 0x7fc10c09f160 2023-10-03T10:15:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc10b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc10c09f550 0x7fc10c1232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc10affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10c09e850 0x7fc10c122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc10b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc10c09f550 0x7fc10c1232e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46682/0 (socket says 172.21.15.72:46682) 2023-10-03T10:15:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc10b7fe700 1 -- 172.21.15.72:0/4144705418 learned_addr learned my addr 172.21.15.72:0/4144705418 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc10a7fc700 1 --2- 172.21.15.72:0/4144705418 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc10c09f160 0x7fc10c122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc10b7fe700 1 -- 172.21.15.72:0/4144705418 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc10c09f160 msgr2=0x7fc10c122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc10b7fe700 1 --2- 172.21.15.72:0/4144705418 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc10c09f160 0x7fc10c122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc10b7fe700 1 -- 172.21.15.72:0/4144705418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10c09e850 msgr2=0x7fc10c122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc10b7fe700 1 --2- 172.21.15.72:0/4144705418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10c09e850 0x7fc10c122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc10b7fe700 1 -- 172.21.15.72:0/4144705418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1000094a0 con 0x7fc10c09f550 2023-10-03T10:15:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.264+0000 7fc10affd700 1 --2- 172.21.15.72:0/4144705418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10c09e850 0x7fc10c122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.265+0000 7fc10b7fe700 1 --2- 172.21.15.72:0/4144705418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc10c09f550 0x7fc10c1232e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fc104009f00 tx=0x7fc10400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.265+0000 7fc0f37fe700 1 -- 172.21.15.72:0/4144705418 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104009d70 con 0x7fc10c09f550 2023-10-03T10:15:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.265+0000 7fc0f37fe700 1 -- 172.21.15.72:0/4144705418 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10400f040 con 0x7fc10c09f550 2023-10-03T10:15:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.265+0000 7fc0f37fe700 1 -- 172.21.15.72:0/4144705418 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10400cd70 con 0x7fc10c09f550 2023-10-03T10:15:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.265+0000 7fc1115c9700 1 -- 172.21.15.72:0/4144705418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc104009a70 con 0x7fc10c09f550 2023-10-03T10:15:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.265+0000 7fc1115c9700 1 -- 172.21.15.72:0/4144705418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0fc009550 con 0x7fc10c09f550 2023-10-03T10:15:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.265+0000 7fc0f37fe700 1 -- 172.21.15.72:0/4144705418 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc104014480 con 0x7fc10c09f550 2023-10-03T10:15:56.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.266+0000 7fc0f37fe700 1 -- 172.21.15.72:0/4144705418 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc10403fbe0 con 0x7fc10c09f550 2023-10-03T10:15:56.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.266+0000 7fc1115c9700 1 -- 172.21.15.72:0/4144705418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10c06ccc0 con 0x7fc10c09f550 2023-10-03T10:15:56.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.270+0000 7fc0f37fe700 1 -- 172.21.15.72:0/4144705418 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc104012930 con 0x7fc10c09f550 2023-10-03T10:15:56.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.455+0000 7fc1115c9700 1 -- 172.21.15.72:0/4144705418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc10c0747f0 con 0x7fc10c09f550 2023-10-03T10:15:56.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.455+0000 7fc0f37fe700 1 -- 172.21.15.72:0/4144705418 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc104012340 con 0x7fc10c09f550 2023-10-03T10:15:56.455 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:56.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.457+0000 7fc1115c9700 1 -- 172.21.15.72:0/4144705418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc10c09f550 msgr2=0x7fc10c1232e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.457+0000 7fc1115c9700 1 --2- 172.21.15.72:0/4144705418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc10c09f550 0x7fc10c1232e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fc104009f00 tx=0x7fc10400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.457+0000 7fc1115c9700 1 -- 172.21.15.72:0/4144705418 shutdown_connections 2023-10-03T10:15:56.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.457+0000 7fc1115c9700 1 --2- 172.21.15.72:0/4144705418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc10c09f550 0x7fc10c1232e0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.457+0000 7fc1115c9700 1 --2- 172.21.15.72:0/4144705418 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc10c09e850 0x7fc10c122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.457+0000 7fc1115c9700 1 --2- 172.21.15.72:0/4144705418 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc10c09f160 0x7fc10c122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.457+0000 7fc1115c9700 1 -- 172.21.15.72:0/4144705418 >> 172.21.15.72:0/4144705418 conn(0x7fc10c0a3f70 msgr2=0x7fc10c0a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.457+0000 7fc1115c9700 1 -- 172.21.15.72:0/4144705418 shutdown_connections 2023-10-03T10:15:56.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:56.457+0000 7fc1115c9700 1 -- 172.21.15.72:0/4144705418 wait complete. 2023-10-03T10:15:56.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:56.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.043+0000 7f04dc05b700 1 Processor -- start 2023-10-03T10:15:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.043+0000 7f04dc05b700 1 -- start start 2023-10-03T10:15:57.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.043+0000 7f04dc05b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04d40a0a30 0x7f04d40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.043+0000 7f04dc05b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04d4134170 0x7f04d413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.043+0000 7f04dc05b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d409edd0 con 0x7f04d40a1340 2023-10-03T10:15:57.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.043+0000 7f04dc05b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d409e1f0 con 0x7f04d4134170 2023-10-03T10:15:57.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.043+0000 7f04dc05b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04d409dc50 con 0x7f04d40a0a30 2023-10-03T10:15:57.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.044+0000 7f04d9df7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04d40a0a30 0x7f04d40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.044+0000 7f04d95f6700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f04d40a1340 0x7f04d4133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50422/0 (socket says 172.21.15.72:50422) 2023-10-03T10:15:57.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.044+0000 7f04d95f6700 1 -- 172.21.15.72:0/3093673286 learned_addr learned my addr 172.21.15.72:0/3093673286 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:57.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.044+0000 7f04da5f8700 1 --2- 172.21.15.72:0/3093673286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04d4134170 0x7f04d413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.044+0000 7f04d8df5700 1 -- 172.21.15.72:0/3093673286 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 687551766 0 0) 0x7f04d409edd0 con 0x7f04d40a1340 2023-10-03T10:15:57.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.044+0000 7f04d9df7700 1 -- 172.21.15.72:0/3093673286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04d4134170 msgr2=0x7f04d413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:57.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.044+0000 7f04d9df7700 1 --2- 172.21.15.72:0/3093673286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04d4134170 0x7f04d413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.044+0000 7f04d9df7700 1 -- 172.21.15.72:0/3093673286 >> v1:172.21.15.72:6789/0 conn(0x7f04d40a1340 legacy=0x7f04d4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.044+0000 7f04d9df7700 1 -- 172.21.15.72:0/3093673286 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d40a1fe0 con 0x7f04d40a0a30 2023-10-03T10:15:57.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.044+0000 7f04da5f8700 1 --2- 172.21.15.72:0/3093673286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04d4134170 0x7f04d413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.044+0000 7f04d9df7700 1 --2- 172.21.15.72:0/3093673286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04d40a0a30 0x7f04d40a0e00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009870 tx=0x7f04d0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad5090125305dbd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.044+0000 7f04d8df5700 1 -- 172.21.15.72:0/3093673286 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0011830 con 0x7f04d40a0a30 2023-10-03T10:15:57.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.044+0000 7f04d8df5700 1 -- 172.21.15.72:0/3093673286 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d0011990 con 0x7f04d40a0a30 2023-10-03T10:15:57.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.044+0000 7f04d8df5700 1 -- 172.21.15.72:0/3093673286 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0011d20 con 0x7f04d40a0a30 2023-10-03T10:15:57.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.045+0000 7f04dc05b700 1 -- 172.21.15.72:0/3093673286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04d40a0a30 msgr2=0x7f04d40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.045+0000 7f04dc05b700 1 --2- 172.21.15.72:0/3093673286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04d40a0a30 0x7f04d40a0e00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009870 tx=0x7f04d0009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:57.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.045+0000 7f04dc05b700 1 -- 172.21.15.72:0/3093673286 shutdown_connections 2023-10-03T10:15:57.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.045+0000 7f04dc05b700 1 --2- 172.21.15.72:0/3093673286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04d4134170 0x7f04d413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.045+0000 7f04dc05b700 1 --2- 172.21.15.72:0/3093673286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04d40a0a30 0x7f04d40a0e00 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.045+0000 7f04dc05b700 1 -- 172.21.15.72:0/3093673286 >> 172.21.15.72:0/3093673286 conn(0x7f04d40a6550 msgr2=0x7f04d40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.045+0000 7f04dc05b700 1 -- 172.21.15.72:0/3093673286 shutdown_connections 2023-10-03T10:15:57.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.045+0000 7f04dc05b700 1 -- 172.21.15.72:0/3093673286 wait complete. 2023-10-03T10:15:57.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04dc05b700 1 Processor -- start 2023-10-03T10:15:57.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04dc05b700 1 -- start start 2023-10-03T10:15:57.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04dc05b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04d40a0a30 0x7f04d4122730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04dc05b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04d40a1340 0x7f04d4122c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04dc05b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04d4134170 0x7f04d41231b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04dc05b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d41261c0 con 0x7f04d40a0a30 2023-10-03T10:15:57.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04dc05b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d4125c20 con 0x7f04d4134170 2023-10-03T10:15:57.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04dc05b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04d4124350 con 0x7f04d40a1340 2023-10-03T10:15:57.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04d9df7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04d40a0a30 0x7f04d4122730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04da5f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04d4134170 0x7f04d41231b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04d95f6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04d40a1340 0x7f04d4122c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04d9df7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04d40a0a30 0x7f04d4122730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46696/0 (socket says 172.21.15.72:46696) 2023-10-03T10:15:57.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04da5f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04d4134170 0x7f04d41231b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41274/0 (socket says 172.21.15.72:41274) 2023-10-03T10:15:57.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04d9df7700 1 -- 172.21.15.72:0/2076473478 learned_addr learned my addr 172.21.15.72:0/2076473478 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:57.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04d9df7700 1 -- 172.21.15.72:0/2076473478 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04d40a1340 msgr2=0x7f04d4122c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04d9df7700 1 --2- 172.21.15.72:0/2076473478 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04d40a1340 0x7f04d4122c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04d9df7700 1 -- 172.21.15.72:0/2076473478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04d4134170 msgr2=0x7f04d41231b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.046+0000 7f04d9df7700 1 --2- 172.21.15.72:0/2076473478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04d4134170 0x7f04d41231b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.047+0000 7f04d9df7700 1 -- 172.21.15.72:0/2076473478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc009a70 con 0x7f04d40a0a30 2023-10-03T10:15:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.047+0000 7f04d9df7700 1 --2- 172.21.15.72:0/2076473478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04d40a0a30 0x7f04d4122730 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009840 tx=0x7f04d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.047+0000 7f04ca7fc700 1 -- 172.21.15.72:0/2076473478 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0004450 con 0x7f04d40a0a30 2023-10-03T10:15:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.047+0000 7f04ca7fc700 1 -- 172.21.15.72:0/2076473478 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d001f070 con 0x7f04d40a0a30 2023-10-03T10:15:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.047+0000 7f04dc05b700 1 -- 172.21.15.72:0/2076473478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d00094a0 con 0x7f04d40a0a30 2023-10-03T10:15:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.047+0000 7f04ca7fc700 1 -- 172.21.15.72:0/2076473478 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d00038e0 con 0x7f04d40a0a30 2023-10-03T10:15:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.047+0000 7f04dc05b700 1 -- 172.21.15.72:0/2076473478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d40a25e0 con 0x7f04d40a0a30 2023-10-03T10:15:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.047+0000 7f04ca7fc700 1 -- 172.21.15.72:0/2076473478 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04d0003a40 con 0x7f04d40a0a30 2023-10-03T10:15:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.048+0000 7f04ca7fc700 1 -- 172.21.15.72:0/2076473478 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f04d0021070 con 0x7f04d40a0a30 2023-10-03T10:15:57.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.048+0000 7f04dc05b700 1 -- 172.21.15.72:0/2076473478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d40a0280 con 0x7f04d40a0a30 2023-10-03T10:15:57.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.052+0000 7f04ca7fc700 1 -- 172.21.15.72:0/2076473478 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04d002b020 con 0x7f04d40a0a30 2023-10-03T10:15:57.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:57.144 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:57.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.207+0000 7f5677794700 1 Processor -- start 2023-10-03T10:15:57.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.207+0000 7f5677794700 1 -- start start 2023-10-03T10:15:57.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.207+0000 7f5677794700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f567009f330 0x7f5670138e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.207+0000 7f5677794700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5670139370 0x7f567013b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.207+0000 7f5677794700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567006bc50 con 0x7f567009e850 2023-10-03T10:15:57.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.207+0000 7f5677794700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567009ae60 con 0x7f5670139370 2023-10-03T10:15:57.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.207+0000 7f5677794700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567006b990 con 0x7f567009f330 2023-10-03T10:15:57.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5675d31700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5670139370 0x7f567013b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5674d2f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f567009f330 0x7f5670138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5675d31700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5670139370 0x7f567013b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46708/0 (socket says 172.21.15.72:46708) 2023-10-03T10:15:57.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5674d2f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f567009f330 0x7f5670138e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41288/0 (socket says 172.21.15.72:41288) 2023-10-03T10:15:57.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5675d31700 1 -- 172.21.15.72:0/1251413073 learned_addr learned my addr 172.21.15.72:0/1251413073 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:57.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5675530700 1 --1- 172.21.15.72:0/1251413073 >> v1:172.21.15.72:6789/0 conn(0x7f567009e850 0x7f567009ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:50426/0 (socket says 172.21.15.72:50426) 2023-10-03T10:15:57.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5675d31700 1 -- 172.21.15.72:0/1251413073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f567009f330 msgr2=0x7f5670138e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:57.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5675d31700 1 --2- 172.21.15.72:0/1251413073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f567009f330 0x7f5670138e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5675d31700 1 -- 172.21.15.72:0/1251413073 >> v1:172.21.15.72:6789/0 conn(0x7f567009e850 legacy=0x7f567009ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5667fff700 1 -- 172.21.15.72:0/1251413073 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697553023 0 0) 0x7f567006bc50 con 0x7f567009e850 2023-10-03T10:15:57.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5675d31700 1 -- 172.21.15.72:0/1251413073 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567006cb10 con 0x7f5670139370 2023-10-03T10:15:57.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5674d2f700 1 --2- 172.21.15.72:0/1251413073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f567009f330 0x7f5670138e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5675d31700 1 --2- 172.21.15.72:0/1251413073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5670139370 0x7f567013b750 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f5668009e50 tx=0x7f566800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff6cf5fa9778b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5667fff700 1 -- 172.21.15.72:0/1251413073 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566800e070 con 0x7f5670139370 2023-10-03T10:15:57.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5667fff700 1 -- 172.21.15.72:0/1251413073 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566800b910 con 0x7f5670139370 2023-10-03T10:15:57.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.208+0000 7f5667fff700 1 -- 172.21.15.72:0/1251413073 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566800bcc0 con 0x7f5670139370 2023-10-03T10:15:57.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.209+0000 7f5677794700 1 -- 172.21.15.72:0/1251413073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5670139370 msgr2=0x7f567013b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.209+0000 7f5677794700 1 --2- 172.21.15.72:0/1251413073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5670139370 0x7f567013b750 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f5668009e50 tx=0x7f566800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.209+0000 7f5677794700 1 -- 172.21.15.72:0/1251413073 shutdown_connections 2023-10-03T10:15:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.209+0000 7f5677794700 1 --2- 172.21.15.72:0/1251413073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5670139370 0x7f567013b750 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.209+0000 7f5677794700 1 --2- 172.21.15.72:0/1251413073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f567009f330 0x7f5670138e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.209+0000 7f5677794700 1 -- 172.21.15.72:0/1251413073 >> 172.21.15.72:0/1251413073 conn(0x7f56700a3f70 msgr2=0x7f56700a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.209+0000 7f5677794700 1 -- 172.21.15.72:0/1251413073 shutdown_connections 2023-10-03T10:15:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.209+0000 7f5677794700 1 -- 172.21.15.72:0/1251413073 wait complete. 2023-10-03T10:15:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.210+0000 7f5677794700 1 Processor -- start 2023-10-03T10:15:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.210+0000 7f5677794700 1 -- start start 2023-10-03T10:15:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5677794700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f567009e850 0x7f56701c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5677794700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f567009f330 0x7f56701c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5677794700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5670139370 0x7f567011ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5677794700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5670122200 con 0x7f567009f330 2023-10-03T10:15:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5677794700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56701c93c0 con 0x7f567009e850 2023-10-03T10:15:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5677794700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56701223e0 con 0x7f5670139370 2023-10-03T10:15:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5675530700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f567009e850 0x7f56701c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5675530700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f567009e850 0x7f56701c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41294/0 (socket says 172.21.15.72:41294) 2023-10-03T10:15:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5675530700 1 -- 172.21.15.72:0/1529074913 learned_addr learned my addr 172.21.15.72:0/1529074913 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5674d2f700 1 --2- 172.21.15.72:0/1529074913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f567009f330 0x7f56701c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5675d31700 1 --2- 172.21.15.72:0/1529074913 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5670139370 0x7f567011ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5675530700 1 -- 172.21.15.72:0/1529074913 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5670139370 msgr2=0x7f567011ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5675530700 1 --2- 172.21.15.72:0/1529074913 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5670139370 0x7f567011ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5675530700 1 -- 172.21.15.72:0/1529074913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f567009f330 msgr2=0x7f56701c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5675530700 1 --2- 172.21.15.72:0/1529074913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f567009f330 0x7f56701c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5675530700 1 -- 172.21.15.72:0/1529074913 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56600094a0 con 0x7f567009e850 2023-10-03T10:15:57.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5675530700 1 --2- 172.21.15.72:0/1529074913 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f567009e850 0x7f56701c8940 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f566c00c520 tx=0x7f566c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5665ffb700 1 -- 172.21.15.72:0/1529074913 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c004c80 con 0x7f567009e850 2023-10-03T10:15:57.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.211+0000 7f5665ffb700 1 -- 172.21.15.72:0/1529074913 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c004de0 con 0x7f567009e850 2023-10-03T10:15:57.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.212+0000 7f5665ffb700 1 -- 172.21.15.72:0/1529074913 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c007310 con 0x7f567009e850 2023-10-03T10:15:57.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.212+0000 7f5677794700 1 -- 172.21.15.72:0/1529074913 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5668009b30 con 0x7f567009e850 2023-10-03T10:15:57.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.212+0000 7f5677794700 1 -- 172.21.15.72:0/1529074913 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56701be450 con 0x7f567009e850 2023-10-03T10:15:57.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.213+0000 7f5677794700 1 -- 172.21.15.72:0/1529074913 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56700747f0 con 0x7f567009e850 2023-10-03T10:15:57.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.213+0000 7f5665ffb700 1 -- 172.21.15.72:0/1529074913 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f566c007470 con 0x7f567009e850 2023-10-03T10:15:57.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.213+0000 7f5665ffb700 1 -- 172.21.15.72:0/1529074913 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f566c03f900 con 0x7f567009e850 2023-10-03T10:15:57.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.222+0000 7f5665ffb700 1 -- 172.21.15.72:0/1529074913 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f566c0133c0 con 0x7f567009e850 2023-10-03T10:15:57.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.254+0000 7f04dc05b700 1 -- 172.21.15.72:0/2076473478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f04d4074ea0 con 0x7f04d40a0a30 2023-10-03T10:15:57.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.254+0000 7f04ca7fc700 1 -- 172.21.15.72:0/2076473478 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f04d0015070 con 0x7f04d40a0a30 2023-10-03T10:15:57.255 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.256+0000 7f04dc05b700 1 -- 172.21.15.72:0/2076473478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04d40a0a30 msgr2=0x7f04d4122730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.256+0000 7f04dc05b700 1 --2- 172.21.15.72:0/2076473478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04d40a0a30 0x7f04d4122730 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009840 tx=0x7f04d0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.256+0000 7f04dc05b700 1 -- 172.21.15.72:0/2076473478 shutdown_connections 2023-10-03T10:15:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.256+0000 7f04dc05b700 1 --2- 172.21.15.72:0/2076473478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04d40a0a30 0x7f04d4122730 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.256+0000 7f04dc05b700 1 --2- 172.21.15.72:0/2076473478 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04d4134170 0x7f04d41231b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.256+0000 7f04dc05b700 1 --2- 172.21.15.72:0/2076473478 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04d40a1340 0x7f04d4122c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.256+0000 7f04dc05b700 1 -- 172.21.15.72:0/2076473478 >> 172.21.15.72:0/2076473478 conn(0x7f04d40a6550 msgr2=0x7f04d409edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.256+0000 7f04dc05b700 1 -- 172.21.15.72:0/2076473478 shutdown_connections 2023-10-03T10:15:57.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.256+0000 7f04dc05b700 1 -- 172.21.15.72:0/2076473478 wait complete. 2023-10-03T10:15:57.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:57.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.269+0000 7f5f03e7c700 1 Processor -- start 2023-10-03T10:15:57.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.269+0000 7f5f03e7c700 1 -- start start 2023-10-03T10:15:57.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.269+0000 7f5f03e7c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5efc09d6f0 0x7f5efc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.269+0000 7f5f03e7c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5efc09e000 0x7f5efc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.269+0000 7f5f03e7c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5efc09e410 0x7f5efc133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.269+0000 7f5f03e7c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc06b460 con 0x7f5efc09e000 2023-10-03T10:15:57.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.269+0000 7f5f03e7c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc09b120 con 0x7f5efc09d6f0 2023-10-03T10:15:57.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.269+0000 7f5f03e7c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc09a7e0 con 0x7f5efc09e410 2023-10-03T10:15:57.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.269+0000 7f5f01c18700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5efc09d6f0 0x7f5efc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.269+0000 7f5f02419700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5efc09e410 0x7f5efc133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.270+0000 7f5f02419700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5efc09e410 0x7f5efc133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36768/0 (socket says 172.21.15.72:36768) 2023-10-03T10:15:57.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.270+0000 7f5f01c18700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5efc09d6f0 0x7f5efc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41306/0 (socket says 172.21.15.72:41306) 2023-10-03T10:15:57.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.270+0000 7f5f02419700 1 -- 172.21.15.72:0/3998109056 learned_addr learned my addr 172.21.15.72:0/3998109056 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:57.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.270+0000 7f5f01417700 1 --2- 172.21.15.72:0/3998109056 >> v2:172.21.15.72:3300/0 conn(0x7f5efc09e000 0x7f5efc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.270+0000 7f5f02419700 1 -- 172.21.15.72:0/3998109056 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5efc09d6f0 msgr2=0x7f5efc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:57.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.270+0000 7f5f02419700 1 --2- 172.21.15.72:0/3998109056 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5efc09d6f0 0x7f5efc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.270+0000 7f5f02419700 1 -- 172.21.15.72:0/3998109056 >> v2:172.21.15.72:3300/0 conn(0x7f5efc09e000 msgr2=0x7f5efc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:57.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.270+0000 7f5f02419700 1 --2- 172.21.15.72:0/3998109056 >> v2:172.21.15.72:3300/0 conn(0x7f5efc09e000 0x7f5efc1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.270+0000 7f5f02419700 1 -- 172.21.15.72:0/3998109056 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc09a500 con 0x7f5efc09e410 2023-10-03T10:15:57.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.270+0000 7f5f02419700 1 --2- 172.21.15.72:0/3998109056 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5efc09e410 0x7f5efc133f30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009e80 tx=0x7f5ef400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b9afeea6b405f50 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.270+0000 7f5f00c16700 1 -- 172.21.15.72:0/3998109056 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef400e070 con 0x7f5efc09e410 2023-10-03T10:15:57.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.270+0000 7f5f00c16700 1 -- 172.21.15.72:0/3998109056 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef400b8d0 con 0x7f5efc09e410 2023-10-03T10:15:57.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.270+0000 7f5f00c16700 1 -- 172.21.15.72:0/3998109056 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef400bc80 con 0x7f5efc09e410 2023-10-03T10:15:57.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.271+0000 7f5f03e7c700 1 -- 172.21.15.72:0/3998109056 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5efc09e410 msgr2=0x7f5efc133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.271+0000 7f5f03e7c700 1 --2- 172.21.15.72:0/3998109056 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5efc09e410 0x7f5efc133f30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009e80 tx=0x7f5ef400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:57.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.271+0000 7f5f03e7c700 1 -- 172.21.15.72:0/3998109056 shutdown_connections 2023-10-03T10:15:57.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.271+0000 7f5f03e7c700 1 --2- 172.21.15.72:0/3998109056 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5efc09e410 0x7f5efc133f30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.271+0000 7f5f03e7c700 1 --2- 172.21.15.72:0/3998109056 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5efc09d6f0 0x7f5efc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.271+0000 7f5f03e7c700 1 --2- 172.21.15.72:0/3998109056 >> v2:172.21.15.72:3300/0 conn(0x7f5efc09e000 0x7f5efc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.271+0000 7f5f03e7c700 1 -- 172.21.15.72:0/3998109056 >> 172.21.15.72:0/3998109056 conn(0x7f5efc066f50 msgr2=0x7f5efc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.271+0000 7f5f03e7c700 1 -- 172.21.15.72:0/3998109056 shutdown_connections 2023-10-03T10:15:57.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.271+0000 7f5f03e7c700 1 -- 172.21.15.72:0/3998109056 wait complete. 2023-10-03T10:15:57.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.272+0000 7f5f03e7c700 1 Processor -- start 2023-10-03T10:15:57.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.272+0000 7f5f03e7c700 1 -- start start 2023-10-03T10:15:57.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.272+0000 7f5f03e7c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5efc09d6f0 0x7f5efc1c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.272+0000 7f5f03e7c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5efc09e000 0x7f5efc1c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.272+0000 7f5f03e7c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5efc09e410 0x7f5efc1c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.272+0000 7f5f03e7c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc1a78d0 con 0x7f5efc09d6f0 2023-10-03T10:15:57.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.272+0000 7f5f03e7c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc1a81a0 con 0x7f5efc09e410 2023-10-03T10:15:57.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.272+0000 7f5f03e7c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0a2060 con 0x7f5efc09e000 2023-10-03T10:15:57.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.272+0000 7f5f01c18700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5efc09d6f0 0x7f5efc1c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.272+0000 7f5f01417700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5efc09e000 0x7f5efc1c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.272+0000 7f5f01c18700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5efc09d6f0 0x7f5efc1c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46732/0 (socket says 172.21.15.72:46732) 2023-10-03T10:15:57.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.272+0000 7f5f01c18700 1 -- 172.21.15.72:0/2352955564 learned_addr learned my addr 172.21.15.72:0/2352955564 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:57.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.272+0000 7f5f02419700 1 --2- 172.21.15.72:0/2352955564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5efc09e410 0x7f5efc1c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.273+0000 7f5f02419700 1 -- 172.21.15.72:0/2352955564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5efc09e000 msgr2=0x7f5efc1c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.273+0000 7f5f02419700 1 --2- 172.21.15.72:0/2352955564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5efc09e000 0x7f5efc1c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.273+0000 7f5f02419700 1 -- 172.21.15.72:0/2352955564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5efc09d6f0 msgr2=0x7f5efc1c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.273+0000 7f5f02419700 1 --2- 172.21.15.72:0/2352955564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5efc09d6f0 0x7f5efc1c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.273+0000 7f5f02419700 1 -- 172.21.15.72:0/2352955564 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef4009b30 con 0x7f5efc09e410 2023-10-03T10:15:57.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.273+0000 7f5f01c18700 1 --2- 172.21.15.72:0/2352955564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5efc09d6f0 0x7f5efc1c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.273+0000 7f5f01417700 1 --2- 172.21.15.72:0/2352955564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5efc09e000 0x7f5efc1c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.273+0000 7f5f02419700 1 --2- 172.21.15.72:0/2352955564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5efc09e410 0x7f5efc1c8040 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4015000 tx=0x7f5ef4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.273+0000 7f5ef27fc700 1 -- 172.21.15.72:0/2352955564 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4004450 con 0x7f5efc09e410 2023-10-03T10:15:57.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.273+0000 7f5ef27fc700 1 -- 172.21.15.72:0/2352955564 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef40045f0 con 0x7f5efc09e410 2023-10-03T10:15:57.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.273+0000 7f5f03e7c700 1 -- 172.21.15.72:0/2352955564 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc1a97e0 con 0x7f5efc09e410 2023-10-03T10:15:57.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.273+0000 7f5ef27fc700 1 -- 172.21.15.72:0/2352955564 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4003e10 con 0x7f5efc09e410 2023-10-03T10:15:57.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.273+0000 7f5f03e7c700 1 -- 172.21.15.72:0/2352955564 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc09c760 con 0x7f5efc09e410 2023-10-03T10:15:57.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.274+0000 7f5ef27fc700 1 -- 172.21.15.72:0/2352955564 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ef401c410 con 0x7f5efc09e410 2023-10-03T10:15:57.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.274+0000 7f5ef27fc700 1 -- 172.21.15.72:0/2352955564 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5ef4040eb0 con 0x7f5efc09e410 2023-10-03T10:15:57.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.274+0000 7f5f03e7c700 1 -- 172.21.15.72:0/2352955564 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5efc1a90b0 con 0x7f5efc09e410 2023-10-03T10:15:57.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.279+0000 7f5ef27fc700 1 -- 172.21.15.72:0/2352955564 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ef402a080 con 0x7f5efc09e410 2023-10-03T10:15:57.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.415+0000 7f5677794700 1 -- 172.21.15.72:0/1529074913 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5670134790 con 0x7f567009e850 2023-10-03T10:15:57.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.416+0000 7f5665ffb700 1 -- 172.21.15.72:0/1529074913 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f566c011360 con 0x7f567009e850 2023-10-03T10:15:57.417 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:57.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.418+0000 7f5677794700 1 -- 172.21.15.72:0/1529074913 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f567009e850 msgr2=0x7f56701c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.418+0000 7f5677794700 1 --2- 172.21.15.72:0/1529074913 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f567009e850 0x7f56701c8940 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f566c00c520 tx=0x7f566c00c830 comp rx=0 tx=0).stop 2023-10-03T10:15:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.418+0000 7f5677794700 1 -- 172.21.15.72:0/1529074913 shutdown_connections 2023-10-03T10:15:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.418+0000 7f5677794700 1 --2- 172.21.15.72:0/1529074913 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5670139370 0x7f567011ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.418+0000 7f5677794700 1 --2- 172.21.15.72:0/1529074913 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f567009e850 0x7f56701c8940 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.418+0000 7f5677794700 1 --2- 172.21.15.72:0/1529074913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f567009f330 0x7f56701c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.418+0000 7f5677794700 1 -- 172.21.15.72:0/1529074913 >> 172.21.15.72:0/1529074913 conn(0x7f56700a3f70 msgr2=0x7f56700a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.418+0000 7f5677794700 1 -- 172.21.15.72:0/1529074913 shutdown_connections 2023-10-03T10:15:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.418+0000 7f5677794700 1 -- 172.21.15.72:0/1529074913 wait complete. 2023-10-03T10:15:57.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:57.470 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:57.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.472+0000 7f5f03e7c700 1 -- 172.21.15.72:0/2352955564 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5efc074ea0 con 0x7f5efc09e410 2023-10-03T10:15:57.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.473+0000 7f5ef27fc700 1 -- 172.21.15.72:0/2352955564 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ef402d350 con 0x7f5efc09e410 2023-10-03T10:15:57.473 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:57.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.475+0000 7f5f03e7c700 1 -- 172.21.15.72:0/2352955564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5efc09e410 msgr2=0x7f5efc1c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.475+0000 7f5f03e7c700 1 --2- 172.21.15.72:0/2352955564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5efc09e410 0x7f5efc1c8040 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4015000 tx=0x7f5ef4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.475+0000 7f5f03e7c700 1 -- 172.21.15.72:0/2352955564 shutdown_connections 2023-10-03T10:15:57.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.475+0000 7f5f03e7c700 1 --2- 172.21.15.72:0/2352955564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5efc09d6f0 0x7f5efc1c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.475+0000 7f5f03e7c700 1 --2- 172.21.15.72:0/2352955564 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5efc09e410 0x7f5efc1c8040 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.475+0000 7f5f03e7c700 1 --2- 172.21.15.72:0/2352955564 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5efc09e000 0x7f5efc1c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.475+0000 7f5f03e7c700 1 -- 172.21.15.72:0/2352955564 >> 172.21.15.72:0/2352955564 conn(0x7f5efc066f50 msgr2=0x7f5efc1bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.475+0000 7f5f03e7c700 1 -- 172.21.15.72:0/2352955564 shutdown_connections 2023-10-03T10:15:57.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.475+0000 7f5f03e7c700 1 -- 172.21.15.72:0/2352955564 wait complete. 2023-10-03T10:15:57.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:57.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.594+0000 7f8feb344700 1 Processor -- start 2023-10-03T10:15:57.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.594+0000 7f8feb344700 1 -- start start 2023-10-03T10:15:57.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8feb344700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8fe409d6f0 0x7f8fe409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8feb344700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8fe409e000 0x7f8fe4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8feb344700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fe409e410 0x7f8fe4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8feb344700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe409f520 con 0x7f8fe409e000 2023-10-03T10:15:57.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8feb344700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe409f130 con 0x7f8fe409e410 2023-10-03T10:15:57.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8feb344700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe409e930 con 0x7f8fe409d6f0 2023-10-03T10:15:57.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8fe90e0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8fe409d6f0 0x7f8fe409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8fe88df700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8fe409e000 0x7f8fe4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8fe98e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fe409e410 0x7f8fe4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8fe88df700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8fe409e000 0x7f8fe4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46744/0 (socket says 172.21.15.72:46744) 2023-10-03T10:15:57.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8fe90e0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8fe409d6f0 0x7f8fe409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36794/0 (socket says 172.21.15.72:36794) 2023-10-03T10:15:57.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8fe88df700 1 -- 172.21.15.72:0/1518924907 learned_addr learned my addr 172.21.15.72:0/1518924907 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:57.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8fe98e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fe409e410 0x7f8fe4130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41316/0 (socket says 172.21.15.72:41316) 2023-10-03T10:15:57.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8fe88df700 1 -- 172.21.15.72:0/1518924907 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8fe409d6f0 msgr2=0x7f8fe409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:57.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8fe88df700 1 --2- 172.21.15.72:0/1518924907 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8fe409d6f0 0x7f8fe409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8fe88df700 1 -- 172.21.15.72:0/1518924907 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fe409e410 msgr2=0x7f8fe4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:57.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8fe88df700 1 --2- 172.21.15.72:0/1518924907 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fe409e410 0x7f8fe4130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8fe88df700 1 -- 172.21.15.72:0/1518924907 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe409b2d0 con 0x7f8fe409e000 2023-10-03T10:15:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8fe90e0700 1 --2- 172.21.15.72:0/1518924907 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8fe409d6f0 0x7f8fe409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8fe98e1700 1 --2- 172.21.15.72:0/1518924907 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fe409e410 0x7f8fe4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.595+0000 7f8fe88df700 1 --2- 172.21.15.72:0/1518924907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fe409e000 0x7f8fe4130660 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009920 tx=0x7f8fd4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2064f59d06defae9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.596+0000 7f8fdbfff700 1 -- 172.21.15.72:0/1518924907 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4011830 con 0x7f8fe409e000 2023-10-03T10:15:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.596+0000 7f8fdbfff700 1 -- 172.21.15.72:0/1518924907 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd4011990 con 0x7f8fe409e000 2023-10-03T10:15:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.596+0000 7f8fdbfff700 1 -- 172.21.15.72:0/1518924907 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4011d20 con 0x7f8fe409e000 2023-10-03T10:15:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.596+0000 7f8feb344700 1 -- 172.21.15.72:0/1518924907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fe409e000 msgr2=0x7f8fe4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.596+0000 7f8feb344700 1 --2- 172.21.15.72:0/1518924907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fe409e000 0x7f8fe4130660 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009920 tx=0x7f8fd4009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.596+0000 7f8feb344700 1 -- 172.21.15.72:0/1518924907 shutdown_connections 2023-10-03T10:15:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.596+0000 7f8feb344700 1 --2- 172.21.15.72:0/1518924907 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fe409e410 0x7f8fe4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.596+0000 7f8feb344700 1 --2- 172.21.15.72:0/1518924907 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8fe409d6f0 0x7f8fe409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.596+0000 7f8feb344700 1 --2- 172.21.15.72:0/1518924907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fe409e000 0x7f8fe4130660 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.596+0000 7f8feb344700 1 -- 172.21.15.72:0/1518924907 >> 172.21.15.72:0/1518924907 conn(0x7f8fe4066f50 msgr2=0x7f8fe409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.596+0000 7f8feb344700 1 -- 172.21.15.72:0/1518924907 shutdown_connections 2023-10-03T10:15:57.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.596+0000 7f8feb344700 1 -- 172.21.15.72:0/1518924907 wait complete. 2023-10-03T10:15:57.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.597+0000 7f8feb344700 1 Processor -- start 2023-10-03T10:15:57.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.597+0000 7f8feb344700 1 -- start start 2023-10-03T10:15:57.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8feb344700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fe409d6f0 0x7f8fe411f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8feb344700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8fe409e000 0x7f8fe411f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8feb344700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fe409e410 0x7f8fe411faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:57.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8feb344700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe4122af0 con 0x7f8fe409e410 2023-10-03T10:15:57.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8feb344700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe4121a70 con 0x7f8fe409d6f0 2023-10-03T10:15:57.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8feb344700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe4122280 con 0x7f8fe409e000 2023-10-03T10:15:57.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8fe88df700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8fe409e000 0x7f8fe411f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8fe88df700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8fe409e000 0x7f8fe411f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36804/0 (socket says 172.21.15.72:36804) 2023-10-03T10:15:57.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8fe88df700 1 -- 172.21.15.72:0/3123640867 learned_addr learned my addr 172.21.15.72:0/3123640867 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:57.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8fe98e1700 1 --2- 172.21.15.72:0/3123640867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fe409e410 0x7f8fe411faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8fe90e0700 1 --2- 172.21.15.72:0/3123640867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fe409d6f0 0x7f8fe411f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:57.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8fe88df700 1 -- 172.21.15.72:0/3123640867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fe409d6f0 msgr2=0x7f8fe411f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8fe88df700 1 --2- 172.21.15.72:0/3123640867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fe409d6f0 0x7f8fe411f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8fe88df700 1 -- 172.21.15.72:0/3123640867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fe409e410 msgr2=0x7f8fe411faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8fe88df700 1 --2- 172.21.15.72:0/3123640867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fe409e410 0x7f8fe411faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8fe88df700 1 -- 172.21.15.72:0/3123640867 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe00094a0 con 0x7f8fe409e000 2023-10-03T10:15:57.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8fe88df700 1 --2- 172.21.15.72:0/3123640867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8fe409e000 0x7f8fe411f5b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4000c00 tx=0x7f8fd4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:57.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8fd9ffb700 1 -- 172.21.15.72:0/3123640867 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4004240 con 0x7f8fe409e000 2023-10-03T10:15:57.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8fd9ffb700 1 -- 172.21.15.72:0/3123640867 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd401f070 con 0x7f8fe409e000 2023-10-03T10:15:57.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8feb344700 1 -- 172.21.15.72:0/3123640867 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fdc009a70 con 0x7f8fe409e000 2023-10-03T10:15:57.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.598+0000 7f8fd9ffb700 1 -- 172.21.15.72:0/3123640867 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd40036a0 con 0x7f8fe409e000 2023-10-03T10:15:57.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.599+0000 7f8feb344700 1 -- 172.21.15.72:0/3123640867 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd4009550 con 0x7f8fe409e000 2023-10-03T10:15:57.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.599+0000 7f8fd9ffb700 1 -- 172.21.15.72:0/3123640867 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8fd4021030 con 0x7f8fe409e000 2023-10-03T10:15:57.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.599+0000 7f8fd9ffb700 1 -- 172.21.15.72:0/3123640867 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8fd40407e0 con 0x7f8fe409e000 2023-10-03T10:15:57.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.599+0000 7f8feb344700 1 -- 172.21.15.72:0/3123640867 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe409c700 con 0x7f8fe409e000 2023-10-03T10:15:57.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.604+0000 7f8fd9ffb700 1 -- 172.21.15.72:0/3123640867 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8fe409c700 con 0x7f8fe409e000 2023-10-03T10:15:57.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.788+0000 7f8feb344700 1 -- 172.21.15.72:0/3123640867 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8fe409c700 con 0x7f8fe409e000 2023-10-03T10:15:57.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.788+0000 7f8fd9ffb700 1 -- 172.21.15.72:0/3123640867 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8fe409c700 con 0x7f8fe409e000 2023-10-03T10:15:57.789 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:57.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.790+0000 7f8feb344700 1 -- 172.21.15.72:0/3123640867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8fe409e000 msgr2=0x7f8fe411f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.790+0000 7f8feb344700 1 --2- 172.21.15.72:0/3123640867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8fe409e000 0x7f8fe411f5b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4000c00 tx=0x7f8fd4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:57.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.790+0000 7f8feb344700 1 -- 172.21.15.72:0/3123640867 shutdown_connections 2023-10-03T10:15:57.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.790+0000 7f8feb344700 1 --2- 172.21.15.72:0/3123640867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fe409e410 0x7f8fe411faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.790+0000 7f8feb344700 1 --2- 172.21.15.72:0/3123640867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fe409d6f0 0x7f8fe411f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.790+0000 7f8feb344700 1 --2- 172.21.15.72:0/3123640867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8fe409e000 0x7f8fe411f5b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.790+0000 7f8feb344700 1 -- 172.21.15.72:0/3123640867 >> 172.21.15.72:0/3123640867 conn(0x7f8fe4066f50 msgr2=0x7f8fe4119480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.790+0000 7f8feb344700 1 -- 172.21.15.72:0/3123640867 shutdown_connections 2023-10-03T10:15:57.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:57.790+0000 7f8feb344700 1 -- 172.21.15.72:0/3123640867 wait complete. 2023-10-03T10:15:57.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:58.270 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:58.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.393+0000 7f6086d0c700 1 Processor -- start 2023-10-03T10:15:58.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.393+0000 7f6086d0c700 1 -- start start 2023-10-03T10:15:58.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.394+0000 7f6086d0c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6080131630 0x7f6080131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.394+0000 7f6086d0c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6080131f40 0x7f608006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.394+0000 7f6086d0c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6080071a00 con 0x7f608006e9d0 2023-10-03T10:15:58.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.394+0000 7f6086d0c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6080131430 con 0x7f6080131630 2023-10-03T10:15:58.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.394+0000 7f6086d0c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f608009a510 con 0x7f6080131f40 2023-10-03T10:15:58.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.394+0000 7f607ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6080131f40 0x7f608006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.394+0000 7f6084aa8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6080131630 0x7f6080131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.394+0000 7f607ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6080131f40 0x7f608006e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49518/0 (socket says 172.21.15.72:49518) 2023-10-03T10:15:58.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.394+0000 7f607ffff700 1 -- 172.21.15.72:0/2351917365 learned_addr learned my addr 172.21.15.72:0/2351917365 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:58.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.394+0000 7f607ffff700 1 -- 172.21.15.72:0/2351917365 >> v2:172.21.15.72:3300/0 conn(0x7f6080131630 msgr2=0x7f6080131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.394+0000 7f607ffff700 1 --2- 172.21.15.72:0/2351917365 >> v2:172.21.15.72:3300/0 conn(0x7f6080131630 0x7f6080131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.394+0000 7f607ffff700 1 -- 172.21.15.72:0/2351917365 >> v1:172.21.15.72:6789/0 conn(0x7f608006e9d0 legacy=0x7f6080138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.394+0000 7f607ffff700 1 -- 172.21.15.72:0/2351917365 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60800721c0 con 0x7f6080131f40 2023-10-03T10:15:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.394+0000 7f6084aa8700 1 --2- 172.21.15.72:0/2351917365 >> v2:172.21.15.72:3300/0 conn(0x7f6080131630 0x7f6080131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.394+0000 7f607f7fe700 1 -- 172.21.15.72:0/2351917365 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353589238 0 0) 0x7f6080071a00 con 0x7f608006e9d0 2023-10-03T10:15:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.395+0000 7f607ffff700 1 --2- 172.21.15.72:0/2351917365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6080131f40 0x7f608006e490 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f60740098f0 tx=0x7f6074009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dbc6a3582d17ab6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.395+0000 7f607f7fe700 1 -- 172.21.15.72:0/2351917365 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074011830 con 0x7f6080131f40 2023-10-03T10:15:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.395+0000 7f607f7fe700 1 -- 172.21.15.72:0/2351917365 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6074011990 con 0x7f6080131f40 2023-10-03T10:15:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.395+0000 7f607f7fe700 1 -- 172.21.15.72:0/2351917365 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074011d20 con 0x7f6080131f40 2023-10-03T10:15:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.395+0000 7f6086d0c700 1 -- 172.21.15.72:0/2351917365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6080131f40 msgr2=0x7f608006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.395+0000 7f6086d0c700 1 --2- 172.21.15.72:0/2351917365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6080131f40 0x7f608006e490 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f60740098f0 tx=0x7f6074009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.395+0000 7f6086d0c700 1 -- 172.21.15.72:0/2351917365 shutdown_connections 2023-10-03T10:15:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.395+0000 7f6086d0c700 1 --2- 172.21.15.72:0/2351917365 >> v2:172.21.15.72:3300/0 conn(0x7f6080131630 0x7f6080131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.395+0000 7f6086d0c700 1 --2- 172.21.15.72:0/2351917365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6080131f40 0x7f608006e490 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.395+0000 7f6086d0c700 1 -- 172.21.15.72:0/2351917365 >> 172.21.15.72:0/2351917365 conn(0x7f60800a2aa0 msgr2=0x7f60800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.395+0000 7f6086d0c700 1 -- 172.21.15.72:0/2351917365 shutdown_connections 2023-10-03T10:15:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.395+0000 7f6086d0c700 1 -- 172.21.15.72:0/2351917365 wait complete. 2023-10-03T10:15:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.397+0000 7f6086d0c700 1 Processor -- start 2023-10-03T10:15:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.397+0000 7f6086d0c700 1 -- start start 2023-10-03T10:15:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.397+0000 7f6086d0c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608006e9d0 0x7f6080119500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.397+0000 7f6086d0c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6080131630 0x7f6080119a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.397+0000 7f6086d0c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6080131f40 0x7f6080119f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.397+0000 7f6086d0c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608011ccf0 con 0x7f6080131f40 2023-10-03T10:15:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.397+0000 7f6086d0c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608009f7d0 con 0x7f608006e9d0 2023-10-03T10:15:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.397+0000 7f6086d0c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f608011b1d0 con 0x7f6080131630 2023-10-03T10:15:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f6084aa8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608006e9d0 0x7f6080119500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f6084aa8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608006e9d0 0x7f6080119500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35260/0 (socket says 172.21.15.72:35260) 2023-10-03T10:15:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f6084aa8700 1 -- 172.21.15.72:0/97195157 learned_addr learned my addr 172.21.15.72:0/97195157 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f607ffff700 1 --2- 172.21.15.72:0/97195157 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6080131630 0x7f6080119a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f60852a9700 1 --2- 172.21.15.72:0/97195157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6080131f40 0x7f6080119f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f6084aa8700 1 -- 172.21.15.72:0/97195157 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6080131630 msgr2=0x7f6080119a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f6084aa8700 1 --2- 172.21.15.72:0/97195157 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6080131630 0x7f6080119a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f6084aa8700 1 -- 172.21.15.72:0/97195157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6080131f40 msgr2=0x7f6080119f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f6084aa8700 1 --2- 172.21.15.72:0/97195157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6080131f40 0x7f6080119f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f6084aa8700 1 -- 172.21.15.72:0/97195157 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6078009a70 con 0x7f608006e9d0 2023-10-03T10:15:58.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f6084aa8700 1 --2- 172.21.15.72:0/97195157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608006e9d0 0x7f6080119500 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f607800efc0 tx=0x7f607800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f607d7fa700 1 -- 172.21.15.72:0/97195157 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607800cdd0 con 0x7f608006e9d0 2023-10-03T10:15:58.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f607d7fa700 1 -- 172.21.15.72:0/97195157 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607800f040 con 0x7f608006e9d0 2023-10-03T10:15:58.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f6086d0c700 1 -- 172.21.15.72:0/97195157 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6074009550 con 0x7f608006e9d0 2023-10-03T10:15:58.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f607d7fa700 1 -- 172.21.15.72:0/97195157 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60780146a0 con 0x7f608006e9d0 2023-10-03T10:15:58.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.398+0000 7f6086d0c700 1 -- 172.21.15.72:0/97195157 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608011c310 con 0x7f608006e9d0 2023-10-03T10:15:58.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.399+0000 7f607d7fa700 1 -- 172.21.15.72:0/97195157 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6078014800 con 0x7f608006e9d0 2023-10-03T10:15:58.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.399+0000 7f607d7fa700 1 -- 172.21.15.72:0/97195157 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6078040380 con 0x7f608006e9d0 2023-10-03T10:15:58.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.399+0000 7f6086d0c700 1 -- 172.21.15.72:0/97195157 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6080074ea0 con 0x7f608006e9d0 2023-10-03T10:15:58.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.404+0000 7f607d7fa700 1 -- 172.21.15.72:0/97195157 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f607801d400 con 0x7f608006e9d0 2023-10-03T10:15:58.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:58.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:58.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.557+0000 7f5ea0d62700 1 Processor -- start 2023-10-03T10:15:58.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.557+0000 7f5ea0d62700 1 -- start start 2023-10-03T10:15:58.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5ea0d62700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e9c133540 0x7f5e9c135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5ea0d62700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5e9c135e60 0x7f5e9c138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5ea0d62700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9c0716a0 con 0x7f5e9c130540 2023-10-03T10:15:58.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5ea0d62700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e9c071290 con 0x7f5e9c135e60 2023-10-03T10:15:58.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5ea0d62700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c130340 con 0x7f5e9c133540 2023-10-03T10:15:58.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5e99d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e9c133540 0x7f5e9c135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5e9a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5e9c130540 0x7f5e9c130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35696/0 (socket says 172.21.15.72:35696) 2023-10-03T10:15:58.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5e9a59c700 1 -- 172.21.15.72:0/3166569558 learned_addr learned my addr 172.21.15.72:0/3166569558 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:58.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5e9ad9d700 1 --2- 172.21.15.72:0/3166569558 >> v2:172.21.15.72:3300/0 conn(0x7f5e9c135e60 0x7f5e9c138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5e99d9b700 1 -- 172.21.15.72:0/3166569558 >> v2:172.21.15.72:3300/0 conn(0x7f5e9c135e60 msgr2=0x7f5e9c138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5e99d9b700 1 --2- 172.21.15.72:0/3166569558 >> v2:172.21.15.72:3300/0 conn(0x7f5e9c135e60 0x7f5e9c138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5e99d9b700 1 -- 172.21.15.72:0/3166569558 >> v1:172.21.15.72:6789/0 conn(0x7f5e9c130540 legacy=0x7f5e9c130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5e9959a700 1 -- 172.21.15.72:0/3166569558 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137552330 0 0) 0x7f5e9c0716a0 con 0x7f5e9c130540 2023-10-03T10:15:58.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5e99d9b700 1 -- 172.21.15.72:0/3166569558 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c070b80 con 0x7f5e9c133540 2023-10-03T10:15:58.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5e9ad9d700 1 --2- 172.21.15.72:0/3166569558 >> v2:172.21.15.72:3300/0 conn(0x7f5e9c135e60 0x7f5e9c138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.558+0000 7f5e99d9b700 1 --2- 172.21.15.72:0/3166569558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e9c133540 0x7f5e9c135920 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009840 tx=0x7f5e90009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45fb812a6dcd642b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.559+0000 7f5e9959a700 1 -- 172.21.15.72:0/3166569558 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e90011830 con 0x7f5e9c133540 2023-10-03T10:15:58.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.559+0000 7f5e9959a700 1 -- 172.21.15.72:0/3166569558 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e90011990 con 0x7f5e9c133540 2023-10-03T10:15:58.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.559+0000 7f5e9959a700 1 -- 172.21.15.72:0/3166569558 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e90011d20 con 0x7f5e9c133540 2023-10-03T10:15:58.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.559+0000 7f5ea0d62700 1 -- 172.21.15.72:0/3166569558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e9c133540 msgr2=0x7f5e9c135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.559+0000 7f5ea0d62700 1 --2- 172.21.15.72:0/3166569558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e9c133540 0x7f5e9c135920 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009840 tx=0x7f5e90009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:58.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.559+0000 7f5ea0d62700 1 -- 172.21.15.72:0/3166569558 shutdown_connections 2023-10-03T10:15:58.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.559+0000 7f5ea0d62700 1 --2- 172.21.15.72:0/3166569558 >> v2:172.21.15.72:3300/0 conn(0x7f5e9c135e60 0x7f5e9c138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.559+0000 7f5ea0d62700 1 --2- 172.21.15.72:0/3166569558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e9c133540 0x7f5e9c135920 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.559+0000 7f5ea0d62700 1 -- 172.21.15.72:0/3166569558 >> 172.21.15.72:0/3166569558 conn(0x7f5e9c0a2aa0 msgr2=0x7f5e9c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.559+0000 7f5ea0d62700 1 -- 172.21.15.72:0/3166569558 shutdown_connections 2023-10-03T10:15:58.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.559+0000 7f5ea0d62700 1 -- 172.21.15.72:0/3166569558 wait complete. 2023-10-03T10:15:58.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.560+0000 7f5ea0d62700 1 Processor -- start 2023-10-03T10:15:58.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.560+0000 7f5ea0d62700 1 -- start start 2023-10-03T10:15:58.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5ea0d62700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e9c130540 0x7f5e9c09c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5ea0d62700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e9c133540 0x7f5e9c09cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5ea0d62700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c135e60 0x7f5e9c09d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5ea0d62700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c09e100 con 0x7f5e9c135e60 2023-10-03T10:15:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5ea0d62700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c1359c0 con 0x7f5e9c130540 2023-10-03T10:15:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5ea0d62700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c11a610 con 0x7f5e9c133540 2023-10-03T10:15:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5e99d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e9c133540 0x7f5e9c09cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5e9ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c135e60 0x7f5e9c09d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5e99d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e9c133540 0x7f5e9c09cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49532/0 (socket says 172.21.15.72:49532) 2023-10-03T10:15:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5e9ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c135e60 0x7f5e9c09d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54646/0 (socket says 172.21.15.72:54646) 2023-10-03T10:15:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5e99d9b700 1 -- 172.21.15.72:0/4219500336 learned_addr learned my addr 172.21.15.72:0/4219500336 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5e9a59c700 1 --2- 172.21.15.72:0/4219500336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e9c130540 0x7f5e9c09c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5e9ad9d700 1 -- 172.21.15.72:0/4219500336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e9c133540 msgr2=0x7f5e9c09cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5e9ad9d700 1 --2- 172.21.15.72:0/4219500336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e9c133540 0x7f5e9c09cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5e9ad9d700 1 -- 172.21.15.72:0/4219500336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e9c130540 msgr2=0x7f5e9c09c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5e9ad9d700 1 --2- 172.21.15.72:0/4219500336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e9c130540 0x7f5e9c09c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5e9ad9d700 1 -- 172.21.15.72:0/4219500336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e94009a70 con 0x7f5e9c135e60 2023-10-03T10:15:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.561+0000 7f5e9ad9d700 1 --2- 172.21.15.72:0/4219500336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c135e60 0x7f5e9c09d010 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400efc0 tx=0x7f5e9400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.562+0000 7f5e8affd700 1 -- 172.21.15.72:0/4219500336 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400ca90 con 0x7f5e9c135e60 2023-10-03T10:15:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.562+0000 7f5e8affd700 1 -- 172.21.15.72:0/4219500336 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9400f040 con 0x7f5e9c135e60 2023-10-03T10:15:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.562+0000 7f5ea0d62700 1 -- 172.21.15.72:0/4219500336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e900094a0 con 0x7f5e9c135e60 2023-10-03T10:15:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.562+0000 7f5e8affd700 1 -- 172.21.15.72:0/4219500336 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400ce30 con 0x7f5e9c135e60 2023-10-03T10:15:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.562+0000 7f5ea0d62700 1 -- 172.21.15.72:0/4219500336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9c1199c0 con 0x7f5e9c135e60 2023-10-03T10:15:58.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.563+0000 7f5e8affd700 1 -- 172.21.15.72:0/4219500336 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e94014480 con 0x7f5e9c135e60 2023-10-03T10:15:58.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.563+0000 7f5ea0d62700 1 -- 172.21.15.72:0/4219500336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9c074ea0 con 0x7f5e9c135e60 2023-10-03T10:15:58.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.563+0000 7f5e8affd700 1 -- 172.21.15.72:0/4219500336 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5e9403fce0 con 0x7f5e9c135e60 2023-10-03T10:15:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.571+0000 7f5e8affd700 1 -- 172.21.15.72:0/4219500336 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e94012910 con 0x7f5e9c135e60 2023-10-03T10:15:58.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.603+0000 7f6086d0c700 1 -- 172.21.15.72:0/97195157 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f608006b9e0 con 0x7f608006e9d0 2023-10-03T10:15:58.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.603+0000 7f607d7fa700 1 -- 172.21.15.72:0/97195157 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f607802c090 con 0x7f608006e9d0 2023-10-03T10:15:58.604 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:58.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.605+0000 7f6086d0c700 1 -- 172.21.15.72:0/97195157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608006e9d0 msgr2=0x7f6080119500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.605+0000 7f6086d0c700 1 --2- 172.21.15.72:0/97195157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608006e9d0 0x7f6080119500 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f607800efc0 tx=0x7f607800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.605+0000 7f6086d0c700 1 -- 172.21.15.72:0/97195157 shutdown_connections 2023-10-03T10:15:58.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.605+0000 7f6086d0c700 1 --2- 172.21.15.72:0/97195157 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6080131f40 0x7f6080119f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.605+0000 7f6086d0c700 1 --2- 172.21.15.72:0/97195157 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608006e9d0 0x7f6080119500 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.605+0000 7f6086d0c700 1 --2- 172.21.15.72:0/97195157 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6080131630 0x7f6080119a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.605+0000 7f6086d0c700 1 -- 172.21.15.72:0/97195157 >> 172.21.15.72:0/97195157 conn(0x7f60800a2aa0 msgr2=0x7f608012e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.605+0000 7f6086d0c700 1 -- 172.21.15.72:0/97195157 shutdown_connections 2023-10-03T10:15:58.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.605+0000 7f6086d0c700 1 -- 172.21.15.72:0/97195157 wait complete. 2023-10-03T10:15:58.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.620+0000 7fdd50b2b700 1 Processor -- start 2023-10-03T10:15:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.620+0000 7fdd50b2b700 1 -- start start 2023-10-03T10:15:58.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.620+0000 7fdd50b2b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd4c131810 0x7fdd4c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.620+0000 7fdd50b2b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd4c099a40 0x7fdd4c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.620+0000 7fdd50b2b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4c1313c0 con 0x7fdd4c09a3b0 2023-10-03T10:15:58.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.620+0000 7fdd50b2b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c09b580 con 0x7fdd4c131810 2023-10-03T10:15:58.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.620+0000 7fdd50b2b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c06e8c0 con 0x7fdd4c099a40 2023-10-03T10:15:58.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.621+0000 7fdd4a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd4c131810 0x7fdd4c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.621+0000 7fdd4ad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdd4c09a3b0 0x7fdd4c138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35712/0 (socket says 172.21.15.72:35712) 2023-10-03T10:15:58.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.621+0000 7fdd4ad9d700 1 -- 172.21.15.72:0/108161354 learned_addr learned my addr 172.21.15.72:0/108161354 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:58.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.621+0000 7fdd49d9b700 1 --2- 172.21.15.72:0/108161354 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd4c099a40 0x7fdd4c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.621+0000 7fdd4959a700 1 -- 172.21.15.72:0/108161354 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342976075 0 0) 0x7fdd4c1313c0 con 0x7fdd4c09a3b0 2023-10-03T10:15:58.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.621+0000 7fdd4a59c700 1 -- 172.21.15.72:0/108161354 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd4c099a40 msgr2=0x7fdd4c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.621+0000 7fdd4a59c700 1 --2- 172.21.15.72:0/108161354 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd4c099a40 0x7fdd4c099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.621+0000 7fdd4a59c700 1 -- 172.21.15.72:0/108161354 >> v1:172.21.15.72:6789/0 conn(0x7fdd4c09a3b0 legacy=0x7fdd4c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.621+0000 7fdd4a59c700 1 -- 172.21.15.72:0/108161354 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c09a820 con 0x7fdd4c131810 2023-10-03T10:15:58.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.621+0000 7fdd49d9b700 1 --2- 172.21.15.72:0/108161354 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd4c099a40 0x7fdd4c099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.621+0000 7fdd4a59c700 1 --2- 172.21.15.72:0/108161354 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd4c131810 0x7fdd4c131be0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009870 tx=0x7fdd3c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6062a2a655bf5f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.621+0000 7fdd4959a700 1 -- 172.21.15.72:0/108161354 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c011830 con 0x7fdd4c131810 2023-10-03T10:15:58.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.621+0000 7fdd4959a700 1 -- 172.21.15.72:0/108161354 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c011990 con 0x7fdd4c131810 2023-10-03T10:15:58.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.621+0000 7fdd4959a700 1 -- 172.21.15.72:0/108161354 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c011d20 con 0x7fdd4c131810 2023-10-03T10:15:58.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.622+0000 7fdd50b2b700 1 -- 172.21.15.72:0/108161354 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd4c131810 msgr2=0x7fdd4c131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.622+0000 7fdd50b2b700 1 --2- 172.21.15.72:0/108161354 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd4c131810 0x7fdd4c131be0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009870 tx=0x7fdd3c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:58.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.622+0000 7fdd50b2b700 1 -- 172.21.15.72:0/108161354 shutdown_connections 2023-10-03T10:15:58.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.622+0000 7fdd50b2b700 1 --2- 172.21.15.72:0/108161354 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd4c131810 0x7fdd4c131be0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.622+0000 7fdd50b2b700 1 --2- 172.21.15.72:0/108161354 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd4c099a40 0x7fdd4c099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.622+0000 7fdd50b2b700 1 -- 172.21.15.72:0/108161354 >> 172.21.15.72:0/108161354 conn(0x7fdd4c0a2aa0 msgr2=0x7fdd4c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.622+0000 7fdd50b2b700 1 -- 172.21.15.72:0/108161354 shutdown_connections 2023-10-03T10:15:58.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.622+0000 7fdd50b2b700 1 -- 172.21.15.72:0/108161354 wait complete. 2023-10-03T10:15:58.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.623+0000 7fdd50b2b700 1 Processor -- start 2023-10-03T10:15:58.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.623+0000 7fdd50b2b700 1 -- start start 2023-10-03T10:15:58.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.623+0000 7fdd50b2b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd4c099a40 0x7fdd4c119540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.623+0000 7fdd50b2b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd4c09a3b0 0x7fdd4c119a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.623+0000 7fdd50b2b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd4c131810 0x7fdd4c119fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.623+0000 7fdd50b2b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c11d980 con 0x7fdd4c131810 2023-10-03T10:15:58.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.623+0000 7fdd50b2b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c06eb00 con 0x7fdd4c09a3b0 2023-10-03T10:15:58.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.623+0000 7fdd50b2b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c11beb0 con 0x7fdd4c099a40 2023-10-03T10:15:58.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.623+0000 7fdd4a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd4c099a40 0x7fdd4c119540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.623+0000 7fdd49d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd4c09a3b0 0x7fdd4c119a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.624+0000 7fdd4a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd4c099a40 0x7fdd4c119540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49550/0 (socket says 172.21.15.72:49550) 2023-10-03T10:15:58.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.624+0000 7fdd4a59c700 1 -- 172.21.15.72:0/487501139 learned_addr learned my addr 172.21.15.72:0/487501139 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:58.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.624+0000 7fdd4ad9d700 1 --2- 172.21.15.72:0/487501139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd4c131810 0x7fdd4c119fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.624+0000 7fdd4a59c700 1 -- 172.21.15.72:0/487501139 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd4c09a3b0 msgr2=0x7fdd4c119a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.624+0000 7fdd4a59c700 1 --2- 172.21.15.72:0/487501139 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd4c09a3b0 0x7fdd4c119a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.624+0000 7fdd4a59c700 1 -- 172.21.15.72:0/487501139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd4c131810 msgr2=0x7fdd4c119fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.624+0000 7fdd4a59c700 1 --2- 172.21.15.72:0/487501139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd4c131810 0x7fdd4c119fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.624+0000 7fdd4a59c700 1 -- 172.21.15.72:0/487501139 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd400094a0 con 0x7fdd4c099a40 2023-10-03T10:15:58.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.624+0000 7fdd49d9b700 1 --2- 172.21.15.72:0/487501139 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd4c09a3b0 0x7fdd4c119a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.624+0000 7fdd4a59c700 1 --2- 172.21.15.72:0/487501139 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd4c099a40 0x7fdd4c119540 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0090b0 tx=0x7fdd3c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.624+0000 7fdd3affd700 1 -- 172.21.15.72:0/487501139 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c004510 con 0x7fdd4c099a40 2023-10-03T10:15:58.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.624+0000 7fdd3affd700 1 -- 172.21.15.72:0/487501139 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0036a0 con 0x7fdd4c099a40 2023-10-03T10:15:58.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.624+0000 7fdd50b2b700 1 -- 172.21.15.72:0/487501139 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3c0094a0 con 0x7fdd4c099a40 2023-10-03T10:15:58.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.624+0000 7fdd3affd700 1 -- 172.21.15.72:0/487501139 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c003a30 con 0x7fdd4c099a40 2023-10-03T10:15:58.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.624+0000 7fdd50b2b700 1 -- 172.21.15.72:0/487501139 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4c11c370 con 0x7fdd4c099a40 2023-10-03T10:15:58.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.625+0000 7fdd3affd700 1 -- 172.21.15.72:0/487501139 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd3c003b90 con 0x7fdd4c099a40 2023-10-03T10:15:58.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.625+0000 7fdd3affd700 1 -- 172.21.15.72:0/487501139 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdd3c040560 con 0x7fdd4c099a40 2023-10-03T10:15:58.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.625+0000 7fdd50b2b700 1 -- 172.21.15.72:0/487501139 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4c074ea0 con 0x7fdd4c099a40 2023-10-03T10:15:58.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.630+0000 7fdd3affd700 1 -- 172.21.15.72:0/487501139 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd3c015080 con 0x7fdd4c099a40 2023-10-03T10:15:58.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.768+0000 7f5ea0d62700 1 -- 172.21.15.72:0/4219500336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5e9c06b9e0 con 0x7f5e9c135e60 2023-10-03T10:15:58.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.768+0000 7f5e8affd700 1 -- 172.21.15.72:0/4219500336 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5e94009cc0 con 0x7f5e9c135e60 2023-10-03T10:15:58.769 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:58.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.770+0000 7f5ea0d62700 1 -- 172.21.15.72:0/4219500336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c135e60 msgr2=0x7f5e9c09d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.770+0000 7f5ea0d62700 1 --2- 172.21.15.72:0/4219500336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c135e60 0x7f5e9c09d010 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400efc0 tx=0x7f5e9400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.770+0000 7f5ea0d62700 1 -- 172.21.15.72:0/4219500336 shutdown_connections 2023-10-03T10:15:58.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.770+0000 7f5ea0d62700 1 --2- 172.21.15.72:0/4219500336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c135e60 0x7f5e9c09d010 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.770+0000 7f5ea0d62700 1 --2- 172.21.15.72:0/4219500336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e9c130540 0x7f5e9c09c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.770+0000 7f5ea0d62700 1 --2- 172.21.15.72:0/4219500336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e9c133540 0x7f5e9c09cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.770+0000 7f5ea0d62700 1 -- 172.21.15.72:0/4219500336 >> 172.21.15.72:0/4219500336 conn(0x7f5e9c0a2aa0 msgr2=0x7f5e9c131320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.770+0000 7f5ea0d62700 1 -- 172.21.15.72:0/4219500336 shutdown_connections 2023-10-03T10:15:58.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.770+0000 7f5ea0d62700 1 -- 172.21.15.72:0/4219500336 wait complete. 2023-10-03T10:15:58.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:15:58.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:58.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.821+0000 7fdd50b2b700 1 -- 172.21.15.72:0/487501139 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd4c06b9e0 con 0x7fdd4c099a40 2023-10-03T10:15:58.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.822+0000 7fdd3affd700 1 -- 172.21.15.72:0/487501139 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd3c028070 con 0x7fdd4c099a40 2023-10-03T10:15:58.823 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:15:58.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.824+0000 7fdd50b2b700 1 -- 172.21.15.72:0/487501139 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd4c099a40 msgr2=0x7fdd4c119540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.824+0000 7fdd50b2b700 1 --2- 172.21.15.72:0/487501139 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd4c099a40 0x7fdd4c119540 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0090b0 tx=0x7fdd3c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:58.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.824+0000 7fdd50b2b700 1 -- 172.21.15.72:0/487501139 shutdown_connections 2023-10-03T10:15:58.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.824+0000 7fdd50b2b700 1 --2- 172.21.15.72:0/487501139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd4c131810 0x7fdd4c119fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.824+0000 7fdd50b2b700 1 --2- 172.21.15.72:0/487501139 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd4c099a40 0x7fdd4c119540 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.824+0000 7fdd50b2b700 1 --2- 172.21.15.72:0/487501139 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd4c09a3b0 0x7fdd4c119a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.824+0000 7fdd50b2b700 1 -- 172.21.15.72:0/487501139 >> 172.21.15.72:0/487501139 conn(0x7fdd4c0a2aa0 msgr2=0x7fdd4c12e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.824+0000 7fdd50b2b700 1 -- 172.21.15.72:0/487501139 shutdown_connections 2023-10-03T10:15:58.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.824+0000 7fdd50b2b700 1 -- 172.21.15.72:0/487501139 wait complete. 2023-10-03T10:15:58.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:15:58.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.943+0000 7fb0dc52b700 1 Processor -- start 2023-10-03T10:15:58.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.943+0000 7fb0dc52b700 1 -- start start 2023-10-03T10:15:58.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.943+0000 7fb0dc52b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0d409d6f0 0x7fb0d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.943+0000 7fb0dc52b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0d409e410 0x7fb0d4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.943+0000 7fb0dc52b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d409f130 con 0x7fb0d409e000 2023-10-03T10:15:58.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.943+0000 7fb0dc52b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d409f520 con 0x7fb0d409d6f0 2023-10-03T10:15:58.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.943+0000 7fb0dc52b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d409e930 con 0x7fb0d409e410 2023-10-03T10:15:58.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.943+0000 7fb0da2c7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0d409d6f0 0x7fb0d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.943+0000 7fb0daac8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0d409e410 0x7fb0d4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.943+0000 7fb0da2c7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0d409d6f0 0x7fb0d409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54662/0 (socket says 172.21.15.72:54662) 2023-10-03T10:15:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.943+0000 7fb0da2c7700 1 -- 172.21.15.72:0/3828721650 learned_addr learned my addr 172.21.15.72:0/3828721650 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.944+0000 7fb0da2c7700 1 -- 172.21.15.72:0/3828721650 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0d409e410 msgr2=0x7fb0d4130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.944+0000 7fb0da2c7700 1 --2- 172.21.15.72:0/3828721650 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0d409e410 0x7fb0d4130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.944+0000 7fb0da2c7700 1 -- 172.21.15.72:0/3828721650 >> v1:172.21.15.72:6789/0 conn(0x7fb0d409e000 legacy=0x7fb0d4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.944+0000 7fb0da2c7700 1 -- 172.21.15.72:0/3828721650 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d409b2d0 con 0x7fb0d409d6f0 2023-10-03T10:15:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.944+0000 7fb0daac8700 1 --2- 172.21.15.72:0/3828721650 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0d409e410 0x7fb0d4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.944+0000 7fb0da2c7700 1 --2- 172.21.15.72:0/3828721650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0d409d6f0 0x7fb0d409dac0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40098f0 tx=0x7fb0c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbff40b595e8f6b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.944+0000 7fb0d92c5700 1 -- 172.21.15.72:0/3828721650 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4011830 con 0x7fb0d409d6f0 2023-10-03T10:15:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.944+0000 7fb0d92c5700 1 -- 172.21.15.72:0/3828721650 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c4011990 con 0x7fb0d409d6f0 2023-10-03T10:15:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.944+0000 7fb0d92c5700 1 -- 172.21.15.72:0/3828721650 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4011d20 con 0x7fb0d409d6f0 2023-10-03T10:15:58.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.944+0000 7fb0dc52b700 1 -- 172.21.15.72:0/3828721650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0d409d6f0 msgr2=0x7fb0d409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.944+0000 7fb0dc52b700 1 --2- 172.21.15.72:0/3828721650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0d409d6f0 0x7fb0d409dac0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40098f0 tx=0x7fb0c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.945+0000 7fb0dc52b700 1 -- 172.21.15.72:0/3828721650 shutdown_connections 2023-10-03T10:15:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.945+0000 7fb0dc52b700 1 --2- 172.21.15.72:0/3828721650 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0d409e410 0x7fb0d4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.945+0000 7fb0dc52b700 1 --2- 172.21.15.72:0/3828721650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0d409d6f0 0x7fb0d409dac0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.945+0000 7fb0dc52b700 1 -- 172.21.15.72:0/3828721650 >> 172.21.15.72:0/3828721650 conn(0x7fb0d4066f50 msgr2=0x7fb0d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.945+0000 7fb0dc52b700 1 -- 172.21.15.72:0/3828721650 shutdown_connections 2023-10-03T10:15:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.945+0000 7fb0dc52b700 1 -- 172.21.15.72:0/3828721650 wait complete. 2023-10-03T10:15:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.945+0000 7fb0dc52b700 1 Processor -- start 2023-10-03T10:15:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0dc52b700 1 -- start start 2023-10-03T10:15:58.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0dc52b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0d409d6f0 0x7fb0d41c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0dc52b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0d409e000 0x7fb0d41c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0dc52b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0d409e410 0x7fb0d406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0dc52b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d406fd40 con 0x7fb0d409e000 2023-10-03T10:15:58.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0dc52b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d409c770 con 0x7fb0d409e410 2023-10-03T10:15:58.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0dc52b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d4070570 con 0x7fb0d409d6f0 2023-10-03T10:15:58.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0da2c7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0d409d6f0 0x7fb0d41c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0da2c7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0d409d6f0 0x7fb0d41c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49558/0 (socket says 172.21.15.72:49558) 2023-10-03T10:15:58.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0d9ac6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0d409e000 0x7fb0d41c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0da2c7700 1 -- 172.21.15.72:0/1404694796 learned_addr learned my addr 172.21.15.72:0/1404694796 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:58.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0daac8700 1 --2- 172.21.15.72:0/1404694796 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0d409e410 0x7fb0d406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0da2c7700 1 -- 172.21.15.72:0/1404694796 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0d409e410 msgr2=0x7fb0d406e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0da2c7700 1 --2- 172.21.15.72:0/1404694796 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0d409e410 0x7fb0d406e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0da2c7700 1 -- 172.21.15.72:0/1404694796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0d409e000 msgr2=0x7fb0d41c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0da2c7700 1 --2- 172.21.15.72:0/1404694796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0d409e000 0x7fb0d41c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.946+0000 7fb0da2c7700 1 -- 172.21.15.72:0/1404694796 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc009a70 con 0x7fb0d409d6f0 2023-10-03T10:15:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.947+0000 7fb0da2c7700 1 --2- 172.21.15.72:0/1404694796 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0d409d6f0 0x7fb0d41c87c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009c40 tx=0x7fb0c4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.947+0000 7fb0caffd700 1 -- 172.21.15.72:0/1404694796 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c40043c0 con 0x7fb0d409d6f0 2023-10-03T10:15:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.947+0000 7fb0caffd700 1 -- 172.21.15.72:0/1404694796 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c401f070 con 0x7fb0d409d6f0 2023-10-03T10:15:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.947+0000 7fb0dc52b700 1 -- 172.21.15.72:0/1404694796 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c4009550 con 0x7fb0d409d6f0 2023-10-03T10:15:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.947+0000 7fb0caffd700 1 -- 172.21.15.72:0/1404694796 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c40036a0 con 0x7fb0d409d6f0 2023-10-03T10:15:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.947+0000 7fb0dc52b700 1 -- 172.21.15.72:0/1404694796 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d4124aa0 con 0x7fb0d409d6f0 2023-10-03T10:15:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.947+0000 7fb0caffd700 1 -- 172.21.15.72:0/1404694796 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0c4021030 con 0x7fb0d409d6f0 2023-10-03T10:15:58.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.947+0000 7fb0caffd700 1 -- 172.21.15.72:0/1404694796 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb0c4040930 con 0x7fb0d409d6f0 2023-10-03T10:15:58.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.948+0000 7fb0dc52b700 1 -- 172.21.15.72:0/1404694796 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d4074ea0 con 0x7fb0d409d6f0 2023-10-03T10:15:58.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:58.952+0000 7fb0caffd700 1 -- 172.21.15.72:0/1404694796 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0c4015080 con 0x7fb0d409d6f0 2023-10-03T10:15:59.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.141+0000 7fb0dc52b700 1 -- 172.21.15.72:0/1404694796 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb0d40a2180 con 0x7fb0d409d6f0 2023-10-03T10:15:59.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.141+0000 7fb0caffd700 1 -- 172.21.15.72:0/1404694796 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb0c40199a0 con 0x7fb0d409d6f0 2023-10-03T10:15:59.142 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:15:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.143+0000 7fb0dc52b700 1 -- 172.21.15.72:0/1404694796 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0d409d6f0 msgr2=0x7fb0d41c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.143+0000 7fb0dc52b700 1 --2- 172.21.15.72:0/1404694796 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0d409d6f0 0x7fb0d41c87c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009c40 tx=0x7fb0c4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.143+0000 7fb0dc52b700 1 -- 172.21.15.72:0/1404694796 shutdown_connections 2023-10-03T10:15:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.143+0000 7fb0dc52b700 1 --2- 172.21.15.72:0/1404694796 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0d409e410 0x7fb0d406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.143+0000 7fb0dc52b700 1 --2- 172.21.15.72:0/1404694796 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0d409d6f0 0x7fb0d41c87c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.143+0000 7fb0dc52b700 1 --2- 172.21.15.72:0/1404694796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0d409e000 0x7fb0d41c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.143+0000 7fb0dc52b700 1 -- 172.21.15.72:0/1404694796 >> 172.21.15.72:0/1404694796 conn(0x7fb0d4066f50 msgr2=0x7fb0d40711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.143+0000 7fb0dc52b700 1 -- 172.21.15.72:0/1404694796 shutdown_connections 2023-10-03T10:15:59.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.143+0000 7fb0dc52b700 1 -- 172.21.15.72:0/1404694796 wait complete. 2023-10-03T10:15:59.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:15:59.619 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:59.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.743+0000 7f63f9cd4700 1 Processor -- start 2023-10-03T10:15:59.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.743+0000 7f63f9cd4700 1 -- start start 2023-10-03T10:15:59.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.743+0000 7f63f9cd4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f41338c0 0x7f63f4133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f9cd4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f409e560 0x7f63f413b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f9cd4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f406f720 con 0x7f63f41341d0 2023-10-03T10:15:59.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f9cd4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4070c80 con 0x7f63f409e560 2023-10-03T10:15:59.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f9cd4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63f406fce0 con 0x7f63f41338c0 2023-10-03T10:15:59.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63ebfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f63f41341d0 0x7f63f409de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35716/0 (socket says 172.21.15.72:35716) 2023-10-03T10:15:59.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f409e560 0x7f63f413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f41338c0 0x7f63f4133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63ebfff700 1 -- 172.21.15.72:0/124868096 learned_addr learned my addr 172.21.15.72:0/124868096 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:59.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f2ffd700 1 -- 172.21.15.72:0/124868096 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786508805 0 0) 0x7f63f406f720 con 0x7f63f41341d0 2023-10-03T10:15:59.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f37fe700 1 -- 172.21.15.72:0/124868096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f409e560 msgr2=0x7f63f413b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f37fe700 1 --2- 172.21.15.72:0/124868096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f409e560 0x7f63f413b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f37fe700 1 -- 172.21.15.72:0/124868096 >> v1:172.21.15.72:6789/0 conn(0x7f63f41341d0 legacy=0x7f63f409de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f37fe700 1 -- 172.21.15.72:0/124868096 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f41336a0 con 0x7f63f41338c0 2023-10-03T10:15:59.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f3fff700 1 --2- 172.21.15.72:0/124868096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f409e560 0x7f63f413b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f37fe700 1 --2- 172.21.15.72:0/124868096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f41338c0 0x7f63f4133c90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009870 tx=0x7f63e4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e8df78dfab8a0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f2ffd700 1 -- 172.21.15.72:0/124868096 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4011830 con 0x7f63f41338c0 2023-10-03T10:15:59.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f2ffd700 1 -- 172.21.15.72:0/124868096 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e4011990 con 0x7f63f41338c0 2023-10-03T10:15:59.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.744+0000 7f63f2ffd700 1 -- 172.21.15.72:0/124868096 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4011d20 con 0x7f63f41338c0 2023-10-03T10:15:59.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.745+0000 7f63f9cd4700 1 -- 172.21.15.72:0/124868096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f41338c0 msgr2=0x7f63f4133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.745+0000 7f63f9cd4700 1 --2- 172.21.15.72:0/124868096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f41338c0 0x7f63f4133c90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009870 tx=0x7f63e4009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.745+0000 7f63f9cd4700 1 -- 172.21.15.72:0/124868096 shutdown_connections 2023-10-03T10:15:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.745+0000 7f63f9cd4700 1 --2- 172.21.15.72:0/124868096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f409e560 0x7f63f413b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.745+0000 7f63f9cd4700 1 --2- 172.21.15.72:0/124868096 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f41338c0 0x7f63f4133c90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.745+0000 7f63f9cd4700 1 -- 172.21.15.72:0/124868096 >> 172.21.15.72:0/124868096 conn(0x7f63f40a2aa0 msgr2=0x7f63f40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.745+0000 7f63f9cd4700 1 -- 172.21.15.72:0/124868096 shutdown_connections 2023-10-03T10:15:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.745+0000 7f63f9cd4700 1 -- 172.21.15.72:0/124868096 wait complete. 2023-10-03T10:15:59.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.746+0000 7f63f9cd4700 1 Processor -- start 2023-10-03T10:15:59.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.746+0000 7f63f9cd4700 1 -- start start 2023-10-03T10:15:59.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.746+0000 7f63f9cd4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f409e560 0x7f63f41c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.746+0000 7f63f9cd4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f41338c0 0x7f63f41c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.746+0000 7f63f9cd4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f41341d0 0x7f63f41c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.746+0000 7f63f9cd4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f411ed00 con 0x7f63f41341d0 2023-10-03T10:15:59.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.746+0000 7f63f9cd4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4130c90 con 0x7f63f41338c0 2023-10-03T10:15:59.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.746+0000 7f63f9cd4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63f411f6f0 con 0x7f63f409e560 2023-10-03T10:15:59.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.746+0000 7f63f37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f409e560 0x7f63f41c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.746+0000 7f63f37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f409e560 0x7f63f41c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49588/0 (socket says 172.21.15.72:49588) 2023-10-03T10:15:59.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.746+0000 7f63ebfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f41338c0 0x7f63f41c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.746+0000 7f63f37fe700 1 -- 172.21.15.72:0/2859344060 learned_addr learned my addr 172.21.15.72:0/2859344060 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:59.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.746+0000 7f63f3fff700 1 --2- 172.21.15.72:0/2859344060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f41341d0 0x7f63f41c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.747+0000 7f63f37fe700 1 -- 172.21.15.72:0/2859344060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f41338c0 msgr2=0x7f63f41c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.747+0000 7f63f37fe700 1 --2- 172.21.15.72:0/2859344060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f41338c0 0x7f63f41c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.747+0000 7f63f37fe700 1 -- 172.21.15.72:0/2859344060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f41341d0 msgr2=0x7f63f41c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.747+0000 7f63f37fe700 1 --2- 172.21.15.72:0/2859344060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f41341d0 0x7f63f41c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.747+0000 7f63f37fe700 1 -- 172.21.15.72:0/2859344060 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec009a70 con 0x7f63f409e560 2023-10-03T10:15:59.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.747+0000 7f63ebfff700 1 --2- 172.21.15.72:0/2859344060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f41338c0 0x7f63f41c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.747+0000 7f63f3fff700 1 --2- 172.21.15.72:0/2859344060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f41341d0 0x7f63f41c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.747+0000 7f63f37fe700 1 --2- 172.21.15.72:0/2859344060 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f409e560 0x7f63f41c8000 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009840 tx=0x7f63e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.747+0000 7f63f0ff9700 1 -- 172.21.15.72:0/2859344060 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e40044d0 con 0x7f63f409e560 2023-10-03T10:15:59.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.747+0000 7f63f0ff9700 1 -- 172.21.15.72:0/2859344060 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e401f070 con 0x7f63f409e560 2023-10-03T10:15:59.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.747+0000 7f63f0ff9700 1 -- 172.21.15.72:0/2859344060 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e40038e0 con 0x7f63f409e560 2023-10-03T10:15:59.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.747+0000 7f63f9cd4700 1 -- 172.21.15.72:0/2859344060 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e40094a0 con 0x7f63f409e560 2023-10-03T10:15:59.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.747+0000 7f63f9cd4700 1 -- 172.21.15.72:0/2859344060 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f4120420 con 0x7f63f409e560 2023-10-03T10:15:59.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.748+0000 7f63f0ff9700 1 -- 172.21.15.72:0/2859344060 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63e4003a40 con 0x7f63f409e560 2023-10-03T10:15:59.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.748+0000 7f63f0ff9700 1 -- 172.21.15.72:0/2859344060 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f63e4021070 con 0x7f63f409e560 2023-10-03T10:15:59.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.748+0000 7f63f9cd4700 1 -- 172.21.15.72:0/2859344060 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f4074ea0 con 0x7f63f409e560 2023-10-03T10:15:59.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.753+0000 7f63f0ff9700 1 -- 172.21.15.72:0/2859344060 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63e402b080 con 0x7f63f409e560 2023-10-03T10:15:59.784 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:59.839 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:59.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.908+0000 7f52c57d9700 1 Processor -- start 2023-10-03T10:15:59.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.908+0000 7f52c57d9700 1 -- start start 2023-10-03T10:15:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.908+0000 7f52c57d9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52c009d630 0x7f52c00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.908+0000 7f52c57d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c0138d80 0x7f52c013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.908+0000 7f52c57d9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c00a2a70 con 0x7f52c00a0a30 2023-10-03T10:15:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.908+0000 7f52c57d9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c00a01d0 con 0x7f52c009d630 2023-10-03T10:15:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.908+0000 7f52c57d9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c009e2b0 con 0x7f52c0138d80 2023-10-03T10:15:59.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.908+0000 7f52bf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c0138d80 0x7f52c013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.908+0000 7f52be7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52c009d630 0x7f52c00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.908+0000 7f52bf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c0138d80 0x7f52c013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35336/0 (socket says 172.21.15.72:35336) 2023-10-03T10:15:59.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.908+0000 7f52be7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52c009d630 0x7f52c00a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54684/0 (socket says 172.21.15.72:54684) 2023-10-03T10:15:59.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.908+0000 7f52bf7fe700 1 -- 172.21.15.72:0/96883533 learned_addr learned my addr 172.21.15.72:0/96883533 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:59.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.909+0000 7f52be7fc700 1 -- 172.21.15.72:0/96883533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c0138d80 msgr2=0x7f52c013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.909+0000 7f52be7fc700 1 --2- 172.21.15.72:0/96883533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c0138d80 0x7f52c013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.909+0000 7f52be7fc700 1 -- 172.21.15.72:0/96883533 >> v1:172.21.15.72:6789/0 conn(0x7f52c00a0a30 legacy=0x7f52c00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.909+0000 7f52be7fc700 1 -- 172.21.15.72:0/96883533 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c009dc50 con 0x7f52c009d630 2023-10-03T10:15:59.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.909+0000 7f52bdffb700 1 -- 172.21.15.72:0/96883533 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92712675 0 0) 0x7f52c00a2a70 con 0x7f52c00a0a30 2023-10-03T10:15:59.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.909+0000 7f52bf7fe700 1 --2- 172.21.15.72:0/96883533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c0138d80 0x7f52c013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.909+0000 7f52be7fc700 1 --2- 172.21.15.72:0/96883533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c009d630 0x7f52c00a1510 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009840 tx=0x7f52b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c998881753c6afb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.909+0000 7f52bdffb700 1 -- 172.21.15.72:0/96883533 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4011830 con 0x7f52c009d630 2023-10-03T10:15:59.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.909+0000 7f52bdffb700 1 -- 172.21.15.72:0/96883533 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b4011990 con 0x7f52c009d630 2023-10-03T10:15:59.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.909+0000 7f52bdffb700 1 -- 172.21.15.72:0/96883533 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4011d20 con 0x7f52c009d630 2023-10-03T10:15:59.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.910+0000 7f52c57d9700 1 -- 172.21.15.72:0/96883533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c009d630 msgr2=0x7f52c00a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.910+0000 7f52c57d9700 1 --2- 172.21.15.72:0/96883533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c009d630 0x7f52c00a1510 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009840 tx=0x7f52b4009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:59.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.910+0000 7f52c57d9700 1 -- 172.21.15.72:0/96883533 shutdown_connections 2023-10-03T10:15:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.910+0000 7f52c57d9700 1 --2- 172.21.15.72:0/96883533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c0138d80 0x7f52c013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.910+0000 7f52c57d9700 1 --2- 172.21.15.72:0/96883533 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c009d630 0x7f52c00a1510 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.910+0000 7f52c57d9700 1 -- 172.21.15.72:0/96883533 >> 172.21.15.72:0/96883533 conn(0x7f52c00a3050 msgr2=0x7f52c00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.910+0000 7f52c57d9700 1 -- 172.21.15.72:0/96883533 shutdown_connections 2023-10-03T10:15:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.910+0000 7f52c57d9700 1 -- 172.21.15.72:0/96883533 wait complete. 2023-10-03T10:15:59.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.911+0000 7f52c57d9700 1 Processor -- start 2023-10-03T10:15:59.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.911+0000 7f52c57d9700 1 -- start start 2023-10-03T10:15:59.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.911+0000 7f52c57d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c009d630 0x7f52c0133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.911+0000 7f52c57d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c00a0a30 0x7f52c0133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.911+0000 7f52c57d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c0138d80 0x7f52c0134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.911+0000 7f52c57d9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0136190 con 0x7f52c0138d80 2023-10-03T10:15:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.911+0000 7f52c57d9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0136eb0 con 0x7f52c00a0a30 2023-10-03T10:15:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.911+0000 7f52c57d9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00a4ba0 con 0x7f52c009d630 2023-10-03T10:15:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52be7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c00a0a30 0x7f52c0133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52beffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c009d630 0x7f52c0133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52be7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c00a0a30 0x7f52c0133c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35342/0 (socket says 172.21.15.72:35342) 2023-10-03T10:15:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52be7fc700 1 -- 172.21.15.72:0/1361990401 learned_addr learned my addr 172.21.15.72:0/1361990401 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52bf7fe700 1 --2- 172.21.15.72:0/1361990401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c0138d80 0x7f52c0134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52be7fc700 1 -- 172.21.15.72:0/1361990401 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c009d630 msgr2=0x7f52c0133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52be7fc700 1 --2- 172.21.15.72:0/1361990401 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c009d630 0x7f52c0133700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52be7fc700 1 -- 172.21.15.72:0/1361990401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c0138d80 msgr2=0x7f52c0134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52be7fc700 1 --2- 172.21.15.72:0/1361990401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c0138d80 0x7f52c0134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52be7fc700 1 -- 172.21.15.72:0/1361990401 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b8009b30 con 0x7f52c00a0a30 2023-10-03T10:15:59.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52beffd700 1 --2- 172.21.15.72:0/1361990401 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c009d630 0x7f52c0133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52be7fc700 1 --2- 172.21.15.72:0/1361990401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c00a0a30 0x7f52c0133c40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009fd0 tx=0x7f52b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52a77fe700 1 -- 172.21.15.72:0/1361990401 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4004480 con 0x7f52c00a0a30 2023-10-03T10:15:59.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52a77fe700 1 -- 172.21.15.72:0/1361990401 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b401f070 con 0x7f52c00a0a30 2023-10-03T10:15:59.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52c57d9700 1 -- 172.21.15.72:0/1361990401 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b40094a0 con 0x7f52c00a0a30 2023-10-03T10:15:59.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52a77fe700 1 -- 172.21.15.72:0/1361990401 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b40038e0 con 0x7f52c00a0a30 2023-10-03T10:15:59.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.912+0000 7f52c57d9700 1 -- 172.21.15.72:0/1361990401 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c00a0460 con 0x7f52c00a0a30 2023-10-03T10:15:59.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.913+0000 7f52a77fe700 1 -- 172.21.15.72:0/1361990401 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52b4021030 con 0x7f52c00a0a30 2023-10-03T10:15:59.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.913+0000 7f52a77fe700 1 -- 172.21.15.72:0/1361990401 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f52b40408d0 con 0x7f52c00a0a30 2023-10-03T10:15:59.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.913+0000 7f52c57d9700 1 -- 172.21.15.72:0/1361990401 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c00747f0 con 0x7f52c00a0a30 2023-10-03T10:15:59.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.922+0000 7f52a77fe700 1 -- 172.21.15.72:0/1361990401 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52b4015080 con 0x7f52c00a0a30 2023-10-03T10:15:59.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.947+0000 7f63f9cd4700 1 -- 172.21.15.72:0/2859344060 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f63f406f960 con 0x7f63f409e560 2023-10-03T10:15:59.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.948+0000 7f63f0ff9700 1 -- 172.21.15.72:0/2859344060 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63e4015020 con 0x7f63f409e560 2023-10-03T10:15:59.949 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:15:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.950+0000 7f63f9cd4700 1 -- 172.21.15.72:0/2859344060 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f409e560 msgr2=0x7f63f41c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.950+0000 7f63f9cd4700 1 --2- 172.21.15.72:0/2859344060 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f409e560 0x7f63f41c8000 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009840 tx=0x7f63e4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.950+0000 7f63f9cd4700 1 -- 172.21.15.72:0/2859344060 shutdown_connections 2023-10-03T10:15:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.950+0000 7f63f9cd4700 1 --2- 172.21.15.72:0/2859344060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f41341d0 0x7f63f41c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.950+0000 7f63f9cd4700 1 --2- 172.21.15.72:0/2859344060 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f409e560 0x7f63f41c8000 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.950+0000 7f63f9cd4700 1 --2- 172.21.15.72:0/2859344060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f41338c0 0x7f63f41c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.950+0000 7f63f9cd4700 1 -- 172.21.15.72:0/2859344060 >> 172.21.15.72:0/2859344060 conn(0x7f63f40a2aa0 msgr2=0x7f63f41bb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.950+0000 7f63f9cd4700 1 -- 172.21.15.72:0/2859344060 shutdown_connections 2023-10-03T10:15:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.950+0000 7f63f9cd4700 1 -- 172.21.15.72:0/2859344060 wait complete. 2023-10-03T10:15:59.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:15:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.968+0000 7ff4047ca700 1 Processor -- start 2023-10-03T10:15:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.969+0000 7ff4047ca700 1 -- start start 2023-10-03T10:15:59.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.969+0000 7ff4047ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3fc06b250 0x7ff3fc136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.969+0000 7ff4047ca700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3fc136d80 0x7ff3fc139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.969+0000 7ff4047ca700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3fc09ece0 con 0x7ff3fc06a770 2023-10-03T10:15:59.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.969+0000 7ff4047ca700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc06b640 con 0x7ff3fc06b250 2023-10-03T10:15:59.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.969+0000 7ff4047ca700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc09e760 con 0x7ff3fc136d80 2023-10-03T10:15:59.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.969+0000 7ff402566700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff3fc06a770 0x7ff3fc06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35730/0 (socket says 172.21.15.72:35730) 2023-10-03T10:15:59.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.969+0000 7ff402566700 1 -- 172.21.15.72:0/3972944730 learned_addr learned my addr 172.21.15.72:0/3972944730 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:15:59.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.969+0000 7ff402d67700 1 --2- 172.21.15.72:0/3972944730 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3fc136d80 0x7ff3fc139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.969+0000 7ff401d65700 1 --2- 172.21.15.72:0/3972944730 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3fc06b250 0x7ff3fc136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.970+0000 7ff401564700 1 -- 172.21.15.72:0/3972944730 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711007777 0 0) 0x7ff3fc09ece0 con 0x7ff3fc06a770 2023-10-03T10:15:59.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.970+0000 7ff401564700 1 -- 172.21.15.72:0/3972944730 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3e80035b0 con 0x7ff3fc06a770 2023-10-03T10:15:59.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.970+0000 7ff402d67700 1 -- 172.21.15.72:0/3972944730 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3fc06b250 msgr2=0x7ff3fc136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.970+0000 7ff402d67700 1 --2- 172.21.15.72:0/3972944730 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3fc06b250 0x7ff3fc136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.970+0000 7ff402d67700 1 -- 172.21.15.72:0/3972944730 >> v1:172.21.15.72:6789/0 conn(0x7ff3fc06a770 legacy=0x7ff3fc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.970+0000 7ff402d67700 1 -- 172.21.15.72:0/3972944730 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc09e040 con 0x7ff3fc136d80 2023-10-03T10:15:59.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.970+0000 7ff402d67700 1 --2- 172.21.15.72:0/3972944730 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3fc136d80 0x7ff3fc139160 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009dc0 tx=0x7ff3f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eafd379980a9620c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.970+0000 7ff401564700 1 -- 172.21.15.72:0/3972944730 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f400e070 con 0x7ff3fc136d80 2023-10-03T10:15:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.970+0000 7ff401564700 1 -- 172.21.15.72:0/3972944730 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f400bb20 con 0x7ff3fc136d80 2023-10-03T10:15:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.970+0000 7ff401564700 1 -- 172.21.15.72:0/3972944730 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f400be90 con 0x7ff3fc136d80 2023-10-03T10:15:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.970+0000 7ff4047ca700 1 -- 172.21.15.72:0/3972944730 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3fc136d80 msgr2=0x7ff3fc139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.970+0000 7ff4047ca700 1 --2- 172.21.15.72:0/3972944730 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3fc136d80 0x7ff3fc139160 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009dc0 tx=0x7ff3f400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.971+0000 7ff4047ca700 1 -- 172.21.15.72:0/3972944730 shutdown_connections 2023-10-03T10:15:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.971+0000 7ff4047ca700 1 --2- 172.21.15.72:0/3972944730 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3fc136d80 0x7ff3fc139160 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.971+0000 7ff4047ca700 1 --2- 172.21.15.72:0/3972944730 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3fc06b250 0x7ff3fc136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.971+0000 7ff4047ca700 1 -- 172.21.15.72:0/3972944730 >> 172.21.15.72:0/3972944730 conn(0x7ff3fc066f50 msgr2=0x7ff3fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.971+0000 7ff4047ca700 1 -- 172.21.15.72:0/3972944730 shutdown_connections 2023-10-03T10:15:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.971+0000 7ff4047ca700 1 -- 172.21.15.72:0/3972944730 wait complete. 2023-10-03T10:15:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.971+0000 7ff4047ca700 1 Processor -- start 2023-10-03T10:15:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.971+0000 7ff4047ca700 1 -- start start 2023-10-03T10:15:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff4047ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3fc06a770 0x7ff3fc1c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff4047ca700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3fc06b250 0x7ff3fc1c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff4047ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc136d80 0x7ff3fc11c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff4047ca700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc06ec50 con 0x7ff3fc136d80 2023-10-03T10:15:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff4047ca700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc1bbf00 con 0x7ff3fc06a770 2023-10-03T10:15:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff4047ca700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc071e60 con 0x7ff3fc06b250 2023-10-03T10:15:59.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff401d65700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3fc06b250 0x7ff3fc1c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff401d65700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3fc06b250 0x7ff3fc1c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49620/0 (socket says 172.21.15.72:49620) 2023-10-03T10:15:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff401d65700 1 -- 172.21.15.72:0/1277827578 learned_addr learned my addr 172.21.15.72:0/1277827578 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:15:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff402d67700 1 --2- 172.21.15.72:0/1277827578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc136d80 0x7ff3fc11c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff401d65700 1 -- 172.21.15.72:0/1277827578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3fc06a770 msgr2=0x7ff3fc1c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff401d65700 1 --2- 172.21.15.72:0/1277827578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3fc06a770 0x7ff3fc1c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff401d65700 1 -- 172.21.15.72:0/1277827578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc136d80 msgr2=0x7ff3fc11c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff401d65700 1 --2- 172.21.15.72:0/1277827578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc136d80 0x7ff3fc11c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff401d65700 1 -- 172.21.15.72:0/1277827578 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f4009a70 con 0x7ff3fc06b250 2023-10-03T10:15:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff402d67700 1 --2- 172.21.15.72:0/1277827578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc136d80 0x7ff3fc11c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.972+0000 7ff401d65700 1 --2- 172.21.15.72:0/1277827578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3fc06b250 0x7ff3fc1c68a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00e9e0 tx=0x7ff3ec00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.973+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/1277827578 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec009710 con 0x7ff3fc06b250 2023-10-03T10:15:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.973+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/1277827578 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec00c850 con 0x7ff3fc06b250 2023-10-03T10:15:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.973+0000 7ff4047ca700 1 -- 172.21.15.72:0/1277827578 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3fc11fa60 con 0x7ff3fc06b250 2023-10-03T10:15:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.973+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/1277827578 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec00cbc0 con 0x7ff3fc06b250 2023-10-03T10:15:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.973+0000 7ff4047ca700 1 -- 172.21.15.72:0/1277827578 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3fc132400 con 0x7ff3fc06b250 2023-10-03T10:15:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.973+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/1277827578 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff3ec00cd20 con 0x7ff3fc06b250 2023-10-03T10:15:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.974+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/1277827578 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff3ec03f840 con 0x7ff3fc06b250 2023-10-03T10:15:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.974+0000 7ff4047ca700 1 -- 172.21.15.72:0/1277827578 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3fc074ea0 con 0x7ff3fc06b250 2023-10-03T10:15:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:15:59.978+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/1277827578 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3ec01be10 con 0x7ff3fc06b250 2023-10-03T10:16:00.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.121+0000 7f52c57d9700 1 -- 172.21.15.72:0/1361990401 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f52c0072980 con 0x7f52c00a0a30 2023-10-03T10:16:00.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.121+0000 7f52a77fe700 1 -- 172.21.15.72:0/1361990401 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f52b4003a40 con 0x7f52c00a0a30 2023-10-03T10:16:00.122 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.123+0000 7f52c57d9700 1 -- 172.21.15.72:0/1361990401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c00a0a30 msgr2=0x7f52c0133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.123+0000 7f52c57d9700 1 --2- 172.21.15.72:0/1361990401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c00a0a30 0x7f52c0133c40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009fd0 tx=0x7f52b4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.123+0000 7f52c57d9700 1 -- 172.21.15.72:0/1361990401 shutdown_connections 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.123+0000 7f52c57d9700 1 --2- 172.21.15.72:0/1361990401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c0138d80 0x7f52c0134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.123+0000 7f52c57d9700 1 --2- 172.21.15.72:0/1361990401 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c009d630 0x7f52c0133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.123+0000 7f52c57d9700 1 --2- 172.21.15.72:0/1361990401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c00a0a30 0x7f52c0133c40 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.123+0000 7f52c57d9700 1 -- 172.21.15.72:0/1361990401 >> 172.21.15.72:0/1361990401 conn(0x7f52c00a3050 msgr2=0x7f52c009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.123+0000 7f52c57d9700 1 -- 172.21.15.72:0/1361990401 shutdown_connections 2023-10-03T10:16:00.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.123+0000 7f52c57d9700 1 -- 172.21.15.72:0/1361990401 wait complete. 2023-10-03T10:16:00.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:00.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:00.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.172+0000 7ff4047ca700 1 -- 172.21.15.72:0/1277827578 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff3fc09dd80 con 0x7ff3fc06b250 2023-10-03T10:16:00.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.172+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/1277827578 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff3ec02a090 con 0x7ff3fc06b250 2023-10-03T10:16:00.173 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:00.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.174+0000 7ff4047ca700 1 -- 172.21.15.72:0/1277827578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3fc06b250 msgr2=0x7ff3fc1c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.174+0000 7ff4047ca700 1 --2- 172.21.15.72:0/1277827578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3fc06b250 0x7ff3fc1c68a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00e9e0 tx=0x7ff3ec00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.174+0000 7ff4047ca700 1 -- 172.21.15.72:0/1277827578 shutdown_connections 2023-10-03T10:16:00.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.174+0000 7ff4047ca700 1 --2- 172.21.15.72:0/1277827578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc136d80 0x7ff3fc11c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.174+0000 7ff4047ca700 1 --2- 172.21.15.72:0/1277827578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3fc06a770 0x7ff3fc1c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.174+0000 7ff4047ca700 1 --2- 172.21.15.72:0/1277827578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3fc06b250 0x7ff3fc1c68a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.174+0000 7ff4047ca700 1 -- 172.21.15.72:0/1277827578 >> 172.21.15.72:0/1277827578 conn(0x7ff3fc066f50 msgr2=0x7ff3fc06ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.174+0000 7ff4047ca700 1 -- 172.21.15.72:0/1277827578 shutdown_connections 2023-10-03T10:16:00.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.174+0000 7ff4047ca700 1 -- 172.21.15.72:0/1277827578 wait complete. 2023-10-03T10:16:00.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:00.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.292+0000 7f59e0ced700 1 Processor -- start 2023-10-03T10:16:00.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.292+0000 7f59e0ced700 1 -- start start 2023-10-03T10:16:00.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59e0ced700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc133870 0x7f59dc133c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59e0ced700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09e560 0x7f59dc13b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59e0ced700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc1334b0 con 0x7f59dc134180 2023-10-03T10:16:00.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59e0ced700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc09fa40 con 0x7f59dc09e560 2023-10-03T10:16:00.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59e0ced700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc06f250 con 0x7f59dc133870 2023-10-03T10:16:00.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59da59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc133870 0x7f59dc133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59dad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09e560 0x7f59dc13b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59d9d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f59dc134180 0x7f59dc09de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35742/0 (socket says 172.21.15.72:35742) 2023-10-03T10:16:00.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59d9d9b700 1 -- 172.21.15.72:0/3106254832 learned_addr learned my addr 172.21.15.72:0/3106254832 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:00.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59d959a700 1 -- 172.21.15.72:0/3106254832 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396495744 0 0) 0x7f59dc1334b0 con 0x7f59dc134180 2023-10-03T10:16:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59da59c700 1 -- 172.21.15.72:0/3106254832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09e560 msgr2=0x7f59dc13b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59da59c700 1 --2- 172.21.15.72:0/3106254832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09e560 0x7f59dc13b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59da59c700 1 -- 172.21.15.72:0/3106254832 >> v1:172.21.15.72:6789/0 conn(0x7f59dc134180 legacy=0x7f59dc09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59da59c700 1 -- 172.21.15.72:0/3106254832 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc06fb20 con 0x7f59dc133870 2023-10-03T10:16:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59dad9d700 1 --2- 172.21.15.72:0/3106254832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09e560 0x7f59dc13b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59da59c700 1 --2- 172.21.15.72:0/3106254832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc133870 0x7f59dc133c40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009870 tx=0x7f59d0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2977cee24baab2d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59d959a700 1 -- 172.21.15.72:0/3106254832 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d0011830 con 0x7f59dc133870 2023-10-03T10:16:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59d959a700 1 -- 172.21.15.72:0/3106254832 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d0011990 con 0x7f59dc133870 2023-10-03T10:16:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.293+0000 7f59d959a700 1 -- 172.21.15.72:0/3106254832 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d0011d20 con 0x7f59dc133870 2023-10-03T10:16:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.294+0000 7f59e0ced700 1 -- 172.21.15.72:0/3106254832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc133870 msgr2=0x7f59dc133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.294+0000 7f59e0ced700 1 --2- 172.21.15.72:0/3106254832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc133870 0x7f59dc133c40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009870 tx=0x7f59d0009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.294+0000 7f59e0ced700 1 -- 172.21.15.72:0/3106254832 shutdown_connections 2023-10-03T10:16:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.294+0000 7f59e0ced700 1 --2- 172.21.15.72:0/3106254832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc09e560 0x7f59dc13b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.294+0000 7f59e0ced700 1 --2- 172.21.15.72:0/3106254832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc133870 0x7f59dc133c40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.294+0000 7f59e0ced700 1 -- 172.21.15.72:0/3106254832 >> 172.21.15.72:0/3106254832 conn(0x7f59dc0a2610 msgr2=0x7f59dc0a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.294+0000 7f59e0ced700 1 -- 172.21.15.72:0/3106254832 shutdown_connections 2023-10-03T10:16:00.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.294+0000 7f59e0ced700 1 -- 172.21.15.72:0/3106254832 wait complete. 2023-10-03T10:16:00.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.295+0000 7f59e0ced700 1 Processor -- start 2023-10-03T10:16:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.295+0000 7f59e0ced700 1 -- start start 2023-10-03T10:16:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.295+0000 7f59e0ced700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e560 0x7f59dc11a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59e0ced700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc133870 0x7f59dc11aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59e0ced700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc134180 0x7f59dc11b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59e0ced700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc11db60 con 0x7f59dc133870 2023-10-03T10:16:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59e0ced700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0a2d50 con 0x7f59dc134180 2023-10-03T10:16:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59e0ced700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc06f490 con 0x7f59dc09e560 2023-10-03T10:16:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59da59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e560 0x7f59dc11a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59d9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc133870 0x7f59dc11aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59dad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc134180 0x7f59dc11b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59dad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc134180 0x7f59dc11b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35378/0 (socket says 172.21.15.72:35378) 2023-10-03T10:16:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59d9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc133870 0x7f59dc11aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54712/0 (socket says 172.21.15.72:54712) 2023-10-03T10:16:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59da59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e560 0x7f59dc11a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49632/0 (socket says 172.21.15.72:49632) 2023-10-03T10:16:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59d9d9b700 1 -- 172.21.15.72:0/3381780592 learned_addr learned my addr 172.21.15.72:0/3381780592 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59d9d9b700 1 -- 172.21.15.72:0/3381780592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e560 msgr2=0x7f59dc11a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59d9d9b700 1 --2- 172.21.15.72:0/3381780592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e560 0x7f59dc11a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59d9d9b700 1 -- 172.21.15.72:0/3381780592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc134180 msgr2=0x7f59dc11b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59d9d9b700 1 --2- 172.21.15.72:0/3381780592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc134180 0x7f59dc11b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59d9d9b700 1 -- 172.21.15.72:0/3381780592 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4009a70 con 0x7f59dc133870 2023-10-03T10:16:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59da59c700 1 --2- 172.21.15.72:0/3381780592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e560 0x7f59dc11a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59dad9d700 1 --2- 172.21.15.72:0/3381780592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc134180 0x7f59dc11b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59d9d9b700 1 --2- 172.21.15.72:0/3381780592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc133870 0x7f59dc11aba0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00c480 tx=0x7f59cc00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59caffd700 1 -- 172.21.15.72:0/3381780592 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc004c80 con 0x7f59dc133870 2023-10-03T10:16:00.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59caffd700 1 -- 172.21.15.72:0/3381780592 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc004de0 con 0x7f59dc133870 2023-10-03T10:16:00.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59e0ced700 1 -- 172.21.15.72:0/3381780592 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d00094a0 con 0x7f59dc133870 2023-10-03T10:16:00.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59caffd700 1 -- 172.21.15.72:0/3381780592 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc0072d0 con 0x7f59dc133870 2023-10-03T10:16:00.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.296+0000 7f59e0ced700 1 -- 172.21.15.72:0/3381780592 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc11cfd0 con 0x7f59dc133870 2023-10-03T10:16:00.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.297+0000 7f59caffd700 1 -- 172.21.15.72:0/3381780592 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f59cc007430 con 0x7f59dc133870 2023-10-03T10:16:00.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.297+0000 7f59caffd700 1 -- 172.21.15.72:0/3381780592 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f59cc03f090 con 0x7f59dc133870 2023-10-03T10:16:00.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.297+0000 7f59e0ced700 1 -- 172.21.15.72:0/3381780592 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59dc11e220 con 0x7f59dc133870 2023-10-03T10:16:00.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.302+0000 7f59caffd700 1 -- 172.21.15.72:0/3381780592 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59cc0076e0 con 0x7f59dc133870 2023-10-03T10:16:00.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.487+0000 7f59e0ced700 1 -- 172.21.15.72:0/3381780592 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f59dc11cfd0 con 0x7f59dc133870 2023-10-03T10:16:00.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.488+0000 7f59caffd700 1 -- 172.21.15.72:0/3381780592 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f59cc01ce90 con 0x7f59dc133870 2023-10-03T10:16:00.488 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:00.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.489+0000 7f59e0ced700 1 -- 172.21.15.72:0/3381780592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc133870 msgr2=0x7f59dc11aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.489+0000 7f59e0ced700 1 --2- 172.21.15.72:0/3381780592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc133870 0x7f59dc11aba0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00c480 tx=0x7f59cc00c790 comp rx=0 tx=0).stop 2023-10-03T10:16:00.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.490+0000 7f59e0ced700 1 -- 172.21.15.72:0/3381780592 shutdown_connections 2023-10-03T10:16:00.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.490+0000 7f59e0ced700 1 --2- 172.21.15.72:0/3381780592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59dc134180 0x7f59dc11b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.490+0000 7f59e0ced700 1 --2- 172.21.15.72:0/3381780592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59dc09e560 0x7f59dc11a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.490+0000 7f59e0ced700 1 --2- 172.21.15.72:0/3381780592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59dc133870 0x7f59dc11aba0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.490+0000 7f59e0ced700 1 -- 172.21.15.72:0/3381780592 >> 172.21.15.72:0/3381780592 conn(0x7f59dc0a2610 msgr2=0x7f59dc12f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.490+0000 7f59e0ced700 1 -- 172.21.15.72:0/3381780592 shutdown_connections 2023-10-03T10:16:00.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:00.490+0000 7f59e0ced700 1 -- 172.21.15.72:0/3381780592 wait complete. 2023-10-03T10:16:00.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:00.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:01.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.087+0000 7fe0a730a700 1 Processor -- start 2023-10-03T10:16:01.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.087+0000 7fe0a730a700 1 -- start start 2023-10-03T10:16:01.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.087+0000 7fe0a730a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0a0131810 0x7fe0a0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a730a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0a0099a40 0x7fe0a0099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a730a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe0a009a3b0 0x7fe0a0138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a730a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a009b580 con 0x7fe0a009a3b0 2023-10-03T10:16:01.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a730a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a01313c0 con 0x7fe0a0099a40 2023-10-03T10:16:01.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a730a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a006e8c0 con 0x7fe0a0131810 2023-10-03T10:16:01.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a58a7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe0a009a3b0 0x7fe0a0138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a50a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0a0131810 0x7fe0a0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a58a7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe0a009a3b0 0x7fe0a0138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54720/0 (socket says 172.21.15.72:54720) 2023-10-03T10:16:01.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a50a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0a0131810 0x7fe0a0131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49634/0 (socket says 172.21.15.72:49634) 2023-10-03T10:16:01.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a58a7700 1 -- 172.21.15.72:0/2649976874 learned_addr learned my addr 172.21.15.72:0/2649976874 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:01.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a48a5700 1 --2- 172.21.15.72:0/2649976874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0a0099a40 0x7fe0a0099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a50a6700 1 -- 172.21.15.72:0/2649976874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0a0099a40 msgr2=0x7fe0a0099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a50a6700 1 --2- 172.21.15.72:0/2649976874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0a0099a40 0x7fe0a0099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a50a6700 1 -- 172.21.15.72:0/2649976874 >> v2:172.21.15.72:3300/0 conn(0x7fe0a009a3b0 msgr2=0x7fe0a0138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a50a6700 1 --2- 172.21.15.72:0/2649976874 >> v2:172.21.15.72:3300/0 conn(0x7fe0a009a3b0 0x7fe0a0138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a50a6700 1 -- 172.21.15.72:0/2649976874 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a009a820 con 0x7fe0a0131810 2023-10-03T10:16:01.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a48a5700 1 --2- 172.21.15.72:0/2649976874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0a0099a40 0x7fe0a0099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a58a7700 1 --2- 172.21.15.72:0/2649976874 >> v2:172.21.15.72:3300/0 conn(0x7fe0a009a3b0 0x7fe0a0138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe0a50a6700 1 --2- 172.21.15.72:0/2649976874 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0a0131810 0x7fe0a0131be0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe09c009840 tx=0x7fe09c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5ec08215e674c93 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe097fff700 1 -- 172.21.15.72:0/2649976874 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c011830 con 0x7fe0a0131810 2023-10-03T10:16:01.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe097fff700 1 -- 172.21.15.72:0/2649976874 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c011990 con 0x7fe0a0131810 2023-10-03T10:16:01.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.088+0000 7fe097fff700 1 -- 172.21.15.72:0/2649976874 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c011d20 con 0x7fe0a0131810 2023-10-03T10:16:01.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.089+0000 7fe0a730a700 1 -- 172.21.15.72:0/2649976874 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0a0131810 msgr2=0x7fe0a0131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.089+0000 7fe0a730a700 1 --2- 172.21.15.72:0/2649976874 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0a0131810 0x7fe0a0131be0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe09c009840 tx=0x7fe09c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:01.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.089+0000 7fe0a730a700 1 -- 172.21.15.72:0/2649976874 shutdown_connections 2023-10-03T10:16:01.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.089+0000 7fe0a730a700 1 --2- 172.21.15.72:0/2649976874 >> v2:172.21.15.72:3300/0 conn(0x7fe0a009a3b0 0x7fe0a0138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.089+0000 7fe0a730a700 1 --2- 172.21.15.72:0/2649976874 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0a0131810 0x7fe0a0131be0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.089+0000 7fe0a730a700 1 --2- 172.21.15.72:0/2649976874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0a0099a40 0x7fe0a0099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.089+0000 7fe0a730a700 1 -- 172.21.15.72:0/2649976874 >> 172.21.15.72:0/2649976874 conn(0x7fe0a00a2aa0 msgr2=0x7fe0a00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.089+0000 7fe0a730a700 1 -- 172.21.15.72:0/2649976874 shutdown_connections 2023-10-03T10:16:01.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.089+0000 7fe0a730a700 1 -- 172.21.15.72:0/2649976874 wait complete. 2023-10-03T10:16:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.090+0000 7fe0a730a700 1 Processor -- start 2023-10-03T10:16:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.090+0000 7fe0a730a700 1 -- start start 2023-10-03T10:16:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.090+0000 7fe0a730a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0a0099a40 0x7fe0a011b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.090+0000 7fe0a730a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0a009a3b0 0x7fe0a011bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.090+0000 7fe0a730a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0131810 0x7fe0a011c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.090+0000 7fe0a730a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a011d8c0 con 0x7fe0a0131810 2023-10-03T10:16:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.090+0000 7fe0a730a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a011ec10 con 0x7fe0a009a3b0 2023-10-03T10:16:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.090+0000 7fe0a730a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a01309d0 con 0x7fe0a0099a40 2023-10-03T10:16:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.090+0000 7fe0a50a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0a0099a40 0x7fe0a011b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.090+0000 7fe0a50a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0a0099a40 0x7fe0a011b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49648/0 (socket says 172.21.15.72:49648) 2023-10-03T10:16:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.090+0000 7fe0a58a7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0131810 0x7fe0a011c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.090+0000 7fe0a50a6700 1 -- 172.21.15.72:0/760374871 learned_addr learned my addr 172.21.15.72:0/760374871 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.090+0000 7fe0a48a5700 1 --2- 172.21.15.72:0/760374871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0a009a3b0 0x7fe0a011bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.091+0000 7fe0a58a7700 1 -- 172.21.15.72:0/760374871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0a0099a40 msgr2=0x7fe0a011b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.091+0000 7fe0a58a7700 1 --2- 172.21.15.72:0/760374871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0a0099a40 0x7fe0a011b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.091+0000 7fe0a58a7700 1 -- 172.21.15.72:0/760374871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0a009a3b0 msgr2=0x7fe0a011bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.091+0000 7fe0a58a7700 1 --2- 172.21.15.72:0/760374871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0a009a3b0 0x7fe0a011bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.091+0000 7fe0a58a7700 1 -- 172.21.15.72:0/760374871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0900094a0 con 0x7fe0a0131810 2023-10-03T10:16:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.091+0000 7fe0a50a6700 1 --2- 172.21.15.72:0/760374871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0a0099a40 0x7fe0a011b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.091+0000 7fe0a58a7700 1 --2- 172.21.15.72:0/760374871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0131810 0x7fe0a011c110 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe09800d7b0 tx=0x7fe09800f560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.091+0000 7fe095ffb700 1 -- 172.21.15.72:0/760374871 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098012050 con 0x7fe0a0131810 2023-10-03T10:16:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.091+0000 7fe095ffb700 1 -- 172.21.15.72:0/760374871 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe098013040 con 0x7fe0a0131810 2023-10-03T10:16:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.091+0000 7fe0a730a700 1 -- 172.21.15.72:0/760374871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09800f050 con 0x7fe0a0131810 2023-10-03T10:16:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.091+0000 7fe095ffb700 1 -- 172.21.15.72:0/760374871 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098019610 con 0x7fe0a0131810 2023-10-03T10:16:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.091+0000 7fe0a730a700 1 -- 172.21.15.72:0/760374871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c0094a0 con 0x7fe0a0131810 2023-10-03T10:16:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.092+0000 7fe095ffb700 1 -- 172.21.15.72:0/760374871 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe098019770 con 0x7fe0a0131810 2023-10-03T10:16:01.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.092+0000 7fe095ffb700 1 -- 172.21.15.72:0/760374871 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe098044290 con 0x7fe0a0131810 2023-10-03T10:16:01.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.092+0000 7fe0a730a700 1 -- 172.21.15.72:0/760374871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a0074ea0 con 0x7fe0a0131810 2023-10-03T10:16:01.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.097+0000 7fe095ffb700 1 -- 172.21.15.72:0/760374871 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe098023460 con 0x7fe0a0131810 2023-10-03T10:16:01.137 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:01.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.261+0000 7f3ebcb13700 1 Processor -- start 2023-10-03T10:16:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.261+0000 7f3ebcb13700 1 -- start start 2023-10-03T10:16:01.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.262+0000 7f3ebcb13700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3eb80a0a30 0x7f3eb80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.262+0000 7f3ebcb13700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb809d630 0x7f3eb80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.262+0000 7f3ebcb13700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb80a2a70 con 0x7f3eb8133930 2023-10-03T10:16:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.262+0000 7f3ebcb13700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb80a01d0 con 0x7f3eb80a0a30 2023-10-03T10:16:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.262+0000 7f3ebcb13700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb809e2b0 con 0x7f3eb809d630 2023-10-03T10:16:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.262+0000 7f3eb5d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb809d630 0x7f3eb80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.262+0000 7f3eb659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3eb80a0a30 0x7f3eb80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.262+0000 7f3eb6d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3eb8133930 0x7f3eb8133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35750/0 (socket says 172.21.15.72:35750) 2023-10-03T10:16:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.262+0000 7f3eb6d9d700 1 -- 172.21.15.72:0/3128200051 learned_addr learned my addr 172.21.15.72:0/3128200051 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.262+0000 7f3eb659c700 1 -- 172.21.15.72:0/3128200051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb809d630 msgr2=0x7f3eb80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.262+0000 7f3eb659c700 1 --2- 172.21.15.72:0/3128200051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb809d630 0x7f3eb80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.262+0000 7f3eb659c700 1 -- 172.21.15.72:0/3128200051 >> v1:172.21.15.72:6789/0 conn(0x7f3eb8133930 legacy=0x7f3eb8133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.262+0000 7f3eb659c700 1 -- 172.21.15.72:0/3128200051 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb809dc50 con 0x7f3eb80a0a30 2023-10-03T10:16:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.262+0000 7f3eb5d9b700 1 --2- 172.21.15.72:0/3128200051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb809d630 0x7f3eb80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.262+0000 7f3eb659c700 1 --2- 172.21.15.72:0/3128200051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb80a0a30 0x7f3eb80a0e00 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009840 tx=0x7f3ea8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3b3ff4a6e180d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.263+0000 7f3eb559a700 1 -- 172.21.15.72:0/3128200051 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8011830 con 0x7f3eb80a0a30 2023-10-03T10:16:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.263+0000 7f3eb559a700 1 -- 172.21.15.72:0/3128200051 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea8011990 con 0x7f3eb80a0a30 2023-10-03T10:16:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.263+0000 7f3eb559a700 1 -- 172.21.15.72:0/3128200051 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8011d20 con 0x7f3eb80a0a30 2023-10-03T10:16:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.264+0000 7f3ebcb13700 1 -- 172.21.15.72:0/3128200051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb80a0a30 msgr2=0x7f3eb80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.264+0000 7f3ebcb13700 1 --2- 172.21.15.72:0/3128200051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb80a0a30 0x7f3eb80a0e00 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009840 tx=0x7f3ea8009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.264+0000 7f3ebcb13700 1 -- 172.21.15.72:0/3128200051 shutdown_connections 2023-10-03T10:16:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.264+0000 7f3ebcb13700 1 --2- 172.21.15.72:0/3128200051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb80a0a30 0x7f3eb80a0e00 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.264+0000 7f3ebcb13700 1 --2- 172.21.15.72:0/3128200051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb809d630 0x7f3eb80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.264+0000 7f3ebcb13700 1 -- 172.21.15.72:0/3128200051 >> 172.21.15.72:0/3128200051 conn(0x7f3eb80a3050 msgr2=0x7f3eb80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.264+0000 7f3ebcb13700 1 -- 172.21.15.72:0/3128200051 shutdown_connections 2023-10-03T10:16:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.264+0000 7f3ebcb13700 1 -- 172.21.15.72:0/3128200051 wait complete. 2023-10-03T10:16:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.265+0000 7f3ebcb13700 1 Processor -- start 2023-10-03T10:16:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.265+0000 7f3ebcb13700 1 -- start start 2023-10-03T10:16:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.266+0000 7f3ebcb13700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb809d630 0x7f3eb811f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.266+0000 7f3ebcb13700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb80a0a30 0x7f3eb811f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.266+0000 7f3ebcb13700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb8133930 0x7f3eb81c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.266+0000 7f3ebcb13700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb8133460 con 0x7f3eb809d630 2023-10-03T10:16:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.266+0000 7f3ebcb13700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb8120ed0 con 0x7f3eb80a0a30 2023-10-03T10:16:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.266+0000 7f3ebcb13700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb811efb0 con 0x7f3eb8133930 2023-10-03T10:16:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.266+0000 7f3eb659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb809d630 0x7f3eb811f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.266+0000 7f3eb6d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb8133930 0x7f3eb81c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.266+0000 7f3eb659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb809d630 0x7f3eb811f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54744/0 (socket says 172.21.15.72:54744) 2023-10-03T10:16:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.266+0000 7f3eb659c700 1 -- 172.21.15.72:0/2441983376 learned_addr learned my addr 172.21.15.72:0/2441983376 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.266+0000 7f3eb5d9b700 1 --2- 172.21.15.72:0/2441983376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb80a0a30 0x7f3eb811f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.267+0000 7f3eb659c700 1 -- 172.21.15.72:0/2441983376 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb8133930 msgr2=0x7f3eb81c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.267+0000 7f3eb659c700 1 --2- 172.21.15.72:0/2441983376 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb8133930 0x7f3eb81c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.267+0000 7f3eb659c700 1 -- 172.21.15.72:0/2441983376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb80a0a30 msgr2=0x7f3eb811f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.267+0000 7f3eb659c700 1 --2- 172.21.15.72:0/2441983376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb80a0a30 0x7f3eb811f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.267+0000 7f3eb659c700 1 -- 172.21.15.72:0/2441983376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac0094a0 con 0x7f3eb809d630 2023-10-03T10:16:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.267+0000 7f3eb6d9d700 1 --2- 172.21.15.72:0/2441983376 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb8133930 0x7f3eb81c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.267+0000 7f3eb5d9b700 1 --2- 172.21.15.72:0/2441983376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb80a0a30 0x7f3eb811f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.267+0000 7f3eb659c700 1 --2- 172.21.15.72:0/2441983376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb809d630 0x7f3eb811f430 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80090b0 tx=0x7f3ea8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.267+0000 7f3ea6ffd700 1 -- 172.21.15.72:0/2441983376 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8004340 con 0x7f3eb809d630 2023-10-03T10:16:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.267+0000 7f3ea6ffd700 1 -- 172.21.15.72:0/2441983376 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea801f070 con 0x7f3eb809d630 2023-10-03T10:16:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.267+0000 7f3ebcb13700 1 -- 172.21.15.72:0/2441983376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea80094a0 con 0x7f3eb809d630 2023-10-03T10:16:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.267+0000 7f3ea6ffd700 1 -- 172.21.15.72:0/2441983376 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea80036a0 con 0x7f3eb809d630 2023-10-03T10:16:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.267+0000 7f3ebcb13700 1 -- 172.21.15.72:0/2441983376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb8120c90 con 0x7f3eb809d630 2023-10-03T10:16:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.268+0000 7f3ea6ffd700 1 -- 172.21.15.72:0/2441983376 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ea8021030 con 0x7f3eb809d630 2023-10-03T10:16:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.268+0000 7f3ea6ffd700 1 -- 172.21.15.72:0/2441983376 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3ea8040880 con 0x7f3eb809d630 2023-10-03T10:16:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.268+0000 7f3ea4ff9700 1 -- 172.21.15.72:0/2441983376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e900052e0 con 0x7f3eb809d630 2023-10-03T10:16:01.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.273+0000 7f3ea6ffd700 1 -- 172.21.15.72:0/2441983376 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ea80239c0 con 0x7f3eb809d630 2023-10-03T10:16:01.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.292+0000 7fe0a730a700 1 -- 172.21.15.72:0/760374871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe0a006b9e0 con 0x7fe0a0131810 2023-10-03T10:16:01.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.292+0000 7fe095ffb700 1 -- 172.21.15.72:0/760374871 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe098021b50 con 0x7fe0a0131810 2023-10-03T10:16:01.293 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:01.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.295+0000 7fe0a730a700 1 -- 172.21.15.72:0/760374871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0131810 msgr2=0x7fe0a011c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.295+0000 7fe0a730a700 1 --2- 172.21.15.72:0/760374871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0131810 0x7fe0a011c110 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe09800d7b0 tx=0x7fe09800f560 comp rx=0 tx=0).stop 2023-10-03T10:16:01.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.295+0000 7fe0a730a700 1 -- 172.21.15.72:0/760374871 shutdown_connections 2023-10-03T10:16:01.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.295+0000 7fe0a730a700 1 --2- 172.21.15.72:0/760374871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a0131810 0x7fe0a011c110 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.295+0000 7fe0a730a700 1 --2- 172.21.15.72:0/760374871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0a0099a40 0x7fe0a011b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.295+0000 7fe0a730a700 1 --2- 172.21.15.72:0/760374871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0a009a3b0 0x7fe0a011bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.295+0000 7fe0a730a700 1 -- 172.21.15.72:0/760374871 >> 172.21.15.72:0/760374871 conn(0x7fe0a00a2aa0 msgr2=0x7fe0a00a1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.295+0000 7fe0a730a700 1 -- 172.21.15.72:0/760374871 shutdown_connections 2023-10-03T10:16:01.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.295+0000 7fe0a730a700 1 -- 172.21.15.72:0/760374871 wait complete. 2023-10-03T10:16:01.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:01.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.315+0000 7f028f2c6700 1 Processor -- start 2023-10-03T10:16:01.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.315+0000 7f028f2c6700 1 -- start start 2023-10-03T10:16:01.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028f2c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02881338a0 0x7f0288133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028f2c6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f028809e930 0x7f028813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028f2c6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f028806ef30 con 0x7f028809de50 2023-10-03T10:16:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028f2c6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f028806fef0 con 0x7f028809e930 2023-10-03T10:16:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028f2c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02881334b0 con 0x7f02881338a0 2023-10-03T10:16:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028d062700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02881338a0 0x7f0288133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028d863700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f028809e930 0x7f028813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028d062700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02881338a0 0x7f0288133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35440/0 (socket says 172.21.15.72:35440) 2023-10-03T10:16:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028c861700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f028809de50 0x7f028809e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35752/0 (socket says 172.21.15.72:35752) 2023-10-03T10:16:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028d062700 1 -- 172.21.15.72:0/3483283811 learned_addr learned my addr 172.21.15.72:0/3483283811 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:01.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028d863700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f028809e930 0x7f028813b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54748/0 (socket says 172.21.15.72:54748) 2023-10-03T10:16:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028d062700 1 -- 172.21.15.72:0/3483283811 >> v2:172.21.15.72:3300/0 conn(0x7f028809e930 msgr2=0x7f028813b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028d062700 1 --2- 172.21.15.72:0/3483283811 >> v2:172.21.15.72:3300/0 conn(0x7f028809e930 0x7f028813b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028d062700 1 -- 172.21.15.72:0/3483283811 >> v1:172.21.15.72:6789/0 conn(0x7f028809de50 legacy=0x7f028809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028d062700 1 -- 172.21.15.72:0/3483283811 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028806fc30 con 0x7f02881338a0 2023-10-03T10:16:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f027ffff700 1 -- 172.21.15.72:0/3483283811 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948787138 0 0) 0x7f028806ef30 con 0x7f028809de50 2023-10-03T10:16:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028d863700 1 --2- 172.21.15.72:0/3483283811 >> v2:172.21.15.72:3300/0 conn(0x7f028809e930 0x7f028813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.316+0000 7f028d062700 1 --2- 172.21.15.72:0/3483283811 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02881338a0 0x7f0288133c70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f02840098f0 tx=0x7f0284009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34dbb204339a7c52 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.317+0000 7f027ffff700 1 -- 172.21.15.72:0/3483283811 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284011830 con 0x7f02881338a0 2023-10-03T10:16:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.317+0000 7f027ffff700 1 -- 172.21.15.72:0/3483283811 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0284011990 con 0x7f02881338a0 2023-10-03T10:16:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.317+0000 7f027ffff700 1 -- 172.21.15.72:0/3483283811 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284011d20 con 0x7f02881338a0 2023-10-03T10:16:01.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.317+0000 7f028f2c6700 1 -- 172.21.15.72:0/3483283811 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02881338a0 msgr2=0x7f0288133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.317+0000 7f028f2c6700 1 --2- 172.21.15.72:0/3483283811 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02881338a0 0x7f0288133c70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f02840098f0 tx=0x7f0284009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:01.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.317+0000 7f028f2c6700 1 -- 172.21.15.72:0/3483283811 shutdown_connections 2023-10-03T10:16:01.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.317+0000 7f028f2c6700 1 --2- 172.21.15.72:0/3483283811 >> v2:172.21.15.72:3300/0 conn(0x7f028809e930 0x7f028813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.317+0000 7f028f2c6700 1 --2- 172.21.15.72:0/3483283811 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02881338a0 0x7f0288133c70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.317+0000 7f028f2c6700 1 -- 172.21.15.72:0/3483283811 >> 172.21.15.72:0/3483283811 conn(0x7f02880a2aa0 msgr2=0x7f02880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.317+0000 7f028f2c6700 1 -- 172.21.15.72:0/3483283811 shutdown_connections 2023-10-03T10:16:01.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.317+0000 7f028f2c6700 1 -- 172.21.15.72:0/3483283811 wait complete. 2023-10-03T10:16:01.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.318+0000 7f028f2c6700 1 Processor -- start 2023-10-03T10:16:01.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.318+0000 7f028f2c6700 1 -- start start 2023-10-03T10:16:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.318+0000 7f028f2c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f028809de50 0x7f028811a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.318+0000 7f028f2c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f028809e930 0x7f028811ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.318+0000 7f028f2c6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02881338a0 0x7f028811b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.318+0000 7f028f2c6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028811e0f0 con 0x7f02881338a0 2023-10-03T10:16:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.318+0000 7f028f2c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02880a0eb0 con 0x7f028809e930 2023-10-03T10:16:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.318+0000 7f028f2c6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f028811d880 con 0x7f028809de50 2023-10-03T10:16:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f028c861700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f028809e930 0x7f028811ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f028d863700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02881338a0 0x7f028811b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f028c861700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f028809e930 0x7f028811ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35450/0 (socket says 172.21.15.72:35450) 2023-10-03T10:16:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f028c861700 1 -- 172.21.15.72:0/4285818339 learned_addr learned my addr 172.21.15.72:0/4285818339 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f028d062700 1 --2- 172.21.15.72:0/4285818339 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f028809de50 0x7f028811a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f028d863700 1 -- 172.21.15.72:0/4285818339 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f028809de50 msgr2=0x7f028811a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f028d863700 1 --2- 172.21.15.72:0/4285818339 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f028809de50 0x7f028811a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f028d863700 1 -- 172.21.15.72:0/4285818339 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f028809e930 msgr2=0x7f028811ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f028d863700 1 --2- 172.21.15.72:0/4285818339 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f028809e930 0x7f028811ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f028d863700 1 -- 172.21.15.72:0/4285818339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0280009a70 con 0x7f02881338a0 2023-10-03T10:16:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f028c861700 1 --2- 172.21.15.72:0/4285818339 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f028809e930 0x7f028811ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f028d062700 1 --2- 172.21.15.72:0/4285818339 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f028809de50 0x7f028811a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f028d863700 1 --2- 172.21.15.72:0/4285818339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02881338a0 0x7f028811b050 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f028000efc0 tx=0x7f028000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f027dffb700 1 -- 172.21.15.72:0/4285818339 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028000ca90 con 0x7f02881338a0 2023-10-03T10:16:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f027dffb700 1 -- 172.21.15.72:0/4285818339 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028000f040 con 0x7f02881338a0 2023-10-03T10:16:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f028f2c6700 1 -- 172.21.15.72:0/4285818339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0284009550 con 0x7f02881338a0 2023-10-03T10:16:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.319+0000 7f027dffb700 1 -- 172.21.15.72:0/4285818339 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028000ce30 con 0x7f02881338a0 2023-10-03T10:16:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.320+0000 7f028f2c6700 1 -- 172.21.15.72:0/4285818339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028811c1e0 con 0x7f02881338a0 2023-10-03T10:16:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.320+0000 7f027dffb700 1 -- 172.21.15.72:0/4285818339 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0280014480 con 0x7f02881338a0 2023-10-03T10:16:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.320+0000 7f027dffb700 1 -- 172.21.15.72:0/4285818339 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f028003fc60 con 0x7f02881338a0 2023-10-03T10:16:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.321+0000 7f028f2c6700 1 -- 172.21.15.72:0/4285818339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0288074ea0 con 0x7f02881338a0 2023-10-03T10:16:01.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.329+0000 7f027dffb700 1 -- 172.21.15.72:0/4285818339 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0280012930 con 0x7f02881338a0 2023-10-03T10:16:01.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.481+0000 7f3ea4ff9700 1 -- 172.21.15.72:0/2441983376 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3e90005590 con 0x7f3eb809d630 2023-10-03T10:16:01.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.481+0000 7f3ea6ffd700 1 -- 172.21.15.72:0/2441983376 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3ea8015020 con 0x7f3eb809d630 2023-10-03T10:16:01.482 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:01.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.483+0000 7f3ea4ff9700 1 -- 172.21.15.72:0/2441983376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb809d630 msgr2=0x7f3eb811f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.483+0000 7f3ea4ff9700 1 --2- 172.21.15.72:0/2441983376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb809d630 0x7f3eb811f430 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80090b0 tx=0x7f3ea8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:01.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.483+0000 7f3ea4ff9700 1 -- 172.21.15.72:0/2441983376 shutdown_connections 2023-10-03T10:16:01.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.483+0000 7f3ea4ff9700 1 --2- 172.21.15.72:0/2441983376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb809d630 0x7f3eb811f430 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.483+0000 7f3ea4ff9700 1 --2- 172.21.15.72:0/2441983376 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb8133930 0x7f3eb81c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.483+0000 7f3ea4ff9700 1 --2- 172.21.15.72:0/2441983376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb80a0a30 0x7f3eb811f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.483+0000 7f3ea4ff9700 1 -- 172.21.15.72:0/2441983376 >> 172.21.15.72:0/2441983376 conn(0x7f3eb80a3050 msgr2=0x7f3eb809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.483+0000 7f3ea4ff9700 1 -- 172.21.15.72:0/2441983376 shutdown_connections 2023-10-03T10:16:01.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.483+0000 7f3ea4ff9700 1 -- 172.21.15.72:0/2441983376 wait complete. 2023-10-03T10:16:01.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:01.503 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:01.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.522+0000 7f028f2c6700 1 -- 172.21.15.72:0/4285818339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f028806b9e0 con 0x7f02881338a0 2023-10-03T10:16:01.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.522+0000 7f027dffb700 1 -- 172.21.15.72:0/4285818339 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0280012340 con 0x7f02881338a0 2023-10-03T10:16:01.523 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:01.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.524+0000 7f028f2c6700 1 -- 172.21.15.72:0/4285818339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02881338a0 msgr2=0x7f028811b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.524+0000 7f028f2c6700 1 --2- 172.21.15.72:0/4285818339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02881338a0 0x7f028811b050 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f028000efc0 tx=0x7f028000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.524+0000 7f028f2c6700 1 -- 172.21.15.72:0/4285818339 shutdown_connections 2023-10-03T10:16:01.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.524+0000 7f028f2c6700 1 --2- 172.21.15.72:0/4285818339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02881338a0 0x7f028811b050 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.524+0000 7f028f2c6700 1 --2- 172.21.15.72:0/4285818339 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f028809de50 0x7f028811a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.524+0000 7f028f2c6700 1 --2- 172.21.15.72:0/4285818339 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f028809e930 0x7f028811ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.524+0000 7f028f2c6700 1 -- 172.21.15.72:0/4285818339 >> 172.21.15.72:0/4285818339 conn(0x7f02880a2aa0 msgr2=0x7f0288130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.524+0000 7f028f2c6700 1 -- 172.21.15.72:0/4285818339 shutdown_connections 2023-10-03T10:16:01.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.524+0000 7f028f2c6700 1 -- 172.21.15.72:0/4285818339 wait complete. 2023-10-03T10:16:01.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:01.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.645+0000 7f1925303700 1 Processor -- start 2023-10-03T10:16:01.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.645+0000 7f1925303700 1 -- start start 2023-10-03T10:16:01.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.645+0000 7f1925303700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f19200a09c0 0x7f19200a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.645+0000 7f1925303700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f192009d5c0 0x7f19200a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.645+0000 7f1925303700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19200a1810 con 0x7f1920133920 2023-10-03T10:16:01.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.645+0000 7f1925303700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192009ea10 con 0x7f192009d5c0 2023-10-03T10:16:01.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.645+0000 7f1925303700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f192009e210 con 0x7f19200a09c0 2023-10-03T10:16:01.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.645+0000 7f191e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f192009d5c0 0x7f19200a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.645+0000 7f191effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f19200a09c0 0x7f19200a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.646+0000 7f191e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f192009d5c0 0x7f19200a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54772/0 (socket says 172.21.15.72:54772) 2023-10-03T10:16:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.646+0000 7f191e7fc700 1 -- 172.21.15.72:0/3186841982 learned_addr learned my addr 172.21.15.72:0/3186841982 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.646+0000 7f191effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f19200a09c0 0x7f19200a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49678/0 (socket says 172.21.15.72:49678) 2023-10-03T10:16:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.646+0000 7f191e7fc700 1 -- 172.21.15.72:0/3186841982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f19200a09c0 msgr2=0x7f19200a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.646+0000 7f191e7fc700 1 --2- 172.21.15.72:0/3186841982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f19200a09c0 0x7f19200a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.646+0000 7f191e7fc700 1 -- 172.21.15.72:0/3186841982 >> v1:172.21.15.72:6789/0 conn(0x7f1920133920 legacy=0x7f1920133da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.646+0000 7f191e7fc700 1 -- 172.21.15.72:0/3186841982 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19200a26f0 con 0x7f192009d5c0 2023-10-03T10:16:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.646+0000 7f191effd700 1 --2- 172.21.15.72:0/3186841982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f19200a09c0 0x7f19200a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.646+0000 7f191e7fc700 1 --2- 172.21.15.72:0/3186841982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f192009d5c0 0x7f19200a12d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f19100098f0 tx=0x7f1910009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a977600912aaa29 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.646+0000 7f191dffb700 1 -- 172.21.15.72:0/3186841982 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910011830 con 0x7f192009d5c0 2023-10-03T10:16:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.646+0000 7f191dffb700 1 -- 172.21.15.72:0/3186841982 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1910011990 con 0x7f192009d5c0 2023-10-03T10:16:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.646+0000 7f191dffb700 1 -- 172.21.15.72:0/3186841982 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910011d20 con 0x7f192009d5c0 2023-10-03T10:16:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.647+0000 7f1925303700 1 -- 172.21.15.72:0/3186841982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f192009d5c0 msgr2=0x7f19200a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.647+0000 7f1925303700 1 --2- 172.21.15.72:0/3186841982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f192009d5c0 0x7f19200a12d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f19100098f0 tx=0x7f1910009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.647+0000 7f1925303700 1 -- 172.21.15.72:0/3186841982 shutdown_connections 2023-10-03T10:16:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.647+0000 7f1925303700 1 --2- 172.21.15.72:0/3186841982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f19200a09c0 0x7f19200a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.647+0000 7f1925303700 1 --2- 172.21.15.72:0/3186841982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f192009d5c0 0x7f19200a12d0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.647+0000 7f1925303700 1 -- 172.21.15.72:0/3186841982 >> 172.21.15.72:0/3186841982 conn(0x7f19200a2fe0 msgr2=0x7f19200a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.647+0000 7f1925303700 1 -- 172.21.15.72:0/3186841982 shutdown_connections 2023-10-03T10:16:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.647+0000 7f1925303700 1 -- 172.21.15.72:0/3186841982 wait complete. 2023-10-03T10:16:01.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.648+0000 7f1925303700 1 Processor -- start 2023-10-03T10:16:01.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.648+0000 7f1925303700 1 -- start start 2023-10-03T10:16:01.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.648+0000 7f1925303700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f192009d5c0 0x7f19201c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.648+0000 7f1925303700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19200a09c0 0x7f19201c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.648+0000 7f1925303700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1920133920 0x7f19201c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.648+0000 7f1925303700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192011f3a0 con 0x7f19200a09c0 2023-10-03T10:16:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.648+0000 7f1925303700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19201c5c10 con 0x7f192009d5c0 2023-10-03T10:16:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.648+0000 7f1925303700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1920121a10 con 0x7f1920133920 2023-10-03T10:16:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.648+0000 7f191e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19200a09c0 0x7f19201c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.648+0000 7f191e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19200a09c0 0x7f19201c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54784/0 (socket says 172.21.15.72:54784) 2023-10-03T10:16:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.648+0000 7f191effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f192009d5c0 0x7f19201c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.648+0000 7f191e7fc700 1 -- 172.21.15.72:0/1082510282 learned_addr learned my addr 172.21.15.72:0/1082510282 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.648+0000 7f191f7fe700 1 --2- 172.21.15.72:0/1082510282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1920133920 0x7f19201c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.649+0000 7f191e7fc700 1 -- 172.21.15.72:0/1082510282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1920133920 msgr2=0x7f19201c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.649+0000 7f191e7fc700 1 --2- 172.21.15.72:0/1082510282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1920133920 0x7f19201c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.649+0000 7f191e7fc700 1 -- 172.21.15.72:0/1082510282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f192009d5c0 msgr2=0x7f19201c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.649+0000 7f191e7fc700 1 --2- 172.21.15.72:0/1082510282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f192009d5c0 0x7f19201c5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.649+0000 7f191e7fc700 1 -- 172.21.15.72:0/1082510282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19140094a0 con 0x7f19200a09c0 2023-10-03T10:16:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.649+0000 7f191f7fe700 1 --2- 172.21.15.72:0/1082510282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1920133920 0x7f19201c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.649+0000 7f191effd700 1 --2- 172.21.15.72:0/1082510282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f192009d5c0 0x7f19201c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.649+0000 7f191e7fc700 1 --2- 172.21.15.72:0/1082510282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19200a09c0 0x7f19201c56d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f1910000c00 tx=0x7f1910004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.649+0000 7f19077fe700 1 -- 172.21.15.72:0/1082510282 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19100036a0 con 0x7f19200a09c0 2023-10-03T10:16:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.649+0000 7f19077fe700 1 -- 172.21.15.72:0/1082510282 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1910003800 con 0x7f19200a09c0 2023-10-03T10:16:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.649+0000 7f1925303700 1 -- 172.21.15.72:0/1082510282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1910009550 con 0x7f19200a09c0 2023-10-03T10:16:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.649+0000 7f19077fe700 1 -- 172.21.15.72:0/1082510282 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910003bb0 con 0x7f19200a09c0 2023-10-03T10:16:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.649+0000 7f1925303700 1 -- 172.21.15.72:0/1082510282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1920120d50 con 0x7f19200a09c0 2023-10-03T10:16:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.650+0000 7f19077fe700 1 -- 172.21.15.72:0/1082510282 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1910021070 con 0x7f19200a09c0 2023-10-03T10:16:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.650+0000 7f1925303700 1 -- 172.21.15.72:0/1082510282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19200747f0 con 0x7f19200a09c0 2023-10-03T10:16:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.650+0000 7f19077fe700 1 -- 172.21.15.72:0/1082510282 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1910040af0 con 0x7f19200a09c0 2023-10-03T10:16:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.654+0000 7f19077fe700 1 -- 172.21.15.72:0/1082510282 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f191000b3e0 con 0x7f19200a09c0 2023-10-03T10:16:01.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.839+0000 7f1925303700 1 -- 172.21.15.72:0/1082510282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f192011fb00 con 0x7f19200a09c0 2023-10-03T10:16:01.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.839+0000 7f19077fe700 1 -- 172.21.15.72:0/1082510282 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1910032020 con 0x7f19200a09c0 2023-10-03T10:16:01.840 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.841+0000 7f1925303700 1 -- 172.21.15.72:0/1082510282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19200a09c0 msgr2=0x7f19201c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.841+0000 7f1925303700 1 --2- 172.21.15.72:0/1082510282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19200a09c0 0x7f19201c56d0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f1910000c00 tx=0x7f1910004750 comp rx=0 tx=0).stop 2023-10-03T10:16:01.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.841+0000 7f1925303700 1 -- 172.21.15.72:0/1082510282 shutdown_connections 2023-10-03T10:16:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.841+0000 7f1925303700 1 --2- 172.21.15.72:0/1082510282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1920133920 0x7f19201c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.841+0000 7f1925303700 1 --2- 172.21.15.72:0/1082510282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f192009d5c0 0x7f19201c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.841+0000 7f1925303700 1 --2- 172.21.15.72:0/1082510282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19200a09c0 0x7f19201c56d0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.841+0000 7f1925303700 1 -- 172.21.15.72:0/1082510282 >> 172.21.15.72:0/1082510282 conn(0x7f19200a2fe0 msgr2=0x7f1920132fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.841+0000 7f1925303700 1 -- 172.21.15.72:0/1082510282 shutdown_connections 2023-10-03T10:16:01.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:01.841+0000 7f1925303700 1 -- 172.21.15.72:0/1082510282 wait complete. 2023-10-03T10:16:01.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:02.314 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:02.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.437+0000 7f9021435700 1 Processor -- start 2023-10-03T10:16:02.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.437+0000 7f9021435700 1 -- start start 2023-10-03T10:16:02.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f9021435700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f901c09d5c0 0x7f901c138d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f9021435700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901c0a14a0 0x7f901c13b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f9021435700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901c09ea10 con 0x7f901c0a09c0 2023-10-03T10:16:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f9021435700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c09e210 con 0x7f901c0a14a0 2023-10-03T10:16:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f9021435700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f901c0a26f0 con 0x7f901c09d5c0 2023-10-03T10:16:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f901a7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f901c09d5c0 0x7f901c138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f901b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901c0a14a0 0x7f901c13b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f901affd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f901c0a09c0 0x7f901c0a0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35770/0 (socket says 172.21.15.72:35770) 2023-10-03T10:16:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f901affd700 1 -- 172.21.15.72:0/2079351556 learned_addr learned my addr 172.21.15.72:0/2079351556 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f9019ffb700 1 -- 172.21.15.72:0/2079351556 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585104168 0 0) 0x7f901c09ea10 con 0x7f901c0a09c0 2023-10-03T10:16:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f901a7fc700 1 -- 172.21.15.72:0/2079351556 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901c0a14a0 msgr2=0x7f901c13b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f901a7fc700 1 --2- 172.21.15.72:0/2079351556 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901c0a14a0 0x7f901c13b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f901a7fc700 1 -- 172.21.15.72:0/2079351556 >> v1:172.21.15.72:6789/0 conn(0x7f901c0a09c0 legacy=0x7f901c0a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f901a7fc700 1 -- 172.21.15.72:0/2079351556 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c09db70 con 0x7f901c09d5c0 2023-10-03T10:16:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f901b7fe700 1 --2- 172.21.15.72:0/2079351556 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901c0a14a0 0x7f901c13b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.438+0000 7f901a7fc700 1 --2- 172.21.15.72:0/2079351556 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f901c09d5c0 0x7f901c138d70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f900c009870 tx=0x7f900c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afbd1875102fb246 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.439+0000 7f9019ffb700 1 -- 172.21.15.72:0/2079351556 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c011830 con 0x7f901c09d5c0 2023-10-03T10:16:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.439+0000 7f9019ffb700 1 -- 172.21.15.72:0/2079351556 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c011990 con 0x7f901c09d5c0 2023-10-03T10:16:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.439+0000 7f9019ffb700 1 -- 172.21.15.72:0/2079351556 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c011d20 con 0x7f901c09d5c0 2023-10-03T10:16:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.439+0000 7f9021435700 1 -- 172.21.15.72:0/2079351556 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f901c09d5c0 msgr2=0x7f901c138d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.439+0000 7f9021435700 1 --2- 172.21.15.72:0/2079351556 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f901c09d5c0 0x7f901c138d70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f900c009870 tx=0x7f900c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.439+0000 7f9021435700 1 -- 172.21.15.72:0/2079351556 shutdown_connections 2023-10-03T10:16:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.439+0000 7f9021435700 1 --2- 172.21.15.72:0/2079351556 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901c0a14a0 0x7f901c13b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.439+0000 7f9021435700 1 --2- 172.21.15.72:0/2079351556 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f901c09d5c0 0x7f901c138d70 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.439+0000 7f9021435700 1 -- 172.21.15.72:0/2079351556 >> 172.21.15.72:0/2079351556 conn(0x7f901c0a2fe0 msgr2=0x7f901c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.439+0000 7f9021435700 1 -- 172.21.15.72:0/2079351556 shutdown_connections 2023-10-03T10:16:02.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.439+0000 7f9021435700 1 -- 172.21.15.72:0/2079351556 wait complete. 2023-10-03T10:16:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.441+0000 7f9021435700 1 Processor -- start 2023-10-03T10:16:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.441+0000 7f9021435700 1 -- start start 2023-10-03T10:16:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.441+0000 7f9021435700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f901c09d5c0 0x7f901c11c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.441+0000 7f9021435700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f901c0a09c0 0x7f901c11ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.441+0000 7f9021435700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901c0a14a0 0x7f901c11d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.441+0000 7f9021435700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c09cec0 con 0x7f901c09d5c0 2023-10-03T10:16:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.441+0000 7f9021435700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c11f510 con 0x7f901c0a14a0 2023-10-03T10:16:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.441+0000 7f9021435700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f901c09c1c0 con 0x7f901c0a09c0 2023-10-03T10:16:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.441+0000 7f901a7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f901c0a09c0 0x7f901c11ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.441+0000 7f901b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901c0a14a0 0x7f901c11d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.441+0000 7f901a7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f901c0a09c0 0x7f901c11ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49714/0 (socket says 172.21.15.72:49714) 2023-10-03T10:16:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.441+0000 7f901affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f901c09d5c0 0x7f901c11c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.441+0000 7f901a7fc700 1 -- 172.21.15.72:0/1920906397 learned_addr learned my addr 172.21.15.72:0/1920906397 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.442+0000 7f901a7fc700 1 -- 172.21.15.72:0/1920906397 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901c0a14a0 msgr2=0x7f901c11d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.442+0000 7f901a7fc700 1 --2- 172.21.15.72:0/1920906397 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901c0a14a0 0x7f901c11d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.442+0000 7f901a7fc700 1 -- 172.21.15.72:0/1920906397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f901c09d5c0 msgr2=0x7f901c11c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.442+0000 7f901a7fc700 1 --2- 172.21.15.72:0/1920906397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f901c09d5c0 0x7f901c11c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.442+0000 7f901a7fc700 1 -- 172.21.15.72:0/1920906397 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9014009a70 con 0x7f901c0a09c0 2023-10-03T10:16:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.442+0000 7f901a7fc700 1 --2- 172.21.15.72:0/1920906397 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f901c0a09c0 0x7f901c11ccf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f900c009840 tx=0x7f900c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.442+0000 7f90037fe700 1 -- 172.21.15.72:0/1920906397 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c004550 con 0x7f901c0a09c0 2023-10-03T10:16:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.442+0000 7f90037fe700 1 -- 172.21.15.72:0/1920906397 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c01f070 con 0x7f901c0a09c0 2023-10-03T10:16:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.442+0000 7f9021435700 1 -- 172.21.15.72:0/1920906397 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900c0094a0 con 0x7f901c0a09c0 2023-10-03T10:16:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.442+0000 7f90037fe700 1 -- 172.21.15.72:0/1920906397 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c0038e0 con 0x7f901c0a09c0 2023-10-03T10:16:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.442+0000 7f9021435700 1 -- 172.21.15.72:0/1920906397 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901c11f0c0 con 0x7f901c0a09c0 2023-10-03T10:16:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.443+0000 7f90037fe700 1 -- 172.21.15.72:0/1920906397 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f900c003a40 con 0x7f901c0a09c0 2023-10-03T10:16:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.443+0000 7f90037fe700 1 -- 172.21.15.72:0/1920906397 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f900c021070 con 0x7f901c0a09c0 2023-10-03T10:16:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.443+0000 7f9021435700 1 -- 172.21.15.72:0/1920906397 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901c0747f0 con 0x7f901c0a09c0 2023-10-03T10:16:02.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.448+0000 7f90037fe700 1 -- 172.21.15.72:0/1920906397 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f900c01a430 con 0x7f901c0a09c0 2023-10-03T10:16:02.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:02.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:02.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.625+0000 7f86aa507700 1 Processor -- start 2023-10-03T10:16:02.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.625+0000 7f86aa507700 1 -- start start 2023-10-03T10:16:02.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.625+0000 7f86aa507700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a409e930 0x7f86a409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.625+0000 7f86aa507700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a409f240 0x7f86a41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.625+0000 7f86aa507700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a4070940 con 0x7f86a409f650 2023-10-03T10:16:02.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.625+0000 7f86aa507700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a406fd60 con 0x7f86a409f240 2023-10-03T10:16:02.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.625+0000 7f86aa507700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86a406fa80 con 0x7f86a409e930 2023-10-03T10:16:02.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.626+0000 7f86a3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a409e930 0x7f86a409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.626+0000 7f86a8aa4700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f86a409f650 0x7f86a4131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35786/0 (socket says 172.21.15.72:35786) 2023-10-03T10:16:02.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.626+0000 7f86a8aa4700 1 -- 172.21.15.72:0/1915139496 learned_addr learned my addr 172.21.15.72:0/1915139496 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:02.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.626+0000 7f86a37fe700 1 --2- 172.21.15.72:0/1915139496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a409f240 0x7f86a41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.626+0000 7f86a3fff700 1 -- 172.21.15.72:0/1915139496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a409f240 msgr2=0x7f86a41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.626+0000 7f86a3fff700 1 --2- 172.21.15.72:0/1915139496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a409f240 0x7f86a41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.626+0000 7f86a2ffd700 1 -- 172.21.15.72:0/1915139496 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848079924 0 0) 0x7f86a4070940 con 0x7f86a409f650 2023-10-03T10:16:02.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.626+0000 7f86a3fff700 1 -- 172.21.15.72:0/1915139496 >> v1:172.21.15.72:6789/0 conn(0x7f86a409f650 legacy=0x7f86a4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.626+0000 7f86a3fff700 1 -- 172.21.15.72:0/1915139496 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a409fb60 con 0x7f86a409e930 2023-10-03T10:16:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.626+0000 7f86a3fff700 1 --2- 172.21.15.72:0/1915139496 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a409e930 0x7f86a409ed00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8694009870 tx=0x7f8694009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54ac218b8eed7246 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.626+0000 7f86a2ffd700 1 -- 172.21.15.72:0/1915139496 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694011830 con 0x7f86a409e930 2023-10-03T10:16:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.626+0000 7f86a2ffd700 1 -- 172.21.15.72:0/1915139496 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8694011990 con 0x7f86a409e930 2023-10-03T10:16:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.626+0000 7f86a2ffd700 1 -- 172.21.15.72:0/1915139496 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694011d20 con 0x7f86a409e930 2023-10-03T10:16:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.627+0000 7f86aa507700 1 -- 172.21.15.72:0/1915139496 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a409e930 msgr2=0x7f86a409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.627+0000 7f86aa507700 1 --2- 172.21.15.72:0/1915139496 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a409e930 0x7f86a409ed00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8694009870 tx=0x7f8694009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.627+0000 7f86aa507700 1 -- 172.21.15.72:0/1915139496 shutdown_connections 2023-10-03T10:16:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.627+0000 7f86aa507700 1 --2- 172.21.15.72:0/1915139496 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a409e930 0x7f86a409ed00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.627+0000 7f86aa507700 1 --2- 172.21.15.72:0/1915139496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a409f240 0x7f86a41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.627+0000 7f86aa507700 1 -- 172.21.15.72:0/1915139496 >> 172.21.15.72:0/1915139496 conn(0x7f86a40a4210 msgr2=0x7f86a40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.627+0000 7f86aa507700 1 -- 172.21.15.72:0/1915139496 shutdown_connections 2023-10-03T10:16:02.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.627+0000 7f86aa507700 1 -- 172.21.15.72:0/1915139496 wait complete. 2023-10-03T10:16:02.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.628+0000 7f86aa507700 1 Processor -- start 2023-10-03T10:16:02.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.628+0000 7f86aa507700 1 -- start start 2023-10-03T10:16:02.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.628+0000 7f86aa507700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a409e930 0x7f86a41c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.628+0000 7f86aa507700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a409f240 0x7f86a41c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.628+0000 7f86aa507700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a409f650 0x7f86a41c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.628+0000 7f86aa507700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a41a4ff0 con 0x7f86a409e930 2023-10-03T10:16:02.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.628+0000 7f86aa507700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a41a7610 con 0x7f86a409f650 2023-10-03T10:16:02.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.628+0000 7f86aa507700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86a41c38a0 con 0x7f86a409f240 2023-10-03T10:16:02.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86a37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a409f240 0x7f86a41c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86a37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a409f240 0x7f86a41c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49736/0 (socket says 172.21.15.72:49736) 2023-10-03T10:16:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86a37fe700 1 -- 172.21.15.72:0/2936598704 learned_addr learned my addr 172.21.15.72:0/2936598704 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86a3fff700 1 --2- 172.21.15.72:0/2936598704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a409e930 0x7f86a41c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86a8aa4700 1 --2- 172.21.15.72:0/2936598704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a409f650 0x7f86a41c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86a37fe700 1 -- 172.21.15.72:0/2936598704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a409f650 msgr2=0x7f86a41c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86a37fe700 1 --2- 172.21.15.72:0/2936598704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a409f650 0x7f86a41c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86a37fe700 1 -- 172.21.15.72:0/2936598704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a409e930 msgr2=0x7f86a41c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86a37fe700 1 --2- 172.21.15.72:0/2936598704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a409e930 0x7f86a41c2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86a37fe700 1 -- 172.21.15.72:0/2936598704 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86940094a0 con 0x7f86a409f240 2023-10-03T10:16:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86a3fff700 1 --2- 172.21.15.72:0/2936598704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a409e930 0x7f86a41c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86a37fe700 1 --2- 172.21.15.72:0/2936598704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a409f240 0x7f86a41c3360 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f869800e980 tx=0x7f869800ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86a0ff9700 1 -- 172.21.15.72:0/2936598704 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8698009710 con 0x7f86a409f240 2023-10-03T10:16:02.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86a0ff9700 1 -- 172.21.15.72:0/2936598704 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869800c690 con 0x7f86a409f240 2023-10-03T10:16:02.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86a0ff9700 1 -- 172.21.15.72:0/2936598704 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869800ca20 con 0x7f86a409f240 2023-10-03T10:16:02.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86aa507700 1 -- 172.21.15.72:0/2936598704 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a40a0190 con 0x7f86a409f240 2023-10-03T10:16:02.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.629+0000 7f86aa507700 1 -- 172.21.15.72:0/2936598704 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a41a6950 con 0x7f86a409f240 2023-10-03T10:16:02.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.630+0000 7f86aa507700 1 -- 172.21.15.72:0/2936598704 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a41a5760 con 0x7f86a409f240 2023-10-03T10:16:02.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.630+0000 7f86a0ff9700 1 -- 172.21.15.72:0/2936598704 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f869800cb80 con 0x7f86a409f240 2023-10-03T10:16:02.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.631+0000 7f86a0ff9700 1 -- 172.21.15.72:0/2936598704 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f869803f700 con 0x7f86a409f240 2023-10-03T10:16:02.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.635+0000 7f86a0ff9700 1 -- 172.21.15.72:0/2936598704 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86980232f0 con 0x7f86a409f240 2023-10-03T10:16:02.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.647+0000 7f9021435700 1 -- 172.21.15.72:0/1920906397 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f901c11f900 con 0x7f901c0a09c0 2023-10-03T10:16:02.647 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:02.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.647+0000 7f90037fe700 1 -- 172.21.15.72:0/1920906397 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f900c015020 con 0x7f901c0a09c0 2023-10-03T10:16:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.649+0000 7f9021435700 1 -- 172.21.15.72:0/1920906397 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f901c0a09c0 msgr2=0x7f901c11ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.649+0000 7f9021435700 1 --2- 172.21.15.72:0/1920906397 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f901c0a09c0 0x7f901c11ccf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f900c009840 tx=0x7f900c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.649+0000 7f9021435700 1 -- 172.21.15.72:0/1920906397 shutdown_connections 2023-10-03T10:16:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.649+0000 7f9021435700 1 --2- 172.21.15.72:0/1920906397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f901c09d5c0 0x7f901c11c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.649+0000 7f9021435700 1 --2- 172.21.15.72:0/1920906397 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901c0a14a0 0x7f901c11d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.649+0000 7f9021435700 1 --2- 172.21.15.72:0/1920906397 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f901c0a09c0 0x7f901c11ccf0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.649+0000 7f9021435700 1 -- 172.21.15.72:0/1920906397 >> 172.21.15.72:0/1920906397 conn(0x7f901c0a2fe0 msgr2=0x7f901c136cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.649+0000 7f9021435700 1 -- 172.21.15.72:0/1920906397 shutdown_connections 2023-10-03T10:16:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.650+0000 7f9021435700 1 -- 172.21.15.72:0/1920906397 wait complete. 2023-10-03T10:16:02.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:02.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.668+0000 7f580c641700 1 Processor -- start 2023-10-03T10:16:02.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.668+0000 7f580c641700 1 -- start start 2023-10-03T10:16:02.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.669+0000 7f580c641700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580409d6f0 0x7f580409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.669+0000 7f580c641700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f580409e410 0x7f5804134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.669+0000 7f580c641700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580409b120 con 0x7f580409e000 2023-10-03T10:16:02.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.669+0000 7f580c641700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580406b460 con 0x7f580409e410 2023-10-03T10:16:02.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.669+0000 7f580c641700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f580409a7e0 con 0x7f580409d6f0 2023-10-03T10:16:02.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.669+0000 7f580a3dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580409d6f0 0x7f580409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.669+0000 7f580abde700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f580409e410 0x7f5804134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.669+0000 7f580a3dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580409d6f0 0x7f580409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49748/0 (socket says 172.21.15.72:49748) 2023-10-03T10:16:02.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.669+0000 7f580a3dd700 1 -- 172.21.15.72:0/563507592 learned_addr learned my addr 172.21.15.72:0/563507592 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:02.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.669+0000 7f580abde700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f580409e410 0x7f5804134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54814/0 (socket says 172.21.15.72:54814) 2023-10-03T10:16:02.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.669+0000 7f580a3dd700 1 -- 172.21.15.72:0/563507592 >> v2:172.21.15.72:3300/0 conn(0x7f580409e410 msgr2=0x7f5804134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.669+0000 7f580a3dd700 1 --2- 172.21.15.72:0/563507592 >> v2:172.21.15.72:3300/0 conn(0x7f580409e410 0x7f5804134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.669+0000 7f580a3dd700 1 -- 172.21.15.72:0/563507592 >> v1:172.21.15.72:6789/0 conn(0x7f580409e000 legacy=0x7f58041339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.669+0000 7f580a3dd700 1 -- 172.21.15.72:0/563507592 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580409a500 con 0x7f580409d6f0 2023-10-03T10:16:02.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.669+0000 7f580a3dd700 1 --2- 172.21.15.72:0/563507592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580409d6f0 0x7f580409dac0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5800009920 tx=0x7f5800009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14add5606e706642 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.670+0000 7f58093db700 1 -- 172.21.15.72:0/563507592 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800011830 con 0x7f580409d6f0 2023-10-03T10:16:02.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.670+0000 7f58093db700 1 -- 172.21.15.72:0/563507592 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5800011990 con 0x7f580409d6f0 2023-10-03T10:16:02.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.670+0000 7f58093db700 1 -- 172.21.15.72:0/563507592 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800011d20 con 0x7f580409d6f0 2023-10-03T10:16:02.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.670+0000 7f580c641700 1 -- 172.21.15.72:0/563507592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580409d6f0 msgr2=0x7f580409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.670+0000 7f580c641700 1 --2- 172.21.15.72:0/563507592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580409d6f0 0x7f580409dac0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5800009920 tx=0x7f5800009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:02.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.670+0000 7f580c641700 1 -- 172.21.15.72:0/563507592 shutdown_connections 2023-10-03T10:16:02.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.670+0000 7f580c641700 1 --2- 172.21.15.72:0/563507592 >> v2:172.21.15.72:3300/0 conn(0x7f580409e410 0x7f5804134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.670+0000 7f580c641700 1 --2- 172.21.15.72:0/563507592 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580409d6f0 0x7f580409dac0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.670+0000 7f580c641700 1 -- 172.21.15.72:0/563507592 >> 172.21.15.72:0/563507592 conn(0x7f5804066f50 msgr2=0x7f580409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.670+0000 7f580c641700 1 -- 172.21.15.72:0/563507592 shutdown_connections 2023-10-03T10:16:02.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.670+0000 7f580c641700 1 -- 172.21.15.72:0/563507592 wait complete. 2023-10-03T10:16:02.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.671+0000 7f580c641700 1 Processor -- start 2023-10-03T10:16:02.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.671+0000 7f580c641700 1 -- start start 2023-10-03T10:16:02.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580c641700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580409d6f0 0x7f58041a6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580c641700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f580409e000 0x7f58041a6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580c641700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f580409e410 0x7f58041a6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580c641700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58041a74c0 con 0x7f580409e000 2023-10-03T10:16:02.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580c641700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58041a7b90 con 0x7f580409e410 2023-10-03T10:16:02.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580c641700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58041a8de0 con 0x7f580409d6f0 2023-10-03T10:16:02.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580a3dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580409d6f0 0x7f58041a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580a3dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580409d6f0 0x7f58041a6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49764/0 (socket says 172.21.15.72:49764) 2023-10-03T10:16:02.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580a3dd700 1 -- 172.21.15.72:0/1743884349 learned_addr learned my addr 172.21.15.72:0/1743884349 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:02.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580abde700 1 --2- 172.21.15.72:0/1743884349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f580409e410 0x7f58041a6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f5809bdc700 1 --2- 172.21.15.72:0/1743884349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f580409e000 0x7f58041a6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580a3dd700 1 -- 172.21.15.72:0/1743884349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f580409e410 msgr2=0x7f58041a6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580a3dd700 1 --2- 172.21.15.72:0/1743884349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f580409e410 0x7f58041a6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580a3dd700 1 -- 172.21.15.72:0/1743884349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f580409e000 msgr2=0x7f58041a6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580a3dd700 1 --2- 172.21.15.72:0/1743884349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f580409e000 0x7f58041a6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580a3dd700 1 -- 172.21.15.72:0/1743884349 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5800009550 con 0x7f580409d6f0 2023-10-03T10:16:02.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580a3dd700 1 --2- 172.21.15.72:0/1743884349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580409d6f0 0x7f58041a6010 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5800009870 tx=0x7f5800004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f57faffd700 1 -- 172.21.15.72:0/1743884349 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800004240 con 0x7f580409d6f0 2023-10-03T10:16:02.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f57faffd700 1 -- 172.21.15.72:0/1743884349 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580001f070 con 0x7f580409d6f0 2023-10-03T10:16:02.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f580c641700 1 -- 172.21.15.72:0/1743884349 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58041a97c0 con 0x7f580409d6f0 2023-10-03T10:16:02.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.672+0000 7f57faffd700 1 -- 172.21.15.72:0/1743884349 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58000036a0 con 0x7f580409d6f0 2023-10-03T10:16:02.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.673+0000 7f580c641700 1 -- 172.21.15.72:0/1743884349 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580409c710 con 0x7f580409d6f0 2023-10-03T10:16:02.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.673+0000 7f57faffd700 1 -- 172.21.15.72:0/1743884349 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5800021030 con 0x7f580409d6f0 2023-10-03T10:16:02.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.673+0000 7f57faffd700 1 -- 172.21.15.72:0/1743884349 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f58000409d0 con 0x7f580409d6f0 2023-10-03T10:16:02.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.673+0000 7f580c641700 1 -- 172.21.15.72:0/1743884349 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5804074ea0 con 0x7f580409d6f0 2023-10-03T10:16:02.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.678+0000 7f57faffd700 1 -- 172.21.15.72:0/1743884349 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5800015070 con 0x7f580409d6f0 2023-10-03T10:16:02.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.831+0000 7f86aa507700 1 -- 172.21.15.72:0/2936598704 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f86a4074ea0 con 0x7f86a409f240 2023-10-03T10:16:02.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.831+0000 7f86a0ff9700 1 -- 172.21.15.72:0/2936598704 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f869801bd00 con 0x7f86a409f240 2023-10-03T10:16:02.832 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.833+0000 7f86aa507700 1 -- 172.21.15.72:0/2936598704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a409f240 msgr2=0x7f86a41c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.833+0000 7f86aa507700 1 --2- 172.21.15.72:0/2936598704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a409f240 0x7f86a41c3360 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f869800e980 tx=0x7f869800ec90 comp rx=0 tx=0).stop 2023-10-03T10:16:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.833+0000 7f86aa507700 1 -- 172.21.15.72:0/2936598704 shutdown_connections 2023-10-03T10:16:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.833+0000 7f86aa507700 1 --2- 172.21.15.72:0/2936598704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a409e930 0x7f86a41c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.833+0000 7f86aa507700 1 --2- 172.21.15.72:0/2936598704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a409f650 0x7f86a41c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.833+0000 7f86aa507700 1 --2- 172.21.15.72:0/2936598704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a409f240 0x7f86a41c3360 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.833+0000 7f86aa507700 1 -- 172.21.15.72:0/2936598704 >> 172.21.15.72:0/2936598704 conn(0x7f86a40a4210 msgr2=0x7f86a41b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.833+0000 7f86aa507700 1 -- 172.21.15.72:0/2936598704 shutdown_connections 2023-10-03T10:16:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.833+0000 7f86aa507700 1 -- 172.21.15.72:0/2936598704 wait complete. 2023-10-03T10:16:02.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:02.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:02.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.872+0000 7f580c641700 1 -- 172.21.15.72:0/1743884349 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f580406c360 con 0x7f580409d6f0 2023-10-03T10:16:02.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.872+0000 7f57faffd700 1 -- 172.21.15.72:0/1743884349 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58000239c0 con 0x7f580409d6f0 2023-10-03T10:16:02.873 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:02.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.874+0000 7f580c641700 1 -- 172.21.15.72:0/1743884349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580409d6f0 msgr2=0x7f58041a6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.874+0000 7f580c641700 1 --2- 172.21.15.72:0/1743884349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580409d6f0 0x7f58041a6010 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5800009870 tx=0x7f5800004750 comp rx=0 tx=0).stop 2023-10-03T10:16:02.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.874+0000 7f580c641700 1 -- 172.21.15.72:0/1743884349 shutdown_connections 2023-10-03T10:16:02.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.874+0000 7f580c641700 1 --2- 172.21.15.72:0/1743884349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f580409e410 0x7f58041a6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.874+0000 7f580c641700 1 --2- 172.21.15.72:0/1743884349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580409d6f0 0x7f58041a6010 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.874+0000 7f580c641700 1 --2- 172.21.15.72:0/1743884349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f580409e000 0x7f58041a6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.874+0000 7f580c641700 1 -- 172.21.15.72:0/1743884349 >> 172.21.15.72:0/1743884349 conn(0x7f5804066f50 msgr2=0x7f58041bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.874+0000 7f580c641700 1 -- 172.21.15.72:0/1743884349 shutdown_connections 2023-10-03T10:16:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.874+0000 7f580c641700 1 -- 172.21.15.72:0/1743884349 wait complete. 2023-10-03T10:16:02.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:02.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.994+0000 7fa43497f700 1 Processor -- start 2023-10-03T10:16:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.994+0000 7fa43497f700 1 -- start start 2023-10-03T10:16:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.994+0000 7fa43497f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d6f0 0x7fa43009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.994+0000 7fa43497f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa43009e410 0x7fa430130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.994+0000 7fa43497f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43009f130 con 0x7fa43009e000 2023-10-03T10:16:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.994+0000 7fa43497f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43009f520 con 0x7fa43009e410 2023-10-03T10:16:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.994+0000 7fa43497f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa43009e930 con 0x7fa43009d6f0 2023-10-03T10:16:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.994+0000 7fa42e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d6f0 0x7fa43009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.994+0000 7fa42ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa43009e410 0x7fa430130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.994+0000 7fa42e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d6f0 0x7fa43009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49768/0 (socket says 172.21.15.72:49768) 2023-10-03T10:16:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.994+0000 7fa42ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa43009e410 0x7fa430130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54828/0 (socket says 172.21.15.72:54828) 2023-10-03T10:16:02.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.994+0000 7fa42e59c700 1 -- 172.21.15.72:0/2936391952 learned_addr learned my addr 172.21.15.72:0/2936391952 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.995+0000 7fa42e59c700 1 -- 172.21.15.72:0/2936391952 >> v2:172.21.15.72:3300/0 conn(0x7fa43009e410 msgr2=0x7fa430130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.995+0000 7fa42e59c700 1 --2- 172.21.15.72:0/2936391952 >> v2:172.21.15.72:3300/0 conn(0x7fa43009e410 0x7fa430130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.995+0000 7fa42e59c700 1 -- 172.21.15.72:0/2936391952 >> v1:172.21.15.72:6789/0 conn(0x7fa43009e000 legacy=0x7fa430130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.995+0000 7fa42e59c700 1 -- 172.21.15.72:0/2936391952 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43009b2d0 con 0x7fa43009d6f0 2023-10-03T10:16:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.995+0000 7fa42ed9d700 1 --2- 172.21.15.72:0/2936391952 >> v2:172.21.15.72:3300/0 conn(0x7fa43009e410 0x7fa430130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.995+0000 7fa42e59c700 1 --2- 172.21.15.72:0/2936391952 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d6f0 0x7fa43009dac0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa4240098f0 tx=0x7fa424009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=735ab6f0c3da422 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.995+0000 7fa42d59a700 1 -- 172.21.15.72:0/2936391952 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424011830 con 0x7fa43009d6f0 2023-10-03T10:16:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.995+0000 7fa42d59a700 1 -- 172.21.15.72:0/2936391952 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa424011990 con 0x7fa43009d6f0 2023-10-03T10:16:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.995+0000 7fa42d59a700 1 -- 172.21.15.72:0/2936391952 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424011d20 con 0x7fa43009d6f0 2023-10-03T10:16:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.995+0000 7fa43497f700 1 -- 172.21.15.72:0/2936391952 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d6f0 msgr2=0x7fa43009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.995+0000 7fa43497f700 1 --2- 172.21.15.72:0/2936391952 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d6f0 0x7fa43009dac0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa4240098f0 tx=0x7fa424009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:02.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.995+0000 7fa43497f700 1 -- 172.21.15.72:0/2936391952 shutdown_connections 2023-10-03T10:16:02.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.995+0000 7fa43497f700 1 --2- 172.21.15.72:0/2936391952 >> v2:172.21.15.72:3300/0 conn(0x7fa43009e410 0x7fa430130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.995+0000 7fa43497f700 1 --2- 172.21.15.72:0/2936391952 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d6f0 0x7fa43009dac0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.996+0000 7fa43497f700 1 -- 172.21.15.72:0/2936391952 >> 172.21.15.72:0/2936391952 conn(0x7fa430066f50 msgr2=0x7fa43009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.996+0000 7fa43497f700 1 -- 172.21.15.72:0/2936391952 shutdown_connections 2023-10-03T10:16:02.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.996+0000 7fa43497f700 1 -- 172.21.15.72:0/2936391952 wait complete. 2023-10-03T10:16:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa43497f700 1 Processor -- start 2023-10-03T10:16:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa43497f700 1 -- start start 2023-10-03T10:16:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa43497f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d6f0 0x7fa4301c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa43497f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa43009e000 0x7fa4301c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa43497f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43009e410 0x7fa4301c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa43497f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4301205b0 con 0x7fa43009e410 2023-10-03T10:16:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa43497f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa430126b00 con 0x7fa43009e000 2023-10-03T10:16:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa43497f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa430126190 con 0x7fa43009d6f0 2023-10-03T10:16:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa42e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d6f0 0x7fa4301c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa42e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d6f0 0x7fa4301c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49782/0 (socket says 172.21.15.72:49782) 2023-10-03T10:16:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa42e59c700 1 -- 172.21.15.72:0/2070666250 learned_addr learned my addr 172.21.15.72:0/2070666250 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa42ed9d700 1 --2- 172.21.15.72:0/2070666250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43009e410 0x7fa4301c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa42dd9b700 1 --2- 172.21.15.72:0/2070666250 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa43009e000 0x7fa4301c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa42e59c700 1 -- 172.21.15.72:0/2070666250 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa43009e000 msgr2=0x7fa4301c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa42e59c700 1 --2- 172.21.15.72:0/2070666250 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa43009e000 0x7fa4301c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa42e59c700 1 -- 172.21.15.72:0/2070666250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43009e410 msgr2=0x7fa4301c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa42e59c700 1 --2- 172.21.15.72:0/2070666250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43009e410 0x7fa4301c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.997+0000 7fa42e59c700 1 -- 172.21.15.72:0/2070666250 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa428009a70 con 0x7fa43009d6f0 2023-10-03T10:16:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.998+0000 7fa42e59c700 1 --2- 172.21.15.72:0/2070666250 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d6f0 0x7fa4301c8610 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa424009c40 tx=0x7fa424004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.998+0000 7fa41effd700 1 -- 172.21.15.72:0/2070666250 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424004510 con 0x7fa43009d6f0 2023-10-03T10:16:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.998+0000 7fa41effd700 1 -- 172.21.15.72:0/2070666250 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42401e070 con 0x7fa43009d6f0 2023-10-03T10:16:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.998+0000 7fa43497f700 1 -- 172.21.15.72:0/2070666250 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa424009550 con 0x7fa43009d6f0 2023-10-03T10:16:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.998+0000 7fa41effd700 1 -- 172.21.15.72:0/2070666250 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4240038e0 con 0x7fa43009d6f0 2023-10-03T10:16:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.998+0000 7fa43497f700 1 -- 172.21.15.72:0/2070666250 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4301212a0 con 0x7fa43009d6f0 2023-10-03T10:16:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.998+0000 7fa41effd700 1 -- 172.21.15.72:0/2070666250 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa424003a40 con 0x7fa43009d6f0 2023-10-03T10:16:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.999+0000 7fa41effd700 1 -- 172.21.15.72:0/2070666250 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa424040470 con 0x7fa43009d6f0 2023-10-03T10:16:03.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:02.999+0000 7fa43497f700 1 -- 172.21.15.72:0/2070666250 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa430074ea0 con 0x7fa43009d6f0 2023-10-03T10:16:03.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.003+0000 7fa41effd700 1 -- 172.21.15.72:0/2070666250 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa424015080 con 0x7fa43009d6f0 2023-10-03T10:16:03.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.187+0000 7fa43497f700 1 -- 172.21.15.72:0/2070666250 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa4300a36b0 con 0x7fa43009d6f0 2023-10-03T10:16:03.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.188+0000 7fa41effd700 1 -- 172.21.15.72:0/2070666250 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa42402d7d0 con 0x7fa43009d6f0 2023-10-03T10:16:03.188 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:03.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.189+0000 7fa43497f700 1 -- 172.21.15.72:0/2070666250 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d6f0 msgr2=0x7fa4301c8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.189+0000 7fa43497f700 1 --2- 172.21.15.72:0/2070666250 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d6f0 0x7fa4301c8610 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa424009c40 tx=0x7fa424004750 comp rx=0 tx=0).stop 2023-10-03T10:16:03.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.189+0000 7fa43497f700 1 -- 172.21.15.72:0/2070666250 shutdown_connections 2023-10-03T10:16:03.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.189+0000 7fa43497f700 1 --2- 172.21.15.72:0/2070666250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43009e410 0x7fa4301c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.189+0000 7fa43497f700 1 --2- 172.21.15.72:0/2070666250 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d6f0 0x7fa4301c8610 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.189+0000 7fa43497f700 1 --2- 172.21.15.72:0/2070666250 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa43009e000 0x7fa4301c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.190+0000 7fa43497f700 1 -- 172.21.15.72:0/2070666250 >> 172.21.15.72:0/2070666250 conn(0x7fa430066f50 msgr2=0x7fa4300a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.190+0000 7fa43497f700 1 -- 172.21.15.72:0/2070666250 shutdown_connections 2023-10-03T10:16:03.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.190+0000 7fa43497f700 1 -- 172.21.15.72:0/2070666250 wait complete. 2023-10-03T10:16:03.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:03.664 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.790+0000 7fbfdb964700 1 Processor -- start 2023-10-03T10:16:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.790+0000 7fbfdb964700 1 -- start start 2023-10-03T10:16:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfdb964700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfd409d6f0 0x7fbfd409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfdb964700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbfd409e000 0x7fbfd41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfdb964700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfd409e410 0x7fbfd4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfdb964700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd406b460 con 0x7fbfd409e000 2023-10-03T10:16:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfdb964700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd409b120 con 0x7fbfd409d6f0 2023-10-03T10:16:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfdb964700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd409a7e0 con 0x7fbfd409e410 2023-10-03T10:16:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfd8eff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbfd409e000 0x7fbfd41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfd9f01700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfd409e410 0x7fbfd4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfd8eff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbfd409e000 0x7fbfd41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54840/0 (socket says 172.21.15.72:54840) 2023-10-03T10:16:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfd9f01700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfd409e410 0x7fbfd4133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49798/0 (socket says 172.21.15.72:49798) 2023-10-03T10:16:03.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfd9700700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfd409d6f0 0x7fbfd409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfd8eff700 1 -- 172.21.15.72:0/2237093621 learned_addr learned my addr 172.21.15.72:0/2237093621 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfd8eff700 1 -- 172.21.15.72:0/2237093621 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfd409e410 msgr2=0x7fbfd4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfd8eff700 1 --2- 172.21.15.72:0/2237093621 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfd409e410 0x7fbfd4133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfd8eff700 1 -- 172.21.15.72:0/2237093621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfd409d6f0 msgr2=0x7fbfd409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfd8eff700 1 --2- 172.21.15.72:0/2237093621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfd409d6f0 0x7fbfd409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfd8eff700 1 -- 172.21.15.72:0/2237093621 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd409a500 con 0x7fbfd409e000 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.791+0000 7fbfd9700700 1 --2- 172.21.15.72:0/2237093621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfd409d6f0 0x7fbfd409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.792+0000 7fbfd8eff700 1 --2- 172.21.15.72:0/2237093621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfd409e000 0x7fbfd41339f0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00098f0 tx=0x7fbfd0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1dce8e3d50b7613 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.792+0000 7fbfcbfff700 1 -- 172.21.15.72:0/2237093621 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0011830 con 0x7fbfd409e000 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.792+0000 7fbfcbfff700 1 -- 172.21.15.72:0/2237093621 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd0011990 con 0x7fbfd409e000 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.792+0000 7fbfcbfff700 1 -- 172.21.15.72:0/2237093621 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0011d20 con 0x7fbfd409e000 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.792+0000 7fbfdb964700 1 -- 172.21.15.72:0/2237093621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfd409e000 msgr2=0x7fbfd41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.792+0000 7fbfdb964700 1 --2- 172.21.15.72:0/2237093621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfd409e000 0x7fbfd41339f0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00098f0 tx=0x7fbfd0009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.792+0000 7fbfdb964700 1 -- 172.21.15.72:0/2237093621 shutdown_connections 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.792+0000 7fbfdb964700 1 --2- 172.21.15.72:0/2237093621 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfd409e410 0x7fbfd4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.792+0000 7fbfdb964700 1 --2- 172.21.15.72:0/2237093621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfd409d6f0 0x7fbfd409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.792+0000 7fbfdb964700 1 --2- 172.21.15.72:0/2237093621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfd409e000 0x7fbfd41339f0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.792+0000 7fbfdb964700 1 -- 172.21.15.72:0/2237093621 >> 172.21.15.72:0/2237093621 conn(0x7fbfd4066f50 msgr2=0x7fbfd409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.792+0000 7fbfdb964700 1 -- 172.21.15.72:0/2237093621 shutdown_connections 2023-10-03T10:16:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.792+0000 7fbfdb964700 1 -- 172.21.15.72:0/2237093621 wait complete. 2023-10-03T10:16:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.793+0000 7fbfdb964700 1 Processor -- start 2023-10-03T10:16:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.793+0000 7fbfdb964700 1 -- start start 2023-10-03T10:16:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfdb964700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfd409d6f0 0x7fbfd41a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfdb964700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfd409e000 0x7fbfd41a6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfdb964700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfd409e410 0x7fbfd41a6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfdb964700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd41a9cf0 con 0x7fbfd409d6f0 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfdb964700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40a1fe0 con 0x7fbfd409e410 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfdb964700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd409c710 con 0x7fbfd409e000 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfd9700700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfd409d6f0 0x7fbfd41a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfd9700700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfd409d6f0 0x7fbfd41a61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54852/0 (socket says 172.21.15.72:54852) 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfd9700700 1 -- 172.21.15.72:0/1642713125 learned_addr learned my addr 172.21.15.72:0/1642713125 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfd8eff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfd409e000 0x7fbfd41a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfd9f01700 1 --2- 172.21.15.72:0/1642713125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfd409e410 0x7fbfd41a6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfd9700700 1 -- 172.21.15.72:0/1642713125 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfd409e000 msgr2=0x7fbfd41a6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfd9700700 1 --2- 172.21.15.72:0/1642713125 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfd409e000 0x7fbfd41a6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfd9700700 1 -- 172.21.15.72:0/1642713125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfd409e410 msgr2=0x7fbfd41a6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfd9700700 1 --2- 172.21.15.72:0/1642713125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfd409e410 0x7fbfd41a6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfd9700700 1 -- 172.21.15.72:0/1642713125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc40094a0 con 0x7fbfd409d6f0 2023-10-03T10:16:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfd8eff700 1 --2- 172.21.15.72:0/1642713125 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfd409e000 0x7fbfd41a6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfd9f01700 1 --2- 172.21.15.72:0/1642713125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfd409e410 0x7fbfd41a6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfd9700700 1 --2- 172.21.15.72:0/1642713125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfd409d6f0 0x7fbfd41a61d0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400ebe0 tx=0x7fbfc400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfc9ffb700 1 -- 172.21.15.72:0/1642713125 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc400c850 con 0x7fbfd409d6f0 2023-10-03T10:16:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfc9ffb700 1 -- 172.21.15.72:0/1642713125 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc400c9b0 con 0x7fbfd409d6f0 2023-10-03T10:16:03.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfdb964700 1 -- 172.21.15.72:0/1642713125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd0009550 con 0x7fbfd409d6f0 2023-10-03T10:16:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.794+0000 7fbfc9ffb700 1 -- 172.21.15.72:0/1642713125 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc400cd40 con 0x7fbfd409d6f0 2023-10-03T10:16:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.795+0000 7fbfdb964700 1 -- 172.21.15.72:0/1642713125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd41a9480 con 0x7fbfd409d6f0 2023-10-03T10:16:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.795+0000 7fbfc9ffb700 1 -- 172.21.15.72:0/1642713125 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbfc4013470 con 0x7fbfd409d6f0 2023-10-03T10:16:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.795+0000 7fbfc9ffb700 1 -- 172.21.15.72:0/1642713125 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbfc403fb30 con 0x7fbfd409d6f0 2023-10-03T10:16:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.795+0000 7fbfdb964700 1 -- 172.21.15.72:0/1642713125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd41a83f0 con 0x7fbfd409d6f0 2023-10-03T10:16:03.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.800+0000 7fbfc9ffb700 1 -- 172.21.15.72:0/1642713125 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfd41a83f0 con 0x7fbfd409d6f0 2023-10-03T10:16:03.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:03.888 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:03.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.972+0000 7f0b3dd51700 1 Processor -- start 2023-10-03T10:16:03.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.972+0000 7f0b3dd51700 1 -- start start 2023-10-03T10:16:03.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b3dd51700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b380a0a30 0x7f0b380a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b3dd51700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b3809d630 0x7f0b380a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b3dd51700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b38133930 0x7f0b38133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b3dd51700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b380a2a70 con 0x7f0b3809d630 2023-10-03T10:16:03.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b3dd51700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380a01d0 con 0x7f0b38133930 2023-10-03T10:16:03.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b3dd51700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3809e2b0 con 0x7f0b380a0a30 2023-10-03T10:16:03.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b377fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b380a0a30 0x7f0b380a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b377fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b380a0a30 0x7f0b380a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49816/0 (socket says 172.21.15.72:49816) 2023-10-03T10:16:03.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b377fe700 1 -- 172.21.15.72:0/2461753963 learned_addr learned my addr 172.21.15.72:0/2461753963 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:03.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b37fff700 1 --2- 172.21.15.72:0/2461753963 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b38133930 0x7f0b38133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b36ffd700 1 --2- 172.21.15.72:0/2461753963 >> v2:172.21.15.72:3300/0 conn(0x7f0b3809d630 0x7f0b380a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b377fe700 1 -- 172.21.15.72:0/2461753963 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b38133930 msgr2=0x7f0b38133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b377fe700 1 --2- 172.21.15.72:0/2461753963 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b38133930 0x7f0b38133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b377fe700 1 -- 172.21.15.72:0/2461753963 >> v2:172.21.15.72:3300/0 conn(0x7f0b3809d630 msgr2=0x7f0b380a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b377fe700 1 --2- 172.21.15.72:0/2461753963 >> v2:172.21.15.72:3300/0 conn(0x7f0b3809d630 0x7f0b380a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.973+0000 7f0b377fe700 1 -- 172.21.15.72:0/2461753963 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3809dc50 con 0x7f0b380a0a30 2023-10-03T10:16:03.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.974+0000 7f0b377fe700 1 --2- 172.21.15.72:0/2461753963 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b380a0a30 0x7f0b380a0e00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009e50 tx=0x7f0b2800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ae7e147ef505aa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.974+0000 7f0b367fc700 1 -- 172.21.15.72:0/2461753963 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2800e070 con 0x7f0b380a0a30 2023-10-03T10:16:03.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.974+0000 7f0b367fc700 1 -- 172.21.15.72:0/2461753963 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2800b910 con 0x7f0b380a0a30 2023-10-03T10:16:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.974+0000 7f0b367fc700 1 -- 172.21.15.72:0/2461753963 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2800bcc0 con 0x7f0b380a0a30 2023-10-03T10:16:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.974+0000 7f0b3dd51700 1 -- 172.21.15.72:0/2461753963 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b380a0a30 msgr2=0x7f0b380a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.974+0000 7f0b3dd51700 1 --2- 172.21.15.72:0/2461753963 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b380a0a30 0x7f0b380a0e00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009e50 tx=0x7f0b2800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.974+0000 7f0b3dd51700 1 -- 172.21.15.72:0/2461753963 shutdown_connections 2023-10-03T10:16:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.974+0000 7f0b3dd51700 1 --2- 172.21.15.72:0/2461753963 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b38133930 0x7f0b38133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.974+0000 7f0b3dd51700 1 --2- 172.21.15.72:0/2461753963 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b380a0a30 0x7f0b380a0e00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.974+0000 7f0b3dd51700 1 --2- 172.21.15.72:0/2461753963 >> v2:172.21.15.72:3300/0 conn(0x7f0b3809d630 0x7f0b380a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.974+0000 7f0b3dd51700 1 -- 172.21.15.72:0/2461753963 >> 172.21.15.72:0/2461753963 conn(0x7f0b380a3050 msgr2=0x7f0b380a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.974+0000 7f0b3dd51700 1 -- 172.21.15.72:0/2461753963 shutdown_connections 2023-10-03T10:16:03.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.974+0000 7f0b3dd51700 1 -- 172.21.15.72:0/2461753963 wait complete. 2023-10-03T10:16:03.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.976+0000 7f0b3dd51700 1 Processor -- start 2023-10-03T10:16:03.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.976+0000 7f0b3dd51700 1 -- start start 2023-10-03T10:16:03.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b3dd51700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809d630 0x7f0b38132670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b3dd51700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b380a0a30 0x7f0b38132bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b3dd51700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b38133930 0x7f0b3811e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b3dd51700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b38120480 con 0x7f0b38133930 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b3dd51700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380a41c0 con 0x7f0b380a0a30 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b3dd51700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b381225b0 con 0x7f0b3809d630 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b377fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809d630 0x7f0b38132670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b377fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809d630 0x7f0b38132670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49818/0 (socket says 172.21.15.72:49818) 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b377fe700 1 -- 172.21.15.72:0/1860374237 learned_addr learned my addr 172.21.15.72:0/1860374237 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b37fff700 1 --2- 172.21.15.72:0/1860374237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b38133930 0x7f0b3811e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b36ffd700 1 --2- 172.21.15.72:0/1860374237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b380a0a30 0x7f0b38132bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b377fe700 1 -- 172.21.15.72:0/1860374237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b380a0a30 msgr2=0x7f0b38132bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b377fe700 1 --2- 172.21.15.72:0/1860374237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b380a0a30 0x7f0b38132bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b377fe700 1 -- 172.21.15.72:0/1860374237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b38133930 msgr2=0x7f0b3811e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b377fe700 1 --2- 172.21.15.72:0/1860374237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b38133930 0x7f0b3811e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b377fe700 1 -- 172.21.15.72:0/1860374237 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b28009b30 con 0x7f0b3809d630 2023-10-03T10:16:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b36ffd700 1 --2- 172.21.15.72:0/1860374237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b380a0a30 0x7f0b38132bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b377fe700 1 --2- 172.21.15.72:0/1860374237 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809d630 0x7f0b38132670 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800b370 tx=0x7f0b28004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b2ffff700 1 -- 172.21.15.72:0/1860374237 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2800ce80 con 0x7f0b3809d630 2023-10-03T10:16:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.977+0000 7f0b2ffff700 1 -- 172.21.15.72:0/1860374237 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b28004250 con 0x7f0b3809d630 2023-10-03T10:16:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.978+0000 7f0b3dd51700 1 -- 172.21.15.72:0/1860374237 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b381220b0 con 0x7f0b3809d630 2023-10-03T10:16:03.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.978+0000 7f0b2ffff700 1 -- 172.21.15.72:0/1860374237 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b28004600 con 0x7f0b3809d630 2023-10-03T10:16:03.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.978+0000 7f0b3dd51700 1 -- 172.21.15.72:0/1860374237 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b38120a80 con 0x7f0b3809d630 2023-10-03T10:16:03.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.978+0000 7f0b3dd51700 1 -- 172.21.15.72:0/1860374237 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b38120cd0 con 0x7f0b3809d630 2023-10-03T10:16:03.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.979+0000 7f0b2ffff700 1 -- 172.21.15.72:0/1860374237 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b28004760 con 0x7f0b3809d630 2023-10-03T10:16:03.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.979+0000 7f0b2ffff700 1 -- 172.21.15.72:0/1860374237 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0b280411b0 con 0x7f0b3809d630 2023-10-03T10:16:03.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:03.983+0000 7f0b2ffff700 1 -- 172.21.15.72:0/1860374237 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b2801b3a0 con 0x7f0b3809d630 2023-10-03T10:16:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.002+0000 7fbfdb964700 1 -- 172.21.15.72:0/1642713125 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbfd41a83f0 con 0x7fbfd409d6f0 2023-10-03T10:16:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.002+0000 7fbfc9ffb700 1 -- 172.21.15.72:0/1642713125 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbfd41a83f0 con 0x7fbfd409d6f0 2023-10-03T10:16:04.003 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.005+0000 7fbfdb964700 1 -- 172.21.15.72:0/1642713125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfd409d6f0 msgr2=0x7fbfd41a61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.005+0000 7fbfdb964700 1 --2- 172.21.15.72:0/1642713125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfd409d6f0 0x7fbfd41a61d0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400ebe0 tx=0x7fbfc400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.005+0000 7fbfdb964700 1 -- 172.21.15.72:0/1642713125 shutdown_connections 2023-10-03T10:16:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.005+0000 7fbfdb964700 1 --2- 172.21.15.72:0/1642713125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfd409d6f0 0x7fbfd41a61d0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.005+0000 7fbfdb964700 1 --2- 172.21.15.72:0/1642713125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfd409e410 0x7fbfd41a6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.005+0000 7fbfdb964700 1 --2- 172.21.15.72:0/1642713125 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfd409e000 0x7fbfd41a6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.005+0000 7fbfdb964700 1 -- 172.21.15.72:0/1642713125 >> 172.21.15.72:0/1642713125 conn(0x7fbfd4066f50 msgr2=0x7fbfd41bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.005+0000 7fbfdb964700 1 -- 172.21.15.72:0/1642713125 shutdown_connections 2023-10-03T10:16:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.005+0000 7fbfdb964700 1 -- 172.21.15.72:0/1642713125 wait complete. 2023-10-03T10:16:04.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.016+0000 7f3d00a81700 1 Processor -- start 2023-10-03T10:16:04.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.016+0000 7f3d00a81700 1 -- start start 2023-10-03T10:16:04.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.016+0000 7f3d00a81700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3cfc133a80 0x7f3cfc133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.016+0000 7f3d00a81700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3cfc130a70 0x7f3cfc13b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.016+0000 7f3d00a81700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cfc06bc00 con 0x7f3cfc12ff20 2023-10-03T10:16:04.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.017+0000 7f3d00a81700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cfc06c570 con 0x7f3cfc133a80 2023-10-03T10:16:04.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.017+0000 7f3d00a81700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc0a0040 con 0x7f3cfc130a70 2023-10-03T10:16:04.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.017+0000 7f3cfa59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3cfc133a80 0x7f3cfc133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.017+0000 7f3cfa59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3cfc133a80 0x7f3cfc133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54880/0 (socket says 172.21.15.72:54880) 2023-10-03T10:16:04.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.017+0000 7f3cfa59c700 1 -- 172.21.15.72:0/1334536571 learned_addr learned my addr 172.21.15.72:0/1334536571 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:04.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.017+0000 7f3cfad9d700 1 --2- 172.21.15.72:0/1334536571 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3cfc130a70 0x7f3cfc13b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.017+0000 7f3cfa59c700 1 -- 172.21.15.72:0/1334536571 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3cfc130a70 msgr2=0x7f3cfc13b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.017+0000 7f3cfa59c700 1 --2- 172.21.15.72:0/1334536571 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3cfc130a70 0x7f3cfc13b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.017+0000 7f3cfa59c700 1 -- 172.21.15.72:0/1334536571 >> v1:172.21.15.72:6789/0 conn(0x7f3cfc12ff20 legacy=0x7f3cfc130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.017+0000 7f3cfa59c700 1 -- 172.21.15.72:0/1334536571 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc133860 con 0x7f3cfc133a80 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.017+0000 7f3cfad9d700 1 --2- 172.21.15.72:0/1334536571 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3cfc130a70 0x7f3cfc13b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.017+0000 7f3cfa59c700 1 --2- 172.21.15.72:0/1334536571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cfc133a80 0x7f3cfc133e50 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0098f0 tx=0x7f3cec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e35606b2bc65938 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.017+0000 7f3cf9d9b700 1 -- 172.21.15.72:0/1334536571 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec011830 con 0x7f3cfc133a80 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.017+0000 7f3cf9d9b700 1 -- 172.21.15.72:0/1334536571 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec011990 con 0x7f3cfc133a80 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.017+0000 7f3cf9d9b700 1 -- 172.21.15.72:0/1334536571 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec011d20 con 0x7f3cfc133a80 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.018+0000 7f3d00a81700 1 -- 172.21.15.72:0/1334536571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cfc133a80 msgr2=0x7f3cfc133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.018+0000 7f3d00a81700 1 --2- 172.21.15.72:0/1334536571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cfc133a80 0x7f3cfc133e50 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0098f0 tx=0x7f3cec009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:04.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.018+0000 7f3d00a81700 1 -- 172.21.15.72:0/1334536571 shutdown_connections 2023-10-03T10:16:04.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.018+0000 7f3d00a81700 1 --2- 172.21.15.72:0/1334536571 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3cfc130a70 0x7f3cfc13b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.018+0000 7f3d00a81700 1 --2- 172.21.15.72:0/1334536571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cfc133a80 0x7f3cfc133e50 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.018+0000 7f3d00a81700 1 -- 172.21.15.72:0/1334536571 >> 172.21.15.72:0/1334536571 conn(0x7f3cfc0a4210 msgr2=0x7f3cfc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.018+0000 7f3d00a81700 1 -- 172.21.15.72:0/1334536571 shutdown_connections 2023-10-03T10:16:04.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.018+0000 7f3d00a81700 1 -- 172.21.15.72:0/1334536571 wait complete. 2023-10-03T10:16:04.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.019+0000 7f3d00a81700 1 Processor -- start 2023-10-03T10:16:04.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.019+0000 7f3d00a81700 1 -- start start 2023-10-03T10:16:04.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3d00a81700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cfc12ff20 0x7f3cfc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3d00a81700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3cfc130a70 0x7f3cfc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3d00a81700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cfc133a80 0x7f3cfc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3d00a81700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc11ed70 con 0x7f3cfc133a80 2023-10-03T10:16:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3d00a81700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc11ea90 con 0x7f3cfc12ff20 2023-10-03T10:16:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3d00a81700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc120090 con 0x7f3cfc130a70 2023-10-03T10:16:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3cf3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3cfc130a70 0x7f3cfc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3cfa59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cfc12ff20 0x7f3cfc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3cfa59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cfc12ff20 0x7f3cfc09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35550/0 (socket says 172.21.15.72:35550) 2023-10-03T10:16:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3cfa59c700 1 -- 172.21.15.72:0/954972828 learned_addr learned my addr 172.21.15.72:0/954972828 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3cf3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3cfc130a70 0x7f3cfc09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49838/0 (socket says 172.21.15.72:49838) 2023-10-03T10:16:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3cfad9d700 1 --2- 172.21.15.72:0/954972828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cfc133a80 0x7f3cfc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3cfa59c700 1 -- 172.21.15.72:0/954972828 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3cfc130a70 msgr2=0x7f3cfc09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3cfa59c700 1 --2- 172.21.15.72:0/954972828 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3cfc130a70 0x7f3cfc09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3cfa59c700 1 -- 172.21.15.72:0/954972828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cfc133a80 msgr2=0x7f3cfc09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3cfa59c700 1 --2- 172.21.15.72:0/954972828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cfc133a80 0x7f3cfc09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3cfa59c700 1 -- 172.21.15.72:0/954972828 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf4009a70 con 0x7f3cfc12ff20 2023-10-03T10:16:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3cfa59c700 1 --2- 172.21.15.72:0/954972828 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cfc12ff20 0x7f3cfc09c480 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009c40 tx=0x7f3cec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.020+0000 7f3cf2ffd700 1 -- 172.21.15.72:0/954972828 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0043c0 con 0x7f3cfc12ff20 2023-10-03T10:16:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.021+0000 7f3cf2ffd700 1 -- 172.21.15.72:0/954972828 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec01f070 con 0x7f3cfc12ff20 2023-10-03T10:16:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.021+0000 7f3d00a81700 1 -- 172.21.15.72:0/954972828 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cec009550 con 0x7f3cfc12ff20 2023-10-03T10:16:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.021+0000 7f3cf2ffd700 1 -- 172.21.15.72:0/954972828 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0036a0 con 0x7f3cfc12ff20 2023-10-03T10:16:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.021+0000 7f3d00a81700 1 -- 172.21.15.72:0/954972828 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cfc12d300 con 0x7f3cfc12ff20 2023-10-03T10:16:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.021+0000 7f3d00a81700 1 -- 172.21.15.72:0/954972828 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cfc0a20c0 con 0x7f3cfc12ff20 2023-10-03T10:16:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.022+0000 7f3cf2ffd700 1 -- 172.21.15.72:0/954972828 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3cec021030 con 0x7f3cfc12ff20 2023-10-03T10:16:04.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.022+0000 7f3cf2ffd700 1 -- 172.21.15.72:0/954972828 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3cec040e80 con 0x7f3cfc12ff20 2023-10-03T10:16:04.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:04.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.026+0000 7f3cf2ffd700 1 -- 172.21.15.72:0/954972828 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3cec0199a0 con 0x7f3cfc12ff20 2023-10-03T10:16:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.187+0000 7f0b3dd51700 1 -- 172.21.15.72:0/1860374237 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0b380747f0 con 0x7f0b3809d630 2023-10-03T10:16:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.187+0000 7f0b2ffff700 1 -- 172.21.15.72:0/1860374237 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0b28033070 con 0x7f0b3809d630 2023-10-03T10:16:04.188 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:04.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.190+0000 7f0b3dd51700 1 -- 172.21.15.72:0/1860374237 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809d630 msgr2=0x7f0b38132670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.190+0000 7f0b3dd51700 1 --2- 172.21.15.72:0/1860374237 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809d630 0x7f0b38132670 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800b370 tx=0x7f0b28004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.190+0000 7f0b3dd51700 1 -- 172.21.15.72:0/1860374237 shutdown_connections 2023-10-03T10:16:04.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.190+0000 7f0b3dd51700 1 --2- 172.21.15.72:0/1860374237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b38133930 0x7f0b3811e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.190+0000 7f0b3dd51700 1 --2- 172.21.15.72:0/1860374237 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b3809d630 0x7f0b38132670 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.190+0000 7f0b3dd51700 1 --2- 172.21.15.72:0/1860374237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b380a0a30 0x7f0b38132bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.190+0000 7f0b3dd51700 1 -- 172.21.15.72:0/1860374237 >> 172.21.15.72:0/1860374237 conn(0x7f0b380a3050 msgr2=0x7f0b381bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.190+0000 7f0b3dd51700 1 -- 172.21.15.72:0/1860374237 shutdown_connections 2023-10-03T10:16:04.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.190+0000 7f0b3dd51700 1 -- 172.21.15.72:0/1860374237 wait complete. 2023-10-03T10:16:04.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:04.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:04.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.221+0000 7f3d00a81700 1 -- 172.21.15.72:0/954972828 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3cfc074ea0 con 0x7f3cfc12ff20 2023-10-03T10:16:04.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.221+0000 7f3cf2ffd700 1 -- 172.21.15.72:0/954972828 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3cec015070 con 0x7f3cfc12ff20 2023-10-03T10:16:04.222 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:04.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.223+0000 7f3d00a81700 1 -- 172.21.15.72:0/954972828 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cfc12ff20 msgr2=0x7f3cfc09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.223+0000 7f3d00a81700 1 --2- 172.21.15.72:0/954972828 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cfc12ff20 0x7f3cfc09c480 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009c40 tx=0x7f3cec004750 comp rx=0 tx=0).stop 2023-10-03T10:16:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.223+0000 7f3d00a81700 1 -- 172.21.15.72:0/954972828 shutdown_connections 2023-10-03T10:16:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.223+0000 7f3d00a81700 1 --2- 172.21.15.72:0/954972828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cfc133a80 0x7f3cfc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.223+0000 7f3d00a81700 1 --2- 172.21.15.72:0/954972828 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3cfc12ff20 0x7f3cfc09c480 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.223+0000 7f3d00a81700 1 --2- 172.21.15.72:0/954972828 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3cfc130a70 0x7f3cfc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.223+0000 7f3d00a81700 1 -- 172.21.15.72:0/954972828 >> 172.21.15.72:0/954972828 conn(0x7f3cfc0a4210 msgr2=0x7f3cfc09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.224+0000 7f3d00a81700 1 -- 172.21.15.72:0/954972828 shutdown_connections 2023-10-03T10:16:04.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.224+0000 7f3d00a81700 1 -- 172.21.15.72:0/954972828 wait complete. 2023-10-03T10:16:04.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:04.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.342+0000 7ff89e19f700 1 Processor -- start 2023-10-03T10:16:04.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.342+0000 7ff89e19f700 1 -- start start 2023-10-03T10:16:04.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff89e19f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff89809e2e0 0x7ff898138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff89e19f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff898138fe0 0x7ff89813b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff89e19f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff898099e10 con 0x7ff89809d800 2023-10-03T10:16:04.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff89e19f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89809f560 con 0x7ff89809e2e0 2023-10-03T10:16:04.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff89e19f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff89809e6b0 con 0x7ff898138fe0 2023-10-03T10:16:04.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff89c99c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff89809e2e0 0x7ff898138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff89d99e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff898138fe0 0x7ff89813b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff89d19d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff89809d800 0x7ff89809dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35828/0 (socket says 172.21.15.72:35828) 2023-10-03T10:16:04.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff89d19d700 1 -- 172.21.15.72:0/1849235574 learned_addr learned my addr 172.21.15.72:0/1849235574 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:04.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff88ffff700 1 -- 172.21.15.72:0/1849235574 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369523610 0 0) 0x7ff898099e10 con 0x7ff89809d800 2023-10-03T10:16:04.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff89d99e700 1 -- 172.21.15.72:0/1849235574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff89809e2e0 msgr2=0x7ff898138aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:04.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff89d99e700 1 --2- 172.21.15.72:0/1849235574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff89809e2e0 0x7ff898138aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff89d99e700 1 -- 172.21.15.72:0/1849235574 >> v1:172.21.15.72:6789/0 conn(0x7ff89809d800 legacy=0x7ff89809dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff89d99e700 1 -- 172.21.15.72:0/1849235574 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89806b4d0 con 0x7ff898138fe0 2023-10-03T10:16:04.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff89c99c700 1 --2- 172.21.15.72:0/1849235574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff89809e2e0 0x7ff898138aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:04.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff89d99e700 1 --2- 172.21.15.72:0/1849235574 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff898138fe0 0x7ff89813b3c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff890009dc0 tx=0x7ff89000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bdc170a0d6b21e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:04.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff88ffff700 1 -- 172.21.15.72:0/1849235574 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89000e070 con 0x7ff898138fe0 2023-10-03T10:16:04.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff88ffff700 1 -- 172.21.15.72:0/1849235574 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89000bac0 con 0x7ff898138fe0 2023-10-03T10:16:04.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.343+0000 7ff88ffff700 1 -- 172.21.15.72:0/1849235574 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89000be70 con 0x7ff898138fe0 2023-10-03T10:16:04.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.344+0000 7ff89e19f700 1 -- 172.21.15.72:0/1849235574 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff898138fe0 msgr2=0x7ff89813b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.344+0000 7ff89e19f700 1 --2- 172.21.15.72:0/1849235574 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff898138fe0 0x7ff89813b3c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff890009dc0 tx=0x7ff89000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:04.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.344+0000 7ff89e19f700 1 -- 172.21.15.72:0/1849235574 shutdown_connections 2023-10-03T10:16:04.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.344+0000 7ff89e19f700 1 --2- 172.21.15.72:0/1849235574 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff898138fe0 0x7ff89813b3c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.344+0000 7ff89e19f700 1 --2- 172.21.15.72:0/1849235574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff89809e2e0 0x7ff898138aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.344+0000 7ff89e19f700 1 -- 172.21.15.72:0/1849235574 >> 172.21.15.72:0/1849235574 conn(0x7ff8980a2e20 msgr2=0x7ff8980a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.344+0000 7ff89e19f700 1 -- 172.21.15.72:0/1849235574 shutdown_connections 2023-10-03T10:16:04.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.344+0000 7ff89e19f700 1 -- 172.21.15.72:0/1849235574 wait complete. 2023-10-03T10:16:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.345+0000 7ff89e19f700 1 Processor -- start 2023-10-03T10:16:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.345+0000 7ff89e19f700 1 -- start start 2023-10-03T10:16:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.345+0000 7ff89e19f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff89809d800 0x7ff89811e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.345+0000 7ff89e19f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff89809e2e0 0x7ff89811e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.345+0000 7ff89e19f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff898138fe0 0x7ff89811ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.345+0000 7ff89e19f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8981202a0 con 0x7ff89809e2e0 2023-10-03T10:16:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.345+0000 7ff89e19f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8981200b0 con 0x7ff898138fe0 2023-10-03T10:16:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.345+0000 7ff89e19f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff89809c510 con 0x7ff89809d800 2023-10-03T10:16:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff89d19d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff89809d800 0x7ff89811e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff89c99c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff89809e2e0 0x7ff89811e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff89d19d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff89809d800 0x7ff89811e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49868/0 (socket says 172.21.15.72:49868) 2023-10-03T10:16:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff89d19d700 1 -- 172.21.15.72:0/2423033080 learned_addr learned my addr 172.21.15.72:0/2423033080 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff89d99e700 1 --2- 172.21.15.72:0/2423033080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff898138fe0 0x7ff89811ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff89c99c700 1 -- 172.21.15.72:0/2423033080 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff89809d800 msgr2=0x7ff89811e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff89c99c700 1 --2- 172.21.15.72:0/2423033080 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff89809d800 0x7ff89811e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff89c99c700 1 -- 172.21.15.72:0/2423033080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff898138fe0 msgr2=0x7ff89811ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff89c99c700 1 --2- 172.21.15.72:0/2423033080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff898138fe0 0x7ff89811ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff89c99c700 1 -- 172.21.15.72:0/2423033080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff894009430 con 0x7ff89809e2e0 2023-10-03T10:16:04.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff89d19d700 1 --2- 172.21.15.72:0/2423033080 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff89809d800 0x7ff89811e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:04.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff89d99e700 1 --2- 172.21.15.72:0/2423033080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff898138fe0 0x7ff89811ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:04.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff89c99c700 1 --2- 172.21.15.72:0/2423033080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff89809e2e0 0x7ff89811e9e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7ff89400e980 tx=0x7ff89400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:04.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff88dffb700 1 -- 172.21.15.72:0/2423033080 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894005a20 con 0x7ff89809e2e0 2023-10-03T10:16:04.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff88dffb700 1 -- 172.21.15.72:0/2423033080 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff894005b80 con 0x7ff89809e2e0 2023-10-03T10:16:04.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff89e19f700 1 -- 172.21.15.72:0/2423033080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff890009a70 con 0x7ff89809e2e0 2023-10-03T10:16:04.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff88dffb700 1 -- 172.21.15.72:0/2423033080 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400c690 con 0x7ff89809e2e0 2023-10-03T10:16:04.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.346+0000 7ff89e19f700 1 -- 172.21.15.72:0/2423033080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff898121ce0 con 0x7ff89809e2e0 2023-10-03T10:16:04.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.347+0000 7ff88dffb700 1 -- 172.21.15.72:0/2423033080 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff89400c7f0 con 0x7ff89809e2e0 2023-10-03T10:16:04.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.347+0000 7ff88dffb700 1 -- 172.21.15.72:0/2423033080 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff89403f8a0 con 0x7ff89809e2e0 2023-10-03T10:16:04.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.347+0000 7ff89e19f700 1 -- 172.21.15.72:0/2423033080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff898121f00 con 0x7ff89809e2e0 2023-10-03T10:16:04.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.352+0000 7ff88dffb700 1 -- 172.21.15.72:0/2423033080 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff894020080 con 0x7ff89809e2e0 2023-10-03T10:16:04.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.535+0000 7ff89e19f700 1 -- 172.21.15.72:0/2423033080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff898120900 con 0x7ff89809e2e0 2023-10-03T10:16:04.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.536+0000 7ff88dffb700 1 -- 172.21.15.72:0/2423033080 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff894006030 con 0x7ff89809e2e0 2023-10-03T10:16:04.538 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:04.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.538+0000 7ff89e19f700 1 -- 172.21.15.72:0/2423033080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff89809e2e0 msgr2=0x7ff89811e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.538+0000 7ff89e19f700 1 --2- 172.21.15.72:0/2423033080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff89809e2e0 0x7ff89811e9e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7ff89400e980 tx=0x7ff89400ec90 comp rx=0 tx=0).stop 2023-10-03T10:16:04.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.538+0000 7ff89e19f700 1 -- 172.21.15.72:0/2423033080 shutdown_connections 2023-10-03T10:16:04.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.538+0000 7ff89e19f700 1 --2- 172.21.15.72:0/2423033080 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff898138fe0 0x7ff89811ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.538+0000 7ff89e19f700 1 --2- 172.21.15.72:0/2423033080 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff89809d800 0x7ff89811e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.538+0000 7ff89e19f700 1 --2- 172.21.15.72:0/2423033080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff89809e2e0 0x7ff89811e9e0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.538+0000 7ff89e19f700 1 -- 172.21.15.72:0/2423033080 >> 172.21.15.72:0/2423033080 conn(0x7ff8980a2e20 msgr2=0x7ff898136b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.538+0000 7ff89e19f700 1 -- 172.21.15.72:0/2423033080 shutdown_connections 2023-10-03T10:16:04.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:04.538+0000 7ff89e19f700 1 -- 172.21.15.72:0/2423033080 wait complete. 2023-10-03T10:16:04.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:05.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:05.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.151+0000 7faf59b3e700 1 Processor -- start 2023-10-03T10:16:05.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.152+0000 7faf59b3e700 1 -- start start 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.152+0000 7faf59b3e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf5409f410 0x7faf54136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.152+0000 7faf59b3e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf54136fe0 0x7faf541393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.152+0000 7faf59b3e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf54070940 con 0x7faf5409e930 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.152+0000 7faf59b3e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5406fd60 con 0x7faf5409f410 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.152+0000 7faf59b3e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5406fa80 con 0x7faf54136fe0 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.152+0000 7faf52ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf5409f410 0x7faf54136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.152+0000 7faf53fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf54136fe0 0x7faf541393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.152+0000 7faf52ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf5409f410 0x7faf54136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54912/0 (socket says 172.21.15.72:54912) 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.152+0000 7faf52ffd700 1 -- 172.21.15.72:0/1267204447 learned_addr learned my addr 172.21.15.72:0/1267204447 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:05.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.152+0000 7faf52ffd700 1 -- 172.21.15.72:0/1267204447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf54136fe0 msgr2=0x7faf541393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.152+0000 7faf52ffd700 1 --2- 172.21.15.72:0/1267204447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf54136fe0 0x7faf541393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.152+0000 7faf52ffd700 1 -- 172.21.15.72:0/1267204447 >> v1:172.21.15.72:6789/0 conn(0x7faf5409e930 legacy=0x7faf5409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.152+0000 7faf52ffd700 1 -- 172.21.15.72:0/1267204447 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5409fb60 con 0x7faf5409f410 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.152+0000 7faf53fff700 1 --2- 172.21.15.72:0/1267204447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf54136fe0 0x7faf541393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.153+0000 7faf52ffd700 1 --2- 172.21.15.72:0/1267204447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5409f410 0x7faf54136aa0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0098f0 tx=0x7faf3c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d00438824ddc9f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.153+0000 7faf527fc700 1 -- 172.21.15.72:0/1267204447 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c011830 con 0x7faf5409f410 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.153+0000 7faf527fc700 1 -- 172.21.15.72:0/1267204447 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c011990 con 0x7faf5409f410 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.153+0000 7faf527fc700 1 -- 172.21.15.72:0/1267204447 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c011d20 con 0x7faf5409f410 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.153+0000 7faf59b3e700 1 -- 172.21.15.72:0/1267204447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5409f410 msgr2=0x7faf54136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.153+0000 7faf59b3e700 1 --2- 172.21.15.72:0/1267204447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5409f410 0x7faf54136aa0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0098f0 tx=0x7faf3c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:05.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.153+0000 7faf59b3e700 1 -- 172.21.15.72:0/1267204447 shutdown_connections 2023-10-03T10:16:05.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.153+0000 7faf59b3e700 1 --2- 172.21.15.72:0/1267204447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf54136fe0 0x7faf541393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.153+0000 7faf59b3e700 1 --2- 172.21.15.72:0/1267204447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5409f410 0x7faf54136aa0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.153+0000 7faf59b3e700 1 -- 172.21.15.72:0/1267204447 >> 172.21.15.72:0/1267204447 conn(0x7faf540a4210 msgr2=0x7faf540a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.153+0000 7faf59b3e700 1 -- 172.21.15.72:0/1267204447 shutdown_connections 2023-10-03T10:16:05.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.153+0000 7faf59b3e700 1 -- 172.21.15.72:0/1267204447 wait complete. 2023-10-03T10:16:05.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.154+0000 7faf59b3e700 1 Processor -- start 2023-10-03T10:16:05.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.154+0000 7faf59b3e700 1 -- start start 2023-10-03T10:16:05.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf59b3e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5409e930 0x7faf541219e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf59b3e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf5409f410 0x7faf54121f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf59b3e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf54136fe0 0x7faf54122460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf59b3e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf54123700 con 0x7faf5409e930 2023-10-03T10:16:05.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf59b3e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf54125220 con 0x7faf54136fe0 2023-10-03T10:16:05.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf59b3e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf5406d880 con 0x7faf5409f410 2023-10-03T10:16:05.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf537fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5409e930 0x7faf541219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf53fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf54136fe0 0x7faf54122460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf537fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5409e930 0x7faf541219e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54924/0 (socket says 172.21.15.72:54924) 2023-10-03T10:16:05.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf52ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf5409f410 0x7faf54121f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf537fe700 1 -- 172.21.15.72:0/371894041 learned_addr learned my addr 172.21.15.72:0/371894041 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:05.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf53fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf54136fe0 0x7faf54122460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35608/0 (socket says 172.21.15.72:35608) 2023-10-03T10:16:05.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf53fff700 1 -- 172.21.15.72:0/371894041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf5409f410 msgr2=0x7faf54121f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf53fff700 1 --2- 172.21.15.72:0/371894041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf5409f410 0x7faf54121f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf53fff700 1 -- 172.21.15.72:0/371894041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5409e930 msgr2=0x7faf541219e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf53fff700 1 --2- 172.21.15.72:0/371894041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5409e930 0x7faf541219e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf53fff700 1 -- 172.21.15.72:0/371894041 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c009a70 con 0x7faf54136fe0 2023-10-03T10:16:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf537fe700 1 --2- 172.21.15.72:0/371894041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5409e930 0x7faf541219e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf53fff700 1 --2- 172.21.15.72:0/371894041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf54136fe0 0x7faf54122460 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00efc0 tx=0x7faf4c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf4bfff700 1 -- 172.21.15.72:0/371894041 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c00ca90 con 0x7faf54136fe0 2023-10-03T10:16:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.155+0000 7faf4bfff700 1 -- 172.21.15.72:0/371894041 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c00f040 con 0x7faf54136fe0 2023-10-03T10:16:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.156+0000 7faf4bfff700 1 -- 172.21.15.72:0/371894041 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c00ce30 con 0x7faf54136fe0 2023-10-03T10:16:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.156+0000 7faf59b3e700 1 -- 172.21.15.72:0/371894041 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3c009550 con 0x7faf54136fe0 2023-10-03T10:16:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.156+0000 7faf59b3e700 1 -- 172.21.15.72:0/371894041 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf54123de0 con 0x7faf54136fe0 2023-10-03T10:16:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.156+0000 7faf4bfff700 1 -- 172.21.15.72:0/371894041 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf4c014480 con 0x7faf54136fe0 2023-10-03T10:16:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.157+0000 7faf4bfff700 1 -- 172.21.15.72:0/371894041 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faf4c03fc60 con 0x7faf54136fe0 2023-10-03T10:16:05.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.157+0000 7faf59b3e700 1 -- 172.21.15.72:0/371894041 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf54074ea0 con 0x7faf54136fe0 2023-10-03T10:16:05.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.161+0000 7faf4bfff700 1 -- 172.21.15.72:0/371894041 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf4c012930 con 0x7faf54136fe0 2023-10-03T10:16:05.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:05.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:05.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.331+0000 7f24b3aeb700 1 Processor -- start 2023-10-03T10:16:05.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.331+0000 7f24b3aeb700 1 -- start start 2023-10-03T10:16:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b3aeb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24ac09e1d0 0x7f24ac138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b3aeb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24ac139170 0x7f24ac13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b3aeb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac09b120 con 0x7f24ac09d6f0 2023-10-03T10:16:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b3aeb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ac06b460 con 0x7f24ac09e1d0 2023-10-03T10:16:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b3aeb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac09a7e0 con 0x7f24ac139170 2023-10-03T10:16:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b1086700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24ac09e1d0 0x7f24ac138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b2088700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24ac139170 0x7f24ac13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b2088700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24ac139170 0x7f24ac13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49886/0 (socket says 172.21.15.72:49886) 2023-10-03T10:16:05.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b1086700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24ac09e1d0 0x7f24ac138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54926/0 (socket says 172.21.15.72:54926) 2023-10-03T10:16:05.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b2088700 1 -- 172.21.15.72:0/3526976440 learned_addr learned my addr 172.21.15.72:0/3526976440 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:05.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b2088700 1 -- 172.21.15.72:0/3526976440 >> v2:172.21.15.72:3300/0 conn(0x7f24ac09e1d0 msgr2=0x7f24ac138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b2088700 1 --2- 172.21.15.72:0/3526976440 >> v2:172.21.15.72:3300/0 conn(0x7f24ac09e1d0 0x7f24ac138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b2088700 1 -- 172.21.15.72:0/3526976440 >> v1:172.21.15.72:6789/0 conn(0x7f24ac09d6f0 legacy=0x7f24ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b2088700 1 -- 172.21.15.72:0/3526976440 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac09a500 con 0x7f24ac139170 2023-10-03T10:16:05.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b1086700 1 --2- 172.21.15.72:0/3526976440 >> v2:172.21.15.72:3300/0 conn(0x7f24ac09e1d0 0x7f24ac138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b2088700 1 --2- 172.21.15.72:0/3526976440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24ac139170 0x7f24ac13b550 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009e80 tx=0x7f24a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ff5aeef158a992c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.332+0000 7f24b0885700 1 -- 172.21.15.72:0/3526976440 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a400e070 con 0x7f24ac139170 2023-10-03T10:16:05.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.333+0000 7f24b0885700 1 -- 172.21.15.72:0/3526976440 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a400b8d0 con 0x7f24ac139170 2023-10-03T10:16:05.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.333+0000 7f24b0885700 1 -- 172.21.15.72:0/3526976440 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a400bc80 con 0x7f24ac139170 2023-10-03T10:16:05.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.333+0000 7f24b3aeb700 1 -- 172.21.15.72:0/3526976440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24ac139170 msgr2=0x7f24ac13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.333+0000 7f24b3aeb700 1 --2- 172.21.15.72:0/3526976440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24ac139170 0x7f24ac13b550 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009e80 tx=0x7f24a400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.333+0000 7f24b3aeb700 1 -- 172.21.15.72:0/3526976440 shutdown_connections 2023-10-03T10:16:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.333+0000 7f24b3aeb700 1 --2- 172.21.15.72:0/3526976440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24ac139170 0x7f24ac13b550 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.333+0000 7f24b3aeb700 1 --2- 172.21.15.72:0/3526976440 >> v2:172.21.15.72:3300/0 conn(0x7f24ac09e1d0 0x7f24ac138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.333+0000 7f24b3aeb700 1 -- 172.21.15.72:0/3526976440 >> 172.21.15.72:0/3526976440 conn(0x7f24ac066f50 msgr2=0x7f24ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.333+0000 7f24b3aeb700 1 -- 172.21.15.72:0/3526976440 shutdown_connections 2023-10-03T10:16:05.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.333+0000 7f24b3aeb700 1 -- 172.21.15.72:0/3526976440 wait complete. 2023-10-03T10:16:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.334+0000 7f24b3aeb700 1 Processor -- start 2023-10-03T10:16:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.334+0000 7f24b3aeb700 1 -- start start 2023-10-03T10:16:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b3aeb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24ac09d6f0 0x7f24ac120880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b3aeb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24ac09e1d0 0x7f24ac120dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b3aeb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24ac139170 0x7f24ac121300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b3aeb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac1240d0 con 0x7f24ac139170 2023-10-03T10:16:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b3aeb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac124320 con 0x7f24ac09d6f0 2023-10-03T10:16:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b3aeb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac123a90 con 0x7f24ac09e1d0 2023-10-03T10:16:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b1086700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24ac09e1d0 0x7f24ac120dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b1086700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24ac09e1d0 0x7f24ac120dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49894/0 (socket says 172.21.15.72:49894) 2023-10-03T10:16:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b1086700 1 -- 172.21.15.72:0/3212995892 learned_addr learned my addr 172.21.15.72:0/3212995892 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b1887700 1 --2- 172.21.15.72:0/3212995892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24ac09d6f0 0x7f24ac120880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b2088700 1 --2- 172.21.15.72:0/3212995892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24ac139170 0x7f24ac121300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b1086700 1 -- 172.21.15.72:0/3212995892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24ac09d6f0 msgr2=0x7f24ac120880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b1086700 1 --2- 172.21.15.72:0/3212995892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24ac09d6f0 0x7f24ac120880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b1086700 1 -- 172.21.15.72:0/3212995892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24ac139170 msgr2=0x7f24ac121300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b1086700 1 --2- 172.21.15.72:0/3212995892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24ac139170 0x7f24ac121300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b1086700 1 -- 172.21.15.72:0/3212995892 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c0094a0 con 0x7f24ac09e1d0 2023-10-03T10:16:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b1887700 1 --2- 172.21.15.72:0/3212995892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24ac09d6f0 0x7f24ac120880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b1086700 1 --2- 172.21.15.72:0/3212995892 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24ac09e1d0 0x7f24ac120dc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f249c00ebe0 tx=0x7f249c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24a27fc700 1 -- 172.21.15.72:0/3212995892 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c00c850 con 0x7f24ac09e1d0 2023-10-03T10:16:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24a27fc700 1 -- 172.21.15.72:0/3212995892 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c00c9b0 con 0x7f24ac09e1d0 2023-10-03T10:16:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24a27fc700 1 -- 172.21.15.72:0/3212995892 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c00cd40 con 0x7f24ac09e1d0 2023-10-03T10:16:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.335+0000 7f24b3aeb700 1 -- 172.21.15.72:0/3212995892 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a4009b30 con 0x7f24ac09e1d0 2023-10-03T10:16:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.336+0000 7f24b3aeb700 1 -- 172.21.15.72:0/3212995892 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ac0a1950 con 0x7f24ac09e1d0 2023-10-03T10:16:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.336+0000 7f24b3aeb700 1 -- 172.21.15.72:0/3212995892 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ac09c710 con 0x7f24ac09e1d0 2023-10-03T10:16:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.337+0000 7f24a27fc700 1 -- 172.21.15.72:0/3212995892 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f249c013470 con 0x7f24ac09e1d0 2023-10-03T10:16:05.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.337+0000 7f24a27fc700 1 -- 172.21.15.72:0/3212995892 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f249c03fae0 con 0x7f24ac09e1d0 2023-10-03T10:16:05.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.345+0000 7f24a27fc700 1 -- 172.21.15.72:0/3212995892 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f249c013720 con 0x7f24ac09e1d0 2023-10-03T10:16:05.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.360+0000 7faf59b3e700 1 -- 172.21.15.72:0/371894041 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faf54124e00 con 0x7faf54136fe0 2023-10-03T10:16:05.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.360+0000 7faf4bfff700 1 -- 172.21.15.72:0/371894041 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf4c02a090 con 0x7faf54136fe0 2023-10-03T10:16:05.361 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:05.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.362+0000 7faf59b3e700 1 -- 172.21.15.72:0/371894041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf54136fe0 msgr2=0x7faf54122460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.362+0000 7faf59b3e700 1 --2- 172.21.15.72:0/371894041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf54136fe0 0x7faf54122460 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00efc0 tx=0x7faf4c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.362+0000 7faf59b3e700 1 -- 172.21.15.72:0/371894041 shutdown_connections 2023-10-03T10:16:05.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.362+0000 7faf59b3e700 1 --2- 172.21.15.72:0/371894041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf5409e930 0x7faf541219e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.362+0000 7faf59b3e700 1 --2- 172.21.15.72:0/371894041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf54136fe0 0x7faf54122460 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.362+0000 7faf59b3e700 1 --2- 172.21.15.72:0/371894041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf5409f410 0x7faf54121f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.362+0000 7faf59b3e700 1 -- 172.21.15.72:0/371894041 >> 172.21.15.72:0/371894041 conn(0x7faf540a4210 msgr2=0x7faf540a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.362+0000 7faf59b3e700 1 -- 172.21.15.72:0/371894041 shutdown_connections 2023-10-03T10:16:05.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.362+0000 7faf59b3e700 1 -- 172.21.15.72:0/371894041 wait complete. 2023-10-03T10:16:05.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.373+0000 7f6b6c41c700 1 Processor -- start 2023-10-03T10:16:05.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.374+0000 7f6b6c41c700 1 -- start start 2023-10-03T10:16:05.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.374+0000 7f6b6c41c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b6409d6f0 0x7f6b6409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.374+0000 7f6b6c41c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6b6409e000 0x7f6b64130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.374+0000 7f6b6c41c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b6409e410 0x7f6b64130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.374+0000 7f6b6c41c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6409f520 con 0x7f6b6409e000 2023-10-03T10:16:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.374+0000 7f6b6c41c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6409f130 con 0x7f6b6409d6f0 2023-10-03T10:16:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.374+0000 7f6b6c41c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6409e930 con 0x7f6b6409e410 2023-10-03T10:16:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.374+0000 7f6b6a1b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b6409d6f0 0x7f6b6409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.374+0000 7f6b6a1b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b6409d6f0 0x7f6b6409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35622/0 (socket says 172.21.15.72:35622) 2023-10-03T10:16:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.374+0000 7f6b6a1b8700 1 -- 172.21.15.72:0/2121850401 learned_addr learned my addr 172.21.15.72:0/2121850401 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.374+0000 7f6b699b7700 1 --2- 172.21.15.72:0/2121850401 >> v2:172.21.15.72:3300/0 conn(0x7f6b6409e000 0x7f6b64130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.375+0000 7f6b6a9b9700 1 --2- 172.21.15.72:0/2121850401 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b6409e410 0x7f6b64130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.375+0000 7f6b6a1b8700 1 -- 172.21.15.72:0/2121850401 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b6409e410 msgr2=0x7f6b64130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.375+0000 7f6b6a1b8700 1 --2- 172.21.15.72:0/2121850401 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b6409e410 0x7f6b64130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.375+0000 7f6b6a1b8700 1 -- 172.21.15.72:0/2121850401 >> v2:172.21.15.72:3300/0 conn(0x7f6b6409e000 msgr2=0x7f6b64130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.375+0000 7f6b6a1b8700 1 --2- 172.21.15.72:0/2121850401 >> v2:172.21.15.72:3300/0 conn(0x7f6b6409e000 0x7f6b64130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.375+0000 7f6b6a1b8700 1 -- 172.21.15.72:0/2121850401 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6409b2d0 con 0x7f6b6409d6f0 2023-10-03T10:16:05.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.375+0000 7f6b699b7700 1 --2- 172.21.15.72:0/2121850401 >> v2:172.21.15.72:3300/0 conn(0x7f6b6409e000 0x7f6b64130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:05.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.375+0000 7f6b6a1b8700 1 --2- 172.21.15.72:0/2121850401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b6409d6f0 0x7f6b6409dac0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6b600098f0 tx=0x7f6b60009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6f911cf98218d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.375+0000 7f6b691b6700 1 -- 172.21.15.72:0/2121850401 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60011830 con 0x7f6b6409d6f0 2023-10-03T10:16:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.375+0000 7f6b691b6700 1 -- 172.21.15.72:0/2121850401 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b60011990 con 0x7f6b6409d6f0 2023-10-03T10:16:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.375+0000 7f6b691b6700 1 -- 172.21.15.72:0/2121850401 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60011d20 con 0x7f6b6409d6f0 2023-10-03T10:16:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.376+0000 7f6b6c41c700 1 -- 172.21.15.72:0/2121850401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b6409d6f0 msgr2=0x7f6b6409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.376+0000 7f6b6c41c700 1 --2- 172.21.15.72:0/2121850401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b6409d6f0 0x7f6b6409dac0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6b600098f0 tx=0x7f6b60009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.376+0000 7f6b6c41c700 1 -- 172.21.15.72:0/2121850401 shutdown_connections 2023-10-03T10:16:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.376+0000 7f6b6c41c700 1 --2- 172.21.15.72:0/2121850401 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b6409e410 0x7f6b64130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.376+0000 7f6b6c41c700 1 --2- 172.21.15.72:0/2121850401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b6409d6f0 0x7f6b6409dac0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.376+0000 7f6b6c41c700 1 --2- 172.21.15.72:0/2121850401 >> v2:172.21.15.72:3300/0 conn(0x7f6b6409e000 0x7f6b64130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.376+0000 7f6b6c41c700 1 -- 172.21.15.72:0/2121850401 >> 172.21.15.72:0/2121850401 conn(0x7f6b64066f50 msgr2=0x7f6b6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.376+0000 7f6b6c41c700 1 -- 172.21.15.72:0/2121850401 shutdown_connections 2023-10-03T10:16:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.376+0000 7f6b6c41c700 1 -- 172.21.15.72:0/2121850401 wait complete. 2023-10-03T10:16:05.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.377+0000 7f6b6c41c700 1 Processor -- start 2023-10-03T10:16:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.377+0000 7f6b6c41c700 1 -- start start 2023-10-03T10:16:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.377+0000 7f6b6c41c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b6409d6f0 0x7f6b641221e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.377+0000 7f6b6c41c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b6409e000 0x7f6b64122720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.377+0000 7f6b6c41c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6409e410 0x7f6b64122c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.377+0000 7f6b6c41c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b64125d00 con 0x7f6b6409e410 2023-10-03T10:16:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.377+0000 7f6b6c41c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b64123df0 con 0x7f6b6409d6f0 2023-10-03T10:16:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.377+0000 7f6b6c41c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b640a1640 con 0x7f6b6409e000 2023-10-03T10:16:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.377+0000 7f6b699b7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b6409e000 0x7f6b64122720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.377+0000 7f6b699b7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b6409e000 0x7f6b64122720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49922/0 (socket says 172.21.15.72:49922) 2023-10-03T10:16:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.377+0000 7f6b699b7700 1 -- 172.21.15.72:0/1317057746 learned_addr learned my addr 172.21.15.72:0/1317057746 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.377+0000 7f6b6a1b8700 1 --2- 172.21.15.72:0/1317057746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b6409d6f0 0x7f6b641221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.377+0000 7f6b6a9b9700 1 --2- 172.21.15.72:0/1317057746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6409e410 0x7f6b64122c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.378+0000 7f6b699b7700 1 -- 172.21.15.72:0/1317057746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b6409d6f0 msgr2=0x7f6b641221e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.378+0000 7f6b699b7700 1 --2- 172.21.15.72:0/1317057746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b6409d6f0 0x7f6b641221e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.378+0000 7f6b699b7700 1 -- 172.21.15.72:0/1317057746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6409e410 msgr2=0x7f6b64122c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.378+0000 7f6b699b7700 1 --2- 172.21.15.72:0/1317057746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6409e410 0x7f6b64122c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.378+0000 7f6b699b7700 1 -- 172.21.15.72:0/1317057746 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b540094a0 con 0x7f6b6409e000 2023-10-03T10:16:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.378+0000 7f6b699b7700 1 --2- 172.21.15.72:0/1317057746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b6409e000 0x7f6b64122720 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6b5400fb00 tx=0x7f6b5400fe10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.378+0000 7f6b5affd700 1 -- 172.21.15.72:0/1317057746 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400c070 con 0x7f6b6409e000 2023-10-03T10:16:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.378+0000 7f6b5affd700 1 -- 172.21.15.72:0/1317057746 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5400da60 con 0x7f6b6409e000 2023-10-03T10:16:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.378+0000 7f6b5affd700 1 -- 172.21.15.72:0/1317057746 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400ddf0 con 0x7f6b6409e000 2023-10-03T10:16:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.378+0000 7f6b6c41c700 1 -- 172.21.15.72:0/1317057746 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b60009550 con 0x7f6b6409e000 2023-10-03T10:16:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.378+0000 7f6b6c41c700 1 -- 172.21.15.72:0/1317057746 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b641245e0 con 0x7f6b6409e000 2023-10-03T10:16:05.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.379+0000 7f6b5affd700 1 -- 172.21.15.72:0/1317057746 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b5401a480 con 0x7f6b6409e000 2023-10-03T10:16:05.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.379+0000 7f6b5affd700 1 -- 172.21.15.72:0/1317057746 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6b54015070 con 0x7f6b6409e000 2023-10-03T10:16:05.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.379+0000 7f6b6c41c700 1 -- 172.21.15.72:0/1317057746 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b64074ea0 con 0x7f6b6409e000 2023-10-03T10:16:05.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.384+0000 7f6b5affd700 1 -- 172.21.15.72:0/1317057746 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b54011450 con 0x7f6b6409e000 2023-10-03T10:16:05.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.537+0000 7f24b3aeb700 1 -- 172.21.15.72:0/3212995892 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f24ac09f420 con 0x7f24ac09e1d0 2023-10-03T10:16:05.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.537+0000 7f24a27fc700 1 -- 172.21.15.72:0/3212995892 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f249c021070 con 0x7f24ac09e1d0 2023-10-03T10:16:05.538 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:05.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.539+0000 7f24b3aeb700 1 -- 172.21.15.72:0/3212995892 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24ac09e1d0 msgr2=0x7f24ac120dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.539+0000 7f24b3aeb700 1 --2- 172.21.15.72:0/3212995892 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24ac09e1d0 0x7f24ac120dc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f249c00ebe0 tx=0x7f249c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.539+0000 7f24b3aeb700 1 -- 172.21.15.72:0/3212995892 shutdown_connections 2023-10-03T10:16:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.539+0000 7f24b3aeb700 1 --2- 172.21.15.72:0/3212995892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24ac139170 0x7f24ac121300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.539+0000 7f24b3aeb700 1 --2- 172.21.15.72:0/3212995892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24ac09d6f0 0x7f24ac120880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.539+0000 7f24b3aeb700 1 --2- 172.21.15.72:0/3212995892 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24ac09e1d0 0x7f24ac120dc0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.539+0000 7f24b3aeb700 1 -- 172.21.15.72:0/3212995892 >> 172.21.15.72:0/3212995892 conn(0x7f24ac066f50 msgr2=0x7f24ac09b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.539+0000 7f24b3aeb700 1 -- 172.21.15.72:0/3212995892 shutdown_connections 2023-10-03T10:16:05.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.539+0000 7f24b3aeb700 1 -- 172.21.15.72:0/3212995892 wait complete. 2023-10-03T10:16:05.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:05.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:05.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.572+0000 7f6b6c41c700 1 -- 172.21.15.72:0/1317057746 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6b64125880 con 0x7f6b6409e000 2023-10-03T10:16:05.573 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:05.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.572+0000 7f6b5affd700 1 -- 172.21.15.72:0/1317057746 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b540103e0 con 0x7f6b6409e000 2023-10-03T10:16:05.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.574+0000 7f6b6c41c700 1 -- 172.21.15.72:0/1317057746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b6409e000 msgr2=0x7f6b64122720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.574+0000 7f6b6c41c700 1 --2- 172.21.15.72:0/1317057746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b6409e000 0x7f6b64122720 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6b5400fb00 tx=0x7f6b5400fe10 comp rx=0 tx=0).stop 2023-10-03T10:16:05.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.574+0000 7f6b6c41c700 1 -- 172.21.15.72:0/1317057746 shutdown_connections 2023-10-03T10:16:05.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.574+0000 7f6b6c41c700 1 --2- 172.21.15.72:0/1317057746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b6409e410 0x7f6b64122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.574+0000 7f6b6c41c700 1 --2- 172.21.15.72:0/1317057746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b6409d6f0 0x7f6b641221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.574+0000 7f6b6c41c700 1 --2- 172.21.15.72:0/1317057746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b6409e000 0x7f6b64122720 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.574+0000 7f6b6c41c700 1 -- 172.21.15.72:0/1317057746 >> 172.21.15.72:0/1317057746 conn(0x7f6b64066f50 msgr2=0x7f6b64130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.574+0000 7f6b6c41c700 1 -- 172.21.15.72:0/1317057746 shutdown_connections 2023-10-03T10:16:05.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.574+0000 7f6b6c41c700 1 -- 172.21.15.72:0/1317057746 wait complete. 2023-10-03T10:16:05.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:05.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.692+0000 7f64cc07f700 1 Processor -- start 2023-10-03T10:16:05.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64cc07f700 1 -- start start 2023-10-03T10:16:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64cc07f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64c409d6f0 0x7f64c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64cc07f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64c409e000 0x7f64c41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64cc07f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64c409e410 0x7f64c4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64cc07f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c406b460 con 0x7f64c409d6f0 2023-10-03T10:16:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64cc07f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c409b120 con 0x7f64c409e000 2023-10-03T10:16:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64cc07f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64c409a7e0 con 0x7f64c409e410 2023-10-03T10:16:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64c961a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64c409e000 0x7f64c41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64c9e1b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64c409d6f0 0x7f64c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64ca61c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64c409e410 0x7f64c4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64ca61c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64c409e410 0x7f64c4133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49930/0 (socket says 172.21.15.72:49930) 2023-10-03T10:16:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64c961a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64c409e000 0x7f64c41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35650/0 (socket says 172.21.15.72:35650) 2023-10-03T10:16:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64c9e1b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64c409d6f0 0x7f64c409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54952/0 (socket says 172.21.15.72:54952) 2023-10-03T10:16:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64ca61c700 1 -- 172.21.15.72:0/2749972869 learned_addr learned my addr 172.21.15.72:0/2749972869 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64ca61c700 1 -- 172.21.15.72:0/2749972869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64c409e000 msgr2=0x7f64c41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64ca61c700 1 --2- 172.21.15.72:0/2749972869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64c409e000 0x7f64c41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64ca61c700 1 -- 172.21.15.72:0/2749972869 >> v2:172.21.15.72:3300/0 conn(0x7f64c409d6f0 msgr2=0x7f64c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.693+0000 7f64ca61c700 1 --2- 172.21.15.72:0/2749972869 >> v2:172.21.15.72:3300/0 conn(0x7f64c409d6f0 0x7f64c409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64ca61c700 1 -- 172.21.15.72:0/2749972869 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c409a500 con 0x7f64c409e410 2023-10-03T10:16:05.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64c961a700 1 --2- 172.21.15.72:0/2749972869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64c409e000 0x7f64c41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64c9e1b700 1 --2- 172.21.15.72:0/2749972869 >> v2:172.21.15.72:3300/0 conn(0x7f64c409d6f0 0x7f64c409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64ca61c700 1 --2- 172.21.15.72:0/2749972869 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64c409e410 0x7f64c4133f30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009e80 tx=0x7f64bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22a64c079cfa7782 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64c8e19700 1 -- 172.21.15.72:0/2749972869 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc00e070 con 0x7f64c409e410 2023-10-03T10:16:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64c8e19700 1 -- 172.21.15.72:0/2749972869 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64bc00b8d0 con 0x7f64c409e410 2023-10-03T10:16:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64c8e19700 1 -- 172.21.15.72:0/2749972869 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc00bc80 con 0x7f64c409e410 2023-10-03T10:16:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64cc07f700 1 -- 172.21.15.72:0/2749972869 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64c409e410 msgr2=0x7f64c4133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64cc07f700 1 --2- 172.21.15.72:0/2749972869 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64c409e410 0x7f64c4133f30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009e80 tx=0x7f64bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64cc07f700 1 -- 172.21.15.72:0/2749972869 shutdown_connections 2023-10-03T10:16:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64cc07f700 1 --2- 172.21.15.72:0/2749972869 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64c409e410 0x7f64c4133f30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64cc07f700 1 --2- 172.21.15.72:0/2749972869 >> v2:172.21.15.72:3300/0 conn(0x7f64c409d6f0 0x7f64c409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64cc07f700 1 --2- 172.21.15.72:0/2749972869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64c409e000 0x7f64c41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64cc07f700 1 -- 172.21.15.72:0/2749972869 >> 172.21.15.72:0/2749972869 conn(0x7f64c4066f50 msgr2=0x7f64c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64cc07f700 1 -- 172.21.15.72:0/2749972869 shutdown_connections 2023-10-03T10:16:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.694+0000 7f64cc07f700 1 -- 172.21.15.72:0/2749972869 wait complete. 2023-10-03T10:16:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.695+0000 7f64cc07f700 1 Processor -- start 2023-10-03T10:16:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.695+0000 7f64cc07f700 1 -- start start 2023-10-03T10:16:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64cc07f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64c409d6f0 0x7f64c41a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64cc07f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64c409e000 0x7f64c41a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64cc07f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64c409e410 0x7f64c41c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64cc07f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c41a6a00 con 0x7f64c409e410 2023-10-03T10:16:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64cc07f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c41b9360 con 0x7f64c409d6f0 2023-10-03T10:16:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64cc07f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64c41a7e30 con 0x7f64c409e000 2023-10-03T10:16:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64c9e1b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64c409d6f0 0x7f64c41a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64c9e1b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64c409d6f0 0x7f64c41a5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35656/0 (socket says 172.21.15.72:35656) 2023-10-03T10:16:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64c9e1b700 1 -- 172.21.15.72:0/1473009755 learned_addr learned my addr 172.21.15.72:0/1473009755 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64c961a700 1 --2- 172.21.15.72:0/1473009755 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64c409e000 0x7f64c41a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64ca61c700 1 --2- 172.21.15.72:0/1473009755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64c409e410 0x7f64c41c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64c9e1b700 1 -- 172.21.15.72:0/1473009755 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64c409e000 msgr2=0x7f64c41a5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64c9e1b700 1 --2- 172.21.15.72:0/1473009755 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64c409e000 0x7f64c41a5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64c9e1b700 1 -- 172.21.15.72:0/1473009755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64c409e410 msgr2=0x7f64c41c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64c9e1b700 1 --2- 172.21.15.72:0/1473009755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64c409e410 0x7f64c41c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64c9e1b700 1 -- 172.21.15.72:0/1473009755 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b80094a0 con 0x7f64c409d6f0 2023-10-03T10:16:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64c9e1b700 1 --2- 172.21.15.72:0/1473009755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64c409d6f0 0x7f64c41a5230 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f64b800ebe0 tx=0x7f64b800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.696+0000 7f64b67fc700 1 -- 172.21.15.72:0/1473009755 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b800c850 con 0x7f64c409d6f0 2023-10-03T10:16:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.697+0000 7f64b67fc700 1 -- 172.21.15.72:0/1473009755 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b800c9b0 con 0x7f64c409d6f0 2023-10-03T10:16:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.697+0000 7f64cc07f700 1 -- 172.21.15.72:0/1473009755 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c00094a0 con 0x7f64c409d6f0 2023-10-03T10:16:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.697+0000 7f64b67fc700 1 -- 172.21.15.72:0/1473009755 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b800cd40 con 0x7f64c409d6f0 2023-10-03T10:16:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.697+0000 7f64cc07f700 1 -- 172.21.15.72:0/1473009755 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64bc009b30 con 0x7f64c409d6f0 2023-10-03T10:16:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.697+0000 7f64b67fc700 1 -- 172.21.15.72:0/1473009755 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f64b8013470 con 0x7f64c409d6f0 2023-10-03T10:16:05.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.697+0000 7f64b67fc700 1 -- 172.21.15.72:0/1473009755 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f64b803fae0 con 0x7f64c409d6f0 2023-10-03T10:16:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.697+0000 7f64cc07f700 1 -- 172.21.15.72:0/1473009755 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c4074ea0 con 0x7f64c409d6f0 2023-10-03T10:16:05.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.702+0000 7f64b67fc700 1 -- 172.21.15.72:0/1473009755 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f64b8013720 con 0x7f64c409d6f0 2023-10-03T10:16:05.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.885+0000 7f64cc07f700 1 -- 172.21.15.72:0/1473009755 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f64c41a8bc0 con 0x7f64c409d6f0 2023-10-03T10:16:05.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.885+0000 7f64b67fc700 1 -- 172.21.15.72:0/1473009755 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f64b8021030 con 0x7f64c409d6f0 2023-10-03T10:16:05.886 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:05.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.888+0000 7f64cc07f700 1 -- 172.21.15.72:0/1473009755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64c409d6f0 msgr2=0x7f64c41a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.888+0000 7f64cc07f700 1 --2- 172.21.15.72:0/1473009755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64c409d6f0 0x7f64c41a5230 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f64b800ebe0 tx=0x7f64b800eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.888+0000 7f64cc07f700 1 -- 172.21.15.72:0/1473009755 shutdown_connections 2023-10-03T10:16:05.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.888+0000 7f64cc07f700 1 --2- 172.21.15.72:0/1473009755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64c409e410 0x7f64c41c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.888+0000 7f64cc07f700 1 --2- 172.21.15.72:0/1473009755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64c409d6f0 0x7f64c41a5230 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.888+0000 7f64cc07f700 1 --2- 172.21.15.72:0/1473009755 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64c409e000 0x7f64c41a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.888+0000 7f64cc07f700 1 -- 172.21.15.72:0/1473009755 >> 172.21.15.72:0/1473009755 conn(0x7f64c4066f50 msgr2=0x7f64c40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.888+0000 7f64cc07f700 1 -- 172.21.15.72:0/1473009755 shutdown_connections 2023-10-03T10:16:05.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:05.888+0000 7f64cc07f700 1 -- 172.21.15.72:0/1473009755 wait complete. 2023-10-03T10:16:05.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:06.378 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.501+0000 7f2a9747f700 1 Processor -- start 2023-10-03T10:16:06.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.501+0000 7f2a9747f700 1 -- start start 2023-10-03T10:16:06.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a9747f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a9009d6f0 0x7f2a9009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a9747f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a9009e410 0x7f2a90130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a9747f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9009f130 con 0x7f2a9009e000 2023-10-03T10:16:06.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a9747f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a9009f520 con 0x7f2a9009d6f0 2023-10-03T10:16:06.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a9747f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9009e930 con 0x7f2a9009e410 2023-10-03T10:16:06.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a9521b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a9009d6f0 0x7f2a9009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a95a1c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a9009e410 0x7f2a90130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a9521b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a9009d6f0 0x7f2a9009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54966/0 (socket says 172.21.15.72:54966) 2023-10-03T10:16:06.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a95a1c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a9009e410 0x7f2a90130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49940/0 (socket says 172.21.15.72:49940) 2023-10-03T10:16:06.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a9521b700 1 -- 172.21.15.72:0/3024152929 learned_addr learned my addr 172.21.15.72:0/3024152929 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:06.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a9521b700 1 -- 172.21.15.72:0/3024152929 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a9009e410 msgr2=0x7f2a90130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a9521b700 1 --2- 172.21.15.72:0/3024152929 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a9009e410 0x7f2a90130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a9521b700 1 -- 172.21.15.72:0/3024152929 >> v1:172.21.15.72:6789/0 conn(0x7f2a9009e000 legacy=0x7f2a90130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a9521b700 1 -- 172.21.15.72:0/3024152929 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9009b2d0 con 0x7f2a9009d6f0 2023-10-03T10:16:06.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a87fff700 1 -- 172.21.15.72:0/3024152929 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453713003 0 0) 0x7f2a9009f130 con 0x7f2a9009e000 2023-10-03T10:16:06.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.502+0000 7f2a95a1c700 1 --2- 172.21.15.72:0/3024152929 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a9009e410 0x7f2a90130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.503+0000 7f2a9521b700 1 --2- 172.21.15.72:0/3024152929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a9009d6f0 0x7f2a9009dac0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000bb90 tx=0x7f2a8000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c789c72f2ed77b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.503+0000 7f2a87fff700 1 -- 172.21.15.72:0/3024152929 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8000dd30 con 0x7f2a9009d6f0 2023-10-03T10:16:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.503+0000 7f2a87fff700 1 -- 172.21.15.72:0/3024152929 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8000de90 con 0x7f2a9009d6f0 2023-10-03T10:16:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.503+0000 7f2a87fff700 1 -- 172.21.15.72:0/3024152929 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a80010690 con 0x7f2a9009d6f0 2023-10-03T10:16:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.503+0000 7f2a9747f700 1 -- 172.21.15.72:0/3024152929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a9009d6f0 msgr2=0x7f2a9009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.503+0000 7f2a9747f700 1 --2- 172.21.15.72:0/3024152929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a9009d6f0 0x7f2a9009dac0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000bb90 tx=0x7f2a8000bea0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.503+0000 7f2a9747f700 1 -- 172.21.15.72:0/3024152929 shutdown_connections 2023-10-03T10:16:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.503+0000 7f2a9747f700 1 --2- 172.21.15.72:0/3024152929 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a9009e410 0x7f2a90130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.503+0000 7f2a9747f700 1 --2- 172.21.15.72:0/3024152929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a9009d6f0 0x7f2a9009dac0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.503+0000 7f2a9747f700 1 -- 172.21.15.72:0/3024152929 >> 172.21.15.72:0/3024152929 conn(0x7f2a90066f50 msgr2=0x7f2a9009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.503+0000 7f2a9747f700 1 -- 172.21.15.72:0/3024152929 shutdown_connections 2023-10-03T10:16:06.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.503+0000 7f2a9747f700 1 -- 172.21.15.72:0/3024152929 wait complete. 2023-10-03T10:16:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.504+0000 7f2a9747f700 1 Processor -- start 2023-10-03T10:16:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.504+0000 7f2a9747f700 1 -- start start 2023-10-03T10:16:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9747f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a9009d6f0 0x7f2a9011df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9747f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a9009e000 0x7f2a9011e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9747f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a9009e410 0x7f2a9011e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9747f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a901302d0 con 0x7f2a9009e410 2023-10-03T10:16:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9747f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a90120d50 con 0x7f2a9009e000 2023-10-03T10:16:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9747f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9011f3a0 con 0x7f2a9009d6f0 2023-10-03T10:16:06.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9521b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a9009d6f0 0x7f2a9011df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9521b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a9009d6f0 0x7f2a9011df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49948/0 (socket says 172.21.15.72:49948) 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9521b700 1 -- 172.21.15.72:0/2040149440 learned_addr learned my addr 172.21.15.72:0/2040149440 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a94a1a700 1 --2- 172.21.15.72:0/2040149440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a9009e000 0x7f2a9011e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a95a1c700 1 --2- 172.21.15.72:0/2040149440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a9009e410 0x7f2a9011e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9521b700 1 -- 172.21.15.72:0/2040149440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a9009e000 msgr2=0x7f2a9011e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9521b700 1 --2- 172.21.15.72:0/2040149440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a9009e000 0x7f2a9011e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9521b700 1 -- 172.21.15.72:0/2040149440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a9009e410 msgr2=0x7f2a9011e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9521b700 1 --2- 172.21.15.72:0/2040149440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a9009e410 0x7f2a9011e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9521b700 1 -- 172.21.15.72:0/2040149440 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a88009a70 con 0x7f2a9009d6f0 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9521b700 1 --2- 172.21.15.72:0/2040149440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a9009d6f0 0x7f2a9011df40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2a80000c00 tx=0x7f2a80004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a85ffb700 1 -- 172.21.15.72:0/2040149440 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8001f070 con 0x7f2a9009d6f0 2023-10-03T10:16:06.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a85ffb700 1 -- 172.21.15.72:0/2040149440 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a800038b0 con 0x7f2a9009d6f0 2023-10-03T10:16:06.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a9747f700 1 -- 172.21.15.72:0/2040149440 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8000b7f0 con 0x7f2a9009d6f0 2023-10-03T10:16:06.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.505+0000 7f2a85ffb700 1 -- 172.21.15.72:0/2040149440 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a80003c20 con 0x7f2a9009d6f0 2023-10-03T10:16:06.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.506+0000 7f2a9747f700 1 -- 172.21.15.72:0/2040149440 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a901211a0 con 0x7f2a9009d6f0 2023-10-03T10:16:06.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.506+0000 7f2a85ffb700 1 -- 172.21.15.72:0/2040149440 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a80019400 con 0x7f2a9009d6f0 2023-10-03T10:16:06.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.506+0000 7f2a85ffb700 1 -- 172.21.15.72:0/2040149440 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2a80042a90 con 0x7f2a9009d6f0 2023-10-03T10:16:06.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.506+0000 7f2a9747f700 1 -- 172.21.15.72:0/2040149440 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9009c700 con 0x7f2a9009d6f0 2023-10-03T10:16:06.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.511+0000 7f2a85ffb700 1 -- 172.21.15.72:0/2040149440 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a8000e360 con 0x7f2a9009d6f0 2023-10-03T10:16:06.553 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:06.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.679+0000 7f68309fe700 1 Processor -- start 2023-10-03T10:16:06.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.679+0000 7f68309fe700 1 -- start start 2023-10-03T10:16:06.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.680+0000 7f68309fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f682c133420 0x7f682c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.680+0000 7f68309fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f682c133e30 0x7f682c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.680+0000 7f68309fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f682c134260 0x7f682c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.680+0000 7f68309fe700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f682c06b990 con 0x7f682c133e30 2023-10-03T10:16:06.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.680+0000 7f68309fe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0a0590 con 0x7f682c134260 2023-10-03T10:16:06.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.680+0000 7f68309fe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f682c09fb80 con 0x7f682c133420 2023-10-03T10:16:06.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.680+0000 7f682a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f682c133420 0x7f682c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.680+0000 7f682a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f682c133420 0x7f682c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49950/0 (socket says 172.21.15.72:49950) 2023-10-03T10:16:06.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.680+0000 7f682a59c700 1 -- 172.21.15.72:0/1118926261 learned_addr learned my addr 172.21.15.72:0/1118926261 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:06.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.680+0000 7f6829d9b700 1 --2- 172.21.15.72:0/1118926261 >> v2:172.21.15.72:3300/0 conn(0x7f682c133e30 0x7f682c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.680+0000 7f682ad9d700 1 --2- 172.21.15.72:0/1118926261 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f682c134260 0x7f682c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.680+0000 7f6829d9b700 1 -- 172.21.15.72:0/1118926261 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f682c133420 msgr2=0x7f682c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.680+0000 7f6829d9b700 1 --2- 172.21.15.72:0/1118926261 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f682c133420 0x7f682c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.680+0000 7f6829d9b700 1 -- 172.21.15.72:0/1118926261 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f682c134260 msgr2=0x7f682c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.680+0000 7f6829d9b700 1 --2- 172.21.15.72:0/1118926261 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f682c134260 0x7f682c1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.681+0000 7f6829d9b700 1 -- 172.21.15.72:0/1118926261 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c0a0030 con 0x7f682c133e30 2023-10-03T10:16:06.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.681+0000 7f682a59c700 1 --2- 172.21.15.72:0/1118926261 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f682c133420 0x7f682c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.681+0000 7f682ad9d700 1 --2- 172.21.15.72:0/1118926261 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f682c134260 0x7f682c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.681+0000 7f6829d9b700 1 --2- 172.21.15.72:0/1118926261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f682c133e30 0x7f682c12ff90 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6820009840 tx=0x7f6820009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e632591e51d9c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.681+0000 7f682959a700 1 -- 172.21.15.72:0/1118926261 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820011830 con 0x7f682c133e30 2023-10-03T10:16:06.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.681+0000 7f682959a700 1 -- 172.21.15.72:0/1118926261 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6820011990 con 0x7f682c133e30 2023-10-03T10:16:06.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.681+0000 7f682959a700 1 -- 172.21.15.72:0/1118926261 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820011d20 con 0x7f682c133e30 2023-10-03T10:16:06.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.681+0000 7f68309fe700 1 -- 172.21.15.72:0/1118926261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f682c133e30 msgr2=0x7f682c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.681+0000 7f68309fe700 1 --2- 172.21.15.72:0/1118926261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f682c133e30 0x7f682c12ff90 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6820009840 tx=0x7f6820009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:06.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.682+0000 7f68309fe700 1 -- 172.21.15.72:0/1118926261 shutdown_connections 2023-10-03T10:16:06.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.682+0000 7f68309fe700 1 --2- 172.21.15.72:0/1118926261 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f682c134260 0x7f682c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.682+0000 7f68309fe700 1 --2- 172.21.15.72:0/1118926261 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f682c133420 0x7f682c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.682+0000 7f68309fe700 1 --2- 172.21.15.72:0/1118926261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f682c133e30 0x7f682c12ff90 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.682+0000 7f68309fe700 1 -- 172.21.15.72:0/1118926261 >> 172.21.15.72:0/1118926261 conn(0x7f682c0a4210 msgr2=0x7f682c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.682+0000 7f68309fe700 1 -- 172.21.15.72:0/1118926261 shutdown_connections 2023-10-03T10:16:06.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.682+0000 7f68309fe700 1 -- 172.21.15.72:0/1118926261 wait complete. 2023-10-03T10:16:06.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.683+0000 7f68309fe700 1 Processor -- start 2023-10-03T10:16:06.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.683+0000 7f68309fe700 1 -- start start 2023-10-03T10:16:06.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.683+0000 7f68309fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f682c133420 0x7f682c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.683+0000 7f68309fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f682c133e30 0x7f682c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.683+0000 7f68309fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f682c134260 0x7f682c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.683+0000 7f68309fe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c09d850 con 0x7f682c133e30 2023-10-03T10:16:06.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.683+0000 7f68309fe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c12daf0 con 0x7f682c133420 2023-10-03T10:16:06.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.683+0000 7f68309fe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f682c11f1e0 con 0x7f682c134260 2023-10-03T10:16:06.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.683+0000 7f682a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f682c133420 0x7f682c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.683+0000 7f682a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f682c133420 0x7f682c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35680/0 (socket says 172.21.15.72:35680) 2023-10-03T10:16:06.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.683+0000 7f682a59c700 1 -- 172.21.15.72:0/905716077 learned_addr learned my addr 172.21.15.72:0/905716077 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:06.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.683+0000 7f6829d9b700 1 --2- 172.21.15.72:0/905716077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f682c133e30 0x7f682c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.683+0000 7f682ad9d700 1 --2- 172.21.15.72:0/905716077 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f682c134260 0x7f682c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.684+0000 7f6829d9b700 1 -- 172.21.15.72:0/905716077 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f682c134260 msgr2=0x7f682c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.684+0000 7f6829d9b700 1 --2- 172.21.15.72:0/905716077 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f682c134260 0x7f682c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.684+0000 7f6829d9b700 1 -- 172.21.15.72:0/905716077 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f682c133420 msgr2=0x7f682c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.684+0000 7f6829d9b700 1 --2- 172.21.15.72:0/905716077 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f682c133420 0x7f682c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.684+0000 7f6829d9b700 1 -- 172.21.15.72:0/905716077 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c009550 con 0x7f682c133e30 2023-10-03T10:16:06.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.684+0000 7f6829d9b700 1 --2- 172.21.15.72:0/905716077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f682c133e30 0x7f682c09c9c0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f6820016000 tx=0x7f6820004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.684+0000 7f681affd700 1 -- 172.21.15.72:0/905716077 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820004300 con 0x7f682c133e30 2023-10-03T10:16:06.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.684+0000 7f681affd700 1 -- 172.21.15.72:0/905716077 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682001f070 con 0x7f682c133e30 2023-10-03T10:16:06.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.684+0000 7f68309fe700 1 -- 172.21.15.72:0/905716077 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6824009a70 con 0x7f682c133e30 2023-10-03T10:16:06.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.684+0000 7f681affd700 1 -- 172.21.15.72:0/905716077 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68200036a0 con 0x7f682c133e30 2023-10-03T10:16:06.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.684+0000 7f68309fe700 1 -- 172.21.15.72:0/905716077 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68200094a0 con 0x7f682c133e30 2023-10-03T10:16:06.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.685+0000 7f681affd700 1 -- 172.21.15.72:0/905716077 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6820021030 con 0x7f682c133e30 2023-10-03T10:16:06.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.685+0000 7f68309fe700 1 -- 172.21.15.72:0/905716077 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682c11f9d0 con 0x7f682c133e30 2023-10-03T10:16:06.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.685+0000 7f681affd700 1 -- 172.21.15.72:0/905716077 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f68200405c0 con 0x7f682c133e30 2023-10-03T10:16:06.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.690+0000 7f681affd700 1 -- 172.21.15.72:0/905716077 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6820023790 con 0x7f682c133e30 2023-10-03T10:16:06.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.716+0000 7f2a9747f700 1 -- 172.21.15.72:0/2040149440 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2a90074ea0 con 0x7f2a9009d6f0 2023-10-03T10:16:06.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.716+0000 7f2a85ffb700 1 -- 172.21.15.72:0/2040149440 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a80029030 con 0x7f2a9009d6f0 2023-10-03T10:16:06.717 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:06.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.718+0000 7f2a9747f700 1 -- 172.21.15.72:0/2040149440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a9009d6f0 msgr2=0x7f2a9011df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.718+0000 7f2a9747f700 1 --2- 172.21.15.72:0/2040149440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a9009d6f0 0x7f2a9011df40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2a80000c00 tx=0x7f2a80004750 comp rx=0 tx=0).stop 2023-10-03T10:16:06.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.719+0000 7f2a9747f700 1 -- 172.21.15.72:0/2040149440 shutdown_connections 2023-10-03T10:16:06.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.719+0000 7f2a9747f700 1 --2- 172.21.15.72:0/2040149440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a9009e410 0x7f2a9011e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.719+0000 7f2a9747f700 1 --2- 172.21.15.72:0/2040149440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a9009d6f0 0x7f2a9011df40 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.719+0000 7f2a9747f700 1 --2- 172.21.15.72:0/2040149440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a9009e000 0x7f2a9011e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.719+0000 7f2a9747f700 1 -- 172.21.15.72:0/2040149440 >> 172.21.15.72:0/2040149440 conn(0x7f2a90066f50 msgr2=0x7f2a90070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.719+0000 7f2a9747f700 1 -- 172.21.15.72:0/2040149440 shutdown_connections 2023-10-03T10:16:06.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.719+0000 7f2a9747f700 1 -- 172.21.15.72:0/2040149440 wait complete. 2023-10-03T10:16:06.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.721+0000 7fbaa2e6e700 1 Processor -- start 2023-10-03T10:16:06.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.721+0000 7fbaa2e6e700 1 -- start start 2023-10-03T10:16:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.721+0000 7fbaa2e6e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba9c09d6f0 0x7fba9c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fbaa2e6e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9c09e000 0x7fba9c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fbaa2e6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9c09e410 0x7fba9c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fbaa2e6e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba9c09f520 con 0x7fba9c09d6f0 2023-10-03T10:16:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fbaa2e6e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c09f130 con 0x7fba9c09e410 2023-10-03T10:16:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fbaa2e6e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c09e930 con 0x7fba9c09e000 2023-10-03T10:16:06.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fbaa0c0a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba9c09d6f0 0x7fba9c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fba9bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9c09e000 0x7fba9c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fbaa0c0a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba9c09d6f0 0x7fba9c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54996/0 (socket says 172.21.15.72:54996) 2023-10-03T10:16:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fba9bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9c09e000 0x7fba9c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49970/0 (socket says 172.21.15.72:49970) 2023-10-03T10:16:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fbaa0c0a700 1 -- 172.21.15.72:0/3362108886 learned_addr learned my addr 172.21.15.72:0/3362108886 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fbaa140b700 1 --2- 172.21.15.72:0/3362108886 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9c09e410 0x7fba9c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fba9bfff700 1 -- 172.21.15.72:0/3362108886 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9c09e410 msgr2=0x7fba9c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fba9bfff700 1 --2- 172.21.15.72:0/3362108886 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9c09e410 0x7fba9c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fba9bfff700 1 -- 172.21.15.72:0/3362108886 >> v2:172.21.15.72:3300/0 conn(0x7fba9c09d6f0 msgr2=0x7fba9c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fba9bfff700 1 --2- 172.21.15.72:0/3362108886 >> v2:172.21.15.72:3300/0 conn(0x7fba9c09d6f0 0x7fba9c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fba9bfff700 1 -- 172.21.15.72:0/3362108886 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c09b2d0 con 0x7fba9c09e000 2023-10-03T10:16:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fbaa0c0a700 1 --2- 172.21.15.72:0/3362108886 >> v2:172.21.15.72:3300/0 conn(0x7fba9c09d6f0 0x7fba9c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fba9bfff700 1 --2- 172.21.15.72:0/3362108886 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9c09e000 0x7fba9c130660 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fba88009870 tx=0x7fba88009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afcd661beca2999d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fba9b7fe700 1 -- 172.21.15.72:0/3362108886 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88011830 con 0x7fba9c09e000 2023-10-03T10:16:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fba9b7fe700 1 -- 172.21.15.72:0/3362108886 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba88011990 con 0x7fba9c09e000 2023-10-03T10:16:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.722+0000 7fba9b7fe700 1 -- 172.21.15.72:0/3362108886 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88011d20 con 0x7fba9c09e000 2023-10-03T10:16:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.723+0000 7fbaa2e6e700 1 -- 172.21.15.72:0/3362108886 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9c09e000 msgr2=0x7fba9c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.723+0000 7fbaa2e6e700 1 --2- 172.21.15.72:0/3362108886 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9c09e000 0x7fba9c130660 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fba88009870 tx=0x7fba88009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.723+0000 7fbaa2e6e700 1 -- 172.21.15.72:0/3362108886 shutdown_connections 2023-10-03T10:16:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.723+0000 7fbaa2e6e700 1 --2- 172.21.15.72:0/3362108886 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9c09e410 0x7fba9c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.723+0000 7fbaa2e6e700 1 --2- 172.21.15.72:0/3362108886 >> v2:172.21.15.72:3300/0 conn(0x7fba9c09d6f0 0x7fba9c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.723+0000 7fbaa2e6e700 1 --2- 172.21.15.72:0/3362108886 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9c09e000 0x7fba9c130660 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.723+0000 7fbaa2e6e700 1 -- 172.21.15.72:0/3362108886 >> 172.21.15.72:0/3362108886 conn(0x7fba9c066f50 msgr2=0x7fba9c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.723+0000 7fbaa2e6e700 1 -- 172.21.15.72:0/3362108886 shutdown_connections 2023-10-03T10:16:06.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.723+0000 7fbaa2e6e700 1 -- 172.21.15.72:0/3362108886 wait complete. 2023-10-03T10:16:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.724+0000 7fbaa2e6e700 1 Processor -- start 2023-10-03T10:16:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.724+0000 7fbaa2e6e700 1 -- start start 2023-10-03T10:16:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa2e6e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9c09d6f0 0x7fba9c11df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa2e6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9c09e000 0x7fba9c11e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa2e6e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba9c09e410 0x7fba9c11e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa2e6e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c11f3a0 con 0x7fba9c09e410 2023-10-03T10:16:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa2e6e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c120130 con 0x7fba9c09e000 2023-10-03T10:16:06.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa2e6e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c1211f0 con 0x7fba9c09d6f0 2023-10-03T10:16:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa0c0a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9c09d6f0 0x7fba9c11df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa0c0a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9c09d6f0 0x7fba9c11df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49980/0 (socket says 172.21.15.72:49980) 2023-10-03T10:16:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa0c0a700 1 -- 172.21.15.72:0/1180264736 learned_addr learned my addr 172.21.15.72:0/1180264736 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa140b700 1 --2- 172.21.15.72:0/1180264736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba9c09e410 0x7fba9c11e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fba9bfff700 1 --2- 172.21.15.72:0/1180264736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9c09e000 0x7fba9c11e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa140b700 1 -- 172.21.15.72:0/1180264736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9c09d6f0 msgr2=0x7fba9c11df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa140b700 1 --2- 172.21.15.72:0/1180264736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9c09d6f0 0x7fba9c11df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa140b700 1 -- 172.21.15.72:0/1180264736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9c09e000 msgr2=0x7fba9c11e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa140b700 1 --2- 172.21.15.72:0/1180264736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9c09e000 0x7fba9c11e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa140b700 1 -- 172.21.15.72:0/1180264736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9000b7f0 con 0x7fba9c09e410 2023-10-03T10:16:06.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fbaa0c0a700 1 --2- 172.21.15.72:0/1180264736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9c09d6f0 0x7fba9c11df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.725+0000 7fba9bfff700 1 --2- 172.21.15.72:0/1180264736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9c09e000 0x7fba9c11e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.726+0000 7fbaa140b700 1 --2- 172.21.15.72:0/1180264736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba9c09e410 0x7fba9c11e9c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fba94009d90 tx=0x7fba9400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.726+0000 7fba997fa700 1 -- 172.21.15.72:0/1180264736 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94009c00 con 0x7fba9c09e410 2023-10-03T10:16:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.726+0000 7fba997fa700 1 -- 172.21.15.72:0/1180264736 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9400f040 con 0x7fba9c09e410 2023-10-03T10:16:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.726+0000 7fbaa2e6e700 1 -- 172.21.15.72:0/1180264736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba880094a0 con 0x7fba9c09e410 2023-10-03T10:16:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.726+0000 7fba997fa700 1 -- 172.21.15.72:0/1180264736 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94014480 con 0x7fba9c09e410 2023-10-03T10:16:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.726+0000 7fbaa2e6e700 1 -- 172.21.15.72:0/1180264736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9c0a16b0 con 0x7fba9c09e410 2023-10-03T10:16:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.727+0000 7fba997fa700 1 -- 172.21.15.72:0/1180264736 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba940145e0 con 0x7fba9c09e410 2023-10-03T10:16:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.727+0000 7fba997fa700 1 -- 172.21.15.72:0/1180264736 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fba94040250 con 0x7fba9c09e410 2023-10-03T10:16:06.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.727+0000 7fbaa2e6e700 1 -- 172.21.15.72:0/1180264736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9c11ac20 con 0x7fba9c09e410 2023-10-03T10:16:06.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.732+0000 7fba997fa700 1 -- 172.21.15.72:0/1180264736 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba94007900 con 0x7fba9c09e410 2023-10-03T10:16:06.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:06.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.886+0000 7f68309fe700 1 -- 172.21.15.72:0/905716077 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f682c074ea0 con 0x7f682c133e30 2023-10-03T10:16:06.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.886+0000 7f681affd700 1 -- 172.21.15.72:0/905716077 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6820015020 con 0x7f682c133e30 2023-10-03T10:16:06.887 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.888+0000 7f68309fe700 1 -- 172.21.15.72:0/905716077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f682c133e30 msgr2=0x7f682c09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.888+0000 7f68309fe700 1 --2- 172.21.15.72:0/905716077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f682c133e30 0x7f682c09c9c0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f6820016000 tx=0x7f6820004750 comp rx=0 tx=0).stop 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.888+0000 7f68309fe700 1 -- 172.21.15.72:0/905716077 shutdown_connections 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.888+0000 7f68309fe700 1 --2- 172.21.15.72:0/905716077 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f682c134260 0x7f682c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.888+0000 7f68309fe700 1 --2- 172.21.15.72:0/905716077 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f682c133420 0x7f682c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.888+0000 7f68309fe700 1 --2- 172.21.15.72:0/905716077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f682c133e30 0x7f682c09c9c0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.888+0000 7f68309fe700 1 -- 172.21.15.72:0/905716077 >> 172.21.15.72:0/905716077 conn(0x7f682c0a4210 msgr2=0x7f682c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.888+0000 7f68309fe700 1 -- 172.21.15.72:0/905716077 shutdown_connections 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.888+0000 7f68309fe700 1 -- 172.21.15.72:0/905716077 wait complete. 2023-10-03T10:16:06.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:06.901 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:06.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.927+0000 7fbaa2e6e700 1 -- 172.21.15.72:0/1180264736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fba9c074ea0 con 0x7fba9c09e410 2023-10-03T10:16:06.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.927+0000 7fba997fa700 1 -- 172.21.15.72:0/1180264736 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba9402c090 con 0x7fba9c09e410 2023-10-03T10:16:06.928 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:06.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.929+0000 7fbaa2e6e700 1 -- 172.21.15.72:0/1180264736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba9c09e410 msgr2=0x7fba9c11e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.929+0000 7fbaa2e6e700 1 --2- 172.21.15.72:0/1180264736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba9c09e410 0x7fba9c11e9c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fba94009d90 tx=0x7fba9400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.929+0000 7fbaa2e6e700 1 -- 172.21.15.72:0/1180264736 shutdown_connections 2023-10-03T10:16:06.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.929+0000 7fbaa2e6e700 1 --2- 172.21.15.72:0/1180264736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba9c09e410 0x7fba9c11e9c0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.929+0000 7fbaa2e6e700 1 --2- 172.21.15.72:0/1180264736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fba9c09d6f0 0x7fba9c11df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.929+0000 7fbaa2e6e700 1 --2- 172.21.15.72:0/1180264736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba9c09e000 0x7fba9c11e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.929+0000 7fbaa2e6e700 1 -- 172.21.15.72:0/1180264736 >> 172.21.15.72:0/1180264736 conn(0x7fba9c066f50 msgr2=0x7fba9c130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.929+0000 7fbaa2e6e700 1 -- 172.21.15.72:0/1180264736 shutdown_connections 2023-10-03T10:16:06.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:06.929+0000 7fbaa2e6e700 1 -- 172.21.15.72:0/1180264736 wait complete. 2023-10-03T10:16:06.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.022+0000 7f5a5ebe4700 1 Processor -- start 2023-10-03T10:16:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.022+0000 7f5a5ebe4700 1 -- start start 2023-10-03T10:16:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a5ebe4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a581337f0 0x7f5a58138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a5ebe4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a58138dc0 0x7f5a5813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a5ebe4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5806b990 con 0x7f5a58133420 2023-10-03T10:16:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a5ebe4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a5809b0e0 con 0x7f5a581337f0 2023-10-03T10:16:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a5ebe4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a58133c20 con 0x7f5a58138dc0 2023-10-03T10:16:07.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a57fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a581337f0 0x7f5a58138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a5d181700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a58138dc0 0x7f5a5813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a57fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a581337f0 0x7f5a58138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55020/0 (socket says 172.21.15.72:55020) 2023-10-03T10:16:07.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a5d181700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a58138dc0 0x7f5a5813b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49990/0 (socket says 172.21.15.72:49990) 2023-10-03T10:16:07.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a57fff700 1 -- 172.21.15.72:0/3954618996 learned_addr learned my addr 172.21.15.72:0/3954618996 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:07.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a5c980700 1 --1- 172.21.15.72:0/3954618996 >> v1:172.21.15.72:6789/0 conn(0x7f5a58133420 0x7f5a58133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35850/0 (socket says 172.21.15.72:35850) 2023-10-03T10:16:07.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a5d181700 1 -- 172.21.15.72:0/3954618996 >> v2:172.21.15.72:3300/0 conn(0x7f5a581337f0 msgr2=0x7f5a58138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:07.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a5d181700 1 --2- 172.21.15.72:0/3954618996 >> v2:172.21.15.72:3300/0 conn(0x7f5a581337f0 0x7f5a58138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a5d181700 1 -- 172.21.15.72:0/3954618996 >> v1:172.21.15.72:6789/0 conn(0x7f5a58133420 legacy=0x7f5a58133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a5d181700 1 -- 172.21.15.72:0/3954618996 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a580a0590 con 0x7f5a58138dc0 2023-10-03T10:16:07.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a57fff700 1 --2- 172.21.15.72:0/3954618996 >> v2:172.21.15.72:3300/0 conn(0x7f5a581337f0 0x7f5a58138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.023+0000 7f5a5d181700 1 --2- 172.21.15.72:0/3954618996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a58138dc0 0x7f5a5813b1a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009d90 tx=0x7f5a5000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6515e9cf6f30c4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.024+0000 7f5a577fe700 1 -- 172.21.15.72:0/3954618996 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5000e070 con 0x7f5a58138dc0 2023-10-03T10:16:07.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.024+0000 7f5a577fe700 1 -- 172.21.15.72:0/3954618996 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5000bb20 con 0x7f5a58138dc0 2023-10-03T10:16:07.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.024+0000 7f5a577fe700 1 -- 172.21.15.72:0/3954618996 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50012430 con 0x7f5a58138dc0 2023-10-03T10:16:07.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.024+0000 7f5a5ebe4700 1 -- 172.21.15.72:0/3954618996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a58138dc0 msgr2=0x7f5a5813b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.024+0000 7f5a5ebe4700 1 --2- 172.21.15.72:0/3954618996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a58138dc0 0x7f5a5813b1a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009d90 tx=0x7f5a5000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:07.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.024+0000 7f5a5ebe4700 1 -- 172.21.15.72:0/3954618996 shutdown_connections 2023-10-03T10:16:07.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.024+0000 7f5a5ebe4700 1 --2- 172.21.15.72:0/3954618996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a58138dc0 0x7f5a5813b1a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.024+0000 7f5a5ebe4700 1 --2- 172.21.15.72:0/3954618996 >> v2:172.21.15.72:3300/0 conn(0x7f5a581337f0 0x7f5a58138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.024+0000 7f5a5ebe4700 1 -- 172.21.15.72:0/3954618996 >> 172.21.15.72:0/3954618996 conn(0x7f5a580a4210 msgr2=0x7f5a580a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.024+0000 7f5a5ebe4700 1 -- 172.21.15.72:0/3954618996 shutdown_connections 2023-10-03T10:16:07.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.024+0000 7f5a5ebe4700 1 -- 172.21.15.72:0/3954618996 wait complete. 2023-10-03T10:16:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.025+0000 7f5a5ebe4700 1 Processor -- start 2023-10-03T10:16:07.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.025+0000 7f5a5ebe4700 1 -- start start 2023-10-03T10:16:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.025+0000 7f5a5ebe4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a58133420 0x7f5a5812f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a5ebe4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a581337f0 0x7f5a5812f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a5ebe4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a58138dc0 0x7f5a5812fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a5ebe4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a581304f0 con 0x7f5a581337f0 2023-10-03T10:16:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a5ebe4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5809c510 con 0x7f5a58138dc0 2023-10-03T10:16:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a5ebe4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5809c720 con 0x7f5a58133420 2023-10-03T10:16:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a5c980700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a58133420 0x7f5a5812f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a57fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a581337f0 0x7f5a5812f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a57fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a581337f0 0x7f5a5812f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55032/0 (socket says 172.21.15.72:55032) 2023-10-03T10:16:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a57fff700 1 -- 172.21.15.72:0/2785498864 learned_addr learned my addr 172.21.15.72:0/2785498864 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a5c980700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a58133420 0x7f5a5812f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50000/0 (socket says 172.21.15.72:50000) 2023-10-03T10:16:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a5d181700 1 --2- 172.21.15.72:0/2785498864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a58138dc0 0x7f5a5812fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a57fff700 1 -- 172.21.15.72:0/2785498864 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a58133420 msgr2=0x7f5a5812f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a57fff700 1 --2- 172.21.15.72:0/2785498864 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a58133420 0x7f5a5812f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a57fff700 1 -- 172.21.15.72:0/2785498864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a58138dc0 msgr2=0x7f5a5812fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a57fff700 1 --2- 172.21.15.72:0/2785498864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a58138dc0 0x7f5a5812fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a57fff700 1 -- 172.21.15.72:0/2785498864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a40009550 con 0x7f5a581337f0 2023-10-03T10:16:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a57fff700 1 --2- 172.21.15.72:0/2785498864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a581337f0 0x7f5a5812f5f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000ebe0 tx=0x7f5a4000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a557fa700 1 -- 172.21.15.72:0/2785498864 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4000c850 con 0x7f5a581337f0 2023-10-03T10:16:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a557fa700 1 -- 172.21.15.72:0/2785498864 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4000c9b0 con 0x7f5a581337f0 2023-10-03T10:16:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a5ebe4700 1 -- 172.21.15.72:0/2785498864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a50009a70 con 0x7f5a581337f0 2023-10-03T10:16:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a557fa700 1 -- 172.21.15.72:0/2785498864 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4000cd40 con 0x7f5a581337f0 2023-10-03T10:16:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.026+0000 7f5a5ebe4700 1 -- 172.21.15.72:0/2785498864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5809e130 con 0x7f5a581337f0 2023-10-03T10:16:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.027+0000 7f5a557fa700 1 -- 172.21.15.72:0/2785498864 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a40013470 con 0x7f5a581337f0 2023-10-03T10:16:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.027+0000 7f5a557fa700 1 -- 172.21.15.72:0/2785498864 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5a4003f8a0 con 0x7f5a581337f0 2023-10-03T10:16:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.027+0000 7f5a5ebe4700 1 -- 172.21.15.72:0/2785498864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a58074ea0 con 0x7f5a581337f0 2023-10-03T10:16:07.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.032+0000 7f5a557fa700 1 -- 172.21.15.72:0/2785498864 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a40017080 con 0x7f5a581337f0 2023-10-03T10:16:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.215+0000 7f5a5ebe4700 1 -- 172.21.15.72:0/2785498864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5a5806b250 con 0x7f5a581337f0 2023-10-03T10:16:07.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.215+0000 7f5a557fa700 1 -- 172.21.15.72:0/2785498864 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5a400232f0 con 0x7f5a581337f0 2023-10-03T10:16:07.216 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:07.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.217+0000 7f5a5ebe4700 1 -- 172.21.15.72:0/2785498864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a581337f0 msgr2=0x7f5a5812f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.217+0000 7f5a5ebe4700 1 --2- 172.21.15.72:0/2785498864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a581337f0 0x7f5a5812f5f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000ebe0 tx=0x7f5a4000eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.217+0000 7f5a5ebe4700 1 -- 172.21.15.72:0/2785498864 shutdown_connections 2023-10-03T10:16:07.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.217+0000 7f5a5ebe4700 1 --2- 172.21.15.72:0/2785498864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a58138dc0 0x7f5a5812fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.217+0000 7f5a5ebe4700 1 --2- 172.21.15.72:0/2785498864 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a58133420 0x7f5a5812f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.217+0000 7f5a5ebe4700 1 --2- 172.21.15.72:0/2785498864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a581337f0 0x7f5a5812f5f0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.217+0000 7f5a5ebe4700 1 -- 172.21.15.72:0/2785498864 >> 172.21.15.72:0/2785498864 conn(0x7f5a580a4210 msgr2=0x7f5a580a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.217+0000 7f5a5ebe4700 1 -- 172.21.15.72:0/2785498864 shutdown_connections 2023-10-03T10:16:07.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.217+0000 7f5a5ebe4700 1 -- 172.21.15.72:0/2785498864 wait complete. 2023-10-03T10:16:07.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:07.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:07.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.859+0000 7f59d9159700 1 Processor -- start 2023-10-03T10:16:07.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.859+0000 7f59d9159700 1 -- start start 2023-10-03T10:16:07.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.859+0000 7f59d9159700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59d409d6f0 0x7f59d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.859+0000 7f59d9159700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59d409e410 0x7f59d4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.859+0000 7f59d9159700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d409b120 con 0x7f59d409e000 2023-10-03T10:16:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.859+0000 7f59d9159700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d406b460 con 0x7f59d409e410 2023-10-03T10:16:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.859+0000 7f59d9159700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d409a7e0 con 0x7f59d409d6f0 2023-10-03T10:16:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.859+0000 7f59d2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59d409d6f0 0x7f59d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.859+0000 7f59d359e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59d409e410 0x7f59d4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.859+0000 7f59d2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59d409d6f0 0x7f59d409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35708/0 (socket says 172.21.15.72:35708) 2023-10-03T10:16:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.859+0000 7f59d359e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59d409e410 0x7f59d4134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55042/0 (socket says 172.21.15.72:55042) 2023-10-03T10:16:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.859+0000 7f59d2d9d700 1 -- 172.21.15.72:0/2572311530 learned_addr learned my addr 172.21.15.72:0/2572311530 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.860+0000 7f59d2d9d700 1 -- 172.21.15.72:0/2572311530 >> v2:172.21.15.72:3300/0 conn(0x7f59d409e410 msgr2=0x7f59d4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.860+0000 7f59d2d9d700 1 --2- 172.21.15.72:0/2572311530 >> v2:172.21.15.72:3300/0 conn(0x7f59d409e410 0x7f59d4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.860+0000 7f59d2d9d700 1 -- 172.21.15.72:0/2572311530 >> v1:172.21.15.72:6789/0 conn(0x7f59d409e000 legacy=0x7f59d41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.860+0000 7f59d2d9d700 1 -- 172.21.15.72:0/2572311530 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d409a500 con 0x7f59d409d6f0 2023-10-03T10:16:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.860+0000 7f59d359e700 1 --2- 172.21.15.72:0/2572311530 >> v2:172.21.15.72:3300/0 conn(0x7f59d409e410 0x7f59d4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.860+0000 7f59d2d9d700 1 --2- 172.21.15.72:0/2572311530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59d409d6f0 0x7f59d409dac0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009920 tx=0x7f59c4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35502559ec489400 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.860+0000 7f59d1d9b700 1 -- 172.21.15.72:0/2572311530 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4011830 con 0x7f59d409d6f0 2023-10-03T10:16:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.860+0000 7f59d1d9b700 1 -- 172.21.15.72:0/2572311530 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c4011990 con 0x7f59d409d6f0 2023-10-03T10:16:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.860+0000 7f59d1d9b700 1 -- 172.21.15.72:0/2572311530 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4011d20 con 0x7f59d409d6f0 2023-10-03T10:16:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.860+0000 7f59d9159700 1 -- 172.21.15.72:0/2572311530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59d409d6f0 msgr2=0x7f59d409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.860+0000 7f59d9159700 1 --2- 172.21.15.72:0/2572311530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59d409d6f0 0x7f59d409dac0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009920 tx=0x7f59c4009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.861+0000 7f59d9159700 1 -- 172.21.15.72:0/2572311530 shutdown_connections 2023-10-03T10:16:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.861+0000 7f59d9159700 1 --2- 172.21.15.72:0/2572311530 >> v2:172.21.15.72:3300/0 conn(0x7f59d409e410 0x7f59d4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.861+0000 7f59d9159700 1 --2- 172.21.15.72:0/2572311530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59d409d6f0 0x7f59d409dac0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.861+0000 7f59d9159700 1 -- 172.21.15.72:0/2572311530 >> 172.21.15.72:0/2572311530 conn(0x7f59d4066f50 msgr2=0x7f59d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.861+0000 7f59d9159700 1 -- 172.21.15.72:0/2572311530 shutdown_connections 2023-10-03T10:16:07.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.861+0000 7f59d9159700 1 -- 172.21.15.72:0/2572311530 wait complete. 2023-10-03T10:16:07.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.862+0000 7f59d9159700 1 Processor -- start 2023-10-03T10:16:07.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.862+0000 7f59d9159700 1 -- start start 2023-10-03T10:16:07.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.862+0000 7f59d9159700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d409d6f0 0x7f59d41a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.862+0000 7f59d9159700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59d409e000 0x7f59d41a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.862+0000 7f59d9159700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59d409e410 0x7f59d41a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.862+0000 7f59d9159700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d40a3480 con 0x7f59d409d6f0 2023-10-03T10:16:07.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.862+0000 7f59d9159700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d41a6b90 con 0x7f59d409e000 2023-10-03T10:16:07.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.862+0000 7f59d9159700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59d41a7d40 con 0x7f59d409e410 2023-10-03T10:16:07.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.862+0000 7f59d2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d409d6f0 0x7f59d41a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.862+0000 7f59d259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59d409e000 0x7f59d41a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.862+0000 7f59d2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d409d6f0 0x7f59d41a4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55048/0 (socket says 172.21.15.72:55048) 2023-10-03T10:16:07.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.862+0000 7f59d2d9d700 1 -- 172.21.15.72:0/3457581156 learned_addr learned my addr 172.21.15.72:0/3457581156 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:07.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.862+0000 7f59d359e700 1 --2- 172.21.15.72:0/3457581156 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59d409e410 0x7f59d41a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.863+0000 7f59d2d9d700 1 -- 172.21.15.72:0/3457581156 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59d409e410 msgr2=0x7f59d41a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.863+0000 7f59d2d9d700 1 --2- 172.21.15.72:0/3457581156 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59d409e410 0x7f59d41a5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.863+0000 7f59d2d9d700 1 -- 172.21.15.72:0/3457581156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59d409e000 msgr2=0x7f59d41a5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.863+0000 7f59d2d9d700 1 --2- 172.21.15.72:0/3457581156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59d409e000 0x7f59d41a5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.863+0000 7f59d2d9d700 1 -- 172.21.15.72:0/3457581156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc009a70 con 0x7f59d409d6f0 2023-10-03T10:16:07.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.863+0000 7f59d359e700 1 --2- 172.21.15.72:0/3457581156 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59d409e410 0x7f59d41a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.863+0000 7f59d259c700 1 --2- 172.21.15.72:0/3457581156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59d409e000 0x7f59d41a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.863+0000 7f59d2d9d700 1 --2- 172.21.15.72:0/3457581156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d409d6f0 0x7f59d41a4f00 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009870 tx=0x7f59c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.863+0000 7f59bb7fe700 1 -- 172.21.15.72:0/3457581156 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c40042c0 con 0x7f59d409d6f0 2023-10-03T10:16:07.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.863+0000 7f59bb7fe700 1 -- 172.21.15.72:0/3457581156 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c401f070 con 0x7f59d409d6f0 2023-10-03T10:16:07.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.863+0000 7f59bb7fe700 1 -- 172.21.15.72:0/3457581156 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c40036a0 con 0x7f59d409d6f0 2023-10-03T10:16:07.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.863+0000 7f59d9159700 1 -- 172.21.15.72:0/3457581156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c4009550 con 0x7f59d409d6f0 2023-10-03T10:16:07.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.863+0000 7f59d9159700 1 -- 172.21.15.72:0/3457581156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d409c760 con 0x7f59d409d6f0 2023-10-03T10:16:07.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.864+0000 7f59bb7fe700 1 -- 172.21.15.72:0/3457581156 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f59c4021030 con 0x7f59d409d6f0 2023-10-03T10:16:07.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.864+0000 7f59bb7fe700 1 -- 172.21.15.72:0/3457581156 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f59c4040860 con 0x7f59d409d6f0 2023-10-03T10:16:07.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.864+0000 7f59d9159700 1 -- 172.21.15.72:0/3457581156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d41a82d0 con 0x7f59d409d6f0 2023-10-03T10:16:07.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:07.869+0000 7f59bb7fe700 1 -- 172.21.15.72:0/3457581156 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59c4015080 con 0x7f59d409d6f0 2023-10-03T10:16:07.901 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:07.944 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.026+0000 7fd4a56bc700 1 Processor -- start 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.026+0000 7fd4a56bc700 1 -- start start 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd4a56bc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4a00a1510 0x7fd4a0138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd4a56bc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4a0139250 0x7fd4a013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd4a56bc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a009edd0 con 0x7fd4a00a0a30 2023-10-03T10:16:08.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd4a56bc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a00a18e0 con 0x7fd4a00a1510 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd4a56bc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a009e1f0 con 0x7fd4a0139250 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd49effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd4a00a0a30 0x7fd4a00a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35856/0 (socket says 172.21.15.72:35856) 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd49e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4a00a1510 0x7fd4a0138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd49effd700 1 -- 172.21.15.72:0/4177795599 learned_addr learned my addr 172.21.15.72:0/4177795599 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd49f7fe700 1 --2- 172.21.15.72:0/4177795599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4a0139250 0x7fd4a013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd49f7fe700 1 -- 172.21.15.72:0/4177795599 >> v2:172.21.15.72:3300/0 conn(0x7fd4a00a1510 msgr2=0x7fd4a0138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd49dffb700 1 -- 172.21.15.72:0/4177795599 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416327703 0 0) 0x7fd4a009edd0 con 0x7fd4a00a0a30 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd49f7fe700 1 --2- 172.21.15.72:0/4177795599 >> v2:172.21.15.72:3300/0 conn(0x7fd4a00a1510 0x7fd4a0138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd49f7fe700 1 -- 172.21.15.72:0/4177795599 >> v1:172.21.15.72:6789/0 conn(0x7fd4a00a0a30 legacy=0x7fd4a00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd49f7fe700 1 -- 172.21.15.72:0/4177795599 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a009dc50 con 0x7fd4a0139250 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd49e7fc700 1 --2- 172.21.15.72:0/4177795599 >> v2:172.21.15.72:3300/0 conn(0x7fd4a00a1510 0x7fd4a0138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd49f7fe700 1 --2- 172.21.15.72:0/4177795599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4a0139250 0x7fd4a013b630 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd498009d90 tx=0x7fd49800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5e50617465597a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.027+0000 7fd49dffb700 1 -- 172.21.15.72:0/4177795599 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49800e070 con 0x7fd4a0139250 2023-10-03T10:16:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.028+0000 7fd49dffb700 1 -- 172.21.15.72:0/4177795599 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49800bb20 con 0x7fd4a0139250 2023-10-03T10:16:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.028+0000 7fd49dffb700 1 -- 172.21.15.72:0/4177795599 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498012430 con 0x7fd4a0139250 2023-10-03T10:16:08.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.028+0000 7fd4a56bc700 1 -- 172.21.15.72:0/4177795599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4a0139250 msgr2=0x7fd4a013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.028+0000 7fd4a56bc700 1 --2- 172.21.15.72:0/4177795599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4a0139250 0x7fd4a013b630 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd498009d90 tx=0x7fd49800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:08.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.028+0000 7fd4a56bc700 1 -- 172.21.15.72:0/4177795599 shutdown_connections 2023-10-03T10:16:08.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.028+0000 7fd4a56bc700 1 --2- 172.21.15.72:0/4177795599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4a0139250 0x7fd4a013b630 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.028+0000 7fd4a56bc700 1 --2- 172.21.15.72:0/4177795599 >> v2:172.21.15.72:3300/0 conn(0x7fd4a00a1510 0x7fd4a0138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.028+0000 7fd4a56bc700 1 -- 172.21.15.72:0/4177795599 >> 172.21.15.72:0/4177795599 conn(0x7fd4a00a6550 msgr2=0x7fd4a00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.028+0000 7fd4a56bc700 1 -- 172.21.15.72:0/4177795599 shutdown_connections 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.028+0000 7fd4a56bc700 1 -- 172.21.15.72:0/4177795599 wait complete. 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.030+0000 7fd4a56bc700 1 Processor -- start 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.030+0000 7fd4a56bc700 1 -- start start 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.030+0000 7fd4a56bc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4a00a0a30 0x7fd4a011e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.030+0000 7fd4a56bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4a00a1510 0x7fd4a011eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.030+0000 7fd4a56bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4a0139250 0x7fd4a011f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.030+0000 7fd4a56bc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a01221f0 con 0x7fd4a00a1510 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.030+0000 7fd4a56bc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a01218e0 con 0x7fd4a0139250 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.030+0000 7fd4a56bc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00a5040 con 0x7fd4a00a0a30 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.030+0000 7fd49effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4a00a0a30 0x7fd4a011e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.030+0000 7fd49e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4a00a1510 0x7fd4a011eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.030+0000 7fd49effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4a00a0a30 0x7fd4a011e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50036/0 (socket says 172.21.15.72:50036) 2023-10-03T10:16:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.030+0000 7fd49e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4a00a1510 0x7fd4a011eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55066/0 (socket says 172.21.15.72:55066) 2023-10-03T10:16:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.031+0000 7fd49effd700 1 -- 172.21.15.72:0/3441437604 learned_addr learned my addr 172.21.15.72:0/3441437604 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.031+0000 7fd49f7fe700 1 --2- 172.21.15.72:0/3441437604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4a0139250 0x7fd4a011f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.031+0000 7fd49e7fc700 1 -- 172.21.15.72:0/3441437604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4a00a0a30 msgr2=0x7fd4a011e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.031+0000 7fd49e7fc700 1 --2- 172.21.15.72:0/3441437604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4a00a0a30 0x7fd4a011e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.031+0000 7fd49e7fc700 1 -- 172.21.15.72:0/3441437604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4a0139250 msgr2=0x7fd4a011f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.031+0000 7fd49e7fc700 1 --2- 172.21.15.72:0/3441437604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4a0139250 0x7fd4a011f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.031+0000 7fd49e7fc700 1 -- 172.21.15.72:0/3441437604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4940094a0 con 0x7fd4a00a1510 2023-10-03T10:16:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.031+0000 7fd49effd700 1 --2- 172.21.15.72:0/3441437604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4a00a0a30 0x7fd4a011e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.031+0000 7fd49e7fc700 1 --2- 172.21.15.72:0/3441437604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4a00a1510 0x7fd4a011eb70 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd49400e9e0 tx=0x7fd49400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.031+0000 7fd4877fe700 1 -- 172.21.15.72:0/3441437604 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49400ee80 con 0x7fd4a00a1510 2023-10-03T10:16:08.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.031+0000 7fd4877fe700 1 -- 172.21.15.72:0/3441437604 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49400c850 con 0x7fd4a00a1510 2023-10-03T10:16:08.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.031+0000 7fd4a56bc700 1 -- 172.21.15.72:0/3441437604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd498009a70 con 0x7fd4a00a1510 2023-10-03T10:16:08.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.031+0000 7fd4877fe700 1 -- 172.21.15.72:0/3441437604 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49400cc00 con 0x7fd4a00a1510 2023-10-03T10:16:08.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.031+0000 7fd4a56bc700 1 -- 172.21.15.72:0/3441437604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a0120a10 con 0x7fd4a00a1510 2023-10-03T10:16:08.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.032+0000 7fd4877fe700 1 -- 172.21.15.72:0/3441437604 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd49400cd60 con 0x7fd4a00a1510 2023-10-03T10:16:08.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.032+0000 7fd4a56bc700 1 -- 172.21.15.72:0/3441437604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a00a1d00 con 0x7fd4a00a1510 2023-10-03T10:16:08.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.032+0000 7fd4877fe700 1 -- 172.21.15.72:0/3441437604 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd49403fb10 con 0x7fd4a00a1510 2023-10-03T10:16:08.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.041+0000 7fd4877fe700 1 -- 172.21.15.72:0/3441437604 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd494011d80 con 0x7fd4a00a1510 2023-10-03T10:16:08.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.075+0000 7f404db45700 1 Processor -- start 2023-10-03T10:16:08.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.075+0000 7f404db45700 1 -- start start 2023-10-03T10:16:08.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f404db45700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f404806a770 0x7f404806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f404db45700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404806b080 0x7f4048131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f404db45700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404809ece0 con 0x7f4048131b40 2023-10-03T10:16:08.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f404db45700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404809e760 con 0x7f404806a770 2023-10-03T10:16:08.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f404db45700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404809e040 con 0x7f404806b080 2023-10-03T10:16:08.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f4046ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404806b080 0x7f4048131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f40477fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f404806a770 0x7f404806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f40477fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f404806a770 0x7f404806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55072/0 (socket says 172.21.15.72:55072) 2023-10-03T10:16:08.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f4046ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404806b080 0x7f4048131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:35722/0 (socket says 172.21.15.72:35722) 2023-10-03T10:16:08.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f40477fe700 1 -- 172.21.15.72:0/2483947994 learned_addr learned my addr 172.21.15.72:0/2483947994 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f4046ffd700 1 -- 172.21.15.72:0/2483947994 >> v2:172.21.15.72:3300/0 conn(0x7f404806a770 msgr2=0x7f404806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f4046ffd700 1 --2- 172.21.15.72:0/2483947994 >> v2:172.21.15.72:3300/0 conn(0x7f404806a770 0x7f404806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f4046ffd700 1 -- 172.21.15.72:0/2483947994 >> v1:172.21.15.72:6789/0 conn(0x7f4048131b40 legacy=0x7f4048138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f4046ffd700 1 -- 172.21.15.72:0/2483947994 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404809f630 con 0x7f404806b080 2023-10-03T10:16:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f40467fc700 1 -- 172.21.15.72:0/2483947994 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745278829 0 0) 0x7f404809ece0 con 0x7f4048131b40 2023-10-03T10:16:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f40477fe700 1 --2- 172.21.15.72:0/2483947994 >> v2:172.21.15.72:3300/0 conn(0x7f404806a770 0x7f404806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.076+0000 7f4046ffd700 1 --2- 172.21.15.72:0/2483947994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404806b080 0x7f4048131600 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f403c009840 tx=0x7f403c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=250852e0f6d1c153 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.077+0000 7f40467fc700 1 -- 172.21.15.72:0/2483947994 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c011830 con 0x7f404806b080 2023-10-03T10:16:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.077+0000 7f40467fc700 1 -- 172.21.15.72:0/2483947994 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c011990 con 0x7f404806b080 2023-10-03T10:16:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.077+0000 7f40467fc700 1 -- 172.21.15.72:0/2483947994 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c011d20 con 0x7f404806b080 2023-10-03T10:16:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.077+0000 7f404db45700 1 -- 172.21.15.72:0/2483947994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404806b080 msgr2=0x7f4048131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.077+0000 7f404db45700 1 --2- 172.21.15.72:0/2483947994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404806b080 0x7f4048131600 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f403c009840 tx=0x7f403c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.077+0000 7f404db45700 1 -- 172.21.15.72:0/2483947994 shutdown_connections 2023-10-03T10:16:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.077+0000 7f404db45700 1 --2- 172.21.15.72:0/2483947994 >> v2:172.21.15.72:3300/0 conn(0x7f404806a770 0x7f404806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.077+0000 7f404db45700 1 --2- 172.21.15.72:0/2483947994 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404806b080 0x7f4048131600 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.077+0000 7f404db45700 1 -- 172.21.15.72:0/2483947994 >> 172.21.15.72:0/2483947994 conn(0x7f4048066f50 msgr2=0x7f404809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.077+0000 7f404db45700 1 -- 172.21.15.72:0/2483947994 shutdown_connections 2023-10-03T10:16:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.077+0000 7f404db45700 1 -- 172.21.15.72:0/2483947994 wait complete. 2023-10-03T10:16:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.078+0000 7f404db45700 1 Processor -- start 2023-10-03T10:16:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.078+0000 7f404db45700 1 -- start start 2023-10-03T10:16:08.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f404db45700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404806a770 0x7f404811d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f404db45700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4048131b40 0x7f404811d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f404db45700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40481c6140 0x7f40481c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f404db45700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404811cc40 con 0x7f404806a770 2023-10-03T10:16:08.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f404db45700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4048071e60 con 0x7f4048131b40 2023-10-03T10:16:08.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f404db45700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f404811fce0 con 0x7f40481c6140 2023-10-03T10:16:08.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f40477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404806a770 0x7f404811d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f40477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404806a770 0x7f404811d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:55078/0 (socket says 172.21.15.72:55078) 2023-10-03T10:16:08.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f40477fe700 1 -- 172.21.15.72:0/2266154659 learned_addr learned my addr 172.21.15.72:0/2266154659 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:08.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f4047fff700 1 --2- 172.21.15.72:0/2266154659 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40481c6140 0x7f40481c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f4046ffd700 1 --2- 172.21.15.72:0/2266154659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4048131b40 0x7f404811d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f40477fe700 1 -- 172.21.15.72:0/2266154659 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40481c6140 msgr2=0x7f40481c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f40477fe700 1 --2- 172.21.15.72:0/2266154659 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40481c6140 0x7f40481c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f40477fe700 1 -- 172.21.15.72:0/2266154659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4048131b40 msgr2=0x7f404811d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f40477fe700 1 --2- 172.21.15.72:0/2266154659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4048131b40 0x7f404811d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f40477fe700 1 -- 172.21.15.72:0/2266154659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4038009550 con 0x7f404806a770 2023-10-03T10:16:08.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.079+0000 7f40477fe700 1 --2- 172.21.15.72:0/2266154659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404806a770 0x7f404811d0c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f403800ebe0 tx=0x7f403800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.080+0000 7f402ffff700 1 -- 172.21.15.72:0/2266154659 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403800c850 con 0x7f404806a770 2023-10-03T10:16:08.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.080+0000 7f402ffff700 1 -- 172.21.15.72:0/2266154659 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403800c9b0 con 0x7f404806a770 2023-10-03T10:16:08.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.080+0000 7f404db45700 1 -- 172.21.15.72:0/2266154659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403c0094a0 con 0x7f404806a770 2023-10-03T10:16:08.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.080+0000 7f402ffff700 1 -- 172.21.15.72:0/2266154659 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403800cd20 con 0x7f404806a770 2023-10-03T10:16:08.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.080+0000 7f404db45700 1 -- 172.21.15.72:0/2266154659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404811ffa0 con 0x7f404806a770 2023-10-03T10:16:08.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.080+0000 7f402ffff700 1 -- 172.21.15.72:0/2266154659 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4038013470 con 0x7f404806a770 2023-10-03T10:16:08.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.081+0000 7f402ffff700 1 -- 172.21.15.72:0/2266154659 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f403803f850 con 0x7f404806a770 2023-10-03T10:16:08.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.081+0000 7f404db45700 1 -- 172.21.15.72:0/2266154659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4048074ea0 con 0x7f404806a770 2023-10-03T10:16:08.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.083+0000 7f59d9159700 1 -- 172.21.15.72:0/3457581156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f59d41a89f0 con 0x7f59d409d6f0 2023-10-03T10:16:08.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.085+0000 7f59bb7fe700 1 -- 172.21.15.72:0/3457581156 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f59c40239c0 con 0x7f59d409d6f0 2023-10-03T10:16:08.086 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:08.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.085+0000 7f402ffff700 1 -- 172.21.15.72:0/2266154659 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40380232f0 con 0x7f404806a770 2023-10-03T10:16:08.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.087+0000 7f59d9159700 1 -- 172.21.15.72:0/3457581156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d409d6f0 msgr2=0x7f59d41a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.087+0000 7f59d9159700 1 --2- 172.21.15.72:0/3457581156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d409d6f0 0x7f59d41a4f00 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009870 tx=0x7f59c4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:08.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.087+0000 7f59d9159700 1 -- 172.21.15.72:0/3457581156 shutdown_connections 2023-10-03T10:16:08.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.087+0000 7f59d9159700 1 --2- 172.21.15.72:0/3457581156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d409d6f0 0x7f59d41a4f00 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.087+0000 7f59d9159700 1 --2- 172.21.15.72:0/3457581156 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59d409e410 0x7f59d41a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.087+0000 7f59d9159700 1 --2- 172.21.15.72:0/3457581156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59d409e000 0x7f59d41a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.087+0000 7f59d9159700 1 -- 172.21.15.72:0/3457581156 >> 172.21.15.72:0/3457581156 conn(0x7f59d4066f50 msgr2=0x7f59d41bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.087+0000 7f59d9159700 1 -- 172.21.15.72:0/3457581156 shutdown_connections 2023-10-03T10:16:08.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.087+0000 7f59d9159700 1 -- 172.21.15.72:0/3457581156 wait complete. 2023-10-03T10:16:08.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:08.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:08.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.233+0000 7fd4a56bc700 1 -- 172.21.15.72:0/3441437604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd4a0074ea0 con 0x7fd4a00a1510 2023-10-03T10:16:08.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.234+0000 7fd4877fe700 1 -- 172.21.15.72:0/3441437604 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd494021030 con 0x7fd4a00a1510 2023-10-03T10:16:08.234 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:08.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.236+0000 7fd4a56bc700 1 -- 172.21.15.72:0/3441437604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4a00a1510 msgr2=0x7fd4a011eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.236+0000 7fd4a56bc700 1 --2- 172.21.15.72:0/3441437604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4a00a1510 0x7fd4a011eb70 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd49400e9e0 tx=0x7fd49400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.236+0000 7fd4a56bc700 1 -- 172.21.15.72:0/3441437604 shutdown_connections 2023-10-03T10:16:08.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.236+0000 7fd4a56bc700 1 --2- 172.21.15.72:0/3441437604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4a0139250 0x7fd4a011f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.236+0000 7fd4a56bc700 1 --2- 172.21.15.72:0/3441437604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd4a00a0a30 0x7fd4a011e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.236+0000 7fd4a56bc700 1 --2- 172.21.15.72:0/3441437604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4a00a1510 0x7fd4a011eb70 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.236+0000 7fd4a56bc700 1 -- 172.21.15.72:0/3441437604 >> 172.21.15.72:0/3441437604 conn(0x7fd4a00a6550 msgr2=0x7fd4a00a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.236+0000 7fd4a56bc700 1 -- 172.21.15.72:0/3441437604 shutdown_connections 2023-10-03T10:16:08.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.236+0000 7fd4a56bc700 1 -- 172.21.15.72:0/3441437604 wait complete. 2023-10-03T10:16:08.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:08.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.277+0000 7f404db45700 1 -- 172.21.15.72:0/2266154659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f404811e370 con 0x7f404806a770 2023-10-03T10:16:08.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.277+0000 7f402ffff700 1 -- 172.21.15.72:0/2266154659 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4038021020 con 0x7f404806a770 2023-10-03T10:16:08.278 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:08.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.279+0000 7f404db45700 1 -- 172.21.15.72:0/2266154659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404806a770 msgr2=0x7f404811d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.279+0000 7f404db45700 1 --2- 172.21.15.72:0/2266154659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404806a770 0x7f404811d0c0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f403800ebe0 tx=0x7f403800eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.279+0000 7f404db45700 1 -- 172.21.15.72:0/2266154659 shutdown_connections 2023-10-03T10:16:08.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.279+0000 7f404db45700 1 --2- 172.21.15.72:0/2266154659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404806a770 0x7f404811d0c0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.279+0000 7f404db45700 1 --2- 172.21.15.72:0/2266154659 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40481c6140 0x7f40481c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.279+0000 7f404db45700 1 --2- 172.21.15.72:0/2266154659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4048131b40 0x7f404811d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.279+0000 7f404db45700 1 -- 172.21.15.72:0/2266154659 >> 172.21.15.72:0/2266154659 conn(0x7f4048066f50 msgr2=0x7f40480a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.280+0000 7f404db45700 1 -- 172.21.15.72:0/2266154659 shutdown_connections 2023-10-03T10:16:08.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.280+0000 7f404db45700 1 -- 172.21.15.72:0/2266154659 wait complete. 2023-10-03T10:16:08.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:08.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.356+0000 7f43a5805700 1 Processor -- start 2023-10-03T10:16:08.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.356+0000 7f43a5805700 1 -- start start 2023-10-03T10:16:08.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f43a5805700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a009d6f0 0x7f43a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f43a5805700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a009e000 0x7f43a01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f43a5805700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a009b120 con 0x7f43a009e410 2023-10-03T10:16:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f43a5805700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a006b460 con 0x7f43a009e000 2023-10-03T10:16:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f43a5805700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43a009a7e0 con 0x7f43a009d6f0 2023-10-03T10:16:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f439effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a009d6f0 0x7f43a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f439e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a009e000 0x7f43a01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f439f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f43a009e410 0x7f43a0133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59944/0 (socket says 172.21.15.72:59944) 2023-10-03T10:16:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f439f7fe700 1 -- 172.21.15.72:0/1357521891 learned_addr learned my addr 172.21.15.72:0/1357521891 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f439effd700 1 -- 172.21.15.72:0/1357521891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a009e000 msgr2=0x7f43a01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f439dffb700 1 -- 172.21.15.72:0/1357521891 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488011048 0 0) 0x7f43a009b120 con 0x7f43a009e410 2023-10-03T10:16:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f439effd700 1 --2- 172.21.15.72:0/1357521891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a009e000 0x7f43a01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f439effd700 1 -- 172.21.15.72:0/1357521891 >> v1:172.21.15.72:6789/0 conn(0x7f43a009e410 legacy=0x7f43a0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f439effd700 1 -- 172.21.15.72:0/1357521891 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a009a500 con 0x7f43a009d6f0 2023-10-03T10:16:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f439e7fc700 1 --2- 172.21.15.72:0/1357521891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a009e000 0x7f43a01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f439effd700 1 --2- 172.21.15.72:0/1357521891 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a009d6f0 0x7f43a009dac0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f43940098a0 tx=0x7f4394009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2371d8c980d86e67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f439dffb700 1 -- 172.21.15.72:0/1357521891 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394011830 con 0x7f43a009d6f0 2023-10-03T10:16:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f439dffb700 1 -- 172.21.15.72:0/1357521891 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4394011990 con 0x7f43a009d6f0 2023-10-03T10:16:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.357+0000 7f439dffb700 1 -- 172.21.15.72:0/1357521891 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394011d20 con 0x7f43a009d6f0 2023-10-03T10:16:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.358+0000 7f43a5805700 1 -- 172.21.15.72:0/1357521891 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a009d6f0 msgr2=0x7f43a009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.358+0000 7f43a5805700 1 --2- 172.21.15.72:0/1357521891 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a009d6f0 0x7f43a009dac0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f43940098a0 tx=0x7f4394009bb0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.358+0000 7f43a5805700 1 -- 172.21.15.72:0/1357521891 shutdown_connections 2023-10-03T10:16:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.358+0000 7f43a5805700 1 --2- 172.21.15.72:0/1357521891 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a009d6f0 0x7f43a009dac0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.358+0000 7f43a5805700 1 --2- 172.21.15.72:0/1357521891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a009e000 0x7f43a01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.358+0000 7f43a5805700 1 -- 172.21.15.72:0/1357521891 >> 172.21.15.72:0/1357521891 conn(0x7f43a0066f50 msgr2=0x7f43a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.358+0000 7f43a5805700 1 -- 172.21.15.72:0/1357521891 shutdown_connections 2023-10-03T10:16:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.358+0000 7f43a5805700 1 -- 172.21.15.72:0/1357521891 wait complete. 2023-10-03T10:16:08.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.359+0000 7f43a5805700 1 Processor -- start 2023-10-03T10:16:08.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.359+0000 7f43a5805700 1 -- start start 2023-10-03T10:16:08.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.359+0000 7f43a5805700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a009d6f0 0x7f43a01c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.359+0000 7f43a5805700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a009e000 0x7f43a01c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.359+0000 7f43a5805700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a009e410 0x7f43a01c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.359+0000 7f43a5805700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a01a72e0 con 0x7f43a009d6f0 2023-10-03T10:16:08.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.359+0000 7f43a5805700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a01c5ad0 con 0x7f43a009e000 2023-10-03T10:16:08.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.359+0000 7f43a5805700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43a01a9820 con 0x7f43a009e410 2023-10-03T10:16:08.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f439effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a009d6f0 0x7f43a01c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f439effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a009d6f0 0x7f43a01c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35562/0 (socket says 172.21.15.72:35562) 2023-10-03T10:16:08.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f439effd700 1 -- 172.21.15.72:0/2700227185 learned_addr learned my addr 172.21.15.72:0/2700227185 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:08.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f439e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a009e000 0x7f43a01c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f439f7fe700 1 --2- 172.21.15.72:0/2700227185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a009e410 0x7f43a01c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f439effd700 1 -- 172.21.15.72:0/2700227185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a009e410 msgr2=0x7f43a01c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f439effd700 1 --2- 172.21.15.72:0/2700227185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a009e410 0x7f43a01c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f439effd700 1 -- 172.21.15.72:0/2700227185 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a009e000 msgr2=0x7f43a01c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f439effd700 1 --2- 172.21.15.72:0/2700227185 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a009e000 0x7f43a01c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f439effd700 1 -- 172.21.15.72:0/2700227185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43900094a0 con 0x7f43a009d6f0 2023-10-03T10:16:08.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f439e7fc700 1 --2- 172.21.15.72:0/2700227185 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a009e000 0x7f43a01c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f439effd700 1 --2- 172.21.15.72:0/2700227185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a009d6f0 0x7f43a01c5050 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f4394000c00 tx=0x7f4394004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f4387fff700 1 -- 172.21.15.72:0/2700227185 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394004450 con 0x7f43a009d6f0 2023-10-03T10:16:08.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f4387fff700 1 -- 172.21.15.72:0/2700227185 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439401f070 con 0x7f43a009d6f0 2023-10-03T10:16:08.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f43a5805700 1 -- 172.21.15.72:0/2700227185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43940094a0 con 0x7f43a009d6f0 2023-10-03T10:16:08.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f4387fff700 1 -- 172.21.15.72:0/2700227185 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43940038e0 con 0x7f43a009d6f0 2023-10-03T10:16:08.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.360+0000 7f43a5805700 1 -- 172.21.15.72:0/2700227185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a01a8b60 con 0x7f43a009d6f0 2023-10-03T10:16:08.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.361+0000 7f4387fff700 1 -- 172.21.15.72:0/2700227185 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4394003a40 con 0x7f43a009d6f0 2023-10-03T10:16:08.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.361+0000 7f43a5805700 1 -- 172.21.15.72:0/2700227185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a01a79d0 con 0x7f43a009d6f0 2023-10-03T10:16:08.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.361+0000 7f4387fff700 1 -- 172.21.15.72:0/2700227185 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4394021070 con 0x7f43a009d6f0 2023-10-03T10:16:08.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.366+0000 7f4387fff700 1 -- 172.21.15.72:0/2700227185 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43940045b0 con 0x7f43a009d6f0 2023-10-03T10:16:08.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.549+0000 7f43a5805700 1 -- 172.21.15.72:0/2700227185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f43a0074ea0 con 0x7f43a009d6f0 2023-10-03T10:16:08.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.550+0000 7f4387fff700 1 -- 172.21.15.72:0/2700227185 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4394015020 con 0x7f43a009d6f0 2023-10-03T10:16:08.550 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:08.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.552+0000 7f43a5805700 1 -- 172.21.15.72:0/2700227185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a009d6f0 msgr2=0x7f43a01c5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.552+0000 7f43a5805700 1 --2- 172.21.15.72:0/2700227185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a009d6f0 0x7f43a01c5050 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f4394000c00 tx=0x7f4394004750 comp rx=0 tx=0).stop 2023-10-03T10:16:08.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.552+0000 7f43a5805700 1 -- 172.21.15.72:0/2700227185 shutdown_connections 2023-10-03T10:16:08.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.552+0000 7f43a5805700 1 --2- 172.21.15.72:0/2700227185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a009d6f0 0x7f43a01c5050 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.552+0000 7f43a5805700 1 --2- 172.21.15.72:0/2700227185 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a009e410 0x7f43a01c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.552+0000 7f43a5805700 1 --2- 172.21.15.72:0/2700227185 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a009e000 0x7f43a01c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.552+0000 7f43a5805700 1 -- 172.21.15.72:0/2700227185 >> 172.21.15.72:0/2700227185 conn(0x7f43a0066f50 msgr2=0x7f43a01bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.552+0000 7f43a5805700 1 -- 172.21.15.72:0/2700227185 shutdown_connections 2023-10-03T10:16:08.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:08.552+0000 7f43a5805700 1 -- 172.21.15.72:0/2700227185 wait complete. 2023-10-03T10:16:08.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:09.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:09.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.224+0000 7fd10649f700 1 Processor -- start 2023-10-03T10:16:09.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.224+0000 7fd10649f700 1 -- start start 2023-10-03T10:16:09.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.224+0000 7fd10649f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd100134630 0x7fd100136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.224+0000 7fd10649f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd100136f50 0x7fd100139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.224+0000 7fd10649f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10009b4f0 con 0x7fd100131810 2023-10-03T10:16:09.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.224+0000 7fd10649f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1001313c0 con 0x7fd100136f50 2023-10-03T10:16:09.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.224+0000 7fd10649f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10006e8c0 con 0x7fd100134630 2023-10-03T10:16:09.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.225+0000 7fd0ff7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd100134630 0x7fd100136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.225+0000 7fd104a3c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd100136f50 0x7fd100139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.225+0000 7fd104a3c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd100136f50 0x7fd100139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35566/0 (socket says 172.21.15.72:35566) 2023-10-03T10:16:09.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.225+0000 7fd0ff7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd100134630 0x7fd100136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46488/0 (socket says 172.21.15.72:46488) 2023-10-03T10:16:09.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.225+0000 7fd104a3c700 1 -- 172.21.15.72:0/4225193068 learned_addr learned my addr 172.21.15.72:0/4225193068 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:09.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.225+0000 7fd0ff7fe700 1 -- 172.21.15.72:0/4225193068 >> v2:172.21.15.72:3300/0 conn(0x7fd100136f50 msgr2=0x7fd100139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.225+0000 7fd0ff7fe700 1 --2- 172.21.15.72:0/4225193068 >> v2:172.21.15.72:3300/0 conn(0x7fd100136f50 0x7fd100139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.225+0000 7fd0ff7fe700 1 -- 172.21.15.72:0/4225193068 >> v1:172.21.15.72:6789/0 conn(0x7fd100131810 legacy=0x7fd100131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.225+0000 7fd0ff7fe700 1 -- 172.21.15.72:0/4225193068 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd100071d20 con 0x7fd100134630 2023-10-03T10:16:09.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.225+0000 7fd104a3c700 1 --2- 172.21.15.72:0/4225193068 >> v2:172.21.15.72:3300/0 conn(0x7fd100136f50 0x7fd100139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.225+0000 7fd0ff7fe700 1 --2- 172.21.15.72:0/4225193068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd100134630 0x7fd100136a10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0009840 tx=0x7fd0f0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc4f326615b2258b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.225+0000 7fd0feffd700 1 -- 172.21.15.72:0/4225193068 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0011830 con 0x7fd100134630 2023-10-03T10:16:09.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.225+0000 7fd0feffd700 1 -- 172.21.15.72:0/4225193068 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0011990 con 0x7fd100134630 2023-10-03T10:16:09.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.225+0000 7fd0feffd700 1 -- 172.21.15.72:0/4225193068 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0011d20 con 0x7fd100134630 2023-10-03T10:16:09.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.226+0000 7fd10649f700 1 -- 172.21.15.72:0/4225193068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd100134630 msgr2=0x7fd100136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.226+0000 7fd10649f700 1 --2- 172.21.15.72:0/4225193068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd100134630 0x7fd100136a10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0009840 tx=0x7fd0f0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:09.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.226+0000 7fd10649f700 1 -- 172.21.15.72:0/4225193068 shutdown_connections 2023-10-03T10:16:09.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.226+0000 7fd10649f700 1 --2- 172.21.15.72:0/4225193068 >> v2:172.21.15.72:3300/0 conn(0x7fd100136f50 0x7fd100139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.226+0000 7fd10649f700 1 --2- 172.21.15.72:0/4225193068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd100134630 0x7fd100136a10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.226+0000 7fd10649f700 1 -- 172.21.15.72:0/4225193068 >> 172.21.15.72:0/4225193068 conn(0x7fd1000a2aa0 msgr2=0x7fd1000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.226+0000 7fd10649f700 1 -- 172.21.15.72:0/4225193068 shutdown_connections 2023-10-03T10:16:09.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.226+0000 7fd10649f700 1 -- 172.21.15.72:0/4225193068 wait complete. 2023-10-03T10:16:09.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.227+0000 7fd10649f700 1 Processor -- start 2023-10-03T10:16:09.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.227+0000 7fd10649f700 1 -- start start 2023-10-03T10:16:09.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.227+0000 7fd10649f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd100131810 0x7fd1001c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.227+0000 7fd10649f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd100134630 0x7fd1001c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.227+0000 7fd10649f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd100136f50 0x7fd100118d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.227+0000 7fd10649f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10011c270 con 0x7fd100134630 2023-10-03T10:16:09.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.227+0000 7fd10649f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1001bc030 con 0x7fd100131810 2023-10-03T10:16:09.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.227+0000 7fd10649f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd10012ebc0 con 0x7fd100136f50 2023-10-03T10:16:09.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.227+0000 7fd0ff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd100134630 0x7fd1001c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.227+0000 7fd0fffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd100131810 0x7fd1001c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.227+0000 7fd104a3c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd100136f50 0x7fd100118d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.227+0000 7fd0fffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd100131810 0x7fd1001c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46502/0 (socket says 172.21.15.72:46502) 2023-10-03T10:16:09.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.227+0000 7fd0ff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd100134630 0x7fd1001c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35572/0 (socket says 172.21.15.72:35572) 2023-10-03T10:16:09.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.227+0000 7fd0fffff700 1 -- 172.21.15.72:0/375881231 learned_addr learned my addr 172.21.15.72:0/375881231 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:09.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.228+0000 7fd0fffff700 1 -- 172.21.15.72:0/375881231 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd100136f50 msgr2=0x7fd100118d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.228+0000 7fd0fffff700 1 --2- 172.21.15.72:0/375881231 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd100136f50 0x7fd100118d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.228+0000 7fd0fffff700 1 -- 172.21.15.72:0/375881231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd100134630 msgr2=0x7fd1001c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.228+0000 7fd0fffff700 1 --2- 172.21.15.72:0/375881231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd100134630 0x7fd1001c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.228+0000 7fd0fffff700 1 -- 172.21.15.72:0/375881231 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f8009b30 con 0x7fd100131810 2023-10-03T10:16:09.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.228+0000 7fd0fffff700 1 --2- 172.21.15.72:0/375881231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd100131810 0x7fd1001c6360 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400c450 tx=0x7fd0f400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.228+0000 7fd0fcff9700 1 -- 172.21.15.72:0/375881231 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40052d0 con 0x7fd100131810 2023-10-03T10:16:09.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.228+0000 7fd0fcff9700 1 -- 172.21.15.72:0/375881231 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f4005430 con 0x7fd100131810 2023-10-03T10:16:09.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.228+0000 7fd0fcff9700 1 -- 172.21.15.72:0/375881231 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40038c0 con 0x7fd100131810 2023-10-03T10:16:09.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.228+0000 7fd10649f700 1 -- 172.21.15.72:0/375881231 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f00094a0 con 0x7fd100131810 2023-10-03T10:16:09.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.228+0000 7fd10649f700 1 -- 172.21.15.72:0/375881231 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10011cfa0 con 0x7fd100131810 2023-10-03T10:16:09.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.229+0000 7fd0fcff9700 1 -- 172.21.15.72:0/375881231 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd0f4003a20 con 0x7fd100131810 2023-10-03T10:16:09.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.229+0000 7fd0fcff9700 1 -- 172.21.15.72:0/375881231 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd0f403eb20 con 0x7fd100131810 2023-10-03T10:16:09.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.229+0000 7fd10649f700 1 -- 172.21.15.72:0/375881231 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd100074ea0 con 0x7fd100131810 2023-10-03T10:16:09.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.233+0000 7fd0fcff9700 1 -- 172.21.15.72:0/375881231 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd0f4017030 con 0x7fd100131810 2023-10-03T10:16:09.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:09.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:09.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.376+0000 7ff97c6b9700 1 Processor -- start 2023-10-03T10:16:09.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.376+0000 7ff97c6b9700 1 -- start start 2023-10-03T10:16:09.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.376+0000 7ff97c6b9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff97409f410 0x7ff974136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.376+0000 7ff97c6b9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff974136fe0 0x7ff9741393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.376+0000 7ff97c6b9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff974070940 con 0x7ff97409e930 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.376+0000 7ff97c6b9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97406fd60 con 0x7ff97409f410 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.376+0000 7ff97c6b9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97406fa80 con 0x7ff974136fe0 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.376+0000 7ff979c54700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff97409f410 0x7ff974136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.376+0000 7ff97ac56700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff974136fe0 0x7ff9741393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.376+0000 7ff97ac56700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff974136fe0 0x7ff9741393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46506/0 (socket says 172.21.15.72:46506) 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.376+0000 7ff979c54700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff97409f410 0x7ff974136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35576/0 (socket says 172.21.15.72:35576) 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.376+0000 7ff97ac56700 1 -- 172.21.15.72:0/289323490 learned_addr learned my addr 172.21.15.72:0/289323490 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.377+0000 7ff97ac56700 1 -- 172.21.15.72:0/289323490 >> v2:172.21.15.72:3300/0 conn(0x7ff97409f410 msgr2=0x7ff974136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.377+0000 7ff97ac56700 1 --2- 172.21.15.72:0/289323490 >> v2:172.21.15.72:3300/0 conn(0x7ff97409f410 0x7ff974136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.377+0000 7ff97ac56700 1 -- 172.21.15.72:0/289323490 >> v1:172.21.15.72:6789/0 conn(0x7ff97409e930 legacy=0x7ff97409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.377+0000 7ff97ac56700 1 -- 172.21.15.72:0/289323490 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97409fb60 con 0x7ff974136fe0 2023-10-03T10:16:09.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.377+0000 7ff97ac56700 1 --2- 172.21.15.72:0/289323490 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff974136fe0 0x7ff9741393c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009e50 tx=0x7ff96c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cde8fc7fbe9a98c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.377+0000 7ff979453700 1 -- 172.21.15.72:0/289323490 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c00e070 con 0x7ff974136fe0 2023-10-03T10:16:09.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.377+0000 7ff979453700 1 -- 172.21.15.72:0/289323490 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c00b910 con 0x7ff974136fe0 2023-10-03T10:16:09.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.377+0000 7ff979453700 1 -- 172.21.15.72:0/289323490 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c00bcc0 con 0x7ff974136fe0 2023-10-03T10:16:09.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.378+0000 7ff97c6b9700 1 -- 172.21.15.72:0/289323490 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff974136fe0 msgr2=0x7ff9741393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.378+0000 7ff97c6b9700 1 --2- 172.21.15.72:0/289323490 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff974136fe0 0x7ff9741393c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009e50 tx=0x7ff96c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:09.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.378+0000 7ff97c6b9700 1 -- 172.21.15.72:0/289323490 shutdown_connections 2023-10-03T10:16:09.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.378+0000 7ff97c6b9700 1 --2- 172.21.15.72:0/289323490 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff974136fe0 0x7ff9741393c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.378+0000 7ff97c6b9700 1 --2- 172.21.15.72:0/289323490 >> v2:172.21.15.72:3300/0 conn(0x7ff97409f410 0x7ff974136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.378+0000 7ff97c6b9700 1 -- 172.21.15.72:0/289323490 >> 172.21.15.72:0/289323490 conn(0x7ff9740a4210 msgr2=0x7ff9740a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.378+0000 7ff97c6b9700 1 -- 172.21.15.72:0/289323490 shutdown_connections 2023-10-03T10:16:09.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.378+0000 7ff97c6b9700 1 -- 172.21.15.72:0/289323490 wait complete. 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.379+0000 7ff97c6b9700 1 Processor -- start 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.379+0000 7ff97c6b9700 1 -- start start 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.379+0000 7ff97c6b9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff97409e930 0x7ff97411c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.379+0000 7ff97c6b9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff97409f410 0x7ff97411ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.379+0000 7ff97c6b9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff974136fe0 0x7ff97411cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.379+0000 7ff97c6b9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff974071db0 con 0x7ff97409e930 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.379+0000 7ff97c6b9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9740a33f0 con 0x7ff974136fe0 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.379+0000 7ff97c6b9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff97411f820 con 0x7ff97409f410 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.379+0000 7ff979c54700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff97409f410 0x7ff97411ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.379+0000 7ff97a455700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff97409e930 0x7ff97411c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.379+0000 7ff979c54700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff97409f410 0x7ff97411ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51872/0 (socket says 172.21.15.72:51872) 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.379+0000 7ff979c54700 1 -- 172.21.15.72:0/2046509260 learned_addr learned my addr 172.21.15.72:0/2046509260 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.379+0000 7ff97ac56700 1 --2- 172.21.15.72:0/2046509260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff974136fe0 0x7ff97411cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.380+0000 7ff979c54700 1 -- 172.21.15.72:0/2046509260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff974136fe0 msgr2=0x7ff97411cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.380+0000 7ff979c54700 1 --2- 172.21.15.72:0/2046509260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff974136fe0 0x7ff97411cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.380+0000 7ff979c54700 1 -- 172.21.15.72:0/2046509260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff97409e930 msgr2=0x7ff97411c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.380+0000 7ff979c54700 1 --2- 172.21.15.72:0/2046509260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff97409e930 0x7ff97411c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.380+0000 7ff979c54700 1 -- 172.21.15.72:0/2046509260 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c009b30 con 0x7ff97409f410 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.380+0000 7ff97ac56700 1 --2- 172.21.15.72:0/2046509260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff974136fe0 0x7ff97411cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.380+0000 7ff97a455700 1 --2- 172.21.15.72:0/2046509260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff97409e930 0x7ff97411c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.380+0000 7ff979c54700 1 --2- 172.21.15.72:0/2046509260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff97409f410 0x7ff97411ca90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff96400e9e0 tx=0x7ff96400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.380+0000 7ff96affd700 1 -- 172.21.15.72:0/2046509260 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964009710 con 0x7ff97409f410 2023-10-03T10:16:09.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.380+0000 7ff96affd700 1 -- 172.21.15.72:0/2046509260 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96400ee80 con 0x7ff97409f410 2023-10-03T10:16:09.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.380+0000 7ff97c6b9700 1 -- 172.21.15.72:0/2046509260 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97411e9c0 con 0x7ff97409f410 2023-10-03T10:16:09.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.380+0000 7ff96affd700 1 -- 172.21.15.72:0/2046509260 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964013a60 con 0x7ff97409f410 2023-10-03T10:16:09.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.380+0000 7ff97c6b9700 1 -- 172.21.15.72:0/2046509260 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff974120800 con 0x7ff97409f410 2023-10-03T10:16:09.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.381+0000 7ff96affd700 1 -- 172.21.15.72:0/2046509260 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff964013bc0 con 0x7ff97409f410 2023-10-03T10:16:09.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.381+0000 7ff97c6b9700 1 -- 172.21.15.72:0/2046509260 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff974074ea0 con 0x7ff97409f410 2023-10-03T10:16:09.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.381+0000 7ff96affd700 1 -- 172.21.15.72:0/2046509260 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff964043500 con 0x7ff97409f410 2023-10-03T10:16:09.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.386+0000 7ff96affd700 1 -- 172.21.15.72:0/2046509260 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff964020020 con 0x7ff97409f410 2023-10-03T10:16:09.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.418+0000 7f3b189d0700 1 Processor -- start 2023-10-03T10:16:09.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.418+0000 7f3b189d0700 1 -- start start 2023-10-03T10:16:09.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.419+0000 7f3b189d0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b140a0a30 0x7f3b140a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.419+0000 7f3b189d0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3b14134170 0x7f3b1413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.419+0000 7f3b189d0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1409edd0 con 0x7f3b140a1340 2023-10-03T10:16:09.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.419+0000 7f3b189d0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1409e1f0 con 0x7f3b14134170 2023-10-03T10:16:09.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.419+0000 7f3b189d0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1409dc50 con 0x7f3b140a0a30 2023-10-03T10:16:09.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.419+0000 7f3b1259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b140a0a30 0x7f3b140a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.419+0000 7f3b1259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b140a0a30 0x7f3b140a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46532/0 (socket says 172.21.15.72:46532) 2023-10-03T10:16:09.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.419+0000 7f3b1259c700 1 -- 172.21.15.72:0/3079561218 learned_addr learned my addr 172.21.15.72:0/3079561218 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:09.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.419+0000 7f3b11d9b700 1 --1- 172.21.15.72:0/3079561218 >> v1:172.21.15.72:6789/0 conn(0x7f3b140a1340 0x7f3b14133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59960/0 (socket says 172.21.15.72:59960) 2023-10-03T10:16:09.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.419+0000 7f3b12d9d700 1 --2- 172.21.15.72:0/3079561218 >> v2:172.21.15.72:3300/0 conn(0x7f3b14134170 0x7f3b1413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.420+0000 7f3b1259c700 1 -- 172.21.15.72:0/3079561218 >> v2:172.21.15.72:3300/0 conn(0x7f3b14134170 msgr2=0x7f3b1413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.420+0000 7f3b1259c700 1 --2- 172.21.15.72:0/3079561218 >> v2:172.21.15.72:3300/0 conn(0x7f3b14134170 0x7f3b1413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.420+0000 7f3b1259c700 1 -- 172.21.15.72:0/3079561218 >> v1:172.21.15.72:6789/0 conn(0x7f3b140a1340 legacy=0x7f3b14133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.420+0000 7f3b1259c700 1 -- 172.21.15.72:0/3079561218 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b140a1fe0 con 0x7f3b140a0a30 2023-10-03T10:16:09.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.420+0000 7f3b1259c700 1 --2- 172.21.15.72:0/3079561218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b140a0a30 0x7f3b140a0e00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3b040098f0 tx=0x7f3b04009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97089c6290860270 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.420+0000 7f3b1159a700 1 -- 172.21.15.72:0/3079561218 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04011830 con 0x7f3b140a0a30 2023-10-03T10:16:09.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.420+0000 7f3b1159a700 1 -- 172.21.15.72:0/3079561218 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b04011990 con 0x7f3b140a0a30 2023-10-03T10:16:09.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.420+0000 7f3b1159a700 1 -- 172.21.15.72:0/3079561218 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04011d20 con 0x7f3b140a0a30 2023-10-03T10:16:09.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.420+0000 7f3b189d0700 1 -- 172.21.15.72:0/3079561218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b140a0a30 msgr2=0x7f3b140a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.420+0000 7f3b189d0700 1 --2- 172.21.15.72:0/3079561218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b140a0a30 0x7f3b140a0e00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3b040098f0 tx=0x7f3b04009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.420+0000 7f3b189d0700 1 -- 172.21.15.72:0/3079561218 shutdown_connections 2023-10-03T10:16:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.420+0000 7f3b189d0700 1 --2- 172.21.15.72:0/3079561218 >> v2:172.21.15.72:3300/0 conn(0x7f3b14134170 0x7f3b1413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.420+0000 7f3b189d0700 1 --2- 172.21.15.72:0/3079561218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b140a0a30 0x7f3b140a0e00 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.421+0000 7f3b189d0700 1 -- 172.21.15.72:0/3079561218 >> 172.21.15.72:0/3079561218 conn(0x7f3b140a6550 msgr2=0x7f3b140a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.421+0000 7f3b189d0700 1 -- 172.21.15.72:0/3079561218 shutdown_connections 2023-10-03T10:16:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.421+0000 7f3b189d0700 1 -- 172.21.15.72:0/3079561218 wait complete. 2023-10-03T10:16:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.422+0000 7f3b189d0700 1 Processor -- start 2023-10-03T10:16:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.422+0000 7f3b189d0700 1 -- start start 2023-10-03T10:16:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.422+0000 7f3b189d0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b140a0a30 0x7f3b141234b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.422+0000 7f3b189d0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b140a1340 0x7f3b141239f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.422+0000 7f3b189d0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b14134170 0x7f3b141c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.422+0000 7f3b189d0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14125f70 con 0x7f3b14134170 2023-10-03T10:16:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.422+0000 7f3b189d0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b141251c0 con 0x7f3b140a0a30 2023-10-03T10:16:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.422+0000 7f3b189d0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14122e20 con 0x7f3b140a1340 2023-10-03T10:16:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.422+0000 7f3b11d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b140a1340 0x7f3b141239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.422+0000 7f3b1259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b140a0a30 0x7f3b141234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.422+0000 7f3b11d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b140a1340 0x7f3b141239f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51886/0 (socket says 172.21.15.72:51886) 2023-10-03T10:16:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.422+0000 7f3b1259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b140a0a30 0x7f3b141234b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46542/0 (socket says 172.21.15.72:46542) 2023-10-03T10:16:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.422+0000 7f3b11d9b700 1 -- 172.21.15.72:0/703424917 learned_addr learned my addr 172.21.15.72:0/703424917 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.422+0000 7f3b12d9d700 1 --2- 172.21.15.72:0/703424917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b14134170 0x7f3b141c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.423+0000 7f3b11d9b700 1 -- 172.21.15.72:0/703424917 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b140a0a30 msgr2=0x7f3b141234b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.423+0000 7f3b11d9b700 1 --2- 172.21.15.72:0/703424917 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b140a0a30 0x7f3b141234b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.423+0000 7f3b11d9b700 1 -- 172.21.15.72:0/703424917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b14134170 msgr2=0x7f3b141c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.423+0000 7f3b11d9b700 1 --2- 172.21.15.72:0/703424917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b14134170 0x7f3b141c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.423+0000 7f3b11d9b700 1 -- 172.21.15.72:0/703424917 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b04009550 con 0x7f3b140a1340 2023-10-03T10:16:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.423+0000 7f3b11d9b700 1 --2- 172.21.15.72:0/703424917 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b140a1340 0x7f3b141239f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800c550 tx=0x7f3b0800c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.423+0000 7f3b02ffd700 1 -- 172.21.15.72:0/703424917 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08005cb0 con 0x7f3b140a1340 2023-10-03T10:16:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.423+0000 7f3b02ffd700 1 -- 172.21.15.72:0/703424917 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b08005e10 con 0x7f3b140a1340 2023-10-03T10:16:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.423+0000 7f3b189d0700 1 -- 172.21.15.72:0/703424917 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b14123060 con 0x7f3b140a1340 2023-10-03T10:16:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.423+0000 7f3b02ffd700 1 -- 172.21.15.72:0/703424917 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b080072d0 con 0x7f3b140a1340 2023-10-03T10:16:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.423+0000 7f3b189d0700 1 -- 172.21.15.72:0/703424917 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b14126b60 con 0x7f3b140a1340 2023-10-03T10:16:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.424+0000 7f3b02ffd700 1 -- 172.21.15.72:0/703424917 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b08007430 con 0x7f3b140a1340 2023-10-03T10:16:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.424+0000 7f3b189d0700 1 -- 172.21.15.72:0/703424917 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b14074ea0 con 0x7f3b140a1340 2023-10-03T10:16:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.424+0000 7f3b02ffd700 1 -- 172.21.15.72:0/703424917 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3b0803eab0 con 0x7f3b140a1340 2023-10-03T10:16:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.429+0000 7f3b02ffd700 1 -- 172.21.15.72:0/703424917 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b080076e0 con 0x7f3b140a1340 2023-10-03T10:16:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.429+0000 7fd10649f700 1 -- 172.21.15.72:0/375881231 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd10006b9e0 con 0x7fd100131810 2023-10-03T10:16:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.430+0000 7fd0fcff9700 1 -- 172.21.15.72:0/375881231 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd0f4011590 con 0x7fd100131810 2023-10-03T10:16:09.430 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.433+0000 7fd10649f700 1 -- 172.21.15.72:0/375881231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd100131810 msgr2=0x7fd1001c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.433+0000 7fd10649f700 1 --2- 172.21.15.72:0/375881231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd100131810 0x7fd1001c6360 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400c450 tx=0x7fd0f400c760 comp rx=0 tx=0).stop 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.433+0000 7fd10649f700 1 -- 172.21.15.72:0/375881231 shutdown_connections 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.433+0000 7fd10649f700 1 --2- 172.21.15.72:0/375881231 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd100136f50 0x7fd100118d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.433+0000 7fd10649f700 1 --2- 172.21.15.72:0/375881231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd100131810 0x7fd1001c6360 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.433+0000 7fd10649f700 1 --2- 172.21.15.72:0/375881231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd100134630 0x7fd1001c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.433+0000 7fd10649f700 1 -- 172.21.15.72:0/375881231 >> 172.21.15.72:0/375881231 conn(0x7fd1000a2aa0 msgr2=0x7fd10009f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.433+0000 7fd10649f700 1 -- 172.21.15.72:0/375881231 shutdown_connections 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.433+0000 7fd10649f700 1 -- 172.21.15.72:0/375881231 wait complete. 2023-10-03T10:16:09.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:09.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:09.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.581+0000 7ff97c6b9700 1 -- 172.21.15.72:0/2046509260 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff97411fa30 con 0x7ff97409f410 2023-10-03T10:16:09.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.581+0000 7ff96affd700 1 -- 172.21.15.72:0/2046509260 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff97411fa30 con 0x7ff97409f410 2023-10-03T10:16:09.582 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:09.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.584+0000 7ff97c6b9700 1 -- 172.21.15.72:0/2046509260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff97409f410 msgr2=0x7ff97411ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.584+0000 7ff97c6b9700 1 --2- 172.21.15.72:0/2046509260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff97409f410 0x7ff97411ca90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff96400e9e0 tx=0x7ff96400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.584+0000 7ff97c6b9700 1 -- 172.21.15.72:0/2046509260 shutdown_connections 2023-10-03T10:16:09.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.584+0000 7ff97c6b9700 1 --2- 172.21.15.72:0/2046509260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff97409e930 0x7ff97411c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.584+0000 7ff97c6b9700 1 --2- 172.21.15.72:0/2046509260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff974136fe0 0x7ff97411cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.584+0000 7ff97c6b9700 1 --2- 172.21.15.72:0/2046509260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff97409f410 0x7ff97411ca90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.584+0000 7ff97c6b9700 1 -- 172.21.15.72:0/2046509260 >> 172.21.15.72:0/2046509260 conn(0x7ff9740a4210 msgr2=0x7ff974135c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.585+0000 7ff97c6b9700 1 -- 172.21.15.72:0/2046509260 shutdown_connections 2023-10-03T10:16:09.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.585+0000 7ff97c6b9700 1 -- 172.21.15.72:0/2046509260 wait complete. 2023-10-03T10:16:09.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:09.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.635+0000 7f3b189d0700 1 -- 172.21.15.72:0/703424917 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3b141336f0 con 0x7f3b140a1340 2023-10-03T10:16:09.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.635+0000 7f3b02ffd700 1 -- 172.21.15.72:0/703424917 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b08017030 con 0x7f3b140a1340 2023-10-03T10:16:09.636 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:09.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.637+0000 7f3b189d0700 1 -- 172.21.15.72:0/703424917 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b140a1340 msgr2=0x7f3b141239f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.637+0000 7f3b189d0700 1 --2- 172.21.15.72:0/703424917 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b140a1340 0x7f3b141239f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800c550 tx=0x7f3b0800c860 comp rx=0 tx=0).stop 2023-10-03T10:16:09.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.637+0000 7f3b189d0700 1 -- 172.21.15.72:0/703424917 shutdown_connections 2023-10-03T10:16:09.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.637+0000 7f3b189d0700 1 --2- 172.21.15.72:0/703424917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b14134170 0x7f3b141c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.637+0000 7f3b189d0700 1 --2- 172.21.15.72:0/703424917 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b140a0a30 0x7f3b141234b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.637+0000 7f3b189d0700 1 --2- 172.21.15.72:0/703424917 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b140a1340 0x7f3b141239f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.637+0000 7f3b189d0700 1 -- 172.21.15.72:0/703424917 >> 172.21.15.72:0/703424917 conn(0x7f3b140a6550 msgr2=0x7f3b1409ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.638+0000 7f3b189d0700 1 -- 172.21.15.72:0/703424917 shutdown_connections 2023-10-03T10:16:09.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.638+0000 7f3b189d0700 1 -- 172.21.15.72:0/703424917 wait complete. 2023-10-03T10:16:09.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.690+0000 7fcb5292d700 1 Processor -- start 2023-10-03T10:16:09.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.690+0000 7fcb5292d700 1 -- start start 2023-10-03T10:16:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb5292d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb4c09d6f0 0x7fcb4c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb5292d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb4c09e000 0x7fcb4c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb5292d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4c09f130 con 0x7fcb4c09e410 2023-10-03T10:16:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb5292d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c09f520 con 0x7fcb4c09e000 2023-10-03T10:16:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb5292d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c09e930 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb4bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb4c09d6f0 0x7fcb4c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb4bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb4c09d6f0 0x7fcb4c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51894/0 (socket says 172.21.15.72:51894) 2023-10-03T10:16:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb4bfff700 1 -- 172.21.15.72:0/2095148937 learned_addr learned my addr 172.21.15.72:0/2095148937 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb50eca700 1 --1- 172.21.15.72:0/2095148937 >> v1:172.21.15.72:6789/0 conn(0x7fcb4c09e410 0x7fcb4c130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59968/0 (socket says 172.21.15.72:59968) 2023-10-03T10:16:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb4b7fe700 1 --2- 172.21.15.72:0/2095148937 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb4c09e000 0x7fcb4c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb4bfff700 1 -- 172.21.15.72:0/2095148937 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb4c09e000 msgr2=0x7fcb4c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb4bfff700 1 --2- 172.21.15.72:0/2095148937 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb4c09e000 0x7fcb4c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb4bfff700 1 -- 172.21.15.72:0/2095148937 >> v1:172.21.15.72:6789/0 conn(0x7fcb4c09e410 legacy=0x7fcb4c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb4bfff700 1 -- 172.21.15.72:0/2095148937 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c09b2d0 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb4affd700 1 -- 172.21.15.72:0/2095148937 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537394234 0 0) 0x7fcb4c09f130 con 0x7fcb4c09e410 2023-10-03T10:16:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb4bfff700 1 --2- 172.21.15.72:0/2095148937 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb4c09d6f0 0x7fcb4c09dac0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009950 tx=0x7fcb3c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8100ce28b3e7b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.691+0000 7fcb4affd700 1 -- 172.21.15.72:0/2095148937 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c011830 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.692+0000 7fcb4affd700 1 -- 172.21.15.72:0/2095148937 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c011990 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.692+0000 7fcb4affd700 1 -- 172.21.15.72:0/2095148937 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c011d40 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.692+0000 7fcb5292d700 1 -- 172.21.15.72:0/2095148937 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb4c09d6f0 msgr2=0x7fcb4c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.692+0000 7fcb5292d700 1 --2- 172.21.15.72:0/2095148937 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb4c09d6f0 0x7fcb4c09dac0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009950 tx=0x7fcb3c009c60 comp rx=0 tx=0).stop 2023-10-03T10:16:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.692+0000 7fcb5292d700 1 -- 172.21.15.72:0/2095148937 shutdown_connections 2023-10-03T10:16:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.692+0000 7fcb5292d700 1 --2- 172.21.15.72:0/2095148937 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb4c09d6f0 0x7fcb4c09dac0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.692+0000 7fcb5292d700 1 --2- 172.21.15.72:0/2095148937 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb4c09e000 0x7fcb4c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.692+0000 7fcb5292d700 1 -- 172.21.15.72:0/2095148937 >> 172.21.15.72:0/2095148937 conn(0x7fcb4c066f50 msgr2=0x7fcb4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.692+0000 7fcb5292d700 1 -- 172.21.15.72:0/2095148937 shutdown_connections 2023-10-03T10:16:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.692+0000 7fcb5292d700 1 -- 172.21.15.72:0/2095148937 wait complete. 2023-10-03T10:16:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.693+0000 7fcb5292d700 1 Processor -- start 2023-10-03T10:16:09.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.693+0000 7fcb5292d700 1 -- start start 2023-10-03T10:16:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb5292d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb4c09d6f0 0x7fcb4c122220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb5292d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb4c09e000 0x7fcb4c122760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb5292d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb4c09e410 0x7fcb4c122ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb5292d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c124450 con 0x7fcb4c09e410 2023-10-03T10:16:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb5292d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c09c770 con 0x7fcb4c09e000 2023-10-03T10:16:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb5292d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c123660 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb4bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb4c09d6f0 0x7fcb4c122220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb50eca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb4c09e410 0x7fcb4c122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb4bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb4c09d6f0 0x7fcb4c122220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51900/0 (socket says 172.21.15.72:51900) 2023-10-03T10:16:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb4bfff700 1 -- 172.21.15.72:0/117756063 learned_addr learned my addr 172.21.15.72:0/117756063 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb4b7fe700 1 --2- 172.21.15.72:0/117756063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb4c09e000 0x7fcb4c122760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb4bfff700 1 -- 172.21.15.72:0/117756063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb4c09e000 msgr2=0x7fcb4c122760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb4bfff700 1 --2- 172.21.15.72:0/117756063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb4c09e000 0x7fcb4c122760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb4bfff700 1 -- 172.21.15.72:0/117756063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb4c09e410 msgr2=0x7fcb4c122ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb4bfff700 1 --2- 172.21.15.72:0/117756063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb4c09e410 0x7fcb4c122ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb4bfff700 1 -- 172.21.15.72:0/117756063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c009550 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb4bfff700 1 --2- 172.21.15.72:0/117756063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb4c09d6f0 0x7fcb4c122220 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009130 tx=0x7fcb3c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb48ff9700 1 -- 172.21.15.72:0/117756063 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c01a840 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb48ff9700 1 -- 172.21.15.72:0/117756063 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c01f070 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb5292d700 1 -- 172.21.15.72:0/117756063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c0a3bb0 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb48ff9700 1 -- 172.21.15.72:0/117756063 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c01ac00 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.694+0000 7fcb5292d700 1 -- 172.21.15.72:0/117756063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c130190 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.695+0000 7fcb48ff9700 1 -- 172.21.15.72:0/117756063 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb3c01b430 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.695+0000 7fcb48ff9700 1 -- 172.21.15.72:0/117756063 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcb3c021070 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.695+0000 7fcb5292d700 1 -- 172.21.15.72:0/117756063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4c074ea0 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.700+0000 7fcb48ff9700 1 -- 172.21.15.72:0/117756063 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb3c02b080 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.884+0000 7fcb5292d700 1 -- 172.21.15.72:0/117756063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcb4c06c360 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.884+0000 7fcb48ff9700 1 -- 172.21.15.72:0/117756063 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcb3c035090 con 0x7fcb4c09d6f0 2023-10-03T10:16:09.885 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:09.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.886+0000 7fcb5292d700 1 -- 172.21.15.72:0/117756063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb4c09d6f0 msgr2=0x7fcb4c122220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.886+0000 7fcb5292d700 1 --2- 172.21.15.72:0/117756063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb4c09d6f0 0x7fcb4c122220 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009130 tx=0x7fcb3c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:09.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.886+0000 7fcb5292d700 1 -- 172.21.15.72:0/117756063 shutdown_connections 2023-10-03T10:16:09.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.886+0000 7fcb5292d700 1 --2- 172.21.15.72:0/117756063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb4c09e410 0x7fcb4c122ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.886+0000 7fcb5292d700 1 --2- 172.21.15.72:0/117756063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb4c09d6f0 0x7fcb4c122220 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.886+0000 7fcb5292d700 1 --2- 172.21.15.72:0/117756063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb4c09e000 0x7fcb4c122760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.886+0000 7fcb5292d700 1 -- 172.21.15.72:0/117756063 >> 172.21.15.72:0/117756063 conn(0x7fcb4c066f50 msgr2=0x7fcb4c130a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.886+0000 7fcb5292d700 1 -- 172.21.15.72:0/117756063 shutdown_connections 2023-10-03T10:16:09.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:09.886+0000 7fcb5292d700 1 -- 172.21.15.72:0/117756063 wait complete. 2023-10-03T10:16:09.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:10.452 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:10.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.579+0000 7f084c270700 1 Processor -- start 2023-10-03T10:16:10.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.579+0000 7f084c270700 1 -- start start 2023-10-03T10:16:10.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084c270700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f084409d6f0 0x7f084409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084c270700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f084409e410 0x7f0844134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084c270700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f084409b120 con 0x7f084409e000 2023-10-03T10:16:10.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084c270700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084406b460 con 0x7f084409e410 2023-10-03T10:16:10.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084c270700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f084409a7e0 con 0x7f084409d6f0 2023-10-03T10:16:10.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084a00c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f084409d6f0 0x7f084409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084a80d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f084409e410 0x7f0844134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084a80d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f084409e410 0x7f0844134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35618/0 (socket says 172.21.15.72:35618) 2023-10-03T10:16:10.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084a00c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f084409d6f0 0x7f084409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51906/0 (socket says 172.21.15.72:51906) 2023-10-03T10:16:10.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084a80d700 1 -- 172.21.15.72:0/2073350839 learned_addr learned my addr 172.21.15.72:0/2073350839 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:10.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084980b700 1 --1- 172.21.15.72:0/2073350839 >> v1:172.21.15.72:6789/0 conn(0x7f084409e000 0x7f08441339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59976/0 (socket says 172.21.15.72:59976) 2023-10-03T10:16:10.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084a80d700 1 -- 172.21.15.72:0/2073350839 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f084409d6f0 msgr2=0x7f084409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084a80d700 1 --2- 172.21.15.72:0/2073350839 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f084409d6f0 0x7f084409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084a80d700 1 -- 172.21.15.72:0/2073350839 >> v1:172.21.15.72:6789/0 conn(0x7f084409e000 legacy=0x7f08441339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084a80d700 1 -- 172.21.15.72:0/2073350839 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084409a500 con 0x7f084409e410 2023-10-03T10:16:10.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.580+0000 7f084a00c700 1 --2- 172.21.15.72:0/2073350839 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f084409d6f0 0x7f084409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.581+0000 7f084a80d700 1 --2- 172.21.15.72:0/2073350839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084409e410 0x7f0844134100 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f083c009e50 tx=0x7f083c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3221328afa7673e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.581+0000 7f084900a700 1 -- 172.21.15.72:0/2073350839 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c00e070 con 0x7f084409e410 2023-10-03T10:16:10.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.581+0000 7f084900a700 1 -- 172.21.15.72:0/2073350839 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c00b910 con 0x7f084409e410 2023-10-03T10:16:10.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.581+0000 7f084900a700 1 -- 172.21.15.72:0/2073350839 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c00bcc0 con 0x7f084409e410 2023-10-03T10:16:10.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.581+0000 7f084c270700 1 -- 172.21.15.72:0/2073350839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084409e410 msgr2=0x7f0844134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.581+0000 7f084c270700 1 --2- 172.21.15.72:0/2073350839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084409e410 0x7f0844134100 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f083c009e50 tx=0x7f083c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:10.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.581+0000 7f084c270700 1 -- 172.21.15.72:0/2073350839 shutdown_connections 2023-10-03T10:16:10.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.581+0000 7f084c270700 1 --2- 172.21.15.72:0/2073350839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084409e410 0x7f0844134100 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.581+0000 7f084c270700 1 --2- 172.21.15.72:0/2073350839 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f084409d6f0 0x7f084409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.581+0000 7f084c270700 1 -- 172.21.15.72:0/2073350839 >> 172.21.15.72:0/2073350839 conn(0x7f0844066f50 msgr2=0x7f084409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.581+0000 7f084c270700 1 -- 172.21.15.72:0/2073350839 shutdown_connections 2023-10-03T10:16:10.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.581+0000 7f084c270700 1 -- 172.21.15.72:0/2073350839 wait complete. 2023-10-03T10:16:10.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.582+0000 7f084c270700 1 Processor -- start 2023-10-03T10:16:10.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.582+0000 7f084c270700 1 -- start start 2023-10-03T10:16:10.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084c270700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084409d6f0 0x7f08441a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084c270700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f084409e000 0x7f08441a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084c270700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f084409e410 0x7f08441a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084c270700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08441a9870 con 0x7f084409d6f0 2023-10-03T10:16:10.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084c270700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08441a7b90 con 0x7f084409e000 2023-10-03T10:16:10.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084c270700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08441a9a70 con 0x7f084409e410 2023-10-03T10:16:10.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084a00c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084409d6f0 0x7f08441a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084a00c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084409d6f0 0x7f08441a60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35632/0 (socket says 172.21.15.72:35632) 2023-10-03T10:16:10.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084a00c700 1 -- 172.21.15.72:0/461122341 learned_addr learned my addr 172.21.15.72:0/461122341 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:10.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084a80d700 1 --2- 172.21.15.72:0/461122341 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f084409e410 0x7f08441a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084980b700 1 --2- 172.21.15.72:0/461122341 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f084409e000 0x7f08441a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084a00c700 1 -- 172.21.15.72:0/461122341 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f084409e410 msgr2=0x7f08441a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084a00c700 1 --2- 172.21.15.72:0/461122341 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f084409e410 0x7f08441a6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084a00c700 1 -- 172.21.15.72:0/461122341 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f084409e000 msgr2=0x7f08441a65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084a00c700 1 --2- 172.21.15.72:0/461122341 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f084409e000 0x7f08441a65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084a00c700 1 -- 172.21.15.72:0/461122341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08340094a0 con 0x7f084409d6f0 2023-10-03T10:16:10.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084a80d700 1 --2- 172.21.15.72:0/461122341 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f084409e410 0x7f08441a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084a00c700 1 --2- 172.21.15.72:0/461122341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084409d6f0 0x7f08441a60a0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f083400ebe0 tx=0x7f083400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f083affd700 1 -- 172.21.15.72:0/461122341 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083400c850 con 0x7f084409d6f0 2023-10-03T10:16:10.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f083affd700 1 -- 172.21.15.72:0/461122341 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083400c9b0 con 0x7f084409d6f0 2023-10-03T10:16:10.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f084c270700 1 -- 172.21.15.72:0/461122341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f083c009b30 con 0x7f084409d6f0 2023-10-03T10:16:10.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.583+0000 7f083affd700 1 -- 172.21.15.72:0/461122341 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083400cd40 con 0x7f084409d6f0 2023-10-03T10:16:10.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.584+0000 7f084c270700 1 -- 172.21.15.72:0/461122341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08441a88f0 con 0x7f084409d6f0 2023-10-03T10:16:10.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.584+0000 7f083affd700 1 -- 172.21.15.72:0/461122341 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0834013470 con 0x7f084409d6f0 2023-10-03T10:16:10.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.584+0000 7f083affd700 1 -- 172.21.15.72:0/461122341 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f083403f7d0 con 0x7f084409d6f0 2023-10-03T10:16:10.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.585+0000 7f084c270700 1 -- 172.21.15.72:0/461122341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08441aa400 con 0x7f084409d6f0 2023-10-03T10:16:10.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.589+0000 7f083affd700 1 -- 172.21.15.72:0/461122341 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0834013720 con 0x7f084409d6f0 2023-10-03T10:16:10.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:10.652 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:10.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.723+0000 7f6b64b20700 1 Processor -- start 2023-10-03T10:16:10.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.723+0000 7f6b64b20700 1 -- start start 2023-10-03T10:16:10.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b64b20700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6b60133420 0x7f6b601337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b64b20700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b60133e30 0x7f6b6012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b64b20700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b60134260 0x7f6b601304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b64b20700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6006b990 con 0x7f6b60133420 2023-10-03T10:16:10.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b64b20700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b600a0590 con 0x7f6b60134260 2023-10-03T10:16:10.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b64b20700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6009fb80 con 0x7f6b60133e30 2023-10-03T10:16:10.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b5dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b60133e30 0x7f6b6012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b5dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b60133e30 0x7f6b6012ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51924/0 (socket says 172.21.15.72:51924) 2023-10-03T10:16:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b5dd9b700 1 -- 172.21.15.72:0/2396354777 learned_addr learned my addr 172.21.15.72:0/2396354777 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b5e59c700 1 --2- 172.21.15.72:0/2396354777 >> v2:172.21.15.72:3300/0 conn(0x7f6b60133420 0x7f6b601337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b5ed9d700 1 --2- 172.21.15.72:0/2396354777 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b60134260 0x7f6b601304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b5e59c700 1 -- 172.21.15.72:0/2396354777 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b60133e30 msgr2=0x7f6b6012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b5e59c700 1 --2- 172.21.15.72:0/2396354777 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b60133e30 0x7f6b6012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b5e59c700 1 -- 172.21.15.72:0/2396354777 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b60134260 msgr2=0x7f6b601304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b5e59c700 1 --2- 172.21.15.72:0/2396354777 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b60134260 0x7f6b601304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b5e59c700 1 -- 172.21.15.72:0/2396354777 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b600a0030 con 0x7f6b60133420 2023-10-03T10:16:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b5e59c700 1 --2- 172.21.15.72:0/2396354777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b60133420 0x7f6b601337f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009840 tx=0x7f6b50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628bfce51ee1f686 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b5d59a700 1 -- 172.21.15.72:0/2396354777 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50011830 con 0x7f6b60133420 2023-10-03T10:16:10.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b5d59a700 1 -- 172.21.15.72:0/2396354777 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b50011990 con 0x7f6b60133420 2023-10-03T10:16:10.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.724+0000 7f6b5d59a700 1 -- 172.21.15.72:0/2396354777 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50011d20 con 0x7f6b60133420 2023-10-03T10:16:10.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.725+0000 7f6b64b20700 1 -- 172.21.15.72:0/2396354777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b60133420 msgr2=0x7f6b601337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.725+0000 7f6b64b20700 1 --2- 172.21.15.72:0/2396354777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b60133420 0x7f6b601337f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009840 tx=0x7f6b50009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:10.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.725+0000 7f6b64b20700 1 -- 172.21.15.72:0/2396354777 shutdown_connections 2023-10-03T10:16:10.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.725+0000 7f6b64b20700 1 --2- 172.21.15.72:0/2396354777 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b60134260 0x7f6b601304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.725+0000 7f6b64b20700 1 --2- 172.21.15.72:0/2396354777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b60133420 0x7f6b601337f0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.725+0000 7f6b64b20700 1 --2- 172.21.15.72:0/2396354777 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b60133e30 0x7f6b6012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.725+0000 7f6b64b20700 1 -- 172.21.15.72:0/2396354777 >> 172.21.15.72:0/2396354777 conn(0x7f6b600a4210 msgr2=0x7f6b600a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.725+0000 7f6b64b20700 1 -- 172.21.15.72:0/2396354777 shutdown_connections 2023-10-03T10:16:10.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.725+0000 7f6b64b20700 1 -- 172.21.15.72:0/2396354777 wait complete. 2023-10-03T10:16:10.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.726+0000 7f6b64b20700 1 Processor -- start 2023-10-03T10:16:10.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.726+0000 7f6b64b20700 1 -- start start 2023-10-03T10:16:10.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b64b20700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b60133420 0x7f6b6009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b64b20700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b60133e30 0x7f6b6009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b64b20700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b60134260 0x7f6b6009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b64b20700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6011f180 con 0x7f6b60133420 2023-10-03T10:16:10.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b64b20700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6009df60 con 0x7f6b60133e30 2023-10-03T10:16:10.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b64b20700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6009dd70 con 0x7f6b60134260 2023-10-03T10:16:10.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b5e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b60133420 0x7f6b6009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b5e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b60133420 0x7f6b6009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35640/0 (socket says 172.21.15.72:35640) 2023-10-03T10:16:10.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b5e59c700 1 -- 172.21.15.72:0/3844462797 learned_addr learned my addr 172.21.15.72:0/3844462797 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:10.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b5ed9d700 1 --2- 172.21.15.72:0/3844462797 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b60134260 0x7f6b6009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b5dd9b700 1 --2- 172.21.15.72:0/3844462797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b60133e30 0x7f6b6009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b5e59c700 1 -- 172.21.15.72:0/3844462797 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b60134260 msgr2=0x7f6b6009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b5e59c700 1 --2- 172.21.15.72:0/3844462797 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b60134260 0x7f6b6009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b5e59c700 1 -- 172.21.15.72:0/3844462797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b60133e30 msgr2=0x7f6b6009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b5e59c700 1 --2- 172.21.15.72:0/3844462797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b60133e30 0x7f6b6009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b5e59c700 1 -- 172.21.15.72:0/3844462797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b500094a0 con 0x7f6b60133420 2023-10-03T10:16:10.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.727+0000 7f6b5e59c700 1 --2- 172.21.15.72:0/3844462797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b60133420 0x7f6b6009c480 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6b500090b0 tx=0x7f6b50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.728+0000 7f6b4effd700 1 -- 172.21.15.72:0/3844462797 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b50004240 con 0x7f6b60133420 2023-10-03T10:16:10.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.728+0000 7f6b4effd700 1 -- 172.21.15.72:0/3844462797 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5001f070 con 0x7f6b60133420 2023-10-03T10:16:10.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.728+0000 7f6b64b20700 1 -- 172.21.15.72:0/3844462797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b60120190 con 0x7f6b60133420 2023-10-03T10:16:10.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.728+0000 7f6b4effd700 1 -- 172.21.15.72:0/3844462797 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500036a0 con 0x7f6b60133420 2023-10-03T10:16:10.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.728+0000 7f6b64b20700 1 -- 172.21.15.72:0/3844462797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6011f4d0 con 0x7f6b60133420 2023-10-03T10:16:10.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.728+0000 7f6b4effd700 1 -- 172.21.15.72:0/3844462797 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b50021030 con 0x7f6b60133420 2023-10-03T10:16:10.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.728+0000 7f6b4effd700 1 -- 172.21.15.72:0/3844462797 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6b50040550 con 0x7f6b60133420 2023-10-03T10:16:10.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.729+0000 7f6b64b20700 1 -- 172.21.15.72:0/3844462797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b60074ea0 con 0x7f6b60133420 2023-10-03T10:16:10.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.733+0000 7f6b4effd700 1 -- 172.21.15.72:0/3844462797 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b500239c0 con 0x7f6b60133420 2023-10-03T10:16:10.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.776+0000 7f485ce51700 1 Processor -- start 2023-10-03T10:16:10.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.776+0000 7f485ce51700 1 -- start start 2023-10-03T10:16:10.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.777+0000 7f485ce51700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f485806a770 0x7f485806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.777+0000 7f485ce51700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4858131d10 0x7f4858139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.777+0000 7f485ce51700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485809ece0 con 0x7f485806b080 2023-10-03T10:16:10.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.777+0000 7f485ce51700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485809e760 con 0x7f4858131d10 2023-10-03T10:16:10.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.777+0000 7f485ce51700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f485809e040 con 0x7f485806a770 2023-10-03T10:16:10.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.777+0000 7f4856d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4858131d10 0x7f4858139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.777+0000 7f485659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f485806a770 0x7f485806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.777+0000 7f4855d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f485806b080 0x7f4858131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59978/0 (socket says 172.21.15.72:59978) 2023-10-03T10:16:10.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.777+0000 7f4855d9b700 1 -- 172.21.15.72:0/1877648419 learned_addr learned my addr 172.21.15.72:0/1877648419 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:10.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.778+0000 7f4856d9d700 1 -- 172.21.15.72:0/1877648419 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f485806a770 msgr2=0x7f485806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.778+0000 7f4856d9d700 1 --2- 172.21.15.72:0/1877648419 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f485806a770 0x7f485806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.778+0000 7f4856d9d700 1 -- 172.21.15.72:0/1877648419 >> v1:172.21.15.72:6789/0 conn(0x7f485806b080 legacy=0x7f4858131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.778+0000 7f485559a700 1 -- 172.21.15.72:0/1877648419 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991882745 0 0) 0x7f485809ece0 con 0x7f485806b080 2023-10-03T10:16:10.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.778+0000 7f4856d9d700 1 -- 172.21.15.72:0/1877648419 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485809f630 con 0x7f4858131d10 2023-10-03T10:16:10.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.778+0000 7f4856d9d700 1 --2- 172.21.15.72:0/1877648419 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4858131d10 0x7f4858139860 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4850009dc0 tx=0x7f485000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a54a9846f37f1043 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.778+0000 7f485559a700 1 -- 172.21.15.72:0/1877648419 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000bd20 con 0x7f4858131d10 2023-10-03T10:16:10.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.778+0000 7f485559a700 1 -- 172.21.15.72:0/1877648419 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485000be80 con 0x7f4858131d10 2023-10-03T10:16:10.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.778+0000 7f485559a700 1 -- 172.21.15.72:0/1877648419 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850010710 con 0x7f4858131d10 2023-10-03T10:16:10.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.778+0000 7f485ce51700 1 -- 172.21.15.72:0/1877648419 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4858131d10 msgr2=0x7f4858139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.778+0000 7f485ce51700 1 --2- 172.21.15.72:0/1877648419 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4858131d10 0x7f4858139860 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4850009dc0 tx=0x7f485000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:10.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.779+0000 7f485ce51700 1 -- 172.21.15.72:0/1877648419 shutdown_connections 2023-10-03T10:16:10.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.779+0000 7f485ce51700 1 --2- 172.21.15.72:0/1877648419 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4858131d10 0x7f4858139860 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.779+0000 7f485ce51700 1 --2- 172.21.15.72:0/1877648419 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f485806a770 0x7f485806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.779+0000 7f485ce51700 1 -- 172.21.15.72:0/1877648419 >> 172.21.15.72:0/1877648419 conn(0x7f4858066f50 msgr2=0x7f485809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.779+0000 7f485ce51700 1 -- 172.21.15.72:0/1877648419 shutdown_connections 2023-10-03T10:16:10.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.779+0000 7f485ce51700 1 -- 172.21.15.72:0/1877648419 wait complete. 2023-10-03T10:16:10.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.780+0000 7f485ce51700 1 Processor -- start 2023-10-03T10:16:10.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.780+0000 7f485ce51700 1 -- start start 2023-10-03T10:16:10.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.780+0000 7f485ce51700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485806a770 0x7f485811eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.780+0000 7f485ce51700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485806b080 0x7f485811f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.780+0000 7f485ce51700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4858131d10 0x7f48581c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.780+0000 7f485ce51700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4858130f90 con 0x7f485806b080 2023-10-03T10:16:10.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.780+0000 7f485ce51700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485811eb00 con 0x7f485806a770 2023-10-03T10:16:10.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.780+0000 7f485ce51700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4858071e60 con 0x7f4858131d10 2023-10-03T10:16:10.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.780+0000 7f485659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485806a770 0x7f485811eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.780+0000 7f485659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485806a770 0x7f485811eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46592/0 (socket says 172.21.15.72:46592) 2023-10-03T10:16:10.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.780+0000 7f485659c700 1 -- 172.21.15.72:0/158608457 learned_addr learned my addr 172.21.15.72:0/158608457 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:10.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.780+0000 7f4856d9d700 1 --2- 172.21.15.72:0/158608457 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4858131d10 0x7f48581c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.780+0000 7f4855d9b700 1 --2- 172.21.15.72:0/158608457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485806b080 0x7f485811f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.781+0000 7f485659c700 1 -- 172.21.15.72:0/158608457 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4858131d10 msgr2=0x7f48581c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.781+0000 7f485659c700 1 --2- 172.21.15.72:0/158608457 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4858131d10 0x7f48581c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.781+0000 7f485659c700 1 -- 172.21.15.72:0/158608457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485806b080 msgr2=0x7f485811f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.781+0000 7f485659c700 1 --2- 172.21.15.72:0/158608457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485806b080 0x7f485811f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.781+0000 7f485659c700 1 -- 172.21.15.72:0/158608457 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4850009a70 con 0x7f485806a770 2023-10-03T10:16:10.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.781+0000 7f485659c700 1 --2- 172.21.15.72:0/158608457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485806a770 0x7f485811eef0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f484800e9b0 tx=0x7f484800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.781+0000 7f4846ffd700 1 -- 172.21.15.72:0/158608457 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848009710 con 0x7f485806a770 2023-10-03T10:16:10.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.781+0000 7f4846ffd700 1 -- 172.21.15.72:0/158608457 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484800ee50 con 0x7f485806a770 2023-10-03T10:16:10.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.781+0000 7f485ce51700 1 -- 172.21.15.72:0/158608457 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4858120ea0 con 0x7f485806a770 2023-10-03T10:16:10.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.781+0000 7f4846ffd700 1 -- 172.21.15.72:0/158608457 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484800ca50 con 0x7f485806a770 2023-10-03T10:16:10.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.781+0000 7f485ce51700 1 -- 172.21.15.72:0/158608457 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485809a5d0 con 0x7f485806a770 2023-10-03T10:16:10.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.782+0000 7f4846ffd700 1 -- 172.21.15.72:0/158608457 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f484800cbb0 con 0x7f485806a770 2023-10-03T10:16:10.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.782+0000 7f4846ffd700 1 -- 172.21.15.72:0/158608457 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f484803fa20 con 0x7f485806a770 2023-10-03T10:16:10.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.782+0000 7f485ce51700 1 -- 172.21.15.72:0/158608457 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4858074ea0 con 0x7f485806a770 2023-10-03T10:16:10.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.791+0000 7f4846ffd700 1 -- 172.21.15.72:0/158608457 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f484801b3b0 con 0x7f485806a770 2023-10-03T10:16:10.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.792+0000 7f084c270700 1 -- 172.21.15.72:0/461122341 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0844074ea0 con 0x7f084409d6f0 2023-10-03T10:16:10.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.792+0000 7f083affd700 1 -- 172.21.15.72:0/461122341 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f083402a090 con 0x7f084409d6f0 2023-10-03T10:16:10.793 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:10.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.795+0000 7f084c270700 1 -- 172.21.15.72:0/461122341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084409d6f0 msgr2=0x7f08441a60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.795+0000 7f084c270700 1 --2- 172.21.15.72:0/461122341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084409d6f0 0x7f08441a60a0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f083400ebe0 tx=0x7f083400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.795+0000 7f084c270700 1 -- 172.21.15.72:0/461122341 shutdown_connections 2023-10-03T10:16:10.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.795+0000 7f084c270700 1 --2- 172.21.15.72:0/461122341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084409d6f0 0x7f08441a60a0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.795+0000 7f084c270700 1 --2- 172.21.15.72:0/461122341 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f084409e410 0x7f08441a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.795+0000 7f084c270700 1 --2- 172.21.15.72:0/461122341 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f084409e000 0x7f08441a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.795+0000 7f084c270700 1 -- 172.21.15.72:0/461122341 >> 172.21.15.72:0/461122341 conn(0x7f0844066f50 msgr2=0x7f08441baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.795+0000 7f084c270700 1 -- 172.21.15.72:0/461122341 shutdown_connections 2023-10-03T10:16:10.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.795+0000 7f084c270700 1 -- 172.21.15.72:0/461122341 wait complete. 2023-10-03T10:16:10.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:10.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:10.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.928+0000 7f6b64b20700 1 -- 172.21.15.72:0/3844462797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6b6006b250 con 0x7f6b60133420 2023-10-03T10:16:10.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.928+0000 7f6b4effd700 1 -- 172.21.15.72:0/3844462797 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6b500233d0 con 0x7f6b60133420 2023-10-03T10:16:10.929 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:10.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.930+0000 7f6b64b20700 1 -- 172.21.15.72:0/3844462797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b60133420 msgr2=0x7f6b6009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.930+0000 7f6b64b20700 1 --2- 172.21.15.72:0/3844462797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b60133420 0x7f6b6009c480 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6b500090b0 tx=0x7f6b50004750 comp rx=0 tx=0).stop 2023-10-03T10:16:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.930+0000 7f6b64b20700 1 -- 172.21.15.72:0/3844462797 shutdown_connections 2023-10-03T10:16:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.930+0000 7f6b64b20700 1 --2- 172.21.15.72:0/3844462797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b60133420 0x7f6b6009c480 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.930+0000 7f6b64b20700 1 --2- 172.21.15.72:0/3844462797 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b60134260 0x7f6b6009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.930+0000 7f6b64b20700 1 --2- 172.21.15.72:0/3844462797 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b60133e30 0x7f6b6009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.930+0000 7f6b64b20700 1 -- 172.21.15.72:0/3844462797 >> 172.21.15.72:0/3844462797 conn(0x7f6b600a4210 msgr2=0x7f6b600a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.931+0000 7f6b64b20700 1 -- 172.21.15.72:0/3844462797 shutdown_connections 2023-10-03T10:16:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.931+0000 7f6b64b20700 1 -- 172.21.15.72:0/3844462797 wait complete. 2023-10-03T10:16:10.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:10.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.985+0000 7f485ce51700 1 -- 172.21.15.72:0/158608457 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f485806c360 con 0x7f485806a770 2023-10-03T10:16:10.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.986+0000 7f4846ffd700 1 -- 172.21.15.72:0/158608457 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4848021020 con 0x7f485806a770 2023-10-03T10:16:10.986 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:10.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.988+0000 7f485ce51700 1 -- 172.21.15.72:0/158608457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485806a770 msgr2=0x7f485811eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.988+0000 7f485ce51700 1 --2- 172.21.15.72:0/158608457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485806a770 0x7f485811eef0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f484800e9b0 tx=0x7f484800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.988+0000 7f485ce51700 1 -- 172.21.15.72:0/158608457 shutdown_connections 2023-10-03T10:16:10.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.988+0000 7f485ce51700 1 --2- 172.21.15.72:0/158608457 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4858131d10 0x7f48581c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.988+0000 7f485ce51700 1 --2- 172.21.15.72:0/158608457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f485806a770 0x7f485811eef0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.988+0000 7f485ce51700 1 --2- 172.21.15.72:0/158608457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f485806b080 0x7f485811f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.988+0000 7f485ce51700 1 -- 172.21.15.72:0/158608457 >> 172.21.15.72:0/158608457 conn(0x7f4858066f50 msgr2=0x7f48580a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.988+0000 7f485ce51700 1 -- 172.21.15.72:0/158608457 shutdown_connections 2023-10-03T10:16:10.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:10.988+0000 7f485ce51700 1 -- 172.21.15.72:0/158608457 wait complete. 2023-10-03T10:16:11.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:11.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.024+0000 7f0ae0cde700 1 Processor -- start 2023-10-03T10:16:11.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.024+0000 7f0ae0cde700 1 -- start start 2023-10-03T10:16:11.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.024+0000 7f0ae0cde700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0adc133420 0x7f0adc1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.024+0000 7f0ae0cde700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0adc133e30 0x7f0adc12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.024+0000 7f0ae0cde700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0adc06b990 con 0x7f0adc134260 2023-10-03T10:16:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.024+0000 7f0ae0cde700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc0a0590 con 0x7f0adc133420 2023-10-03T10:16:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.024+0000 7f0ae0cde700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc09fb80 con 0x7f0adc133e30 2023-10-03T10:16:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.024+0000 7f0ada59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0adc133420 0x7f0adc1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.024+0000 7f0ad9d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0adc133e30 0x7f0adc12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.025+0000 7f0ada59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0adc133420 0x7f0adc1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35658/0 (socket says 172.21.15.72:35658) 2023-10-03T10:16:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.025+0000 7f0ada59c700 1 -- 172.21.15.72:0/3915944000 learned_addr learned my addr 172.21.15.72:0/3915944000 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.025+0000 7f0ad9d9b700 1 -- 172.21.15.72:0/3915944000 >> v2:172.21.15.72:3300/0 conn(0x7f0adc133420 msgr2=0x7f0adc1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.025+0000 7f0ad9d9b700 1 --2- 172.21.15.72:0/3915944000 >> v2:172.21.15.72:3300/0 conn(0x7f0adc133420 0x7f0adc1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.025+0000 7f0ad9d9b700 1 -- 172.21.15.72:0/3915944000 >> v1:172.21.15.72:6789/0 conn(0x7f0adc134260 legacy=0x7f0adc1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.025+0000 7f0ad9d9b700 1 -- 172.21.15.72:0/3915944000 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0a0030 con 0x7f0adc133e30 2023-10-03T10:16:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.025+0000 7f0ad959a700 1 -- 172.21.15.72:0/3915944000 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126469691 0 0) 0x7f0adc06b990 con 0x7f0adc134260 2023-10-03T10:16:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.025+0000 7f0ada59c700 1 --2- 172.21.15.72:0/3915944000 >> v2:172.21.15.72:3300/0 conn(0x7f0adc133420 0x7f0adc1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.025+0000 7f0ad9d9b700 1 --2- 172.21.15.72:0/3915944000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0adc133e30 0x7f0adc12ff90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009840 tx=0x7f0ad0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4f2a0ab765e0177 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.025+0000 7f0ad959a700 1 -- 172.21.15.72:0/3915944000 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0011830 con 0x7f0adc133e30 2023-10-03T10:16:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.025+0000 7f0ad959a700 1 -- 172.21.15.72:0/3915944000 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad0011990 con 0x7f0adc133e30 2023-10-03T10:16:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.025+0000 7f0ad959a700 1 -- 172.21.15.72:0/3915944000 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0011d20 con 0x7f0adc133e30 2023-10-03T10:16:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.026+0000 7f0ae0cde700 1 -- 172.21.15.72:0/3915944000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0adc133e30 msgr2=0x7f0adc12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.026+0000 7f0ae0cde700 1 --2- 172.21.15.72:0/3915944000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0adc133e30 0x7f0adc12ff90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009840 tx=0x7f0ad0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.026+0000 7f0ae0cde700 1 -- 172.21.15.72:0/3915944000 shutdown_connections 2023-10-03T10:16:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.026+0000 7f0ae0cde700 1 --2- 172.21.15.72:0/3915944000 >> v2:172.21.15.72:3300/0 conn(0x7f0adc133420 0x7f0adc1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.026+0000 7f0ae0cde700 1 --2- 172.21.15.72:0/3915944000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0adc133e30 0x7f0adc12ff90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.026+0000 7f0ae0cde700 1 -- 172.21.15.72:0/3915944000 >> 172.21.15.72:0/3915944000 conn(0x7f0adc0a4210 msgr2=0x7f0adc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:11.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.026+0000 7f0ae0cde700 1 -- 172.21.15.72:0/3915944000 shutdown_connections 2023-10-03T10:16:11.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.026+0000 7f0ae0cde700 1 -- 172.21.15.72:0/3915944000 wait complete. 2023-10-03T10:16:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.027+0000 7f0ae0cde700 1 Processor -- start 2023-10-03T10:16:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.027+0000 7f0ae0cde700 1 -- start start 2023-10-03T10:16:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.027+0000 7f0ae0cde700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0adc133420 0x7f0adc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.027+0000 7f0ae0cde700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0adc133e30 0x7f0adc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.027+0000 7f0ae0cde700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0adc134260 0x7f0adc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.027+0000 7f0ae0cde700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc12d7d0 con 0x7f0adc133e30 2023-10-03T10:16:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.027+0000 7f0ae0cde700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc120020 con 0x7f0adc133420 2023-10-03T10:16:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.027+0000 7f0ae0cde700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc09d870 con 0x7f0adc134260 2023-10-03T10:16:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.027+0000 7f0ada59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0adc133420 0x7f0adc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.027+0000 7f0ad9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0adc133e30 0x7f0adc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.027+0000 7f0ada59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0adc133420 0x7f0adc09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46596/0 (socket says 172.21.15.72:46596) 2023-10-03T10:16:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.027+0000 7f0adad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0adc134260 0x7f0adc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.027+0000 7f0ada59c700 1 -- 172.21.15.72:0/24457530 learned_addr learned my addr 172.21.15.72:0/24457530 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.028+0000 7f0ad9d9b700 1 -- 172.21.15.72:0/24457530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0adc134260 msgr2=0x7f0adc09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.028+0000 7f0ad9d9b700 1 --2- 172.21.15.72:0/24457530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0adc134260 0x7f0adc09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.028+0000 7f0ad9d9b700 1 -- 172.21.15.72:0/24457530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0adc133420 msgr2=0x7f0adc09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.028+0000 7f0ad9d9b700 1 --2- 172.21.15.72:0/24457530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0adc133420 0x7f0adc09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.028+0000 7f0ad9d9b700 1 -- 172.21.15.72:0/24457530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc009550 con 0x7f0adc133e30 2023-10-03T10:16:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.028+0000 7f0ada59c700 1 --2- 172.21.15.72:0/24457530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0adc133420 0x7f0adc09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.028+0000 7f0ad9d9b700 1 --2- 172.21.15.72:0/24457530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0adc133e30 0x7f0adc09c9c0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0016000 tx=0x7f0ad0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.028+0000 7f0acaffd700 1 -- 172.21.15.72:0/24457530 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0004400 con 0x7f0adc133e30 2023-10-03T10:16:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.028+0000 7f0acaffd700 1 -- 172.21.15.72:0/24457530 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad001f070 con 0x7f0adc133e30 2023-10-03T10:16:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.028+0000 7f0ae0cde700 1 -- 172.21.15.72:0/24457530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad00094a0 con 0x7f0adc133e30 2023-10-03T10:16:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.028+0000 7f0acaffd700 1 -- 172.21.15.72:0/24457530 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00038a0 con 0x7f0adc133e30 2023-10-03T10:16:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.028+0000 7f0ae0cde700 1 -- 172.21.15.72:0/24457530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc09de20 con 0x7f0adc133e30 2023-10-03T10:16:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.029+0000 7f0acaffd700 1 -- 172.21.15.72:0/24457530 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ad0021030 con 0x7f0adc133e30 2023-10-03T10:16:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.029+0000 7f0acaffd700 1 -- 172.21.15.72:0/24457530 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0ad00407f0 con 0x7f0adc133e30 2023-10-03T10:16:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.029+0000 7f0ae0cde700 1 -- 172.21.15.72:0/24457530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc11fb90 con 0x7f0adc133e30 2023-10-03T10:16:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.033+0000 7f0acaffd700 1 -- 172.21.15.72:0/24457530 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ad0004560 con 0x7f0adc133e30 2023-10-03T10:16:11.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.216+0000 7f0ae0cde700 1 -- 172.21.15.72:0/24457530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0adc074ea0 con 0x7f0adc133e30 2023-10-03T10:16:11.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.217+0000 7f0acaffd700 1 -- 172.21.15.72:0/24457530 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0ad0015020 con 0x7f0adc133e30 2023-10-03T10:16:11.217 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:11.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.218+0000 7f0ae0cde700 1 -- 172.21.15.72:0/24457530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0adc133e30 msgr2=0x7f0adc09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.218+0000 7f0ae0cde700 1 --2- 172.21.15.72:0/24457530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0adc133e30 0x7f0adc09c9c0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0016000 tx=0x7f0ad0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:11.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.219+0000 7f0ae0cde700 1 -- 172.21.15.72:0/24457530 shutdown_connections 2023-10-03T10:16:11.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.219+0000 7f0ae0cde700 1 --2- 172.21.15.72:0/24457530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0adc134260 0x7f0adc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.219+0000 7f0ae0cde700 1 --2- 172.21.15.72:0/24457530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0adc133420 0x7f0adc09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.219+0000 7f0ae0cde700 1 --2- 172.21.15.72:0/24457530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0adc133e30 0x7f0adc09c9c0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.219+0000 7f0ae0cde700 1 -- 172.21.15.72:0/24457530 >> 172.21.15.72:0/24457530 conn(0x7f0adc0a4210 msgr2=0x7f0adc12de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:11.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.219+0000 7f0ae0cde700 1 -- 172.21.15.72:0/24457530 shutdown_connections 2023-10-03T10:16:11.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.219+0000 7f0ae0cde700 1 -- 172.21.15.72:0/24457530 wait complete. 2023-10-03T10:16:11.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:11.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:11.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.933+0000 7f7283b2c700 1 Processor -- start 2023-10-03T10:16:11.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.933+0000 7f7283b2c700 1 -- start start 2023-10-03T10:16:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f7283b2c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f727c134630 0x7f727c136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f7283b2c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727c136f50 0x7f727c139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f7283b2c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727c09b4f0 con 0x7f727c131810 2023-10-03T10:16:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f7283b2c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c1313c0 con 0x7f727c134630 2023-10-03T10:16:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f7283b2c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c06e8c0 con 0x7f727c136f50 2023-10-03T10:16:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f72820c9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727c136f50 0x7f727c139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f72810c7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f727c134630 0x7f727c136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f72810c7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f727c134630 0x7f727c136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35676/0 (socket says 172.21.15.72:35676) 2023-10-03T10:16:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f72820c9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727c136f50 0x7f727c139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46610/0 (socket says 172.21.15.72:46610) 2023-10-03T10:16:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f72810c7700 1 -- 172.21.15.72:0/525046439 learned_addr learned my addr 172.21.15.72:0/525046439 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f72820c9700 1 -- 172.21.15.72:0/525046439 >> v2:172.21.15.72:3300/0 conn(0x7f727c134630 msgr2=0x7f727c136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f72820c9700 1 --2- 172.21.15.72:0/525046439 >> v2:172.21.15.72:3300/0 conn(0x7f727c134630 0x7f727c136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f72820c9700 1 -- 172.21.15.72:0/525046439 >> v1:172.21.15.72:6789/0 conn(0x7f727c131810 legacy=0x7f727c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f72820c9700 1 -- 172.21.15.72:0/525046439 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c071d20 con 0x7f727c136f50 2023-10-03T10:16:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f72808c6700 1 -- 172.21.15.72:0/525046439 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341030842 0 0) 0x7f727c09b4f0 con 0x7f727c131810 2023-10-03T10:16:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f72810c7700 1 --2- 172.21.15.72:0/525046439 >> v2:172.21.15.72:3300/0 conn(0x7f727c134630 0x7f727c136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f72820c9700 1 --2- 172.21.15.72:0/525046439 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727c136f50 0x7f727c139330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7274009d90 tx=0x7f727400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6c4652b748ddd73 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f72808c6700 1 -- 172.21.15.72:0/525046439 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727400e070 con 0x7f727c136f50 2023-10-03T10:16:11.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f72808c6700 1 -- 172.21.15.72:0/525046439 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727400bb20 con 0x7f727c136f50 2023-10-03T10:16:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.934+0000 7f72808c6700 1 -- 172.21.15.72:0/525046439 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274012430 con 0x7f727c136f50 2023-10-03T10:16:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.935+0000 7f7283b2c700 1 -- 172.21.15.72:0/525046439 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727c136f50 msgr2=0x7f727c139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.935+0000 7f7283b2c700 1 --2- 172.21.15.72:0/525046439 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727c136f50 0x7f727c139330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7274009d90 tx=0x7f727400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.935+0000 7f7283b2c700 1 -- 172.21.15.72:0/525046439 shutdown_connections 2023-10-03T10:16:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.935+0000 7f7283b2c700 1 --2- 172.21.15.72:0/525046439 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727c136f50 0x7f727c139330 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.935+0000 7f7283b2c700 1 --2- 172.21.15.72:0/525046439 >> v2:172.21.15.72:3300/0 conn(0x7f727c134630 0x7f727c136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.935+0000 7f7283b2c700 1 -- 172.21.15.72:0/525046439 >> 172.21.15.72:0/525046439 conn(0x7f727c0a2aa0 msgr2=0x7f727c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.935+0000 7f7283b2c700 1 -- 172.21.15.72:0/525046439 shutdown_connections 2023-10-03T10:16:11.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.935+0000 7f7283b2c700 1 -- 172.21.15.72:0/525046439 wait complete. 2023-10-03T10:16:11.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.936+0000 7f7283b2c700 1 Processor -- start 2023-10-03T10:16:11.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.936+0000 7f7283b2c700 1 -- start start 2023-10-03T10:16:11.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.936+0000 7f7283b2c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f727c131810 0x7f727c118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.936+0000 7f7283b2c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c134630 0x7f727c119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.936+0000 7f7283b2c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727c136f50 0x7f727c119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:11.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.936+0000 7f7283b2c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c12e540 con 0x7f727c134630 2023-10-03T10:16:11.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.936+0000 7f7283b2c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c12eb00 con 0x7f727c136f50 2023-10-03T10:16:11.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.936+0000 7f7283b2c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f727c11c730 con 0x7f727c131810 2023-10-03T10:16:11.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.936+0000 7f72810c7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c134630 0x7f727c119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.936+0000 7f72818c8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f727c131810 0x7f727c118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.936+0000 7f72820c9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727c136f50 0x7f727c119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:11.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.937+0000 7f72810c7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c134630 0x7f727c119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35680/0 (socket says 172.21.15.72:35680) 2023-10-03T10:16:11.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.937+0000 7f72810c7700 1 -- 172.21.15.72:0/2521828546 learned_addr learned my addr 172.21.15.72:0/2521828546 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:11.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.937+0000 7f72820c9700 1 -- 172.21.15.72:0/2521828546 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f727c131810 msgr2=0x7f727c118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.937+0000 7f72820c9700 1 --2- 172.21.15.72:0/2521828546 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f727c131810 0x7f727c118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.937+0000 7f72820c9700 1 -- 172.21.15.72:0/2521828546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c134630 msgr2=0x7f727c119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.937+0000 7f72820c9700 1 --2- 172.21.15.72:0/2521828546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c134630 0x7f727c119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.937+0000 7f72820c9700 1 -- 172.21.15.72:0/2521828546 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7278009550 con 0x7f727c136f50 2023-10-03T10:16:11.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.937+0000 7f72820c9700 1 --2- 172.21.15.72:0/2521828546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727c136f50 0x7f727c119750 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7274016000 tx=0x7f7274004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:11.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.937+0000 7f72727fc700 1 -- 172.21.15.72:0/2521828546 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274012430 con 0x7f727c136f50 2023-10-03T10:16:11.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.937+0000 7f72727fc700 1 -- 172.21.15.72:0/2521828546 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7274020070 con 0x7f727c136f50 2023-10-03T10:16:11.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.937+0000 7f7283b2c700 1 -- 172.21.15.72:0/2521828546 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7274009a70 con 0x7f727c136f50 2023-10-03T10:16:11.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.937+0000 7f72727fc700 1 -- 172.21.15.72:0/2521828546 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274004280 con 0x7f727c136f50 2023-10-03T10:16:11.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.937+0000 7f7283b2c700 1 -- 172.21.15.72:0/2521828546 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c11b0a0 con 0x7f727c136f50 2023-10-03T10:16:11.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.938+0000 7f72727fc700 1 -- 172.21.15.72:0/2521828546 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72740043e0 con 0x7f727c136f50 2023-10-03T10:16:11.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.938+0000 7f72727fc700 1 -- 172.21.15.72:0/2521828546 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7274022070 con 0x7f727c136f50 2023-10-03T10:16:11.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.938+0000 7f7283b2c700 1 -- 172.21.15.72:0/2521828546 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727c074ea0 con 0x7f727c136f50 2023-10-03T10:16:11.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:11.942+0000 7f72727fc700 1 -- 172.21.15.72:0/2521828546 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f727401a380 con 0x7f727c136f50 2023-10-03T10:16:11.944 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:12.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:12.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.071+0000 7fef26bba700 1 Processor -- start 2023-10-03T10:16:12.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.071+0000 7fef26bba700 1 -- start start 2023-10-03T10:16:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.071+0000 7fef26bba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef2009d6f0 0x7fef2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.071+0000 7fef26bba700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef2009e000 0x7fef201339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.071+0000 7fef26bba700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef2009e410 0x7fef20133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.071+0000 7fef26bba700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2006b460 con 0x7fef2009e410 2023-10-03T10:16:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.071+0000 7fef26bba700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2009b120 con 0x7fef2009d6f0 2023-10-03T10:16:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.071+0000 7fef26bba700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef2009a7e0 con 0x7fef2009e000 2023-10-03T10:16:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.071+0000 7fef1ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef2009e000 0x7fef201339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.071+0000 7fef1ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef2009e000 0x7fef201339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51984/0 (socket says 172.21.15.72:51984) 2023-10-03T10:16:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.071+0000 7fef1ffff700 1 -- 172.21.15.72:0/2862215264 learned_addr learned my addr 172.21.15.72:0/2862215264 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.071+0000 7fef24956700 1 --2- 172.21.15.72:0/2862215264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef2009d6f0 0x7fef2009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.071+0000 7fef25157700 1 --2- 172.21.15.72:0/2862215264 >> v2:172.21.15.72:3300/0 conn(0x7fef2009e410 0x7fef20133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.072+0000 7fef25157700 1 -- 172.21.15.72:0/2862215264 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef2009e000 msgr2=0x7fef201339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.072+0000 7fef25157700 1 --2- 172.21.15.72:0/2862215264 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef2009e000 0x7fef201339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.072+0000 7fef25157700 1 -- 172.21.15.72:0/2862215264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef2009d6f0 msgr2=0x7fef2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.072+0000 7fef25157700 1 --2- 172.21.15.72:0/2862215264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef2009d6f0 0x7fef2009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.072+0000 7fef25157700 1 -- 172.21.15.72:0/2862215264 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2009a500 con 0x7fef2009e410 2023-10-03T10:16:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.072+0000 7fef1ffff700 1 --2- 172.21.15.72:0/2862215264 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef2009e000 0x7fef201339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.072+0000 7fef24956700 1 --2- 172.21.15.72:0/2862215264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef2009d6f0 0x7fef2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.072+0000 7fef25157700 1 --2- 172.21.15.72:0/2862215264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef2009e410 0x7fef20133f30 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fef18009d90 tx=0x7fef1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dac1cb1a671cebb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.072+0000 7fef1f7fe700 1 -- 172.21.15.72:0/2862215264 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800e070 con 0x7fef2009e410 2023-10-03T10:16:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.072+0000 7fef1f7fe700 1 -- 172.21.15.72:0/2862215264 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1800bb20 con 0x7fef2009e410 2023-10-03T10:16:12.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.072+0000 7fef1f7fe700 1 -- 172.21.15.72:0/2862215264 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18012430 con 0x7fef2009e410 2023-10-03T10:16:12.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.073+0000 7fef26bba700 1 -- 172.21.15.72:0/2862215264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef2009e410 msgr2=0x7fef20133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.073+0000 7fef26bba700 1 --2- 172.21.15.72:0/2862215264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef2009e410 0x7fef20133f30 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fef18009d90 tx=0x7fef1800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:12.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.073+0000 7fef26bba700 1 -- 172.21.15.72:0/2862215264 shutdown_connections 2023-10-03T10:16:12.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.073+0000 7fef26bba700 1 --2- 172.21.15.72:0/2862215264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef2009e410 0x7fef20133f30 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.073+0000 7fef26bba700 1 --2- 172.21.15.72:0/2862215264 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef2009d6f0 0x7fef2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.073+0000 7fef26bba700 1 --2- 172.21.15.72:0/2862215264 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef2009e000 0x7fef201339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.073+0000 7fef26bba700 1 -- 172.21.15.72:0/2862215264 >> 172.21.15.72:0/2862215264 conn(0x7fef20066f50 msgr2=0x7fef2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.073+0000 7fef26bba700 1 -- 172.21.15.72:0/2862215264 shutdown_connections 2023-10-03T10:16:12.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.073+0000 7fef26bba700 1 -- 172.21.15.72:0/2862215264 wait complete. 2023-10-03T10:16:12.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.074+0000 7fef26bba700 1 Processor -- start 2023-10-03T10:16:12.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.074+0000 7fef26bba700 1 -- start start 2023-10-03T10:16:12.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef26bba700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef2009d6f0 0x7fef201c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef26bba700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef2009e000 0x7fef201c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef26bba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef2009e410 0x7fef201c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef26bba700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef201a65c0 con 0x7fef2009e000 2023-10-03T10:16:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef26bba700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef201a63d0 con 0x7fef2009e410 2023-10-03T10:16:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef26bba700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef2009c710 con 0x7fef2009d6f0 2023-10-03T10:16:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef24956700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef2009d6f0 0x7fef201c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef24956700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef2009d6f0 0x7fef201c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51990/0 (socket says 172.21.15.72:51990) 2023-10-03T10:16:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef24956700 1 -- 172.21.15.72:0/885154661 learned_addr learned my addr 172.21.15.72:0/885154661 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef1ffff700 1 --2- 172.21.15.72:0/885154661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef2009e000 0x7fef201c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef25157700 1 --2- 172.21.15.72:0/885154661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef2009e410 0x7fef201c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef24956700 1 -- 172.21.15.72:0/885154661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef2009e410 msgr2=0x7fef201c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef24956700 1 --2- 172.21.15.72:0/885154661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef2009e410 0x7fef201c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef24956700 1 -- 172.21.15.72:0/885154661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef2009e000 msgr2=0x7fef201c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef24956700 1 --2- 172.21.15.72:0/885154661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef2009e000 0x7fef201c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef24956700 1 -- 172.21.15.72:0/885154661 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef140094a0 con 0x7fef2009d6f0 2023-10-03T10:16:12.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.075+0000 7fef24956700 1 --2- 172.21.15.72:0/885154661 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef2009d6f0 0x7fef201c8040 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fef1400ebe0 tx=0x7fef1400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.076+0000 7fef1d7fa700 1 -- 172.21.15.72:0/885154661 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1400c850 con 0x7fef2009d6f0 2023-10-03T10:16:12.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.076+0000 7fef1d7fa700 1 -- 172.21.15.72:0/885154661 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1400c9b0 con 0x7fef2009d6f0 2023-10-03T10:16:12.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.076+0000 7fef1d7fa700 1 -- 172.21.15.72:0/885154661 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1400cd40 con 0x7fef2009d6f0 2023-10-03T10:16:12.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.076+0000 7fef26bba700 1 -- 172.21.15.72:0/885154661 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0c009550 con 0x7fef2009d6f0 2023-10-03T10:16:12.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.076+0000 7fef26bba700 1 -- 172.21.15.72:0/885154661 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef18009a70 con 0x7fef2009d6f0 2023-10-03T10:16:12.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.077+0000 7fef1d7fa700 1 -- 172.21.15.72:0/885154661 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef14013470 con 0x7fef2009d6f0 2023-10-03T10:16:12.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.077+0000 7fef26bba700 1 -- 172.21.15.72:0/885154661 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2009aca0 con 0x7fef2009d6f0 2023-10-03T10:16:12.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.077+0000 7fef1d7fa700 1 -- 172.21.15.72:0/885154661 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef1403f770 con 0x7fef2009d6f0 2023-10-03T10:16:12.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.082+0000 7fef1d7fa700 1 -- 172.21.15.72:0/885154661 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef14021020 con 0x7fef2009d6f0 2023-10-03T10:16:12.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.127+0000 7f09d03f1700 1 Processor -- start 2023-10-03T10:16:12.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.128+0000 7f09d03f1700 1 -- start start 2023-10-03T10:16:12.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.128+0000 7f09d03f1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09c8071f40 0x7f09c8133a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.128+0000 7f09d03f1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09c809e000 0x7f09c8133f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.128+0000 7f09d03f1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c8133620 con 0x7f09c809ce60 2023-10-03T10:16:12.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.128+0000 7f09d03f1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c8072310 con 0x7f09c8071f40 2023-10-03T10:16:12.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.128+0000 7f09d03f1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09c809a190 con 0x7f09c809e000 2023-10-03T10:16:12.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.128+0000 7f09ce18d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09c8071f40 0x7f09c8133a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.128+0000 7f09cd98c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09c809e000 0x7f09c8133f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.128+0000 7f09ce18d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09c8071f40 0x7f09c8133a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35708/0 (socket says 172.21.15.72:35708) 2023-10-03T10:16:12.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.128+0000 7f09ce18d700 1 -- 172.21.15.72:0/4238433705 learned_addr learned my addr 172.21.15.72:0/4238433705 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:12.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.128+0000 7f09cd98c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09c809e000 0x7f09c8133f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51992/0 (socket says 172.21.15.72:51992) 2023-10-03T10:16:12.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.129+0000 7f09ce18d700 1 -- 172.21.15.72:0/4238433705 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09c809e000 msgr2=0x7f09c8133f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.129+0000 7f09ce18d700 1 --2- 172.21.15.72:0/4238433705 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09c809e000 0x7f09c8133f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.129+0000 7f09ce18d700 1 -- 172.21.15.72:0/4238433705 >> v1:172.21.15.72:6789/0 conn(0x7f09c809ce60 legacy=0x7f09c809d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.129+0000 7f09ce18d700 1 -- 172.21.15.72:0/4238433705 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c8134480 con 0x7f09c8071f40 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.129+0000 7f09cd98c700 1 --2- 172.21.15.72:0/4238433705 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09c809e000 0x7f09c8133f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.129+0000 7f09ce18d700 1 --2- 172.21.15.72:0/4238433705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09c8071f40 0x7f09c8133a00 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f09c40098f0 tx=0x7f09c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202dba5f339720c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.129+0000 7f09cd18b700 1 -- 172.21.15.72:0/4238433705 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c4011830 con 0x7f09c8071f40 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.129+0000 7f09cd18b700 1 -- 172.21.15.72:0/4238433705 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c4011990 con 0x7f09c8071f40 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.129+0000 7f09cd18b700 1 -- 172.21.15.72:0/4238433705 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c4011d20 con 0x7f09c8071f40 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.130+0000 7f09d03f1700 1 -- 172.21.15.72:0/4238433705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09c8071f40 msgr2=0x7f09c8133a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.130+0000 7f09d03f1700 1 --2- 172.21.15.72:0/4238433705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09c8071f40 0x7f09c8133a00 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f09c40098f0 tx=0x7f09c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:12.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.130+0000 7f09d03f1700 1 -- 172.21.15.72:0/4238433705 shutdown_connections 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.130+0000 7f09d03f1700 1 --2- 172.21.15.72:0/4238433705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09c8071f40 0x7f09c8133a00 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.130+0000 7f09d03f1700 1 --2- 172.21.15.72:0/4238433705 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09c809e000 0x7f09c8133f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.130+0000 7f09d03f1700 1 -- 172.21.15.72:0/4238433705 >> 172.21.15.72:0/4238433705 conn(0x7f09c80a2360 msgr2=0x7f09c80a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.130+0000 7f09d03f1700 1 -- 172.21.15.72:0/4238433705 shutdown_connections 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.130+0000 7f09d03f1700 1 -- 172.21.15.72:0/4238433705 wait complete. 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.131+0000 7f09d03f1700 1 Processor -- start 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.131+0000 7f09d03f1700 1 -- start start 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.131+0000 7f09d03f1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09c8071f40 0x7f09c812e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.131+0000 7f09d03f1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09c809ce60 0x7f09c812eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.131+0000 7f09d03f1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09c809e000 0x7f09c812f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.131+0000 7f09d03f1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c80a0c60 con 0x7f09c809e000 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.131+0000 7f09d03f1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c812f9f0 con 0x7f09c8071f40 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.131+0000 7f09d03f1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09c808b8e0 con 0x7f09c809ce60 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.131+0000 7f09cd98c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09c809ce60 0x7f09c812eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.131+0000 7f09cd98c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09c809ce60 0x7f09c812eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51998/0 (socket says 172.21.15.72:51998) 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.131+0000 7f09cd98c700 1 -- 172.21.15.72:0/4154808733 learned_addr learned my addr 172.21.15.72:0/4154808733 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.131+0000 7f09ce98e700 1 --2- 172.21.15.72:0/4154808733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09c809e000 0x7f09c812f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.131+0000 7f09ce18d700 1 --2- 172.21.15.72:0/4154808733 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09c8071f40 0x7f09c812e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.132+0000 7f09cd98c700 1 -- 172.21.15.72:0/4154808733 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09c8071f40 msgr2=0x7f09c812e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.132+0000 7f09cd98c700 1 --2- 172.21.15.72:0/4154808733 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09c8071f40 0x7f09c812e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.132+0000 7f09cd98c700 1 -- 172.21.15.72:0/4154808733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09c809e000 msgr2=0x7f09c812f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.132+0000 7f09cd98c700 1 --2- 172.21.15.72:0/4154808733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09c809e000 0x7f09c812f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.132+0000 7f09cd98c700 1 -- 172.21.15.72:0/4154808733 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b80094a0 con 0x7f09c809ce60 2023-10-03T10:16:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.132+0000 7f09cd98c700 1 --2- 172.21.15.72:0/4154808733 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09c809ce60 0x7f09c812eb40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f09b800ec10 tx=0x7f09b800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.132+0000 7f09beffd700 1 -- 172.21.15.72:0/4154808733 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b800c7f0 con 0x7f09c809ce60 2023-10-03T10:16:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.132+0000 7f09beffd700 1 -- 172.21.15.72:0/4154808733 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b800c950 con 0x7f09c809ce60 2023-10-03T10:16:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.132+0000 7f09beffd700 1 -- 172.21.15.72:0/4154808733 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b800ccc0 con 0x7f09c809ce60 2023-10-03T10:16:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.132+0000 7f09d03f1700 1 -- 172.21.15.72:0/4154808733 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c4009550 con 0x7f09c809ce60 2023-10-03T10:16:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.132+0000 7f09d03f1700 1 -- 172.21.15.72:0/4154808733 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c808b4f0 con 0x7f09c809ce60 2023-10-03T10:16:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.133+0000 7f09beffd700 1 -- 172.21.15.72:0/4154808733 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09b8013470 con 0x7f09c809ce60 2023-10-03T10:16:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.133+0000 7f09d03f1700 1 -- 172.21.15.72:0/4154808733 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c8074ea0 con 0x7f09c809ce60 2023-10-03T10:16:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.133+0000 7f09beffd700 1 -- 172.21.15.72:0/4154808733 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09b803fae0 con 0x7f09c809ce60 2023-10-03T10:16:12.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.142+0000 7f09beffd700 1 -- 172.21.15.72:0/4154808733 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09b8021020 con 0x7f09c809ce60 2023-10-03T10:16:12.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.150+0000 7f7283b2c700 1 -- 172.21.15.72:0/2521828546 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f727c06b9e0 con 0x7f727c136f50 2023-10-03T10:16:12.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.151+0000 7f72727fc700 1 -- 172.21.15.72:0/2521828546 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7274011b80 con 0x7f727c136f50 2023-10-03T10:16:12.151 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.153+0000 7f7283b2c700 1 -- 172.21.15.72:0/2521828546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727c136f50 msgr2=0x7f727c119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.153+0000 7f7283b2c700 1 --2- 172.21.15.72:0/2521828546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727c136f50 0x7f727c119750 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7274016000 tx=0x7f7274004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.153+0000 7f7283b2c700 1 -- 172.21.15.72:0/2521828546 shutdown_connections 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.153+0000 7f7283b2c700 1 --2- 172.21.15.72:0/2521828546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727c136f50 0x7f727c119750 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.153+0000 7f7283b2c700 1 --2- 172.21.15.72:0/2521828546 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f727c131810 0x7f727c118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.153+0000 7f7283b2c700 1 --2- 172.21.15.72:0/2521828546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727c134630 0x7f727c119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.153+0000 7f7283b2c700 1 -- 172.21.15.72:0/2521828546 >> 172.21.15.72:0/2521828546 conn(0x7f727c0a2aa0 msgr2=0x7f727c12f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.153+0000 7f7283b2c700 1 -- 172.21.15.72:0/2521828546 shutdown_connections 2023-10-03T10:16:12.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.153+0000 7f7283b2c700 1 -- 172.21.15.72:0/2521828546 wait complete. 2023-10-03T10:16:12.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:12.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:12.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.279+0000 7fef26bba700 1 -- 172.21.15.72:0/885154661 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fef2009f420 con 0x7fef2009d6f0 2023-10-03T10:16:12.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.279+0000 7fef1d7fa700 1 -- 172.21.15.72:0/885154661 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fef1400cea0 con 0x7fef2009d6f0 2023-10-03T10:16:12.280 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:12.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.281+0000 7fef26bba700 1 -- 172.21.15.72:0/885154661 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef2009d6f0 msgr2=0x7fef201c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.281+0000 7fef26bba700 1 --2- 172.21.15.72:0/885154661 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef2009d6f0 0x7fef201c8040 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fef1400ebe0 tx=0x7fef1400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.281+0000 7fef26bba700 1 -- 172.21.15.72:0/885154661 shutdown_connections 2023-10-03T10:16:12.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.281+0000 7fef26bba700 1 --2- 172.21.15.72:0/885154661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef2009e410 0x7fef201c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.281+0000 7fef26bba700 1 --2- 172.21.15.72:0/885154661 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef2009d6f0 0x7fef201c8040 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.281+0000 7fef26bba700 1 --2- 172.21.15.72:0/885154661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef2009e000 0x7fef201c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.281+0000 7fef26bba700 1 -- 172.21.15.72:0/885154661 >> 172.21.15.72:0/885154661 conn(0x7fef20066f50 msgr2=0x7fef201bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.281+0000 7fef26bba700 1 -- 172.21.15.72:0/885154661 shutdown_connections 2023-10-03T10:16:12.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.281+0000 7fef26bba700 1 -- 172.21.15.72:0/885154661 wait complete. 2023-10-03T10:16:12.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:12.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.335+0000 7f09d03f1700 1 -- 172.21.15.72:0/4154808733 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f09c8130b00 con 0x7f09c809ce60 2023-10-03T10:16:12.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.336+0000 7f09beffd700 1 -- 172.21.15.72:0/4154808733 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f09b8013720 con 0x7f09c809ce60 2023-10-03T10:16:12.336 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.338+0000 7f09d03f1700 1 -- 172.21.15.72:0/4154808733 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09c809ce60 msgr2=0x7f09c812eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.338+0000 7f09d03f1700 1 --2- 172.21.15.72:0/4154808733 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09c809ce60 0x7f09c812eb40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f09b800ec10 tx=0x7f09b800ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.338+0000 7f09d03f1700 1 -- 172.21.15.72:0/4154808733 shutdown_connections 2023-10-03T10:16:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.338+0000 7f09d03f1700 1 --2- 172.21.15.72:0/4154808733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09c809e000 0x7f09c812f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.338+0000 7f09d03f1700 1 --2- 172.21.15.72:0/4154808733 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09c8071f40 0x7f09c812e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.338+0000 7f09d03f1700 1 --2- 172.21.15.72:0/4154808733 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f09c809ce60 0x7f09c812eb40 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.338+0000 7f09d03f1700 1 -- 172.21.15.72:0/4154808733 >> 172.21.15.72:0/4154808733 conn(0x7f09c80a2360 msgr2=0x7f09c809ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.338+0000 7f09d03f1700 1 -- 172.21.15.72:0/4154808733 shutdown_connections 2023-10-03T10:16:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.338+0000 7f09d03f1700 1 -- 172.21.15.72:0/4154808733 wait complete. 2023-10-03T10:16:12.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:12.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.364+0000 7f979e546700 1 Processor -- start 2023-10-03T10:16:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.364+0000 7f979e546700 1 -- start start 2023-10-03T10:16:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.364+0000 7f979e546700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9798131810 0x7f9798131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.364+0000 7f979e546700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979809a580 0x7f9798139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.364+0000 7f979e546700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97981313c0 con 0x7f9798099a40 2023-10-03T10:16:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.364+0000 7f979e546700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979806e8c0 con 0x7f9798131810 2023-10-03T10:16:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.365+0000 7f979e546700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9798071d20 con 0x7f979809a580 2023-10-03T10:16:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.365+0000 7f9797fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9798131810 0x7f9798131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.365+0000 7f979cae3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979809a580 0x7f9798139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.365+0000 7f979cae3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979809a580 0x7f9798139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52002/0 (socket says 172.21.15.72:52002) 2023-10-03T10:16:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.365+0000 7f9797fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9798131810 0x7f9798131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35720/0 (socket says 172.21.15.72:35720) 2023-10-03T10:16:12.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.365+0000 7f979cae3700 1 -- 172.21.15.72:0/3955848846 learned_addr learned my addr 172.21.15.72:0/3955848846 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.365+0000 7f9797fff700 1 -- 172.21.15.72:0/3955848846 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979809a580 msgr2=0x7f9798139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.365+0000 7f9797fff700 1 --2- 172.21.15.72:0/3955848846 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979809a580 0x7f9798139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.365+0000 7f9797fff700 1 -- 172.21.15.72:0/3955848846 >> v1:172.21.15.72:6789/0 conn(0x7f9798099a40 legacy=0x7f9798099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.365+0000 7f9797fff700 1 -- 172.21.15.72:0/3955848846 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97980721a0 con 0x7f9798131810 2023-10-03T10:16:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.365+0000 7f979cae3700 1 --2- 172.21.15.72:0/3955848846 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979809a580 0x7f9798139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.365+0000 7f9797fff700 1 --2- 172.21.15.72:0/3955848846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9798131810 0x7f9798131be0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f978c009840 tx=0x7f978c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be75182cf94abad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.365+0000 7f9796ffd700 1 -- 172.21.15.72:0/3955848846 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c011830 con 0x7f9798131810 2023-10-03T10:16:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.365+0000 7f9796ffd700 1 -- 172.21.15.72:0/3955848846 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c011990 con 0x7f9798131810 2023-10-03T10:16:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.365+0000 7f9796ffd700 1 -- 172.21.15.72:0/3955848846 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c011d20 con 0x7f9798131810 2023-10-03T10:16:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.366+0000 7f979e546700 1 -- 172.21.15.72:0/3955848846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9798131810 msgr2=0x7f9798131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.366+0000 7f979e546700 1 --2- 172.21.15.72:0/3955848846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9798131810 0x7f9798131be0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f978c009840 tx=0x7f978c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:12.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.366+0000 7f979e546700 1 -- 172.21.15.72:0/3955848846 shutdown_connections 2023-10-03T10:16:12.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.366+0000 7f979e546700 1 --2- 172.21.15.72:0/3955848846 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979809a580 0x7f9798139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.366+0000 7f979e546700 1 --2- 172.21.15.72:0/3955848846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9798131810 0x7f9798131be0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.366+0000 7f979e546700 1 -- 172.21.15.72:0/3955848846 >> 172.21.15.72:0/3955848846 conn(0x7f97980a2aa0 msgr2=0x7f97980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.366+0000 7f979e546700 1 -- 172.21.15.72:0/3955848846 shutdown_connections 2023-10-03T10:16:12.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.366+0000 7f979e546700 1 -- 172.21.15.72:0/3955848846 wait complete. 2023-10-03T10:16:12.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.367+0000 7f979e546700 1 Processor -- start 2023-10-03T10:16:12.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.367+0000 7f979e546700 1 -- start start 2023-10-03T10:16:12.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.367+0000 7f979e546700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9798099a40 0x7f979811b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.367+0000 7f979e546700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979809a580 0x7f979811baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.367+0000 7f979e546700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9798131810 0x7f979811c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.367+0000 7f979e546700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979811d1c0 con 0x7f9798131810 2023-10-03T10:16:12.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.367+0000 7f979e546700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979811e410 con 0x7f9798099a40 2023-10-03T10:16:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.367+0000 7f979e546700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f979811d7b0 con 0x7f979809a580 2023-10-03T10:16:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.367+0000 7f9797fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9798099a40 0x7f979811b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.367+0000 7f979cae3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9798131810 0x7f979811c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.367+0000 7f97977fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979809a580 0x7f979811baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.367+0000 7f979cae3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9798131810 0x7f979811c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35726/0 (socket says 172.21.15.72:35726) 2023-10-03T10:16:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.367+0000 7f9797fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9798099a40 0x7f979811b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46656/0 (socket says 172.21.15.72:46656) 2023-10-03T10:16:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.367+0000 7f979cae3700 1 -- 172.21.15.72:0/3323108808 learned_addr learned my addr 172.21.15.72:0/3323108808 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.368+0000 7f97977fe700 1 -- 172.21.15.72:0/3323108808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9798099a40 msgr2=0x7f979811b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.368+0000 7f97977fe700 1 --2- 172.21.15.72:0/3323108808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9798099a40 0x7f979811b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.368+0000 7f97977fe700 1 -- 172.21.15.72:0/3323108808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9798131810 msgr2=0x7f979811c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.368+0000 7f97977fe700 1 --2- 172.21.15.72:0/3323108808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9798131810 0x7f979811c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.368+0000 7f97977fe700 1 -- 172.21.15.72:0/3323108808 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9790009b30 con 0x7f979809a580 2023-10-03T10:16:12.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.368+0000 7f979cae3700 1 --2- 172.21.15.72:0/3323108808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9798131810 0x7f979811c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.368+0000 7f9797fff700 1 --2- 172.21.15.72:0/3323108808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9798099a40 0x7f979811b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.368+0000 7f97977fe700 1 --2- 172.21.15.72:0/3323108808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979809a580 0x7f979811baf0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9798066c70 tx=0x7f978800c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.368+0000 7f9794ff9700 1 -- 172.21.15.72:0/3323108808 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880052d0 con 0x7f979809a580 2023-10-03T10:16:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.368+0000 7f9794ff9700 1 -- 172.21.15.72:0/3323108808 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9788005430 con 0x7f979809a580 2023-10-03T10:16:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.368+0000 7f9794ff9700 1 -- 172.21.15.72:0/3323108808 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880038c0 con 0x7f979809a580 2023-10-03T10:16:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.368+0000 7f979e546700 1 -- 172.21.15.72:0/3323108808 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978c0094a0 con 0x7f979809a580 2023-10-03T10:16:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.368+0000 7f979e546700 1 -- 172.21.15.72:0/3323108808 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979806eb00 con 0x7f979809a580 2023-10-03T10:16:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.369+0000 7f9794ff9700 1 -- 172.21.15.72:0/3323108808 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9788003c30 con 0x7f979809a580 2023-10-03T10:16:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.369+0000 7f9794ff9700 1 -- 172.21.15.72:0/3323108808 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f978803eb80 con 0x7f979809a580 2023-10-03T10:16:12.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.369+0000 7f979e546700 1 -- 172.21.15.72:0/3323108808 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9798074ea0 con 0x7f979809a580 2023-10-03T10:16:12.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.374+0000 7f9794ff9700 1 -- 172.21.15.72:0/3323108808 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f978803ee60 con 0x7f979809a580 2023-10-03T10:16:12.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.558+0000 7f979e546700 1 -- 172.21.15.72:0/3323108808 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f979806b9e0 con 0x7f979809a580 2023-10-03T10:16:12.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.558+0000 7f9794ff9700 1 -- 172.21.15.72:0/3323108808 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9788017020 con 0x7f979809a580 2023-10-03T10:16:12.559 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.560+0000 7f979e546700 1 -- 172.21.15.72:0/3323108808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979809a580 msgr2=0x7f979811baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.560+0000 7f979e546700 1 --2- 172.21.15.72:0/3323108808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979809a580 0x7f979811baf0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9798066c70 tx=0x7f978800c730 comp rx=0 tx=0).stop 2023-10-03T10:16:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.560+0000 7f979e546700 1 -- 172.21.15.72:0/3323108808 shutdown_connections 2023-10-03T10:16:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.560+0000 7f979e546700 1 --2- 172.21.15.72:0/3323108808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9798131810 0x7f979811c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.560+0000 7f979e546700 1 --2- 172.21.15.72:0/3323108808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9798099a40 0x7f979811b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.560+0000 7f979e546700 1 --2- 172.21.15.72:0/3323108808 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f979809a580 0x7f979811baf0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.560+0000 7f979e546700 1 -- 172.21.15.72:0/3323108808 >> 172.21.15.72:0/3323108808 conn(0x7f97980a2aa0 msgr2=0x7f97981b8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.560+0000 7f979e546700 1 -- 172.21.15.72:0/3323108808 shutdown_connections 2023-10-03T10:16:12.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:12.560+0000 7f979e546700 1 -- 172.21.15.72:0/3323108808 wait complete. 2023-10-03T10:16:12.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:13.167 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:13.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:13.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.300+0000 7fe8f118a700 1 Processor -- start 2023-10-03T10:16:13.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.300+0000 7fe8f118a700 1 -- start start 2023-10-03T10:16:13.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.301+0000 7fe8f118a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8ec09e1d0 0x7fe8ec138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.301+0000 7fe8f118a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8ec139170 0x7fe8ec13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.301+0000 7fe8f118a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ec09b120 con 0x7fe8ec09d6f0 2023-10-03T10:16:13.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.301+0000 7fe8f118a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ec06b460 con 0x7fe8ec09e1d0 2023-10-03T10:16:13.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.301+0000 7fe8f118a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec09a7e0 con 0x7fe8ec139170 2023-10-03T10:16:13.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.301+0000 7fe8ea59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8ec09e1d0 0x7fe8ec138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.301+0000 7fe8ea59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8ec09e1d0 0x7fe8ec138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35732/0 (socket says 172.21.15.72:35732) 2023-10-03T10:16:13.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.301+0000 7fe8ea59c700 1 -- 172.21.15.72:0/1455424625 learned_addr learned my addr 172.21.15.72:0/1455424625 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:13.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.301+0000 7fe8eb59e700 1 --2- 172.21.15.72:0/1455424625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8ec139170 0x7fe8ec13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.302+0000 7fe8ea59c700 1 -- 172.21.15.72:0/1455424625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8ec139170 msgr2=0x7fe8ec13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.302+0000 7fe8ea59c700 1 --2- 172.21.15.72:0/1455424625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8ec139170 0x7fe8ec13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.302+0000 7fe8ea59c700 1 -- 172.21.15.72:0/1455424625 >> v1:172.21.15.72:6789/0 conn(0x7fe8ec09d6f0 legacy=0x7fe8ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.302+0000 7fe8ea59c700 1 -- 172.21.15.72:0/1455424625 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec09a500 con 0x7fe8ec09e1d0 2023-10-03T10:16:13.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.302+0000 7fe8ea59c700 1 --2- 172.21.15.72:0/1455424625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8ec09e1d0 0x7fe8ec138c30 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009920 tx=0x7fe8d4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04b930d821c229c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.302+0000 7fe8e9d9b700 1 -- 172.21.15.72:0/1455424625 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4011830 con 0x7fe8ec09e1d0 2023-10-03T10:16:13.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.302+0000 7fe8e9d9b700 1 -- 172.21.15.72:0/1455424625 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d4011990 con 0x7fe8ec09e1d0 2023-10-03T10:16:13.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.302+0000 7fe8e9d9b700 1 -- 172.21.15.72:0/1455424625 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4011d20 con 0x7fe8ec09e1d0 2023-10-03T10:16:13.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.303+0000 7fe8f118a700 1 -- 172.21.15.72:0/1455424625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8ec09e1d0 msgr2=0x7fe8ec138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.303+0000 7fe8f118a700 1 --2- 172.21.15.72:0/1455424625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8ec09e1d0 0x7fe8ec138c30 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4009920 tx=0x7fe8d4009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:13.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.303+0000 7fe8f118a700 1 -- 172.21.15.72:0/1455424625 shutdown_connections 2023-10-03T10:16:13.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.303+0000 7fe8f118a700 1 --2- 172.21.15.72:0/1455424625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8ec139170 0x7fe8ec13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.303+0000 7fe8f118a700 1 --2- 172.21.15.72:0/1455424625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8ec09e1d0 0x7fe8ec138c30 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.303+0000 7fe8f118a700 1 -- 172.21.15.72:0/1455424625 >> 172.21.15.72:0/1455424625 conn(0x7fe8ec066f50 msgr2=0x7fe8ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.303+0000 7fe8f118a700 1 -- 172.21.15.72:0/1455424625 shutdown_connections 2023-10-03T10:16:13.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.303+0000 7fe8f118a700 1 -- 172.21.15.72:0/1455424625 wait complete. 2023-10-03T10:16:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.304+0000 7fe8f118a700 1 Processor -- start 2023-10-03T10:16:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.304+0000 7fe8f118a700 1 -- start start 2023-10-03T10:16:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.305+0000 7fe8f118a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8ec09d6f0 0x7fe8ec11e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.305+0000 7fe8f118a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8ec09e1d0 0x7fe8ec11eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.305+0000 7fe8f118a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8ec139170 0x7fe8ec11f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.305+0000 7fe8f118a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec120630 con 0x7fe8ec09d6f0 2023-10-03T10:16:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.305+0000 7fe8f118a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec120a90 con 0x7fe8ec09e1d0 2023-10-03T10:16:13.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.305+0000 7fe8f118a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec09c710 con 0x7fe8ec139170 2023-10-03T10:16:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.305+0000 7fe8ea59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8ec09e1d0 0x7fe8ec11eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.305+0000 7fe8ead9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8ec09d6f0 0x7fe8ec11e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.305+0000 7fe8ea59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8ec09e1d0 0x7fe8ec11eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46674/0 (socket says 172.21.15.72:46674) 2023-10-03T10:16:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.305+0000 7fe8ead9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8ec09d6f0 0x7fe8ec11e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35736/0 (socket says 172.21.15.72:35736) 2023-10-03T10:16:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.305+0000 7fe8ea59c700 1 -- 172.21.15.72:0/2512724400 learned_addr learned my addr 172.21.15.72:0/2512724400 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.305+0000 7fe8eb59e700 1 --2- 172.21.15.72:0/2512724400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8ec139170 0x7fe8ec11f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.306+0000 7fe8ead9d700 1 -- 172.21.15.72:0/2512724400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8ec139170 msgr2=0x7fe8ec11f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.306+0000 7fe8ead9d700 1 --2- 172.21.15.72:0/2512724400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8ec139170 0x7fe8ec11f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.306+0000 7fe8ead9d700 1 -- 172.21.15.72:0/2512724400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8ec09e1d0 msgr2=0x7fe8ec11eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.306+0000 7fe8ead9d700 1 --2- 172.21.15.72:0/2512724400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8ec09e1d0 0x7fe8ec11eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.306+0000 7fe8ead9d700 1 -- 172.21.15.72:0/2512724400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4009550 con 0x7fe8ec09d6f0 2023-10-03T10:16:13.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.306+0000 7fe8ea59c700 1 --2- 172.21.15.72:0/2512724400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8ec09e1d0 0x7fe8ec11eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.306+0000 7fe8eb59e700 1 --2- 172.21.15.72:0/2512724400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8ec139170 0x7fe8ec11f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.306+0000 7fe8ead9d700 1 --2- 172.21.15.72:0/2512724400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8ec09d6f0 0x7fe8ec11e980 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400cbe0 tx=0x7fe8e400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.306+0000 7fe8e37fe700 1 -- 172.21.15.72:0/2512724400 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4003c00 con 0x7fe8ec09d6f0 2023-10-03T10:16:13.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.306+0000 7fe8e37fe700 1 -- 172.21.15.72:0/2512724400 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e4003d60 con 0x7fe8ec09d6f0 2023-10-03T10:16:13.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.306+0000 7fe8e37fe700 1 -- 172.21.15.72:0/2512724400 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e400aaa0 con 0x7fe8ec09d6f0 2023-10-03T10:16:13.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.306+0000 7fe8f118a700 1 -- 172.21.15.72:0/2512724400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ec1220e0 con 0x7fe8ec09d6f0 2023-10-03T10:16:13.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.306+0000 7fe8f118a700 1 -- 172.21.15.72:0/2512724400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ec0720d0 con 0x7fe8ec09d6f0 2023-10-03T10:16:13.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.307+0000 7fe8e37fe700 1 -- 172.21.15.72:0/2512724400 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8e400ac00 con 0x7fe8ec09d6f0 2023-10-03T10:16:13.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.307+0000 7fe8e37fe700 1 -- 172.21.15.72:0/2512724400 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe8e403f5c0 con 0x7fe8ec09d6f0 2023-10-03T10:16:13.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.307+0000 7fe8f118a700 1 -- 172.21.15.72:0/2512724400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ec074ea0 con 0x7fe8ec09d6f0 2023-10-03T10:16:13.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.312+0000 7fe8e37fe700 1 -- 172.21.15.72:0/2512724400 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8e40198f0 con 0x7fe8ec09d6f0 2023-10-03T10:16:13.355 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:13.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.423+0000 7f61f4f3e700 1 Processor -- start 2023-10-03T10:16:13.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.423+0000 7f61f4f3e700 1 -- start start 2023-10-03T10:16:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.424+0000 7f61f4f3e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61f009d6f0 0x7f61f009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.424+0000 7f61f4f3e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f61f009e410 0x7f61f0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.424+0000 7f61f4f3e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f009f130 con 0x7f61f009e000 2023-10-03T10:16:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.424+0000 7f61f4f3e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f009f520 con 0x7f61f009e410 2023-10-03T10:16:13.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.424+0000 7f61f4f3e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f009e930 con 0x7f61f009d6f0 2023-10-03T10:16:13.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.424+0000 7f61eed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f61f009e410 0x7f61f0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.424+0000 7f61edd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f61f009e000 0x7f61f0130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60026/0 (socket says 172.21.15.72:60026) 2023-10-03T10:16:13.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.424+0000 7f61ee59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61f009d6f0 0x7f61f009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.424+0000 7f61eed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f61f009e410 0x7f61f0130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35742/0 (socket says 172.21.15.72:35742) 2023-10-03T10:16:13.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.424+0000 7f61edd9b700 1 -- 172.21.15.72:0/1442415620 learned_addr learned my addr 172.21.15.72:0/1442415620 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:13.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.424+0000 7f61eed9d700 1 -- 172.21.15.72:0/1442415620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61f009d6f0 msgr2=0x7f61f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.424+0000 7f61eed9d700 1 --2- 172.21.15.72:0/1442415620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61f009d6f0 0x7f61f009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.424+0000 7f61eed9d700 1 -- 172.21.15.72:0/1442415620 >> v1:172.21.15.72:6789/0 conn(0x7f61f009e000 legacy=0x7f61f0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.424+0000 7f61eed9d700 1 -- 172.21.15.72:0/1442415620 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f009b2d0 con 0x7f61f009e410 2023-10-03T10:16:13.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.424+0000 7f61ee59c700 1 --2- 172.21.15.72:0/1442415620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61f009d6f0 0x7f61f009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.425+0000 7f61eed9d700 1 --2- 172.21.15.72:0/1442415620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61f009e410 0x7f61f0130d70 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009d90 tx=0x7f61e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa9bca2c298b4b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.425+0000 7f61ed59a700 1 -- 172.21.15.72:0/1442415620 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e800e070 con 0x7f61f009e410 2023-10-03T10:16:13.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.425+0000 7f61ed59a700 1 -- 172.21.15.72:0/1442415620 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e800bb20 con 0x7f61f009e410 2023-10-03T10:16:13.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.425+0000 7f61ed59a700 1 -- 172.21.15.72:0/1442415620 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8012430 con 0x7f61f009e410 2023-10-03T10:16:13.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.425+0000 7f61f4f3e700 1 -- 172.21.15.72:0/1442415620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61f009e410 msgr2=0x7f61f0130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.425+0000 7f61f4f3e700 1 --2- 172.21.15.72:0/1442415620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61f009e410 0x7f61f0130d70 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009d90 tx=0x7f61e800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:13.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.425+0000 7f61f4f3e700 1 -- 172.21.15.72:0/1442415620 shutdown_connections 2023-10-03T10:16:13.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.425+0000 7f61f4f3e700 1 --2- 172.21.15.72:0/1442415620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61f009e410 0x7f61f0130d70 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.425+0000 7f61f4f3e700 1 --2- 172.21.15.72:0/1442415620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61f009d6f0 0x7f61f009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.425+0000 7f61f4f3e700 1 -- 172.21.15.72:0/1442415620 >> 172.21.15.72:0/1442415620 conn(0x7f61f0066f50 msgr2=0x7f61f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.425+0000 7f61f4f3e700 1 -- 172.21.15.72:0/1442415620 shutdown_connections 2023-10-03T10:16:13.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.426+0000 7f61f4f3e700 1 -- 172.21.15.72:0/1442415620 wait complete. 2023-10-03T10:16:13.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.427+0000 7f61f4f3e700 1 Processor -- start 2023-10-03T10:16:13.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.427+0000 7f61f4f3e700 1 -- start start 2023-10-03T10:16:13.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61f4f3e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61f009d6f0 0x7f61f01223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61f4f3e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61f009e000 0x7f61f01228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61f4f3e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61f009e410 0x7f61f0122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61f4f3e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f0125cd0 con 0x7f61f009e410 2023-10-03T10:16:13.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61f4f3e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f0125eb0 con 0x7f61f009e000 2023-10-03T10:16:13.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61f4f3e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61f0125910 con 0x7f61f009d6f0 2023-10-03T10:16:13.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61edd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61f009e000 0x7f61f01228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61ee59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61f009d6f0 0x7f61f01223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61ee59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61f009d6f0 0x7f61f01223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52034/0 (socket says 172.21.15.72:52034) 2023-10-03T10:16:13.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61edd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61f009e000 0x7f61f01228f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46688/0 (socket says 172.21.15.72:46688) 2023-10-03T10:16:13.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61ee59c700 1 -- 172.21.15.72:0/1049691548 learned_addr learned my addr 172.21.15.72:0/1049691548 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:13.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61eed9d700 1 --2- 172.21.15.72:0/1049691548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61f009e410 0x7f61f0122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61edd9b700 1 -- 172.21.15.72:0/1049691548 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61f009d6f0 msgr2=0x7f61f01223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61edd9b700 1 --2- 172.21.15.72:0/1049691548 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61f009d6f0 0x7f61f01223b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61edd9b700 1 -- 172.21.15.72:0/1049691548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61f009e410 msgr2=0x7f61f0122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61edd9b700 1 --2- 172.21.15.72:0/1049691548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61f009e410 0x7f61f0122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61edd9b700 1 -- 172.21.15.72:0/1049691548 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e00094a0 con 0x7f61f009e000 2023-10-03T10:16:13.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61edd9b700 1 --2- 172.21.15.72:0/1049691548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61f009e000 0x7f61f01228f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f61e400c420 tx=0x7f61e400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61deffd700 1 -- 172.21.15.72:0/1049691548 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4004c80 con 0x7f61f009e000 2023-10-03T10:16:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.428+0000 7f61deffd700 1 -- 172.21.15.72:0/1049691548 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e4004de0 con 0x7f61f009e000 2023-10-03T10:16:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.429+0000 7f61f4f3e700 1 -- 172.21.15.72:0/1049691548 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e8009a70 con 0x7f61f009e000 2023-10-03T10:16:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.429+0000 7f61deffd700 1 -- 172.21.15.72:0/1049691548 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e40072f0 con 0x7f61f009e000 2023-10-03T10:16:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.429+0000 7f61f4f3e700 1 -- 172.21.15.72:0/1049691548 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f009c700 con 0x7f61f009e000 2023-10-03T10:16:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.429+0000 7f61deffd700 1 -- 172.21.15.72:0/1049691548 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61e4007450 con 0x7f61f009e000 2023-10-03T10:16:13.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.429+0000 7f61deffd700 1 -- 172.21.15.72:0/1049691548 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f61e403f1a0 con 0x7f61f009e000 2023-10-03T10:16:13.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.429+0000 7f61f4f3e700 1 -- 172.21.15.72:0/1049691548 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f0074ea0 con 0x7f61f009e000 2023-10-03T10:16:13.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.434+0000 7f61deffd700 1 -- 172.21.15.72:0/1049691548 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61e400ce30 con 0x7f61f009e000 2023-10-03T10:16:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.480+0000 7fa55af71700 1 Processor -- start 2023-10-03T10:16:13.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.480+0000 7fa55af71700 1 -- start start 2023-10-03T10:16:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.480+0000 7fa55af71700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa55409d630 0x7fa5540a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.480+0000 7fa55af71700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa554138d80 0x7fa55413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa55af71700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5540a2a70 con 0x7fa5540a0a30 2023-10-03T10:16:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa55af71700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5540a01d0 con 0x7fa55409d630 2023-10-03T10:16:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa55af71700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa55409e2b0 con 0x7fa554138d80 2023-10-03T10:16:13.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa553fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa55409d630 0x7fa5540a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa55950e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa554138d80 0x7fa55413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa553fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa55409d630 0x7fa5540a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46704/0 (socket says 172.21.15.72:46704) 2023-10-03T10:16:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa553fff700 1 -- 172.21.15.72:0/75974759 learned_addr learned my addr 172.21.15.72:0/75974759 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa553fff700 1 -- 172.21.15.72:0/75974759 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa554138d80 msgr2=0x7fa55413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa553fff700 1 --2- 172.21.15.72:0/75974759 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa554138d80 0x7fa55413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa553fff700 1 -- 172.21.15.72:0/75974759 >> v1:172.21.15.72:6789/0 conn(0x7fa5540a0a30 legacy=0x7fa5540a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa553fff700 1 -- 172.21.15.72:0/75974759 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55409dc50 con 0x7fa55409d630 2023-10-03T10:16:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa55950e700 1 --2- 172.21.15.72:0/75974759 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa554138d80 0x7fa55413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa553fff700 1 --2- 172.21.15.72:0/75974759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa55409d630 0x7fa5540a1510 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa540009920 tx=0x7fa540009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5813d88f9dca227 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa5537fe700 1 -- 172.21.15.72:0/75974759 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa540011830 con 0x7fa55409d630 2023-10-03T10:16:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa5537fe700 1 -- 172.21.15.72:0/75974759 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa540011990 con 0x7fa55409d630 2023-10-03T10:16:13.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.481+0000 7fa5537fe700 1 -- 172.21.15.72:0/75974759 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa540011d20 con 0x7fa55409d630 2023-10-03T10:16:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.482+0000 7fa55af71700 1 -- 172.21.15.72:0/75974759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa55409d630 msgr2=0x7fa5540a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.482+0000 7fa55af71700 1 --2- 172.21.15.72:0/75974759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa55409d630 0x7fa5540a1510 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa540009920 tx=0x7fa540009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:13.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.482+0000 7fa55af71700 1 -- 172.21.15.72:0/75974759 shutdown_connections 2023-10-03T10:16:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.482+0000 7fa55af71700 1 --2- 172.21.15.72:0/75974759 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa554138d80 0x7fa55413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.482+0000 7fa55af71700 1 --2- 172.21.15.72:0/75974759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa55409d630 0x7fa5540a1510 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.482+0000 7fa55af71700 1 -- 172.21.15.72:0/75974759 >> 172.21.15.72:0/75974759 conn(0x7fa5540a3050 msgr2=0x7fa5540a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.482+0000 7fa55af71700 1 -- 172.21.15.72:0/75974759 shutdown_connections 2023-10-03T10:16:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.482+0000 7fa55af71700 1 -- 172.21.15.72:0/75974759 wait complete. 2023-10-03T10:16:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.483+0000 7fa55af71700 1 Processor -- start 2023-10-03T10:16:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.483+0000 7fa55af71700 1 -- start start 2023-10-03T10:16:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.484+0000 7fa55af71700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa55409d630 0x7fa55411d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.484+0000 7fa55af71700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5540a0a30 0x7fa55411d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.484+0000 7fa55af71700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa554138d80 0x7fa55411deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.484+0000 7fa55af71700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa554120270 con 0x7fa554138d80 2023-10-03T10:16:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.484+0000 7fa55af71700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55411f7f0 con 0x7fa5540a0a30 2023-10-03T10:16:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.484+0000 7fa55af71700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5540a4e20 con 0x7fa55409d630 2023-10-03T10:16:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.484+0000 7fa55950e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa554138d80 0x7fa55411deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.484+0000 7fa55950e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa554138d80 0x7fa55411deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35758/0 (socket says 172.21.15.72:35758) 2023-10-03T10:16:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.484+0000 7fa558d0d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa55409d630 0x7fa55411d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.484+0000 7fa55950e700 1 -- 172.21.15.72:0/3306075252 learned_addr learned my addr 172.21.15.72:0/3306075252 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.485+0000 7fa553fff700 1 --2- 172.21.15.72:0/3306075252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5540a0a30 0x7fa55411d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.485+0000 7fa55950e700 1 -- 172.21.15.72:0/3306075252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa55409d630 msgr2=0x7fa55411d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.485+0000 7fa55950e700 1 --2- 172.21.15.72:0/3306075252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa55409d630 0x7fa55411d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.485+0000 7fa55950e700 1 -- 172.21.15.72:0/3306075252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5540a0a30 msgr2=0x7fa55411d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.485+0000 7fa55950e700 1 --2- 172.21.15.72:0/3306075252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5540a0a30 0x7fa55411d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.485+0000 7fa55950e700 1 -- 172.21.15.72:0/3306075252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c009a70 con 0x7fa554138d80 2023-10-03T10:16:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.485+0000 7fa553fff700 1 --2- 172.21.15.72:0/3306075252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5540a0a30 0x7fa55411d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.485+0000 7fa55950e700 1 --2- 172.21.15.72:0/3306075252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa554138d80 0x7fa55411deb0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00efc0 tx=0x7fa54c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.485+0000 7fa5517fa700 1 -- 172.21.15.72:0/3306075252 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c00cb40 con 0x7fa554138d80 2023-10-03T10:16:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.485+0000 7fa5517fa700 1 -- 172.21.15.72:0/3306075252 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c00f040 con 0x7fa554138d80 2023-10-03T10:16:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.485+0000 7fa55af71700 1 -- 172.21.15.72:0/3306075252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa540009550 con 0x7fa554138d80 2023-10-03T10:16:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.485+0000 7fa5517fa700 1 -- 172.21.15.72:0/3306075252 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c003a20 con 0x7fa554138d80 2023-10-03T10:16:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.486+0000 7fa55af71700 1 -- 172.21.15.72:0/3306075252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa554120be0 con 0x7fa554138d80 2023-10-03T10:16:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.486+0000 7fa5517fa700 1 -- 172.21.15.72:0/3306075252 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa54c014480 con 0x7fa554138d80 2023-10-03T10:16:13.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.486+0000 7fa5517fa700 1 -- 172.21.15.72:0/3306075252 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa54c0417f0 con 0x7fa554138d80 2023-10-03T10:16:13.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.487+0000 7fa55af71700 1 -- 172.21.15.72:0/3306075252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5540747f0 con 0x7fa554138d80 2023-10-03T10:16:13.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.491+0000 7fa5517fa700 1 -- 172.21.15.72:0/3306075252 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa54c045060 con 0x7fa554138d80 2023-10-03T10:16:13.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.510+0000 7fe8f118a700 1 -- 172.21.15.72:0/2512724400 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe8ec09f420 con 0x7fe8ec09d6f0 2023-10-03T10:16:13.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.511+0000 7fe8e37fe700 1 -- 172.21.15.72:0/2512724400 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8e4019300 con 0x7fe8ec09d6f0 2023-10-03T10:16:13.511 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.513+0000 7fe8f118a700 1 -- 172.21.15.72:0/2512724400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8ec09d6f0 msgr2=0x7fe8ec11e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.513+0000 7fe8f118a700 1 --2- 172.21.15.72:0/2512724400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8ec09d6f0 0x7fe8ec11e980 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400cbe0 tx=0x7fe8e400cef0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.513+0000 7fe8f118a700 1 -- 172.21.15.72:0/2512724400 shutdown_connections 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.513+0000 7fe8f118a700 1 --2- 172.21.15.72:0/2512724400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8ec09d6f0 0x7fe8ec11e980 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.513+0000 7fe8f118a700 1 --2- 172.21.15.72:0/2512724400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8ec139170 0x7fe8ec11f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.513+0000 7fe8f118a700 1 --2- 172.21.15.72:0/2512724400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8ec09e1d0 0x7fe8ec11eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.513+0000 7fe8f118a700 1 -- 172.21.15.72:0/2512724400 >> 172.21.15.72:0/2512724400 conn(0x7fe8ec066f50 msgr2=0x7fe8ec138100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.513+0000 7fe8f118a700 1 -- 172.21.15.72:0/2512724400 shutdown_connections 2023-10-03T10:16:13.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.513+0000 7fe8f118a700 1 -- 172.21.15.72:0/2512724400 wait complete. 2023-10-03T10:16:13.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:13.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:13.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.659+0000 7f61f4f3e700 1 -- 172.21.15.72:0/1049691548 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f61f006c360 con 0x7f61f009e000 2023-10-03T10:16:13.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.659+0000 7f61deffd700 1 -- 172.21.15.72:0/1049691548 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f61e401ce90 con 0x7f61f009e000 2023-10-03T10:16:13.660 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:13.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.661+0000 7f61f4f3e700 1 -- 172.21.15.72:0/1049691548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61f009e000 msgr2=0x7f61f01228f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.661+0000 7f61f4f3e700 1 --2- 172.21.15.72:0/1049691548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61f009e000 0x7f61f01228f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f61e400c420 tx=0x7f61e400c730 comp rx=0 tx=0).stop 2023-10-03T10:16:13.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.661+0000 7f61f4f3e700 1 -- 172.21.15.72:0/1049691548 shutdown_connections 2023-10-03T10:16:13.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.661+0000 7f61f4f3e700 1 --2- 172.21.15.72:0/1049691548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61f009e410 0x7f61f0122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.661+0000 7f61f4f3e700 1 --2- 172.21.15.72:0/1049691548 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61f009d6f0 0x7f61f01223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.661+0000 7f61f4f3e700 1 --2- 172.21.15.72:0/1049691548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61f009e000 0x7f61f01228f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.661+0000 7f61f4f3e700 1 -- 172.21.15.72:0/1049691548 >> 172.21.15.72:0/1049691548 conn(0x7f61f0066f50 msgr2=0x7f61f00710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.662+0000 7f61f4f3e700 1 -- 172.21.15.72:0/1049691548 shutdown_connections 2023-10-03T10:16:13.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.662+0000 7f61f4f3e700 1 -- 172.21.15.72:0/1049691548 wait complete. 2023-10-03T10:16:13.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:13.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.697+0000 7f207e246700 1 Processor -- start 2023-10-03T10:16:13.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.698+0000 7f207e246700 1 -- start start 2023-10-03T10:16:13.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.698+0000 7f207e246700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2078133a80 0x7f2078133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.698+0000 7f207e246700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f207812ff20 0x7f2078130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.698+0000 7f207e246700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207806bc00 con 0x7f2078130870 2023-10-03T10:16:13.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.698+0000 7f207e246700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f207806c570 con 0x7f2078133a80 2023-10-03T10:16:13.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.698+0000 7f207e246700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20780a0040 con 0x7f207812ff20 2023-10-03T10:16:13.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.698+0000 7f20777fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2078133a80 0x7f2078133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.698+0000 7f2076ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f207812ff20 0x7f2078130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.698+0000 7f2077fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2078130870 0x7f207813a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60050/0 (socket says 172.21.15.72:60050) 2023-10-03T10:16:13.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.698+0000 7f20777fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2078133a80 0x7f2078133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35768/0 (socket says 172.21.15.72:35768) 2023-10-03T10:16:13.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.698+0000 7f2077fff700 1 -- 172.21.15.72:0/234077108 learned_addr learned my addr 172.21.15.72:0/234077108 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.699+0000 7f2076ffd700 1 -- 172.21.15.72:0/234077108 >> v2:172.21.15.72:3300/0 conn(0x7f2078133a80 msgr2=0x7f2078133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.699+0000 7f2076ffd700 1 --2- 172.21.15.72:0/234077108 >> v2:172.21.15.72:3300/0 conn(0x7f2078133a80 0x7f2078133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.699+0000 7f2076ffd700 1 -- 172.21.15.72:0/234077108 >> v1:172.21.15.72:6789/0 conn(0x7f2078130870 legacy=0x7f207813a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.699+0000 7f2076ffd700 1 -- 172.21.15.72:0/234077108 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2078133860 con 0x7f207812ff20 2023-10-03T10:16:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.699+0000 7f20777fe700 1 --2- 172.21.15.72:0/234077108 >> v2:172.21.15.72:3300/0 conn(0x7f2078133a80 0x7f2078133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.699+0000 7f2076ffd700 1 --2- 172.21.15.72:0/234077108 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f207812ff20 0x7f2078130330 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2060009840 tx=0x7f2060009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef6678d12375a71d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.699+0000 7f20767fc700 1 -- 172.21.15.72:0/234077108 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060011830 con 0x7f207812ff20 2023-10-03T10:16:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.699+0000 7f20767fc700 1 -- 172.21.15.72:0/234077108 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2060011990 con 0x7f207812ff20 2023-10-03T10:16:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.699+0000 7f20767fc700 1 -- 172.21.15.72:0/234077108 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060011d20 con 0x7f207812ff20 2023-10-03T10:16:13.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.699+0000 7f207e246700 1 -- 172.21.15.72:0/234077108 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f207812ff20 msgr2=0x7f2078130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.699+0000 7f207e246700 1 --2- 172.21.15.72:0/234077108 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f207812ff20 0x7f2078130330 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2060009840 tx=0x7f2060009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.699+0000 7f207e246700 1 -- 172.21.15.72:0/234077108 shutdown_connections 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.699+0000 7f207e246700 1 --2- 172.21.15.72:0/234077108 >> v2:172.21.15.72:3300/0 conn(0x7f2078133a80 0x7f2078133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.699+0000 7f207e246700 1 --2- 172.21.15.72:0/234077108 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f207812ff20 0x7f2078130330 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.699+0000 7f207e246700 1 -- 172.21.15.72:0/234077108 >> 172.21.15.72:0/234077108 conn(0x7f20780a4210 msgr2=0x7f20780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.700+0000 7f207e246700 1 -- 172.21.15.72:0/234077108 shutdown_connections 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.700+0000 7f207e246700 1 -- 172.21.15.72:0/234077108 wait complete. 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.700+0000 7f207e246700 1 Processor -- start 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f207e246700 1 -- start start 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f207e246700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f207812ff20 0x7f207809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f207e246700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2078130870 0x7f207809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f207e246700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2078133a80 0x7f207809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f207e246700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207809e4a0 con 0x7f207812ff20 2023-10-03T10:16:13.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f207e246700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2078120060 con 0x7f2078130870 2023-10-03T10:16:13.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f207e246700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f207812db00 con 0x7f2078133a80 2023-10-03T10:16:13.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f20777fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f207812ff20 0x7f207809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f2077fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2078133a80 0x7f207809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f20777fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f207812ff20 0x7f207809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35772/0 (socket says 172.21.15.72:35772) 2023-10-03T10:16:13.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f20777fe700 1 -- 172.21.15.72:0/1528683340 learned_addr learned my addr 172.21.15.72:0/1528683340 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:13.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f2076ffd700 1 --2- 172.21.15.72:0/1528683340 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2078130870 0x7f207809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f20777fe700 1 -- 172.21.15.72:0/1528683340 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2078133a80 msgr2=0x7f207809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f20777fe700 1 --2- 172.21.15.72:0/1528683340 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2078133a80 0x7f207809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f20777fe700 1 -- 172.21.15.72:0/1528683340 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2078130870 msgr2=0x7f207809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f20777fe700 1 --2- 172.21.15.72:0/1528683340 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2078130870 0x7f207809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.701+0000 7f20777fe700 1 -- 172.21.15.72:0/1528683340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20680094a0 con 0x7f207812ff20 2023-10-03T10:16:13.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.702+0000 7f20777fe700 1 --2- 172.21.15.72:0/1528683340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f207812ff20 0x7f207809c480 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f206800ebe0 tx=0x7f206800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.702+0000 7f206ffff700 1 -- 172.21.15.72:0/1528683340 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206800c850 con 0x7f207812ff20 2023-10-03T10:16:13.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.702+0000 7f206ffff700 1 -- 172.21.15.72:0/1528683340 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206800c9b0 con 0x7f207812ff20 2023-10-03T10:16:13.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.702+0000 7f207e246700 1 -- 172.21.15.72:0/1528683340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20600094a0 con 0x7f207812ff20 2023-10-03T10:16:13.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.702+0000 7f206ffff700 1 -- 172.21.15.72:0/1528683340 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206800cd40 con 0x7f207812ff20 2023-10-03T10:16:13.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.702+0000 7f207e246700 1 -- 172.21.15.72:0/1528683340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2078120340 con 0x7f207812ff20 2023-10-03T10:16:13.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.703+0000 7f206ffff700 1 -- 172.21.15.72:0/1528683340 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2068013470 con 0x7f207812ff20 2023-10-03T10:16:13.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.703+0000 7f206ffff700 1 -- 172.21.15.72:0/1528683340 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f206803fb30 con 0x7f207812ff20 2023-10-03T10:16:13.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.703+0000 7f207e246700 1 -- 172.21.15.72:0/1528683340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2078074ea0 con 0x7f207812ff20 2023-10-03T10:16:13.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.707+0000 7f206ffff700 1 -- 172.21.15.72:0/1528683340 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2068013720 con 0x7f207812ff20 2023-10-03T10:16:13.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.714+0000 7fa55af71700 1 -- 172.21.15.72:0/3306075252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa5541209d0 con 0x7fa554138d80 2023-10-03T10:16:13.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.714+0000 7fa5517fa700 1 -- 172.21.15.72:0/3306075252 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa54c012930 con 0x7fa554138d80 2023-10-03T10:16:13.715 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:13.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.717+0000 7fa55af71700 1 -- 172.21.15.72:0/3306075252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa554138d80 msgr2=0x7fa55411deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.717+0000 7fa55af71700 1 --2- 172.21.15.72:0/3306075252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa554138d80 0x7fa55411deb0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00efc0 tx=0x7fa54c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.717+0000 7fa55af71700 1 -- 172.21.15.72:0/3306075252 shutdown_connections 2023-10-03T10:16:13.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.717+0000 7fa55af71700 1 --2- 172.21.15.72:0/3306075252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa554138d80 0x7fa55411deb0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.717+0000 7fa55af71700 1 --2- 172.21.15.72:0/3306075252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa55409d630 0x7fa55411d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.717+0000 7fa55af71700 1 --2- 172.21.15.72:0/3306075252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5540a0a30 0x7fa55411d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.717+0000 7fa55af71700 1 -- 172.21.15.72:0/3306075252 >> 172.21.15.72:0/3306075252 conn(0x7fa5540a3050 msgr2=0x7fa5540a5370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.717+0000 7fa55af71700 1 -- 172.21.15.72:0/3306075252 shutdown_connections 2023-10-03T10:16:13.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.717+0000 7fa55af71700 1 -- 172.21.15.72:0/3306075252 wait complete. 2023-10-03T10:16:13.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:13.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.902+0000 7f207e246700 1 -- 172.21.15.72:0/1528683340 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f207806b250 con 0x7f207812ff20 2023-10-03T10:16:13.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.902+0000 7f206ffff700 1 -- 172.21.15.72:0/1528683340 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2068017020 con 0x7f207812ff20 2023-10-03T10:16:13.903 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:13.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.904+0000 7f207e246700 1 -- 172.21.15.72:0/1528683340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f207812ff20 msgr2=0x7f207809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.904+0000 7f207e246700 1 --2- 172.21.15.72:0/1528683340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f207812ff20 0x7f207809c480 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f206800ebe0 tx=0x7f206800eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.904+0000 7f207e246700 1 -- 172.21.15.72:0/1528683340 shutdown_connections 2023-10-03T10:16:13.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.904+0000 7f207e246700 1 --2- 172.21.15.72:0/1528683340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f207812ff20 0x7f207809c480 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.904+0000 7f207e246700 1 --2- 172.21.15.72:0/1528683340 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2078133a80 0x7f207809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.904+0000 7f207e246700 1 --2- 172.21.15.72:0/1528683340 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2078130870 0x7f207809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.904+0000 7f207e246700 1 -- 172.21.15.72:0/1528683340 >> 172.21.15.72:0/1528683340 conn(0x7f20780a4210 msgr2=0x7f207809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.904+0000 7f207e246700 1 -- 172.21.15.72:0/1528683340 shutdown_connections 2023-10-03T10:16:13.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:13.904+0000 7f207e246700 1 -- 172.21.15.72:0/1528683340 wait complete. 2023-10-03T10:16:13.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:14.527 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.653+0000 7fb0e53e8700 1 Processor -- start 2023-10-03T10:16:14.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.653+0000 7fb0e53e8700 1 -- start start 2023-10-03T10:16:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.653+0000 7fb0e53e8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e00a0a30 0x7fb0e00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0e53e8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e0138d80 0x7fb0e013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0e53e8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e00a2a70 con 0x7fb0e009d630 2023-10-03T10:16:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0e53e8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e00a01d0 con 0x7fb0e00a0a30 2023-10-03T10:16:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0e53e8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e009e2b0 con 0x7fb0e0138d80 2023-10-03T10:16:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0df7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e0138d80 0x7fb0e013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0de7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb0e009d630 0x7fb0e00a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60060/0 (socket says 172.21.15.72:60060) 2023-10-03T10:16:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0de7fc700 1 -- 172.21.15.72:0/1729214445 learned_addr learned my addr 172.21.15.72:0/1729214445 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0deffd700 1 --2- 172.21.15.72:0/1729214445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e00a0a30 0x7fb0e00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0df7fe700 1 -- 172.21.15.72:0/1729214445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e00a0a30 msgr2=0x7fb0e00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0ddffb700 1 -- 172.21.15.72:0/1729214445 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773347080 0 0) 0x7fb0e00a2a70 con 0x7fb0e009d630 2023-10-03T10:16:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0df7fe700 1 --2- 172.21.15.72:0/1729214445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e00a0a30 0x7fb0e00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0df7fe700 1 -- 172.21.15.72:0/1729214445 >> v1:172.21.15.72:6789/0 conn(0x7fb0e009d630 legacy=0x7fb0e00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0df7fe700 1 -- 172.21.15.72:0/1729214445 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e009dc50 con 0x7fb0e0138d80 2023-10-03T10:16:14.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0deffd700 1 --2- 172.21.15.72:0/1729214445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e00a0a30 0x7fb0e00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0df7fe700 1 --2- 172.21.15.72:0/1729214445 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e0138d80 0x7fb0e013b160 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8009dc0 tx=0x7fb0d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=601b383fb5a86bae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0ddffb700 1 -- 172.21.15.72:0/1729214445 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800e070 con 0x7fb0e0138d80 2023-10-03T10:16:14.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0ddffb700 1 -- 172.21.15.72:0/1729214445 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d800bb20 con 0x7fb0e0138d80 2023-10-03T10:16:14.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.654+0000 7fb0ddffb700 1 -- 172.21.15.72:0/1729214445 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8012430 con 0x7fb0e0138d80 2023-10-03T10:16:14.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.655+0000 7fb0e53e8700 1 -- 172.21.15.72:0/1729214445 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e0138d80 msgr2=0x7fb0e013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.655+0000 7fb0e53e8700 1 --2- 172.21.15.72:0/1729214445 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e0138d80 0x7fb0e013b160 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8009dc0 tx=0x7fb0d800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:14.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.655+0000 7fb0e53e8700 1 -- 172.21.15.72:0/1729214445 shutdown_connections 2023-10-03T10:16:14.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.655+0000 7fb0e53e8700 1 --2- 172.21.15.72:0/1729214445 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e0138d80 0x7fb0e013b160 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.655+0000 7fb0e53e8700 1 --2- 172.21.15.72:0/1729214445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e00a0a30 0x7fb0e00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.655+0000 7fb0e53e8700 1 -- 172.21.15.72:0/1729214445 >> 172.21.15.72:0/1729214445 conn(0x7fb0e00a3050 msgr2=0x7fb0e00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.655+0000 7fb0e53e8700 1 -- 172.21.15.72:0/1729214445 shutdown_connections 2023-10-03T10:16:14.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.655+0000 7fb0e53e8700 1 -- 172.21.15.72:0/1729214445 wait complete. 2023-10-03T10:16:14.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.656+0000 7fb0e53e8700 1 Processor -- start 2023-10-03T10:16:14.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.656+0000 7fb0e53e8700 1 -- start start 2023-10-03T10:16:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.656+0000 7fb0e53e8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e009d630 0x7fb0e012c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.656+0000 7fb0e53e8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e00a0a30 0x7fb0e012ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.656+0000 7fb0e53e8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e0138d80 0x7fb0e012cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.656+0000 7fb0e53e8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e00a49e0 con 0x7fb0e0138d80 2023-10-03T10:16:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.656+0000 7fb0e53e8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e012fb00 con 0x7fb0e009d630 2023-10-03T10:16:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.656+0000 7fb0e53e8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e012e090 con 0x7fb0e00a0a30 2023-10-03T10:16:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.656+0000 7fb0deffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e009d630 0x7fb0e012c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.656+0000 7fb0de7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e00a0a30 0x7fb0e012ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.656+0000 7fb0deffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e009d630 0x7fb0e012c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46746/0 (socket says 172.21.15.72:46746) 2023-10-03T10:16:14.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.656+0000 7fb0deffd700 1 -- 172.21.15.72:0/2845198146 learned_addr learned my addr 172.21.15.72:0/2845198146 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:14.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.656+0000 7fb0df7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e0138d80 0x7fb0e012cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.657+0000 7fb0de7fc700 1 -- 172.21.15.72:0/2845198146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e009d630 msgr2=0x7fb0e012c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.657+0000 7fb0de7fc700 1 --2- 172.21.15.72:0/2845198146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e009d630 0x7fb0e012c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.657+0000 7fb0de7fc700 1 -- 172.21.15.72:0/2845198146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e0138d80 msgr2=0x7fb0e012cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.657+0000 7fb0de7fc700 1 --2- 172.21.15.72:0/2845198146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e0138d80 0x7fb0e012cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.657+0000 7fb0de7fc700 1 -- 172.21.15.72:0/2845198146 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d40094a0 con 0x7fb0e00a0a30 2023-10-03T10:16:14.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.657+0000 7fb0deffd700 1 --2- 172.21.15.72:0/2845198146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e009d630 0x7fb0e012c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.657+0000 7fb0df7fe700 1 --2- 172.21.15.72:0/2845198146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e0138d80 0x7fb0e012cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.657+0000 7fb0de7fc700 1 --2- 172.21.15.72:0/2845198146 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e00a0a30 0x7fb0e012ca00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000c470 tx=0x7fb0d000c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.657+0000 7fb0c77fe700 1 -- 172.21.15.72:0/2845198146 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0004c80 con 0x7fb0e00a0a30 2023-10-03T10:16:14.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.657+0000 7fb0c77fe700 1 -- 172.21.15.72:0/2845198146 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d0004de0 con 0x7fb0e00a0a30 2023-10-03T10:16:14.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.657+0000 7fb0e53e8700 1 -- 172.21.15.72:0/2845198146 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d8009a70 con 0x7fb0e00a0a30 2023-10-03T10:16:14.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.657+0000 7fb0c77fe700 1 -- 172.21.15.72:0/2845198146 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0007310 con 0x7fb0e00a0a30 2023-10-03T10:16:14.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.657+0000 7fb0e53e8700 1 -- 172.21.15.72:0/2845198146 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e012ed80 con 0x7fb0e00a0a30 2023-10-03T10:16:14.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.658+0000 7fb0c77fe700 1 -- 172.21.15.72:0/2845198146 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0d0007470 con 0x7fb0e00a0a30 2023-10-03T10:16:14.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.658+0000 7fb0c77fe700 1 -- 172.21.15.72:0/2845198146 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb0d003f1c0 con 0x7fb0e00a0a30 2023-10-03T10:16:14.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.658+0000 7fb0e53e8700 1 -- 172.21.15.72:0/2845198146 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e00747f0 con 0x7fb0e00a0a30 2023-10-03T10:16:14.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.663+0000 7fb0c77fe700 1 -- 172.21.15.72:0/2845198146 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0d000ce40 con 0x7fb0e00a0a30 2023-10-03T10:16:14.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:14.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:14.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.800+0000 7ff85d324700 1 Processor -- start 2023-10-03T10:16:14.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.800+0000 7ff85d324700 1 -- start start 2023-10-03T10:16:14.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff85d324700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff85806a770 0x7ff85806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff85d324700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff85806b080 0x7ff858131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff85d324700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff858131b40 0x7ff858131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff85d324700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85809ece0 con 0x7ff85806a770 2023-10-03T10:16:14.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff85d324700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85809e760 con 0x7ff85806b080 2023-10-03T10:16:14.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff85d324700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff85809e040 con 0x7ff858131b40 2023-10-03T10:16:14.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff8577fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff858131b40 0x7ff858131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff856ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff85806a770 0x7ff85806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff8577fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff858131b40 0x7ff858131fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52112/0 (socket says 172.21.15.72:52112) 2023-10-03T10:16:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff8567fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff85806b080 0x7ff858131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff8577fe700 1 -- 172.21.15.72:0/148384129 learned_addr learned my addr 172.21.15.72:0/148384129 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff8577fe700 1 -- 172.21.15.72:0/148384129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff85806b080 msgr2=0x7ff858131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff8577fe700 1 --2- 172.21.15.72:0/148384129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff85806b080 0x7ff858131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff8577fe700 1 -- 172.21.15.72:0/148384129 >> v2:172.21.15.72:3300/0 conn(0x7ff85806a770 msgr2=0x7ff85806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff8577fe700 1 --2- 172.21.15.72:0/148384129 >> v2:172.21.15.72:3300/0 conn(0x7ff85806a770 0x7ff85806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff8577fe700 1 -- 172.21.15.72:0/148384129 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85809f630 con 0x7ff858131b40 2023-10-03T10:16:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff8567fc700 1 --2- 172.21.15.72:0/148384129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff85806b080 0x7ff858131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff856ffd700 1 --2- 172.21.15.72:0/148384129 >> v2:172.21.15.72:3300/0 conn(0x7ff85806a770 0x7ff85806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.801+0000 7ff8577fe700 1 --2- 172.21.15.72:0/148384129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff858131b40 0x7ff858131fa0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff850009e50 tx=0x7ff85000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8342eec6318aa96b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.802+0000 7ff855ffb700 1 -- 172.21.15.72:0/148384129 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85000e070 con 0x7ff858131b40 2023-10-03T10:16:14.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.802+0000 7ff855ffb700 1 -- 172.21.15.72:0/148384129 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85000b910 con 0x7ff858131b40 2023-10-03T10:16:14.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.802+0000 7ff855ffb700 1 -- 172.21.15.72:0/148384129 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85000bcc0 con 0x7ff858131b40 2023-10-03T10:16:14.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.802+0000 7ff85d324700 1 -- 172.21.15.72:0/148384129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff858131b40 msgr2=0x7ff858131fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.802+0000 7ff85d324700 1 --2- 172.21.15.72:0/148384129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff858131b40 0x7ff858131fa0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff850009e50 tx=0x7ff85000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:14.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.802+0000 7ff85d324700 1 -- 172.21.15.72:0/148384129 shutdown_connections 2023-10-03T10:16:14.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.802+0000 7ff85d324700 1 --2- 172.21.15.72:0/148384129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff858131b40 0x7ff858131fa0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.802+0000 7ff85d324700 1 --2- 172.21.15.72:0/148384129 >> v2:172.21.15.72:3300/0 conn(0x7ff85806a770 0x7ff85806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.802+0000 7ff85d324700 1 --2- 172.21.15.72:0/148384129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff85806b080 0x7ff858131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.802+0000 7ff85d324700 1 -- 172.21.15.72:0/148384129 >> 172.21.15.72:0/148384129 conn(0x7ff858066f50 msgr2=0x7ff85809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.802+0000 7ff85d324700 1 -- 172.21.15.72:0/148384129 shutdown_connections 2023-10-03T10:16:14.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.802+0000 7ff85d324700 1 -- 172.21.15.72:0/148384129 wait complete. 2023-10-03T10:16:14.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.804+0000 7ff85d324700 1 Processor -- start 2023-10-03T10:16:14.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.804+0000 7ff85d324700 1 -- start start 2023-10-03T10:16:14.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.804+0000 7ff85d324700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff85806a770 0x7ff85809acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.804+0000 7ff85d324700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff85806b080 0x7ff85809b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.804+0000 7ff85d324700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff858131b40 0x7ff8581c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.804+0000 7ff85d324700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff858071e60 con 0x7ff85806b080 2023-10-03T10:16:14.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.804+0000 7ff85d324700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8581310e0 con 0x7ff85806a770 2023-10-03T10:16:14.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.804+0000 7ff85d324700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff858121ab0 con 0x7ff858131b40 2023-10-03T10:16:14.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff8567fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff85806b080 0x7ff85809b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff8577fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff858131b40 0x7ff8581c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff8567fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff85806b080 0x7ff85809b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35790/0 (socket says 172.21.15.72:35790) 2023-10-03T10:16:14.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff8567fc700 1 -- 172.21.15.72:0/1672471414 learned_addr learned my addr 172.21.15.72:0/1672471414 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:14.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff856ffd700 1 --2- 172.21.15.72:0/1672471414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff85806a770 0x7ff85809acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff8567fc700 1 -- 172.21.15.72:0/1672471414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff858131b40 msgr2=0x7ff8581c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff8567fc700 1 --2- 172.21.15.72:0/1672471414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff858131b40 0x7ff8581c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff8567fc700 1 -- 172.21.15.72:0/1672471414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff85806a770 msgr2=0x7ff85809acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff8567fc700 1 --2- 172.21.15.72:0/1672471414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff85806a770 0x7ff85809acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff8567fc700 1 -- 172.21.15.72:0/1672471414 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8480094a0 con 0x7ff85806b080 2023-10-03T10:16:14.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff8577fe700 1 --2- 172.21.15.72:0/1672471414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff858131b40 0x7ff8581c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff856ffd700 1 --2- 172.21.15.72:0/1672471414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff85806a770 0x7ff85809acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:14.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff8567fc700 1 --2- 172.21.15.72:0/1672471414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff85806b080 0x7ff85809b210 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00ebe0 tx=0x7ff84c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff83f7fe700 1 -- 172.21.15.72:0/1672471414 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c009800 con 0x7ff85806b080 2023-10-03T10:16:14.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff83f7fe700 1 -- 172.21.15.72:0/1672471414 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c00c910 con 0x7ff85806b080 2023-10-03T10:16:14.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff85d324700 1 -- 172.21.15.72:0/1672471414 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84c0094a0 con 0x7ff85806b080 2023-10-03T10:16:14.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff83f7fe700 1 -- 172.21.15.72:0/1672471414 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c00cc80 con 0x7ff85806b080 2023-10-03T10:16:14.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.805+0000 7ff85d324700 1 -- 172.21.15.72:0/1672471414 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff850009b30 con 0x7ff85806b080 2023-10-03T10:16:14.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.806+0000 7ff83f7fe700 1 -- 172.21.15.72:0/1672471414 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff84c013470 con 0x7ff85806b080 2023-10-03T10:16:14.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.806+0000 7ff85d324700 1 -- 172.21.15.72:0/1672471414 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff858074ea0 con 0x7ff85806b080 2023-10-03T10:16:14.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.807+0000 7ff83f7fe700 1 -- 172.21.15.72:0/1672471414 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff84c03f840 con 0x7ff85806b080 2023-10-03T10:16:14.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.811+0000 7ff83f7fe700 1 -- 172.21.15.72:0/1672471414 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff84c013720 con 0x7ff85806b080 2023-10-03T10:16:14.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.866+0000 7fb0e53e8700 1 -- 172.21.15.72:0/2845198146 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb0e00a0410 con 0x7fb0e00a0a30 2023-10-03T10:16:14.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.866+0000 7fb0c77fe700 1 -- 172.21.15.72:0/2845198146 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0d001b7b0 con 0x7fb0e00a0a30 2023-10-03T10:16:14.867 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:14.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.868+0000 7fb0e53e8700 1 -- 172.21.15.72:0/2845198146 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e00a0a30 msgr2=0x7fb0e012ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.868+0000 7fb0e53e8700 1 --2- 172.21.15.72:0/2845198146 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e00a0a30 0x7fb0e012ca00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000c470 tx=0x7fb0d000c780 comp rx=0 tx=0).stop 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.868+0000 7fb0e53e8700 1 -- 172.21.15.72:0/2845198146 shutdown_connections 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.868+0000 7fb0e53e8700 1 --2- 172.21.15.72:0/2845198146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e0138d80 0x7fb0e012cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.868+0000 7fb0e53e8700 1 --2- 172.21.15.72:0/2845198146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e009d630 0x7fb0e012c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.868+0000 7fb0e53e8700 1 --2- 172.21.15.72:0/2845198146 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e00a0a30 0x7fb0e012ca00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.868+0000 7fb0e53e8700 1 -- 172.21.15.72:0/2845198146 >> 172.21.15.72:0/2845198146 conn(0x7fb0e00a3050 msgr2=0x7fb0e009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.869+0000 7fb0e53e8700 1 -- 172.21.15.72:0/2845198146 shutdown_connections 2023-10-03T10:16:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.869+0000 7fb0e53e8700 1 -- 172.21.15.72:0/2845198146 wait complete. 2023-10-03T10:16:14.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.890+0000 7f73c6711700 1 Processor -- start 2023-10-03T10:16:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.890+0000 7f73c6711700 1 -- start start 2023-10-03T10:16:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73c6711700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73c009e1d0 0x7f73c0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73c6711700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73c0139170 0x7f73c013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73c6711700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c009b120 con 0x7f73c009d6f0 2023-10-03T10:16:14.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73c6711700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c006b460 con 0x7f73c0139170 2023-10-03T10:16:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73c6711700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73c009a7e0 con 0x7f73c009e1d0 2023-10-03T10:16:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73bf7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73c009e1d0 0x7f73c0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73c4cae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73c0139170 0x7f73c013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73bf7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73c009e1d0 0x7f73c0138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52136/0 (socket says 172.21.15.72:52136) 2023-10-03T10:16:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73bffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f73c009d6f0 0x7f73c009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60068/0 (socket says 172.21.15.72:60068) 2023-10-03T10:16:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73c4cae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73c0139170 0x7f73c013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46760/0 (socket says 172.21.15.72:46760) 2023-10-03T10:16:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73bffff700 1 -- 172.21.15.72:0/2882584625 learned_addr learned my addr 172.21.15.72:0/2882584625 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73beffd700 1 -- 172.21.15.72:0/2882584625 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681397162 0 0) 0x7f73c009b120 con 0x7f73c009d6f0 2023-10-03T10:16:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73bf7fe700 1 -- 172.21.15.72:0/2882584625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73c0139170 msgr2=0x7f73c013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:14.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73bf7fe700 1 --2- 172.21.15.72:0/2882584625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73c0139170 0x7f73c013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73bf7fe700 1 -- 172.21.15.72:0/2882584625 >> v1:172.21.15.72:6789/0 conn(0x7f73c009d6f0 legacy=0x7f73c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73bf7fe700 1 -- 172.21.15.72:0/2882584625 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c009a500 con 0x7f73c009e1d0 2023-10-03T10:16:14.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73c4cae700 1 --2- 172.21.15.72:0/2882584625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73c0139170 0x7f73c013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73bf7fe700 1 --2- 172.21.15.72:0/2882584625 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73c009e1d0 0x7f73c0138c30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f73b00098a0 tx=0x7f73b0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5d3fccd09a6c1f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.891+0000 7f73beffd700 1 -- 172.21.15.72:0/2882584625 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0011830 con 0x7f73c009e1d0 2023-10-03T10:16:14.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.892+0000 7f73beffd700 1 -- 172.21.15.72:0/2882584625 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b0011990 con 0x7f73c009e1d0 2023-10-03T10:16:14.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.892+0000 7f73beffd700 1 -- 172.21.15.72:0/2882584625 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0011d20 con 0x7f73c009e1d0 2023-10-03T10:16:14.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.892+0000 7f73c6711700 1 -- 172.21.15.72:0/2882584625 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73c009e1d0 msgr2=0x7f73c0138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.892+0000 7f73c6711700 1 --2- 172.21.15.72:0/2882584625 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73c009e1d0 0x7f73c0138c30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f73b00098a0 tx=0x7f73b0009bb0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.892+0000 7f73c6711700 1 -- 172.21.15.72:0/2882584625 shutdown_connections 2023-10-03T10:16:14.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.892+0000 7f73c6711700 1 --2- 172.21.15.72:0/2882584625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73c0139170 0x7f73c013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.892+0000 7f73c6711700 1 --2- 172.21.15.72:0/2882584625 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73c009e1d0 0x7f73c0138c30 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.892+0000 7f73c6711700 1 -- 172.21.15.72:0/2882584625 >> 172.21.15.72:0/2882584625 conn(0x7f73c0066f50 msgr2=0x7f73c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.892+0000 7f73c6711700 1 -- 172.21.15.72:0/2882584625 shutdown_connections 2023-10-03T10:16:14.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.892+0000 7f73c6711700 1 -- 172.21.15.72:0/2882584625 wait complete. 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.893+0000 7f73c6711700 1 Processor -- start 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.893+0000 7f73c6711700 1 -- start start 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73c6711700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73c009d6f0 0x7f73c01c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73c6711700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73c009e1d0 0x7f73c01c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73c6711700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73c0139170 0x7f73c01c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73c6711700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c0072210 con 0x7f73c009d6f0 2023-10-03T10:16:14.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73c6711700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c0120680 con 0x7f73c009e1d0 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73c6711700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73c0121d20 con 0x7f73c0139170 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73bffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73c009d6f0 0x7f73c01c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73bf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73c009e1d0 0x7f73c01c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73bffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73c009d6f0 0x7f73c01c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35804/0 (socket says 172.21.15.72:35804) 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73bf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73c009e1d0 0x7f73c01c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46770/0 (socket says 172.21.15.72:46770) 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73bf7fe700 1 -- 172.21.15.72:0/3756162623 learned_addr learned my addr 172.21.15.72:0/3756162623 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73c4cae700 1 --2- 172.21.15.72:0/3756162623 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73c0139170 0x7f73c01c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73bffff700 1 -- 172.21.15.72:0/3756162623 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73c0139170 msgr2=0x7f73c01c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73bffff700 1 --2- 172.21.15.72:0/3756162623 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73c0139170 0x7f73c01c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73bffff700 1 -- 172.21.15.72:0/3756162623 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73c009e1d0 msgr2=0x7f73c01c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73bffff700 1 --2- 172.21.15.72:0/3756162623 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73c009e1d0 0x7f73c01c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:14.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73bffff700 1 -- 172.21.15.72:0/3756162623 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b8009a70 con 0x7f73c009d6f0 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73bf7fe700 1 --2- 172.21.15.72:0/3756162623 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73c009e1d0 0x7f73c01c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73bffff700 1 --2- 172.21.15.72:0/3756162623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73c009d6f0 0x7f73c01c8460 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f73a800c470 tx=0x7f73a800c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73bcff9700 1 -- 172.21.15.72:0/3756162623 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8004c80 con 0x7f73c009d6f0 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73bcff9700 1 -- 172.21.15.72:0/3756162623 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a8004de0 con 0x7f73c009d6f0 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73c6711700 1 -- 172.21.15.72:0/3756162623 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b00094a0 con 0x7f73c009d6f0 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73bcff9700 1 -- 172.21.15.72:0/3756162623 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8007310 con 0x7f73c009d6f0 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.894+0000 7f73c6711700 1 -- 172.21.15.72:0/3756162623 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c01222b0 con 0x7f73c009d6f0 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.895+0000 7f73bcff9700 1 -- 172.21.15.72:0/3756162623 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73a8007470 con 0x7f73c009d6f0 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.895+0000 7f73c6711700 1 -- 172.21.15.72:0/3756162623 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c01224a0 con 0x7f73c009d6f0 2023-10-03T10:16:14.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.895+0000 7f73bcff9700 1 -- 172.21.15.72:0/3756162623 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f73a803f240 con 0x7f73c009d6f0 2023-10-03T10:16:14.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:14.900+0000 7f73bcff9700 1 -- 172.21.15.72:0/3756162623 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73a8007720 con 0x7f73c009d6f0 2023-10-03T10:16:14.918 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.039+0000 7ff85d324700 1 -- 172.21.15.72:0/1672471414 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff85809bf70 con 0x7ff85806b080 2023-10-03T10:16:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.040+0000 7ff83f7fe700 1 -- 172.21.15.72:0/1672471414 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff84c021070 con 0x7ff85806b080 2023-10-03T10:16:15.041 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.040+0000 7fd395f1c700 1 Processor -- start 2023-10-03T10:16:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.040+0000 7fd395f1c700 1 -- start start 2023-10-03T10:16:15.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.041+0000 7fd395f1c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd39009d6f0 0x7fd39009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.041+0000 7fd395f1c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd39009e000 0x7fd390130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.041+0000 7fd395f1c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd39009e410 0x7fd390130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.041+0000 7fd395f1c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39009f520 con 0x7fd39009d6f0 2023-10-03T10:16:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.041+0000 7fd395f1c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39009f130 con 0x7fd39009e000 2023-10-03T10:16:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.041+0000 7fd395f1c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd39009e930 con 0x7fd39009e410 2023-10-03T10:16:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.041+0000 7fd38ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd39009e410 0x7fd390130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.041+0000 7fd38f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd39009d6f0 0x7fd39009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.041+0000 7fd38ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd39009e410 0x7fd390130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52152/0 (socket says 172.21.15.72:52152) 2023-10-03T10:16:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.041+0000 7fd38ffff700 1 -- 172.21.15.72:0/3434779870 learned_addr learned my addr 172.21.15.72:0/3434779870 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.041+0000 7fd38effd700 1 --2- 172.21.15.72:0/3434779870 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd39009e000 0x7fd390130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.042+0000 7fd38effd700 1 -- 172.21.15.72:0/3434779870 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd39009e410 msgr2=0x7fd390130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.042+0000 7fd38effd700 1 --2- 172.21.15.72:0/3434779870 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd39009e410 0x7fd390130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.042+0000 7fd38effd700 1 -- 172.21.15.72:0/3434779870 >> v2:172.21.15.72:3300/0 conn(0x7fd39009d6f0 msgr2=0x7fd39009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.042+0000 7fd38effd700 1 --2- 172.21.15.72:0/3434779870 >> v2:172.21.15.72:3300/0 conn(0x7fd39009d6f0 0x7fd39009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.042+0000 7fd38effd700 1 -- 172.21.15.72:0/3434779870 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39009b2d0 con 0x7fd39009e000 2023-10-03T10:16:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.042+0000 7fd38ffff700 1 --2- 172.21.15.72:0/3434779870 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd39009e410 0x7fd390130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.042+0000 7fd38effd700 1 --2- 172.21.15.72:0/3434779870 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd39009e000 0x7fd390130660 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd384009840 tx=0x7fd384009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73f88575b223b550 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.042+0000 7fd38e7fc700 1 -- 172.21.15.72:0/3434779870 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384011830 con 0x7fd39009e000 2023-10-03T10:16:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.042+0000 7fd38e7fc700 1 -- 172.21.15.72:0/3434779870 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd384011990 con 0x7fd39009e000 2023-10-03T10:16:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.042+0000 7fd38e7fc700 1 -- 172.21.15.72:0/3434779870 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384011d20 con 0x7fd39009e000 2023-10-03T10:16:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.042+0000 7ff85d324700 1 -- 172.21.15.72:0/1672471414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff85806b080 msgr2=0x7ff85809b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.042+0000 7ff85d324700 1 --2- 172.21.15.72:0/1672471414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff85806b080 0x7ff85809b210 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00ebe0 tx=0x7ff84c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7ff85d324700 1 -- 172.21.15.72:0/1672471414 shutdown_connections 2023-10-03T10:16:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7ff85d324700 1 --2- 172.21.15.72:0/1672471414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff858131b40 0x7ff8581c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7ff85d324700 1 --2- 172.21.15.72:0/1672471414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff85806a770 0x7ff85809acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7ff85d324700 1 --2- 172.21.15.72:0/1672471414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff85806b080 0x7ff85809b210 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7ff85d324700 1 -- 172.21.15.72:0/1672471414 >> 172.21.15.72:0/1672471414 conn(0x7ff858066f50 msgr2=0x7ff858070060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7ff85d324700 1 -- 172.21.15.72:0/1672471414 shutdown_connections 2023-10-03T10:16:15.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7ff85d324700 1 -- 172.21.15.72:0/1672471414 wait complete. 2023-10-03T10:16:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7fd395f1c700 1 -- 172.21.15.72:0/3434779870 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd39009e000 msgr2=0x7fd390130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7fd395f1c700 1 --2- 172.21.15.72:0/3434779870 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd39009e000 0x7fd390130660 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd384009840 tx=0x7fd384009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7fd395f1c700 1 -- 172.21.15.72:0/3434779870 shutdown_connections 2023-10-03T10:16:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7fd395f1c700 1 --2- 172.21.15.72:0/3434779870 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd39009e410 0x7fd390130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7fd395f1c700 1 --2- 172.21.15.72:0/3434779870 >> v2:172.21.15.72:3300/0 conn(0x7fd39009d6f0 0x7fd39009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7fd395f1c700 1 --2- 172.21.15.72:0/3434779870 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd39009e000 0x7fd390130660 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7fd395f1c700 1 -- 172.21.15.72:0/3434779870 >> 172.21.15.72:0/3434779870 conn(0x7fd390066f50 msgr2=0x7fd39009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7fd395f1c700 1 -- 172.21.15.72:0/3434779870 shutdown_connections 2023-10-03T10:16:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.043+0000 7fd395f1c700 1 -- 172.21.15.72:0/3434779870 wait complete. 2023-10-03T10:16:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.044+0000 7fd395f1c700 1 Processor -- start 2023-10-03T10:16:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.044+0000 7fd395f1c700 1 -- start start 2023-10-03T10:16:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd395f1c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd39009d6f0 0x7fd390137920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd395f1c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd39009e000 0x7fd390137e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd395f1c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd39009e410 0x7fd3901383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd395f1c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39011a870 con 0x7fd39009e410 2023-10-03T10:16:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd395f1c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3901398a0 con 0x7fd39009e000 2023-10-03T10:16:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd395f1c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900a38d0 con 0x7fd39009d6f0 2023-10-03T10:16:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd38effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd39009e000 0x7fd390137e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd38effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd39009e000 0x7fd390137e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46794/0 (socket says 172.21.15.72:46794) 2023-10-03T10:16:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd38ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd39009e410 0x7fd3901383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd38effd700 1 -- 172.21.15.72:0/3488069002 learned_addr learned my addr 172.21.15.72:0/3488069002 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd38f7fe700 1 --2- 172.21.15.72:0/3488069002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd39009d6f0 0x7fd390137920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd38ffff700 1 -- 172.21.15.72:0/3488069002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd39009d6f0 msgr2=0x7fd390137920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd38ffff700 1 --2- 172.21.15.72:0/3488069002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd39009d6f0 0x7fd390137920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd38ffff700 1 -- 172.21.15.72:0/3488069002 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd39009e000 msgr2=0x7fd390137e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd38ffff700 1 --2- 172.21.15.72:0/3488069002 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd39009e000 0x7fd390137e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd38ffff700 1 -- 172.21.15.72:0/3488069002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388009b30 con 0x7fd39009e410 2023-10-03T10:16:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd38effd700 1 --2- 172.21.15.72:0/3488069002 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd39009e000 0x7fd390137e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:15.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd38f7fe700 1 --2- 172.21.15.72:0/3488069002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd39009d6f0 0x7fd390137920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd38ffff700 1 --2- 172.21.15.72:0/3488069002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd39009e410 0x7fd3901383a0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd38800efc0 tx=0x7fd38800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd377fff700 1 -- 172.21.15.72:0/3488069002 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388018070 con 0x7fd39009e410 2023-10-03T10:16:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd377fff700 1 -- 172.21.15.72:0/3488069002 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38800f040 con 0x7fd39009e410 2023-10-03T10:16:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd377fff700 1 -- 172.21.15.72:0/3488069002 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388003c60 con 0x7fd39009e410 2023-10-03T10:16:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.045+0000 7fd395f1c700 1 -- 172.21.15.72:0/3488069002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3840094a0 con 0x7fd39009e410 2023-10-03T10:16:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.046+0000 7fd395f1c700 1 -- 172.21.15.72:0/3488069002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39009c700 con 0x7fd39009e410 2023-10-03T10:16:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.046+0000 7fd377fff700 1 -- 172.21.15.72:0/3488069002 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd38800c820 con 0x7fd39009e410 2023-10-03T10:16:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.046+0000 7fd377fff700 1 -- 172.21.15.72:0/3488069002 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd38803f640 con 0x7fd39009e410 2023-10-03T10:16:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.047+0000 7fd395f1c700 1 -- 172.21.15.72:0/3488069002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39011a410 con 0x7fd39009e410 2023-10-03T10:16:15.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.051+0000 7fd377fff700 1 -- 172.21.15.72:0/3488069002 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd388003dc0 con 0x7fd39009e410 2023-10-03T10:16:15.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:15.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.096+0000 7f73c6711700 1 -- 172.21.15.72:0/3756162623 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f73c00a1dd0 con 0x7f73c009d6f0 2023-10-03T10:16:15.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.096+0000 7f73bcff9700 1 -- 172.21.15.72:0/3756162623 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73a8011360 con 0x7f73c009d6f0 2023-10-03T10:16:15.097 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.098+0000 7f73c6711700 1 -- 172.21.15.72:0/3756162623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73c009d6f0 msgr2=0x7f73c01c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.098+0000 7f73c6711700 1 --2- 172.21.15.72:0/3756162623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73c009d6f0 0x7f73c01c8460 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f73a800c470 tx=0x7f73a800c780 comp rx=0 tx=0).stop 2023-10-03T10:16:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.098+0000 7f73c6711700 1 -- 172.21.15.72:0/3756162623 shutdown_connections 2023-10-03T10:16:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.098+0000 7f73c6711700 1 --2- 172.21.15.72:0/3756162623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73c009d6f0 0x7f73c01c8460 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.098+0000 7f73c6711700 1 --2- 172.21.15.72:0/3756162623 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73c0139170 0x7f73c01c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.098+0000 7f73c6711700 1 --2- 172.21.15.72:0/3756162623 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73c009e1d0 0x7f73c01c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.098+0000 7f73c6711700 1 -- 172.21.15.72:0/3756162623 >> 172.21.15.72:0/3756162623 conn(0x7f73c0066f50 msgr2=0x7f73c0136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.098+0000 7f73c6711700 1 -- 172.21.15.72:0/3756162623 shutdown_connections 2023-10-03T10:16:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.098+0000 7f73c6711700 1 -- 172.21.15.72:0/3756162623 wait complete. 2023-10-03T10:16:15.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:15.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.239+0000 7fd395f1c700 1 -- 172.21.15.72:0/3488069002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd390074ea0 con 0x7fd39009e410 2023-10-03T10:16:15.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.240+0000 7fd377fff700 1 -- 172.21.15.72:0/3488069002 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd38801de00 con 0x7fd39009e410 2023-10-03T10:16:15.240 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.242+0000 7fd395f1c700 1 -- 172.21.15.72:0/3488069002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd39009e410 msgr2=0x7fd3901383a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.242+0000 7fd395f1c700 1 --2- 172.21.15.72:0/3488069002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd39009e410 0x7fd3901383a0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd38800efc0 tx=0x7fd38800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.242+0000 7fd395f1c700 1 -- 172.21.15.72:0/3488069002 shutdown_connections 2023-10-03T10:16:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.242+0000 7fd395f1c700 1 --2- 172.21.15.72:0/3488069002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd39009e410 0x7fd3901383a0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.242+0000 7fd395f1c700 1 --2- 172.21.15.72:0/3488069002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd39009d6f0 0x7fd390137920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.242+0000 7fd395f1c700 1 --2- 172.21.15.72:0/3488069002 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd39009e000 0x7fd390137e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.242+0000 7fd395f1c700 1 -- 172.21.15.72:0/3488069002 >> 172.21.15.72:0/3488069002 conn(0x7fd390066f50 msgr2=0x7fd390070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.242+0000 7fd395f1c700 1 -- 172.21.15.72:0/3488069002 shutdown_connections 2023-10-03T10:16:15.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:15.242+0000 7fd395f1c700 1 -- 172.21.15.72:0/3488069002 wait complete. 2023-10-03T10:16:15.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:15.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:16.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.006+0000 7f215e8d6700 1 Processor -- start 2023-10-03T10:16:16.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.006+0000 7f215e8d6700 1 -- start start 2023-10-03T10:16:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f215e8d6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2158133a80 0x7f2158133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f215e8d6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f215812ff20 0x7f2158130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f215e8d6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f215806bc00 con 0x7f2158130870 2023-10-03T10:16:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f215e8d6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215806c570 con 0x7f215812ff20 2023-10-03T10:16:16.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f215e8d6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21580a0040 con 0x7f2158133a80 2023-10-03T10:16:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f2157fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2158133a80 0x7f2158133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f21577fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f215812ff20 0x7f2158130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f21577fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f215812ff20 0x7f2158130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35840/0 (socket says 172.21.15.72:35840) 2023-10-03T10:16:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f2157fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2158133a80 0x7f2158133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52178/0 (socket says 172.21.15.72:52178) 2023-10-03T10:16:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f21577fe700 1 -- 172.21.15.72:0/282545487 learned_addr learned my addr 172.21.15.72:0/282545487 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f21577fe700 1 -- 172.21.15.72:0/282545487 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2158133a80 msgr2=0x7f2158133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f21577fe700 1 --2- 172.21.15.72:0/282545487 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2158133a80 0x7f2158133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f21577fe700 1 -- 172.21.15.72:0/282545487 >> v1:172.21.15.72:6789/0 conn(0x7f2158130870 legacy=0x7f215813a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f21577fe700 1 -- 172.21.15.72:0/282545487 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158133860 con 0x7f215812ff20 2023-10-03T10:16:16.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f2157fff700 1 --2- 172.21.15.72:0/282545487 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2158133a80 0x7f2158133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.007+0000 7f21577fe700 1 --2- 172.21.15.72:0/282545487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f215812ff20 0x7f2158130330 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f214c0098f0 tx=0x7f214c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b0b1d24e14e8fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.008+0000 7f2156ffd700 1 -- 172.21.15.72:0/282545487 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c011830 con 0x7f215812ff20 2023-10-03T10:16:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.008+0000 7f2156ffd700 1 -- 172.21.15.72:0/282545487 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c011990 con 0x7f215812ff20 2023-10-03T10:16:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.008+0000 7f2156ffd700 1 -- 172.21.15.72:0/282545487 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c011d20 con 0x7f215812ff20 2023-10-03T10:16:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.008+0000 7f215e8d6700 1 -- 172.21.15.72:0/282545487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f215812ff20 msgr2=0x7f2158130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.008+0000 7f215e8d6700 1 --2- 172.21.15.72:0/282545487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f215812ff20 0x7f2158130330 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f214c0098f0 tx=0x7f214c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.008+0000 7f215e8d6700 1 -- 172.21.15.72:0/282545487 shutdown_connections 2023-10-03T10:16:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.008+0000 7f215e8d6700 1 --2- 172.21.15.72:0/282545487 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2158133a80 0x7f2158133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.008+0000 7f215e8d6700 1 --2- 172.21.15.72:0/282545487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f215812ff20 0x7f2158130330 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.008+0000 7f215e8d6700 1 -- 172.21.15.72:0/282545487 >> 172.21.15.72:0/282545487 conn(0x7f21580a4210 msgr2=0x7f21580a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.008+0000 7f215e8d6700 1 -- 172.21.15.72:0/282545487 shutdown_connections 2023-10-03T10:16:16.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.008+0000 7f215e8d6700 1 -- 172.21.15.72:0/282545487 wait complete. 2023-10-03T10:16:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.009+0000 7f215e8d6700 1 Processor -- start 2023-10-03T10:16:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.010+0000 7f215e8d6700 1 -- start start 2023-10-03T10:16:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.010+0000 7f215e8d6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f215812ff20 0x7f215809c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.010+0000 7f215e8d6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2158130870 0x7f215809ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.010+0000 7f215e8d6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2158133a80 0x7f215809cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.010+0000 7f215e8d6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21580a1fa0 con 0x7f2158133a80 2023-10-03T10:16:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.010+0000 7f215e8d6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215809e0a0 con 0x7f215812ff20 2023-10-03T10:16:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.010+0000 7f215e8d6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2158120040 con 0x7f2158130870 2023-10-03T10:16:16.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.010+0000 7f2157fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f215812ff20 0x7f215809c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.010+0000 7f21577fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2158130870 0x7f215809ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.010+0000 7f2157fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f215812ff20 0x7f215809c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46798/0 (socket says 172.21.15.72:46798) 2023-10-03T10:16:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.010+0000 7f2157fff700 1 -- 172.21.15.72:0/2064506949 learned_addr learned my addr 172.21.15.72:0/2064506949 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.010+0000 7f215ce73700 1 --2- 172.21.15.72:0/2064506949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2158133a80 0x7f215809cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.011+0000 7f2157fff700 1 -- 172.21.15.72:0/2064506949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2158130870 msgr2=0x7f215809ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.011+0000 7f2157fff700 1 --2- 172.21.15.72:0/2064506949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2158130870 0x7f215809ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.011+0000 7f2157fff700 1 -- 172.21.15.72:0/2064506949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2158133a80 msgr2=0x7f215809cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.011+0000 7f2157fff700 1 --2- 172.21.15.72:0/2064506949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2158133a80 0x7f215809cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.011+0000 7f2157fff700 1 -- 172.21.15.72:0/2064506949 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21480094a0 con 0x7f215812ff20 2023-10-03T10:16:16.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.011+0000 7f21577fe700 1 --2- 172.21.15.72:0/2064506949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2158130870 0x7f215809ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.011+0000 7f215ce73700 1 --2- 172.21.15.72:0/2064506949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2158133a80 0x7f215809cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.011+0000 7f2157fff700 1 --2- 172.21.15.72:0/2064506949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f215812ff20 0x7f215809c550 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f214800ec10 tx=0x7f214800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.011+0000 7f2154ff9700 1 -- 172.21.15.72:0/2064506949 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214800c850 con 0x7f215812ff20 2023-10-03T10:16:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.011+0000 7f2154ff9700 1 -- 172.21.15.72:0/2064506949 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214800c9b0 con 0x7f215812ff20 2023-10-03T10:16:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.011+0000 7f2154ff9700 1 -- 172.21.15.72:0/2064506949 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214800cd20 con 0x7f215812ff20 2023-10-03T10:16:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.011+0000 7f215e8d6700 1 -- 172.21.15.72:0/2064506949 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c009550 con 0x7f215812ff20 2023-10-03T10:16:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.011+0000 7f215e8d6700 1 -- 172.21.15.72:0/2064506949 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215811fd80 con 0x7f215812ff20 2023-10-03T10:16:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.012+0000 7f2154ff9700 1 -- 172.21.15.72:0/2064506949 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2148013470 con 0x7f215812ff20 2023-10-03T10:16:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.012+0000 7f2154ff9700 1 -- 172.21.15.72:0/2064506949 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f214803fb30 con 0x7f215812ff20 2023-10-03T10:16:16.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.012+0000 7f215e8d6700 1 -- 172.21.15.72:0/2064506949 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2158120280 con 0x7f215812ff20 2023-10-03T10:16:16.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.017+0000 7f2154ff9700 1 -- 172.21.15.72:0/2064506949 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2148021080 con 0x7f215812ff20 2023-10-03T10:16:16.057 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:16.112 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:16.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.188+0000 7fbf1a6c7700 1 Processor -- start 2023-10-03T10:16:16.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.188+0000 7fbf1a6c7700 1 -- start start 2023-10-03T10:16:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.189+0000 7fbf1a6c7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf1409e930 0x7fbf1409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.189+0000 7fbf1a6c7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf1409f240 0x7fbf141317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.189+0000 7fbf1a6c7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf1409f650 0x7fbf14131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.189+0000 7fbf1a6c7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf14070940 con 0x7fbf1409f650 2023-10-03T10:16:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.189+0000 7fbf1a6c7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1406fd60 con 0x7fbf1409f240 2023-10-03T10:16:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.189+0000 7fbf1a6c7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1406fa80 con 0x7fbf1409e930 2023-10-03T10:16:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.189+0000 7fbf13fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf1409e930 0x7fbf1409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.189+0000 7fbf13fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf1409e930 0x7fbf1409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52190/0 (socket says 172.21.15.72:52190) 2023-10-03T10:16:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.189+0000 7fbf13fff700 1 -- 172.21.15.72:0/1023082852 learned_addr learned my addr 172.21.15.72:0/1023082852 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.189+0000 7fbf137fe700 1 --2- 172.21.15.72:0/1023082852 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf1409f240 0x7fbf141317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.189+0000 7fbf18c64700 1 --2- 172.21.15.72:0/1023082852 >> v2:172.21.15.72:3300/0 conn(0x7fbf1409f650 0x7fbf14131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.190+0000 7fbf13fff700 1 -- 172.21.15.72:0/1023082852 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf1409f240 msgr2=0x7fbf141317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.190+0000 7fbf13fff700 1 --2- 172.21.15.72:0/1023082852 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf1409f240 0x7fbf141317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.190+0000 7fbf13fff700 1 -- 172.21.15.72:0/1023082852 >> v2:172.21.15.72:3300/0 conn(0x7fbf1409f650 msgr2=0x7fbf14131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.190+0000 7fbf13fff700 1 --2- 172.21.15.72:0/1023082852 >> v2:172.21.15.72:3300/0 conn(0x7fbf1409f650 0x7fbf14131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.190+0000 7fbf13fff700 1 -- 172.21.15.72:0/1023082852 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1409fb60 con 0x7fbf1409e930 2023-10-03T10:16:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.190+0000 7fbf137fe700 1 --2- 172.21.15.72:0/1023082852 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf1409f240 0x7fbf141317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.190+0000 7fbf13fff700 1 --2- 172.21.15.72:0/1023082852 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf1409e930 0x7fbf1409ed00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbf040098f0 tx=0x7fbf04009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6b78ab33d0bc198 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.190+0000 7fbf12ffd700 1 -- 172.21.15.72:0/1023082852 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04011830 con 0x7fbf1409e930 2023-10-03T10:16:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.190+0000 7fbf12ffd700 1 -- 172.21.15.72:0/1023082852 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf04011990 con 0x7fbf1409e930 2023-10-03T10:16:16.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.190+0000 7fbf12ffd700 1 -- 172.21.15.72:0/1023082852 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04011d20 con 0x7fbf1409e930 2023-10-03T10:16:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.191+0000 7fbf1a6c7700 1 -- 172.21.15.72:0/1023082852 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf1409e930 msgr2=0x7fbf1409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.191+0000 7fbf1a6c7700 1 --2- 172.21.15.72:0/1023082852 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf1409e930 0x7fbf1409ed00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbf040098f0 tx=0x7fbf04009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.191+0000 7fbf1a6c7700 1 -- 172.21.15.72:0/1023082852 shutdown_connections 2023-10-03T10:16:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.191+0000 7fbf1a6c7700 1 --2- 172.21.15.72:0/1023082852 >> v2:172.21.15.72:3300/0 conn(0x7fbf1409f650 0x7fbf14131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.191+0000 7fbf1a6c7700 1 --2- 172.21.15.72:0/1023082852 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf1409e930 0x7fbf1409ed00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.191+0000 7fbf1a6c7700 1 --2- 172.21.15.72:0/1023082852 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf1409f240 0x7fbf141317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.191+0000 7fbf1a6c7700 1 -- 172.21.15.72:0/1023082852 >> 172.21.15.72:0/1023082852 conn(0x7fbf140a4210 msgr2=0x7fbf140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.191+0000 7fbf1a6c7700 1 -- 172.21.15.72:0/1023082852 shutdown_connections 2023-10-03T10:16:16.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.191+0000 7fbf1a6c7700 1 -- 172.21.15.72:0/1023082852 wait complete. 2023-10-03T10:16:16.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.192+0000 7fbf1a6c7700 1 Processor -- start 2023-10-03T10:16:16.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.192+0000 7fbf1a6c7700 1 -- start start 2023-10-03T10:16:16.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.192+0000 7fbf1a6c7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf1409e930 0x7fbf1406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf1a6c7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1409f240 0x7fbf1406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf1a6c7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf1409f650 0x7fbf1406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf1a6c7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1406cd80 con 0x7fbf1409f240 2023-10-03T10:16:16.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf1a6c7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf141b71d0 con 0x7fbf1409e930 2023-10-03T10:16:16.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf1a6c7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf141a9380 con 0x7fbf1409f650 2023-10-03T10:16:16.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf13fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf1409e930 0x7fbf1406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf13fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf1409e930 0x7fbf1406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46822/0 (socket says 172.21.15.72:46822) 2023-10-03T10:16:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf13fff700 1 -- 172.21.15.72:0/367296904 learned_addr learned my addr 172.21.15.72:0/367296904 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf137fe700 1 --2- 172.21.15.72:0/367296904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1409f240 0x7fbf1406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf18c64700 1 --2- 172.21.15.72:0/367296904 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf1409f650 0x7fbf1406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf13fff700 1 -- 172.21.15.72:0/367296904 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf1409f650 msgr2=0x7fbf1406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf13fff700 1 --2- 172.21.15.72:0/367296904 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf1409f650 0x7fbf1406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf13fff700 1 -- 172.21.15.72:0/367296904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1409f240 msgr2=0x7fbf1406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf13fff700 1 --2- 172.21.15.72:0/367296904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1409f240 0x7fbf1406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf13fff700 1 -- 172.21.15.72:0/367296904 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf080094a0 con 0x7fbf1409e930 2023-10-03T10:16:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf13fff700 1 --2- 172.21.15.72:0/367296904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf1409e930 0x7fbf1406b8b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbf04000c00 tx=0x7fbf04004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf10ff9700 1 -- 172.21.15.72:0/367296904 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04004240 con 0x7fbf1409e930 2023-10-03T10:16:16.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf10ff9700 1 -- 172.21.15.72:0/367296904 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0401f070 con 0x7fbf1409e930 2023-10-03T10:16:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf1a6c7700 1 -- 172.21.15.72:0/367296904 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf04009550 con 0x7fbf1409e930 2023-10-03T10:16:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf10ff9700 1 -- 172.21.15.72:0/367296904 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf040045e0 con 0x7fbf1409e930 2023-10-03T10:16:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.193+0000 7fbf1a6c7700 1 -- 172.21.15.72:0/367296904 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf140a0190 con 0x7fbf1409e930 2023-10-03T10:16:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.194+0000 7fbf10ff9700 1 -- 172.21.15.72:0/367296904 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf04021030 con 0x7fbf1409e930 2023-10-03T10:16:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.194+0000 7fbf10ff9700 1 -- 172.21.15.72:0/367296904 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbf040408a0 con 0x7fbf1409e930 2023-10-03T10:16:16.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.194+0000 7fbf1a6c7700 1 -- 172.21.15.72:0/367296904 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf141a0b30 con 0x7fbf1409e930 2023-10-03T10:16:16.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.199+0000 7fbf10ff9700 1 -- 172.21.15.72:0/367296904 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf0401a450 con 0x7fbf1409e930 2023-10-03T10:16:16.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.212+0000 7f215e8d6700 1 -- 172.21.15.72:0/2064506949 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f215812d750 con 0x7f215812ff20 2023-10-03T10:16:16.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.213+0000 7f2154ff9700 1 -- 172.21.15.72:0/2064506949 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2148013720 con 0x7f215812ff20 2023-10-03T10:16:16.213 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:16.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.215+0000 7f215e8d6700 1 -- 172.21.15.72:0/2064506949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f215812ff20 msgr2=0x7f215809c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.215+0000 7f215e8d6700 1 --2- 172.21.15.72:0/2064506949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f215812ff20 0x7f215809c550 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f214800ec10 tx=0x7f214800ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.215+0000 7f215e8d6700 1 -- 172.21.15.72:0/2064506949 shutdown_connections 2023-10-03T10:16:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.215+0000 7f215e8d6700 1 --2- 172.21.15.72:0/2064506949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2158133a80 0x7f215809cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.215+0000 7f215e8d6700 1 --2- 172.21.15.72:0/2064506949 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f215812ff20 0x7f215809c550 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.215+0000 7f215e8d6700 1 --2- 172.21.15.72:0/2064506949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2158130870 0x7f215809ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.215+0000 7f215e8d6700 1 -- 172.21.15.72:0/2064506949 >> 172.21.15.72:0/2064506949 conn(0x7f21580a4210 msgr2=0x7f215809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.215+0000 7f215e8d6700 1 -- 172.21.15.72:0/2064506949 shutdown_connections 2023-10-03T10:16:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.215+0000 7f215e8d6700 1 -- 172.21.15.72:0/2064506949 wait complete. 2023-10-03T10:16:16.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:16.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.250+0000 7fa7e8f3b700 1 Processor -- start 2023-10-03T10:16:16.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.250+0000 7fa7e8f3b700 1 -- start start 2023-10-03T10:16:16.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.251+0000 7fa7e8f3b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7e40a0a30 0x7fa7e40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.251+0000 7fa7e8f3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7e4134170 0x7fa7e413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.251+0000 7fa7e8f3b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e409edd0 con 0x7fa7e40a1340 2023-10-03T10:16:16.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.251+0000 7fa7e8f3b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e409e1f0 con 0x7fa7e4134170 2023-10-03T10:16:16.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.251+0000 7fa7e8f3b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e409dc50 con 0x7fa7e40a0a30 2023-10-03T10:16:16.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.251+0000 7fa7e259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7e40a0a30 0x7fa7e40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.251+0000 7fa7e1d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa7e40a1340 0x7fa7e4133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60076/0 (socket says 172.21.15.72:60076) 2023-10-03T10:16:16.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.251+0000 7fa7e2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7e4134170 0x7fa7e413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.251+0000 7fa7e1d9b700 1 -- 172.21.15.72:0/3429761286 learned_addr learned my addr 172.21.15.72:0/3429761286 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.251+0000 7fa7e259c700 1 -- 172.21.15.72:0/3429761286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7e4134170 msgr2=0x7fa7e413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.251+0000 7fa7e259c700 1 --2- 172.21.15.72:0/3429761286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7e4134170 0x7fa7e413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.251+0000 7fa7e259c700 1 -- 172.21.15.72:0/3429761286 >> v1:172.21.15.72:6789/0 conn(0x7fa7e40a1340 legacy=0x7fa7e4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.251+0000 7fa7e159a700 1 -- 172.21.15.72:0/3429761286 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480671941 0 0) 0x7fa7e409edd0 con 0x7fa7e40a1340 2023-10-03T10:16:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.251+0000 7fa7e259c700 1 -- 172.21.15.72:0/3429761286 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e40a1fe0 con 0x7fa7e40a0a30 2023-10-03T10:16:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.251+0000 7fa7e259c700 1 --2- 172.21.15.72:0/3429761286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7e40a0a30 0x7fa7e40a0e00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009870 tx=0x7fa7d4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=137118d4fe66822a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.252+0000 7fa7e159a700 1 -- 172.21.15.72:0/3429761286 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4011830 con 0x7fa7e40a0a30 2023-10-03T10:16:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.252+0000 7fa7e159a700 1 -- 172.21.15.72:0/3429761286 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d4011990 con 0x7fa7e40a0a30 2023-10-03T10:16:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.252+0000 7fa7e159a700 1 -- 172.21.15.72:0/3429761286 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4011d20 con 0x7fa7e40a0a30 2023-10-03T10:16:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.252+0000 7fa7e8f3b700 1 -- 172.21.15.72:0/3429761286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7e40a0a30 msgr2=0x7fa7e40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.252+0000 7fa7e8f3b700 1 --2- 172.21.15.72:0/3429761286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7e40a0a30 0x7fa7e40a0e00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009870 tx=0x7fa7d4009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:16.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.252+0000 7fa7e8f3b700 1 -- 172.21.15.72:0/3429761286 shutdown_connections 2023-10-03T10:16:16.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.252+0000 7fa7e8f3b700 1 --2- 172.21.15.72:0/3429761286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7e4134170 0x7fa7e413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.252+0000 7fa7e8f3b700 1 --2- 172.21.15.72:0/3429761286 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7e40a0a30 0x7fa7e40a0e00 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.252+0000 7fa7e8f3b700 1 -- 172.21.15.72:0/3429761286 >> 172.21.15.72:0/3429761286 conn(0x7fa7e40a6550 msgr2=0x7fa7e40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.252+0000 7fa7e8f3b700 1 -- 172.21.15.72:0/3429761286 shutdown_connections 2023-10-03T10:16:16.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.252+0000 7fa7e8f3b700 1 -- 172.21.15.72:0/3429761286 wait complete. 2023-10-03T10:16:16.255 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:16.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.254+0000 7fa7e8f3b700 1 Processor -- start 2023-10-03T10:16:16.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.254+0000 7fa7e8f3b700 1 -- start start 2023-10-03T10:16:16.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.254+0000 7fa7e8f3b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7e40a0a30 0x7fa7e4122640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.254+0000 7fa7e8f3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7e40a1340 0x7fa7e4122b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.254+0000 7fa7e8f3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7e4134170 0x7fa7e41230c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.254+0000 7fa7e8f3b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e41331e0 con 0x7fa7e40a1340 2023-10-03T10:16:16.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.254+0000 7fa7e8f3b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e4124360 con 0x7fa7e4134170 2023-10-03T10:16:16.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.254+0000 7fa7e8f3b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e40a0220 con 0x7fa7e40a0a30 2023-10-03T10:16:16.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.254+0000 7fa7e1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7e40a1340 0x7fa7e4122b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.254+0000 7fa7e259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7e40a0a30 0x7fa7e4122640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.254+0000 7fa7e1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7e40a1340 0x7fa7e4122b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35892/0 (socket says 172.21.15.72:35892) 2023-10-03T10:16:16.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.254+0000 7fa7e1d9b700 1 -- 172.21.15.72:0/2107984969 learned_addr learned my addr 172.21.15.72:0/2107984969 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:16.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.254+0000 7fa7e2d9d700 1 --2- 172.21.15.72:0/2107984969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7e4134170 0x7fa7e41230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.255+0000 7fa7e259c700 1 -- 172.21.15.72:0/2107984969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7e4134170 msgr2=0x7fa7e41230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.255+0000 7fa7e259c700 1 --2- 172.21.15.72:0/2107984969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7e4134170 0x7fa7e41230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.255+0000 7fa7e259c700 1 -- 172.21.15.72:0/2107984969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7e40a1340 msgr2=0x7fa7e4122b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.255+0000 7fa7e259c700 1 --2- 172.21.15.72:0/2107984969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7e40a1340 0x7fa7e4122b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.255+0000 7fa7e259c700 1 -- 172.21.15.72:0/2107984969 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d40094a0 con 0x7fa7e40a0a30 2023-10-03T10:16:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.255+0000 7fa7e259c700 1 --2- 172.21.15.72:0/2107984969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7e40a0a30 0x7fa7e4122640 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4016000 tx=0x7fa7d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.255+0000 7fa7d2ffd700 1 -- 172.21.15.72:0/2107984969 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4004510 con 0x7fa7e40a0a30 2023-10-03T10:16:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.255+0000 7fa7d2ffd700 1 -- 172.21.15.72:0/2107984969 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d401f070 con 0x7fa7e40a0a30 2023-10-03T10:16:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.255+0000 7fa7e8f3b700 1 -- 172.21.15.72:0/2107984969 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e40a25e0 con 0x7fa7e40a0a30 2023-10-03T10:16:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.255+0000 7fa7d2ffd700 1 -- 172.21.15.72:0/2107984969 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d40038c0 con 0x7fa7e40a0a30 2023-10-03T10:16:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.255+0000 7fa7e8f3b700 1 -- 172.21.15.72:0/2107984969 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e4126160 con 0x7fa7e40a0a30 2023-10-03T10:16:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.256+0000 7fa7d2ffd700 1 -- 172.21.15.72:0/2107984969 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7d4003a20 con 0x7fa7e40a0a30 2023-10-03T10:16:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.256+0000 7fa7d2ffd700 1 -- 172.21.15.72:0/2107984969 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa7d4021070 con 0x7fa7e40a0a30 2023-10-03T10:16:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.256+0000 7fa7e8f3b700 1 -- 172.21.15.72:0/2107984969 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e4074ea0 con 0x7fa7e40a0a30 2023-10-03T10:16:16.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.265+0000 7fa7d2ffd700 1 -- 172.21.15.72:0/2107984969 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7d401a430 con 0x7fa7e40a0a30 2023-10-03T10:16:16.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.381+0000 7f9f62263700 1 Processor -- start 2023-10-03T10:16:16.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.381+0000 7f9f62263700 1 -- start start 2023-10-03T10:16:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f62263700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f5c09e1d0 0x7f9f5c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f62263700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f5c139170 0x7f9f5c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f62263700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c09b120 con 0x7f9f5c09d6f0 2023-10-03T10:16:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f62263700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5c06b460 con 0x7f9f5c09e1d0 2023-10-03T10:16:16.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f62263700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c09a7e0 con 0x7f9f5c139170 2023-10-03T10:16:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f5b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f5c09e1d0 0x7f9f5c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f60800700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f5c139170 0x7f9f5c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f5b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f5c09e1d0 0x7f9f5c138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35894/0 (socket says 172.21.15.72:35894) 2023-10-03T10:16:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f5b7fe700 1 -- 172.21.15.72:0/3822849010 learned_addr learned my addr 172.21.15.72:0/3822849010 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f60800700 1 --2- 172.21.15.72:0/3822849010 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f5c139170 0x7f9f5c13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52222/0 (socket says 172.21.15.72:52222) 2023-10-03T10:16:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f60800700 1 -- 172.21.15.72:0/3822849010 >> v2:172.21.15.72:3300/0 conn(0x7f9f5c09e1d0 msgr2=0x7f9f5c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f60800700 1 --2- 172.21.15.72:0/3822849010 >> v2:172.21.15.72:3300/0 conn(0x7f9f5c09e1d0 0x7f9f5c138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f60800700 1 -- 172.21.15.72:0/3822849010 >> v1:172.21.15.72:6789/0 conn(0x7f9f5c09d6f0 legacy=0x7f9f5c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f60800700 1 -- 172.21.15.72:0/3822849010 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c09a500 con 0x7f9f5c139170 2023-10-03T10:16:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f5b7fe700 1 --2- 172.21.15.72:0/3822849010 >> v2:172.21.15.72:3300/0 conn(0x7f9f5c09e1d0 0x7f9f5c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.382+0000 7f9f60800700 1 --2- 172.21.15.72:0/3822849010 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f5c139170 0x7f9f5c13b550 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009dc0 tx=0x7f9f5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bd8898a9afbaa76 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.383+0000 7f9f5affd700 1 -- 172.21.15.72:0/3822849010 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5400e070 con 0x7f9f5c139170 2023-10-03T10:16:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.383+0000 7f9f5affd700 1 -- 172.21.15.72:0/3822849010 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5400bae0 con 0x7f9f5c139170 2023-10-03T10:16:16.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.383+0000 7f9f5affd700 1 -- 172.21.15.72:0/3822849010 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5400be90 con 0x7f9f5c139170 2023-10-03T10:16:16.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.383+0000 7f9f62263700 1 -- 172.21.15.72:0/3822849010 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f5c139170 msgr2=0x7f9f5c13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.383+0000 7f9f62263700 1 --2- 172.21.15.72:0/3822849010 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f5c139170 0x7f9f5c13b550 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009dc0 tx=0x7f9f5400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:16.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.383+0000 7f9f62263700 1 -- 172.21.15.72:0/3822849010 shutdown_connections 2023-10-03T10:16:16.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.383+0000 7f9f62263700 1 --2- 172.21.15.72:0/3822849010 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f5c139170 0x7f9f5c13b550 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.383+0000 7f9f62263700 1 --2- 172.21.15.72:0/3822849010 >> v2:172.21.15.72:3300/0 conn(0x7f9f5c09e1d0 0x7f9f5c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.383+0000 7f9f62263700 1 -- 172.21.15.72:0/3822849010 >> 172.21.15.72:0/3822849010 conn(0x7f9f5c066f50 msgr2=0x7f9f5c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.383+0000 7f9f62263700 1 -- 172.21.15.72:0/3822849010 shutdown_connections 2023-10-03T10:16:16.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.383+0000 7f9f62263700 1 -- 172.21.15.72:0/3822849010 wait complete. 2023-10-03T10:16:16.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.385+0000 7f9f62263700 1 Processor -- start 2023-10-03T10:16:16.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.385+0000 7f9f62263700 1 -- start start 2023-10-03T10:16:16.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.385+0000 7f9f62263700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c09d6f0 0x7f9f5c120880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.385+0000 7f9f62263700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c09e1d0 0x7f9f5c120dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.385+0000 7f9f62263700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f5c139170 0x7f9f5c121300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.385+0000 7f9f62263700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c1240d0 con 0x7f9f5c09e1d0 2023-10-03T10:16:16.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.385+0000 7f9f62263700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c124320 con 0x7f9f5c09d6f0 2023-10-03T10:16:16.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.385+0000 7f9f62263700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c123a90 con 0x7f9f5c139170 2023-10-03T10:16:16.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.385+0000 7f9f5bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c09d6f0 0x7f9f5c120880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.385+0000 7f9f5b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c09e1d0 0x7f9f5c120dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.385+0000 7f9f5bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c09d6f0 0x7f9f5c120880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46844/0 (socket says 172.21.15.72:46844) 2023-10-03T10:16:16.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.385+0000 7f9f5b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c09e1d0 0x7f9f5c120dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35896/0 (socket says 172.21.15.72:35896) 2023-10-03T10:16:16.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.385+0000 7f9f5bfff700 1 -- 172.21.15.72:0/3944390461 learned_addr learned my addr 172.21.15.72:0/3944390461 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:16.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.386+0000 7f9f60800700 1 --2- 172.21.15.72:0/3944390461 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f5c139170 0x7f9f5c121300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.386+0000 7f9f5b7fe700 1 -- 172.21.15.72:0/3944390461 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f5c139170 msgr2=0x7f9f5c121300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.386+0000 7f9f5b7fe700 1 --2- 172.21.15.72:0/3944390461 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f5c139170 0x7f9f5c121300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.386+0000 7f9f5b7fe700 1 -- 172.21.15.72:0/3944390461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c09d6f0 msgr2=0x7f9f5c120880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.386+0000 7f9f5b7fe700 1 --2- 172.21.15.72:0/3944390461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c09d6f0 0x7f9f5c120880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.386+0000 7f9f5b7fe700 1 -- 172.21.15.72:0/3944390461 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f50009550 con 0x7f9f5c09e1d0 2023-10-03T10:16:16.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.386+0000 7f9f5bfff700 1 --2- 172.21.15.72:0/3944390461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c09d6f0 0x7f9f5c120880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.386+0000 7f9f5b7fe700 1 --2- 172.21.15.72:0/3944390461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c09e1d0 0x7f9f5c120dc0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000e9a0 tx=0x7f9f5000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.386+0000 7f9f58ff9700 1 -- 172.21.15.72:0/3944390461 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50004030 con 0x7f9f5c09e1d0 2023-10-03T10:16:16.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.386+0000 7f9f58ff9700 1 -- 172.21.15.72:0/3944390461 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f50004190 con 0x7f9f5c09e1d0 2023-10-03T10:16:16.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.386+0000 7f9f62263700 1 -- 172.21.15.72:0/3944390461 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f54009a70 con 0x7f9f5c09e1d0 2023-10-03T10:16:16.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.386+0000 7f9f58ff9700 1 -- 172.21.15.72:0/3944390461 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50004520 con 0x7f9f5c09e1d0 2023-10-03T10:16:16.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.386+0000 7f9f62263700 1 -- 172.21.15.72:0/3944390461 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5c0a1950 con 0x7f9f5c09e1d0 2023-10-03T10:16:16.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.387+0000 7f9f58ff9700 1 -- 172.21.15.72:0/3944390461 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f500036a0 con 0x7f9f5c09e1d0 2023-10-03T10:16:16.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.387+0000 7f9f58ff9700 1 -- 172.21.15.72:0/3944390461 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9f5003f8c0 con 0x7f9f5c09e1d0 2023-10-03T10:16:16.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.387+0000 7f9f62263700 1 -- 172.21.15.72:0/3944390461 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5c09c770 con 0x7f9f5c09e1d0 2023-10-03T10:16:16.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.392+0000 7f9f58ff9700 1 -- 172.21.15.72:0/3944390461 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f50011db0 con 0x7f9f5c09e1d0 2023-10-03T10:16:16.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.400+0000 7fbf1a6c7700 1 -- 172.21.15.72:0/367296904 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbf140a3610 con 0x7fbf1409e930 2023-10-03T10:16:16.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.401+0000 7fbf10ff9700 1 -- 172.21.15.72:0/367296904 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbf040233d0 con 0x7fbf1409e930 2023-10-03T10:16:16.401 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:16.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.403+0000 7fbf1a6c7700 1 -- 172.21.15.72:0/367296904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf1409e930 msgr2=0x7fbf1406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.403+0000 7fbf1a6c7700 1 --2- 172.21.15.72:0/367296904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf1409e930 0x7fbf1406b8b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbf04000c00 tx=0x7fbf04004750 comp rx=0 tx=0).stop 2023-10-03T10:16:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.403+0000 7fbf1a6c7700 1 -- 172.21.15.72:0/367296904 shutdown_connections 2023-10-03T10:16:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.403+0000 7fbf1a6c7700 1 --2- 172.21.15.72:0/367296904 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbf1409f650 0x7fbf1406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.403+0000 7fbf1a6c7700 1 --2- 172.21.15.72:0/367296904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbf1409e930 0x7fbf1406b8b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.403+0000 7fbf1a6c7700 1 --2- 172.21.15.72:0/367296904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf1409f240 0x7fbf1406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.403+0000 7fbf1a6c7700 1 -- 172.21.15.72:0/367296904 >> 172.21.15.72:0/367296904 conn(0x7fbf140a4210 msgr2=0x7fbf141b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.403+0000 7fbf1a6c7700 1 -- 172.21.15.72:0/367296904 shutdown_connections 2023-10-03T10:16:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.403+0000 7fbf1a6c7700 1 -- 172.21.15.72:0/367296904 wait complete. 2023-10-03T10:16:16.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:16.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.461+0000 7fa7e8f3b700 1 -- 172.21.15.72:0/2107984969 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa7e40a28e0 con 0x7fa7e40a0a30 2023-10-03T10:16:16.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.461+0000 7fa7d2ffd700 1 -- 172.21.15.72:0/2107984969 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7d4015030 con 0x7fa7e40a0a30 2023-10-03T10:16:16.462 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.463+0000 7fa7e8f3b700 1 -- 172.21.15.72:0/2107984969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7e40a0a30 msgr2=0x7fa7e4122640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.463+0000 7fa7e8f3b700 1 --2- 172.21.15.72:0/2107984969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7e40a0a30 0x7fa7e4122640 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4016000 tx=0x7fa7d4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.463+0000 7fa7e8f3b700 1 -- 172.21.15.72:0/2107984969 shutdown_connections 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.463+0000 7fa7e8f3b700 1 --2- 172.21.15.72:0/2107984969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7e4134170 0x7fa7e41230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.463+0000 7fa7e8f3b700 1 --2- 172.21.15.72:0/2107984969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa7e40a0a30 0x7fa7e4122640 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.463+0000 7fa7e8f3b700 1 --2- 172.21.15.72:0/2107984969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7e40a1340 0x7fa7e4122b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.463+0000 7fa7e8f3b700 1 -- 172.21.15.72:0/2107984969 >> 172.21.15.72:0/2107984969 conn(0x7fa7e40a6550 msgr2=0x7fa7e409edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.463+0000 7fa7e8f3b700 1 -- 172.21.15.72:0/2107984969 shutdown_connections 2023-10-03T10:16:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.463+0000 7fa7e8f3b700 1 -- 172.21.15.72:0/2107984969 wait complete. 2023-10-03T10:16:16.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:16.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.583+0000 7f9f62263700 1 -- 172.21.15.72:0/3944390461 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9f5c123f30 con 0x7f9f5c09e1d0 2023-10-03T10:16:16.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.583+0000 7f9f58ff9700 1 -- 172.21.15.72:0/3944390461 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9f5c123f30 con 0x7f9f5c09e1d0 2023-10-03T10:16:16.584 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:16.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.585+0000 7f9f62263700 1 -- 172.21.15.72:0/3944390461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c09e1d0 msgr2=0x7f9f5c120dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.585+0000 7f9f62263700 1 --2- 172.21.15.72:0/3944390461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c09e1d0 0x7f9f5c120dc0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000e9a0 tx=0x7f9f5000ecb0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.585+0000 7f9f62263700 1 -- 172.21.15.72:0/3944390461 shutdown_connections 2023-10-03T10:16:16.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.585+0000 7f9f62263700 1 --2- 172.21.15.72:0/3944390461 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f5c139170 0x7f9f5c121300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.585+0000 7f9f62263700 1 --2- 172.21.15.72:0/3944390461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f5c09d6f0 0x7f9f5c120880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.585+0000 7f9f62263700 1 --2- 172.21.15.72:0/3944390461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f5c09e1d0 0x7f9f5c120dc0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.585+0000 7f9f62263700 1 -- 172.21.15.72:0/3944390461 >> 172.21.15.72:0/3944390461 conn(0x7f9f5c066f50 msgr2=0x7f9f5c09b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.585+0000 7f9f62263700 1 -- 172.21.15.72:0/3944390461 shutdown_connections 2023-10-03T10:16:16.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:16.585+0000 7f9f62263700 1 -- 172.21.15.72:0/3944390461 wait complete. 2023-10-03T10:16:16.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:17.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.360+0000 7f6db0a43700 1 Processor -- start 2023-10-03T10:16:17.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.360+0000 7f6db0a43700 1 -- start start 2023-10-03T10:16:17.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.360+0000 7f6db0a43700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dac09d6f0 0x7f6dac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.360+0000 7f6db0a43700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dac09e410 0x7f6dac134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.360+0000 7f6db0a43700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac09b120 con 0x7f6dac09e000 2023-10-03T10:16:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.360+0000 7f6db0a43700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac06b460 con 0x7f6dac09d6f0 2023-10-03T10:16:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.360+0000 7f6db0a43700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac09a7e0 con 0x7f6dac09e410 2023-10-03T10:16:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.360+0000 7f6daad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dac09e410 0x7f6dac134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.360+0000 7f6daa59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dac09d6f0 0x7f6dac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.360+0000 7f6da9d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6dac09e000 0x7f6dac1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60086/0 (socket says 172.21.15.72:60086) 2023-10-03T10:16:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.360+0000 7f6da9d9b700 1 -- 172.21.15.72:0/4275078762 learned_addr learned my addr 172.21.15.72:0/4275078762 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.361+0000 7f6da959a700 1 -- 172.21.15.72:0/4275078762 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076352594 0 0) 0x7f6dac09b120 con 0x7f6dac09e000 2023-10-03T10:16:17.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.361+0000 7f6da959a700 1 -- 172.21.15.72:0/4275078762 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d940035b0 con 0x7f6dac09e000 2023-10-03T10:16:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.361+0000 7f6daad9d700 1 -- 172.21.15.72:0/4275078762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dac09d6f0 msgr2=0x7f6dac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.361+0000 7f6daad9d700 1 --2- 172.21.15.72:0/4275078762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dac09d6f0 0x7f6dac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.361+0000 7f6daad9d700 1 -- 172.21.15.72:0/4275078762 >> v1:172.21.15.72:6789/0 conn(0x7f6dac09e000 legacy=0x7f6dac1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.361+0000 7f6daad9d700 1 -- 172.21.15.72:0/4275078762 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac09a500 con 0x7f6dac09e410 2023-10-03T10:16:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.361+0000 7f6daa59c700 1 --2- 172.21.15.72:0/4275078762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dac09d6f0 0x7f6dac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.361+0000 7f6daad9d700 1 --2- 172.21.15.72:0/4275078762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dac09e410 0x7f6dac134100 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009df0 tx=0x7f6da400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=264301b0d93c7910 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.361+0000 7f6da959a700 1 -- 172.21.15.72:0/4275078762 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da400e070 con 0x7f6dac09e410 2023-10-03T10:16:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.361+0000 7f6da959a700 1 -- 172.21.15.72:0/4275078762 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da400bae0 con 0x7f6dac09e410 2023-10-03T10:16:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.361+0000 7f6da959a700 1 -- 172.21.15.72:0/4275078762 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da400be50 con 0x7f6dac09e410 2023-10-03T10:16:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.362+0000 7f6db0a43700 1 -- 172.21.15.72:0/4275078762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dac09e410 msgr2=0x7f6dac134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.362+0000 7f6db0a43700 1 --2- 172.21.15.72:0/4275078762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dac09e410 0x7f6dac134100 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009df0 tx=0x7f6da400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:17.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.362+0000 7f6db0a43700 1 -- 172.21.15.72:0/4275078762 shutdown_connections 2023-10-03T10:16:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.362+0000 7f6db0a43700 1 --2- 172.21.15.72:0/4275078762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dac09e410 0x7f6dac134100 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.362+0000 7f6db0a43700 1 --2- 172.21.15.72:0/4275078762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dac09d6f0 0x7f6dac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.362+0000 7f6db0a43700 1 -- 172.21.15.72:0/4275078762 >> 172.21.15.72:0/4275078762 conn(0x7f6dac066f50 msgr2=0x7f6dac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.362+0000 7f6db0a43700 1 -- 172.21.15.72:0/4275078762 shutdown_connections 2023-10-03T10:16:17.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.362+0000 7f6db0a43700 1 -- 172.21.15.72:0/4275078762 wait complete. 2023-10-03T10:16:17.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.363+0000 7f6db0a43700 1 Processor -- start 2023-10-03T10:16:17.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.363+0000 7f6db0a43700 1 -- start start 2023-10-03T10:16:17.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.363+0000 7f6db0a43700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dac09d6f0 0x7f6dac1a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.363+0000 7f6db0a43700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dac09e000 0x7f6dac1a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.363+0000 7f6db0a43700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dac09e410 0x7f6dac1c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.363+0000 7f6db0a43700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac1b94f0 con 0x7f6dac09e000 2023-10-03T10:16:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.363+0000 7f6db0a43700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac1a4e70 con 0x7f6dac09d6f0 2023-10-03T10:16:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.363+0000 7f6db0a43700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac1b9290 con 0x7f6dac09e410 2023-10-03T10:16:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.363+0000 7f6daa59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dac09d6f0 0x7f6dac1a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.363+0000 7f6da9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dac09e000 0x7f6dac1a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.363+0000 7f6daa59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dac09d6f0 0x7f6dac1a5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46858/0 (socket says 172.21.15.72:46858) 2023-10-03T10:16:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.363+0000 7f6daa59c700 1 -- 172.21.15.72:0/1910695379 learned_addr learned my addr 172.21.15.72:0/1910695379 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.363+0000 7f6daad9d700 1 --2- 172.21.15.72:0/1910695379 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dac09e410 0x7f6dac1c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.364+0000 7f6daa59c700 1 -- 172.21.15.72:0/1910695379 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dac09e410 msgr2=0x7f6dac1c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.364+0000 7f6daa59c700 1 --2- 172.21.15.72:0/1910695379 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dac09e410 0x7f6dac1c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.364+0000 7f6daa59c700 1 -- 172.21.15.72:0/1910695379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dac09e000 msgr2=0x7f6dac1a5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.364+0000 7f6daa59c700 1 --2- 172.21.15.72:0/1910695379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dac09e000 0x7f6dac1a5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.364+0000 7f6daa59c700 1 -- 172.21.15.72:0/1910695379 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c0094a0 con 0x7f6dac09d6f0 2023-10-03T10:16:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.364+0000 7f6da9d9b700 1 --2- 172.21.15.72:0/1910695379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dac09e000 0x7f6dac1a5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.364+0000 7f6daa59c700 1 --2- 172.21.15.72:0/1910695379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dac09d6f0 0x7f6dac1a5320 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00ec10 tx=0x7f6d9c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.364+0000 7f6d9affd700 1 -- 172.21.15.72:0/1910695379 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c00c850 con 0x7f6dac09d6f0 2023-10-03T10:16:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.364+0000 7f6d9affd700 1 -- 172.21.15.72:0/1910695379 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9c00c9b0 con 0x7f6dac09d6f0 2023-10-03T10:16:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.364+0000 7f6db0a43700 1 -- 172.21.15.72:0/1910695379 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da4009a70 con 0x7f6dac09d6f0 2023-10-03T10:16:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.364+0000 7f6d9affd700 1 -- 172.21.15.72:0/1910695379 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c00cd20 con 0x7f6dac09d6f0 2023-10-03T10:16:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.364+0000 7f6db0a43700 1 -- 172.21.15.72:0/1910695379 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac1a5da0 con 0x7f6dac09d6f0 2023-10-03T10:16:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.365+0000 7f6d9affd700 1 -- 172.21.15.72:0/1910695379 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d9c013470 con 0x7f6dac09d6f0 2023-10-03T10:16:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.365+0000 7f6d9affd700 1 -- 172.21.15.72:0/1910695379 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6d9c03f780 con 0x7f6dac09d6f0 2023-10-03T10:16:17.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.365+0000 7f6db0a43700 1 -- 172.21.15.72:0/1910695379 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dac0a1d60 con 0x7f6dac09d6f0 2023-10-03T10:16:17.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.369+0000 7f6d9affd700 1 -- 172.21.15.72:0/1910695379 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d9c013720 con 0x7f6dac09d6f0 2023-10-03T10:16:17.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:17.477 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:17.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.541+0000 7fab4268c700 1 Processor -- start 2023-10-03T10:16:17.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.541+0000 7fab4268c700 1 -- start start 2023-10-03T10:16:17.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.542+0000 7fab4268c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab3c0a0a30 0x7fab3c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.542+0000 7fab4268c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab3c09d630 0x7fab3c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.542+0000 7fab4268c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3c0a2a70 con 0x7fab3c133930 2023-10-03T10:16:17.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.542+0000 7fab4268c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab3c0a01d0 con 0x7fab3c09d630 2023-10-03T10:16:17.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.542+0000 7fab4268c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c09e2b0 con 0x7fab3c0a0a30 2023-10-03T10:16:17.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.542+0000 7fab3bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab3c0a0a30 0x7fab3c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.542+0000 7fab3bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab3c0a0a30 0x7fab3c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52266/0 (socket says 172.21.15.72:52266) 2023-10-03T10:16:17.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.542+0000 7fab3bfff700 1 -- 172.21.15.72:0/2258186978 learned_addr learned my addr 172.21.15.72:0/2258186978 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:17.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.542+0000 7fab3b7fe700 1 --2- 172.21.15.72:0/2258186978 >> v2:172.21.15.72:3300/0 conn(0x7fab3c09d630 0x7fab3c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.542+0000 7fab3bfff700 1 -- 172.21.15.72:0/2258186978 >> v2:172.21.15.72:3300/0 conn(0x7fab3c09d630 msgr2=0x7fab3c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.542+0000 7fab3bfff700 1 --2- 172.21.15.72:0/2258186978 >> v2:172.21.15.72:3300/0 conn(0x7fab3c09d630 0x7fab3c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.542+0000 7fab3bfff700 1 -- 172.21.15.72:0/2258186978 >> v1:172.21.15.72:6789/0 conn(0x7fab3c133930 legacy=0x7fab3c133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.542+0000 7fab3bfff700 1 -- 172.21.15.72:0/2258186978 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c09dc50 con 0x7fab3c0a0a30 2023-10-03T10:16:17.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.542+0000 7fab3bfff700 1 --2- 172.21.15.72:0/2258186978 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab3c0a0a30 0x7fab3c0a0e00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0098f0 tx=0x7fab2c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ea694587a1288f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.543+0000 7fab3affd700 1 -- 172.21.15.72:0/2258186978 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c011830 con 0x7fab3c0a0a30 2023-10-03T10:16:17.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.543+0000 7fab3affd700 1 -- 172.21.15.72:0/2258186978 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c011990 con 0x7fab3c0a0a30 2023-10-03T10:16:17.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.543+0000 7fab3affd700 1 -- 172.21.15.72:0/2258186978 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c011d20 con 0x7fab3c0a0a30 2023-10-03T10:16:17.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.543+0000 7fab4268c700 1 -- 172.21.15.72:0/2258186978 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab3c0a0a30 msgr2=0x7fab3c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.543+0000 7fab4268c700 1 --2- 172.21.15.72:0/2258186978 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab3c0a0a30 0x7fab3c0a0e00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0098f0 tx=0x7fab2c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:17.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.543+0000 7fab4268c700 1 -- 172.21.15.72:0/2258186978 shutdown_connections 2023-10-03T10:16:17.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.543+0000 7fab4268c700 1 --2- 172.21.15.72:0/2258186978 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab3c0a0a30 0x7fab3c0a0e00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.543+0000 7fab4268c700 1 --2- 172.21.15.72:0/2258186978 >> v2:172.21.15.72:3300/0 conn(0x7fab3c09d630 0x7fab3c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.543+0000 7fab4268c700 1 -- 172.21.15.72:0/2258186978 >> 172.21.15.72:0/2258186978 conn(0x7fab3c0a3050 msgr2=0x7fab3c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.543+0000 7fab4268c700 1 -- 172.21.15.72:0/2258186978 shutdown_connections 2023-10-03T10:16:17.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.543+0000 7fab4268c700 1 -- 172.21.15.72:0/2258186978 wait complete. 2023-10-03T10:16:17.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.544+0000 7fab4268c700 1 Processor -- start 2023-10-03T10:16:17.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.544+0000 7fab4268c700 1 -- start start 2023-10-03T10:16:17.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab4268c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c09d630 0x7fab3c1c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab4268c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab3c0a0a30 0x7fab3c1c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab4268c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab3c133930 0x7fab3c1c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab4268c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c121e30 con 0x7fab3c09d630 2023-10-03T10:16:17.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab4268c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c0a50d0 con 0x7fab3c133930 2023-10-03T10:16:17.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab4268c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c120830 con 0x7fab3c0a0a30 2023-10-03T10:16:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab3bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c09d630 0x7fab3c1c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab3b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab3c0a0a30 0x7fab3c1c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab3b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab3c0a0a30 0x7fab3c1c8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52276/0 (socket says 172.21.15.72:52276) 2023-10-03T10:16:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab3bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c09d630 0x7fab3c1c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35932/0 (socket says 172.21.15.72:35932) 2023-10-03T10:16:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab3b7fe700 1 -- 172.21.15.72:0/141513000 learned_addr learned my addr 172.21.15.72:0/141513000 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab40c29700 1 --2- 172.21.15.72:0/141513000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab3c133930 0x7fab3c1c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab3bfff700 1 -- 172.21.15.72:0/141513000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab3c0a0a30 msgr2=0x7fab3c1c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab3bfff700 1 --2- 172.21.15.72:0/141513000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab3c0a0a30 0x7fab3c1c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab3bfff700 1 -- 172.21.15.72:0/141513000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab3c133930 msgr2=0x7fab3c1c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab3bfff700 1 --2- 172.21.15.72:0/141513000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab3c133930 0x7fab3c1c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.545+0000 7fab3bfff700 1 -- 172.21.15.72:0/141513000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c009550 con 0x7fab3c09d630 2023-10-03T10:16:17.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.546+0000 7fab3bfff700 1 --2- 172.21.15.72:0/141513000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c09d630 0x7fab3c1c8130 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0a2380 tx=0x7fab2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.546+0000 7fab38ff9700 1 -- 172.21.15.72:0/141513000 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c0036a0 con 0x7fab3c09d630 2023-10-03T10:16:17.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.546+0000 7fab38ff9700 1 -- 172.21.15.72:0/141513000 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c003800 con 0x7fab3c09d630 2023-10-03T10:16:17.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.546+0000 7fab4268c700 1 -- 172.21.15.72:0/141513000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3c1222e0 con 0x7fab3c09d630 2023-10-03T10:16:17.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.546+0000 7fab38ff9700 1 -- 172.21.15.72:0/141513000 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c003b70 con 0x7fab3c09d630 2023-10-03T10:16:17.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.546+0000 7fab4268c700 1 -- 172.21.15.72:0/141513000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3c133550 con 0x7fab3c09d630 2023-10-03T10:16:17.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.547+0000 7fab4268c700 1 -- 172.21.15.72:0/141513000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3c0747f0 con 0x7fab3c09d630 2023-10-03T10:16:17.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.547+0000 7fab38ff9700 1 -- 172.21.15.72:0/141513000 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab2c021070 con 0x7fab3c09d630 2023-10-03T10:16:17.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.547+0000 7fab38ff9700 1 -- 172.21.15.72:0/141513000 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fab2c041230 con 0x7fab3c09d630 2023-10-03T10:16:17.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.555+0000 7fab38ff9700 1 -- 172.21.15.72:0/141513000 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab2c00b3e0 con 0x7fab3c09d630 2023-10-03T10:16:17.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.577+0000 7f6db0a43700 1 -- 172.21.15.72:0/1910695379 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6dac074ea0 con 0x7f6dac09d6f0 2023-10-03T10:16:17.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.578+0000 7f6d9affd700 1 -- 172.21.15.72:0/1910695379 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d9c021020 con 0x7f6dac09d6f0 2023-10-03T10:16:17.579 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.581+0000 7f6db0a43700 1 -- 172.21.15.72:0/1910695379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dac09d6f0 msgr2=0x7f6dac1a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.581+0000 7f6db0a43700 1 --2- 172.21.15.72:0/1910695379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dac09d6f0 0x7f6dac1a5320 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00ec10 tx=0x7f6d9c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.581+0000 7f6db0a43700 1 -- 172.21.15.72:0/1910695379 shutdown_connections 2023-10-03T10:16:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.581+0000 7f6db0a43700 1 --2- 172.21.15.72:0/1910695379 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6dac09e410 0x7f6dac1c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.581+0000 7f6db0a43700 1 --2- 172.21.15.72:0/1910695379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6dac09d6f0 0x7f6dac1a5320 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.581+0000 7f6db0a43700 1 --2- 172.21.15.72:0/1910695379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6dac09e000 0x7f6dac1a5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.581+0000 7f6db0a43700 1 -- 172.21.15.72:0/1910695379 >> 172.21.15.72:0/1910695379 conn(0x7f6dac066f50 msgr2=0x7f6dac071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.581+0000 7f6db0a43700 1 -- 172.21.15.72:0/1910695379 shutdown_connections 2023-10-03T10:16:17.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.581+0000 7f6db0a43700 1 -- 172.21.15.72:0/1910695379 wait complete. 2023-10-03T10:16:17.599 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:17.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:17.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.604+0000 7feb194e9700 1 Processor -- start 2023-10-03T10:16:17.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.604+0000 7feb194e9700 1 -- start start 2023-10-03T10:16:17.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb194e9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb14131810 0x7feb14131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb194e9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb14099a40 0x7feb14099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb194e9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb1409a3b0 0x7feb14138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb194e9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb1409b580 con 0x7feb1409a3b0 2023-10-03T10:16:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb194e9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb141313c0 con 0x7feb14131810 2023-10-03T10:16:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb194e9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb1406e8c0 con 0x7feb14099a40 2023-10-03T10:16:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb127fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb14099a40 0x7feb14099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb12ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb14131810 0x7feb14131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb137fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb1409a3b0 0x7feb14138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb12ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb14131810 0x7feb14131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46866/0 (socket says 172.21.15.72:46866) 2023-10-03T10:16:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb127fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb14099a40 0x7feb14099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52284/0 (socket says 172.21.15.72:52284) 2023-10-03T10:16:17.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb12ffd700 1 -- 172.21.15.72:0/1158309619 learned_addr learned my addr 172.21.15.72:0/1158309619 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb12ffd700 1 -- 172.21.15.72:0/1158309619 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb14099a40 msgr2=0x7feb14099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb12ffd700 1 --2- 172.21.15.72:0/1158309619 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb14099a40 0x7feb14099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb12ffd700 1 -- 172.21.15.72:0/1158309619 >> v2:172.21.15.72:3300/0 conn(0x7feb1409a3b0 msgr2=0x7feb14138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb12ffd700 1 --2- 172.21.15.72:0/1158309619 >> v2:172.21.15.72:3300/0 conn(0x7feb1409a3b0 0x7feb14138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb12ffd700 1 -- 172.21.15.72:0/1158309619 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1409a820 con 0x7feb14131810 2023-10-03T10:16:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb127fc700 1 --2- 172.21.15.72:0/1158309619 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb14099a40 0x7feb14099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb137fe700 1 --2- 172.21.15.72:0/1158309619 >> v2:172.21.15.72:3300/0 conn(0x7feb1409a3b0 0x7feb14138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.605+0000 7feb12ffd700 1 --2- 172.21.15.72:0/1158309619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb14131810 0x7feb14131be0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7feb040098f0 tx=0x7feb04009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0daba396c87b1a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.606+0000 7feb11ffb700 1 -- 172.21.15.72:0/1158309619 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04011830 con 0x7feb14131810 2023-10-03T10:16:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.606+0000 7feb11ffb700 1 -- 172.21.15.72:0/1158309619 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb04011990 con 0x7feb14131810 2023-10-03T10:16:17.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.606+0000 7feb11ffb700 1 -- 172.21.15.72:0/1158309619 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04011d20 con 0x7feb14131810 2023-10-03T10:16:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.606+0000 7feb194e9700 1 -- 172.21.15.72:0/1158309619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb14131810 msgr2=0x7feb14131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.606+0000 7feb194e9700 1 --2- 172.21.15.72:0/1158309619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb14131810 0x7feb14131be0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7feb040098f0 tx=0x7feb04009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.607+0000 7feb194e9700 1 -- 172.21.15.72:0/1158309619 shutdown_connections 2023-10-03T10:16:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.607+0000 7feb194e9700 1 --2- 172.21.15.72:0/1158309619 >> v2:172.21.15.72:3300/0 conn(0x7feb1409a3b0 0x7feb14138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.607+0000 7feb194e9700 1 --2- 172.21.15.72:0/1158309619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb14131810 0x7feb14131be0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.607+0000 7feb194e9700 1 --2- 172.21.15.72:0/1158309619 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb14099a40 0x7feb14099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.607+0000 7feb194e9700 1 -- 172.21.15.72:0/1158309619 >> 172.21.15.72:0/1158309619 conn(0x7feb140a2aa0 msgr2=0x7feb140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.607+0000 7feb194e9700 1 -- 172.21.15.72:0/1158309619 shutdown_connections 2023-10-03T10:16:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.607+0000 7feb194e9700 1 -- 172.21.15.72:0/1158309619 wait complete. 2023-10-03T10:16:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.608+0000 7feb194e9700 1 Processor -- start 2023-10-03T10:16:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.608+0000 7feb194e9700 1 -- start start 2023-10-03T10:16:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.608+0000 7feb194e9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb14099a40 0x7feb1411fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.608+0000 7feb194e9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb1409a3b0 0x7feb14120200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.608+0000 7feb194e9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb14131810 0x7feb14120740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.608+0000 7feb194e9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb14121120 con 0x7feb14099a40 2023-10-03T10:16:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.608+0000 7feb194e9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb141219e0 con 0x7feb14131810 2023-10-03T10:16:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.608+0000 7feb194e9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb14123500 con 0x7feb1409a3b0 2023-10-03T10:16:17.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feb127fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb1409a3b0 0x7feb14120200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feb127fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb1409a3b0 0x7feb14120200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52288/0 (socket says 172.21.15.72:52288) 2023-10-03T10:16:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feb127fc700 1 -- 172.21.15.72:0/237288051 learned_addr learned my addr 172.21.15.72:0/237288051 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feb12ffd700 1 --2- 172.21.15.72:0/237288051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb14099a40 0x7feb1411fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feb137fe700 1 --2- 172.21.15.72:0/237288051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb14131810 0x7feb14120740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feb127fc700 1 -- 172.21.15.72:0/237288051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb14131810 msgr2=0x7feb14120740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feb127fc700 1 --2- 172.21.15.72:0/237288051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb14131810 0x7feb14120740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feb127fc700 1 -- 172.21.15.72:0/237288051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb14099a40 msgr2=0x7feb1411fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feb127fc700 1 --2- 172.21.15.72:0/237288051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb14099a40 0x7feb1411fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feb127fc700 1 -- 172.21.15.72:0/237288051 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb080094a0 con 0x7feb1409a3b0 2023-10-03T10:16:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feb12ffd700 1 --2- 172.21.15.72:0/237288051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb14099a40 0x7feb1411fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feb127fc700 1 --2- 172.21.15.72:0/237288051 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb1409a3b0 0x7feb14120200 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7feb0800ebb0 tx=0x7feb0800eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feafb7fe700 1 -- 172.21.15.72:0/237288051 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0800c850 con 0x7feb1409a3b0 2023-10-03T10:16:17.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feafb7fe700 1 -- 172.21.15.72:0/237288051 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0800c9b0 con 0x7feb1409a3b0 2023-10-03T10:16:17.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feb194e9700 1 -- 172.21.15.72:0/237288051 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0c009a70 con 0x7feb1409a3b0 2023-10-03T10:16:17.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feafb7fe700 1 -- 172.21.15.72:0/237288051 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0800cd40 con 0x7feb1409a3b0 2023-10-03T10:16:17.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.609+0000 7feb194e9700 1 -- 172.21.15.72:0/237288051 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb04009550 con 0x7feb1409a3b0 2023-10-03T10:16:17.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.611+0000 7feb194e9700 1 -- 172.21.15.72:0/237288051 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb14122150 con 0x7feb1409a3b0 2023-10-03T10:16:17.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.611+0000 7feafb7fe700 1 -- 172.21.15.72:0/237288051 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb08013470 con 0x7feb1409a3b0 2023-10-03T10:16:17.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.611+0000 7feafb7fe700 1 -- 172.21.15.72:0/237288051 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feb0803fc50 con 0x7feb1409a3b0 2023-10-03T10:16:17.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.619+0000 7feafb7fe700 1 -- 172.21.15.72:0/237288051 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb0801b3b0 con 0x7feb1409a3b0 2023-10-03T10:16:17.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.730+0000 7f10d6f90700 1 Processor -- start 2023-10-03T10:16:17.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.730+0000 7f10d6f90700 1 -- start start 2023-10-03T10:16:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.730+0000 7f10d6f90700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10d00a0a30 0x7f10d00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.730+0000 7f10d6f90700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10d00a1340 0x7f10d0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.730+0000 7f10d6f90700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f10d0133fa0 0x7f10d0134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.730+0000 7f10d6f90700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d009edd0 con 0x7f10d00a1340 2023-10-03T10:16:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.730+0000 7f10d6f90700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d009e1f0 con 0x7f10d00a0a30 2023-10-03T10:16:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.730+0000 7f10d6f90700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10d009dc50 con 0x7f10d0133fa0 2023-10-03T10:16:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.730+0000 7f10d4d2c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10d00a0a30 0x7f10d00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.730+0000 7f10cffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10d00a1340 0x7f10d0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.730+0000 7f10d4d2c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10d00a0a30 0x7f10d00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:46882/0 (socket says 172.21.15.72:46882) 2023-10-03T10:16:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.730+0000 7f10d4d2c700 1 -- 172.21.15.72:0/3591497868 learned_addr learned my addr 172.21.15.72:0/3591497868 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:17.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.730+0000 7f10d552d700 1 --2- 172.21.15.72:0/3591497868 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f10d0133fa0 0x7f10d0134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.731+0000 7f10d4d2c700 1 -- 172.21.15.72:0/3591497868 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f10d0133fa0 msgr2=0x7f10d0134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.731+0000 7f10d4d2c700 1 --2- 172.21.15.72:0/3591497868 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f10d0133fa0 0x7f10d0134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.731+0000 7f10d4d2c700 1 -- 172.21.15.72:0/3591497868 >> v2:172.21.15.72:3300/0 conn(0x7f10d00a1340 msgr2=0x7f10d0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.731+0000 7f10d4d2c700 1 --2- 172.21.15.72:0/3591497868 >> v2:172.21.15.72:3300/0 conn(0x7f10d00a1340 0x7f10d0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.731+0000 7f10d4d2c700 1 -- 172.21.15.72:0/3591497868 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d00a1fe0 con 0x7f10d00a0a30 2023-10-03T10:16:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.731+0000 7f10cffff700 1 --2- 172.21.15.72:0/3591497868 >> v2:172.21.15.72:3300/0 conn(0x7f10d00a1340 0x7f10d0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.731+0000 7f10d4d2c700 1 --2- 172.21.15.72:0/3591497868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10d00a0a30 0x7f10d00a0e00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009920 tx=0x7f10c4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f19c32b7451e5983 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.731+0000 7f10cf7fe700 1 -- 172.21.15.72:0/3591497868 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4011830 con 0x7f10d00a0a30 2023-10-03T10:16:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.731+0000 7f10cf7fe700 1 -- 172.21.15.72:0/3591497868 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4011990 con 0x7f10d00a0a30 2023-10-03T10:16:17.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.731+0000 7f10cf7fe700 1 -- 172.21.15.72:0/3591497868 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4011d20 con 0x7f10d00a0a30 2023-10-03T10:16:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.732+0000 7f10d6f90700 1 -- 172.21.15.72:0/3591497868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10d00a0a30 msgr2=0x7f10d00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.732+0000 7f10d6f90700 1 --2- 172.21.15.72:0/3591497868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10d00a0a30 0x7f10d00a0e00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009920 tx=0x7f10c4009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.732+0000 7f10d6f90700 1 -- 172.21.15.72:0/3591497868 shutdown_connections 2023-10-03T10:16:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.732+0000 7f10d6f90700 1 --2- 172.21.15.72:0/3591497868 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f10d0133fa0 0x7f10d0134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.732+0000 7f10d6f90700 1 --2- 172.21.15.72:0/3591497868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10d00a0a30 0x7f10d00a0e00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.732+0000 7f10d6f90700 1 --2- 172.21.15.72:0/3591497868 >> v2:172.21.15.72:3300/0 conn(0x7f10d00a1340 0x7f10d0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.732+0000 7f10d6f90700 1 -- 172.21.15.72:0/3591497868 >> 172.21.15.72:0/3591497868 conn(0x7f10d00a6550 msgr2=0x7f10d00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.732+0000 7f10d6f90700 1 -- 172.21.15.72:0/3591497868 shutdown_connections 2023-10-03T10:16:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.732+0000 7f10d6f90700 1 -- 172.21.15.72:0/3591497868 wait complete. 2023-10-03T10:16:17.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.733+0000 7f10d6f90700 1 Processor -- start 2023-10-03T10:16:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.733+0000 7f10d6f90700 1 -- start start 2023-10-03T10:16:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.733+0000 7f10d6f90700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d00a0a30 0x7f10d0120740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.733+0000 7f10d6f90700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f10d00a1340 0x7f10d0120c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.733+0000 7f10d6f90700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10d0133fa0 0x7f10d01211c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.733+0000 7f10d6f90700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d0123950 con 0x7f10d00a0a30 2023-10-03T10:16:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.733+0000 7f10d6f90700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00a0220 con 0x7f10d0133fa0 2023-10-03T10:16:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.733+0000 7f10d6f90700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00a3610 con 0x7f10d00a1340 2023-10-03T10:16:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.733+0000 7f10d4d2c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d00a0a30 0x7f10d0120740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.733+0000 7f10cffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f10d00a1340 0x7f10d0120c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.733+0000 7f10d4d2c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d00a0a30 0x7f10d0120740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35962/0 (socket says 172.21.15.72:35962) 2023-10-03T10:16:17.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.733+0000 7f10d4d2c700 1 -- 172.21.15.72:0/3009175146 learned_addr learned my addr 172.21.15.72:0/3009175146 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.733+0000 7f10d552d700 1 --2- 172.21.15.72:0/3009175146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10d0133fa0 0x7f10d01211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.734+0000 7f10d4d2c700 1 -- 172.21.15.72:0/3009175146 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f10d00a1340 msgr2=0x7f10d0120c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.734+0000 7f10d4d2c700 1 --2- 172.21.15.72:0/3009175146 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f10d00a1340 0x7f10d0120c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.734+0000 7f10d4d2c700 1 -- 172.21.15.72:0/3009175146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10d0133fa0 msgr2=0x7f10d01211c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.734+0000 7f10d4d2c700 1 --2- 172.21.15.72:0/3009175146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10d0133fa0 0x7f10d01211c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.734+0000 7f10d4d2c700 1 -- 172.21.15.72:0/3009175146 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0094a0 con 0x7f10d00a0a30 2023-10-03T10:16:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.734+0000 7f10d4d2c700 1 --2- 172.21.15.72:0/3009175146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d00a0a30 0x7f10d0120740 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f10c40098f0 tx=0x7f10c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.734+0000 7f10cd7fa700 1 -- 172.21.15.72:0/3009175146 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4004240 con 0x7f10d00a0a30 2023-10-03T10:16:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.734+0000 7f10cd7fa700 1 -- 172.21.15.72:0/3009175146 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c401f070 con 0x7f10d00a0a30 2023-10-03T10:16:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.734+0000 7f10d6f90700 1 -- 172.21.15.72:0/3009175146 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c4009550 con 0x7f10d00a0a30 2023-10-03T10:16:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.734+0000 7f10cd7fa700 1 -- 172.21.15.72:0/3009175146 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c40036a0 con 0x7f10d00a0a30 2023-10-03T10:16:17.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.734+0000 7f10d6f90700 1 -- 172.21.15.72:0/3009175146 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d0123500 con 0x7f10d00a0a30 2023-10-03T10:16:17.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.735+0000 7f10cd7fa700 1 -- 172.21.15.72:0/3009175146 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10c4021030 con 0x7f10d00a0a30 2023-10-03T10:16:17.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.735+0000 7f10d6f90700 1 -- 172.21.15.72:0/3009175146 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d0074ea0 con 0x7f10d00a0a30 2023-10-03T10:16:17.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.735+0000 7f10cd7fa700 1 -- 172.21.15.72:0/3009175146 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f10c4040960 con 0x7f10d00a0a30 2023-10-03T10:16:17.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.740+0000 7f10cd7fa700 1 -- 172.21.15.72:0/3009175146 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10c40239c0 con 0x7f10d00a0a30 2023-10-03T10:16:17.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.768+0000 7fab4268c700 1 -- 172.21.15.72:0/141513000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fab3c072980 con 0x7fab3c09d630 2023-10-03T10:16:17.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.769+0000 7fab38ff9700 1 -- 172.21.15.72:0/141513000 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fab2c02d3f0 con 0x7fab3c09d630 2023-10-03T10:16:17.769 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.771+0000 7fab4268c700 1 -- 172.21.15.72:0/141513000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c09d630 msgr2=0x7fab3c1c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.771+0000 7fab4268c700 1 --2- 172.21.15.72:0/141513000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c09d630 0x7fab3c1c8130 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0a2380 tx=0x7fab2c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.771+0000 7fab4268c700 1 -- 172.21.15.72:0/141513000 shutdown_connections 2023-10-03T10:16:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.771+0000 7fab4268c700 1 --2- 172.21.15.72:0/141513000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab3c09d630 0x7fab3c1c8130 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.771+0000 7fab4268c700 1 --2- 172.21.15.72:0/141513000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab3c133930 0x7fab3c1c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.771+0000 7fab4268c700 1 --2- 172.21.15.72:0/141513000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab3c0a0a30 0x7fab3c1c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.771+0000 7fab4268c700 1 -- 172.21.15.72:0/141513000 >> 172.21.15.72:0/141513000 conn(0x7fab3c0a3050 msgr2=0x7fab3c1bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.771+0000 7fab4268c700 1 -- 172.21.15.72:0/141513000 shutdown_connections 2023-10-03T10:16:17.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.771+0000 7fab4268c700 1 -- 172.21.15.72:0/141513000 wait complete. 2023-10-03T10:16:17.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.817+0000 7feb194e9700 1 -- 172.21.15.72:0/237288051 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feb14071d80 con 0x7feb1409a3b0 2023-10-03T10:16:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.817+0000 7feafb7fe700 1 -- 172.21.15.72:0/237288051 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb08017020 con 0x7feb1409a3b0 2023-10-03T10:16:17.818 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:17.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.819+0000 7feb194e9700 1 -- 172.21.15.72:0/237288051 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb1409a3b0 msgr2=0x7feb14120200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.819+0000 7feb194e9700 1 --2- 172.21.15.72:0/237288051 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb1409a3b0 0x7feb14120200 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7feb0800ebb0 tx=0x7feb0800eec0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.819+0000 7feb194e9700 1 -- 172.21.15.72:0/237288051 shutdown_connections 2023-10-03T10:16:17.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.819+0000 7feb194e9700 1 --2- 172.21.15.72:0/237288051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb14099a40 0x7feb1411fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.819+0000 7feb194e9700 1 --2- 172.21.15.72:0/237288051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb14131810 0x7feb14120740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.819+0000 7feb194e9700 1 --2- 172.21.15.72:0/237288051 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb1409a3b0 0x7feb14120200 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.819+0000 7feb194e9700 1 -- 172.21.15.72:0/237288051 >> 172.21.15.72:0/237288051 conn(0x7feb140a2aa0 msgr2=0x7feb140a15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.819+0000 7feb194e9700 1 -- 172.21.15.72:0/237288051 shutdown_connections 2023-10-03T10:16:17.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.819+0000 7feb194e9700 1 -- 172.21.15.72:0/237288051 wait complete. 2023-10-03T10:16:17.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:17.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.932+0000 7f10d6f90700 1 -- 172.21.15.72:0/3009175146 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f10d00a28e0 con 0x7f10d00a0a30 2023-10-03T10:16:17.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.933+0000 7f10cd7fa700 1 -- 172.21.15.72:0/3009175146 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f10c401b430 con 0x7f10d00a0a30 2023-10-03T10:16:17.933 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:17.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.934+0000 7f10d6f90700 1 -- 172.21.15.72:0/3009175146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d00a0a30 msgr2=0x7f10d0120740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.934+0000 7f10d6f90700 1 --2- 172.21.15.72:0/3009175146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d00a0a30 0x7f10d0120740 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f10c40098f0 tx=0x7f10c4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:17.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.935+0000 7f10d6f90700 1 -- 172.21.15.72:0/3009175146 shutdown_connections 2023-10-03T10:16:17.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.935+0000 7f10d6f90700 1 --2- 172.21.15.72:0/3009175146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10d00a0a30 0x7f10d0120740 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.935+0000 7f10d6f90700 1 --2- 172.21.15.72:0/3009175146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10d0133fa0 0x7f10d01211c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.935+0000 7f10d6f90700 1 --2- 172.21.15.72:0/3009175146 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f10d00a1340 0x7f10d0120c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.935+0000 7f10d6f90700 1 -- 172.21.15.72:0/3009175146 >> 172.21.15.72:0/3009175146 conn(0x7f10d00a6550 msgr2=0x7f10d009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.935+0000 7f10d6f90700 1 -- 172.21.15.72:0/3009175146 shutdown_connections 2023-10-03T10:16:17.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:17.935+0000 7f10d6f90700 1 -- 172.21.15.72:0/3009175146 wait complete. 2023-10-03T10:16:17.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:18.600 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:18.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.728+0000 7f613d15b700 1 Processor -- start 2023-10-03T10:16:18.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.728+0000 7f613d15b700 1 -- start start 2023-10-03T10:16:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613d15b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f613809e930 0x7f613809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613d15b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f613809f240 0x7f61381317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613d15b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f613809f650 0x7f6138131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613d15b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6138070940 con 0x7f613809f650 2023-10-03T10:16:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613d15b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613806fd60 con 0x7f613809e930 2023-10-03T10:16:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613d15b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f613806fa80 con 0x7f613809f240 2023-10-03T10:16:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f6136d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f613809e930 0x7f613809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f613809f240 0x7f61381317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613759e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f613809f650 0x7f6138131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f613809f240 0x7f61381317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41380/0 (socket says 172.21.15.72:41380) 2023-10-03T10:16:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f6136d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f613809e930 0x7f613809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40832/0 (socket says 172.21.15.72:40832) 2023-10-03T10:16:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613659c700 1 -- 172.21.15.72:0/3914670336 learned_addr learned my addr 172.21.15.72:0/3914670336 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613659c700 1 -- 172.21.15.72:0/3914670336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f613809e930 msgr2=0x7f613809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613659c700 1 --2- 172.21.15.72:0/3914670336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f613809e930 0x7f613809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613659c700 1 -- 172.21.15.72:0/3914670336 >> v2:172.21.15.72:3300/0 conn(0x7f613809f650 msgr2=0x7f6138131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613659c700 1 --2- 172.21.15.72:0/3914670336 >> v2:172.21.15.72:3300/0 conn(0x7f613809f650 0x7f6138131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613659c700 1 -- 172.21.15.72:0/3914670336 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613809fb60 con 0x7f613809f240 2023-10-03T10:16:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f6136d9d700 1 --2- 172.21.15.72:0/3914670336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f613809e930 0x7f613809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613759e700 1 --2- 172.21.15.72:0/3914670336 >> v2:172.21.15.72:3300/0 conn(0x7f613809f650 0x7f6138131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f613659c700 1 --2- 172.21.15.72:0/3914670336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f613809f240 0x7f61381317f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f61280098f0 tx=0x7f6128009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=922fb250aa0b1e43 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f6135d9b700 1 -- 172.21.15.72:0/3914670336 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128011830 con 0x7f613809f240 2023-10-03T10:16:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f6135d9b700 1 -- 172.21.15.72:0/3914670336 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6128011990 con 0x7f613809f240 2023-10-03T10:16:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.729+0000 7f6135d9b700 1 -- 172.21.15.72:0/3914670336 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128011d20 con 0x7f613809f240 2023-10-03T10:16:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.730+0000 7f613d15b700 1 -- 172.21.15.72:0/3914670336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f613809f240 msgr2=0x7f61381317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.730+0000 7f613d15b700 1 --2- 172.21.15.72:0/3914670336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f613809f240 0x7f61381317f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f61280098f0 tx=0x7f6128009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.730+0000 7f613d15b700 1 -- 172.21.15.72:0/3914670336 shutdown_connections 2023-10-03T10:16:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.730+0000 7f613d15b700 1 --2- 172.21.15.72:0/3914670336 >> v2:172.21.15.72:3300/0 conn(0x7f613809f650 0x7f6138131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.730+0000 7f613d15b700 1 --2- 172.21.15.72:0/3914670336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f613809e930 0x7f613809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.730+0000 7f613d15b700 1 --2- 172.21.15.72:0/3914670336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f613809f240 0x7f61381317f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.730+0000 7f613d15b700 1 -- 172.21.15.72:0/3914670336 >> 172.21.15.72:0/3914670336 conn(0x7f61380a4210 msgr2=0x7f61380a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.730+0000 7f613d15b700 1 -- 172.21.15.72:0/3914670336 shutdown_connections 2023-10-03T10:16:18.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.730+0000 7f613d15b700 1 -- 172.21.15.72:0/3914670336 wait complete. 2023-10-03T10:16:18.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.731+0000 7f613d15b700 1 Processor -- start 2023-10-03T10:16:18.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.731+0000 7f613d15b700 1 -- start start 2023-10-03T10:16:18.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f613d15b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f613809e930 0x7f61381a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f613d15b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f613809f240 0x7f61381a41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f613d15b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f613809f650 0x7f61381a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f613d15b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61381a80f0 con 0x7f613809f650 2023-10-03T10:16:18.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f613d15b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61381a7730 con 0x7f613809f240 2023-10-03T10:16:18.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f613d15b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61381a6a70 con 0x7f613809e930 2023-10-03T10:16:18.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f613659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f613809f240 0x7f61381a41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f613659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f613809f240 0x7f61381a41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40844/0 (socket says 172.21.15.72:40844) 2023-10-03T10:16:18.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f613659c700 1 -- 172.21.15.72:0/3121056344 learned_addr learned my addr 172.21.15.72:0/3121056344 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:18.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f6136d9d700 1 --2- 172.21.15.72:0/3121056344 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f613809e930 0x7f61381a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f613759e700 1 --2- 172.21.15.72:0/3121056344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f613809f650 0x7f61381a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f6136d9d700 1 -- 172.21.15.72:0/3121056344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f613809f240 msgr2=0x7f61381a41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f6136d9d700 1 --2- 172.21.15.72:0/3121056344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f613809f240 0x7f61381a41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f6136d9d700 1 -- 172.21.15.72:0/3121056344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f613809f650 msgr2=0x7f61381a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f6136d9d700 1 --2- 172.21.15.72:0/3121056344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f613809f650 0x7f61381a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f6136d9d700 1 -- 172.21.15.72:0/3121056344 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c0094a0 con 0x7f613809e930 2023-10-03T10:16:18.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f613659c700 1 --2- 172.21.15.72:0/3121056344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f613809f240 0x7f61381a41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:18.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f613759e700 1 --2- 172.21.15.72:0/3121056344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f613809f650 0x7f61381a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:18.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f6136d9d700 1 --2- 172.21.15.72:0/3121056344 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f613809e930 0x7f61381a3c60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f612c00e9b0 tx=0x7f612c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f611f7fe700 1 -- 172.21.15.72:0/3121056344 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c00ee50 con 0x7f613809e930 2023-10-03T10:16:18.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.732+0000 7f611f7fe700 1 -- 172.21.15.72:0/3121056344 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c004030 con 0x7f613809e930 2023-10-03T10:16:18.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.733+0000 7f611f7fe700 1 -- 172.21.15.72:0/3121056344 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c0043c0 con 0x7f613809e930 2023-10-03T10:16:18.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.733+0000 7f613d15b700 1 -- 172.21.15.72:0/3121056344 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6130009a70 con 0x7f613809e930 2023-10-03T10:16:18.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.733+0000 7f613d15b700 1 -- 172.21.15.72:0/3121056344 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6128009550 con 0x7f613809e930 2023-10-03T10:16:18.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.733+0000 7f611f7fe700 1 -- 172.21.15.72:0/3121056344 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f612c00c7f0 con 0x7f613809e930 2023-10-03T10:16:18.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.733+0000 7f611f7fe700 1 -- 172.21.15.72:0/3121056344 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f612c03f830 con 0x7f613809e930 2023-10-03T10:16:18.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.733+0000 7f613d15b700 1 -- 172.21.15.72:0/3121056344 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61381a0b30 con 0x7f613809e930 2023-10-03T10:16:18.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.738+0000 7f611f7fe700 1 -- 172.21.15.72:0/3121056344 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f612c020080 con 0x7f613809e930 2023-10-03T10:16:18.784 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:18.832 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:18.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.909+0000 7f7e795fb700 1 Processor -- start 2023-10-03T10:16:18.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.909+0000 7f7e795fb700 1 -- start start 2023-10-03T10:16:18.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.909+0000 7f7e795fb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e740a0a30 0x7f7e740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.909+0000 7f7e795fb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e74134170 0x7f7e7413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.909+0000 7f7e795fb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7409edd0 con 0x7f7e740a1340 2023-10-03T10:16:18.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.909+0000 7f7e795fb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7409e1f0 con 0x7f7e74134170 2023-10-03T10:16:18.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.909+0000 7f7e795fb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7409dc50 con 0x7f7e740a0a30 2023-10-03T10:16:18.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.909+0000 7f7e737fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e74134170 0x7f7e7413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.909+0000 7f7e72ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e740a0a30 0x7f7e740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.909+0000 7f7e737fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e74134170 0x7f7e7413bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37826/0 (socket says 172.21.15.72:37826) 2023-10-03T10:16:18.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.909+0000 7f7e72ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e740a0a30 0x7f7e740a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40860/0 (socket says 172.21.15.72:40860) 2023-10-03T10:16:18.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.909+0000 7f7e737fe700 1 -- 172.21.15.72:0/3642798649 learned_addr learned my addr 172.21.15.72:0/3642798649 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:18.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.910+0000 7f7e737fe700 1 -- 172.21.15.72:0/3642798649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e740a0a30 msgr2=0x7f7e740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:18.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.910+0000 7f7e737fe700 1 --2- 172.21.15.72:0/3642798649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e740a0a30 0x7f7e740a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.910+0000 7f7e737fe700 1 -- 172.21.15.72:0/3642798649 >> v1:172.21.15.72:6789/0 conn(0x7f7e740a1340 legacy=0x7f7e74133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.910+0000 7f7e737fe700 1 -- 172.21.15.72:0/3642798649 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e740a1fe0 con 0x7f7e74134170 2023-10-03T10:16:18.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.910+0000 7f7e72ffd700 1 --2- 172.21.15.72:0/3642798649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e740a0a30 0x7f7e740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:18.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.910+0000 7f7e737fe700 1 --2- 172.21.15.72:0/3642798649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74134170 0x7f7e7413bd30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009e50 tx=0x7f7e6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53624e9968cef10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.910+0000 7f7e71ffb700 1 -- 172.21.15.72:0/3642798649 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00e070 con 0x7f7e74134170 2023-10-03T10:16:18.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.910+0000 7f7e71ffb700 1 -- 172.21.15.72:0/3642798649 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c00b910 con 0x7f7e74134170 2023-10-03T10:16:18.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.910+0000 7f7e71ffb700 1 -- 172.21.15.72:0/3642798649 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00bcc0 con 0x7f7e74134170 2023-10-03T10:16:18.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.910+0000 7f7e795fb700 1 -- 172.21.15.72:0/3642798649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74134170 msgr2=0x7f7e7413bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.910+0000 7f7e795fb700 1 --2- 172.21.15.72:0/3642798649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74134170 0x7f7e7413bd30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009e50 tx=0x7f7e6c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:18.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.911+0000 7f7e795fb700 1 -- 172.21.15.72:0/3642798649 shutdown_connections 2023-10-03T10:16:18.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.911+0000 7f7e795fb700 1 --2- 172.21.15.72:0/3642798649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74134170 0x7f7e7413bd30 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.911+0000 7f7e795fb700 1 --2- 172.21.15.72:0/3642798649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e740a0a30 0x7f7e740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.911+0000 7f7e795fb700 1 -- 172.21.15.72:0/3642798649 >> 172.21.15.72:0/3642798649 conn(0x7f7e740a6550 msgr2=0x7f7e740a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.911+0000 7f7e795fb700 1 -- 172.21.15.72:0/3642798649 shutdown_connections 2023-10-03T10:16:18.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.911+0000 7f7e795fb700 1 -- 172.21.15.72:0/3642798649 wait complete. 2023-10-03T10:16:18.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.912+0000 7f7e795fb700 1 Processor -- start 2023-10-03T10:16:18.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.912+0000 7f7e795fb700 1 -- start start 2023-10-03T10:16:18.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e795fb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e740a0a30 0x7f7e741229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e795fb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e740a1340 0x7f7e74122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e795fb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74134170 0x7f7e74123450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e795fb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740a0290 con 0x7f7e74134170 2023-10-03T10:16:18.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e795fb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740a4ef0 con 0x7f7e740a0a30 2023-10-03T10:16:18.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e795fb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e74124db0 con 0x7f7e740a1340 2023-10-03T10:16:18.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e727fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e740a1340 0x7f7e74122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e72ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e740a0a30 0x7f7e741229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e727fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e740a1340 0x7f7e74122f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41402/0 (socket says 172.21.15.72:41402) 2023-10-03T10:16:18.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e727fc700 1 -- 172.21.15.72:0/3441258348 learned_addr learned my addr 172.21.15.72:0/3441258348 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:18.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e737fe700 1 --2- 172.21.15.72:0/3441258348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74134170 0x7f7e74123450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e727fc700 1 -- 172.21.15.72:0/3441258348 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e740a0a30 msgr2=0x7f7e741229d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e727fc700 1 --2- 172.21.15.72:0/3441258348 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e740a0a30 0x7f7e741229d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e727fc700 1 -- 172.21.15.72:0/3441258348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74134170 msgr2=0x7f7e74123450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e727fc700 1 --2- 172.21.15.72:0/3441258348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74134170 0x7f7e74123450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e727fc700 1 -- 172.21.15.72:0/3441258348 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e640094a0 con 0x7f7e740a1340 2023-10-03T10:16:18.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.913+0000 7f7e727fc700 1 --2- 172.21.15.72:0/3441258348 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e740a1340 0x7f7e74122f10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800c4e0 tx=0x7f7e6800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.914+0000 7f7e5b7fe700 1 -- 172.21.15.72:0/3441258348 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e680052d0 con 0x7f7e740a1340 2023-10-03T10:16:18.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.914+0000 7f7e5b7fe700 1 -- 172.21.15.72:0/3441258348 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e68005430 con 0x7f7e740a1340 2023-10-03T10:16:18.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.914+0000 7f7e795fb700 1 -- 172.21.15.72:0/3441258348 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6c009b30 con 0x7f7e740a1340 2023-10-03T10:16:18.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.914+0000 7f7e5b7fe700 1 -- 172.21.15.72:0/3441258348 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e680038c0 con 0x7f7e740a1340 2023-10-03T10:16:18.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.914+0000 7f7e795fb700 1 -- 172.21.15.72:0/3441258348 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e74124b00 con 0x7f7e740a1340 2023-10-03T10:16:18.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.915+0000 7f7e5b7fe700 1 -- 172.21.15.72:0/3441258348 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e68003a20 con 0x7f7e740a1340 2023-10-03T10:16:18.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.915+0000 7f7e795fb700 1 -- 172.21.15.72:0/3441258348 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e74074ea0 con 0x7f7e740a1340 2023-10-03T10:16:18.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.915+0000 7f7e5b7fe700 1 -- 172.21.15.72:0/3441258348 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e6803ea60 con 0x7f7e740a1340 2023-10-03T10:16:18.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.920+0000 7f7e5b7fe700 1 -- 172.21.15.72:0/3441258348 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e68019a70 con 0x7f7e740a1340 2023-10-03T10:16:18.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.937+0000 7f613d15b700 1 -- 172.21.15.72:0/3121056344 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f61381a72d0 con 0x7f613809e930 2023-10-03T10:16:18.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.938+0000 7f611f7fe700 1 -- 172.21.15.72:0/3121056344 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f612c011db0 con 0x7f613809e930 2023-10-03T10:16:18.938 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.940+0000 7f613d15b700 1 -- 172.21.15.72:0/3121056344 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f613809e930 msgr2=0x7f61381a3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.940+0000 7f613d15b700 1 --2- 172.21.15.72:0/3121056344 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f613809e930 0x7f61381a3c60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f612c00e9b0 tx=0x7f612c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.940+0000 7f613d15b700 1 -- 172.21.15.72:0/3121056344 shutdown_connections 2023-10-03T10:16:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.940+0000 7f613d15b700 1 --2- 172.21.15.72:0/3121056344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f613809f650 0x7f61381a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.940+0000 7f613d15b700 1 --2- 172.21.15.72:0/3121056344 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f613809e930 0x7f61381a3c60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.940+0000 7f613d15b700 1 --2- 172.21.15.72:0/3121056344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f613809f240 0x7f61381a41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.940+0000 7f613d15b700 1 -- 172.21.15.72:0/3121056344 >> 172.21.15.72:0/3121056344 conn(0x7f61380a4210 msgr2=0x7f61381b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.940+0000 7f613d15b700 1 -- 172.21.15.72:0/3121056344 shutdown_connections 2023-10-03T10:16:18.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.940+0000 7f613d15b700 1 -- 172.21.15.72:0/3121056344 wait complete. 2023-10-03T10:16:18.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:18.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:18.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.959+0000 7f0a271b6700 1 Processor -- start 2023-10-03T10:16:18.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.959+0000 7f0a271b6700 1 -- start start 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.959+0000 7f0a271b6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a2006e570 0x7f0a2006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.959+0000 7f0a271b6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a2009eca0 0x7f0a2006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.959+0000 7f0a271b6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a20134610 0x7f0a20134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.959+0000 7f0a271b6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a20070ee0 con 0x7f0a20134610 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.959+0000 7f0a271b6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a20071480 con 0x7f0a2009eca0 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.959+0000 7f0a271b6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2006f3c0 con 0x7f0a2006e570 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.959+0000 7f0a24f52700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a2006e570 0x7f0a2006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.959+0000 7f0a24f52700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a2006e570 0x7f0a2006e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41418/0 (socket says 172.21.15.72:41418) 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.959+0000 7f0a24f52700 1 -- 172.21.15.72:0/1451506801 learned_addr learned my addr 172.21.15.72:0/1451506801 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.959+0000 7f0a25753700 1 --2- 172.21.15.72:0/1451506801 >> v2:172.21.15.72:3300/0 conn(0x7f0a20134610 0x7f0a20134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.959+0000 7f0a1ffff700 1 --2- 172.21.15.72:0/1451506801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a2009eca0 0x7f0a2006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.960+0000 7f0a24f52700 1 -- 172.21.15.72:0/1451506801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a2009eca0 msgr2=0x7f0a2006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.960+0000 7f0a24f52700 1 --2- 172.21.15.72:0/1451506801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a2009eca0 0x7f0a2006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.960+0000 7f0a24f52700 1 -- 172.21.15.72:0/1451506801 >> v2:172.21.15.72:3300/0 conn(0x7f0a20134610 msgr2=0x7f0a20134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.960+0000 7f0a24f52700 1 --2- 172.21.15.72:0/1451506801 >> v2:172.21.15.72:3300/0 conn(0x7f0a20134610 0x7f0a20134ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.960+0000 7f0a24f52700 1 -- 172.21.15.72:0/1451506801 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a20071b90 con 0x7f0a2006e570 2023-10-03T10:16:18.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.960+0000 7f0a24f52700 1 --2- 172.21.15.72:0/1451506801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a2006e570 0x7f0a2006e940 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0a140098f0 tx=0x7f0a14009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=123dfc0efde6ddb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.960+0000 7f0a1f7fe700 1 -- 172.21.15.72:0/1451506801 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14011830 con 0x7f0a2006e570 2023-10-03T10:16:18.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.960+0000 7f0a1f7fe700 1 -- 172.21.15.72:0/1451506801 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a14011990 con 0x7f0a2006e570 2023-10-03T10:16:18.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.960+0000 7f0a1f7fe700 1 -- 172.21.15.72:0/1451506801 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14011d20 con 0x7f0a2006e570 2023-10-03T10:16:18.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.961+0000 7f0a271b6700 1 -- 172.21.15.72:0/1451506801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a2006e570 msgr2=0x7f0a2006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.961+0000 7f0a271b6700 1 --2- 172.21.15.72:0/1451506801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a2006e570 0x7f0a2006e940 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0a140098f0 tx=0x7f0a14009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:18.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.961+0000 7f0a271b6700 1 -- 172.21.15.72:0/1451506801 shutdown_connections 2023-10-03T10:16:18.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.961+0000 7f0a271b6700 1 --2- 172.21.15.72:0/1451506801 >> v2:172.21.15.72:3300/0 conn(0x7f0a20134610 0x7f0a20134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.961+0000 7f0a271b6700 1 --2- 172.21.15.72:0/1451506801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a2006e570 0x7f0a2006e940 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.961+0000 7f0a271b6700 1 --2- 172.21.15.72:0/1451506801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a2009eca0 0x7f0a2006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.961+0000 7f0a271b6700 1 -- 172.21.15.72:0/1451506801 >> 172.21.15.72:0/1451506801 conn(0x7f0a200a2aa0 msgr2=0x7f0a200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.961+0000 7f0a271b6700 1 -- 172.21.15.72:0/1451506801 shutdown_connections 2023-10-03T10:16:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.961+0000 7f0a271b6700 1 -- 172.21.15.72:0/1451506801 wait complete. 2023-10-03T10:16:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.962+0000 7f0a271b6700 1 Processor -- start 2023-10-03T10:16:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.962+0000 7f0a271b6700 1 -- start start 2023-10-03T10:16:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.962+0000 7f0a271b6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a2006e570 0x7f0a20127510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.962+0000 7f0a271b6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a20134610 0x7f0a20125ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.962+0000 7f0a271b6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a201263e0 0x7f0a20126840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.962+0000 7f0a271b6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2013aec0 con 0x7f0a201263e0 2023-10-03T10:16:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.962+0000 7f0a271b6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a200a1d10 con 0x7f0a2006e570 2023-10-03T10:16:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.962+0000 7f0a271b6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2013e220 con 0x7f0a20134610 2023-10-03T10:16:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.962+0000 7f0a1ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a20134610 0x7f0a20125ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.962+0000 7f0a24f52700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a2006e570 0x7f0a20127510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.962+0000 7f0a1ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a20134610 0x7f0a20125ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41422/0 (socket says 172.21.15.72:41422) 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.962+0000 7f0a1ffff700 1 -- 172.21.15.72:0/3278512471 learned_addr learned my addr 172.21.15.72:0/3278512471 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.963+0000 7f0a25753700 1 --2- 172.21.15.72:0/3278512471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a201263e0 0x7f0a20126840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.963+0000 7f0a24f52700 1 -- 172.21.15.72:0/3278512471 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a20134610 msgr2=0x7f0a20125ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.963+0000 7f0a24f52700 1 --2- 172.21.15.72:0/3278512471 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a20134610 0x7f0a20125ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.963+0000 7f0a24f52700 1 -- 172.21.15.72:0/3278512471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a201263e0 msgr2=0x7f0a20126840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.963+0000 7f0a24f52700 1 --2- 172.21.15.72:0/3278512471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a201263e0 0x7f0a20126840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.963+0000 7f0a24f52700 1 -- 172.21.15.72:0/3278512471 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a14009550 con 0x7f0a2006e570 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.963+0000 7f0a1ffff700 1 --2- 172.21.15.72:0/3278512471 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a20134610 0x7f0a20125ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:18.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.963+0000 7f0a24f52700 1 --2- 172.21.15.72:0/3278512471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a2006e570 0x7f0a20127510 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0a14016000 tx=0x7f0a14004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:18.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.963+0000 7f0a1d7fa700 1 -- 172.21.15.72:0/3278512471 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14004240 con 0x7f0a2006e570 2023-10-03T10:16:18.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.963+0000 7f0a1d7fa700 1 -- 172.21.15.72:0/3278512471 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1401f070 con 0x7f0a2006e570 2023-10-03T10:16:18.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.963+0000 7f0a271b6700 1 -- 172.21.15.72:0/3278512471 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a20070610 con 0x7f0a2006e570 2023-10-03T10:16:18.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.963+0000 7f0a1d7fa700 1 -- 172.21.15.72:0/3278512471 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a140036a0 con 0x7f0a2006e570 2023-10-03T10:16:18.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.963+0000 7f0a271b6700 1 -- 172.21.15.72:0/3278512471 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2013d530 con 0x7f0a2006e570 2023-10-03T10:16:18.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.964+0000 7f0a1d7fa700 1 -- 172.21.15.72:0/3278512471 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a14021030 con 0x7f0a2006e570 2023-10-03T10:16:18.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.964+0000 7f0a1d7fa700 1 -- 172.21.15.72:0/3278512471 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0a14040740 con 0x7f0a2006e570 2023-10-03T10:16:18.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.964+0000 7f0a271b6700 1 -- 172.21.15.72:0/3278512471 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2013d100 con 0x7f0a2006e570 2023-10-03T10:16:18.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:18.969+0000 7f0a1d7fa700 1 -- 172.21.15.72:0/3278512471 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a14015020 con 0x7f0a2006e570 2023-10-03T10:16:19.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.074+0000 7f502171d700 1 Processor -- start 2023-10-03T10:16:19.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.074+0000 7f502171d700 1 -- start start 2023-10-03T10:16:19.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.075+0000 7f502171d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f501c09d6f0 0x7f501c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.075+0000 7f502171d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f501c09e000 0x7f501c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.075+0000 7f502171d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f501c09e410 0x7f501c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.075+0000 7f502171d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c09f520 con 0x7f501c09e410 2023-10-03T10:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.075+0000 7f502171d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c09f130 con 0x7f501c09e000 2023-10-03T10:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.075+0000 7f502171d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f501c09e930 con 0x7f501c09d6f0 2023-10-03T10:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.075+0000 7f501a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f501c09e000 0x7f501c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.075+0000 7f501affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f501c09d6f0 0x7f501c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.075+0000 7f501a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f501c09e000 0x7f501c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40900/0 (socket says 172.21.15.72:40900) 2023-10-03T10:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.075+0000 7f501affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f501c09d6f0 0x7f501c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41434/0 (socket says 172.21.15.72:41434) 2023-10-03T10:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.075+0000 7f501a7fc700 1 -- 172.21.15.72:0/561915911 learned_addr learned my addr 172.21.15.72:0/561915911 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:19.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.075+0000 7f501b7fe700 1 --2- 172.21.15.72:0/561915911 >> v2:172.21.15.72:3300/0 conn(0x7f501c09e410 0x7f501c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.076+0000 7f501a7fc700 1 -- 172.21.15.72:0/561915911 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f501c09d6f0 msgr2=0x7f501c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.076+0000 7f501a7fc700 1 --2- 172.21.15.72:0/561915911 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f501c09d6f0 0x7f501c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.076+0000 7f501a7fc700 1 -- 172.21.15.72:0/561915911 >> v2:172.21.15.72:3300/0 conn(0x7f501c09e410 msgr2=0x7f501c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.076+0000 7f501a7fc700 1 --2- 172.21.15.72:0/561915911 >> v2:172.21.15.72:3300/0 conn(0x7f501c09e410 0x7f501c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.076+0000 7f501a7fc700 1 -- 172.21.15.72:0/561915911 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c09b2d0 con 0x7f501c09e000 2023-10-03T10:16:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.076+0000 7f501a7fc700 1 --2- 172.21.15.72:0/561915911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f501c09e000 0x7f501c130660 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5010009920 tx=0x7f5010009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d79524aba2fa192 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.076+0000 7f5019ffb700 1 -- 172.21.15.72:0/561915911 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010011830 con 0x7f501c09e000 2023-10-03T10:16:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.076+0000 7f5019ffb700 1 -- 172.21.15.72:0/561915911 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5010011990 con 0x7f501c09e000 2023-10-03T10:16:19.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.076+0000 7f5019ffb700 1 -- 172.21.15.72:0/561915911 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010011d20 con 0x7f501c09e000 2023-10-03T10:16:19.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.077+0000 7f502171d700 1 -- 172.21.15.72:0/561915911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f501c09e000 msgr2=0x7f501c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.077+0000 7f502171d700 1 --2- 172.21.15.72:0/561915911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f501c09e000 0x7f501c130660 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5010009920 tx=0x7f5010009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:19.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.077+0000 7f502171d700 1 -- 172.21.15.72:0/561915911 shutdown_connections 2023-10-03T10:16:19.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.077+0000 7f502171d700 1 --2- 172.21.15.72:0/561915911 >> v2:172.21.15.72:3300/0 conn(0x7f501c09e410 0x7f501c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.077+0000 7f502171d700 1 --2- 172.21.15.72:0/561915911 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f501c09d6f0 0x7f501c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.077+0000 7f502171d700 1 --2- 172.21.15.72:0/561915911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f501c09e000 0x7f501c130660 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.077+0000 7f502171d700 1 -- 172.21.15.72:0/561915911 >> 172.21.15.72:0/561915911 conn(0x7f501c066f50 msgr2=0x7f501c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.077+0000 7f502171d700 1 -- 172.21.15.72:0/561915911 shutdown_connections 2023-10-03T10:16:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.077+0000 7f502171d700 1 -- 172.21.15.72:0/561915911 wait complete. 2023-10-03T10:16:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.078+0000 7f502171d700 1 Processor -- start 2023-10-03T10:16:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.078+0000 7f502171d700 1 -- start start 2023-10-03T10:16:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f502171d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f501c09d6f0 0x7f501c11e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f502171d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f501c09e000 0x7f501c11e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f502171d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f501c09e410 0x7f501c11eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f502171d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c11f4f0 con 0x7f501c09e000 2023-10-03T10:16:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f502171d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c1201f0 con 0x7f501c09e410 2023-10-03T10:16:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f502171d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f501c121ab0 con 0x7f501c09d6f0 2023-10-03T10:16:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f501affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f501c09d6f0 0x7f501c11e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f501affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f501c09d6f0 0x7f501c11e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41450/0 (socket says 172.21.15.72:41450) 2023-10-03T10:16:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f501affd700 1 -- 172.21.15.72:0/1364593281 learned_addr learned my addr 172.21.15.72:0/1364593281 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f501a7fc700 1 --2- 172.21.15.72:0/1364593281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f501c09e000 0x7f501c11e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f501b7fe700 1 --2- 172.21.15.72:0/1364593281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f501c09e410 0x7f501c11eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f501affd700 1 -- 172.21.15.72:0/1364593281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f501c09e410 msgr2=0x7f501c11eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f501affd700 1 --2- 172.21.15.72:0/1364593281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f501c09e410 0x7f501c11eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f501affd700 1 -- 172.21.15.72:0/1364593281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f501c09e000 msgr2=0x7f501c11e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f501affd700 1 --2- 172.21.15.72:0/1364593281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f501c09e000 0x7f501c11e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f501affd700 1 -- 172.21.15.72:0/1364593281 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5010009550 con 0x7f501c09d6f0 2023-10-03T10:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.079+0000 7f501affd700 1 --2- 172.21.15.72:0/1364593281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f501c09d6f0 0x7f501c11e020 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f500c012f00 tx=0x7f500c012f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.080+0000 7f50037fe700 1 -- 172.21.15.72:0/1364593281 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c014040 con 0x7f501c09d6f0 2023-10-03T10:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.080+0000 7f50037fe700 1 -- 172.21.15.72:0/1364593281 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500c00f910 con 0x7f501c09d6f0 2023-10-03T10:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.080+0000 7f502171d700 1 -- 172.21.15.72:0/1364593281 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501c120e80 con 0x7f501c09d6f0 2023-10-03T10:16:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.080+0000 7f50037fe700 1 -- 172.21.15.72:0/1364593281 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c00fc80 con 0x7f501c09d6f0 2023-10-03T10:16:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.080+0000 7f502171d700 1 -- 172.21.15.72:0/1364593281 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501c130370 con 0x7f501c09d6f0 2023-10-03T10:16:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.080+0000 7f50037fe700 1 -- 172.21.15.72:0/1364593281 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f500c00b450 con 0x7f501c09d6f0 2023-10-03T10:16:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.081+0000 7f50037fe700 1 -- 172.21.15.72:0/1364593281 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f500c043210 con 0x7f501c09d6f0 2023-10-03T10:16:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.081+0000 7f502171d700 1 -- 172.21.15.72:0/1364593281 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f501c074ea0 con 0x7f501c09d6f0 2023-10-03T10:16:19.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.089+0000 7f50037fe700 1 -- 172.21.15.72:0/1364593281 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f500c01f900 con 0x7f501c09d6f0 2023-10-03T10:16:19.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.123+0000 7f7e795fb700 1 -- 172.21.15.72:0/3441258348 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7e740a28e0 con 0x7f7e740a1340 2023-10-03T10:16:19.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.123+0000 7f7e5b7fe700 1 -- 172.21.15.72:0/3441258348 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7e68017020 con 0x7f7e740a1340 2023-10-03T10:16:19.124 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:19.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.125+0000 7f7e795fb700 1 -- 172.21.15.72:0/3441258348 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e740a1340 msgr2=0x7f7e74122f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.125+0000 7f7e795fb700 1 --2- 172.21.15.72:0/3441258348 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e740a1340 0x7f7e74122f10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800c4e0 tx=0x7f7e6800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.125+0000 7f7e795fb700 1 -- 172.21.15.72:0/3441258348 shutdown_connections 2023-10-03T10:16:19.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.125+0000 7f7e795fb700 1 --2- 172.21.15.72:0/3441258348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74134170 0x7f7e74123450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.125+0000 7f7e795fb700 1 --2- 172.21.15.72:0/3441258348 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e740a0a30 0x7f7e741229d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.125+0000 7f7e795fb700 1 --2- 172.21.15.72:0/3441258348 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e740a1340 0x7f7e74122f10 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.125+0000 7f7e795fb700 1 -- 172.21.15.72:0/3441258348 >> 172.21.15.72:0/3441258348 conn(0x7f7e740a6550 msgr2=0x7f7e7409ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.125+0000 7f7e795fb700 1 -- 172.21.15.72:0/3441258348 shutdown_connections 2023-10-03T10:16:19.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.125+0000 7f7e795fb700 1 -- 172.21.15.72:0/3441258348 wait complete. 2023-10-03T10:16:19.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:19.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.166+0000 7f0a271b6700 1 -- 172.21.15.72:0/3278512471 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0a20074ea0 con 0x7f0a2006e570 2023-10-03T10:16:19.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.167+0000 7f0a1d7fa700 1 -- 172.21.15.72:0/3278512471 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a140239c0 con 0x7f0a2006e570 2023-10-03T10:16:19.167 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:19.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.169+0000 7f0a271b6700 1 -- 172.21.15.72:0/3278512471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a2006e570 msgr2=0x7f0a20127510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.169+0000 7f0a271b6700 1 --2- 172.21.15.72:0/3278512471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a2006e570 0x7f0a20127510 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0a14016000 tx=0x7f0a14004750 comp rx=0 tx=0).stop 2023-10-03T10:16:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.169+0000 7f0a271b6700 1 -- 172.21.15.72:0/3278512471 shutdown_connections 2023-10-03T10:16:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.169+0000 7f0a271b6700 1 --2- 172.21.15.72:0/3278512471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a201263e0 0x7f0a20126840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.169+0000 7f0a271b6700 1 --2- 172.21.15.72:0/3278512471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a2006e570 0x7f0a20127510 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.169+0000 7f0a271b6700 1 --2- 172.21.15.72:0/3278512471 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a20134610 0x7f0a20125ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.169+0000 7f0a271b6700 1 -- 172.21.15.72:0/3278512471 >> 172.21.15.72:0/3278512471 conn(0x7f0a200a2aa0 msgr2=0x7f0a20099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.169+0000 7f0a271b6700 1 -- 172.21.15.72:0/3278512471 shutdown_connections 2023-10-03T10:16:19.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.169+0000 7f0a271b6700 1 -- 172.21.15.72:0/3278512471 wait complete. 2023-10-03T10:16:19.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:19.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.282+0000 7f502171d700 1 -- 172.21.15.72:0/1364593281 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f501c121650 con 0x7f501c09d6f0 2023-10-03T10:16:19.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.283+0000 7f50037fe700 1 -- 172.21.15.72:0/1364593281 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f501c121650 con 0x7f501c09d6f0 2023-10-03T10:16:19.283 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:19.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.285+0000 7f502171d700 1 -- 172.21.15.72:0/1364593281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f501c09d6f0 msgr2=0x7f501c11e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.285+0000 7f502171d700 1 --2- 172.21.15.72:0/1364593281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f501c09d6f0 0x7f501c11e020 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f500c012f00 tx=0x7f500c012f30 comp rx=0 tx=0).stop 2023-10-03T10:16:19.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.285+0000 7f502171d700 1 -- 172.21.15.72:0/1364593281 shutdown_connections 2023-10-03T10:16:19.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.285+0000 7f502171d700 1 --2- 172.21.15.72:0/1364593281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f501c09e410 0x7f501c11eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.285+0000 7f502171d700 1 --2- 172.21.15.72:0/1364593281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f501c09d6f0 0x7f501c11e020 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.285+0000 7f502171d700 1 --2- 172.21.15.72:0/1364593281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f501c09e000 0x7f501c11e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.285+0000 7f502171d700 1 -- 172.21.15.72:0/1364593281 >> 172.21.15.72:0/1364593281 conn(0x7f501c066f50 msgr2=0x7f501c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.285+0000 7f502171d700 1 -- 172.21.15.72:0/1364593281 shutdown_connections 2023-10-03T10:16:19.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:19.285+0000 7f502171d700 1 -- 172.21.15.72:0/1364593281 wait complete. 2023-10-03T10:16:19.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:19.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.081+0000 7f208c5c7700 1 Processor -- start 2023-10-03T10:16:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.081+0000 7f208c5c7700 1 -- start start 2023-10-03T10:16:20.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.082+0000 7f208c5c7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20841316c0 0x7f2084131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.082+0000 7f208c5c7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208406ae80 0x7f2084139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.082+0000 7f208c5c7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f208409e130 con 0x7f208409d9f0 2023-10-03T10:16:20.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.082+0000 7f208c5c7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20841312b0 con 0x7f20841316c0 2023-10-03T10:16:20.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.082+0000 7f208c5c7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f208409f6e0 con 0x7f208406ae80 2023-10-03T10:16:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.082+0000 7f208a363700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20841316c0 0x7f2084131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.082+0000 7f208ab64700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208406ae80 0x7f2084139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.082+0000 7f208a363700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20841316c0 0x7f2084131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37860/0 (socket says 172.21.15.72:37860) 2023-10-03T10:16:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.082+0000 7f208ab64700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208406ae80 0x7f2084139550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41458/0 (socket says 172.21.15.72:41458) 2023-10-03T10:16:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.082+0000 7f208a363700 1 -- 172.21.15.72:0/1939261200 learned_addr learned my addr 172.21.15.72:0/1939261200 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.082+0000 7f208a363700 1 -- 172.21.15.72:0/1939261200 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208406ae80 msgr2=0x7f2084139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.082+0000 7f208a363700 1 --2- 172.21.15.72:0/1939261200 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208406ae80 0x7f2084139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.082+0000 7f208a363700 1 -- 172.21.15.72:0/1939261200 >> v1:172.21.15.72:6789/0 conn(0x7f208409d9f0 legacy=0x7f208406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.082+0000 7f208a363700 1 -- 172.21.15.72:0/1939261200 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208409e760 con 0x7f20841316c0 2023-10-03T10:16:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.082+0000 7f208ab64700 1 --2- 172.21.15.72:0/1939261200 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208406ae80 0x7f2084139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.083+0000 7f208a363700 1 --2- 172.21.15.72:0/1939261200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20841316c0 0x7f2084131a90 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f20740098f0 tx=0x7f2074009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b5a1ac403f1f1c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.083+0000 7f2089361700 1 -- 172.21.15.72:0/1939261200 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074011830 con 0x7f20841316c0 2023-10-03T10:16:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.083+0000 7f2089361700 1 -- 172.21.15.72:0/1939261200 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2074011990 con 0x7f20841316c0 2023-10-03T10:16:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.083+0000 7f2089361700 1 -- 172.21.15.72:0/1939261200 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074011d20 con 0x7f20841316c0 2023-10-03T10:16:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.083+0000 7f208c5c7700 1 -- 172.21.15.72:0/1939261200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20841316c0 msgr2=0x7f2084131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.083+0000 7f208c5c7700 1 --2- 172.21.15.72:0/1939261200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20841316c0 0x7f2084131a90 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f20740098f0 tx=0x7f2074009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.083+0000 7f208c5c7700 1 -- 172.21.15.72:0/1939261200 shutdown_connections 2023-10-03T10:16:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.083+0000 7f208c5c7700 1 --2- 172.21.15.72:0/1939261200 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208406ae80 0x7f2084139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.083+0000 7f208c5c7700 1 --2- 172.21.15.72:0/1939261200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20841316c0 0x7f2084131a90 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.083+0000 7f208c5c7700 1 -- 172.21.15.72:0/1939261200 >> 172.21.15.72:0/1939261200 conn(0x7f2084066f50 msgr2=0x7f208409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.083+0000 7f208c5c7700 1 -- 172.21.15.72:0/1939261200 shutdown_connections 2023-10-03T10:16:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.083+0000 7f208c5c7700 1 -- 172.21.15.72:0/1939261200 wait complete. 2023-10-03T10:16:20.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.085+0000 7f208c5c7700 1 Processor -- start 2023-10-03T10:16:20.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.085+0000 7f208c5c7700 1 -- start start 2023-10-03T10:16:20.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.085+0000 7f208c5c7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208406ae80 0x7f20840708b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.085+0000 7f208c5c7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208409d9f0 0x7f2084070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.085+0000 7f208c5c7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20841316c0 0x7f2084071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.085+0000 7f208c5c7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208411aec0 con 0x7f20841316c0 2023-10-03T10:16:20.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.085+0000 7f208c5c7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2084071d10 con 0x7f208409d9f0 2023-10-03T10:16:20.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.085+0000 7f208c5c7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f208412b900 con 0x7f208406ae80 2023-10-03T10:16:20.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.085+0000 7f208a363700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208406ae80 0x7f20840708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.085+0000 7f208a363700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208406ae80 0x7f20840708b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41466/0 (socket says 172.21.15.72:41466) 2023-10-03T10:16:20.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.085+0000 7f208a363700 1 -- 172.21.15.72:0/1244489984 learned_addr learned my addr 172.21.15.72:0/1244489984 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:20.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.085+0000 7f208ab64700 1 --2- 172.21.15.72:0/1244489984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20841316c0 0x7f2084071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.085+0000 7f2089b62700 1 --2- 172.21.15.72:0/1244489984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208409d9f0 0x7f2084070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.086+0000 7f208a363700 1 -- 172.21.15.72:0/1244489984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208409d9f0 msgr2=0x7f2084070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.086+0000 7f208a363700 1 --2- 172.21.15.72:0/1244489984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208409d9f0 0x7f2084070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.086+0000 7f208a363700 1 -- 172.21.15.72:0/1244489984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20841316c0 msgr2=0x7f2084071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.086+0000 7f208a363700 1 --2- 172.21.15.72:0/1244489984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20841316c0 0x7f2084071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.086+0000 7f208a363700 1 -- 172.21.15.72:0/1244489984 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c009a70 con 0x7f208406ae80 2023-10-03T10:16:20.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.086+0000 7f208ab64700 1 --2- 172.21.15.72:0/1244489984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20841316c0 0x7f2084071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.086+0000 7f208a363700 1 --2- 172.21.15.72:0/1244489984 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208406ae80 0x7f20840708b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2074000c00 tx=0x7f2074004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.086+0000 7f207affd700 1 -- 172.21.15.72:0/1244489984 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20740043c0 con 0x7f208406ae80 2023-10-03T10:16:20.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.086+0000 7f207affd700 1 -- 172.21.15.72:0/1244489984 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207401f070 con 0x7f208406ae80 2023-10-03T10:16:20.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.086+0000 7f207affd700 1 -- 172.21.15.72:0/1244489984 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20740038c0 con 0x7f208406ae80 2023-10-03T10:16:20.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.086+0000 7f208c5c7700 1 -- 172.21.15.72:0/1244489984 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2074009550 con 0x7f208406ae80 2023-10-03T10:16:20.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.086+0000 7f208c5c7700 1 -- 172.21.15.72:0/1244489984 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20840a36d0 con 0x7f208406ae80 2023-10-03T10:16:20.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.087+0000 7f207affd700 1 -- 172.21.15.72:0/1244489984 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2074021030 con 0x7f208406ae80 2023-10-03T10:16:20.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.087+0000 7f207affd700 1 -- 172.21.15.72:0/1244489984 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2074040980 con 0x7f208406ae80 2023-10-03T10:16:20.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.087+0000 7f208c5c7700 1 -- 172.21.15.72:0/1244489984 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208411aad0 con 0x7f208406ae80 2023-10-03T10:16:20.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.092+0000 7f207affd700 1 -- 172.21.15.72:0/1244489984 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2074004560 con 0x7f208406ae80 2023-10-03T10:16:20.138 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:20.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:20.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.265+0000 7f09684a0700 1 Processor -- start 2023-10-03T10:16:20.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.265+0000 7f09684a0700 1 -- start start 2023-10-03T10:16:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f09684a0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f096009d6f0 0x7f096009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f09684a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f096009e000 0x7f0960130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f09684a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f096009e410 0x7f0960130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f09684a0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f096009f520 con 0x7f096009d6f0 2023-10-03T10:16:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f09684a0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096009f130 con 0x7f096009e410 2023-10-03T10:16:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f09684a0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f096009e930 con 0x7f096009e000 2023-10-03T10:16:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f096623c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f096009d6f0 0x7f096009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f0966a3d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f096009e410 0x7f0960130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f096623c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f096009d6f0 0x7f096009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37876/0 (socket says 172.21.15.72:37876) 2023-10-03T10:16:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f096623c700 1 -- 172.21.15.72:0/3569612542 learned_addr learned my addr 172.21.15.72:0/3569612542 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f0965a3b700 1 --2- 172.21.15.72:0/3569612542 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f096009e000 0x7f0960130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f0966a3d700 1 -- 172.21.15.72:0/3569612542 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f096009e000 msgr2=0x7f0960130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f0966a3d700 1 --2- 172.21.15.72:0/3569612542 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f096009e000 0x7f0960130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f0966a3d700 1 -- 172.21.15.72:0/3569612542 >> v2:172.21.15.72:3300/0 conn(0x7f096009d6f0 msgr2=0x7f096009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f0966a3d700 1 --2- 172.21.15.72:0/3569612542 >> v2:172.21.15.72:3300/0 conn(0x7f096009d6f0 0x7f096009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f0966a3d700 1 -- 172.21.15.72:0/3569612542 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096009b2d0 con 0x7f096009e410 2023-10-03T10:16:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f0965a3b700 1 --2- 172.21.15.72:0/3569612542 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f096009e000 0x7f0960130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.266+0000 7f096623c700 1 --2- 172.21.15.72:0/3569612542 >> v2:172.21.15.72:3300/0 conn(0x7f096009d6f0 0x7f096009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.267+0000 7f0966a3d700 1 --2- 172.21.15.72:0/3569612542 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f096009e410 0x7f0960130ba0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f095800f370 tx=0x7f095800f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e9d9ea521c00467 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.267+0000 7f096523a700 1 -- 172.21.15.72:0/3569612542 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0958012070 con 0x7f096009e410 2023-10-03T10:16:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.267+0000 7f096523a700 1 -- 172.21.15.72:0/3569612542 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095800fe70 con 0x7f096009e410 2023-10-03T10:16:20.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.267+0000 7f096523a700 1 -- 172.21.15.72:0/3569612542 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095800d2f0 con 0x7f096009e410 2023-10-03T10:16:20.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.268+0000 7f09684a0700 1 -- 172.21.15.72:0/3569612542 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f096009e410 msgr2=0x7f0960130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.268+0000 7f09684a0700 1 --2- 172.21.15.72:0/3569612542 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f096009e410 0x7f0960130ba0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f095800f370 tx=0x7f095800f680 comp rx=0 tx=0).stop 2023-10-03T10:16:20.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.268+0000 7f09684a0700 1 -- 172.21.15.72:0/3569612542 shutdown_connections 2023-10-03T10:16:20.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.268+0000 7f09684a0700 1 --2- 172.21.15.72:0/3569612542 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f096009e410 0x7f0960130ba0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.268+0000 7f09684a0700 1 --2- 172.21.15.72:0/3569612542 >> v2:172.21.15.72:3300/0 conn(0x7f096009d6f0 0x7f096009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.268+0000 7f09684a0700 1 --2- 172.21.15.72:0/3569612542 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f096009e000 0x7f0960130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.268+0000 7f09684a0700 1 -- 172.21.15.72:0/3569612542 >> 172.21.15.72:0/3569612542 conn(0x7f0960066f50 msgr2=0x7f096009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.268+0000 7f09684a0700 1 -- 172.21.15.72:0/3569612542 shutdown_connections 2023-10-03T10:16:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.268+0000 7f09684a0700 1 -- 172.21.15.72:0/3569612542 wait complete. 2023-10-03T10:16:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.269+0000 7f09684a0700 1 Processor -- start 2023-10-03T10:16:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.269+0000 7f09684a0700 1 -- start start 2023-10-03T10:16:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f09684a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f096009d6f0 0x7f096011de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f09684a0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f096009e000 0x7f096011e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f09684a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f096009e410 0x7f096011e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f09684a0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0960121030 con 0x7f096009e000 2023-10-03T10:16:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f09684a0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096009c700 con 0x7f096009e410 2023-10-03T10:16:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f09684a0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09600a1600 con 0x7f096009d6f0 2023-10-03T10:16:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f0965a3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f096009e000 0x7f096011e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f0965a3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f096009e000 0x7f096011e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37882/0 (socket says 172.21.15.72:37882) 2023-10-03T10:16:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f0965a3b700 1 -- 172.21.15.72:0/3525442980 learned_addr learned my addr 172.21.15.72:0/3525442980 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f096623c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f096009d6f0 0x7f096011de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f0966a3d700 1 --2- 172.21.15.72:0/3525442980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f096009e410 0x7f096011e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f0965a3b700 1 -- 172.21.15.72:0/3525442980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f096009d6f0 msgr2=0x7f096011de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f0965a3b700 1 --2- 172.21.15.72:0/3525442980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f096009d6f0 0x7f096011de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f0965a3b700 1 -- 172.21.15.72:0/3525442980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f096009e410 msgr2=0x7f096011e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f0965a3b700 1 --2- 172.21.15.72:0/3525442980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f096009e410 0x7f096011e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f0965a3b700 1 -- 172.21.15.72:0/3525442980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095c00b600 con 0x7f096009e000 2023-10-03T10:16:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f096623c700 1 --2- 172.21.15.72:0/3525442980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f096009d6f0 0x7f096011de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f0965a3b700 1 --2- 172.21.15.72:0/3525442980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f096009e000 0x7f096011e350 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f095000ebe0 tx=0x7f095000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f0956ffd700 1 -- 172.21.15.72:0/3525442980 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0950009800 con 0x7f096009e000 2023-10-03T10:16:20.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f0956ffd700 1 -- 172.21.15.72:0/3525442980 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095000c850 con 0x7f096009e000 2023-10-03T10:16:20.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f09684a0700 1 -- 172.21.15.72:0/3525442980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09500094a0 con 0x7f096009e000 2023-10-03T10:16:20.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.270+0000 7f0956ffd700 1 -- 172.21.15.72:0/3525442980 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095000cbc0 con 0x7f096009e000 2023-10-03T10:16:20.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.271+0000 7f09684a0700 1 -- 172.21.15.72:0/3525442980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095800f050 con 0x7f096009e000 2023-10-03T10:16:20.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.271+0000 7f0956ffd700 1 -- 172.21.15.72:0/3525442980 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f095000cd20 con 0x7f096009e000 2023-10-03T10:16:20.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.271+0000 7f09684a0700 1 -- 172.21.15.72:0/3525442980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f096011ac20 con 0x7f096009e000 2023-10-03T10:16:20.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.272+0000 7f0956ffd700 1 -- 172.21.15.72:0/3525442980 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f095003f720 con 0x7f096009e000 2023-10-03T10:16:20.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.280+0000 7f0956ffd700 1 -- 172.21.15.72:0/3525442980 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09500232f0 con 0x7f096009e000 2023-10-03T10:16:20.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.292+0000 7f208c5c7700 1 -- 172.21.15.72:0/1244489984 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2084074ea0 con 0x7f208406ae80 2023-10-03T10:16:20.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.292+0000 7f207affd700 1 -- 172.21.15.72:0/1244489984 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20740193b0 con 0x7f208406ae80 2023-10-03T10:16:20.293 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.294+0000 7f208c5c7700 1 -- 172.21.15.72:0/1244489984 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208406ae80 msgr2=0x7f20840708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.294+0000 7f208c5c7700 1 --2- 172.21.15.72:0/1244489984 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208406ae80 0x7f20840708b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2074000c00 tx=0x7f2074004750 comp rx=0 tx=0).stop 2023-10-03T10:16:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.294+0000 7f208c5c7700 1 -- 172.21.15.72:0/1244489984 shutdown_connections 2023-10-03T10:16:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.294+0000 7f208c5c7700 1 --2- 172.21.15.72:0/1244489984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20841316c0 0x7f2084071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.294+0000 7f208c5c7700 1 --2- 172.21.15.72:0/1244489984 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f208406ae80 0x7f20840708b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.295+0000 7f208c5c7700 1 --2- 172.21.15.72:0/1244489984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f208409d9f0 0x7f2084070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.295+0000 7f208c5c7700 1 -- 172.21.15.72:0/1244489984 >> 172.21.15.72:0/1244489984 conn(0x7f2084066f50 msgr2=0x7f20840a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.295+0000 7f208c5c7700 1 -- 172.21.15.72:0/1244489984 shutdown_connections 2023-10-03T10:16:20.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.295+0000 7f208c5c7700 1 -- 172.21.15.72:0/1244489984 wait complete. 2023-10-03T10:16:20.298 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:20.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:20.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.313+0000 7fd8eb7a8700 1 Processor -- start 2023-10-03T10:16:20.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.313+0000 7fd8eb7a8700 1 -- start start 2023-10-03T10:16:20.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8eb7a8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8e409d6f0 0x7fd8e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8eb7a8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8e409e000 0x7fd8e41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8eb7a8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e409b120 con 0x7fd8e409e410 2023-10-03T10:16:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8eb7a8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e406b460 con 0x7fd8e409e000 2023-10-03T10:16:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8eb7a8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e409a7e0 con 0x7fd8e409d6f0 2023-10-03T10:16:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8e9d45700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd8e409e410 0x7fd8e4133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55960/0 (socket says 172.21.15.72:55960) 2023-10-03T10:16:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8e9d45700 1 -- 172.21.15.72:0/2531669214 learned_addr learned my addr 172.21.15.72:0/2531669214 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8e9544700 1 --2- 172.21.15.72:0/2531669214 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8e409d6f0 0x7fd8e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8e8d43700 1 --2- 172.21.15.72:0/2531669214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8e409e000 0x7fd8e41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8e9544700 1 -- 172.21.15.72:0/2531669214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8e409e000 msgr2=0x7fd8e41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8e9544700 1 --2- 172.21.15.72:0/2531669214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8e409e000 0x7fd8e41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8e9544700 1 -- 172.21.15.72:0/2531669214 >> v1:172.21.15.72:6789/0 conn(0x7fd8e409e410 legacy=0x7fd8e4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8e9544700 1 -- 172.21.15.72:0/2531669214 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e409a500 con 0x7fd8e409d6f0 2023-10-03T10:16:20.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8dbfff700 1 -- 172.21.15.72:0/2531669214 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830380406 0 0) 0x7fd8e409b120 con 0x7fd8e409e410 2023-10-03T10:16:20.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8e9544700 1 --2- 172.21.15.72:0/2531669214 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8e409d6f0 0x7fd8e409dac0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00098a0 tx=0x7fd8e0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1090d1b0652a412a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8dbfff700 1 -- 172.21.15.72:0/2531669214 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0011830 con 0x7fd8e409d6f0 2023-10-03T10:16:20.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.314+0000 7fd8dbfff700 1 -- 172.21.15.72:0/2531669214 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e0011990 con 0x7fd8e409d6f0 2023-10-03T10:16:20.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.315+0000 7fd8dbfff700 1 -- 172.21.15.72:0/2531669214 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0011d20 con 0x7fd8e409d6f0 2023-10-03T10:16:20.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.315+0000 7fd8eb7a8700 1 -- 172.21.15.72:0/2531669214 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8e409d6f0 msgr2=0x7fd8e409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.315+0000 7fd8eb7a8700 1 --2- 172.21.15.72:0/2531669214 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8e409d6f0 0x7fd8e409dac0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00098a0 tx=0x7fd8e0009bb0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.315+0000 7fd8eb7a8700 1 -- 172.21.15.72:0/2531669214 shutdown_connections 2023-10-03T10:16:20.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.315+0000 7fd8eb7a8700 1 --2- 172.21.15.72:0/2531669214 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8e409d6f0 0x7fd8e409dac0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.315+0000 7fd8eb7a8700 1 --2- 172.21.15.72:0/2531669214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8e409e000 0x7fd8e41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.315+0000 7fd8eb7a8700 1 -- 172.21.15.72:0/2531669214 >> 172.21.15.72:0/2531669214 conn(0x7fd8e4066f50 msgr2=0x7fd8e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.315+0000 7fd8eb7a8700 1 -- 172.21.15.72:0/2531669214 shutdown_connections 2023-10-03T10:16:20.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.315+0000 7fd8eb7a8700 1 -- 172.21.15.72:0/2531669214 wait complete. 2023-10-03T10:16:20.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.317+0000 7fd8eb7a8700 1 Processor -- start 2023-10-03T10:16:20.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.317+0000 7fd8eb7a8700 1 -- start start 2023-10-03T10:16:20.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.317+0000 7fd8eb7a8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e409d6f0 0x7fd8e41a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.317+0000 7fd8eb7a8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8e409e000 0x7fd8e41a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.317+0000 7fd8eb7a8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8e409e410 0x7fd8e41c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.317+0000 7fd8eb7a8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e41a8360 con 0x7fd8e409d6f0 2023-10-03T10:16:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8eb7a8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e409c710 con 0x7fd8e409e410 2023-10-03T10:16:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8eb7a8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e41a4f00 con 0x7fd8e409e000 2023-10-03T10:16:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8e8d43700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8e409e000 0x7fd8e41a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8e8d43700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8e409e000 0x7fd8e41a5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41526/0 (socket says 172.21.15.72:41526) 2023-10-03T10:16:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8e8d43700 1 -- 172.21.15.72:0/1721501693 learned_addr learned my addr 172.21.15.72:0/1721501693 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8e9d45700 1 --2- 172.21.15.72:0/1721501693 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8e409e410 0x7fd8e41c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8e9544700 1 --2- 172.21.15.72:0/1721501693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e409d6f0 0x7fd8e41a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8e8d43700 1 -- 172.21.15.72:0/1721501693 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8e409e410 msgr2=0x7fd8e41c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8e8d43700 1 --2- 172.21.15.72:0/1721501693 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8e409e410 0x7fd8e41c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8e8d43700 1 -- 172.21.15.72:0/1721501693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e409d6f0 msgr2=0x7fd8e41a5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8e8d43700 1 --2- 172.21.15.72:0/1721501693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e409d6f0 0x7fd8e41a5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8e8d43700 1 -- 172.21.15.72:0/1721501693 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e00094a0 con 0x7fd8e409e000 2023-10-03T10:16:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8e9544700 1 --2- 172.21.15.72:0/1721501693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e409d6f0 0x7fd8e41a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8e8d43700 1 --2- 172.21.15.72:0/1721501693 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8e409e000 0x7fd8e41a5850 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400e980 tx=0x7fd8d400ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8d9ffb700 1 -- 172.21.15.72:0/1721501693 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4009710 con 0x7fd8e409e000 2023-10-03T10:16:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8d9ffb700 1 -- 172.21.15.72:0/1721501693 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d400c690 con 0x7fd8e409e000 2023-10-03T10:16:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8eb7a8700 1 -- 172.21.15.72:0/1721501693 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e41a66b0 con 0x7fd8e409e000 2023-10-03T10:16:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.318+0000 7fd8d9ffb700 1 -- 172.21.15.72:0/1721501693 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d400ca20 con 0x7fd8e409e000 2023-10-03T10:16:20.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.319+0000 7fd8eb7a8700 1 -- 172.21.15.72:0/1721501693 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e41a7c60 con 0x7fd8e409e000 2023-10-03T10:16:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.319+0000 7fd8d9ffb700 1 -- 172.21.15.72:0/1721501693 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8d400cb80 con 0x7fd8e409e000 2023-10-03T10:16:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.319+0000 7fd8eb7a8700 1 -- 172.21.15.72:0/1721501693 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e4074ea0 con 0x7fd8e409e000 2023-10-03T10:16:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.320+0000 7fd8d9ffb700 1 -- 172.21.15.72:0/1721501693 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd8d403f540 con 0x7fd8e409e000 2023-10-03T10:16:20.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.324+0000 7fd8d9ffb700 1 -- 172.21.15.72:0/1721501693 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8d4013470 con 0x7fd8e409e000 2023-10-03T10:16:20.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.423+0000 7fdfbb958700 1 Processor -- start 2023-10-03T10:16:20.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.424+0000 7fdfbb958700 1 -- start start 2023-10-03T10:16:20.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.424+0000 7fdfbb958700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfb409e930 0x7fdfb409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.424+0000 7fdfbb958700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb409f240 0x7fdfb41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.424+0000 7fdfbb958700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb4070940 con 0x7fdfb409f650 2023-10-03T10:16:20.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.424+0000 7fdfbb958700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb406fd60 con 0x7fdfb409f240 2023-10-03T10:16:20.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.424+0000 7fdfbb958700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb406fa80 con 0x7fdfb409e930 2023-10-03T10:16:20.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.424+0000 7fdfb96f4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfb409e930 0x7fdfb409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.424+0000 7fdfb8ef3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb409f240 0x7fdfb41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.424+0000 7fdfb8ef3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb409f240 0x7fdfb41317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40990/0 (socket says 172.21.15.72:40990) 2023-10-03T10:16:20.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.424+0000 7fdfb96f4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfb409e930 0x7fdfb409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41534/0 (socket says 172.21.15.72:41534) 2023-10-03T10:16:20.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.424+0000 7fdfb8ef3700 1 -- 172.21.15.72:0/1801800041 learned_addr learned my addr 172.21.15.72:0/1801800041 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:20.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.425+0000 7fdfabfff700 1 -- 172.21.15.72:0/1801800041 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665207862 0 0) 0x7fdfb4070940 con 0x7fdfb409f650 2023-10-03T10:16:20.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.425+0000 7fdfb8ef3700 1 -- 172.21.15.72:0/1801800041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfb409e930 msgr2=0x7fdfb409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.425+0000 7fdfb8ef3700 1 --2- 172.21.15.72:0/1801800041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfb409e930 0x7fdfb409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.425+0000 7fdfb8ef3700 1 -- 172.21.15.72:0/1801800041 >> v1:172.21.15.72:6789/0 conn(0x7fdfb409f650 legacy=0x7fdfb4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.425+0000 7fdfb8ef3700 1 -- 172.21.15.72:0/1801800041 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb409fb60 con 0x7fdfb409f240 2023-10-03T10:16:20.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.425+0000 7fdfb8ef3700 1 --2- 172.21.15.72:0/1801800041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb409f240 0x7fdfb41317f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009920 tx=0x7fdfa4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a924440673715d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.425+0000 7fdfabfff700 1 -- 172.21.15.72:0/1801800041 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4011830 con 0x7fdfb409f240 2023-10-03T10:16:20.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.425+0000 7fdfabfff700 1 -- 172.21.15.72:0/1801800041 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa4011990 con 0x7fdfb409f240 2023-10-03T10:16:20.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.425+0000 7fdfabfff700 1 -- 172.21.15.72:0/1801800041 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4011d20 con 0x7fdfb409f240 2023-10-03T10:16:20.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.426+0000 7fdfbb958700 1 -- 172.21.15.72:0/1801800041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb409f240 msgr2=0x7fdfb41317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.426+0000 7fdfbb958700 1 --2- 172.21.15.72:0/1801800041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb409f240 0x7fdfb41317f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009920 tx=0x7fdfa4009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:20.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.426+0000 7fdfbb958700 1 -- 172.21.15.72:0/1801800041 shutdown_connections 2023-10-03T10:16:20.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.426+0000 7fdfbb958700 1 --2- 172.21.15.72:0/1801800041 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfb409e930 0x7fdfb409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.426+0000 7fdfbb958700 1 --2- 172.21.15.72:0/1801800041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb409f240 0x7fdfb41317f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.426+0000 7fdfbb958700 1 -- 172.21.15.72:0/1801800041 >> 172.21.15.72:0/1801800041 conn(0x7fdfb40a4210 msgr2=0x7fdfb40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.426+0000 7fdfbb958700 1 -- 172.21.15.72:0/1801800041 shutdown_connections 2023-10-03T10:16:20.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.426+0000 7fdfbb958700 1 -- 172.21.15.72:0/1801800041 wait complete. 2023-10-03T10:16:20.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.427+0000 7fdfbb958700 1 Processor -- start 2023-10-03T10:16:20.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.427+0000 7fdfbb958700 1 -- start start 2023-10-03T10:16:20.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfbb958700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfb409e930 0x7fdfb406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfbb958700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfb409f240 0x7fdfb406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfbb958700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb409f650 0x7fdfb406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfbb958700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb406cd80 con 0x7fdfb409e930 2023-10-03T10:16:20.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfbb958700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb41b7290 con 0x7fdfb409f650 2023-10-03T10:16:20.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfbb958700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb41a9440 con 0x7fdfb409f240 2023-10-03T10:16:20.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfb8ef3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfb409f240 0x7fdfb406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfb8ef3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfb409f240 0x7fdfb406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41538/0 (socket says 172.21.15.72:41538) 2023-10-03T10:16:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfb8ef3700 1 -- 172.21.15.72:0/3673015619 learned_addr learned my addr 172.21.15.72:0/3673015619 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfb96f4700 1 --2- 172.21.15.72:0/3673015619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfb409e930 0x7fdfb406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfb9ef5700 1 --2- 172.21.15.72:0/3673015619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb409f650 0x7fdfb406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfb8ef3700 1 -- 172.21.15.72:0/3673015619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb409f650 msgr2=0x7fdfb406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfb8ef3700 1 --2- 172.21.15.72:0/3673015619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb409f650 0x7fdfb406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfb8ef3700 1 -- 172.21.15.72:0/3673015619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfb409e930 msgr2=0x7fdfb406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfb8ef3700 1 --2- 172.21.15.72:0/3673015619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfb409e930 0x7fdfb406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.428+0000 7fdfb8ef3700 1 -- 172.21.15.72:0/3673015619 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa4009550 con 0x7fdfb409f240 2023-10-03T10:16:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.429+0000 7fdfb8ef3700 1 --2- 172.21.15.72:0/3673015619 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfb409f240 0x7fdfb406bdf0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4000c00 tx=0x7fdfa4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.429+0000 7fdfa9ffb700 1 -- 172.21.15.72:0/3673015619 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4004450 con 0x7fdfb409f240 2023-10-03T10:16:20.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.429+0000 7fdfa9ffb700 1 -- 172.21.15.72:0/3673015619 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa40045b0 con 0x7fdfb409f240 2023-10-03T10:16:20.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.429+0000 7fdfbb958700 1 -- 172.21.15.72:0/3673015619 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb40a0190 con 0x7fdfb409f240 2023-10-03T10:16:20.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.429+0000 7fdfa9ffb700 1 -- 172.21.15.72:0/3673015619 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa40038a0 con 0x7fdfb409f240 2023-10-03T10:16:20.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.429+0000 7fdfbb958700 1 -- 172.21.15.72:0/3673015619 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb41a9170 con 0x7fdfb409f240 2023-10-03T10:16:20.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.430+0000 7fdfbb958700 1 -- 172.21.15.72:0/3673015619 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb40a34c0 con 0x7fdfb409f240 2023-10-03T10:16:20.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.430+0000 7fdfa9ffb700 1 -- 172.21.15.72:0/3673015619 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdfa4003a00 con 0x7fdfb409f240 2023-10-03T10:16:20.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.430+0000 7fdfa9ffb700 1 -- 172.21.15.72:0/3673015619 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdfa4021030 con 0x7fdfb409f240 2023-10-03T10:16:20.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.435+0000 7fdfa9ffb700 1 -- 172.21.15.72:0/3673015619 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdfa4003cb0 con 0x7fdfb409f240 2023-10-03T10:16:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.524+0000 7fd8eb7a8700 1 -- 172.21.15.72:0/1721501693 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd8e41a66b0 con 0x7fd8e409e000 2023-10-03T10:16:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.524+0000 7fd8d9ffb700 1 -- 172.21.15.72:0/1721501693 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8e41a66b0 con 0x7fd8e409e000 2023-10-03T10:16:20.525 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.525+0000 7f09684a0700 1 -- 172.21.15.72:0/3525442980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0960121440 con 0x7f096009e000 2023-10-03T10:16:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.525+0000 7f0956ffd700 1 -- 172.21.15.72:0/3525442980 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0950021020 con 0x7f096009e000 2023-10-03T10:16:20.526 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:20.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.527+0000 7fd8eb7a8700 1 -- 172.21.15.72:0/1721501693 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8e409e000 msgr2=0x7fd8e41a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.527+0000 7fd8eb7a8700 1 --2- 172.21.15.72:0/1721501693 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8e409e000 0x7fd8e41a5850 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400e980 tx=0x7fd8d400ec90 comp rx=0 tx=0).stop 2023-10-03T10:16:20.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.527+0000 7fd8eb7a8700 1 -- 172.21.15.72:0/1721501693 shutdown_connections 2023-10-03T10:16:20.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.527+0000 7fd8eb7a8700 1 --2- 172.21.15.72:0/1721501693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8e409d6f0 0x7fd8e41a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.527+0000 7fd8eb7a8700 1 --2- 172.21.15.72:0/1721501693 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8e409e410 0x7fd8e41c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.527+0000 7fd8eb7a8700 1 --2- 172.21.15.72:0/1721501693 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd8e409e000 0x7fd8e41a5850 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.527+0000 7fd8eb7a8700 1 -- 172.21.15.72:0/1721501693 >> 172.21.15.72:0/1721501693 conn(0x7fd8e4066f50 msgr2=0x7fd8e40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.527+0000 7fd8eb7a8700 1 -- 172.21.15.72:0/1721501693 shutdown_connections 2023-10-03T10:16:20.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.527+0000 7fd8eb7a8700 1 -- 172.21.15.72:0/1721501693 wait complete. 2023-10-03T10:16:20.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.528+0000 7f09684a0700 1 -- 172.21.15.72:0/3525442980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f096009e000 msgr2=0x7f096011e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.528+0000 7f09684a0700 1 --2- 172.21.15.72:0/3525442980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f096009e000 0x7f096011e350 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f095000ebe0 tx=0x7f095000eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.529+0000 7f09684a0700 1 -- 172.21.15.72:0/3525442980 shutdown_connections 2023-10-03T10:16:20.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.529+0000 7f09684a0700 1 --2- 172.21.15.72:0/3525442980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f096009e410 0x7f096011e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.529+0000 7f09684a0700 1 --2- 172.21.15.72:0/3525442980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f096009d6f0 0x7f096011de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.529+0000 7f09684a0700 1 --2- 172.21.15.72:0/3525442980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f096009e000 0x7f096011e350 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.529+0000 7f09684a0700 1 -- 172.21.15.72:0/3525442980 >> 172.21.15.72:0/3525442980 conn(0x7f0960066f50 msgr2=0x7f0960130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.529+0000 7f09684a0700 1 -- 172.21.15.72:0/3525442980 shutdown_connections 2023-10-03T10:16:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.529+0000 7f09684a0700 1 -- 172.21.15.72:0/3525442980 wait complete. 2023-10-03T10:16:20.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:20.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:20.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.670+0000 7fdfbb958700 1 -- 172.21.15.72:0/3673015619 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdfb41a8d20 con 0x7fdfb409f240 2023-10-03T10:16:20.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.670+0000 7fdfa9ffb700 1 -- 172.21.15.72:0/3673015619 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdfa402b070 con 0x7fdfb409f240 2023-10-03T10:16:20.671 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:20.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.672+0000 7fdfbb958700 1 -- 172.21.15.72:0/3673015619 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfb409f240 msgr2=0x7fdfb406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.672+0000 7fdfbb958700 1 --2- 172.21.15.72:0/3673015619 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfb409f240 0x7fdfb406bdf0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4000c00 tx=0x7fdfa4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:20.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.672+0000 7fdfbb958700 1 -- 172.21.15.72:0/3673015619 shutdown_connections 2023-10-03T10:16:20.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.672+0000 7fdfbb958700 1 --2- 172.21.15.72:0/3673015619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfb409e930 0x7fdfb406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.672+0000 7fdfbb958700 1 --2- 172.21.15.72:0/3673015619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfb409f650 0x7fdfb406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.672+0000 7fdfbb958700 1 --2- 172.21.15.72:0/3673015619 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdfb409f240 0x7fdfb406bdf0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.672+0000 7fdfbb958700 1 -- 172.21.15.72:0/3673015619 >> 172.21.15.72:0/3673015619 conn(0x7fdfb40a4210 msgr2=0x7fdfb41b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.672+0000 7fdfbb958700 1 -- 172.21.15.72:0/3673015619 shutdown_connections 2023-10-03T10:16:20.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:20.672+0000 7fdfbb958700 1 -- 172.21.15.72:0/3673015619 wait complete. 2023-10-03T10:16:20.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:21.311 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:21.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.435+0000 7f18f8471700 1 Processor -- start 2023-10-03T10:16:21.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.435+0000 7f18f8471700 1 -- start start 2023-10-03T10:16:21.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f8471700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18f009d6f0 0x7f18f009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f8471700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18f009e000 0x7f18f0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f8471700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f009e410 0x7f18f0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f8471700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f009f520 con 0x7f18f009e000 2023-10-03T10:16:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f8471700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f009f130 con 0x7f18f009e410 2023-10-03T10:16:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f8471700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18f009e930 con 0x7f18f009d6f0 2023-10-03T10:16:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f620d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18f009d6f0 0x7f18f009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f5a0c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18f009e000 0x7f18f0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f620d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18f009d6f0 0x7f18f009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41552/0 (socket says 172.21.15.72:41552) 2023-10-03T10:16:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f5a0c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18f009e000 0x7f18f0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37916/0 (socket says 172.21.15.72:37916) 2023-10-03T10:16:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f620d700 1 -- 172.21.15.72:0/2936742905 learned_addr learned my addr 172.21.15.72:0/2936742905 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f6a0e700 1 --2- 172.21.15.72:0/2936742905 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f009e410 0x7f18f0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f5a0c700 1 -- 172.21.15.72:0/2936742905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18f009d6f0 msgr2=0x7f18f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f5a0c700 1 --2- 172.21.15.72:0/2936742905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18f009d6f0 0x7f18f009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f5a0c700 1 -- 172.21.15.72:0/2936742905 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f009e410 msgr2=0x7f18f0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f5a0c700 1 --2- 172.21.15.72:0/2936742905 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f009e410 0x7f18f0130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f5a0c700 1 -- 172.21.15.72:0/2936742905 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f009b2d0 con 0x7f18f009e000 2023-10-03T10:16:21.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f620d700 1 --2- 172.21.15.72:0/2936742905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18f009d6f0 0x7f18f009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f6a0e700 1 --2- 172.21.15.72:0/2936742905 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f009e410 0x7f18f0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.436+0000 7f18f5a0c700 1 --2- 172.21.15.72:0/2936742905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18f009e000 0x7f18f0130660 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f18ec009870 tx=0x7f18ec009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d58bb7c6399546e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.437+0000 7f18f520b700 1 -- 172.21.15.72:0/2936742905 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec011830 con 0x7f18f009e000 2023-10-03T10:16:21.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.437+0000 7f18f520b700 1 -- 172.21.15.72:0/2936742905 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec011990 con 0x7f18f009e000 2023-10-03T10:16:21.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.437+0000 7f18f520b700 1 -- 172.21.15.72:0/2936742905 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec011d20 con 0x7f18f009e000 2023-10-03T10:16:21.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.437+0000 7f18f8471700 1 -- 172.21.15.72:0/2936742905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18f009e000 msgr2=0x7f18f0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.437+0000 7f18f8471700 1 --2- 172.21.15.72:0/2936742905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18f009e000 0x7f18f0130660 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f18ec009870 tx=0x7f18ec009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.437+0000 7f18f8471700 1 -- 172.21.15.72:0/2936742905 shutdown_connections 2023-10-03T10:16:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.437+0000 7f18f8471700 1 --2- 172.21.15.72:0/2936742905 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f009e410 0x7f18f0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.437+0000 7f18f8471700 1 --2- 172.21.15.72:0/2936742905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18f009d6f0 0x7f18f009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.437+0000 7f18f8471700 1 --2- 172.21.15.72:0/2936742905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18f009e000 0x7f18f0130660 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.437+0000 7f18f8471700 1 -- 172.21.15.72:0/2936742905 >> 172.21.15.72:0/2936742905 conn(0x7f18f0066f50 msgr2=0x7f18f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.437+0000 7f18f8471700 1 -- 172.21.15.72:0/2936742905 shutdown_connections 2023-10-03T10:16:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.437+0000 7f18f8471700 1 -- 172.21.15.72:0/2936742905 wait complete. 2023-10-03T10:16:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.438+0000 7f18f8471700 1 Processor -- start 2023-10-03T10:16:21.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.438+0000 7f18f8471700 1 -- start start 2023-10-03T10:16:21.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f8471700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18f009d6f0 0x7f18f0122680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f8471700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f009e000 0x7f18f0122bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f8471700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18f009e410 0x7f18f0123100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f8471700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0125c00 con 0x7f18f009e410 2023-10-03T10:16:21.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f8471700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f01261a0 con 0x7f18f009e000 2023-10-03T10:16:21.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f8471700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0124ab0 con 0x7f18f009d6f0 2023-10-03T10:16:21.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f620d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18f009d6f0 0x7f18f0122680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f6a0e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18f009e410 0x7f18f0123100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f620d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18f009d6f0 0x7f18f0122680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41568/0 (socket says 172.21.15.72:41568) 2023-10-03T10:16:21.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f620d700 1 -- 172.21.15.72:0/3773704003 learned_addr learned my addr 172.21.15.72:0/3773704003 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:21.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f5a0c700 1 --2- 172.21.15.72:0/3773704003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f009e000 0x7f18f0122bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f6a0e700 1 -- 172.21.15.72:0/3773704003 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18f009d6f0 msgr2=0x7f18f0122680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f6a0e700 1 --2- 172.21.15.72:0/3773704003 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18f009d6f0 0x7f18f0122680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f6a0e700 1 -- 172.21.15.72:0/3773704003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f009e000 msgr2=0x7f18f0122bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f6a0e700 1 --2- 172.21.15.72:0/3773704003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f009e000 0x7f18f0122bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f6a0e700 1 -- 172.21.15.72:0/3773704003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e4009550 con 0x7f18f009e410 2023-10-03T10:16:21.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f620d700 1 --2- 172.21.15.72:0/3773704003 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18f009d6f0 0x7f18f0122680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f6a0e700 1 --2- 172.21.15.72:0/3773704003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18f009e410 0x7f18f0123100 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f18e800efc0 tx=0x7f18e800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18e2ffd700 1 -- 172.21.15.72:0/3773704003 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e800ca90 con 0x7f18f009e410 2023-10-03T10:16:21.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18e2ffd700 1 -- 172.21.15.72:0/3773704003 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e800f040 con 0x7f18f009e410 2023-10-03T10:16:21.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f8471700 1 -- 172.21.15.72:0/3773704003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e8009a70 con 0x7f18f009e410 2023-10-03T10:16:21.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18e2ffd700 1 -- 172.21.15.72:0/3773704003 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e800ce30 con 0x7f18f009e410 2023-10-03T10:16:21.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.439+0000 7f18f8471700 1 -- 172.21.15.72:0/3773704003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ec0094a0 con 0x7f18f009e410 2023-10-03T10:16:21.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.440+0000 7f18e2ffd700 1 -- 172.21.15.72:0/3773704003 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18e8014480 con 0x7f18f009e410 2023-10-03T10:16:21.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.440+0000 7f18e2ffd700 1 -- 172.21.15.72:0/3773704003 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f18e803fcb0 con 0x7f18f009e410 2023-10-03T10:16:21.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.440+0000 7f18f8471700 1 -- 172.21.15.72:0/3773704003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f01305a0 con 0x7f18f009e410 2023-10-03T10:16:21.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.445+0000 7f18e2ffd700 1 -- 172.21.15.72:0/3773704003 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18e8012910 con 0x7f18f009e410 2023-10-03T10:16:21.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:21.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:21.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.640+0000 7f18f8471700 1 -- 172.21.15.72:0/3773704003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f18f009c760 con 0x7f18f009e410 2023-10-03T10:16:21.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.640+0000 7f18e2ffd700 1 -- 172.21.15.72:0/3773704003 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18e8009cc0 con 0x7f18f009e410 2023-10-03T10:16:21.641 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:21.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.642+0000 7f18f8471700 1 -- 172.21.15.72:0/3773704003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18f009e410 msgr2=0x7f18f0123100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.642+0000 7f18f8471700 1 --2- 172.21.15.72:0/3773704003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18f009e410 0x7f18f0123100 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f18e800efc0 tx=0x7f18e800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.642+0000 7f18f8471700 1 -- 172.21.15.72:0/3773704003 shutdown_connections 2023-10-03T10:16:21.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.643+0000 7f18f8471700 1 --2- 172.21.15.72:0/3773704003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18f009e410 0x7f18f0123100 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.643+0000 7f18f8471700 1 --2- 172.21.15.72:0/3773704003 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18f009d6f0 0x7f18f0122680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.643+0000 7f18f8471700 1 --2- 172.21.15.72:0/3773704003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18f009e000 0x7f18f0122bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.643+0000 7f18f8471700 1 -- 172.21.15.72:0/3773704003 >> 172.21.15.72:0/3773704003 conn(0x7f18f0066f50 msgr2=0x7f18f006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.643+0000 7f18f8471700 1 -- 172.21.15.72:0/3773704003 shutdown_connections 2023-10-03T10:16:21.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.643+0000 7f18f8471700 1 -- 172.21.15.72:0/3773704003 wait complete. 2023-10-03T10:16:21.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:21.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.669+0000 7f0a08f0c700 1 Processor -- start 2023-10-03T10:16:21.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.669+0000 7f0a08f0c700 1 -- start start 2023-10-03T10:16:21.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.669+0000 7f6e12b16700 1 Processor -- start 2023-10-03T10:16:21.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.669+0000 7f6e12b16700 1 -- start start 2023-10-03T10:16:21.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f0a08f0c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a041337f0 0x7f0a04138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f0a08f0c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a04138dc0 0x7f0a0413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f0a08f0c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0406b990 con 0x7f0a04133420 2023-10-03T10:16:21.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f0a08f0c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0409b0e0 con 0x7f0a04138dc0 2023-10-03T10:16:21.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f0a08f0c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a04133c20 con 0x7f0a041337f0 2023-10-03T10:16:21.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f6e12b16700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e0c06a770 0x7f6e0c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f6e12b16700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e0c131d10 0x7f6e0c139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f6e12b16700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0c09ece0 con 0x7f6e0c06b080 2023-10-03T10:16:21.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f6e12b16700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e0c09e760 con 0x7f6e0c131d10 2023-10-03T10:16:21.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f6e12b16700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c09e040 con 0x7f6e0c06a770 2023-10-03T10:16:21.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f6e110b3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e0c131d10 0x7f6e0c139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f6e110b3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e0c131d10 0x7f6e0c139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37942/0 (socket says 172.21.15.72:37942) 2023-10-03T10:16:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f0a01d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a041337f0 0x7f0a04138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f0a01d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a041337f0 0x7f0a04138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41020/0 (socket says 172.21.15.72:41020) 2023-10-03T10:16:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f0a02d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a04138dc0 0x7f0a0413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f0a01d9b700 1 -- 172.21.15.72:0/8628079 learned_addr learned my addr 172.21.15.72:0/8628079 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f6e110b3700 1 -- 172.21.15.72:0/1367325532 learned_addr learned my addr 172.21.15.72:0/1367325532 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f6e0bfff700 1 --1- 172.21.15.72:0/1367325532 >> v1:172.21.15.72:6789/0 conn(0x7f6e0c06b080 0x7f6e0c131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55988/0 (socket says 172.21.15.72:55988) 2023-10-03T10:16:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f0a02d9d700 1 -- 172.21.15.72:0/8628079 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a041337f0 msgr2=0x7f0a04138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f0a02d9d700 1 --2- 172.21.15.72:0/8628079 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a041337f0 0x7f0a04138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f0a02d9d700 1 -- 172.21.15.72:0/8628079 >> v1:172.21.15.72:6789/0 conn(0x7f0a04133420 legacy=0x7f0a04133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.670+0000 7f0a02d9d700 1 -- 172.21.15.72:0/8628079 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a040a0590 con 0x7f0a04138dc0 2023-10-03T10:16:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.671+0000 7f6e108b2700 1 --2- 172.21.15.72:0/1367325532 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e0c06a770 0x7f6e0c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.671+0000 7f0a02d9d700 1 --2- 172.21.15.72:0/8628079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a04138dc0 0x7f0a0413b1a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009d90 tx=0x7f09fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67322f6e82fecdc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.671+0000 7f6e110b3700 1 -- 172.21.15.72:0/1367325532 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e0c06a770 msgr2=0x7f6e0c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.671+0000 7f6e110b3700 1 --2- 172.21.15.72:0/1367325532 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e0c06a770 0x7f6e0c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.671+0000 7f6e110b3700 1 -- 172.21.15.72:0/1367325532 >> v1:172.21.15.72:6789/0 conn(0x7f6e0c06b080 legacy=0x7f6e0c131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.671+0000 7f6e110b3700 1 -- 172.21.15.72:0/1367325532 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c09f630 con 0x7f6e0c131d10 2023-10-03T10:16:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.671+0000 7f0a0159a700 1 -- 172.21.15.72:0/8628079 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc00e070 con 0x7f0a04138dc0 2023-10-03T10:16:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.671+0000 7f0a0159a700 1 -- 172.21.15.72:0/8628079 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc00bb20 con 0x7f0a04138dc0 2023-10-03T10:16:21.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.671+0000 7f0a0159a700 1 -- 172.21.15.72:0/8628079 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc012430 con 0x7f0a04138dc0 2023-10-03T10:16:21.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.671+0000 7f6e110b3700 1 --2- 172.21.15.72:0/1367325532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c131d10 0x7f6e0c139860 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009e50 tx=0x7f6e0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6582a8c53817f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.671+0000 7f6e0b7fe700 1 -- 172.21.15.72:0/1367325532 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400e070 con 0x7f6e0c131d10 2023-10-03T10:16:21.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.671+0000 7f6e0b7fe700 1 -- 172.21.15.72:0/1367325532 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e04003a20 con 0x7f6e0c131d10 2023-10-03T10:16:21.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.671+0000 7f6e0b7fe700 1 -- 172.21.15.72:0/1367325532 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04003dd0 con 0x7f6e0c131d10 2023-10-03T10:16:21.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f0a08f0c700 1 -- 172.21.15.72:0/8628079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a04138dc0 msgr2=0x7f0a0413b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f0a08f0c700 1 --2- 172.21.15.72:0/8628079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a04138dc0 0x7f0a0413b1a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009d90 tx=0x7f09fc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:21.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f0a08f0c700 1 -- 172.21.15.72:0/8628079 shutdown_connections 2023-10-03T10:16:21.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f0a08f0c700 1 --2- 172.21.15.72:0/8628079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a04138dc0 0x7f0a0413b1a0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f0a08f0c700 1 --2- 172.21.15.72:0/8628079 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a041337f0 0x7f0a04138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f0a08f0c700 1 -- 172.21.15.72:0/8628079 >> 172.21.15.72:0/8628079 conn(0x7f0a040a4210 msgr2=0x7f0a040a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f0a08f0c700 1 -- 172.21.15.72:0/8628079 shutdown_connections 2023-10-03T10:16:21.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f0a08f0c700 1 -- 172.21.15.72:0/8628079 wait complete. 2023-10-03T10:16:21.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f6e12b16700 1 -- 172.21.15.72:0/1367325532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c131d10 msgr2=0x7f6e0c139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f6e12b16700 1 --2- 172.21.15.72:0/1367325532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c131d10 0x7f6e0c139860 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f6e04009e50 tx=0x7f6e0400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:21.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f6e12b16700 1 -- 172.21.15.72:0/1367325532 shutdown_connections 2023-10-03T10:16:21.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f6e12b16700 1 --2- 172.21.15.72:0/1367325532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c131d10 0x7f6e0c139860 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f6e12b16700 1 --2- 172.21.15.72:0/1367325532 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e0c06a770 0x7f6e0c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f6e12b16700 1 -- 172.21.15.72:0/1367325532 >> 172.21.15.72:0/1367325532 conn(0x7f6e0c066f50 msgr2=0x7f6e0c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f6e12b16700 1 -- 172.21.15.72:0/1367325532 shutdown_connections 2023-10-03T10:16:21.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.672+0000 7f6e12b16700 1 -- 172.21.15.72:0/1367325532 wait complete. 2023-10-03T10:16:21.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f6e12b16700 1 Processor -- start 2023-10-03T10:16:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f0a08f0c700 1 Processor -- start 2023-10-03T10:16:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f6e12b16700 1 -- start start 2023-10-03T10:16:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f0a08f0c700 1 -- start start 2023-10-03T10:16:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f0a08f0c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a04133420 0x7f0a0409c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f0a08f0c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a041337f0 0x7f0a0409ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f0a08f0c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a04138dc0 0x7f0a0409d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f0a08f0c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0412f330 con 0x7f0a041337f0 2023-10-03T10:16:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f0a08f0c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a04130890 con 0x7f0a04138dc0 2023-10-03T10:16:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f0a08f0c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0413b1b0 con 0x7f0a04133420 2023-10-03T10:16:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f0a02d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a04138dc0 0x7f0a0409d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f0a0259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a04133420 0x7f0a0409c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f0a02d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a04138dc0 0x7f0a0409d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41036/0 (socket says 172.21.15.72:41036) 2023-10-03T10:16:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f0a02d9d700 1 -- 172.21.15.72:0/1605178489 learned_addr learned my addr 172.21.15.72:0/1605178489 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:21.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f0a01d9b700 1 --2- 172.21.15.72:0/1605178489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a041337f0 0x7f0a0409ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f6e12b16700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c06a770 0x7f6e0c1c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f6e12b16700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e0c06b080 0x7f6e0c1c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f6e12b16700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c131d10 0x7f6e0c1c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f6e12b16700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c071e60 con 0x7f6e0c131d10 2023-10-03T10:16:21.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f6e12b16700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c122340 con 0x7f6e0c06a770 2023-10-03T10:16:21.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.673+0000 7f6e12b16700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c122e30 con 0x7f6e0c06b080 2023-10-03T10:16:21.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e110b3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c131d10 0x7f6e0c1c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e110b3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c131d10 0x7f6e0c1c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37954/0 (socket says 172.21.15.72:37954) 2023-10-03T10:16:21.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e108b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c06a770 0x7f6e0c1c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e110b3700 1 -- 172.21.15.72:0/2903198867 learned_addr learned my addr 172.21.15.72:0/2903198867 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:21.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e0bfff700 1 --2- 172.21.15.72:0/2903198867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e0c06b080 0x7f6e0c1c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f0a01d9b700 1 -- 172.21.15.72:0/1605178489 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a04133420 msgr2=0x7f0a0409c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f0a01d9b700 1 --2- 172.21.15.72:0/1605178489 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a04133420 0x7f0a0409c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f0a01d9b700 1 -- 172.21.15.72:0/1605178489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a04138dc0 msgr2=0x7f0a0409d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f0a01d9b700 1 --2- 172.21.15.72:0/1605178489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a04138dc0 0x7f0a0409d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f0a01d9b700 1 -- 172.21.15.72:0/1605178489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc009a70 con 0x7f0a041337f0 2023-10-03T10:16:21.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e0bfff700 1 -- 172.21.15.72:0/2903198867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c06a770 msgr2=0x7f6e0c1c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e0bfff700 1 --2- 172.21.15.72:0/2903198867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c06a770 0x7f6e0c1c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e0bfff700 1 -- 172.21.15.72:0/2903198867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c131d10 msgr2=0x7f6e0c1c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e0bfff700 1 --2- 172.21.15.72:0/2903198867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c131d10 0x7f6e0c1c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e0bfff700 1 -- 172.21.15.72:0/2903198867 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e04009b30 con 0x7f6e0c06b080 2023-10-03T10:16:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e108b2700 1 --2- 172.21.15.72:0/2903198867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c06a770 0x7f6e0c1c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f0a01d9b700 1 --2- 172.21.15.72:0/1605178489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a041337f0 0x7f0a0409ce40 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f09f800e8e0 tx=0x7f09f800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e0bfff700 1 --2- 172.21.15.72:0/2903198867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e0c06b080 0x7f6e0c1c6490 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6df800c750 tx=0x7f6df800ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f09f2ffd700 1 -- 172.21.15.72:0/1605178489 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8013680 con 0x7f0a041337f0 2023-10-03T10:16:21.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e097fa700 1 -- 172.21.15.72:0/2903198867 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df8004c80 con 0x7f6e0c06b080 2023-10-03T10:16:21.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f09f2ffd700 1 -- 172.21.15.72:0/1605178489 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f80137e0 con 0x7f0a041337f0 2023-10-03T10:16:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f0a08f0c700 1 -- 172.21.15.72:0/1605178489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0412e410 con 0x7f0a041337f0 2023-10-03T10:16:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e097fa700 1 -- 172.21.15.72:0/2903198867 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df8004de0 con 0x7f6e0c06b080 2023-10-03T10:16:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e12b16700 1 -- 172.21.15.72:0/2903198867 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0c131120 con 0x7f6e0c06b080 2023-10-03T10:16:21.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f09f2ffd700 1 -- 172.21.15.72:0/1605178489 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8013b70 con 0x7f0a041337f0 2023-10-03T10:16:21.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.674+0000 7f6e097fa700 1 -- 172.21.15.72:0/2903198867 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df8007310 con 0x7f6e0c06b080 2023-10-03T10:16:21.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.675+0000 7f0a08f0c700 1 -- 172.21.15.72:0/1605178489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a04130230 con 0x7f0a041337f0 2023-10-03T10:16:21.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.675+0000 7f6e12b16700 1 -- 172.21.15.72:0/2903198867 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0c124860 con 0x7f6e0c06b080 2023-10-03T10:16:21.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.675+0000 7f09f2ffd700 1 -- 172.21.15.72:0/1605178489 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09f8013cd0 con 0x7f0a041337f0 2023-10-03T10:16:21.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.675+0000 7f6e097fa700 1 -- 172.21.15.72:0/2903198867 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6df8007470 con 0x7f6e0c06b080 2023-10-03T10:16:21.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.676+0000 7f09f2ffd700 1 -- 172.21.15.72:0/1605178489 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09f803f640 con 0x7f0a041337f0 2023-10-03T10:16:21.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.676+0000 7f6e097fa700 1 -- 172.21.15.72:0/2903198867 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6df803f350 con 0x7f6e0c06b080 2023-10-03T10:16:21.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.676+0000 7f6e12b16700 1 -- 172.21.15.72:0/2903198867 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e0c074ea0 con 0x7f6e0c06b080 2023-10-03T10:16:21.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.676+0000 7f0a08f0c700 1 -- 172.21.15.72:0/1605178489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a04132b20 con 0x7f0a041337f0 2023-10-03T10:16:21.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.680+0000 7f09f2ffd700 1 -- 172.21.15.72:0/1605178489 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f09f8017070 con 0x7f0a041337f0 2023-10-03T10:16:21.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.680+0000 7f6e097fa700 1 -- 172.21.15.72:0/2903198867 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6df8007720 con 0x7f6e0c06b080 2023-10-03T10:16:21.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.816+0000 7f928f67c700 1 Processor -- start 2023-10-03T10:16:21.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.816+0000 7f928f67c700 1 -- start start 2023-10-03T10:16:21.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.817+0000 7f928f67c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f928809d6f0 0x7f928809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.817+0000 7f928f67c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928809e000 0x7f9288130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.817+0000 7f928f67c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928809f130 con 0x7f928809e410 2023-10-03T10:16:21.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.817+0000 7f928f67c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928809f520 con 0x7f928809d6f0 2023-10-03T10:16:21.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.817+0000 7f928f67c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928809e930 con 0x7f928809e000 2023-10-03T10:16:21.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.817+0000 7f928d418700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f928809d6f0 0x7f928809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.817+0000 7f928cc17700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928809e000 0x7f9288130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.817+0000 7f928cc17700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928809e000 0x7f9288130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41056/0 (socket says 172.21.15.72:41056) 2023-10-03T10:16:21.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.817+0000 7f928d418700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f928809d6f0 0x7f928809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37960/0 (socket says 172.21.15.72:37960) 2023-10-03T10:16:21.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.817+0000 7f928cc17700 1 -- 172.21.15.72:0/1873037724 learned_addr learned my addr 172.21.15.72:0/1873037724 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:21.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.817+0000 7f928d418700 1 -- 172.21.15.72:0/1873037724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928809e000 msgr2=0x7f9288130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:21.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.817+0000 7f928d418700 1 --2- 172.21.15.72:0/1873037724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928809e000 0x7f9288130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.817+0000 7f928d418700 1 -- 172.21.15.72:0/1873037724 >> v1:172.21.15.72:6789/0 conn(0x7f928809e410 legacy=0x7f9288130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.817+0000 7f928d418700 1 -- 172.21.15.72:0/1873037724 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928809b2d0 con 0x7f928809d6f0 2023-10-03T10:16:21.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.817+0000 7f928cc17700 1 --2- 172.21.15.72:0/1873037724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928809e000 0x7f9288130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:21.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.818+0000 7f928d418700 1 --2- 172.21.15.72:0/1873037724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f928809d6f0 0x7f928809dac0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f9284009840 tx=0x7f9284009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdd4b204b6ccae9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.818+0000 7f927ffff700 1 -- 172.21.15.72:0/1873037724 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284011830 con 0x7f928809d6f0 2023-10-03T10:16:21.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.818+0000 7f927ffff700 1 -- 172.21.15.72:0/1873037724 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9284011990 con 0x7f928809d6f0 2023-10-03T10:16:21.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.818+0000 7f927ffff700 1 -- 172.21.15.72:0/1873037724 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284011d20 con 0x7f928809d6f0 2023-10-03T10:16:21.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.818+0000 7f928f67c700 1 -- 172.21.15.72:0/1873037724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f928809d6f0 msgr2=0x7f928809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.818+0000 7f928f67c700 1 --2- 172.21.15.72:0/1873037724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f928809d6f0 0x7f928809dac0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f9284009840 tx=0x7f9284009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:21.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.818+0000 7f928f67c700 1 -- 172.21.15.72:0/1873037724 shutdown_connections 2023-10-03T10:16:21.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.818+0000 7f928f67c700 1 --2- 172.21.15.72:0/1873037724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f928809d6f0 0x7f928809dac0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.818+0000 7f928f67c700 1 --2- 172.21.15.72:0/1873037724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928809e000 0x7f9288130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.818+0000 7f928f67c700 1 -- 172.21.15.72:0/1873037724 >> 172.21.15.72:0/1873037724 conn(0x7f9288066f50 msgr2=0x7f928809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.818+0000 7f928f67c700 1 -- 172.21.15.72:0/1873037724 shutdown_connections 2023-10-03T10:16:21.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.818+0000 7f928f67c700 1 -- 172.21.15.72:0/1873037724 wait complete. 2023-10-03T10:16:21.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.819+0000 7f928f67c700 1 Processor -- start 2023-10-03T10:16:21.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.819+0000 7f928f67c700 1 -- start start 2023-10-03T10:16:21.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928f67c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f928809d6f0 0x7f928811e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928f67c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928809e000 0x7f928811e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928f67c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928809e410 0x7f928811eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:21.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928f67c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9288120580 con 0x7f928809d6f0 2023-10-03T10:16:21.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928f67c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9288121bc0 con 0x7f928809e410 2023-10-03T10:16:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928f67c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9288120260 con 0x7f928809e000 2023-10-03T10:16:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928cc17700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928809e000 0x7f928811e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928cc17700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928809e000 0x7f928811e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41604/0 (socket says 172.21.15.72:41604) 2023-10-03T10:16:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928cc17700 1 -- 172.21.15.72:0/891766383 learned_addr learned my addr 172.21.15.72:0/891766383 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928dc19700 1 --2- 172.21.15.72:0/891766383 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928809e410 0x7f928811eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928d418700 1 --2- 172.21.15.72:0/891766383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f928809d6f0 0x7f928811e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928cc17700 1 -- 172.21.15.72:0/891766383 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928809e410 msgr2=0x7f928811eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928cc17700 1 --2- 172.21.15.72:0/891766383 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928809e410 0x7f928811eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928cc17700 1 -- 172.21.15.72:0/891766383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f928809d6f0 msgr2=0x7f928811e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928cc17700 1 --2- 172.21.15.72:0/891766383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f928809d6f0 0x7f928811e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928cc17700 1 -- 172.21.15.72:0/891766383 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927800da00 con 0x7f928809e000 2023-10-03T10:16:21.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f928cc17700 1 --2- 172.21.15.72:0/891766383 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928809e000 0x7f928811e5e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9278012fc0 tx=0x7f92780103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:21.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f927dffb700 1 -- 172.21.15.72:0/891766383 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278010dc0 con 0x7f928809e000 2023-10-03T10:16:21.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.820+0000 7f927dffb700 1 -- 172.21.15.72:0/891766383 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9278013040 con 0x7f928809e000 2023-10-03T10:16:21.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.821+0000 7f928f67c700 1 -- 172.21.15.72:0/891766383 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92840094a0 con 0x7f928809e000 2023-10-03T10:16:21.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.821+0000 7f927dffb700 1 -- 172.21.15.72:0/891766383 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780186a0 con 0x7f928809e000 2023-10-03T10:16:21.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.821+0000 7f928f67c700 1 -- 172.21.15.72:0/891766383 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9288121620 con 0x7f928809e000 2023-10-03T10:16:21.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.821+0000 7f927dffb700 1 -- 172.21.15.72:0/891766383 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9278018800 con 0x7f928809e000 2023-10-03T10:16:21.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.822+0000 7f927dffb700 1 -- 172.21.15.72:0/891766383 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9278043e00 con 0x7f928809e000 2023-10-03T10:16:21.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.822+0000 7f928f67c700 1 -- 172.21.15.72:0/891766383 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9288072450 con 0x7f928809e000 2023-10-03T10:16:21.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.827+0000 7f927dffb700 1 -- 172.21.15.72:0/891766383 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9278021400 con 0x7f928809e000 2023-10-03T10:16:21.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.892+0000 7f6e12b16700 1 -- 172.21.15.72:0/2903198867 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6e0c06c360 con 0x7f6e0c06b080 2023-10-03T10:16:21.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.893+0000 7f6e097fa700 1 -- 172.21.15.72:0/2903198867 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6df8011360 con 0x7f6e0c06b080 2023-10-03T10:16:21.894 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:21.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.895+0000 7f6e12b16700 1 -- 172.21.15.72:0/2903198867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e0c06b080 msgr2=0x7f6e0c1c6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.895+0000 7f6e12b16700 1 --2- 172.21.15.72:0/2903198867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e0c06b080 0x7f6e0c1c6490 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6df800c750 tx=0x7f6df800ca60 comp rx=0 tx=0).stop 2023-10-03T10:16:21.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.895+0000 7f6e12b16700 1 -- 172.21.15.72:0/2903198867 shutdown_connections 2023-10-03T10:16:21.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.895+0000 7f6e12b16700 1 --2- 172.21.15.72:0/2903198867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c131d10 0x7f6e0c1c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.895+0000 7f6e12b16700 1 --2- 172.21.15.72:0/2903198867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c06a770 0x7f6e0c1c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.895+0000 7f6e12b16700 1 --2- 172.21.15.72:0/2903198867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6e0c06b080 0x7f6e0c1c6490 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.895+0000 7f6e12b16700 1 -- 172.21.15.72:0/2903198867 >> 172.21.15.72:0/2903198867 conn(0x7f6e0c066f50 msgr2=0x7f6e0c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.895+0000 7f6e12b16700 1 -- 172.21.15.72:0/2903198867 shutdown_connections 2023-10-03T10:16:21.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.895+0000 7f6e12b16700 1 -- 172.21.15.72:0/2903198867 wait complete. 2023-10-03T10:16:21.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.917+0000 7f0a08f0c700 1 -- 172.21.15.72:0/1605178489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0a04074ea0 con 0x7f0a041337f0 2023-10-03T10:16:21.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.917+0000 7f09f2ffd700 1 -- 172.21.15.72:0/1605178489 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f09f801b820 con 0x7f0a041337f0 2023-10-03T10:16:21.918 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:21.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.920+0000 7f0a08f0c700 1 -- 172.21.15.72:0/1605178489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a041337f0 msgr2=0x7f0a0409ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.920+0000 7f0a08f0c700 1 --2- 172.21.15.72:0/1605178489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a041337f0 0x7f0a0409ce40 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f09f800e8e0 tx=0x7f09f800ebf0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.920+0000 7f0a08f0c700 1 -- 172.21.15.72:0/1605178489 shutdown_connections 2023-10-03T10:16:21.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.920+0000 7f0a08f0c700 1 --2- 172.21.15.72:0/1605178489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a04138dc0 0x7f0a0409d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.920+0000 7f0a08f0c700 1 --2- 172.21.15.72:0/1605178489 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a04133420 0x7f0a0409c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.920+0000 7f0a08f0c700 1 --2- 172.21.15.72:0/1605178489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a041337f0 0x7f0a0409ce40 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.920+0000 7f0a08f0c700 1 -- 172.21.15.72:0/1605178489 >> 172.21.15.72:0/1605178489 conn(0x7f0a040a4210 msgr2=0x7f0a040a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.920+0000 7f0a08f0c700 1 -- 172.21.15.72:0/1605178489 shutdown_connections 2023-10-03T10:16:21.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:21.920+0000 7f0a08f0c700 1 -- 172.21.15.72:0/1605178489 wait complete. 2023-10-03T10:16:21.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.040+0000 7f928f67c700 1 -- 172.21.15.72:0/891766383 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9288121410 con 0x7f928809e000 2023-10-03T10:16:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.041+0000 7f927dffb700 1 -- 172.21.15.72:0/891766383 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9278028300 con 0x7f928809e000 2023-10-03T10:16:22.041 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.043+0000 7f928f67c700 1 -- 172.21.15.72:0/891766383 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928809e000 msgr2=0x7f928811e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.043+0000 7f928f67c700 1 --2- 172.21.15.72:0/891766383 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928809e000 0x7f928811e5e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9278012fc0 tx=0x7f92780103a0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.043+0000 7f928f67c700 1 -- 172.21.15.72:0/891766383 shutdown_connections 2023-10-03T10:16:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.043+0000 7f928f67c700 1 --2- 172.21.15.72:0/891766383 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f928809d6f0 0x7f928811e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.043+0000 7f928f67c700 1 --2- 172.21.15.72:0/891766383 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f928809e410 0x7f928811eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.043+0000 7f928f67c700 1 --2- 172.21.15.72:0/891766383 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f928809e000 0x7f928811e5e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.043+0000 7f928f67c700 1 -- 172.21.15.72:0/891766383 >> 172.21.15.72:0/891766383 conn(0x7f9288066f50 msgr2=0x7f928806efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.043+0000 7f928f67c700 1 -- 172.21.15.72:0/891766383 shutdown_connections 2023-10-03T10:16:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.043+0000 7f928f67c700 1 -- 172.21.15.72:0/891766383 wait complete. 2023-10-03T10:16:22.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:22.657 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:22.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.781+0000 7f4ddb9f6700 1 Processor -- start 2023-10-03T10:16:22.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.781+0000 7f4ddb9f6700 1 -- start start 2023-10-03T10:16:22.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.781+0000 7f4ddb9f6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd409d6f0 0x7f4dd409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.781+0000 7f4ddb9f6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4dd409e000 0x7f4dd41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4ddb9f6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4dd409e410 0x7f4dd4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4ddb9f6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd406b460 con 0x7f4dd409e000 2023-10-03T10:16:22.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4ddb9f6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd409b120 con 0x7f4dd409d6f0 2023-10-03T10:16:22.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4ddb9f6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd409a7e0 con 0x7f4dd409e410 2023-10-03T10:16:22.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dd8f91700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4dd409e000 0x7f4dd41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dd9f93700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4dd409e410 0x7f4dd4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dd9792700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd409d6f0 0x7f4dd409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dd8f91700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4dd409e000 0x7f4dd41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37974/0 (socket says 172.21.15.72:37974) 2023-10-03T10:16:22.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dd9792700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd409d6f0 0x7f4dd409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41068/0 (socket says 172.21.15.72:41068) 2023-10-03T10:16:22.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dd9f93700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4dd409e410 0x7f4dd4133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41606/0 (socket says 172.21.15.72:41606) 2023-10-03T10:16:22.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dd8f91700 1 -- 172.21.15.72:0/2073137714 learned_addr learned my addr 172.21.15.72:0/2073137714 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:22.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dd9f93700 1 -- 172.21.15.72:0/2073137714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd409d6f0 msgr2=0x7f4dd409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:22.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dd9f93700 1 --2- 172.21.15.72:0/2073137714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd409d6f0 0x7f4dd409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dd9f93700 1 -- 172.21.15.72:0/2073137714 >> v2:172.21.15.72:3300/0 conn(0x7f4dd409e000 msgr2=0x7f4dd41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:22.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dd9f93700 1 --2- 172.21.15.72:0/2073137714 >> v2:172.21.15.72:3300/0 conn(0x7f4dd409e000 0x7f4dd41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dd9f93700 1 -- 172.21.15.72:0/2073137714 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd409a500 con 0x7f4dd409e410 2023-10-03T10:16:22.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dd8f91700 1 --2- 172.21.15.72:0/2073137714 >> v2:172.21.15.72:3300/0 conn(0x7f4dd409e000 0x7f4dd41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:22.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dd9792700 1 --2- 172.21.15.72:0/2073137714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd409d6f0 0x7f4dd409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:22.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dd9f93700 1 --2- 172.21.15.72:0/2073137714 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4dd409e410 0x7f4dd4133f30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009dc0 tx=0x7f4dcc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9611ed948e0094f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dcbfff700 1 -- 172.21.15.72:0/2073137714 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00e070 con 0x7f4dd409e410 2023-10-03T10:16:22.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dcbfff700 1 -- 172.21.15.72:0/2073137714 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc00bae0 con 0x7f4dd409e410 2023-10-03T10:16:22.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.782+0000 7f4dcbfff700 1 -- 172.21.15.72:0/2073137714 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00be90 con 0x7f4dd409e410 2023-10-03T10:16:22.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.783+0000 7f4ddb9f6700 1 -- 172.21.15.72:0/2073137714 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4dd409e410 msgr2=0x7f4dd4133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.783+0000 7f4ddb9f6700 1 --2- 172.21.15.72:0/2073137714 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4dd409e410 0x7f4dd4133f30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009dc0 tx=0x7f4dcc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:22.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.783+0000 7f4ddb9f6700 1 -- 172.21.15.72:0/2073137714 shutdown_connections 2023-10-03T10:16:22.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.783+0000 7f4ddb9f6700 1 --2- 172.21.15.72:0/2073137714 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4dd409e410 0x7f4dd4133f30 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.783+0000 7f4ddb9f6700 1 --2- 172.21.15.72:0/2073137714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd409d6f0 0x7f4dd409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.783+0000 7f4ddb9f6700 1 --2- 172.21.15.72:0/2073137714 >> v2:172.21.15.72:3300/0 conn(0x7f4dd409e000 0x7f4dd41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.783+0000 7f4ddb9f6700 1 -- 172.21.15.72:0/2073137714 >> 172.21.15.72:0/2073137714 conn(0x7f4dd4066f50 msgr2=0x7f4dd409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.783+0000 7f4ddb9f6700 1 -- 172.21.15.72:0/2073137714 shutdown_connections 2023-10-03T10:16:22.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.783+0000 7f4ddb9f6700 1 -- 172.21.15.72:0/2073137714 wait complete. 2023-10-03T10:16:22.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.784+0000 7f4ddb9f6700 1 Processor -- start 2023-10-03T10:16:22.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.784+0000 7f4ddb9f6700 1 -- start start 2023-10-03T10:16:22.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.784+0000 7f4ddb9f6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dd409d6f0 0x7f4dd41c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.784+0000 7f4ddb9f6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd409e000 0x7f4dd41c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.784+0000 7f4ddb9f6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4dd409e410 0x7f4dd41c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.784+0000 7f4ddb9f6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd41a6420 con 0x7f4dd409d6f0 2023-10-03T10:16:22.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.784+0000 7f4ddb9f6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd41a7c10 con 0x7f4dd409e000 2023-10-03T10:16:22.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.784+0000 7f4ddb9f6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd409c710 con 0x7f4dd409e410 2023-10-03T10:16:22.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.784+0000 7f4dd9792700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dd409d6f0 0x7f4dd41c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.784+0000 7f4dd8f91700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd409e000 0x7f4dd41c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.784+0000 7f4dd9792700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dd409d6f0 0x7f4dd41c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:37980/0 (socket says 172.21.15.72:37980) 2023-10-03T10:16:22.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.784+0000 7f4dd9792700 1 -- 172.21.15.72:0/1638895390 learned_addr learned my addr 172.21.15.72:0/1638895390 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:22.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.784+0000 7f4dd9f93700 1 --2- 172.21.15.72:0/1638895390 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4dd409e410 0x7f4dd41c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.785+0000 7f4dd8f91700 1 -- 172.21.15.72:0/1638895390 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4dd409e410 msgr2=0x7f4dd41c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.785+0000 7f4dd8f91700 1 --2- 172.21.15.72:0/1638895390 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4dd409e410 0x7f4dd41c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.785+0000 7f4dd8f91700 1 -- 172.21.15.72:0/1638895390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dd409d6f0 msgr2=0x7f4dd41c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.785+0000 7f4dd8f91700 1 --2- 172.21.15.72:0/1638895390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dd409d6f0 0x7f4dd41c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.785+0000 7f4dd8f91700 1 -- 172.21.15.72:0/1638895390 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40094a0 con 0x7f4dd409e000 2023-10-03T10:16:22.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.785+0000 7f4dd9792700 1 --2- 172.21.15.72:0/1638895390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dd409d6f0 0x7f4dd41c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:22.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.785+0000 7f4dd8f91700 1 --2- 172.21.15.72:0/1638895390 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd409e000 0x7f4dd41c84f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4dd406e510 tx=0x7f4dd000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.785+0000 7f4dc9ffb700 1 -- 172.21.15.72:0/1638895390 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0004240 con 0x7f4dd409e000 2023-10-03T10:16:22.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.785+0000 7f4dc9ffb700 1 -- 172.21.15.72:0/1638895390 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd00043a0 con 0x7f4dd409e000 2023-10-03T10:16:22.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.785+0000 7f4dc9ffb700 1 -- 172.21.15.72:0/1638895390 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd00036a0 con 0x7f4dd409e000 2023-10-03T10:16:22.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.785+0000 7f4ddb9f6700 1 -- 172.21.15.72:0/1638895390 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd0009550 con 0x7f4dd409e000 2023-10-03T10:16:22.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.785+0000 7f4ddb9f6700 1 -- 172.21.15.72:0/1638895390 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dcc009a70 con 0x7f4dd409e000 2023-10-03T10:16:22.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.786+0000 7f4dc9ffb700 1 -- 172.21.15.72:0/1638895390 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4dd0003800 con 0x7f4dd409e000 2023-10-03T10:16:22.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.786+0000 7f4dc9ffb700 1 -- 172.21.15.72:0/1638895390 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4dd003fae0 con 0x7f4dd409e000 2023-10-03T10:16:22.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.786+0000 7f4ddb9f6700 1 -- 172.21.15.72:0/1638895390 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd4074ea0 con 0x7f4dd409e000 2023-10-03T10:16:22.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.791+0000 7f4dc9ffb700 1 -- 172.21.15.72:0/1638895390 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4dd0013470 con 0x7f4dd409e000 2023-10-03T10:16:22.909 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:22.933 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:22.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.981+0000 7f4ddb9f6700 1 -- 172.21.15.72:0/1638895390 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4dd41a6f10 con 0x7f4dd409e000 2023-10-03T10:16:22.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.981+0000 7f4dc9ffb700 1 -- 172.21.15.72:0/1638895390 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4dd001bba0 con 0x7f4dd409e000 2023-10-03T10:16:22.982 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.983+0000 7f4ddb9f6700 1 -- 172.21.15.72:0/1638895390 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd409e000 msgr2=0x7f4dd41c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.983+0000 7f4ddb9f6700 1 --2- 172.21.15.72:0/1638895390 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd409e000 0x7f4dd41c84f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4dd406e510 tx=0x7f4dd000ec80 comp rx=0 tx=0).stop 2023-10-03T10:16:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.983+0000 7f4ddb9f6700 1 -- 172.21.15.72:0/1638895390 shutdown_connections 2023-10-03T10:16:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.983+0000 7f4ddb9f6700 1 --2- 172.21.15.72:0/1638895390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4dd409d6f0 0x7f4dd41c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.983+0000 7f4ddb9f6700 1 --2- 172.21.15.72:0/1638895390 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4dd409e410 0x7f4dd41c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.983+0000 7f4ddb9f6700 1 --2- 172.21.15.72:0/1638895390 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4dd409e000 0x7f4dd41c84f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.983+0000 7f4ddb9f6700 1 -- 172.21.15.72:0/1638895390 >> 172.21.15.72:0/1638895390 conn(0x7f4dd4066f50 msgr2=0x7f4dd41bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.983+0000 7f4ddb9f6700 1 -- 172.21.15.72:0/1638895390 shutdown_connections 2023-10-03T10:16:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:22.983+0000 7f4ddb9f6700 1 -- 172.21.15.72:0/1638895390 wait complete. 2023-10-03T10:16:22.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.037+0000 7fb820591700 1 Processor -- start 2023-10-03T10:16:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.037+0000 7fb820591700 1 -- start start 2023-10-03T10:16:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.038+0000 7fb820591700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8180a0a30 0x7fb8180a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.038+0000 7fb820591700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb818138d80 0x7fb81813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.038+0000 7fb820591700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8180a2a70 con 0x7fb81809d630 2023-10-03T10:16:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.038+0000 7fb820591700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180a01d0 con 0x7fb8180a0a30 2023-10-03T10:16:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.038+0000 7fb820591700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb81809e2b0 con 0x7fb818138d80 2023-10-03T10:16:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.038+0000 7fb81e32d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8180a0a30 0x7fb8180a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.038+0000 7fb81eb2e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb818138d80 0x7fb81813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.038+0000 7fb81e32d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8180a0a30 0x7fb8180a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41084/0 (socket says 172.21.15.72:41084) 2023-10-03T10:16:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.038+0000 7fb81eb2e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb818138d80 0x7fb81813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41616/0 (socket says 172.21.15.72:41616) 2023-10-03T10:16:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.038+0000 7fb81e32d700 1 -- 172.21.15.72:0/1386315581 learned_addr learned my addr 172.21.15.72:0/1386315581 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.038+0000 7fb81db2c700 1 --1- 172.21.15.72:0/1386315581 >> v1:172.21.15.72:6789/0 conn(0x7fb81809d630 0x7fb8180a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56006/0 (socket says 172.21.15.72:56006) 2023-10-03T10:16:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.039+0000 7fb81eb2e700 1 -- 172.21.15.72:0/1386315581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8180a0a30 msgr2=0x7fb8180a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.039+0000 7fb81eb2e700 1 --2- 172.21.15.72:0/1386315581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8180a0a30 0x7fb8180a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.039+0000 7fb81eb2e700 1 -- 172.21.15.72:0/1386315581 >> v1:172.21.15.72:6789/0 conn(0x7fb81809d630 legacy=0x7fb8180a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.039+0000 7fb81eb2e700 1 -- 172.21.15.72:0/1386315581 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81809dc50 con 0x7fb818138d80 2023-10-03T10:16:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.039+0000 7fb81d32b700 1 -- 172.21.15.72:0/1386315581 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449632951 0 0) 0x7fb8180a2a70 con 0x7fb81809d630 2023-10-03T10:16:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.039+0000 7fb81e32d700 1 --2- 172.21.15.72:0/1386315581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8180a0a30 0x7fb8180a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.039+0000 7fb81eb2e700 1 --2- 172.21.15.72:0/1386315581 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb818138d80 0x7fb81813b160 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb810009dc0 tx=0x7fb81000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f71fbca82cba91d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.039+0000 7fb81d32b700 1 -- 172.21.15.72:0/1386315581 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81000e070 con 0x7fb818138d80 2023-10-03T10:16:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.039+0000 7fb81d32b700 1 -- 172.21.15.72:0/1386315581 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81000bb20 con 0x7fb818138d80 2023-10-03T10:16:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.039+0000 7fb81d32b700 1 -- 172.21.15.72:0/1386315581 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810012430 con 0x7fb818138d80 2023-10-03T10:16:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.040+0000 7fb820591700 1 -- 172.21.15.72:0/1386315581 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb818138d80 msgr2=0x7fb81813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.040+0000 7fb820591700 1 --2- 172.21.15.72:0/1386315581 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb818138d80 0x7fb81813b160 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb810009dc0 tx=0x7fb81000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.040+0000 7fb820591700 1 -- 172.21.15.72:0/1386315581 shutdown_connections 2023-10-03T10:16:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.040+0000 7fb820591700 1 --2- 172.21.15.72:0/1386315581 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb818138d80 0x7fb81813b160 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.040+0000 7fb820591700 1 --2- 172.21.15.72:0/1386315581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8180a0a30 0x7fb8180a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.040+0000 7fb820591700 1 -- 172.21.15.72:0/1386315581 >> 172.21.15.72:0/1386315581 conn(0x7fb8180a3050 msgr2=0x7fb8180a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.040+0000 7fb820591700 1 -- 172.21.15.72:0/1386315581 shutdown_connections 2023-10-03T10:16:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.040+0000 7fb820591700 1 -- 172.21.15.72:0/1386315581 wait complete. 2023-10-03T10:16:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb820591700 1 Processor -- start 2023-10-03T10:16:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb820591700 1 -- start start 2023-10-03T10:16:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb820591700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb81809d630 0x7fb8181337f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb820591700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb8180a0a30 0x7fb818133d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb820591700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb818138d80 0x7fb818134270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb820591700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8181365c0 con 0x7fb818138d80 2023-10-03T10:16:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb820591700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180a4a40 con 0x7fb81809d630 2023-10-03T10:16:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb820591700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb818135bd0 con 0x7fb8180a0a30 2023-10-03T10:16:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb81db2c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb8180a0a30 0x7fb818133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb81eb2e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb818138d80 0x7fb818134270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb81e32d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb81809d630 0x7fb8181337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb81db2c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb8180a0a30 0x7fb818133d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41632/0 (socket says 172.21.15.72:41632) 2023-10-03T10:16:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb81db2c700 1 -- 172.21.15.72:0/2005408578 learned_addr learned my addr 172.21.15.72:0/2005408578 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb81eb2e700 1 -- 172.21.15.72:0/2005408578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb8180a0a30 msgr2=0x7fb818133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb81eb2e700 1 --2- 172.21.15.72:0/2005408578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb8180a0a30 0x7fb818133d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb81eb2e700 1 -- 172.21.15.72:0/2005408578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb81809d630 msgr2=0x7fb8181337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb81eb2e700 1 --2- 172.21.15.72:0/2005408578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb81809d630 0x7fb8181337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb81eb2e700 1 -- 172.21.15.72:0/2005408578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb814009550 con 0x7fb818138d80 2023-10-03T10:16:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb81e32d700 1 --2- 172.21.15.72:0/2005408578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb81809d630 0x7fb8181337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.041+0000 7fb81db2c700 1 --2- 172.21.15.72:0/2005408578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb8180a0a30 0x7fb818133d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.042+0000 7fb81eb2e700 1 --2- 172.21.15.72:0/2005408578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb818138d80 0x7fb818134270 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fb810016000 tx=0x7fb810004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.042+0000 7fb80effd700 1 -- 172.21.15.72:0/2005408578 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810012430 con 0x7fb818138d80 2023-10-03T10:16:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.042+0000 7fb80effd700 1 -- 172.21.15.72:0/2005408578 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb810020070 con 0x7fb818138d80 2023-10-03T10:16:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.042+0000 7fb80effd700 1 -- 172.21.15.72:0/2005408578 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810004280 con 0x7fb818138d80 2023-10-03T10:16:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.042+0000 7fb820591700 1 -- 172.21.15.72:0/2005408578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb810009a70 con 0x7fb818138d80 2023-10-03T10:16:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.042+0000 7fb820591700 1 -- 172.21.15.72:0/2005408578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8180a0460 con 0x7fb818138d80 2023-10-03T10:16:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.043+0000 7fb80effd700 1 -- 172.21.15.72:0/2005408578 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8100043e0 con 0x7fb818138d80 2023-10-03T10:16:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.043+0000 7fb80effd700 1 -- 172.21.15.72:0/2005408578 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb810022070 con 0x7fb818138d80 2023-10-03T10:16:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.043+0000 7fb820591700 1 -- 172.21.15.72:0/2005408578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb818136b30 con 0x7fb818138d80 2023-10-03T10:16:23.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.047+0000 7fb80effd700 1 -- 172.21.15.72:0/2005408578 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb81002c080 con 0x7fb818138d80 2023-10-03T10:16:23.056 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:23.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.081+0000 7f59c70c2700 1 Processor -- start 2023-10-03T10:16:23.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.081+0000 7f59c70c2700 1 -- start start 2023-10-03T10:16:23.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59c70c2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59c009d6f0 0x7f59c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59c70c2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59c009e000 0x7f59c01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59c70c2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c009b120 con 0x7f59c009e410 2023-10-03T10:16:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59c70c2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c006b460 con 0x7f59c009d6f0 2023-10-03T10:16:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59c70c2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59c009a7e0 con 0x7f59c009e000 2023-10-03T10:16:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59c4e5e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59c009d6f0 0x7f59c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59c565f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f59c009e410 0x7f59c0133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56022/0 (socket says 172.21.15.72:56022) 2023-10-03T10:16:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59c565f700 1 -- 172.21.15.72:0/2841819331 learned_addr learned my addr 172.21.15.72:0/2841819331 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59c4e5e700 1 -- 172.21.15.72:0/2841819331 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59c009e000 msgr2=0x7f59c01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59c4e5e700 1 --2- 172.21.15.72:0/2841819331 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59c009e000 0x7f59c01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59c4e5e700 1 -- 172.21.15.72:0/2841819331 >> v1:172.21.15.72:6789/0 conn(0x7f59c009e410 legacy=0x7f59c0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59c4e5e700 1 -- 172.21.15.72:0/2841819331 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c009a500 con 0x7f59c009d6f0 2023-10-03T10:16:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59bf7fe700 1 -- 172.21.15.72:0/2841819331 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014922372 0 0) 0x7f59c009b120 con 0x7f59c009e410 2023-10-03T10:16:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59c4e5e700 1 --2- 172.21.15.72:0/2841819331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59c009d6f0 0x7f59c009dac0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009840 tx=0x7f59b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20af7d5d4018dcd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59bf7fe700 1 -- 172.21.15.72:0/2841819331 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4011830 con 0x7f59c009d6f0 2023-10-03T10:16:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59bf7fe700 1 -- 172.21.15.72:0/2841819331 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b4011990 con 0x7f59c009d6f0 2023-10-03T10:16:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.082+0000 7f59bf7fe700 1 -- 172.21.15.72:0/2841819331 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4011d20 con 0x7f59c009d6f0 2023-10-03T10:16:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.083+0000 7f59c70c2700 1 -- 172.21.15.72:0/2841819331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59c009d6f0 msgr2=0x7f59c009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.083+0000 7f59c70c2700 1 --2- 172.21.15.72:0/2841819331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59c009d6f0 0x7f59c009dac0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009840 tx=0x7f59b4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.083+0000 7f59c70c2700 1 -- 172.21.15.72:0/2841819331 shutdown_connections 2023-10-03T10:16:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.083+0000 7f59c70c2700 1 --2- 172.21.15.72:0/2841819331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59c009d6f0 0x7f59c009dac0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.083+0000 7f59c70c2700 1 --2- 172.21.15.72:0/2841819331 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59c009e000 0x7f59c01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.083+0000 7f59c70c2700 1 -- 172.21.15.72:0/2841819331 >> 172.21.15.72:0/2841819331 conn(0x7f59c0066f50 msgr2=0x7f59c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.084+0000 7f59c70c2700 1 -- 172.21.15.72:0/2841819331 shutdown_connections 2023-10-03T10:16:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.084+0000 7f59c70c2700 1 -- 172.21.15.72:0/2841819331 wait complete. 2023-10-03T10:16:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.084+0000 7f59c70c2700 1 Processor -- start 2023-10-03T10:16:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.084+0000 7f59c70c2700 1 -- start start 2023-10-03T10:16:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.085+0000 7f59c70c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59c009d6f0 0x7f59c01c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.085+0000 7f59c70c2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59c009e000 0x7f59c01c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.085+0000 7f59c70c2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59c009e410 0x7f59c01c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.085+0000 7f59c70c2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c01a6ad0 con 0x7f59c009e000 2023-10-03T10:16:23.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.085+0000 7f59c70c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c00a2f60 con 0x7f59c009d6f0 2023-10-03T10:16:23.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.085+0000 7f59c70c2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59c009c710 con 0x7f59c009e410 2023-10-03T10:16:23.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.085+0000 7f59c565f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59c009e410 0x7f59c01c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.085+0000 7f59c4e5e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59c009d6f0 0x7f59c01c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.085+0000 7f59c565f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59c009e410 0x7f59c01c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41644/0 (socket says 172.21.15.72:41644) 2023-10-03T10:16:23.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.085+0000 7f59c4e5e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59c009d6f0 0x7f59c01c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41108/0 (socket says 172.21.15.72:41108) 2023-10-03T10:16:23.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.085+0000 7f59c565f700 1 -- 172.21.15.72:0/1426520903 learned_addr learned my addr 172.21.15.72:0/1426520903 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:23.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.085+0000 7f59bffff700 1 --2- 172.21.15.72:0/1426520903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59c009e000 0x7f59c01c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.086+0000 7f59bffff700 1 -- 172.21.15.72:0/1426520903 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59c009e410 msgr2=0x7f59c01c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.086+0000 7f59bffff700 1 --2- 172.21.15.72:0/1426520903 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59c009e410 0x7f59c01c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.086+0000 7f59bffff700 1 -- 172.21.15.72:0/1426520903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59c009d6f0 msgr2=0x7f59c01c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.086+0000 7f59bffff700 1 --2- 172.21.15.72:0/1426520903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59c009d6f0 0x7f59c01c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.086+0000 7f59bffff700 1 -- 172.21.15.72:0/1426520903 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b40094a0 con 0x7f59c009e000 2023-10-03T10:16:23.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.086+0000 7f59c565f700 1 --2- 172.21.15.72:0/1426520903 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59c009e410 0x7f59c01c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.086+0000 7f59c4e5e700 1 --2- 172.21.15.72:0/1426520903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59c009d6f0 0x7f59c01c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.086+0000 7f59bffff700 1 --2- 172.21.15.72:0/1426520903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59c009e000 0x7f59c01c85f0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00b450 tx=0x7f59ac00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.086+0000 7f59bd7fa700 1 -- 172.21.15.72:0/1426520903 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac011830 con 0x7f59c009e000 2023-10-03T10:16:23.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.086+0000 7f59bd7fa700 1 -- 172.21.15.72:0/1426520903 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac011990 con 0x7f59c009e000 2023-10-03T10:16:23.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.086+0000 7f59c70c2700 1 -- 172.21.15.72:0/1426520903 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c01a80b0 con 0x7f59c009e000 2023-10-03T10:16:23.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.086+0000 7f59bd7fa700 1 -- 172.21.15.72:0/1426520903 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac011d40 con 0x7f59c009e000 2023-10-03T10:16:23.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.086+0000 7f59c70c2700 1 -- 172.21.15.72:0/1426520903 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c01a8b20 con 0x7f59c009e000 2023-10-03T10:16:23.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.087+0000 7f59c70c2700 1 -- 172.21.15.72:0/1426520903 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c01a7d30 con 0x7f59c009e000 2023-10-03T10:16:23.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.087+0000 7f59bd7fa700 1 -- 172.21.15.72:0/1426520903 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f59ac01a400 con 0x7f59c009e000 2023-10-03T10:16:23.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.087+0000 7f59bd7fa700 1 -- 172.21.15.72:0/1426520903 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f59ac03f4f0 con 0x7f59c009e000 2023-10-03T10:16:23.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.096+0000 7f59bd7fa700 1 -- 172.21.15.72:0/1426520903 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59ac009280 con 0x7f59c009e000 2023-10-03T10:16:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.183+0000 7fb987c12700 1 Processor -- start 2023-10-03T10:16:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.184+0000 7fb987c12700 1 -- start start 2023-10-03T10:16:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.184+0000 7fb987c12700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9800a0a30 0x7fb9800a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.184+0000 7fb987c12700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb980138d80 0x7fb98013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.184+0000 7fb987c12700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9800a2a70 con 0x7fb98009d630 2023-10-03T10:16:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.184+0000 7fb987c12700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9800a01d0 con 0x7fb9800a0a30 2023-10-03T10:16:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.184+0000 7fb987c12700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb98009e2b0 con 0x7fb980138d80 2023-10-03T10:16:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.184+0000 7fb9851ad700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb98009d630 0x7fb9800a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56030/0 (socket says 172.21.15.72:56030) 2023-10-03T10:16:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.184+0000 7fb9859ae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9800a0a30 0x7fb9800a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.184+0000 7fb9851ad700 1 -- 172.21.15.72:0/3045533431 learned_addr learned my addr 172.21.15.72:0/3045533431 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:23.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.184+0000 7fb9861af700 1 --2- 172.21.15.72:0/3045533431 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb980138d80 0x7fb98013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.185+0000 7fb9849ac700 1 -- 172.21.15.72:0/3045533431 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659141879 0 0) 0x7fb9800a2a70 con 0x7fb98009d630 2023-10-03T10:16:23.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.185+0000 7fb9849ac700 1 -- 172.21.15.72:0/3045533431 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb96c0035b0 con 0x7fb98009d630 2023-10-03T10:16:23.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.185+0000 7fb9859ae700 1 -- 172.21.15.72:0/3045533431 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb980138d80 msgr2=0x7fb98013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.185+0000 7fb9859ae700 1 --2- 172.21.15.72:0/3045533431 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb980138d80 0x7fb98013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.185+0000 7fb9859ae700 1 -- 172.21.15.72:0/3045533431 >> v1:172.21.15.72:6789/0 conn(0x7fb98009d630 legacy=0x7fb9800a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.185+0000 7fb9859ae700 1 -- 172.21.15.72:0/3045533431 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98009dc50 con 0x7fb9800a0a30 2023-10-03T10:16:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.185+0000 7fb9861af700 1 --2- 172.21.15.72:0/3045533431 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb980138d80 0x7fb98013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.185+0000 7fb9859ae700 1 --2- 172.21.15.72:0/3045533431 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9800a0a30 0x7fb9800a0e00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009870 tx=0x7fb97c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1708cc39290cce67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.185+0000 7fb9849ac700 1 -- 172.21.15.72:0/3045533431 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c011830 con 0x7fb9800a0a30 2023-10-03T10:16:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.185+0000 7fb9849ac700 1 -- 172.21.15.72:0/3045533431 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97c011990 con 0x7fb9800a0a30 2023-10-03T10:16:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.185+0000 7fb9849ac700 1 -- 172.21.15.72:0/3045533431 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c011d20 con 0x7fb9800a0a30 2023-10-03T10:16:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.185+0000 7fb987c12700 1 -- 172.21.15.72:0/3045533431 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9800a0a30 msgr2=0x7fb9800a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.185+0000 7fb987c12700 1 --2- 172.21.15.72:0/3045533431 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9800a0a30 0x7fb9800a0e00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009870 tx=0x7fb97c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.186+0000 7fb987c12700 1 -- 172.21.15.72:0/3045533431 shutdown_connections 2023-10-03T10:16:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.186+0000 7fb987c12700 1 --2- 172.21.15.72:0/3045533431 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb980138d80 0x7fb98013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.186+0000 7fb987c12700 1 --2- 172.21.15.72:0/3045533431 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9800a0a30 0x7fb9800a0e00 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.186+0000 7fb987c12700 1 -- 172.21.15.72:0/3045533431 >> 172.21.15.72:0/3045533431 conn(0x7fb9800a3050 msgr2=0x7fb9800a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.186+0000 7fb987c12700 1 -- 172.21.15.72:0/3045533431 shutdown_connections 2023-10-03T10:16:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.186+0000 7fb987c12700 1 -- 172.21.15.72:0/3045533431 wait complete. 2023-10-03T10:16:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb987c12700 1 Processor -- start 2023-10-03T10:16:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb987c12700 1 -- start start 2023-10-03T10:16:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb987c12700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb98009d630 0x7fb980133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb987c12700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9800a0a30 0x7fb980133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb987c12700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb980138d80 0x7fb9801341e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb987c12700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9801365a0 con 0x7fb980138d80 2023-10-03T10:16:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb987c12700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb980138b10 con 0x7fb9800a0a30 2023-10-03T10:16:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb987c12700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb980136f10 con 0x7fb98009d630 2023-10-03T10:16:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb9851ad700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9800a0a30 0x7fb980133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb9851ad700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9800a0a30 0x7fb980133ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41128/0 (socket says 172.21.15.72:41128) 2023-10-03T10:16:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb9851ad700 1 -- 172.21.15.72:0/1735221530 learned_addr learned my addr 172.21.15.72:0/1735221530 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb9861af700 1 --2- 172.21.15.72:0/1735221530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb980138d80 0x7fb9801341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb9859ae700 1 --2- 172.21.15.72:0/1735221530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb98009d630 0x7fb980133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb9851ad700 1 -- 172.21.15.72:0/1735221530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb98009d630 msgr2=0x7fb980133760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb9851ad700 1 --2- 172.21.15.72:0/1735221530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb98009d630 0x7fb980133760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb9851ad700 1 -- 172.21.15.72:0/1735221530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb980138d80 msgr2=0x7fb9801341e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb9851ad700 1 --2- 172.21.15.72:0/1735221530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb980138d80 0x7fb9801341e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.187+0000 7fb9851ad700 1 -- 172.21.15.72:0/1735221530 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb978009a70 con 0x7fb9800a0a30 2023-10-03T10:16:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.188+0000 7fb9851ad700 1 --2- 172.21.15.72:0/1735221530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9800a0a30 0x7fb980133ca0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb97000c700 tx=0x7fb97000ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.188+0000 7fb9767fc700 1 -- 172.21.15.72:0/1735221530 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970005d70 con 0x7fb9800a0a30 2023-10-03T10:16:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.188+0000 7fb9767fc700 1 -- 172.21.15.72:0/1735221530 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9700070d0 con 0x7fb9800a0a30 2023-10-03T10:16:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.188+0000 7fb987c12700 1 -- 172.21.15.72:0/1735221530 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97c0094a0 con 0x7fb9800a0a30 2023-10-03T10:16:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.188+0000 7fb9767fc700 1 -- 172.21.15.72:0/1735221530 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970007460 con 0x7fb9800a0a30 2023-10-03T10:16:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.188+0000 7fb987c12700 1 -- 172.21.15.72:0/1735221530 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9801371f0 con 0x7fb9800a0a30 2023-10-03T10:16:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.189+0000 7fb9767fc700 1 -- 172.21.15.72:0/1735221530 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9700075c0 con 0x7fb9800a0a30 2023-10-03T10:16:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.189+0000 7fb9767fc700 1 -- 172.21.15.72:0/1735221530 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb97003eab0 con 0x7fb9800a0a30 2023-10-03T10:16:23.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.189+0000 7fb987c12700 1 -- 172.21.15.72:0/1735221530 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9800747f0 con 0x7fb9800a0a30 2023-10-03T10:16:23.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.194+0000 7fb9767fc700 1 -- 172.21.15.72:0/1735221530 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb970017070 con 0x7fb9800a0a30 2023-10-03T10:16:23.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.246+0000 7fb820591700 1 -- 172.21.15.72:0/2005408578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb8180747f0 con 0x7fb818138d80 2023-10-03T10:16:23.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.246+0000 7fb80effd700 1 -- 172.21.15.72:0/2005408578 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb810007000 con 0x7fb818138d80 2023-10-03T10:16:23.247 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:23.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.248+0000 7fb820591700 1 -- 172.21.15.72:0/2005408578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb818138d80 msgr2=0x7fb818134270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.248+0000 7fb820591700 1 --2- 172.21.15.72:0/2005408578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb818138d80 0x7fb818134270 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fb810016000 tx=0x7fb810004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.249+0000 7fb820591700 1 -- 172.21.15.72:0/2005408578 shutdown_connections 2023-10-03T10:16:23.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.249+0000 7fb820591700 1 --2- 172.21.15.72:0/2005408578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb818138d80 0x7fb818134270 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.249+0000 7fb820591700 1 --2- 172.21.15.72:0/2005408578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb81809d630 0x7fb8181337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.249+0000 7fb820591700 1 --2- 172.21.15.72:0/2005408578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb8180a0a30 0x7fb818133d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.249+0000 7fb820591700 1 -- 172.21.15.72:0/2005408578 >> 172.21.15.72:0/2005408578 conn(0x7fb8180a3050 msgr2=0x7fb818139720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.249+0000 7fb820591700 1 -- 172.21.15.72:0/2005408578 shutdown_connections 2023-10-03T10:16:23.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.249+0000 7fb820591700 1 -- 172.21.15.72:0/2005408578 wait complete. 2023-10-03T10:16:23.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:23.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.290+0000 7f59c70c2700 1 -- 172.21.15.72:0/1426520903 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f59c0074ea0 con 0x7f59c009e000 2023-10-03T10:16:23.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.290+0000 7f59bd7fa700 1 -- 172.21.15.72:0/1426520903 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f59ac015030 con 0x7f59c009e000 2023-10-03T10:16:23.291 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.292+0000 7f59c70c2700 1 -- 172.21.15.72:0/1426520903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59c009e000 msgr2=0x7f59c01c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.292+0000 7f59c70c2700 1 --2- 172.21.15.72:0/1426520903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59c009e000 0x7f59c01c85f0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00b450 tx=0x7f59ac00b760 comp rx=0 tx=0).stop 2023-10-03T10:16:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.292+0000 7f59c70c2700 1 -- 172.21.15.72:0/1426520903 shutdown_connections 2023-10-03T10:16:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.292+0000 7f59c70c2700 1 --2- 172.21.15.72:0/1426520903 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f59c009e410 0x7f59c01c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.292+0000 7f59c70c2700 1 --2- 172.21.15.72:0/1426520903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f59c009d6f0 0x7f59c01c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.292+0000 7f59c70c2700 1 --2- 172.21.15.72:0/1426520903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59c009e000 0x7f59c01c85f0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.292+0000 7f59c70c2700 1 -- 172.21.15.72:0/1426520903 >> 172.21.15.72:0/1426520903 conn(0x7f59c0066f50 msgr2=0x7f59c01bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.292+0000 7f59c70c2700 1 -- 172.21.15.72:0/1426520903 shutdown_connections 2023-10-03T10:16:23.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.292+0000 7f59c70c2700 1 -- 172.21.15.72:0/1426520903 wait complete. 2023-10-03T10:16:23.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:23.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.385+0000 7fb987c12700 1 -- 172.21.15.72:0/1735221530 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb980137dd0 con 0x7fb9800a0a30 2023-10-03T10:16:23.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.386+0000 7fb9767fc700 1 -- 172.21.15.72:0/1735221530 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb97000f260 con 0x7fb9800a0a30 2023-10-03T10:16:23.386 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.388+0000 7fb987c12700 1 -- 172.21.15.72:0/1735221530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9800a0a30 msgr2=0x7fb980133ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.388+0000 7fb987c12700 1 --2- 172.21.15.72:0/1735221530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9800a0a30 0x7fb980133ca0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb97000c700 tx=0x7fb97000ca10 comp rx=0 tx=0).stop 2023-10-03T10:16:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.388+0000 7fb987c12700 1 -- 172.21.15.72:0/1735221530 shutdown_connections 2023-10-03T10:16:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.388+0000 7fb987c12700 1 --2- 172.21.15.72:0/1735221530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb980138d80 0x7fb9801341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.388+0000 7fb987c12700 1 --2- 172.21.15.72:0/1735221530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb98009d630 0x7fb980133760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.388+0000 7fb987c12700 1 --2- 172.21.15.72:0/1735221530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9800a0a30 0x7fb980133ca0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.388+0000 7fb987c12700 1 -- 172.21.15.72:0/1735221530 >> 172.21.15.72:0/1735221530 conn(0x7fb9800a3050 msgr2=0x7fb98013ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.388+0000 7fb987c12700 1 -- 172.21.15.72:0/1735221530 shutdown_connections 2023-10-03T10:16:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:23.388+0000 7fb987c12700 1 -- 172.21.15.72:0/1735221530 wait complete. 2023-10-03T10:16:23.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:23.998 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:24.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.122+0000 7fa25a979700 1 Processor -- start 2023-10-03T10:16:24.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.122+0000 7fa25a979700 1 -- start start 2023-10-03T10:16:24.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa25a979700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25409d6f0 0x7fa25409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa25a979700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa25409e000 0x7fa2541339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa25a979700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25409e410 0x7fa254133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa25a979700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25406b460 con 0x7fa25409e000 2023-10-03T10:16:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa25a979700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25409b120 con 0x7fa25409d6f0 2023-10-03T10:16:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa25a979700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa25409a7e0 con 0x7fa25409e410 2023-10-03T10:16:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa253fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25409d6f0 0x7fa25409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa2537fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa25409e000 0x7fa2541339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa258f16700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25409e410 0x7fa254133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa2537fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa25409e000 0x7fa2541339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38032/0 (socket says 172.21.15.72:38032) 2023-10-03T10:16:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa253fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25409d6f0 0x7fa25409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41140/0 (socket says 172.21.15.72:41140) 2023-10-03T10:16:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa2537fe700 1 -- 172.21.15.72:0/2070262449 learned_addr learned my addr 172.21.15.72:0/2070262449 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa258f16700 1 --2- 172.21.15.72:0/2070262449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25409e410 0x7fa254133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41682/0 (socket says 172.21.15.72:41682) 2023-10-03T10:16:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa258f16700 1 -- 172.21.15.72:0/2070262449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25409d6f0 msgr2=0x7fa25409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa258f16700 1 --2- 172.21.15.72:0/2070262449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25409d6f0 0x7fa25409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa258f16700 1 -- 172.21.15.72:0/2070262449 >> v2:172.21.15.72:3300/0 conn(0x7fa25409e000 msgr2=0x7fa2541339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa258f16700 1 --2- 172.21.15.72:0/2070262449 >> v2:172.21.15.72:3300/0 conn(0x7fa25409e000 0x7fa2541339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa258f16700 1 -- 172.21.15.72:0/2070262449 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25409a500 con 0x7fa25409e410 2023-10-03T10:16:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa2537fe700 1 --2- 172.21.15.72:0/2070262449 >> v2:172.21.15.72:3300/0 conn(0x7fa25409e000 0x7fa2541339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa253fff700 1 --2- 172.21.15.72:0/2070262449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25409d6f0 0x7fa25409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.123+0000 7fa258f16700 1 --2- 172.21.15.72:0/2070262449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25409e410 0x7fa254133f30 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009dc0 tx=0x7fa24c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58af4670d3b7913b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.124+0000 7fa252ffd700 1 -- 172.21.15.72:0/2070262449 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c00e070 con 0x7fa25409e410 2023-10-03T10:16:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.124+0000 7fa252ffd700 1 -- 172.21.15.72:0/2070262449 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24c00bae0 con 0x7fa25409e410 2023-10-03T10:16:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.124+0000 7fa252ffd700 1 -- 172.21.15.72:0/2070262449 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c00be90 con 0x7fa25409e410 2023-10-03T10:16:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.124+0000 7fa25a979700 1 -- 172.21.15.72:0/2070262449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25409e410 msgr2=0x7fa254133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.124+0000 7fa25a979700 1 --2- 172.21.15.72:0/2070262449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25409e410 0x7fa254133f30 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009dc0 tx=0x7fa24c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.124+0000 7fa25a979700 1 -- 172.21.15.72:0/2070262449 shutdown_connections 2023-10-03T10:16:24.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.124+0000 7fa25a979700 1 --2- 172.21.15.72:0/2070262449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25409e410 0x7fa254133f30 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.124+0000 7fa25a979700 1 --2- 172.21.15.72:0/2070262449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25409d6f0 0x7fa25409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.124+0000 7fa25a979700 1 --2- 172.21.15.72:0/2070262449 >> v2:172.21.15.72:3300/0 conn(0x7fa25409e000 0x7fa2541339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.124+0000 7fa25a979700 1 -- 172.21.15.72:0/2070262449 >> 172.21.15.72:0/2070262449 conn(0x7fa254066f50 msgr2=0x7fa25409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.124+0000 7fa25a979700 1 -- 172.21.15.72:0/2070262449 shutdown_connections 2023-10-03T10:16:24.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.124+0000 7fa25a979700 1 -- 172.21.15.72:0/2070262449 wait complete. 2023-10-03T10:16:24.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.125+0000 7fa25a979700 1 Processor -- start 2023-10-03T10:16:24.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.125+0000 7fa25a979700 1 -- start start 2023-10-03T10:16:24.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa25a979700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25409d6f0 0x7fa2541c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa25a979700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa25409e000 0x7fa2541c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa25a979700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25409e410 0x7fa2541c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa25a979700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2541a6420 con 0x7fa25409e000 2023-10-03T10:16:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa25a979700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2541a7c10 con 0x7fa25409e410 2023-10-03T10:16:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa25a979700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa25409c710 con 0x7fa25409d6f0 2023-10-03T10:16:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa253fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25409d6f0 0x7fa2541c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa2537fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa25409e000 0x7fa2541c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa253fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25409d6f0 0x7fa2541c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41692/0 (socket says 172.21.15.72:41692) 2023-10-03T10:16:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa253fff700 1 -- 172.21.15.72:0/3206762184 learned_addr learned my addr 172.21.15.72:0/3206762184 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa258f16700 1 --2- 172.21.15.72:0/3206762184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25409e410 0x7fa2541c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa2537fe700 1 -- 172.21.15.72:0/3206762184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25409d6f0 msgr2=0x7fa2541c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa2537fe700 1 --2- 172.21.15.72:0/3206762184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25409d6f0 0x7fa2541c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa2537fe700 1 -- 172.21.15.72:0/3206762184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25409e410 msgr2=0x7fa2541c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa2537fe700 1 --2- 172.21.15.72:0/3206762184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25409e410 0x7fa2541c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa2537fe700 1 -- 172.21.15.72:0/3206762184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2440094a0 con 0x7fa25409e000 2023-10-03T10:16:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa253fff700 1 --2- 172.21.15.72:0/3206762184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25409d6f0 0x7fa2541c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa2537fe700 1 --2- 172.21.15.72:0/3206762184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa25409e000 0x7fa2541c84f0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fa25406e510 tx=0x7fa24800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa250ff9700 1 -- 172.21.15.72:0/3206762184 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248004240 con 0x7fa25409e000 2023-10-03T10:16:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa250ff9700 1 -- 172.21.15.72:0/3206762184 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2480043a0 con 0x7fa25409e000 2023-10-03T10:16:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa25a979700 1 -- 172.21.15.72:0/3206762184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa248009550 con 0x7fa25409e000 2023-10-03T10:16:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa250ff9700 1 -- 172.21.15.72:0/3206762184 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2480036a0 con 0x7fa25409e000 2023-10-03T10:16:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.126+0000 7fa25a979700 1 -- 172.21.15.72:0/3206762184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c009a70 con 0x7fa25409e000 2023-10-03T10:16:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.127+0000 7fa250ff9700 1 -- 172.21.15.72:0/3206762184 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa248003800 con 0x7fa25409e000 2023-10-03T10:16:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.127+0000 7fa250ff9700 1 -- 172.21.15.72:0/3206762184 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa24803fb40 con 0x7fa25409e000 2023-10-03T10:16:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.127+0000 7fa25a979700 1 -- 172.21.15.72:0/3206762184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa254074ea0 con 0x7fa25409e000 2023-10-03T10:16:24.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.132+0000 7fa250ff9700 1 -- 172.21.15.72:0/3206762184 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa248013470 con 0x7fa25409e000 2023-10-03T10:16:24.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:24.305 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:24.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.320+0000 7fa25a979700 1 -- 172.21.15.72:0/3206762184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa2541a6f10 con 0x7fa25409e000 2023-10-03T10:16:24.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.320+0000 7fa250ff9700 1 -- 172.21.15.72:0/3206762184 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa24802a070 con 0x7fa25409e000 2023-10-03T10:16:24.321 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:24.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.323+0000 7fa25a979700 1 -- 172.21.15.72:0/3206762184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa25409e000 msgr2=0x7fa2541c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.323+0000 7fa25a979700 1 --2- 172.21.15.72:0/3206762184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa25409e000 0x7fa2541c84f0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fa25406e510 tx=0x7fa24800ec80 comp rx=0 tx=0).stop 2023-10-03T10:16:24.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.323+0000 7fa25a979700 1 -- 172.21.15.72:0/3206762184 shutdown_connections 2023-10-03T10:16:24.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.323+0000 7fa25a979700 1 --2- 172.21.15.72:0/3206762184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa25409e410 0x7fa2541c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.323+0000 7fa25a979700 1 --2- 172.21.15.72:0/3206762184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa25409d6f0 0x7fa2541c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.323+0000 7fa25a979700 1 --2- 172.21.15.72:0/3206762184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa25409e000 0x7fa2541c84f0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.323+0000 7fa25a979700 1 -- 172.21.15.72:0/3206762184 >> 172.21.15.72:0/3206762184 conn(0x7fa254066f50 msgr2=0x7fa2541bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.323+0000 7fa25a979700 1 -- 172.21.15.72:0/3206762184 shutdown_connections 2023-10-03T10:16:24.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.323+0000 7fa25a979700 1 -- 172.21.15.72:0/3206762184 wait complete. 2023-10-03T10:16:24.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:24.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.390+0000 7f12b4ac1700 1 Processor -- start 2023-10-03T10:16:24.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.390+0000 7f12b4ac1700 1 -- start start 2023-10-03T10:16:24.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.390+0000 7f12b4ac1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12b00a0a30 0x7f12b00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.390+0000 7f12b4ac1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12b009d630 0x7f12b00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.390+0000 7f12b4ac1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b00a2a70 con 0x7f12b0133930 2023-10-03T10:16:24.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.390+0000 7f12b4ac1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b00a01d0 con 0x7f12b009d630 2023-10-03T10:16:24.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.390+0000 7f12b4ac1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12b009e2b0 con 0x7f12b00a0a30 2023-10-03T10:16:24.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.390+0000 7f12ae59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12b00a0a30 0x7f12b00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.390+0000 7f12add9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12b009d630 0x7f12b00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.390+0000 7f12add9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f12b009d630 0x7f12b00a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38056/0 (socket says 172.21.15.72:38056) 2023-10-03T10:16:24.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.390+0000 7f12ae59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12b00a0a30 0x7f12b00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41696/0 (socket says 172.21.15.72:41696) 2023-10-03T10:16:24.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.390+0000 7f12add9b700 1 -- 172.21.15.72:0/1139308168 learned_addr learned my addr 172.21.15.72:0/1139308168 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:24.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.391+0000 7f12add9b700 1 -- 172.21.15.72:0/1139308168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12b00a0a30 msgr2=0x7f12b00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.391+0000 7f12add9b700 1 --2- 172.21.15.72:0/1139308168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12b00a0a30 0x7f12b00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.391+0000 7f12add9b700 1 -- 172.21.15.72:0/1139308168 >> v1:172.21.15.72:6789/0 conn(0x7f12b0133930 legacy=0x7f12b0133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.391+0000 7f12add9b700 1 -- 172.21.15.72:0/1139308168 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b009dc50 con 0x7f12b009d630 2023-10-03T10:16:24.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.391+0000 7f12ae59c700 1 --2- 172.21.15.72:0/1139308168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12b00a0a30 0x7f12b00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.391+0000 7f12add9b700 1 --2- 172.21.15.72:0/1139308168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12b009d630 0x7f12b00a1340 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f12a40098f0 tx=0x7f12a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c78cdee0c4cafa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.391+0000 7f12ad59a700 1 -- 172.21.15.72:0/1139308168 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4011830 con 0x7f12b009d630 2023-10-03T10:16:24.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.391+0000 7f12ad59a700 1 -- 172.21.15.72:0/1139308168 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a4011990 con 0x7f12b009d630 2023-10-03T10:16:24.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.391+0000 7f12ad59a700 1 -- 172.21.15.72:0/1139308168 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4011d20 con 0x7f12b009d630 2023-10-03T10:16:24.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.391+0000 7f12b4ac1700 1 -- 172.21.15.72:0/1139308168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12b009d630 msgr2=0x7f12b00a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.392+0000 7f12b4ac1700 1 --2- 172.21.15.72:0/1139308168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12b009d630 0x7f12b00a1340 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f12a40098f0 tx=0x7f12a4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:24.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.392+0000 7f12b4ac1700 1 -- 172.21.15.72:0/1139308168 shutdown_connections 2023-10-03T10:16:24.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.392+0000 7f12b4ac1700 1 --2- 172.21.15.72:0/1139308168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12b00a0a30 0x7f12b00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.392+0000 7f12b4ac1700 1 --2- 172.21.15.72:0/1139308168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12b009d630 0x7f12b00a1340 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.392+0000 7f12b4ac1700 1 -- 172.21.15.72:0/1139308168 >> 172.21.15.72:0/1139308168 conn(0x7f12b00a3050 msgr2=0x7f12b00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.392+0000 7f12b4ac1700 1 -- 172.21.15.72:0/1139308168 shutdown_connections 2023-10-03T10:16:24.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.392+0000 7f12b4ac1700 1 -- 172.21.15.72:0/1139308168 wait complete. 2023-10-03T10:16:24.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.393+0000 7f12b4ac1700 1 Processor -- start 2023-10-03T10:16:24.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.393+0000 7f12b4ac1700 1 -- start start 2023-10-03T10:16:24.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.393+0000 7f12b4ac1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12b009d630 0x7f12b01c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.393+0000 7f12b4ac1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12b00a0a30 0x7f12b01c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.393+0000 7f12b4ac1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12b0133930 0x7f12b01c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.393+0000 7f12b4ac1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b0120a70 con 0x7f12b009d630 2023-10-03T10:16:24.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.393+0000 7f12b4ac1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b0120880 con 0x7f12b00a0a30 2023-10-03T10:16:24.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.393+0000 7f12b4ac1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12b0121920 con 0x7f12b0133930 2023-10-03T10:16:24.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.393+0000 7f12ae59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12b009d630 0x7f12b01c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.393+0000 7f12aed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12b0133930 0x7f12b01c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.393+0000 7f12aed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12b0133930 0x7f12b01c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41698/0 (socket says 172.21.15.72:41698) 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.393+0000 7f12ae59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12b009d630 0x7f12b01c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38070/0 (socket says 172.21.15.72:38070) 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.393+0000 7f12aed9d700 1 -- 172.21.15.72:0/3972549266 learned_addr learned my addr 172.21.15.72:0/3972549266 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.394+0000 7f12ae59c700 1 -- 172.21.15.72:0/3972549266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12b0133930 msgr2=0x7f12b01c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.394+0000 7f12ae59c700 1 --2- 172.21.15.72:0/3972549266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12b0133930 0x7f12b01c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.394+0000 7f12ae59c700 1 -- 172.21.15.72:0/3972549266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12b00a0a30 msgr2=0x7f12b01c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.394+0000 7f12add9b700 1 --2- 172.21.15.72:0/3972549266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12b00a0a30 0x7f12b01c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.394+0000 7f12ae59c700 1 --2- 172.21.15.72:0/3972549266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12b00a0a30 0x7f12b01c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.394+0000 7f12ae59c700 1 -- 172.21.15.72:0/3972549266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a00094a0 con 0x7f12b009d630 2023-10-03T10:16:24.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.394+0000 7f12aed9d700 1 --2- 172.21.15.72:0/3972549266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12b0133930 0x7f12b01c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.394+0000 7f12ae59c700 1 --2- 172.21.15.72:0/3972549266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12b009d630 0x7f12b01c8310 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f12a000e9b0 tx=0x7f12a000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.394+0000 7f129effd700 1 -- 172.21.15.72:0/3972549266 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a000c850 con 0x7f12b009d630 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.394+0000 7f129effd700 1 -- 172.21.15.72:0/3972549266 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a000c9b0 con 0x7f12b009d630 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.394+0000 7f12b4ac1700 1 -- 172.21.15.72:0/3972549266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a4009550 con 0x7f12b009d630 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.394+0000 7f129effd700 1 -- 172.21.15.72:0/3972549266 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a000cd60 con 0x7f12b009d630 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.394+0000 7f12b4ac1700 1 -- 172.21.15.72:0/3972549266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b01224b0 con 0x7f12b009d630 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.395+0000 7f129effd700 1 -- 172.21.15.72:0/3972549266 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12a0013470 con 0x7f12b009d630 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.395+0000 7f12b4ac1700 1 -- 172.21.15.72:0/3972549266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b0121ef0 con 0x7f12b009d630 2023-10-03T10:16:24.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.395+0000 7f129effd700 1 -- 172.21.15.72:0/3972549266 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f12a003f780 con 0x7f12b009d630 2023-10-03T10:16:24.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.399+0000 7f129effd700 1 -- 172.21.15.72:0/3972549266 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12a00232f0 con 0x7f12b009d630 2023-10-03T10:16:24.401 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:24.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.435+0000 7f972f783700 1 Processor -- start 2023-10-03T10:16:24.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.435+0000 7f972f783700 1 -- start start 2023-10-03T10:16:24.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.435+0000 7f972f783700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f972809d6f0 0x7f972809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.435+0000 7f972f783700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f972809e410 0x7f9728134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.435+0000 7f972f783700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972809b120 con 0x7f972809e000 2023-10-03T10:16:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.436+0000 7f972f783700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f972806b460 con 0x7f972809e410 2023-10-03T10:16:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.436+0000 7f972f783700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972809a7e0 con 0x7f972809d6f0 2023-10-03T10:16:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.436+0000 7f972d51f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f972809d6f0 0x7f972809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.436+0000 7f972cd1e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f972809e000 0x7f97281339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56062/0 (socket says 172.21.15.72:56062) 2023-10-03T10:16:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.436+0000 7f972cd1e700 1 -- 172.21.15.72:0/3969544567 learned_addr learned my addr 172.21.15.72:0/3969544567 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.436+0000 7f972d51f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f972809d6f0 0x7f972809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41178/0 (socket says 172.21.15.72:41178) 2023-10-03T10:16:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.436+0000 7f972dd20700 1 --2- 172.21.15.72:0/3969544567 >> v2:172.21.15.72:3300/0 conn(0x7f972809e410 0x7f9728134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.436+0000 7f972d51f700 1 -- 172.21.15.72:0/3969544567 >> v2:172.21.15.72:3300/0 conn(0x7f972809e410 msgr2=0x7f9728134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.436+0000 7f972d51f700 1 --2- 172.21.15.72:0/3969544567 >> v2:172.21.15.72:3300/0 conn(0x7f972809e410 0x7f9728134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.436+0000 7f972d51f700 1 -- 172.21.15.72:0/3969544567 >> v1:172.21.15.72:6789/0 conn(0x7f972809e000 legacy=0x7f97281339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.436+0000 7f972d51f700 1 -- 172.21.15.72:0/3969544567 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972809a500 con 0x7f972809d6f0 2023-10-03T10:16:24.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.436+0000 7f972d51f700 1 --2- 172.21.15.72:0/3969544567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f972809d6f0 0x7f972809dac0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9724009870 tx=0x7f9724009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22f7acbcd8fd0b27 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.436+0000 7f971ffff700 1 -- 172.21.15.72:0/3969544567 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724011830 con 0x7f972809d6f0 2023-10-03T10:16:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.436+0000 7f971ffff700 1 -- 172.21.15.72:0/3969544567 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9724011990 con 0x7f972809d6f0 2023-10-03T10:16:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.436+0000 7f971ffff700 1 -- 172.21.15.72:0/3969544567 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724011d20 con 0x7f972809d6f0 2023-10-03T10:16:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.437+0000 7f972f783700 1 -- 172.21.15.72:0/3969544567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f972809d6f0 msgr2=0x7f972809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.437+0000 7f972f783700 1 --2- 172.21.15.72:0/3969544567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f972809d6f0 0x7f972809dac0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9724009870 tx=0x7f9724009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.437+0000 7f972f783700 1 -- 172.21.15.72:0/3969544567 shutdown_connections 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.437+0000 7f972f783700 1 --2- 172.21.15.72:0/3969544567 >> v2:172.21.15.72:3300/0 conn(0x7f972809e410 0x7f9728134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.437+0000 7f972f783700 1 --2- 172.21.15.72:0/3969544567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f972809d6f0 0x7f972809dac0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.437+0000 7f972f783700 1 -- 172.21.15.72:0/3969544567 >> 172.21.15.72:0/3969544567 conn(0x7f9728066f50 msgr2=0x7f972809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.437+0000 7f972f783700 1 -- 172.21.15.72:0/3969544567 shutdown_connections 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.437+0000 7f972f783700 1 -- 172.21.15.72:0/3969544567 wait complete. 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.438+0000 7f972f783700 1 Processor -- start 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.438+0000 7f972f783700 1 -- start start 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.438+0000 7f972f783700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f972809d6f0 0x7f97281a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.438+0000 7f972f783700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f972809e000 0x7f97281a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.438+0000 7f972f783700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f972809e410 0x7f97281a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.438+0000 7f972f783700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97281a8050 con 0x7f972809e000 2023-10-03T10:16:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.438+0000 7f972f783700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97281a9110 con 0x7f972809e410 2023-10-03T10:16:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.438+0000 7f972f783700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f972809c710 con 0x7f972809d6f0 2023-10-03T10:16:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f972cd1e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f972809e000 0x7f97281a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f972d51f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f972809d6f0 0x7f97281a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f972d51f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f972809d6f0 0x7f97281a5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41708/0 (socket says 172.21.15.72:41708) 2023-10-03T10:16:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f972d51f700 1 -- 172.21.15.72:0/474163691 learned_addr learned my addr 172.21.15.72:0/474163691 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f972cd1e700 1 --2- 172.21.15.72:0/474163691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f972809e000 0x7f97281a63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38082/0 (socket says 172.21.15.72:38082) 2023-10-03T10:16:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f972dd20700 1 --2- 172.21.15.72:0/474163691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f972809e410 0x7f97281a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f972d51f700 1 -- 172.21.15.72:0/474163691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f972809e410 msgr2=0x7f97281a68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f972d51f700 1 --2- 172.21.15.72:0/474163691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f972809e410 0x7f97281a68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f972d51f700 1 -- 172.21.15.72:0/474163691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f972809e000 msgr2=0x7f97281a63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f972d51f700 1 --2- 172.21.15.72:0/474163691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f972809e000 0x7f97281a63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f972d51f700 1 -- 172.21.15.72:0/474163691 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97240094a0 con 0x7f972809d6f0 2023-10-03T10:16:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f972cd1e700 1 --2- 172.21.15.72:0/474163691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f972809e000 0x7f97281a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f972dd20700 1 --2- 172.21.15.72:0/474163691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f972809e410 0x7f97281a68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f972d51f700 1 --2- 172.21.15.72:0/474163691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f972809d6f0 0x7f97281a5e60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9724000c00 tx=0x7f9724004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f971dffb700 1 -- 172.21.15.72:0/474163691 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724004550 con 0x7f972809d6f0 2023-10-03T10:16:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f971dffb700 1 -- 172.21.15.72:0/474163691 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972401f070 con 0x7f972809d6f0 2023-10-03T10:16:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f971dffb700 1 -- 172.21.15.72:0/474163691 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97240038e0 con 0x7f972809d6f0 2023-10-03T10:16:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.439+0000 7f972f783700 1 -- 172.21.15.72:0/474163691 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97280a3210 con 0x7f972809d6f0 2023-10-03T10:16:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.440+0000 7f972f783700 1 -- 172.21.15.72:0/474163691 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97281a8cc0 con 0x7f972809d6f0 2023-10-03T10:16:24.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.441+0000 7f971dffb700 1 -- 172.21.15.72:0/474163691 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9724003a40 con 0x7f972809d6f0 2023-10-03T10:16:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.441+0000 7f972f783700 1 -- 172.21.15.72:0/474163691 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9728074ea0 con 0x7f972809d6f0 2023-10-03T10:16:24.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.441+0000 7f971dffb700 1 -- 172.21.15.72:0/474163691 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9724021070 con 0x7f972809d6f0 2023-10-03T10:16:24.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.445+0000 7f971dffb700 1 -- 172.21.15.72:0/474163691 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f972402f3a0 con 0x7f972809d6f0 2023-10-03T10:16:24.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.526+0000 7f61ab563700 1 Processor -- start 2023-10-03T10:16:24.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.526+0000 7f61ab563700 1 -- start start 2023-10-03T10:16:24.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61ab563700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f61a40a0a30 0x7f61a40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61ab563700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61a409d630 0x7f61a40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61ab563700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61a4133930 0x7f61a4133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61ab563700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a40a2a70 con 0x7f61a40a0a30 2023-10-03T10:16:24.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61ab563700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a40a01d0 con 0x7f61a4133930 2023-10-03T10:16:24.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61ab563700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61a409e2b0 con 0x7f61a409d630 2023-10-03T10:16:24.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61a8afe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61a409d630 0x7f61a40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61a8afe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61a409d630 0x7f61a40a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41714/0 (socket says 172.21.15.72:41714) 2023-10-03T10:16:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61a92ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f61a40a0a30 0x7f61a40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61a8afe700 1 -- 172.21.15.72:0/3067427471 learned_addr learned my addr 172.21.15.72:0/3067427471 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61a9b00700 1 --2- 172.21.15.72:0/3067427471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61a4133930 0x7f61a4133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61a8afe700 1 -- 172.21.15.72:0/3067427471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61a4133930 msgr2=0x7f61a4133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61a8afe700 1 --2- 172.21.15.72:0/3067427471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61a4133930 0x7f61a4133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61a8afe700 1 -- 172.21.15.72:0/3067427471 >> v2:172.21.15.72:3300/0 conn(0x7f61a40a0a30 msgr2=0x7f61a40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61a8afe700 1 --2- 172.21.15.72:0/3067427471 >> v2:172.21.15.72:3300/0 conn(0x7f61a40a0a30 0x7f61a40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61a8afe700 1 -- 172.21.15.72:0/3067427471 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a409dc50 con 0x7f61a409d630 2023-10-03T10:16:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61a92ff700 1 --2- 172.21.15.72:0/3067427471 >> v2:172.21.15.72:3300/0 conn(0x7f61a40a0a30 0x7f61a40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f61a8afe700 1 --2- 172.21.15.72:0/3067427471 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61a409d630 0x7f61a40a1340 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f61940098f0 tx=0x7f6194009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f395e7b69eeb2a3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f619bfff700 1 -- 172.21.15.72:0/3067427471 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194011830 con 0x7f61a409d630 2023-10-03T10:16:24.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f619bfff700 1 -- 172.21.15.72:0/3067427471 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6194011990 con 0x7f61a409d630 2023-10-03T10:16:24.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.527+0000 7f619bfff700 1 -- 172.21.15.72:0/3067427471 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194011d20 con 0x7f61a409d630 2023-10-03T10:16:24.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.528+0000 7f61ab563700 1 -- 172.21.15.72:0/3067427471 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61a409d630 msgr2=0x7f61a40a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.528+0000 7f61ab563700 1 --2- 172.21.15.72:0/3067427471 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61a409d630 0x7f61a40a1340 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f61940098f0 tx=0x7f6194009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:24.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.528+0000 7f61ab563700 1 -- 172.21.15.72:0/3067427471 shutdown_connections 2023-10-03T10:16:24.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.528+0000 7f61ab563700 1 --2- 172.21.15.72:0/3067427471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61a4133930 0x7f61a4133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.528+0000 7f61ab563700 1 --2- 172.21.15.72:0/3067427471 >> v2:172.21.15.72:3300/0 conn(0x7f61a40a0a30 0x7f61a40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.528+0000 7f61ab563700 1 --2- 172.21.15.72:0/3067427471 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61a409d630 0x7f61a40a1340 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.528+0000 7f61ab563700 1 -- 172.21.15.72:0/3067427471 >> 172.21.15.72:0/3067427471 conn(0x7f61a40a3050 msgr2=0x7f61a40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.528+0000 7f61ab563700 1 -- 172.21.15.72:0/3067427471 shutdown_connections 2023-10-03T10:16:24.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.528+0000 7f61ab563700 1 -- 172.21.15.72:0/3067427471 wait complete. 2023-10-03T10:16:24.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.529+0000 7f61ab563700 1 Processor -- start 2023-10-03T10:16:24.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.529+0000 7f61ab563700 1 -- start start 2023-10-03T10:16:24.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.529+0000 7f61ab563700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61a409d630 0x7f61a411f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.529+0000 7f61ab563700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61a40a0a30 0x7f61a411f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.529+0000 7f61ab563700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61a4133930 0x7f61a41c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:24.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.529+0000 7f61ab563700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4121200 con 0x7f61a409d630 2023-10-03T10:16:24.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.529+0000 7f61ab563700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a41334d0 con 0x7f61a4133930 2023-10-03T10:16:24.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.529+0000 7f61ab563700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61a40a4130 con 0x7f61a40a0a30 2023-10-03T10:16:24.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.530+0000 7f61a8afe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61a40a0a30 0x7f61a411f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.530+0000 7f61a8afe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61a40a0a30 0x7f61a411f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41728/0 (socket says 172.21.15.72:41728) 2023-10-03T10:16:24.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.530+0000 7f61a8afe700 1 -- 172.21.15.72:0/431152685 learned_addr learned my addr 172.21.15.72:0/431152685 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:24.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.530+0000 7f61a9b00700 1 --2- 172.21.15.72:0/431152685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61a4133930 0x7f61a41c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.530+0000 7f61a92ff700 1 --2- 172.21.15.72:0/431152685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61a409d630 0x7f61a411f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:24.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.530+0000 7f61a8afe700 1 -- 172.21.15.72:0/431152685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61a4133930 msgr2=0x7f61a41c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.530+0000 7f61a8afe700 1 --2- 172.21.15.72:0/431152685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61a4133930 0x7f61a41c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.530+0000 7f61a8afe700 1 -- 172.21.15.72:0/431152685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61a409d630 msgr2=0x7f61a411f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.530+0000 7f61a8afe700 1 --2- 172.21.15.72:0/431152685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61a409d630 0x7f61a411f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.530+0000 7f61a8afe700 1 -- 172.21.15.72:0/431152685 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a00094a0 con 0x7f61a40a0a30 2023-10-03T10:16:24.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.530+0000 7f61a8afe700 1 --2- 172.21.15.72:0/431152685 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61a40a0a30 0x7f61a411f880 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6194000c00 tx=0x7f6194004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:24.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.530+0000 7f6199ffb700 1 -- 172.21.15.72:0/431152685 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194004240 con 0x7f61a40a0a30 2023-10-03T10:16:24.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.530+0000 7f6199ffb700 1 -- 172.21.15.72:0/431152685 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619401f070 con 0x7f61a40a0a30 2023-10-03T10:16:24.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.530+0000 7f61ab563700 1 -- 172.21.15.72:0/431152685 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6194009550 con 0x7f61a40a0a30 2023-10-03T10:16:24.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.530+0000 7f6199ffb700 1 -- 172.21.15.72:0/431152685 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61940045c0 con 0x7f61a40a0a30 2023-10-03T10:16:24.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.531+0000 7f61ab563700 1 -- 172.21.15.72:0/431152685 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a411fdc0 con 0x7f61a40a0a30 2023-10-03T10:16:24.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.531+0000 7f6199ffb700 1 -- 172.21.15.72:0/431152685 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6194021030 con 0x7f61a40a0a30 2023-10-03T10:16:24.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.531+0000 7f6199ffb700 1 -- 172.21.15.72:0/431152685 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6194040890 con 0x7f61a40a0a30 2023-10-03T10:16:24.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.532+0000 7f61ab563700 1 -- 172.21.15.72:0/431152685 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a40747f0 con 0x7f61a40a0a30 2023-10-03T10:16:24.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.537+0000 7f6199ffb700 1 -- 172.21.15.72:0/431152685 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6194015080 con 0x7f61a40a0a30 2023-10-03T10:16:24.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.599+0000 7f12b4ac1700 1 -- 172.21.15.72:0/3972549266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f12b0074770 con 0x7f12b009d630 2023-10-03T10:16:24.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.600+0000 7f129effd700 1 -- 172.21.15.72:0/3972549266 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12a0021020 con 0x7f12b009d630 2023-10-03T10:16:24.600 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:24.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.602+0000 7f12b4ac1700 1 -- 172.21.15.72:0/3972549266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12b009d630 msgr2=0x7f12b01c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.602+0000 7f12b4ac1700 1 --2- 172.21.15.72:0/3972549266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12b009d630 0x7f12b01c8310 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f12a000e9b0 tx=0x7f12a000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.602+0000 7f12b4ac1700 1 -- 172.21.15.72:0/3972549266 shutdown_connections 2023-10-03T10:16:24.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.602+0000 7f12b4ac1700 1 --2- 172.21.15.72:0/3972549266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12b009d630 0x7f12b01c8310 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.602+0000 7f12b4ac1700 1 --2- 172.21.15.72:0/3972549266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f12b0133930 0x7f12b01c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.602+0000 7f12b4ac1700 1 --2- 172.21.15.72:0/3972549266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12b00a0a30 0x7f12b01c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.602+0000 7f12b4ac1700 1 -- 172.21.15.72:0/3972549266 >> 172.21.15.72:0/3972549266 conn(0x7f12b00a3050 msgr2=0x7f12b01bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.602+0000 7f12b4ac1700 1 -- 172.21.15.72:0/3972549266 shutdown_connections 2023-10-03T10:16:24.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.602+0000 7f12b4ac1700 1 -- 172.21.15.72:0/3972549266 wait complete. 2023-10-03T10:16:24.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:24.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.644+0000 7f972f783700 1 -- 172.21.15.72:0/474163691 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f972806c360 con 0x7f972809d6f0 2023-10-03T10:16:24.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.645+0000 7f971dffb700 1 -- 172.21.15.72:0/474163691 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f972402b030 con 0x7f972809d6f0 2023-10-03T10:16:24.645 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:24.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.647+0000 7f972f783700 1 -- 172.21.15.72:0/474163691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f972809d6f0 msgr2=0x7f97281a5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.647+0000 7f972f783700 1 --2- 172.21.15.72:0/474163691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f972809d6f0 0x7f97281a5e60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9724000c00 tx=0x7f9724004750 comp rx=0 tx=0).stop 2023-10-03T10:16:24.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.647+0000 7f972f783700 1 -- 172.21.15.72:0/474163691 shutdown_connections 2023-10-03T10:16:24.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.647+0000 7f972f783700 1 --2- 172.21.15.72:0/474163691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f972809e410 0x7f97281a68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.647+0000 7f972f783700 1 --2- 172.21.15.72:0/474163691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f972809d6f0 0x7f97281a5e60 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.647+0000 7f972f783700 1 --2- 172.21.15.72:0/474163691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f972809e000 0x7f97281a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.647+0000 7f972f783700 1 -- 172.21.15.72:0/474163691 >> 172.21.15.72:0/474163691 conn(0x7f9728066f50 msgr2=0x7f97281bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.647+0000 7f972f783700 1 -- 172.21.15.72:0/474163691 shutdown_connections 2023-10-03T10:16:24.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.647+0000 7f972f783700 1 -- 172.21.15.72:0/474163691 wait complete. 2023-10-03T10:16:24.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.731+0000 7f61ab563700 1 -- 172.21.15.72:0/431152685 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f61a4120a90 con 0x7f61a40a0a30 2023-10-03T10:16:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.731+0000 7f6199ffb700 1 -- 172.21.15.72:0/431152685 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f61940199a0 con 0x7f61a40a0a30 2023-10-03T10:16:24.732 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.733+0000 7f61ab563700 1 -- 172.21.15.72:0/431152685 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61a40a0a30 msgr2=0x7f61a411f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.733+0000 7f61ab563700 1 --2- 172.21.15.72:0/431152685 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61a40a0a30 0x7f61a411f880 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6194000c00 tx=0x7f6194004750 comp rx=0 tx=0).stop 2023-10-03T10:16:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.733+0000 7f61ab563700 1 -- 172.21.15.72:0/431152685 shutdown_connections 2023-10-03T10:16:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.733+0000 7f61ab563700 1 --2- 172.21.15.72:0/431152685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61a409d630 0x7f61a411f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.733+0000 7f61ab563700 1 --2- 172.21.15.72:0/431152685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f61a4133930 0x7f61a41c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.733+0000 7f61ab563700 1 --2- 172.21.15.72:0/431152685 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f61a40a0a30 0x7f61a411f880 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.733+0000 7f61ab563700 1 -- 172.21.15.72:0/431152685 >> 172.21.15.72:0/431152685 conn(0x7f61a40a3050 msgr2=0x7f61a409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.733+0000 7f61ab563700 1 -- 172.21.15.72:0/431152685 shutdown_connections 2023-10-03T10:16:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:24.733+0000 7f61ab563700 1 -- 172.21.15.72:0/431152685 wait complete. 2023-10-03T10:16:24.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:25.337 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:25.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.460+0000 7fec1ac76700 1 Processor -- start 2023-10-03T10:16:25.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.460+0000 7fec1ac76700 1 -- start start 2023-10-03T10:16:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec1ac76700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec1406a770 0x7fec1406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec1ac76700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1406b080 0x7fec14131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec1ac76700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1409ece0 con 0x7fec14131b40 2023-10-03T10:16:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec1ac76700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1409e760 con 0x7fec1406b080 2023-10-03T10:16:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec1ac76700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec1409e040 con 0x7fec1406a770 2023-10-03T10:16:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec13fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1406b080 0x7fec14131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec18a12700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec1406a770 0x7fec1406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec13fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1406b080 0x7fec14131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41214/0 (socket says 172.21.15.72:41214) 2023-10-03T10:16:25.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec19213700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fec14131b40 0x7fec14138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56078/0 (socket says 172.21.15.72:56078) 2023-10-03T10:16:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec13fff700 1 -- 172.21.15.72:0/3168390670 learned_addr learned my addr 172.21.15.72:0/3168390670 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec13fff700 1 -- 172.21.15.72:0/3168390670 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec1406a770 msgr2=0x7fec1406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec137fe700 1 -- 172.21.15.72:0/3168390670 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305501751 0 0) 0x7fec1409ece0 con 0x7fec14131b40 2023-10-03T10:16:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec13fff700 1 --2- 172.21.15.72:0/3168390670 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec1406a770 0x7fec1406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec13fff700 1 -- 172.21.15.72:0/3168390670 >> v1:172.21.15.72:6789/0 conn(0x7fec14131b40 legacy=0x7fec14138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec13fff700 1 -- 172.21.15.72:0/3168390670 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1409f630 con 0x7fec1406b080 2023-10-03T10:16:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec18a12700 1 --2- 172.21.15.72:0/3168390670 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec1406a770 0x7fec1406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.461+0000 7fec13fff700 1 --2- 172.21.15.72:0/3168390670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1406b080 0x7fec14131600 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fec00009920 tx=0x7fec00009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ad91659993143ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.462+0000 7fec137fe700 1 -- 172.21.15.72:0/3168390670 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec00011830 con 0x7fec1406b080 2023-10-03T10:16:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.462+0000 7fec137fe700 1 -- 172.21.15.72:0/3168390670 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec00011990 con 0x7fec1406b080 2023-10-03T10:16:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.462+0000 7fec137fe700 1 -- 172.21.15.72:0/3168390670 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec00011d20 con 0x7fec1406b080 2023-10-03T10:16:25.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.462+0000 7fec1ac76700 1 -- 172.21.15.72:0/3168390670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1406b080 msgr2=0x7fec14131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.462+0000 7fec1ac76700 1 --2- 172.21.15.72:0/3168390670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1406b080 0x7fec14131600 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fec00009920 tx=0x7fec00009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:25.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.462+0000 7fec1ac76700 1 -- 172.21.15.72:0/3168390670 shutdown_connections 2023-10-03T10:16:25.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.462+0000 7fec1ac76700 1 --2- 172.21.15.72:0/3168390670 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec1406a770 0x7fec1406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.462+0000 7fec1ac76700 1 --2- 172.21.15.72:0/3168390670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1406b080 0x7fec14131600 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.462+0000 7fec1ac76700 1 -- 172.21.15.72:0/3168390670 >> 172.21.15.72:0/3168390670 conn(0x7fec14066f50 msgr2=0x7fec1409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.462+0000 7fec1ac76700 1 -- 172.21.15.72:0/3168390670 shutdown_connections 2023-10-03T10:16:25.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.462+0000 7fec1ac76700 1 -- 172.21.15.72:0/3168390670 wait complete. 2023-10-03T10:16:25.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.463+0000 7fec1ac76700 1 Processor -- start 2023-10-03T10:16:25.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.463+0000 7fec1ac76700 1 -- start start 2023-10-03T10:16:25.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec1ac76700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1406a770 0x7fec14120fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec1ac76700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec1406b080 0x7fec14121510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec1ac76700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec14131b40 0x7fec141c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec1ac76700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec14123b10 con 0x7fec14131b40 2023-10-03T10:16:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec1ac76700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec141241b0 con 0x7fec1406a770 2023-10-03T10:16:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec1ac76700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec14120b30 con 0x7fec1406b080 2023-10-03T10:16:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec19213700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec14131b40 0x7fec141c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec13fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec1406b080 0x7fec14121510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec18a12700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1406a770 0x7fec14120fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec13fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec1406b080 0x7fec14121510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41752/0 (socket says 172.21.15.72:41752) 2023-10-03T10:16:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec18a12700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1406a770 0x7fec14120fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41226/0 (socket says 172.21.15.72:41226) 2023-10-03T10:16:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec19213700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec14131b40 0x7fec141c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38100/0 (socket says 172.21.15.72:38100) 2023-10-03T10:16:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec13fff700 1 -- 172.21.15.72:0/1526876698 learned_addr learned my addr 172.21.15.72:0/1526876698 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec18a12700 1 -- 172.21.15.72:0/1526876698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec1406b080 msgr2=0x7fec14121510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec18a12700 1 --2- 172.21.15.72:0/1526876698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec1406b080 0x7fec14121510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec18a12700 1 -- 172.21.15.72:0/1526876698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec14131b40 msgr2=0x7fec141c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec18a12700 1 --2- 172.21.15.72:0/1526876698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec14131b40 0x7fec141c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec18a12700 1 -- 172.21.15.72:0/1526876698 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec080094a0 con 0x7fec1406a770 2023-10-03T10:16:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec13fff700 1 --2- 172.21.15.72:0/1526876698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec1406b080 0x7fec14121510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec18a12700 1 --2- 172.21.15.72:0/1526876698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1406a770 0x7fec14120fd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fec0800e9b0 tx=0x7fec0800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec117fa700 1 -- 172.21.15.72:0/1526876698 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800ee50 con 0x7fec1406a770 2023-10-03T10:16:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec117fa700 1 -- 172.21.15.72:0/1526876698 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0800c850 con 0x7fec1406a770 2023-10-03T10:16:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec117fa700 1 -- 172.21.15.72:0/1526876698 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800cc00 con 0x7fec1406a770 2023-10-03T10:16:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec1ac76700 1 -- 172.21.15.72:0/1526876698 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec00009550 con 0x7fec1406a770 2023-10-03T10:16:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.464+0000 7fec1ac76700 1 -- 172.21.15.72:0/1526876698 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec141221f0 con 0x7fec1406a770 2023-10-03T10:16:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.465+0000 7fec117fa700 1 -- 172.21.15.72:0/1526876698 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec08013470 con 0x7fec1406a770 2023-10-03T10:16:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.465+0000 7fec117fa700 1 -- 172.21.15.72:0/1526876698 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fec0803fa70 con 0x7fec1406a770 2023-10-03T10:16:25.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.465+0000 7fec1ac76700 1 -- 172.21.15.72:0/1526876698 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec14074ea0 con 0x7fec1406a770 2023-10-03T10:16:25.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.470+0000 7fec117fa700 1 -- 172.21.15.72:0/1526876698 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec08021080 con 0x7fec1406a770 2023-10-03T10:16:25.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:25.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:25.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.663+0000 7fec1ac76700 1 -- 172.21.15.72:0/1526876698 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fec14131090 con 0x7fec1406a770 2023-10-03T10:16:25.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.664+0000 7fec117fa700 1 -- 172.21.15.72:0/1526876698 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec08017020 con 0x7fec1406a770 2023-10-03T10:16:25.664 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:25.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.666+0000 7fec1ac76700 1 -- 172.21.15.72:0/1526876698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1406a770 msgr2=0x7fec14120fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.666+0000 7fec1ac76700 1 --2- 172.21.15.72:0/1526876698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1406a770 0x7fec14120fd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fec0800e9b0 tx=0x7fec0800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.666+0000 7fec1ac76700 1 -- 172.21.15.72:0/1526876698 shutdown_connections 2023-10-03T10:16:25.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.666+0000 7fec1ac76700 1 --2- 172.21.15.72:0/1526876698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec14131b40 0x7fec141c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.666+0000 7fec1ac76700 1 --2- 172.21.15.72:0/1526876698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1406a770 0x7fec14120fd0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.666+0000 7fec1ac76700 1 --2- 172.21.15.72:0/1526876698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec1406b080 0x7fec14121510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.666+0000 7fec1ac76700 1 -- 172.21.15.72:0/1526876698 >> 172.21.15.72:0/1526876698 conn(0x7fec14066f50 msgr2=0x7fec1406ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.667+0000 7fec1ac76700 1 -- 172.21.15.72:0/1526876698 shutdown_connections 2023-10-03T10:16:25.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.667+0000 7fec1ac76700 1 -- 172.21.15.72:0/1526876698 wait complete. 2023-10-03T10:16:25.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:25.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.742+0000 7f117ef7d700 1 Processor -- start 2023-10-03T10:16:25.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.743+0000 7f117ef7d700 1 -- start start 2023-10-03T10:16:25.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.743+0000 7f117ef7d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11780a0a30 0x7f11780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.743+0000 7f117ef7d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1178134170 0x7f117813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.743+0000 7f117ef7d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117809edd0 con 0x7f11780a1340 2023-10-03T10:16:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.743+0000 7f117ef7d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117809e1f0 con 0x7f1178134170 2023-10-03T10:16:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.743+0000 7f117ef7d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f117809dc50 con 0x7f11780a0a30 2023-10-03T10:16:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.743+0000 7f117cd19700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11780a0a30 0x7f11780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.743+0000 7f117d51a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1178134170 0x7f117813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.743+0000 7f117cd19700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11780a0a30 0x7f11780a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41764/0 (socket says 172.21.15.72:41764) 2023-10-03T10:16:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.743+0000 7f117d51a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1178134170 0x7f117813bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38112/0 (socket says 172.21.15.72:38112) 2023-10-03T10:16:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.743+0000 7f117cd19700 1 -- 172.21.15.72:0/1536117026 learned_addr learned my addr 172.21.15.72:0/1536117026 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.744+0000 7f117d51a700 1 -- 172.21.15.72:0/1536117026 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11780a0a30 msgr2=0x7f11780a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.744+0000 7f117d51a700 1 --2- 172.21.15.72:0/1536117026 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11780a0a30 0x7f11780a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.744+0000 7f117d51a700 1 -- 172.21.15.72:0/1536117026 >> v1:172.21.15.72:6789/0 conn(0x7f11780a1340 legacy=0x7f1178133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.744+0000 7f117d51a700 1 -- 172.21.15.72:0/1536117026 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11780a1fe0 con 0x7f1178134170 2023-10-03T10:16:25.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.744+0000 7f117cd19700 1 --2- 172.21.15.72:0/1536117026 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11780a0a30 0x7f11780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:25.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.744+0000 7f11777fe700 1 -- 172.21.15.72:0/1536117026 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275717018 0 0) 0x7f117809edd0 con 0x7f11780a1340 2023-10-03T10:16:25.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.744+0000 7f117d51a700 1 --2- 172.21.15.72:0/1536117026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1178134170 0x7f117813bd30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1170009d90 tx=0x7f117000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51aa7437d4eaaf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.744+0000 7f11777fe700 1 -- 172.21.15.72:0/1536117026 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117000e070 con 0x7f1178134170 2023-10-03T10:16:25.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.744+0000 7f11777fe700 1 -- 172.21.15.72:0/1536117026 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117000bb20 con 0x7f1178134170 2023-10-03T10:16:25.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.744+0000 7f11777fe700 1 -- 172.21.15.72:0/1536117026 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170012430 con 0x7f1178134170 2023-10-03T10:16:25.746 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:25.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.745+0000 7f117ef7d700 1 -- 172.21.15.72:0/1536117026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1178134170 msgr2=0x7f117813bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.745+0000 7f117ef7d700 1 --2- 172.21.15.72:0/1536117026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1178134170 0x7f117813bd30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1170009d90 tx=0x7f117000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.745+0000 7f117ef7d700 1 -- 172.21.15.72:0/1536117026 shutdown_connections 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.745+0000 7f117ef7d700 1 --2- 172.21.15.72:0/1536117026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1178134170 0x7f117813bd30 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.745+0000 7f117ef7d700 1 --2- 172.21.15.72:0/1536117026 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11780a0a30 0x7f11780a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.745+0000 7f117ef7d700 1 -- 172.21.15.72:0/1536117026 >> 172.21.15.72:0/1536117026 conn(0x7f11780a6550 msgr2=0x7f11780a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.745+0000 7f117ef7d700 1 -- 172.21.15.72:0/1536117026 shutdown_connections 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.745+0000 7f117ef7d700 1 -- 172.21.15.72:0/1536117026 wait complete. 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.746+0000 7f117ef7d700 1 Processor -- start 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.746+0000 7f117ef7d700 1 -- start start 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.746+0000 7f117ef7d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11780a0a30 0x7f1178122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.746+0000 7f117ef7d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11780a1340 0x7f1178122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.746+0000 7f117ef7d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1178134170 0x7f1178123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.746+0000 7f117ef7d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1178125f30 con 0x7f1178134170 2023-10-03T10:16:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.746+0000 7f117ef7d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11780a4dc0 con 0x7f11780a0a30 2023-10-03T10:16:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.746+0000 7f117ef7d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11780a0220 con 0x7f11780a1340 2023-10-03T10:16:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.746+0000 7f117d51a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1178134170 0x7f1178123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.746+0000 7f1177fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11780a1340 0x7f1178122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.746+0000 7f117d51a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1178134170 0x7f1178123200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38122/0 (socket says 172.21.15.72:38122) 2023-10-03T10:16:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.746+0000 7f117d51a700 1 -- 172.21.15.72:0/1822774652 learned_addr learned my addr 172.21.15.72:0/1822774652 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.746+0000 7f117cd19700 1 --2- 172.21.15.72:0/1822774652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11780a0a30 0x7f1178122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.747+0000 7f117d51a700 1 -- 172.21.15.72:0/1822774652 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11780a1340 msgr2=0x7f1178122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.747+0000 7f117d51a700 1 --2- 172.21.15.72:0/1822774652 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11780a1340 0x7f1178122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.747+0000 7f117d51a700 1 -- 172.21.15.72:0/1822774652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11780a0a30 msgr2=0x7f1178122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.747+0000 7f117d51a700 1 --2- 172.21.15.72:0/1822774652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11780a0a30 0x7f1178122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.747+0000 7f117d51a700 1 -- 172.21.15.72:0/1822774652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c009550 con 0x7f1178134170 2023-10-03T10:16:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.747+0000 7f117cd19700 1 --2- 172.21.15.72:0/1822774652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11780a0a30 0x7f1178122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.747+0000 7f1177fff700 1 --2- 172.21.15.72:0/1822774652 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11780a1340 0x7f1178122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.747+0000 7f117d51a700 1 --2- 172.21.15.72:0/1822774652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1178134170 0x7f1178123200 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f117809e330 tx=0x7f1170004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.747+0000 7f11757fa700 1 -- 172.21.15.72:0/1822774652 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170012430 con 0x7f1178134170 2023-10-03T10:16:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.747+0000 7f11757fa700 1 -- 172.21.15.72:0/1822774652 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1170020070 con 0x7f1178134170 2023-10-03T10:16:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.747+0000 7f117ef7d700 1 -- 172.21.15.72:0/1822774652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1170009a70 con 0x7f1178134170 2023-10-03T10:16:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.747+0000 7f11757fa700 1 -- 172.21.15.72:0/1822774652 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170004280 con 0x7f1178134170 2023-10-03T10:16:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.747+0000 7f117ef7d700 1 -- 172.21.15.72:0/1822774652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11781269a0 con 0x7f1178134170 2023-10-03T10:16:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.748+0000 7f11757fa700 1 -- 172.21.15.72:0/1822774652 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11700043e0 con 0x7f1178134170 2023-10-03T10:16:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.748+0000 7f117ef7d700 1 -- 172.21.15.72:0/1822774652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1178125bd0 con 0x7f1178134170 2023-10-03T10:16:25.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.748+0000 7f11757fa700 1 -- 172.21.15.72:0/1822774652 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1170022070 con 0x7f1178134170 2023-10-03T10:16:25.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.753+0000 7f11757fa700 1 -- 172.21.15.72:0/1822774652 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11700048d0 con 0x7f1178134170 2023-10-03T10:16:25.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.790+0000 7fe9c0bd2700 1 Processor -- start 2023-10-03T10:16:25.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.790+0000 7fe9c0bd2700 1 -- start start 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.791+0000 7fe9c0bd2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9bc09e1d0 0x7fe9bc135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.791+0000 7fe9c0bd2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9bc135e50 0x7fe9bc138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.791+0000 7fe9c0bd2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9bc09f130 con 0x7fe9bc09d6f0 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.791+0000 7fe9c0bd2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc09f520 con 0x7fe9bc09e1d0 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.791+0000 7fe9c0bd2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc09e930 con 0x7fe9bc135e50 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.791+0000 7fe9bad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9bc135e50 0x7fe9bc138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.791+0000 7fe9ba59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe9bc09d6f0 0x7fe9bc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56094/0 (socket says 172.21.15.72:56094) 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.791+0000 7fe9ba59c700 1 -- 172.21.15.72:0/2069631414 learned_addr learned my addr 172.21.15.72:0/2069631414 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.791+0000 7fe9b9d9b700 1 --2- 172.21.15.72:0/2069631414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9bc09e1d0 0x7fe9bc135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.792+0000 7fe9b959a700 1 -- 172.21.15.72:0/2069631414 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866952686 0 0) 0x7fe9bc09f130 con 0x7fe9bc09d6f0 2023-10-03T10:16:25.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.792+0000 7fe9b959a700 1 -- 172.21.15.72:0/2069631414 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9a40035b0 con 0x7fe9bc09d6f0 2023-10-03T10:16:25.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.792+0000 7fe9b9d9b700 1 -- 172.21.15.72:0/2069631414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9bc135e50 msgr2=0x7fe9bc138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.792+0000 7fe9b9d9b700 1 --2- 172.21.15.72:0/2069631414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9bc135e50 0x7fe9bc138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.792+0000 7fe9b9d9b700 1 -- 172.21.15.72:0/2069631414 >> v1:172.21.15.72:6789/0 conn(0x7fe9bc09d6f0 legacy=0x7fe9bc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.792+0000 7fe9b9d9b700 1 -- 172.21.15.72:0/2069631414 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9bc09b2d0 con 0x7fe9bc09e1d0 2023-10-03T10:16:25.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.792+0000 7fe9bad9d700 1 --2- 172.21.15.72:0/2069631414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9bc135e50 0x7fe9bc138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:25.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.792+0000 7fe9b9d9b700 1 --2- 172.21.15.72:0/2069631414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9bc09e1d0 0x7fe9bc135910 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009870 tx=0x7fe9b0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d47bf610dac33e5c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.792+0000 7fe9b959a700 1 -- 172.21.15.72:0/2069631414 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0011830 con 0x7fe9bc09e1d0 2023-10-03T10:16:25.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.792+0000 7fe9b959a700 1 -- 172.21.15.72:0/2069631414 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b0011990 con 0x7fe9bc09e1d0 2023-10-03T10:16:25.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.792+0000 7fe9b959a700 1 -- 172.21.15.72:0/2069631414 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0011d20 con 0x7fe9bc09e1d0 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.793+0000 7fe9c0bd2700 1 -- 172.21.15.72:0/2069631414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9bc09e1d0 msgr2=0x7fe9bc135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.793+0000 7fe9c0bd2700 1 --2- 172.21.15.72:0/2069631414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9bc09e1d0 0x7fe9bc135910 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009870 tx=0x7fe9b0009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.793+0000 7fe9c0bd2700 1 -- 172.21.15.72:0/2069631414 shutdown_connections 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.793+0000 7fe9c0bd2700 1 --2- 172.21.15.72:0/2069631414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9bc135e50 0x7fe9bc138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.793+0000 7fe9c0bd2700 1 --2- 172.21.15.72:0/2069631414 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9bc09e1d0 0x7fe9bc135910 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.793+0000 7fe9c0bd2700 1 -- 172.21.15.72:0/2069631414 >> 172.21.15.72:0/2069631414 conn(0x7fe9bc066f50 msgr2=0x7fe9bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.793+0000 7fe9c0bd2700 1 -- 172.21.15.72:0/2069631414 shutdown_connections 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.793+0000 7fe9c0bd2700 1 -- 172.21.15.72:0/2069631414 wait complete. 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.794+0000 7fe9c0bd2700 1 Processor -- start 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.794+0000 7fe9c0bd2700 1 -- start start 2023-10-03T10:16:25.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.794+0000 7fe9c0bd2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9bc09d6f0 0x7fe9bc06f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.794+0000 7fe9c0bd2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9bc09e1d0 0x7fe9bc06f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.794+0000 7fe9c0bd2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9bc135e50 0x7fe9bc1c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.794+0000 7fe9c0bd2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc06ed40 con 0x7fe9bc09e1d0 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.794+0000 7fe9c0bd2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc122fd0 con 0x7fe9bc09d6f0 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.794+0000 7fe9c0bd2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc132270 con 0x7fe9bc135e50 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.794+0000 7fe9b9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9bc09e1d0 0x7fe9bc06f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.794+0000 7fe9ba59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9bc09d6f0 0x7fe9bc06f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.794+0000 7fe9b9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9bc09e1d0 0x7fe9bc06f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38138/0 (socket says 172.21.15.72:38138) 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.794+0000 7fe9b9d9b700 1 -- 172.21.15.72:0/3435940139 learned_addr learned my addr 172.21.15.72:0/3435940139 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.794+0000 7fe9bad9d700 1 --2- 172.21.15.72:0/3435940139 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9bc135e50 0x7fe9bc1c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.795+0000 7fe9bad9d700 1 -- 172.21.15.72:0/3435940139 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9bc09d6f0 msgr2=0x7fe9bc06f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.795+0000 7fe9bad9d700 1 --2- 172.21.15.72:0/3435940139 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9bc09d6f0 0x7fe9bc06f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.795+0000 7fe9bad9d700 1 -- 172.21.15.72:0/3435940139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9bc09e1d0 msgr2=0x7fe9bc06f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.795+0000 7fe9bad9d700 1 --2- 172.21.15.72:0/3435940139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9bc09e1d0 0x7fe9bc06f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.795+0000 7fe9bad9d700 1 -- 172.21.15.72:0/3435940139 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b4009a70 con 0x7fe9bc135e50 2023-10-03T10:16:25.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.795+0000 7fe9b9d9b700 1 --2- 172.21.15.72:0/3435940139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9bc09e1d0 0x7fe9bc06f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:25.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.795+0000 7fe9bad9d700 1 --2- 172.21.15.72:0/3435940139 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9bc135e50 0x7fe9bc1c80e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400efc0 tx=0x7fe9b400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.795+0000 7fe9aaffd700 1 -- 172.21.15.72:0/3435940139 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b400ca90 con 0x7fe9bc135e50 2023-10-03T10:16:25.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.795+0000 7fe9aaffd700 1 -- 172.21.15.72:0/3435940139 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b400f040 con 0x7fe9bc135e50 2023-10-03T10:16:25.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.795+0000 7fe9c0bd2700 1 -- 172.21.15.72:0/3435940139 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b00094a0 con 0x7fe9bc135e50 2023-10-03T10:16:25.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.795+0000 7fe9aaffd700 1 -- 172.21.15.72:0/3435940139 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b400ce30 con 0x7fe9bc135e50 2023-10-03T10:16:25.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.795+0000 7fe9c0bd2700 1 -- 172.21.15.72:0/3435940139 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9bc0a1c50 con 0x7fe9bc135e50 2023-10-03T10:16:25.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.796+0000 7fe9aaffd700 1 -- 172.21.15.72:0/3435940139 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe9b4014480 con 0x7fe9bc135e50 2023-10-03T10:16:25.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.796+0000 7fe9c0bd2700 1 -- 172.21.15.72:0/3435940139 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9bc074ea0 con 0x7fe9bc135e50 2023-10-03T10:16:25.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.796+0000 7fe9aaffd700 1 -- 172.21.15.72:0/3435940139 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe9b403fce0 con 0x7fe9bc135e50 2023-10-03T10:16:25.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.801+0000 7fe9aaffd700 1 -- 172.21.15.72:0/3435940139 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9b4012910 con 0x7fe9bc135e50 2023-10-03T10:16:25.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.874+0000 7f97b5db2700 1 Processor -- start 2023-10-03T10:16:25.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.874+0000 7f97b5db2700 1 -- start start 2023-10-03T10:16:25.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.875+0000 7f97b5db2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b009d6f0 0x7f97b009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.875+0000 7f97b5db2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97b009e000 0x7f97b01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.875+0000 7f97b5db2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b009b120 con 0x7f97b009e410 2023-10-03T10:16:25.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.875+0000 7f97b5db2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b006b460 con 0x7f97b009d6f0 2023-10-03T10:16:25.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.875+0000 7f97b5db2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97b009a7e0 con 0x7f97b009e000 2023-10-03T10:16:25.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.875+0000 7f97af7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b009d6f0 0x7f97b009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.875+0000 7f97a6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97b009e000 0x7f97b01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.875+0000 7f97affff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f97b009e410 0x7f97b0133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56104/0 (socket says 172.21.15.72:56104) 2023-10-03T10:16:25.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.875+0000 7f97affff700 1 -- 172.21.15.72:0/2278406960 learned_addr learned my addr 172.21.15.72:0/2278406960 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:25.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.875+0000 7f97af7fe700 1 -- 172.21.15.72:0/2278406960 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97b009e000 msgr2=0x7f97b01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.875+0000 7f97af7fe700 1 --2- 172.21.15.72:0/2278406960 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97b009e000 0x7f97b01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.875+0000 7f97af7fe700 1 -- 172.21.15.72:0/2278406960 >> v1:172.21.15.72:6789/0 conn(0x7f97b009e410 legacy=0x7f97b0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.875+0000 7f97af7fe700 1 -- 172.21.15.72:0/2278406960 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b009a500 con 0x7f97b009d6f0 2023-10-03T10:16:25.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.875+0000 7f97aeffd700 1 -- 172.21.15.72:0/2278406960 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755536874 0 0) 0x7f97b009b120 con 0x7f97b009e410 2023-10-03T10:16:25.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.875+0000 7f97af7fe700 1 --2- 172.21.15.72:0/2278406960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b009d6f0 0x7f97b009dac0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009870 tx=0x7f97a0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e94f8d5126695d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.876+0000 7f97aeffd700 1 -- 172.21.15.72:0/2278406960 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0011830 con 0x7f97b009d6f0 2023-10-03T10:16:25.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.876+0000 7f97aeffd700 1 -- 172.21.15.72:0/2278406960 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a0011990 con 0x7f97b009d6f0 2023-10-03T10:16:25.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.876+0000 7f97aeffd700 1 -- 172.21.15.72:0/2278406960 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0011d20 con 0x7f97b009d6f0 2023-10-03T10:16:25.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.876+0000 7f97b5db2700 1 -- 172.21.15.72:0/2278406960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b009d6f0 msgr2=0x7f97b009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.876+0000 7f97b5db2700 1 --2- 172.21.15.72:0/2278406960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b009d6f0 0x7f97b009dac0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009870 tx=0x7f97a0009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:25.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.876+0000 7f97b5db2700 1 -- 172.21.15.72:0/2278406960 shutdown_connections 2023-10-03T10:16:25.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.876+0000 7f97b5db2700 1 --2- 172.21.15.72:0/2278406960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b009d6f0 0x7f97b009dac0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.876+0000 7f97b5db2700 1 --2- 172.21.15.72:0/2278406960 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97b009e000 0x7f97b01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.876+0000 7f97b5db2700 1 -- 172.21.15.72:0/2278406960 >> 172.21.15.72:0/2278406960 conn(0x7f97b0066f50 msgr2=0x7f97b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.876+0000 7f97b5db2700 1 -- 172.21.15.72:0/2278406960 shutdown_connections 2023-10-03T10:16:25.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.876+0000 7f97b5db2700 1 -- 172.21.15.72:0/2278406960 wait complete. 2023-10-03T10:16:25.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.877+0000 7f97b5db2700 1 Processor -- start 2023-10-03T10:16:25.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.878+0000 7f97b5db2700 1 -- start start 2023-10-03T10:16:25.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.878+0000 7f97b5db2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b009d6f0 0x7f97b01a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.878+0000 7f97b5db2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b009e000 0x7f97b01a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.878+0000 7f97b5db2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97b009e410 0x7f97b01a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.878+0000 7f97b5db2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b01a57a0 con 0x7f97b009e000 2023-10-03T10:16:25.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.878+0000 7f97b5db2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b01a5360 con 0x7f97b009d6f0 2023-10-03T10:16:25.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.878+0000 7f97b5db2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00a2eb0 con 0x7f97b009e410 2023-10-03T10:16:25.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.878+0000 7f97a6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b009e000 0x7f97b01a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.878+0000 7f97a6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b009e000 0x7f97b01a3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38150/0 (socket says 172.21.15.72:38150) 2023-10-03T10:16:25.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.878+0000 7f97a6ffd700 1 -- 172.21.15.72:0/1269153256 learned_addr learned my addr 172.21.15.72:0/1269153256 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:25.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.878+0000 7f97af7fe700 1 --2- 172.21.15.72:0/1269153256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b009d6f0 0x7f97b01a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.879+0000 7f97affff700 1 --2- 172.21.15.72:0/1269153256 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97b009e410 0x7f97b01a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.879+0000 7f97a6ffd700 1 -- 172.21.15.72:0/1269153256 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97b009e410 msgr2=0x7f97b01a40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.879+0000 7f97a6ffd700 1 --2- 172.21.15.72:0/1269153256 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97b009e410 0x7f97b01a40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.879+0000 7f97a6ffd700 1 -- 172.21.15.72:0/1269153256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b009d6f0 msgr2=0x7f97b01a3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.879+0000 7f97a6ffd700 1 --2- 172.21.15.72:0/1269153256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b009d6f0 0x7f97b01a3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.879+0000 7f97a6ffd700 1 -- 172.21.15.72:0/1269153256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a00094a0 con 0x7f97b009e000 2023-10-03T10:16:25.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.879+0000 7f97af7fe700 1 --2- 172.21.15.72:0/1269153256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b009d6f0 0x7f97b01a3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:25.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.879+0000 7f97a6ffd700 1 --2- 172.21.15.72:0/1269153256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b009e000 0x7f97b01a3ba0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f979800e980 tx=0x7f979800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.879+0000 7f97acff9700 1 -- 172.21.15.72:0/1269153256 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798009710 con 0x7f97b009e000 2023-10-03T10:16:25.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.879+0000 7f97acff9700 1 -- 172.21.15.72:0/1269153256 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979800c690 con 0x7f97b009e000 2023-10-03T10:16:25.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.879+0000 7f97b5db2700 1 -- 172.21.15.72:0/1269153256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b01a6e10 con 0x7f97b009e000 2023-10-03T10:16:25.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.879+0000 7f97acff9700 1 -- 172.21.15.72:0/1269153256 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979800ca20 con 0x7f97b009e000 2023-10-03T10:16:25.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.879+0000 7f97b5db2700 1 -- 172.21.15.72:0/1269153256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b01b8560 con 0x7f97b009e000 2023-10-03T10:16:25.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.880+0000 7f97acff9700 1 -- 172.21.15.72:0/1269153256 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f979800cb80 con 0x7f97b009e000 2023-10-03T10:16:25.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.880+0000 7f97b5db2700 1 -- 172.21.15.72:0/1269153256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b01a6ab0 con 0x7f97b009e000 2023-10-03T10:16:25.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.880+0000 7f97acff9700 1 -- 172.21.15.72:0/1269153256 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f979803f750 con 0x7f97b009e000 2023-10-03T10:16:25.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.885+0000 7f97acff9700 1 -- 172.21.15.72:0/1269153256 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97b01a6ab0 con 0x7f97b009e000 2023-10-03T10:16:25.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.950+0000 7f117ef7d700 1 -- 172.21.15.72:0/1822774652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1178074ea0 con 0x7f1178134170 2023-10-03T10:16:25.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.951+0000 7f11757fa700 1 -- 172.21.15.72:0/1822774652 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1170025380 con 0x7f1178134170 2023-10-03T10:16:25.951 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:25.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.954+0000 7f117ef7d700 1 -- 172.21.15.72:0/1822774652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1178134170 msgr2=0x7f1178123200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.954+0000 7f117ef7d700 1 --2- 172.21.15.72:0/1822774652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1178134170 0x7f1178123200 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f117809e330 tx=0x7f1170004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.954+0000 7f117ef7d700 1 -- 172.21.15.72:0/1822774652 shutdown_connections 2023-10-03T10:16:25.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.954+0000 7f117ef7d700 1 --2- 172.21.15.72:0/1822774652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1178134170 0x7f1178123200 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.954+0000 7f117ef7d700 1 --2- 172.21.15.72:0/1822774652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11780a0a30 0x7f1178122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.954+0000 7f117ef7d700 1 --2- 172.21.15.72:0/1822774652 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11780a1340 0x7f1178122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.954+0000 7f117ef7d700 1 -- 172.21.15.72:0/1822774652 >> 172.21.15.72:0/1822774652 conn(0x7f11780a6550 msgr2=0x7f117809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.954+0000 7f117ef7d700 1 -- 172.21.15.72:0/1822774652 shutdown_connections 2023-10-03T10:16:25.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.954+0000 7f117ef7d700 1 -- 172.21.15.72:0/1822774652 wait complete. 2023-10-03T10:16:25.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:25.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.996+0000 7fe9c0bd2700 1 -- 172.21.15.72:0/3435940139 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe9bc06fcb0 con 0x7fe9bc135e50 2023-10-03T10:16:25.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.996+0000 7fe9aaffd700 1 -- 172.21.15.72:0/3435940139 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe9b4012340 con 0x7fe9bc135e50 2023-10-03T10:16:25.997 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:25.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.998+0000 7fe9c0bd2700 1 -- 172.21.15.72:0/3435940139 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9bc135e50 msgr2=0x7fe9bc1c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.998+0000 7fe9c0bd2700 1 --2- 172.21.15.72:0/3435940139 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9bc135e50 0x7fe9bc1c80e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400efc0 tx=0x7fe9b400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.998+0000 7fe9c0bd2700 1 -- 172.21.15.72:0/3435940139 shutdown_connections 2023-10-03T10:16:25.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.998+0000 7fe9c0bd2700 1 --2- 172.21.15.72:0/3435940139 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9bc135e50 0x7fe9bc1c80e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.998+0000 7fe9c0bd2700 1 --2- 172.21.15.72:0/3435940139 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9bc09d6f0 0x7fe9bc06f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.998+0000 7fe9c0bd2700 1 --2- 172.21.15.72:0/3435940139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9bc09e1d0 0x7fe9bc06f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.998+0000 7fe9c0bd2700 1 -- 172.21.15.72:0/3435940139 >> 172.21.15.72:0/3435940139 conn(0x7fe9bc066f50 msgr2=0x7fe9bc071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.999+0000 7fe9c0bd2700 1 -- 172.21.15.72:0/3435940139 shutdown_connections 2023-10-03T10:16:26.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:25.999+0000 7fe9c0bd2700 1 -- 172.21.15.72:0/3435940139 wait complete. 2023-10-03T10:16:26.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:26.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.075+0000 7f97b5db2700 1 -- 172.21.15.72:0/1269153256 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f97b01a6ab0 con 0x7f97b009e000 2023-10-03T10:16:26.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.075+0000 7f97acff9700 1 -- 172.21.15.72:0/1269153256 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f97b01a6ab0 con 0x7f97b009e000 2023-10-03T10:16:26.076 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:26.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.077+0000 7f97b5db2700 1 -- 172.21.15.72:0/1269153256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b009e000 msgr2=0x7f97b01a3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.077+0000 7f97b5db2700 1 --2- 172.21.15.72:0/1269153256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b009e000 0x7f97b01a3ba0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f979800e980 tx=0x7f979800ec90 comp rx=0 tx=0).stop 2023-10-03T10:16:26.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.077+0000 7f97b5db2700 1 -- 172.21.15.72:0/1269153256 shutdown_connections 2023-10-03T10:16:26.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.077+0000 7f97b5db2700 1 --2- 172.21.15.72:0/1269153256 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f97b009e410 0x7f97b01a40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.077+0000 7f97b5db2700 1 --2- 172.21.15.72:0/1269153256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b009d6f0 0x7f97b01a3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.077+0000 7f97b5db2700 1 --2- 172.21.15.72:0/1269153256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b009e000 0x7f97b01a3ba0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.077+0000 7f97b5db2700 1 -- 172.21.15.72:0/1269153256 >> 172.21.15.72:0/1269153256 conn(0x7f97b0066f50 msgr2=0x7f97b00a3610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.077+0000 7f97b5db2700 1 -- 172.21.15.72:0/1269153256 shutdown_connections 2023-10-03T10:16:26.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.077+0000 7f97b5db2700 1 -- 172.21.15.72:0/1269153256 wait complete. 2023-10-03T10:16:26.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:26.682 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:26.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.811+0000 7ff1a3ae0700 1 Processor -- start 2023-10-03T10:16:26.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.811+0000 7ff1a3ae0700 1 -- start start 2023-10-03T10:16:26.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a3ae0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff19c133420 0x7ff19c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a3ae0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff19c134260 0x7ff19c1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a3ae0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19c06b990 con 0x7ff19c133e30 2023-10-03T10:16:26.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a3ae0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19c0a0590 con 0x7ff19c134260 2023-10-03T10:16:26.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a3ae0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c09fb80 con 0x7ff19c133420 2023-10-03T10:16:26.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a187c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff19c133420 0x7ff19c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a207d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff19c134260 0x7ff19c1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a187c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff19c133420 0x7ff19c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41816/0 (socket says 172.21.15.72:41816) 2023-10-03T10:16:26.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a207d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff19c134260 0x7ff19c1306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38152/0 (socket says 172.21.15.72:38152) 2023-10-03T10:16:26.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a187c700 1 -- 172.21.15.72:0/738741325 learned_addr learned my addr 172.21.15.72:0/738741325 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:26.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a187c700 1 -- 172.21.15.72:0/738741325 >> v2:172.21.15.72:3300/0 conn(0x7ff19c134260 msgr2=0x7ff19c1306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a187c700 1 --2- 172.21.15.72:0/738741325 >> v2:172.21.15.72:3300/0 conn(0x7ff19c134260 0x7ff19c1306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a187c700 1 -- 172.21.15.72:0/738741325 >> v1:172.21.15.72:6789/0 conn(0x7ff19c133e30 legacy=0x7ff19c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a187c700 1 -- 172.21.15.72:0/738741325 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c0a0030 con 0x7ff19c133420 2023-10-03T10:16:26.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a207d700 1 --2- 172.21.15.72:0/738741325 >> v2:172.21.15.72:3300/0 conn(0x7ff19c134260 0x7ff19c1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a187c700 1 --2- 172.21.15.72:0/738741325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff19c133420 0x7ff19c1337f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff1980098f0 tx=0x7ff198009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba99f738ba066e13 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a087a700 1 -- 172.21.15.72:0/738741325 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198011830 con 0x7ff19c133420 2023-10-03T10:16:26.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a087a700 1 -- 172.21.15.72:0/738741325 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff198011990 con 0x7ff19c133420 2023-10-03T10:16:26.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.812+0000 7ff1a087a700 1 -- 172.21.15.72:0/738741325 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198011d20 con 0x7ff19c133420 2023-10-03T10:16:26.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.813+0000 7ff1a3ae0700 1 -- 172.21.15.72:0/738741325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff19c133420 msgr2=0x7ff19c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.813+0000 7ff1a3ae0700 1 --2- 172.21.15.72:0/738741325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff19c133420 0x7ff19c1337f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff1980098f0 tx=0x7ff198009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.813+0000 7ff1a3ae0700 1 -- 172.21.15.72:0/738741325 shutdown_connections 2023-10-03T10:16:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.813+0000 7ff1a3ae0700 1 --2- 172.21.15.72:0/738741325 >> v2:172.21.15.72:3300/0 conn(0x7ff19c134260 0x7ff19c1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.813+0000 7ff1a3ae0700 1 --2- 172.21.15.72:0/738741325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff19c133420 0x7ff19c1337f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.813+0000 7ff1a3ae0700 1 -- 172.21.15.72:0/738741325 >> 172.21.15.72:0/738741325 conn(0x7ff19c0a4210 msgr2=0x7ff19c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.813+0000 7ff1a3ae0700 1 -- 172.21.15.72:0/738741325 shutdown_connections 2023-10-03T10:16:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.813+0000 7ff1a3ae0700 1 -- 172.21.15.72:0/738741325 wait complete. 2023-10-03T10:16:26.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.814+0000 7ff1a3ae0700 1 Processor -- start 2023-10-03T10:16:26.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.814+0000 7ff1a3ae0700 1 -- start start 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.814+0000 7ff1a3ae0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff19c133420 0x7ff19c0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.814+0000 7ff1a3ae0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff19c133e30 0x7ff19c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.814+0000 7ff1a3ae0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff19c134260 0x7ff19c071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.814+0000 7ff1a3ae0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c12d570 con 0x7ff19c133420 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.814+0000 7ff1a3ae0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c12dae0 con 0x7ff19c133e30 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.814+0000 7ff1a3ae0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c072340 con 0x7ff19c134260 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.814+0000 7ff1a107b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff19c133e30 0x7ff19c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.814+0000 7ff1a207d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff19c134260 0x7ff19c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.814+0000 7ff1a187c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff19c133420 0x7ff19c0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.814+0000 7ff1a207d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff19c134260 0x7ff19c071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41824/0 (socket says 172.21.15.72:41824) 2023-10-03T10:16:26.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.814+0000 7ff1a107b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff19c133e30 0x7ff19c070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41268/0 (socket says 172.21.15.72:41268) 2023-10-03T10:16:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.814+0000 7ff1a207d700 1 -- 172.21.15.72:0/1301747691 learned_addr learned my addr 172.21.15.72:0/1301747691 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.814+0000 7ff1a187c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff19c133420 0x7ff19c0709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38158/0 (socket says 172.21.15.72:38158) 2023-10-03T10:16:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.815+0000 7ff1a187c700 1 -- 172.21.15.72:0/1301747691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff19c134260 msgr2=0x7ff19c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.815+0000 7ff1a187c700 1 --2- 172.21.15.72:0/1301747691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff19c134260 0x7ff19c071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.815+0000 7ff1a187c700 1 -- 172.21.15.72:0/1301747691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff19c133e30 msgr2=0x7ff19c070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.815+0000 7ff1a187c700 1 --2- 172.21.15.72:0/1301747691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff19c133e30 0x7ff19c070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.815+0000 7ff1a187c700 1 -- 172.21.15.72:0/1301747691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff194009a70 con 0x7ff19c133420 2023-10-03T10:16:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.815+0000 7ff1a207d700 1 --2- 172.21.15.72:0/1301747691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff19c134260 0x7ff19c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.815+0000 7ff1a187c700 1 --2- 172.21.15.72:0/1301747691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff19c133420 0x7ff19c0709a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7ff198016000 tx=0x7ff198004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.815+0000 7ff1927fc700 1 -- 172.21.15.72:0/1301747691 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1980036a0 con 0x7ff19c133420 2023-10-03T10:16:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.815+0000 7ff1927fc700 1 -- 172.21.15.72:0/1301747691 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff198003800 con 0x7ff19c133420 2023-10-03T10:16:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.815+0000 7ff1a3ae0700 1 -- 172.21.15.72:0/1301747691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff198009550 con 0x7ff19c133420 2023-10-03T10:16:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.815+0000 7ff1927fc700 1 -- 172.21.15.72:0/1301747691 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198003b70 con 0x7ff19c133420 2023-10-03T10:16:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.815+0000 7ff1a3ae0700 1 -- 172.21.15.72:0/1301747691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c131980 con 0x7ff19c133420 2023-10-03T10:16:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.816+0000 7ff1927fc700 1 -- 172.21.15.72:0/1301747691 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff198021070 con 0x7ff19c133420 2023-10-03T10:16:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.816+0000 7ff1927fc700 1 -- 172.21.15.72:0/1301747691 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff198040a10 con 0x7ff19c133420 2023-10-03T10:16:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.816+0000 7ff1a3ae0700 1 -- 172.21.15.72:0/1301747691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c074ea0 con 0x7ff19c133420 2023-10-03T10:16:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:26.821+0000 7ff1927fc700 1 -- 172.21.15.72:0/1301747691 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff198015080 con 0x7ff19c133420 2023-10-03T10:16:26.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:27.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.008+0000 7ff1a3ae0700 1 -- 172.21.15.72:0/1301747691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff19c06b250 con 0x7ff19c133420 2023-10-03T10:16:27.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.008+0000 7ff1927fc700 1 -- 172.21.15.72:0/1301747691 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff19801b950 con 0x7ff19c133420 2023-10-03T10:16:27.009 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:27.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.010+0000 7ff1a3ae0700 1 -- 172.21.15.72:0/1301747691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff19c133420 msgr2=0x7ff19c0709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.010+0000 7ff1a3ae0700 1 --2- 172.21.15.72:0/1301747691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff19c133420 0x7ff19c0709a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7ff198016000 tx=0x7ff198004750 comp rx=0 tx=0).stop 2023-10-03T10:16:27.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.010+0000 7ff1a3ae0700 1 -- 172.21.15.72:0/1301747691 shutdown_connections 2023-10-03T10:16:27.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.010+0000 7ff1a3ae0700 1 --2- 172.21.15.72:0/1301747691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff19c133420 0x7ff19c0709a0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.010+0000 7ff1a3ae0700 1 --2- 172.21.15.72:0/1301747691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff19c134260 0x7ff19c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.010+0000 7ff1a3ae0700 1 --2- 172.21.15.72:0/1301747691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff19c133e30 0x7ff19c070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.010+0000 7ff1a3ae0700 1 -- 172.21.15.72:0/1301747691 >> 172.21.15.72:0/1301747691 conn(0x7ff19c0a4210 msgr2=0x7ff19c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.011+0000 7ff1a3ae0700 1 -- 172.21.15.72:0/1301747691 shutdown_connections 2023-10-03T10:16:27.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.011+0000 7ff1a3ae0700 1 -- 172.21.15.72:0/1301747691 wait complete. 2023-10-03T10:16:27.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:27.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:27.091 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:27.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.093+0000 7f8639ee1700 1 Processor -- start 2023-10-03T10:16:27.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.093+0000 7f8639ee1700 1 -- start start 2023-10-03T10:16:27.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f8639ee1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f863409e930 0x7f863409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f8639ee1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f863409f650 0x7f8634131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f8639ee1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8634070940 con 0x7f863409f240 2023-10-03T10:16:27.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f8639ee1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863406fd60 con 0x7f863409e930 2023-10-03T10:16:27.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f8639ee1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863406fa80 con 0x7f863409f650 2023-10-03T10:16:27.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f86337fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f863409e930 0x7f863409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f8633fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f863409f650 0x7f8634131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f86337fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f863409e930 0x7f863409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38172/0 (socket says 172.21.15.72:38172) 2023-10-03T10:16:27.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f86337fe700 1 -- 172.21.15.72:0/4050561327 learned_addr learned my addr 172.21.15.72:0/4050561327 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:27.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f8633fff700 1 -- 172.21.15.72:0/4050561327 >> v2:172.21.15.72:3300/0 conn(0x7f863409e930 msgr2=0x7f863409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f8633fff700 1 --2- 172.21.15.72:0/4050561327 >> v2:172.21.15.72:3300/0 conn(0x7f863409e930 0x7f863409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f8633fff700 1 -- 172.21.15.72:0/4050561327 >> v1:172.21.15.72:6789/0 conn(0x7f863409f240 legacy=0x7f86341317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f8633fff700 1 -- 172.21.15.72:0/4050561327 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863409fb60 con 0x7f863409f650 2023-10-03T10:16:27.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f86337fe700 1 --2- 172.21.15.72:0/4050561327 >> v2:172.21.15.72:3300/0 conn(0x7f863409e930 0x7f863409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f8633fff700 1 --2- 172.21.15.72:0/4050561327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f863409f650 0x7f8634131f00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f862c009d90 tx=0x7f862c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b55100225c7e78a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.094+0000 7f86327fc700 1 -- 172.21.15.72:0/4050561327 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c00e070 con 0x7f863409f650 2023-10-03T10:16:27.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.095+0000 7f86327fc700 1 -- 172.21.15.72:0/4050561327 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862c00bb20 con 0x7f863409f650 2023-10-03T10:16:27.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.095+0000 7f86327fc700 1 -- 172.21.15.72:0/4050561327 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c012430 con 0x7f863409f650 2023-10-03T10:16:27.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.095+0000 7f8639ee1700 1 -- 172.21.15.72:0/4050561327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f863409f650 msgr2=0x7f8634131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.095+0000 7f8639ee1700 1 --2- 172.21.15.72:0/4050561327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f863409f650 0x7f8634131f00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f862c009d90 tx=0x7f862c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:27.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.095+0000 7f8639ee1700 1 -- 172.21.15.72:0/4050561327 shutdown_connections 2023-10-03T10:16:27.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.095+0000 7f8639ee1700 1 --2- 172.21.15.72:0/4050561327 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f863409f650 0x7f8634131f00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.095+0000 7f8639ee1700 1 --2- 172.21.15.72:0/4050561327 >> v2:172.21.15.72:3300/0 conn(0x7f863409e930 0x7f863409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.095+0000 7f8639ee1700 1 -- 172.21.15.72:0/4050561327 >> 172.21.15.72:0/4050561327 conn(0x7f86340a4210 msgr2=0x7f86340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.095+0000 7f8639ee1700 1 -- 172.21.15.72:0/4050561327 shutdown_connections 2023-10-03T10:16:27.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.095+0000 7f8639ee1700 1 -- 172.21.15.72:0/4050561327 wait complete. 2023-10-03T10:16:27.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.096+0000 7f8639ee1700 1 Processor -- start 2023-10-03T10:16:27.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.096+0000 7f8639ee1700 1 -- start start 2023-10-03T10:16:27.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f8639ee1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863409e930 0x7f863406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f8639ee1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f863409f240 0x7f863406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f8639ee1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f863409f650 0x7f863406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f8639ee1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86341a87e0 con 0x7f863409e930 2023-10-03T10:16:27.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f8639ee1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86341a9820 con 0x7f863409f650 2023-10-03T10:16:27.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f8639ee1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86340a3630 con 0x7f863409f240 2023-10-03T10:16:27.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f86337fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863409e930 0x7f863406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f86337fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863409e930 0x7f863406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38188/0 (socket says 172.21.15.72:38188) 2023-10-03T10:16:27.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f86337fe700 1 -- 172.21.15.72:0/2201051358 learned_addr learned my addr 172.21.15.72:0/2201051358 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:27.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f8633fff700 1 --2- 172.21.15.72:0/2201051358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f863409f650 0x7f863406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f8632ffd700 1 --2- 172.21.15.72:0/2201051358 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f863409f240 0x7f863406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f86337fe700 1 -- 172.21.15.72:0/2201051358 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f863409f240 msgr2=0x7f863406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f86337fe700 1 --2- 172.21.15.72:0/2201051358 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f863409f240 0x7f863406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f86337fe700 1 -- 172.21.15.72:0/2201051358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f863409f650 msgr2=0x7f863406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f86337fe700 1 --2- 172.21.15.72:0/2201051358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f863409f650 0x7f863406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f86337fe700 1 -- 172.21.15.72:0/2201051358 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8624009550 con 0x7f863409e930 2023-10-03T10:16:27.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.097+0000 7f8633fff700 1 --2- 172.21.15.72:0/2201051358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f863409f650 0x7f863406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.098+0000 7f86337fe700 1 --2- 172.21.15.72:0/2201051358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863409e930 0x7f863406b8b0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f862400ebe0 tx=0x7f862400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.098+0000 7f861bfff700 1 -- 172.21.15.72:0/2201051358 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862400c850 con 0x7f863409e930 2023-10-03T10:16:27.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.098+0000 7f861bfff700 1 -- 172.21.15.72:0/2201051358 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862400c9b0 con 0x7f863409e930 2023-10-03T10:16:27.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.098+0000 7f8639ee1700 1 -- 172.21.15.72:0/2201051358 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862c009a70 con 0x7f863409e930 2023-10-03T10:16:27.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.098+0000 7f861bfff700 1 -- 172.21.15.72:0/2201051358 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862400cd40 con 0x7f863409e930 2023-10-03T10:16:27.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.098+0000 7f8639ee1700 1 -- 172.21.15.72:0/2201051358 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86340a0190 con 0x7f863409e930 2023-10-03T10:16:27.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.098+0000 7f861bfff700 1 -- 172.21.15.72:0/2201051358 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8624013470 con 0x7f863409e930 2023-10-03T10:16:27.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.099+0000 7f861bfff700 1 -- 172.21.15.72:0/2201051358 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f862403fc00 con 0x7f863409e930 2023-10-03T10:16:27.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.099+0000 7f8639ee1700 1 -- 172.21.15.72:0/2201051358 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86341a0b30 con 0x7f863409e930 2023-10-03T10:16:27.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.103+0000 7f861bfff700 1 -- 172.21.15.72:0/2201051358 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f862401b3b0 con 0x7f863409e930 2023-10-03T10:16:27.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.140+0000 7fab6b501700 1 Processor -- start 2023-10-03T10:16:27.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.140+0000 7fab6b501700 1 -- start start 2023-10-03T10:16:27.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.140+0000 7fab6b501700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab6409d6f0 0x7fab6409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.140+0000 7fab6b501700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab6409e410 0x7fab64134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab6b501700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6409b120 con 0x7fab6409e000 2023-10-03T10:16:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab6b501700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6406b460 con 0x7fab6409e410 2023-10-03T10:16:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab6b501700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6409a7e0 con 0x7fab6409d6f0 2023-10-03T10:16:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab6929d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab6409d6f0 0x7fab6409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab69a9e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab6409e410 0x7fab64134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab68a9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fab6409e000 0x7fab641339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56136/0 (socket says 172.21.15.72:56136) 2023-10-03T10:16:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab6929d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab6409d6f0 0x7fab6409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41296/0 (socket says 172.21.15.72:41296) 2023-10-03T10:16:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab68a9c700 1 -- 172.21.15.72:0/1321852014 learned_addr learned my addr 172.21.15.72:0/1321852014 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab69a9e700 1 -- 172.21.15.72:0/1321852014 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab6409d6f0 msgr2=0x7fab6409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab69a9e700 1 --2- 172.21.15.72:0/1321852014 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab6409d6f0 0x7fab6409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab69a9e700 1 -- 172.21.15.72:0/1321852014 >> v1:172.21.15.72:6789/0 conn(0x7fab6409e000 legacy=0x7fab641339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab69a9e700 1 -- 172.21.15.72:0/1321852014 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6409a500 con 0x7fab6409e410 2023-10-03T10:16:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab5bfff700 1 -- 172.21.15.72:0/1321852014 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566298661 0 0) 0x7fab6409b120 con 0x7fab6409e000 2023-10-03T10:16:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab6929d700 1 --2- 172.21.15.72:0/1321852014 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab6409d6f0 0x7fab6409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab69a9e700 1 --2- 172.21.15.72:0/1321852014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab6409e410 0x7fab64134100 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009d90 tx=0x7fab5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6ad8f0e3e97b3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab5bfff700 1 -- 172.21.15.72:0/1321852014 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c00e070 con 0x7fab6409e410 2023-10-03T10:16:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab5bfff700 1 -- 172.21.15.72:0/1321852014 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c00bb20 con 0x7fab6409e410 2023-10-03T10:16:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.141+0000 7fab5bfff700 1 -- 172.21.15.72:0/1321852014 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c012430 con 0x7fab6409e410 2023-10-03T10:16:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.142+0000 7fab6b501700 1 -- 172.21.15.72:0/1321852014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab6409e410 msgr2=0x7fab64134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.142+0000 7fab6b501700 1 --2- 172.21.15.72:0/1321852014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab6409e410 0x7fab64134100 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009d90 tx=0x7fab5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.142+0000 7fab6b501700 1 -- 172.21.15.72:0/1321852014 shutdown_connections 2023-10-03T10:16:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.142+0000 7fab6b501700 1 --2- 172.21.15.72:0/1321852014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab6409e410 0x7fab64134100 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.142+0000 7fab6b501700 1 --2- 172.21.15.72:0/1321852014 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab6409d6f0 0x7fab6409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.142+0000 7fab6b501700 1 -- 172.21.15.72:0/1321852014 >> 172.21.15.72:0/1321852014 conn(0x7fab64066f50 msgr2=0x7fab6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.142+0000 7fab6b501700 1 -- 172.21.15.72:0/1321852014 shutdown_connections 2023-10-03T10:16:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.142+0000 7fab6b501700 1 -- 172.21.15.72:0/1321852014 wait complete. 2023-10-03T10:16:27.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.143+0000 7fab6b501700 1 Processor -- start 2023-10-03T10:16:27.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.143+0000 7fab6b501700 1 -- start start 2023-10-03T10:16:27.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.143+0000 7fab6b501700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab6409d6f0 0x7fab641c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.143+0000 7fab6b501700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab6409e000 0x7fab641c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.143+0000 7fab6b501700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab6409e410 0x7fab641c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.143+0000 7fab6b501700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab641a8a30 con 0x7fab6409d6f0 2023-10-03T10:16:27.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.143+0000 7fab6b501700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab641a9780 con 0x7fab6409e410 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.143+0000 7fab6b501700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab641c8e80 con 0x7fab6409e000 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.143+0000 7fab68a9c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab6409e000 0x7fab641c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.144+0000 7fab68a9c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab6409e000 0x7fab641c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41842/0 (socket says 172.21.15.72:41842) 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.144+0000 7fab68a9c700 1 -- 172.21.15.72:0/3577294599 learned_addr learned my addr 172.21.15.72:0/3577294599 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.144+0000 7fab69a9e700 1 --2- 172.21.15.72:0/3577294599 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab6409e410 0x7fab641c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.144+0000 7fab6929d700 1 --2- 172.21.15.72:0/3577294599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab6409d6f0 0x7fab641c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.144+0000 7fab68a9c700 1 -- 172.21.15.72:0/3577294599 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab6409e410 msgr2=0x7fab641c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.144+0000 7fab68a9c700 1 --2- 172.21.15.72:0/3577294599 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab6409e410 0x7fab641c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.144+0000 7fab68a9c700 1 -- 172.21.15.72:0/3577294599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab6409d6f0 msgr2=0x7fab641c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.144+0000 7fab68a9c700 1 --2- 172.21.15.72:0/3577294599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab6409d6f0 0x7fab641c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.144+0000 7fab68a9c700 1 -- 172.21.15.72:0/3577294599 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab600094a0 con 0x7fab6409e000 2023-10-03T10:16:27.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.144+0000 7fab68a9c700 1 --2- 172.21.15.72:0/3577294599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab6409e000 0x7fab641c8940 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fab5400c520 tx=0x7fab5400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.144+0000 7fab59ffb700 1 -- 172.21.15.72:0/3577294599 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54004c80 con 0x7fab6409e000 2023-10-03T10:16:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.144+0000 7fab59ffb700 1 -- 172.21.15.72:0/3577294599 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab54004de0 con 0x7fab6409e000 2023-10-03T10:16:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.144+0000 7fab6b501700 1 -- 172.21.15.72:0/3577294599 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5c009a70 con 0x7fab6409e000 2023-10-03T10:16:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.144+0000 7fab59ffb700 1 -- 172.21.15.72:0/3577294599 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54007310 con 0x7fab6409e000 2023-10-03T10:16:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.144+0000 7fab6b501700 1 -- 172.21.15.72:0/3577294599 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab641a85e0 con 0x7fab6409e000 2023-10-03T10:16:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.145+0000 7fab59ffb700 1 -- 172.21.15.72:0/3577294599 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab54007470 con 0x7fab6409e000 2023-10-03T10:16:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.145+0000 7fab59ffb700 1 -- 172.21.15.72:0/3577294599 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fab54040d00 con 0x7fab6409e000 2023-10-03T10:16:27.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.146+0000 7fab6b501700 1 -- 172.21.15.72:0/3577294599 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab64074ea0 con 0x7fab6409e000 2023-10-03T10:16:27.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.150+0000 7fab59ffb700 1 -- 172.21.15.72:0/3577294599 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab54044060 con 0x7fab6409e000 2023-10-03T10:16:27.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.219+0000 7f9d84c5e700 1 Processor -- start 2023-10-03T10:16:27.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.220+0000 7f9d84c5e700 1 -- start start 2023-10-03T10:16:27.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.220+0000 7f9d84c5e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d800a0a30 0x7f9d800a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.220+0000 7f9d84c5e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d80138d80 0x7f9d8013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.220+0000 7f9d84c5e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d800a2a70 con 0x7f9d8009d630 2023-10-03T10:16:27.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.220+0000 7f9d84c5e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d800a01d0 con 0x7f9d80138d80 2023-10-03T10:16:27.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.220+0000 7f9d84c5e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8009e2b0 con 0x7f9d800a0a30 2023-10-03T10:16:27.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.220+0000 7f9d7e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d800a0a30 0x7f9d800a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.220+0000 7f9d7dd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9d8009d630 0x7f9d800a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56142/0 (socket says 172.21.15.72:56142) 2023-10-03T10:16:27.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.220+0000 7f9d7dd9b700 1 -- 172.21.15.72:0/1827388249 learned_addr learned my addr 172.21.15.72:0/1827388249 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:27.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.220+0000 7f9d7ed9d700 1 --2- 172.21.15.72:0/1827388249 >> v2:172.21.15.72:3300/0 conn(0x7f9d80138d80 0x7f9d8013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.221+0000 7f9d7d59a700 1 -- 172.21.15.72:0/1827388249 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170647536 0 0) 0x7f9d800a2a70 con 0x7f9d8009d630 2023-10-03T10:16:27.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.221+0000 7f9d7d59a700 1 -- 172.21.15.72:0/1827388249 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d680035b0 con 0x7f9d8009d630 2023-10-03T10:16:27.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.221+0000 7f9d7e59c700 1 -- 172.21.15.72:0/1827388249 >> v2:172.21.15.72:3300/0 conn(0x7f9d80138d80 msgr2=0x7f9d8013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.221+0000 7f9d7e59c700 1 --2- 172.21.15.72:0/1827388249 >> v2:172.21.15.72:3300/0 conn(0x7f9d80138d80 0x7f9d8013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.221+0000 7f9d7e59c700 1 -- 172.21.15.72:0/1827388249 >> v1:172.21.15.72:6789/0 conn(0x7f9d8009d630 legacy=0x7f9d800a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.221+0000 7f9d7e59c700 1 -- 172.21.15.72:0/1827388249 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8009dc50 con 0x7f9d800a0a30 2023-10-03T10:16:27.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.221+0000 7f9d7e59c700 1 --2- 172.21.15.72:0/1827388249 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d800a0a30 0x7f9d800a0e00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009840 tx=0x7f9d70009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e3c850575920de server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.221+0000 7f9d7d59a700 1 -- 172.21.15.72:0/1827388249 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70011830 con 0x7f9d800a0a30 2023-10-03T10:16:27.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.221+0000 7f9d7d59a700 1 -- 172.21.15.72:0/1827388249 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d70011990 con 0x7f9d800a0a30 2023-10-03T10:16:27.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.221+0000 7f9d7d59a700 1 -- 172.21.15.72:0/1827388249 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70011d20 con 0x7f9d800a0a30 2023-10-03T10:16:27.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.222+0000 7f9d84c5e700 1 -- 172.21.15.72:0/1827388249 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d800a0a30 msgr2=0x7f9d800a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.222+0000 7f9d84c5e700 1 --2- 172.21.15.72:0/1827388249 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d800a0a30 0x7f9d800a0e00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9d70009840 tx=0x7f9d70009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:27.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.222+0000 7f9d84c5e700 1 -- 172.21.15.72:0/1827388249 shutdown_connections 2023-10-03T10:16:27.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.222+0000 7f9d84c5e700 1 --2- 172.21.15.72:0/1827388249 >> v2:172.21.15.72:3300/0 conn(0x7f9d80138d80 0x7f9d8013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.222+0000 7f9d84c5e700 1 --2- 172.21.15.72:0/1827388249 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d800a0a30 0x7f9d800a0e00 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.222+0000 7f9d84c5e700 1 -- 172.21.15.72:0/1827388249 >> 172.21.15.72:0/1827388249 conn(0x7f9d800a3050 msgr2=0x7f9d800a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.222+0000 7f9d84c5e700 1 -- 172.21.15.72:0/1827388249 shutdown_connections 2023-10-03T10:16:27.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.222+0000 7f9d84c5e700 1 -- 172.21.15.72:0/1827388249 wait complete. 2023-10-03T10:16:27.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.223+0000 7f9d84c5e700 1 Processor -- start 2023-10-03T10:16:27.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.223+0000 7f9d84c5e700 1 -- start start 2023-10-03T10:16:27.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.223+0000 7f9d84c5e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d8009d630 0x7f9d801338b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.223+0000 7f9d84c5e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d800a0a30 0x7f9d80133df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.223+0000 7f9d84c5e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d80138d80 0x7f9d80134330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.223+0000 7f9d84c5e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d80136b20 con 0x7f9d800a0a30 2023-10-03T10:16:27.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.223+0000 7f9d84c5e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d80134ca0 con 0x7f9d80138d80 2023-10-03T10:16:27.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.223+0000 7f9d84c5e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800a0410 con 0x7f9d8009d630 2023-10-03T10:16:27.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.223+0000 7f9d7e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d8009d630 0x7f9d801338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.223+0000 7f9d7dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d800a0a30 0x7f9d80133df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.223+0000 7f9d7ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d80138d80 0x7f9d80134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.223+0000 7f9d7e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d8009d630 0x7f9d801338b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41848/0 (socket says 172.21.15.72:41848) 2023-10-03T10:16:27.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.223+0000 7f9d7dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d800a0a30 0x7f9d80133df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38216/0 (socket says 172.21.15.72:38216) 2023-10-03T10:16:27.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.223+0000 7f9d7e59c700 1 -- 172.21.15.72:0/3223135640 learned_addr learned my addr 172.21.15.72:0/3223135640 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:27.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.224+0000 7f9d7e59c700 1 -- 172.21.15.72:0/3223135640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d80138d80 msgr2=0x7f9d80134330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.224+0000 7f9d7e59c700 1 --2- 172.21.15.72:0/3223135640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d80138d80 0x7f9d80134330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.224+0000 7f9d7e59c700 1 -- 172.21.15.72:0/3223135640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d800a0a30 msgr2=0x7f9d80133df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.224+0000 7f9d7e59c700 1 --2- 172.21.15.72:0/3223135640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d800a0a30 0x7f9d80133df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.224+0000 7f9d7e59c700 1 -- 172.21.15.72:0/3223135640 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d700094a0 con 0x7f9d8009d630 2023-10-03T10:16:27.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.224+0000 7f9d7dd9b700 1 --2- 172.21.15.72:0/3223135640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d800a0a30 0x7f9d80133df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.224+0000 7f9d7e59c700 1 --2- 172.21.15.72:0/3223135640 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d8009d630 0x7f9d801338b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9d700090b0 tx=0x7f9d70004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.224+0000 7f9d6effd700 1 -- 172.21.15.72:0/3223135640 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70004380 con 0x7f9d8009d630 2023-10-03T10:16:27.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.224+0000 7f9d6effd700 1 -- 172.21.15.72:0/3223135640 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7001f070 con 0x7f9d8009d630 2023-10-03T10:16:27.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.224+0000 7f9d84c5e700 1 -- 172.21.15.72:0/3223135640 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d80136df0 con 0x7f9d8009d630 2023-10-03T10:16:27.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.224+0000 7f9d6effd700 1 -- 172.21.15.72:0/3223135640 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700036a0 con 0x7f9d8009d630 2023-10-03T10:16:27.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.224+0000 7f9d84c5e700 1 -- 172.21.15.72:0/3223135640 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d801370b0 con 0x7f9d8009d630 2023-10-03T10:16:27.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.225+0000 7f9d6effd700 1 -- 172.21.15.72:0/3223135640 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d70021030 con 0x7f9d8009d630 2023-10-03T10:16:27.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.225+0000 7f9d84c5e700 1 -- 172.21.15.72:0/3223135640 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d800747f0 con 0x7f9d8009d630 2023-10-03T10:16:27.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.225+0000 7f9d6effd700 1 -- 172.21.15.72:0/3223135640 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9d70040770 con 0x7f9d8009d630 2023-10-03T10:16:27.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.230+0000 7f9d6effd700 1 -- 172.21.15.72:0/3223135640 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d700239c0 con 0x7f9d8009d630 2023-10-03T10:16:27.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.302+0000 7f8639ee1700 1 -- 172.21.15.72:0/2201051358 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8634074ea0 con 0x7f863409e930 2023-10-03T10:16:27.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.302+0000 7f861bfff700 1 -- 172.21.15.72:0/2201051358 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8624024350 con 0x7f863409e930 2023-10-03T10:16:27.303 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.304+0000 7f8639ee1700 1 -- 172.21.15.72:0/2201051358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863409e930 msgr2=0x7f863406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.304+0000 7f8639ee1700 1 --2- 172.21.15.72:0/2201051358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863409e930 0x7f863406b8b0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f862400ebe0 tx=0x7f862400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.304+0000 7f8639ee1700 1 -- 172.21.15.72:0/2201051358 shutdown_connections 2023-10-03T10:16:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.304+0000 7f8639ee1700 1 --2- 172.21.15.72:0/2201051358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863409e930 0x7f863406b8b0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.304+0000 7f8639ee1700 1 --2- 172.21.15.72:0/2201051358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f863409f650 0x7f863406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.304+0000 7f8639ee1700 1 --2- 172.21.15.72:0/2201051358 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f863409f240 0x7f863406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.304+0000 7f8639ee1700 1 -- 172.21.15.72:0/2201051358 >> 172.21.15.72:0/2201051358 conn(0x7f86340a4210 msgr2=0x7f86341b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.304+0000 7f8639ee1700 1 -- 172.21.15.72:0/2201051358 shutdown_connections 2023-10-03T10:16:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.304+0000 7f8639ee1700 1 -- 172.21.15.72:0/2201051358 wait complete. 2023-10-03T10:16:27.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:27.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.345+0000 7fab6b501700 1 -- 172.21.15.72:0/3577294599 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fab641a7870 con 0x7fab6409e000 2023-10-03T10:16:27.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.345+0000 7fab59ffb700 1 -- 172.21.15.72:0/3577294599 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fab540123b0 con 0x7fab6409e000 2023-10-03T10:16:27.346 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:27.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.347+0000 7fab6b501700 1 -- 172.21.15.72:0/3577294599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab6409e000 msgr2=0x7fab641c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.347+0000 7fab6b501700 1 --2- 172.21.15.72:0/3577294599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab6409e000 0x7fab641c8940 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fab5400c520 tx=0x7fab5400c830 comp rx=0 tx=0).stop 2023-10-03T10:16:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.347+0000 7fab6b501700 1 -- 172.21.15.72:0/3577294599 shutdown_connections 2023-10-03T10:16:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.347+0000 7fab6b501700 1 --2- 172.21.15.72:0/3577294599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab6409d6f0 0x7fab641c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.347+0000 7fab6b501700 1 --2- 172.21.15.72:0/3577294599 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab6409e410 0x7fab641c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.347+0000 7fab6b501700 1 --2- 172.21.15.72:0/3577294599 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab6409e000 0x7fab641c8940 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.348+0000 7fab6b501700 1 -- 172.21.15.72:0/3577294599 >> 172.21.15.72:0/3577294599 conn(0x7fab64066f50 msgr2=0x7fab641bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.348+0000 7fab6b501700 1 -- 172.21.15.72:0/3577294599 shutdown_connections 2023-10-03T10:16:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.348+0000 7fab6b501700 1 -- 172.21.15.72:0/3577294599 wait complete. 2023-10-03T10:16:27.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:27.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.423+0000 7f9d84c5e700 1 -- 172.21.15.72:0/3223135640 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d80135c70 con 0x7f9d8009d630 2023-10-03T10:16:27.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.423+0000 7f9d6effd700 1 -- 172.21.15.72:0/3223135640 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9d7001b430 con 0x7f9d8009d630 2023-10-03T10:16:27.424 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:27.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.425+0000 7f9d84c5e700 1 -- 172.21.15.72:0/3223135640 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d8009d630 msgr2=0x7f9d801338b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.425+0000 7f9d84c5e700 1 --2- 172.21.15.72:0/3223135640 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d8009d630 0x7f9d801338b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9d700090b0 tx=0x7f9d70004750 comp rx=0 tx=0).stop 2023-10-03T10:16:27.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.425+0000 7f9d84c5e700 1 -- 172.21.15.72:0/3223135640 shutdown_connections 2023-10-03T10:16:27.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.425+0000 7f9d84c5e700 1 --2- 172.21.15.72:0/3223135640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d80138d80 0x7f9d80134330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.425+0000 7f9d84c5e700 1 --2- 172.21.15.72:0/3223135640 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d8009d630 0x7f9d801338b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.425+0000 7f9d84c5e700 1 --2- 172.21.15.72:0/3223135640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d800a0a30 0x7f9d80133df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.425+0000 7f9d84c5e700 1 -- 172.21.15.72:0/3223135640 >> 172.21.15.72:0/3223135640 conn(0x7f9d800a3050 msgr2=0x7f9d8009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.425+0000 7f9d84c5e700 1 -- 172.21.15.72:0/3223135640 shutdown_connections 2023-10-03T10:16:27.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:27.425+0000 7f9d84c5e700 1 -- 172.21.15.72:0/3223135640 wait complete. 2023-10-03T10:16:27.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:28.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:28.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.151+0000 7f2608645700 1 Processor -- start 2023-10-03T10:16:28.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.151+0000 7f2608645700 1 -- start start 2023-10-03T10:16:28.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f2608645700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f26001338a0 0x7f2600133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f2608645700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f260009de50 0x7f260009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f2608645700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f260009e760 0x7f260013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f2608645700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260006fef0 con 0x7f26001338a0 2023-10-03T10:16:28.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f2608645700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260006ef30 con 0x7f260009de50 2023-10-03T10:16:28.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f2608645700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26001334b0 con 0x7f260009e760 2023-10-03T10:16:28.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f26063e1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f26001338a0 0x7f2600133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f2606be2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f260009e760 0x7f260013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f2605be0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f260009de50 0x7f260009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f2606be2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f260009e760 0x7f260013a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41862/0 (socket says 172.21.15.72:41862) 2023-10-03T10:16:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f2606be2700 1 -- 172.21.15.72:0/72203928 learned_addr learned my addr 172.21.15.72:0/72203928 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f26063e1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f26001338a0 0x7f2600133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38218/0 (socket says 172.21.15.72:38218) 2023-10-03T10:16:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f2605be0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f260009de50 0x7f260009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41318/0 (socket says 172.21.15.72:41318) 2023-10-03T10:16:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f26063e1700 1 -- 172.21.15.72:0/72203928 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f260009e760 msgr2=0x7f260013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f26063e1700 1 --2- 172.21.15.72:0/72203928 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f260009e760 0x7f260013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f26063e1700 1 -- 172.21.15.72:0/72203928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f260009de50 msgr2=0x7f260009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f26063e1700 1 --2- 172.21.15.72:0/72203928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f260009de50 0x7f260009e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f26063e1700 1 -- 172.21.15.72:0/72203928 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260006fc30 con 0x7f26001338a0 2023-10-03T10:16:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f2606be2700 1 --2- 172.21.15.72:0/72203928 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f260009e760 0x7f260013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f26063e1700 1 --2- 172.21.15.72:0/72203928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26001338a0 0x7f2600133c70 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009840 tx=0x7f25f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46186c604285c23f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f26053df700 1 -- 172.21.15.72:0/72203928 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0011830 con 0x7f26001338a0 2023-10-03T10:16:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f26053df700 1 -- 172.21.15.72:0/72203928 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f0011990 con 0x7f26001338a0 2023-10-03T10:16:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.152+0000 7f26053df700 1 -- 172.21.15.72:0/72203928 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0011d20 con 0x7f26001338a0 2023-10-03T10:16:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.153+0000 7f2608645700 1 -- 172.21.15.72:0/72203928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26001338a0 msgr2=0x7f2600133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.153+0000 7f2608645700 1 --2- 172.21.15.72:0/72203928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26001338a0 0x7f2600133c70 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009840 tx=0x7f25f0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.153+0000 7f2608645700 1 -- 172.21.15.72:0/72203928 shutdown_connections 2023-10-03T10:16:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.153+0000 7f2608645700 1 --2- 172.21.15.72:0/72203928 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f260009e760 0x7f260013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.153+0000 7f2608645700 1 --2- 172.21.15.72:0/72203928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26001338a0 0x7f2600133c70 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.153+0000 7f2608645700 1 --2- 172.21.15.72:0/72203928 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f260009de50 0x7f260009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.153+0000 7f2608645700 1 -- 172.21.15.72:0/72203928 >> 172.21.15.72:0/72203928 conn(0x7f26000a2aa0 msgr2=0x7f26000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.153+0000 7f2608645700 1 -- 172.21.15.72:0/72203928 shutdown_connections 2023-10-03T10:16:28.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.153+0000 7f2608645700 1 -- 172.21.15.72:0/72203928 wait complete. 2023-10-03T10:16:28.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.154+0000 7f2608645700 1 Processor -- start 2023-10-03T10:16:28.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.154+0000 7f2608645700 1 -- start start 2023-10-03T10:16:28.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.154+0000 7f2608645700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f260009de50 0x7f260011d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.154+0000 7f2608645700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260009e760 0x7f260011dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.154+0000 7f2608645700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26001338a0 0x7f260011e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.154+0000 7f2608645700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26001208d0 con 0x7f260009e760 2023-10-03T10:16:28.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.154+0000 7f2608645700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260006f640 con 0x7f26001338a0 2023-10-03T10:16:28.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.154+0000 7f2608645700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26000a0f90 con 0x7f260009de50 2023-10-03T10:16:28.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.154+0000 7f26063e1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f260009de50 0x7f260011d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.154+0000 7f2605be0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260009e760 0x7f260011dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.154+0000 7f26063e1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f260009de50 0x7f260011d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41878/0 (socket says 172.21.15.72:41878) 2023-10-03T10:16:28.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.154+0000 7f26063e1700 1 -- 172.21.15.72:0/1078381197 learned_addr learned my addr 172.21.15.72:0/1078381197 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:28.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.154+0000 7f2606be2700 1 --2- 172.21.15.72:0/1078381197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26001338a0 0x7f260011e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.155+0000 7f26063e1700 1 -- 172.21.15.72:0/1078381197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26001338a0 msgr2=0x7f260011e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.155+0000 7f26063e1700 1 --2- 172.21.15.72:0/1078381197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26001338a0 0x7f260011e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.155+0000 7f26063e1700 1 -- 172.21.15.72:0/1078381197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260009e760 msgr2=0x7f260011dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.155+0000 7f26063e1700 1 --2- 172.21.15.72:0/1078381197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260009e760 0x7f260011dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.155+0000 7f26063e1700 1 -- 172.21.15.72:0/1078381197 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f8009b30 con 0x7f260009de50 2023-10-03T10:16:28.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.155+0000 7f2605be0700 1 --2- 172.21.15.72:0/1078381197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260009e760 0x7f260011dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.155+0000 7f2606be2700 1 --2- 172.21.15.72:0/1078381197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26001338a0 0x7f260011e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.155+0000 7f26063e1700 1 --2- 172.21.15.72:0/1078381197 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f260009de50 0x7f260011d6b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f25f00090b0 tx=0x7f25f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.155+0000 7f25f6ffd700 1 -- 172.21.15.72:0/1078381197 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0004450 con 0x7f260009de50 2023-10-03T10:16:28.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.155+0000 7f25f6ffd700 1 -- 172.21.15.72:0/1078381197 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f001f070 con 0x7f260009de50 2023-10-03T10:16:28.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.155+0000 7f2608645700 1 -- 172.21.15.72:0/1078381197 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f00094a0 con 0x7f260009de50 2023-10-03T10:16:28.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.155+0000 7f25f6ffd700 1 -- 172.21.15.72:0/1078381197 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f00038e0 con 0x7f260009de50 2023-10-03T10:16:28.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.155+0000 7f2608645700 1 -- 172.21.15.72:0/1078381197 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2600120480 con 0x7f260009de50 2023-10-03T10:16:28.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.156+0000 7f25f6ffd700 1 -- 172.21.15.72:0/1078381197 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25f0003a40 con 0x7f260009de50 2023-10-03T10:16:28.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.156+0000 7f25f6ffd700 1 -- 172.21.15.72:0/1078381197 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f25f0021070 con 0x7f260009de50 2023-10-03T10:16:28.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.156+0000 7f2608645700 1 -- 172.21.15.72:0/1078381197 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260011a470 con 0x7f260009de50 2023-10-03T10:16:28.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.161+0000 7f25f6ffd700 1 -- 172.21.15.72:0/1078381197 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25f0015020 con 0x7f260009de50 2023-10-03T10:16:28.318 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.345+0000 7f2608645700 1 -- 172.21.15.72:0/1078381197 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2600120ce0 con 0x7f260009de50 2023-10-03T10:16:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.346+0000 7f25f6ffd700 1 -- 172.21.15.72:0/1078381197 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25f0033070 con 0x7f260009de50 2023-10-03T10:16:28.347 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:28.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.348+0000 7f2608645700 1 -- 172.21.15.72:0/1078381197 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f260009de50 msgr2=0x7f260011d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.348+0000 7f2608645700 1 --2- 172.21.15.72:0/1078381197 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f260009de50 0x7f260011d6b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f25f00090b0 tx=0x7f25f0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:28.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.348+0000 7f2608645700 1 -- 172.21.15.72:0/1078381197 shutdown_connections 2023-10-03T10:16:28.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.348+0000 7f2608645700 1 --2- 172.21.15.72:0/1078381197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f26001338a0 0x7f260011e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.348+0000 7f2608645700 1 --2- 172.21.15.72:0/1078381197 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f260009de50 0x7f260011d6b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.348+0000 7f2608645700 1 --2- 172.21.15.72:0/1078381197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f260009e760 0x7f260011dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.348+0000 7f2608645700 1 -- 172.21.15.72:0/1078381197 >> 172.21.15.72:0/1078381197 conn(0x7f26000a2aa0 msgr2=0x7f26001bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.348+0000 7f2608645700 1 -- 172.21.15.72:0/1078381197 shutdown_connections 2023-10-03T10:16:28.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.348+0000 7f2608645700 1 -- 172.21.15.72:0/1078381197 wait complete. 2023-10-03T10:16:28.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:28.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:28.438 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:28.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.443+0000 7fe84c3e5700 1 Processor -- start 2023-10-03T10:16:28.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.443+0000 7fe84c3e5700 1 -- start start 2023-10-03T10:16:28.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.444+0000 7fe84c3e5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8440a1510 0x7fe844138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.444+0000 7fe84c3e5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe844139250 0x7fe84413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.444+0000 7fe84c3e5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84409edd0 con 0x7fe8440a0a30 2023-10-03T10:16:28.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.444+0000 7fe84c3e5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8440a18e0 con 0x7fe844139250 2023-10-03T10:16:28.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.444+0000 7fe84c3e5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84409e1f0 con 0x7fe8440a1510 2023-10-03T10:16:28.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.444+0000 7fe849980700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8440a1510 0x7fe844138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.444+0000 7fe84a982700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe844139250 0x7fe84413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.444+0000 7fe849980700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8440a1510 0x7fe844138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56828/0 (socket says 172.21.15.72:56828) 2023-10-03T10:16:28.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.444+0000 7fe849980700 1 -- 172.21.15.72:0/1966826585 learned_addr learned my addr 172.21.15.72:0/1966826585 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:28.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.444+0000 7fe84a982700 1 -- 172.21.15.72:0/1966826585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8440a1510 msgr2=0x7fe844138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.444+0000 7fe84a982700 1 --2- 172.21.15.72:0/1966826585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8440a1510 0x7fe844138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.444+0000 7fe84a982700 1 -- 172.21.15.72:0/1966826585 >> v1:172.21.15.72:6789/0 conn(0x7fe8440a0a30 legacy=0x7fe8440a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.444+0000 7fe84a982700 1 -- 172.21.15.72:0/1966826585 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84409dc50 con 0x7fe844139250 2023-10-03T10:16:28.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.444+0000 7fe849980700 1 --2- 172.21.15.72:0/1966826585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8440a1510 0x7fe844138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.445+0000 7fe84a982700 1 --2- 172.21.15.72:0/1966826585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe844139250 0x7fe84413b630 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009dc0 tx=0x7fe83c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c060f10f391bbe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.445+0000 7fe84917f700 1 -- 172.21.15.72:0/1966826585 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00e070 con 0x7fe844139250 2023-10-03T10:16:28.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.445+0000 7fe84917f700 1 -- 172.21.15.72:0/1966826585 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c00bae0 con 0x7fe844139250 2023-10-03T10:16:28.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.445+0000 7fe84917f700 1 -- 172.21.15.72:0/1966826585 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00be90 con 0x7fe844139250 2023-10-03T10:16:28.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.445+0000 7fe84c3e5700 1 -- 172.21.15.72:0/1966826585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe844139250 msgr2=0x7fe84413b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.445+0000 7fe84c3e5700 1 --2- 172.21.15.72:0/1966826585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe844139250 0x7fe84413b630 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009dc0 tx=0x7fe83c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:28.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.446+0000 7fe84c3e5700 1 -- 172.21.15.72:0/1966826585 shutdown_connections 2023-10-03T10:16:28.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.446+0000 7fe84c3e5700 1 --2- 172.21.15.72:0/1966826585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe844139250 0x7fe84413b630 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.446+0000 7fe84c3e5700 1 --2- 172.21.15.72:0/1966826585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8440a1510 0x7fe844138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.446+0000 7fe84c3e5700 1 -- 172.21.15.72:0/1966826585 >> 172.21.15.72:0/1966826585 conn(0x7fe8440a6550 msgr2=0x7fe8440a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.446+0000 7fe84c3e5700 1 -- 172.21.15.72:0/1966826585 shutdown_connections 2023-10-03T10:16:28.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.446+0000 7fe84c3e5700 1 -- 172.21.15.72:0/1966826585 wait complete. 2023-10-03T10:16:28.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.446+0000 7fe84c3e5700 1 Processor -- start 2023-10-03T10:16:28.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe84c3e5700 1 -- start start 2023-10-03T10:16:28.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe84c3e5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8440a0a30 0x7fe844122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe84c3e5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8440a1510 0x7fe844122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe84c3e5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe844139250 0x7fe8441233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe84c3e5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe844138250 con 0x7fe844139250 2023-10-03T10:16:28.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe84c3e5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe844138810 con 0x7fe8440a1510 2023-10-03T10:16:28.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe84c3e5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe844124640 con 0x7fe8440a0a30 2023-10-03T10:16:28.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe849980700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8440a1510 0x7fe844122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe84a181700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8440a0a30 0x7fe844122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe849980700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8440a1510 0x7fe844122e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56840/0 (socket says 172.21.15.72:56840) 2023-10-03T10:16:28.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe849980700 1 -- 172.21.15.72:0/2467508894 learned_addr learned my addr 172.21.15.72:0/2467508894 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:28.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe84a982700 1 --2- 172.21.15.72:0/2467508894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe844139250 0x7fe8441233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe849980700 1 -- 172.21.15.72:0/2467508894 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8440a0a30 msgr2=0x7fe844122920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe849980700 1 --2- 172.21.15.72:0/2467508894 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8440a0a30 0x7fe844122920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe849980700 1 -- 172.21.15.72:0/2467508894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe844139250 msgr2=0x7fe8441233a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.447+0000 7fe849980700 1 --2- 172.21.15.72:0/2467508894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe844139250 0x7fe8441233a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.448+0000 7fe849980700 1 -- 172.21.15.72:0/2467508894 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe834009550 con 0x7fe8440a1510 2023-10-03T10:16:28.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.448+0000 7fe84a181700 1 --2- 172.21.15.72:0/2467508894 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8440a0a30 0x7fe844122920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.448+0000 7fe849980700 1 --2- 172.21.15.72:0/2467508894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8440a1510 0x7fe844122e60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe83400ebe0 tx=0x7fe83400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.448+0000 7fe83affd700 1 -- 172.21.15.72:0/2467508894 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83400c850 con 0x7fe8440a1510 2023-10-03T10:16:28.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.448+0000 7fe83affd700 1 -- 172.21.15.72:0/2467508894 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83400c9b0 con 0x7fe8440a1510 2023-10-03T10:16:28.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.448+0000 7fe84c3e5700 1 -- 172.21.15.72:0/2467508894 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83c009a70 con 0x7fe8440a1510 2023-10-03T10:16:28.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.448+0000 7fe83affd700 1 -- 172.21.15.72:0/2467508894 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83400cd40 con 0x7fe8440a1510 2023-10-03T10:16:28.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.448+0000 7fe84c3e5700 1 -- 172.21.15.72:0/2467508894 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe844125ef0 con 0x7fe8440a1510 2023-10-03T10:16:28.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.449+0000 7fe84c3e5700 1 -- 172.21.15.72:0/2467508894 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe844074ea0 con 0x7fe8440a1510 2023-10-03T10:16:28.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.449+0000 7fe83affd700 1 -- 172.21.15.72:0/2467508894 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe834013470 con 0x7fe8440a1510 2023-10-03T10:16:28.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.450+0000 7fe83affd700 1 -- 172.21.15.72:0/2467508894 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe834040070 con 0x7fe8440a1510 2023-10-03T10:16:28.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.454+0000 7fe83affd700 1 -- 172.21.15.72:0/2467508894 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe834024760 con 0x7fe8440a1510 2023-10-03T10:16:28.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.528+0000 7fc0b0321700 1 Processor -- start 2023-10-03T10:16:28.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.528+0000 7fc0b0321700 1 -- start start 2023-10-03T10:16:28.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.528+0000 7fc0b0321700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc0a809d630 0x7fc0a80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.528+0000 7fc0b0321700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0a8138d80 0x7fc0a813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.528+0000 7fc0b0321700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a80a2a70 con 0x7fc0a80a0a30 2023-10-03T10:16:28.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.529+0000 7fc0b0321700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a80a01d0 con 0x7fc0a809d630 2023-10-03T10:16:28.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.529+0000 7fc0b0321700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a809e2b0 con 0x7fc0a8138d80 2023-10-03T10:16:28.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.529+0000 7fc0ad8bc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc0a809d630 0x7fc0a80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.529+0000 7fc0ad8bc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc0a809d630 0x7fc0a80a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59992/0 (socket says 172.21.15.72:59992) 2023-10-03T10:16:28.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.529+0000 7fc0ad8bc700 1 -- 172.21.15.72:0/1542544712 learned_addr learned my addr 172.21.15.72:0/1542544712 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:28.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.529+0000 7fc0ae8be700 1 --2- 172.21.15.72:0/1542544712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0a8138d80 0x7fc0a813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.529+0000 7fc0ad8bc700 1 -- 172.21.15.72:0/1542544712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0a8138d80 msgr2=0x7fc0a813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.529+0000 7fc0ad8bc700 1 --2- 172.21.15.72:0/1542544712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0a8138d80 0x7fc0a813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.529+0000 7fc0ad8bc700 1 -- 172.21.15.72:0/1542544712 >> v1:172.21.15.72:6789/0 conn(0x7fc0a80a0a30 legacy=0x7fc0a80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.529+0000 7fc0ad8bc700 1 -- 172.21.15.72:0/1542544712 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a809dc50 con 0x7fc0a809d630 2023-10-03T10:16:28.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.529+0000 7fc0ad8bc700 1 --2- 172.21.15.72:0/1542544712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0a809d630 0x7fc0a80a1510 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fc0980098f0 tx=0x7fc098009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d52fe17523a262 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.529+0000 7fc0ad0bb700 1 -- 172.21.15.72:0/1542544712 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098004230 con 0x7fc0a809d630 2023-10-03T10:16:28.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.529+0000 7fc0ad0bb700 1 -- 172.21.15.72:0/1542544712 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc098004390 con 0x7fc0a809d630 2023-10-03T10:16:28.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.529+0000 7fc0ad0bb700 1 -- 172.21.15.72:0/1542544712 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0980036a0 con 0x7fc0a809d630 2023-10-03T10:16:28.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.530+0000 7fc0b0321700 1 -- 172.21.15.72:0/1542544712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0a809d630 msgr2=0x7fc0a80a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.530+0000 7fc0b0321700 1 --2- 172.21.15.72:0/1542544712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0a809d630 0x7fc0a80a1510 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fc0980098f0 tx=0x7fc098009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:28.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.530+0000 7fc0b0321700 1 -- 172.21.15.72:0/1542544712 shutdown_connections 2023-10-03T10:16:28.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.530+0000 7fc0b0321700 1 --2- 172.21.15.72:0/1542544712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0a8138d80 0x7fc0a813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.530+0000 7fc0b0321700 1 --2- 172.21.15.72:0/1542544712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0a809d630 0x7fc0a80a1510 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.530+0000 7fc0b0321700 1 -- 172.21.15.72:0/1542544712 >> 172.21.15.72:0/1542544712 conn(0x7fc0a80a3050 msgr2=0x7fc0a80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.530+0000 7fc0b0321700 1 -- 172.21.15.72:0/1542544712 shutdown_connections 2023-10-03T10:16:28.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.530+0000 7fc0b0321700 1 -- 172.21.15.72:0/1542544712 wait complete. 2023-10-03T10:16:28.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.531+0000 7fc0b0321700 1 Processor -- start 2023-10-03T10:16:28.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.531+0000 7fc0b0321700 1 -- start start 2023-10-03T10:16:28.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.531+0000 7fc0b0321700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0a809d630 0x7fc0a811d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.531+0000 7fc0b0321700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0a80a0a30 0x7fc0a811dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.531+0000 7fc0b0321700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0a8138d80 0x7fc0a811e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.531+0000 7fc0b0321700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a811fac0 con 0x7fc0a80a0a30 2023-10-03T10:16:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.531+0000 7fc0b0321700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a811f280 con 0x7fc0a8138d80 2023-10-03T10:16:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.531+0000 7fc0b0321700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a8121190 con 0x7fc0a809d630 2023-10-03T10:16:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc0ad8bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0a80a0a30 0x7fc0a811dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc0ae0bd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0a809d630 0x7fc0a811d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc0ad8bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0a80a0a30 0x7fc0a811dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59996/0 (socket says 172.21.15.72:59996) 2023-10-03T10:16:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc0ad8bc700 1 -- 172.21.15.72:0/3864066532 learned_addr learned my addr 172.21.15.72:0/3864066532 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc0ae8be700 1 --2- 172.21.15.72:0/3864066532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0a8138d80 0x7fc0a811e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc0ae0bd700 1 -- 172.21.15.72:0/3864066532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0a8138d80 msgr2=0x7fc0a811e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc0ae0bd700 1 --2- 172.21.15.72:0/3864066532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0a8138d80 0x7fc0a811e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc0ae0bd700 1 -- 172.21.15.72:0/3864066532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0a80a0a30 msgr2=0x7fc0a811dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc0ae0bd700 1 --2- 172.21.15.72:0/3864066532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0a80a0a30 0x7fc0a811dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc0ae0bd700 1 -- 172.21.15.72:0/3864066532 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc098009550 con 0x7fc0a809d630 2023-10-03T10:16:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc0ad8bc700 1 --2- 172.21.15.72:0/3864066532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0a80a0a30 0x7fc0a811dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc0ae0bd700 1 --2- 172.21.15.72:0/3864066532 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0a809d630 0x7fc0a811d750 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c430 tx=0x7fc0a400c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc09effd700 1 -- 172.21.15.72:0/3864066532 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4011590 con 0x7fc0a809d630 2023-10-03T10:16:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc09effd700 1 -- 172.21.15.72:0/3864066532 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a40116f0 con 0x7fc0a809d630 2023-10-03T10:16:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc09effd700 1 -- 172.21.15.72:0/3864066532 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4011aa0 con 0x7fc0a809d630 2023-10-03T10:16:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc0b0321700 1 -- 172.21.15.72:0/3864066532 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a8120540 con 0x7fc0a809d630 2023-10-03T10:16:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.532+0000 7fc0b0321700 1 -- 172.21.15.72:0/3864066532 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a80a0410 con 0x7fc0a809d630 2023-10-03T10:16:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.533+0000 7fc09effd700 1 -- 172.21.15.72:0/3864066532 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0a4011c00 con 0x7fc0a809d630 2023-10-03T10:16:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.533+0000 7fc09effd700 1 -- 172.21.15.72:0/3864066532 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc0a403f2c0 con 0x7fc0a809d630 2023-10-03T10:16:28.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.533+0000 7fc0b0321700 1 -- 172.21.15.72:0/3864066532 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a80a2760 con 0x7fc0a809d630 2023-10-03T10:16:28.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.538+0000 7fc09effd700 1 -- 172.21.15.72:0/3864066532 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0a4012420 con 0x7fc0a809d630 2023-10-03T10:16:28.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.569+0000 7f15f020b700 1 Processor -- start 2023-10-03T10:16:28.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.569+0000 7f15f020b700 1 -- start start 2023-10-03T10:16:28.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15f020b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15e806a770 0x7f15e806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15f020b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15e806b080 0x7f15e8131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15f020b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15e8131b40 0x7f15e8131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15f020b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e809ece0 con 0x7f15e806a770 2023-10-03T10:16:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15f020b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e809e760 con 0x7f15e8131b40 2023-10-03T10:16:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15f020b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15e809e040 con 0x7f15e806b080 2023-10-03T10:16:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15ed7a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15e806b080 0x7f15e8131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15ed7a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15e806b080 0x7f15e8131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47338/0 (socket says 172.21.15.72:47338) 2023-10-03T10:16:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15ee7a8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15e8131b40 0x7f15e8131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15edfa7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15e806a770 0x7f15e806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15ed7a6700 1 -- 172.21.15.72:0/241196209 learned_addr learned my addr 172.21.15.72:0/241196209 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15ed7a6700 1 -- 172.21.15.72:0/241196209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15e8131b40 msgr2=0x7f15e8131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15ed7a6700 1 --2- 172.21.15.72:0/241196209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15e8131b40 0x7f15e8131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15ed7a6700 1 -- 172.21.15.72:0/241196209 >> v2:172.21.15.72:3300/0 conn(0x7f15e806a770 msgr2=0x7f15e806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:28.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15ed7a6700 1 --2- 172.21.15.72:0/241196209 >> v2:172.21.15.72:3300/0 conn(0x7f15e806a770 0x7f15e806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15ed7a6700 1 -- 172.21.15.72:0/241196209 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e809f630 con 0x7f15e806b080 2023-10-03T10:16:28.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.570+0000 7f15edfa7700 1 --2- 172.21.15.72:0/241196209 >> v2:172.21.15.72:3300/0 conn(0x7f15e806a770 0x7f15e806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:28.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.571+0000 7f15ed7a6700 1 --2- 172.21.15.72:0/241196209 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15e806b080 0x7f15e8131600 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f15d80098f0 tx=0x7f15d8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd8754538948f0d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.571+0000 7f15ecfa5700 1 -- 172.21.15.72:0/241196209 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8011830 con 0x7f15e806b080 2023-10-03T10:16:28.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.571+0000 7f15ecfa5700 1 -- 172.21.15.72:0/241196209 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d8011990 con 0x7f15e806b080 2023-10-03T10:16:28.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.571+0000 7f15ecfa5700 1 -- 172.21.15.72:0/241196209 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8011d20 con 0x7f15e806b080 2023-10-03T10:16:28.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.571+0000 7f15f020b700 1 -- 172.21.15.72:0/241196209 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15e806b080 msgr2=0x7f15e8131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.571+0000 7f15f020b700 1 --2- 172.21.15.72:0/241196209 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15e806b080 0x7f15e8131600 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f15d80098f0 tx=0x7f15d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:28.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.571+0000 7f15f020b700 1 -- 172.21.15.72:0/241196209 shutdown_connections 2023-10-03T10:16:28.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.571+0000 7f15f020b700 1 --2- 172.21.15.72:0/241196209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15e8131b40 0x7f15e8131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.571+0000 7f15f020b700 1 --2- 172.21.15.72:0/241196209 >> v2:172.21.15.72:3300/0 conn(0x7f15e806a770 0x7f15e806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.571+0000 7f15f020b700 1 --2- 172.21.15.72:0/241196209 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15e806b080 0x7f15e8131600 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.571+0000 7f15f020b700 1 -- 172.21.15.72:0/241196209 >> 172.21.15.72:0/241196209 conn(0x7f15e8066f50 msgr2=0x7f15e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.572+0000 7f15f020b700 1 -- 172.21.15.72:0/241196209 shutdown_connections 2023-10-03T10:16:28.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.572+0000 7f15f020b700 1 -- 172.21.15.72:0/241196209 wait complete. 2023-10-03T10:16:28.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.573+0000 7f15f020b700 1 Processor -- start 2023-10-03T10:16:28.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.573+0000 7f15f020b700 1 -- start start 2023-10-03T10:16:28.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.573+0000 7f15f020b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15e806a770 0x7f15e81c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.573+0000 7f15f020b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15e806b080 0x7f15e81c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.573+0000 7f15f020b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15e8131b40 0x7f15e81c1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:28.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.573+0000 7f15f020b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e8071e60 con 0x7f15e8131b40 2023-10-03T10:16:28.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.573+0000 7f15f020b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e81c80b0 con 0x7f15e806a770 2023-10-03T10:16:28.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.573+0000 7f15f020b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15e811ab70 con 0x7f15e806b080 2023-10-03T10:16:28.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.573+0000 7f15edfa7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15e806a770 0x7f15e81c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.573+0000 7f15edfa7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15e806a770 0x7f15e81c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56856/0 (socket says 172.21.15.72:56856) 2023-10-03T10:16:28.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.573+0000 7f15edfa7700 1 -- 172.21.15.72:0/3607844770 learned_addr learned my addr 172.21.15.72:0/3607844770 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:28.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.574+0000 7f15ed7a6700 1 --2- 172.21.15.72:0/3607844770 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15e806b080 0x7f15e81c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.574+0000 7f15ee7a8700 1 --2- 172.21.15.72:0/3607844770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15e8131b40 0x7f15e81c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:28.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.574+0000 7f15edfa7700 1 -- 172.21.15.72:0/3607844770 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15e806b080 msgr2=0x7f15e81c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.574+0000 7f15edfa7700 1 --2- 172.21.15.72:0/3607844770 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15e806b080 0x7f15e81c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.574+0000 7f15edfa7700 1 -- 172.21.15.72:0/3607844770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15e8131b40 msgr2=0x7f15e81c1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.574+0000 7f15edfa7700 1 --2- 172.21.15.72:0/3607844770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15e8131b40 0x7f15e81c1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.574+0000 7f15edfa7700 1 -- 172.21.15.72:0/3607844770 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e40094a0 con 0x7f15e806a770 2023-10-03T10:16:28.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.574+0000 7f15edfa7700 1 --2- 172.21.15.72:0/3607844770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15e806a770 0x7f15e81c8590 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f15e400ebe0 tx=0x7f15e400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:28.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.574+0000 7f15de7fc700 1 -- 172.21.15.72:0/3607844770 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e400c850 con 0x7f15e806a770 2023-10-03T10:16:28.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.574+0000 7f15de7fc700 1 -- 172.21.15.72:0/3607844770 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e400c9b0 con 0x7f15e806a770 2023-10-03T10:16:28.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.574+0000 7f15f020b700 1 -- 172.21.15.72:0/3607844770 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d8009550 con 0x7f15e806a770 2023-10-03T10:16:28.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.574+0000 7f15de7fc700 1 -- 172.21.15.72:0/3607844770 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e400cd40 con 0x7f15e806a770 2023-10-03T10:16:28.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.574+0000 7f15f020b700 1 -- 172.21.15.72:0/3607844770 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e8137d30 con 0x7f15e806a770 2023-10-03T10:16:28.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.575+0000 7f15de7fc700 1 -- 172.21.15.72:0/3607844770 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15e4013470 con 0x7f15e806a770 2023-10-03T10:16:28.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.575+0000 7f15f020b700 1 -- 172.21.15.72:0/3607844770 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e8074ea0 con 0x7f15e806a770 2023-10-03T10:16:28.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.575+0000 7f15de7fc700 1 -- 172.21.15.72:0/3607844770 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f15e403f7c0 con 0x7f15e806a770 2023-10-03T10:16:28.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.580+0000 7f15de7fc700 1 -- 172.21.15.72:0/3607844770 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15e4013720 con 0x7f15e806a770 2023-10-03T10:16:28.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.653+0000 7fe84c3e5700 1 -- 172.21.15.72:0/2467508894 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe8440a1d10 con 0x7fe8440a1510 2023-10-03T10:16:28.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.653+0000 7fe83affd700 1 -- 172.21.15.72:0/2467508894 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe834017020 con 0x7fe8440a1510 2023-10-03T10:16:28.654 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:28.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.655+0000 7fe84c3e5700 1 -- 172.21.15.72:0/2467508894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8440a1510 msgr2=0x7fe844122e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.655+0000 7fe84c3e5700 1 --2- 172.21.15.72:0/2467508894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8440a1510 0x7fe844122e60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe83400ebe0 tx=0x7fe83400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.655+0000 7fe84c3e5700 1 -- 172.21.15.72:0/2467508894 shutdown_connections 2023-10-03T10:16:28.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.655+0000 7fe84c3e5700 1 --2- 172.21.15.72:0/2467508894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe844139250 0x7fe8441233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.655+0000 7fe84c3e5700 1 --2- 172.21.15.72:0/2467508894 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8440a0a30 0x7fe844122920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.655+0000 7fe84c3e5700 1 --2- 172.21.15.72:0/2467508894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8440a1510 0x7fe844122e60 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.655+0000 7fe84c3e5700 1 -- 172.21.15.72:0/2467508894 >> 172.21.15.72:0/2467508894 conn(0x7fe8440a6550 msgr2=0x7fe8440a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.655+0000 7fe84c3e5700 1 -- 172.21.15.72:0/2467508894 shutdown_connections 2023-10-03T10:16:28.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.655+0000 7fe84c3e5700 1 -- 172.21.15.72:0/2467508894 wait complete. 2023-10-03T10:16:28.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:28.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.759+0000 7fc0b0321700 1 -- 172.21.15.72:0/3864066532 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc0a80747f0 con 0x7fc0a809d630 2023-10-03T10:16:28.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.760+0000 7fc09effd700 1 -- 172.21.15.72:0/3864066532 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc0a403f0c0 con 0x7fc0a809d630 2023-10-03T10:16:28.761 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:28.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.762+0000 7fc0b0321700 1 -- 172.21.15.72:0/3864066532 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0a809d630 msgr2=0x7fc0a811d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.762+0000 7fc0b0321700 1 --2- 172.21.15.72:0/3864066532 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0a809d630 0x7fc0a811d750 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c430 tx=0x7fc0a400c740 comp rx=0 tx=0).stop 2023-10-03T10:16:28.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.762+0000 7fc0b0321700 1 -- 172.21.15.72:0/3864066532 shutdown_connections 2023-10-03T10:16:28.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.762+0000 7fc0b0321700 1 --2- 172.21.15.72:0/3864066532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0a8138d80 0x7fc0a811e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.762+0000 7fc0b0321700 1 --2- 172.21.15.72:0/3864066532 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0a809d630 0x7fc0a811d750 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.762+0000 7fc0b0321700 1 --2- 172.21.15.72:0/3864066532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0a80a0a30 0x7fc0a811dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.762+0000 7fc0b0321700 1 -- 172.21.15.72:0/3864066532 >> 172.21.15.72:0/3864066532 conn(0x7fc0a80a3050 msgr2=0x7fc0a80a5140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.762+0000 7fc0b0321700 1 -- 172.21.15.72:0/3864066532 shutdown_connections 2023-10-03T10:16:28.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.762+0000 7fc0b0321700 1 -- 172.21.15.72:0/3864066532 wait complete. 2023-10-03T10:16:28.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:28.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.799+0000 7f15f020b700 1 -- 172.21.15.72:0/3607844770 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f15e811b830 con 0x7f15e806a770 2023-10-03T10:16:28.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.800+0000 7f15de7fc700 1 -- 172.21.15.72:0/3607844770 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f15e4021030 con 0x7f15e806a770 2023-10-03T10:16:28.800 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:28.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.802+0000 7f15f020b700 1 -- 172.21.15.72:0/3607844770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15e806a770 msgr2=0x7f15e81c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.802+0000 7f15f020b700 1 --2- 172.21.15.72:0/3607844770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15e806a770 0x7f15e81c8590 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f15e400ebe0 tx=0x7f15e400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.802+0000 7f15f020b700 1 -- 172.21.15.72:0/3607844770 shutdown_connections 2023-10-03T10:16:28.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.802+0000 7f15f020b700 1 --2- 172.21.15.72:0/3607844770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15e8131b40 0x7f15e81c1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.802+0000 7f15f020b700 1 --2- 172.21.15.72:0/3607844770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15e806a770 0x7f15e81c8590 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.802+0000 7f15f020b700 1 --2- 172.21.15.72:0/3607844770 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15e806b080 0x7f15e81c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.802+0000 7f15f020b700 1 -- 172.21.15.72:0/3607844770 >> 172.21.15.72:0/3607844770 conn(0x7f15e8066f50 msgr2=0x7f15e80708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.802+0000 7f15f020b700 1 -- 172.21.15.72:0/3607844770 shutdown_connections 2023-10-03T10:16:28.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:28.802+0000 7f15f020b700 1 -- 172.21.15.72:0/3607844770 wait complete. 2023-10-03T10:16:28.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:29.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:29.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.489+0000 7f82fa9da700 1 Processor -- start 2023-10-03T10:16:29.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.489+0000 7f82fa9da700 1 -- start start 2023-10-03T10:16:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82fa9da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f409e930 0x7f82f409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82fa9da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f409f240 0x7f82f4133be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82fa9da700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f406c9f0 con 0x7f82f4134120 2023-10-03T10:16:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82fa9da700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f406c670 con 0x7f82f409e930 2023-10-03T10:16:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82fa9da700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82f406bc90 con 0x7f82f409f240 2023-10-03T10:16:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f409e930 0x7f82f409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f409f240 0x7f82f4133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f8f77700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f82f4134120 0x7f82f413ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44630/0 (socket says 172.21.15.72:44630) 2023-10-03T10:16:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f409e930 0x7f82f409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56866/0 (socket says 172.21.15.72:56866) 2023-10-03T10:16:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f409f240 0x7f82f4133be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47366/0 (socket says 172.21.15.72:47366) 2023-10-03T10:16:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f8f77700 1 -- 172.21.15.72:0/1058210697 learned_addr learned my addr 172.21.15.72:0/1058210697 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f2ffd700 1 -- 172.21.15.72:0/1058210697 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122308259 0 0) 0x7f82ec001490 con 0x7f82f4134120 2023-10-03T10:16:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f2ffd700 1 -- 172.21.15.72:0/1058210697 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82dc0035b0 con 0x7f82f4134120 2023-10-03T10:16:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f3fff700 1 -- 172.21.15.72:0/1058210697 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f409f240 msgr2=0x7f82f4133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f3fff700 1 --2- 172.21.15.72:0/1058210697 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f409f240 0x7f82f4133be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f3fff700 1 -- 172.21.15.72:0/1058210697 >> v1:172.21.15.72:6789/0 conn(0x7f82f4134120 legacy=0x7f82f413ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f3fff700 1 -- 172.21.15.72:0/1058210697 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f406d860 con 0x7f82f409e930 2023-10-03T10:16:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f37fe700 1 --2- 172.21.15.72:0/1058210697 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f409f240 0x7f82f4133be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f3fff700 1 --2- 172.21.15.72:0/1058210697 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f409e930 0x7f82f409ed00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009870 tx=0x7f82e8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18a36e64c0bbf31f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f2ffd700 1 -- 172.21.15.72:0/1058210697 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8011830 con 0x7f82f409e930 2023-10-03T10:16:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f2ffd700 1 -- 172.21.15.72:0/1058210697 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e8011990 con 0x7f82f409e930 2023-10-03T10:16:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.490+0000 7f82f2ffd700 1 -- 172.21.15.72:0/1058210697 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8011d00 con 0x7f82f409e930 2023-10-03T10:16:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.491+0000 7f82fa9da700 1 -- 172.21.15.72:0/1058210697 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f409e930 msgr2=0x7f82f409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.491+0000 7f82fa9da700 1 --2- 172.21.15.72:0/1058210697 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f409e930 0x7f82f409ed00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009870 tx=0x7f82e8009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.491+0000 7f82fa9da700 1 -- 172.21.15.72:0/1058210697 shutdown_connections 2023-10-03T10:16:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.491+0000 7f82fa9da700 1 --2- 172.21.15.72:0/1058210697 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f409e930 0x7f82f409ed00 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.491+0000 7f82fa9da700 1 --2- 172.21.15.72:0/1058210697 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f409f240 0x7f82f4133be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.491+0000 7f82fa9da700 1 -- 172.21.15.72:0/1058210697 >> 172.21.15.72:0/1058210697 conn(0x7f82f40a4210 msgr2=0x7f82f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.491+0000 7f82fa9da700 1 -- 172.21.15.72:0/1058210697 shutdown_connections 2023-10-03T10:16:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.491+0000 7f82fa9da700 1 -- 172.21.15.72:0/1058210697 wait complete. 2023-10-03T10:16:29.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.492+0000 7f82fa9da700 1 Processor -- start 2023-10-03T10:16:29.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.492+0000 7f82fa9da700 1 -- start start 2023-10-03T10:16:29.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.492+0000 7f82fa9da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f409e930 0x7f82f4122a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.492+0000 7f82fa9da700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f409f240 0x7f82f4122f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.492+0000 7f82fa9da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f4134120 0x7f82f41234d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.492+0000 7f82fa9da700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f4124580 con 0x7f82f409f240 2023-10-03T10:16:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.492+0000 7f82fa9da700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f4123e90 con 0x7f82f409e930 2023-10-03T10:16:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.492+0000 7f82fa9da700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82f4124770 con 0x7f82f4134120 2023-10-03T10:16:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.492+0000 7f82f37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f409f240 0x7f82f4122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.492+0000 7f82f37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f409f240 0x7f82f4122f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60018/0 (socket says 172.21.15.72:60018) 2023-10-03T10:16:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.492+0000 7f82f37fe700 1 -- 172.21.15.72:0/1839250565 learned_addr learned my addr 172.21.15.72:0/1839250565 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.492+0000 7f82f8f77700 1 --2- 172.21.15.72:0/1839250565 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f4134120 0x7f82f41234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.493+0000 7f82f3fff700 1 --2- 172.21.15.72:0/1839250565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f409e930 0x7f82f4122a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.493+0000 7f82f8f77700 1 -- 172.21.15.72:0/1839250565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f409e930 msgr2=0x7f82f4122a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.493+0000 7f82f8f77700 1 --2- 172.21.15.72:0/1839250565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f409e930 0x7f82f4122a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.493+0000 7f82f8f77700 1 -- 172.21.15.72:0/1839250565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f409f240 msgr2=0x7f82f4122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.493+0000 7f82f8f77700 1 --2- 172.21.15.72:0/1839250565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f409f240 0x7f82f4122f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.493+0000 7f82f8f77700 1 -- 172.21.15.72:0/1839250565 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e40094a0 con 0x7f82f4134120 2023-10-03T10:16:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.493+0000 7f82f37fe700 1 --2- 172.21.15.72:0/1839250565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f409f240 0x7f82f4122f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.493+0000 7f82f8f77700 1 --2- 172.21.15.72:0/1839250565 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f4134120 0x7f82f41234d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00cad0 tx=0x7f82ec00cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.493+0000 7f82f0ff9700 1 -- 172.21.15.72:0/1839250565 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec00a9a0 con 0x7f82f4134120 2023-10-03T10:16:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.493+0000 7f82f0ff9700 1 -- 172.21.15.72:0/1839250565 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec00ab00 con 0x7f82f4134120 2023-10-03T10:16:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.493+0000 7f82fa9da700 1 -- 172.21.15.72:0/1839250565 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e80094a0 con 0x7f82f4134120 2023-10-03T10:16:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.493+0000 7f82f0ff9700 1 -- 172.21.15.72:0/1839250565 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec00ae90 con 0x7f82f4134120 2023-10-03T10:16:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.493+0000 7f82fa9da700 1 -- 172.21.15.72:0/1839250565 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f4125ef0 con 0x7f82f4134120 2023-10-03T10:16:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.494+0000 7f82fa9da700 1 -- 172.21.15.72:0/1839250565 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f406cc10 con 0x7f82f4134120 2023-10-03T10:16:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.495+0000 7f82f0ff9700 1 -- 172.21.15.72:0/1839250565 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82ec01b3b0 con 0x7f82f4134120 2023-10-03T10:16:29.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.495+0000 7f82f0ff9700 1 -- 172.21.15.72:0/1839250565 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f82ec03f430 con 0x7f82f4134120 2023-10-03T10:16:29.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.500+0000 7f82f0ff9700 1 -- 172.21.15.72:0/1839250565 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82ec0192c0 con 0x7f82f4134120 2023-10-03T10:16:29.669 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:29.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.686+0000 7f82fa9da700 1 -- 172.21.15.72:0/1839250565 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f82f406c9f0 con 0x7f82f4134120 2023-10-03T10:16:29.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.687+0000 7f82f0ff9700 1 -- 172.21.15.72:0/1839250565 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82f406c9f0 con 0x7f82f4134120 2023-10-03T10:16:29.688 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.689+0000 7f82fa9da700 1 -- 172.21.15.72:0/1839250565 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f4134120 msgr2=0x7f82f41234d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.689+0000 7f82fa9da700 1 --2- 172.21.15.72:0/1839250565 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f4134120 0x7f82f41234d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00cad0 tx=0x7f82ec00cde0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.689+0000 7f82fa9da700 1 -- 172.21.15.72:0/1839250565 shutdown_connections 2023-10-03T10:16:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.689+0000 7f82fa9da700 1 --2- 172.21.15.72:0/1839250565 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82f4134120 0x7f82f41234d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.689+0000 7f82fa9da700 1 --2- 172.21.15.72:0/1839250565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82f409e930 0x7f82f4122a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.689+0000 7f82fa9da700 1 --2- 172.21.15.72:0/1839250565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82f409f240 0x7f82f4122f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.689+0000 7f82fa9da700 1 -- 172.21.15.72:0/1839250565 >> 172.21.15.72:0/1839250565 conn(0x7f82f40a4210 msgr2=0x7f82f40a2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.689+0000 7f82fa9da700 1 -- 172.21.15.72:0/1839250565 shutdown_connections 2023-10-03T10:16:29.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.689+0000 7f82fa9da700 1 -- 172.21.15.72:0/1839250565 wait complete. 2023-10-03T10:16:29.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:29.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:29.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.792+0000 7febaa964700 1 Processor -- start 2023-10-03T10:16:29.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.792+0000 7febaa964700 1 -- start start 2023-10-03T10:16:29.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7febaa964700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba412cf60 0x7feba406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7febaa964700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feba4130430 0x7feba4137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7febaa964700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba412cd90 con 0x7feba412f8b0 2023-10-03T10:16:29.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7febaa964700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba412d330 con 0x7feba412cf60 2023-10-03T10:16:29.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7febaa964700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feba4071780 con 0x7feba4130430 2023-10-03T10:16:29.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7feba3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba412cf60 0x7feba406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7feba8f01700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feba4130430 0x7feba4137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7feba8f01700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feba4130430 0x7feba4137c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47386/0 (socket says 172.21.15.72:47386) 2023-10-03T10:16:29.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7feba3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba412cf60 0x7feba406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56888/0 (socket says 172.21.15.72:56888) 2023-10-03T10:16:29.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7feba8f01700 1 -- 172.21.15.72:0/28236721 learned_addr learned my addr 172.21.15.72:0/28236721 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:29.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7feba8f01700 1 -- 172.21.15.72:0/28236721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba412cf60 msgr2=0x7feba406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:29.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7feba8f01700 1 --2- 172.21.15.72:0/28236721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba412cf60 0x7feba406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7feba2ffd700 1 -- 172.21.15.72:0/28236721 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663375847 0 0) 0x7feba412cd90 con 0x7feba412f8b0 2023-10-03T10:16:29.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7feba8f01700 1 -- 172.21.15.72:0/28236721 >> v1:172.21.15.72:6789/0 conn(0x7feba412f8b0 legacy=0x7feba412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7feba8f01700 1 -- 172.21.15.72:0/28236721 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba4071a40 con 0x7feba4130430 2023-10-03T10:16:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7feba3fff700 1 --2- 172.21.15.72:0/28236721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba412cf60 0x7feba406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7feba8f01700 1 --2- 172.21.15.72:0/28236721 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feba4130430 0x7feba4137c30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00af90 tx=0x7feb9c00c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea7089bedb0850d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7feba2ffd700 1 -- 172.21.15.72:0/28236721 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00f070 con 0x7feba4130430 2023-10-03T10:16:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7feba2ffd700 1 -- 172.21.15.72:0/28236721 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c00a2e0 con 0x7feba4130430 2023-10-03T10:16:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.793+0000 7feba2ffd700 1 -- 172.21.15.72:0/28236721 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00cc30 con 0x7feba4130430 2023-10-03T10:16:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.794+0000 7febaa964700 1 -- 172.21.15.72:0/28236721 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feba4130430 msgr2=0x7feba4137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.794+0000 7febaa964700 1 --2- 172.21.15.72:0/28236721 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feba4130430 0x7feba4137c30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00af90 tx=0x7feb9c00c330 comp rx=0 tx=0).stop 2023-10-03T10:16:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.794+0000 7febaa964700 1 -- 172.21.15.72:0/28236721 shutdown_connections 2023-10-03T10:16:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.794+0000 7febaa964700 1 --2- 172.21.15.72:0/28236721 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feba4130430 0x7feba4137c30 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.794+0000 7febaa964700 1 --2- 172.21.15.72:0/28236721 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba412cf60 0x7feba406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.794+0000 7febaa964700 1 -- 172.21.15.72:0/28236721 >> 172.21.15.72:0/28236721 conn(0x7feba40a2aa0 msgr2=0x7feba40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.794+0000 7febaa964700 1 -- 172.21.15.72:0/28236721 shutdown_connections 2023-10-03T10:16:29.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.794+0000 7febaa964700 1 -- 172.21.15.72:0/28236721 wait complete. 2023-10-03T10:16:29.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.795+0000 7febaa964700 1 Processor -- start 2023-10-03T10:16:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.795+0000 7febaa964700 1 -- start start 2023-10-03T10:16:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7febaa964700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba412cf60 0x7feba411d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7febaa964700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba412f8b0 0x7feba409d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7febaa964700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feba4130430 0x7feba409dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7febaa964700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba412a010 con 0x7feba412cf60 2023-10-03T10:16:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7febaa964700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba411ec90 con 0x7feba412f8b0 2023-10-03T10:16:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7febaa964700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feba409eb60 con 0x7feba4130430 2023-10-03T10:16:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba8f01700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feba4130430 0x7feba409dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba412cf60 0x7feba411d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba412f8b0 0x7feba409d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba412cf60 0x7feba411d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60028/0 (socket says 172.21.15.72:60028) 2023-10-03T10:16:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba8f01700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feba4130430 0x7feba409dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47394/0 (socket says 172.21.15.72:47394) 2023-10-03T10:16:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba3fff700 1 -- 172.21.15.72:0/4108846914 learned_addr learned my addr 172.21.15.72:0/4108846914 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba37fe700 1 -- 172.21.15.72:0/4108846914 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feba4130430 msgr2=0x7feba409dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba37fe700 1 --2- 172.21.15.72:0/4108846914 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feba4130430 0x7feba409dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba37fe700 1 -- 172.21.15.72:0/4108846914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba412cf60 msgr2=0x7feba411d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba37fe700 1 --2- 172.21.15.72:0/4108846914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba412cf60 0x7feba411d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba37fe700 1 -- 172.21.15.72:0/4108846914 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940094a0 con 0x7feba412f8b0 2023-10-03T10:16:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba3fff700 1 --2- 172.21.15.72:0/4108846914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba412cf60 0x7feba411d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba37fe700 1 --2- 172.21.15.72:0/4108846914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba412f8b0 0x7feba409d7e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7feba4129f70 tx=0x7feb9800c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba0ff9700 1 -- 172.21.15.72:0/4108846914 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980054e0 con 0x7feba412f8b0 2023-10-03T10:16:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba0ff9700 1 -- 172.21.15.72:0/4108846914 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800ce10 con 0x7feba412f8b0 2023-10-03T10:16:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7febaa964700 1 -- 172.21.15.72:0/4108846914 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c00ac40 con 0x7feba412f8b0 2023-10-03T10:16:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.796+0000 7feba0ff9700 1 -- 172.21.15.72:0/4108846914 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb980038c0 con 0x7feba412f8b0 2023-10-03T10:16:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.797+0000 7febaa964700 1 -- 172.21.15.72:0/4108846914 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba411f500 con 0x7feba412f8b0 2023-10-03T10:16:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.797+0000 7feba0ff9700 1 -- 172.21.15.72:0/4108846914 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb98003a20 con 0x7feba412f8b0 2023-10-03T10:16:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.797+0000 7febaa964700 1 -- 172.21.15.72:0/4108846914 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba411f180 con 0x7feba412f8b0 2023-10-03T10:16:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.797+0000 7feba0ff9700 1 -- 172.21.15.72:0/4108846914 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feb9803e9e0 con 0x7feba412f8b0 2023-10-03T10:16:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.802+0000 7feba0ff9700 1 -- 172.21.15.72:0/4108846914 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb98017070 con 0x7feba412f8b0 2023-10-03T10:16:29.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:29.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.901+0000 7fabc2297700 1 Processor -- start 2023-10-03T10:16:29.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.901+0000 7fabc2297700 1 -- start start 2023-10-03T10:16:29.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabc2297700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabbc133420 0x7fabbc1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabc2297700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fabbc133e30 0x7fabbc12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabc2297700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabbc134260 0x7fabbc1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabc2297700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabbc06b990 con 0x7fabbc133e30 2023-10-03T10:16:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabc2297700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0a0590 con 0x7fabbc133420 2023-10-03T10:16:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabc2297700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc09fb80 con 0x7fabbc134260 2023-10-03T10:16:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabbbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabbc133420 0x7fabbc1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabbbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabbc133420 0x7fabbc1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56910/0 (socket says 172.21.15.72:56910) 2023-10-03T10:16:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabbbfff700 1 -- 172.21.15.72:0/1312652158 learned_addr learned my addr 172.21.15.72:0/1312652158 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabbb7fe700 1 --2- 172.21.15.72:0/1312652158 >> v2:172.21.15.72:3300/0 conn(0x7fabbc133e30 0x7fabbc12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabc0834700 1 --2- 172.21.15.72:0/1312652158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabbc134260 0x7fabbc1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabbbfff700 1 -- 172.21.15.72:0/1312652158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabbc134260 msgr2=0x7fabbc1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabbbfff700 1 --2- 172.21.15.72:0/1312652158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabbc134260 0x7fabbc1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabbbfff700 1 -- 172.21.15.72:0/1312652158 >> v2:172.21.15.72:3300/0 conn(0x7fabbc133e30 msgr2=0x7fabbc12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabbbfff700 1 --2- 172.21.15.72:0/1312652158 >> v2:172.21.15.72:3300/0 conn(0x7fabbc133e30 0x7fabbc12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabbbfff700 1 -- 172.21.15.72:0/1312652158 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc0a0030 con 0x7fabbc133420 2023-10-03T10:16:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.902+0000 7fabbb7fe700 1 --2- 172.21.15.72:0/1312652158 >> v2:172.21.15.72:3300/0 conn(0x7fabbc133e30 0x7fabbc12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.903+0000 7fabbbfff700 1 --2- 172.21.15.72:0/1312652158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabbc133420 0x7fabbc1337f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fabac0098f0 tx=0x7fabac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=944f31a8e5503986 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.903+0000 7fabbaffd700 1 -- 172.21.15.72:0/1312652158 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac011830 con 0x7fabbc133420 2023-10-03T10:16:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.903+0000 7fabbaffd700 1 -- 172.21.15.72:0/1312652158 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac011990 con 0x7fabbc133420 2023-10-03T10:16:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.903+0000 7fabbaffd700 1 -- 172.21.15.72:0/1312652158 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac011d20 con 0x7fabbc133420 2023-10-03T10:16:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.903+0000 7fabc2297700 1 -- 172.21.15.72:0/1312652158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabbc133420 msgr2=0x7fabbc1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.903+0000 7fabc2297700 1 --2- 172.21.15.72:0/1312652158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabbc133420 0x7fabbc1337f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fabac0098f0 tx=0x7fabac009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.903+0000 7fabc2297700 1 -- 172.21.15.72:0/1312652158 shutdown_connections 2023-10-03T10:16:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.903+0000 7fabc2297700 1 --2- 172.21.15.72:0/1312652158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabbc134260 0x7fabbc1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.903+0000 7fabc2297700 1 --2- 172.21.15.72:0/1312652158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabbc133420 0x7fabbc1337f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.903+0000 7fabc2297700 1 --2- 172.21.15.72:0/1312652158 >> v2:172.21.15.72:3300/0 conn(0x7fabbc133e30 0x7fabbc12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.903+0000 7fabc2297700 1 -- 172.21.15.72:0/1312652158 >> 172.21.15.72:0/1312652158 conn(0x7fabbc0a4210 msgr2=0x7fabbc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.903+0000 7fabc2297700 1 -- 172.21.15.72:0/1312652158 shutdown_connections 2023-10-03T10:16:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.903+0000 7fabc2297700 1 -- 172.21.15.72:0/1312652158 wait complete. 2023-10-03T10:16:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.904+0000 7fabc2297700 1 Processor -- start 2023-10-03T10:16:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabc2297700 1 -- start start 2023-10-03T10:16:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabc2297700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabbc133420 0x7fabbc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabc2297700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabbc133e30 0x7fabbc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabc2297700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabbc134260 0x7fabbc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabc2297700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc11ffb0 con 0x7fabbc133420 2023-10-03T10:16:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabc2297700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc120190 con 0x7fabbc133e30 2023-10-03T10:16:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabc2297700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc12da40 con 0x7fabbc134260 2023-10-03T10:16:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabc0834700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabbc134260 0x7fabbc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabbb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabbc133e30 0x7fabbc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabc0834700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabbc134260 0x7fabbc09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47422/0 (socket says 172.21.15.72:47422) 2023-10-03T10:16:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabbb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabbc133e30 0x7fabbc09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56922/0 (socket says 172.21.15.72:56922) 2023-10-03T10:16:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabc0834700 1 -- 172.21.15.72:0/1092596079 learned_addr learned my addr 172.21.15.72:0/1092596079 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabbbfff700 1 --2- 172.21.15.72:0/1092596079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabbc133420 0x7fabbc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabbbfff700 1 -- 172.21.15.72:0/1092596079 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabbc134260 msgr2=0x7fabbc09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabbbfff700 1 --2- 172.21.15.72:0/1092596079 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabbc134260 0x7fabbc09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabbbfff700 1 -- 172.21.15.72:0/1092596079 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabbc133e30 msgr2=0x7fabbc09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabbbfff700 1 --2- 172.21.15.72:0/1092596079 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabbc133e30 0x7fabbc09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabbbfff700 1 -- 172.21.15.72:0/1092596079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb00094a0 con 0x7fabbc133420 2023-10-03T10:16:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabbb7fe700 1 --2- 172.21.15.72:0/1092596079 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabbc133e30 0x7fabbc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.905+0000 7fabc0834700 1 --2- 172.21.15.72:0/1092596079 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabbc134260 0x7fabbc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.906+0000 7fabbbfff700 1 --2- 172.21.15.72:0/1092596079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabbc133420 0x7fabbc09c480 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fabac016000 tx=0x7fabac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.906+0000 7fabb8ff9700 1 -- 172.21.15.72:0/1092596079 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac004240 con 0x7fabbc133420 2023-10-03T10:16:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.906+0000 7fabb8ff9700 1 -- 172.21.15.72:0/1092596079 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac01f070 con 0x7fabbc133420 2023-10-03T10:16:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.906+0000 7fabc2297700 1 -- 172.21.15.72:0/1092596079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabac009550 con 0x7fabbc133420 2023-10-03T10:16:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.906+0000 7fabb8ff9700 1 -- 172.21.15.72:0/1092596079 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac0045e0 con 0x7fabbc133420 2023-10-03T10:16:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.906+0000 7fabc2297700 1 -- 172.21.15.72:0/1092596079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc11fc40 con 0x7fabbc133420 2023-10-03T10:16:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.907+0000 7fabc2297700 1 -- 172.21.15.72:0/1092596079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabbc11fdd0 con 0x7fabbc133420 2023-10-03T10:16:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.907+0000 7fabb8ff9700 1 -- 172.21.15.72:0/1092596079 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabac021030 con 0x7fabbc133420 2023-10-03T10:16:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.907+0000 7fabb8ff9700 1 -- 172.21.15.72:0/1092596079 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fabac040880 con 0x7fabbc133420 2023-10-03T10:16:29.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.916+0000 7fabb8ff9700 1 -- 172.21.15.72:0/1092596079 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabac0197c0 con 0x7fabbc133420 2023-10-03T10:16:29.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.942+0000 7f8a8cf6c700 1 Processor -- start 2023-10-03T10:16:29.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.942+0000 7f8a8cf6c700 1 -- start start 2023-10-03T10:16:29.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a8cf6c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a8809f410 0x7f8a88136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a8cf6c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a88136fe0 0x7f8a881393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a8cf6c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a88070940 con 0x7f8a8809e930 2023-10-03T10:16:29.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a8cf6c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a8806fd60 con 0x7f8a88136fe0 2023-10-03T10:16:29.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a8cf6c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8806fa80 con 0x7f8a8809f410 2023-10-03T10:16:29.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a8659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8a8809e930 0x7f8a8809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44650/0 (socket says 172.21.15.72:44650) 2023-10-03T10:16:29.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a8659c700 1 -- 172.21.15.72:0/1702837765 learned_addr learned my addr 172.21.15.72:0/1702837765 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:29.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a86d9d700 1 --2- 172.21.15.72:0/1702837765 >> v2:172.21.15.72:3300/0 conn(0x7f8a88136fe0 0x7f8a881393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a85d9b700 1 --2- 172.21.15.72:0/1702837765 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a8809f410 0x7f8a88136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a86d9d700 1 -- 172.21.15.72:0/1702837765 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a8809f410 msgr2=0x7f8a88136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:29.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a86d9d700 1 --2- 172.21.15.72:0/1702837765 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a8809f410 0x7f8a88136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a86d9d700 1 -- 172.21.15.72:0/1702837765 >> v1:172.21.15.72:6789/0 conn(0x7f8a8809e930 legacy=0x7f8a8809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a86d9d700 1 -- 172.21.15.72:0/1702837765 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8809fb60 con 0x7f8a88136fe0 2023-10-03T10:16:29.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a8559a700 1 -- 172.21.15.72:0/1702837765 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370918877 0 0) 0x7f8a88070940 con 0x7f8a8809e930 2023-10-03T10:16:29.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a85d9b700 1 --2- 172.21.15.72:0/1702837765 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a8809f410 0x7f8a88136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.943+0000 7f8a86d9d700 1 --2- 172.21.15.72:0/1702837765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a88136fe0 0x7f8a881393c0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009d90 tx=0x7f8a8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c537bec488ceb1b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.944+0000 7f8a8559a700 1 -- 172.21.15.72:0/1702837765 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8000e070 con 0x7f8a88136fe0 2023-10-03T10:16:29.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.944+0000 7f8a8559a700 1 -- 172.21.15.72:0/1702837765 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8000bb20 con 0x7f8a88136fe0 2023-10-03T10:16:29.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.944+0000 7f8a8559a700 1 -- 172.21.15.72:0/1702837765 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80012430 con 0x7f8a88136fe0 2023-10-03T10:16:29.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.944+0000 7f8a8cf6c700 1 -- 172.21.15.72:0/1702837765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a88136fe0 msgr2=0x7f8a881393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.944+0000 7f8a8cf6c700 1 --2- 172.21.15.72:0/1702837765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a88136fe0 0x7f8a881393c0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009d90 tx=0x7f8a8000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:29.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.944+0000 7f8a8cf6c700 1 -- 172.21.15.72:0/1702837765 shutdown_connections 2023-10-03T10:16:29.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.944+0000 7f8a8cf6c700 1 --2- 172.21.15.72:0/1702837765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a88136fe0 0x7f8a881393c0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.944+0000 7f8a8cf6c700 1 --2- 172.21.15.72:0/1702837765 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a8809f410 0x7f8a88136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.944+0000 7f8a8cf6c700 1 -- 172.21.15.72:0/1702837765 >> 172.21.15.72:0/1702837765 conn(0x7f8a880a4210 msgr2=0x7f8a880a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.944+0000 7f8a8cf6c700 1 -- 172.21.15.72:0/1702837765 shutdown_connections 2023-10-03T10:16:29.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.944+0000 7f8a8cf6c700 1 -- 172.21.15.72:0/1702837765 wait complete. 2023-10-03T10:16:29.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.946+0000 7f8a8cf6c700 1 Processor -- start 2023-10-03T10:16:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.946+0000 7f8a8cf6c700 1 -- start start 2023-10-03T10:16:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a8cf6c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a8809e930 0x7f8a881c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a8cf6c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a8809f410 0x7f8a881c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a8cf6c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a88136fe0 0x7f8a881c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a8cf6c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a88124270 con 0x7f8a88136fe0 2023-10-03T10:16:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a8cf6c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a88134610 con 0x7f8a8809e930 2023-10-03T10:16:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a8cf6c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a880a32a0 con 0x7f8a8809f410 2023-10-03T10:16:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a8659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a8809e930 0x7f8a881c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a8659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a8809e930 0x7f8a881c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56936/0 (socket says 172.21.15.72:56936) 2023-10-03T10:16:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a8659c700 1 -- 172.21.15.72:0/1100890426 learned_addr learned my addr 172.21.15.72:0/1100890426 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a85d9b700 1 --2- 172.21.15.72:0/1100890426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a8809f410 0x7f8a881c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a86d9d700 1 --2- 172.21.15.72:0/1100890426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a88136fe0 0x7f8a881c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a8659c700 1 -- 172.21.15.72:0/1100890426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a8809f410 msgr2=0x7f8a881c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a8659c700 1 --2- 172.21.15.72:0/1100890426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a8809f410 0x7f8a881c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a8659c700 1 -- 172.21.15.72:0/1100890426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a88136fe0 msgr2=0x7f8a881c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a8659c700 1 --2- 172.21.15.72:0/1100890426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a88136fe0 0x7f8a881c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a8659c700 1 -- 172.21.15.72:0/1100890426 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7c0094a0 con 0x7f8a8809e930 2023-10-03T10:16:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a86d9d700 1 --2- 172.21.15.72:0/1100890426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a88136fe0 0x7f8a881c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a85d9b700 1 --2- 172.21.15.72:0/1100890426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a8809f410 0x7f8a881c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a8659c700 1 --2- 172.21.15.72:0/1100890426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a8809e930 0x7f8a881c8470 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800c550 tx=0x7f8a7800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.947+0000 7f8a76ffd700 1 -- 172.21.15.72:0/1100890426 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a78004c80 con 0x7f8a8809e930 2023-10-03T10:16:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.948+0000 7f8a8cf6c700 1 -- 172.21.15.72:0/1100890426 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a80009a70 con 0x7f8a8809e930 2023-10-03T10:16:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.948+0000 7f8a76ffd700 1 -- 172.21.15.72:0/1100890426 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a78004e00 con 0x7f8a8809e930 2023-10-03T10:16:29.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.948+0000 7f8a76ffd700 1 -- 172.21.15.72:0/1100890426 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a78007310 con 0x7f8a8809e930 2023-10-03T10:16:29.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.948+0000 7f8a8cf6c700 1 -- 172.21.15.72:0/1100890426 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8806d470 con 0x7f8a8809e930 2023-10-03T10:16:29.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.948+0000 7f8a76ffd700 1 -- 172.21.15.72:0/1100890426 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a78007470 con 0x7f8a8809e930 2023-10-03T10:16:29.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.949+0000 7f8a76ffd700 1 -- 172.21.15.72:0/1100890426 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8a7803f3f0 con 0x7f8a8809e930 2023-10-03T10:16:29.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.949+0000 7f8a8cf6c700 1 -- 172.21.15.72:0/1100890426 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a881243b0 con 0x7f8a8809e930 2023-10-03T10:16:29.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:29.953+0000 7f8a76ffd700 1 -- 172.21.15.72:0/1100890426 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a881243b0 con 0x7f8a8809e930 2023-10-03T10:16:30.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.008+0000 7febaa964700 1 -- 172.21.15.72:0/4108846914 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feba4074ea0 con 0x7feba412f8b0 2023-10-03T10:16:30.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.008+0000 7feba0ff9700 1 -- 172.21.15.72:0/4108846914 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb98019b20 con 0x7feba412f8b0 2023-10-03T10:16:30.009 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.011+0000 7febaa964700 1 -- 172.21.15.72:0/4108846914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba412f8b0 msgr2=0x7feba409d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.011+0000 7febaa964700 1 --2- 172.21.15.72:0/4108846914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba412f8b0 0x7feba409d7e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7feba4129f70 tx=0x7feb9800c710 comp rx=0 tx=0).stop 2023-10-03T10:16:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.011+0000 7febaa964700 1 -- 172.21.15.72:0/4108846914 shutdown_connections 2023-10-03T10:16:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.011+0000 7febaa964700 1 --2- 172.21.15.72:0/4108846914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba412cf60 0x7feba411d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.011+0000 7febaa964700 1 --2- 172.21.15.72:0/4108846914 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feba4130430 0x7feba409dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.011+0000 7febaa964700 1 --2- 172.21.15.72:0/4108846914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feba412f8b0 0x7feba409d7e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.011+0000 7febaa964700 1 -- 172.21.15.72:0/4108846914 >> 172.21.15.72:0/4108846914 conn(0x7feba40a2aa0 msgr2=0x7feba41295d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.015+0000 7febaa964700 1 -- 172.21.15.72:0/4108846914 shutdown_connections 2023-10-03T10:16:30.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.015+0000 7febaa964700 1 -- 172.21.15.72:0/4108846914 wait complete. 2023-10-03T10:16:30.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.120+0000 7fabc2297700 1 -- 172.21.15.72:0/1092596079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fabbc09dee0 con 0x7fabbc133420 2023-10-03T10:16:30.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.120+0000 7fabb8ff9700 1 -- 172.21.15.72:0/1092596079 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fabac0193b0 con 0x7fabbc133420 2023-10-03T10:16:30.121 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.122+0000 7fabc2297700 1 -- 172.21.15.72:0/1092596079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabbc133420 msgr2=0x7fabbc09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.122+0000 7fabc2297700 1 --2- 172.21.15.72:0/1092596079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabbc133420 0x7fabbc09c480 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fabac016000 tx=0x7fabac004750 comp rx=0 tx=0).stop 2023-10-03T10:16:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.122+0000 7fabc2297700 1 -- 172.21.15.72:0/1092596079 shutdown_connections 2023-10-03T10:16:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.122+0000 7fabc2297700 1 --2- 172.21.15.72:0/1092596079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabbc133420 0x7fabbc09c480 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.122+0000 7fabc2297700 1 --2- 172.21.15.72:0/1092596079 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fabbc134260 0x7fabbc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.122+0000 7fabc2297700 1 --2- 172.21.15.72:0/1092596079 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fabbc133e30 0x7fabbc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.122+0000 7fabc2297700 1 -- 172.21.15.72:0/1092596079 >> 172.21.15.72:0/1092596079 conn(0x7fabbc0a4210 msgr2=0x7fabbc0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.122+0000 7fabc2297700 1 -- 172.21.15.72:0/1092596079 shutdown_connections 2023-10-03T10:16:30.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.122+0000 7fabc2297700 1 -- 172.21.15.72:0/1092596079 wait complete. 2023-10-03T10:16:30.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:30.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.147+0000 7f8a8cf6c700 1 -- 172.21.15.72:0/1100890426 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8a881243b0 con 0x7f8a8809e930 2023-10-03T10:16:30.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.148+0000 7f8a76ffd700 1 -- 172.21.15.72:0/1100890426 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8a881243b0 con 0x7f8a8809e930 2023-10-03T10:16:30.148 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:30.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.150+0000 7f8a8cf6c700 1 -- 172.21.15.72:0/1100890426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a8809e930 msgr2=0x7f8a881c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.150+0000 7f8a8cf6c700 1 --2- 172.21.15.72:0/1100890426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a8809e930 0x7f8a881c8470 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800c550 tx=0x7f8a7800c860 comp rx=0 tx=0).stop 2023-10-03T10:16:30.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.150+0000 7f8a8cf6c700 1 -- 172.21.15.72:0/1100890426 shutdown_connections 2023-10-03T10:16:30.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.150+0000 7f8a8cf6c700 1 --2- 172.21.15.72:0/1100890426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a88136fe0 0x7f8a881c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.150+0000 7f8a8cf6c700 1 --2- 172.21.15.72:0/1100890426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a8809e930 0x7f8a881c8470 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.150+0000 7f8a8cf6c700 1 --2- 172.21.15.72:0/1100890426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a8809f410 0x7f8a881c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.150+0000 7f8a8cf6c700 1 -- 172.21.15.72:0/1100890426 >> 172.21.15.72:0/1100890426 conn(0x7f8a880a4210 msgr2=0x7f8a88134900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.150+0000 7f8a8cf6c700 1 -- 172.21.15.72:0/1100890426 shutdown_connections 2023-10-03T10:16:30.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.150+0000 7f8a8cf6c700 1 -- 172.21.15.72:0/1100890426 wait complete. 2023-10-03T10:16:30.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:30.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:30.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.832+0000 7f6f4920b700 1 Processor -- start 2023-10-03T10:16:30.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.832+0000 7f6f4920b700 1 -- start start 2023-10-03T10:16:30.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f4920b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4409d6f0 0x7f6f4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f4920b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f4409e000 0x7f6f44130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f4920b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4409f130 con 0x7f6f4409e410 2023-10-03T10:16:30.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f4920b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4409f520 con 0x7f6f4409d6f0 2023-10-03T10:16:30.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f4920b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4409e930 con 0x7f6f4409e000 2023-10-03T10:16:30.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f4259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f4409e000 0x7f6f44130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f42d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4409d6f0 0x7f6f4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f4359e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6f4409e410 0x7f6f44130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44660/0 (socket says 172.21.15.72:44660) 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f42d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4409d6f0 0x7f6f4409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56950/0 (socket says 172.21.15.72:56950) 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f4259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f4409e000 0x7f6f44130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47442/0 (socket says 172.21.15.72:47442) 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f4359e700 1 -- 172.21.15.72:0/767520203 learned_addr learned my addr 172.21.15.72:0/767520203 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f41d9b700 1 -- 172.21.15.72:0/767520203 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261533271 0 0) 0x7f6f4409f130 con 0x7f6f4409e410 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f42d9d700 1 -- 172.21.15.72:0/767520203 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f4409e000 msgr2=0x7f6f44130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f42d9d700 1 --2- 172.21.15.72:0/767520203 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f4409e000 0x7f6f44130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f42d9d700 1 -- 172.21.15.72:0/767520203 >> v1:172.21.15.72:6789/0 conn(0x7f6f4409e410 legacy=0x7f6f44130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f42d9d700 1 -- 172.21.15.72:0/767520203 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4409b2d0 con 0x7f6f4409d6f0 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f4259c700 1 --2- 172.21.15.72:0/767520203 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f4409e000 0x7f6f44130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f42d9d700 1 --2- 172.21.15.72:0/767520203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4409d6f0 0x7f6f4409dac0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009870 tx=0x7f6f38009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b365b3e6e692232 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.833+0000 7f6f41d9b700 1 -- 172.21.15.72:0/767520203 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38011830 con 0x7f6f4409d6f0 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.834+0000 7f6f41d9b700 1 -- 172.21.15.72:0/767520203 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f38011990 con 0x7f6f4409d6f0 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.834+0000 7f6f41d9b700 1 -- 172.21.15.72:0/767520203 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38011d20 con 0x7f6f4409d6f0 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.834+0000 7f6f4920b700 1 -- 172.21.15.72:0/767520203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4409d6f0 msgr2=0x7f6f4409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.834+0000 7f6f4920b700 1 --2- 172.21.15.72:0/767520203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4409d6f0 0x7f6f4409dac0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009870 tx=0x7f6f38009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.834+0000 7f6f4920b700 1 -- 172.21.15.72:0/767520203 shutdown_connections 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.834+0000 7f6f4920b700 1 --2- 172.21.15.72:0/767520203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4409d6f0 0x7f6f4409dac0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.834+0000 7f6f4920b700 1 --2- 172.21.15.72:0/767520203 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f4409e000 0x7f6f44130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.834+0000 7f6f4920b700 1 -- 172.21.15.72:0/767520203 >> 172.21.15.72:0/767520203 conn(0x7f6f44066f50 msgr2=0x7f6f4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.834+0000 7f6f4920b700 1 -- 172.21.15.72:0/767520203 shutdown_connections 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.834+0000 7f6f4920b700 1 -- 172.21.15.72:0/767520203 wait complete. 2023-10-03T10:16:30.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.835+0000 7f6f4920b700 1 Processor -- start 2023-10-03T10:16:30.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.835+0000 7f6f4920b700 1 -- start start 2023-10-03T10:16:30.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4920b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4409d6f0 0x7f6f441c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4920b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4409e000 0x7f6f441c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4920b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f4409e410 0x7f6f441c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4920b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f44126630 con 0x7f6f4409e000 2023-10-03T10:16:30.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4920b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f44120ad0 con 0x7f6f4409d6f0 2023-10-03T10:16:30.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4920b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f44125410 con 0x7f6f4409e410 2023-10-03T10:16:30.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f42d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4409d6f0 0x7f6f441c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4409e000 0x7f6f441c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4359e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f4409e410 0x7f6f441c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f42d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4409d6f0 0x7f6f441c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56964/0 (socket says 172.21.15.72:56964) 2023-10-03T10:16:30.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4409e000 0x7f6f441c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60066/0 (socket says 172.21.15.72:60066) 2023-10-03T10:16:30.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f42d9d700 1 -- 172.21.15.72:0/1552542818 learned_addr learned my addr 172.21.15.72:0/1552542818 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:30.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4359e700 1 -- 172.21.15.72:0/1552542818 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4409d6f0 msgr2=0x7f6f441c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4359e700 1 --2- 172.21.15.72:0/1552542818 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4409d6f0 0x7f6f441c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4359e700 1 -- 172.21.15.72:0/1552542818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4409e000 msgr2=0x7f6f441c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4359e700 1 --2- 172.21.15.72:0/1552542818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4409e000 0x7f6f441c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4359e700 1 -- 172.21.15.72:0/1552542818 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f340094a0 con 0x7f6f4409e410 2023-10-03T10:16:30.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4259c700 1 --2- 172.21.15.72:0/1552542818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4409e000 0x7f6f441c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f4359e700 1 --2- 172.21.15.72:0/1552542818 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f4409e410 0x7f6f441c8f20 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00cbe0 tx=0x7f6f3c00cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.836+0000 7f6f2b7fe700 1 -- 172.21.15.72:0/1552542818 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c00aa40 con 0x7f6f4409e410 2023-10-03T10:16:30.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.837+0000 7f6f2b7fe700 1 -- 172.21.15.72:0/1552542818 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c00abc0 con 0x7f6f4409e410 2023-10-03T10:16:30.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.837+0000 7f6f4920b700 1 -- 172.21.15.72:0/1552542818 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f380094a0 con 0x7f6f4409e410 2023-10-03T10:16:30.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.837+0000 7f6f2b7fe700 1 -- 172.21.15.72:0/1552542818 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0070d0 con 0x7f6f4409e410 2023-10-03T10:16:30.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.837+0000 7f6f4920b700 1 -- 172.21.15.72:0/1552542818 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f44120320 con 0x7f6f4409e410 2023-10-03T10:16:30.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.837+0000 7f6f2b7fe700 1 -- 172.21.15.72:0/1552542818 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f3c007230 con 0x7f6f4409e410 2023-10-03T10:16:30.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.837+0000 7f6f2b7fe700 1 -- 172.21.15.72:0/1552542818 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6f3c03f3e0 con 0x7f6f4409e410 2023-10-03T10:16:30.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.837+0000 7f6f4920b700 1 -- 172.21.15.72:0/1552542818 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f441257b0 con 0x7f6f4409e410 2023-10-03T10:16:30.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:30.842+0000 7f6f2b7fe700 1 -- 172.21.15.72:0/1552542818 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f3c018070 con 0x7f6f4409e410 2023-10-03T10:16:31.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:31.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.028+0000 7f6f4920b700 1 -- 172.21.15.72:0/1552542818 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6f44074ea0 con 0x7f6f4409e410 2023-10-03T10:16:31.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.029+0000 7f6f2b7fe700 1 -- 172.21.15.72:0/1552542818 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f3c0074e0 con 0x7f6f4409e410 2023-10-03T10:16:31.029 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:31.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.031+0000 7f6f4920b700 1 -- 172.21.15.72:0/1552542818 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f4409e410 msgr2=0x7f6f441c8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.031+0000 7f6f4920b700 1 --2- 172.21.15.72:0/1552542818 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f4409e410 0x7f6f441c8f20 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00cbe0 tx=0x7f6f3c00cef0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.031+0000 7f6f4920b700 1 -- 172.21.15.72:0/1552542818 shutdown_connections 2023-10-03T10:16:31.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.031+0000 7f6f4920b700 1 --2- 172.21.15.72:0/1552542818 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f4409e410 0x7f6f441c8f20 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.031+0000 7f6f4920b700 1 --2- 172.21.15.72:0/1552542818 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f4409d6f0 0x7f6f441c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.031+0000 7f6f4920b700 1 --2- 172.21.15.72:0/1552542818 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f4409e000 0x7f6f441c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.031+0000 7f6f4920b700 1 -- 172.21.15.72:0/1552542818 >> 172.21.15.72:0/1552542818 conn(0x7f6f44066f50 msgr2=0x7f6f44130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.031+0000 7f6f4920b700 1 -- 172.21.15.72:0/1552542818 shutdown_connections 2023-10-03T10:16:31.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.031+0000 7f6f4920b700 1 -- 172.21.15.72:0/1552542818 wait complete. 2023-10-03T10:16:31.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:31.135 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:31.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.149+0000 7f63f4fb0700 1 Processor -- start 2023-10-03T10:16:31.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.149+0000 7f63f4fb0700 1 -- start start 2023-10-03T10:16:31.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.150+0000 7f63f4fb0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63f009d6f0 0x7f63f009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.150+0000 7f63f4fb0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009e410 0x7f63f0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.150+0000 7f63f4fb0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f009f130 con 0x7f63f009e000 2023-10-03T10:16:31.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.150+0000 7f63f4fb0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f009f520 con 0x7f63f009d6f0 2023-10-03T10:16:31.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.150+0000 7f63f4fb0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f009e930 con 0x7f63f009e410 2023-10-03T10:16:31.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.150+0000 7f63ee59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63f009d6f0 0x7f63f009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.150+0000 7f63eed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009e410 0x7f63f0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.150+0000 7f63eed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009e410 0x7f63f0130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56972/0 (socket says 172.21.15.72:56972) 2023-10-03T10:16:31.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.150+0000 7f63ee59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63f009d6f0 0x7f63f009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60076/0 (socket says 172.21.15.72:60076) 2023-10-03T10:16:31.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.150+0000 7f63eed9d700 1 -- 172.21.15.72:0/1275662729 learned_addr learned my addr 172.21.15.72:0/1275662729 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:31.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.150+0000 7f63ee59c700 1 -- 172.21.15.72:0/1275662729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009e410 msgr2=0x7f63f0130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.150+0000 7f63ee59c700 1 --2- 172.21.15.72:0/1275662729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009e410 0x7f63f0130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.150+0000 7f63ee59c700 1 -- 172.21.15.72:0/1275662729 >> v1:172.21.15.72:6789/0 conn(0x7f63f009e000 legacy=0x7f63f0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.150+0000 7f63ee59c700 1 -- 172.21.15.72:0/1275662729 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f009b2d0 con 0x7f63f009d6f0 2023-10-03T10:16:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.150+0000 7f63eed9d700 1 --2- 172.21.15.72:0/1275662729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009e410 0x7f63f0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.151+0000 7f63ee59c700 1 --2- 172.21.15.72:0/1275662729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009d6f0 0x7f63f009dac0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009840 tx=0x7f63e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69988b2f955652a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.151+0000 7f63ed59a700 1 -- 172.21.15.72:0/1275662729 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0011830 con 0x7f63f009d6f0 2023-10-03T10:16:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.151+0000 7f63ed59a700 1 -- 172.21.15.72:0/1275662729 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e0011990 con 0x7f63f009d6f0 2023-10-03T10:16:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.151+0000 7f63ed59a700 1 -- 172.21.15.72:0/1275662729 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0011d20 con 0x7f63f009d6f0 2023-10-03T10:16:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.151+0000 7f63f4fb0700 1 -- 172.21.15.72:0/1275662729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009d6f0 msgr2=0x7f63f009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.151+0000 7f63f4fb0700 1 --2- 172.21.15.72:0/1275662729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009d6f0 0x7f63f009dac0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009840 tx=0x7f63e0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.151+0000 7f63f4fb0700 1 -- 172.21.15.72:0/1275662729 shutdown_connections 2023-10-03T10:16:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.151+0000 7f63f4fb0700 1 --2- 172.21.15.72:0/1275662729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009e410 0x7f63f0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.151+0000 7f63f4fb0700 1 --2- 172.21.15.72:0/1275662729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009d6f0 0x7f63f009dac0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.151+0000 7f63f4fb0700 1 -- 172.21.15.72:0/1275662729 >> 172.21.15.72:0/1275662729 conn(0x7f63f0066f50 msgr2=0x7f63f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.152+0000 7f63f4fb0700 1 -- 172.21.15.72:0/1275662729 shutdown_connections 2023-10-03T10:16:31.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.152+0000 7f63f4fb0700 1 -- 172.21.15.72:0/1275662729 wait complete. 2023-10-03T10:16:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.153+0000 7f63f4fb0700 1 Processor -- start 2023-10-03T10:16:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.153+0000 7f63f4fb0700 1 -- start start 2023-10-03T10:16:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63f4fb0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009d6f0 0x7f63f012ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63f4fb0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009e000 0x7f63f012f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63f4fb0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f009e410 0x7f63f012f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63f4fb0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f0130980 con 0x7f63f009e000 2023-10-03T10:16:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63f4fb0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f0132900 con 0x7f63f009d6f0 2023-10-03T10:16:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63f4fb0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63f0072620 con 0x7f63f009e410 2023-10-03T10:16:31.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63edd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009e000 0x7f63f012f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63ee59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009d6f0 0x7f63f012ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63edd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009e000 0x7f63f012f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60084/0 (socket says 172.21.15.72:60084) 2023-10-03T10:16:31.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63edd9b700 1 -- 172.21.15.72:0/4152082787 learned_addr learned my addr 172.21.15.72:0/4152082787 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:31.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63eed9d700 1 --2- 172.21.15.72:0/4152082787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f009e410 0x7f63f012f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63edd9b700 1 -- 172.21.15.72:0/4152082787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f009e410 msgr2=0x7f63f012f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63edd9b700 1 --2- 172.21.15.72:0/4152082787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f009e410 0x7f63f012f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63edd9b700 1 -- 172.21.15.72:0/4152082787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009d6f0 msgr2=0x7f63f012ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63edd9b700 1 --2- 172.21.15.72:0/4152082787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009d6f0 0x7f63f012ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63edd9b700 1 -- 172.21.15.72:0/4152082787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e8009b30 con 0x7f63f009e000 2023-10-03T10:16:31.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63edd9b700 1 --2- 172.21.15.72:0/4152082787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009e000 0x7f63f012f2b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f63e400c4e0 tx=0x7f63e400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63deffd700 1 -- 172.21.15.72:0/4152082787 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e40052d0 con 0x7f63f009e000 2023-10-03T10:16:31.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63deffd700 1 -- 172.21.15.72:0/4152082787 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e4005430 con 0x7f63f009e000 2023-10-03T10:16:31.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63f4fb0700 1 -- 172.21.15.72:0/4152082787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e00094a0 con 0x7f63f009e000 2023-10-03T10:16:31.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.154+0000 7f63deffd700 1 -- 172.21.15.72:0/4152082787 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e40038c0 con 0x7f63f009e000 2023-10-03T10:16:31.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.155+0000 7f63f4fb0700 1 -- 172.21.15.72:0/4152082787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f0130e60 con 0x7f63f009e000 2023-10-03T10:16:31.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.155+0000 7f63deffd700 1 -- 172.21.15.72:0/4152082787 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63e4003a20 con 0x7f63f009e000 2023-10-03T10:16:31.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.155+0000 7f63f4fb0700 1 -- 172.21.15.72:0/4152082787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f0074ea0 con 0x7f63f009e000 2023-10-03T10:16:31.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.156+0000 7f63deffd700 1 -- 172.21.15.72:0/4152082787 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f63e403ea60 con 0x7f63f009e000 2023-10-03T10:16:31.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.160+0000 7f63deffd700 1 -- 172.21.15.72:0/4152082787 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63e4019e60 con 0x7f63f009e000 2023-10-03T10:16:31.163 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:31.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.262+0000 7f7e4f2c6700 1 Processor -- start 2023-10-03T10:16:31.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.263+0000 7f7e4f2c6700 1 -- start start 2023-10-03T10:16:31.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.263+0000 7f7e4f2c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e480a0090 0x7f7e48136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.263+0000 7f7e4f2c6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e4809d130 0x7f7e48139170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.263+0000 7f7e4f2c6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4809ba70 con 0x7f7e4809c650 2023-10-03T10:16:31.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.263+0000 7f7e4f2c6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4809e8f0 con 0x7f7e4809d130 2023-10-03T10:16:31.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.263+0000 7f7e4f2c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e480a0760 con 0x7f7e480a0090 2023-10-03T10:16:31.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.263+0000 7f7e4d062700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7e4809c650 0x7f7e4809ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44678/0 (socket says 172.21.15.72:44678) 2023-10-03T10:16:31.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.263+0000 7f7e4d863700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e4809d130 0x7f7e48139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.263+0000 7f7e4d062700 1 -- 172.21.15.72:0/4015814880 learned_addr learned my addr 172.21.15.72:0/4015814880 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:31.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.263+0000 7f7e4c861700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e480a0090 0x7f7e48136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.264+0000 7f7e4c861700 1 -- 172.21.15.72:0/4015814880 >> v2:172.21.15.72:3300/0 conn(0x7f7e4809d130 msgr2=0x7f7e48139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.264+0000 7f7e4c861700 1 --2- 172.21.15.72:0/4015814880 >> v2:172.21.15.72:3300/0 conn(0x7f7e4809d130 0x7f7e48139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.264+0000 7f7e4c861700 1 -- 172.21.15.72:0/4015814880 >> v1:172.21.15.72:6789/0 conn(0x7f7e4809c650 legacy=0x7f7e4809ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.264+0000 7f7e4c861700 1 -- 172.21.15.72:0/4015814880 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4809a080 con 0x7f7e480a0090 2023-10-03T10:16:31.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.264+0000 7f7e4d863700 1 --2- 172.21.15.72:0/4015814880 >> v2:172.21.15.72:3300/0 conn(0x7f7e4809d130 0x7f7e48139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.264+0000 7f7e4c861700 1 --2- 172.21.15.72:0/4015814880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e480a0090 0x7f7e48136c20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009840 tx=0x7f7e38009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3440bae53a5a2fbd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.264+0000 7f7e3ffff700 1 -- 172.21.15.72:0/4015814880 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38011830 con 0x7f7e480a0090 2023-10-03T10:16:31.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.264+0000 7f7e3ffff700 1 -- 172.21.15.72:0/4015814880 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e38011990 con 0x7f7e480a0090 2023-10-03T10:16:31.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.264+0000 7f7e3ffff700 1 -- 172.21.15.72:0/4015814880 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38011d20 con 0x7f7e480a0090 2023-10-03T10:16:31.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.264+0000 7f7e4f2c6700 1 -- 172.21.15.72:0/4015814880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e480a0090 msgr2=0x7f7e48136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.264+0000 7f7e4f2c6700 1 --2- 172.21.15.72:0/4015814880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e480a0090 0x7f7e48136c20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009840 tx=0x7f7e38009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:31.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.265+0000 7f7e4f2c6700 1 -- 172.21.15.72:0/4015814880 shutdown_connections 2023-10-03T10:16:31.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.265+0000 7f7e4f2c6700 1 --2- 172.21.15.72:0/4015814880 >> v2:172.21.15.72:3300/0 conn(0x7f7e4809d130 0x7f7e48139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.265+0000 7f7e4f2c6700 1 --2- 172.21.15.72:0/4015814880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e480a0090 0x7f7e48136c20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.265+0000 7f7e4f2c6700 1 -- 172.21.15.72:0/4015814880 >> 172.21.15.72:0/4015814880 conn(0x7f7e480a3f70 msgr2=0x7f7e480a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.265+0000 7f7e4f2c6700 1 -- 172.21.15.72:0/4015814880 shutdown_connections 2023-10-03T10:16:31.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.265+0000 7f7e4f2c6700 1 -- 172.21.15.72:0/4015814880 wait complete. 2023-10-03T10:16:31.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.266+0000 7f7e4f2c6700 1 Processor -- start 2023-10-03T10:16:31.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.266+0000 7f7e4f2c6700 1 -- start start 2023-10-03T10:16:31.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4f2c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4809c650 0x7f7e48135360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4f2c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e4809d130 0x7f7e481358a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4f2c6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e480a0090 0x7f7e48135de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4f2c6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e48136f90 con 0x7f7e480a0090 2023-10-03T10:16:31.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4f2c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4811a8e0 con 0x7f7e4809c650 2023-10-03T10:16:31.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4f2c6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e48130880 con 0x7f7e4809d130 2023-10-03T10:16:31.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4c861700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e4809d130 0x7f7e481358a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4c861700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e4809d130 0x7f7e481358a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47470/0 (socket says 172.21.15.72:47470) 2023-10-03T10:16:31.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4c861700 1 -- 172.21.15.72:0/452571082 learned_addr learned my addr 172.21.15.72:0/452571082 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:31.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4d062700 1 --2- 172.21.15.72:0/452571082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4809c650 0x7f7e48135360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4d863700 1 --2- 172.21.15.72:0/452571082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e480a0090 0x7f7e48135de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4c861700 1 -- 172.21.15.72:0/452571082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4809c650 msgr2=0x7f7e48135360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4c861700 1 --2- 172.21.15.72:0/452571082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4809c650 0x7f7e48135360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4c861700 1 -- 172.21.15.72:0/452571082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e480a0090 msgr2=0x7f7e48135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4c861700 1 --2- 172.21.15.72:0/452571082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e480a0090 0x7f7e48135de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4c861700 1 -- 172.21.15.72:0/452571082 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e40009a70 con 0x7f7e4809d130 2023-10-03T10:16:31.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4d062700 1 --2- 172.21.15.72:0/452571082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4809c650 0x7f7e48135360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4d863700 1 --2- 172.21.15.72:0/452571082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e480a0090 0x7f7e48135de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:31.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.267+0000 7f7e4c861700 1 --2- 172.21.15.72:0/452571082 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e4809d130 0x7f7e481358a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009b90 tx=0x7f7e38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.268+0000 7f7e3dffb700 1 -- 172.21.15.72:0/452571082 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38004550 con 0x7f7e4809d130 2023-10-03T10:16:31.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.268+0000 7f7e3dffb700 1 -- 172.21.15.72:0/452571082 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e380036a0 con 0x7f7e4809d130 2023-10-03T10:16:31.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.268+0000 7f7e4f2c6700 1 -- 172.21.15.72:0/452571082 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e380094a0 con 0x7f7e4809d130 2023-10-03T10:16:31.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.268+0000 7f7e3dffb700 1 -- 172.21.15.72:0/452571082 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38003a30 con 0x7f7e4809d130 2023-10-03T10:16:31.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.268+0000 7f7e4f2c6700 1 -- 172.21.15.72:0/452571082 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4811b350 con 0x7f7e4809d130 2023-10-03T10:16:31.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.269+0000 7f7e3dffb700 1 -- 172.21.15.72:0/452571082 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e38003b90 con 0x7f7e4809d130 2023-10-03T10:16:31.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.269+0000 7f7e3dffb700 1 -- 172.21.15.72:0/452571082 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e38040920 con 0x7f7e4809d130 2023-10-03T10:16:31.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.269+0000 7f7e4f2c6700 1 -- 172.21.15.72:0/452571082 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e480747f0 con 0x7f7e4809d130 2023-10-03T10:16:31.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.274+0000 7f7e3dffb700 1 -- 172.21.15.72:0/452571082 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e3802e970 con 0x7f7e4809d130 2023-10-03T10:16:31.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.290+0000 7f373beb1700 1 Processor -- start 2023-10-03T10:16:31.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.290+0000 7f373beb1700 1 -- start start 2023-10-03T10:16:31.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.290+0000 7f373beb1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37340a0a30 0x7f37340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.290+0000 7f373beb1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3734138d80 0x7f373413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.290+0000 7f373beb1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37340a2a70 con 0x7f373409d630 2023-10-03T10:16:31.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.290+0000 7f373beb1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37340a01d0 con 0x7f37340a0a30 2023-10-03T10:16:31.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.290+0000 7f373beb1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373409e2b0 con 0x7f3734138d80 2023-10-03T10:16:31.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.290+0000 7f3739c4d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37340a0a30 0x7f37340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.290+0000 7f3739c4d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37340a0a30 0x7f37340a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60110/0 (socket says 172.21.15.72:60110) 2023-10-03T10:16:31.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.290+0000 7f3739c4d700 1 -- 172.21.15.72:0/474041622 learned_addr learned my addr 172.21.15.72:0/474041622 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.291+0000 7f373a44e700 1 --2- 172.21.15.72:0/474041622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3734138d80 0x7f373413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.291+0000 7f3739c4d700 1 -- 172.21.15.72:0/474041622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3734138d80 msgr2=0x7f373413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.291+0000 7f3739c4d700 1 --2- 172.21.15.72:0/474041622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3734138d80 0x7f373413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.291+0000 7f3739c4d700 1 -- 172.21.15.72:0/474041622 >> v1:172.21.15.72:6789/0 conn(0x7f373409d630 legacy=0x7f37340a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.291+0000 7f3739c4d700 1 -- 172.21.15.72:0/474041622 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373409dc50 con 0x7f37340a0a30 2023-10-03T10:16:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.291+0000 7f3738c4b700 1 -- 172.21.15.72:0/474041622 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438753965 0 0) 0x7f37340a2a70 con 0x7f373409d630 2023-10-03T10:16:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.291+0000 7f373a44e700 1 --2- 172.21.15.72:0/474041622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3734138d80 0x7f373413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.291+0000 7f3739c4d700 1 --2- 172.21.15.72:0/474041622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37340a0a30 0x7f37340a0e00 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f37300098f0 tx=0x7f3730009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0f99f8764e1370 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.291+0000 7f3738c4b700 1 -- 172.21.15.72:0/474041622 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000b8a0 con 0x7f37340a0a30 2023-10-03T10:16:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.291+0000 7f3738c4b700 1 -- 172.21.15.72:0/474041622 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373000ba00 con 0x7f37340a0a30 2023-10-03T10:16:31.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.291+0000 7f3738c4b700 1 -- 172.21.15.72:0/474041622 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000bd90 con 0x7f37340a0a30 2023-10-03T10:16:31.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.292+0000 7f373beb1700 1 -- 172.21.15.72:0/474041622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37340a0a30 msgr2=0x7f37340a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.292+0000 7f373beb1700 1 --2- 172.21.15.72:0/474041622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37340a0a30 0x7f37340a0e00 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f37300098f0 tx=0x7f3730009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:31.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.292+0000 7f373beb1700 1 -- 172.21.15.72:0/474041622 shutdown_connections 2023-10-03T10:16:31.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.292+0000 7f373beb1700 1 --2- 172.21.15.72:0/474041622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3734138d80 0x7f373413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.292+0000 7f373beb1700 1 --2- 172.21.15.72:0/474041622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37340a0a30 0x7f37340a0e00 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.292+0000 7f373beb1700 1 -- 172.21.15.72:0/474041622 >> 172.21.15.72:0/474041622 conn(0x7f37340a3050 msgr2=0x7f37340a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.292+0000 7f373beb1700 1 -- 172.21.15.72:0/474041622 shutdown_connections 2023-10-03T10:16:31.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.292+0000 7f373beb1700 1 -- 172.21.15.72:0/474041622 wait complete. 2023-10-03T10:16:31.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.293+0000 7f373beb1700 1 Processor -- start 2023-10-03T10:16:31.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.293+0000 7f373beb1700 1 -- start start 2023-10-03T10:16:31.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.294+0000 7f373beb1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f373409d630 0x7f37341337b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.294+0000 7f373beb1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37340a0a30 0x7f3734133cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.294+0000 7f373beb1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3734138d80 0x7f3734134230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:31.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.294+0000 7f373beb1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3734135b70 con 0x7f373409d630 2023-10-03T10:16:31.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.294+0000 7f373beb1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3734134ba0 con 0x7f3734138d80 2023-10-03T10:16:31.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.294+0000 7f373beb1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37340a4ae0 con 0x7f37340a0a30 2023-10-03T10:16:31.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.294+0000 7f3739c4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f373409d630 0x7f37341337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.294+0000 7f3739c4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f373409d630 0x7f37341337b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60124/0 (socket says 172.21.15.72:60124) 2023-10-03T10:16:31.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.294+0000 7f3739c4d700 1 -- 172.21.15.72:0/1604469959 learned_addr learned my addr 172.21.15.72:0/1604469959 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:31.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.294+0000 7f373a44e700 1 --2- 172.21.15.72:0/1604469959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3734138d80 0x7f3734134230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.294+0000 7f373944c700 1 --2- 172.21.15.72:0/1604469959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37340a0a30 0x7f3734133cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:31.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.295+0000 7f3739c4d700 1 -- 172.21.15.72:0/1604469959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37340a0a30 msgr2=0x7f3734133cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.295+0000 7f3739c4d700 1 --2- 172.21.15.72:0/1604469959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37340a0a30 0x7f3734133cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.295+0000 7f3739c4d700 1 -- 172.21.15.72:0/1604469959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3734138d80 msgr2=0x7f3734134230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.295+0000 7f3739c4d700 1 --2- 172.21.15.72:0/1604469959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3734138d80 0x7f3734134230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.295+0000 7f3739c4d700 1 -- 172.21.15.72:0/1604469959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3730009550 con 0x7f373409d630 2023-10-03T10:16:31.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.295+0000 7f3739c4d700 1 --2- 172.21.15.72:0/1604469959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f373409d630 0x7f37341337b0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f37340a2c00 tx=0x7f3730004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:31.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.295+0000 7f372a7fc700 1 -- 172.21.15.72:0/1604469959 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37300044d0 con 0x7f373409d630 2023-10-03T10:16:31.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.295+0000 7f372a7fc700 1 -- 172.21.15.72:0/1604469959 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37300036a0 con 0x7f373409d630 2023-10-03T10:16:31.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.295+0000 7f373beb1700 1 -- 172.21.15.72:0/1604469959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37340a0410 con 0x7f373409d630 2023-10-03T10:16:31.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.295+0000 7f372a7fc700 1 -- 172.21.15.72:0/1604469959 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3730003a10 con 0x7f373409d630 2023-10-03T10:16:31.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.295+0000 7f373beb1700 1 -- 172.21.15.72:0/1604469959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37341364f0 con 0x7f373409d630 2023-10-03T10:16:31.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.296+0000 7f372a7fc700 1 -- 172.21.15.72:0/1604469959 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3730021070 con 0x7f373409d630 2023-10-03T10:16:31.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.296+0000 7f373beb1700 1 -- 172.21.15.72:0/1604469959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3734137d90 con 0x7f373409d630 2023-10-03T10:16:31.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.296+0000 7f372a7fc700 1 -- 172.21.15.72:0/1604469959 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3730040b20 con 0x7f373409d630 2023-10-03T10:16:31.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.301+0000 7f372a7fc700 1 -- 172.21.15.72:0/1604469959 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3730015070 con 0x7f373409d630 2023-10-03T10:16:31.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.359+0000 7f63f4fb0700 1 -- 172.21.15.72:0/4152082787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f63f006c360 con 0x7f63f009e000 2023-10-03T10:16:31.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.359+0000 7f63deffd700 1 -- 172.21.15.72:0/4152082787 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63e4017020 con 0x7f63f009e000 2023-10-03T10:16:31.359 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.362+0000 7f63f4fb0700 1 -- 172.21.15.72:0/4152082787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009e000 msgr2=0x7f63f012f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.362+0000 7f63f4fb0700 1 --2- 172.21.15.72:0/4152082787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009e000 0x7f63f012f2b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f63e400c4e0 tx=0x7f63e400c7f0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.363+0000 7f63f4fb0700 1 -- 172.21.15.72:0/4152082787 shutdown_connections 2023-10-03T10:16:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.363+0000 7f63f4fb0700 1 --2- 172.21.15.72:0/4152082787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63f009e410 0x7f63f012f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.363+0000 7f63f4fb0700 1 --2- 172.21.15.72:0/4152082787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f009d6f0 0x7f63f012ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.363+0000 7f63f4fb0700 1 --2- 172.21.15.72:0/4152082787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f009e000 0x7f63f012f2b0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.363+0000 7f63f4fb0700 1 -- 172.21.15.72:0/4152082787 >> 172.21.15.72:0/4152082787 conn(0x7f63f0066f50 msgr2=0x7f63f00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.363+0000 7f63f4fb0700 1 -- 172.21.15.72:0/4152082787 shutdown_connections 2023-10-03T10:16:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.363+0000 7f63f4fb0700 1 -- 172.21.15.72:0/4152082787 wait complete. 2023-10-03T10:16:31.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:31.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.480+0000 7f7e4f2c6700 1 -- 172.21.15.72:0/452571082 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7e48072840 con 0x7f7e4809d130 2023-10-03T10:16:31.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.480+0000 7f7e3dffb700 1 -- 172.21.15.72:0/452571082 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7e38015020 con 0x7f7e4809d130 2023-10-03T10:16:31.480 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:31.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.482+0000 7f7e4f2c6700 1 -- 172.21.15.72:0/452571082 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e4809d130 msgr2=0x7f7e481358a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.482+0000 7f7e4f2c6700 1 --2- 172.21.15.72:0/452571082 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e4809d130 0x7f7e481358a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009b90 tx=0x7f7e38004750 comp rx=0 tx=0).stop 2023-10-03T10:16:31.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.482+0000 7f7e4f2c6700 1 -- 172.21.15.72:0/452571082 shutdown_connections 2023-10-03T10:16:31.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.482+0000 7f7e4f2c6700 1 --2- 172.21.15.72:0/452571082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e480a0090 0x7f7e48135de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.482+0000 7f7e4f2c6700 1 --2- 172.21.15.72:0/452571082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4809c650 0x7f7e48135360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.482+0000 7f7e4f2c6700 1 --2- 172.21.15.72:0/452571082 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7e4809d130 0x7f7e481358a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.482+0000 7f7e4f2c6700 1 -- 172.21.15.72:0/452571082 >> 172.21.15.72:0/452571082 conn(0x7f7e480a3f70 msgr2=0x7f7e480a4560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.482+0000 7f7e4f2c6700 1 -- 172.21.15.72:0/452571082 shutdown_connections 2023-10-03T10:16:31.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.482+0000 7f7e4f2c6700 1 -- 172.21.15.72:0/452571082 wait complete. 2023-10-03T10:16:31.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:31.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.494+0000 7f373beb1700 1 -- 172.21.15.72:0/1604469959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37340747f0 con 0x7f373409d630 2023-10-03T10:16:31.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.495+0000 7f372a7fc700 1 -- 172.21.15.72:0/1604469959 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f373001b430 con 0x7f373409d630 2023-10-03T10:16:31.495 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:31.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.497+0000 7f373beb1700 1 -- 172.21.15.72:0/1604469959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f373409d630 msgr2=0x7f37341337b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.497+0000 7f373beb1700 1 --2- 172.21.15.72:0/1604469959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f373409d630 0x7f37341337b0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f37340a2c00 tx=0x7f3730004750 comp rx=0 tx=0).stop 2023-10-03T10:16:31.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.497+0000 7f373beb1700 1 -- 172.21.15.72:0/1604469959 shutdown_connections 2023-10-03T10:16:31.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.497+0000 7f373beb1700 1 --2- 172.21.15.72:0/1604469959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f373409d630 0x7f37341337b0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.497+0000 7f373beb1700 1 --2- 172.21.15.72:0/1604469959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3734138d80 0x7f3734134230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.497+0000 7f373beb1700 1 --2- 172.21.15.72:0/1604469959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37340a0a30 0x7f3734133cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.497+0000 7f373beb1700 1 -- 172.21.15.72:0/1604469959 >> 172.21.15.72:0/1604469959 conn(0x7f37340a3050 msgr2=0x7f373413aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.497+0000 7f373beb1700 1 -- 172.21.15.72:0/1604469959 shutdown_connections 2023-10-03T10:16:31.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:31.497+0000 7f373beb1700 1 -- 172.21.15.72:0/1604469959 wait complete. 2023-10-03T10:16:31.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:32.046 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.170+0000 7f84e181d700 1 Processor -- start 2023-10-03T10:16:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.170+0000 7f84e181d700 1 -- start start 2023-10-03T10:16:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.170+0000 7f84e181d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84dc09d630 0x7f84dc0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.170+0000 7f84e181d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84dc138d80 0x7f84dc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.170+0000 7f84e181d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84dc0a2a70 con 0x7f84dc0a0a30 2023-10-03T10:16:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.170+0000 7f84e181d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84dc0a01d0 con 0x7f84dc09d630 2023-10-03T10:16:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.170+0000 7f84e181d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc09e2b0 con 0x7f84dc138d80 2023-10-03T10:16:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.171+0000 7f84db7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84dc138d80 0x7f84dc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.171+0000 7f84da7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84dc09d630 0x7f84dc0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.171+0000 7f84db7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84dc138d80 0x7f84dc13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:57010/0 (socket says 172.21.15.72:57010) 2023-10-03T10:16:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.171+0000 7f84da7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84dc09d630 0x7f84dc0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60126/0 (socket says 172.21.15.72:60126) 2023-10-03T10:16:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.171+0000 7f84db7fe700 1 -- 172.21.15.72:0/2725890030 learned_addr learned my addr 172.21.15.72:0/2725890030 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.171+0000 7f84db7fe700 1 -- 172.21.15.72:0/2725890030 >> v2:172.21.15.72:3300/0 conn(0x7f84dc09d630 msgr2=0x7f84dc0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.171+0000 7f84db7fe700 1 --2- 172.21.15.72:0/2725890030 >> v2:172.21.15.72:3300/0 conn(0x7f84dc09d630 0x7f84dc0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.171+0000 7f84db7fe700 1 -- 172.21.15.72:0/2725890030 >> v1:172.21.15.72:6789/0 conn(0x7f84dc0a0a30 legacy=0x7f84dc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.171+0000 7f84db7fe700 1 -- 172.21.15.72:0/2725890030 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc09dc50 con 0x7f84dc138d80 2023-10-03T10:16:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.171+0000 7f84da7fc700 1 --2- 172.21.15.72:0/2725890030 >> v2:172.21.15.72:3300/0 conn(0x7f84dc09d630 0x7f84dc0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.171+0000 7f84db7fe700 1 --2- 172.21.15.72:0/2725890030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84dc138d80 0x7f84dc13b160 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009e50 tx=0x7f84d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10cc5b52edce31e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.171+0000 7f84d9ffb700 1 -- 172.21.15.72:0/2725890030 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d400e070 con 0x7f84dc138d80 2023-10-03T10:16:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.171+0000 7f84d9ffb700 1 -- 172.21.15.72:0/2725890030 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d400b910 con 0x7f84dc138d80 2023-10-03T10:16:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.171+0000 7f84d9ffb700 1 -- 172.21.15.72:0/2725890030 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d400bcc0 con 0x7f84dc138d80 2023-10-03T10:16:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.172+0000 7f84e181d700 1 -- 172.21.15.72:0/2725890030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84dc138d80 msgr2=0x7f84dc13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.172+0000 7f84e181d700 1 --2- 172.21.15.72:0/2725890030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84dc138d80 0x7f84dc13b160 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009e50 tx=0x7f84d400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.172+0000 7f84e181d700 1 -- 172.21.15.72:0/2725890030 shutdown_connections 2023-10-03T10:16:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.172+0000 7f84e181d700 1 --2- 172.21.15.72:0/2725890030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84dc138d80 0x7f84dc13b160 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.172+0000 7f84e181d700 1 --2- 172.21.15.72:0/2725890030 >> v2:172.21.15.72:3300/0 conn(0x7f84dc09d630 0x7f84dc0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.172+0000 7f84e181d700 1 -- 172.21.15.72:0/2725890030 >> 172.21.15.72:0/2725890030 conn(0x7f84dc0a3050 msgr2=0x7f84dc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.172+0000 7f84e181d700 1 -- 172.21.15.72:0/2725890030 shutdown_connections 2023-10-03T10:16:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.172+0000 7f84e181d700 1 -- 172.21.15.72:0/2725890030 wait complete. 2023-10-03T10:16:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.173+0000 7f84e181d700 1 Processor -- start 2023-10-03T10:16:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.173+0000 7f84e181d700 1 -- start start 2023-10-03T10:16:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.173+0000 7f84e181d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84dc09d630 0x7f84dc120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.173+0000 7f84e181d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84dc0a0a30 0x7f84dc120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.173+0000 7f84e181d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84dc138d80 0x7f84dc1210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.173+0000 7f84e181d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc124140 con 0x7f84dc09d630 2023-10-03T10:16:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.173+0000 7f84e181d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc1234f0 con 0x7f84dc138d80 2023-10-03T10:16:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.173+0000 7f84e181d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc138b20 con 0x7f84dc0a0a30 2023-10-03T10:16:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.173+0000 7f84da7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84dc0a0a30 0x7f84dc120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.173+0000 7f84db7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84dc138d80 0x7f84dc1210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.173+0000 7f84da7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84dc0a0a30 0x7f84dc120b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47488/0 (socket says 172.21.15.72:47488) 2023-10-03T10:16:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.173+0000 7f84da7fc700 1 -- 172.21.15.72:0/374034459 learned_addr learned my addr 172.21.15.72:0/374034459 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.173+0000 7f84daffd700 1 --2- 172.21.15.72:0/374034459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84dc09d630 0x7f84dc120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.174+0000 7f84db7fe700 1 -- 172.21.15.72:0/374034459 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84dc0a0a30 msgr2=0x7f84dc120b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.174+0000 7f84db7fe700 1 --2- 172.21.15.72:0/374034459 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84dc0a0a30 0x7f84dc120b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.174+0000 7f84db7fe700 1 -- 172.21.15.72:0/374034459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84dc09d630 msgr2=0x7f84dc120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.174+0000 7f84db7fe700 1 --2- 172.21.15.72:0/374034459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84dc09d630 0x7f84dc120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.174+0000 7f84db7fe700 1 -- 172.21.15.72:0/374034459 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc0094a0 con 0x7f84dc138d80 2023-10-03T10:16:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.174+0000 7f84db7fe700 1 --2- 172.21.15.72:0/374034459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84dc138d80 0x7f84dc1210a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f84d4015000 tx=0x7f84d4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.174+0000 7f84c3fff700 1 -- 172.21.15.72:0/374034459 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d4004780 con 0x7f84dc138d80 2023-10-03T10:16:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.174+0000 7f84c3fff700 1 -- 172.21.15.72:0/374034459 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d40092e0 con 0x7f84dc138d80 2023-10-03T10:16:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.174+0000 7f84e181d700 1 -- 172.21.15.72:0/374034459 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d4009b30 con 0x7f84dc138d80 2023-10-03T10:16:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.174+0000 7f84c3fff700 1 -- 172.21.15.72:0/374034459 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d401c650 con 0x7f84dc138d80 2023-10-03T10:16:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.174+0000 7f84e181d700 1 -- 172.21.15.72:0/374034459 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84dc0a0460 con 0x7f84dc138d80 2023-10-03T10:16:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.175+0000 7f84c3fff700 1 -- 172.21.15.72:0/374034459 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84d401c7b0 con 0x7f84dc138d80 2023-10-03T10:16:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.175+0000 7f84c3fff700 1 -- 172.21.15.72:0/374034459 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f84d4040ef0 con 0x7f84dc138d80 2023-10-03T10:16:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.175+0000 7f84e181d700 1 -- 172.21.15.72:0/374034459 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84dc0747f0 con 0x7f84dc138d80 2023-10-03T10:16:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.180+0000 7f84c3fff700 1 -- 172.21.15.72:0/374034459 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84d401ca60 con 0x7f84dc138d80 2023-10-03T10:16:32.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.365+0000 7f84e181d700 1 -- 172.21.15.72:0/374034459 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f84dc124930 con 0x7f84dc138d80 2023-10-03T10:16:32.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.365+0000 7f84c3fff700 1 -- 172.21.15.72:0/374034459 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84d4033090 con 0x7f84dc138d80 2023-10-03T10:16:32.365 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:32.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.368+0000 7f84e181d700 1 -- 172.21.15.72:0/374034459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84dc138d80 msgr2=0x7f84dc1210a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.368+0000 7f84e181d700 1 --2- 172.21.15.72:0/374034459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84dc138d80 0x7f84dc1210a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f84d4015000 tx=0x7f84d4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.368+0000 7f84e181d700 1 -- 172.21.15.72:0/374034459 shutdown_connections 2023-10-03T10:16:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.368+0000 7f84e181d700 1 --2- 172.21.15.72:0/374034459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84dc09d630 0x7f84dc120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.368+0000 7f84e181d700 1 --2- 172.21.15.72:0/374034459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84dc138d80 0x7f84dc1210a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.368+0000 7f84e181d700 1 --2- 172.21.15.72:0/374034459 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84dc0a0a30 0x7f84dc120b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.368+0000 7f84e181d700 1 -- 172.21.15.72:0/374034459 >> 172.21.15.72:0/374034459 conn(0x7f84dc0a3050 msgr2=0x7f84dc139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.368+0000 7f84e181d700 1 -- 172.21.15.72:0/374034459 shutdown_connections 2023-10-03T10:16:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.368+0000 7f84e181d700 1 -- 172.21.15.72:0/374034459 wait complete. 2023-10-03T10:16:32.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:32.379 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:32.495 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:32.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.501+0000 7f9b83c3b700 1 Processor -- start 2023-10-03T10:16:32.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.501+0000 7f9b83c3b700 1 -- start start 2023-10-03T10:16:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.501+0000 7f9b83c3b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b7c131810 0x7f9b7c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.501+0000 7f9b83c3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b7c099a40 0x7f9b7c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.501+0000 7f9b83c3b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b7c1313c0 con 0x7f9b7c09a3b0 2023-10-03T10:16:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.501+0000 7f9b83c3b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c09b580 con 0x7f9b7c099a40 2023-10-03T10:16:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.501+0000 7f9b83c3b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c06e8c0 con 0x7f9b7c131810 2023-10-03T10:16:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.501+0000 7f9b819d7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b7c131810 0x7f9b7c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.501+0000 7f9b821d8700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9b7c09a3b0 0x7f9b7c138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44688/0 (socket says 172.21.15.72:44688) 2023-10-03T10:16:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.501+0000 7f9b821d8700 1 -- 172.21.15.72:0/30918961 learned_addr learned my addr 172.21.15.72:0/30918961 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.502+0000 7f9b811d6700 1 --2- 172.21.15.72:0/30918961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b7c099a40 0x7f9b7c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.502+0000 7f9b809d5700 1 -- 172.21.15.72:0/30918961 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305824640 0 0) 0x7f9b7c1313c0 con 0x7f9b7c09a3b0 2023-10-03T10:16:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.502+0000 7f9b819d7700 1 -- 172.21.15.72:0/30918961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b7c099a40 msgr2=0x7f9b7c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.502+0000 7f9b819d7700 1 --2- 172.21.15.72:0/30918961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b7c099a40 0x7f9b7c099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.502+0000 7f9b819d7700 1 -- 172.21.15.72:0/30918961 >> v1:172.21.15.72:6789/0 conn(0x7f9b7c09a3b0 legacy=0x7f9b7c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.502+0000 7f9b819d7700 1 -- 172.21.15.72:0/30918961 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c09a820 con 0x7f9b7c131810 2023-10-03T10:16:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.502+0000 7f9b819d7700 1 --2- 172.21.15.72:0/30918961 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b7c131810 0x7f9b7c131be0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009870 tx=0x7f9b78009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0288d3a2c0042a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.502+0000 7f9b809d5700 1 -- 172.21.15.72:0/30918961 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78011830 con 0x7f9b7c131810 2023-10-03T10:16:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.502+0000 7f9b809d5700 1 -- 172.21.15.72:0/30918961 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b78011990 con 0x7f9b7c131810 2023-10-03T10:16:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.502+0000 7f9b809d5700 1 -- 172.21.15.72:0/30918961 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78011d20 con 0x7f9b7c131810 2023-10-03T10:16:32.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.503+0000 7f9b83c3b700 1 -- 172.21.15.72:0/30918961 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b7c131810 msgr2=0x7f9b7c131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.503+0000 7f9b83c3b700 1 --2- 172.21.15.72:0/30918961 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b7c131810 0x7f9b7c131be0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009870 tx=0x7f9b78009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:32.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.503+0000 7f9b83c3b700 1 -- 172.21.15.72:0/30918961 shutdown_connections 2023-10-03T10:16:32.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.503+0000 7f9b83c3b700 1 --2- 172.21.15.72:0/30918961 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b7c131810 0x7f9b7c131be0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.503+0000 7f9b83c3b700 1 --2- 172.21.15.72:0/30918961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b7c099a40 0x7f9b7c099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.503+0000 7f9b83c3b700 1 -- 172.21.15.72:0/30918961 >> 172.21.15.72:0/30918961 conn(0x7f9b7c0a2aa0 msgr2=0x7f9b7c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.503+0000 7f9b83c3b700 1 -- 172.21.15.72:0/30918961 shutdown_connections 2023-10-03T10:16:32.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.503+0000 7f9b83c3b700 1 -- 172.21.15.72:0/30918961 wait complete. 2023-10-03T10:16:32.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.504+0000 7f9b83c3b700 1 Processor -- start 2023-10-03T10:16:32.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.504+0000 7f9b83c3b700 1 -- start start 2023-10-03T10:16:32.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b83c3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b7c099a40 0x7f9b7c06f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b83c3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b7c09a3b0 0x7f9b7c06fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b83c3b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b7c131810 0x7f9b7c070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b83c3b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c120c80 con 0x7f9b7c099a40 2023-10-03T10:16:32.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b83c3b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c121020 con 0x7f9b7c09a3b0 2023-10-03T10:16:32.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b83c3b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c070a70 con 0x7f9b7c131810 2023-10-03T10:16:32.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b819d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b7c099a40 0x7f9b7c06f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b821d8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b7c131810 0x7f9b7c070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b811d6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b7c09a3b0 0x7f9b7c06fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b819d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b7c099a40 0x7f9b7c06f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60142/0 (socket says 172.21.15.72:60142) 2023-10-03T10:16:32.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b819d7700 1 -- 172.21.15.72:0/3721020832 learned_addr learned my addr 172.21.15.72:0/3721020832 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:32.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b821d8700 1 -- 172.21.15.72:0/3721020832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b7c09a3b0 msgr2=0x7f9b7c06fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b821d8700 1 --2- 172.21.15.72:0/3721020832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b7c09a3b0 0x7f9b7c06fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b821d8700 1 -- 172.21.15.72:0/3721020832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b7c099a40 msgr2=0x7f9b7c06f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b821d8700 1 --2- 172.21.15.72:0/3721020832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b7c099a40 0x7f9b7c06f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b821d8700 1 -- 172.21.15.72:0/3721020832 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b780094a0 con 0x7f9b7c131810 2023-10-03T10:16:32.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b811d6700 1 --2- 172.21.15.72:0/3721020832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b7c09a3b0 0x7f9b7c06fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b821d8700 1 --2- 172.21.15.72:0/3721020832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b7c131810 0x7f9b7c070090 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400cc10 tx=0x7f9b7400cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.505+0000 7f9b727fc700 1 -- 172.21.15.72:0/3721020832 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7400aa00 con 0x7f9b7c131810 2023-10-03T10:16:32.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.506+0000 7f9b727fc700 1 -- 172.21.15.72:0/3721020832 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7400ab80 con 0x7f9b7c131810 2023-10-03T10:16:32.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.506+0000 7f9b83c3b700 1 -- 172.21.15.72:0/3721020832 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7c121220 con 0x7f9b7c131810 2023-10-03T10:16:32.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.506+0000 7f9b727fc700 1 -- 172.21.15.72:0/3721020832 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b740070d0 con 0x7f9b7c131810 2023-10-03T10:16:32.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.506+0000 7f9b83c3b700 1 -- 172.21.15.72:0/3721020832 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7c06eb00 con 0x7f9b7c131810 2023-10-03T10:16:32.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.506+0000 7f9b727fc700 1 -- 172.21.15.72:0/3721020832 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b74007230 con 0x7f9b7c131810 2023-10-03T10:16:32.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.507+0000 7f9b727fc700 1 -- 172.21.15.72:0/3721020832 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9b7403f010 con 0x7f9b7c131810 2023-10-03T10:16:32.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.507+0000 7f9b83c3b700 1 -- 172.21.15.72:0/3721020832 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7c074ea0 con 0x7f9b7c131810 2023-10-03T10:16:32.510 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:32.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.511+0000 7f9b727fc700 1 -- 172.21.15.72:0/3721020832 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b74018020 con 0x7f9b7c131810 2023-10-03T10:16:32.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.623+0000 7fad8694b700 1 Processor -- start 2023-10-03T10:16:32.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.623+0000 7fad8694b700 1 -- start start 2023-10-03T10:16:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad8694b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad801337f0 0x7fad80138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad8694b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad80138dc0 0x7fad8013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad8694b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8006b990 con 0x7fad80133420 2023-10-03T10:16:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad8694b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8009b0e0 con 0x7fad801337f0 2023-10-03T10:16:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad8694b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad80133c20 con 0x7fad80138dc0 2023-10-03T10:16:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad7f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad801337f0 0x7fad80138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad84ee8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad80138dc0 0x7fad8013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad7f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad801337f0 0x7fad80138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60156/0 (socket says 172.21.15.72:60156) 2023-10-03T10:16:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad7f7fe700 1 -- 172.21.15.72:0/3522163596 learned_addr learned my addr 172.21.15.72:0/3522163596 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad7f7fe700 1 -- 172.21.15.72:0/3522163596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad80138dc0 msgr2=0x7fad8013b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad7f7fe700 1 --2- 172.21.15.72:0/3522163596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad80138dc0 0x7fad8013b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad7f7fe700 1 -- 172.21.15.72:0/3522163596 >> v1:172.21.15.72:6789/0 conn(0x7fad80133420 legacy=0x7fad80133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad7f7fe700 1 -- 172.21.15.72:0/3522163596 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad800a0590 con 0x7fad801337f0 2023-10-03T10:16:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad7effd700 1 -- 172.21.15.72:0/3522163596 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786063136 0 0) 0x7fad8006b990 con 0x7fad80133420 2023-10-03T10:16:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad84ee8700 1 --2- 172.21.15.72:0/3522163596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad80138dc0 0x7fad8013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad7f7fe700 1 --2- 172.21.15.72:0/3522163596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad801337f0 0x7fad80138880 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fad740098f0 tx=0x7fad74009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533b7b3f7f447ad4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad7effd700 1 -- 172.21.15.72:0/3522163596 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74011830 con 0x7fad801337f0 2023-10-03T10:16:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.624+0000 7fad7effd700 1 -- 172.21.15.72:0/3522163596 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad74011990 con 0x7fad801337f0 2023-10-03T10:16:32.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.625+0000 7fad7effd700 1 -- 172.21.15.72:0/3522163596 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74011d20 con 0x7fad801337f0 2023-10-03T10:16:32.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.625+0000 7fad8694b700 1 -- 172.21.15.72:0/3522163596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad801337f0 msgr2=0x7fad80138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.625+0000 7fad8694b700 1 --2- 172.21.15.72:0/3522163596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad801337f0 0x7fad80138880 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fad740098f0 tx=0x7fad74009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:32.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.625+0000 7fad8694b700 1 -- 172.21.15.72:0/3522163596 shutdown_connections 2023-10-03T10:16:32.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.625+0000 7fad8694b700 1 --2- 172.21.15.72:0/3522163596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad80138dc0 0x7fad8013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.625+0000 7fad8694b700 1 --2- 172.21.15.72:0/3522163596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad801337f0 0x7fad80138880 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.625+0000 7fad8694b700 1 -- 172.21.15.72:0/3522163596 >> 172.21.15.72:0/3522163596 conn(0x7fad800a4210 msgr2=0x7fad800a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.625+0000 7fad8694b700 1 -- 172.21.15.72:0/3522163596 shutdown_connections 2023-10-03T10:16:32.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.625+0000 7fad8694b700 1 -- 172.21.15.72:0/3522163596 wait complete. 2023-10-03T10:16:32.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.626+0000 7fad8694b700 1 Processor -- start 2023-10-03T10:16:32.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.627+0000 7fad8694b700 1 -- start start 2023-10-03T10:16:32.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.627+0000 7fad8694b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad80133420 0x7fad80137810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.627+0000 7fad8694b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad801337f0 0x7fad80137d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.627+0000 7fad8694b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad80138dc0 0x7fad8009c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.627+0000 7fad8694b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad80134650 con 0x7fad80133420 2023-10-03T10:16:32.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.627+0000 7fad8694b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8009e020 con 0x7fad80138dc0 2023-10-03T10:16:32.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.627+0000 7fad8694b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad80130ab0 con 0x7fad801337f0 2023-10-03T10:16:32.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.627+0000 7fad7ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad80133420 0x7fad80137810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.627+0000 7fad84ee8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad80138dc0 0x7fad8009c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.627+0000 7fad7ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad80133420 0x7fad80137810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60164/0 (socket says 172.21.15.72:60164) 2023-10-03T10:16:32.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.627+0000 7fad7ffff700 1 -- 172.21.15.72:0/1100329567 learned_addr learned my addr 172.21.15.72:0/1100329567 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:32.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.627+0000 7fad7f7fe700 1 --2- 172.21.15.72:0/1100329567 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad801337f0 0x7fad80137d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.628+0000 7fad7ffff700 1 -- 172.21.15.72:0/1100329567 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad801337f0 msgr2=0x7fad80137d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.628+0000 7fad7ffff700 1 --2- 172.21.15.72:0/1100329567 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad801337f0 0x7fad80137d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.628+0000 7fad7ffff700 1 -- 172.21.15.72:0/1100329567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad80138dc0 msgr2=0x7fad8009c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.628+0000 7fad7ffff700 1 --2- 172.21.15.72:0/1100329567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad80138dc0 0x7fad8009c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.628+0000 7fad7ffff700 1 -- 172.21.15.72:0/1100329567 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad78009a70 con 0x7fad80133420 2023-10-03T10:16:32.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.628+0000 7fad84ee8700 1 --2- 172.21.15.72:0/1100329567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad80138dc0 0x7fad8009c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.628+0000 7fad7ffff700 1 --2- 172.21.15.72:0/1100329567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad80133420 0x7fad80137810 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fad70001eb0 tx=0x7fad7000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.628+0000 7fad7cff9700 1 -- 172.21.15.72:0/1100329567 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad700054e0 con 0x7fad80133420 2023-10-03T10:16:32.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.628+0000 7fad7cff9700 1 -- 172.21.15.72:0/1100329567 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad70003680 con 0x7fad80133420 2023-10-03T10:16:32.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.628+0000 7fad7cff9700 1 -- 172.21.15.72:0/1100329567 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad700039f0 con 0x7fad80133420 2023-10-03T10:16:32.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.628+0000 7fad8694b700 1 -- 172.21.15.72:0/1100329567 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad74009550 con 0x7fad80133420 2023-10-03T10:16:32.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.628+0000 7fad8694b700 1 -- 172.21.15.72:0/1100329567 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8012f280 con 0x7fad80133420 2023-10-03T10:16:32.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.629+0000 7fad7cff9700 1 -- 172.21.15.72:0/1100329567 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad70003b50 con 0x7fad80133420 2023-10-03T10:16:32.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.629+0000 7fad8694b700 1 -- 172.21.15.72:0/1100329567 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad800a47a0 con 0x7fad80133420 2023-10-03T10:16:32.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.629+0000 7fad7cff9700 1 -- 172.21.15.72:0/1100329567 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fad7003eb10 con 0x7fad80133420 2023-10-03T10:16:32.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.639+0000 7fad7cff9700 1 -- 172.21.15.72:0/1100329567 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad70017080 con 0x7fad80133420 2023-10-03T10:16:32.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.639+0000 7f147860a700 1 Processor -- start 2023-10-03T10:16:32.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.639+0000 7f147860a700 1 -- start start 2023-10-03T10:16:32.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f147860a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f147009d6f0 0x7f147009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f147860a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f147009e000 0x7f14701339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f147860a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f147009e410 0x7f1470133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f147860a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147006b460 con 0x7f147009e410 2023-10-03T10:16:32.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f147860a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147009b120 con 0x7f147009e000 2023-10-03T10:16:32.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f147860a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f147009a7e0 con 0x7f147009d6f0 2023-10-03T10:16:32.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f14763a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f147009d6f0 0x7f147009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f14763a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f147009d6f0 0x7f147009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47538/0 (socket says 172.21.15.72:47538) 2023-10-03T10:16:32.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f14763a6700 1 -- 172.21.15.72:0/3908184176 learned_addr learned my addr 172.21.15.72:0/3908184176 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:32.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f1476ba7700 1 --2- 172.21.15.72:0/3908184176 >> v2:172.21.15.72:3300/0 conn(0x7f147009e410 0x7f1470133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f1475ba5700 1 --2- 172.21.15.72:0/3908184176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f147009e000 0x7f14701339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f14763a6700 1 -- 172.21.15.72:0/3908184176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f147009e000 msgr2=0x7f14701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f14763a6700 1 --2- 172.21.15.72:0/3908184176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f147009e000 0x7f14701339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f14763a6700 1 -- 172.21.15.72:0/3908184176 >> v2:172.21.15.72:3300/0 conn(0x7f147009e410 msgr2=0x7f1470133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f14763a6700 1 --2- 172.21.15.72:0/3908184176 >> v2:172.21.15.72:3300/0 conn(0x7f147009e410 0x7f1470133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f14763a6700 1 -- 172.21.15.72:0/3908184176 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147009a500 con 0x7f147009d6f0 2023-10-03T10:16:32.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f1476ba7700 1 --2- 172.21.15.72:0/3908184176 >> v2:172.21.15.72:3300/0 conn(0x7f147009e410 0x7f1470133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.640+0000 7f14763a6700 1 --2- 172.21.15.72:0/3908184176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f147009d6f0 0x7f147009dac0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f146c009920 tx=0x7f146c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c100cb9a326dfefa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.641+0000 7f14753a4700 1 -- 172.21.15.72:0/3908184176 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c011830 con 0x7f147009d6f0 2023-10-03T10:16:32.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.641+0000 7f14753a4700 1 -- 172.21.15.72:0/3908184176 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c011990 con 0x7f147009d6f0 2023-10-03T10:16:32.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.641+0000 7f14753a4700 1 -- 172.21.15.72:0/3908184176 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c011d20 con 0x7f147009d6f0 2023-10-03T10:16:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.641+0000 7f147860a700 1 -- 172.21.15.72:0/3908184176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f147009d6f0 msgr2=0x7f147009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.641+0000 7f147860a700 1 --2- 172.21.15.72:0/3908184176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f147009d6f0 0x7f147009dac0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f146c009920 tx=0x7f146c009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.641+0000 7f147860a700 1 -- 172.21.15.72:0/3908184176 shutdown_connections 2023-10-03T10:16:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.641+0000 7f147860a700 1 --2- 172.21.15.72:0/3908184176 >> v2:172.21.15.72:3300/0 conn(0x7f147009e410 0x7f1470133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.641+0000 7f147860a700 1 --2- 172.21.15.72:0/3908184176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f147009d6f0 0x7f147009dac0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.641+0000 7f147860a700 1 --2- 172.21.15.72:0/3908184176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f147009e000 0x7f14701339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.641+0000 7f147860a700 1 -- 172.21.15.72:0/3908184176 >> 172.21.15.72:0/3908184176 conn(0x7f1470066f50 msgr2=0x7f147009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.641+0000 7f147860a700 1 -- 172.21.15.72:0/3908184176 shutdown_connections 2023-10-03T10:16:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.641+0000 7f147860a700 1 -- 172.21.15.72:0/3908184176 wait complete. 2023-10-03T10:16:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.642+0000 7f147860a700 1 Processor -- start 2023-10-03T10:16:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.642+0000 7f147860a700 1 -- start start 2023-10-03T10:16:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f147860a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f147009d6f0 0x7f14701c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f147860a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f147009e000 0x7f14701c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f147860a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f147009e410 0x7f14701c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f147860a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14701a5590 con 0x7f147009e000 2023-10-03T10:16:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f147860a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14701a53a0 con 0x7f147009e410 2023-10-03T10:16:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f147860a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14700a30c0 con 0x7f147009d6f0 2023-10-03T10:16:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f14763a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f147009d6f0 0x7f14701c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f1476ba7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f147009e410 0x7f14701c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f14763a6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f147009d6f0 0x7f14701c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47550/0 (socket says 172.21.15.72:47550) 2023-10-03T10:16:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f14763a6700 1 -- 172.21.15.72:0/3085389792 learned_addr learned my addr 172.21.15.72:0/3085389792 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f1475ba5700 1 --2- 172.21.15.72:0/3085389792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f147009e000 0x7f14701c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f14763a6700 1 -- 172.21.15.72:0/3085389792 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f147009e410 msgr2=0x7f14701c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f14763a6700 1 --2- 172.21.15.72:0/3085389792 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f147009e410 0x7f14701c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f14763a6700 1 -- 172.21.15.72:0/3085389792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f147009e000 msgr2=0x7f14701c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f14763a6700 1 --2- 172.21.15.72:0/3085389792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f147009e000 0x7f14701c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f14763a6700 1 -- 172.21.15.72:0/3085389792 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1468009a70 con 0x7f147009d6f0 2023-10-03T10:16:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f14763a6700 1 --2- 172.21.15.72:0/3085389792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f147009d6f0 0x7f14701c8190 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f146c000c00 tx=0x7f146c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.643+0000 7f1466ffd700 1 -- 172.21.15.72:0/3085389792 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c004240 con 0x7f147009d6f0 2023-10-03T10:16:32.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.644+0000 7f1466ffd700 1 -- 172.21.15.72:0/3085389792 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c01f070 con 0x7f147009d6f0 2023-10-03T10:16:32.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.644+0000 7f1466ffd700 1 -- 172.21.15.72:0/3085389792 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c0036a0 con 0x7f147009d6f0 2023-10-03T10:16:32.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.644+0000 7f147860a700 1 -- 172.21.15.72:0/3085389792 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146c009550 con 0x7f147009d6f0 2023-10-03T10:16:32.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.644+0000 7f147860a700 1 -- 172.21.15.72:0/3085389792 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14701a7320 con 0x7f147009d6f0 2023-10-03T10:16:32.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.644+0000 7f1466ffd700 1 -- 172.21.15.72:0/3085389792 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f146c021030 con 0x7f147009d6f0 2023-10-03T10:16:32.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.645+0000 7f1466ffd700 1 -- 172.21.15.72:0/3085389792 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f146c040730 con 0x7f147009d6f0 2023-10-03T10:16:32.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.645+0000 7f147860a700 1 -- 172.21.15.72:0/3085389792 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1470074ea0 con 0x7f147009d6f0 2023-10-03T10:16:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.649+0000 7f1466ffd700 1 -- 172.21.15.72:0/3085389792 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f146c015070 con 0x7f147009d6f0 2023-10-03T10:16:32.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.734+0000 7f9b83c3b700 1 -- 172.21.15.72:0/3721020832 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9b7c0712c0 con 0x7f9b7c131810 2023-10-03T10:16:32.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.734+0000 7f9b727fc700 1 -- 172.21.15.72:0/3721020832 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b74019860 con 0x7f9b7c131810 2023-10-03T10:16:32.733 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.736+0000 7f9b83c3b700 1 -- 172.21.15.72:0/3721020832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b7c131810 msgr2=0x7f9b7c070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.736+0000 7f9b83c3b700 1 --2- 172.21.15.72:0/3721020832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b7c131810 0x7f9b7c070090 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400cc10 tx=0x7f9b7400cf20 comp rx=0 tx=0).stop 2023-10-03T10:16:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.736+0000 7f9b83c3b700 1 -- 172.21.15.72:0/3721020832 shutdown_connections 2023-10-03T10:16:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.736+0000 7f9b83c3b700 1 --2- 172.21.15.72:0/3721020832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b7c099a40 0x7f9b7c06f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.736+0000 7f9b83c3b700 1 --2- 172.21.15.72:0/3721020832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b7c131810 0x7f9b7c070090 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.736+0000 7f9b83c3b700 1 --2- 172.21.15.72:0/3721020832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b7c09a3b0 0x7f9b7c06fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.736+0000 7f9b83c3b700 1 -- 172.21.15.72:0/3721020832 >> 172.21.15.72:0/3721020832 conn(0x7f9b7c0a2aa0 msgr2=0x7f9b7c1b8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.736+0000 7f9b83c3b700 1 -- 172.21.15.72:0/3721020832 shutdown_connections 2023-10-03T10:16:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.736+0000 7f9b83c3b700 1 -- 172.21.15.72:0/3721020832 wait complete. 2023-10-03T10:16:32.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:32.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.841+0000 7f147860a700 1 -- 172.21.15.72:0/3085389792 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f14701b84f0 con 0x7f147009d6f0 2023-10-03T10:16:32.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.842+0000 7f1466ffd700 1 -- 172.21.15.72:0/3085389792 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f146c0239c0 con 0x7f147009d6f0 2023-10-03T10:16:32.841 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:32.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.843+0000 7f147860a700 1 -- 172.21.15.72:0/3085389792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f147009d6f0 msgr2=0x7f14701c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.843+0000 7f147860a700 1 --2- 172.21.15.72:0/3085389792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f147009d6f0 0x7f14701c8190 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f146c000c00 tx=0x7f146c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:32.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.843+0000 7f147860a700 1 -- 172.21.15.72:0/3085389792 shutdown_connections 2023-10-03T10:16:32.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.843+0000 7f147860a700 1 --2- 172.21.15.72:0/3085389792 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f147009e410 0x7f14701c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.843+0000 7f147860a700 1 --2- 172.21.15.72:0/3085389792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f147009d6f0 0x7f14701c8190 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.843+0000 7f147860a700 1 --2- 172.21.15.72:0/3085389792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f147009e000 0x7f14701c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.843+0000 7f147860a700 1 -- 172.21.15.72:0/3085389792 >> 172.21.15.72:0/3085389792 conn(0x7f1470066f50 msgr2=0x7f14701bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.844+0000 7f147860a700 1 -- 172.21.15.72:0/3085389792 shutdown_connections 2023-10-03T10:16:32.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.844+0000 7f147860a700 1 -- 172.21.15.72:0/3085389792 wait complete. 2023-10-03T10:16:32.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.853+0000 7fad8694b700 1 -- 172.21.15.72:0/1100329567 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad80074ea0 con 0x7fad80133420 2023-10-03T10:16:32.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.853+0000 7fad7cff9700 1 -- 172.21.15.72:0/1100329567 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fad7001b3b0 con 0x7fad80133420 2023-10-03T10:16:32.853 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:32.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:32.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.856+0000 7fad8694b700 1 -- 172.21.15.72:0/1100329567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad80133420 msgr2=0x7fad80137810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.856+0000 7fad8694b700 1 --2- 172.21.15.72:0/1100329567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad80133420 0x7fad80137810 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fad70001eb0 tx=0x7fad7000c800 comp rx=0 tx=0).stop 2023-10-03T10:16:32.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.856+0000 7fad8694b700 1 -- 172.21.15.72:0/1100329567 shutdown_connections 2023-10-03T10:16:32.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.856+0000 7fad8694b700 1 --2- 172.21.15.72:0/1100329567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad80133420 0x7fad80137810 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.856+0000 7fad8694b700 1 --2- 172.21.15.72:0/1100329567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad80138dc0 0x7fad8009c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.856+0000 7fad8694b700 1 --2- 172.21.15.72:0/1100329567 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad801337f0 0x7fad80137d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.856+0000 7fad8694b700 1 -- 172.21.15.72:0/1100329567 >> 172.21.15.72:0/1100329567 conn(0x7fad800a4210 msgr2=0x7fad800a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.856+0000 7fad8694b700 1 -- 172.21.15.72:0/1100329567 shutdown_connections 2023-10-03T10:16:32.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:32.856+0000 7fad8694b700 1 -- 172.21.15.72:0/1100329567 wait complete. 2023-10-03T10:16:32.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:33.380 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.506+0000 7f8c76350700 1 Processor -- start 2023-10-03T10:16:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.506+0000 7f8c76350700 1 -- start start 2023-10-03T10:16:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c76350700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8c70130750 0x7f8c70130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c76350700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c7009d6f0 0x7f8c7009db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c76350700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c7009e080 0x7f8c701374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c76350700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7009c190 con 0x7f8c70130750 2023-10-03T10:16:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c76350700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7009b090 con 0x7f8c7009e080 2023-10-03T10:16:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c76350700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7009a6c0 con 0x7f8c7009d6f0 2023-10-03T10:16:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c6f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c7009d6f0 0x7f8c7009db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c6ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8c70130750 0x7f8c70130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c748ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c7009e080 0x7f8c701374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c6ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8c70130750 0x7f8c70130b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60186/0 (socket says 172.21.15.72:60186) 2023-10-03T10:16:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c748ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c7009e080 0x7f8c701374b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:57084/0 (socket says 172.21.15.72:57084) 2023-10-03T10:16:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c6ffff700 1 -- 172.21.15.72:0/3004950880 learned_addr learned my addr 172.21.15.72:0/3004950880 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c6f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c7009d6f0 0x7f8c7009db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47556/0 (socket says 172.21.15.72:47556) 2023-10-03T10:16:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c6f7fe700 1 -- 172.21.15.72:0/3004950880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c7009e080 msgr2=0x7f8c701374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c6f7fe700 1 --2- 172.21.15.72:0/3004950880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c7009e080 0x7f8c701374b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c6f7fe700 1 -- 172.21.15.72:0/3004950880 >> v2:172.21.15.72:3300/0 conn(0x7f8c70130750 msgr2=0x7f8c70130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c6f7fe700 1 --2- 172.21.15.72:0/3004950880 >> v2:172.21.15.72:3300/0 conn(0x7f8c70130750 0x7f8c70130b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c6f7fe700 1 -- 172.21.15.72:0/3004950880 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c70131060 con 0x7f8c7009d6f0 2023-10-03T10:16:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c748ed700 1 --2- 172.21.15.72:0/3004950880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c7009e080 0x7f8c701374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c6ffff700 1 --2- 172.21.15.72:0/3004950880 >> v2:172.21.15.72:3300/0 conn(0x7f8c70130750 0x7f8c70130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.507+0000 7f8c6f7fe700 1 --2- 172.21.15.72:0/3004950880 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c7009d6f0 0x7f8c7009db40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009840 tx=0x7f8c60009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85da61d5713259d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.508+0000 7f8c6effd700 1 -- 172.21.15.72:0/3004950880 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60011830 con 0x7f8c7009d6f0 2023-10-03T10:16:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.508+0000 7f8c6effd700 1 -- 172.21.15.72:0/3004950880 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c60011990 con 0x7f8c7009d6f0 2023-10-03T10:16:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.508+0000 7f8c6effd700 1 -- 172.21.15.72:0/3004950880 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60011d20 con 0x7f8c7009d6f0 2023-10-03T10:16:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.508+0000 7f8c76350700 1 -- 172.21.15.72:0/3004950880 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c7009d6f0 msgr2=0x7f8c7009db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.508+0000 7f8c76350700 1 --2- 172.21.15.72:0/3004950880 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c7009d6f0 0x7f8c7009db40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009840 tx=0x7f8c60009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.508+0000 7f8c76350700 1 -- 172.21.15.72:0/3004950880 shutdown_connections 2023-10-03T10:16:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.508+0000 7f8c76350700 1 --2- 172.21.15.72:0/3004950880 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c7009e080 0x7f8c701374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.508+0000 7f8c76350700 1 --2- 172.21.15.72:0/3004950880 >> v2:172.21.15.72:3300/0 conn(0x7f8c70130750 0x7f8c70130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.508+0000 7f8c76350700 1 --2- 172.21.15.72:0/3004950880 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c7009d6f0 0x7f8c7009db40 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.508+0000 7f8c76350700 1 -- 172.21.15.72:0/3004950880 >> 172.21.15.72:0/3004950880 conn(0x7f8c7009f470 msgr2=0x7f8c700a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.508+0000 7f8c76350700 1 -- 172.21.15.72:0/3004950880 shutdown_connections 2023-10-03T10:16:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.508+0000 7f8c76350700 1 -- 172.21.15.72:0/3004950880 wait complete. 2023-10-03T10:16:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.509+0000 7f8c76350700 1 Processor -- start 2023-10-03T10:16:33.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.509+0000 7f8c76350700 1 -- start start 2023-10-03T10:16:33.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c76350700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c7009d6f0 0x7f8c7012ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c76350700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c7009e080 0x7f8c7012b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c76350700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c70130750 0x7f8c7012b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c76350700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7012e000 con 0x7f8c7009d6f0 2023-10-03T10:16:33.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c76350700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7009d180 con 0x7f8c70130750 2023-10-03T10:16:33.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c76350700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7009b2b0 con 0x7f8c7009e080 2023-10-03T10:16:33.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c6ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c7009d6f0 0x7f8c7012ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c6ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c7009d6f0 0x7f8c7012ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60202/0 (socket says 172.21.15.72:60202) 2023-10-03T10:16:33.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c748ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c70130750 0x7f8c7012b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c6ffff700 1 -- 172.21.15.72:0/2805892281 learned_addr learned my addr 172.21.15.72:0/2805892281 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:33.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c6f7fe700 1 --2- 172.21.15.72:0/2805892281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c7009e080 0x7f8c7012b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c6ffff700 1 -- 172.21.15.72:0/2805892281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c7009e080 msgr2=0x7f8c7012b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c6ffff700 1 --2- 172.21.15.72:0/2805892281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c7009e080 0x7f8c7012b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c6ffff700 1 -- 172.21.15.72:0/2805892281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c70130750 msgr2=0x7f8c7012b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c6ffff700 1 --2- 172.21.15.72:0/2805892281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c70130750 0x7f8c7012b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c6ffff700 1 -- 172.21.15.72:0/2805892281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6800bc80 con 0x7f8c7009d6f0 2023-10-03T10:16:33.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c6f7fe700 1 --2- 172.21.15.72:0/2805892281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c7009e080 0x7f8c7012b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c6ffff700 1 --2- 172.21.15.72:0/2805892281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c7009d6f0 0x7f8c7012ab60 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400ebe0 tx=0x7f8c6400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c6cff9700 1 -- 172.21.15.72:0/2805892281 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6400c850 con 0x7f8c7009d6f0 2023-10-03T10:16:33.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c6cff9700 1 -- 172.21.15.72:0/2805892281 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6400c9b0 con 0x7f8c7009d6f0 2023-10-03T10:16:33.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c76350700 1 -- 172.21.15.72:0/2805892281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c64009550 con 0x7f8c7009d6f0 2023-10-03T10:16:33.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c6cff9700 1 -- 172.21.15.72:0/2805892281 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6400cd20 con 0x7f8c7009d6f0 2023-10-03T10:16:33.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.510+0000 7f8c76350700 1 -- 172.21.15.72:0/2805892281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c600094a0 con 0x7f8c7009d6f0 2023-10-03T10:16:33.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.511+0000 7f8c6cff9700 1 -- 172.21.15.72:0/2805892281 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c64013470 con 0x7f8c7009d6f0 2023-10-03T10:16:33.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.511+0000 7f8c76350700 1 -- 172.21.15.72:0/2805892281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c700a02f0 con 0x7f8c7009d6f0 2023-10-03T10:16:33.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.511+0000 7f8c6cff9700 1 -- 172.21.15.72:0/2805892281 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c6403f800 con 0x7f8c7009d6f0 2023-10-03T10:16:33.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.516+0000 7f8c6cff9700 1 -- 172.21.15.72:0/2805892281 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c640232f0 con 0x7f8c7009d6f0 2023-10-03T10:16:33.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.702+0000 7f8c76350700 1 -- 172.21.15.72:0/2805892281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8c700747f0 con 0x7f8c7009d6f0 2023-10-03T10:16:33.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.702+0000 7f8c6cff9700 1 -- 172.21.15.72:0/2805892281 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c64021090 con 0x7f8c7009d6f0 2023-10-03T10:16:33.702 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:33.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.704+0000 7f8c76350700 1 -- 172.21.15.72:0/2805892281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c7009d6f0 msgr2=0x7f8c7012ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.704+0000 7f8c76350700 1 --2- 172.21.15.72:0/2805892281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c7009d6f0 0x7f8c7012ab60 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400ebe0 tx=0x7f8c6400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.704+0000 7f8c76350700 1 -- 172.21.15.72:0/2805892281 shutdown_connections 2023-10-03T10:16:33.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.704+0000 7f8c76350700 1 --2- 172.21.15.72:0/2805892281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c7009d6f0 0x7f8c7012ab60 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.704+0000 7f8c76350700 1 --2- 172.21.15.72:0/2805892281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c70130750 0x7f8c7012b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.704+0000 7f8c76350700 1 --2- 172.21.15.72:0/2805892281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c7009e080 0x7f8c7012b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.704+0000 7f8c76350700 1 -- 172.21.15.72:0/2805892281 >> 172.21.15.72:0/2805892281 conn(0x7f8c7009f470 msgr2=0x7f8c700717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.704+0000 7f8c76350700 1 -- 172.21.15.72:0/2805892281 shutdown_connections 2023-10-03T10:16:33.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.704+0000 7f8c76350700 1 -- 172.21.15.72:0/2805892281 wait complete. 2023-10-03T10:16:33.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:33.749 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:33.856 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:33.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:33.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.871+0000 7fc6e7ff6700 1 Processor -- start 2023-10-03T10:16:33.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.871+0000 7fc6e7ff6700 1 -- start start 2023-10-03T10:16:33.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.872+0000 7fc6e7ff6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6e006a770 0x7fc6e006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.872+0000 7fc6e7ff6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6e0131d10 0x7fc6e0139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.872+0000 7fc6e7ff6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e009ece0 con 0x7fc6e006b080 2023-10-03T10:16:33.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.872+0000 7fc6e7ff6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e009e760 con 0x7fc6e0131d10 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.872+0000 7fc6e7ff6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e009e040 con 0x7fc6e006a770 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.872+0000 7fc6e6593700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6e0131d10 0x7fc6e0139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.872+0000 7fc6e6593700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6e0131d10 0x7fc6e0139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60210/0 (socket says 172.21.15.72:60210) 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.872+0000 7fc6e5d92700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6e006a770 0x7fc6e006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.872+0000 7fc6e6593700 1 -- 172.21.15.72:0/2430478317 learned_addr learned my addr 172.21.15.72:0/2430478317 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.872+0000 7fc6e6593700 1 -- 172.21.15.72:0/2430478317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6e006a770 msgr2=0x7fc6e006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.872+0000 7fc6e6593700 1 --2- 172.21.15.72:0/2430478317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6e006a770 0x7fc6e006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.872+0000 7fc6e6593700 1 -- 172.21.15.72:0/2430478317 >> v1:172.21.15.72:6789/0 conn(0x7fc6e006b080 legacy=0x7fc6e0131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.872+0000 7fc6e4d90700 1 -- 172.21.15.72:0/2430478317 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887715294 0 0) 0x7fc6e009ece0 con 0x7fc6e006b080 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.872+0000 7fc6e6593700 1 -- 172.21.15.72:0/2430478317 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e009f630 con 0x7fc6e0131d10 2023-10-03T10:16:33.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.872+0000 7fc6e5d92700 1 --2- 172.21.15.72:0/2430478317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6e006a770 0x7fc6e006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.873+0000 7fc6e6593700 1 --2- 172.21.15.72:0/2430478317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e0131d10 0x7fc6e0139860 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009e50 tx=0x7fc6d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e81211985455777 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.873+0000 7fc6e4d90700 1 -- 172.21.15.72:0/2430478317 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d800e070 con 0x7fc6e0131d10 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.873+0000 7fc6e4d90700 1 -- 172.21.15.72:0/2430478317 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d800b910 con 0x7fc6e0131d10 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.873+0000 7fc6e4d90700 1 -- 172.21.15.72:0/2430478317 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d800bcc0 con 0x7fc6e0131d10 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.873+0000 7fc6e7ff6700 1 -- 172.21.15.72:0/2430478317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e0131d10 msgr2=0x7fc6e0139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.873+0000 7fc6e7ff6700 1 --2- 172.21.15.72:0/2430478317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e0131d10 0x7fc6e0139860 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009e50 tx=0x7fc6d800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.873+0000 7fc6e7ff6700 1 -- 172.21.15.72:0/2430478317 shutdown_connections 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.873+0000 7fc6e7ff6700 1 --2- 172.21.15.72:0/2430478317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e0131d10 0x7fc6e0139860 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.873+0000 7fc6e7ff6700 1 --2- 172.21.15.72:0/2430478317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6e006a770 0x7fc6e006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.873+0000 7fc6e7ff6700 1 -- 172.21.15.72:0/2430478317 >> 172.21.15.72:0/2430478317 conn(0x7fc6e0066f50 msgr2=0x7fc6e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.874+0000 7fc6e7ff6700 1 -- 172.21.15.72:0/2430478317 shutdown_connections 2023-10-03T10:16:33.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.874+0000 7fc6e7ff6700 1 -- 172.21.15.72:0/2430478317 wait complete. 2023-10-03T10:16:33.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.875+0000 7fc6e7ff6700 1 Processor -- start 2023-10-03T10:16:33.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.875+0000 7fc6e7ff6700 1 -- start start 2023-10-03T10:16:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.875+0000 7fc6e7ff6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6e006a770 0x7fc6e009ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.875+0000 7fc6e7ff6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e006b080 0x7fc6e009b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.875+0000 7fc6e7ff6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6e0131d10 0x7fc6e01c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.875+0000 7fc6e7ff6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0126380 con 0x7fc6e006b080 2023-10-03T10:16:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.875+0000 7fc6e7ff6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e009a8e0 con 0x7fc6e006a770 2023-10-03T10:16:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.875+0000 7fc6e7ff6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e006edb0 con 0x7fc6e0131d10 2023-10-03T10:16:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.875+0000 7fc6e5d92700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6e006a770 0x7fc6e009ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.875+0000 7fc6e5d92700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6e006a770 0x7fc6e009ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:57110/0 (socket says 172.21.15.72:57110) 2023-10-03T10:16:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.875+0000 7fc6e5d92700 1 -- 172.21.15.72:0/3254704422 learned_addr learned my addr 172.21.15.72:0/3254704422 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.875+0000 7fc6e5591700 1 --2- 172.21.15.72:0/3254704422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e006b080 0x7fc6e009b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.875+0000 7fc6e6593700 1 --2- 172.21.15.72:0/3254704422 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6e0131d10 0x7fc6e01c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.876+0000 7fc6e5d92700 1 -- 172.21.15.72:0/3254704422 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6e0131d10 msgr2=0x7fc6e01c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.876+0000 7fc6e5d92700 1 --2- 172.21.15.72:0/3254704422 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6e0131d10 0x7fc6e01c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.876+0000 7fc6e5d92700 1 -- 172.21.15.72:0/3254704422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e006b080 msgr2=0x7fc6e009b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.876+0000 7fc6e5d92700 1 --2- 172.21.15.72:0/3254704422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e006b080 0x7fc6e009b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.876+0000 7fc6e5d92700 1 -- 172.21.15.72:0/3254704422 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc0094a0 con 0x7fc6e006a770 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.876+0000 7fc6e6593700 1 --2- 172.21.15.72:0/3254704422 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6e0131d10 0x7fc6e01c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.876+0000 7fc6e5d92700 1 --2- 172.21.15.72:0/3254704422 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6e006a770 0x7fc6e009ad20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00ebe0 tx=0x7fc6dc00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.876+0000 7fc6d67fc700 1 -- 172.21.15.72:0/3254704422 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc00c850 con 0x7fc6e006a770 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.876+0000 7fc6d67fc700 1 -- 172.21.15.72:0/3254704422 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc00c9b0 con 0x7fc6e006a770 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.876+0000 7fc6e7ff6700 1 -- 172.21.15.72:0/3254704422 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d8009b30 con 0x7fc6e006a770 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.876+0000 7fc6d67fc700 1 -- 172.21.15.72:0/3254704422 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc00cd40 con 0x7fc6e006a770 2023-10-03T10:16:33.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.876+0000 7fc6e7ff6700 1 -- 172.21.15.72:0/3254704422 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e009c010 con 0x7fc6e006a770 2023-10-03T10:16:33.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.877+0000 7fc6e7ff6700 1 -- 172.21.15.72:0/3254704422 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e0074ea0 con 0x7fc6e006a770 2023-10-03T10:16:33.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.878+0000 7fc6d67fc700 1 -- 172.21.15.72:0/3254704422 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6dc013470 con 0x7fc6e006a770 2023-10-03T10:16:33.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.878+0000 7fc6d67fc700 1 -- 172.21.15.72:0/3254704422 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc6dc03ff90 con 0x7fc6e006a770 2023-10-03T10:16:33.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.884+0000 7fc6d67fc700 1 -- 172.21.15.72:0/3254704422 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6dc013720 con 0x7fc6e006a770 2023-10-03T10:16:33.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.985+0000 7f20dde94700 1 Processor -- start 2023-10-03T10:16:33.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.985+0000 7f20dde94700 1 -- start start 2023-10-03T10:16:33.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20dde94700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20d81316c0 0x7f20d8131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20dde94700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20d809d9f0 0x7f20d806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20dde94700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20d806acb0 0x7f20d806b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20dde94700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d809e130 con 0x7f20d81316c0 2023-10-03T10:16:33.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20dde94700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d81312b0 con 0x7f20d806acb0 2023-10-03T10:16:33.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20dde94700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20d809f6e0 con 0x7f20d809d9f0 2023-10-03T10:16:33.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20d6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20d809d9f0 0x7f20d806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20d7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20d806acb0 0x7f20d806b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20d6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20d809d9f0 0x7f20d806a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47578/0 (socket says 172.21.15.72:47578) 2023-10-03T10:16:33.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20d6ffd700 1 -- 172.21.15.72:0/2325475102 learned_addr learned my addr 172.21.15.72:0/2325475102 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:33.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20d77fe700 1 --2- 172.21.15.72:0/2325475102 >> v2:172.21.15.72:3300/0 conn(0x7f20d81316c0 0x7f20d8131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20d7fff700 1 -- 172.21.15.72:0/2325475102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20d809d9f0 msgr2=0x7f20d806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20d7fff700 1 --2- 172.21.15.72:0/2325475102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20d809d9f0 0x7f20d806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20d7fff700 1 -- 172.21.15.72:0/2325475102 >> v2:172.21.15.72:3300/0 conn(0x7f20d81316c0 msgr2=0x7f20d8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20d7fff700 1 --2- 172.21.15.72:0/2325475102 >> v2:172.21.15.72:3300/0 conn(0x7f20d81316c0 0x7f20d8131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20d7fff700 1 -- 172.21.15.72:0/2325475102 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d809e760 con 0x7f20d806acb0 2023-10-03T10:16:33.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20d7fff700 1 --2- 172.21.15.72:0/2325475102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20d806acb0 0x7f20d806b150 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009d90 tx=0x7f20d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=481c01432cc080e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20d67fc700 1 -- 172.21.15.72:0/2325475102 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d000e070 con 0x7f20d806acb0 2023-10-03T10:16:33.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20d67fc700 1 -- 172.21.15.72:0/2325475102 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d000bb20 con 0x7f20d806acb0 2023-10-03T10:16:33.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.986+0000 7f20d67fc700 1 -- 172.21.15.72:0/2325475102 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0012430 con 0x7f20d806acb0 2023-10-03T10:16:33.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.987+0000 7f20dde94700 1 -- 172.21.15.72:0/2325475102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20d806acb0 msgr2=0x7f20d806b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.987+0000 7f20dde94700 1 --2- 172.21.15.72:0/2325475102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20d806acb0 0x7f20d806b150 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009d90 tx=0x7f20d000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:33.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.987+0000 7f20dde94700 1 -- 172.21.15.72:0/2325475102 shutdown_connections 2023-10-03T10:16:33.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.987+0000 7f20dde94700 1 --2- 172.21.15.72:0/2325475102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20d806acb0 0x7f20d806b150 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.987+0000 7f20dde94700 1 --2- 172.21.15.72:0/2325475102 >> v2:172.21.15.72:3300/0 conn(0x7f20d81316c0 0x7f20d8131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.987+0000 7f20dde94700 1 --2- 172.21.15.72:0/2325475102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20d809d9f0 0x7f20d806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.987+0000 7f20dde94700 1 -- 172.21.15.72:0/2325475102 >> 172.21.15.72:0/2325475102 conn(0x7f20d8066f50 msgr2=0x7f20d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.987+0000 7f20dde94700 1 -- 172.21.15.72:0/2325475102 shutdown_connections 2023-10-03T10:16:33.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.987+0000 7f20dde94700 1 -- 172.21.15.72:0/2325475102 wait complete. 2023-10-03T10:16:33.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.988+0000 7f20dde94700 1 Processor -- start 2023-10-03T10:16:33.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.988+0000 7f20dde94700 1 -- start start 2023-10-03T10:16:33.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20dde94700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20d806acb0 0x7f20d80707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20dde94700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20d809d9f0 0x7f20d8070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20dde94700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d81316c0 0x7f20d8071240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20dde94700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d811a670 con 0x7f20d81316c0 2023-10-03T10:16:33.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20dde94700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d811ac10 con 0x7f20d809d9f0 2023-10-03T10:16:33.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20dde94700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20d812b900 con 0x7f20d806acb0 2023-10-03T10:16:33.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20d6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20d809d9f0 0x7f20d8070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20d77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20d806acb0 0x7f20d80707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20d6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20d809d9f0 0x7f20d8070d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:57128/0 (socket says 172.21.15.72:57128) 2023-10-03T10:16:33.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20d6ffd700 1 -- 172.21.15.72:0/3804941334 learned_addr learned my addr 172.21.15.72:0/3804941334 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:33.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20d77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20d806acb0 0x7f20d80707c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47584/0 (socket says 172.21.15.72:47584) 2023-10-03T10:16:33.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20d7fff700 1 --2- 172.21.15.72:0/3804941334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d81316c0 0x7f20d8071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20d7fff700 1 -- 172.21.15.72:0/3804941334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20d806acb0 msgr2=0x7f20d80707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20d7fff700 1 --2- 172.21.15.72:0/3804941334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20d806acb0 0x7f20d80707c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20d7fff700 1 -- 172.21.15.72:0/3804941334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20d809d9f0 msgr2=0x7f20d8070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20d7fff700 1 --2- 172.21.15.72:0/3804941334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20d809d9f0 0x7f20d8070d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20d7fff700 1 -- 172.21.15.72:0/3804941334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d0009a70 con 0x7f20d81316c0 2023-10-03T10:16:33.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20d77fe700 1 --2- 172.21.15.72:0/3804941334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20d806acb0 0x7f20d80707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20d7fff700 1 --2- 172.21.15.72:0/3804941334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d81316c0 0x7f20d8071240 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f20d0016000 tx=0x7f20d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.989+0000 7f20bffff700 1 -- 172.21.15.72:0/3804941334 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0004800 con 0x7f20d81316c0 2023-10-03T10:16:33.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.990+0000 7f20bffff700 1 -- 172.21.15.72:0/3804941334 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d0020070 con 0x7f20d81316c0 2023-10-03T10:16:33.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.990+0000 7f20dde94700 1 -- 172.21.15.72:0/3804941334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d80a35b0 con 0x7f20d81316c0 2023-10-03T10:16:33.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.990+0000 7f20bffff700 1 -- 172.21.15.72:0/3804941334 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d00276c0 con 0x7f20d81316c0 2023-10-03T10:16:33.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.990+0000 7f20dde94700 1 -- 172.21.15.72:0/3804941334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d811b3a0 con 0x7f20d81316c0 2023-10-03T10:16:33.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.990+0000 7f20bffff700 1 -- 172.21.15.72:0/3804941334 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20d0012430 con 0x7f20d81316c0 2023-10-03T10:16:33.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.991+0000 7f20bffff700 1 -- 172.21.15.72:0/3804941334 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f20d0022070 con 0x7f20d81316c0 2023-10-03T10:16:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.992+0000 7f20dde94700 1 -- 172.21.15.72:0/3804941334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d8128040 con 0x7f20d81316c0 2023-10-03T10:16:33.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.996+0000 7f20bffff700 1 -- 172.21.15.72:0/3804941334 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20d001c400 con 0x7f20d81316c0 2023-10-03T10:16:33.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.998+0000 7f4b2e934700 1 Processor -- start 2023-10-03T10:16:33.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.998+0000 7f4b2e934700 1 -- start start 2023-10-03T10:16:33.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.998+0000 7f4b2e934700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b2809d6f0 0x7f4b2809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.998+0000 7f4b2e934700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b2809e000 0x7f4b281339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.998+0000 7f4b2e934700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b2809e410 0x7f4b28133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.998+0000 7f4b2e934700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2806b460 con 0x7f4b2809e000 2023-10-03T10:16:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.998+0000 7f4b2e934700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2809b120 con 0x7f4b2809e410 2023-10-03T10:16:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.998+0000 7f4b2e934700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2809a7e0 con 0x7f4b2809d6f0 2023-10-03T10:16:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.998+0000 7f4b27fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b2809d6f0 0x7f4b2809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.998+0000 7f4b2ced1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b2809e410 0x7f4b28133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.998+0000 7f4b27fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b2809d6f0 0x7f4b2809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47588/0 (socket says 172.21.15.72:47588) 2023-10-03T10:16:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.998+0000 7f4b27fff700 1 -- 172.21.15.72:0/4152629767 learned_addr learned my addr 172.21.15.72:0/4152629767 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.998+0000 7f4b277fe700 1 --2- 172.21.15.72:0/4152629767 >> v2:172.21.15.72:3300/0 conn(0x7f4b2809e000 0x7f4b281339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.999+0000 7f4b2ced1700 1 -- 172.21.15.72:0/4152629767 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b2809d6f0 msgr2=0x7f4b2809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.999+0000 7f4b2ced1700 1 --2- 172.21.15.72:0/4152629767 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b2809d6f0 0x7f4b2809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.999+0000 7f4b2ced1700 1 -- 172.21.15.72:0/4152629767 >> v2:172.21.15.72:3300/0 conn(0x7f4b2809e000 msgr2=0x7f4b281339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.999+0000 7f4b2ced1700 1 --2- 172.21.15.72:0/4152629767 >> v2:172.21.15.72:3300/0 conn(0x7f4b2809e000 0x7f4b281339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.999+0000 7f4b2ced1700 1 -- 172.21.15.72:0/4152629767 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2809a500 con 0x7f4b2809e410 2023-10-03T10:16:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.999+0000 7f4b2ced1700 1 --2- 172.21.15.72:0/4152629767 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b2809e410 0x7f4b28133f30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009dc0 tx=0x7f4b2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad31913fedaa7b58 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.999+0000 7f4b26ffd700 1 -- 172.21.15.72:0/4152629767 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2000e070 con 0x7f4b2809e410 2023-10-03T10:16:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.999+0000 7f4b26ffd700 1 -- 172.21.15.72:0/4152629767 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2000bae0 con 0x7f4b2809e410 2023-10-03T10:16:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:33.999+0000 7f4b26ffd700 1 -- 172.21.15.72:0/4152629767 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2000be90 con 0x7f4b2809e410 2023-10-03T10:16:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.000+0000 7f4b2e934700 1 -- 172.21.15.72:0/4152629767 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b2809e410 msgr2=0x7f4b28133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.000+0000 7f4b2e934700 1 --2- 172.21.15.72:0/4152629767 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b2809e410 0x7f4b28133f30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009dc0 tx=0x7f4b2000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.000+0000 7f4b2e934700 1 -- 172.21.15.72:0/4152629767 shutdown_connections 2023-10-03T10:16:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.000+0000 7f4b2e934700 1 --2- 172.21.15.72:0/4152629767 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b2809e410 0x7f4b28133f30 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.000+0000 7f4b2e934700 1 --2- 172.21.15.72:0/4152629767 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b2809d6f0 0x7f4b2809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.000+0000 7f4b2e934700 1 --2- 172.21.15.72:0/4152629767 >> v2:172.21.15.72:3300/0 conn(0x7f4b2809e000 0x7f4b281339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.000+0000 7f4b2e934700 1 -- 172.21.15.72:0/4152629767 >> 172.21.15.72:0/4152629767 conn(0x7f4b28066f50 msgr2=0x7f4b2809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.000+0000 7f4b2e934700 1 -- 172.21.15.72:0/4152629767 shutdown_connections 2023-10-03T10:16:34.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.000+0000 7f4b2e934700 1 -- 172.21.15.72:0/4152629767 wait complete. 2023-10-03T10:16:34.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.001+0000 7f4b2e934700 1 Processor -- start 2023-10-03T10:16:34.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.001+0000 7f4b2e934700 1 -- start start 2023-10-03T10:16:34.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b2e934700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b2809d6f0 0x7f4b281c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b2e934700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2809e000 0x7f4b281c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b2e934700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b2809e410 0x7f4b281c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b2e934700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b281aa9c0 con 0x7f4b2809e000 2023-10-03T10:16:34.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b2e934700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b280a1f00 con 0x7f4b2809d6f0 2023-10-03T10:16:34.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b2e934700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2809c710 con 0x7f4b2809e410 2023-10-03T10:16:34.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b277fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2809e000 0x7f4b281c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b27fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b2809d6f0 0x7f4b281c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b27fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b2809d6f0 0x7f4b281c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:57146/0 (socket says 172.21.15.72:57146) 2023-10-03T10:16:34.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b277fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2809e000 0x7f4b281c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60248/0 (socket says 172.21.15.72:60248) 2023-10-03T10:16:34.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b27fff700 1 -- 172.21.15.72:0/4227582259 learned_addr learned my addr 172.21.15.72:0/4227582259 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:34.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b2ced1700 1 --2- 172.21.15.72:0/4227582259 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b2809e410 0x7f4b281c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b27fff700 1 -- 172.21.15.72:0/4227582259 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b2809e410 msgr2=0x7f4b281c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b27fff700 1 --2- 172.21.15.72:0/4227582259 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b2809e410 0x7f4b281c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b27fff700 1 -- 172.21.15.72:0/4227582259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2809e000 msgr2=0x7f4b281c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b27fff700 1 --2- 172.21.15.72:0/4227582259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2809e000 0x7f4b281c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b27fff700 1 -- 172.21.15.72:0/4227582259 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b20009a70 con 0x7f4b2809d6f0 2023-10-03T10:16:34.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.002+0000 7f4b2ced1700 1 --2- 172.21.15.72:0/4227582259 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b2809e410 0x7f4b281c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.003+0000 7f4b27fff700 1 --2- 172.21.15.72:0/4227582259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b2809d6f0 0x7f4b281c86c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800e910 tx=0x7f4b1800ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.003+0000 7f4b24ff9700 1 -- 172.21.15.72:0/4227582259 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b180096a0 con 0x7f4b2809d6f0 2023-10-03T10:16:34.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.003+0000 7f4b24ff9700 1 -- 172.21.15.72:0/4227582259 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b18013680 con 0x7f4b2809d6f0 2023-10-03T10:16:34.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.003+0000 7f4b2e934700 1 -- 172.21.15.72:0/4227582259 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b281a9ba0 con 0x7f4b2809d6f0 2023-10-03T10:16:34.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.003+0000 7f4b24ff9700 1 -- 172.21.15.72:0/4227582259 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18013a30 con 0x7f4b2809d6f0 2023-10-03T10:16:34.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.003+0000 7f4b2e934700 1 -- 172.21.15.72:0/4227582259 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b281ac170 con 0x7f4b2809d6f0 2023-10-03T10:16:34.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.004+0000 7f4b24ff9700 1 -- 172.21.15.72:0/4227582259 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b18013b90 con 0x7f4b2809d6f0 2023-10-03T10:16:34.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.004+0000 7f4b24ff9700 1 -- 172.21.15.72:0/4227582259 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b1803f610 con 0x7f4b2809d6f0 2023-10-03T10:16:34.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.004+0000 7f4b2e934700 1 -- 172.21.15.72:0/4227582259 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b280729a0 con 0x7f4b2809d6f0 2023-10-03T10:16:34.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.009+0000 7f4b24ff9700 1 -- 172.21.15.72:0/4227582259 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b1801bc30 con 0x7f4b2809d6f0 2023-10-03T10:16:34.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.082+0000 7fc6e7ff6700 1 -- 172.21.15.72:0/3254704422 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc6e0126130 con 0x7fc6e006a770 2023-10-03T10:16:34.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.082+0000 7fc6d67fc700 1 -- 172.21.15.72:0/3254704422 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6dc021070 con 0x7fc6e006a770 2023-10-03T10:16:34.082 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.085+0000 7fc6e7ff6700 1 -- 172.21.15.72:0/3254704422 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6e006a770 msgr2=0x7fc6e009ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.085+0000 7fc6e7ff6700 1 --2- 172.21.15.72:0/3254704422 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6e006a770 0x7fc6e009ad20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00ebe0 tx=0x7fc6dc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.085+0000 7fc6e7ff6700 1 -- 172.21.15.72:0/3254704422 shutdown_connections 2023-10-03T10:16:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.085+0000 7fc6e7ff6700 1 --2- 172.21.15.72:0/3254704422 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6e0131d10 0x7fc6e01c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.085+0000 7fc6e7ff6700 1 --2- 172.21.15.72:0/3254704422 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6e006a770 0x7fc6e009ad20 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.085+0000 7fc6e7ff6700 1 --2- 172.21.15.72:0/3254704422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6e006b080 0x7fc6e009b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.085+0000 7fc6e7ff6700 1 -- 172.21.15.72:0/3254704422 >> 172.21.15.72:0/3254704422 conn(0x7fc6e0066f50 msgr2=0x7fc6e00700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.086+0000 7fc6e7ff6700 1 -- 172.21.15.72:0/3254704422 shutdown_connections 2023-10-03T10:16:34.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.086+0000 7fc6e7ff6700 1 -- 172.21.15.72:0/3254704422 wait complete. 2023-10-03T10:16:34.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:34.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.191+0000 7f20dde94700 1 -- 172.21.15.72:0/3804941334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f20d8074ea0 con 0x7f20d81316c0 2023-10-03T10:16:34.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.191+0000 7f20bffff700 1 -- 172.21.15.72:0/3804941334 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f20d001a380 con 0x7f20d81316c0 2023-10-03T10:16:34.191 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:34.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.193+0000 7f20dde94700 1 -- 172.21.15.72:0/3804941334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d81316c0 msgr2=0x7f20d8071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.193+0000 7f20dde94700 1 --2- 172.21.15.72:0/3804941334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d81316c0 0x7f20d8071240 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f20d0016000 tx=0x7f20d0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.193+0000 7f20dde94700 1 -- 172.21.15.72:0/3804941334 shutdown_connections 2023-10-03T10:16:34.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.193+0000 7f20dde94700 1 --2- 172.21.15.72:0/3804941334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20d81316c0 0x7f20d8071240 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.193+0000 7f20dde94700 1 --2- 172.21.15.72:0/3804941334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f20d806acb0 0x7f20d80707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.193+0000 7f20dde94700 1 --2- 172.21.15.72:0/3804941334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20d809d9f0 0x7f20d8070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.193+0000 7f20dde94700 1 -- 172.21.15.72:0/3804941334 >> 172.21.15.72:0/3804941334 conn(0x7f20d8066f50 msgr2=0x7f20d80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.193+0000 7f20dde94700 1 -- 172.21.15.72:0/3804941334 shutdown_connections 2023-10-03T10:16:34.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.193+0000 7f20dde94700 1 -- 172.21.15.72:0/3804941334 wait complete. 2023-10-03T10:16:34.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.199+0000 7f4b2e934700 1 -- 172.21.15.72:0/4227582259 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b281aa260 con 0x7f4b2809d6f0 2023-10-03T10:16:34.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.199+0000 7f4b24ff9700 1 -- 172.21.15.72:0/4227582259 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4b281aa260 con 0x7f4b2809d6f0 2023-10-03T10:16:34.199 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:34.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.201+0000 7f4b2e934700 1 -- 172.21.15.72:0/4227582259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b2809d6f0 msgr2=0x7f4b281c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.201+0000 7f4b2e934700 1 --2- 172.21.15.72:0/4227582259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b2809d6f0 0x7f4b281c86c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800e910 tx=0x7f4b1800ec20 comp rx=0 tx=0).stop 2023-10-03T10:16:34.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.201+0000 7f4b2e934700 1 -- 172.21.15.72:0/4227582259 shutdown_connections 2023-10-03T10:16:34.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.201+0000 7f4b2e934700 1 --2- 172.21.15.72:0/4227582259 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b2809e410 0x7f4b281c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.201+0000 7f4b2e934700 1 --2- 172.21.15.72:0/4227582259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b2809d6f0 0x7f4b281c86c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.201+0000 7f4b2e934700 1 --2- 172.21.15.72:0/4227582259 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2809e000 0x7f4b281c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.201+0000 7f4b2e934700 1 -- 172.21.15.72:0/4227582259 >> 172.21.15.72:0/4227582259 conn(0x7f4b28066f50 msgr2=0x7f4b280707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.201+0000 7f4b2e934700 1 -- 172.21.15.72:0/4227582259 shutdown_connections 2023-10-03T10:16:34.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.201+0000 7f4b2e934700 1 -- 172.21.15.72:0/4227582259 wait complete. 2023-10-03T10:16:34.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:34.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:34.717 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.840+0000 7f7698f9e700 1 Processor -- start 2023-10-03T10:16:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.840+0000 7f7698f9e700 1 -- start start 2023-10-03T10:16:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f7698f9e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f769409e930 0x7f769409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f7698f9e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f769409f240 0x7f76941317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f7698f9e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f769409f650 0x7f7694131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f7698f9e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7694070940 con 0x7f769409f650 2023-10-03T10:16:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f7698f9e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769406fd60 con 0x7f769409e930 2023-10-03T10:16:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f7698f9e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f769406fa80 con 0x7f769409f240 2023-10-03T10:16:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f769259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f769409e930 0x7f769409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f7691d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f769409f240 0x7f76941317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f7692d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f769409f650 0x7f7694131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f769259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f769409e930 0x7f769409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:57152/0 (socket says 172.21.15.72:57152) 2023-10-03T10:16:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f7692d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f769409f650 0x7f7694131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60256/0 (socket says 172.21.15.72:60256) 2023-10-03T10:16:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f7691d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f769409f240 0x7f76941317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47602/0 (socket says 172.21.15.72:47602) 2023-10-03T10:16:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f769259c700 1 -- 172.21.15.72:0/3014759202 learned_addr learned my addr 172.21.15.72:0/3014759202 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f769259c700 1 -- 172.21.15.72:0/3014759202 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f769409f240 msgr2=0x7f76941317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f769259c700 1 --2- 172.21.15.72:0/3014759202 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f769409f240 0x7f76941317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f769259c700 1 -- 172.21.15.72:0/3014759202 >> v2:172.21.15.72:3300/0 conn(0x7f769409f650 msgr2=0x7f7694131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f769259c700 1 --2- 172.21.15.72:0/3014759202 >> v2:172.21.15.72:3300/0 conn(0x7f769409f650 0x7f7694131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f769259c700 1 -- 172.21.15.72:0/3014759202 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769409fb60 con 0x7f769409e930 2023-10-03T10:16:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f7691d9b700 1 --2- 172.21.15.72:0/3014759202 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f769409f240 0x7f76941317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.841+0000 7f7692d9d700 1 --2- 172.21.15.72:0/3014759202 >> v2:172.21.15.72:3300/0 conn(0x7f769409f650 0x7f7694131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.842+0000 7f769259c700 1 --2- 172.21.15.72:0/3014759202 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f769409e930 0x7f769409ed00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f76840098f0 tx=0x7f7684009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=768abe98c3a52511 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.842+0000 7f769159a700 1 -- 172.21.15.72:0/3014759202 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684011830 con 0x7f769409e930 2023-10-03T10:16:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.842+0000 7f769159a700 1 -- 172.21.15.72:0/3014759202 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7684011990 con 0x7f769409e930 2023-10-03T10:16:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.842+0000 7f769159a700 1 -- 172.21.15.72:0/3014759202 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684011d20 con 0x7f769409e930 2023-10-03T10:16:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.842+0000 7f7698f9e700 1 -- 172.21.15.72:0/3014759202 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f769409e930 msgr2=0x7f769409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.842+0000 7f7698f9e700 1 --2- 172.21.15.72:0/3014759202 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f769409e930 0x7f769409ed00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f76840098f0 tx=0x7f7684009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.842+0000 7f7698f9e700 1 -- 172.21.15.72:0/3014759202 shutdown_connections 2023-10-03T10:16:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.842+0000 7f7698f9e700 1 --2- 172.21.15.72:0/3014759202 >> v2:172.21.15.72:3300/0 conn(0x7f769409f650 0x7f7694131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.842+0000 7f7698f9e700 1 --2- 172.21.15.72:0/3014759202 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f769409e930 0x7f769409ed00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.842+0000 7f7698f9e700 1 --2- 172.21.15.72:0/3014759202 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f769409f240 0x7f76941317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.842+0000 7f7698f9e700 1 -- 172.21.15.72:0/3014759202 >> 172.21.15.72:0/3014759202 conn(0x7f76940a4210 msgr2=0x7f76940a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.842+0000 7f7698f9e700 1 -- 172.21.15.72:0/3014759202 shutdown_connections 2023-10-03T10:16:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.842+0000 7f7698f9e700 1 -- 172.21.15.72:0/3014759202 wait complete. 2023-10-03T10:16:34.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.843+0000 7f7698f9e700 1 Processor -- start 2023-10-03T10:16:34.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7698f9e700 1 -- start start 2023-10-03T10:16:34.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7698f9e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f769409e930 0x7f769406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7698f9e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f769409f240 0x7f769406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7698f9e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f769409f650 0x7f769406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:34.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7698f9e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76941a89e0 con 0x7f769409e930 2023-10-03T10:16:34.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7698f9e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76941a8170 con 0x7f769409f650 2023-10-03T10:16:34.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7698f9e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76941b6290 con 0x7f769409f240 2023-10-03T10:16:34.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7691d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f769409f240 0x7f769406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7691d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f769409f240 0x7f769406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47618/0 (socket says 172.21.15.72:47618) 2023-10-03T10:16:34.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7691d9b700 1 -- 172.21.15.72:0/2411213287 learned_addr learned my addr 172.21.15.72:0/2411213287 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:34.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f769259c700 1 --2- 172.21.15.72:0/2411213287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f769409e930 0x7f769406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7692d9d700 1 --2- 172.21.15.72:0/2411213287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f769409f650 0x7f769406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7691d9b700 1 -- 172.21.15.72:0/2411213287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f769409f650 msgr2=0x7f769406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7691d9b700 1 --2- 172.21.15.72:0/2411213287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f769409f650 0x7f769406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7691d9b700 1 -- 172.21.15.72:0/2411213287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f769409e930 msgr2=0x7f769406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7691d9b700 1 --2- 172.21.15.72:0/2411213287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f769409e930 0x7f769406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7691d9b700 1 -- 172.21.15.72:0/2411213287 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c0094a0 con 0x7f769409f240 2023-10-03T10:16:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f769259c700 1 --2- 172.21.15.72:0/2411213287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f769409e930 0x7f769406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.844+0000 7f7692d9d700 1 --2- 172.21.15.72:0/2411213287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f769409f650 0x7f769406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.845+0000 7f7691d9b700 1 --2- 172.21.15.72:0/2411213287 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f769409f240 0x7f769406bdf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f767c00ebb0 tx=0x7f767c00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.845+0000 7f768affd700 1 -- 172.21.15.72:0/2411213287 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c00c850 con 0x7f769409f240 2023-10-03T10:16:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.845+0000 7f768affd700 1 -- 172.21.15.72:0/2411213287 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c00c9b0 con 0x7f769409f240 2023-10-03T10:16:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.845+0000 7f768affd700 1 -- 172.21.15.72:0/2411213287 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c00cd40 con 0x7f769409f240 2023-10-03T10:16:34.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.845+0000 7f7698f9e700 1 -- 172.21.15.72:0/2411213287 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768c009a70 con 0x7f769409f240 2023-10-03T10:16:34.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.845+0000 7f7698f9e700 1 -- 172.21.15.72:0/2411213287 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7684009550 con 0x7f769409f240 2023-10-03T10:16:34.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.846+0000 7f768affd700 1 -- 172.21.15.72:0/2411213287 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f767c013470 con 0x7f769409f240 2023-10-03T10:16:34.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.846+0000 7f768affd700 1 -- 172.21.15.72:0/2411213287 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f767c03faa0 con 0x7f769409f240 2023-10-03T10:16:34.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.846+0000 7f7698f9e700 1 -- 172.21.15.72:0/2411213287 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76940a3580 con 0x7f769409f240 2023-10-03T10:16:34.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:34.850+0000 7f768affd700 1 -- 172.21.15.72:0/2411213287 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f767c01b3b0 con 0x7f769409f240 2023-10-03T10:16:35.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.038+0000 7f7698f9e700 1 -- 172.21.15.72:0/2411213287 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7694071d20 con 0x7f769409f240 2023-10-03T10:16:35.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.038+0000 7f768affd700 1 -- 172.21.15.72:0/2411213287 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f767c017020 con 0x7f769409f240 2023-10-03T10:16:35.038 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:35.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.040+0000 7f7698f9e700 1 -- 172.21.15.72:0/2411213287 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f769409f240 msgr2=0x7f769406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.040+0000 7f7698f9e700 1 --2- 172.21.15.72:0/2411213287 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f769409f240 0x7f769406bdf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f767c00ebb0 tx=0x7f767c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.040+0000 7f7698f9e700 1 -- 172.21.15.72:0/2411213287 shutdown_connections 2023-10-03T10:16:35.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.040+0000 7f7698f9e700 1 --2- 172.21.15.72:0/2411213287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f769409e930 0x7f769406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.040+0000 7f7698f9e700 1 --2- 172.21.15.72:0/2411213287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f769409f650 0x7f769406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.040+0000 7f7698f9e700 1 --2- 172.21.15.72:0/2411213287 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f769409f240 0x7f769406bdf0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.041+0000 7f7698f9e700 1 -- 172.21.15.72:0/2411213287 >> 172.21.15.72:0/2411213287 conn(0x7f76940a4210 msgr2=0x7f769409c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.041+0000 7f7698f9e700 1 -- 172.21.15.72:0/2411213287 shutdown_connections 2023-10-03T10:16:35.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.041+0000 7f7698f9e700 1 -- 172.21.15.72:0/2411213287 wait complete. 2023-10-03T10:16:35.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:35.098 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:35.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:35.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:35.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.219+0000 7f2e57592700 1 Processor -- start 2023-10-03T10:16:35.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.220+0000 7f2e57592700 1 -- start start 2023-10-03T10:16:35.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.220+0000 7f2e57592700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e5012cc20 0x7f2e5012f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.220+0000 7f2e57592700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e5012cff0 0x7f2e50137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.220+0000 7f2e57592700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5009a510 con 0x7f2e5012c2f0 2023-10-03T10:16:35.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.220+0000 7f2e57592700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5012c7d0 con 0x7f2e5012cff0 2023-10-03T10:16:35.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.220+0000 7f2e57592700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5009c190 con 0x7f2e5012cc20 2023-10-03T10:16:35.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.220+0000 7f2e55b2f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e5012cff0 0x7f2e50137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.220+0000 7f2e5532e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e5012cc20 0x7f2e5012f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.220+0000 7f2e55b2f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2e5012cff0 0x7f2e50137cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60268/0 (socket says 172.21.15.72:60268) 2023-10-03T10:16:35.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.220+0000 7f2e55b2f700 1 -- 172.21.15.72:0/4086029465 learned_addr learned my addr 172.21.15.72:0/4086029465 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:35.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.220+0000 7f2e5532e700 1 --2- 172.21.15.72:0/4086029465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e5012cc20 0x7f2e5012f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47620/0 (socket says 172.21.15.72:47620) 2023-10-03T10:16:35.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.221+0000 7f2e5532e700 1 -- 172.21.15.72:0/4086029465 >> v2:172.21.15.72:3300/0 conn(0x7f2e5012cff0 msgr2=0x7f2e50137cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.221+0000 7f2e5532e700 1 --2- 172.21.15.72:0/4086029465 >> v2:172.21.15.72:3300/0 conn(0x7f2e5012cff0 0x7f2e50137cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.221+0000 7f2e5532e700 1 -- 172.21.15.72:0/4086029465 >> v1:172.21.15.72:6789/0 conn(0x7f2e5012c2f0 legacy=0x7f2e5012fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.221+0000 7f2e5532e700 1 -- 172.21.15.72:0/4086029465 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5009b540 con 0x7f2e5012cc20 2023-10-03T10:16:35.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.221+0000 7f2e55b2f700 1 --2- 172.21.15.72:0/4086029465 >> v2:172.21.15.72:3300/0 conn(0x7f2e5012cff0 0x7f2e50137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.221+0000 7f2e5532e700 1 --2- 172.21.15.72:0/4086029465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e5012cc20 0x7f2e5012f930 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009840 tx=0x7f2e40009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b77337d1fce16211 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.221+0000 7f2e47fff700 1 -- 172.21.15.72:0/4086029465 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40011830 con 0x7f2e5012cc20 2023-10-03T10:16:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.221+0000 7f2e47fff700 1 -- 172.21.15.72:0/4086029465 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e40011990 con 0x7f2e5012cc20 2023-10-03T10:16:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.221+0000 7f2e47fff700 1 -- 172.21.15.72:0/4086029465 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40011d20 con 0x7f2e5012cc20 2023-10-03T10:16:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.222+0000 7f2e57592700 1 -- 172.21.15.72:0/4086029465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e5012cc20 msgr2=0x7f2e5012f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.222+0000 7f2e57592700 1 --2- 172.21.15.72:0/4086029465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e5012cc20 0x7f2e5012f930 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009840 tx=0x7f2e40009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.222+0000 7f2e57592700 1 -- 172.21.15.72:0/4086029465 shutdown_connections 2023-10-03T10:16:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.222+0000 7f2e57592700 1 --2- 172.21.15.72:0/4086029465 >> v2:172.21.15.72:3300/0 conn(0x7f2e5012cff0 0x7f2e50137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.222+0000 7f2e57592700 1 --2- 172.21.15.72:0/4086029465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e5012cc20 0x7f2e5012f930 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.222+0000 7f2e57592700 1 -- 172.21.15.72:0/4086029465 >> 172.21.15.72:0/4086029465 conn(0x7f2e5009f470 msgr2=0x7f2e500a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.222+0000 7f2e57592700 1 -- 172.21.15.72:0/4086029465 shutdown_connections 2023-10-03T10:16:35.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.222+0000 7f2e57592700 1 -- 172.21.15.72:0/4086029465 wait complete. 2023-10-03T10:16:35.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.223+0000 7f2e57592700 1 Processor -- start 2023-10-03T10:16:35.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.223+0000 7f2e57592700 1 -- start start 2023-10-03T10:16:35.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.223+0000 7f2e57592700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e5012c2f0 0x7f2e5006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.223+0000 7f2e57592700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e5012cc20 0x7f2e5006f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.223+0000 7f2e57592700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e5012cff0 0x7f2e5006fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.223+0000 7f2e57592700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5008bc70 con 0x7f2e5012cff0 2023-10-03T10:16:35.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.223+0000 7f2e57592700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e50098ea0 con 0x7f2e5012cc20 2023-10-03T10:16:35.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.223+0000 7f2e57592700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e500724c0 con 0x7f2e5012c2f0 2023-10-03T10:16:35.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.224+0000 7f2e5532e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e5012c2f0 0x7f2e5006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.224+0000 7f2e5532e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e5012c2f0 0x7f2e5006f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47636/0 (socket says 172.21.15.72:47636) 2023-10-03T10:16:35.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.224+0000 7f2e5532e700 1 -- 172.21.15.72:0/2288453959 learned_addr learned my addr 172.21.15.72:0/2288453959 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:35.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.224+0000 7f2e54b2d700 1 --2- 172.21.15.72:0/2288453959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e5012cc20 0x7f2e5006f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.224+0000 7f2e55b2f700 1 --2- 172.21.15.72:0/2288453959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e5012cff0 0x7f2e5006fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.224+0000 7f2e54b2d700 1 -- 172.21.15.72:0/2288453959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e5012c2f0 msgr2=0x7f2e5006f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.224+0000 7f2e54b2d700 1 --2- 172.21.15.72:0/2288453959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e5012c2f0 0x7f2e5006f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.224+0000 7f2e54b2d700 1 -- 172.21.15.72:0/2288453959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e5012cff0 msgr2=0x7f2e5006fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.224+0000 7f2e54b2d700 1 --2- 172.21.15.72:0/2288453959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e5012cff0 0x7f2e5006fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.224+0000 7f2e54b2d700 1 -- 172.21.15.72:0/2288453959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4800f050 con 0x7f2e5012cc20 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.224+0000 7f2e54b2d700 1 --2- 172.21.15.72:0/2288453959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e5012cc20 0x7f2e5006f890 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c000f60 tx=0x7f2e4c00c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.224+0000 7f2e45ffb700 1 -- 172.21.15.72:0/2288453959 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0050d0 con 0x7f2e5012cc20 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.224+0000 7f2e45ffb700 1 -- 172.21.15.72:0/2288453959 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c005230 con 0x7f2e5012cc20 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.224+0000 7f2e57592700 1 -- 172.21.15.72:0/2288453959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e400094a0 con 0x7f2e5012cc20 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.224+0000 7f2e45ffb700 1 -- 172.21.15.72:0/2288453959 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c003680 con 0x7f2e5012cc20 2023-10-03T10:16:35.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.225+0000 7f2e45ffb700 1 -- 172.21.15.72:0/2288453959 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e4c0037e0 con 0x7f2e5012cc20 2023-10-03T10:16:35.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.225+0000 7f2e57592700 1 -- 172.21.15.72:0/2288453959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5008b120 con 0x7f2e5012cc20 2023-10-03T10:16:35.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.226+0000 7f2e45ffb700 1 -- 172.21.15.72:0/2288453959 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2e4c01a960 con 0x7f2e5012cc20 2023-10-03T10:16:35.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.226+0000 7f2e57592700 1 -- 172.21.15.72:0/2288453959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e501285a0 con 0x7f2e5012cc20 2023-10-03T10:16:35.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.234+0000 7f2e45ffb700 1 -- 172.21.15.72:0/2288453959 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e4c017030 con 0x7f2e5012cc20 2023-10-03T10:16:35.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.335+0000 7f4d40ce7700 1 Processor -- start 2023-10-03T10:16:35.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.335+0000 7f4d40ce7700 1 -- start start 2023-10-03T10:16:35.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d40ce7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09d6f0 0x7f4d3c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d40ce7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e410 0x7f4d3c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d40ce7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3c09b120 con 0x7f4d3c09e000 2023-10-03T10:16:35.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d40ce7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c06b460 con 0x7f4d3c09e410 2023-10-03T10:16:35.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d40ce7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c09a7e0 con 0x7f4d3c09d6f0 2023-10-03T10:16:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d3a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09d6f0 0x7f4d3c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d39d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4d3c09e000 0x7f4d3c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44724/0 (socket says 172.21.15.72:44724) 2023-10-03T10:16:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d3ad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e410 0x7f4d3c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d39d9b700 1 -- 172.21.15.72:0/3996815400 learned_addr learned my addr 172.21.15.72:0/3996815400 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d3a59c700 1 -- 172.21.15.72:0/3996815400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e410 msgr2=0x7f4d3c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d3a59c700 1 --2- 172.21.15.72:0/3996815400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e410 0x7f4d3c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d3a59c700 1 -- 172.21.15.72:0/3996815400 >> v1:172.21.15.72:6789/0 conn(0x7f4d3c09e000 legacy=0x7f4d3c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d3959a700 1 -- 172.21.15.72:0/3996815400 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943405352 0 0) 0x7f4d3c09b120 con 0x7f4d3c09e000 2023-10-03T10:16:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d3a59c700 1 -- 172.21.15.72:0/3996815400 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c09a500 con 0x7f4d3c09d6f0 2023-10-03T10:16:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d3ad9d700 1 --2- 172.21.15.72:0/3996815400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e410 0x7f4d3c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.336+0000 7f4d3a59c700 1 --2- 172.21.15.72:0/3996815400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09d6f0 0x7f4d3c09dac0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0098a0 tx=0x7f4d2c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c3d5c6e900aea4d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.337+0000 7f4d3959a700 1 -- 172.21.15.72:0/3996815400 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c011830 con 0x7f4d3c09d6f0 2023-10-03T10:16:35.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.337+0000 7f4d3959a700 1 -- 172.21.15.72:0/3996815400 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c011990 con 0x7f4d3c09d6f0 2023-10-03T10:16:35.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.337+0000 7f4d3959a700 1 -- 172.21.15.72:0/3996815400 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c011d20 con 0x7f4d3c09d6f0 2023-10-03T10:16:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.337+0000 7f4d40ce7700 1 -- 172.21.15.72:0/3996815400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09d6f0 msgr2=0x7f4d3c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.337+0000 7f4d40ce7700 1 --2- 172.21.15.72:0/3996815400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09d6f0 0x7f4d3c09dac0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0098a0 tx=0x7f4d2c009bb0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.337+0000 7f4d40ce7700 1 -- 172.21.15.72:0/3996815400 shutdown_connections 2023-10-03T10:16:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.337+0000 7f4d40ce7700 1 --2- 172.21.15.72:0/3996815400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e410 0x7f4d3c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.337+0000 7f4d40ce7700 1 --2- 172.21.15.72:0/3996815400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09d6f0 0x7f4d3c09dac0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.337+0000 7f4d40ce7700 1 -- 172.21.15.72:0/3996815400 >> 172.21.15.72:0/3996815400 conn(0x7f4d3c066f50 msgr2=0x7f4d3c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.337+0000 7f4d40ce7700 1 -- 172.21.15.72:0/3996815400 shutdown_connections 2023-10-03T10:16:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.337+0000 7f4d40ce7700 1 -- 172.21.15.72:0/3996815400 wait complete. 2023-10-03T10:16:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.338+0000 7f4d40ce7700 1 Processor -- start 2023-10-03T10:16:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.338+0000 7f4d40ce7700 1 -- start start 2023-10-03T10:16:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d40ce7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09d6f0 0x7f4d3c122630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d40ce7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d3c09e000 0x7f4d3c122b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d40ce7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e410 0x7f4d3c1230b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d40ce7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c125d40 con 0x7f4d3c09e000 2023-10-03T10:16:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d40ce7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c126020 con 0x7f4d3c09e410 2023-10-03T10:16:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d40ce7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c0a19d0 con 0x7f4d3c09d6f0 2023-10-03T10:16:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d3a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09d6f0 0x7f4d3c122630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d39d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d3c09e000 0x7f4d3c122b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d3a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09d6f0 0x7f4d3c122630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47666/0 (socket says 172.21.15.72:47666) 2023-10-03T10:16:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d39d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d3c09e000 0x7f4d3c122b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60292/0 (socket says 172.21.15.72:60292) 2023-10-03T10:16:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d3a59c700 1 -- 172.21.15.72:0/56324271 learned_addr learned my addr 172.21.15.72:0/56324271 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d3ad9d700 1 --2- 172.21.15.72:0/56324271 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e410 0x7f4d3c1230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d39d9b700 1 -- 172.21.15.72:0/56324271 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09d6f0 msgr2=0x7f4d3c122630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d39d9b700 1 --2- 172.21.15.72:0/56324271 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09d6f0 0x7f4d3c122630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d39d9b700 1 -- 172.21.15.72:0/56324271 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e410 msgr2=0x7f4d3c1230b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d39d9b700 1 --2- 172.21.15.72:0/56324271 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e410 0x7f4d3c1230b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d39d9b700 1 -- 172.21.15.72:0/56324271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d34009a70 con 0x7f4d3c09e000 2023-10-03T10:16:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.339+0000 7f4d39d9b700 1 --2- 172.21.15.72:0/56324271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d3c09e000 0x7f4d3c122b70 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c06e510 tx=0x7f4d3000c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.340+0000 7f4d2affd700 1 -- 172.21.15.72:0/56324271 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30004c80 con 0x7f4d3c09e000 2023-10-03T10:16:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.340+0000 7f4d2affd700 1 -- 172.21.15.72:0/56324271 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d30004de0 con 0x7f4d3c09e000 2023-10-03T10:16:35.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.340+0000 7f4d2affd700 1 -- 172.21.15.72:0/56324271 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30007310 con 0x7f4d3c09e000 2023-10-03T10:16:35.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.340+0000 7f4d40ce7700 1 -- 172.21.15.72:0/56324271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c0094a0 con 0x7f4d3c09e000 2023-10-03T10:16:35.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.340+0000 7f4d40ce7700 1 -- 172.21.15.72:0/56324271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3c125360 con 0x7f4d3c09e000 2023-10-03T10:16:35.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.341+0000 7f4d2affd700 1 -- 172.21.15.72:0/56324271 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d30007470 con 0x7f4d3c09e000 2023-10-03T10:16:35.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.341+0000 7f4d2affd700 1 -- 172.21.15.72:0/56324271 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d3003f1c0 con 0x7f4d3c09e000 2023-10-03T10:16:35.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.342+0000 7f4d40ce7700 1 -- 172.21.15.72:0/56324271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3c074ea0 con 0x7f4d3c09e000 2023-10-03T10:16:35.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.346+0000 7fb02f8e1700 1 Processor -- start 2023-10-03T10:16:35.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.346+0000 7fb02f8e1700 1 -- start start 2023-10-03T10:16:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02f8e1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb02809e930 0x7fb02809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02f8e1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb02809f240 0x7fb0281317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02f8e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb02809f650 0x7fb028131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02f8e1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb028070940 con 0x7fb02809f240 2023-10-03T10:16:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02f8e1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02806fd60 con 0x7fb02809f650 2023-10-03T10:16:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02f8e1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb02806fa80 con 0x7fb02809e930 2023-10-03T10:16:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02d67d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb02809e930 0x7fb02809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02ce7c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb02809f240 0x7fb0281317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02d67d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb02809e930 0x7fb02809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47674/0 (socket says 172.21.15.72:47674) 2023-10-03T10:16:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02ce7c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb02809f240 0x7fb0281317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60304/0 (socket says 172.21.15.72:60304) 2023-10-03T10:16:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02d67d700 1 -- 172.21.15.72:0/691729688 learned_addr learned my addr 172.21.15.72:0/691729688 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02de7e700 1 --2- 172.21.15.72:0/691729688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb02809f650 0x7fb028131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02d67d700 1 -- 172.21.15.72:0/691729688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb02809f650 msgr2=0x7fb028131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02d67d700 1 --2- 172.21.15.72:0/691729688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb02809f650 0x7fb028131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02d67d700 1 -- 172.21.15.72:0/691729688 >> v2:172.21.15.72:3300/0 conn(0x7fb02809f240 msgr2=0x7fb0281317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02d67d700 1 --2- 172.21.15.72:0/691729688 >> v2:172.21.15.72:3300/0 conn(0x7fb02809f240 0x7fb0281317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02d67d700 1 -- 172.21.15.72:0/691729688 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02809fb60 con 0x7fb02809e930 2023-10-03T10:16:35.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.347+0000 7fb02ce7c700 1 --2- 172.21.15.72:0/691729688 >> v2:172.21.15.72:3300/0 conn(0x7fb02809f240 0x7fb0281317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.348+0000 7fb02d67d700 1 --2- 172.21.15.72:0/691729688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb02809e930 0x7fb02809ed00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb02400dd10 tx=0x7fb02400f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61dfffb7ea9c7e2e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.348+0000 7fb01ffff700 1 -- 172.21.15.72:0/691729688 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024012070 con 0x7fb02809e930 2023-10-03T10:16:35.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.348+0000 7fb01ffff700 1 -- 172.21.15.72:0/691729688 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02400d2e0 con 0x7fb02809e930 2023-10-03T10:16:35.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.348+0000 7fb01ffff700 1 -- 172.21.15.72:0/691729688 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02400fb10 con 0x7fb02809e930 2023-10-03T10:16:35.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.348+0000 7fb02f8e1700 1 -- 172.21.15.72:0/691729688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb02809e930 msgr2=0x7fb02809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.348+0000 7fb02f8e1700 1 --2- 172.21.15.72:0/691729688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb02809e930 0x7fb02809ed00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb02400dd10 tx=0x7fb02400f330 comp rx=0 tx=0).stop 2023-10-03T10:16:35.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.348+0000 7fb02f8e1700 1 -- 172.21.15.72:0/691729688 shutdown_connections 2023-10-03T10:16:35.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.348+0000 7fb02f8e1700 1 --2- 172.21.15.72:0/691729688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb02809f650 0x7fb028131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.348+0000 7fb02f8e1700 1 --2- 172.21.15.72:0/691729688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb02809e930 0x7fb02809ed00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.348+0000 7fb02f8e1700 1 --2- 172.21.15.72:0/691729688 >> v2:172.21.15.72:3300/0 conn(0x7fb02809f240 0x7fb0281317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.348+0000 7fb02f8e1700 1 -- 172.21.15.72:0/691729688 >> 172.21.15.72:0/691729688 conn(0x7fb0280a4210 msgr2=0x7fb0280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.348+0000 7fb02f8e1700 1 -- 172.21.15.72:0/691729688 shutdown_connections 2023-10-03T10:16:35.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.348+0000 7fb02f8e1700 1 -- 172.21.15.72:0/691729688 wait complete. 2023-10-03T10:16:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.349+0000 7fb02f8e1700 1 Processor -- start 2023-10-03T10:16:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.349+0000 7fb02f8e1700 1 -- start start 2023-10-03T10:16:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02f8e1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02809e930 0x7fb0281a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02f8e1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb02809f240 0x7fb0281a21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02f8e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb02809f650 0x7fb0281a26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02f8e1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0281a60c0 con 0x7fb02809e930 2023-10-03T10:16:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02f8e1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0281a5700 con 0x7fb02809f650 2023-10-03T10:16:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02f8e1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0281a4a40 con 0x7fb02809f240 2023-10-03T10:16:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02ce7c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb02809f240 0x7fb0281a21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02de7e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb02809f650 0x7fb0281a26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02ce7c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb02809f240 0x7fb0281a21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47678/0 (socket says 172.21.15.72:47678) 2023-10-03T10:16:35.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02de7e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb02809f650 0x7fb0281a26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:57216/0 (socket says 172.21.15.72:57216) 2023-10-03T10:16:35.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02ce7c700 1 -- 172.21.15.72:0/514274832 learned_addr learned my addr 172.21.15.72:0/514274832 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:35.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02d67d700 1 --2- 172.21.15.72:0/514274832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02809e930 0x7fb0281a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02ce7c700 1 -- 172.21.15.72:0/514274832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb02809f650 msgr2=0x7fb0281a26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02ce7c700 1 --2- 172.21.15.72:0/514274832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb02809f650 0x7fb0281a26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02ce7c700 1 -- 172.21.15.72:0/514274832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02809e930 msgr2=0x7fb0281a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02ce7c700 1 --2- 172.21.15.72:0/514274832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02809e930 0x7fb0281a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02ce7c700 1 -- 172.21.15.72:0/514274832 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180094a0 con 0x7fb02809f240 2023-10-03T10:16:35.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02d67d700 1 --2- 172.21.15.72:0/514274832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02809e930 0x7fb0281a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02de7e700 1 --2- 172.21.15.72:0/514274832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb02809f650 0x7fb0281a26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.350+0000 7fb02ce7c700 1 --2- 172.21.15.72:0/514274832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb02809f240 0x7fb0281a21b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb01800ebe0 tx=0x7fb01800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.351+0000 7f4d2affd700 1 -- 172.21.15.72:0/56324271 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d30007720 con 0x7f4d3c09e000 2023-10-03T10:16:35.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.351+0000 7fb01dffb700 1 -- 172.21.15.72:0/514274832 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01800c850 con 0x7fb02809f240 2023-10-03T10:16:35.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.351+0000 7fb01dffb700 1 -- 172.21.15.72:0/514274832 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01800c9b0 con 0x7fb02809f240 2023-10-03T10:16:35.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.351+0000 7fb01dffb700 1 -- 172.21.15.72:0/514274832 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01800cd40 con 0x7fb02809f240 2023-10-03T10:16:35.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.351+0000 7fb02f8e1700 1 -- 172.21.15.72:0/514274832 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02400d9f0 con 0x7fb02809f240 2023-10-03T10:16:35.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.351+0000 7fb02f8e1700 1 -- 172.21.15.72:0/514274832 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0280a0190 con 0x7fb02809f240 2023-10-03T10:16:35.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.352+0000 7fb02f8e1700 1 -- 172.21.15.72:0/514274832 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0280a1760 con 0x7fb02809f240 2023-10-03T10:16:35.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.352+0000 7fb01dffb700 1 -- 172.21.15.72:0/514274832 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb018013470 con 0x7fb02809f240 2023-10-03T10:16:35.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.352+0000 7fb01dffb700 1 -- 172.21.15.72:0/514274832 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb01803faa0 con 0x7fb02809f240 2023-10-03T10:16:35.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.357+0000 7fb01dffb700 1 -- 172.21.15.72:0/514274832 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb018013720 con 0x7fb02809f240 2023-10-03T10:16:35.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.433+0000 7f2e57592700 1 -- 172.21.15.72:0/2288453959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2e50130540 con 0x7f2e5012cc20 2023-10-03T10:16:35.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.433+0000 7f2e45ffb700 1 -- 172.21.15.72:0/2288453959 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e4c011590 con 0x7f2e5012cc20 2023-10-03T10:16:35.433 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.437+0000 7f2e57592700 1 -- 172.21.15.72:0/2288453959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e5012cc20 msgr2=0x7f2e5006f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.437+0000 7f2e57592700 1 --2- 172.21.15.72:0/2288453959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e5012cc20 0x7f2e5006f890 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c000f60 tx=0x7f2e4c00c730 comp rx=0 tx=0).stop 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.437+0000 7f2e57592700 1 -- 172.21.15.72:0/2288453959 shutdown_connections 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.437+0000 7f2e57592700 1 --2- 172.21.15.72:0/2288453959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2e5012cff0 0x7f2e5006fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.437+0000 7f2e57592700 1 --2- 172.21.15.72:0/2288453959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2e5012c2f0 0x7f2e5006f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.437+0000 7f2e57592700 1 --2- 172.21.15.72:0/2288453959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2e5012cc20 0x7f2e5006f890 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.437+0000 7f2e57592700 1 -- 172.21.15.72:0/2288453959 >> 172.21.15.72:0/2288453959 conn(0x7f2e5009f470 msgr2=0x7f2e5012fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.437+0000 7f2e57592700 1 -- 172.21.15.72:0/2288453959 shutdown_connections 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.437+0000 7f2e57592700 1 -- 172.21.15.72:0/2288453959 wait complete. 2023-10-03T10:16:35.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:35.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.553+0000 7fb02f8e1700 1 -- 172.21.15.72:0/514274832 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb0281a52a0 con 0x7fb02809f240 2023-10-03T10:16:35.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.553+0000 7fb01dffb700 1 -- 172.21.15.72:0/514274832 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb018011b00 con 0x7fb02809f240 2023-10-03T10:16:35.553 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:35.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.555+0000 7fb02f8e1700 1 -- 172.21.15.72:0/514274832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb02809f240 msgr2=0x7fb0281a21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.555+0000 7fb02f8e1700 1 --2- 172.21.15.72:0/514274832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb02809f240 0x7fb0281a21b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb01800ebe0 tx=0x7fb01800eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.555+0000 7fb02f8e1700 1 -- 172.21.15.72:0/514274832 shutdown_connections 2023-10-03T10:16:35.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.555+0000 7fb02f8e1700 1 --2- 172.21.15.72:0/514274832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02809e930 0x7fb0281a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.555+0000 7fb02f8e1700 1 --2- 172.21.15.72:0/514274832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb02809f650 0x7fb0281a26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.555+0000 7fb02f8e1700 1 --2- 172.21.15.72:0/514274832 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb02809f240 0x7fb0281a21b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.555+0000 7fb02f8e1700 1 -- 172.21.15.72:0/514274832 >> 172.21.15.72:0/514274832 conn(0x7fb0280a4210 msgr2=0x7fb0281b6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.555+0000 7fb02f8e1700 1 -- 172.21.15.72:0/514274832 shutdown_connections 2023-10-03T10:16:35.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.555+0000 7fb02f8e1700 1 -- 172.21.15.72:0/514274832 wait complete. 2023-10-03T10:16:35.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.557+0000 7f4d40ce7700 1 -- 172.21.15.72:0/56324271 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4d3c0a29a0 con 0x7f4d3c09e000 2023-10-03T10:16:35.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.557+0000 7f4d2affd700 1 -- 172.21.15.72:0/56324271 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4d3001ce30 con 0x7f4d3c09e000 2023-10-03T10:16:35.557 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.559+0000 7f4d40ce7700 1 -- 172.21.15.72:0/56324271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d3c09e000 msgr2=0x7f4d3c122b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.559+0000 7f4d40ce7700 1 --2- 172.21.15.72:0/56324271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d3c09e000 0x7f4d3c122b70 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c06e510 tx=0x7f4d3000c750 comp rx=0 tx=0).stop 2023-10-03T10:16:35.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.559+0000 7f4d40ce7700 1 -- 172.21.15.72:0/56324271 shutdown_connections 2023-10-03T10:16:35.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.559+0000 7f4d40ce7700 1 --2- 172.21.15.72:0/56324271 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4d3c09e410 0x7f4d3c1230b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.559+0000 7f4d40ce7700 1 --2- 172.21.15.72:0/56324271 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4d3c09d6f0 0x7f4d3c122630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.559+0000 7f4d40ce7700 1 --2- 172.21.15.72:0/56324271 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d3c09e000 0x7f4d3c122b70 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.559+0000 7f4d40ce7700 1 -- 172.21.15.72:0/56324271 >> 172.21.15.72:0/56324271 conn(0x7f4d3c066f50 msgr2=0x7f4d3c09b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.559+0000 7f4d40ce7700 1 -- 172.21.15.72:0/56324271 shutdown_connections 2023-10-03T10:16:35.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:35.560+0000 7f4d40ce7700 1 -- 172.21.15.72:0/56324271 wait complete. 2023-10-03T10:16:35.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:35.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:36.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.177+0000 7f5eaa217700 1 Processor -- start 2023-10-03T10:16:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.177+0000 7f5eaa217700 1 -- start start 2023-10-03T10:16:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5eaa217700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ea41337f0 0x7f5ea4138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5eaa217700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ea4138dc0 0x7f5ea413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5eaa217700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea406b990 con 0x7f5ea4133420 2023-10-03T10:16:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5eaa217700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea409b0e0 con 0x7f5ea4138dc0 2023-10-03T10:16:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5eaa217700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea4133c20 con 0x7f5ea41337f0 2023-10-03T10:16:36.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5ea2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ea41337f0 0x7f5ea4138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5ea3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ea4138dc0 0x7f5ea413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5ea2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ea41337f0 0x7f5ea4138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:57230/0 (socket says 172.21.15.72:57230) 2023-10-03T10:16:36.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5ea3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ea4138dc0 0x7f5ea413b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60332/0 (socket says 172.21.15.72:60332) 2023-10-03T10:16:36.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5ea2ffd700 1 -- 172.21.15.72:0/2010181816 learned_addr learned my addr 172.21.15.72:0/2010181816 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:36.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5ea3fff700 1 -- 172.21.15.72:0/2010181816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ea41337f0 msgr2=0x7f5ea4138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:36.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5ea3fff700 1 --2- 172.21.15.72:0/2010181816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ea41337f0 0x7f5ea4138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5ea3fff700 1 -- 172.21.15.72:0/2010181816 >> v1:172.21.15.72:6789/0 conn(0x7f5ea4133420 legacy=0x7f5ea4133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5ea3fff700 1 -- 172.21.15.72:0/2010181816 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea40a0590 con 0x7f5ea4138dc0 2023-10-03T10:16:36.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5ea27fc700 1 -- 172.21.15.72:0/2010181816 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806530186 0 0) 0x7f5ea406b990 con 0x7f5ea4133420 2023-10-03T10:16:36.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5ea2ffd700 1 --2- 172.21.15.72:0/2010181816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ea41337f0 0x7f5ea4138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:36.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.178+0000 7f5ea3fff700 1 --2- 172.21.15.72:0/2010181816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ea4138dc0 0x7f5ea413b1a0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009d90 tx=0x7f5e9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aad1fa9cd3f8228 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.179+0000 7f5ea27fc700 1 -- 172.21.15.72:0/2010181816 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c00e070 con 0x7f5ea4138dc0 2023-10-03T10:16:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.179+0000 7f5ea27fc700 1 -- 172.21.15.72:0/2010181816 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c00bb20 con 0x7f5ea4138dc0 2023-10-03T10:16:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.179+0000 7f5ea27fc700 1 -- 172.21.15.72:0/2010181816 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c012430 con 0x7f5ea4138dc0 2023-10-03T10:16:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.179+0000 7f5eaa217700 1 -- 172.21.15.72:0/2010181816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ea4138dc0 msgr2=0x7f5ea413b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.179+0000 7f5eaa217700 1 --2- 172.21.15.72:0/2010181816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ea4138dc0 0x7f5ea413b1a0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009d90 tx=0x7f5e9c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.179+0000 7f5eaa217700 1 -- 172.21.15.72:0/2010181816 shutdown_connections 2023-10-03T10:16:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.179+0000 7f5eaa217700 1 --2- 172.21.15.72:0/2010181816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ea4138dc0 0x7f5ea413b1a0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.179+0000 7f5eaa217700 1 --2- 172.21.15.72:0/2010181816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ea41337f0 0x7f5ea4138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.179+0000 7f5eaa217700 1 -- 172.21.15.72:0/2010181816 >> 172.21.15.72:0/2010181816 conn(0x7f5ea40a4210 msgr2=0x7f5ea40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.179+0000 7f5eaa217700 1 -- 172.21.15.72:0/2010181816 shutdown_connections 2023-10-03T10:16:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.179+0000 7f5eaa217700 1 -- 172.21.15.72:0/2010181816 wait complete. 2023-10-03T10:16:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.180+0000 7f5eaa217700 1 Processor -- start 2023-10-03T10:16:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.180+0000 7f5eaa217700 1 -- start start 2023-10-03T10:16:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5eaa217700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ea4133420 0x7f5ea412f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5eaa217700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ea41337f0 0x7f5ea412f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5eaa217700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ea4138dc0 0x7f5ea412fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5eaa217700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea409c4e0 con 0x7f5ea41337f0 2023-10-03T10:16:36.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5eaa217700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea409b430 con 0x7f5ea4138dc0 2023-10-03T10:16:36.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5eaa217700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea409d600 con 0x7f5ea4133420 2023-10-03T10:16:36.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5ea37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ea4133420 0x7f5ea412f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5ea3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ea4138dc0 0x7f5ea412fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5ea2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ea41337f0 0x7f5ea412f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5ea3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ea4138dc0 0x7f5ea412fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:57232/0 (socket says 172.21.15.72:57232) 2023-10-03T10:16:36.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5ea37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ea4133420 0x7f5ea412f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47690/0 (socket says 172.21.15.72:47690) 2023-10-03T10:16:36.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5ea3fff700 1 -- 172.21.15.72:0/2313112196 learned_addr learned my addr 172.21.15.72:0/2313112196 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:36.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5ea3fff700 1 -- 172.21.15.72:0/2313112196 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ea4133420 msgr2=0x7f5ea412f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5ea3fff700 1 --2- 172.21.15.72:0/2313112196 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ea4133420 0x7f5ea412f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5ea3fff700 1 -- 172.21.15.72:0/2313112196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ea41337f0 msgr2=0x7f5ea412f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5ea3fff700 1 --2- 172.21.15.72:0/2313112196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ea41337f0 0x7f5ea412f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5ea3fff700 1 -- 172.21.15.72:0/2313112196 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e94009550 con 0x7f5ea4138dc0 2023-10-03T10:16:36.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5ea37fe700 1 --2- 172.21.15.72:0/2313112196 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ea4133420 0x7f5ea412f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:36.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5ea2ffd700 1 --2- 172.21.15.72:0/2313112196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ea41337f0 0x7f5ea412f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:36.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5ea3fff700 1 --2- 172.21.15.72:0/2313112196 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ea4138dc0 0x7f5ea412fb30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c013000 tx=0x7f5e9c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5e9bfff700 1 -- 172.21.15.72:0/2313112196 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c012430 con 0x7f5ea4138dc0 2023-10-03T10:16:36.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5e9bfff700 1 -- 172.21.15.72:0/2313112196 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c020070 con 0x7f5ea4138dc0 2023-10-03T10:16:36.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5eaa217700 1 -- 172.21.15.72:0/2313112196 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9c009a70 con 0x7f5ea4138dc0 2023-10-03T10:16:36.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5e9bfff700 1 -- 172.21.15.72:0/2313112196 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c004280 con 0x7f5ea4138dc0 2023-10-03T10:16:36.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.181+0000 7f5eaa217700 1 -- 172.21.15.72:0/2313112196 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea4130b10 con 0x7f5ea4138dc0 2023-10-03T10:16:36.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.182+0000 7f5e9bfff700 1 -- 172.21.15.72:0/2313112196 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e9c0043e0 con 0x7f5ea4138dc0 2023-10-03T10:16:36.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.182+0000 7f5eaa217700 1 -- 172.21.15.72:0/2313112196 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea4074ea0 con 0x7f5ea4138dc0 2023-10-03T10:16:36.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.182+0000 7f5e9bfff700 1 -- 172.21.15.72:0/2313112196 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5e9c022070 con 0x7f5ea4138dc0 2023-10-03T10:16:36.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.187+0000 7f5e9bfff700 1 -- 172.21.15.72:0/2313112196 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e9c01b400 con 0x7f5ea4138dc0 2023-10-03T10:16:36.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.371+0000 7f5eaa217700 1 -- 172.21.15.72:0/2313112196 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ea406b250 con 0x7f5ea4138dc0 2023-10-03T10:16:36.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.371+0000 7f5e9bfff700 1 -- 172.21.15.72:0/2313112196 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e9c01a380 con 0x7f5ea4138dc0 2023-10-03T10:16:36.371 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:36.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.373+0000 7f5eaa217700 1 -- 172.21.15.72:0/2313112196 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ea4138dc0 msgr2=0x7f5ea412fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.373+0000 7f5eaa217700 1 --2- 172.21.15.72:0/2313112196 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ea4138dc0 0x7f5ea412fb30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c013000 tx=0x7f5e9c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.373+0000 7f5eaa217700 1 -- 172.21.15.72:0/2313112196 shutdown_connections 2023-10-03T10:16:36.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.373+0000 7f5eaa217700 1 --2- 172.21.15.72:0/2313112196 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ea4138dc0 0x7f5ea412fb30 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.373+0000 7f5eaa217700 1 --2- 172.21.15.72:0/2313112196 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ea4133420 0x7f5ea412f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.373+0000 7f5eaa217700 1 --2- 172.21.15.72:0/2313112196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ea41337f0 0x7f5ea412f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.373+0000 7f5eaa217700 1 -- 172.21.15.72:0/2313112196 >> 172.21.15.72:0/2313112196 conn(0x7f5ea40a4210 msgr2=0x7f5ea40a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.373+0000 7f5eaa217700 1 -- 172.21.15.72:0/2313112196 shutdown_connections 2023-10-03T10:16:36.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.373+0000 7f5eaa217700 1 -- 172.21.15.72:0/2313112196 wait complete. 2023-10-03T10:16:36.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:36.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:36.568 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:36.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:36.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.575+0000 7fcaadfd6700 1 Processor -- start 2023-10-03T10:16:36.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.575+0000 7fcaadfd6700 1 -- start start 2023-10-03T10:16:36.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaadfd6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcaa809e1d0 0x7fcaa8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaadfd6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcaa8139170 0x7fcaa813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaadfd6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa809b120 con 0x7fcaa809d6f0 2023-10-03T10:16:36.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaadfd6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa806b460 con 0x7fcaa8139170 2023-10-03T10:16:36.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaadfd6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa809a7e0 con 0x7fcaa809e1d0 2023-10-03T10:16:36.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaa6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcaa809e1d0 0x7fcaa8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaa7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcaa8139170 0x7fcaa813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaa6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcaa809e1d0 0x7fcaa8138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47706/0 (socket says 172.21.15.72:47706) 2023-10-03T10:16:36.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaa7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcaa8139170 0x7fcaa813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60350/0 (socket says 172.21.15.72:60350) 2023-10-03T10:16:36.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaa6ffd700 1 -- 172.21.15.72:0/1585606552 learned_addr learned my addr 172.21.15.72:0/1585606552 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:36.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaa7fff700 1 -- 172.21.15.72:0/1585606552 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcaa809e1d0 msgr2=0x7fcaa8138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:36.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaa7fff700 1 --2- 172.21.15.72:0/1585606552 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcaa809e1d0 0x7fcaa8138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaa7fff700 1 -- 172.21.15.72:0/1585606552 >> v1:172.21.15.72:6789/0 conn(0x7fcaa809d6f0 legacy=0x7fcaa809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaa7fff700 1 -- 172.21.15.72:0/1585606552 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa809a500 con 0x7fcaa8139170 2023-10-03T10:16:36.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaa6ffd700 1 --2- 172.21.15.72:0/1585606552 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcaa809e1d0 0x7fcaa8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.576+0000 7fcaa7fff700 1 --2- 172.21.15.72:0/1585606552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaa8139170 0x7fcaa813b550 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009d90 tx=0x7fcaa000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85d81250421042e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.577+0000 7fcaa67fc700 1 -- 172.21.15.72:0/1585606552 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa000e070 con 0x7fcaa8139170 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.577+0000 7fcaa67fc700 1 -- 172.21.15.72:0/1585606552 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa000bb20 con 0x7fcaa8139170 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.577+0000 7fcaa67fc700 1 -- 172.21.15.72:0/1585606552 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0012430 con 0x7fcaa8139170 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.577+0000 7fcaadfd6700 1 -- 172.21.15.72:0/1585606552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaa8139170 msgr2=0x7fcaa813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.577+0000 7fcaadfd6700 1 --2- 172.21.15.72:0/1585606552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaa8139170 0x7fcaa813b550 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009d90 tx=0x7fcaa000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.577+0000 7fcaadfd6700 1 -- 172.21.15.72:0/1585606552 shutdown_connections 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.577+0000 7fcaadfd6700 1 --2- 172.21.15.72:0/1585606552 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaa8139170 0x7fcaa813b550 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.577+0000 7fcaadfd6700 1 --2- 172.21.15.72:0/1585606552 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcaa809e1d0 0x7fcaa8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.577+0000 7fcaadfd6700 1 -- 172.21.15.72:0/1585606552 >> 172.21.15.72:0/1585606552 conn(0x7fcaa8066f50 msgr2=0x7fcaa809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.577+0000 7fcaadfd6700 1 -- 172.21.15.72:0/1585606552 shutdown_connections 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.577+0000 7fcaadfd6700 1 -- 172.21.15.72:0/1585606552 wait complete. 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.578+0000 7fcaadfd6700 1 Processor -- start 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaadfd6700 1 -- start start 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaadfd6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcaa809d6f0 0x7fcaa8120910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaadfd6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcaa809e1d0 0x7fcaa8120e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaadfd6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaa8139170 0x7fcaa8121390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaadfd6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa8123e20 con 0x7fcaa8139170 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaadfd6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80a18d0 con 0x7fcaa809e1d0 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaadfd6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa81224e0 con 0x7fcaa809d6f0 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaa6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcaa809e1d0 0x7fcaa8120e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaa77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcaa809d6f0 0x7fcaa8120910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaa77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcaa809d6f0 0x7fcaa8120910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47714/0 (socket says 172.21.15.72:47714) 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaa6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcaa809e1d0 0x7fcaa8120e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:57244/0 (socket says 172.21.15.72:57244) 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaa77fe700 1 -- 172.21.15.72:0/2238671145 learned_addr learned my addr 172.21.15.72:0/2238671145 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaa6ffd700 1 -- 172.21.15.72:0/2238671145 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcaa809d6f0 msgr2=0x7fcaa8120910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaa6ffd700 1 --2- 172.21.15.72:0/2238671145 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcaa809d6f0 0x7fcaa8120910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaa6ffd700 1 -- 172.21.15.72:0/2238671145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaa8139170 msgr2=0x7fcaa8121390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.579+0000 7fcaa6ffd700 1 --2- 172.21.15.72:0/2238671145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaa8139170 0x7fcaa8121390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.580+0000 7fcaa6ffd700 1 -- 172.21.15.72:0/2238671145 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c009550 con 0x7fcaa809e1d0 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.580+0000 7fcaa77fe700 1 --2- 172.21.15.72:0/2238671145 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcaa809d6f0 0x7fcaa8120910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.580+0000 7fcaa6ffd700 1 --2- 172.21.15.72:0/2238671145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcaa809e1d0 0x7fcaa8120e50 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00e9d0 tx=0x7fca9c00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.580+0000 7fca8ffff700 1 -- 172.21.15.72:0/2238671145 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c004030 con 0x7fcaa809e1d0 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.580+0000 7fca8ffff700 1 -- 172.21.15.72:0/2238671145 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c004190 con 0x7fcaa809e1d0 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.580+0000 7fcaadfd6700 1 -- 172.21.15.72:0/2238671145 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa0009a70 con 0x7fcaa809e1d0 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.580+0000 7fca8ffff700 1 -- 172.21.15.72:0/2238671145 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c004520 con 0x7fcaa809e1d0 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.580+0000 7fcaadfd6700 1 -- 172.21.15.72:0/2238671145 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa8122c30 con 0x7fcaa809e1d0 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.581+0000 7fca8ffff700 1 -- 172.21.15.72:0/2238671145 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca9c00c850 con 0x7fcaa809e1d0 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.581+0000 7fca8ffff700 1 -- 172.21.15.72:0/2238671145 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fca9c03f5a0 con 0x7fcaa809e1d0 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.581+0000 7fcaadfd6700 1 -- 172.21.15.72:0/2238671145 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa8074ea0 con 0x7fcaa809e1d0 2023-10-03T10:16:36.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.587+0000 7fca8ffff700 1 -- 172.21.15.72:0/2238671145 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca9c0036a0 con 0x7fcaa809e1d0 2023-10-03T10:16:36.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.698+0000 7fad20c36700 1 Processor -- start 2023-10-03T10:16:36.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.698+0000 7fad20c36700 1 -- start start 2023-10-03T10:16:36.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.698+0000 7fad20c36700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad1c130540 0x7fad1c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.698+0000 7fad20c36700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad1c130e50 0x7fad1c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad20c36700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1c0716a0 con 0x7fad1c06fb20 2023-10-03T10:16:36.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad20c36700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c09a390 con 0x7fad1c130e50 2023-10-03T10:16:36.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad20c36700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c071290 con 0x7fad1c130540 2023-10-03T10:16:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad19d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad1c130e50 0x7fad1c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad19d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad1c130e50 0x7fad1c06f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:57250/0 (socket says 172.21.15.72:57250) 2023-10-03T10:16:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad19d9b700 1 -- 172.21.15.72:0/41415689 learned_addr learned my addr 172.21.15.72:0/41415689 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad1a59c700 1 --2- 172.21.15.72:0/41415689 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad1c130540 0x7fad1c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad1959a700 1 -- 172.21.15.72:0/41415689 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814293045 0 0) 0x7fad1c0716a0 con 0x7fad1c06fb20 2023-10-03T10:16:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad1959a700 1 -- 172.21.15.72:0/41415689 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad040035b0 con 0x7fad1c06fb20 2023-10-03T10:16:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad1a59c700 1 -- 172.21.15.72:0/41415689 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad1c130e50 msgr2=0x7fad1c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad1a59c700 1 --2- 172.21.15.72:0/41415689 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad1c130e50 0x7fad1c06f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad1a59c700 1 -- 172.21.15.72:0/41415689 >> v1:172.21.15.72:6789/0 conn(0x7fad1c06fb20 legacy=0x7fad1c137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad1a59c700 1 -- 172.21.15.72:0/41415689 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c130340 con 0x7fad1c130540 2023-10-03T10:16:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad19d9b700 1 --2- 172.21.15.72:0/41415689 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad1c130e50 0x7fad1c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad1a59c700 1 --2- 172.21.15.72:0/41415689 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad1c130540 0x7fad1c130910 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0098a0 tx=0x7fad0c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5112240137ac450b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad1959a700 1 -- 172.21.15.72:0/41415689 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c011830 con 0x7fad1c130540 2023-10-03T10:16:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad1959a700 1 -- 172.21.15.72:0/41415689 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c011990 con 0x7fad1c130540 2023-10-03T10:16:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.699+0000 7fad1959a700 1 -- 172.21.15.72:0/41415689 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c011d20 con 0x7fad1c130540 2023-10-03T10:16:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.700+0000 7fad20c36700 1 -- 172.21.15.72:0/41415689 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad1c130540 msgr2=0x7fad1c130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.700+0000 7fad20c36700 1 --2- 172.21.15.72:0/41415689 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad1c130540 0x7fad1c130910 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0098a0 tx=0x7fad0c009bb0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.700+0000 7fad20c36700 1 -- 172.21.15.72:0/41415689 shutdown_connections 2023-10-03T10:16:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.700+0000 7fad20c36700 1 --2- 172.21.15.72:0/41415689 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad1c130540 0x7fad1c130910 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.700+0000 7fad20c36700 1 --2- 172.21.15.72:0/41415689 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad1c130e50 0x7fad1c06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.700+0000 7fad20c36700 1 -- 172.21.15.72:0/41415689 >> 172.21.15.72:0/41415689 conn(0x7fad1c0a2aa0 msgr2=0x7fad1c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.700+0000 7fad20c36700 1 -- 172.21.15.72:0/41415689 shutdown_connections 2023-10-03T10:16:36.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.700+0000 7fad20c36700 1 -- 172.21.15.72:0/41415689 wait complete. 2023-10-03T10:16:36.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.701+0000 7f2dd1695700 1 Processor -- start 2023-10-03T10:16:36.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.701+0000 7f2dd1695700 1 -- start start 2023-10-03T10:16:36.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.701+0000 7f2dd1695700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dcc130670 0x7f2dcc130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.701+0000 7f2dd1695700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dcc0701a0 0x7f2dcc138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.701+0000 7f2dd1695700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dcc130260 con 0x7f2dcc06f680 2023-10-03T10:16:36.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.701+0000 7f2dd1695700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc09a350 con 0x7f2dcc0701a0 2023-10-03T10:16:36.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.701+0000 7f2dd1695700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc071ff0 con 0x7f2dcc130670 2023-10-03T10:16:36.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.701+0000 7f2dcaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dcc130670 0x7f2dcc130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.701+0000 7f2dcaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dcc130670 0x7f2dcc130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47736/0 (socket says 172.21.15.72:47736) 2023-10-03T10:16:36.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.701+0000 7f2dcaffd700 1 -- 172.21.15.72:0/3606016763 learned_addr learned my addr 172.21.15.72:0/3606016763 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:36.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.702+0000 7f2dcb7fe700 1 --2- 172.21.15.72:0/3606016763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dcc0701a0 0x7f2dcc138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.702+0000 7fad20c36700 1 Processor -- start 2023-10-03T10:16:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.702+0000 7f2dcb7fe700 1 -- 172.21.15.72:0/3606016763 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dcc130670 msgr2=0x7f2dcc130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.702+0000 7f2dcb7fe700 1 --2- 172.21.15.72:0/3606016763 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dcc130670 0x7f2dcc130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.702+0000 7f2dcb7fe700 1 -- 172.21.15.72:0/3606016763 >> v1:172.21.15.72:6789/0 conn(0x7f2dcc06f680 legacy=0x7f2dcc06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.702+0000 7f2dcb7fe700 1 -- 172.21.15.72:0/3606016763 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc09ecf0 con 0x7f2dcc0701a0 2023-10-03T10:16:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.702+0000 7f2dcaffd700 1 --2- 172.21.15.72:0/3606016763 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dcc130670 0x7f2dcc130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.702+0000 7f2dcb7fe700 1 --2- 172.21.15.72:0/3606016763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dcc0701a0 0x7f2dcc138540 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4009dc0 tx=0x7f2dc400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4422519a41aeb100 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.702+0000 7f2dc9ffb700 1 -- 172.21.15.72:0/3606016763 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc400e070 con 0x7f2dcc0701a0 2023-10-03T10:16:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.702+0000 7f2dc9ffb700 1 -- 172.21.15.72:0/3606016763 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc400bb20 con 0x7f2dcc0701a0 2023-10-03T10:16:36.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.702+0000 7f2dc9ffb700 1 -- 172.21.15.72:0/3606016763 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4012430 con 0x7f2dcc0701a0 2023-10-03T10:16:36.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.702+0000 7fad20c36700 1 -- start start 2023-10-03T10:16:36.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.702+0000 7fad20c36700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad1c06fb20 0x7fad1c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.702+0000 7fad20c36700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad1c130540 0x7fad1c139c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.702+0000 7fad20c36700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad1c130e50 0x7fad1c13a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad20c36700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c134ba0 con 0x7fad1c130e50 2023-10-03T10:16:36.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad20c36700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c1391b0 con 0x7fad1c06fb20 2023-10-03T10:16:36.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad19d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad1c130540 0x7fad1c139c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad20c36700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c1348f0 con 0x7fad1c130540 2023-10-03T10:16:36.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad19d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad1c130540 0x7fad1c139c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47752/0 (socket says 172.21.15.72:47752) 2023-10-03T10:16:36.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad19d9b700 1 -- 172.21.15.72:0/3769500046 learned_addr learned my addr 172.21.15.72:0/3769500046 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:36.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7f2dd1695700 1 -- 172.21.15.72:0/3606016763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dcc0701a0 msgr2=0x7f2dcc138540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7f2dd1695700 1 --2- 172.21.15.72:0/3606016763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dcc0701a0 0x7f2dcc138540 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4009dc0 tx=0x7f2dc400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:36.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad19d9b700 1 -- 172.21.15.72:0/3769500046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad1c06fb20 msgr2=0x7fad1c1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad19d9b700 1 --2- 172.21.15.72:0/3769500046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad1c06fb20 0x7fad1c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad19d9b700 1 -- 172.21.15.72:0/3769500046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad1c130e50 msgr2=0x7fad1c13a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad19d9b700 1 --2- 172.21.15.72:0/3769500046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad1c130e50 0x7fad1c13a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad19d9b700 1 -- 172.21.15.72:0/3769500046 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad10009550 con 0x7fad1c130540 2023-10-03T10:16:36.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad19d9b700 1 --2- 172.21.15.72:0/3769500046 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad1c130540 0x7fad1c139c90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fad1000ebe0 tx=0x7fad10009e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7f2dd1695700 1 -- 172.21.15.72:0/3606016763 shutdown_connections 2023-10-03T10:16:36.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7f2dd1695700 1 --2- 172.21.15.72:0/3606016763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dcc0701a0 0x7f2dcc138540 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7f2dd1695700 1 --2- 172.21.15.72:0/3606016763 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dcc130670 0x7f2dcc130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7f2dd1695700 1 -- 172.21.15.72:0/3606016763 >> 172.21.15.72:0/3606016763 conn(0x7f2dcc0a2aa0 msgr2=0x7f2dcc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7f2dd1695700 1 -- 172.21.15.72:0/3606016763 shutdown_connections 2023-10-03T10:16:36.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad0affd700 1 -- 172.21.15.72:0/3769500046 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1000c8b0 con 0x7fad1c130540 2023-10-03T10:16:36.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad0affd700 1 -- 172.21.15.72:0/3769500046 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1000ca10 con 0x7fad1c130540 2023-10-03T10:16:36.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad0affd700 1 -- 172.21.15.72:0/3769500046 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1000cdc0 con 0x7fad1c130540 2023-10-03T10:16:36.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad20c36700 1 -- 172.21.15.72:0/3769500046 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c0094a0 con 0x7fad1c130540 2023-10-03T10:16:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7f2dd1695700 1 -- 172.21.15.72:0/3606016763 wait complete. 2023-10-03T10:16:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.703+0000 7fad20c36700 1 -- 172.21.15.72:0/3769500046 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1c1358d0 con 0x7fad1c130540 2023-10-03T10:16:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.704+0000 7f2dd1695700 1 Processor -- start 2023-10-03T10:16:36.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.704+0000 7f2dd1695700 1 -- start start 2023-10-03T10:16:36.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7fad20c36700 1 -- 172.21.15.72:0/3769500046 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1c074ea0 con 0x7fad1c130540 2023-10-03T10:16:36.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7f2dd1695700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dcc06f680 0x7f2dcc11f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7f2dd1695700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dcc0701a0 0x7f2dcc11f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7f2dd1695700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dcc130670 0x7f2dcc11fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7f2dd1695700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc120580 con 0x7f2dcc06f680 2023-10-03T10:16:36.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7f2dd1695700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc12cfd0 con 0x7f2dcc130670 2023-10-03T10:16:36.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7f2dd1695700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc120dd0 con 0x7f2dcc0701a0 2023-10-03T10:16:36.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7f2dcb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dcc130670 0x7f2dcc11fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7f2dcb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dcc130670 0x7f2dcc11fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:57274/0 (socket says 172.21.15.72:57274) 2023-10-03T10:16:36.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7f2dcb7fe700 1 -- 172.21.15.72:0/3200094468 learned_addr learned my addr 172.21.15.72:0/3200094468 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:36.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7f2dcaffd700 1 --2- 172.21.15.72:0/3200094468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dcc06f680 0x7f2dcc11f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7f2dca7fc700 1 --2- 172.21.15.72:0/3200094468 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dcc0701a0 0x7f2dcc11f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7fad0affd700 1 -- 172.21.15.72:0/3769500046 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad10013470 con 0x7fad1c130540 2023-10-03T10:16:36.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.706+0000 7fad0affd700 1 -- 172.21.15.72:0/3769500046 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fad10040130 con 0x7fad1c130540 2023-10-03T10:16:36.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7f2dcb7fe700 1 -- 172.21.15.72:0/3200094468 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dcc0701a0 msgr2=0x7f2dcc11f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7f2dcb7fe700 1 --2- 172.21.15.72:0/3200094468 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dcc0701a0 0x7f2dcc11f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7f2dcb7fe700 1 -- 172.21.15.72:0/3200094468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dcc06f680 msgr2=0x7f2dcc11f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.705+0000 7f2dcb7fe700 1 --2- 172.21.15.72:0/3200094468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dcc06f680 0x7f2dcc11f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.706+0000 7f2dcb7fe700 1 -- 172.21.15.72:0/3200094468 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc00b7f0 con 0x7f2dcc130670 2023-10-03T10:16:36.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.706+0000 7f2dcb7fe700 1 --2- 172.21.15.72:0/3200094468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dcc130670 0x7f2dcc11fb30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400b680 tx=0x7f2dc4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.706+0000 7f2db37fe700 1 -- 172.21.15.72:0/3200094468 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4004920 con 0x7f2dcc130670 2023-10-03T10:16:36.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.706+0000 7f2db37fe700 1 -- 172.21.15.72:0/3200094468 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc4020070 con 0x7f2dcc130670 2023-10-03T10:16:36.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.706+0000 7f2dd1695700 1 -- 172.21.15.72:0/3200094468 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc4009a70 con 0x7f2dcc130670 2023-10-03T10:16:36.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.706+0000 7f2db37fe700 1 -- 172.21.15.72:0/3200094468 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc40276c0 con 0x7f2dcc130670 2023-10-03T10:16:36.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.706+0000 7f2dd1695700 1 -- 172.21.15.72:0/3200094468 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc1214b0 con 0x7f2dcc130670 2023-10-03T10:16:36.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.707+0000 7f2dd1695700 1 -- 172.21.15.72:0/3200094468 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dcc122740 con 0x7f2dcc130670 2023-10-03T10:16:36.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.707+0000 7f2db37fe700 1 -- 172.21.15.72:0/3200094468 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2dc4031470 con 0x7f2dcc130670 2023-10-03T10:16:36.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.707+0000 7f2db37fe700 1 -- 172.21.15.72:0/3200094468 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2dc4022070 con 0x7f2dcc130670 2023-10-03T10:16:36.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.712+0000 7f2db37fe700 1 -- 172.21.15.72:0/3200094468 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2dc402f750 con 0x7f2dcc130670 2023-10-03T10:16:36.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.714+0000 7fad0affd700 1 -- 172.21.15.72:0/3769500046 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad10024350 con 0x7fad1c130540 2023-10-03T10:16:36.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.788+0000 7fcaadfd6700 1 -- 172.21.15.72:0/2238671145 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcaa806c360 con 0x7fcaa809e1d0 2023-10-03T10:16:36.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.789+0000 7fca8ffff700 1 -- 172.21.15.72:0/2238671145 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca9c013e60 con 0x7fcaa809e1d0 2023-10-03T10:16:36.788 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:36.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.791+0000 7fcaadfd6700 1 -- 172.21.15.72:0/2238671145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcaa809e1d0 msgr2=0x7fcaa8120e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.791+0000 7fcaadfd6700 1 --2- 172.21.15.72:0/2238671145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcaa809e1d0 0x7fcaa8120e50 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00e9d0 tx=0x7fca9c00ece0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.791+0000 7fcaadfd6700 1 -- 172.21.15.72:0/2238671145 shutdown_connections 2023-10-03T10:16:36.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.791+0000 7fcaadfd6700 1 --2- 172.21.15.72:0/2238671145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcaa8139170 0x7fcaa8121390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.791+0000 7fcaadfd6700 1 --2- 172.21.15.72:0/2238671145 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcaa809d6f0 0x7fcaa8120910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.791+0000 7fcaadfd6700 1 --2- 172.21.15.72:0/2238671145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcaa809e1d0 0x7fcaa8120e50 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.791+0000 7fcaadfd6700 1 -- 172.21.15.72:0/2238671145 >> 172.21.15.72:0/2238671145 conn(0x7fcaa8066f50 msgr2=0x7fcaa809b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.791+0000 7fcaadfd6700 1 -- 172.21.15.72:0/2238671145 shutdown_connections 2023-10-03T10:16:36.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.791+0000 7fcaadfd6700 1 -- 172.21.15.72:0/2238671145 wait complete. 2023-10-03T10:16:36.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:36.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.906+0000 7f2dd1695700 1 -- 172.21.15.72:0/3200094468 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2dcc074ea0 con 0x7f2dcc130670 2023-10-03T10:16:36.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.907+0000 7f2db37fe700 1 -- 172.21.15.72:0/3200094468 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2dc4036090 con 0x7f2dcc130670 2023-10-03T10:16:36.907 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:36.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.907+0000 7fad20c36700 1 -- 172.21.15.72:0/3769500046 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad1c1351a0 con 0x7fad1c130540 2023-10-03T10:16:36.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.907+0000 7fad0affd700 1 -- 172.21.15.72:0/3769500046 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fad1002a090 con 0x7fad1c130540 2023-10-03T10:16:36.908 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:36.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7f2dd1695700 1 -- 172.21.15.72:0/3200094468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dcc130670 msgr2=0x7f2dcc11fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7f2dd1695700 1 --2- 172.21.15.72:0/3200094468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dcc130670 0x7f2dcc11fb30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400b680 tx=0x7f2dc4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7f2dd1695700 1 -- 172.21.15.72:0/3200094468 shutdown_connections 2023-10-03T10:16:36.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7f2dd1695700 1 --2- 172.21.15.72:0/3200094468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dcc06f680 0x7f2dcc11f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7f2dd1695700 1 --2- 172.21.15.72:0/3200094468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dcc130670 0x7f2dcc11fb30 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7fad20c36700 1 -- 172.21.15.72:0/3769500046 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad1c130540 msgr2=0x7fad1c139c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7fad20c36700 1 --2- 172.21.15.72:0/3769500046 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad1c130540 0x7fad1c139c90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fad1000ebe0 tx=0x7fad10009e50 comp rx=0 tx=0).stop 2023-10-03T10:16:36.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7f2dd1695700 1 --2- 172.21.15.72:0/3200094468 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2dcc0701a0 0x7f2dcc11f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7f2dd1695700 1 -- 172.21.15.72:0/3200094468 >> 172.21.15.72:0/3200094468 conn(0x7f2dcc0a2aa0 msgr2=0x7f2dcc12e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7fad20c36700 1 -- 172.21.15.72:0/3769500046 shutdown_connections 2023-10-03T10:16:36.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7fad20c36700 1 --2- 172.21.15.72:0/3769500046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad1c130e50 0x7fad1c13a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7fad20c36700 1 --2- 172.21.15.72:0/3769500046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad1c06fb20 0x7fad1c1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7fad20c36700 1 --2- 172.21.15.72:0/3769500046 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad1c130540 0x7fad1c139c90 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7fad20c36700 1 -- 172.21.15.72:0/3769500046 >> 172.21.15.72:0/3769500046 conn(0x7fad1c0a2aa0 msgr2=0x7fad1c06e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7f2dd1695700 1 -- 172.21.15.72:0/3200094468 shutdown_connections 2023-10-03T10:16:36.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7f2dd1695700 1 -- 172.21.15.72:0/3200094468 wait complete. 2023-10-03T10:16:36.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7fad20c36700 1 -- 172.21.15.72:0/3769500046 shutdown_connections 2023-10-03T10:16:36.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:36.909+0000 7fad20c36700 1 -- 172.21.15.72:0/3769500046 wait complete. 2023-10-03T10:16:36.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:36.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:37.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:37.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.515+0000 7f98b9331700 1 Processor -- start 2023-10-03T10:16:37.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.515+0000 7f98b9331700 1 -- start start 2023-10-03T10:16:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.515+0000 7f98b9331700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98b409d630 0x7f98b40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.515+0000 7f98b9331700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98b4138d80 0x7f98b413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.515+0000 7f98b9331700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b40a2a70 con 0x7f98b40a0a30 2023-10-03T10:16:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.515+0000 7f98b9331700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b40a01d0 con 0x7f98b4138d80 2023-10-03T10:16:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.515+0000 7f98b9331700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98b409e2b0 con 0x7f98b409d630 2023-10-03T10:16:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.516+0000 7f98b37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98b4138d80 0x7f98b413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.516+0000 7f98b37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98b4138d80 0x7f98b413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60374/0 (socket says 172.21.15.72:60374) 2023-10-03T10:16:37.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.516+0000 7f98b37fe700 1 -- 172.21.15.72:0/3280129704 learned_addr learned my addr 172.21.15.72:0/3280129704 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.516+0000 7f98b27fc700 1 --2- 172.21.15.72:0/3280129704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98b409d630 0x7f98b40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.516+0000 7f98b27fc700 1 -- 172.21.15.72:0/3280129704 >> v2:172.21.15.72:3300/0 conn(0x7f98b4138d80 msgr2=0x7f98b413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.516+0000 7f98b27fc700 1 --2- 172.21.15.72:0/3280129704 >> v2:172.21.15.72:3300/0 conn(0x7f98b4138d80 0x7f98b413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.516+0000 7f98b27fc700 1 -- 172.21.15.72:0/3280129704 >> v1:172.21.15.72:6789/0 conn(0x7f98b40a0a30 legacy=0x7f98b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.516+0000 7f98b27fc700 1 -- 172.21.15.72:0/3280129704 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b409dc50 con 0x7f98b409d630 2023-10-03T10:16:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.516+0000 7f98b37fe700 1 --2- 172.21.15.72:0/3280129704 >> v2:172.21.15.72:3300/0 conn(0x7f98b4138d80 0x7f98b413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.516+0000 7f98b27fc700 1 --2- 172.21.15.72:0/3280129704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98b409d630 0x7f98b40a1510 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009840 tx=0x7f98a4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3737ca1082879635 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.516+0000 7f98b1ffb700 1 -- 172.21.15.72:0/3280129704 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4011830 con 0x7f98b409d630 2023-10-03T10:16:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.516+0000 7f98b1ffb700 1 -- 172.21.15.72:0/3280129704 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a4011990 con 0x7f98b409d630 2023-10-03T10:16:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.516+0000 7f98b1ffb700 1 -- 172.21.15.72:0/3280129704 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4011d20 con 0x7f98b409d630 2023-10-03T10:16:37.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.517+0000 7f98b9331700 1 -- 172.21.15.72:0/3280129704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98b409d630 msgr2=0x7f98b40a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.517+0000 7f98b9331700 1 --2- 172.21.15.72:0/3280129704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98b409d630 0x7f98b40a1510 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009840 tx=0x7f98a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.517+0000 7f98b9331700 1 -- 172.21.15.72:0/3280129704 shutdown_connections 2023-10-03T10:16:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.517+0000 7f98b9331700 1 --2- 172.21.15.72:0/3280129704 >> v2:172.21.15.72:3300/0 conn(0x7f98b4138d80 0x7f98b413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.517+0000 7f98b9331700 1 --2- 172.21.15.72:0/3280129704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98b409d630 0x7f98b40a1510 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.517+0000 7f98b9331700 1 -- 172.21.15.72:0/3280129704 >> 172.21.15.72:0/3280129704 conn(0x7f98b40a3050 msgr2=0x7f98b40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.517+0000 7f98b9331700 1 -- 172.21.15.72:0/3280129704 shutdown_connections 2023-10-03T10:16:37.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.517+0000 7f98b9331700 1 -- 172.21.15.72:0/3280129704 wait complete. 2023-10-03T10:16:37.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.518+0000 7f98b9331700 1 Processor -- start 2023-10-03T10:16:37.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.518+0000 7f98b9331700 1 -- start start 2023-10-03T10:16:37.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.518+0000 7f98b9331700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b409d630 0x7f98b4133b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.518+0000 7f98b9331700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98b40a0a30 0x7f98b4134090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.518+0000 7f98b9331700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98b4138d80 0x7f98b41345d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.518+0000 7f98b9331700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b4135010 con 0x7f98b409d630 2023-10-03T10:16:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.518+0000 7f98b9331700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b413afc0 con 0x7f98b4138d80 2023-10-03T10:16:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.518+0000 7f98b9331700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98b4135c30 con 0x7f98b40a0a30 2023-10-03T10:16:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.518+0000 7f98b2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b409d630 0x7f98b4133b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.518+0000 7f98b37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98b4138d80 0x7f98b41345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.518+0000 7f98b27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98b40a0a30 0x7f98b4134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.518+0000 7f98b2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b409d630 0x7f98b4133b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60378/0 (socket says 172.21.15.72:60378) 2023-10-03T10:16:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.518+0000 7f98b2ffd700 1 -- 172.21.15.72:0/3313957504 learned_addr learned my addr 172.21.15.72:0/3313957504 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.519+0000 7f98b2ffd700 1 -- 172.21.15.72:0/3313957504 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98b40a0a30 msgr2=0x7f98b4134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.519+0000 7f98b2ffd700 1 --2- 172.21.15.72:0/3313957504 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98b40a0a30 0x7f98b4134090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.519+0000 7f98b2ffd700 1 -- 172.21.15.72:0/3313957504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98b4138d80 msgr2=0x7f98b41345d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.519+0000 7f98b2ffd700 1 --2- 172.21.15.72:0/3313957504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98b4138d80 0x7f98b41345d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.519+0000 7f98b2ffd700 1 -- 172.21.15.72:0/3313957504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac009b30 con 0x7f98b409d630 2023-10-03T10:16:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.519+0000 7f98b27fc700 1 --2- 172.21.15.72:0/3313957504 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98b40a0a30 0x7f98b4134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.519+0000 7f98b37fe700 1 --2- 172.21.15.72:0/3313957504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98b4138d80 0x7f98b41345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.519+0000 7f98b2ffd700 1 --2- 172.21.15.72:0/3313957504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b409d630 0x7f98b4133b50 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f98a800c510 tx=0x7f98a800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.519+0000 7f989b7fe700 1 -- 172.21.15.72:0/3313957504 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a80052d0 con 0x7f98b409d630 2023-10-03T10:16:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.519+0000 7f989b7fe700 1 -- 172.21.15.72:0/3313957504 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a8005430 con 0x7f98b409d630 2023-10-03T10:16:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.519+0000 7f989b7fe700 1 -- 172.21.15.72:0/3313957504 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a80038c0 con 0x7f98b409d630 2023-10-03T10:16:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.519+0000 7f98b9331700 1 -- 172.21.15.72:0/3313957504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a40094a0 con 0x7f98b409d630 2023-10-03T10:16:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.519+0000 7f98b9331700 1 -- 172.21.15.72:0/3313957504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b4137590 con 0x7f98b409d630 2023-10-03T10:16:37.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.520+0000 7f989b7fe700 1 -- 172.21.15.72:0/3313957504 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f98a8003a20 con 0x7f98b409d630 2023-10-03T10:16:37.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.520+0000 7f989b7fe700 1 -- 172.21.15.72:0/3313957504 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f98a803ea60 con 0x7f98b409d630 2023-10-03T10:16:37.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.520+0000 7f98b9331700 1 -- 172.21.15.72:0/3313957504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b40747f0 con 0x7f98b409d630 2023-10-03T10:16:37.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.525+0000 7f989b7fe700 1 -- 172.21.15.72:0/3313957504 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f98a8017020 con 0x7f98b409d630 2023-10-03T10:16:37.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.713+0000 7f98b9331700 1 -- 172.21.15.72:0/3313957504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f98b4072980 con 0x7f98b409d630 2023-10-03T10:16:37.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.714+0000 7f989b7fe700 1 -- 172.21.15.72:0/3313957504 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f98a8018260 con 0x7f98b409d630 2023-10-03T10:16:37.713 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:37.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.716+0000 7f98b9331700 1 -- 172.21.15.72:0/3313957504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b409d630 msgr2=0x7f98b4133b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.716+0000 7f98b9331700 1 --2- 172.21.15.72:0/3313957504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b409d630 0x7f98b4133b50 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f98a800c510 tx=0x7f98a800c820 comp rx=0 tx=0).stop 2023-10-03T10:16:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.716+0000 7f98b9331700 1 -- 172.21.15.72:0/3313957504 shutdown_connections 2023-10-03T10:16:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.716+0000 7f98b9331700 1 --2- 172.21.15.72:0/3313957504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98b409d630 0x7f98b4133b50 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.716+0000 7f98b9331700 1 --2- 172.21.15.72:0/3313957504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98b4138d80 0x7f98b41345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.716+0000 7f98b9331700 1 --2- 172.21.15.72:0/3313957504 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f98b40a0a30 0x7f98b4134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.716+0000 7f98b9331700 1 -- 172.21.15.72:0/3313957504 >> 172.21.15.72:0/3313957504 conn(0x7f98b40a3050 msgr2=0x7f98b409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.716+0000 7f98b9331700 1 -- 172.21.15.72:0/3313957504 shutdown_connections 2023-10-03T10:16:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.716+0000 7f98b9331700 1 -- 172.21.15.72:0/3313957504 wait complete. 2023-10-03T10:16:37.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:37.804 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:37.923 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:37.923 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:37.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.927+0000 7fc609bce700 1 Processor -- start 2023-10-03T10:16:37.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.927+0000 7fc609bce700 1 -- start start 2023-10-03T10:16:37.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.928+0000 7fc609bce700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc60412cf60 0x7fc60406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.928+0000 7fc609bce700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc604130430 0x7fc604137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.928+0000 7fc609bce700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60412cd90 con 0x7fc60412f8b0 2023-10-03T10:16:37.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.928+0000 7fc609bce700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60412d330 con 0x7fc604130430 2023-10-03T10:16:37.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.928+0000 7fc609bce700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc604071780 con 0x7fc60412cf60 2023-10-03T10:16:37.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.928+0000 7fc6037fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc60412cf60 0x7fc60406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.928+0000 7fc603fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc604130430 0x7fc604137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.928+0000 7fc6037fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc60412cf60 0x7fc60406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:57280/0 (socket says 172.21.15.72:57280) 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.928+0000 7fc6037fe700 1 -- 172.21.15.72:0/4271645618 learned_addr learned my addr 172.21.15.72:0/4271645618 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.928+0000 7fc6037fe700 1 -- 172.21.15.72:0/4271645618 >> v2:172.21.15.72:3300/0 conn(0x7fc604130430 msgr2=0x7fc604137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.928+0000 7fc6037fe700 1 --2- 172.21.15.72:0/4271645618 >> v2:172.21.15.72:3300/0 conn(0x7fc604130430 0x7fc604137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.928+0000 7fc6037fe700 1 -- 172.21.15.72:0/4271645618 >> v1:172.21.15.72:6789/0 conn(0x7fc60412f8b0 legacy=0x7fc60412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.928+0000 7fc6037fe700 1 -- 172.21.15.72:0/4271645618 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604071a40 con 0x7fc60412cf60 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.929+0000 7fc603fff700 1 --2- 172.21.15.72:0/4271645618 >> v2:172.21.15.72:3300/0 conn(0x7fc604130430 0x7fc604137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.929+0000 7fc6037fe700 1 --2- 172.21.15.72:0/4271645618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc60412cf60 0x7fc60406f5d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400aa90 tx=0x7fc5f400ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=793e16b1d1916a10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.929+0000 7fc6027fc700 1 -- 172.21.15.72:0/4271645618 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f400cb70 con 0x7fc60412cf60 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.929+0000 7fc6027fc700 1 -- 172.21.15.72:0/4271645618 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f400ccd0 con 0x7fc60412cf60 2023-10-03T10:16:37.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.929+0000 7fc6027fc700 1 -- 172.21.15.72:0/4271645618 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4018620 con 0x7fc60412cf60 2023-10-03T10:16:37.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.930+0000 7fc609bce700 1 -- 172.21.15.72:0/4271645618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc60412cf60 msgr2=0x7fc60406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.930+0000 7fc609bce700 1 --2- 172.21.15.72:0/4271645618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc60412cf60 0x7fc60406f5d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400aa90 tx=0x7fc5f400ada0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.930+0000 7fc609bce700 1 -- 172.21.15.72:0/4271645618 shutdown_connections 2023-10-03T10:16:37.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.930+0000 7fc609bce700 1 --2- 172.21.15.72:0/4271645618 >> v2:172.21.15.72:3300/0 conn(0x7fc604130430 0x7fc604137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.930+0000 7fc609bce700 1 --2- 172.21.15.72:0/4271645618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc60412cf60 0x7fc60406f5d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.930+0000 7fc609bce700 1 -- 172.21.15.72:0/4271645618 >> 172.21.15.72:0/4271645618 conn(0x7fc6040a2aa0 msgr2=0x7fc6040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.930+0000 7fc609bce700 1 -- 172.21.15.72:0/4271645618 shutdown_connections 2023-10-03T10:16:37.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.930+0000 7fc609bce700 1 -- 172.21.15.72:0/4271645618 wait complete. 2023-10-03T10:16:37.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.931+0000 7fc609bce700 1 Processor -- start 2023-10-03T10:16:37.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.931+0000 7fc609bce700 1 -- start start 2023-10-03T10:16:37.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.931+0000 7fc609bce700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc60412cf60 0x7fc6041c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc609bce700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc60412f8b0 0x7fc6041c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc609bce700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc604130430 0x7fc60409b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc609bce700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6041b90b0 con 0x7fc60412cf60 2023-10-03T10:16:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc609bce700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc604129fa0 con 0x7fc60412f8b0 2023-10-03T10:16:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc609bce700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6041298c0 con 0x7fc604130430 2023-10-03T10:16:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc602ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc60412f8b0 0x7fc6041c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc603fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc604130430 0x7fc60409b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc603fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc604130430 0x7fc60409b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47786/0 (socket says 172.21.15.72:47786) 2023-10-03T10:16:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc602ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc60412f8b0 0x7fc6041c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:57290/0 (socket says 172.21.15.72:57290) 2023-10-03T10:16:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc603fff700 1 -- 172.21.15.72:0/2534531679 learned_addr learned my addr 172.21.15.72:0/2534531679 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc6037fe700 1 --2- 172.21.15.72:0/2534531679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc60412cf60 0x7fc6041c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc602ffd700 1 -- 172.21.15.72:0/2534531679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc604130430 msgr2=0x7fc60409b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc602ffd700 1 --2- 172.21.15.72:0/2534531679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc604130430 0x7fc60409b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc602ffd700 1 -- 172.21.15.72:0/2534531679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc60412cf60 msgr2=0x7fc6041c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc602ffd700 1 --2- 172.21.15.72:0/2534531679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc60412cf60 0x7fc6041c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc602ffd700 1 -- 172.21.15.72:0/2534531679 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc009a70 con 0x7fc60412f8b0 2023-10-03T10:16:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc602ffd700 1 --2- 172.21.15.72:0/2534531679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc60412f8b0 0x7fc6041c49c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8000f60 tx=0x7fc5f800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc5ebfff700 1 -- 172.21.15.72:0/2534531679 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f80050d0 con 0x7fc60412f8b0 2023-10-03T10:16:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc5ebfff700 1 -- 172.21.15.72:0/2534531679 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f8005230 con 0x7fc60412f8b0 2023-10-03T10:16:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc609bce700 1 -- 172.21.15.72:0/2534531679 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f400a6f0 con 0x7fc60412f8b0 2023-10-03T10:16:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.932+0000 7fc5ebfff700 1 -- 172.21.15.72:0/2534531679 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8003680 con 0x7fc60412f8b0 2023-10-03T10:16:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.933+0000 7fc609bce700 1 -- 172.21.15.72:0/2534531679 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60409e510 con 0x7fc60412f8b0 2023-10-03T10:16:37.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.933+0000 7fc5ebfff700 1 -- 172.21.15.72:0/2534531679 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5f80037e0 con 0x7fc60412f8b0 2023-10-03T10:16:37.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.934+0000 7fc5ebfff700 1 -- 172.21.15.72:0/2534531679 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc5f803e9a0 con 0x7fc60412f8b0 2023-10-03T10:16:37.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.934+0000 7fc609bce700 1 -- 172.21.15.72:0/2534531679 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60409e6a0 con 0x7fc60412f8b0 2023-10-03T10:16:37.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:37.939+0000 7fc5ebfff700 1 -- 172.21.15.72:0/2534531679 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5f8011590 con 0x7fc60412f8b0 2023-10-03T10:16:38.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.057+0000 7f7204582700 1 Processor -- start 2023-10-03T10:16:38.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.057+0000 7fc4a182b700 1 Processor -- start 2023-10-03T10:16:38.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.057+0000 7f7204582700 1 -- start start 2023-10-03T10:16:38.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.057+0000 7fc4a182b700 1 -- start start 2023-10-03T10:16:38.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.057+0000 7fc4a182b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc49c134630 0x7fc49c136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.057+0000 7fc4a182b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc49c136f50 0x7fc49c139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.057+0000 7fc4a182b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49c09b4f0 con 0x7fc49c131810 2023-10-03T10:16:38.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.057+0000 7fc4a182b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49c1313c0 con 0x7fc49c134630 2023-10-03T10:16:38.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.057+0000 7fc4a182b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c06e8c0 con 0x7fc49c136f50 2023-10-03T10:16:38.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.057+0000 7fc49a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc49c134630 0x7fc49c136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.057+0000 7fc49a7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc49c134630 0x7fc49c136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60408/0 (socket says 172.21.15.72:60408) 2023-10-03T10:16:38.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.057+0000 7fc49a7fc700 1 -- 172.21.15.72:0/191884746 learned_addr learned my addr 172.21.15.72:0/191884746 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:38.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f7204582700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71fc09d6f0 0x7f71fc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f7204582700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71fc09e000 0x7f71fc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f7204582700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71fc09e410 0x7f71fc133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f7204582700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71fc06b460 con 0x7f71fc09d6f0 2023-10-03T10:16:38.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f7204582700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc09b120 con 0x7f71fc09e000 2023-10-03T10:16:38.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f7204582700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc09a7e0 con 0x7f71fc09e410 2023-10-03T10:16:38.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f720231e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71fc09d6f0 0x7f71fc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f720231e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f71fc09d6f0 0x7f71fc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:60420/0 (socket says 172.21.15.72:60420) 2023-10-03T10:16:38.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f720231e700 1 -- 172.21.15.72:0/290911785 learned_addr learned my addr 172.21.15.72:0/290911785 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:38.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7fc49b7fe700 1 --2- 172.21.15.72:0/191884746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc49c136f50 0x7fc49c139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7fc49a7fc700 1 -- 172.21.15.72:0/191884746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc49c136f50 msgr2=0x7fc49c139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f7202b1f700 1 --2- 172.21.15.72:0/290911785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71fc09e410 0x7f71fc133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7fc49a7fc700 1 --2- 172.21.15.72:0/191884746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc49c136f50 0x7fc49c139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7fc49a7fc700 1 -- 172.21.15.72:0/191884746 >> v1:172.21.15.72:6789/0 conn(0x7fc49c131810 legacy=0x7fc49c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7fc49a7fc700 1 -- 172.21.15.72:0/191884746 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c071d20 con 0x7fc49c134630 2023-10-03T10:16:38.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7fc499ffb700 1 -- 172.21.15.72:0/191884746 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105001767 0 0) 0x7fc49c09b4f0 con 0x7fc49c131810 2023-10-03T10:16:38.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7fc49b7fe700 1 --2- 172.21.15.72:0/191884746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc49c136f50 0x7fc49c139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:38.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f720231e700 1 -- 172.21.15.72:0/290911785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71fc09e410 msgr2=0x7f71fc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f720231e700 1 --2- 172.21.15.72:0/290911785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71fc09e410 0x7f71fc133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f720231e700 1 -- 172.21.15.72:0/290911785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71fc09e000 msgr2=0x7f71fc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f720231e700 1 --2- 172.21.15.72:0/290911785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71fc09e000 0x7f71fc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f720231e700 1 -- 172.21.15.72:0/290911785 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc09a500 con 0x7f71fc09d6f0 2023-10-03T10:16:38.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7fc49a7fc700 1 --2- 172.21.15.72:0/191884746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc49c134630 0x7fc49c136a10 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc4900098f0 tx=0x7fc490009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651965523831efa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f720231e700 1 --2- 172.21.15.72:0/290911785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc09d6f0 0x7f71fc09dac0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f71f80098f0 tx=0x7f71f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3270bc23c4dd8572 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7fc499ffb700 1 -- 172.21.15.72:0/191884746 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49000b8a0 con 0x7fc49c134630 2023-10-03T10:16:38.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7fc499ffb700 1 -- 172.21.15.72:0/191884746 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49000ba00 con 0x7fc49c134630 2023-10-03T10:16:38.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7fc499ffb700 1 -- 172.21.15.72:0/191884746 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49000bd90 con 0x7fc49c134630 2023-10-03T10:16:38.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.058+0000 7f720131c700 1 -- 172.21.15.72:0/290911785 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f8011830 con 0x7f71fc09d6f0 2023-10-03T10:16:38.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7f720131c700 1 -- 172.21.15.72:0/290911785 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f8011990 con 0x7f71fc09d6f0 2023-10-03T10:16:38.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7f720131c700 1 -- 172.21.15.72:0/290911785 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f8011d20 con 0x7f71fc09d6f0 2023-10-03T10:16:38.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7fc4a182b700 1 -- 172.21.15.72:0/191884746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc49c134630 msgr2=0x7fc49c136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7fc4a182b700 1 --2- 172.21.15.72:0/191884746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc49c134630 0x7fc49c136a10 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc4900098f0 tx=0x7fc490009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:38.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7fc4a182b700 1 -- 172.21.15.72:0/191884746 shutdown_connections 2023-10-03T10:16:38.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7f7204582700 1 -- 172.21.15.72:0/290911785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc09d6f0 msgr2=0x7f71fc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7fc4a182b700 1 --2- 172.21.15.72:0/191884746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc49c136f50 0x7fc49c139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7fc4a182b700 1 --2- 172.21.15.72:0/191884746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc49c134630 0x7fc49c136a10 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7fc4a182b700 1 -- 172.21.15.72:0/191884746 >> 172.21.15.72:0/191884746 conn(0x7fc49c0a2aa0 msgr2=0x7fc49c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7f7204582700 1 --2- 172.21.15.72:0/290911785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc09d6f0 0x7f71fc09dac0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f71f80098f0 tx=0x7f71f8009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:38.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7fc4a182b700 1 -- 172.21.15.72:0/191884746 shutdown_connections 2023-10-03T10:16:38.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7fc4a182b700 1 -- 172.21.15.72:0/191884746 wait complete. 2023-10-03T10:16:38.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7f7204582700 1 -- 172.21.15.72:0/290911785 shutdown_connections 2023-10-03T10:16:38.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7f7204582700 1 --2- 172.21.15.72:0/290911785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71fc09e410 0x7f71fc133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7f7204582700 1 --2- 172.21.15.72:0/290911785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc09d6f0 0x7f71fc09dac0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7f7204582700 1 --2- 172.21.15.72:0/290911785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71fc09e000 0x7f71fc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7f7204582700 1 -- 172.21.15.72:0/290911785 >> 172.21.15.72:0/290911785 conn(0x7f71fc066f50 msgr2=0x7f71fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7f7204582700 1 -- 172.21.15.72:0/290911785 shutdown_connections 2023-10-03T10:16:38.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.059+0000 7f7204582700 1 -- 172.21.15.72:0/290911785 wait complete. 2023-10-03T10:16:38.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.060+0000 7fc4a182b700 1 Processor -- start 2023-10-03T10:16:38.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.060+0000 7f7204582700 1 Processor -- start 2023-10-03T10:16:38.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.060+0000 7f7204582700 1 -- start start 2023-10-03T10:16:38.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.060+0000 7fc4a182b700 1 -- start start 2023-10-03T10:16:38.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f7204582700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71fc09d6f0 0x7f71fc1c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f7204582700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71fc09e000 0x7f71fc1c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f7204582700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc09e410 0x7f71fc1c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f7204582700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc1a5580 con 0x7f71fc09e410 2023-10-03T10:16:38.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f7204582700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc0a20c0 con 0x7f71fc09d6f0 2023-10-03T10:16:38.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f7204582700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc1a6d30 con 0x7f71fc09e000 2023-10-03T10:16:38.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7fc4a182b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc49c131810 0x7fc49c1c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7fc4a182b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc49c134630 0x7fc49c1c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7fc4a182b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc49c136f50 0x7fc49c118d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7fc4a182b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c1bc030 con 0x7fc49c131810 2023-10-03T10:16:38.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7fc4a182b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c11ca70 con 0x7fc49c134630 2023-10-03T10:16:38.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7fc4a182b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c11c5e0 con 0x7fc49c136f50 2023-10-03T10:16:38.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f720231e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71fc09d6f0 0x7f71fc1c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f7201b1d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71fc09e000 0x7f71fc1c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f720231e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71fc09d6f0 0x7f71fc1c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:57332/0 (socket says 172.21.15.72:57332) 2023-10-03T10:16:38.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f720231e700 1 -- 172.21.15.72:0/2699882219 learned_addr learned my addr 172.21.15.72:0/2699882219 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:38.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f7202b1f700 1 --2- 172.21.15.72:0/2699882219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc09e410 0x7f71fc1c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7fc49b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc49c136f50 0x7fc49c118d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7fc49b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc49c136f50 0x7fc49c118d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47814/0 (socket says 172.21.15.72:47814) 2023-10-03T10:16:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7fc49b7fe700 1 -- 172.21.15.72:0/3227180292 learned_addr learned my addr 172.21.15.72:0/3227180292 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f720231e700 1 -- 172.21.15.72:0/2699882219 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71fc09e000 msgr2=0x7f71fc1c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f720231e700 1 --2- 172.21.15.72:0/2699882219 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71fc09e000 0x7f71fc1c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f720231e700 1 -- 172.21.15.72:0/2699882219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc09e410 msgr2=0x7f71fc1c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f720231e700 1 --2- 172.21.15.72:0/2699882219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc09e410 0x7f71fc1c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f720231e700 1 -- 172.21.15.72:0/2699882219 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f8009550 con 0x7f71fc09d6f0 2023-10-03T10:16:38.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7f7202b1f700 1 --2- 172.21.15.72:0/2699882219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc09e410 0x7f71fc1c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7fc49a7fc700 1 --2- 172.21.15.72:0/3227180292 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc49c134630 0x7fc49c1c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7fc49b7fe700 1 -- 172.21.15.72:0/3227180292 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc49c134630 msgr2=0x7fc49c1c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7fc49b7fe700 1 --2- 172.21.15.72:0/3227180292 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc49c134630 0x7fc49c1c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7fc49b7fe700 1 -- 172.21.15.72:0/3227180292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc49c131810 msgr2=0x7fc49c1c6490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7fc49b7fe700 1 --2- 172.21.15.72:0/3227180292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc49c131810 0x7fc49c1c6490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.061+0000 7fc49b7fe700 1 -- 172.21.15.72:0/3227180292 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc490009550 con 0x7fc49c136f50 2023-10-03T10:16:38.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.062+0000 7f720231e700 1 --2- 172.21.15.72:0/2699882219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71fc09d6f0 0x7f71fc1c8170 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009c40 tx=0x7f71f8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.062+0000 7fc49b7fe700 1 --2- 172.21.15.72:0/3227180292 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc49c136f50 0x7fc49c118d50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc49400ce80 tx=0x7fc49400ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.062+0000 7f71f2ffd700 1 -- 172.21.15.72:0/2699882219 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f8004240 con 0x7f71fc09d6f0 2023-10-03T10:16:38.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.062+0000 7fc483fff700 1 -- 172.21.15.72:0/3227180292 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49400ad70 con 0x7fc49c136f50 2023-10-03T10:16:38.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.062+0000 7fc483fff700 1 -- 172.21.15.72:0/3227180292 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc494015440 con 0x7fc49c136f50 2023-10-03T10:16:38.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.062+0000 7fc483fff700 1 -- 172.21.15.72:0/3227180292 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4940157f0 con 0x7fc49c136f50 2023-10-03T10:16:38.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.062+0000 7fc4a182b700 1 -- 172.21.15.72:0/3227180292 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49c130ec0 con 0x7fc49c136f50 2023-10-03T10:16:38.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.062+0000 7f71f2ffd700 1 -- 172.21.15.72:0/2699882219 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f801f070 con 0x7f71fc09d6f0 2023-10-03T10:16:38.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.062+0000 7f71f2ffd700 1 -- 172.21.15.72:0/2699882219 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f80045a0 con 0x7f71fc09d6f0 2023-10-03T10:16:38.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.062+0000 7f7204582700 1 -- 172.21.15.72:0/2699882219 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71fc09c710 con 0x7f71fc09d6f0 2023-10-03T10:16:38.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.062+0000 7f7204582700 1 -- 172.21.15.72:0/2699882219 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71fc1a6030 con 0x7f71fc09d6f0 2023-10-03T10:16:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.062+0000 7fc4a182b700 1 -- 172.21.15.72:0/3227180292 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49c11c290 con 0x7fc49c136f50 2023-10-03T10:16:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.063+0000 7f71f2ffd700 1 -- 172.21.15.72:0/2699882219 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71f8021030 con 0x7f71fc09d6f0 2023-10-03T10:16:38.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.063+0000 7f71f2ffd700 1 -- 172.21.15.72:0/2699882219 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f71f8040a00 con 0x7f71fc09d6f0 2023-10-03T10:16:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.063+0000 7f7204582700 1 -- 172.21.15.72:0/2699882219 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71fc1a6f50 con 0x7f71fc09d6f0 2023-10-03T10:16:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.063+0000 7fc4a182b700 1 -- 172.21.15.72:0/3227180292 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49c0721a0 con 0x7fc49c136f50 2023-10-03T10:16:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.064+0000 7fc483fff700 1 -- 172.21.15.72:0/3227180292 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc49400d430 con 0x7fc49c136f50 2023-10-03T10:16:38.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.064+0000 7fc483fff700 1 -- 172.21.15.72:0/3227180292 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc494040080 con 0x7fc49c136f50 2023-10-03T10:16:38.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.068+0000 7f71f2ffd700 1 -- 172.21.15.72:0/2699882219 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71f8015020 con 0x7f71fc09d6f0 2023-10-03T10:16:38.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.068+0000 7fc483fff700 1 -- 172.21.15.72:0/3227180292 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc494008910 con 0x7fc49c136f50 2023-10-03T10:16:38.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.136+0000 7fc609bce700 1 -- 172.21.15.72:0/2534531679 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc604074ea0 con 0x7fc60412f8b0 2023-10-03T10:16:38.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.136+0000 7fc5ebfff700 1 -- 172.21.15.72:0/2534531679 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5f80192c0 con 0x7fc60412f8b0 2023-10-03T10:16:38.136 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:38.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.139+0000 7fc609bce700 1 -- 172.21.15.72:0/2534531679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc60412f8b0 msgr2=0x7fc6041c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.139+0000 7fc609bce700 1 --2- 172.21.15.72:0/2534531679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc60412f8b0 0x7fc6041c49c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8000f60 tx=0x7fc5f800c730 comp rx=0 tx=0).stop 2023-10-03T10:16:38.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.139+0000 7fc609bce700 1 -- 172.21.15.72:0/2534531679 shutdown_connections 2023-10-03T10:16:38.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.139+0000 7fc609bce700 1 --2- 172.21.15.72:0/2534531679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc60412cf60 0x7fc6041c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.139+0000 7fc609bce700 1 --2- 172.21.15.72:0/2534531679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc604130430 0x7fc60409b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.139+0000 7fc609bce700 1 --2- 172.21.15.72:0/2534531679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc60412f8b0 0x7fc6041c49c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.139+0000 7fc609bce700 1 -- 172.21.15.72:0/2534531679 >> 172.21.15.72:0/2534531679 conn(0x7fc6040a2aa0 msgr2=0x7fc60406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.139+0000 7fc609bce700 1 -- 172.21.15.72:0/2534531679 shutdown_connections 2023-10-03T10:16:38.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.139+0000 7fc609bce700 1 -- 172.21.15.72:0/2534531679 wait complete. 2023-10-03T10:16:38.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:38.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.258+0000 7f7204582700 1 -- 172.21.15.72:0/2699882219 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f71fc074ea0 con 0x7f71fc09d6f0 2023-10-03T10:16:38.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.258+0000 7f71f2ffd700 1 -- 172.21.15.72:0/2699882219 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f71f80036a0 con 0x7f71fc09d6f0 2023-10-03T10:16:38.258 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:38.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.260+0000 7fc4a182b700 1 -- 172.21.15.72:0/3227180292 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc49c06e6b0 con 0x7fc49c136f50 2023-10-03T10:16:38.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.260+0000 7f7204582700 1 -- 172.21.15.72:0/2699882219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71fc09d6f0 msgr2=0x7f71fc1c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.260+0000 7f7204582700 1 --2- 172.21.15.72:0/2699882219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71fc09d6f0 0x7f71fc1c8170 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009c40 tx=0x7f71f8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:38.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.260+0000 7fc483fff700 1 -- 172.21.15.72:0/3227180292 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc49401a030 con 0x7fc49c136f50 2023-10-03T10:16:38.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.260+0000 7f7204582700 1 -- 172.21.15.72:0/2699882219 shutdown_connections 2023-10-03T10:16:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.260+0000 7f7204582700 1 --2- 172.21.15.72:0/2699882219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71fc09e410 0x7f71fc1c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.260+0000 7f7204582700 1 --2- 172.21.15.72:0/2699882219 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71fc09d6f0 0x7f71fc1c8170 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.260+0000 7f7204582700 1 --2- 172.21.15.72:0/2699882219 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f71fc09e000 0x7f71fc1c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.260+0000 7f7204582700 1 -- 172.21.15.72:0/2699882219 >> 172.21.15.72:0/2699882219 conn(0x7f71fc066f50 msgr2=0x7f71fc1bbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.261 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:38.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.260+0000 7f7204582700 1 -- 172.21.15.72:0/2699882219 shutdown_connections 2023-10-03T10:16:38.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.260+0000 7f7204582700 1 -- 172.21.15.72:0/2699882219 wait complete. 2023-10-03T10:16:38.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.262+0000 7fc4a182b700 1 -- 172.21.15.72:0/3227180292 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc49c136f50 msgr2=0x7fc49c118d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.262+0000 7fc4a182b700 1 --2- 172.21.15.72:0/3227180292 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc49c136f50 0x7fc49c118d50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc49400ce80 tx=0x7fc49400ceb0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.262+0000 7fc4a182b700 1 -- 172.21.15.72:0/3227180292 shutdown_connections 2023-10-03T10:16:38.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.262+0000 7fc4a182b700 1 --2- 172.21.15.72:0/3227180292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc49c131810 0x7fc49c1c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.262+0000 7fc4a182b700 1 --2- 172.21.15.72:0/3227180292 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc49c136f50 0x7fc49c118d50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.262+0000 7fc4a182b700 1 --2- 172.21.15.72:0/3227180292 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc49c134630 0x7fc49c1c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.262+0000 7fc4a182b700 1 -- 172.21.15.72:0/3227180292 >> 172.21.15.72:0/3227180292 conn(0x7fc49c0a2aa0 msgr2=0x7fc49c099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.263+0000 7fc4a182b700 1 -- 172.21.15.72:0/3227180292 shutdown_connections 2023-10-03T10:16:38.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.263+0000 7fc4a182b700 1 -- 172.21.15.72:0/3227180292 wait complete. 2023-10-03T10:16:38.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:38.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:38.729 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:38.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.852+0000 7f300f866700 1 Processor -- start 2023-10-03T10:16:38.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.853+0000 7f300f866700 1 -- start start 2023-10-03T10:16:38.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.853+0000 7f300f866700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f300809d6f0 0x7f300809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.853+0000 7f300f866700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f300809e410 0x7f3008130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.853+0000 7f300f866700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300809f130 con 0x7f300809e000 2023-10-03T10:16:38.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.853+0000 7f300f866700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300809f520 con 0x7f300809d6f0 2023-10-03T10:16:38.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.853+0000 7f300f866700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f300809e930 con 0x7f300809e410 2023-10-03T10:16:38.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.853+0000 7f300ce01700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f300809e000 0x7f3008130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42078/0 (socket says 172.21.15.72:42078) 2023-10-03T10:16:38.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.853+0000 7f300d602700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f300809d6f0 0x7f300809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.853+0000 7f300ce01700 1 -- 172.21.15.72:0/1893831091 learned_addr learned my addr 172.21.15.72:0/1893831091 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:38.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.853+0000 7f300de03700 1 --2- 172.21.15.72:0/1893831091 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f300809e410 0x7f3008130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.854+0000 7f2ffbfff700 1 -- 172.21.15.72:0/1893831091 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107962955 0 0) 0x7f300809f130 con 0x7f300809e000 2023-10-03T10:16:38.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.854+0000 7f300d602700 1 -- 172.21.15.72:0/1893831091 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f300809e410 msgr2=0x7f3008130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.854+0000 7f300d602700 1 --2- 172.21.15.72:0/1893831091 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f300809e410 0x7f3008130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.854+0000 7f300d602700 1 -- 172.21.15.72:0/1893831091 >> v1:172.21.15.72:6789/0 conn(0x7f300809e000 legacy=0x7f3008130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.854+0000 7f300d602700 1 -- 172.21.15.72:0/1893831091 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300809b2d0 con 0x7f300809d6f0 2023-10-03T10:16:38.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.854+0000 7f300de03700 1 --2- 172.21.15.72:0/1893831091 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f300809e410 0x7f3008130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.854+0000 7f300d602700 1 --2- 172.21.15.72:0/1893831091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f300809d6f0 0x7f300809dac0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009870 tx=0x7f2ffc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd8d040ff3db32d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.854+0000 7f2ffbfff700 1 -- 172.21.15.72:0/1893831091 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc011830 con 0x7f300809d6f0 2023-10-03T10:16:38.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.854+0000 7f2ffbfff700 1 -- 172.21.15.72:0/1893831091 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ffc011990 con 0x7f300809d6f0 2023-10-03T10:16:38.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.854+0000 7f2ffbfff700 1 -- 172.21.15.72:0/1893831091 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc011d20 con 0x7f300809d6f0 2023-10-03T10:16:38.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.855+0000 7f300f866700 1 -- 172.21.15.72:0/1893831091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f300809d6f0 msgr2=0x7f300809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.855+0000 7f300f866700 1 --2- 172.21.15.72:0/1893831091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f300809d6f0 0x7f300809dac0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009870 tx=0x7f2ffc009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:38.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.855+0000 7f300f866700 1 -- 172.21.15.72:0/1893831091 shutdown_connections 2023-10-03T10:16:38.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.855+0000 7f300f866700 1 --2- 172.21.15.72:0/1893831091 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f300809e410 0x7f3008130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.855+0000 7f300f866700 1 --2- 172.21.15.72:0/1893831091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f300809d6f0 0x7f300809dac0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.855+0000 7f300f866700 1 -- 172.21.15.72:0/1893831091 >> 172.21.15.72:0/1893831091 conn(0x7f3008066f50 msgr2=0x7f300809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.855+0000 7f300f866700 1 -- 172.21.15.72:0/1893831091 shutdown_connections 2023-10-03T10:16:38.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.855+0000 7f300f866700 1 -- 172.21.15.72:0/1893831091 wait complete. 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.856+0000 7f300f866700 1 Processor -- start 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.856+0000 7f300f866700 1 -- start start 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300f866700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f300809d6f0 0x7f300811e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300f866700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f300809e000 0x7f300811e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300f866700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f300809e410 0x7f300811eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300f866700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3008121b50 con 0x7f300809d6f0 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300f866700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300809c770 con 0x7f300809e000 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300f866700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3008072150 con 0x7f300809e410 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300d602700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f300809d6f0 0x7f300811e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300de03700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f300809e410 0x7f300811eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300ce01700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f300809e000 0x7f300811e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300d602700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f300809d6f0 0x7f300811e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32830/0 (socket says 172.21.15.72:32830) 2023-10-03T10:16:38.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300de03700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f300809e410 0x7f300811eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59418/0 (socket says 172.21.15.72:59418) 2023-10-03T10:16:38.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300d602700 1 -- 172.21.15.72:0/877867776 learned_addr learned my addr 172.21.15.72:0/877867776 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:38.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300ce01700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f300809e000 0x7f300811e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48900/0 (socket says 172.21.15.72:48900) 2023-10-03T10:16:38.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300ce01700 1 -- 172.21.15.72:0/877867776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f300809e410 msgr2=0x7f300811eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300ce01700 1 --2- 172.21.15.72:0/877867776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f300809e410 0x7f300811eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300ce01700 1 -- 172.21.15.72:0/877867776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f300809d6f0 msgr2=0x7f300811e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300ce01700 1 --2- 172.21.15.72:0/877867776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f300809d6f0 0x7f300811e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300ce01700 1 -- 172.21.15.72:0/877867776 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3000009a70 con 0x7f300809e000 2023-10-03T10:16:38.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300de03700 1 --2- 172.21.15.72:0/877867776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f300809e410 0x7f300811eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300d602700 1 --2- 172.21.15.72:0/877867776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f300809d6f0 0x7f300811e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300ce01700 1 --2- 172.21.15.72:0/877867776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f300809e000 0x7f300811e570 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f30080a3e20 tx=0x7f3004001b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f2ff9ffb700 1 -- 172.21.15.72:0/877867776 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004013070 con 0x7f300809e000 2023-10-03T10:16:38.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f2ff9ffb700 1 -- 172.21.15.72:0/877867776 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300400e110 con 0x7f300809e000 2023-10-03T10:16:38.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.857+0000 7f300f866700 1 -- 172.21.15.72:0/877867776 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ffc0094a0 con 0x7f300809e000 2023-10-03T10:16:38.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.858+0000 7f2ff9ffb700 1 -- 172.21.15.72:0/877867776 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300400eea0 con 0x7f300809e000 2023-10-03T10:16:38.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.858+0000 7f300f866700 1 -- 172.21.15.72:0/877867776 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30081215b0 con 0x7f300809e000 2023-10-03T10:16:38.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.858+0000 7f2ff9ffb700 1 -- 172.21.15.72:0/877867776 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3004004870 con 0x7f300809e000 2023-10-03T10:16:38.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.858+0000 7f2ff9ffb700 1 -- 172.21.15.72:0/877867776 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3004042e20 con 0x7f300809e000 2023-10-03T10:16:38.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.859+0000 7f300f866700 1 -- 172.21.15.72:0/877867776 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3008120e90 con 0x7f300809e000 2023-10-03T10:16:38.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:38.863+0000 7f2ff9ffb700 1 -- 172.21.15.72:0/877867776 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3004018980 con 0x7f300809e000 2023-10-03T10:16:39.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.047+0000 7f300f866700 1 -- 172.21.15.72:0/877867776 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f300811ac20 con 0x7f300809e000 2023-10-03T10:16:39.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.047+0000 7f2ff9ffb700 1 -- 172.21.15.72:0/877867776 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3004018390 con 0x7f300809e000 2023-10-03T10:16:39.047 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.049+0000 7f300f866700 1 -- 172.21.15.72:0/877867776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f300809e000 msgr2=0x7f300811e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.049+0000 7f300f866700 1 --2- 172.21.15.72:0/877867776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f300809e000 0x7f300811e570 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f30080a3e20 tx=0x7f3004001b80 comp rx=0 tx=0).stop 2023-10-03T10:16:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.049+0000 7f300f866700 1 -- 172.21.15.72:0/877867776 shutdown_connections 2023-10-03T10:16:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.049+0000 7f300f866700 1 --2- 172.21.15.72:0/877867776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f300809d6f0 0x7f300811e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.049+0000 7f300f866700 1 --2- 172.21.15.72:0/877867776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f300809e410 0x7f300811eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.049+0000 7f300f866700 1 --2- 172.21.15.72:0/877867776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f300809e000 0x7f300811e570 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.049+0000 7f300f866700 1 -- 172.21.15.72:0/877867776 >> 172.21.15.72:0/877867776 conn(0x7f3008066f50 msgr2=0x7f3008130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.049+0000 7f300f866700 1 -- 172.21.15.72:0/877867776 shutdown_connections 2023-10-03T10:16:39.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.049+0000 7f300f866700 1 -- 172.21.15.72:0/877867776 wait complete. 2023-10-03T10:16:39.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:39.152 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:39.273 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:39.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.274+0000 7fef1fae2700 1 Processor -- start 2023-10-03T10:16:39.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.275+0000 7fef1fae2700 1 -- start start 2023-10-03T10:16:39.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.275+0000 7fef1fae2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef181337f0 0x7fef18138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.275+0000 7fef1fae2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef18138dc0 0x7fef1813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.275+0000 7fef1fae2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1806b990 con 0x7fef18133420 2023-10-03T10:16:39.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.275+0000 7fef1fae2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1809b0e0 con 0x7fef181337f0 2023-10-03T10:16:39.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.275+0000 7fef1fae2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef18133c20 con 0x7fef18138dc0 2023-10-03T10:16:39.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.275+0000 7fef1d07d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef181337f0 0x7fef18138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.275+0000 7fef1e07f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef18138dc0 0x7fef1813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.275+0000 7fef1d07d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef181337f0 0x7fef18138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32834/0 (socket says 172.21.15.72:32834) 2023-10-03T10:16:39.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.275+0000 7fef1d07d700 1 -- 172.21.15.72:0/1662760876 learned_addr learned my addr 172.21.15.72:0/1662760876 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:39.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.275+0000 7fef1e07f700 1 -- 172.21.15.72:0/1662760876 >> v2:172.21.15.72:3300/0 conn(0x7fef181337f0 msgr2=0x7fef18138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.275+0000 7fef1e07f700 1 --2- 172.21.15.72:0/1662760876 >> v2:172.21.15.72:3300/0 conn(0x7fef181337f0 0x7fef18138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.275+0000 7fef1e07f700 1 -- 172.21.15.72:0/1662760876 >> v1:172.21.15.72:6789/0 conn(0x7fef18133420 legacy=0x7fef18133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.275+0000 7fef1e07f700 1 -- 172.21.15.72:0/1662760876 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180a0590 con 0x7fef18138dc0 2023-10-03T10:16:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.275+0000 7fef1d07d700 1 --2- 172.21.15.72:0/1662760876 >> v2:172.21.15.72:3300/0 conn(0x7fef181337f0 0x7fef18138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.276+0000 7fef1e07f700 1 --2- 172.21.15.72:0/1662760876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef18138dc0 0x7fef1813b1a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fef10009d90 tx=0x7fef1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c894d9ea2693c4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.276+0000 7fef1c87c700 1 -- 172.21.15.72:0/1662760876 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1000e070 con 0x7fef18138dc0 2023-10-03T10:16:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.276+0000 7fef1c87c700 1 -- 172.21.15.72:0/1662760876 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1000bb20 con 0x7fef18138dc0 2023-10-03T10:16:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.276+0000 7fef1c87c700 1 -- 172.21.15.72:0/1662760876 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10012430 con 0x7fef18138dc0 2023-10-03T10:16:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.276+0000 7fef1fae2700 1 -- 172.21.15.72:0/1662760876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef18138dc0 msgr2=0x7fef1813b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.276+0000 7fef1fae2700 1 --2- 172.21.15.72:0/1662760876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef18138dc0 0x7fef1813b1a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fef10009d90 tx=0x7fef1000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.276+0000 7fef1fae2700 1 -- 172.21.15.72:0/1662760876 shutdown_connections 2023-10-03T10:16:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.276+0000 7fef1fae2700 1 --2- 172.21.15.72:0/1662760876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef18138dc0 0x7fef1813b1a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.276+0000 7fef1fae2700 1 --2- 172.21.15.72:0/1662760876 >> v2:172.21.15.72:3300/0 conn(0x7fef181337f0 0x7fef18138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.276+0000 7fef1fae2700 1 -- 172.21.15.72:0/1662760876 >> 172.21.15.72:0/1662760876 conn(0x7fef180a4210 msgr2=0x7fef180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.276+0000 7fef1fae2700 1 -- 172.21.15.72:0/1662760876 shutdown_connections 2023-10-03T10:16:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.276+0000 7fef1fae2700 1 -- 172.21.15.72:0/1662760876 wait complete. 2023-10-03T10:16:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.277+0000 7fef1fae2700 1 Processor -- start 2023-10-03T10:16:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.277+0000 7fef1fae2700 1 -- start start 2023-10-03T10:16:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1fae2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef18133420 0x7fef1812f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1fae2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef181337f0 0x7fef1812f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1fae2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef18138dc0 0x7fef1812fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1fae2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef181304f0 con 0x7fef181337f0 2023-10-03T10:16:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1fae2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1809c510 con 0x7fef18138dc0 2023-10-03T10:16:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1fae2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef1809c720 con 0x7fef18133420 2023-10-03T10:16:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1d07d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef181337f0 0x7fef1812f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1d07d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef181337f0 0x7fef1812f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32850/0 (socket says 172.21.15.72:32850) 2023-10-03T10:16:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1d07d700 1 -- 172.21.15.72:0/2381979979 learned_addr learned my addr 172.21.15.72:0/2381979979 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1e07f700 1 --2- 172.21.15.72:0/2381979979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef18138dc0 0x7fef1812fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1d87e700 1 --2- 172.21.15.72:0/2381979979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef18133420 0x7fef1812f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1d87e700 1 -- 172.21.15.72:0/2381979979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef18138dc0 msgr2=0x7fef1812fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1d87e700 1 --2- 172.21.15.72:0/2381979979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef18138dc0 0x7fef1812fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1d87e700 1 -- 172.21.15.72:0/2381979979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef181337f0 msgr2=0x7fef1812f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1d87e700 1 --2- 172.21.15.72:0/2381979979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef181337f0 0x7fef1812f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1d87e700 1 -- 172.21.15.72:0/2381979979 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef08009550 con 0x7fef18133420 2023-10-03T10:16:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1e07f700 1 --2- 172.21.15.72:0/2381979979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef18138dc0 0x7fef1812fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1d07d700 1 --2- 172.21.15.72:0/2381979979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef181337f0 0x7fef1812f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.278+0000 7fef1d87e700 1 --2- 172.21.15.72:0/2381979979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef18133420 0x7fef1812f0b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fef14000f60 tx=0x7fef1400c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.279+0000 7fef0e7fc700 1 -- 172.21.15.72:0/2381979979 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef140052d0 con 0x7fef18133420 2023-10-03T10:16:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.279+0000 7fef0e7fc700 1 -- 172.21.15.72:0/2381979979 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef14005430 con 0x7fef18133420 2023-10-03T10:16:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.279+0000 7fef1fae2700 1 -- 172.21.15.72:0/2381979979 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef10009a70 con 0x7fef18133420 2023-10-03T10:16:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.279+0000 7fef0e7fc700 1 -- 172.21.15.72:0/2381979979 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef140038c0 con 0x7fef18133420 2023-10-03T10:16:39.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.279+0000 7fef1fae2700 1 -- 172.21.15.72:0/2381979979 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1809e130 con 0x7fef18133420 2023-10-03T10:16:39.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.280+0000 7fef0e7fc700 1 -- 172.21.15.72:0/2381979979 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef14003a20 con 0x7fef18133420 2023-10-03T10:16:39.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.280+0000 7fef1fae2700 1 -- 172.21.15.72:0/2381979979 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef18074ea0 con 0x7fef18133420 2023-10-03T10:16:39.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.280+0000 7fef0e7fc700 1 -- 172.21.15.72:0/2381979979 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef1403e990 con 0x7fef18133420 2023-10-03T10:16:39.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.284+0000 7fef0e7fc700 1 -- 172.21.15.72:0/2381979979 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef14017070 con 0x7fef18133420 2023-10-03T10:16:39.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.401+0000 7f34cd9f6700 1 Processor -- start 2023-10-03T10:16:39.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.401+0000 7f34cd9f6700 1 -- start start 2023-10-03T10:16:39.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.401+0000 7f34cd9f6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34c809d6f0 0x7f34c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.401+0000 7f34cd9f6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c809e000 0x7f34c81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.401+0000 7f34cd9f6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c809b120 con 0x7f34c809e410 2023-10-03T10:16:39.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.401+0000 7f34cd9f6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c806b460 con 0x7f34c809d6f0 2023-10-03T10:16:39.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.401+0000 7f34cd9f6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c809a7e0 con 0x7f34c809e000 2023-10-03T10:16:39.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.401+0000 7f34c6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34c809d6f0 0x7f34c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.401+0000 7f34c6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34c809d6f0 0x7f34c809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32862/0 (socket says 172.21.15.72:32862) 2023-10-03T10:16:39.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.401+0000 7f34c6ffd700 1 -- 172.21.15.72:0/506181424 learned_addr learned my addr 172.21.15.72:0/506181424 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:39.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.401+0000 7f34c77fe700 1 --1- 172.21.15.72:0/506181424 >> v1:172.21.15.72:6789/0 conn(0x7f34c809e410 0x7f34c8133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42096/0 (socket says 172.21.15.72:42096) 2023-10-03T10:16:39.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.401+0000 7f34c67fc700 1 --2- 172.21.15.72:0/506181424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c809e000 0x7f34c81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.402+0000 7f34c6ffd700 1 -- 172.21.15.72:0/506181424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c809e000 msgr2=0x7f34c81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.402+0000 7f34c6ffd700 1 --2- 172.21.15.72:0/506181424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c809e000 0x7f34c81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.402+0000 7f34c6ffd700 1 -- 172.21.15.72:0/506181424 >> v1:172.21.15.72:6789/0 conn(0x7f34c809e410 legacy=0x7f34c8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.402+0000 7f34c6ffd700 1 -- 172.21.15.72:0/506181424 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c809a500 con 0x7f34c809d6f0 2023-10-03T10:16:39.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.402+0000 7f34c5ffb700 1 -- 172.21.15.72:0/506181424 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805684836 0 0) 0x7f34c809b120 con 0x7f34c809e410 2023-10-03T10:16:39.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.402+0000 7f34c67fc700 1 --2- 172.21.15.72:0/506181424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c809e000 0x7f34c81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.402+0000 7f34c6ffd700 1 --2- 172.21.15.72:0/506181424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c809d6f0 0x7f34c809dac0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f34b80098f0 tx=0x7f34b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c06bec22dbbad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.402+0000 7f34c5ffb700 1 -- 172.21.15.72:0/506181424 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b8011830 con 0x7f34c809d6f0 2023-10-03T10:16:39.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.402+0000 7f34c5ffb700 1 -- 172.21.15.72:0/506181424 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b8011990 con 0x7f34c809d6f0 2023-10-03T10:16:39.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.402+0000 7f34c5ffb700 1 -- 172.21.15.72:0/506181424 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b8011d20 con 0x7f34c809d6f0 2023-10-03T10:16:39.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.403+0000 7f34cd9f6700 1 -- 172.21.15.72:0/506181424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c809d6f0 msgr2=0x7f34c809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.403+0000 7f34cd9f6700 1 --2- 172.21.15.72:0/506181424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c809d6f0 0x7f34c809dac0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f34b80098f0 tx=0x7f34b8009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.403+0000 7f34cd9f6700 1 -- 172.21.15.72:0/506181424 shutdown_connections 2023-10-03T10:16:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.403+0000 7f34cd9f6700 1 --2- 172.21.15.72:0/506181424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c809d6f0 0x7f34c809dac0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.403+0000 7f34cd9f6700 1 --2- 172.21.15.72:0/506181424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c809e000 0x7f34c81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.403+0000 7f34cd9f6700 1 -- 172.21.15.72:0/506181424 >> 172.21.15.72:0/506181424 conn(0x7f34c8066f50 msgr2=0x7f34c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.403+0000 7f34cd9f6700 1 -- 172.21.15.72:0/506181424 shutdown_connections 2023-10-03T10:16:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.403+0000 7f34cd9f6700 1 -- 172.21.15.72:0/506181424 wait complete. 2023-10-03T10:16:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.404+0000 7f34cd9f6700 1 Processor -- start 2023-10-03T10:16:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.404+0000 7f34cd9f6700 1 -- start start 2023-10-03T10:16:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.404+0000 7f34cd9f6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c809d6f0 0x7f34c81a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.404+0000 7f34cd9f6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c809e000 0x7f34c81a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.404+0000 7f34cd9f6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c809e410 0x7f34c81c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.404+0000 7f34cd9f6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c81a7d20 con 0x7f34c809e000 2023-10-03T10:16:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.404+0000 7f34cd9f6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c81b90a0 con 0x7f34c809d6f0 2023-10-03T10:16:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.404+0000 7f34cd9f6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34c81a4bd0 con 0x7f34c809e410 2023-10-03T10:16:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.404+0000 7f34c6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c809d6f0 0x7f34c81a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.404+0000 7f34c67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c809e000 0x7f34c81a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.404+0000 7f34c6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c809d6f0 0x7f34c81a5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48924/0 (socket says 172.21.15.72:48924) 2023-10-03T10:16:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.404+0000 7f34c67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c809e000 0x7f34c81a55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32874/0 (socket says 172.21.15.72:32874) 2023-10-03T10:16:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.404+0000 7f34c6ffd700 1 -- 172.21.15.72:0/3134145192 learned_addr learned my addr 172.21.15.72:0/3134145192 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.405+0000 7f34c77fe700 1 --2- 172.21.15.72:0/3134145192 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c809e410 0x7f34c81c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.405+0000 7f34c6ffd700 1 -- 172.21.15.72:0/3134145192 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c809e410 msgr2=0x7f34c81c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.405+0000 7f34c6ffd700 1 --2- 172.21.15.72:0/3134145192 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c809e410 0x7f34c81c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.405+0000 7f34c6ffd700 1 -- 172.21.15.72:0/3134145192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c809e000 msgr2=0x7f34c81a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.405+0000 7f34c6ffd700 1 --2- 172.21.15.72:0/3134145192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c809e000 0x7f34c81a55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.405+0000 7f34c6ffd700 1 -- 172.21.15.72:0/3134145192 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc0094a0 con 0x7f34c809d6f0 2023-10-03T10:16:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.405+0000 7f34c67fc700 1 --2- 172.21.15.72:0/3134145192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c809e000 0x7f34c81a55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.405+0000 7f34c6ffd700 1 --2- 172.21.15.72:0/3134145192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c809d6f0 0x7f34c81a5070 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f34b8009f50 tx=0x7f34b8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.405+0000 7f34affff700 1 -- 172.21.15.72:0/3134145192 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b801a900 con 0x7f34c809d6f0 2023-10-03T10:16:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.405+0000 7f34affff700 1 -- 172.21.15.72:0/3134145192 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b801f070 con 0x7f34c809d6f0 2023-10-03T10:16:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.405+0000 7f34cd9f6700 1 -- 172.21.15.72:0/3134145192 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b8009550 con 0x7f34c809d6f0 2023-10-03T10:16:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.405+0000 7f34affff700 1 -- 172.21.15.72:0/3134145192 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b801ac60 con 0x7f34c809d6f0 2023-10-03T10:16:39.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.405+0000 7f34cd9f6700 1 -- 172.21.15.72:0/3134145192 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c81a6370 con 0x7f34c809d6f0 2023-10-03T10:16:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.406+0000 7f34cd9f6700 1 -- 172.21.15.72:0/3134145192 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c8074ea0 con 0x7f34c809d6f0 2023-10-03T10:16:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.407+0000 7f34affff700 1 -- 172.21.15.72:0/3134145192 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f34b801b430 con 0x7f34c809d6f0 2023-10-03T10:16:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.407+0000 7f34affff700 1 -- 172.21.15.72:0/3134145192 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f34b8021070 con 0x7f34c809d6f0 2023-10-03T10:16:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.411+0000 7f34affff700 1 -- 172.21.15.72:0/3134145192 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34b802e7b0 con 0x7f34c809d6f0 2023-10-03T10:16:39.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.413+0000 7f034815d700 1 Processor -- start 2023-10-03T10:16:39.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.413+0000 7f034815d700 1 -- start start 2023-10-03T10:16:39.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.414+0000 7f034815d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f034009d6f0 0x7f034009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.414+0000 7f034815d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034009e440 0x7f0340134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.414+0000 7f034815d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034009b120 con 0x7f034009e000 2023-10-03T10:16:39.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.414+0000 7f034815d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034006b460 con 0x7f034009d6f0 2023-10-03T10:16:39.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.414+0000 7f034815d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034009a7e0 con 0x7f034009e440 2023-10-03T10:16:39.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.414+0000 7f03466fa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034009e440 0x7f0340134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.414+0000 7f03466fa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034009e440 0x7f0340134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48936/0 (socket says 172.21.15.72:48936) 2023-10-03T10:16:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.414+0000 7f03466fa700 1 -- 172.21.15.72:0/339166703 learned_addr learned my addr 172.21.15.72:0/339166703 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.414+0000 7f0345ef9700 1 --2- 172.21.15.72:0/339166703 >> v2:172.21.15.72:3300/0 conn(0x7f034009d6f0 0x7f034009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.414+0000 7f0345ef9700 1 -- 172.21.15.72:0/339166703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034009e440 msgr2=0x7f0340134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.414+0000 7f0345ef9700 1 --2- 172.21.15.72:0/339166703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034009e440 0x7f0340134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.414+0000 7f0345ef9700 1 -- 172.21.15.72:0/339166703 >> v1:172.21.15.72:6789/0 conn(0x7f034009e000 legacy=0x7f03401339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.414+0000 7f0345ef9700 1 -- 172.21.15.72:0/339166703 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034009a500 con 0x7f034009d6f0 2023-10-03T10:16:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.414+0000 7f03466fa700 1 --2- 172.21.15.72:0/339166703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034009e440 0x7f0340134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.414+0000 7f0344ef7700 1 -- 172.21.15.72:0/339166703 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160838653 0 0) 0x7f034009b120 con 0x7f034009e000 2023-10-03T10:16:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.415+0000 7f0345ef9700 1 --2- 172.21.15.72:0/339166703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034009d6f0 0x7f034009dac0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f033c009870 tx=0x7f033c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ec3afd8c7b8fa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.415+0000 7f0344ef7700 1 -- 172.21.15.72:0/339166703 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c011830 con 0x7f034009d6f0 2023-10-03T10:16:39.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.415+0000 7f0344ef7700 1 -- 172.21.15.72:0/339166703 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c011990 con 0x7f034009d6f0 2023-10-03T10:16:39.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.415+0000 7f0344ef7700 1 -- 172.21.15.72:0/339166703 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c011d20 con 0x7f034009d6f0 2023-10-03T10:16:39.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.415+0000 7f034815d700 1 -- 172.21.15.72:0/339166703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034009d6f0 msgr2=0x7f034009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.415+0000 7f034815d700 1 --2- 172.21.15.72:0/339166703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034009d6f0 0x7f034009dac0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f033c009870 tx=0x7f033c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:39.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.415+0000 7f034815d700 1 -- 172.21.15.72:0/339166703 shutdown_connections 2023-10-03T10:16:39.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.415+0000 7f034815d700 1 --2- 172.21.15.72:0/339166703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034009e440 0x7f0340134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.415+0000 7f034815d700 1 --2- 172.21.15.72:0/339166703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034009d6f0 0x7f034009dac0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.415+0000 7f034815d700 1 -- 172.21.15.72:0/339166703 >> 172.21.15.72:0/339166703 conn(0x7f0340066f50 msgr2=0x7f034009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.416+0000 7f034815d700 1 -- 172.21.15.72:0/339166703 shutdown_connections 2023-10-03T10:16:39.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.416+0000 7f034815d700 1 -- 172.21.15.72:0/339166703 wait complete. 2023-10-03T10:16:39.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.416+0000 7f034815d700 1 Processor -- start 2023-10-03T10:16:39.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.416+0000 7f034815d700 1 -- start start 2023-10-03T10:16:39.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f034815d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034009d6f0 0x7f03401a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f034815d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034009e000 0x7f03401a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f034815d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f034009e440 0x7f03401c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f034815d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03401a8110 con 0x7f034009e000 2023-10-03T10:16:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f034815d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03401b9180 con 0x7f034009d6f0 2023-10-03T10:16:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f034815d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03401a8310 con 0x7f034009e440 2023-10-03T10:16:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f0345ef9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034009d6f0 0x7f03401a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f03466fa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f034009e440 0x7f03401c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f0345ef9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034009d6f0 0x7f03401a5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48938/0 (socket says 172.21.15.72:48938) 2023-10-03T10:16:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f0345ef9700 1 -- 172.21.15.72:0/782779720 learned_addr learned my addr 172.21.15.72:0/782779720 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f03456f8700 1 --2- 172.21.15.72:0/782779720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034009e000 0x7f03401a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f0345ef9700 1 -- 172.21.15.72:0/782779720 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f034009e440 msgr2=0x7f03401c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f0345ef9700 1 --2- 172.21.15.72:0/782779720 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f034009e440 0x7f03401c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f0345ef9700 1 -- 172.21.15.72:0/782779720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034009e000 msgr2=0x7f03401a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f0345ef9700 1 --2- 172.21.15.72:0/782779720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034009e000 0x7f03401a58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.417+0000 7f0345ef9700 1 -- 172.21.15.72:0/782779720 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0338009b30 con 0x7f034009d6f0 2023-10-03T10:16:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.418+0000 7f0345ef9700 1 --2- 172.21.15.72:0/782779720 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034009d6f0 0x7f03401a5380 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f033c000c00 tx=0x7f033c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.418+0000 7f03367fc700 1 -- 172.21.15.72:0/782779720 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c0036a0 con 0x7f034009d6f0 2023-10-03T10:16:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.418+0000 7f03367fc700 1 -- 172.21.15.72:0/782779720 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c01f070 con 0x7f034009d6f0 2023-10-03T10:16:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.418+0000 7f034815d700 1 -- 172.21.15.72:0/782779720 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033c0094a0 con 0x7f034009d6f0 2023-10-03T10:16:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.418+0000 7f03367fc700 1 -- 172.21.15.72:0/782779720 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c003a20 con 0x7f034009d6f0 2023-10-03T10:16:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.418+0000 7f034815d700 1 -- 172.21.15.72:0/782779720 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03401a4d90 con 0x7f034009d6f0 2023-10-03T10:16:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.418+0000 7f03367fc700 1 -- 172.21.15.72:0/782779720 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f033c003b80 con 0x7f034009d6f0 2023-10-03T10:16:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.419+0000 7f03367fc700 1 -- 172.21.15.72:0/782779720 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f033c021070 con 0x7f034009d6f0 2023-10-03T10:16:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.419+0000 7f034815d700 1 -- 172.21.15.72:0/782779720 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034009c710 con 0x7f034009d6f0 2023-10-03T10:16:39.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.423+0000 7f03367fc700 1 -- 172.21.15.72:0/782779720 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f033c015080 con 0x7f034009d6f0 2023-10-03T10:16:39.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.500+0000 7fef1fae2700 1 -- 172.21.15.72:0/2381979979 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fef1806b250 con 0x7fef18133420 2023-10-03T10:16:39.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.501+0000 7fef0e7fc700 1 -- 172.21.15.72:0/2381979979 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef14011590 con 0x7fef18133420 2023-10-03T10:16:39.500 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:39.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.503+0000 7fef1fae2700 1 -- 172.21.15.72:0/2381979979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef18133420 msgr2=0x7fef1812f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.503+0000 7fef1fae2700 1 --2- 172.21.15.72:0/2381979979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef18133420 0x7fef1812f0b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fef14000f60 tx=0x7fef1400c730 comp rx=0 tx=0).stop 2023-10-03T10:16:39.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.503+0000 7fef1fae2700 1 -- 172.21.15.72:0/2381979979 shutdown_connections 2023-10-03T10:16:39.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.503+0000 7fef1fae2700 1 --2- 172.21.15.72:0/2381979979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef18138dc0 0x7fef1812fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.503+0000 7fef1fae2700 1 --2- 172.21.15.72:0/2381979979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef18133420 0x7fef1812f0b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.503+0000 7fef1fae2700 1 --2- 172.21.15.72:0/2381979979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef181337f0 0x7fef1812f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.503+0000 7fef1fae2700 1 -- 172.21.15.72:0/2381979979 >> 172.21.15.72:0/2381979979 conn(0x7fef180a4210 msgr2=0x7fef180a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.503+0000 7fef1fae2700 1 -- 172.21.15.72:0/2381979979 shutdown_connections 2023-10-03T10:16:39.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.503+0000 7fef1fae2700 1 -- 172.21.15.72:0/2381979979 wait complete. 2023-10-03T10:16:39.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:39.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.615+0000 7f034815d700 1 -- 172.21.15.72:0/782779720 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f034009f420 con 0x7f034009d6f0 2023-10-03T10:16:39.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.615+0000 7f03367fc700 1 -- 172.21.15.72:0/782779720 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f033c035090 con 0x7f034009d6f0 2023-10-03T10:16:39.615 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:39.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.617+0000 7f034815d700 1 -- 172.21.15.72:0/782779720 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034009d6f0 msgr2=0x7f03401a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.617+0000 7f034815d700 1 --2- 172.21.15.72:0/782779720 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034009d6f0 0x7f03401a5380 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f033c000c00 tx=0x7f033c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:39.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.617+0000 7f034815d700 1 -- 172.21.15.72:0/782779720 shutdown_connections 2023-10-03T10:16:39.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.617+0000 7f034815d700 1 --2- 172.21.15.72:0/782779720 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f034009e440 0x7f03401c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.617+0000 7f034815d700 1 --2- 172.21.15.72:0/782779720 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034009d6f0 0x7f03401a5380 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.617+0000 7f034815d700 1 --2- 172.21.15.72:0/782779720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034009e000 0x7f03401a58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.617+0000 7f034815d700 1 -- 172.21.15.72:0/782779720 >> 172.21.15.72:0/782779720 conn(0x7f0340066f50 msgr2=0x7f03401bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.617+0000 7f034815d700 1 -- 172.21.15.72:0/782779720 shutdown_connections 2023-10-03T10:16:39.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.617+0000 7f034815d700 1 -- 172.21.15.72:0/782779720 wait complete. 2023-10-03T10:16:39.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.621+0000 7f34cd9f6700 1 -- 172.21.15.72:0/3134145192 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f34c81a5b50 con 0x7f34c809d6f0 2023-10-03T10:16:39.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.622+0000 7f34affff700 1 -- 172.21.15.72:0/3134145192 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f34b8034090 con 0x7f34c809d6f0 2023-10-03T10:16:39.621 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:39.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.625+0000 7f34cd9f6700 1 -- 172.21.15.72:0/3134145192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c809d6f0 msgr2=0x7f34c81a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.625+0000 7f34cd9f6700 1 --2- 172.21.15.72:0/3134145192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c809d6f0 0x7f34c81a5070 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f34b8009f50 tx=0x7f34b8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:39.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.625+0000 7f34cd9f6700 1 -- 172.21.15.72:0/3134145192 shutdown_connections 2023-10-03T10:16:39.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.625+0000 7f34cd9f6700 1 --2- 172.21.15.72:0/3134145192 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34c809e410 0x7f34c81c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.626+0000 7f34cd9f6700 1 --2- 172.21.15.72:0/3134145192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34c809d6f0 0x7f34c81a5070 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.626+0000 7f34cd9f6700 1 --2- 172.21.15.72:0/3134145192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34c809e000 0x7f34c81a55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.626+0000 7f34cd9f6700 1 -- 172.21.15.72:0/3134145192 >> 172.21.15.72:0/3134145192 conn(0x7f34c8066f50 msgr2=0x7f34c81bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.626+0000 7f34cd9f6700 1 -- 172.21.15.72:0/3134145192 shutdown_connections 2023-10-03T10:16:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:39.626+0000 7f34cd9f6700 1 -- 172.21.15.72:0/3134145192 wait complete. 2023-10-03T10:16:39.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:39.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:40.062 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:40.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.187+0000 7fa968bb2700 1 Processor -- start 2023-10-03T10:16:40.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.187+0000 7fa968bb2700 1 -- start start 2023-10-03T10:16:40.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.188+0000 7fa968bb2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9641337f0 0x7fa964138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.188+0000 7fa968bb2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa964138dc0 0x7fa96413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.188+0000 7fa968bb2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96406b990 con 0x7fa964133420 2023-10-03T10:16:40.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.188+0000 7fa968bb2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96409b0e0 con 0x7fa9641337f0 2023-10-03T10:16:40.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.188+0000 7fa968bb2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa964133c20 con 0x7fa964138dc0 2023-10-03T10:16:40.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.188+0000 7fa962d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa964138dc0 0x7fa96413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.188+0000 7fa961d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9641337f0 0x7fa964138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.188+0000 7fa962d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa964138dc0 0x7fa96413b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59446/0 (socket says 172.21.15.72:59446) 2023-10-03T10:16:40.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.188+0000 7fa962d9d700 1 -- 172.21.15.72:0/4109133026 learned_addr learned my addr 172.21.15.72:0/4109133026 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:40.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.188+0000 7fa961d9b700 1 -- 172.21.15.72:0/4109133026 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa964138dc0 msgr2=0x7fa96413b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.188+0000 7fa961d9b700 1 --2- 172.21.15.72:0/4109133026 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa964138dc0 0x7fa96413b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.188+0000 7fa961d9b700 1 -- 172.21.15.72:0/4109133026 >> v1:172.21.15.72:6789/0 conn(0x7fa964133420 legacy=0x7fa964133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.188+0000 7fa961d9b700 1 -- 172.21.15.72:0/4109133026 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9640a0590 con 0x7fa9641337f0 2023-10-03T10:16:40.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.188+0000 7fa962d9d700 1 --2- 172.21.15.72:0/4109133026 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa964138dc0 0x7fa96413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.189+0000 7fa961d9b700 1 --2- 172.21.15.72:0/4109133026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9641337f0 0x7fa964138880 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fa954009840 tx=0x7fa954009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57d8d9515c1e99b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.189+0000 7fa96159a700 1 -- 172.21.15.72:0/4109133026 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954011830 con 0x7fa9641337f0 2023-10-03T10:16:40.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.189+0000 7fa96159a700 1 -- 172.21.15.72:0/4109133026 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa954011990 con 0x7fa9641337f0 2023-10-03T10:16:40.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.189+0000 7fa96159a700 1 -- 172.21.15.72:0/4109133026 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa954011d20 con 0x7fa9641337f0 2023-10-03T10:16:40.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.189+0000 7fa968bb2700 1 -- 172.21.15.72:0/4109133026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9641337f0 msgr2=0x7fa964138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.189+0000 7fa968bb2700 1 --2- 172.21.15.72:0/4109133026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9641337f0 0x7fa964138880 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fa954009840 tx=0x7fa954009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.189+0000 7fa968bb2700 1 -- 172.21.15.72:0/4109133026 shutdown_connections 2023-10-03T10:16:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.189+0000 7fa968bb2700 1 --2- 172.21.15.72:0/4109133026 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa964138dc0 0x7fa96413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.189+0000 7fa968bb2700 1 --2- 172.21.15.72:0/4109133026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9641337f0 0x7fa964138880 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.189+0000 7fa968bb2700 1 -- 172.21.15.72:0/4109133026 >> 172.21.15.72:0/4109133026 conn(0x7fa9640a4210 msgr2=0x7fa9640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.189+0000 7fa968bb2700 1 -- 172.21.15.72:0/4109133026 shutdown_connections 2023-10-03T10:16:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.189+0000 7fa968bb2700 1 -- 172.21.15.72:0/4109133026 wait complete. 2023-10-03T10:16:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.190+0000 7fa968bb2700 1 Processor -- start 2023-10-03T10:16:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.190+0000 7fa968bb2700 1 -- start start 2023-10-03T10:16:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa968bb2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa964133420 0x7fa96409c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa968bb2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9641337f0 0x7fa96409cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa968bb2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa964138dc0 0x7fa96409d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa968bb2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96412df60 con 0x7fa9641337f0 2023-10-03T10:16:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa968bb2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96412f950 con 0x7fa964138dc0 2023-10-03T10:16:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa968bb2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa964130780 con 0x7fa964133420 2023-10-03T10:16:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa96259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa964133420 0x7fa96409c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa96259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa964133420 0x7fa96409c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59458/0 (socket says 172.21.15.72:59458) 2023-10-03T10:16:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa962d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa964138dc0 0x7fa96409d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa961d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9641337f0 0x7fa96409cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa96259c700 1 -- 172.21.15.72:0/2068663896 learned_addr learned my addr 172.21.15.72:0/2068663896 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa96259c700 1 -- 172.21.15.72:0/2068663896 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa964138dc0 msgr2=0x7fa96409d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa96259c700 1 --2- 172.21.15.72:0/2068663896 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa964138dc0 0x7fa96409d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa96259c700 1 -- 172.21.15.72:0/2068663896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9641337f0 msgr2=0x7fa96409cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa96259c700 1 --2- 172.21.15.72:0/2068663896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9641337f0 0x7fa96409cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa96259c700 1 -- 172.21.15.72:0/2068663896 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c009b30 con 0x7fa964133420 2023-10-03T10:16:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa961d9b700 1 --2- 172.21.15.72:0/2068663896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9641337f0 0x7fa96409cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.191+0000 7fa96259c700 1 --2- 172.21.15.72:0/2068663896 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa964133420 0x7fa96409c9e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c510 tx=0x7fa95800c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.192+0000 7fa952ffd700 1 -- 172.21.15.72:0/2068663896 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9580052d0 con 0x7fa964133420 2023-10-03T10:16:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.192+0000 7fa952ffd700 1 -- 172.21.15.72:0/2068663896 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958005430 con 0x7fa964133420 2023-10-03T10:16:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.192+0000 7fa952ffd700 1 -- 172.21.15.72:0/2068663896 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9580038c0 con 0x7fa964133420 2023-10-03T10:16:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.192+0000 7fa968bb2700 1 -- 172.21.15.72:0/2068663896 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9540094a0 con 0x7fa964133420 2023-10-03T10:16:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.192+0000 7fa968bb2700 1 -- 172.21.15.72:0/2068663896 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa964130d40 con 0x7fa964133420 2023-10-03T10:16:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.192+0000 7fa968bb2700 1 -- 172.21.15.72:0/2068663896 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa964074ea0 con 0x7fa964133420 2023-10-03T10:16:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.193+0000 7fa952ffd700 1 -- 172.21.15.72:0/2068663896 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa958003a20 con 0x7fa964133420 2023-10-03T10:16:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.193+0000 7fa952ffd700 1 -- 172.21.15.72:0/2068663896 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa95803ec50 con 0x7fa964133420 2023-10-03T10:16:40.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.197+0000 7fa952ffd700 1 -- 172.21.15.72:0/2068663896 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa95803ee60 con 0x7fa964133420 2023-10-03T10:16:40.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.380+0000 7fa968bb2700 1 -- 172.21.15.72:0/2068663896 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa96406b250 con 0x7fa964133420 2023-10-03T10:16:40.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.380+0000 7fa952ffd700 1 -- 172.21.15.72:0/2068663896 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa958017020 con 0x7fa964133420 2023-10-03T10:16:40.381 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.382+0000 7fa968bb2700 1 -- 172.21.15.72:0/2068663896 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa964133420 msgr2=0x7fa96409c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.382+0000 7fa968bb2700 1 --2- 172.21.15.72:0/2068663896 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa964133420 0x7fa96409c9e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c510 tx=0x7fa95800c820 comp rx=0 tx=0).stop 2023-10-03T10:16:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.382+0000 7fa968bb2700 1 -- 172.21.15.72:0/2068663896 shutdown_connections 2023-10-03T10:16:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.382+0000 7fa968bb2700 1 --2- 172.21.15.72:0/2068663896 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa964138dc0 0x7fa96409d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.382+0000 7fa968bb2700 1 --2- 172.21.15.72:0/2068663896 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa964133420 0x7fa96409c9e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.382+0000 7fa968bb2700 1 --2- 172.21.15.72:0/2068663896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9641337f0 0x7fa96409cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.382+0000 7fa968bb2700 1 -- 172.21.15.72:0/2068663896 >> 172.21.15.72:0/2068663896 conn(0x7fa9640a4210 msgr2=0x7fa9640a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.382+0000 7fa968bb2700 1 -- 172.21.15.72:0/2068663896 shutdown_connections 2023-10-03T10:16:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.382+0000 7fa968bb2700 1 -- 172.21.15.72:0/2068663896 wait complete. 2023-10-03T10:16:40.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:40.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:40.634 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:40.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.638+0000 7f05cb2ac700 1 Processor -- start 2023-10-03T10:16:40.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.638+0000 7f05cb2ac700 1 -- start start 2023-10-03T10:16:40.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.638+0000 7f05cb2ac700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05c409c650 0x7f05c409ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.638+0000 7f05cb2ac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05c40a0090 0x7f05c409cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.638+0000 7f05cb2ac700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c409ba70 con 0x7f05c4131970 2023-10-03T10:16:40.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.639+0000 7f05cb2ac700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c409d4a0 con 0x7f05c409c650 2023-10-03T10:16:40.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.639+0000 7f05cb2ac700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c409e8f0 con 0x7f05c40a0090 2023-10-03T10:16:40.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.639+0000 7f05c8847700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05c40a0090 0x7f05c409cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.639+0000 7f05c8847700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05c40a0090 0x7f05c409cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48960/0 (socket says 172.21.15.72:48960) 2023-10-03T10:16:40.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.639+0000 7f05c8847700 1 -- 172.21.15.72:0/3230955694 learned_addr learned my addr 172.21.15.72:0/3230955694 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:40.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.639+0000 7f05c8847700 1 -- 172.21.15.72:0/3230955694 >> v2:172.21.15.72:3300/0 conn(0x7f05c409c650 msgr2=0x7f05c409ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.639+0000 7f05c8847700 1 --2- 172.21.15.72:0/3230955694 >> v2:172.21.15.72:3300/0 conn(0x7f05c409c650 0x7f05c409ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.639+0000 7f05c8847700 1 -- 172.21.15.72:0/3230955694 >> v1:172.21.15.72:6789/0 conn(0x7f05c4131970 legacy=0x7f05c4131db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.639+0000 7f05c8847700 1 -- 172.21.15.72:0/3230955694 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c40a0760 con 0x7f05c40a0090 2023-10-03T10:16:40.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.639+0000 7f05c8847700 1 --2- 172.21.15.72:0/3230955694 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05c40a0090 0x7f05c409cf60 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f05b40098f0 tx=0x7f05b4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=304f61ac15edf492 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.640 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:40.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.640+0000 7f05bbfff700 1 -- 172.21.15.72:0/3230955694 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4004230 con 0x7f05c40a0090 2023-10-03T10:16:40.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.640+0000 7f05bbfff700 1 -- 172.21.15.72:0/3230955694 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b4004390 con 0x7f05c40a0090 2023-10-03T10:16:40.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.640+0000 7f05bbfff700 1 -- 172.21.15.72:0/3230955694 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40036a0 con 0x7f05c40a0090 2023-10-03T10:16:40.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.641+0000 7f05cb2ac700 1 -- 172.21.15.72:0/3230955694 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05c40a0090 msgr2=0x7f05c409cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.641+0000 7f05cb2ac700 1 --2- 172.21.15.72:0/3230955694 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05c40a0090 0x7f05c409cf60 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f05b40098f0 tx=0x7f05b4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:40.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.641+0000 7f05cb2ac700 1 -- 172.21.15.72:0/3230955694 shutdown_connections 2023-10-03T10:16:40.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.641+0000 7f05cb2ac700 1 --2- 172.21.15.72:0/3230955694 >> v2:172.21.15.72:3300/0 conn(0x7f05c409c650 0x7f05c409ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.641+0000 7f05cb2ac700 1 --2- 172.21.15.72:0/3230955694 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05c40a0090 0x7f05c409cf60 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.641+0000 7f05cb2ac700 1 -- 172.21.15.72:0/3230955694 >> 172.21.15.72:0/3230955694 conn(0x7f05c40a3f70 msgr2=0x7f05c40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.641+0000 7f05cb2ac700 1 -- 172.21.15.72:0/3230955694 shutdown_connections 2023-10-03T10:16:40.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.641+0000 7f05cb2ac700 1 -- 172.21.15.72:0/3230955694 wait complete. 2023-10-03T10:16:40.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.642+0000 7f05cb2ac700 1 Processor -- start 2023-10-03T10:16:40.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.642+0000 7f05cb2ac700 1 -- start start 2023-10-03T10:16:40.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.642+0000 7f05cb2ac700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05c409c650 0x7f05c411d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.642+0000 7f05cb2ac700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05c40a0090 0x7f05c411d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.642+0000 7f05cb2ac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05c4131970 0x7f05c411ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.642+0000 7f05cb2ac700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c4120bb0 con 0x7f05c40a0090 2023-10-03T10:16:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.642+0000 7f05cb2ac700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c4130210 con 0x7f05c4131970 2023-10-03T10:16:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.642+0000 7f05cb2ac700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05c411f090 con 0x7f05c409c650 2023-10-03T10:16:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.642+0000 7f05c9048700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05c409c650 0x7f05c411d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.642+0000 7f05c9048700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05c409c650 0x7f05c411d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59468/0 (socket says 172.21.15.72:59468) 2023-10-03T10:16:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.642+0000 7f05c9048700 1 -- 172.21.15.72:0/3927033239 learned_addr learned my addr 172.21.15.72:0/3927033239 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.642+0000 7f05c9849700 1 --2- 172.21.15.72:0/3927033239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05c4131970 0x7f05c411ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.642+0000 7f05c8847700 1 --2- 172.21.15.72:0/3927033239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05c40a0090 0x7f05c411d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.643+0000 7f05c8847700 1 -- 172.21.15.72:0/3927033239 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05c409c650 msgr2=0x7f05c411d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.643+0000 7f05c8847700 1 --2- 172.21.15.72:0/3927033239 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05c409c650 0x7f05c411d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.643+0000 7f05c8847700 1 -- 172.21.15.72:0/3927033239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05c4131970 msgr2=0x7f05c411ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.643+0000 7f05c8847700 1 --2- 172.21.15.72:0/3927033239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05c4131970 0x7f05c411ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.643+0000 7f05c8847700 1 -- 172.21.15.72:0/3927033239 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b4009550 con 0x7f05c40a0090 2023-10-03T10:16:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.643+0000 7f05c9849700 1 --2- 172.21.15.72:0/3927033239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05c4131970 0x7f05c411ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.643+0000 7f05c8847700 1 --2- 172.21.15.72:0/3927033239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05c40a0090 0x7f05c411d8b0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f05b4015000 tx=0x7f05b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.643+0000 7f05b9ffb700 1 -- 172.21.15.72:0/3927033239 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4003d10 con 0x7f05c40a0090 2023-10-03T10:16:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.643+0000 7f05b9ffb700 1 -- 172.21.15.72:0/3927033239 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b401f070 con 0x7f05c40a0090 2023-10-03T10:16:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.643+0000 7f05cb2ac700 1 -- 172.21.15.72:0/3927033239 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c411f7a0 con 0x7f05c40a0090 2023-10-03T10:16:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.643+0000 7f05b9ffb700 1 -- 172.21.15.72:0/3927033239 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b400b8a0 con 0x7f05c40a0090 2023-10-03T10:16:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.643+0000 7f05cb2ac700 1 -- 172.21.15.72:0/3927033239 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c4121620 con 0x7f05c40a0090 2023-10-03T10:16:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.644+0000 7f05b9ffb700 1 -- 172.21.15.72:0/3927033239 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05b4021030 con 0x7f05c40a0090 2023-10-03T10:16:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.644+0000 7f05b9ffb700 1 -- 172.21.15.72:0/3927033239 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f05b4040dc0 con 0x7f05c40a0090 2023-10-03T10:16:40.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.644+0000 7f05cb2ac700 1 -- 172.21.15.72:0/3927033239 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c40747f0 con 0x7f05c40a0090 2023-10-03T10:16:40.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.650+0000 7f05b9ffb700 1 -- 172.21.15.72:0/3927033239 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05b401a440 con 0x7f05c40a0090 2023-10-03T10:16:40.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.761+0000 7f1df14ae700 1 Processor -- start 2023-10-03T10:16:40.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.761+0000 7f1df14ae700 1 -- start start 2023-10-03T10:16:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.762+0000 7f1df14ae700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1dec1338a0 0x7f1dec133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.762+0000 7f1df14ae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dec09de50 0x7f1dec09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.762+0000 7f1df14ae700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dec06ef30 con 0x7f1dec09e760 2023-10-03T10:16:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.762+0000 7f1df14ae700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec06fef0 con 0x7f1dec09de50 2023-10-03T10:16:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.762+0000 7f1df14ae700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec1334b0 con 0x7f1dec1338a0 2023-10-03T10:16:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.762+0000 7f1dea7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dec09de50 0x7f1dec09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.762+0000 7f1dea7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dec09de50 0x7f1dec09e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48970/0 (socket says 172.21.15.72:48970) 2023-10-03T10:16:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.762+0000 7f1deaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1dec1338a0 0x7f1dec133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.762+0000 7f1dea7fc700 1 -- 172.21.15.72:0/2974267089 learned_addr learned my addr 172.21.15.72:0/2974267089 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.762+0000 7f1dea7fc700 1 -- 172.21.15.72:0/2974267089 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1dec1338a0 msgr2=0x7f1dec133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.762+0000 7f1dea7fc700 1 --2- 172.21.15.72:0/2974267089 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1dec1338a0 0x7f1dec133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.762+0000 7f1dea7fc700 1 -- 172.21.15.72:0/2974267089 >> v1:172.21.15.72:6789/0 conn(0x7f1dec09e760 legacy=0x7f1dec13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.762+0000 7f1dea7fc700 1 -- 172.21.15.72:0/2974267089 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec06fc30 con 0x7f1dec09de50 2023-10-03T10:16:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.762+0000 7f1deaffd700 1 --2- 172.21.15.72:0/2974267089 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1dec1338a0 0x7f1dec133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.763+0000 7f1dea7fc700 1 --2- 172.21.15.72:0/2974267089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dec09de50 0x7f1dec09e220 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009920 tx=0x7f1de0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0218ffc96659cf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.763+0000 7f1de9ffb700 1 -- 172.21.15.72:0/2974267089 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0004230 con 0x7f1dec09de50 2023-10-03T10:16:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.763+0000 7f1de9ffb700 1 -- 172.21.15.72:0/2974267089 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de0004390 con 0x7f1dec09de50 2023-10-03T10:16:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.763+0000 7f1de9ffb700 1 -- 172.21.15.72:0/2974267089 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de00036a0 con 0x7f1dec09de50 2023-10-03T10:16:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.763+0000 7f1df14ae700 1 -- 172.21.15.72:0/2974267089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dec09de50 msgr2=0x7f1dec09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.763+0000 7f1df14ae700 1 --2- 172.21.15.72:0/2974267089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dec09de50 0x7f1dec09e220 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009920 tx=0x7f1de0009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.763+0000 7f1df14ae700 1 -- 172.21.15.72:0/2974267089 shutdown_connections 2023-10-03T10:16:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.763+0000 7f1df14ae700 1 --2- 172.21.15.72:0/2974267089 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1dec1338a0 0x7f1dec133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.763+0000 7f1df14ae700 1 --2- 172.21.15.72:0/2974267089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dec09de50 0x7f1dec09e220 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.763+0000 7f1df14ae700 1 -- 172.21.15.72:0/2974267089 >> 172.21.15.72:0/2974267089 conn(0x7f1dec0a2aa0 msgr2=0x7f1dec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.763+0000 7f1df14ae700 1 -- 172.21.15.72:0/2974267089 shutdown_connections 2023-10-03T10:16:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.763+0000 7f1df14ae700 1 -- 172.21.15.72:0/2974267089 wait complete. 2023-10-03T10:16:40.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.764+0000 7f1df14ae700 1 Processor -- start 2023-10-03T10:16:40.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.764+0000 7f1df14ae700 1 -- start start 2023-10-03T10:16:40.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1df14ae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dec09de50 0x7f1dec11eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1df14ae700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dec09e760 0x7f1dec11f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1df14ae700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1dec1338a0 0x7f1dec11f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1df14ae700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec121ea0 con 0x7f1dec09e760 2023-10-03T10:16:40.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1df14ae700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec122080 con 0x7f1dec09de50 2023-10-03T10:16:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1df14ae700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec12f690 con 0x7f1dec1338a0 2023-10-03T10:16:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1dea7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dec09e760 0x7f1dec11f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1dea7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dec09e760 0x7f1dec11f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32948/0 (socket says 172.21.15.72:32948) 2023-10-03T10:16:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1dea7fc700 1 -- 172.21.15.72:0/786788662 learned_addr learned my addr 172.21.15.72:0/786788662 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1deaffd700 1 --2- 172.21.15.72:0/786788662 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dec09de50 0x7f1dec11eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1deb7fe700 1 --2- 172.21.15.72:0/786788662 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1dec1338a0 0x7f1dec11f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1dea7fc700 1 -- 172.21.15.72:0/786788662 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1dec1338a0 msgr2=0x7f1dec11f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1dea7fc700 1 --2- 172.21.15.72:0/786788662 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1dec1338a0 0x7f1dec11f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1dea7fc700 1 -- 172.21.15.72:0/786788662 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dec09de50 msgr2=0x7f1dec11eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1dea7fc700 1 --2- 172.21.15.72:0/786788662 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dec09de50 0x7f1dec11eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1dea7fc700 1 -- 172.21.15.72:0/786788662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc0094a0 con 0x7f1dec09e760 2023-10-03T10:16:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.765+0000 7f1deaffd700 1 --2- 172.21.15.72:0/786788662 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dec09de50 0x7f1dec11eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.766+0000 7f1dea7fc700 1 --2- 172.21.15.72:0/786788662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dec09e760 0x7f1dec11f0d0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f1de0000c00 tx=0x7f1de0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.766+0000 7f1dd37fe700 1 -- 172.21.15.72:0/786788662 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0003d70 con 0x7f1dec09e760 2023-10-03T10:16:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.766+0000 7f1dd37fe700 1 -- 172.21.15.72:0/786788662 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de0011630 con 0x7f1dec09e760 2023-10-03T10:16:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.766+0000 7f1df14ae700 1 -- 172.21.15.72:0/786788662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de0009550 con 0x7f1dec09e760 2023-10-03T10:16:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.766+0000 7f1dd37fe700 1 -- 172.21.15.72:0/786788662 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de00119e0 con 0x7f1dec09e760 2023-10-03T10:16:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.766+0000 7f1df14ae700 1 -- 172.21.15.72:0/786788662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dec06f640 con 0x7f1dec09e760 2023-10-03T10:16:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.766+0000 7f794ae69700 1 Processor -- start 2023-10-03T10:16:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.766+0000 7f794ae69700 1 -- start start 2023-10-03T10:16:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f1dd37fe700 1 -- 172.21.15.72:0/786788662 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1de0011b40 con 0x7f1dec09e760 2023-10-03T10:16:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f1dd37fe700 1 -- 172.21.15.72:0/786788662 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1de00408f0 con 0x7f1dec09e760 2023-10-03T10:16:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f794ae69700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79440a09c0 0x7f79440a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f794ae69700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f794409d5c0 0x7f79440a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f794ae69700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79440a1810 con 0x7f7944133920 2023-10-03T10:16:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f794ae69700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794409ea10 con 0x7f79440a09c0 2023-10-03T10:16:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f794ae69700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794409e210 con 0x7f794409d5c0 2023-10-03T10:16:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f1df14ae700 1 -- 172.21.15.72:0/786788662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dec074ea0 con 0x7f1dec09e760 2023-10-03T10:16:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f7943fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f794409d5c0 0x7f79440a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f7948c05700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79440a09c0 0x7f79440a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f7943fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f794409d5c0 0x7f79440a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48992/0 (socket says 172.21.15.72:48992) 2023-10-03T10:16:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f7943fff700 1 -- 172.21.15.72:0/378463004 learned_addr learned my addr 172.21.15.72:0/378463004 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:40.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f7943fff700 1 -- 172.21.15.72:0/378463004 >> v2:172.21.15.72:3300/0 conn(0x7f79440a09c0 msgr2=0x7f79440a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f7943fff700 1 --2- 172.21.15.72:0/378463004 >> v2:172.21.15.72:3300/0 conn(0x7f79440a09c0 0x7f79440a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f7943fff700 1 -- 172.21.15.72:0/378463004 >> v1:172.21.15.72:6789/0 conn(0x7f7944133920 legacy=0x7f7944133d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f7943fff700 1 -- 172.21.15.72:0/378463004 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79440a26f0 con 0x7f794409d5c0 2023-10-03T10:16:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.767+0000 7f7948c05700 1 --2- 172.21.15.72:0/378463004 >> v2:172.21.15.72:3300/0 conn(0x7f79440a09c0 0x7f79440a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.768+0000 7f7943fff700 1 --2- 172.21.15.72:0/378463004 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f794409d5c0 0x7f79440a12d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f792c0098f0 tx=0x7f792c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17b090b333160857 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.768+0000 7f79437fe700 1 -- 172.21.15.72:0/378463004 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c011830 con 0x7f794409d5c0 2023-10-03T10:16:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.768+0000 7f79437fe700 1 -- 172.21.15.72:0/378463004 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c011990 con 0x7f794409d5c0 2023-10-03T10:16:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.768+0000 7f79437fe700 1 -- 172.21.15.72:0/378463004 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c011d20 con 0x7f794409d5c0 2023-10-03T10:16:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.768+0000 7f794ae69700 1 -- 172.21.15.72:0/378463004 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f794409d5c0 msgr2=0x7f79440a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.768+0000 7f794ae69700 1 --2- 172.21.15.72:0/378463004 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f794409d5c0 0x7f79440a12d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f792c0098f0 tx=0x7f792c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.768+0000 7f794ae69700 1 -- 172.21.15.72:0/378463004 shutdown_connections 2023-10-03T10:16:40.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.768+0000 7f794ae69700 1 --2- 172.21.15.72:0/378463004 >> v2:172.21.15.72:3300/0 conn(0x7f79440a09c0 0x7f79440a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.768+0000 7f794ae69700 1 --2- 172.21.15.72:0/378463004 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f794409d5c0 0x7f79440a12d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.768+0000 7f794ae69700 1 -- 172.21.15.72:0/378463004 >> 172.21.15.72:0/378463004 conn(0x7f79440a2fe0 msgr2=0x7f79440a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.768+0000 7f794ae69700 1 -- 172.21.15.72:0/378463004 shutdown_connections 2023-10-03T10:16:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.768+0000 7f794ae69700 1 -- 172.21.15.72:0/378463004 wait complete. 2023-10-03T10:16:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.769+0000 7f794ae69700 1 Processor -- start 2023-10-03T10:16:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.769+0000 7f794ae69700 1 -- start start 2023-10-03T10:16:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f794ae69700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f794409d5c0 0x7f794407ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f794ae69700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79440a09c0 0x7f794407efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f794ae69700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7944133920 0x7f794407f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f794ae69700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794407ff60 con 0x7f7944133920 2023-10-03T10:16:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f794ae69700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79440814a0 con 0x7f794409d5c0 2023-10-03T10:16:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f794ae69700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79440a4000 con 0x7f79440a09c0 2023-10-03T10:16:40.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f7949406700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7944133920 0x7f794407f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f7948c05700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f794409d5c0 0x7f794407ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f7948c05700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f794409d5c0 0x7f794407ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49002/0 (socket says 172.21.15.72:49002) 2023-10-03T10:16:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f7948c05700 1 -- 172.21.15.72:0/1117264729 learned_addr learned my addr 172.21.15.72:0/1117264729 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f7943fff700 1 --2- 172.21.15.72:0/1117264729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79440a09c0 0x7f794407efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f7949406700 1 -- 172.21.15.72:0/1117264729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79440a09c0 msgr2=0x7f794407efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f7949406700 1 --2- 172.21.15.72:0/1117264729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79440a09c0 0x7f794407efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f7949406700 1 -- 172.21.15.72:0/1117264729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f794409d5c0 msgr2=0x7f794407ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f7949406700 1 --2- 172.21.15.72:0/1117264729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f794409d5c0 0x7f794407ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f7949406700 1 -- 172.21.15.72:0/1117264729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c009a70 con 0x7f7944133920 2023-10-03T10:16:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f7948c05700 1 --2- 172.21.15.72:0/1117264729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f794409d5c0 0x7f794407ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.770+0000 7f7949406700 1 --2- 172.21.15.72:0/1117264729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7944133920 0x7f794407f510 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f7934000f60 tx=0x7f793400c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.772+0000 7f79417fa700 1 -- 172.21.15.72:0/1117264729 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79340052d0 con 0x7f7944133920 2023-10-03T10:16:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.772+0000 7f79417fa700 1 -- 172.21.15.72:0/1117264729 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7934005430 con 0x7f7944133920 2023-10-03T10:16:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.772+0000 7f79417fa700 1 -- 172.21.15.72:0/1117264729 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79340038c0 con 0x7f7944133920 2023-10-03T10:16:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.772+0000 7f794ae69700 1 -- 172.21.15.72:0/1117264729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792c009550 con 0x7f7944133920 2023-10-03T10:16:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.772+0000 7f794ae69700 1 -- 172.21.15.72:0/1117264729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7944082010 con 0x7f7944133920 2023-10-03T10:16:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.772+0000 7f1dd37fe700 1 -- 172.21.15.72:0/786788662 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1de0011df0 con 0x7f1dec09e760 2023-10-03T10:16:40.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.773+0000 7f79417fa700 1 -- 172.21.15.72:0/1117264729 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7934003a20 con 0x7f7944133920 2023-10-03T10:16:40.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.773+0000 7f794ae69700 1 -- 172.21.15.72:0/1117264729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79440821f0 con 0x7f7944133920 2023-10-03T10:16:40.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.773+0000 7f79417fa700 1 -- 172.21.15.72:0/1117264729 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f793403e990 con 0x7f7944133920 2023-10-03T10:16:40.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.782+0000 7f79417fa700 1 -- 172.21.15.72:0/1117264729 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7934017080 con 0x7f7944133920 2023-10-03T10:16:40.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.870+0000 7f05cb2ac700 1 -- 172.21.15.72:0/3927033239 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f05c40747f0 con 0x7f05c40a0090 2023-10-03T10:16:40.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.870+0000 7f05b9ffb700 1 -- 172.21.15.72:0/3927033239 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f05b40193c0 con 0x7f05c40a0090 2023-10-03T10:16:40.870 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:40.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.872+0000 7f05cb2ac700 1 -- 172.21.15.72:0/3927033239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05c40a0090 msgr2=0x7f05c411d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.872+0000 7f05cb2ac700 1 --2- 172.21.15.72:0/3927033239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05c40a0090 0x7f05c411d8b0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f05b4015000 tx=0x7f05b4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:40.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.873+0000 7f05cb2ac700 1 -- 172.21.15.72:0/3927033239 shutdown_connections 2023-10-03T10:16:40.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.873+0000 7f05cb2ac700 1 --2- 172.21.15.72:0/3927033239 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05c4131970 0x7f05c411ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.873+0000 7f05cb2ac700 1 --2- 172.21.15.72:0/3927033239 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f05c409c650 0x7f05c411d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.873+0000 7f05cb2ac700 1 --2- 172.21.15.72:0/3927033239 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05c40a0090 0x7f05c411d8b0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.873+0000 7f05cb2ac700 1 -- 172.21.15.72:0/3927033239 >> 172.21.15.72:0/3927033239 conn(0x7f05c40a3f70 msgr2=0x7f05c409ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.873+0000 7f05cb2ac700 1 -- 172.21.15.72:0/3927033239 shutdown_connections 2023-10-03T10:16:40.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.873+0000 7f05cb2ac700 1 -- 172.21.15.72:0/3927033239 wait complete. 2023-10-03T10:16:40.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:40.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.970+0000 7f1df14ae700 1 -- 172.21.15.72:0/786788662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1dec122400 con 0x7f1dec09e760 2023-10-03T10:16:40.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.970+0000 7f1dd37fe700 1 -- 172.21.15.72:0/786788662 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1de0028020 con 0x7f1dec09e760 2023-10-03T10:16:40.970 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:40.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.972+0000 7f1df14ae700 1 -- 172.21.15.72:0/786788662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dec09e760 msgr2=0x7f1dec11f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.972+0000 7f1df14ae700 1 --2- 172.21.15.72:0/786788662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dec09e760 0x7f1dec11f0d0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f1de0000c00 tx=0x7f1de0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:40.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.972+0000 7f1df14ae700 1 -- 172.21.15.72:0/786788662 shutdown_connections 2023-10-03T10:16:40.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.972+0000 7f1df14ae700 1 --2- 172.21.15.72:0/786788662 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1dec1338a0 0x7f1dec11f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.972+0000 7f1df14ae700 1 --2- 172.21.15.72:0/786788662 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dec09de50 0x7f1dec11eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.972+0000 7f1df14ae700 1 --2- 172.21.15.72:0/786788662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dec09e760 0x7f1dec11f0d0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.972+0000 7f1df14ae700 1 -- 172.21.15.72:0/786788662 >> 172.21.15.72:0/786788662 conn(0x7f1dec0a2aa0 msgr2=0x7f1dec09ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.972+0000 7f1df14ae700 1 -- 172.21.15.72:0/786788662 shutdown_connections 2023-10-03T10:16:40.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.972+0000 7f1df14ae700 1 -- 172.21.15.72:0/786788662 wait complete. 2023-10-03T10:16:40.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:40.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.994+0000 7f794ae69700 1 -- 172.21.15.72:0/1117264729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f79440747f0 con 0x7f7944133920 2023-10-03T10:16:40.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.995+0000 7f79417fa700 1 -- 172.21.15.72:0/1117264729 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f793400ce60 con 0x7f7944133920 2023-10-03T10:16:40.994 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:40.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.996+0000 7f794ae69700 1 -- 172.21.15.72:0/1117264729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7944133920 msgr2=0x7f794407f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.996+0000 7f794ae69700 1 --2- 172.21.15.72:0/1117264729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7944133920 0x7f794407f510 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f7934000f60 tx=0x7f793400c6e0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.997+0000 7f794ae69700 1 -- 172.21.15.72:0/1117264729 shutdown_connections 2023-10-03T10:16:40.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.997+0000 7f794ae69700 1 --2- 172.21.15.72:0/1117264729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7944133920 0x7f794407f510 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.997+0000 7f794ae69700 1 --2- 172.21.15.72:0/1117264729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f794409d5c0 0x7f794407ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.997+0000 7f794ae69700 1 --2- 172.21.15.72:0/1117264729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79440a09c0 0x7f794407efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.997+0000 7f794ae69700 1 -- 172.21.15.72:0/1117264729 >> 172.21.15.72:0/1117264729 conn(0x7f79440a2fe0 msgr2=0x7f794409ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.997+0000 7f794ae69700 1 -- 172.21.15.72:0/1117264729 shutdown_connections 2023-10-03T10:16:40.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:40.997+0000 7f794ae69700 1 -- 172.21.15.72:0/1117264729 wait complete. 2023-10-03T10:16:41.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:41.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:41.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.519+0000 7f3dc6d03700 1 Processor -- start 2023-10-03T10:16:41.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.520+0000 7f3dc6d03700 1 -- start start 2023-10-03T10:16:41.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.520+0000 7f3dc6d03700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3dc009d6f0 0x7f3dc009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.520+0000 7f3dc6d03700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3dc009e000 0x7f3dc01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.520+0000 7f3dc6d03700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc009b120 con 0x7f3dc009e410 2023-10-03T10:16:41.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.520+0000 7f3dc6d03700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc006b460 con 0x7f3dc009d6f0 2023-10-03T10:16:41.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.520+0000 7f3dc6d03700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc009a7e0 con 0x7f3dc009e000 2023-10-03T10:16:41.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.520+0000 7f3dbffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3dc009e000 0x7f3dc01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.520+0000 7f3dc4a9f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3dc009d6f0 0x7f3dc009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.520+0000 7f3dbffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3dc009e000 0x7f3dc01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59508/0 (socket says 172.21.15.72:59508) 2023-10-03T10:16:41.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.521+0000 7f3dbffff700 1 -- 172.21.15.72:0/1223046623 learned_addr learned my addr 172.21.15.72:0/1223046623 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:41.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.521+0000 7f3dc4a9f700 1 -- 172.21.15.72:0/1223046623 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3dc009e000 msgr2=0x7f3dc01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:41.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.521+0000 7f3dc4a9f700 1 --2- 172.21.15.72:0/1223046623 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3dc009e000 0x7f3dc01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.521+0000 7f3dc4a9f700 1 -- 172.21.15.72:0/1223046623 >> v1:172.21.15.72:6789/0 conn(0x7f3dc009e410 legacy=0x7f3dc0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.521+0000 7f3dc4a9f700 1 -- 172.21.15.72:0/1223046623 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc009a500 con 0x7f3dc009d6f0 2023-10-03T10:16:41.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.521+0000 7f3dbffff700 1 --2- 172.21.15.72:0/1223046623 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3dc009e000 0x7f3dc01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.521+0000 7f3dc4a9f700 1 --2- 172.21.15.72:0/1223046623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3dc009d6f0 0x7f3dc009dac0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009840 tx=0x7f3db4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba68e1558dccffa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.521+0000 7f3dbf7fe700 1 -- 172.21.15.72:0/1223046623 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4011830 con 0x7f3dc009d6f0 2023-10-03T10:16:41.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.521+0000 7f3dbf7fe700 1 -- 172.21.15.72:0/1223046623 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db4011990 con 0x7f3dc009d6f0 2023-10-03T10:16:41.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.521+0000 7f3dbf7fe700 1 -- 172.21.15.72:0/1223046623 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4011d20 con 0x7f3dc009d6f0 2023-10-03T10:16:41.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.522+0000 7f3dc6d03700 1 -- 172.21.15.72:0/1223046623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3dc009d6f0 msgr2=0x7f3dc009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.522+0000 7f3dc6d03700 1 --2- 172.21.15.72:0/1223046623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3dc009d6f0 0x7f3dc009dac0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009840 tx=0x7f3db4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:41.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.522+0000 7f3dc6d03700 1 -- 172.21.15.72:0/1223046623 shutdown_connections 2023-10-03T10:16:41.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.522+0000 7f3dc6d03700 1 --2- 172.21.15.72:0/1223046623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3dc009d6f0 0x7f3dc009dac0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.522+0000 7f3dc6d03700 1 --2- 172.21.15.72:0/1223046623 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3dc009e000 0x7f3dc01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.522+0000 7f3dc6d03700 1 -- 172.21.15.72:0/1223046623 >> 172.21.15.72:0/1223046623 conn(0x7f3dc0066f50 msgr2=0x7f3dc009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.522+0000 7f3dc6d03700 1 -- 172.21.15.72:0/1223046623 shutdown_connections 2023-10-03T10:16:41.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.522+0000 7f3dc6d03700 1 -- 172.21.15.72:0/1223046623 wait complete. 2023-10-03T10:16:41.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.523+0000 7f3dc6d03700 1 Processor -- start 2023-10-03T10:16:41.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.523+0000 7f3dc6d03700 1 -- start start 2023-10-03T10:16:41.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc6d03700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3dc009d6f0 0x7f3dc01a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc6d03700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3dc009e000 0x7f3dc01a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc6d03700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3dc009e410 0x7f3dc01a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:41.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc6d03700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc01a7340 con 0x7f3dc009e000 2023-10-03T10:16:41.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc6d03700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc01a7ac0 con 0x7f3dc009d6f0 2023-10-03T10:16:41.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc6d03700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc01a80e0 con 0x7f3dc009e410 2023-10-03T10:16:41.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc4a9f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3dc009d6f0 0x7f3dc01a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc4a9f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3dc009d6f0 0x7f3dc01a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49010/0 (socket says 172.21.15.72:49010) 2023-10-03T10:16:41.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc4a9f700 1 -- 172.21.15.72:0/113790493 learned_addr learned my addr 172.21.15.72:0/113790493 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:41.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc52a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3dc009e410 0x7f3dc01a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dbffff700 1 --2- 172.21.15.72:0/113790493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3dc009e000 0x7f3dc01a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:41.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc52a0700 1 -- 172.21.15.72:0/113790493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3dc009d6f0 msgr2=0x7f3dc01a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc52a0700 1 --2- 172.21.15.72:0/113790493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3dc009d6f0 0x7f3dc01a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc52a0700 1 -- 172.21.15.72:0/113790493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3dc009e000 msgr2=0x7f3dc01a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc52a0700 1 --2- 172.21.15.72:0/113790493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3dc009e000 0x7f3dc01a63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc52a0700 1 -- 172.21.15.72:0/113790493 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac009550 con 0x7f3dc009e410 2023-10-03T10:16:41.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc4a9f700 1 --2- 172.21.15.72:0/113790493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3dc009d6f0 0x7f3dc01a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dbffff700 1 --2- 172.21.15.72:0/113790493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3dc009e000 0x7f3dc01a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:41.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dc52a0700 1 --2- 172.21.15.72:0/113790493 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3dc009e410 0x7f3dc01a6930 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3db800cbc0 tx=0x7f3db800ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:41.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dbd7fa700 1 -- 172.21.15.72:0/113790493 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8003c00 con 0x7f3dc009e410 2023-10-03T10:16:41.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.524+0000 7f3dbd7fa700 1 -- 172.21.15.72:0/113790493 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db8003d60 con 0x7f3dc009e410 2023-10-03T10:16:41.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.525+0000 7f3dc6d03700 1 -- 172.21.15.72:0/113790493 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db40094a0 con 0x7f3dc009e410 2023-10-03T10:16:41.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.525+0000 7f3dbd7fa700 1 -- 172.21.15.72:0/113790493 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db800aa40 con 0x7f3dc009e410 2023-10-03T10:16:41.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.525+0000 7f3dc6d03700 1 -- 172.21.15.72:0/113790493 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc00a3220 con 0x7f3dc009e410 2023-10-03T10:16:41.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.525+0000 7f3dbd7fa700 1 -- 172.21.15.72:0/113790493 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3db800aba0 con 0x7f3dc009e410 2023-10-03T10:16:41.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.525+0000 7f3dc6d03700 1 -- 172.21.15.72:0/113790493 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc009c710 con 0x7f3dc009e410 2023-10-03T10:16:41.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.525+0000 7f3dbd7fa700 1 -- 172.21.15.72:0/113790493 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3db803f5b0 con 0x7f3dc009e410 2023-10-03T10:16:41.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.530+0000 7f3dbd7fa700 1 -- 172.21.15.72:0/113790493 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3db8019710 con 0x7f3dc009e410 2023-10-03T10:16:41.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.717+0000 7f3dc6d03700 1 -- 172.21.15.72:0/113790493 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3dc0074ea0 con 0x7f3dc009e410 2023-10-03T10:16:41.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.717+0000 7f3dbd7fa700 1 -- 172.21.15.72:0/113790493 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3db801a360 con 0x7f3dc009e410 2023-10-03T10:16:41.717 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:41.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.719+0000 7f3dc6d03700 1 -- 172.21.15.72:0/113790493 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3dc009e410 msgr2=0x7f3dc01a6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.719+0000 7f3dc6d03700 1 --2- 172.21.15.72:0/113790493 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3dc009e410 0x7f3dc01a6930 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3db800cbc0 tx=0x7f3db800ced0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.719+0000 7f3dc6d03700 1 -- 172.21.15.72:0/113790493 shutdown_connections 2023-10-03T10:16:41.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.719+0000 7f3dc6d03700 1 --2- 172.21.15.72:0/113790493 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3dc009e410 0x7f3dc01a6930 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.719+0000 7f3dc6d03700 1 --2- 172.21.15.72:0/113790493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3dc009d6f0 0x7f3dc01a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.719+0000 7f3dc6d03700 1 --2- 172.21.15.72:0/113790493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3dc009e000 0x7f3dc01a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.719+0000 7f3dc6d03700 1 -- 172.21.15.72:0/113790493 >> 172.21.15.72:0/113790493 conn(0x7f3dc0066f50 msgr2=0x7f3dc01badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.719+0000 7f3dc6d03700 1 -- 172.21.15.72:0/113790493 shutdown_connections 2023-10-03T10:16:41.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:41.719+0000 7f3dc6d03700 1 -- 172.21.15.72:0/113790493 wait complete. 2023-10-03T10:16:41.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:41.886 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:41.985 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:42.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:42.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.013+0000 7fa10c5ce700 1 Processor -- start 2023-10-03T10:16:42.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.013+0000 7fa10c5ce700 1 -- start start 2023-10-03T10:16:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.013+0000 7fa10c5ce700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa104134630 0x7fa104136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.013+0000 7fa10c5ce700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa104136f50 0x7fa104139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.013+0000 7fa10c5ce700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa10409b4f0 con 0x7fa104131810 2023-10-03T10:16:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.013+0000 7fa10c5ce700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1041313c0 con 0x7fa104136f50 2023-10-03T10:16:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.013+0000 7fa10c5ce700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa10406e8c0 con 0x7fa104134630 2023-10-03T10:16:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.014+0000 7fa109b69700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa104134630 0x7fa104136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.014+0000 7fa10ab6b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa104136f50 0x7fa104139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.014+0000 7fa109b69700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa104134630 0x7fa104136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59516/0 (socket says 172.21.15.72:59516) 2023-10-03T10:16:42.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.014+0000 7fa109b69700 1 -- 172.21.15.72:0/1218564556 learned_addr learned my addr 172.21.15.72:0/1218564556 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.014+0000 7fa10ab6b700 1 -- 172.21.15.72:0/1218564556 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa104134630 msgr2=0x7fa104136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.014+0000 7fa10ab6b700 1 --2- 172.21.15.72:0/1218564556 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa104134630 0x7fa104136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.014+0000 7fa10ab6b700 1 -- 172.21.15.72:0/1218564556 >> v1:172.21.15.72:6789/0 conn(0x7fa104131810 legacy=0x7fa104131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.014+0000 7fa10ab6b700 1 -- 172.21.15.72:0/1218564556 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa104071d20 con 0x7fa104136f50 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.014+0000 7fa109b69700 1 --2- 172.21.15.72:0/1218564556 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa104134630 0x7fa104136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.014+0000 7fa10ab6b700 1 --2- 172.21.15.72:0/1218564556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104136f50 0x7fa104139330 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009d90 tx=0x7fa0fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822b0a4526b49802 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.014+0000 7fa109368700 1 -- 172.21.15.72:0/1218564556 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc00e070 con 0x7fa104136f50 2023-10-03T10:16:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.014+0000 7fa109368700 1 -- 172.21.15.72:0/1218564556 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc00bb20 con 0x7fa104136f50 2023-10-03T10:16:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.014+0000 7fa109368700 1 -- 172.21.15.72:0/1218564556 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc012430 con 0x7fa104136f50 2023-10-03T10:16:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.015+0000 7fa10c5ce700 1 -- 172.21.15.72:0/1218564556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104136f50 msgr2=0x7fa104139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.015+0000 7fa10c5ce700 1 --2- 172.21.15.72:0/1218564556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104136f50 0x7fa104139330 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009d90 tx=0x7fa0fc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.015+0000 7fa10c5ce700 1 -- 172.21.15.72:0/1218564556 shutdown_connections 2023-10-03T10:16:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.015+0000 7fa10c5ce700 1 --2- 172.21.15.72:0/1218564556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104136f50 0x7fa104139330 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.015+0000 7fa10c5ce700 1 --2- 172.21.15.72:0/1218564556 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa104134630 0x7fa104136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.015+0000 7fa10c5ce700 1 -- 172.21.15.72:0/1218564556 >> 172.21.15.72:0/1218564556 conn(0x7fa1040a2aa0 msgr2=0x7fa1040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.016+0000 7fa10c5ce700 1 -- 172.21.15.72:0/1218564556 shutdown_connections 2023-10-03T10:16:42.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.016+0000 7fa10c5ce700 1 -- 172.21.15.72:0/1218564556 wait complete. 2023-10-03T10:16:42.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.016+0000 7fa10c5ce700 1 Processor -- start 2023-10-03T10:16:42.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa10c5ce700 1 -- start start 2023-10-03T10:16:42.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa10c5ce700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa104131810 0x7fa10406fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa10c5ce700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa104134630 0x7fa1040703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa10c5ce700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104136f50 0x7fa1041c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa10c5ce700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10411e580 con 0x7fa104136f50 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa10c5ce700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10411d470 con 0x7fa104131810 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa10c5ce700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa104070900 con 0x7fa104134630 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa109b69700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa104134630 0x7fa1040703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa109b69700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa104134630 0x7fa1040703c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59518/0 (socket says 172.21.15.72:59518) 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa109b69700 1 -- 172.21.15.72:0/801769680 learned_addr learned my addr 172.21.15.72:0/801769680 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa10ab6b700 1 --2- 172.21.15.72:0/801769680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104136f50 0x7fa1041c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa10a36a700 1 --2- 172.21.15.72:0/801769680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa104131810 0x7fa10406fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa109b69700 1 -- 172.21.15.72:0/801769680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa104131810 msgr2=0x7fa10406fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa109b69700 1 --2- 172.21.15.72:0/801769680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa104131810 0x7fa10406fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa109b69700 1 -- 172.21.15.72:0/801769680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104136f50 msgr2=0x7fa1041c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa109b69700 1 --2- 172.21.15.72:0/801769680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104136f50 0x7fa1041c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa109b69700 1 -- 172.21.15.72:0/801769680 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f4009550 con 0x7fa104134630 2023-10-03T10:16:42.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa10a36a700 1 --2- 172.21.15.72:0/801769680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa104131810 0x7fa10406fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:42.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.017+0000 7fa10ab6b700 1 --2- 172.21.15.72:0/801769680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104136f50 0x7fa1041c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.018+0000 7fa109b69700 1 --2- 172.21.15.72:0/801769680 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa104134630 0x7fa1040703c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400ec10 tx=0x7fa0f400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.018+0000 7fa0faffd700 1 -- 172.21.15.72:0/801769680 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f400c850 con 0x7fa104134630 2023-10-03T10:16:42.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.018+0000 7fa0faffd700 1 -- 172.21.15.72:0/801769680 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f400c9b0 con 0x7fa104134630 2023-10-03T10:16:42.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.018+0000 7fa10c5ce700 1 -- 172.21.15.72:0/801769680 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0fc009a70 con 0x7fa104134630 2023-10-03T10:16:42.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.018+0000 7fa0faffd700 1 -- 172.21.15.72:0/801769680 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f400cd20 con 0x7fa104134630 2023-10-03T10:16:42.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.018+0000 7fa10c5ce700 1 -- 172.21.15.72:0/801769680 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10406fac0 con 0x7fa104134630 2023-10-03T10:16:42.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.019+0000 7fa10c5ce700 1 -- 172.21.15.72:0/801769680 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa104074ea0 con 0x7fa104134630 2023-10-03T10:16:42.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.019+0000 7fa0faffd700 1 -- 172.21.15.72:0/801769680 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa0f4004020 con 0x7fa104134630 2023-10-03T10:16:42.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.020+0000 7fa0faffd700 1 -- 172.21.15.72:0/801769680 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa0f403fbe0 con 0x7fa104134630 2023-10-03T10:16:42.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.028+0000 7fa0faffd700 1 -- 172.21.15.72:0/801769680 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0f40042d0 con 0x7fa104134630 2023-10-03T10:16:42.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.116+0000 7f9aef145700 1 Processor -- start 2023-10-03T10:16:42.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.116+0000 7f9aef145700 1 -- start start 2023-10-03T10:16:42.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9aef145700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9ae809d6f0 0x7f9ae809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9aef145700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ae809e410 0x7f9ae8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9aef145700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae809f130 con 0x7f9ae809e000 2023-10-03T10:16:42.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9aef145700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae809f520 con 0x7f9ae809d6f0 2023-10-03T10:16:42.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9aef145700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae809e930 con 0x7f9ae809e410 2023-10-03T10:16:42.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9aecee1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9ae809d6f0 0x7f9ae809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9aecee1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9ae809d6f0 0x7f9ae809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33018/0 (socket says 172.21.15.72:33018) 2023-10-03T10:16:42.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9aed6e2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ae809e410 0x7f9ae8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9aecee1700 1 -- 172.21.15.72:0/2047483208 learned_addr learned my addr 172.21.15.72:0/2047483208 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:42.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9aed6e2700 1 -- 172.21.15.72:0/2047483208 >> v2:172.21.15.72:3300/0 conn(0x7f9ae809d6f0 msgr2=0x7f9ae809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9aed6e2700 1 --2- 172.21.15.72:0/2047483208 >> v2:172.21.15.72:3300/0 conn(0x7f9ae809d6f0 0x7f9ae809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9aed6e2700 1 -- 172.21.15.72:0/2047483208 >> v1:172.21.15.72:6789/0 conn(0x7f9ae809e000 legacy=0x7f9ae8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9aed6e2700 1 -- 172.21.15.72:0/2047483208 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae809b2d0 con 0x7f9ae809e410 2023-10-03T10:16:42.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9aecee1700 1 --2- 172.21.15.72:0/2047483208 >> v2:172.21.15.72:3300/0 conn(0x7f9ae809d6f0 0x7f9ae809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9aed6e2700 1 --2- 172.21.15.72:0/2047483208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ae809e410 0x7f9ae8130d70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009d90 tx=0x7f9ae000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31c2f79aa7105880 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.117+0000 7f9ae77fe700 1 -- 172.21.15.72:0/2047483208 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae000bd20 con 0x7f9ae809e410 2023-10-03T10:16:42.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.118+0000 7f9ae77fe700 1 -- 172.21.15.72:0/2047483208 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae000be80 con 0x7f9ae809e410 2023-10-03T10:16:42.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.118+0000 7f9ae77fe700 1 -- 172.21.15.72:0/2047483208 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae00116a0 con 0x7f9ae809e410 2023-10-03T10:16:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.118+0000 7f9aef145700 1 -- 172.21.15.72:0/2047483208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ae809e410 msgr2=0x7f9ae8130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.118+0000 7f9aef145700 1 --2- 172.21.15.72:0/2047483208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ae809e410 0x7f9ae8130d70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009d90 tx=0x7f9ae000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.118+0000 7f9aef145700 1 -- 172.21.15.72:0/2047483208 shutdown_connections 2023-10-03T10:16:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.118+0000 7f9aef145700 1 --2- 172.21.15.72:0/2047483208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ae809e410 0x7f9ae8130d70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.118+0000 7f9aef145700 1 --2- 172.21.15.72:0/2047483208 >> v2:172.21.15.72:3300/0 conn(0x7f9ae809d6f0 0x7f9ae809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.118+0000 7f9aef145700 1 -- 172.21.15.72:0/2047483208 >> 172.21.15.72:0/2047483208 conn(0x7f9ae8066f50 msgr2=0x7f9ae809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.118+0000 7f9aef145700 1 -- 172.21.15.72:0/2047483208 shutdown_connections 2023-10-03T10:16:42.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.118+0000 7f9aef145700 1 -- 172.21.15.72:0/2047483208 wait complete. 2023-10-03T10:16:42.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.119+0000 7f9aef145700 1 Processor -- start 2023-10-03T10:16:42.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.119+0000 7f9aef145700 1 -- start start 2023-10-03T10:16:42.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9aef145700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae809d6f0 0x7f9ae81c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9aef145700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ae809e000 0x7f9ae81c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9aef145700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ae809e410 0x7f9ae81229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9aef145700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae8127030 con 0x7f9ae809d6f0 2023-10-03T10:16:42.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9aef145700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae8126200 con 0x7f9ae809e000 2023-10-03T10:16:42.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9aef145700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae8126450 con 0x7f9ae809e410 2023-10-03T10:16:42.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9ae7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ae809e000 0x7f9ae81c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9aecee1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae809d6f0 0x7f9ae81c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9ae7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ae809e000 0x7f9ae81c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49042/0 (socket says 172.21.15.72:49042) 2023-10-03T10:16:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9ae7fff700 1 -- 172.21.15.72:0/3775494630 learned_addr learned my addr 172.21.15.72:0/3775494630 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9aed6e2700 1 --2- 172.21.15.72:0/3775494630 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ae809e410 0x7f9ae81229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9aecee1700 1 -- 172.21.15.72:0/3775494630 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ae809e410 msgr2=0x7f9ae81229d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9aecee1700 1 --2- 172.21.15.72:0/3775494630 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ae809e410 0x7f9ae81229d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9aecee1700 1 -- 172.21.15.72:0/3775494630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ae809e000 msgr2=0x7f9ae81c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9aecee1700 1 --2- 172.21.15.72:0/3775494630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ae809e000 0x7f9ae81c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9aecee1700 1 -- 172.21.15.72:0/3775494630 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc009550 con 0x7f9ae809d6f0 2023-10-03T10:16:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.120+0000 7f9aecee1700 1 --2- 172.21.15.72:0/3775494630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae809d6f0 0x7f9ae81c8810 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00e980 tx=0x7f9adc00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.121+0000 7f9ae57fa700 1 -- 172.21.15.72:0/3775494630 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc004030 con 0x7f9ae809d6f0 2023-10-03T10:16:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.121+0000 7f9ae57fa700 1 -- 172.21.15.72:0/3775494630 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9adc004190 con 0x7f9ae809d6f0 2023-10-03T10:16:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.121+0000 7f9aef145700 1 -- 172.21.15.72:0/3775494630 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae0009a70 con 0x7f9ae809d6f0 2023-10-03T10:16:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.121+0000 7f9ae57fa700 1 -- 172.21.15.72:0/3775494630 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc004520 con 0x7f9ae809d6f0 2023-10-03T10:16:42.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.121+0000 7f9aef145700 1 -- 172.21.15.72:0/3775494630 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae809c700 con 0x7f9ae809d6f0 2023-10-03T10:16:42.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.122+0000 7f9ae57fa700 1 -- 172.21.15.72:0/3775494630 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9adc0036a0 con 0x7f9ae809d6f0 2023-10-03T10:16:42.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.122+0000 7f9aef145700 1 -- 172.21.15.72:0/3775494630 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae8074ea0 con 0x7f9ae809d6f0 2023-10-03T10:16:42.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.122+0000 7f9ae57fa700 1 -- 172.21.15.72:0/3775494630 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9adc03f860 con 0x7f9ae809d6f0 2023-10-03T10:16:42.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.126+0000 7f9ae57fa700 1 -- 172.21.15.72:0/3775494630 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9adc011bd0 con 0x7f9ae809d6f0 2023-10-03T10:16:42.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.140+0000 7f4fc8e58700 1 Processor -- start 2023-10-03T10:16:42.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.140+0000 7f4fc8e58700 1 -- start start 2023-10-03T10:16:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc8e58700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4fc409e850 0x7f4fc409ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc8e58700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fc409f5b0 0x7f4fc4134300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc8e58700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc406bf30 con 0x7f4fc409f160 2023-10-03T10:16:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc8e58700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc409ffb0 con 0x7f4fc409f5b0 2023-10-03T10:16:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc8e58700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc406cb10 con 0x7f4fc409e850 2023-10-03T10:16:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc1d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4fc409f160 0x7f4fc4133bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42158/0 (socket says 172.21.15.72:42158) 2023-10-03T10:16:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc1d9b700 1 -- 172.21.15.72:0/73353385 learned_addr learned my addr 172.21.15.72:0/73353385 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc259c700 1 --2- 172.21.15.72:0/73353385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4fc409e850 0x7f4fc409ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc2d9d700 1 --2- 172.21.15.72:0/73353385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fc409f5b0 0x7f4fc4134300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc159a700 1 -- 172.21.15.72:0/73353385 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767807282 0 0) 0x7f4fc406bf30 con 0x7f4fc409f160 2023-10-03T10:16:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc159a700 1 -- 172.21.15.72:0/73353385 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fac0035b0 con 0x7f4fc409f160 2023-10-03T10:16:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc259c700 1 -- 172.21.15.72:0/73353385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fc409f5b0 msgr2=0x7f4fc4134300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc259c700 1 --2- 172.21.15.72:0/73353385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fc409f5b0 0x7f4fc4134300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc259c700 1 -- 172.21.15.72:0/73353385 >> v1:172.21.15.72:6789/0 conn(0x7f4fc409f160 legacy=0x7f4fc4133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc259c700 1 -- 172.21.15.72:0/73353385 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc40a0270 con 0x7f4fc409e850 2023-10-03T10:16:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.141+0000 7f4fc259c700 1 --2- 172.21.15.72:0/73353385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4fc409e850 0x7f4fc409ec20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009870 tx=0x7f4fb4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b184c55f4163af63 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.142+0000 7f4fc159a700 1 -- 172.21.15.72:0/73353385 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4011830 con 0x7f4fc409e850 2023-10-03T10:16:42.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.142+0000 7f4fc159a700 1 -- 172.21.15.72:0/73353385 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb4011990 con 0x7f4fc409e850 2023-10-03T10:16:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.142+0000 7f4fc159a700 1 -- 172.21.15.72:0/73353385 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4011d20 con 0x7f4fc409e850 2023-10-03T10:16:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.142+0000 7f4fc8e58700 1 -- 172.21.15.72:0/73353385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4fc409e850 msgr2=0x7f4fc409ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.142+0000 7f4fc8e58700 1 --2- 172.21.15.72:0/73353385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4fc409e850 0x7f4fc409ec20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009870 tx=0x7f4fb4009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.142+0000 7f4fc8e58700 1 -- 172.21.15.72:0/73353385 shutdown_connections 2023-10-03T10:16:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.142+0000 7f4fc8e58700 1 --2- 172.21.15.72:0/73353385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fc409f5b0 0x7f4fc4134300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.142+0000 7f4fc8e58700 1 --2- 172.21.15.72:0/73353385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4fc409e850 0x7f4fc409ec20 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.142+0000 7f4fc8e58700 1 -- 172.21.15.72:0/73353385 >> 172.21.15.72:0/73353385 conn(0x7f4fc40a3f70 msgr2=0x7f4fc40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.142+0000 7f4fc8e58700 1 -- 172.21.15.72:0/73353385 shutdown_connections 2023-10-03T10:16:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.142+0000 7f4fc8e58700 1 -- 172.21.15.72:0/73353385 wait complete. 2023-10-03T10:16:42.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.143+0000 7f4fc8e58700 1 Processor -- start 2023-10-03T10:16:42.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.143+0000 7f4fc8e58700 1 -- start start 2023-10-03T10:16:42.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc8e58700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fc409e850 0x7f4fc4122580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc8e58700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fc409f160 0x7f4fc4122ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc8e58700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4fc409f5b0 0x7f4fc4123000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc8e58700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc406cd30 con 0x7f4fc409e850 2023-10-03T10:16:42.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc8e58700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4125dc0 con 0x7f4fc409f160 2023-10-03T10:16:42.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc8e58700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4133970 con 0x7f4fc409f5b0 2023-10-03T10:16:42.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fc409e850 0x7f4fc4122580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc1d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fc409f160 0x7f4fc4122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fc409e850 0x7f4fc4122580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33026/0 (socket says 172.21.15.72:33026) 2023-10-03T10:16:42.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc1d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fc409f160 0x7f4fc4122ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49064/0 (socket says 172.21.15.72:49064) 2023-10-03T10:16:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc259c700 1 -- 172.21.15.72:0/1183194985 learned_addr learned my addr 172.21.15.72:0/1183194985 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc2d9d700 1 --2- 172.21.15.72:0/1183194985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4fc409f5b0 0x7f4fc4123000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc1d9b700 1 -- 172.21.15.72:0/1183194985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4fc409f5b0 msgr2=0x7f4fc4123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc1d9b700 1 --2- 172.21.15.72:0/1183194985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4fc409f5b0 0x7f4fc4123000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc1d9b700 1 -- 172.21.15.72:0/1183194985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fc409e850 msgr2=0x7f4fc4122580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc1d9b700 1 --2- 172.21.15.72:0/1183194985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fc409e850 0x7f4fc4122580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc1d9b700 1 -- 172.21.15.72:0/1183194985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb40094a0 con 0x7f4fc409f160 2023-10-03T10:16:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc259c700 1 --2- 172.21.15.72:0/1183194985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fc409e850 0x7f4fc4122580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.144+0000 7f4fc2d9d700 1 --2- 172.21.15.72:0/1183194985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4fc409f5b0 0x7f4fc4123000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.145+0000 7f4fc1d9b700 1 --2- 172.21.15.72:0/1183194985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fc409f160 0x7f4fc4122ac0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800c460 tx=0x7f4fb800c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.145+0000 7f4fb2ffd700 1 -- 172.21.15.72:0/1183194985 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8005d70 con 0x7f4fc409f160 2023-10-03T10:16:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.145+0000 7f4fb2ffd700 1 -- 172.21.15.72:0/1183194985 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb80070d0 con 0x7f4fc409f160 2023-10-03T10:16:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.145+0000 7f4fc8e58700 1 -- 172.21.15.72:0/1183194985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc406f810 con 0x7f4fc409f160 2023-10-03T10:16:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.145+0000 7f4fb2ffd700 1 -- 172.21.15.72:0/1183194985 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8007440 con 0x7f4fc409f160 2023-10-03T10:16:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.145+0000 7f4fc8e58700 1 -- 172.21.15.72:0/1183194985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc4126830 con 0x7f4fc409f160 2023-10-03T10:16:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.146+0000 7f4fc8e58700 1 -- 172.21.15.72:0/1183194985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc40747f0 con 0x7f4fc409f160 2023-10-03T10:16:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.146+0000 7f4fb2ffd700 1 -- 172.21.15.72:0/1183194985 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fb80075a0 con 0x7f4fc409f160 2023-10-03T10:16:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.147+0000 7f4fb2ffd700 1 -- 172.21.15.72:0/1183194985 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4fb803eb80 con 0x7f4fc409f160 2023-10-03T10:16:42.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.151+0000 7f4fb2ffd700 1 -- 172.21.15.72:0/1183194985 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fb8018af0 con 0x7f4fc409f160 2023-10-03T10:16:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.237+0000 7fa10c5ce700 1 -- 172.21.15.72:0/801769680 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa104136cb0 con 0x7fa104134630 2023-10-03T10:16:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.237+0000 7fa0faffd700 1 -- 172.21.15.72:0/801769680 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa0f4021070 con 0x7fa104134630 2023-10-03T10:16:42.239 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.240+0000 7fa10c5ce700 1 -- 172.21.15.72:0/801769680 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa104134630 msgr2=0x7fa1040703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.240+0000 7fa10c5ce700 1 --2- 172.21.15.72:0/801769680 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa104134630 0x7fa1040703c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400ec10 tx=0x7fa0f400ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.240+0000 7fa10c5ce700 1 -- 172.21.15.72:0/801769680 shutdown_connections 2023-10-03T10:16:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.240+0000 7fa10c5ce700 1 --2- 172.21.15.72:0/801769680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104136f50 0x7fa1041c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.240+0000 7fa10c5ce700 1 --2- 172.21.15.72:0/801769680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa104131810 0x7fa10406fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.240+0000 7fa10c5ce700 1 --2- 172.21.15.72:0/801769680 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa104134630 0x7fa1040703c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.240+0000 7fa10c5ce700 1 -- 172.21.15.72:0/801769680 >> 172.21.15.72:0/801769680 conn(0x7fa1040a2aa0 msgr2=0x7fa1041331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.240+0000 7fa10c5ce700 1 -- 172.21.15.72:0/801769680 shutdown_connections 2023-10-03T10:16:42.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.240+0000 7fa10c5ce700 1 -- 172.21.15.72:0/801769680 wait complete. 2023-10-03T10:16:42.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:42.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.330+0000 7f9aef145700 1 -- 172.21.15.72:0/3775494630 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9ae8124d30 con 0x7f9ae809d6f0 2023-10-03T10:16:42.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.331+0000 7f9ae57fa700 1 -- 172.21.15.72:0/3775494630 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9adc011e00 con 0x7f9ae809d6f0 2023-10-03T10:16:42.330 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:42.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.332+0000 7f9aef145700 1 -- 172.21.15.72:0/3775494630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae809d6f0 msgr2=0x7f9ae81c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.332+0000 7f9aef145700 1 --2- 172.21.15.72:0/3775494630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae809d6f0 0x7f9ae81c8810 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00e980 tx=0x7f9adc00ec90 comp rx=0 tx=0).stop 2023-10-03T10:16:42.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.333+0000 7f9aef145700 1 -- 172.21.15.72:0/3775494630 shutdown_connections 2023-10-03T10:16:42.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.333+0000 7f9aef145700 1 --2- 172.21.15.72:0/3775494630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ae809d6f0 0x7f9ae81c8810 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.333+0000 7f9aef145700 1 --2- 172.21.15.72:0/3775494630 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ae809e410 0x7f9ae81229d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.333+0000 7f9aef145700 1 --2- 172.21.15.72:0/3775494630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ae809e000 0x7f9ae81c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.333+0000 7f9aef145700 1 -- 172.21.15.72:0/3775494630 >> 172.21.15.72:0/3775494630 conn(0x7f9ae8066f50 msgr2=0x7f9ae80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.333+0000 7f9aef145700 1 -- 172.21.15.72:0/3775494630 shutdown_connections 2023-10-03T10:16:42.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.333+0000 7f9aef145700 1 -- 172.21.15.72:0/3775494630 wait complete. 2023-10-03T10:16:42.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:42.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.353+0000 7f4fc8e58700 1 -- 172.21.15.72:0/1183194985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4fc406bbb0 con 0x7f4fc409f160 2023-10-03T10:16:42.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.354+0000 7f4fb2ffd700 1 -- 172.21.15.72:0/1183194985 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4fb8017020 con 0x7f4fc409f160 2023-10-03T10:16:42.353 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.356+0000 7f4fc8e58700 1 -- 172.21.15.72:0/1183194985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fc409f160 msgr2=0x7f4fc4122ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.356+0000 7f4fc8e58700 1 --2- 172.21.15.72:0/1183194985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fc409f160 0x7f4fc4122ac0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800c460 tx=0x7f4fb800c770 comp rx=0 tx=0).stop 2023-10-03T10:16:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.356+0000 7f4fc8e58700 1 -- 172.21.15.72:0/1183194985 shutdown_connections 2023-10-03T10:16:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.356+0000 7f4fc8e58700 1 --2- 172.21.15.72:0/1183194985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fc409e850 0x7f4fc4122580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.356+0000 7f4fc8e58700 1 --2- 172.21.15.72:0/1183194985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4fc409f5b0 0x7f4fc4123000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.356+0000 7f4fc8e58700 1 --2- 172.21.15.72:0/1183194985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4fc409f160 0x7f4fc4122ac0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.356+0000 7f4fc8e58700 1 -- 172.21.15.72:0/1183194985 >> 172.21.15.72:0/1183194985 conn(0x7f4fc40a3f70 msgr2=0x7f4fc409d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.356+0000 7f4fc8e58700 1 -- 172.21.15.72:0/1183194985 shutdown_connections 2023-10-03T10:16:42.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.356+0000 7f4fc8e58700 1 -- 172.21.15.72:0/1183194985 wait complete. 2023-10-03T10:16:42.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:42.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:42.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.855+0000 7f309cd62700 1 Processor -- start 2023-10-03T10:16:42.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.855+0000 7f309cd62700 1 -- start start 2023-10-03T10:16:42.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.855+0000 7f309cd62700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3098136830 0x7f3098138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.855+0000 7f309cd62700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3098139150 0x7f309813b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.855+0000 7f309cd62700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309806f720 con 0x7f30981338c0 2023-10-03T10:16:42.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.855+0000 7f309cd62700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3098070c80 con 0x7f3098139150 2023-10-03T10:16:42.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.855+0000 7f309cd62700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309806fce0 con 0x7f3098136830 2023-10-03T10:16:42.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.855+0000 7f3096d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3098139150 0x7f309813b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.855+0000 7f3095d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3098136830 0x7f3098138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.855+0000 7f3096d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3098139150 0x7f309813b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33030/0 (socket says 172.21.15.72:33030) 2023-10-03T10:16:42.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.855+0000 7f3095d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3098136830 0x7f3098138c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49070/0 (socket says 172.21.15.72:49070) 2023-10-03T10:16:42.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.855+0000 7f3096d9d700 1 -- 172.21.15.72:0/2556197215 learned_addr learned my addr 172.21.15.72:0/2556197215 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:42.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.856+0000 7f3096d9d700 1 -- 172.21.15.72:0/2556197215 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3098136830 msgr2=0x7f3098138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.856+0000 7f3096d9d700 1 --2- 172.21.15.72:0/2556197215 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3098136830 0x7f3098138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.856+0000 7f3096d9d700 1 -- 172.21.15.72:0/2556197215 >> v1:172.21.15.72:6789/0 conn(0x7f30981338c0 legacy=0x7f3098133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.856+0000 7f3096d9d700 1 -- 172.21.15.72:0/2556197215 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30981336a0 con 0x7f3098139150 2023-10-03T10:16:42.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.856+0000 7f3095d9b700 1 --2- 172.21.15.72:0/2556197215 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3098136830 0x7f3098138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.856+0000 7f3096d9d700 1 --2- 172.21.15.72:0/2556197215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3098139150 0x7f309813b530 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f3090009e50 tx=0x7f309000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1c9f494fcc7d83 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.856+0000 7f309559a700 1 -- 172.21.15.72:0/2556197215 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309000e070 con 0x7f3098139150 2023-10-03T10:16:42.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.856+0000 7f309559a700 1 -- 172.21.15.72:0/2556197215 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309000b910 con 0x7f3098139150 2023-10-03T10:16:42.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.856+0000 7f309559a700 1 -- 172.21.15.72:0/2556197215 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309000bcc0 con 0x7f3098139150 2023-10-03T10:16:42.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.857+0000 7f309cd62700 1 -- 172.21.15.72:0/2556197215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3098139150 msgr2=0x7f309813b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.857+0000 7f309cd62700 1 --2- 172.21.15.72:0/2556197215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3098139150 0x7f309813b530 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f3090009e50 tx=0x7f309000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:42.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.857+0000 7f309cd62700 1 -- 172.21.15.72:0/2556197215 shutdown_connections 2023-10-03T10:16:42.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.857+0000 7f309cd62700 1 --2- 172.21.15.72:0/2556197215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3098139150 0x7f309813b530 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.857+0000 7f309cd62700 1 --2- 172.21.15.72:0/2556197215 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3098136830 0x7f3098138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.857+0000 7f309cd62700 1 -- 172.21.15.72:0/2556197215 >> 172.21.15.72:0/2556197215 conn(0x7f30980a2aa0 msgr2=0x7f30980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.857+0000 7f309cd62700 1 -- 172.21.15.72:0/2556197215 shutdown_connections 2023-10-03T10:16:42.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.857+0000 7f309cd62700 1 -- 172.21.15.72:0/2556197215 wait complete. 2023-10-03T10:16:42.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.858+0000 7f309cd62700 1 Processor -- start 2023-10-03T10:16:42.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.858+0000 7f309cd62700 1 -- start start 2023-10-03T10:16:42.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.858+0000 7f309cd62700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30981338c0 0x7f309812dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.858+0000 7f309cd62700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3098136830 0x7f309812e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.858+0000 7f309cd62700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3098139150 0x7f3098118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.858+0000 7f309cd62700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309811aed0 con 0x7f3098136830 2023-10-03T10:16:42.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.858+0000 7f309cd62700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3098136070 con 0x7f3098139150 2023-10-03T10:16:42.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.858+0000 7f309cd62700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f309811a9c0 con 0x7f30981338c0 2023-10-03T10:16:42.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.858+0000 7f3095d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3098136830 0x7f309812e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.858+0000 7f3095d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3098136830 0x7f309812e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33044/0 (socket says 172.21.15.72:33044) 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.858+0000 7f309659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30981338c0 0x7f309812dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.858+0000 7f3095d9b700 1 -- 172.21.15.72:0/2077273084 learned_addr learned my addr 172.21.15.72:0/2077273084 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.858+0000 7f3096d9d700 1 --2- 172.21.15.72:0/2077273084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3098139150 0x7f3098118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.859+0000 7f3095d9b700 1 -- 172.21.15.72:0/2077273084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30981338c0 msgr2=0x7f309812dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.859+0000 7f3095d9b700 1 --2- 172.21.15.72:0/2077273084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30981338c0 0x7f309812dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.859+0000 7f3095d9b700 1 -- 172.21.15.72:0/2077273084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3098139150 msgr2=0x7f3098118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.859+0000 7f3095d9b700 1 --2- 172.21.15.72:0/2077273084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3098139150 0x7f3098118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.859+0000 7f3095d9b700 1 -- 172.21.15.72:0/2077273084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30880094a0 con 0x7f3098136830 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.859+0000 7f309659c700 1 --2- 172.21.15.72:0/2077273084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30981338c0 0x7f309812dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.859+0000 7f3095d9b700 1 --2- 172.21.15.72:0/2077273084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3098136830 0x7f309812e1d0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f308800ebe0 tx=0x7f308800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.859+0000 7f308effd700 1 -- 172.21.15.72:0/2077273084 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30880097a0 con 0x7f3098136830 2023-10-03T10:16:42.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.859+0000 7f308effd700 1 -- 172.21.15.72:0/2077273084 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308800c850 con 0x7f3098136830 2023-10-03T10:16:42.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.859+0000 7f308effd700 1 -- 172.21.15.72:0/2077273084 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308800cbe0 con 0x7f3098136830 2023-10-03T10:16:42.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.859+0000 7f309cd62700 1 -- 172.21.15.72:0/2077273084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3090009b30 con 0x7f3098136830 2023-10-03T10:16:42.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.859+0000 7f309cd62700 1 -- 172.21.15.72:0/2077273084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309811b110 con 0x7f3098136830 2023-10-03T10:16:42.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.860+0000 7f308effd700 1 -- 172.21.15.72:0/2077273084 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f308800cd40 con 0x7f3098136830 2023-10-03T10:16:42.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.860+0000 7f309cd62700 1 -- 172.21.15.72:0/2077273084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3098074ea0 con 0x7f3098136830 2023-10-03T10:16:42.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.860+0000 7f308effd700 1 -- 172.21.15.72:0/2077273084 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f308803f510 con 0x7f3098136830 2023-10-03T10:16:42.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:42.864+0000 7f308effd700 1 -- 172.21.15.72:0/2077273084 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30880102b0 con 0x7f3098136830 2023-10-03T10:16:43.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.047+0000 7f309cd62700 1 -- 172.21.15.72:0/2077273084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f309811c1f0 con 0x7f3098136830 2023-10-03T10:16:43.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.047+0000 7f308effd700 1 -- 172.21.15.72:0/2077273084 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f309811c1f0 con 0x7f3098136830 2023-10-03T10:16:43.047 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.050+0000 7f309cd62700 1 -- 172.21.15.72:0/2077273084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3098136830 msgr2=0x7f309812e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.050+0000 7f309cd62700 1 --2- 172.21.15.72:0/2077273084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3098136830 0x7f309812e1d0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f308800ebe0 tx=0x7f308800eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.050+0000 7f309cd62700 1 -- 172.21.15.72:0/2077273084 shutdown_connections 2023-10-03T10:16:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.050+0000 7f309cd62700 1 --2- 172.21.15.72:0/2077273084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3098139150 0x7f3098118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.050+0000 7f309cd62700 1 --2- 172.21.15.72:0/2077273084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f30981338c0 0x7f309812dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.050+0000 7f309cd62700 1 --2- 172.21.15.72:0/2077273084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3098136830 0x7f309812e1d0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.050+0000 7f309cd62700 1 -- 172.21.15.72:0/2077273084 >> 172.21.15.72:0/2077273084 conn(0x7f30980a2aa0 msgr2=0x7f309812f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.050+0000 7f309cd62700 1 -- 172.21.15.72:0/2077273084 shutdown_connections 2023-10-03T10:16:43.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.050+0000 7f309cd62700 1 -- 172.21.15.72:0/2077273084 wait complete. 2023-10-03T10:16:43.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:43.257 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:43.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:43.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:43.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.383+0000 7f34dc853700 1 Processor -- start 2023-10-03T10:16:43.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.383+0000 7f34dc853700 1 -- start start 2023-10-03T10:16:43.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.383+0000 7f34dc853700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34d80a0a30 0x7f34d80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.383+0000 7f34dc853700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34d8138d80 0x7f34d813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.383+0000 7f34dc853700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d80a2a70 con 0x7f34d809d630 2023-10-03T10:16:43.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.383+0000 7f34dc853700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d80a01d0 con 0x7f34d8138d80 2023-10-03T10:16:43.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.383+0000 7f34dc853700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d809e2b0 con 0x7f34d80a0a30 2023-10-03T10:16:43.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.384+0000 7f34d6d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34d8138d80 0x7f34d813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.384+0000 7f34d659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34d80a0a30 0x7f34d80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.384+0000 7f34d659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34d80a0a30 0x7f34d80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49090/0 (socket says 172.21.15.72:49090) 2023-10-03T10:16:43.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.384+0000 7f34d6d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34d8138d80 0x7f34d813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33056/0 (socket says 172.21.15.72:33056) 2023-10-03T10:16:43.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.384+0000 7f34d659c700 1 -- 172.21.15.72:0/1670903726 learned_addr learned my addr 172.21.15.72:0/1670903726 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:43.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.384+0000 7f34d6d9d700 1 -- 172.21.15.72:0/1670903726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34d80a0a30 msgr2=0x7f34d80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.384+0000 7f34d6d9d700 1 --2- 172.21.15.72:0/1670903726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34d80a0a30 0x7f34d80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.384+0000 7f34d6d9d700 1 -- 172.21.15.72:0/1670903726 >> v1:172.21.15.72:6789/0 conn(0x7f34d809d630 legacy=0x7f34d80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.384+0000 7f34d6d9d700 1 -- 172.21.15.72:0/1670903726 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d809dc50 con 0x7f34d8138d80 2023-10-03T10:16:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.384+0000 7f34d559a700 1 -- 172.21.15.72:0/1670903726 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539917415 0 0) 0x7f34d80a2a70 con 0x7f34d809d630 2023-10-03T10:16:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.384+0000 7f34d659c700 1 --2- 172.21.15.72:0/1670903726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34d80a0a30 0x7f34d80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.384+0000 7f34d6d9d700 1 --2- 172.21.15.72:0/1670903726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d8138d80 0x7f34d813b160 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009d90 tx=0x7f34d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8049cd48d99e377 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.384+0000 7f34d559a700 1 -- 172.21.15.72:0/1670903726 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d000e070 con 0x7f34d8138d80 2023-10-03T10:16:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.384+0000 7f34d559a700 1 -- 172.21.15.72:0/1670903726 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d000bb20 con 0x7f34d8138d80 2023-10-03T10:16:43.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.384+0000 7f34d559a700 1 -- 172.21.15.72:0/1670903726 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0012430 con 0x7f34d8138d80 2023-10-03T10:16:43.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.385+0000 7f34dc853700 1 -- 172.21.15.72:0/1670903726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d8138d80 msgr2=0x7f34d813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.385+0000 7f34dc853700 1 --2- 172.21.15.72:0/1670903726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d8138d80 0x7f34d813b160 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f34d0009d90 tx=0x7f34d000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:43.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.385+0000 7f34dc853700 1 -- 172.21.15.72:0/1670903726 shutdown_connections 2023-10-03T10:16:43.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.385+0000 7f34dc853700 1 --2- 172.21.15.72:0/1670903726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d8138d80 0x7f34d813b160 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.385+0000 7f34dc853700 1 --2- 172.21.15.72:0/1670903726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34d80a0a30 0x7f34d80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.385+0000 7f34dc853700 1 -- 172.21.15.72:0/1670903726 >> 172.21.15.72:0/1670903726 conn(0x7f34d80a3050 msgr2=0x7f34d80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.385+0000 7f34dc853700 1 -- 172.21.15.72:0/1670903726 shutdown_connections 2023-10-03T10:16:43.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.385+0000 7f34dc853700 1 -- 172.21.15.72:0/1670903726 wait complete. 2023-10-03T10:16:43.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.386+0000 7f34dc853700 1 Processor -- start 2023-10-03T10:16:43.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.386+0000 7f34dc853700 1 -- start start 2023-10-03T10:16:43.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.386+0000 7f34dc853700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34d809d630 0x7f34d8133690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.386+0000 7f34dc853700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34d80a0a30 0x7f34d8133bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.386+0000 7f34dc853700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d8138d80 0x7f34d8134110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.386+0000 7f34dc853700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d81361b0 con 0x7f34d8138d80 2023-10-03T10:16:43.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34dc853700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d8136ed0 con 0x7f34d809d630 2023-10-03T10:16:43.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34dc853700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80a4b60 con 0x7f34d80a0a30 2023-10-03T10:16:43.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34d5d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34d80a0a30 0x7f34d8133bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34d6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d8138d80 0x7f34d8134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34d5d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34d80a0a30 0x7f34d8133bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59562/0 (socket says 172.21.15.72:59562) 2023-10-03T10:16:43.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34d5d9b700 1 -- 172.21.15.72:0/3618635142 learned_addr learned my addr 172.21.15.72:0/3618635142 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:43.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34d659c700 1 --2- 172.21.15.72:0/3618635142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34d809d630 0x7f34d8133690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34d5d9b700 1 -- 172.21.15.72:0/3618635142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34d809d630 msgr2=0x7f34d8133690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34d5d9b700 1 --2- 172.21.15.72:0/3618635142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34d809d630 0x7f34d8133690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34d5d9b700 1 -- 172.21.15.72:0/3618635142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d8138d80 msgr2=0x7f34d8134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34d5d9b700 1 --2- 172.21.15.72:0/3618635142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d8138d80 0x7f34d8134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34d5d9b700 1 -- 172.21.15.72:0/3618635142 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c8009550 con 0x7f34d80a0a30 2023-10-03T10:16:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34d659c700 1 --2- 172.21.15.72:0/3618635142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34d809d630 0x7f34d8133690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34d5d9b700 1 --2- 172.21.15.72:0/3618635142 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34d80a0a30 0x7f34d8133bd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00c580 tx=0x7f34cc00c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34c6ffd700 1 -- 172.21.15.72:0/3618635142 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0054e0 con 0x7f34d80a0a30 2023-10-03T10:16:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34c6ffd700 1 -- 172.21.15.72:0/3618635142 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc003680 con 0x7f34d80a0a30 2023-10-03T10:16:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34c6ffd700 1 -- 172.21.15.72:0/3618635142 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc003a30 con 0x7f34d80a0a30 2023-10-03T10:16:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.387+0000 7f34dc853700 1 -- 172.21.15.72:0/3618635142 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d0009a70 con 0x7f34d80a0a30 2023-10-03T10:16:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.388+0000 7f34dc853700 1 -- 172.21.15.72:0/3618635142 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d8136560 con 0x7f34d80a0a30 2023-10-03T10:16:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.388+0000 7f34c6ffd700 1 -- 172.21.15.72:0/3618635142 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f34cc003b90 con 0x7f34d80a0a30 2023-10-03T10:16:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.388+0000 7f34c6ffd700 1 -- 172.21.15.72:0/3618635142 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f34cc03ea80 con 0x7f34d80a0a30 2023-10-03T10:16:43.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.389+0000 7f34dc853700 1 -- 172.21.15.72:0/3618635142 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d8137a00 con 0x7f34d80a0a30 2023-10-03T10:16:43.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.397+0000 7f34c6ffd700 1 -- 172.21.15.72:0/3618635142 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34cc017080 con 0x7f34d80a0a30 2023-10-03T10:16:43.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.477+0000 7f3bc8d36700 1 Processor -- start 2023-10-03T10:16:43.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.477+0000 7f3bc8d36700 1 -- start start 2023-10-03T10:16:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.477+0000 7f3bc8d36700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bc41316c0 0x7f3bc4131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc8d36700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bc409d9f0 0x7f3bc406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc8d36700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bc406acb0 0x7f3bc406b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc8d36700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc409e130 con 0x7f3bc406acb0 2023-10-03T10:16:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc8d36700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc41312b0 con 0x7f3bc409d9f0 2023-10-03T10:16:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc8d36700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc409f6e0 con 0x7f3bc41316c0 2023-10-03T10:16:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bc406acb0 0x7f3bc406b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bc41316c0 0x7f3bc4131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bc406acb0 0x7f3bc406b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33070/0 (socket says 172.21.15.72:33070) 2023-10-03T10:16:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc2d9d700 1 -- 172.21.15.72:0/79304176 learned_addr learned my addr 172.21.15.72:0/79304176 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc1d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bc409d9f0 0x7f3bc406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc2d9d700 1 -- 172.21.15.72:0/79304176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bc41316c0 msgr2=0x7f3bc4131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc2d9d700 1 --2- 172.21.15.72:0/79304176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bc41316c0 0x7f3bc4131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc2d9d700 1 -- 172.21.15.72:0/79304176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bc409d9f0 msgr2=0x7f3bc406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc2d9d700 1 --2- 172.21.15.72:0/79304176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bc409d9f0 0x7f3bc406a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc2d9d700 1 -- 172.21.15.72:0/79304176 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc409e760 con 0x7f3bc406acb0 2023-10-03T10:16:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc259c700 1 --2- 172.21.15.72:0/79304176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bc41316c0 0x7f3bc4131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc1d9b700 1 --2- 172.21.15.72:0/79304176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bc409d9f0 0x7f3bc406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc2d9d700 1 --2- 172.21.15.72:0/79304176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc406acb0 0x7f3bc406b110 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009e50 tx=0x7f3bbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63f07308ee9415c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc159a700 1 -- 172.21.15.72:0/79304176 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00e070 con 0x7f3bc406acb0 2023-10-03T10:16:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc159a700 1 -- 172.21.15.72:0/79304176 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc00b910 con 0x7f3bc406acb0 2023-10-03T10:16:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.478+0000 7f3bc159a700 1 -- 172.21.15.72:0/79304176 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00bcc0 con 0x7f3bc406acb0 2023-10-03T10:16:43.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.479+0000 7f3bc8d36700 1 -- 172.21.15.72:0/79304176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc406acb0 msgr2=0x7f3bc406b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.479+0000 7f3bc8d36700 1 --2- 172.21.15.72:0/79304176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc406acb0 0x7f3bc406b110 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009e50 tx=0x7f3bbc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:43.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.479+0000 7f3bc8d36700 1 -- 172.21.15.72:0/79304176 shutdown_connections 2023-10-03T10:16:43.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.479+0000 7f3bc8d36700 1 --2- 172.21.15.72:0/79304176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc406acb0 0x7f3bc406b110 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.479+0000 7f3bc8d36700 1 --2- 172.21.15.72:0/79304176 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bc41316c0 0x7f3bc4131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.479+0000 7f3bc8d36700 1 --2- 172.21.15.72:0/79304176 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bc409d9f0 0x7f3bc406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.479+0000 7f3bc8d36700 1 -- 172.21.15.72:0/79304176 >> 172.21.15.72:0/79304176 conn(0x7f3bc4066f50 msgr2=0x7f3bc409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.479+0000 7f3bc8d36700 1 -- 172.21.15.72:0/79304176 shutdown_connections 2023-10-03T10:16:43.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.479+0000 7f3bc8d36700 1 -- 172.21.15.72:0/79304176 wait complete. 2023-10-03T10:16:43.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.480+0000 7f3bc8d36700 1 Processor -- start 2023-10-03T10:16:43.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.480+0000 7f3bc8d36700 1 -- start start 2023-10-03T10:16:43.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc8d36700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bc406acb0 0x7f3bc406fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc8d36700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc409d9f0 0x7f3bc406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc8d36700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bc41316c0 0x7f3bc4070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc8d36700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc412b900 con 0x7f3bc409d9f0 2023-10-03T10:16:43.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc8d36700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc4132b70 con 0x7f3bc406acb0 2023-10-03T10:16:43.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc8d36700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc4130aa0 con 0x7f3bc41316c0 2023-10-03T10:16:43.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bc406acb0 0x7f3bc406fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bc406acb0 0x7f3bc406fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49102/0 (socket says 172.21.15.72:49102) 2023-10-03T10:16:43.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc259c700 1 -- 172.21.15.72:0/3655631997 learned_addr learned my addr 172.21.15.72:0/3655631997 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:43.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc1d9b700 1 --2- 172.21.15.72:0/3655631997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc409d9f0 0x7f3bc406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc2d9d700 1 --2- 172.21.15.72:0/3655631997 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bc41316c0 0x7f3bc4070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc259c700 1 -- 172.21.15.72:0/3655631997 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bc41316c0 msgr2=0x7f3bc4070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc259c700 1 --2- 172.21.15.72:0/3655631997 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bc41316c0 0x7f3bc4070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc259c700 1 -- 172.21.15.72:0/3655631997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc409d9f0 msgr2=0x7f3bc406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc259c700 1 --2- 172.21.15.72:0/3655631997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc409d9f0 0x7f3bc406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc259c700 1 -- 172.21.15.72:0/3655631997 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb80094a0 con 0x7f3bc406acb0 2023-10-03T10:16:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc2d9d700 1 --2- 172.21.15.72:0/3655631997 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bc41316c0 0x7f3bc4070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc259c700 1 --2- 172.21.15.72:0/3655631997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bc406acb0 0x7f3bc406fa00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400ec10 tx=0x7f3bb400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bb2ffd700 1 -- 172.21.15.72:0/3655631997 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb400c910 con 0x7f3bc406acb0 2023-10-03T10:16:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bb2ffd700 1 -- 172.21.15.72:0/3655631997 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb400ca70 con 0x7f3bc406acb0 2023-10-03T10:16:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bb2ffd700 1 -- 172.21.15.72:0/3655631997 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb400cde0 con 0x7f3bc406acb0 2023-10-03T10:16:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.481+0000 7f3bc8d36700 1 -- 172.21.15.72:0/3655631997 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb40094a0 con 0x7f3bc406acb0 2023-10-03T10:16:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.482+0000 7f3bc8d36700 1 -- 172.21.15.72:0/3655631997 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bbc009b30 con 0x7f3bc406acb0 2023-10-03T10:16:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.482+0000 7f3bb2ffd700 1 -- 172.21.15.72:0/3655631997 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3bb4013470 con 0x7f3bc406acb0 2023-10-03T10:16:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.483+0000 7f3bc8d36700 1 -- 172.21.15.72:0/3655631997 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc4074ea0 con 0x7f3bc406acb0 2023-10-03T10:16:43.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.483+0000 7f3bb2ffd700 1 -- 172.21.15.72:0/3655631997 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3bb403fb90 con 0x7f3bc406acb0 2023-10-03T10:16:43.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.487+0000 7f3bb2ffd700 1 -- 172.21.15.72:0/3655631997 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bb401b3b0 con 0x7f3bc406acb0 2023-10-03T10:16:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.510+0000 7f39c42fc700 1 Processor -- start 2023-10-03T10:16:43.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.510+0000 7f39c42fc700 1 -- start start 2023-10-03T10:16:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c42fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0a0a30 0x7f39bc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c42fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f39bc09d630 0x7f39bc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c42fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc133930 0x7f39bc133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c42fc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc0a2a70 con 0x7f39bc09d630 2023-10-03T10:16:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c42fc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc0a01d0 con 0x7f39bc0a0a30 2023-10-03T10:16:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c42fc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc09e2b0 con 0x7f39bc133930 2023-10-03T10:16:43.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c2098700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0a0a30 0x7f39bc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c1897700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f39bc09d630 0x7f39bc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c2098700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0a0a30 0x7f39bc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49118/0 (socket says 172.21.15.72:49118) 2023-10-03T10:16:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c2098700 1 -- 172.21.15.72:0/247744270 learned_addr learned my addr 172.21.15.72:0/247744270 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c2899700 1 --2- 172.21.15.72:0/247744270 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc133930 0x7f39bc133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c1897700 1 -- 172.21.15.72:0/247744270 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc133930 msgr2=0x7f39bc133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c1897700 1 --2- 172.21.15.72:0/247744270 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc133930 0x7f39bc133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c1897700 1 -- 172.21.15.72:0/247744270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0a0a30 msgr2=0x7f39bc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c1897700 1 --2- 172.21.15.72:0/247744270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0a0a30 0x7f39bc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c1897700 1 -- 172.21.15.72:0/247744270 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc09dc50 con 0x7f39bc09d630 2023-10-03T10:16:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.511+0000 7f39c2098700 1 --2- 172.21.15.72:0/247744270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0a0a30 0x7f39bc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.512+0000 7f39c1897700 1 --2- 172.21.15.72:0/247744270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc09d630 0x7f39bc0a1340 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009840 tx=0x7f39ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f940df06408e4e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.512+0000 7f39c1096700 1 -- 172.21.15.72:0/247744270 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac011830 con 0x7f39bc09d630 2023-10-03T10:16:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.512+0000 7f39c1096700 1 -- 172.21.15.72:0/247744270 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac011990 con 0x7f39bc09d630 2023-10-03T10:16:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.512+0000 7f39c1096700 1 -- 172.21.15.72:0/247744270 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac011d20 con 0x7f39bc09d630 2023-10-03T10:16:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.512+0000 7f39c42fc700 1 -- 172.21.15.72:0/247744270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc09d630 msgr2=0x7f39bc0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.512+0000 7f39c42fc700 1 --2- 172.21.15.72:0/247744270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc09d630 0x7f39bc0a1340 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f39ac009840 tx=0x7f39ac009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.512+0000 7f39c42fc700 1 -- 172.21.15.72:0/247744270 shutdown_connections 2023-10-03T10:16:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.512+0000 7f39c42fc700 1 --2- 172.21.15.72:0/247744270 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc133930 0x7f39bc133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.512+0000 7f39c42fc700 1 --2- 172.21.15.72:0/247744270 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc0a0a30 0x7f39bc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.512+0000 7f39c42fc700 1 --2- 172.21.15.72:0/247744270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc09d630 0x7f39bc0a1340 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.512+0000 7f39c42fc700 1 -- 172.21.15.72:0/247744270 >> 172.21.15.72:0/247744270 conn(0x7f39bc0a3050 msgr2=0x7f39bc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.512+0000 7f39c42fc700 1 -- 172.21.15.72:0/247744270 shutdown_connections 2023-10-03T10:16:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.512+0000 7f39c42fc700 1 -- 172.21.15.72:0/247744270 wait complete. 2023-10-03T10:16:43.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.513+0000 7f39c42fc700 1 Processor -- start 2023-10-03T10:16:43.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.513+0000 7f39c42fc700 1 -- start start 2023-10-03T10:16:43.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c42fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc09d630 0x7f39bc1210d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c42fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc0a0a30 0x7f39bc121610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c42fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc133930 0x7f39bc121b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c42fc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc124410 con 0x7f39bc133930 2023-10-03T10:16:43.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c42fc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc125560 con 0x7f39bc09d630 2023-10-03T10:16:43.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c42fc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc122d30 con 0x7f39bc0a0a30 2023-10-03T10:16:43.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c2098700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc09d630 0x7f39bc1210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c2098700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc09d630 0x7f39bc1210d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49122/0 (socket says 172.21.15.72:49122) 2023-10-03T10:16:43.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c2098700 1 -- 172.21.15.72:0/2956760275 learned_addr learned my addr 172.21.15.72:0/2956760275 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:43.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c2899700 1 --2- 172.21.15.72:0/2956760275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc133930 0x7f39bc121b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c1897700 1 --2- 172.21.15.72:0/2956760275 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc0a0a30 0x7f39bc121610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c2098700 1 -- 172.21.15.72:0/2956760275 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc0a0a30 msgr2=0x7f39bc121610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c2098700 1 --2- 172.21.15.72:0/2956760275 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc0a0a30 0x7f39bc121610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c2098700 1 -- 172.21.15.72:0/2956760275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc133930 msgr2=0x7f39bc121b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c2098700 1 --2- 172.21.15.72:0/2956760275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc133930 0x7f39bc121b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c2098700 1 -- 172.21.15.72:0/2956760275 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b8009550 con 0x7f39bc09d630 2023-10-03T10:16:43.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.514+0000 7f39c2098700 1 --2- 172.21.15.72:0/2956760275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc09d630 0x7f39bc1210d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f39b800ec10 tx=0x7f39b800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.515+0000 7f39b2ffd700 1 -- 172.21.15.72:0/2956760275 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b800c850 con 0x7f39bc09d630 2023-10-03T10:16:43.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.515+0000 7f39b2ffd700 1 -- 172.21.15.72:0/2956760275 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b800c9b0 con 0x7f39bc09d630 2023-10-03T10:16:43.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.515+0000 7f39c42fc700 1 -- 172.21.15.72:0/2956760275 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ac0094a0 con 0x7f39bc09d630 2023-10-03T10:16:43.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.515+0000 7f39b2ffd700 1 -- 172.21.15.72:0/2956760275 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b800cd40 con 0x7f39bc09d630 2023-10-03T10:16:43.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.515+0000 7f39c42fc700 1 -- 172.21.15.72:0/2956760275 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc124920 con 0x7f39bc09d630 2023-10-03T10:16:43.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.516+0000 7f39b2ffd700 1 -- 172.21.15.72:0/2956760275 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f39b8013470 con 0x7f39bc09d630 2023-10-03T10:16:43.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.516+0000 7f39c42fc700 1 -- 172.21.15.72:0/2956760275 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39bc0747f0 con 0x7f39bc09d630 2023-10-03T10:16:43.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.516+0000 7f39b2ffd700 1 -- 172.21.15.72:0/2956760275 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f39b803f800 con 0x7f39bc09d630 2023-10-03T10:16:43.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.520+0000 7f39b2ffd700 1 -- 172.21.15.72:0/2956760275 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39b8013720 con 0x7f39bc09d630 2023-10-03T10:16:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.593+0000 7f34dc853700 1 -- 172.21.15.72:0/3618635142 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f34d80747f0 con 0x7f34d80a0a30 2023-10-03T10:16:43.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.594+0000 7f34c6ffd700 1 -- 172.21.15.72:0/3618635142 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34cc03ce60 con 0x7f34d80a0a30 2023-10-03T10:16:43.593 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:43.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.596+0000 7f34dc853700 1 -- 172.21.15.72:0/3618635142 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34d80a0a30 msgr2=0x7f34d8133bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.596+0000 7f34dc853700 1 --2- 172.21.15.72:0/3618635142 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34d80a0a30 0x7f34d8133bd0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00c580 tx=0x7f34cc00c890 comp rx=0 tx=0).stop 2023-10-03T10:16:43.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.596+0000 7f34dc853700 1 -- 172.21.15.72:0/3618635142 shutdown_connections 2023-10-03T10:16:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.596+0000 7f34dc853700 1 --2- 172.21.15.72:0/3618635142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d8138d80 0x7f34d8134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.596+0000 7f34dc853700 1 --2- 172.21.15.72:0/3618635142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34d809d630 0x7f34d8133690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.596+0000 7f34dc853700 1 --2- 172.21.15.72:0/3618635142 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34d80a0a30 0x7f34d8133bd0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.596+0000 7f34dc853700 1 -- 172.21.15.72:0/3618635142 >> 172.21.15.72:0/3618635142 conn(0x7f34d80a3050 msgr2=0x7f34d813af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.597+0000 7f34dc853700 1 -- 172.21.15.72:0/3618635142 shutdown_connections 2023-10-03T10:16:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.597+0000 7f34dc853700 1 -- 172.21.15.72:0/3618635142 wait complete. 2023-10-03T10:16:43.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:43.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.684+0000 7f3bc8d36700 1 -- 172.21.15.72:0/3655631997 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3bc409e980 con 0x7f3bc406acb0 2023-10-03T10:16:43.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.684+0000 7f3bb2ffd700 1 -- 172.21.15.72:0/3655631997 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3bb4017020 con 0x7f3bc406acb0 2023-10-03T10:16:43.684 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:43.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.686+0000 7f3bc8d36700 1 -- 172.21.15.72:0/3655631997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bc406acb0 msgr2=0x7f3bc406fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.686+0000 7f3bc8d36700 1 --2- 172.21.15.72:0/3655631997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bc406acb0 0x7f3bc406fa00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400ec10 tx=0x7f3bb400ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:43.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.686+0000 7f3bc8d36700 1 -- 172.21.15.72:0/3655631997 shutdown_connections 2023-10-03T10:16:43.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.686+0000 7f3bc8d36700 1 --2- 172.21.15.72:0/3655631997 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bc41316c0 0x7f3bc4070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.686+0000 7f3bc8d36700 1 --2- 172.21.15.72:0/3655631997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bc406acb0 0x7f3bc406fa00 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.686+0000 7f3bc8d36700 1 --2- 172.21.15.72:0/3655631997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc409d9f0 0x7f3bc406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.686+0000 7f3bc8d36700 1 -- 172.21.15.72:0/3655631997 >> 172.21.15.72:0/3655631997 conn(0x7f3bc4066f50 msgr2=0x7f3bc412db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.686+0000 7f3bc8d36700 1 -- 172.21.15.72:0/3655631997 shutdown_connections 2023-10-03T10:16:43.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.686+0000 7f3bc8d36700 1 -- 172.21.15.72:0/3655631997 wait complete. 2023-10-03T10:16:43.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:43.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.722+0000 7f39c42fc700 1 -- 172.21.15.72:0/2956760275 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f39bc072980 con 0x7f39bc09d630 2023-10-03T10:16:43.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.723+0000 7f39b2ffd700 1 -- 172.21.15.72:0/2956760275 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f39b8017020 con 0x7f39bc09d630 2023-10-03T10:16:43.722 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.725+0000 7f39c42fc700 1 -- 172.21.15.72:0/2956760275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc09d630 msgr2=0x7f39bc1210d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.725+0000 7f39c42fc700 1 --2- 172.21.15.72:0/2956760275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc09d630 0x7f39bc1210d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f39b800ec10 tx=0x7f39b800ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.725+0000 7f39c42fc700 1 -- 172.21.15.72:0/2956760275 shutdown_connections 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.725+0000 7f39c42fc700 1 --2- 172.21.15.72:0/2956760275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39bc133930 0x7f39bc121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.725+0000 7f39c42fc700 1 --2- 172.21.15.72:0/2956760275 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39bc09d630 0x7f39bc1210d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.725+0000 7f39c42fc700 1 --2- 172.21.15.72:0/2956760275 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39bc0a0a30 0x7f39bc121610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.725+0000 7f39c42fc700 1 -- 172.21.15.72:0/2956760275 >> 172.21.15.72:0/2956760275 conn(0x7f39bc0a3050 msgr2=0x7f39bc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.725+0000 7f39c42fc700 1 -- 172.21.15.72:0/2956760275 shutdown_connections 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:43.725+0000 7f39c42fc700 1 -- 172.21.15.72:0/2956760275 wait complete. 2023-10-03T10:16:43.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:44.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:44.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.187+0000 7f99a820e700 1 Processor -- start 2023-10-03T10:16:44.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.187+0000 7f99a820e700 1 -- start start 2023-10-03T10:16:44.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a820e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99a009d6f0 0x7f99a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a820e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f99a009e000 0x7f99a0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a820e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99a009e410 0x7f99a0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a820e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a009f520 con 0x7f99a009e000 2023-10-03T10:16:44.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a820e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a009f130 con 0x7f99a009e410 2023-10-03T10:16:44.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a820e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99a009e930 con 0x7f99a009d6f0 2023-10-03T10:16:44.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a5faa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99a009d6f0 0x7f99a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a57a9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f99a009e000 0x7f99a0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a67ab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99a009e410 0x7f99a0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a5faa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99a009d6f0 0x7f99a009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59616/0 (socket says 172.21.15.72:59616) 2023-10-03T10:16:44.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a57a9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f99a009e000 0x7f99a0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33092/0 (socket says 172.21.15.72:33092) 2023-10-03T10:16:44.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a5faa700 1 -- 172.21.15.72:0/2959927406 learned_addr learned my addr 172.21.15.72:0/2959927406 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:44.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a67ab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99a009e410 0x7f99a0130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49128/0 (socket says 172.21.15.72:49128) 2023-10-03T10:16:44.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a67ab700 1 -- 172.21.15.72:0/2959927406 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99a009d6f0 msgr2=0x7f99a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a67ab700 1 --2- 172.21.15.72:0/2959927406 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99a009d6f0 0x7f99a009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a67ab700 1 -- 172.21.15.72:0/2959927406 >> v2:172.21.15.72:3300/0 conn(0x7f99a009e000 msgr2=0x7f99a0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a67ab700 1 --2- 172.21.15.72:0/2959927406 >> v2:172.21.15.72:3300/0 conn(0x7f99a009e000 0x7f99a0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a67ab700 1 -- 172.21.15.72:0/2959927406 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a009b2d0 con 0x7f99a009e410 2023-10-03T10:16:44.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a5faa700 1 --2- 172.21.15.72:0/2959927406 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99a009d6f0 0x7f99a009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a57a9700 1 --2- 172.21.15.72:0/2959927406 >> v2:172.21.15.72:3300/0 conn(0x7f99a009e000 0x7f99a0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a67ab700 1 --2- 172.21.15.72:0/2959927406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99a009e410 0x7f99a0130ba0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f999800bfa0 tx=0x7f999800d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84eb821aefa9c0b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a4fa8700 1 -- 172.21.15.72:0/2959927406 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998010070 con 0x7f99a009e410 2023-10-03T10:16:44.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a4fa8700 1 -- 172.21.15.72:0/2959927406 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999800b2e0 con 0x7f99a009e410 2023-10-03T10:16:44.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.188+0000 7f99a4fa8700 1 -- 172.21.15.72:0/2959927406 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999800dc40 con 0x7f99a009e410 2023-10-03T10:16:44.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.189+0000 7f99a820e700 1 -- 172.21.15.72:0/2959927406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99a009e410 msgr2=0x7f99a0130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.189+0000 7f99a820e700 1 --2- 172.21.15.72:0/2959927406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99a009e410 0x7f99a0130ba0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f999800bfa0 tx=0x7f999800d330 comp rx=0 tx=0).stop 2023-10-03T10:16:44.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.189+0000 7f99a820e700 1 -- 172.21.15.72:0/2959927406 shutdown_connections 2023-10-03T10:16:44.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.189+0000 7f99a820e700 1 --2- 172.21.15.72:0/2959927406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99a009e410 0x7f99a0130ba0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.189+0000 7f99a820e700 1 --2- 172.21.15.72:0/2959927406 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99a009d6f0 0x7f99a009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.189+0000 7f99a820e700 1 --2- 172.21.15.72:0/2959927406 >> v2:172.21.15.72:3300/0 conn(0x7f99a009e000 0x7f99a0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.189+0000 7f99a820e700 1 -- 172.21.15.72:0/2959927406 >> 172.21.15.72:0/2959927406 conn(0x7f99a0066f50 msgr2=0x7f99a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.189+0000 7f99a820e700 1 -- 172.21.15.72:0/2959927406 shutdown_connections 2023-10-03T10:16:44.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.189+0000 7f99a820e700 1 -- 172.21.15.72:0/2959927406 wait complete. 2023-10-03T10:16:44.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.190+0000 7f99a820e700 1 Processor -- start 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.190+0000 7f99a820e700 1 -- start start 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a820e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99a009d6f0 0x7f99a011ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a820e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99a009e000 0x7f99a011e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a820e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99a009e410 0x7f99a011e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a820e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a011fa60 con 0x7f99a009d6f0 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a820e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a009c700 con 0x7f99a009e410 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a820e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0121690 con 0x7f99a009e000 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a57a9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99a009e000 0x7f99a011e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a67ab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99a009e410 0x7f99a011e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a57a9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99a009e000 0x7f99a011e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59620/0 (socket says 172.21.15.72:59620) 2023-10-03T10:16:44.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a57a9700 1 -- 172.21.15.72:0/4188579010 learned_addr learned my addr 172.21.15.72:0/4188579010 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:44.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a5faa700 1 --2- 172.21.15.72:0/4188579010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99a009d6f0 0x7f99a011ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a57a9700 1 -- 172.21.15.72:0/4188579010 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99a009e410 msgr2=0x7f99a011e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a57a9700 1 --2- 172.21.15.72:0/4188579010 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99a009e410 0x7f99a011e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a57a9700 1 -- 172.21.15.72:0/4188579010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99a009d6f0 msgr2=0x7f99a011ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a57a9700 1 --2- 172.21.15.72:0/4188579010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99a009d6f0 0x7f99a011ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a57a9700 1 -- 172.21.15.72:0/4188579010 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9990009550 con 0x7f99a009e000 2023-10-03T10:16:44.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.191+0000 7f99a67ab700 1 --2- 172.21.15.72:0/4188579010 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99a009e410 0x7f99a011e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.192+0000 7f99a57a9700 1 --2- 172.21.15.72:0/4188579010 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99a009e000 0x7f99a011e410 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f999c00ebb0 tx=0x7f999c00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.192+0000 7f99967fc700 1 -- 172.21.15.72:0/4188579010 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c00c850 con 0x7f99a009e000 2023-10-03T10:16:44.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.192+0000 7f99967fc700 1 -- 172.21.15.72:0/4188579010 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c00c9b0 con 0x7f99a009e000 2023-10-03T10:16:44.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.192+0000 7f99a820e700 1 -- 172.21.15.72:0/4188579010 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f999c0094a0 con 0x7f99a009e000 2023-10-03T10:16:44.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.192+0000 7f99967fc700 1 -- 172.21.15.72:0/4188579010 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c00cd40 con 0x7f99a009e000 2023-10-03T10:16:44.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.192+0000 7f99a820e700 1 -- 172.21.15.72:0/4188579010 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999800bc80 con 0x7f99a009e000 2023-10-03T10:16:44.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.192+0000 7f99967fc700 1 -- 172.21.15.72:0/4188579010 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f999c013470 con 0x7f99a009e000 2023-10-03T10:16:44.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.193+0000 7f99967fc700 1 -- 172.21.15.72:0/4188579010 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f999c03f770 con 0x7f99a009e000 2023-10-03T10:16:44.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.193+0000 7f99a820e700 1 -- 172.21.15.72:0/4188579010 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a011ac20 con 0x7f99a009e000 2023-10-03T10:16:44.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.197+0000 7f99967fc700 1 -- 172.21.15.72:0/4188579010 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f999c0232f0 con 0x7f99a009e000 2023-10-03T10:16:44.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.381+0000 7f99a820e700 1 -- 172.21.15.72:0/4188579010 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f99a0074ea0 con 0x7f99a009e000 2023-10-03T10:16:44.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.382+0000 7f99967fc700 1 -- 172.21.15.72:0/4188579010 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f999c021020 con 0x7f99a009e000 2023-10-03T10:16:44.381 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:44.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.383+0000 7f99a820e700 1 -- 172.21.15.72:0/4188579010 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99a009e000 msgr2=0x7f99a011e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.383+0000 7f99a820e700 1 --2- 172.21.15.72:0/4188579010 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99a009e000 0x7f99a011e410 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f999c00ebb0 tx=0x7f999c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.384+0000 7f99a820e700 1 -- 172.21.15.72:0/4188579010 shutdown_connections 2023-10-03T10:16:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.384+0000 7f99a820e700 1 --2- 172.21.15.72:0/4188579010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99a009d6f0 0x7f99a011ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.384+0000 7f99a820e700 1 --2- 172.21.15.72:0/4188579010 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99a009e410 0x7f99a011e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.384+0000 7f99a820e700 1 --2- 172.21.15.72:0/4188579010 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99a009e000 0x7f99a011e410 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.384+0000 7f99a820e700 1 -- 172.21.15.72:0/4188579010 >> 172.21.15.72:0/4188579010 conn(0x7f99a0066f50 msgr2=0x7f99a0130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.384+0000 7f99a820e700 1 -- 172.21.15.72:0/4188579010 shutdown_connections 2023-10-03T10:16:44.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.384+0000 7f99a820e700 1 -- 172.21.15.72:0/4188579010 wait complete. 2023-10-03T10:16:44.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:44.610 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:44.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:44.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.734+0000 7f07b2673700 1 Processor -- start 2023-10-03T10:16:44.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.735+0000 7f07b2673700 1 -- start start 2023-10-03T10:16:44.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.735+0000 7f07b2673700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07ac09d6f0 0x7f07ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.735+0000 7f07b2673700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07ac09e000 0x7f07ac130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.735+0000 7f07b2673700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ac09f130 con 0x7f07ac09e410 2023-10-03T10:16:44.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.735+0000 7f07b2673700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac09f520 con 0x7f07ac09e000 2023-10-03T10:16:44.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.735+0000 7f07b2673700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac09e930 con 0x7f07ac09d6f0 2023-10-03T10:16:44.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.735+0000 7f07abfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07ac09d6f0 0x7f07ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.735+0000 7f07ab7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07ac09e000 0x7f07ac130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.735+0000 7f07b0c10700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f07ac09e410 0x7f07ac130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42190/0 (socket says 172.21.15.72:42190) 2023-10-03T10:16:44.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.735+0000 7f07b0c10700 1 -- 172.21.15.72:0/3648348325 learned_addr learned my addr 172.21.15.72:0/3648348325 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:44.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.736+0000 7f07aaffd700 1 -- 172.21.15.72:0/3648348325 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928109751 0 0) 0x7f07ac09f130 con 0x7f07ac09e410 2023-10-03T10:16:44.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.736+0000 7f07aaffd700 1 -- 172.21.15.72:0/3648348325 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07940035b0 con 0x7f07ac09e410 2023-10-03T10:16:44.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.736+0000 7f07abfff700 1 -- 172.21.15.72:0/3648348325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07ac09e000 msgr2=0x7f07ac130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.736+0000 7f07abfff700 1 --2- 172.21.15.72:0/3648348325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07ac09e000 0x7f07ac130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.736+0000 7f07abfff700 1 -- 172.21.15.72:0/3648348325 >> v1:172.21.15.72:6789/0 conn(0x7f07ac09e410 legacy=0x7f07ac130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.736+0000 7f07abfff700 1 -- 172.21.15.72:0/3648348325 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac09b2d0 con 0x7f07ac09d6f0 2023-10-03T10:16:44.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.736+0000 7f07ab7fe700 1 --2- 172.21.15.72:0/3648348325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07ac09e000 0x7f07ac130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.736+0000 7f07abfff700 1 --2- 172.21.15.72:0/3648348325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07ac09d6f0 0x7f07ac09dac0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f079c00bb40 tx=0x7f079c00be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e9c76d58a0b53eb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.736+0000 7f07aaffd700 1 -- 172.21.15.72:0/3648348325 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c00dc30 con 0x7f07ac09d6f0 2023-10-03T10:16:44.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.736+0000 7f07aaffd700 1 -- 172.21.15.72:0/3648348325 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079c00dd90 con 0x7f07ac09d6f0 2023-10-03T10:16:44.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.736+0000 7f07aaffd700 1 -- 172.21.15.72:0/3648348325 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c010690 con 0x7f07ac09d6f0 2023-10-03T10:16:44.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.737+0000 7f07b2673700 1 -- 172.21.15.72:0/3648348325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07ac09d6f0 msgr2=0x7f07ac09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.737+0000 7f07b2673700 1 --2- 172.21.15.72:0/3648348325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07ac09d6f0 0x7f07ac09dac0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f079c00bb40 tx=0x7f079c00be50 comp rx=0 tx=0).stop 2023-10-03T10:16:44.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.737+0000 7f07b2673700 1 -- 172.21.15.72:0/3648348325 shutdown_connections 2023-10-03T10:16:44.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.737+0000 7f07b2673700 1 --2- 172.21.15.72:0/3648348325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07ac09d6f0 0x7f07ac09dac0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.737+0000 7f07b2673700 1 --2- 172.21.15.72:0/3648348325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07ac09e000 0x7f07ac130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.737+0000 7f07b2673700 1 -- 172.21.15.72:0/3648348325 >> 172.21.15.72:0/3648348325 conn(0x7f07ac066f50 msgr2=0x7f07ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.737+0000 7f07b2673700 1 -- 172.21.15.72:0/3648348325 shutdown_connections 2023-10-03T10:16:44.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.737+0000 7f07b2673700 1 -- 172.21.15.72:0/3648348325 wait complete. 2023-10-03T10:16:44.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:44.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.738+0000 7f07b2673700 1 Processor -- start 2023-10-03T10:16:44.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.739+0000 7f07b2673700 1 -- start start 2023-10-03T10:16:44.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.739+0000 7f07b2673700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07ac09d6f0 0x7f07ac11e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.739+0000 7f07b2673700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07ac09e000 0x7f07ac11e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.739+0000 7f07b2673700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07ac09e410 0x7f07ac11ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.739+0000 7f07b2673700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac121850 con 0x7f07ac09e410 2023-10-03T10:16:44.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.739+0000 7f07b2673700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac09c700 con 0x7f07ac09e000 2023-10-03T10:16:44.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.739+0000 7f07b2673700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac09a0c0 con 0x7f07ac09d6f0 2023-10-03T10:16:44.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.739+0000 7f07abfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07ac09d6f0 0x7f07ac11e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.739+0000 7f07ab7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07ac09e000 0x7f07ac11e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.739+0000 7f07b0c10700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07ac09e410 0x7f07ac11ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.739+0000 7f07abfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07ac09d6f0 0x7f07ac11e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59638/0 (socket says 172.21.15.72:59638) 2023-10-03T10:16:44.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.740+0000 7f07abfff700 1 -- 172.21.15.72:0/123915959 learned_addr learned my addr 172.21.15.72:0/123915959 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:44.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.740+0000 7f07ab7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07ac09e000 0x7f07ac11e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49152/0 (socket says 172.21.15.72:49152) 2023-10-03T10:16:44.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.740+0000 7f07ab7fe700 1 -- 172.21.15.72:0/123915959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07ac09d6f0 msgr2=0x7f07ac11e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.740+0000 7f07ab7fe700 1 --2- 172.21.15.72:0/123915959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07ac09d6f0 0x7f07ac11e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.740+0000 7f07ab7fe700 1 -- 172.21.15.72:0/123915959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07ac09e410 msgr2=0x7f07ac11ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.740+0000 7f07ab7fe700 1 --2- 172.21.15.72:0/123915959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07ac09e410 0x7f07ac11ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.740+0000 7f07ab7fe700 1 -- 172.21.15.72:0/123915959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a00094a0 con 0x7f07ac09e000 2023-10-03T10:16:44.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.740+0000 7f07abfff700 1 --2- 172.21.15.72:0/123915959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07ac09d6f0 0x7f07ac11e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.740+0000 7f07b0c10700 1 --2- 172.21.15.72:0/123915959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07ac09e410 0x7f07ac11ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.740+0000 7f07ab7fe700 1 --2- 172.21.15.72:0/123915959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07ac09e000 0x7f07ac11e550 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f07a000e980 tx=0x7f07a000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.740+0000 7f07a8ff9700 1 -- 172.21.15.72:0/123915959 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a000c690 con 0x7f07ac09e000 2023-10-03T10:16:44.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.740+0000 7f07a8ff9700 1 -- 172.21.15.72:0/123915959 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a000c7f0 con 0x7f07ac09e000 2023-10-03T10:16:44.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.740+0000 7f07b2673700 1 -- 172.21.15.72:0/123915959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c00b740 con 0x7f07ac09e000 2023-10-03T10:16:44.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.740+0000 7f07a8ff9700 1 -- 172.21.15.72:0/123915959 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a000cb80 con 0x7f07ac09e000 2023-10-03T10:16:44.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.740+0000 7f07b2673700 1 -- 172.21.15.72:0/123915959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ac1212c0 con 0x7f07ac09e000 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.741+0000 7f07a8ff9700 1 -- 172.21.15.72:0/123915959 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07a000cce0 con 0x7f07ac09e000 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.741+0000 7f07b2673700 1 -- 172.21.15.72:0/123915959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ac074ea0 con 0x7f07ac09e000 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.741+0000 7f07a8ff9700 1 -- 172.21.15.72:0/123915959 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f07a003f700 con 0x7f07ac09e000 2023-10-03T10:16:44.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.746+0000 7f07a8ff9700 1 -- 172.21.15.72:0/123915959 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07a0017020 con 0x7f07ac09e000 2023-10-03T10:16:44.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.833+0000 7f2c9ff42700 1 Processor -- start 2023-10-03T10:16:44.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.833+0000 7f2c9ff42700 1 -- start start 2023-10-03T10:16:44.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9ff42700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c980a0a30 0x7f2c980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9ff42700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c9809d630 0x7f2c980a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9ff42700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c98133930 0x7f2c98133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9ff42700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c980a2a70 con 0x7f2c9809d630 2023-10-03T10:16:44.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9ff42700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c980a01d0 con 0x7f2c980a0a30 2023-10-03T10:16:44.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9ff42700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9809e2b0 con 0x7f2c98133930 2023-10-03T10:16:44.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9d4dd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c9809d630 0x7f2c980a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9dcde700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c980a0a30 0x7f2c980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9d4dd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c9809d630 0x7f2c980a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33122/0 (socket says 172.21.15.72:33122) 2023-10-03T10:16:44.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9dcde700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c980a0a30 0x7f2c980a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49162/0 (socket says 172.21.15.72:49162) 2023-10-03T10:16:44.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9d4dd700 1 -- 172.21.15.72:0/3057191871 learned_addr learned my addr 172.21.15.72:0/3057191871 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:44.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9e4df700 1 --2- 172.21.15.72:0/3057191871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c98133930 0x7f2c98133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9d4dd700 1 -- 172.21.15.72:0/3057191871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c98133930 msgr2=0x7f2c98133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9d4dd700 1 --2- 172.21.15.72:0/3057191871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c98133930 0x7f2c98133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9d4dd700 1 -- 172.21.15.72:0/3057191871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c980a0a30 msgr2=0x7f2c980a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9d4dd700 1 --2- 172.21.15.72:0/3057191871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c980a0a30 0x7f2c980a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9d4dd700 1 -- 172.21.15.72:0/3057191871 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9809dc50 con 0x7f2c9809d630 2023-10-03T10:16:44.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9dcde700 1 --2- 172.21.15.72:0/3057191871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c980a0a30 0x7f2c980a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.834+0000 7f2c9d4dd700 1 --2- 172.21.15.72:0/3057191871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9809d630 0x7f2c980a1340 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f2c880098f0 tx=0x7f2c88009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8db96012d508d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.835+0000 7f2c9ccdc700 1 -- 172.21.15.72:0/3057191871 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88011830 con 0x7f2c9809d630 2023-10-03T10:16:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.835+0000 7f2c9ccdc700 1 -- 172.21.15.72:0/3057191871 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c88011990 con 0x7f2c9809d630 2023-10-03T10:16:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.835+0000 7f2c9ccdc700 1 -- 172.21.15.72:0/3057191871 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88011d20 con 0x7f2c9809d630 2023-10-03T10:16:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.835+0000 7f2c9ff42700 1 -- 172.21.15.72:0/3057191871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9809d630 msgr2=0x7f2c980a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.835+0000 7f2c9ff42700 1 --2- 172.21.15.72:0/3057191871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9809d630 0x7f2c980a1340 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f2c880098f0 tx=0x7f2c88009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.835+0000 7f2c9ff42700 1 -- 172.21.15.72:0/3057191871 shutdown_connections 2023-10-03T10:16:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.835+0000 7f2c9ff42700 1 --2- 172.21.15.72:0/3057191871 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c98133930 0x7f2c98133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.835+0000 7f2c9ff42700 1 --2- 172.21.15.72:0/3057191871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c980a0a30 0x7f2c980a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.835+0000 7f2c9ff42700 1 --2- 172.21.15.72:0/3057191871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9809d630 0x7f2c980a1340 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.835+0000 7f2c9ff42700 1 -- 172.21.15.72:0/3057191871 >> 172.21.15.72:0/3057191871 conn(0x7f2c980a3050 msgr2=0x7f2c980a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.835+0000 7f2c9ff42700 1 -- 172.21.15.72:0/3057191871 shutdown_connections 2023-10-03T10:16:44.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.835+0000 7f2c9ff42700 1 -- 172.21.15.72:0/3057191871 wait complete. 2023-10-03T10:16:44.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.836+0000 7f2c9ff42700 1 Processor -- start 2023-10-03T10:16:44.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.836+0000 7f2c9ff42700 1 -- start start 2023-10-03T10:16:44.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9ff42700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9809d630 0x7f2c981210d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9ff42700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c980a0a30 0x7f2c98121610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9ff42700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c98133930 0x7f2c98121b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9ff42700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c98124410 con 0x7f2c9809d630 2023-10-03T10:16:44.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9ff42700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c98125560 con 0x7f2c980a0a30 2023-10-03T10:16:44.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9ff42700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c98122d30 con 0x7f2c98133930 2023-10-03T10:16:44.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9dcde700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9809d630 0x7f2c981210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9d4dd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c980a0a30 0x7f2c98121610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9dcde700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9809d630 0x7f2c981210d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33126/0 (socket says 172.21.15.72:33126) 2023-10-03T10:16:44.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9dcde700 1 -- 172.21.15.72:0/2621093716 learned_addr learned my addr 172.21.15.72:0/2621093716 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:44.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9e4df700 1 --2- 172.21.15.72:0/2621093716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c98133930 0x7f2c98121b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9d4dd700 1 -- 172.21.15.72:0/2621093716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c98133930 msgr2=0x7f2c98121b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9d4dd700 1 --2- 172.21.15.72:0/2621093716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c98133930 0x7f2c98121b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9d4dd700 1 -- 172.21.15.72:0/2621093716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9809d630 msgr2=0x7f2c981210d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9d4dd700 1 --2- 172.21.15.72:0/2621093716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9809d630 0x7f2c981210d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9d4dd700 1 -- 172.21.15.72:0/2621093716 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940094a0 con 0x7f2c980a0a30 2023-10-03T10:16:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.837+0000 7f2c9dcde700 1 --2- 172.21.15.72:0/2621093716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9809d630 0x7f2c981210d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.838+0000 7f2c9d4dd700 1 --2- 172.21.15.72:0/2621093716 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c980a0a30 0x7f2c98121610 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2c980672b0 tx=0x7f2c88004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.838+0000 7f2c8e7fc700 1 -- 172.21.15.72:0/2621093716 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88004450 con 0x7f2c980a0a30 2023-10-03T10:16:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.838+0000 7f2c8e7fc700 1 -- 172.21.15.72:0/2621093716 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c880045b0 con 0x7f2c980a0a30 2023-10-03T10:16:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.838+0000 7f2c8e7fc700 1 -- 172.21.15.72:0/2621093716 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c880038e0 con 0x7f2c980a0a30 2023-10-03T10:16:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.838+0000 7f2c9ff42700 1 -- 172.21.15.72:0/2621093716 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c88009550 con 0x7f2c980a0a30 2023-10-03T10:16:44.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.838+0000 7f2c9ff42700 1 -- 172.21.15.72:0/2621093716 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c98124920 con 0x7f2c980a0a30 2023-10-03T10:16:44.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.839+0000 7f2c8e7fc700 1 -- 172.21.15.72:0/2621093716 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c88021070 con 0x7f2c980a0a30 2023-10-03T10:16:44.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.839+0000 7f2c9ff42700 1 -- 172.21.15.72:0/2621093716 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c980a0470 con 0x7f2c980a0a30 2023-10-03T10:16:44.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.839+0000 7f2c8e7fc700 1 -- 172.21.15.72:0/2621093716 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2c880406e0 con 0x7f2c980a0a30 2023-10-03T10:16:44.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.843+0000 7f2c8e7fc700 1 -- 172.21.15.72:0/2621093716 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c880199a0 con 0x7f2c980a0a30 2023-10-03T10:16:44.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.872+0000 7f4be7e39700 1 Processor -- start 2023-10-03T10:16:44.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.872+0000 7f4be7e39700 1 -- start start 2023-10-03T10:16:44.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.872+0000 7f4be7e39700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4be009e930 0x7f4be009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be7e39700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4be009f240 0x7f4be01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be7e39700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be0070940 con 0x7f4be009f650 2023-10-03T10:16:44.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be7e39700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be006fd60 con 0x7f4be009f240 2023-10-03T10:16:44.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be7e39700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4be006fa80 con 0x7f4be009e930 2023-10-03T10:16:44.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be5bd5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4be009e930 0x7f4be009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be53d4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4be009f240 0x7f4be01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be5bd5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4be009e930 0x7f4be009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59676/0 (socket says 172.21.15.72:59676) 2023-10-03T10:16:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be53d4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4be009f240 0x7f4be01317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33138/0 (socket says 172.21.15.72:33138) 2023-10-03T10:16:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be5bd5700 1 -- 172.21.15.72:0/1361363530 learned_addr learned my addr 172.21.15.72:0/1361363530 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be53d4700 1 -- 172.21.15.72:0/1361363530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4be009e930 msgr2=0x7f4be009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be53d4700 1 --2- 172.21.15.72:0/1361363530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4be009e930 0x7f4be009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be53d4700 1 -- 172.21.15.72:0/1361363530 >> v1:172.21.15.72:6789/0 conn(0x7f4be009f650 legacy=0x7f4be0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be53d4700 1 -- 172.21.15.72:0/1361363530 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be009fb60 con 0x7f4be009f240 2023-10-03T10:16:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be5bd5700 1 --2- 172.21.15.72:0/1361363530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4be009e930 0x7f4be009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:44.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be53d4700 1 --2- 172.21.15.72:0/1361363530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4be009f240 0x7f4be01317f0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009840 tx=0x7f4bd0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b38d58bd3c7226 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be4bd3700 1 -- 172.21.15.72:0/1361363530 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0011830 con 0x7f4be009f240 2023-10-03T10:16:44.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be4bd3700 1 -- 172.21.15.72:0/1361363530 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd0011990 con 0x7f4be009f240 2023-10-03T10:16:44.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.873+0000 7f4be4bd3700 1 -- 172.21.15.72:0/1361363530 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0011d20 con 0x7f4be009f240 2023-10-03T10:16:44.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.874+0000 7f4be7e39700 1 -- 172.21.15.72:0/1361363530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4be009f240 msgr2=0x7f4be01317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.874+0000 7f4be7e39700 1 --2- 172.21.15.72:0/1361363530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4be009f240 0x7f4be01317f0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009840 tx=0x7f4bd0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:44.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.874+0000 7f4be7e39700 1 -- 172.21.15.72:0/1361363530 shutdown_connections 2023-10-03T10:16:44.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.874+0000 7f4be7e39700 1 --2- 172.21.15.72:0/1361363530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4be009e930 0x7f4be009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.874+0000 7f4be7e39700 1 --2- 172.21.15.72:0/1361363530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4be009f240 0x7f4be01317f0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.874+0000 7f4be7e39700 1 -- 172.21.15.72:0/1361363530 >> 172.21.15.72:0/1361363530 conn(0x7f4be00a4210 msgr2=0x7f4be00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.874+0000 7f4be7e39700 1 -- 172.21.15.72:0/1361363530 shutdown_connections 2023-10-03T10:16:44.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.874+0000 7f4be7e39700 1 -- 172.21.15.72:0/1361363530 wait complete. 2023-10-03T10:16:44.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.875+0000 7f4be7e39700 1 Processor -- start 2023-10-03T10:16:44.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.875+0000 7f4be7e39700 1 -- start start 2023-10-03T10:16:44.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.875+0000 7f4be7e39700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4be009e930 0x7f4be006b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.875+0000 7f4be7e39700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4be009f240 0x7f4be006bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.875+0000 7f4be7e39700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4be009f650 0x7f4be006c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:44.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.875+0000 7f4be7e39700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be01a99e0 con 0x7f4be009f650 2023-10-03T10:16:44.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.875+0000 7f4be7e39700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be00a3560 con 0x7f4be009e930 2023-10-03T10:16:44.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.875+0000 7f4be7e39700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4be0071d20 con 0x7f4be009f240 2023-10-03T10:16:44.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.875+0000 7f4be53d4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4be009f240 0x7f4be006bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.875+0000 7f4be53d4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4be009f240 0x7f4be006bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59682/0 (socket says 172.21.15.72:59682) 2023-10-03T10:16:44.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.875+0000 7f4be53d4700 1 -- 172.21.15.72:0/4197498299 learned_addr learned my addr 172.21.15.72:0/4197498299 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.876+0000 7f4be5bd5700 1 --2- 172.21.15.72:0/4197498299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4be009e930 0x7f4be006b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.876+0000 7f4be63d6700 1 --2- 172.21.15.72:0/4197498299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4be009f650 0x7f4be006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.876+0000 7f4be53d4700 1 -- 172.21.15.72:0/4197498299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4be009e930 msgr2=0x7f4be006b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.876+0000 7f4be53d4700 1 --2- 172.21.15.72:0/4197498299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4be009e930 0x7f4be006b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.876+0000 7f4be53d4700 1 -- 172.21.15.72:0/4197498299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4be009f650 msgr2=0x7f4be006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.876+0000 7f4be53d4700 1 --2- 172.21.15.72:0/4197498299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4be009f650 0x7f4be006c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.876+0000 7f4be53d4700 1 -- 172.21.15.72:0/4197498299 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc009550 con 0x7f4be009f240 2023-10-03T10:16:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.876+0000 7f4be53d4700 1 --2- 172.21.15.72:0/4197498299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4be009f240 0x7f4be006bdc0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00090b0 tx=0x7f4bd0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.876+0000 7f4bd67fc700 1 -- 172.21.15.72:0/4197498299 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00036a0 con 0x7f4be009f240 2023-10-03T10:16:44.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.876+0000 7f4bd67fc700 1 -- 172.21.15.72:0/4197498299 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd001f070 con 0x7f4be009f240 2023-10-03T10:16:44.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.876+0000 7f4be7e39700 1 -- 172.21.15.72:0/4197498299 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd00094a0 con 0x7f4be009f240 2023-10-03T10:16:44.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.876+0000 7f4bd67fc700 1 -- 172.21.15.72:0/4197498299 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0003a60 con 0x7f4be009f240 2023-10-03T10:16:44.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.876+0000 7f4be7e39700 1 -- 172.21.15.72:0/4197498299 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be00a0190 con 0x7f4be009f240 2023-10-03T10:16:44.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.877+0000 7f4bd67fc700 1 -- 172.21.15.72:0/4197498299 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bd0003bc0 con 0x7f4be009f240 2023-10-03T10:16:44.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.877+0000 7f4be7e39700 1 -- 172.21.15.72:0/4197498299 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be00a3180 con 0x7f4be009f240 2023-10-03T10:16:44.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.877+0000 7f4bd67fc700 1 -- 172.21.15.72:0/4197498299 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4bd0021070 con 0x7f4be009f240 2023-10-03T10:16:44.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.882+0000 7f4bd67fc700 1 -- 172.21.15.72:0/4197498299 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bd0015070 con 0x7f4be009f240 2023-10-03T10:16:44.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.961+0000 7f07b2673700 1 -- 172.21.15.72:0/123915959 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f07ac121b10 con 0x7f07ac09e000 2023-10-03T10:16:44.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.961+0000 7f07a8ff9700 1 -- 172.21.15.72:0/123915959 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07a00232f0 con 0x7f07ac09e000 2023-10-03T10:16:44.961 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:44.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.965+0000 7f07b2673700 1 -- 172.21.15.72:0/123915959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07ac09e000 msgr2=0x7f07ac11e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.965+0000 7f07b2673700 1 --2- 172.21.15.72:0/123915959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07ac09e000 0x7f07ac11e550 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f07a000e980 tx=0x7f07a000ec90 comp rx=0 tx=0).stop 2023-10-03T10:16:44.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.965+0000 7f07b2673700 1 -- 172.21.15.72:0/123915959 shutdown_connections 2023-10-03T10:16:44.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.965+0000 7f07b2673700 1 --2- 172.21.15.72:0/123915959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07ac09e410 0x7f07ac11ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.965+0000 7f07b2673700 1 --2- 172.21.15.72:0/123915959 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07ac09d6f0 0x7f07ac11e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.965+0000 7f07b2673700 1 --2- 172.21.15.72:0/123915959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07ac09e000 0x7f07ac11e550 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.965+0000 7f07b2673700 1 -- 172.21.15.72:0/123915959 >> 172.21.15.72:0/123915959 conn(0x7f07ac066f50 msgr2=0x7f07ac070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.965+0000 7f07b2673700 1 -- 172.21.15.72:0/123915959 shutdown_connections 2023-10-03T10:16:44.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:44.965+0000 7f07b2673700 1 -- 172.21.15.72:0/123915959 wait complete. 2023-10-03T10:16:44.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.054+0000 7f2c9ff42700 1 -- 172.21.15.72:0/2621093716 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2c980747f0 con 0x7f2c980a0a30 2023-10-03T10:16:45.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.055+0000 7f2c8e7fc700 1 -- 172.21.15.72:0/2621093716 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2c88029070 con 0x7f2c980a0a30 2023-10-03T10:16:45.054 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.057+0000 7f2c9ff42700 1 -- 172.21.15.72:0/2621093716 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c980a0a30 msgr2=0x7f2c98121610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.057+0000 7f2c9ff42700 1 --2- 172.21.15.72:0/2621093716 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c980a0a30 0x7f2c98121610 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2c980672b0 tx=0x7f2c88004750 comp rx=0 tx=0).stop 2023-10-03T10:16:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.057+0000 7f2c9ff42700 1 -- 172.21.15.72:0/2621093716 shutdown_connections 2023-10-03T10:16:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.057+0000 7f2c9ff42700 1 --2- 172.21.15.72:0/2621093716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9809d630 0x7f2c981210d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.057+0000 7f2c9ff42700 1 --2- 172.21.15.72:0/2621093716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c98133930 0x7f2c98121b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.057+0000 7f2c9ff42700 1 --2- 172.21.15.72:0/2621093716 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c980a0a30 0x7f2c98121610 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.057+0000 7f2c9ff42700 1 -- 172.21.15.72:0/2621093716 >> 172.21.15.72:0/2621093716 conn(0x7f2c980a3050 msgr2=0x7f2c9809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.057+0000 7f2c9ff42700 1 -- 172.21.15.72:0/2621093716 shutdown_connections 2023-10-03T10:16:45.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.057+0000 7f2c9ff42700 1 -- 172.21.15.72:0/2621093716 wait complete. 2023-10-03T10:16:45.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:45.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.085+0000 7f4be7e39700 1 -- 172.21.15.72:0/4197498299 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4be0074ea0 con 0x7f4be009f240 2023-10-03T10:16:45.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.086+0000 7f4bd67fc700 1 -- 172.21.15.72:0/4197498299 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4bd003e090 con 0x7f4be009f240 2023-10-03T10:16:45.085 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:45.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.087+0000 7f4be7e39700 1 -- 172.21.15.72:0/4197498299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4be009f240 msgr2=0x7f4be006bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.087+0000 7f4be7e39700 1 --2- 172.21.15.72:0/4197498299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4be009f240 0x7f4be006bdc0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00090b0 tx=0x7f4bd0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:45.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.088+0000 7f4be7e39700 1 -- 172.21.15.72:0/4197498299 shutdown_connections 2023-10-03T10:16:45.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.088+0000 7f4be7e39700 1 --2- 172.21.15.72:0/4197498299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4be009f650 0x7f4be006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.088+0000 7f4be7e39700 1 --2- 172.21.15.72:0/4197498299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4be009e930 0x7f4be006b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.088+0000 7f4be7e39700 1 --2- 172.21.15.72:0/4197498299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4be009f240 0x7f4be006bdc0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.088+0000 7f4be7e39700 1 -- 172.21.15.72:0/4197498299 >> 172.21.15.72:0/4197498299 conn(0x7f4be00a4210 msgr2=0x7f4be01b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.088+0000 7f4be7e39700 1 -- 172.21.15.72:0/4197498299 shutdown_connections 2023-10-03T10:16:45.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.088+0000 7f4be7e39700 1 -- 172.21.15.72:0/4197498299 wait complete. 2023-10-03T10:16:45.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:45.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:45.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.521+0000 7f9e85b1a700 1 Processor -- start 2023-10-03T10:16:45.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.521+0000 7f9e85b1a700 1 -- start start 2023-10-03T10:16:45.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e85b1a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9e8009d6f0 0x7f9e8009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e85b1a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e8009e000 0x7f9e80130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e85b1a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8009f130 con 0x7f9e8009e410 2023-10-03T10:16:45.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e85b1a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8009f520 con 0x7f9e8009d6f0 2023-10-03T10:16:45.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e85b1a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8009e930 con 0x7f9e8009e000 2023-10-03T10:16:45.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e7effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e8009e000 0x7f9e80130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e7f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9e8009d6f0 0x7f9e8009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e7effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e8009e000 0x7f9e80130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59688/0 (socket says 172.21.15.72:59688) 2023-10-03T10:16:45.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e7effd700 1 -- 172.21.15.72:0/955482301 learned_addr learned my addr 172.21.15.72:0/955482301 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:45.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e7effd700 1 -- 172.21.15.72:0/955482301 >> v2:172.21.15.72:3300/0 conn(0x7f9e8009d6f0 msgr2=0x7f9e8009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e7effd700 1 --2- 172.21.15.72:0/955482301 >> v2:172.21.15.72:3300/0 conn(0x7f9e8009d6f0 0x7f9e8009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e7effd700 1 -- 172.21.15.72:0/955482301 >> v1:172.21.15.72:6789/0 conn(0x7f9e8009e410 legacy=0x7f9e80130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e7effd700 1 -- 172.21.15.72:0/955482301 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8009b2d0 con 0x7f9e8009e000 2023-10-03T10:16:45.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e7f7fe700 1 --2- 172.21.15.72:0/955482301 >> v2:172.21.15.72:3300/0 conn(0x7f9e8009d6f0 0x7f9e8009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e7effd700 1 --2- 172.21.15.72:0/955482301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e8009e000 0x7f9e80130660 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9e740098f0 tx=0x7f9e74009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52d61b6d01ee1013 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e7e7fc700 1 -- 172.21.15.72:0/955482301 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e74011830 con 0x7f9e8009e000 2023-10-03T10:16:45.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e7e7fc700 1 -- 172.21.15.72:0/955482301 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e74011990 con 0x7f9e8009e000 2023-10-03T10:16:45.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.522+0000 7f9e7e7fc700 1 -- 172.21.15.72:0/955482301 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e74011d20 con 0x7f9e8009e000 2023-10-03T10:16:45.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.523+0000 7f9e85b1a700 1 -- 172.21.15.72:0/955482301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e8009e000 msgr2=0x7f9e80130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.523+0000 7f9e85b1a700 1 --2- 172.21.15.72:0/955482301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e8009e000 0x7f9e80130660 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9e740098f0 tx=0x7f9e74009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:45.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.523+0000 7f9e85b1a700 1 -- 172.21.15.72:0/955482301 shutdown_connections 2023-10-03T10:16:45.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.523+0000 7f9e85b1a700 1 --2- 172.21.15.72:0/955482301 >> v2:172.21.15.72:3300/0 conn(0x7f9e8009d6f0 0x7f9e8009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.523+0000 7f9e85b1a700 1 --2- 172.21.15.72:0/955482301 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e8009e000 0x7f9e80130660 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.523+0000 7f9e85b1a700 1 -- 172.21.15.72:0/955482301 >> 172.21.15.72:0/955482301 conn(0x7f9e80066f50 msgr2=0x7f9e8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.523+0000 7f9e85b1a700 1 -- 172.21.15.72:0/955482301 shutdown_connections 2023-10-03T10:16:45.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.523+0000 7f9e85b1a700 1 -- 172.21.15.72:0/955482301 wait complete. 2023-10-03T10:16:45.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.524+0000 7f9e85b1a700 1 Processor -- start 2023-10-03T10:16:45.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.524+0000 7f9e85b1a700 1 -- start start 2023-10-03T10:16:45.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e85b1a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e8009d6f0 0x7f9e8011f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e85b1a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e8009e000 0x7f9e8011f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e85b1a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e8009e410 0x7f9e8011fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e85b1a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e80122ce0 con 0x7f9e8009d6f0 2023-10-03T10:16:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e85b1a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e80120dd0 con 0x7f9e8009e000 2023-10-03T10:16:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e85b1a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8006e8d0 con 0x7f9e8009e410 2023-10-03T10:16:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e7f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e8009d6f0 0x7f9e8011f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e7f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e8009d6f0 0x7f9e8011f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33178/0 (socket says 172.21.15.72:33178) 2023-10-03T10:16:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e7f7fe700 1 -- 172.21.15.72:0/162967231 learned_addr learned my addr 172.21.15.72:0/162967231 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e7ffff700 1 --2- 172.21.15.72:0/162967231 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e8009e410 0x7f9e8011fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e7effd700 1 --2- 172.21.15.72:0/162967231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e8009e000 0x7f9e8011f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e7f7fe700 1 -- 172.21.15.72:0/162967231 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e8009e410 msgr2=0x7f9e8011fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e7f7fe700 1 --2- 172.21.15.72:0/162967231 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e8009e410 0x7f9e8011fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e7f7fe700 1 -- 172.21.15.72:0/162967231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e8009e000 msgr2=0x7f9e8011f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e7f7fe700 1 --2- 172.21.15.72:0/162967231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e8009e000 0x7f9e8011f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.525+0000 7f9e7f7fe700 1 -- 172.21.15.72:0/162967231 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e700094a0 con 0x7f9e8009d6f0 2023-10-03T10:16:45.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.526+0000 7f9e7f7fe700 1 --2- 172.21.15.72:0/162967231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e8009d6f0 0x7f9e8011f1c0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000ebe0 tx=0x7f9e7000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.526+0000 7f9e67fff700 1 -- 172.21.15.72:0/162967231 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7000c850 con 0x7f9e8009d6f0 2023-10-03T10:16:45.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.526+0000 7f9e67fff700 1 -- 172.21.15.72:0/162967231 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7000c9b0 con 0x7f9e8009d6f0 2023-10-03T10:16:45.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.526+0000 7f9e85b1a700 1 -- 172.21.15.72:0/162967231 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e74009550 con 0x7f9e8009d6f0 2023-10-03T10:16:45.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.526+0000 7f9e67fff700 1 -- 172.21.15.72:0/162967231 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7000cd40 con 0x7f9e8009d6f0 2023-10-03T10:16:45.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.526+0000 7f9e85b1a700 1 -- 172.21.15.72:0/162967231 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8012fce0 con 0x7f9e8009d6f0 2023-10-03T10:16:45.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.527+0000 7f9e85b1a700 1 -- 172.21.15.72:0/162967231 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8009dcd0 con 0x7f9e8009d6f0 2023-10-03T10:16:45.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.527+0000 7f9e67fff700 1 -- 172.21.15.72:0/162967231 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e70013470 con 0x7f9e8009d6f0 2023-10-03T10:16:45.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.527+0000 7f9e67fff700 1 -- 172.21.15.72:0/162967231 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9e7003ffc0 con 0x7f9e8009d6f0 2023-10-03T10:16:45.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.531+0000 7f9e67fff700 1 -- 172.21.15.72:0/162967231 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e70013720 con 0x7f9e8009d6f0 2023-10-03T10:16:45.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.718+0000 7f9e85b1a700 1 -- 172.21.15.72:0/162967231 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9e80074ea0 con 0x7f9e8009d6f0 2023-10-03T10:16:45.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.719+0000 7f9e67fff700 1 -- 172.21.15.72:0/162967231 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e70017070 con 0x7f9e8009d6f0 2023-10-03T10:16:45.718 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:45.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.721+0000 7f9e85b1a700 1 -- 172.21.15.72:0/162967231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e8009d6f0 msgr2=0x7f9e8011f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.721+0000 7f9e85b1a700 1 --2- 172.21.15.72:0/162967231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e8009d6f0 0x7f9e8011f1c0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000ebe0 tx=0x7f9e7000eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.721+0000 7f9e85b1a700 1 -- 172.21.15.72:0/162967231 shutdown_connections 2023-10-03T10:16:45.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.721+0000 7f9e85b1a700 1 --2- 172.21.15.72:0/162967231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e8009d6f0 0x7f9e8011f1c0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.721+0000 7f9e85b1a700 1 --2- 172.21.15.72:0/162967231 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e8009e410 0x7f9e8011fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.721+0000 7f9e85b1a700 1 --2- 172.21.15.72:0/162967231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e8009e000 0x7f9e8011f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.721+0000 7f9e85b1a700 1 -- 172.21.15.72:0/162967231 >> 172.21.15.72:0/162967231 conn(0x7f9e80066f50 msgr2=0x7f9e80070120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.721+0000 7f9e85b1a700 1 -- 172.21.15.72:0/162967231 shutdown_connections 2023-10-03T10:16:45.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:45.721+0000 7f9e85b1a700 1 -- 172.21.15.72:0/162967231 wait complete. 2023-10-03T10:16:45.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:45.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:46.069 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:46.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:46.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.107+0000 7f8626e43700 1 Processor -- start 2023-10-03T10:16:46.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.107+0000 7f8626e43700 1 -- start start 2023-10-03T10:16:46.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f8626e43700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86200a0a30 0x7f86200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f8626e43700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86200a1340 0x7f8620133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f8626e43700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8620133fa0 0x7f8620134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f8626e43700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862009edd0 con 0x7f86200a1340 2023-10-03T10:16:46.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f8626e43700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862009e1f0 con 0x7f8620133fa0 2023-10-03T10:16:46.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f8626e43700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f862009dc50 con 0x7f86200a0a30 2023-10-03T10:16:46.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f8624bdf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86200a0a30 0x7f86200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f86253e0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8620133fa0 0x7f8620134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f861ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f86200a1340 0x7f8620133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f86253e0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8620133fa0 0x7f8620134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49206/0 (socket says 172.21.15.72:49206) 2023-10-03T10:16:46.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f8624bdf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86200a0a30 0x7f86200a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59706/0 (socket says 172.21.15.72:59706) 2023-10-03T10:16:46.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f86253e0700 1 -- 172.21.15.72:0/1016503229 learned_addr learned my addr 172.21.15.72:0/1016503229 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:46.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f861ffff700 1 -- 172.21.15.72:0/1016503229 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86200a0a30 msgr2=0x7f86200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f861ffff700 1 --2- 172.21.15.72:0/1016503229 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86200a0a30 0x7f86200a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f861ffff700 1 -- 172.21.15.72:0/1016503229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8620133fa0 msgr2=0x7f8620134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f861ffff700 1 --2- 172.21.15.72:0/1016503229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8620133fa0 0x7f8620134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f861ffff700 1 -- 172.21.15.72:0/1016503229 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86200a1fe0 con 0x7f86200a1340 2023-10-03T10:16:46.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f8624bdf700 1 --2- 172.21.15.72:0/1016503229 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86200a0a30 0x7f86200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f86253e0700 1 --2- 172.21.15.72:0/1016503229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8620133fa0 0x7f8620134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.108+0000 7f861ffff700 1 --2- 172.21.15.72:0/1016503229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86200a1340 0x7f8620133a60 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f860c009840 tx=0x7f860c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42928ee43d7e4b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.109+0000 7f861f7fe700 1 -- 172.21.15.72:0/1016503229 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c011830 con 0x7f86200a1340 2023-10-03T10:16:46.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.109+0000 7f861f7fe700 1 -- 172.21.15.72:0/1016503229 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860c011990 con 0x7f86200a1340 2023-10-03T10:16:46.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.109+0000 7f861f7fe700 1 -- 172.21.15.72:0/1016503229 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c011d20 con 0x7f86200a1340 2023-10-03T10:16:46.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.109+0000 7f8626e43700 1 -- 172.21.15.72:0/1016503229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86200a1340 msgr2=0x7f8620133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.109+0000 7f8626e43700 1 --2- 172.21.15.72:0/1016503229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86200a1340 0x7f8620133a60 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f860c009840 tx=0x7f860c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:46.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.109+0000 7f8626e43700 1 -- 172.21.15.72:0/1016503229 shutdown_connections 2023-10-03T10:16:46.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.109+0000 7f8626e43700 1 --2- 172.21.15.72:0/1016503229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8620133fa0 0x7f8620134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.109+0000 7f8626e43700 1 --2- 172.21.15.72:0/1016503229 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86200a0a30 0x7f86200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.109+0000 7f8626e43700 1 --2- 172.21.15.72:0/1016503229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86200a1340 0x7f8620133a60 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.109+0000 7f8626e43700 1 -- 172.21.15.72:0/1016503229 >> 172.21.15.72:0/1016503229 conn(0x7f86200a6550 msgr2=0x7f86200a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.109+0000 7f8626e43700 1 -- 172.21.15.72:0/1016503229 shutdown_connections 2023-10-03T10:16:46.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.110+0000 7f8626e43700 1 -- 172.21.15.72:0/1016503229 wait complete. 2023-10-03T10:16:46.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.110+0000 7f8626e43700 1 Processor -- start 2023-10-03T10:16:46.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.110+0000 7f8626e43700 1 -- start start 2023-10-03T10:16:46.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.111+0000 7f8626e43700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86200a0a30 0x7f8620120270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.111+0000 7f8626e43700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86200a1340 0x7f86201207b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.111+0000 7f8626e43700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8620133fa0 0x7f8620120cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.111+0000 7f8626e43700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8620121740 con 0x7f8620133fa0 2023-10-03T10:16:46.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.111+0000 7f8626e43700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8620133660 con 0x7f86200a1340 2023-10-03T10:16:46.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.111+0000 7f8626e43700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86201230d0 con 0x7f86200a0a30 2023-10-03T10:16:46.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.111+0000 7f8624bdf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86200a0a30 0x7f8620120270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.111+0000 7f8624bdf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86200a0a30 0x7f8620120270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59716/0 (socket says 172.21.15.72:59716) 2023-10-03T10:16:46.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.111+0000 7f8624bdf700 1 -- 172.21.15.72:0/654517426 learned_addr learned my addr 172.21.15.72:0/654517426 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:46.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.111+0000 7f861ffff700 1 --2- 172.21.15.72:0/654517426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86200a1340 0x7f86201207b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.111+0000 7f86253e0700 1 --2- 172.21.15.72:0/654517426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8620133fa0 0x7f8620120cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.112+0000 7f861ffff700 1 -- 172.21.15.72:0/654517426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86200a0a30 msgr2=0x7f8620120270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.112+0000 7f861ffff700 1 --2- 172.21.15.72:0/654517426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86200a0a30 0x7f8620120270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.112+0000 7f861ffff700 1 -- 172.21.15.72:0/654517426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8620133fa0 msgr2=0x7f8620120cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.112+0000 7f861ffff700 1 --2- 172.21.15.72:0/654517426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8620133fa0 0x7f8620120cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.112+0000 7f861ffff700 1 -- 172.21.15.72:0/654517426 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86140094a0 con 0x7f86200a1340 2023-10-03T10:16:46.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.112+0000 7f8624bdf700 1 --2- 172.21.15.72:0/654517426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86200a0a30 0x7f8620120270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.112+0000 7f86253e0700 1 --2- 172.21.15.72:0/654517426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8620133fa0 0x7f8620120cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.112+0000 7f861ffff700 1 --2- 172.21.15.72:0/654517426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86200a1340 0x7f86201207b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f860c009840 tx=0x7f860c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.112+0000 7f861d7fa700 1 -- 172.21.15.72:0/654517426 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c004450 con 0x7f86200a1340 2023-10-03T10:16:46.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.112+0000 7f861d7fa700 1 -- 172.21.15.72:0/654517426 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860c01f070 con 0x7f86200a1340 2023-10-03T10:16:46.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.112+0000 7f8626e43700 1 -- 172.21.15.72:0/654517426 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8618009b30 con 0x7f86200a1340 2023-10-03T10:16:46.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.112+0000 7f861d7fa700 1 -- 172.21.15.72:0/654517426 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c0038e0 con 0x7f86200a1340 2023-10-03T10:16:46.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.112+0000 7f8626e43700 1 -- 172.21.15.72:0/654517426 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c0094a0 con 0x7f86200a1340 2023-10-03T10:16:46.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.113+0000 7f861d7fa700 1 -- 172.21.15.72:0/654517426 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f860c003a40 con 0x7f86200a1340 2023-10-03T10:16:46.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.113+0000 7f861d7fa700 1 -- 172.21.15.72:0/654517426 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f860c021070 con 0x7f86200a1340 2023-10-03T10:16:46.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.113+0000 7f8626e43700 1 -- 172.21.15.72:0/654517426 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86200a3500 con 0x7f86200a1340 2023-10-03T10:16:46.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.119+0000 7f861d7fa700 1 -- 172.21.15.72:0/654517426 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f860c01a430 con 0x7f86200a1340 2023-10-03T10:16:46.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.200+0000 7efdd03e1700 1 Processor -- start 2023-10-03T10:16:46.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.200+0000 7efdd03e1700 1 -- start start 2023-10-03T10:16:46.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.200+0000 7efdd03e1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdc80a0a30 0x7efdc80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.200+0000 7efdd03e1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efdc809d630 0x7efdc80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdd03e1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc80a2a70 con 0x7efdc8133930 2023-10-03T10:16:46.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdd03e1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc80a01d0 con 0x7efdc809d630 2023-10-03T10:16:46.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdd03e1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdc809e2b0 con 0x7efdc80a0a30 2023-10-03T10:16:46.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdcd97c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efdc809d630 0x7efdc80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdce17d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdc80a0a30 0x7efdc80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdcd97c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efdc809d630 0x7efdc80a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33198/0 (socket says 172.21.15.72:33198) 2023-10-03T10:16:46.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdcd97c700 1 -- 172.21.15.72:0/3272085145 learned_addr learned my addr 172.21.15.72:0/3272085145 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:46.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdce17d700 1 -- 172.21.15.72:0/3272085145 >> v2:172.21.15.72:3300/0 conn(0x7efdc809d630 msgr2=0x7efdc80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdce17d700 1 --2- 172.21.15.72:0/3272085145 >> v2:172.21.15.72:3300/0 conn(0x7efdc809d630 0x7efdc80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdce17d700 1 -- 172.21.15.72:0/3272085145 >> v1:172.21.15.72:6789/0 conn(0x7efdc8133930 legacy=0x7efdc8133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdce17d700 1 -- 172.21.15.72:0/3272085145 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc809dc50 con 0x7efdc80a0a30 2023-10-03T10:16:46.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdcd97c700 1 --2- 172.21.15.72:0/3272085145 >> v2:172.21.15.72:3300/0 conn(0x7efdc809d630 0x7efdc80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdce17d700 1 --2- 172.21.15.72:0/3272085145 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdc80a0a30 0x7efdc80a0e00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009840 tx=0x7efdc4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=276e375fcc328bd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdcd17b700 1 -- 172.21.15.72:0/3272085145 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc4011830 con 0x7efdc80a0a30 2023-10-03T10:16:46.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdcd17b700 1 -- 172.21.15.72:0/3272085145 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc4011990 con 0x7efdc80a0a30 2023-10-03T10:16:46.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.201+0000 7efdcd17b700 1 -- 172.21.15.72:0/3272085145 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc4011d20 con 0x7efdc80a0a30 2023-10-03T10:16:46.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.202+0000 7efdd03e1700 1 -- 172.21.15.72:0/3272085145 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdc80a0a30 msgr2=0x7efdc80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.202+0000 7efdd03e1700 1 --2- 172.21.15.72:0/3272085145 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdc80a0a30 0x7efdc80a0e00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009840 tx=0x7efdc4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:46.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.202+0000 7efdd03e1700 1 -- 172.21.15.72:0/3272085145 shutdown_connections 2023-10-03T10:16:46.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.202+0000 7efdd03e1700 1 --2- 172.21.15.72:0/3272085145 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdc80a0a30 0x7efdc80a0e00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.202+0000 7efdd03e1700 1 --2- 172.21.15.72:0/3272085145 >> v2:172.21.15.72:3300/0 conn(0x7efdc809d630 0x7efdc80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.202+0000 7efdd03e1700 1 -- 172.21.15.72:0/3272085145 >> 172.21.15.72:0/3272085145 conn(0x7efdc80a3050 msgr2=0x7efdc80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.202+0000 7efdd03e1700 1 -- 172.21.15.72:0/3272085145 shutdown_connections 2023-10-03T10:16:46.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.202+0000 7efdd03e1700 1 -- 172.21.15.72:0/3272085145 wait complete. 2023-10-03T10:16:46.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.203+0000 7efdd03e1700 1 Processor -- start 2023-10-03T10:16:46.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.203+0000 7efdd03e1700 1 -- start start 2023-10-03T10:16:46.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdd03e1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdc809d630 0x7efdc81c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdd03e1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdc80a0a30 0x7efdc81c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdd03e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdc8133930 0x7efdc81c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdd03e1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc8122430 con 0x7efdc80a0a30 2023-10-03T10:16:46.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdd03e1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc8120720 con 0x7efdc8133930 2023-10-03T10:16:46.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdd03e1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdc80a5040 con 0x7efdc809d630 2023-10-03T10:16:46.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdcd97c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdc80a0a30 0x7efdc81c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdce17d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdc809d630 0x7efdc81c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdcd97c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdc80a0a30 0x7efdc81c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33200/0 (socket says 172.21.15.72:33200) 2023-10-03T10:16:46.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdcd97c700 1 -- 172.21.15.72:0/3658614393 learned_addr learned my addr 172.21.15.72:0/3658614393 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:46.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdce97e700 1 --2- 172.21.15.72:0/3658614393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdc8133930 0x7efdc81c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdce17d700 1 -- 172.21.15.72:0/3658614393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdc8133930 msgr2=0x7efdc81c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdce17d700 1 --2- 172.21.15.72:0/3658614393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdc8133930 0x7efdc81c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdce17d700 1 -- 172.21.15.72:0/3658614393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdc80a0a30 msgr2=0x7efdc81c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdce17d700 1 --2- 172.21.15.72:0/3658614393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdc80a0a30 0x7efdc81c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdce17d700 1 -- 172.21.15.72:0/3658614393 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb8009550 con 0x7efdc809d630 2023-10-03T10:16:46.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdce97e700 1 --2- 172.21.15.72:0/3658614393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdc8133930 0x7efdc81c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:46.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdcd97c700 1 --2- 172.21.15.72:0/3658614393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdc80a0a30 0x7efdc81c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdce17d700 1 --2- 172.21.15.72:0/3658614393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdc809d630 0x7efdc81c81a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7efdc4016000 tx=0x7efdc4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdbeffd700 1 -- 172.21.15.72:0/3658614393 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc4004480 con 0x7efdc809d630 2023-10-03T10:16:46.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdbeffd700 1 -- 172.21.15.72:0/3658614393 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc401f070 con 0x7efdc809d630 2023-10-03T10:16:46.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdd03e1700 1 -- 172.21.15.72:0/3658614393 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc40094a0 con 0x7efdc809d630 2023-10-03T10:16:46.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdbeffd700 1 -- 172.21.15.72:0/3658614393 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40038e0 con 0x7efdc809d630 2023-10-03T10:16:46.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.204+0000 7efdd03e1700 1 -- 172.21.15.72:0/3658614393 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc80a0410 con 0x7efdc809d630 2023-10-03T10:16:46.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.205+0000 7efdbeffd700 1 -- 172.21.15.72:0/3658614393 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efdc4021030 con 0x7efdc809d630 2023-10-03T10:16:46.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.205+0000 7efdbeffd700 1 -- 172.21.15.72:0/3658614393 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efdc4040940 con 0x7efdc809d630 2023-10-03T10:16:46.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.206+0000 7efdd03e1700 1 -- 172.21.15.72:0/3658614393 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc8133680 con 0x7efdc809d630 2023-10-03T10:16:46.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.214+0000 7efdbeffd700 1 -- 172.21.15.72:0/3658614393 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efdc8133680 con 0x7efdc809d630 2023-10-03T10:16:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.238+0000 7f182f1f8700 1 Processor -- start 2023-10-03T10:16:46.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.238+0000 7f182f1f8700 1 -- start start 2023-10-03T10:16:46.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.239+0000 7f182f1f8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f182809e1d0 0x7f1828135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.239+0000 7f182f1f8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1828135e50 0x7f1828138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.239+0000 7f182f1f8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182809f130 con 0x7f182809d6f0 2023-10-03T10:16:46.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.239+0000 7f182f1f8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f182809f520 con 0x7f1828135e50 2023-10-03T10:16:46.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.239+0000 7f182f1f8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f182809e930 con 0x7f182809e1d0 2023-10-03T10:16:46.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.239+0000 7f182cf94700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f182809d6f0 0x7f182809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42246/0 (socket says 172.21.15.72:42246) 2023-10-03T10:16:46.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.239+0000 7f1827fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f182809e1d0 0x7f1828135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.239+0000 7f182cf94700 1 -- 172.21.15.72:0/4111346554 learned_addr learned my addr 172.21.15.72:0/4111346554 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:46.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.239+0000 7f182d795700 1 --2- 172.21.15.72:0/4111346554 >> v2:172.21.15.72:3300/0 conn(0x7f1828135e50 0x7f1828138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.239+0000 7f182d795700 1 -- 172.21.15.72:0/4111346554 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f182809e1d0 msgr2=0x7f1828135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.239+0000 7f182d795700 1 --2- 172.21.15.72:0/4111346554 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f182809e1d0 0x7f1828135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.239+0000 7f182d795700 1 -- 172.21.15.72:0/4111346554 >> v1:172.21.15.72:6789/0 conn(0x7f182809d6f0 legacy=0x7f182809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.239+0000 7f182d795700 1 -- 172.21.15.72:0/4111346554 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182809b2d0 con 0x7f1828135e50 2023-10-03T10:16:46.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.239+0000 7f182d795700 1 --2- 172.21.15.72:0/4111346554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1828135e50 0x7f1828138230 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f1820009df0 tx=0x7f182000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d941a3c363c9d05a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.240+0000 7f18277fe700 1 -- 172.21.15.72:0/4111346554 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000e070 con 0x7f1828135e50 2023-10-03T10:16:46.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.240+0000 7f18277fe700 1 -- 172.21.15.72:0/4111346554 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182000baa0 con 0x7f1828135e50 2023-10-03T10:16:46.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.240+0000 7f18277fe700 1 -- 172.21.15.72:0/4111346554 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000be50 con 0x7f1828135e50 2023-10-03T10:16:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.240+0000 7f182f1f8700 1 -- 172.21.15.72:0/4111346554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1828135e50 msgr2=0x7f1828138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.240+0000 7f182f1f8700 1 --2- 172.21.15.72:0/4111346554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1828135e50 0x7f1828138230 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f1820009df0 tx=0x7f182000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.240+0000 7f182f1f8700 1 -- 172.21.15.72:0/4111346554 shutdown_connections 2023-10-03T10:16:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.240+0000 7f182f1f8700 1 --2- 172.21.15.72:0/4111346554 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1828135e50 0x7f1828138230 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.240+0000 7f182f1f8700 1 --2- 172.21.15.72:0/4111346554 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f182809e1d0 0x7f1828135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.240+0000 7f182f1f8700 1 -- 172.21.15.72:0/4111346554 >> 172.21.15.72:0/4111346554 conn(0x7f1828066f50 msgr2=0x7f182809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.240+0000 7f182f1f8700 1 -- 172.21.15.72:0/4111346554 shutdown_connections 2023-10-03T10:16:46.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.240+0000 7f182f1f8700 1 -- 172.21.15.72:0/4111346554 wait complete. 2023-10-03T10:16:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.241+0000 7f182f1f8700 1 Processor -- start 2023-10-03T10:16:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.241+0000 7f182f1f8700 1 -- start start 2023-10-03T10:16:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182f1f8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f182809d6f0 0x7f18281397b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182f1f8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f182809e1d0 0x7f1828139cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182f1f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1828135e50 0x7f182813a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182f1f8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1828138ca0 con 0x7f182809e1d0 2023-10-03T10:16:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182f1f8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182809c700 con 0x7f1828135e50 2023-10-03T10:16:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182f1f8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1828120b60 con 0x7f182809d6f0 2023-10-03T10:16:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182cf94700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f182809d6f0 0x7f18281397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182cf94700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f182809d6f0 0x7f18281397b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59756/0 (socket says 172.21.15.72:59756) 2023-10-03T10:16:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182cf94700 1 -- 172.21.15.72:0/2794675789 learned_addr learned my addr 172.21.15.72:0/2794675789 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182d795700 1 --2- 172.21.15.72:0/2794675789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1828135e50 0x7f182813a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f1827fff700 1 --2- 172.21.15.72:0/2794675789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f182809e1d0 0x7f1828139cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182cf94700 1 -- 172.21.15.72:0/2794675789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1828135e50 msgr2=0x7f182813a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182cf94700 1 --2- 172.21.15.72:0/2794675789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1828135e50 0x7f182813a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182cf94700 1 -- 172.21.15.72:0/2794675789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f182809e1d0 msgr2=0x7f1828139cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182cf94700 1 --2- 172.21.15.72:0/2794675789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f182809e1d0 0x7f1828139cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182cf94700 1 -- 172.21.15.72:0/2794675789 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1820009a70 con 0x7f182809d6f0 2023-10-03T10:16:46.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.242+0000 7f182d795700 1 --2- 172.21.15.72:0/2794675789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1828135e50 0x7f182813a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.243+0000 7f182cf94700 1 --2- 172.21.15.72:0/2794675789 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f182809d6f0 0x7f18281397b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f181c00c480 tx=0x7f181c00c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.243+0000 7f18257fa700 1 -- 172.21.15.72:0/2794675789 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c005d70 con 0x7f182809d6f0 2023-10-03T10:16:46.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.243+0000 7f18257fa700 1 -- 172.21.15.72:0/2794675789 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c00ce90 con 0x7f182809d6f0 2023-10-03T10:16:46.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.243+0000 7f182f1f8700 1 -- 172.21.15.72:0/2794675789 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1828121470 con 0x7f182809d6f0 2023-10-03T10:16:46.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.243+0000 7f18257fa700 1 -- 172.21.15.72:0/2794675789 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c0072d0 con 0x7f182809d6f0 2023-10-03T10:16:46.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.243+0000 7f182f1f8700 1 -- 172.21.15.72:0/2794675789 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18281210f0 con 0x7f182809d6f0 2023-10-03T10:16:46.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.244+0000 7f182f1f8700 1 -- 172.21.15.72:0/2794675789 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1828071700 con 0x7f182809d6f0 2023-10-03T10:16:46.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.244+0000 7f18257fa700 1 -- 172.21.15.72:0/2794675789 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f181c007430 con 0x7f182809d6f0 2023-10-03T10:16:46.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.244+0000 7f18257fa700 1 -- 172.21.15.72:0/2794675789 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f181c03e960 con 0x7f182809d6f0 2023-10-03T10:16:46.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.249+0000 7f18257fa700 1 -- 172.21.15.72:0/2794675789 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f181c01b3b0 con 0x7f182809d6f0 2023-10-03T10:16:46.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.318+0000 7f8626e43700 1 -- 172.21.15.72:0/654517426 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f86200a0220 con 0x7f86200a1340 2023-10-03T10:16:46.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.319+0000 7f861d7fa700 1 -- 172.21.15.72:0/654517426 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f860c015030 con 0x7f86200a1340 2023-10-03T10:16:46.319 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.322+0000 7f8626e43700 1 -- 172.21.15.72:0/654517426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86200a1340 msgr2=0x7f86201207b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.322+0000 7f8626e43700 1 --2- 172.21.15.72:0/654517426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86200a1340 0x7f86201207b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f860c009840 tx=0x7f860c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.322+0000 7f8626e43700 1 -- 172.21.15.72:0/654517426 shutdown_connections 2023-10-03T10:16:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.322+0000 7f8626e43700 1 --2- 172.21.15.72:0/654517426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8620133fa0 0x7f8620120cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.322+0000 7f8626e43700 1 --2- 172.21.15.72:0/654517426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86200a0a30 0x7f8620120270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.322+0000 7f8626e43700 1 --2- 172.21.15.72:0/654517426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86200a1340 0x7f86201207b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.322+0000 7f8626e43700 1 -- 172.21.15.72:0/654517426 >> 172.21.15.72:0/654517426 conn(0x7f86200a6550 msgr2=0x7f86201baf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.322+0000 7f8626e43700 1 -- 172.21.15.72:0/654517426 shutdown_connections 2023-10-03T10:16:46.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.322+0000 7f8626e43700 1 -- 172.21.15.72:0/654517426 wait complete. 2023-10-03T10:16:46.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:46.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.419+0000 7efdd03e1700 1 -- 172.21.15.72:0/3658614393 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efdc8133680 con 0x7efdc809d630 2023-10-03T10:16:46.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.420+0000 7efdbeffd700 1 -- 172.21.15.72:0/3658614393 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efdc8133680 con 0x7efdc809d630 2023-10-03T10:16:46.419 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:46.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.422+0000 7efdd03e1700 1 -- 172.21.15.72:0/3658614393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdc809d630 msgr2=0x7efdc81c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.422+0000 7efdd03e1700 1 --2- 172.21.15.72:0/3658614393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdc809d630 0x7efdc81c81a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7efdc4016000 tx=0x7efdc4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:46.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.422+0000 7efdd03e1700 1 -- 172.21.15.72:0/3658614393 shutdown_connections 2023-10-03T10:16:46.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.422+0000 7efdd03e1700 1 --2- 172.21.15.72:0/3658614393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdc8133930 0x7efdc81c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.422+0000 7efdd03e1700 1 --2- 172.21.15.72:0/3658614393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdc809d630 0x7efdc81c81a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.422+0000 7efdd03e1700 1 --2- 172.21.15.72:0/3658614393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdc80a0a30 0x7efdc81c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.422+0000 7efdd03e1700 1 -- 172.21.15.72:0/3658614393 >> 172.21.15.72:0/3658614393 conn(0x7efdc80a3050 msgr2=0x7efdc80a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.422+0000 7efdd03e1700 1 -- 172.21.15.72:0/3658614393 shutdown_connections 2023-10-03T10:16:46.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.422+0000 7efdd03e1700 1 -- 172.21.15.72:0/3658614393 wait complete. 2023-10-03T10:16:46.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:46.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.440+0000 7f182f1f8700 1 -- 172.21.15.72:0/2794675789 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1828074ea0 con 0x7f182809d6f0 2023-10-03T10:16:46.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.441+0000 7f18257fa700 1 -- 172.21.15.72:0/2794675789 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f181c017030 con 0x7f182809d6f0 2023-10-03T10:16:46.440 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:46.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.443+0000 7f182f1f8700 1 -- 172.21.15.72:0/2794675789 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f182809d6f0 msgr2=0x7f18281397b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.443+0000 7f182f1f8700 1 --2- 172.21.15.72:0/2794675789 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f182809d6f0 0x7f18281397b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f181c00c480 tx=0x7f181c00c790 comp rx=0 tx=0).stop 2023-10-03T10:16:46.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.443+0000 7f182f1f8700 1 -- 172.21.15.72:0/2794675789 shutdown_connections 2023-10-03T10:16:46.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.443+0000 7f182f1f8700 1 --2- 172.21.15.72:0/2794675789 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1828135e50 0x7f182813a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.443+0000 7f182f1f8700 1 --2- 172.21.15.72:0/2794675789 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f182809d6f0 0x7f18281397b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.443+0000 7f182f1f8700 1 --2- 172.21.15.72:0/2794675789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f182809e1d0 0x7f1828139cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.443+0000 7f182f1f8700 1 -- 172.21.15.72:0/2794675789 >> 172.21.15.72:0/2794675789 conn(0x7f1828066f50 msgr2=0x7f182806e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.443+0000 7f182f1f8700 1 -- 172.21.15.72:0/2794675789 shutdown_connections 2023-10-03T10:16:46.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.443+0000 7f182f1f8700 1 -- 172.21.15.72:0/2794675789 wait complete. 2023-10-03T10:16:46.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:46.734 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:46.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.857+0000 7fbea68d6700 1 Processor -- start 2023-10-03T10:16:46.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.857+0000 7fbea68d6700 1 -- start start 2023-10-03T10:16:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.857+0000 7fbea68d6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea009d6f0 0x7fbea009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.857+0000 7fbea68d6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbea009e000 0x7fbea01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.857+0000 7fbea68d6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea009b120 con 0x7fbea009e410 2023-10-03T10:16:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.857+0000 7fbea68d6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea006b460 con 0x7fbea009e000 2023-10-03T10:16:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.857+0000 7fbea68d6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbea009a7e0 con 0x7fbea009d6f0 2023-10-03T10:16:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.857+0000 7fbe9f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbea009e000 0x7fbea01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.857+0000 7fbe9ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea009d6f0 0x7fbea009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.857+0000 7fbe9f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbea009e000 0x7fbea01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33220/0 (socket says 172.21.15.72:33220) 2023-10-03T10:16:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.857+0000 7fbe9ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea009d6f0 0x7fbea009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59766/0 (socket says 172.21.15.72:59766) 2023-10-03T10:16:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.857+0000 7fbe9f7fe700 1 -- 172.21.15.72:0/3733760163 learned_addr learned my addr 172.21.15.72:0/3733760163 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbe9f7fe700 1 -- 172.21.15.72:0/3733760163 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea009d6f0 msgr2=0x7fbea009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbe9f7fe700 1 --2- 172.21.15.72:0/3733760163 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea009d6f0 0x7fbea009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbe9f7fe700 1 -- 172.21.15.72:0/3733760163 >> v1:172.21.15.72:6789/0 conn(0x7fbea009e410 legacy=0x7fbea0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbe9f7fe700 1 -- 172.21.15.72:0/3733760163 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea009a500 con 0x7fbea009e000 2023-10-03T10:16:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbe9ffff700 1 --2- 172.21.15.72:0/3733760163 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea009d6f0 0x7fbea009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbe9f7fe700 1 --2- 172.21.15.72:0/3733760163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea009e000 0x7fbea01339f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fbe940098f0 tx=0x7fbe94009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8645d0148e27e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbe9effd700 1 -- 172.21.15.72:0/3733760163 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94011830 con 0x7fbea009e000 2023-10-03T10:16:46.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbe9effd700 1 -- 172.21.15.72:0/3733760163 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe94011990 con 0x7fbea009e000 2023-10-03T10:16:46.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbe9effd700 1 -- 172.21.15.72:0/3733760163 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94011d20 con 0x7fbea009e000 2023-10-03T10:16:46.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbea68d6700 1 -- 172.21.15.72:0/3733760163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea009e000 msgr2=0x7fbea01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbea68d6700 1 --2- 172.21.15.72:0/3733760163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea009e000 0x7fbea01339f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fbe940098f0 tx=0x7fbe94009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:46.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbea68d6700 1 -- 172.21.15.72:0/3733760163 shutdown_connections 2023-10-03T10:16:46.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbea68d6700 1 --2- 172.21.15.72:0/3733760163 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea009d6f0 0x7fbea009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbea68d6700 1 --2- 172.21.15.72:0/3733760163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea009e000 0x7fbea01339f0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbea68d6700 1 -- 172.21.15.72:0/3733760163 >> 172.21.15.72:0/3733760163 conn(0x7fbea0066f50 msgr2=0x7fbea009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.858+0000 7fbea68d6700 1 -- 172.21.15.72:0/3733760163 shutdown_connections 2023-10-03T10:16:46.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.859+0000 7fbea68d6700 1 -- 172.21.15.72:0/3733760163 wait complete. 2023-10-03T10:16:46.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.859+0000 7fbea68d6700 1 Processor -- start 2023-10-03T10:16:46.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbea68d6700 1 -- start start 2023-10-03T10:16:46.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbea68d6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea009d6f0 0x7fbea01a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbea68d6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea009e000 0x7fbea01a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbea68d6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea009e410 0x7fbea01a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbea68d6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea01a91f0 con 0x7fbea009e410 2023-10-03T10:16:46.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbea68d6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea009c710 con 0x7fbea009e000 2023-10-03T10:16:46.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbea68d6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00a3160 con 0x7fbea009d6f0 2023-10-03T10:16:46.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbe9ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea009d6f0 0x7fbea01a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbe9f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea009e000 0x7fbea01a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbea4e73700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea009e410 0x7fbea01a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbe9ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea009d6f0 0x7fbea01a5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59782/0 (socket says 172.21.15.72:59782) 2023-10-03T10:16:46.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbe9ffff700 1 -- 172.21.15.72:0/3497209221 learned_addr learned my addr 172.21.15.72:0/3497209221 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:46.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbe9f7fe700 1 -- 172.21.15.72:0/3497209221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea009d6f0 msgr2=0x7fbea01a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbe9f7fe700 1 --2- 172.21.15.72:0/3497209221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea009d6f0 0x7fbea01a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbe9f7fe700 1 -- 172.21.15.72:0/3497209221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea009e410 msgr2=0x7fbea01a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbe9f7fe700 1 --2- 172.21.15.72:0/3497209221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea009e410 0x7fbea01a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbe9f7fe700 1 -- 172.21.15.72:0/3497209221 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe900094a0 con 0x7fbea009e000 2023-10-03T10:16:46.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbea4e73700 1 --2- 172.21.15.72:0/3497209221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea009e410 0x7fbea01a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.860+0000 7fbe9ffff700 1 --2- 172.21.15.72:0/3497209221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea009d6f0 0x7fbea01a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.861+0000 7fbe9f7fe700 1 --2- 172.21.15.72:0/3497209221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea009e000 0x7fbea01a6510 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbea006e510 tx=0x7fbe94004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.861+0000 7fbe9cff9700 1 -- 172.21.15.72:0/3497209221 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94004300 con 0x7fbea009e000 2023-10-03T10:16:46.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.861+0000 7fbe9cff9700 1 -- 172.21.15.72:0/3497209221 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9401f070 con 0x7fbea009e000 2023-10-03T10:16:46.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.861+0000 7fbea68d6700 1 -- 172.21.15.72:0/3497209221 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe94009550 con 0x7fbea009e000 2023-10-03T10:16:46.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.861+0000 7fbe9cff9700 1 -- 172.21.15.72:0/3497209221 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe940036a0 con 0x7fbea009e000 2023-10-03T10:16:46.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.861+0000 7fbea68d6700 1 -- 172.21.15.72:0/3497209221 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea01a8da0 con 0x7fbea009e000 2023-10-03T10:16:46.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.861+0000 7fbe9cff9700 1 -- 172.21.15.72:0/3497209221 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe94021030 con 0x7fbea009e000 2023-10-03T10:16:46.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.862+0000 7fbe9cff9700 1 -- 172.21.15.72:0/3497209221 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbe94040870 con 0x7fbea009e000 2023-10-03T10:16:46.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.862+0000 7fbea68d6700 1 -- 172.21.15.72:0/3497209221 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea0074ea0 con 0x7fbea009e000 2023-10-03T10:16:46.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:46.866+0000 7fbe9cff9700 1 -- 172.21.15.72:0/3497209221 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe94015070 con 0x7fbea009e000 2023-10-03T10:16:47.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.049+0000 7fbea68d6700 1 -- 172.21.15.72:0/3497209221 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbea006c360 con 0x7fbea009e000 2023-10-03T10:16:47.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.050+0000 7fbe9cff9700 1 -- 172.21.15.72:0/3497209221 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe940239c0 con 0x7fbea009e000 2023-10-03T10:16:47.051 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:47.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.052+0000 7fbea68d6700 1 -- 172.21.15.72:0/3497209221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea009e000 msgr2=0x7fbea01a6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.052+0000 7fbea68d6700 1 --2- 172.21.15.72:0/3497209221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea009e000 0x7fbea01a6510 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbea006e510 tx=0x7fbe94004750 comp rx=0 tx=0).stop 2023-10-03T10:16:47.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.052+0000 7fbea68d6700 1 -- 172.21.15.72:0/3497209221 shutdown_connections 2023-10-03T10:16:47.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.052+0000 7fbea68d6700 1 --2- 172.21.15.72:0/3497209221 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbea009e410 0x7fbea01a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.052+0000 7fbea68d6700 1 --2- 172.21.15.72:0/3497209221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbea009d6f0 0x7fbea01a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.052+0000 7fbea68d6700 1 --2- 172.21.15.72:0/3497209221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbea009e000 0x7fbea01a6510 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.052+0000 7fbea68d6700 1 -- 172.21.15.72:0/3497209221 >> 172.21.15.72:0/3497209221 conn(0x7fbea0066f50 msgr2=0x7fbea01baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.052+0000 7fbea68d6700 1 -- 172.21.15.72:0/3497209221 shutdown_connections 2023-10-03T10:16:47.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.052+0000 7fbea68d6700 1 -- 172.21.15.72:0/3497209221 wait complete. 2023-10-03T10:16:47.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:47.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:47.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:47.456 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.462+0000 7fc3ae8e1700 1 Processor -- start 2023-10-03T10:16:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.462+0000 7fc3ae8e1700 1 -- start start 2023-10-03T10:16:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.462+0000 7fc3ae8e1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3a812cf60 0x7fc3a806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.462+0000 7fc3ae8e1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3a812f8b0 0x7fc3a812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.462+0000 7fc3ae8e1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a812cd90 con 0x7fc3a8130260 2023-10-03T10:16:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.462+0000 7fc3ae8e1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a812d330 con 0x7fc3a812cf60 2023-10-03T10:16:47.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.462+0000 7fc3ae8e1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a81306d0 con 0x7fc3a812f8b0 2023-10-03T10:16:47.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.462+0000 7fc3a77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3a812f8b0 0x7fc3a812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.462+0000 7fc3a7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3a812cf60 0x7fc3a806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.462+0000 7fc3a77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3a812f8b0 0x7fc3a812fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59790/0 (socket says 172.21.15.72:59790) 2023-10-03T10:16:47.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.462+0000 7fc3a7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3a812cf60 0x7fc3a806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33226/0 (socket says 172.21.15.72:33226) 2023-10-03T10:16:47.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.462+0000 7fc3a77fe700 1 -- 172.21.15.72:0/55348248 learned_addr learned my addr 172.21.15.72:0/55348248 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:47.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.463+0000 7fc3a7fff700 1 -- 172.21.15.72:0/55348248 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3a812f8b0 msgr2=0x7fc3a812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.463+0000 7fc3a7fff700 1 --2- 172.21.15.72:0/55348248 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3a812f8b0 0x7fc3a812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.463+0000 7fc3a7fff700 1 -- 172.21.15.72:0/55348248 >> v1:172.21.15.72:6789/0 conn(0x7fc3a8130260 legacy=0x7fc3a8136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.463+0000 7fc3a7fff700 1 -- 172.21.15.72:0/55348248 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a8071780 con 0x7fc3a812cf60 2023-10-03T10:16:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.463+0000 7fc3a6ffd700 1 -- 172.21.15.72:0/55348248 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054387180 0 0) 0x7fc3a812cd90 con 0x7fc3a8130260 2023-10-03T10:16:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.463+0000 7fc3a7fff700 1 --2- 172.21.15.72:0/55348248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a812cf60 0x7fc3a806f5d0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fc398009840 tx=0x7fc398009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425af8173b40c64f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.463+0000 7fc3a6ffd700 1 -- 172.21.15.72:0/55348248 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398011830 con 0x7fc3a812cf60 2023-10-03T10:16:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.463+0000 7fc3a6ffd700 1 -- 172.21.15.72:0/55348248 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc398011990 con 0x7fc3a812cf60 2023-10-03T10:16:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.463+0000 7fc3a6ffd700 1 -- 172.21.15.72:0/55348248 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398011d20 con 0x7fc3a812cf60 2023-10-03T10:16:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.464+0000 7fc3ae8e1700 1 -- 172.21.15.72:0/55348248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a812cf60 msgr2=0x7fc3a806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.464+0000 7fc3ae8e1700 1 --2- 172.21.15.72:0/55348248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a812cf60 0x7fc3a806f5d0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fc398009840 tx=0x7fc398009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.464+0000 7fc3ae8e1700 1 -- 172.21.15.72:0/55348248 shutdown_connections 2023-10-03T10:16:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.464+0000 7fc3ae8e1700 1 --2- 172.21.15.72:0/55348248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a812cf60 0x7fc3a806f5d0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.464+0000 7fc3ae8e1700 1 --2- 172.21.15.72:0/55348248 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3a812f8b0 0x7fc3a812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.464+0000 7fc3ae8e1700 1 -- 172.21.15.72:0/55348248 >> 172.21.15.72:0/55348248 conn(0x7fc3a80a2aa0 msgr2=0x7fc3a80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.464+0000 7fc3ae8e1700 1 -- 172.21.15.72:0/55348248 shutdown_connections 2023-10-03T10:16:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.464+0000 7fc3ae8e1700 1 -- 172.21.15.72:0/55348248 wait complete. 2023-10-03T10:16:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.465+0000 7fc3ae8e1700 1 Processor -- start 2023-10-03T10:16:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.465+0000 7fc3ae8e1700 1 -- start start 2023-10-03T10:16:47.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.465+0000 7fc3ae8e1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a812cf60 0x7fc3a811ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.465+0000 7fc3ae8e1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3a812f8b0 0x7fc3a811b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.465+0000 7fc3ae8e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3a8130260 0x7fc3a81c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.465+0000 7fc3ae8e1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a811cc40 con 0x7fc3a812cf60 2023-10-03T10:16:47.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.465+0000 7fc3ae8e1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a811a680 con 0x7fc3a8130260 2023-10-03T10:16:47.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.465+0000 7fc3ae8e1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a811cfe0 con 0x7fc3a812f8b0 2023-10-03T10:16:47.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3a7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a812cf60 0x7fc3a811ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3a7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a812cf60 0x7fc3a811ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33228/0 (socket says 172.21.15.72:33228) 2023-10-03T10:16:47.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3a7fff700 1 -- 172.21.15.72:0/3983348625 learned_addr learned my addr 172.21.15.72:0/3983348625 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:47.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3a77fe700 1 --2- 172.21.15.72:0/3983348625 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3a812f8b0 0x7fc3a811b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3ace7e700 1 --2- 172.21.15.72:0/3983348625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3a8130260 0x7fc3a81c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3a7fff700 1 -- 172.21.15.72:0/3983348625 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3a812f8b0 msgr2=0x7fc3a811b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3a7fff700 1 --2- 172.21.15.72:0/3983348625 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3a812f8b0 0x7fc3a811b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3a7fff700 1 -- 172.21.15.72:0/3983348625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3a8130260 msgr2=0x7fc3a81c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3a7fff700 1 --2- 172.21.15.72:0/3983348625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3a8130260 0x7fc3a81c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3a7fff700 1 -- 172.21.15.72:0/3983348625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3980094a0 con 0x7fc3a812cf60 2023-10-03T10:16:47.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3a77fe700 1 --2- 172.21.15.72:0/3983348625 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3a812f8b0 0x7fc3a811b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3a7fff700 1 --2- 172.21.15.72:0/3983348625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a812cf60 0x7fc3a811ad10 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fc398009fd0 tx=0x7fc398004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3a4ff9700 1 -- 172.21.15.72:0/3983348625 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398004480 con 0x7fc3a812cf60 2023-10-03T10:16:47.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3a4ff9700 1 -- 172.21.15.72:0/3983348625 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39801f070 con 0x7fc3a812cf60 2023-10-03T10:16:47.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3a4ff9700 1 -- 172.21.15.72:0/3983348625 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3980038a0 con 0x7fc3a812cf60 2023-10-03T10:16:47.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.466+0000 7fc3ae8e1700 1 -- 172.21.15.72:0/3983348625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a811a8e0 con 0x7fc3a812cf60 2023-10-03T10:16:47.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.467+0000 7fc3ae8e1700 1 -- 172.21.15.72:0/3983348625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a811db00 con 0x7fc3a812cf60 2023-10-03T10:16:47.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.468+0000 7fc3ae8e1700 1 -- 172.21.15.72:0/3983348625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a8074ea0 con 0x7fc3a812cf60 2023-10-03T10:16:47.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.468+0000 7fc3a4ff9700 1 -- 172.21.15.72:0/3983348625 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc398021030 con 0x7fc3a812cf60 2023-10-03T10:16:47.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.468+0000 7fc3a4ff9700 1 -- 172.21.15.72:0/3983348625 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc398040df0 con 0x7fc3a812cf60 2023-10-03T10:16:47.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.473+0000 7fc3a4ff9700 1 -- 172.21.15.72:0/3983348625 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc398023790 con 0x7fc3a812cf60 2023-10-03T10:16:47.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.562+0000 7f432531d700 1 Processor -- start 2023-10-03T10:16:47.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.562+0000 7f432531d700 1 -- start start 2023-10-03T10:16:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.562+0000 7f432531d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43200a0a30 0x7f43200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.562+0000 7f432531d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f432009d630 0x7f43200a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.562+0000 7f432531d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43200a2a70 con 0x7f4320133930 2023-10-03T10:16:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.562+0000 7f432531d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43200a01d0 con 0x7f43200a0a30 2023-10-03T10:16:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.562+0000 7f432531d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f432009e2b0 con 0x7f432009d630 2023-10-03T10:16:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.563+0000 7f431effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43200a0a30 0x7f43200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.563+0000 7f431effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43200a0a30 0x7f43200a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49256/0 (socket says 172.21.15.72:49256) 2023-10-03T10:16:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.563+0000 7f431effd700 1 -- 172.21.15.72:0/3039630075 learned_addr learned my addr 172.21.15.72:0/3039630075 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.563+0000 7f431e7fc700 1 --2- 172.21.15.72:0/3039630075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f432009d630 0x7f43200a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.563+0000 7f431e7fc700 1 -- 172.21.15.72:0/3039630075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43200a0a30 msgr2=0x7f43200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.563+0000 7f431e7fc700 1 --2- 172.21.15.72:0/3039630075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43200a0a30 0x7f43200a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.563+0000 7f431dffb700 1 -- 172.21.15.72:0/3039630075 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731721329 0 0) 0x7f43200a2a70 con 0x7f4320133930 2023-10-03T10:16:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.563+0000 7f431e7fc700 1 -- 172.21.15.72:0/3039630075 >> v1:172.21.15.72:6789/0 conn(0x7f4320133930 legacy=0x7f4320133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.563+0000 7f431e7fc700 1 -- 172.21.15.72:0/3039630075 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432009dc50 con 0x7f432009d630 2023-10-03T10:16:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.563+0000 7f431effd700 1 --2- 172.21.15.72:0/3039630075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43200a0a30 0x7f43200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.563+0000 7f431e7fc700 1 --2- 172.21.15.72:0/3039630075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f432009d630 0x7f43200a1340 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4314009870 tx=0x7f4314009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e1928d093291ff1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.563+0000 7f431dffb700 1 -- 172.21.15.72:0/3039630075 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314011830 con 0x7f432009d630 2023-10-03T10:16:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.563+0000 7f431dffb700 1 -- 172.21.15.72:0/3039630075 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4314011990 con 0x7f432009d630 2023-10-03T10:16:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.563+0000 7f431dffb700 1 -- 172.21.15.72:0/3039630075 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314011d20 con 0x7f432009d630 2023-10-03T10:16:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.564+0000 7f432531d700 1 -- 172.21.15.72:0/3039630075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f432009d630 msgr2=0x7f43200a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.564+0000 7f432531d700 1 --2- 172.21.15.72:0/3039630075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f432009d630 0x7f43200a1340 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4314009870 tx=0x7f4314009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.564+0000 7f432531d700 1 -- 172.21.15.72:0/3039630075 shutdown_connections 2023-10-03T10:16:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.564+0000 7f432531d700 1 --2- 172.21.15.72:0/3039630075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43200a0a30 0x7f43200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.564+0000 7f432531d700 1 --2- 172.21.15.72:0/3039630075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f432009d630 0x7f43200a1340 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.564+0000 7f432531d700 1 -- 172.21.15.72:0/3039630075 >> 172.21.15.72:0/3039630075 conn(0x7f43200a3050 msgr2=0x7f43200a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.564+0000 7f432531d700 1 -- 172.21.15.72:0/3039630075 shutdown_connections 2023-10-03T10:16:47.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.564+0000 7f432531d700 1 -- 172.21.15.72:0/3039630075 wait complete. 2023-10-03T10:16:47.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.565+0000 7f432531d700 1 Processor -- start 2023-10-03T10:16:47.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.565+0000 7f432531d700 1 -- start start 2023-10-03T10:16:47.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f432531d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432009d630 0x7f432011f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f432531d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43200a0a30 0x7f432011f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f432531d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4320133930 0x7f43201c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f432531d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432011ed60 con 0x7f432009d630 2023-10-03T10:16:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f432531d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43201224a0 con 0x7f43200a0a30 2023-10-03T10:16:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f432531d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4320120490 con 0x7f4320133930 2023-10-03T10:16:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f431e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43200a0a30 0x7f432011f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f431f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4320133930 0x7f43201c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f431e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43200a0a30 0x7f432011f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49262/0 (socket says 172.21.15.72:49262) 2023-10-03T10:16:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f431e7fc700 1 -- 172.21.15.72:0/2328737410 learned_addr learned my addr 172.21.15.72:0/2328737410 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f431e7fc700 1 -- 172.21.15.72:0/2328737410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4320133930 msgr2=0x7f43201c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f431e7fc700 1 --2- 172.21.15.72:0/2328737410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4320133930 0x7f43201c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f431e7fc700 1 -- 172.21.15.72:0/2328737410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432009d630 msgr2=0x7f432011f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f431e7fc700 1 --2- 172.21.15.72:0/2328737410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432009d630 0x7f432011f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f431e7fc700 1 -- 172.21.15.72:0/2328737410 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4310009550 con 0x7f43200a0a30 2023-10-03T10:16:47.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f431f7fe700 1 --2- 172.21.15.72:0/2328737410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4320133930 0x7f43201c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f431e7fc700 1 --2- 172.21.15.72:0/2328737410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43200a0a30 0x7f432011f820 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f43140090b0 tx=0x7f4314004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f43077fe700 1 -- 172.21.15.72:0/2328737410 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314004380 con 0x7f43200a0a30 2023-10-03T10:16:47.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f43077fe700 1 -- 172.21.15.72:0/2328737410 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431401f070 con 0x7f43200a0a30 2023-10-03T10:16:47.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.566+0000 7f432531d700 1 -- 172.21.15.72:0/2328737410 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43140094a0 con 0x7f43200a0a30 2023-10-03T10:16:47.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.567+0000 7f43077fe700 1 -- 172.21.15.72:0/2328737410 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43140036a0 con 0x7f43200a0a30 2023-10-03T10:16:47.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.567+0000 7f432531d700 1 -- 172.21.15.72:0/2328737410 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43200a0410 con 0x7f43200a0a30 2023-10-03T10:16:47.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.568+0000 7f432531d700 1 -- 172.21.15.72:0/2328737410 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43201222e0 con 0x7f43200a0a30 2023-10-03T10:16:47.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.568+0000 7f43077fe700 1 -- 172.21.15.72:0/2328737410 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4314021030 con 0x7f43200a0a30 2023-10-03T10:16:47.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.568+0000 7f43077fe700 1 -- 172.21.15.72:0/2328737410 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f43140406a0 con 0x7f43200a0a30 2023-10-03T10:16:47.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.572+0000 7f43077fe700 1 -- 172.21.15.72:0/2328737410 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43201222e0 con 0x7f43200a0a30 2023-10-03T10:16:47.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.590+0000 7f78a69ba700 1 Processor -- start 2023-10-03T10:16:47.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.590+0000 7f78a69ba700 1 -- start start 2023-10-03T10:16:47.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.590+0000 7f78a69ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a00a0a30 0x7f78a00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.590+0000 7f78a69ba700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78a0138d80 0x7f78a013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.590+0000 7f78a69ba700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a00a2a70 con 0x7f78a009d630 2023-10-03T10:16:47.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f78a69ba700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a00a01d0 con 0x7f78a0138d80 2023-10-03T10:16:47.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f78a69ba700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a009e2b0 con 0x7f78a00a0a30 2023-10-03T10:16:47.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f789ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a00a0a30 0x7f78a00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f789f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f78a009d630 0x7f78a00a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42264/0 (socket says 172.21.15.72:42264) 2023-10-03T10:16:47.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f789ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a00a0a30 0x7f78a00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49278/0 (socket says 172.21.15.72:49278) 2023-10-03T10:16:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f789f7fe700 1 -- 172.21.15.72:0/590790291 learned_addr learned my addr 172.21.15.72:0/590790291 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f78a4f57700 1 --2- 172.21.15.72:0/590790291 >> v2:172.21.15.72:3300/0 conn(0x7f78a0138d80 0x7f78a013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f789effd700 1 -- 172.21.15.72:0/590790291 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982887698 0 0) 0x7f78a00a2a70 con 0x7f78a009d630 2023-10-03T10:16:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f789effd700 1 -- 172.21.15.72:0/590790291 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78880035b0 con 0x7f78a009d630 2023-10-03T10:16:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f789ffff700 1 -- 172.21.15.72:0/590790291 >> v2:172.21.15.72:3300/0 conn(0x7f78a0138d80 msgr2=0x7f78a013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f789ffff700 1 --2- 172.21.15.72:0/590790291 >> v2:172.21.15.72:3300/0 conn(0x7f78a0138d80 0x7f78a013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f789ffff700 1 -- 172.21.15.72:0/590790291 >> v1:172.21.15.72:6789/0 conn(0x7f78a009d630 legacy=0x7f78a00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f789ffff700 1 -- 172.21.15.72:0/590790291 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a009dc50 con 0x7f78a00a0a30 2023-10-03T10:16:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f789ffff700 1 --2- 172.21.15.72:0/590790291 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a00a0a30 0x7f78a00a0e00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7890009840 tx=0x7f7890009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a2006b390b078e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f789effd700 1 -- 172.21.15.72:0/590790291 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7890011830 con 0x7f78a00a0a30 2023-10-03T10:16:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f789effd700 1 -- 172.21.15.72:0/590790291 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7890011990 con 0x7f78a00a0a30 2023-10-03T10:16:47.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.591+0000 7f789effd700 1 -- 172.21.15.72:0/590790291 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7890011d20 con 0x7f78a00a0a30 2023-10-03T10:16:47.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.592+0000 7f78a69ba700 1 -- 172.21.15.72:0/590790291 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a00a0a30 msgr2=0x7f78a00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.592+0000 7f78a69ba700 1 --2- 172.21.15.72:0/590790291 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a00a0a30 0x7f78a00a0e00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7890009840 tx=0x7f7890009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:47.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.592+0000 7f78a69ba700 1 -- 172.21.15.72:0/590790291 shutdown_connections 2023-10-03T10:16:47.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.592+0000 7f78a69ba700 1 --2- 172.21.15.72:0/590790291 >> v2:172.21.15.72:3300/0 conn(0x7f78a0138d80 0x7f78a013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.592+0000 7f78a69ba700 1 --2- 172.21.15.72:0/590790291 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a00a0a30 0x7f78a00a0e00 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.592+0000 7f78a69ba700 1 -- 172.21.15.72:0/590790291 >> 172.21.15.72:0/590790291 conn(0x7f78a00a3050 msgr2=0x7f78a00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.592+0000 7f78a69ba700 1 -- 172.21.15.72:0/590790291 shutdown_connections 2023-10-03T10:16:47.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.592+0000 7f78a69ba700 1 -- 172.21.15.72:0/590790291 wait complete. 2023-10-03T10:16:47.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.593+0000 7f78a69ba700 1 Processor -- start 2023-10-03T10:16:47.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.593+0000 7f78a69ba700 1 -- start start 2023-10-03T10:16:47.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.593+0000 7f78a69ba700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a009d630 0x7f78a0133830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.593+0000 7f78a69ba700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78a00a0a30 0x7f78a0133d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.593+0000 7f78a69ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a0138d80 0x7f78a01342b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.593+0000 7f78a69ba700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a0135840 con 0x7f78a00a0a30 2023-10-03T10:16:47.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.593+0000 7f78a69ba700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a0137020 con 0x7f78a0138d80 2023-10-03T10:16:47.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.593+0000 7f78a69ba700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78a013add0 con 0x7f78a009d630 2023-10-03T10:16:47.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f789ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a009d630 0x7f78a0133830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f789ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a009d630 0x7f78a0133830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59830/0 (socket says 172.21.15.72:59830) 2023-10-03T10:16:47.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f78a4f57700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a0138d80 0x7f78a01342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f789ffff700 1 -- 172.21.15.72:0/4013848578 learned_addr learned my addr 172.21.15.72:0/4013848578 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:47.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f789f7fe700 1 --2- 172.21.15.72:0/4013848578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78a00a0a30 0x7f78a0133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f789ffff700 1 -- 172.21.15.72:0/4013848578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a0138d80 msgr2=0x7f78a01342b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f789ffff700 1 --2- 172.21.15.72:0/4013848578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a0138d80 0x7f78a01342b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f789ffff700 1 -- 172.21.15.72:0/4013848578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78a00a0a30 msgr2=0x7f78a0133d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f789ffff700 1 --2- 172.21.15.72:0/4013848578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78a00a0a30 0x7f78a0133d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f789ffff700 1 -- 172.21.15.72:0/4013848578 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78900094a0 con 0x7f78a009d630 2023-10-03T10:16:47.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f78a4f57700 1 --2- 172.21.15.72:0/4013848578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a0138d80 0x7f78a01342b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f789ffff700 1 --2- 172.21.15.72:0/4013848578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a009d630 0x7f78a0133830 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f78900090b0 tx=0x7f7890004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f789cff9700 1 -- 172.21.15.72:0/4013848578 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7890004380 con 0x7f78a009d630 2023-10-03T10:16:47.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f789cff9700 1 -- 172.21.15.72:0/4013848578 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789001f070 con 0x7f78a009d630 2023-10-03T10:16:47.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f789cff9700 1 -- 172.21.15.72:0/4013848578 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78900036a0 con 0x7f78a009d630 2023-10-03T10:16:47.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f78a69ba700 1 -- 172.21.15.72:0/4013848578 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a00a0410 con 0x7f78a009d630 2023-10-03T10:16:47.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.594+0000 7f78a69ba700 1 -- 172.21.15.72:0/4013848578 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a0137a90 con 0x7f78a009d630 2023-10-03T10:16:47.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.595+0000 7f789cff9700 1 -- 172.21.15.72:0/4013848578 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7890021030 con 0x7f78a009d630 2023-10-03T10:16:47.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.595+0000 7f789cff9700 1 -- 172.21.15.72:0/4013848578 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f78900406b0 con 0x7f78a009d630 2023-10-03T10:16:47.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.596+0000 7f78a69ba700 1 -- 172.21.15.72:0/4013848578 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a00747f0 con 0x7f78a009d630 2023-10-03T10:16:47.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.600+0000 7f789cff9700 1 -- 172.21.15.72:0/4013848578 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7890023790 con 0x7f78a009d630 2023-10-03T10:16:47.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.709+0000 7fc3ae8e1700 1 -- 172.21.15.72:0/3983348625 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc3a80713a0 con 0x7fc3a812cf60 2023-10-03T10:16:47.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.709+0000 7fc3a4ff9700 1 -- 172.21.15.72:0/3983348625 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc398015030 con 0x7fc3a812cf60 2023-10-03T10:16:47.710 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.711+0000 7fc3ae8e1700 1 -- 172.21.15.72:0/3983348625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a812cf60 msgr2=0x7fc3a811ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.711+0000 7fc3ae8e1700 1 --2- 172.21.15.72:0/3983348625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a812cf60 0x7fc3a811ad10 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fc398009fd0 tx=0x7fc398004750 comp rx=0 tx=0).stop 2023-10-03T10:16:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.711+0000 7fc3ae8e1700 1 -- 172.21.15.72:0/3983348625 shutdown_connections 2023-10-03T10:16:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.711+0000 7fc3ae8e1700 1 --2- 172.21.15.72:0/3983348625 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a812cf60 0x7fc3a811ad10 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.711+0000 7fc3ae8e1700 1 --2- 172.21.15.72:0/3983348625 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3a8130260 0x7fc3a81c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.711+0000 7fc3ae8e1700 1 --2- 172.21.15.72:0/3983348625 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3a812f8b0 0x7fc3a811b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.711+0000 7fc3ae8e1700 1 -- 172.21.15.72:0/3983348625 >> 172.21.15.72:0/3983348625 conn(0x7fc3a80a2aa0 msgr2=0x7fc3a809e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.711+0000 7fc3ae8e1700 1 -- 172.21.15.72:0/3983348625 shutdown_connections 2023-10-03T10:16:47.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.711+0000 7fc3ae8e1700 1 -- 172.21.15.72:0/3983348625 wait complete. 2023-10-03T10:16:47.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:47.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.793+0000 7f78a69ba700 1 -- 172.21.15.72:0/4013848578 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f78a0072980 con 0x7f78a009d630 2023-10-03T10:16:47.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.794+0000 7f789cff9700 1 -- 172.21.15.72:0/4013848578 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7890015020 con 0x7f78a009d630 2023-10-03T10:16:47.794 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:47.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.796+0000 7f78a69ba700 1 -- 172.21.15.72:0/4013848578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a009d630 msgr2=0x7f78a0133830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.796+0000 7f78a69ba700 1 --2- 172.21.15.72:0/4013848578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a009d630 0x7f78a0133830 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f78900090b0 tx=0x7f7890004750 comp rx=0 tx=0).stop 2023-10-03T10:16:47.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.796+0000 7f78a69ba700 1 -- 172.21.15.72:0/4013848578 shutdown_connections 2023-10-03T10:16:47.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.796+0000 7f78a69ba700 1 --2- 172.21.15.72:0/4013848578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78a0138d80 0x7f78a01342b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.796+0000 7f78a69ba700 1 --2- 172.21.15.72:0/4013848578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78a009d630 0x7f78a0133830 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.796+0000 7f78a69ba700 1 --2- 172.21.15.72:0/4013848578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78a00a0a30 0x7f78a0133d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.796+0000 7f78a69ba700 1 -- 172.21.15.72:0/4013848578 >> 172.21.15.72:0/4013848578 conn(0x7f78a00a3050 msgr2=0x7f78a009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.796+0000 7f78a69ba700 1 -- 172.21.15.72:0/4013848578 shutdown_connections 2023-10-03T10:16:47.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.796+0000 7f78a69ba700 1 -- 172.21.15.72:0/4013848578 wait complete. 2023-10-03T10:16:47.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.803+0000 7f432531d700 1 -- 172.21.15.72:0/2328737410 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f43201222e0 con 0x7f43200a0a30 2023-10-03T10:16:47.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.803+0000 7f43077fe700 1 -- 172.21.15.72:0/2328737410 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f43201222e0 con 0x7f43200a0a30 2023-10-03T10:16:47.804 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:47.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.806+0000 7f432531d700 1 -- 172.21.15.72:0/2328737410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43200a0a30 msgr2=0x7f432011f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.806+0000 7f432531d700 1 --2- 172.21.15.72:0/2328737410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43200a0a30 0x7f432011f820 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f43140090b0 tx=0x7f4314004750 comp rx=0 tx=0).stop 2023-10-03T10:16:47.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.806+0000 7f432531d700 1 -- 172.21.15.72:0/2328737410 shutdown_connections 2023-10-03T10:16:47.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.806+0000 7f432531d700 1 --2- 172.21.15.72:0/2328737410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432009d630 0x7f432011f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.806+0000 7f432531d700 1 --2- 172.21.15.72:0/2328737410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4320133930 0x7f43201c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.806+0000 7f432531d700 1 --2- 172.21.15.72:0/2328737410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43200a0a30 0x7f432011f820 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.806+0000 7f432531d700 1 -- 172.21.15.72:0/2328737410 >> 172.21.15.72:0/2328737410 conn(0x7f43200a3050 msgr2=0x7f43201bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.806+0000 7f432531d700 1 -- 172.21.15.72:0/2328737410 shutdown_connections 2023-10-03T10:16:47.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:47.806+0000 7f432531d700 1 -- 172.21.15.72:0/2328737410 wait complete. 2023-10-03T10:16:47.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:47.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:48.065 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:48.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.187+0000 7f8d80042700 1 Processor -- start 2023-10-03T10:16:48.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.187+0000 7f8d80042700 1 -- start start 2023-10-03T10:16:48.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.187+0000 7f8d80042700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d7812cf60 0x7f8d7806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.187+0000 7f8d80042700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d7812f8b0 0x7f8d7812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.187+0000 7f8d80042700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7812cd90 con 0x7f8d78130260 2023-10-03T10:16:48.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.187+0000 7f8d80042700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7812d330 con 0x7f8d7812cf60 2023-10-03T10:16:48.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.187+0000 7f8d80042700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d781306d0 con 0x7f8d7812f8b0 2023-10-03T10:16:48.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.188+0000 7f8d7ddde700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d7812cf60 0x7f8d7806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.188+0000 7f8d7d5dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d7812f8b0 0x7f8d7812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.188+0000 7f8d7ddde700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d7812cf60 0x7f8d7806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33254/0 (socket says 172.21.15.72:33254) 2023-10-03T10:16:48.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.188+0000 7f8d7ddde700 1 -- 172.21.15.72:0/1132111154 learned_addr learned my addr 172.21.15.72:0/1132111154 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:48.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.188+0000 7f8d7d5dd700 1 -- 172.21.15.72:0/1132111154 >> v2:172.21.15.72:3300/0 conn(0x7f8d7812cf60 msgr2=0x7f8d7806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.188+0000 7f8d7d5dd700 1 --2- 172.21.15.72:0/1132111154 >> v2:172.21.15.72:3300/0 conn(0x7f8d7812cf60 0x7f8d7806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.188+0000 7f8d7d5dd700 1 -- 172.21.15.72:0/1132111154 >> v1:172.21.15.72:6789/0 conn(0x7f8d78130260 legacy=0x7f8d78136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.188+0000 7f8d7d5dd700 1 -- 172.21.15.72:0/1132111154 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d78071780 con 0x7f8d7812f8b0 2023-10-03T10:16:48.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.188+0000 7f8d7ddde700 1 --2- 172.21.15.72:0/1132111154 >> v2:172.21.15.72:3300/0 conn(0x7f8d7812cf60 0x7f8d7806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.188+0000 7f8d7cddc700 1 -- 172.21.15.72:0/1132111154 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271744495 0 0) 0x7f8d7812cd90 con 0x7f8d78130260 2023-10-03T10:16:48.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.188+0000 7f8d7d5dd700 1 --2- 172.21.15.72:0/1132111154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d7812f8b0 0x7f8d7812fd20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009840 tx=0x7f8d68009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37344cf9b882ea31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.188+0000 7f8d7cddc700 1 -- 172.21.15.72:0/1132111154 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d68010820 con 0x7f8d7812f8b0 2023-10-03T10:16:48.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.188+0000 7f8d7cddc700 1 -- 172.21.15.72:0/1132111154 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d68010980 con 0x7f8d7812f8b0 2023-10-03T10:16:48.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.188+0000 7f8d7cddc700 1 -- 172.21.15.72:0/1132111154 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d68010d10 con 0x7f8d7812f8b0 2023-10-03T10:16:48.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.189+0000 7f8d80042700 1 -- 172.21.15.72:0/1132111154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d7812f8b0 msgr2=0x7f8d7812fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.189+0000 7f8d80042700 1 --2- 172.21.15.72:0/1132111154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d7812f8b0 0x7f8d7812fd20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009840 tx=0x7f8d68009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:48.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.189+0000 7f8d80042700 1 -- 172.21.15.72:0/1132111154 shutdown_connections 2023-10-03T10:16:48.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.189+0000 7f8d80042700 1 --2- 172.21.15.72:0/1132111154 >> v2:172.21.15.72:3300/0 conn(0x7f8d7812cf60 0x7f8d7806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.189+0000 7f8d80042700 1 --2- 172.21.15.72:0/1132111154 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d7812f8b0 0x7f8d7812fd20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.189+0000 7f8d80042700 1 -- 172.21.15.72:0/1132111154 >> 172.21.15.72:0/1132111154 conn(0x7f8d780a2aa0 msgr2=0x7f8d780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.189+0000 7f8d80042700 1 -- 172.21.15.72:0/1132111154 shutdown_connections 2023-10-03T10:16:48.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.189+0000 7f8d80042700 1 -- 172.21.15.72:0/1132111154 wait complete. 2023-10-03T10:16:48.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.190+0000 7f8d80042700 1 Processor -- start 2023-10-03T10:16:48.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.190+0000 7f8d80042700 1 -- start start 2023-10-03T10:16:48.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.190+0000 7f8d80042700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7812cf60 0x7f8d781c1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.190+0000 7f8d80042700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d7812f8b0 0x7f8d781c1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.190+0000 7f8d80042700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d78130260 0x7f8d781c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.190+0000 7f8d80042700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d78129ce0 con 0x7f8d7812cf60 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.190+0000 7f8d80042700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d78118e70 con 0x7f8d78130260 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.190+0000 7f8d80042700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7809ca00 con 0x7f8d7812f8b0 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.190+0000 7f8d7ddde700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7812cf60 0x7f8d781c1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.190+0000 7f8d7d5dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d7812f8b0 0x7f8d781c1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.190+0000 7f8d7ddde700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7812cf60 0x7f8d781c1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33262/0 (socket says 172.21.15.72:33262) 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.190+0000 7f8d7ddde700 1 -- 172.21.15.72:0/3699486526 learned_addr learned my addr 172.21.15.72:0/3699486526 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.190+0000 7f8d7e5df700 1 --2- 172.21.15.72:0/3699486526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d78130260 0x7f8d781c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.191+0000 7f8d7d5dd700 1 -- 172.21.15.72:0/3699486526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d78130260 msgr2=0x7f8d781c41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.191+0000 7f8d7d5dd700 1 --2- 172.21.15.72:0/3699486526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d78130260 0x7f8d781c41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.191+0000 7f8d7d5dd700 1 -- 172.21.15.72:0/3699486526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7812cf60 msgr2=0x7f8d781c1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.191+0000 7f8d7d5dd700 1 --2- 172.21.15.72:0/3699486526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7812cf60 0x7f8d781c1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.191+0000 7f8d7d5dd700 1 -- 172.21.15.72:0/3699486526 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74009550 con 0x7f8d7812f8b0 2023-10-03T10:16:48.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.191+0000 7f8d7ddde700 1 --2- 172.21.15.72:0/3699486526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7812cf60 0x7f8d781c1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.191+0000 7f8d7d5dd700 1 --2- 172.21.15.72:0/3699486526 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d7812f8b0 0x7f8d781c1690 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8d68016000 tx=0x7f8d68004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.191+0000 7f8d6e7fc700 1 -- 172.21.15.72:0/3699486526 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6801e070 con 0x7f8d7812f8b0 2023-10-03T10:16:48.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.191+0000 7f8d6e7fc700 1 -- 172.21.15.72:0/3699486526 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d68010d00 con 0x7f8d7812f8b0 2023-10-03T10:16:48.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.191+0000 7f8d80042700 1 -- 172.21.15.72:0/3699486526 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d680094a0 con 0x7f8d7812f8b0 2023-10-03T10:16:48.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.191+0000 7f8d6e7fc700 1 -- 172.21.15.72:0/3699486526 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d680038c0 con 0x7f8d7812f8b0 2023-10-03T10:16:48.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.191+0000 7f8d80042700 1 -- 172.21.15.72:0/3699486526 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d78067cb0 con 0x7f8d7812f8b0 2023-10-03T10:16:48.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.192+0000 7f8d6e7fc700 1 -- 172.21.15.72:0/3699486526 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d68003a20 con 0x7f8d7812f8b0 2023-10-03T10:16:48.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.192+0000 7f8d6e7fc700 1 -- 172.21.15.72:0/3699486526 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8d68040830 con 0x7f8d7812f8b0 2023-10-03T10:16:48.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.192+0000 7f8d80042700 1 -- 172.21.15.72:0/3699486526 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d780a2470 con 0x7f8d7812f8b0 2023-10-03T10:16:48.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.197+0000 7f8d6e7fc700 1 -- 172.21.15.72:0/3699486526 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d680197d0 con 0x7f8d7812f8b0 2023-10-03T10:16:48.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.379+0000 7f8d80042700 1 -- 172.21.15.72:0/3699486526 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8d78074ea0 con 0x7f8d7812f8b0 2023-10-03T10:16:48.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.380+0000 7f8d6e7fc700 1 -- 172.21.15.72:0/3699486526 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d68028030 con 0x7f8d7812f8b0 2023-10-03T10:16:48.380 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:48.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.382+0000 7f8d80042700 1 -- 172.21.15.72:0/3699486526 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d7812f8b0 msgr2=0x7f8d781c1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.382+0000 7f8d80042700 1 --2- 172.21.15.72:0/3699486526 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d7812f8b0 0x7f8d781c1690 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8d68016000 tx=0x7f8d68004750 comp rx=0 tx=0).stop 2023-10-03T10:16:48.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.382+0000 7f8d80042700 1 -- 172.21.15.72:0/3699486526 shutdown_connections 2023-10-03T10:16:48.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.382+0000 7f8d80042700 1 --2- 172.21.15.72:0/3699486526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d7812cf60 0x7f8d781c1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.382+0000 7f8d80042700 1 --2- 172.21.15.72:0/3699486526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d78130260 0x7f8d781c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.382+0000 7f8d80042700 1 --2- 172.21.15.72:0/3699486526 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d7812f8b0 0x7f8d781c1690 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.382+0000 7f8d80042700 1 -- 172.21.15.72:0/3699486526 >> 172.21.15.72:0/3699486526 conn(0x7f8d780a2aa0 msgr2=0x7f8d780a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.382+0000 7f8d80042700 1 -- 172.21.15.72:0/3699486526 shutdown_connections 2023-10-03T10:16:48.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.382+0000 7f8d80042700 1 -- 172.21.15.72:0/3699486526 wait complete. 2023-10-03T10:16:48.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:48.725 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:48.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:48.819 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:48.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.851+0000 7fb0ee6cf700 1 Processor -- start 2023-10-03T10:16:48.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.851+0000 7fb0ee6cf700 1 -- start start 2023-10-03T10:16:48.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.851+0000 7fb0ee6cf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e8133960 0x7fb0e8133d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.851+0000 7fb0ee6cf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0e809e990 0x7fb0e813b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.851+0000 7fb0ee6cf700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e8133550 con 0x7fb0e809de50 2023-10-03T10:16:48.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.851+0000 7fb0ee6cf700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e806fab0 con 0x7fb0e809e990 2023-10-03T10:16:48.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.851+0000 7fb0ee6cf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8071e20 con 0x7fb0e8133960 2023-10-03T10:16:48.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.852+0000 7fb0ecc6c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0e809e990 0x7fb0e813b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.852+0000 7fb0e7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e8133960 0x7fb0e8133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.852+0000 7fb0ecc6c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0e809e990 0x7fb0e813b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52368/0 (socket says 172.21.15.72:52368) 2023-10-03T10:16:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.852+0000 7fb0e7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e8133960 0x7fb0e8133d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48442/0 (socket says 172.21.15.72:48442) 2023-10-03T10:16:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.852+0000 7fb0ecc6c700 1 -- 172.21.15.72:0/1346405404 learned_addr learned my addr 172.21.15.72:0/1346405404 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.852+0000 7fb0ecc6c700 1 -- 172.21.15.72:0/1346405404 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e8133960 msgr2=0x7fb0e8133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.852+0000 7fb0ecc6c700 1 --2- 172.21.15.72:0/1346405404 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e8133960 0x7fb0e8133d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.852+0000 7fb0ecc6c700 1 -- 172.21.15.72:0/1346405404 >> v1:172.21.15.72:6789/0 conn(0x7fb0e809de50 legacy=0x7fb0e809e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.852+0000 7fb0ecc6c700 1 -- 172.21.15.72:0/1346405404 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e806f1e0 con 0x7fb0e809e990 2023-10-03T10:16:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.852+0000 7fb0ecc6c700 1 --2- 172.21.15.72:0/1346405404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e809e990 0x7fb0e813b7f0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0009e50 tx=0x7fb0e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8168def614d98a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.852+0000 7fb0e6ffd700 1 -- 172.21.15.72:0/1346405404 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e000e070 con 0x7fb0e809e990 2023-10-03T10:16:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.852+0000 7fb0e6ffd700 1 -- 172.21.15.72:0/1346405404 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e000b910 con 0x7fb0e809e990 2023-10-03T10:16:48.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.852+0000 7fb0e6ffd700 1 -- 172.21.15.72:0/1346405404 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e000bcc0 con 0x7fb0e809e990 2023-10-03T10:16:48.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.853+0000 7fb0ee6cf700 1 -- 172.21.15.72:0/1346405404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e809e990 msgr2=0x7fb0e813b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.853+0000 7fb0ee6cf700 1 --2- 172.21.15.72:0/1346405404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e809e990 0x7fb0e813b7f0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0009e50 tx=0x7fb0e000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:48.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.853+0000 7fb0ee6cf700 1 -- 172.21.15.72:0/1346405404 shutdown_connections 2023-10-03T10:16:48.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.853+0000 7fb0ee6cf700 1 --2- 172.21.15.72:0/1346405404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e809e990 0x7fb0e813b7f0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.853+0000 7fb0ee6cf700 1 --2- 172.21.15.72:0/1346405404 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e8133960 0x7fb0e8133d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.853+0000 7fb0ee6cf700 1 -- 172.21.15.72:0/1346405404 >> 172.21.15.72:0/1346405404 conn(0x7fb0e80a2610 msgr2=0x7fb0e80a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.853+0000 7fb0ee6cf700 1 -- 172.21.15.72:0/1346405404 shutdown_connections 2023-10-03T10:16:48.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.853+0000 7fb0ee6cf700 1 -- 172.21.15.72:0/1346405404 wait complete. 2023-10-03T10:16:48.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.854+0000 7fb0ee6cf700 1 Processor -- start 2023-10-03T10:16:48.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.854+0000 7fb0ee6cf700 1 -- start start 2023-10-03T10:16:48.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.854+0000 7fb0ee6cf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e809de50 0x7fb0e811f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.854+0000 7fb0ee6cf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e809e990 0x7fb0e811fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.854+0000 7fb0ee6cf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e8133960 0x7fb0e8120420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.854+0000 7fb0ee6cf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8122e90 con 0x7fb0e809de50 2023-10-03T10:16:48.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.854+0000 7fb0ee6cf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8123430 con 0x7fb0e809e990 2023-10-03T10:16:48.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.854+0000 7fb0ee6cf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8121d50 con 0x7fb0e8133960 2023-10-03T10:16:48.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.854+0000 7fb0e7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e809de50 0x7fb0e811f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0e7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e809de50 0x7fb0e811f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52376/0 (socket says 172.21.15.72:52376) 2023-10-03T10:16:48.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0e7fff700 1 -- 172.21.15.72:0/3925037294 learned_addr learned my addr 172.21.15.72:0/3925037294 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:48.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0e77fe700 1 --2- 172.21.15.72:0/3925037294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e809e990 0x7fb0e811fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0ecc6c700 1 --2- 172.21.15.72:0/3925037294 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e8133960 0x7fb0e8120420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0e7fff700 1 -- 172.21.15.72:0/3925037294 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e8133960 msgr2=0x7fb0e8120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0e7fff700 1 --2- 172.21.15.72:0/3925037294 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e8133960 0x7fb0e8120420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0e7fff700 1 -- 172.21.15.72:0/3925037294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e809e990 msgr2=0x7fb0e811fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0e7fff700 1 --2- 172.21.15.72:0/3925037294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e809e990 0x7fb0e811fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0e7fff700 1 -- 172.21.15.72:0/3925037294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e0009b30 con 0x7fb0e809de50 2023-10-03T10:16:48.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0e77fe700 1 --2- 172.21.15.72:0/3925037294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e809e990 0x7fb0e811fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0e7fff700 1 --2- 172.21.15.72:0/3925037294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e809de50 0x7fb0e811f9a0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800e9b0 tx=0x7fb0d800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0e4ff9700 1 -- 172.21.15.72:0/3925037294 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8009710 con 0x7fb0e809de50 2023-10-03T10:16:48.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0e4ff9700 1 -- 172.21.15.72:0/3925037294 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d800ee50 con 0x7fb0e809de50 2023-10-03T10:16:48.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0ee6cf700 1 -- 172.21.15.72:0/3925037294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e806eb10 con 0x7fb0e809de50 2023-10-03T10:16:48.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0e4ff9700 1 -- 172.21.15.72:0/3925037294 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d800ca50 con 0x7fb0e809de50 2023-10-03T10:16:48.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.855+0000 7fb0ee6cf700 1 -- 172.21.15.72:0/3925037294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e8123150 con 0x7fb0e809de50 2023-10-03T10:16:48.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.857+0000 7fb0ee6cf700 1 -- 172.21.15.72:0/3925037294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e80747f0 con 0x7fb0e809de50 2023-10-03T10:16:48.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.857+0000 7fb0e4ff9700 1 -- 172.21.15.72:0/3925037294 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0d800cbb0 con 0x7fb0e809de50 2023-10-03T10:16:48.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.857+0000 7fb0e4ff9700 1 -- 172.21.15.72:0/3925037294 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb0d803ff30 con 0x7fb0e809de50 2023-10-03T10:16:48.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.862+0000 7fb0e4ff9700 1 -- 172.21.15.72:0/3925037294 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0d8011350 con 0x7fb0e809de50 2023-10-03T10:16:48.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.943+0000 7f05944d9700 1 Processor -- start 2023-10-03T10:16:48.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.943+0000 7f05944d9700 1 -- start start 2023-10-03T10:16:48.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.944+0000 7f05944d9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f058c0a0090 0x7f058c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.944+0000 7f05944d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058c09d130 0x7f058c139170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.944+0000 7f05944d9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058c09ba70 con 0x7f058c09c650 2023-10-03T10:16:48.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.944+0000 7f05944d9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c09e8f0 con 0x7f058c0a0090 2023-10-03T10:16:48.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.944+0000 7f05944d9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0a0760 con 0x7f058c09d130 2023-10-03T10:16:48.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.944+0000 7f0592a76700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058c09d130 0x7f058c139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.944+0000 7f0591a74700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f058c0a0090 0x7f058c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.944+0000 7f0592a76700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058c09d130 0x7f058c139170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48472/0 (socket says 172.21.15.72:48472) 2023-10-03T10:16:48.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.944+0000 7f0592a76700 1 -- 172.21.15.72:0/1090189437 learned_addr learned my addr 172.21.15.72:0/1090189437 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:48.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.944+0000 7f0592275700 1 --1- 172.21.15.72:0/1090189437 >> v1:172.21.15.72:6789/0 conn(0x7f058c09c650 0x7f058c09ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34520/0 (socket says 172.21.15.72:34520) 2023-10-03T10:16:48.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.945+0000 7f0591a74700 1 -- 172.21.15.72:0/1090189437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058c09d130 msgr2=0x7f058c139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.945+0000 7f0591a74700 1 --2- 172.21.15.72:0/1090189437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058c09d130 0x7f058c139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.945+0000 7f0591a74700 1 -- 172.21.15.72:0/1090189437 >> v1:172.21.15.72:6789/0 conn(0x7f058c09c650 legacy=0x7f058c09ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.945+0000 7f0591273700 1 -- 172.21.15.72:0/1090189437 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717295520 0 0) 0x7f058c09ba70 con 0x7f058c09c650 2023-10-03T10:16:48.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.945+0000 7f0591a74700 1 -- 172.21.15.72:0/1090189437 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c09a080 con 0x7f058c0a0090 2023-10-03T10:16:48.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.945+0000 7f0592a76700 1 --2- 172.21.15.72:0/1090189437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058c09d130 0x7f058c139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.945+0000 7f0591a74700 1 --2- 172.21.15.72:0/1090189437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058c0a0090 0x7f058c136c20 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f057c009840 tx=0x7f057c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ca20235cdfc9b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.945+0000 7f0591273700 1 -- 172.21.15.72:0/1090189437 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c011830 con 0x7f058c0a0090 2023-10-03T10:16:48.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.945+0000 7f0591273700 1 -- 172.21.15.72:0/1090189437 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c011990 con 0x7f058c0a0090 2023-10-03T10:16:48.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.945+0000 7f0591273700 1 -- 172.21.15.72:0/1090189437 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c011d20 con 0x7f058c0a0090 2023-10-03T10:16:48.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.945+0000 7f05944d9700 1 -- 172.21.15.72:0/1090189437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058c0a0090 msgr2=0x7f058c136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.945+0000 7f05944d9700 1 --2- 172.21.15.72:0/1090189437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058c0a0090 0x7f058c136c20 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f057c009840 tx=0x7f057c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:48.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.946+0000 7f05944d9700 1 -- 172.21.15.72:0/1090189437 shutdown_connections 2023-10-03T10:16:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.946+0000 7f05944d9700 1 --2- 172.21.15.72:0/1090189437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058c09d130 0x7f058c139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.946+0000 7f05944d9700 1 --2- 172.21.15.72:0/1090189437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058c0a0090 0x7f058c136c20 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.946+0000 7f05944d9700 1 -- 172.21.15.72:0/1090189437 >> 172.21.15.72:0/1090189437 conn(0x7f058c0a3f70 msgr2=0x7f058c0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.946+0000 7f05944d9700 1 -- 172.21.15.72:0/1090189437 shutdown_connections 2023-10-03T10:16:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.946+0000 7f05944d9700 1 -- 172.21.15.72:0/1090189437 wait complete. 2023-10-03T10:16:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.947+0000 7f05944d9700 1 Processor -- start 2023-10-03T10:16:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.947+0000 7f05944d9700 1 -- start start 2023-10-03T10:16:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f05944d9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058c09c650 0x7f058c1377c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f05944d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058c09d130 0x7f058c137d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f05944d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f058c0a0090 0x7f058c138240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f05944d9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c12f5c0 con 0x7f058c09d130 2023-10-03T10:16:48.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f05944d9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c135f20 con 0x7f058c0a0090 2023-10-03T10:16:48.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f05944d9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f058c1303e0 con 0x7f058c09c650 2023-10-03T10:16:48.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f0592275700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058c09c650 0x7f058c1377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f0592275700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058c09c650 0x7f058c1377c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48474/0 (socket says 172.21.15.72:48474) 2023-10-03T10:16:48.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f0592275700 1 -- 172.21.15.72:0/42907299 learned_addr learned my addr 172.21.15.72:0/42907299 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:48.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f0591a74700 1 --2- 172.21.15.72:0/42907299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058c09d130 0x7f058c137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f0591a74700 1 -- 172.21.15.72:0/42907299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058c09c650 msgr2=0x7f058c1377c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f0591a74700 1 --2- 172.21.15.72:0/42907299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058c09c650 0x7f058c1377c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f0591a74700 1 -- 172.21.15.72:0/42907299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f058c0a0090 msgr2=0x7f058c138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f0591a74700 1 --2- 172.21.15.72:0/42907299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f058c0a0090 0x7f058c138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f0591a74700 1 -- 172.21.15.72:0/42907299 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0584009b30 con 0x7f058c09d130 2023-10-03T10:16:48.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f0591a74700 1 --2- 172.21.15.72:0/42907299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058c09d130 0x7f058c137d00 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f057c016000 tx=0x7f057c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f0582ffd700 1 -- 172.21.15.72:0/42907299 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c0036a0 con 0x7f058c09d130 2023-10-03T10:16:48.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f0582ffd700 1 -- 172.21.15.72:0/42907299 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c01f070 con 0x7f058c09d130 2023-10-03T10:16:48.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f0582ffd700 1 -- 172.21.15.72:0/42907299 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c003a00 con 0x7f058c09d130 2023-10-03T10:16:48.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f05944d9700 1 -- 172.21.15.72:0/42907299 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057c0094a0 con 0x7f058c09d130 2023-10-03T10:16:48.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.948+0000 7f05944d9700 1 -- 172.21.15.72:0/42907299 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c136900 con 0x7f058c09d130 2023-10-03T10:16:48.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.949+0000 7f0582ffd700 1 -- 172.21.15.72:0/42907299 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f057c003b60 con 0x7f058c09d130 2023-10-03T10:16:48.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.950+0000 7f0582ffd700 1 -- 172.21.15.72:0/42907299 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f057c021070 con 0x7f058c09d130 2023-10-03T10:16:48.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.950+0000 7f05944d9700 1 -- 172.21.15.72:0/42907299 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c0747f0 con 0x7f058c09d130 2023-10-03T10:16:48.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.954+0000 7f0582ffd700 1 -- 172.21.15.72:0/42907299 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f057c02b020 con 0x7f058c09d130 2023-10-03T10:16:48.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.986+0000 7f6b8d82e700 1 Processor -- start 2023-10-03T10:16:48.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.986+0000 7f6b8d82e700 1 -- start start 2023-10-03T10:16:48.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.986+0000 7f6b8d82e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b880a0a30 0x7f6b880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.986+0000 7f6b8d82e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6b88134170 0x7f6b8813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.986+0000 7f6b8d82e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8809edd0 con 0x7f6b880a1340 2023-10-03T10:16:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.986+0000 7f6b8d82e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8809e1f0 con 0x7f6b88134170 2023-10-03T10:16:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.986+0000 7f6b8d82e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8809dc50 con 0x7f6b880a0a30 2023-10-03T10:16:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.987+0000 7f6b867fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6b880a1340 0x7f6b88133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34526/0 (socket says 172.21.15.72:34526) 2023-10-03T10:16:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.987+0000 7f6b867fc700 1 -- 172.21.15.72:0/1628109821 learned_addr learned my addr 172.21.15.72:0/1628109821 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.987+0000 7f6b877fe700 1 --2- 172.21.15.72:0/1628109821 >> v2:172.21.15.72:3300/0 conn(0x7f6b88134170 0x7f6b8813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.987+0000 7f6b86ffd700 1 --2- 172.21.15.72:0/1628109821 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b880a0a30 0x7f6b880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.987+0000 7f6b85ffb700 1 -- 172.21.15.72:0/1628109821 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256800824 0 0) 0x7f6b8809edd0 con 0x7f6b880a1340 2023-10-03T10:16:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.987+0000 7f6b85ffb700 1 -- 172.21.15.72:0/1628109821 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b700035b0 con 0x7f6b880a1340 2023-10-03T10:16:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.987+0000 7f6b877fe700 1 -- 172.21.15.72:0/1628109821 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b880a0a30 msgr2=0x7f6b880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.987+0000 7f6b877fe700 1 --2- 172.21.15.72:0/1628109821 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b880a0a30 0x7f6b880a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.987+0000 7f6b877fe700 1 -- 172.21.15.72:0/1628109821 >> v1:172.21.15.72:6789/0 conn(0x7f6b880a1340 legacy=0x7f6b88133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.987+0000 7f6b877fe700 1 -- 172.21.15.72:0/1628109821 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b880a1fe0 con 0x7f6b88134170 2023-10-03T10:16:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.987+0000 7f6b86ffd700 1 --2- 172.21.15.72:0/1628109821 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b880a0a30 0x7f6b880a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.987+0000 7f6b877fe700 1 --2- 172.21.15.72:0/1628109821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b88134170 0x7f6b8813bd30 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f6b80009d90 tx=0x7f6b8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f719186bc4c422d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.987+0000 7f6b85ffb700 1 -- 172.21.15.72:0/1628109821 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8000e070 con 0x7f6b88134170 2023-10-03T10:16:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.987+0000 7f6b85ffb700 1 -- 172.21.15.72:0/1628109821 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8000bae0 con 0x7f6b88134170 2023-10-03T10:16:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.987+0000 7f6b85ffb700 1 -- 172.21.15.72:0/1628109821 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8000be90 con 0x7f6b88134170 2023-10-03T10:16:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.988+0000 7f6b8d82e700 1 -- 172.21.15.72:0/1628109821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b88134170 msgr2=0x7f6b8813bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.988+0000 7f6b8d82e700 1 --2- 172.21.15.72:0/1628109821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b88134170 0x7f6b8813bd30 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f6b80009d90 tx=0x7f6b8000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.988+0000 7f6b8d82e700 1 -- 172.21.15.72:0/1628109821 shutdown_connections 2023-10-03T10:16:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.988+0000 7f6b8d82e700 1 --2- 172.21.15.72:0/1628109821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b88134170 0x7f6b8813bd30 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.988+0000 7f6b8d82e700 1 --2- 172.21.15.72:0/1628109821 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b880a0a30 0x7f6b880a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.988+0000 7f6b8d82e700 1 -- 172.21.15.72:0/1628109821 >> 172.21.15.72:0/1628109821 conn(0x7f6b880a6550 msgr2=0x7f6b880a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.988+0000 7f6b8d82e700 1 -- 172.21.15.72:0/1628109821 shutdown_connections 2023-10-03T10:16:48.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.988+0000 7f6b8d82e700 1 -- 172.21.15.72:0/1628109821 wait complete. 2023-10-03T10:16:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.989+0000 7f6b8d82e700 1 Processor -- start 2023-10-03T10:16:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.989+0000 7f6b8d82e700 1 -- start start 2023-10-03T10:16:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.989+0000 7f6b8d82e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b880a0a30 0x7f6b881227d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.989+0000 7f6b8d82e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b880a1340 0x7f6b88122d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.989+0000 7f6b8d82e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b88134170 0x7f6b88123250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.989+0000 7f6b8d82e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b88125f30 con 0x7f6b880a1340 2023-10-03T10:16:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.989+0000 7f6b8d82e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880a4e40 con 0x7f6b880a0a30 2023-10-03T10:16:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.989+0000 7f6b8d82e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880a0220 con 0x7f6b88134170 2023-10-03T10:16:48.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.989+0000 7f6b867fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b880a1340 0x7f6b88122d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.989+0000 7f6b867fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b880a1340 0x7f6b88122d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52422/0 (socket says 172.21.15.72:52422) 2023-10-03T10:16:48.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b867fc700 1 -- 172.21.15.72:0/3161647530 learned_addr learned my addr 172.21.15.72:0/3161647530 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:48.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b877fe700 1 --2- 172.21.15.72:0/3161647530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b88134170 0x7f6b88123250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b86ffd700 1 --2- 172.21.15.72:0/3161647530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b880a0a30 0x7f6b881227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b867fc700 1 -- 172.21.15.72:0/3161647530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b88134170 msgr2=0x7f6b88123250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b867fc700 1 --2- 172.21.15.72:0/3161647530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b88134170 0x7f6b88123250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b867fc700 1 -- 172.21.15.72:0/3161647530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b880a0a30 msgr2=0x7f6b881227d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b867fc700 1 --2- 172.21.15.72:0/3161647530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b880a0a30 0x7f6b881227d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b867fc700 1 -- 172.21.15.72:0/3161647530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b780094a0 con 0x7f6b880a1340 2023-10-03T10:16:48.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b877fe700 1 --2- 172.21.15.72:0/3161647530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b88134170 0x7f6b88123250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b86ffd700 1 --2- 172.21.15.72:0/3161647530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b880a0a30 0x7f6b881227d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:48.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b867fc700 1 --2- 172.21.15.72:0/3161647530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b880a1340 0x7f6b88122d10 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0011e0 tx=0x7f6b7c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b6ffff700 1 -- 172.21.15.72:0/3161647530 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c004c80 con 0x7f6b880a1340 2023-10-03T10:16:48.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b6ffff700 1 -- 172.21.15.72:0/3161647530 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c004e00 con 0x7f6b880a1340 2023-10-03T10:16:48.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b8d82e700 1 -- 172.21.15.72:0/3161647530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b80009a70 con 0x7f6b880a1340 2023-10-03T10:16:48.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b6ffff700 1 -- 172.21.15.72:0/3161647530 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c007310 con 0x7f6b880a1340 2023-10-03T10:16:48.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.990+0000 7f6b8d82e700 1 -- 172.21.15.72:0/3161647530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b881269a0 con 0x7f6b880a1340 2023-10-03T10:16:48.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.991+0000 7f6b6ffff700 1 -- 172.21.15.72:0/3161647530 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b7c007470 con 0x7f6b880a1340 2023-10-03T10:16:48.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.991+0000 7f6b6ffff700 1 -- 172.21.15.72:0/3161647530 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6b7c03f2c0 con 0x7f6b880a1340 2023-10-03T10:16:48.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.991+0000 7f6b8d82e700 1 -- 172.21.15.72:0/3161647530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b880a1d40 con 0x7f6b880a1340 2023-10-03T10:16:48.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:48.996+0000 7f6b6ffff700 1 -- 172.21.15.72:0/3161647530 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b7c0123b0 con 0x7f6b880a1340 2023-10-03T10:16:49.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.090+0000 7fb0ee6cf700 1 -- 172.21.15.72:0/3925037294 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb0e806ba90 con 0x7fb0e809de50 2023-10-03T10:16:49.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.090+0000 7fb0e4ff9700 1 -- 172.21.15.72:0/3925037294 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0d8024b00 con 0x7fb0e809de50 2023-10-03T10:16:49.092 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:49.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.092+0000 7fb0ee6cf700 1 -- 172.21.15.72:0/3925037294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e809de50 msgr2=0x7fb0e811f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.092+0000 7fb0ee6cf700 1 --2- 172.21.15.72:0/3925037294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e809de50 0x7fb0e811f9a0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800e9b0 tx=0x7fb0d800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.092+0000 7fb0ee6cf700 1 -- 172.21.15.72:0/3925037294 shutdown_connections 2023-10-03T10:16:49.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.092+0000 7fb0ee6cf700 1 --2- 172.21.15.72:0/3925037294 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0e809de50 0x7fb0e811f9a0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.092+0000 7fb0ee6cf700 1 --2- 172.21.15.72:0/3925037294 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0e8133960 0x7fb0e8120420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.092+0000 7fb0ee6cf700 1 --2- 172.21.15.72:0/3925037294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0e809e990 0x7fb0e811fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.092+0000 7fb0ee6cf700 1 -- 172.21.15.72:0/3925037294 >> 172.21.15.72:0/3925037294 conn(0x7fb0e80a2610 msgr2=0x7fb0e80a0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.092+0000 7fb0ee6cf700 1 -- 172.21.15.72:0/3925037294 shutdown_connections 2023-10-03T10:16:49.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.092+0000 7fb0ee6cf700 1 -- 172.21.15.72:0/3925037294 wait complete. 2023-10-03T10:16:49.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:49.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.179+0000 7f05944d9700 1 -- 172.21.15.72:0/42907299 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f058c072840 con 0x7f058c09d130 2023-10-03T10:16:49.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.179+0000 7f0582ffd700 1 -- 172.21.15.72:0/42907299 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f057c015070 con 0x7f058c09d130 2023-10-03T10:16:49.180 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:49.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.181+0000 7f05944d9700 1 -- 172.21.15.72:0/42907299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058c09d130 msgr2=0x7f058c137d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.181+0000 7f05944d9700 1 --2- 172.21.15.72:0/42907299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058c09d130 0x7f058c137d00 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f057c016000 tx=0x7f057c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:49.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.181+0000 7f05944d9700 1 -- 172.21.15.72:0/42907299 shutdown_connections 2023-10-03T10:16:49.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.181+0000 7f05944d9700 1 --2- 172.21.15.72:0/42907299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f058c0a0090 0x7f058c138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.181+0000 7f05944d9700 1 --2- 172.21.15.72:0/42907299 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f058c09c650 0x7f058c1377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.181+0000 7f05944d9700 1 --2- 172.21.15.72:0/42907299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058c09d130 0x7f058c137d00 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.181+0000 7f05944d9700 1 -- 172.21.15.72:0/42907299 >> 172.21.15.72:0/42907299 conn(0x7f058c0a3f70 msgr2=0x7f058c09eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.181+0000 7f05944d9700 1 -- 172.21.15.72:0/42907299 shutdown_connections 2023-10-03T10:16:49.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.181+0000 7f05944d9700 1 -- 172.21.15.72:0/42907299 wait complete. 2023-10-03T10:16:49.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.190+0000 7f6b8d82e700 1 -- 172.21.15.72:0/3161647530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6b88074ea0 con 0x7f6b880a1340 2023-10-03T10:16:49.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.190+0000 7f6b6ffff700 1 -- 172.21.15.72:0/3161647530 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6b7c01b340 con 0x7f6b880a1340 2023-10-03T10:16:49.191 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:49.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.192+0000 7f6b8d82e700 1 -- 172.21.15.72:0/3161647530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b880a1340 msgr2=0x7f6b88122d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.192+0000 7f6b8d82e700 1 --2- 172.21.15.72:0/3161647530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b880a1340 0x7f6b88122d10 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0011e0 tx=0x7f6b7c00ca30 comp rx=0 tx=0).stop 2023-10-03T10:16:49.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.192+0000 7f6b8d82e700 1 -- 172.21.15.72:0/3161647530 shutdown_connections 2023-10-03T10:16:49.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.192+0000 7f6b8d82e700 1 --2- 172.21.15.72:0/3161647530 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b88134170 0x7f6b88123250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.192+0000 7f6b8d82e700 1 --2- 172.21.15.72:0/3161647530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b880a0a30 0x7f6b881227d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.192+0000 7f6b8d82e700 1 --2- 172.21.15.72:0/3161647530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b880a1340 0x7f6b88122d10 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.192+0000 7f6b8d82e700 1 -- 172.21.15.72:0/3161647530 >> 172.21.15.72:0/3161647530 conn(0x7f6b880a6550 msgr2=0x7f6b8809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.193+0000 7f6b8d82e700 1 -- 172.21.15.72:0/3161647530 shutdown_connections 2023-10-03T10:16:49.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.193+0000 7f6b8d82e700 1 -- 172.21.15.72:0/3161647530 wait complete. 2023-10-03T10:16:49.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:49.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:49.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:49.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.517+0000 7f2931cb8700 1 Processor -- start 2023-10-03T10:16:49.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.517+0000 7f2931cb8700 1 -- start start 2023-10-03T10:16:49.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f2931cb8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f292c09d6f0 0x7f292c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f2931cb8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f292c09e410 0x7f292c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f2931cb8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f292c09b120 con 0x7f292c09e000 2023-10-03T10:16:49.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f2931cb8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292c06b460 con 0x7f292c09e410 2023-10-03T10:16:49.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f2931cb8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292c09a7e0 con 0x7f292c09d6f0 2023-10-03T10:16:49.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f292bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f292c09e410 0x7f292c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f292b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f292c09d6f0 0x7f292c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f292bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f292c09e410 0x7f292c134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52428/0 (socket says 172.21.15.72:52428) 2023-10-03T10:16:49.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f292b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f292c09d6f0 0x7f292c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:60956/0 (socket says 172.21.15.72:60956) 2023-10-03T10:16:49.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f292bfff700 1 -- 172.21.15.72:0/1223688934 learned_addr learned my addr 172.21.15.72:0/1223688934 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:49.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f292bfff700 1 -- 172.21.15.72:0/1223688934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f292c09d6f0 msgr2=0x7f292c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f292bfff700 1 --2- 172.21.15.72:0/1223688934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f292c09d6f0 0x7f292c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f292bfff700 1 -- 172.21.15.72:0/1223688934 >> v1:172.21.15.72:6789/0 conn(0x7f292c09e000 legacy=0x7f292c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f292bfff700 1 -- 172.21.15.72:0/1223688934 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c09a500 con 0x7f292c09e410 2023-10-03T10:16:49.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f292b7fe700 1 --2- 172.21.15.72:0/1223688934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f292c09d6f0 0x7f292c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f292bfff700 1 --2- 172.21.15.72:0/1223688934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f292c09e410 0x7f292c134100 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f2924009e50 tx=0x7f292400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f20d82a8e50cce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f292a7fc700 1 -- 172.21.15.72:0/1223688934 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292400e070 con 0x7f292c09e410 2023-10-03T10:16:49.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f292a7fc700 1 -- 172.21.15.72:0/1223688934 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292400b910 con 0x7f292c09e410 2023-10-03T10:16:49.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.518+0000 7f292a7fc700 1 -- 172.21.15.72:0/1223688934 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292400bcc0 con 0x7f292c09e410 2023-10-03T10:16:49.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.519+0000 7f2931cb8700 1 -- 172.21.15.72:0/1223688934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f292c09e410 msgr2=0x7f292c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.519+0000 7f2931cb8700 1 --2- 172.21.15.72:0/1223688934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f292c09e410 0x7f292c134100 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f2924009e50 tx=0x7f292400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:49.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.519+0000 7f2931cb8700 1 -- 172.21.15.72:0/1223688934 shutdown_connections 2023-10-03T10:16:49.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.519+0000 7f2931cb8700 1 --2- 172.21.15.72:0/1223688934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f292c09e410 0x7f292c134100 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.519+0000 7f2931cb8700 1 --2- 172.21.15.72:0/1223688934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f292c09d6f0 0x7f292c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.519+0000 7f2931cb8700 1 -- 172.21.15.72:0/1223688934 >> 172.21.15.72:0/1223688934 conn(0x7f292c066f50 msgr2=0x7f292c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.519+0000 7f2931cb8700 1 -- 172.21.15.72:0/1223688934 shutdown_connections 2023-10-03T10:16:49.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.519+0000 7f2931cb8700 1 -- 172.21.15.72:0/1223688934 wait complete. 2023-10-03T10:16:49.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.520+0000 7f2931cb8700 1 Processor -- start 2023-10-03T10:16:49.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.520+0000 7f2931cb8700 1 -- start start 2023-10-03T10:16:49.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f2931cb8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f292c09d6f0 0x7f292c1a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f2931cb8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f292c09e000 0x7f292c1a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f2931cb8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f292c09e410 0x7f292c1a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f2931cb8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c1a9870 con 0x7f292c09e410 2023-10-03T10:16:49.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f2931cb8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292c1a7b90 con 0x7f292c09e000 2023-10-03T10:16:49.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f2931cb8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f292c1a9a70 con 0x7f292c09d6f0 2023-10-03T10:16:49.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f292b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f292c09d6f0 0x7f292c1a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f292affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f292c09e000 0x7f292c1a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f292bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f292c09e410 0x7f292c1a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f292b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f292c09d6f0 0x7f292c1a60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48500/0 (socket says 172.21.15.72:48500) 2023-10-03T10:16:49.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f292affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f292c09e000 0x7f292c1a65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:60968/0 (socket says 172.21.15.72:60968) 2023-10-03T10:16:49.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f292b7fe700 1 -- 172.21.15.72:0/1568427803 learned_addr learned my addr 172.21.15.72:0/1568427803 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:49.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f292b7fe700 1 -- 172.21.15.72:0/1568427803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f292c09e000 msgr2=0x7f292c1a65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f292b7fe700 1 --2- 172.21.15.72:0/1568427803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f292c09e000 0x7f292c1a65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f292b7fe700 1 -- 172.21.15.72:0/1568427803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f292c09e410 msgr2=0x7f292c1a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f292b7fe700 1 --2- 172.21.15.72:0/1568427803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f292c09e410 0x7f292c1a6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f292b7fe700 1 -- 172.21.15.72:0/1568427803 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29200094a0 con 0x7f292c09d6f0 2023-10-03T10:16:49.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f292affd700 1 --2- 172.21.15.72:0/1568427803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f292c09e000 0x7f292c1a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.521+0000 7f292bfff700 1 --2- 172.21.15.72:0/1568427803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f292c09e410 0x7f292c1a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.522+0000 7f292b7fe700 1 --2- 172.21.15.72:0/1568427803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f292c09d6f0 0x7f292c1a60a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f292000ec10 tx=0x7f292000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.522+0000 7f2913fff700 1 -- 172.21.15.72:0/1568427803 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292000c850 con 0x7f292c09d6f0 2023-10-03T10:16:49.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.522+0000 7f2913fff700 1 -- 172.21.15.72:0/1568427803 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292000c9b0 con 0x7f292c09d6f0 2023-10-03T10:16:49.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.522+0000 7f2931cb8700 1 -- 172.21.15.72:0/1568427803 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2924009b30 con 0x7f292c09d6f0 2023-10-03T10:16:49.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.522+0000 7f2913fff700 1 -- 172.21.15.72:0/1568427803 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292000cd20 con 0x7f292c09d6f0 2023-10-03T10:16:49.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.522+0000 7f2931cb8700 1 -- 172.21.15.72:0/1568427803 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292c1a88f0 con 0x7f292c09d6f0 2023-10-03T10:16:49.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.522+0000 7f2913fff700 1 -- 172.21.15.72:0/1568427803 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2920013470 con 0x7f292c09d6f0 2023-10-03T10:16:49.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.523+0000 7f2913fff700 1 -- 172.21.15.72:0/1568427803 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f292003f7f0 con 0x7f292c09d6f0 2023-10-03T10:16:49.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.523+0000 7f2931cb8700 1 -- 172.21.15.72:0/1568427803 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292c074ea0 con 0x7f292c09d6f0 2023-10-03T10:16:49.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.527+0000 7f2913fff700 1 -- 172.21.15.72:0/1568427803 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2920013720 con 0x7f292c09d6f0 2023-10-03T10:16:49.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.715+0000 7f2931cb8700 1 -- 172.21.15.72:0/1568427803 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f292c1aa3a0 con 0x7f292c09d6f0 2023-10-03T10:16:49.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.715+0000 7f2913fff700 1 -- 172.21.15.72:0/1568427803 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f292001bb60 con 0x7f292c09d6f0 2023-10-03T10:16:49.716 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:49.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.717+0000 7f2931cb8700 1 -- 172.21.15.72:0/1568427803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f292c09d6f0 msgr2=0x7f292c1a60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.717+0000 7f2931cb8700 1 --2- 172.21.15.72:0/1568427803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f292c09d6f0 0x7f292c1a60a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f292000ec10 tx=0x7f292000ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:49.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.717+0000 7f2931cb8700 1 -- 172.21.15.72:0/1568427803 shutdown_connections 2023-10-03T10:16:49.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.717+0000 7f2931cb8700 1 --2- 172.21.15.72:0/1568427803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f292c09e410 0x7f292c1a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.717+0000 7f2931cb8700 1 --2- 172.21.15.72:0/1568427803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f292c09d6f0 0x7f292c1a60a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.717+0000 7f2931cb8700 1 --2- 172.21.15.72:0/1568427803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f292c09e000 0x7f292c1a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.717+0000 7f2931cb8700 1 -- 172.21.15.72:0/1568427803 >> 172.21.15.72:0/1568427803 conn(0x7f292c066f50 msgr2=0x7f292c1baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.717+0000 7f2931cb8700 1 -- 172.21.15.72:0/1568427803 shutdown_connections 2023-10-03T10:16:49.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:49.717+0000 7f2931cb8700 1 -- 172.21.15.72:0/1568427803 wait complete. 2023-10-03T10:16:49.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:50.106 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:50.196 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:50.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:50.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.230+0000 7f60770b0700 1 Processor -- start 2023-10-03T10:16:50.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f60770b0700 1 -- start start 2023-10-03T10:16:50.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f60770b0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f607012c2f0 0x7f6070130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f60770b0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f607012cff0 0x7f6070137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f60770b0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607009a510 con 0x7f607012cc20 2023-10-03T10:16:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f60770b0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607012c7d0 con 0x7f607012cff0 2023-10-03T10:16:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f60770b0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607009c190 con 0x7f607012c2f0 2023-10-03T10:16:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f606ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f607012c2f0 0x7f6070130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f607564d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f607012cff0 0x7f6070137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f606ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f607012c2f0 0x7f6070130040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:60972/0 (socket says 172.21.15.72:60972) 2023-10-03T10:16:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f607564d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f607012cff0 0x7f6070137cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52434/0 (socket says 172.21.15.72:52434) 2023-10-03T10:16:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f606ffff700 1 -- 172.21.15.72:0/1784783052 learned_addr learned my addr 172.21.15.72:0/1784783052 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:50.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f606ffff700 1 -- 172.21.15.72:0/1784783052 >> v2:172.21.15.72:3300/0 conn(0x7f607012cff0 msgr2=0x7f6070137cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f606ffff700 1 --2- 172.21.15.72:0/1784783052 >> v2:172.21.15.72:3300/0 conn(0x7f607012cff0 0x7f6070137cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f606ffff700 1 -- 172.21.15.72:0/1784783052 >> v1:172.21.15.72:6789/0 conn(0x7f607012cc20 legacy=0x7f607012f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f606ffff700 1 -- 172.21.15.72:0/1784783052 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607009b540 con 0x7f607012c2f0 2023-10-03T10:16:50.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.231+0000 7f607564d700 1 --2- 172.21.15.72:0/1784783052 >> v2:172.21.15.72:3300/0 conn(0x7f607012cff0 0x7f6070137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.232+0000 7f606ffff700 1 --2- 172.21.15.72:0/1784783052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f607012c2f0 0x7f6070130040 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f605c0098f0 tx=0x7f605c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f731c4f6ec312418 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.232+0000 7f606f7fe700 1 -- 172.21.15.72:0/1784783052 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c011830 con 0x7f607012c2f0 2023-10-03T10:16:50.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.232+0000 7f606f7fe700 1 -- 172.21.15.72:0/1784783052 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c011990 con 0x7f607012c2f0 2023-10-03T10:16:50.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.232+0000 7f606f7fe700 1 -- 172.21.15.72:0/1784783052 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c011d20 con 0x7f607012c2f0 2023-10-03T10:16:50.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.232+0000 7f60770b0700 1 -- 172.21.15.72:0/1784783052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f607012c2f0 msgr2=0x7f6070130040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.232+0000 7f60770b0700 1 --2- 172.21.15.72:0/1784783052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f607012c2f0 0x7f6070130040 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f605c0098f0 tx=0x7f605c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:50.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.233+0000 7f60770b0700 1 -- 172.21.15.72:0/1784783052 shutdown_connections 2023-10-03T10:16:50.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.233+0000 7f60770b0700 1 --2- 172.21.15.72:0/1784783052 >> v2:172.21.15.72:3300/0 conn(0x7f607012cff0 0x7f6070137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.233+0000 7f60770b0700 1 --2- 172.21.15.72:0/1784783052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f607012c2f0 0x7f6070130040 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.233+0000 7f60770b0700 1 -- 172.21.15.72:0/1784783052 >> 172.21.15.72:0/1784783052 conn(0x7f607009f470 msgr2=0x7f60700a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.233+0000 7f60770b0700 1 -- 172.21.15.72:0/1784783052 shutdown_connections 2023-10-03T10:16:50.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.233+0000 7f60770b0700 1 -- 172.21.15.72:0/1784783052 wait complete. 2023-10-03T10:16:50.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.234+0000 7f60770b0700 1 Processor -- start 2023-10-03T10:16:50.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.234+0000 7f60770b0700 1 -- start start 2023-10-03T10:16:50.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.234+0000 7f60770b0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f607012c2f0 0x7f60701c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.234+0000 7f60770b0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f607012cc20 0x7f60701c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.234+0000 7f60770b0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f607012cff0 0x7f60701c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.234+0000 7f60770b0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607006e680 con 0x7f607012cc20 2023-10-03T10:16:50.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.234+0000 7f60770b0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607006d810 con 0x7f607012cff0 2023-10-03T10:16:50.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.234+0000 7f60770b0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f607012ec80 con 0x7f607012c2f0 2023-10-03T10:16:50.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f6074e4c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f607012c2f0 0x7f60701c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f6074e4c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f607012c2f0 0x7f60701c5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48504/0 (socket says 172.21.15.72:48504) 2023-10-03T10:16:50.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f6074e4c700 1 -- 172.21.15.72:0/3218308161 learned_addr learned my addr 172.21.15.72:0/3218308161 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:50.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f607564d700 1 --2- 172.21.15.72:0/3218308161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f607012cff0 0x7f60701c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f606ffff700 1 --2- 172.21.15.72:0/3218308161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f607012cc20 0x7f60701c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f607564d700 1 -- 172.21.15.72:0/3218308161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f607012c2f0 msgr2=0x7f60701c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f607564d700 1 --2- 172.21.15.72:0/3218308161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f607012c2f0 0x7f60701c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f607564d700 1 -- 172.21.15.72:0/3218308161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f607012cc20 msgr2=0x7f60701c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f607564d700 1 --2- 172.21.15.72:0/3218308161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f607012cc20 0x7f60701c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f607564d700 1 -- 172.21.15.72:0/3218308161 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6068009a70 con 0x7f607012cff0 2023-10-03T10:16:50.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f607564d700 1 --2- 172.21.15.72:0/3218308161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f607012cff0 0x7f60701c5b10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f606800bf60 tx=0x7f606800bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f606d7fa700 1 -- 172.21.15.72:0/3218308161 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606800e070 con 0x7f607012cff0 2023-10-03T10:16:50.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f606d7fa700 1 -- 172.21.15.72:0/3218308161 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6068003a20 con 0x7f607012cff0 2023-10-03T10:16:50.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f606d7fa700 1 -- 172.21.15.72:0/3218308161 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068003db0 con 0x7f607012cff0 2023-10-03T10:16:50.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f60770b0700 1 -- 172.21.15.72:0/3218308161 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605c009550 con 0x7f607012cff0 2023-10-03T10:16:50.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.235+0000 7f60770b0700 1 -- 172.21.15.72:0/3218308161 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607006dc50 con 0x7f607012cff0 2023-10-03T10:16:50.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.236+0000 7f606d7fa700 1 -- 172.21.15.72:0/3218308161 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6068012930 con 0x7f607012cff0 2023-10-03T10:16:50.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.236+0000 7f606d7fa700 1 -- 172.21.15.72:0/3218308161 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f606803f8c0 con 0x7f607012cff0 2023-10-03T10:16:50.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.237+0000 7f60770b0700 1 -- 172.21.15.72:0/3218308161 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607006eee0 con 0x7f607012cff0 2023-10-03T10:16:50.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.241+0000 7f606d7fa700 1 -- 172.21.15.72:0/3218308161 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f606801f080 con 0x7f607012cff0 2023-10-03T10:16:50.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.323+0000 7f80fdbe1700 1 Processor -- start 2023-10-03T10:16:50.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.323+0000 7f80fdbe1700 1 -- start start 2023-10-03T10:16:50.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.323+0000 7f80fdbe1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f80f809e930 0x7f80f809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.323+0000 7f80fdbe1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80f809f240 0x7f80f81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.323+0000 7f80fdbe1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f8070940 con 0x7f80f809f650 2023-10-03T10:16:50.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.323+0000 7f80fdbe1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f806fd60 con 0x7f80f809e930 2023-10-03T10:16:50.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.323+0000 7f80fdbe1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80f806fa80 con 0x7f80f809f240 2023-10-03T10:16:50.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.323+0000 7f80f77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f80f809e930 0x7f80f809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.323+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80f809f240 0x7f80f81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.324+0000 7f80f77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f80f809e930 0x7f80f809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52454/0 (socket says 172.21.15.72:52454) 2023-10-03T10:16:50.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.324+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80f809f240 0x7f80f81317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48510/0 (socket says 172.21.15.72:48510) 2023-10-03T10:16:50.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.324+0000 7f80f77fe700 1 -- 172.21.15.72:0/560698460 learned_addr learned my addr 172.21.15.72:0/560698460 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:50.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.324+0000 7f80f77fe700 1 -- 172.21.15.72:0/560698460 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80f809f240 msgr2=0x7f80f81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.324+0000 7f80f77fe700 1 --2- 172.21.15.72:0/560698460 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80f809f240 0x7f80f81317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.324+0000 7f80f77fe700 1 -- 172.21.15.72:0/560698460 >> v1:172.21.15.72:6789/0 conn(0x7f80f809f650 legacy=0x7f80f8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.324+0000 7f80f77fe700 1 -- 172.21.15.72:0/560698460 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f809fb60 con 0x7f80f809e930 2023-10-03T10:16:50.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.324+0000 7f80f77fe700 1 --2- 172.21.15.72:0/560698460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f809e930 0x7f80f809ed00 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f80e80098f0 tx=0x7f80e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdc23059b8ef68a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.324+0000 7f80f67fc700 1 -- 172.21.15.72:0/560698460 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8011830 con 0x7f80f809e930 2023-10-03T10:16:50.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.324+0000 7f80f67fc700 1 -- 172.21.15.72:0/560698460 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e8011990 con 0x7f80f809e930 2023-10-03T10:16:50.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.324+0000 7f80f67fc700 1 -- 172.21.15.72:0/560698460 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8011d20 con 0x7f80f809e930 2023-10-03T10:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.325+0000 7f80fdbe1700 1 -- 172.21.15.72:0/560698460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f809e930 msgr2=0x7f80f809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.325+0000 7f80fdbe1700 1 --2- 172.21.15.72:0/560698460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f809e930 0x7f80f809ed00 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f80e80098f0 tx=0x7f80e8009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.325+0000 7f80fdbe1700 1 -- 172.21.15.72:0/560698460 shutdown_connections 2023-10-03T10:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.325+0000 7f80fdbe1700 1 --2- 172.21.15.72:0/560698460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f809e930 0x7f80f809ed00 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.325+0000 7f80fdbe1700 1 --2- 172.21.15.72:0/560698460 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80f809f240 0x7f80f81317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.325+0000 7f80fdbe1700 1 -- 172.21.15.72:0/560698460 >> 172.21.15.72:0/560698460 conn(0x7f80f80a4210 msgr2=0x7f80f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.325+0000 7f80fdbe1700 1 -- 172.21.15.72:0/560698460 shutdown_connections 2023-10-03T10:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.325+0000 7f80fdbe1700 1 -- 172.21.15.72:0/560698460 wait complete. 2023-10-03T10:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.326+0000 7f80fdbe1700 1 Processor -- start 2023-10-03T10:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.326+0000 7f80fdbe1700 1 -- start start 2023-10-03T10:16:50.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.326+0000 7f80fdbe1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f809e930 0x7f80f81a3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.326+0000 7f80fdbe1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80f809f240 0x7f80f81a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.326+0000 7f80fdbe1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80f809f650 0x7f80f81a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.326+0000 7f80fdbe1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f81a7010 con 0x7f80f809e930 2023-10-03T10:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.326+0000 7f80fdbe1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f81a5930 con 0x7f80f809f240 2023-10-03T10:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.326+0000 7f80fdbe1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80f81a74c0 con 0x7f80f809f650 2023-10-03T10:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.326+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80f809f240 0x7f80f81a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.327+0000 7f80f6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80f809f240 0x7f80f81a4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:60992/0 (socket says 172.21.15.72:60992) 2023-10-03T10:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.327+0000 7f80f6ffd700 1 -- 172.21.15.72:0/1550721682 learned_addr learned my addr 172.21.15.72:0/1550721682 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.327+0000 7f80f7fff700 1 --2- 172.21.15.72:0/1550721682 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80f809f650 0x7f80f81a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.327+0000 7f80f77fe700 1 --2- 172.21.15.72:0/1550721682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f809e930 0x7f80f81a3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.327+0000 7f80f6ffd700 1 -- 172.21.15.72:0/1550721682 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80f809f650 msgr2=0x7f80f81a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.327+0000 7f80f6ffd700 1 --2- 172.21.15.72:0/1550721682 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80f809f650 0x7f80f81a47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.327+0000 7f80f6ffd700 1 -- 172.21.15.72:0/1550721682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f809e930 msgr2=0x7f80f81a3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.327+0000 7f80f6ffd700 1 --2- 172.21.15.72:0/1550721682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f809e930 0x7f80f81a3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.327+0000 7f80f6ffd700 1 -- 172.21.15.72:0/1550721682 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e8009550 con 0x7f80f809f240 2023-10-03T10:16:50.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.327+0000 7f80f6ffd700 1 --2- 172.21.15.72:0/1550721682 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80f809f240 0x7f80f81a4260 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00e9e0 tx=0x7f80ec00ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.327+0000 7f80dffff700 1 -- 172.21.15.72:0/1550721682 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec009710 con 0x7f80f809f240 2023-10-03T10:16:50.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.327+0000 7f80dffff700 1 -- 172.21.15.72:0/1550721682 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec00ee80 con 0x7f80f809f240 2023-10-03T10:16:50.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.327+0000 7f80fdbe1700 1 -- 172.21.15.72:0/1550721682 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f80a0190 con 0x7f80f809f240 2023-10-03T10:16:50.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.327+0000 7f80dffff700 1 -- 172.21.15.72:0/1550721682 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec00ca50 con 0x7f80f809f240 2023-10-03T10:16:50.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.327+0000 7f80fdbe1700 1 -- 172.21.15.72:0/1550721682 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f81a6ae0 con 0x7f80f809f240 2023-10-03T10:16:50.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.328+0000 7f80dffff700 1 -- 172.21.15.72:0/1550721682 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80ec00cbb0 con 0x7f80f809f240 2023-10-03T10:16:50.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.328+0000 7f80dffff700 1 -- 172.21.15.72:0/1550721682 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f80ec03faa0 con 0x7f80f809f240 2023-10-03T10:16:50.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.328+0000 7f80fdbe1700 1 -- 172.21.15.72:0/1550721682 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f81a0b30 con 0x7f80f809f240 2023-10-03T10:16:50.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.333+0000 7f80dffff700 1 -- 172.21.15.72:0/1550721682 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80ec01b3b0 con 0x7f80f809f240 2023-10-03T10:16:50.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.358+0000 7f589bdde700 1 Processor -- start 2023-10-03T10:16:50.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.358+0000 7f589bdde700 1 -- start start 2023-10-03T10:16:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.358+0000 7f589bdde700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f589409c650 0x7f589409ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.358+0000 7f589bdde700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58940a0090 0x7f589409cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.358+0000 7f589bdde700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5894131970 0x7f5894131df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.358+0000 7f589bdde700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589409ba70 con 0x7f589409c650 2023-10-03T10:16:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f589bdde700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589409d4a0 con 0x7f5894131970 2023-10-03T10:16:50.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f589bdde700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f589409e8f0 con 0x7f58940a0090 2023-10-03T10:16:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f5899b7a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f589409c650 0x7f589409ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f5899379700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58940a0090 0x7f589409cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f589a37b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5894131970 0x7f5894131df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f5899b7a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f589409c650 0x7f589409ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52476/0 (socket says 172.21.15.72:52476) 2023-10-03T10:16:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f5899379700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58940a0090 0x7f589409cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48542/0 (socket says 172.21.15.72:48542) 2023-10-03T10:16:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f5899b7a700 1 -- 172.21.15.72:0/4125790411 learned_addr learned my addr 172.21.15.72:0/4125790411 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f5899379700 1 -- 172.21.15.72:0/4125790411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5894131970 msgr2=0x7f5894131df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f5899379700 1 --2- 172.21.15.72:0/4125790411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5894131970 0x7f5894131df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f5899379700 1 -- 172.21.15.72:0/4125790411 >> v2:172.21.15.72:3300/0 conn(0x7f589409c650 msgr2=0x7f589409ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f5899379700 1 --2- 172.21.15.72:0/4125790411 >> v2:172.21.15.72:3300/0 conn(0x7f589409c650 0x7f589409ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f5899379700 1 -- 172.21.15.72:0/4125790411 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58940a0760 con 0x7f58940a0090 2023-10-03T10:16:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f5899b7a700 1 --2- 172.21.15.72:0/4125790411 >> v2:172.21.15.72:3300/0 conn(0x7f589409c650 0x7f589409ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f5899379700 1 --2- 172.21.15.72:0/4125790411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58940a0090 0x7f589409cf60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5884009840 tx=0x7f5884009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e39ac951ffd78e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f5898b78700 1 -- 172.21.15.72:0/4125790411 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884011830 con 0x7f58940a0090 2023-10-03T10:16:50.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f5898b78700 1 -- 172.21.15.72:0/4125790411 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5884011990 con 0x7f58940a0090 2023-10-03T10:16:50.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.359+0000 7f5898b78700 1 -- 172.21.15.72:0/4125790411 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884011d20 con 0x7f58940a0090 2023-10-03T10:16:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.360+0000 7f589bdde700 1 -- 172.21.15.72:0/4125790411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58940a0090 msgr2=0x7f589409cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.360+0000 7f589bdde700 1 --2- 172.21.15.72:0/4125790411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58940a0090 0x7f589409cf60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5884009840 tx=0x7f5884009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.360+0000 7f589bdde700 1 -- 172.21.15.72:0/4125790411 shutdown_connections 2023-10-03T10:16:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.360+0000 7f589bdde700 1 --2- 172.21.15.72:0/4125790411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5894131970 0x7f5894131df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.360+0000 7f589bdde700 1 --2- 172.21.15.72:0/4125790411 >> v2:172.21.15.72:3300/0 conn(0x7f589409c650 0x7f589409ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.360+0000 7f589bdde700 1 --2- 172.21.15.72:0/4125790411 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58940a0090 0x7f589409cf60 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.360+0000 7f589bdde700 1 -- 172.21.15.72:0/4125790411 >> 172.21.15.72:0/4125790411 conn(0x7f58940a3f70 msgr2=0x7f58940a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.360+0000 7f589bdde700 1 -- 172.21.15.72:0/4125790411 shutdown_connections 2023-10-03T10:16:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.360+0000 7f589bdde700 1 -- 172.21.15.72:0/4125790411 wait complete. 2023-10-03T10:16:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.361+0000 7f589bdde700 1 Processor -- start 2023-10-03T10:16:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.361+0000 7f589bdde700 1 -- start start 2023-10-03T10:16:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f589bdde700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f589409c650 0x7f589411a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f589bdde700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58940a0090 0x7f589411ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f589bdde700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5894131970 0x7f589411b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f589bdde700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589411e440 con 0x7f5894131970 2023-10-03T10:16:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f589bdde700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589411bc80 con 0x7f589409c650 2023-10-03T10:16:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f589bdde700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f589411d7a0 con 0x7f58940a0090 2023-10-03T10:16:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f5899379700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58940a0090 0x7f589411ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f5899379700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58940a0090 0x7f589411ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48544/0 (socket says 172.21.15.72:48544) 2023-10-03T10:16:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f5899379700 1 -- 172.21.15.72:0/1649248091 learned_addr learned my addr 172.21.15.72:0/1649248091 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f5899b7a700 1 --2- 172.21.15.72:0/1649248091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f589409c650 0x7f589411a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f589a37b700 1 --2- 172.21.15.72:0/1649248091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5894131970 0x7f589411b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f5899379700 1 -- 172.21.15.72:0/1649248091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f589409c650 msgr2=0x7f589411a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f5899379700 1 --2- 172.21.15.72:0/1649248091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f589409c650 0x7f589411a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f5899379700 1 -- 172.21.15.72:0/1649248091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5894131970 msgr2=0x7f589411b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f5899379700 1 --2- 172.21.15.72:0/1649248091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5894131970 0x7f589411b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f5899379700 1 -- 172.21.15.72:0/1649248091 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890009550 con 0x7f58940a0090 2023-10-03T10:16:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f5899379700 1 --2- 172.21.15.72:0/1649248091 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58940a0090 0x7f589411ab60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f589409ea30 tx=0x7f5884004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f588a7fc700 1 -- 172.21.15.72:0/1649248091 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884004450 con 0x7f58940a0090 2023-10-03T10:16:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.362+0000 7f588a7fc700 1 -- 172.21.15.72:0/1649248091 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588401f070 con 0x7f58940a0090 2023-10-03T10:16:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.363+0000 7f589bdde700 1 -- 172.21.15.72:0/1649248091 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58840094a0 con 0x7f58940a0090 2023-10-03T10:16:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.363+0000 7f588a7fc700 1 -- 172.21.15.72:0/1649248091 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58840038e0 con 0x7f58940a0090 2023-10-03T10:16:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.363+0000 7f589bdde700 1 -- 172.21.15.72:0/1649248091 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589409d980 con 0x7f58940a0090 2023-10-03T10:16:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.363+0000 7f589bdde700 1 -- 172.21.15.72:0/1649248091 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589411d440 con 0x7f58940a0090 2023-10-03T10:16:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.364+0000 7f588a7fc700 1 -- 172.21.15.72:0/1649248091 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5884003a40 con 0x7f58940a0090 2023-10-03T10:16:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.364+0000 7f588a7fc700 1 -- 172.21.15.72:0/1649248091 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5884021070 con 0x7f58940a0090 2023-10-03T10:16:50.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.368+0000 7f588a7fc700 1 -- 172.21.15.72:0/1649248091 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5884010380 con 0x7f58940a0090 2023-10-03T10:16:50.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.440+0000 7f60770b0700 1 -- 172.21.15.72:0/3218308161 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f60700747f0 con 0x7f607012cff0 2023-10-03T10:16:50.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.441+0000 7f606d7fa700 1 -- 172.21.15.72:0/3218308161 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6068003f10 con 0x7f607012cff0 2023-10-03T10:16:50.442 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:50.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.443+0000 7f60770b0700 1 -- 172.21.15.72:0/3218308161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f607012cff0 msgr2=0x7f60701c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.443+0000 7f60770b0700 1 --2- 172.21.15.72:0/3218308161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f607012cff0 0x7f60701c5b10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f606800bf60 tx=0x7f606800bf90 comp rx=0 tx=0).stop 2023-10-03T10:16:50.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.443+0000 7f60770b0700 1 -- 172.21.15.72:0/3218308161 shutdown_connections 2023-10-03T10:16:50.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.443+0000 7f60770b0700 1 --2- 172.21.15.72:0/3218308161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f607012cff0 0x7f60701c5b10 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.443+0000 7f60770b0700 1 --2- 172.21.15.72:0/3218308161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f607012c2f0 0x7f60701c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.443+0000 7f60770b0700 1 --2- 172.21.15.72:0/3218308161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f607012cc20 0x7f60701c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.443+0000 7f60770b0700 1 -- 172.21.15.72:0/3218308161 >> 172.21.15.72:0/3218308161 conn(0x7f607009f470 msgr2=0x7f607012b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.443+0000 7f60770b0700 1 -- 172.21.15.72:0/3218308161 shutdown_connections 2023-10-03T10:16:50.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.443+0000 7f60770b0700 1 -- 172.21.15.72:0/3218308161 wait complete. 2023-10-03T10:16:50.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:50.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.531+0000 7f80fdbe1700 1 -- 172.21.15.72:0/1550721682 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f80f8074ea0 con 0x7f80f809f240 2023-10-03T10:16:50.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.531+0000 7f80dffff700 1 -- 172.21.15.72:0/1550721682 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f80ec02a090 con 0x7f80f809f240 2023-10-03T10:16:50.532 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:50.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.533+0000 7f80fdbe1700 1 -- 172.21.15.72:0/1550721682 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80f809f240 msgr2=0x7f80f81a4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.533+0000 7f80fdbe1700 1 --2- 172.21.15.72:0/1550721682 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80f809f240 0x7f80f81a4260 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00e9e0 tx=0x7f80ec00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.534+0000 7f80fdbe1700 1 -- 172.21.15.72:0/1550721682 shutdown_connections 2023-10-03T10:16:50.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.534+0000 7f80fdbe1700 1 --2- 172.21.15.72:0/1550721682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80f809e930 0x7f80f81a3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.534+0000 7f80fdbe1700 1 --2- 172.21.15.72:0/1550721682 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80f809f650 0x7f80f81a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.534+0000 7f80fdbe1700 1 --2- 172.21.15.72:0/1550721682 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80f809f240 0x7f80f81a4260 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.534+0000 7f80fdbe1700 1 -- 172.21.15.72:0/1550721682 >> 172.21.15.72:0/1550721682 conn(0x7f80f80a4210 msgr2=0x7f80f81b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.534+0000 7f80fdbe1700 1 -- 172.21.15.72:0/1550721682 shutdown_connections 2023-10-03T10:16:50.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.534+0000 7f80fdbe1700 1 -- 172.21.15.72:0/1550721682 wait complete. 2023-10-03T10:16:50.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:50.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.564+0000 7f589bdde700 1 -- 172.21.15.72:0/1649248091 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f589411d440 con 0x7f58940a0090 2023-10-03T10:16:50.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.564+0000 7f588a7fc700 1 -- 172.21.15.72:0/1649248091 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f589411d440 con 0x7f58940a0090 2023-10-03T10:16:50.565 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:50.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.567+0000 7f589bdde700 1 -- 172.21.15.72:0/1649248091 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58940a0090 msgr2=0x7f589411ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.567+0000 7f589bdde700 1 --2- 172.21.15.72:0/1649248091 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58940a0090 0x7f589411ab60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f589409ea30 tx=0x7f5884004750 comp rx=0 tx=0).stop 2023-10-03T10:16:50.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.567+0000 7f589bdde700 1 -- 172.21.15.72:0/1649248091 shutdown_connections 2023-10-03T10:16:50.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.567+0000 7f589bdde700 1 --2- 172.21.15.72:0/1649248091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5894131970 0x7f589411b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.567+0000 7f589bdde700 1 --2- 172.21.15.72:0/1649248091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f589409c650 0x7f589411a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.567+0000 7f589bdde700 1 --2- 172.21.15.72:0/1649248091 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f58940a0090 0x7f589411ab60 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.567+0000 7f589bdde700 1 -- 172.21.15.72:0/1649248091 >> 172.21.15.72:0/1649248091 conn(0x7f58940a3f70 msgr2=0x7f589412efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.567+0000 7f589bdde700 1 -- 172.21.15.72:0/1649248091 shutdown_connections 2023-10-03T10:16:50.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.567+0000 7f589bdde700 1 -- 172.21.15.72:0/1649248091 wait complete. 2023-10-03T10:16:50.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:50.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:50.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.851+0000 7f5e132ff700 1 Processor -- start 2023-10-03T10:16:50.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.851+0000 7f5e132ff700 1 -- start start 2023-10-03T10:16:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e132ff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e0c131630 0x7f5e0c131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e132ff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e0c131f40 0x7f5e0c06e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e132ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c071a00 con 0x7f5e0c06e9d0 2023-10-03T10:16:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e132ff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c131430 con 0x7f5e0c131630 2023-10-03T10:16:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e132ff700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c09a510 con 0x7f5e0c131f40 2023-10-03T10:16:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e1109b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e0c131630 0x7f5e0c131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e1189c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5e0c06e9d0 0x7f5e0c138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34560/0 (socket says 172.21.15.72:34560) 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e1189c700 1 -- 172.21.15.72:0/163431326 learned_addr learned my addr 172.21.15.72:0/163431326 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e1089a700 1 --2- 172.21.15.72:0/163431326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e0c131f40 0x7f5e0c06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e1109b700 1 -- 172.21.15.72:0/163431326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e0c131f40 msgr2=0x7f5e0c06e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e1109b700 1 --2- 172.21.15.72:0/163431326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e0c131f40 0x7f5e0c06e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e1109b700 1 -- 172.21.15.72:0/163431326 >> v1:172.21.15.72:6789/0 conn(0x7f5e0c06e9d0 legacy=0x7f5e0c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e03fff700 1 -- 172.21.15.72:0/163431326 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219265511 0 0) 0x7f5e0c071a00 con 0x7f5e0c06e9d0 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e1109b700 1 -- 172.21.15.72:0/163431326 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c0721c0 con 0x7f5e0c131630 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e1089a700 1 --2- 172.21.15.72:0/163431326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e0c131f40 0x7f5e0c06e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.852+0000 7f5e1109b700 1 --2- 172.21.15.72:0/163431326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e0c131630 0x7f5e0c131a00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009870 tx=0x7f5dfc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5da3d7066865e207 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.853+0000 7f5e03fff700 1 -- 172.21.15.72:0/163431326 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc011830 con 0x7f5e0c131630 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.853+0000 7f5e03fff700 1 -- 172.21.15.72:0/163431326 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc011990 con 0x7f5e0c131630 2023-10-03T10:16:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.853+0000 7f5e03fff700 1 -- 172.21.15.72:0/163431326 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc011d20 con 0x7f5e0c131630 2023-10-03T10:16:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.853+0000 7f5e132ff700 1 -- 172.21.15.72:0/163431326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e0c131630 msgr2=0x7f5e0c131a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.853+0000 7f5e132ff700 1 --2- 172.21.15.72:0/163431326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e0c131630 0x7f5e0c131a00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009870 tx=0x7f5dfc009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.853+0000 7f5e132ff700 1 -- 172.21.15.72:0/163431326 shutdown_connections 2023-10-03T10:16:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.853+0000 7f5e132ff700 1 --2- 172.21.15.72:0/163431326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e0c131630 0x7f5e0c131a00 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.853+0000 7f5e132ff700 1 --2- 172.21.15.72:0/163431326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e0c131f40 0x7f5e0c06e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.853+0000 7f5e132ff700 1 -- 172.21.15.72:0/163431326 >> 172.21.15.72:0/163431326 conn(0x7f5e0c0a2aa0 msgr2=0x7f5e0c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.853+0000 7f5e132ff700 1 -- 172.21.15.72:0/163431326 shutdown_connections 2023-10-03T10:16:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.853+0000 7f5e132ff700 1 -- 172.21.15.72:0/163431326 wait complete. 2023-10-03T10:16:50.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.854+0000 7f5e132ff700 1 Processor -- start 2023-10-03T10:16:50.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.854+0000 7f5e132ff700 1 -- start start 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.854+0000 7f5e132ff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e0c06e9d0 0x7f5e0c06f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e132ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e0c131630 0x7f5e0c06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e132ff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e0c131f40 0x7f5e0c0700e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e132ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c11eef0 con 0x7f5e0c131630 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e132ff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c071220 con 0x7f5e0c131f40 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e132ff700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c11f0f0 con 0x7f5e0c06e9d0 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e1109b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e0c06e9d0 0x7f5e0c06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e1089a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e0c131630 0x7f5e0c06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e1109b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e0c06e9d0 0x7f5e0c06f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48568/0 (socket says 172.21.15.72:48568) 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e1109b700 1 -- 172.21.15.72:0/2015507071 learned_addr learned my addr 172.21.15.72:0/2015507071 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e1189c700 1 --2- 172.21.15.72:0/2015507071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e0c131f40 0x7f5e0c0700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e1109b700 1 -- 172.21.15.72:0/2015507071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e0c131f40 msgr2=0x7f5e0c0700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e1109b700 1 --2- 172.21.15.72:0/2015507071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e0c131f40 0x7f5e0c0700e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e1109b700 1 -- 172.21.15.72:0/2015507071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e0c131630 msgr2=0x7f5e0c06fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e1109b700 1 --2- 172.21.15.72:0/2015507071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e0c131630 0x7f5e0c06fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e1109b700 1 -- 172.21.15.72:0/2015507071 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e080094a0 con 0x7f5e0c06e9d0 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e1189c700 1 --2- 172.21.15.72:0/2015507071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e0c131f40 0x7f5e0c0700e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e1089a700 1 --2- 172.21.15.72:0/2015507071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e0c131630 0x7f5e0c06fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e1109b700 1 --2- 172.21.15.72:0/2015507071 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e0c06e9d0 0x7f5e0c06f660 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0090b0 tx=0x7f5dfc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e01ffb700 1 -- 172.21.15.72:0/2015507071 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc004510 con 0x7f5e0c06e9d0 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e01ffb700 1 -- 172.21.15.72:0/2015507071 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc01f070 con 0x7f5e0c06e9d0 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e132ff700 1 -- 172.21.15.72:0/2015507071 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dfc0094a0 con 0x7f5e0c06e9d0 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e01ffb700 1 -- 172.21.15.72:0/2015507071 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc0038e0 con 0x7f5e0c06e9d0 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.855+0000 7f5e132ff700 1 -- 172.21.15.72:0/2015507071 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c099f20 con 0x7f5e0c06e9d0 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.856+0000 7f5e01ffb700 1 -- 172.21.15.72:0/2015507071 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5dfc003a40 con 0x7f5e0c06e9d0 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.856+0000 7f5e01ffb700 1 -- 172.21.15.72:0/2015507071 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5dfc021070 con 0x7f5e0c06e9d0 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.856+0000 7f5e132ff700 1 -- 172.21.15.72:0/2015507071 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0c074ea0 con 0x7f5e0c06e9d0 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:50.861+0000 7f5e01ffb700 1 -- 172.21.15.72:0/2015507071 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5dfc01a430 con 0x7f5e0c06e9d0 2023-10-03T10:16:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.045+0000 7f5e132ff700 1 -- 172.21.15.72:0/2015507071 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5e0c11e4c0 con 0x7f5e0c06e9d0 2023-10-03T10:16:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.045+0000 7f5e01ffb700 1 -- 172.21.15.72:0/2015507071 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5dfc015020 con 0x7f5e0c06e9d0 2023-10-03T10:16:51.046 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.047+0000 7f5e132ff700 1 -- 172.21.15.72:0/2015507071 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e0c06e9d0 msgr2=0x7f5e0c06f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.047+0000 7f5e132ff700 1 --2- 172.21.15.72:0/2015507071 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e0c06e9d0 0x7f5e0c06f660 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0090b0 tx=0x7f5dfc004750 comp rx=0 tx=0).stop 2023-10-03T10:16:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.047+0000 7f5e132ff700 1 -- 172.21.15.72:0/2015507071 shutdown_connections 2023-10-03T10:16:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.047+0000 7f5e132ff700 1 --2- 172.21.15.72:0/2015507071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e0c131f40 0x7f5e0c0700e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.047+0000 7f5e132ff700 1 --2- 172.21.15.72:0/2015507071 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e0c06e9d0 0x7f5e0c06f660 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.047+0000 7f5e132ff700 1 --2- 172.21.15.72:0/2015507071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e0c131630 0x7f5e0c06fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.047+0000 7f5e132ff700 1 -- 172.21.15.72:0/2015507071 >> 172.21.15.72:0/2015507071 conn(0x7f5e0c0a2aa0 msgr2=0x7f5e0c12e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.047+0000 7f5e132ff700 1 -- 172.21.15.72:0/2015507071 shutdown_connections 2023-10-03T10:16:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.047+0000 7f5e132ff700 1 -- 172.21.15.72:0/2015507071 wait complete. 2023-10-03T10:16:51.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:51.457 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:51.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:51.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:51.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.583+0000 7f27f0925700 1 Processor -- start 2023-10-03T10:16:51.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.583+0000 7f27f0925700 1 -- start start 2023-10-03T10:16:51.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.584+0000 7f27f0925700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27ec09d6f0 0x7f27ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.584+0000 7f27f0925700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27ec09e000 0x7f27ec1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.584+0000 7f27f0925700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27ec09e410 0x7f27ec133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.584+0000 7f27f0925700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27ec06b460 con 0x7f27ec09e000 2023-10-03T10:16:51.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.584+0000 7f27f0925700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec09b120 con 0x7f27ec09e410 2023-10-03T10:16:51.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.584+0000 7f27f0925700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec09a7e0 con 0x7f27ec09d6f0 2023-10-03T10:16:51.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.584+0000 7f27ea59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27ec09d6f0 0x7f27ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.584+0000 7f27ead9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27ec09e410 0x7f27ec133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.584+0000 7f27ea59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27ec09d6f0 0x7f27ec09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48572/0 (socket says 172.21.15.72:48572) 2023-10-03T10:16:51.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.584+0000 7f27ea59c700 1 -- 172.21.15.72:0/2011079392 learned_addr learned my addr 172.21.15.72:0/2011079392 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:51.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.584+0000 7f27e9d9b700 1 --2- 172.21.15.72:0/2011079392 >> v2:172.21.15.72:3300/0 conn(0x7f27ec09e000 0x7f27ec1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.584+0000 7f27ead9d700 1 -- 172.21.15.72:0/2011079392 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27ec09d6f0 msgr2=0x7f27ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.584+0000 7f27ead9d700 1 --2- 172.21.15.72:0/2011079392 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27ec09d6f0 0x7f27ec09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.584+0000 7f27ead9d700 1 -- 172.21.15.72:0/2011079392 >> v2:172.21.15.72:3300/0 conn(0x7f27ec09e000 msgr2=0x7f27ec1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.584+0000 7f27ead9d700 1 --2- 172.21.15.72:0/2011079392 >> v2:172.21.15.72:3300/0 conn(0x7f27ec09e000 0x7f27ec1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.585+0000 7f27ead9d700 1 -- 172.21.15.72:0/2011079392 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec09a500 con 0x7f27ec09e410 2023-10-03T10:16:51.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.585+0000 7f27ea59c700 1 --2- 172.21.15.72:0/2011079392 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27ec09d6f0 0x7f27ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.585+0000 7f27ead9d700 1 --2- 172.21.15.72:0/2011079392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27ec09e410 0x7f27ec133f30 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009dc0 tx=0x7f27e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eca622c66bd565c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.585+0000 7f27e959a700 1 -- 172.21.15.72:0/2011079392 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e400e070 con 0x7f27ec09e410 2023-10-03T10:16:51.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.585+0000 7f27e959a700 1 -- 172.21.15.72:0/2011079392 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e400bae0 con 0x7f27ec09e410 2023-10-03T10:16:51.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.585+0000 7f27e959a700 1 -- 172.21.15.72:0/2011079392 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e400be90 con 0x7f27ec09e410 2023-10-03T10:16:51.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.585+0000 7f27f0925700 1 -- 172.21.15.72:0/2011079392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27ec09e410 msgr2=0x7f27ec133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.585+0000 7f27f0925700 1 --2- 172.21.15.72:0/2011079392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27ec09e410 0x7f27ec133f30 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009dc0 tx=0x7f27e400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:51.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.586+0000 7f27f0925700 1 -- 172.21.15.72:0/2011079392 shutdown_connections 2023-10-03T10:16:51.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.586+0000 7f27f0925700 1 --2- 172.21.15.72:0/2011079392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27ec09e410 0x7f27ec133f30 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.586+0000 7f27f0925700 1 --2- 172.21.15.72:0/2011079392 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27ec09d6f0 0x7f27ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.586+0000 7f27f0925700 1 --2- 172.21.15.72:0/2011079392 >> v2:172.21.15.72:3300/0 conn(0x7f27ec09e000 0x7f27ec1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.586+0000 7f27f0925700 1 -- 172.21.15.72:0/2011079392 >> 172.21.15.72:0/2011079392 conn(0x7f27ec066f50 msgr2=0x7f27ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.586+0000 7f27f0925700 1 -- 172.21.15.72:0/2011079392 shutdown_connections 2023-10-03T10:16:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.586+0000 7f27f0925700 1 -- 172.21.15.72:0/2011079392 wait complete. 2023-10-03T10:16:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.587+0000 7f27f0925700 1 Processor -- start 2023-10-03T10:16:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.587+0000 7f27f0925700 1 -- start start 2023-10-03T10:16:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.587+0000 7f27f0925700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27ec09d6f0 0x7f27ec1c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.587+0000 7f27f0925700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27ec09e000 0x7f27ec1c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.587+0000 7f27f0925700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27ec09e410 0x7f27ec1c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.587+0000 7f27f0925700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec1a6420 con 0x7f27ec09e410 2023-10-03T10:16:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.587+0000 7f27f0925700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec1a7c10 con 0x7f27ec09d6f0 2023-10-03T10:16:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.587+0000 7f27f0925700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec09c710 con 0x7f27ec09e000 2023-10-03T10:16:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.587+0000 7f27ea59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27ec09d6f0 0x7f27ec1c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27ea59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27ec09d6f0 0x7f27ec1c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:32804/0 (socket says 172.21.15.72:32804) 2023-10-03T10:16:51.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27e9d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27ec09e000 0x7f27ec1c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27ea59c700 1 -- 172.21.15.72:0/850185148 learned_addr learned my addr 172.21.15.72:0/850185148 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27ead9d700 1 --2- 172.21.15.72:0/850185148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27ec09e410 0x7f27ec1c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27ead9d700 1 -- 172.21.15.72:0/850185148 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27ec09e000 msgr2=0x7f27ec1c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27ead9d700 1 --2- 172.21.15.72:0/850185148 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27ec09e000 0x7f27ec1c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27ead9d700 1 -- 172.21.15.72:0/850185148 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27ec09d6f0 msgr2=0x7f27ec1c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27ead9d700 1 --2- 172.21.15.72:0/850185148 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27ec09d6f0 0x7f27ec1c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27ead9d700 1 -- 172.21.15.72:0/850185148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc009550 con 0x7f27ec09e410 2023-10-03T10:16:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27e9d9b700 1 --2- 172.21.15.72:0/850185148 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27ec09e000 0x7f27ec1c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27ea59c700 1 --2- 172.21.15.72:0/850185148 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27ec09d6f0 0x7f27ec1c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27ead9d700 1 --2- 172.21.15.72:0/850185148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27ec09e410 0x7f27ec1c8a30 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f27e4016000 tx=0x7f27e4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27daffd700 1 -- 172.21.15.72:0/850185148 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4004550 con 0x7f27ec09e410 2023-10-03T10:16:51.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27daffd700 1 -- 172.21.15.72:0/850185148 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e4020070 con 0x7f27ec09e410 2023-10-03T10:16:51.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27daffd700 1 -- 172.21.15.72:0/850185148 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4004950 con 0x7f27ec09e410 2023-10-03T10:16:51.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27f0925700 1 -- 172.21.15.72:0/850185148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e4009a70 con 0x7f27ec09e410 2023-10-03T10:16:51.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.588+0000 7f27f0925700 1 -- 172.21.15.72:0/850185148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec1a6f10 con 0x7f27ec09e410 2023-10-03T10:16:51.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.589+0000 7f27daffd700 1 -- 172.21.15.72:0/850185148 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f27e4027480 con 0x7f27ec09e410 2023-10-03T10:16:51.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.589+0000 7f27daffd700 1 -- 172.21.15.72:0/850185148 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f27e4022070 con 0x7f27ec09e410 2023-10-03T10:16:51.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.589+0000 7f27f0925700 1 -- 172.21.15.72:0/850185148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ec074ea0 con 0x7f27ec09e410 2023-10-03T10:16:51.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.598+0000 7f27daffd700 1 -- 172.21.15.72:0/850185148 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27e402c030 con 0x7f27ec09e410 2023-10-03T10:16:51.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.679+0000 7fed1277a700 1 Processor -- start 2023-10-03T10:16:51.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.679+0000 7fed1277a700 1 -- start start 2023-10-03T10:16:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.679+0000 7fed1277a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c131790 0x7fed0c131b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.679+0000 7fed1277a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fed0c1320a0 0x7fed0c09c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.679+0000 7fed1277a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0c09d550 con 0x7fed0c09c9f0 2023-10-03T10:16:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.679+0000 7fed1277a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c09ff00 con 0x7fed0c1320a0 2023-10-03T10:16:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.679+0000 7fed1277a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0a0530 con 0x7fed0c131790 2023-10-03T10:16:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.680+0000 7fed0bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c131790 0x7fed0c131b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.680+0000 7fed0bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c131790 0x7fed0c131b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:32808/0 (socket says 172.21.15.72:32808) 2023-10-03T10:16:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.680+0000 7fed0bfff700 1 -- 172.21.15.72:0/3271568584 learned_addr learned my addr 172.21.15.72:0/3271568584 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.680+0000 7fed0b7fe700 1 --2- 172.21.15.72:0/3271568584 >> v2:172.21.15.72:3300/0 conn(0x7fed0c1320a0 0x7fed0c09c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.680+0000 7fed0bfff700 1 -- 172.21.15.72:0/3271568584 >> v2:172.21.15.72:3300/0 conn(0x7fed0c1320a0 msgr2=0x7fed0c09c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.680+0000 7fed0bfff700 1 --2- 172.21.15.72:0/3271568584 >> v2:172.21.15.72:3300/0 conn(0x7fed0c1320a0 0x7fed0c09c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.680+0000 7fed0bfff700 1 -- 172.21.15.72:0/3271568584 >> v1:172.21.15.72:6789/0 conn(0x7fed0c09c9f0 legacy=0x7fed0c09ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.680+0000 7fed0bfff700 1 -- 172.21.15.72:0/3271568584 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c09f6d0 con 0x7fed0c131790 2023-10-03T10:16:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.680+0000 7fed0bfff700 1 --2- 172.21.15.72:0/3271568584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c131790 0x7fed0c131b60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0098f0 tx=0x7fecfc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52925f96453b004d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.680+0000 7fed0affd700 1 -- 172.21.15.72:0/3271568584 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc011830 con 0x7fed0c131790 2023-10-03T10:16:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.680+0000 7fed0affd700 1 -- 172.21.15.72:0/3271568584 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc011990 con 0x7fed0c131790 2023-10-03T10:16:51.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.680+0000 7fed0affd700 1 -- 172.21.15.72:0/3271568584 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc011d20 con 0x7fed0c131790 2023-10-03T10:16:51.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.681+0000 7fed1277a700 1 -- 172.21.15.72:0/3271568584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c131790 msgr2=0x7fed0c131b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.681+0000 7fed1277a700 1 --2- 172.21.15.72:0/3271568584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c131790 0x7fed0c131b60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0098f0 tx=0x7fecfc009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.681+0000 7fed1277a700 1 -- 172.21.15.72:0/3271568584 shutdown_connections 2023-10-03T10:16:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.681+0000 7fed1277a700 1 --2- 172.21.15.72:0/3271568584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c131790 0x7fed0c131b60 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.681+0000 7fed1277a700 1 --2- 172.21.15.72:0/3271568584 >> v2:172.21.15.72:3300/0 conn(0x7fed0c1320a0 0x7fed0c09c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.681+0000 7fed1277a700 1 -- 172.21.15.72:0/3271568584 >> 172.21.15.72:0/3271568584 conn(0x7fed0c0a0970 msgr2=0x7fed0c0a0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.681+0000 7fed1277a700 1 -- 172.21.15.72:0/3271568584 shutdown_connections 2023-10-03T10:16:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.681+0000 7fed1277a700 1 -- 172.21.15.72:0/3271568584 wait complete. 2023-10-03T10:16:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.682+0000 7fed1277a700 1 Processor -- start 2023-10-03T10:16:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.682+0000 7fed1277a700 1 -- start start 2023-10-03T10:16:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed1277a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c09c9f0 0x7fed0c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed1277a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c131790 0x7fed0c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed1277a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed0c1320a0 0x7fed0c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed1277a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c09a660 con 0x7fed0c1320a0 2023-10-03T10:16:51.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed1277a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c1219f0 con 0x7fed0c09c9f0 2023-10-03T10:16:51.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed1277a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c06d550 con 0x7fed0c131790 2023-10-03T10:16:51.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed10d17700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed0c1320a0 0x7fed0c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed0b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c131790 0x7fed0c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed0b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c131790 0x7fed0c06bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48588/0 (socket says 172.21.15.72:48588) 2023-10-03T10:16:51.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed10d17700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed0c1320a0 0x7fed0c06c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52528/0 (socket says 172.21.15.72:52528) 2023-10-03T10:16:51.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed0b7fe700 1 -- 172.21.15.72:0/2043601394 learned_addr learned my addr 172.21.15.72:0/2043601394 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:51.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed0bfff700 1 --2- 172.21.15.72:0/2043601394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c09c9f0 0x7fed0c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed0b7fe700 1 -- 172.21.15.72:0/2043601394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c09c9f0 msgr2=0x7fed0c06b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed0b7fe700 1 --2- 172.21.15.72:0/2043601394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c09c9f0 0x7fed0c06b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed0b7fe700 1 -- 172.21.15.72:0/2043601394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed0c1320a0 msgr2=0x7fed0c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed0b7fe700 1 --2- 172.21.15.72:0/2043601394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed0c1320a0 0x7fed0c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed0b7fe700 1 -- 172.21.15.72:0/2043601394 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc009550 con 0x7fed0c131790 2023-10-03T10:16:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed0b7fe700 1 --2- 172.21.15.72:0/2043601394 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c131790 0x7fed0c06bdc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fed0000e9b0 tx=0x7fed0000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed08ff9700 1 -- 172.21.15.72:0/2043601394 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed00009710 con 0x7fed0c131790 2023-10-03T10:16:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed08ff9700 1 -- 172.21.15.72:0/2043601394 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0000ee50 con 0x7fed0c131790 2023-10-03T10:16:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed1277a700 1 -- 172.21.15.72:0/2043601394 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0c09d800 con 0x7fed0c131790 2023-10-03T10:16:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.683+0000 7fed08ff9700 1 -- 172.21.15.72:0/2043601394 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0000ca50 con 0x7fed0c131790 2023-10-03T10:16:51.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.684+0000 7fed1277a700 1 -- 172.21.15.72:0/2043601394 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0c122720 con 0x7fed0c131790 2023-10-03T10:16:51.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.684+0000 7fed08ff9700 1 -- 172.21.15.72:0/2043601394 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed0000cbb0 con 0x7fed0c131790 2023-10-03T10:16:51.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.685+0000 7fed1277a700 1 -- 172.21.15.72:0/2043601394 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0c04f2a0 con 0x7fed0c131790 2023-10-03T10:16:51.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.685+0000 7fed08ff9700 1 -- 172.21.15.72:0/2043601394 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fed0003fa70 con 0x7fed0c131790 2023-10-03T10:16:51.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.694+0000 7fed08ff9700 1 -- 172.21.15.72:0/2043601394 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed00041e60 con 0x7fed0c131790 2023-10-03T10:16:51.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.718+0000 7fcf4b237700 1 Processor -- start 2023-10-03T10:16:51.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.718+0000 7fcf4b237700 1 -- start start 2023-10-03T10:16:51.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf4b237700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf4409d6f0 0x7fcf4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf4b237700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf4409e000 0x7fcf441339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf4b237700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4409b120 con 0x7fcf4409e410 2023-10-03T10:16:51.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf4b237700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4406b460 con 0x7fcf4409e000 2023-10-03T10:16:51.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf4b237700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4409a7e0 con 0x7fcf4409d6f0 2023-10-03T10:16:51.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf43fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf4409e000 0x7fcf441339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf43fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf4409e000 0x7fcf441339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52538/0 (socket says 172.21.15.72:52538) 2023-10-03T10:16:51.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf43fff700 1 -- 172.21.15.72:0/4263632519 learned_addr learned my addr 172.21.15.72:0/4263632519 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:51.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf48fd3700 1 --2- 172.21.15.72:0/4263632519 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf4409d6f0 0x7fcf4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf43fff700 1 -- 172.21.15.72:0/4263632519 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf4409d6f0 msgr2=0x7fcf4409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:51.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf43fff700 1 --2- 172.21.15.72:0/4263632519 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf4409d6f0 0x7fcf4409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf43fff700 1 -- 172.21.15.72:0/4263632519 >> v1:172.21.15.72:6789/0 conn(0x7fcf4409e410 legacy=0x7fcf44133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf43fff700 1 -- 172.21.15.72:0/4263632519 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4409a500 con 0x7fcf4409e000 2023-10-03T10:16:51.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf437fe700 1 -- 172.21.15.72:0/4263632519 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328404358 0 0) 0x7fcf4409b120 con 0x7fcf4409e410 2023-10-03T10:16:51.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf43fff700 1 --2- 172.21.15.72:0/4263632519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409e000 0x7fcf441339f0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fcf300098f0 tx=0x7fcf30009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de48513a427bdee8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf437fe700 1 -- 172.21.15.72:0/4263632519 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf30011830 con 0x7fcf4409e000 2023-10-03T10:16:51.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf437fe700 1 -- 172.21.15.72:0/4263632519 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf30011990 con 0x7fcf4409e000 2023-10-03T10:16:51.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.719+0000 7fcf437fe700 1 -- 172.21.15.72:0/4263632519 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf30011d20 con 0x7fcf4409e000 2023-10-03T10:16:51.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.720+0000 7fcf4b237700 1 -- 172.21.15.72:0/4263632519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409e000 msgr2=0x7fcf441339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.720+0000 7fcf4b237700 1 --2- 172.21.15.72:0/4263632519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409e000 0x7fcf441339f0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fcf300098f0 tx=0x7fcf30009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:51.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.720+0000 7fcf4b237700 1 -- 172.21.15.72:0/4263632519 shutdown_connections 2023-10-03T10:16:51.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.720+0000 7fcf4b237700 1 --2- 172.21.15.72:0/4263632519 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf4409d6f0 0x7fcf4409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.720+0000 7fcf4b237700 1 --2- 172.21.15.72:0/4263632519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409e000 0x7fcf441339f0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.720+0000 7fcf4b237700 1 -- 172.21.15.72:0/4263632519 >> 172.21.15.72:0/4263632519 conn(0x7fcf44066f50 msgr2=0x7fcf4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.720+0000 7fcf4b237700 1 -- 172.21.15.72:0/4263632519 shutdown_connections 2023-10-03T10:16:51.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.720+0000 7fcf4b237700 1 -- 172.21.15.72:0/4263632519 wait complete. 2023-10-03T10:16:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.721+0000 7fcf4b237700 1 Processor -- start 2023-10-03T10:16:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.721+0000 7fcf4b237700 1 -- start start 2023-10-03T10:16:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf4b237700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409d6f0 0x7fcf441c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf4b237700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf4409e000 0x7fcf441c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf4b237700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf4409e410 0x7fcf441c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf4b237700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf441a7fb0 con 0x7fcf4409d6f0 2023-10-03T10:16:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf4b237700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf441b9320 con 0x7fcf4409e410 2023-10-03T10:16:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf4b237700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf441a6500 con 0x7fcf4409e000 2023-10-03T10:16:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf497d4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf4409e410 0x7fcf441c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf43fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf4409e000 0x7fcf441c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf497d4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf4409e410 0x7fcf441c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:32828/0 (socket says 172.21.15.72:32828) 2023-10-03T10:16:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf497d4700 1 -- 172.21.15.72:0/4189695232 learned_addr learned my addr 172.21.15.72:0/4189695232 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf43fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf4409e000 0x7fcf441c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48608/0 (socket says 172.21.15.72:48608) 2023-10-03T10:16:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf48fd3700 1 --2- 172.21.15.72:0/4189695232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409d6f0 0x7fcf441c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf497d4700 1 -- 172.21.15.72:0/4189695232 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf4409e000 msgr2=0x7fcf441c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf497d4700 1 --2- 172.21.15.72:0/4189695232 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf4409e000 0x7fcf441c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf497d4700 1 -- 172.21.15.72:0/4189695232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409d6f0 msgr2=0x7fcf441c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf497d4700 1 --2- 172.21.15.72:0/4189695232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409d6f0 0x7fcf441c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf497d4700 1 -- 172.21.15.72:0/4189695232 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf30009550 con 0x7fcf4409e410 2023-10-03T10:16:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf43fff700 1 --2- 172.21.15.72:0/4189695232 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf4409e000 0x7fcf441c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf48fd3700 1 --2- 172.21.15.72:0/4189695232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409d6f0 0x7fcf441c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf497d4700 1 --2- 172.21.15.72:0/4189695232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf4409e410 0x7fcf441c8a50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00c870 tx=0x7fcf3c00cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf417fa700 1 -- 172.21.15.72:0/4189695232 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c003e30 con 0x7fcf4409e410 2023-10-03T10:16:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.722+0000 7fcf417fa700 1 -- 172.21.15.72:0/4189695232 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c005070 con 0x7fcf4409e410 2023-10-03T10:16:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.723+0000 7fcf4b237700 1 -- 172.21.15.72:0/4189695232 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4409c710 con 0x7fcf4409e410 2023-10-03T10:16:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.723+0000 7fcf417fa700 1 -- 172.21.15.72:0/4189695232 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c005420 con 0x7fcf4409e410 2023-10-03T10:16:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.723+0000 7fcf4b237700 1 -- 172.21.15.72:0/4189695232 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf441a8a20 con 0x7fcf4409e410 2023-10-03T10:16:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.723+0000 7fcf417fa700 1 -- 172.21.15.72:0/4189695232 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf3c005580 con 0x7fcf4409e410 2023-10-03T10:16:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.724+0000 7fcf417fa700 1 -- 172.21.15.72:0/4189695232 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcf3c03ecd0 con 0x7fcf4409e410 2023-10-03T10:16:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.724+0000 7fcf4b237700 1 -- 172.21.15.72:0/4189695232 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf441a8100 con 0x7fcf4409e410 2023-10-03T10:16:51.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.728+0000 7fcf417fa700 1 -- 172.21.15.72:0/4189695232 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf3c017020 con 0x7fcf4409e410 2023-10-03T10:16:51.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.801+0000 7f27f0925700 1 -- 172.21.15.72:0/850185148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f27ec06c360 con 0x7f27ec09e410 2023-10-03T10:16:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.801+0000 7f27daffd700 1 -- 172.21.15.72:0/850185148 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f27e4035090 con 0x7f27ec09e410 2023-10-03T10:16:51.802 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.803+0000 7f27f0925700 1 -- 172.21.15.72:0/850185148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27ec09e410 msgr2=0x7f27ec1c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.803+0000 7f27f0925700 1 --2- 172.21.15.72:0/850185148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27ec09e410 0x7f27ec1c8a30 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f27e4016000 tx=0x7f27e4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.803+0000 7f27f0925700 1 -- 172.21.15.72:0/850185148 shutdown_connections 2023-10-03T10:16:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.803+0000 7f27f0925700 1 --2- 172.21.15.72:0/850185148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27ec09e410 0x7f27ec1c8a30 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.803+0000 7f27f0925700 1 --2- 172.21.15.72:0/850185148 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27ec09d6f0 0x7f27ec1c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.803+0000 7f27f0925700 1 --2- 172.21.15.72:0/850185148 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f27ec09e000 0x7f27ec1c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.803+0000 7f27f0925700 1 -- 172.21.15.72:0/850185148 >> 172.21.15.72:0/850185148 conn(0x7f27ec066f50 msgr2=0x7f27ec1bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.803+0000 7f27f0925700 1 -- 172.21.15.72:0/850185148 shutdown_connections 2023-10-03T10:16:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.803+0000 7f27f0925700 1 -- 172.21.15.72:0/850185148 wait complete. 2023-10-03T10:16:51.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:51.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.910+0000 7fed1277a700 1 -- 172.21.15.72:0/2043601394 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fed0c09b550 con 0x7fed0c131790 2023-10-03T10:16:51.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.910+0000 7fed08ff9700 1 -- 172.21.15.72:0/2043601394 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fed0001b3b0 con 0x7fed0c131790 2023-10-03T10:16:51.911 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.912+0000 7fed1277a700 1 -- 172.21.15.72:0/2043601394 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c131790 msgr2=0x7fed0c06bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.912+0000 7fed1277a700 1 --2- 172.21.15.72:0/2043601394 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c131790 0x7fed0c06bdc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fed0000e9b0 tx=0x7fed0000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.912+0000 7fed1277a700 1 -- 172.21.15.72:0/2043601394 shutdown_connections 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.912+0000 7fed1277a700 1 --2- 172.21.15.72:0/2043601394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed0c1320a0 0x7fed0c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.912+0000 7fed1277a700 1 --2- 172.21.15.72:0/2043601394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c09c9f0 0x7fed0c06b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.912+0000 7fed1277a700 1 --2- 172.21.15.72:0/2043601394 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c131790 0x7fed0c06bdc0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.912+0000 7fed1277a700 1 -- 172.21.15.72:0/2043601394 >> 172.21.15.72:0/2043601394 conn(0x7fed0c0a0970 msgr2=0x7fed0c0705f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.912+0000 7fed1277a700 1 -- 172.21.15.72:0/2043601394 shutdown_connections 2023-10-03T10:16:51.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.912+0000 7fed1277a700 1 -- 172.21.15.72:0/2043601394 wait complete. 2023-10-03T10:16:51.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:51.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.935+0000 7fcf4b237700 1 -- 172.21.15.72:0/4189695232 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcf44074ea0 con 0x7fcf4409e410 2023-10-03T10:16:51.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.935+0000 7fcf417fa700 1 -- 172.21.15.72:0/4189695232 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcf3c017020 con 0x7fcf4409e410 2023-10-03T10:16:51.936 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:51.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.937+0000 7fcf4b237700 1 -- 172.21.15.72:0/4189695232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf4409e410 msgr2=0x7fcf441c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.937+0000 7fcf4b237700 1 --2- 172.21.15.72:0/4189695232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf4409e410 0x7fcf441c8a50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00c870 tx=0x7fcf3c00cb80 comp rx=0 tx=0).stop 2023-10-03T10:16:51.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.938+0000 7fcf4b237700 1 -- 172.21.15.72:0/4189695232 shutdown_connections 2023-10-03T10:16:51.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.938+0000 7fcf4b237700 1 --2- 172.21.15.72:0/4189695232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409d6f0 0x7fcf441c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.938+0000 7fcf4b237700 1 --2- 172.21.15.72:0/4189695232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf4409e410 0x7fcf441c8a50 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.938+0000 7fcf4b237700 1 --2- 172.21.15.72:0/4189695232 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf4409e000 0x7fcf441c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.938+0000 7fcf4b237700 1 -- 172.21.15.72:0/4189695232 >> 172.21.15.72:0/4189695232 conn(0x7fcf44066f50 msgr2=0x7fcf4406f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.938+0000 7fcf4b237700 1 -- 172.21.15.72:0/4189695232 shutdown_connections 2023-10-03T10:16:51.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:51.938+0000 7fcf4b237700 1 -- 172.21.15.72:0/4189695232 wait complete. 2023-10-03T10:16:51.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:52.061 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:52.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.182+0000 7f92255bb700 1 Processor -- start 2023-10-03T10:16:52.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.182+0000 7f92255bb700 1 -- start start 2023-10-03T10:16:52.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f92255bb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f922009e1d0 0x7f9220138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f92255bb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9220139170 0x7f922013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f92255bb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f922009b120 con 0x7f922009d6f0 2023-10-03T10:16:52.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f92255bb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922006b460 con 0x7f922009e1d0 2023-10-03T10:16:52.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f92255bb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f922009a7e0 con 0x7f9220139170 2023-10-03T10:16:52.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f921f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9220139170 0x7f922013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f921effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f922009d6f0 0x7f922009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34578/0 (socket says 172.21.15.72:34578) 2023-10-03T10:16:52.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f921effd700 1 -- 172.21.15.72:0/403624982 learned_addr learned my addr 172.21.15.72:0/403624982 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:52.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f921e7fc700 1 --2- 172.21.15.72:0/403624982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f922009e1d0 0x7f9220138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f921f7fe700 1 -- 172.21.15.72:0/403624982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f922009e1d0 msgr2=0x7f9220138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:52.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f921f7fe700 1 --2- 172.21.15.72:0/403624982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f922009e1d0 0x7f9220138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f921f7fe700 1 -- 172.21.15.72:0/403624982 >> v1:172.21.15.72:6789/0 conn(0x7f922009d6f0 legacy=0x7f922009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f921f7fe700 1 -- 172.21.15.72:0/403624982 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922009a500 con 0x7f9220139170 2023-10-03T10:16:52.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f921dffb700 1 -- 172.21.15.72:0/403624982 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394432658 0 0) 0x7f922009b120 con 0x7f922009d6f0 2023-10-03T10:16:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f921f7fe700 1 --2- 172.21.15.72:0/403624982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9220139170 0x7f922013b550 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9218009df0 tx=0x7f921800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d92c23035cb058c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f921dffb700 1 -- 172.21.15.72:0/403624982 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921800e070 con 0x7f9220139170 2023-10-03T10:16:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f921dffb700 1 -- 172.21.15.72:0/403624982 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921800bae0 con 0x7f9220139170 2023-10-03T10:16:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.183+0000 7f921dffb700 1 -- 172.21.15.72:0/403624982 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921800be90 con 0x7f9220139170 2023-10-03T10:16:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.184+0000 7f92255bb700 1 -- 172.21.15.72:0/403624982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9220139170 msgr2=0x7f922013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.184+0000 7f92255bb700 1 --2- 172.21.15.72:0/403624982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9220139170 0x7f922013b550 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9218009df0 tx=0x7f921800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.184+0000 7f92255bb700 1 -- 172.21.15.72:0/403624982 shutdown_connections 2023-10-03T10:16:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.184+0000 7f92255bb700 1 --2- 172.21.15.72:0/403624982 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9220139170 0x7f922013b550 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.184+0000 7f92255bb700 1 --2- 172.21.15.72:0/403624982 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f922009e1d0 0x7f9220138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.184+0000 7f92255bb700 1 -- 172.21.15.72:0/403624982 >> 172.21.15.72:0/403624982 conn(0x7f9220066f50 msgr2=0x7f922009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.184+0000 7f92255bb700 1 -- 172.21.15.72:0/403624982 shutdown_connections 2023-10-03T10:16:52.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.184+0000 7f92255bb700 1 -- 172.21.15.72:0/403624982 wait complete. 2023-10-03T10:16:52.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.185+0000 7f92255bb700 1 Processor -- start 2023-10-03T10:16:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.185+0000 7f92255bb700 1 -- start start 2023-10-03T10:16:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.185+0000 7f92255bb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f922009d6f0 0x7f92201215e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.185+0000 7f92255bb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f922009e1d0 0x7f9220121b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f92255bb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9220139170 0x7f9220122060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f92255bb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92200a3b40 con 0x7f922009e1d0 2023-10-03T10:16:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f92255bb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9220124e90 con 0x7f922009d6f0 2023-10-03T10:16:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f92255bb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9220125100 con 0x7f9220139170 2023-10-03T10:16:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f921effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f922009d6f0 0x7f92201215e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f921effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f922009d6f0 0x7f92201215e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:32846/0 (socket says 172.21.15.72:32846) 2023-10-03T10:16:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f921f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9220139170 0x7f9220122060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f921effd700 1 -- 172.21.15.72:0/3848393523 learned_addr learned my addr 172.21.15.72:0/3848393523 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f921e7fc700 1 --2- 172.21.15.72:0/3848393523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f922009e1d0 0x7f9220121b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f921f7fe700 1 -- 172.21.15.72:0/3848393523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f922009d6f0 msgr2=0x7f92201215e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f921f7fe700 1 --2- 172.21.15.72:0/3848393523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f922009d6f0 0x7f92201215e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f921f7fe700 1 -- 172.21.15.72:0/3848393523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f922009e1d0 msgr2=0x7f9220121b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f921f7fe700 1 --2- 172.21.15.72:0/3848393523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f922009e1d0 0x7f9220121b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f921f7fe700 1 -- 172.21.15.72:0/3848393523 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9218009a70 con 0x7f9220139170 2023-10-03T10:16:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f921f7fe700 1 --2- 172.21.15.72:0/3848393523 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9220139170 0x7f9220122060 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9218016000 tx=0x7f9218004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f92077fe700 1 -- 172.21.15.72:0/3848393523 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92180045d0 con 0x7f9220139170 2023-10-03T10:16:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f92077fe700 1 -- 172.21.15.72:0/3848393523 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9218020070 con 0x7f9220139170 2023-10-03T10:16:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f92077fe700 1 -- 172.21.15.72:0/3848393523 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218027480 con 0x7f9220139170 2023-10-03T10:16:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f92255bb700 1 -- 172.21.15.72:0/3848393523 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92201244b0 con 0x7f9220139170 2023-10-03T10:16:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.186+0000 7f92255bb700 1 -- 172.21.15.72:0/3848393523 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92201231f0 con 0x7f9220139170 2023-10-03T10:16:52.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.187+0000 7f92077fe700 1 -- 172.21.15.72:0/3848393523 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92180275e0 con 0x7f9220139170 2023-10-03T10:16:52.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.187+0000 7f92077fe700 1 -- 172.21.15.72:0/3848393523 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9218022070 con 0x7f9220139170 2023-10-03T10:16:52.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.187+0000 7f92255bb700 1 -- 172.21.15.72:0/3848393523 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9220074ea0 con 0x7f9220139170 2023-10-03T10:16:52.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.192+0000 7f92077fe700 1 -- 172.21.15.72:0/3848393523 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9218027890 con 0x7f9220139170 2023-10-03T10:16:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.377+0000 7f92255bb700 1 -- 172.21.15.72:0/3848393523 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f922006c360 con 0x7f9220139170 2023-10-03T10:16:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.377+0000 7f92077fe700 1 -- 172.21.15.72:0/3848393523 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f921801c400 con 0x7f9220139170 2023-10-03T10:16:52.378 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:52.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.379+0000 7f92255bb700 1 -- 172.21.15.72:0/3848393523 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9220139170 msgr2=0x7f9220122060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.379+0000 7f92255bb700 1 --2- 172.21.15.72:0/3848393523 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9220139170 0x7f9220122060 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9218016000 tx=0x7f9218004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.379+0000 7f92255bb700 1 -- 172.21.15.72:0/3848393523 shutdown_connections 2023-10-03T10:16:52.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.379+0000 7f92255bb700 1 --2- 172.21.15.72:0/3848393523 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9220139170 0x7f9220122060 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.379+0000 7f92255bb700 1 --2- 172.21.15.72:0/3848393523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f922009d6f0 0x7f92201215e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.379+0000 7f92255bb700 1 --2- 172.21.15.72:0/3848393523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f922009e1d0 0x7f9220121b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.379+0000 7f92255bb700 1 -- 172.21.15.72:0/3848393523 >> 172.21.15.72:0/3848393523 conn(0x7f9220066f50 msgr2=0x7f9220070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.379+0000 7f92255bb700 1 -- 172.21.15.72:0/3848393523 shutdown_connections 2023-10-03T10:16:52.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.379+0000 7f92255bb700 1 -- 172.21.15.72:0/3848393523 wait complete. 2023-10-03T10:16:52.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:52.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:52.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:52.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.940+0000 7f92cf5ba700 1 Processor -- start 2023-10-03T10:16:52.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.940+0000 7f92cf5ba700 1 -- start start 2023-10-03T10:16:52.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cf5ba700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92c806a770 0x7f92c806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cf5ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92c8131d10 0x7f92c8139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cf5ba700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c809ece0 con 0x7f92c806b080 2023-10-03T10:16:52.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cf5ba700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c809e760 con 0x7f92c806a770 2023-10-03T10:16:52.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cf5ba700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c809e040 con 0x7f92c8131d10 2023-10-03T10:16:52.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cd356700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92c806a770 0x7f92c806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cdb57700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92c8131d10 0x7f92c8139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cd356700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92c806a770 0x7f92c806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52564/0 (socket says 172.21.15.72:52564) 2023-10-03T10:16:52.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cdb57700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92c8131d10 0x7f92c8139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:32858/0 (socket says 172.21.15.72:32858) 2023-10-03T10:16:52.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cd356700 1 -- 172.21.15.72:0/2162220550 learned_addr learned my addr 172.21.15.72:0/2162220550 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:52.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cdb57700 1 -- 172.21.15.72:0/2162220550 >> v2:172.21.15.72:3300/0 conn(0x7f92c806a770 msgr2=0x7f92c806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:52.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cdb57700 1 --2- 172.21.15.72:0/2162220550 >> v2:172.21.15.72:3300/0 conn(0x7f92c806a770 0x7f92c806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cdb57700 1 -- 172.21.15.72:0/2162220550 >> v1:172.21.15.72:6789/0 conn(0x7f92c806b080 legacy=0x7f92c8131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cdb57700 1 -- 172.21.15.72:0/2162220550 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c809f630 con 0x7f92c8131d10 2023-10-03T10:16:52.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cd356700 1 --2- 172.21.15.72:0/2162220550 >> v2:172.21.15.72:3300/0 conn(0x7f92c806a770 0x7f92c806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92cdb57700 1 --2- 172.21.15.72:0/2162220550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92c8131d10 0x7f92c8139860 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f92c0009d90 tx=0x7f92c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=630433ce45bb115b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.941+0000 7f92bffff700 1 -- 172.21.15.72:0/2162220550 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c000e070 con 0x7f92c8131d10 2023-10-03T10:16:52.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.942+0000 7f92bffff700 1 -- 172.21.15.72:0/2162220550 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c000bb20 con 0x7f92c8131d10 2023-10-03T10:16:52.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.942+0000 7f92bffff700 1 -- 172.21.15.72:0/2162220550 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0012430 con 0x7f92c8131d10 2023-10-03T10:16:52.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.942+0000 7f92cf5ba700 1 -- 172.21.15.72:0/2162220550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92c8131d10 msgr2=0x7f92c8139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.942+0000 7f92cf5ba700 1 --2- 172.21.15.72:0/2162220550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92c8131d10 0x7f92c8139860 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f92c0009d90 tx=0x7f92c000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:52.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.942+0000 7f92cf5ba700 1 -- 172.21.15.72:0/2162220550 shutdown_connections 2023-10-03T10:16:52.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.942+0000 7f92cf5ba700 1 --2- 172.21.15.72:0/2162220550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92c8131d10 0x7f92c8139860 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.942+0000 7f92cf5ba700 1 --2- 172.21.15.72:0/2162220550 >> v2:172.21.15.72:3300/0 conn(0x7f92c806a770 0x7f92c806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.942+0000 7f92cf5ba700 1 -- 172.21.15.72:0/2162220550 >> 172.21.15.72:0/2162220550 conn(0x7f92c8066f50 msgr2=0x7f92c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.942+0000 7f92cf5ba700 1 -- 172.21.15.72:0/2162220550 shutdown_connections 2023-10-03T10:16:52.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.942+0000 7f92cf5ba700 1 -- 172.21.15.72:0/2162220550 wait complete. 2023-10-03T10:16:52.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.943+0000 7f92cf5ba700 1 Processor -- start 2023-10-03T10:16:52.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.943+0000 7f92cf5ba700 1 -- start start 2023-10-03T10:16:52.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.943+0000 7f92cf5ba700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92c806a770 0x7f92c81c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cf5ba700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f92c806b080 0x7f92c81c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cf5ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92c8131d10 0x7f92c81c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cf5ba700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c811e1c0 con 0x7f92c806a770 2023-10-03T10:16:52.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cf5ba700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c811e7e0 con 0x7f92c8131d10 2023-10-03T10:16:52.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cf5ba700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92c8071e60 con 0x7f92c806b080 2023-10-03T10:16:52.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cdb57700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92c8131d10 0x7f92c81c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cd356700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92c806a770 0x7f92c81c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cd356700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92c806a770 0x7f92c81c6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52572/0 (socket says 172.21.15.72:52572) 2023-10-03T10:16:52.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cdb57700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92c8131d10 0x7f92c81c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:32864/0 (socket says 172.21.15.72:32864) 2023-10-03T10:16:52.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cd356700 1 -- 172.21.15.72:0/3781713211 learned_addr learned my addr 172.21.15.72:0/3781713211 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:52.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cd356700 1 -- 172.21.15.72:0/3781713211 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f92c806b080 msgr2=0x7f92c81c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cd356700 1 --2- 172.21.15.72:0/3781713211 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f92c806b080 0x7f92c81c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cd356700 1 -- 172.21.15.72:0/3781713211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92c8131d10 msgr2=0x7f92c81c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cd356700 1 --2- 172.21.15.72:0/3781713211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92c8131d10 0x7f92c81c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cd356700 1 -- 172.21.15.72:0/3781713211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c4009550 con 0x7f92c806a770 2023-10-03T10:16:52.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cdb57700 1 --2- 172.21.15.72:0/3781713211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92c8131d10 0x7f92c81c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cd356700 1 --2- 172.21.15.72:0/3781713211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92c806a770 0x7f92c81c6190 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f92c400ebe0 tx=0x7f92c400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92bdffb700 1 -- 172.21.15.72:0/3781713211 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c400c850 con 0x7f92c806a770 2023-10-03T10:16:52.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92bdffb700 1 -- 172.21.15.72:0/3781713211 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c400c9b0 con 0x7f92c806a770 2023-10-03T10:16:52.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92cf5ba700 1 -- 172.21.15.72:0/3781713211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c0009a70 con 0x7f92c806a770 2023-10-03T10:16:52.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.944+0000 7f92bdffb700 1 -- 172.21.15.72:0/3781713211 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c400cd20 con 0x7f92c806a770 2023-10-03T10:16:52.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.945+0000 7f92cf5ba700 1 -- 172.21.15.72:0/3781713211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c811fdf0 con 0x7f92c806a770 2023-10-03T10:16:52.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.945+0000 7f92bdffb700 1 -- 172.21.15.72:0/3781713211 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92c4013470 con 0x7f92c806a770 2023-10-03T10:16:52.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.945+0000 7f92bdffb700 1 -- 172.21.15.72:0/3781713211 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f92c403fbe0 con 0x7f92c806a770 2023-10-03T10:16:52.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.945+0000 7f92cf5ba700 1 -- 172.21.15.72:0/3781713211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c811ffe0 con 0x7f92c806a770 2023-10-03T10:16:52.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:52.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:52.950+0000 7f92bdffb700 1 -- 172.21.15.72:0/3781713211 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92c401b3b0 con 0x7f92c806a770 2023-10-03T10:16:53.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.052+0000 7f69a2752700 1 Processor -- start 2023-10-03T10:16:53.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.052+0000 7f69a2752700 1 -- start start 2023-10-03T10:16:53.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f69a2752700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f699c09f410 0x7f699c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f69a2752700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f699c136fe0 0x7f699c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f69a2752700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699c070940 con 0x7f699c09e930 2023-10-03T10:16:53.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f69a2752700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699c06fd60 con 0x7f699c136fe0 2023-10-03T10:16:53.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f69a2752700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f699c06fa80 con 0x7f699c09f410 2023-10-03T10:16:53.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f69a0cef700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f699c136fe0 0x7f699c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f699b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f699c09f410 0x7f699c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f69a0cef700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f699c136fe0 0x7f699c1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52582/0 (socket says 172.21.15.72:52582) 2023-10-03T10:16:53.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f69a0cef700 1 -- 172.21.15.72:0/3869918861 learned_addr learned my addr 172.21.15.72:0/3869918861 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:53.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f69a0cef700 1 -- 172.21.15.72:0/3869918861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f699c09f410 msgr2=0x7f699c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f69a0cef700 1 --2- 172.21.15.72:0/3869918861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f699c09f410 0x7f699c136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f69a0cef700 1 -- 172.21.15.72:0/3869918861 >> v1:172.21.15.72:6789/0 conn(0x7f699c09e930 legacy=0x7f699c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f699affd700 1 -- 172.21.15.72:0/3869918861 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518354527 0 0) 0x7f699c070940 con 0x7f699c09e930 2023-10-03T10:16:53.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f69a0cef700 1 -- 172.21.15.72:0/3869918861 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c09fb60 con 0x7f699c136fe0 2023-10-03T10:16:53.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f699b7fe700 1 --2- 172.21.15.72:0/3869918861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f699c09f410 0x7f699c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.053+0000 7f69a0cef700 1 --2- 172.21.15.72:0/3869918861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f699c136fe0 0x7f699c1393c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f6994009e50 tx=0x7f699400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2dccb534ff8287 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.054+0000 7f699affd700 1 -- 172.21.15.72:0/3869918861 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699400e070 con 0x7f699c136fe0 2023-10-03T10:16:53.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.054+0000 7f699affd700 1 -- 172.21.15.72:0/3869918861 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699400b910 con 0x7f699c136fe0 2023-10-03T10:16:53.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.054+0000 7f699affd700 1 -- 172.21.15.72:0/3869918861 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699400bcc0 con 0x7f699c136fe0 2023-10-03T10:16:53.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.054+0000 7f69a2752700 1 -- 172.21.15.72:0/3869918861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f699c136fe0 msgr2=0x7f699c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.054+0000 7f69a2752700 1 --2- 172.21.15.72:0/3869918861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f699c136fe0 0x7f699c1393c0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f6994009e50 tx=0x7f699400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:53.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.054+0000 7f69a2752700 1 -- 172.21.15.72:0/3869918861 shutdown_connections 2023-10-03T10:16:53.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.054+0000 7f69a2752700 1 --2- 172.21.15.72:0/3869918861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f699c136fe0 0x7f699c1393c0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.054+0000 7f69a2752700 1 --2- 172.21.15.72:0/3869918861 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f699c09f410 0x7f699c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.054+0000 7f69a2752700 1 -- 172.21.15.72:0/3869918861 >> 172.21.15.72:0/3869918861 conn(0x7f699c0a4210 msgr2=0x7f699c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.054+0000 7f69a2752700 1 -- 172.21.15.72:0/3869918861 shutdown_connections 2023-10-03T10:16:53.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.054+0000 7f69a2752700 1 -- 172.21.15.72:0/3869918861 wait complete. 2023-10-03T10:16:53.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.055+0000 7f69a2752700 1 Processor -- start 2023-10-03T10:16:53.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.055+0000 7f69a2752700 1 -- start start 2023-10-03T10:16:53.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f69a2752700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f699c09e930 0x7f699c1c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f69a2752700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f699c09f410 0x7f699c1c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f69a2752700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f699c136fe0 0x7f699c1c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f69a2752700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c124270 con 0x7f699c09f410 2023-10-03T10:16:53.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f69a2752700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699c134610 con 0x7f699c09e930 2023-10-03T10:16:53.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f69a2752700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0a32a0 con 0x7f699c136fe0 2023-10-03T10:16:53.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f69a0cef700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f699c136fe0 0x7f699c1c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f69a0cef700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f699c136fe0 0x7f699c1c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48658/0 (socket says 172.21.15.72:48658) 2023-10-03T10:16:53.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f69a0cef700 1 -- 172.21.15.72:0/3795198769 learned_addr learned my addr 172.21.15.72:0/3795198769 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:53.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f699b7fe700 1 --2- 172.21.15.72:0/3795198769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f699c09f410 0x7f699c1c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f699bfff700 1 --2- 172.21.15.72:0/3795198769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f699c09e930 0x7f699c1c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f69a0cef700 1 -- 172.21.15.72:0/3795198769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f699c09e930 msgr2=0x7f699c1c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f69a0cef700 1 --2- 172.21.15.72:0/3795198769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f699c09e930 0x7f699c1c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f69a0cef700 1 -- 172.21.15.72:0/3795198769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f699c09f410 msgr2=0x7f699c1c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f69a0cef700 1 --2- 172.21.15.72:0/3795198769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f699c09f410 0x7f699c1c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f69a0cef700 1 -- 172.21.15.72:0/3795198769 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69900094a0 con 0x7f699c136fe0 2023-10-03T10:16:53.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f699b7fe700 1 --2- 172.21.15.72:0/3795198769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f699c09f410 0x7f699c1c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.056+0000 7f69a0cef700 1 --2- 172.21.15.72:0/3795198769 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f699c136fe0 0x7f699c1c8ef0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f699400b680 tx=0x7f6994004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.057+0000 7f6998ff9700 1 -- 172.21.15.72:0/3795198769 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6994004870 con 0x7f699c136fe0 2023-10-03T10:16:53.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.057+0000 7f6998ff9700 1 -- 172.21.15.72:0/3795198769 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69940092e0 con 0x7f699c136fe0 2023-10-03T10:16:53.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.057+0000 7f69a2752700 1 -- 172.21.15.72:0/3795198769 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6994009b30 con 0x7f699c136fe0 2023-10-03T10:16:53.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.057+0000 7f6998ff9700 1 -- 172.21.15.72:0/3795198769 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699401c660 con 0x7f699c136fe0 2023-10-03T10:16:53.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.057+0000 7f69a2752700 1 -- 172.21.15.72:0/3795198769 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699c071d70 con 0x7f699c136fe0 2023-10-03T10:16:53.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.058+0000 7f69a2752700 1 -- 172.21.15.72:0/3795198769 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f699c074ea0 con 0x7f699c136fe0 2023-10-03T10:16:53.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.058+0000 7f6998ff9700 1 -- 172.21.15.72:0/3795198769 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f699401c7c0 con 0x7f699c136fe0 2023-10-03T10:16:53.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.058+0000 7f6998ff9700 1 -- 172.21.15.72:0/3795198769 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6994041420 con 0x7f699c136fe0 2023-10-03T10:16:53.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.063+0000 7f6998ff9700 1 -- 172.21.15.72:0/3795198769 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f699401ca70 con 0x7f699c136fe0 2023-10-03T10:16:53.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.080+0000 7f6752839700 1 Processor -- start 2023-10-03T10:16:53.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.080+0000 7f6752839700 1 -- start start 2023-10-03T10:16:53.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f6752839700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f674c09f410 0x7f674c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f6752839700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f674c136fe0 0x7f674c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f6752839700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f674c070940 con 0x7f674c09e930 2023-10-03T10:16:53.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f6752839700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674c06fd60 con 0x7f674c136fe0 2023-10-03T10:16:53.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f6752839700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f674c06fa80 con 0x7f674c09f410 2023-10-03T10:16:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f6750dd6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f674c136fe0 0x7f674c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f6750dd6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f674c136fe0 0x7f674c1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52598/0 (socket says 172.21.15.72:52598) 2023-10-03T10:16:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f674bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f674c09e930 0x7f674c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34602/0 (socket says 172.21.15.72:34602) 2023-10-03T10:16:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f6750dd6700 1 -- 172.21.15.72:0/3935986420 learned_addr learned my addr 172.21.15.72:0/3935986420 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f674b7fe700 1 --2- 172.21.15.72:0/3935986420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f674c09f410 0x7f674c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f6750dd6700 1 -- 172.21.15.72:0/3935986420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f674c09f410 msgr2=0x7f674c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f6750dd6700 1 --2- 172.21.15.72:0/3935986420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f674c09f410 0x7f674c136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f6750dd6700 1 -- 172.21.15.72:0/3935986420 >> v1:172.21.15.72:6789/0 conn(0x7f674c09e930 legacy=0x7f674c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f674affd700 1 -- 172.21.15.72:0/3935986420 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538376039 0 0) 0x7f674c070940 con 0x7f674c09e930 2023-10-03T10:16:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f6750dd6700 1 -- 172.21.15.72:0/3935986420 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c09fb60 con 0x7f674c136fe0 2023-10-03T10:16:53.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f674b7fe700 1 --2- 172.21.15.72:0/3935986420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f674c09f410 0x7f674c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f6750dd6700 1 --2- 172.21.15.72:0/3935986420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f674c136fe0 0x7f674c1393c0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f6744009e50 tx=0x7f674400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f43a00b4472d99b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f674affd700 1 -- 172.21.15.72:0/3935986420 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674400e070 con 0x7f674c136fe0 2023-10-03T10:16:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f674affd700 1 -- 172.21.15.72:0/3935986420 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674400b910 con 0x7f674c136fe0 2023-10-03T10:16:53.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.081+0000 7f674affd700 1 -- 172.21.15.72:0/3935986420 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674400bcc0 con 0x7f674c136fe0 2023-10-03T10:16:53.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.082+0000 7f6752839700 1 -- 172.21.15.72:0/3935986420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f674c136fe0 msgr2=0x7f674c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.082+0000 7f6752839700 1 --2- 172.21.15.72:0/3935986420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f674c136fe0 0x7f674c1393c0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f6744009e50 tx=0x7f674400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:53.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.082+0000 7f6752839700 1 -- 172.21.15.72:0/3935986420 shutdown_connections 2023-10-03T10:16:53.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.082+0000 7f6752839700 1 --2- 172.21.15.72:0/3935986420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f674c136fe0 0x7f674c1393c0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.082+0000 7f6752839700 1 --2- 172.21.15.72:0/3935986420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f674c09f410 0x7f674c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.082+0000 7f6752839700 1 -- 172.21.15.72:0/3935986420 >> 172.21.15.72:0/3935986420 conn(0x7f674c0a4210 msgr2=0x7f674c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.082+0000 7f6752839700 1 -- 172.21.15.72:0/3935986420 shutdown_connections 2023-10-03T10:16:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.082+0000 7f6752839700 1 -- 172.21.15.72:0/3935986420 wait complete. 2023-10-03T10:16:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.083+0000 7f6752839700 1 Processor -- start 2023-10-03T10:16:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.083+0000 7f6752839700 1 -- start start 2023-10-03T10:16:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f6752839700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f674c09e930 0x7f674c11b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f6752839700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f674c09f410 0x7f674c11b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f6752839700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f674c136fe0 0x7f674c11be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f6752839700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c132cc0 con 0x7f674c09e930 2023-10-03T10:16:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f6752839700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674c071d20 con 0x7f674c136fe0 2023-10-03T10:16:53.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f6752839700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f674c11ef20 con 0x7f674c09f410 2023-10-03T10:16:53.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f674bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f674c09e930 0x7f674c11b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f6750dd6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f674c136fe0 0x7f674c11be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f674bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f674c09e930 0x7f674c11b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52612/0 (socket says 172.21.15.72:52612) 2023-10-03T10:16:53.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f674bfff700 1 -- 172.21.15.72:0/2605061081 learned_addr learned my addr 172.21.15.72:0/2605061081 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:53.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f674b7fe700 1 --2- 172.21.15.72:0/2605061081 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f674c09f410 0x7f674c11b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f674bfff700 1 -- 172.21.15.72:0/2605061081 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f674c09f410 msgr2=0x7f674c11b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f674bfff700 1 --2- 172.21.15.72:0/2605061081 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f674c09f410 0x7f674c11b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f674bfff700 1 -- 172.21.15.72:0/2605061081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f674c136fe0 msgr2=0x7f674c11be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f674bfff700 1 --2- 172.21.15.72:0/2605061081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f674c136fe0 0x7f674c11be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f674bfff700 1 -- 172.21.15.72:0/2605061081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674000da70 con 0x7f674c09e930 2023-10-03T10:16:53.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f6750dd6700 1 --2- 172.21.15.72:0/2605061081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f674c136fe0 0x7f674c11be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.084+0000 7f674bfff700 1 --2- 172.21.15.72:0/2605061081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f674c09e930 0x7f674c11b400 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f673c00c520 tx=0x7f673c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.085+0000 7f6748ff9700 1 -- 172.21.15.72:0/2605061081 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c004c80 con 0x7f674c09e930 2023-10-03T10:16:53.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.085+0000 7f6748ff9700 1 -- 172.21.15.72:0/2605061081 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c004e00 con 0x7f674c09e930 2023-10-03T10:16:53.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.085+0000 7f6752839700 1 -- 172.21.15.72:0/2605061081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6744009b30 con 0x7f674c09e930 2023-10-03T10:16:53.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.085+0000 7f6748ff9700 1 -- 172.21.15.72:0/2605061081 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c007310 con 0x7f674c09e930 2023-10-03T10:16:53.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.085+0000 7f6752839700 1 -- 172.21.15.72:0/2605061081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674c11e6b0 con 0x7f674c09e930 2023-10-03T10:16:53.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.085+0000 7f6748ff9700 1 -- 172.21.15.72:0/2605061081 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f673c007470 con 0x7f674c09e930 2023-10-03T10:16:53.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.086+0000 7f6748ff9700 1 -- 172.21.15.72:0/2605061081 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f673c03f410 con 0x7f674c09e930 2023-10-03T10:16:53.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.086+0000 7f6752839700 1 -- 172.21.15.72:0/2605061081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674c074ea0 con 0x7f674c09e930 2023-10-03T10:16:53.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.095+0000 7f6748ff9700 1 -- 172.21.15.72:0/2605061081 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f673c0123b0 con 0x7f674c09e930 2023-10-03T10:16:53.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.157+0000 7f92cf5ba700 1 -- 172.21.15.72:0/3781713211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f92c8074ea0 con 0x7f92c806a770 2023-10-03T10:16:53.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.158+0000 7f92bdffb700 1 -- 172.21.15.72:0/3781713211 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92c4017070 con 0x7f92c806a770 2023-10-03T10:16:53.159 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:53.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.160+0000 7f92cf5ba700 1 -- 172.21.15.72:0/3781713211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92c806a770 msgr2=0x7f92c81c6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.160+0000 7f92cf5ba700 1 --2- 172.21.15.72:0/3781713211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92c806a770 0x7f92c81c6190 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f92c400ebe0 tx=0x7f92c400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.160+0000 7f92cf5ba700 1 -- 172.21.15.72:0/3781713211 shutdown_connections 2023-10-03T10:16:53.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.160+0000 7f92cf5ba700 1 --2- 172.21.15.72:0/3781713211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92c806a770 0x7f92c81c6190 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.160+0000 7f92cf5ba700 1 --2- 172.21.15.72:0/3781713211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f92c8131d10 0x7f92c81c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.160+0000 7f92cf5ba700 1 --2- 172.21.15.72:0/3781713211 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f92c806b080 0x7f92c81c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.160+0000 7f92cf5ba700 1 -- 172.21.15.72:0/3781713211 >> 172.21.15.72:0/3781713211 conn(0x7f92c8066f50 msgr2=0x7f92c80700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.160+0000 7f92cf5ba700 1 -- 172.21.15.72:0/3781713211 shutdown_connections 2023-10-03T10:16:53.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.160+0000 7f92cf5ba700 1 -- 172.21.15.72:0/3781713211 wait complete. 2023-10-03T10:16:53.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:53.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.258+0000 7f69a2752700 1 -- 172.21.15.72:0/3795198769 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f699c1243b0 con 0x7f699c136fe0 2023-10-03T10:16:53.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.258+0000 7f6998ff9700 1 -- 172.21.15.72:0/3795198769 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f699c1243b0 con 0x7f699c136fe0 2023-10-03T10:16:53.259 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:53.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.261+0000 7f69a2752700 1 -- 172.21.15.72:0/3795198769 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f699c136fe0 msgr2=0x7f699c1c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.261+0000 7f69a2752700 1 --2- 172.21.15.72:0/3795198769 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f699c136fe0 0x7f699c1c8ef0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f699400b680 tx=0x7f6994004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.261+0000 7f69a2752700 1 -- 172.21.15.72:0/3795198769 shutdown_connections 2023-10-03T10:16:53.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.261+0000 7f69a2752700 1 --2- 172.21.15.72:0/3795198769 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f699c136fe0 0x7f699c1c8ef0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.261+0000 7f69a2752700 1 --2- 172.21.15.72:0/3795198769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f699c09e930 0x7f699c1c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.261+0000 7f69a2752700 1 --2- 172.21.15.72:0/3795198769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f699c09f410 0x7f699c1c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.261+0000 7f69a2752700 1 -- 172.21.15.72:0/3795198769 >> 172.21.15.72:0/3795198769 conn(0x7f699c0a4210 msgr2=0x7f699c134900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.262+0000 7f69a2752700 1 -- 172.21.15.72:0/3795198769 shutdown_connections 2023-10-03T10:16:53.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.262+0000 7f69a2752700 1 -- 172.21.15.72:0/3795198769 wait complete. 2023-10-03T10:16:53.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:53.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.291+0000 7f6752839700 1 -- 172.21.15.72:0/2605061081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f674c06cf10 con 0x7f674c09e930 2023-10-03T10:16:53.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.291+0000 7f6748ff9700 1 -- 172.21.15.72:0/2605061081 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f673c011360 con 0x7f674c09e930 2023-10-03T10:16:53.292 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.293+0000 7f6752839700 1 -- 172.21.15.72:0/2605061081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f674c09e930 msgr2=0x7f674c11b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.293+0000 7f6752839700 1 --2- 172.21.15.72:0/2605061081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f674c09e930 0x7f674c11b400 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f673c00c520 tx=0x7f673c00c830 comp rx=0 tx=0).stop 2023-10-03T10:16:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.293+0000 7f6752839700 1 -- 172.21.15.72:0/2605061081 shutdown_connections 2023-10-03T10:16:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.293+0000 7f6752839700 1 --2- 172.21.15.72:0/2605061081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f674c09e930 0x7f674c11b400 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.293+0000 7f6752839700 1 --2- 172.21.15.72:0/2605061081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f674c136fe0 0x7f674c11be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.293+0000 7f6752839700 1 --2- 172.21.15.72:0/2605061081 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f674c09f410 0x7f674c11b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.293+0000 7f6752839700 1 -- 172.21.15.72:0/2605061081 >> 172.21.15.72:0/2605061081 conn(0x7f674c0a4210 msgr2=0x7f674c06bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.293+0000 7f6752839700 1 -- 172.21.15.72:0/2605061081 shutdown_connections 2023-10-03T10:16:53.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.293+0000 7f6752839700 1 -- 172.21.15.72:0/2605061081 wait complete. 2023-10-03T10:16:53.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:53.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.514+0000 7f0fa8734700 1 Processor -- start 2023-10-03T10:16:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.514+0000 7f0fa8734700 1 -- start start 2023-10-03T10:16:53.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa8734700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa009e1b0 0x7f0fa0138a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa8734700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa0138f50 0x7f0fa013b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa8734700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa009a570 con 0x7f0fa009d6d0 2023-10-03T10:16:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa8734700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa009e5a0 con 0x7f0fa0138f50 2023-10-03T10:16:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa8734700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa009b1c0 con 0x7f0fa009e1b0 2023-10-03T10:16:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa5ccf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa009e1b0 0x7f0fa0138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa6cd1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa0138f50 0x7f0fa013b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa6cd1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa0138f50 0x7f0fa013b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:32882/0 (socket says 172.21.15.72:32882) 2023-10-03T10:16:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa5ccf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa009e1b0 0x7f0fa0138a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48668/0 (socket says 172.21.15.72:48668) 2023-10-03T10:16:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa6cd1700 1 -- 172.21.15.72:0/2043073894 learned_addr learned my addr 172.21.15.72:0/2043073894 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:53.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa64d0700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0fa009d6d0 0x7f0fa009daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34604/0 (socket says 172.21.15.72:34604) 2023-10-03T10:16:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa54ce700 1 -- 172.21.15.72:0/2043073894 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429867885 0 0) 0x7f0fa009a570 con 0x7f0fa009d6d0 2023-10-03T10:16:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa54ce700 1 -- 172.21.15.72:0/2043073894 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f8c0035b0 con 0x7f0fa009d6d0 2023-10-03T10:16:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa6cd1700 1 -- 172.21.15.72:0/2043073894 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa009e1b0 msgr2=0x7f0fa0138a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa6cd1700 1 --2- 172.21.15.72:0/2043073894 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa009e1b0 0x7f0fa0138a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa6cd1700 1 -- 172.21.15.72:0/2043073894 >> v1:172.21.15.72:6789/0 conn(0x7f0fa009d6d0 legacy=0x7f0fa009daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa6cd1700 1 -- 172.21.15.72:0/2043073894 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa009f240 con 0x7f0fa0138f50 2023-10-03T10:16:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.515+0000 7f0fa5ccf700 1 --2- 172.21.15.72:0/2043073894 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa009e1b0 0x7f0fa0138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.516+0000 7f0fa6cd1700 1 --2- 172.21.15.72:0/2043073894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa0138f50 0x7f0fa013b330 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009eb0 tx=0x7f0f9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3dc7e8c9281e3eb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.516+0000 7f0fa54ce700 1 -- 172.21.15.72:0/2043073894 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9800e070 con 0x7f0fa0138f50 2023-10-03T10:16:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.516+0000 7f0fa54ce700 1 -- 172.21.15.72:0/2043073894 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9800b8d0 con 0x7f0fa0138f50 2023-10-03T10:16:53.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.516+0000 7f0fa54ce700 1 -- 172.21.15.72:0/2043073894 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9800bc80 con 0x7f0fa0138f50 2023-10-03T10:16:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.516+0000 7f0fa8734700 1 -- 172.21.15.72:0/2043073894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa0138f50 msgr2=0x7f0fa013b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.516+0000 7f0fa8734700 1 --2- 172.21.15.72:0/2043073894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa0138f50 0x7f0fa013b330 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009eb0 tx=0x7f0f9800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.516+0000 7f0fa8734700 1 -- 172.21.15.72:0/2043073894 shutdown_connections 2023-10-03T10:16:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.516+0000 7f0fa8734700 1 --2- 172.21.15.72:0/2043073894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa0138f50 0x7f0fa013b330 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.516+0000 7f0fa8734700 1 --2- 172.21.15.72:0/2043073894 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa009e1b0 0x7f0fa0138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.516+0000 7f0fa8734700 1 -- 172.21.15.72:0/2043073894 >> 172.21.15.72:0/2043073894 conn(0x7f0fa0099c20 msgr2=0x7f0fa00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.516+0000 7f0fa8734700 1 -- 172.21.15.72:0/2043073894 shutdown_connections 2023-10-03T10:16:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.516+0000 7f0fa8734700 1 -- 172.21.15.72:0/2043073894 wait complete. 2023-10-03T10:16:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.517+0000 7f0fa8734700 1 Processor -- start 2023-10-03T10:16:53.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.517+0000 7f0fa8734700 1 -- start start 2023-10-03T10:16:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa8734700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa009d6d0 0x7f0fa011a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa8734700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa009e1b0 0x7f0fa011a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa8734700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa0138f50 0x7f0fa011adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa8734700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa011bf30 con 0x7f0fa009d6d0 2023-10-03T10:16:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa8734700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa0130210 con 0x7f0fa0138f50 2023-10-03T10:16:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa8734700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa011c790 con 0x7f0fa009e1b0 2023-10-03T10:16:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa5ccf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa009e1b0 0x7f0fa011a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa5ccf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa009e1b0 0x7f0fa011a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48682/0 (socket says 172.21.15.72:48682) 2023-10-03T10:16:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa6cd1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa0138f50 0x7f0fa011adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa5ccf700 1 -- 172.21.15.72:0/881540385 learned_addr learned my addr 172.21.15.72:0/881540385 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa64d0700 1 --2- 172.21.15.72:0/881540385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa009d6d0 0x7f0fa011a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa6cd1700 1 -- 172.21.15.72:0/881540385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa009e1b0 msgr2=0x7f0fa011a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa6cd1700 1 --2- 172.21.15.72:0/881540385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa009e1b0 0x7f0fa011a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa6cd1700 1 -- 172.21.15.72:0/881540385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa009d6d0 msgr2=0x7f0fa011a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa6cd1700 1 --2- 172.21.15.72:0/881540385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa009d6d0 0x7f0fa011a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa6cd1700 1 -- 172.21.15.72:0/881540385 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0094a0 con 0x7f0fa0138f50 2023-10-03T10:16:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa5ccf700 1 --2- 172.21.15.72:0/881540385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa009e1b0 0x7f0fa011a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.518+0000 7f0fa6cd1700 1 --2- 172.21.15.72:0/881540385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa0138f50 0x7f0fa011adf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009eb0 tx=0x7f0f98004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.519+0000 7f0f96ffd700 1 -- 172.21.15.72:0/881540385 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98004450 con 0x7f0fa0138f50 2023-10-03T10:16:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.519+0000 7f0f96ffd700 1 -- 172.21.15.72:0/881540385 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f980045b0 con 0x7f0fa0138f50 2023-10-03T10:16:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.519+0000 7f0fa8734700 1 -- 172.21.15.72:0/881540385 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f98009b30 con 0x7f0fa0138f50 2023-10-03T10:16:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.519+0000 7f0f96ffd700 1 -- 172.21.15.72:0/881540385 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98004920 con 0x7f0fa0138f50 2023-10-03T10:16:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.519+0000 7f0fa8734700 1 -- 172.21.15.72:0/881540385 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa011d5d0 con 0x7f0fa0138f50 2023-10-03T10:16:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.519+0000 7f0f96ffd700 1 -- 172.21.15.72:0/881540385 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f98025460 con 0x7f0fa0138f50 2023-10-03T10:16:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.519+0000 7f0f96ffd700 1 -- 172.21.15.72:0/881540385 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0f98041250 con 0x7f0fa0138f50 2023-10-03T10:16:53.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.519+0000 7f0fa8734700 1 -- 172.21.15.72:0/881540385 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa004f2a0 con 0x7f0fa0138f50 2023-10-03T10:16:53.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.524+0000 7f0f96ffd700 1 -- 172.21.15.72:0/881540385 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f98003e10 con 0x7f0fa0138f50 2023-10-03T10:16:53.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.712+0000 7f0fa8734700 1 -- 172.21.15.72:0/881540385 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0fa009c900 con 0x7f0fa0138f50 2023-10-03T10:16:53.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.712+0000 7f0f96ffd700 1 -- 172.21.15.72:0/881540385 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f98033020 con 0x7f0fa0138f50 2023-10-03T10:16:53.713 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:53.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.714+0000 7f0fa8734700 1 -- 172.21.15.72:0/881540385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa0138f50 msgr2=0x7f0fa011adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.714+0000 7f0fa8734700 1 --2- 172.21.15.72:0/881540385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa0138f50 0x7f0fa011adf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009eb0 tx=0x7f0f98004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.714+0000 7f0fa8734700 1 -- 172.21.15.72:0/881540385 shutdown_connections 2023-10-03T10:16:53.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.714+0000 7f0fa8734700 1 --2- 172.21.15.72:0/881540385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fa009d6d0 0x7f0fa011a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.714+0000 7f0fa8734700 1 --2- 172.21.15.72:0/881540385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fa0138f50 0x7f0fa011adf0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.714+0000 7f0fa8734700 1 --2- 172.21.15.72:0/881540385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fa009e1b0 0x7f0fa011a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.714+0000 7f0fa8734700 1 -- 172.21.15.72:0/881540385 >> 172.21.15.72:0/881540385 conn(0x7f0fa0099c20 msgr2=0x7f0fa00a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.714+0000 7f0fa8734700 1 -- 172.21.15.72:0/881540385 shutdown_connections 2023-10-03T10:16:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:53.714+0000 7f0fa8734700 1 -- 172.21.15.72:0/881540385 wait complete. 2023-10-03T10:16:53.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:54.174 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:54.275 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:54.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.302+0000 7fc5bb747700 1 Processor -- start 2023-10-03T10:16:54.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.302+0000 7fc5bb747700 1 -- start start 2023-10-03T10:16:54.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5bb747700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5b409d6f0 0x7fc5b409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5bb747700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5b409e000 0x7fc5b4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5bb747700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b409f130 con 0x7fc5b409e410 2023-10-03T10:16:54.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5bb747700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b409f520 con 0x7fc5b409e000 2023-10-03T10:16:54.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5bb747700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b409e930 con 0x7fc5b409d6f0 2023-10-03T10:16:54.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5b8ce2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5b409e000 0x7fc5b4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5b8ce2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5b409e000 0x7fc5b4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52628/0 (socket says 172.21.15.72:52628) 2023-10-03T10:16:54.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5b94e3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5b409d6f0 0x7fc5b409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5b8ce2700 1 -- 172.21.15.72:0/813708094 learned_addr learned my addr 172.21.15.72:0/813708094 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:54.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5b8ce2700 1 -- 172.21.15.72:0/813708094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5b409d6f0 msgr2=0x7fc5b409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:54.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5b8ce2700 1 --2- 172.21.15.72:0/813708094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5b409d6f0 0x7fc5b409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5b8ce2700 1 -- 172.21.15.72:0/813708094 >> v1:172.21.15.72:6789/0 conn(0x7fc5b409e410 legacy=0x7fc5b4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5b8ce2700 1 -- 172.21.15.72:0/813708094 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b409b2d0 con 0x7fc5b409e000 2023-10-03T10:16:54.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5b94e3700 1 --2- 172.21.15.72:0/813708094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5b409d6f0 0x7fc5b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5b8ce2700 1 --2- 172.21.15.72:0/813708094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5b409e000 0x7fc5b4130660 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40098f0 tx=0x7fc5a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de101d48efa8465f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5abfff700 1 -- 172.21.15.72:0/813708094 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4011830 con 0x7fc5b409e000 2023-10-03T10:16:54.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5abfff700 1 -- 172.21.15.72:0/813708094 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a4011990 con 0x7fc5b409e000 2023-10-03T10:16:54.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.303+0000 7fc5abfff700 1 -- 172.21.15.72:0/813708094 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4011d20 con 0x7fc5b409e000 2023-10-03T10:16:54.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.304+0000 7fc5bb747700 1 -- 172.21.15.72:0/813708094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5b409e000 msgr2=0x7fc5b4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.304+0000 7fc5bb747700 1 --2- 172.21.15.72:0/813708094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5b409e000 0x7fc5b4130660 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40098f0 tx=0x7fc5a4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:54.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.304+0000 7fc5bb747700 1 -- 172.21.15.72:0/813708094 shutdown_connections 2023-10-03T10:16:54.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.304+0000 7fc5bb747700 1 --2- 172.21.15.72:0/813708094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5b409d6f0 0x7fc5b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.304+0000 7fc5bb747700 1 --2- 172.21.15.72:0/813708094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5b409e000 0x7fc5b4130660 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.304+0000 7fc5bb747700 1 -- 172.21.15.72:0/813708094 >> 172.21.15.72:0/813708094 conn(0x7fc5b4066f50 msgr2=0x7fc5b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.304+0000 7fc5bb747700 1 -- 172.21.15.72:0/813708094 shutdown_connections 2023-10-03T10:16:54.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.304+0000 7fc5bb747700 1 -- 172.21.15.72:0/813708094 wait complete. 2023-10-03T10:16:54.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:54.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.305+0000 7fc5bb747700 1 Processor -- start 2023-10-03T10:16:54.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.305+0000 7fc5bb747700 1 -- start start 2023-10-03T10:16:54.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5bb747700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5b409d6f0 0x7fc5b41c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5bb747700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5b409e000 0x7fc5b41c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5bb747700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5b409e410 0x7fc5b41c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5bb747700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b406b280 con 0x7fc5b409e000 2023-10-03T10:16:54.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5bb747700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b4121030 con 0x7fc5b409d6f0 2023-10-03T10:16:54.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5bb747700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b406e9f0 con 0x7fc5b409e410 2023-10-03T10:16:54.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5b94e3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5b409d6f0 0x7fc5b41c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5b8ce2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5b409e000 0x7fc5b41c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5b94e3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5b409d6f0 0x7fc5b41c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:32908/0 (socket says 172.21.15.72:32908) 2023-10-03T10:16:54.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5b94e3700 1 -- 172.21.15.72:0/441300491 learned_addr learned my addr 172.21.15.72:0/441300491 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:54.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5b9ce4700 1 --2- 172.21.15.72:0/441300491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5b409e410 0x7fc5b41c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5b94e3700 1 -- 172.21.15.72:0/441300491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5b409e410 msgr2=0x7fc5b41c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5b94e3700 1 --2- 172.21.15.72:0/441300491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5b409e410 0x7fc5b41c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5b94e3700 1 -- 172.21.15.72:0/441300491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5b409e000 msgr2=0x7fc5b41c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5b94e3700 1 --2- 172.21.15.72:0/441300491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5b409e000 0x7fc5b41c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5b94e3700 1 -- 172.21.15.72:0/441300491 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b00094a0 con 0x7fc5b409d6f0 2023-10-03T10:16:54.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5b8ce2700 1 --2- 172.21.15.72:0/441300491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5b409e000 0x7fc5b41c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5b94e3700 1 --2- 172.21.15.72:0/441300491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5b409d6f0 0x7fc5b41c84a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000ebe0 tx=0x7fc5b000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5a9ffb700 1 -- 172.21.15.72:0/441300491 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0009760 con 0x7fc5b409d6f0 2023-10-03T10:16:54.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5a9ffb700 1 -- 172.21.15.72:0/441300491 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b000c850 con 0x7fc5b409d6f0 2023-10-03T10:16:54.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5bb747700 1 -- 172.21.15.72:0/441300491 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a4009550 con 0x7fc5b409d6f0 2023-10-03T10:16:54.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.306+0000 7fc5a9ffb700 1 -- 172.21.15.72:0/441300491 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b000cbe0 con 0x7fc5b409d6f0 2023-10-03T10:16:54.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.307+0000 7fc5bb747700 1 -- 172.21.15.72:0/441300491 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b4125c40 con 0x7fc5b409d6f0 2023-10-03T10:16:54.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.307+0000 7fc5a9ffb700 1 -- 172.21.15.72:0/441300491 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5b000cd40 con 0x7fc5b409d6f0 2023-10-03T10:16:54.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.307+0000 7fc5a9ffb700 1 -- 172.21.15.72:0/441300491 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc5b003fac0 con 0x7fc5b409d6f0 2023-10-03T10:16:54.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.309+0000 7fc5bb747700 1 -- 172.21.15.72:0/441300491 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b41203a0 con 0x7fc5b409d6f0 2023-10-03T10:16:54.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.314+0000 7fc5a9ffb700 1 -- 172.21.15.72:0/441300491 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5b001b3b0 con 0x7fc5b409d6f0 2023-10-03T10:16:54.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.423+0000 7f2a7cfa2700 1 Processor -- start 2023-10-03T10:16:54.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.423+0000 7f2a7cfa2700 1 -- start start 2023-10-03T10:16:54.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a7cfa2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a7809f150 0x7f2a78136890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a7cfa2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a78136dd0 0x7f2a781391b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a7cfa2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7809fd20 con 0x7f2a7809e670 2023-10-03T10:16:54.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a7cfa2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7809bb90 con 0x7f2a7809f150 2023-10-03T10:16:54.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a7cfa2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7809b510 con 0x7f2a78136dd0 2023-10-03T10:16:54.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a76ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a7809f150 0x7f2a78136890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a76ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a7809f150 0x7f2a78136890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52642/0 (socket says 172.21.15.72:52642) 2023-10-03T10:16:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a76ffd700 1 -- 172.21.15.72:0/2159194972 learned_addr learned my addr 172.21.15.72:0/2159194972 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a77fff700 1 --2- 172.21.15.72:0/2159194972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a78136dd0 0x7f2a781391b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a77fff700 1 -- 172.21.15.72:0/2159194972 >> v2:172.21.15.72:3300/0 conn(0x7f2a7809f150 msgr2=0x7f2a78136890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a77fff700 1 --2- 172.21.15.72:0/2159194972 >> v2:172.21.15.72:3300/0 conn(0x7f2a7809f150 0x7f2a78136890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a77fff700 1 -- 172.21.15.72:0/2159194972 >> v1:172.21.15.72:6789/0 conn(0x7f2a7809e670 legacy=0x7f2a7809ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a77fff700 1 -- 172.21.15.72:0/2159194972 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7809ff50 con 0x7f2a78136dd0 2023-10-03T10:16:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a76ffd700 1 --2- 172.21.15.72:0/2159194972 >> v2:172.21.15.72:3300/0 conn(0x7f2a7809f150 0x7f2a78136890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a77fff700 1 --2- 172.21.15.72:0/2159194972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a78136dd0 0x7f2a781391b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009d90 tx=0x7f2a7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d452ba77b570d3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.424+0000 7f2a767fc700 1 -- 172.21.15.72:0/2159194972 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7000e070 con 0x7f2a78136dd0 2023-10-03T10:16:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.425+0000 7f2a767fc700 1 -- 172.21.15.72:0/2159194972 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7000bb20 con 0x7f2a78136dd0 2023-10-03T10:16:54.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.425+0000 7f2a767fc700 1 -- 172.21.15.72:0/2159194972 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70012430 con 0x7f2a78136dd0 2023-10-03T10:16:54.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.425+0000 7f2a7cfa2700 1 -- 172.21.15.72:0/2159194972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a78136dd0 msgr2=0x7f2a781391b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.425+0000 7f2a7cfa2700 1 --2- 172.21.15.72:0/2159194972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a78136dd0 0x7f2a781391b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009d90 tx=0x7f2a7000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:54.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.425+0000 7f2a7cfa2700 1 -- 172.21.15.72:0/2159194972 shutdown_connections 2023-10-03T10:16:54.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.425+0000 7f2a7cfa2700 1 --2- 172.21.15.72:0/2159194972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a78136dd0 0x7f2a781391b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.425+0000 7f2a7cfa2700 1 --2- 172.21.15.72:0/2159194972 >> v2:172.21.15.72:3300/0 conn(0x7f2a7809f150 0x7f2a78136890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.425+0000 7f2a7cfa2700 1 -- 172.21.15.72:0/2159194972 >> 172.21.15.72:0/2159194972 conn(0x7f2a780a0c90 msgr2=0x7f2a780a1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.425+0000 7f2a7cfa2700 1 -- 172.21.15.72:0/2159194972 shutdown_connections 2023-10-03T10:16:54.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.425+0000 7f2a7cfa2700 1 -- 172.21.15.72:0/2159194972 wait complete. 2023-10-03T10:16:54.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.427+0000 7f2a7cfa2700 1 Processor -- start 2023-10-03T10:16:54.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.427+0000 7f2a7cfa2700 1 -- start start 2023-10-03T10:16:54.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a7cfa2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a7809e670 0x7f2a781c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a7cfa2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a7809f150 0x7f2a781c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a7cfa2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a78136dd0 0x7f2a7806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a7cfa2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a781bbeb0 con 0x7f2a78136dd0 2023-10-03T10:16:54.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a7cfa2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a78121d20 con 0x7f2a7809e670 2023-10-03T10:16:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a7cfa2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a781320b0 con 0x7f2a7809f150 2023-10-03T10:16:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a77fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a78136dd0 0x7f2a7806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a77fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a78136dd0 0x7f2a7806b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52654/0 (socket says 172.21.15.72:52654) 2023-10-03T10:16:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a77fff700 1 -- 172.21.15.72:0/404365180 learned_addr learned my addr 172.21.15.72:0/404365180 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a777fe700 1 --2- 172.21.15.72:0/404365180 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a7809e670 0x7f2a781c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a777fe700 1 -- 172.21.15.72:0/404365180 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a7809f150 msgr2=0x7f2a781c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a777fe700 1 --2- 172.21.15.72:0/404365180 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a7809f150 0x7f2a781c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a777fe700 1 -- 172.21.15.72:0/404365180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a78136dd0 msgr2=0x7f2a7806b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a777fe700 1 --2- 172.21.15.72:0/404365180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a78136dd0 0x7f2a7806b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a777fe700 1 -- 172.21.15.72:0/404365180 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c009550 con 0x7f2a7809e670 2023-10-03T10:16:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a77fff700 1 --2- 172.21.15.72:0/404365180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a78136dd0 0x7f2a7806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a777fe700 1 --2- 172.21.15.72:0/404365180 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a7809e670 0x7f2a781c8430 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800c450 tx=0x7f2a6800c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.428+0000 7f2a5ffff700 1 -- 172.21.15.72:0/404365180 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a680052d0 con 0x7f2a7809e670 2023-10-03T10:16:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.429+0000 7f2a5ffff700 1 -- 172.21.15.72:0/404365180 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a68005430 con 0x7f2a7809e670 2023-10-03T10:16:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.429+0000 7f2a7cfa2700 1 -- 172.21.15.72:0/404365180 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a70009a70 con 0x7f2a7809e670 2023-10-03T10:16:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.429+0000 7f2a5ffff700 1 -- 172.21.15.72:0/404365180 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a680038c0 con 0x7f2a7809e670 2023-10-03T10:16:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.429+0000 7f2a7cfa2700 1 -- 172.21.15.72:0/404365180 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7809d8c0 con 0x7f2a7809e670 2023-10-03T10:16:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.429+0000 7f2a5ffff700 1 -- 172.21.15.72:0/404365180 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a68003a20 con 0x7f2a7809e670 2023-10-03T10:16:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.430+0000 7f2a5ffff700 1 -- 172.21.15.72:0/404365180 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2a68040a50 con 0x7f2a7809e670 2023-10-03T10:16:54.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.430+0000 7f2a7cfa2700 1 -- 172.21.15.72:0/404365180 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a78121f60 con 0x7f2a7809e670 2023-10-03T10:16:54.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.435+0000 7f2a5ffff700 1 -- 172.21.15.72:0/404365180 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a68017080 con 0x7f2a7809e670 2023-10-03T10:16:54.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.435+0000 7f8b371fd700 1 Processor -- start 2023-10-03T10:16:54.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.435+0000 7f8b371fd700 1 -- start start 2023-10-03T10:16:54.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.436+0000 7f8b371fd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b30134630 0x7f8b30136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.436+0000 7f8b371fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b30136f50 0x7f8b30139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.436+0000 7f8b371fd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3009b4f0 con 0x7f8b30131810 2023-10-03T10:16:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.436+0000 7f8b371fd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b301313c0 con 0x7f8b30136f50 2023-10-03T10:16:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.436+0000 7f8b371fd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3006e8c0 con 0x7f8b30134630 2023-10-03T10:16:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.436+0000 7f8b2ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b30134630 0x7f8b30136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.436+0000 7f8b3579a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b30136f50 0x7f8b30139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.436+0000 7f8b3579a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b30136f50 0x7f8b30139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:32946/0 (socket says 172.21.15.72:32946) 2023-10-03T10:16:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.436+0000 7f8b2ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b30134630 0x7f8b30136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48712/0 (socket says 172.21.15.72:48712) 2023-10-03T10:16:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.436+0000 7f8b3579a700 1 -- 172.21.15.72:0/4270468234 learned_addr learned my addr 172.21.15.72:0/4270468234 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.436+0000 7f8b2ffff700 1 -- 172.21.15.72:0/4270468234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b30136f50 msgr2=0x7f8b30139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.436+0000 7f8b2f7fe700 1 -- 172.21.15.72:0/4270468234 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887789696 0 0) 0x7f8b3009b4f0 con 0x7f8b30131810 2023-10-03T10:16:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.436+0000 7f8b2ffff700 1 --2- 172.21.15.72:0/4270468234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b30136f50 0x7f8b30139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.437+0000 7f8b2ffff700 1 -- 172.21.15.72:0/4270468234 >> v1:172.21.15.72:6789/0 conn(0x7f8b30131810 legacy=0x7f8b30131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.437+0000 7f8b2ffff700 1 -- 172.21.15.72:0/4270468234 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b30071d20 con 0x7f8b30134630 2023-10-03T10:16:54.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.437+0000 7f8b3579a700 1 --2- 172.21.15.72:0/4270468234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b30136f50 0x7f8b30139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.437+0000 7f8b2ffff700 1 --2- 172.21.15.72:0/4270468234 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b30134630 0x7f8b30136a10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009870 tx=0x7f8b1c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e0de54b2c5c05ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.437+0000 7f8b2f7fe700 1 -- 172.21.15.72:0/4270468234 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c011830 con 0x7f8b30134630 2023-10-03T10:16:54.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.437+0000 7f8b2f7fe700 1 -- 172.21.15.72:0/4270468234 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c011990 con 0x7f8b30134630 2023-10-03T10:16:54.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.437+0000 7f8b2f7fe700 1 -- 172.21.15.72:0/4270468234 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c011d20 con 0x7f8b30134630 2023-10-03T10:16:54.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.438+0000 7f8b371fd700 1 -- 172.21.15.72:0/4270468234 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b30134630 msgr2=0x7f8b30136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.438+0000 7f8b371fd700 1 --2- 172.21.15.72:0/4270468234 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b30134630 0x7f8b30136a10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009870 tx=0x7f8b1c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:54.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.438+0000 7f8b371fd700 1 -- 172.21.15.72:0/4270468234 shutdown_connections 2023-10-03T10:16:54.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.438+0000 7f8b371fd700 1 --2- 172.21.15.72:0/4270468234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b30136f50 0x7f8b30139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.438+0000 7f8b371fd700 1 --2- 172.21.15.72:0/4270468234 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b30134630 0x7f8b30136a10 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.438+0000 7f8b371fd700 1 -- 172.21.15.72:0/4270468234 >> 172.21.15.72:0/4270468234 conn(0x7f8b300a2aa0 msgr2=0x7f8b300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.438+0000 7f8b371fd700 1 -- 172.21.15.72:0/4270468234 shutdown_connections 2023-10-03T10:16:54.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.438+0000 7f8b371fd700 1 -- 172.21.15.72:0/4270468234 wait complete. 2023-10-03T10:16:54.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.439+0000 7f8b371fd700 1 Processor -- start 2023-10-03T10:16:54.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.439+0000 7f8b371fd700 1 -- start start 2023-10-03T10:16:54.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.440+0000 7f8b371fd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b30131810 0x7f8b3006feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.440+0000 7f8b371fd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b30134630 0x7f8b300703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.440+0000 7f8b371fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b30136f50 0x7f8b301c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.440+0000 7f8b371fd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3011e720 con 0x7f8b30134630 2023-10-03T10:16:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.440+0000 7f8b371fd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3011e170 con 0x7f8b30136f50 2023-10-03T10:16:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.440+0000 7f8b371fd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3011e900 con 0x7f8b30131810 2023-10-03T10:16:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.440+0000 7f8b34f99700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b30131810 0x7f8b3006feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.440+0000 7f8b2ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b30134630 0x7f8b300703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.440+0000 7f8b34f99700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b30131810 0x7f8b3006feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48724/0 (socket says 172.21.15.72:48724) 2023-10-03T10:16:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.440+0000 7f8b2ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b30134630 0x7f8b300703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52666/0 (socket says 172.21.15.72:52666) 2023-10-03T10:16:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.440+0000 7f8b34f99700 1 -- 172.21.15.72:0/3930715366 learned_addr learned my addr 172.21.15.72:0/3930715366 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.440+0000 7f8b3579a700 1 --2- 172.21.15.72:0/3930715366 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b30136f50 0x7f8b301c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.441+0000 7f8b2ffff700 1 -- 172.21.15.72:0/3930715366 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b30131810 msgr2=0x7f8b3006feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.441+0000 7f8b2ffff700 1 --2- 172.21.15.72:0/3930715366 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b30131810 0x7f8b3006feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.441+0000 7f8b2ffff700 1 -- 172.21.15.72:0/3930715366 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b30136f50 msgr2=0x7f8b301c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.441+0000 7f8b2ffff700 1 --2- 172.21.15.72:0/3930715366 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b30136f50 0x7f8b301c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.441+0000 7f8b2ffff700 1 -- 172.21.15.72:0/3930715366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b28009b30 con 0x7f8b30134630 2023-10-03T10:16:54.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.441+0000 7f8b2ffff700 1 --2- 172.21.15.72:0/3930715366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b30134630 0x7f8b300703f0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c016000 tx=0x7f8b1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.441+0000 7f8b2d7fa700 1 -- 172.21.15.72:0/3930715366 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c004300 con 0x7f8b30134630 2023-10-03T10:16:54.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.441+0000 7f8b2d7fa700 1 -- 172.21.15.72:0/3930715366 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c01f070 con 0x7f8b30134630 2023-10-03T10:16:54.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.441+0000 7f8b2d7fa700 1 -- 172.21.15.72:0/3930715366 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c0036a0 con 0x7f8b30134630 2023-10-03T10:16:54.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.441+0000 7f8b371fd700 1 -- 172.21.15.72:0/3930715366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1c0094a0 con 0x7f8b30134630 2023-10-03T10:16:54.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.441+0000 7f8b371fd700 1 -- 172.21.15.72:0/3930715366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b30130c40 con 0x7f8b30134630 2023-10-03T10:16:54.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.442+0000 7f8b371fd700 1 -- 172.21.15.72:0/3930715366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3006eb00 con 0x7f8b30134630 2023-10-03T10:16:54.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.442+0000 7f8b2d7fa700 1 -- 172.21.15.72:0/3930715366 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b1c021030 con 0x7f8b30134630 2023-10-03T10:16:54.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.443+0000 7f8b2d7fa700 1 -- 172.21.15.72:0/3930715366 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8b1c040c60 con 0x7f8b30134630 2023-10-03T10:16:54.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.451+0000 7f8b2d7fa700 1 -- 172.21.15.72:0/3930715366 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b1c0239c0 con 0x7f8b30134630 2023-10-03T10:16:54.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.538+0000 7fc5bb747700 1 -- 172.21.15.72:0/441300491 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc5b4074ea0 con 0x7fc5b409d6f0 2023-10-03T10:16:54.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.539+0000 7fc5a9ffb700 1 -- 172.21.15.72:0/441300491 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5b0017020 con 0x7fc5b409d6f0 2023-10-03T10:16:54.539 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:54.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.541+0000 7fc5bb747700 1 -- 172.21.15.72:0/441300491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5b409d6f0 msgr2=0x7fc5b41c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.541+0000 7fc5bb747700 1 --2- 172.21.15.72:0/441300491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5b409d6f0 0x7fc5b41c84a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000ebe0 tx=0x7fc5b000eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.541+0000 7fc5bb747700 1 -- 172.21.15.72:0/441300491 shutdown_connections 2023-10-03T10:16:54.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.541+0000 7fc5bb747700 1 --2- 172.21.15.72:0/441300491 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5b409e410 0x7fc5b41c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.541+0000 7fc5bb747700 1 --2- 172.21.15.72:0/441300491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5b409d6f0 0x7fc5b41c84a0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.541+0000 7fc5bb747700 1 --2- 172.21.15.72:0/441300491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5b409e000 0x7fc5b41c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.541+0000 7fc5bb747700 1 -- 172.21.15.72:0/441300491 >> 172.21.15.72:0/441300491 conn(0x7fc5b4066f50 msgr2=0x7fc5b40a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.541+0000 7fc5bb747700 1 -- 172.21.15.72:0/441300491 shutdown_connections 2023-10-03T10:16:54.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.541+0000 7fc5bb747700 1 -- 172.21.15.72:0/441300491 wait complete. 2023-10-03T10:16:54.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:54.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.637+0000 7f2a7cfa2700 1 -- 172.21.15.72:0/404365180 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2a7804f2a0 con 0x7f2a7809e670 2023-10-03T10:16:54.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.637+0000 7f2a5ffff700 1 -- 172.21.15.72:0/404365180 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2a68044060 con 0x7f2a7809e670 2023-10-03T10:16:54.638 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:54.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.639+0000 7f2a7cfa2700 1 -- 172.21.15.72:0/404365180 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a7809e670 msgr2=0x7f2a781c8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.639+0000 7f2a7cfa2700 1 --2- 172.21.15.72:0/404365180 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a7809e670 0x7f2a781c8430 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800c450 tx=0x7f2a6800c760 comp rx=0 tx=0).stop 2023-10-03T10:16:54.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.639+0000 7f2a7cfa2700 1 -- 172.21.15.72:0/404365180 shutdown_connections 2023-10-03T10:16:54.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.639+0000 7f2a7cfa2700 1 --2- 172.21.15.72:0/404365180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a78136dd0 0x7f2a7806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.639+0000 7f2a7cfa2700 1 --2- 172.21.15.72:0/404365180 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a7809e670 0x7f2a781c8430 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.639+0000 7f2a7cfa2700 1 --2- 172.21.15.72:0/404365180 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a7809f150 0x7f2a781c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.639+0000 7f2a7cfa2700 1 -- 172.21.15.72:0/404365180 >> 172.21.15.72:0/404365180 conn(0x7f2a780a0c90 msgr2=0x7f2a780a2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.639+0000 7f2a7cfa2700 1 -- 172.21.15.72:0/404365180 shutdown_connections 2023-10-03T10:16:54.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.639+0000 7f2a7cfa2700 1 -- 172.21.15.72:0/404365180 wait complete. 2023-10-03T10:16:54.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.644+0000 7f8b371fd700 1 -- 172.21.15.72:0/3930715366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8b30074ea0 con 0x7f8b30134630 2023-10-03T10:16:54.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.644+0000 7f8b2d7fa700 1 -- 172.21.15.72:0/3930715366 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8b1c015070 con 0x7f8b30134630 2023-10-03T10:16:54.645 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:54.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.646+0000 7f8b371fd700 1 -- 172.21.15.72:0/3930715366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b30134630 msgr2=0x7f8b300703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.646+0000 7f8b371fd700 1 --2- 172.21.15.72:0/3930715366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b30134630 0x7f8b300703f0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c016000 tx=0x7f8b1c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:54.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.647+0000 7f8b371fd700 1 -- 172.21.15.72:0/3930715366 shutdown_connections 2023-10-03T10:16:54.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.647+0000 7f8b371fd700 1 --2- 172.21.15.72:0/3930715366 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8b30136f50 0x7f8b301c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.647+0000 7f8b371fd700 1 --2- 172.21.15.72:0/3930715366 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8b30131810 0x7f8b3006feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.647+0000 7f8b371fd700 1 --2- 172.21.15.72:0/3930715366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b30134630 0x7f8b300703f0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.647+0000 7f8b371fd700 1 -- 172.21.15.72:0/3930715366 >> 172.21.15.72:0/3930715366 conn(0x7f8b300a2aa0 msgr2=0x7f8b301330f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.647+0000 7f8b371fd700 1 -- 172.21.15.72:0/3930715366 shutdown_connections 2023-10-03T10:16:54.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.647+0000 7f8b371fd700 1 -- 172.21.15.72:0/3930715366 wait complete. 2023-10-03T10:16:54.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:54.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:54.728 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:54.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.849+0000 7fcf49349700 1 Processor -- start 2023-10-03T10:16:54.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.849+0000 7fcf49349700 1 -- start start 2023-10-03T10:16:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf49349700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf44131810 0x7fcf44131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf49349700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf4409a580 0x7fcf44139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf49349700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf441313c0 con 0x7fcf44099a40 2023-10-03T10:16:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf49349700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4409b580 con 0x7fcf4409a580 2023-10-03T10:16:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf49349700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4406e8c0 con 0x7fcf44131810 2023-10-03T10:16:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf42ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf44131810 0x7fcf44131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf427fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcf44099a40 0x7fcf44099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34628/0 (socket says 172.21.15.72:34628) 2023-10-03T10:16:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf427fc700 1 -- 172.21.15.72:0/3195545502 learned_addr learned my addr 172.21.15.72:0/3195545502 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf437fe700 1 --2- 172.21.15.72:0/3195545502 >> v2:172.21.15.72:3300/0 conn(0x7fcf4409a580 0x7fcf44139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf437fe700 1 -- 172.21.15.72:0/3195545502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf44131810 msgr2=0x7fcf44131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf437fe700 1 --2- 172.21.15.72:0/3195545502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf44131810 0x7fcf44131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf437fe700 1 -- 172.21.15.72:0/3195545502 >> v1:172.21.15.72:6789/0 conn(0x7fcf44099a40 legacy=0x7fcf44099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf437fe700 1 -- 172.21.15.72:0/3195545502 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf44071d20 con 0x7fcf4409a580 2023-10-03T10:16:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf42ffd700 1 --2- 172.21.15.72:0/3195545502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf44131810 0x7fcf44131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf437fe700 1 --2- 172.21.15.72:0/3195545502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409a580 0x7fcf44139660 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009d90 tx=0x7fcf3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db8a840157c1179 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf41ffb700 1 -- 172.21.15.72:0/3195545502 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00e070 con 0x7fcf4409a580 2023-10-03T10:16:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.850+0000 7fcf41ffb700 1 -- 172.21.15.72:0/3195545502 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c00bb20 con 0x7fcf4409a580 2023-10-03T10:16:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.851+0000 7fcf41ffb700 1 -- 172.21.15.72:0/3195545502 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c012430 con 0x7fcf4409a580 2023-10-03T10:16:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.851+0000 7fcf49349700 1 -- 172.21.15.72:0/3195545502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409a580 msgr2=0x7fcf44139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.851+0000 7fcf49349700 1 --2- 172.21.15.72:0/3195545502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409a580 0x7fcf44139660 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009d90 tx=0x7fcf3c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.851+0000 7fcf49349700 1 -- 172.21.15.72:0/3195545502 shutdown_connections 2023-10-03T10:16:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.851+0000 7fcf49349700 1 --2- 172.21.15.72:0/3195545502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409a580 0x7fcf44139660 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.851+0000 7fcf49349700 1 --2- 172.21.15.72:0/3195545502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf44131810 0x7fcf44131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.851+0000 7fcf49349700 1 -- 172.21.15.72:0/3195545502 >> 172.21.15.72:0/3195545502 conn(0x7fcf440a2aa0 msgr2=0x7fcf440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:54.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.851+0000 7fcf49349700 1 -- 172.21.15.72:0/3195545502 shutdown_connections 2023-10-03T10:16:54.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.851+0000 7fcf49349700 1 -- 172.21.15.72:0/3195545502 wait complete. 2023-10-03T10:16:54.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.852+0000 7fcf49349700 1 Processor -- start 2023-10-03T10:16:54.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.852+0000 7fcf49349700 1 -- start start 2023-10-03T10:16:54.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf49349700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf44099a40 0x7fcf4406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf49349700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409a580 0x7fcf4406fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf49349700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf44131810 0x7fcf44070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:54.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf49349700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44070ae0 con 0x7fcf4409a580 2023-10-03T10:16:54.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf49349700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4411fe10 con 0x7fcf44131810 2023-10-03T10:16:54.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf49349700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44120ee0 con 0x7fcf44099a40 2023-10-03T10:16:54.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf42ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf44099a40 0x7fcf4406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf437fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf44131810 0x7fcf44070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf427fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409a580 0x7fcf4406fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf42ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf44099a40 0x7fcf4406f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48726/0 (socket says 172.21.15.72:48726) 2023-10-03T10:16:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf42ffd700 1 -- 172.21.15.72:0/2922259744 learned_addr learned my addr 172.21.15.72:0/2922259744 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf437fe700 1 -- 172.21.15.72:0/2922259744 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf44099a40 msgr2=0x7fcf4406f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf437fe700 1 --2- 172.21.15.72:0/2922259744 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf44099a40 0x7fcf4406f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf437fe700 1 -- 172.21.15.72:0/2922259744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409a580 msgr2=0x7fcf4406fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf437fe700 1 --2- 172.21.15.72:0/2922259744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409a580 0x7fcf4406fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:54.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf437fe700 1 -- 172.21.15.72:0/2922259744 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf380094a0 con 0x7fcf44131810 2023-10-03T10:16:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf437fe700 1 --2- 172.21.15.72:0/2922259744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf44131810 0x7fcf44070090 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcf4409aa20 tx=0x7fcf3c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf2b7fe700 1 -- 172.21.15.72:0/2922259744 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c012430 con 0x7fcf44131810 2023-10-03T10:16:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf2b7fe700 1 -- 172.21.15.72:0/2922259744 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c020070 con 0x7fcf44131810 2023-10-03T10:16:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf49349700 1 -- 172.21.15.72:0/2922259744 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c009a70 con 0x7fcf44131810 2023-10-03T10:16:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf2b7fe700 1 -- 172.21.15.72:0/2922259744 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c004280 con 0x7fcf44131810 2023-10-03T10:16:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.853+0000 7fcf49349700 1 -- 172.21.15.72:0/2922259744 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf44072250 con 0x7fcf44131810 2023-10-03T10:16:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.854+0000 7fcf2b7fe700 1 -- 172.21.15.72:0/2922259744 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf3c0043e0 con 0x7fcf44131810 2023-10-03T10:16:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.854+0000 7fcf2b7fe700 1 -- 172.21.15.72:0/2922259744 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcf3c022070 con 0x7fcf44131810 2023-10-03T10:16:54.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.854+0000 7fcf49349700 1 -- 172.21.15.72:0/2922259744 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf44074ea0 con 0x7fcf44131810 2023-10-03T10:16:54.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:54.859+0000 7fcf2b7fe700 1 -- 172.21.15.72:0/2922259744 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf3c01b400 con 0x7fcf44131810 2023-10-03T10:16:55.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.042+0000 7fcf49349700 1 -- 172.21.15.72:0/2922259744 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcf4406b9e0 con 0x7fcf44131810 2023-10-03T10:16:55.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.043+0000 7fcf2b7fe700 1 -- 172.21.15.72:0/2922259744 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf3c02c020 con 0x7fcf44131810 2023-10-03T10:16:55.043 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:55.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.044+0000 7fcf49349700 1 -- 172.21.15.72:0/2922259744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf44131810 msgr2=0x7fcf44070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.044+0000 7fcf49349700 1 --2- 172.21.15.72:0/2922259744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf44131810 0x7fcf44070090 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcf4409aa20 tx=0x7fcf3c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.044+0000 7fcf49349700 1 -- 172.21.15.72:0/2922259744 shutdown_connections 2023-10-03T10:16:55.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.044+0000 7fcf49349700 1 --2- 172.21.15.72:0/2922259744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf44131810 0x7fcf44070090 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.044+0000 7fcf49349700 1 --2- 172.21.15.72:0/2922259744 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcf44099a40 0x7fcf4406f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.044+0000 7fcf49349700 1 --2- 172.21.15.72:0/2922259744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf4409a580 0x7fcf4406fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.044+0000 7fcf49349700 1 -- 172.21.15.72:0/2922259744 >> 172.21.15.72:0/2922259744 conn(0x7fcf440a2aa0 msgr2=0x7fcf441b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.045+0000 7fcf49349700 1 -- 172.21.15.72:0/2922259744 shutdown_connections 2023-10-03T10:16:55.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.045+0000 7fcf49349700 1 -- 172.21.15.72:0/2922259744 wait complete. 2023-10-03T10:16:55.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:55.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:55.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:55.663 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:55.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.683+0000 7f0a5c0df700 1 Processor -- start 2023-10-03T10:16:55.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.684+0000 7f0a5c0df700 1 -- start start 2023-10-03T10:16:55.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.684+0000 7f0a5c0df700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a54133540 0x7f0a54135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.684+0000 7f0a5c0df700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a54135e60 0x7f0a54138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.684+0000 7f0a5c0df700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a540716a0 con 0x7f0a54130540 2023-10-03T10:16:55.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.684+0000 7f0a5c0df700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a54071290 con 0x7f0a54133540 2023-10-03T10:16:55.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.684+0000 7f0a5c0df700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a54130340 con 0x7f0a54135e60 2023-10-03T10:16:55.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.684+0000 7f0a5967a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a54133540 0x7f0a54135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.684+0000 7f0a5a67c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a54135e60 0x7f0a54138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.684+0000 7f0a5967a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a54133540 0x7f0a54135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52686/0 (socket says 172.21.15.72:52686) 2023-10-03T10:16:55.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.684+0000 7f0a5967a700 1 -- 172.21.15.72:0/2519049352 learned_addr learned my addr 172.21.15.72:0/2519049352 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:55.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.684+0000 7f0a5967a700 1 -- 172.21.15.72:0/2519049352 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a54135e60 msgr2=0x7f0a54138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.684+0000 7f0a5967a700 1 --2- 172.21.15.72:0/2519049352 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a54135e60 0x7f0a54138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.684+0000 7f0a5967a700 1 -- 172.21.15.72:0/2519049352 >> v1:172.21.15.72:6789/0 conn(0x7f0a54130540 legacy=0x7f0a54130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.684+0000 7f0a5967a700 1 -- 172.21.15.72:0/2519049352 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a54070b80 con 0x7f0a54133540 2023-10-03T10:16:55.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.685+0000 7f0a5967a700 1 --2- 172.21.15.72:0/2519049352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a54133540 0x7f0a54135920 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f0a440098f0 tx=0x7f0a44009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbccbaceacc90cba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.685+0000 7f0a58e79700 1 -- 172.21.15.72:0/2519049352 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a44011830 con 0x7f0a54133540 2023-10-03T10:16:55.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.685+0000 7f0a58e79700 1 -- 172.21.15.72:0/2519049352 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a44011990 con 0x7f0a54133540 2023-10-03T10:16:55.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.685+0000 7f0a58e79700 1 -- 172.21.15.72:0/2519049352 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a44011d20 con 0x7f0a54133540 2023-10-03T10:16:55.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.685+0000 7f0a5c0df700 1 -- 172.21.15.72:0/2519049352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a54133540 msgr2=0x7f0a54135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.685+0000 7f0a5c0df700 1 --2- 172.21.15.72:0/2519049352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a54133540 0x7f0a54135920 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f0a440098f0 tx=0x7f0a44009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:55.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.685+0000 7f0a5c0df700 1 -- 172.21.15.72:0/2519049352 shutdown_connections 2023-10-03T10:16:55.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.685+0000 7f0a5c0df700 1 --2- 172.21.15.72:0/2519049352 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a54135e60 0x7f0a54138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.686+0000 7f0a5c0df700 1 --2- 172.21.15.72:0/2519049352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a54133540 0x7f0a54135920 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.686+0000 7f0a5c0df700 1 -- 172.21.15.72:0/2519049352 >> 172.21.15.72:0/2519049352 conn(0x7f0a540a2aa0 msgr2=0x7f0a540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.686+0000 7f0a5c0df700 1 -- 172.21.15.72:0/2519049352 shutdown_connections 2023-10-03T10:16:55.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.686+0000 7f0a5c0df700 1 -- 172.21.15.72:0/2519049352 wait complete. 2023-10-03T10:16:55.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.687+0000 7f0a5c0df700 1 Processor -- start 2023-10-03T10:16:55.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.687+0000 7f0a5c0df700 1 -- start start 2023-10-03T10:16:55.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.687+0000 7f0a5c0df700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a54130540 0x7f0a5409ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.687+0000 7f0a5c0df700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a54133540 0x7f0a5409b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.687+0000 7f0a5c0df700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a54135e60 0x7f0a541c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.687+0000 7f0a5c0df700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5409d130 con 0x7f0a54133540 2023-10-03T10:16:55.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.687+0000 7f0a5c0df700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5409ab00 con 0x7f0a54130540 2023-10-03T10:16:55.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.687+0000 7f0a5c0df700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5409dde0 con 0x7f0a54135e60 2023-10-03T10:16:55.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.687+0000 7f0a5967a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a54133540 0x7f0a5409b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.687+0000 7f0a5967a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a54133540 0x7f0a5409b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52692/0 (socket says 172.21.15.72:52692) 2023-10-03T10:16:55.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.688+0000 7f0a5967a700 1 -- 172.21.15.72:0/2000361967 learned_addr learned my addr 172.21.15.72:0/2000361967 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:55.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.688+0000 7f0a59e7b700 1 --2- 172.21.15.72:0/2000361967 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a54130540 0x7f0a5409ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.688+0000 7f0a5a67c700 1 --2- 172.21.15.72:0/2000361967 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a54135e60 0x7f0a541c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.688+0000 7f0a5967a700 1 -- 172.21.15.72:0/2000361967 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a54135e60 msgr2=0x7f0a541c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.688+0000 7f0a5967a700 1 --2- 172.21.15.72:0/2000361967 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a54135e60 0x7f0a541c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.688+0000 7f0a5967a700 1 -- 172.21.15.72:0/2000361967 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a54130540 msgr2=0x7f0a5409ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.688+0000 7f0a5967a700 1 --2- 172.21.15.72:0/2000361967 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a54130540 0x7f0a5409ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.688+0000 7f0a5967a700 1 -- 172.21.15.72:0/2000361967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a44009550 con 0x7f0a54133540 2023-10-03T10:16:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.688+0000 7f0a59e7b700 1 --2- 172.21.15.72:0/2000361967 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a54130540 0x7f0a5409ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.688+0000 7f0a5967a700 1 --2- 172.21.15.72:0/2000361967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a54133540 0x7f0a5409b2b0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f0a44000c00 tx=0x7f0a44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.688+0000 7f0a4a7fc700 1 -- 172.21.15.72:0/2000361967 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a440036a0 con 0x7f0a54133540 2023-10-03T10:16:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.688+0000 7f0a4a7fc700 1 -- 172.21.15.72:0/2000361967 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a44003800 con 0x7f0a54133540 2023-10-03T10:16:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.688+0000 7f0a5c0df700 1 -- 172.21.15.72:0/2000361967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5409c1b0 con 0x7f0a54133540 2023-10-03T10:16:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.688+0000 7f0a4a7fc700 1 -- 172.21.15.72:0/2000361967 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a44003bb0 con 0x7f0a54133540 2023-10-03T10:16:55.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.688+0000 7f0a5c0df700 1 -- 172.21.15.72:0/2000361967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a540718e0 con 0x7f0a54133540 2023-10-03T10:16:55.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.689+0000 7f0a4a7fc700 1 -- 172.21.15.72:0/2000361967 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a44021070 con 0x7f0a54133540 2023-10-03T10:16:55.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.689+0000 7f0a4a7fc700 1 -- 172.21.15.72:0/2000361967 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0a44040a70 con 0x7f0a54133540 2023-10-03T10:16:55.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.689+0000 7f0a5c0df700 1 -- 172.21.15.72:0/2000361967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a5412bbd0 con 0x7f0a54133540 2023-10-03T10:16:55.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.695+0000 7f0a4a7fc700 1 -- 172.21.15.72:0/2000361967 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a44015020 con 0x7f0a54133540 2023-10-03T10:16:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.782+0000 7f4b7ec19700 1 Processor -- start 2023-10-03T10:16:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.782+0000 7f4b7ec19700 1 -- start start 2023-10-03T10:16:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.782+0000 7f4b7ec19700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b7806a770 0x7f4b7806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.782+0000 7f4b7ec19700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b7806b080 0x7f4b78131630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b7ec19700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b78131b70 0x7f4b78131fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b7ec19700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7809ec80 con 0x7f4b7806b080 2023-10-03T10:16:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b7ec19700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7809e210 con 0x7f4b78131b70 2023-10-03T10:16:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b7ec19700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7809ee60 con 0x7f4b7806a770 2023-10-03T10:16:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b7c9b5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b7806a770 0x7f4b7806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b7c9b5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b7806a770 0x7f4b7806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48740/0 (socket says 172.21.15.72:48740) 2023-10-03T10:16:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b77fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b7806b080 0x7f4b78131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b7c9b5700 1 -- 172.21.15.72:0/1861007643 learned_addr learned my addr 172.21.15.72:0/1861007643 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b7d1b6700 1 --2- 172.21.15.72:0/1861007643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b78131b70 0x7f4b78131fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b7c9b5700 1 -- 172.21.15.72:0/1861007643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b78131b70 msgr2=0x7f4b78131fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b7c9b5700 1 --2- 172.21.15.72:0/1861007643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b78131b70 0x7f4b78131fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b7c9b5700 1 -- 172.21.15.72:0/1861007643 >> v2:172.21.15.72:3300/0 conn(0x7f4b7806b080 msgr2=0x7f4b78131630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b7c9b5700 1 --2- 172.21.15.72:0/1861007643 >> v2:172.21.15.72:3300/0 conn(0x7f4b7806b080 0x7f4b78131630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b7c9b5700 1 -- 172.21.15.72:0/1861007643 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7809d760 con 0x7f4b7806a770 2023-10-03T10:16:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b77fff700 1 --2- 172.21.15.72:0/1861007643 >> v2:172.21.15.72:3300/0 conn(0x7f4b7806b080 0x7f4b78131630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b7c9b5700 1 --2- 172.21.15.72:0/1861007643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b7806a770 0x7f4b7806ab40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009920 tx=0x7f4b6c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fad229608bf02acf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b777fe700 1 -- 172.21.15.72:0/1861007643 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c011830 con 0x7f4b7806a770 2023-10-03T10:16:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b777fe700 1 -- 172.21.15.72:0/1861007643 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c011990 con 0x7f4b7806a770 2023-10-03T10:16:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.783+0000 7f4b777fe700 1 -- 172.21.15.72:0/1861007643 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c011d20 con 0x7f4b7806a770 2023-10-03T10:16:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.784+0000 7f4b7ec19700 1 -- 172.21.15.72:0/1861007643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b7806a770 msgr2=0x7f4b7806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.784+0000 7f4b7ec19700 1 --2- 172.21.15.72:0/1861007643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b7806a770 0x7f4b7806ab40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009920 tx=0x7f4b6c009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.784+0000 7f4b7ec19700 1 -- 172.21.15.72:0/1861007643 shutdown_connections 2023-10-03T10:16:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.784+0000 7f4b7ec19700 1 --2- 172.21.15.72:0/1861007643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b78131b70 0x7f4b78131fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.784+0000 7f4b7ec19700 1 --2- 172.21.15.72:0/1861007643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b7806a770 0x7f4b7806ab40 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.784+0000 7f4b7ec19700 1 --2- 172.21.15.72:0/1861007643 >> v2:172.21.15.72:3300/0 conn(0x7f4b7806b080 0x7f4b78131630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.784+0000 7f4b7ec19700 1 -- 172.21.15.72:0/1861007643 >> 172.21.15.72:0/1861007643 conn(0x7f4b78066f50 msgr2=0x7f4b780a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.784+0000 7f4b7ec19700 1 -- 172.21.15.72:0/1861007643 shutdown_connections 2023-10-03T10:16:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.784+0000 7f4b7ec19700 1 -- 172.21.15.72:0/1861007643 wait complete. 2023-10-03T10:16:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.785+0000 7f4b7ec19700 1 Processor -- start 2023-10-03T10:16:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.785+0000 7f4b7ec19700 1 -- start start 2023-10-03T10:16:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.786+0000 7f4b7ec19700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b7806a770 0x7f4b781194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.786+0000 7f4b7ec19700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b7806b080 0x7f4b781199f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.786+0000 7f4b7ec19700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b78131b70 0x7f4b78119f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.786+0000 7f4b7ec19700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7811c1f0 con 0x7f4b7806a770 2023-10-03T10:16:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.786+0000 7f4b7ec19700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78071f40 con 0x7f4b7806b080 2023-10-03T10:16:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.786+0000 7f4b7ec19700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7811ab10 con 0x7f4b78131b70 2023-10-03T10:16:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.786+0000 7f4b7c9b5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b7806a770 0x7f4b781194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.786+0000 7f4b77fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b7806b080 0x7f4b781199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.786+0000 7f4b7c9b5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b7806a770 0x7f4b781194b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52702/0 (socket says 172.21.15.72:52702) 2023-10-03T10:16:55.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.786+0000 7f4b7c9b5700 1 -- 172.21.15.72:0/2545248576 learned_addr learned my addr 172.21.15.72:0/2545248576 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:55.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.786+0000 7f4b77fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b7806b080 0x7f4b781199f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:32996/0 (socket says 172.21.15.72:32996) 2023-10-03T10:16:55.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.786+0000 7f4b7d1b6700 1 --2- 172.21.15.72:0/2545248576 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b78131b70 0x7f4b78119f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.787+0000 7f4b77fff700 1 -- 172.21.15.72:0/2545248576 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b78131b70 msgr2=0x7f4b78119f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.787+0000 7f4b77fff700 1 --2- 172.21.15.72:0/2545248576 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b78131b70 0x7f4b78119f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.787+0000 7f4b77fff700 1 -- 172.21.15.72:0/2545248576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b7806a770 msgr2=0x7f4b781194b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.787+0000 7f4b77fff700 1 --2- 172.21.15.72:0/2545248576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b7806a770 0x7f4b781194b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.787+0000 7f4b77fff700 1 -- 172.21.15.72:0/2545248576 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6400d8d0 con 0x7f4b7806b080 2023-10-03T10:16:55.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.787+0000 7f4b77fff700 1 --2- 172.21.15.72:0/2545248576 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b7806b080 0x7f4b781199f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4b64012c10 tx=0x7f4b64012f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.787+0000 7f4b757fa700 1 -- 172.21.15.72:0/2545248576 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b64005c20 con 0x7f4b7806b080 2023-10-03T10:16:55.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.787+0000 7f4b757fa700 1 -- 172.21.15.72:0/2545248576 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b64013040 con 0x7f4b7806b080 2023-10-03T10:16:55.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.787+0000 7f4b7ec19700 1 -- 172.21.15.72:0/2545248576 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6c009550 con 0x7f4b7806b080 2023-10-03T10:16:55.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.787+0000 7f4b757fa700 1 -- 172.21.15.72:0/2545248576 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6400d2e0 con 0x7f4b7806b080 2023-10-03T10:16:55.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.787+0000 7f4b7ec19700 1 -- 172.21.15.72:0/2545248576 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b780a0f50 con 0x7f4b7806b080 2023-10-03T10:16:55.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.788+0000 7f4b757fa700 1 -- 172.21.15.72:0/2545248576 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b64010670 con 0x7f4b7806b080 2023-10-03T10:16:55.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.788+0000 7f4b757fa700 1 -- 172.21.15.72:0/2545248576 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b64043200 con 0x7f4b7806b080 2023-10-03T10:16:55.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.788+0000 7f4b7ec19700 1 -- 172.21.15.72:0/2545248576 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7811c600 con 0x7f4b7806b080 2023-10-03T10:16:55.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.793+0000 7f4b757fa700 1 -- 172.21.15.72:0/2545248576 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b64006030 con 0x7f4b7806b080 2023-10-03T10:16:55.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.811+0000 7f2b70d20700 1 Processor -- start 2023-10-03T10:16:55.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.811+0000 7f2b70d20700 1 -- start start 2023-10-03T10:16:55.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.812+0000 7f2b70d20700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2b6c09f410 0x7f2b6c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.812+0000 7f2b70d20700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b6c136fe0 0x7f2b6c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.812+0000 7f2b70d20700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6c070940 con 0x7f2b6c09e930 2023-10-03T10:16:55.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.812+0000 7f2b70d20700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6c06fd60 con 0x7f2b6c136fe0 2023-10-03T10:16:55.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.812+0000 7f2b70d20700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c06fa80 con 0x7f2b6c09f410 2023-10-03T10:16:55.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.812+0000 7f2b6ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b6c136fe0 0x7f2b6c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.812+0000 7f2b69d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2b6c09f410 0x7f2b6c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.812+0000 7f2b6a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2b6c09e930 0x7f2b6c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34646/0 (socket says 172.21.15.72:34646) 2023-10-03T10:16:55.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.812+0000 7f2b6a59c700 1 -- 172.21.15.72:0/3593152968 learned_addr learned my addr 172.21.15.72:0/3593152968 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:55.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.812+0000 7f2b6ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b6c136fe0 0x7f2b6c1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52712/0 (socket says 172.21.15.72:52712) 2023-10-03T10:16:55.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.813+0000 7f2b6ad9d700 1 -- 172.21.15.72:0/3593152968 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2b6c09f410 msgr2=0x7f2b6c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.813+0000 7f2b6ad9d700 1 --2- 172.21.15.72:0/3593152968 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2b6c09f410 0x7f2b6c136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.813+0000 7f2b6ad9d700 1 -- 172.21.15.72:0/3593152968 >> v1:172.21.15.72:6789/0 conn(0x7f2b6c09e930 legacy=0x7f2b6c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.813+0000 7f2b6ad9d700 1 -- 172.21.15.72:0/3593152968 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c09fb60 con 0x7f2b6c136fe0 2023-10-03T10:16:55.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.813+0000 7f2b6959a700 1 -- 172.21.15.72:0/3593152968 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529871553 0 0) 0x7f2b6c070940 con 0x7f2b6c09e930 2023-10-03T10:16:55.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.813+0000 7f2b69d9b700 1 --2- 172.21.15.72:0/3593152968 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2b6c09f410 0x7f2b6c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.813+0000 7f2b6ad9d700 1 --2- 172.21.15.72:0/3593152968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6c136fe0 0x7f2b6c1393c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009d90 tx=0x7f2b6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46ec330d5e9456f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.813+0000 7f2b6959a700 1 -- 172.21.15.72:0/3593152968 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400e070 con 0x7f2b6c136fe0 2023-10-03T10:16:55.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.813+0000 7f2b6959a700 1 -- 172.21.15.72:0/3593152968 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6400bb20 con 0x7f2b6c136fe0 2023-10-03T10:16:55.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.813+0000 7f2b6959a700 1 -- 172.21.15.72:0/3593152968 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64012430 con 0x7f2b6c136fe0 2023-10-03T10:16:55.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.813+0000 7f2b70d20700 1 -- 172.21.15.72:0/3593152968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6c136fe0 msgr2=0x7f2b6c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.813+0000 7f2b70d20700 1 --2- 172.21.15.72:0/3593152968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6c136fe0 0x7f2b6c1393c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009d90 tx=0x7f2b6400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:55.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.814+0000 7f2b70d20700 1 -- 172.21.15.72:0/3593152968 shutdown_connections 2023-10-03T10:16:55.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.814+0000 7f2b70d20700 1 --2- 172.21.15.72:0/3593152968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6c136fe0 0x7f2b6c1393c0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.814+0000 7f2b70d20700 1 --2- 172.21.15.72:0/3593152968 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2b6c09f410 0x7f2b6c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.814+0000 7f2b70d20700 1 -- 172.21.15.72:0/3593152968 >> 172.21.15.72:0/3593152968 conn(0x7f2b6c0a4210 msgr2=0x7f2b6c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.814+0000 7f2b70d20700 1 -- 172.21.15.72:0/3593152968 shutdown_connections 2023-10-03T10:16:55.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.814+0000 7f2b70d20700 1 -- 172.21.15.72:0/3593152968 wait complete. 2023-10-03T10:16:55.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.815+0000 7f2b70d20700 1 Processor -- start 2023-10-03T10:16:55.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.815+0000 7f2b70d20700 1 -- start start 2023-10-03T10:16:55.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.815+0000 7f2b70d20700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b6c09e930 0x7f2b6c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.815+0000 7f2b70d20700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2b6c09f410 0x7f2b6c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.815+0000 7f2b70d20700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6c136fe0 0x7f2b6c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.815+0000 7f2b70d20700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c123e20 con 0x7f2b6c136fe0 2023-10-03T10:16:55.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.815+0000 7f2b70d20700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c1341c0 con 0x7f2b6c09e930 2023-10-03T10:16:55.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.815+0000 7f2b70d20700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c09ddf0 con 0x7f2b6c09f410 2023-10-03T10:16:55.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.815+0000 7f2b69d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2b6c09f410 0x7f2b6c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.815+0000 7f2b6a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b6c09e930 0x7f2b6c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.815+0000 7f2b69d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2b6c09f410 0x7f2b6c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48766/0 (socket says 172.21.15.72:48766) 2023-10-03T10:16:55.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.815+0000 7f2b6a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b6c09e930 0x7f2b6c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33004/0 (socket says 172.21.15.72:33004) 2023-10-03T10:16:55.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.815+0000 7f2b69d9b700 1 -- 172.21.15.72:0/3372557083 learned_addr learned my addr 172.21.15.72:0/3372557083 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:55.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.815+0000 7f2b6ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6c136fe0 0x7f2b6c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.816+0000 7f2b6ad9d700 1 -- 172.21.15.72:0/3372557083 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2b6c09f410 msgr2=0x7f2b6c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.816+0000 7f2b6ad9d700 1 --2- 172.21.15.72:0/3372557083 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2b6c09f410 0x7f2b6c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.816+0000 7f2b6ad9d700 1 -- 172.21.15.72:0/3372557083 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b6c09e930 msgr2=0x7f2b6c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.816+0000 7f2b6ad9d700 1 --2- 172.21.15.72:0/3372557083 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b6c09e930 0x7f2b6c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.816+0000 7f2b6ad9d700 1 -- 172.21.15.72:0/3372557083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b600094a0 con 0x7f2b6c136fe0 2023-10-03T10:16:55.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.816+0000 7f2b6ad9d700 1 --2- 172.21.15.72:0/3372557083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6c136fe0 0x7f2b6c06c330 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f2b64016000 tx=0x7f2b64004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.816+0000 7f2b5affd700 1 -- 172.21.15.72:0/3372557083 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64012430 con 0x7f2b6c136fe0 2023-10-03T10:16:55.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.816+0000 7f2b5affd700 1 -- 172.21.15.72:0/3372557083 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b64020070 con 0x7f2b6c136fe0 2023-10-03T10:16:55.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.816+0000 7f2b5affd700 1 -- 172.21.15.72:0/3372557083 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64004280 con 0x7f2b6c136fe0 2023-10-03T10:16:55.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.816+0000 7f2b70d20700 1 -- 172.21.15.72:0/3372557083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b64009a70 con 0x7f2b6c136fe0 2023-10-03T10:16:55.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.816+0000 7f2b70d20700 1 -- 172.21.15.72:0/3372557083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6c1229e0 con 0x7f2b6c136fe0 2023-10-03T10:16:55.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.817+0000 7f2b5affd700 1 -- 172.21.15.72:0/3372557083 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b640043e0 con 0x7f2b6c136fe0 2023-10-03T10:16:55.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.817+0000 7f2b5affd700 1 -- 172.21.15.72:0/3372557083 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2b64022070 con 0x7f2b6c136fe0 2023-10-03T10:16:55.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.817+0000 7f2b70d20700 1 -- 172.21.15.72:0/3372557083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6c074ea0 con 0x7f2b6c136fe0 2023-10-03T10:16:55.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.822+0000 7f2b5affd700 1 -- 172.21.15.72:0/3372557083 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b64012e40 con 0x7f2b6c136fe0 2023-10-03T10:16:55.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.896+0000 7f0a5c0df700 1 -- 172.21.15.72:0/2000361967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0a54074ea0 con 0x7f0a54133540 2023-10-03T10:16:55.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.897+0000 7f0a4a7fc700 1 -- 172.21.15.72:0/2000361967 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a44015020 con 0x7f0a54133540 2023-10-03T10:16:55.898 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.899+0000 7f0a5c0df700 1 -- 172.21.15.72:0/2000361967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a54133540 msgr2=0x7f0a5409b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.899+0000 7f0a5c0df700 1 --2- 172.21.15.72:0/2000361967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a54133540 0x7f0a5409b2b0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f0a44000c00 tx=0x7f0a44004750 comp rx=0 tx=0).stop 2023-10-03T10:16:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.899+0000 7f0a5c0df700 1 -- 172.21.15.72:0/2000361967 shutdown_connections 2023-10-03T10:16:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.899+0000 7f0a5c0df700 1 --2- 172.21.15.72:0/2000361967 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a54135e60 0x7f0a541c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.899+0000 7f0a5c0df700 1 --2- 172.21.15.72:0/2000361967 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a54130540 0x7f0a5409ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.899+0000 7f0a5c0df700 1 --2- 172.21.15.72:0/2000361967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a54133540 0x7f0a5409b2b0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.899+0000 7f0a5c0df700 1 -- 172.21.15.72:0/2000361967 >> 172.21.15.72:0/2000361967 conn(0x7f0a540a2aa0 msgr2=0x7f0a54131320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.899+0000 7f0a5c0df700 1 -- 172.21.15.72:0/2000361967 shutdown_connections 2023-10-03T10:16:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.899+0000 7f0a5c0df700 1 -- 172.21.15.72:0/2000361967 wait complete. 2023-10-03T10:16:55.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:55.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.988+0000 7f4b7ec19700 1 -- 172.21.15.72:0/2545248576 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4b780747f0 con 0x7f4b7806b080 2023-10-03T10:16:55.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.989+0000 7f4b757fa700 1 -- 172.21.15.72:0/2545248576 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4b640213b0 con 0x7f4b7806b080 2023-10-03T10:16:55.990 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:55.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.991+0000 7f4b7ec19700 1 -- 172.21.15.72:0/2545248576 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b7806b080 msgr2=0x7f4b781199f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.991+0000 7f4b7ec19700 1 --2- 172.21.15.72:0/2545248576 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b7806b080 0x7f4b781199f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4b64012c10 tx=0x7f4b64012f20 comp rx=0 tx=0).stop 2023-10-03T10:16:55.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.991+0000 7f4b7ec19700 1 -- 172.21.15.72:0/2545248576 shutdown_connections 2023-10-03T10:16:55.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.991+0000 7f4b7ec19700 1 --2- 172.21.15.72:0/2545248576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b7806a770 0x7f4b781194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.991+0000 7f4b7ec19700 1 --2- 172.21.15.72:0/2545248576 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4b78131b70 0x7f4b78119f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.991+0000 7f4b7ec19700 1 --2- 172.21.15.72:0/2545248576 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4b7806b080 0x7f4b781199f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.991+0000 7f4b7ec19700 1 -- 172.21.15.72:0/2545248576 >> 172.21.15.72:0/2545248576 conn(0x7f4b78066f50 msgr2=0x7f4b78131010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.991+0000 7f4b7ec19700 1 -- 172.21.15.72:0/2545248576 shutdown_connections 2023-10-03T10:16:55.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:55.991+0000 7f4b7ec19700 1 -- 172.21.15.72:0/2545248576 wait complete. 2023-10-03T10:16:56.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:56.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.015+0000 7f2b70d20700 1 -- 172.21.15.72:0/3372557083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2b6c1345f0 con 0x7f2b6c136fe0 2023-10-03T10:16:56.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.016+0000 7f2b5affd700 1 -- 172.21.15.72:0/3372557083 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2b640263e0 con 0x7f2b6c136fe0 2023-10-03T10:16:56.016 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:56.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.018+0000 7f2b70d20700 1 -- 172.21.15.72:0/3372557083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6c136fe0 msgr2=0x7f2b6c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.018+0000 7f2b70d20700 1 --2- 172.21.15.72:0/3372557083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6c136fe0 0x7f2b6c06c330 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f2b64016000 tx=0x7f2b64004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.018+0000 7f2b70d20700 1 -- 172.21.15.72:0/3372557083 shutdown_connections 2023-10-03T10:16:56.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.018+0000 7f2b70d20700 1 --2- 172.21.15.72:0/3372557083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b6c136fe0 0x7f2b6c06c330 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.018+0000 7f2b70d20700 1 --2- 172.21.15.72:0/3372557083 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b6c09e930 0x7f2b6c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.018+0000 7f2b70d20700 1 --2- 172.21.15.72:0/3372557083 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2b6c09f410 0x7f2b6c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.018+0000 7f2b70d20700 1 -- 172.21.15.72:0/3372557083 >> 172.21.15.72:0/3372557083 conn(0x7f2b6c0a4210 msgr2=0x7f2b6c134890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.018+0000 7f2b70d20700 1 -- 172.21.15.72:0/3372557083 shutdown_connections 2023-10-03T10:16:56.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.018+0000 7f2b70d20700 1 -- 172.21.15.72:0/3372557083 wait complete. 2023-10-03T10:16:56.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:56.058 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:56.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.191+0000 7f23e360c700 1 Processor -- start 2023-10-03T10:16:56.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.191+0000 7f23e360c700 1 -- start start 2023-10-03T10:16:56.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.191+0000 7f23e360c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc133420 0x7f23dc1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.191+0000 7f23e360c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23dc134260 0x7f23dc1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.191+0000 7f23e360c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc06b990 con 0x7f23dc133e30 2023-10-03T10:16:56.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.191+0000 7f23e360c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23dc0a0590 con 0x7f23dc134260 2023-10-03T10:16:56.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.191+0000 7f23e360c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc09fb80 con 0x7f23dc133420 2023-10-03T10:16:56.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.191+0000 7f23e1ba9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23dc134260 0x7f23dc1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.191+0000 7f23e1ba9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23dc134260 0x7f23dc1306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52742/0 (socket says 172.21.15.72:52742) 2023-10-03T10:16:56.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.191+0000 7f23e1ba9700 1 -- 172.21.15.72:0/1798046940 learned_addr learned my addr 172.21.15.72:0/1798046940 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:56.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.191+0000 7f23e13a8700 1 --2- 172.21.15.72:0/1798046940 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc133420 0x7f23dc1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.192+0000 7f23e1ba9700 1 -- 172.21.15.72:0/1798046940 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc133420 msgr2=0x7f23dc1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.192+0000 7f23e1ba9700 1 --2- 172.21.15.72:0/1798046940 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc133420 0x7f23dc1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.192+0000 7f23e1ba9700 1 -- 172.21.15.72:0/1798046940 >> v1:172.21.15.72:6789/0 conn(0x7f23dc133e30 legacy=0x7f23dc12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.192+0000 7f23e1ba9700 1 -- 172.21.15.72:0/1798046940 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc0a0030 con 0x7f23dc134260 2023-10-03T10:16:56.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.192+0000 7f23e13a8700 1 --2- 172.21.15.72:0/1798046940 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc133420 0x7f23dc1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.192+0000 7f23e1ba9700 1 --2- 172.21.15.72:0/1798046940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc134260 0x7f23dc1306a0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009e50 tx=0x7f23d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccb15ac9eceebeb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.192+0000 7f23d3fff700 1 -- 172.21.15.72:0/1798046940 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d400e070 con 0x7f23dc134260 2023-10-03T10:16:56.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.192+0000 7f23d3fff700 1 -- 172.21.15.72:0/1798046940 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d400b910 con 0x7f23dc134260 2023-10-03T10:16:56.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.192+0000 7f23d3fff700 1 -- 172.21.15.72:0/1798046940 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d400bcc0 con 0x7f23dc134260 2023-10-03T10:16:56.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.193+0000 7f23e360c700 1 -- 172.21.15.72:0/1798046940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc134260 msgr2=0x7f23dc1306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.193+0000 7f23e360c700 1 --2- 172.21.15.72:0/1798046940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc134260 0x7f23dc1306a0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009e50 tx=0x7f23d400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:56.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.193+0000 7f23e360c700 1 -- 172.21.15.72:0/1798046940 shutdown_connections 2023-10-03T10:16:56.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.193+0000 7f23e360c700 1 --2- 172.21.15.72:0/1798046940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc134260 0x7f23dc1306a0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.193+0000 7f23e360c700 1 --2- 172.21.15.72:0/1798046940 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc133420 0x7f23dc1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.193+0000 7f23e360c700 1 -- 172.21.15.72:0/1798046940 >> 172.21.15.72:0/1798046940 conn(0x7f23dc0a4210 msgr2=0x7f23dc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.193+0000 7f23e360c700 1 -- 172.21.15.72:0/1798046940 shutdown_connections 2023-10-03T10:16:56.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.193+0000 7f23e360c700 1 -- 172.21.15.72:0/1798046940 wait complete. 2023-10-03T10:16:56.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e360c700 1 Processor -- start 2023-10-03T10:16:56.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e360c700 1 -- start start 2023-10-03T10:16:56.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e360c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc133420 0x7f23dc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e360c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc133e30 0x7f23dc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e360c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc134260 0x7f23dc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e360c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc1202f0 con 0x7f23dc134260 2023-10-03T10:16:56.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e360c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc12da20 con 0x7f23dc133e30 2023-10-03T10:16:56.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e360c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc11ff20 con 0x7f23dc133420 2023-10-03T10:16:56.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e13a8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc133420 0x7f23dc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e1ba9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc134260 0x7f23dc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e13a8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc133420 0x7f23dc09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48790/0 (socket says 172.21.15.72:48790) 2023-10-03T10:16:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e13a8700 1 -- 172.21.15.72:0/2477503805 learned_addr learned my addr 172.21.15.72:0/2477503805 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e0ba7700 1 --2- 172.21.15.72:0/2477503805 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc133e30 0x7f23dc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e13a8700 1 -- 172.21.15.72:0/2477503805 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc133e30 msgr2=0x7f23dc09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e13a8700 1 --2- 172.21.15.72:0/2477503805 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc133e30 0x7f23dc09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e13a8700 1 -- 172.21.15.72:0/2477503805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc134260 msgr2=0x7f23dc09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e13a8700 1 --2- 172.21.15.72:0/2477503805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc134260 0x7f23dc09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e13a8700 1 -- 172.21.15.72:0/2477503805 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d80094a0 con 0x7f23dc133420 2023-10-03T10:16:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.194+0000 7f23e1ba9700 1 --2- 172.21.15.72:0/2477503805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc134260 0x7f23dc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.195+0000 7f23e13a8700 1 --2- 172.21.15.72:0/2477503805 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc133420 0x7f23dc09c480 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f23d800ec10 tx=0x7f23d800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.195+0000 7f23d1ffb700 1 -- 172.21.15.72:0/2477503805 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d800c850 con 0x7f23dc133420 2023-10-03T10:16:56.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.195+0000 7f23d1ffb700 1 -- 172.21.15.72:0/2477503805 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d800c9b0 con 0x7f23dc133420 2023-10-03T10:16:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.195+0000 7f23e360c700 1 -- 172.21.15.72:0/2477503805 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d4009b30 con 0x7f23dc133420 2023-10-03T10:16:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.195+0000 7f23d1ffb700 1 -- 172.21.15.72:0/2477503805 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d800cd20 con 0x7f23dc133420 2023-10-03T10:16:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.195+0000 7f23e360c700 1 -- 172.21.15.72:0/2477503805 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23dc09ddb0 con 0x7f23dc133420 2023-10-03T10:16:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.196+0000 7f23d1ffb700 1 -- 172.21.15.72:0/2477503805 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23d8013470 con 0x7f23dc133420 2023-10-03T10:16:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.196+0000 7f23d1ffb700 1 -- 172.21.15.72:0/2477503805 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f23d803f5b0 con 0x7f23dc133420 2023-10-03T10:16:56.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.196+0000 7f23e360c700 1 -- 172.21.15.72:0/2477503805 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23dc09dd50 con 0x7f23dc133420 2023-10-03T10:16:56.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.201+0000 7f23d1ffb700 1 -- 172.21.15.72:0/2477503805 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23d800ce80 con 0x7f23dc133420 2023-10-03T10:16:56.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.387+0000 7f23e360c700 1 -- 172.21.15.72:0/2477503805 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f23dc074ea0 con 0x7f23dc133420 2023-10-03T10:16:56.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.387+0000 7f23d1ffb700 1 -- 172.21.15.72:0/2477503805 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23d801b3b0 con 0x7f23dc133420 2023-10-03T10:16:56.388 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:56.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.389+0000 7f23e360c700 1 -- 172.21.15.72:0/2477503805 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc133420 msgr2=0x7f23dc09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.389+0000 7f23e360c700 1 --2- 172.21.15.72:0/2477503805 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc133420 0x7f23dc09c480 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f23d800ec10 tx=0x7f23d800ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:56.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.389+0000 7f23e360c700 1 -- 172.21.15.72:0/2477503805 shutdown_connections 2023-10-03T10:16:56.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.389+0000 7f23e360c700 1 --2- 172.21.15.72:0/2477503805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23dc134260 0x7f23dc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.389+0000 7f23e360c700 1 --2- 172.21.15.72:0/2477503805 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23dc133420 0x7f23dc09c480 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.389+0000 7f23e360c700 1 --2- 172.21.15.72:0/2477503805 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23dc133e30 0x7f23dc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.389+0000 7f23e360c700 1 -- 172.21.15.72:0/2477503805 >> 172.21.15.72:0/2477503805 conn(0x7f23dc0a4210 msgr2=0x7f23dc0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.389+0000 7f23e360c700 1 -- 172.21.15.72:0/2477503805 shutdown_connections 2023-10-03T10:16:56.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:56.389+0000 7f23e360c700 1 -- 172.21.15.72:0/2477503805 wait complete. 2023-10-03T10:16:56.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:56.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:57.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:57.031 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:57.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.036+0000 7fac48431700 1 Processor -- start 2023-10-03T10:16:57.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.036+0000 7fac48431700 1 -- start start 2023-10-03T10:16:57.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.036+0000 7fac48431700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac400984f0 0x7fac400988c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.036+0000 7fac48431700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4009d6f0 0x7fac4009db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.036+0000 7fac48431700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac4009e040 0x7fac401385c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.036+0000 7fac48431700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac40099620 con 0x7fac400984f0 2023-10-03T10:16:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.036+0000 7fac48431700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4009aca0 con 0x7fac4009d6f0 2023-10-03T10:16:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.036+0000 7fac48431700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac4009a9e0 con 0x7fac4009e040 2023-10-03T10:16:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.036+0000 7fac469ce700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac4009e040 0x7fac401385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.036+0000 7fac469ce700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac4009e040 0x7fac401385c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48798/0 (socket says 172.21.15.72:48798) 2023-10-03T10:16:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.036+0000 7fac469ce700 1 -- 172.21.15.72:0/3695049943 learned_addr learned my addr 172.21.15.72:0/3695049943 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.036+0000 7fac459cc700 1 --2- 172.21.15.72:0/3695049943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4009d6f0 0x7fac4009db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.037+0000 7fac461cd700 1 --2- 172.21.15.72:0/3695049943 >> v2:172.21.15.72:3300/0 conn(0x7fac400984f0 0x7fac400988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.037+0000 7fac469ce700 1 -- 172.21.15.72:0/3695049943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4009d6f0 msgr2=0x7fac4009db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.037+0000 7fac469ce700 1 --2- 172.21.15.72:0/3695049943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4009d6f0 0x7fac4009db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.037+0000 7fac469ce700 1 -- 172.21.15.72:0/3695049943 >> v2:172.21.15.72:3300/0 conn(0x7fac400984f0 msgr2=0x7fac400988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.037+0000 7fac469ce700 1 --2- 172.21.15.72:0/3695049943 >> v2:172.21.15.72:3300/0 conn(0x7fac400984f0 0x7fac400988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.037+0000 7fac469ce700 1 -- 172.21.15.72:0/3695049943 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4009bce0 con 0x7fac4009e040 2023-10-03T10:16:57.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.037+0000 7fac461cd700 1 --2- 172.21.15.72:0/3695049943 >> v2:172.21.15.72:3300/0 conn(0x7fac400984f0 0x7fac400988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.037+0000 7fac469ce700 1 --2- 172.21.15.72:0/3695049943 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac4009e040 0x7fac401385c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fac38009e80 tx=0x7fac3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68a4f01a268c6919 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.037+0000 7fac451cb700 1 -- 172.21.15.72:0/3695049943 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3800e070 con 0x7fac4009e040 2023-10-03T10:16:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.037+0000 7fac451cb700 1 -- 172.21.15.72:0/3695049943 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3800b8d0 con 0x7fac4009e040 2023-10-03T10:16:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.037+0000 7fac451cb700 1 -- 172.21.15.72:0/3695049943 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3800bc80 con 0x7fac4009e040 2023-10-03T10:16:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.038+0000 7fac48431700 1 -- 172.21.15.72:0/3695049943 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac4009e040 msgr2=0x7fac401385c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.038+0000 7fac48431700 1 --2- 172.21.15.72:0/3695049943 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac4009e040 0x7fac401385c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fac38009e80 tx=0x7fac3800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.038+0000 7fac48431700 1 -- 172.21.15.72:0/3695049943 shutdown_connections 2023-10-03T10:16:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.038+0000 7fac48431700 1 --2- 172.21.15.72:0/3695049943 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac4009e040 0x7fac401385c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.038+0000 7fac48431700 1 --2- 172.21.15.72:0/3695049943 >> v2:172.21.15.72:3300/0 conn(0x7fac400984f0 0x7fac400988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.038+0000 7fac48431700 1 --2- 172.21.15.72:0/3695049943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4009d6f0 0x7fac4009db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.038+0000 7fac48431700 1 -- 172.21.15.72:0/3695049943 >> 172.21.15.72:0/3695049943 conn(0x7fac4009f470 msgr2=0x7fac400a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.038+0000 7fac48431700 1 -- 172.21.15.72:0/3695049943 shutdown_connections 2023-10-03T10:16:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.038+0000 7fac48431700 1 -- 172.21.15.72:0/3695049943 wait complete. 2023-10-03T10:16:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.039+0000 7fac48431700 1 Processor -- start 2023-10-03T10:16:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.039+0000 7fac48431700 1 -- start start 2023-10-03T10:16:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.039+0000 7fac48431700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac400984f0 0x7fac4012d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.039+0000 7fac48431700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac4009d6f0 0x7fac4012d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.039+0000 7fac48431700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4009e040 0x7fac4012daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.039+0000 7fac48431700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4012c200 con 0x7fac4009d6f0 2023-10-03T10:16:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.039+0000 7fac48431700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4012a530 con 0x7fac4009e040 2023-10-03T10:16:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.039+0000 7fac48431700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac4009a2b0 con 0x7fac400984f0 2023-10-03T10:16:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.039+0000 7fac461cd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac400984f0 0x7fac4012d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.039+0000 7fac461cd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac400984f0 0x7fac4012d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48814/0 (socket says 172.21.15.72:48814) 2023-10-03T10:16:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.039+0000 7fac461cd700 1 -- 172.21.15.72:0/2664157020 learned_addr learned my addr 172.21.15.72:0/2664157020 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.039+0000 7fac459cc700 1 --2- 172.21.15.72:0/2664157020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac4009d6f0 0x7fac4012d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.039+0000 7fac469ce700 1 --2- 172.21.15.72:0/2664157020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4009e040 0x7fac4012daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.040+0000 7fac461cd700 1 -- 172.21.15.72:0/2664157020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4009e040 msgr2=0x7fac4012daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.040+0000 7fac461cd700 1 --2- 172.21.15.72:0/2664157020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4009e040 0x7fac4012daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.040+0000 7fac461cd700 1 -- 172.21.15.72:0/2664157020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac4009d6f0 msgr2=0x7fac4012d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.040+0000 7fac461cd700 1 --2- 172.21.15.72:0/2664157020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac4009d6f0 0x7fac4012d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.040+0000 7fac461cd700 1 -- 172.21.15.72:0/2664157020 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac38009b30 con 0x7fac400984f0 2023-10-03T10:16:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.040+0000 7fac461cd700 1 --2- 172.21.15.72:0/2664157020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac400984f0 0x7fac4012d020 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00e810 tx=0x7fac3c00eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.040+0000 7fac36ffd700 1 -- 172.21.15.72:0/2664157020 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c013610 con 0x7fac400984f0 2023-10-03T10:16:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.040+0000 7fac36ffd700 1 -- 172.21.15.72:0/2664157020 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3c013770 con 0x7fac400984f0 2023-10-03T10:16:57.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.040+0000 7fac36ffd700 1 -- 172.21.15.72:0/2664157020 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c013b20 con 0x7fac400984f0 2023-10-03T10:16:57.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.040+0000 7fac48431700 1 -- 172.21.15.72:0/2664157020 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4012bea0 con 0x7fac400984f0 2023-10-03T10:16:57.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.040+0000 7fac48431700 1 -- 172.21.15.72:0/2664157020 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4012b780 con 0x7fac400984f0 2023-10-03T10:16:57.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.041+0000 7fac36ffd700 1 -- 172.21.15.72:0/2664157020 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac3c013c80 con 0x7fac400984f0 2023-10-03T10:16:57.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.041+0000 7fac36ffd700 1 -- 172.21.15.72:0/2664157020 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fac3c03f390 con 0x7fac400984f0 2023-10-03T10:16:57.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.041+0000 7fac48431700 1 -- 172.21.15.72:0/2664157020 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac40130930 con 0x7fac400984f0 2023-10-03T10:16:57.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.046+0000 7fac36ffd700 1 -- 172.21.15.72:0/2664157020 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac3c012370 con 0x7fac400984f0 2023-10-03T10:16:57.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.138+0000 7fef067e9700 1 Processor -- start 2023-10-03T10:16:57.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.138+0000 7fef067e9700 1 -- start start 2023-10-03T10:16:57.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.139+0000 7fef067e9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef000a0a30 0x7fef000a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.139+0000 7fef067e9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef00134170 0x7fef0013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.139+0000 7fef067e9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0009edd0 con 0x7fef000a1340 2023-10-03T10:16:57.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.139+0000 7fef067e9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef0009e1f0 con 0x7fef000a0a30 2023-10-03T10:16:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.139+0000 7fef067e9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef0009dc50 con 0x7fef00134170 2023-10-03T10:16:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.139+0000 7feefffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef000a0a30 0x7fef000a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.139+0000 7feefffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef000a0a30 0x7fef000a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52774/0 (socket says 172.21.15.72:52774) 2023-10-03T10:16:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.139+0000 7feefffff700 1 -- 172.21.15.72:0/104932980 learned_addr learned my addr 172.21.15.72:0/104932980 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.139+0000 7fef04d86700 1 --2- 172.21.15.72:0/104932980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef00134170 0x7fef0013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.139+0000 7feefffff700 1 -- 172.21.15.72:0/104932980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef00134170 msgr2=0x7fef0013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.139+0000 7feefffff700 1 --2- 172.21.15.72:0/104932980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef00134170 0x7fef0013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.139+0000 7feefffff700 1 -- 172.21.15.72:0/104932980 >> v1:172.21.15.72:6789/0 conn(0x7fef000a1340 legacy=0x7fef00133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.139+0000 7feefffff700 1 -- 172.21.15.72:0/104932980 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000a1fe0 con 0x7fef000a0a30 2023-10-03T10:16:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.139+0000 7feefffff700 1 --2- 172.21.15.72:0/104932980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef000a0a30 0x7fef000a0e00 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7feef00098f0 tx=0x7feef0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222b3f3c01dca1b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.139+0000 7feefeffd700 1 -- 172.21.15.72:0/104932980 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0011830 con 0x7fef000a0a30 2023-10-03T10:16:57.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.140+0000 7feefeffd700 1 -- 172.21.15.72:0/104932980 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef0011990 con 0x7fef000a0a30 2023-10-03T10:16:57.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.140+0000 7feefeffd700 1 -- 172.21.15.72:0/104932980 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0011d20 con 0x7fef000a0a30 2023-10-03T10:16:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.140+0000 7fef067e9700 1 -- 172.21.15.72:0/104932980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef000a0a30 msgr2=0x7fef000a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.140+0000 7fef067e9700 1 --2- 172.21.15.72:0/104932980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef000a0a30 0x7fef000a0e00 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7feef00098f0 tx=0x7feef0009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.140+0000 7fef067e9700 1 -- 172.21.15.72:0/104932980 shutdown_connections 2023-10-03T10:16:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.140+0000 7fef067e9700 1 --2- 172.21.15.72:0/104932980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef00134170 0x7fef0013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.140+0000 7fef067e9700 1 --2- 172.21.15.72:0/104932980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef000a0a30 0x7fef000a0e00 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.140+0000 7fef067e9700 1 -- 172.21.15.72:0/104932980 >> 172.21.15.72:0/104932980 conn(0x7fef000a6550 msgr2=0x7fef000a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.140+0000 7fef067e9700 1 -- 172.21.15.72:0/104932980 shutdown_connections 2023-10-03T10:16:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.141+0000 7fef067e9700 1 -- 172.21.15.72:0/104932980 wait complete. 2023-10-03T10:16:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.142+0000 7fef067e9700 1 Processor -- start 2023-10-03T10:16:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.142+0000 7fef067e9700 1 -- start start 2023-10-03T10:16:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.142+0000 7fef067e9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef000a0a30 0x7fef00122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.142+0000 7fef067e9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef000a1340 0x7fef00122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.142+0000 7fef067e9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef00134170 0x7fef001233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.142+0000 7fef067e9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef001246a0 con 0x7fef000a1340 2023-10-03T10:16:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.142+0000 7fef067e9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef001244b0 con 0x7fef00134170 2023-10-03T10:16:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.142+0000 7fef067e9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef001263c0 con 0x7fef000a0a30 2023-10-03T10:16:57.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7feefffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef000a0a30 0x7fef00122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7fef04d86700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef00134170 0x7fef001233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7feefffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef000a0a30 0x7fef00122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48830/0 (socket says 172.21.15.72:48830) 2023-10-03T10:16:57.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7feefffff700 1 -- 172.21.15.72:0/3544581391 learned_addr learned my addr 172.21.15.72:0/3544581391 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:57.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7feeff7fe700 1 --2- 172.21.15.72:0/3544581391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef000a1340 0x7fef00122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7fef04d86700 1 -- 172.21.15.72:0/3544581391 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef000a0a30 msgr2=0x7fef00122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7fef04d86700 1 --2- 172.21.15.72:0/3544581391 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef000a0a30 0x7fef00122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7fef04d86700 1 -- 172.21.15.72:0/3544581391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef000a1340 msgr2=0x7fef00122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7fef04d86700 1 --2- 172.21.15.72:0/3544581391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef000a1340 0x7fef00122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7fef04d86700 1 -- 172.21.15.72:0/3544581391 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef0009550 con 0x7fef00134170 2023-10-03T10:16:57.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7feefffff700 1 --2- 172.21.15.72:0/3544581391 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef000a0a30 0x7fef00122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7fef04d86700 1 --2- 172.21.15.72:0/3544581391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef00134170 0x7fef001233b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7feef800efc0 tx=0x7feef800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7feefcff9700 1 -- 172.21.15.72:0/3544581391 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800cc90 con 0x7fef00134170 2023-10-03T10:16:57.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7feefcff9700 1 -- 172.21.15.72:0/3544581391 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef800f040 con 0x7fef00134170 2023-10-03T10:16:57.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7fef067e9700 1 -- 172.21.15.72:0/3544581391 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef000a25e0 con 0x7fef00134170 2023-10-03T10:16:57.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7feefcff9700 1 -- 172.21.15.72:0/3544581391 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef80146c0 con 0x7fef00134170 2023-10-03T10:16:57.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.143+0000 7fef067e9700 1 -- 172.21.15.72:0/3544581391 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef000a0270 con 0x7fef00134170 2023-10-03T10:16:57.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.144+0000 7feefcff9700 1 -- 172.21.15.72:0/3544581391 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feef8014820 con 0x7fef00134170 2023-10-03T10:16:57.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.145+0000 7fef067e9700 1 -- 172.21.15.72:0/3544581391 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef00125d80 con 0x7fef00134170 2023-10-03T10:16:57.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.145+0000 7feefcff9700 1 -- 172.21.15.72:0/3544581391 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feef80401b0 con 0x7fef00134170 2023-10-03T10:16:57.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.149+0000 7feefcff9700 1 -- 172.21.15.72:0/3544581391 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef00125d80 con 0x7fef00134170 2023-10-03T10:16:57.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.162+0000 7fbbbb9d1700 1 Processor -- start 2023-10-03T10:16:57.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.162+0000 7fbbbb9d1700 1 -- start start 2023-10-03T10:16:57.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbbb9d1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbbb40984f0 0x7fbbb40988c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbbb9d1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbbb409d6f0 0x7fbbb409db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbbb9d1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbb409e040 0x7fbbb41385c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbbb9d1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb4099620 con 0x7fbbb40984f0 2023-10-03T10:16:57.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbbb9d1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb409aca0 con 0x7fbbb409e040 2023-10-03T10:16:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbbb9d1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb409a9e0 con 0x7fbbb409d6f0 2023-10-03T10:16:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbb8f6c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbbb409d6f0 0x7fbbb409db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbb9f6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbb409e040 0x7fbbb41385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbb976d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbbb40984f0 0x7fbbb40988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbb9f6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbb409e040 0x7fbbb41385c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33048/0 (socket says 172.21.15.72:33048) 2023-10-03T10:16:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbb8f6c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbbb409d6f0 0x7fbbb409db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48840/0 (socket says 172.21.15.72:48840) 2023-10-03T10:16:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbb9f6e700 1 -- 172.21.15.72:0/2909180905 learned_addr learned my addr 172.21.15.72:0/2909180905 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbb976d700 1 -- 172.21.15.72:0/2909180905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbbb409d6f0 msgr2=0x7fbbb409db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbb976d700 1 --2- 172.21.15.72:0/2909180905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbbb409d6f0 0x7fbbb409db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbb976d700 1 -- 172.21.15.72:0/2909180905 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbb409e040 msgr2=0x7fbbb41385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbb976d700 1 --2- 172.21.15.72:0/2909180905 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbb409e040 0x7fbbb41385c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbb976d700 1 -- 172.21.15.72:0/2909180905 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb409bce0 con 0x7fbbb40984f0 2023-10-03T10:16:57.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbb9f6e700 1 --2- 172.21.15.72:0/2909180905 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbb409e040 0x7fbbb41385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbb8f6c700 1 --2- 172.21.15.72:0/2909180905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbbb409d6f0 0x7fbbb409db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.163+0000 7fbbb976d700 1 --2- 172.21.15.72:0/2909180905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbb40984f0 0x7fbbb40988c0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009840 tx=0x7fbbb0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4e6fdc45eb4083 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.164+0000 7fbbabfff700 1 -- 172.21.15.72:0/2909180905 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0010a90 con 0x7fbbb40984f0 2023-10-03T10:16:57.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.164+0000 7fbbabfff700 1 -- 172.21.15.72:0/2909180905 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb0010bf0 con 0x7fbbb40984f0 2023-10-03T10:16:57.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.164+0000 7fbbabfff700 1 -- 172.21.15.72:0/2909180905 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0018440 con 0x7fbbb40984f0 2023-10-03T10:16:57.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.164+0000 7fbbbb9d1700 1 -- 172.21.15.72:0/2909180905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbb40984f0 msgr2=0x7fbbb40988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.164+0000 7fbbbb9d1700 1 --2- 172.21.15.72:0/2909180905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbb40984f0 0x7fbbb40988c0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009840 tx=0x7fbbb0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:57.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.164+0000 7fbbbb9d1700 1 -- 172.21.15.72:0/2909180905 shutdown_connections 2023-10-03T10:16:57.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.164+0000 7fbbbb9d1700 1 --2- 172.21.15.72:0/2909180905 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbb409e040 0x7fbbb41385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.164+0000 7fbbbb9d1700 1 --2- 172.21.15.72:0/2909180905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbb40984f0 0x7fbbb40988c0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.164+0000 7fbbbb9d1700 1 --2- 172.21.15.72:0/2909180905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbbb409d6f0 0x7fbbb409db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.164+0000 7fbbbb9d1700 1 -- 172.21.15.72:0/2909180905 >> 172.21.15.72:0/2909180905 conn(0x7fbbb409f470 msgr2=0x7fbbb40a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.164+0000 7fbbbb9d1700 1 -- 172.21.15.72:0/2909180905 shutdown_connections 2023-10-03T10:16:57.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.164+0000 7fbbbb9d1700 1 -- 172.21.15.72:0/2909180905 wait complete. 2023-10-03T10:16:57.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.165+0000 7fbbbb9d1700 1 Processor -- start 2023-10-03T10:16:57.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.165+0000 7fbbbb9d1700 1 -- start start 2023-10-03T10:16:57.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.166+0000 7fbbbb9d1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbb40984f0 0x7fbbb4126e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.166+0000 7fbbbb9d1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbbb409d6f0 0x7fbbb4127340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.166+0000 7fbbbb9d1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbb409e040 0x7fbbb4127880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.166+0000 7fbbbb9d1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb412a870 con 0x7fbbb40984f0 2023-10-03T10:16:57.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.166+0000 7fbbbb9d1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb412a090 con 0x7fbbb409e040 2023-10-03T10:16:57.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.166+0000 7fbbbb9d1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb412a5b0 con 0x7fbbb409d6f0 2023-10-03T10:16:57.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.166+0000 7fbbb8f6c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbbb409d6f0 0x7fbbb4127340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.166+0000 7fbbb8f6c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbbb409d6f0 0x7fbbb4127340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48850/0 (socket says 172.21.15.72:48850) 2023-10-03T10:16:57.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.166+0000 7fbbb8f6c700 1 -- 172.21.15.72:0/3724820715 learned_addr learned my addr 172.21.15.72:0/3724820715 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:57.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.166+0000 7fbbb9f6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbb409e040 0x7fbbb4127880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.166+0000 7fbbb976d700 1 --2- 172.21.15.72:0/3724820715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbb40984f0 0x7fbbb4126e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.166+0000 7fbbb8f6c700 1 -- 172.21.15.72:0/3724820715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbb409e040 msgr2=0x7fbbb4127880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.166+0000 7fbbb8f6c700 1 --2- 172.21.15.72:0/3724820715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbb409e040 0x7fbbb4127880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.167+0000 7fbbb8f6c700 1 -- 172.21.15.72:0/3724820715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbb40984f0 msgr2=0x7fbbb4126e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.167+0000 7fbbb8f6c700 1 --2- 172.21.15.72:0/3724820715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbb40984f0 0x7fbbb4126e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.167+0000 7fbbb8f6c700 1 -- 172.21.15.72:0/3724820715 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba40094a0 con 0x7fbbb409d6f0 2023-10-03T10:16:57.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.167+0000 7fbbb8f6c700 1 --2- 172.21.15.72:0/3724820715 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbbb409d6f0 0x7fbbb4127340 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbba400ebe0 tx=0x7fbba400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.167+0000 7fbba9ffb700 1 -- 172.21.15.72:0/3724820715 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba400c850 con 0x7fbbb409d6f0 2023-10-03T10:16:57.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.167+0000 7fbba9ffb700 1 -- 172.21.15.72:0/3724820715 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba400c9b0 con 0x7fbbb409d6f0 2023-10-03T10:16:57.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.167+0000 7fbbbb9d1700 1 -- 172.21.15.72:0/3724820715 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbac009b30 con 0x7fbbb409d6f0 2023-10-03T10:16:57.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.167+0000 7fbba9ffb700 1 -- 172.21.15.72:0/3724820715 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba400cd40 con 0x7fbbb409d6f0 2023-10-03T10:16:57.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.167+0000 7fbbbb9d1700 1 -- 172.21.15.72:0/3724820715 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb00094a0 con 0x7fbbb409d6f0 2023-10-03T10:16:57.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.168+0000 7fbba9ffb700 1 -- 172.21.15.72:0/3724820715 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbba4013470 con 0x7fbbb409d6f0 2023-10-03T10:16:57.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.168+0000 7fbba9ffb700 1 -- 172.21.15.72:0/3724820715 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbba403fb50 con 0x7fbbb409d6f0 2023-10-03T10:16:57.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.168+0000 7fbbbb9d1700 1 -- 172.21.15.72:0/3724820715 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb4129ef0 con 0x7fbbb409d6f0 2023-10-03T10:16:57.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.173+0000 7fbba9ffb700 1 -- 172.21.15.72:0/3724820715 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbbb4129ef0 con 0x7fbbb409d6f0 2023-10-03T10:16:57.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.254+0000 7fac48431700 1 -- 172.21.15.72:0/2664157020 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fac400747f0 con 0x7fac400984f0 2023-10-03T10:16:57.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.254+0000 7fac36ffd700 1 -- 172.21.15.72:0/2664157020 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac3c010310 con 0x7fac400984f0 2023-10-03T10:16:57.255 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.256+0000 7fac48431700 1 -- 172.21.15.72:0/2664157020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac400984f0 msgr2=0x7fac4012d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.256+0000 7fac48431700 1 --2- 172.21.15.72:0/2664157020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac400984f0 0x7fac4012d020 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00e810 tx=0x7fac3c00eb20 comp rx=0 tx=0).stop 2023-10-03T10:16:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.256+0000 7fac48431700 1 -- 172.21.15.72:0/2664157020 shutdown_connections 2023-10-03T10:16:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.256+0000 7fac48431700 1 --2- 172.21.15.72:0/2664157020 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4009e040 0x7fac4012daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.256+0000 7fac48431700 1 --2- 172.21.15.72:0/2664157020 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac400984f0 0x7fac4012d020 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.256+0000 7fac48431700 1 --2- 172.21.15.72:0/2664157020 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac4009d6f0 0x7fac4012d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.256+0000 7fac48431700 1 -- 172.21.15.72:0/2664157020 >> 172.21.15.72:0/2664157020 conn(0x7fac4009f470 msgr2=0x7fac401b8920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.257+0000 7fac48431700 1 -- 172.21.15.72:0/2664157020 shutdown_connections 2023-10-03T10:16:57.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.257+0000 7fac48431700 1 -- 172.21.15.72:0/2664157020 wait complete. 2023-10-03T10:16:57.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:57.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.356+0000 7fef067e9700 1 -- 172.21.15.72:0/3544581391 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fef00125d80 con 0x7fef00134170 2023-10-03T10:16:57.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.357+0000 7feefcff9700 1 -- 172.21.15.72:0/3544581391 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fef00125d80 con 0x7fef00134170 2023-10-03T10:16:57.357 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:57.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.359+0000 7fef067e9700 1 -- 172.21.15.72:0/3544581391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef00134170 msgr2=0x7fef001233b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.359+0000 7fef067e9700 1 --2- 172.21.15.72:0/3544581391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef00134170 0x7fef001233b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7feef800efc0 tx=0x7feef800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.359+0000 7fef067e9700 1 -- 172.21.15.72:0/3544581391 shutdown_connections 2023-10-03T10:16:57.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.359+0000 7fef067e9700 1 --2- 172.21.15.72:0/3544581391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef00134170 0x7fef001233b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.359+0000 7fef067e9700 1 --2- 172.21.15.72:0/3544581391 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef000a0a30 0x7fef00122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.359+0000 7fef067e9700 1 --2- 172.21.15.72:0/3544581391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef000a1340 0x7fef00122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.359+0000 7fef067e9700 1 -- 172.21.15.72:0/3544581391 >> 172.21.15.72:0/3544581391 conn(0x7fef000a6550 msgr2=0x7fef0009ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.359+0000 7fef067e9700 1 -- 172.21.15.72:0/3544581391 shutdown_connections 2023-10-03T10:16:57.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.359+0000 7fef067e9700 1 -- 172.21.15.72:0/3544581391 wait complete. 2023-10-03T10:16:57.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.380+0000 7fbbbb9d1700 1 -- 172.21.15.72:0/3724820715 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbbb4129ef0 con 0x7fbbb409d6f0 2023-10-03T10:16:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.380+0000 7fbba9ffb700 1 -- 172.21.15.72:0/3724820715 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbbb4129ef0 con 0x7fbbb409d6f0 2023-10-03T10:16:57.381 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:57.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.382+0000 7fbbbb9d1700 1 -- 172.21.15.72:0/3724820715 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbbb409d6f0 msgr2=0x7fbbb4127340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.382+0000 7fbbbb9d1700 1 --2- 172.21.15.72:0/3724820715 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbbb409d6f0 0x7fbbb4127340 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbba400ebe0 tx=0x7fbba400eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.382+0000 7fbbbb9d1700 1 -- 172.21.15.72:0/3724820715 shutdown_connections 2023-10-03T10:16:57.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.382+0000 7fbbbb9d1700 1 --2- 172.21.15.72:0/3724820715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbbb40984f0 0x7fbbb4126e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.382+0000 7fbbbb9d1700 1 --2- 172.21.15.72:0/3724820715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbbb409e040 0x7fbbb4127880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.382+0000 7fbbbb9d1700 1 --2- 172.21.15.72:0/3724820715 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbbb409d6f0 0x7fbbb4127340 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.382+0000 7fbbbb9d1700 1 -- 172.21.15.72:0/3724820715 >> 172.21.15.72:0/3724820715 conn(0x7fbbb409f470 msgr2=0x7fbbb4097910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.382+0000 7fbbbb9d1700 1 -- 172.21.15.72:0/3724820715 shutdown_connections 2023-10-03T10:16:57.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.382+0000 7fbbbb9d1700 1 -- 172.21.15.72:0/3724820715 wait complete. 2023-10-03T10:16:57.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:57.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:57.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.555+0000 7f5afa5a2700 1 Processor -- start 2023-10-03T10:16:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.555+0000 7f5afa5a2700 1 -- start start 2023-10-03T10:16:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.555+0000 7f5afa5a2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5af4131810 0x7f5af4131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.555+0000 7f5afa5a2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5af4099a40 0x7f5af4099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.555+0000 7f5afa5a2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5af409a3b0 0x7f5af4138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.555+0000 7f5afa5a2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af41313c0 con 0x7f5af4131810 2023-10-03T10:16:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.555+0000 7f5afa5a2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af406e8c0 con 0x7f5af4099a40 2023-10-03T10:16:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.555+0000 7f5afa5a2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5af4071d20 con 0x7f5af409a3b0 2023-10-03T10:16:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.555+0000 7f5af3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5af4131810 0x7f5af4131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af8b3f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5af409a3b0 0x7f5af4138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5af4099a40 0x7f5af4099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5af4131810 0x7f5af4131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52814/0 (socket says 172.21.15.72:52814) 2023-10-03T10:16:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af8b3f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5af409a3b0 0x7f5af4138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48866/0 (socket says 172.21.15.72:48866) 2023-10-03T10:16:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af3fff700 1 -- 172.21.15.72:0/2335761922 learned_addr learned my addr 172.21.15.72:0/2335761922 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af37fe700 1 -- 172.21.15.72:0/2335761922 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5af409a3b0 msgr2=0x7f5af4138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af37fe700 1 --2- 172.21.15.72:0/2335761922 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5af409a3b0 0x7f5af4138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af37fe700 1 -- 172.21.15.72:0/2335761922 >> v2:172.21.15.72:3300/0 conn(0x7f5af4131810 msgr2=0x7f5af4131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af37fe700 1 --2- 172.21.15.72:0/2335761922 >> v2:172.21.15.72:3300/0 conn(0x7f5af4131810 0x7f5af4131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af37fe700 1 -- 172.21.15.72:0/2335761922 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af40721a0 con 0x7f5af4099a40 2023-10-03T10:16:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af3fff700 1 --2- 172.21.15.72:0/2335761922 >> v2:172.21.15.72:3300/0 conn(0x7f5af4131810 0x7f5af4131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af8b3f700 1 --2- 172.21.15.72:0/2335761922 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5af409a3b0 0x7f5af4138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af37fe700 1 --2- 172.21.15.72:0/2335761922 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5af4099a40 0x7f5af4099e70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009840 tx=0x7f5ae4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4720f5a6ed3cc6d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af2ffd700 1 -- 172.21.15.72:0/2335761922 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4011830 con 0x7f5af4099a40 2023-10-03T10:16:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af2ffd700 1 -- 172.21.15.72:0/2335761922 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae4011990 con 0x7f5af4099a40 2023-10-03T10:16:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.556+0000 7f5af2ffd700 1 -- 172.21.15.72:0/2335761922 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4011d20 con 0x7f5af4099a40 2023-10-03T10:16:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.557+0000 7f5afa5a2700 1 -- 172.21.15.72:0/2335761922 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5af4099a40 msgr2=0x7f5af4099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.557+0000 7f5afa5a2700 1 --2- 172.21.15.72:0/2335761922 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5af4099a40 0x7f5af4099e70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009840 tx=0x7f5ae4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.557+0000 7f5afa5a2700 1 -- 172.21.15.72:0/2335761922 shutdown_connections 2023-10-03T10:16:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.557+0000 7f5afa5a2700 1 --2- 172.21.15.72:0/2335761922 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5af409a3b0 0x7f5af4138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.557+0000 7f5afa5a2700 1 --2- 172.21.15.72:0/2335761922 >> v2:172.21.15.72:3300/0 conn(0x7f5af4131810 0x7f5af4131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.557+0000 7f5afa5a2700 1 --2- 172.21.15.72:0/2335761922 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5af4099a40 0x7f5af4099e70 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.557+0000 7f5afa5a2700 1 -- 172.21.15.72:0/2335761922 >> 172.21.15.72:0/2335761922 conn(0x7f5af40a2aa0 msgr2=0x7f5af40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.557+0000 7f5afa5a2700 1 -- 172.21.15.72:0/2335761922 shutdown_connections 2023-10-03T10:16:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.557+0000 7f5afa5a2700 1 -- 172.21.15.72:0/2335761922 wait complete. 2023-10-03T10:16:57.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.558+0000 7f5afa5a2700 1 Processor -- start 2023-10-03T10:16:57.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.558+0000 7f5afa5a2700 1 -- start start 2023-10-03T10:16:57.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.558+0000 7f5afa5a2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5af4099a40 0x7f5af411b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.558+0000 7f5afa5a2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af409a3b0 0x7f5af411be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.558+0000 7f5afa5a2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5af4131810 0x7f5af411c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.558+0000 7f5afa5a2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af411cdf0 con 0x7f5af409a3b0 2023-10-03T10:16:57.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.558+0000 7f5afa5a2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af412ec30 con 0x7f5af4131810 2023-10-03T10:16:57.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.558+0000 7f5afa5a2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5af411da70 con 0x7f5af4099a40 2023-10-03T10:16:57.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.558+0000 7f5af37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af409a3b0 0x7f5af411be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.558+0000 7f5af8b3f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5af4131810 0x7f5af411c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.558+0000 7f5af3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5af4099a40 0x7f5af411b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.558+0000 7f5af37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af409a3b0 0x7f5af411be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:52828/0 (socket says 172.21.15.72:52828) 2023-10-03T10:16:57.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.558+0000 7f5af37fe700 1 -- 172.21.15.72:0/2335703829 learned_addr learned my addr 172.21.15.72:0/2335703829 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:57.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.558+0000 7f5af8b3f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5af4131810 0x7f5af411c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:33062/0 (socket says 172.21.15.72:33062) 2023-10-03T10:16:57.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.559+0000 7f5af3fff700 1 -- 172.21.15.72:0/2335703829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5af4131810 msgr2=0x7f5af411c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.559+0000 7f5af3fff700 1 --2- 172.21.15.72:0/2335703829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5af4131810 0x7f5af411c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.559+0000 7f5af3fff700 1 -- 172.21.15.72:0/2335703829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af409a3b0 msgr2=0x7f5af411be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.559+0000 7f5af3fff700 1 --2- 172.21.15.72:0/2335703829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af409a3b0 0x7f5af411be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.559+0000 7f5af3fff700 1 -- 172.21.15.72:0/2335703829 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec009a70 con 0x7f5af4099a40 2023-10-03T10:16:57.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.559+0000 7f5af37fe700 1 --2- 172.21.15.72:0/2335703829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af409a3b0 0x7f5af411be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.559+0000 7f5af3fff700 1 --2- 172.21.15.72:0/2335703829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5af4099a40 0x7f5af411b920 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800dd00 tx=0x7f5ae80103a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.559+0000 7f5af0ff9700 1 -- 172.21.15.72:0/2335703829 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae800d2d0 con 0x7f5af4099a40 2023-10-03T10:16:57.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.559+0000 7f5af0ff9700 1 -- 172.21.15.72:0/2335703829 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae8013040 con 0x7f5af4099a40 2023-10-03T10:16:57.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.559+0000 7f5af0ff9700 1 -- 172.21.15.72:0/2335703829 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8010bd0 con 0x7f5af4099a40 2023-10-03T10:16:57.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.559+0000 7f5afa5a2700 1 -- 172.21.15.72:0/2335703829 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae800d9f0 con 0x7f5af4099a40 2023-10-03T10:16:57.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.559+0000 7f5afa5a2700 1 -- 172.21.15.72:0/2335703829 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae40094a0 con 0x7f5af4099a40 2023-10-03T10:16:57.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.560+0000 7f5afa5a2700 1 -- 172.21.15.72:0/2335703829 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af41308f0 con 0x7f5af4099a40 2023-10-03T10:16:57.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.560+0000 7f5af0ff9700 1 -- 172.21.15.72:0/2335703829 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ae8010d30 con 0x7f5af4099a40 2023-10-03T10:16:57.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.560+0000 7f5af0ff9700 1 -- 172.21.15.72:0/2335703829 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5ae8043ef0 con 0x7f5af4099a40 2023-10-03T10:16:57.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.565+0000 7f5af0ff9700 1 -- 172.21.15.72:0/2335703829 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ae8004030 con 0x7f5af4099a40 2023-10-03T10:16:57.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.754+0000 7f5afa5a2700 1 -- 172.21.15.72:0/2335703829 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5af40a0580 con 0x7f5af4099a40 2023-10-03T10:16:57.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.754+0000 7f5af0ff9700 1 -- 172.21.15.72:0/2335703829 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ae8018e40 con 0x7f5af4099a40 2023-10-03T10:16:57.755 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:57.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.756+0000 7f5afa5a2700 1 -- 172.21.15.72:0/2335703829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5af4099a40 msgr2=0x7f5af411b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.756+0000 7f5afa5a2700 1 --2- 172.21.15.72:0/2335703829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5af4099a40 0x7f5af411b920 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800dd00 tx=0x7f5ae80103a0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.756+0000 7f5afa5a2700 1 -- 172.21.15.72:0/2335703829 shutdown_connections 2023-10-03T10:16:57.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.756+0000 7f5afa5a2700 1 --2- 172.21.15.72:0/2335703829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5af4131810 0x7f5af411c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.756+0000 7f5afa5a2700 1 --2- 172.21.15.72:0/2335703829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5af4099a40 0x7f5af411b920 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.756+0000 7f5afa5a2700 1 --2- 172.21.15.72:0/2335703829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af409a3b0 0x7f5af411be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.756+0000 7f5afa5a2700 1 -- 172.21.15.72:0/2335703829 >> 172.21.15.72:0/2335703829 conn(0x7f5af40a2aa0 msgr2=0x7f5af4071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.756+0000 7f5afa5a2700 1 -- 172.21.15.72:0/2335703829 shutdown_connections 2023-10-03T10:16:57.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:57.756+0000 7f5afa5a2700 1 -- 172.21.15.72:0/2335703829 wait complete. 2023-10-03T10:16:57.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:58.270 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:58.372 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:58.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:58.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.396+0000 7f7eee83f700 1 Processor -- start 2023-10-03T10:16:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.396+0000 7f7eee83f700 1 -- start start 2023-10-03T10:16:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7eee83f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ee8131810 0x7f7ee8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7eee83f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee8099a40 0x7f7ee8099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7eee83f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee81313c0 con 0x7f7ee809a3b0 2023-10-03T10:16:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7eee83f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee809b580 con 0x7f7ee8131810 2023-10-03T10:16:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7eee83f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee806e8c0 con 0x7f7ee8099a40 2023-10-03T10:16:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7ee7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ee8131810 0x7f7ee8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7ee7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ee8131810 0x7f7ee8131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40608/0 (socket says 172.21.15.72:40608) 2023-10-03T10:16:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7ee7fff700 1 -- 172.21.15.72:0/287627874 learned_addr learned my addr 172.21.15.72:0/287627874 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7ee77fe700 1 --2- 172.21.15.72:0/287627874 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee8099a40 0x7f7ee8099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7ee7fff700 1 -- 172.21.15.72:0/287627874 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee8099a40 msgr2=0x7f7ee8099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7ee7fff700 1 --2- 172.21.15.72:0/287627874 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee8099a40 0x7f7ee8099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7ee7fff700 1 -- 172.21.15.72:0/287627874 >> v1:172.21.15.72:6789/0 conn(0x7f7ee809a3b0 legacy=0x7f7ee8138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7ee7fff700 1 -- 172.21.15.72:0/287627874 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee809a830 con 0x7f7ee8131810 2023-10-03T10:16:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7ee77fe700 1 --2- 172.21.15.72:0/287627874 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee8099a40 0x7f7ee8099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7ee7fff700 1 --2- 172.21.15.72:0/287627874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee8131810 0x7f7ee8131be0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80098f0 tx=0x7f7ed8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ea3ba1603c5861 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.397+0000 7f7ee6ffd700 1 -- 172.21.15.72:0/287627874 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8004230 con 0x7f7ee8131810 2023-10-03T10:16:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.398+0000 7f7ee6ffd700 1 -- 172.21.15.72:0/287627874 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed8004390 con 0x7f7ee8131810 2023-10-03T10:16:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.398+0000 7f7ee6ffd700 1 -- 172.21.15.72:0/287627874 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed80036a0 con 0x7f7ee8131810 2023-10-03T10:16:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.399+0000 7f7eee83f700 1 -- 172.21.15.72:0/287627874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee8131810 msgr2=0x7f7ee8131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.399+0000 7f7eee83f700 1 --2- 172.21.15.72:0/287627874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee8131810 0x7f7ee8131be0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80098f0 tx=0x7f7ed8009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.399+0000 7f7eee83f700 1 -- 172.21.15.72:0/287627874 shutdown_connections 2023-10-03T10:16:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.399+0000 7f7eee83f700 1 --2- 172.21.15.72:0/287627874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee8131810 0x7f7ee8131be0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.399+0000 7f7eee83f700 1 --2- 172.21.15.72:0/287627874 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee8099a40 0x7f7ee8099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.399+0000 7f7eee83f700 1 -- 172.21.15.72:0/287627874 >> 172.21.15.72:0/287627874 conn(0x7f7ee80a2aa0 msgr2=0x7f7ee80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.399+0000 7f7eee83f700 1 -- 172.21.15.72:0/287627874 shutdown_connections 2023-10-03T10:16:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.399+0000 7f7eee83f700 1 -- 172.21.15.72:0/287627874 wait complete. 2023-10-03T10:16:58.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.400+0000 7f7eee83f700 1 Processor -- start 2023-10-03T10:16:58.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.400+0000 7f7eee83f700 1 -- start start 2023-10-03T10:16:58.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7eee83f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ee8099a40 0x7f7ee811b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7eee83f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee809a3b0 0x7f7ee811bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7eee83f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee8131810 0x7f7ee811c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7eee83f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee811da10 con 0x7f7ee809a3b0 2023-10-03T10:16:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7eee83f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee811f2d0 con 0x7f7ee8099a40 2023-10-03T10:16:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7eee83f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee811e6a0 con 0x7f7ee8131810 2023-10-03T10:16:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7ee7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ee8099a40 0x7f7ee811b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7ee7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ee8099a40 0x7f7ee811b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59162/0 (socket says 172.21.15.72:59162) 2023-10-03T10:16:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7ee7fff700 1 -- 172.21.15.72:0/1825337911 learned_addr learned my addr 172.21.15.72:0/1825337911 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7eecddc700 1 --2- 172.21.15.72:0/1825337911 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee8131810 0x7f7ee811c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7eecddc700 1 -- 172.21.15.72:0/1825337911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ee8099a40 msgr2=0x7f7ee811b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7eecddc700 1 --2- 172.21.15.72:0/1825337911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ee8099a40 0x7f7ee811b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7eecddc700 1 -- 172.21.15.72:0/1825337911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee809a3b0 msgr2=0x7f7ee811bd80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7eecddc700 1 --2- 172.21.15.72:0/1825337911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee809a3b0 0x7f7ee811bd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7eecddc700 1 -- 172.21.15.72:0/1825337911 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc0094a0 con 0x7f7ee8131810 2023-10-03T10:16:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.401+0000 7f7ee7fff700 1 --2- 172.21.15.72:0/1825337911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ee8099a40 0x7f7ee811b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.402+0000 7f7eecddc700 1 --2- 172.21.15.72:0/1825337911 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee8131810 0x7f7ee811c2c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000cb40 tx=0x7f7ee000ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.402+0000 7f7ee4ff9700 1 -- 172.21.15.72:0/1825337911 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee000aa60 con 0x7f7ee8131810 2023-10-03T10:16:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.402+0000 7f7ee4ff9700 1 -- 172.21.15.72:0/1825337911 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee000ac00 con 0x7f7ee8131810 2023-10-03T10:16:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.402+0000 7f7eee83f700 1 -- 172.21.15.72:0/1825337911 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed8009550 con 0x7f7ee8131810 2023-10-03T10:16:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.402+0000 7f7ee4ff9700 1 -- 172.21.15.72:0/1825337911 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0012420 con 0x7f7ee8131810 2023-10-03T10:16:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.402+0000 7f7eee83f700 1 -- 172.21.15.72:0/1825337911 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee80a1cb0 con 0x7f7ee8131810 2023-10-03T10:16:58.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.403+0000 7f7ee4ff9700 1 -- 172.21.15.72:0/1825337911 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ee0012580 con 0x7f7ee8131810 2023-10-03T10:16:58.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.403+0000 7f7ee4ff9700 1 -- 172.21.15.72:0/1825337911 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ee003fd30 con 0x7f7ee8131810 2023-10-03T10:16:58.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.403+0000 7f7eee83f700 1 -- 172.21.15.72:0/1825337911 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee8074ea0 con 0x7f7ee8131810 2023-10-03T10:16:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.412+0000 7f7ee4ff9700 1 -- 172.21.15.72:0/1825337911 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ee00228f0 con 0x7f7ee8131810 2023-10-03T10:16:58.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.500+0000 7fef70025700 1 Processor -- start 2023-10-03T10:16:58.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.501+0000 7fef70025700 1 -- start start 2023-10-03T10:16:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.501+0000 7fef70025700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef68130380 0x7fef68130750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.501+0000 7fef70025700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6809e560 0x7fef6813b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.501+0000 7fef70025700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef6812ff50 con 0x7fef68071f40 2023-10-03T10:16:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.501+0000 7fef70025700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6806f980 con 0x7fef68130380 2023-10-03T10:16:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.501+0000 7fef70025700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6806fc40 con 0x7fef6809e560 2023-10-03T10:16:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.502+0000 7fef6e5c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6809e560 0x7fef6813b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.502+0000 7fef6ddc1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef68130380 0x7fef68130750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.502+0000 7fef6d5c0700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fef68071f40 0x7fef6809de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56646/0 (socket says 172.21.15.72:56646) 2023-10-03T10:16:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.502+0000 7fef6d5c0700 1 -- 172.21.15.72:0/1044850213 learned_addr learned my addr 172.21.15.72:0/1044850213 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.502+0000 7fef6e5c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6809e560 0x7fef6813b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59166/0 (socket says 172.21.15.72:59166) 2023-10-03T10:16:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.502+0000 7fef6ddc1700 1 -- 172.21.15.72:0/1044850213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6809e560 msgr2=0x7fef6813b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.502+0000 7fef6ddc1700 1 --2- 172.21.15.72:0/1044850213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6809e560 0x7fef6813b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.502+0000 7fef6ddc1700 1 -- 172.21.15.72:0/1044850213 >> v1:172.21.15.72:6789/0 conn(0x7fef68071f40 legacy=0x7fef6809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.502+0000 7fef6cdbf700 1 -- 172.21.15.72:0/1044850213 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107132845 0 0) 0x7fef6812ff50 con 0x7fef68071f40 2023-10-03T10:16:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.502+0000 7fef6ddc1700 1 -- 172.21.15.72:0/1044850213 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef68066680 con 0x7fef68130380 2023-10-03T10:16:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.502+0000 7fef6ddc1700 1 --2- 172.21.15.72:0/1044850213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef68130380 0x7fef68130750 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fef64009840 tx=0x7fef64009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0b677bfb432cf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.502+0000 7fef6cdbf700 1 -- 172.21.15.72:0/1044850213 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64011830 con 0x7fef68130380 2023-10-03T10:16:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.502+0000 7fef6cdbf700 1 -- 172.21.15.72:0/1044850213 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef64011990 con 0x7fef68130380 2023-10-03T10:16:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.502+0000 7fef6cdbf700 1 -- 172.21.15.72:0/1044850213 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64011d20 con 0x7fef68130380 2023-10-03T10:16:58.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.503+0000 7fef70025700 1 -- 172.21.15.72:0/1044850213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef68130380 msgr2=0x7fef68130750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.503+0000 7fef70025700 1 --2- 172.21.15.72:0/1044850213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef68130380 0x7fef68130750 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fef64009840 tx=0x7fef64009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.503+0000 7fef70025700 1 -- 172.21.15.72:0/1044850213 shutdown_connections 2023-10-03T10:16:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.503+0000 7fef70025700 1 --2- 172.21.15.72:0/1044850213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6809e560 0x7fef6813b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.503+0000 7fef70025700 1 --2- 172.21.15.72:0/1044850213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef68130380 0x7fef68130750 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.503+0000 7fef70025700 1 -- 172.21.15.72:0/1044850213 >> 172.21.15.72:0/1044850213 conn(0x7fef680a27f0 msgr2=0x7fef680a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.503+0000 7fef70025700 1 -- 172.21.15.72:0/1044850213 shutdown_connections 2023-10-03T10:16:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.503+0000 7fef70025700 1 -- 172.21.15.72:0/1044850213 wait complete. 2023-10-03T10:16:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.505+0000 7fef70025700 1 Processor -- start 2023-10-03T10:16:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.505+0000 7fef70025700 1 -- start start 2023-10-03T10:16:58.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.505+0000 7fef70025700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef68071f40 0x7fef6811c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.505+0000 7fef70025700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef6809e560 0x7fef6811cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.505+0000 7fef70025700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef68130380 0x7fef6811d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.505+0000 7fef70025700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6811e270 con 0x7fef68071f40 2023-10-03T10:16:58.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.505+0000 7fef70025700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6811f4c0 con 0x7fef68130380 2023-10-03T10:16:58.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.505+0000 7fef70025700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef6811e850 con 0x7fef6809e560 2023-10-03T10:16:58.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef6ddc1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef68071f40 0x7fef6811c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef6ddc1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef68071f40 0x7fef6811c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40630/0 (socket says 172.21.15.72:40630) 2023-10-03T10:16:58.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef6ddc1700 1 -- 172.21.15.72:0/2852295201 learned_addr learned my addr 172.21.15.72:0/2852295201 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:58.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef6e5c2700 1 --2- 172.21.15.72:0/2852295201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef68130380 0x7fef6811d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef6d5c0700 1 --2- 172.21.15.72:0/2852295201 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef6809e560 0x7fef6811cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef6ddc1700 1 -- 172.21.15.72:0/2852295201 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef6809e560 msgr2=0x7fef6811cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef6ddc1700 1 --2- 172.21.15.72:0/2852295201 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef6809e560 0x7fef6811cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef6ddc1700 1 -- 172.21.15.72:0/2852295201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef68130380 msgr2=0x7fef6811d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef6ddc1700 1 --2- 172.21.15.72:0/2852295201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef68130380 0x7fef6811d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef6ddc1700 1 -- 172.21.15.72:0/2852295201 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef640094a0 con 0x7fef68071f40 2023-10-03T10:16:58.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef6ddc1700 1 --2- 172.21.15.72:0/2852295201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef68071f40 0x7fef6811c6f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fef640090b0 tx=0x7fef64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef5e7fc700 1 -- 172.21.15.72:0/2852295201 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef640045d0 con 0x7fef68071f40 2023-10-03T10:16:58.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef5e7fc700 1 -- 172.21.15.72:0/2852295201 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6401f070 con 0x7fef68071f40 2023-10-03T10:16:58.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef70025700 1 -- 172.21.15.72:0/2852295201 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef68130e10 con 0x7fef68071f40 2023-10-03T10:16:58.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef5e7fc700 1 -- 172.21.15.72:0/2852295201 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef640038e0 con 0x7fef68071f40 2023-10-03T10:16:58.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.506+0000 7fef70025700 1 -- 172.21.15.72:0/2852295201 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef680a2d00 con 0x7fef68071f40 2023-10-03T10:16:58.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.507+0000 7fef5e7fc700 1 -- 172.21.15.72:0/2852295201 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef64003a40 con 0x7fef68071f40 2023-10-03T10:16:58.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.507+0000 7fef5e7fc700 1 -- 172.21.15.72:0/2852295201 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef64021070 con 0x7fef68071f40 2023-10-03T10:16:58.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.508+0000 7fef70025700 1 -- 172.21.15.72:0/2852295201 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6806f470 con 0x7fef68071f40 2023-10-03T10:16:58.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.512+0000 7fef5e7fc700 1 -- 172.21.15.72:0/2852295201 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef6401a430 con 0x7fef68071f40 2023-10-03T10:16:58.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.524+0000 7fc3147a0700 1 Processor -- start 2023-10-03T10:16:58.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.524+0000 7fc3147a0700 1 -- start start 2023-10-03T10:16:58.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.524+0000 7fc3147a0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc30c0a0a30 0x7fc30c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.524+0000 7fc3147a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c138d80 0x7fc30c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.524+0000 7fc3147a0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c0a2a70 con 0x7fc30c09d630 2023-10-03T10:16:58.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.524+0000 7fc3147a0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30c0a01d0 con 0x7fc30c0a0a30 2023-10-03T10:16:58.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.524+0000 7fc3147a0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c09e2b0 con 0x7fc30c138d80 2023-10-03T10:16:58.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.524+0000 7fc31253c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc30c0a0a30 0x7fc30c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.524+0000 7fc31253c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc30c0a0a30 0x7fc30c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40644/0 (socket says 172.21.15.72:40644) 2023-10-03T10:16:58.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.524+0000 7fc31253c700 1 -- 172.21.15.72:0/178018597 learned_addr learned my addr 172.21.15.72:0/178018597 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:58.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.525+0000 7fc312d3d700 1 --2- 172.21.15.72:0/178018597 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c138d80 0x7fc30c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.524+0000 7fc311d3b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc30c09d630 0x7fc30c0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56658/0 (socket says 172.21.15.72:56658) 2023-10-03T10:16:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.525+0000 7fc31253c700 1 -- 172.21.15.72:0/178018597 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c138d80 msgr2=0x7fc30c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.525+0000 7fc31253c700 1 --2- 172.21.15.72:0/178018597 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c138d80 0x7fc30c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.525+0000 7fc31253c700 1 -- 172.21.15.72:0/178018597 >> v1:172.21.15.72:6789/0 conn(0x7fc30c09d630 legacy=0x7fc30c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.525+0000 7fc31253c700 1 -- 172.21.15.72:0/178018597 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c09dc50 con 0x7fc30c0a0a30 2023-10-03T10:16:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.525+0000 7fc31153a700 1 -- 172.21.15.72:0/178018597 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755594584 0 0) 0x7fc30c0a2a70 con 0x7fc30c09d630 2023-10-03T10:16:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.525+0000 7fc312d3d700 1 --2- 172.21.15.72:0/178018597 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c138d80 0x7fc30c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.525+0000 7fc31253c700 1 --2- 172.21.15.72:0/178018597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30c0a0a30 0x7fc30c0a0e00 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fc3080098f0 tx=0x7fc308009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c478f568b0a7a3a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.525+0000 7fc31153a700 1 -- 172.21.15.72:0/178018597 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308011830 con 0x7fc30c0a0a30 2023-10-03T10:16:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.525+0000 7fc31153a700 1 -- 172.21.15.72:0/178018597 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc308011990 con 0x7fc30c0a0a30 2023-10-03T10:16:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.525+0000 7fc31153a700 1 -- 172.21.15.72:0/178018597 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308011d20 con 0x7fc30c0a0a30 2023-10-03T10:16:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.526+0000 7fc3147a0700 1 -- 172.21.15.72:0/178018597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30c0a0a30 msgr2=0x7fc30c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.526+0000 7fc3147a0700 1 --2- 172.21.15.72:0/178018597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30c0a0a30 0x7fc30c0a0e00 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fc3080098f0 tx=0x7fc308009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:58.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.526+0000 7fc3147a0700 1 -- 172.21.15.72:0/178018597 shutdown_connections 2023-10-03T10:16:58.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.526+0000 7fc3147a0700 1 --2- 172.21.15.72:0/178018597 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c138d80 0x7fc30c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.526+0000 7fc3147a0700 1 --2- 172.21.15.72:0/178018597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30c0a0a30 0x7fc30c0a0e00 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.526+0000 7fc3147a0700 1 -- 172.21.15.72:0/178018597 >> 172.21.15.72:0/178018597 conn(0x7fc30c0a3050 msgr2=0x7fc30c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.526+0000 7fc3147a0700 1 -- 172.21.15.72:0/178018597 shutdown_connections 2023-10-03T10:16:58.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.526+0000 7fc3147a0700 1 -- 172.21.15.72:0/178018597 wait complete. 2023-10-03T10:16:58.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.527+0000 7fc3147a0700 1 Processor -- start 2023-10-03T10:16:58.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.527+0000 7fc3147a0700 1 -- start start 2023-10-03T10:16:58.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.527+0000 7fc3147a0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30c09d630 0x7fc30c1336f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.527+0000 7fc3147a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c0a0a30 0x7fc30c133c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.527+0000 7fc3147a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c138d80 0x7fc30c134170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.527+0000 7fc3147a0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c1365c0 con 0x7fc30c09d630 2023-10-03T10:16:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.527+0000 7fc3147a0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c135750 con 0x7fc30c0a0a30 2023-10-03T10:16:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.527+0000 7fc3147a0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c136f30 con 0x7fc30c138d80 2023-10-03T10:16:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.527+0000 7fc311d3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c0a0a30 0x7fc30c133c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.527+0000 7fc312d3d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c138d80 0x7fc30c134170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.527+0000 7fc311d3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c0a0a30 0x7fc30c133c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59182/0 (socket says 172.21.15.72:59182) 2023-10-03T10:16:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.527+0000 7fc312d3d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c138d80 0x7fc30c134170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39602/0 (socket says 172.21.15.72:39602) 2023-10-03T10:16:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.527+0000 7fc311d3b700 1 -- 172.21.15.72:0/3933507426 learned_addr learned my addr 172.21.15.72:0/3933507426 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.527+0000 7fc31253c700 1 --2- 172.21.15.72:0/3933507426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30c09d630 0x7fc30c1336f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.528+0000 7fc312d3d700 1 -- 172.21.15.72:0/3933507426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c0a0a30 msgr2=0x7fc30c133c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.528+0000 7fc312d3d700 1 --2- 172.21.15.72:0/3933507426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c0a0a30 0x7fc30c133c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.528+0000 7fc312d3d700 1 -- 172.21.15.72:0/3933507426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30c09d630 msgr2=0x7fc30c1336f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.528+0000 7fc312d3d700 1 --2- 172.21.15.72:0/3933507426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30c09d630 0x7fc30c1336f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.528+0000 7fc312d3d700 1 -- 172.21.15.72:0/3933507426 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc304009a70 con 0x7fc30c138d80 2023-10-03T10:16:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.528+0000 7fc31253c700 1 --2- 172.21.15.72:0/3933507426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30c09d630 0x7fc30c1336f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.528+0000 7fc312d3d700 1 --2- 172.21.15.72:0/3933507426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c138d80 0x7fc30c134170 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc30400efc0 tx=0x7fc30400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.528+0000 7fc302ffd700 1 -- 172.21.15.72:0/3933507426 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30400cc90 con 0x7fc30c138d80 2023-10-03T10:16:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.528+0000 7fc302ffd700 1 -- 172.21.15.72:0/3933507426 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30400f040 con 0x7fc30c138d80 2023-10-03T10:16:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.528+0000 7fc3147a0700 1 -- 172.21.15.72:0/3933507426 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc308009550 con 0x7fc30c138d80 2023-10-03T10:16:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.528+0000 7fc302ffd700 1 -- 172.21.15.72:0/3933507426 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304014480 con 0x7fc30c138d80 2023-10-03T10:16:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.528+0000 7fc3147a0700 1 -- 172.21.15.72:0/3933507426 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30c1379a0 con 0x7fc30c138d80 2023-10-03T10:16:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.529+0000 7fc302ffd700 1 -- 172.21.15.72:0/3933507426 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc304014600 con 0x7fc30c138d80 2023-10-03T10:16:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.529+0000 7fc302ffd700 1 -- 172.21.15.72:0/3933507426 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc30403feb0 con 0x7fc30c138d80 2023-10-03T10:16:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.529+0000 7fc3147a0700 1 -- 172.21.15.72:0/3933507426 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30c136bb0 con 0x7fc30c138d80 2023-10-03T10:16:58.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.534+0000 7fc302ffd700 1 -- 172.21.15.72:0/3933507426 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc30c136bb0 con 0x7fc30c138d80 2023-10-03T10:16:58.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.614+0000 7f7eee83f700 1 -- 172.21.15.72:0/1825337911 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7ee806b9e0 con 0x7f7ee8131810 2023-10-03T10:16:58.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.615+0000 7f7ee4ff9700 1 -- 172.21.15.72:0/1825337911 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ee0022300 con 0x7f7ee8131810 2023-10-03T10:16:58.615 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.618+0000 7f7eee83f700 1 -- 172.21.15.72:0/1825337911 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee8131810 msgr2=0x7f7ee811c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.618+0000 7f7eee83f700 1 --2- 172.21.15.72:0/1825337911 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee8131810 0x7f7ee811c2c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000cb40 tx=0x7f7ee000ce50 comp rx=0 tx=0).stop 2023-10-03T10:16:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.618+0000 7f7eee83f700 1 -- 172.21.15.72:0/1825337911 shutdown_connections 2023-10-03T10:16:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.618+0000 7f7eee83f700 1 --2- 172.21.15.72:0/1825337911 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee8131810 0x7f7ee811c2c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.618+0000 7f7eee83f700 1 --2- 172.21.15.72:0/1825337911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ee8099a40 0x7f7ee811b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.618+0000 7f7eee83f700 1 --2- 172.21.15.72:0/1825337911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee809a3b0 0x7f7ee811bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.618+0000 7f7eee83f700 1 -- 172.21.15.72:0/1825337911 >> 172.21.15.72:0/1825337911 conn(0x7f7ee80a2aa0 msgr2=0x7f7ee809d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.618+0000 7f7eee83f700 1 -- 172.21.15.72:0/1825337911 shutdown_connections 2023-10-03T10:16:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.618+0000 7f7eee83f700 1 -- 172.21.15.72:0/1825337911 wait complete. 2023-10-03T10:16:58.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:16:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.736+0000 7fef70025700 1 -- 172.21.15.72:0/2852295201 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fef6804f2a0 con 0x7fef68071f40 2023-10-03T10:16:58.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.736+0000 7fef5e7fc700 1 -- 172.21.15.72:0/2852295201 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fef64015020 con 0x7fef68071f40 2023-10-03T10:16:58.737 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:58.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.738+0000 7fef70025700 1 -- 172.21.15.72:0/2852295201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef68071f40 msgr2=0x7fef6811c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.738+0000 7fef70025700 1 --2- 172.21.15.72:0/2852295201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef68071f40 0x7fef6811c6f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fef640090b0 tx=0x7fef64004750 comp rx=0 tx=0).stop 2023-10-03T10:16:58.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.738+0000 7fef70025700 1 -- 172.21.15.72:0/2852295201 shutdown_connections 2023-10-03T10:16:58.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.738+0000 7fef70025700 1 --2- 172.21.15.72:0/2852295201 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef68071f40 0x7fef6811c6f0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.738+0000 7fef70025700 1 --2- 172.21.15.72:0/2852295201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef68130380 0x7fef6811d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.738+0000 7fef70025700 1 --2- 172.21.15.72:0/2852295201 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef6809e560 0x7fef6811cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.738+0000 7fef70025700 1 -- 172.21.15.72:0/2852295201 >> 172.21.15.72:0/2852295201 conn(0x7fef680a27f0 msgr2=0x7fef681bad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.738+0000 7fef70025700 1 -- 172.21.15.72:0/2852295201 shutdown_connections 2023-10-03T10:16:58.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.738+0000 7fef70025700 1 -- 172.21.15.72:0/2852295201 wait complete. 2023-10-03T10:16:58.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.748+0000 7fc3147a0700 1 -- 172.21.15.72:0/3933507426 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc30c136bb0 con 0x7fc30c138d80 2023-10-03T10:16:58.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.748+0000 7fc302ffd700 1 -- 172.21.15.72:0/3933507426 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc30c136bb0 con 0x7fc30c138d80 2023-10-03T10:16:58.749 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:16:58.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.750+0000 7fc3147a0700 1 -- 172.21.15.72:0/3933507426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c138d80 msgr2=0x7fc30c134170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.750+0000 7fc3147a0700 1 --2- 172.21.15.72:0/3933507426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c138d80 0x7fc30c134170 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc30400efc0 tx=0x7fc30400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.750+0000 7fc3147a0700 1 -- 172.21.15.72:0/3933507426 shutdown_connections 2023-10-03T10:16:58.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.750+0000 7fc3147a0700 1 --2- 172.21.15.72:0/3933507426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30c09d630 0x7fc30c1336f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.750+0000 7fc3147a0700 1 --2- 172.21.15.72:0/3933507426 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc30c138d80 0x7fc30c134170 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.750+0000 7fc3147a0700 1 --2- 172.21.15.72:0/3933507426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc30c0a0a30 0x7fc30c133c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.750+0000 7fc3147a0700 1 -- 172.21.15.72:0/3933507426 >> 172.21.15.72:0/3933507426 conn(0x7fc30c0a3050 msgr2=0x7fc30c13ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.750+0000 7fc3147a0700 1 -- 172.21.15.72:0/3933507426 shutdown_connections 2023-10-03T10:16:58.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.750+0000 7fc3147a0700 1 -- 172.21.15.72:0/3933507426 wait complete. 2023-10-03T10:16:58.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:16:58.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:16:58.770 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:58.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.923+0000 7ff3e709e700 1 Processor -- start 2023-10-03T10:16:58.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.923+0000 7ff3e709e700 1 -- start start 2023-10-03T10:16:58.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.923+0000 7ff3e709e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3e009d6f0 0x7ff3e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.923+0000 7ff3e709e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3e009e000 0x7ff3e0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.923+0000 7ff3e709e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e009f130 con 0x7ff3e009e410 2023-10-03T10:16:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.923+0000 7ff3e709e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e009f520 con 0x7ff3e009d6f0 2023-10-03T10:16:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.923+0000 7ff3e709e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e009e930 con 0x7ff3e009e000 2023-10-03T10:16:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.923+0000 7ff3dffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3e009e000 0x7ff3e0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.923+0000 7ff3e563b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff3e009e410 0x7ff3e0130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56672/0 (socket says 172.21.15.72:56672) 2023-10-03T10:16:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.923+0000 7ff3e563b700 1 -- 172.21.15.72:0/1303606187 learned_addr learned my addr 172.21.15.72:0/1303606187 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:16:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.923+0000 7ff3e4e3a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3e009d6f0 0x7ff3e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3e4e3a700 1 -- 172.21.15.72:0/1303606187 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3e009e000 msgr2=0x7ff3e0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3df7fe700 1 -- 172.21.15.72:0/1303606187 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892627465 0 0) 0x7ff3e009f130 con 0x7ff3e009e410 2023-10-03T10:16:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3e4e3a700 1 --2- 172.21.15.72:0/1303606187 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3e009e000 0x7ff3e0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3e4e3a700 1 -- 172.21.15.72:0/1303606187 >> v1:172.21.15.72:6789/0 conn(0x7ff3e009e410 legacy=0x7ff3e0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3e4e3a700 1 -- 172.21.15.72:0/1303606187 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e009b2d0 con 0x7ff3e009d6f0 2023-10-03T10:16:58.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3dffff700 1 --2- 172.21.15.72:0/1303606187 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3e009e000 0x7ff3e0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3e4e3a700 1 --2- 172.21.15.72:0/1303606187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3e009d6f0 0x7ff3e009dac0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009870 tx=0x7ff3d4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb681fb9d4591d5f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3df7fe700 1 -- 172.21.15.72:0/1303606187 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4011830 con 0x7ff3e009d6f0 2023-10-03T10:16:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3df7fe700 1 -- 172.21.15.72:0/1303606187 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d4011990 con 0x7ff3e009d6f0 2023-10-03T10:16:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3df7fe700 1 -- 172.21.15.72:0/1303606187 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4011d20 con 0x7ff3e009d6f0 2023-10-03T10:16:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3e709e700 1 -- 172.21.15.72:0/1303606187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3e009d6f0 msgr2=0x7ff3e009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3e709e700 1 --2- 172.21.15.72:0/1303606187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3e009d6f0 0x7ff3e009dac0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009870 tx=0x7ff3d4009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3e709e700 1 -- 172.21.15.72:0/1303606187 shutdown_connections 2023-10-03T10:16:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3e709e700 1 --2- 172.21.15.72:0/1303606187 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3e009d6f0 0x7ff3e009dac0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3e709e700 1 --2- 172.21.15.72:0/1303606187 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3e009e000 0x7ff3e0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3e709e700 1 -- 172.21.15.72:0/1303606187 >> 172.21.15.72:0/1303606187 conn(0x7ff3e0066f50 msgr2=0x7ff3e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.924+0000 7ff3e709e700 1 -- 172.21.15.72:0/1303606187 shutdown_connections 2023-10-03T10:16:58.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.925+0000 7ff3e709e700 1 -- 172.21.15.72:0/1303606187 wait complete. 2023-10-03T10:16:58.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.926+0000 7ff3e709e700 1 Processor -- start 2023-10-03T10:16:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.926+0000 7ff3e709e700 1 -- start start 2023-10-03T10:16:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.926+0000 7ff3e709e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3e009d6f0 0x7ff3e0120fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e709e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3e009e000 0x7ff3e0121500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e709e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3e009e410 0x7ff3e0121a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e709e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e00a3b40 con 0x7ff3e009e000 2023-10-03T10:16:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e709e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e009c700 con 0x7ff3e009d6f0 2023-10-03T10:16:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e709e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e01231e0 con 0x7ff3e009e410 2023-10-03T10:16:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e4e3a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3e009d6f0 0x7ff3e0120fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3dffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3e009e000 0x7ff3e0121500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e4e3a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3e009d6f0 0x7ff3e0120fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59192/0 (socket says 172.21.15.72:59192) 2023-10-03T10:16:58.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e563b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3e009e410 0x7ff3e0121a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e4e3a700 1 -- 172.21.15.72:0/928492675 learned_addr learned my addr 172.21.15.72:0/928492675 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e4e3a700 1 -- 172.21.15.72:0/928492675 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3e009e410 msgr2=0x7ff3e0121a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e4e3a700 1 --2- 172.21.15.72:0/928492675 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3e009e410 0x7ff3e0121a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e4e3a700 1 -- 172.21.15.72:0/928492675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3e009e000 msgr2=0x7ff3e0121500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e4e3a700 1 --2- 172.21.15.72:0/928492675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3e009e000 0x7ff3e0121500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e4e3a700 1 -- 172.21.15.72:0/928492675 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc0094a0 con 0x7ff3e009d6f0 2023-10-03T10:16:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3dffff700 1 --2- 172.21.15.72:0/928492675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3e009e000 0x7ff3e0121500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e4e3a700 1 --2- 172.21.15.72:0/928492675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3e009d6f0 0x7ff3e0120fc0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40090b0 tx=0x7ff3d4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3dd7fa700 1 -- 172.21.15.72:0/928492675 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d401a830 con 0x7ff3e009d6f0 2023-10-03T10:16:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3dd7fa700 1 -- 172.21.15.72:0/928492675 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d401a990 con 0x7ff3e009d6f0 2023-10-03T10:16:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e709e700 1 -- 172.21.15.72:0/928492675 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d40094a0 con 0x7ff3e009d6f0 2023-10-03T10:16:58.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3dd7fa700 1 -- 172.21.15.72:0/928492675 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d401ad20 con 0x7ff3e009d6f0 2023-10-03T10:16:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.927+0000 7ff3e709e700 1 -- 172.21.15.72:0/928492675 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e0122330 con 0x7ff3e009d6f0 2023-10-03T10:16:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.928+0000 7ff3dd7fa700 1 -- 172.21.15.72:0/928492675 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff3d40193b0 con 0x7ff3e009d6f0 2023-10-03T10:16:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.928+0000 7ff3dd7fa700 1 -- 172.21.15.72:0/928492675 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff3d4040760 con 0x7ff3e009d6f0 2023-10-03T10:16:58.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.928+0000 7ff3e709e700 1 -- 172.21.15.72:0/928492675 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e0074ea0 con 0x7ff3e009d6f0 2023-10-03T10:16:58.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:58.933+0000 7ff3dd7fa700 1 -- 172.21.15.72:0/928492675 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3d4019660 con 0x7ff3e009d6f0 2023-10-03T10:16:59.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.118+0000 7ff3e709e700 1 -- 172.21.15.72:0/928492675 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff3e0123410 con 0x7ff3e009d6f0 2023-10-03T10:16:59.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.118+0000 7ff3dd7fa700 1 -- 172.21.15.72:0/928492675 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff3d4015030 con 0x7ff3e009d6f0 2023-10-03T10:16:59.119 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:16:59.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.120+0000 7ff3e709e700 1 -- 172.21.15.72:0/928492675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3e009d6f0 msgr2=0x7ff3e0120fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.120+0000 7ff3e709e700 1 --2- 172.21.15.72:0/928492675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3e009d6f0 0x7ff3e0120fc0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40090b0 tx=0x7ff3d4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:59.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.120+0000 7ff3e709e700 1 -- 172.21.15.72:0/928492675 shutdown_connections 2023-10-03T10:16:59.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.120+0000 7ff3e709e700 1 --2- 172.21.15.72:0/928492675 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3e009e410 0x7ff3e0121a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.120+0000 7ff3e709e700 1 --2- 172.21.15.72:0/928492675 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3e009d6f0 0x7ff3e0120fc0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.120+0000 7ff3e709e700 1 --2- 172.21.15.72:0/928492675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3e009e000 0x7ff3e0121500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.120+0000 7ff3e709e700 1 -- 172.21.15.72:0/928492675 >> 172.21.15.72:0/928492675 conn(0x7ff3e0066f50 msgr2=0x7ff3e00a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.120+0000 7ff3e709e700 1 -- 172.21.15.72:0/928492675 shutdown_connections 2023-10-03T10:16:59.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.120+0000 7ff3e709e700 1 -- 172.21.15.72:0/928492675 wait complete. 2023-10-03T10:16:59.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:16:59.636 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:59.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:59.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.762+0000 7f23c5696700 1 Processor -- start 2023-10-03T10:16:59.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.762+0000 7f23c5696700 1 -- start start 2023-10-03T10:16:59.763 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:59.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23c5696700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23c009d6f0 0x7f23c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23c5696700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23c009e410 0x7f23c0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23c5696700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c009b120 con 0x7f23c009e000 2023-10-03T10:16:59.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23c5696700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c006b460 con 0x7f23c009e410 2023-10-03T10:16:59.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23c5696700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c009a7e0 con 0x7f23c009d6f0 2023-10-03T10:16:59.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23bf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23c009e410 0x7f23c0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23beffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23c009d6f0 0x7f23c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23beffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23c009d6f0 0x7f23c009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59208/0 (socket says 172.21.15.72:59208) 2023-10-03T10:16:59.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23bf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23c009e410 0x7f23c0134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40676/0 (socket says 172.21.15.72:40676) 2023-10-03T10:16:59.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23beffd700 1 -- 172.21.15.72:0/2181271505 learned_addr learned my addr 172.21.15.72:0/2181271505 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:59.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23beffd700 1 -- 172.21.15.72:0/2181271505 >> v2:172.21.15.72:3300/0 conn(0x7f23c009e410 msgr2=0x7f23c0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23beffd700 1 --2- 172.21.15.72:0/2181271505 >> v2:172.21.15.72:3300/0 conn(0x7f23c009e410 0x7f23c0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23beffd700 1 -- 172.21.15.72:0/2181271505 >> v1:172.21.15.72:6789/0 conn(0x7f23c009e000 legacy=0x7f23c01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23beffd700 1 -- 172.21.15.72:0/2181271505 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c009a500 con 0x7f23c009d6f0 2023-10-03T10:16:59.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23bf7fe700 1 --2- 172.21.15.72:0/2181271505 >> v2:172.21.15.72:3300/0 conn(0x7f23c009e410 0x7f23c0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23beffd700 1 --2- 172.21.15.72:0/2181271505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23c009d6f0 0x7f23c009dac0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009e80 tx=0x7f23b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cda6ba9543af9181 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23bdffb700 1 -- 172.21.15.72:0/2181271505 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b000e070 con 0x7f23c009d6f0 2023-10-03T10:16:59.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23bdffb700 1 -- 172.21.15.72:0/2181271505 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b000b8d0 con 0x7f23c009d6f0 2023-10-03T10:16:59.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.763+0000 7f23bdffb700 1 -- 172.21.15.72:0/2181271505 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b000bc80 con 0x7f23c009d6f0 2023-10-03T10:16:59.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.764+0000 7f23c5696700 1 -- 172.21.15.72:0/2181271505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23c009d6f0 msgr2=0x7f23c009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.764+0000 7f23c5696700 1 --2- 172.21.15.72:0/2181271505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23c009d6f0 0x7f23c009dac0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009e80 tx=0x7f23b000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:59.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.764+0000 7f23c5696700 1 -- 172.21.15.72:0/2181271505 shutdown_connections 2023-10-03T10:16:59.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.764+0000 7f23c5696700 1 --2- 172.21.15.72:0/2181271505 >> v2:172.21.15.72:3300/0 conn(0x7f23c009e410 0x7f23c0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.764+0000 7f23c5696700 1 --2- 172.21.15.72:0/2181271505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23c009d6f0 0x7f23c009dac0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.764+0000 7f23c5696700 1 -- 172.21.15.72:0/2181271505 >> 172.21.15.72:0/2181271505 conn(0x7f23c0066f50 msgr2=0x7f23c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.764+0000 7f23c5696700 1 -- 172.21.15.72:0/2181271505 shutdown_connections 2023-10-03T10:16:59.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.764+0000 7f23c5696700 1 -- 172.21.15.72:0/2181271505 wait complete. 2023-10-03T10:16:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.765+0000 7f23c5696700 1 Processor -- start 2023-10-03T10:16:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.765+0000 7f23c5696700 1 -- start start 2023-10-03T10:16:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23c5696700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23c009d6f0 0x7f23c01a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23c5696700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23c009e000 0x7f23c01a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23c5696700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23c009e410 0x7f23c01a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23c5696700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c01a9b00 con 0x7f23c009e000 2023-10-03T10:16:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23c5696700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c01a81d0 con 0x7f23c009e410 2023-10-03T10:16:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23c5696700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23c01a9290 con 0x7f23c009d6f0 2023-10-03T10:16:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23be7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23c009e000 0x7f23c01a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23be7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23c009e000 0x7f23c01a65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40692/0 (socket says 172.21.15.72:40692) 2023-10-03T10:16:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23be7fc700 1 -- 172.21.15.72:0/40182622 learned_addr learned my addr 172.21.15.72:0/40182622 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23beffd700 1 --2- 172.21.15.72:0/40182622 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23c009d6f0 0x7f23c01a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23be7fc700 1 -- 172.21.15.72:0/40182622 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23c009d6f0 msgr2=0x7f23c01a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23be7fc700 1 --2- 172.21.15.72:0/40182622 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23c009d6f0 0x7f23c01a6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23be7fc700 1 -- 172.21.15.72:0/40182622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23c009e410 msgr2=0x7f23c01a6af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23be7fc700 1 --2- 172.21.15.72:0/40182622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23c009e410 0x7f23c01a6af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23be7fc700 1 -- 172.21.15.72:0/40182622 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b80094a0 con 0x7f23c009e000 2023-10-03T10:16:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23be7fc700 1 --2- 172.21.15.72:0/40182622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23c009e000 0x7f23c01a65b0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f23a800c4e0 tx=0x7f23a800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.766+0000 7f23b77fe700 1 -- 172.21.15.72:0/40182622 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80052d0 con 0x7f23c009e000 2023-10-03T10:16:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.767+0000 7f23b77fe700 1 -- 172.21.15.72:0/40182622 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a8005430 con 0x7f23c009e000 2023-10-03T10:16:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.767+0000 7f23b77fe700 1 -- 172.21.15.72:0/40182622 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80038a0 con 0x7f23c009e000 2023-10-03T10:16:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.767+0000 7f23c5696700 1 -- 172.21.15.72:0/40182622 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b0009b30 con 0x7f23c009e000 2023-10-03T10:16:59.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.767+0000 7f23c5696700 1 -- 172.21.15.72:0/40182622 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c009c760 con 0x7f23c009e000 2023-10-03T10:16:59.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.767+0000 7f23b77fe700 1 -- 172.21.15.72:0/40182622 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23a8003a00 con 0x7f23c009e000 2023-10-03T10:16:59.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.767+0000 7f23b77fe700 1 -- 172.21.15.72:0/40182622 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f23a803eb70 con 0x7f23c009e000 2023-10-03T10:16:59.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.768+0000 7f23c5696700 1 -- 172.21.15.72:0/40182622 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c0074ea0 con 0x7f23c009e000 2023-10-03T10:16:59.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.773+0000 7f23b77fe700 1 -- 172.21.15.72:0/40182622 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23a8017080 con 0x7f23c009e000 2023-10-03T10:16:59.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.882+0000 7ffbdf59d700 1 Processor -- start 2023-10-03T10:16:59.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.882+0000 7ffbdf59d700 1 -- start start 2023-10-03T10:16:59.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbdf59d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbd809d8d0 0x7ffbd809dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbdf59d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffbd809e1e0 0x7ffbd8130460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbdf59d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd809b6e0 con 0x7ffbd809e610 2023-10-03T10:16:59.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbdf59d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd809b470 con 0x7ffbd809e1e0 2023-10-03T10:16:59.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbdf59d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd809eb80 con 0x7ffbd809d8d0 2023-10-03T10:16:59.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbddd9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffbd809e1e0 0x7ffbd8130460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbde59b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbd809d8d0 0x7ffbd809dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbddd9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffbd809e1e0 0x7ffbd8130460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40706/0 (socket says 172.21.15.72:40706) 2023-10-03T10:16:59.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbde59b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbd809d8d0 0x7ffbd809dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59212/0 (socket says 172.21.15.72:59212) 2023-10-03T10:16:59.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbddd9a700 1 -- 172.21.15.72:0/3252999328 learned_addr learned my addr 172.21.15.72:0/3252999328 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:59.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbded9c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffbd809e610 0x7ffbd81309a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56686/0 (socket says 172.21.15.72:56686) 2023-10-03T10:16:59.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbddd9a700 1 -- 172.21.15.72:0/3252999328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbd809d8d0 msgr2=0x7ffbd809dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbddd9a700 1 --2- 172.21.15.72:0/3252999328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbd809d8d0 0x7ffbd809dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbddd9a700 1 -- 172.21.15.72:0/3252999328 >> v1:172.21.15.72:6789/0 conn(0x7ffbd809e610 legacy=0x7ffbd81309a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbddd9a700 1 -- 172.21.15.72:0/3252999328 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd809ae00 con 0x7ffbd809e1e0 2023-10-03T10:16:59.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.883+0000 7ffbdd599700 1 -- 172.21.15.72:0/3252999328 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694459927 0 0) 0x7ffbd809b6e0 con 0x7ffbd809e610 2023-10-03T10:16:59.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.884+0000 7ffbddd9a700 1 --2- 172.21.15.72:0/3252999328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbd809e1e0 0x7ffbd8130460 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8006fd0 tx=0x7ffbc8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae29da5e42d9f902 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.884+0000 7ffbdd599700 1 -- 172.21.15.72:0/3252999328 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8005e30 con 0x7ffbd809e1e0 2023-10-03T10:16:59.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.884+0000 7ffbdd599700 1 -- 172.21.15.72:0/3252999328 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc8004030 con 0x7ffbd809e1e0 2023-10-03T10:16:59.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.884+0000 7ffbdd599700 1 -- 172.21.15.72:0/3252999328 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc80043e0 con 0x7ffbd809e1e0 2023-10-03T10:16:59.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.884+0000 7ffbdf59d700 1 -- 172.21.15.72:0/3252999328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbd809e1e0 msgr2=0x7ffbd8130460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.884+0000 7ffbdf59d700 1 --2- 172.21.15.72:0/3252999328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbd809e1e0 0x7ffbd8130460 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8006fd0 tx=0x7ffbc8009bd0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.884+0000 7ffbdf59d700 1 -- 172.21.15.72:0/3252999328 shutdown_connections 2023-10-03T10:16:59.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.884+0000 7ffbdf59d700 1 --2- 172.21.15.72:0/3252999328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbd809d8d0 0x7ffbd809dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.884+0000 7ffbdf59d700 1 --2- 172.21.15.72:0/3252999328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbd809e1e0 0x7ffbd8130460 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.884+0000 7ffbdf59d700 1 -- 172.21.15.72:0/3252999328 >> 172.21.15.72:0/3252999328 conn(0x7ffbd80a2e20 msgr2=0x7ffbd80a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.884+0000 7ffbdf59d700 1 -- 172.21.15.72:0/3252999328 shutdown_connections 2023-10-03T10:16:59.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.884+0000 7ffbdf59d700 1 -- 172.21.15.72:0/3252999328 wait complete. 2023-10-03T10:16:59.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.885+0000 7ffbdf59d700 1 Processor -- start 2023-10-03T10:16:59.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.885+0000 7ffbdf59d700 1 -- start start 2023-10-03T10:16:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbdf59d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffbd809d8d0 0x7ffbd811dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbdf59d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbd809e1e0 0x7ffbd811e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbdf59d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbd809e610 0x7ffbd811e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbdf59d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd811f0f0 con 0x7ffbd809e610 2023-10-03T10:16:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbdf59d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd811f7c0 con 0x7ffbd809e1e0 2023-10-03T10:16:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbdf59d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8120a10 con 0x7ffbd809d8d0 2023-10-03T10:16:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbde59b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffbd809d8d0 0x7ffbd811dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbde59b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffbd809d8d0 0x7ffbd811dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39638/0 (socket says 172.21.15.72:39638) 2023-10-03T10:16:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbded9c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbd809e610 0x7ffbd811e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbde59b700 1 -- 172.21.15.72:0/2472041420 learned_addr learned my addr 172.21.15.72:0/2472041420 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:59.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbddd9a700 1 --2- 172.21.15.72:0/2472041420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbd809e1e0 0x7ffbd811e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbde59b700 1 -- 172.21.15.72:0/2472041420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbd809e1e0 msgr2=0x7ffbd811e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbde59b700 1 --2- 172.21.15.72:0/2472041420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbd809e1e0 0x7ffbd811e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbde59b700 1 -- 172.21.15.72:0/2472041420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbd809e610 msgr2=0x7ffbd811e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbde59b700 1 --2- 172.21.15.72:0/2472041420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbd809e610 0x7ffbd811e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbde59b700 1 -- 172.21.15.72:0/2472041420 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc8009500 con 0x7ffbd809d8d0 2023-10-03T10:16:59.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbded9c700 1 --2- 172.21.15.72:0/2472041420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbd809e610 0x7ffbd811e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.886+0000 7ffbde59b700 1 --2- 172.21.15.72:0/2472041420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffbd809d8d0 0x7ffbd811dc40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400e9e0 tx=0x7ffbd400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.887+0000 7ffbceffd700 1 -- 172.21.15.72:0/2472041420 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4009710 con 0x7ffbd809d8d0 2023-10-03T10:16:59.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.887+0000 7ffbceffd700 1 -- 172.21.15.72:0/2472041420 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd400ee80 con 0x7ffbd809d8d0 2023-10-03T10:16:59.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.887+0000 7ffbdf59d700 1 -- 172.21.15.72:0/2472041420 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd81213f0 con 0x7ffbd809d8d0 2023-10-03T10:16:59.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.887+0000 7ffbceffd700 1 -- 172.21.15.72:0/2472041420 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd400ca50 con 0x7ffbd809d8d0 2023-10-03T10:16:59.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.887+0000 7ffbdf59d700 1 -- 172.21.15.72:0/2472041420 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd8120eb0 con 0x7ffbd809d8d0 2023-10-03T10:16:59.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.888+0000 7ffbceffd700 1 -- 172.21.15.72:0/2472041420 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffbd400cbb0 con 0x7ffbd809d8d0 2023-10-03T10:16:59.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.888+0000 7ffbdf59d700 1 -- 172.21.15.72:0/2472041420 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd804f2a0 con 0x7ffbd809d8d0 2023-10-03T10:16:59.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.888+0000 7ffbceffd700 1 -- 172.21.15.72:0/2472041420 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffbd403f6b0 con 0x7ffbd809d8d0 2023-10-03T10:16:59.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.890+0000 7f5be1b4c700 1 Processor -- start 2023-10-03T10:16:59.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.890+0000 7f5be1b4c700 1 -- start start 2023-10-03T10:16:59.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5be1b4c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5bdc09d6f0 0x7f5bdc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5be1b4c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5bdc09e000 0x7f5bdc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5be1b4c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bdc09f130 con 0x7f5bdc09e410 2023-10-03T10:16:59.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5be1b4c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bdc09f520 con 0x7f5bdc09e000 2023-10-03T10:16:59.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5be1b4c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc09e930 con 0x7f5bdc09d6f0 2023-10-03T10:16:59.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5bdaffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5bdc09e000 0x7f5bdc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5bdb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5bdc09d6f0 0x7f5bdc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5bdaffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5bdc09e000 0x7f5bdc130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40716/0 (socket says 172.21.15.72:40716) 2023-10-03T10:16:59.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5bdb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5bdc09d6f0 0x7f5bdc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39646/0 (socket says 172.21.15.72:39646) 2023-10-03T10:16:59.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5bdaffd700 1 -- 172.21.15.72:0/4287883316 learned_addr learned my addr 172.21.15.72:0/4287883316 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:59.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5bdb7fe700 1 -- 172.21.15.72:0/4287883316 >> v2:172.21.15.72:3300/0 conn(0x7f5bdc09e000 msgr2=0x7f5bdc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5bdb7fe700 1 --2- 172.21.15.72:0/4287883316 >> v2:172.21.15.72:3300/0 conn(0x7f5bdc09e000 0x7f5bdc130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5bdb7fe700 1 -- 172.21.15.72:0/4287883316 >> v1:172.21.15.72:6789/0 conn(0x7f5bdc09e410 legacy=0x7f5bdc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5bdb7fe700 1 -- 172.21.15.72:0/4287883316 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc09b2d0 con 0x7f5bdc09d6f0 2023-10-03T10:16:59.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5bdaffd700 1 --2- 172.21.15.72:0/4287883316 >> v2:172.21.15.72:3300/0 conn(0x7f5bdc09e000 0x7f5bdc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.891+0000 7f5bdb7fe700 1 --2- 172.21.15.72:0/4287883316 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5bdc09d6f0 0x7f5bdc09dac0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009840 tx=0x7f5bcc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=177d8086830c5420 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.893+0000 7f5bda7fc700 1 -- 172.21.15.72:0/4287883316 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc011830 con 0x7f5bdc09d6f0 2023-10-03T10:16:59.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.893+0000 7f5bda7fc700 1 -- 172.21.15.72:0/4287883316 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bcc011990 con 0x7f5bdc09d6f0 2023-10-03T10:16:59.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.893+0000 7f5bda7fc700 1 -- 172.21.15.72:0/4287883316 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc011d20 con 0x7f5bdc09d6f0 2023-10-03T10:16:59.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.893+0000 7ffbceffd700 1 -- 172.21.15.72:0/2472041420 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffbd40232f0 con 0x7ffbd809d8d0 2023-10-03T10:16:59.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.894+0000 7f5be1b4c700 1 -- 172.21.15.72:0/4287883316 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5bdc09d6f0 msgr2=0x7f5bdc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.894+0000 7f5be1b4c700 1 --2- 172.21.15.72:0/4287883316 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5bdc09d6f0 0x7f5bdc09dac0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009840 tx=0x7f5bcc009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:59.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.894+0000 7f5be1b4c700 1 -- 172.21.15.72:0/4287883316 shutdown_connections 2023-10-03T10:16:59.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.894+0000 7f5be1b4c700 1 --2- 172.21.15.72:0/4287883316 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5bdc09d6f0 0x7f5bdc09dac0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.894+0000 7f5be1b4c700 1 --2- 172.21.15.72:0/4287883316 >> v2:172.21.15.72:3300/0 conn(0x7f5bdc09e000 0x7f5bdc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.894+0000 7f5be1b4c700 1 -- 172.21.15.72:0/4287883316 >> 172.21.15.72:0/4287883316 conn(0x7f5bdc066f50 msgr2=0x7f5bdc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.894+0000 7f5be1b4c700 1 -- 172.21.15.72:0/4287883316 shutdown_connections 2023-10-03T10:16:59.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.894+0000 7f5be1b4c700 1 -- 172.21.15.72:0/4287883316 wait complete. 2023-10-03T10:16:59.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.895+0000 7f5be1b4c700 1 Processor -- start 2023-10-03T10:16:59.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.896+0000 7f5be1b4c700 1 -- start start 2023-10-03T10:16:59.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.896+0000 7f5be1b4c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bdc09d6f0 0x7f5bdc12eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.896+0000 7f5be1b4c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5bdc09e000 0x7f5bdc12f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.896+0000 7f5be1b4c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5bdc09e410 0x7f5bdc12f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.896+0000 7f5be1b4c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc132820 con 0x7f5bdc09d6f0 2023-10-03T10:16:59.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.896+0000 7f5be1b4c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc09c700 con 0x7f5bdc09e000 2023-10-03T10:16:59.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.896+0000 7f5be1b4c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc132a00 con 0x7f5bdc09e410 2023-10-03T10:16:59.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.896+0000 7f5bdaffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5bdc09e000 0x7f5bdc12f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5bdb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bdc09d6f0 0x7f5bdc12eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5bdaffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5bdc09e000 0x7f5bdc12f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59228/0 (socket says 172.21.15.72:59228) 2023-10-03T10:16:59.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5bdb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bdc09d6f0 0x7f5bdc12eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40722/0 (socket says 172.21.15.72:40722) 2023-10-03T10:16:59.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5bdaffd700 1 -- 172.21.15.72:0/2596799357 learned_addr learned my addr 172.21.15.72:0/2596799357 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:16:59.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5bdbfff700 1 --2- 172.21.15.72:0/2596799357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5bdc09e410 0x7f5bdc12f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5bdaffd700 1 -- 172.21.15.72:0/2596799357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5bdc09e410 msgr2=0x7f5bdc12f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5bdaffd700 1 --2- 172.21.15.72:0/2596799357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5bdc09e410 0x7f5bdc12f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5bdaffd700 1 -- 172.21.15.72:0/2596799357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bdc09d6f0 msgr2=0x7f5bdc12eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5bdaffd700 1 --2- 172.21.15.72:0/2596799357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bdc09d6f0 0x7f5bdc12eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5bdaffd700 1 -- 172.21.15.72:0/2596799357 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd0009550 con 0x7f5bdc09e000 2023-10-03T10:16:59.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5bdb7fe700 1 --2- 172.21.15.72:0/2596799357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bdc09d6f0 0x7f5bdc12eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5bdaffd700 1 --2- 172.21.15.72:0/2596799357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5bdc09e000 0x7f5bdc12f420 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0010f50 tx=0x7f5bd000b420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5bc3fff700 1 -- 172.21.15.72:0/2596799357 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0015070 con 0x7f5bdc09e000 2023-10-03T10:16:59.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5bc3fff700 1 -- 172.21.15.72:0/2596799357 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd000bb10 con 0x7f5bdc09e000 2023-10-03T10:16:59.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5be1b4c700 1 -- 172.21.15.72:0/2596799357 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bcc0094a0 con 0x7f5bdc09e000 2023-10-03T10:16:59.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5bc3fff700 1 -- 172.21.15.72:0/2596799357 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0019410 con 0x7f5bdc09e000 2023-10-03T10:16:59.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.897+0000 7f5be1b4c700 1 -- 172.21.15.72:0/2596799357 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bdc132ce0 con 0x7f5bdc09e000 2023-10-03T10:16:59.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.898+0000 7f5bc3fff700 1 -- 172.21.15.72:0/2596799357 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bd0019570 con 0x7f5bdc09e000 2023-10-03T10:16:59.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.898+0000 7f5bc3fff700 1 -- 172.21.15.72:0/2596799357 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5bd0042f30 con 0x7f5bdc09e000 2023-10-03T10:16:59.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.899+0000 7f5be1b4c700 1 -- 172.21.15.72:0/2596799357 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bdc132b40 con 0x7f5bdc09e000 2023-10-03T10:16:59.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.903+0000 7f5bc3fff700 1 -- 172.21.15.72:0/2596799357 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bdc132b40 con 0x7f5bdc09e000 2023-10-03T10:16:59.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.972+0000 7f23c5696700 1 -- 172.21.15.72:0/40182622 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f23c01a94c0 con 0x7f23c009e000 2023-10-03T10:16:59.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.973+0000 7f23b77fe700 1 -- 172.21.15.72:0/40182622 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23c01a94c0 con 0x7f23c009e000 2023-10-03T10:16:59.974 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:16:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.975+0000 7f23c5696700 1 -- 172.21.15.72:0/40182622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23c009e000 msgr2=0x7f23c01a65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.975+0000 7f23c5696700 1 --2- 172.21.15.72:0/40182622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23c009e000 0x7f23c01a65b0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f23a800c4e0 tx=0x7f23a800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.975+0000 7f23c5696700 1 -- 172.21.15.72:0/40182622 shutdown_connections 2023-10-03T10:16:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.975+0000 7f23c5696700 1 --2- 172.21.15.72:0/40182622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23c009e410 0x7f23c01a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.975+0000 7f23c5696700 1 --2- 172.21.15.72:0/40182622 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f23c009d6f0 0x7f23c01a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.975+0000 7f23c5696700 1 --2- 172.21.15.72:0/40182622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23c009e000 0x7f23c01a65b0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.975+0000 7f23c5696700 1 -- 172.21.15.72:0/40182622 >> 172.21.15.72:0/40182622 conn(0x7f23c0066f50 msgr2=0x7f23c01baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.975+0000 7f23c5696700 1 -- 172.21.15.72:0/40182622 shutdown_connections 2023-10-03T10:16:59.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:16:59.975+0000 7f23c5696700 1 -- 172.21.15.72:0/40182622 wait complete. 2023-10-03T10:16:59.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.087+0000 7ffbdf59d700 1 -- 172.21.15.72:0/2472041420 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffbd811fda0 con 0x7ffbd809d8d0 2023-10-03T10:17:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.088+0000 7ffbceffd700 1 -- 172.21.15.72:0/2472041420 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffbd4021030 con 0x7ffbd809d8d0 2023-10-03T10:17:00.089 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:00.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.090+0000 7ffbdf59d700 1 -- 172.21.15.72:0/2472041420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffbd809d8d0 msgr2=0x7ffbd811dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.090+0000 7ffbdf59d700 1 --2- 172.21.15.72:0/2472041420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffbd809d8d0 0x7ffbd811dc40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400e9e0 tx=0x7ffbd400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.090+0000 7ffbdf59d700 1 -- 172.21.15.72:0/2472041420 shutdown_connections 2023-10-03T10:17:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.090+0000 7ffbdf59d700 1 --2- 172.21.15.72:0/2472041420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbd809e610 0x7ffbd811e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.090+0000 7ffbdf59d700 1 --2- 172.21.15.72:0/2472041420 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffbd809d8d0 0x7ffbd811dc40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.090+0000 7ffbdf59d700 1 --2- 172.21.15.72:0/2472041420 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbd809e1e0 0x7ffbd811e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.090+0000 7ffbdf59d700 1 -- 172.21.15.72:0/2472041420 >> 172.21.15.72:0/2472041420 conn(0x7ffbd80a2e20 msgr2=0x7ffbd8070910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.090+0000 7ffbdf59d700 1 -- 172.21.15.72:0/2472041420 shutdown_connections 2023-10-03T10:17:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.090+0000 7ffbdf59d700 1 -- 172.21.15.72:0/2472041420 wait complete. 2023-10-03T10:17:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.096+0000 7f5be1b4c700 1 -- 172.21.15.72:0/2596799357 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5bdc132b40 con 0x7f5bdc09e000 2023-10-03T10:17:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.096+0000 7f5bc3fff700 1 -- 172.21.15.72:0/2596799357 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5bdc132b40 con 0x7f5bdc09e000 2023-10-03T10:17:00.097 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:00.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.098+0000 7f5be1b4c700 1 -- 172.21.15.72:0/2596799357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5bdc09e000 msgr2=0x7f5bdc12f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.098+0000 7f5be1b4c700 1 --2- 172.21.15.72:0/2596799357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5bdc09e000 0x7f5bdc12f420 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0010f50 tx=0x7f5bd000b420 comp rx=0 tx=0).stop 2023-10-03T10:17:00.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.098+0000 7f5be1b4c700 1 -- 172.21.15.72:0/2596799357 shutdown_connections 2023-10-03T10:17:00.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.098+0000 7f5be1b4c700 1 --2- 172.21.15.72:0/2596799357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5bdc09d6f0 0x7f5bdc12eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.098+0000 7f5be1b4c700 1 --2- 172.21.15.72:0/2596799357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5bdc09e410 0x7f5bdc12f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.098+0000 7f5be1b4c700 1 --2- 172.21.15.72:0/2596799357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5bdc09e000 0x7f5bdc12f420 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.098+0000 7f5be1b4c700 1 -- 172.21.15.72:0/2596799357 >> 172.21.15.72:0/2596799357 conn(0x7f5bdc066f50 msgr2=0x7f5bdc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.099+0000 7f5be1b4c700 1 -- 172.21.15.72:0/2596799357 shutdown_connections 2023-10-03T10:17:00.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.099+0000 7f5be1b4c700 1 -- 172.21.15.72:0/2596799357 wait complete. 2023-10-03T10:17:00.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:00.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:00.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:00.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.272+0000 7f8049c50700 1 Processor -- start 2023-10-03T10:17:00.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.272+0000 7f8049c50700 1 -- start start 2023-10-03T10:17:00.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.272+0000 7f8049c50700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f804409e930 0x7f804409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.272+0000 7f8049c50700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f804409f240 0x7f80441317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.272+0000 7f8049c50700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804409f650 0x7f8044131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.272+0000 7f8049c50700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8044070940 con 0x7f804409e930 2023-10-03T10:17:00.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.272+0000 7f8049c50700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804406fd60 con 0x7f804409f650 2023-10-03T10:17:00.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.272+0000 7f8049c50700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f804406fa80 con 0x7f804409f240 2023-10-03T10:17:00.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.272+0000 7f8042ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f804409f240 0x7f80441317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.272+0000 7f8043fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804409f650 0x7f8044131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.272+0000 7f80437fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f804409e930 0x7f804409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.272+0000 7f8043fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804409f650 0x7f8044131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59234/0 (socket says 172.21.15.72:59234) 2023-10-03T10:17:00.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.272+0000 7f8042ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f804409f240 0x7f80441317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39672/0 (socket says 172.21.15.72:39672) 2023-10-03T10:17:00.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.272+0000 7f80437fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f804409e930 0x7f804409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40726/0 (socket says 172.21.15.72:40726) 2023-10-03T10:17:00.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.272+0000 7f8043fff700 1 -- 172.21.15.72:0/3197082578 learned_addr learned my addr 172.21.15.72:0/3197082578 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:00.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.273+0000 7f80437fe700 1 -- 172.21.15.72:0/3197082578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f804409f240 msgr2=0x7f80441317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.273+0000 7f80437fe700 1 --2- 172.21.15.72:0/3197082578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f804409f240 0x7f80441317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.273+0000 7f80437fe700 1 -- 172.21.15.72:0/3197082578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804409f650 msgr2=0x7f8044131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.273+0000 7f80437fe700 1 --2- 172.21.15.72:0/3197082578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804409f650 0x7f8044131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.273+0000 7f80437fe700 1 -- 172.21.15.72:0/3197082578 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804409fb60 con 0x7f804409e930 2023-10-03T10:17:00.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.273+0000 7f8042ffd700 1 --2- 172.21.15.72:0/3197082578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f804409f240 0x7f80441317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:00.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.273+0000 7f8043fff700 1 --2- 172.21.15.72:0/3197082578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804409f650 0x7f8044131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:00.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.273+0000 7f80437fe700 1 --2- 172.21.15.72:0/3197082578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f804409e930 0x7f804409ed00 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f8034009840 tx=0x7f8034009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7139399a030630e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.273+0000 7f80427fc700 1 -- 172.21.15.72:0/3197082578 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034011830 con 0x7f804409e930 2023-10-03T10:17:00.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.273+0000 7f80427fc700 1 -- 172.21.15.72:0/3197082578 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8034011990 con 0x7f804409e930 2023-10-03T10:17:00.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.273+0000 7f80427fc700 1 -- 172.21.15.72:0/3197082578 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034011d20 con 0x7f804409e930 2023-10-03T10:17:00.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.274+0000 7f8049c50700 1 -- 172.21.15.72:0/3197082578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f804409e930 msgr2=0x7f804409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.274+0000 7f8049c50700 1 --2- 172.21.15.72:0/3197082578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f804409e930 0x7f804409ed00 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f8034009840 tx=0x7f8034009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:00.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.274+0000 7f8049c50700 1 -- 172.21.15.72:0/3197082578 shutdown_connections 2023-10-03T10:17:00.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.274+0000 7f8049c50700 1 --2- 172.21.15.72:0/3197082578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804409f650 0x7f8044131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.274+0000 7f8049c50700 1 --2- 172.21.15.72:0/3197082578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f804409e930 0x7f804409ed00 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.274+0000 7f8049c50700 1 --2- 172.21.15.72:0/3197082578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f804409f240 0x7f80441317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.274+0000 7f8049c50700 1 -- 172.21.15.72:0/3197082578 >> 172.21.15.72:0/3197082578 conn(0x7f80440a4210 msgr2=0x7f80440a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.274+0000 7f8049c50700 1 -- 172.21.15.72:0/3197082578 shutdown_connections 2023-10-03T10:17:00.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.274+0000 7f8049c50700 1 -- 172.21.15.72:0/3197082578 wait complete. 2023-10-03T10:17:00.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.275+0000 7f8049c50700 1 Processor -- start 2023-10-03T10:17:00.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.275+0000 7f8049c50700 1 -- start start 2023-10-03T10:17:00.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.275+0000 7f8049c50700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f804409e930 0x7f804406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.275+0000 7f8049c50700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804409f240 0x7f804406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.275+0000 7f8049c50700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f804409f650 0x7f804406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.275+0000 7f8049c50700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80440a3410 con 0x7f804409f650 2023-10-03T10:17:00.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.275+0000 7f8049c50700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8044071d20 con 0x7f804409f240 2023-10-03T10:17:00.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.275+0000 7f8049c50700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80441a8a30 con 0x7f804409e930 2023-10-03T10:17:00.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.275+0000 7f8042ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804409f240 0x7f804406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.275+0000 7f8043fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f804409f650 0x7f804406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.275+0000 7f8042ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804409f240 0x7f804406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59240/0 (socket says 172.21.15.72:59240) 2023-10-03T10:17:00.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.275+0000 7f8042ffd700 1 -- 172.21.15.72:0/3448348085 learned_addr learned my addr 172.21.15.72:0/3448348085 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:00.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.275+0000 7f80437fe700 1 --2- 172.21.15.72:0/3448348085 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f804409e930 0x7f804406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.276+0000 7f8043fff700 1 -- 172.21.15.72:0/3448348085 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f804409e930 msgr2=0x7f804406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.276+0000 7f8043fff700 1 --2- 172.21.15.72:0/3448348085 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f804409e930 0x7f804406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.276+0000 7f8043fff700 1 -- 172.21.15.72:0/3448348085 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804409f240 msgr2=0x7f804406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.276+0000 7f8043fff700 1 --2- 172.21.15.72:0/3448348085 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804409f240 0x7f804406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.276+0000 7f8043fff700 1 -- 172.21.15.72:0/3448348085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80380094a0 con 0x7f804409f650 2023-10-03T10:17:00.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.276+0000 7f8042ffd700 1 --2- 172.21.15.72:0/3448348085 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804409f240 0x7f804406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:00.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.276+0000 7f8043fff700 1 --2- 172.21.15.72:0/3448348085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f804409f650 0x7f804406c330 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f803c00efc0 tx=0x7f803c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.276+0000 7f802bfff700 1 -- 172.21.15.72:0/3448348085 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c018070 con 0x7f804409f650 2023-10-03T10:17:00.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.276+0000 7f802bfff700 1 -- 172.21.15.72:0/3448348085 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c00f040 con 0x7f804409f650 2023-10-03T10:17:00.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.276+0000 7f802bfff700 1 -- 172.21.15.72:0/3448348085 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c003c60 con 0x7f804409f650 2023-10-03T10:17:00.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.276+0000 7f8049c50700 1 -- 172.21.15.72:0/3448348085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803c009b30 con 0x7f804409f650 2023-10-03T10:17:00.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.276+0000 7f8049c50700 1 -- 172.21.15.72:0/3448348085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80340094a0 con 0x7f804409f650 2023-10-03T10:17:00.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.277+0000 7f802bfff700 1 -- 172.21.15.72:0/3448348085 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f803c00c880 con 0x7f804409f650 2023-10-03T10:17:00.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.277+0000 7f802bfff700 1 -- 172.21.15.72:0/3448348085 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f803c03f720 con 0x7f804409f650 2023-10-03T10:17:00.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.277+0000 7f8049c50700 1 -- 172.21.15.72:0/3448348085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80441a0b30 con 0x7f804409f650 2023-10-03T10:17:00.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.281+0000 7f802bfff700 1 -- 172.21.15.72:0/3448348085 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f803c003dc0 con 0x7f804409f650 2023-10-03T10:17:00.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.467+0000 7f8049c50700 1 -- 172.21.15.72:0/3448348085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8044074ea0 con 0x7f804409f650 2023-10-03T10:17:00.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.467+0000 7f802bfff700 1 -- 172.21.15.72:0/3448348085 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f803c01cbb0 con 0x7f804409f650 2023-10-03T10:17:00.468 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:00.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.469+0000 7f8049c50700 1 -- 172.21.15.72:0/3448348085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f804409f650 msgr2=0x7f804406c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.469+0000 7f8049c50700 1 --2- 172.21.15.72:0/3448348085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f804409f650 0x7f804406c330 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f803c00efc0 tx=0x7f803c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.469+0000 7f8049c50700 1 -- 172.21.15.72:0/3448348085 shutdown_connections 2023-10-03T10:17:00.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.469+0000 7f8049c50700 1 --2- 172.21.15.72:0/3448348085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f804409f650 0x7f804406c330 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.469+0000 7f8049c50700 1 --2- 172.21.15.72:0/3448348085 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f804409e930 0x7f804406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.469+0000 7f8049c50700 1 --2- 172.21.15.72:0/3448348085 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f804409f240 0x7f804406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.470+0000 7f8049c50700 1 -- 172.21.15.72:0/3448348085 >> 172.21.15.72:0/3448348085 conn(0x7f80440a4210 msgr2=0x7f80441b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.470+0000 7f8049c50700 1 -- 172.21.15.72:0/3448348085 shutdown_connections 2023-10-03T10:17:00.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:00.470+0000 7f8049c50700 1 -- 172.21.15.72:0/3448348085 wait complete. 2023-10-03T10:17:00.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:00.990 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:01.104 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:01.112 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:01.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.115+0000 7f443ce4d700 1 Processor -- start 2023-10-03T10:17:01.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.115+0000 7f443ce4d700 1 -- start start 2023-10-03T10:17:01.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f443ce4d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f44380a0a30 0x7f44380a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f443ce4d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f443809d630 0x7f44380a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f443ce4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4438133930 0x7f4438133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f443ce4d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44380a2a70 con 0x7f44380a0a30 2023-10-03T10:17:01.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f443ce4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44380a01d0 con 0x7f4438133930 2023-10-03T10:17:01.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f443ce4d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f443809e2b0 con 0x7f443809d630 2023-10-03T10:17:01.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f4435d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f443809d630 0x7f44380a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f4436d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4438133930 0x7f4438133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f4436d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4438133930 0x7f4438133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59252/0 (socket says 172.21.15.72:59252) 2023-10-03T10:17:01.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f4435d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f443809d630 0x7f44380a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39690/0 (socket says 172.21.15.72:39690) 2023-10-03T10:17:01.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f4436d9d700 1 -- 172.21.15.72:0/2960318893 learned_addr learned my addr 172.21.15.72:0/2960318893 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:01.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f443659c700 1 --2- 172.21.15.72:0/2960318893 >> v2:172.21.15.72:3300/0 conn(0x7f44380a0a30 0x7f44380a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f4436d9d700 1 -- 172.21.15.72:0/2960318893 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f443809d630 msgr2=0x7f44380a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:01.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f4436d9d700 1 --2- 172.21.15.72:0/2960318893 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f443809d630 0x7f44380a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f4436d9d700 1 -- 172.21.15.72:0/2960318893 >> v2:172.21.15.72:3300/0 conn(0x7f44380a0a30 msgr2=0x7f44380a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:01.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f4436d9d700 1 --2- 172.21.15.72:0/2960318893 >> v2:172.21.15.72:3300/0 conn(0x7f44380a0a30 0x7f44380a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f4436d9d700 1 -- 172.21.15.72:0/2960318893 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443809dc50 con 0x7f4438133930 2023-10-03T10:17:01.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.116+0000 7f443659c700 1 --2- 172.21.15.72:0/2960318893 >> v2:172.21.15.72:3300/0 conn(0x7f44380a0a30 0x7f44380a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.117+0000 7f4436d9d700 1 --2- 172.21.15.72:0/2960318893 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4438133930 0x7f4438133db0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4430009e50 tx=0x7f443000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df6ac4d8379b25be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.117+0000 7f443559a700 1 -- 172.21.15.72:0/2960318893 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443000e070 con 0x7f4438133930 2023-10-03T10:17:01.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.117+0000 7f443559a700 1 -- 172.21.15.72:0/2960318893 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443000b910 con 0x7f4438133930 2023-10-03T10:17:01.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.117+0000 7f443559a700 1 -- 172.21.15.72:0/2960318893 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443000bcc0 con 0x7f4438133930 2023-10-03T10:17:01.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.117+0000 7f443ce4d700 1 -- 172.21.15.72:0/2960318893 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4438133930 msgr2=0x7f4438133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.117+0000 7f443ce4d700 1 --2- 172.21.15.72:0/2960318893 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4438133930 0x7f4438133db0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4430009e50 tx=0x7f443000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:01.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.118+0000 7f443ce4d700 1 -- 172.21.15.72:0/2960318893 shutdown_connections 2023-10-03T10:17:01.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.118+0000 7f443ce4d700 1 --2- 172.21.15.72:0/2960318893 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4438133930 0x7f4438133db0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.118+0000 7f443ce4d700 1 --2- 172.21.15.72:0/2960318893 >> v2:172.21.15.72:3300/0 conn(0x7f44380a0a30 0x7f44380a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.118+0000 7f443ce4d700 1 --2- 172.21.15.72:0/2960318893 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f443809d630 0x7f44380a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.118+0000 7f443ce4d700 1 -- 172.21.15.72:0/2960318893 >> 172.21.15.72:0/2960318893 conn(0x7f44380a3050 msgr2=0x7f44380a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.118+0000 7f443ce4d700 1 -- 172.21.15.72:0/2960318893 shutdown_connections 2023-10-03T10:17:01.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.118+0000 7f443ce4d700 1 -- 172.21.15.72:0/2960318893 wait complete. 2023-10-03T10:17:01.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.119+0000 7f443ce4d700 1 Processor -- start 2023-10-03T10:17:01.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.119+0000 7f443ce4d700 1 -- start start 2023-10-03T10:17:01.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.119+0000 7f443ce4d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f443809d630 0x7f443811e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.119+0000 7f443ce4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44380a0a30 0x7f443811ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.119+0000 7f443ce4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4438133930 0x7f443811f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.119+0000 7f443ce4d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4438120a40 con 0x7f44380a0a30 2023-10-03T10:17:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.119+0000 7f443ce4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44380a0480 con 0x7f4438133930 2023-10-03T10:17:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.119+0000 7f443ce4d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44381205a0 con 0x7f443809d630 2023-10-03T10:17:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.119+0000 7f443659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f443809d630 0x7f443811e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.119+0000 7f443659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f443809d630 0x7f443811e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39692/0 (socket says 172.21.15.72:39692) 2023-10-03T10:17:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.119+0000 7f443659c700 1 -- 172.21.15.72:0/1312604851 learned_addr learned my addr 172.21.15.72:0/1312604851 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.119+0000 7f4436d9d700 1 --2- 172.21.15.72:0/1312604851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4438133930 0x7f443811f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.119+0000 7f4435d9b700 1 --2- 172.21.15.72:0/1312604851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44380a0a30 0x7f443811ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.120+0000 7f443659c700 1 -- 172.21.15.72:0/1312604851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4438133930 msgr2=0x7f443811f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.120+0000 7f443659c700 1 --2- 172.21.15.72:0/1312604851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4438133930 0x7f443811f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.120+0000 7f443659c700 1 -- 172.21.15.72:0/1312604851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44380a0a30 msgr2=0x7f443811ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.120+0000 7f443659c700 1 --2- 172.21.15.72:0/1312604851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44380a0a30 0x7f443811ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.120+0000 7f443659c700 1 -- 172.21.15.72:0/1312604851 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44280094a0 con 0x7f443809d630 2023-10-03T10:17:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.120+0000 7f4435d9b700 1 --2- 172.21.15.72:0/1312604851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44380a0a30 0x7f443811ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.120+0000 7f443659c700 1 --2- 172.21.15.72:0/1312604851 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f443809d630 0x7f443811e810 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f442800ebe0 tx=0x7f442800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.120+0000 7f4426ffd700 1 -- 172.21.15.72:0/1312604851 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442800c7f0 con 0x7f443809d630 2023-10-03T10:17:01.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.120+0000 7f4426ffd700 1 -- 172.21.15.72:0/1312604851 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442800c950 con 0x7f443809d630 2023-10-03T10:17:01.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.120+0000 7f443ce4d700 1 -- 172.21.15.72:0/1312604851 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4430009b30 con 0x7f443809d630 2023-10-03T10:17:01.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.120+0000 7f4426ffd700 1 -- 172.21.15.72:0/1312604851 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442800cce0 con 0x7f443809d630 2023-10-03T10:17:01.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.120+0000 7f443ce4d700 1 -- 172.21.15.72:0/1312604851 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4438122050 con 0x7f443809d630 2023-10-03T10:17:01.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.121+0000 7f443ce4d700 1 -- 172.21.15.72:0/1312604851 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4438120c70 con 0x7f443809d630 2023-10-03T10:17:01.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.122+0000 7f4426ffd700 1 -- 172.21.15.72:0/1312604851 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4428013470 con 0x7f443809d630 2023-10-03T10:17:01.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.122+0000 7f4426ffd700 1 -- 172.21.15.72:0/1312604851 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f442803fed0 con 0x7f443809d630 2023-10-03T10:17:01.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.127+0000 7f4426ffd700 1 -- 172.21.15.72:0/1312604851 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4428013720 con 0x7f443809d630 2023-10-03T10:17:01.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.237+0000 7fb7f4c31700 1 Processor -- start 2023-10-03T10:17:01.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.237+0000 7fb7f4c31700 1 -- start start 2023-10-03T10:17:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.238+0000 7fb7f4c31700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7f009e930 0x7fb7f009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.238+0000 7fb7f4c31700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7f009f240 0x7fb7f01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.238+0000 7fb7f4c31700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f0070940 con 0x7fb7f009f650 2023-10-03T10:17:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.238+0000 7fb7f4c31700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f006fd60 con 0x7fb7f009f240 2023-10-03T10:17:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.238+0000 7fb7f4c31700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f006fa80 con 0x7fb7f009e930 2023-10-03T10:17:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.238+0000 7fb7ee59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7f009e930 0x7fb7f009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.238+0000 7fb7ee59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7f009e930 0x7fb7f009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59280/0 (socket says 172.21.15.72:59280) 2023-10-03T10:17:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.238+0000 7fb7edd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7f009f240 0x7fb7f01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.238+0000 7fb7ee59c700 1 -- 172.21.15.72:0/4018986474 learned_addr learned my addr 172.21.15.72:0/4018986474 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.238+0000 7fb7ee59c700 1 -- 172.21.15.72:0/4018986474 >> v2:172.21.15.72:3300/0 conn(0x7fb7f009f240 msgr2=0x7fb7f01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.238+0000 7fb7ee59c700 1 --2- 172.21.15.72:0/4018986474 >> v2:172.21.15.72:3300/0 conn(0x7fb7f009f240 0x7fb7f01317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.238+0000 7fb7ee59c700 1 -- 172.21.15.72:0/4018986474 >> v1:172.21.15.72:6789/0 conn(0x7fb7f009f650 legacy=0x7fb7f0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.238+0000 7fb7ee59c700 1 -- 172.21.15.72:0/4018986474 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f009fb60 con 0x7fb7f009e930 2023-10-03T10:17:01.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.239+0000 7fb7edd9b700 1 --2- 172.21.15.72:0/4018986474 >> v2:172.21.15.72:3300/0 conn(0x7fb7f009f240 0x7fb7f01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.239+0000 7fb7ee59c700 1 --2- 172.21.15.72:0/4018986474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7f009e930 0x7fb7f009ed00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb7e00098f0 tx=0x7fb7e0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22c12b78e515e147 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.239+0000 7fb7ed59a700 1 -- 172.21.15.72:0/4018986474 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0011830 con 0x7fb7f009e930 2023-10-03T10:17:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.239+0000 7fb7ed59a700 1 -- 172.21.15.72:0/4018986474 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e0011990 con 0x7fb7f009e930 2023-10-03T10:17:01.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.239+0000 7fb7ed59a700 1 -- 172.21.15.72:0/4018986474 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0011d20 con 0x7fb7f009e930 2023-10-03T10:17:01.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.239+0000 7fb7f4c31700 1 -- 172.21.15.72:0/4018986474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7f009e930 msgr2=0x7fb7f009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.239+0000 7fb7f4c31700 1 --2- 172.21.15.72:0/4018986474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7f009e930 0x7fb7f009ed00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb7e00098f0 tx=0x7fb7e0009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:01.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.240+0000 7fb7f4c31700 1 -- 172.21.15.72:0/4018986474 shutdown_connections 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.240+0000 7fb7f4c31700 1 --2- 172.21.15.72:0/4018986474 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7f009e930 0x7fb7f009ed00 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.240+0000 7fb7f4c31700 1 --2- 172.21.15.72:0/4018986474 >> v2:172.21.15.72:3300/0 conn(0x7fb7f009f240 0x7fb7f01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.240+0000 7fb7f4c31700 1 -- 172.21.15.72:0/4018986474 >> 172.21.15.72:0/4018986474 conn(0x7fb7f00a4210 msgr2=0x7fb7f00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.240+0000 7fb7f4c31700 1 -- 172.21.15.72:0/4018986474 shutdown_connections 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.240+0000 7fb7f4c31700 1 -- 172.21.15.72:0/4018986474 wait complete. 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.241+0000 7fb7f4c31700 1 Processor -- start 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.241+0000 7fb7f4c31700 1 -- start start 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.241+0000 7fb7f4c31700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7f009e930 0x7fb7f01a3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.241+0000 7fb7f4c31700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7f009f240 0x7fb7f01a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.241+0000 7fb7f4c31700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7f009f650 0x7fb7f01a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.241+0000 7fb7f4c31700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f01a51b0 con 0x7fb7f009e930 2023-10-03T10:17:01.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.241+0000 7fb7f4c31700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f01a5910 con 0x7fb7f009f240 2023-10-03T10:17:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.241+0000 7fb7f4c31700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f01a6b60 con 0x7fb7f009f650 2023-10-03T10:17:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7edd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7f009f240 0x7fb7f01a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7edd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7f009f240 0x7fb7f01a4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59294/0 (socket says 172.21.15.72:59294) 2023-10-03T10:17:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7edd9b700 1 -- 172.21.15.72:0/3209554708 learned_addr learned my addr 172.21.15.72:0/3209554708 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7eed9d700 1 --2- 172.21.15.72:0/3209554708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7f009f650 0x7fb7f01a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7ee59c700 1 --2- 172.21.15.72:0/3209554708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7f009e930 0x7fb7f01a3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7edd9b700 1 -- 172.21.15.72:0/3209554708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7f009f650 msgr2=0x7fb7f01a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7edd9b700 1 --2- 172.21.15.72:0/3209554708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7f009f650 0x7fb7f01a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7edd9b700 1 -- 172.21.15.72:0/3209554708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7f009e930 msgr2=0x7fb7f01a3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7edd9b700 1 --2- 172.21.15.72:0/3209554708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7f009e930 0x7fb7f01a3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7edd9b700 1 -- 172.21.15.72:0/3209554708 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e40094a0 con 0x7fb7f009f240 2023-10-03T10:17:01.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7edd9b700 1 --2- 172.21.15.72:0/3209554708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7f009f240 0x7fb7f01a4240 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400ebb0 tx=0x7fb7e400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7deffd700 1 -- 172.21.15.72:0/3209554708 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400c850 con 0x7fb7f009f240 2023-10-03T10:17:01.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7deffd700 1 -- 172.21.15.72:0/3209554708 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e400c9b0 con 0x7fb7f009f240 2023-10-03T10:17:01.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7deffd700 1 -- 172.21.15.72:0/3209554708 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400cd40 con 0x7fb7f009f240 2023-10-03T10:17:01.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7f4c31700 1 -- 172.21.15.72:0/3209554708 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e0009550 con 0x7fb7f009f240 2023-10-03T10:17:01.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.242+0000 7fb7f4c31700 1 -- 172.21.15.72:0/3209554708 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f00a0190 con 0x7fb7f009f240 2023-10-03T10:17:01.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.243+0000 7fb7deffd700 1 -- 172.21.15.72:0/3209554708 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7e4013470 con 0x7fb7f009f240 2023-10-03T10:17:01.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.243+0000 7fb7deffd700 1 -- 172.21.15.72:0/3209554708 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb7e403f770 con 0x7fb7f009f240 2023-10-03T10:17:01.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.243+0000 7fb7f4c31700 1 -- 172.21.15.72:0/3209554708 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f01a0b30 con 0x7fb7f009f240 2023-10-03T10:17:01.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.247+0000 7fae8c281700 1 Processor -- start 2023-10-03T10:17:01.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.247+0000 7fae8c281700 1 -- start start 2023-10-03T10:17:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.248+0000 7fae8c281700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae8409d6f0 0x7fae8409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.248+0000 7fae8c281700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fae8409e410 0x7fae84134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.248+0000 7fae8c281700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8409b120 con 0x7fae8409e000 2023-10-03T10:17:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.248+0000 7fae8c281700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8406b460 con 0x7fae8409e410 2023-10-03T10:17:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.248+0000 7fae8c281700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8409a7e0 con 0x7fae8409d6f0 2023-10-03T10:17:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.248+0000 7fae8a01d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae8409d6f0 0x7fae8409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.248+0000 7fae8a01d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae8409d6f0 0x7fae8409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59300/0 (socket says 172.21.15.72:59300) 2023-10-03T10:17:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.248+0000 7fae8a01d700 1 -- 172.21.15.72:0/756393941 learned_addr learned my addr 172.21.15.72:0/756393941 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.248+0000 7fae8a81e700 1 --2- 172.21.15.72:0/756393941 >> v2:172.21.15.72:3300/0 conn(0x7fae8409e410 0x7fae84134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.248+0000 7fae8a01d700 1 -- 172.21.15.72:0/756393941 >> v2:172.21.15.72:3300/0 conn(0x7fae8409e410 msgr2=0x7fae84134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.248+0000 7fae8a01d700 1 --2- 172.21.15.72:0/756393941 >> v2:172.21.15.72:3300/0 conn(0x7fae8409e410 0x7fae84134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.248+0000 7fae8a01d700 1 -- 172.21.15.72:0/756393941 >> v1:172.21.15.72:6789/0 conn(0x7fae8409e000 legacy=0x7fae841339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.248+0000 7fae8a01d700 1 -- 172.21.15.72:0/756393941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8409a500 con 0x7fae8409d6f0 2023-10-03T10:17:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.249+0000 7fae8a01d700 1 --2- 172.21.15.72:0/756393941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae8409d6f0 0x7fae8409dac0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fae80009920 tx=0x7fae80009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2add5500267a4144 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.249+0000 7fae8901b700 1 -- 172.21.15.72:0/756393941 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80011830 con 0x7fae8409d6f0 2023-10-03T10:17:01.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.249+0000 7fb7deffd700 1 -- 172.21.15.72:0/3209554708 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7e4017070 con 0x7fb7f009f240 2023-10-03T10:17:01.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.249+0000 7fae8901b700 1 -- 172.21.15.72:0/756393941 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae80011990 con 0x7fae8409d6f0 2023-10-03T10:17:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.249+0000 7fae8901b700 1 -- 172.21.15.72:0/756393941 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80011d20 con 0x7fae8409d6f0 2023-10-03T10:17:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.249+0000 7fae8c281700 1 -- 172.21.15.72:0/756393941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae8409d6f0 msgr2=0x7fae8409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.249+0000 7fae8c281700 1 --2- 172.21.15.72:0/756393941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae8409d6f0 0x7fae8409dac0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fae80009920 tx=0x7fae80009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.250+0000 7fae8c281700 1 -- 172.21.15.72:0/756393941 shutdown_connections 2023-10-03T10:17:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.250+0000 7fae8c281700 1 --2- 172.21.15.72:0/756393941 >> v2:172.21.15.72:3300/0 conn(0x7fae8409e410 0x7fae84134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.250+0000 7fae8c281700 1 --2- 172.21.15.72:0/756393941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae8409d6f0 0x7fae8409dac0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.250+0000 7fae8c281700 1 -- 172.21.15.72:0/756393941 >> 172.21.15.72:0/756393941 conn(0x7fae84066f50 msgr2=0x7fae8409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.250+0000 7fae8c281700 1 -- 172.21.15.72:0/756393941 shutdown_connections 2023-10-03T10:17:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.250+0000 7fae8c281700 1 -- 172.21.15.72:0/756393941 wait complete. 2023-10-03T10:17:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.251+0000 7fae8c281700 1 Processor -- start 2023-10-03T10:17:01.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.251+0000 7fae8c281700 1 -- start start 2023-10-03T10:17:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8c281700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae8409d6f0 0x7fae841a8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8c281700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae8409e000 0x7fae841a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8c281700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae8409e410 0x7fae841a8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8c281700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae841ab880 con 0x7fae8409d6f0 2023-10-03T10:17:01.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8c281700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8409c710 con 0x7fae8409e410 2023-10-03T10:17:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8c281700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae841a9ba0 con 0x7fae8409e000 2023-10-03T10:17:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8a81e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae8409e410 0x7fae841a8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8a01d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae8409d6f0 0x7fae841a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8a81e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae8409e410 0x7fae841a8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59310/0 (socket says 172.21.15.72:59310) 2023-10-03T10:17:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8981c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae8409e000 0x7fae841a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8a81e700 1 -- 172.21.15.72:0/4213457456 learned_addr learned my addr 172.21.15.72:0/4213457456 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8a01d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae8409d6f0 0x7fae841a8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40782/0 (socket says 172.21.15.72:40782) 2023-10-03T10:17:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8a81e700 1 -- 172.21.15.72:0/4213457456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae8409e000 msgr2=0x7fae841a85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8a81e700 1 --2- 172.21.15.72:0/4213457456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae8409e000 0x7fae841a85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8a81e700 1 -- 172.21.15.72:0/4213457456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae8409d6f0 msgr2=0x7fae841a8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8a81e700 1 --2- 172.21.15.72:0/4213457456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae8409d6f0 0x7fae841a8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8a81e700 1 -- 172.21.15.72:0/4213457456 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae80009550 con 0x7fae8409e410 2023-10-03T10:17:01.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8a01d700 1 --2- 172.21.15.72:0/4213457456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae8409d6f0 0x7fae841a8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae8a81e700 1 --2- 172.21.15.72:0/4213457456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae8409e410 0x7fae841a8af0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009dd0 tx=0x7fae7c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae7affd700 1 -- 172.21.15.72:0/4213457456 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c009c40 con 0x7fae8409e410 2023-10-03T10:17:01.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.252+0000 7fae7affd700 1 -- 172.21.15.72:0/4213457456 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c00f040 con 0x7fae8409e410 2023-10-03T10:17:01.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.253+0000 7fae8c281700 1 -- 172.21.15.72:0/4213457456 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae841abae0 con 0x7fae8409e410 2023-10-03T10:17:01.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.253+0000 7fae7affd700 1 -- 172.21.15.72:0/4213457456 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c00ceb0 con 0x7fae8409e410 2023-10-03T10:17:01.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.253+0000 7fae8c281700 1 -- 172.21.15.72:0/4213457456 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae841aa290 con 0x7fae8409e410 2023-10-03T10:17:01.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.253+0000 7fae7affd700 1 -- 172.21.15.72:0/4213457456 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fae7c014480 con 0x7fae8409e410 2023-10-03T10:17:01.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.253+0000 7fae7affd700 1 -- 172.21.15.72:0/4213457456 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fae7c03fe00 con 0x7fae8409e410 2023-10-03T10:17:01.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.254+0000 7fae8c281700 1 -- 172.21.15.72:0/4213457456 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae84074ea0 con 0x7fae8409e410 2023-10-03T10:17:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.258+0000 7fae7affd700 1 -- 172.21.15.72:0/4213457456 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fae7c018020 con 0x7fae8409e410 2023-10-03T10:17:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.323+0000 7f443ce4d700 1 -- 172.21.15.72:0/1312604851 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f44380747f0 con 0x7f443809d630 2023-10-03T10:17:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.323+0000 7f4426ffd700 1 -- 172.21.15.72:0/1312604851 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4428021020 con 0x7f443809d630 2023-10-03T10:17:01.324 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.326+0000 7f443ce4d700 1 -- 172.21.15.72:0/1312604851 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f443809d630 msgr2=0x7f443811e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.326+0000 7f443ce4d700 1 --2- 172.21.15.72:0/1312604851 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f443809d630 0x7f443811e810 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f442800ebe0 tx=0x7f442800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.326+0000 7f443ce4d700 1 -- 172.21.15.72:0/1312604851 shutdown_connections 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.326+0000 7f443ce4d700 1 --2- 172.21.15.72:0/1312604851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4438133930 0x7f443811f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.326+0000 7f443ce4d700 1 --2- 172.21.15.72:0/1312604851 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f443809d630 0x7f443811e810 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.326+0000 7f443ce4d700 1 --2- 172.21.15.72:0/1312604851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44380a0a30 0x7f443811ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.326+0000 7f443ce4d700 1 -- 172.21.15.72:0/1312604851 >> 172.21.15.72:0/1312604851 conn(0x7f44380a3050 msgr2=0x7f44381bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.326+0000 7f443ce4d700 1 -- 172.21.15.72:0/1312604851 shutdown_connections 2023-10-03T10:17:01.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.326+0000 7f443ce4d700 1 -- 172.21.15.72:0/1312604851 wait complete. 2023-10-03T10:17:01.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:01.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.455+0000 7fb7f4c31700 1 -- 172.21.15.72:0/3209554708 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb7f00a34c0 con 0x7fb7f009f240 2023-10-03T10:17:01.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.456+0000 7fb7deffd700 1 -- 172.21.15.72:0/3209554708 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb7e4017070 con 0x7fb7f009f240 2023-10-03T10:17:01.456 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:01.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.457+0000 7fb7f4c31700 1 -- 172.21.15.72:0/3209554708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7f009f240 msgr2=0x7fb7f01a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.457+0000 7fb7f4c31700 1 --2- 172.21.15.72:0/3209554708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7f009f240 0x7fb7f01a4240 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400ebb0 tx=0x7fb7e400eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.457+0000 7fb7f4c31700 1 -- 172.21.15.72:0/3209554708 shutdown_connections 2023-10-03T10:17:01.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.457+0000 7fb7f4c31700 1 --2- 172.21.15.72:0/3209554708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7f009e930 0x7fb7f01a3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.457+0000 7fb7f4c31700 1 --2- 172.21.15.72:0/3209554708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7f009f650 0x7fb7f01a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.457+0000 7fb7f4c31700 1 --2- 172.21.15.72:0/3209554708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7f009f240 0x7fb7f01a4240 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.457+0000 7fb7f4c31700 1 -- 172.21.15.72:0/3209554708 >> 172.21.15.72:0/3209554708 conn(0x7fb7f00a4210 msgr2=0x7fb7f01b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.458+0000 7fb7f4c31700 1 -- 172.21.15.72:0/3209554708 shutdown_connections 2023-10-03T10:17:01.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.458+0000 7fb7f4c31700 1 -- 172.21.15.72:0/3209554708 wait complete. 2023-10-03T10:17:01.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.464+0000 7fae8c281700 1 -- 172.21.15.72:0/4213457456 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae8406c360 con 0x7fae8409e410 2023-10-03T10:17:01.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.464+0000 7fae7affd700 1 -- 172.21.15.72:0/4213457456 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fae7c0114a0 con 0x7fae8409e410 2023-10-03T10:17:01.465 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:01.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.467+0000 7fae8c281700 1 -- 172.21.15.72:0/4213457456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae8409e410 msgr2=0x7fae841a8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.467+0000 7fae8c281700 1 --2- 172.21.15.72:0/4213457456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae8409e410 0x7fae841a8af0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009dd0 tx=0x7fae7c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.467+0000 7fae8c281700 1 -- 172.21.15.72:0/4213457456 shutdown_connections 2023-10-03T10:17:01.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.467+0000 7fae8c281700 1 --2- 172.21.15.72:0/4213457456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae8409d6f0 0x7fae841a8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.467+0000 7fae8c281700 1 --2- 172.21.15.72:0/4213457456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae8409e410 0x7fae841a8af0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.467+0000 7fae8c281700 1 --2- 172.21.15.72:0/4213457456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fae8409e000 0x7fae841a85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.467+0000 7fae8c281700 1 -- 172.21.15.72:0/4213457456 >> 172.21.15.72:0/4213457456 conn(0x7fae84066f50 msgr2=0x7fae8406f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.467+0000 7fae8c281700 1 -- 172.21.15.72:0/4213457456 shutdown_connections 2023-10-03T10:17:01.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.467+0000 7fae8c281700 1 -- 172.21.15.72:0/4213457456 wait complete. 2023-10-03T10:17:01.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:01.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:01.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:01.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.642+0000 7f17c7aa1700 1 Processor -- start 2023-10-03T10:17:01.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.642+0000 7f17c7aa1700 1 -- start start 2023-10-03T10:17:01.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.642+0000 7f17c7aa1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17c009e1d0 0x7f17c0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.642+0000 7f17c7aa1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17c0139170 0x7f17c013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.642+0000 7f17c7aa1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c009b120 con 0x7f17c009d6f0 2023-10-03T10:17:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.642+0000 7f17c7aa1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c006b460 con 0x7f17c0139170 2023-10-03T10:17:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.642+0000 7f17c7aa1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c009a7e0 con 0x7f17c009e1d0 2023-10-03T10:17:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.643+0000 7f17c603e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17c0139170 0x7f17c013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.643+0000 7f17c503c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17c009e1d0 0x7f17c0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.643+0000 7f17c603e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17c0139170 0x7f17c013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40786/0 (socket says 172.21.15.72:40786) 2023-10-03T10:17:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.643+0000 7f17c603e700 1 -- 172.21.15.72:0/1522982316 learned_addr learned my addr 172.21.15.72:0/1522982316 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.643+0000 7f17c503c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17c009e1d0 0x7f17c0138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59322/0 (socket says 172.21.15.72:59322) 2023-10-03T10:17:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.643+0000 7f17c503c700 1 -- 172.21.15.72:0/1522982316 >> v2:172.21.15.72:3300/0 conn(0x7f17c0139170 msgr2=0x7f17c013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.643+0000 7f17c503c700 1 --2- 172.21.15.72:0/1522982316 >> v2:172.21.15.72:3300/0 conn(0x7f17c0139170 0x7f17c013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.643+0000 7f17c503c700 1 -- 172.21.15.72:0/1522982316 >> v1:172.21.15.72:6789/0 conn(0x7f17c009d6f0 legacy=0x7f17c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.643+0000 7f17c503c700 1 -- 172.21.15.72:0/1522982316 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c009a500 con 0x7f17c009e1d0 2023-10-03T10:17:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.643+0000 7f17c603e700 1 --2- 172.21.15.72:0/1522982316 >> v2:172.21.15.72:3300/0 conn(0x7f17c0139170 0x7f17c013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.643+0000 7f17c503c700 1 --2- 172.21.15.72:0/1522982316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17c009e1d0 0x7f17c0138c30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009870 tx=0x7f17b0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6212363fab07d9b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.643+0000 7f17c483b700 1 -- 172.21.15.72:0/1522982316 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0011830 con 0x7f17c009e1d0 2023-10-03T10:17:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.643+0000 7f17c483b700 1 -- 172.21.15.72:0/1522982316 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b0011990 con 0x7f17c009e1d0 2023-10-03T10:17:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.643+0000 7f17c483b700 1 -- 172.21.15.72:0/1522982316 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0011d20 con 0x7f17c009e1d0 2023-10-03T10:17:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.644+0000 7f17c7aa1700 1 -- 172.21.15.72:0/1522982316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17c009e1d0 msgr2=0x7f17c0138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.644+0000 7f17c7aa1700 1 --2- 172.21.15.72:0/1522982316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17c009e1d0 0x7f17c0138c30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009870 tx=0x7f17b0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.644+0000 7f17c7aa1700 1 -- 172.21.15.72:0/1522982316 shutdown_connections 2023-10-03T10:17:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.644+0000 7f17c7aa1700 1 --2- 172.21.15.72:0/1522982316 >> v2:172.21.15.72:3300/0 conn(0x7f17c0139170 0x7f17c013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.644+0000 7f17c7aa1700 1 --2- 172.21.15.72:0/1522982316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17c009e1d0 0x7f17c0138c30 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.644+0000 7f17c7aa1700 1 -- 172.21.15.72:0/1522982316 >> 172.21.15.72:0/1522982316 conn(0x7f17c0066f50 msgr2=0x7f17c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.644+0000 7f17c7aa1700 1 -- 172.21.15.72:0/1522982316 shutdown_connections 2023-10-03T10:17:01.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.644+0000 7f17c7aa1700 1 -- 172.21.15.72:0/1522982316 wait complete. 2023-10-03T10:17:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c7aa1700 1 Processor -- start 2023-10-03T10:17:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c7aa1700 1 -- start start 2023-10-03T10:17:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c7aa1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17c009d6f0 0x7f17c01c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c7aa1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c009e1d0 0x7f17c01c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c7aa1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f17c0139170 0x7f17c0120840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c7aa1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c0124180 con 0x7f17c009e1d0 2023-10-03T10:17:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c7aa1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c0124360 con 0x7f17c009d6f0 2023-10-03T10:17:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c7aa1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17c01be250 con 0x7f17c0139170 2023-10-03T10:17:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c583d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17c009d6f0 0x7f17c01c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c583d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17c009d6f0 0x7f17c01c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59338/0 (socket says 172.21.15.72:59338) 2023-10-03T10:17:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c583d700 1 -- 172.21.15.72:0/1707754058 learned_addr learned my addr 172.21.15.72:0/1707754058 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:01.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c603e700 1 --2- 172.21.15.72:0/1707754058 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f17c0139170 0x7f17c0120840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c503c700 1 --2- 172.21.15.72:0/1707754058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c009e1d0 0x7f17c01c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c583d700 1 -- 172.21.15.72:0/1707754058 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f17c0139170 msgr2=0x7f17c0120840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c583d700 1 --2- 172.21.15.72:0/1707754058 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f17c0139170 0x7f17c0120840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c583d700 1 -- 172.21.15.72:0/1707754058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c009e1d0 msgr2=0x7f17c01c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c583d700 1 --2- 172.21.15.72:0/1707754058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c009e1d0 0x7f17c01c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.645+0000 7f17c583d700 1 -- 172.21.15.72:0/1707754058 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b8009b30 con 0x7f17c009d6f0 2023-10-03T10:17:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.646+0000 7f17c583d700 1 --2- 172.21.15.72:0/1707754058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17c009d6f0 0x7f17c01c8610 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00c4e0 tx=0x7f17bc00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.646+0000 7f17b67fc700 1 -- 172.21.15.72:0/1707754058 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0052d0 con 0x7f17c009d6f0 2023-10-03T10:17:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.646+0000 7f17b67fc700 1 -- 172.21.15.72:0/1707754058 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc005430 con 0x7f17c009d6f0 2023-10-03T10:17:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.646+0000 7f17c7aa1700 1 -- 172.21.15.72:0/1707754058 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b00094a0 con 0x7f17c009d6f0 2023-10-03T10:17:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.646+0000 7f17b67fc700 1 -- 172.21.15.72:0/1707754058 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0038c0 con 0x7f17c009d6f0 2023-10-03T10:17:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.646+0000 7f17c7aa1700 1 -- 172.21.15.72:0/1707754058 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c0123dc0 con 0x7f17c009d6f0 2023-10-03T10:17:01.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.647+0000 7f17b67fc700 1 -- 172.21.15.72:0/1707754058 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17bc003a20 con 0x7f17c009d6f0 2023-10-03T10:17:01.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.647+0000 7f17b67fc700 1 -- 172.21.15.72:0/1707754058 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f17bc03e9d0 con 0x7f17c009d6f0 2023-10-03T10:17:01.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.647+0000 7f17c7aa1700 1 -- 172.21.15.72:0/1707754058 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c0123fb0 con 0x7f17c009d6f0 2023-10-03T10:17:01.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.651+0000 7f17b67fc700 1 -- 172.21.15.72:0/1707754058 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17bc017020 con 0x7f17c009d6f0 2023-10-03T10:17:01.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.837+0000 7f17c7aa1700 1 -- 172.21.15.72:0/1707754058 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f17c009f420 con 0x7f17c009d6f0 2023-10-03T10:17:01.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.837+0000 7f17b67fc700 1 -- 172.21.15.72:0/1707754058 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17bc018260 con 0x7f17c009d6f0 2023-10-03T10:17:01.838 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:01.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.839+0000 7f17c7aa1700 1 -- 172.21.15.72:0/1707754058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17c009d6f0 msgr2=0x7f17c01c8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.839+0000 7f17c7aa1700 1 --2- 172.21.15.72:0/1707754058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17c009d6f0 0x7f17c01c8610 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00c4e0 tx=0x7f17bc00c7f0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.839+0000 7f17c7aa1700 1 -- 172.21.15.72:0/1707754058 shutdown_connections 2023-10-03T10:17:01.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.839+0000 7f17c7aa1700 1 --2- 172.21.15.72:0/1707754058 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f17c0139170 0x7f17c0120840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.839+0000 7f17c7aa1700 1 --2- 172.21.15.72:0/1707754058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17c009d6f0 0x7f17c01c8610 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.839+0000 7f17c7aa1700 1 --2- 172.21.15.72:0/1707754058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17c009e1d0 0x7f17c01c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.839+0000 7f17c7aa1700 1 -- 172.21.15.72:0/1707754058 >> 172.21.15.72:0/1707754058 conn(0x7f17c0066f50 msgr2=0x7f17c009b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.839+0000 7f17c7aa1700 1 -- 172.21.15.72:0/1707754058 shutdown_connections 2023-10-03T10:17:01.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:01.839+0000 7f17c7aa1700 1 -- 172.21.15.72:0/1707754058 wait complete. 2023-10-03T10:17:01.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:02.340 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:02.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.465+0000 7f08f19c5700 1 Processor -- start 2023-10-03T10:17:02.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.465+0000 7f08f19c5700 1 -- start start 2023-10-03T10:17:02.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.465+0000 7f08f19c5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f08ec0a0a30 0x7f08ec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.465+0000 7f08f19c5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f08ec09d630 0x7f08ec0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.465+0000 7f08f19c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08ec133930 0x7f08ec133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.465+0000 7f08f19c5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ec0a2a70 con 0x7f08ec09d630 2023-10-03T10:17:02.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.465+0000 7f08f19c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec0a01d0 con 0x7f08ec133930 2023-10-03T10:17:02.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.465+0000 7f08f19c5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec09e2b0 con 0x7f08ec0a0a30 2023-10-03T10:17:02.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08eaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f08ec0a0a30 0x7f08ec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08ea7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f08ec09d630 0x7f08ec0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08eb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08ec133930 0x7f08ec133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08eaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f08ec0a0a30 0x7f08ec0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39706/0 (socket says 172.21.15.72:39706) 2023-10-03T10:17:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08eaffd700 1 -- 172.21.15.72:0/3145567678 learned_addr learned my addr 172.21.15.72:0/3145567678 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08ea7fc700 1 -- 172.21.15.72:0/3145567678 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f08ec0a0a30 msgr2=0x7f08ec0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08ea7fc700 1 --2- 172.21.15.72:0/3145567678 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f08ec0a0a30 0x7f08ec0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08ea7fc700 1 -- 172.21.15.72:0/3145567678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08ec133930 msgr2=0x7f08ec133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08ea7fc700 1 --2- 172.21.15.72:0/3145567678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08ec133930 0x7f08ec133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08ea7fc700 1 -- 172.21.15.72:0/3145567678 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec09dc50 con 0x7f08ec09d630 2023-10-03T10:17:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08eaffd700 1 --2- 172.21.15.72:0/3145567678 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f08ec0a0a30 0x7f08ec0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08eb7fe700 1 --2- 172.21.15.72:0/3145567678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08ec133930 0x7f08ec133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08ea7fc700 1 --2- 172.21.15.72:0/3145567678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08ec09d630 0x7f08ec0a1340 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009840 tx=0x7f08dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51b24bbbda7db0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08e9ffb700 1 -- 172.21.15.72:0/3145567678 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc011830 con 0x7f08ec09d630 2023-10-03T10:17:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08e9ffb700 1 -- 172.21.15.72:0/3145567678 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08dc011990 con 0x7f08ec09d630 2023-10-03T10:17:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.466+0000 7f08e9ffb700 1 -- 172.21.15.72:0/3145567678 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc011d20 con 0x7f08ec09d630 2023-10-03T10:17:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.467+0000 7f08f19c5700 1 -- 172.21.15.72:0/3145567678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08ec09d630 msgr2=0x7f08ec0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.467+0000 7f08f19c5700 1 --2- 172.21.15.72:0/3145567678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08ec09d630 0x7f08ec0a1340 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009840 tx=0x7f08dc009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.467+0000 7f08f19c5700 1 -- 172.21.15.72:0/3145567678 shutdown_connections 2023-10-03T10:17:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.467+0000 7f08f19c5700 1 --2- 172.21.15.72:0/3145567678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08ec133930 0x7f08ec133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.467+0000 7f08f19c5700 1 --2- 172.21.15.72:0/3145567678 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f08ec0a0a30 0x7f08ec0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.467+0000 7f08f19c5700 1 --2- 172.21.15.72:0/3145567678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08ec09d630 0x7f08ec0a1340 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.467+0000 7f08f19c5700 1 -- 172.21.15.72:0/3145567678 >> 172.21.15.72:0/3145567678 conn(0x7f08ec0a3050 msgr2=0x7f08ec0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.467+0000 7f08f19c5700 1 -- 172.21.15.72:0/3145567678 shutdown_connections 2023-10-03T10:17:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.467+0000 7f08f19c5700 1 -- 172.21.15.72:0/3145567678 wait complete. 2023-10-03T10:17:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.468+0000 7f08f19c5700 1 Processor -- start 2023-10-03T10:17:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.468+0000 7f08f19c5700 1 -- start start 2023-10-03T10:17:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.468+0000 7f08f19c5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f08ec09d630 0x7f08ec1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.468+0000 7f08f19c5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08ec0a0a30 0x7f08ec1c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.468+0000 7f08f19c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08ec133930 0x7f08ec1c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.468+0000 7f08f19c5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec120500 con 0x7f08ec0a0a30 2023-10-03T10:17:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.468+0000 7f08f19c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec120b50 con 0x7f08ec133930 2023-10-03T10:17:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.468+0000 7f08f19c5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec122410 con 0x7f08ec09d630 2023-10-03T10:17:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.468+0000 7f08eb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08ec133930 0x7f08ec1c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.468+0000 7f08eaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f08ec09d630 0x7f08ec1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.468+0000 7f08ea7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08ec0a0a30 0x7f08ec1c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.468+0000 7f08eb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08ec133930 0x7f08ec1c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59360/0 (socket says 172.21.15.72:59360) 2023-10-03T10:17:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.468+0000 7f08eaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f08ec09d630 0x7f08ec1c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39716/0 (socket says 172.21.15.72:39716) 2023-10-03T10:17:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.468+0000 7f08eb7fe700 1 -- 172.21.15.72:0/1715949479 learned_addr learned my addr 172.21.15.72:0/1715949479 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.469+0000 7f08eb7fe700 1 -- 172.21.15.72:0/1715949479 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f08ec09d630 msgr2=0x7f08ec1c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.469+0000 7f08eb7fe700 1 --2- 172.21.15.72:0/1715949479 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f08ec09d630 0x7f08ec1c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.469+0000 7f08eb7fe700 1 -- 172.21.15.72:0/1715949479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08ec0a0a30 msgr2=0x7f08ec1c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.469+0000 7f08eb7fe700 1 --2- 172.21.15.72:0/1715949479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08ec0a0a30 0x7f08ec1c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.469+0000 7f08eb7fe700 1 -- 172.21.15.72:0/1715949479 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e0009550 con 0x7f08ec133930 2023-10-03T10:17:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.469+0000 7f08eaffd700 1 --2- 172.21.15.72:0/1715949479 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f08ec09d630 0x7f08ec1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.469+0000 7f08ea7fc700 1 --2- 172.21.15.72:0/1715949479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08ec0a0a30 0x7f08ec1c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.469+0000 7f08eb7fe700 1 --2- 172.21.15.72:0/1715949479 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08ec133930 0x7f08ec1c8b10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f08e400efc0 tx=0x7f08e400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.469+0000 7f08d3fff700 1 -- 172.21.15.72:0/1715949479 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400ca90 con 0x7f08ec133930 2023-10-03T10:17:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.469+0000 7f08d3fff700 1 -- 172.21.15.72:0/1715949479 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e400f040 con 0x7f08ec133930 2023-10-03T10:17:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.469+0000 7f08f19c5700 1 -- 172.21.15.72:0/1715949479 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e4009a70 con 0x7f08ec133930 2023-10-03T10:17:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.469+0000 7f08d3fff700 1 -- 172.21.15.72:0/1715949479 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400ce10 con 0x7f08ec133930 2023-10-03T10:17:02.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.469+0000 7f08f19c5700 1 -- 172.21.15.72:0/1715949479 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08dc0094a0 con 0x7f08ec133930 2023-10-03T10:17:02.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.470+0000 7f08d3fff700 1 -- 172.21.15.72:0/1715949479 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08e4014480 con 0x7f08ec133930 2023-10-03T10:17:02.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.470+0000 7f08d3fff700 1 -- 172.21.15.72:0/1715949479 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f08e403fcc0 con 0x7f08ec133930 2023-10-03T10:17:02.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.470+0000 7f08f19c5700 1 -- 172.21.15.72:0/1715949479 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ec121f90 con 0x7f08ec133930 2023-10-03T10:17:02.475 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:02.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.475+0000 7f08d3fff700 1 -- 172.21.15.72:0/1715949479 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08ec121f90 con 0x7f08ec133930 2023-10-03T10:17:02.480 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:02.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.600+0000 7f11f1a34700 1 Processor -- start 2023-10-03T10:17:02.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.600+0000 7f11f1a34700 1 -- start start 2023-10-03T10:17:02.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.600+0000 7f11f1a34700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11ec0a0a30 0x7f11ec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.600+0000 7f11f1a34700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f11ec09d630 0x7f11ec0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.600+0000 7f11f1a34700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ec0a2a70 con 0x7f11ec133930 2023-10-03T10:17:02.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.600+0000 7f11f1a34700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ec0a01d0 con 0x7f11ec09d630 2023-10-03T10:17:02.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.600+0000 7f11f1a34700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec09e2b0 con 0x7f11ec0a0a30 2023-10-03T10:17:02.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.601+0000 7f11eaffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11ec0a0a30 0x7f11ec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.601+0000 7f11eaffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11ec0a0a30 0x7f11ec0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59366/0 (socket says 172.21.15.72:59366) 2023-10-03T10:17:02.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.601+0000 7f11eaffd700 1 -- 172.21.15.72:0/2551842226 learned_addr learned my addr 172.21.15.72:0/2551842226 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:02.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.601+0000 7f11ea7fc700 1 --2- 172.21.15.72:0/2551842226 >> v2:172.21.15.72:3300/0 conn(0x7f11ec09d630 0x7f11ec0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.601+0000 7f11eaffd700 1 -- 172.21.15.72:0/2551842226 >> v2:172.21.15.72:3300/0 conn(0x7f11ec09d630 msgr2=0x7f11ec0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.601+0000 7f11eaffd700 1 --2- 172.21.15.72:0/2551842226 >> v2:172.21.15.72:3300/0 conn(0x7f11ec09d630 0x7f11ec0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.601+0000 7f11eaffd700 1 -- 172.21.15.72:0/2551842226 >> v1:172.21.15.72:6789/0 conn(0x7f11ec133930 legacy=0x7f11ec133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.601+0000 7f11eaffd700 1 -- 172.21.15.72:0/2551842226 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec09dc50 con 0x7f11ec0a0a30 2023-10-03T10:17:02.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.601+0000 7f11eaffd700 1 --2- 172.21.15.72:0/2551842226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11ec0a0a30 0x7f11ec0a0e00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0098f0 tx=0x7f11dc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb8d501506d7b93c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.601+0000 7f11e9ffb700 1 -- 172.21.15.72:0/2551842226 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc011830 con 0x7f11ec0a0a30 2023-10-03T10:17:02.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.601+0000 7f11e9ffb700 1 -- 172.21.15.72:0/2551842226 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11dc011990 con 0x7f11ec0a0a30 2023-10-03T10:17:02.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.601+0000 7f11e9ffb700 1 -- 172.21.15.72:0/2551842226 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc011d20 con 0x7f11ec0a0a30 2023-10-03T10:17:02.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.602+0000 7f11f1a34700 1 -- 172.21.15.72:0/2551842226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11ec0a0a30 msgr2=0x7f11ec0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.602+0000 7f11f1a34700 1 --2- 172.21.15.72:0/2551842226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11ec0a0a30 0x7f11ec0a0e00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0098f0 tx=0x7f11dc009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:02.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.602+0000 7f11f1a34700 1 -- 172.21.15.72:0/2551842226 shutdown_connections 2023-10-03T10:17:02.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.602+0000 7f11f1a34700 1 --2- 172.21.15.72:0/2551842226 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11ec0a0a30 0x7f11ec0a0e00 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.602+0000 7f11f1a34700 1 --2- 172.21.15.72:0/2551842226 >> v2:172.21.15.72:3300/0 conn(0x7f11ec09d630 0x7f11ec0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.602+0000 7f11f1a34700 1 -- 172.21.15.72:0/2551842226 >> 172.21.15.72:0/2551842226 conn(0x7f11ec0a3050 msgr2=0x7f11ec0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.602+0000 7f11f1a34700 1 -- 172.21.15.72:0/2551842226 shutdown_connections 2023-10-03T10:17:02.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.602+0000 7f11f1a34700 1 -- 172.21.15.72:0/2551842226 wait complete. 2023-10-03T10:17:02.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.603+0000 7f11f1a34700 1 Processor -- start 2023-10-03T10:17:02.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.603+0000 7f11f1a34700 1 -- start start 2023-10-03T10:17:02.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11f1a34700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11ec09d630 0x7f11ec1c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11f1a34700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ec0a0a30 0x7f11ec1c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11f1a34700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11ec133930 0x7f11ec1c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11f1a34700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec1206c0 con 0x7f11ec0a0a30 2023-10-03T10:17:02.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11f1a34700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec0a5040 con 0x7f11ec133930 2023-10-03T10:17:02.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11f1a34700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec0a0410 con 0x7f11ec09d630 2023-10-03T10:17:02.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11eaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11ec09d630 0x7f11ec1c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11eb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11ec133930 0x7f11ec1c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11eaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11ec09d630 0x7f11ec1c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39732/0 (socket says 172.21.15.72:39732) 2023-10-03T10:17:02.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11ea7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ec0a0a30 0x7f11ec1c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11eaffd700 1 -- 172.21.15.72:0/1790977453 learned_addr learned my addr 172.21.15.72:0/1790977453 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:02.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11eaffd700 1 -- 172.21.15.72:0/1790977453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11ec133930 msgr2=0x7f11ec1c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11eaffd700 1 --2- 172.21.15.72:0/1790977453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11ec133930 0x7f11ec1c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11eaffd700 1 -- 172.21.15.72:0/1790977453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ec0a0a30 msgr2=0x7f11ec1c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11eaffd700 1 --2- 172.21.15.72:0/1790977453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ec0a0a30 0x7f11ec1c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11eaffd700 1 -- 172.21.15.72:0/1790977453 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc009550 con 0x7f11ec09d630 2023-10-03T10:17:02.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.604+0000 7f11ea7fc700 1 --2- 172.21.15.72:0/1790977453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ec0a0a30 0x7f11ec1c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.605+0000 7f11eaffd700 1 --2- 172.21.15.72:0/1790977453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11ec09d630 0x7f11ec1c8170 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f11dc000c00 tx=0x7f11dc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.605+0000 7f11d3fff700 1 -- 172.21.15.72:0/1790977453 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc0036a0 con 0x7f11ec09d630 2023-10-03T10:17:02.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.605+0000 7f11d3fff700 1 -- 172.21.15.72:0/1790977453 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11dc003800 con 0x7f11ec09d630 2023-10-03T10:17:02.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.605+0000 7f11d3fff700 1 -- 172.21.15.72:0/1790977453 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc003bb0 con 0x7f11ec09d630 2023-10-03T10:17:02.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.605+0000 7f11f1a34700 1 -- 172.21.15.72:0/1790977453 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ec122170 con 0x7f11ec09d630 2023-10-03T10:17:02.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.605+0000 7f11f1a34700 1 -- 172.21.15.72:0/1790977453 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ec1211b0 con 0x7f11ec09d630 2023-10-03T10:17:02.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.606+0000 7f11d3fff700 1 -- 172.21.15.72:0/1790977453 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11dc021070 con 0x7f11ec09d630 2023-10-03T10:17:02.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.606+0000 7f11f1a34700 1 -- 172.21.15.72:0/1790977453 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ec0747f0 con 0x7f11ec09d630 2023-10-03T10:17:02.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.606+0000 7f11d3fff700 1 -- 172.21.15.72:0/1790977453 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f11dc040b40 con 0x7f11ec09d630 2023-10-03T10:17:02.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.614+0000 7f11d3fff700 1 -- 172.21.15.72:0/1790977453 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11dc02d3a0 con 0x7f11ec09d630 2023-10-03T10:17:02.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.646+0000 7fd2b5c29700 1 Processor -- start 2023-10-03T10:17:02.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.646+0000 7fd2b5c29700 1 -- start start 2023-10-03T10:17:02.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2b5c29700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2b00a0a30 0x7fd2b00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2b5c29700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2b009d630 0x7fd2b00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2b5c29700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2b0133930 0x7fd2b0133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2b5c29700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b00a2a70 con 0x7fd2b0133930 2023-10-03T10:17:02.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2b5c29700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00a01d0 con 0x7fd2b009d630 2023-10-03T10:17:02.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2b5c29700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b009e2b0 con 0x7fd2b00a0a30 2023-10-03T10:17:02.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2aeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2b009d630 0x7fd2b00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2affff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2b0133930 0x7fd2b0133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2af7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2b00a0a30 0x7fd2b00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2affff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2b0133930 0x7fd2b0133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40846/0 (socket says 172.21.15.72:40846) 2023-10-03T10:17:02.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2af7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2b00a0a30 0x7fd2b00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39736/0 (socket says 172.21.15.72:39736) 2023-10-03T10:17:02.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2aeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2b009d630 0x7fd2b00a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59380/0 (socket says 172.21.15.72:59380) 2023-10-03T10:17:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2affff700 1 -- 172.21.15.72:0/3100269962 learned_addr learned my addr 172.21.15.72:0/3100269962 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2aeffd700 1 -- 172.21.15.72:0/3100269962 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2b00a0a30 msgr2=0x7fd2b00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2aeffd700 1 --2- 172.21.15.72:0/3100269962 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2b00a0a30 0x7fd2b00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2aeffd700 1 -- 172.21.15.72:0/3100269962 >> v2:172.21.15.72:3300/0 conn(0x7fd2b0133930 msgr2=0x7fd2b0133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2aeffd700 1 --2- 172.21.15.72:0/3100269962 >> v2:172.21.15.72:3300/0 conn(0x7fd2b0133930 0x7fd2b0133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2aeffd700 1 -- 172.21.15.72:0/3100269962 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b009dc50 con 0x7fd2b009d630 2023-10-03T10:17:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2af7fe700 1 --2- 172.21.15.72:0/3100269962 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2b00a0a30 0x7fd2b00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.647+0000 7fd2affff700 1 --2- 172.21.15.72:0/3100269962 >> v2:172.21.15.72:3300/0 conn(0x7fd2b0133930 0x7fd2b0133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.648+0000 7fd2aeffd700 1 --2- 172.21.15.72:0/3100269962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2b009d630 0x7fd2b00a1340 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009840 tx=0x7fd2a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=606cdecf157dfffd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.648+0000 7fd2ae7fc700 1 -- 172.21.15.72:0/3100269962 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4011830 con 0x7fd2b009d630 2023-10-03T10:17:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.648+0000 7fd2ae7fc700 1 -- 172.21.15.72:0/3100269962 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a4011990 con 0x7fd2b009d630 2023-10-03T10:17:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.648+0000 7fd2ae7fc700 1 -- 172.21.15.72:0/3100269962 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4011d20 con 0x7fd2b009d630 2023-10-03T10:17:02.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.648+0000 7fd2b5c29700 1 -- 172.21.15.72:0/3100269962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2b009d630 msgr2=0x7fd2b00a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.648+0000 7fd2b5c29700 1 --2- 172.21.15.72:0/3100269962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2b009d630 0x7fd2b00a1340 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009840 tx=0x7fd2a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:02.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.649+0000 7fd2b5c29700 1 -- 172.21.15.72:0/3100269962 shutdown_connections 2023-10-03T10:17:02.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.649+0000 7fd2b5c29700 1 --2- 172.21.15.72:0/3100269962 >> v2:172.21.15.72:3300/0 conn(0x7fd2b0133930 0x7fd2b0133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.649+0000 7fd2b5c29700 1 --2- 172.21.15.72:0/3100269962 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2b00a0a30 0x7fd2b00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.649+0000 7fd2b5c29700 1 --2- 172.21.15.72:0/3100269962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2b009d630 0x7fd2b00a1340 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.649+0000 7fd2b5c29700 1 -- 172.21.15.72:0/3100269962 >> 172.21.15.72:0/3100269962 conn(0x7fd2b00a3050 msgr2=0x7fd2b00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.649+0000 7fd2b5c29700 1 -- 172.21.15.72:0/3100269962 shutdown_connections 2023-10-03T10:17:02.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.649+0000 7fd2b5c29700 1 -- 172.21.15.72:0/3100269962 wait complete. 2023-10-03T10:17:02.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.650+0000 7fd2b5c29700 1 Processor -- start 2023-10-03T10:17:02.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.650+0000 7fd2b5c29700 1 -- start start 2023-10-03T10:17:02.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2b5c29700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2b009d630 0x7fd2b011f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2b5c29700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2b00a0a30 0x7fd2b011f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2b5c29700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2b0133930 0x7fd2b01c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2b5c29700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b011ed60 con 0x7fd2b00a0a30 2023-10-03T10:17:02.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2b5c29700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b01224a0 con 0x7fd2b009d630 2023-10-03T10:17:02.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2b5c29700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b0120490 con 0x7fd2b0133930 2023-10-03T10:17:02.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2af7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2b009d630 0x7fd2b011f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2af7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2b009d630 0x7fd2b011f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59396/0 (socket says 172.21.15.72:59396) 2023-10-03T10:17:02.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2af7fe700 1 -- 172.21.15.72:0/2463663167 learned_addr learned my addr 172.21.15.72:0/2463663167 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:02.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2aeffd700 1 --2- 172.21.15.72:0/2463663167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2b00a0a30 0x7fd2b011f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2affff700 1 --2- 172.21.15.72:0/2463663167 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2b0133930 0x7fd2b01c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2af7fe700 1 -- 172.21.15.72:0/2463663167 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2b0133930 msgr2=0x7fd2b01c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2af7fe700 1 --2- 172.21.15.72:0/2463663167 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2b0133930 0x7fd2b01c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2af7fe700 1 -- 172.21.15.72:0/2463663167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2b00a0a30 msgr2=0x7fd2b011f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2af7fe700 1 --2- 172.21.15.72:0/2463663167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2b00a0a30 0x7fd2b011f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.651+0000 7fd2af7fe700 1 -- 172.21.15.72:0/2463663167 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a00094a0 con 0x7fd2b009d630 2023-10-03T10:17:02.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.652+0000 7fd2af7fe700 1 --2- 172.21.15.72:0/2463663167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2b009d630 0x7fd2b011f2e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000ebe0 tx=0x7fd2a000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.652+0000 7fd297fff700 1 -- 172.21.15.72:0/2463663167 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a000c850 con 0x7fd2b009d630 2023-10-03T10:17:02.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.652+0000 7fd297fff700 1 -- 172.21.15.72:0/2463663167 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a000c9b0 con 0x7fd2b009d630 2023-10-03T10:17:02.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.652+0000 7fd2b5c29700 1 -- 172.21.15.72:0/2463663167 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a8009b30 con 0x7fd2b009d630 2023-10-03T10:17:02.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.652+0000 7fd297fff700 1 -- 172.21.15.72:0/2463663167 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a000cd20 con 0x7fd2b009d630 2023-10-03T10:17:02.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.652+0000 7fd2b5c29700 1 -- 172.21.15.72:0/2463663167 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a40094a0 con 0x7fd2b009d630 2023-10-03T10:17:02.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.653+0000 7fd2b5c29700 1 -- 172.21.15.72:0/2463663167 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b01222e0 con 0x7fd2b009d630 2023-10-03T10:17:02.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.653+0000 7fd297fff700 1 -- 172.21.15.72:0/2463663167 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2a0013470 con 0x7fd2b009d630 2023-10-03T10:17:02.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.653+0000 7fd297fff700 1 -- 172.21.15.72:0/2463663167 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd2a003fb60 con 0x7fd2b009d630 2023-10-03T10:17:02.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.658+0000 7fd297fff700 1 -- 172.21.15.72:0/2463663167 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2b01222e0 con 0x7fd2b009d630 2023-10-03T10:17:02.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.682+0000 7f08f19c5700 1 -- 172.21.15.72:0/1715949479 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f08ec121f90 con 0x7f08ec133930 2023-10-03T10:17:02.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.682+0000 7f08d3fff700 1 -- 172.21.15.72:0/1715949479 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08ec121f90 con 0x7f08ec133930 2023-10-03T10:17:02.683 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:02.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.684+0000 7f08f19c5700 1 -- 172.21.15.72:0/1715949479 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08ec133930 msgr2=0x7f08ec1c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.684+0000 7f08f19c5700 1 --2- 172.21.15.72:0/1715949479 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08ec133930 0x7f08ec1c8b10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f08e400efc0 tx=0x7f08e400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.684+0000 7f08f19c5700 1 -- 172.21.15.72:0/1715949479 shutdown_connections 2023-10-03T10:17:02.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.684+0000 7f08f19c5700 1 --2- 172.21.15.72:0/1715949479 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08ec133930 0x7f08ec1c8b10 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.684+0000 7f08f19c5700 1 --2- 172.21.15.72:0/1715949479 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f08ec09d630 0x7f08ec1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.684+0000 7f08f19c5700 1 --2- 172.21.15.72:0/1715949479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08ec0a0a30 0x7f08ec1c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.684+0000 7f08f19c5700 1 -- 172.21.15.72:0/1715949479 >> 172.21.15.72:0/1715949479 conn(0x7f08ec0a3050 msgr2=0x7f08ec1bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.685+0000 7f08f19c5700 1 -- 172.21.15.72:0/1715949479 shutdown_connections 2023-10-03T10:17:02.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.685+0000 7f08f19c5700 1 -- 172.21.15.72:0/1715949479 wait complete. 2023-10-03T10:17:02.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:02.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.814+0000 7f11f1a34700 1 -- 172.21.15.72:0/1790977453 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f11ec072980 con 0x7f11ec09d630 2023-10-03T10:17:02.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.814+0000 7f11d3fff700 1 -- 172.21.15.72:0/1790977453 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f11dc029030 con 0x7f11ec09d630 2023-10-03T10:17:02.815 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:02.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.816+0000 7f11f1a34700 1 -- 172.21.15.72:0/1790977453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11ec09d630 msgr2=0x7f11ec1c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.816+0000 7f11f1a34700 1 --2- 172.21.15.72:0/1790977453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11ec09d630 0x7f11ec1c8170 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f11dc000c00 tx=0x7f11dc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:02.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.816+0000 7f11f1a34700 1 -- 172.21.15.72:0/1790977453 shutdown_connections 2023-10-03T10:17:02.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.816+0000 7f11f1a34700 1 --2- 172.21.15.72:0/1790977453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f11ec133930 0x7f11ec1c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.816+0000 7f11f1a34700 1 --2- 172.21.15.72:0/1790977453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f11ec09d630 0x7f11ec1c8170 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.816+0000 7f11f1a34700 1 --2- 172.21.15.72:0/1790977453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ec0a0a30 0x7f11ec1c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.816+0000 7f11f1a34700 1 -- 172.21.15.72:0/1790977453 >> 172.21.15.72:0/1790977453 conn(0x7f11ec0a3050 msgr2=0x7f11ec0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.816+0000 7f11f1a34700 1 -- 172.21.15.72:0/1790977453 shutdown_connections 2023-10-03T10:17:02.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.816+0000 7f11f1a34700 1 -- 172.21.15.72:0/1790977453 wait complete. 2023-10-03T10:17:02.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:02.852 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:02.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.852+0000 7fd2b5c29700 1 -- 172.21.15.72:0/2463663167 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd2b01222e0 con 0x7fd2b009d630 2023-10-03T10:17:02.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.852+0000 7fd297fff700 1 -- 172.21.15.72:0/2463663167 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd2b01222e0 con 0x7fd2b009d630 2023-10-03T10:17:02.853 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:02.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.854+0000 7fd2b5c29700 1 -- 172.21.15.72:0/2463663167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2b009d630 msgr2=0x7fd2b011f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.854+0000 7fd2b5c29700 1 --2- 172.21.15.72:0/2463663167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2b009d630 0x7fd2b011f2e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000ebe0 tx=0x7fd2a000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.854+0000 7fd2b5c29700 1 -- 172.21.15.72:0/2463663167 shutdown_connections 2023-10-03T10:17:02.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.854+0000 7fd2b5c29700 1 --2- 172.21.15.72:0/2463663167 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd2b0133930 0x7fd2b01c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.854+0000 7fd2b5c29700 1 --2- 172.21.15.72:0/2463663167 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2b009d630 0x7fd2b011f2e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.854+0000 7fd2b5c29700 1 --2- 172.21.15.72:0/2463663167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2b00a0a30 0x7fd2b011f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.854+0000 7fd2b5c29700 1 -- 172.21.15.72:0/2463663167 >> 172.21.15.72:0/2463663167 conn(0x7fd2b00a3050 msgr2=0x7fd2b009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.855+0000 7fd2b5c29700 1 -- 172.21.15.72:0/2463663167 shutdown_connections 2023-10-03T10:17:02.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.855+0000 7fd2b5c29700 1 -- 172.21.15.72:0/2463663167 wait complete. 2023-10-03T10:17:02.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:02.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.974+0000 7f36aebed700 1 Processor -- start 2023-10-03T10:17:02.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.974+0000 7f36aebed700 1 -- start start 2023-10-03T10:17:02.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.974+0000 7f36aebed700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36a809d6f0 0x7f36a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.974+0000 7f36aebed700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36a809e410 0x7f36a8134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.974+0000 7f36aebed700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a809b120 con 0x7f36a809e000 2023-10-03T10:17:02.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.974+0000 7f36aebed700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a806b460 con 0x7f36a809e410 2023-10-03T10:17:02.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.974+0000 7f36aebed700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36a809a7e0 con 0x7f36a809d6f0 2023-10-03T10:17:02.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.974+0000 7f36ac989700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36a809d6f0 0x7f36a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.974+0000 7f36ac989700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36a809d6f0 0x7f36a809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39756/0 (socket says 172.21.15.72:39756) 2023-10-03T10:17:02.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.974+0000 7f36ad18a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36a809e410 0x7f36a8134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.974+0000 7f36ac989700 1 -- 172.21.15.72:0/2636097181 learned_addr learned my addr 172.21.15.72:0/2636097181 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:02.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36ac989700 1 -- 172.21.15.72:0/2636097181 >> v2:172.21.15.72:3300/0 conn(0x7f36a809e410 msgr2=0x7f36a8134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36ac989700 1 --2- 172.21.15.72:0/2636097181 >> v2:172.21.15.72:3300/0 conn(0x7f36a809e410 0x7f36a8134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36ac989700 1 -- 172.21.15.72:0/2636097181 >> v1:172.21.15.72:6789/0 conn(0x7f36a809e000 legacy=0x7f36a81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36ac989700 1 -- 172.21.15.72:0/2636097181 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a809a500 con 0x7f36a809d6f0 2023-10-03T10:17:02.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36ad18a700 1 --2- 172.21.15.72:0/2636097181 >> v2:172.21.15.72:3300/0 conn(0x7f36a809e410 0x7f36a8134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36ac989700 1 --2- 172.21.15.72:0/2636097181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36a809d6f0 0x7f36a809dac0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f369c009920 tx=0x7f369c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6e6086714cdeb92 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36a77fe700 1 -- 172.21.15.72:0/2636097181 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c011830 con 0x7f36a809d6f0 2023-10-03T10:17:02.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36a77fe700 1 -- 172.21.15.72:0/2636097181 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c011990 con 0x7f36a809d6f0 2023-10-03T10:17:02.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36a77fe700 1 -- 172.21.15.72:0/2636097181 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c011d20 con 0x7f36a809d6f0 2023-10-03T10:17:02.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36aebed700 1 -- 172.21.15.72:0/2636097181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36a809d6f0 msgr2=0x7f36a809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36aebed700 1 --2- 172.21.15.72:0/2636097181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36a809d6f0 0x7f36a809dac0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f369c009920 tx=0x7f369c009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:02.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36aebed700 1 -- 172.21.15.72:0/2636097181 shutdown_connections 2023-10-03T10:17:02.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36aebed700 1 --2- 172.21.15.72:0/2636097181 >> v2:172.21.15.72:3300/0 conn(0x7f36a809e410 0x7f36a8134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36aebed700 1 --2- 172.21.15.72:0/2636097181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36a809d6f0 0x7f36a809dac0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36aebed700 1 -- 172.21.15.72:0/2636097181 >> 172.21.15.72:0/2636097181 conn(0x7f36a8066f50 msgr2=0x7f36a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36aebed700 1 -- 172.21.15.72:0/2636097181 shutdown_connections 2023-10-03T10:17:02.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.975+0000 7f36aebed700 1 -- 172.21.15.72:0/2636097181 wait complete. 2023-10-03T10:17:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.976+0000 7f36aebed700 1 Processor -- start 2023-10-03T10:17:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.976+0000 7f36aebed700 1 -- start start 2023-10-03T10:17:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36aebed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a809d6f0 0x7f36a81a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36aebed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a809e000 0x7f36a81a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36aebed700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36a809e410 0x7f36a81a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36aebed700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80a3480 con 0x7f36a809d6f0 2023-10-03T10:17:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36aebed700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a81a6b90 con 0x7f36a809e000 2023-10-03T10:17:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36aebed700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36a81a7d40 con 0x7f36a809e410 2023-10-03T10:17:02.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36ac989700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a809d6f0 0x7f36a81a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36ac989700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a809d6f0 0x7f36a81a4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40894/0 (socket says 172.21.15.72:40894) 2023-10-03T10:17:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36ac989700 1 -- 172.21.15.72:0/1497308643 learned_addr learned my addr 172.21.15.72:0/1497308643 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36a7fff700 1 --2- 172.21.15.72:0/1497308643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a809e000 0x7f36a81a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36ad18a700 1 --2- 172.21.15.72:0/1497308643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36a809e410 0x7f36a81a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36ac989700 1 -- 172.21.15.72:0/1497308643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36a809e410 msgr2=0x7f36a81a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36ac989700 1 --2- 172.21.15.72:0/1497308643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36a809e410 0x7f36a81a5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36ac989700 1 -- 172.21.15.72:0/1497308643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a809e000 msgr2=0x7f36a81a5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36ac989700 1 --2- 172.21.15.72:0/1497308643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a809e000 0x7f36a81a5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36ac989700 1 -- 172.21.15.72:0/1497308643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a0009a70 con 0x7f36a809d6f0 2023-10-03T10:17:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.977+0000 7f36ad18a700 1 --2- 172.21.15.72:0/1497308643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36a809e410 0x7f36a81a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.978+0000 7f36ac989700 1 --2- 172.21.15.72:0/1497308643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a809d6f0 0x7f36a81a4f00 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f369c009870 tx=0x7f369c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.978+0000 7f36a57fa700 1 -- 172.21.15.72:0/1497308643 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c0042c0 con 0x7f36a809d6f0 2023-10-03T10:17:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.978+0000 7f36a57fa700 1 -- 172.21.15.72:0/1497308643 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c01f070 con 0x7f36a809d6f0 2023-10-03T10:17:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.978+0000 7f36a57fa700 1 -- 172.21.15.72:0/1497308643 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c0036a0 con 0x7f36a809d6f0 2023-10-03T10:17:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.978+0000 7f36aebed700 1 -- 172.21.15.72:0/1497308643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369c009550 con 0x7f36a809d6f0 2023-10-03T10:17:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.978+0000 7f36aebed700 1 -- 172.21.15.72:0/1497308643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a81a7880 con 0x7f36a809d6f0 2023-10-03T10:17:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.978+0000 7f36a57fa700 1 -- 172.21.15.72:0/1497308643 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f369c021030 con 0x7f36a809d6f0 2023-10-03T10:17:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.979+0000 7f36a57fa700 1 -- 172.21.15.72:0/1497308643 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f369c040860 con 0x7f36a809d6f0 2023-10-03T10:17:02.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.979+0000 7f36aebed700 1 -- 172.21.15.72:0/1497308643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a81a82d0 con 0x7f36a809d6f0 2023-10-03T10:17:02.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:02.983+0000 7f36a57fa700 1 -- 172.21.15.72:0/1497308643 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f369c015080 con 0x7f36a809d6f0 2023-10-03T10:17:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.168+0000 7f36aebed700 1 -- 172.21.15.72:0/1497308643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f36a8074ea0 con 0x7f36a809d6f0 2023-10-03T10:17:03.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.169+0000 7f36a57fa700 1 -- 172.21.15.72:0/1497308643 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f369c0239c0 con 0x7f36a809d6f0 2023-10-03T10:17:03.169 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:03.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.170+0000 7f36aebed700 1 -- 172.21.15.72:0/1497308643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a809d6f0 msgr2=0x7f36a81a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.171+0000 7f36aebed700 1 --2- 172.21.15.72:0/1497308643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a809d6f0 0x7f36a81a4f00 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f369c009870 tx=0x7f369c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:03.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.171+0000 7f36aebed700 1 -- 172.21.15.72:0/1497308643 shutdown_connections 2023-10-03T10:17:03.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.171+0000 7f36aebed700 1 --2- 172.21.15.72:0/1497308643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36a809d6f0 0x7f36a81a4f00 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.171+0000 7f36aebed700 1 --2- 172.21.15.72:0/1497308643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36a809e410 0x7f36a81a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.171+0000 7f36aebed700 1 --2- 172.21.15.72:0/1497308643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36a809e000 0x7f36a81a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.171+0000 7f36aebed700 1 -- 172.21.15.72:0/1497308643 >> 172.21.15.72:0/1497308643 conn(0x7f36a8066f50 msgr2=0x7f36a81bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.171+0000 7f36aebed700 1 -- 172.21.15.72:0/1497308643 shutdown_connections 2023-10-03T10:17:03.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.171+0000 7f36aebed700 1 -- 172.21.15.72:0/1497308643 wait complete. 2023-10-03T10:17:03.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:03.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.822+0000 7faec3049700 1 Processor -- start 2023-10-03T10:17:03.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.822+0000 7faec3049700 1 -- start start 2023-10-03T10:17:03.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.823+0000 7faec3049700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faebc09e1d0 0x7faebc135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.823+0000 7faec3049700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faebc135e50 0x7faebc138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.823+0000 7faec3049700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faebc09f130 con 0x7faebc09d6f0 2023-10-03T10:17:03.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.823+0000 7faec3049700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faebc09f520 con 0x7faebc135e50 2023-10-03T10:17:03.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.823+0000 7faec3049700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faebc09e930 con 0x7faebc09e1d0 2023-10-03T10:17:03.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.823+0000 7faec15e6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faebc135e50 0x7faebc138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.823+0000 7faebbfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faebc09e1d0 0x7faebc135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.823+0000 7faec0de5700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faebc09d6f0 0x7faebc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56746/0 (socket says 172.21.15.72:56746) 2023-10-03T10:17:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.823+0000 7faec0de5700 1 -- 172.21.15.72:0/4137146741 learned_addr learned my addr 172.21.15.72:0/4137146741 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.823+0000 7faebb7fe700 1 -- 172.21.15.72:0/4137146741 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103843295 0 0) 0x7faebc09f130 con 0x7faebc09d6f0 2023-10-03T10:17:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.823+0000 7faec15e6700 1 -- 172.21.15.72:0/4137146741 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faebc09e1d0 msgr2=0x7faebc135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.823+0000 7faec15e6700 1 --2- 172.21.15.72:0/4137146741 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faebc09e1d0 0x7faebc135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.823+0000 7faec15e6700 1 -- 172.21.15.72:0/4137146741 >> v1:172.21.15.72:6789/0 conn(0x7faebc09d6f0 legacy=0x7faebc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.823+0000 7faec15e6700 1 -- 172.21.15.72:0/4137146741 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc09b2d0 con 0x7faebc135e50 2023-10-03T10:17:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.823+0000 7faebbfff700 1 --2- 172.21.15.72:0/4137146741 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faebc09e1d0 0x7faebc135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.824+0000 7faec15e6700 1 --2- 172.21.15.72:0/4137146741 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faebc135e50 0x7faebc138230 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009dc0 tx=0x7faeb400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11aca88ef62a3a1e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.824+0000 7faebb7fe700 1 -- 172.21.15.72:0/4137146741 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb400e070 con 0x7faebc135e50 2023-10-03T10:17:03.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.824+0000 7faebb7fe700 1 -- 172.21.15.72:0/4137146741 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb400bb20 con 0x7faebc135e50 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.824+0000 7faebb7fe700 1 -- 172.21.15.72:0/4137146741 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4012430 con 0x7faebc135e50 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.824+0000 7faec3049700 1 -- 172.21.15.72:0/4137146741 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faebc135e50 msgr2=0x7faebc138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.824+0000 7faec3049700 1 --2- 172.21.15.72:0/4137146741 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faebc135e50 0x7faebc138230 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009dc0 tx=0x7faeb400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.824+0000 7faec3049700 1 -- 172.21.15.72:0/4137146741 shutdown_connections 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.824+0000 7faec3049700 1 --2- 172.21.15.72:0/4137146741 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faebc135e50 0x7faebc138230 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.824+0000 7faec3049700 1 --2- 172.21.15.72:0/4137146741 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faebc09e1d0 0x7faebc135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.824+0000 7faec3049700 1 -- 172.21.15.72:0/4137146741 >> 172.21.15.72:0/4137146741 conn(0x7faebc066f50 msgr2=0x7faebc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.824+0000 7faec3049700 1 -- 172.21.15.72:0/4137146741 shutdown_connections 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.824+0000 7faec3049700 1 -- 172.21.15.72:0/4137146741 wait complete. 2023-10-03T10:17:03.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.825+0000 7faec3049700 1 Processor -- start 2023-10-03T10:17:03.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.825+0000 7faec3049700 1 -- start start 2023-10-03T10:17:03.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faec3049700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faebc09d6f0 0x7faebc11b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faec3049700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faebc09e1d0 0x7faebc11ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faec3049700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faebc135e50 0x7faebc11bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faec3049700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc11e7e0 con 0x7faebc135e50 2023-10-03T10:17:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faec3049700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faebc0a2000 con 0x7faebc09d6f0 2023-10-03T10:17:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faec3049700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faebc11d170 con 0x7faebc09e1d0 2023-10-03T10:17:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faebbfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faebc09e1d0 0x7faebc11ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faec15e6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faebc135e50 0x7faebc11bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faebbfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faebc09e1d0 0x7faebc11ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39802/0 (socket says 172.21.15.72:39802) 2023-10-03T10:17:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faebbfff700 1 -- 172.21.15.72:0/1862634653 learned_addr learned my addr 172.21.15.72:0/1862634653 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faec0de5700 1 --2- 172.21.15.72:0/1862634653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faebc09d6f0 0x7faebc11b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faebbfff700 1 -- 172.21.15.72:0/1862634653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faebc09d6f0 msgr2=0x7faebc11b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faebbfff700 1 --2- 172.21.15.72:0/1862634653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faebc09d6f0 0x7faebc11b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faebbfff700 1 -- 172.21.15.72:0/1862634653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faebc135e50 msgr2=0x7faebc11bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faebbfff700 1 --2- 172.21.15.72:0/1862634653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faebc135e50 0x7faebc11bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faebbfff700 1 -- 172.21.15.72:0/1862634653 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea80094a0 con 0x7faebc09e1d0 2023-10-03T10:17:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faec0de5700 1 --2- 172.21.15.72:0/1862634653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faebc09d6f0 0x7faebc11b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faec15e6700 1 --2- 172.21.15.72:0/1862634653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faebc135e50 0x7faebc11bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faebbfff700 1 --2- 172.21.15.72:0/1862634653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faebc09e1d0 0x7faebc11ba00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7faea800ebe0 tx=0x7faea800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faeb97fa700 1 -- 172.21.15.72:0/1862634653 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800c850 con 0x7faebc09e1d0 2023-10-03T10:17:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faeb97fa700 1 -- 172.21.15.72:0/1862634653 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea800c9b0 con 0x7faebc09e1d0 2023-10-03T10:17:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faec3049700 1 -- 172.21.15.72:0/1862634653 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb4009a70 con 0x7faebc09e1d0 2023-10-03T10:17:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faeb97fa700 1 -- 172.21.15.72:0/1862634653 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800cd40 con 0x7faebc09e1d0 2023-10-03T10:17:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.826+0000 7faec3049700 1 -- 172.21.15.72:0/1862634653 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc09c700 con 0x7faebc09e1d0 2023-10-03T10:17:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.827+0000 7faeb97fa700 1 -- 172.21.15.72:0/1862634653 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faea8013470 con 0x7faebc09e1d0 2023-10-03T10:17:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.827+0000 7faeb97fa700 1 -- 172.21.15.72:0/1862634653 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faea803fc40 con 0x7faebc09e1d0 2023-10-03T10:17:03.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.827+0000 7faec3049700 1 -- 172.21.15.72:0/1862634653 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faebc11e9a0 con 0x7faebc09e1d0 2023-10-03T10:17:03.832 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:03.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.832+0000 7faeb97fa700 1 -- 172.21.15.72:0/1862634653 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faea8017080 con 0x7faebc09e1d0 2023-10-03T10:17:03.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:03.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.956+0000 7fdd1f29f700 1 Processor -- start 2023-10-03T10:17:03.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.956+0000 7fdd1f29f700 1 -- start start 2023-10-03T10:17:03.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.956+0000 7fdd1f29f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd18133420 0x7fdd181337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.956+0000 7fdd1f29f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdd18133e30 0x7fdd1812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.956+0000 7fdd1f29f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd18134260 0x7fdd181304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.956+0000 7fdd1f29f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1806b990 con 0x7fdd18133e30 2023-10-03T10:17:03.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.956+0000 7fdd1f29f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180a0590 con 0x7fdd18134260 2023-10-03T10:17:03.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.956+0000 7fdd1f29f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1809fb80 con 0x7fdd18133420 2023-10-03T10:17:03.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.957+0000 7fdd1c83a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdd18133e30 0x7fdd1812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.957+0000 7fdd1c83a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdd18133e30 0x7fdd1812ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40924/0 (socket says 172.21.15.72:40924) 2023-10-03T10:17:03.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.957+0000 7fdd1d83c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd18134260 0x7fdd181304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.957+0000 7fdd1c83a700 1 -- 172.21.15.72:0/2487636021 learned_addr learned my addr 172.21.15.72:0/2487636021 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:03.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.957+0000 7fdd1d03b700 1 --2- 172.21.15.72:0/2487636021 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd18133420 0x7fdd181337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.957+0000 7fdd1d03b700 1 -- 172.21.15.72:0/2487636021 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd18134260 msgr2=0x7fdd181304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.957+0000 7fdd1d03b700 1 --2- 172.21.15.72:0/2487636021 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd18134260 0x7fdd181304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.957+0000 7fdd1d03b700 1 -- 172.21.15.72:0/2487636021 >> v2:172.21.15.72:3300/0 conn(0x7fdd18133e30 msgr2=0x7fdd1812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.957+0000 7fdd1d03b700 1 --2- 172.21.15.72:0/2487636021 >> v2:172.21.15.72:3300/0 conn(0x7fdd18133e30 0x7fdd1812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.957+0000 7fdd1d03b700 1 -- 172.21.15.72:0/2487636021 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd180a0030 con 0x7fdd18133420 2023-10-03T10:17:03.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.957+0000 7fdd1d83c700 1 --2- 172.21.15.72:0/2487636021 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd18134260 0x7fdd181304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.957+0000 7fdd1d03b700 1 --2- 172.21.15.72:0/2487636021 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd18133420 0x7fdd181337f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009840 tx=0x7fdd14009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8dc2fbc1c15cb27 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.957+0000 7fdd0ffff700 1 -- 172.21.15.72:0/2487636021 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14011830 con 0x7fdd18133420 2023-10-03T10:17:03.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.957+0000 7fdd0ffff700 1 -- 172.21.15.72:0/2487636021 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd14011990 con 0x7fdd18133420 2023-10-03T10:17:03.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.957+0000 7fdd0ffff700 1 -- 172.21.15.72:0/2487636021 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14011d20 con 0x7fdd18133420 2023-10-03T10:17:03.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.958+0000 7fdd1f29f700 1 -- 172.21.15.72:0/2487636021 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd18133420 msgr2=0x7fdd181337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.958+0000 7fdd1f29f700 1 --2- 172.21.15.72:0/2487636021 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd18133420 0x7fdd181337f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009840 tx=0x7fdd14009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:03.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.958+0000 7fdd1f29f700 1 -- 172.21.15.72:0/2487636021 shutdown_connections 2023-10-03T10:17:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.958+0000 7fdd1f29f700 1 --2- 172.21.15.72:0/2487636021 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd18134260 0x7fdd181304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.958+0000 7fdd1f29f700 1 --2- 172.21.15.72:0/2487636021 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd18133420 0x7fdd181337f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.958+0000 7fdd1f29f700 1 --2- 172.21.15.72:0/2487636021 >> v2:172.21.15.72:3300/0 conn(0x7fdd18133e30 0x7fdd1812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.958+0000 7fdd1f29f700 1 -- 172.21.15.72:0/2487636021 >> 172.21.15.72:0/2487636021 conn(0x7fdd180a4210 msgr2=0x7fdd180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.958+0000 7fdd1f29f700 1 -- 172.21.15.72:0/2487636021 shutdown_connections 2023-10-03T10:17:03.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.958+0000 7fdd1f29f700 1 -- 172.21.15.72:0/2487636021 wait complete. 2023-10-03T10:17:03.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.959+0000 7fdd1f29f700 1 Processor -- start 2023-10-03T10:17:03.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.959+0000 7fdd1f29f700 1 -- start start 2023-10-03T10:17:03.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.959+0000 7fdd1f29f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd18133420 0x7fdd1809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.959+0000 7fdd1f29f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18133e30 0x7fdd1809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.959+0000 7fdd1f29f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd18134260 0x7fdd1809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.959+0000 7fdd1f29f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18120ba0 con 0x7fdd18133e30 2023-10-03T10:17:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.959+0000 7fdd1f29f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1812dc50 con 0x7fdd18134260 2023-10-03T10:17:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.959+0000 7fdd1f29f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1811ff10 con 0x7fdd18133420 2023-10-03T10:17:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.959+0000 7fdd1c83a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18133e30 0x7fdd1809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.959+0000 7fdd1d03b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd18133420 0x7fdd1809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd1c83a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18133e30 0x7fdd1809c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40930/0 (socket says 172.21.15.72:40930) 2023-10-03T10:17:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd1d03b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd18133420 0x7fdd1809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39818/0 (socket says 172.21.15.72:39818) 2023-10-03T10:17:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd1c83a700 1 -- 172.21.15.72:0/3903256862 learned_addr learned my addr 172.21.15.72:0/3903256862 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd1d83c700 1 --2- 172.21.15.72:0/3903256862 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd18134260 0x7fdd1809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd1d03b700 1 -- 172.21.15.72:0/3903256862 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd18134260 msgr2=0x7fdd1809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd1d03b700 1 --2- 172.21.15.72:0/3903256862 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd18134260 0x7fdd1809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd1d03b700 1 -- 172.21.15.72:0/3903256862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18133e30 msgr2=0x7fdd1809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd1d03b700 1 --2- 172.21.15.72:0/3903256862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18133e30 0x7fdd1809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd1d03b700 1 -- 172.21.15.72:0/3903256862 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd10009a70 con 0x7fdd18133420 2023-10-03T10:17:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd1c83a700 1 --2- 172.21.15.72:0/3903256862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18133e30 0x7fdd1809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd1d03b700 1 --2- 172.21.15.72:0/3903256862 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd18133420 0x7fdd1809c480 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fdd1806e650 tx=0x7fdd14004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd0dffb700 1 -- 172.21.15.72:0/3903256862 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14004240 con 0x7fdd18133420 2023-10-03T10:17:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd0dffb700 1 -- 172.21.15.72:0/3903256862 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1401f070 con 0x7fdd18133420 2023-10-03T10:17:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd1f29f700 1 -- 172.21.15.72:0/3903256862 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd140094a0 con 0x7fdd18133420 2023-10-03T10:17:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd0dffb700 1 -- 172.21.15.72:0/3903256862 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd140045e0 con 0x7fdd18133420 2023-10-03T10:17:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.960+0000 7fdd1f29f700 1 -- 172.21.15.72:0/3903256862 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd181206f0 con 0x7fdd18133420 2023-10-03T10:17:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.961+0000 7fdd0dffb700 1 -- 172.21.15.72:0/3903256862 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd14021030 con 0x7fdd18133420 2023-10-03T10:17:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.961+0000 7fdd0dffb700 1 -- 172.21.15.72:0/3903256862 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdd140404c0 con 0x7fdd18133420 2023-10-03T10:17:03.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.962+0000 7fdd1f29f700 1 -- 172.21.15.72:0/3903256862 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd18074ea0 con 0x7fdd18133420 2023-10-03T10:17:03.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.966+0000 7fdd0dffb700 1 -- 172.21.15.72:0/3903256862 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd14015080 con 0x7fdd18133420 2023-10-03T10:17:03.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.999+0000 7fa1dc828700 1 Processor -- start 2023-10-03T10:17:03.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:03.999+0000 7fa1dc828700 1 -- start start 2023-10-03T10:17:04.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1dc828700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d81337f0 0x7fa1d8138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1dc828700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa1d8138dc0 0x7fa1d813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1dc828700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d806b990 con 0x7fa1d8133420 2023-10-03T10:17:04.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1dc828700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d809b0e0 con 0x7fa1d8138dc0 2023-10-03T10:17:04.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1dc828700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d8133c20 con 0x7fa1d81337f0 2023-10-03T10:17:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1d659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa1d8133420 0x7fa1d8133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56758/0 (socket says 172.21.15.72:56758) 2023-10-03T10:17:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1d659c700 1 -- 172.21.15.72:0/242504037 learned_addr learned my addr 172.21.15.72:0/242504037 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1d6d9d700 1 --2- 172.21.15.72:0/242504037 >> v2:172.21.15.72:3300/0 conn(0x7fa1d8138dc0 0x7fa1d813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1d5d9b700 1 --2- 172.21.15.72:0/242504037 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d81337f0 0x7fa1d8138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1d6d9d700 1 -- 172.21.15.72:0/242504037 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d81337f0 msgr2=0x7fa1d8138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1d6d9d700 1 --2- 172.21.15.72:0/242504037 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d81337f0 0x7fa1d8138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1d6d9d700 1 -- 172.21.15.72:0/242504037 >> v1:172.21.15.72:6789/0 conn(0x7fa1d8133420 legacy=0x7fa1d8133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1d6d9d700 1 -- 172.21.15.72:0/242504037 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d80a0590 con 0x7fa1d8138dc0 2023-10-03T10:17:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1d559a700 1 -- 172.21.15.72:0/242504037 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215662838 0 0) 0x7fa1d806b990 con 0x7fa1d8133420 2023-10-03T10:17:04.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1d5d9b700 1 --2- 172.21.15.72:0/242504037 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d81337f0 0x7fa1d8138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1d6d9d700 1 --2- 172.21.15.72:0/242504037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d8138dc0 0x7fa1d813b1a0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009d90 tx=0x7fa1d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a055aa622f0789 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.000+0000 7fa1d559a700 1 -- 172.21.15.72:0/242504037 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d000e070 con 0x7fa1d8138dc0 2023-10-03T10:17:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.001+0000 7fa1d559a700 1 -- 172.21.15.72:0/242504037 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d000bb20 con 0x7fa1d8138dc0 2023-10-03T10:17:04.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.001+0000 7fa1d559a700 1 -- 172.21.15.72:0/242504037 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0012430 con 0x7fa1d8138dc0 2023-10-03T10:17:04.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.001+0000 7fa1dc828700 1 -- 172.21.15.72:0/242504037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d8138dc0 msgr2=0x7fa1d813b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.001+0000 7fa1dc828700 1 --2- 172.21.15.72:0/242504037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d8138dc0 0x7fa1d813b1a0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009d90 tx=0x7fa1d000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.001+0000 7fa1dc828700 1 -- 172.21.15.72:0/242504037 shutdown_connections 2023-10-03T10:17:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.001+0000 7fa1dc828700 1 --2- 172.21.15.72:0/242504037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d8138dc0 0x7fa1d813b1a0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.001+0000 7fa1dc828700 1 --2- 172.21.15.72:0/242504037 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d81337f0 0x7fa1d8138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.001+0000 7fa1dc828700 1 -- 172.21.15.72:0/242504037 >> 172.21.15.72:0/242504037 conn(0x7fa1d80a4210 msgr2=0x7fa1d80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.001+0000 7fa1dc828700 1 -- 172.21.15.72:0/242504037 shutdown_connections 2023-10-03T10:17:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.001+0000 7fa1dc828700 1 -- 172.21.15.72:0/242504037 wait complete. 2023-10-03T10:17:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.002+0000 7fa1dc828700 1 Processor -- start 2023-10-03T10:17:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.002+0000 7fa1dc828700 1 -- start start 2023-10-03T10:17:04.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1dc828700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1d8133420 0x7fa1d812f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1dc828700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d81337f0 0x7fa1d812f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1dc828700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d8138dc0 0x7fa1d812fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1dc828700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d809c4e0 con 0x7fa1d81337f0 2023-10-03T10:17:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1dc828700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d809b430 con 0x7fa1d8138dc0 2023-10-03T10:17:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1dc828700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d809d600 con 0x7fa1d8133420 2023-10-03T10:17:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1d5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d81337f0 0x7fa1d812f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1d5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d81337f0 0x7fa1d812f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40956/0 (socket says 172.21.15.72:40956) 2023-10-03T10:17:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1d6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d8138dc0 0x7fa1d812fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1d5d9b700 1 -- 172.21.15.72:0/452116953 learned_addr learned my addr 172.21.15.72:0/452116953 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1d6d9d700 1 -- 172.21.15.72:0/452116953 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1d8133420 msgr2=0x7fa1d812f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1d6d9d700 1 --2- 172.21.15.72:0/452116953 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1d8133420 0x7fa1d812f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1d6d9d700 1 -- 172.21.15.72:0/452116953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d81337f0 msgr2=0x7fa1d812f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1d6d9d700 1 --2- 172.21.15.72:0/452116953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d81337f0 0x7fa1d812f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1d6d9d700 1 -- 172.21.15.72:0/452116953 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc0094a0 con 0x7fa1d8138dc0 2023-10-03T10:17:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1d5d9b700 1 --2- 172.21.15.72:0/452116953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d81337f0 0x7fa1d812f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1d6d9d700 1 --2- 172.21.15.72:0/452116953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d8138dc0 0x7fa1d812fb30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0016000 tx=0x7fa1d0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1c6ffd700 1 -- 172.21.15.72:0/452116953 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0012430 con 0x7fa1d8138dc0 2023-10-03T10:17:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1c6ffd700 1 -- 172.21.15.72:0/452116953 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d0020070 con 0x7fa1d8138dc0 2023-10-03T10:17:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1dc828700 1 -- 172.21.15.72:0/452116953 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d0009a70 con 0x7fa1d8138dc0 2023-10-03T10:17:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.003+0000 7fa1c6ffd700 1 -- 172.21.15.72:0/452116953 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0004280 con 0x7fa1d8138dc0 2023-10-03T10:17:04.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.004+0000 7fa1dc828700 1 -- 172.21.15.72:0/452116953 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d8130b10 con 0x7fa1d8138dc0 2023-10-03T10:17:04.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.004+0000 7fa1c6ffd700 1 -- 172.21.15.72:0/452116953 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1d00043e0 con 0x7fa1d8138dc0 2023-10-03T10:17:04.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.005+0000 7fa1c6ffd700 1 -- 172.21.15.72:0/452116953 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa1d0022070 con 0x7fa1d8138dc0 2023-10-03T10:17:04.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.005+0000 7fa1dc828700 1 -- 172.21.15.72:0/452116953 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d8074ea0 con 0x7fa1d8138dc0 2023-10-03T10:17:04.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.010+0000 7fa1c6ffd700 1 -- 172.21.15.72:0/452116953 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1d001b400 con 0x7fa1d8138dc0 2023-10-03T10:17:04.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.032+0000 7faec3049700 1 -- 172.21.15.72:0/1862634653 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faebc074ea0 con 0x7faebc09e1d0 2023-10-03T10:17:04.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.033+0000 7faeb97fa700 1 -- 172.21.15.72:0/1862634653 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faea8021020 con 0x7faebc09e1d0 2023-10-03T10:17:04.033 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:04.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.035+0000 7faec3049700 1 -- 172.21.15.72:0/1862634653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faebc09e1d0 msgr2=0x7faebc11ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.035+0000 7faec3049700 1 --2- 172.21.15.72:0/1862634653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faebc09e1d0 0x7faebc11ba00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7faea800ebe0 tx=0x7faea800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.035+0000 7faec3049700 1 -- 172.21.15.72:0/1862634653 shutdown_connections 2023-10-03T10:17:04.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.035+0000 7faec3049700 1 --2- 172.21.15.72:0/1862634653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faebc135e50 0x7faebc11bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.035+0000 7faec3049700 1 --2- 172.21.15.72:0/1862634653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faebc09d6f0 0x7faebc11b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.035+0000 7faec3049700 1 --2- 172.21.15.72:0/1862634653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faebc09e1d0 0x7faebc11ba00 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.035+0000 7faec3049700 1 -- 172.21.15.72:0/1862634653 >> 172.21.15.72:0/1862634653 conn(0x7faebc066f50 msgr2=0x7faebc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.035+0000 7faec3049700 1 -- 172.21.15.72:0/1862634653 shutdown_connections 2023-10-03T10:17:04.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.035+0000 7faec3049700 1 -- 172.21.15.72:0/1862634653 wait complete. 2023-10-03T10:17:04.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:04.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.161+0000 7fdd1f29f700 1 -- 172.21.15.72:0/3903256862 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdd1806b250 con 0x7fdd18133420 2023-10-03T10:17:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.161+0000 7fdd0dffb700 1 -- 172.21.15.72:0/3903256862 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdd1401a450 con 0x7fdd18133420 2023-10-03T10:17:04.162 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.163+0000 7fdd1f29f700 1 -- 172.21.15.72:0/3903256862 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd18133420 msgr2=0x7fdd1809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.163+0000 7fdd1f29f700 1 --2- 172.21.15.72:0/3903256862 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd18133420 0x7fdd1809c480 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fdd1806e650 tx=0x7fdd14004750 comp rx=0 tx=0).stop 2023-10-03T10:17:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.163+0000 7fdd1f29f700 1 -- 172.21.15.72:0/3903256862 shutdown_connections 2023-10-03T10:17:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.163+0000 7fdd1f29f700 1 --2- 172.21.15.72:0/3903256862 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd18134260 0x7fdd1809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.163+0000 7fdd1f29f700 1 --2- 172.21.15.72:0/3903256862 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdd18133420 0x7fdd1809c480 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.163+0000 7fdd1f29f700 1 --2- 172.21.15.72:0/3903256862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd18133e30 0x7fdd1809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.163+0000 7fdd1f29f700 1 -- 172.21.15.72:0/3903256862 >> 172.21.15.72:0/3903256862 conn(0x7fdd180a4210 msgr2=0x7fdd180a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.163+0000 7fdd1f29f700 1 -- 172.21.15.72:0/3903256862 shutdown_connections 2023-10-03T10:17:04.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.163+0000 7fdd1f29f700 1 -- 172.21.15.72:0/3903256862 wait complete. 2023-10-03T10:17:04.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:04.184 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:04.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.203+0000 7fa1dc828700 1 -- 172.21.15.72:0/452116953 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa1d806b250 con 0x7fa1d8138dc0 2023-10-03T10:17:04.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.204+0000 7fa1c6ffd700 1 -- 172.21.15.72:0/452116953 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa1d002c020 con 0x7fa1d8138dc0 2023-10-03T10:17:04.204 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:04.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.206+0000 7fa1dc828700 1 -- 172.21.15.72:0/452116953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d8138dc0 msgr2=0x7fa1d812fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.206+0000 7fa1dc828700 1 --2- 172.21.15.72:0/452116953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d8138dc0 0x7fa1d812fb30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0016000 tx=0x7fa1d0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.206+0000 7fa1dc828700 1 -- 172.21.15.72:0/452116953 shutdown_connections 2023-10-03T10:17:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.206+0000 7fa1dc828700 1 --2- 172.21.15.72:0/452116953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d8138dc0 0x7fa1d812fb30 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.206+0000 7fa1dc828700 1 --2- 172.21.15.72:0/452116953 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1d8133420 0x7fa1d812f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.206+0000 7fa1dc828700 1 --2- 172.21.15.72:0/452116953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d81337f0 0x7fa1d812f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.206+0000 7fa1dc828700 1 -- 172.21.15.72:0/452116953 >> 172.21.15.72:0/452116953 conn(0x7fa1d80a4210 msgr2=0x7fa1d80a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.206+0000 7fa1dc828700 1 -- 172.21.15.72:0/452116953 shutdown_connections 2023-10-03T10:17:04.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.206+0000 7fa1dc828700 1 -- 172.21.15.72:0/452116953 wait complete. 2023-10-03T10:17:04.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:04.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.307+0000 7f1214df3700 1 Processor -- start 2023-10-03T10:17:04.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.307+0000 7f1214df3700 1 -- start start 2023-10-03T10:17:04.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.307+0000 7f1214df3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f121009e930 0x7f121009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.307+0000 7f1214df3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f121009f650 0x7f1210131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.307+0000 7f1214df3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1210070940 con 0x7f121009f240 2023-10-03T10:17:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.307+0000 7f1214df3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121006fd60 con 0x7f121009f650 2023-10-03T10:17:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.307+0000 7f1214df3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121006fa80 con 0x7f121009e930 2023-10-03T10:17:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.307+0000 7f120ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f121009f650 0x7f1210131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.307+0000 7f120e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f121009e930 0x7f121009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.307+0000 7f120ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f121009f650 0x7f1210131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40958/0 (socket says 172.21.15.72:40958) 2023-10-03T10:17:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.307+0000 7f120ed9d700 1 -- 172.21.15.72:0/1260570342 learned_addr learned my addr 172.21.15.72:0/1260570342 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.308+0000 7f120e59c700 1 -- 172.21.15.72:0/1260570342 >> v2:172.21.15.72:3300/0 conn(0x7f121009f650 msgr2=0x7f1210131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.308+0000 7f120e59c700 1 --2- 172.21.15.72:0/1260570342 >> v2:172.21.15.72:3300/0 conn(0x7f121009f650 0x7f1210131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.308+0000 7f120e59c700 1 -- 172.21.15.72:0/1260570342 >> v1:172.21.15.72:6789/0 conn(0x7f121009f240 legacy=0x7f12101317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.308+0000 7f120e59c700 1 -- 172.21.15.72:0/1260570342 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121009fb60 con 0x7f121009e930 2023-10-03T10:17:04.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.308+0000 7f120ed9d700 1 --2- 172.21.15.72:0/1260570342 >> v2:172.21.15.72:3300/0 conn(0x7f121009f650 0x7f1210131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.308+0000 7f120e59c700 1 --2- 172.21.15.72:0/1260570342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f121009e930 0x7f121009ed00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1200009840 tx=0x7f1200009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb4bac62fd19dea3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.308+0000 7f120d59a700 1 -- 172.21.15.72:0/1260570342 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200011830 con 0x7f121009e930 2023-10-03T10:17:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.308+0000 7f120d59a700 1 -- 172.21.15.72:0/1260570342 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1200011990 con 0x7f121009e930 2023-10-03T10:17:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.308+0000 7f120d59a700 1 -- 172.21.15.72:0/1260570342 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200011d20 con 0x7f121009e930 2023-10-03T10:17:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.308+0000 7f1214df3700 1 -- 172.21.15.72:0/1260570342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f121009e930 msgr2=0x7f121009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.308+0000 7f1214df3700 1 --2- 172.21.15.72:0/1260570342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f121009e930 0x7f121009ed00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1200009840 tx=0x7f1200009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.309+0000 7f1214df3700 1 -- 172.21.15.72:0/1260570342 shutdown_connections 2023-10-03T10:17:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.309+0000 7f1214df3700 1 --2- 172.21.15.72:0/1260570342 >> v2:172.21.15.72:3300/0 conn(0x7f121009f650 0x7f1210131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.309+0000 7f1214df3700 1 --2- 172.21.15.72:0/1260570342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f121009e930 0x7f121009ed00 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.309+0000 7f1214df3700 1 -- 172.21.15.72:0/1260570342 >> 172.21.15.72:0/1260570342 conn(0x7f12100a4210 msgr2=0x7f12100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.309+0000 7f1214df3700 1 -- 172.21.15.72:0/1260570342 shutdown_connections 2023-10-03T10:17:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.309+0000 7f1214df3700 1 -- 172.21.15.72:0/1260570342 wait complete. 2023-10-03T10:17:04.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f1214df3700 1 Processor -- start 2023-10-03T10:17:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f1214df3700 1 -- start start 2023-10-03T10:17:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f1214df3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f121009e930 0x7f12101c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f1214df3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f121009f240 0x7f12101c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f1214df3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f121009f650 0x7f12101c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f1214df3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12101a96c0 con 0x7f121009f240 2023-10-03T10:17:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f1214df3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12100a33c0 con 0x7f121009f650 2023-10-03T10:17:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f1214df3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12101c9090 con 0x7f121009e930 2023-10-03T10:17:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f120e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f121009e930 0x7f12101c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f120dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f121009f240 0x7f12101c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f120e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f121009e930 0x7f12101c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39826/0 (socket says 172.21.15.72:39826) 2023-10-03T10:17:04.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f120e59c700 1 -- 172.21.15.72:0/2420591975 learned_addr learned my addr 172.21.15.72:0/2420591975 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:04.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f120ed9d700 1 --2- 172.21.15.72:0/2420591975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f121009f650 0x7f12101c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f120dd9b700 1 -- 172.21.15.72:0/2420591975 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f121009e930 msgr2=0x7f12101c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f120dd9b700 1 --2- 172.21.15.72:0/2420591975 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f121009e930 0x7f12101c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f120dd9b700 1 -- 172.21.15.72:0/2420591975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f121009f650 msgr2=0x7f12101c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f120dd9b700 1 --2- 172.21.15.72:0/2420591975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f121009f650 0x7f12101c4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.310+0000 7f120dd9b700 1 -- 172.21.15.72:0/2420591975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1208009b30 con 0x7f121009f240 2023-10-03T10:17:04.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.311+0000 7f120dd9b700 1 --2- 172.21.15.72:0/2420591975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f121009f240 0x7f12101c8b50 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f1204000f60 tx=0x7f120400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.311+0000 7f11feffd700 1 -- 172.21.15.72:0/2420591975 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12040050d0 con 0x7f121009f240 2023-10-03T10:17:04.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.311+0000 7f11feffd700 1 -- 172.21.15.72:0/2420591975 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1204005230 con 0x7f121009f240 2023-10-03T10:17:04.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.311+0000 7f11feffd700 1 -- 172.21.15.72:0/2420591975 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204003680 con 0x7f121009f240 2023-10-03T10:17:04.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.311+0000 7f1214df3700 1 -- 172.21.15.72:0/2420591975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12000094a0 con 0x7f121009f240 2023-10-03T10:17:04.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.311+0000 7f1214df3700 1 -- 172.21.15.72:0/2420591975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12100a0190 con 0x7f121009f240 2023-10-03T10:17:04.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.311+0000 7f11feffd700 1 -- 172.21.15.72:0/2420591975 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12040037e0 con 0x7f121009f240 2023-10-03T10:17:04.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.312+0000 7f11feffd700 1 -- 172.21.15.72:0/2420591975 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f120403e970 con 0x7f121009f240 2023-10-03T10:17:04.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.312+0000 7f1214df3700 1 -- 172.21.15.72:0/2420591975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12101a9500 con 0x7f121009f240 2023-10-03T10:17:04.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.316+0000 7f11feffd700 1 -- 172.21.15.72:0/2420591975 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1204017080 con 0x7f121009f240 2023-10-03T10:17:04.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.499+0000 7f1214df3700 1 -- 172.21.15.72:0/2420591975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1210074ea0 con 0x7f121009f240 2023-10-03T10:17:04.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.499+0000 7f11feffd700 1 -- 172.21.15.72:0/2420591975 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1204011590 con 0x7f121009f240 2023-10-03T10:17:04.500 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:04.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.502+0000 7f1214df3700 1 -- 172.21.15.72:0/2420591975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f121009f240 msgr2=0x7f12101c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.502+0000 7f1214df3700 1 --2- 172.21.15.72:0/2420591975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f121009f240 0x7f12101c8b50 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f1204000f60 tx=0x7f120400c730 comp rx=0 tx=0).stop 2023-10-03T10:17:04.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.502+0000 7f1214df3700 1 -- 172.21.15.72:0/2420591975 shutdown_connections 2023-10-03T10:17:04.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.502+0000 7f1214df3700 1 --2- 172.21.15.72:0/2420591975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f121009f650 0x7f12101c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.502+0000 7f1214df3700 1 --2- 172.21.15.72:0/2420591975 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f121009e930 0x7f12101c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.502+0000 7f1214df3700 1 --2- 172.21.15.72:0/2420591975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f121009f240 0x7f12101c8b50 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.502+0000 7f1214df3700 1 -- 172.21.15.72:0/2420591975 >> 172.21.15.72:0/2420591975 conn(0x7f12100a4210 msgr2=0x7f12101bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:04.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.502+0000 7f1214df3700 1 -- 172.21.15.72:0/2420591975 shutdown_connections 2023-10-03T10:17:04.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:04.502+0000 7f1214df3700 1 -- 172.21.15.72:0/2420591975 wait complete. 2023-10-03T10:17:04.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:05.049 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:05.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.171+0000 7f75250ca700 1 Processor -- start 2023-10-03T10:17:05.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.171+0000 7f75250ca700 1 -- start start 2023-10-03T10:17:05.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f75250ca700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f752009e930 0x7f752009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f75250ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f752009f650 0x7f7520131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f75250ca700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7520070940 con 0x7f752009f240 2023-10-03T10:17:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f75250ca700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752006fd60 con 0x7f752009e930 2023-10-03T10:17:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f75250ca700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752006fa80 con 0x7f752009f650 2023-10-03T10:17:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f751f59e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f752009f650 0x7f7520131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f751ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f752009e930 0x7f752009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f751f59e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f752009f650 0x7f7520131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59478/0 (socket says 172.21.15.72:59478) 2023-10-03T10:17:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f751ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f752009e930 0x7f752009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40978/0 (socket says 172.21.15.72:40978) 2023-10-03T10:17:05.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f751f59e700 1 -- 172.21.15.72:0/1338567091 learned_addr learned my addr 172.21.15.72:0/1338567091 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:05.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f751f59e700 1 -- 172.21.15.72:0/1338567091 >> v2:172.21.15.72:3300/0 conn(0x7f752009e930 msgr2=0x7f752009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f751f59e700 1 --2- 172.21.15.72:0/1338567091 >> v2:172.21.15.72:3300/0 conn(0x7f752009e930 0x7f752009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f751f59e700 1 -- 172.21.15.72:0/1338567091 >> v1:172.21.15.72:6789/0 conn(0x7f752009f240 legacy=0x7f75201317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f751f59e700 1 -- 172.21.15.72:0/1338567091 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752009fb60 con 0x7f752009f650 2023-10-03T10:17:05.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f751ed9d700 1 --2- 172.21.15.72:0/1338567091 >> v2:172.21.15.72:3300/0 conn(0x7f752009e930 0x7f752009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.172+0000 7f751f59e700 1 --2- 172.21.15.72:0/1338567091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f752009f650 0x7f7520131f00 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7518009e50 tx=0x7f751800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=461aaff0ebc07d2c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.173+0000 7f751dd9b700 1 -- 172.21.15.72:0/1338567091 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751800e070 con 0x7f752009f650 2023-10-03T10:17:05.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.173+0000 7f751dd9b700 1 -- 172.21.15.72:0/1338567091 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751800b910 con 0x7f752009f650 2023-10-03T10:17:05.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.173+0000 7f751dd9b700 1 -- 172.21.15.72:0/1338567091 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751800bcc0 con 0x7f752009f650 2023-10-03T10:17:05.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.173+0000 7f75250ca700 1 -- 172.21.15.72:0/1338567091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f752009f650 msgr2=0x7f7520131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.173+0000 7f75250ca700 1 --2- 172.21.15.72:0/1338567091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f752009f650 0x7f7520131f00 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7518009e50 tx=0x7f751800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:05.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.173+0000 7f75250ca700 1 -- 172.21.15.72:0/1338567091 shutdown_connections 2023-10-03T10:17:05.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.173+0000 7f75250ca700 1 --2- 172.21.15.72:0/1338567091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f752009f650 0x7f7520131f00 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.173+0000 7f75250ca700 1 --2- 172.21.15.72:0/1338567091 >> v2:172.21.15.72:3300/0 conn(0x7f752009e930 0x7f752009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.173+0000 7f75250ca700 1 -- 172.21.15.72:0/1338567091 >> 172.21.15.72:0/1338567091 conn(0x7f75200a4210 msgr2=0x7f75200a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.173+0000 7f75250ca700 1 -- 172.21.15.72:0/1338567091 shutdown_connections 2023-10-03T10:17:05.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.173+0000 7f75250ca700 1 -- 172.21.15.72:0/1338567091 wait complete. 2023-10-03T10:17:05.177 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:05.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.174+0000 7f75250ca700 1 Processor -- start 2023-10-03T10:17:05.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.174+0000 7f75250ca700 1 -- start start 2023-10-03T10:17:05.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f75250ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f752009e930 0x7f75201c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f75250ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f752009f240 0x7f75201c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f75250ca700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f752009f650 0x7f75201c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f75250ca700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75201a43d0 con 0x7f752009e930 2023-10-03T10:17:05.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f75250ca700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75201a47e0 con 0x7f752009f240 2023-10-03T10:17:05.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f75250ca700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75201a4fd0 con 0x7f752009f650 2023-10-03T10:17:05.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f751ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f752009e930 0x7f75201c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f751f59e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f752009f650 0x7f75201c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f751ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f752009e930 0x7f75201c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40980/0 (socket says 172.21.15.72:40980) 2023-10-03T10:17:05.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f751ed9d700 1 -- 172.21.15.72:0/1065686295 learned_addr learned my addr 172.21.15.72:0/1065686295 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:05.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f751e59c700 1 --2- 172.21.15.72:0/1065686295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f752009f240 0x7f75201c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f751ed9d700 1 -- 172.21.15.72:0/1065686295 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f752009f650 msgr2=0x7f75201c07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f751ed9d700 1 --2- 172.21.15.72:0/1065686295 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f752009f650 0x7f75201c07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f751ed9d700 1 -- 172.21.15.72:0/1065686295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f752009f240 msgr2=0x7f75201c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f751ed9d700 1 --2- 172.21.15.72:0/1065686295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f752009f240 0x7f75201c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f751ed9d700 1 -- 172.21.15.72:0/1065686295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751400d940 con 0x7f752009e930 2023-10-03T10:17:05.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f751ed9d700 1 --2- 172.21.15.72:0/1065686295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f752009e930 0x7f75201c4340 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f7514012fc0 tx=0x7f75140103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f75077fe700 1 -- 172.21.15.72:0/1065686295 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514010b00 con 0x7f752009e930 2023-10-03T10:17:05.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f75077fe700 1 -- 172.21.15.72:0/1065686295 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7514013040 con 0x7f752009e930 2023-10-03T10:17:05.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f75077fe700 1 -- 172.21.15.72:0/1065686295 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514010e80 con 0x7f752009e930 2023-10-03T10:17:05.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.175+0000 7f75250ca700 1 -- 172.21.15.72:0/1065686295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7518009b30 con 0x7f752009e930 2023-10-03T10:17:05.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.176+0000 7f75250ca700 1 -- 172.21.15.72:0/1065686295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75200a0190 con 0x7f752009e930 2023-10-03T10:17:05.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.176+0000 7f75077fe700 1 -- 172.21.15.72:0/1065686295 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7514018480 con 0x7f752009e930 2023-10-03T10:17:05.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.176+0000 7f75077fe700 1 -- 172.21.15.72:0/1065686295 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7514043640 con 0x7f752009e930 2023-10-03T10:17:05.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.177+0000 7f75250ca700 1 -- 172.21.15.72:0/1065686295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7520074ea0 con 0x7f752009e930 2023-10-03T10:17:05.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.181+0000 7f75077fe700 1 -- 172.21.15.72:0/1065686295 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7514016930 con 0x7f752009e930 2023-10-03T10:17:05.219 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:05.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.307+0000 7f7106a78700 1 Processor -- start 2023-10-03T10:17:05.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.307+0000 7f7106a78700 1 -- start start 2023-10-03T10:17:05.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.307+0000 7f7106a78700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f710009e1d0 0x7f7100138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.307+0000 7f7106a78700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7100139170 0x7f710013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.307+0000 7f7106a78700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710009b120 con 0x7f710009d6f0 2023-10-03T10:17:05.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.307+0000 7f7106a78700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f710006b460 con 0x7f7100139170 2023-10-03T10:17:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.307+0000 7f7106a78700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f710009a7e0 con 0x7f710009e1d0 2023-10-03T10:17:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.307+0000 7f7104814700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f710009d6f0 0x7f710009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56796/0 (socket says 172.21.15.72:56796) 2023-10-03T10:17:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.307+0000 7f7104814700 1 -- 172.21.15.72:0/4115052650 learned_addr learned my addr 172.21.15.72:0/4115052650 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.307+0000 7f70fffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f710009e1d0 0x7f7100138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.307+0000 7f7105015700 1 --2- 172.21.15.72:0/4115052650 >> v2:172.21.15.72:3300/0 conn(0x7f7100139170 0x7f710013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.308+0000 7f7105015700 1 -- 172.21.15.72:0/4115052650 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f710009e1d0 msgr2=0x7f7100138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.308+0000 7f7105015700 1 --2- 172.21.15.72:0/4115052650 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f710009e1d0 0x7f7100138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.308+0000 7f7105015700 1 -- 172.21.15.72:0/4115052650 >> v1:172.21.15.72:6789/0 conn(0x7f710009d6f0 legacy=0x7f710009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.308+0000 7f7105015700 1 -- 172.21.15.72:0/4115052650 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710009a500 con 0x7f7100139170 2023-10-03T10:17:05.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.308+0000 7f70fffff700 1 --2- 172.21.15.72:0/4115052650 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f710009e1d0 0x7f7100138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.308+0000 7f7105015700 1 --2- 172.21.15.72:0/4115052650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7100139170 0x7f710013b550 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009d90 tx=0x7f70f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfc63413dbf93cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.308+0000 7f70ff7fe700 1 -- 172.21.15.72:0/4115052650 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f800e070 con 0x7f7100139170 2023-10-03T10:17:05.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.308+0000 7f70ff7fe700 1 -- 172.21.15.72:0/4115052650 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f800bb20 con 0x7f7100139170 2023-10-03T10:17:05.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.308+0000 7f70ff7fe700 1 -- 172.21.15.72:0/4115052650 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8012430 con 0x7f7100139170 2023-10-03T10:17:05.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.309+0000 7f7106a78700 1 -- 172.21.15.72:0/4115052650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7100139170 msgr2=0x7f710013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.309+0000 7f7106a78700 1 --2- 172.21.15.72:0/4115052650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7100139170 0x7f710013b550 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009d90 tx=0x7f70f800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:05.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.309+0000 7f7106a78700 1 -- 172.21.15.72:0/4115052650 shutdown_connections 2023-10-03T10:17:05.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.309+0000 7f7106a78700 1 --2- 172.21.15.72:0/4115052650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7100139170 0x7f710013b550 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.309+0000 7f7106a78700 1 --2- 172.21.15.72:0/4115052650 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f710009e1d0 0x7f7100138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.309+0000 7f7106a78700 1 -- 172.21.15.72:0/4115052650 >> 172.21.15.72:0/4115052650 conn(0x7f7100066f50 msgr2=0x7f710009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.309+0000 7f7106a78700 1 -- 172.21.15.72:0/4115052650 shutdown_connections 2023-10-03T10:17:05.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.309+0000 7f7106a78700 1 -- 172.21.15.72:0/4115052650 wait complete. 2023-10-03T10:17:05.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.310+0000 7f7106a78700 1 Processor -- start 2023-10-03T10:17:05.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.310+0000 7f7106a78700 1 -- start start 2023-10-03T10:17:05.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.311+0000 7f7106a78700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f710009d6f0 0x7f7100120910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.311+0000 7f7106a78700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f710009e1d0 0x7f7100120e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.311+0000 7f7106a78700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7100139170 0x7f7100121390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.311+0000 7f7106a78700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7100123e20 con 0x7f7100139170 2023-10-03T10:17:05.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.311+0000 7f7106a78700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71000a18d0 con 0x7f710009e1d0 2023-10-03T10:17:05.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.311+0000 7f7106a78700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71001224e0 con 0x7f710009d6f0 2023-10-03T10:17:05.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.311+0000 7f7104814700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f710009d6f0 0x7f7100120910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.311+0000 7f70fffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f710009e1d0 0x7f7100120e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.311+0000 7f7104814700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f710009d6f0 0x7f7100120910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39856/0 (socket says 172.21.15.72:39856) 2023-10-03T10:17:05.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.311+0000 7f7104814700 1 -- 172.21.15.72:0/2402380229 learned_addr learned my addr 172.21.15.72:0/2402380229 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.311+0000 7f7105015700 1 --2- 172.21.15.72:0/2402380229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7100139170 0x7f7100121390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.312+0000 7f70fffff700 1 -- 172.21.15.72:0/2402380229 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f710009d6f0 msgr2=0x7f7100120910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.312+0000 7f70fffff700 1 --2- 172.21.15.72:0/2402380229 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f710009d6f0 0x7f7100120910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.312+0000 7f70fffff700 1 -- 172.21.15.72:0/2402380229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7100139170 msgr2=0x7f7100121390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.312+0000 7f70fffff700 1 --2- 172.21.15.72:0/2402380229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7100139170 0x7f7100121390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.312+0000 7f70fffff700 1 -- 172.21.15.72:0/2402380229 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec0094a0 con 0x7f710009e1d0 2023-10-03T10:17:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.312+0000 7f7105015700 1 --2- 172.21.15.72:0/2402380229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7100139170 0x7f7100121390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.312+0000 7f70fffff700 1 --2- 172.21.15.72:0/2402380229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f710009e1d0 0x7f7100120e50 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00e9e0 tx=0x7f70ec00ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.312+0000 7f70fd7fa700 1 -- 172.21.15.72:0/2402380229 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00ee80 con 0x7f710009e1d0 2023-10-03T10:17:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.312+0000 7f70fd7fa700 1 -- 172.21.15.72:0/2402380229 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec00c850 con 0x7f710009e1d0 2023-10-03T10:17:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.312+0000 7f70fd7fa700 1 -- 172.21.15.72:0/2402380229 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00cc00 con 0x7f710009e1d0 2023-10-03T10:17:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.312+0000 7f7106a78700 1 -- 172.21.15.72:0/2402380229 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f8009a70 con 0x7f710009e1d0 2023-10-03T10:17:05.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.312+0000 7f7106a78700 1 -- 172.21.15.72:0/2402380229 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7100122c30 con 0x7f710009e1d0 2023-10-03T10:17:05.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.313+0000 7f70fd7fa700 1 -- 172.21.15.72:0/2402380229 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70ec00cd60 con 0x7f710009e1d0 2023-10-03T10:17:05.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.313+0000 7f70fd7fa700 1 -- 172.21.15.72:0/2402380229 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f70ec03f710 con 0x7f710009e1d0 2023-10-03T10:17:05.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.313+0000 7f7106a78700 1 -- 172.21.15.72:0/2402380229 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7100074ea0 con 0x7f710009e1d0 2023-10-03T10:17:05.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.318+0000 7f70fd7fa700 1 -- 172.21.15.72:0/2402380229 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70ec01be10 con 0x7f710009e1d0 2023-10-03T10:17:05.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.350+0000 7f56980a2700 1 Processor -- start 2023-10-03T10:17:05.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.350+0000 7f56980a2700 1 -- start start 2023-10-03T10:17:05.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.350+0000 7f56980a2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56900a0a30 0x7f56900a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.350+0000 7f56980a2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f569009d630 0x7f56900a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.350+0000 7f56980a2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56900a2a70 con 0x7f5690133930 2023-10-03T10:17:05.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.350+0000 7f56980a2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56900a01d0 con 0x7f56900a0a30 2023-10-03T10:17:05.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.350+0000 7f56980a2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f569009e2b0 con 0x7f569009d630 2023-10-03T10:17:05.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.350+0000 7f5695e3e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56900a0a30 0x7f56900a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.350+0000 7f569563d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f569009d630 0x7f56900a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.350+0000 7f569563d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f569009d630 0x7f56900a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39862/0 (socket says 172.21.15.72:39862) 2023-10-03T10:17:05.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.350+0000 7f569563d700 1 -- 172.21.15.72:0/3956072803 learned_addr learned my addr 172.21.15.72:0/3956072803 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:05.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.351+0000 7f5695e3e700 1 -- 172.21.15.72:0/3956072803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f569009d630 msgr2=0x7f56900a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.351+0000 7f5695e3e700 1 --2- 172.21.15.72:0/3956072803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f569009d630 0x7f56900a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.351+0000 7f5695e3e700 1 -- 172.21.15.72:0/3956072803 >> v1:172.21.15.72:6789/0 conn(0x7f5690133930 legacy=0x7f5690133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.351+0000 7f5695e3e700 1 -- 172.21.15.72:0/3956072803 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569009dc50 con 0x7f56900a0a30 2023-10-03T10:17:05.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.351+0000 7f5695e3e700 1 --2- 172.21.15.72:0/3956072803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56900a0a30 0x7f56900a0e00 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f568c009840 tx=0x7f568c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bda9ab0ea6d676 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.351+0000 7f5694e3c700 1 -- 172.21.15.72:0/3956072803 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c011830 con 0x7f56900a0a30 2023-10-03T10:17:05.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.351+0000 7f5694e3c700 1 -- 172.21.15.72:0/3956072803 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c011990 con 0x7f56900a0a30 2023-10-03T10:17:05.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.351+0000 7f5694e3c700 1 -- 172.21.15.72:0/3956072803 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c011d20 con 0x7f56900a0a30 2023-10-03T10:17:05.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.352+0000 7f56980a2700 1 -- 172.21.15.72:0/3956072803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56900a0a30 msgr2=0x7f56900a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.352+0000 7f56980a2700 1 --2- 172.21.15.72:0/3956072803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56900a0a30 0x7f56900a0e00 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f568c009840 tx=0x7f568c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:05.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.352+0000 7f56980a2700 1 -- 172.21.15.72:0/3956072803 shutdown_connections 2023-10-03T10:17:05.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.352+0000 7f56980a2700 1 --2- 172.21.15.72:0/3956072803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56900a0a30 0x7f56900a0e00 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.352+0000 7f56980a2700 1 --2- 172.21.15.72:0/3956072803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f569009d630 0x7f56900a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.352+0000 7f56980a2700 1 -- 172.21.15.72:0/3956072803 >> 172.21.15.72:0/3956072803 conn(0x7f56900a3050 msgr2=0x7f56900a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.352+0000 7f56980a2700 1 -- 172.21.15.72:0/3956072803 shutdown_connections 2023-10-03T10:17:05.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.352+0000 7f56980a2700 1 -- 172.21.15.72:0/3956072803 wait complete. 2023-10-03T10:17:05.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.353+0000 7f56980a2700 1 Processor -- start 2023-10-03T10:17:05.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.354+0000 7f56980a2700 1 -- start start 2023-10-03T10:17:05.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.354+0000 7f56980a2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f569009d630 0x7f56901c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.354+0000 7f56980a2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56900a0a30 0x7f56901c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.354+0000 7f56980a2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5690133930 0x7f56901c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.354+0000 7f56980a2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569011eea0 con 0x7f5690133930 2023-10-03T10:17:05.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.354+0000 7f56980a2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56901207f0 con 0x7f56900a0a30 2023-10-03T10:17:05.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.354+0000 7f56980a2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5690120600 con 0x7f569009d630 2023-10-03T10:17:05.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.354+0000 7f5695e3e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f569009d630 0x7f56901c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.354+0000 7f569563d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56900a0a30 0x7f56901c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.354+0000 7f5695e3e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f569009d630 0x7f56901c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39870/0 (socket says 172.21.15.72:39870) 2023-10-03T10:17:05.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.354+0000 7f569563d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56900a0a30 0x7f56901c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59510/0 (socket says 172.21.15.72:59510) 2023-10-03T10:17:05.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.354+0000 7f5695e3e700 1 -- 172.21.15.72:0/4113294311 learned_addr learned my addr 172.21.15.72:0/4113294311 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:05.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.354+0000 7f569663f700 1 --2- 172.21.15.72:0/4113294311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5690133930 0x7f56901c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.355+0000 7f5695e3e700 1 -- 172.21.15.72:0/4113294311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56900a0a30 msgr2=0x7f56901c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.355+0000 7f5695e3e700 1 --2- 172.21.15.72:0/4113294311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56900a0a30 0x7f56901c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.355+0000 7f5695e3e700 1 -- 172.21.15.72:0/4113294311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5690133930 msgr2=0x7f56901c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.355+0000 7f5695e3e700 1 --2- 172.21.15.72:0/4113294311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5690133930 0x7f56901c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.355+0000 7f5695e3e700 1 -- 172.21.15.72:0/4113294311 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c0094a0 con 0x7f569009d630 2023-10-03T10:17:05.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.355+0000 7f569563d700 1 --2- 172.21.15.72:0/4113294311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56900a0a30 0x7f56901c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.355+0000 7f569663f700 1 --2- 172.21.15.72:0/4113294311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5690133930 0x7f56901c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.355+0000 7f5695e3e700 1 --2- 172.21.15.72:0/4113294311 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f569009d630 0x7f56901c8120 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f568c009fd0 tx=0x7f568c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.355+0000 7f56867fc700 1 -- 172.21.15.72:0/4113294311 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c0036a0 con 0x7f569009d630 2023-10-03T10:17:05.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.355+0000 7f56867fc700 1 -- 172.21.15.72:0/4113294311 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c01f070 con 0x7f569009d630 2023-10-03T10:17:05.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.355+0000 7f56980a2700 1 -- 172.21.15.72:0/4113294311 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5690122510 con 0x7f569009d630 2023-10-03T10:17:05.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.355+0000 7f56867fc700 1 -- 172.21.15.72:0/4113294311 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c003a60 con 0x7f569009d630 2023-10-03T10:17:05.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.355+0000 7f56980a2700 1 -- 172.21.15.72:0/4113294311 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5690120df0 con 0x7f569009d630 2023-10-03T10:17:05.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.356+0000 7f56980a2700 1 -- 172.21.15.72:0/4113294311 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56900747f0 con 0x7f569009d630 2023-10-03T10:17:05.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.357+0000 7f56867fc700 1 -- 172.21.15.72:0/4113294311 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f568c003bc0 con 0x7f569009d630 2023-10-03T10:17:05.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.357+0000 7f56867fc700 1 -- 172.21.15.72:0/4113294311 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f568c021070 con 0x7f569009d630 2023-10-03T10:17:05.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.361+0000 7f56867fc700 1 -- 172.21.15.72:0/4113294311 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f568c0197c0 con 0x7f569009d630 2023-10-03T10:17:05.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.409+0000 7f75250ca700 1 -- 172.21.15.72:0/1065686295 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f75201a5650 con 0x7f752009e930 2023-10-03T10:17:05.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.410+0000 7f75077fe700 1 -- 172.21.15.72:0/1065686295 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f751400dca0 con 0x7f752009e930 2023-10-03T10:17:05.410 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.412+0000 7f75250ca700 1 -- 172.21.15.72:0/1065686295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f752009e930 msgr2=0x7f75201c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.412+0000 7f75250ca700 1 --2- 172.21.15.72:0/1065686295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f752009e930 0x7f75201c4340 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f7514012fc0 tx=0x7f75140103a0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.412+0000 7f75250ca700 1 -- 172.21.15.72:0/1065686295 shutdown_connections 2023-10-03T10:17:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.412+0000 7f75250ca700 1 --2- 172.21.15.72:0/1065686295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f752009e930 0x7f75201c4340 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.412+0000 7f75250ca700 1 --2- 172.21.15.72:0/1065686295 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f752009f650 0x7f75201c07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.412+0000 7f75250ca700 1 --2- 172.21.15.72:0/1065686295 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f752009f240 0x7f75201c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.412+0000 7f75250ca700 1 -- 172.21.15.72:0/1065686295 >> 172.21.15.72:0/1065686295 conn(0x7f75200a4210 msgr2=0x7f75201b6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.412+0000 7f75250ca700 1 -- 172.21.15.72:0/1065686295 shutdown_connections 2023-10-03T10:17:05.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.412+0000 7f75250ca700 1 -- 172.21.15.72:0/1065686295 wait complete. 2023-10-03T10:17:05.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:05.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.514+0000 7f7106a78700 1 -- 172.21.15.72:0/2402380229 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f710006c360 con 0x7f710009e1d0 2023-10-03T10:17:05.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.514+0000 7f70fd7fa700 1 -- 172.21.15.72:0/2402380229 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f70ec01b3b0 con 0x7f710009e1d0 2023-10-03T10:17:05.515 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:05.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:05.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.516+0000 7f7106a78700 1 -- 172.21.15.72:0/2402380229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f710009e1d0 msgr2=0x7f7100120e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.516+0000 7f7106a78700 1 --2- 172.21.15.72:0/2402380229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f710009e1d0 0x7f7100120e50 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00e9e0 tx=0x7f70ec00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.516+0000 7f7106a78700 1 -- 172.21.15.72:0/2402380229 shutdown_connections 2023-10-03T10:17:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.516+0000 7f7106a78700 1 --2- 172.21.15.72:0/2402380229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7100139170 0x7f7100121390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.516+0000 7f7106a78700 1 --2- 172.21.15.72:0/2402380229 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f710009d6f0 0x7f7100120910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.516+0000 7f7106a78700 1 --2- 172.21.15.72:0/2402380229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f710009e1d0 0x7f7100120e50 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.516+0000 7f7106a78700 1 -- 172.21.15.72:0/2402380229 >> 172.21.15.72:0/2402380229 conn(0x7f7100066f50 msgr2=0x7f710009b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.516+0000 7f7106a78700 1 -- 172.21.15.72:0/2402380229 shutdown_connections 2023-10-03T10:17:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.516+0000 7f7106a78700 1 -- 172.21.15.72:0/2402380229 wait complete. 2023-10-03T10:17:05.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.579+0000 7f56980a2700 1 -- 172.21.15.72:0/4113294311 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5690072980 con 0x7f569009d630 2023-10-03T10:17:05.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.579+0000 7f56867fc700 1 -- 172.21.15.72:0/4113294311 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f568c015070 con 0x7f569009d630 2023-10-03T10:17:05.580 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.581+0000 7f56980a2700 1 -- 172.21.15.72:0/4113294311 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f569009d630 msgr2=0x7f56901c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.581+0000 7f56980a2700 1 --2- 172.21.15.72:0/4113294311 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f569009d630 0x7f56901c8120 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f568c009fd0 tx=0x7f568c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.581+0000 7f56980a2700 1 -- 172.21.15.72:0/4113294311 shutdown_connections 2023-10-03T10:17:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.581+0000 7f56980a2700 1 --2- 172.21.15.72:0/4113294311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5690133930 0x7f56901c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.581+0000 7f56980a2700 1 --2- 172.21.15.72:0/4113294311 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f569009d630 0x7f56901c8120 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.581+0000 7f56980a2700 1 --2- 172.21.15.72:0/4113294311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56900a0a30 0x7f56901c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.581+0000 7f56980a2700 1 -- 172.21.15.72:0/4113294311 >> 172.21.15.72:0/4113294311 conn(0x7f56900a3050 msgr2=0x7f569009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.581+0000 7f56980a2700 1 -- 172.21.15.72:0/4113294311 shutdown_connections 2023-10-03T10:17:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.581+0000 7f56980a2700 1 -- 172.21.15.72:0/4113294311 wait complete. 2023-10-03T10:17:05.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:05.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.641+0000 7f18708a9700 1 Processor -- start 2023-10-03T10:17:05.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.641+0000 7f18708a9700 1 -- start start 2023-10-03T10:17:05.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.641+0000 7f18708a9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f186c0a09c0 0x7f186c0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.641+0000 7f18708a9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f186c0a12d0 0x7f186c134030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.641+0000 7f18708a9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186c09ea10 con 0x7f186c09d5c0 2023-10-03T10:17:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.641+0000 7f18708a9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186c09e210 con 0x7f186c0a09c0 2023-10-03T10:17:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.641+0000 7f18708a9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0a26f0 con 0x7f186c0a12d0 2023-10-03T10:17:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.641+0000 7f186a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f186c0a09c0 0x7f186c0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.641+0000 7f186ad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f186c0a12d0 0x7f186c134030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.642+0000 7f186a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f186c0a09c0 0x7f186c0a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41008/0 (socket says 172.21.15.72:41008) 2023-10-03T10:17:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.642+0000 7f186a59c700 1 -- 172.21.15.72:0/3641426822 learned_addr learned my addr 172.21.15.72:0/3641426822 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.642+0000 7f186ad9d700 1 -- 172.21.15.72:0/3641426822 >> v2:172.21.15.72:3300/0 conn(0x7f186c0a09c0 msgr2=0x7f186c0a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.642+0000 7f186ad9d700 1 --2- 172.21.15.72:0/3641426822 >> v2:172.21.15.72:3300/0 conn(0x7f186c0a09c0 0x7f186c0a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.642+0000 7f186ad9d700 1 -- 172.21.15.72:0/3641426822 >> v1:172.21.15.72:6789/0 conn(0x7f186c09d5c0 legacy=0x7f186c133920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.642+0000 7f186ad9d700 1 -- 172.21.15.72:0/3641426822 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c09db70 con 0x7f186c0a12d0 2023-10-03T10:17:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.642+0000 7f186a59c700 1 --2- 172.21.15.72:0/3641426822 >> v2:172.21.15.72:3300/0 conn(0x7f186c0a09c0 0x7f186c0a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.642+0000 7f186ad9d700 1 --2- 172.21.15.72:0/3641426822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f186c0a12d0 0x7f186c134030 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1864009d90 tx=0x7f186400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abdfa20a1e92b261 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.642+0000 7f186959a700 1 -- 172.21.15.72:0/3641426822 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186400e070 con 0x7f186c0a12d0 2023-10-03T10:17:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.642+0000 7f186959a700 1 -- 172.21.15.72:0/3641426822 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186400bb20 con 0x7f186c0a12d0 2023-10-03T10:17:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.642+0000 7f186959a700 1 -- 172.21.15.72:0/3641426822 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864012430 con 0x7f186c0a12d0 2023-10-03T10:17:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.643+0000 7f18708a9700 1 -- 172.21.15.72:0/3641426822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f186c0a12d0 msgr2=0x7f186c134030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.643+0000 7f18708a9700 1 --2- 172.21.15.72:0/3641426822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f186c0a12d0 0x7f186c134030 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1864009d90 tx=0x7f186400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.643+0000 7f18708a9700 1 -- 172.21.15.72:0/3641426822 shutdown_connections 2023-10-03T10:17:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.643+0000 7f18708a9700 1 --2- 172.21.15.72:0/3641426822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f186c0a12d0 0x7f186c134030 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.643+0000 7f18708a9700 1 --2- 172.21.15.72:0/3641426822 >> v2:172.21.15.72:3300/0 conn(0x7f186c0a09c0 0x7f186c0a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.643+0000 7f18708a9700 1 -- 172.21.15.72:0/3641426822 >> 172.21.15.72:0/3641426822 conn(0x7f186c0a2fe0 msgr2=0x7f186c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.643+0000 7f18708a9700 1 -- 172.21.15.72:0/3641426822 shutdown_connections 2023-10-03T10:17:05.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.643+0000 7f18708a9700 1 -- 172.21.15.72:0/3641426822 wait complete. 2023-10-03T10:17:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.644+0000 7f18708a9700 1 Processor -- start 2023-10-03T10:17:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.644+0000 7f18708a9700 1 -- start start 2023-10-03T10:17:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f18708a9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f186c09d5c0 0x7f186c11efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f18708a9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f186c0a09c0 0x7f186c11f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f18708a9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f186c0a12d0 0x7f186c11fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f18708a9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c123430 con 0x7f186c09d5c0 2023-10-03T10:17:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f18708a9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c120b60 con 0x7f186c0a12d0 2023-10-03T10:17:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f18708a9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f186c121180 con 0x7f186c0a09c0 2023-10-03T10:17:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f186a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f186c09d5c0 0x7f186c11efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f186ad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f186c0a12d0 0x7f186c11fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f186a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f186c09d5c0 0x7f186c11efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41016/0 (socket says 172.21.15.72:41016) 2023-10-03T10:17:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f186a59c700 1 -- 172.21.15.72:0/3812400600 learned_addr learned my addr 172.21.15.72:0/3812400600 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f1869d9b700 1 --2- 172.21.15.72:0/3812400600 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f186c0a09c0 0x7f186c11f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f186a59c700 1 -- 172.21.15.72:0/3812400600 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f186c0a09c0 msgr2=0x7f186c11f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f186a59c700 1 --2- 172.21.15.72:0/3812400600 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f186c0a09c0 0x7f186c11f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f186a59c700 1 -- 172.21.15.72:0/3812400600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f186c0a12d0 msgr2=0x7f186c11fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f186a59c700 1 --2- 172.21.15.72:0/3812400600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f186c0a12d0 0x7f186c11fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f186a59c700 1 -- 172.21.15.72:0/3812400600 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c009550 con 0x7f186c09d5c0 2023-10-03T10:17:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f1869d9b700 1 --2- 172.21.15.72:0/3812400600 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f186c0a09c0 0x7f186c11f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f186ad9d700 1 --2- 172.21.15.72:0/3812400600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f186c0a12d0 0x7f186c11fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f186a59c700 1 --2- 172.21.15.72:0/3812400600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f186c09d5c0 0x7f186c11efe0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f185c00ec10 tx=0x7f185c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f185affd700 1 -- 172.21.15.72:0/3812400600 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c00c850 con 0x7f186c09d5c0 2023-10-03T10:17:05.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f185affd700 1 -- 172.21.15.72:0/3812400600 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185c00c9b0 con 0x7f186c09d5c0 2023-10-03T10:17:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f185affd700 1 -- 172.21.15.72:0/3812400600 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c00cd40 con 0x7f186c09d5c0 2023-10-03T10:17:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.645+0000 7f18708a9700 1 -- 172.21.15.72:0/3812400600 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1864009a70 con 0x7f186c09d5c0 2023-10-03T10:17:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.646+0000 7f18708a9700 1 -- 172.21.15.72:0/3812400600 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c0a50a0 con 0x7f186c09d5c0 2023-10-03T10:17:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.646+0000 7f185affd700 1 -- 172.21.15.72:0/3812400600 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f185c013470 con 0x7f186c09d5c0 2023-10-03T10:17:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.646+0000 7f18708a9700 1 -- 172.21.15.72:0/3812400600 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186c09cec0 con 0x7f186c09d5c0 2023-10-03T10:17:05.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.646+0000 7f185affd700 1 -- 172.21.15.72:0/3812400600 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f185c03fbe0 con 0x7f186c09d5c0 2023-10-03T10:17:05.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.651+0000 7f185affd700 1 -- 172.21.15.72:0/3812400600 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f185c013aa0 con 0x7f186c09d5c0 2023-10-03T10:17:05.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.839+0000 7f18708a9700 1 -- 172.21.15.72:0/3812400600 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f186c0747f0 con 0x7f186c09d5c0 2023-10-03T10:17:05.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.839+0000 7f185affd700 1 -- 172.21.15.72:0/3812400600 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f185c021030 con 0x7f186c09d5c0 2023-10-03T10:17:05.840 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.841+0000 7f18708a9700 1 -- 172.21.15.72:0/3812400600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f186c09d5c0 msgr2=0x7f186c11efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.841+0000 7f18708a9700 1 --2- 172.21.15.72:0/3812400600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f186c09d5c0 0x7f186c11efe0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f185c00ec10 tx=0x7f185c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.841+0000 7f18708a9700 1 -- 172.21.15.72:0/3812400600 shutdown_connections 2023-10-03T10:17:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.841+0000 7f18708a9700 1 --2- 172.21.15.72:0/3812400600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f186c09d5c0 0x7f186c11efe0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.841+0000 7f18708a9700 1 --2- 172.21.15.72:0/3812400600 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f186c0a12d0 0x7f186c11fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.841+0000 7f18708a9700 1 --2- 172.21.15.72:0/3812400600 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f186c0a09c0 0x7f186c11f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.841+0000 7f18708a9700 1 -- 172.21.15.72:0/3812400600 >> 172.21.15.72:0/3812400600 conn(0x7f186c0a2fe0 msgr2=0x7f186c133ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.841+0000 7f18708a9700 1 -- 172.21.15.72:0/3812400600 shutdown_connections 2023-10-03T10:17:05.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:05.841+0000 7f18708a9700 1 -- 172.21.15.72:0/3812400600 wait complete. 2023-10-03T10:17:05.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:06.425 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:06.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:06.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.553+0000 7fbdab486700 1 Processor -- start 2023-10-03T10:17:06.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.553+0000 7fbdab486700 1 -- start start 2023-10-03T10:17:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbdab486700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbda409d6f0 0x7fbda409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbdab486700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbda409e000 0x7fbda4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbdab486700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbda409e410 0x7fbda4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbdab486700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda409f520 con 0x7fbda409d6f0 2023-10-03T10:17:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbdab486700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda409f130 con 0x7fbda409e000 2023-10-03T10:17:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbdab486700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbda409e930 con 0x7fbda409e410 2023-10-03T10:17:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbda8a21700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbda409e000 0x7fbda4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbda9a23700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbda409e410 0x7fbda4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbda9a23700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbda409e410 0x7fbda4130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39884/0 (socket says 172.21.15.72:39884) 2023-10-03T10:17:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbda8a21700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbda409e000 0x7fbda4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59552/0 (socket says 172.21.15.72:59552) 2023-10-03T10:17:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbda9a23700 1 -- 172.21.15.72:0/3629242813 learned_addr learned my addr 172.21.15.72:0/3629242813 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbda9222700 1 --2- 172.21.15.72:0/3629242813 >> v2:172.21.15.72:3300/0 conn(0x7fbda409d6f0 0x7fbda409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbda8a21700 1 -- 172.21.15.72:0/3629242813 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbda409e410 msgr2=0x7fbda4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbda8a21700 1 --2- 172.21.15.72:0/3629242813 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbda409e410 0x7fbda4130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbda8a21700 1 -- 172.21.15.72:0/3629242813 >> v2:172.21.15.72:3300/0 conn(0x7fbda409d6f0 msgr2=0x7fbda409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbda8a21700 1 --2- 172.21.15.72:0/3629242813 >> v2:172.21.15.72:3300/0 conn(0x7fbda409d6f0 0x7fbda409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbda8a21700 1 -- 172.21.15.72:0/3629242813 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda409b2d0 con 0x7fbda409e000 2023-10-03T10:17:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbda9222700 1 --2- 172.21.15.72:0/3629242813 >> v2:172.21.15.72:3300/0 conn(0x7fbda409d6f0 0x7fbda409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbda8a21700 1 --2- 172.21.15.72:0/3629242813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbda409e000 0x7fbda4130660 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbd94009840 tx=0x7fbd94009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=629a114b57640e10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbd9bfff700 1 -- 172.21.15.72:0/3629242813 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400f8a0 con 0x7fbda409e000 2023-10-03T10:17:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbd9bfff700 1 -- 172.21.15.72:0/3629242813 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9400fa00 con 0x7fbda409e000 2023-10-03T10:17:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.554+0000 7fbd9bfff700 1 -- 172.21.15.72:0/3629242813 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400fd90 con 0x7fbda409e000 2023-10-03T10:17:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.555+0000 7fbdab486700 1 -- 172.21.15.72:0/3629242813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbda409e000 msgr2=0x7fbda4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.555+0000 7fbdab486700 1 --2- 172.21.15.72:0/3629242813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbda409e000 0x7fbda4130660 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbd94009840 tx=0x7fbd94009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.555+0000 7fbdab486700 1 -- 172.21.15.72:0/3629242813 shutdown_connections 2023-10-03T10:17:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.555+0000 7fbdab486700 1 --2- 172.21.15.72:0/3629242813 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbda409e410 0x7fbda4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.555+0000 7fbdab486700 1 --2- 172.21.15.72:0/3629242813 >> v2:172.21.15.72:3300/0 conn(0x7fbda409d6f0 0x7fbda409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.555+0000 7fbdab486700 1 --2- 172.21.15.72:0/3629242813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbda409e000 0x7fbda4130660 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.555+0000 7fbdab486700 1 -- 172.21.15.72:0/3629242813 >> 172.21.15.72:0/3629242813 conn(0x7fbda4066f50 msgr2=0x7fbda409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.555+0000 7fbdab486700 1 -- 172.21.15.72:0/3629242813 shutdown_connections 2023-10-03T10:17:06.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.555+0000 7fbdab486700 1 -- 172.21.15.72:0/3629242813 wait complete. 2023-10-03T10:17:06.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.556+0000 7fbdab486700 1 Processor -- start 2023-10-03T10:17:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.556+0000 7fbdab486700 1 -- start start 2023-10-03T10:17:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbdab486700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbda409d6f0 0x7fbda4122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbdab486700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbda409e000 0x7fbda41234a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbdab486700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbda409e410 0x7fbda41c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbdab486700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda4122b50 con 0x7fbda409e410 2023-10-03T10:17:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbdab486700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40a1a70 con 0x7fbda409d6f0 2023-10-03T10:17:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbdab486700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbda409c700 con 0x7fbda409e000 2023-10-03T10:17:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbda8a21700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbda409e000 0x7fbda41234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbda8a21700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbda409e000 0x7fbda41234a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39892/0 (socket says 172.21.15.72:39892) 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbda8a21700 1 -- 172.21.15.72:0/39626308 learned_addr learned my addr 172.21.15.72:0/39626308 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbda9222700 1 --2- 172.21.15.72:0/39626308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbda409d6f0 0x7fbda4122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbda9a23700 1 --2- 172.21.15.72:0/39626308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbda409e410 0x7fbda41c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbda8a21700 1 -- 172.21.15.72:0/39626308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbda409d6f0 msgr2=0x7fbda4122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbda8a21700 1 --2- 172.21.15.72:0/39626308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbda409d6f0 0x7fbda4122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbda8a21700 1 -- 172.21.15.72:0/39626308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbda409e410 msgr2=0x7fbda41c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbda8a21700 1 --2- 172.21.15.72:0/39626308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbda409e410 0x7fbda41c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbda8a21700 1 -- 172.21.15.72:0/39626308 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda00094a0 con 0x7fbda409e000 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.557+0000 7fbda8a21700 1 --2- 172.21.15.72:0/39626308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbda409e000 0x7fbda41234a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbd94009fd0 tx=0x7fbd94004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.558+0000 7fbd99ffb700 1 -- 172.21.15.72:0/39626308 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd940038a0 con 0x7fbda409e000 2023-10-03T10:17:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.558+0000 7fbd99ffb700 1 -- 172.21.15.72:0/39626308 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd94003a00 con 0x7fbda409e000 2023-10-03T10:17:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.558+0000 7fbdab486700 1 -- 172.21.15.72:0/39626308 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd940094a0 con 0x7fbda409e000 2023-10-03T10:17:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.558+0000 7fbd99ffb700 1 -- 172.21.15.72:0/39626308 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd94003db0 con 0x7fbda409e000 2023-10-03T10:17:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.558+0000 7fbdab486700 1 -- 172.21.15.72:0/39626308 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda4124f10 con 0x7fbda409e000 2023-10-03T10:17:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.558+0000 7fbd99ffb700 1 -- 172.21.15.72:0/39626308 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd94019400 con 0x7fbda409e000 2023-10-03T10:17:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.559+0000 7fbd99ffb700 1 -- 172.21.15.72:0/39626308 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbd94040ac0 con 0x7fbda409e000 2023-10-03T10:17:06.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.559+0000 7fbdab486700 1 -- 172.21.15.72:0/39626308 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda4074ea0 con 0x7fbda409e000 2023-10-03T10:17:06.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.564+0000 7fbd99ffb700 1 -- 172.21.15.72:0/39626308 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd9402a900 con 0x7fbda409e000 2023-10-03T10:17:06.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:06.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.693+0000 7f3eb9579700 1 Processor -- start 2023-10-03T10:17:06.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.693+0000 7f3eb9579700 1 -- start start 2023-10-03T10:17:06.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.694+0000 7f3eb9579700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3eb4133420 0x7f3eb41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.694+0000 7f3eb9579700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb4134260 0x7f3eb41306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.694+0000 7f3eb9579700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb406b990 con 0x7f3eb4133e30 2023-10-03T10:17:06.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.694+0000 7f3eb9579700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb40a0590 con 0x7f3eb4133420 2023-10-03T10:17:06.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.694+0000 7f3eb9579700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb409fb80 con 0x7f3eb4134260 2023-10-03T10:17:06.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.694+0000 7f3eb2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3eb4133420 0x7f3eb41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.694+0000 7f3eb37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb4134260 0x7f3eb41306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.694+0000 7f3eb2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3eb4133420 0x7f3eb41337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41048/0 (socket says 172.21.15.72:41048) 2023-10-03T10:17:06.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.694+0000 7f3eb2ffd700 1 -- 172.21.15.72:0/3336823165 learned_addr learned my addr 172.21.15.72:0/3336823165 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:06.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.694+0000 7f3eb37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb4134260 0x7f3eb41306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39902/0 (socket says 172.21.15.72:39902) 2023-10-03T10:17:06.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.694+0000 7f3eb2ffd700 1 -- 172.21.15.72:0/3336823165 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb4134260 msgr2=0x7f3eb41306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.694+0000 7f3eb2ffd700 1 --2- 172.21.15.72:0/3336823165 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb4134260 0x7f3eb41306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.694+0000 7f3eb2ffd700 1 -- 172.21.15.72:0/3336823165 >> v1:172.21.15.72:6789/0 conn(0x7f3eb4133e30 legacy=0x7f3eb412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.694+0000 7f3eb2ffd700 1 -- 172.21.15.72:0/3336823165 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb40a0030 con 0x7f3eb4133420 2023-10-03T10:17:06.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.695+0000 7f3eb2ffd700 1 --2- 172.21.15.72:0/3336823165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb4133420 0x7f3eb41337f0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40098f0 tx=0x7f3ea4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48b1042d987c2c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.695+0000 7f3eb1ffb700 1 -- 172.21.15.72:0/3336823165 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4011830 con 0x7f3eb4133420 2023-10-03T10:17:06.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.695+0000 7f3eb1ffb700 1 -- 172.21.15.72:0/3336823165 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4011990 con 0x7f3eb4133420 2023-10-03T10:17:06.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.695+0000 7f3eb1ffb700 1 -- 172.21.15.72:0/3336823165 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4011d20 con 0x7f3eb4133420 2023-10-03T10:17:06.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.695+0000 7f3eb9579700 1 -- 172.21.15.72:0/3336823165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb4133420 msgr2=0x7f3eb41337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.695+0000 7f3eb9579700 1 --2- 172.21.15.72:0/3336823165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb4133420 0x7f3eb41337f0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40098f0 tx=0x7f3ea4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:06.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.695+0000 7f3eb9579700 1 -- 172.21.15.72:0/3336823165 shutdown_connections 2023-10-03T10:17:06.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.695+0000 7f3eb9579700 1 --2- 172.21.15.72:0/3336823165 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb4134260 0x7f3eb41306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.695+0000 7f3eb9579700 1 --2- 172.21.15.72:0/3336823165 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb4133420 0x7f3eb41337f0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.695+0000 7f3eb9579700 1 -- 172.21.15.72:0/3336823165 >> 172.21.15.72:0/3336823165 conn(0x7f3eb40a4210 msgr2=0x7f3eb40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.695+0000 7f3eb9579700 1 -- 172.21.15.72:0/3336823165 shutdown_connections 2023-10-03T10:17:06.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.696+0000 7f3eb9579700 1 -- 172.21.15.72:0/3336823165 wait complete. 2023-10-03T10:17:06.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb9579700 1 Processor -- start 2023-10-03T10:17:06.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb9579700 1 -- start start 2023-10-03T10:17:06.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb9579700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb4133420 0x7f3eb409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb9579700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb4133e30 0x7f3eb409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb9579700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb4134260 0x7f3eb409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb9579700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb409d850 con 0x7f3eb4134260 2023-10-03T10:17:06.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb9579700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb409e0a0 con 0x7f3eb4133420 2023-10-03T10:17:06.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb9579700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb412d870 con 0x7f3eb4133e30 2023-10-03T10:17:06.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb4133e30 0x7f3eb409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb4134260 0x7f3eb409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb4133e30 0x7f3eb409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39916/0 (socket says 172.21.15.72:39916) 2023-10-03T10:17:06.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb27fc700 1 -- 172.21.15.72:0/255982232 learned_addr learned my addr 172.21.15.72:0/255982232 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb37fe700 1 -- 172.21.15.72:0/255982232 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb4133e30 msgr2=0x7f3eb409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb37fe700 1 --2- 172.21.15.72:0/255982232 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb4133e30 0x7f3eb409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb37fe700 1 -- 172.21.15.72:0/255982232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb4133420 msgr2=0x7f3eb409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb37fe700 1 --2- 172.21.15.72:0/255982232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb4133420 0x7f3eb409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb37fe700 1 -- 172.21.15.72:0/255982232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea4009550 con 0x7f3eb4134260 2023-10-03T10:17:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.697+0000 7f3eb27fc700 1 --2- 172.21.15.72:0/255982232 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb4133e30 0x7f3eb409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.698+0000 7f3eb37fe700 1 --2- 172.21.15.72:0/255982232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb4134260 0x7f3eb409cf00 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00ef90 tx=0x7f3eac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.698+0000 7f3e9b7fe700 1 -- 172.21.15.72:0/255982232 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac00cd40 con 0x7f3eb4134260 2023-10-03T10:17:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.698+0000 7f3e9b7fe700 1 -- 172.21.15.72:0/255982232 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac00f040 con 0x7f3eb4134260 2023-10-03T10:17:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.698+0000 7f3eb9579700 1 -- 172.21.15.72:0/255982232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb411fe30 con 0x7f3eb4134260 2023-10-03T10:17:06.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.698+0000 7f3e9b7fe700 1 -- 172.21.15.72:0/255982232 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0146c0 con 0x7f3eb4134260 2023-10-03T10:17:06.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.698+0000 7f3eb9579700 1 -- 172.21.15.72:0/255982232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb412d3b0 con 0x7f3eb4134260 2023-10-03T10:17:06.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.699+0000 7f3e9b7fe700 1 -- 172.21.15.72:0/255982232 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3eac014820 con 0x7f3eb4134260 2023-10-03T10:17:06.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.699+0000 7f3e9b7fe700 1 -- 172.21.15.72:0/255982232 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3eac040250 con 0x7f3eb4134260 2023-10-03T10:17:06.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.699+0000 7f3eb9579700 1 -- 172.21.15.72:0/255982232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb4131400 con 0x7f3eb4134260 2023-10-03T10:17:06.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.704+0000 7f3e9b7fe700 1 -- 172.21.15.72:0/255982232 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3eac018020 con 0x7f3eb4134260 2023-10-03T10:17:06.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.740+0000 7f0d2ca0e700 1 Processor -- start 2023-10-03T10:17:06.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.740+0000 7f0d2ca0e700 1 -- start start 2023-10-03T10:17:06.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d2ca0e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d2809d630 0x7f0d280a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d2ca0e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d28138d80 0x7f0d2813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d2ca0e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d280a2a70 con 0x7f0d280a0a30 2023-10-03T10:17:06.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d2ca0e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d280a01d0 con 0x7f0d28138d80 2023-10-03T10:17:06.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d2ca0e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2809e2b0 con 0x7f0d2809d630 2023-10-03T10:17:06.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d26d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d28138d80 0x7f0d2813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d25d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d2809d630 0x7f0d280a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d26d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d28138d80 0x7f0d2813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41066/0 (socket says 172.21.15.72:41066) 2023-10-03T10:17:06.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d26d9d700 1 -- 172.21.15.72:0/1463272815 learned_addr learned my addr 172.21.15.72:0/1463272815 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:06.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d25d9b700 1 --2- 172.21.15.72:0/1463272815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d2809d630 0x7f0d280a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39924/0 (socket says 172.21.15.72:39924) 2023-10-03T10:17:06.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d25d9b700 1 -- 172.21.15.72:0/1463272815 >> v2:172.21.15.72:3300/0 conn(0x7f0d28138d80 msgr2=0x7f0d2813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d25d9b700 1 --2- 172.21.15.72:0/1463272815 >> v2:172.21.15.72:3300/0 conn(0x7f0d28138d80 0x7f0d2813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d25d9b700 1 -- 172.21.15.72:0/1463272815 >> v1:172.21.15.72:6789/0 conn(0x7f0d280a0a30 legacy=0x7f0d280a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d25d9b700 1 -- 172.21.15.72:0/1463272815 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2809dc50 con 0x7f0d2809d630 2023-10-03T10:17:06.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d25d9b700 1 --2- 172.21.15.72:0/1463272815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d2809d630 0x7f0d280a1510 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009840 tx=0x7f0d1c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75a7e1ceeb15f3c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.741+0000 7f0d2559a700 1 -- 172.21.15.72:0/1463272815 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c011830 con 0x7f0d2809d630 2023-10-03T10:17:06.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.742+0000 7f0d2559a700 1 -- 172.21.15.72:0/1463272815 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c011990 con 0x7f0d2809d630 2023-10-03T10:17:06.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.742+0000 7f0d2559a700 1 -- 172.21.15.72:0/1463272815 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c011d20 con 0x7f0d2809d630 2023-10-03T10:17:06.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.742+0000 7f0d2ca0e700 1 -- 172.21.15.72:0/1463272815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d2809d630 msgr2=0x7f0d280a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.742+0000 7f0d2ca0e700 1 --2- 172.21.15.72:0/1463272815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d2809d630 0x7f0d280a1510 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009840 tx=0x7f0d1c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:06.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.742+0000 7f0d2ca0e700 1 -- 172.21.15.72:0/1463272815 shutdown_connections 2023-10-03T10:17:06.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.742+0000 7f0d2ca0e700 1 --2- 172.21.15.72:0/1463272815 >> v2:172.21.15.72:3300/0 conn(0x7f0d28138d80 0x7f0d2813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.742+0000 7f0d2ca0e700 1 --2- 172.21.15.72:0/1463272815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d2809d630 0x7f0d280a1510 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.742+0000 7f0d2ca0e700 1 -- 172.21.15.72:0/1463272815 >> 172.21.15.72:0/1463272815 conn(0x7f0d280a3050 msgr2=0x7f0d280a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.742+0000 7f0d2ca0e700 1 -- 172.21.15.72:0/1463272815 shutdown_connections 2023-10-03T10:17:06.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.742+0000 7f0d2ca0e700 1 -- 172.21.15.72:0/1463272815 wait complete. 2023-10-03T10:17:06.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.743+0000 7f0d2ca0e700 1 Processor -- start 2023-10-03T10:17:06.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.743+0000 7f0d2ca0e700 1 -- start start 2023-10-03T10:17:06.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d2ca0e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d2809d630 0x7f0d28133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d2ca0e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d280a0a30 0x7f0d28133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d2ca0e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d28138d80 0x7f0d281341e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d2ca0e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28134bc0 con 0x7f0d280a0a30 2023-10-03T10:17:06.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d2ca0e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28136630 con 0x7f0d28138d80 2023-10-03T10:17:06.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d2ca0e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28136fa0 con 0x7f0d2809d630 2023-10-03T10:17:06.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d2659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d2809d630 0x7f0d28133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d2659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d2809d630 0x7f0d28133760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39928/0 (socket says 172.21.15.72:39928) 2023-10-03T10:17:06.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d2659c700 1 -- 172.21.15.72:0/2847772932 learned_addr learned my addr 172.21.15.72:0/2847772932 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:06.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d25d9b700 1 --2- 172.21.15.72:0/2847772932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d280a0a30 0x7f0d28133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d26d9d700 1 --2- 172.21.15.72:0/2847772932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d28138d80 0x7f0d281341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d25d9b700 1 -- 172.21.15.72:0/2847772932 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d2809d630 msgr2=0x7f0d28133760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d25d9b700 1 --2- 172.21.15.72:0/2847772932 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d2809d630 0x7f0d28133760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d25d9b700 1 -- 172.21.15.72:0/2847772932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d28138d80 msgr2=0x7f0d281341e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d25d9b700 1 --2- 172.21.15.72:0/2847772932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d28138d80 0x7f0d281341e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d25d9b700 1 -- 172.21.15.72:0/2847772932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c0094a0 con 0x7f0d280a0a30 2023-10-03T10:17:06.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d2659c700 1 --2- 172.21.15.72:0/2847772932 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d2809d630 0x7f0d28133760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.744+0000 7f0d25d9b700 1 --2- 172.21.15.72:0/2847772932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d280a0a30 0x7f0d28133ca0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c016000 tx=0x7f0d1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.745+0000 7f0d16ffd700 1 -- 172.21.15.72:0/2847772932 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c004340 con 0x7f0d280a0a30 2023-10-03T10:17:06.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.745+0000 7f0d2ca0e700 1 -- 172.21.15.72:0/2847772932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2813ae60 con 0x7f0d280a0a30 2023-10-03T10:17:06.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.745+0000 7f0d16ffd700 1 -- 172.21.15.72:0/2847772932 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c01f070 con 0x7f0d280a0a30 2023-10-03T10:17:06.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.745+0000 7f0d16ffd700 1 -- 172.21.15.72:0/2847772932 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c0036a0 con 0x7f0d280a0a30 2023-10-03T10:17:06.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.745+0000 7f0d2ca0e700 1 -- 172.21.15.72:0/2847772932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d28137a10 con 0x7f0d280a0a30 2023-10-03T10:17:06.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.745+0000 7f0d16ffd700 1 -- 172.21.15.72:0/2847772932 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d1c021030 con 0x7f0d280a0a30 2023-10-03T10:17:06.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.745+0000 7f0d16ffd700 1 -- 172.21.15.72:0/2847772932 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0d1c0408e0 con 0x7f0d280a0a30 2023-10-03T10:17:06.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.746+0000 7f0d2ca0e700 1 -- 172.21.15.72:0/2847772932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d280747f0 con 0x7f0d280a0a30 2023-10-03T10:17:06.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.751+0000 7f0d16ffd700 1 -- 172.21.15.72:0/2847772932 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d1c010970 con 0x7f0d280a0a30 2023-10-03T10:17:06.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.798+0000 7fbdab486700 1 -- 172.21.15.72:0/39626308 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbda41260f0 con 0x7fbda409e000 2023-10-03T10:17:06.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.798+0000 7fbd99ffb700 1 -- 172.21.15.72:0/39626308 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbda41260f0 con 0x7fbda409e000 2023-10-03T10:17:06.799 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:06.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.800+0000 7fbdab486700 1 -- 172.21.15.72:0/39626308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbda409e000 msgr2=0x7fbda41234a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.800+0000 7fbdab486700 1 --2- 172.21.15.72:0/39626308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbda409e000 0x7fbda41234a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbd94009fd0 tx=0x7fbd94004750 comp rx=0 tx=0).stop 2023-10-03T10:17:06.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.801+0000 7fbdab486700 1 -- 172.21.15.72:0/39626308 shutdown_connections 2023-10-03T10:17:06.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.801+0000 7fbdab486700 1 --2- 172.21.15.72:0/39626308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbda409e410 0x7fbda41c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.801+0000 7fbdab486700 1 --2- 172.21.15.72:0/39626308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbda409d6f0 0x7fbda4122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.801+0000 7fbdab486700 1 --2- 172.21.15.72:0/39626308 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbda409e000 0x7fbda41234a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.801+0000 7fbdab486700 1 -- 172.21.15.72:0/39626308 >> 172.21.15.72:0/39626308 conn(0x7fbda4066f50 msgr2=0x7fbda406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.801+0000 7fbdab486700 1 -- 172.21.15.72:0/39626308 shutdown_connections 2023-10-03T10:17:06.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.801+0000 7fbdab486700 1 -- 172.21.15.72:0/39626308 wait complete. 2023-10-03T10:17:06.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:06.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:06.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.935+0000 7f3eb9579700 1 -- 172.21.15.72:0/255982232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3eb4074ea0 con 0x7f3eb4134260 2023-10-03T10:17:06.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.935+0000 7f3e9b7fe700 1 -- 172.21.15.72:0/255982232 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3eac02b090 con 0x7f3eb4134260 2023-10-03T10:17:06.936 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:06.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.937+0000 7f3eb9579700 1 -- 172.21.15.72:0/255982232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb4134260 msgr2=0x7f3eb409cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.937+0000 7f3eb9579700 1 --2- 172.21.15.72:0/255982232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb4134260 0x7f3eb409cf00 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00ef90 tx=0x7f3eac00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.937+0000 7f3eb9579700 1 -- 172.21.15.72:0/255982232 shutdown_connections 2023-10-03T10:17:06.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.937+0000 7f3eb9579700 1 --2- 172.21.15.72:0/255982232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb4134260 0x7f3eb409cf00 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.937+0000 7f3eb9579700 1 --2- 172.21.15.72:0/255982232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb4133420 0x7f3eb409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.937+0000 7f3eb9579700 1 --2- 172.21.15.72:0/255982232 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb4133e30 0x7f3eb409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.937+0000 7f3eb9579700 1 -- 172.21.15.72:0/255982232 >> 172.21.15.72:0/255982232 conn(0x7f3eb40a4210 msgr2=0x7f3eb40a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.937+0000 7f3eb9579700 1 -- 172.21.15.72:0/255982232 shutdown_connections 2023-10-03T10:17:06.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.937+0000 7f3eb9579700 1 -- 172.21.15.72:0/255982232 wait complete. 2023-10-03T10:17:06.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:06.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.969+0000 7f0d2ca0e700 1 -- 172.21.15.72:0/2847772932 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0d28072980 con 0x7f0d280a0a30 2023-10-03T10:17:06.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.969+0000 7f0d16ffd700 1 -- 172.21.15.72:0/2847772932 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0d1c0193b0 con 0x7f0d280a0a30 2023-10-03T10:17:06.970 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.971+0000 7f0d2ca0e700 1 -- 172.21.15.72:0/2847772932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d280a0a30 msgr2=0x7f0d28133ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.971+0000 7f0d2ca0e700 1 --2- 172.21.15.72:0/2847772932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d280a0a30 0x7f0d28133ca0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c016000 tx=0x7f0d1c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:06.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.971+0000 7f0d2ca0e700 1 -- 172.21.15.72:0/2847772932 shutdown_connections 2023-10-03T10:17:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.971+0000 7f0d2ca0e700 1 --2- 172.21.15.72:0/2847772932 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d28138d80 0x7f0d281341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.971+0000 7f0d2ca0e700 1 --2- 172.21.15.72:0/2847772932 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0d2809d630 0x7f0d28133760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.971+0000 7f0d2ca0e700 1 --2- 172.21.15.72:0/2847772932 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d280a0a30 0x7f0d28133ca0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.971+0000 7f0d2ca0e700 1 -- 172.21.15.72:0/2847772932 >> 172.21.15.72:0/2847772932 conn(0x7f0d280a3050 msgr2=0x7f0d2809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.971+0000 7f0d2ca0e700 1 -- 172.21.15.72:0/2847772932 shutdown_connections 2023-10-03T10:17:06.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.971+0000 7f0d2ca0e700 1 -- 172.21.15.72:0/2847772932 wait complete. 2023-10-03T10:17:06.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.979+0000 7ff8471d5700 1 Processor -- start 2023-10-03T10:17:06.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.979+0000 7ff8471d5700 1 -- start start 2023-10-03T10:17:06.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.979+0000 7ff8471d5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff84009d6f0 0x7ff84009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.979+0000 7ff8471d5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84009e000 0x7ff8401339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.979+0000 7ff8471d5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84009b120 con 0x7ff84009e410 2023-10-03T10:17:06.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.979+0000 7ff8471d5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84006b460 con 0x7ff84009e000 2023-10-03T10:17:06.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.979+0000 7ff8471d5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff84009a7e0 con 0x7ff84009d6f0 2023-10-03T10:17:06.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.979+0000 7ff844f71700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff84009d6f0 0x7ff84009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.980+0000 7ff844f71700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff84009d6f0 0x7ff84009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39934/0 (socket says 172.21.15.72:39934) 2023-10-03T10:17:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.980+0000 7ff844f71700 1 -- 172.21.15.72:0/113254362 learned_addr learned my addr 172.21.15.72:0/113254362 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.980+0000 7ff845772700 1 --1- 172.21.15.72:0/113254362 >> v1:172.21.15.72:6789/0 conn(0x7ff84009e410 0x7ff840133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:56850/0 (socket says 172.21.15.72:56850) 2023-10-03T10:17:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.980+0000 7ff83ffff700 1 --2- 172.21.15.72:0/113254362 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84009e000 0x7ff8401339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.980+0000 7ff83ffff700 1 -- 172.21.15.72:0/113254362 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff84009d6f0 msgr2=0x7ff84009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.980+0000 7ff83ffff700 1 --2- 172.21.15.72:0/113254362 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff84009d6f0 0x7ff84009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.980+0000 7ff83f7fe700 1 -- 172.21.15.72:0/113254362 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603611568 0 0) 0x7ff84009b120 con 0x7ff84009e410 2023-10-03T10:17:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.980+0000 7ff83ffff700 1 -- 172.21.15.72:0/113254362 >> v1:172.21.15.72:6789/0 conn(0x7ff84009e410 legacy=0x7ff840133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.980+0000 7ff83ffff700 1 -- 172.21.15.72:0/113254362 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84009a500 con 0x7ff84009e000 2023-10-03T10:17:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.980+0000 7ff844f71700 1 --2- 172.21.15.72:0/113254362 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff84009d6f0 0x7ff84009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.980+0000 7ff83ffff700 1 --2- 172.21.15.72:0/113254362 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84009e000 0x7ff8401339f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009870 tx=0x7ff82c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e1720a3286597f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.980+0000 7ff83f7fe700 1 -- 172.21.15.72:0/113254362 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c011830 con 0x7ff84009e000 2023-10-03T10:17:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.980+0000 7ff83f7fe700 1 -- 172.21.15.72:0/113254362 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c011990 con 0x7ff84009e000 2023-10-03T10:17:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.980+0000 7ff83f7fe700 1 -- 172.21.15.72:0/113254362 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c011d20 con 0x7ff84009e000 2023-10-03T10:17:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.981+0000 7ff8471d5700 1 -- 172.21.15.72:0/113254362 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84009e000 msgr2=0x7ff8401339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.981+0000 7ff8471d5700 1 --2- 172.21.15.72:0/113254362 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84009e000 0x7ff8401339f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009870 tx=0x7ff82c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.981+0000 7ff8471d5700 1 -- 172.21.15.72:0/113254362 shutdown_connections 2023-10-03T10:17:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.981+0000 7ff8471d5700 1 --2- 172.21.15.72:0/113254362 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff84009d6f0 0x7ff84009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.981+0000 7ff8471d5700 1 --2- 172.21.15.72:0/113254362 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84009e000 0x7ff8401339f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.981+0000 7ff8471d5700 1 -- 172.21.15.72:0/113254362 >> 172.21.15.72:0/113254362 conn(0x7ff840066f50 msgr2=0x7ff84009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.981+0000 7ff8471d5700 1 -- 172.21.15.72:0/113254362 shutdown_connections 2023-10-03T10:17:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.981+0000 7ff8471d5700 1 -- 172.21.15.72:0/113254362 wait complete. 2023-10-03T10:17:06.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.982+0000 7ff8471d5700 1 Processor -- start 2023-10-03T10:17:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.982+0000 7ff8471d5700 1 -- start start 2023-10-03T10:17:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff8471d5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84009d6f0 0x7ff8401a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff8471d5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84009e000 0x7ff8401a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff8471d5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff84009e410 0x7ff8401a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff8471d5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8401a9780 con 0x7ff84009e000 2023-10-03T10:17:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff8471d5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8401a7ab0 con 0x7ff84009d6f0 2023-10-03T10:17:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff8471d5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8401a8d00 con 0x7ff84009e410 2023-10-03T10:17:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff844f71700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84009d6f0 0x7ff8401a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff844f71700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84009d6f0 0x7ff8401a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59592/0 (socket says 172.21.15.72:59592) 2023-10-03T10:17:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff844f71700 1 -- 172.21.15.72:0/2529289670 learned_addr learned my addr 172.21.15.72:0/2529289670 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:06.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff845772700 1 --2- 172.21.15.72:0/2529289670 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff84009e410 0x7ff8401a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff83ffff700 1 --2- 172.21.15.72:0/2529289670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84009e000 0x7ff8401a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff844f71700 1 -- 172.21.15.72:0/2529289670 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff84009e410 msgr2=0x7ff8401a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff844f71700 1 --2- 172.21.15.72:0/2529289670 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff84009e410 0x7ff8401a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff844f71700 1 -- 172.21.15.72:0/2529289670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84009e000 msgr2=0x7ff8401a63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff844f71700 1 --2- 172.21.15.72:0/2529289670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84009e000 0x7ff8401a63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff844f71700 1 -- 172.21.15.72:0/2529289670 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff834009550 con 0x7ff84009d6f0 2023-10-03T10:17:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.983+0000 7ff845772700 1 --2- 172.21.15.72:0/2529289670 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff84009e410 0x7ff8401a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.984+0000 7ff844f71700 1 --2- 172.21.15.72:0/2529289670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84009d6f0 0x7ff8401a5ea0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff83400ec40 tx=0x7ff83400ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.984+0000 7ff83d7fa700 1 -- 172.21.15.72:0/2529289670 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83400c850 con 0x7ff84009d6f0 2023-10-03T10:17:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.984+0000 7ff83d7fa700 1 -- 172.21.15.72:0/2529289670 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83400c9b0 con 0x7ff84009d6f0 2023-10-03T10:17:06.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.984+0000 7ff8471d5700 1 -- 172.21.15.72:0/2529289670 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c0094a0 con 0x7ff84009d6f0 2023-10-03T10:17:06.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.984+0000 7ff83d7fa700 1 -- 172.21.15.72:0/2529289670 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83400cd20 con 0x7ff84009d6f0 2023-10-03T10:17:06.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:06.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.984+0000 7ff8471d5700 1 -- 172.21.15.72:0/2529289670 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8400a2eb0 con 0x7ff84009d6f0 2023-10-03T10:17:06.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.984+0000 7ff83d7fa700 1 -- 172.21.15.72:0/2529289670 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff834013470 con 0x7ff84009d6f0 2023-10-03T10:17:06.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.985+0000 7ff83d7fa700 1 -- 172.21.15.72:0/2529289670 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff83403fae0 con 0x7ff84009d6f0 2023-10-03T10:17:06.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.985+0000 7ff8471d5700 1 -- 172.21.15.72:0/2529289670 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84009c710 con 0x7ff84009d6f0 2023-10-03T10:17:06.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:06.990+0000 7ff83d7fa700 1 -- 172.21.15.72:0/2529289670 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff834013720 con 0x7ff84009d6f0 2023-10-03T10:17:07.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.172+0000 7ff8471d5700 1 -- 172.21.15.72:0/2529289670 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff840074ea0 con 0x7ff84009d6f0 2023-10-03T10:17:07.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.172+0000 7ff83d7fa700 1 -- 172.21.15.72:0/2529289670 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff834021020 con 0x7ff84009d6f0 2023-10-03T10:17:07.173 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.174+0000 7ff8471d5700 1 -- 172.21.15.72:0/2529289670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84009d6f0 msgr2=0x7ff8401a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.174+0000 7ff8471d5700 1 --2- 172.21.15.72:0/2529289670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84009d6f0 0x7ff8401a5ea0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff83400ec40 tx=0x7ff83400ef50 comp rx=0 tx=0).stop 2023-10-03T10:17:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.174+0000 7ff8471d5700 1 -- 172.21.15.72:0/2529289670 shutdown_connections 2023-10-03T10:17:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.174+0000 7ff8471d5700 1 --2- 172.21.15.72:0/2529289670 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff84009e410 0x7ff8401a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.174+0000 7ff8471d5700 1 --2- 172.21.15.72:0/2529289670 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84009d6f0 0x7ff8401a5ea0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.174+0000 7ff8471d5700 1 --2- 172.21.15.72:0/2529289670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84009e000 0x7ff8401a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.174+0000 7ff8471d5700 1 -- 172.21.15.72:0/2529289670 >> 172.21.15.72:0/2529289670 conn(0x7ff840066f50 msgr2=0x7ff8401bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.174+0000 7ff8471d5700 1 -- 172.21.15.72:0/2529289670 shutdown_connections 2023-10-03T10:17:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.174+0000 7ff8471d5700 1 -- 172.21.15.72:0/2529289670 wait complete. 2023-10-03T10:17:07.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:07.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:07.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.940+0000 7f0cb11e4700 1 Processor -- start 2023-10-03T10:17:07.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.940+0000 7f0cb11e4700 1 -- start start 2023-10-03T10:17:07.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.940+0000 7f0cb11e4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0cac06a770 0x7f0cac06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.940+0000 7f0cb11e4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0cac06b080 0x7f0cac131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.940+0000 7f0cb11e4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cac09ece0 con 0x7f0cac131b40 2023-10-03T10:17:07.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.940+0000 7f0cb11e4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cac09e760 con 0x7f0cac06b080 2023-10-03T10:17:07.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.940+0000 7f0cb11e4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac09e040 con 0x7f0cac06a770 2023-10-03T10:17:07.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.940+0000 7f0caa59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0cac06b080 0x7f0cac131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.940+0000 7f0caad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0cac06a770 0x7f0cac06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.940+0000 7f0caa59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0cac06b080 0x7f0cac131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41086/0 (socket says 172.21.15.72:41086) 2023-10-03T10:17:07.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.940+0000 7f0caad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0cac06a770 0x7f0cac06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39950/0 (socket says 172.21.15.72:39950) 2023-10-03T10:17:07.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.940+0000 7f0caa59c700 1 -- 172.21.15.72:0/3473417716 learned_addr learned my addr 172.21.15.72:0/3473417716 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:07.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.940+0000 7f0caa59c700 1 -- 172.21.15.72:0/3473417716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0cac06a770 msgr2=0x7f0cac06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:07.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.940+0000 7f0caa59c700 1 --2- 172.21.15.72:0/3473417716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0cac06a770 0x7f0cac06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.941+0000 7f0caa59c700 1 -- 172.21.15.72:0/3473417716 >> v1:172.21.15.72:6789/0 conn(0x7f0cac131b40 legacy=0x7f0cac138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.941+0000 7f0caa59c700 1 -- 172.21.15.72:0/3473417716 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cac09f630 con 0x7f0cac06b080 2023-10-03T10:17:07.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.941+0000 7f0ca9d9b700 1 -- 172.21.15.72:0/3473417716 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436851622 0 0) 0x7f0cac09ece0 con 0x7f0cac131b40 2023-10-03T10:17:07.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.941+0000 7f0caa59c700 1 --2- 172.21.15.72:0/3473417716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cac06b080 0x7f0cac131600 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00098f0 tx=0x7f0ca0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498feb6be913a346 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.941+0000 7f0ca9d9b700 1 -- 172.21.15.72:0/3473417716 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0011830 con 0x7f0cac06b080 2023-10-03T10:17:07.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.941+0000 7f0ca9d9b700 1 -- 172.21.15.72:0/3473417716 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca0011990 con 0x7f0cac06b080 2023-10-03T10:17:07.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.941+0000 7f0ca9d9b700 1 -- 172.21.15.72:0/3473417716 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0011d20 con 0x7f0cac06b080 2023-10-03T10:17:07.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.941+0000 7f0cb11e4700 1 -- 172.21.15.72:0/3473417716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cac06b080 msgr2=0x7f0cac131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.941+0000 7f0cb11e4700 1 --2- 172.21.15.72:0/3473417716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cac06b080 0x7f0cac131600 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00098f0 tx=0x7f0ca0009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:07.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.941+0000 7f0cb11e4700 1 -- 172.21.15.72:0/3473417716 shutdown_connections 2023-10-03T10:17:07.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.941+0000 7f0cb11e4700 1 --2- 172.21.15.72:0/3473417716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0cac06a770 0x7f0cac06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.941+0000 7f0cb11e4700 1 --2- 172.21.15.72:0/3473417716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cac06b080 0x7f0cac131600 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.941+0000 7f0cb11e4700 1 -- 172.21.15.72:0/3473417716 >> 172.21.15.72:0/3473417716 conn(0x7f0cac066f50 msgr2=0x7f0cac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.941+0000 7f0cb11e4700 1 -- 172.21.15.72:0/3473417716 shutdown_connections 2023-10-03T10:17:07.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.941+0000 7f0cb11e4700 1 -- 172.21.15.72:0/3473417716 wait complete. 2023-10-03T10:17:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0cb11e4700 1 Processor -- start 2023-10-03T10:17:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0cb11e4700 1 -- start start 2023-10-03T10:17:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0cb11e4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cac06a770 0x7f0cac09ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0cb11e4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0cac06b080 0x7f0cac09b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0cb11e4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0cac131b40 0x7f0cac1c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0cb11e4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac1312c0 con 0x7f0cac06a770 2023-10-03T10:17:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0cb11e4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac06ed00 con 0x7f0cac06b080 2023-10-03T10:17:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0cb11e4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac071e60 con 0x7f0cac131b40 2023-10-03T10:17:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0cab59e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0cac131b40 0x7f0cac1c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0caad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cac06a770 0x7f0cac09ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0caa59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0cac06b080 0x7f0cac09b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0caad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cac06a770 0x7f0cac09ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41096/0 (socket says 172.21.15.72:41096) 2023-10-03T10:17:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0caad9d700 1 -- 172.21.15.72:0/272470941 learned_addr learned my addr 172.21.15.72:0/272470941 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0cab59e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0cac131b40 0x7f0cac1c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39956/0 (socket says 172.21.15.72:39956) 2023-10-03T10:17:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0caa59c700 1 -- 172.21.15.72:0/272470941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0cac131b40 msgr2=0x7f0cac1c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0caa59c700 1 --2- 172.21.15.72:0/272470941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0cac131b40 0x7f0cac1c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0caa59c700 1 -- 172.21.15.72:0/272470941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cac06a770 msgr2=0x7f0cac09ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0caa59c700 1 --2- 172.21.15.72:0/272470941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cac06a770 0x7f0cac09ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0caa59c700 1 -- 172.21.15.72:0/272470941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0009550 con 0x7f0cac06b080 2023-10-03T10:17:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0cab59e700 1 --2- 172.21.15.72:0/272470941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0cac131b40 0x7f0cac1c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.943+0000 7f0caad9d700 1 --2- 172.21.15.72:0/272470941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cac06a770 0x7f0cac09ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.944+0000 7f0caa59c700 1 --2- 172.21.15.72:0/272470941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0cac06b080 0x7f0cac09b3b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0016000 tx=0x7f0ca0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.944+0000 7f0c937fe700 1 -- 172.21.15.72:0/272470941 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0004550 con 0x7f0cac06b080 2023-10-03T10:17:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.944+0000 7f0c937fe700 1 -- 172.21.15.72:0/272470941 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca001f070 con 0x7f0cac06b080 2023-10-03T10:17:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.944+0000 7f0cb11e4700 1 -- 172.21.15.72:0/272470941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cac09aa20 con 0x7f0cac06b080 2023-10-03T10:17:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.944+0000 7f0c937fe700 1 -- 172.21.15.72:0/272470941 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca00038e0 con 0x7f0cac06b080 2023-10-03T10:17:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.944+0000 7f0cb11e4700 1 -- 172.21.15.72:0/272470941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cac126980 con 0x7f0cac06b080 2023-10-03T10:17:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.945+0000 7f0c937fe700 1 -- 172.21.15.72:0/272470941 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ca0003a40 con 0x7f0cac06b080 2023-10-03T10:17:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.945+0000 7f0cb11e4700 1 -- 172.21.15.72:0/272470941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cac074ea0 con 0x7f0cac06b080 2023-10-03T10:17:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.945+0000 7f0c937fe700 1 -- 172.21.15.72:0/272470941 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0ca0021070 con 0x7f0cac06b080 2023-10-03T10:17:07.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:07.949+0000 7f0c937fe700 1 -- 172.21.15.72:0/272470941 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ca0010380 con 0x7f0cac06b080 2023-10-03T10:17:07.951 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:07.993 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:08.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.075+0000 7f215c411700 1 Processor -- start 2023-10-03T10:17:08.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.075+0000 7f215c411700 1 -- start start 2023-10-03T10:17:08.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.076+0000 7f215c411700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f215406a770 0x7f215406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.076+0000 7f215c411700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f215406b080 0x7f2154131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.076+0000 7f215c411700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2154131b40 0x7f2154131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.076+0000 7f215c411700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215409ece0 con 0x7f215406a770 2023-10-03T10:17:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.076+0000 7f215c411700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215409e760 con 0x7f2154131b40 2023-10-03T10:17:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.076+0000 7f215c411700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f215409e040 con 0x7f215406b080 2023-10-03T10:17:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.076+0000 7f21599ac700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f215406b080 0x7f2154131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.076+0000 7f215a1ad700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f215406a770 0x7f215406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.076+0000 7f21599ac700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f215406b080 0x7f2154131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39968/0 (socket says 172.21.15.72:39968) 2023-10-03T10:17:08.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.076+0000 7f21599ac700 1 -- 172.21.15.72:0/550487356 learned_addr learned my addr 172.21.15.72:0/550487356 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.076+0000 7f215a9ae700 1 --2- 172.21.15.72:0/550487356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2154131b40 0x7f2154131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.076+0000 7f215a9ae700 1 -- 172.21.15.72:0/550487356 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f215406b080 msgr2=0x7f2154131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.076+0000 7f215a9ae700 1 --2- 172.21.15.72:0/550487356 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f215406b080 0x7f2154131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.077+0000 7f215a9ae700 1 -- 172.21.15.72:0/550487356 >> v2:172.21.15.72:3300/0 conn(0x7f215406a770 msgr2=0x7f215406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.077+0000 7f215a9ae700 1 --2- 172.21.15.72:0/550487356 >> v2:172.21.15.72:3300/0 conn(0x7f215406a770 0x7f215406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.077+0000 7f215a9ae700 1 -- 172.21.15.72:0/550487356 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215409f630 con 0x7f2154131b40 2023-10-03T10:17:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.077+0000 7f21599ac700 1 --2- 172.21.15.72:0/550487356 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f215406b080 0x7f2154131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.077+0000 7f215a9ae700 1 --2- 172.21.15.72:0/550487356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2154131b40 0x7f2154131fa0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f214c009d90 tx=0x7f214c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e41804b83978213 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.077+0000 7f21591ab700 1 -- 172.21.15.72:0/550487356 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c00e070 con 0x7f2154131b40 2023-10-03T10:17:08.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.077+0000 7f21591ab700 1 -- 172.21.15.72:0/550487356 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c00bb20 con 0x7f2154131b40 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.077+0000 7f21591ab700 1 -- 172.21.15.72:0/550487356 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c012430 con 0x7f2154131b40 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.077+0000 7f215c411700 1 -- 172.21.15.72:0/550487356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2154131b40 msgr2=0x7f2154131fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.077+0000 7f215c411700 1 --2- 172.21.15.72:0/550487356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2154131b40 0x7f2154131fa0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f214c009d90 tx=0x7f214c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.078+0000 7f215c411700 1 -- 172.21.15.72:0/550487356 shutdown_connections 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.078+0000 7f215c411700 1 --2- 172.21.15.72:0/550487356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2154131b40 0x7f2154131fa0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.078+0000 7f215c411700 1 --2- 172.21.15.72:0/550487356 >> v2:172.21.15.72:3300/0 conn(0x7f215406a770 0x7f215406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.078+0000 7f215c411700 1 --2- 172.21.15.72:0/550487356 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f215406b080 0x7f2154131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.078+0000 7f215c411700 1 -- 172.21.15.72:0/550487356 >> 172.21.15.72:0/550487356 conn(0x7f2154066f50 msgr2=0x7f215409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.078+0000 7f215c411700 1 -- 172.21.15.72:0/550487356 shutdown_connections 2023-10-03T10:17:08.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.078+0000 7f215c411700 1 -- 172.21.15.72:0/550487356 wait complete. 2023-10-03T10:17:08.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.078+0000 7f215c411700 1 Processor -- start 2023-10-03T10:17:08.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215c411700 1 -- start start 2023-10-03T10:17:08.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215c411700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f215406a770 0x7f215409af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215c411700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f215406b080 0x7f215409b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215c411700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154131b40 0x7f21541c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215c411700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2154121ec0 con 0x7f2154131b40 2023-10-03T10:17:08.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215c411700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2154130ff0 con 0x7f215406b080 2023-10-03T10:17:08.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215c411700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2154120f70 con 0x7f215406a770 2023-10-03T10:17:08.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215a1ad700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f215406a770 0x7f215409af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215a9ae700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154131b40 0x7f21541c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215a1ad700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f215406a770 0x7f215409af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39978/0 (socket says 172.21.15.72:39978) 2023-10-03T10:17:08.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215a1ad700 1 -- 172.21.15.72:0/368943652 learned_addr learned my addr 172.21.15.72:0/368943652 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:08.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f21599ac700 1 --2- 172.21.15.72:0/368943652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f215406b080 0x7f215409b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215a1ad700 1 -- 172.21.15.72:0/368943652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f215406b080 msgr2=0x7f215409b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215a1ad700 1 --2- 172.21.15.72:0/368943652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f215406b080 0x7f215409b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215a1ad700 1 -- 172.21.15.72:0/368943652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154131b40 msgr2=0x7f21541c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215a1ad700 1 --2- 172.21.15.72:0/368943652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154131b40 0x7f21541c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215a1ad700 1 -- 172.21.15.72:0/368943652 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2144009550 con 0x7f215406a770 2023-10-03T10:17:08.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f215a9ae700 1 --2- 172.21.15.72:0/368943652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154131b40 0x7f21541c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.079+0000 7f21599ac700 1 --2- 172.21.15.72:0/368943652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f215406b080 0x7f215409b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.080+0000 7f215a1ad700 1 --2- 172.21.15.72:0/368943652 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f215406a770 0x7f215409af00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f215000e9e0 tx=0x7f215000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.080+0000 7f214affd700 1 -- 172.21.15.72:0/368943652 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2150009710 con 0x7f215406a770 2023-10-03T10:17:08.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.080+0000 7f214affd700 1 -- 172.21.15.72:0/368943652 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215000ee80 con 0x7f215406a770 2023-10-03T10:17:08.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.080+0000 7f215c411700 1 -- 172.21.15.72:0/368943652 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c009a70 con 0x7f215406a770 2023-10-03T10:17:08.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.080+0000 7f214affd700 1 -- 172.21.15.72:0/368943652 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215000ca50 con 0x7f215406a770 2023-10-03T10:17:08.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.080+0000 7f215c411700 1 -- 172.21.15.72:0/368943652 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215409a9b0 con 0x7f215406a770 2023-10-03T10:17:08.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.081+0000 7f215c411700 1 -- 172.21.15.72:0/368943652 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21541229f0 con 0x7f215406a770 2023-10-03T10:17:08.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.081+0000 7f214affd700 1 -- 172.21.15.72:0/368943652 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f215000cbb0 con 0x7f215406a770 2023-10-03T10:17:08.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.081+0000 7f214affd700 1 -- 172.21.15.72:0/368943652 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f215003f710 con 0x7f215406a770 2023-10-03T10:17:08.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.086+0000 7f214affd700 1 -- 172.21.15.72:0/368943652 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21500232f0 con 0x7f215406a770 2023-10-03T10:17:08.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.118+0000 7f2afe442700 1 Processor -- start 2023-10-03T10:17:08.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.118+0000 7f2afe442700 1 -- start start 2023-10-03T10:17:08.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2afe442700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2af80a0a30 0x7f2af80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2afe442700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2af809d630 0x7f2af80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2afe442700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2af8133930 0x7f2af8133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2afe442700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af80a2a70 con 0x7f2af80a0a30 2023-10-03T10:17:08.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2afe442700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af80a01d0 con 0x7f2af8133930 2023-10-03T10:17:08.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2afe442700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2af809e2b0 con 0x7f2af809d630 2023-10-03T10:17:08.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2af77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2af809d630 0x7f2af80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2af7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2af80a0a30 0x7f2af80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2af77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2af809d630 0x7f2af80a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:39980/0 (socket says 172.21.15.72:39980) 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2af7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2af80a0a30 0x7f2af80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41124/0 (socket says 172.21.15.72:41124) 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2af77fe700 1 -- 172.21.15.72:0/3989852115 learned_addr learned my addr 172.21.15.72:0/3989852115 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2afc9df700 1 --2- 172.21.15.72:0/3989852115 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2af8133930 0x7f2af8133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2afc9df700 1 -- 172.21.15.72:0/3989852115 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2af809d630 msgr2=0x7f2af80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2afc9df700 1 --2- 172.21.15.72:0/3989852115 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2af809d630 0x7f2af80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2afc9df700 1 -- 172.21.15.72:0/3989852115 >> v2:172.21.15.72:3300/0 conn(0x7f2af80a0a30 msgr2=0x7f2af80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2afc9df700 1 --2- 172.21.15.72:0/3989852115 >> v2:172.21.15.72:3300/0 conn(0x7f2af80a0a30 0x7f2af80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2afc9df700 1 -- 172.21.15.72:0/3989852115 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af809dc50 con 0x7f2af8133930 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.119+0000 7f2afc9df700 1 --2- 172.21.15.72:0/3989852115 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2af8133930 0x7f2af8133db0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009d90 tx=0x7f2af000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c11efc54ae1be09 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.120+0000 7f2af6ffd700 1 -- 172.21.15.72:0/3989852115 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af000e070 con 0x7f2af8133930 2023-10-03T10:17:08.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.120+0000 7f2af6ffd700 1 -- 172.21.15.72:0/3989852115 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af000bb20 con 0x7f2af8133930 2023-10-03T10:17:08.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.120+0000 7f2af6ffd700 1 -- 172.21.15.72:0/3989852115 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0012430 con 0x7f2af8133930 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.120+0000 7f2afe442700 1 -- 172.21.15.72:0/3989852115 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2af8133930 msgr2=0x7f2af8133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.120+0000 7f2afe442700 1 --2- 172.21.15.72:0/3989852115 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2af8133930 0x7f2af8133db0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009d90 tx=0x7f2af000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.121+0000 7f2afe442700 1 -- 172.21.15.72:0/3989852115 shutdown_connections 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.121+0000 7f2afe442700 1 --2- 172.21.15.72:0/3989852115 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2af8133930 0x7f2af8133db0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.121+0000 7f2afe442700 1 --2- 172.21.15.72:0/3989852115 >> v2:172.21.15.72:3300/0 conn(0x7f2af80a0a30 0x7f2af80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.121+0000 7f2afe442700 1 --2- 172.21.15.72:0/3989852115 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2af809d630 0x7f2af80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.121+0000 7f2afe442700 1 -- 172.21.15.72:0/3989852115 >> 172.21.15.72:0/3989852115 conn(0x7f2af80a3050 msgr2=0x7f2af80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.121+0000 7f2afe442700 1 -- 172.21.15.72:0/3989852115 shutdown_connections 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.121+0000 7f2afe442700 1 -- 172.21.15.72:0/3989852115 wait complete. 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.122+0000 7f2afe442700 1 Processor -- start 2023-10-03T10:17:08.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.122+0000 7f2afe442700 1 -- start start 2023-10-03T10:17:08.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2afe442700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2af809d630 0x7f2af8121340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2afe442700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2af80a0a30 0x7f2af8121880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2afe442700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2af8133930 0x7f2af8121dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2afe442700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8124960 con 0x7f2af80a0a30 2023-10-03T10:17:08.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2afe442700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af80a4030 con 0x7f2af8133930 2023-10-03T10:17:08.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2afe442700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8122cd0 con 0x7f2af809d630 2023-10-03T10:17:08.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2af77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2af80a0a30 0x7f2af8121880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2af77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2af80a0a30 0x7f2af8121880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41136/0 (socket says 172.21.15.72:41136) 2023-10-03T10:17:08.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2af77fe700 1 -- 172.21.15.72:0/1761510371 learned_addr learned my addr 172.21.15.72:0/1761510371 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:08.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2af7fff700 1 --2- 172.21.15.72:0/1761510371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2af809d630 0x7f2af8121340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2afc9df700 1 --2- 172.21.15.72:0/1761510371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2af8133930 0x7f2af8121dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2af77fe700 1 -- 172.21.15.72:0/1761510371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2af809d630 msgr2=0x7f2af8121340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2af77fe700 1 --2- 172.21.15.72:0/1761510371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2af809d630 0x7f2af8121340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2af77fe700 1 -- 172.21.15.72:0/1761510371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2af8133930 msgr2=0x7f2af8121dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2af77fe700 1 --2- 172.21.15.72:0/1761510371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2af8133930 0x7f2af8121dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.123+0000 7f2af77fe700 1 -- 172.21.15.72:0/1761510371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af0009a70 con 0x7f2af80a0a30 2023-10-03T10:17:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.124+0000 7f2af77fe700 1 --2- 172.21.15.72:0/1761510371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2af80a0a30 0x7f2af8121880 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00e910 tx=0x7f2aec00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.124+0000 7f2af4ff9700 1 -- 172.21.15.72:0/1761510371 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec0096a0 con 0x7f2af80a0a30 2023-10-03T10:17:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.124+0000 7f2afe442700 1 -- 172.21.15.72:0/1761510371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af8124bb0 con 0x7f2af80a0a30 2023-10-03T10:17:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.124+0000 7f2af4ff9700 1 -- 172.21.15.72:0/1761510371 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec013680 con 0x7f2af80a0a30 2023-10-03T10:17:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.124+0000 7f2af4ff9700 1 -- 172.21.15.72:0/1761510371 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec013a30 con 0x7f2af80a0a30 2023-10-03T10:17:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.124+0000 7f2afe442700 1 -- 172.21.15.72:0/1761510371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af8132800 con 0x7f2af80a0a30 2023-10-03T10:17:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.125+0000 7f2af4ff9700 1 -- 172.21.15.72:0/1761510371 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2aec013b90 con 0x7f2af80a0a30 2023-10-03T10:17:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.125+0000 7f2af4ff9700 1 -- 172.21.15.72:0/1761510371 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2aec03fa10 con 0x7f2af80a0a30 2023-10-03T10:17:08.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.125+0000 7f2afe442700 1 -- 172.21.15.72:0/1761510371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af811df60 con 0x7f2af80a0a30 2023-10-03T10:17:08.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.129+0000 7f2af4ff9700 1 -- 172.21.15.72:0/1761510371 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2aec021080 con 0x7f2af80a0a30 2023-10-03T10:17:08.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.150+0000 7f0cb11e4700 1 -- 172.21.15.72:0/272470941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0cac06c360 con 0x7f0cac06b080 2023-10-03T10:17:08.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.150+0000 7f0c937fe700 1 -- 172.21.15.72:0/272470941 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ca0015030 con 0x7f0cac06b080 2023-10-03T10:17:08.151 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:08.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.153+0000 7f0cb11e4700 1 -- 172.21.15.72:0/272470941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0cac06b080 msgr2=0x7f0cac09b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.153+0000 7f0cb11e4700 1 --2- 172.21.15.72:0/272470941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0cac06b080 0x7f0cac09b3b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0016000 tx=0x7f0ca0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:08.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.153+0000 7f0cb11e4700 1 -- 172.21.15.72:0/272470941 shutdown_connections 2023-10-03T10:17:08.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.153+0000 7f0cb11e4700 1 --2- 172.21.15.72:0/272470941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0cac06a770 0x7f0cac09ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.153+0000 7f0cb11e4700 1 --2- 172.21.15.72:0/272470941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0cac131b40 0x7f0cac1c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.153+0000 7f0cb11e4700 1 --2- 172.21.15.72:0/272470941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0cac06b080 0x7f0cac09b3b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.153+0000 7f0cb11e4700 1 -- 172.21.15.72:0/272470941 >> 172.21.15.72:0/272470941 conn(0x7f0cac066f50 msgr2=0x7f0cac06ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.153+0000 7f0cb11e4700 1 -- 172.21.15.72:0/272470941 shutdown_connections 2023-10-03T10:17:08.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.153+0000 7f0cb11e4700 1 -- 172.21.15.72:0/272470941 wait complete. 2023-10-03T10:17:08.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:08.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:08.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.283+0000 7f215c411700 1 -- 172.21.15.72:0/368943652 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2154074ea0 con 0x7f215406a770 2023-10-03T10:17:08.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.284+0000 7f214affd700 1 -- 172.21.15.72:0/368943652 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f215001ae80 con 0x7f215406a770 2023-10-03T10:17:08.284 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:08.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.286+0000 7f215c411700 1 -- 172.21.15.72:0/368943652 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f215406a770 msgr2=0x7f215409af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.286+0000 7f215c411700 1 --2- 172.21.15.72:0/368943652 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f215406a770 0x7f215409af00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f215000e9e0 tx=0x7f215000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.286+0000 7f215c411700 1 -- 172.21.15.72:0/368943652 shutdown_connections 2023-10-03T10:17:08.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.286+0000 7f215c411700 1 --2- 172.21.15.72:0/368943652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2154131b40 0x7f21541c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.286+0000 7f215c411700 1 --2- 172.21.15.72:0/368943652 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f215406a770 0x7f215409af00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.286+0000 7f215c411700 1 --2- 172.21.15.72:0/368943652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f215406b080 0x7f215409b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.286+0000 7f215c411700 1 -- 172.21.15.72:0/368943652 >> 172.21.15.72:0/368943652 conn(0x7f2154066f50 msgr2=0x7f2154070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.286+0000 7f215c411700 1 -- 172.21.15.72:0/368943652 shutdown_connections 2023-10-03T10:17:08.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.286+0000 7f215c411700 1 -- 172.21.15.72:0/368943652 wait complete. 2023-10-03T10:17:08.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.311+0000 7ff0a4567700 1 Processor -- start 2023-10-03T10:17:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.311+0000 7ff0a4567700 1 -- start start 2023-10-03T10:17:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.311+0000 7ff0a4567700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff09c130540 0x7ff09c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.311+0000 7ff0a4567700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff09c130e50 0x7ff09c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.311+0000 7ff0a4567700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09c06fb20 0x7ff09c06ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.311+0000 7ff0a4567700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09c0704b0 con 0x7ff09c130e50 2023-10-03T10:17:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.311+0000 7ff0a4567700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c09a390 con 0x7ff09c06fb20 2023-10-03T10:17:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.311+0000 7ff0a4567700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0716a0 con 0x7ff09c130540 2023-10-03T10:17:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a2303700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff09c130540 0x7ff09c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a1b02700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff09c130e50 0x7ff09c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a2b04700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09c06fb20 0x7ff09c06ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a1b02700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff09c130e50 0x7ff09c06f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53778/0 (socket says 172.21.15.72:53778) 2023-10-03T10:17:08.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a1b02700 1 -- 172.21.15.72:0/539307653 learned_addr learned my addr 172.21.15.72:0/539307653 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:08.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a1b02700 1 -- 172.21.15.72:0/539307653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff09c130540 msgr2=0x7ff09c130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a1b02700 1 --2- 172.21.15.72:0/539307653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff09c130540 0x7ff09c130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a1b02700 1 -- 172.21.15.72:0/539307653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09c06fb20 msgr2=0x7ff09c06ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a1b02700 1 --2- 172.21.15.72:0/539307653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09c06fb20 0x7ff09c06ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a1b02700 1 -- 172.21.15.72:0/539307653 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c071290 con 0x7ff09c130e50 2023-10-03T10:17:08.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a2b04700 1 --2- 172.21.15.72:0/539307653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09c06fb20 0x7ff09c06ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a2303700 1 --2- 172.21.15.72:0/539307653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff09c130540 0x7ff09c130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a1b02700 1 --2- 172.21.15.72:0/539307653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff09c130e50 0x7ff09c06f5e0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009920 tx=0x7ff08c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9f48a3923a5f3a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a1301700 1 -- 172.21.15.72:0/539307653 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c011830 con 0x7ff09c130e50 2023-10-03T10:17:08.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a1301700 1 -- 172.21.15.72:0/539307653 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c011990 con 0x7ff09c130e50 2023-10-03T10:17:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.312+0000 7ff0a1301700 1 -- 172.21.15.72:0/539307653 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c011d20 con 0x7ff09c130e50 2023-10-03T10:17:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.313+0000 7ff0a4567700 1 -- 172.21.15.72:0/539307653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff09c130e50 msgr2=0x7ff09c06f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.313+0000 7ff0a4567700 1 --2- 172.21.15.72:0/539307653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff09c130e50 0x7ff09c06f5e0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009920 tx=0x7ff08c009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.313+0000 7ff0a4567700 1 -- 172.21.15.72:0/539307653 shutdown_connections 2023-10-03T10:17:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.313+0000 7ff0a4567700 1 --2- 172.21.15.72:0/539307653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09c06fb20 0x7ff09c06ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.313+0000 7ff0a4567700 1 --2- 172.21.15.72:0/539307653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff09c130540 0x7ff09c130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.313+0000 7ff0a4567700 1 --2- 172.21.15.72:0/539307653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff09c130e50 0x7ff09c06f5e0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.313+0000 7ff0a4567700 1 -- 172.21.15.72:0/539307653 >> 172.21.15.72:0/539307653 conn(0x7ff09c0a2aa0 msgr2=0x7ff09c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.313+0000 7ff0a4567700 1 -- 172.21.15.72:0/539307653 shutdown_connections 2023-10-03T10:17:08.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.313+0000 7ff0a4567700 1 -- 172.21.15.72:0/539307653 wait complete. 2023-10-03T10:17:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.314+0000 7ff0a4567700 1 Processor -- start 2023-10-03T10:17:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.314+0000 7ff0a4567700 1 -- start start 2023-10-03T10:17:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.314+0000 7ff0a4567700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff09c06fb20 0x7ff09c12d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.314+0000 7ff0a4567700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff09c130540 0x7ff09c12d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.314+0000 7ff0a4567700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09c130e50 0x7ff09c137590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.314+0000 7ff0a4567700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c133bf0 con 0x7ff09c06fb20 2023-10-03T10:17:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.314+0000 7ff0a4567700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c134560 con 0x7ff09c130e50 2023-10-03T10:17:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.314+0000 7ff0a4567700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0a0d70 con 0x7ff09c130540 2023-10-03T10:17:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.314+0000 7ff0a1b02700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff09c130540 0x7ff09c12d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.314+0000 7ff0a1b02700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff09c130540 0x7ff09c12d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53208/0 (socket says 172.21.15.72:53208) 2023-10-03T10:17:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.314+0000 7ff0a1b02700 1 -- 172.21.15.72:0/850621571 learned_addr learned my addr 172.21.15.72:0/850621571 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.314+0000 7ff0a2303700 1 --2- 172.21.15.72:0/850621571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff09c06fb20 0x7ff09c12d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.314+0000 7ff0a2b04700 1 --2- 172.21.15.72:0/850621571 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09c130e50 0x7ff09c137590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.315+0000 7ff0a1b02700 1 -- 172.21.15.72:0/850621571 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09c130e50 msgr2=0x7ff09c137590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.315+0000 7ff0a1b02700 1 --2- 172.21.15.72:0/850621571 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09c130e50 0x7ff09c137590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.315+0000 7ff0a1b02700 1 -- 172.21.15.72:0/850621571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff09c06fb20 msgr2=0x7ff09c12d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.315+0000 7ff0a1b02700 1 --2- 172.21.15.72:0/850621571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff09c06fb20 0x7ff09c12d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.315+0000 7ff0a1b02700 1 -- 172.21.15.72:0/850621571 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff094009a70 con 0x7ff09c130540 2023-10-03T10:17:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.315+0000 7ff0a1b02700 1 --2- 172.21.15.72:0/850621571 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff09c130540 0x7ff09c12d720 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff08c000c00 tx=0x7ff08c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.315+0000 7ff092ffd700 1 -- 172.21.15.72:0/850621571 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c004450 con 0x7ff09c130540 2023-10-03T10:17:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.315+0000 7ff092ffd700 1 -- 172.21.15.72:0/850621571 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c0036a0 con 0x7ff09c130540 2023-10-03T10:17:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.315+0000 7ff0a4567700 1 -- 172.21.15.72:0/850621571 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0980094a0 con 0x7ff09c130540 2023-10-03T10:17:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.315+0000 7ff092ffd700 1 -- 172.21.15.72:0/850621571 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c0045f0 con 0x7ff09c130540 2023-10-03T10:17:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.315+0000 7ff0a4567700 1 -- 172.21.15.72:0/850621571 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08c009550 con 0x7ff09c130540 2023-10-03T10:17:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.316+0000 7ff092ffd700 1 -- 172.21.15.72:0/850621571 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff08c003a50 con 0x7ff09c130540 2023-10-03T10:17:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.316+0000 7ff092ffd700 1 -- 172.21.15.72:0/850621571 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff08c040c70 con 0x7ff09c130540 2023-10-03T10:17:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.316+0000 7ff0a4567700 1 -- 172.21.15.72:0/850621571 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09c1341c0 con 0x7ff09c130540 2023-10-03T10:17:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.321+0000 7ff092ffd700 1 -- 172.21.15.72:0/850621571 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff08c022390 con 0x7ff09c130540 2023-10-03T10:17:08.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.326+0000 7f2afe442700 1 -- 172.21.15.72:0/1761510371 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2af80747f0 con 0x7f2af80a0a30 2023-10-03T10:17:08.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.326+0000 7f2af4ff9700 1 -- 172.21.15.72:0/1761510371 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2aec011d90 con 0x7f2af80a0a30 2023-10-03T10:17:08.327 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:08.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.328+0000 7f2afe442700 1 -- 172.21.15.72:0/1761510371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2af80a0a30 msgr2=0x7f2af8121880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.328+0000 7f2afe442700 1 --2- 172.21.15.72:0/1761510371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2af80a0a30 0x7f2af8121880 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00e910 tx=0x7f2aec00ec20 comp rx=0 tx=0).stop 2023-10-03T10:17:08.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.328+0000 7f2afe442700 1 -- 172.21.15.72:0/1761510371 shutdown_connections 2023-10-03T10:17:08.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.328+0000 7f2afe442700 1 --2- 172.21.15.72:0/1761510371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2af8133930 0x7f2af8121dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.328+0000 7f2afe442700 1 --2- 172.21.15.72:0/1761510371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2af809d630 0x7f2af8121340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.328+0000 7f2afe442700 1 --2- 172.21.15.72:0/1761510371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2af80a0a30 0x7f2af8121880 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.328+0000 7f2afe442700 1 -- 172.21.15.72:0/1761510371 >> 172.21.15.72:0/1761510371 conn(0x7f2af80a3050 msgr2=0x7f2af81331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.328+0000 7f2afe442700 1 -- 172.21.15.72:0/1761510371 shutdown_connections 2023-10-03T10:17:08.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.328+0000 7f2afe442700 1 -- 172.21.15.72:0/1761510371 wait complete. 2023-10-03T10:17:08.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:08.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.507+0000 7ff0a4567700 1 -- 172.21.15.72:0/850621571 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff09c074ea0 con 0x7ff09c130540 2023-10-03T10:17:08.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.508+0000 7ff092ffd700 1 -- 172.21.15.72:0/850621571 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff08c00bbd0 con 0x7ff09c130540 2023-10-03T10:17:08.508 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:08.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.510+0000 7ff0a4567700 1 -- 172.21.15.72:0/850621571 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff09c130540 msgr2=0x7ff09c12d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.510+0000 7ff0a4567700 1 --2- 172.21.15.72:0/850621571 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff09c130540 0x7ff09c12d720 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff08c000c00 tx=0x7ff08c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:08.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.510+0000 7ff0a4567700 1 -- 172.21.15.72:0/850621571 shutdown_connections 2023-10-03T10:17:08.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.510+0000 7ff0a4567700 1 --2- 172.21.15.72:0/850621571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff09c06fb20 0x7ff09c12d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.510+0000 7ff0a4567700 1 --2- 172.21.15.72:0/850621571 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff09c130e50 0x7ff09c137590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.510+0000 7ff0a4567700 1 --2- 172.21.15.72:0/850621571 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff09c130540 0x7ff09c12d720 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.510+0000 7ff0a4567700 1 -- 172.21.15.72:0/850621571 >> 172.21.15.72:0/850621571 conn(0x7ff09c0a2aa0 msgr2=0x7ff09c12fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.510+0000 7ff0a4567700 1 -- 172.21.15.72:0/850621571 shutdown_connections 2023-10-03T10:17:08.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:08.510+0000 7ff0a4567700 1 -- 172.21.15.72:0/850621571 wait complete. 2023-10-03T10:17:08.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:09.166 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:09.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.289+0000 7f85ec5d2700 1 Processor -- start 2023-10-03T10:17:09.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.289+0000 7f85ec5d2700 1 -- start start 2023-10-03T10:17:09.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.290+0000 7f85ec5d2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85e409d6f0 0x7f85e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.290+0000 7f85ec5d2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85e409e000 0x7f85e4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.290+0000 7f85ec5d2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e409f130 con 0x7f85e409e410 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.290+0000 7f85ec5d2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e409f520 con 0x7f85e409d6f0 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.290+0000 7f85ec5d2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85e409e930 con 0x7f85e409e000 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.290+0000 7f85e9b6d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85e409e000 0x7f85e4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.290+0000 7f85ea36e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85e409d6f0 0x7f85e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.290+0000 7f85e9b6d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85e409e000 0x7f85e4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53220/0 (socket says 172.21.15.72:53220) 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.290+0000 7f85e9b6d700 1 -- 172.21.15.72:0/3103886758 learned_addr learned my addr 172.21.15.72:0/3103886758 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.290+0000 7f85e9b6d700 1 -- 172.21.15.72:0/3103886758 >> v2:172.21.15.72:3300/0 conn(0x7f85e409d6f0 msgr2=0x7f85e409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.290+0000 7f85e9b6d700 1 --2- 172.21.15.72:0/3103886758 >> v2:172.21.15.72:3300/0 conn(0x7f85e409d6f0 0x7f85e409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.290+0000 7f85e9b6d700 1 -- 172.21.15.72:0/3103886758 >> v1:172.21.15.72:6789/0 conn(0x7f85e409e410 legacy=0x7f85e4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.290+0000 7f85e9b6d700 1 -- 172.21.15.72:0/3103886758 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e409b2d0 con 0x7f85e409e000 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.290+0000 7f85ea36e700 1 --2- 172.21.15.72:0/3103886758 >> v2:172.21.15.72:3300/0 conn(0x7f85e409d6f0 0x7f85e409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.291+0000 7f85e9b6d700 1 --2- 172.21.15.72:0/3103886758 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85e409e000 0x7f85e4130660 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f85e00098f0 tx=0x7f85e0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b72ad3705c967918 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.291+0000 7f85e936c700 1 -- 172.21.15.72:0/3103886758 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0011830 con 0x7f85e409e000 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.291+0000 7f85e936c700 1 -- 172.21.15.72:0/3103886758 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0011990 con 0x7f85e409e000 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.291+0000 7f85e936c700 1 -- 172.21.15.72:0/3103886758 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0011d20 con 0x7f85e409e000 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.291+0000 7f85ec5d2700 1 -- 172.21.15.72:0/3103886758 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85e409e000 msgr2=0x7f85e4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.291+0000 7f85ec5d2700 1 --2- 172.21.15.72:0/3103886758 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85e409e000 0x7f85e4130660 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f85e00098f0 tx=0x7f85e0009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.291+0000 7f85ec5d2700 1 -- 172.21.15.72:0/3103886758 shutdown_connections 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.291+0000 7f85ec5d2700 1 --2- 172.21.15.72:0/3103886758 >> v2:172.21.15.72:3300/0 conn(0x7f85e409d6f0 0x7f85e409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.291+0000 7f85ec5d2700 1 --2- 172.21.15.72:0/3103886758 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85e409e000 0x7f85e4130660 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.291+0000 7f85ec5d2700 1 -- 172.21.15.72:0/3103886758 >> 172.21.15.72:0/3103886758 conn(0x7f85e4066f50 msgr2=0x7f85e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.291+0000 7f85ec5d2700 1 -- 172.21.15.72:0/3103886758 shutdown_connections 2023-10-03T10:17:09.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.291+0000 7f85ec5d2700 1 -- 172.21.15.72:0/3103886758 wait complete. 2023-10-03T10:17:09.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.292+0000 7f85ec5d2700 1 Processor -- start 2023-10-03T10:17:09.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.292+0000 7f85ec5d2700 1 -- start start 2023-10-03T10:17:09.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ec5d2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85e409d6f0 0x7f85e41bb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ec5d2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85e409e000 0x7f85e41bb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ec5d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85e409e410 0x7f85e41bbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ec5d2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e411db30 con 0x7f85e409e000 2023-10-03T10:17:09.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ec5d2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e409c770 con 0x7f85e409e410 2023-10-03T10:17:09.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ec5d2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85e41bd160 con 0x7f85e409d6f0 2023-10-03T10:17:09.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ea36e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85e409d6f0 0x7f85e41bb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ea36e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85e409d6f0 0x7f85e41bb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53232/0 (socket says 172.21.15.72:53232) 2023-10-03T10:17:09.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ea36e700 1 -- 172.21.15.72:0/1225147100 learned_addr learned my addr 172.21.15.72:0/1225147100 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:09.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85e9b6d700 1 --2- 172.21.15.72:0/1225147100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85e409e000 0x7f85e41bb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85eab6f700 1 --2- 172.21.15.72:0/1225147100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85e409e410 0x7f85e41bbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ea36e700 1 -- 172.21.15.72:0/1225147100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85e409e410 msgr2=0x7f85e41bbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ea36e700 1 --2- 172.21.15.72:0/1225147100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85e409e410 0x7f85e41bbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ea36e700 1 -- 172.21.15.72:0/1225147100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85e409e000 msgr2=0x7f85e41bb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ea36e700 1 --2- 172.21.15.72:0/1225147100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85e409e000 0x7f85e41bb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ea36e700 1 -- 172.21.15.72:0/1225147100 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d40094a0 con 0x7f85e409d6f0 2023-10-03T10:17:09.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85e9b6d700 1 --2- 172.21.15.72:0/1225147100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85e409e000 0x7f85e41bb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ea36e700 1 --2- 172.21.15.72:0/1225147100 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85e409d6f0 0x7f85e41bb470 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f85d400ebe0 tx=0x7f85d400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85daffd700 1 -- 172.21.15.72:0/1225147100 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d400c7f0 con 0x7f85e409d6f0 2023-10-03T10:17:09.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85daffd700 1 -- 172.21.15.72:0/1225147100 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d400c950 con 0x7f85e409d6f0 2023-10-03T10:17:09.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ec5d2700 1 -- 172.21.15.72:0/1225147100 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e0009550 con 0x7f85e409d6f0 2023-10-03T10:17:09.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85daffd700 1 -- 172.21.15.72:0/1225147100 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d400cce0 con 0x7f85e409d6f0 2023-10-03T10:17:09.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.293+0000 7f85ec5d2700 1 -- 172.21.15.72:0/1225147100 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e411f140 con 0x7f85e409d6f0 2023-10-03T10:17:09.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.294+0000 7f85daffd700 1 -- 172.21.15.72:0/1225147100 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f85d4013470 con 0x7f85e409d6f0 2023-10-03T10:17:09.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.294+0000 7f85daffd700 1 -- 172.21.15.72:0/1225147100 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f85d403fad0 con 0x7f85e409d6f0 2023-10-03T10:17:09.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.294+0000 7f85ec5d2700 1 -- 172.21.15.72:0/1225147100 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e411dd60 con 0x7f85e409d6f0 2023-10-03T10:17:09.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:09.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.299+0000 7f85daffd700 1 -- 172.21.15.72:0/1225147100 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f85d403de60 con 0x7f85e409d6f0 2023-10-03T10:17:09.342 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.426+0000 7fa235553700 1 Processor -- start 2023-10-03T10:17:09.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.426+0000 7fa235553700 1 -- start start 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.427+0000 7fa235553700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2300a0a30 0x7fa2300a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.427+0000 7fa235553700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa230138d80 0x7fa23013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.427+0000 7fa235553700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2300a2a70 con 0x7fa23009d630 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.427+0000 7fa235553700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300a01d0 con 0x7fa2300a0a30 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.427+0000 7fa235553700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa23009e2b0 con 0x7fa230138d80 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.427+0000 7fa22e7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa23009d630 0x7fa2300a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33648/0 (socket says 172.21.15.72:33648) 2023-10-03T10:17:09.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.427+0000 7fa22effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2300a0a30 0x7fa2300a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.427+0000 7fa22e7fc700 1 -- 172.21.15.72:0/3789134856 learned_addr learned my addr 172.21.15.72:0/3789134856 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.427+0000 7fa22f7fe700 1 --2- 172.21.15.72:0/3789134856 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa230138d80 0x7fa23013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.427+0000 7fa22effd700 1 -- 172.21.15.72:0/3789134856 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa230138d80 msgr2=0x7fa23013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.427+0000 7fa22effd700 1 --2- 172.21.15.72:0/3789134856 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa230138d80 0x7fa23013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.427+0000 7fa22effd700 1 -- 172.21.15.72:0/3789134856 >> v1:172.21.15.72:6789/0 conn(0x7fa23009d630 legacy=0x7fa2300a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.427+0000 7fa22effd700 1 -- 172.21.15.72:0/3789134856 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23009dc50 con 0x7fa2300a0a30 2023-10-03T10:17:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.427+0000 7fa22effd700 1 --2- 172.21.15.72:0/3789134856 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2300a0a30 0x7fa2300a0e00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa220009870 tx=0x7fa220009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=981b6187fad530e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.428+0000 7fa22dffb700 1 -- 172.21.15.72:0/3789134856 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220011830 con 0x7fa2300a0a30 2023-10-03T10:17:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.428+0000 7fa22dffb700 1 -- 172.21.15.72:0/3789134856 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa220011990 con 0x7fa2300a0a30 2023-10-03T10:17:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.428+0000 7fa22dffb700 1 -- 172.21.15.72:0/3789134856 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220011d20 con 0x7fa2300a0a30 2023-10-03T10:17:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.428+0000 7fa235553700 1 -- 172.21.15.72:0/3789134856 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2300a0a30 msgr2=0x7fa2300a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.428+0000 7fa235553700 1 --2- 172.21.15.72:0/3789134856 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2300a0a30 0x7fa2300a0e00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa220009870 tx=0x7fa220009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.428+0000 7fa235553700 1 -- 172.21.15.72:0/3789134856 shutdown_connections 2023-10-03T10:17:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.428+0000 7fa235553700 1 --2- 172.21.15.72:0/3789134856 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa230138d80 0x7fa23013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.428+0000 7fa235553700 1 --2- 172.21.15.72:0/3789134856 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2300a0a30 0x7fa2300a0e00 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.428+0000 7fa235553700 1 -- 172.21.15.72:0/3789134856 >> 172.21.15.72:0/3789134856 conn(0x7fa2300a3050 msgr2=0x7fa2300a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.428+0000 7fa235553700 1 -- 172.21.15.72:0/3789134856 shutdown_connections 2023-10-03T10:17:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.428+0000 7fa235553700 1 -- 172.21.15.72:0/3789134856 wait complete. 2023-10-03T10:17:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.430+0000 7fa235553700 1 Processor -- start 2023-10-03T10:17:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.430+0000 7fa235553700 1 -- start start 2023-10-03T10:17:09.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.430+0000 7fa235553700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa23009d630 0x7fa2301208d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.430+0000 7fa235553700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2300a0a30 0x7fa230120e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.430+0000 7fa235553700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa230138d80 0x7fa230121350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.430+0000 7fa235553700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa230123660 con 0x7fa23009d630 2023-10-03T10:17:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.430+0000 7fa235553700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300a4e20 con 0x7fa2300a0a30 2023-10-03T10:17:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.430+0000 7fa235553700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300a0410 con 0x7fa230138d80 2023-10-03T10:17:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa22effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa23009d630 0x7fa2301208d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa22e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2300a0a30 0x7fa230120e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa22effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa23009d630 0x7fa2301208d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53800/0 (socket says 172.21.15.72:53800) 2023-10-03T10:17:09.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa22effd700 1 -- 172.21.15.72:0/3095586656 learned_addr learned my addr 172.21.15.72:0/3095586656 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:09.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa22f7fe700 1 --2- 172.21.15.72:0/3095586656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa230138d80 0x7fa230121350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa22effd700 1 -- 172.21.15.72:0/3095586656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa230138d80 msgr2=0x7fa230121350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa22effd700 1 --2- 172.21.15.72:0/3095586656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa230138d80 0x7fa230121350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa22effd700 1 -- 172.21.15.72:0/3095586656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2300a0a30 msgr2=0x7fa230120e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa22effd700 1 --2- 172.21.15.72:0/3095586656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2300a0a30 0x7fa230120e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa22effd700 1 -- 172.21.15.72:0/3095586656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2200094a0 con 0x7fa23009d630 2023-10-03T10:17:09.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa22f7fe700 1 --2- 172.21.15.72:0/3095586656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa230138d80 0x7fa230121350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa22e7fc700 1 --2- 172.21.15.72:0/3095586656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2300a0a30 0x7fa230120e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa22effd700 1 --2- 172.21.15.72:0/3095586656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa23009d630 0x7fa2301208d0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fa220009840 tx=0x7fa220004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa2177fe700 1 -- 172.21.15.72:0/3095586656 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220004450 con 0x7fa23009d630 2023-10-03T10:17:09.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa2177fe700 1 -- 172.21.15.72:0/3095586656 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22001f070 con 0x7fa23009d630 2023-10-03T10:17:09.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa2177fe700 1 -- 172.21.15.72:0/3095586656 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2200038e0 con 0x7fa23009d630 2023-10-03T10:17:09.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.431+0000 7fa235553700 1 -- 172.21.15.72:0/3095586656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa230122c70 con 0x7fa23009d630 2023-10-03T10:17:09.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.432+0000 7fa235553700 1 -- 172.21.15.72:0/3095586656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa230121d10 con 0x7fa23009d630 2023-10-03T10:17:09.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.432+0000 7fa2177fe700 1 -- 172.21.15.72:0/3095586656 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa220003a40 con 0x7fa23009d630 2023-10-03T10:17:09.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.432+0000 7fa2177fe700 1 -- 172.21.15.72:0/3095586656 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa220021070 con 0x7fa23009d630 2023-10-03T10:17:09.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.433+0000 7fa235553700 1 -- 172.21.15.72:0/3095586656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2300747f0 con 0x7fa23009d630 2023-10-03T10:17:09.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.437+0000 7fa2177fe700 1 -- 172.21.15.72:0/3095586656 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa220015080 con 0x7fa23009d630 2023-10-03T10:17:09.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.481+0000 7f3599a44700 1 Processor -- start 2023-10-03T10:17:09.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.481+0000 7f3599a44700 1 -- start start 2023-10-03T10:17:09.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.482+0000 7f3599a44700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35940a0a30 0x7f35940a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.482+0000 7f3599a44700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3594138d80 0x7f359413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.482+0000 7f3599a44700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35940a2a70 con 0x7f359409d630 2023-10-03T10:17:09.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.482+0000 7f3599a44700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35940a01d0 con 0x7f35940a0a30 2023-10-03T10:17:09.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.482+0000 7f3599a44700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f359409e2b0 con 0x7f3594138d80 2023-10-03T10:17:09.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.482+0000 7f3592ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35940a0a30 0x7f35940a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.482+0000 7f35927fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f359409d630 0x7f35940a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33656/0 (socket says 172.21.15.72:33656) 2023-10-03T10:17:09.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.482+0000 7f35927fc700 1 -- 172.21.15.72:0/3503100987 learned_addr learned my addr 172.21.15.72:0/3503100987 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:09.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.482+0000 7f35937fe700 1 --2- 172.21.15.72:0/3503100987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3594138d80 0x7f359413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.483+0000 7f3592ffd700 1 -- 172.21.15.72:0/3503100987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3594138d80 msgr2=0x7f359413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.483+0000 7f3591ffb700 1 -- 172.21.15.72:0/3503100987 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855581550 0 0) 0x7f35940a2a70 con 0x7f359409d630 2023-10-03T10:17:09.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.483+0000 7f3592ffd700 1 --2- 172.21.15.72:0/3503100987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3594138d80 0x7f359413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.483+0000 7f3592ffd700 1 -- 172.21.15.72:0/3503100987 >> v1:172.21.15.72:6789/0 conn(0x7f359409d630 legacy=0x7f35940a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.483+0000 7f3592ffd700 1 -- 172.21.15.72:0/3503100987 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359409dc50 con 0x7f35940a0a30 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.483+0000 7f3592ffd700 1 --2- 172.21.15.72:0/3503100987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35940a0a30 0x7f35940a0e00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3584009870 tx=0x7f3584009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ac95c65a87df926 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.483+0000 7f3591ffb700 1 -- 172.21.15.72:0/3503100987 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584011830 con 0x7f35940a0a30 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.483+0000 7f3591ffb700 1 -- 172.21.15.72:0/3503100987 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3584011990 con 0x7f35940a0a30 2023-10-03T10:17:09.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.483+0000 7f3591ffb700 1 -- 172.21.15.72:0/3503100987 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584011d20 con 0x7f35940a0a30 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.484+0000 7f3599a44700 1 -- 172.21.15.72:0/3503100987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35940a0a30 msgr2=0x7f35940a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.484+0000 7f3599a44700 1 --2- 172.21.15.72:0/3503100987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35940a0a30 0x7f35940a0e00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3584009870 tx=0x7f3584009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.484+0000 7f3599a44700 1 -- 172.21.15.72:0/3503100987 shutdown_connections 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.484+0000 7f3599a44700 1 --2- 172.21.15.72:0/3503100987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3594138d80 0x7f359413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.484+0000 7f3599a44700 1 --2- 172.21.15.72:0/3503100987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35940a0a30 0x7f35940a0e00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.484+0000 7f3599a44700 1 -- 172.21.15.72:0/3503100987 >> 172.21.15.72:0/3503100987 conn(0x7f35940a3050 msgr2=0x7f35940a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.484+0000 7f3599a44700 1 -- 172.21.15.72:0/3503100987 shutdown_connections 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.484+0000 7f3599a44700 1 -- 172.21.15.72:0/3503100987 wait complete. 2023-10-03T10:17:09.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.485+0000 7f3599a44700 1 Processor -- start 2023-10-03T10:17:09.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.486+0000 7f3599a44700 1 -- start start 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.486+0000 7f3599a44700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f359409d630 0x7f3594133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.486+0000 7f3599a44700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35940a0a30 0x7f3594133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.486+0000 7f3599a44700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3594138d80 0x7f3594134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.486+0000 7f3599a44700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3594137d30 con 0x7f359409d630 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.486+0000 7f3599a44700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35940a4bf0 con 0x7f3594138d80 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.486+0000 7f3599a44700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35940a0410 con 0x7f35940a0a30 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.486+0000 7f3592ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f359409d630 0x7f3594133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.486+0000 7f3592ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f359409d630 0x7f3594133700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53802/0 (socket says 172.21.15.72:53802) 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.486+0000 7f3592ffd700 1 -- 172.21.15.72:0/1352472483 learned_addr learned my addr 172.21.15.72:0/1352472483 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.486+0000 7f35927fc700 1 --2- 172.21.15.72:0/1352472483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35940a0a30 0x7f3594133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.486+0000 7f35937fe700 1 --2- 172.21.15.72:0/1352472483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3594138d80 0x7f3594134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.487+0000 7f3592ffd700 1 -- 172.21.15.72:0/1352472483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35940a0a30 msgr2=0x7f3594133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.487+0000 7f3592ffd700 1 --2- 172.21.15.72:0/1352472483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35940a0a30 0x7f3594133c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.487+0000 7f3592ffd700 1 -- 172.21.15.72:0/1352472483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3594138d80 msgr2=0x7f3594134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.487+0000 7f3592ffd700 1 --2- 172.21.15.72:0/1352472483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3594138d80 0x7f3594134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.487+0000 7f3592ffd700 1 -- 172.21.15.72:0/1352472483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35840094a0 con 0x7f359409d630 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.487+0000 7f35927fc700 1 --2- 172.21.15.72:0/1352472483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35940a0a30 0x7f3594133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.487+0000 7f3592ffd700 1 --2- 172.21.15.72:0/1352472483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f359409d630 0x7f3594133700 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f3584000c00 tx=0x7f3584004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.487+0000 7f357bfff700 1 -- 172.21.15.72:0/1352472483 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584004510 con 0x7f359409d630 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.487+0000 7f357bfff700 1 -- 172.21.15.72:0/1352472483 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358401f070 con 0x7f359409d630 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.487+0000 7f3599a44700 1 -- 172.21.15.72:0/1352472483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3594136500 con 0x7f359409d630 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.487+0000 7f357bfff700 1 -- 172.21.15.72:0/1352472483 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35840038e0 con 0x7f359409d630 2023-10-03T10:17:09.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.487+0000 7f3599a44700 1 -- 172.21.15.72:0/1352472483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3594136e70 con 0x7f359409d630 2023-10-03T10:17:09.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.488+0000 7f357bfff700 1 -- 172.21.15.72:0/1352472483 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3584003a40 con 0x7f359409d630 2023-10-03T10:17:09.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.488+0000 7f357bfff700 1 -- 172.21.15.72:0/1352472483 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3584021070 con 0x7f359409d630 2023-10-03T10:17:09.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.488+0000 7f3599a44700 1 -- 172.21.15.72:0/1352472483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35940747f0 con 0x7f359409d630 2023-10-03T10:17:09.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.493+0000 7f357bfff700 1 -- 172.21.15.72:0/1352472483 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f358402b070 con 0x7f359409d630 2023-10-03T10:17:09.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.497+0000 7f85ec5d2700 1 -- 172.21.15.72:0/1225147100 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f85e4072550 con 0x7f85e409d6f0 2023-10-03T10:17:09.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.497+0000 7f85daffd700 1 -- 172.21.15.72:0/1225147100 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f85d403de60 con 0x7f85e409d6f0 2023-10-03T10:17:09.498 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:09.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.500+0000 7f85ec5d2700 1 -- 172.21.15.72:0/1225147100 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85e409d6f0 msgr2=0x7f85e41bb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.500+0000 7f85ec5d2700 1 --2- 172.21.15.72:0/1225147100 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85e409d6f0 0x7f85e41bb470 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f85d400ebe0 tx=0x7f85d400eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.500+0000 7f85ec5d2700 1 -- 172.21.15.72:0/1225147100 shutdown_connections 2023-10-03T10:17:09.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.500+0000 7f85ec5d2700 1 --2- 172.21.15.72:0/1225147100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f85e409e410 0x7f85e41bbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.500+0000 7f85ec5d2700 1 --2- 172.21.15.72:0/1225147100 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f85e409d6f0 0x7f85e41bb470 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.500+0000 7f85ec5d2700 1 --2- 172.21.15.72:0/1225147100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85e409e000 0x7f85e41bb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.500+0000 7f85ec5d2700 1 -- 172.21.15.72:0/1225147100 >> 172.21.15.72:0/1225147100 conn(0x7f85e4066f50 msgr2=0x7f85e406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.500+0000 7f85ec5d2700 1 -- 172.21.15.72:0/1225147100 shutdown_connections 2023-10-03T10:17:09.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.500+0000 7f85ec5d2700 1 -- 172.21.15.72:0/1225147100 wait complete. 2023-10-03T10:17:09.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:09.524 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:09.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.647+0000 7ff880b79700 1 Processor -- start 2023-10-03T10:17:09.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.647+0000 7ff880b79700 1 -- start start 2023-10-03T10:17:09.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.648+0000 7ff880b79700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff87c1305f0 0x7ff87c1309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.648+0000 7ff880b79700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff87c070160 0x7ff87c138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.648+0000 7ff880b79700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87c1301c0 con 0x7ff87c06f660 2023-10-03T10:17:09.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.648+0000 7ff880b79700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c071ff0 con 0x7ff87c1305f0 2023-10-03T10:17:09.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.648+0000 7ff880b79700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c070e70 con 0x7ff87c070160 2023-10-03T10:17:09.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.648+0000 7ff87ad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff87c070160 0x7ff87c138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.648+0000 7ff87a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff87c1305f0 0x7ff87c1309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.648+0000 7ff87ad9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff87c070160 0x7ff87c138540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53266/0 (socket says 172.21.15.72:53266) 2023-10-03T10:17:09.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.648+0000 7ff87ad9d700 1 -- 172.21.15.72:0/1348770705 learned_addr learned my addr 172.21.15.72:0/1348770705 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:09.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.649+0000 7ff87959a700 1 -- 172.21.15.72:0/1348770705 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947243150 0 0) 0x7ff87c1301c0 con 0x7ff87c06f660 2023-10-03T10:17:09.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.649+0000 7ff87ad9d700 1 -- 172.21.15.72:0/1348770705 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff87c1305f0 msgr2=0x7ff87c1309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.649+0000 7ff87ad9d700 1 --2- 172.21.15.72:0/1348770705 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff87c1305f0 0x7ff87c1309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.649+0000 7ff87ad9d700 1 -- 172.21.15.72:0/1348770705 >> v1:172.21.15.72:6789/0 conn(0x7ff87c06f660 legacy=0x7ff87c06fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.649+0000 7ff87ad9d700 1 -- 172.21.15.72:0/1348770705 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c0722b0 con 0x7ff87c070160 2023-10-03T10:17:09.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.649+0000 7ff87a59c700 1 --2- 172.21.15.72:0/1348770705 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff87c1305f0 0x7ff87c1309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.649+0000 7ff87ad9d700 1 --2- 172.21.15.72:0/1348770705 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff87c070160 0x7ff87c138540 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff874009e80 tx=0x7ff87400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=944b0316c0460d4e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.649+0000 7ff87959a700 1 -- 172.21.15.72:0/1348770705 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87400e070 con 0x7ff87c070160 2023-10-03T10:17:09.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.649+0000 7ff87959a700 1 -- 172.21.15.72:0/1348770705 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87400b910 con 0x7ff87c070160 2023-10-03T10:17:09.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.649+0000 7ff87959a700 1 -- 172.21.15.72:0/1348770705 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87400bcc0 con 0x7ff87c070160 2023-10-03T10:17:09.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.650+0000 7ff880b79700 1 -- 172.21.15.72:0/1348770705 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff87c070160 msgr2=0x7ff87c138540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.650+0000 7ff880b79700 1 --2- 172.21.15.72:0/1348770705 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff87c070160 0x7ff87c138540 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff874009e80 tx=0x7ff87400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:09.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.650+0000 7ff880b79700 1 -- 172.21.15.72:0/1348770705 shutdown_connections 2023-10-03T10:17:09.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.650+0000 7ff880b79700 1 --2- 172.21.15.72:0/1348770705 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff87c070160 0x7ff87c138540 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.650+0000 7ff880b79700 1 --2- 172.21.15.72:0/1348770705 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff87c1305f0 0x7ff87c1309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.650+0000 7ff880b79700 1 -- 172.21.15.72:0/1348770705 >> 172.21.15.72:0/1348770705 conn(0x7ff87c0a2aa0 msgr2=0x7ff87c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.650+0000 7ff880b79700 1 -- 172.21.15.72:0/1348770705 shutdown_connections 2023-10-03T10:17:09.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.650+0000 7ff880b79700 1 -- 172.21.15.72:0/1348770705 wait complete. 2023-10-03T10:17:09.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.651+0000 7ff880b79700 1 Processor -- start 2023-10-03T10:17:09.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.651+0000 7ff880b79700 1 -- start start 2023-10-03T10:17:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.652+0000 7ff880b79700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff87c06f660 0x7ff87c1c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.652+0000 7ff880b79700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff87c070160 0x7ff87c1c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.652+0000 7ff880b79700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff87c1305f0 0x7ff87c1c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.652+0000 7ff880b79700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c12b2f0 con 0x7ff87c06f660 2023-10-03T10:17:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.652+0000 7ff880b79700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c12a3a0 con 0x7ff87c1305f0 2023-10-03T10:17:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.652+0000 7ff880b79700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c1284c0 con 0x7ff87c070160 2023-10-03T10:17:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.652+0000 7ff879d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff87c070160 0x7ff87c1c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.652+0000 7ff87ad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff87c1305f0 0x7ff87c1c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.652+0000 7ff879d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff87c070160 0x7ff87c1c63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53270/0 (socket says 172.21.15.72:53270) 2023-10-03T10:17:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.652+0000 7ff879d9b700 1 -- 172.21.15.72:0/1208375941 learned_addr learned my addr 172.21.15.72:0/1208375941 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:09.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.652+0000 7ff87a59c700 1 --2- 172.21.15.72:0/1208375941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff87c06f660 0x7ff87c1c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.653+0000 7ff87ad9d700 1 -- 172.21.15.72:0/1208375941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff87c070160 msgr2=0x7ff87c1c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.653+0000 7ff87ad9d700 1 --2- 172.21.15.72:0/1208375941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff87c070160 0x7ff87c1c63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.653+0000 7ff87ad9d700 1 -- 172.21.15.72:0/1208375941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff87c06f660 msgr2=0x7ff87c1c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.653+0000 7ff87ad9d700 1 --2- 172.21.15.72:0/1208375941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff87c06f660 0x7ff87c1c5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.653+0000 7ff87ad9d700 1 -- 172.21.15.72:0/1208375941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c0094a0 con 0x7ff87c1305f0 2023-10-03T10:17:09.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.653+0000 7ff879d9b700 1 --2- 172.21.15.72:0/1208375941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff87c070160 0x7ff87c1c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.653+0000 7ff87a59c700 1 --2- 172.21.15.72:0/1208375941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff87c06f660 0x7ff87c1c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.653+0000 7ff87ad9d700 1 --2- 172.21.15.72:0/1208375941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff87c1305f0 0x7ff87c1c68e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff874009e80 tx=0x7ff874004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.653+0000 7ff86affd700 1 -- 172.21.15.72:0/1208375941 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8740099b0 con 0x7ff87c1305f0 2023-10-03T10:17:09.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.653+0000 7ff86affd700 1 -- 172.21.15.72:0/1208375941 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8740092e0 con 0x7ff87c1305f0 2023-10-03T10:17:09.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.653+0000 7ff86affd700 1 -- 172.21.15.72:0/1208375941 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87401c660 con 0x7ff87c1305f0 2023-10-03T10:17:09.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.653+0000 7ff880b79700 1 -- 172.21.15.72:0/1208375941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff874009b30 con 0x7ff87c1305f0 2023-10-03T10:17:09.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.653+0000 7ff880b79700 1 -- 172.21.15.72:0/1208375941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87c12ac30 con 0x7ff87c1305f0 2023-10-03T10:17:09.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.654+0000 7ff86affd700 1 -- 172.21.15.72:0/1208375941 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff87401c7c0 con 0x7ff87c1305f0 2023-10-03T10:17:09.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.654+0000 7ff880b79700 1 -- 172.21.15.72:0/1208375941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff87c074ea0 con 0x7ff87c1305f0 2023-10-03T10:17:09.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.654+0000 7ff86affd700 1 -- 172.21.15.72:0/1208375941 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff874040b20 con 0x7ff87c1305f0 2023-10-03T10:17:09.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.659+0000 7ff86affd700 1 -- 172.21.15.72:0/1208375941 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff874042e60 con 0x7ff87c1305f0 2023-10-03T10:17:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.692+0000 7fa235553700 1 -- 172.21.15.72:0/3095586656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa230124100 con 0x7fa23009d630 2023-10-03T10:17:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.693+0000 7fa2177fe700 1 -- 172.21.15.72:0/3095586656 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa22002b020 con 0x7fa23009d630 2023-10-03T10:17:09.693 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.695+0000 7fa235553700 1 -- 172.21.15.72:0/3095586656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa23009d630 msgr2=0x7fa2301208d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.695+0000 7fa235553700 1 --2- 172.21.15.72:0/3095586656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa23009d630 0x7fa2301208d0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fa220009840 tx=0x7fa220004750 comp rx=0 tx=0).stop 2023-10-03T10:17:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.695+0000 7fa235553700 1 -- 172.21.15.72:0/3095586656 shutdown_connections 2023-10-03T10:17:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.695+0000 7fa235553700 1 --2- 172.21.15.72:0/3095586656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa23009d630 0x7fa2301208d0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.695+0000 7fa235553700 1 --2- 172.21.15.72:0/3095586656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa230138d80 0x7fa230121350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.695+0000 7fa235553700 1 --2- 172.21.15.72:0/3095586656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2300a0a30 0x7fa230120e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.695+0000 7fa235553700 1 -- 172.21.15.72:0/3095586656 >> 172.21.15.72:0/3095586656 conn(0x7fa2300a3050 msgr2=0x7fa23009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.695+0000 7fa235553700 1 -- 172.21.15.72:0/3095586656 shutdown_connections 2023-10-03T10:17:09.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.695+0000 7fa235553700 1 -- 172.21.15.72:0/3095586656 wait complete. 2023-10-03T10:17:09.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:09.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.732+0000 7f3599a44700 1 -- 172.21.15.72:0/1352472483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3594072980 con 0x7f359409d630 2023-10-03T10:17:09.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.732+0000 7f357bfff700 1 -- 172.21.15.72:0/1352472483 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3584026480 con 0x7f359409d630 2023-10-03T10:17:09.733 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:09.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.734+0000 7f3599a44700 1 -- 172.21.15.72:0/1352472483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f359409d630 msgr2=0x7f3594133700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.734+0000 7f3599a44700 1 --2- 172.21.15.72:0/1352472483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f359409d630 0x7f3594133700 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f3584000c00 tx=0x7f3584004750 comp rx=0 tx=0).stop 2023-10-03T10:17:09.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.734+0000 7f3599a44700 1 -- 172.21.15.72:0/1352472483 shutdown_connections 2023-10-03T10:17:09.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.734+0000 7f3599a44700 1 --2- 172.21.15.72:0/1352472483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f359409d630 0x7f3594133700 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.734+0000 7f3599a44700 1 --2- 172.21.15.72:0/1352472483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3594138d80 0x7f3594134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.734+0000 7f3599a44700 1 --2- 172.21.15.72:0/1352472483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f35940a0a30 0x7f3594133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.734+0000 7f3599a44700 1 -- 172.21.15.72:0/1352472483 >> 172.21.15.72:0/1352472483 conn(0x7f35940a3050 msgr2=0x7f359413add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.735+0000 7f3599a44700 1 -- 172.21.15.72:0/1352472483 shutdown_connections 2023-10-03T10:17:09.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.735+0000 7f3599a44700 1 -- 172.21.15.72:0/1352472483 wait complete. 2023-10-03T10:17:09.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:09.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.851+0000 7ff880b79700 1 -- 172.21.15.72:0/1208375941 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff87c12ac30 con 0x7ff87c1305f0 2023-10-03T10:17:09.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.852+0000 7ff86affd700 1 -- 172.21.15.72:0/1208375941 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff87c12ac30 con 0x7ff87c1305f0 2023-10-03T10:17:09.852 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:09.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.854+0000 7ff880b79700 1 -- 172.21.15.72:0/1208375941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff87c1305f0 msgr2=0x7ff87c1c68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.854+0000 7ff880b79700 1 --2- 172.21.15.72:0/1208375941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff87c1305f0 0x7ff87c1c68e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff874009e80 tx=0x7ff874004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.854+0000 7ff880b79700 1 -- 172.21.15.72:0/1208375941 shutdown_connections 2023-10-03T10:17:09.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.854+0000 7ff880b79700 1 --2- 172.21.15.72:0/1208375941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff87c06f660 0x7ff87c1c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.854+0000 7ff880b79700 1 --2- 172.21.15.72:0/1208375941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff87c1305f0 0x7ff87c1c68e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.854+0000 7ff880b79700 1 --2- 172.21.15.72:0/1208375941 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff87c070160 0x7ff87c1c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.854+0000 7ff880b79700 1 -- 172.21.15.72:0/1208375941 >> 172.21.15.72:0/1208375941 conn(0x7ff87c0a2aa0 msgr2=0x7ff87c12f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.854+0000 7ff880b79700 1 -- 172.21.15.72:0/1208375941 shutdown_connections 2023-10-03T10:17:09.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:09.854+0000 7ff880b79700 1 -- 172.21.15.72:0/1208375941 wait complete. 2023-10-03T10:17:09.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:10.513 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:10.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.638+0000 7f3e8634f700 1 Processor -- start 2023-10-03T10:17:10.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.638+0000 7f3e8634f700 1 -- start start 2023-10-03T10:17:10.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e8634f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e8009e930 0x7f3e8009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e8634f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e8009f240 0x7f3e801317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e8634f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e8009f650 0x7f3e80131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e8634f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e80070940 con 0x7f3e8009e930 2023-10-03T10:17:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e8634f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8006fd60 con 0x7f3e8009f650 2023-10-03T10:17:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e8634f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8006fa80 con 0x7f3e8009f240 2023-10-03T10:17:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e7ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e8009e930 0x7f3e8009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e848ec700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e8009f650 0x7f3e80131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e7f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e8009f240 0x7f3e801317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e848ec700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e8009f650 0x7f3e80131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43304/0 (socket says 172.21.15.72:43304) 2023-10-03T10:17:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e7f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e8009f240 0x7f3e801317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53274/0 (socket says 172.21.15.72:53274) 2023-10-03T10:17:10.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e7ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e8009e930 0x7f3e8009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53820/0 (socket says 172.21.15.72:53820) 2023-10-03T10:17:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e848ec700 1 -- 172.21.15.72:0/1483154155 learned_addr learned my addr 172.21.15.72:0/1483154155 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e7f7fe700 1 -- 172.21.15.72:0/1483154155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e8009f650 msgr2=0x7f3e80131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e7f7fe700 1 --2- 172.21.15.72:0/1483154155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e8009f650 0x7f3e80131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e7f7fe700 1 -- 172.21.15.72:0/1483154155 >> v2:172.21.15.72:3300/0 conn(0x7f3e8009e930 msgr2=0x7f3e8009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e7f7fe700 1 --2- 172.21.15.72:0/1483154155 >> v2:172.21.15.72:3300/0 conn(0x7f3e8009e930 0x7f3e8009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e7f7fe700 1 -- 172.21.15.72:0/1483154155 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8009fb60 con 0x7f3e8009f240 2023-10-03T10:17:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e848ec700 1 --2- 172.21.15.72:0/1483154155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e8009f650 0x7f3e80131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e7ffff700 1 --2- 172.21.15.72:0/1483154155 >> v2:172.21.15.72:3300/0 conn(0x7f3e8009e930 0x7f3e8009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e7f7fe700 1 --2- 172.21.15.72:0/1483154155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e8009f240 0x7f3e801317f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009840 tx=0x7f3e68009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a057fa8b5ea6c23 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.639+0000 7f3e7effd700 1 -- 172.21.15.72:0/1483154155 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68011830 con 0x7f3e8009f240 2023-10-03T10:17:10.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.640+0000 7f3e7effd700 1 -- 172.21.15.72:0/1483154155 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e68011990 con 0x7f3e8009f240 2023-10-03T10:17:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.640+0000 7f3e7effd700 1 -- 172.21.15.72:0/1483154155 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68011d20 con 0x7f3e8009f240 2023-10-03T10:17:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.640+0000 7f3e8634f700 1 -- 172.21.15.72:0/1483154155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e8009f240 msgr2=0x7f3e801317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.640+0000 7f3e8634f700 1 --2- 172.21.15.72:0/1483154155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e8009f240 0x7f3e801317f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009840 tx=0x7f3e68009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.640+0000 7f3e8634f700 1 -- 172.21.15.72:0/1483154155 shutdown_connections 2023-10-03T10:17:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.640+0000 7f3e8634f700 1 --2- 172.21.15.72:0/1483154155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e8009f650 0x7f3e80131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.640+0000 7f3e8634f700 1 --2- 172.21.15.72:0/1483154155 >> v2:172.21.15.72:3300/0 conn(0x7f3e8009e930 0x7f3e8009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.640+0000 7f3e8634f700 1 --2- 172.21.15.72:0/1483154155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e8009f240 0x7f3e801317f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.640+0000 7f3e8634f700 1 -- 172.21.15.72:0/1483154155 >> 172.21.15.72:0/1483154155 conn(0x7f3e800a4210 msgr2=0x7f3e800a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.640+0000 7f3e8634f700 1 -- 172.21.15.72:0/1483154155 shutdown_connections 2023-10-03T10:17:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.640+0000 7f3e8634f700 1 -- 172.21.15.72:0/1483154155 wait complete. 2023-10-03T10:17:10.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.641+0000 7f3e8634f700 1 Processor -- start 2023-10-03T10:17:10.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.641+0000 7f3e8634f700 1 -- start start 2023-10-03T10:17:10.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e8634f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e8009e930 0x7f3e801a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e8634f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e8009f240 0x7f3e801a2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e8634f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e8009f650 0x7f3e801a2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e8634f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e801a4f70 con 0x7f3e8009e930 2023-10-03T10:17:10.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e8634f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e80071d20 con 0x7f3e8009f240 2023-10-03T10:17:10.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e8634f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800a3430 con 0x7f3e8009f650 2023-10-03T10:17:10.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e7ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e8009e930 0x7f3e801a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e848ec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e8009f650 0x7f3e801a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e7ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e8009e930 0x7f3e801a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53822/0 (socket says 172.21.15.72:53822) 2023-10-03T10:17:10.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e7f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e8009f240 0x7f3e801a2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e7ffff700 1 -- 172.21.15.72:0/3479020831 learned_addr learned my addr 172.21.15.72:0/3479020831 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:10.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e7ffff700 1 -- 172.21.15.72:0/3479020831 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e8009f650 msgr2=0x7f3e801a2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e7ffff700 1 --2- 172.21.15.72:0/3479020831 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e8009f650 0x7f3e801a2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e7ffff700 1 -- 172.21.15.72:0/3479020831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e8009f240 msgr2=0x7f3e801a2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e7ffff700 1 --2- 172.21.15.72:0/3479020831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e8009f240 0x7f3e801a2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e7ffff700 1 -- 172.21.15.72:0/3479020831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7000d940 con 0x7f3e8009e930 2023-10-03T10:17:10.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e7ffff700 1 --2- 172.21.15.72:0/3479020831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e8009e930 0x7f3e801a1d10 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f3e70012ed0 tx=0x7f3e7000f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e7cff9700 1 -- 172.21.15.72:0/3479020831 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70014040 con 0x7f3e8009e930 2023-10-03T10:17:10.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e7cff9700 1 -- 172.21.15.72:0/3479020831 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7000faf0 con 0x7f3e8009e930 2023-10-03T10:17:10.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e8634f700 1 -- 172.21.15.72:0/3479020831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e78009b30 con 0x7f3e8009e930 2023-10-03T10:17:10.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e7cff9700 1 -- 172.21.15.72:0/3479020831 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000dea0 con 0x7f3e8009e930 2023-10-03T10:17:10.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.642+0000 7f3e8634f700 1 -- 172.21.15.72:0/3479020831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e680094a0 con 0x7f3e8009e930 2023-10-03T10:17:10.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.643+0000 7f3e7cff9700 1 -- 172.21.15.72:0/3479020831 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e7000b450 con 0x7f3e8009e930 2023-10-03T10:17:10.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.643+0000 7f3e7cff9700 1 -- 172.21.15.72:0/3479020831 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3e700431c0 con 0x7f3e8009e930 2023-10-03T10:17:10.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.643+0000 7f3e8634f700 1 -- 172.21.15.72:0/3479020831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e800a1960 con 0x7f3e8009e930 2023-10-03T10:17:10.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.648+0000 7f3e7cff9700 1 -- 172.21.15.72:0/3479020831 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e7000fe60 con 0x7f3e8009e930 2023-10-03T10:17:10.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:10.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:10.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.833+0000 7fcc072d8700 1 Processor -- start 2023-10-03T10:17:10.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.833+0000 7fcc072d8700 1 -- start start 2023-10-03T10:17:10.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc072d8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc00131670 0x7fcc00131a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc072d8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc00131f80 0x7fcc0006efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc072d8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0009fc10 con 0x7fcc0006f510 2023-10-03T10:17:10.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc072d8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0009b960 con 0x7fcc00131f80 2023-10-03T10:17:10.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc072d8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00131470 con 0x7fcc00131670 2023-10-03T10:17:10.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc05074700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc00131670 0x7fcc00131a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc04873700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc00131f80 0x7fcc0006efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc05074700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc00131670 0x7fcc00131a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53296/0 (socket says 172.21.15.72:53296) 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc05875700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcc0006f510 0x7fcc001385e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33678/0 (socket says 172.21.15.72:33678) 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc04873700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc00131f80 0x7fcc0006efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43312/0 (socket says 172.21.15.72:43312) 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc05074700 1 -- 172.21.15.72:0/3262070410 learned_addr learned my addr 172.21.15.72:0/3262070410 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc04873700 1 -- 172.21.15.72:0/3262070410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc00131670 msgr2=0x7fcc00131a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc04873700 1 --2- 172.21.15.72:0/3262070410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc00131670 0x7fcc00131a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc04873700 1 -- 172.21.15.72:0/3262070410 >> v1:172.21.15.72:6789/0 conn(0x7fcc0006f510 legacy=0x7fcc001385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc04873700 1 -- 172.21.15.72:0/3262070410 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0009adb0 con 0x7fcc00131f80 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.834+0000 7fcc05074700 1 --2- 172.21.15.72:0/3262070410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc00131670 0x7fcc00131a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.835+0000 7fcc04873700 1 --2- 172.21.15.72:0/3262070410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc00131f80 0x7fcc0006efd0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009870 tx=0x7fcbf0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7270423d065a1a43 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.835+0000 7fcbf7fff700 1 -- 172.21.15.72:0/3262070410 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0011830 con 0x7fcc00131f80 2023-10-03T10:17:10.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.835+0000 7fcbf7fff700 1 -- 172.21.15.72:0/3262070410 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf0011990 con 0x7fcc00131f80 2023-10-03T10:17:10.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.835+0000 7fcbf7fff700 1 -- 172.21.15.72:0/3262070410 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0011d20 con 0x7fcc00131f80 2023-10-03T10:17:10.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.835+0000 7fcc072d8700 1 -- 172.21.15.72:0/3262070410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc00131f80 msgr2=0x7fcc0006efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.835+0000 7fcc072d8700 1 --2- 172.21.15.72:0/3262070410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc00131f80 0x7fcc0006efd0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009870 tx=0x7fcbf0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:10.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.835+0000 7fcc072d8700 1 -- 172.21.15.72:0/3262070410 shutdown_connections 2023-10-03T10:17:10.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.835+0000 7fcc072d8700 1 --2- 172.21.15.72:0/3262070410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc00131670 0x7fcc00131a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.835+0000 7fcc072d8700 1 --2- 172.21.15.72:0/3262070410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc00131f80 0x7fcc0006efd0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.835+0000 7fcc072d8700 1 -- 172.21.15.72:0/3262070410 >> 172.21.15.72:0/3262070410 conn(0x7fcc000a27f0 msgr2=0x7fcc000a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.836+0000 7fcc072d8700 1 -- 172.21.15.72:0/3262070410 shutdown_connections 2023-10-03T10:17:10.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.836+0000 7fcc072d8700 1 -- 172.21.15.72:0/3262070410 wait complete. 2023-10-03T10:17:10.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.836+0000 7fcc072d8700 1 Processor -- start 2023-10-03T10:17:10.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc072d8700 1 -- start start 2023-10-03T10:17:10.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc072d8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc0006f510 0x7fcc00070110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc072d8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc00131670 0x7fcc00070650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc072d8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc00131f80 0x7fcc00070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc072d8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00121370 con 0x7fcc00131670 2023-10-03T10:17:10.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc072d8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00071570 con 0x7fcc0006f510 2023-10-03T10:17:10.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc072d8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00120b00 con 0x7fcc00131f80 2023-10-03T10:17:10.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc04873700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc00131670 0x7fcc00070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc05074700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc0006f510 0x7fcc00070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc04873700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc00131670 0x7fcc00070650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53830/0 (socket says 172.21.15.72:53830) 2023-10-03T10:17:10.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc04873700 1 -- 172.21.15.72:0/1826030109 learned_addr learned my addr 172.21.15.72:0/1826030109 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:10.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc05875700 1 --2- 172.21.15.72:0/1826030109 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc00131f80 0x7fcc00070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc05074700 1 -- 172.21.15.72:0/1826030109 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc00131f80 msgr2=0x7fcc00070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc05074700 1 --2- 172.21.15.72:0/1826030109 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc00131f80 0x7fcc00070b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc05074700 1 -- 172.21.15.72:0/1826030109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc00131670 msgr2=0x7fcc00070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc05074700 1 --2- 172.21.15.72:0/1826030109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc00131670 0x7fcc00070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc05074700 1 -- 172.21.15.72:0/1826030109 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc009550 con 0x7fcc0006f510 2023-10-03T10:17:10.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.837+0000 7fcc04873700 1 --2- 172.21.15.72:0/1826030109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc00131670 0x7fcc00070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.838+0000 7fcc05074700 1 --2- 172.21.15.72:0/1826030109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc0006f510 0x7fcc00070110 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00e9a0 tx=0x7fcbfc00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.838+0000 7fcbf5ffb700 1 -- 172.21.15.72:0/1826030109 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc004030 con 0x7fcc0006f510 2023-10-03T10:17:10.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.838+0000 7fcbf5ffb700 1 -- 172.21.15.72:0/1826030109 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc004190 con 0x7fcc0006f510 2023-10-03T10:17:10.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.838+0000 7fcc072d8700 1 -- 172.21.15.72:0/1826030109 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf00094a0 con 0x7fcc0006f510 2023-10-03T10:17:10.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.838+0000 7fcbf5ffb700 1 -- 172.21.15.72:0/1826030109 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc004520 con 0x7fcc0006f510 2023-10-03T10:17:10.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.838+0000 7fcc072d8700 1 -- 172.21.15.72:0/1826030109 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc00120dd0 con 0x7fcc0006f510 2023-10-03T10:17:10.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.839+0000 7fcbf5ffb700 1 -- 172.21.15.72:0/1826030109 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcbfc0036a0 con 0x7fcc0006f510 2023-10-03T10:17:10.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.839+0000 7fcbf5ffb700 1 -- 172.21.15.72:0/1826030109 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcbfc00c6e0 con 0x7fcc0006f510 2023-10-03T10:17:10.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.839+0000 7fcc072d8700 1 -- 172.21.15.72:0/1826030109 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc001206b0 con 0x7fcc0006f510 2023-10-03T10:17:10.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.843+0000 7f3e8634f700 1 -- 172.21.15.72:0/3479020831 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3e801a5380 con 0x7f3e8009e930 2023-10-03T10:17:10.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.844+0000 7f3e7cff9700 1 -- 172.21.15.72:0/3479020831 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e7001f310 con 0x7f3e8009e930 2023-10-03T10:17:10.844 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:10.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.846+0000 7f3e8634f700 1 -- 172.21.15.72:0/3479020831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e8009e930 msgr2=0x7f3e801a1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.846+0000 7f3e8634f700 1 --2- 172.21.15.72:0/3479020831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e8009e930 0x7f3e801a1d10 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f3e70012ed0 tx=0x7f3e7000f390 comp rx=0 tx=0).stop 2023-10-03T10:17:10.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.846+0000 7f3e8634f700 1 -- 172.21.15.72:0/3479020831 shutdown_connections 2023-10-03T10:17:10.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.846+0000 7f3e8634f700 1 --2- 172.21.15.72:0/3479020831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e8009e930 0x7f3e801a1d10 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.846+0000 7f3e8634f700 1 --2- 172.21.15.72:0/3479020831 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3e8009f650 0x7f3e801a2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.846+0000 7f3e8634f700 1 --2- 172.21.15.72:0/3479020831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e8009f240 0x7f3e801a2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.846+0000 7f3e8634f700 1 -- 172.21.15.72:0/3479020831 >> 172.21.15.72:0/3479020831 conn(0x7f3e800a4210 msgr2=0x7f3e801b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.847+0000 7f3e8634f700 1 -- 172.21.15.72:0/3479020831 shutdown_connections 2023-10-03T10:17:10.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.848+0000 7fcbf5ffb700 1 -- 172.21.15.72:0/1826030109 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcbfc019d60 con 0x7fcc0006f510 2023-10-03T10:17:10.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.849+0000 7f3e8634f700 1 -- 172.21.15.72:0/3479020831 wait complete. 2023-10-03T10:17:10.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:10.867 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:10.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.881+0000 7f7ee4ba1700 1 Processor -- start 2023-10-03T10:17:10.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.881+0000 7f7ee4ba1700 1 -- start start 2023-10-03T10:17:10.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.881+0000 7f7ee4ba1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ee009bc50 0x7f7ee009c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.881+0000 7f7ee4ba1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee009c560 0x7f7ee0131470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.881+0000 7f7ee4ba1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee009d8a0 con 0x7f7ee01319b0 2023-10-03T10:17:10.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.881+0000 7f7ee4ba1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee006b490 con 0x7f7ee009bc50 2023-10-03T10:17:10.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.881+0000 7f7ee4ba1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee009e5e0 con 0x7f7ee009c560 2023-10-03T10:17:10.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.881+0000 7f7edeffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee009c560 0x7f7ee0131470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.881+0000 7f7edf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ee009bc50 0x7f7ee009c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.881+0000 7f7edeffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee009c560 0x7f7ee0131470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53304/0 (socket says 172.21.15.72:53304) 2023-10-03T10:17:10.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.881+0000 7f7edeffd700 1 -- 172.21.15.72:0/3860008043 learned_addr learned my addr 172.21.15.72:0/3860008043 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:10.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.882+0000 7f7edeffd700 1 -- 172.21.15.72:0/3860008043 >> v2:172.21.15.72:3300/0 conn(0x7f7ee009bc50 msgr2=0x7f7ee009c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.882+0000 7f7edeffd700 1 --2- 172.21.15.72:0/3860008043 >> v2:172.21.15.72:3300/0 conn(0x7f7ee009bc50 0x7f7ee009c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.882+0000 7f7edeffd700 1 -- 172.21.15.72:0/3860008043 >> v1:172.21.15.72:6789/0 conn(0x7f7ee01319b0 legacy=0x7f7ee0138730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.882+0000 7f7edeffd700 1 -- 172.21.15.72:0/3860008043 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee009e8a0 con 0x7f7ee009c560 2023-10-03T10:17:10.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.882+0000 7f7ede7fc700 1 -- 172.21.15.72:0/3860008043 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117995520 0 0) 0x7f7ee009d8a0 con 0x7f7ee01319b0 2023-10-03T10:17:10.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.882+0000 7f7edf7fe700 1 --2- 172.21.15.72:0/3860008043 >> v2:172.21.15.72:3300/0 conn(0x7f7ee009bc50 0x7f7ee009c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:10.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.882+0000 7f7edeffd700 1 --2- 172.21.15.72:0/3860008043 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee009c560 0x7f7ee0131470 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4006fd0 tx=0x7f7ed4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fb11d694b3fdf28 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.882+0000 7f7ede7fc700 1 -- 172.21.15.72:0/3860008043 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4005e30 con 0x7f7ee009c560 2023-10-03T10:17:10.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.882+0000 7f7ede7fc700 1 -- 172.21.15.72:0/3860008043 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed4004030 con 0x7f7ee009c560 2023-10-03T10:17:10.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.882+0000 7f7ede7fc700 1 -- 172.21.15.72:0/3860008043 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed40043e0 con 0x7f7ee009c560 2023-10-03T10:17:10.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.883+0000 7f7ee4ba1700 1 -- 172.21.15.72:0/3860008043 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee009c560 msgr2=0x7f7ee0131470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.883+0000 7f7ee4ba1700 1 --2- 172.21.15.72:0/3860008043 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee009c560 0x7f7ee0131470 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4006fd0 tx=0x7f7ed4009bd0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.883+0000 7f7ee4ba1700 1 -- 172.21.15.72:0/3860008043 shutdown_connections 2023-10-03T10:17:10.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.883+0000 7f7ee4ba1700 1 --2- 172.21.15.72:0/3860008043 >> v2:172.21.15.72:3300/0 conn(0x7f7ee009bc50 0x7f7ee009c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.883+0000 7f7ee4ba1700 1 --2- 172.21.15.72:0/3860008043 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee009c560 0x7f7ee0131470 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.883+0000 7f7ee4ba1700 1 -- 172.21.15.72:0/3860008043 >> 172.21.15.72:0/3860008043 conn(0x7f7ee00a2e20 msgr2=0x7f7ee00a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.883+0000 7f7ee4ba1700 1 -- 172.21.15.72:0/3860008043 shutdown_connections 2023-10-03T10:17:10.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.883+0000 7f7ee4ba1700 1 -- 172.21.15.72:0/3860008043 wait complete. 2023-10-03T10:17:10.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.884+0000 7f7ee4ba1700 1 Processor -- start 2023-10-03T10:17:10.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.884+0000 7f7ee4ba1700 1 -- start start 2023-10-03T10:17:10.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7ee4ba1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee009bc50 0x7f7ee0120de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7ee4ba1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ee009c560 0x7f7ee0121320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7ee4ba1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee01319b0 0x7f7ee01c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7ee4ba1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee01239f0 con 0x7f7ee01319b0 2023-10-03T10:17:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7ee4ba1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0124090 con 0x7f7ee009c560 2023-10-03T10:17:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7ee4ba1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee0122080 con 0x7f7ee009bc50 2023-10-03T10:17:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7edf7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee009bc50 0x7f7ee0120de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7edf7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee009bc50 0x7f7ee0120de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53316/0 (socket says 172.21.15.72:53316) 2023-10-03T10:17:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7edf7fe700 1 -- 172.21.15.72:0/2113152659 learned_addr learned my addr 172.21.15.72:0/2113152659 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7edffff700 1 --2- 172.21.15.72:0/2113152659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee01319b0 0x7f7ee01c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7edf7fe700 1 -- 172.21.15.72:0/2113152659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ee009c560 msgr2=0x7f7ee0121320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7edf7fe700 1 --2- 172.21.15.72:0/2113152659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ee009c560 0x7f7ee0121320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7edf7fe700 1 -- 172.21.15.72:0/2113152659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee01319b0 msgr2=0x7f7ee01c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7edf7fe700 1 --2- 172.21.15.72:0/2113152659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee01319b0 0x7f7ee01c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7edf7fe700 1 -- 172.21.15.72:0/2113152659 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed00094a0 con 0x7f7ee009bc50 2023-10-03T10:17:10.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7edf7fe700 1 --2- 172.21.15.72:0/2113152659 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee009bc50 0x7f7ee0120de0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000ebe0 tx=0x7f7ed000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.885+0000 7f7ec7fff700 1 -- 172.21.15.72:0/2113152659 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed000c910 con 0x7f7ee009bc50 2023-10-03T10:17:10.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.886+0000 7f7ec7fff700 1 -- 172.21.15.72:0/2113152659 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed000ca70 con 0x7f7ee009bc50 2023-10-03T10:17:10.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.886+0000 7f7ee4ba1700 1 -- 172.21.15.72:0/2113152659 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed4009500 con 0x7f7ee009bc50 2023-10-03T10:17:10.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.886+0000 7f7ec7fff700 1 -- 172.21.15.72:0/2113152659 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed000cde0 con 0x7f7ee009bc50 2023-10-03T10:17:10.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.886+0000 7f7ee4ba1700 1 -- 172.21.15.72:0/2113152659 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee0071ad0 con 0x7f7ee009bc50 2023-10-03T10:17:10.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.886+0000 7f7ec7fff700 1 -- 172.21.15.72:0/2113152659 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ed0013470 con 0x7f7ee009bc50 2023-10-03T10:17:10.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.887+0000 7f7ee4ba1700 1 -- 172.21.15.72:0/2113152659 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee0123ec0 con 0x7f7ee009bc50 2023-10-03T10:17:10.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.887+0000 7f7ec7fff700 1 -- 172.21.15.72:0/2113152659 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ed003fc50 con 0x7f7ee009bc50 2023-10-03T10:17:10.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.892+0000 7f7ec7fff700 1 -- 172.21.15.72:0/2113152659 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ed001b3b0 con 0x7f7ee009bc50 2023-10-03T10:17:10.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.991+0000 7f044377d700 1 Processor -- start 2023-10-03T10:17:10.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.991+0000 7f044377d700 1 -- start start 2023-10-03T10:17:10.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.992+0000 7f044377d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f043c136710 0x7f043c138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.992+0000 7f044377d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f043c139030 0x7f043c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.992+0000 7f044377d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c06ef30 con 0x7f043c1338a0 2023-10-03T10:17:10.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.992+0000 7f044377d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c06fef0 con 0x7f043c139030 2023-10-03T10:17:10.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.992+0000 7f044377d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1334b0 con 0x7f043c136710 2023-10-03T10:17:10.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.992+0000 7f0441d1a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f043c139030 0x7f043c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.992+0000 7f0440d18700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f043c136710 0x7f043c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.992+0000 7f0441d1a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f043c139030 0x7f043c13b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43336/0 (socket says 172.21.15.72:43336) 2023-10-03T10:17:10.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.992+0000 7f0441d1a700 1 -- 172.21.15.72:0/2583362502 learned_addr learned my addr 172.21.15.72:0/2583362502 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:10.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.992+0000 7f0441d1a700 1 -- 172.21.15.72:0/2583362502 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f043c136710 msgr2=0x7f043c138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.992+0000 7f0441d1a700 1 --2- 172.21.15.72:0/2583362502 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f043c136710 0x7f043c138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.992+0000 7f0441d1a700 1 -- 172.21.15.72:0/2583362502 >> v1:172.21.15.72:6789/0 conn(0x7f043c1338a0 legacy=0x7f043c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.992+0000 7f0441d1a700 1 -- 172.21.15.72:0/2583362502 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c06fc30 con 0x7f043c139030 2023-10-03T10:17:10.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.992+0000 7f0433fff700 1 -- 172.21.15.72:0/2583362502 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477172755 0 0) 0x7f043c06ef30 con 0x7f043c1338a0 2023-10-03T10:17:10.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.992+0000 7f0441d1a700 1 --2- 172.21.15.72:0/2583362502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f043c139030 0x7f043c13b410 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0434009e80 tx=0x7f043400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=317e270cdc73a6d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.993+0000 7f0433fff700 1 -- 172.21.15.72:0/2583362502 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043400e070 con 0x7f043c139030 2023-10-03T10:17:10.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.993+0000 7f0433fff700 1 -- 172.21.15.72:0/2583362502 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043400b910 con 0x7f043c139030 2023-10-03T10:17:10.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.993+0000 7f0433fff700 1 -- 172.21.15.72:0/2583362502 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043400bcc0 con 0x7f043c139030 2023-10-03T10:17:10.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.993+0000 7f044377d700 1 -- 172.21.15.72:0/2583362502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f043c139030 msgr2=0x7f043c13b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.993+0000 7f044377d700 1 --2- 172.21.15.72:0/2583362502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f043c139030 0x7f043c13b410 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0434009e80 tx=0x7f043400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:10.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.993+0000 7f044377d700 1 -- 172.21.15.72:0/2583362502 shutdown_connections 2023-10-03T10:17:10.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.993+0000 7f044377d700 1 --2- 172.21.15.72:0/2583362502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f043c139030 0x7f043c13b410 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.993+0000 7f044377d700 1 --2- 172.21.15.72:0/2583362502 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f043c136710 0x7f043c138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.993+0000 7f044377d700 1 -- 172.21.15.72:0/2583362502 >> 172.21.15.72:0/2583362502 conn(0x7f043c0a2aa0 msgr2=0x7f043c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.993+0000 7f044377d700 1 -- 172.21.15.72:0/2583362502 shutdown_connections 2023-10-03T10:17:10.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.993+0000 7f044377d700 1 -- 172.21.15.72:0/2583362502 wait complete. 2023-10-03T10:17:10.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.994+0000 7f044377d700 1 Processor -- start 2023-10-03T10:17:10.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.994+0000 7f044377d700 1 -- start start 2023-10-03T10:17:10.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f044377d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f043c1338a0 0x7f043c119d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f044377d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f043c136710 0x7f043c11a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f044377d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f043c139030 0x7f043c11a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f044377d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c11d4e0 con 0x7f043c1338a0 2023-10-03T10:17:10.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f044377d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c11d6c0 con 0x7f043c139030 2023-10-03T10:17:10.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f044377d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f043c138cb0 con 0x7f043c136710 2023-10-03T10:17:10.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f0441d1a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f043c139030 0x7f043c11a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f0441519700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f043c1338a0 0x7f043c119d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f0441d1a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f043c139030 0x7f043c11a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43342/0 (socket says 172.21.15.72:43342) 2023-10-03T10:17:10.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f0441d1a700 1 -- 172.21.15.72:0/3013909985 learned_addr learned my addr 172.21.15.72:0/3013909985 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:11.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f0440d18700 1 --2- 172.21.15.72:0/3013909985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f043c136710 0x7f043c11a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:11.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f0441d1a700 1 -- 172.21.15.72:0/3013909985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f043c136710 msgr2=0x7f043c11a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f0441d1a700 1 --2- 172.21.15.72:0/3013909985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f043c136710 0x7f043c11a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f0441d1a700 1 -- 172.21.15.72:0/3013909985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f043c1338a0 msgr2=0x7f043c119d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f0441d1a700 1 --2- 172.21.15.72:0/3013909985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f043c1338a0 0x7f043c119d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f0441d1a700 1 -- 172.21.15.72:0/3013909985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0434009b30 con 0x7f043c139030 2023-10-03T10:17:11.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f0441519700 1 --2- 172.21.15.72:0/3013909985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f043c1338a0 0x7f043c119d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:11.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f0441d1a700 1 --2- 172.21.15.72:0/3013909985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f043c139030 0x7f043c11a7a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f043400b680 tx=0x7f0434004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:11.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f0431ffb700 1 -- 172.21.15.72:0/3013909985 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434004450 con 0x7f043c139030 2023-10-03T10:17:11.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f0431ffb700 1 -- 172.21.15.72:0/3013909985 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04340045b0 con 0x7f043c139030 2023-10-03T10:17:11.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f0431ffb700 1 -- 172.21.15.72:0/3013909985 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434004940 con 0x7f043c139030 2023-10-03T10:17:11.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.995+0000 7f044377d700 1 -- 172.21.15.72:0/3013909985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c06f640 con 0x7f043c139030 2023-10-03T10:17:11.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.996+0000 7f044377d700 1 -- 172.21.15.72:0/3013909985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c11de50 con 0x7f043c139030 2023-10-03T10:17:11.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.996+0000 7f0431ffb700 1 -- 172.21.15.72:0/3013909985 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f043401c410 con 0x7f043c139030 2023-10-03T10:17:11.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.997+0000 7f0431ffb700 1 -- 172.21.15.72:0/3013909985 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0434041360 con 0x7f043c139030 2023-10-03T10:17:11.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:10.997+0000 7f044377d700 1 -- 172.21.15.72:0/3013909985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c074ea0 con 0x7f043c139030 2023-10-03T10:17:11.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.001+0000 7f0431ffb700 1 -- 172.21.15.72:0/3013909985 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f043401c6c0 con 0x7f043c139030 2023-10-03T10:17:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.044+0000 7fcc072d8700 1 -- 172.21.15.72:0/1826030109 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcc0009aff0 con 0x7fcc0006f510 2023-10-03T10:17:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.044+0000 7fcbf5ffb700 1 -- 172.21.15.72:0/1826030109 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcbfc032090 con 0x7fcc0006f510 2023-10-03T10:17:11.045 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.047+0000 7fcc072d8700 1 -- 172.21.15.72:0/1826030109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc0006f510 msgr2=0x7fcc00070110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.047+0000 7fcc072d8700 1 --2- 172.21.15.72:0/1826030109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc0006f510 0x7fcc00070110 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00e9a0 tx=0x7fcbfc00ecb0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.047+0000 7fcc072d8700 1 -- 172.21.15.72:0/1826030109 shutdown_connections 2023-10-03T10:17:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.047+0000 7fcc072d8700 1 --2- 172.21.15.72:0/1826030109 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc00131f80 0x7fcc00070b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.047+0000 7fcc072d8700 1 --2- 172.21.15.72:0/1826030109 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc0006f510 0x7fcc00070110 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.047+0000 7fcc072d8700 1 --2- 172.21.15.72:0/1826030109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc00131670 0x7fcc00070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.047+0000 7fcc072d8700 1 -- 172.21.15.72:0/1826030109 >> 172.21.15.72:0/1826030109 conn(0x7fcc000a27f0 msgr2=0x7fcc001b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.047+0000 7fcc072d8700 1 -- 172.21.15.72:0/1826030109 shutdown_connections 2023-10-03T10:17:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.047+0000 7fcc072d8700 1 -- 172.21.15.72:0/1826030109 wait complete. 2023-10-03T10:17:11.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:11.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.088+0000 7f7ee4ba1700 1 -- 172.21.15.72:0/2113152659 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7ee004f2a0 con 0x7f7ee009bc50 2023-10-03T10:17:11.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.088+0000 7f7ec7fff700 1 -- 172.21.15.72:0/2113152659 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7ed0011350 con 0x7f7ee009bc50 2023-10-03T10:17:11.089 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:11.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.090+0000 7f7ee4ba1700 1 -- 172.21.15.72:0/2113152659 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee009bc50 msgr2=0x7f7ee0120de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.090+0000 7f7ee4ba1700 1 --2- 172.21.15.72:0/2113152659 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee009bc50 0x7f7ee0120de0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000ebe0 tx=0x7f7ed000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.090+0000 7f7ee4ba1700 1 -- 172.21.15.72:0/2113152659 shutdown_connections 2023-10-03T10:17:11.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.090+0000 7f7ee4ba1700 1 --2- 172.21.15.72:0/2113152659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ee01319b0 0x7f7ee01c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.090+0000 7f7ee4ba1700 1 --2- 172.21.15.72:0/2113152659 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ee009bc50 0x7f7ee0120de0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.090+0000 7f7ee4ba1700 1 --2- 172.21.15.72:0/2113152659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ee009c560 0x7f7ee0121320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.090+0000 7f7ee4ba1700 1 -- 172.21.15.72:0/2113152659 >> 172.21.15.72:0/2113152659 conn(0x7f7ee00a2e20 msgr2=0x7f7ee00a19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.091+0000 7f7ee4ba1700 1 -- 172.21.15.72:0/2113152659 shutdown_connections 2023-10-03T10:17:11.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.091+0000 7f7ee4ba1700 1 -- 172.21.15.72:0/2113152659 wait complete. 2023-10-03T10:17:11.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:11.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.192+0000 7f044377d700 1 -- 172.21.15.72:0/3013909985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f043c06b9e0 con 0x7f043c139030 2023-10-03T10:17:11.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.192+0000 7f0431ffb700 1 -- 172.21.15.72:0/3013909985 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f043401bb90 con 0x7f043c139030 2023-10-03T10:17:11.193 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:11.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.194+0000 7f044377d700 1 -- 172.21.15.72:0/3013909985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f043c139030 msgr2=0x7f043c11a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.194+0000 7f044377d700 1 --2- 172.21.15.72:0/3013909985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f043c139030 0x7f043c11a7a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f043400b680 tx=0x7f0434004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.194+0000 7f044377d700 1 -- 172.21.15.72:0/3013909985 shutdown_connections 2023-10-03T10:17:11.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.194+0000 7f044377d700 1 --2- 172.21.15.72:0/3013909985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f043c1338a0 0x7f043c119d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.194+0000 7f044377d700 1 --2- 172.21.15.72:0/3013909985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f043c139030 0x7f043c11a7a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.194+0000 7f044377d700 1 --2- 172.21.15.72:0/3013909985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f043c136710 0x7f043c11a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.194+0000 7f044377d700 1 -- 172.21.15.72:0/3013909985 >> 172.21.15.72:0/3013909985 conn(0x7f043c0a2aa0 msgr2=0x7f043c130050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.194+0000 7f044377d700 1 -- 172.21.15.72:0/3013909985 shutdown_connections 2023-10-03T10:17:11.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.194+0000 7f044377d700 1 -- 172.21.15.72:0/3013909985 wait complete. 2023-10-03T10:17:11.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:11.862 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:11.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.997+0000 7f452eb3b700 1 Processor -- start 2023-10-03T10:17:12.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.997+0000 7f452eb3b700 1 -- start start 2023-10-03T10:17:12.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.997+0000 7f452eb3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f452809d6f0 0x7f452809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.997+0000 7f452eb3b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f452809e000 0x7f45281339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.997+0000 7f452eb3b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f452809e410 0x7f4528133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.997+0000 7f452eb3b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f452806b460 con 0x7f452809e000 2023-10-03T10:17:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.997+0000 7f452eb3b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452809b120 con 0x7f452809d6f0 2023-10-03T10:17:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.997+0000 7f452eb3b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f452809a7e0 con 0x7f452809e410 2023-10-03T10:17:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f4527fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f452809e000 0x7f45281339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f452c8d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f452809d6f0 0x7f452809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f452d0d8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f452809e410 0x7f4528133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f4527fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f452809e000 0x7f45281339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53850/0 (socket says 172.21.15.72:53850) 2023-10-03T10:17:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f452c8d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f452809d6f0 0x7f452809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43346/0 (socket says 172.21.15.72:43346) 2023-10-03T10:17:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f4527fff700 1 -- 172.21.15.72:0/1150482772 learned_addr learned my addr 172.21.15.72:0/1150482772 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f4527fff700 1 -- 172.21.15.72:0/1150482772 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f452809e410 msgr2=0x7f4528133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f4527fff700 1 --2- 172.21.15.72:0/1150482772 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f452809e410 0x7f4528133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f4527fff700 1 -- 172.21.15.72:0/1150482772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f452809d6f0 msgr2=0x7f452809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f4527fff700 1 --2- 172.21.15.72:0/1150482772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f452809d6f0 0x7f452809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f4527fff700 1 -- 172.21.15.72:0/1150482772 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452809a500 con 0x7f452809e000 2023-10-03T10:17:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f452c8d7700 1 --2- 172.21.15.72:0/1150482772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f452809d6f0 0x7f452809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f452d0d8700 1 --2- 172.21.15.72:0/1150482772 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f452809e410 0x7f4528133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f4527fff700 1 --2- 172.21.15.72:0/1150482772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f452809e000 0x7f45281339f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f45140098f0 tx=0x7f4514009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3031ef4f80b86 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f45277fe700 1 -- 172.21.15.72:0/1150482772 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514011830 con 0x7f452809e000 2023-10-03T10:17:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f45277fe700 1 -- 172.21.15.72:0/1150482772 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4514011990 con 0x7f452809e000 2023-10-03T10:17:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.998+0000 7f45277fe700 1 -- 172.21.15.72:0/1150482772 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514011d20 con 0x7f452809e000 2023-10-03T10:17:12.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.999+0000 7f452eb3b700 1 -- 172.21.15.72:0/1150482772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f452809e000 msgr2=0x7f45281339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.999+0000 7f452eb3b700 1 --2- 172.21.15.72:0/1150482772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f452809e000 0x7f45281339f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f45140098f0 tx=0x7f4514009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.999+0000 7f452eb3b700 1 -- 172.21.15.72:0/1150482772 shutdown_connections 2023-10-03T10:17:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.999+0000 7f452eb3b700 1 --2- 172.21.15.72:0/1150482772 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f452809e410 0x7f4528133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.999+0000 7f452eb3b700 1 --2- 172.21.15.72:0/1150482772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f452809d6f0 0x7f452809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.999+0000 7f452eb3b700 1 --2- 172.21.15.72:0/1150482772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f452809e000 0x7f45281339f0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.999+0000 7f452eb3b700 1 -- 172.21.15.72:0/1150482772 >> 172.21.15.72:0/1150482772 conn(0x7f4528066f50 msgr2=0x7f452809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.999+0000 7f452eb3b700 1 -- 172.21.15.72:0/1150482772 shutdown_connections 2023-10-03T10:17:12.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:11.999+0000 7f452eb3b700 1 -- 172.21.15.72:0/1150482772 wait complete. 2023-10-03T10:17:12.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.000+0000 7f452eb3b700 1 Processor -- start 2023-10-03T10:17:12.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.000+0000 7f452eb3b700 1 -- start start 2023-10-03T10:17:12.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.000+0000 7f452eb3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f452809d6f0 0x7f45281a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.000+0000 7f452eb3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f452809e000 0x7f45281a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.000+0000 7f452eb3b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f452809e410 0x7f45281a6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.000+0000 7f452eb3b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45281aa280 con 0x7f452809d6f0 2023-10-03T10:17:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.000+0000 7f452eb3b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45281a79b0 con 0x7f452809e000 2023-10-03T10:17:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.000+0000 7f452eb3b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45281a8c00 con 0x7f452809e410 2023-10-03T10:17:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.000+0000 7f4527fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f452809e000 0x7f45281a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f452c8d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f452809d6f0 0x7f45281a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f4527fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f452809e000 0x7f45281a62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43356/0 (socket says 172.21.15.72:43356) 2023-10-03T10:17:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f452d0d8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f452809e410 0x7f45281a6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f4527fff700 1 -- 172.21.15.72:0/294690572 learned_addr learned my addr 172.21.15.72:0/294690572 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:12.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f4527fff700 1 -- 172.21.15.72:0/294690572 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f452809e410 msgr2=0x7f45281a6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f4527fff700 1 --2- 172.21.15.72:0/294690572 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f452809e410 0x7f45281a6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f4527fff700 1 -- 172.21.15.72:0/294690572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f452809d6f0 msgr2=0x7f45281a5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f4527fff700 1 --2- 172.21.15.72:0/294690572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f452809d6f0 0x7f45281a5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f4527fff700 1 -- 172.21.15.72:0/294690572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c0094a0 con 0x7f452809e000 2023-10-03T10:17:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f452d0d8700 1 --2- 172.21.15.72:0/294690572 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f452809e410 0x7f45281a6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f4527fff700 1 --2- 172.21.15.72:0/294690572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f452809e000 0x7f45281a62e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4514009f50 tx=0x7f4514004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f45257fa700 1 -- 172.21.15.72:0/294690572 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514004240 con 0x7f452809e000 2023-10-03T10:17:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f45257fa700 1 -- 172.21.15.72:0/294690572 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451401f070 con 0x7f452809e000 2023-10-03T10:17:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f452eb3b700 1 -- 172.21.15.72:0/294690572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4520009a70 con 0x7f452809e000 2023-10-03T10:17:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f45257fa700 1 -- 172.21.15.72:0/294690572 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45140045a0 con 0x7f452809e000 2023-10-03T10:17:12.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.001+0000 7f452eb3b700 1 -- 172.21.15.72:0/294690572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4514009550 con 0x7f452809e000 2023-10-03T10:17:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.002+0000 7f45257fa700 1 -- 172.21.15.72:0/294690572 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4514021030 con 0x7f452809e000 2023-10-03T10:17:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.002+0000 7f45257fa700 1 -- 172.21.15.72:0/294690572 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4514040660 con 0x7f452809e000 2023-10-03T10:17:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.002+0000 7f452eb3b700 1 -- 172.21.15.72:0/294690572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452809c710 con 0x7f452809e000 2023-10-03T10:17:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.007+0000 7f45257fa700 1 -- 172.21.15.72:0/294690572 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f451401a450 con 0x7f452809e000 2023-10-03T10:17:12.061 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:12.104 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.184+0000 7fe28eb50700 1 Processor -- start 2023-10-03T10:17:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.184+0000 7fe28eb50700 1 -- start start 2023-10-03T10:17:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.185+0000 7fe28eb50700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe28809d6f0 0x7fe28809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.185+0000 7fe28eb50700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe28809e000 0x7fe2881339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.185+0000 7fe28eb50700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28809b120 con 0x7fe28809e410 2023-10-03T10:17:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.185+0000 7fe28eb50700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe28806b460 con 0x7fe28809d6f0 2023-10-03T10:17:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.185+0000 7fe28eb50700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe28809a7e0 con 0x7fe28809e000 2023-10-03T10:17:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.185+0000 7fe28c8ec700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe28809d6f0 0x7fe28809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.185+0000 7fe28c8ec700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe28809d6f0 0x7fe28809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53860/0 (socket says 172.21.15.72:53860) 2023-10-03T10:17:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.185+0000 7fe28c8ec700 1 -- 172.21.15.72:0/2742703794 learned_addr learned my addr 172.21.15.72:0/2742703794 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.185+0000 7fe287fff700 1 --2- 172.21.15.72:0/2742703794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe28809e000 0x7fe2881339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.185+0000 7fe287fff700 1 -- 172.21.15.72:0/2742703794 >> v2:172.21.15.72:3300/0 conn(0x7fe28809d6f0 msgr2=0x7fe28809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.185+0000 7fe287fff700 1 --2- 172.21.15.72:0/2742703794 >> v2:172.21.15.72:3300/0 conn(0x7fe28809d6f0 0x7fe28809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.185+0000 7fe287fff700 1 -- 172.21.15.72:0/2742703794 >> v1:172.21.15.72:6789/0 conn(0x7fe28809e410 legacy=0x7fe288133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.185+0000 7fe287fff700 1 -- 172.21.15.72:0/2742703794 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28809a500 con 0x7fe28809e000 2023-10-03T10:17:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.185+0000 7fe2877fe700 1 -- 172.21.15.72:0/2742703794 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487077379 0 0) 0x7fe28809b120 con 0x7fe28809e410 2023-10-03T10:17:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.186+0000 7fe287fff700 1 --2- 172.21.15.72:0/2742703794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe28809e000 0x7fe2881339f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe274009870 tx=0x7fe274009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c6f674cba10a214 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.186+0000 7fe2877fe700 1 -- 172.21.15.72:0/2742703794 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe274011830 con 0x7fe28809e000 2023-10-03T10:17:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.186+0000 7fe2877fe700 1 -- 172.21.15.72:0/2742703794 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe274011990 con 0x7fe28809e000 2023-10-03T10:17:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.186+0000 7fe2877fe700 1 -- 172.21.15.72:0/2742703794 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe274011d20 con 0x7fe28809e000 2023-10-03T10:17:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.186+0000 7fe28eb50700 1 -- 172.21.15.72:0/2742703794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe28809e000 msgr2=0x7fe2881339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.186+0000 7fe28eb50700 1 --2- 172.21.15.72:0/2742703794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe28809e000 0x7fe2881339f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe274009870 tx=0x7fe274009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.186+0000 7fe28eb50700 1 -- 172.21.15.72:0/2742703794 shutdown_connections 2023-10-03T10:17:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.186+0000 7fe28eb50700 1 --2- 172.21.15.72:0/2742703794 >> v2:172.21.15.72:3300/0 conn(0x7fe28809d6f0 0x7fe28809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.186+0000 7fe28eb50700 1 --2- 172.21.15.72:0/2742703794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe28809e000 0x7fe2881339f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.186+0000 7fe28eb50700 1 -- 172.21.15.72:0/2742703794 >> 172.21.15.72:0/2742703794 conn(0x7fe288066f50 msgr2=0x7fe28809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.186+0000 7fe28eb50700 1 -- 172.21.15.72:0/2742703794 shutdown_connections 2023-10-03T10:17:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.186+0000 7fe28eb50700 1 -- 172.21.15.72:0/2742703794 wait complete. 2023-10-03T10:17:12.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.188+0000 7fe28eb50700 1 Processor -- start 2023-10-03T10:17:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.188+0000 7fe28eb50700 1 -- start start 2023-10-03T10:17:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28eb50700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe28809d6f0 0x7fe2881b7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28eb50700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe28809e000 0x7fe2881b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28eb50700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe28809e410 0x7fe2881a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28eb50700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28809c780 con 0x7fe28809e410 2023-10-03T10:17:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28eb50700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2880a2d30 con 0x7fe28809e000 2023-10-03T10:17:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28eb50700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2881a5790 con 0x7fe28809d6f0 2023-10-03T10:17:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28c8ec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe28809d6f0 0x7fe2881b7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28c8ec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe28809d6f0 0x7fe2881b7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53364/0 (socket says 172.21.15.72:53364) 2023-10-03T10:17:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28c8ec700 1 -- 172.21.15.72:0/89298583 learned_addr learned my addr 172.21.15.72:0/89298583 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28d0ed700 1 --2- 172.21.15.72:0/89298583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe28809e410 0x7fe2881a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28c8ec700 1 -- 172.21.15.72:0/89298583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe28809e000 msgr2=0x7fe2881b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28c8ec700 1 --2- 172.21.15.72:0/89298583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe28809e000 0x7fe2881b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28c8ec700 1 -- 172.21.15.72:0/89298583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe28809e410 msgr2=0x7fe2881a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28c8ec700 1 --2- 172.21.15.72:0/89298583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe28809e410 0x7fe2881a35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28c8ec700 1 -- 172.21.15.72:0/89298583 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2740094a0 con 0x7fe28809d6f0 2023-10-03T10:17:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28c8ec700 1 --2- 172.21.15.72:0/89298583 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe28809d6f0 0x7fe2881b7410 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00e910 tx=0x7fe27c00ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe2857fa700 1 -- 172.21.15.72:0/89298583 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00ee60 con 0x7fe28809d6f0 2023-10-03T10:17:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe2857fa700 1 -- 172.21.15.72:0/89298583 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c00c850 con 0x7fe28809d6f0 2023-10-03T10:17:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28eb50700 1 -- 172.21.15.72:0/89298583 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2881a5350 con 0x7fe28809d6f0 2023-10-03T10:17:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe2857fa700 1 -- 172.21.15.72:0/89298583 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00cc00 con 0x7fe28809d6f0 2023-10-03T10:17:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.189+0000 7fe28eb50700 1 -- 172.21.15.72:0/89298583 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2881a6b90 con 0x7fe28809d6f0 2023-10-03T10:17:12.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.190+0000 7fe2857fa700 1 -- 172.21.15.72:0/89298583 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe27c00cd60 con 0x7fe28809d6f0 2023-10-03T10:17:12.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.191+0000 7fe28eb50700 1 -- 172.21.15.72:0/89298583 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe288074ea0 con 0x7fe28809d6f0 2023-10-03T10:17:12.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.191+0000 7fe2857fa700 1 -- 172.21.15.72:0/89298583 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe27c03fa10 con 0x7fe28809d6f0 2023-10-03T10:17:12.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.195+0000 7fe2857fa700 1 -- 172.21.15.72:0/89298583 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe27c017070 con 0x7fe28809d6f0 2023-10-03T10:17:12.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.201+0000 7f452eb3b700 1 -- 172.21.15.72:0/294690572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4528074ea0 con 0x7f452809e000 2023-10-03T10:17:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.201+0000 7f45257fa700 1 -- 172.21.15.72:0/294690572 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4514015030 con 0x7f452809e000 2023-10-03T10:17:12.202 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:12.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.205+0000 7f452eb3b700 1 -- 172.21.15.72:0/294690572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f452809e000 msgr2=0x7f45281a62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.205+0000 7f452eb3b700 1 --2- 172.21.15.72:0/294690572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f452809e000 0x7f45281a62e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4514009f50 tx=0x7f4514004750 comp rx=0 tx=0).stop 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.205+0000 7f452eb3b700 1 -- 172.21.15.72:0/294690572 shutdown_connections 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.205+0000 7f452eb3b700 1 --2- 172.21.15.72:0/294690572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f452809d6f0 0x7f45281a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.205+0000 7f452eb3b700 1 --2- 172.21.15.72:0/294690572 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f452809e410 0x7f45281a6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.205+0000 7f452eb3b700 1 --2- 172.21.15.72:0/294690572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f452809e000 0x7f45281a62e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.205+0000 7f452eb3b700 1 -- 172.21.15.72:0/294690572 >> 172.21.15.72:0/294690572 conn(0x7f4528066f50 msgr2=0x7f45281badd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.205+0000 7f452eb3b700 1 -- 172.21.15.72:0/294690572 shutdown_connections 2023-10-03T10:17:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.205+0000 7f452eb3b700 1 -- 172.21.15.72:0/294690572 wait complete. 2023-10-03T10:17:12.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:12.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:12.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.241+0000 7f2a29149700 1 Processor -- start 2023-10-03T10:17:12.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.241+0000 7f2a29149700 1 -- start start 2023-10-03T10:17:12.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.241+0000 7f2a29149700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a2409d6f0 0x7f2a2409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.241+0000 7f2a29149700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2409e000 0x7f2a241339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.241+0000 7f2a29149700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2409e410 0x7f2a24133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.241+0000 7f2a29149700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2406b460 con 0x7f2a2409d6f0 2023-10-03T10:17:12.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.241+0000 7f2a29149700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2409b120 con 0x7f2a2409e000 2023-10-03T10:17:12.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.241+0000 7f2a29149700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2409a7e0 con 0x7f2a2409e410 2023-10-03T10:17:12.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a2259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2409e000 0x7f2a241339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a2259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2409e000 0x7f2a241339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43388/0 (socket says 172.21.15.72:43388) 2023-10-03T10:17:12.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a2259c700 1 -- 172.21.15.72:0/2120839473 learned_addr learned my addr 172.21.15.72:0/2120839473 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:12.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a2359e700 1 --2- 172.21.15.72:0/2120839473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2409e410 0x7f2a24133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a22d9d700 1 --2- 172.21.15.72:0/2120839473 >> v2:172.21.15.72:3300/0 conn(0x7f2a2409d6f0 0x7f2a2409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a2259c700 1 -- 172.21.15.72:0/2120839473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2409e410 msgr2=0x7f2a24133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a2259c700 1 --2- 172.21.15.72:0/2120839473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2409e410 0x7f2a24133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a2259c700 1 -- 172.21.15.72:0/2120839473 >> v2:172.21.15.72:3300/0 conn(0x7f2a2409d6f0 msgr2=0x7f2a2409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a2259c700 1 --2- 172.21.15.72:0/2120839473 >> v2:172.21.15.72:3300/0 conn(0x7f2a2409d6f0 0x7f2a2409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a2259c700 1 -- 172.21.15.72:0/2120839473 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2409a500 con 0x7f2a2409e000 2023-10-03T10:17:12.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a22d9d700 1 --2- 172.21.15.72:0/2120839473 >> v2:172.21.15.72:3300/0 conn(0x7f2a2409d6f0 0x7f2a2409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a2359e700 1 --2- 172.21.15.72:0/2120839473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2409e410 0x7f2a24133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a2259c700 1 --2- 172.21.15.72:0/2120839473 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2409e000 0x7f2a241339f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009920 tx=0x7f2a18009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6523631c5830f41 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a21d9b700 1 -- 172.21.15.72:0/2120839473 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18011830 con 0x7f2a2409e000 2023-10-03T10:17:12.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a21d9b700 1 -- 172.21.15.72:0/2120839473 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a18011990 con 0x7f2a2409e000 2023-10-03T10:17:12.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.242+0000 7f2a21d9b700 1 -- 172.21.15.72:0/2120839473 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18011d20 con 0x7f2a2409e000 2023-10-03T10:17:12.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.243+0000 7f2a29149700 1 -- 172.21.15.72:0/2120839473 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2409e000 msgr2=0x7f2a241339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.243+0000 7f2a29149700 1 --2- 172.21.15.72:0/2120839473 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2409e000 0x7f2a241339f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009920 tx=0x7f2a18009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:12.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.243+0000 7f2a29149700 1 -- 172.21.15.72:0/2120839473 shutdown_connections 2023-10-03T10:17:12.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.243+0000 7f2a29149700 1 --2- 172.21.15.72:0/2120839473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2409e410 0x7f2a24133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.243+0000 7f2a29149700 1 --2- 172.21.15.72:0/2120839473 >> v2:172.21.15.72:3300/0 conn(0x7f2a2409d6f0 0x7f2a2409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.243+0000 7f2a29149700 1 --2- 172.21.15.72:0/2120839473 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2409e000 0x7f2a241339f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.243+0000 7f2a29149700 1 -- 172.21.15.72:0/2120839473 >> 172.21.15.72:0/2120839473 conn(0x7f2a24066f50 msgr2=0x7f2a2409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.243+0000 7f2a29149700 1 -- 172.21.15.72:0/2120839473 shutdown_connections 2023-10-03T10:17:12.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.243+0000 7f2a29149700 1 -- 172.21.15.72:0/2120839473 wait complete. 2023-10-03T10:17:12.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.244+0000 7f2a29149700 1 Processor -- start 2023-10-03T10:17:12.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.244+0000 7f2a29149700 1 -- start start 2023-10-03T10:17:12.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a29149700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2409d6f0 0x7f2a241a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a29149700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2409e000 0x7f2a241a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a29149700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2409e410 0x7f2a241a6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a29149700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a241a98e0 con 0x7f2a2409d6f0 2023-10-03T10:17:12.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a29149700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a241a7ff0 con 0x7f2a2409e000 2023-10-03T10:17:12.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a29149700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a241aa280 con 0x7f2a2409e410 2023-10-03T10:17:12.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a2259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2409e000 0x7f2a241a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a22d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2409d6f0 0x7f2a241a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a2259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2409e000 0x7f2a241a6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43398/0 (socket says 172.21.15.72:43398) 2023-10-03T10:17:12.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a22d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2409d6f0 0x7f2a241a5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53882/0 (socket says 172.21.15.72:53882) 2023-10-03T10:17:12.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a2259c700 1 -- 172.21.15.72:0/3884580661 learned_addr learned my addr 172.21.15.72:0/3884580661 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:12.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a2359e700 1 --2- 172.21.15.72:0/3884580661 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2409e410 0x7f2a241a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a2359e700 1 -- 172.21.15.72:0/3884580661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2409e000 msgr2=0x7f2a241a6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a2359e700 1 --2- 172.21.15.72:0/3884580661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2409e000 0x7f2a241a6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a2359e700 1 -- 172.21.15.72:0/3884580661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2409d6f0 msgr2=0x7f2a241a5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a2359e700 1 --2- 172.21.15.72:0/3884580661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2409d6f0 0x7f2a241a5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a2359e700 1 -- 172.21.15.72:0/3884580661 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a140094a0 con 0x7f2a2409e410 2023-10-03T10:17:12.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a22d9d700 1 --2- 172.21.15.72:0/3884580661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2409d6f0 0x7f2a241a5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a2359e700 1 --2- 172.21.15.72:0/3884580661 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2409e410 0x7f2a241a6840 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00efc0 tx=0x7f2a1c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.245+0000 7f2a0b7fe700 1 -- 172.21.15.72:0/3884580661 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00ca90 con 0x7f2a2409e410 2023-10-03T10:17:12.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.246+0000 7f2a0b7fe700 1 -- 172.21.15.72:0/3884580661 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c00f040 con 0x7f2a2409e410 2023-10-03T10:17:12.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.246+0000 7f2a0b7fe700 1 -- 172.21.15.72:0/3884580661 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00ce30 con 0x7f2a2409e410 2023-10-03T10:17:12.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.246+0000 7f2a29149700 1 -- 172.21.15.72:0/3884580661 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1c009a70 con 0x7f2a2409e410 2023-10-03T10:17:12.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.246+0000 7f2a29149700 1 -- 172.21.15.72:0/3884580661 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a18009550 con 0x7f2a2409e410 2023-10-03T10:17:12.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.246+0000 7f2a0b7fe700 1 -- 172.21.15.72:0/3884580661 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a1c014480 con 0x7f2a2409e410 2023-10-03T10:17:12.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.247+0000 7f2a0b7fe700 1 -- 172.21.15.72:0/3884580661 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2a1c03fd30 con 0x7f2a2409e410 2023-10-03T10:17:12.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.247+0000 7f2a29149700 1 -- 172.21.15.72:0/3884580661 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a240a2000 con 0x7f2a2409e410 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.256+0000 7f2a0b7fe700 1 -- 172.21.15.72:0/3884580661 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a1c012930 con 0x7f2a2409e410 2023-10-03T10:17:12.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.334+0000 7f2d3aa8c700 1 Processor -- start 2023-10-03T10:17:12.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.334+0000 7f2d3aa8c700 1 -- start start 2023-10-03T10:17:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.335+0000 7f2d3aa8c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2d340a0a30 0x7f2d340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.335+0000 7f2d3aa8c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d3409d630 0x7f2d340a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.335+0000 7f2d3aa8c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d340a2a70 con 0x7f2d34133930 2023-10-03T10:17:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.335+0000 7f2d3aa8c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d340a01d0 con 0x7f2d340a0a30 2023-10-03T10:17:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.335+0000 7f2d3aa8c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3409e2b0 con 0x7f2d3409d630 2023-10-03T10:17:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.335+0000 7f2d33fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d3409d630 0x7f2d340a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.335+0000 7f2d33fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d3409d630 0x7f2d340a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53400/0 (socket says 172.21.15.72:53400) 2023-10-03T10:17:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.335+0000 7f2d33fff700 1 -- 172.21.15.72:0/1292609778 learned_addr learned my addr 172.21.15.72:0/1292609778 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.335+0000 7f2d38828700 1 --2- 172.21.15.72:0/1292609778 >> v2:172.21.15.72:3300/0 conn(0x7f2d340a0a30 0x7f2d340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.335+0000 7f2d38828700 1 -- 172.21.15.72:0/1292609778 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d3409d630 msgr2=0x7f2d340a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.335+0000 7f2d38828700 1 --2- 172.21.15.72:0/1292609778 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d3409d630 0x7f2d340a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.335+0000 7f2d38828700 1 -- 172.21.15.72:0/1292609778 >> v1:172.21.15.72:6789/0 conn(0x7f2d34133930 legacy=0x7f2d34133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.335+0000 7f2d38828700 1 -- 172.21.15.72:0/1292609778 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3409dc50 con 0x7f2d340a0a30 2023-10-03T10:17:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.335+0000 7f2d33fff700 1 --2- 172.21.15.72:0/1292609778 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d3409d630 0x7f2d340a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.336+0000 7f2d38828700 1 --2- 172.21.15.72:0/1292609778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d340a0a30 0x7f2d340a0e00 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009840 tx=0x7f2d28009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a45643a1a5a4b9b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.336+0000 7f2d337fe700 1 -- 172.21.15.72:0/1292609778 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28011830 con 0x7f2d340a0a30 2023-10-03T10:17:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.336+0000 7f2d337fe700 1 -- 172.21.15.72:0/1292609778 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d28011990 con 0x7f2d340a0a30 2023-10-03T10:17:12.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.336+0000 7f2d337fe700 1 -- 172.21.15.72:0/1292609778 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28011d20 con 0x7f2d340a0a30 2023-10-03T10:17:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.336+0000 7f2d3aa8c700 1 -- 172.21.15.72:0/1292609778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d340a0a30 msgr2=0x7f2d340a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.336+0000 7f2d3aa8c700 1 --2- 172.21.15.72:0/1292609778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d340a0a30 0x7f2d340a0e00 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009840 tx=0x7f2d28009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.336+0000 7f2d3aa8c700 1 -- 172.21.15.72:0/1292609778 shutdown_connections 2023-10-03T10:17:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.336+0000 7f2d3aa8c700 1 --2- 172.21.15.72:0/1292609778 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d340a0a30 0x7f2d340a0e00 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.336+0000 7f2d3aa8c700 1 --2- 172.21.15.72:0/1292609778 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d3409d630 0x7f2d340a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.336+0000 7f2d3aa8c700 1 -- 172.21.15.72:0/1292609778 >> 172.21.15.72:0/1292609778 conn(0x7f2d340a3050 msgr2=0x7f2d340a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.336+0000 7f2d3aa8c700 1 -- 172.21.15.72:0/1292609778 shutdown_connections 2023-10-03T10:17:12.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.336+0000 7f2d3aa8c700 1 -- 172.21.15.72:0/1292609778 wait complete. 2023-10-03T10:17:12.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.338+0000 7f2d3aa8c700 1 Processor -- start 2023-10-03T10:17:12.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.338+0000 7f2d3aa8c700 1 -- start start 2023-10-03T10:17:12.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.338+0000 7f2d3aa8c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d3409d630 0x7f2d341c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.338+0000 7f2d3aa8c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d340a0a30 0x7f2d341c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.338+0000 7f2d3aa8c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d34133930 0x7f2d341c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d3aa8c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3411eea0 con 0x7f2d340a0a30 2023-10-03T10:17:12.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d3aa8c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d341207f0 con 0x7f2d3409d630 2023-10-03T10:17:12.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d3aa8c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34120600 con 0x7f2d34133930 2023-10-03T10:17:12.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d33fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d340a0a30 0x7f2d341c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d33fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d340a0a30 0x7f2d341c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53908/0 (socket says 172.21.15.72:53908) 2023-10-03T10:17:12.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d33fff700 1 -- 172.21.15.72:0/1324090614 learned_addr learned my addr 172.21.15.72:0/1324090614 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:12.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d38828700 1 --2- 172.21.15.72:0/1324090614 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d3409d630 0x7f2d341c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d39029700 1 --2- 172.21.15.72:0/1324090614 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d34133930 0x7f2d341c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d33fff700 1 -- 172.21.15.72:0/1324090614 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d34133930 msgr2=0x7f2d341c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d33fff700 1 --2- 172.21.15.72:0/1324090614 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d34133930 0x7f2d341c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d33fff700 1 -- 172.21.15.72:0/1324090614 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d3409d630 msgr2=0x7f2d341c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d33fff700 1 --2- 172.21.15.72:0/1324090614 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d3409d630 0x7f2d341c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d33fff700 1 -- 172.21.15.72:0/1324090614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d20009550 con 0x7f2d340a0a30 2023-10-03T10:17:12.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d39029700 1 --2- 172.21.15.72:0/1324090614 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d34133930 0x7f2d341c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d33fff700 1 --2- 172.21.15.72:0/1324090614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d340a0a30 0x7f2d341c8660 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000ebe0 tx=0x7f2d2000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d317fa700 1 -- 172.21.15.72:0/1324090614 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000c850 con 0x7f2d340a0a30 2023-10-03T10:17:12.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d3aa8c700 1 -- 172.21.15.72:0/1324090614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d280094a0 con 0x7f2d340a0a30 2023-10-03T10:17:12.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d317fa700 1 -- 172.21.15.72:0/1324090614 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2000c9b0 con 0x7f2d340a0a30 2023-10-03T10:17:12.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d317fa700 1 -- 172.21.15.72:0/1324090614 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000cd40 con 0x7f2d340a0a30 2023-10-03T10:17:12.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.339+0000 7f2d3aa8c700 1 -- 172.21.15.72:0/1324090614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d34122230 con 0x7f2d340a0a30 2023-10-03T10:17:12.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.340+0000 7f2d317fa700 1 -- 172.21.15.72:0/1324090614 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d20013470 con 0x7f2d340a0a30 2023-10-03T10:17:12.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.340+0000 7f2d317fa700 1 -- 172.21.15.72:0/1324090614 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2d2003f890 con 0x7f2d340a0a30 2023-10-03T10:17:12.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.341+0000 7f2d3aa8c700 1 -- 172.21.15.72:0/1324090614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d34122420 con 0x7f2d340a0a30 2023-10-03T10:17:12.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.345+0000 7f2d317fa700 1 -- 172.21.15.72:0/1324090614 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d200232f0 con 0x7f2d340a0a30 2023-10-03T10:17:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.407+0000 7fe28eb50700 1 -- 172.21.15.72:0/89298583 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe2881b7e90 con 0x7fe28809d6f0 2023-10-03T10:17:12.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.407+0000 7fe2857fa700 1 -- 172.21.15.72:0/89298583 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe27c021070 con 0x7fe28809d6f0 2023-10-03T10:17:12.408 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.409+0000 7fe28eb50700 1 -- 172.21.15.72:0/89298583 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe28809d6f0 msgr2=0x7fe2881b7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.409+0000 7fe28eb50700 1 --2- 172.21.15.72:0/89298583 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe28809d6f0 0x7fe2881b7410 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00e910 tx=0x7fe27c00ec20 comp rx=0 tx=0).stop 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.409+0000 7fe28eb50700 1 -- 172.21.15.72:0/89298583 shutdown_connections 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.409+0000 7fe28eb50700 1 --2- 172.21.15.72:0/89298583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe28809e410 0x7fe2881a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.409+0000 7fe28eb50700 1 --2- 172.21.15.72:0/89298583 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe28809d6f0 0x7fe2881b7410 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.409+0000 7fe28eb50700 1 --2- 172.21.15.72:0/89298583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe28809e000 0x7fe2881b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.409+0000 7fe28eb50700 1 -- 172.21.15.72:0/89298583 >> 172.21.15.72:0/89298583 conn(0x7fe288066f50 msgr2=0x7fe2881bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.409+0000 7fe28eb50700 1 -- 172.21.15.72:0/89298583 shutdown_connections 2023-10-03T10:17:12.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.409+0000 7fe28eb50700 1 -- 172.21.15.72:0/89298583 wait complete. 2023-10-03T10:17:12.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:12.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.452+0000 7f2a29149700 1 -- 172.21.15.72:0/3884580661 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2a24074ea0 con 0x7f2a2409e410 2023-10-03T10:17:12.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.452+0000 7f2a0b7fe700 1 -- 172.21.15.72:0/3884580661 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2a1c012340 con 0x7f2a2409e410 2023-10-03T10:17:12.453 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:12.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.454+0000 7f2a29149700 1 -- 172.21.15.72:0/3884580661 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2409e410 msgr2=0x7f2a241a6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.454+0000 7f2a29149700 1 --2- 172.21.15.72:0/3884580661 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2409e410 0x7f2a241a6840 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00efc0 tx=0x7f2a1c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.454+0000 7f2a29149700 1 -- 172.21.15.72:0/3884580661 shutdown_connections 2023-10-03T10:17:12.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.454+0000 7f2a29149700 1 --2- 172.21.15.72:0/3884580661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a2409d6f0 0x7f2a241a5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.454+0000 7f2a29149700 1 --2- 172.21.15.72:0/3884580661 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a2409e410 0x7f2a241a6840 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.454+0000 7f2a29149700 1 --2- 172.21.15.72:0/3884580661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a2409e000 0x7f2a241a6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.454+0000 7f2a29149700 1 -- 172.21.15.72:0/3884580661 >> 172.21.15.72:0/3884580661 conn(0x7f2a24066f50 msgr2=0x7f2a241bab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.455+0000 7f2a29149700 1 -- 172.21.15.72:0/3884580661 shutdown_connections 2023-10-03T10:17:12.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.455+0000 7f2a29149700 1 -- 172.21.15.72:0/3884580661 wait complete. 2023-10-03T10:17:12.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:12.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.537+0000 7f2d3aa8c700 1 -- 172.21.15.72:0/1324090614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2d34121eb0 con 0x7f2d340a0a30 2023-10-03T10:17:12.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.537+0000 7f2d317fa700 1 -- 172.21.15.72:0/1324090614 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d20021030 con 0x7f2d340a0a30 2023-10-03T10:17:12.538 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:12.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.540+0000 7f2d3aa8c700 1 -- 172.21.15.72:0/1324090614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d340a0a30 msgr2=0x7f2d341c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.540+0000 7f2d3aa8c700 1 --2- 172.21.15.72:0/1324090614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d340a0a30 0x7f2d341c8660 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000ebe0 tx=0x7f2d2000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.540+0000 7f2d3aa8c700 1 -- 172.21.15.72:0/1324090614 shutdown_connections 2023-10-03T10:17:12.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.540+0000 7f2d3aa8c700 1 --2- 172.21.15.72:0/1324090614 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d34133930 0x7f2d341c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.540+0000 7f2d3aa8c700 1 --2- 172.21.15.72:0/1324090614 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d3409d630 0x7f2d341c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.540+0000 7f2d3aa8c700 1 --2- 172.21.15.72:0/1324090614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d340a0a30 0x7f2d341c8660 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.540+0000 7f2d3aa8c700 1 -- 172.21.15.72:0/1324090614 >> 172.21.15.72:0/1324090614 conn(0x7f2d340a3050 msgr2=0x7f2d3409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.540+0000 7f2d3aa8c700 1 -- 172.21.15.72:0/1324090614 shutdown_connections 2023-10-03T10:17:12.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:12.540+0000 7f2d3aa8c700 1 -- 172.21.15.72:0/1324090614 wait complete. 2023-10-03T10:17:12.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:13.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:13.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.350+0000 7ff100cf4700 1 Processor -- start 2023-10-03T10:17:13.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.350+0000 7ff100cf4700 1 -- start start 2023-10-03T10:17:13.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff100cf4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0fc09e1d0 0x7ff0fc135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff100cf4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff0fc135e50 0x7ff0fc138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff100cf4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc09f130 con 0x7ff0fc09d6f0 2023-10-03T10:17:13.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff100cf4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0fc09f520 con 0x7ff0fc135e50 2023-10-03T10:17:13.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff100cf4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc09e930 con 0x7ff0fc09e1d0 2023-10-03T10:17:13.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff0f9d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0fc09e1d0 0x7ff0fc135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff0fa59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff0fc09d6f0 0x7ff0fc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33732/0 (socket says 172.21.15.72:33732) 2023-10-03T10:17:13.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff0fad9d700 1 --2- 172.21.15.72:0/508619225 >> v2:172.21.15.72:3300/0 conn(0x7ff0fc135e50 0x7ff0fc138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff0fa59c700 1 -- 172.21.15.72:0/508619225 learned_addr learned my addr 172.21.15.72:0/508619225 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:13.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff0f9d9b700 1 -- 172.21.15.72:0/508619225 >> v2:172.21.15.72:3300/0 conn(0x7ff0fc135e50 msgr2=0x7ff0fc138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff0f9d9b700 1 --2- 172.21.15.72:0/508619225 >> v2:172.21.15.72:3300/0 conn(0x7ff0fc135e50 0x7ff0fc138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff0f9d9b700 1 -- 172.21.15.72:0/508619225 >> v1:172.21.15.72:6789/0 conn(0x7ff0fc09d6f0 legacy=0x7ff0fc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff0f9d9b700 1 -- 172.21.15.72:0/508619225 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc09b2d0 con 0x7ff0fc09e1d0 2023-10-03T10:17:13.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff0f9d9b700 1 --2- 172.21.15.72:0/508619225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0fc09e1d0 0x7ff0fc135910 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009870 tx=0x7ff0ec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86df7607d6004a8e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff0f959a700 1 -- 172.21.15.72:0/508619225 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec011830 con 0x7ff0fc09e1d0 2023-10-03T10:17:13.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff0f959a700 1 -- 172.21.15.72:0/508619225 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec011990 con 0x7ff0fc09e1d0 2023-10-03T10:17:13.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.351+0000 7ff0f959a700 1 -- 172.21.15.72:0/508619225 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec011d20 con 0x7ff0fc09e1d0 2023-10-03T10:17:13.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.352+0000 7ff100cf4700 1 -- 172.21.15.72:0/508619225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0fc09e1d0 msgr2=0x7ff0fc135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.352+0000 7ff100cf4700 1 --2- 172.21.15.72:0/508619225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0fc09e1d0 0x7ff0fc135910 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009870 tx=0x7ff0ec009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:13.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.352+0000 7ff100cf4700 1 -- 172.21.15.72:0/508619225 shutdown_connections 2023-10-03T10:17:13.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.352+0000 7ff100cf4700 1 --2- 172.21.15.72:0/508619225 >> v2:172.21.15.72:3300/0 conn(0x7ff0fc135e50 0x7ff0fc138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.352+0000 7ff100cf4700 1 --2- 172.21.15.72:0/508619225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0fc09e1d0 0x7ff0fc135910 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.352+0000 7ff100cf4700 1 -- 172.21.15.72:0/508619225 >> 172.21.15.72:0/508619225 conn(0x7ff0fc066f50 msgr2=0x7ff0fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.352+0000 7ff100cf4700 1 -- 172.21.15.72:0/508619225 shutdown_connections 2023-10-03T10:17:13.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.352+0000 7ff100cf4700 1 -- 172.21.15.72:0/508619225 wait complete. 2023-10-03T10:17:13.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.353+0000 7ff100cf4700 1 Processor -- start 2023-10-03T10:17:13.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.353+0000 7ff100cf4700 1 -- start start 2023-10-03T10:17:13.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.353+0000 7ff100cf4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0fc09d6f0 0x7ff0fc1c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.353+0000 7ff100cf4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0fc09e1d0 0x7ff0fc1c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.353+0000 7ff100cf4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0fc135e50 0x7ff0fc1c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.353+0000 7ff100cf4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc122bc0 con 0x7ff0fc09d6f0 2023-10-03T10:17:13.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.353+0000 7ff100cf4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc09c770 con 0x7ff0fc135e50 2023-10-03T10:17:13.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.353+0000 7ff100cf4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc122720 con 0x7ff0fc09e1d0 2023-10-03T10:17:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff0fa59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0fc09d6f0 0x7ff0fc1c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff0fad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0fc135e50 0x7ff0fc1c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff0fa59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0fc09d6f0 0x7ff0fc1c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53924/0 (socket says 172.21.15.72:53924) 2023-10-03T10:17:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff0fa59c700 1 -- 172.21.15.72:0/1246110031 learned_addr learned my addr 172.21.15.72:0/1246110031 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff0f9d9b700 1 --2- 172.21.15.72:0/1246110031 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0fc09e1d0 0x7ff0fc1c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff0fa59c700 1 -- 172.21.15.72:0/1246110031 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0fc09e1d0 msgr2=0x7ff0fc1c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff0fa59c700 1 --2- 172.21.15.72:0/1246110031 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0fc09e1d0 0x7ff0fc1c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff0fa59c700 1 -- 172.21.15.72:0/1246110031 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0fc135e50 msgr2=0x7ff0fc1c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff0fa59c700 1 --2- 172.21.15.72:0/1246110031 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0fc135e50 0x7ff0fc1c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff0fa59c700 1 -- 172.21.15.72:0/1246110031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec0094a0 con 0x7ff0fc09d6f0 2023-10-03T10:17:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff0fad9d700 1 --2- 172.21.15.72:0/1246110031 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0fc135e50 0x7ff0fc1c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff0fa59c700 1 --2- 172.21.15.72:0/1246110031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0fc09d6f0 0x7ff0fc1c8280 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000c550 tx=0x7ff0f000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff0eaffd700 1 -- 172.21.15.72:0/1246110031 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0005d70 con 0x7ff0fc09d6f0 2023-10-03T10:17:13.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff0eaffd700 1 -- 172.21.15.72:0/1246110031 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f00070d0 con 0x7ff0fc09d6f0 2023-10-03T10:17:13.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff0eaffd700 1 -- 172.21.15.72:0/1246110031 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0007440 con 0x7ff0fc09d6f0 2023-10-03T10:17:13.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff100cf4700 1 -- 172.21.15.72:0/1246110031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0fc1244b0 con 0x7ff0fc09d6f0 2023-10-03T10:17:13.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.354+0000 7ff100cf4700 1 -- 172.21.15.72:0/1246110031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc122d90 con 0x7ff0fc09d6f0 2023-10-03T10:17:13.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.355+0000 7ff0eaffd700 1 -- 172.21.15.72:0/1246110031 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff0f00075a0 con 0x7ff0fc09d6f0 2023-10-03T10:17:13.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.355+0000 7ff0eaffd700 1 -- 172.21.15.72:0/1246110031 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff0f003ea30 con 0x7ff0fc09d6f0 2023-10-03T10:17:13.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.355+0000 7ff100cf4700 1 -- 172.21.15.72:0/1246110031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc074ea0 con 0x7ff0fc09d6f0 2023-10-03T10:17:13.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.360+0000 7ff0eaffd700 1 -- 172.21.15.72:0/1246110031 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0f0017020 con 0x7ff0fc09d6f0 2023-10-03T10:17:13.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:13.467 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.549+0000 7fe8fd5d4700 1 Processor -- start 2023-10-03T10:17:13.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.549+0000 7fe8fd5d4700 1 -- start start 2023-10-03T10:17:13.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.549+0000 7fe8fd5d4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8f809e930 0x7fe8f809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.549+0000 7fe8fd5d4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8f809f240 0x7fe8f81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.549+0000 7fe8fd5d4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f8070940 con 0x7fe8f809f650 2023-10-03T10:17:13.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.549+0000 7fe8fd5d4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f806fd60 con 0x7fe8f809e930 2023-10-03T10:17:13.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.549+0000 7fe8fd5d4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f806fa80 con 0x7fe8f809f240 2023-10-03T10:17:13.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.549+0000 7fe8f67fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8f809f240 0x7fe8f81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.549+0000 7fe8f77fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe8f809f650 0x7fe8f8131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33744/0 (socket says 172.21.15.72:33744) 2023-10-03T10:17:13.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.549+0000 7fe8f6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8f809e930 0x7fe8f809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.549+0000 7fe8f77fe700 1 -- 172.21.15.72:0/3565171832 learned_addr learned my addr 172.21.15.72:0/3565171832 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:13.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.550+0000 7fe8f5ffb700 1 -- 172.21.15.72:0/3565171832 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746418012 0 0) 0x7fe8f8070940 con 0x7fe8f809f650 2023-10-03T10:17:13.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.550+0000 7fe8f5ffb700 1 -- 172.21.15.72:0/3565171832 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8e00035b0 con 0x7fe8f809f650 2023-10-03T10:17:13.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.550+0000 7fe8f67fc700 1 -- 172.21.15.72:0/3565171832 >> v2:172.21.15.72:3300/0 conn(0x7fe8f809e930 msgr2=0x7fe8f809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.550+0000 7fe8f67fc700 1 --2- 172.21.15.72:0/3565171832 >> v2:172.21.15.72:3300/0 conn(0x7fe8f809e930 0x7fe8f809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.550+0000 7fe8f67fc700 1 -- 172.21.15.72:0/3565171832 >> v1:172.21.15.72:6789/0 conn(0x7fe8f809f650 legacy=0x7fe8f8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.550+0000 7fe8f67fc700 1 -- 172.21.15.72:0/3565171832 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f809fb60 con 0x7fe8f809f240 2023-10-03T10:17:13.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.550+0000 7fe8f67fc700 1 --2- 172.21.15.72:0/3565171832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8f809f240 0x7fe8f81317f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009840 tx=0x7fe8ec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38fb85452de7d457 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.550+0000 7fe8f5ffb700 1 -- 172.21.15.72:0/3565171832 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec011830 con 0x7fe8f809f240 2023-10-03T10:17:13.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.550+0000 7fe8f5ffb700 1 -- 172.21.15.72:0/3565171832 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ec011990 con 0x7fe8f809f240 2023-10-03T10:17:13.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.550+0000 7fe8f5ffb700 1 -- 172.21.15.72:0/3565171832 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec011d00 con 0x7fe8f809f240 2023-10-03T10:17:13.552 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.551+0000 7fe8fd5d4700 1 -- 172.21.15.72:0/3565171832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8f809f240 msgr2=0x7fe8f81317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.551+0000 7fe8fd5d4700 1 --2- 172.21.15.72:0/3565171832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8f809f240 0x7fe8f81317f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009840 tx=0x7fe8ec009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.551+0000 7fe8fd5d4700 1 -- 172.21.15.72:0/3565171832 shutdown_connections 2023-10-03T10:17:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.551+0000 7fe8fd5d4700 1 --2- 172.21.15.72:0/3565171832 >> v2:172.21.15.72:3300/0 conn(0x7fe8f809e930 0x7fe8f809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.551+0000 7fe8fd5d4700 1 --2- 172.21.15.72:0/3565171832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8f809f240 0x7fe8f81317f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.551+0000 7fe8fd5d4700 1 -- 172.21.15.72:0/3565171832 >> 172.21.15.72:0/3565171832 conn(0x7fe8f80a4210 msgr2=0x7fe8f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.551+0000 7fe8fd5d4700 1 -- 172.21.15.72:0/3565171832 shutdown_connections 2023-10-03T10:17:13.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.551+0000 7fe8fd5d4700 1 -- 172.21.15.72:0/3565171832 wait complete. 2023-10-03T10:17:13.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.552+0000 7fe8fd5d4700 1 Processor -- start 2023-10-03T10:17:13.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.552+0000 7fe8fd5d4700 1 -- start start 2023-10-03T10:17:13.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8fd5d4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8f809e930 0x7fe8f81c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8fd5d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8f809f240 0x7fe8f81c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8fd5d4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8f809f650 0x7fe8f81c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8fd5d4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f8071d90 con 0x7fe8f809f240 2023-10-03T10:17:13.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8fd5d4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f81c6c80 con 0x7fe8f809f650 2023-10-03T10:17:13.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8fd5d4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f81a6830 con 0x7fe8f809e930 2023-10-03T10:17:13.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8f67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8f809f240 0x7fe8f81c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8f67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8f809f240 0x7fe8f81c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53932/0 (socket says 172.21.15.72:53932) 2023-10-03T10:17:13.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8f67fc700 1 -- 172.21.15.72:0/3242227044 learned_addr learned my addr 172.21.15.72:0/3242227044 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8f6ffd700 1 --2- 172.21.15.72:0/3242227044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8f809e930 0x7fe8f81c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8f77fe700 1 --2- 172.21.15.72:0/3242227044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8f809f650 0x7fe8f81c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8f67fc700 1 -- 172.21.15.72:0/3242227044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8f809e930 msgr2=0x7fe8f81c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8f67fc700 1 --2- 172.21.15.72:0/3242227044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8f809e930 0x7fe8f81c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8f67fc700 1 -- 172.21.15.72:0/3242227044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8f809f650 msgr2=0x7fe8f81c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8f67fc700 1 --2- 172.21.15.72:0/3242227044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8f809f650 0x7fe8f81c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8f67fc700 1 -- 172.21.15.72:0/3242227044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec0094a0 con 0x7fe8f809f240 2023-10-03T10:17:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.553+0000 7fe8f67fc700 1 --2- 172.21.15.72:0/3242227044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8f809f240 0x7fe8f81c6740 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009b90 tx=0x7fe8ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.554+0000 7fe8df7fe700 1 -- 172.21.15.72:0/3242227044 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec0043c0 con 0x7fe8f809f240 2023-10-03T10:17:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.554+0000 7fe8df7fe700 1 -- 172.21.15.72:0/3242227044 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ec01f070 con 0x7fe8f809f240 2023-10-03T10:17:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.554+0000 7fe8df7fe700 1 -- 172.21.15.72:0/3242227044 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec0036a0 con 0x7fe8f809f240 2023-10-03T10:17:13.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.554+0000 7fe8fd5d4700 1 -- 172.21.15.72:0/3242227044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f80a0190 con 0x7fe8f809f240 2023-10-03T10:17:13.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.554+0000 7fe8fd5d4700 1 -- 172.21.15.72:0/3242227044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f81a63e0 con 0x7fe8f809f240 2023-10-03T10:17:13.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.555+0000 7fe8df7fe700 1 -- 172.21.15.72:0/3242227044 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8ec021030 con 0x7fe8f809f240 2023-10-03T10:17:13.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.555+0000 7fe8fd5d4700 1 -- 172.21.15.72:0/3242227044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f8074ea0 con 0x7fe8f809f240 2023-10-03T10:17:13.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.555+0000 7fe8df7fe700 1 -- 172.21.15.72:0/3242227044 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe8ec040860 con 0x7fe8f809f240 2023-10-03T10:17:13.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.564+0000 7fe8df7fe700 1 -- 172.21.15.72:0/3242227044 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8ec003a90 con 0x7fe8f809f240 2023-10-03T10:17:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.569+0000 7ff100cf4700 1 -- 172.21.15.72:0/1246110031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff0fc06c360 con 0x7ff0fc09d6f0 2023-10-03T10:17:13.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.569+0000 7ff0eaffd700 1 -- 172.21.15.72:0/1246110031 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0f0019b40 con 0x7ff0fc09d6f0 2023-10-03T10:17:13.570 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:13.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.571+0000 7ff100cf4700 1 -- 172.21.15.72:0/1246110031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0fc09d6f0 msgr2=0x7ff0fc1c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.571+0000 7ff100cf4700 1 --2- 172.21.15.72:0/1246110031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0fc09d6f0 0x7ff0fc1c8280 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000c550 tx=0x7ff0f000c860 comp rx=0 tx=0).stop 2023-10-03T10:17:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.573+0000 7ff100cf4700 1 -- 172.21.15.72:0/1246110031 shutdown_connections 2023-10-03T10:17:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.573+0000 7ff100cf4700 1 --2- 172.21.15.72:0/1246110031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0fc09d6f0 0x7ff0fc1c8280 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.573+0000 7ff100cf4700 1 --2- 172.21.15.72:0/1246110031 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff0fc135e50 0x7ff0fc1c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.573+0000 7ff100cf4700 1 --2- 172.21.15.72:0/1246110031 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff0fc09e1d0 0x7ff0fc1c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.573+0000 7ff100cf4700 1 -- 172.21.15.72:0/1246110031 >> 172.21.15.72:0/1246110031 conn(0x7ff0fc066f50 msgr2=0x7ff0fc06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.573+0000 7ff100cf4700 1 -- 172.21.15.72:0/1246110031 shutdown_connections 2023-10-03T10:17:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.573+0000 7ff100cf4700 1 -- 172.21.15.72:0/1246110031 wait complete. 2023-10-03T10:17:13.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:13.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.601+0000 7f1b2e933700 1 Processor -- start 2023-10-03T10:17:13.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.601+0000 7f1b2e933700 1 -- start start 2023-10-03T10:17:13.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b2e933700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b2809e930 0x7f1b2809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b2e933700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b2809f650 0x7f1b28131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b2e933700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b28070940 con 0x7f1b2809f240 2023-10-03T10:17:13.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b2e933700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2806fd60 con 0x7f1b2809e930 2023-10-03T10:17:13.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b2e933700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2806fa80 con 0x7f1b2809f650 2023-10-03T10:17:13.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b2ced0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b2809f650 0x7f1b28131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b27fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b2809e930 0x7f1b2809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b2ced0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b2809f650 0x7f1b28131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53422/0 (socket says 172.21.15.72:53422) 2023-10-03T10:17:13.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b2ced0700 1 -- 172.21.15.72:0/725832152 learned_addr learned my addr 172.21.15.72:0/725832152 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:13.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b27fff700 1 -- 172.21.15.72:0/725832152 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b2809f650 msgr2=0x7f1b28131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b27fff700 1 --2- 172.21.15.72:0/725832152 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b2809f650 0x7f1b28131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b27fff700 1 -- 172.21.15.72:0/725832152 >> v1:172.21.15.72:6789/0 conn(0x7f1b2809f240 legacy=0x7f1b281317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b27fff700 1 -- 172.21.15.72:0/725832152 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2809fb60 con 0x7f1b2809e930 2023-10-03T10:17:13.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b26ffd700 1 -- 172.21.15.72:0/725832152 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578203661 0 0) 0x7f1b28070940 con 0x7f1b2809f240 2023-10-03T10:17:13.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b2ced0700 1 --2- 172.21.15.72:0/725832152 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b2809f650 0x7f1b28131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b27fff700 1 --2- 172.21.15.72:0/725832152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b2809e930 0x7f1b2809ed00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009870 tx=0x7f1b18009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3ed91bb34422a84 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b26ffd700 1 -- 172.21.15.72:0/725832152 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b18011830 con 0x7f1b2809e930 2023-10-03T10:17:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b26ffd700 1 -- 172.21.15.72:0/725832152 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b18011990 con 0x7f1b2809e930 2023-10-03T10:17:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.602+0000 7f1b26ffd700 1 -- 172.21.15.72:0/725832152 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b18011d20 con 0x7f1b2809e930 2023-10-03T10:17:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.603+0000 7f1b2e933700 1 -- 172.21.15.72:0/725832152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b2809e930 msgr2=0x7f1b2809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.603+0000 7f1b2e933700 1 --2- 172.21.15.72:0/725832152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b2809e930 0x7f1b2809ed00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009870 tx=0x7f1b18009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:13.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.603+0000 7f1b2e933700 1 -- 172.21.15.72:0/725832152 shutdown_connections 2023-10-03T10:17:13.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.603+0000 7f1b2e933700 1 --2- 172.21.15.72:0/725832152 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b2809f650 0x7f1b28131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.603+0000 7f1b2e933700 1 --2- 172.21.15.72:0/725832152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b2809e930 0x7f1b2809ed00 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.603+0000 7f1b2e933700 1 -- 172.21.15.72:0/725832152 >> 172.21.15.72:0/725832152 conn(0x7f1b280a4210 msgr2=0x7f1b280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.603+0000 7f1b2e933700 1 -- 172.21.15.72:0/725832152 shutdown_connections 2023-10-03T10:17:13.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.603+0000 7f1b2e933700 1 -- 172.21.15.72:0/725832152 wait complete. 2023-10-03T10:17:13.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.604+0000 7f1b2e933700 1 Processor -- start 2023-10-03T10:17:13.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.605+0000 7f1b2e933700 1 -- start start 2023-10-03T10:17:13.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.605+0000 7f1b2e933700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2809e930 0x7f1b281a3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.605+0000 7f1b2e933700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b2809f240 0x7f1b281a4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.605+0000 7f1b2e933700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b2809f650 0x7f1b281a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.605+0000 7f1b2e933700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b281a80a0 con 0x7f1b2809e930 2023-10-03T10:17:13.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.605+0000 7f1b2e933700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b281a57d0 con 0x7f1b2809f240 2023-10-03T10:17:13.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.605+0000 7f1b2e933700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b281a6a20 con 0x7f1b2809f650 2023-10-03T10:17:13.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.605+0000 7f1b277fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b2809f240 0x7f1b281a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.606+0000 7f1b277fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b2809f240 0x7f1b281a4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43464/0 (socket says 172.21.15.72:43464) 2023-10-03T10:17:13.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.606+0000 7f1b277fe700 1 -- 172.21.15.72:0/3206192714 learned_addr learned my addr 172.21.15.72:0/3206192714 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:13.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.606+0000 7f1b2ced0700 1 --2- 172.21.15.72:0/3206192714 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b2809f650 0x7f1b281a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.606+0000 7f1b27fff700 1 --2- 172.21.15.72:0/3206192714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2809e930 0x7f1b281a3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.606+0000 7f1b277fe700 1 -- 172.21.15.72:0/3206192714 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b2809f650 msgr2=0x7f1b281a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.606+0000 7f1b277fe700 1 --2- 172.21.15.72:0/3206192714 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b2809f650 0x7f1b281a4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.606+0000 7f1b277fe700 1 -- 172.21.15.72:0/3206192714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2809e930 msgr2=0x7f1b281a3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.606+0000 7f1b277fe700 1 --2- 172.21.15.72:0/3206192714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2809e930 0x7f1b281a3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.606+0000 7f1b277fe700 1 -- 172.21.15.72:0/3206192714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b20009b30 con 0x7f1b2809f240 2023-10-03T10:17:13.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.606+0000 7f1b277fe700 1 --2- 172.21.15.72:0/3206192714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b2809f240 0x7f1b281a4100 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00c580 tx=0x7f1b1c00c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.606+0000 7f1b24ff9700 1 -- 172.21.15.72:0/3206192714 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0054e0 con 0x7f1b2809f240 2023-10-03T10:17:13.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.606+0000 7f1b24ff9700 1 -- 172.21.15.72:0/3206192714 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c003680 con 0x7f1b2809f240 2023-10-03T10:17:13.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.606+0000 7f1b2e933700 1 -- 172.21.15.72:0/3206192714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b180094a0 con 0x7f1b2809f240 2023-10-03T10:17:13.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.606+0000 7f1b24ff9700 1 -- 172.21.15.72:0/3206192714 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c003a30 con 0x7f1b2809f240 2023-10-03T10:17:13.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.606+0000 7f1b2e933700 1 -- 172.21.15.72:0/3206192714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b280a0190 con 0x7f1b2809f240 2023-10-03T10:17:13.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.607+0000 7f1b24ff9700 1 -- 172.21.15.72:0/3206192714 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b1c003b90 con 0x7f1b2809f240 2023-10-03T10:17:13.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.607+0000 7f1b2e933700 1 -- 172.21.15.72:0/3206192714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b28071d20 con 0x7f1b2809f240 2023-10-03T10:17:13.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.607+0000 7f1b24ff9700 1 -- 172.21.15.72:0/3206192714 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1b1c03ea80 con 0x7f1b2809f240 2023-10-03T10:17:13.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.612+0000 7f1b24ff9700 1 -- 172.21.15.72:0/3206192714 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b1c003e40 con 0x7f1b2809f240 2023-10-03T10:17:13.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.683+0000 7fa14b625700 1 Processor -- start 2023-10-03T10:17:13.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.683+0000 7fa14b625700 1 -- start start 2023-10-03T10:17:13.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.683+0000 7fa14b625700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1440a0a30 0x7fa1440a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa14b625700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1440a1340 0x7fa144133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa14b625700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa14409edd0 con 0x7fa144133fa0 2023-10-03T10:17:13.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa14b625700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14409e1f0 con 0x7fa1440a1340 2023-10-03T10:17:13.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa14b625700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa14409dc50 con 0x7fa1440a0a30 2023-10-03T10:17:13.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa148bc0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1440a1340 0x7fa144133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa149bc2700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa144133fa0 0x7fa14413ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33762/0 (socket says 172.21.15.72:33762) 2023-10-03T10:17:13.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa148bc0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1440a1340 0x7fa144133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43474/0 (socket says 172.21.15.72:43474) 2023-10-03T10:17:13.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa149bc2700 1 -- 172.21.15.72:0/106962582 learned_addr learned my addr 172.21.15.72:0/106962582 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:13.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa1493c1700 1 --2- 172.21.15.72:0/106962582 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1440a0a30 0x7fa1440a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa148bc0700 1 -- 172.21.15.72:0/106962582 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1440a0a30 msgr2=0x7fa1440a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa148bc0700 1 --2- 172.21.15.72:0/106962582 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1440a0a30 0x7fa1440a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa148bc0700 1 -- 172.21.15.72:0/106962582 >> v1:172.21.15.72:6789/0 conn(0x7fa144133fa0 legacy=0x7fa14413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa13bfff700 1 -- 172.21.15.72:0/106962582 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153635500 0 0) 0x7fa14409edd0 con 0x7fa144133fa0 2023-10-03T10:17:13.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa148bc0700 1 -- 172.21.15.72:0/106962582 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1440a1fe0 con 0x7fa1440a1340 2023-10-03T10:17:13.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa1493c1700 1 --2- 172.21.15.72:0/106962582 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1440a0a30 0x7fa1440a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa148bc0700 1 --2- 172.21.15.72:0/106962582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1440a1340 0x7fa144133a60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa134009870 tx=0x7fa134009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dc678f22b436dcb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa13bfff700 1 -- 172.21.15.72:0/106962582 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa134011830 con 0x7fa1440a1340 2023-10-03T10:17:13.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa13bfff700 1 -- 172.21.15.72:0/106962582 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa134011990 con 0x7fa1440a1340 2023-10-03T10:17:13.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.684+0000 7fa13bfff700 1 -- 172.21.15.72:0/106962582 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa134011d20 con 0x7fa1440a1340 2023-10-03T10:17:13.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.685+0000 7fa14b625700 1 -- 172.21.15.72:0/106962582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1440a1340 msgr2=0x7fa144133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.685+0000 7fa14b625700 1 --2- 172.21.15.72:0/106962582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1440a1340 0x7fa144133a60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa134009870 tx=0x7fa134009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:13.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.685+0000 7fa14b625700 1 -- 172.21.15.72:0/106962582 shutdown_connections 2023-10-03T10:17:13.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.685+0000 7fa14b625700 1 --2- 172.21.15.72:0/106962582 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1440a0a30 0x7fa1440a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.685+0000 7fa14b625700 1 --2- 172.21.15.72:0/106962582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1440a1340 0x7fa144133a60 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.685+0000 7fa14b625700 1 -- 172.21.15.72:0/106962582 >> 172.21.15.72:0/106962582 conn(0x7fa1440a6550 msgr2=0x7fa1440a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.685+0000 7fa14b625700 1 -- 172.21.15.72:0/106962582 shutdown_connections 2023-10-03T10:17:13.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.685+0000 7fa14b625700 1 -- 172.21.15.72:0/106962582 wait complete. 2023-10-03T10:17:13.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.686+0000 7fa14b625700 1 Processor -- start 2023-10-03T10:17:13.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.686+0000 7fa14b625700 1 -- start start 2023-10-03T10:17:13.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.686+0000 7fa14b625700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1440a0a30 0x7fa1441c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.686+0000 7fa14b625700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1440a1340 0x7fa1441c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.686+0000 7fa14b625700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa144133fa0 0x7fa1441c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.686+0000 7fa14b625700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1440a0220 con 0x7fa1440a1340 2023-10-03T10:17:13.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.686+0000 7fa14b625700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa144125170 con 0x7fa1440a0a30 2023-10-03T10:17:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.686+0000 7fa14b625700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa144124ab0 con 0x7fa144133fa0 2023-10-03T10:17:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.687+0000 7fa1493c1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1440a0a30 0x7fa1441c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.687+0000 7fa1493c1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1440a0a30 0x7fa1441c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43490/0 (socket says 172.21.15.72:43490) 2023-10-03T10:17:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.687+0000 7fa1493c1700 1 -- 172.21.15.72:0/1554159736 learned_addr learned my addr 172.21.15.72:0/1554159736 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.687+0000 7fa149bc2700 1 --2- 172.21.15.72:0/1554159736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa144133fa0 0x7fa1441c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.687+0000 7fa148bc0700 1 --2- 172.21.15.72:0/1554159736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1440a1340 0x7fa1441c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.687+0000 7fa1493c1700 1 -- 172.21.15.72:0/1554159736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa144133fa0 msgr2=0x7fa1441c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.687+0000 7fa1493c1700 1 --2- 172.21.15.72:0/1554159736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa144133fa0 0x7fa1441c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.687+0000 7fa1493c1700 1 -- 172.21.15.72:0/1554159736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1440a1340 msgr2=0x7fa1441c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.687+0000 7fa1493c1700 1 --2- 172.21.15.72:0/1554159736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1440a1340 0x7fa1441c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.687+0000 7fa1493c1700 1 -- 172.21.15.72:0/1554159736 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1400094a0 con 0x7fa1440a0a30 2023-10-03T10:17:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.687+0000 7fa1493c1700 1 --2- 172.21.15.72:0/1554159736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1440a0a30 0x7fa1441c8280 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa14000ebe0 tx=0x7fa14000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.687+0000 7fa139ffb700 1 -- 172.21.15.72:0/1554159736 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000c850 con 0x7fa1440a0a30 2023-10-03T10:17:13.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.687+0000 7fa139ffb700 1 -- 172.21.15.72:0/1554159736 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14000c9b0 con 0x7fa1440a0a30 2023-10-03T10:17:13.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.687+0000 7fa14b625700 1 -- 172.21.15.72:0/1554159736 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1340094a0 con 0x7fa1440a0a30 2023-10-03T10:17:13.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.687+0000 7fa139ffb700 1 -- 172.21.15.72:0/1554159736 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000cd40 con 0x7fa1440a0a30 2023-10-03T10:17:13.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.688+0000 7fa14b625700 1 -- 172.21.15.72:0/1554159736 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1440a25e0 con 0x7fa1440a0a30 2023-10-03T10:17:13.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.689+0000 7fa139ffb700 1 -- 172.21.15.72:0/1554159736 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa140013470 con 0x7fa1440a0a30 2023-10-03T10:17:13.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.689+0000 7fa14b625700 1 -- 172.21.15.72:0/1554159736 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa144125dd0 con 0x7fa1440a0a30 2023-10-03T10:17:13.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.689+0000 7fa139ffb700 1 -- 172.21.15.72:0/1554159736 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa14003f7a0 con 0x7fa1440a0a30 2023-10-03T10:17:13.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.693+0000 7fa139ffb700 1 -- 172.21.15.72:0/1554159736 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa14000cea0 con 0x7fa1440a0a30 2023-10-03T10:17:13.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.763+0000 7fe8fd5d4700 1 -- 172.21.15.72:0/3242227044 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe8f81a7640 con 0x7fe8f809f240 2023-10-03T10:17:13.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.763+0000 7fe8df7fe700 1 -- 172.21.15.72:0/3242227044 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe8ec015030 con 0x7fe8f809f240 2023-10-03T10:17:13.764 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:13.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.766+0000 7fe8fd5d4700 1 -- 172.21.15.72:0/3242227044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8f809f240 msgr2=0x7fe8f81c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.766+0000 7fe8fd5d4700 1 --2- 172.21.15.72:0/3242227044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8f809f240 0x7fe8f81c6740 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009b90 tx=0x7fe8ec004750 comp rx=0 tx=0).stop 2023-10-03T10:17:13.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.766+0000 7fe8fd5d4700 1 -- 172.21.15.72:0/3242227044 shutdown_connections 2023-10-03T10:17:13.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.766+0000 7fe8fd5d4700 1 --2- 172.21.15.72:0/3242227044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8f809f650 0x7fe8f81c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.766+0000 7fe8fd5d4700 1 --2- 172.21.15.72:0/3242227044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe8f809e930 0x7fe8f81c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.766+0000 7fe8fd5d4700 1 --2- 172.21.15.72:0/3242227044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8f809f240 0x7fe8f81c6740 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.766+0000 7fe8fd5d4700 1 -- 172.21.15.72:0/3242227044 >> 172.21.15.72:0/3242227044 conn(0x7fe8f80a4210 msgr2=0x7fe8f81b8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.766+0000 7fe8fd5d4700 1 -- 172.21.15.72:0/3242227044 shutdown_connections 2023-10-03T10:17:13.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.766+0000 7fe8fd5d4700 1 -- 172.21.15.72:0/3242227044 wait complete. 2023-10-03T10:17:13.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:13.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.811+0000 7f1b2e933700 1 -- 172.21.15.72:0/3206192714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1b28074ea0 con 0x7f1b2809f240 2023-10-03T10:17:13.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.812+0000 7f1b24ff9700 1 -- 172.21.15.72:0/3206192714 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1b1c017030 con 0x7f1b2809f240 2023-10-03T10:17:13.813 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.814+0000 7f1b2e933700 1 -- 172.21.15.72:0/3206192714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b2809f240 msgr2=0x7f1b281a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.814+0000 7f1b2e933700 1 --2- 172.21.15.72:0/3206192714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b2809f240 0x7f1b281a4100 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00c580 tx=0x7f1b1c00c890 comp rx=0 tx=0).stop 2023-10-03T10:17:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.814+0000 7f1b2e933700 1 -- 172.21.15.72:0/3206192714 shutdown_connections 2023-10-03T10:17:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.814+0000 7f1b2e933700 1 --2- 172.21.15.72:0/3206192714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2809e930 0x7f1b281a3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.814+0000 7f1b2e933700 1 --2- 172.21.15.72:0/3206192714 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b2809f650 0x7f1b281a4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.814+0000 7f1b2e933700 1 --2- 172.21.15.72:0/3206192714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b2809f240 0x7f1b281a4100 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.814+0000 7f1b2e933700 1 -- 172.21.15.72:0/3206192714 >> 172.21.15.72:0/3206192714 conn(0x7f1b280a4210 msgr2=0x7f1b281b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.814+0000 7f1b2e933700 1 -- 172.21.15.72:0/3206192714 shutdown_connections 2023-10-03T10:17:13.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.814+0000 7f1b2e933700 1 -- 172.21.15.72:0/3206192714 wait complete. 2023-10-03T10:17:13.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:13.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.887+0000 7fa14b625700 1 -- 172.21.15.72:0/1554159736 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa144074ea0 con 0x7fa1440a0a30 2023-10-03T10:17:13.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.887+0000 7fa139ffb700 1 -- 172.21.15.72:0/1554159736 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa14001b3b0 con 0x7fa1440a0a30 2023-10-03T10:17:13.888 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:13.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.889+0000 7fa14b625700 1 -- 172.21.15.72:0/1554159736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1440a0a30 msgr2=0x7fa1441c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.889+0000 7fa14b625700 1 --2- 172.21.15.72:0/1554159736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1440a0a30 0x7fa1441c8280 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa14000ebe0 tx=0x7fa14000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.889+0000 7fa14b625700 1 -- 172.21.15.72:0/1554159736 shutdown_connections 2023-10-03T10:17:13.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.889+0000 7fa14b625700 1 --2- 172.21.15.72:0/1554159736 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa144133fa0 0x7fa1441c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.889+0000 7fa14b625700 1 --2- 172.21.15.72:0/1554159736 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1440a0a30 0x7fa1441c8280 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.889+0000 7fa14b625700 1 --2- 172.21.15.72:0/1554159736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1440a1340 0x7fa1441c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.889+0000 7fa14b625700 1 -- 172.21.15.72:0/1554159736 >> 172.21.15.72:0/1554159736 conn(0x7fa1440a6550 msgr2=0x7fa14409c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.890+0000 7fa14b625700 1 -- 172.21.15.72:0/1554159736 shutdown_connections 2023-10-03T10:17:13.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:13.890+0000 7fa14b625700 1 -- 172.21.15.72:0/1554159736 wait complete. 2023-10-03T10:17:13.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:14.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:14.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.718+0000 7f4c849a1700 1 Processor -- start 2023-10-03T10:17:14.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.718+0000 7f4c849a1700 1 -- start start 2023-10-03T10:17:14.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.718+0000 7f4c849a1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4c8009d6f0 0x7f4c8009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.718+0000 7f4c849a1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c8009e440 0x7f4c80134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.718+0000 7f4c849a1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8009b120 con 0x7f4c8009e000 2023-10-03T10:17:14.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.718+0000 7f4c849a1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8006b460 con 0x7f4c8009d6f0 2023-10-03T10:17:14.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.718+0000 7f4c849a1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8009a7e0 con 0x7f4c8009e440 2023-10-03T10:17:14.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.718+0000 7f4c7e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4c8009d6f0 0x7f4c8009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.718+0000 7f4c7ed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c8009e440 0x7f4c80134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.718+0000 7f4c7ed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c8009e440 0x7f4c80134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53442/0 (socket says 172.21.15.72:53442) 2023-10-03T10:17:14.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.718+0000 7f4c7e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4c8009d6f0 0x7f4c8009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53952/0 (socket says 172.21.15.72:53952) 2023-10-03T10:17:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.718+0000 7f4c7ed9d700 1 -- 172.21.15.72:0/126429223 learned_addr learned my addr 172.21.15.72:0/126429223 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.719+0000 7f4c7e59c700 1 -- 172.21.15.72:0/126429223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c8009e440 msgr2=0x7f4c80134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.719+0000 7f4c7e59c700 1 --2- 172.21.15.72:0/126429223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c8009e440 0x7f4c80134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.719+0000 7f4c7e59c700 1 -- 172.21.15.72:0/126429223 >> v1:172.21.15.72:6789/0 conn(0x7f4c8009e000 legacy=0x7f4c801339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.719+0000 7f4c7e59c700 1 -- 172.21.15.72:0/126429223 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8009a500 con 0x7f4c8009d6f0 2023-10-03T10:17:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.719+0000 7f4c7ed9d700 1 --2- 172.21.15.72:0/126429223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c8009e440 0x7f4c80134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.719+0000 7f4c7e59c700 1 --2- 172.21.15.72:0/126429223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c8009d6f0 0x7f4c8009dac0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009870 tx=0x7f4c70009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ab6261d4e2f149 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.719+0000 7f4c7d59a700 1 -- 172.21.15.72:0/126429223 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c70011830 con 0x7f4c8009d6f0 2023-10-03T10:17:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.719+0000 7f4c7d59a700 1 -- 172.21.15.72:0/126429223 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c70011990 con 0x7f4c8009d6f0 2023-10-03T10:17:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.719+0000 7f4c7d59a700 1 -- 172.21.15.72:0/126429223 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c70011d20 con 0x7f4c8009d6f0 2023-10-03T10:17:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.719+0000 7f4c849a1700 1 -- 172.21.15.72:0/126429223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c8009d6f0 msgr2=0x7f4c8009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.719+0000 7f4c849a1700 1 --2- 172.21.15.72:0/126429223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c8009d6f0 0x7f4c8009dac0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009870 tx=0x7f4c70009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:14.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.720+0000 7f4c849a1700 1 -- 172.21.15.72:0/126429223 shutdown_connections 2023-10-03T10:17:14.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.720+0000 7f4c849a1700 1 --2- 172.21.15.72:0/126429223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c8009e440 0x7f4c80134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.720+0000 7f4c849a1700 1 --2- 172.21.15.72:0/126429223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c8009d6f0 0x7f4c8009dac0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.720+0000 7f4c849a1700 1 -- 172.21.15.72:0/126429223 >> 172.21.15.72:0/126429223 conn(0x7f4c80066f50 msgr2=0x7f4c8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.720+0000 7f4c849a1700 1 -- 172.21.15.72:0/126429223 shutdown_connections 2023-10-03T10:17:14.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.720+0000 7f4c849a1700 1 -- 172.21.15.72:0/126429223 wait complete. 2023-10-03T10:17:14.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.721+0000 7f4c849a1700 1 Processor -- start 2023-10-03T10:17:14.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.721+0000 7f4c849a1700 1 -- start start 2023-10-03T10:17:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.721+0000 7f4c849a1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c8009d6f0 0x7f4c801a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.721+0000 7f4c849a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c8009e000 0x7f4c801a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.721+0000 7f4c849a1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c8009e440 0x7f4c801a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.721+0000 7f4c849a1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c801a7a60 con 0x7f4c8009e440 2023-10-03T10:17:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.721+0000 7f4c849a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8009c710 con 0x7f4c8009e000 2023-10-03T10:17:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.721+0000 7f4c849a1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c801a9690 con 0x7f4c8009d6f0 2023-10-03T10:17:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.721+0000 7f4c7e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c8009d6f0 0x7f4c801a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.721+0000 7f4c7ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c8009e440 0x7f4c801a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.721+0000 7f4c7dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c8009e000 0x7f4c801a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.721+0000 7f4c7e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c8009d6f0 0x7f4c801a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53456/0 (socket says 172.21.15.72:53456) 2023-10-03T10:17:14.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.721+0000 7f4c7ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c8009e440 0x7f4c801a6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53954/0 (socket says 172.21.15.72:53954) 2023-10-03T10:17:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.721+0000 7f4c7e59c700 1 -- 172.21.15.72:0/4202439787 learned_addr learned my addr 172.21.15.72:0/4202439787 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.721+0000 7f4c7dd9b700 1 -- 172.21.15.72:0/4202439787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c8009d6f0 msgr2=0x7f4c801a5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.722+0000 7f4c7dd9b700 1 --2- 172.21.15.72:0/4202439787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c8009d6f0 0x7f4c801a5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.722+0000 7f4c7dd9b700 1 -- 172.21.15.72:0/4202439787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c8009e440 msgr2=0x7f4c801a6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.722+0000 7f4c7dd9b700 1 --2- 172.21.15.72:0/4202439787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c8009e440 0x7f4c801a6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.722+0000 7f4c7dd9b700 1 -- 172.21.15.72:0/4202439787 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78009b30 con 0x7f4c8009e000 2023-10-03T10:17:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.722+0000 7f4c7e59c700 1 --2- 172.21.15.72:0/4202439787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c8009d6f0 0x7f4c801a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.722+0000 7f4c7ed9d700 1 --2- 172.21.15.72:0/4202439787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c8009e440 0x7f4c801a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.722+0000 7f4c7dd9b700 1 --2- 172.21.15.72:0/4202439787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c8009e000 0x7f4c801a63d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4c74000f60 tx=0x7f4c7400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.722+0000 7f4c6effd700 1 -- 172.21.15.72:0/4202439787 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c740052d0 con 0x7f4c8009e000 2023-10-03T10:17:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.722+0000 7f4c6effd700 1 -- 172.21.15.72:0/4202439787 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c74005430 con 0x7f4c8009e000 2023-10-03T10:17:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.722+0000 7f4c849a1700 1 -- 172.21.15.72:0/4202439787 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c700094a0 con 0x7f4c8009e000 2023-10-03T10:17:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.722+0000 7f4c6effd700 1 -- 172.21.15.72:0/4202439787 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c740038c0 con 0x7f4c8009e000 2023-10-03T10:17:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.722+0000 7f4c849a1700 1 -- 172.21.15.72:0/4202439787 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c801a8cb0 con 0x7f4c8009e000 2023-10-03T10:17:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.723+0000 7f4c6effd700 1 -- 172.21.15.72:0/4202439787 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c74003a20 con 0x7f4c8009e000 2023-10-03T10:17:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.723+0000 7f4c6effd700 1 -- 172.21.15.72:0/4202439787 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4c7403e990 con 0x7f4c8009e000 2023-10-03T10:17:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.723+0000 7f4c849a1700 1 -- 172.21.15.72:0/4202439787 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c80074ea0 con 0x7f4c8009e000 2023-10-03T10:17:14.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.727+0000 7f4c6effd700 1 -- 172.21.15.72:0/4202439787 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c74017070 con 0x7f4c8009e000 2023-10-03T10:17:14.779 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:14.827 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:14.903 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:14.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.903+0000 7f358993e700 1 Processor -- start 2023-10-03T10:17:14.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.903+0000 7f358993e700 1 -- start start 2023-10-03T10:17:14.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f358993e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f358409e1d0 0x7f3584135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f358993e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3584135e50 0x7f3584138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f358993e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358409f130 con 0x7f358409d6f0 2023-10-03T10:17:14.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f358993e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358409f520 con 0x7f3584135e50 2023-10-03T10:17:14.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f358993e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f358409e930 con 0x7f358409e1d0 2023-10-03T10:17:14.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f3582ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f358409d6f0 0x7f358409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33782/0 (socket says 172.21.15.72:33782) 2023-10-03T10:17:14.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f35837fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3584135e50 0x7f3584138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f3582ffd700 1 -- 172.21.15.72:0/1141683965 learned_addr learned my addr 172.21.15.72:0/1141683965 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:14.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f35827fc700 1 --2- 172.21.15.72:0/1141683965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f358409e1d0 0x7f3584135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f3581ffb700 1 -- 172.21.15.72:0/1141683965 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604524401 0 0) 0x7f358409f130 con 0x7f358409d6f0 2023-10-03T10:17:14.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f3581ffb700 1 -- 172.21.15.72:0/1141683965 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f356c0035b0 con 0x7f358409d6f0 2023-10-03T10:17:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f35837fe700 1 -- 172.21.15.72:0/1141683965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f358409e1d0 msgr2=0x7f3584135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f35837fe700 1 --2- 172.21.15.72:0/1141683965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f358409e1d0 0x7f3584135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f35837fe700 1 -- 172.21.15.72:0/1141683965 >> v1:172.21.15.72:6789/0 conn(0x7f358409d6f0 legacy=0x7f358409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f35837fe700 1 -- 172.21.15.72:0/1141683965 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358409b2d0 con 0x7f3584135e50 2023-10-03T10:17:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f35837fe700 1 --2- 172.21.15.72:0/1141683965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3584135e50 0x7f3584138230 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f357c009dc0 tx=0x7f357c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b0e785f19c8bc0c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.904+0000 7f3581ffb700 1 -- 172.21.15.72:0/1141683965 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c00e070 con 0x7f3584135e50 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.905+0000 7f3581ffb700 1 -- 172.21.15.72:0/1141683965 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c00bae0 con 0x7f3584135e50 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.905+0000 7f3581ffb700 1 -- 172.21.15.72:0/1141683965 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c00be90 con 0x7f3584135e50 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.905+0000 7f358993e700 1 -- 172.21.15.72:0/1141683965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3584135e50 msgr2=0x7f3584138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.905+0000 7f358993e700 1 --2- 172.21.15.72:0/1141683965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3584135e50 0x7f3584138230 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f357c009dc0 tx=0x7f357c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.905+0000 7f358993e700 1 -- 172.21.15.72:0/1141683965 shutdown_connections 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.905+0000 7f358993e700 1 --2- 172.21.15.72:0/1141683965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3584135e50 0x7f3584138230 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.905+0000 7f358993e700 1 --2- 172.21.15.72:0/1141683965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f358409e1d0 0x7f3584135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.905+0000 7f358993e700 1 -- 172.21.15.72:0/1141683965 >> 172.21.15.72:0/1141683965 conn(0x7f3584066f50 msgr2=0x7f358409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.905+0000 7f358993e700 1 -- 172.21.15.72:0/1141683965 shutdown_connections 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.905+0000 7f358993e700 1 -- 172.21.15.72:0/1141683965 wait complete. 2023-10-03T10:17:14.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.906+0000 7f358993e700 1 Processor -- start 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.907+0000 7f358993e700 1 -- start start 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.907+0000 7f358993e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f358409d6f0 0x7f358411d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.907+0000 7f358993e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f358409e1d0 0x7f358411da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.907+0000 7f358993e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3584135e50 0x7f358411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.907+0000 7f358993e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358409c700 con 0x7f358409e1d0 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.907+0000 7f358993e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3584120e50 con 0x7f358409d6f0 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.907+0000 7f358993e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35841205c0 con 0x7f3584135e50 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.907+0000 7f3582ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f358409d6f0 0x7f358411d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.907+0000 7f35837fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3584135e50 0x7f358411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.907+0000 7f3582ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f358409d6f0 0x7f358411d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43512/0 (socket says 172.21.15.72:43512) 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.907+0000 7f3582ffd700 1 -- 172.21.15.72:0/850100419 learned_addr learned my addr 172.21.15.72:0/850100419 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:14.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.907+0000 7f35827fc700 1 --2- 172.21.15.72:0/850100419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f358409e1d0 0x7f358411da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.908+0000 7f3582ffd700 1 -- 172.21.15.72:0/850100419 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3584135e50 msgr2=0x7f358411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.908+0000 7f3582ffd700 1 --2- 172.21.15.72:0/850100419 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3584135e50 0x7f358411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.908+0000 7f3582ffd700 1 -- 172.21.15.72:0/850100419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f358409e1d0 msgr2=0x7f358411da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.908+0000 7f3582ffd700 1 --2- 172.21.15.72:0/850100419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f358409e1d0 0x7f358411da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.908+0000 7f3582ffd700 1 -- 172.21.15.72:0/850100419 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c009a70 con 0x7f358409d6f0 2023-10-03T10:17:14.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.908+0000 7f3582ffd700 1 --2- 172.21.15.72:0/850100419 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f358409d6f0 0x7f358411d500 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f35740018d0 tx=0x7f3574001be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.908+0000 7f356bfff700 1 -- 172.21.15.72:0/850100419 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3574004c80 con 0x7f358409d6f0 2023-10-03T10:17:14.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.908+0000 7f356bfff700 1 -- 172.21.15.72:0/850100419 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3574004de0 con 0x7f358409d6f0 2023-10-03T10:17:14.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.908+0000 7f356bfff700 1 -- 172.21.15.72:0/850100419 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35740072d0 con 0x7f358409d6f0 2023-10-03T10:17:14.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.908+0000 7f358993e700 1 -- 172.21.15.72:0/850100419 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35840a1bf0 con 0x7f358409d6f0 2023-10-03T10:17:14.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.908+0000 7f358993e700 1 -- 172.21.15.72:0/850100419 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35841322c0 con 0x7f358409d6f0 2023-10-03T10:17:14.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.909+0000 7f356bfff700 1 -- 172.21.15.72:0/850100419 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3574007430 con 0x7f358409d6f0 2023-10-03T10:17:14.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.909+0000 7f356bfff700 1 -- 172.21.15.72:0/850100419 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3574042e00 con 0x7f358409d6f0 2023-10-03T10:17:14.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.909+0000 7f358993e700 1 -- 172.21.15.72:0/850100419 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3584120cc0 con 0x7f358409d6f0 2023-10-03T10:17:14.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.918+0000 7f356bfff700 1 -- 172.21.15.72:0/850100419 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f357401f070 con 0x7f358409d6f0 2023-10-03T10:17:14.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.929+0000 7f4c849a1700 1 -- 172.21.15.72:0/4202439787 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4c8009f420 con 0x7f4c8009e000 2023-10-03T10:17:14.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.929+0000 7f4c6effd700 1 -- 172.21.15.72:0/4202439787 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c74011590 con 0x7f4c8009e000 2023-10-03T10:17:14.930 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:14.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.932+0000 7f4c849a1700 1 -- 172.21.15.72:0/4202439787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c8009e000 msgr2=0x7f4c801a63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.932+0000 7f4c849a1700 1 --2- 172.21.15.72:0/4202439787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c8009e000 0x7f4c801a63d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4c74000f60 tx=0x7f4c7400c730 comp rx=0 tx=0).stop 2023-10-03T10:17:14.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.933+0000 7f4c849a1700 1 -- 172.21.15.72:0/4202439787 shutdown_connections 2023-10-03T10:17:14.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.933+0000 7f4c849a1700 1 --2- 172.21.15.72:0/4202439787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c8009e440 0x7f4c801a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.933+0000 7f4c849a1700 1 --2- 172.21.15.72:0/4202439787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c8009d6f0 0x7f4c801a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.933+0000 7f4c849a1700 1 --2- 172.21.15.72:0/4202439787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c8009e000 0x7f4c801a63d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.933+0000 7f4c849a1700 1 -- 172.21.15.72:0/4202439787 >> 172.21.15.72:0/4202439787 conn(0x7f4c80066f50 msgr2=0x7f4c801bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.933+0000 7f4c849a1700 1 -- 172.21.15.72:0/4202439787 shutdown_connections 2023-10-03T10:17:14.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.933+0000 7f4c849a1700 1 -- 172.21.15.72:0/4202439787 wait complete. 2023-10-03T10:17:14.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:14.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.956+0000 7fb2eb523700 1 Processor -- start 2023-10-03T10:17:14.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.956+0000 7fb2eb523700 1 -- start start 2023-10-03T10:17:14.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.957+0000 7fb2eb523700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2e40a0a30 0x7fb2e40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.957+0000 7fb2eb523700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e409d630 0x7fb2e40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.957+0000 7fb2eb523700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e40a2a70 con 0x7fb2e4133930 2023-10-03T10:17:14.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.957+0000 7fb2eb523700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e40a01d0 con 0x7fb2e40a0a30 2023-10-03T10:17:14.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.957+0000 7fb2eb523700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e409e2b0 con 0x7fb2e409d630 2023-10-03T10:17:14.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.957+0000 7fb2e92bf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2e40a0a30 0x7fb2e40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.957+0000 7fb2e92bf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2e40a0a30 0x7fb2e40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53972/0 (socket says 172.21.15.72:53972) 2023-10-03T10:17:14.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.957+0000 7fb2e92bf700 1 -- 172.21.15.72:0/847044528 learned_addr learned my addr 172.21.15.72:0/847044528 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:14.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.957+0000 7fb2e8abe700 1 --2- 172.21.15.72:0/847044528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e409d630 0x7fb2e40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.957+0000 7fb2e8abe700 1 -- 172.21.15.72:0/847044528 >> v2:172.21.15.72:3300/0 conn(0x7fb2e40a0a30 msgr2=0x7fb2e40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.957+0000 7fb2e8abe700 1 --2- 172.21.15.72:0/847044528 >> v2:172.21.15.72:3300/0 conn(0x7fb2e40a0a30 0x7fb2e40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.957+0000 7fb2e8abe700 1 -- 172.21.15.72:0/847044528 >> v1:172.21.15.72:6789/0 conn(0x7fb2e4133930 legacy=0x7fb2e4133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.957+0000 7fb2e8abe700 1 -- 172.21.15.72:0/847044528 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e409dc50 con 0x7fb2e409d630 2023-10-03T10:17:14.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.957+0000 7fb2e92bf700 1 --2- 172.21.15.72:0/847044528 >> v2:172.21.15.72:3300/0 conn(0x7fb2e40a0a30 0x7fb2e40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.958+0000 7fb2e8abe700 1 --2- 172.21.15.72:0/847044528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e409d630 0x7fb2e40a1340 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009840 tx=0x7fb2d4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d37407bf7f84a53e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.958+0000 7fb2dbfff700 1 -- 172.21.15.72:0/847044528 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4011830 con 0x7fb2e409d630 2023-10-03T10:17:14.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.958+0000 7fb2dbfff700 1 -- 172.21.15.72:0/847044528 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d4011990 con 0x7fb2e409d630 2023-10-03T10:17:14.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.958+0000 7fb2dbfff700 1 -- 172.21.15.72:0/847044528 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4011d20 con 0x7fb2e409d630 2023-10-03T10:17:14.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.958+0000 7fb2eb523700 1 -- 172.21.15.72:0/847044528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e409d630 msgr2=0x7fb2e40a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.958+0000 7fb2eb523700 1 --2- 172.21.15.72:0/847044528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e409d630 0x7fb2e40a1340 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009840 tx=0x7fb2d4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:14.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.958+0000 7fb2eb523700 1 -- 172.21.15.72:0/847044528 shutdown_connections 2023-10-03T10:17:14.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.958+0000 7fb2eb523700 1 --2- 172.21.15.72:0/847044528 >> v2:172.21.15.72:3300/0 conn(0x7fb2e40a0a30 0x7fb2e40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.958+0000 7fb2eb523700 1 --2- 172.21.15.72:0/847044528 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e409d630 0x7fb2e40a1340 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.958+0000 7fb2eb523700 1 -- 172.21.15.72:0/847044528 >> 172.21.15.72:0/847044528 conn(0x7fb2e40a3050 msgr2=0x7fb2e40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.959+0000 7fb2eb523700 1 -- 172.21.15.72:0/847044528 shutdown_connections 2023-10-03T10:17:14.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.959+0000 7fb2eb523700 1 -- 172.21.15.72:0/847044528 wait complete. 2023-10-03T10:17:14.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.960+0000 7fb2eb523700 1 Processor -- start 2023-10-03T10:17:14.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.960+0000 7fb2eb523700 1 -- start start 2023-10-03T10:17:14.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2eb523700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e409d630 0x7fb2e4121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2eb523700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e40a0a30 0x7fb2e4121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2eb523700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2e4133930 0x7fb2e4121b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2eb523700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e41225b0 con 0x7fb2e409d630 2023-10-03T10:17:14.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2eb523700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4124bd0 con 0x7fb2e4133930 2023-10-03T10:17:14.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2eb523700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4124630 con 0x7fb2e40a0a30 2023-10-03T10:17:14.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2e8abe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e40a0a30 0x7fb2e4121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2e8abe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e40a0a30 0x7fb2e4121640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53490/0 (socket says 172.21.15.72:53490) 2023-10-03T10:17:14.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2e8abe700 1 -- 172.21.15.72:0/2633166890 learned_addr learned my addr 172.21.15.72:0/2633166890 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:14.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2e92bf700 1 --2- 172.21.15.72:0/2633166890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e409d630 0x7fb2e4121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2e9ac0700 1 --2- 172.21.15.72:0/2633166890 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2e4133930 0x7fb2e4121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2e8abe700 1 -- 172.21.15.72:0/2633166890 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2e4133930 msgr2=0x7fb2e4121b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2e8abe700 1 --2- 172.21.15.72:0/2633166890 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2e4133930 0x7fb2e4121b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2e8abe700 1 -- 172.21.15.72:0/2633166890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e409d630 msgr2=0x7fb2e4121100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2e8abe700 1 --2- 172.21.15.72:0/2633166890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e409d630 0x7fb2e4121100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2e8abe700 1 -- 172.21.15.72:0/2633166890 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e0009550 con 0x7fb2e40a0a30 2023-10-03T10:17:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2e8abe700 1 --2- 172.21.15.72:0/2633166890 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e40a0a30 0x7fb2e4121640 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009fd0 tx=0x7fb2d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2d9ffb700 1 -- 172.21.15.72:0/2633166890 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d40036a0 con 0x7fb2e40a0a30 2023-10-03T10:17:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2d9ffb700 1 -- 172.21.15.72:0/2633166890 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d401f070 con 0x7fb2e40a0a30 2023-10-03T10:17:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2eb523700 1 -- 172.21.15.72:0/2633166890 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d40094a0 con 0x7fb2e40a0a30 2023-10-03T10:17:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.961+0000 7fb2d9ffb700 1 -- 172.21.15.72:0/2633166890 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4003a40 con 0x7fb2e40a0a30 2023-10-03T10:17:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.962+0000 7fb2eb523700 1 -- 172.21.15.72:0/2633166890 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e40a0410 con 0x7fb2e40a0a30 2023-10-03T10:17:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.962+0000 7fb2d9ffb700 1 -- 172.21.15.72:0/2633166890 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2d4003ba0 con 0x7fb2e40a0a30 2023-10-03T10:17:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.963+0000 7fb2d9ffb700 1 -- 172.21.15.72:0/2633166890 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb2d4021070 con 0x7fb2e40a0a30 2023-10-03T10:17:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.963+0000 7fb2eb523700 1 -- 172.21.15.72:0/2633166890 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e4124850 con 0x7fb2e40a0a30 2023-10-03T10:17:14.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:14.968+0000 7fb2d9ffb700 1 -- 172.21.15.72:0/2633166890 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2e4124850 con 0x7fb2e40a0a30 2023-10-03T10:17:15.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.035+0000 7f31ac99e700 1 Processor -- start 2023-10-03T10:17:15.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.035+0000 7f31ac99e700 1 -- start start 2023-10-03T10:17:15.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.036+0000 7f31ac99e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a806a770 0x7f31a806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.036+0000 7f31ac99e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31a806b080 0x7f31a8131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.036+0000 7f31ac99e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31a8131b40 0x7f31a8131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.036+0000 7f31ac99e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a809ece0 con 0x7f31a806b080 2023-10-03T10:17:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.036+0000 7f31ac99e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a809e760 con 0x7f31a806a770 2023-10-03T10:17:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.036+0000 7f31ac99e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31a809e040 con 0x7f31a8131b40 2023-10-03T10:17:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.036+0000 7f31a659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a806a770 0x7f31a806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.036+0000 7f31a5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31a806b080 0x7f31a8131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.036+0000 7f31a5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31a806b080 0x7f31a8131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:53992/0 (socket says 172.21.15.72:53992) 2023-10-03T10:17:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.036+0000 7f31a659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a806a770 0x7f31a806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43520/0 (socket says 172.21.15.72:43520) 2023-10-03T10:17:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.036+0000 7f31a5d9b700 1 -- 172.21.15.72:0/1682378574 learned_addr learned my addr 172.21.15.72:0/1682378574 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.036+0000 7f31a6d9d700 1 --2- 172.21.15.72:0/1682378574 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31a8131b40 0x7f31a8131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.037+0000 7f31a659c700 1 -- 172.21.15.72:0/1682378574 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31a8131b40 msgr2=0x7f31a8131fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.037+0000 7f31a659c700 1 --2- 172.21.15.72:0/1682378574 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31a8131b40 0x7f31a8131fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.037+0000 7f31a659c700 1 -- 172.21.15.72:0/1682378574 >> v2:172.21.15.72:3300/0 conn(0x7f31a806b080 msgr2=0x7f31a8131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.037+0000 7f31a659c700 1 --2- 172.21.15.72:0/1682378574 >> v2:172.21.15.72:3300/0 conn(0x7f31a806b080 0x7f31a8131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.037+0000 7f31a659c700 1 -- 172.21.15.72:0/1682378574 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a809f630 con 0x7f31a806a770 2023-10-03T10:17:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.037+0000 7f31a5d9b700 1 --2- 172.21.15.72:0/1682378574 >> v2:172.21.15.72:3300/0 conn(0x7f31a806b080 0x7f31a8131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.037+0000 7f31a659c700 1 --2- 172.21.15.72:0/1682378574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a806a770 0x7f31a806ab40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3198009840 tx=0x7f3198009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75f8dee474011cce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.037+0000 7f31a559a700 1 -- 172.21.15.72:0/1682378574 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198011830 con 0x7f31a806a770 2023-10-03T10:17:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.037+0000 7f31a559a700 1 -- 172.21.15.72:0/1682378574 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3198011990 con 0x7f31a806a770 2023-10-03T10:17:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.037+0000 7f31a559a700 1 -- 172.21.15.72:0/1682378574 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198011d20 con 0x7f31a806a770 2023-10-03T10:17:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.038+0000 7f31ac99e700 1 -- 172.21.15.72:0/1682378574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a806a770 msgr2=0x7f31a806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.038+0000 7f31ac99e700 1 --2- 172.21.15.72:0/1682378574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a806a770 0x7f31a806ab40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3198009840 tx=0x7f3198009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.038+0000 7f31ac99e700 1 -- 172.21.15.72:0/1682378574 shutdown_connections 2023-10-03T10:17:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.038+0000 7f31ac99e700 1 --2- 172.21.15.72:0/1682378574 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31a8131b40 0x7f31a8131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.038+0000 7f31ac99e700 1 --2- 172.21.15.72:0/1682378574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a806a770 0x7f31a806ab40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.038+0000 7f31ac99e700 1 --2- 172.21.15.72:0/1682378574 >> v2:172.21.15.72:3300/0 conn(0x7f31a806b080 0x7f31a8131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.038+0000 7f31ac99e700 1 -- 172.21.15.72:0/1682378574 >> 172.21.15.72:0/1682378574 conn(0x7f31a8066f50 msgr2=0x7f31a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.038+0000 7f31ac99e700 1 -- 172.21.15.72:0/1682378574 shutdown_connections 2023-10-03T10:17:15.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.038+0000 7f31ac99e700 1 -- 172.21.15.72:0/1682378574 wait complete. 2023-10-03T10:17:15.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.039+0000 7f31ac99e700 1 Processor -- start 2023-10-03T10:17:15.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.039+0000 7f31ac99e700 1 -- start start 2023-10-03T10:17:15.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.039+0000 7f31ac99e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a806a770 0x7f31a8120150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.039+0000 7f31ac99e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31a806b080 0x7f31a8120690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.039+0000 7f31ac99e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31a8131b40 0x7f31a8120bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.039+0000 7f31ac99e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8071ed0 con 0x7f31a8131b40 2023-10-03T10:17:15.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.039+0000 7f31ac99e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8121590 con 0x7f31a806a770 2023-10-03T10:17:15.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.039+0000 7f31ac99e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8123990 con 0x7f31a806b080 2023-10-03T10:17:15.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.039+0000 7f31a5d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31a806b080 0x7f31a8120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.039+0000 7f31a5d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31a806b080 0x7f31a8120690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53504/0 (socket says 172.21.15.72:53504) 2023-10-03T10:17:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.039+0000 7f31a5d9b700 1 -- 172.21.15.72:0/1895833024 learned_addr learned my addr 172.21.15.72:0/1895833024 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.039+0000 7f31a659c700 1 --2- 172.21.15.72:0/1895833024 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a806a770 0x7f31a8120150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.039+0000 7f31a6d9d700 1 --2- 172.21.15.72:0/1895833024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31a8131b40 0x7f31a8120bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.040+0000 7f31a5d9b700 1 -- 172.21.15.72:0/1895833024 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a806a770 msgr2=0x7f31a8120150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.040+0000 7f31a5d9b700 1 --2- 172.21.15.72:0/1895833024 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a806a770 0x7f31a8120150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.040+0000 7f31a5d9b700 1 -- 172.21.15.72:0/1895833024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31a8131b40 msgr2=0x7f31a8120bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.040+0000 7f31a5d9b700 1 --2- 172.21.15.72:0/1895833024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31a8131b40 0x7f31a8120bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.040+0000 7f31a5d9b700 1 -- 172.21.15.72:0/1895833024 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c009550 con 0x7f31a806b080 2023-10-03T10:17:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.040+0000 7f31a5d9b700 1 --2- 172.21.15.72:0/1895833024 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31a806b080 0x7f31a8120690 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f319c009e50 tx=0x7f319c00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.040+0000 7f3196ffd700 1 -- 172.21.15.72:0/1895833024 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c013860 con 0x7f31a806b080 2023-10-03T10:17:15.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.040+0000 7f3196ffd700 1 -- 172.21.15.72:0/1895833024 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c0139c0 con 0x7f31a806b080 2023-10-03T10:17:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.040+0000 7f31ac99e700 1 -- 172.21.15.72:0/1895833024 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31980094a0 con 0x7f31a806b080 2023-10-03T10:17:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.040+0000 7f3196ffd700 1 -- 172.21.15.72:0/1895833024 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c013d70 con 0x7f31a806b080 2023-10-03T10:17:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.040+0000 7f31ac99e700 1 -- 172.21.15.72:0/1895833024 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a81225d0 con 0x7f31a806b080 2023-10-03T10:17:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.041+0000 7f3196ffd700 1 -- 172.21.15.72:0/1895833024 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f319c00c640 con 0x7f31a806b080 2023-10-03T10:17:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.041+0000 7f3196ffd700 1 -- 172.21.15.72:0/1895833024 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f319c043670 con 0x7f31a806b080 2023-10-03T10:17:15.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.041+0000 7f31ac99e700 1 -- 172.21.15.72:0/1895833024 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a8074ea0 con 0x7f31a806b080 2023-10-03T10:17:15.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.046+0000 7f3196ffd700 1 -- 172.21.15.72:0/1895833024 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f319c01b440 con 0x7f31a806b080 2023-10-03T10:17:15.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.147+0000 7f358993e700 1 -- 172.21.15.72:0/850100419 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3584120a60 con 0x7f358409d6f0 2023-10-03T10:17:15.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.147+0000 7f356bfff700 1 -- 172.21.15.72:0/850100419 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3584120a60 con 0x7f358409d6f0 2023-10-03T10:17:15.148 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:15.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.150+0000 7f358993e700 1 -- 172.21.15.72:0/850100419 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f358409d6f0 msgr2=0x7f358411d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.150+0000 7f358993e700 1 --2- 172.21.15.72:0/850100419 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f358409d6f0 0x7f358411d500 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f35740018d0 tx=0x7f3574001be0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.151+0000 7f358993e700 1 -- 172.21.15.72:0/850100419 shutdown_connections 2023-10-03T10:17:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.151+0000 7f358993e700 1 --2- 172.21.15.72:0/850100419 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3584135e50 0x7f358411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.151+0000 7f358993e700 1 --2- 172.21.15.72:0/850100419 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f358409d6f0 0x7f358411d500 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.151+0000 7f358993e700 1 --2- 172.21.15.72:0/850100419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f358409e1d0 0x7f358411da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.151+0000 7f358993e700 1 -- 172.21.15.72:0/850100419 >> 172.21.15.72:0/850100419 conn(0x7f3584066f50 msgr2=0x7f3584134830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.151+0000 7f358993e700 1 -- 172.21.15.72:0/850100419 shutdown_connections 2023-10-03T10:17:15.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.151+0000 7f358993e700 1 -- 172.21.15.72:0/850100419 wait complete. 2023-10-03T10:17:15.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.163+0000 7fb2eb523700 1 -- 172.21.15.72:0/2633166890 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb2e4124850 con 0x7fb2e40a0a30 2023-10-03T10:17:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.163+0000 7fb2d9ffb700 1 -- 172.21.15.72:0/2633166890 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb2e4124850 con 0x7fb2e40a0a30 2023-10-03T10:17:15.164 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.165+0000 7fb2eb523700 1 -- 172.21.15.72:0/2633166890 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e40a0a30 msgr2=0x7fb2e4121640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.165+0000 7fb2eb523700 1 --2- 172.21.15.72:0/2633166890 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e40a0a30 0x7fb2e4121640 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009fd0 tx=0x7fb2d4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.166+0000 7fb2eb523700 1 -- 172.21.15.72:0/2633166890 shutdown_connections 2023-10-03T10:17:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.166+0000 7fb2eb523700 1 --2- 172.21.15.72:0/2633166890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2e409d630 0x7fb2e4121100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.166+0000 7fb2eb523700 1 --2- 172.21.15.72:0/2633166890 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2e4133930 0x7fb2e4121b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.166+0000 7fb2eb523700 1 --2- 172.21.15.72:0/2633166890 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb2e40a0a30 0x7fb2e4121640 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.166+0000 7fb2eb523700 1 -- 172.21.15.72:0/2633166890 >> 172.21.15.72:0/2633166890 conn(0x7fb2e40a3050 msgr2=0x7fb2e4133210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.166+0000 7fb2eb523700 1 -- 172.21.15.72:0/2633166890 shutdown_connections 2023-10-03T10:17:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.166+0000 7fb2eb523700 1 -- 172.21.15.72:0/2633166890 wait complete. 2023-10-03T10:17:15.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:15.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.275+0000 7f31ac99e700 1 -- 172.21.15.72:0/1895833024 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f31a8130c70 con 0x7f31a806b080 2023-10-03T10:17:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.275+0000 7f3196ffd700 1 -- 172.21.15.72:0/1895833024 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f319c019340 con 0x7f31a806b080 2023-10-03T10:17:15.276 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.277+0000 7f31ac99e700 1 -- 172.21.15.72:0/1895833024 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31a806b080 msgr2=0x7f31a8120690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.277+0000 7f31ac99e700 1 --2- 172.21.15.72:0/1895833024 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31a806b080 0x7f31a8120690 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f319c009e50 tx=0x7f319c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.277+0000 7f31ac99e700 1 -- 172.21.15.72:0/1895833024 shutdown_connections 2023-10-03T10:17:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.277+0000 7f31ac99e700 1 --2- 172.21.15.72:0/1895833024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31a8131b40 0x7f31a8120bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.277+0000 7f31ac99e700 1 --2- 172.21.15.72:0/1895833024 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a806a770 0x7f31a8120150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.277+0000 7f31ac99e700 1 --2- 172.21.15.72:0/1895833024 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31a806b080 0x7f31a8120690 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.277+0000 7f31ac99e700 1 -- 172.21.15.72:0/1895833024 >> 172.21.15.72:0/1895833024 conn(0x7f31a8066f50 msgr2=0x7f31a806fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.277+0000 7f31ac99e700 1 -- 172.21.15.72:0/1895833024 shutdown_connections 2023-10-03T10:17:15.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:15.277+0000 7f31ac99e700 1 -- 172.21.15.72:0/1895833024 wait complete. 2023-10-03T10:17:15.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:15.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:16.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.076+0000 7fddd9fdf700 1 Processor -- start 2023-10-03T10:17:16.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.076+0000 7fddd9fdf700 1 -- start start 2023-10-03T10:17:16.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.076+0000 7fddd9fdf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fddd409f410 0x7fddd4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.076+0000 7fddd9fdf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddd4136fe0 0x7fddd41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.076+0000 7fddd9fdf700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd4070940 con 0x7fddd409e930 2023-10-03T10:17:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.076+0000 7fddd9fdf700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd406fd60 con 0x7fddd409f410 2023-10-03T10:17:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.076+0000 7fddd9fdf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddd406fa80 con 0x7fddd4136fe0 2023-10-03T10:17:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.076+0000 7fddd2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fddd409f410 0x7fddd4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.076+0000 7fddd2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fddd409f410 0x7fddd4136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54014/0 (socket says 172.21.15.72:54014) 2023-10-03T10:17:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.076+0000 7fddd2ffd700 1 -- 172.21.15.72:0/2954694474 learned_addr learned my addr 172.21.15.72:0/2954694474 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.076+0000 7fddd3fff700 1 --2- 172.21.15.72:0/2954694474 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddd4136fe0 0x7fddd41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd2ffd700 1 -- 172.21.15.72:0/2954694474 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddd4136fe0 msgr2=0x7fddd41393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd2ffd700 1 --2- 172.21.15.72:0/2954694474 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddd4136fe0 0x7fddd41393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd2ffd700 1 -- 172.21.15.72:0/2954694474 >> v1:172.21.15.72:6789/0 conn(0x7fddd409e930 legacy=0x7fddd409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd2ffd700 1 -- 172.21.15.72:0/2954694474 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd409fb60 con 0x7fddd409f410 2023-10-03T10:17:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd3fff700 1 --2- 172.21.15.72:0/2954694474 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddd4136fe0 0x7fddd41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd2ffd700 1 --2- 172.21.15.72:0/2954694474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd409f410 0x7fddd4136aa0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fddc80098f0 tx=0x7fddc8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be18acbc938975d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd27fc700 1 -- 172.21.15.72:0/2954694474 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8011830 con 0x7fddd409f410 2023-10-03T10:17:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd27fc700 1 -- 172.21.15.72:0/2954694474 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc8011990 con 0x7fddd409f410 2023-10-03T10:17:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd27fc700 1 -- 172.21.15.72:0/2954694474 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8011d20 con 0x7fddd409f410 2023-10-03T10:17:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd9fdf700 1 -- 172.21.15.72:0/2954694474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd409f410 msgr2=0x7fddd4136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd9fdf700 1 --2- 172.21.15.72:0/2954694474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd409f410 0x7fddd4136aa0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fddc80098f0 tx=0x7fddc8009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd9fdf700 1 -- 172.21.15.72:0/2954694474 shutdown_connections 2023-10-03T10:17:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd9fdf700 1 --2- 172.21.15.72:0/2954694474 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddd4136fe0 0x7fddd41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd9fdf700 1 --2- 172.21.15.72:0/2954694474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd409f410 0x7fddd4136aa0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd9fdf700 1 -- 172.21.15.72:0/2954694474 >> 172.21.15.72:0/2954694474 conn(0x7fddd40a4210 msgr2=0x7fddd40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd9fdf700 1 -- 172.21.15.72:0/2954694474 shutdown_connections 2023-10-03T10:17:16.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.077+0000 7fddd9fdf700 1 -- 172.21.15.72:0/2954694474 wait complete. 2023-10-03T10:17:16.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.078+0000 7fddd9fdf700 1 Processor -- start 2023-10-03T10:17:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd9fdf700 1 -- start start 2023-10-03T10:17:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd9fdf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddd409e930 0x7fddd41319f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd9fdf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddd409f410 0x7fddd4131f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd9fdf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd4136fe0 0x7fddd41c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd9fdf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4120520 con 0x7fddd4136fe0 2023-10-03T10:17:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd9fdf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd411e7a0 con 0x7fddd409e930 2023-10-03T10:17:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd9fdf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddd411f840 con 0x7fddd409f410 2023-10-03T10:17:16.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd2ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddd409f410 0x7fddd4131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddd409e930 0x7fddd41319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd2ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddd409f410 0x7fddd4131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53518/0 (socket says 172.21.15.72:53518) 2023-10-03T10:17:16.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd2ffd700 1 -- 172.21.15.72:0/3753454085 learned_addr learned my addr 172.21.15.72:0/3753454085 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:16.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd3fff700 1 --2- 172.21.15.72:0/3753454085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd4136fe0 0x7fddd41c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd2ffd700 1 -- 172.21.15.72:0/3753454085 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddd409e930 msgr2=0x7fddd41319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd2ffd700 1 --2- 172.21.15.72:0/3753454085 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddd409e930 0x7fddd41319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd2ffd700 1 -- 172.21.15.72:0/3753454085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd4136fe0 msgr2=0x7fddd41c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd2ffd700 1 --2- 172.21.15.72:0/3753454085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd4136fe0 0x7fddd41c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd2ffd700 1 -- 172.21.15.72:0/3753454085 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc009a70 con 0x7fddd409f410 2023-10-03T10:17:16.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd3fff700 1 --2- 172.21.15.72:0/3753454085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd4136fe0 0x7fddd41c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.079+0000 7fddd2ffd700 1 --2- 172.21.15.72:0/3753454085 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddd409f410 0x7fddd4131f30 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fddc8000c00 tx=0x7fddc8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.080+0000 7fddbbfff700 1 -- 172.21.15.72:0/3753454085 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc80043c0 con 0x7fddd409f410 2023-10-03T10:17:16.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.080+0000 7fddbbfff700 1 -- 172.21.15.72:0/3753454085 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc801f070 con 0x7fddd409f410 2023-10-03T10:17:16.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.080+0000 7fddbbfff700 1 -- 172.21.15.72:0/3753454085 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc80038c0 con 0x7fddd409f410 2023-10-03T10:17:16.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.080+0000 7fddd9fdf700 1 -- 172.21.15.72:0/3753454085 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc8009550 con 0x7fddd409f410 2023-10-03T10:17:16.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.080+0000 7fddd9fdf700 1 -- 172.21.15.72:0/3753454085 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd411f410 con 0x7fddd409f410 2023-10-03T10:17:16.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.080+0000 7fddbbfff700 1 -- 172.21.15.72:0/3753454085 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddc8021030 con 0x7fddd409f410 2023-10-03T10:17:16.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.080+0000 7fddbbfff700 1 -- 172.21.15.72:0/3753454085 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fddc80408c0 con 0x7fddd409f410 2023-10-03T10:17:16.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.081+0000 7fddd9fdf700 1 -- 172.21.15.72:0/3753454085 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd409e190 con 0x7fddd409f410 2023-10-03T10:17:16.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.085+0000 7fddbbfff700 1 -- 172.21.15.72:0/3753454085 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddc8015080 con 0x7fddd409f410 2023-10-03T10:17:16.171 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:16.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.277+0000 7fddd9fdf700 1 -- 172.21.15.72:0/3753454085 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fddd40a3de0 con 0x7fddd409f410 2023-10-03T10:17:16.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.277+0000 7fddbbfff700 1 -- 172.21.15.72:0/3753454085 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddc8004560 con 0x7fddd409f410 2023-10-03T10:17:16.278 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.279+0000 7fddd9fdf700 1 -- 172.21.15.72:0/3753454085 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddd409f410 msgr2=0x7fddd4131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.279+0000 7fddd9fdf700 1 --2- 172.21.15.72:0/3753454085 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddd409f410 0x7fddd4131f30 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fddc8000c00 tx=0x7fddc8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.279+0000 7fddd9fdf700 1 -- 172.21.15.72:0/3753454085 shutdown_connections 2023-10-03T10:17:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.279+0000 7fddd9fdf700 1 --2- 172.21.15.72:0/3753454085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddd4136fe0 0x7fddd41c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.279+0000 7fddd9fdf700 1 --2- 172.21.15.72:0/3753454085 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddd409e930 0x7fddd41319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.279+0000 7fddd9fdf700 1 --2- 172.21.15.72:0/3753454085 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fddd409f410 0x7fddd4131f30 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.279+0000 7fddd9fdf700 1 -- 172.21.15.72:0/3753454085 >> 172.21.15.72:0/3753454085 conn(0x7fddd40a4210 msgr2=0x7fddd4134b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.279+0000 7fddd9fdf700 1 -- 172.21.15.72:0/3753454085 shutdown_connections 2023-10-03T10:17:16.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.279+0000 7fddd9fdf700 1 -- 172.21.15.72:0/3753454085 wait complete. 2023-10-03T10:17:16.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:16.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.296+0000 7fc7f986d700 1 Processor -- start 2023-10-03T10:17:16.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.296+0000 7fc7f986d700 1 -- start start 2023-10-03T10:17:16.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.297+0000 7fc7f986d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc7f406a770 0x7fc7f406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.297+0000 7fc7f986d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7f4131d10 0x7fc7f4139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.297+0000 7fc7f986d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f409ece0 con 0x7fc7f406b080 2023-10-03T10:17:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.297+0000 7fc7f986d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f409e760 con 0x7fc7f406a770 2023-10-03T10:17:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.297+0000 7fc7f986d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f409e040 con 0x7fc7f4131d10 2023-10-03T10:17:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.297+0000 7fc7f37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7f4131d10 0x7fc7f4139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.297+0000 7fc7f37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7f4131d10 0x7fc7f4139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53530/0 (socket says 172.21.15.72:53530) 2023-10-03T10:17:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.297+0000 7fc7f37fe700 1 -- 172.21.15.72:0/3524309876 learned_addr learned my addr 172.21.15.72:0/3524309876 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.297+0000 7fc7f2ffd700 1 --2- 172.21.15.72:0/3524309876 >> v2:172.21.15.72:3300/0 conn(0x7fc7f406a770 0x7fc7f406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.298+0000 7fc7f37fe700 1 -- 172.21.15.72:0/3524309876 >> v2:172.21.15.72:3300/0 conn(0x7fc7f406a770 msgr2=0x7fc7f406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.298+0000 7fc7f37fe700 1 --2- 172.21.15.72:0/3524309876 >> v2:172.21.15.72:3300/0 conn(0x7fc7f406a770 0x7fc7f406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.298+0000 7fc7f37fe700 1 -- 172.21.15.72:0/3524309876 >> v1:172.21.15.72:6789/0 conn(0x7fc7f406b080 legacy=0x7fc7f4131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.298+0000 7fc7f37fe700 1 -- 172.21.15.72:0/3524309876 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f409f630 con 0x7fc7f4131d10 2023-10-03T10:17:16.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.298+0000 7fc7f37fe700 1 --2- 172.21.15.72:0/3524309876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7f4131d10 0x7fc7f4139860 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009e50 tx=0x7fc7ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbb0f9c4d0facfa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.298+0000 7fc7f1ffb700 1 -- 172.21.15.72:0/3524309876 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec00e070 con 0x7fc7f4131d10 2023-10-03T10:17:16.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.298+0000 7fc7f1ffb700 1 -- 172.21.15.72:0/3524309876 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ec00b910 con 0x7fc7f4131d10 2023-10-03T10:17:16.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.298+0000 7fc7f1ffb700 1 -- 172.21.15.72:0/3524309876 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec00bcc0 con 0x7fc7f4131d10 2023-10-03T10:17:16.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.299+0000 7fc7f986d700 1 -- 172.21.15.72:0/3524309876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7f4131d10 msgr2=0x7fc7f4139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.299+0000 7fc7f986d700 1 --2- 172.21.15.72:0/3524309876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7f4131d10 0x7fc7f4139860 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009e50 tx=0x7fc7ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:16.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.299+0000 7fc7f986d700 1 -- 172.21.15.72:0/3524309876 shutdown_connections 2023-10-03T10:17:16.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.299+0000 7fc7f986d700 1 --2- 172.21.15.72:0/3524309876 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7f4131d10 0x7fc7f4139860 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.299+0000 7fc7f986d700 1 --2- 172.21.15.72:0/3524309876 >> v2:172.21.15.72:3300/0 conn(0x7fc7f406a770 0x7fc7f406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.299+0000 7fc7f986d700 1 -- 172.21.15.72:0/3524309876 >> 172.21.15.72:0/3524309876 conn(0x7fc7f4066f50 msgr2=0x7fc7f409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.299+0000 7fc7f986d700 1 -- 172.21.15.72:0/3524309876 shutdown_connections 2023-10-03T10:17:16.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.299+0000 7fc7f986d700 1 -- 172.21.15.72:0/3524309876 wait complete. 2023-10-03T10:17:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.300+0000 7fc7f986d700 1 Processor -- start 2023-10-03T10:17:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.300+0000 7fc7f986d700 1 -- start start 2023-10-03T10:17:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.300+0000 7fc7f986d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7f406a770 0x7fc7f41c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.300+0000 7fc7f986d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7f406b080 0x7fc7f41c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.300+0000 7fc7f986d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7f4131d10 0x7fc7f41c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.300+0000 7fc7f986d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f4125f60 con 0x7fc7f406b080 2023-10-03T10:17:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.300+0000 7fc7f986d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f4125540 con 0x7fc7f406a770 2023-10-03T10:17:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.300+0000 7fc7f986d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f4126160 con 0x7fc7f4131d10 2023-10-03T10:17:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.300+0000 7fc7f2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7f406a770 0x7fc7f41c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.300+0000 7fc7f2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7f406a770 0x7fc7f41c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43542/0 (socket says 172.21.15.72:43542) 2023-10-03T10:17:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.300+0000 7fc7f2ffd700 1 -- 172.21.15.72:0/2894155798 learned_addr learned my addr 172.21.15.72:0/2894155798 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:16.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.300+0000 7fc7f27fc700 1 --2- 172.21.15.72:0/2894155798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7f406b080 0x7fc7f41c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.300+0000 7fc7f37fe700 1 --2- 172.21.15.72:0/2894155798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7f4131d10 0x7fc7f41c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.301+0000 7fc7f37fe700 1 -- 172.21.15.72:0/2894155798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7f406a770 msgr2=0x7fc7f41c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.301+0000 7fc7f37fe700 1 --2- 172.21.15.72:0/2894155798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7f406a770 0x7fc7f41c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.301+0000 7fc7f37fe700 1 -- 172.21.15.72:0/2894155798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7f406b080 msgr2=0x7fc7f41c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.301+0000 7fc7f37fe700 1 --2- 172.21.15.72:0/2894155798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7f406b080 0x7fc7f41c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.301+0000 7fc7f37fe700 1 -- 172.21.15.72:0/2894155798 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec009b30 con 0x7fc7f4131d10 2023-10-03T10:17:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.301+0000 7fc7f2ffd700 1 --2- 172.21.15.72:0/2894155798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7f406a770 0x7fc7f41c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.301+0000 7fc7f27fc700 1 --2- 172.21.15.72:0/2894155798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7f406b080 0x7fc7f41c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.301+0000 7fc7f37fe700 1 --2- 172.21.15.72:0/2894155798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7f4131d10 0x7fc7f41c8da0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec015000 tx=0x7fc7ec004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.301+0000 7fc7dbfff700 1 -- 172.21.15.72:0/2894155798 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec004800 con 0x7fc7f4131d10 2023-10-03T10:17:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.301+0000 7fc7dbfff700 1 -- 172.21.15.72:0/2894155798 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ec004960 con 0x7fc7f4131d10 2023-10-03T10:17:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.301+0000 7fc7dbfff700 1 -- 172.21.15.72:0/2894155798 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec01c680 con 0x7fc7f4131d10 2023-10-03T10:17:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.301+0000 7fc7f986d700 1 -- 172.21.15.72:0/2894155798 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f409bfc0 con 0x7fc7f4131d10 2023-10-03T10:17:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.301+0000 7fc7f986d700 1 -- 172.21.15.72:0/2894155798 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f41314b0 con 0x7fc7f4131d10 2023-10-03T10:17:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.302+0000 7fc7dbfff700 1 -- 172.21.15.72:0/2894155798 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7ec01c7e0 con 0x7fc7f4131d10 2023-10-03T10:17:16.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.302+0000 7fc7dbfff700 1 -- 172.21.15.72:0/2894155798 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc7ec040e50 con 0x7fc7f4131d10 2023-10-03T10:17:16.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.302+0000 7fc7f986d700 1 -- 172.21.15.72:0/2894155798 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f4125c20 con 0x7fc7f4131d10 2023-10-03T10:17:16.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.307+0000 7fc7dbfff700 1 -- 172.21.15.72:0/2894155798 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7ec0123f0 con 0x7fc7f4131d10 2023-10-03T10:17:16.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.342+0000 7f6091618700 1 Processor -- start 2023-10-03T10:17:16.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.342+0000 7f6091618700 1 -- start start 2023-10-03T10:17:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.342+0000 7f6091618700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f608c133420 0x7f608c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.342+0000 7f6091618700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608c133e30 0x7f608c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.343+0000 7f6091618700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608c06b990 con 0x7f608c134260 2023-10-03T10:17:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.343+0000 7f6091618700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608c0a0590 con 0x7f608c133420 2023-10-03T10:17:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.343+0000 7f6091618700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c09fb80 con 0x7f608c133e30 2023-10-03T10:17:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.343+0000 7f608a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608c133e30 0x7f608c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.343+0000 7f608affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f608c133420 0x7f608c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.343+0000 7f608a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608c133e30 0x7f608c12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43556/0 (socket says 172.21.15.72:43556) 2023-10-03T10:17:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.343+0000 7f608a7fc700 1 -- 172.21.15.72:0/1907951958 learned_addr learned my addr 172.21.15.72:0/1907951958 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.343+0000 7f608a7fc700 1 -- 172.21.15.72:0/1907951958 >> v2:172.21.15.72:3300/0 conn(0x7f608c133420 msgr2=0x7f608c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.343+0000 7f608a7fc700 1 --2- 172.21.15.72:0/1907951958 >> v2:172.21.15.72:3300/0 conn(0x7f608c133420 0x7f608c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.343+0000 7f608a7fc700 1 -- 172.21.15.72:0/1907951958 >> v1:172.21.15.72:6789/0 conn(0x7f608c134260 legacy=0x7f608c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.343+0000 7f608a7fc700 1 -- 172.21.15.72:0/1907951958 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0a0030 con 0x7f608c133e30 2023-10-03T10:17:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.343+0000 7f608a7fc700 1 --2- 172.21.15.72:0/1907951958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608c133e30 0x7f608c12ff90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f60800098f0 tx=0x7f6080009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c7572b713a7d0dc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.343+0000 7f6089ffb700 1 -- 172.21.15.72:0/1907951958 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080011830 con 0x7f608c133e30 2023-10-03T10:17:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.343+0000 7f6089ffb700 1 -- 172.21.15.72:0/1907951958 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6080011990 con 0x7f608c133e30 2023-10-03T10:17:16.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.343+0000 7f6089ffb700 1 -- 172.21.15.72:0/1907951958 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080011d20 con 0x7f608c133e30 2023-10-03T10:17:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.344+0000 7f6091618700 1 -- 172.21.15.72:0/1907951958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608c133e30 msgr2=0x7f608c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.344+0000 7f6091618700 1 --2- 172.21.15.72:0/1907951958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608c133e30 0x7f608c12ff90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f60800098f0 tx=0x7f6080009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:16.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.344+0000 7f6091618700 1 -- 172.21.15.72:0/1907951958 shutdown_connections 2023-10-03T10:17:16.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.344+0000 7f6091618700 1 --2- 172.21.15.72:0/1907951958 >> v2:172.21.15.72:3300/0 conn(0x7f608c133420 0x7f608c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.344+0000 7f6091618700 1 --2- 172.21.15.72:0/1907951958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608c133e30 0x7f608c12ff90 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.344+0000 7f6091618700 1 -- 172.21.15.72:0/1907951958 >> 172.21.15.72:0/1907951958 conn(0x7f608c0a4210 msgr2=0x7f608c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.344+0000 7f6091618700 1 -- 172.21.15.72:0/1907951958 shutdown_connections 2023-10-03T10:17:16.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.344+0000 7f6091618700 1 -- 172.21.15.72:0/1907951958 wait complete. 2023-10-03T10:17:16.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.346+0000 7f6091618700 1 Processor -- start 2023-10-03T10:17:16.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.346+0000 7f6091618700 1 -- start start 2023-10-03T10:17:16.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.346+0000 7f6091618700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f608c133420 0x7f608c09c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.346+0000 7f6091618700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608c133e30 0x7f608c09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.346+0000 7f6091618700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608c134260 0x7f608c09d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.346+0000 7f6091618700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608c1201b0 con 0x7f608c134260 2023-10-03T10:17:16.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.346+0000 7f6091618700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608c131a70 con 0x7f608c133e30 2023-10-03T10:17:16.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.346+0000 7f6091618700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f608c09dfe0 con 0x7f608c133420 2023-10-03T10:17:16.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.346+0000 7f608a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608c133e30 0x7f608c09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.346+0000 7f608affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f608c133420 0x7f608c09c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.346+0000 7f608a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608c133e30 0x7f608c09cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43558/0 (socket says 172.21.15.72:43558) 2023-10-03T10:17:16.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.346+0000 7f608a7fc700 1 -- 172.21.15.72:0/3057163246 learned_addr learned my addr 172.21.15.72:0/3057163246 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:16.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.347+0000 7f608b7fe700 1 --2- 172.21.15.72:0/3057163246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608c134260 0x7f608c09d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.347+0000 7f608a7fc700 1 -- 172.21.15.72:0/3057163246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f608c133420 msgr2=0x7f608c09c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.347+0000 7f608a7fc700 1 --2- 172.21.15.72:0/3057163246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f608c133420 0x7f608c09c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.347+0000 7f608a7fc700 1 -- 172.21.15.72:0/3057163246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608c134260 msgr2=0x7f608c09d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.347+0000 7f608a7fc700 1 --2- 172.21.15.72:0/3057163246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608c134260 0x7f608c09d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.347+0000 7f608a7fc700 1 -- 172.21.15.72:0/3057163246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6080009550 con 0x7f608c133e30 2023-10-03T10:17:16.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.347+0000 7f608a7fc700 1 --2- 172.21.15.72:0/3057163246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608c133e30 0x7f608c09cc20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6080000c00 tx=0x7f6080004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.347+0000 7f60737fe700 1 -- 172.21.15.72:0/3057163246 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60800036a0 con 0x7f608c133e30 2023-10-03T10:17:16.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.347+0000 7f60737fe700 1 -- 172.21.15.72:0/3057163246 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6080003800 con 0x7f608c133e30 2023-10-03T10:17:16.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.347+0000 7f6091618700 1 -- 172.21.15.72:0/3057163246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608c11fe80 con 0x7f608c133e30 2023-10-03T10:17:16.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.347+0000 7f60737fe700 1 -- 172.21.15.72:0/3057163246 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080003b90 con 0x7f608c133e30 2023-10-03T10:17:16.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.347+0000 7f6091618700 1 -- 172.21.15.72:0/3057163246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608c12db80 con 0x7f608c133e30 2023-10-03T10:17:16.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.348+0000 7f60737fe700 1 -- 172.21.15.72:0/3057163246 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6080021070 con 0x7f608c133e30 2023-10-03T10:17:16.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.348+0000 7f60737fe700 1 -- 172.21.15.72:0/3057163246 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6080040aa0 con 0x7f608c133e30 2023-10-03T10:17:16.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.348+0000 7f6091618700 1 -- 172.21.15.72:0/3057163246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608c1202f0 con 0x7f608c133e30 2023-10-03T10:17:16.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.357+0000 7f60737fe700 1 -- 172.21.15.72:0/3057163246 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f608c1202f0 con 0x7f608c133e30 2023-10-03T10:17:16.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.434+0000 7ff84d939700 1 Processor -- start 2023-10-03T10:17:16.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.434+0000 7ff84d939700 1 -- start start 2023-10-03T10:17:16.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.435+0000 7ff84d939700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8480a0a30 0x7ff8480a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.435+0000 7ff84d939700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff84809d630 0x7ff8480a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.435+0000 7ff84d939700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8480a2a70 con 0x7ff848133930 2023-10-03T10:17:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.435+0000 7ff84d939700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8480a01d0 con 0x7ff84809d630 2023-10-03T10:17:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.435+0000 7ff84d939700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff84809e2b0 con 0x7ff8480a0a30 2023-10-03T10:17:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.435+0000 7ff846ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8480a0a30 0x7ff8480a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.435+0000 7ff8467fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff84809d630 0x7ff8480a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.435+0000 7ff846ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8480a0a30 0x7ff8480a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53556/0 (socket says 172.21.15.72:53556) 2023-10-03T10:17:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.435+0000 7ff846ffd700 1 -- 172.21.15.72:0/3384783725 learned_addr learned my addr 172.21.15.72:0/3384783725 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.435+0000 7ff8467fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff84809d630 0x7ff8480a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54052/0 (socket says 172.21.15.72:54052) 2023-10-03T10:17:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.435+0000 7ff8467fc700 1 -- 172.21.15.72:0/3384783725 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8480a0a30 msgr2=0x7ff8480a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.435+0000 7ff8467fc700 1 --2- 172.21.15.72:0/3384783725 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8480a0a30 0x7ff8480a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.435+0000 7ff8467fc700 1 -- 172.21.15.72:0/3384783725 >> v1:172.21.15.72:6789/0 conn(0x7ff848133930 legacy=0x7ff848133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.435+0000 7ff8467fc700 1 -- 172.21.15.72:0/3384783725 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84809dc50 con 0x7ff84809d630 2023-10-03T10:17:16.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.435+0000 7ff846ffd700 1 --2- 172.21.15.72:0/3384783725 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8480a0a30 0x7ff8480a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.436+0000 7ff8467fc700 1 --2- 172.21.15.72:0/3384783725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84809d630 0x7ff8480a1340 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009840 tx=0x7ff83c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770c6965c3876bd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.436+0000 7ff845ffb700 1 -- 172.21.15.72:0/3384783725 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c011830 con 0x7ff84809d630 2023-10-03T10:17:16.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.436+0000 7ff845ffb700 1 -- 172.21.15.72:0/3384783725 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c011990 con 0x7ff84809d630 2023-10-03T10:17:16.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.436+0000 7ff845ffb700 1 -- 172.21.15.72:0/3384783725 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c011d20 con 0x7ff84809d630 2023-10-03T10:17:16.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.437+0000 7ff84d939700 1 -- 172.21.15.72:0/3384783725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84809d630 msgr2=0x7ff8480a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.437+0000 7ff84d939700 1 --2- 172.21.15.72:0/3384783725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84809d630 0x7ff8480a1340 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009840 tx=0x7ff83c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:16.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.437+0000 7ff84d939700 1 -- 172.21.15.72:0/3384783725 shutdown_connections 2023-10-03T10:17:16.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.437+0000 7ff84d939700 1 --2- 172.21.15.72:0/3384783725 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8480a0a30 0x7ff8480a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.437+0000 7ff84d939700 1 --2- 172.21.15.72:0/3384783725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff84809d630 0x7ff8480a1340 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.437+0000 7ff84d939700 1 -- 172.21.15.72:0/3384783725 >> 172.21.15.72:0/3384783725 conn(0x7ff8480a3050 msgr2=0x7ff8480a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.437+0000 7ff84d939700 1 -- 172.21.15.72:0/3384783725 shutdown_connections 2023-10-03T10:17:16.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.437+0000 7ff84d939700 1 -- 172.21.15.72:0/3384783725 wait complete. 2023-10-03T10:17:16.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.438+0000 7ff84d939700 1 Processor -- start 2023-10-03T10:17:16.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.438+0000 7ff84d939700 1 -- start start 2023-10-03T10:17:16.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff84d939700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84809d630 0x7ff8481c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff84d939700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8480a0a30 0x7ff8481c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff84d939700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff848133930 0x7ff8481c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff84d939700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff848120a70 con 0x7ff848133930 2023-10-03T10:17:16.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff84d939700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff848120880 con 0x7ff84809d630 2023-10-03T10:17:16.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff84d939700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff848121920 con 0x7ff8480a0a30 2023-10-03T10:17:16.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff846ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84809d630 0x7ff8481c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff846ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84809d630 0x7ff8481c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43566/0 (socket says 172.21.15.72:43566) 2023-10-03T10:17:16.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff846ffd700 1 -- 172.21.15.72:0/2242589626 learned_addr learned my addr 172.21.15.72:0/2242589626 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:16.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff8467fc700 1 --2- 172.21.15.72:0/2242589626 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8480a0a30 0x7ff8481c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff8477fe700 1 --2- 172.21.15.72:0/2242589626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff848133930 0x7ff8481c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff8467fc700 1 -- 172.21.15.72:0/2242589626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84809d630 msgr2=0x7ff8481c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff8467fc700 1 --2- 172.21.15.72:0/2242589626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84809d630 0x7ff8481c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff8467fc700 1 -- 172.21.15.72:0/2242589626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff848133930 msgr2=0x7ff8481c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff8467fc700 1 --2- 172.21.15.72:0/2242589626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff848133930 0x7ff8481c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff8467fc700 1 -- 172.21.15.72:0/2242589626 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff838009550 con 0x7ff8480a0a30 2023-10-03T10:17:16.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.439+0000 7ff846ffd700 1 --2- 172.21.15.72:0/2242589626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84809d630 0x7ff8481c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.440+0000 7ff8467fc700 1 --2- 172.21.15.72:0/2242589626 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8480a0a30 0x7ff8481c8850 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff83c016000 tx=0x7ff83c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.440+0000 7ff82ffff700 1 -- 172.21.15.72:0/2242589626 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c004400 con 0x7ff8480a0a30 2023-10-03T10:17:16.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.440+0000 7ff82ffff700 1 -- 172.21.15.72:0/2242589626 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c01f070 con 0x7ff8480a0a30 2023-10-03T10:17:16.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.440+0000 7ff84d939700 1 -- 172.21.15.72:0/2242589626 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c0094a0 con 0x7ff8480a0a30 2023-10-03T10:17:16.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.440+0000 7ff82ffff700 1 -- 172.21.15.72:0/2242589626 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0038c0 con 0x7ff8480a0a30 2023-10-03T10:17:16.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.440+0000 7ff84d939700 1 -- 172.21.15.72:0/2242589626 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8481224b0 con 0x7ff8480a0a30 2023-10-03T10:17:16.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.441+0000 7ff82ffff700 1 -- 172.21.15.72:0/2242589626 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff83c021030 con 0x7ff8480a0a30 2023-10-03T10:17:16.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.441+0000 7ff82ffff700 1 -- 172.21.15.72:0/2242589626 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff83c040960 con 0x7ff8480a0a30 2023-10-03T10:17:16.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.441+0000 7ff82dffb700 1 -- 172.21.15.72:0/2242589626 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff848122280 con 0x7ff8480a0a30 2023-10-03T10:17:16.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.446+0000 7ff82ffff700 1 -- 172.21.15.72:0/2242589626 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff83c004560 con 0x7ff8480a0a30 2023-10-03T10:17:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.506+0000 7fc7f986d700 1 -- 172.21.15.72:0/2894155798 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc7f406e970 con 0x7fc7f4131d10 2023-10-03T10:17:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.506+0000 7fc7dbfff700 1 -- 172.21.15.72:0/2894155798 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc7ec0243b0 con 0x7fc7f4131d10 2023-10-03T10:17:16.509 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.508+0000 7fc7f986d700 1 -- 172.21.15.72:0/2894155798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7f4131d10 msgr2=0x7fc7f41c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.508+0000 7fc7f986d700 1 --2- 172.21.15.72:0/2894155798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7f4131d10 0x7fc7f41c8da0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec015000 tx=0x7fc7ec004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.508+0000 7fc7f986d700 1 -- 172.21.15.72:0/2894155798 shutdown_connections 2023-10-03T10:17:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.508+0000 7fc7f986d700 1 --2- 172.21.15.72:0/2894155798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc7f4131d10 0x7fc7f41c8da0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.508+0000 7fc7f986d700 1 --2- 172.21.15.72:0/2894155798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7f406a770 0x7fc7f41c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.508+0000 7fc7f986d700 1 --2- 172.21.15.72:0/2894155798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7f406b080 0x7fc7f41c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.508+0000 7fc7f986d700 1 -- 172.21.15.72:0/2894155798 >> 172.21.15.72:0/2894155798 conn(0x7fc7f4066f50 msgr2=0x7fc7f40700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.509+0000 7fc7f986d700 1 -- 172.21.15.72:0/2894155798 shutdown_connections 2023-10-03T10:17:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.509+0000 7fc7f986d700 1 -- 172.21.15.72:0/2894155798 wait complete. 2023-10-03T10:17:16.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:16.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.562+0000 7f6091618700 1 -- 172.21.15.72:0/3057163246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f608c1202f0 con 0x7f608c133e30 2023-10-03T10:17:16.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.563+0000 7f60737fe700 1 -- 172.21.15.72:0/3057163246 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f608c1202f0 con 0x7f608c133e30 2023-10-03T10:17:16.563 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.565+0000 7f6091618700 1 -- 172.21.15.72:0/3057163246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608c133e30 msgr2=0x7f608c09cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.565+0000 7f6091618700 1 --2- 172.21.15.72:0/3057163246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608c133e30 0x7f608c09cc20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6080000c00 tx=0x7f6080004750 comp rx=0 tx=0).stop 2023-10-03T10:17:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.565+0000 7f6091618700 1 -- 172.21.15.72:0/3057163246 shutdown_connections 2023-10-03T10:17:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.565+0000 7f6091618700 1 --2- 172.21.15.72:0/3057163246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f608c134260 0x7f608c09d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.565+0000 7f6091618700 1 --2- 172.21.15.72:0/3057163246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f608c133420 0x7f608c09c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.565+0000 7f6091618700 1 --2- 172.21.15.72:0/3057163246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f608c133e30 0x7f608c09cc20 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.565+0000 7f6091618700 1 -- 172.21.15.72:0/3057163246 >> 172.21.15.72:0/3057163246 conn(0x7f608c0a4210 msgr2=0x7f608c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.565+0000 7f6091618700 1 -- 172.21.15.72:0/3057163246 shutdown_connections 2023-10-03T10:17:16.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.565+0000 7f6091618700 1 -- 172.21.15.72:0/3057163246 wait complete. 2023-10-03T10:17:16.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:16.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.638+0000 7ff82dffb700 1 -- 172.21.15.72:0/2242589626 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff848121e90 con 0x7ff8480a0a30 2023-10-03T10:17:16.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.639+0000 7ff82ffff700 1 -- 172.21.15.72:0/2242589626 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff83c015030 con 0x7ff8480a0a30 2023-10-03T10:17:16.640 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:16.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.641+0000 7ff82dffb700 1 -- 172.21.15.72:0/2242589626 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8480a0a30 msgr2=0x7ff8481c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.641+0000 7ff82dffb700 1 --2- 172.21.15.72:0/2242589626 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8480a0a30 0x7ff8481c8850 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff83c016000 tx=0x7ff83c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:16.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.641+0000 7ff82dffb700 1 -- 172.21.15.72:0/2242589626 shutdown_connections 2023-10-03T10:17:16.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.641+0000 7ff82dffb700 1 --2- 172.21.15.72:0/2242589626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff848133930 0x7ff8481c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.641+0000 7ff82dffb700 1 --2- 172.21.15.72:0/2242589626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff84809d630 0x7ff8481c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.641+0000 7ff82dffb700 1 --2- 172.21.15.72:0/2242589626 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff8480a0a30 0x7ff8481c8850 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.641+0000 7ff82dffb700 1 -- 172.21.15.72:0/2242589626 >> 172.21.15.72:0/2242589626 conn(0x7ff8480a3050 msgr2=0x7ff8481bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.641+0000 7ff82dffb700 1 -- 172.21.15.72:0/2242589626 shutdown_connections 2023-10-03T10:17:16.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:16.641+0000 7ff82dffb700 1 -- 172.21.15.72:0/2242589626 wait complete. 2023-10-03T10:17:16.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:17.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:17.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.423+0000 7f82c2273700 1 Processor -- start 2023-10-03T10:17:17.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82c2273700 1 -- start start 2023-10-03T10:17:17.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82c2273700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82bc09f410 0x7f82bc138e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82c2273700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82bc139360 0x7f82bc13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82c2273700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc06c9f0 con 0x7f82bc09e930 2023-10-03T10:17:17.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82c2273700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc06c670 con 0x7f82bc139360 2023-10-03T10:17:17.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82c2273700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc06bc90 con 0x7f82bc09f410 2023-10-03T10:17:17.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82bb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82bc09f410 0x7f82bc138e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82bbfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f82bc09e930 0x7f82bc09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33828/0 (socket says 172.21.15.72:33828) 2023-10-03T10:17:17.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82c0810700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82bc139360 0x7f82bc13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82bbfff700 1 -- 172.21.15.72:0/618071089 learned_addr learned my addr 172.21.15.72:0/618071089 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:17.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82baffd700 1 -- 172.21.15.72:0/618071089 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813648763 0 0) 0x7f82b0001110 con 0x7f82bc09e930 2023-10-03T10:17:17.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82baffd700 1 -- 172.21.15.72:0/618071089 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82a40035b0 con 0x7f82bc09e930 2023-10-03T10:17:17.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82c0810700 1 -- 172.21.15.72:0/618071089 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82bc09f410 msgr2=0x7f82bc138e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82c0810700 1 --2- 172.21.15.72:0/618071089 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82bc09f410 0x7f82bc138e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82c0810700 1 -- 172.21.15.72:0/618071089 >> v1:172.21.15.72:6789/0 conn(0x7f82bc09e930 legacy=0x7f82bc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82c0810700 1 -- 172.21.15.72:0/618071089 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc06d860 con 0x7f82bc139360 2023-10-03T10:17:17.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.424+0000 7f82bb7fe700 1 --2- 172.21.15.72:0/618071089 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82bc09f410 0x7f82bc138e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.425+0000 7f82c0810700 1 --2- 172.21.15.72:0/618071089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82bc139360 0x7f82bc13b740 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009dc0 tx=0x7f82b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4801f5f851705225 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.425+0000 7f82baffd700 1 -- 172.21.15.72:0/618071089 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b400e070 con 0x7f82bc139360 2023-10-03T10:17:17.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.425+0000 7f82baffd700 1 -- 172.21.15.72:0/618071089 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b400bb20 con 0x7f82bc139360 2023-10-03T10:17:17.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.425+0000 7f82baffd700 1 -- 172.21.15.72:0/618071089 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4012430 con 0x7f82bc139360 2023-10-03T10:17:17.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.425+0000 7f82c2273700 1 -- 172.21.15.72:0/618071089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82bc139360 msgr2=0x7f82bc13b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.425+0000 7f82c2273700 1 --2- 172.21.15.72:0/618071089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82bc139360 0x7f82bc13b740 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009dc0 tx=0x7f82b400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:17.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.425+0000 7f82c2273700 1 -- 172.21.15.72:0/618071089 shutdown_connections 2023-10-03T10:17:17.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.425+0000 7f82c2273700 1 --2- 172.21.15.72:0/618071089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82bc139360 0x7f82bc13b740 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.425+0000 7f82c2273700 1 --2- 172.21.15.72:0/618071089 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82bc09f410 0x7f82bc138e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.425+0000 7f82c2273700 1 -- 172.21.15.72:0/618071089 >> 172.21.15.72:0/618071089 conn(0x7f82bc0a4210 msgr2=0x7f82bc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.425+0000 7f82c2273700 1 -- 172.21.15.72:0/618071089 shutdown_connections 2023-10-03T10:17:17.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.425+0000 7f82c2273700 1 -- 172.21.15.72:0/618071089 wait complete. 2023-10-03T10:17:17.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.426+0000 7f82c2273700 1 Processor -- start 2023-10-03T10:17:17.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.426+0000 7f82c2273700 1 -- start start 2023-10-03T10:17:17.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82c2273700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82bc09e930 0x7f82bc120810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82c2273700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82bc09f410 0x7f82bc120d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82c2273700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82bc139360 0x7f82bc121290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82c2273700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc122610 con 0x7f82bc09e930 2023-10-03T10:17:17.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82c2273700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc122420 con 0x7f82bc09f410 2023-10-03T10:17:17.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82c2273700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc136790 con 0x7f82bc139360 2023-10-03T10:17:17.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82bb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82bc09f410 0x7f82bc120d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82c0810700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82bc139360 0x7f82bc121290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82bb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82bc09f410 0x7f82bc120d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43576/0 (socket says 172.21.15.72:43576) 2023-10-03T10:17:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82bb7fe700 1 -- 172.21.15.72:0/1171079748 learned_addr learned my addr 172.21.15.72:0/1171079748 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82bbfff700 1 --2- 172.21.15.72:0/1171079748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82bc09e930 0x7f82bc120810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82c0810700 1 -- 172.21.15.72:0/1171079748 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82bc09f410 msgr2=0x7f82bc120d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82c0810700 1 --2- 172.21.15.72:0/1171079748 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82bc09f410 0x7f82bc120d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82c0810700 1 -- 172.21.15.72:0/1171079748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82bc09e930 msgr2=0x7f82bc120810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82c0810700 1 --2- 172.21.15.72:0/1171079748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82bc09e930 0x7f82bc120810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82c0810700 1 -- 172.21.15.72:0/1171079748 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac0094a0 con 0x7f82bc139360 2023-10-03T10:17:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82bbfff700 1 --2- 172.21.15.72:0/1171079748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82bc09e930 0x7f82bc120810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82bb7fe700 1 --2- 172.21.15.72:0/1171079748 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82bc09f410 0x7f82bc120d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82c0810700 1 --2- 172.21.15.72:0/1171079748 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82bc139360 0x7f82bc121290 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f82b4016000 tx=0x7f82b4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82b8ff9700 1 -- 172.21.15.72:0/1171079748 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4004800 con 0x7f82bc139360 2023-10-03T10:17:17.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82b8ff9700 1 -- 172.21.15.72:0/1171079748 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b4020070 con 0x7f82bc139360 2023-10-03T10:17:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82c2273700 1 -- 172.21.15.72:0/1171079748 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b4009a70 con 0x7f82bc139360 2023-10-03T10:17:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.427+0000 7f82b8ff9700 1 -- 172.21.15.72:0/1171079748 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b40276c0 con 0x7f82bc139360 2023-10-03T10:17:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.428+0000 7f82c2273700 1 -- 172.21.15.72:0/1171079748 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82bc124050 con 0x7f82bc139360 2023-10-03T10:17:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.428+0000 7f82b8ff9700 1 -- 172.21.15.72:0/1171079748 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82b4012430 con 0x7f82bc139360 2023-10-03T10:17:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.428+0000 7f82b8ff9700 1 -- 172.21.15.72:0/1171079748 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f82b4022070 con 0x7f82bc139360 2023-10-03T10:17:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.428+0000 7f82c2273700 1 -- 172.21.15.72:0/1171079748 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82bc074ea0 con 0x7f82bc139360 2023-10-03T10:17:17.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.433+0000 7f82b8ff9700 1 -- 172.21.15.72:0/1171079748 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82b4003e30 con 0x7f82bc139360 2023-10-03T10:17:17.522 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:17.578 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:17.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.623+0000 7f82c2273700 1 -- 172.21.15.72:0/1171079748 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f82bc06b910 con 0x7f82bc139360 2023-10-03T10:17:17.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.623+0000 7f82b8ff9700 1 -- 172.21.15.72:0/1171079748 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82b401ab20 con 0x7f82bc139360 2023-10-03T10:17:17.624 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:17.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.625+0000 7f82c2273700 1 -- 172.21.15.72:0/1171079748 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82bc139360 msgr2=0x7f82bc121290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.625+0000 7f82c2273700 1 --2- 172.21.15.72:0/1171079748 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82bc139360 0x7f82bc121290 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f82b4016000 tx=0x7f82b4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.625+0000 7f82c2273700 1 -- 172.21.15.72:0/1171079748 shutdown_connections 2023-10-03T10:17:17.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.625+0000 7f82c2273700 1 --2- 172.21.15.72:0/1171079748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82bc09e930 0x7f82bc120810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.625+0000 7f82c2273700 1 --2- 172.21.15.72:0/1171079748 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82bc139360 0x7f82bc121290 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.625+0000 7f82c2273700 1 --2- 172.21.15.72:0/1171079748 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82bc09f410 0x7f82bc120d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.625+0000 7f82c2273700 1 -- 172.21.15.72:0/1171079748 >> 172.21.15.72:0/1171079748 conn(0x7f82bc0a4210 msgr2=0x7f82bc0a2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.625+0000 7f82c2273700 1 -- 172.21.15.72:0/1171079748 shutdown_connections 2023-10-03T10:17:17.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.625+0000 7f82c2273700 1 -- 172.21.15.72:0/1171079748 wait complete. 2023-10-03T10:17:17.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:17.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.648+0000 7f8e57ec2700 1 Processor -- start 2023-10-03T10:17:17.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.648+0000 7f8e57ec2700 1 -- start start 2023-10-03T10:17:17.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.648+0000 7f8e57ec2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e500a0a30 0x7f8e500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.648+0000 7f8e57ec2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5009d630 0x7f8e500a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.648+0000 7f8e57ec2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e50133930 0x7f8e50133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.648+0000 7f8e57ec2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e500a2a70 con 0x7f8e500a0a30 2023-10-03T10:17:17.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.648+0000 7f8e57ec2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e500a01d0 con 0x7f8e5009d630 2023-10-03T10:17:17.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.648+0000 7f8e57ec2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5009e2b0 con 0x7f8e50133930 2023-10-03T10:17:17.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.648+0000 7f8e5545d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5009d630 0x7f8e500a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.649+0000 7f8e55c5e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e500a0a30 0x7f8e500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.649+0000 7f8e5545d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5009d630 0x7f8e500a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43580/0 (socket says 172.21.15.72:43580) 2023-10-03T10:17:17.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.649+0000 7f8e5545d700 1 -- 172.21.15.72:0/3792416101 learned_addr learned my addr 172.21.15.72:0/3792416101 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:17.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.649+0000 7f8e5645f700 1 --2- 172.21.15.72:0/3792416101 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e50133930 0x7f8e50133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.649+0000 7f8e5645f700 1 -- 172.21.15.72:0/3792416101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5009d630 msgr2=0x7f8e500a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.649+0000 7f8e5645f700 1 --2- 172.21.15.72:0/3792416101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5009d630 0x7f8e500a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.649+0000 7f8e5645f700 1 -- 172.21.15.72:0/3792416101 >> v2:172.21.15.72:3300/0 conn(0x7f8e500a0a30 msgr2=0x7f8e500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.649+0000 7f8e5645f700 1 --2- 172.21.15.72:0/3792416101 >> v2:172.21.15.72:3300/0 conn(0x7f8e500a0a30 0x7f8e500a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.649+0000 7f8e5645f700 1 -- 172.21.15.72:0/3792416101 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5009dc50 con 0x7f8e50133930 2023-10-03T10:17:17.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.649+0000 7f8e55c5e700 1 --2- 172.21.15.72:0/3792416101 >> v2:172.21.15.72:3300/0 conn(0x7f8e500a0a30 0x7f8e500a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.649+0000 7f8e5545d700 1 --2- 172.21.15.72:0/3792416101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5009d630 0x7f8e500a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.649+0000 7f8e5645f700 1 --2- 172.21.15.72:0/3792416101 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e50133930 0x7f8e50133db0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009d90 tx=0x7f8e4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=717533a1c54e8f74 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.649+0000 7f8e54c5c700 1 -- 172.21.15.72:0/3792416101 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4800e070 con 0x7f8e50133930 2023-10-03T10:17:17.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.649+0000 7f8e54c5c700 1 -- 172.21.15.72:0/3792416101 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4800bb20 con 0x7f8e50133930 2023-10-03T10:17:17.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.649+0000 7f8e54c5c700 1 -- 172.21.15.72:0/3792416101 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48012430 con 0x7f8e50133930 2023-10-03T10:17:17.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.650+0000 7f8e57ec2700 1 -- 172.21.15.72:0/3792416101 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e50133930 msgr2=0x7f8e50133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.650+0000 7f8e57ec2700 1 --2- 172.21.15.72:0/3792416101 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e50133930 0x7f8e50133db0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009d90 tx=0x7f8e4800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:17.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.650+0000 7f8e57ec2700 1 -- 172.21.15.72:0/3792416101 shutdown_connections 2023-10-03T10:17:17.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.650+0000 7f8e57ec2700 1 --2- 172.21.15.72:0/3792416101 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e50133930 0x7f8e50133db0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.650+0000 7f8e57ec2700 1 --2- 172.21.15.72:0/3792416101 >> v2:172.21.15.72:3300/0 conn(0x7f8e500a0a30 0x7f8e500a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.650+0000 7f8e57ec2700 1 --2- 172.21.15.72:0/3792416101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e5009d630 0x7f8e500a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.650+0000 7f8e57ec2700 1 -- 172.21.15.72:0/3792416101 >> 172.21.15.72:0/3792416101 conn(0x7f8e500a3050 msgr2=0x7f8e500a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.650+0000 7f8e57ec2700 1 -- 172.21.15.72:0/3792416101 shutdown_connections 2023-10-03T10:17:17.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.650+0000 7f8e57ec2700 1 -- 172.21.15.72:0/3792416101 wait complete. 2023-10-03T10:17:17.653 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:17.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.651+0000 7f8e57ec2700 1 Processor -- start 2023-10-03T10:17:17.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.651+0000 7f8e57ec2700 1 -- start start 2023-10-03T10:17:17.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.651+0000 7f8e57ec2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e5009d630 0x7f8e501c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.651+0000 7f8e57ec2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e500a0a30 0x7f8e501c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.651+0000 7f8e57ec2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e50133930 0x7f8e501c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.651+0000 7f8e57ec2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e50122720 con 0x7f8e500a0a30 2023-10-03T10:17:17.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.651+0000 7f8e57ec2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e501209b0 con 0x7f8e50133930 2023-10-03T10:17:17.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.651+0000 7f8e57ec2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e50120780 con 0x7f8e5009d630 2023-10-03T10:17:17.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.651+0000 7f8e5545d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e500a0a30 0x7f8e501c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.651+0000 7f8e5645f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e50133930 0x7f8e501c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.651+0000 7f8e5645f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e50133930 0x7f8e501c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43594/0 (socket says 172.21.15.72:43594) 2023-10-03T10:17:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.651+0000 7f8e5545d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e500a0a30 0x7f8e501c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54100/0 (socket says 172.21.15.72:54100) 2023-10-03T10:17:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.651+0000 7f8e55c5e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e5009d630 0x7f8e501c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.651+0000 7f8e5645f700 1 -- 172.21.15.72:0/2968952049 learned_addr learned my addr 172.21.15.72:0/2968952049 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.652+0000 7f8e5645f700 1 -- 172.21.15.72:0/2968952049 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e5009d630 msgr2=0x7f8e501c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.652+0000 7f8e5645f700 1 --2- 172.21.15.72:0/2968952049 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e5009d630 0x7f8e501c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.652+0000 7f8e5645f700 1 -- 172.21.15.72:0/2968952049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e500a0a30 msgr2=0x7f8e501c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.652+0000 7f8e5645f700 1 --2- 172.21.15.72:0/2968952049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e500a0a30 0x7f8e501c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.652+0000 7f8e5645f700 1 -- 172.21.15.72:0/2968952049 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e40009550 con 0x7f8e50133930 2023-10-03T10:17:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.652+0000 7f8e5545d700 1 --2- 172.21.15.72:0/2968952049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e500a0a30 0x7f8e501c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.652+0000 7f8e5645f700 1 --2- 172.21.15.72:0/2968952049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e50133930 0x7f8e501c8b10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8e48014040 tx=0x7f8e48004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.652+0000 7f8e467fc700 1 -- 172.21.15.72:0/2968952049 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48012a40 con 0x7f8e50133930 2023-10-03T10:17:17.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.652+0000 7f8e467fc700 1 -- 172.21.15.72:0/2968952049 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e48020070 con 0x7f8e50133930 2023-10-03T10:17:17.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.652+0000 7f8e57ec2700 1 -- 172.21.15.72:0/2968952049 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c0094a0 con 0x7f8e50133930 2023-10-03T10:17:17.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.652+0000 7f8e467fc700 1 -- 172.21.15.72:0/2968952049 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48012e20 con 0x7f8e50133930 2023-10-03T10:17:17.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.652+0000 7f8e57ec2700 1 -- 172.21.15.72:0/2968952049 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e48009a70 con 0x7f8e50133930 2023-10-03T10:17:17.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.653+0000 7f8e57ec2700 1 -- 172.21.15.72:0/2968952049 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e500747f0 con 0x7f8e50133930 2023-10-03T10:17:17.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.653+0000 7f8e467fc700 1 -- 172.21.15.72:0/2968952049 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e48004040 con 0x7f8e50133930 2023-10-03T10:17:17.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.653+0000 7f8e467fc700 1 -- 172.21.15.72:0/2968952049 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8e48022070 con 0x7f8e50133930 2023-10-03T10:17:17.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.658+0000 7f8e467fc700 1 -- 172.21.15.72:0/2968952049 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e4801a740 con 0x7f8e50133930 2023-10-03T10:17:17.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.707+0000 7fad6abd6700 1 Processor -- start 2023-10-03T10:17:17.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.707+0000 7fad6abd6700 1 -- start start 2023-10-03T10:17:17.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.707+0000 7fad6abd6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad640a0a30 0x7fad640a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.707+0000 7fad6abd6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad6409d630 0x7fad640a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.707+0000 7fad6abd6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad640a2a70 con 0x7fad64133930 2023-10-03T10:17:17.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.707+0000 7fad6abd6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad640a01d0 con 0x7fad6409d630 2023-10-03T10:17:17.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.707+0000 7fad6abd6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad6409e2b0 con 0x7fad640a0a30 2023-10-03T10:17:17.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.708+0000 7fad69173700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fad64133930 0x7fad64133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33830/0 (socket says 172.21.15.72:33830) 2023-10-03T10:17:17.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.708+0000 7fad69173700 1 -- 172.21.15.72:0/3307695469 learned_addr learned my addr 172.21.15.72:0/3307695469 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:17.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.708+0000 7fad63fff700 1 --2- 172.21.15.72:0/3307695469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad6409d630 0x7fad640a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.708+0000 7fad68972700 1 --2- 172.21.15.72:0/3307695469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad640a0a30 0x7fad640a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.708+0000 7fad637fe700 1 -- 172.21.15.72:0/3307695469 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525150595 0 0) 0x7fad640a2a70 con 0x7fad64133930 2023-10-03T10:17:17.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.708+0000 7fad63fff700 1 -- 172.21.15.72:0/3307695469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad640a0a30 msgr2=0x7fad640a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.708+0000 7fad63fff700 1 --2- 172.21.15.72:0/3307695469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad640a0a30 0x7fad640a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.708+0000 7fad63fff700 1 -- 172.21.15.72:0/3307695469 >> v1:172.21.15.72:6789/0 conn(0x7fad64133930 legacy=0x7fad64133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.708+0000 7fad63fff700 1 -- 172.21.15.72:0/3307695469 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6409dc50 con 0x7fad6409d630 2023-10-03T10:17:17.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.708+0000 7fad68972700 1 --2- 172.21.15.72:0/3307695469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad640a0a30 0x7fad640a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.708+0000 7fad63fff700 1 --2- 172.21.15.72:0/3307695469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad6409d630 0x7fad640a1340 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fad50009870 tx=0x7fad50009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30f8d8557ea3c3c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.708+0000 7fad637fe700 1 -- 172.21.15.72:0/3307695469 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50011830 con 0x7fad6409d630 2023-10-03T10:17:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.708+0000 7fad637fe700 1 -- 172.21.15.72:0/3307695469 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad50011990 con 0x7fad6409d630 2023-10-03T10:17:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.708+0000 7fad637fe700 1 -- 172.21.15.72:0/3307695469 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50011d20 con 0x7fad6409d630 2023-10-03T10:17:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.709+0000 7fad6abd6700 1 -- 172.21.15.72:0/3307695469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad6409d630 msgr2=0x7fad640a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.709+0000 7fad6abd6700 1 --2- 172.21.15.72:0/3307695469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad6409d630 0x7fad640a1340 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fad50009870 tx=0x7fad50009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.709+0000 7fad6abd6700 1 -- 172.21.15.72:0/3307695469 shutdown_connections 2023-10-03T10:17:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.709+0000 7fad6abd6700 1 --2- 172.21.15.72:0/3307695469 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad640a0a30 0x7fad640a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.709+0000 7fad6abd6700 1 --2- 172.21.15.72:0/3307695469 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad6409d630 0x7fad640a1340 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.709+0000 7fad6abd6700 1 -- 172.21.15.72:0/3307695469 >> 172.21.15.72:0/3307695469 conn(0x7fad640a3050 msgr2=0x7fad640a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.709+0000 7fad6abd6700 1 -- 172.21.15.72:0/3307695469 shutdown_connections 2023-10-03T10:17:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.709+0000 7fad6abd6700 1 -- 172.21.15.72:0/3307695469 wait complete. 2023-10-03T10:17:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.710+0000 7fad6abd6700 1 Processor -- start 2023-10-03T10:17:17.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.710+0000 7fad6abd6700 1 -- start start 2023-10-03T10:17:17.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad6abd6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad6409d630 0x7fad641c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad6abd6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad640a0a30 0x7fad641c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad6abd6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad64133930 0x7fad641c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad6abd6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad64120650 con 0x7fad640a0a30 2023-10-03T10:17:17.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad6abd6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad640a0410 con 0x7fad6409d630 2023-10-03T10:17:17.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad6abd6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad64121e40 con 0x7fad64133930 2023-10-03T10:17:17.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad68972700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad6409d630 0x7fad641c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad68972700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad6409d630 0x7fad641c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43616/0 (socket says 172.21.15.72:43616) 2023-10-03T10:17:17.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad68972700 1 -- 172.21.15.72:0/2813161862 learned_addr learned my addr 172.21.15.72:0/2813161862 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:17.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad69173700 1 --2- 172.21.15.72:0/2813161862 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad64133930 0x7fad641c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad63fff700 1 --2- 172.21.15.72:0/2813161862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad640a0a30 0x7fad641c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad68972700 1 -- 172.21.15.72:0/2813161862 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad64133930 msgr2=0x7fad641c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad68972700 1 --2- 172.21.15.72:0/2813161862 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad64133930 0x7fad641c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad68972700 1 -- 172.21.15.72:0/2813161862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad640a0a30 msgr2=0x7fad641c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad68972700 1 --2- 172.21.15.72:0/2813161862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad640a0a30 0x7fad641c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad68972700 1 -- 172.21.15.72:0/2813161862 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad580094a0 con 0x7fad6409d630 2023-10-03T10:17:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad69173700 1 --2- 172.21.15.72:0/2813161862 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad64133930 0x7fad641c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad63fff700 1 --2- 172.21.15.72:0/2813161862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad640a0a30 0x7fad641c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.711+0000 7fad68972700 1 --2- 172.21.15.72:0/2813161862 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad6409d630 0x7fad641c7f90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fad5800ebe0 tx=0x7fad5800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.712+0000 7fad617fa700 1 -- 172.21.15.72:0/2813161862 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5800c850 con 0x7fad6409d630 2023-10-03T10:17:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.712+0000 7fad617fa700 1 -- 172.21.15.72:0/2813161862 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5800c9b0 con 0x7fad6409d630 2023-10-03T10:17:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.712+0000 7fad6abd6700 1 -- 172.21.15.72:0/2813161862 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad500094a0 con 0x7fad6409d630 2023-10-03T10:17:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.712+0000 7fad617fa700 1 -- 172.21.15.72:0/2813161862 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5800cd40 con 0x7fad6409d630 2023-10-03T10:17:17.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.712+0000 7fad6abd6700 1 -- 172.21.15.72:0/2813161862 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad64121140 con 0x7fad6409d630 2023-10-03T10:17:17.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.713+0000 7fad6abd6700 1 -- 172.21.15.72:0/2813161862 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad640747f0 con 0x7fad6409d630 2023-10-03T10:17:17.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.713+0000 7fad617fa700 1 -- 172.21.15.72:0/2813161862 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad58013470 con 0x7fad6409d630 2023-10-03T10:17:17.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.714+0000 7fad617fa700 1 -- 172.21.15.72:0/2813161862 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fad5803ffc0 con 0x7fad6409d630 2023-10-03T10:17:17.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.718+0000 7fad617fa700 1 -- 172.21.15.72:0/2813161862 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad58013720 con 0x7fad6409d630 2023-10-03T10:17:17.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.786+0000 7fd8a2670700 1 Processor -- start 2023-10-03T10:17:17.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.786+0000 7fd8a2670700 1 -- start start 2023-10-03T10:17:17.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.786+0000 7fd8a2670700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd89c09d630 0x7fd89c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.786+0000 7fd8a2670700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd89c138d80 0x7fd89c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.786+0000 7fd8a2670700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c0a2a70 con 0x7fd89c0a0a30 2023-10-03T10:17:17.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.786+0000 7fd8a2670700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89c0a01d0 con 0x7fd89c138d80 2023-10-03T10:17:17.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.786+0000 7fd8a2670700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c09e2b0 con 0x7fd89c09d630 2023-10-03T10:17:17.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.787+0000 7fd89b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd89c09d630 0x7fd89c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.787+0000 7fd8a0c0d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd89c138d80 0x7fd89c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.787+0000 7fd89b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd89c09d630 0x7fd89c0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:53618/0 (socket says 172.21.15.72:53618) 2023-10-03T10:17:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.787+0000 7fd89bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd89c0a0a30 0x7fd89c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33846/0 (socket says 172.21.15.72:33846) 2023-10-03T10:17:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.787+0000 7fd89b7fe700 1 -- 172.21.15.72:0/3536270905 learned_addr learned my addr 172.21.15.72:0/3536270905 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.787+0000 7fd8a0c0d700 1 -- 172.21.15.72:0/3536270905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd89c09d630 msgr2=0x7fd89c0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.787+0000 7fd8a0c0d700 1 --2- 172.21.15.72:0/3536270905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd89c09d630 0x7fd89c0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.787+0000 7fd8a0c0d700 1 -- 172.21.15.72:0/3536270905 >> v1:172.21.15.72:6789/0 conn(0x7fd89c0a0a30 legacy=0x7fd89c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.787+0000 7fd8a0c0d700 1 -- 172.21.15.72:0/3536270905 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c09dc50 con 0x7fd89c138d80 2023-10-03T10:17:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.787+0000 7fd89affd700 1 -- 172.21.15.72:0/3536270905 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857772339 0 0) 0x7fd89c0a2a70 con 0x7fd89c0a0a30 2023-10-03T10:17:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.787+0000 7fd89b7fe700 1 --2- 172.21.15.72:0/3536270905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd89c09d630 0x7fd89c0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.787+0000 7fd8a0c0d700 1 --2- 172.21.15.72:0/3536270905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd89c138d80 0x7fd89c13b160 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fd894009d90 tx=0x7fd89400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbe08ce8d70d7f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.787+0000 7fd89affd700 1 -- 172.21.15.72:0/3536270905 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89400e070 con 0x7fd89c138d80 2023-10-03T10:17:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.787+0000 7fd89affd700 1 -- 172.21.15.72:0/3536270905 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89400bb20 con 0x7fd89c138d80 2023-10-03T10:17:17.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.787+0000 7fd89affd700 1 -- 172.21.15.72:0/3536270905 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894012430 con 0x7fd89c138d80 2023-10-03T10:17:17.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.788+0000 7fd8a2670700 1 -- 172.21.15.72:0/3536270905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd89c138d80 msgr2=0x7fd89c13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.788+0000 7fd8a2670700 1 --2- 172.21.15.72:0/3536270905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd89c138d80 0x7fd89c13b160 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fd894009d90 tx=0x7fd89400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:17.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.788+0000 7fd8a2670700 1 -- 172.21.15.72:0/3536270905 shutdown_connections 2023-10-03T10:17:17.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.788+0000 7fd8a2670700 1 --2- 172.21.15.72:0/3536270905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd89c138d80 0x7fd89c13b160 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.788+0000 7fd8a2670700 1 --2- 172.21.15.72:0/3536270905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd89c09d630 0x7fd89c0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.788+0000 7fd8a2670700 1 -- 172.21.15.72:0/3536270905 >> 172.21.15.72:0/3536270905 conn(0x7fd89c0a3050 msgr2=0x7fd89c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.788+0000 7fd8a2670700 1 -- 172.21.15.72:0/3536270905 shutdown_connections 2023-10-03T10:17:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.788+0000 7fd8a2670700 1 -- 172.21.15.72:0/3536270905 wait complete. 2023-10-03T10:17:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.789+0000 7fd8a2670700 1 Processor -- start 2023-10-03T10:17:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.789+0000 7fd8a2670700 1 -- start start 2023-10-03T10:17:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd8a2670700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd89c09d630 0x7fd89c1337b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd8a2670700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd89c0a0a30 0x7fd89c133cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd8a2670700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd89c138d80 0x7fd89c134230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd8a2670700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0a0480 con 0x7fd89c09d630 2023-10-03T10:17:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd8a2670700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c136bb0 con 0x7fd89c138d80 2023-10-03T10:17:17.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd8a2670700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c137150 con 0x7fd89c0a0a30 2023-10-03T10:17:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd89bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd89c09d630 0x7fd89c1337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd89bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd89c09d630 0x7fd89c1337b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54130/0 (socket says 172.21.15.72:54130) 2023-10-03T10:17:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd89bfff700 1 -- 172.21.15.72:0/970150618 learned_addr learned my addr 172.21.15.72:0/970150618 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd89b7fe700 1 --2- 172.21.15.72:0/970150618 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd89c0a0a30 0x7fd89c133cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd8a0c0d700 1 --2- 172.21.15.72:0/970150618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd89c138d80 0x7fd89c134230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd89bfff700 1 -- 172.21.15.72:0/970150618 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd89c0a0a30 msgr2=0x7fd89c133cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd89bfff700 1 --2- 172.21.15.72:0/970150618 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd89c0a0a30 0x7fd89c133cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd89bfff700 1 -- 172.21.15.72:0/970150618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd89c138d80 msgr2=0x7fd89c134230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd89bfff700 1 --2- 172.21.15.72:0/970150618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd89c138d80 0x7fd89c134230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd89bfff700 1 -- 172.21.15.72:0/970150618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd890009550 con 0x7fd89c09d630 2023-10-03T10:17:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd89bfff700 1 --2- 172.21.15.72:0/970150618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd89c09d630 0x7fd89c1337b0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00c550 tx=0x7fd88c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd898ff9700 1 -- 172.21.15.72:0/970150618 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c004c80 con 0x7fd89c09d630 2023-10-03T10:17:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd898ff9700 1 -- 172.21.15.72:0/970150618 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c004e00 con 0x7fd89c09d630 2023-10-03T10:17:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd8a2670700 1 -- 172.21.15.72:0/970150618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd894009a70 con 0x7fd89c09d630 2023-10-03T10:17:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd898ff9700 1 -- 172.21.15.72:0/970150618 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c007310 con 0x7fd89c09d630 2023-10-03T10:17:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.790+0000 7fd8a2670700 1 -- 172.21.15.72:0/970150618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c137d30 con 0x7fd89c09d630 2023-10-03T10:17:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.791+0000 7fd898ff9700 1 -- 172.21.15.72:0/970150618 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd88c007470 con 0x7fd89c09d630 2023-10-03T10:17:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.791+0000 7fd898ff9700 1 -- 172.21.15.72:0/970150618 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd88c03f3d0 con 0x7fd89c09d630 2023-10-03T10:17:17.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.792+0000 7fd8a2670700 1 -- 172.21.15.72:0/970150618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89c1368e0 con 0x7fd89c09d630 2023-10-03T10:17:17.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.796+0000 7fd898ff9700 1 -- 172.21.15.72:0/970150618 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd88c0123b0 con 0x7fd89c09d630 2023-10-03T10:17:17.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.857+0000 7f8e57ec2700 1 -- 172.21.15.72:0/2968952049 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8e50121700 con 0x7f8e50133930 2023-10-03T10:17:17.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.857+0000 7f8e467fc700 1 -- 172.21.15.72:0/2968952049 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8e4801a380 con 0x7f8e50133930 2023-10-03T10:17:17.858 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:17.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.860+0000 7f8e57ec2700 1 -- 172.21.15.72:0/2968952049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e50133930 msgr2=0x7f8e501c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.860+0000 7f8e57ec2700 1 --2- 172.21.15.72:0/2968952049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e50133930 0x7f8e501c8b10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8e48014040 tx=0x7f8e48004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.861+0000 7f8e57ec2700 1 -- 172.21.15.72:0/2968952049 shutdown_connections 2023-10-03T10:17:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.861+0000 7f8e57ec2700 1 --2- 172.21.15.72:0/2968952049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e50133930 0x7f8e501c8b10 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.861+0000 7f8e57ec2700 1 --2- 172.21.15.72:0/2968952049 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e5009d630 0x7f8e501c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.861+0000 7f8e57ec2700 1 --2- 172.21.15.72:0/2968952049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e500a0a30 0x7f8e501c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.861+0000 7f8e57ec2700 1 -- 172.21.15.72:0/2968952049 >> 172.21.15.72:0/2968952049 conn(0x7f8e500a3050 msgr2=0x7f8e5009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.861+0000 7f8e57ec2700 1 -- 172.21.15.72:0/2968952049 shutdown_connections 2023-10-03T10:17:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.861+0000 7f8e57ec2700 1 -- 172.21.15.72:0/2968952049 wait complete. 2023-10-03T10:17:17.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:17.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.922+0000 7fad6abd6700 1 -- 172.21.15.72:0/2813161862 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad64072980 con 0x7fad6409d630 2023-10-03T10:17:17.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.923+0000 7fad617fa700 1 -- 172.21.15.72:0/2813161862 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fad5802a090 con 0x7fad6409d630 2023-10-03T10:17:17.923 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:17.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.924+0000 7fad6abd6700 1 -- 172.21.15.72:0/2813161862 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad6409d630 msgr2=0x7fad641c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.925+0000 7fad6abd6700 1 --2- 172.21.15.72:0/2813161862 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad6409d630 0x7fad641c7f90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fad5800ebe0 tx=0x7fad5800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.925+0000 7fad6abd6700 1 -- 172.21.15.72:0/2813161862 shutdown_connections 2023-10-03T10:17:17.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.925+0000 7fad6abd6700 1 --2- 172.21.15.72:0/2813161862 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fad64133930 0x7fad641c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.925+0000 7fad6abd6700 1 --2- 172.21.15.72:0/2813161862 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad6409d630 0x7fad641c7f90 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.925+0000 7fad6abd6700 1 --2- 172.21.15.72:0/2813161862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad640a0a30 0x7fad641c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.925+0000 7fad6abd6700 1 -- 172.21.15.72:0/2813161862 >> 172.21.15.72:0/2813161862 conn(0x7fad640a3050 msgr2=0x7fad641bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.925+0000 7fad6abd6700 1 -- 172.21.15.72:0/2813161862 shutdown_connections 2023-10-03T10:17:17.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.925+0000 7fad6abd6700 1 -- 172.21.15.72:0/2813161862 wait complete. 2023-10-03T10:17:17.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:17.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.989+0000 7fd8a2670700 1 -- 172.21.15.72:0/970150618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd89c135aa0 con 0x7fd89c09d630 2023-10-03T10:17:17.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.990+0000 7fd898ff9700 1 -- 172.21.15.72:0/970150618 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd88c0102c0 con 0x7fd89c09d630 2023-10-03T10:17:17.990 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.992+0000 7fd8a2670700 1 -- 172.21.15.72:0/970150618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd89c09d630 msgr2=0x7fd89c1337b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.992+0000 7fd8a2670700 1 --2- 172.21.15.72:0/970150618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd89c09d630 0x7fd89c1337b0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00c550 tx=0x7fd88c00c910 comp rx=0 tx=0).stop 2023-10-03T10:17:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.992+0000 7fd8a2670700 1 -- 172.21.15.72:0/970150618 shutdown_connections 2023-10-03T10:17:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.992+0000 7fd8a2670700 1 --2- 172.21.15.72:0/970150618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd89c09d630 0x7fd89c1337b0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.992+0000 7fd8a2670700 1 --2- 172.21.15.72:0/970150618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd89c138d80 0x7fd89c134230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.992+0000 7fd8a2670700 1 --2- 172.21.15.72:0/970150618 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd89c0a0a30 0x7fd89c133cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.992+0000 7fd8a2670700 1 -- 172.21.15.72:0/970150618 >> 172.21.15.72:0/970150618 conn(0x7fd89c0a3050 msgr2=0x7fd89c139720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.992+0000 7fd8a2670700 1 -- 172.21.15.72:0/970150618 shutdown_connections 2023-10-03T10:17:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:17.992+0000 7fd8a2670700 1 -- 172.21.15.72:0/970150618 wait complete. 2023-10-03T10:17:18.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:18.640 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:18.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.767+0000 7f3eb4a0e700 1 Processor -- start 2023-10-03T10:17:18.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.767+0000 7f3eb4a0e700 1 -- start start 2023-10-03T10:17:18.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.767+0000 7f3eb4a0e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb009d6f0 0x7f3eb009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.767+0000 7f3eb4a0e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3eb009e410 0x7f3eb0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.767+0000 7f3eb4a0e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb009b120 con 0x7f3eb009e000 2023-10-03T10:17:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.767+0000 7f3eb4a0e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb006b460 con 0x7f3eb009e410 2023-10-03T10:17:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.767+0000 7f3eb4a0e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb009a7e0 con 0x7f3eb009d6f0 2023-10-03T10:17:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.768+0000 7f3eaed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3eb009e410 0x7f3eb0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.768+0000 7f3eae59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb009d6f0 0x7f3eb009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.768+0000 7f3eaed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3eb009e410 0x7f3eb0134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35544/0 (socket says 172.21.15.72:35544) 2023-10-03T10:17:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.768+0000 7f3eaed9d700 1 -- 172.21.15.72:0/1117263945 learned_addr learned my addr 172.21.15.72:0/1117263945 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.768+0000 7f3eae59c700 1 -- 172.21.15.72:0/1117263945 >> v2:172.21.15.72:3300/0 conn(0x7f3eb009e410 msgr2=0x7f3eb0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.768+0000 7f3eae59c700 1 --2- 172.21.15.72:0/1117263945 >> v2:172.21.15.72:3300/0 conn(0x7f3eb009e410 0x7f3eb0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.768+0000 7f3eae59c700 1 -- 172.21.15.72:0/1117263945 >> v1:172.21.15.72:6789/0 conn(0x7f3eb009e000 legacy=0x7f3eb01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.768+0000 7f3eae59c700 1 -- 172.21.15.72:0/1117263945 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb009a500 con 0x7f3eb009d6f0 2023-10-03T10:17:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.768+0000 7f3ead59a700 1 -- 172.21.15.72:0/1117263945 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623052017 0 0) 0x7f3eb009b120 con 0x7f3eb009e000 2023-10-03T10:17:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.768+0000 7f3eaed9d700 1 --2- 172.21.15.72:0/1117263945 >> v2:172.21.15.72:3300/0 conn(0x7f3eb009e410 0x7f3eb0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.768+0000 7f3eae59c700 1 --2- 172.21.15.72:0/1117263945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb009d6f0 0x7f3eb009dac0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009870 tx=0x7f3ea0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f511558435c95351 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.768+0000 7f3ead59a700 1 -- 172.21.15.72:0/1117263945 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0011830 con 0x7f3eb009d6f0 2023-10-03T10:17:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.768+0000 7f3ead59a700 1 -- 172.21.15.72:0/1117263945 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea0011990 con 0x7f3eb009d6f0 2023-10-03T10:17:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.768+0000 7f3ead59a700 1 -- 172.21.15.72:0/1117263945 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0011d20 con 0x7f3eb009d6f0 2023-10-03T10:17:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.769+0000 7f3eb4a0e700 1 -- 172.21.15.72:0/1117263945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb009d6f0 msgr2=0x7f3eb009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.769+0000 7f3eb4a0e700 1 --2- 172.21.15.72:0/1117263945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb009d6f0 0x7f3eb009dac0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009870 tx=0x7f3ea0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:18.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.769+0000 7f3eb4a0e700 1 -- 172.21.15.72:0/1117263945 shutdown_connections 2023-10-03T10:17:18.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.769+0000 7f3eb4a0e700 1 --2- 172.21.15.72:0/1117263945 >> v2:172.21.15.72:3300/0 conn(0x7f3eb009e410 0x7f3eb0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.769+0000 7f3eb4a0e700 1 --2- 172.21.15.72:0/1117263945 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb009d6f0 0x7f3eb009dac0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.769+0000 7f3eb4a0e700 1 -- 172.21.15.72:0/1117263945 >> 172.21.15.72:0/1117263945 conn(0x7f3eb0066f50 msgr2=0x7f3eb009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.769+0000 7f3eb4a0e700 1 -- 172.21.15.72:0/1117263945 shutdown_connections 2023-10-03T10:17:18.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.769+0000 7f3eb4a0e700 1 -- 172.21.15.72:0/1117263945 wait complete. 2023-10-03T10:17:18.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.770+0000 7f3eb4a0e700 1 Processor -- start 2023-10-03T10:17:18.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.770+0000 7f3eb4a0e700 1 -- start start 2023-10-03T10:17:18.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.770+0000 7f3eb4a0e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb009d6f0 0x7f3eb01c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.770+0000 7f3eb4a0e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb009e000 0x7f3eb01c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.770+0000 7f3eb4a0e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb009e410 0x7f3eb01c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:18.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.770+0000 7f3eb4a0e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb01a6660 con 0x7f3eb009e410 2023-10-03T10:17:18.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.770+0000 7f3eb4a0e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb01a6430 con 0x7f3eb009e000 2023-10-03T10:17:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.770+0000 7f3eb4a0e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb01a70a0 con 0x7f3eb009d6f0 2023-10-03T10:17:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.770+0000 7f3eae59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb009d6f0 0x7f3eb01c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.770+0000 7f3eaed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb009e410 0x7f3eb01c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.770+0000 7f3eadd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb009e000 0x7f3eb01c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.770+0000 7f3eaed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb009e410 0x7f3eb01c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35560/0 (socket says 172.21.15.72:35560) 2023-10-03T10:17:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.770+0000 7f3eae59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb009d6f0 0x7f3eb01c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48848/0 (socket says 172.21.15.72:48848) 2023-10-03T10:17:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.770+0000 7f3eaed9d700 1 -- 172.21.15.72:0/1727734468 learned_addr learned my addr 172.21.15.72:0/1727734468 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.771+0000 7f3eaed9d700 1 -- 172.21.15.72:0/1727734468 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb009d6f0 msgr2=0x7f3eb01c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.771+0000 7f3eaed9d700 1 --2- 172.21.15.72:0/1727734468 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb009d6f0 0x7f3eb01c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.771+0000 7f3eaed9d700 1 -- 172.21.15.72:0/1727734468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb009e000 msgr2=0x7f3eb01c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.771+0000 7f3eaed9d700 1 --2- 172.21.15.72:0/1727734468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb009e000 0x7f3eb01c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.771+0000 7f3eaed9d700 1 -- 172.21.15.72:0/1727734468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea8009b30 con 0x7f3eb009e410 2023-10-03T10:17:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.771+0000 7f3eadd9b700 1 --2- 172.21.15.72:0/1727734468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb009e000 0x7f3eb01c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.771+0000 7f3eaed9d700 1 --2- 172.21.15.72:0/1727734468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb009e410 0x7f3eb01c8b10 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009f10 tx=0x7f3ea800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.771+0000 7f3e9effd700 1 -- 172.21.15.72:0/1727734468 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8018070 con 0x7f3eb009e410 2023-10-03T10:17:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.771+0000 7f3e9effd700 1 -- 172.21.15.72:0/1727734468 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea800f040 con 0x7f3eb009e410 2023-10-03T10:17:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.771+0000 7f3e9effd700 1 -- 172.21.15.72:0/1727734468 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8003c40 con 0x7f3eb009e410 2023-10-03T10:17:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.771+0000 7f3eb4a0e700 1 -- 172.21.15.72:0/1727734468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea00094a0 con 0x7f3eb009e410 2023-10-03T10:17:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.771+0000 7f3eb4a0e700 1 -- 172.21.15.72:0/1727734468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb01a7e00 con 0x7f3eb009e410 2023-10-03T10:17:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.772+0000 7f3e9effd700 1 -- 172.21.15.72:0/1727734468 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ea800c940 con 0x7f3eb009e410 2023-10-03T10:17:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.772+0000 7f3e9effd700 1 -- 172.21.15.72:0/1727734468 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3ea803f670 con 0x7f3eb009e410 2023-10-03T10:17:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.772+0000 7f3eb4a0e700 1 -- 172.21.15.72:0/1727734468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb01a7fc0 con 0x7f3eb009e410 2023-10-03T10:17:18.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.777+0000 7f3e9effd700 1 -- 172.21.15.72:0/1727734468 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ea801c9c0 con 0x7f3eb009e410 2023-10-03T10:17:18.879 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:18.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:18.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.975+0000 7f3eb4a0e700 1 -- 172.21.15.72:0/1727734468 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3eb0074ea0 con 0x7f3eb009e410 2023-10-03T10:17:18.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.975+0000 7f3e9effd700 1 -- 172.21.15.72:0/1727734468 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ea801c370 con 0x7f3eb009e410 2023-10-03T10:17:18.976 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:18.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.977+0000 7f3eb4a0e700 1 -- 172.21.15.72:0/1727734468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb009e410 msgr2=0x7f3eb01c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.977+0000 7f3eb4a0e700 1 --2- 172.21.15.72:0/1727734468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb009e410 0x7f3eb01c8b10 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009f10 tx=0x7f3ea800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.977+0000 7f3eb4a0e700 1 -- 172.21.15.72:0/1727734468 shutdown_connections 2023-10-03T10:17:18.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.977+0000 7f3eb4a0e700 1 --2- 172.21.15.72:0/1727734468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3eb009e410 0x7f3eb01c8b10 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.977+0000 7f3eb4a0e700 1 --2- 172.21.15.72:0/1727734468 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3eb009d6f0 0x7f3eb01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.977+0000 7f3eb4a0e700 1 --2- 172.21.15.72:0/1727734468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3eb009e000 0x7f3eb01c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.977+0000 7f3eb4a0e700 1 -- 172.21.15.72:0/1727734468 >> 172.21.15.72:0/1727734468 conn(0x7f3eb0066f50 msgr2=0x7f3eb01bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.977+0000 7f3eb4a0e700 1 -- 172.21.15.72:0/1727734468 shutdown_connections 2023-10-03T10:17:18.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:18.977+0000 7f3eb4a0e700 1 -- 172.21.15.72:0/1727734468 wait complete. 2023-10-03T10:17:18.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:19.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:19.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.005+0000 7f1e7ffff700 1 Processor -- start 2023-10-03T10:17:19.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.005+0000 7f1e7ffff700 1 -- start start 2023-10-03T10:17:19.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e8009f8a0 0x7f1e80138ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e8009f150 0x7f1e8013b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7ffff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e800a0240 con 0x7f1e8009e670 2023-10-03T10:17:19.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7ffff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8006c9a0 con 0x7f1e8009f8a0 2023-10-03T10:17:19.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7ffff700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8006b880 con 0x7f1e8009f150 2023-10-03T10:17:19.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e8009f8a0 0x7f1e80138ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1e8009e670 0x7f1e8009ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39594/0 (socket says 172.21.15.72:39594) 2023-10-03T10:17:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7effd700 1 -- 172.21.15.72:0/2654854387 learned_addr learned my addr 172.21.15.72:0/2654854387 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7f7fe700 1 --2- 172.21.15.72:0/2654854387 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e8009f150 0x7f1e8013b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7dffb700 1 -- 172.21.15.72:0/2654854387 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264890409 0 0) 0x7f1e800a0240 con 0x7f1e8009e670 2023-10-03T10:17:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7dffb700 1 -- 172.21.15.72:0/2654854387 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e680035b0 con 0x7f1e8009e670 2023-10-03T10:17:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7e7fc700 1 -- 172.21.15.72:0/2654854387 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e8009f150 msgr2=0x7f1e8013b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7e7fc700 1 --2- 172.21.15.72:0/2654854387 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e8009f150 0x7f1e8013b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7e7fc700 1 -- 172.21.15.72:0/2654854387 >> v1:172.21.15.72:6789/0 conn(0x7f1e8009e670 legacy=0x7f1e8009ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7e7fc700 1 -- 172.21.15.72:0/2654854387 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8006bde0 con 0x7f1e8009f8a0 2023-10-03T10:17:19.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7f7fe700 1 --2- 172.21.15.72:0/2654854387 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e8009f150 0x7f1e8013b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.006+0000 7f1e7e7fc700 1 --2- 172.21.15.72:0/2654854387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e8009f8a0 0x7f1e80138ba0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009870 tx=0x7f1e74009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db7c1334efb51df2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.007+0000 7f1e7dffb700 1 -- 172.21.15.72:0/2654854387 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74011830 con 0x7f1e8009f8a0 2023-10-03T10:17:19.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.007+0000 7f1e7dffb700 1 -- 172.21.15.72:0/2654854387 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e74011990 con 0x7f1e8009f8a0 2023-10-03T10:17:19.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.007+0000 7f1e7dffb700 1 -- 172.21.15.72:0/2654854387 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74011d20 con 0x7f1e8009f8a0 2023-10-03T10:17:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.007+0000 7f1e7ffff700 1 -- 172.21.15.72:0/2654854387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e8009f8a0 msgr2=0x7f1e80138ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.007+0000 7f1e7ffff700 1 --2- 172.21.15.72:0/2654854387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e8009f8a0 0x7f1e80138ba0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009870 tx=0x7f1e74009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.007+0000 7f1e7ffff700 1 -- 172.21.15.72:0/2654854387 shutdown_connections 2023-10-03T10:17:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.007+0000 7f1e7ffff700 1 --2- 172.21.15.72:0/2654854387 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e8009f150 0x7f1e8013b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.007+0000 7f1e7ffff700 1 --2- 172.21.15.72:0/2654854387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e8009f8a0 0x7f1e80138ba0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.007+0000 7f1e7ffff700 1 -- 172.21.15.72:0/2654854387 >> 172.21.15.72:0/2654854387 conn(0x7f1e800a0c90 msgr2=0x7f1e800a1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.007+0000 7f1e7ffff700 1 -- 172.21.15.72:0/2654854387 shutdown_connections 2023-10-03T10:17:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.009+0000 7f1e7ffff700 1 -- 172.21.15.72:0/2654854387 wait complete. 2023-10-03T10:17:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.010+0000 7f1e7ffff700 1 Processor -- start 2023-10-03T10:17:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.010+0000 7f1e7ffff700 1 -- start start 2023-10-03T10:17:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.010+0000 7f1e7ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e8009e670 0x7f1e80139000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.010+0000 7f1e7ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e8009f150 0x7f1e80139540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.010+0000 7f1e7ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e8009f8a0 0x7f1e80139a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.010+0000 7f1e7ffff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8011fa30 con 0x7f1e8009f150 2023-10-03T10:17:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.010+0000 7f1e7ffff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8013ab80 con 0x7f1e8009e670 2023-10-03T10:17:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.010+0000 7f1e7ffff700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8011efb0 con 0x7f1e8009f8a0 2023-10-03T10:17:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.010+0000 7f1e7effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e8009e670 0x7f1e80139000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.011+0000 7f1e7effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e8009e670 0x7f1e80139000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50772/0 (socket says 172.21.15.72:50772) 2023-10-03T10:17:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.011+0000 7f1e7effd700 1 -- 172.21.15.72:0/961237614 learned_addr learned my addr 172.21.15.72:0/961237614 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.011+0000 7f1e7f7fe700 1 --2- 172.21.15.72:0/961237614 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e8009f8a0 0x7f1e80139a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.010+0000 7f1e7e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e8009f150 0x7f1e80139540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.011+0000 7f1e7effd700 1 -- 172.21.15.72:0/961237614 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e8009f8a0 msgr2=0x7f1e80139a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.011+0000 7f1e7effd700 1 --2- 172.21.15.72:0/961237614 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e8009f8a0 0x7f1e80139a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.011+0000 7f1e7effd700 1 -- 172.21.15.72:0/961237614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e8009f150 msgr2=0x7f1e80139540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.011+0000 7f1e7effd700 1 --2- 172.21.15.72:0/961237614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e8009f150 0x7f1e80139540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.011+0000 7f1e7effd700 1 -- 172.21.15.72:0/961237614 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e78009a70 con 0x7f1e8009e670 2023-10-03T10:17:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.011+0000 7f1e7effd700 1 --2- 172.21.15.72:0/961237614 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e8009e670 0x7f1e80139000 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1e70001eb0 tx=0x7f1e7000c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.011+0000 7f1e677fe700 1 -- 172.21.15.72:0/961237614 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7000cea0 con 0x7f1e8009e670 2023-10-03T10:17:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.011+0000 7f1e677fe700 1 -- 172.21.15.72:0/961237614 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e70005d70 con 0x7f1e8009e670 2023-10-03T10:17:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.011+0000 7f1e677fe700 1 -- 172.21.15.72:0/961237614 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e700072d0 con 0x7f1e8009e670 2023-10-03T10:17:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.011+0000 7f1e7ffff700 1 -- 172.21.15.72:0/961237614 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e740094a0 con 0x7f1e8009e670 2023-10-03T10:17:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.011+0000 7f1e7ffff700 1 -- 172.21.15.72:0/961237614 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e800a0480 con 0x7f1e8009e670 2023-10-03T10:17:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.012+0000 7f1e677fe700 1 -- 172.21.15.72:0/961237614 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e70007430 con 0x7f1e8009e670 2023-10-03T10:17:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.012+0000 7f1e677fe700 1 -- 172.21.15.72:0/961237614 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1e7003ea00 con 0x7f1e8009e670 2023-10-03T10:17:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.013+0000 7f1e7ffff700 1 -- 172.21.15.72:0/961237614 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8004f2a0 con 0x7f1e8009e670 2023-10-03T10:17:19.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.017+0000 7f1e677fe700 1 -- 172.21.15.72:0/961237614 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e70017080 con 0x7f1e8009e670 2023-10-03T10:17:19.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.080+0000 7f4da6771700 1 Processor -- start 2023-10-03T10:17:19.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.080+0000 7f4da6771700 1 -- start start 2023-10-03T10:17:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.080+0000 7f4da6771700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4da006a770 0x7f4da006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.080+0000 7f4da6771700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4da0131d10 0x7f4da0139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.080+0000 7f4da6771700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da009ece0 con 0x7f4da006b080 2023-10-03T10:17:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.080+0000 7f4da6771700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da009e760 con 0x7f4da006a770 2023-10-03T10:17:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.080+0000 7f4da6771700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4da009e040 con 0x7f4da0131d10 2023-10-03T10:17:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.080+0000 7f4da4d0e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4da0131d10 0x7f4da0139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.080+0000 7f4d9f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4da006b080 0x7f4da0131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39596/0 (socket says 172.21.15.72:39596) 2023-10-03T10:17:19.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.080+0000 7f4d9f7fe700 1 -- 172.21.15.72:0/3221484218 learned_addr learned my addr 172.21.15.72:0/3221484218 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.080+0000 7f4d9ffff700 1 --2- 172.21.15.72:0/3221484218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4da006a770 0x7f4da006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.081+0000 7f4da4d0e700 1 -- 172.21.15.72:0/3221484218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4da006a770 msgr2=0x7f4da006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.081+0000 7f4da4d0e700 1 --2- 172.21.15.72:0/3221484218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4da006a770 0x7f4da006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.081+0000 7f4da4d0e700 1 -- 172.21.15.72:0/3221484218 >> v1:172.21.15.72:6789/0 conn(0x7f4da006b080 legacy=0x7f4da0131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.081+0000 7f4d9effd700 1 -- 172.21.15.72:0/3221484218 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047858285 0 0) 0x7f4da009ece0 con 0x7f4da006b080 2023-10-03T10:17:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.081+0000 7f4da4d0e700 1 -- 172.21.15.72:0/3221484218 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da009f630 con 0x7f4da0131d10 2023-10-03T10:17:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.081+0000 7f4d9ffff700 1 --2- 172.21.15.72:0/3221484218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4da006a770 0x7f4da006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.081+0000 7f4da4d0e700 1 --2- 172.21.15.72:0/3221484218 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4da0131d10 0x7f4da0139860 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009dc0 tx=0x7f4d9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59e6cbea17111274 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.081+0000 7f4d9effd700 1 -- 172.21.15.72:0/3221484218 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9800e070 con 0x7f4da0131d10 2023-10-03T10:17:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.081+0000 7f4d9effd700 1 -- 172.21.15.72:0/3221484218 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9800bb20 con 0x7f4da0131d10 2023-10-03T10:17:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.081+0000 7f4d9effd700 1 -- 172.21.15.72:0/3221484218 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98012430 con 0x7f4da0131d10 2023-10-03T10:17:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.082+0000 7f4da6771700 1 -- 172.21.15.72:0/3221484218 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4da0131d10 msgr2=0x7f4da0139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.082+0000 7f4da6771700 1 --2- 172.21.15.72:0/3221484218 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4da0131d10 0x7f4da0139860 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009dc0 tx=0x7f4d9800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.082+0000 7f4da6771700 1 -- 172.21.15.72:0/3221484218 shutdown_connections 2023-10-03T10:17:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.082+0000 7f4da6771700 1 --2- 172.21.15.72:0/3221484218 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4da0131d10 0x7f4da0139860 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.082+0000 7f4da6771700 1 --2- 172.21.15.72:0/3221484218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4da006a770 0x7f4da006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.082+0000 7f4da6771700 1 -- 172.21.15.72:0/3221484218 >> 172.21.15.72:0/3221484218 conn(0x7f4da0066f50 msgr2=0x7f4da009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.082+0000 7f4da6771700 1 -- 172.21.15.72:0/3221484218 shutdown_connections 2023-10-03T10:17:19.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.082+0000 7f4da6771700 1 -- 172.21.15.72:0/3221484218 wait complete. 2023-10-03T10:17:19.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.083+0000 7f4da6771700 1 Processor -- start 2023-10-03T10:17:19.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.083+0000 7f4da6771700 1 -- start start 2023-10-03T10:17:19.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.083+0000 7f4da6771700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4da006a770 0x7f4da01203f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.083+0000 7f4da6771700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4da006b080 0x7f4da0120930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.083+0000 7f4da6771700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4da0131d10 0x7f4da0120e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.083+0000 7f4da6771700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da0123cc0 con 0x7f4da006b080 2023-10-03T10:17:19.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.083+0000 7f4da6771700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da0123ec0 con 0x7f4da0131d10 2023-10-03T10:17:19.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.083+0000 7f4da6771700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4da0130ea0 con 0x7f4da006a770 2023-10-03T10:17:19.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4d9f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4da006b080 0x7f4da0120930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4da4d0e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4da0131d10 0x7f4da0120e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4d9ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4da006a770 0x7f4da01203f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4d9f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4da006b080 0x7f4da0120930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35582/0 (socket says 172.21.15.72:35582) 2023-10-03T10:17:19.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4d9f7fe700 1 -- 172.21.15.72:0/3147531085 learned_addr learned my addr 172.21.15.72:0/3147531085 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:19.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4d9f7fe700 1 -- 172.21.15.72:0/3147531085 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4da006a770 msgr2=0x7f4da01203f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4d9f7fe700 1 --2- 172.21.15.72:0/3147531085 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4da006a770 0x7f4da01203f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4d9f7fe700 1 -- 172.21.15.72:0/3147531085 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4da0131d10 msgr2=0x7f4da0120e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4d9f7fe700 1 --2- 172.21.15.72:0/3147531085 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4da0131d10 0x7f4da0120e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4d9f7fe700 1 -- 172.21.15.72:0/3147531085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d900094a0 con 0x7f4da006b080 2023-10-03T10:17:19.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4d9ffff700 1 --2- 172.21.15.72:0/3147531085 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4da006a770 0x7f4da01203f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4d9f7fe700 1 --2- 172.21.15.72:0/3147531085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4da006b080 0x7f4da0120930 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f4d94001eb0 tx=0x7f4d9400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4d9cff9700 1 -- 172.21.15.72:0/3147531085 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94004c80 con 0x7f4da006b080 2023-10-03T10:17:19.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4d9cff9700 1 -- 172.21.15.72:0/3147531085 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d94004de0 con 0x7f4da006b080 2023-10-03T10:17:19.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4d9cff9700 1 -- 172.21.15.72:0/3147531085 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94007310 con 0x7f4da006b080 2023-10-03T10:17:19.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4da6771700 1 -- 172.21.15.72:0/3147531085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d98009a70 con 0x7f4da006b080 2023-10-03T10:17:19.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.084+0000 7f4da6771700 1 -- 172.21.15.72:0/3147531085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da006ed20 con 0x7f4da006b080 2023-10-03T10:17:19.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.085+0000 7f4d9cff9700 1 -- 172.21.15.72:0/3147531085 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d94007470 con 0x7f4da006b080 2023-10-03T10:17:19.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.085+0000 7f4d9cff9700 1 -- 172.21.15.72:0/3147531085 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d9403f2c0 con 0x7f4da006b080 2023-10-03T10:17:19.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.085+0000 7f4da6771700 1 -- 172.21.15.72:0/3147531085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da0074ea0 con 0x7f4da006b080 2023-10-03T10:17:19.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.090+0000 7f4d9cff9700 1 -- 172.21.15.72:0/3147531085 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d940123b0 con 0x7f4da006b080 2023-10-03T10:17:19.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.143+0000 7fc03f510700 1 Processor -- start 2023-10-03T10:17:19.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.144+0000 7fc03f510700 1 -- start start 2023-10-03T10:17:19.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.144+0000 7fc03f510700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc0380a1510 0x7fc038138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.144+0000 7fc03f510700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc038139250 0x7fc03813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.144+0000 7fc03f510700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03809edd0 con 0x7fc0380a0a30 2023-10-03T10:17:19.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.144+0000 7fc03f510700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0380a18e0 con 0x7fc0380a1510 2023-10-03T10:17:19.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.144+0000 7fc03f510700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03809e1f0 con 0x7fc038139250 2023-10-03T10:17:19.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.144+0000 7fc03daad700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc038139250 0x7fc03813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.144+0000 7fc03d2ac700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc0380a0a30 0x7fc0380a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39604/0 (socket says 172.21.15.72:39604) 2023-10-03T10:17:19.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.144+0000 7fc03d2ac700 1 -- 172.21.15.72:0/2559161227 learned_addr learned my addr 172.21.15.72:0/2559161227 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:19.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.144+0000 7fc03daad700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc038139250 0x7fc03813b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50796/0 (socket says 172.21.15.72:50796) 2023-10-03T10:17:19.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.144+0000 7fc03caab700 1 --2- 172.21.15.72:0/2559161227 >> v2:172.21.15.72:3300/0 conn(0x7fc0380a1510 0x7fc038138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.144+0000 7fc03daad700 1 -- 172.21.15.72:0/2559161227 >> v2:172.21.15.72:3300/0 conn(0x7fc0380a1510 msgr2=0x7fc038138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.144+0000 7fc03daad700 1 --2- 172.21.15.72:0/2559161227 >> v2:172.21.15.72:3300/0 conn(0x7fc0380a1510 0x7fc038138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.144+0000 7fc03daad700 1 -- 172.21.15.72:0/2559161227 >> v1:172.21.15.72:6789/0 conn(0x7fc0380a0a30 legacy=0x7fc0380a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.144+0000 7fc02ffff700 1 -- 172.21.15.72:0/2559161227 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041721604 0 0) 0x7fc03809edd0 con 0x7fc0380a0a30 2023-10-03T10:17:19.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.145+0000 7fc03daad700 1 -- 172.21.15.72:0/2559161227 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03809dc50 con 0x7fc038139250 2023-10-03T10:17:19.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.145+0000 7fc03caab700 1 --2- 172.21.15.72:0/2559161227 >> v2:172.21.15.72:3300/0 conn(0x7fc0380a1510 0x7fc038138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.145+0000 7fc03daad700 1 --2- 172.21.15.72:0/2559161227 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc038139250 0x7fc03813b630 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc030009d90 tx=0x7fc03000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98dc0f9ccb9c012 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.145+0000 7fc02ffff700 1 -- 172.21.15.72:0/2559161227 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03000e070 con 0x7fc038139250 2023-10-03T10:17:19.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.145+0000 7fc02ffff700 1 -- 172.21.15.72:0/2559161227 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03000bb20 con 0x7fc038139250 2023-10-03T10:17:19.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.145+0000 7fc02ffff700 1 -- 172.21.15.72:0/2559161227 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030012430 con 0x7fc038139250 2023-10-03T10:17:19.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.145+0000 7fc03f510700 1 -- 172.21.15.72:0/2559161227 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc038139250 msgr2=0x7fc03813b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.145+0000 7fc03f510700 1 --2- 172.21.15.72:0/2559161227 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc038139250 0x7fc03813b630 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc030009d90 tx=0x7fc03000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.145+0000 7fc03f510700 1 -- 172.21.15.72:0/2559161227 shutdown_connections 2023-10-03T10:17:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.145+0000 7fc03f510700 1 --2- 172.21.15.72:0/2559161227 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc038139250 0x7fc03813b630 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.145+0000 7fc03f510700 1 --2- 172.21.15.72:0/2559161227 >> v2:172.21.15.72:3300/0 conn(0x7fc0380a1510 0x7fc038138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.146+0000 7fc03f510700 1 -- 172.21.15.72:0/2559161227 >> 172.21.15.72:0/2559161227 conn(0x7fc0380a6550 msgr2=0x7fc0380a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.146+0000 7fc03f510700 1 -- 172.21.15.72:0/2559161227 shutdown_connections 2023-10-03T10:17:19.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.146+0000 7fc03f510700 1 -- 172.21.15.72:0/2559161227 wait complete. 2023-10-03T10:17:19.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.146+0000 7fc03f510700 1 Processor -- start 2023-10-03T10:17:19.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03f510700 1 -- start start 2023-10-03T10:17:19.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03f510700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0380a0a30 0x7fc03811e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03f510700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0380a1510 0x7fc03811eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03f510700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc038139250 0x7fc03811f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03f510700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0381221f0 con 0x7fc038139250 2023-10-03T10:17:19.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03f510700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0381218e0 con 0x7fc0380a1510 2023-10-03T10:17:19.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03f510700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0380a5040 con 0x7fc0380a0a30 2023-10-03T10:17:19.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03caab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0380a1510 0x7fc03811eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03caab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0380a1510 0x7fc03811eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50806/0 (socket says 172.21.15.72:50806) 2023-10-03T10:17:19.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03caab700 1 -- 172.21.15.72:0/2549351536 learned_addr learned my addr 172.21.15.72:0/2549351536 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:19.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03d2ac700 1 --2- 172.21.15.72:0/2549351536 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0380a0a30 0x7fc03811e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03daad700 1 --2- 172.21.15.72:0/2549351536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc038139250 0x7fc03811f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03caab700 1 -- 172.21.15.72:0/2549351536 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0380a0a30 msgr2=0x7fc03811e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03caab700 1 --2- 172.21.15.72:0/2549351536 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0380a0a30 0x7fc03811e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03caab700 1 -- 172.21.15.72:0/2549351536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc038139250 msgr2=0x7fc03811f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03caab700 1 --2- 172.21.15.72:0/2549351536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc038139250 0x7fc03811f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03caab700 1 -- 172.21.15.72:0/2549351536 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0280094a0 con 0x7fc0380a1510 2023-10-03T10:17:19.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03d2ac700 1 --2- 172.21.15.72:0/2549351536 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0380a0a30 0x7fc03811e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.147+0000 7fc03daad700 1 --2- 172.21.15.72:0/2549351536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc038139250 0x7fc03811f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:19.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.148+0000 7fc03caab700 1 --2- 172.21.15.72:0/2549351536 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0380a1510 0x7fc03811eb70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc02800ebe0 tx=0x7fc02800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.148+0000 7fc02dffb700 1 -- 172.21.15.72:0/2549351536 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028009800 con 0x7fc0380a1510 2023-10-03T10:17:19.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.148+0000 7fc02dffb700 1 -- 172.21.15.72:0/2549351536 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02800c910 con 0x7fc0380a1510 2023-10-03T10:17:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.148+0000 7fc02dffb700 1 -- 172.21.15.72:0/2549351536 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02800cc80 con 0x7fc0380a1510 2023-10-03T10:17:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.148+0000 7fc03f510700 1 -- 172.21.15.72:0/2549351536 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc030009a70 con 0x7fc0380a1510 2023-10-03T10:17:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.148+0000 7fc03f510700 1 -- 172.21.15.72:0/2549351536 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0380a0280 con 0x7fc0380a1510 2023-10-03T10:17:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.149+0000 7fc02dffb700 1 -- 172.21.15.72:0/2549351536 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc028013470 con 0x7fc0380a1510 2023-10-03T10:17:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.149+0000 7fc02dffb700 1 -- 172.21.15.72:0/2549351536 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc02803fbc0 con 0x7fc0380a1510 2023-10-03T10:17:19.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.149+0000 7fc03f510700 1 -- 172.21.15.72:0/2549351536 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0380a1d00 con 0x7fc0380a1510 2023-10-03T10:17:19.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.158+0000 7fc02dffb700 1 -- 172.21.15.72:0/2549351536 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc028021020 con 0x7fc0380a1510 2023-10-03T10:17:19.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.236+0000 7f1e7ffff700 1 -- 172.21.15.72:0/961237614 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e8006af90 con 0x7f1e8009e670 2023-10-03T10:17:19.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.237+0000 7f1e677fe700 1 -- 172.21.15.72:0/961237614 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1e70012400 con 0x7f1e8009e670 2023-10-03T10:17:19.237 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:19.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.239+0000 7f1e7ffff700 1 -- 172.21.15.72:0/961237614 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e8009e670 msgr2=0x7f1e80139000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.239+0000 7f1e7ffff700 1 --2- 172.21.15.72:0/961237614 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e8009e670 0x7f1e80139000 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1e70001eb0 tx=0x7f1e7000c7b0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.239+0000 7f1e7ffff700 1 -- 172.21.15.72:0/961237614 shutdown_connections 2023-10-03T10:17:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.239+0000 7f1e7ffff700 1 --2- 172.21.15.72:0/961237614 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e8009f8a0 0x7f1e80139a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.239+0000 7f1e7ffff700 1 --2- 172.21.15.72:0/961237614 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e8009e670 0x7f1e80139000 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.239+0000 7f1e7ffff700 1 --2- 172.21.15.72:0/961237614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e8009f150 0x7f1e80139540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.239+0000 7f1e7ffff700 1 -- 172.21.15.72:0/961237614 >> 172.21.15.72:0/961237614 conn(0x7f1e800a0c90 msgr2=0x7f1e80136c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.239+0000 7f1e7ffff700 1 -- 172.21.15.72:0/961237614 shutdown_connections 2023-10-03T10:17:19.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.239+0000 7f1e7ffff700 1 -- 172.21.15.72:0/961237614 wait complete. 2023-10-03T10:17:19.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:19.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.301+0000 7f4da6771700 1 -- 172.21.15.72:0/3147531085 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4da006c360 con 0x7f4da006b080 2023-10-03T10:17:19.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.301+0000 7f4d9cff9700 1 -- 172.21.15.72:0/3147531085 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4d94011360 con 0x7f4da006b080 2023-10-03T10:17:19.302 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.303+0000 7f4da6771700 1 -- 172.21.15.72:0/3147531085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4da006b080 msgr2=0x7f4da0120930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.303+0000 7f4da6771700 1 --2- 172.21.15.72:0/3147531085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4da006b080 0x7f4da0120930 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f4d94001eb0 tx=0x7f4d9400c800 comp rx=0 tx=0).stop 2023-10-03T10:17:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.304+0000 7f4da6771700 1 -- 172.21.15.72:0/3147531085 shutdown_connections 2023-10-03T10:17:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.304+0000 7f4da6771700 1 --2- 172.21.15.72:0/3147531085 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4da0131d10 0x7f4da0120e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.304+0000 7f4da6771700 1 --2- 172.21.15.72:0/3147531085 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4da006a770 0x7f4da01203f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.304+0000 7f4da6771700 1 --2- 172.21.15.72:0/3147531085 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4da006b080 0x7f4da0120930 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.304+0000 7f4da6771700 1 -- 172.21.15.72:0/3147531085 >> 172.21.15.72:0/3147531085 conn(0x7f4da0066f50 msgr2=0x7f4da0070070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.304+0000 7f4da6771700 1 -- 172.21.15.72:0/3147531085 shutdown_connections 2023-10-03T10:17:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.304+0000 7f4da6771700 1 -- 172.21.15.72:0/3147531085 wait complete. 2023-10-03T10:17:19.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:19.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.352+0000 7fc03f510700 1 -- 172.21.15.72:0/2549351536 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc038074ea0 con 0x7fc0380a1510 2023-10-03T10:17:19.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.353+0000 7fc02dffb700 1 -- 172.21.15.72:0/2549351536 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc028017070 con 0x7fc0380a1510 2023-10-03T10:17:19.354 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:19.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.355+0000 7fc03f510700 1 -- 172.21.15.72:0/2549351536 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0380a1510 msgr2=0x7fc03811eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.355+0000 7fc03f510700 1 --2- 172.21.15.72:0/2549351536 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0380a1510 0x7fc03811eb70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc02800ebe0 tx=0x7fc02800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.355+0000 7fc03f510700 1 -- 172.21.15.72:0/2549351536 shutdown_connections 2023-10-03T10:17:19.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.355+0000 7fc03f510700 1 --2- 172.21.15.72:0/2549351536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc038139250 0x7fc03811f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.355+0000 7fc03f510700 1 --2- 172.21.15.72:0/2549351536 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc0380a0a30 0x7fc03811e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.355+0000 7fc03f510700 1 --2- 172.21.15.72:0/2549351536 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc0380a1510 0x7fc03811eb70 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.355+0000 7fc03f510700 1 -- 172.21.15.72:0/2549351536 >> 172.21.15.72:0/2549351536 conn(0x7fc0380a6550 msgr2=0x7fc0380a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.355+0000 7fc03f510700 1 -- 172.21.15.72:0/2549351536 shutdown_connections 2023-10-03T10:17:19.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:19.355+0000 7fc03f510700 1 -- 172.21.15.72:0/2549351536 wait complete. 2023-10-03T10:17:19.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:19.992 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.118+0000 7f6c1d220700 1 Processor -- start 2023-10-03T10:17:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.118+0000 7f6c1d220700 1 -- start start 2023-10-03T10:17:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c1d220700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c1809d6f0 0x7f6c1809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c1d220700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c1809e410 0x7f6c18130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c1d220700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1809f130 con 0x7f6c1809e000 2023-10-03T10:17:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c1d220700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1809f520 con 0x7f6c1809d6f0 2023-10-03T10:17:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c1d220700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1809e930 con 0x7f6c1809e410 2023-10-03T10:17:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c16d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c1809d6f0 0x7f6c1809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c1759e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c1809e410 0x7f6c18130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c16d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c1809d6f0 0x7f6c1809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35622/0 (socket says 172.21.15.72:35622) 2023-10-03T10:17:20.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c1759e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c1809e410 0x7f6c18130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48874/0 (socket says 172.21.15.72:48874) 2023-10-03T10:17:20.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c16d9d700 1 -- 172.21.15.72:0/4154770906 learned_addr learned my addr 172.21.15.72:0/4154770906 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:20.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c1759e700 1 -- 172.21.15.72:0/4154770906 >> v2:172.21.15.72:3300/0 conn(0x7f6c1809d6f0 msgr2=0x7f6c1809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c1759e700 1 --2- 172.21.15.72:0/4154770906 >> v2:172.21.15.72:3300/0 conn(0x7f6c1809d6f0 0x7f6c1809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c1759e700 1 -- 172.21.15.72:0/4154770906 >> v1:172.21.15.72:6789/0 conn(0x7f6c1809e000 legacy=0x7f6c18130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c1759e700 1 -- 172.21.15.72:0/4154770906 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1809b2d0 con 0x7f6c1809e410 2023-10-03T10:17:20.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c16d9d700 1 --2- 172.21.15.72:0/4154770906 >> v2:172.21.15.72:3300/0 conn(0x7f6c1809d6f0 0x7f6c1809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c1759e700 1 --2- 172.21.15.72:0/4154770906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c1809e410 0x7f6c18130d70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009d90 tx=0x7f6c1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0b9e2e8f4dc38f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c15d9b700 1 -- 172.21.15.72:0/4154770906 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000e070 con 0x7f6c1809e410 2023-10-03T10:17:20.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c15d9b700 1 -- 172.21.15.72:0/4154770906 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1000bb20 con 0x7f6c1809e410 2023-10-03T10:17:20.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.119+0000 7f6c15d9b700 1 -- 172.21.15.72:0/4154770906 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10012430 con 0x7f6c1809e410 2023-10-03T10:17:20.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.120+0000 7f6c1d220700 1 -- 172.21.15.72:0/4154770906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c1809e410 msgr2=0x7f6c18130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.120+0000 7f6c1d220700 1 --2- 172.21.15.72:0/4154770906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c1809e410 0x7f6c18130d70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009d90 tx=0x7f6c1000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.120+0000 7f6c1d220700 1 -- 172.21.15.72:0/4154770906 shutdown_connections 2023-10-03T10:17:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.120+0000 7f6c1d220700 1 --2- 172.21.15.72:0/4154770906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c1809e410 0x7f6c18130d70 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.120+0000 7f6c1d220700 1 --2- 172.21.15.72:0/4154770906 >> v2:172.21.15.72:3300/0 conn(0x7f6c1809d6f0 0x7f6c1809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.120+0000 7f6c1d220700 1 -- 172.21.15.72:0/4154770906 >> 172.21.15.72:0/4154770906 conn(0x7f6c18066f50 msgr2=0x7f6c1809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.120+0000 7f6c1d220700 1 -- 172.21.15.72:0/4154770906 shutdown_connections 2023-10-03T10:17:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.120+0000 7f6c1d220700 1 -- 172.21.15.72:0/4154770906 wait complete. 2023-10-03T10:17:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.121+0000 7f6c1d220700 1 Processor -- start 2023-10-03T10:17:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.121+0000 7f6c1d220700 1 -- start start 2023-10-03T10:17:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1d220700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c1809d6f0 0x7f6c18138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1d220700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1809e000 0x7f6c18138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1d220700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c1809e410 0x7f6c181393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1d220700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c18137650 con 0x7f6c1809e000 2023-10-03T10:17:20.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1d220700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1809c700 con 0x7f6c1809d6f0 2023-10-03T10:17:20.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1d220700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c18072530 con 0x7f6c1809e410 2023-10-03T10:17:20.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1759e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c1809e410 0x7f6c181393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1809e000 0x7f6c18138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c16d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c1809d6f0 0x7f6c18138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1759e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c1809e410 0x7f6c181393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48876/0 (socket says 172.21.15.72:48876) 2023-10-03T10:17:20.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1759e700 1 -- 172.21.15.72:0/3737910639 learned_addr learned my addr 172.21.15.72:0/3737910639 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:20.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1759e700 1 -- 172.21.15.72:0/3737910639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c1809d6f0 msgr2=0x7f6c18138960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1759e700 1 --2- 172.21.15.72:0/3737910639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c1809d6f0 0x7f6c18138960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1759e700 1 -- 172.21.15.72:0/3737910639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1809e000 msgr2=0x7f6c18138ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1759e700 1 --2- 172.21.15.72:0/3737910639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1809e000 0x7f6c18138ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1759e700 1 -- 172.21.15.72:0/3737910639 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c009550 con 0x7f6c1809e410 2023-10-03T10:17:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1659c700 1 --2- 172.21.15.72:0/3737910639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1809e000 0x7f6c18138ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1759e700 1 --2- 172.21.15.72:0/3737910639 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c1809e410 0x7f6c181393e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6c10014040 tx=0x7f6c10004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6bff7fe700 1 -- 172.21.15.72:0/3737910639 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10012430 con 0x7f6c1809e410 2023-10-03T10:17:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6bff7fe700 1 -- 172.21.15.72:0/3737910639 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c10020070 con 0x7f6c1809e410 2023-10-03T10:17:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1d220700 1 -- 172.21.15.72:0/3737910639 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c10009a70 con 0x7f6c1809e410 2023-10-03T10:17:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6bff7fe700 1 -- 172.21.15.72:0/3737910639 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10003ea0 con 0x7f6c1809e410 2023-10-03T10:17:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1d220700 1 -- 172.21.15.72:0/3737910639 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c181364d0 con 0x7f6c1809e410 2023-10-03T10:17:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.123+0000 7f6c1d220700 1 -- 172.21.15.72:0/3737910639 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c18074ea0 con 0x7f6c1809e410 2023-10-03T10:17:20.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.124+0000 7f6bff7fe700 1 -- 172.21.15.72:0/3737910639 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c10004040 con 0x7f6c1809e410 2023-10-03T10:17:20.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.124+0000 7f6bff7fe700 1 -- 172.21.15.72:0/3737910639 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6c10022070 con 0x7f6c1809e410 2023-10-03T10:17:20.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.129+0000 7f6bff7fe700 1 -- 172.21.15.72:0/3737910639 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c10011570 con 0x7f6c1809e410 2023-10-03T10:17:20.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:20.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:20.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.320+0000 7f6c1d220700 1 -- 172.21.15.72:0/3737910639 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c1806c360 con 0x7f6c1809e410 2023-10-03T10:17:20.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.320+0000 7f6bff7fe700 1 -- 172.21.15.72:0/3737910639 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c10035090 con 0x7f6c1809e410 2023-10-03T10:17:20.320 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:20.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.323+0000 7f6c1d220700 1 -- 172.21.15.72:0/3737910639 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c1809e410 msgr2=0x7f6c181393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.323+0000 7f6c1d220700 1 --2- 172.21.15.72:0/3737910639 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c1809e410 0x7f6c181393e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6c10014040 tx=0x7f6c10004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.323+0000 7f6c1d220700 1 -- 172.21.15.72:0/3737910639 shutdown_connections 2023-10-03T10:17:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.323+0000 7f6c1d220700 1 --2- 172.21.15.72:0/3737910639 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c1809e410 0x7f6c181393e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.323+0000 7f6c1d220700 1 --2- 172.21.15.72:0/3737910639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c1809d6f0 0x7f6c18138960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.323+0000 7f6c1d220700 1 --2- 172.21.15.72:0/3737910639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1809e000 0x7f6c18138ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.323+0000 7f6c1d220700 1 -- 172.21.15.72:0/3737910639 >> 172.21.15.72:0/3737910639 conn(0x7f6c18066f50 msgr2=0x7f6c180a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.323+0000 7f6c1d220700 1 -- 172.21.15.72:0/3737910639 shutdown_connections 2023-10-03T10:17:20.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.323+0000 7f6c1d220700 1 -- 172.21.15.72:0/3737910639 wait complete. 2023-10-03T10:17:20.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:20.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.382+0000 7fe2de8dd700 1 Processor -- start 2023-10-03T10:17:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.382+0000 7fe2de8dd700 1 -- start start 2023-10-03T10:17:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.382+0000 7fe2de8dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2d8131810 0x7fe2d8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.382+0000 7fe2de8dd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2d8099a40 0x7fe2d8099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.382+0000 7fe2de8dd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2d809a3b0 0x7fe2d8138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.382+0000 7fe2de8dd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d809b580 con 0x7fe2d809a3b0 2023-10-03T10:17:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.382+0000 7fe2de8dd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d81313c0 con 0x7fe2d8099a40 2023-10-03T10:17:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.382+0000 7fe2de8dd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d806e8c0 con 0x7fe2d8131810 2023-10-03T10:17:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.383+0000 7fe2dce7a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2d809a3b0 0x7fe2d8138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.383+0000 7fe2dce7a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2d809a3b0 0x7fe2d8138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35652/0 (socket says 172.21.15.72:35652) 2023-10-03T10:17:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.383+0000 7fe2dce7a700 1 -- 172.21.15.72:0/91487127 learned_addr learned my addr 172.21.15.72:0/91487127 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.383+0000 7fe2d77fe700 1 --2- 172.21.15.72:0/91487127 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2d8099a40 0x7fe2d8099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.383+0000 7fe2d7fff700 1 --2- 172.21.15.72:0/91487127 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2d8131810 0x7fe2d8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.383+0000 7fe2dce7a700 1 -- 172.21.15.72:0/91487127 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2d8131810 msgr2=0x7fe2d8131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.383+0000 7fe2dce7a700 1 --2- 172.21.15.72:0/91487127 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2d8131810 0x7fe2d8131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.383+0000 7fe2dce7a700 1 -- 172.21.15.72:0/91487127 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2d8099a40 msgr2=0x7fe2d8099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.383+0000 7fe2dce7a700 1 --2- 172.21.15.72:0/91487127 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2d8099a40 0x7fe2d8099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.383+0000 7fe2dce7a700 1 -- 172.21.15.72:0/91487127 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d809a820 con 0x7fe2d809a3b0 2023-10-03T10:17:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.383+0000 7fe2dce7a700 1 --2- 172.21.15.72:0/91487127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d809a3b0 0x7fe2d8138650 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009e50 tx=0x7fe2d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0697db3f9d4342d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.383+0000 7fe2d6ffd700 1 -- 172.21.15.72:0/91487127 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d000e070 con 0x7fe2d809a3b0 2023-10-03T10:17:20.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.383+0000 7fe2d6ffd700 1 -- 172.21.15.72:0/91487127 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d000b910 con 0x7fe2d809a3b0 2023-10-03T10:17:20.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.383+0000 7fe2d6ffd700 1 -- 172.21.15.72:0/91487127 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d000bcc0 con 0x7fe2d809a3b0 2023-10-03T10:17:20.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.384+0000 7fe2de8dd700 1 -- 172.21.15.72:0/91487127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d809a3b0 msgr2=0x7fe2d8138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.384+0000 7fe2de8dd700 1 --2- 172.21.15.72:0/91487127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d809a3b0 0x7fe2d8138650 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009e50 tx=0x7fe2d000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:20.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.384+0000 7fe2de8dd700 1 -- 172.21.15.72:0/91487127 shutdown_connections 2023-10-03T10:17:20.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.384+0000 7fe2de8dd700 1 --2- 172.21.15.72:0/91487127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d809a3b0 0x7fe2d8138650 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.384+0000 7fe2de8dd700 1 --2- 172.21.15.72:0/91487127 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2d8131810 0x7fe2d8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.384+0000 7fe2de8dd700 1 --2- 172.21.15.72:0/91487127 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2d8099a40 0x7fe2d8099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.384+0000 7fe2de8dd700 1 -- 172.21.15.72:0/91487127 >> 172.21.15.72:0/91487127 conn(0x7fe2d80a2aa0 msgr2=0x7fe2d80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.384+0000 7fe2de8dd700 1 -- 172.21.15.72:0/91487127 shutdown_connections 2023-10-03T10:17:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.384+0000 7fe2de8dd700 1 -- 172.21.15.72:0/91487127 wait complete. 2023-10-03T10:17:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.385+0000 7fe2de8dd700 1 Processor -- start 2023-10-03T10:17:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.385+0000 7fe2de8dd700 1 -- start start 2023-10-03T10:17:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2de8dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2d8099a40 0x7fe2d806f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2de8dd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2d809a3b0 0x7fe2d806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2de8dd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d8131810 0x7fe2d8070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2de8dd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8120b90 con 0x7fe2d8131810 2023-10-03T10:17:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2de8dd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d806eb00 con 0x7fe2d809a3b0 2023-10-03T10:17:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2de8dd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d812ecc0 con 0x7fe2d8099a40 2023-10-03T10:17:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2d7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2d8099a40 0x7fe2d806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2d809a3b0 0x7fe2d806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2dce7a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d8131810 0x7fe2d8070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2d77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2d809a3b0 0x7fe2d806fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50830/0 (socket says 172.21.15.72:50830) 2023-10-03T10:17:20.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2d7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2d8099a40 0x7fe2d806f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48908/0 (socket says 172.21.15.72:48908) 2023-10-03T10:17:20.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2d77fe700 1 -- 172.21.15.72:0/538296277 learned_addr learned my addr 172.21.15.72:0/538296277 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:20.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2dce7a700 1 -- 172.21.15.72:0/538296277 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2d8099a40 msgr2=0x7fe2d806f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2dce7a700 1 --2- 172.21.15.72:0/538296277 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2d8099a40 0x7fe2d806f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2dce7a700 1 -- 172.21.15.72:0/538296277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2d809a3b0 msgr2=0x7fe2d806fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2dce7a700 1 --2- 172.21.15.72:0/538296277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2d809a3b0 0x7fe2d806fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2dce7a700 1 -- 172.21.15.72:0/538296277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d0009b30 con 0x7fe2d8131810 2023-10-03T10:17:20.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2d77fe700 1 --2- 172.21.15.72:0/538296277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2d809a3b0 0x7fe2d806fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2dce7a700 1 --2- 172.21.15.72:0/538296277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d8131810 0x7fe2d8070090 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0015000 tx=0x7fe2d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.386+0000 7fe2d4ff9700 1 -- 172.21.15.72:0/538296277 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d000ce80 con 0x7fe2d8131810 2023-10-03T10:17:20.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.387+0000 7fe2d4ff9700 1 -- 172.21.15.72:0/538296277 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d0004040 con 0x7fe2d8131810 2023-10-03T10:17:20.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.387+0000 7fe2de8dd700 1 -- 172.21.15.72:0/538296277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d8121090 con 0x7fe2d8131810 2023-10-03T10:17:20.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.387+0000 7fe2d4ff9700 1 -- 172.21.15.72:0/538296277 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d00043d0 con 0x7fe2d8131810 2023-10-03T10:17:20.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.387+0000 7fe2de8dd700 1 -- 172.21.15.72:0/538296277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d8121370 con 0x7fe2d8131810 2023-10-03T10:17:20.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.387+0000 7fe2de8dd700 1 -- 172.21.15.72:0/538296277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d8120d30 con 0x7fe2d8131810 2023-10-03T10:17:20.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.388+0000 7fe2d4ff9700 1 -- 172.21.15.72:0/538296277 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2d0004530 con 0x7fe2d8131810 2023-10-03T10:17:20.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.388+0000 7fe2d4ff9700 1 -- 172.21.15.72:0/538296277 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe2d0040820 con 0x7fe2d8131810 2023-10-03T10:17:20.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.396+0000 7fe2d4ff9700 1 -- 172.21.15.72:0/538296277 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2d001c440 con 0x7fe2d8131810 2023-10-03T10:17:20.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.449+0000 7f0e26323700 1 Processor -- start 2023-10-03T10:17:20.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.449+0000 7f0e26323700 1 -- start start 2023-10-03T10:17:20.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e26323700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0e200a0a30 0x7f0e200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e26323700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0e2009d630 0x7f0e200a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e26323700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e200a2a70 con 0x7f0e20133930 2023-10-03T10:17:20.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e26323700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e200a01d0 con 0x7f0e2009d630 2023-10-03T10:17:20.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e26323700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2009e2b0 con 0x7f0e200a0a30 2023-10-03T10:17:20.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e1f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0e2009d630 0x7f0e200a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e1ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0e200a0a30 0x7f0e200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e1f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0e2009d630 0x7f0e200a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35664/0 (socket says 172.21.15.72:35664) 2023-10-03T10:17:20.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e1f7fe700 1 -- 172.21.15.72:0/1615364694 learned_addr learned my addr 172.21.15.72:0/1615364694 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:20.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e1ffff700 1 -- 172.21.15.72:0/1615364694 >> v2:172.21.15.72:3300/0 conn(0x7f0e2009d630 msgr2=0x7f0e200a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e1ffff700 1 --2- 172.21.15.72:0/1615364694 >> v2:172.21.15.72:3300/0 conn(0x7f0e2009d630 0x7f0e200a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e1ffff700 1 -- 172.21.15.72:0/1615364694 >> v1:172.21.15.72:6789/0 conn(0x7f0e20133930 legacy=0x7f0e20133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e1ffff700 1 -- 172.21.15.72:0/1615364694 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2009dc50 con 0x7f0e200a0a30 2023-10-03T10:17:20.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e1effd700 1 -- 172.21.15.72:0/1615364694 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061980641 0 0) 0x7f0e200a2a70 con 0x7f0e20133930 2023-10-03T10:17:20.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e1f7fe700 1 --2- 172.21.15.72:0/1615364694 >> v2:172.21.15.72:3300/0 conn(0x7f0e2009d630 0x7f0e200a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e1ffff700 1 --2- 172.21.15.72:0/1615364694 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0e200a0a30 0x7f0e200a0e00 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009840 tx=0x7f0e10009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ba55d149c96c4a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.450+0000 7f0e1effd700 1 -- 172.21.15.72:0/1615364694 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10011830 con 0x7f0e200a0a30 2023-10-03T10:17:20.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.451+0000 7f0e1effd700 1 -- 172.21.15.72:0/1615364694 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e10011990 con 0x7f0e200a0a30 2023-10-03T10:17:20.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.451+0000 7f0e1effd700 1 -- 172.21.15.72:0/1615364694 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10011d20 con 0x7f0e200a0a30 2023-10-03T10:17:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.451+0000 7f0e26323700 1 -- 172.21.15.72:0/1615364694 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0e200a0a30 msgr2=0x7f0e200a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.451+0000 7f0e26323700 1 --2- 172.21.15.72:0/1615364694 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0e200a0a30 0x7f0e200a0e00 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009840 tx=0x7f0e10009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.451+0000 7f0e26323700 1 -- 172.21.15.72:0/1615364694 shutdown_connections 2023-10-03T10:17:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.451+0000 7f0e26323700 1 --2- 172.21.15.72:0/1615364694 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0e200a0a30 0x7f0e200a0e00 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.451+0000 7f0e26323700 1 --2- 172.21.15.72:0/1615364694 >> v2:172.21.15.72:3300/0 conn(0x7f0e2009d630 0x7f0e200a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.451+0000 7f0e26323700 1 -- 172.21.15.72:0/1615364694 >> 172.21.15.72:0/1615364694 conn(0x7f0e200a3050 msgr2=0x7f0e200a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.451+0000 7f0e26323700 1 -- 172.21.15.72:0/1615364694 shutdown_connections 2023-10-03T10:17:20.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.451+0000 7f0e26323700 1 -- 172.21.15.72:0/1615364694 wait complete. 2023-10-03T10:17:20.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.452+0000 7f0e26323700 1 Processor -- start 2023-10-03T10:17:20.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e26323700 1 -- start start 2023-10-03T10:17:20.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e26323700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0e2009d630 0x7f0e201c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e26323700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e200a0a30 0x7f0e201c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e26323700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e20133930 0x7f0e201c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e26323700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e20122200 con 0x7f0e200a0a30 2023-10-03T10:17:20.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e26323700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e20133570 con 0x7f0e20133930 2023-10-03T10:17:20.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e26323700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e20120750 con 0x7f0e2009d630 2023-10-03T10:17:20.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e1ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0e2009d630 0x7f0e201c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e1ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0e2009d630 0x7f0e201c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48932/0 (socket says 172.21.15.72:48932) 2023-10-03T10:17:20.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e1ffff700 1 -- 172.21.15.72:0/3732909470 learned_addr learned my addr 172.21.15.72:0/3732909470 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:20.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e1f7fe700 1 --2- 172.21.15.72:0/3732909470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e200a0a30 0x7f0e201c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e1ffff700 1 -- 172.21.15.72:0/3732909470 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e20133930 msgr2=0x7f0e201c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e1ffff700 1 --2- 172.21.15.72:0/3732909470 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e20133930 0x7f0e201c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e1ffff700 1 -- 172.21.15.72:0/3732909470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e200a0a30 msgr2=0x7f0e201c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e1ffff700 1 --2- 172.21.15.72:0/3732909470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e200a0a30 0x7f0e201c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.453+0000 7f0e1ffff700 1 -- 172.21.15.72:0/3732909470 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e14009550 con 0x7f0e2009d630 2023-10-03T10:17:20.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.454+0000 7f0e1ffff700 1 --2- 172.21.15.72:0/3732909470 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0e2009d630 0x7f0e201c7f80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0e100090b0 tx=0x7f0e10004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.454+0000 7f0e1cff9700 1 -- 172.21.15.72:0/3732909470 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10004480 con 0x7f0e2009d630 2023-10-03T10:17:20.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.454+0000 7f0e1cff9700 1 -- 172.21.15.72:0/3732909470 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1001f070 con 0x7f0e2009d630 2023-10-03T10:17:20.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.454+0000 7f0e26323700 1 -- 172.21.15.72:0/3732909470 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e100094a0 con 0x7f0e2009d630 2023-10-03T10:17:20.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.454+0000 7f0e1cff9700 1 -- 172.21.15.72:0/3732909470 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e100038c0 con 0x7f0e2009d630 2023-10-03T10:17:20.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.454+0000 7f0e26323700 1 -- 172.21.15.72:0/3732909470 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e20122c70 con 0x7f0e2009d630 2023-10-03T10:17:20.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.455+0000 7f0e26323700 1 -- 172.21.15.72:0/3732909470 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e200a1800 con 0x7f0e2009d630 2023-10-03T10:17:20.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.455+0000 7f0e1cff9700 1 -- 172.21.15.72:0/3732909470 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e10021030 con 0x7f0e2009d630 2023-10-03T10:17:20.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.455+0000 7f0e1cff9700 1 -- 172.21.15.72:0/3732909470 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0e10040e40 con 0x7f0e2009d630 2023-10-03T10:17:20.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.460+0000 7f0e1cff9700 1 -- 172.21.15.72:0/3732909470 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e10019960 con 0x7f0e2009d630 2023-10-03T10:17:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.521+0000 7fd772e5d700 1 Processor -- start 2023-10-03T10:17:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.521+0000 7fd772e5d700 1 -- start start 2023-10-03T10:17:20.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.521+0000 7fd772e5d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd76c0a0a30 0x7fd76c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.521+0000 7fd772e5d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd76c09d630 0x7fd76c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.521+0000 7fd772e5d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76c0a2a70 con 0x7fd76c133930 2023-10-03T10:17:20.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.521+0000 7fd772e5d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c0a01d0 con 0x7fd76c09d630 2023-10-03T10:17:20.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.521+0000 7fd772e5d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c09e2b0 con 0x7fd76c0a0a30 2023-10-03T10:17:20.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.522+0000 7fd770bf9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd76c0a0a30 0x7fd76c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.522+0000 7fd770bf9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd76c0a0a30 0x7fd76c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48940/0 (socket says 172.21.15.72:48940) 2023-10-03T10:17:20.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.522+0000 7fd770bf9700 1 -- 172.21.15.72:0/2784507210 learned_addr learned my addr 172.21.15.72:0/2784507210 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:20.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.522+0000 7fd770bf9700 1 -- 172.21.15.72:0/2784507210 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd76c09d630 msgr2=0x7fd76c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.522+0000 7fd770bf9700 1 --2- 172.21.15.72:0/2784507210 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd76c09d630 0x7fd76c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.522+0000 7fd770bf9700 1 -- 172.21.15.72:0/2784507210 >> v1:172.21.15.72:6789/0 conn(0x7fd76c133930 legacy=0x7fd76c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.522+0000 7fd770bf9700 1 -- 172.21.15.72:0/2784507210 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c09dc50 con 0x7fd76c0a0a30 2023-10-03T10:17:20.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.522+0000 7fd770bf9700 1 --2- 172.21.15.72:0/2784507210 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd76c0a0a30 0x7fd76c0a0e00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd760009920 tx=0x7fd760009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5358fc2d20c54819 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.525+0000 7fd76b7fe700 1 -- 172.21.15.72:0/2784507210 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76000ba60 con 0x7fd76c0a0a30 2023-10-03T10:17:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.525+0000 7fd76b7fe700 1 -- 172.21.15.72:0/2784507210 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76000bbc0 con 0x7fd76c0a0a30 2023-10-03T10:17:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.525+0000 7fd76b7fe700 1 -- 172.21.15.72:0/2784507210 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760009e70 con 0x7fd76c0a0a30 2023-10-03T10:17:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.526+0000 7fd772e5d700 1 -- 172.21.15.72:0/2784507210 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd76c0a0a30 msgr2=0x7fd76c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.526+0000 7fd772e5d700 1 --2- 172.21.15.72:0/2784507210 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd76c0a0a30 0x7fd76c0a0e00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd760009920 tx=0x7fd760009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.526+0000 7fd772e5d700 1 -- 172.21.15.72:0/2784507210 shutdown_connections 2023-10-03T10:17:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.526+0000 7fd772e5d700 1 --2- 172.21.15.72:0/2784507210 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd76c0a0a30 0x7fd76c0a0e00 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.526+0000 7fd772e5d700 1 --2- 172.21.15.72:0/2784507210 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd76c09d630 0x7fd76c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.526+0000 7fd772e5d700 1 -- 172.21.15.72:0/2784507210 >> 172.21.15.72:0/2784507210 conn(0x7fd76c0a3050 msgr2=0x7fd76c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.526+0000 7fd772e5d700 1 -- 172.21.15.72:0/2784507210 shutdown_connections 2023-10-03T10:17:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.526+0000 7fd772e5d700 1 -- 172.21.15.72:0/2784507210 wait complete. 2023-10-03T10:17:20.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.527+0000 7fd772e5d700 1 Processor -- start 2023-10-03T10:17:20.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.527+0000 7fd772e5d700 1 -- start start 2023-10-03T10:17:20.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.528+0000 7fd772e5d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd76c09d630 0x7fd76c11f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.528+0000 7fd772e5d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd76c0a0a30 0x7fd76c11f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.528+0000 7fd772e5d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd76c133930 0x7fd76c1c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.528+0000 7fd772e5d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c11f040 con 0x7fd76c09d630 2023-10-03T10:17:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.528+0000 7fd772e5d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c133690 con 0x7fd76c133930 2023-10-03T10:17:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.528+0000 7fd772e5d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c133450 con 0x7fd76c0a0a30 2023-10-03T10:17:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.528+0000 7fd770bf9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd76c09d630 0x7fd76c11f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.528+0000 7fd770bf9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd76c09d630 0x7fd76c11f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35676/0 (socket says 172.21.15.72:35676) 2023-10-03T10:17:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.528+0000 7fd770bf9700 1 -- 172.21.15.72:0/118610696 learned_addr learned my addr 172.21.15.72:0/118610696 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.528+0000 7fd76bfff700 1 --2- 172.21.15.72:0/118610696 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd76c0a0a30 0x7fd76c11f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.528+0000 7fd7713fa700 1 --2- 172.21.15.72:0/118610696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd76c133930 0x7fd76c1c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.529+0000 7fd770bf9700 1 -- 172.21.15.72:0/118610696 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd76c0a0a30 msgr2=0x7fd76c11f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.529+0000 7fd770bf9700 1 --2- 172.21.15.72:0/118610696 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd76c0a0a30 0x7fd76c11f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.529+0000 7fd770bf9700 1 -- 172.21.15.72:0/118610696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd76c133930 msgr2=0x7fd76c1c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.529+0000 7fd770bf9700 1 --2- 172.21.15.72:0/118610696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd76c133930 0x7fd76c1c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.529+0000 7fd770bf9700 1 -- 172.21.15.72:0/118610696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760009550 con 0x7fd76c09d630 2023-10-03T10:17:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.529+0000 7fd7713fa700 1 --2- 172.21.15.72:0/118610696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd76c133930 0x7fd76c1c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.529+0000 7fd76bfff700 1 --2- 172.21.15.72:0/118610696 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd76c0a0a30 0x7fd76c11f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.529+0000 7fd770bf9700 1 --2- 172.21.15.72:0/118610696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd76c09d630 0x7fd76c11f3f0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fd760000c00 tx=0x7fd760004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.529+0000 7fd7697fa700 1 -- 172.21.15.72:0/118610696 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760004300 con 0x7fd76c09d630 2023-10-03T10:17:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.529+0000 7fd7697fa700 1 -- 172.21.15.72:0/118610696 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76001f070 con 0x7fd76c09d630 2023-10-03T10:17:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.529+0000 7fd772e5d700 1 -- 172.21.15.72:0/118610696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76c120ec0 con 0x7fd76c09d630 2023-10-03T10:17:20.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.529+0000 7fd7697fa700 1 -- 172.21.15.72:0/118610696 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7600036a0 con 0x7fd76c09d630 2023-10-03T10:17:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.529+0000 7fd772e5d700 1 -- 172.21.15.72:0/118610696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76c122360 con 0x7fd76c09d630 2023-10-03T10:17:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.530+0000 7fd772e5d700 1 -- 172.21.15.72:0/118610696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76c120cb0 con 0x7fd76c09d630 2023-10-03T10:17:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.531+0000 7fd7697fa700 1 -- 172.21.15.72:0/118610696 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd760021030 con 0x7fd76c09d630 2023-10-03T10:17:20.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.531+0000 7fd7697fa700 1 -- 172.21.15.72:0/118610696 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd760040640 con 0x7fd76c09d630 2023-10-03T10:17:20.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.535+0000 7fd7697fa700 1 -- 172.21.15.72:0/118610696 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd76002d9b0 con 0x7fd76c09d630 2023-10-03T10:17:20.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.597+0000 7fe2de8dd700 1 -- 172.21.15.72:0/538296277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe2d8071d80 con 0x7fe2d8131810 2023-10-03T10:17:20.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.597+0000 7fe2d4ff9700 1 -- 172.21.15.72:0/538296277 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe2d002a030 con 0x7fe2d8131810 2023-10-03T10:17:20.597 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.599+0000 7fe2de8dd700 1 -- 172.21.15.72:0/538296277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d8131810 msgr2=0x7fe2d8070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.599+0000 7fe2de8dd700 1 --2- 172.21.15.72:0/538296277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d8131810 0x7fe2d8070090 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0015000 tx=0x7fe2d0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.599+0000 7fe2de8dd700 1 -- 172.21.15.72:0/538296277 shutdown_connections 2023-10-03T10:17:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.599+0000 7fe2de8dd700 1 --2- 172.21.15.72:0/538296277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d8131810 0x7fe2d8070090 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.599+0000 7fe2de8dd700 1 --2- 172.21.15.72:0/538296277 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2d8099a40 0x7fe2d806f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.599+0000 7fe2de8dd700 1 --2- 172.21.15.72:0/538296277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2d809a3b0 0x7fe2d806fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.599+0000 7fe2de8dd700 1 -- 172.21.15.72:0/538296277 >> 172.21.15.72:0/538296277 conn(0x7fe2d80a2aa0 msgr2=0x7fe2d81b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.599+0000 7fe2de8dd700 1 -- 172.21.15.72:0/538296277 shutdown_connections 2023-10-03T10:17:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.599+0000 7fe2de8dd700 1 -- 172.21.15.72:0/538296277 wait complete. 2023-10-03T10:17:20.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.676+0000 7f0e26323700 1 -- 172.21.15.72:0/3732909470 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0e200747f0 con 0x7f0e2009d630 2023-10-03T10:17:20.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.677+0000 7f0e1cff9700 1 -- 172.21.15.72:0/3732909470 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0e10015030 con 0x7f0e2009d630 2023-10-03T10:17:20.677 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:20.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.679+0000 7f0e26323700 1 -- 172.21.15.72:0/3732909470 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0e2009d630 msgr2=0x7f0e201c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.679+0000 7f0e26323700 1 --2- 172.21.15.72:0/3732909470 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0e2009d630 0x7f0e201c7f80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0e100090b0 tx=0x7f0e10004750 comp rx=0 tx=0).stop 2023-10-03T10:17:20.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.679+0000 7f0e26323700 1 -- 172.21.15.72:0/3732909470 shutdown_connections 2023-10-03T10:17:20.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.679+0000 7f0e26323700 1 --2- 172.21.15.72:0/3732909470 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e20133930 0x7f0e201c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.679+0000 7f0e26323700 1 --2- 172.21.15.72:0/3732909470 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0e2009d630 0x7f0e201c7f80 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.679+0000 7f0e26323700 1 --2- 172.21.15.72:0/3732909470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e200a0a30 0x7f0e201c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.679+0000 7f0e26323700 1 -- 172.21.15.72:0/3732909470 >> 172.21.15.72:0/3732909470 conn(0x7f0e200a3050 msgr2=0x7f0e201bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.679+0000 7f0e26323700 1 -- 172.21.15.72:0/3732909470 shutdown_connections 2023-10-03T10:17:20.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.679+0000 7f0e26323700 1 -- 172.21.15.72:0/3732909470 wait complete. 2023-10-03T10:17:20.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:20.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.731+0000 7fd772e5d700 1 -- 172.21.15.72:0/118610696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd76c0747f0 con 0x7fd76c09d630 2023-10-03T10:17:20.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.731+0000 7fd7697fa700 1 -- 172.21.15.72:0/118610696 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd760015020 con 0x7fd76c09d630 2023-10-03T10:17:20.731 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.733+0000 7fd772e5d700 1 -- 172.21.15.72:0/118610696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd76c09d630 msgr2=0x7fd76c11f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.733+0000 7fd772e5d700 1 --2- 172.21.15.72:0/118610696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd76c09d630 0x7fd76c11f3f0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fd760000c00 tx=0x7fd760004750 comp rx=0 tx=0).stop 2023-10-03T10:17:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.733+0000 7fd772e5d700 1 -- 172.21.15.72:0/118610696 shutdown_connections 2023-10-03T10:17:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.733+0000 7fd772e5d700 1 --2- 172.21.15.72:0/118610696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd76c09d630 0x7fd76c11f3f0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.733+0000 7fd772e5d700 1 --2- 172.21.15.72:0/118610696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd76c133930 0x7fd76c1c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.733+0000 7fd772e5d700 1 --2- 172.21.15.72:0/118610696 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd76c0a0a30 0x7fd76c11f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.733+0000 7fd772e5d700 1 -- 172.21.15.72:0/118610696 >> 172.21.15.72:0/118610696 conn(0x7fd76c0a3050 msgr2=0x7fd76c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.733+0000 7fd772e5d700 1 -- 172.21.15.72:0/118610696 shutdown_connections 2023-10-03T10:17:20.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:20.733+0000 7fd772e5d700 1 -- 172.21.15.72:0/118610696 wait complete. 2023-10-03T10:17:20.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:21.337 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:21.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.463+0000 7f32e3cef700 1 Processor -- start 2023-10-03T10:17:21.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.463+0000 7f32e3cef700 1 -- start start 2023-10-03T10:17:21.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.463+0000 7f32e3cef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32dc1316c0 0x7f32dc131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.463+0000 7f32e3cef700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f32dc06ae80 0x7f32dc139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.463+0000 7f32e3cef700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32dc09e130 con 0x7f32dc09d9f0 2023-10-03T10:17:21.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.463+0000 7f32e3cef700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc1312b0 con 0x7f32dc1316c0 2023-10-03T10:17:21.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.463+0000 7f32e3cef700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc09f6e0 con 0x7f32dc06ae80 2023-10-03T10:17:21.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.464+0000 7f32e228c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f32dc06ae80 0x7f32dc139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.464+0000 7f32e128a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f32dc09d9f0 0x7f32dc06a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39642/0 (socket says 172.21.15.72:39642) 2023-10-03T10:17:21.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.464+0000 7f32e1a8b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32dc1316c0 0x7f32dc131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.464+0000 7f32e128a700 1 -- 172.21.15.72:0/57478573 learned_addr learned my addr 172.21.15.72:0/57478573 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:21.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.464+0000 7f32e0a89700 1 -- 172.21.15.72:0/57478573 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194532099 0 0) 0x7f32cc001110 con 0x7f32dc09d9f0 2023-10-03T10:17:21.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.464+0000 7f32e228c700 1 -- 172.21.15.72:0/57478573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32dc1316c0 msgr2=0x7f32dc131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.464+0000 7f32e228c700 1 --2- 172.21.15.72:0/57478573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32dc1316c0 0x7f32dc131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.464+0000 7f32e228c700 1 -- 172.21.15.72:0/57478573 >> v1:172.21.15.72:6789/0 conn(0x7f32dc09d9f0 legacy=0x7f32dc06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.464+0000 7f32e228c700 1 -- 172.21.15.72:0/57478573 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc09e760 con 0x7f32dc06ae80 2023-10-03T10:17:21.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.464+0000 7f32e1a8b700 1 --2- 172.21.15.72:0/57478573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32dc1316c0 0x7f32dc131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.464+0000 7f32e228c700 1 --2- 172.21.15.72:0/57478573 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f32dc06ae80 0x7f32dc139550 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009dc0 tx=0x7f32d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d2d35fef1b46e79 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.464+0000 7f32e0a89700 1 -- 172.21.15.72:0/57478573 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d400e070 con 0x7f32dc06ae80 2023-10-03T10:17:21.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.464+0000 7f32e0a89700 1 -- 172.21.15.72:0/57478573 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d400bb20 con 0x7f32dc06ae80 2023-10-03T10:17:21.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.464+0000 7f32e0a89700 1 -- 172.21.15.72:0/57478573 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4012430 con 0x7f32dc06ae80 2023-10-03T10:17:21.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.465+0000 7f32e3cef700 1 -- 172.21.15.72:0/57478573 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f32dc06ae80 msgr2=0x7f32dc139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.465+0000 7f32e3cef700 1 --2- 172.21.15.72:0/57478573 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f32dc06ae80 0x7f32dc139550 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009dc0 tx=0x7f32d400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:21.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.465+0000 7f32e3cef700 1 -- 172.21.15.72:0/57478573 shutdown_connections 2023-10-03T10:17:21.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.465+0000 7f32e3cef700 1 --2- 172.21.15.72:0/57478573 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f32dc06ae80 0x7f32dc139550 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.465+0000 7f32e3cef700 1 --2- 172.21.15.72:0/57478573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32dc1316c0 0x7f32dc131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.465+0000 7f32e3cef700 1 -- 172.21.15.72:0/57478573 >> 172.21.15.72:0/57478573 conn(0x7f32dc066f50 msgr2=0x7f32dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.465+0000 7f32e3cef700 1 -- 172.21.15.72:0/57478573 shutdown_connections 2023-10-03T10:17:21.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.465+0000 7f32e3cef700 1 -- 172.21.15.72:0/57478573 wait complete. 2023-10-03T10:17:21.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.466+0000 7f32e3cef700 1 Processor -- start 2023-10-03T10:17:21.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.466+0000 7f32e3cef700 1 -- start start 2023-10-03T10:17:21.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e3cef700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f32dc06ae80 0x7f32dc11a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e3cef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32dc09d9f0 0x7f32dc11a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e3cef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32dc1316c0 0x7f32dc11ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e3cef700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc11cd40 con 0x7f32dc09d9f0 2023-10-03T10:17:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e3cef700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc11bf40 con 0x7f32dc1316c0 2023-10-03T10:17:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e3cef700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc11c7d0 con 0x7f32dc06ae80 2023-10-03T10:17:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e1a8b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f32dc06ae80 0x7f32dc11a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e1a8b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f32dc06ae80 0x7f32dc11a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48972/0 (socket says 172.21.15.72:48972) 2023-10-03T10:17:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e1a8b700 1 -- 172.21.15.72:0/1917593653 learned_addr learned my addr 172.21.15.72:0/1917593653 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e128a700 1 --2- 172.21.15.72:0/1917593653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32dc09d9f0 0x7f32dc11a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e228c700 1 --2- 172.21.15.72:0/1917593653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32dc1316c0 0x7f32dc11ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e1a8b700 1 -- 172.21.15.72:0/1917593653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32dc1316c0 msgr2=0x7f32dc11ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e1a8b700 1 --2- 172.21.15.72:0/1917593653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32dc1316c0 0x7f32dc11ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e1a8b700 1 -- 172.21.15.72:0/1917593653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32dc09d9f0 msgr2=0x7f32dc11a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e1a8b700 1 --2- 172.21.15.72:0/1917593653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32dc09d9f0 0x7f32dc11a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e1a8b700 1 -- 172.21.15.72:0/1917593653 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d80094a0 con 0x7f32dc06ae80 2023-10-03T10:17:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e1a8b700 1 --2- 172.21.15.72:0/1917593653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f32dc06ae80 0x7f32dc11a3f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f32d800ec10 tx=0x7f32d800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32d27fc700 1 -- 172.21.15.72:0/1917593653 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d800c850 con 0x7f32dc06ae80 2023-10-03T10:17:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32d27fc700 1 -- 172.21.15.72:0/1917593653 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d800c9b0 con 0x7f32dc06ae80 2023-10-03T10:17:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e3cef700 1 -- 172.21.15.72:0/1917593653 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d4009a70 con 0x7f32dc06ae80 2023-10-03T10:17:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32d27fc700 1 -- 172.21.15.72:0/1917593653 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d800cd40 con 0x7f32dc06ae80 2023-10-03T10:17:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.467+0000 7f32e3cef700 1 -- 172.21.15.72:0/1917593653 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32dc11db70 con 0x7f32dc06ae80 2023-10-03T10:17:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.468+0000 7f32d27fc700 1 -- 172.21.15.72:0/1917593653 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32d8013470 con 0x7f32dc06ae80 2023-10-03T10:17:21.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.468+0000 7f32d27fc700 1 -- 172.21.15.72:0/1917593653 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f32d803fb00 con 0x7f32dc06ae80 2023-10-03T10:17:21.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.468+0000 7f32e3cef700 1 -- 172.21.15.72:0/1917593653 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32dc09eaa0 con 0x7f32dc06ae80 2023-10-03T10:17:21.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.473+0000 7f32d27fc700 1 -- 172.21.15.72:0/1917593653 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32d8021020 con 0x7f32dc06ae80 2023-10-03T10:17:21.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:21.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.662+0000 7f32e3cef700 1 -- 172.21.15.72:0/1917593653 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f32dc12b900 con 0x7f32dc06ae80 2023-10-03T10:17:21.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.663+0000 7f32d27fc700 1 -- 172.21.15.72:0/1917593653 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f32d8017070 con 0x7f32dc06ae80 2023-10-03T10:17:21.662 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.665+0000 7f32e3cef700 1 -- 172.21.15.72:0/1917593653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f32dc06ae80 msgr2=0x7f32dc11a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.665+0000 7f32e3cef700 1 --2- 172.21.15.72:0/1917593653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f32dc06ae80 0x7f32dc11a3f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f32d800ec10 tx=0x7f32d800ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.665+0000 7f32e3cef700 1 -- 172.21.15.72:0/1917593653 shutdown_connections 2023-10-03T10:17:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.665+0000 7f32e3cef700 1 --2- 172.21.15.72:0/1917593653 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f32dc1316c0 0x7f32dc11ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.665+0000 7f32e3cef700 1 --2- 172.21.15.72:0/1917593653 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f32dc06ae80 0x7f32dc11a3f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.665+0000 7f32e3cef700 1 --2- 172.21.15.72:0/1917593653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32dc09d9f0 0x7f32dc11a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.665+0000 7f32e3cef700 1 -- 172.21.15.72:0/1917593653 >> 172.21.15.72:0/1917593653 conn(0x7f32dc066f50 msgr2=0x7f32dc0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.665+0000 7f32e3cef700 1 -- 172.21.15.72:0/1917593653 shutdown_connections 2023-10-03T10:17:21.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.665+0000 7f32e3cef700 1 -- 172.21.15.72:0/1917593653 wait complete. 2023-10-03T10:17:21.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:21.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.742+0000 7fc6ccf4d700 1 Processor -- start 2023-10-03T10:17:21.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.742+0000 7fc6ccf4d700 1 -- start start 2023-10-03T10:17:21.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.742+0000 7fc6ccf4d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6c809d630 0x7fc6c80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.742+0000 7fc6ccf4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6c8138d80 0x7fc6c813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.742+0000 7fc6ccf4d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c80a2a70 con 0x7fc6c80a0a30 2023-10-03T10:17:21.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.742+0000 7fc6ccf4d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c80a01d0 con 0x7fc6c809d630 2023-10-03T10:17:21.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.742+0000 7fc6ccf4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c809e2b0 con 0x7fc6c8138d80 2023-10-03T10:17:21.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.742+0000 7fc6c5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6c809d630 0x7fc6c80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.742+0000 7fc6c6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6c8138d80 0x7fc6c813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.742+0000 7fc6c5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6c809d630 0x7fc6c80a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35696/0 (socket says 172.21.15.72:35696) 2023-10-03T10:17:21.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.742+0000 7fc6c6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6c8138d80 0x7fc6c813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50880/0 (socket says 172.21.15.72:50880) 2023-10-03T10:17:21.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.742+0000 7fc6c5d9b700 1 -- 172.21.15.72:0/502668287 learned_addr learned my addr 172.21.15.72:0/502668287 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:21.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.743+0000 7fc6c5d9b700 1 -- 172.21.15.72:0/502668287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6c8138d80 msgr2=0x7fc6c813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.743+0000 7fc6c5d9b700 1 --2- 172.21.15.72:0/502668287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6c8138d80 0x7fc6c813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.743+0000 7fc6c5d9b700 1 -- 172.21.15.72:0/502668287 >> v1:172.21.15.72:6789/0 conn(0x7fc6c80a0a30 legacy=0x7fc6c80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.743+0000 7fc6c559a700 1 -- 172.21.15.72:0/502668287 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476449200 0 0) 0x7fc6c80a2a70 con 0x7fc6c80a0a30 2023-10-03T10:17:21.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.743+0000 7fc6c5d9b700 1 -- 172.21.15.72:0/502668287 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c809dc50 con 0x7fc6c809d630 2023-10-03T10:17:21.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.743+0000 7fc6c6d9d700 1 --2- 172.21.15.72:0/502668287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6c8138d80 0x7fc6c813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.743+0000 7fc6c5d9b700 1 --2- 172.21.15.72:0/502668287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c809d630 0x7fc6c80a1510 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0098f0 tx=0x7fc6bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfa32ff9e6e298a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.743+0000 7fc6c559a700 1 -- 172.21.15.72:0/502668287 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc011830 con 0x7fc6c809d630 2023-10-03T10:17:21.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.743+0000 7fc6c559a700 1 -- 172.21.15.72:0/502668287 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc011990 con 0x7fc6c809d630 2023-10-03T10:17:21.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.743+0000 7fc6c559a700 1 -- 172.21.15.72:0/502668287 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc011d20 con 0x7fc6c809d630 2023-10-03T10:17:21.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.744+0000 7fc6ccf4d700 1 -- 172.21.15.72:0/502668287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c809d630 msgr2=0x7fc6c80a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.744+0000 7fc6ccf4d700 1 --2- 172.21.15.72:0/502668287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c809d630 0x7fc6c80a1510 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0098f0 tx=0x7fc6bc009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:21.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.744+0000 7fc6ccf4d700 1 -- 172.21.15.72:0/502668287 shutdown_connections 2023-10-03T10:17:21.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.744+0000 7fc6ccf4d700 1 --2- 172.21.15.72:0/502668287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6c8138d80 0x7fc6c813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.744+0000 7fc6ccf4d700 1 --2- 172.21.15.72:0/502668287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c809d630 0x7fc6c80a1510 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.744+0000 7fc6ccf4d700 1 -- 172.21.15.72:0/502668287 >> 172.21.15.72:0/502668287 conn(0x7fc6c80a3050 msgr2=0x7fc6c80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.744+0000 7fc6ccf4d700 1 -- 172.21.15.72:0/502668287 shutdown_connections 2023-10-03T10:17:21.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.744+0000 7fc6ccf4d700 1 -- 172.21.15.72:0/502668287 wait complete. 2023-10-03T10:17:21.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.745+0000 7fc6ccf4d700 1 Processor -- start 2023-10-03T10:17:21.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.745+0000 7fc6ccf4d700 1 -- start start 2023-10-03T10:17:21.747 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:21.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.745+0000 7fc6ccf4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c809d630 0x7fc6c8133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.745+0000 7fc6ccf4d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6c80a0a30 0x7fc6c8133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.745+0000 7fc6ccf4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6c8138d80 0x7fc6c8134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.745+0000 7fc6ccf4d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8136190 con 0x7fc6c809d630 2023-10-03T10:17:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.745+0000 7fc6ccf4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8136eb0 con 0x7fc6c8138d80 2023-10-03T10:17:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.745+0000 7fc6ccf4d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80a4ba0 con 0x7fc6c80a0a30 2023-10-03T10:17:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.745+0000 7fc6c6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6c8138d80 0x7fc6c8134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.745+0000 7fc6c659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c809d630 0x7fc6c8133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.745+0000 7fc6c6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6c8138d80 0x7fc6c8134180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50882/0 (socket says 172.21.15.72:50882) 2023-10-03T10:17:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.745+0000 7fc6c6d9d700 1 -- 172.21.15.72:0/2481229535 learned_addr learned my addr 172.21.15.72:0/2481229535 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.745+0000 7fc6c5d9b700 1 --2- 172.21.15.72:0/2481229535 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6c80a0a30 0x7fc6c8133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.746+0000 7fc6c659c700 1 -- 172.21.15.72:0/2481229535 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6c80a0a30 msgr2=0x7fc6c8133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.746+0000 7fc6c659c700 1 --2- 172.21.15.72:0/2481229535 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6c80a0a30 0x7fc6c8133c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.746+0000 7fc6c659c700 1 -- 172.21.15.72:0/2481229535 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6c8138d80 msgr2=0x7fc6c8134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.746+0000 7fc6c659c700 1 --2- 172.21.15.72:0/2481229535 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6c8138d80 0x7fc6c8134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.746+0000 7fc6c659c700 1 -- 172.21.15.72:0/2481229535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c0009a70 con 0x7fc6c809d630 2023-10-03T10:17:21.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.746+0000 7fc6c5d9b700 1 --2- 172.21.15.72:0/2481229535 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6c80a0a30 0x7fc6c8133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.746+0000 7fc6c659c700 1 --2- 172.21.15.72:0/2481229535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c809d630 0x7fc6c8133700 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800c460 tx=0x7fc6b800c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.746+0000 7fc6b6ffd700 1 -- 172.21.15.72:0/2481229535 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b80054e0 con 0x7fc6c809d630 2023-10-03T10:17:21.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.746+0000 7fc6b6ffd700 1 -- 172.21.15.72:0/2481229535 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b800ce30 con 0x7fc6c809d630 2023-10-03T10:17:21.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.746+0000 7fc6ccf4d700 1 -- 172.21.15.72:0/2481229535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6bc009550 con 0x7fc6c809d630 2023-10-03T10:17:21.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.746+0000 7fc6b6ffd700 1 -- 172.21.15.72:0/2481229535 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b80038c0 con 0x7fc6c809d630 2023-10-03T10:17:21.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.746+0000 7fc6ccf4d700 1 -- 172.21.15.72:0/2481229535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c8136540 con 0x7fc6c809d630 2023-10-03T10:17:21.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.747+0000 7fc6b6ffd700 1 -- 172.21.15.72:0/2481229535 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6b8003a20 con 0x7fc6c809d630 2023-10-03T10:17:21.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.747+0000 7fc6b6ffd700 1 -- 172.21.15.72:0/2481229535 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc6b803ea00 con 0x7fc6c809d630 2023-10-03T10:17:21.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.747+0000 7fc6ccf4d700 1 -- 172.21.15.72:0/2481229535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c81379e0 con 0x7fc6c809d630 2023-10-03T10:17:21.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.752+0000 7fc6b6ffd700 1 -- 172.21.15.72:0/2481229535 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6b8017080 con 0x7fc6c809d630 2023-10-03T10:17:21.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.830+0000 7fd554881700 1 Processor -- start 2023-10-03T10:17:21.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.830+0000 7fd554881700 1 -- start start 2023-10-03T10:17:21.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.830+0000 7fd554881700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd5500a0a30 0x7fd5500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.830+0000 7fd554881700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd5500a1340 0x7fd550133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.830+0000 7fd554881700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55009edd0 con 0x7fd550133fa0 2023-10-03T10:17:21.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.830+0000 7fd554881700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55009e1f0 con 0x7fd5500a1340 2023-10-03T10:17:21.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.830+0000 7fd554881700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd55009dc50 con 0x7fd5500a0a30 2023-10-03T10:17:21.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.831+0000 7fd54e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd5500a0a30 0x7fd5500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.831+0000 7fd54dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd5500a1340 0x7fd550133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.831+0000 7fd54ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd550133fa0 0x7fd55013ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39668/0 (socket says 172.21.15.72:39668) 2023-10-03T10:17:21.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.831+0000 7fd54e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd5500a0a30 0x7fd5500a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48986/0 (socket says 172.21.15.72:48986) 2023-10-03T10:17:21.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.831+0000 7fd54ed9d700 1 -- 172.21.15.72:0/1320180364 learned_addr learned my addr 172.21.15.72:0/1320180364 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:21.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.831+0000 7fd54dd9b700 1 -- 172.21.15.72:0/1320180364 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd5500a0a30 msgr2=0x7fd5500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.831+0000 7fd54dd9b700 1 --2- 172.21.15.72:0/1320180364 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd5500a0a30 0x7fd5500a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.831+0000 7fd54dd9b700 1 -- 172.21.15.72:0/1320180364 >> v1:172.21.15.72:6789/0 conn(0x7fd550133fa0 legacy=0x7fd55013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.831+0000 7fd54dd9b700 1 -- 172.21.15.72:0/1320180364 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5500a1fe0 con 0x7fd5500a1340 2023-10-03T10:17:21.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.831+0000 7fd54d59a700 1 -- 172.21.15.72:0/1320180364 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577269437 0 0) 0x7fd55009edd0 con 0x7fd550133fa0 2023-10-03T10:17:21.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.831+0000 7fd54dd9b700 1 --2- 172.21.15.72:0/1320180364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5500a1340 0x7fd550133a60 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fd544009840 tx=0x7fd544009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbd76786c653eac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.831+0000 7fd54d59a700 1 -- 172.21.15.72:0/1320180364 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544011830 con 0x7fd5500a1340 2023-10-03T10:17:21.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.831+0000 7fd54d59a700 1 -- 172.21.15.72:0/1320180364 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd544011990 con 0x7fd5500a1340 2023-10-03T10:17:21.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.831+0000 7fd54d59a700 1 -- 172.21.15.72:0/1320180364 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544011d20 con 0x7fd5500a1340 2023-10-03T10:17:21.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.832+0000 7fd554881700 1 -- 172.21.15.72:0/1320180364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5500a1340 msgr2=0x7fd550133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.832+0000 7fd554881700 1 --2- 172.21.15.72:0/1320180364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5500a1340 0x7fd550133a60 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fd544009840 tx=0x7fd544009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:21.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.832+0000 7fd554881700 1 -- 172.21.15.72:0/1320180364 shutdown_connections 2023-10-03T10:17:21.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.832+0000 7fd554881700 1 --2- 172.21.15.72:0/1320180364 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd5500a0a30 0x7fd5500a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.832+0000 7fd554881700 1 --2- 172.21.15.72:0/1320180364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5500a1340 0x7fd550133a60 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.832+0000 7fd554881700 1 -- 172.21.15.72:0/1320180364 >> 172.21.15.72:0/1320180364 conn(0x7fd5500a6550 msgr2=0x7fd5500a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.832+0000 7fd554881700 1 -- 172.21.15.72:0/1320180364 shutdown_connections 2023-10-03T10:17:21.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.832+0000 7fd554881700 1 -- 172.21.15.72:0/1320180364 wait complete. 2023-10-03T10:17:21.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.834+0000 7fd554881700 1 Processor -- start 2023-10-03T10:17:21.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.834+0000 7fd554881700 1 -- start start 2023-10-03T10:17:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd554881700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5500a0a30 0x7fd550122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd554881700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5500a1340 0x7fd550122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd554881700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd550133fa0 0x7fd550123280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd554881700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd550123cb0 con 0x7fd5500a0a30 2023-10-03T10:17:21.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd554881700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd550124520 con 0x7fd5500a1340 2023-10-03T10:17:21.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd554881700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5501249c0 con 0x7fd550133fa0 2023-10-03T10:17:21.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd54e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5500a0a30 0x7fd550122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd54dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5500a1340 0x7fd550122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd54e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5500a0a30 0x7fd550122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35730/0 (socket says 172.21.15.72:35730) 2023-10-03T10:17:21.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd54e59c700 1 -- 172.21.15.72:0/1540393754 learned_addr learned my addr 172.21.15.72:0/1540393754 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:21.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd54ed9d700 1 --2- 172.21.15.72:0/1540393754 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd550133fa0 0x7fd550123280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd54dd9b700 1 -- 172.21.15.72:0/1540393754 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd550133fa0 msgr2=0x7fd550123280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd54dd9b700 1 --2- 172.21.15.72:0/1540393754 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd550133fa0 0x7fd550123280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd54dd9b700 1 -- 172.21.15.72:0/1540393754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5500a0a30 msgr2=0x7fd550122800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd54dd9b700 1 --2- 172.21.15.72:0/1540393754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5500a0a30 0x7fd550122800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd54dd9b700 1 -- 172.21.15.72:0/1540393754 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5440094a0 con 0x7fd5500a1340 2023-10-03T10:17:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd54e59c700 1 --2- 172.21.15.72:0/1540393754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5500a0a30 0x7fd550122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd54dd9b700 1 --2- 172.21.15.72:0/1540393754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5500a1340 0x7fd550122d40 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd544016000 tx=0x7fd544004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.835+0000 7fd53effd700 1 -- 172.21.15.72:0/1540393754 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544004550 con 0x7fd5500a1340 2023-10-03T10:17:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.836+0000 7fd53effd700 1 -- 172.21.15.72:0/1540393754 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54401f070 con 0x7fd5500a1340 2023-10-03T10:17:21.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.836+0000 7fd554881700 1 -- 172.21.15.72:0/1540393754 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd550133320 con 0x7fd5500a1340 2023-10-03T10:17:21.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.836+0000 7fd53effd700 1 -- 172.21.15.72:0/1540393754 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5440038e0 con 0x7fd5500a1340 2023-10-03T10:17:21.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.836+0000 7fd554881700 1 -- 172.21.15.72:0/1540393754 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd550124c00 con 0x7fd5500a1340 2023-10-03T10:17:21.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.837+0000 7fd554881700 1 -- 172.21.15.72:0/1540393754 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd550074ea0 con 0x7fd5500a1340 2023-10-03T10:17:21.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.837+0000 7fd53effd700 1 -- 172.21.15.72:0/1540393754 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd544003a40 con 0x7fd5500a1340 2023-10-03T10:17:21.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.837+0000 7fd53effd700 1 -- 172.21.15.72:0/1540393754 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd544021070 con 0x7fd5500a1340 2023-10-03T10:17:21.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.841+0000 7fd53effd700 1 -- 172.21.15.72:0/1540393754 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd54402f3a0 con 0x7fd5500a1340 2023-10-03T10:17:21.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.877+0000 7fe9d14f1700 1 Processor -- start 2023-10-03T10:17:21.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.877+0000 7fe9d14f1700 1 -- start start 2023-10-03T10:17:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9d14f1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe9cc0a0a30 0x7fe9cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9d14f1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9cc09d630 0x7fe9cc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9d14f1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9cc133930 0x7fe9cc133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9d14f1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9cc0a2a70 con 0x7fe9cc0a0a30 2023-10-03T10:17:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9d14f1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc0a01d0 con 0x7fe9cc133930 2023-10-03T10:17:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9d14f1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc09e2b0 con 0x7fe9cc09d630 2023-10-03T10:17:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9caffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe9cc0a0a30 0x7fe9cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9cb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9cc133930 0x7fe9cc133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9ca7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9cc09d630 0x7fe9cc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9cb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9cc133930 0x7fe9cc133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50890/0 (socket says 172.21.15.72:50890) 2023-10-03T10:17:21.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9caffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe9cc0a0a30 0x7fe9cc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35736/0 (socket says 172.21.15.72:35736) 2023-10-03T10:17:21.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9cb7fe700 1 -- 172.21.15.72:0/2254951833 learned_addr learned my addr 172.21.15.72:0/2254951833 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:21.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9cb7fe700 1 -- 172.21.15.72:0/2254951833 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9cc09d630 msgr2=0x7fe9cc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9cb7fe700 1 --2- 172.21.15.72:0/2254951833 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9cc09d630 0x7fe9cc0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9cb7fe700 1 -- 172.21.15.72:0/2254951833 >> v2:172.21.15.72:3300/0 conn(0x7fe9cc0a0a30 msgr2=0x7fe9cc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9cb7fe700 1 --2- 172.21.15.72:0/2254951833 >> v2:172.21.15.72:3300/0 conn(0x7fe9cc0a0a30 0x7fe9cc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9cb7fe700 1 -- 172.21.15.72:0/2254951833 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc09dc50 con 0x7fe9cc133930 2023-10-03T10:17:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.878+0000 7fe9cb7fe700 1 --2- 172.21.15.72:0/2254951833 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9cc133930 0x7fe9cc133db0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009e50 tx=0x7fe9c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98f920e3b3da965d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.879+0000 7fe9c9ffb700 1 -- 172.21.15.72:0/2254951833 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400e070 con 0x7fe9cc133930 2023-10-03T10:17:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.879+0000 7fe9c9ffb700 1 -- 172.21.15.72:0/2254951833 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c400b910 con 0x7fe9cc133930 2023-10-03T10:17:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.879+0000 7fe9c9ffb700 1 -- 172.21.15.72:0/2254951833 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400bcc0 con 0x7fe9cc133930 2023-10-03T10:17:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.879+0000 7fe9d14f1700 1 -- 172.21.15.72:0/2254951833 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9cc133930 msgr2=0x7fe9cc133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.879+0000 7fe9d14f1700 1 --2- 172.21.15.72:0/2254951833 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9cc133930 0x7fe9cc133db0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009e50 tx=0x7fe9c400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.879+0000 7fe9d14f1700 1 -- 172.21.15.72:0/2254951833 shutdown_connections 2023-10-03T10:17:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.879+0000 7fe9d14f1700 1 --2- 172.21.15.72:0/2254951833 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9cc133930 0x7fe9cc133db0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.879+0000 7fe9d14f1700 1 --2- 172.21.15.72:0/2254951833 >> v2:172.21.15.72:3300/0 conn(0x7fe9cc0a0a30 0x7fe9cc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.879+0000 7fe9d14f1700 1 --2- 172.21.15.72:0/2254951833 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9cc09d630 0x7fe9cc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.879+0000 7fe9d14f1700 1 -- 172.21.15.72:0/2254951833 >> 172.21.15.72:0/2254951833 conn(0x7fe9cc0a3050 msgr2=0x7fe9cc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.879+0000 7fe9d14f1700 1 -- 172.21.15.72:0/2254951833 shutdown_connections 2023-10-03T10:17:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.879+0000 7fe9d14f1700 1 -- 172.21.15.72:0/2254951833 wait complete. 2023-10-03T10:17:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.880+0000 7fe9d14f1700 1 Processor -- start 2023-10-03T10:17:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.880+0000 7fe9d14f1700 1 -- start start 2023-10-03T10:17:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9d14f1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9cc09d630 0x7fe9cc11e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9d14f1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9cc0a0a30 0x7fe9cc11ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9d14f1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9cc133930 0x7fe9cc11f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9d14f1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc120a40 con 0x7fe9cc133930 2023-10-03T10:17:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9d14f1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc0a0480 con 0x7fe9cc0a0a30 2023-10-03T10:17:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9d14f1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc1205a0 con 0x7fe9cc09d630 2023-10-03T10:17:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9ca7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9cc0a0a30 0x7fe9cc11ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9ca7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9cc0a0a30 0x7fe9cc11ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50904/0 (socket says 172.21.15.72:50904) 2023-10-03T10:17:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9ca7fc700 1 -- 172.21.15.72:0/974294662 learned_addr learned my addr 172.21.15.72:0/974294662 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9cb7fe700 1 --2- 172.21.15.72:0/974294662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9cc133930 0x7fe9cc11f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9caffd700 1 --2- 172.21.15.72:0/974294662 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9cc09d630 0x7fe9cc11e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9ca7fc700 1 -- 172.21.15.72:0/974294662 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9cc09d630 msgr2=0x7fe9cc11e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9ca7fc700 1 --2- 172.21.15.72:0/974294662 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9cc09d630 0x7fe9cc11e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9ca7fc700 1 -- 172.21.15.72:0/974294662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9cc133930 msgr2=0x7fe9cc11f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9ca7fc700 1 --2- 172.21.15.72:0/974294662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9cc133930 0x7fe9cc11f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9ca7fc700 1 -- 172.21.15.72:0/974294662 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c4009b30 con 0x7fe9cc0a0a30 2023-10-03T10:17:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9cb7fe700 1 --2- 172.21.15.72:0/974294662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9cc133930 0x7fe9cc11f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9ca7fc700 1 --2- 172.21.15.72:0/974294662 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9cc0a0a30 0x7fe9cc11ed50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000e9e0 tx=0x7fe9c000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.881+0000 7fe9b37fe700 1 -- 172.21.15.72:0/974294662 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0009710 con 0x7fe9cc0a0a30 2023-10-03T10:17:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.882+0000 7fe9b37fe700 1 -- 172.21.15.72:0/974294662 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c000ee80 con 0x7fe9cc0a0a30 2023-10-03T10:17:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.882+0000 7fe9d14f1700 1 -- 172.21.15.72:0/974294662 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9cc0a4150 con 0x7fe9cc0a0a30 2023-10-03T10:17:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.882+0000 7fe9b37fe700 1 -- 172.21.15.72:0/974294662 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c000ca50 con 0x7fe9cc0a0a30 2023-10-03T10:17:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.882+0000 7fe9d14f1700 1 -- 172.21.15.72:0/974294662 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9cc120c10 con 0x7fe9cc0a0a30 2023-10-03T10:17:21.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.882+0000 7fe9b37fe700 1 -- 172.21.15.72:0/974294662 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe9c000cbb0 con 0x7fe9cc0a0a30 2023-10-03T10:17:21.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.883+0000 7fe9d14f1700 1 -- 172.21.15.72:0/974294662 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9cc0747f0 con 0x7fe9cc0a0a30 2023-10-03T10:17:21.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.883+0000 7fe9b37fe700 1 -- 172.21.15.72:0/974294662 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe9c003fb10 con 0x7fe9cc0a0a30 2023-10-03T10:17:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.887+0000 7fe9b37fe700 1 -- 172.21.15.72:0/974294662 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9c001b3b0 con 0x7fe9cc0a0a30 2023-10-03T10:17:21.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.962+0000 7fc6ccf4d700 1 -- 172.21.15.72:0/2481229535 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc6c80747f0 con 0x7fc6c809d630 2023-10-03T10:17:21.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.963+0000 7fc6b6ffd700 1 -- 172.21.15.72:0/2481229535 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc6b8019b40 con 0x7fc6c809d630 2023-10-03T10:17:21.963 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:21.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.965+0000 7fc6ccf4d700 1 -- 172.21.15.72:0/2481229535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c809d630 msgr2=0x7fc6c8133700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.965+0000 7fc6ccf4d700 1 --2- 172.21.15.72:0/2481229535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c809d630 0x7fc6c8133700 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800c460 tx=0x7fc6b800c770 comp rx=0 tx=0).stop 2023-10-03T10:17:21.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.965+0000 7fc6ccf4d700 1 -- 172.21.15.72:0/2481229535 shutdown_connections 2023-10-03T10:17:21.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.965+0000 7fc6ccf4d700 1 --2- 172.21.15.72:0/2481229535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6c809d630 0x7fc6c8133700 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.965+0000 7fc6ccf4d700 1 --2- 172.21.15.72:0/2481229535 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6c8138d80 0x7fc6c8134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.965+0000 7fc6ccf4d700 1 --2- 172.21.15.72:0/2481229535 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6c80a0a30 0x7fc6c8133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.965+0000 7fc6ccf4d700 1 -- 172.21.15.72:0/2481229535 >> 172.21.15.72:0/2481229535 conn(0x7fc6c80a3050 msgr2=0x7fc6c809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.965+0000 7fc6ccf4d700 1 -- 172.21.15.72:0/2481229535 shutdown_connections 2023-10-03T10:17:21.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:21.965+0000 7fc6ccf4d700 1 -- 172.21.15.72:0/2481229535 wait complete. 2023-10-03T10:17:21.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.036+0000 7fd554881700 1 -- 172.21.15.72:0/1540393754 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd550125ce0 con 0x7fd5500a1340 2023-10-03T10:17:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.037+0000 7fd53effd700 1 -- 172.21.15.72:0/1540393754 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd54402b020 con 0x7fd5500a1340 2023-10-03T10:17:22.036 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.039+0000 7fd554881700 1 -- 172.21.15.72:0/1540393754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5500a1340 msgr2=0x7fd550122d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.039+0000 7fd554881700 1 --2- 172.21.15.72:0/1540393754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5500a1340 0x7fd550122d40 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd544016000 tx=0x7fd544004750 comp rx=0 tx=0).stop 2023-10-03T10:17:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.039+0000 7fd554881700 1 -- 172.21.15.72:0/1540393754 shutdown_connections 2023-10-03T10:17:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.039+0000 7fd554881700 1 --2- 172.21.15.72:0/1540393754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5500a0a30 0x7fd550122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.039+0000 7fd554881700 1 --2- 172.21.15.72:0/1540393754 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd550133fa0 0x7fd550123280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.039+0000 7fd554881700 1 --2- 172.21.15.72:0/1540393754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5500a1340 0x7fd550122d40 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.039+0000 7fd554881700 1 -- 172.21.15.72:0/1540393754 >> 172.21.15.72:0/1540393754 conn(0x7fd5500a6550 msgr2=0x7fd5500a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.039+0000 7fd554881700 1 -- 172.21.15.72:0/1540393754 shutdown_connections 2023-10-03T10:17:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.039+0000 7fd554881700 1 -- 172.21.15.72:0/1540393754 wait complete. 2023-10-03T10:17:22.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:22.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.081+0000 7fe9d14f1700 1 -- 172.21.15.72:0/974294662 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe9cc072980 con 0x7fe9cc0a0a30 2023-10-03T10:17:22.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.082+0000 7fe9b37fe700 1 -- 172.21.15.72:0/974294662 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9c0017030 con 0x7fe9cc0a0a30 2023-10-03T10:17:22.081 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:22.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.084+0000 7fe9d14f1700 1 -- 172.21.15.72:0/974294662 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9cc0a0a30 msgr2=0x7fe9cc11ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.084+0000 7fe9d14f1700 1 --2- 172.21.15.72:0/974294662 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9cc0a0a30 0x7fe9cc11ed50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000e9e0 tx=0x7fe9c000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.084+0000 7fe9d14f1700 1 -- 172.21.15.72:0/974294662 shutdown_connections 2023-10-03T10:17:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.084+0000 7fe9d14f1700 1 --2- 172.21.15.72:0/974294662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe9cc133930 0x7fe9cc11f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.084+0000 7fe9d14f1700 1 --2- 172.21.15.72:0/974294662 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe9cc09d630 0x7fe9cc11e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.084+0000 7fe9d14f1700 1 --2- 172.21.15.72:0/974294662 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe9cc0a0a30 0x7fe9cc11ed50 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.084+0000 7fe9d14f1700 1 -- 172.21.15.72:0/974294662 >> 172.21.15.72:0/974294662 conn(0x7fe9cc0a3050 msgr2=0x7fe9cc1bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.084+0000 7fe9d14f1700 1 -- 172.21.15.72:0/974294662 shutdown_connections 2023-10-03T10:17:22.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.084+0000 7fe9d14f1700 1 -- 172.21.15.72:0/974294662 wait complete. 2023-10-03T10:17:22.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:22.678 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.802+0000 7feb3fe3f700 1 Processor -- start 2023-10-03T10:17:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.802+0000 7feb3fe3f700 1 -- start start 2023-10-03T10:17:22.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3fe3f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb3809d6f0 0x7feb3809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3fe3f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb3809e410 0x7feb38130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3fe3f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3809f130 con 0x7feb3809e000 2023-10-03T10:17:22.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3fe3f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3809f520 con 0x7feb3809d6f0 2023-10-03T10:17:22.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3fe3f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb3809e930 con 0x7feb3809e410 2023-10-03T10:17:22.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3e3dc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb3809e410 0x7feb38130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3dbdb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb3809d6f0 0x7feb3809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3d3da700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7feb3809e000 0x7feb38130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39674/0 (socket says 172.21.15.72:39674) 2023-10-03T10:17:22.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3d3da700 1 -- 172.21.15.72:0/2685532129 learned_addr learned my addr 172.21.15.72:0/2685532129 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:22.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3e3dc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb3809e410 0x7feb38130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49010/0 (socket says 172.21.15.72:49010) 2023-10-03T10:17:22.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3e3dc700 1 -- 172.21.15.72:0/2685532129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb3809d6f0 msgr2=0x7feb3809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3e3dc700 1 --2- 172.21.15.72:0/2685532129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb3809d6f0 0x7feb3809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3e3dc700 1 -- 172.21.15.72:0/2685532129 >> v1:172.21.15.72:6789/0 conn(0x7feb3809e000 legacy=0x7feb38130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3cbd9700 1 -- 172.21.15.72:0/2685532129 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178848936 0 0) 0x7feb3809f130 con 0x7feb3809e000 2023-10-03T10:17:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3e3dc700 1 -- 172.21.15.72:0/2685532129 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3809b2d0 con 0x7feb3809e410 2023-10-03T10:17:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3dbdb700 1 --2- 172.21.15.72:0/2685532129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb3809d6f0 0x7feb3809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.803+0000 7feb3e3dc700 1 --2- 172.21.15.72:0/2685532129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb3809e410 0x7feb38130d70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7feb30009dc0 tx=0x7feb3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d047922cd489e98 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.804+0000 7feb3cbd9700 1 -- 172.21.15.72:0/2685532129 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3000e070 con 0x7feb3809e410 2023-10-03T10:17:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.804+0000 7feb3cbd9700 1 -- 172.21.15.72:0/2685532129 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3000bb20 con 0x7feb3809e410 2023-10-03T10:17:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.804+0000 7feb3cbd9700 1 -- 172.21.15.72:0/2685532129 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30012430 con 0x7feb3809e410 2023-10-03T10:17:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.804+0000 7feb3fe3f700 1 -- 172.21.15.72:0/2685532129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb3809e410 msgr2=0x7feb38130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.804+0000 7feb3fe3f700 1 --2- 172.21.15.72:0/2685532129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb3809e410 0x7feb38130d70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7feb30009dc0 tx=0x7feb3000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.804+0000 7feb3fe3f700 1 -- 172.21.15.72:0/2685532129 shutdown_connections 2023-10-03T10:17:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.804+0000 7feb3fe3f700 1 --2- 172.21.15.72:0/2685532129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb3809e410 0x7feb38130d70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.804+0000 7feb3fe3f700 1 --2- 172.21.15.72:0/2685532129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb3809d6f0 0x7feb3809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.804+0000 7feb3fe3f700 1 -- 172.21.15.72:0/2685532129 >> 172.21.15.72:0/2685532129 conn(0x7feb38066f50 msgr2=0x7feb3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.804+0000 7feb3fe3f700 1 -- 172.21.15.72:0/2685532129 shutdown_connections 2023-10-03T10:17:22.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.804+0000 7feb3fe3f700 1 -- 172.21.15.72:0/2685532129 wait complete. 2023-10-03T10:17:22.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.805+0000 7feb3fe3f700 1 Processor -- start 2023-10-03T10:17:22.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.805+0000 7feb3fe3f700 1 -- start start 2023-10-03T10:17:22.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3fe3f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb3809d6f0 0x7feb381c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3fe3f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3809e000 0x7feb381c3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3fe3f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb3809e410 0x7feb381c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3fe3f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3809c700 con 0x7feb3809e000 2023-10-03T10:17:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3fe3f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb380a1e90 con 0x7feb3809e410 2023-10-03T10:17:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3fe3f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb381339d0 con 0x7feb3809d6f0 2023-10-03T10:17:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3d3da700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3809e000 0x7feb381c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3e3dc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb3809e410 0x7feb381c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3e3dc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb3809e410 0x7feb381c5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50924/0 (socket says 172.21.15.72:50924) 2023-10-03T10:17:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3d3da700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3809e000 0x7feb381c3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35758/0 (socket says 172.21.15.72:35758) 2023-10-03T10:17:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3e3dc700 1 -- 172.21.15.72:0/2915086000 learned_addr learned my addr 172.21.15.72:0/2915086000 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3dbdb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb3809d6f0 0x7feb381c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3e3dc700 1 -- 172.21.15.72:0/2915086000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb3809d6f0 msgr2=0x7feb381c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3e3dc700 1 --2- 172.21.15.72:0/2915086000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb3809d6f0 0x7feb381c2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3e3dc700 1 -- 172.21.15.72:0/2915086000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3809e000 msgr2=0x7feb381c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3e3dc700 1 --2- 172.21.15.72:0/2915086000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3809e000 0x7feb381c3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3e3dc700 1 -- 172.21.15.72:0/2915086000 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb280094a0 con 0x7feb3809e410 2023-10-03T10:17:22.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3d3da700 1 --2- 172.21.15.72:0/2915086000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3809e000 0x7feb381c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3dbdb700 1 --2- 172.21.15.72:0/2915086000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb3809d6f0 0x7feb381c2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3e3dc700 1 --2- 172.21.15.72:0/2915086000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb3809e410 0x7feb381c5e60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7feb30014040 tx=0x7feb30004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb2e7fc700 1 -- 172.21.15.72:0/2915086000 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30004880 con 0x7feb3809e410 2023-10-03T10:17:22.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb2e7fc700 1 -- 172.21.15.72:0/2915086000 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb30020070 con 0x7feb3809e410 2023-10-03T10:17:22.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb2e7fc700 1 -- 172.21.15.72:0/2915086000 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb300276c0 con 0x7feb3809e410 2023-10-03T10:17:22.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3fe3f700 1 -- 172.21.15.72:0/2915086000 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb30009a70 con 0x7feb3809e410 2023-10-03T10:17:22.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.806+0000 7feb3fe3f700 1 -- 172.21.15.72:0/2915086000 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb381c37a0 con 0x7feb3809e410 2023-10-03T10:17:22.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.807+0000 7feb2e7fc700 1 -- 172.21.15.72:0/2915086000 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb30012430 con 0x7feb3809e410 2023-10-03T10:17:22.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.807+0000 7feb2e7fc700 1 -- 172.21.15.72:0/2915086000 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feb30022070 con 0x7feb3809e410 2023-10-03T10:17:22.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.807+0000 7feb3fe3f700 1 -- 172.21.15.72:0/2915086000 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb38074ea0 con 0x7feb3809e410 2023-10-03T10:17:22.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.812+0000 7feb2e7fc700 1 -- 172.21.15.72:0/2915086000 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb3001b400 con 0x7feb3809e410 2023-10-03T10:17:22.977 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:22.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.998+0000 7feb3fe3f700 1 -- 172.21.15.72:0/2915086000 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feb3806c360 con 0x7feb3809e410 2023-10-03T10:17:22.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:22.998+0000 7feb2e7fc700 1 -- 172.21.15.72:0/2915086000 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb300263e0 con 0x7feb3809e410 2023-10-03T10:17:22.998 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.000+0000 7feb3fe3f700 1 -- 172.21.15.72:0/2915086000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb3809e410 msgr2=0x7feb381c5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.000+0000 7feb3fe3f700 1 --2- 172.21.15.72:0/2915086000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb3809e410 0x7feb381c5e60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7feb30014040 tx=0x7feb30004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.000+0000 7feb3fe3f700 1 -- 172.21.15.72:0/2915086000 shutdown_connections 2023-10-03T10:17:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.000+0000 7feb3fe3f700 1 --2- 172.21.15.72:0/2915086000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb3809e410 0x7feb381c5e60 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.000+0000 7feb3fe3f700 1 --2- 172.21.15.72:0/2915086000 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb3809d6f0 0x7feb381c2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.000+0000 7feb3fe3f700 1 --2- 172.21.15.72:0/2915086000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb3809e000 0x7feb381c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.000+0000 7feb3fe3f700 1 -- 172.21.15.72:0/2915086000 >> 172.21.15.72:0/2915086000 conn(0x7feb38066f50 msgr2=0x7feb38070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.000+0000 7feb3fe3f700 1 -- 172.21.15.72:0/2915086000 shutdown_connections 2023-10-03T10:17:23.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.000+0000 7feb3fe3f700 1 -- 172.21.15.72:0/2915086000 wait complete. 2023-10-03T10:17:23.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:23.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:23.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:23.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.104+0000 7f828c2a4700 1 Processor -- start 2023-10-03T10:17:23.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.104+0000 7f828c2a4700 1 -- start start 2023-10-03T10:17:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.105+0000 7f828c2a4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82841338a0 0x7f8284133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.105+0000 7f828c2a4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f828409e930 0x7f828413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.105+0000 7f828c2a4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828406ef30 con 0x7f828409de50 2023-10-03T10:17:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.105+0000 7f828c2a4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828406fef0 con 0x7f828409e930 2023-10-03T10:17:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.105+0000 7f828c2a4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82841334b0 con 0x7f82841338a0 2023-10-03T10:17:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.105+0000 7f828a841700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f828409e930 0x7f828413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.105+0000 7f828a841700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f828409e930 0x7f828413b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35766/0 (socket says 172.21.15.72:35766) 2023-10-03T10:17:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.105+0000 7f828a841700 1 -- 172.21.15.72:0/250419440 learned_addr learned my addr 172.21.15.72:0/250419440 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.105+0000 7f828a040700 1 --2- 172.21.15.72:0/250419440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82841338a0 0x7f8284133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.105+0000 7f828a841700 1 -- 172.21.15.72:0/250419440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82841338a0 msgr2=0x7f8284133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.105+0000 7f828a841700 1 --2- 172.21.15.72:0/250419440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82841338a0 0x7f8284133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.105+0000 7f828a841700 1 -- 172.21.15.72:0/250419440 >> v1:172.21.15.72:6789/0 conn(0x7f828409de50 legacy=0x7f828409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.105+0000 7f828a841700 1 -- 172.21.15.72:0/250419440 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828406fc30 con 0x7f828409e930 2023-10-03T10:17:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.105+0000 7f828a841700 1 --2- 172.21.15.72:0/250419440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f828409e930 0x7f828413b740 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f827c009e50 tx=0x7f827c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e152ba547ad7c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.106+0000 7f828903e700 1 -- 172.21.15.72:0/250419440 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c00e070 con 0x7f828409e930 2023-10-03T10:17:23.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.106+0000 7f828903e700 1 -- 172.21.15.72:0/250419440 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c00b910 con 0x7f828409e930 2023-10-03T10:17:23.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.106+0000 7f828903e700 1 -- 172.21.15.72:0/250419440 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c00bcc0 con 0x7f828409e930 2023-10-03T10:17:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.107+0000 7f828c2a4700 1 -- 172.21.15.72:0/250419440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f828409e930 msgr2=0x7f828413b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.107+0000 7f828c2a4700 1 --2- 172.21.15.72:0/250419440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f828409e930 0x7f828413b740 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f827c009e50 tx=0x7f827c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.107+0000 7f828c2a4700 1 -- 172.21.15.72:0/250419440 shutdown_connections 2023-10-03T10:17:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.107+0000 7f828c2a4700 1 --2- 172.21.15.72:0/250419440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f828409e930 0x7f828413b740 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.107+0000 7f828c2a4700 1 --2- 172.21.15.72:0/250419440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f82841338a0 0x7f8284133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.107+0000 7f828c2a4700 1 -- 172.21.15.72:0/250419440 >> 172.21.15.72:0/250419440 conn(0x7f82840a2aa0 msgr2=0x7f82840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.107+0000 7f828c2a4700 1 -- 172.21.15.72:0/250419440 shutdown_connections 2023-10-03T10:17:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.107+0000 7f828c2a4700 1 -- 172.21.15.72:0/250419440 wait complete. 2023-10-03T10:17:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.108+0000 7f828c2a4700 1 Processor -- start 2023-10-03T10:17:23.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.108+0000 7f828c2a4700 1 -- start start 2023-10-03T10:17:23.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828c2a4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828409de50 0x7f828411d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828c2a4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828409e930 0x7f828411dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828c2a4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82841338a0 0x7f828411e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828c2a4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82840a0f90 con 0x7f82841338a0 2023-10-03T10:17:23.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828c2a4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8284120bb0 con 0x7f828409de50 2023-10-03T10:17:23.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828c2a4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f828411f350 con 0x7f828409e930 2023-10-03T10:17:23.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828983f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828409e930 0x7f828411dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828983f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828409e930 0x7f828411dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49032/0 (socket says 172.21.15.72:49032) 2023-10-03T10:17:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828983f700 1 -- 172.21.15.72:0/2290560358 learned_addr learned my addr 172.21.15.72:0/2290560358 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828a841700 1 --2- 172.21.15.72:0/2290560358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82841338a0 0x7f828411e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828a040700 1 --2- 172.21.15.72:0/2290560358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828409de50 0x7f828411d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828a040700 1 -- 172.21.15.72:0/2290560358 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828409e930 msgr2=0x7f828411dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828a040700 1 --2- 172.21.15.72:0/2290560358 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828409e930 0x7f828411dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828a040700 1 -- 172.21.15.72:0/2290560358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82841338a0 msgr2=0x7f828411e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828a040700 1 --2- 172.21.15.72:0/2290560358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82841338a0 0x7f828411e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828a040700 1 -- 172.21.15.72:0/2290560358 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c009b30 con 0x7f828409de50 2023-10-03T10:17:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.109+0000 7f828a841700 1 --2- 172.21.15.72:0/2290560358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82841338a0 0x7f828411e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.110+0000 7f828a040700 1 --2- 172.21.15.72:0/2290560358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828409de50 0x7f828411d740 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f828000e930 tx=0x7f828000ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.110+0000 7f827affd700 1 -- 172.21.15.72:0/2290560358 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280013680 con 0x7f828409de50 2023-10-03T10:17:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.110+0000 7f827affd700 1 -- 172.21.15.72:0/2290560358 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82800137e0 con 0x7f828409de50 2023-10-03T10:17:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.110+0000 7f828c2a4700 1 -- 172.21.15.72:0/2290560358 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828406f640 con 0x7f828409de50 2023-10-03T10:17:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.110+0000 7f827affd700 1 -- 172.21.15.72:0/2290560358 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280013b50 con 0x7f828409de50 2023-10-03T10:17:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.110+0000 7f828c2a4700 1 -- 172.21.15.72:0/2290560358 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8284120040 con 0x7f828409de50 2023-10-03T10:17:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.111+0000 7f827affd700 1 -- 172.21.15.72:0/2290560358 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8280013cb0 con 0x7f828409de50 2023-10-03T10:17:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.111+0000 7f827affd700 1 -- 172.21.15.72:0/2290560358 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f828003f630 con 0x7f828409de50 2023-10-03T10:17:23.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.111+0000 7f828c2a4700 1 -- 172.21.15.72:0/2290560358 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828411a470 con 0x7f828409de50 2023-10-03T10:17:23.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.116+0000 7f827affd700 1 -- 172.21.15.72:0/2290560358 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f828001bc30 con 0x7f828409de50 2023-10-03T10:17:23.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.182+0000 7f5f9d9d5700 1 Processor -- start 2023-10-03T10:17:23.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.182+0000 7f5f9d9d5700 1 -- start start 2023-10-03T10:17:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.183+0000 7f5f9d9d5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f981337f0 0x7f5f98138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.183+0000 7f5f9d9d5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5f98138dc0 0x7f5f9813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.183+0000 7f5f9d9d5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9806b990 con 0x7f5f98133420 2023-10-03T10:17:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.183+0000 7f5f9d9d5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9809b0e0 con 0x7f5f98138dc0 2023-10-03T10:17:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.183+0000 7f5f9d9d5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f98133c20 con 0x7f5f981337f0 2023-10-03T10:17:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.183+0000 7f5f967fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f981337f0 0x7f5f98138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.183+0000 7f5f977fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5f98138dc0 0x7f5f9813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.183+0000 7f5f967fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f981337f0 0x7f5f98138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50944/0 (socket says 172.21.15.72:50944) 2023-10-03T10:17:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.183+0000 7f5f967fc700 1 -- 172.21.15.72:0/632082663 learned_addr learned my addr 172.21.15.72:0/632082663 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.183+0000 7f5f967fc700 1 -- 172.21.15.72:0/632082663 >> v2:172.21.15.72:3300/0 conn(0x7f5f98138dc0 msgr2=0x7f5f9813b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.183+0000 7f5f967fc700 1 --2- 172.21.15.72:0/632082663 >> v2:172.21.15.72:3300/0 conn(0x7f5f98138dc0 0x7f5f9813b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.183+0000 7f5f967fc700 1 -- 172.21.15.72:0/632082663 >> v1:172.21.15.72:6789/0 conn(0x7f5f98133420 legacy=0x7f5f98133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.183+0000 7f5f967fc700 1 -- 172.21.15.72:0/632082663 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f980a0590 con 0x7f5f981337f0 2023-10-03T10:17:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.183+0000 7f5f95ffb700 1 -- 172.21.15.72:0/632082663 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216034564 0 0) 0x7f5f9806b990 con 0x7f5f98133420 2023-10-03T10:17:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.184+0000 7f5f977fe700 1 --2- 172.21.15.72:0/632082663 >> v2:172.21.15.72:3300/0 conn(0x7f5f98138dc0 0x7f5f9813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.184+0000 7f5f967fc700 1 --2- 172.21.15.72:0/632082663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f981337f0 0x7f5f98138880 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0098f0 tx=0x7f5f8c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3688af13b553810 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.184+0000 7f5f95ffb700 1 -- 172.21.15.72:0/632082663 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c011830 con 0x7f5f981337f0 2023-10-03T10:17:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.184+0000 7f5f95ffb700 1 -- 172.21.15.72:0/632082663 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c011990 con 0x7f5f981337f0 2023-10-03T10:17:23.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.184+0000 7f5f95ffb700 1 -- 172.21.15.72:0/632082663 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c011d20 con 0x7f5f981337f0 2023-10-03T10:17:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.184+0000 7f5f9d9d5700 1 -- 172.21.15.72:0/632082663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f981337f0 msgr2=0x7f5f98138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.184+0000 7f5f9d9d5700 1 --2- 172.21.15.72:0/632082663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f981337f0 0x7f5f98138880 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0098f0 tx=0x7f5f8c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.184+0000 7f5f9d9d5700 1 -- 172.21.15.72:0/632082663 shutdown_connections 2023-10-03T10:17:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.184+0000 7f5f9d9d5700 1 --2- 172.21.15.72:0/632082663 >> v2:172.21.15.72:3300/0 conn(0x7f5f98138dc0 0x7f5f9813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.184+0000 7f5f9d9d5700 1 --2- 172.21.15.72:0/632082663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f981337f0 0x7f5f98138880 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.184+0000 7f5f9d9d5700 1 -- 172.21.15.72:0/632082663 >> 172.21.15.72:0/632082663 conn(0x7f5f980a4210 msgr2=0x7f5f980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.185+0000 7f5f9d9d5700 1 -- 172.21.15.72:0/632082663 shutdown_connections 2023-10-03T10:17:23.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.185+0000 7f5f9d9d5700 1 -- 172.21.15.72:0/632082663 wait complete. 2023-10-03T10:17:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.186+0000 7f5f9d9d5700 1 Processor -- start 2023-10-03T10:17:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.186+0000 7f5f9d9d5700 1 -- start start 2023-10-03T10:17:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.186+0000 7f5f9d9d5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f98133420 0x7f5f9809c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.186+0000 7f5f9d9d5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f981337f0 0x7f5f9809ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.186+0000 7f5f9d9d5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f98138dc0 0x7f5f9809d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.186+0000 7f5f9d9d5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9809b220 con 0x7f5f981337f0 2023-10-03T10:17:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.186+0000 7f5f9d9d5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9812f330 con 0x7f5f98133420 2023-10-03T10:17:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.186+0000 7f5f9d9d5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9809e200 con 0x7f5f98138dc0 2023-10-03T10:17:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f967fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f981337f0 0x7f5f9809ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f96ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f98133420 0x7f5f9809c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f967fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f981337f0 0x7f5f9809ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35792/0 (socket says 172.21.15.72:35792) 2023-10-03T10:17:23.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f96ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f98133420 0x7f5f9809c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50960/0 (socket says 172.21.15.72:50960) 2023-10-03T10:17:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f967fc700 1 -- 172.21.15.72:0/3702038106 learned_addr learned my addr 172.21.15.72:0/3702038106 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f977fe700 1 --2- 172.21.15.72:0/3702038106 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f98138dc0 0x7f5f9809d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f967fc700 1 -- 172.21.15.72:0/3702038106 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f98138dc0 msgr2=0x7f5f9809d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f967fc700 1 --2- 172.21.15.72:0/3702038106 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f98138dc0 0x7f5f9809d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f967fc700 1 -- 172.21.15.72:0/3702038106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f98133420 msgr2=0x7f5f9809c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f967fc700 1 --2- 172.21.15.72:0/3702038106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f98133420 0x7f5f9809c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f967fc700 1 -- 172.21.15.72:0/3702038106 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f90009a70 con 0x7f5f981337f0 2023-10-03T10:17:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f96ffd700 1 --2- 172.21.15.72:0/3702038106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f98133420 0x7f5f9809c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f967fc700 1 --2- 172.21.15.72:0/3702038106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f981337f0 0x7f5f9809ce00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c009c40 tx=0x7f5f8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f7ffff700 1 -- 172.21.15.72:0/3702038106 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c004550 con 0x7f5f981337f0 2023-10-03T10:17:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f7ffff700 1 -- 172.21.15.72:0/3702038106 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c0036a0 con 0x7f5f981337f0 2023-10-03T10:17:23.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f9d9d5700 1 -- 172.21.15.72:0/3702038106 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8c009550 con 0x7f5f981337f0 2023-10-03T10:17:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f7ffff700 1 -- 172.21.15.72:0/3702038106 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c003a10 con 0x7f5f981337f0 2023-10-03T10:17:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.187+0000 7f5f9d9d5700 1 -- 172.21.15.72:0/3702038106 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9812f8d0 con 0x7f5f981337f0 2023-10-03T10:17:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.188+0000 7f5f9d9d5700 1 -- 172.21.15.72:0/3702038106 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f98074ea0 con 0x7f5f981337f0 2023-10-03T10:17:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.188+0000 7f5f7ffff700 1 -- 172.21.15.72:0/3702038106 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f8c021070 con 0x7f5f981337f0 2023-10-03T10:17:23.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.189+0000 7f5f7ffff700 1 -- 172.21.15.72:0/3702038106 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5f8c040ac0 con 0x7f5f981337f0 2023-10-03T10:17:23.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.193+0000 7f5f7ffff700 1 -- 172.21.15.72:0/3702038106 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f8c02ce00 con 0x7f5f981337f0 2023-10-03T10:17:23.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.226+0000 7f0817e3b700 1 Processor -- start 2023-10-03T10:17:23.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.226+0000 7f0817e3b700 1 -- start start 2023-10-03T10:17:23.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f0817e3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08100a0a30 0x7f08100a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f0817e3b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f081009d630 0x7f08100a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f0817e3b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0810133930 0x7f0810133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f0817e3b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100a2a70 con 0x7f081009d630 2023-10-03T10:17:23.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f0817e3b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08100a01d0 con 0x7f08100a0a30 2023-10-03T10:17:23.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f0817e3b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f081009e2b0 con 0x7f0810133930 2023-10-03T10:17:23.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f0815bd7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08100a0a30 0x7f08100a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f08153d6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f081009d630 0x7f08100a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f0815bd7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08100a0a30 0x7f08100a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50966/0 (socket says 172.21.15.72:50966) 2023-10-03T10:17:23.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f08153d6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f081009d630 0x7f08100a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35806/0 (socket says 172.21.15.72:35806) 2023-10-03T10:17:23.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f0815bd7700 1 -- 172.21.15.72:0/850095809 learned_addr learned my addr 172.21.15.72:0/850095809 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:23.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f08163d8700 1 --2- 172.21.15.72:0/850095809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0810133930 0x7f0810133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f0815bd7700 1 -- 172.21.15.72:0/850095809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0810133930 msgr2=0x7f0810133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f0815bd7700 1 --2- 172.21.15.72:0/850095809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0810133930 0x7f0810133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f0815bd7700 1 -- 172.21.15.72:0/850095809 >> v2:172.21.15.72:3300/0 conn(0x7f081009d630 msgr2=0x7f08100a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f0815bd7700 1 --2- 172.21.15.72:0/850095809 >> v2:172.21.15.72:3300/0 conn(0x7f081009d630 0x7f08100a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f0815bd7700 1 -- 172.21.15.72:0/850095809 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081009dc50 con 0x7f08100a0a30 2023-10-03T10:17:23.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.227+0000 7f0815bd7700 1 --2- 172.21.15.72:0/850095809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08100a0a30 0x7f08100a0e00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f080c0098f0 tx=0x7f080c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dba48876af7b468 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.228+0000 7f0814bd5700 1 -- 172.21.15.72:0/850095809 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c011830 con 0x7f08100a0a30 2023-10-03T10:17:23.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.228+0000 7f0814bd5700 1 -- 172.21.15.72:0/850095809 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c011990 con 0x7f08100a0a30 2023-10-03T10:17:23.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.228+0000 7f0814bd5700 1 -- 172.21.15.72:0/850095809 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c011d20 con 0x7f08100a0a30 2023-10-03T10:17:23.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.228+0000 7f0817e3b700 1 -- 172.21.15.72:0/850095809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08100a0a30 msgr2=0x7f08100a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.228+0000 7f0817e3b700 1 --2- 172.21.15.72:0/850095809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08100a0a30 0x7f08100a0e00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f080c0098f0 tx=0x7f080c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.228+0000 7f0817e3b700 1 -- 172.21.15.72:0/850095809 shutdown_connections 2023-10-03T10:17:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.228+0000 7f0817e3b700 1 --2- 172.21.15.72:0/850095809 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0810133930 0x7f0810133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.228+0000 7f0817e3b700 1 --2- 172.21.15.72:0/850095809 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08100a0a30 0x7f08100a0e00 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.228+0000 7f0817e3b700 1 --2- 172.21.15.72:0/850095809 >> v2:172.21.15.72:3300/0 conn(0x7f081009d630 0x7f08100a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.228+0000 7f0817e3b700 1 -- 172.21.15.72:0/850095809 >> 172.21.15.72:0/850095809 conn(0x7f08100a3050 msgr2=0x7f08100a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.228+0000 7f0817e3b700 1 -- 172.21.15.72:0/850095809 shutdown_connections 2023-10-03T10:17:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.228+0000 7f0817e3b700 1 -- 172.21.15.72:0/850095809 wait complete. 2023-10-03T10:17:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.230+0000 7f0817e3b700 1 Processor -- start 2023-10-03T10:17:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.230+0000 7f0817e3b700 1 -- start start 2023-10-03T10:17:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.230+0000 7f0817e3b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f081009d630 0x7f081011e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.230+0000 7f0817e3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08100a0a30 0x7f081011ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.230+0000 7f0817e3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0810133930 0x7f081011f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.230+0000 7f0817e3b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081011fde0 con 0x7f0810133930 2023-10-03T10:17:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.230+0000 7f0817e3b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0810120490 con 0x7f08100a0a30 2023-10-03T10:17:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.230+0000 7f0817e3b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08101223a0 con 0x7f081009d630 2023-10-03T10:17:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.230+0000 7f08153d6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08100a0a30 0x7f081011ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.230+0000 7f08153d6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08100a0a30 0x7f081011ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:50982/0 (socket says 172.21.15.72:50982) 2023-10-03T10:17:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.230+0000 7f0815bd7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f081009d630 0x7f081011e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.230+0000 7f08153d6700 1 -- 172.21.15.72:0/2362316206 learned_addr learned my addr 172.21.15.72:0/2362316206 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.230+0000 7f08163d8700 1 --2- 172.21.15.72:0/2362316206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0810133930 0x7f081011f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.231+0000 7f08153d6700 1 -- 172.21.15.72:0/2362316206 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f081009d630 msgr2=0x7f081011e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.231+0000 7f08153d6700 1 --2- 172.21.15.72:0/2362316206 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f081009d630 0x7f081011e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.231+0000 7f08153d6700 1 -- 172.21.15.72:0/2362316206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0810133930 msgr2=0x7f081011f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.231+0000 7f08153d6700 1 --2- 172.21.15.72:0/2362316206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0810133930 0x7f081011f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.231+0000 7f08153d6700 1 -- 172.21.15.72:0/2362316206 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c009550 con 0x7f08100a0a30 2023-10-03T10:17:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.231+0000 7f0815bd7700 1 --2- 172.21.15.72:0/2362316206 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f081009d630 0x7f081011e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.231+0000 7f08153d6700 1 --2- 172.21.15.72:0/2362316206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08100a0a30 0x7f081011ee50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f080000e980 tx=0x7f080000ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.231+0000 7f08067fc700 1 -- 172.21.15.72:0/2362316206 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800009710 con 0x7f08100a0a30 2023-10-03T10:17:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.231+0000 7f08067fc700 1 -- 172.21.15.72:0/2362316206 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080000c690 con 0x7f08100a0a30 2023-10-03T10:17:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.231+0000 7f0817e3b700 1 -- 172.21.15.72:0/2362316206 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08100a4150 con 0x7f08100a0a30 2023-10-03T10:17:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.231+0000 7f08067fc700 1 -- 172.21.15.72:0/2362316206 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080000ca20 con 0x7f08100a0a30 2023-10-03T10:17:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.231+0000 7f0817e3b700 1 -- 172.21.15.72:0/2362316206 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0810120c40 con 0x7f08100a0a30 2023-10-03T10:17:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.232+0000 7f08067fc700 1 -- 172.21.15.72:0/2362316206 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f080000cb80 con 0x7f08100a0a30 2023-10-03T10:17:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.232+0000 7f08067fc700 1 -- 172.21.15.72:0/2362316206 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f080003fa70 con 0x7f08100a0a30 2023-10-03T10:17:23.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.232+0000 7f0817e3b700 1 -- 172.21.15.72:0/2362316206 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08100008d0 con 0x7f08100a0a30 2023-10-03T10:17:23.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.237+0000 7f08067fc700 1 -- 172.21.15.72:0/2362316206 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f080001b3b0 con 0x7f08100a0a30 2023-10-03T10:17:23.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.320+0000 7f828c2a4700 1 -- 172.21.15.72:0/2290560358 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8284074ea0 con 0x7f828409de50 2023-10-03T10:17:23.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.320+0000 7f827affd700 1 -- 172.21.15.72:0/2290560358 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8280021030 con 0x7f828409de50 2023-10-03T10:17:23.320 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:23.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.322+0000 7f828c2a4700 1 -- 172.21.15.72:0/2290560358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828409de50 msgr2=0x7f828411d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.322+0000 7f828c2a4700 1 --2- 172.21.15.72:0/2290560358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828409de50 0x7f828411d740 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f828000e930 tx=0x7f828000ec40 comp rx=0 tx=0).stop 2023-10-03T10:17:23.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.322+0000 7f828c2a4700 1 -- 172.21.15.72:0/2290560358 shutdown_connections 2023-10-03T10:17:23.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.322+0000 7f828c2a4700 1 --2- 172.21.15.72:0/2290560358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82841338a0 0x7f828411e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.322+0000 7f828c2a4700 1 --2- 172.21.15.72:0/2290560358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828409de50 0x7f828411d740 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.322+0000 7f828c2a4700 1 --2- 172.21.15.72:0/2290560358 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828409e930 0x7f828411dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.322+0000 7f828c2a4700 1 -- 172.21.15.72:0/2290560358 >> 172.21.15.72:0/2290560358 conn(0x7f82840a2aa0 msgr2=0x7f82841b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.322+0000 7f828c2a4700 1 -- 172.21.15.72:0/2290560358 shutdown_connections 2023-10-03T10:17:23.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.323+0000 7f828c2a4700 1 -- 172.21.15.72:0/2290560358 wait complete. 2023-10-03T10:17:23.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.389+0000 7f5f9d9d5700 1 -- 172.21.15.72:0/3702038106 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5f98138ba0 con 0x7f5f981337f0 2023-10-03T10:17:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.389+0000 7f5f7ffff700 1 -- 172.21.15.72:0/3702038106 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5f8c015020 con 0x7f5f981337f0 2023-10-03T10:17:23.389 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:23.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.392+0000 7f5f9d9d5700 1 -- 172.21.15.72:0/3702038106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f981337f0 msgr2=0x7f5f9809ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.392+0000 7f5f9d9d5700 1 --2- 172.21.15.72:0/3702038106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f981337f0 0x7f5f9809ce00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c009c40 tx=0x7f5f8c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:23.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.392+0000 7f5f9d9d5700 1 -- 172.21.15.72:0/3702038106 shutdown_connections 2023-10-03T10:17:23.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.392+0000 7f5f9d9d5700 1 --2- 172.21.15.72:0/3702038106 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f98138dc0 0x7f5f9809d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.392+0000 7f5f9d9d5700 1 --2- 172.21.15.72:0/3702038106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f98133420 0x7f5f9809c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.392+0000 7f5f9d9d5700 1 --2- 172.21.15.72:0/3702038106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f981337f0 0x7f5f9809ce00 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.392+0000 7f5f9d9d5700 1 -- 172.21.15.72:0/3702038106 >> 172.21.15.72:0/3702038106 conn(0x7f5f980a4210 msgr2=0x7f5f980a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.393+0000 7f5f9d9d5700 1 -- 172.21.15.72:0/3702038106 shutdown_connections 2023-10-03T10:17:23.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.393+0000 7f5f9d9d5700 1 -- 172.21.15.72:0/3702038106 wait complete. 2023-10-03T10:17:23.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:23.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.441+0000 7f0817e3b700 1 -- 172.21.15.72:0/2362316206 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0810121d60 con 0x7f08100a0a30 2023-10-03T10:17:23.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.441+0000 7f08067fc700 1 -- 172.21.15.72:0/2362316206 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0810121d60 con 0x7f08100a0a30 2023-10-03T10:17:23.441 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:23.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.444+0000 7f0817e3b700 1 -- 172.21.15.72:0/2362316206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08100a0a30 msgr2=0x7f081011ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.444+0000 7f0817e3b700 1 --2- 172.21.15.72:0/2362316206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08100a0a30 0x7f081011ee50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f080000e980 tx=0x7f080000ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:23.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.444+0000 7f0817e3b700 1 -- 172.21.15.72:0/2362316206 shutdown_connections 2023-10-03T10:17:23.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.444+0000 7f0817e3b700 1 --2- 172.21.15.72:0/2362316206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0810133930 0x7f081011f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.444+0000 7f0817e3b700 1 --2- 172.21.15.72:0/2362316206 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f081009d630 0x7f081011e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.444+0000 7f0817e3b700 1 --2- 172.21.15.72:0/2362316206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08100a0a30 0x7f081011ee50 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.444+0000 7f0817e3b700 1 -- 172.21.15.72:0/2362316206 >> 172.21.15.72:0/2362316206 conn(0x7f08100a3050 msgr2=0x7f08101bbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.444+0000 7f0817e3b700 1 -- 172.21.15.72:0/2362316206 shutdown_connections 2023-10-03T10:17:23.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:23.444+0000 7f0817e3b700 1 -- 172.21.15.72:0/2362316206 wait complete. 2023-10-03T10:17:23.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:24.014 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:24.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.144+0000 7f021dcfc700 1 Processor -- start 2023-10-03T10:17:24.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.144+0000 7f021dcfc700 1 -- start start 2023-10-03T10:17:24.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.145+0000 7f021dcfc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0218136710 0x7f0218138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.145+0000 7f021dcfc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0218139030 0x7f021813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.145+0000 7f021dcfc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021806ef30 con 0x7f02181338a0 2023-10-03T10:17:24.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.145+0000 7f021dcfc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021806fef0 con 0x7f0218136710 2023-10-03T10:17:24.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.145+0000 7f021dcfc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02181334b0 con 0x7f0218139030 2023-10-03T10:17:24.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.145+0000 7f0216ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0218136710 0x7f0218138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.145+0000 7f0217fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0218139030 0x7f021813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.145+0000 7f02177fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f02181338a0 0x7f0218133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39708/0 (socket says 172.21.15.72:39708) 2023-10-03T10:17:24.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.145+0000 7f02177fe700 1 -- 172.21.15.72:0/149700467 learned_addr learned my addr 172.21.15.72:0/149700467 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:24.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.145+0000 7f0216ffd700 1 -- 172.21.15.72:0/149700467 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0218139030 msgr2=0x7f021813b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:24.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.145+0000 7f0216ffd700 1 --2- 172.21.15.72:0/149700467 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0218139030 0x7f021813b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.145+0000 7f02167fc700 1 -- 172.21.15.72:0/149700467 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222537605 0 0) 0x7f021806ef30 con 0x7f02181338a0 2023-10-03T10:17:24.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.145+0000 7f0216ffd700 1 -- 172.21.15.72:0/149700467 >> v1:172.21.15.72:6789/0 conn(0x7f02181338a0 legacy=0x7f0218133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.145+0000 7f0216ffd700 1 -- 172.21.15.72:0/149700467 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021806fc30 con 0x7f0218136710 2023-10-03T10:17:24.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.145+0000 7f0217fff700 1 --2- 172.21.15.72:0/149700467 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0218139030 0x7f021813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.146+0000 7f0216ffd700 1 --2- 172.21.15.72:0/149700467 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0218136710 0x7f0218138af0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0200009870 tx=0x7f0200009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95e80e3e94607ee0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.146+0000 7f02167fc700 1 -- 172.21.15.72:0/149700467 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200011830 con 0x7f0218136710 2023-10-03T10:17:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.146+0000 7f02167fc700 1 -- 172.21.15.72:0/149700467 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0200011990 con 0x7f0218136710 2023-10-03T10:17:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.146+0000 7f02167fc700 1 -- 172.21.15.72:0/149700467 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200011d20 con 0x7f0218136710 2023-10-03T10:17:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.146+0000 7f021dcfc700 1 -- 172.21.15.72:0/149700467 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0218136710 msgr2=0x7f0218138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.146+0000 7f021dcfc700 1 --2- 172.21.15.72:0/149700467 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0218136710 0x7f0218138af0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0200009870 tx=0x7f0200009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.146+0000 7f021dcfc700 1 -- 172.21.15.72:0/149700467 shutdown_connections 2023-10-03T10:17:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.146+0000 7f021dcfc700 1 --2- 172.21.15.72:0/149700467 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0218139030 0x7f021813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.146+0000 7f021dcfc700 1 --2- 172.21.15.72:0/149700467 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0218136710 0x7f0218138af0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.146+0000 7f021dcfc700 1 -- 172.21.15.72:0/149700467 >> 172.21.15.72:0/149700467 conn(0x7f02180a2aa0 msgr2=0x7f02180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.146+0000 7f021dcfc700 1 -- 172.21.15.72:0/149700467 shutdown_connections 2023-10-03T10:17:24.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.146+0000 7f021dcfc700 1 -- 172.21.15.72:0/149700467 wait complete. 2023-10-03T10:17:24.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.147+0000 7f021dcfc700 1 Processor -- start 2023-10-03T10:17:24.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.147+0000 7f021dcfc700 1 -- start start 2023-10-03T10:17:24.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f021dcfc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02181338a0 0x7f02181c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f021dcfc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0218136710 0x7f02181c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f021dcfc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0218139030 0x7f021811ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f021dcfc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021811ca40 con 0x7f0218139030 2023-10-03T10:17:24.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f021dcfc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021811c850 con 0x7f02181338a0 2023-10-03T10:17:24.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f021dcfc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f021811e760 con 0x7f0218136710 2023-10-03T10:17:24.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f02177fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02181338a0 0x7f02181c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f02177fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02181338a0 0x7f02181c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51000/0 (socket says 172.21.15.72:51000) 2023-10-03T10:17:24.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f02177fe700 1 -- 172.21.15.72:0/46831110 learned_addr learned my addr 172.21.15.72:0/46831110 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:24.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f0216ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0218136710 0x7f02181c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f0217fff700 1 --2- 172.21.15.72:0/46831110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0218139030 0x7f021811ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f02177fe700 1 -- 172.21.15.72:0/46831110 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0218136710 msgr2=0x7f02181c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f02177fe700 1 --2- 172.21.15.72:0/46831110 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0218136710 0x7f02181c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f02177fe700 1 -- 172.21.15.72:0/46831110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0218139030 msgr2=0x7f021811ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f02177fe700 1 --2- 172.21.15.72:0/46831110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0218139030 0x7f021811ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f02177fe700 1 -- 172.21.15.72:0/46831110 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0210009a70 con 0x7f02181338a0 2023-10-03T10:17:24.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f0216ffd700 1 --2- 172.21.15.72:0/46831110 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0218136710 0x7f02181c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f02177fe700 1 --2- 172.21.15.72:0/46831110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02181338a0 0x7f02181c8420 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f020800c520 tx=0x7f020800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.148+0000 7f020ffff700 1 -- 172.21.15.72:0/46831110 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208004c80 con 0x7f02181338a0 2023-10-03T10:17:24.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.149+0000 7f020ffff700 1 -- 172.21.15.72:0/46831110 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0208004e00 con 0x7f02181338a0 2023-10-03T10:17:24.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.149+0000 7f020ffff700 1 -- 172.21.15.72:0/46831110 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208007310 con 0x7f02181338a0 2023-10-03T10:17:24.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.149+0000 7f021dcfc700 1 -- 172.21.15.72:0/46831110 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02000094a0 con 0x7f02181338a0 2023-10-03T10:17:24.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.149+0000 7f021dcfc700 1 -- 172.21.15.72:0/46831110 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0218130b60 con 0x7f02181338a0 2023-10-03T10:17:24.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.149+0000 7f020ffff700 1 -- 172.21.15.72:0/46831110 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0208007470 con 0x7f02181338a0 2023-10-03T10:17:24.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.150+0000 7f020ffff700 1 -- 172.21.15.72:0/46831110 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f020803f300 con 0x7f02181338a0 2023-10-03T10:17:24.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.150+0000 7f021dcfc700 1 -- 172.21.15.72:0/46831110 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021811e120 con 0x7f02181338a0 2023-10-03T10:17:24.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.154+0000 7f020ffff700 1 -- 172.21.15.72:0/46831110 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f021811e120 con 0x7f02181338a0 2023-10-03T10:17:24.335 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:24.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.337+0000 7f021dcfc700 1 -- 172.21.15.72:0/46831110 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f021811e120 con 0x7f02181338a0 2023-10-03T10:17:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.337+0000 7f020ffff700 1 -- 172.21.15.72:0/46831110 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f021811e120 con 0x7f02181338a0 2023-10-03T10:17:24.338 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.340+0000 7f021dcfc700 1 -- 172.21.15.72:0/46831110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02181338a0 msgr2=0x7f02181c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.340+0000 7f021dcfc700 1 --2- 172.21.15.72:0/46831110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02181338a0 0x7f02181c8420 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f020800c520 tx=0x7f020800c830 comp rx=0 tx=0).stop 2023-10-03T10:17:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.340+0000 7f021dcfc700 1 -- 172.21.15.72:0/46831110 shutdown_connections 2023-10-03T10:17:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.340+0000 7f021dcfc700 1 --2- 172.21.15.72:0/46831110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0218139030 0x7f021811ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.340+0000 7f021dcfc700 1 --2- 172.21.15.72:0/46831110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f02181338a0 0x7f02181c8420 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.340+0000 7f021dcfc700 1 --2- 172.21.15.72:0/46831110 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0218136710 0x7f02181c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.340+0000 7f021dcfc700 1 -- 172.21.15.72:0/46831110 >> 172.21.15.72:0/46831110 conn(0x7f02180a2aa0 msgr2=0x7f02181344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.340+0000 7f021dcfc700 1 -- 172.21.15.72:0/46831110 shutdown_connections 2023-10-03T10:17:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.340+0000 7f021dcfc700 1 -- 172.21.15.72:0/46831110 wait complete. 2023-10-03T10:17:24.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:24.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:24.456 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:24.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.459+0000 7f873fcef700 1 Processor -- start 2023-10-03T10:17:24.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.459+0000 7f873fcef700 1 -- start start 2023-10-03T10:17:24.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.459+0000 7f873fcef700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87381338a0 0x7f8738133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.459+0000 7f873fcef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f873809de50 0x7f873809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.459+0000 7f873fcef700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f873809e760 0x7f873813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.459+0000 7f873fcef700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873806fef0 con 0x7f873809e760 2023-10-03T10:17:24.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.459+0000 7f873fcef700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873806ef30 con 0x7f873809de50 2023-10-03T10:17:24.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.459+0000 7f873fcef700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87381334b0 con 0x7f87381338a0 2023-10-03T10:17:24.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873da8b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87381338a0 0x7f8738133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873d28a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f873809de50 0x7f873809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873d28a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f873809de50 0x7f873809e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51002/0 (socket says 172.21.15.72:51002) 2023-10-03T10:17:24.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873da8b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87381338a0 0x7f8738133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49090/0 (socket says 172.21.15.72:49090) 2023-10-03T10:17:24.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873d28a700 1 -- 172.21.15.72:0/1561240946 learned_addr learned my addr 172.21.15.72:0/1561240946 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:24.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873e28c700 1 --2- 172.21.15.72:0/1561240946 >> v2:172.21.15.72:3300/0 conn(0x7f873809e760 0x7f873813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873d28a700 1 -- 172.21.15.72:0/1561240946 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87381338a0 msgr2=0x7f8738133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:24.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873d28a700 1 --2- 172.21.15.72:0/1561240946 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87381338a0 0x7f8738133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873d28a700 1 -- 172.21.15.72:0/1561240946 >> v2:172.21.15.72:3300/0 conn(0x7f873809e760 msgr2=0x7f873813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:24.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873d28a700 1 --2- 172.21.15.72:0/1561240946 >> v2:172.21.15.72:3300/0 conn(0x7f873809e760 0x7f873813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873d28a700 1 -- 172.21.15.72:0/1561240946 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873806fc30 con 0x7f873809de50 2023-10-03T10:17:24.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873e28c700 1 --2- 172.21.15.72:0/1561240946 >> v2:172.21.15.72:3300/0 conn(0x7f873809e760 0x7f873813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873da8b700 1 --2- 172.21.15.72:0/1561240946 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87381338a0 0x7f8738133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873d28a700 1 --2- 172.21.15.72:0/1561240946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f873809de50 0x7f873809e220 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8728009920 tx=0x7f8728009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4905ae0383b16903 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873ca89700 1 -- 172.21.15.72:0/1561240946 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011830 con 0x7f873809de50 2023-10-03T10:17:24.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873ca89700 1 -- 172.21.15.72:0/1561240946 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8728011990 con 0x7f873809de50 2023-10-03T10:17:24.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.460+0000 7f873ca89700 1 -- 172.21.15.72:0/1561240946 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011d20 con 0x7f873809de50 2023-10-03T10:17:24.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.461+0000 7f873fcef700 1 -- 172.21.15.72:0/1561240946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f873809de50 msgr2=0x7f873809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.461+0000 7f873fcef700 1 --2- 172.21.15.72:0/1561240946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f873809de50 0x7f873809e220 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8728009920 tx=0x7f8728009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:24.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.461+0000 7f873fcef700 1 -- 172.21.15.72:0/1561240946 shutdown_connections 2023-10-03T10:17:24.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.461+0000 7f873fcef700 1 --2- 172.21.15.72:0/1561240946 >> v2:172.21.15.72:3300/0 conn(0x7f873809e760 0x7f873813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.461+0000 7f873fcef700 1 --2- 172.21.15.72:0/1561240946 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87381338a0 0x7f8738133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.461+0000 7f873fcef700 1 --2- 172.21.15.72:0/1561240946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f873809de50 0x7f873809e220 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.461+0000 7f873fcef700 1 -- 172.21.15.72:0/1561240946 >> 172.21.15.72:0/1561240946 conn(0x7f87380a2aa0 msgr2=0x7f87380a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.461+0000 7f873fcef700 1 -- 172.21.15.72:0/1561240946 shutdown_connections 2023-10-03T10:17:24.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.461+0000 7f873fcef700 1 -- 172.21.15.72:0/1561240946 wait complete. 2023-10-03T10:17:24.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.462+0000 7f873fcef700 1 Processor -- start 2023-10-03T10:17:24.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.462+0000 7f873fcef700 1 -- start start 2023-10-03T10:17:24.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873fcef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f873809de50 0x7f873811ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873fcef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f873809e760 0x7f873811f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873fcef700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87381338a0 0x7f873811f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873fcef700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873812ff00 con 0x7f873809de50 2023-10-03T10:17:24.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873fcef700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8738120730 con 0x7f873809e760 2023-10-03T10:17:24.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873fcef700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87381222c0 con 0x7f87381338a0 2023-10-03T10:17:24.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873d28a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f873809e760 0x7f873811f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873d28a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f873809e760 0x7f873811f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51016/0 (socket says 172.21.15.72:51016) 2023-10-03T10:17:24.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873d28a700 1 -- 172.21.15.72:0/1486764437 learned_addr learned my addr 172.21.15.72:0/1486764437 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:24.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873da8b700 1 --2- 172.21.15.72:0/1486764437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f873809de50 0x7f873811ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873e28c700 1 --2- 172.21.15.72:0/1486764437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87381338a0 0x7f873811f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873d28a700 1 -- 172.21.15.72:0/1486764437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87381338a0 msgr2=0x7f873811f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873d28a700 1 --2- 172.21.15.72:0/1486764437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87381338a0 0x7f873811f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873d28a700 1 -- 172.21.15.72:0/1486764437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f873809de50 msgr2=0x7f873811ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873d28a700 1 --2- 172.21.15.72:0/1486764437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f873809de50 0x7f873811ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873d28a700 1 -- 172.21.15.72:0/1486764437 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8730009a70 con 0x7f873809e760 2023-10-03T10:17:24.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873e28c700 1 --2- 172.21.15.72:0/1486764437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87381338a0 0x7f873811f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873da8b700 1 --2- 172.21.15.72:0/1486764437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f873809de50 0x7f873811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873d28a700 1 --2- 172.21.15.72:0/1486764437 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f873809e760 0x7f873811f010 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8728014040 tx=0x7f8728004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f872e7fc700 1 -- 172.21.15.72:0/1486764437 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728004450 con 0x7f873809e760 2023-10-03T10:17:24.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f872e7fc700 1 -- 172.21.15.72:0/1486764437 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872801e070 con 0x7f873809e760 2023-10-03T10:17:24.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.463+0000 7f873fcef700 1 -- 172.21.15.72:0/1486764437 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87340094a0 con 0x7f873809e760 2023-10-03T10:17:24.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.464+0000 7f872e7fc700 1 -- 172.21.15.72:0/1486764437 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280038e0 con 0x7f873809e760 2023-10-03T10:17:24.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.464+0000 7f873fcef700 1 -- 172.21.15.72:0/1486764437 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8728009550 con 0x7f873809e760 2023-10-03T10:17:24.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.464+0000 7f872e7fc700 1 -- 172.21.15.72:0/1486764437 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8728003a40 con 0x7f873809e760 2023-10-03T10:17:24.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.464+0000 7f872e7fc700 1 -- 172.21.15.72:0/1486764437 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f87280402c0 con 0x7f873809e760 2023-10-03T10:17:24.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.465+0000 7f873fcef700 1 -- 172.21.15.72:0/1486764437 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8738074ea0 con 0x7f873809e760 2023-10-03T10:17:24.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.470+0000 7f872e7fc700 1 -- 172.21.15.72:0/1486764437 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f872802d450 con 0x7f873809e760 2023-10-03T10:17:24.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.538+0000 7fdbb6fba700 1 Processor -- start 2023-10-03T10:17:24.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.538+0000 7fdbb6fba700 1 -- start start 2023-10-03T10:17:24.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.539+0000 7fdbb6fba700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdbb01316c0 0x7fdbb0131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.539+0000 7fdbb6fba700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdbb009d9f0 0x7fdbb006a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.539+0000 7fdbb6fba700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb009e130 con 0x7fdbb006acb0 2023-10-03T10:17:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.539+0000 7fdbb6fba700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb01312b0 con 0x7fdbb01316c0 2023-10-03T10:17:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.539+0000 7fdbb6fba700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb009f6e0 con 0x7fdbb009d9f0 2023-10-03T10:17:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.539+0000 7fdbaffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdbb009d9f0 0x7fdbb006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.539+0000 7fdbb4d56700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdbb01316c0 0x7fdbb0131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.539+0000 7fdbaffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdbb009d9f0 0x7fdbb006a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49114/0 (socket says 172.21.15.72:49114) 2023-10-03T10:17:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.539+0000 7fdbb4d56700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdbb01316c0 0x7fdbb0131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35856/0 (socket says 172.21.15.72:35856) 2023-10-03T10:17:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.539+0000 7fdbaffff700 1 -- 172.21.15.72:0/3412172478 learned_addr learned my addr 172.21.15.72:0/3412172478 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.539+0000 7fdbb4d56700 1 -- 172.21.15.72:0/3412172478 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdbb009d9f0 msgr2=0x7fdbb006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.539+0000 7fdbb4d56700 1 --2- 172.21.15.72:0/3412172478 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdbb009d9f0 0x7fdbb006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.539+0000 7fdbb4d56700 1 -- 172.21.15.72:0/3412172478 >> v1:172.21.15.72:6789/0 conn(0x7fdbb006acb0 legacy=0x7fdbb0138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.539+0000 7fdbb4d56700 1 -- 172.21.15.72:0/3412172478 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb009e760 con 0x7fdbb01316c0 2023-10-03T10:17:24.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.539+0000 7fdbb4d56700 1 --2- 172.21.15.72:0/3412172478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbb01316c0 0x7fdbb0131a90 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009840 tx=0x7fdba4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6298909a921a898a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.540+0000 7fdbaf7fe700 1 -- 172.21.15.72:0/3412172478 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4011830 con 0x7fdbb01316c0 2023-10-03T10:17:24.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.540+0000 7fdbaf7fe700 1 -- 172.21.15.72:0/3412172478 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba4011990 con 0x7fdbb01316c0 2023-10-03T10:17:24.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.540+0000 7fdbaf7fe700 1 -- 172.21.15.72:0/3412172478 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4011d20 con 0x7fdbb01316c0 2023-10-03T10:17:24.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.540+0000 7fdbb6fba700 1 -- 172.21.15.72:0/3412172478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbb01316c0 msgr2=0x7fdbb0131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.540+0000 7fdbb6fba700 1 --2- 172.21.15.72:0/3412172478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbb01316c0 0x7fdbb0131a90 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009840 tx=0x7fdba4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:24.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.540+0000 7fdbb6fba700 1 -- 172.21.15.72:0/3412172478 shutdown_connections 2023-10-03T10:17:24.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.540+0000 7fdbb6fba700 1 --2- 172.21.15.72:0/3412172478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbb01316c0 0x7fdbb0131a90 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.540+0000 7fdbb6fba700 1 --2- 172.21.15.72:0/3412172478 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdbb009d9f0 0x7fdbb006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.540+0000 7fdbb6fba700 1 -- 172.21.15.72:0/3412172478 >> 172.21.15.72:0/3412172478 conn(0x7fdbb0066f50 msgr2=0x7fdbb009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.540+0000 7fdbb6fba700 1 -- 172.21.15.72:0/3412172478 shutdown_connections 2023-10-03T10:17:24.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.540+0000 7fdbb6fba700 1 -- 172.21.15.72:0/3412172478 wait complete. 2023-10-03T10:17:24.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.541+0000 7fdbb6fba700 1 Processor -- start 2023-10-03T10:17:24.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.542+0000 7fdbb6fba700 1 -- start start 2023-10-03T10:17:24.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.542+0000 7fdbb6fba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdbb006acb0 0x7fdbb01c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.542+0000 7fdbb6fba700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdbb009d9f0 0x7fdbb01c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.542+0000 7fdbb6fba700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbb01316c0 0x7fdbb0070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.542+0000 7fdbb6fba700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb011b080 con 0x7fdbb01316c0 2023-10-03T10:17:24.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.542+0000 7fdbb6fba700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb011bbb0 con 0x7fdbb006acb0 2023-10-03T10:17:24.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.542+0000 7fdbb6fba700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb01c71e0 con 0x7fdbb009d9f0 2023-10-03T10:17:24.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.542+0000 7fdbaffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdbb009d9f0 0x7fdbb01c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.542+0000 7fdbaffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdbb009d9f0 0x7fdbb01c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49126/0 (socket says 172.21.15.72:49126) 2023-10-03T10:17:24.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.542+0000 7fdbaffff700 1 -- 172.21.15.72:0/1147893957 learned_addr learned my addr 172.21.15.72:0/1147893957 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:24.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.542+0000 7fdbb4d56700 1 --2- 172.21.15.72:0/1147893957 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdbb006acb0 0x7fdbb01c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.543+0000 7fdbb5557700 1 --2- 172.21.15.72:0/1147893957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbb01316c0 0x7fdbb0070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.543+0000 7fdbb4d56700 1 -- 172.21.15.72:0/1147893957 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdbb009d9f0 msgr2=0x7fdbb01c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.543+0000 7fdbb4d56700 1 --2- 172.21.15.72:0/1147893957 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdbb009d9f0 0x7fdbb01c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.543+0000 7fdbb4d56700 1 -- 172.21.15.72:0/1147893957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbb01316c0 msgr2=0x7fdbb0070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.543+0000 7fdbb4d56700 1 --2- 172.21.15.72:0/1147893957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbb01316c0 0x7fdbb0070b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.543+0000 7fdbb4d56700 1 -- 172.21.15.72:0/1147893957 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba40094a0 con 0x7fdbb006acb0 2023-10-03T10:17:24.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.543+0000 7fdbaffff700 1 --2- 172.21.15.72:0/1147893957 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdbb009d9f0 0x7fdbb01c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.543+0000 7fdbb4d56700 1 --2- 172.21.15.72:0/1147893957 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdbb006acb0 0x7fdbb01c6760 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdba4016000 tx=0x7fdba4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.543+0000 7fdbad7fa700 1 -- 172.21.15.72:0/1147893957 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba40036a0 con 0x7fdbb006acb0 2023-10-03T10:17:24.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.543+0000 7fdbad7fa700 1 -- 172.21.15.72:0/1147893957 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba401f070 con 0x7fdbb006acb0 2023-10-03T10:17:24.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.543+0000 7fdbb6fba700 1 -- 172.21.15.72:0/1147893957 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb009ead0 con 0x7fdbb006acb0 2023-10-03T10:17:24.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.543+0000 7fdbad7fa700 1 -- 172.21.15.72:0/1147893957 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4003a60 con 0x7fdbb006acb0 2023-10-03T10:17:24.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.543+0000 7fdbb6fba700 1 -- 172.21.15.72:0/1147893957 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb011b6c0 con 0x7fdbb006acb0 2023-10-03T10:17:24.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.544+0000 7fdbad7fa700 1 -- 172.21.15.72:0/1147893957 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdba4003bc0 con 0x7fdbb006acb0 2023-10-03T10:17:24.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.544+0000 7fdbb6fba700 1 -- 172.21.15.72:0/1147893957 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb011aaa0 con 0x7fdbb006acb0 2023-10-03T10:17:24.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.544+0000 7fdbad7fa700 1 -- 172.21.15.72:0/1147893957 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdba4021070 con 0x7fdbb006acb0 2023-10-03T10:17:24.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.549+0000 7fdbad7fa700 1 -- 172.21.15.72:0/1147893957 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdba402b070 con 0x7fdbb006acb0 2023-10-03T10:17:24.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.583+0000 7f96144c3700 1 Processor -- start 2023-10-03T10:17:24.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.584+0000 7f96144c3700 1 -- start start 2023-10-03T10:17:24.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.584+0000 7f96144c3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c1337f0 0x7f960c138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.584+0000 7f96144c3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c138dc0 0x7f960c13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.584+0000 7f96144c3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960c06b990 con 0x7f960c133420 2023-10-03T10:17:24.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.584+0000 7f96144c3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c09b0e0 con 0x7f960c138dc0 2023-10-03T10:17:24.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.585+0000 7f96144c3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f960c133c20 con 0x7f960c1337f0 2023-10-03T10:17:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.585+0000 7f9611a5e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c1337f0 0x7f960c138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.585+0000 7f9612a60700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c138dc0 0x7f960c13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.585+0000 7f9611a5e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c1337f0 0x7f960c138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49140/0 (socket says 172.21.15.72:49140) 2023-10-03T10:17:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.585+0000 7f9611a5e700 1 -- 172.21.15.72:0/657282847 learned_addr learned my addr 172.21.15.72:0/657282847 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.585+0000 7f961125d700 1 -- 172.21.15.72:0/657282847 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570268257 0 0) 0x7f960c06b990 con 0x7f960c133420 2023-10-03T10:17:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.585+0000 7f9612a60700 1 -- 172.21.15.72:0/657282847 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c1337f0 msgr2=0x7f960c138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.585+0000 7f9612a60700 1 --2- 172.21.15.72:0/657282847 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c1337f0 0x7f960c138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.585+0000 7f9612a60700 1 -- 172.21.15.72:0/657282847 >> v1:172.21.15.72:6789/0 conn(0x7f960c133420 legacy=0x7f960c133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.585+0000 7f9612a60700 1 -- 172.21.15.72:0/657282847 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c0a0590 con 0x7f960c138dc0 2023-10-03T10:17:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.585+0000 7f9611a5e700 1 --2- 172.21.15.72:0/657282847 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c1337f0 0x7f960c138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.585+0000 7f9612a60700 1 --2- 172.21.15.72:0/657282847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c138dc0 0x7f960c13b1a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9604009dc0 tx=0x7f960400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1fda82f00661279 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.585+0000 7f961125d700 1 -- 172.21.15.72:0/657282847 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960400e070 con 0x7f960c138dc0 2023-10-03T10:17:24.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.585+0000 7f961125d700 1 -- 172.21.15.72:0/657282847 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960400bb20 con 0x7f960c138dc0 2023-10-03T10:17:24.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.585+0000 7f961125d700 1 -- 172.21.15.72:0/657282847 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604012430 con 0x7f960c138dc0 2023-10-03T10:17:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.586+0000 7f96144c3700 1 -- 172.21.15.72:0/657282847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c138dc0 msgr2=0x7f960c13b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.586+0000 7f96144c3700 1 --2- 172.21.15.72:0/657282847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c138dc0 0x7f960c13b1a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9604009dc0 tx=0x7f960400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.586+0000 7f96144c3700 1 -- 172.21.15.72:0/657282847 shutdown_connections 2023-10-03T10:17:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.586+0000 7f96144c3700 1 --2- 172.21.15.72:0/657282847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c138dc0 0x7f960c13b1a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.586+0000 7f96144c3700 1 --2- 172.21.15.72:0/657282847 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c1337f0 0x7f960c138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.586+0000 7f96144c3700 1 -- 172.21.15.72:0/657282847 >> 172.21.15.72:0/657282847 conn(0x7f960c0a4210 msgr2=0x7f960c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.586+0000 7f96144c3700 1 -- 172.21.15.72:0/657282847 shutdown_connections 2023-10-03T10:17:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.586+0000 7f96144c3700 1 -- 172.21.15.72:0/657282847 wait complete. 2023-10-03T10:17:24.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.588+0000 7f96144c3700 1 Processor -- start 2023-10-03T10:17:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.588+0000 7f96144c3700 1 -- start start 2023-10-03T10:17:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.588+0000 7f96144c3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f960c133420 0x7f960c12ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.588+0000 7f96144c3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c1337f0 0x7f960c12f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.588+0000 7f96144c3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c138dc0 0x7f960c12f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.588+0000 7f96144c3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c09c4e0 con 0x7f960c133420 2023-10-03T10:17:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.588+0000 7f96144c3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c09cd10 con 0x7f960c1337f0 2023-10-03T10:17:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.588+0000 7f96144c3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f960c09e460 con 0x7f960c138dc0 2023-10-03T10:17:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f9611a5e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c1337f0 0x7f960c12f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f961225f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f960c133420 0x7f960c12ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f9611a5e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c1337f0 0x7f960c12f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51036/0 (socket says 172.21.15.72:51036) 2023-10-03T10:17:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f9611a5e700 1 -- 172.21.15.72:0/3393573558 learned_addr learned my addr 172.21.15.72:0/3393573558 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:24.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f9612a60700 1 --2- 172.21.15.72:0/3393573558 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c138dc0 0x7f960c12f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f9611a5e700 1 -- 172.21.15.72:0/3393573558 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c138dc0 msgr2=0x7f960c12f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f9611a5e700 1 --2- 172.21.15.72:0/3393573558 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c138dc0 0x7f960c12f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f9611a5e700 1 -- 172.21.15.72:0/3393573558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f960c133420 msgr2=0x7f960c12ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f9611a5e700 1 --2- 172.21.15.72:0/3393573558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f960c133420 0x7f960c12ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f9611a5e700 1 -- 172.21.15.72:0/3393573558 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc009550 con 0x7f960c1337f0 2023-10-03T10:17:24.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f961225f700 1 --2- 172.21.15.72:0/3393573558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f960c133420 0x7f960c12ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f9611a5e700 1 --2- 172.21.15.72:0/3393573558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c1337f0 0x7f960c12f390 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00ebe0 tx=0x7f95fc00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f9602ffd700 1 -- 172.21.15.72:0/3393573558 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00c850 con 0x7f960c1337f0 2023-10-03T10:17:24.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f9602ffd700 1 -- 172.21.15.72:0/3393573558 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc00c9b0 con 0x7f960c1337f0 2023-10-03T10:17:24.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f96144c3700 1 -- 172.21.15.72:0/3393573558 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9604009a70 con 0x7f960c1337f0 2023-10-03T10:17:24.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f9602ffd700 1 -- 172.21.15.72:0/3393573558 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00cd40 con 0x7f960c1337f0 2023-10-03T10:17:24.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.589+0000 7f96144c3700 1 -- 172.21.15.72:0/3393573558 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c09b9d0 con 0x7f960c1337f0 2023-10-03T10:17:24.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.590+0000 7f9602ffd700 1 -- 172.21.15.72:0/3393573558 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95fc013470 con 0x7f960c1337f0 2023-10-03T10:17:24.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.590+0000 7f96144c3700 1 -- 172.21.15.72:0/3393573558 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c074ea0 con 0x7f960c1337f0 2023-10-03T10:17:24.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.590+0000 7f9602ffd700 1 -- 172.21.15.72:0/3393573558 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f95fc03fc80 con 0x7f960c1337f0 2023-10-03T10:17:24.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.595+0000 7f9602ffd700 1 -- 172.21.15.72:0/3393573558 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95fc045020 con 0x7f960c1337f0 2023-10-03T10:17:24.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.670+0000 7f873fcef700 1 -- 172.21.15.72:0/1486764437 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8738122060 con 0x7f873809e760 2023-10-03T10:17:24.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.670+0000 7f872e7fc700 1 -- 172.21.15.72:0/1486764437 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8728015030 con 0x7f873809e760 2023-10-03T10:17:24.670 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:24.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.673+0000 7f873fcef700 1 -- 172.21.15.72:0/1486764437 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f873809e760 msgr2=0x7f873811f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.673+0000 7f873fcef700 1 --2- 172.21.15.72:0/1486764437 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f873809e760 0x7f873811f010 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8728014040 tx=0x7f8728004750 comp rx=0 tx=0).stop 2023-10-03T10:17:24.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.673+0000 7f873fcef700 1 -- 172.21.15.72:0/1486764437 shutdown_connections 2023-10-03T10:17:24.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.673+0000 7f873fcef700 1 --2- 172.21.15.72:0/1486764437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f873809de50 0x7f873811ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.673+0000 7f873fcef700 1 --2- 172.21.15.72:0/1486764437 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87381338a0 0x7f873811f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.673+0000 7f873fcef700 1 --2- 172.21.15.72:0/1486764437 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f873809e760 0x7f873811f010 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.673+0000 7f873fcef700 1 -- 172.21.15.72:0/1486764437 >> 172.21.15.72:0/1486764437 conn(0x7f87380a2aa0 msgr2=0x7f873809ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.673+0000 7f873fcef700 1 -- 172.21.15.72:0/1486764437 shutdown_connections 2023-10-03T10:17:24.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.673+0000 7f873fcef700 1 -- 172.21.15.72:0/1486764437 wait complete. 2023-10-03T10:17:24.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:24.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.754+0000 7fdbb6fba700 1 -- 172.21.15.72:0/1147893957 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdbb0074ea0 con 0x7fdbb006acb0 2023-10-03T10:17:24.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.755+0000 7fdbad7fa700 1 -- 172.21.15.72:0/1147893957 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdba4015030 con 0x7fdbb006acb0 2023-10-03T10:17:24.754 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:24.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.757+0000 7fdbb6fba700 1 -- 172.21.15.72:0/1147893957 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdbb006acb0 msgr2=0x7fdbb01c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.757+0000 7fdbb6fba700 1 --2- 172.21.15.72:0/1147893957 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdbb006acb0 0x7fdbb01c6760 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdba4016000 tx=0x7fdba4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:24.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.757+0000 7fdbb6fba700 1 -- 172.21.15.72:0/1147893957 shutdown_connections 2023-10-03T10:17:24.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.757+0000 7fdbb6fba700 1 --2- 172.21.15.72:0/1147893957 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdbb01316c0 0x7fdbb0070b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.757+0000 7fdbb6fba700 1 --2- 172.21.15.72:0/1147893957 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdbb006acb0 0x7fdbb01c6760 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.757+0000 7fdbb6fba700 1 --2- 172.21.15.72:0/1147893957 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdbb009d9f0 0x7fdbb01c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.757+0000 7fdbb6fba700 1 -- 172.21.15.72:0/1147893957 >> 172.21.15.72:0/1147893957 conn(0x7fdbb0066f50 msgr2=0x7fdbb00a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.757+0000 7fdbb6fba700 1 -- 172.21.15.72:0/1147893957 shutdown_connections 2023-10-03T10:17:24.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.757+0000 7fdbb6fba700 1 -- 172.21.15.72:0/1147893957 wait complete. 2023-10-03T10:17:24.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:24.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.791+0000 7f96144c3700 1 -- 172.21.15.72:0/3393573558 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f960c06b250 con 0x7f960c1337f0 2023-10-03T10:17:24.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.792+0000 7f9602ffd700 1 -- 172.21.15.72:0/3393573558 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f95fc01b3b0 con 0x7f960c1337f0 2023-10-03T10:17:24.791 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:24.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.794+0000 7f96144c3700 1 -- 172.21.15.72:0/3393573558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c1337f0 msgr2=0x7f960c12f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.794+0000 7f96144c3700 1 --2- 172.21.15.72:0/3393573558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c1337f0 0x7f960c12f390 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00ebe0 tx=0x7f95fc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.794+0000 7f96144c3700 1 -- 172.21.15.72:0/3393573558 shutdown_connections 2023-10-03T10:17:24.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.794+0000 7f96144c3700 1 --2- 172.21.15.72:0/3393573558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f960c133420 0x7f960c12ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.794+0000 7f96144c3700 1 --2- 172.21.15.72:0/3393573558 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f960c138dc0 0x7f960c12f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.794+0000 7f96144c3700 1 --2- 172.21.15.72:0/3393573558 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f960c1337f0 0x7f960c12f390 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.794+0000 7f96144c3700 1 -- 172.21.15.72:0/3393573558 >> 172.21.15.72:0/3393573558 conn(0x7f960c0a4210 msgr2=0x7f960c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.794+0000 7f96144c3700 1 -- 172.21.15.72:0/3393573558 shutdown_connections 2023-10-03T10:17:24.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:24.794+0000 7f96144c3700 1 -- 172.21.15.72:0/3393573558 wait complete. 2023-10-03T10:17:24.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:25.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:25.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.477+0000 7f77e4844700 1 Processor -- start 2023-10-03T10:17:25.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.477+0000 7f77e4844700 1 -- start start 2023-10-03T10:17:25.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.477+0000 7f77e4844700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f77e009e930 0x7f77e009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.477+0000 7f77e4844700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77e009f240 0x7f77e01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.477+0000 7f77e4844700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77e009f650 0x7f77e0131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.477+0000 7f77e4844700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e0070940 con 0x7f77e009f650 2023-10-03T10:17:25.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.477+0000 7f77e4844700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e006fd60 con 0x7f77e009f240 2023-10-03T10:17:25.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.477+0000 7f77e4844700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77e006fa80 con 0x7f77e009e930 2023-10-03T10:17:25.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.477+0000 7f77ddd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77e009f240 0x7f77e01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.477+0000 7f77de59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f77e009e930 0x7f77e009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.477+0000 7f77ded9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77e009f650 0x7f77e0131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.477+0000 7f77de59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f77e009e930 0x7f77e009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49158/0 (socket says 172.21.15.72:49158) 2023-10-03T10:17:25.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.477+0000 7f77ddd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77e009f240 0x7f77e01317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51050/0 (socket says 172.21.15.72:51050) 2023-10-03T10:17:25.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.477+0000 7f77de59c700 1 -- 172.21.15.72:0/3029119464 learned_addr learned my addr 172.21.15.72:0/3029119464 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:25.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.478+0000 7f77ded9d700 1 -- 172.21.15.72:0/3029119464 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f77e009e930 msgr2=0x7f77e009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.478+0000 7f77ded9d700 1 --2- 172.21.15.72:0/3029119464 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f77e009e930 0x7f77e009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.478+0000 7f77ded9d700 1 -- 172.21.15.72:0/3029119464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77e009f240 msgr2=0x7f77e01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.478+0000 7f77ded9d700 1 --2- 172.21.15.72:0/3029119464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77e009f240 0x7f77e01317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.478+0000 7f77ded9d700 1 -- 172.21.15.72:0/3029119464 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e009fb60 con 0x7f77e009f650 2023-10-03T10:17:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.478+0000 7f77de59c700 1 --2- 172.21.15.72:0/3029119464 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f77e009e930 0x7f77e009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.478+0000 7f77ddd9b700 1 --2- 172.21.15.72:0/3029119464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77e009f240 0x7f77e01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.478+0000 7f77ded9d700 1 --2- 172.21.15.72:0/3029119464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e009f650 0x7f77e0131d30 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009d90 tx=0x7f77d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caaf7a9de27bac11 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.478+0000 7f77dd59a700 1 -- 172.21.15.72:0/3029119464 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d800e070 con 0x7f77e009f650 2023-10-03T10:17:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.478+0000 7f77dd59a700 1 -- 172.21.15.72:0/3029119464 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d800bb20 con 0x7f77e009f650 2023-10-03T10:17:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.478+0000 7f77dd59a700 1 -- 172.21.15.72:0/3029119464 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8012430 con 0x7f77e009f650 2023-10-03T10:17:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.479+0000 7f77e4844700 1 -- 172.21.15.72:0/3029119464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e009f650 msgr2=0x7f77e0131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.479+0000 7f77e4844700 1 --2- 172.21.15.72:0/3029119464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e009f650 0x7f77e0131d30 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009d90 tx=0x7f77d800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.479+0000 7f77e4844700 1 -- 172.21.15.72:0/3029119464 shutdown_connections 2023-10-03T10:17:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.479+0000 7f77e4844700 1 --2- 172.21.15.72:0/3029119464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e009f650 0x7f77e0131d30 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.479+0000 7f77e4844700 1 --2- 172.21.15.72:0/3029119464 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f77e009e930 0x7f77e009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.479+0000 7f77e4844700 1 --2- 172.21.15.72:0/3029119464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77e009f240 0x7f77e01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.479+0000 7f77e4844700 1 -- 172.21.15.72:0/3029119464 >> 172.21.15.72:0/3029119464 conn(0x7f77e00a4210 msgr2=0x7f77e00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.479+0000 7f77e4844700 1 -- 172.21.15.72:0/3029119464 shutdown_connections 2023-10-03T10:17:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.479+0000 7f77e4844700 1 -- 172.21.15.72:0/3029119464 wait complete. 2023-10-03T10:17:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.480+0000 7f77e4844700 1 Processor -- start 2023-10-03T10:17:25.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.480+0000 7f77e4844700 1 -- start start 2023-10-03T10:17:25.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.480+0000 7f77e4844700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77e009e930 0x7f77e006b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.480+0000 7f77e4844700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e009f240 0x7f77e006bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.480+0000 7f77e4844700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f77e009f650 0x7f77e006c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.480+0000 7f77e4844700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e006cce0 con 0x7f77e009f240 2023-10-03T10:17:25.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.480+0000 7f77e4844700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e01ab970 con 0x7f77e009e930 2023-10-03T10:17:25.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.480+0000 7f77e4844700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77e01ab100 con 0x7f77e009f650 2023-10-03T10:17:25.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.480+0000 7f77ddd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e009f240 0x7f77e006bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.480+0000 7f77ded9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f77e009f650 0x7f77e006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.480+0000 7f77de59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77e009e930 0x7f77e006b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.480+0000 7f77ded9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f77e009f650 0x7f77e006c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49172/0 (socket says 172.21.15.72:49172) 2023-10-03T10:17:25.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.480+0000 7f77ddd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e009f240 0x7f77e006bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35894/0 (socket says 172.21.15.72:35894) 2023-10-03T10:17:25.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.480+0000 7f77ded9d700 1 -- 172.21.15.72:0/2783461772 learned_addr learned my addr 172.21.15.72:0/2783461772 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:25.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.481+0000 7f77de59c700 1 -- 172.21.15.72:0/2783461772 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f77e009f650 msgr2=0x7f77e006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.481+0000 7f77de59c700 1 --2- 172.21.15.72:0/2783461772 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f77e009f650 0x7f77e006c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.481+0000 7f77de59c700 1 -- 172.21.15.72:0/2783461772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e009f240 msgr2=0x7f77e006bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.481+0000 7f77de59c700 1 --2- 172.21.15.72:0/2783461772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e009f240 0x7f77e006bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.481+0000 7f77de59c700 1 -- 172.21.15.72:0/2783461772 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d0009550 con 0x7f77e009e930 2023-10-03T10:17:25.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.481+0000 7f77ded9d700 1 --2- 172.21.15.72:0/2783461772 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f77e009f650 0x7f77e006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.481+0000 7f77ddd9b700 1 --2- 172.21.15.72:0/2783461772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e009f240 0x7f77e006bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.481+0000 7f77de59c700 1 --2- 172.21.15.72:0/2783461772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77e009e930 0x7f77e006b880 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f77d000e9b0 tx=0x7f77d000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.481+0000 7f77ceffd700 1 -- 172.21.15.72:0/2783461772 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d000c640 con 0x7f77e009e930 2023-10-03T10:17:25.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.481+0000 7f77ceffd700 1 -- 172.21.15.72:0/2783461772 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d000c7a0 con 0x7f77e009e930 2023-10-03T10:17:25.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.481+0000 7f77ceffd700 1 -- 172.21.15.72:0/2783461772 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d000cb30 con 0x7f77e009e930 2023-10-03T10:17:25.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.481+0000 7f77e4844700 1 -- 172.21.15.72:0/2783461772 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d40094a0 con 0x7f77e009e930 2023-10-03T10:17:25.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.481+0000 7f77e4844700 1 -- 172.21.15.72:0/2783461772 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d8009a70 con 0x7f77e009e930 2023-10-03T10:17:25.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.482+0000 7f77ceffd700 1 -- 172.21.15.72:0/2783461772 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77d000cc90 con 0x7f77e009e930 2023-10-03T10:17:25.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.482+0000 7f77e4844700 1 -- 172.21.15.72:0/2783461772 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e01a2b40 con 0x7f77e009e930 2023-10-03T10:17:25.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.482+0000 7f77ceffd700 1 -- 172.21.15.72:0/2783461772 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f77d003fa10 con 0x7f77e009e930 2023-10-03T10:17:25.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.486+0000 7f77ceffd700 1 -- 172.21.15.72:0/2783461772 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77d0011b40 con 0x7f77e009e930 2023-10-03T10:17:25.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.674+0000 7f77e4844700 1 -- 172.21.15.72:0/2783461772 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f77e00a3510 con 0x7f77e009e930 2023-10-03T10:17:25.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.675+0000 7f77ceffd700 1 -- 172.21.15.72:0/2783461772 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77d0021020 con 0x7f77e009e930 2023-10-03T10:17:25.674 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.677+0000 7f77e4844700 1 -- 172.21.15.72:0/2783461772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77e009e930 msgr2=0x7f77e006b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.677+0000 7f77e4844700 1 --2- 172.21.15.72:0/2783461772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77e009e930 0x7f77e006b880 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f77d000e9b0 tx=0x7f77d000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.677+0000 7f77e4844700 1 -- 172.21.15.72:0/2783461772 shutdown_connections 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.677+0000 7f77e4844700 1 --2- 172.21.15.72:0/2783461772 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f77e009f650 0x7f77e006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.677+0000 7f77e4844700 1 --2- 172.21.15.72:0/2783461772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77e009e930 0x7f77e006b880 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.677+0000 7f77e4844700 1 --2- 172.21.15.72:0/2783461772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77e009f240 0x7f77e006bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.677+0000 7f77e4844700 1 -- 172.21.15.72:0/2783461772 >> 172.21.15.72:0/2783461772 conn(0x7f77e00a4210 msgr2=0x7f77e009dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.677+0000 7f77e4844700 1 -- 172.21.15.72:0/2783461772 shutdown_connections 2023-10-03T10:17:25.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.677+0000 7f77e4844700 1 -- 172.21.15.72:0/2783461772 wait complete. 2023-10-03T10:17:25.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:25.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:25.770 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:25.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:25.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.816+0000 7fb91f10a700 1 Processor -- start 2023-10-03T10:17:25.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.816+0000 7fb91f10a700 1 -- start start 2023-10-03T10:17:25.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.817+0000 7fb91f10a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb91809d6f0 0x7fb91809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.817+0000 7fb91f10a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb91809e000 0x7fb9181339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.817+0000 7fb91f10a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb91809b120 con 0x7fb91809e410 2023-10-03T10:17:25.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.817+0000 7fb91f10a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91806b460 con 0x7fb91809d6f0 2023-10-03T10:17:25.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.817+0000 7fb91f10a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91809a7e0 con 0x7fb91809e000 2023-10-03T10:17:25.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.817+0000 7fb917fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb91809e000 0x7fb9181339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.817+0000 7fb91cea6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb91809d6f0 0x7fb91809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.817+0000 7fb917fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb91809e000 0x7fb9181339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51068/0 (socket says 172.21.15.72:51068) 2023-10-03T10:17:25.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.817+0000 7fb917fff700 1 -- 172.21.15.72:0/3165412841 learned_addr learned my addr 172.21.15.72:0/3165412841 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:25.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.817+0000 7fb917fff700 1 -- 172.21.15.72:0/3165412841 >> v2:172.21.15.72:3300/0 conn(0x7fb91809d6f0 msgr2=0x7fb91809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.817+0000 7fb917fff700 1 --2- 172.21.15.72:0/3165412841 >> v2:172.21.15.72:3300/0 conn(0x7fb91809d6f0 0x7fb91809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.817+0000 7fb917fff700 1 -- 172.21.15.72:0/3165412841 >> v1:172.21.15.72:6789/0 conn(0x7fb91809e410 legacy=0x7fb918133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.817+0000 7fb917fff700 1 -- 172.21.15.72:0/3165412841 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91809a500 con 0x7fb91809e000 2023-10-03T10:17:25.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.817+0000 7fb917fff700 1 --2- 172.21.15.72:0/3165412841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb91809e000 0x7fb9181339f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb904009920 tx=0x7fb904009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab63d538a0fa48d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.818+0000 7fb9177fe700 1 -- 172.21.15.72:0/3165412841 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904011830 con 0x7fb91809e000 2023-10-03T10:17:25.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.818+0000 7fb9177fe700 1 -- 172.21.15.72:0/3165412841 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb904011990 con 0x7fb91809e000 2023-10-03T10:17:25.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.818+0000 7fb9177fe700 1 -- 172.21.15.72:0/3165412841 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904011d20 con 0x7fb91809e000 2023-10-03T10:17:25.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.818+0000 7fb91f10a700 1 -- 172.21.15.72:0/3165412841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb91809e000 msgr2=0x7fb9181339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.818+0000 7fb91f10a700 1 --2- 172.21.15.72:0/3165412841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb91809e000 0x7fb9181339f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb904009920 tx=0x7fb904009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:25.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.818+0000 7fb91f10a700 1 -- 172.21.15.72:0/3165412841 shutdown_connections 2023-10-03T10:17:25.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.818+0000 7fb91f10a700 1 --2- 172.21.15.72:0/3165412841 >> v2:172.21.15.72:3300/0 conn(0x7fb91809d6f0 0x7fb91809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.818+0000 7fb91f10a700 1 --2- 172.21.15.72:0/3165412841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb91809e000 0x7fb9181339f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.818+0000 7fb91f10a700 1 -- 172.21.15.72:0/3165412841 >> 172.21.15.72:0/3165412841 conn(0x7fb918066f50 msgr2=0x7fb91809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.818+0000 7fb91f10a700 1 -- 172.21.15.72:0/3165412841 shutdown_connections 2023-10-03T10:17:25.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.818+0000 7fb91f10a700 1 -- 172.21.15.72:0/3165412841 wait complete. 2023-10-03T10:17:25.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.819+0000 7fb91f10a700 1 Processor -- start 2023-10-03T10:17:25.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.819+0000 7fb91f10a700 1 -- start start 2023-10-03T10:17:25.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.820+0000 7fb91f10a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb91809d6f0 0x7fb9181a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.820+0000 7fb91f10a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb91809e000 0x7fb9181a2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.820+0000 7fb91f10a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb91809e410 0x7fb9181a2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.820+0000 7fb91f10a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9181a2f50 con 0x7fb91809e000 2023-10-03T10:17:25.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.820+0000 7fb91f10a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9181a3ce0 con 0x7fb91809e410 2023-10-03T10:17:25.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.820+0000 7fb91f10a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9181a4da0 con 0x7fb91809d6f0 2023-10-03T10:17:25.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.820+0000 7fb917fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb91809e000 0x7fb9181a2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.820+0000 7fb917fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb91809e000 0x7fb9181a2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35904/0 (socket says 172.21.15.72:35904) 2023-10-03T10:17:25.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.820+0000 7fb917fff700 1 -- 172.21.15.72:0/1080273585 learned_addr learned my addr 172.21.15.72:0/1080273585 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:25.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.820+0000 7fb91cea6700 1 --2- 172.21.15.72:0/1080273585 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb91809d6f0 0x7fb9181a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.820+0000 7fb91d6a7700 1 --2- 172.21.15.72:0/1080273585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb91809e410 0x7fb9181a2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.820+0000 7fb917fff700 1 -- 172.21.15.72:0/1080273585 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb91809d6f0 msgr2=0x7fb9181a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.820+0000 7fb917fff700 1 --2- 172.21.15.72:0/1080273585 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb91809d6f0 0x7fb9181a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.821+0000 7fb917fff700 1 -- 172.21.15.72:0/1080273585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb91809e410 msgr2=0x7fb9181a2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.821+0000 7fb917fff700 1 --2- 172.21.15.72:0/1080273585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb91809e410 0x7fb9181a2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.821+0000 7fb917fff700 1 -- 172.21.15.72:0/1080273585 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb904009550 con 0x7fb91809e000 2023-10-03T10:17:25.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.821+0000 7fb91d6a7700 1 --2- 172.21.15.72:0/1080273585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb91809e410 0x7fb9181a2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.821+0000 7fb91cea6700 1 --2- 172.21.15.72:0/1080273585 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb91809d6f0 0x7fb9181a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.821+0000 7fb917fff700 1 --2- 172.21.15.72:0/1080273585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb91809e000 0x7fb9181a2030 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fb904000c00 tx=0x7fb904004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.821+0000 7fb9157fa700 1 -- 172.21.15.72:0/1080273585 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904004450 con 0x7fb91809e000 2023-10-03T10:17:25.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.821+0000 7fb9157fa700 1 -- 172.21.15.72:0/1080273585 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9040045d0 con 0x7fb91809e000 2023-10-03T10:17:25.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.821+0000 7fb9157fa700 1 -- 172.21.15.72:0/1080273585 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9040038e0 con 0x7fb91809e000 2023-10-03T10:17:25.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.821+0000 7fb91f10a700 1 -- 172.21.15.72:0/1080273585 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91809c710 con 0x7fb91809e000 2023-10-03T10:17:25.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.821+0000 7fb91f10a700 1 -- 172.21.15.72:0/1080273585 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9181a3700 con 0x7fb91809e000 2023-10-03T10:17:25.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.822+0000 7fb9157fa700 1 -- 172.21.15.72:0/1080273585 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb904003a40 con 0x7fb91809e000 2023-10-03T10:17:25.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.822+0000 7fb9157fa700 1 -- 172.21.15.72:0/1080273585 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb9040409c0 con 0x7fb91809e000 2023-10-03T10:17:25.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.822+0000 7fb91f10a700 1 -- 172.21.15.72:0/1080273585 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb918074ea0 con 0x7fb91809e000 2023-10-03T10:17:25.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.827+0000 7fb9157fa700 1 -- 172.21.15.72:0/1080273585 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb90401a420 con 0x7fb91809e000 2023-10-03T10:17:25.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.911+0000 7f1a71eee700 1 Processor -- start 2023-10-03T10:17:25.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.911+0000 7f1a71eee700 1 -- start start 2023-10-03T10:17:25.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.912+0000 7f1a71eee700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a6c0a1510 0x7f1a6c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.912+0000 7f1a71eee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a6c139250 0x7f1a6c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.912+0000 7f1a71eee700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6c09edd0 con 0x7f1a6c0a0a30 2023-10-03T10:17:25.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.912+0000 7f1a71eee700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c0a18e0 con 0x7f1a6c139250 2023-10-03T10:17:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.912+0000 7f1a71eee700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c09e1f0 con 0x7f1a6c0a1510 2023-10-03T10:17:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.912+0000 7f1a6bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a6c139250 0x7f1a6c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.912+0000 7f1a6bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a6c139250 0x7f1a6c13b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51090/0 (socket says 172.21.15.72:51090) 2023-10-03T10:17:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.912+0000 7f1a6bfff700 1 -- 172.21.15.72:0/3735209909 learned_addr learned my addr 172.21.15.72:0/3735209909 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.912+0000 7f1a6affd700 1 --2- 172.21.15.72:0/3735209909 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a6c0a1510 0x7f1a6c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.912+0000 7f1a6affd700 1 -- 172.21.15.72:0/3735209909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a6c139250 msgr2=0x7f1a6c13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.912+0000 7f1a6affd700 1 --2- 172.21.15.72:0/3735209909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a6c139250 0x7f1a6c13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.912+0000 7f1a6affd700 1 -- 172.21.15.72:0/3735209909 >> v1:172.21.15.72:6789/0 conn(0x7f1a6c0a0a30 legacy=0x7f1a6c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.912+0000 7f1a6affd700 1 -- 172.21.15.72:0/3735209909 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c09dc50 con 0x7f1a6c0a1510 2023-10-03T10:17:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.912+0000 7f1a6a7fc700 1 -- 172.21.15.72:0/3735209909 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609639779 0 0) 0x7f1a6c09edd0 con 0x7f1a6c0a0a30 2023-10-03T10:17:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.912+0000 7f1a6bfff700 1 --2- 172.21.15.72:0/3735209909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a6c139250 0x7f1a6c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.913+0000 7f1a6affd700 1 --2- 172.21.15.72:0/3735209909 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a6c0a1510 0x7f1a6c138d10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009870 tx=0x7f1a60009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=410566d10f2df4b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.913+0000 7f1a6a7fc700 1 -- 172.21.15.72:0/3735209909 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60011830 con 0x7f1a6c0a1510 2023-10-03T10:17:25.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.913+0000 7f1a6a7fc700 1 -- 172.21.15.72:0/3735209909 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a60011990 con 0x7f1a6c0a1510 2023-10-03T10:17:25.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.913+0000 7f1a6a7fc700 1 -- 172.21.15.72:0/3735209909 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60011d20 con 0x7f1a6c0a1510 2023-10-03T10:17:25.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.913+0000 7f1a71eee700 1 -- 172.21.15.72:0/3735209909 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a6c0a1510 msgr2=0x7f1a6c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.913+0000 7f1a71eee700 1 --2- 172.21.15.72:0/3735209909 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a6c0a1510 0x7f1a6c138d10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009870 tx=0x7f1a60009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:25.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.913+0000 7f1a71eee700 1 -- 172.21.15.72:0/3735209909 shutdown_connections 2023-10-03T10:17:25.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.913+0000 7f1a71eee700 1 --2- 172.21.15.72:0/3735209909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a6c139250 0x7f1a6c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.913+0000 7f1a71eee700 1 --2- 172.21.15.72:0/3735209909 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a6c0a1510 0x7f1a6c138d10 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.913+0000 7f1a71eee700 1 -- 172.21.15.72:0/3735209909 >> 172.21.15.72:0/3735209909 conn(0x7f1a6c0a6550 msgr2=0x7f1a6c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.913+0000 7f1a71eee700 1 -- 172.21.15.72:0/3735209909 shutdown_connections 2023-10-03T10:17:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.914+0000 7f1a71eee700 1 -- 172.21.15.72:0/3735209909 wait complete. 2023-10-03T10:17:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.914+0000 7f1a71eee700 1 Processor -- start 2023-10-03T10:17:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.915+0000 7f1a71eee700 1 -- start start 2023-10-03T10:17:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.915+0000 7f1a71eee700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a6c0a0a30 0x7f1a6c122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.915+0000 7f1a71eee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0a1510 0x7f1a6c122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.915+0000 7f1a71eee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a6c139250 0x7f1a6c123380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.915+0000 7f1a71eee700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c125c00 con 0x7f1a6c0a1510 2023-10-03T10:17:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.915+0000 7f1a71eee700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c138180 con 0x7f1a6c139250 2023-10-03T10:17:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.915+0000 7f1a71eee700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c1389a0 con 0x7f1a6c0a0a30 2023-10-03T10:17:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.915+0000 7f1a6b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a6c0a0a30 0x7f1a6c122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.915+0000 7f1a6affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0a1510 0x7f1a6c122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.915+0000 7f1a6affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0a1510 0x7f1a6c122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35910/0 (socket says 172.21.15.72:35910) 2023-10-03T10:17:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.915+0000 7f1a6affd700 1 -- 172.21.15.72:0/1050570004 learned_addr learned my addr 172.21.15.72:0/1050570004 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.915+0000 7f1a6b7fe700 1 --2- 172.21.15.72:0/1050570004 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a6c0a0a30 0x7f1a6c122900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49200/0 (socket says 172.21.15.72:49200) 2023-10-03T10:17:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.915+0000 7f1a6bfff700 1 --2- 172.21.15.72:0/1050570004 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a6c139250 0x7f1a6c123380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.916+0000 7f1a6affd700 1 -- 172.21.15.72:0/1050570004 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a6c0a0a30 msgr2=0x7f1a6c122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.916+0000 7f1a6affd700 1 --2- 172.21.15.72:0/1050570004 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a6c0a0a30 0x7f1a6c122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.916+0000 7f1a6affd700 1 -- 172.21.15.72:0/1050570004 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a6c139250 msgr2=0x7f1a6c123380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.916+0000 7f1a6affd700 1 --2- 172.21.15.72:0/1050570004 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a6c139250 0x7f1a6c123380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.916+0000 7f1a6affd700 1 -- 172.21.15.72:0/1050570004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a64009b30 con 0x7f1a6c0a1510 2023-10-03T10:17:25.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.916+0000 7f1a6affd700 1 --2- 172.21.15.72:0/1050570004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0a1510 0x7f1a6c122e40 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009840 tx=0x7f1a60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.916+0000 7f1a53fff700 1 -- 172.21.15.72:0/1050570004 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60004510 con 0x7f1a6c0a1510 2023-10-03T10:17:25.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.916+0000 7f1a53fff700 1 -- 172.21.15.72:0/1050570004 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6001f070 con 0x7f1a6c0a1510 2023-10-03T10:17:25.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.916+0000 7f1a71eee700 1 -- 172.21.15.72:0/1050570004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a600094a0 con 0x7f1a6c0a1510 2023-10-03T10:17:25.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.916+0000 7f1a53fff700 1 -- 172.21.15.72:0/1050570004 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a600038e0 con 0x7f1a6c0a1510 2023-10-03T10:17:25.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.916+0000 7f1a71eee700 1 -- 172.21.15.72:0/1050570004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6c138760 con 0x7f1a6c0a1510 2023-10-03T10:17:25.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.917+0000 7f1a53fff700 1 -- 172.21.15.72:0/1050570004 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a60003a40 con 0x7f1a6c0a1510 2023-10-03T10:17:25.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.917+0000 7f1a71eee700 1 -- 172.21.15.72:0/1050570004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6c0a1d00 con 0x7f1a6c0a1510 2023-10-03T10:17:25.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.917+0000 7f1a53fff700 1 -- 172.21.15.72:0/1050570004 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1a60021070 con 0x7f1a6c0a1510 2023-10-03T10:17:25.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.922+0000 7f1a53fff700 1 -- 172.21.15.72:0/1050570004 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a60010380 con 0x7f1a6c0a1510 2023-10-03T10:17:25.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.941+0000 7f5caf110700 1 Processor -- start 2023-10-03T10:17:25.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.941+0000 7f5caf110700 1 -- start start 2023-10-03T10:17:25.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5caf110700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ca80a0a30 0x7f5ca80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5caf110700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca809d630 0x7f5ca80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5caf110700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ca8133930 0x7f5ca8133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5caf110700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca80a2a70 con 0x7f5ca8133930 2023-10-03T10:17:25.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5caf110700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca80a01d0 con 0x7f5ca809d630 2023-10-03T10:17:25.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5caf110700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca809e2b0 con 0x7f5ca80a0a30 2023-10-03T10:17:25.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5caceac700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ca80a0a30 0x7f5ca80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5cad6ad700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ca8133930 0x7f5ca8133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5caceac700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ca80a0a30 0x7f5ca80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49206/0 (socket says 172.21.15.72:49206) 2023-10-03T10:17:25.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5cad6ad700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ca8133930 0x7f5ca8133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35914/0 (socket says 172.21.15.72:35914) 2023-10-03T10:17:25.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5caceac700 1 -- 172.21.15.72:0/2378799204 learned_addr learned my addr 172.21.15.72:0/2378799204 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:25.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5ca7fff700 1 --2- 172.21.15.72:0/2378799204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca809d630 0x7f5ca80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5cad6ad700 1 -- 172.21.15.72:0/2378799204 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ca80a0a30 msgr2=0x7f5ca80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5cad6ad700 1 --2- 172.21.15.72:0/2378799204 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ca80a0a30 0x7f5ca80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5cad6ad700 1 -- 172.21.15.72:0/2378799204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca809d630 msgr2=0x7f5ca80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5cad6ad700 1 --2- 172.21.15.72:0/2378799204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca809d630 0x7f5ca80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5cad6ad700 1 -- 172.21.15.72:0/2378799204 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca809dc50 con 0x7f5ca8133930 2023-10-03T10:17:25.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5caceac700 1 --2- 172.21.15.72:0/2378799204 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ca80a0a30 0x7f5ca80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5ca7fff700 1 --2- 172.21.15.72:0/2378799204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca809d630 0x7f5ca80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5cad6ad700 1 --2- 172.21.15.72:0/2378799204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca8133930 0x7f5ca8133dd0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0009d90 tx=0x7f5ca000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddc3b2db3f3c0b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.942+0000 7f5ca77fe700 1 -- 172.21.15.72:0/2378799204 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca000e070 con 0x7f5ca8133930 2023-10-03T10:17:25.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.943+0000 7f5ca77fe700 1 -- 172.21.15.72:0/2378799204 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca000bb20 con 0x7f5ca8133930 2023-10-03T10:17:25.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.943+0000 7f5ca77fe700 1 -- 172.21.15.72:0/2378799204 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0012430 con 0x7f5ca8133930 2023-10-03T10:17:25.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.943+0000 7f5caf110700 1 -- 172.21.15.72:0/2378799204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca8133930 msgr2=0x7f5ca8133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.943+0000 7f5caf110700 1 --2- 172.21.15.72:0/2378799204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca8133930 0x7f5ca8133dd0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0009d90 tx=0x7f5ca000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:25.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.943+0000 7f5caf110700 1 -- 172.21.15.72:0/2378799204 shutdown_connections 2023-10-03T10:17:25.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.943+0000 7f5caf110700 1 --2- 172.21.15.72:0/2378799204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca8133930 0x7f5ca8133dd0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.943+0000 7f5caf110700 1 --2- 172.21.15.72:0/2378799204 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ca80a0a30 0x7f5ca80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.943+0000 7f5caf110700 1 --2- 172.21.15.72:0/2378799204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca809d630 0x7f5ca80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.943+0000 7f5caf110700 1 -- 172.21.15.72:0/2378799204 >> 172.21.15.72:0/2378799204 conn(0x7f5ca80a3050 msgr2=0x7f5ca80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.943+0000 7f5caf110700 1 -- 172.21.15.72:0/2378799204 shutdown_connections 2023-10-03T10:17:25.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.943+0000 7f5caf110700 1 -- 172.21.15.72:0/2378799204 wait complete. 2023-10-03T10:17:25.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.944+0000 7f5caf110700 1 Processor -- start 2023-10-03T10:17:25.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.944+0000 7f5caf110700 1 -- start start 2023-10-03T10:17:25.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.945+0000 7f5caf110700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca809d630 0x7f5ca81c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.945+0000 7f5caf110700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca80a0a30 0x7f5ca81c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.945+0000 7f5caf110700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ca8133930 0x7f5ca81c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.945+0000 7f5caf110700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca81207e0 con 0x7f5ca809d630 2023-10-03T10:17:25.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.945+0000 7f5caf110700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca81205f0 con 0x7f5ca80a0a30 2023-10-03T10:17:25.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.945+0000 7f5caf110700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca80a0410 con 0x7f5ca8133930 2023-10-03T10:17:25.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.945+0000 7f5caceac700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca809d630 0x7f5ca81c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.945+0000 7f5ca7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca80a0a30 0x7f5ca81c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.945+0000 7f5caceac700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca809d630 0x7f5ca81c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35916/0 (socket says 172.21.15.72:35916) 2023-10-03T10:17:25.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.945+0000 7f5caceac700 1 -- 172.21.15.72:0/3048686663 learned_addr learned my addr 172.21.15.72:0/3048686663 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:25.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.945+0000 7f5cad6ad700 1 --2- 172.21.15.72:0/3048686663 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ca8133930 0x7f5ca81c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.946+0000 7f5caceac700 1 -- 172.21.15.72:0/3048686663 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ca8133930 msgr2=0x7f5ca81c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.946+0000 7f5caceac700 1 --2- 172.21.15.72:0/3048686663 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ca8133930 0x7f5ca81c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.946+0000 7f5caceac700 1 -- 172.21.15.72:0/3048686663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca80a0a30 msgr2=0x7f5ca81c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.946+0000 7f5caceac700 1 --2- 172.21.15.72:0/3048686663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca80a0a30 0x7f5ca81c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.946+0000 7f5caceac700 1 -- 172.21.15.72:0/3048686663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c940094a0 con 0x7f5ca809d630 2023-10-03T10:17:25.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.946+0000 7f5ca7fff700 1 --2- 172.21.15.72:0/3048686663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca80a0a30 0x7f5ca81c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:25.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.946+0000 7f5caceac700 1 --2- 172.21.15.72:0/3048686663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca809d630 0x7f5ca81c7fb0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00ebe0 tx=0x7f5c9c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.946+0000 7f5ca57fa700 1 -- 172.21.15.72:0/3048686663 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00c850 con 0x7f5ca809d630 2023-10-03T10:17:25.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.946+0000 7f5ca57fa700 1 -- 172.21.15.72:0/3048686663 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c00c9b0 con 0x7f5ca809d630 2023-10-03T10:17:25.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.946+0000 7f5caf110700 1 -- 172.21.15.72:0/3048686663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9c009550 con 0x7f5ca809d630 2023-10-03T10:17:25.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.946+0000 7f5ca57fa700 1 -- 172.21.15.72:0/3048686663 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00cd40 con 0x7f5ca809d630 2023-10-03T10:17:25.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.946+0000 7f5caf110700 1 -- 172.21.15.72:0/3048686663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca0009a70 con 0x7f5ca809d630 2023-10-03T10:17:25.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.947+0000 7f5ca57fa700 1 -- 172.21.15.72:0/3048686663 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c9c013470 con 0x7f5ca809d630 2023-10-03T10:17:25.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.947+0000 7f5ca57fa700 1 -- 172.21.15.72:0/3048686663 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5c9c03f7a0 con 0x7f5ca809d630 2023-10-03T10:17:25.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.947+0000 7f5caf110700 1 -- 172.21.15.72:0/3048686663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca80747f0 con 0x7f5ca809d630 2023-10-03T10:17:25.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:25.952+0000 7f5ca57fa700 1 -- 172.21.15.72:0/3048686663 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c9c0232f0 con 0x7f5ca809d630 2023-10-03T10:17:26.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.036+0000 7fb91f10a700 1 -- 172.21.15.72:0/1080273585 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb9181a4950 con 0x7fb91809e000 2023-10-03T10:17:26.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.036+0000 7fb9157fa700 1 -- 172.21.15.72:0/1080273585 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb904015020 con 0x7fb91809e000 2023-10-03T10:17:26.036 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:26.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.038+0000 7fb91f10a700 1 -- 172.21.15.72:0/1080273585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb91809e000 msgr2=0x7fb9181a2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.038+0000 7fb91f10a700 1 --2- 172.21.15.72:0/1080273585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb91809e000 0x7fb9181a2030 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fb904000c00 tx=0x7fb904004750 comp rx=0 tx=0).stop 2023-10-03T10:17:26.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.038+0000 7fb91f10a700 1 -- 172.21.15.72:0/1080273585 shutdown_connections 2023-10-03T10:17:26.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.038+0000 7fb91f10a700 1 --2- 172.21.15.72:0/1080273585 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb91809e410 0x7fb9181a2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.038+0000 7fb91f10a700 1 --2- 172.21.15.72:0/1080273585 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb91809d6f0 0x7fb9181a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.038+0000 7fb91f10a700 1 --2- 172.21.15.72:0/1080273585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb91809e000 0x7fb9181a2030 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.038+0000 7fb91f10a700 1 -- 172.21.15.72:0/1080273585 >> 172.21.15.72:0/1080273585 conn(0x7fb918066f50 msgr2=0x7fb9181b69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.038+0000 7fb91f10a700 1 -- 172.21.15.72:0/1080273585 shutdown_connections 2023-10-03T10:17:26.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.038+0000 7fb91f10a700 1 -- 172.21.15.72:0/1080273585 wait complete. 2023-10-03T10:17:26.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:26.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.126+0000 7f1a71eee700 1 -- 172.21.15.72:0/1050570004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a6c124440 con 0x7f1a6c0a1510 2023-10-03T10:17:26.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.126+0000 7f1a53fff700 1 -- 172.21.15.72:0/1050570004 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1a60015070 con 0x7f1a6c0a1510 2023-10-03T10:17:26.126 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:26.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.128+0000 7f1a71eee700 1 -- 172.21.15.72:0/1050570004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0a1510 msgr2=0x7f1a6c122e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.128+0000 7f1a71eee700 1 --2- 172.21.15.72:0/1050570004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0a1510 0x7f1a6c122e40 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009840 tx=0x7f1a60004750 comp rx=0 tx=0).stop 2023-10-03T10:17:26.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.128+0000 7f1a71eee700 1 -- 172.21.15.72:0/1050570004 shutdown_connections 2023-10-03T10:17:26.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.128+0000 7f1a71eee700 1 --2- 172.21.15.72:0/1050570004 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a6c139250 0x7f1a6c123380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.128+0000 7f1a71eee700 1 --2- 172.21.15.72:0/1050570004 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1a6c0a0a30 0x7f1a6c122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.128+0000 7f1a71eee700 1 --2- 172.21.15.72:0/1050570004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a6c0a1510 0x7f1a6c122e40 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.128+0000 7f1a71eee700 1 -- 172.21.15.72:0/1050570004 >> 172.21.15.72:0/1050570004 conn(0x7f1a6c0a6550 msgr2=0x7f1a6c09ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.128+0000 7f1a71eee700 1 -- 172.21.15.72:0/1050570004 shutdown_connections 2023-10-03T10:17:26.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.128+0000 7f1a71eee700 1 -- 172.21.15.72:0/1050570004 wait complete. 2023-10-03T10:17:26.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:26.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.156+0000 7f5caf110700 1 -- 172.21.15.72:0/3048686663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ca8120de0 con 0x7f5ca809d630 2023-10-03T10:17:26.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.156+0000 7f5ca57fa700 1 -- 172.21.15.72:0/3048686663 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c9c017020 con 0x7f5ca809d630 2023-10-03T10:17:26.156 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:26.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.158+0000 7f5caf110700 1 -- 172.21.15.72:0/3048686663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca809d630 msgr2=0x7f5ca81c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.158+0000 7f5caf110700 1 --2- 172.21.15.72:0/3048686663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca809d630 0x7f5ca81c7fb0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00ebe0 tx=0x7f5c9c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.158+0000 7f5caf110700 1 -- 172.21.15.72:0/3048686663 shutdown_connections 2023-10-03T10:17:26.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.158+0000 7f5caf110700 1 --2- 172.21.15.72:0/3048686663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ca809d630 0x7f5ca81c7fb0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.158+0000 7f5caf110700 1 --2- 172.21.15.72:0/3048686663 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5ca8133930 0x7f5ca81c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.158+0000 7f5caf110700 1 --2- 172.21.15.72:0/3048686663 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ca80a0a30 0x7f5ca81c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.158+0000 7f5caf110700 1 -- 172.21.15.72:0/3048686663 >> 172.21.15.72:0/3048686663 conn(0x7f5ca80a3050 msgr2=0x7f5ca80a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.158+0000 7f5caf110700 1 -- 172.21.15.72:0/3048686663 shutdown_connections 2023-10-03T10:17:26.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.158+0000 7f5caf110700 1 -- 172.21.15.72:0/3048686663 wait complete. 2023-10-03T10:17:26.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:26.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:26.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.814+0000 7f44c4a61700 1 Processor -- start 2023-10-03T10:17:26.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.814+0000 7f44c4a61700 1 -- start start 2023-10-03T10:17:26.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.814+0000 7f44c4a61700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44c01337f0 0x7f44c0138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.814+0000 7f44c4a61700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f44c0138dc0 0x7f44c013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.814+0000 7f44c4a61700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c006b990 con 0x7f44c0133420 2023-10-03T10:17:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.814+0000 7f44c4a61700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c009b0e0 con 0x7f44c0138dc0 2023-10-03T10:17:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.814+0000 7f44c4a61700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44c0133c20 con 0x7f44c01337f0 2023-10-03T10:17:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.814+0000 7f44bed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f44c0138dc0 0x7f44c013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.815+0000 7f44bdd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44c01337f0 0x7f44c0138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.815+0000 7f44bed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f44c0138dc0 0x7f44c013b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35924/0 (socket says 172.21.15.72:35924) 2023-10-03T10:17:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.815+0000 7f44bed9d700 1 -- 172.21.15.72:0/1965355853 learned_addr learned my addr 172.21.15.72:0/1965355853 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.815+0000 7f44bed9d700 1 -- 172.21.15.72:0/1965355853 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44c01337f0 msgr2=0x7f44c0138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.815+0000 7f44bed9d700 1 --2- 172.21.15.72:0/1965355853 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44c01337f0 0x7f44c0138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.815+0000 7f44bed9d700 1 -- 172.21.15.72:0/1965355853 >> v1:172.21.15.72:6789/0 conn(0x7f44c0133420 legacy=0x7f44c0133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.815+0000 7f44bed9d700 1 -- 172.21.15.72:0/1965355853 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c00a0590 con 0x7f44c0138dc0 2023-10-03T10:17:26.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.815+0000 7f44bdd9b700 1 --2- 172.21.15.72:0/1965355853 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44c01337f0 0x7f44c0138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.815+0000 7f44bed9d700 1 --2- 172.21.15.72:0/1965355853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44c0138dc0 0x7f44c013b1a0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009e50 tx=0x7f44b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96bf1a5bddbd18c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.815+0000 7f44bd59a700 1 -- 172.21.15.72:0/1965355853 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b800e070 con 0x7f44c0138dc0 2023-10-03T10:17:26.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.815+0000 7f44bd59a700 1 -- 172.21.15.72:0/1965355853 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b800b910 con 0x7f44c0138dc0 2023-10-03T10:17:26.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.815+0000 7f44bd59a700 1 -- 172.21.15.72:0/1965355853 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b800bcc0 con 0x7f44c0138dc0 2023-10-03T10:17:26.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.816+0000 7f44c4a61700 1 -- 172.21.15.72:0/1965355853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44c0138dc0 msgr2=0x7f44c013b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.816+0000 7f44c4a61700 1 --2- 172.21.15.72:0/1965355853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44c0138dc0 0x7f44c013b1a0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009e50 tx=0x7f44b800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:26.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.816+0000 7f44c4a61700 1 -- 172.21.15.72:0/1965355853 shutdown_connections 2023-10-03T10:17:26.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.816+0000 7f44c4a61700 1 --2- 172.21.15.72:0/1965355853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44c0138dc0 0x7f44c013b1a0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.816+0000 7f44c4a61700 1 --2- 172.21.15.72:0/1965355853 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44c01337f0 0x7f44c0138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.816+0000 7f44c4a61700 1 -- 172.21.15.72:0/1965355853 >> 172.21.15.72:0/1965355853 conn(0x7f44c00a4210 msgr2=0x7f44c00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.816+0000 7f44c4a61700 1 -- 172.21.15.72:0/1965355853 shutdown_connections 2023-10-03T10:17:26.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.816+0000 7f44c4a61700 1 -- 172.21.15.72:0/1965355853 wait complete. 2023-10-03T10:17:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.817+0000 7f44c4a61700 1 Processor -- start 2023-10-03T10:17:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.817+0000 7f44c4a61700 1 -- start start 2023-10-03T10:17:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.817+0000 7f44c4a61700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44c0133420 0x7f44c012f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.817+0000 7f44c4a61700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44c01337f0 0x7f44c012f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.817+0000 7f44c4a61700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44c0138dc0 0x7f44c012fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.817+0000 7f44c4a61700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c01388a0 con 0x7f44c01337f0 2023-10-03T10:17:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.817+0000 7f44c4a61700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c009dc90 con 0x7f44c0133420 2023-10-03T10:17:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.817+0000 7f44c4a61700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44c009ca70 con 0x7f44c0138dc0 2023-10-03T10:17:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.817+0000 7f44bdd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44c01337f0 0x7f44c012f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.817+0000 7f44bed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44c0138dc0 0x7f44c012fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.817+0000 7f44be59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44c0133420 0x7f44c012f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.817+0000 7f44bdd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44c01337f0 0x7f44c012f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35930/0 (socket says 172.21.15.72:35930) 2023-10-03T10:17:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.817+0000 7f44bdd9b700 1 -- 172.21.15.72:0/429238023 learned_addr learned my addr 172.21.15.72:0/429238023 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.818+0000 7f44bed9d700 1 -- 172.21.15.72:0/429238023 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44c0133420 msgr2=0x7f44c012f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.818+0000 7f44bed9d700 1 --2- 172.21.15.72:0/429238023 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44c0133420 0x7f44c012f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.818+0000 7f44bed9d700 1 -- 172.21.15.72:0/429238023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44c01337f0 msgr2=0x7f44c012f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.818+0000 7f44bed9d700 1 --2- 172.21.15.72:0/429238023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44c01337f0 0x7f44c012f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.818+0000 7f44bed9d700 1 -- 172.21.15.72:0/429238023 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b00094a0 con 0x7f44c0138dc0 2023-10-03T10:17:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.818+0000 7f44bdd9b700 1 --2- 172.21.15.72:0/429238023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44c01337f0 0x7f44c012f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.818+0000 7f44bed9d700 1 --2- 172.21.15.72:0/429238023 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44c0138dc0 0x7f44c012fbb0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f44b8015000 tx=0x7f44b8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.818+0000 7f44aeffd700 1 -- 172.21.15.72:0/429238023 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8004780 con 0x7f44c0138dc0 2023-10-03T10:17:26.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.818+0000 7f44aeffd700 1 -- 172.21.15.72:0/429238023 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b80092e0 con 0x7f44c0138dc0 2023-10-03T10:17:26.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.818+0000 7f44c4a61700 1 -- 172.21.15.72:0/429238023 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b8009b30 con 0x7f44c0138dc0 2023-10-03T10:17:26.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.818+0000 7f44aeffd700 1 -- 172.21.15.72:0/429238023 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b801c680 con 0x7f44c0138dc0 2023-10-03T10:17:26.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.818+0000 7f44c4a61700 1 -- 172.21.15.72:0/429238023 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c009d510 con 0x7f44c0138dc0 2023-10-03T10:17:26.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.819+0000 7f44aeffd700 1 -- 172.21.15.72:0/429238023 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44b801c7e0 con 0x7f44c0138dc0 2023-10-03T10:17:26.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.819+0000 7f44aeffd700 1 -- 172.21.15.72:0/429238023 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f44b8040e00 con 0x7f44c0138dc0 2023-10-03T10:17:26.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.819+0000 7f44c4a61700 1 -- 172.21.15.72:0/429238023 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c009f130 con 0x7f44c0138dc0 2023-10-03T10:17:26.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:26.824+0000 7f44aeffd700 1 -- 172.21.15.72:0/429238023 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44b80249a0 con 0x7f44c0138dc0 2023-10-03T10:17:27.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.008+0000 7f44c4a61700 1 -- 172.21.15.72:0/429238023 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f44c013b660 con 0x7f44c0138dc0 2023-10-03T10:17:27.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.009+0000 7f44aeffd700 1 -- 172.21.15.72:0/429238023 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44b8013e80 con 0x7f44c0138dc0 2023-10-03T10:17:27.008 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:27.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.011+0000 7f44c4a61700 1 -- 172.21.15.72:0/429238023 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44c0138dc0 msgr2=0x7f44c012fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.011+0000 7f44c4a61700 1 --2- 172.21.15.72:0/429238023 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44c0138dc0 0x7f44c012fbb0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f44b8015000 tx=0x7f44b8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.011+0000 7f44c4a61700 1 -- 172.21.15.72:0/429238023 shutdown_connections 2023-10-03T10:17:27.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.011+0000 7f44c4a61700 1 --2- 172.21.15.72:0/429238023 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f44c0138dc0 0x7f44c012fbb0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.011+0000 7f44c4a61700 1 --2- 172.21.15.72:0/429238023 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44c0133420 0x7f44c012f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.011+0000 7f44c4a61700 1 --2- 172.21.15.72:0/429238023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44c01337f0 0x7f44c012f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.011+0000 7f44c4a61700 1 -- 172.21.15.72:0/429238023 >> 172.21.15.72:0/429238023 conn(0x7f44c00a4210 msgr2=0x7f44c00a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.011+0000 7f44c4a61700 1 -- 172.21.15.72:0/429238023 shutdown_connections 2023-10-03T10:17:27.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.011+0000 7f44c4a61700 1 -- 172.21.15.72:0/429238023 wait complete. 2023-10-03T10:17:27.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:27.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:27.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:27.170 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:27.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.175+0000 7f68d96f4700 1 Processor -- start 2023-10-03T10:17:27.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.175+0000 7f68d96f4700 1 -- start start 2023-10-03T10:17:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d96f4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68d409d6f0 0x7f68d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d96f4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f68d409e000 0x7f68d41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d96f4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68d409e410 0x7f68d4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d96f4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d406b460 con 0x7f68d409e410 2023-10-03T10:17:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d96f4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d409b120 con 0x7f68d409d6f0 2023-10-03T10:17:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d96f4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68d409a7e0 con 0x7f68d409e000 2023-10-03T10:17:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f68d409e000 0x7f68d41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68d409d6f0 0x7f68d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f68d409e000 0x7f68d41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49252/0 (socket says 172.21.15.72:49252) 2023-10-03T10:17:27.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d27fc700 1 -- 172.21.15.72:0/3861703595 learned_addr learned my addr 172.21.15.72:0/3861703595 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:27.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d37fe700 1 --2- 172.21.15.72:0/3861703595 >> v2:172.21.15.72:3300/0 conn(0x7f68d409e410 0x7f68d4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d2ffd700 1 -- 172.21.15.72:0/3861703595 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f68d409e000 msgr2=0x7f68d41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d2ffd700 1 --2- 172.21.15.72:0/3861703595 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f68d409e000 0x7f68d41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d2ffd700 1 -- 172.21.15.72:0/3861703595 >> v2:172.21.15.72:3300/0 conn(0x7f68d409e410 msgr2=0x7f68d4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d2ffd700 1 --2- 172.21.15.72:0/3861703595 >> v2:172.21.15.72:3300/0 conn(0x7f68d409e410 0x7f68d4133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d2ffd700 1 -- 172.21.15.72:0/3861703595 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d409a500 con 0x7f68d409d6f0 2023-10-03T10:17:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d27fc700 1 --2- 172.21.15.72:0/3861703595 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f68d409e000 0x7f68d41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.176+0000 7f68d2ffd700 1 --2- 172.21.15.72:0/3861703595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68d409d6f0 0x7f68d409dac0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009870 tx=0x7f68c4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4c592915b209fc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.177+0000 7f68d1ffb700 1 -- 172.21.15.72:0/3861703595 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4011830 con 0x7f68d409d6f0 2023-10-03T10:17:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.177+0000 7f68d1ffb700 1 -- 172.21.15.72:0/3861703595 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c4011990 con 0x7f68d409d6f0 2023-10-03T10:17:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.177+0000 7f68d1ffb700 1 -- 172.21.15.72:0/3861703595 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4011d20 con 0x7f68d409d6f0 2023-10-03T10:17:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.177+0000 7f68d96f4700 1 -- 172.21.15.72:0/3861703595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68d409d6f0 msgr2=0x7f68d409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.177+0000 7f68d96f4700 1 --2- 172.21.15.72:0/3861703595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68d409d6f0 0x7f68d409dac0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009870 tx=0x7f68c4009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.177+0000 7f68d96f4700 1 -- 172.21.15.72:0/3861703595 shutdown_connections 2023-10-03T10:17:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.177+0000 7f68d96f4700 1 --2- 172.21.15.72:0/3861703595 >> v2:172.21.15.72:3300/0 conn(0x7f68d409e410 0x7f68d4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.177+0000 7f68d96f4700 1 --2- 172.21.15.72:0/3861703595 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68d409d6f0 0x7f68d409dac0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.177+0000 7f68d96f4700 1 --2- 172.21.15.72:0/3861703595 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f68d409e000 0x7f68d41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.177+0000 7f68d96f4700 1 -- 172.21.15.72:0/3861703595 >> 172.21.15.72:0/3861703595 conn(0x7f68d4066f50 msgr2=0x7f68d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.177+0000 7f68d96f4700 1 -- 172.21.15.72:0/3861703595 shutdown_connections 2023-10-03T10:17:27.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.177+0000 7f68d96f4700 1 -- 172.21.15.72:0/3861703595 wait complete. 2023-10-03T10:17:27.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.179+0000 7f68d96f4700 1 Processor -- start 2023-10-03T10:17:27.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.179+0000 7f68d96f4700 1 -- start start 2023-10-03T10:17:27.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d96f4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68d409d6f0 0x7f68d41a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d96f4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68d409e000 0x7f68d41a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d96f4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f68d409e410 0x7f68d41c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d96f4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d41a8190 con 0x7f68d409e000 2023-10-03T10:17:27.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d96f4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d41a8370 con 0x7f68d409d6f0 2023-10-03T10:17:27.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d96f4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68d41b91e0 con 0x7f68d409e410 2023-10-03T10:17:27.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f68d409e410 0x7f68d41c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68d409d6f0 0x7f68d41a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f68d409e410 0x7f68d41c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49266/0 (socket says 172.21.15.72:49266) 2023-10-03T10:17:27.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d37fe700 1 -- 172.21.15.72:0/2360668254 learned_addr learned my addr 172.21.15.72:0/2360668254 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:27.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d2ffd700 1 --2- 172.21.15.72:0/2360668254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68d409d6f0 0x7f68d41a52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51130/0 (socket says 172.21.15.72:51130) 2023-10-03T10:17:27.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d27fc700 1 --2- 172.21.15.72:0/2360668254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68d409e000 0x7f68d41a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d37fe700 1 -- 172.21.15.72:0/2360668254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68d409d6f0 msgr2=0x7f68d41a52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d37fe700 1 --2- 172.21.15.72:0/2360668254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68d409d6f0 0x7f68d41a52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d37fe700 1 -- 172.21.15.72:0/2360668254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68d409e000 msgr2=0x7f68d41a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d37fe700 1 --2- 172.21.15.72:0/2360668254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68d409e000 0x7f68d41a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d37fe700 1 -- 172.21.15.72:0/2360668254 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c8009550 con 0x7f68d409e410 2023-10-03T10:17:27.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d2ffd700 1 --2- 172.21.15.72:0/2360668254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68d409d6f0 0x7f68d41a52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.180+0000 7f68d37fe700 1 --2- 172.21.15.72:0/2360668254 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f68d409e410 0x7f68d41c80b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009e30 tx=0x7f68cc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.181+0000 7f68bb7fe700 1 -- 172.21.15.72:0/2360668254 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc009ca0 con 0x7f68d409e410 2023-10-03T10:17:27.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.181+0000 7f68bb7fe700 1 -- 172.21.15.72:0/2360668254 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68cc00f040 con 0x7f68d409e410 2023-10-03T10:17:27.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.181+0000 7f68bb7fe700 1 -- 172.21.15.72:0/2360668254 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68cc014480 con 0x7f68d409e410 2023-10-03T10:17:27.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.181+0000 7f68d96f4700 1 -- 172.21.15.72:0/2360668254 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c40094a0 con 0x7f68d409e410 2023-10-03T10:17:27.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.181+0000 7f68d96f4700 1 -- 172.21.15.72:0/2360668254 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d40a3000 con 0x7f68d409e410 2023-10-03T10:17:27.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.181+0000 7f68bb7fe700 1 -- 172.21.15.72:0/2360668254 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68cc0145e0 con 0x7f68d409e410 2023-10-03T10:17:27.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.182+0000 7f68bb7fe700 1 -- 172.21.15.72:0/2360668254 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f68cc0401e0 con 0x7f68d409e410 2023-10-03T10:17:27.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.182+0000 7f68d96f4700 1 -- 172.21.15.72:0/2360668254 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d41a5d30 con 0x7f68d409e410 2023-10-03T10:17:27.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.187+0000 7f68bb7fe700 1 -- 172.21.15.72:0/2360668254 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68cc018030 con 0x7f68d409e410 2023-10-03T10:17:27.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.269+0000 7efdd7546700 1 Processor -- start 2023-10-03T10:17:27.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.269+0000 7efdd7546700 1 -- start start 2023-10-03T10:17:27.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd7546700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdd0134630 0x7efdd0136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd7546700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdd0136f50 0x7efdd0139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd7546700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd009b4f0 con 0x7efdd0131810 2023-10-03T10:17:27.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd7546700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd01313c0 con 0x7efdd0134630 2023-10-03T10:17:27.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd7546700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdd006e8c0 con 0x7efdd0136f50 2023-10-03T10:17:27.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd4ae1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdd0134630 0x7efdd0136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd4ae1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdd0134630 0x7efdd0136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:51132/0 (socket says 172.21.15.72:51132) 2023-10-03T10:17:27.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd4ae1700 1 -- 172.21.15.72:0/4179096552 learned_addr learned my addr 172.21.15.72:0/4179096552 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:27.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd52e2700 1 --1- 172.21.15.72:0/4179096552 >> v1:172.21.15.72:6789/0 conn(0x7efdd0131810 0x7efdd0131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39782/0 (socket says 172.21.15.72:39782) 2023-10-03T10:17:27.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd5ae3700 1 --2- 172.21.15.72:0/4179096552 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdd0136f50 0x7efdd0139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd5ae3700 1 -- 172.21.15.72:0/4179096552 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdd0134630 msgr2=0x7efdd0136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd5ae3700 1 --2- 172.21.15.72:0/4179096552 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdd0134630 0x7efdd0136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd5ae3700 1 -- 172.21.15.72:0/4179096552 >> v1:172.21.15.72:6789/0 conn(0x7efdd0131810 legacy=0x7efdd0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd5ae3700 1 -- 172.21.15.72:0/4179096552 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd0071d20 con 0x7efdd0136f50 2023-10-03T10:17:27.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd4ae1700 1 --2- 172.21.15.72:0/4179096552 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdd0134630 0x7efdd0136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.270+0000 7efdd5ae3700 1 --2- 172.21.15.72:0/4179096552 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdd0136f50 0x7efdd0139330 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009dc0 tx=0x7efdc800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20ea8f808b3ce1b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.271+0000 7efdc7fff700 1 -- 172.21.15.72:0/4179096552 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800e070 con 0x7efdd0136f50 2023-10-03T10:17:27.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.271+0000 7efdc7fff700 1 -- 172.21.15.72:0/4179096552 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc800bb20 con 0x7efdd0136f50 2023-10-03T10:17:27.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.271+0000 7efdc7fff700 1 -- 172.21.15.72:0/4179096552 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc8012430 con 0x7efdd0136f50 2023-10-03T10:17:27.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.271+0000 7efdd7546700 1 -- 172.21.15.72:0/4179096552 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdd0136f50 msgr2=0x7efdd0139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.271+0000 7efdd7546700 1 --2- 172.21.15.72:0/4179096552 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdd0136f50 0x7efdd0139330 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009dc0 tx=0x7efdc800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:27.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.271+0000 7efdd7546700 1 -- 172.21.15.72:0/4179096552 shutdown_connections 2023-10-03T10:17:27.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.271+0000 7efdd7546700 1 --2- 172.21.15.72:0/4179096552 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdd0136f50 0x7efdd0139330 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.271+0000 7efdd7546700 1 --2- 172.21.15.72:0/4179096552 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdd0134630 0x7efdd0136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.271+0000 7efdd7546700 1 -- 172.21.15.72:0/4179096552 >> 172.21.15.72:0/4179096552 conn(0x7efdd00a2aa0 msgr2=0x7efdd00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.271+0000 7efdd7546700 1 -- 172.21.15.72:0/4179096552 shutdown_connections 2023-10-03T10:17:27.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.271+0000 7efdd7546700 1 -- 172.21.15.72:0/4179096552 wait complete. 2023-10-03T10:17:27.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.272+0000 7efdd7546700 1 Processor -- start 2023-10-03T10:17:27.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.272+0000 7efdd7546700 1 -- start start 2023-10-03T10:17:27.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd7546700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdd0131810 0x7efdd01c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd7546700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdd0134630 0x7efdd01c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd7546700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdd0136f50 0x7efdd0118f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd7546700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd011aa40 con 0x7efdd0134630 2023-10-03T10:17:27.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd7546700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd011a850 con 0x7efdd0136f50 2023-10-03T10:17:27.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd7546700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00a2060 con 0x7efdd0131810 2023-10-03T10:17:27.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd4ae1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdd0134630 0x7efdd01c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd4ae1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdd0134630 0x7efdd01c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35948/0 (socket says 172.21.15.72:35948) 2023-10-03T10:17:27.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd4ae1700 1 -- 172.21.15.72:0/3772469156 learned_addr learned my addr 172.21.15.72:0/3772469156 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd5ae3700 1 --2- 172.21.15.72:0/3772469156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdd0136f50 0x7efdd0118f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd52e2700 1 --2- 172.21.15.72:0/3772469156 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdd0131810 0x7efdd01c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd4ae1700 1 -- 172.21.15.72:0/3772469156 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdd0131810 msgr2=0x7efdd01c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd4ae1700 1 --2- 172.21.15.72:0/3772469156 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdd0131810 0x7efdd01c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd4ae1700 1 -- 172.21.15.72:0/3772469156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdd0136f50 msgr2=0x7efdd0118f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd4ae1700 1 --2- 172.21.15.72:0/3772469156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdd0136f50 0x7efdd0118f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd4ae1700 1 -- 172.21.15.72:0/3772469156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc0009550 con 0x7efdd0134630 2023-10-03T10:17:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.273+0000 7efdd4ae1700 1 --2- 172.21.15.72:0/3772469156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdd0134630 0x7efdd01c6920 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7efdc000ebe0 tx=0x7efdc000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.274+0000 7efdc5ffb700 1 -- 172.21.15.72:0/3772469156 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000c850 con 0x7efdd0134630 2023-10-03T10:17:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.274+0000 7efdc5ffb700 1 -- 172.21.15.72:0/3772469156 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc000c9b0 con 0x7efdd0134630 2023-10-03T10:17:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.274+0000 7efdc5ffb700 1 -- 172.21.15.72:0/3772469156 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000cd40 con 0x7efdd0134630 2023-10-03T10:17:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.274+0000 7efdd7546700 1 -- 172.21.15.72:0/3772469156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc8009a70 con 0x7efdd0134630 2023-10-03T10:17:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.274+0000 7efdd7546700 1 -- 172.21.15.72:0/3772469156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd006eb00 con 0x7efdd0134630 2023-10-03T10:17:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.275+0000 7efdc5ffb700 1 -- 172.21.15.72:0/3772469156 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efdc0013470 con 0x7efdd0134630 2023-10-03T10:17:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.275+0000 7efdd7546700 1 -- 172.21.15.72:0/3772469156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd0074ea0 con 0x7efdd0134630 2023-10-03T10:17:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.275+0000 7efdc5ffb700 1 -- 172.21.15.72:0/3772469156 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efdc003f830 con 0x7efdd0134630 2023-10-03T10:17:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.280+0000 7efdc5ffb700 1 -- 172.21.15.72:0/3772469156 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efdc0021020 con 0x7efdd0134630 2023-10-03T10:17:27.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.302+0000 7f39b5028700 1 Processor -- start 2023-10-03T10:17:27.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.302+0000 7f39b5028700 1 -- start start 2023-10-03T10:17:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.302+0000 7f39b5028700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39b00a0a30 0x7f39b00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.302+0000 7f39b5028700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39b009d630 0x7f39b00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.302+0000 7f39b5028700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b00a2a70 con 0x7f39b0133930 2023-10-03T10:17:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.302+0000 7f39b5028700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b00a01d0 con 0x7f39b00a0a30 2023-10-03T10:17:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.302+0000 7f39b5028700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39b009e2b0 con 0x7f39b009d630 2023-10-03T10:17:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.302+0000 7f39ae59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39b009d630 0x7f39b00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.302+0000 7f39ae59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39b009d630 0x7f39b00a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49292/0 (socket says 172.21.15.72:49292) 2023-10-03T10:17:27.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.302+0000 7f39af59e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f39b0133930 0x7f39b0133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39788/0 (socket says 172.21.15.72:39788) 2023-10-03T10:17:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.302+0000 7f39ae59c700 1 -- 172.21.15.72:0/1371557900 learned_addr learned my addr 172.21.15.72:0/1371557900 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.302+0000 7f39aed9d700 1 --2- 172.21.15.72:0/1371557900 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39b00a0a30 0x7f39b00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.303+0000 7f39ae59c700 1 -- 172.21.15.72:0/1371557900 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39b00a0a30 msgr2=0x7f39b00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.303+0000 7f39ae59c700 1 --2- 172.21.15.72:0/1371557900 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39b00a0a30 0x7f39b00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.303+0000 7f39ae59c700 1 -- 172.21.15.72:0/1371557900 >> v1:172.21.15.72:6789/0 conn(0x7f39b0133930 legacy=0x7f39b0133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.303+0000 7f39add9b700 1 -- 172.21.15.72:0/1371557900 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641310670 0 0) 0x7f39b00a2a70 con 0x7f39b0133930 2023-10-03T10:17:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.303+0000 7f39ae59c700 1 -- 172.21.15.72:0/1371557900 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b009dc50 con 0x7f39b009d630 2023-10-03T10:17:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.303+0000 7f39ae59c700 1 --2- 172.21.15.72:0/1371557900 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39b009d630 0x7f39b00a1340 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009920 tx=0x7f39a4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ed4d496f2507294 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.303+0000 7f39add9b700 1 -- 172.21.15.72:0/1371557900 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4011830 con 0x7f39b009d630 2023-10-03T10:17:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.303+0000 7f39add9b700 1 -- 172.21.15.72:0/1371557900 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a4011990 con 0x7f39b009d630 2023-10-03T10:17:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.303+0000 7f39add9b700 1 -- 172.21.15.72:0/1371557900 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4011d20 con 0x7f39b009d630 2023-10-03T10:17:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.304+0000 7f39b5028700 1 -- 172.21.15.72:0/1371557900 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39b009d630 msgr2=0x7f39b00a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.304+0000 7f39b5028700 1 --2- 172.21.15.72:0/1371557900 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39b009d630 0x7f39b00a1340 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009920 tx=0x7f39a4009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.304+0000 7f39b5028700 1 -- 172.21.15.72:0/1371557900 shutdown_connections 2023-10-03T10:17:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.304+0000 7f39b5028700 1 --2- 172.21.15.72:0/1371557900 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39b00a0a30 0x7f39b00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.304+0000 7f39b5028700 1 --2- 172.21.15.72:0/1371557900 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39b009d630 0x7f39b00a1340 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.304+0000 7f39b5028700 1 -- 172.21.15.72:0/1371557900 >> 172.21.15.72:0/1371557900 conn(0x7f39b00a3050 msgr2=0x7f39b00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.304+0000 7f39b5028700 1 -- 172.21.15.72:0/1371557900 shutdown_connections 2023-10-03T10:17:27.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.304+0000 7f39b5028700 1 -- 172.21.15.72:0/1371557900 wait complete. 2023-10-03T10:17:27.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.305+0000 7f39b5028700 1 Processor -- start 2023-10-03T10:17:27.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.305+0000 7f39b5028700 1 -- start start 2023-10-03T10:17:27.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39b5028700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39b009d630 0x7f39b01c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39b5028700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39b00a0a30 0x7f39b01c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39b5028700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39b0133930 0x7f39b011e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39b5028700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b01bcf00 con 0x7f39b00a0a30 2023-10-03T10:17:27.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39b5028700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b01c8ef0 con 0x7f39b0133930 2023-10-03T10:17:27.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39b5028700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39b0121db0 con 0x7f39b009d630 2023-10-03T10:17:27.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39ae59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39b00a0a30 0x7f39b01c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39aed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39b009d630 0x7f39b01c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39ae59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39b00a0a30 0x7f39b01c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35952/0 (socket says 172.21.15.72:35952) 2023-10-03T10:17:27.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39aed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39b009d630 0x7f39b01c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49306/0 (socket says 172.21.15.72:49306) 2023-10-03T10:17:27.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39ae59c700 1 -- 172.21.15.72:0/1879252052 learned_addr learned my addr 172.21.15.72:0/1879252052 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:27.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39af59e700 1 --2- 172.21.15.72:0/1879252052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39b0133930 0x7f39b011e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39aed9d700 1 -- 172.21.15.72:0/1879252052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39b0133930 msgr2=0x7f39b011e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39aed9d700 1 --2- 172.21.15.72:0/1879252052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39b0133930 0x7f39b011e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39aed9d700 1 -- 172.21.15.72:0/1879252052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39b00a0a30 msgr2=0x7f39b01c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39aed9d700 1 --2- 172.21.15.72:0/1879252052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39b00a0a30 0x7f39b01c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39aed9d700 1 -- 172.21.15.72:0/1879252052 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a4009550 con 0x7f39b009d630 2023-10-03T10:17:27.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.306+0000 7f39ae59c700 1 --2- 172.21.15.72:0/1879252052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39b00a0a30 0x7f39b01c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.307+0000 7f39aed9d700 1 --2- 172.21.15.72:0/1879252052 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39b009d630 0x7f39b01c8470 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f39a000e900 tx=0x7f39a000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.307+0000 7f39977fe700 1 -- 172.21.15.72:0/1879252052 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0013680 con 0x7f39b009d630 2023-10-03T10:17:27.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.307+0000 7f39977fe700 1 -- 172.21.15.72:0/1879252052 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a00137e0 con 0x7f39b009d630 2023-10-03T10:17:27.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.307+0000 7f39b5028700 1 -- 172.21.15.72:0/1879252052 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b0122450 con 0x7f39b009d630 2023-10-03T10:17:27.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.307+0000 7f39977fe700 1 -- 172.21.15.72:0/1879252052 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0013b50 con 0x7f39b009d630 2023-10-03T10:17:27.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.307+0000 7f39b5028700 1 -- 172.21.15.72:0/1879252052 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b0120440 con 0x7f39b009d630 2023-10-03T10:17:27.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.308+0000 7f39977fe700 1 -- 172.21.15.72:0/1879252052 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f39a0013cb0 con 0x7f39b009d630 2023-10-03T10:17:27.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.308+0000 7f39b5028700 1 -- 172.21.15.72:0/1879252052 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b00747f0 con 0x7f39b009d630 2023-10-03T10:17:27.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.308+0000 7f39977fe700 1 -- 172.21.15.72:0/1879252052 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f39a003fa50 con 0x7f39b009d630 2023-10-03T10:17:27.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.317+0000 7f39977fe700 1 -- 172.21.15.72:0/1879252052 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39a001adc0 con 0x7f39b009d630 2023-10-03T10:17:27.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.389+0000 7f68d96f4700 1 -- 172.21.15.72:0/2360668254 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f68d409c710 con 0x7f68d409e410 2023-10-03T10:17:27.389 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:27.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.390+0000 7f68bb7fe700 1 -- 172.21.15.72:0/2360668254 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f68cc02b090 con 0x7f68d409e410 2023-10-03T10:17:27.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.393+0000 7f68d96f4700 1 -- 172.21.15.72:0/2360668254 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f68d409e410 msgr2=0x7f68d41c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.393+0000 7f68d96f4700 1 --2- 172.21.15.72:0/2360668254 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f68d409e410 0x7f68d41c80b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009e30 tx=0x7f68cc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.393+0000 7f68d96f4700 1 -- 172.21.15.72:0/2360668254 shutdown_connections 2023-10-03T10:17:27.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.393+0000 7f68d96f4700 1 --2- 172.21.15.72:0/2360668254 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f68d409e410 0x7f68d41c80b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.393+0000 7f68d96f4700 1 --2- 172.21.15.72:0/2360668254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f68d409d6f0 0x7f68d41a52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.393+0000 7f68d96f4700 1 --2- 172.21.15.72:0/2360668254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68d409e000 0x7f68d41a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.393+0000 7f68d96f4700 1 -- 172.21.15.72:0/2360668254 >> 172.21.15.72:0/2360668254 conn(0x7f68d4066f50 msgr2=0x7f68d406f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.393+0000 7f68d96f4700 1 -- 172.21.15.72:0/2360668254 shutdown_connections 2023-10-03T10:17:27.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.393+0000 7f68d96f4700 1 -- 172.21.15.72:0/2360668254 wait complete. 2023-10-03T10:17:27.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:27.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.473+0000 7efdd7546700 1 -- 172.21.15.72:0/3772469156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efdd011b040 con 0x7efdd0134630 2023-10-03T10:17:27.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.474+0000 7efdc5ffb700 1 -- 172.21.15.72:0/3772469156 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efdc00232f0 con 0x7efdd0134630 2023-10-03T10:17:27.473 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:27.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.476+0000 7efdd7546700 1 -- 172.21.15.72:0/3772469156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdd0134630 msgr2=0x7efdd01c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.476+0000 7efdd7546700 1 --2- 172.21.15.72:0/3772469156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdd0134630 0x7efdd01c6920 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7efdc000ebe0 tx=0x7efdc000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.476+0000 7efdd7546700 1 -- 172.21.15.72:0/3772469156 shutdown_connections 2023-10-03T10:17:27.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.476+0000 7efdd7546700 1 --2- 172.21.15.72:0/3772469156 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdd0136f50 0x7efdd0118f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.476+0000 7efdd7546700 1 --2- 172.21.15.72:0/3772469156 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdd0131810 0x7efdd01c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.476+0000 7efdd7546700 1 --2- 172.21.15.72:0/3772469156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdd0134630 0x7efdd01c6920 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.476+0000 7efdd7546700 1 -- 172.21.15.72:0/3772469156 >> 172.21.15.72:0/3772469156 conn(0x7efdd00a2aa0 msgr2=0x7efdd01331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.476+0000 7efdd7546700 1 -- 172.21.15.72:0/3772469156 shutdown_connections 2023-10-03T10:17:27.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.476+0000 7efdd7546700 1 -- 172.21.15.72:0/3772469156 wait complete. 2023-10-03T10:17:27.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:27.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.517+0000 7f39b5028700 1 -- 172.21.15.72:0/1879252052 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f39b0072980 con 0x7f39b009d630 2023-10-03T10:17:27.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.517+0000 7f39977fe700 1 -- 172.21.15.72:0/1879252052 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f39a001a360 con 0x7f39b009d630 2023-10-03T10:17:27.517 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:27.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.519+0000 7f39b5028700 1 -- 172.21.15.72:0/1879252052 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39b009d630 msgr2=0x7f39b01c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.520+0000 7f39b5028700 1 --2- 172.21.15.72:0/1879252052 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39b009d630 0x7f39b01c8470 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f39a000e900 tx=0x7f39a000ec10 comp rx=0 tx=0).stop 2023-10-03T10:17:27.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.520+0000 7f39b5028700 1 -- 172.21.15.72:0/1879252052 shutdown_connections 2023-10-03T10:17:27.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.520+0000 7f39b5028700 1 --2- 172.21.15.72:0/1879252052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f39b0133930 0x7f39b011e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.520+0000 7f39b5028700 1 --2- 172.21.15.72:0/1879252052 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f39b009d630 0x7f39b01c8470 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.520+0000 7f39b5028700 1 --2- 172.21.15.72:0/1879252052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f39b00a0a30 0x7f39b01c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.520+0000 7f39b5028700 1 -- 172.21.15.72:0/1879252052 >> 172.21.15.72:0/1879252052 conn(0x7f39b00a3050 msgr2=0x7f39b01bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.520+0000 7f39b5028700 1 -- 172.21.15.72:0/1879252052 shutdown_connections 2023-10-03T10:17:27.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:27.520+0000 7f39b5028700 1 -- 172.21.15.72:0/1879252052 wait complete. 2023-10-03T10:17:27.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:28.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:28.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.148+0000 7f4a7d995700 1 Processor -- start 2023-10-03T10:17:28.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.148+0000 7f4a7d995700 1 -- start start 2023-10-03T10:17:28.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.149+0000 7f4a7d995700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a7809e1d0 0x7f4a78138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.149+0000 7f4a7d995700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a78139170 0x7f4a7813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.149+0000 7f4a7d995700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7809b120 con 0x7f4a7809d6f0 2023-10-03T10:17:28.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.149+0000 7f4a7d995700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7806b460 con 0x7f4a7809e1d0 2023-10-03T10:17:28.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.149+0000 7f4a7d995700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7809a7e0 con 0x7f4a78139170 2023-10-03T10:17:28.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.149+0000 7f4a76ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4a7809d6f0 0x7f4a7809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39802/0 (socket says 172.21.15.72:39802) 2023-10-03T10:17:28.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.149+0000 7f4a777fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a78139170 0x7f4a7813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.149+0000 7f4a76ffd700 1 -- 172.21.15.72:0/4287383912 learned_addr learned my addr 172.21.15.72:0/4287383912 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:28.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.149+0000 7f4a767fc700 1 --2- 172.21.15.72:0/4287383912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a7809e1d0 0x7f4a78138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.149+0000 7f4a75ffb700 1 -- 172.21.15.72:0/4287383912 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029566156 0 0) 0x7f4a7809b120 con 0x7f4a7809d6f0 2023-10-03T10:17:28.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.149+0000 7f4a767fc700 1 -- 172.21.15.72:0/4287383912 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a78139170 msgr2=0x7f4a7813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:28.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.149+0000 7f4a767fc700 1 --2- 172.21.15.72:0/4287383912 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a78139170 0x7f4a7813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.149+0000 7f4a767fc700 1 -- 172.21.15.72:0/4287383912 >> v1:172.21.15.72:6789/0 conn(0x7f4a7809d6f0 legacy=0x7f4a7809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.149+0000 7f4a767fc700 1 -- 172.21.15.72:0/4287383912 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7809a500 con 0x7f4a7809e1d0 2023-10-03T10:17:28.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.149+0000 7f4a777fe700 1 --2- 172.21.15.72:0/4287383912 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a78139170 0x7f4a7813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.150+0000 7f4a767fc700 1 --2- 172.21.15.72:0/4287383912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a7809e1d0 0x7f4a78138c30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009870 tx=0x7f4a68009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8458a3c79d70c177 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.150+0000 7f4a75ffb700 1 -- 172.21.15.72:0/4287383912 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68011830 con 0x7f4a7809e1d0 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.150+0000 7f4a75ffb700 1 -- 172.21.15.72:0/4287383912 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a68011990 con 0x7f4a7809e1d0 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.150+0000 7f4a75ffb700 1 -- 172.21.15.72:0/4287383912 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68011d20 con 0x7f4a7809e1d0 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.150+0000 7f4a7d995700 1 -- 172.21.15.72:0/4287383912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a7809e1d0 msgr2=0x7f4a78138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.150+0000 7f4a7d995700 1 --2- 172.21.15.72:0/4287383912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a7809e1d0 0x7f4a78138c30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009870 tx=0x7f4a68009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.150+0000 7f4a7d995700 1 -- 172.21.15.72:0/4287383912 shutdown_connections 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.150+0000 7f4a7d995700 1 --2- 172.21.15.72:0/4287383912 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a78139170 0x7f4a7813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.150+0000 7f4a7d995700 1 --2- 172.21.15.72:0/4287383912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a7809e1d0 0x7f4a78138c30 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.150+0000 7f4a7d995700 1 -- 172.21.15.72:0/4287383912 >> 172.21.15.72:0/4287383912 conn(0x7f4a78066f50 msgr2=0x7f4a7809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.150+0000 7f4a7d995700 1 -- 172.21.15.72:0/4287383912 shutdown_connections 2023-10-03T10:17:28.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.150+0000 7f4a7d995700 1 -- 172.21.15.72:0/4287383912 wait complete. 2023-10-03T10:17:28.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.151+0000 7f4a7d995700 1 Processor -- start 2023-10-03T10:17:28.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.151+0000 7f4a7d995700 1 -- start start 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a7d995700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a7809d6f0 0x7f4a7811e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a7d995700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a7809e1d0 0x7f4a7811ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a7d995700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a78139170 0x7f4a7811f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a7d995700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78133fa0 con 0x7f4a7809d6f0 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a7d995700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78134580 con 0x7f4a7809e1d0 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a7d995700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78120b00 con 0x7f4a78139170 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a76ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a7809d6f0 0x7f4a7811e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a777fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a78139170 0x7f4a7811f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a76ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a7809d6f0 0x7f4a7811e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35960/0 (socket says 172.21.15.72:35960) 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a76ffd700 1 -- 172.21.15.72:0/1138403145 learned_addr learned my addr 172.21.15.72:0/1138403145 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a777fe700 1 --2- 172.21.15.72:0/1138403145 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a78139170 0x7f4a7811f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49328/0 (socket says 172.21.15.72:49328) 2023-10-03T10:17:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a767fc700 1 --2- 172.21.15.72:0/1138403145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a7809e1d0 0x7f4a7811ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a76ffd700 1 -- 172.21.15.72:0/1138403145 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a78139170 msgr2=0x7f4a7811f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a76ffd700 1 --2- 172.21.15.72:0/1138403145 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a78139170 0x7f4a7811f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a76ffd700 1 -- 172.21.15.72:0/1138403145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a7809e1d0 msgr2=0x7f4a7811ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a76ffd700 1 --2- 172.21.15.72:0/1138403145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a7809e1d0 0x7f4a7811ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a76ffd700 1 -- 172.21.15.72:0/1138403145 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a70009a70 con 0x7f4a7809d6f0 2023-10-03T10:17:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a76ffd700 1 --2- 172.21.15.72:0/1138403145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a7809d6f0 0x7f4a7811e690 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00c550 tx=0x7f4a6c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a5ffff700 1 -- 172.21.15.72:0/1138403145 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c004c80 con 0x7f4a7809d6f0 2023-10-03T10:17:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a5ffff700 1 -- 172.21.15.72:0/1138403145 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c004de0 con 0x7f4a7809d6f0 2023-10-03T10:17:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a7d995700 1 -- 172.21.15.72:0/1138403145 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a680094a0 con 0x7f4a7809d6f0 2023-10-03T10:17:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a5ffff700 1 -- 172.21.15.72:0/1138403145 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c007310 con 0x7f4a7809d6f0 2023-10-03T10:17:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.152+0000 7f4a7d995700 1 -- 172.21.15.72:0/1138403145 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a78072110 con 0x7f4a7809d6f0 2023-10-03T10:17:28.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.153+0000 7f4a5ffff700 1 -- 172.21.15.72:0/1138403145 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a6c007470 con 0x7f4a7809d6f0 2023-10-03T10:17:28.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.153+0000 7f4a5ffff700 1 -- 172.21.15.72:0/1138403145 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4a6c03f2b0 con 0x7f4a7809d6f0 2023-10-03T10:17:28.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.153+0000 7f4a7d995700 1 -- 172.21.15.72:0/1138403145 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a78074ea0 con 0x7f4a7809d6f0 2023-10-03T10:17:28.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.158+0000 7f4a5ffff700 1 -- 172.21.15.72:0/1138403145 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a6c0123b0 con 0x7f4a7809d6f0 2023-10-03T10:17:28.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.344+0000 7f4a7d995700 1 -- 172.21.15.72:0/1138403145 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4a78121b70 con 0x7f4a7809d6f0 2023-10-03T10:17:28.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.344+0000 7f4a5ffff700 1 -- 172.21.15.72:0/1138403145 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4a6c0102c0 con 0x7f4a7809d6f0 2023-10-03T10:17:28.344 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:28.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.346+0000 7f4a7d995700 1 -- 172.21.15.72:0/1138403145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a7809d6f0 msgr2=0x7f4a7811e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.346+0000 7f4a7d995700 1 --2- 172.21.15.72:0/1138403145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a7809d6f0 0x7f4a7811e690 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00c550 tx=0x7f4a6c00c860 comp rx=0 tx=0).stop 2023-10-03T10:17:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.346+0000 7f4a7d995700 1 -- 172.21.15.72:0/1138403145 shutdown_connections 2023-10-03T10:17:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.346+0000 7f4a7d995700 1 --2- 172.21.15.72:0/1138403145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a7809d6f0 0x7f4a7811e690 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.346+0000 7f4a7d995700 1 --2- 172.21.15.72:0/1138403145 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a78139170 0x7f4a7811f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.346+0000 7f4a7d995700 1 --2- 172.21.15.72:0/1138403145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a7809e1d0 0x7f4a7811ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.346+0000 7f4a7d995700 1 -- 172.21.15.72:0/1138403145 >> 172.21.15.72:0/1138403145 conn(0x7f4a78066f50 msgr2=0x7f4a78136c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.346+0000 7f4a7d995700 1 -- 172.21.15.72:0/1138403145 shutdown_connections 2023-10-03T10:17:28.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.346+0000 7f4a7d995700 1 -- 172.21.15.72:0/1138403145 wait complete. 2023-10-03T10:17:28.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:28.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:28.488 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:28.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:28.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.534+0000 7f7463ccf700 1 Processor -- start 2023-10-03T10:17:28.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.534+0000 7f7463ccf700 1 -- start start 2023-10-03T10:17:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f7463ccf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f745c133420 0x7f745c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f7463ccf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c133e30 0x7f745c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f7463ccf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c134260 0x7f745c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f7463ccf700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745c06b990 con 0x7f745c133420 2023-10-03T10:17:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f7463ccf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745c0a0590 con 0x7f745c133e30 2023-10-03T10:17:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f7463ccf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f745c09fb80 con 0x7f745c134260 2023-10-03T10:17:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f746226c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c134260 0x7f745c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f746126a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c133e30 0x7f745c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f746226c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c134260 0x7f745c1304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37824/0 (socket says 172.21.15.72:37824) 2023-10-03T10:17:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f746126a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c133e30 0x7f745c12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43084/0 (socket says 172.21.15.72:43084) 2023-10-03T10:17:28.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f746226c700 1 -- 172.21.15.72:0/2061485750 learned_addr learned my addr 172.21.15.72:0/2061485750 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f7461a6b700 1 --2- 172.21.15.72:0/2061485750 >> v2:172.21.15.72:3300/0 conn(0x7f745c133420 0x7f745c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f746226c700 1 -- 172.21.15.72:0/2061485750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c133e30 msgr2=0x7f745c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f746226c700 1 --2- 172.21.15.72:0/2061485750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c133e30 0x7f745c12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f746226c700 1 -- 172.21.15.72:0/2061485750 >> v2:172.21.15.72:3300/0 conn(0x7f745c133420 msgr2=0x7f745c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f746226c700 1 --2- 172.21.15.72:0/2061485750 >> v2:172.21.15.72:3300/0 conn(0x7f745c133420 0x7f745c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f746226c700 1 -- 172.21.15.72:0/2061485750 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c0a0030 con 0x7f745c134260 2023-10-03T10:17:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.535+0000 7f746226c700 1 --2- 172.21.15.72:0/2061485750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c134260 0x7f745c1304d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7454009e50 tx=0x7f745400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e367db5d6149bb47 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.536+0000 7f7460a69700 1 -- 172.21.15.72:0/2061485750 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745400e070 con 0x7f745c134260 2023-10-03T10:17:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.536+0000 7f7460a69700 1 -- 172.21.15.72:0/2061485750 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745400b910 con 0x7f745c134260 2023-10-03T10:17:28.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.536+0000 7f7460a69700 1 -- 172.21.15.72:0/2061485750 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745400bcc0 con 0x7f745c134260 2023-10-03T10:17:28.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.536+0000 7f7463ccf700 1 -- 172.21.15.72:0/2061485750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c134260 msgr2=0x7f745c1304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.536+0000 7f7463ccf700 1 --2- 172.21.15.72:0/2061485750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c134260 0x7f745c1304d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7454009e50 tx=0x7f745400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:28.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.536+0000 7f7463ccf700 1 -- 172.21.15.72:0/2061485750 shutdown_connections 2023-10-03T10:17:28.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.536+0000 7f7463ccf700 1 --2- 172.21.15.72:0/2061485750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c134260 0x7f745c1304d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.536+0000 7f7463ccf700 1 --2- 172.21.15.72:0/2061485750 >> v2:172.21.15.72:3300/0 conn(0x7f745c133420 0x7f745c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.536+0000 7f7463ccf700 1 --2- 172.21.15.72:0/2061485750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c133e30 0x7f745c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.536+0000 7f7463ccf700 1 -- 172.21.15.72:0/2061485750 >> 172.21.15.72:0/2061485750 conn(0x7f745c0a4210 msgr2=0x7f745c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.537+0000 7f7463ccf700 1 -- 172.21.15.72:0/2061485750 shutdown_connections 2023-10-03T10:17:28.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.537+0000 7f7463ccf700 1 -- 172.21.15.72:0/2061485750 wait complete. 2023-10-03T10:17:28.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.538+0000 7f7463ccf700 1 Processor -- start 2023-10-03T10:17:28.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.538+0000 7f7463ccf700 1 -- start start 2023-10-03T10:17:28.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f7463ccf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c133420 0x7f745c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f7463ccf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c133e30 0x7f745c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f7463ccf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c134260 0x7f745c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f7463ccf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c09dbe0 con 0x7f745c134260 2023-10-03T10:17:28.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f7463ccf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745c11ed80 con 0x7f745c133e30 2023-10-03T10:17:28.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f7463ccf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f745c131400 con 0x7f745c133420 2023-10-03T10:17:28.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f746126a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c133e30 0x7f745c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f746126a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c133e30 0x7f745c09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43094/0 (socket says 172.21.15.72:43094) 2023-10-03T10:17:28.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f746126a700 1 -- 172.21.15.72:0/1708511773 learned_addr learned my addr 172.21.15.72:0/1708511773 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:28.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f7461a6b700 1 --2- 172.21.15.72:0/1708511773 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c133420 0x7f745c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f746226c700 1 --2- 172.21.15.72:0/1708511773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c134260 0x7f745c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f7461a6b700 1 -- 172.21.15.72:0/1708511773 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c133e30 msgr2=0x7f745c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f7461a6b700 1 --2- 172.21.15.72:0/1708511773 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c133e30 0x7f745c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f7461a6b700 1 -- 172.21.15.72:0/1708511773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c134260 msgr2=0x7f745c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f7461a6b700 1 --2- 172.21.15.72:0/1708511773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c134260 0x7f745c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f7461a6b700 1 -- 172.21.15.72:0/1708511773 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7454009b30 con 0x7f745c133420 2023-10-03T10:17:28.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f746126a700 1 --2- 172.21.15.72:0/1708511773 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c133e30 0x7f745c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.539+0000 7f7461a6b700 1 --2- 172.21.15.72:0/1708511773 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c133420 0x7f745c09c480 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f745800e900 tx=0x7f745800ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.540+0000 7f74527fc700 1 -- 172.21.15.72:0/1708511773 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458013680 con 0x7f745c133420 2023-10-03T10:17:28.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.540+0000 7f74527fc700 1 -- 172.21.15.72:0/1708511773 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74580137e0 con 0x7f745c133420 2023-10-03T10:17:28.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.540+0000 7f74527fc700 1 -- 172.21.15.72:0/1708511773 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458013b50 con 0x7f745c133420 2023-10-03T10:17:28.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.540+0000 7f7463ccf700 1 -- 172.21.15.72:0/1708511773 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745c11faf0 con 0x7f745c133420 2023-10-03T10:17:28.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.540+0000 7f7463ccf700 1 -- 172.21.15.72:0/1708511773 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745c120100 con 0x7f745c133420 2023-10-03T10:17:28.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.541+0000 7f74527fc700 1 -- 172.21.15.72:0/1708511773 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7458013cb0 con 0x7f745c133420 2023-10-03T10:17:28.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.541+0000 7f74527fc700 1 -- 172.21.15.72:0/1708511773 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f745803f810 con 0x7f745c133420 2023-10-03T10:17:28.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.541+0000 7f7463ccf700 1 -- 172.21.15.72:0/1708511773 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745c074ea0 con 0x7f745c133420 2023-10-03T10:17:28.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.547+0000 7f74527fc700 1 -- 172.21.15.72:0/1708511773 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f745801be10 con 0x7f745c133420 2023-10-03T10:17:28.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.630+0000 7f8c2b510700 1 Processor -- start 2023-10-03T10:17:28.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.630+0000 7f8c2b510700 1 -- start start 2023-10-03T10:17:28.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.630+0000 7f8c2b510700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c2409d6f0 0x7f8c2409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.630+0000 7f8c2b510700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c2409e000 0x7f8c241339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.630+0000 7f8c2b510700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8c2409e410 0x7f8c24133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c2b510700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c2406b460 con 0x7f8c2409e410 2023-10-03T10:17:28.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c2b510700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2409b120 con 0x7f8c2409e000 2023-10-03T10:17:28.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c2b510700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2409a7e0 con 0x7f8c2409d6f0 2023-10-03T10:17:28.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c28aab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c2409e000 0x7f8c241339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c29aad700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8c2409e410 0x7f8c24133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c28aab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c2409e000 0x7f8c241339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43100/0 (socket says 172.21.15.72:43100) 2023-10-03T10:17:28.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c28aab700 1 -- 172.21.15.72:0/2296695079 learned_addr learned my addr 172.21.15.72:0/2296695079 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:28.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c292ac700 1 --2- 172.21.15.72:0/2296695079 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c2409d6f0 0x7f8c2409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c29aad700 1 -- 172.21.15.72:0/2296695079 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c2409d6f0 msgr2=0x7f8c2409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:28.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c29aad700 1 --2- 172.21.15.72:0/2296695079 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c2409d6f0 0x7f8c2409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c29aad700 1 -- 172.21.15.72:0/2296695079 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c2409e000 msgr2=0x7f8c241339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:28.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c29aad700 1 --2- 172.21.15.72:0/2296695079 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c2409e000 0x7f8c241339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c29aad700 1 -- 172.21.15.72:0/2296695079 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2409a500 con 0x7f8c2409e410 2023-10-03T10:17:28.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c28aab700 1 --2- 172.21.15.72:0/2296695079 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c2409e000 0x7f8c241339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c29aad700 1 --2- 172.21.15.72:0/2296695079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2409e410 0x7f8c24133f30 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009d90 tx=0x7f8c1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ad3525dc479c19 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c1bfff700 1 -- 172.21.15.72:0/2296695079 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c00e070 con 0x7f8c2409e410 2023-10-03T10:17:28.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c1bfff700 1 -- 172.21.15.72:0/2296695079 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c00bb20 con 0x7f8c2409e410 2023-10-03T10:17:28.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.631+0000 7f8c1bfff700 1 -- 172.21.15.72:0/2296695079 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c012430 con 0x7f8c2409e410 2023-10-03T10:17:28.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.632+0000 7f8c2b510700 1 -- 172.21.15.72:0/2296695079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2409e410 msgr2=0x7f8c24133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.632+0000 7f8c2b510700 1 --2- 172.21.15.72:0/2296695079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2409e410 0x7f8c24133f30 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009d90 tx=0x7f8c1c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:28.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.632+0000 7f8c2b510700 1 -- 172.21.15.72:0/2296695079 shutdown_connections 2023-10-03T10:17:28.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.632+0000 7f8c2b510700 1 --2- 172.21.15.72:0/2296695079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2409e410 0x7f8c24133f30 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.632+0000 7f8c2b510700 1 --2- 172.21.15.72:0/2296695079 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c2409d6f0 0x7f8c2409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.632+0000 7f8c2b510700 1 --2- 172.21.15.72:0/2296695079 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c2409e000 0x7f8c241339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.632+0000 7f8c2b510700 1 -- 172.21.15.72:0/2296695079 >> 172.21.15.72:0/2296695079 conn(0x7f8c24066f50 msgr2=0x7f8c2409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.632+0000 7f8c2b510700 1 -- 172.21.15.72:0/2296695079 shutdown_connections 2023-10-03T10:17:28.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.632+0000 7f8c2b510700 1 -- 172.21.15.72:0/2296695079 wait complete. 2023-10-03T10:17:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.633+0000 7f8c2b510700 1 Processor -- start 2023-10-03T10:17:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.633+0000 7f8c2b510700 1 -- start start 2023-10-03T10:17:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.633+0000 7f8c2b510700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c2409d6f0 0x7f8c241a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.633+0000 7f8c2b510700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c2409e000 0x7f8c241a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.633+0000 7f8c2b510700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2409e410 0x7f8c241c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c2b510700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c241a5c90 con 0x7f8c2409e410 2023-10-03T10:17:28.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c2b510700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c241b9140 con 0x7f8c2409d6f0 2023-10-03T10:17:28.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c2b510700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c241a4d20 con 0x7f8c2409e000 2023-10-03T10:17:28.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c292ac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c2409d6f0 0x7f8c241a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c292ac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c2409d6f0 0x7f8c241a5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43106/0 (socket says 172.21.15.72:43106) 2023-10-03T10:17:28.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c292ac700 1 -- 172.21.15.72:0/4047418972 learned_addr learned my addr 172.21.15.72:0/4047418972 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:28.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c29aad700 1 --2- 172.21.15.72:0/4047418972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2409e410 0x7f8c241c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c28aab700 1 --2- 172.21.15.72:0/4047418972 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c2409e000 0x7f8c241a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c29aad700 1 -- 172.21.15.72:0/4047418972 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c2409e000 msgr2=0x7f8c241a5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c29aad700 1 --2- 172.21.15.72:0/4047418972 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c2409e000 0x7f8c241a5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c29aad700 1 -- 172.21.15.72:0/4047418972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c2409d6f0 msgr2=0x7f8c241a5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c29aad700 1 --2- 172.21.15.72:0/4047418972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c2409d6f0 0x7f8c241a5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c29aad700 1 -- 172.21.15.72:0/4047418972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c14009550 con 0x7f8c2409e410 2023-10-03T10:17:28.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c292ac700 1 --2- 172.21.15.72:0/4047418972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c2409d6f0 0x7f8c241a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c29aad700 1 --2- 172.21.15.72:0/4047418972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2409e410 0x7f8c241c8020 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f8c2409e8b0 tx=0x7f8c1c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c19ffb700 1 -- 172.21.15.72:0/4047418972 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c004930 con 0x7f8c2409e410 2023-10-03T10:17:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c19ffb700 1 -- 172.21.15.72:0/4047418972 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c020070 con 0x7f8c2409e410 2023-10-03T10:17:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c2b510700 1 -- 172.21.15.72:0/4047418972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1c009a70 con 0x7f8c2409e410 2023-10-03T10:17:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.634+0000 7f8c19ffb700 1 -- 172.21.15.72:0/4047418972 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c0276c0 con 0x7f8c2409e410 2023-10-03T10:17:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.635+0000 7f8c2b510700 1 -- 172.21.15.72:0/4047418972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c241a7d30 con 0x7f8c2409e410 2023-10-03T10:17:28.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.635+0000 7f8c19ffb700 1 -- 172.21.15.72:0/4047418972 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c1c012430 con 0x7f8c2409e410 2023-10-03T10:17:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.635+0000 7f8c19ffb700 1 -- 172.21.15.72:0/4047418972 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c1c022070 con 0x7f8c2409e410 2023-10-03T10:17:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.636+0000 7f8c2b510700 1 -- 172.21.15.72:0/4047418972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c24074ea0 con 0x7f8c2409e410 2023-10-03T10:17:28.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.640+0000 7f8c19ffb700 1 -- 172.21.15.72:0/4047418972 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c1c003e10 con 0x7f8c2409e410 2023-10-03T10:17:28.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.660+0000 7fac9bf19700 1 Processor -- start 2023-10-03T10:17:28.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.661+0000 7fac9bf19700 1 -- start start 2023-10-03T10:17:28.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.661+0000 7fac9bf19700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac9409e1d0 0x7fac94135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.661+0000 7fac9bf19700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac94135e50 0x7fac94138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.661+0000 7fac9bf19700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9409f130 con 0x7fac9409d6f0 2023-10-03T10:17:28.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.661+0000 7fac9bf19700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9409f520 con 0x7fac94135e50 2023-10-03T10:17:28.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.661+0000 7fac9bf19700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac9409e930 con 0x7fac9409e1d0 2023-10-03T10:17:28.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.661+0000 7fac994b4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac9409e1d0 0x7fac94135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.661+0000 7fac99cb5700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fac9409d6f0 0x7fac9409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48422/0 (socket says 172.21.15.72:48422) 2023-10-03T10:17:28.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.661+0000 7fac99cb5700 1 -- 172.21.15.72:0/3361075044 learned_addr learned my addr 172.21.15.72:0/3361075044 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:28.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.661+0000 7fac9a4b6700 1 --2- 172.21.15.72:0/3361075044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac94135e50 0x7fac94138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.662+0000 7fac994b4700 1 -- 172.21.15.72:0/3361075044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac94135e50 msgr2=0x7fac94138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:28.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.662+0000 7fac994b4700 1 --2- 172.21.15.72:0/3361075044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac94135e50 0x7fac94138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.662+0000 7fac994b4700 1 -- 172.21.15.72:0/3361075044 >> v1:172.21.15.72:6789/0 conn(0x7fac9409d6f0 legacy=0x7fac9409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.662+0000 7fac98cb3700 1 -- 172.21.15.72:0/3361075044 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196144823 0 0) 0x7fac9409f130 con 0x7fac9409d6f0 2023-10-03T10:17:28.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.662+0000 7fac994b4700 1 -- 172.21.15.72:0/3361075044 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9409b2d0 con 0x7fac9409e1d0 2023-10-03T10:17:28.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.662+0000 7fac9a4b6700 1 --2- 172.21.15.72:0/3361075044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac94135e50 0x7fac94138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.662+0000 7fac994b4700 1 --2- 172.21.15.72:0/3361075044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac9409e1d0 0x7fac94135910 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fac84009870 tx=0x7fac84009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8039ce73255cd550 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.662+0000 7fac98cb3700 1 -- 172.21.15.72:0/3361075044 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84011830 con 0x7fac9409e1d0 2023-10-03T10:17:28.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.662+0000 7fac98cb3700 1 -- 172.21.15.72:0/3361075044 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac84011990 con 0x7fac9409e1d0 2023-10-03T10:17:28.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.662+0000 7fac98cb3700 1 -- 172.21.15.72:0/3361075044 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84011d20 con 0x7fac9409e1d0 2023-10-03T10:17:28.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.662+0000 7fac9bf19700 1 -- 172.21.15.72:0/3361075044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac9409e1d0 msgr2=0x7fac94135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.662+0000 7fac9bf19700 1 --2- 172.21.15.72:0/3361075044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac9409e1d0 0x7fac94135910 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fac84009870 tx=0x7fac84009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:28.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.663+0000 7fac9bf19700 1 -- 172.21.15.72:0/3361075044 shutdown_connections 2023-10-03T10:17:28.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.663+0000 7fac9bf19700 1 --2- 172.21.15.72:0/3361075044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac94135e50 0x7fac94138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.663+0000 7fac9bf19700 1 --2- 172.21.15.72:0/3361075044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac9409e1d0 0x7fac94135910 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.663+0000 7fac9bf19700 1 -- 172.21.15.72:0/3361075044 >> 172.21.15.72:0/3361075044 conn(0x7fac94066f50 msgr2=0x7fac9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.663+0000 7fac9bf19700 1 -- 172.21.15.72:0/3361075044 shutdown_connections 2023-10-03T10:17:28.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.663+0000 7fac9bf19700 1 -- 172.21.15.72:0/3361075044 wait complete. 2023-10-03T10:17:28.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac9bf19700 1 Processor -- start 2023-10-03T10:17:28.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac9bf19700 1 -- start start 2023-10-03T10:17:28.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac9bf19700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac9409d6f0 0x7fac94119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac9bf19700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac9409e1d0 0x7fac941199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac9bf19700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac94135e50 0x7fac94119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:28.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac9bf19700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9412fcf0 con 0x7fac9409e1d0 2023-10-03T10:17:28.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac9bf19700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9411aee0 con 0x7fac94135e50 2023-10-03T10:17:28.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac9bf19700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac94130070 con 0x7fac9409d6f0 2023-10-03T10:17:28.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac994b4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac9409e1d0 0x7fac941199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac994b4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac9409e1d0 0x7fac941199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57244/0 (socket says 172.21.15.72:57244) 2023-10-03T10:17:28.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac994b4700 1 -- 172.21.15.72:0/3266073935 learned_addr learned my addr 172.21.15.72:0/3266073935 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:28.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac9a4b6700 1 --2- 172.21.15.72:0/3266073935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac94135e50 0x7fac94119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac99cb5700 1 --2- 172.21.15.72:0/3266073935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac9409d6f0 0x7fac94119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:28.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac994b4700 1 -- 172.21.15.72:0/3266073935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac9409d6f0 msgr2=0x7fac94119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac994b4700 1 --2- 172.21.15.72:0/3266073935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac9409d6f0 0x7fac94119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac994b4700 1 -- 172.21.15.72:0/3266073935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac94135e50 msgr2=0x7fac94119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac994b4700 1 --2- 172.21.15.72:0/3266073935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac94135e50 0x7fac94119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac994b4700 1 -- 172.21.15.72:0/3266073935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c009a70 con 0x7fac9409e1d0 2023-10-03T10:17:28.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.664+0000 7fac9a4b6700 1 --2- 172.21.15.72:0/3266073935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac94135e50 0x7fac94119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:28.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.665+0000 7fac994b4700 1 --2- 172.21.15.72:0/3266073935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac9409e1d0 0x7fac941199c0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fac84009840 tx=0x7fac84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:28.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.665+0000 7fac8a7fc700 1 -- 172.21.15.72:0/3266073935 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840044d0 con 0x7fac9409e1d0 2023-10-03T10:17:28.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.665+0000 7fac8a7fc700 1 -- 172.21.15.72:0/3266073935 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8401f070 con 0x7fac9409e1d0 2023-10-03T10:17:28.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.665+0000 7fac9bf19700 1 -- 172.21.15.72:0/3266073935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac840094a0 con 0x7fac9409e1d0 2023-10-03T10:17:28.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.665+0000 7fac8a7fc700 1 -- 172.21.15.72:0/3266073935 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840038e0 con 0x7fac9409e1d0 2023-10-03T10:17:28.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.665+0000 7fac9bf19700 1 -- 172.21.15.72:0/3266073935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9411c450 con 0x7fac9409e1d0 2023-10-03T10:17:28.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.666+0000 7fac8a7fc700 1 -- 172.21.15.72:0/3266073935 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac84003a40 con 0x7fac9409e1d0 2023-10-03T10:17:28.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.666+0000 7fac8a7fc700 1 -- 172.21.15.72:0/3266073935 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fac84021070 con 0x7fac9409e1d0 2023-10-03T10:17:28.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.666+0000 7fac9bf19700 1 -- 172.21.15.72:0/3266073935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac94074ea0 con 0x7fac9409e1d0 2023-10-03T10:17:28.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.671+0000 7fac8a7fc700 1 -- 172.21.15.72:0/3266073935 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac8402b070 con 0x7fac9409e1d0 2023-10-03T10:17:28.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.762+0000 7f7463ccf700 1 -- 172.21.15.72:0/1708511773 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f745c11fd10 con 0x7f745c133420 2023-10-03T10:17:28.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.762+0000 7f74527fc700 1 -- 172.21.15.72:0/1708511773 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f745802a090 con 0x7f745c133420 2023-10-03T10:17:28.762 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:28.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.764+0000 7f7463ccf700 1 -- 172.21.15.72:0/1708511773 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c133420 msgr2=0x7f745c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.764+0000 7f7463ccf700 1 --2- 172.21.15.72:0/1708511773 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c133420 0x7f745c09c480 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f745800e900 tx=0x7f745800ec10 comp rx=0 tx=0).stop 2023-10-03T10:17:28.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.764+0000 7f7463ccf700 1 -- 172.21.15.72:0/1708511773 shutdown_connections 2023-10-03T10:17:28.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.764+0000 7f7463ccf700 1 --2- 172.21.15.72:0/1708511773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c134260 0x7f745c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.764+0000 7f7463ccf700 1 --2- 172.21.15.72:0/1708511773 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c133420 0x7f745c09c480 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.764+0000 7f7463ccf700 1 --2- 172.21.15.72:0/1708511773 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c133e30 0x7f745c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.764+0000 7f7463ccf700 1 -- 172.21.15.72:0/1708511773 >> 172.21.15.72:0/1708511773 conn(0x7f745c0a4210 msgr2=0x7f745c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.764+0000 7f7463ccf700 1 -- 172.21.15.72:0/1708511773 shutdown_connections 2023-10-03T10:17:28.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.764+0000 7f7463ccf700 1 -- 172.21.15.72:0/1708511773 wait complete. 2023-10-03T10:17:28.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:28.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.834+0000 7f8c2b510700 1 -- 172.21.15.72:0/4047418972 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8c241a7030 con 0x7f8c2409e410 2023-10-03T10:17:28.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.835+0000 7f8c19ffb700 1 -- 172.21.15.72:0/4047418972 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8c1c02c030 con 0x7f8c2409e410 2023-10-03T10:17:28.834 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:28.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.837+0000 7f8c2b510700 1 -- 172.21.15.72:0/4047418972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2409e410 msgr2=0x7f8c241c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.837+0000 7f8c2b510700 1 --2- 172.21.15.72:0/4047418972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2409e410 0x7f8c241c8020 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f8c2409e8b0 tx=0x7f8c1c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.837+0000 7f8c2b510700 1 -- 172.21.15.72:0/4047418972 shutdown_connections 2023-10-03T10:17:28.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.837+0000 7f8c2b510700 1 --2- 172.21.15.72:0/4047418972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c2409e410 0x7f8c241c8020 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.837+0000 7f8c2b510700 1 --2- 172.21.15.72:0/4047418972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c2409d6f0 0x7f8c241a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.837+0000 7f8c2b510700 1 --2- 172.21.15.72:0/4047418972 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c2409e000 0x7f8c241a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.837+0000 7f8c2b510700 1 -- 172.21.15.72:0/4047418972 >> 172.21.15.72:0/4047418972 conn(0x7f8c24066f50 msgr2=0x7f8c241bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.837+0000 7f8c2b510700 1 -- 172.21.15.72:0/4047418972 shutdown_connections 2023-10-03T10:17:28.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.837+0000 7f8c2b510700 1 -- 172.21.15.72:0/4047418972 wait complete. 2023-10-03T10:17:28.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:28.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.868+0000 7fac9bf19700 1 -- 172.21.15.72:0/3266073935 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fac9406c360 con 0x7fac9409e1d0 2023-10-03T10:17:28.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.869+0000 7fac8a7fc700 1 -- 172.21.15.72:0/3266073935 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac84015030 con 0x7fac9409e1d0 2023-10-03T10:17:28.868 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:28.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.871+0000 7fac9bf19700 1 -- 172.21.15.72:0/3266073935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac9409e1d0 msgr2=0x7fac941199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.871+0000 7fac9bf19700 1 --2- 172.21.15.72:0/3266073935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac9409e1d0 0x7fac941199c0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fac84009840 tx=0x7fac84004750 comp rx=0 tx=0).stop 2023-10-03T10:17:28.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.871+0000 7fac9bf19700 1 -- 172.21.15.72:0/3266073935 shutdown_connections 2023-10-03T10:17:28.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.871+0000 7fac9bf19700 1 --2- 172.21.15.72:0/3266073935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac94135e50 0x7fac94119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.871+0000 7fac9bf19700 1 --2- 172.21.15.72:0/3266073935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac9409d6f0 0x7fac94119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.871+0000 7fac9bf19700 1 --2- 172.21.15.72:0/3266073935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac9409e1d0 0x7fac941199c0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.871+0000 7fac9bf19700 1 -- 172.21.15.72:0/3266073935 >> 172.21.15.72:0/3266073935 conn(0x7fac94066f50 msgr2=0x7fac941327f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.871+0000 7fac9bf19700 1 -- 172.21.15.72:0/3266073935 shutdown_connections 2023-10-03T10:17:28.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:28.871+0000 7fac9bf19700 1 -- 172.21.15.72:0/3266073935 wait complete. 2023-10-03T10:17:28.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:29.359 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:29.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.483+0000 7f2ca3c1c700 1 Processor -- start 2023-10-03T10:17:29.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca3c1c700 1 -- start start 2023-10-03T10:17:29.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca3c1c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c9c09d6f0 0x7f2c9c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca3c1c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c9c09e000 0x7f2c9c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca3c1c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c9c09b120 con 0x7f2c9c09e410 2023-10-03T10:17:29.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca3c1c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c9c06b460 con 0x7f2c9c09e000 2023-10-03T10:17:29.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca3c1c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c09a7e0 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca11b7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c9c09e000 0x7f2c9c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca19b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c9c09d6f0 0x7f2c9c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca11b7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c9c09e000 0x7f2c9c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57252/0 (socket says 172.21.15.72:57252) 2023-10-03T10:17:29.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca19b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c9c09d6f0 0x7f2c9c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43136/0 (socket says 172.21.15.72:43136) 2023-10-03T10:17:29.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca11b7700 1 -- 172.21.15.72:0/1402442844 learned_addr learned my addr 172.21.15.72:0/1402442844 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:29.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca19b8700 1 -- 172.21.15.72:0/1402442844 >> v2:172.21.15.72:3300/0 conn(0x7f2c9c09e000 msgr2=0x7f2c9c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca19b8700 1 --2- 172.21.15.72:0/1402442844 >> v2:172.21.15.72:3300/0 conn(0x7f2c9c09e000 0x7f2c9c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca19b8700 1 -- 172.21.15.72:0/1402442844 >> v1:172.21.15.72:6789/0 conn(0x7f2c9c09e410 legacy=0x7f2c9c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca19b8700 1 -- 172.21.15.72:0/1402442844 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9c09a500 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.484+0000 7f2ca11b7700 1 --2- 172.21.15.72:0/1402442844 >> v2:172.21.15.72:3300/0 conn(0x7f2c9c09e000 0x7f2c9c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.485+0000 7f2ca19b8700 1 --2- 172.21.15.72:0/1402442844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c9c09d6f0 0x7f2c9c09dac0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009870 tx=0x7f2c90009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fbde8afbafc00c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.485+0000 7f2ca09b6700 1 -- 172.21.15.72:0/1402442844 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90011830 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.485+0000 7f2ca09b6700 1 -- 172.21.15.72:0/1402442844 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c90011990 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.485+0000 7f2ca09b6700 1 -- 172.21.15.72:0/1402442844 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90011d20 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.485+0000 7f2ca3c1c700 1 -- 172.21.15.72:0/1402442844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c9c09d6f0 msgr2=0x7f2c9c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.485+0000 7f2ca3c1c700 1 --2- 172.21.15.72:0/1402442844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c9c09d6f0 0x7f2c9c09dac0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009870 tx=0x7f2c90009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:29.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.485+0000 7f2ca3c1c700 1 -- 172.21.15.72:0/1402442844 shutdown_connections 2023-10-03T10:17:29.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.485+0000 7f2ca3c1c700 1 --2- 172.21.15.72:0/1402442844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c9c09d6f0 0x7f2c9c09dac0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.485+0000 7f2ca3c1c700 1 --2- 172.21.15.72:0/1402442844 >> v2:172.21.15.72:3300/0 conn(0x7f2c9c09e000 0x7f2c9c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.485+0000 7f2ca3c1c700 1 -- 172.21.15.72:0/1402442844 >> 172.21.15.72:0/1402442844 conn(0x7f2c9c066f50 msgr2=0x7f2c9c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.485+0000 7f2ca3c1c700 1 -- 172.21.15.72:0/1402442844 shutdown_connections 2023-10-03T10:17:29.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.485+0000 7f2ca3c1c700 1 -- 172.21.15.72:0/1402442844 wait complete. 2023-10-03T10:17:29.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.486+0000 7f2ca3c1c700 1 Processor -- start 2023-10-03T10:17:29.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.486+0000 7f2ca3c1c700 1 -- start start 2023-10-03T10:17:29.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca3c1c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9c09d6f0 0x7f2c9c1a4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca3c1c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c09e000 0x7f2c9c1a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca3c1c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c9c09e410 0x7f2c9c1a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca3c1c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c1a6ae0 con 0x7f2c9c09e000 2023-10-03T10:17:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca3c1c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c1a7d30 con 0x7f2c9c09e410 2023-10-03T10:17:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca3c1c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c1a70d0 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca19b8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9c09d6f0 0x7f2c9c1a4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca11b7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c09e000 0x7f2c9c1a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca21b9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c9c09e410 0x7f2c9c1a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca19b8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9c09d6f0 0x7f2c9c1a4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37884/0 (socket says 172.21.15.72:37884) 2023-10-03T10:17:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca11b7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c09e000 0x7f2c9c1a54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57266/0 (socket says 172.21.15.72:57266) 2023-10-03T10:17:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca19b8700 1 -- 172.21.15.72:0/3627272063 learned_addr learned my addr 172.21.15.72:0/3627272063 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca19b8700 1 -- 172.21.15.72:0/3627272063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c9c09e410 msgr2=0x7f2c9c1a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca19b8700 1 --2- 172.21.15.72:0/3627272063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c9c09e410 0x7f2c9c1a59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca19b8700 1 -- 172.21.15.72:0/3627272063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c09e000 msgr2=0x7f2c9c1a54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca19b8700 1 --2- 172.21.15.72:0/3627272063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c09e000 0x7f2c9c1a54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca19b8700 1 -- 172.21.15.72:0/3627272063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c98009550 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca19b8700 1 --2- 172.21.15.72:0/3627272063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9c09d6f0 0x7f2c9c1a4f60 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2c90000c00 tx=0x7f2c90004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2c8e7fc700 1 -- 172.21.15.72:0/3627272063 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c900036a0 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2c8e7fc700 1 -- 172.21.15.72:0/3627272063 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9001f070 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca3c1c700 1 -- 172.21.15.72:0/3627272063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c900094a0 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2c8e7fc700 1 -- 172.21.15.72:0/3627272063 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90003a60 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.487+0000 7f2ca3c1c700 1 -- 172.21.15.72:0/3627272063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9c09c710 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.488+0000 7f2ca3c1c700 1 -- 172.21.15.72:0/3627272063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c9c074ea0 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.489+0000 7f2c8e7fc700 1 -- 172.21.15.72:0/3627272063 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c90003bc0 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.489+0000 7f2c8e7fc700 1 -- 172.21.15.72:0/3627272063 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2c90021070 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.493+0000 7f2c8e7fc700 1 -- 172.21.15.72:0/3627272063 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c900193b0 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.680+0000 7f2ca3c1c700 1 -- 172.21.15.72:0/3627272063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2c9c06c360 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.681+0000 7f2c8e7fc700 1 -- 172.21.15.72:0/3627272063 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c90025bd0 con 0x7f2c9c09d6f0 2023-10-03T10:17:29.680 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:29.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.683+0000 7f2ca3c1c700 1 -- 172.21.15.72:0/3627272063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9c09d6f0 msgr2=0x7f2c9c1a4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.683+0000 7f2ca3c1c700 1 --2- 172.21.15.72:0/3627272063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9c09d6f0 0x7f2c9c1a4f60 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2c90000c00 tx=0x7f2c90004750 comp rx=0 tx=0).stop 2023-10-03T10:17:29.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.683+0000 7f2ca3c1c700 1 -- 172.21.15.72:0/3627272063 shutdown_connections 2023-10-03T10:17:29.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.683+0000 7f2ca3c1c700 1 --2- 172.21.15.72:0/3627272063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c9c09e410 0x7f2c9c1a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.683+0000 7f2ca3c1c700 1 --2- 172.21.15.72:0/3627272063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9c09d6f0 0x7f2c9c1a4f60 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.683+0000 7f2ca3c1c700 1 --2- 172.21.15.72:0/3627272063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9c09e000 0x7f2c9c1a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.683+0000 7f2ca3c1c700 1 -- 172.21.15.72:0/3627272063 >> 172.21.15.72:0/3627272063 conn(0x7f2c9c066f50 msgr2=0x7f2c9c1bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.683+0000 7f2ca3c1c700 1 -- 172.21.15.72:0/3627272063 shutdown_connections 2023-10-03T10:17:29.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.683+0000 7f2ca3c1c700 1 -- 172.21.15.72:0/3627272063 wait complete. 2023-10-03T10:17:29.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:29.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:29.849 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:29.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:29.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.903+0000 7fe736e08700 1 Processor -- start 2023-10-03T10:17:29.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.903+0000 7fe736e08700 1 -- start start 2023-10-03T10:17:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.903+0000 7fe736e08700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe73009d6f0 0x7fe73009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.903+0000 7fe736e08700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe73009e000 0x7fe730130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.903+0000 7fe736e08700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73009e410 0x7fe730130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.903+0000 7fe736e08700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73009f520 con 0x7fe73009e000 2023-10-03T10:17:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.903+0000 7fe736e08700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73009f130 con 0x7fe73009e410 2023-10-03T10:17:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.903+0000 7fe736e08700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe73009e930 con 0x7fe73009d6f0 2023-10-03T10:17:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.903+0000 7fe734ba4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe73009d6f0 0x7fe73009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.903+0000 7fe734ba4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe73009d6f0 0x7fe73009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37892/0 (socket says 172.21.15.72:37892) 2023-10-03T10:17:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.903+0000 7fe734ba4700 1 -- 172.21.15.72:0/1142761199 learned_addr learned my addr 172.21.15.72:0/1142761199 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.903+0000 7fe72ffff700 1 --2- 172.21.15.72:0/1142761199 >> v2:172.21.15.72:3300/0 conn(0x7fe73009e000 0x7fe730130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.904+0000 7fe7353a5700 1 --2- 172.21.15.72:0/1142761199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73009e410 0x7fe730130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.904+0000 7fe734ba4700 1 -- 172.21.15.72:0/1142761199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73009e410 msgr2=0x7fe730130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.904+0000 7fe734ba4700 1 --2- 172.21.15.72:0/1142761199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73009e410 0x7fe730130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.904+0000 7fe734ba4700 1 -- 172.21.15.72:0/1142761199 >> v2:172.21.15.72:3300/0 conn(0x7fe73009e000 msgr2=0x7fe730130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.904+0000 7fe734ba4700 1 --2- 172.21.15.72:0/1142761199 >> v2:172.21.15.72:3300/0 conn(0x7fe73009e000 0x7fe730130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.904+0000 7fe734ba4700 1 -- 172.21.15.72:0/1142761199 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73009b2d0 con 0x7fe73009d6f0 2023-10-03T10:17:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.904+0000 7fe72ffff700 1 --2- 172.21.15.72:0/1142761199 >> v2:172.21.15.72:3300/0 conn(0x7fe73009e000 0x7fe730130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.904+0000 7fe734ba4700 1 --2- 172.21.15.72:0/1142761199 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe73009d6f0 0x7fe73009dac0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe724009920 tx=0x7fe724009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eda25106c088658 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.904+0000 7fe72f7fe700 1 -- 172.21.15.72:0/1142761199 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe724011830 con 0x7fe73009d6f0 2023-10-03T10:17:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.904+0000 7fe72f7fe700 1 -- 172.21.15.72:0/1142761199 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe724011990 con 0x7fe73009d6f0 2023-10-03T10:17:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.904+0000 7fe72f7fe700 1 -- 172.21.15.72:0/1142761199 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe724011d20 con 0x7fe73009d6f0 2023-10-03T10:17:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.905+0000 7fe736e08700 1 -- 172.21.15.72:0/1142761199 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe73009d6f0 msgr2=0x7fe73009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.905+0000 7fe736e08700 1 --2- 172.21.15.72:0/1142761199 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe73009d6f0 0x7fe73009dac0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe724009920 tx=0x7fe724009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.905+0000 7fe736e08700 1 -- 172.21.15.72:0/1142761199 shutdown_connections 2023-10-03T10:17:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.905+0000 7fe736e08700 1 --2- 172.21.15.72:0/1142761199 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73009e410 0x7fe730130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.905+0000 7fe736e08700 1 --2- 172.21.15.72:0/1142761199 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe73009d6f0 0x7fe73009dac0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.905+0000 7fe736e08700 1 --2- 172.21.15.72:0/1142761199 >> v2:172.21.15.72:3300/0 conn(0x7fe73009e000 0x7fe730130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.905+0000 7fe736e08700 1 -- 172.21.15.72:0/1142761199 >> 172.21.15.72:0/1142761199 conn(0x7fe730066f50 msgr2=0x7fe73009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.905+0000 7fe736e08700 1 -- 172.21.15.72:0/1142761199 shutdown_connections 2023-10-03T10:17:29.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.905+0000 7fe736e08700 1 -- 172.21.15.72:0/1142761199 wait complete. 2023-10-03T10:17:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.906+0000 7fe736e08700 1 Processor -- start 2023-10-03T10:17:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.906+0000 7fe736e08700 1 -- start start 2023-10-03T10:17:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe736e08700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73009d6f0 0x7fe73011e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe736e08700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe73009e000 0x7fe73011e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe736e08700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73009e410 0x7fe73011ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe736e08700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe730121350 con 0x7fe73009e410 2023-10-03T10:17:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe736e08700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73011fc80 con 0x7fe73009d6f0 2023-10-03T10:17:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe736e08700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe730130140 con 0x7fe73009e000 2023-10-03T10:17:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe72ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe73009e000 0x7fe73011e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe734ba4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73009d6f0 0x7fe73011e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe72ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe73009e000 0x7fe73011e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37898/0 (socket says 172.21.15.72:37898) 2023-10-03T10:17:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe734ba4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73009d6f0 0x7fe73011e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43158/0 (socket says 172.21.15.72:43158) 2023-10-03T10:17:29.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe72ffff700 1 -- 172.21.15.72:0/3068207717 learned_addr learned my addr 172.21.15.72:0/3068207717 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe72ffff700 1 -- 172.21.15.72:0/3068207717 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73009d6f0 msgr2=0x7fe73011e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe72ffff700 1 --2- 172.21.15.72:0/3068207717 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73009d6f0 0x7fe73011e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe72ffff700 1 -- 172.21.15.72:0/3068207717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73009e410 msgr2=0x7fe73011ec30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe72ffff700 1 --2- 172.21.15.72:0/3068207717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73009e410 0x7fe73011ec30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe72ffff700 1 -- 172.21.15.72:0/3068207717 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c0094a0 con 0x7fe73009e000 2023-10-03T10:17:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe734ba4700 1 --2- 172.21.15.72:0/3068207717 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73009d6f0 0x7fe73011e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.907+0000 7fe72ffff700 1 --2- 172.21.15.72:0/3068207717 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe73009e000 0x7fe73011e6f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00ebb0 tx=0x7fe71c00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.908+0000 7fe72d7fa700 1 -- 172.21.15.72:0/3068207717 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c00c850 con 0x7fe73009e000 2023-10-03T10:17:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.908+0000 7fe72d7fa700 1 -- 172.21.15.72:0/3068207717 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c00c9b0 con 0x7fe73009e000 2023-10-03T10:17:29.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.908+0000 7fe72d7fa700 1 -- 172.21.15.72:0/3068207717 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c00cd40 con 0x7fe73009e000 2023-10-03T10:17:29.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.908+0000 7fe736e08700 1 -- 172.21.15.72:0/3068207717 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe724009550 con 0x7fe73009e000 2023-10-03T10:17:29.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.908+0000 7fe736e08700 1 -- 172.21.15.72:0/3068207717 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73009c700 con 0x7fe73009e000 2023-10-03T10:17:29.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.909+0000 7fe72d7fa700 1 -- 172.21.15.72:0/3068207717 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe71c013470 con 0x7fe73009e000 2023-10-03T10:17:29.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.909+0000 7fe736e08700 1 -- 172.21.15.72:0/3068207717 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe730121540 con 0x7fe73009e000 2023-10-03T10:17:29.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.909+0000 7fe72d7fa700 1 -- 172.21.15.72:0/3068207717 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe71c03fb30 con 0x7fe73009e000 2023-10-03T10:17:29.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.914+0000 7fe72d7fa700 1 -- 172.21.15.72:0/3068207717 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe71c01b3b0 con 0x7fe73009e000 2023-10-03T10:17:29.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.977+0000 7f0de7b8a700 1 Processor -- start 2023-10-03T10:17:29.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.977+0000 7f0de7b8a700 1 -- start start 2023-10-03T10:17:29.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.978+0000 7f0de7b8a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0de0133420 0x7f0de01337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.978+0000 7f0de7b8a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0de0134260 0x7f0de01306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.978+0000 7f0de7b8a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de006b990 con 0x7f0de0133e30 2023-10-03T10:17:29.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.978+0000 7f0de7b8a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de00a0590 con 0x7f0de0134260 2023-10-03T10:17:29.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.978+0000 7f0de7b8a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de009fb80 con 0x7f0de0133420 2023-10-03T10:17:29.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.978+0000 7f0de6127700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0de0134260 0x7f0de01306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.978+0000 7f0de6127700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0de0134260 0x7f0de01306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57296/0 (socket says 172.21.15.72:57296) 2023-10-03T10:17:29.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.978+0000 7f0de6127700 1 -- 172.21.15.72:0/3778961409 learned_addr learned my addr 172.21.15.72:0/3778961409 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:29.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.978+0000 7f0de5926700 1 --2- 172.21.15.72:0/3778961409 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0de0133420 0x7f0de01337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.978+0000 7f0de5926700 1 -- 172.21.15.72:0/3778961409 >> v2:172.21.15.72:3300/0 conn(0x7f0de0134260 msgr2=0x7f0de01306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.978+0000 7f0de5926700 1 --2- 172.21.15.72:0/3778961409 >> v2:172.21.15.72:3300/0 conn(0x7f0de0134260 0x7f0de01306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.978+0000 7f0de5926700 1 -- 172.21.15.72:0/3778961409 >> v1:172.21.15.72:6789/0 conn(0x7f0de0133e30 legacy=0x7f0de012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.978+0000 7f0de5926700 1 -- 172.21.15.72:0/3778961409 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de00a0030 con 0x7f0de0133420 2023-10-03T10:17:29.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.978+0000 7f0de6127700 1 --2- 172.21.15.72:0/3778961409 >> v2:172.21.15.72:3300/0 conn(0x7f0de0134260 0x7f0de01306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.979+0000 7f0de5926700 1 --2- 172.21.15.72:0/3778961409 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0de0133420 0x7f0de01337f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009840 tx=0x7f0ddc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f149f792991b791 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.979+0000 7f0de4924700 1 -- 172.21.15.72:0/3778961409 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc011830 con 0x7f0de0133420 2023-10-03T10:17:29.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.979+0000 7f0de4924700 1 -- 172.21.15.72:0/3778961409 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc011990 con 0x7f0de0133420 2023-10-03T10:17:29.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.979+0000 7f0de4924700 1 -- 172.21.15.72:0/3778961409 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc011d20 con 0x7f0de0133420 2023-10-03T10:17:29.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.979+0000 7f0de7b8a700 1 -- 172.21.15.72:0/3778961409 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0de0133420 msgr2=0x7f0de01337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.979+0000 7f0de7b8a700 1 --2- 172.21.15.72:0/3778961409 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0de0133420 0x7f0de01337f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009840 tx=0x7f0ddc009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:29.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.979+0000 7f0de7b8a700 1 -- 172.21.15.72:0/3778961409 shutdown_connections 2023-10-03T10:17:29.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.979+0000 7f0de7b8a700 1 --2- 172.21.15.72:0/3778961409 >> v2:172.21.15.72:3300/0 conn(0x7f0de0134260 0x7f0de01306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.979+0000 7f0de7b8a700 1 --2- 172.21.15.72:0/3778961409 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0de0133420 0x7f0de01337f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.979+0000 7f0de7b8a700 1 -- 172.21.15.72:0/3778961409 >> 172.21.15.72:0/3778961409 conn(0x7f0de00a4210 msgr2=0x7f0de00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.979+0000 7f0de7b8a700 1 -- 172.21.15.72:0/3778961409 shutdown_connections 2023-10-03T10:17:29.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.980+0000 7f0de7b8a700 1 -- 172.21.15.72:0/3778961409 wait complete. 2023-10-03T10:17:29.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.980+0000 7f0de7b8a700 1 Processor -- start 2023-10-03T10:17:29.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.980+0000 7f0de7b8a700 1 -- start start 2023-10-03T10:17:29.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de7b8a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0de0133420 0x7f0de00709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de7b8a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de0133e30 0x7f0de0070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de7b8a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0de0134260 0x7f0de0071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de7b8a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de012d570 con 0x7f0de0133e30 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de7b8a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de012dae0 con 0x7f0de0133420 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de7b8a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0de0072340 con 0x7f0de0134260 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de5125700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de0133e30 0x7f0de0070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de5926700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0de0133420 0x7f0de00709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de5125700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de0133e30 0x7f0de0070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57298/0 (socket says 172.21.15.72:57298) 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de5125700 1 -- 172.21.15.72:0/1547915852 learned_addr learned my addr 172.21.15.72:0/1547915852 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de6127700 1 --2- 172.21.15.72:0/1547915852 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0de0134260 0x7f0de0071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de5926700 1 -- 172.21.15.72:0/1547915852 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0de0134260 msgr2=0x7f0de0071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de5926700 1 --2- 172.21.15.72:0/1547915852 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0de0134260 0x7f0de0071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de5926700 1 -- 172.21.15.72:0/1547915852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de0133e30 msgr2=0x7f0de0070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de5926700 1 --2- 172.21.15.72:0/1547915852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de0133e30 0x7f0de0070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.981+0000 7f0de5926700 1 -- 172.21.15.72:0/1547915852 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd8009b30 con 0x7f0de0133420 2023-10-03T10:17:29.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.982+0000 7f0de5926700 1 --2- 172.21.15.72:0/1547915852 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0de0133420 0x7f0de00709a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0de006e650 tx=0x7f0ddc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.982+0000 7f0dd67fc700 1 -- 172.21.15.72:0/1547915852 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc004400 con 0x7f0de0133420 2023-10-03T10:17:29.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.982+0000 7f0dd67fc700 1 -- 172.21.15.72:0/1547915852 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc01f070 con 0x7f0de0133420 2023-10-03T10:17:29.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.982+0000 7f0de7b8a700 1 -- 172.21.15.72:0/1547915852 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc0094a0 con 0x7f0de0133420 2023-10-03T10:17:29.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.982+0000 7f0dd67fc700 1 -- 172.21.15.72:0/1547915852 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc0038e0 con 0x7f0de0133420 2023-10-03T10:17:29.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.982+0000 7f0de7b8a700 1 -- 172.21.15.72:0/1547915852 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de0131980 con 0x7f0de0133420 2023-10-03T10:17:29.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.983+0000 7f0dd67fc700 1 -- 172.21.15.72:0/1547915852 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ddc021030 con 0x7f0de0133420 2023-10-03T10:17:29.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.983+0000 7f0dd67fc700 1 -- 172.21.15.72:0/1547915852 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0ddc040860 con 0x7f0de0133420 2023-10-03T10:17:29.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.983+0000 7f0de7b8a700 1 -- 172.21.15.72:0/1547915852 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de0074ea0 con 0x7f0de0133420 2023-10-03T10:17:29.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:29.992+0000 7f0dd67fc700 1 -- 172.21.15.72:0/1547915852 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ddc010970 con 0x7f0de0133420 2023-10-03T10:17:30.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.023+0000 7fc34ceb9700 1 Processor -- start 2023-10-03T10:17:30.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.023+0000 7fc34ceb9700 1 -- start start 2023-10-03T10:17:30.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc34ceb9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc34809e1d0 0x7fc348135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc34ceb9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc348135e50 0x7fc348138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc34ceb9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34809f130 con 0x7fc34809d6f0 2023-10-03T10:17:30.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc34ceb9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34809f520 con 0x7fc34809e1d0 2023-10-03T10:17:30.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc34ceb9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc34809e930 con 0x7fc348135e50 2023-10-03T10:17:30.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc345d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc34809e1d0 0x7fc348135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc345d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc34809e1d0 0x7fc348135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57314/0 (socket says 172.21.15.72:57314) 2023-10-03T10:17:30.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc345d9b700 1 -- 172.21.15.72:0/1391264094 learned_addr learned my addr 172.21.15.72:0/1391264094 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:30.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc346d9d700 1 --2- 172.21.15.72:0/1391264094 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc348135e50 0x7fc348138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc345d9b700 1 -- 172.21.15.72:0/1391264094 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc348135e50 msgr2=0x7fc348138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:30.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc345d9b700 1 --2- 172.21.15.72:0/1391264094 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc348135e50 0x7fc348138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc345d9b700 1 -- 172.21.15.72:0/1391264094 >> v1:172.21.15.72:6789/0 conn(0x7fc34809d6f0 legacy=0x7fc34809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc345d9b700 1 -- 172.21.15.72:0/1391264094 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34809b2d0 con 0x7fc34809e1d0 2023-10-03T10:17:30.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc345d9b700 1 --2- 172.21.15.72:0/1391264094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34809e1d0 0x7fc348135910 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0098f0 tx=0x7fc33c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e6756a1ab6966f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc34559a700 1 -- 172.21.15.72:0/1391264094 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c011830 con 0x7fc34809e1d0 2023-10-03T10:17:30.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc34559a700 1 -- 172.21.15.72:0/1391264094 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c011990 con 0x7fc34809e1d0 2023-10-03T10:17:30.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.024+0000 7fc34559a700 1 -- 172.21.15.72:0/1391264094 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c011d20 con 0x7fc34809e1d0 2023-10-03T10:17:30.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.025+0000 7fc34ceb9700 1 -- 172.21.15.72:0/1391264094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34809e1d0 msgr2=0x7fc348135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.025+0000 7fc34ceb9700 1 --2- 172.21.15.72:0/1391264094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34809e1d0 0x7fc348135910 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0098f0 tx=0x7fc33c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:30.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.025+0000 7fc34ceb9700 1 -- 172.21.15.72:0/1391264094 shutdown_connections 2023-10-03T10:17:30.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.025+0000 7fc34ceb9700 1 --2- 172.21.15.72:0/1391264094 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc348135e50 0x7fc348138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.025+0000 7fc34ceb9700 1 --2- 172.21.15.72:0/1391264094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34809e1d0 0x7fc348135910 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.025+0000 7fc34ceb9700 1 -- 172.21.15.72:0/1391264094 >> 172.21.15.72:0/1391264094 conn(0x7fc348066f50 msgr2=0x7fc34809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.025+0000 7fc34ceb9700 1 -- 172.21.15.72:0/1391264094 shutdown_connections 2023-10-03T10:17:30.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.025+0000 7fc34ceb9700 1 -- 172.21.15.72:0/1391264094 wait complete. 2023-10-03T10:17:30.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.026+0000 7fc34ceb9700 1 Processor -- start 2023-10-03T10:17:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.027+0000 7fc34ceb9700 1 -- start start 2023-10-03T10:17:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.027+0000 7fc34ceb9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34809d6f0 0x7fc3481c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.027+0000 7fc34ceb9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34809e1d0 0x7fc3481c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.027+0000 7fc34ceb9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc348135e50 0x7fc348119760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.027+0000 7fc34ceb9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34811d380 con 0x7fc34809e1d0 2023-10-03T10:17:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.027+0000 7fc34ceb9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34811cbc0 con 0x7fc34809d6f0 2023-10-03T10:17:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.027+0000 7fc34ceb9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc34811c8f0 con 0x7fc348135e50 2023-10-03T10:17:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.027+0000 7fc345d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34809e1d0 0x7fc3481c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.027+0000 7fc34659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34809d6f0 0x7fc3481c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.027+0000 7fc345d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34809e1d0 0x7fc3481c4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57326/0 (socket says 172.21.15.72:57326) 2023-10-03T10:17:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.027+0000 7fc345d9b700 1 -- 172.21.15.72:0/1585777151 learned_addr learned my addr 172.21.15.72:0/1585777151 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.027+0000 7fc346d9d700 1 --2- 172.21.15.72:0/1585777151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc348135e50 0x7fc348119760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.028+0000 7fc34659c700 1 -- 172.21.15.72:0/1585777151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc348135e50 msgr2=0x7fc348119760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.028+0000 7fc34659c700 1 --2- 172.21.15.72:0/1585777151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc348135e50 0x7fc348119760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.028+0000 7fc34659c700 1 -- 172.21.15.72:0/1585777151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34809e1d0 msgr2=0x7fc3481c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.028+0000 7fc34659c700 1 --2- 172.21.15.72:0/1585777151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34809e1d0 0x7fc3481c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.028+0000 7fc34659c700 1 -- 172.21.15.72:0/1585777151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c009550 con 0x7fc34809d6f0 2023-10-03T10:17:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.028+0000 7fc345d9b700 1 --2- 172.21.15.72:0/1585777151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34809e1d0 0x7fc3481c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.028+0000 7fc34659c700 1 --2- 172.21.15.72:0/1585777151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34809d6f0 0x7fc3481c4510 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc338000f60 tx=0x7fc33800c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.028+0000 7fc336ffd700 1 -- 172.21.15.72:0/1585777151 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3380052d0 con 0x7fc34809d6f0 2023-10-03T10:17:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.028+0000 7fc336ffd700 1 -- 172.21.15.72:0/1585777151 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc338005430 con 0x7fc34809d6f0 2023-10-03T10:17:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.028+0000 7fc336ffd700 1 -- 172.21.15.72:0/1585777151 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3380038c0 con 0x7fc34809d6f0 2023-10-03T10:17:30.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.028+0000 7fc34ceb9700 1 -- 172.21.15.72:0/1585777151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34809c700 con 0x7fc34809d6f0 2023-10-03T10:17:30.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.028+0000 7fc34ceb9700 1 -- 172.21.15.72:0/1585777151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc348130400 con 0x7fc34809d6f0 2023-10-03T10:17:30.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.029+0000 7fc336ffd700 1 -- 172.21.15.72:0/1585777151 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc338003c30 con 0x7fc34809d6f0 2023-10-03T10:17:30.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.029+0000 7fc336ffd700 1 -- 172.21.15.72:0/1585777151 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc33803eb10 con 0x7fc34809d6f0 2023-10-03T10:17:30.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.029+0000 7fc34ceb9700 1 -- 172.21.15.72:0/1585777151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc348074ea0 con 0x7fc34809d6f0 2023-10-03T10:17:30.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.034+0000 7fc336ffd700 1 -- 172.21.15.72:0/1585777151 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc338017020 con 0x7fc34809d6f0 2023-10-03T10:17:30.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.111+0000 7fe736e08700 1 -- 172.21.15.72:0/3068207717 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe730074ea0 con 0x7fe73009e000 2023-10-03T10:17:30.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.112+0000 7fe72d7fa700 1 -- 172.21.15.72:0/3068207717 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe71c021030 con 0x7fe73009e000 2023-10-03T10:17:30.111 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:30.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.115+0000 7fe736e08700 1 -- 172.21.15.72:0/3068207717 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe73009e000 msgr2=0x7fe73011e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.115+0000 7fe736e08700 1 --2- 172.21.15.72:0/3068207717 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe73009e000 0x7fe73011e6f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00ebb0 tx=0x7fe71c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.115+0000 7fe736e08700 1 -- 172.21.15.72:0/3068207717 shutdown_connections 2023-10-03T10:17:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.115+0000 7fe736e08700 1 --2- 172.21.15.72:0/3068207717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73009e410 0x7fe73011ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.115+0000 7fe736e08700 1 --2- 172.21.15.72:0/3068207717 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe73009d6f0 0x7fe73011e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.115+0000 7fe736e08700 1 --2- 172.21.15.72:0/3068207717 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe73009e000 0x7fe73011e6f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.115+0000 7fe736e08700 1 -- 172.21.15.72:0/3068207717 >> 172.21.15.72:0/3068207717 conn(0x7fe730066f50 msgr2=0x7fe73006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.115+0000 7fe736e08700 1 -- 172.21.15.72:0/3068207717 shutdown_connections 2023-10-03T10:17:30.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.115+0000 7fe736e08700 1 -- 172.21.15.72:0/3068207717 wait complete. 2023-10-03T10:17:30.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:30.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.187+0000 7f0de7b8a700 1 -- 172.21.15.72:0/1547915852 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0de0120150 con 0x7f0de0133420 2023-10-03T10:17:30.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.187+0000 7f0dd67fc700 1 -- 172.21.15.72:0/1547915852 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0de0120150 con 0x7f0de0133420 2023-10-03T10:17:30.187 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.189+0000 7f0de7b8a700 1 -- 172.21.15.72:0/1547915852 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0de0133420 msgr2=0x7f0de00709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.189+0000 7f0de7b8a700 1 --2- 172.21.15.72:0/1547915852 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0de0133420 0x7f0de00709a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0de006e650 tx=0x7f0ddc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:30.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.190+0000 7f0de7b8a700 1 -- 172.21.15.72:0/1547915852 shutdown_connections 2023-10-03T10:17:30.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.190+0000 7f0de7b8a700 1 --2- 172.21.15.72:0/1547915852 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0de0134260 0x7f0de0071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.190+0000 7f0de7b8a700 1 --2- 172.21.15.72:0/1547915852 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0de0133420 0x7f0de00709a0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.190+0000 7f0de7b8a700 1 --2- 172.21.15.72:0/1547915852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de0133e30 0x7f0de0070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.190+0000 7f0de7b8a700 1 -- 172.21.15.72:0/1547915852 >> 172.21.15.72:0/1547915852 conn(0x7f0de00a4210 msgr2=0x7f0de00a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.190+0000 7f0de7b8a700 1 -- 172.21.15.72:0/1547915852 shutdown_connections 2023-10-03T10:17:30.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.190+0000 7f0de7b8a700 1 -- 172.21.15.72:0/1547915852 wait complete. 2023-10-03T10:17:30.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:30.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.234+0000 7fc34ceb9700 1 -- 172.21.15.72:0/1585777151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc34806c360 con 0x7fc34809d6f0 2023-10-03T10:17:30.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.234+0000 7fc336ffd700 1 -- 172.21.15.72:0/1585777151 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc33801b3b0 con 0x7fc34809d6f0 2023-10-03T10:17:30.234 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:30.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.236+0000 7fc34ceb9700 1 -- 172.21.15.72:0/1585777151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34809d6f0 msgr2=0x7fc3481c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.236+0000 7fc34ceb9700 1 --2- 172.21.15.72:0/1585777151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34809d6f0 0x7fc3481c4510 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc338000f60 tx=0x7fc33800c6e0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.236+0000 7fc34ceb9700 1 -- 172.21.15.72:0/1585777151 shutdown_connections 2023-10-03T10:17:30.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.236+0000 7fc34ceb9700 1 --2- 172.21.15.72:0/1585777151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc348135e50 0x7fc348119760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.236+0000 7fc34ceb9700 1 --2- 172.21.15.72:0/1585777151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc34809d6f0 0x7fc3481c4510 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.236+0000 7fc34ceb9700 1 --2- 172.21.15.72:0/1585777151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc34809e1d0 0x7fc3481c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.236+0000 7fc34ceb9700 1 -- 172.21.15.72:0/1585777151 >> 172.21.15.72:0/1585777151 conn(0x7fc348066f50 msgr2=0x7fc3480a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.236+0000 7fc34ceb9700 1 -- 172.21.15.72:0/1585777151 shutdown_connections 2023-10-03T10:17:30.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.236+0000 7fc34ceb9700 1 -- 172.21.15.72:0/1585777151 wait complete. 2023-10-03T10:17:30.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:30.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:30.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f5135ee5700 1 Processor -- start 2023-10-03T10:17:30.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f5135ee5700 1 -- start start 2023-10-03T10:17:30.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f5135ee5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f513009d6f0 0x7f513009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f5135ee5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f513009e000 0x7f5130130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f5135ee5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f513009e410 0x7f5130130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f5135ee5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513009f520 con 0x7f513009e410 2023-10-03T10:17:30.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f5135ee5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513009f130 con 0x7f513009d6f0 2023-10-03T10:17:30.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f5135ee5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f513009e930 con 0x7f513009e000 2023-10-03T10:17:30.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f512effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f513009e000 0x7f5130130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f512f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f513009d6f0 0x7f513009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f512ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f513009e410 0x7f5130130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f512f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f513009d6f0 0x7f513009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43184/0 (socket says 172.21.15.72:43184) 2023-10-03T10:17:30.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f512ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f513009e410 0x7f5130130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57334/0 (socket says 172.21.15.72:57334) 2023-10-03T10:17:30.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f512effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f513009e000 0x7f5130130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37936/0 (socket says 172.21.15.72:37936) 2023-10-03T10:17:30.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f512f7fe700 1 -- 172.21.15.72:0/3458256447 learned_addr learned my addr 172.21.15.72:0/3458256447 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:30.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f512ffff700 1 -- 172.21.15.72:0/3458256447 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f513009e000 msgr2=0x7f5130130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:30.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.818+0000 7f512ffff700 1 --2- 172.21.15.72:0/3458256447 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f513009e000 0x7f5130130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f512ffff700 1 -- 172.21.15.72:0/3458256447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f513009d6f0 msgr2=0x7f513009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:30.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f512ffff700 1 --2- 172.21.15.72:0/3458256447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f513009d6f0 0x7f513009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f512ffff700 1 -- 172.21.15.72:0/3458256447 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513009b2d0 con 0x7f513009e410 2023-10-03T10:17:30.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f512effd700 1 --2- 172.21.15.72:0/3458256447 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f513009e000 0x7f5130130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:30.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f512ffff700 1 --2- 172.21.15.72:0/3458256447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f513009e410 0x7f5130130ba0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f5128009d90 tx=0x7f512800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00f1f96c18c7a7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f512e7fc700 1 -- 172.21.15.72:0/3458256447 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512800e070 con 0x7f513009e410 2023-10-03T10:17:30.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f512e7fc700 1 -- 172.21.15.72:0/3458256447 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512800bb20 con 0x7f513009e410 2023-10-03T10:17:30.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f512e7fc700 1 -- 172.21.15.72:0/3458256447 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128012430 con 0x7f513009e410 2023-10-03T10:17:30.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f5135ee5700 1 -- 172.21.15.72:0/3458256447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f513009e410 msgr2=0x7f5130130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f5135ee5700 1 --2- 172.21.15.72:0/3458256447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f513009e410 0x7f5130130ba0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f5128009d90 tx=0x7f512800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:30.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f5135ee5700 1 -- 172.21.15.72:0/3458256447 shutdown_connections 2023-10-03T10:17:30.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f5135ee5700 1 --2- 172.21.15.72:0/3458256447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f513009e410 0x7f5130130ba0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f5135ee5700 1 --2- 172.21.15.72:0/3458256447 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f513009d6f0 0x7f513009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f5135ee5700 1 --2- 172.21.15.72:0/3458256447 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f513009e000 0x7f5130130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f5135ee5700 1 -- 172.21.15.72:0/3458256447 >> 172.21.15.72:0/3458256447 conn(0x7f5130066f50 msgr2=0x7f513009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f5135ee5700 1 -- 172.21.15.72:0/3458256447 shutdown_connections 2023-10-03T10:17:30.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.819+0000 7f5135ee5700 1 -- 172.21.15.72:0/3458256447 wait complete. 2023-10-03T10:17:30.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.820+0000 7f5135ee5700 1 Processor -- start 2023-10-03T10:17:30.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f5135ee5700 1 -- start start 2023-10-03T10:17:30.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f5135ee5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f513009d6f0 0x7f51301210e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f5135ee5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f513009e000 0x7f5130121620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f5135ee5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f513009e410 0x7f5130121b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f5135ee5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513006ac30 con 0x7f513009e410 2023-10-03T10:17:30.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f5135ee5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5130123540 con 0x7f513009d6f0 2023-10-03T10:17:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f5135ee5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f513006b4e0 con 0x7f513009e000 2023-10-03T10:17:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f512f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f513009d6f0 0x7f51301210e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f512effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f513009e000 0x7f5130121620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f512f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f513009d6f0 0x7f51301210e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43190/0 (socket says 172.21.15.72:43190) 2023-10-03T10:17:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f512effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f513009e000 0x7f5130121620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37946/0 (socket says 172.21.15.72:37946) 2023-10-03T10:17:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f512f7fe700 1 -- 172.21.15.72:0/1440047126 learned_addr learned my addr 172.21.15.72:0/1440047126 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f512ffff700 1 --2- 172.21.15.72:0/1440047126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f513009e410 0x7f5130121b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f512f7fe700 1 -- 172.21.15.72:0/1440047126 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f513009e000 msgr2=0x7f5130121620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f512f7fe700 1 --2- 172.21.15.72:0/1440047126 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f513009e000 0x7f5130121620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f512f7fe700 1 -- 172.21.15.72:0/1440047126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f513009e410 msgr2=0x7f5130121b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f512f7fe700 1 --2- 172.21.15.72:0/1440047126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f513009e410 0x7f5130121b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f512f7fe700 1 -- 172.21.15.72:0/1440047126 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51200094a0 con 0x7f513009d6f0 2023-10-03T10:17:30.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f512effd700 1 --2- 172.21.15.72:0/1440047126 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f513009e000 0x7f5130121620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:30.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.821+0000 7f512ffff700 1 --2- 172.21.15.72:0/1440047126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f513009e410 0x7f5130121b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:30.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.822+0000 7f512f7fe700 1 --2- 172.21.15.72:0/1440047126 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f513009d6f0 0x7f51301210e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f512400e9c0 tx=0x7f512400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.822+0000 7f5117fff700 1 -- 172.21.15.72:0/1440047126 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512400ee60 con 0x7f513009d6f0 2023-10-03T10:17:30.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.822+0000 7f5117fff700 1 -- 172.21.15.72:0/1440047126 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512400c850 con 0x7f513009d6f0 2023-10-03T10:17:30.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.822+0000 7f5135ee5700 1 -- 172.21.15.72:0/1440047126 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5128009a70 con 0x7f513009d6f0 2023-10-03T10:17:30.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.822+0000 7f5117fff700 1 -- 172.21.15.72:0/1440047126 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512400cbc0 con 0x7f513009d6f0 2023-10-03T10:17:30.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.822+0000 7f5135ee5700 1 -- 172.21.15.72:0/1440047126 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513009c700 con 0x7f513009d6f0 2023-10-03T10:17:30.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.822+0000 7f5117fff700 1 -- 172.21.15.72:0/1440047126 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f512400cd20 con 0x7f513009d6f0 2023-10-03T10:17:30.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.823+0000 7f5117fff700 1 -- 172.21.15.72:0/1440047126 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f512403fa00 con 0x7f513009d6f0 2023-10-03T10:17:30.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.823+0000 7f5135ee5700 1 -- 172.21.15.72:0/1440047126 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5130074ea0 con 0x7f513009d6f0 2023-10-03T10:17:30.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:30.827+0000 7f5117fff700 1 -- 172.21.15.72:0/1440047126 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5124017020 con 0x7f513009d6f0 2023-10-03T10:17:31.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.010+0000 7f5135ee5700 1 -- 172.21.15.72:0/1440047126 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f513006c360 con 0x7f513009d6f0 2023-10-03T10:17:31.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.010+0000 7f5117fff700 1 -- 172.21.15.72:0/1440047126 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51240117c0 con 0x7f513009d6f0 2023-10-03T10:17:31.010 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:31.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.012+0000 7f5135ee5700 1 -- 172.21.15.72:0/1440047126 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f513009d6f0 msgr2=0x7f51301210e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.012+0000 7f5135ee5700 1 --2- 172.21.15.72:0/1440047126 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f513009d6f0 0x7f51301210e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f512400e9c0 tx=0x7f512400ecd0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.012+0000 7f5135ee5700 1 -- 172.21.15.72:0/1440047126 shutdown_connections 2023-10-03T10:17:31.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.012+0000 7f5135ee5700 1 --2- 172.21.15.72:0/1440047126 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f513009e410 0x7f5130121b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.012+0000 7f5135ee5700 1 --2- 172.21.15.72:0/1440047126 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f513009d6f0 0x7f51301210e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.012+0000 7f5135ee5700 1 --2- 172.21.15.72:0/1440047126 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f513009e000 0x7f5130121620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.012+0000 7f5135ee5700 1 -- 172.21.15.72:0/1440047126 >> 172.21.15.72:0/1440047126 conn(0x7f5130066f50 msgr2=0x7f5130130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.012+0000 7f5135ee5700 1 -- 172.21.15.72:0/1440047126 shutdown_connections 2023-10-03T10:17:31.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.012+0000 7f5135ee5700 1 -- 172.21.15.72:0/1440047126 wait complete. 2023-10-03T10:17:31.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:31.132 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:31.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:31.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:31.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.257+0000 7f2833360700 1 Processor -- start 2023-10-03T10:17:31.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.257+0000 7f2833360700 1 -- start start 2023-10-03T10:17:31.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f2833360700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f282c136710 0x7f282c138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f2833360700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f282c139030 0x7f282c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f2833360700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282c06ef30 con 0x7f282c1338a0 2023-10-03T10:17:31.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f2833360700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282c06fef0 con 0x7f282c139030 2023-10-03T10:17:31.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f2833360700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f282c1334b0 con 0x7f282c136710 2023-10-03T10:17:31.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f28308fb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f282c136710 0x7f282c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f28310fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f282c1338a0 0x7f282c133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48446/0 (socket says 172.21.15.72:48446) 2023-10-03T10:17:31.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f28310fc700 1 -- 172.21.15.72:0/602117132 learned_addr learned my addr 172.21.15.72:0/602117132 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:31.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f28318fd700 1 --2- 172.21.15.72:0/602117132 >> v2:172.21.15.72:3300/0 conn(0x7f282c139030 0x7f282c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f28318fd700 1 -- 172.21.15.72:0/602117132 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f282c136710 msgr2=0x7f282c138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f28318fd700 1 --2- 172.21.15.72:0/602117132 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f282c136710 0x7f282c138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f28318fd700 1 -- 172.21.15.72:0/602117132 >> v1:172.21.15.72:6789/0 conn(0x7f282c1338a0 legacy=0x7f282c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f28318fd700 1 -- 172.21.15.72:0/602117132 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c06fc30 con 0x7f282c139030 2023-10-03T10:17:31.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f28308fb700 1 --2- 172.21.15.72:0/602117132 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f282c136710 0x7f282c138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:31.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f28318fd700 1 --2- 172.21.15.72:0/602117132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c139030 0x7f282c13b410 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f2824009d90 tx=0x7f282400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0d24b7eb9a25f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.258+0000 7f2823fff700 1 -- 172.21.15.72:0/602117132 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282400e070 con 0x7f282c139030 2023-10-03T10:17:31.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.259+0000 7f2823fff700 1 -- 172.21.15.72:0/602117132 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282400bb20 con 0x7f282c139030 2023-10-03T10:17:31.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.259+0000 7f2823fff700 1 -- 172.21.15.72:0/602117132 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2824012430 con 0x7f282c139030 2023-10-03T10:17:31.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.259+0000 7f2833360700 1 -- 172.21.15.72:0/602117132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c139030 msgr2=0x7f282c13b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.259+0000 7f2833360700 1 --2- 172.21.15.72:0/602117132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c139030 0x7f282c13b410 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f2824009d90 tx=0x7f282400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:31.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.260+0000 7f2833360700 1 -- 172.21.15.72:0/602117132 shutdown_connections 2023-10-03T10:17:31.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.260+0000 7f2833360700 1 --2- 172.21.15.72:0/602117132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c139030 0x7f282c13b410 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.260+0000 7f2833360700 1 --2- 172.21.15.72:0/602117132 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f282c136710 0x7f282c138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.260+0000 7f2833360700 1 -- 172.21.15.72:0/602117132 >> 172.21.15.72:0/602117132 conn(0x7f282c0a2aa0 msgr2=0x7f282c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.260+0000 7f2833360700 1 -- 172.21.15.72:0/602117132 shutdown_connections 2023-10-03T10:17:31.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.260+0000 7f2833360700 1 -- 172.21.15.72:0/602117132 wait complete. 2023-10-03T10:17:31.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.261+0000 7f2833360700 1 Processor -- start 2023-10-03T10:17:31.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.261+0000 7f2833360700 1 -- start start 2023-10-03T10:17:31.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.261+0000 7f2833360700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c1338a0 0x7f282c1c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.261+0000 7f2833360700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f282c136710 0x7f282c1c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.261+0000 7f2833360700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f282c139030 0x7f282c11adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.261+0000 7f2833360700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c1c90d0 con 0x7f282c1338a0 2023-10-03T10:17:31.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.261+0000 7f2833360700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c11c9c0 con 0x7f282c139030 2023-10-03T10:17:31.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.261+0000 7f2833360700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f282c11cfe0 con 0x7f282c136710 2023-10-03T10:17:31.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.261+0000 7f28308fb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f282c136710 0x7f282c1c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.261+0000 7f28310fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c1338a0 0x7f282c1c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.261+0000 7f28308fb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f282c136710 0x7f282c1c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37956/0 (socket says 172.21.15.72:37956) 2023-10-03T10:17:31.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.262+0000 7f28308fb700 1 -- 172.21.15.72:0/1474260548 learned_addr learned my addr 172.21.15.72:0/1474260548 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:31.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.262+0000 7f28318fd700 1 --2- 172.21.15.72:0/1474260548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f282c139030 0x7f282c11adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.262+0000 7f28308fb700 1 -- 172.21.15.72:0/1474260548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f282c139030 msgr2=0x7f282c11adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.262+0000 7f28308fb700 1 --2- 172.21.15.72:0/1474260548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f282c139030 0x7f282c11adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.262+0000 7f28308fb700 1 -- 172.21.15.72:0/1474260548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c1338a0 msgr2=0x7f282c1c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.262+0000 7f28308fb700 1 --2- 172.21.15.72:0/1474260548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c1338a0 0x7f282c1c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.262+0000 7f28308fb700 1 -- 172.21.15.72:0/1474260548 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c0094a0 con 0x7f282c136710 2023-10-03T10:17:31.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.262+0000 7f28308fb700 1 --2- 172.21.15.72:0/1474260548 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f282c136710 0x7f282c1c8b90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f281c00ec10 tx=0x7f281c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.262+0000 7f2821ffb700 1 -- 172.21.15.72:0/1474260548 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c00c850 con 0x7f282c136710 2023-10-03T10:17:31.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.262+0000 7f2821ffb700 1 -- 172.21.15.72:0/1474260548 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c00c9b0 con 0x7f282c136710 2023-10-03T10:17:31.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.262+0000 7f2821ffb700 1 -- 172.21.15.72:0/1474260548 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c00cd20 con 0x7f282c136710 2023-10-03T10:17:31.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.262+0000 7f2833360700 1 -- 172.21.15.72:0/1474260548 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2824009a70 con 0x7f282c136710 2023-10-03T10:17:31.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.263+0000 7f2833360700 1 -- 172.21.15.72:0/1474260548 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282c06f640 con 0x7f282c136710 2023-10-03T10:17:31.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.263+0000 7f2821ffb700 1 -- 172.21.15.72:0/1474260548 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f281c013470 con 0x7f282c136710 2023-10-03T10:17:31.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.264+0000 7f2821ffb700 1 -- 172.21.15.72:0/1474260548 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f281c03f800 con 0x7f282c136710 2023-10-03T10:17:31.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.264+0000 7f2833360700 1 -- 172.21.15.72:0/1474260548 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282c130d30 con 0x7f282c136710 2023-10-03T10:17:31.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.269+0000 7f2821ffb700 1 -- 172.21.15.72:0/1474260548 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f281c013720 con 0x7f282c136710 2023-10-03T10:17:31.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.331+0000 7f1e979bc700 1 Processor -- start 2023-10-03T10:17:31.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.331+0000 7f1e979bc700 1 -- start start 2023-10-03T10:17:31.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e979bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e901338a0 0x7f1e90133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e979bc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1e9009de50 0x7f1e9009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e979bc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9006ef30 con 0x7f1e9009e760 2023-10-03T10:17:31.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e979bc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9006fef0 con 0x7f1e9009de50 2023-10-03T10:17:31.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e979bc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e901334b0 con 0x7f1e901338a0 2023-10-03T10:17:31.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e95758700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e901338a0 0x7f1e90133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e94f57700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1e9009de50 0x7f1e9009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e95758700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e901338a0 0x7f1e90133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43206/0 (socket says 172.21.15.72:43206) 2023-10-03T10:17:31.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e94f57700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1e9009de50 0x7f1e9009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57368/0 (socket says 172.21.15.72:57368) 2023-10-03T10:17:31.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e95758700 1 -- 172.21.15.72:0/3114506551 learned_addr learned my addr 172.21.15.72:0/3114506551 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:31.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e95758700 1 -- 172.21.15.72:0/3114506551 >> v2:172.21.15.72:3300/0 conn(0x7f1e9009de50 msgr2=0x7f1e9009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e95758700 1 --2- 172.21.15.72:0/3114506551 >> v2:172.21.15.72:3300/0 conn(0x7f1e9009de50 0x7f1e9009e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e95758700 1 -- 172.21.15.72:0/3114506551 >> v1:172.21.15.72:6789/0 conn(0x7f1e9009e760 legacy=0x7f1e9013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e87fff700 1 -- 172.21.15.72:0/3114506551 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869691564 0 0) 0x7f1e9006ef30 con 0x7f1e9009e760 2023-10-03T10:17:31.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e95758700 1 -- 172.21.15.72:0/3114506551 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9006fc30 con 0x7f1e901338a0 2023-10-03T10:17:31.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e94f57700 1 --2- 172.21.15.72:0/3114506551 >> v2:172.21.15.72:3300/0 conn(0x7f1e9009de50 0x7f1e9009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:31.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e95758700 1 --2- 172.21.15.72:0/3114506551 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e901338a0 0x7f1e90133c70 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0098f0 tx=0x7f1e8c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f32e435af7f1245 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e87fff700 1 -- 172.21.15.72:0/3114506551 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c011830 con 0x7f1e901338a0 2023-10-03T10:17:31.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e87fff700 1 -- 172.21.15.72:0/3114506551 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c011990 con 0x7f1e901338a0 2023-10-03T10:17:31.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.332+0000 7f1e87fff700 1 -- 172.21.15.72:0/3114506551 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c011d20 con 0x7f1e901338a0 2023-10-03T10:17:31.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.333+0000 7f1e979bc700 1 -- 172.21.15.72:0/3114506551 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e901338a0 msgr2=0x7f1e90133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.333+0000 7f1e979bc700 1 --2- 172.21.15.72:0/3114506551 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e901338a0 0x7f1e90133c70 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0098f0 tx=0x7f1e8c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:31.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.333+0000 7f1e979bc700 1 -- 172.21.15.72:0/3114506551 shutdown_connections 2023-10-03T10:17:31.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.333+0000 7f1e979bc700 1 --2- 172.21.15.72:0/3114506551 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e901338a0 0x7f1e90133c70 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.333+0000 7f1e979bc700 1 --2- 172.21.15.72:0/3114506551 >> v2:172.21.15.72:3300/0 conn(0x7f1e9009de50 0x7f1e9009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.333+0000 7f1e979bc700 1 -- 172.21.15.72:0/3114506551 >> 172.21.15.72:0/3114506551 conn(0x7f1e900a2aa0 msgr2=0x7f1e900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.333+0000 7f1e979bc700 1 -- 172.21.15.72:0/3114506551 shutdown_connections 2023-10-03T10:17:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.333+0000 7f1e979bc700 1 -- 172.21.15.72:0/3114506551 wait complete. 2023-10-03T10:17:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.334+0000 7f1e979bc700 1 Processor -- start 2023-10-03T10:17:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.334+0000 7f1e979bc700 1 -- start start 2023-10-03T10:17:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e979bc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e9009de50 0x7f1e9011a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e979bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e9009e760 0x7f1e9011ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e979bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e901338a0 0x7f1e9011b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e979bc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9011c890 con 0x7f1e901338a0 2023-10-03T10:17:31.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e979bc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9011e150 con 0x7f1e9009e760 2023-10-03T10:17:31.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e979bc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9011d520 con 0x7f1e9009de50 2023-10-03T10:17:31.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e94f57700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e9009e760 0x7f1e9011ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e95758700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e9009de50 0x7f1e9011a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e94f57700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e9009e760 0x7f1e9011ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43220/0 (socket says 172.21.15.72:43220) 2023-10-03T10:17:31.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e94f57700 1 -- 172.21.15.72:0/935628655 learned_addr learned my addr 172.21.15.72:0/935628655 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:31.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e95758700 1 --2- 172.21.15.72:0/935628655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e9009de50 0x7f1e9011a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37972/0 (socket says 172.21.15.72:37972) 2023-10-03T10:17:31.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e95f59700 1 --2- 172.21.15.72:0/935628655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e901338a0 0x7f1e9011b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e95758700 1 -- 172.21.15.72:0/935628655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e9009e760 msgr2=0x7f1e9011ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e95758700 1 --2- 172.21.15.72:0/935628655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e9009e760 0x7f1e9011ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e95758700 1 -- 172.21.15.72:0/935628655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e901338a0 msgr2=0x7f1e9011b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e95758700 1 --2- 172.21.15.72:0/935628655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e901338a0 0x7f1e9011b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e95758700 1 -- 172.21.15.72:0/935628655 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e800094a0 con 0x7f1e9009de50 2023-10-03T10:17:31.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e95758700 1 --2- 172.21.15.72:0/935628655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e9009de50 0x7f1e9011a630 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c016000 tx=0x7f1e8c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e85ffb700 1 -- 172.21.15.72:0/935628655 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c004300 con 0x7f1e9009de50 2023-10-03T10:17:31.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e85ffb700 1 -- 172.21.15.72:0/935628655 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e8c01f070 con 0x7f1e9009de50 2023-10-03T10:17:31.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e979bc700 1 -- 172.21.15.72:0/935628655 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8c009550 con 0x7f1e9009de50 2023-10-03T10:17:31.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.335+0000 7f1e85ffb700 1 -- 172.21.15.72:0/935628655 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c0036a0 con 0x7f1e9009de50 2023-10-03T10:17:31.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.336+0000 7f1e979bc700 1 -- 172.21.15.72:0/935628655 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e900a0ba0 con 0x7f1e9009de50 2023-10-03T10:17:31.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.336+0000 7f1e979bc700 1 -- 172.21.15.72:0/935628655 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e90074ea0 con 0x7f1e9009de50 2023-10-03T10:17:31.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.337+0000 7f1e85ffb700 1 -- 172.21.15.72:0/935628655 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e8c021030 con 0x7f1e9009de50 2023-10-03T10:17:31.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.337+0000 7f1e85ffb700 1 -- 172.21.15.72:0/935628655 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1e8c040900 con 0x7f1e9009de50 2023-10-03T10:17:31.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.341+0000 7f1e85ffb700 1 -- 172.21.15.72:0/935628655 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e8c0239c0 con 0x7f1e9009de50 2023-10-03T10:17:31.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.375+0000 7f47b4a8b700 1 Processor -- start 2023-10-03T10:17:31.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.375+0000 7f47b4a8b700 1 -- start start 2023-10-03T10:17:31.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.375+0000 7f47b4a8b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47b009e930 0x7f47b009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47b4a8b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47b009f650 0x7f47b0131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47b4a8b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b0070940 con 0x7f47b009f240 2023-10-03T10:17:31.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47b4a8b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b006fd60 con 0x7f47b009f650 2023-10-03T10:17:31.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47b4a8b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47b006fa80 con 0x7f47b009e930 2023-10-03T10:17:31.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47ae59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47b009e930 0x7f47b009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47add9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f47b009f240 0x7f47b01317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48464/0 (socket says 172.21.15.72:48464) 2023-10-03T10:17:31.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47ae59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47b009e930 0x7f47b009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37980/0 (socket says 172.21.15.72:37980) 2023-10-03T10:17:31.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47add9b700 1 -- 172.21.15.72:0/1673994273 learned_addr learned my addr 172.21.15.72:0/1673994273 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:31.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47aed9d700 1 --2- 172.21.15.72:0/1673994273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47b009f650 0x7f47b0131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47ad59a700 1 -- 172.21.15.72:0/1673994273 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677767327 0 0) 0x7f47b0070940 con 0x7f47b009f240 2023-10-03T10:17:31.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47aed9d700 1 -- 172.21.15.72:0/1673994273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47b009e930 msgr2=0x7f47b009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:31.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47aed9d700 1 --2- 172.21.15.72:0/1673994273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47b009e930 0x7f47b009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47aed9d700 1 -- 172.21.15.72:0/1673994273 >> v1:172.21.15.72:6789/0 conn(0x7f47b009f240 legacy=0x7f47b01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47aed9d700 1 -- 172.21.15.72:0/1673994273 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b009fb60 con 0x7f47b009f650 2023-10-03T10:17:31.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47ae59c700 1 --2- 172.21.15.72:0/1673994273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47b009e930 0x7f47b009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:31.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47aed9d700 1 --2- 172.21.15.72:0/1673994273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47b009f650 0x7f47b0131f00 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009dc0 tx=0x7f47a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89a26a48e5586cd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47ad59a700 1 -- 172.21.15.72:0/1673994273 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a800e070 con 0x7f47b009f650 2023-10-03T10:17:31.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47ad59a700 1 -- 172.21.15.72:0/1673994273 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a800bb20 con 0x7f47b009f650 2023-10-03T10:17:31.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.376+0000 7f47ad59a700 1 -- 172.21.15.72:0/1673994273 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8012430 con 0x7f47b009f650 2023-10-03T10:17:31.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.377+0000 7f47b4a8b700 1 -- 172.21.15.72:0/1673994273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47b009f650 msgr2=0x7f47b0131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.377+0000 7f47b4a8b700 1 --2- 172.21.15.72:0/1673994273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47b009f650 0x7f47b0131f00 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009dc0 tx=0x7f47a800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:31.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.377+0000 7f47b4a8b700 1 -- 172.21.15.72:0/1673994273 shutdown_connections 2023-10-03T10:17:31.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.377+0000 7f47b4a8b700 1 --2- 172.21.15.72:0/1673994273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47b009f650 0x7f47b0131f00 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.377+0000 7f47b4a8b700 1 --2- 172.21.15.72:0/1673994273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47b009e930 0x7f47b009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.377+0000 7f47b4a8b700 1 -- 172.21.15.72:0/1673994273 >> 172.21.15.72:0/1673994273 conn(0x7f47b00a4210 msgr2=0x7f47b00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.377+0000 7f47b4a8b700 1 -- 172.21.15.72:0/1673994273 shutdown_connections 2023-10-03T10:17:31.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.377+0000 7f47b4a8b700 1 -- 172.21.15.72:0/1673994273 wait complete. 2023-10-03T10:17:31.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.378+0000 7f47b4a8b700 1 Processor -- start 2023-10-03T10:17:31.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.378+0000 7f47b4a8b700 1 -- start start 2023-10-03T10:17:31.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47b4a8b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47b009e930 0x7f47b006c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47b4a8b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47b009f240 0x7f47b006c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47b4a8b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b009f650 0x7f47b01c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:31.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47b4a8b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b01a8100 con 0x7f47b009f650 2023-10-03T10:17:31.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47b4a8b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b006cc90 con 0x7f47b009f240 2023-10-03T10:17:31.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47b4a8b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47b01b7380 con 0x7f47b009e930 2023-10-03T10:17:31.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47ae59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47b009e930 0x7f47b006c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47aed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b009f650 0x7f47b01c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47ae59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47b009e930 0x7f47b006c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37992/0 (socket says 172.21.15.72:37992) 2023-10-03T10:17:31.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47ae59c700 1 -- 172.21.15.72:0/439091996 learned_addr learned my addr 172.21.15.72:0/439091996 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47add9b700 1 --2- 172.21.15.72:0/439091996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47b009f240 0x7f47b006c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47aed9d700 1 -- 172.21.15.72:0/439091996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47b009e930 msgr2=0x7f47b006c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47aed9d700 1 --2- 172.21.15.72:0/439091996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47b009e930 0x7f47b006c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47aed9d700 1 -- 172.21.15.72:0/439091996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47b009f240 msgr2=0x7f47b006c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47aed9d700 1 --2- 172.21.15.72:0/439091996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47b009f240 0x7f47b006c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47aed9d700 1 -- 172.21.15.72:0/439091996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a00094a0 con 0x7f47b009f650 2023-10-03T10:17:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47ae59c700 1 --2- 172.21.15.72:0/439091996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47b009e930 0x7f47b006c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f47aed9d700 1 --2- 172.21.15.72:0/439091996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b009f650 0x7f47b01c8050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f47b00a1bf0 tx=0x7f47a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.379+0000 7f479effd700 1 -- 172.21.15.72:0/439091996 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8004840 con 0x7f47b009f650 2023-10-03T10:17:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.380+0000 7f479effd700 1 -- 172.21.15.72:0/439091996 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a8020070 con 0x7f47b009f650 2023-10-03T10:17:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.380+0000 7f479effd700 1 -- 172.21.15.72:0/439091996 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a80276c0 con 0x7f47b009f650 2023-10-03T10:17:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.380+0000 7f47b4a8b700 1 -- 172.21.15.72:0/439091996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a8009a70 con 0x7f47b009f650 2023-10-03T10:17:31.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.380+0000 7f47b4a8b700 1 -- 172.21.15.72:0/439091996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b00a0190 con 0x7f47b009f650 2023-10-03T10:17:31.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.380+0000 7f479effd700 1 -- 172.21.15.72:0/439091996 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47a8012430 con 0x7f47b009f650 2023-10-03T10:17:31.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.380+0000 7f47b4a8b700 1 -- 172.21.15.72:0/439091996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b00a3260 con 0x7f47b009f650 2023-10-03T10:17:31.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.381+0000 7f479effd700 1 -- 172.21.15.72:0/439091996 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f47a8022070 con 0x7f47b009f650 2023-10-03T10:17:31.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.390+0000 7f479effd700 1 -- 172.21.15.72:0/439091996 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47a801b400 con 0x7f47b009f650 2023-10-03T10:17:31.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.474+0000 7f2833360700 1 -- 172.21.15.72:0/1474260548 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f282c074ea0 con 0x7f282c136710 2023-10-03T10:17:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.474+0000 7f2821ffb700 1 -- 172.21.15.72:0/1474260548 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f281c01bb60 con 0x7f282c136710 2023-10-03T10:17:31.474 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:31.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.476+0000 7f2833360700 1 -- 172.21.15.72:0/1474260548 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f282c136710 msgr2=0x7f282c1c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.476+0000 7f2833360700 1 --2- 172.21.15.72:0/1474260548 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f282c136710 0x7f282c1c8b90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f281c00ec10 tx=0x7f281c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.477+0000 7f2833360700 1 -- 172.21.15.72:0/1474260548 shutdown_connections 2023-10-03T10:17:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.477+0000 7f2833360700 1 --2- 172.21.15.72:0/1474260548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f282c1338a0 0x7f282c1c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.477+0000 7f2833360700 1 --2- 172.21.15.72:0/1474260548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f282c139030 0x7f282c11adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.477+0000 7f2833360700 1 --2- 172.21.15.72:0/1474260548 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f282c136710 0x7f282c1c8b90 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.477+0000 7f2833360700 1 -- 172.21.15.72:0/1474260548 >> 172.21.15.72:0/1474260548 conn(0x7f282c0a2aa0 msgr2=0x7f282c1344d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.477+0000 7f2833360700 1 -- 172.21.15.72:0/1474260548 shutdown_connections 2023-10-03T10:17:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.477+0000 7f2833360700 1 -- 172.21.15.72:0/1474260548 wait complete. 2023-10-03T10:17:31.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:31.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.541+0000 7f1e979bc700 1 -- 172.21.15.72:0/935628655 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1e9011bad0 con 0x7f1e9009de50 2023-10-03T10:17:31.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.541+0000 7f1e85ffb700 1 -- 172.21.15.72:0/935628655 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1e8c015070 con 0x7f1e9009de50 2023-10-03T10:17:31.541 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:31.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.543+0000 7f1e979bc700 1 -- 172.21.15.72:0/935628655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e9009de50 msgr2=0x7f1e9011a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.543+0000 7f1e979bc700 1 --2- 172.21.15.72:0/935628655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e9009de50 0x7f1e9011a630 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c016000 tx=0x7f1e8c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:31.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.543+0000 7f1e979bc700 1 -- 172.21.15.72:0/935628655 shutdown_connections 2023-10-03T10:17:31.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.543+0000 7f1e979bc700 1 --2- 172.21.15.72:0/935628655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1e901338a0 0x7f1e9011b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.543+0000 7f1e979bc700 1 --2- 172.21.15.72:0/935628655 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1e9009de50 0x7f1e9011a630 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.543+0000 7f1e979bc700 1 --2- 172.21.15.72:0/935628655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1e9009e760 0x7f1e9011ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.543+0000 7f1e979bc700 1 -- 172.21.15.72:0/935628655 >> 172.21.15.72:0/935628655 conn(0x7f1e900a2aa0 msgr2=0x7f1e90130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.544+0000 7f1e979bc700 1 -- 172.21.15.72:0/935628655 shutdown_connections 2023-10-03T10:17:31.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.544+0000 7f1e979bc700 1 -- 172.21.15.72:0/935628655 wait complete. 2023-10-03T10:17:31.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:31.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.591+0000 7f47b4a8b700 1 -- 172.21.15.72:0/439091996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f47b009ffe0 con 0x7f47b009f650 2023-10-03T10:17:31.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.591+0000 7f479effd700 1 -- 172.21.15.72:0/439091996 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f47a802c030 con 0x7f47b009f650 2023-10-03T10:17:31.591 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:31.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.593+0000 7f47b4a8b700 1 -- 172.21.15.72:0/439091996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b009f650 msgr2=0x7f47b01c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.593+0000 7f47b4a8b700 1 --2- 172.21.15.72:0/439091996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b009f650 0x7f47b01c8050 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f47b00a1bf0 tx=0x7f47a8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.593+0000 7f47b4a8b700 1 -- 172.21.15.72:0/439091996 shutdown_connections 2023-10-03T10:17:31.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.593+0000 7f47b4a8b700 1 --2- 172.21.15.72:0/439091996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47b009f650 0x7f47b01c8050 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.593+0000 7f47b4a8b700 1 --2- 172.21.15.72:0/439091996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f47b009e930 0x7f47b006c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.593+0000 7f47b4a8b700 1 --2- 172.21.15.72:0/439091996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47b009f240 0x7f47b006c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.593+0000 7f47b4a8b700 1 -- 172.21.15.72:0/439091996 >> 172.21.15.72:0/439091996 conn(0x7f47b00a4210 msgr2=0x7f47b00a27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.593+0000 7f47b4a8b700 1 -- 172.21.15.72:0/439091996 shutdown_connections 2023-10-03T10:17:31.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:31.593+0000 7f47b4a8b700 1 -- 172.21.15.72:0/439091996 wait complete. 2023-10-03T10:17:31.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:32.024 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.152+0000 7fde7eac0700 1 Processor -- start 2023-10-03T10:17:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.152+0000 7fde7eac0700 1 -- start start 2023-10-03T10:17:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.152+0000 7fde7eac0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fde7812cf60 0x7fde7806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.152+0000 7fde7eac0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde7812f8b0 0x7fde7812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.152+0000 7fde7eac0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7812cd90 con 0x7fde78130260 2023-10-03T10:17:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.152+0000 7fde7eac0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7812d330 con 0x7fde7812cf60 2023-10-03T10:17:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.152+0000 7fde7eac0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde781306d0 con 0x7fde7812f8b0 2023-10-03T10:17:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.152+0000 7fde77fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde7812f8b0 0x7fde7812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.152+0000 7fde7c85c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fde7812cf60 0x7fde7806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.153+0000 7fde77fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde7812f8b0 0x7fde7812fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37994/0 (socket says 172.21.15.72:37994) 2023-10-03T10:17:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.153+0000 7fde77fff700 1 -- 172.21.15.72:0/2930984168 learned_addr learned my addr 172.21.15.72:0/2930984168 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.153+0000 7fde7c85c700 1 --2- 172.21.15.72:0/2930984168 >> v2:172.21.15.72:3300/0 conn(0x7fde7812cf60 0x7fde7806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57394/0 (socket says 172.21.15.72:57394) 2023-10-03T10:17:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.153+0000 7fde7c85c700 1 -- 172.21.15.72:0/2930984168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde7812f8b0 msgr2=0x7fde7812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.153+0000 7fde7c85c700 1 --2- 172.21.15.72:0/2930984168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde7812f8b0 0x7fde7812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.153+0000 7fde7c85c700 1 -- 172.21.15.72:0/2930984168 >> v1:172.21.15.72:6789/0 conn(0x7fde78130260 legacy=0x7fde78136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.153+0000 7fde7c85c700 1 -- 172.21.15.72:0/2930984168 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde78071780 con 0x7fde7812cf60 2023-10-03T10:17:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.153+0000 7fde777fe700 1 -- 172.21.15.72:0/2930984168 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602883260 0 0) 0x7fde7812cd90 con 0x7fde78130260 2023-10-03T10:17:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.153+0000 7fde77fff700 1 --2- 172.21.15.72:0/2930984168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde7812f8b0 0x7fde7812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.153+0000 7fde7c85c700 1 --2- 172.21.15.72:0/2930984168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7812cf60 0x7fde7806f5d0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00a9e0 tx=0x7fde6c00acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57586dffffdb2c31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.153+0000 7fde777fe700 1 -- 172.21.15.72:0/2930984168 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c00cb70 con 0x7fde7812cf60 2023-10-03T10:17:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.153+0000 7fde777fe700 1 -- 172.21.15.72:0/2930984168 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c00ccd0 con 0x7fde7812cf60 2023-10-03T10:17:32.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.153+0000 7fde777fe700 1 -- 172.21.15.72:0/2930984168 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c018620 con 0x7fde7812cf60 2023-10-03T10:17:32.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.154+0000 7fde7eac0700 1 -- 172.21.15.72:0/2930984168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7812cf60 msgr2=0x7fde7806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.154+0000 7fde7eac0700 1 --2- 172.21.15.72:0/2930984168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7812cf60 0x7fde7806f5d0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00a9e0 tx=0x7fde6c00acf0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.154+0000 7fde7eac0700 1 -- 172.21.15.72:0/2930984168 shutdown_connections 2023-10-03T10:17:32.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.154+0000 7fde7eac0700 1 --2- 172.21.15.72:0/2930984168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7812cf60 0x7fde7806f5d0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.154+0000 7fde7eac0700 1 --2- 172.21.15.72:0/2930984168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde7812f8b0 0x7fde7812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.154+0000 7fde7eac0700 1 -- 172.21.15.72:0/2930984168 >> 172.21.15.72:0/2930984168 conn(0x7fde780a2aa0 msgr2=0x7fde780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.154+0000 7fde7eac0700 1 -- 172.21.15.72:0/2930984168 shutdown_connections 2023-10-03T10:17:32.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.154+0000 7fde7eac0700 1 -- 172.21.15.72:0/2930984168 wait complete. 2023-10-03T10:17:32.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.155+0000 7fde7eac0700 1 Processor -- start 2023-10-03T10:17:32.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.155+0000 7fde7eac0700 1 -- start start 2023-10-03T10:17:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.155+0000 7fde7eac0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7812cf60 0x7fde781c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.155+0000 7fde7eac0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde7812f8b0 0x7fde781c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.155+0000 7fde7eac0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde78130260 0x7fde781c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.155+0000 7fde7eac0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde781c3980 con 0x7fde7812cf60 2023-10-03T10:17:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.155+0000 7fde7eac0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7811db50 con 0x7fde7812f8b0 2023-10-03T10:17:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.155+0000 7fde7eac0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde78067cb0 con 0x7fde78130260 2023-10-03T10:17:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.155+0000 7fde7c85c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7812cf60 0x7fde781c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.155+0000 7fde7c85c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7812cf60 0x7fde781c2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57410/0 (socket says 172.21.15.72:57410) 2023-10-03T10:17:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.155+0000 7fde7c85c700 1 -- 172.21.15.72:0/3361539520 learned_addr learned my addr 172.21.15.72:0/3361539520 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.155+0000 7fde7d05d700 1 --2- 172.21.15.72:0/3361539520 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde78130260 0x7fde781c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.155+0000 7fde77fff700 1 --2- 172.21.15.72:0/3361539520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde7812f8b0 0x7fde781c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.156+0000 7fde7c85c700 1 -- 172.21.15.72:0/3361539520 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde78130260 msgr2=0x7fde781c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.156+0000 7fde7c85c700 1 --2- 172.21.15.72:0/3361539520 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde78130260 0x7fde781c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.156+0000 7fde7c85c700 1 -- 172.21.15.72:0/3361539520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde7812f8b0 msgr2=0x7fde781c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.156+0000 7fde7c85c700 1 --2- 172.21.15.72:0/3361539520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde7812f8b0 0x7fde781c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.156+0000 7fde7c85c700 1 -- 172.21.15.72:0/3361539520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde64009550 con 0x7fde7812cf60 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.156+0000 7fde7c85c700 1 --2- 172.21.15.72:0/3361539520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7812cf60 0x7fde781c2f00 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00a1c0 tx=0x7fde6c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.156+0000 7fde757fa700 1 -- 172.21.15.72:0/3361539520 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c003ab0 con 0x7fde7812cf60 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.156+0000 7fde757fa700 1 -- 172.21.15.72:0/3361539520 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c003c10 con 0x7fde7812cf60 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.156+0000 7fde757fa700 1 -- 172.21.15.72:0/3361539520 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c021480 con 0x7fde7812cf60 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.156+0000 7fde7eac0700 1 -- 172.21.15.72:0/3361539520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6c00a640 con 0x7fde7812cf60 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.156+0000 7fde7eac0700 1 -- 172.21.15.72:0/3361539520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7811c810 con 0x7fde7812cf60 2023-10-03T10:17:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.157+0000 7fde757fa700 1 -- 172.21.15.72:0/3361539520 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde6c018400 con 0x7fde7812cf60 2023-10-03T10:17:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.157+0000 7fde757fa700 1 -- 172.21.15.72:0/3361539520 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fde6c040bf0 con 0x7fde7812cf60 2023-10-03T10:17:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.157+0000 7fde7eac0700 1 -- 172.21.15.72:0/3361539520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7811d990 con 0x7fde7812cf60 2023-10-03T10:17:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.161+0000 7fde757fa700 1 -- 172.21.15.72:0/3361539520 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde6c029770 con 0x7fde7812cf60 2023-10-03T10:17:32.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.347+0000 7fde7eac0700 1 -- 172.21.15.72:0/3361539520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fde78074ea0 con 0x7fde7812cf60 2023-10-03T10:17:32.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.347+0000 7fde757fa700 1 -- 172.21.15.72:0/3361539520 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde6c026030 con 0x7fde7812cf60 2023-10-03T10:17:32.347 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.349+0000 7fde7eac0700 1 -- 172.21.15.72:0/3361539520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7812cf60 msgr2=0x7fde781c2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.349+0000 7fde7eac0700 1 --2- 172.21.15.72:0/3361539520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7812cf60 0x7fde781c2f00 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00a1c0 tx=0x7fde6c0047c0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.349+0000 7fde7eac0700 1 -- 172.21.15.72:0/3361539520 shutdown_connections 2023-10-03T10:17:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.349+0000 7fde7eac0700 1 --2- 172.21.15.72:0/3361539520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7812cf60 0x7fde781c2f00 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.349+0000 7fde7eac0700 1 --2- 172.21.15.72:0/3361539520 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde78130260 0x7fde781c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.349+0000 7fde7eac0700 1 --2- 172.21.15.72:0/3361539520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde7812f8b0 0x7fde781c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.349+0000 7fde7eac0700 1 -- 172.21.15.72:0/3361539520 >> 172.21.15.72:0/3361539520 conn(0x7fde780a2aa0 msgr2=0x7fde7809e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.349+0000 7fde7eac0700 1 -- 172.21.15.72:0/3361539520 shutdown_connections 2023-10-03T10:17:32.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.349+0000 7fde7eac0700 1 -- 172.21.15.72:0/3361539520 wait complete. 2023-10-03T10:17:32.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:32.489 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:32.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:32.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:32.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.617+0000 7f41b9a0c700 1 Processor -- start 2023-10-03T10:17:32.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.617+0000 7f41b9a0c700 1 -- start start 2023-10-03T10:17:32.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.617+0000 7f41b9a0c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41b4130540 0x7f41b4130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.617+0000 7f41b9a0c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41b406fcf0 0x7f41b4138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.617+0000 7f41b9a0c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b40716a0 con 0x7f41b4130e50 2023-10-03T10:17:32.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.617+0000 7f41b9a0c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b409a390 con 0x7f41b4130540 2023-10-03T10:17:32.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.617+0000 7f41b9a0c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b4071290 con 0x7f41b406fcf0 2023-10-03T10:17:32.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.617+0000 7f41b2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41b4130540 0x7f41b4130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.617+0000 7f41b37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41b406fcf0 0x7f41b4138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.617+0000 7f41b2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41b4130540 0x7f41b4130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57418/0 (socket says 172.21.15.72:57418) 2023-10-03T10:17:32.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.617+0000 7f41b37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41b406fcf0 0x7f41b4138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43248/0 (socket says 172.21.15.72:43248) 2023-10-03T10:17:32.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.617+0000 7f41b2ffd700 1 -- 172.21.15.72:0/744323619 learned_addr learned my addr 172.21.15.72:0/744323619 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:32.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.618+0000 7f41b2ffd700 1 -- 172.21.15.72:0/744323619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41b406fcf0 msgr2=0x7f41b4138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.618+0000 7f41b2ffd700 1 --2- 172.21.15.72:0/744323619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41b406fcf0 0x7f41b4138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.618+0000 7f41b2ffd700 1 -- 172.21.15.72:0/744323619 >> v1:172.21.15.72:6789/0 conn(0x7f41b4130e50 legacy=0x7f41b406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.618+0000 7f41b2ffd700 1 -- 172.21.15.72:0/744323619 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b4130340 con 0x7f41b4130540 2023-10-03T10:17:32.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.618+0000 7f41b37fe700 1 --2- 172.21.15.72:0/744323619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41b406fcf0 0x7f41b4138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.618+0000 7f41b2ffd700 1 --2- 172.21.15.72:0/744323619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41b4130540 0x7f41b4130910 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f41a40098f0 tx=0x7f41a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760d230558b9b16d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.618+0000 7f41b1ffb700 1 -- 172.21.15.72:0/744323619 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a400f8a0 con 0x7f41b4130540 2023-10-03T10:17:32.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.618+0000 7f41b1ffb700 1 -- 172.21.15.72:0/744323619 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a400fa00 con 0x7f41b4130540 2023-10-03T10:17:32.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.618+0000 7f41b1ffb700 1 -- 172.21.15.72:0/744323619 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a400fd90 con 0x7f41b4130540 2023-10-03T10:17:32.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.619+0000 7f41b9a0c700 1 -- 172.21.15.72:0/744323619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41b4130540 msgr2=0x7f41b4130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.619+0000 7f41b9a0c700 1 --2- 172.21.15.72:0/744323619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41b4130540 0x7f41b4130910 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f41a40098f0 tx=0x7f41a4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:32.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.619+0000 7f41b9a0c700 1 -- 172.21.15.72:0/744323619 shutdown_connections 2023-10-03T10:17:32.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.619+0000 7f41b9a0c700 1 --2- 172.21.15.72:0/744323619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41b406fcf0 0x7f41b4138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.619+0000 7f41b9a0c700 1 --2- 172.21.15.72:0/744323619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41b4130540 0x7f41b4130910 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.619+0000 7f41b9a0c700 1 -- 172.21.15.72:0/744323619 >> 172.21.15.72:0/744323619 conn(0x7f41b40a2aa0 msgr2=0x7f41b40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.619+0000 7f41b9a0c700 1 -- 172.21.15.72:0/744323619 shutdown_connections 2023-10-03T10:17:32.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.619+0000 7f41b9a0c700 1 -- 172.21.15.72:0/744323619 wait complete. 2023-10-03T10:17:32.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.620+0000 7f41b9a0c700 1 Processor -- start 2023-10-03T10:17:32.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.620+0000 7f41b9a0c700 1 -- start start 2023-10-03T10:17:32.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b9a0c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41b406fcf0 0x7f41b409af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b9a0c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41b4130540 0x7f41b409b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b9a0c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41b4130e50 0x7f41b409ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b9a0c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b411d460 con 0x7f41b4130e50 2023-10-03T10:17:32.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b9a0c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b4128cc0 con 0x7f41b406fcf0 2023-10-03T10:17:32.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b9a0c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41b40718e0 con 0x7f41b4130540 2023-10-03T10:17:32.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41b4130540 0x7f41b409b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41b4130e50 0x7f41b409ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b27fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41b4130540 0x7f41b409b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38014/0 (socket says 172.21.15.72:38014) 2023-10-03T10:17:32.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b27fc700 1 -- 172.21.15.72:0/2568954887 learned_addr learned my addr 172.21.15.72:0/2568954887 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b2ffd700 1 --2- 172.21.15.72:0/2568954887 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41b406fcf0 0x7f41b409af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b2ffd700 1 -- 172.21.15.72:0/2568954887 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41b4130540 msgr2=0x7f41b409b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b2ffd700 1 --2- 172.21.15.72:0/2568954887 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41b4130540 0x7f41b409b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b2ffd700 1 -- 172.21.15.72:0/2568954887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41b4130e50 msgr2=0x7f41b409ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b2ffd700 1 --2- 172.21.15.72:0/2568954887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41b4130e50 0x7f41b409ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b2ffd700 1 -- 172.21.15.72:0/2568954887 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac009a70 con 0x7f41b406fcf0 2023-10-03T10:17:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b27fc700 1 --2- 172.21.15.72:0/2568954887 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41b4130540 0x7f41b409b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b37fe700 1 --2- 172.21.15.72:0/2568954887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41b4130e50 0x7f41b409ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f41b2ffd700 1 --2- 172.21.15.72:0/2568954887 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41b406fcf0 0x7f41b409af80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f41a40098f0 tx=0x7f41a4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.621+0000 7f419bfff700 1 -- 172.21.15.72:0/2568954887 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a4003ab0 con 0x7f41b406fcf0 2023-10-03T10:17:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.622+0000 7f419bfff700 1 -- 172.21.15.72:0/2568954887 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a4003c10 con 0x7f41b406fcf0 2023-10-03T10:17:32.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.622+0000 7f41b9a0c700 1 -- 172.21.15.72:0/2568954887 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a4009550 con 0x7f41b406fcf0 2023-10-03T10:17:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.622+0000 7f419bfff700 1 -- 172.21.15.72:0/2568954887 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a4006bd0 con 0x7f41b406fcf0 2023-10-03T10:17:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.622+0000 7f41b9a0c700 1 -- 172.21.15.72:0/2568954887 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b40a0d50 con 0x7f41b406fcf0 2023-10-03T10:17:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.622+0000 7f419bfff700 1 -- 172.21.15.72:0/2568954887 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f41a4019400 con 0x7f41b406fcf0 2023-10-03T10:17:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.623+0000 7f419bfff700 1 -- 172.21.15.72:0/2568954887 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f41a40403a0 con 0x7f41b406fcf0 2023-10-03T10:17:32.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.623+0000 7f41b9a0c700 1 -- 172.21.15.72:0/2568954887 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b409e520 con 0x7f41b406fcf0 2023-10-03T10:17:32.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.632+0000 7f419bfff700 1 -- 172.21.15.72:0/2568954887 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41a4026020 con 0x7f41b406fcf0 2023-10-03T10:17:32.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.689+0000 7f8291268700 1 Processor -- start 2023-10-03T10:17:32.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.689+0000 7f8291268700 1 -- start start 2023-10-03T10:17:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.690+0000 7f8291268700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828c09d6f0 0x7f828c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.690+0000 7f8291268700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828c09e000 0x7f828c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.690+0000 7f8291268700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c09f130 con 0x7f828c09e410 2023-10-03T10:17:32.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.690+0000 7f8291268700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c09f520 con 0x7f828c09d6f0 2023-10-03T10:17:32.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.690+0000 7f8291268700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f828c09e930 con 0x7f828c09e000 2023-10-03T10:17:32.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.690+0000 7f828b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f828c09e410 0x7f828c130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48496/0 (socket says 172.21.15.72:48496) 2023-10-03T10:17:32.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.690+0000 7f828b7fe700 1 -- 172.21.15.72:0/1772045817 learned_addr learned my addr 172.21.15.72:0/1772045817 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:32.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.690+0000 7f828affd700 1 --2- 172.21.15.72:0/1772045817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828c09d6f0 0x7f828c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.690+0000 7f828a7fc700 1 --2- 172.21.15.72:0/1772045817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828c09e000 0x7f828c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.690+0000 7f828affd700 1 -- 172.21.15.72:0/1772045817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828c09e000 msgr2=0x7f828c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.690+0000 7f828affd700 1 --2- 172.21.15.72:0/1772045817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828c09e000 0x7f828c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.690+0000 7f828affd700 1 -- 172.21.15.72:0/1772045817 >> v1:172.21.15.72:6789/0 conn(0x7f828c09e410 legacy=0x7f828c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.690+0000 7f828affd700 1 -- 172.21.15.72:0/1772045817 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c09b2d0 con 0x7f828c09d6f0 2023-10-03T10:17:32.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.690+0000 7f828a7fc700 1 --2- 172.21.15.72:0/1772045817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828c09e000 0x7f828c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.690+0000 7f8289ffb700 1 -- 172.21.15.72:0/1772045817 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903528662 0 0) 0x7f828c09f130 con 0x7f828c09e410 2023-10-03T10:17:32.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.691+0000 7f828affd700 1 --2- 172.21.15.72:0/1772045817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828c09d6f0 0x7f828c09dac0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f827c009870 tx=0x7f827c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a69df41cfdab26b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.691+0000 7f8289ffb700 1 -- 172.21.15.72:0/1772045817 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c011830 con 0x7f828c09d6f0 2023-10-03T10:17:32.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.691+0000 7f8289ffb700 1 -- 172.21.15.72:0/1772045817 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c011990 con 0x7f828c09d6f0 2023-10-03T10:17:32.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.691+0000 7f8289ffb700 1 -- 172.21.15.72:0/1772045817 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c011d20 con 0x7f828c09d6f0 2023-10-03T10:17:32.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.691+0000 7f8291268700 1 -- 172.21.15.72:0/1772045817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828c09d6f0 msgr2=0x7f828c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.691+0000 7f8291268700 1 --2- 172.21.15.72:0/1772045817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828c09d6f0 0x7f828c09dac0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f827c009870 tx=0x7f827c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:32.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.691+0000 7f8291268700 1 -- 172.21.15.72:0/1772045817 shutdown_connections 2023-10-03T10:17:32.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.691+0000 7f8291268700 1 --2- 172.21.15.72:0/1772045817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828c09d6f0 0x7f828c09dac0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.691+0000 7f8291268700 1 --2- 172.21.15.72:0/1772045817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828c09e000 0x7f828c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.691+0000 7f8291268700 1 -- 172.21.15.72:0/1772045817 >> 172.21.15.72:0/1772045817 conn(0x7f828c066f50 msgr2=0x7f828c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.691+0000 7f8291268700 1 -- 172.21.15.72:0/1772045817 shutdown_connections 2023-10-03T10:17:32.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.692+0000 7f8291268700 1 -- 172.21.15.72:0/1772045817 wait complete. 2023-10-03T10:17:32.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.693+0000 7f8291268700 1 Processor -- start 2023-10-03T10:17:32.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.693+0000 7f8291268700 1 -- start start 2023-10-03T10:17:32.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.693+0000 7f8291268700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828c09d6f0 0x7f828c131670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.693+0000 7f8291268700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828c09e000 0x7f828c131bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.693+0000 7f8291268700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f828c09e410 0x7f828c1320f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.693+0000 7f8291268700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c1341c0 con 0x7f828c09e410 2023-10-03T10:17:32.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.693+0000 7f8291268700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c132b90 con 0x7f828c09d6f0 2023-10-03T10:17:32.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.693+0000 7f8291268700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f828c1346e0 con 0x7f828c09e000 2023-10-03T10:17:32.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.693+0000 7f828b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f828c09e410 0x7f828c1320f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.693+0000 7f828affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828c09d6f0 0x7f828c131670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.693+0000 7f828b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f828c09e410 0x7f828c1320f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57430/0 (socket says 172.21.15.72:57430) 2023-10-03T10:17:32.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.693+0000 7f828affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828c09d6f0 0x7f828c131670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43278/0 (socket says 172.21.15.72:43278) 2023-10-03T10:17:32.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.693+0000 7f828b7fe700 1 -- 172.21.15.72:0/1635329665 learned_addr learned my addr 172.21.15.72:0/1635329665 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:32.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.693+0000 7f828a7fc700 1 --2- 172.21.15.72:0/1635329665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828c09e000 0x7f828c131bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.694+0000 7f828b7fe700 1 -- 172.21.15.72:0/1635329665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828c09e000 msgr2=0x7f828c131bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.694+0000 7f828b7fe700 1 --2- 172.21.15.72:0/1635329665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828c09e000 0x7f828c131bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.694+0000 7f828b7fe700 1 -- 172.21.15.72:0/1635329665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828c09d6f0 msgr2=0x7f828c131670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.694+0000 7f828b7fe700 1 --2- 172.21.15.72:0/1635329665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828c09d6f0 0x7f828c131670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.694+0000 7f828b7fe700 1 -- 172.21.15.72:0/1635329665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82800094a0 con 0x7f828c09e410 2023-10-03T10:17:32.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.694+0000 7f828affd700 1 --2- 172.21.15.72:0/1635329665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828c09d6f0 0x7f828c131670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.694+0000 7f828b7fe700 1 --2- 172.21.15.72:0/1635329665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f828c09e410 0x7f828c1320f0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f8284002230 tx=0x7f828400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.694+0000 7f82737fe700 1 -- 172.21.15.72:0/1635329665 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400aac0 con 0x7f828c09e410 2023-10-03T10:17:32.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.694+0000 7f82737fe700 1 -- 172.21.15.72:0/1635329665 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828400ac40 con 0x7f828c09e410 2023-10-03T10:17:32.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.694+0000 7f8291268700 1 -- 172.21.15.72:0/1635329665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827c0094a0 con 0x7f828c09e410 2023-10-03T10:17:32.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.694+0000 7f82737fe700 1 -- 172.21.15.72:0/1635329665 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82840070d0 con 0x7f828c09e410 2023-10-03T10:17:32.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.694+0000 7f8291268700 1 -- 172.21.15.72:0/1635329665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c09c700 con 0x7f828c09e410 2023-10-03T10:17:32.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.695+0000 7f82737fe700 1 -- 172.21.15.72:0/1635329665 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8284007250 con 0x7f828c09e410 2023-10-03T10:17:32.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.695+0000 7f8291268700 1 -- 172.21.15.72:0/1635329665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c139760 con 0x7f828c09e410 2023-10-03T10:17:32.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.695+0000 7f82737fe700 1 -- 172.21.15.72:0/1635329665 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f828403f500 con 0x7f828c09e410 2023-10-03T10:17:32.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.700+0000 7f82737fe700 1 -- 172.21.15.72:0/1635329665 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8284007500 con 0x7f828c09e410 2023-10-03T10:17:32.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.735+0000 7f17b51a3700 1 Processor -- start 2023-10-03T10:17:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.735+0000 7f17b51a3700 1 -- start start 2023-10-03T10:17:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.735+0000 7f17b51a3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17b0133420 0x7f17b01337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.735+0000 7f17b51a3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17b0133e30 0x7f17b012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.735+0000 7f17b51a3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b006b990 con 0x7f17b0134260 2023-10-03T10:17:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.735+0000 7f17b51a3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b00a0590 con 0x7f17b0133e30 2023-10-03T10:17:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.735+0000 7f17b51a3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b009fb80 con 0x7f17b0133420 2023-10-03T10:17:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.735+0000 7f17af59e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f17b0134260 0x7f17b01304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48506/0 (socket says 172.21.15.72:48506) 2023-10-03T10:17:32.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.735+0000 7f17af59e700 1 -- 172.21.15.72:0/1913567323 learned_addr learned my addr 172.21.15.72:0/1913567323 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.735+0000 7f17ae59c700 1 --2- 172.21.15.72:0/1913567323 >> v2:172.21.15.72:3300/0 conn(0x7f17b0133e30 0x7f17b012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.735+0000 7f17aed9d700 1 --2- 172.21.15.72:0/1913567323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17b0133420 0x7f17b01337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.735+0000 7f17add9b700 1 -- 172.21.15.72:0/1913567323 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591820038 0 0) 0x7f17b006b990 con 0x7f17b0134260 2023-10-03T10:17:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.736+0000 7f17add9b700 1 -- 172.21.15.72:0/1913567323 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17980035b0 con 0x7f17b0134260 2023-10-03T10:17:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.736+0000 7f17aed9d700 1 -- 172.21.15.72:0/1913567323 >> v2:172.21.15.72:3300/0 conn(0x7f17b0133e30 msgr2=0x7f17b012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.736+0000 7f17aed9d700 1 --2- 172.21.15.72:0/1913567323 >> v2:172.21.15.72:3300/0 conn(0x7f17b0133e30 0x7f17b012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.736+0000 7f17aed9d700 1 -- 172.21.15.72:0/1913567323 >> v1:172.21.15.72:6789/0 conn(0x7f17b0134260 legacy=0x7f17b01304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.736+0000 7f17aed9d700 1 -- 172.21.15.72:0/1913567323 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b00a0030 con 0x7f17b0133420 2023-10-03T10:17:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.736+0000 7f17ae59c700 1 --2- 172.21.15.72:0/1913567323 >> v2:172.21.15.72:3300/0 conn(0x7f17b0133e30 0x7f17b012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.736+0000 7f17aed9d700 1 --2- 172.21.15.72:0/1913567323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17b0133420 0x7f17b01337f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009840 tx=0x7f17a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d2008896fa28c6d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.736+0000 7f17add9b700 1 -- 172.21.15.72:0/1913567323 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0011830 con 0x7f17b0133420 2023-10-03T10:17:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.736+0000 7f17add9b700 1 -- 172.21.15.72:0/1913567323 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a0011990 con 0x7f17b0133420 2023-10-03T10:17:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.736+0000 7f17add9b700 1 -- 172.21.15.72:0/1913567323 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0011d20 con 0x7f17b0133420 2023-10-03T10:17:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.736+0000 7f17b51a3700 1 -- 172.21.15.72:0/1913567323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17b0133420 msgr2=0x7f17b01337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.736+0000 7f17b51a3700 1 --2- 172.21.15.72:0/1913567323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17b0133420 0x7f17b01337f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009840 tx=0x7f17a0009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.737+0000 7f17b51a3700 1 -- 172.21.15.72:0/1913567323 shutdown_connections 2023-10-03T10:17:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.737+0000 7f17b51a3700 1 --2- 172.21.15.72:0/1913567323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17b0133420 0x7f17b01337f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.737+0000 7f17b51a3700 1 --2- 172.21.15.72:0/1913567323 >> v2:172.21.15.72:3300/0 conn(0x7f17b0133e30 0x7f17b012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.737+0000 7f17b51a3700 1 -- 172.21.15.72:0/1913567323 >> 172.21.15.72:0/1913567323 conn(0x7f17b00a4210 msgr2=0x7f17b00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.737+0000 7f17b51a3700 1 -- 172.21.15.72:0/1913567323 shutdown_connections 2023-10-03T10:17:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.737+0000 7f17b51a3700 1 -- 172.21.15.72:0/1913567323 wait complete. 2023-10-03T10:17:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.738+0000 7f17b51a3700 1 Processor -- start 2023-10-03T10:17:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.738+0000 7f17b51a3700 1 -- start start 2023-10-03T10:17:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.738+0000 7f17b51a3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17b0133420 0x7f17b009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.738+0000 7f17b51a3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f17b0133e30 0x7f17b009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.738+0000 7f17b51a3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b0134260 0x7f17b009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.738+0000 7f17b51a3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b011f0f0 con 0x7f17b0134260 2023-10-03T10:17:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.738+0000 7f17b51a3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b009ded0 con 0x7f17b0133420 2023-10-03T10:17:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.738+0000 7f17b51a3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17b009dce0 con 0x7f17b0133e30 2023-10-03T10:17:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.738+0000 7f17aed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17b0133420 0x7f17b009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.738+0000 7f17af59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b0134260 0x7f17b009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.738+0000 7f17aed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17b0133420 0x7f17b009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43300/0 (socket says 172.21.15.72:43300) 2023-10-03T10:17:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.738+0000 7f17af59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b0134260 0x7f17b009cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57442/0 (socket says 172.21.15.72:57442) 2023-10-03T10:17:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.738+0000 7f17aed9d700 1 -- 172.21.15.72:0/2943096817 learned_addr learned my addr 172.21.15.72:0/2943096817 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.739+0000 7f17ae59c700 1 --2- 172.21.15.72:0/2943096817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f17b0133e30 0x7f17b009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.739+0000 7f17aed9d700 1 -- 172.21.15.72:0/2943096817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f17b0133e30 msgr2=0x7f17b009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.739+0000 7f17aed9d700 1 --2- 172.21.15.72:0/2943096817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f17b0133e30 0x7f17b009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.739+0000 7f17aed9d700 1 -- 172.21.15.72:0/2943096817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b0134260 msgr2=0x7f17b009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.739+0000 7f17aed9d700 1 --2- 172.21.15.72:0/2943096817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b0134260 0x7f17b009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.739+0000 7f17aed9d700 1 -- 172.21.15.72:0/2943096817 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a40094a0 con 0x7f17b0133420 2023-10-03T10:17:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.739+0000 7f17af59e700 1 --2- 172.21.15.72:0/2943096817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b0134260 0x7f17b009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.739+0000 7f17ae59c700 1 --2- 172.21.15.72:0/2943096817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f17b0133e30 0x7f17b009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.739+0000 7f17aed9d700 1 --2- 172.21.15.72:0/2943096817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17b0133420 0x7f17b009c480 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f17a0000c00 tx=0x7f17a0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.739+0000 7f17977fe700 1 -- 172.21.15.72:0/2943096817 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a00036a0 con 0x7f17b0133420 2023-10-03T10:17:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.739+0000 7f17977fe700 1 -- 172.21.15.72:0/2943096817 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a001f070 con 0x7f17b0133420 2023-10-03T10:17:32.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.739+0000 7f17977fe700 1 -- 172.21.15.72:0/2943096817 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0003a60 con 0x7f17b0133420 2023-10-03T10:17:32.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.739+0000 7f17b51a3700 1 -- 172.21.15.72:0/2943096817 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a00094a0 con 0x7f17b0133420 2023-10-03T10:17:32.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.739+0000 7f17b51a3700 1 -- 172.21.15.72:0/2943096817 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b0131690 con 0x7f17b0133420 2023-10-03T10:17:32.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.740+0000 7f17b51a3700 1 -- 172.21.15.72:0/2943096817 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b0074ea0 con 0x7f17b0133420 2023-10-03T10:17:32.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.740+0000 7f17977fe700 1 -- 172.21.15.72:0/2943096817 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17a0003bc0 con 0x7f17b0133420 2023-10-03T10:17:32.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.740+0000 7f17977fe700 1 -- 172.21.15.72:0/2943096817 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f17a0021070 con 0x7f17b0133420 2023-10-03T10:17:32.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.749+0000 7f17977fe700 1 -- 172.21.15.72:0/2943096817 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17a0010380 con 0x7f17b0133420 2023-10-03T10:17:32.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.831+0000 7f41b9a0c700 1 -- 172.21.15.72:0/2568954887 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f41b4074ea0 con 0x7f41b406fcf0 2023-10-03T10:17:32.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.831+0000 7f419bfff700 1 -- 172.21.15.72:0/2568954887 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f41a401f2f0 con 0x7f41b406fcf0 2023-10-03T10:17:32.831 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:32.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.833+0000 7f41b9a0c700 1 -- 172.21.15.72:0/2568954887 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41b406fcf0 msgr2=0x7f41b409af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.833+0000 7f41b9a0c700 1 --2- 172.21.15.72:0/2568954887 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41b406fcf0 0x7f41b409af80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f41a40098f0 tx=0x7f41a4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:32.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.834+0000 7f41b9a0c700 1 -- 172.21.15.72:0/2568954887 shutdown_connections 2023-10-03T10:17:32.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.834+0000 7f41b9a0c700 1 --2- 172.21.15.72:0/2568954887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41b4130e50 0x7f41b409ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.834+0000 7f41b9a0c700 1 --2- 172.21.15.72:0/2568954887 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f41b406fcf0 0x7f41b409af80 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.834+0000 7f41b9a0c700 1 --2- 172.21.15.72:0/2568954887 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f41b4130540 0x7f41b409b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.834+0000 7f41b9a0c700 1 -- 172.21.15.72:0/2568954887 >> 172.21.15.72:0/2568954887 conn(0x7f41b40a2aa0 msgr2=0x7f41b412d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.834+0000 7f41b9a0c700 1 -- 172.21.15.72:0/2568954887 shutdown_connections 2023-10-03T10:17:32.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.834+0000 7f41b9a0c700 1 -- 172.21.15.72:0/2568954887 wait complete. 2023-10-03T10:17:32.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:32.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.901+0000 7f8291268700 1 -- 172.21.15.72:0/1635329665 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f828c131260 con 0x7f828c09e410 2023-10-03T10:17:32.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.901+0000 7f82737fe700 1 -- 172.21.15.72:0/1635329665 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8284018020 con 0x7f828c09e410 2023-10-03T10:17:32.901 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:32.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.903+0000 7f8291268700 1 -- 172.21.15.72:0/1635329665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f828c09e410 msgr2=0x7f828c1320f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.903+0000 7f8291268700 1 --2- 172.21.15.72:0/1635329665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f828c09e410 0x7f828c1320f0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f8284002230 tx=0x7f828400cf50 comp rx=0 tx=0).stop 2023-10-03T10:17:32.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.903+0000 7f8291268700 1 -- 172.21.15.72:0/1635329665 shutdown_connections 2023-10-03T10:17:32.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.903+0000 7f8291268700 1 --2- 172.21.15.72:0/1635329665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f828c09e410 0x7f828c1320f0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.903+0000 7f8291268700 1 --2- 172.21.15.72:0/1635329665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f828c09d6f0 0x7f828c131670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.903+0000 7f8291268700 1 --2- 172.21.15.72:0/1635329665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f828c09e000 0x7f828c131bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.903+0000 7f8291268700 1 -- 172.21.15.72:0/1635329665 >> 172.21.15.72:0/1635329665 conn(0x7f828c066f50 msgr2=0x7f828c070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.903+0000 7f8291268700 1 -- 172.21.15.72:0/1635329665 shutdown_connections 2023-10-03T10:17:32.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.903+0000 7f8291268700 1 -- 172.21.15.72:0/1635329665 wait complete. 2023-10-03T10:17:32.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:32.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.942+0000 7f17b51a3700 1 -- 172.21.15.72:0/2943096817 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f17b011edd0 con 0x7f17b0133420 2023-10-03T10:17:32.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.943+0000 7f17977fe700 1 -- 172.21.15.72:0/2943096817 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17a0015030 con 0x7f17b0133420 2023-10-03T10:17:32.942 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:32.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.945+0000 7f17b51a3700 1 -- 172.21.15.72:0/2943096817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17b0133420 msgr2=0x7f17b009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.945+0000 7f17b51a3700 1 --2- 172.21.15.72:0/2943096817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17b0133420 0x7f17b009c480 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f17a0000c00 tx=0x7f17a0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:32.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.945+0000 7f17b51a3700 1 -- 172.21.15.72:0/2943096817 shutdown_connections 2023-10-03T10:17:32.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.945+0000 7f17b51a3700 1 --2- 172.21.15.72:0/2943096817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17b0134260 0x7f17b009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.945+0000 7f17b51a3700 1 --2- 172.21.15.72:0/2943096817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f17b0133420 0x7f17b009c480 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.945+0000 7f17b51a3700 1 --2- 172.21.15.72:0/2943096817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f17b0133e30 0x7f17b009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.945+0000 7f17b51a3700 1 -- 172.21.15.72:0/2943096817 >> 172.21.15.72:0/2943096817 conn(0x7f17b00a4210 msgr2=0x7f17b00a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.945+0000 7f17b51a3700 1 -- 172.21.15.72:0/2943096817 shutdown_connections 2023-10-03T10:17:32.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:32.945+0000 7f17b51a3700 1 -- 172.21.15.72:0/2943096817 wait complete. 2023-10-03T10:17:32.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:33.361 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:33.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.486+0000 7f18d9d01700 1 Processor -- start 2023-10-03T10:17:33.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.486+0000 7f18d9d01700 1 -- start start 2023-10-03T10:17:33.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d9d01700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d409d6f0 0x7f18d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d9d01700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d409e000 0x7f18d4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d9d01700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d409f130 con 0x7f18d409e410 2023-10-03T10:17:33.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d9d01700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d409f520 con 0x7f18d409e000 2023-10-03T10:17:33.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d9d01700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18d409e930 con 0x7f18d409d6f0 2023-10-03T10:17:33.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d409e000 0x7f18d4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d409d6f0 0x7f18d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f18d409e410 0x7f18d4130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48508/0 (socket says 172.21.15.72:48508) 2023-10-03T10:17:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d3fff700 1 -- 172.21.15.72:0/775055161 learned_addr learned my addr 172.21.15.72:0/775055161 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d27fc700 1 -- 172.21.15.72:0/775055161 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818520715 0 0) 0x7f18d409f130 con 0x7f18d409e410 2023-10-03T10:17:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d2ffd700 1 -- 172.21.15.72:0/775055161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d409d6f0 msgr2=0x7f18d409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d2ffd700 1 --2- 172.21.15.72:0/775055161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d409d6f0 0x7f18d409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d2ffd700 1 -- 172.21.15.72:0/775055161 >> v1:172.21.15.72:6789/0 conn(0x7f18d409e410 legacy=0x7f18d4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d2ffd700 1 -- 172.21.15.72:0/775055161 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d409b2d0 con 0x7f18d409e000 2023-10-03T10:17:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d37fe700 1 --2- 172.21.15.72:0/775055161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d409d6f0 0x7f18d409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d2ffd700 1 --2- 172.21.15.72:0/775055161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d409e000 0x7f18d4130660 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009870 tx=0x7f18c4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f109f45344eb2405 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d27fc700 1 -- 172.21.15.72:0/775055161 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4011830 con 0x7f18d409e000 2023-10-03T10:17:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d27fc700 1 -- 172.21.15.72:0/775055161 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c4011990 con 0x7f18d409e000 2023-10-03T10:17:33.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.487+0000 7f18d27fc700 1 -- 172.21.15.72:0/775055161 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4011d20 con 0x7f18d409e000 2023-10-03T10:17:33.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.488+0000 7f18d9d01700 1 -- 172.21.15.72:0/775055161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d409e000 msgr2=0x7f18d4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.488+0000 7f18d9d01700 1 --2- 172.21.15.72:0/775055161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d409e000 0x7f18d4130660 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009870 tx=0x7f18c4009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:33.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.488+0000 7f18d9d01700 1 -- 172.21.15.72:0/775055161 shutdown_connections 2023-10-03T10:17:33.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.488+0000 7f18d9d01700 1 --2- 172.21.15.72:0/775055161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d409d6f0 0x7f18d409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.488+0000 7f18d9d01700 1 --2- 172.21.15.72:0/775055161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d409e000 0x7f18d4130660 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.488+0000 7f18d9d01700 1 -- 172.21.15.72:0/775055161 >> 172.21.15.72:0/775055161 conn(0x7f18d4066f50 msgr2=0x7f18d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.488+0000 7f18d9d01700 1 -- 172.21.15.72:0/775055161 shutdown_connections 2023-10-03T10:17:33.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.488+0000 7f18d9d01700 1 -- 172.21.15.72:0/775055161 wait complete. 2023-10-03T10:17:33.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.489+0000 7f18d9d01700 1 Processor -- start 2023-10-03T10:17:33.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.489+0000 7f18d9d01700 1 -- start start 2023-10-03T10:17:33.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.489+0000 7f18d9d01700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d409d6f0 0x7f18d411ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.489+0000 7f18d9d01700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d409e000 0x7f18d411f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.489+0000 7f18d9d01700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d409e410 0x7f18d411f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.489+0000 7f18d9d01700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d41209f0 con 0x7f18d409e000 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.489+0000 7f18d9d01700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d41226c0 con 0x7f18d409d6f0 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.489+0000 7f18d9d01700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18d4121880 con 0x7f18d409e410 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.489+0000 7f18d37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d409d6f0 0x7f18d411ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.490+0000 7f18d37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d409d6f0 0x7f18d411ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43304/0 (socket says 172.21.15.72:43304) 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.490+0000 7f18d37fe700 1 -- 172.21.15.72:0/265977867 learned_addr learned my addr 172.21.15.72:0/265977867 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.490+0000 7f18d2ffd700 1 --2- 172.21.15.72:0/265977867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d409e000 0x7f18d411f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.490+0000 7f18d3fff700 1 --2- 172.21.15.72:0/265977867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d409e410 0x7f18d411f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.490+0000 7f18d37fe700 1 -- 172.21.15.72:0/265977867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d409e410 msgr2=0x7f18d411f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.490+0000 7f18d37fe700 1 --2- 172.21.15.72:0/265977867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d409e410 0x7f18d411f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.490+0000 7f18d37fe700 1 -- 172.21.15.72:0/265977867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d409e000 msgr2=0x7f18d411f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.490+0000 7f18d37fe700 1 --2- 172.21.15.72:0/265977867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d409e000 0x7f18d411f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.490+0000 7f18d37fe700 1 -- 172.21.15.72:0/265977867 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc0094a0 con 0x7f18d409d6f0 2023-10-03T10:17:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.490+0000 7f18d37fe700 1 --2- 172.21.15.72:0/265977867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d409d6f0 0x7f18d411ede0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00ec10 tx=0x7f18bc00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.490+0000 7f18cbfff700 1 -- 172.21.15.72:0/265977867 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc00c850 con 0x7f18d409d6f0 2023-10-03T10:17:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.490+0000 7f18cbfff700 1 -- 172.21.15.72:0/265977867 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18bc00c9b0 con 0x7f18d409d6f0 2023-10-03T10:17:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.490+0000 7f18d9d01700 1 -- 172.21.15.72:0/265977867 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c40094a0 con 0x7f18d409d6f0 2023-10-03T10:17:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.490+0000 7f18cbfff700 1 -- 172.21.15.72:0/265977867 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc00cd40 con 0x7f18d409d6f0 2023-10-03T10:17:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.490+0000 7f18d9d01700 1 -- 172.21.15.72:0/265977867 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d4072090 con 0x7f18d409d6f0 2023-10-03T10:17:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.491+0000 7f18cbfff700 1 -- 172.21.15.72:0/265977867 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18bc013470 con 0x7f18d409d6f0 2023-10-03T10:17:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.491+0000 7f18cbfff700 1 -- 172.21.15.72:0/265977867 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f18bc03fb70 con 0x7f18d409d6f0 2023-10-03T10:17:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.491+0000 7f18d9d01700 1 -- 172.21.15.72:0/265977867 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d409c760 con 0x7f18d409d6f0 2023-10-03T10:17:33.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.495+0000 7f18cbfff700 1 -- 172.21.15.72:0/265977867 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18bc021080 con 0x7f18d409d6f0 2023-10-03T10:17:33.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.679+0000 7f18d9d01700 1 -- 172.21.15.72:0/265977867 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f18d4074ea0 con 0x7f18d409d6f0 2023-10-03T10:17:33.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.680+0000 7f18cbfff700 1 -- 172.21.15.72:0/265977867 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18bc00cea0 con 0x7f18d409d6f0 2023-10-03T10:17:33.679 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:33.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.682+0000 7f18d9d01700 1 -- 172.21.15.72:0/265977867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d409d6f0 msgr2=0x7f18d411ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.682+0000 7f18d9d01700 1 --2- 172.21.15.72:0/265977867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d409d6f0 0x7f18d411ede0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00ec10 tx=0x7f18bc00ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:33.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.682+0000 7f18d9d01700 1 -- 172.21.15.72:0/265977867 shutdown_connections 2023-10-03T10:17:33.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.682+0000 7f18d9d01700 1 --2- 172.21.15.72:0/265977867 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f18d409e410 0x7f18d411f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.682+0000 7f18d9d01700 1 --2- 172.21.15.72:0/265977867 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18d409d6f0 0x7f18d411ede0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.682+0000 7f18d9d01700 1 --2- 172.21.15.72:0/265977867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18d409e000 0x7f18d411f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.682+0000 7f18d9d01700 1 -- 172.21.15.72:0/265977867 >> 172.21.15.72:0/265977867 conn(0x7f18d4066f50 msgr2=0x7f18d41309b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.682+0000 7f18d9d01700 1 -- 172.21.15.72:0/265977867 shutdown_connections 2023-10-03T10:17:33.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.682+0000 7f18d9d01700 1 -- 172.21.15.72:0/265977867 wait complete. 2023-10-03T10:17:33.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:33.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:33.915 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:33.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:33.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.974+0000 7fd591a95700 1 Processor -- start 2023-10-03T10:17:33.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.974+0000 7fd591a95700 1 -- start start 2023-10-03T10:17:33.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.975+0000 7fd591a95700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd58c130540 0x7fd58c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.975+0000 7fd591a95700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd58c130e50 0x7fd58c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.975+0000 7fd591a95700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58c0716a0 con 0x7fd58c06fb20 2023-10-03T10:17:33.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.975+0000 7fd591a95700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58c09a390 con 0x7fd58c130e50 2023-10-03T10:17:33.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.975+0000 7fd591a95700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c071290 con 0x7fd58c130540 2023-10-03T10:17:33.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.975+0000 7fd58b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd58c130540 0x7fd58c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.975+0000 7fd58b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd58c130540 0x7fd58c130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43318/0 (socket says 172.21.15.72:43318) 2023-10-03T10:17:33.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.975+0000 7fd58b7fe700 1 -- 172.21.15.72:0/1483302482 learned_addr learned my addr 172.21.15.72:0/1483302482 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:33.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.975+0000 7fd58affd700 1 --2- 172.21.15.72:0/1483302482 >> v2:172.21.15.72:3300/0 conn(0x7fd58c130e50 0x7fd58c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.975+0000 7fd58affd700 1 -- 172.21.15.72:0/1483302482 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd58c130540 msgr2=0x7fd58c130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.975+0000 7fd58affd700 1 --2- 172.21.15.72:0/1483302482 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd58c130540 0x7fd58c130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.975+0000 7fd58affd700 1 -- 172.21.15.72:0/1483302482 >> v1:172.21.15.72:6789/0 conn(0x7fd58c06fb20 legacy=0x7fd58c137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.975+0000 7fd58a7fc700 1 -- 172.21.15.72:0/1483302482 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568466345 0 0) 0x7fd58c0716a0 con 0x7fd58c06fb20 2023-10-03T10:17:33.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.975+0000 7fd58affd700 1 -- 172.21.15.72:0/1483302482 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c130340 con 0x7fd58c130e50 2023-10-03T10:17:33.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.975+0000 7fd58affd700 1 --2- 172.21.15.72:0/1483302482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd58c130e50 0x7fd58c06f5e0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fd580009840 tx=0x7fd580009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47dfc55c48bfe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.976+0000 7fd58a7fc700 1 -- 172.21.15.72:0/1483302482 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580011830 con 0x7fd58c130e50 2023-10-03T10:17:33.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.976+0000 7fd58a7fc700 1 -- 172.21.15.72:0/1483302482 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd580011990 con 0x7fd58c130e50 2023-10-03T10:17:33.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.976+0000 7fd58a7fc700 1 -- 172.21.15.72:0/1483302482 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580011d00 con 0x7fd58c130e50 2023-10-03T10:17:33.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.976+0000 7fd591a95700 1 -- 172.21.15.72:0/1483302482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd58c130e50 msgr2=0x7fd58c06f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.976+0000 7fd591a95700 1 --2- 172.21.15.72:0/1483302482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd58c130e50 0x7fd58c06f5e0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fd580009840 tx=0x7fd580009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:33.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.976+0000 7fd591a95700 1 -- 172.21.15.72:0/1483302482 shutdown_connections 2023-10-03T10:17:33.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.976+0000 7fd591a95700 1 --2- 172.21.15.72:0/1483302482 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd58c130540 0x7fd58c130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.976+0000 7fd591a95700 1 --2- 172.21.15.72:0/1483302482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd58c130e50 0x7fd58c06f5e0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.976+0000 7fd591a95700 1 -- 172.21.15.72:0/1483302482 >> 172.21.15.72:0/1483302482 conn(0x7fd58c0a2aa0 msgr2=0x7fd58c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.976+0000 7fd591a95700 1 -- 172.21.15.72:0/1483302482 shutdown_connections 2023-10-03T10:17:33.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.976+0000 7fd591a95700 1 -- 172.21.15.72:0/1483302482 wait complete. 2023-10-03T10:17:33.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.978+0000 7fd591a95700 1 Processor -- start 2023-10-03T10:17:33.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.978+0000 7fd591a95700 1 -- start start 2023-10-03T10:17:33.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.978+0000 7fd591a95700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd58c06fb20 0x7fd58c12abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.978+0000 7fd591a95700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd58c130540 0x7fd58c12b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.978+0000 7fd591a95700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd58c130e50 0x7fd58c1c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.978+0000 7fd591a95700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c12c0c0 con 0x7fd58c06fb20 2023-10-03T10:17:33.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.978+0000 7fd591a95700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c12bed0 con 0x7fd58c130540 2023-10-03T10:17:33.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.978+0000 7fd591a95700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c12db70 con 0x7fd58c130e50 2023-10-03T10:17:33.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd58affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd58c130540 0x7fd58c12b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd58affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd58c130540 0x7fd58c12b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43334/0 (socket says 172.21.15.72:43334) 2023-10-03T10:17:33.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd58affd700 1 -- 172.21.15.72:0/2819843247 learned_addr learned my addr 172.21.15.72:0/2819843247 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:33.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd58b7fe700 1 --2- 172.21.15.72:0/2819843247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd58c06fb20 0x7fd58c12abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd58b7fe700 1 -- 172.21.15.72:0/2819843247 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd58c130e50 msgr2=0x7fd58c1c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd58b7fe700 1 --2- 172.21.15.72:0/2819843247 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd58c130e50 0x7fd58c1c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd58b7fe700 1 -- 172.21.15.72:0/2819843247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd58c130540 msgr2=0x7fd58c12b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd58b7fe700 1 --2- 172.21.15.72:0/2819843247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd58c130540 0x7fd58c12b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd58b7fe700 1 -- 172.21.15.72:0/2819843247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5800094a0 con 0x7fd58c06fb20 2023-10-03T10:17:33.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd58affd700 1 --2- 172.21.15.72:0/2819843247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd58c130540 0x7fd58c12b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd58b7fe700 1 --2- 172.21.15.72:0/2819843247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd58c06fb20 0x7fd58c12abe0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fd57c007b20 tx=0x7fd57c007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd573fff700 1 -- 172.21.15.72:0/2819843247 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c00da90 con 0x7fd58c06fb20 2023-10-03T10:17:33.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd573fff700 1 -- 172.21.15.72:0/2819843247 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c00f040 con 0x7fd58c06fb20 2023-10-03T10:17:33.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd591a95700 1 -- 172.21.15.72:0/2819843247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58c1397d0 con 0x7fd58c06fb20 2023-10-03T10:17:33.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd573fff700 1 -- 172.21.15.72:0/2819843247 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c00ddf0 con 0x7fd58c06fb20 2023-10-03T10:17:33.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.979+0000 7fd591a95700 1 -- 172.21.15.72:0/2819843247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58c071930 con 0x7fd58c06fb20 2023-10-03T10:17:33.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.980+0000 7fd573fff700 1 -- 172.21.15.72:0/2819843247 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd57c015400 con 0x7fd58c06fb20 2023-10-03T10:17:33.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.980+0000 7fd573fff700 1 -- 172.21.15.72:0/2819843247 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd57c03f370 con 0x7fd58c06fb20 2023-10-03T10:17:33.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.981+0000 7fd591a95700 1 -- 172.21.15.72:0/2819843247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58c12d7a0 con 0x7fd58c06fb20 2023-10-03T10:17:33.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:33.986+0000 7fd573fff700 1 -- 172.21.15.72:0/2819843247 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd57c013710 con 0x7fd58c06fb20 2023-10-03T10:17:34.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.045+0000 7ff36a4d2700 1 Processor -- start 2023-10-03T10:17:34.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.046+0000 7ff36a4d2700 1 -- start start 2023-10-03T10:17:34.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.046+0000 7ff36a4d2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3640a0a30 0x7ff3640a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.046+0000 7ff36a4d2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff364134170 0x7ff36413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.046+0000 7ff36a4d2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36409edd0 con 0x7ff3640a1340 2023-10-03T10:17:34.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.046+0000 7ff36a4d2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36409e1f0 con 0x7ff364134170 2023-10-03T10:17:34.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.046+0000 7ff36a4d2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff36409dc50 con 0x7ff3640a0a30 2023-10-03T10:17:34.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.046+0000 7ff363fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3640a0a30 0x7ff3640a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.046+0000 7ff363fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3640a0a30 0x7ff3640a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38094/0 (socket says 172.21.15.72:38094) 2023-10-03T10:17:34.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.046+0000 7ff363fff700 1 -- 172.21.15.72:0/2328124462 learned_addr learned my addr 172.21.15.72:0/2328124462 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:34.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.046+0000 7ff368a6f700 1 --2- 172.21.15.72:0/2328124462 >> v2:172.21.15.72:3300/0 conn(0x7ff364134170 0x7ff36413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.047+0000 7ff368a6f700 1 -- 172.21.15.72:0/2328124462 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3640a0a30 msgr2=0x7ff3640a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:34.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.047+0000 7ff368a6f700 1 --2- 172.21.15.72:0/2328124462 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3640a0a30 0x7ff3640a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.047+0000 7ff368a6f700 1 -- 172.21.15.72:0/2328124462 >> v1:172.21.15.72:6789/0 conn(0x7ff3640a1340 legacy=0x7ff364133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.047+0000 7ff368a6f700 1 -- 172.21.15.72:0/2328124462 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3640a1fe0 con 0x7ff364134170 2023-10-03T10:17:34.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.047+0000 7ff362ffd700 1 -- 172.21.15.72:0/2328124462 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339670840 0 0) 0x7ff36409edd0 con 0x7ff3640a1340 2023-10-03T10:17:34.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.047+0000 7ff363fff700 1 --2- 172.21.15.72:0/2328124462 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3640a0a30 0x7ff3640a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.047+0000 7ff368a6f700 1 --2- 172.21.15.72:0/2328124462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff364134170 0x7ff36413bd30 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7ff35c009d90 tx=0x7ff35c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b2f0586eb87ff4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.047+0000 7ff362ffd700 1 -- 172.21.15.72:0/2328124462 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c00e070 con 0x7ff364134170 2023-10-03T10:17:34.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.047+0000 7ff362ffd700 1 -- 172.21.15.72:0/2328124462 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c00bb20 con 0x7ff364134170 2023-10-03T10:17:34.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.047+0000 7ff362ffd700 1 -- 172.21.15.72:0/2328124462 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c012430 con 0x7ff364134170 2023-10-03T10:17:34.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.048+0000 7ff36a4d2700 1 -- 172.21.15.72:0/2328124462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff364134170 msgr2=0x7ff36413bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.048+0000 7ff36a4d2700 1 --2- 172.21.15.72:0/2328124462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff364134170 0x7ff36413bd30 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7ff35c009d90 tx=0x7ff35c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:34.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.048+0000 7ff36a4d2700 1 -- 172.21.15.72:0/2328124462 shutdown_connections 2023-10-03T10:17:34.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.048+0000 7ff36a4d2700 1 --2- 172.21.15.72:0/2328124462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff364134170 0x7ff36413bd30 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.048+0000 7ff36a4d2700 1 --2- 172.21.15.72:0/2328124462 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3640a0a30 0x7ff3640a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.048+0000 7ff36a4d2700 1 -- 172.21.15.72:0/2328124462 >> 172.21.15.72:0/2328124462 conn(0x7ff3640a6550 msgr2=0x7ff3640a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.048+0000 7ff36a4d2700 1 -- 172.21.15.72:0/2328124462 shutdown_connections 2023-10-03T10:17:34.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.048+0000 7ff36a4d2700 1 -- 172.21.15.72:0/2328124462 wait complete. 2023-10-03T10:17:34.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.049+0000 7ff36a4d2700 1 Processor -- start 2023-10-03T10:17:34.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.050+0000 7ff36a4d2700 1 -- start start 2023-10-03T10:17:34.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.050+0000 7ff36a4d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3640a0a30 0x7ff364122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.050+0000 7ff36a4d2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3640a1340 0x7ff364122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.050+0000 7ff36a4d2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff364134170 0x7ff364123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.050+0000 7ff36a4d2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff364125f30 con 0x7ff364134170 2023-10-03T10:17:34.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.050+0000 7ff36a4d2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640a4dc0 con 0x7ff3640a0a30 2023-10-03T10:17:34.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.050+0000 7ff36a4d2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640a0220 con 0x7ff3640a1340 2023-10-03T10:17:34.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.050+0000 7ff3637fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3640a1340 0x7ff364122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.050+0000 7ff363fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3640a0a30 0x7ff364122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.050+0000 7ff3637fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3640a1340 0x7ff364122cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38100/0 (socket says 172.21.15.72:38100) 2023-10-03T10:17:34.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.050+0000 7ff3637fe700 1 -- 172.21.15.72:0/3524394078 learned_addr learned my addr 172.21.15.72:0/3524394078 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:34.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.051+0000 7ff368a6f700 1 --2- 172.21.15.72:0/3524394078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff364134170 0x7ff364123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.051+0000 7ff3637fe700 1 -- 172.21.15.72:0/3524394078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3640a0a30 msgr2=0x7ff364122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.051+0000 7ff3637fe700 1 --2- 172.21.15.72:0/3524394078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3640a0a30 0x7ff364122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.051+0000 7ff3637fe700 1 -- 172.21.15.72:0/3524394078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff364134170 msgr2=0x7ff364123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.051+0000 7ff3637fe700 1 --2- 172.21.15.72:0/3524394078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff364134170 0x7ff364123200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.051+0000 7ff3637fe700 1 -- 172.21.15.72:0/3524394078 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff354009550 con 0x7ff3640a1340 2023-10-03T10:17:34.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.051+0000 7ff368a6f700 1 --2- 172.21.15.72:0/3524394078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff364134170 0x7ff364123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:34.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.051+0000 7ff3637fe700 1 --2- 172.21.15.72:0/3524394078 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3640a1340 0x7ff364122cc0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff358001eb0 tx=0x7ff35800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.051+0000 7ff360ff9700 1 -- 172.21.15.72:0/3524394078 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3580054e0 con 0x7ff3640a1340 2023-10-03T10:17:34.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.051+0000 7ff360ff9700 1 -- 172.21.15.72:0/3524394078 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff358003680 con 0x7ff3640a1340 2023-10-03T10:17:34.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.051+0000 7ff36a4d2700 1 -- 172.21.15.72:0/3524394078 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35c009a70 con 0x7ff3640a1340 2023-10-03T10:17:34.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.051+0000 7ff360ff9700 1 -- 172.21.15.72:0/3524394078 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3580039f0 con 0x7ff3640a1340 2023-10-03T10:17:34.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.051+0000 7ff36a4d2700 1 -- 172.21.15.72:0/3524394078 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3641269a0 con 0x7ff3640a1340 2023-10-03T10:17:34.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.052+0000 7ff360ff9700 1 -- 172.21.15.72:0/3524394078 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff358003b50 con 0x7ff3640a1340 2023-10-03T10:17:34.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.052+0000 7ff36a4d2700 1 -- 172.21.15.72:0/3524394078 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff364074ea0 con 0x7ff3640a1340 2023-10-03T10:17:34.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.052+0000 7ff360ff9700 1 -- 172.21.15.72:0/3524394078 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff35803eb40 con 0x7ff3640a1340 2023-10-03T10:17:34.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.057+0000 7ff360ff9700 1 -- 172.21.15.72:0/3524394078 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff35801b3b0 con 0x7ff3640a1340 2023-10-03T10:17:34.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.087+0000 7f6c36c5f700 1 Processor -- start 2023-10-03T10:17:34.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.087+0000 7f6c36c5f700 1 -- start start 2023-10-03T10:17:34.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.088+0000 7f6c36c5f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c300a1510 0x7f6c30138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.088+0000 7f6c36c5f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c30139250 0x7f6c3013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.088+0000 7f6c36c5f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3009edd0 con 0x7f6c300a0a30 2023-10-03T10:17:34.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.088+0000 7f6c36c5f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c300a18e0 con 0x7f6c30139250 2023-10-03T10:17:34.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.088+0000 7f6c36c5f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3009e1f0 con 0x7f6c300a1510 2023-10-03T10:17:34.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.088+0000 7f6c2ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c300a1510 0x7f6c30138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.088+0000 7f6c351fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c30139250 0x7f6c3013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.088+0000 7f6c349fb700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6c300a0a30 0x7f6c300a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48544/0 (socket says 172.21.15.72:48544) 2023-10-03T10:17:34.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.088+0000 7f6c349fb700 1 -- 172.21.15.72:0/3838432716 learned_addr learned my addr 172.21.15.72:0/3838432716 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:34.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.089+0000 7f6c351fc700 1 -- 172.21.15.72:0/3838432716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c300a1510 msgr2=0x7f6c30138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:34.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.089+0000 7f6c351fc700 1 --2- 172.21.15.72:0/3838432716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c300a1510 0x7f6c30138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.089+0000 7f6c351fc700 1 -- 172.21.15.72:0/3838432716 >> v1:172.21.15.72:6789/0 conn(0x7f6c300a0a30 legacy=0x7f6c300a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.089+0000 7f6c351fc700 1 -- 172.21.15.72:0/3838432716 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3009dc50 con 0x7f6c30139250 2023-10-03T10:17:34.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.089+0000 7f6c2f7fe700 1 -- 172.21.15.72:0/3838432716 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714795227 0 0) 0x7f6c3009edd0 con 0x7f6c300a0a30 2023-10-03T10:17:34.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.089+0000 7f6c2ffff700 1 --2- 172.21.15.72:0/3838432716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c300a1510 0x7f6c30138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.089+0000 7f6c351fc700 1 --2- 172.21.15.72:0/3838432716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c30139250 0x7f6c3013b630 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009dc0 tx=0x7f6c2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a1879a0918be32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.089+0000 7f6c2f7fe700 1 -- 172.21.15.72:0/3838432716 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2800e070 con 0x7f6c30139250 2023-10-03T10:17:34.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.089+0000 7f6c2f7fe700 1 -- 172.21.15.72:0/3838432716 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2800bae0 con 0x7f6c30139250 2023-10-03T10:17:34.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.089+0000 7f6c2f7fe700 1 -- 172.21.15.72:0/3838432716 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2800be90 con 0x7f6c30139250 2023-10-03T10:17:34.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.089+0000 7f6c36c5f700 1 -- 172.21.15.72:0/3838432716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c30139250 msgr2=0x7f6c3013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.089+0000 7f6c36c5f700 1 --2- 172.21.15.72:0/3838432716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c30139250 0x7f6c3013b630 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009dc0 tx=0x7f6c2800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:34.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.090+0000 7f6c36c5f700 1 -- 172.21.15.72:0/3838432716 shutdown_connections 2023-10-03T10:17:34.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.090+0000 7f6c36c5f700 1 --2- 172.21.15.72:0/3838432716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c30139250 0x7f6c3013b630 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.090+0000 7f6c36c5f700 1 --2- 172.21.15.72:0/3838432716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c300a1510 0x7f6c30138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.090+0000 7f6c36c5f700 1 -- 172.21.15.72:0/3838432716 >> 172.21.15.72:0/3838432716 conn(0x7f6c300a6550 msgr2=0x7f6c300a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.090+0000 7f6c36c5f700 1 -- 172.21.15.72:0/3838432716 shutdown_connections 2023-10-03T10:17:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.090+0000 7f6c36c5f700 1 -- 172.21.15.72:0/3838432716 wait complete. 2023-10-03T10:17:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.090+0000 7f6c36c5f700 1 Processor -- start 2023-10-03T10:17:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.090+0000 7f6c36c5f700 1 -- start start 2023-10-03T10:17:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.091+0000 7f6c36c5f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c300a0a30 0x7f6c30122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.091+0000 7f6c36c5f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c300a1510 0x7f6c30122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.091+0000 7f6c36c5f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c30139250 0x7f6c30123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.091+0000 7f6c36c5f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c30125950 con 0x7f6c300a1510 2023-10-03T10:17:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.091+0000 7f6c36c5f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c30124320 con 0x7f6c300a0a30 2023-10-03T10:17:34.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.091+0000 7f6c36c5f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c30138070 con 0x7f6c30139250 2023-10-03T10:17:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.091+0000 7f6c349fb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c300a0a30 0x7f6c30122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.091+0000 7f6c349fb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c300a0a30 0x7f6c30122710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43352/0 (socket says 172.21.15.72:43352) 2023-10-03T10:17:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.091+0000 7f6c349fb700 1 -- 172.21.15.72:0/2934405102 learned_addr learned my addr 172.21.15.72:0/2934405102 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.091+0000 7f6c351fc700 1 --2- 172.21.15.72:0/2934405102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c30139250 0x7f6c30123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.091+0000 7f6c2ffff700 1 --2- 172.21.15.72:0/2934405102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c300a1510 0x7f6c30122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.092+0000 7f6c349fb700 1 -- 172.21.15.72:0/2934405102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c30139250 msgr2=0x7f6c30123190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.092+0000 7f6c349fb700 1 --2- 172.21.15.72:0/2934405102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c30139250 0x7f6c30123190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.092+0000 7f6c349fb700 1 -- 172.21.15.72:0/2934405102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c300a1510 msgr2=0x7f6c30122c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.092+0000 7f6c349fb700 1 --2- 172.21.15.72:0/2934405102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c300a1510 0x7f6c30122c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.092+0000 7f6c349fb700 1 -- 172.21.15.72:0/2934405102 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c0094a0 con 0x7f6c300a0a30 2023-10-03T10:17:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.092+0000 7f6c349fb700 1 --2- 172.21.15.72:0/2934405102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c300a0a30 0x7f6c30122710 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c550 tx=0x7f6c2400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.092+0000 7f6c2d7fa700 1 -- 172.21.15.72:0/2934405102 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24004c80 con 0x7f6c300a0a30 2023-10-03T10:17:34.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.092+0000 7f6c2d7fa700 1 -- 172.21.15.72:0/2934405102 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c24004de0 con 0x7f6c300a0a30 2023-10-03T10:17:34.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.092+0000 7f6c2d7fa700 1 -- 172.21.15.72:0/2934405102 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24007310 con 0x7f6c300a0a30 2023-10-03T10:17:34.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.092+0000 7f6c36c5f700 1 -- 172.21.15.72:0/2934405102 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c28009a70 con 0x7f6c300a0a30 2023-10-03T10:17:34.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.092+0000 7f6c36c5f700 1 -- 172.21.15.72:0/2934405102 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c300a0220 con 0x7f6c300a0a30 2023-10-03T10:17:34.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.093+0000 7f6c36c5f700 1 -- 172.21.15.72:0/2934405102 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c30138660 con 0x7f6c300a0a30 2023-10-03T10:17:34.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.093+0000 7f6c2d7fa700 1 -- 172.21.15.72:0/2934405102 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c24007470 con 0x7f6c300a0a30 2023-10-03T10:17:34.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.093+0000 7f6c2d7fa700 1 -- 172.21.15.72:0/2934405102 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6c2403f260 con 0x7f6c300a0a30 2023-10-03T10:17:34.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.098+0000 7f6c2d7fa700 1 -- 172.21.15.72:0/2934405102 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c240133c0 con 0x7f6c300a0a30 2023-10-03T10:17:34.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.183+0000 7fd591a95700 1 -- 172.21.15.72:0/2819843247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd58c12cba0 con 0x7fd58c06fb20 2023-10-03T10:17:34.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.183+0000 7fd573fff700 1 -- 172.21.15.72:0/2819843247 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd57c01a020 con 0x7fd58c06fb20 2023-10-03T10:17:34.183 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:34.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.185+0000 7fd591a95700 1 -- 172.21.15.72:0/2819843247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd58c06fb20 msgr2=0x7fd58c12abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.185+0000 7fd591a95700 1 --2- 172.21.15.72:0/2819843247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd58c06fb20 0x7fd58c12abe0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fd57c007b20 tx=0x7fd57c007e30 comp rx=0 tx=0).stop 2023-10-03T10:17:34.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.185+0000 7fd591a95700 1 -- 172.21.15.72:0/2819843247 shutdown_connections 2023-10-03T10:17:34.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.185+0000 7fd591a95700 1 --2- 172.21.15.72:0/2819843247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd58c06fb20 0x7fd58c12abe0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.185+0000 7fd591a95700 1 --2- 172.21.15.72:0/2819843247 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd58c130e50 0x7fd58c1c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.185+0000 7fd591a95700 1 --2- 172.21.15.72:0/2819843247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd58c130540 0x7fd58c12b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.185+0000 7fd591a95700 1 -- 172.21.15.72:0/2819843247 >> 172.21.15.72:0/2819843247 conn(0x7fd58c0a2aa0 msgr2=0x7fd58c06e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.186+0000 7fd591a95700 1 -- 172.21.15.72:0/2819843247 shutdown_connections 2023-10-03T10:17:34.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.186+0000 7fd591a95700 1 -- 172.21.15.72:0/2819843247 wait complete. 2023-10-03T10:17:34.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:34.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.252+0000 7ff36a4d2700 1 -- 172.21.15.72:0/3524394078 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff3640a28e0 con 0x7ff3640a1340 2023-10-03T10:17:34.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.252+0000 7ff360ff9700 1 -- 172.21.15.72:0/3524394078 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff358017030 con 0x7ff3640a1340 2023-10-03T10:17:34.252 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.254+0000 7ff36a4d2700 1 -- 172.21.15.72:0/3524394078 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3640a1340 msgr2=0x7ff364122cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.254+0000 7ff36a4d2700 1 --2- 172.21.15.72:0/3524394078 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3640a1340 0x7ff364122cc0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff358001eb0 tx=0x7ff35800c800 comp rx=0 tx=0).stop 2023-10-03T10:17:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.254+0000 7ff36a4d2700 1 -- 172.21.15.72:0/3524394078 shutdown_connections 2023-10-03T10:17:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.254+0000 7ff36a4d2700 1 --2- 172.21.15.72:0/3524394078 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff364134170 0x7ff364123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.254+0000 7ff36a4d2700 1 --2- 172.21.15.72:0/3524394078 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3640a0a30 0x7ff364122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.254+0000 7ff36a4d2700 1 --2- 172.21.15.72:0/3524394078 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3640a1340 0x7ff364122cc0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.254+0000 7ff36a4d2700 1 -- 172.21.15.72:0/3524394078 >> 172.21.15.72:0/3524394078 conn(0x7ff3640a6550 msgr2=0x7ff36409edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.254+0000 7ff36a4d2700 1 -- 172.21.15.72:0/3524394078 shutdown_connections 2023-10-03T10:17:34.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.254+0000 7ff36a4d2700 1 -- 172.21.15.72:0/3524394078 wait complete. 2023-10-03T10:17:34.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.291+0000 7f6c36c5f700 1 -- 172.21.15.72:0/2934405102 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6c30074ea0 con 0x7f6c300a0a30 2023-10-03T10:17:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.292+0000 7f6c2d7fa700 1 -- 172.21.15.72:0/2934405102 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c24011360 con 0x7f6c300a0a30 2023-10-03T10:17:34.291 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:34.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.294+0000 7f6c36c5f700 1 -- 172.21.15.72:0/2934405102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c300a0a30 msgr2=0x7f6c30122710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.294+0000 7f6c36c5f700 1 --2- 172.21.15.72:0/2934405102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c300a0a30 0x7f6c30122710 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c550 tx=0x7f6c2400c860 comp rx=0 tx=0).stop 2023-10-03T10:17:34.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.294+0000 7f6c36c5f700 1 -- 172.21.15.72:0/2934405102 shutdown_connections 2023-10-03T10:17:34.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.294+0000 7f6c36c5f700 1 --2- 172.21.15.72:0/2934405102 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c30139250 0x7f6c30123190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.294+0000 7f6c36c5f700 1 --2- 172.21.15.72:0/2934405102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c300a0a30 0x7f6c30122710 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.294+0000 7f6c36c5f700 1 --2- 172.21.15.72:0/2934405102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c300a1510 0x7f6c30122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.294+0000 7f6c36c5f700 1 -- 172.21.15.72:0/2934405102 >> 172.21.15.72:0/2934405102 conn(0x7f6c300a6550 msgr2=0x7f6c3011c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.294+0000 7f6c36c5f700 1 -- 172.21.15.72:0/2934405102 shutdown_connections 2023-10-03T10:17:34.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.294+0000 7f6c36c5f700 1 -- 172.21.15.72:0/2934405102 wait complete. 2023-10-03T10:17:34.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:34.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:34.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.824+0000 7f0b1d221700 1 Processor -- start 2023-10-03T10:17:34.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.824+0000 7f0b1d221700 1 -- start start 2023-10-03T10:17:34.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.824+0000 7f0b1d221700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1809d6f0 0x7f0b1809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.824+0000 7f0b1d221700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b1809e410 0x7f0b18134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.824+0000 7f0b1d221700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1809b120 con 0x7f0b1809e000 2023-10-03T10:17:34.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.824+0000 7f0b1d221700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1806b460 con 0x7f0b1809e410 2023-10-03T10:17:34.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.824+0000 7f0b1d221700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1809a7e0 con 0x7f0b1809d6f0 2023-10-03T10:17:34.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.824+0000 7f0b1759e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b1809e410 0x7f0b18134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.824+0000 7f0b1759e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b1809e410 0x7f0b18134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57526/0 (socket says 172.21.15.72:57526) 2023-10-03T10:17:34.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.824+0000 7f0b1759e700 1 -- 172.21.15.72:0/509268586 learned_addr learned my addr 172.21.15.72:0/509268586 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:34.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.824+0000 7f0b16d9d700 1 --2- 172.21.15.72:0/509268586 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1809d6f0 0x7f0b1809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b16d9d700 1 -- 172.21.15.72:0/509268586 >> v2:172.21.15.72:3300/0 conn(0x7f0b1809e410 msgr2=0x7f0b18134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:34.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b16d9d700 1 --2- 172.21.15.72:0/509268586 >> v2:172.21.15.72:3300/0 conn(0x7f0b1809e410 0x7f0b18134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b16d9d700 1 -- 172.21.15.72:0/509268586 >> v1:172.21.15.72:6789/0 conn(0x7f0b1809e000 legacy=0x7f0b181339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b16d9d700 1 -- 172.21.15.72:0/509268586 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1809a500 con 0x7f0b1809d6f0 2023-10-03T10:17:34.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b1759e700 1 --2- 172.21.15.72:0/509268586 >> v2:172.21.15.72:3300/0 conn(0x7f0b1809e410 0x7f0b18134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b16d9d700 1 --2- 172.21.15.72:0/509268586 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1809d6f0 0x7f0b1809dac0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009870 tx=0x7f0b08009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c439883a295a6888 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b15d9b700 1 -- 172.21.15.72:0/509268586 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08011830 con 0x7f0b1809d6f0 2023-10-03T10:17:34.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b15d9b700 1 -- 172.21.15.72:0/509268586 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b08011990 con 0x7f0b1809d6f0 2023-10-03T10:17:34.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b15d9b700 1 -- 172.21.15.72:0/509268586 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08011d20 con 0x7f0b1809d6f0 2023-10-03T10:17:34.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b1d221700 1 -- 172.21.15.72:0/509268586 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1809d6f0 msgr2=0x7f0b1809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b1d221700 1 --2- 172.21.15.72:0/509268586 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1809d6f0 0x7f0b1809dac0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009870 tx=0x7f0b08009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:34.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b1d221700 1 -- 172.21.15.72:0/509268586 shutdown_connections 2023-10-03T10:17:34.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b1d221700 1 --2- 172.21.15.72:0/509268586 >> v2:172.21.15.72:3300/0 conn(0x7f0b1809e410 0x7f0b18134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b1d221700 1 --2- 172.21.15.72:0/509268586 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1809d6f0 0x7f0b1809dac0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b1d221700 1 -- 172.21.15.72:0/509268586 >> 172.21.15.72:0/509268586 conn(0x7f0b18066f50 msgr2=0x7f0b1809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b1d221700 1 -- 172.21.15.72:0/509268586 shutdown_connections 2023-10-03T10:17:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.825+0000 7f0b1d221700 1 -- 172.21.15.72:0/509268586 wait complete. 2023-10-03T10:17:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.827+0000 7f0b1d221700 1 Processor -- start 2023-10-03T10:17:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.827+0000 7f0b1d221700 1 -- start start 2023-10-03T10:17:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.827+0000 7f0b1d221700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b1809d6f0 0x7f0b181a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.827+0000 7f0b1d221700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1809e000 0x7f0b181a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.827+0000 7f0b1d221700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1809e410 0x7f0b181a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.827+0000 7f0b1d221700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b181a9b00 con 0x7f0b1809e000 2023-10-03T10:17:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.827+0000 7f0b1d221700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b181a81d0 con 0x7f0b1809e410 2023-10-03T10:17:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.827+0000 7f0b1d221700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b181a9290 con 0x7f0b1809d6f0 2023-10-03T10:17:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.827+0000 7f0b16d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b1809d6f0 0x7f0b181a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.827+0000 7f0b1659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1809e000 0x7f0b181a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.827+0000 7f0b1759e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1809e410 0x7f0b181a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.827+0000 7f0b16d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b1809d6f0 0x7f0b181a6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38116/0 (socket says 172.21.15.72:38116) 2023-10-03T10:17:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.827+0000 7f0b1659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1809e000 0x7f0b181a65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57528/0 (socket says 172.21.15.72:57528) 2023-10-03T10:17:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.827+0000 7f0b16d9d700 1 -- 172.21.15.72:0/3070610598 learned_addr learned my addr 172.21.15.72:0/3070610598 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.828+0000 7f0b16d9d700 1 -- 172.21.15.72:0/3070610598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1809e410 msgr2=0x7f0b181a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.828+0000 7f0b16d9d700 1 --2- 172.21.15.72:0/3070610598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1809e410 0x7f0b181a6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.828+0000 7f0b16d9d700 1 -- 172.21.15.72:0/3070610598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1809e000 msgr2=0x7f0b181a65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.828+0000 7f0b16d9d700 1 --2- 172.21.15.72:0/3070610598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1809e000 0x7f0b181a65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.828+0000 7f0b16d9d700 1 -- 172.21.15.72:0/3070610598 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b10009b30 con 0x7f0b1809d6f0 2023-10-03T10:17:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.828+0000 7f0b1759e700 1 --2- 172.21.15.72:0/3070610598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1809e410 0x7f0b181a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.828+0000 7f0b1659c700 1 --2- 172.21.15.72:0/3070610598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1809e000 0x7f0b181a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.828+0000 7f0b16d9d700 1 --2- 172.21.15.72:0/3070610598 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b1809d6f0 0x7f0b181a6070 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0b080097c0 tx=0x7f0b08004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.828+0000 7f0aff7fe700 1 -- 172.21.15.72:0/3070610598 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b080036a0 con 0x7f0b1809d6f0 2023-10-03T10:17:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.828+0000 7f0aff7fe700 1 -- 172.21.15.72:0/3070610598 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0801f070 con 0x7f0b1809d6f0 2023-10-03T10:17:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.828+0000 7f0aff7fe700 1 -- 172.21.15.72:0/3070610598 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08003a60 con 0x7f0b1809d6f0 2023-10-03T10:17:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.828+0000 7f0b1d221700 1 -- 172.21.15.72:0/3070610598 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b080094a0 con 0x7f0b1809d6f0 2023-10-03T10:17:34.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.828+0000 7f0b1d221700 1 -- 172.21.15.72:0/3070610598 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1809c760 con 0x7f0b1809d6f0 2023-10-03T10:17:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.829+0000 7f0aff7fe700 1 -- 172.21.15.72:0/3070610598 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b08003bc0 con 0x7f0b1809d6f0 2023-10-03T10:17:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.829+0000 7f0aff7fe700 1 -- 172.21.15.72:0/3070610598 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0b08021070 con 0x7f0b1809d6f0 2023-10-03T10:17:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.829+0000 7f0b1d221700 1 -- 172.21.15.72:0/3070610598 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b18074ea0 con 0x7f0b1809d6f0 2023-10-03T10:17:34.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:34.834+0000 7f0aff7fe700 1 -- 172.21.15.72:0/3070610598 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b0802b080 con 0x7f0b1809d6f0 2023-10-03T10:17:35.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.016+0000 7f0b1d221700 1 -- 172.21.15.72:0/3070610598 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0b181a9680 con 0x7f0b1809d6f0 2023-10-03T10:17:35.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.016+0000 7f0aff7fe700 1 -- 172.21.15.72:0/3070610598 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b181a9680 con 0x7f0b1809d6f0 2023-10-03T10:17:35.016 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:35.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.018+0000 7f0b1d221700 1 -- 172.21.15.72:0/3070610598 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b1809d6f0 msgr2=0x7f0b181a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.018+0000 7f0b1d221700 1 --2- 172.21.15.72:0/3070610598 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b1809d6f0 0x7f0b181a6070 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0b080097c0 tx=0x7f0b08004750 comp rx=0 tx=0).stop 2023-10-03T10:17:35.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.018+0000 7f0b1d221700 1 -- 172.21.15.72:0/3070610598 shutdown_connections 2023-10-03T10:17:35.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.018+0000 7f0b1d221700 1 --2- 172.21.15.72:0/3070610598 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b1809e410 0x7f0b181a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.018+0000 7f0b1d221700 1 --2- 172.21.15.72:0/3070610598 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b1809d6f0 0x7f0b181a6070 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.018+0000 7f0b1d221700 1 --2- 172.21.15.72:0/3070610598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b1809e000 0x7f0b181a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.018+0000 7f0b1d221700 1 -- 172.21.15.72:0/3070610598 >> 172.21.15.72:0/3070610598 conn(0x7f0b18066f50 msgr2=0x7f0b181baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.018+0000 7f0b1d221700 1 -- 172.21.15.72:0/3070610598 shutdown_connections 2023-10-03T10:17:35.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.018+0000 7f0b1d221700 1 -- 172.21.15.72:0/3070610598 wait complete. 2023-10-03T10:17:35.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:35.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:35.266 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:35.305 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:35.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.324+0000 7f15910fb700 1 Processor -- start 2023-10-03T10:17:35.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.324+0000 7f15910fb700 1 -- start start 2023-10-03T10:17:35.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f15910fb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f158c133510 0x7f158c1358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f15910fb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f158c135e30 0x7f158c138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f15910fb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158c1310d0 con 0x7f158c1305f0 2023-10-03T10:17:35.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f15910fb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158c1301c0 con 0x7f158c133510 2023-10-03T10:17:35.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f15910fb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f158c071ff0 con 0x7f158c135e30 2023-10-03T10:17:35.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f158a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f158c133510 0x7f158c1358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f158a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f158c133510 0x7f158c1358f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57536/0 (socket says 172.21.15.72:57536) 2023-10-03T10:17:35.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f158b59e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f158c135e30 0x7f158c138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f158a59c700 1 -- 172.21.15.72:0/3489895850 learned_addr learned my addr 172.21.15.72:0/3489895850 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:35.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f158a59c700 1 -- 172.21.15.72:0/3489895850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f158c135e30 msgr2=0x7f158c138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f158a59c700 1 --2- 172.21.15.72:0/3489895850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f158c135e30 0x7f158c138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f158a59c700 1 -- 172.21.15.72:0/3489895850 >> v1:172.21.15.72:6789/0 conn(0x7f158c1305f0 legacy=0x7f158c1309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f158a59c700 1 -- 172.21.15.72:0/3489895850 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c070e70 con 0x7f158c133510 2023-10-03T10:17:35.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f1589d9b700 1 -- 172.21.15.72:0/3489895850 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559773380 0 0) 0x7f158c1310d0 con 0x7f158c1305f0 2023-10-03T10:17:35.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f158b59e700 1 --2- 172.21.15.72:0/3489895850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f158c135e30 0x7f158c138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.325+0000 7f158a59c700 1 --2- 172.21.15.72:0/3489895850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158c133510 0x7f158c1358f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f158000b9a0 tx=0x7f158000bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628b47b1c1f43b22 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.326+0000 7f1589d9b700 1 -- 172.21.15.72:0/3489895850 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158000caa0 con 0x7f158c133510 2023-10-03T10:17:35.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.326+0000 7f1589d9b700 1 -- 172.21.15.72:0/3489895850 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158000cc00 con 0x7f158c133510 2023-10-03T10:17:35.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.326+0000 7f1589d9b700 1 -- 172.21.15.72:0/3489895850 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158000f460 con 0x7f158c133510 2023-10-03T10:17:35.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.326+0000 7f15910fb700 1 -- 172.21.15.72:0/3489895850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158c133510 msgr2=0x7f158c1358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.326+0000 7f15910fb700 1 --2- 172.21.15.72:0/3489895850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158c133510 0x7f158c1358f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f158000b9a0 tx=0x7f158000bcb0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.326+0000 7f15910fb700 1 -- 172.21.15.72:0/3489895850 shutdown_connections 2023-10-03T10:17:35.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.326+0000 7f15910fb700 1 --2- 172.21.15.72:0/3489895850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f158c135e30 0x7f158c138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.326+0000 7f15910fb700 1 --2- 172.21.15.72:0/3489895850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158c133510 0x7f158c1358f0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.326+0000 7f15910fb700 1 -- 172.21.15.72:0/3489895850 >> 172.21.15.72:0/3489895850 conn(0x7f158c0a2aa0 msgr2=0x7f158c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.326+0000 7f15910fb700 1 -- 172.21.15.72:0/3489895850 shutdown_connections 2023-10-03T10:17:35.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.326+0000 7f15910fb700 1 -- 172.21.15.72:0/3489895850 wait complete. 2023-10-03T10:17:35.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.328+0000 7f15910fb700 1 Processor -- start 2023-10-03T10:17:35.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.328+0000 7f15910fb700 1 -- start start 2023-10-03T10:17:35.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f15910fb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158c1305f0 0x7f158c09b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f15910fb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f158c133510 0x7f158c09b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f15910fb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f158c135e30 0x7f158c1c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f15910fb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c09ada0 con 0x7f158c1305f0 2023-10-03T10:17:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f15910fb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158c09c8a0 con 0x7f158c133510 2023-10-03T10:17:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f15910fb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f158c071820 con 0x7f158c135e30 2023-10-03T10:17:35.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f158ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158c1305f0 0x7f158c09b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f158b59e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f158c135e30 0x7f158c1c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f158ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158c1305f0 0x7f158c09b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57546/0 (socket says 172.21.15.72:57546) 2023-10-03T10:17:35.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f158ad9d700 1 -- 172.21.15.72:0/1883605365 learned_addr learned my addr 172.21.15.72:0/1883605365 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:35.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f158a59c700 1 --2- 172.21.15.72:0/1883605365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f158c133510 0x7f158c09b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f158b59e700 1 -- 172.21.15.72:0/1883605365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f158c133510 msgr2=0x7f158c09b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f158b59e700 1 --2- 172.21.15.72:0/1883605365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f158c133510 0x7f158c09b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f158b59e700 1 -- 172.21.15.72:0/1883605365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158c1305f0 msgr2=0x7f158c09b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f158b59e700 1 --2- 172.21.15.72:0/1883605365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158c1305f0 0x7f158c09b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f158b59e700 1 -- 172.21.15.72:0/1883605365 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158400f050 con 0x7f158c135e30 2023-10-03T10:17:35.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f158a59c700 1 --2- 172.21.15.72:0/1883605365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f158c133510 0x7f158c09b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f158b59e700 1 --2- 172.21.15.72:0/1883605365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f158c135e30 0x7f158c1c4010 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f158400f500 tx=0x7f158400f810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.329+0000 7f15737fe700 1 -- 172.21.15.72:0/1883605365 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584012050 con 0x7f158c135e30 2023-10-03T10:17:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.330+0000 7f15737fe700 1 -- 172.21.15.72:0/1883605365 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1584013040 con 0x7f158c135e30 2023-10-03T10:17:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.330+0000 7f15737fe700 1 -- 172.21.15.72:0/1883605365 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584003e20 con 0x7f158c135e30 2023-10-03T10:17:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.330+0000 7f15910fb700 1 -- 172.21.15.72:0/1883605365 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158000b600 con 0x7f158c135e30 2023-10-03T10:17:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.330+0000 7f15910fb700 1 -- 172.21.15.72:0/1883605365 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158c1190b0 con 0x7f158c135e30 2023-10-03T10:17:35.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.331+0000 7f15910fb700 1 -- 172.21.15.72:0/1883605365 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158c074ea0 con 0x7f158c135e30 2023-10-03T10:17:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.331+0000 7f15737fe700 1 -- 172.21.15.72:0/1883605365 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1584003fe0 con 0x7f158c135e30 2023-10-03T10:17:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.331+0000 7f15737fe700 1 -- 172.21.15.72:0/1883605365 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1584044770 con 0x7f158c135e30 2023-10-03T10:17:35.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.336+0000 7f15737fe700 1 -- 172.21.15.72:0/1883605365 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f158400be20 con 0x7f158c135e30 2023-10-03T10:17:35.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.402+0000 7f6bbc311700 1 Processor -- start 2023-10-03T10:17:35.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.402+0000 7f6bbc311700 1 -- start start 2023-10-03T10:17:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.402+0000 7f6bbc311700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bb409d630 0x7f6bb40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.402+0000 7f6bbc311700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6bb4138d80 0x7f6bb413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.402+0000 7f6bbc311700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb40a2a70 con 0x7f6bb40a0a30 2023-10-03T10:17:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.402+0000 7f6bbc311700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb40a01d0 con 0x7f6bb4138d80 2023-10-03T10:17:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.402+0000 7f6bbc311700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb409e2b0 con 0x7f6bb409d630 2023-10-03T10:17:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.403+0000 7f6bb98ac700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bb409d630 0x7f6bb40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.403+0000 7f6bba0ad700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6bb40a0a30 0x7f6bb40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48578/0 (socket says 172.21.15.72:48578) 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.403+0000 7f6bba0ad700 1 -- 172.21.15.72:0/453338255 learned_addr learned my addr 172.21.15.72:0/453338255 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.403+0000 7f6bb98ac700 1 --2- 172.21.15.72:0/453338255 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bb409d630 0x7f6bb40a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38142/0 (socket says 172.21.15.72:38142) 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.403+0000 7f6bba8ae700 1 --2- 172.21.15.72:0/453338255 >> v2:172.21.15.72:3300/0 conn(0x7f6bb4138d80 0x7f6bb413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.403+0000 7f6bb98ac700 1 -- 172.21.15.72:0/453338255 >> v2:172.21.15.72:3300/0 conn(0x7f6bb4138d80 msgr2=0x7f6bb413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.403+0000 7f6bb98ac700 1 --2- 172.21.15.72:0/453338255 >> v2:172.21.15.72:3300/0 conn(0x7f6bb4138d80 0x7f6bb413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.403+0000 7f6bb98ac700 1 -- 172.21.15.72:0/453338255 >> v1:172.21.15.72:6789/0 conn(0x7f6bb40a0a30 legacy=0x7f6bb40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.403+0000 7f6bb98ac700 1 -- 172.21.15.72:0/453338255 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb409dc50 con 0x7f6bb409d630 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.403+0000 7f6bba8ae700 1 --2- 172.21.15.72:0/453338255 >> v2:172.21.15.72:3300/0 conn(0x7f6bb4138d80 0x7f6bb413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.403+0000 7f6bb98ac700 1 --2- 172.21.15.72:0/453338255 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bb409d630 0x7f6bb40a1510 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009840 tx=0x7f6ba4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceaeeb71c10e87cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.403+0000 7f6bb90ab700 1 -- 172.21.15.72:0/453338255 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4011830 con 0x7f6bb409d630 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.403+0000 7f6bb90ab700 1 -- 172.21.15.72:0/453338255 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba4011990 con 0x7f6bb409d630 2023-10-03T10:17:35.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.403+0000 7f6bb90ab700 1 -- 172.21.15.72:0/453338255 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4011d20 con 0x7f6bb409d630 2023-10-03T10:17:35.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.404+0000 7f6bbc311700 1 -- 172.21.15.72:0/453338255 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bb409d630 msgr2=0x7f6bb40a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.404+0000 7f6bbc311700 1 --2- 172.21.15.72:0/453338255 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bb409d630 0x7f6bb40a1510 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009840 tx=0x7f6ba4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:35.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.404+0000 7f6bbc311700 1 -- 172.21.15.72:0/453338255 shutdown_connections 2023-10-03T10:17:35.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.404+0000 7f6bbc311700 1 --2- 172.21.15.72:0/453338255 >> v2:172.21.15.72:3300/0 conn(0x7f6bb4138d80 0x7f6bb413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.404+0000 7f6bbc311700 1 --2- 172.21.15.72:0/453338255 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bb409d630 0x7f6bb40a1510 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.404+0000 7f6bbc311700 1 -- 172.21.15.72:0/453338255 >> 172.21.15.72:0/453338255 conn(0x7f6bb40a3050 msgr2=0x7f6bb40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.404+0000 7f6bbc311700 1 -- 172.21.15.72:0/453338255 shutdown_connections 2023-10-03T10:17:35.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.404+0000 7f6bbc311700 1 -- 172.21.15.72:0/453338255 wait complete. 2023-10-03T10:17:35.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.405+0000 7f6bbc311700 1 Processor -- start 2023-10-03T10:17:35.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.405+0000 7f6bbc311700 1 -- start start 2023-10-03T10:17:35.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.405+0000 7f6bbc311700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bb409d630 0x7f6bb4133b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.405+0000 7f6bbc311700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bb40a0a30 0x7f6bb4134090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.405+0000 7f6bbc311700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bb4138d80 0x7f6bb41345d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.405+0000 7f6bbc311700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4135010 con 0x7f6bb40a0a30 2023-10-03T10:17:35.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.405+0000 7f6bbc311700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb413afc0 con 0x7f6bb4138d80 2023-10-03T10:17:35.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.405+0000 7f6bbc311700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4135c30 con 0x7f6bb409d630 2023-10-03T10:17:35.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6bba0ad700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bb409d630 0x7f6bb4133b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6bba0ad700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bb409d630 0x7f6bb4133b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38154/0 (socket says 172.21.15.72:38154) 2023-10-03T10:17:35.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6bba0ad700 1 -- 172.21.15.72:0/1452892762 learned_addr learned my addr 172.21.15.72:0/1452892762 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:35.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6bba8ae700 1 --2- 172.21.15.72:0/1452892762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bb4138d80 0x7f6bb41345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6bb98ac700 1 --2- 172.21.15.72:0/1452892762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bb40a0a30 0x7f6bb4134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6bba0ad700 1 -- 172.21.15.72:0/1452892762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bb4138d80 msgr2=0x7f6bb41345d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6bba0ad700 1 --2- 172.21.15.72:0/1452892762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bb4138d80 0x7f6bb41345d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6bba0ad700 1 -- 172.21.15.72:0/1452892762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bb40a0a30 msgr2=0x7f6bb4134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6bba0ad700 1 --2- 172.21.15.72:0/1452892762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bb40a0a30 0x7f6bb4134090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6bba0ad700 1 -- 172.21.15.72:0/1452892762 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac009a70 con 0x7f6bb409d630 2023-10-03T10:17:35.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6bba8ae700 1 --2- 172.21.15.72:0/1452892762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bb4138d80 0x7f6bb41345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6bba0ad700 1 --2- 172.21.15.72:0/1452892762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bb409d630 0x7f6bb4133b50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000c550 tx=0x7f6bb000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6baaffd700 1 -- 172.21.15.72:0/1452892762 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0005d70 con 0x7f6bb409d630 2023-10-03T10:17:35.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6baaffd700 1 -- 172.21.15.72:0/1452892762 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb00070d0 con 0x7f6bb409d630 2023-10-03T10:17:35.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6bbc311700 1 -- 172.21.15.72:0/1452892762 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba40094a0 con 0x7f6bb409d630 2023-10-03T10:17:35.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6baaffd700 1 -- 172.21.15.72:0/1452892762 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0007440 con 0x7f6bb409d630 2023-10-03T10:17:35.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.406+0000 7f6bbc311700 1 -- 172.21.15.72:0/1452892762 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb4137590 con 0x7f6bb409d630 2023-10-03T10:17:35.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.407+0000 7f6baaffd700 1 -- 172.21.15.72:0/1452892762 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bb00075a0 con 0x7f6bb409d630 2023-10-03T10:17:35.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.407+0000 7f6baaffd700 1 -- 172.21.15.72:0/1452892762 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6bb003e9e0 con 0x7f6bb409d630 2023-10-03T10:17:35.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.408+0000 7f6bbc311700 1 -- 172.21.15.72:0/1452892762 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb40747f0 con 0x7f6bb409d630 2023-10-03T10:17:35.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.412+0000 7f6baaffd700 1 -- 172.21.15.72:0/1452892762 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bb0019b40 con 0x7f6bb409d630 2023-10-03T10:17:35.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.456+0000 7f3a9a4c4700 1 Processor -- start 2023-10-03T10:17:35.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.456+0000 7f3a9a4c4700 1 -- start start 2023-10-03T10:17:35.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.456+0000 7f3a9a4c4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a940a0a30 0x7f3a940a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.456+0000 7f3a9a4c4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a94138d80 0x7f3a9413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.456+0000 7f3a9a4c4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a940a2a70 con 0x7f3a9409d630 2023-10-03T10:17:35.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.456+0000 7f3a9a4c4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940a01d0 con 0x7f3a940a0a30 2023-10-03T10:17:35.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.456+0000 7f3a9a4c4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9409e2b0 con 0x7f3a94138d80 2023-10-03T10:17:35.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.456+0000 7f3a98a61700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a94138d80 0x7f3a9413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.456+0000 7f3a937fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3a9409d630 0x7f3a940a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48584/0 (socket says 172.21.15.72:48584) 2023-10-03T10:17:35.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.456+0000 7f3a937fe700 1 -- 172.21.15.72:0/3604685634 learned_addr learned my addr 172.21.15.72:0/3604685634 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:35.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.457+0000 7f3a93fff700 1 --2- 172.21.15.72:0/3604685634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a940a0a30 0x7f3a940a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.457+0000 7f3a93fff700 1 -- 172.21.15.72:0/3604685634 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a94138d80 msgr2=0x7f3a9413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.457+0000 7f3a93fff700 1 --2- 172.21.15.72:0/3604685634 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a94138d80 0x7f3a9413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.457+0000 7f3a93fff700 1 -- 172.21.15.72:0/3604685634 >> v1:172.21.15.72:6789/0 conn(0x7f3a9409d630 legacy=0x7f3a940a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.457+0000 7f3a93fff700 1 -- 172.21.15.72:0/3604685634 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9409dc50 con 0x7f3a940a0a30 2023-10-03T10:17:35.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.457+0000 7f3a98a61700 1 --2- 172.21.15.72:0/3604685634 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a94138d80 0x7f3a9413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.457+0000 7f3a93fff700 1 --2- 172.21.15.72:0/3604685634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a940a0a30 0x7f3a940a0e00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009870 tx=0x7f3a84009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a73a5e9b354b6287 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.457+0000 7f3a92ffd700 1 -- 172.21.15.72:0/3604685634 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84011830 con 0x7f3a940a0a30 2023-10-03T10:17:35.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.457+0000 7f3a92ffd700 1 -- 172.21.15.72:0/3604685634 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a84011990 con 0x7f3a940a0a30 2023-10-03T10:17:35.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.457+0000 7f3a92ffd700 1 -- 172.21.15.72:0/3604685634 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84011d20 con 0x7f3a940a0a30 2023-10-03T10:17:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.458+0000 7f3a9a4c4700 1 -- 172.21.15.72:0/3604685634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a940a0a30 msgr2=0x7f3a940a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.458+0000 7f3a9a4c4700 1 --2- 172.21.15.72:0/3604685634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a940a0a30 0x7f3a940a0e00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009870 tx=0x7f3a84009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.458+0000 7f3a9a4c4700 1 -- 172.21.15.72:0/3604685634 shutdown_connections 2023-10-03T10:17:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.458+0000 7f3a9a4c4700 1 --2- 172.21.15.72:0/3604685634 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a94138d80 0x7f3a9413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.458+0000 7f3a9a4c4700 1 --2- 172.21.15.72:0/3604685634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a940a0a30 0x7f3a940a0e00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.458+0000 7f3a9a4c4700 1 -- 172.21.15.72:0/3604685634 >> 172.21.15.72:0/3604685634 conn(0x7f3a940a3050 msgr2=0x7f3a940a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.458+0000 7f3a9a4c4700 1 -- 172.21.15.72:0/3604685634 shutdown_connections 2023-10-03T10:17:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.458+0000 7f3a9a4c4700 1 -- 172.21.15.72:0/3604685634 wait complete. 2023-10-03T10:17:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.459+0000 7f3a9a4c4700 1 Processor -- start 2023-10-03T10:17:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.459+0000 7f3a9a4c4700 1 -- start start 2023-10-03T10:17:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.459+0000 7f3a9a4c4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a9409d630 0x7f3a941208d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.459+0000 7f3a9a4c4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a940a0a30 0x7f3a94120e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.459+0000 7f3a9a4c4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a94138d80 0x7f3a94121350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.459+0000 7f3a9a4c4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a94123a40 con 0x7f3a940a0a30 2023-10-03T10:17:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.459+0000 7f3a9a4c4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940a4e20 con 0x7f3a9409d630 2023-10-03T10:17:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.459+0000 7f3a9a4c4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a94124350 con 0x7f3a94138d80 2023-10-03T10:17:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.459+0000 7f3a98a61700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a94138d80 0x7f3a94121350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.459+0000 7f3a93fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a9409d630 0x7f3a941208d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.459+0000 7f3a98a61700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a94138d80 0x7f3a94121350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38166/0 (socket says 172.21.15.72:38166) 2023-10-03T10:17:35.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.459+0000 7f3a98a61700 1 -- 172.21.15.72:0/3390273403 learned_addr learned my addr 172.21.15.72:0/3390273403 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:35.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.459+0000 7f3a937fe700 1 --2- 172.21.15.72:0/3390273403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a940a0a30 0x7f3a94120e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.460+0000 7f3a98a61700 1 -- 172.21.15.72:0/3390273403 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a9409d630 msgr2=0x7f3a941208d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.460+0000 7f3a98a61700 1 --2- 172.21.15.72:0/3390273403 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a9409d630 0x7f3a941208d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.460+0000 7f3a98a61700 1 -- 172.21.15.72:0/3390273403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a940a0a30 msgr2=0x7f3a94120e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.460+0000 7f3a98a61700 1 --2- 172.21.15.72:0/3390273403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a940a0a30 0x7f3a94120e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.460+0000 7f3a98a61700 1 -- 172.21.15.72:0/3390273403 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c009a70 con 0x7f3a94138d80 2023-10-03T10:17:35.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.460+0000 7f3a93fff700 1 --2- 172.21.15.72:0/3390273403 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a9409d630 0x7f3a941208d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:35.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.460+0000 7f3a98a61700 1 --2- 172.21.15.72:0/3390273403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a94138d80 0x7f3a94121350 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00efc0 tx=0x7f3a8c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.460+0000 7f3a90ff9700 1 -- 172.21.15.72:0/3390273403 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c00cc90 con 0x7f3a94138d80 2023-10-03T10:17:35.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.460+0000 7f3a90ff9700 1 -- 172.21.15.72:0/3390273403 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8c00f040 con 0x7f3a94138d80 2023-10-03T10:17:35.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.460+0000 7f3a9a4c4700 1 -- 172.21.15.72:0/3390273403 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a840094a0 con 0x7f3a94138d80 2023-10-03T10:17:35.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.460+0000 7f3a90ff9700 1 -- 172.21.15.72:0/3390273403 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c014480 con 0x7f3a94138d80 2023-10-03T10:17:35.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.460+0000 7f3a9a4c4700 1 -- 172.21.15.72:0/3390273403 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a94123fd0 con 0x7f3a94138d80 2023-10-03T10:17:35.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.461+0000 7f3a9a4c4700 1 -- 172.21.15.72:0/3390273403 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a94123e10 con 0x7f3a94138d80 2023-10-03T10:17:35.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.461+0000 7f3a90ff9700 1 -- 172.21.15.72:0/3390273403 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a8c0145e0 con 0x7f3a94138d80 2023-10-03T10:17:35.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.461+0000 7f3a90ff9700 1 -- 172.21.15.72:0/3390273403 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3a8c040320 con 0x7f3a94138d80 2023-10-03T10:17:35.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.470+0000 7f3a90ff9700 1 -- 172.21.15.72:0/3390273403 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a8c007920 con 0x7f3a94138d80 2023-10-03T10:17:35.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.536+0000 7f15910fb700 1 -- 172.21.15.72:0/1883605365 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f158c12f950 con 0x7f158c135e30 2023-10-03T10:17:35.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.536+0000 7f15737fe700 1 -- 172.21.15.72:0/1883605365 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1584022360 con 0x7f158c135e30 2023-10-03T10:17:35.536 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:35.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.538+0000 7f15910fb700 1 -- 172.21.15.72:0/1883605365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f158c135e30 msgr2=0x7f158c1c4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.538+0000 7f15910fb700 1 --2- 172.21.15.72:0/1883605365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f158c135e30 0x7f158c1c4010 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f158400f500 tx=0x7f158400f810 comp rx=0 tx=0).stop 2023-10-03T10:17:35.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.538+0000 7f15910fb700 1 -- 172.21.15.72:0/1883605365 shutdown_connections 2023-10-03T10:17:35.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.538+0000 7f15910fb700 1 --2- 172.21.15.72:0/1883605365 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f158c1305f0 0x7f158c09b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.538+0000 7f15910fb700 1 --2- 172.21.15.72:0/1883605365 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f158c135e30 0x7f158c1c4010 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.538+0000 7f15910fb700 1 --2- 172.21.15.72:0/1883605365 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f158c133510 0x7f158c09b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.538+0000 7f15910fb700 1 -- 172.21.15.72:0/1883605365 >> 172.21.15.72:0/1883605365 conn(0x7f158c0a2aa0 msgr2=0x7f158c1312f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.538+0000 7f15910fb700 1 -- 172.21.15.72:0/1883605365 shutdown_connections 2023-10-03T10:17:35.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.538+0000 7f15910fb700 1 -- 172.21.15.72:0/1883605365 wait complete. 2023-10-03T10:17:35.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:35.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.629+0000 7f6bbc311700 1 -- 172.21.15.72:0/1452892762 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6bb4072980 con 0x7f6bb409d630 2023-10-03T10:17:35.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.629+0000 7f6baaffd700 1 -- 172.21.15.72:0/1452892762 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6bb0017020 con 0x7f6bb409d630 2023-10-03T10:17:35.629 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:35.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.631+0000 7f6bbc311700 1 -- 172.21.15.72:0/1452892762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bb409d630 msgr2=0x7f6bb4133b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.631+0000 7f6bbc311700 1 --2- 172.21.15.72:0/1452892762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bb409d630 0x7f6bb4133b50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000c550 tx=0x7f6bb000c860 comp rx=0 tx=0).stop 2023-10-03T10:17:35.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.631+0000 7f6bbc311700 1 -- 172.21.15.72:0/1452892762 shutdown_connections 2023-10-03T10:17:35.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.631+0000 7f6bbc311700 1 --2- 172.21.15.72:0/1452892762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bb4138d80 0x7f6bb41345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.631+0000 7f6bbc311700 1 --2- 172.21.15.72:0/1452892762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bb409d630 0x7f6bb4133b50 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.631+0000 7f6bbc311700 1 --2- 172.21.15.72:0/1452892762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bb40a0a30 0x7f6bb4134090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.631+0000 7f6bbc311700 1 -- 172.21.15.72:0/1452892762 >> 172.21.15.72:0/1452892762 conn(0x7f6bb40a3050 msgr2=0x7f6bb409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.632+0000 7f6bbc311700 1 -- 172.21.15.72:0/1452892762 shutdown_connections 2023-10-03T10:17:35.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.632+0000 7f6bbc311700 1 -- 172.21.15.72:0/1452892762 wait complete. 2023-10-03T10:17:35.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:35.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.667+0000 7f3a9a4c4700 1 -- 172.21.15.72:0/3390273403 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3a94123c30 con 0x7f3a94138d80 2023-10-03T10:17:35.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.667+0000 7f3a90ff9700 1 -- 172.21.15.72:0/3390273403 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a8c007330 con 0x7f3a94138d80 2023-10-03T10:17:35.667 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:35.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.669+0000 7f3a9a4c4700 1 -- 172.21.15.72:0/3390273403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a94138d80 msgr2=0x7f3a94121350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.669+0000 7f3a9a4c4700 1 --2- 172.21.15.72:0/3390273403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a94138d80 0x7f3a94121350 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00efc0 tx=0x7f3a8c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.669+0000 7f3a9a4c4700 1 -- 172.21.15.72:0/3390273403 shutdown_connections 2023-10-03T10:17:35.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.669+0000 7f3a9a4c4700 1 --2- 172.21.15.72:0/3390273403 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3a94138d80 0x7f3a94121350 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.669+0000 7f3a9a4c4700 1 --2- 172.21.15.72:0/3390273403 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a9409d630 0x7f3a941208d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.669+0000 7f3a9a4c4700 1 --2- 172.21.15.72:0/3390273403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a940a0a30 0x7f3a94120e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.669+0000 7f3a9a4c4700 1 -- 172.21.15.72:0/3390273403 >> 172.21.15.72:0/3390273403 conn(0x7f3a940a3050 msgr2=0x7f3a9409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.669+0000 7f3a9a4c4700 1 -- 172.21.15.72:0/3390273403 shutdown_connections 2023-10-03T10:17:35.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:35.669+0000 7f3a9a4c4700 1 -- 172.21.15.72:0/3390273403 wait complete. 2023-10-03T10:17:35.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:36.031 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:36.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.153+0000 7f3bbf6c8700 1 Processor -- start 2023-10-03T10:17:36.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.154+0000 7f3bbf6c8700 1 -- start start 2023-10-03T10:17:36.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.154+0000 7f3bbf6c8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bb809d6f0 0x7f3bb809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.154+0000 7f3bbf6c8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bb809e000 0x7f3bb81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.154+0000 7f3bbf6c8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb809b120 con 0x7f3bb809e410 2023-10-03T10:17:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.154+0000 7f3bbf6c8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb806b460 con 0x7f3bb809d6f0 2023-10-03T10:17:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.154+0000 7f3bbf6c8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb809a7e0 con 0x7f3bb809e000 2023-10-03T10:17:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.154+0000 7f3bbcc63700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bb809e000 0x7f3bb81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.154+0000 7f3bbcc63700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bb809e000 0x7f3bb81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38174/0 (socket says 172.21.15.72:38174) 2023-10-03T10:17:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.154+0000 7f3bbcc63700 1 -- 172.21.15.72:0/1457224962 learned_addr learned my addr 172.21.15.72:0/1457224962 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.154+0000 7f3bbd464700 1 --2- 172.21.15.72:0/1457224962 >> v2:172.21.15.72:3300/0 conn(0x7f3bb809d6f0 0x7f3bb809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.155+0000 7f3bbd464700 1 -- 172.21.15.72:0/1457224962 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bb809e000 msgr2=0x7f3bb81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.155+0000 7f3bbd464700 1 --2- 172.21.15.72:0/1457224962 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bb809e000 0x7f3bb81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.155+0000 7f3bbd464700 1 -- 172.21.15.72:0/1457224962 >> v1:172.21.15.72:6789/0 conn(0x7f3bb809e410 legacy=0x7f3bb8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.155+0000 7f3bbd464700 1 -- 172.21.15.72:0/1457224962 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb809a500 con 0x7f3bb809d6f0 2023-10-03T10:17:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.155+0000 7f3bbcc63700 1 --2- 172.21.15.72:0/1457224962 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bb809e000 0x7f3bb81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.155+0000 7f3bbd464700 1 --2- 172.21.15.72:0/1457224962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb809d6f0 0x7f3bb809dac0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009840 tx=0x7f3ba8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76d4927f20a6d7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.155+0000 7f3baffff700 1 -- 172.21.15.72:0/1457224962 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8011830 con 0x7f3bb809d6f0 2023-10-03T10:17:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.155+0000 7f3baffff700 1 -- 172.21.15.72:0/1457224962 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba8011990 con 0x7f3bb809d6f0 2023-10-03T10:17:36.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.155+0000 7f3baffff700 1 -- 172.21.15.72:0/1457224962 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8011d20 con 0x7f3bb809d6f0 2023-10-03T10:17:36.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.155+0000 7f3bbf6c8700 1 -- 172.21.15.72:0/1457224962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb809d6f0 msgr2=0x7f3bb809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.155+0000 7f3bbf6c8700 1 --2- 172.21.15.72:0/1457224962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb809d6f0 0x7f3bb809dac0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009840 tx=0x7f3ba8009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:36.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.155+0000 7f3bbf6c8700 1 -- 172.21.15.72:0/1457224962 shutdown_connections 2023-10-03T10:17:36.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.155+0000 7f3bbf6c8700 1 --2- 172.21.15.72:0/1457224962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb809d6f0 0x7f3bb809dac0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.155+0000 7f3bbf6c8700 1 --2- 172.21.15.72:0/1457224962 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bb809e000 0x7f3bb81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.155+0000 7f3bbf6c8700 1 -- 172.21.15.72:0/1457224962 >> 172.21.15.72:0/1457224962 conn(0x7f3bb8066f50 msgr2=0x7f3bb809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.156+0000 7f3bbf6c8700 1 -- 172.21.15.72:0/1457224962 shutdown_connections 2023-10-03T10:17:36.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.156+0000 7f3bbf6c8700 1 -- 172.21.15.72:0/1457224962 wait complete. 2023-10-03T10:17:36.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.157+0000 7f3bbf6c8700 1 Processor -- start 2023-10-03T10:17:36.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.157+0000 7f3bbf6c8700 1 -- start start 2023-10-03T10:17:36.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.157+0000 7f3bbf6c8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bb809d6f0 0x7f3bb81a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.157+0000 7f3bbf6c8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb809e000 0x7f3bb81a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.157+0000 7f3bbf6c8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bb809e410 0x7f3bb81a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.157+0000 7f3bbf6c8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb81a7340 con 0x7f3bb809e000 2023-10-03T10:17:36.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbf6c8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb81a7ac0 con 0x7f3bb809d6f0 2023-10-03T10:17:36.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbf6c8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb81a80e0 con 0x7f3bb809e410 2023-10-03T10:17:36.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbd464700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bb809d6f0 0x7f3bb81a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbcc63700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb809e000 0x7f3bb81a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbcc63700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb809e000 0x7f3bb81a63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57592/0 (socket says 172.21.15.72:57592) 2023-10-03T10:17:36.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbd464700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bb809d6f0 0x7f3bb81a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43436/0 (socket says 172.21.15.72:43436) 2023-10-03T10:17:36.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbcc63700 1 -- 172.21.15.72:0/787271434 learned_addr learned my addr 172.21.15.72:0/787271434 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:36.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbdc65700 1 --2- 172.21.15.72:0/787271434 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bb809e410 0x7f3bb81a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbcc63700 1 -- 172.21.15.72:0/787271434 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bb809e410 msgr2=0x7f3bb81a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbcc63700 1 --2- 172.21.15.72:0/787271434 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bb809e410 0x7f3bb81a6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbcc63700 1 -- 172.21.15.72:0/787271434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bb809d6f0 msgr2=0x7f3bb81a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbcc63700 1 --2- 172.21.15.72:0/787271434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bb809d6f0 0x7f3bb81a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbcc63700 1 -- 172.21.15.72:0/787271434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb4009550 con 0x7f3bb809e000 2023-10-03T10:17:36.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbd464700 1 --2- 172.21.15.72:0/787271434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bb809d6f0 0x7f3bb81a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbcc63700 1 --2- 172.21.15.72:0/787271434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb809e000 0x7f3bb81a63f0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400ec10 tx=0x7f3bb400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3badffb700 1 -- 172.21.15.72:0/787271434 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb400c850 con 0x7f3bb809e000 2023-10-03T10:17:36.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3badffb700 1 -- 172.21.15.72:0/787271434 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb400c9b0 con 0x7f3bb809e000 2023-10-03T10:17:36.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbf6c8700 1 -- 172.21.15.72:0/787271434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba80094a0 con 0x7f3bb809e000 2023-10-03T10:17:36.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3badffb700 1 -- 172.21.15.72:0/787271434 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb400cd40 con 0x7f3bb809e000 2023-10-03T10:17:36.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.158+0000 7f3bbf6c8700 1 -- 172.21.15.72:0/787271434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb80a3220 con 0x7f3bb809e000 2023-10-03T10:17:36.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.159+0000 7f3badffb700 1 -- 172.21.15.72:0/787271434 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3bb4013470 con 0x7f3bb809e000 2023-10-03T10:17:36.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.159+0000 7f3badffb700 1 -- 172.21.15.72:0/787271434 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3bb403f840 con 0x7f3bb809e000 2023-10-03T10:17:36.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.159+0000 7f3bbf6c8700 1 -- 172.21.15.72:0/787271434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb809c770 con 0x7f3bb809e000 2023-10-03T10:17:36.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.164+0000 7f3badffb700 1 -- 172.21.15.72:0/787271434 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3bb400cea0 con 0x7f3bb809e000 2023-10-03T10:17:36.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.348+0000 7f3bbf6c8700 1 -- 172.21.15.72:0/787271434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3bb81a95c0 con 0x7f3bb809e000 2023-10-03T10:17:36.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.348+0000 7f3badffb700 1 -- 172.21.15.72:0/787271434 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3bb402a090 con 0x7f3bb809e000 2023-10-03T10:17:36.348 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.350+0000 7f3bbf6c8700 1 -- 172.21.15.72:0/787271434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb809e000 msgr2=0x7f3bb81a63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.350+0000 7f3bbf6c8700 1 --2- 172.21.15.72:0/787271434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb809e000 0x7f3bb81a63f0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400ec10 tx=0x7f3bb400ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.350+0000 7f3bbf6c8700 1 -- 172.21.15.72:0/787271434 shutdown_connections 2023-10-03T10:17:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.350+0000 7f3bbf6c8700 1 --2- 172.21.15.72:0/787271434 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3bb809e410 0x7f3bb81a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.350+0000 7f3bbf6c8700 1 --2- 172.21.15.72:0/787271434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3bb809d6f0 0x7f3bb81a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.350+0000 7f3bbf6c8700 1 --2- 172.21.15.72:0/787271434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bb809e000 0x7f3bb81a63f0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.350+0000 7f3bbf6c8700 1 -- 172.21.15.72:0/787271434 >> 172.21.15.72:0/787271434 conn(0x7f3bb8066f50 msgr2=0x7f3bb81badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.350+0000 7f3bbf6c8700 1 -- 172.21.15.72:0/787271434 shutdown_connections 2023-10-03T10:17:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.350+0000 7f3bbf6c8700 1 -- 172.21.15.72:0/787271434 wait complete. 2023-10-03T10:17:36.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:36.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:36.643 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:36.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.676+0000 7fcd6c353700 1 Processor -- start 2023-10-03T10:17:36.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.676+0000 7fcd6c353700 1 -- start start 2023-10-03T10:17:36.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd6c353700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd6409e1d0 0x7fcd64135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd6c353700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd64135e50 0x7fcd64138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd6c353700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6409f130 con 0x7fcd6409d6f0 2023-10-03T10:17:36.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd6c353700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd6409f520 con 0x7fcd6409e1d0 2023-10-03T10:17:36.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd6c353700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6409e930 con 0x7fcd64135e50 2023-10-03T10:17:36.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd698ee700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd6409e1d0 0x7fcd64135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd6a8f0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd64135e50 0x7fcd64138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd698ee700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd6409e1d0 0x7fcd64135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57606/0 (socket says 172.21.15.72:57606) 2023-10-03T10:17:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd698ee700 1 -- 172.21.15.72:0/2742637030 learned_addr learned my addr 172.21.15.72:0/2742637030 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd6a8f0700 1 -- 172.21.15.72:0/2742637030 >> v2:172.21.15.72:3300/0 conn(0x7fcd6409e1d0 msgr2=0x7fcd64135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd6a8f0700 1 --2- 172.21.15.72:0/2742637030 >> v2:172.21.15.72:3300/0 conn(0x7fcd6409e1d0 0x7fcd64135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd6a8f0700 1 -- 172.21.15.72:0/2742637030 >> v1:172.21.15.72:6789/0 conn(0x7fcd6409d6f0 legacy=0x7fcd6409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd6a8f0700 1 -- 172.21.15.72:0/2742637030 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6409b2d0 con 0x7fcd64135e50 2023-10-03T10:17:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd690ed700 1 -- 172.21.15.72:0/2742637030 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2458843046 0 0) 0x7fcd6409f130 con 0x7fcd6409d6f0 2023-10-03T10:17:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd698ee700 1 --2- 172.21.15.72:0/2742637030 >> v2:172.21.15.72:3300/0 conn(0x7fcd6409e1d0 0x7fcd64135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd6a8f0700 1 --2- 172.21.15.72:0/2742637030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd64135e50 0x7fcd64138230 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009d90 tx=0x7fcd5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee65828b5b28e57f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd690ed700 1 -- 172.21.15.72:0/2742637030 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c00e070 con 0x7fcd64135e50 2023-10-03T10:17:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd690ed700 1 -- 172.21.15.72:0/2742637030 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c00bb20 con 0x7fcd64135e50 2023-10-03T10:17:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.677+0000 7fcd690ed700 1 -- 172.21.15.72:0/2742637030 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c012430 con 0x7fcd64135e50 2023-10-03T10:17:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.678+0000 7fcd6c353700 1 -- 172.21.15.72:0/2742637030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd64135e50 msgr2=0x7fcd64138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.678+0000 7fcd6c353700 1 --2- 172.21.15.72:0/2742637030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd64135e50 0x7fcd64138230 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009d90 tx=0x7fcd5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:36.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.678+0000 7fcd6c353700 1 -- 172.21.15.72:0/2742637030 shutdown_connections 2023-10-03T10:17:36.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.678+0000 7fcd6c353700 1 --2- 172.21.15.72:0/2742637030 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd64135e50 0x7fcd64138230 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.678+0000 7fcd6c353700 1 --2- 172.21.15.72:0/2742637030 >> v2:172.21.15.72:3300/0 conn(0x7fcd6409e1d0 0x7fcd64135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.678+0000 7fcd6c353700 1 -- 172.21.15.72:0/2742637030 >> 172.21.15.72:0/2742637030 conn(0x7fcd64066f50 msgr2=0x7fcd6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.678+0000 7fcd6c353700 1 -- 172.21.15.72:0/2742637030 shutdown_connections 2023-10-03T10:17:36.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.678+0000 7fcd6c353700 1 -- 172.21.15.72:0/2742637030 wait complete. 2023-10-03T10:17:36.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:36.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.679+0000 7fcd6c353700 1 Processor -- start 2023-10-03T10:17:36.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.679+0000 7fcd6c353700 1 -- start start 2023-10-03T10:17:36.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.679+0000 7fcd6c353700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd6409d6f0 0x7fcd6411d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.679+0000 7fcd6c353700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd6409e1d0 0x7fcd6411da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.679+0000 7fcd6c353700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd64135e50 0x7fcd6411dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.679+0000 7fcd6c353700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6411e650 con 0x7fcd6409d6f0 2023-10-03T10:17:36.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.679+0000 7fcd6c353700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6411e910 con 0x7fcd6409e1d0 2023-10-03T10:17:36.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.679+0000 7fcd6c353700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd641240d0 con 0x7fcd64135e50 2023-10-03T10:17:36.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd6a8f0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd64135e50 0x7fcd6411dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd6a0ef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd6409d6f0 0x7fcd6411d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd6a8f0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd64135e50 0x7fcd6411dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38206/0 (socket says 172.21.15.72:38206) 2023-10-03T10:17:36.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd6a8f0700 1 -- 172.21.15.72:0/870848577 learned_addr learned my addr 172.21.15.72:0/870848577 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:36.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd698ee700 1 --2- 172.21.15.72:0/870848577 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd6409e1d0 0x7fcd6411da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd6a8f0700 1 -- 172.21.15.72:0/870848577 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd6409e1d0 msgr2=0x7fcd6411da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd6a8f0700 1 --2- 172.21.15.72:0/870848577 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd6409e1d0 0x7fcd6411da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd6a8f0700 1 -- 172.21.15.72:0/870848577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd6409d6f0 msgr2=0x7fcd6411d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd6a8f0700 1 --2- 172.21.15.72:0/870848577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd6409d6f0 0x7fcd6411d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd6a8f0700 1 -- 172.21.15.72:0/870848577 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd54009550 con 0x7fcd64135e50 2023-10-03T10:17:36.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd6a8f0700 1 --2- 172.21.15.72:0/870848577 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd64135e50 0x7fcd6411dfb0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcd6409ea70 tx=0x7fcd5c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd5affd700 1 -- 172.21.15.72:0/870848577 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c012430 con 0x7fcd64135e50 2023-10-03T10:17:36.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd5affd700 1 -- 172.21.15.72:0/870848577 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c020070 con 0x7fcd64135e50 2023-10-03T10:17:36.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd6c353700 1 -- 172.21.15.72:0/870848577 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c009a70 con 0x7fcd64135e50 2023-10-03T10:17:36.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd5affd700 1 -- 172.21.15.72:0/870848577 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c004040 con 0x7fcd64135e50 2023-10-03T10:17:36.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.680+0000 7fcd6c353700 1 -- 172.21.15.72:0/870848577 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd64123cf0 con 0x7fcd64135e50 2023-10-03T10:17:36.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.681+0000 7fcd6c353700 1 -- 172.21.15.72:0/870848577 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd64074ea0 con 0x7fcd64135e50 2023-10-03T10:17:36.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.681+0000 7fcd5affd700 1 -- 172.21.15.72:0/870848577 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd5c0041a0 con 0x7fcd64135e50 2023-10-03T10:17:36.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.682+0000 7fcd5affd700 1 -- 172.21.15.72:0/870848577 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd5c022070 con 0x7fcd64135e50 2023-10-03T10:17:36.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.686+0000 7fcd5affd700 1 -- 172.21.15.72:0/870848577 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd5c004450 con 0x7fcd64135e50 2023-10-03T10:17:36.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.773+0000 7ffa4ef31700 1 Processor -- start 2023-10-03T10:17:36.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.773+0000 7ffa4ef31700 1 -- start start 2023-10-03T10:17:36.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.773+0000 7ffa4ef31700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa48133a80 0x7ffa48133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.773+0000 7ffa4ef31700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa4812ff20 0x7ffa48130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.773+0000 7ffa4ef31700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4806bc00 con 0x7ffa48130870 2023-10-03T10:17:36.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.773+0000 7ffa4ef31700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4806c570 con 0x7ffa48133a80 2023-10-03T10:17:36.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.773+0000 7ffa4ef31700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa480a0040 con 0x7ffa4812ff20 2023-10-03T10:17:36.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.774+0000 7ffa4cccd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa48133a80 0x7ffa48133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.774+0000 7ffa4cccd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa48133a80 0x7ffa48133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57616/0 (socket says 172.21.15.72:57616) 2023-10-03T10:17:36.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.774+0000 7ffa4cccd700 1 -- 172.21.15.72:0/3706796136 learned_addr learned my addr 172.21.15.72:0/3706796136 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:36.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.774+0000 7ffa47fff700 1 --2- 172.21.15.72:0/3706796136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa4812ff20 0x7ffa48130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.774+0000 7ffa4cccd700 1 -- 172.21.15.72:0/3706796136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa4812ff20 msgr2=0x7ffa48130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.774+0000 7ffa4cccd700 1 --2- 172.21.15.72:0/3706796136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa4812ff20 0x7ffa48130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.774+0000 7ffa4cccd700 1 -- 172.21.15.72:0/3706796136 >> v1:172.21.15.72:6789/0 conn(0x7ffa48130870 legacy=0x7ffa4813a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.774+0000 7ffa4cccd700 1 -- 172.21.15.72:0/3706796136 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa48133860 con 0x7ffa48133a80 2023-10-03T10:17:36.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.774+0000 7ffa477fe700 1 -- 172.21.15.72:0/3706796136 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569658504 0 0) 0x7ffa4806bc00 con 0x7ffa48130870 2023-10-03T10:17:36.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.774+0000 7ffa4cccd700 1 --2- 172.21.15.72:0/3706796136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa48133a80 0x7ffa48133e50 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0098f0 tx=0x7ffa3c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3b5d2309d233ba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.774+0000 7ffa477fe700 1 -- 172.21.15.72:0/3706796136 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c011830 con 0x7ffa48133a80 2023-10-03T10:17:36.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.774+0000 7ffa477fe700 1 -- 172.21.15.72:0/3706796136 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3c011990 con 0x7ffa48133a80 2023-10-03T10:17:36.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.774+0000 7ffa477fe700 1 -- 172.21.15.72:0/3706796136 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c011d20 con 0x7ffa48133a80 2023-10-03T10:17:36.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.775+0000 7ffa4ef31700 1 -- 172.21.15.72:0/3706796136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa48133a80 msgr2=0x7ffa48133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.775+0000 7ffa4ef31700 1 --2- 172.21.15.72:0/3706796136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa48133a80 0x7ffa48133e50 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0098f0 tx=0x7ffa3c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:36.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.775+0000 7ffa4ef31700 1 -- 172.21.15.72:0/3706796136 shutdown_connections 2023-10-03T10:17:36.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.775+0000 7ffa4ef31700 1 --2- 172.21.15.72:0/3706796136 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa48133a80 0x7ffa48133e50 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.775+0000 7ffa4ef31700 1 --2- 172.21.15.72:0/3706796136 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa4812ff20 0x7ffa48130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.775+0000 7ffa4ef31700 1 -- 172.21.15.72:0/3706796136 >> 172.21.15.72:0/3706796136 conn(0x7ffa480a4210 msgr2=0x7ffa480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.775+0000 7ffa4ef31700 1 -- 172.21.15.72:0/3706796136 shutdown_connections 2023-10-03T10:17:36.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.775+0000 7ffa4ef31700 1 -- 172.21.15.72:0/3706796136 wait complete. 2023-10-03T10:17:36.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.776+0000 7ffa4ef31700 1 Processor -- start 2023-10-03T10:17:36.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.776+0000 7ffa4ef31700 1 -- start start 2023-10-03T10:17:36.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.776+0000 7ffa4ef31700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa4812ff20 0x7ffa4809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.776+0000 7ffa4ef31700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa48130870 0x7ffa4809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.776+0000 7ffa4ef31700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa48133a80 0x7ffa4809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.776+0000 7ffa4ef31700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4811f0f0 con 0x7ffa4812ff20 2023-10-03T10:17:36.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.776+0000 7ffa4ef31700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4809dfc0 con 0x7ffa48130870 2023-10-03T10:17:36.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.776+0000 7ffa4ef31700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4809d9e0 con 0x7ffa48133a80 2023-10-03T10:17:36.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa4cccd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa4812ff20 0x7ffa4809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa4cccd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa4812ff20 0x7ffa4809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57630/0 (socket says 172.21.15.72:57630) 2023-10-03T10:17:36.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa47fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa48130870 0x7ffa4809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa4cccd700 1 -- 172.21.15.72:0/3454746339 learned_addr learned my addr 172.21.15.72:0/3454746339 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:36.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa4d4ce700 1 --2- 172.21.15.72:0/3454746339 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa48133a80 0x7ffa4809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa4cccd700 1 -- 172.21.15.72:0/3454746339 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa48133a80 msgr2=0x7ffa4809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa4cccd700 1 --2- 172.21.15.72:0/3454746339 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa48133a80 0x7ffa4809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa4cccd700 1 -- 172.21.15.72:0/3454746339 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa48130870 msgr2=0x7ffa4809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa4cccd700 1 --2- 172.21.15.72:0/3454746339 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa48130870 0x7ffa4809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa4cccd700 1 -- 172.21.15.72:0/3454746339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c009550 con 0x7ffa4812ff20 2023-10-03T10:17:36.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa47fff700 1 --2- 172.21.15.72:0/3454746339 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa48130870 0x7ffa4809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa4cccd700 1 --2- 172.21.15.72:0/3454746339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa4812ff20 0x7ffa4809c480 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009c40 tx=0x7ffa3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa457fa700 1 -- 172.21.15.72:0/3454746339 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c004300 con 0x7ffa4812ff20 2023-10-03T10:17:36.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa457fa700 1 -- 172.21.15.72:0/3454746339 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3c01f070 con 0x7ffa4812ff20 2023-10-03T10:17:36.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa4ef31700 1 -- 172.21.15.72:0/3454746339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa480a20e0 con 0x7ffa4812ff20 2023-10-03T10:17:36.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa457fa700 1 -- 172.21.15.72:0/3454746339 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0036a0 con 0x7ffa4812ff20 2023-10-03T10:17:36.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.777+0000 7ffa4ef31700 1 -- 172.21.15.72:0/3454746339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4811f440 con 0x7ffa4812ff20 2023-10-03T10:17:36.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.778+0000 7ffa457fa700 1 -- 172.21.15.72:0/3454746339 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa3c021030 con 0x7ffa4812ff20 2023-10-03T10:17:36.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.778+0000 7ffa457fa700 1 -- 172.21.15.72:0/3454746339 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffa3c040b00 con 0x7ffa4812ff20 2023-10-03T10:17:36.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.779+0000 7ffa4ef31700 1 -- 172.21.15.72:0/3454746339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4811f890 con 0x7ffa4812ff20 2023-10-03T10:17:36.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.784+0000 7ffa457fa700 1 -- 172.21.15.72:0/3454746339 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa3c015020 con 0x7ffa4812ff20 2023-10-03T10:17:36.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.814+0000 7f00bbfd9700 1 Processor -- start 2023-10-03T10:17:36.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.815+0000 7f00bbfd9700 1 -- start start 2023-10-03T10:17:36.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.815+0000 7f00bbfd9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00b4133a80 0x7f00b4133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.815+0000 7f00bbfd9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f00b412ff20 0x7f00b4130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.815+0000 7f00bbfd9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00b4130870 0x7f00b413a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.815+0000 7f00bbfd9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b406c570 con 0x7f00b412ff20 2023-10-03T10:17:36.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.815+0000 7f00bbfd9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b406bc00 con 0x7f00b4133a80 2023-10-03T10:17:36.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.815+0000 7f00bbfd9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40a0040 con 0x7f00b4130870 2023-10-03T10:17:36.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.815+0000 7f00b9574700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f00b412ff20 0x7f00b4130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.815+0000 7f00b9d75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00b4133a80 0x7f00b4133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.815+0000 7f00b9574700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f00b412ff20 0x7f00b4130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57638/0 (socket says 172.21.15.72:57638) 2023-10-03T10:17:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.815+0000 7f00ba576700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00b4130870 0x7f00b413a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.815+0000 7f00b9574700 1 -- 172.21.15.72:0/4095702088 learned_addr learned my addr 172.21.15.72:0/4095702088 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00b9574700 1 -- 172.21.15.72:0/4095702088 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00b4130870 msgr2=0x7f00b413a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00b9574700 1 --2- 172.21.15.72:0/4095702088 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00b4130870 0x7f00b413a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00b9574700 1 -- 172.21.15.72:0/4095702088 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00b4133a80 msgr2=0x7f00b4133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00b9574700 1 --2- 172.21.15.72:0/4095702088 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00b4133a80 0x7f00b4133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00b9574700 1 -- 172.21.15.72:0/4095702088 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b4133860 con 0x7f00b412ff20 2023-10-03T10:17:36.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00ba576700 1 --2- 172.21.15.72:0/4095702088 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00b4130870 0x7f00b413a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00b9574700 1 --2- 172.21.15.72:0/4095702088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00b412ff20 0x7f00b4130330 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f00a40098f0 tx=0x7f00a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7e2a27960e1b40 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00b8d73700 1 -- 172.21.15.72:0/4095702088 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4011830 con 0x7f00b412ff20 2023-10-03T10:17:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00b8d73700 1 -- 172.21.15.72:0/4095702088 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a4011990 con 0x7f00b412ff20 2023-10-03T10:17:36.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00b8d73700 1 -- 172.21.15.72:0/4095702088 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4011d20 con 0x7f00b412ff20 2023-10-03T10:17:36.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00bbfd9700 1 -- 172.21.15.72:0/4095702088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00b412ff20 msgr2=0x7f00b4130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00bbfd9700 1 --2- 172.21.15.72:0/4095702088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00b412ff20 0x7f00b4130330 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f00a40098f0 tx=0x7f00a4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:36.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00bbfd9700 1 -- 172.21.15.72:0/4095702088 shutdown_connections 2023-10-03T10:17:36.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00bbfd9700 1 --2- 172.21.15.72:0/4095702088 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00b4130870 0x7f00b413a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00bbfd9700 1 --2- 172.21.15.72:0/4095702088 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00b4133a80 0x7f00b4133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00bbfd9700 1 --2- 172.21.15.72:0/4095702088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00b412ff20 0x7f00b4130330 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.816+0000 7f00bbfd9700 1 -- 172.21.15.72:0/4095702088 >> 172.21.15.72:0/4095702088 conn(0x7f00b40a4210 msgr2=0x7f00b40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.817+0000 7f00bbfd9700 1 -- 172.21.15.72:0/4095702088 shutdown_connections 2023-10-03T10:17:36.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.817+0000 7f00bbfd9700 1 -- 172.21.15.72:0/4095702088 wait complete. 2023-10-03T10:17:36.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.817+0000 7f00bbfd9700 1 Processor -- start 2023-10-03T10:17:36.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.817+0000 7f00bbfd9700 1 -- start start 2023-10-03T10:17:36.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00bbfd9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00b412ff20 0x7f00b409c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00bbfd9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00b4130870 0x7f00b409c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00bbfd9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00b4133a80 0x7f00b409cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00bbfd9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b411ee40 con 0x7f00b4133a80 2023-10-03T10:17:36.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00bbfd9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b409e0a0 con 0x7f00b412ff20 2023-10-03T10:17:36.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00bbfd9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00b411ff90 con 0x7f00b4130870 2023-10-03T10:17:36.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00b9574700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00b4130870 0x7f00b409c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00b9574700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00b4130870 0x7f00b409c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38234/0 (socket says 172.21.15.72:38234) 2023-10-03T10:17:36.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00b9574700 1 -- 172.21.15.72:0/1135746293 learned_addr learned my addr 172.21.15.72:0/1135746293 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:36.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00ba576700 1 --2- 172.21.15.72:0/1135746293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00b4133a80 0x7f00b409cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00b9d75700 1 --2- 172.21.15.72:0/1135746293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00b412ff20 0x7f00b409c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00ba576700 1 -- 172.21.15.72:0/1135746293 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00b4130870 msgr2=0x7f00b409c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00ba576700 1 --2- 172.21.15.72:0/1135746293 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00b4130870 0x7f00b409c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00ba576700 1 -- 172.21.15.72:0/1135746293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00b412ff20 msgr2=0x7f00b409c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00ba576700 1 --2- 172.21.15.72:0/1135746293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00b412ff20 0x7f00b409c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00ba576700 1 -- 172.21.15.72:0/1135746293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ac009a70 con 0x7f00b4133a80 2023-10-03T10:17:36.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.818+0000 7f00b9574700 1 --2- 172.21.15.72:0/1135746293 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00b4130870 0x7f00b409c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.819+0000 7f00ba576700 1 --2- 172.21.15.72:0/1135746293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00b4133a80 0x7f00b409cf10 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009e50 tx=0x7f00ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.819+0000 7f00aa7fc700 1 -- 172.21.15.72:0/1135746293 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac00ca90 con 0x7f00b4133a80 2023-10-03T10:17:36.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.819+0000 7f00aa7fc700 1 -- 172.21.15.72:0/1135746293 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ac00f040 con 0x7f00b4133a80 2023-10-03T10:17:36.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.819+0000 7f00bbfd9700 1 -- 172.21.15.72:0/1135746293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a4009550 con 0x7f00b4133a80 2023-10-03T10:17:36.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.819+0000 7f00aa7fc700 1 -- 172.21.15.72:0/1135746293 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac00ce50 con 0x7f00b4133a80 2023-10-03T10:17:36.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.819+0000 7f00bbfd9700 1 -- 172.21.15.72:0/1135746293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b40a2130 con 0x7f00b4133a80 2023-10-03T10:17:36.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.820+0000 7f00aa7fc700 1 -- 172.21.15.72:0/1135746293 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00ac014480 con 0x7f00b4133a80 2023-10-03T10:17:36.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.820+0000 7f00aa7fc700 1 -- 172.21.15.72:0/1135746293 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f00ac03fcc0 con 0x7f00b4133a80 2023-10-03T10:17:36.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.820+0000 7f00bbfd9700 1 -- 172.21.15.72:0/1135746293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b4074ea0 con 0x7f00b4133a80 2023-10-03T10:17:36.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.824+0000 7f00aa7fc700 1 -- 172.21.15.72:0/1135746293 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00ac012910 con 0x7f00b4133a80 2023-10-03T10:17:36.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.885+0000 7fcd6c353700 1 -- 172.21.15.72:0/870848577 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd6406aaa0 con 0x7fcd64135e50 2023-10-03T10:17:36.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.885+0000 7fcd5affd700 1 -- 172.21.15.72:0/870848577 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcd5c02c020 con 0x7fcd64135e50 2023-10-03T10:17:36.886 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.887+0000 7fcd6c353700 1 -- 172.21.15.72:0/870848577 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd64135e50 msgr2=0x7fcd6411dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.887+0000 7fcd6c353700 1 --2- 172.21.15.72:0/870848577 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd64135e50 0x7fcd6411dfb0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcd6409ea70 tx=0x7fcd5c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.887+0000 7fcd6c353700 1 -- 172.21.15.72:0/870848577 shutdown_connections 2023-10-03T10:17:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.887+0000 7fcd6c353700 1 --2- 172.21.15.72:0/870848577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd6409d6f0 0x7fcd6411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.887+0000 7fcd6c353700 1 --2- 172.21.15.72:0/870848577 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd64135e50 0x7fcd6411dfb0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.887+0000 7fcd6c353700 1 --2- 172.21.15.72:0/870848577 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd6409e1d0 0x7fcd6411da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.887+0000 7fcd6c353700 1 -- 172.21.15.72:0/870848577 >> 172.21.15.72:0/870848577 conn(0x7fcd64066f50 msgr2=0x7fcd64070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.887+0000 7fcd6c353700 1 -- 172.21.15.72:0/870848577 shutdown_connections 2023-10-03T10:17:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.887+0000 7fcd6c353700 1 -- 172.21.15.72:0/870848577 wait complete. 2023-10-03T10:17:36.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:36.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.983+0000 7ffa4ef31700 1 -- 172.21.15.72:0/3454746339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa48074ea0 con 0x7ffa4812ff20 2023-10-03T10:17:36.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.983+0000 7ffa457fa700 1 -- 172.21.15.72:0/3454746339 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffa3c0199a0 con 0x7ffa4812ff20 2023-10-03T10:17:36.984 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:36.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.985+0000 7ffa4ef31700 1 -- 172.21.15.72:0/3454746339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa4812ff20 msgr2=0x7ffa4809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.985+0000 7ffa4ef31700 1 --2- 172.21.15.72:0/3454746339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa4812ff20 0x7ffa4809c480 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009c40 tx=0x7ffa3c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:36.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.985+0000 7ffa4ef31700 1 -- 172.21.15.72:0/3454746339 shutdown_connections 2023-10-03T10:17:36.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.985+0000 7ffa4ef31700 1 --2- 172.21.15.72:0/3454746339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa4812ff20 0x7ffa4809c480 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.985+0000 7ffa4ef31700 1 --2- 172.21.15.72:0/3454746339 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa48133a80 0x7ffa4809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.985+0000 7ffa4ef31700 1 --2- 172.21.15.72:0/3454746339 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa48130870 0x7ffa4809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.985+0000 7ffa4ef31700 1 -- 172.21.15.72:0/3454746339 >> 172.21.15.72:0/3454746339 conn(0x7ffa480a4210 msgr2=0x7ffa4809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.985+0000 7ffa4ef31700 1 -- 172.21.15.72:0/3454746339 shutdown_connections 2023-10-03T10:17:36.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:36.985+0000 7ffa4ef31700 1 -- 172.21.15.72:0/3454746339 wait complete. 2023-10-03T10:17:36.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:37.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.017+0000 7f00bbfd9700 1 -- 172.21.15.72:0/1135746293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f00b40a46c0 con 0x7f00b4133a80 2023-10-03T10:17:37.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.018+0000 7f00aa7fc700 1 -- 172.21.15.72:0/1135746293 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00ac012340 con 0x7f00b4133a80 2023-10-03T10:17:37.019 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:37.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.020+0000 7f00bbfd9700 1 -- 172.21.15.72:0/1135746293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00b4133a80 msgr2=0x7f00b409cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.020+0000 7f00bbfd9700 1 --2- 172.21.15.72:0/1135746293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00b4133a80 0x7f00b409cf10 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009e50 tx=0x7f00ac00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.020+0000 7f00bbfd9700 1 -- 172.21.15.72:0/1135746293 shutdown_connections 2023-10-03T10:17:37.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.020+0000 7f00bbfd9700 1 --2- 172.21.15.72:0/1135746293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00b4133a80 0x7f00b409cf10 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.020+0000 7f00bbfd9700 1 --2- 172.21.15.72:0/1135746293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00b412ff20 0x7f00b409c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.020+0000 7f00bbfd9700 1 --2- 172.21.15.72:0/1135746293 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00b4130870 0x7f00b409c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.020+0000 7f00bbfd9700 1 -- 172.21.15.72:0/1135746293 >> 172.21.15.72:0/1135746293 conn(0x7f00b40a4210 msgr2=0x7f00b40a0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.020+0000 7f00bbfd9700 1 -- 172.21.15.72:0/1135746293 shutdown_connections 2023-10-03T10:17:37.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.020+0000 7f00bbfd9700 1 -- 172.21.15.72:0/1135746293 wait complete. 2023-10-03T10:17:37.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:37.363 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:37.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.488+0000 7fe34ae92700 1 Processor -- start 2023-10-03T10:17:37.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.488+0000 7fe34ae92700 1 -- start start 2023-10-03T10:17:37.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe34ae92700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe34409d6f0 0x7fe34409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe34ae92700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe34409e000 0x7fe344130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe34ae92700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34409f130 con 0x7fe34409e410 2023-10-03T10:17:37.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe34ae92700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34409f520 con 0x7fe34409d6f0 2023-10-03T10:17:37.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe34ae92700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe34409e930 con 0x7fe34409e000 2023-10-03T10:17:37.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe348c2e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe34409d6f0 0x7fe34409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe343fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe34409e000 0x7fe344130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe348c2e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe34409d6f0 0x7fe34409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57652/0 (socket says 172.21.15.72:57652) 2023-10-03T10:17:37.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe343fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe34409e000 0x7fe344130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43484/0 (socket says 172.21.15.72:43484) 2023-10-03T10:17:37.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe348c2e700 1 -- 172.21.15.72:0/3599088188 learned_addr learned my addr 172.21.15.72:0/3599088188 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:37.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe348c2e700 1 -- 172.21.15.72:0/3599088188 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe34409e000 msgr2=0x7fe344130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe348c2e700 1 --2- 172.21.15.72:0/3599088188 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe34409e000 0x7fe344130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe348c2e700 1 -- 172.21.15.72:0/3599088188 >> v1:172.21.15.72:6789/0 conn(0x7fe34409e410 legacy=0x7fe344130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe348c2e700 1 -- 172.21.15.72:0/3599088188 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34409b2d0 con 0x7fe34409d6f0 2023-10-03T10:17:37.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe343fff700 1 --2- 172.21.15.72:0/3599088188 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe34409e000 0x7fe344130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe348c2e700 1 --2- 172.21.15.72:0/3599088188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe34409d6f0 0x7fe34409dac0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fe33800bb90 tx=0x7fe33800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fa0e141b7ea0b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe3437fe700 1 -- 172.21.15.72:0/3599088188 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33800dd30 con 0x7fe34409d6f0 2023-10-03T10:17:37.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe3437fe700 1 -- 172.21.15.72:0/3599088188 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33800de90 con 0x7fe34409d6f0 2023-10-03T10:17:37.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.489+0000 7fe3437fe700 1 -- 172.21.15.72:0/3599088188 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe338010690 con 0x7fe34409d6f0 2023-10-03T10:17:37.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.490+0000 7fe34ae92700 1 -- 172.21.15.72:0/3599088188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe34409d6f0 msgr2=0x7fe34409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.490+0000 7fe34ae92700 1 --2- 172.21.15.72:0/3599088188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe34409d6f0 0x7fe34409dac0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fe33800bb90 tx=0x7fe33800bea0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.490+0000 7fe34ae92700 1 -- 172.21.15.72:0/3599088188 shutdown_connections 2023-10-03T10:17:37.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.490+0000 7fe34ae92700 1 --2- 172.21.15.72:0/3599088188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe34409d6f0 0x7fe34409dac0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.490+0000 7fe34ae92700 1 --2- 172.21.15.72:0/3599088188 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe34409e000 0x7fe344130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.490+0000 7fe34ae92700 1 -- 172.21.15.72:0/3599088188 >> 172.21.15.72:0/3599088188 conn(0x7fe344066f50 msgr2=0x7fe34409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.490+0000 7fe34ae92700 1 -- 172.21.15.72:0/3599088188 shutdown_connections 2023-10-03T10:17:37.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.490+0000 7fe34ae92700 1 -- 172.21.15.72:0/3599088188 wait complete. 2023-10-03T10:17:37.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.491+0000 7fe34ae92700 1 Processor -- start 2023-10-03T10:17:37.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.491+0000 7fe34ae92700 1 -- start start 2023-10-03T10:17:37.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.491+0000 7fe34ae92700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe34409d6f0 0x7fe344122400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.491+0000 7fe34ae92700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe34409e000 0x7fe344122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.491+0000 7fe34ae92700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe34409e410 0x7fe344122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.491+0000 7fe34ae92700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe344130350 con 0x7fe34409e000 2023-10-03T10:17:37.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.491+0000 7fe34ae92700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe344124070 con 0x7fe34409d6f0 2023-10-03T10:17:37.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.491+0000 7fe34ae92700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe344125c00 con 0x7fe34409e410 2023-10-03T10:17:37.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.491+0000 7fe348c2e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe34409d6f0 0x7fe344122400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.491+0000 7fe348c2e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe34409d6f0 0x7fe344122400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43486/0 (socket says 172.21.15.72:43486) 2023-10-03T10:17:37.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.491+0000 7fe348c2e700 1 -- 172.21.15.72:0/3367251121 learned_addr learned my addr 172.21.15.72:0/3367251121 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:37.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.491+0000 7fe34942f700 1 --2- 172.21.15.72:0/3367251121 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe34409e410 0x7fe344122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.491+0000 7fe343fff700 1 --2- 172.21.15.72:0/3367251121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe34409e000 0x7fe344122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.492+0000 7fe348c2e700 1 -- 172.21.15.72:0/3367251121 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe34409e410 msgr2=0x7fe344122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.492+0000 7fe348c2e700 1 --2- 172.21.15.72:0/3367251121 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe34409e410 0x7fe344122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.492+0000 7fe348c2e700 1 -- 172.21.15.72:0/3367251121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe34409e000 msgr2=0x7fe344122940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.492+0000 7fe348c2e700 1 --2- 172.21.15.72:0/3367251121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe34409e000 0x7fe344122940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.492+0000 7fe348c2e700 1 -- 172.21.15.72:0/3367251121 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3300094a0 con 0x7fe34409d6f0 2023-10-03T10:17:37.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.492+0000 7fe348c2e700 1 --2- 172.21.15.72:0/3367251121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe34409d6f0 0x7fe344122400 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe338000c00 tx=0x7fe338004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.492+0000 7fe3417fa700 1 -- 172.21.15.72:0/3367251121 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe338003b70 con 0x7fe34409d6f0 2023-10-03T10:17:37.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.492+0000 7fe3417fa700 1 -- 172.21.15.72:0/3367251121 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe338003cd0 con 0x7fe34409d6f0 2023-10-03T10:17:37.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.492+0000 7fe34ae92700 1 -- 172.21.15.72:0/3367251121 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33800b7f0 con 0x7fe34409d6f0 2023-10-03T10:17:37.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.492+0000 7fe3417fa700 1 -- 172.21.15.72:0/3367251121 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3380106b0 con 0x7fe34409d6f0 2023-10-03T10:17:37.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.492+0000 7fe34ae92700 1 -- 172.21.15.72:0/3367251121 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3441247c0 con 0x7fe34409d6f0 2023-10-03T10:17:37.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.493+0000 7fe34ae92700 1 -- 172.21.15.72:0/3367251121 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3441258a0 con 0x7fe34409d6f0 2023-10-03T10:17:37.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.493+0000 7fe3417fa700 1 -- 172.21.15.72:0/3367251121 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe338019400 con 0x7fe34409d6f0 2023-10-03T10:17:37.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.493+0000 7fe3417fa700 1 -- 172.21.15.72:0/3367251121 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe338041170 con 0x7fe34409d6f0 2023-10-03T10:17:37.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.498+0000 7fe3417fa700 1 -- 172.21.15.72:0/3367251121 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe338019e60 con 0x7fe34409d6f0 2023-10-03T10:17:37.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.685+0000 7fe34ae92700 1 -- 172.21.15.72:0/3367251121 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe344074ea0 con 0x7fe34409d6f0 2023-10-03T10:17:37.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.686+0000 7fe3417fa700 1 -- 172.21.15.72:0/3367251121 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe33800e360 con 0x7fe34409d6f0 2023-10-03T10:17:37.686 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:37.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.688+0000 7fe34ae92700 1 -- 172.21.15.72:0/3367251121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe34409d6f0 msgr2=0x7fe344122400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.688+0000 7fe34ae92700 1 --2- 172.21.15.72:0/3367251121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe34409d6f0 0x7fe344122400 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe338000c00 tx=0x7fe338004750 comp rx=0 tx=0).stop 2023-10-03T10:17:37.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.688+0000 7fe34ae92700 1 -- 172.21.15.72:0/3367251121 shutdown_connections 2023-10-03T10:17:37.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.688+0000 7fe34ae92700 1 --2- 172.21.15.72:0/3367251121 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe34409e410 0x7fe344122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.688+0000 7fe34ae92700 1 --2- 172.21.15.72:0/3367251121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe34409d6f0 0x7fe344122400 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.688+0000 7fe34ae92700 1 --2- 172.21.15.72:0/3367251121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe34409e000 0x7fe344122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.688+0000 7fe34ae92700 1 -- 172.21.15.72:0/3367251121 >> 172.21.15.72:0/3367251121 conn(0x7fe344066f50 msgr2=0x7fe34406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.688+0000 7fe34ae92700 1 -- 172.21.15.72:0/3367251121 shutdown_connections 2023-10-03T10:17:37.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:37.688+0000 7fe34ae92700 1 -- 172.21.15.72:0/3367251121 wait complete. 2023-10-03T10:17:37.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:37.901 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:37.998 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:38.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.024+0000 7f7369b8b700 1 Processor -- start 2023-10-03T10:17:38.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.024+0000 7f7369b8b700 1 -- start start 2023-10-03T10:17:38.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.024+0000 7f7369b8b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f736409d6f0 0x7f736409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.024+0000 7f7369b8b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f736409e410 0x7f7364130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.024+0000 7f7369b8b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736409f130 con 0x7f736409e000 2023-10-03T10:17:38.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f7369b8b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736409f520 con 0x7f736409d6f0 2023-10-03T10:17:38.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f7369b8b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736409e930 con 0x7f736409e410 2023-10-03T10:17:38.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f7363fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f736409e410 0x7f7364130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f73637fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f736409d6f0 0x7f736409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f7363fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f736409e410 0x7f7364130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43500/0 (socket says 172.21.15.72:43500) 2023-10-03T10:17:38.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f7363fff700 1 -- 172.21.15.72:0/2820214 learned_addr learned my addr 172.21.15.72:0/2820214 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:38.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f73637fe700 1 -- 172.21.15.72:0/2820214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f736409e410 msgr2=0x7f7364130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f73637fe700 1 --2- 172.21.15.72:0/2820214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f736409e410 0x7f7364130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f73637fe700 1 -- 172.21.15.72:0/2820214 >> v1:172.21.15.72:6789/0 conn(0x7f736409e000 legacy=0x7f7364130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f73637fe700 1 -- 172.21.15.72:0/2820214 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736409b2d0 con 0x7f736409d6f0 2023-10-03T10:17:38.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f73627fc700 1 -- 172.21.15.72:0/2820214 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638257876 0 0) 0x7f736409f130 con 0x7f736409e000 2023-10-03T10:17:38.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f7363fff700 1 --2- 172.21.15.72:0/2820214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f736409e410 0x7f7364130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f73637fe700 1 --2- 172.21.15.72:0/2820214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f736409d6f0 0x7f736409dac0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f7354009840 tx=0x7f7354009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fe222b2ef5a395 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f73627fc700 1 -- 172.21.15.72:0/2820214 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354011830 con 0x7f736409d6f0 2023-10-03T10:17:38.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f73627fc700 1 -- 172.21.15.72:0/2820214 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7354011990 con 0x7f736409d6f0 2023-10-03T10:17:38.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.025+0000 7f73627fc700 1 -- 172.21.15.72:0/2820214 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354011d20 con 0x7f736409d6f0 2023-10-03T10:17:38.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.026+0000 7f7369b8b700 1 -- 172.21.15.72:0/2820214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f736409d6f0 msgr2=0x7f736409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.026+0000 7f7369b8b700 1 --2- 172.21.15.72:0/2820214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f736409d6f0 0x7f736409dac0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f7354009840 tx=0x7f7354009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:38.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.026+0000 7f7369b8b700 1 -- 172.21.15.72:0/2820214 shutdown_connections 2023-10-03T10:17:38.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.026+0000 7f7369b8b700 1 --2- 172.21.15.72:0/2820214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f736409e410 0x7f7364130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.026+0000 7f7369b8b700 1 --2- 172.21.15.72:0/2820214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f736409d6f0 0x7f736409dac0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.026+0000 7f7369b8b700 1 -- 172.21.15.72:0/2820214 >> 172.21.15.72:0/2820214 conn(0x7f7364066f50 msgr2=0x7f736409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.026+0000 7f7369b8b700 1 -- 172.21.15.72:0/2820214 shutdown_connections 2023-10-03T10:17:38.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.026+0000 7f7369b8b700 1 -- 172.21.15.72:0/2820214 wait complete. 2023-10-03T10:17:38.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.027+0000 7f7369b8b700 1 Processor -- start 2023-10-03T10:17:38.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.027+0000 7f7369b8b700 1 -- start start 2023-10-03T10:17:38.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.028+0000 7f7369b8b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f736409d6f0 0x7f736411f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.028+0000 7f7369b8b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f736409e000 0x7f736411f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.028+0000 7f7369b8b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f736409e410 0x7f736411fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.028+0000 7f7369b8b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736409c700 con 0x7f736409e000 2023-10-03T10:17:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.028+0000 7f7369b8b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736409a0c0 con 0x7f736409e410 2023-10-03T10:17:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.028+0000 7f7369b8b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7364121b80 con 0x7f736409d6f0 2023-10-03T10:17:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.028+0000 7f7362ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f736409e000 0x7f736411f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.028+0000 7f7362ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f736409e000 0x7f736411f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57672/0 (socket says 172.21.15.72:57672) 2023-10-03T10:17:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.028+0000 7f7362ffd700 1 -- 172.21.15.72:0/2735234273 learned_addr learned my addr 172.21.15.72:0/2735234273 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.028+0000 7f73637fe700 1 --2- 172.21.15.72:0/2735234273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f736409d6f0 0x7f736411f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.028+0000 7f7363fff700 1 --2- 172.21.15.72:0/2735234273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f736409e410 0x7f736411fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.029+0000 7f7362ffd700 1 -- 172.21.15.72:0/2735234273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f736409d6f0 msgr2=0x7f736411f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.029+0000 7f7362ffd700 1 --2- 172.21.15.72:0/2735234273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f736409d6f0 0x7f736411f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.029+0000 7f7362ffd700 1 -- 172.21.15.72:0/2735234273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f736409e410 msgr2=0x7f736411fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.029+0000 7f7362ffd700 1 --2- 172.21.15.72:0/2735234273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f736409e410 0x7f736411fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.029+0000 7f7362ffd700 1 -- 172.21.15.72:0/2735234273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c009b30 con 0x7f736409e000 2023-10-03T10:17:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.029+0000 7f73637fe700 1 --2- 172.21.15.72:0/2735234273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f736409d6f0 0x7f736411f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.029+0000 7f7363fff700 1 --2- 172.21.15.72:0/2735234273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f736409e410 0x7f736411fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.029+0000 7f7362ffd700 1 --2- 172.21.15.72:0/2735234273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f736409e000 0x7f736411f690 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f735800e990 tx=0x7f735800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.029+0000 7f734bfff700 1 -- 172.21.15.72:0/2735234273 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73580054e0 con 0x7f736409e000 2023-10-03T10:17:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.029+0000 7f734bfff700 1 -- 172.21.15.72:0/2735234273 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7358003680 con 0x7f736409e000 2023-10-03T10:17:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.029+0000 7f7369b8b700 1 -- 172.21.15.72:0/2735234273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73540094a0 con 0x7f736409e000 2023-10-03T10:17:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.029+0000 7f734bfff700 1 -- 172.21.15.72:0/2735234273 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358003a30 con 0x7f736409e000 2023-10-03T10:17:38.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.029+0000 7f7369b8b700 1 -- 172.21.15.72:0/2735234273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7364122990 con 0x7f736409e000 2023-10-03T10:17:38.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.030+0000 7f734bfff700 1 -- 172.21.15.72:0/2735234273 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7358003b90 con 0x7f736409e000 2023-10-03T10:17:38.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.030+0000 7f7369b8b700 1 -- 172.21.15.72:0/2735234273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7364074ea0 con 0x7f736409e000 2023-10-03T10:17:38.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.030+0000 7f734bfff700 1 -- 172.21.15.72:0/2735234273 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f735803f4d0 con 0x7f736409e000 2023-10-03T10:17:38.034 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:38.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.034+0000 7f734bfff700 1 -- 172.21.15.72:0/2735234273 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7358021350 con 0x7f736409e000 2023-10-03T10:17:38.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.124+0000 7f78f78dd700 1 Processor -- start 2023-10-03T10:17:38.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.124+0000 7f78f78dd700 1 -- start start 2023-10-03T10:17:38.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78f78dd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78f0133420 0x7f78f01337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78f78dd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f0133e30 0x7f78f012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78f78dd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f006b990 con 0x7f78f0134260 2023-10-03T10:17:38.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78f78dd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f00a0590 con 0x7f78f0133420 2023-10-03T10:17:38.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78f78dd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f009fb80 con 0x7f78f0133e30 2023-10-03T10:17:38.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78f5679700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78f0133420 0x7f78f01337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78f5679700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78f0133420 0x7f78f01337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57678/0 (socket says 172.21.15.72:57678) 2023-10-03T10:17:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78f5679700 1 -- 172.21.15.72:0/482895688 learned_addr learned my addr 172.21.15.72:0/482895688 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78f4e78700 1 --2- 172.21.15.72:0/482895688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f0133e30 0x7f78f012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78f5679700 1 -- 172.21.15.72:0/482895688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f0133e30 msgr2=0x7f78f012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78f5679700 1 --2- 172.21.15.72:0/482895688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f0133e30 0x7f78f012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78f5679700 1 -- 172.21.15.72:0/482895688 >> v1:172.21.15.72:6789/0 conn(0x7f78f0134260 legacy=0x7f78f01304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78e7fff700 1 -- 172.21.15.72:0/482895688 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661050788 0 0) 0x7f78f006b990 con 0x7f78f0134260 2023-10-03T10:17:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78f5679700 1 -- 172.21.15.72:0/482895688 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f00a0030 con 0x7f78f0133420 2023-10-03T10:17:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78f5679700 1 --2- 172.21.15.72:0/482895688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f0133420 0x7f78f01337f0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0098f0 tx=0x7f78ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd86c88f61bd69e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.125+0000 7f78e7fff700 1 -- 172.21.15.72:0/482895688 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec011830 con 0x7f78f0133420 2023-10-03T10:17:38.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.126+0000 7f78e7fff700 1 -- 172.21.15.72:0/482895688 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec011990 con 0x7f78f0133420 2023-10-03T10:17:38.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.126+0000 7f78e7fff700 1 -- 172.21.15.72:0/482895688 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec011d20 con 0x7f78f0133420 2023-10-03T10:17:38.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.126+0000 7f78f78dd700 1 -- 172.21.15.72:0/482895688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f0133420 msgr2=0x7f78f01337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.126+0000 7f78f78dd700 1 --2- 172.21.15.72:0/482895688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f0133420 0x7f78f01337f0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0098f0 tx=0x7f78ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:38.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.126+0000 7f78f78dd700 1 -- 172.21.15.72:0/482895688 shutdown_connections 2023-10-03T10:17:38.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.126+0000 7f78f78dd700 1 --2- 172.21.15.72:0/482895688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f0133420 0x7f78f01337f0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.126+0000 7f78f78dd700 1 --2- 172.21.15.72:0/482895688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f0133e30 0x7f78f012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.126+0000 7f78f78dd700 1 -- 172.21.15.72:0/482895688 >> 172.21.15.72:0/482895688 conn(0x7f78f00a4210 msgr2=0x7f78f00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.126+0000 7f78f78dd700 1 -- 172.21.15.72:0/482895688 shutdown_connections 2023-10-03T10:17:38.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.126+0000 7f78f78dd700 1 -- 172.21.15.72:0/482895688 wait complete. 2023-10-03T10:17:38.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.127+0000 7f78f78dd700 1 Processor -- start 2023-10-03T10:17:38.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.127+0000 7f78f78dd700 1 -- start start 2023-10-03T10:17:38.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f78dd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f0133420 0x7f78f009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f78dd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f0133e30 0x7f78f009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f78dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f0134260 0x7f78f009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f78dd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f0120110 con 0x7f78f0133e30 2023-10-03T10:17:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f78dd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f011f080 con 0x7f78f0133420 2023-10-03T10:17:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f78dd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78f009deb0 con 0x7f78f0134260 2023-10-03T10:17:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f5e7a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f0134260 0x7f78f009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f5e7a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f0134260 0x7f78f009cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38264/0 (socket says 172.21.15.72:38264) 2023-10-03T10:17:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f5e7a700 1 -- 172.21.15.72:0/252080954 learned_addr learned my addr 172.21.15.72:0/252080954 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f5679700 1 --2- 172.21.15.72:0/252080954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f0133420 0x7f78f009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f4e78700 1 --2- 172.21.15.72:0/252080954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f0133e30 0x7f78f009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f5679700 1 -- 172.21.15.72:0/252080954 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f0134260 msgr2=0x7f78f009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f5679700 1 --2- 172.21.15.72:0/252080954 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f0134260 0x7f78f009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f5679700 1 -- 172.21.15.72:0/252080954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f0133e30 msgr2=0x7f78f009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f5679700 1 --2- 172.21.15.72:0/252080954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f0133e30 0x7f78f009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f5679700 1 -- 172.21.15.72:0/252080954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec009550 con 0x7f78f0133420 2023-10-03T10:17:38.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f5679700 1 --2- 172.21.15.72:0/252080954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f0133420 0x7f78f009c480 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f78ec016000 tx=0x7f78ec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78e5ffb700 1 -- 172.21.15.72:0/252080954 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec004400 con 0x7f78f0133420 2023-10-03T10:17:38.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78e5ffb700 1 -- 172.21.15.72:0/252080954 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec01f070 con 0x7f78f0133420 2023-10-03T10:17:38.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.128+0000 7f78f78dd700 1 -- 172.21.15.72:0/252080954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f011edd0 con 0x7f78f0133420 2023-10-03T10:17:38.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.129+0000 7f78e5ffb700 1 -- 172.21.15.72:0/252080954 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0038a0 con 0x7f78f0133420 2023-10-03T10:17:38.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.129+0000 7f78f78dd700 1 -- 172.21.15.72:0/252080954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f011fd90 con 0x7f78f0133420 2023-10-03T10:17:38.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.130+0000 7f78e5ffb700 1 -- 172.21.15.72:0/252080954 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78ec021030 con 0x7f78f0133420 2023-10-03T10:17:38.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.130+0000 7f78e5ffb700 1 -- 172.21.15.72:0/252080954 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f78ec040a10 con 0x7f78f0133420 2023-10-03T10:17:38.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.130+0000 7f78f78dd700 1 -- 172.21.15.72:0/252080954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f0074ea0 con 0x7f78f0133420 2023-10-03T10:17:38.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.134+0000 7f78e5ffb700 1 -- 172.21.15.72:0/252080954 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78ec0239c0 con 0x7f78f0133420 2023-10-03T10:17:38.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.160+0000 7f76fa905700 1 Processor -- start 2023-10-03T10:17:38.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.160+0000 7f76fa905700 1 -- start start 2023-10-03T10:17:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.160+0000 7f76fa905700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76f4133420 0x7f76f41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76fa905700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76f4133e30 0x7f76f412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76fa905700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76f4134260 0x7f76f41304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76fa905700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f406b990 con 0x7f76f4133e30 2023-10-03T10:17:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76fa905700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f40a0590 con 0x7f76f4134260 2023-10-03T10:17:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76fa905700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76f409fb80 con 0x7f76f4133420 2023-10-03T10:17:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f8ea2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76f4134260 0x7f76f41304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76f4133420 0x7f76f41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76f4133e30 0x7f76f412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f8ea2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76f4134260 0x7f76f41304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43534/0 (socket says 172.21.15.72:43534) 2023-10-03T10:17:38.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f8ea2700 1 -- 172.21.15.72:0/2621625129 learned_addr learned my addr 172.21.15.72:0/2621625129 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f37fe700 1 -- 172.21.15.72:0/2621625129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76f4133420 msgr2=0x7f76f41337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f37fe700 1 --2- 172.21.15.72:0/2621625129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76f4133420 0x7f76f41337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f37fe700 1 -- 172.21.15.72:0/2621625129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76f4134260 msgr2=0x7f76f41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f37fe700 1 --2- 172.21.15.72:0/2621625129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76f4134260 0x7f76f41304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f37fe700 1 -- 172.21.15.72:0/2621625129 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f40a0030 con 0x7f76f4133e30 2023-10-03T10:17:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f8ea2700 1 --2- 172.21.15.72:0/2621625129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76f4134260 0x7f76f41304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f3fff700 1 --2- 172.21.15.72:0/2621625129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76f4133420 0x7f76f41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f37fe700 1 --2- 172.21.15.72:0/2621625129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76f4133e30 0x7f76f412ff90 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009840 tx=0x7f76e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6230f97af1d379df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f2ffd700 1 -- 172.21.15.72:0/2621625129 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8011830 con 0x7f76f4133e30 2023-10-03T10:17:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f2ffd700 1 -- 172.21.15.72:0/2621625129 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e8011990 con 0x7f76f4133e30 2023-10-03T10:17:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.161+0000 7f76f2ffd700 1 -- 172.21.15.72:0/2621625129 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8011d20 con 0x7f76f4133e30 2023-10-03T10:17:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.162+0000 7f76fa905700 1 -- 172.21.15.72:0/2621625129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76f4133e30 msgr2=0x7f76f412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.162+0000 7f76fa905700 1 --2- 172.21.15.72:0/2621625129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76f4133e30 0x7f76f412ff90 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009840 tx=0x7f76e8009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.162+0000 7f76fa905700 1 -- 172.21.15.72:0/2621625129 shutdown_connections 2023-10-03T10:17:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.162+0000 7f76fa905700 1 --2- 172.21.15.72:0/2621625129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76f4134260 0x7f76f41304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.162+0000 7f76fa905700 1 --2- 172.21.15.72:0/2621625129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76f4133420 0x7f76f41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.162+0000 7f76fa905700 1 --2- 172.21.15.72:0/2621625129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76f4133e30 0x7f76f412ff90 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.162+0000 7f76fa905700 1 -- 172.21.15.72:0/2621625129 >> 172.21.15.72:0/2621625129 conn(0x7f76f40a4210 msgr2=0x7f76f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.162+0000 7f76fa905700 1 -- 172.21.15.72:0/2621625129 shutdown_connections 2023-10-03T10:17:38.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.162+0000 7f76fa905700 1 -- 172.21.15.72:0/2621625129 wait complete. 2023-10-03T10:17:38.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.163+0000 7f76fa905700 1 Processor -- start 2023-10-03T10:17:38.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.163+0000 7f76fa905700 1 -- start start 2023-10-03T10:17:38.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76fa905700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76f4133420 0x7f76f409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76fa905700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76f4133e30 0x7f76f409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76fa905700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76f4134260 0x7f76f409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76fa905700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f409d850 con 0x7f76f4133420 2023-10-03T10:17:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76fa905700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f412daf0 con 0x7f76f4133e30 2023-10-03T10:17:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76fa905700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76f411f1e0 con 0x7f76f4134260 2023-10-03T10:17:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76f37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76f4133e30 0x7f76f409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76f37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76f4133e30 0x7f76f409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43550/0 (socket says 172.21.15.72:43550) 2023-10-03T10:17:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76f37fe700 1 -- 172.21.15.72:0/2063693147 learned_addr learned my addr 172.21.15.72:0/2063693147 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:38.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76f3fff700 1 --2- 172.21.15.72:0/2063693147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76f4133420 0x7f76f409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76f8ea2700 1 --2- 172.21.15.72:0/2063693147 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76f4134260 0x7f76f409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76f3fff700 1 -- 172.21.15.72:0/2063693147 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76f4134260 msgr2=0x7f76f409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76f3fff700 1 --2- 172.21.15.72:0/2063693147 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76f4134260 0x7f76f409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76f3fff700 1 -- 172.21.15.72:0/2063693147 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76f4133e30 msgr2=0x7f76f409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76f3fff700 1 --2- 172.21.15.72:0/2063693147 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76f4133e30 0x7f76f409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76f3fff700 1 -- 172.21.15.72:0/2063693147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e40094a0 con 0x7f76f4133420 2023-10-03T10:17:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76f37fe700 1 --2- 172.21.15.72:0/2063693147 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76f4133e30 0x7f76f409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76f3fff700 1 --2- 172.21.15.72:0/2063693147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76f4133420 0x7f76f409c480 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f76e400e9b0 tx=0x7f76e400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76f0ff9700 1 -- 172.21.15.72:0/2063693147 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e400ee50 con 0x7f76f4133420 2023-10-03T10:17:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76f0ff9700 1 -- 172.21.15.72:0/2063693147 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e400c850 con 0x7f76f4133420 2023-10-03T10:17:38.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76f0ff9700 1 -- 172.21.15.72:0/2063693147 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e400cc00 con 0x7f76f4133420 2023-10-03T10:17:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76fa905700 1 -- 172.21.15.72:0/2063693147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ec009b30 con 0x7f76f4133420 2023-10-03T10:17:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.164+0000 7f76fa905700 1 -- 172.21.15.72:0/2063693147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e80094a0 con 0x7f76f4133420 2023-10-03T10:17:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.165+0000 7f76f0ff9700 1 -- 172.21.15.72:0/2063693147 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f76e4013470 con 0x7f76f4133420 2023-10-03T10:17:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.165+0000 7f76f0ff9700 1 -- 172.21.15.72:0/2063693147 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f76e403f8a0 con 0x7f76f4133420 2023-10-03T10:17:38.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.165+0000 7f76fa905700 1 -- 172.21.15.72:0/2063693147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f411f9d0 con 0x7f76f4133420 2023-10-03T10:17:38.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.170+0000 7f76f0ff9700 1 -- 172.21.15.72:0/2063693147 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76e4017020 con 0x7f76f4133420 2023-10-03T10:17:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.303+0000 7f7369b8b700 1 -- 172.21.15.72:0/2735234273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f736406ec10 con 0x7f736409e000 2023-10-03T10:17:38.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.303+0000 7f734bfff700 1 -- 172.21.15.72:0/2735234273 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7358014030 con 0x7f736409e000 2023-10-03T10:17:38.304 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:38.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.305+0000 7f7369b8b700 1 -- 172.21.15.72:0/2735234273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f736409e000 msgr2=0x7f736411f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.305+0000 7f7369b8b700 1 --2- 172.21.15.72:0/2735234273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f736409e000 0x7f736411f690 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f735800e990 tx=0x7f735800eca0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.305+0000 7f7369b8b700 1 -- 172.21.15.72:0/2735234273 shutdown_connections 2023-10-03T10:17:38.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.305+0000 7f7369b8b700 1 --2- 172.21.15.72:0/2735234273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f736409e410 0x7f736411fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.305+0000 7f7369b8b700 1 --2- 172.21.15.72:0/2735234273 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f736409d6f0 0x7f736411f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.305+0000 7f7369b8b700 1 --2- 172.21.15.72:0/2735234273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f736409e000 0x7f736411f690 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.305+0000 7f7369b8b700 1 -- 172.21.15.72:0/2735234273 >> 172.21.15.72:0/2735234273 conn(0x7f7364066f50 msgr2=0x7f7364119480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.306+0000 7f7369b8b700 1 -- 172.21.15.72:0/2735234273 shutdown_connections 2023-10-03T10:17:38.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.306+0000 7f7369b8b700 1 -- 172.21.15.72:0/2735234273 wait complete. 2023-10-03T10:17:38.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:38.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.365+0000 7f76fa905700 1 -- 172.21.15.72:0/2063693147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f76f4074ea0 con 0x7f76f4133420 2023-10-03T10:17:38.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.366+0000 7f76f0ff9700 1 -- 172.21.15.72:0/2063693147 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f76e4013720 con 0x7f76f4133420 2023-10-03T10:17:38.367 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:38.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.368+0000 7f76fa905700 1 -- 172.21.15.72:0/2063693147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76f4133420 msgr2=0x7f76f409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.368+0000 7f76fa905700 1 --2- 172.21.15.72:0/2063693147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76f4133420 0x7f76f409c480 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f76e400e9b0 tx=0x7f76e400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.368+0000 7f76fa905700 1 -- 172.21.15.72:0/2063693147 shutdown_connections 2023-10-03T10:17:38.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.368+0000 7f76fa905700 1 --2- 172.21.15.72:0/2063693147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76f4133420 0x7f76f409c480 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.368+0000 7f76fa905700 1 --2- 172.21.15.72:0/2063693147 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f76f4134260 0x7f76f409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.368+0000 7f76fa905700 1 --2- 172.21.15.72:0/2063693147 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76f4133e30 0x7f76f409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.368+0000 7f76fa905700 1 -- 172.21.15.72:0/2063693147 >> 172.21.15.72:0/2063693147 conn(0x7f76f40a4210 msgr2=0x7f76f40a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.368+0000 7f76fa905700 1 -- 172.21.15.72:0/2063693147 shutdown_connections 2023-10-03T10:17:38.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.368+0000 7f76fa905700 1 -- 172.21.15.72:0/2063693147 wait complete. 2023-10-03T10:17:38.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:38.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.400+0000 7f78f78dd700 1 -- 172.21.15.72:0/252080954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f78f006b250 con 0x7f78f0133420 2023-10-03T10:17:38.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.400+0000 7f78e5ffb700 1 -- 172.21.15.72:0/252080954 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f78ec01ce00 con 0x7f78f0133420 2023-10-03T10:17:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:38.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.402+0000 7f78f78dd700 1 -- 172.21.15.72:0/252080954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f0133420 msgr2=0x7f78f009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.402+0000 7f78f78dd700 1 --2- 172.21.15.72:0/252080954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f0133420 0x7f78f009c480 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f78ec016000 tx=0x7f78ec004750 comp rx=0 tx=0).stop 2023-10-03T10:17:38.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.402+0000 7f78f78dd700 1 -- 172.21.15.72:0/252080954 shutdown_connections 2023-10-03T10:17:38.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.402+0000 7f78f78dd700 1 --2- 172.21.15.72:0/252080954 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f78f0134260 0x7f78f009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.402+0000 7f78f78dd700 1 --2- 172.21.15.72:0/252080954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78f0133420 0x7f78f009c480 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.402+0000 7f78f78dd700 1 --2- 172.21.15.72:0/252080954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78f0133e30 0x7f78f009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.402+0000 7f78f78dd700 1 -- 172.21.15.72:0/252080954 >> 172.21.15.72:0/252080954 conn(0x7f78f00a4210 msgr2=0x7f78f012de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.402+0000 7f78f78dd700 1 -- 172.21.15.72:0/252080954 shutdown_connections 2023-10-03T10:17:38.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.402+0000 7f78f78dd700 1 -- 172.21.15.72:0/252080954 wait complete. 2023-10-03T10:17:38.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:38.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:38.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.823+0000 7fb7336d3700 1 Processor -- start 2023-10-03T10:17:38.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.823+0000 7fb7336d3700 1 -- start start 2023-10-03T10:17:38.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.824+0000 7fb7336d3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb72c09d6f0 0x7fb72c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.824+0000 7fb7336d3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72c09e000 0x7fb72c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.824+0000 7fb7336d3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72c09b120 con 0x7fb72c09e410 2023-10-03T10:17:38.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.824+0000 7fb7336d3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb72c06b460 con 0x7fb72c09d6f0 2023-10-03T10:17:38.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.824+0000 7fb7336d3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c09a7e0 con 0x7fb72c09e000 2023-10-03T10:17:38.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.824+0000 7fb73146f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb72c09d6f0 0x7fb72c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.824+0000 7fb73146f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb72c09d6f0 0x7fb72c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40778/0 (socket says 172.21.15.72:40778) 2023-10-03T10:17:38.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.824+0000 7fb730c6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72c09e000 0x7fb72c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.824+0000 7fb73146f700 1 -- 172.21.15.72:0/1036549395 learned_addr learned my addr 172.21.15.72:0/1036549395 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:38.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.824+0000 7fb73146f700 1 -- 172.21.15.72:0/1036549395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72c09e000 msgr2=0x7fb72c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:38.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.824+0000 7fb73146f700 1 --2- 172.21.15.72:0/1036549395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72c09e000 0x7fb72c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.824+0000 7fb73146f700 1 -- 172.21.15.72:0/1036549395 >> v1:172.21.15.72:6789/0 conn(0x7fb72c09e410 legacy=0x7fb72c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.824+0000 7fb73146f700 1 -- 172.21.15.72:0/1036549395 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c09a500 con 0x7fb72c09d6f0 2023-10-03T10:17:38.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.824+0000 7fb730c6e700 1 --2- 172.21.15.72:0/1036549395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72c09e000 0x7fb72c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:38.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.824+0000 7fb73146f700 1 --2- 172.21.15.72:0/1036549395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb72c09d6f0 0x7fb72c09dac0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0098f0 tx=0x7fb71c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d12234aef4f5d37 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.825+0000 7fb723fff700 1 -- 172.21.15.72:0/1036549395 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c011830 con 0x7fb72c09d6f0 2023-10-03T10:17:38.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.825+0000 7fb723fff700 1 -- 172.21.15.72:0/1036549395 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c011990 con 0x7fb72c09d6f0 2023-10-03T10:17:38.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.825+0000 7fb723fff700 1 -- 172.21.15.72:0/1036549395 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c011d20 con 0x7fb72c09d6f0 2023-10-03T10:17:38.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.825+0000 7fb7336d3700 1 -- 172.21.15.72:0/1036549395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb72c09d6f0 msgr2=0x7fb72c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.825+0000 7fb7336d3700 1 --2- 172.21.15.72:0/1036549395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb72c09d6f0 0x7fb72c09dac0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0098f0 tx=0x7fb71c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:38.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.825+0000 7fb7336d3700 1 -- 172.21.15.72:0/1036549395 shutdown_connections 2023-10-03T10:17:38.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.825+0000 7fb7336d3700 1 --2- 172.21.15.72:0/1036549395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb72c09d6f0 0x7fb72c09dac0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.825+0000 7fb7336d3700 1 --2- 172.21.15.72:0/1036549395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72c09e000 0x7fb72c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.825+0000 7fb7336d3700 1 -- 172.21.15.72:0/1036549395 >> 172.21.15.72:0/1036549395 conn(0x7fb72c066f50 msgr2=0x7fb72c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.825+0000 7fb7336d3700 1 -- 172.21.15.72:0/1036549395 shutdown_connections 2023-10-03T10:17:38.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.825+0000 7fb7336d3700 1 -- 172.21.15.72:0/1036549395 wait complete. 2023-10-03T10:17:38.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.826+0000 7fb7336d3700 1 Processor -- start 2023-10-03T10:17:38.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.827+0000 7fb7336d3700 1 -- start start 2023-10-03T10:17:38.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.827+0000 7fb7336d3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72c09d6f0 0x7fb72c1a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.827+0000 7fb7336d3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb72c09e000 0x7fb72c1a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.827+0000 7fb7336d3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb72c09e410 0x7fb72c1a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.827+0000 7fb7336d3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c1a7340 con 0x7fb72c09e000 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.827+0000 7fb7336d3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c1a7ac0 con 0x7fb72c09d6f0 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.827+0000 7fb7336d3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb72c1a80e0 con 0x7fb72c09e410 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.827+0000 7fb73146f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72c09d6f0 0x7fb72c1a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.827+0000 7fb73146f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72c09d6f0 0x7fb72c1a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39536/0 (socket says 172.21.15.72:39536) 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.827+0000 7fb73146f700 1 -- 172.21.15.72:0/2295297357 learned_addr learned my addr 172.21.15.72:0/2295297357 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.827+0000 7fb731c70700 1 --2- 172.21.15.72:0/2295297357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb72c09e410 0x7fb72c1a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.827+0000 7fb730c6e700 1 --2- 172.21.15.72:0/2295297357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb72c09e000 0x7fb72c1a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.828+0000 7fb73146f700 1 -- 172.21.15.72:0/2295297357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb72c09e410 msgr2=0x7fb72c1a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.828+0000 7fb73146f700 1 --2- 172.21.15.72:0/2295297357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb72c09e410 0x7fb72c1a6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.828+0000 7fb73146f700 1 -- 172.21.15.72:0/2295297357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb72c09e000 msgr2=0x7fb72c1a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.828+0000 7fb73146f700 1 --2- 172.21.15.72:0/2295297357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb72c09e000 0x7fb72c1a63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.828+0000 7fb73146f700 1 -- 172.21.15.72:0/2295297357 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7280094a0 con 0x7fb72c09d6f0 2023-10-03T10:17:38.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.828+0000 7fb73146f700 1 --2- 172.21.15.72:0/2295297357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72c09d6f0 0x7fb72c1a5eb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb71c014040 tx=0x7fb71c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:38.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.828+0000 7fb721ffb700 1 -- 172.21.15.72:0/2295297357 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c004510 con 0x7fb72c09d6f0 2023-10-03T10:17:38.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.828+0000 7fb721ffb700 1 -- 172.21.15.72:0/2295297357 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c01e070 con 0x7fb72c09d6f0 2023-10-03T10:17:38.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.828+0000 7fb7336d3700 1 -- 172.21.15.72:0/2295297357 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71c009550 con 0x7fb72c09d6f0 2023-10-03T10:17:38.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.828+0000 7fb721ffb700 1 -- 172.21.15.72:0/2295297357 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c0038c0 con 0x7fb72c09d6f0 2023-10-03T10:17:38.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.828+0000 7fb7336d3700 1 -- 172.21.15.72:0/2295297357 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72c0a3220 con 0x7fb72c09d6f0 2023-10-03T10:17:38.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.829+0000 7fb721ffb700 1 -- 172.21.15.72:0/2295297357 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb71c003a20 con 0x7fb72c09d6f0 2023-10-03T10:17:38.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.829+0000 7fb721ffb700 1 -- 172.21.15.72:0/2295297357 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb71c040560 con 0x7fb72c09d6f0 2023-10-03T10:17:38.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.829+0000 7fb7336d3700 1 -- 172.21.15.72:0/2295297357 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72c09c770 con 0x7fb72c09d6f0 2023-10-03T10:17:38.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:38.834+0000 7fb721ffb700 1 -- 172.21.15.72:0/2295297357 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb71c003cd0 con 0x7fb72c09d6f0 2023-10-03T10:17:39.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.018+0000 7fb7336d3700 1 -- 172.21.15.72:0/2295297357 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb72c1a95e0 con 0x7fb72c09d6f0 2023-10-03T10:17:39.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.018+0000 7fb721ffb700 1 -- 172.21.15.72:0/2295297357 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb71c015020 con 0x7fb72c09d6f0 2023-10-03T10:17:39.019 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:39.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.020+0000 7fb7336d3700 1 -- 172.21.15.72:0/2295297357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72c09d6f0 msgr2=0x7fb72c1a5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.020+0000 7fb7336d3700 1 --2- 172.21.15.72:0/2295297357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72c09d6f0 0x7fb72c1a5eb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb71c014040 tx=0x7fb71c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:39.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.020+0000 7fb7336d3700 1 -- 172.21.15.72:0/2295297357 shutdown_connections 2023-10-03T10:17:39.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.020+0000 7fb7336d3700 1 --2- 172.21.15.72:0/2295297357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb72c09e410 0x7fb72c1a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.020+0000 7fb7336d3700 1 --2- 172.21.15.72:0/2295297357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72c09d6f0 0x7fb72c1a5eb0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.020+0000 7fb7336d3700 1 --2- 172.21.15.72:0/2295297357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb72c09e000 0x7fb72c1a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.020+0000 7fb7336d3700 1 -- 172.21.15.72:0/2295297357 >> 172.21.15.72:0/2295297357 conn(0x7fb72c066f50 msgr2=0x7fb72c1badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.020+0000 7fb7336d3700 1 -- 172.21.15.72:0/2295297357 shutdown_connections 2023-10-03T10:17:39.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.020+0000 7fb7336d3700 1 -- 172.21.15.72:0/2295297357 wait complete. 2023-10-03T10:17:39.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:39.319 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:39.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:39.415 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:39.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.447+0000 7fb46b8bc700 1 Processor -- start 2023-10-03T10:17:39.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.447+0000 7fb46b8bc700 1 -- start start 2023-10-03T10:17:39.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb46b8bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46409d630 0x7fb4640a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb46b8bc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb464138d80 0x7fb46413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb46b8bc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4640a2a70 con 0x7fb4640a0a30 2023-10-03T10:17:39.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb46b8bc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640a01d0 con 0x7fb46409d630 2023-10-03T10:17:39.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb46b8bc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb46409e2b0 con 0x7fb464138d80 2023-10-03T10:17:39.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb469e59700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb464138d80 0x7fb46413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb469658700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb4640a0a30 0x7fb4640a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41276/0 (socket says 172.21.15.72:41276) 2023-10-03T10:17:39.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb469658700 1 -- 172.21.15.72:0/661365519 learned_addr learned my addr 172.21.15.72:0/661365519 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:39.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb468e57700 1 --2- 172.21.15.72:0/661365519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46409d630 0x7fb4640a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb45bfff700 1 -- 172.21.15.72:0/661365519 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288989556 0 0) 0x7fb4640a2a70 con 0x7fb4640a0a30 2023-10-03T10:17:39.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb45bfff700 1 -- 172.21.15.72:0/661365519 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4500035b0 con 0x7fb4640a0a30 2023-10-03T10:17:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb468e57700 1 -- 172.21.15.72:0/661365519 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb464138d80 msgr2=0x7fb46413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb468e57700 1 --2- 172.21.15.72:0/661365519 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb464138d80 0x7fb46413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb468e57700 1 -- 172.21.15.72:0/661365519 >> v1:172.21.15.72:6789/0 conn(0x7fb4640a0a30 legacy=0x7fb4640a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb468e57700 1 -- 172.21.15.72:0/661365519 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46409dc50 con 0x7fb46409d630 2023-10-03T10:17:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.448+0000 7fb468e57700 1 --2- 172.21.15.72:0/661365519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46409d630 0x7fb4640a1510 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb454009870 tx=0x7fb454009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8015470be9bba22 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.449+0000 7fb45bfff700 1 -- 172.21.15.72:0/661365519 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454004230 con 0x7fb46409d630 2023-10-03T10:17:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.449+0000 7fb45bfff700 1 -- 172.21.15.72:0/661365519 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb454004390 con 0x7fb46409d630 2023-10-03T10:17:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.449+0000 7fb45bfff700 1 -- 172.21.15.72:0/661365519 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4540036a0 con 0x7fb46409d630 2023-10-03T10:17:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.450+0000 7fb46b8bc700 1 -- 172.21.15.72:0/661365519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46409d630 msgr2=0x7fb4640a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.450+0000 7fb46b8bc700 1 --2- 172.21.15.72:0/661365519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46409d630 0x7fb4640a1510 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb454009870 tx=0x7fb454009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.450+0000 7fb46b8bc700 1 -- 172.21.15.72:0/661365519 shutdown_connections 2023-10-03T10:17:39.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.450+0000 7fb46b8bc700 1 --2- 172.21.15.72:0/661365519 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb464138d80 0x7fb46413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.450+0000 7fb46b8bc700 1 --2- 172.21.15.72:0/661365519 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46409d630 0x7fb4640a1510 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.450+0000 7fb46b8bc700 1 -- 172.21.15.72:0/661365519 >> 172.21.15.72:0/661365519 conn(0x7fb4640a3050 msgr2=0x7fb4640a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.450+0000 7fb46b8bc700 1 -- 172.21.15.72:0/661365519 shutdown_connections 2023-10-03T10:17:39.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.450+0000 7fb46b8bc700 1 -- 172.21.15.72:0/661365519 wait complete. 2023-10-03T10:17:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.451+0000 7fb46b8bc700 1 Processor -- start 2023-10-03T10:17:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.451+0000 7fb46b8bc700 1 -- start start 2023-10-03T10:17:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.451+0000 7fb46b8bc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46409d630 0x7fb464133900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.451+0000 7fb46b8bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4640a0a30 0x7fb464133e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.451+0000 7fb46b8bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb464138d80 0x7fb464134380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.451+0000 7fb46b8bc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640a0410 con 0x7fb4640a0a30 2023-10-03T10:17:39.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.451+0000 7fb46b8bc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb464134d60 con 0x7fb464138d80 2023-10-03T10:17:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.451+0000 7fb46b8bc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb464136da0 con 0x7fb46409d630 2023-10-03T10:17:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.451+0000 7fb469658700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46409d630 0x7fb464133900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.451+0000 7fb468e57700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4640a0a30 0x7fb464133e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.451+0000 7fb469658700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46409d630 0x7fb464133900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58872/0 (socket says 172.21.15.72:58872) 2023-10-03T10:17:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.451+0000 7fb468e57700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4640a0a30 0x7fb464133e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40802/0 (socket says 172.21.15.72:40802) 2023-10-03T10:17:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.451+0000 7fb469658700 1 -- 172.21.15.72:0/3256932001 learned_addr learned my addr 172.21.15.72:0/3256932001 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.451+0000 7fb469e59700 1 --2- 172.21.15.72:0/3256932001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb464138d80 0x7fb464134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.452+0000 7fb469658700 1 -- 172.21.15.72:0/3256932001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb464138d80 msgr2=0x7fb464134380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.452+0000 7fb469658700 1 --2- 172.21.15.72:0/3256932001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb464138d80 0x7fb464134380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.452+0000 7fb469658700 1 -- 172.21.15.72:0/3256932001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4640a0a30 msgr2=0x7fb464133e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.452+0000 7fb469658700 1 --2- 172.21.15.72:0/3256932001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4640a0a30 0x7fb464133e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.452+0000 7fb469658700 1 -- 172.21.15.72:0/3256932001 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540094a0 con 0x7fb46409d630 2023-10-03T10:17:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.452+0000 7fb469e59700 1 --2- 172.21.15.72:0/3256932001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb464138d80 0x7fb464134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.452+0000 7fb469658700 1 --2- 172.21.15.72:0/3256932001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46409d630 0x7fb464133900 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb4600011e0 tx=0x7fb46000ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.452+0000 7fb459ffb700 1 -- 172.21.15.72:0/3256932001 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460004c80 con 0x7fb46409d630 2023-10-03T10:17:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.452+0000 7fb459ffb700 1 -- 172.21.15.72:0/3256932001 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb460004e00 con 0x7fb46409d630 2023-10-03T10:17:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.452+0000 7fb459ffb700 1 -- 172.21.15.72:0/3256932001 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460007310 con 0x7fb46409d630 2023-10-03T10:17:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.452+0000 7fb46b8bc700 1 -- 172.21.15.72:0/3256932001 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4640a4ae0 con 0x7fb46409d630 2023-10-03T10:17:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.452+0000 7fb46b8bc700 1 -- 172.21.15.72:0/3256932001 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb464135c20 con 0x7fb46409d630 2023-10-03T10:17:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.453+0000 7fb459ffb700 1 -- 172.21.15.72:0/3256932001 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb460007470 con 0x7fb46409d630 2023-10-03T10:17:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.453+0000 7fb459ffb700 1 -- 172.21.15.72:0/3256932001 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb46003f340 con 0x7fb46409d630 2023-10-03T10:17:39.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.453+0000 7fb46b8bc700 1 -- 172.21.15.72:0/3256932001 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4640747f0 con 0x7fb46409d630 2023-10-03T10:17:39.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.458+0000 7fb459ffb700 1 -- 172.21.15.72:0/3256932001 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4600123b0 con 0x7fb46409d630 2023-10-03T10:17:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.519+0000 7f4c3df5a700 1 Processor -- start 2023-10-03T10:17:39.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.519+0000 7f4c3df5a700 1 -- start start 2023-10-03T10:17:39.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.520+0000 7f4c3df5a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c3809f410 0x7f4c38136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.520+0000 7f4c3df5a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4c38136fe0 0x7f4c381393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.520+0000 7f4c3df5a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c38070940 con 0x7f4c3809e930 2023-10-03T10:17:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.520+0000 7f4c3df5a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3806fd60 con 0x7f4c38136fe0 2023-10-03T10:17:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.520+0000 7f4c3df5a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3806fa80 con 0x7f4c3809f410 2023-10-03T10:17:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.520+0000 7f4c36ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c3809f410 0x7f4c38136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.520+0000 7f4c377fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4c3809e930 0x7f4c3809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41288/0 (socket says 172.21.15.72:41288) 2023-10-03T10:17:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.520+0000 7f4c377fe700 1 -- 172.21.15.72:0/2048222243 learned_addr learned my addr 172.21.15.72:0/2048222243 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.520+0000 7f4c37fff700 1 --2- 172.21.15.72:0/2048222243 >> v2:172.21.15.72:3300/0 conn(0x7f4c38136fe0 0x7f4c381393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.521+0000 7f4c37fff700 1 -- 172.21.15.72:0/2048222243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c3809f410 msgr2=0x7f4c38136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.521+0000 7f4c37fff700 1 --2- 172.21.15.72:0/2048222243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c3809f410 0x7f4c38136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.521+0000 7f4c37fff700 1 -- 172.21.15.72:0/2048222243 >> v1:172.21.15.72:6789/0 conn(0x7f4c3809e930 legacy=0x7f4c3809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.521+0000 7f4c37fff700 1 -- 172.21.15.72:0/2048222243 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3809fb60 con 0x7f4c38136fe0 2023-10-03T10:17:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.521+0000 7f4c367fc700 1 -- 172.21.15.72:0/2048222243 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912835468 0 0) 0x7f4c38070940 con 0x7f4c3809e930 2023-10-03T10:17:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.521+0000 7f4c36ffd700 1 --2- 172.21.15.72:0/2048222243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c3809f410 0x7f4c38136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.521+0000 7f4c37fff700 1 --2- 172.21.15.72:0/2048222243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c38136fe0 0x7f4c381393c0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009d90 tx=0x7f4c3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4c9b1eb5877dc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.521+0000 7f4c367fc700 1 -- 172.21.15.72:0/2048222243 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3000e070 con 0x7f4c38136fe0 2023-10-03T10:17:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.521+0000 7f4c367fc700 1 -- 172.21.15.72:0/2048222243 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3000bb20 con 0x7f4c38136fe0 2023-10-03T10:17:39.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.521+0000 7f4c367fc700 1 -- 172.21.15.72:0/2048222243 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30012430 con 0x7f4c38136fe0 2023-10-03T10:17:39.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.522+0000 7f4c3df5a700 1 -- 172.21.15.72:0/2048222243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c38136fe0 msgr2=0x7f4c381393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.522+0000 7f4c3df5a700 1 --2- 172.21.15.72:0/2048222243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c38136fe0 0x7f4c381393c0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009d90 tx=0x7f4c3000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:39.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.522+0000 7f4c3df5a700 1 -- 172.21.15.72:0/2048222243 shutdown_connections 2023-10-03T10:17:39.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.522+0000 7f4c3df5a700 1 --2- 172.21.15.72:0/2048222243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c38136fe0 0x7f4c381393c0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.522+0000 7f4c3df5a700 1 --2- 172.21.15.72:0/2048222243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c3809f410 0x7f4c38136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.522+0000 7f4c3df5a700 1 -- 172.21.15.72:0/2048222243 >> 172.21.15.72:0/2048222243 conn(0x7f4c380a4210 msgr2=0x7f4c380a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.522+0000 7f4c3df5a700 1 -- 172.21.15.72:0/2048222243 shutdown_connections 2023-10-03T10:17:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.522+0000 7f4c3df5a700 1 -- 172.21.15.72:0/2048222243 wait complete. 2023-10-03T10:17:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.523+0000 7f4c3df5a700 1 Processor -- start 2023-10-03T10:17:39.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.524+0000 7f4c3df5a700 1 -- start start 2023-10-03T10:17:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.524+0000 7f4c3df5a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c3809e930 0x7f4c3811e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.524+0000 7f4c3df5a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c3809f410 0x7f4c3811ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.524+0000 7f4c3df5a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c38136fe0 0x7f4c3811f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.524+0000 7f4c3df5a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c38120590 con 0x7f4c3809f410 2023-10-03T10:17:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.524+0000 7f4c3df5a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c381346f0 con 0x7f4c38136fe0 2023-10-03T10:17:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.524+0000 7f4c3df5a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c38122320 con 0x7f4c3809e930 2023-10-03T10:17:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.524+0000 7f4c36ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c3809f410 0x7f4c3811ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.524+0000 7f4c36ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c3809f410 0x7f4c3811ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40820/0 (socket says 172.21.15.72:40820) 2023-10-03T10:17:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.524+0000 7f4c36ffd700 1 -- 172.21.15.72:0/2728537169 learned_addr learned my addr 172.21.15.72:0/2728537169 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.524+0000 7f4c377fe700 1 --2- 172.21.15.72:0/2728537169 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c3809e930 0x7f4c3811e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.524+0000 7f4c37fff700 1 --2- 172.21.15.72:0/2728537169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c38136fe0 0x7f4c3811f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.525+0000 7f4c36ffd700 1 -- 172.21.15.72:0/2728537169 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c3809e930 msgr2=0x7f4c3811e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.525+0000 7f4c36ffd700 1 --2- 172.21.15.72:0/2728537169 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c3809e930 0x7f4c3811e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.525+0000 7f4c36ffd700 1 -- 172.21.15.72:0/2728537169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c38136fe0 msgr2=0x7f4c3811f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.525+0000 7f4c36ffd700 1 --2- 172.21.15.72:0/2728537169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c38136fe0 0x7f4c3811f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.525+0000 7f4c36ffd700 1 -- 172.21.15.72:0/2728537169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c0094a0 con 0x7f4c3809f410 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.525+0000 7f4c36ffd700 1 --2- 172.21.15.72:0/2728537169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c3809f410 0x7f4c3811ed90 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00ebe0 tx=0x7f4c2c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.525+0000 7f4c1ffff700 1 -- 172.21.15.72:0/2728537169 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c00c850 con 0x7f4c3809f410 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.525+0000 7f4c1ffff700 1 -- 172.21.15.72:0/2728537169 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c00c9b0 con 0x7f4c3809f410 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.525+0000 7f4c3df5a700 1 -- 172.21.15.72:0/2728537169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c30009a70 con 0x7f4c3809f410 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.525+0000 7f4c1ffff700 1 -- 172.21.15.72:0/2728537169 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c00cd40 con 0x7f4c3809f410 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.525+0000 7f4c3df5a700 1 -- 172.21.15.72:0/2728537169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c380a32a0 con 0x7f4c3809f410 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.526+0000 7f4c3df5a700 1 -- 172.21.15.72:0/2728537169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c38074ea0 con 0x7f4c3809f410 2023-10-03T10:17:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.526+0000 7f4c1ffff700 1 -- 172.21.15.72:0/2728537169 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c2c013470 con 0x7f4c3809f410 2023-10-03T10:17:39.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.527+0000 7f4c1ffff700 1 -- 172.21.15.72:0/2728537169 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4c2c03ffc0 con 0x7f4c3809f410 2023-10-03T10:17:39.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.531+0000 7f4c1ffff700 1 -- 172.21.15.72:0/2728537169 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c2c013720 con 0x7f4c3809f410 2023-10-03T10:17:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.561+0000 7f29dce68700 1 Processor -- start 2023-10-03T10:17:39.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.561+0000 7f29dce68700 1 -- start start 2023-10-03T10:17:39.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.561+0000 7f29dce68700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f29d809f410 0x7f29d8136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.561+0000 7f29dce68700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f29d8136fe0 0x7f29d81393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.561+0000 7f29dce68700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d8070940 con 0x7f29d809e930 2023-10-03T10:17:39.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.561+0000 7f29dce68700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d806fd60 con 0x7f29d8136fe0 2023-10-03T10:17:39.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.561+0000 7f29dce68700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29d806fa80 con 0x7f29d809f410 2023-10-03T10:17:39.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.561+0000 7f29d6d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f29d8136fe0 0x7f29d81393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.561+0000 7f29d659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f29d809e930 0x7f29d809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41292/0 (socket says 172.21.15.72:41292) 2023-10-03T10:17:39.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.561+0000 7f29d659c700 1 -- 172.21.15.72:0/1247962475 learned_addr learned my addr 172.21.15.72:0/1247962475 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:39.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.562+0000 7f29d5d9b700 1 --2- 172.21.15.72:0/1247962475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f29d809f410 0x7f29d8136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.562+0000 7f29d6d9d700 1 -- 172.21.15.72:0/1247962475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f29d809f410 msgr2=0x7f29d8136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.562+0000 7f29d6d9d700 1 --2- 172.21.15.72:0/1247962475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f29d809f410 0x7f29d8136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.562+0000 7f29d6d9d700 1 -- 172.21.15.72:0/1247962475 >> v1:172.21.15.72:6789/0 conn(0x7f29d809e930 legacy=0x7f29d809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.562+0000 7f29d6d9d700 1 -- 172.21.15.72:0/1247962475 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d809fb60 con 0x7f29d8136fe0 2023-10-03T10:17:39.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.562+0000 7f29d6d9d700 1 --2- 172.21.15.72:0/1247962475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29d8136fe0 0x7f29d81393c0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009d90 tx=0x7f29d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6a2924fdbf2aba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.562+0000 7f29d559a700 1 -- 172.21.15.72:0/1247962475 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d000e070 con 0x7f29d8136fe0 2023-10-03T10:17:39.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.562+0000 7f29d559a700 1 -- 172.21.15.72:0/1247962475 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d000bbd0 con 0x7f29d8136fe0 2023-10-03T10:17:39.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.562+0000 7f29d559a700 1 -- 172.21.15.72:0/1247962475 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0012430 con 0x7f29d8136fe0 2023-10-03T10:17:39.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.563+0000 7f29dce68700 1 -- 172.21.15.72:0/1247962475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29d8136fe0 msgr2=0x7f29d81393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.563+0000 7f29dce68700 1 --2- 172.21.15.72:0/1247962475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29d8136fe0 0x7f29d81393c0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009d90 tx=0x7f29d000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:39.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.563+0000 7f29dce68700 1 -- 172.21.15.72:0/1247962475 shutdown_connections 2023-10-03T10:17:39.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.563+0000 7f29dce68700 1 --2- 172.21.15.72:0/1247962475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29d8136fe0 0x7f29d81393c0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.563+0000 7f29dce68700 1 --2- 172.21.15.72:0/1247962475 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f29d809f410 0x7f29d8136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.563+0000 7f29dce68700 1 -- 172.21.15.72:0/1247962475 >> 172.21.15.72:0/1247962475 conn(0x7f29d80a4210 msgr2=0x7f29d80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.563+0000 7f29dce68700 1 -- 172.21.15.72:0/1247962475 shutdown_connections 2023-10-03T10:17:39.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.563+0000 7f29dce68700 1 -- 172.21.15.72:0/1247962475 wait complete. 2023-10-03T10:17:39.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.564+0000 7f29dce68700 1 Processor -- start 2023-10-03T10:17:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.564+0000 7f29dce68700 1 -- start start 2023-10-03T10:17:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.564+0000 7f29dce68700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f29d809e930 0x7f29d811d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.564+0000 7f29dce68700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29d809f410 0x7f29d811d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.564+0000 7f29dce68700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29d8136fe0 0x7f29d81c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.564+0000 7f29dce68700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d811fe50 con 0x7f29d8136fe0 2023-10-03T10:17:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.564+0000 7f29dce68700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d811f130 con 0x7f29d809f410 2023-10-03T10:17:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.564+0000 7f29dce68700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29d809b220 con 0x7f29d809e930 2023-10-03T10:17:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.564+0000 7f29d659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f29d809e930 0x7f29d811d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.565+0000 7f29d6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29d8136fe0 0x7f29d81c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.565+0000 7f29d659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f29d809e930 0x7f29d811d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58904/0 (socket says 172.21.15.72:58904) 2023-10-03T10:17:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.565+0000 7f29d659c700 1 -- 172.21.15.72:0/2594793193 learned_addr learned my addr 172.21.15.72:0/2594793193 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:39.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.565+0000 7f29d5d9b700 1 --2- 172.21.15.72:0/2594793193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29d809f410 0x7f29d811d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.565+0000 7f29d659c700 1 -- 172.21.15.72:0/2594793193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29d809f410 msgr2=0x7f29d811d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.565+0000 7f29d659c700 1 --2- 172.21.15.72:0/2594793193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29d809f410 0x7f29d811d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.565+0000 7f29d659c700 1 -- 172.21.15.72:0/2594793193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29d8136fe0 msgr2=0x7f29d81c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.565+0000 7f29d659c700 1 --2- 172.21.15.72:0/2594793193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29d8136fe0 0x7f29d81c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.565+0000 7f29d659c700 1 -- 172.21.15.72:0/2594793193 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d0009a70 con 0x7f29d809e930 2023-10-03T10:17:39.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.565+0000 7f29d659c700 1 --2- 172.21.15.72:0/2594793193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f29d809e930 0x7f29d811d110 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f29c800c520 tx=0x7f29c800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.565+0000 7f29c6ffd700 1 -- 172.21.15.72:0/2594793193 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8005d70 con 0x7f29d809e930 2023-10-03T10:17:39.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.565+0000 7f29c6ffd700 1 -- 172.21.15.72:0/2594793193 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c80070d0 con 0x7f29d809e930 2023-10-03T10:17:39.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.565+0000 7f29dce68700 1 -- 172.21.15.72:0/2594793193 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d8120080 con 0x7f29d809e930 2023-10-03T10:17:39.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.565+0000 7f29c6ffd700 1 -- 172.21.15.72:0/2594793193 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8007440 con 0x7f29d809e930 2023-10-03T10:17:39.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.565+0000 7f29dce68700 1 -- 172.21.15.72:0/2594793193 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d811ea00 con 0x7f29d809e930 2023-10-03T10:17:39.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.566+0000 7f29c6ffd700 1 -- 172.21.15.72:0/2594793193 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29c80075a0 con 0x7f29d809e930 2023-10-03T10:17:39.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.566+0000 7f29dce68700 1 -- 172.21.15.72:0/2594793193 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d811eca0 con 0x7f29d809e930 2023-10-03T10:17:39.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.566+0000 7f29c6ffd700 1 -- 172.21.15.72:0/2594793193 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f29c803ea50 con 0x7f29d809e930 2023-10-03T10:17:39.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.571+0000 7f29c6ffd700 1 -- 172.21.15.72:0/2594793193 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29c8017030 con 0x7f29d809e930 2023-10-03T10:17:39.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.657+0000 7fb46b8bc700 1 -- 172.21.15.72:0/3256932001 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb464072980 con 0x7fb46409d630 2023-10-03T10:17:39.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.658+0000 7fb459ffb700 1 -- 172.21.15.72:0/3256932001 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb46001b340 con 0x7fb46409d630 2023-10-03T10:17:39.658 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:39.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.660+0000 7fb46b8bc700 1 -- 172.21.15.72:0/3256932001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46409d630 msgr2=0x7fb464133900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.660+0000 7fb46b8bc700 1 --2- 172.21.15.72:0/3256932001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46409d630 0x7fb464133900 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb4600011e0 tx=0x7fb46000ca30 comp rx=0 tx=0).stop 2023-10-03T10:17:39.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.661+0000 7fb46b8bc700 1 -- 172.21.15.72:0/3256932001 shutdown_connections 2023-10-03T10:17:39.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.661+0000 7fb46b8bc700 1 --2- 172.21.15.72:0/3256932001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb464138d80 0x7fb464134380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.661+0000 7fb46b8bc700 1 --2- 172.21.15.72:0/3256932001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46409d630 0x7fb464133900 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.661+0000 7fb46b8bc700 1 --2- 172.21.15.72:0/3256932001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4640a0a30 0x7fb464133e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.661+0000 7fb46b8bc700 1 -- 172.21.15.72:0/3256932001 >> 172.21.15.72:0/3256932001 conn(0x7fb4640a3050 msgr2=0x7fb46409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.661+0000 7fb46b8bc700 1 -- 172.21.15.72:0/3256932001 shutdown_connections 2023-10-03T10:17:39.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.661+0000 7fb46b8bc700 1 -- 172.21.15.72:0/3256932001 wait complete. 2023-10-03T10:17:39.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:39.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.734+0000 7f4c3df5a700 1 -- 172.21.15.72:0/2728537169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4c38122100 con 0x7f4c3809f410 2023-10-03T10:17:39.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.735+0000 7f4c1ffff700 1 -- 172.21.15.72:0/2728537169 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c2c021070 con 0x7f4c3809f410 2023-10-03T10:17:39.735 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:39.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.737+0000 7f4c3df5a700 1 -- 172.21.15.72:0/2728537169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c3809f410 msgr2=0x7f4c3811ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.737+0000 7f4c3df5a700 1 --2- 172.21.15.72:0/2728537169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c3809f410 0x7f4c3811ed90 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00ebe0 tx=0x7f4c2c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.737+0000 7f4c3df5a700 1 -- 172.21.15.72:0/2728537169 shutdown_connections 2023-10-03T10:17:39.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.737+0000 7f4c3df5a700 1 --2- 172.21.15.72:0/2728537169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c38136fe0 0x7f4c3811f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.737+0000 7f4c3df5a700 1 --2- 172.21.15.72:0/2728537169 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c3809e930 0x7f4c3811e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.737+0000 7f4c3df5a700 1 --2- 172.21.15.72:0/2728537169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c3809f410 0x7f4c3811ed90 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.737+0000 7f4c3df5a700 1 -- 172.21.15.72:0/2728537169 >> 172.21.15.72:0/2728537169 conn(0x7f4c380a4210 msgr2=0x7f4c38134900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.737+0000 7f4c3df5a700 1 -- 172.21.15.72:0/2728537169 shutdown_connections 2023-10-03T10:17:39.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.737+0000 7f4c3df5a700 1 -- 172.21.15.72:0/2728537169 wait complete. 2023-10-03T10:17:39.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:39.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.764+0000 7f29dce68700 1 -- 172.21.15.72:0/2594793193 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f29d8074ea0 con 0x7f29d809e930 2023-10-03T10:17:39.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.765+0000 7f29c6ffd700 1 -- 172.21.15.72:0/2594793193 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f29c8019d20 con 0x7f29d809e930 2023-10-03T10:17:39.765 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:39.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.767+0000 7f29dce68700 1 -- 172.21.15.72:0/2594793193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f29d809e930 msgr2=0x7f29d811d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.767+0000 7f29dce68700 1 --2- 172.21.15.72:0/2594793193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f29d809e930 0x7f29d811d110 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f29c800c520 tx=0x7f29c800c830 comp rx=0 tx=0).stop 2023-10-03T10:17:39.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.767+0000 7f29dce68700 1 -- 172.21.15.72:0/2594793193 shutdown_connections 2023-10-03T10:17:39.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.767+0000 7f29dce68700 1 --2- 172.21.15.72:0/2594793193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29d8136fe0 0x7f29d81c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.767+0000 7f29dce68700 1 --2- 172.21.15.72:0/2594793193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f29d809e930 0x7f29d811d110 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.767+0000 7f29dce68700 1 --2- 172.21.15.72:0/2594793193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29d809f410 0x7f29d811d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.767+0000 7f29dce68700 1 -- 172.21.15.72:0/2594793193 >> 172.21.15.72:0/2594793193 conn(0x7f29d80a4210 msgr2=0x7f29d809bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.767+0000 7f29dce68700 1 -- 172.21.15.72:0/2594793193 shutdown_connections 2023-10-03T10:17:39.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:39.767+0000 7f29dce68700 1 -- 172.21.15.72:0/2594793193 wait complete. 2023-10-03T10:17:39.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:40.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:40.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.156+0000 7f564adc8700 1 Processor -- start 2023-10-03T10:17:40.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.156+0000 7f564adc8700 1 -- start start 2023-10-03T10:17:40.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.156+0000 7f564adc8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f564409d6f0 0x7f564409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.156+0000 7f564adc8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f564409e000 0x7f5644130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.156+0000 7f564adc8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564409f130 con 0x7f564409e410 2023-10-03T10:17:40.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.156+0000 7f564adc8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564409f520 con 0x7f564409d6f0 2023-10-03T10:17:40.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.156+0000 7f564adc8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564409e930 con 0x7f564409e000 2023-10-03T10:17:40.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.156+0000 7f5648b64700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f564409d6f0 0x7f564409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.156+0000 7f5643fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f564409e000 0x7f5644130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.156+0000 7f5648b64700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f564409d6f0 0x7f564409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40850/0 (socket says 172.21.15.72:40850) 2023-10-03T10:17:40.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.156+0000 7f5648b64700 1 -- 172.21.15.72:0/3038674106 learned_addr learned my addr 172.21.15.72:0/3038674106 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:40.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.156+0000 7f5643fff700 1 -- 172.21.15.72:0/3038674106 >> v2:172.21.15.72:3300/0 conn(0x7f564409d6f0 msgr2=0x7f564409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.156+0000 7f5643fff700 1 --2- 172.21.15.72:0/3038674106 >> v2:172.21.15.72:3300/0 conn(0x7f564409d6f0 0x7f564409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.156+0000 7f5643fff700 1 -- 172.21.15.72:0/3038674106 >> v1:172.21.15.72:6789/0 conn(0x7f564409e410 legacy=0x7f5644130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.157+0000 7f5643fff700 1 -- 172.21.15.72:0/3038674106 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564409b2d0 con 0x7f564409e000 2023-10-03T10:17:40.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.157+0000 7f5648b64700 1 --2- 172.21.15.72:0/3038674106 >> v2:172.21.15.72:3300/0 conn(0x7f564409d6f0 0x7f564409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.157+0000 7f5643fff700 1 --2- 172.21.15.72:0/3038674106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f564409e000 0x7f5644130660 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5630009840 tx=0x7f5630009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee7f7d922e1fc8fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.157+0000 7f56437fe700 1 -- 172.21.15.72:0/3038674106 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630011830 con 0x7f564409e000 2023-10-03T10:17:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.157+0000 7f56437fe700 1 -- 172.21.15.72:0/3038674106 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630011990 con 0x7f564409e000 2023-10-03T10:17:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.157+0000 7f56437fe700 1 -- 172.21.15.72:0/3038674106 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630011d20 con 0x7f564409e000 2023-10-03T10:17:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.157+0000 7f564adc8700 1 -- 172.21.15.72:0/3038674106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f564409e000 msgr2=0x7f5644130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.157+0000 7f564adc8700 1 --2- 172.21.15.72:0/3038674106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f564409e000 0x7f5644130660 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5630009840 tx=0x7f5630009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.157+0000 7f564adc8700 1 -- 172.21.15.72:0/3038674106 shutdown_connections 2023-10-03T10:17:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.157+0000 7f564adc8700 1 --2- 172.21.15.72:0/3038674106 >> v2:172.21.15.72:3300/0 conn(0x7f564409d6f0 0x7f564409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.157+0000 7f564adc8700 1 --2- 172.21.15.72:0/3038674106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f564409e000 0x7f5644130660 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.157+0000 7f564adc8700 1 -- 172.21.15.72:0/3038674106 >> 172.21.15.72:0/3038674106 conn(0x7f5644066f50 msgr2=0x7f564409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.157+0000 7f564adc8700 1 -- 172.21.15.72:0/3038674106 shutdown_connections 2023-10-03T10:17:40.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.157+0000 7f564adc8700 1 -- 172.21.15.72:0/3038674106 wait complete. 2023-10-03T10:17:40.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.158+0000 7f564adc8700 1 Processor -- start 2023-10-03T10:17:40.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.158+0000 7f564adc8700 1 -- start start 2023-10-03T10:17:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f564adc8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f564409d6f0 0x7f5644131630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f564adc8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f564409e000 0x7f5644131b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f564adc8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f564409e410 0x7f56441320b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f564adc8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5644134390 con 0x7f564409e410 2023-10-03T10:17:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f564adc8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5644133530 con 0x7f564409e000 2023-10-03T10:17:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f564adc8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5644132de0 con 0x7f564409d6f0 2023-10-03T10:17:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f5648b64700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f564409d6f0 0x7f5644131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f5649365700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f564409e410 0x7f56441320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f5648b64700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f564409d6f0 0x7f5644131630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58906/0 (socket says 172.21.15.72:58906) 2023-10-03T10:17:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f5648b64700 1 -- 172.21.15.72:0/3432056844 learned_addr learned my addr 172.21.15.72:0/3432056844 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:40.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f5643fff700 1 --2- 172.21.15.72:0/3432056844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f564409e000 0x7f5644131b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f5648b64700 1 -- 172.21.15.72:0/3432056844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f564409e000 msgr2=0x7f5644131b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f5648b64700 1 --2- 172.21.15.72:0/3432056844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f564409e000 0x7f5644131b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f5648b64700 1 -- 172.21.15.72:0/3432056844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f564409e410 msgr2=0x7f56441320b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f5648b64700 1 --2- 172.21.15.72:0/3432056844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f564409e410 0x7f56441320b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f5648b64700 1 -- 172.21.15.72:0/3432056844 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5638009550 con 0x7f564409d6f0 2023-10-03T10:17:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f5649365700 1 --2- 172.21.15.72:0/3432056844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f564409e410 0x7f56441320b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.159+0000 7f5648b64700 1 --2- 172.21.15.72:0/3432056844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f564409d6f0 0x7f5644131630 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f563800ebe0 tx=0x7f563800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.160+0000 7f56417fa700 1 -- 172.21.15.72:0/3432056844 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800c850 con 0x7f564409d6f0 2023-10-03T10:17:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.160+0000 7f56417fa700 1 -- 172.21.15.72:0/3432056844 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800c9b0 con 0x7f564409d6f0 2023-10-03T10:17:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.160+0000 7f56417fa700 1 -- 172.21.15.72:0/3432056844 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800cd40 con 0x7f564409d6f0 2023-10-03T10:17:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.160+0000 7f564adc8700 1 -- 172.21.15.72:0/3432056844 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56300094a0 con 0x7f564409d6f0 2023-10-03T10:17:40.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.160+0000 7f564adc8700 1 -- 172.21.15.72:0/3432056844 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56440725a0 con 0x7f564409d6f0 2023-10-03T10:17:40.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.160+0000 7f56417fa700 1 -- 172.21.15.72:0/3432056844 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5638013470 con 0x7f564409d6f0 2023-10-03T10:17:40.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.160+0000 7f56417fa700 1 -- 172.21.15.72:0/3432056844 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f563803f860 con 0x7f564409d6f0 2023-10-03T10:17:40.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.161+0000 7f564adc8700 1 -- 172.21.15.72:0/3432056844 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5644074ea0 con 0x7f564409d6f0 2023-10-03T10:17:40.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.165+0000 7f56417fa700 1 -- 172.21.15.72:0/3432056844 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5638017080 con 0x7f564409d6f0 2023-10-03T10:17:40.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.348+0000 7f564adc8700 1 -- 172.21.15.72:0/3432056844 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5644134700 con 0x7f564409d6f0 2023-10-03T10:17:40.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.349+0000 7f56417fa700 1 -- 172.21.15.72:0/3432056844 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5638021020 con 0x7f564409d6f0 2023-10-03T10:17:40.349 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:40.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.350+0000 7f564adc8700 1 -- 172.21.15.72:0/3432056844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f564409d6f0 msgr2=0x7f5644131630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.350+0000 7f564adc8700 1 --2- 172.21.15.72:0/3432056844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f564409d6f0 0x7f5644131630 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f563800ebe0 tx=0x7f563800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.351+0000 7f564adc8700 1 -- 172.21.15.72:0/3432056844 shutdown_connections 2023-10-03T10:17:40.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.351+0000 7f564adc8700 1 --2- 172.21.15.72:0/3432056844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f564409e410 0x7f56441320b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.351+0000 7f564adc8700 1 --2- 172.21.15.72:0/3432056844 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f564409d6f0 0x7f5644131630 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.351+0000 7f564adc8700 1 --2- 172.21.15.72:0/3432056844 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f564409e000 0x7f5644131b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.351+0000 7f564adc8700 1 -- 172.21.15.72:0/3432056844 >> 172.21.15.72:0/3432056844 conn(0x7f5644066f50 msgr2=0x7f56440a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.351+0000 7f564adc8700 1 -- 172.21.15.72:0/3432056844 shutdown_connections 2023-10-03T10:17:40.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.351+0000 7f564adc8700 1 -- 172.21.15.72:0/3432056844 wait complete. 2023-10-03T10:17:40.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:40.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:40.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:40.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:40.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.804+0000 7f37f5c3c700 1 Processor -- start 2023-10-03T10:17:40.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.804+0000 7f37f5c3c700 1 -- start start 2023-10-03T10:17:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.804+0000 7f37f5c3c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37f01338c0 0x7f37f0133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.804+0000 7f37f5c3c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37f01341d0 0x7f37f009de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.804+0000 7f37f5c3c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f006f720 con 0x7f37f009e390 2023-10-03T10:17:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.804+0000 7f37f5c3c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f0070c80 con 0x7f37f01338c0 2023-10-03T10:17:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.804+0000 7f37f5c3c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37f006fce0 con 0x7f37f01341d0 2023-10-03T10:17:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.804+0000 7f37eeffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37f01341d0 0x7f37f009de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.804+0000 7f37ef7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37f01338c0 0x7f37f0133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.804+0000 7f37eeffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37f01341d0 0x7f37f009de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58914/0 (socket says 172.21.15.72:58914) 2023-10-03T10:17:40.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.804+0000 7f37eeffd700 1 -- 172.21.15.72:0/872581493 learned_addr learned my addr 172.21.15.72:0/872581493 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.805+0000 7f37ef7fe700 1 -- 172.21.15.72:0/872581493 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37f01341d0 msgr2=0x7f37f009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.805+0000 7f37ef7fe700 1 --2- 172.21.15.72:0/872581493 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37f01341d0 0x7f37f009de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.805+0000 7f37ef7fe700 1 -- 172.21.15.72:0/872581493 >> v1:172.21.15.72:6789/0 conn(0x7f37f009e390 legacy=0x7f37f013a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.805+0000 7f37ef7fe700 1 -- 172.21.15.72:0/872581493 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f01336a0 con 0x7f37f01338c0 2023-10-03T10:17:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.805+0000 7f37eeffd700 1 --2- 172.21.15.72:0/872581493 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37f01341d0 0x7f37f009de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.805+0000 7f37ef7fe700 1 --2- 172.21.15.72:0/872581493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f01338c0 0x7f37f0133c90 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009840 tx=0x7f37e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5865d459a9899a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.805+0000 7f37ee7fc700 1 -- 172.21.15.72:0/872581493 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0011830 con 0x7f37f01338c0 2023-10-03T10:17:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.805+0000 7f37ee7fc700 1 -- 172.21.15.72:0/872581493 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e0011990 con 0x7f37f01338c0 2023-10-03T10:17:40.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.805+0000 7f37ee7fc700 1 -- 172.21.15.72:0/872581493 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0011d20 con 0x7f37f01338c0 2023-10-03T10:17:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.806+0000 7f37f5c3c700 1 -- 172.21.15.72:0/872581493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f01338c0 msgr2=0x7f37f0133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.806+0000 7f37f5c3c700 1 --2- 172.21.15.72:0/872581493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f01338c0 0x7f37f0133c90 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009840 tx=0x7f37e0009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.806+0000 7f37f5c3c700 1 -- 172.21.15.72:0/872581493 shutdown_connections 2023-10-03T10:17:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.806+0000 7f37f5c3c700 1 --2- 172.21.15.72:0/872581493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f01338c0 0x7f37f0133c90 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.806+0000 7f37f5c3c700 1 --2- 172.21.15.72:0/872581493 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37f01341d0 0x7f37f009de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.806+0000 7f37f5c3c700 1 -- 172.21.15.72:0/872581493 >> 172.21.15.72:0/872581493 conn(0x7f37f00a2aa0 msgr2=0x7f37f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.806+0000 7f37f5c3c700 1 -- 172.21.15.72:0/872581493 shutdown_connections 2023-10-03T10:17:40.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.806+0000 7f37f5c3c700 1 -- 172.21.15.72:0/872581493 wait complete. 2023-10-03T10:17:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.807+0000 7f37f5c3c700 1 Processor -- start 2023-10-03T10:17:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.807+0000 7f37f5c3c700 1 -- start start 2023-10-03T10:17:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.807+0000 7f37f5c3c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37f009e390 0x7f37f011f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.807+0000 7f37f5c3c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f01338c0 0x7f37f011fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.807+0000 7f37f5c3c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37f01341d0 0x7f37f0120420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.807+0000 7f37f5c3c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f0123170 con 0x7f37f01338c0 2023-10-03T10:17:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.807+0000 7f37f5c3c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f0122eb0 con 0x7f37f009e390 2023-10-03T10:17:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.807+0000 7f37f5c3c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37f01216c0 con 0x7f37f01341d0 2023-10-03T10:17:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37eeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f01338c0 0x7f37f011fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37eeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f01338c0 0x7f37f011fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40888/0 (socket says 172.21.15.72:40888) 2023-10-03T10:17:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37eeffd700 1 -- 172.21.15.72:0/1917428385 learned_addr learned my addr 172.21.15.72:0/1917428385 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:40.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37ef7fe700 1 --2- 172.21.15.72:0/1917428385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37f009e390 0x7f37f011f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37effff700 1 --2- 172.21.15.72:0/1917428385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37f01341d0 0x7f37f0120420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37eeffd700 1 -- 172.21.15.72:0/1917428385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37f01341d0 msgr2=0x7f37f0120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37eeffd700 1 --2- 172.21.15.72:0/1917428385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37f01341d0 0x7f37f0120420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37eeffd700 1 -- 172.21.15.72:0/1917428385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37f009e390 msgr2=0x7f37f011f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37eeffd700 1 --2- 172.21.15.72:0/1917428385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37f009e390 0x7f37f011f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37eeffd700 1 -- 172.21.15.72:0/1917428385 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e4009550 con 0x7f37f01338c0 2023-10-03T10:17:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37ef7fe700 1 --2- 172.21.15.72:0/1917428385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37f009e390 0x7f37f011f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37eeffd700 1 --2- 172.21.15.72:0/1917428385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f01338c0 0x7f37f011fee0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f37e400ebe0 tx=0x7f37e400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37d7fff700 1 -- 172.21.15.72:0/1917428385 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e400c850 con 0x7f37f01338c0 2023-10-03T10:17:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37d7fff700 1 -- 172.21.15.72:0/1917428385 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e400c9b0 con 0x7f37f01338c0 2023-10-03T10:17:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37f5c3c700 1 -- 172.21.15.72:0/1917428385 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e00094a0 con 0x7f37f01338c0 2023-10-03T10:17:40.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37d7fff700 1 -- 172.21.15.72:0/1917428385 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e400cd60 con 0x7f37f01338c0 2023-10-03T10:17:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.808+0000 7f37f5c3c700 1 -- 172.21.15.72:0/1917428385 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f0123be0 con 0x7f37f01338c0 2023-10-03T10:17:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.809+0000 7f37d7fff700 1 -- 172.21.15.72:0/1917428385 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37e4013470 con 0x7f37f01338c0 2023-10-03T10:17:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.809+0000 7f37d7fff700 1 -- 172.21.15.72:0/1917428385 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f37e403fb10 con 0x7f37f01338c0 2023-10-03T10:17:40.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.810+0000 7f37f5c3c700 1 -- 172.21.15.72:0/1917428385 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f0074ea0 con 0x7f37f01338c0 2023-10-03T10:17:40.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.814+0000 7f37d7fff700 1 -- 172.21.15.72:0/1917428385 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37e401b3b0 con 0x7f37f01338c0 2023-10-03T10:17:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.878+0000 7eff053b0700 1 Processor -- start 2023-10-03T10:17:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.878+0000 7eff053b0700 1 -- start start 2023-10-03T10:17:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7eff053b0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff000a0a30 0x7eff000a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7eff053b0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff0009d630 0x7eff000a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7eff053b0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff00133930 0x7eff00133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7eff053b0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff000a2a70 con 0x7eff0009d630 2023-10-03T10:17:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7eff053b0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff000a01d0 con 0x7eff000a0a30 2023-10-03T10:17:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7eff053b0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff0009e2b0 con 0x7eff00133930 2023-10-03T10:17:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7efeff7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff00133930 0x7eff00133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7efeff7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff00133930 0x7eff00133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58928/0 (socket says 172.21.15.72:58928) 2023-10-03T10:17:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7efefeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff000a0a30 0x7eff000a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7efeff7fe700 1 -- 172.21.15.72:0/462820734 learned_addr learned my addr 172.21.15.72:0/462820734 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7efefe7fc700 1 --2- 172.21.15.72:0/462820734 >> v2:172.21.15.72:3300/0 conn(0x7eff0009d630 0x7eff000a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7efeff7fe700 1 -- 172.21.15.72:0/462820734 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff000a0a30 msgr2=0x7eff000a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7efeff7fe700 1 --2- 172.21.15.72:0/462820734 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff000a0a30 0x7eff000a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7efeff7fe700 1 -- 172.21.15.72:0/462820734 >> v2:172.21.15.72:3300/0 conn(0x7eff0009d630 msgr2=0x7eff000a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7efeff7fe700 1 --2- 172.21.15.72:0/462820734 >> v2:172.21.15.72:3300/0 conn(0x7eff0009d630 0x7eff000a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7efeff7fe700 1 -- 172.21.15.72:0/462820734 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0009dc50 con 0x7eff00133930 2023-10-03T10:17:40.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7efefe7fc700 1 --2- 172.21.15.72:0/462820734 >> v2:172.21.15.72:3300/0 conn(0x7eff0009d630 0x7eff000a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7efeff7fe700 1 --2- 172.21.15.72:0/462820734 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff00133930 0x7eff00133dd0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7efef8009e50 tx=0x7efef800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f00efec910c1360 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7efefdffb700 1 -- 172.21.15.72:0/462820734 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef800e070 con 0x7eff00133930 2023-10-03T10:17:40.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7efefdffb700 1 -- 172.21.15.72:0/462820734 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef800b910 con 0x7eff00133930 2023-10-03T10:17:40.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.879+0000 7efefdffb700 1 -- 172.21.15.72:0/462820734 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef800bcc0 con 0x7eff00133930 2023-10-03T10:17:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.880+0000 7eff053b0700 1 -- 172.21.15.72:0/462820734 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff00133930 msgr2=0x7eff00133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.880+0000 7eff053b0700 1 --2- 172.21.15.72:0/462820734 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff00133930 0x7eff00133dd0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7efef8009e50 tx=0x7efef800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.880+0000 7eff053b0700 1 -- 172.21.15.72:0/462820734 shutdown_connections 2023-10-03T10:17:40.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.880+0000 7eff053b0700 1 --2- 172.21.15.72:0/462820734 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff00133930 0x7eff00133dd0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.880+0000 7eff053b0700 1 --2- 172.21.15.72:0/462820734 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff000a0a30 0x7eff000a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.880+0000 7eff053b0700 1 --2- 172.21.15.72:0/462820734 >> v2:172.21.15.72:3300/0 conn(0x7eff0009d630 0x7eff000a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.880+0000 7eff053b0700 1 -- 172.21.15.72:0/462820734 >> 172.21.15.72:0/462820734 conn(0x7eff000a3050 msgr2=0x7eff000a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.880+0000 7eff053b0700 1 -- 172.21.15.72:0/462820734 shutdown_connections 2023-10-03T10:17:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.880+0000 7eff053b0700 1 -- 172.21.15.72:0/462820734 wait complete. 2023-10-03T10:17:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.882+0000 7eff053b0700 1 Processor -- start 2023-10-03T10:17:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.882+0000 7eff053b0700 1 -- start start 2023-10-03T10:17:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.882+0000 7eff053b0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0009d630 0x7eff00132b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.882+0000 7eff053b0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff000a0a30 0x7eff00133040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.882+0000 7eff053b0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff00133930 0x7eff001c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.882+0000 7eff053b0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff001225b0 con 0x7eff0009d630 2023-10-03T10:17:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.882+0000 7eff053b0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff000a0410 con 0x7eff00133930 2023-10-03T10:17:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.882+0000 7eff053b0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff001208a0 con 0x7eff000a0a30 2023-10-03T10:17:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7efefe7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff000a0a30 0x7eff00133040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7efefe7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff000a0a30 0x7eff00133040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58934/0 (socket says 172.21.15.72:58934) 2023-10-03T10:17:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7efefe7fc700 1 -- 172.21.15.72:0/3875602285 learned_addr learned my addr 172.21.15.72:0/3875602285 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7efefeffd700 1 --2- 172.21.15.72:0/3875602285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0009d630 0x7eff00132b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7efeff7fe700 1 --2- 172.21.15.72:0/3875602285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff00133930 0x7eff001c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7efefe7fc700 1 -- 172.21.15.72:0/3875602285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff00133930 msgr2=0x7eff001c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7efefe7fc700 1 --2- 172.21.15.72:0/3875602285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff00133930 0x7eff001c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7efefe7fc700 1 -- 172.21.15.72:0/3875602285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0009d630 msgr2=0x7eff00132b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7efefe7fc700 1 --2- 172.21.15.72:0/3875602285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0009d630 0x7eff00132b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7efefe7fc700 1 -- 172.21.15.72:0/3875602285 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef40094a0 con 0x7eff000a0a30 2023-10-03T10:17:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7efefe7fc700 1 --2- 172.21.15.72:0/3875602285 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff000a0a30 0x7eff00133040 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7efef400ebe0 tx=0x7efef400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7efee77fe700 1 -- 172.21.15.72:0/3875602285 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef400c850 con 0x7eff000a0a30 2023-10-03T10:17:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7efee77fe700 1 -- 172.21.15.72:0/3875602285 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef400c9b0 con 0x7eff000a0a30 2023-10-03T10:17:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7efee77fe700 1 -- 172.21.15.72:0/3875602285 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef400cd40 con 0x7eff000a0a30 2023-10-03T10:17:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7eff053b0700 1 -- 172.21.15.72:0/3875602285 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef8009b30 con 0x7eff000a0a30 2023-10-03T10:17:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.883+0000 7eff053b0700 1 -- 172.21.15.72:0/3875602285 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff001218b0 con 0x7eff000a0a30 2023-10-03T10:17:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.884+0000 7efee77fe700 1 -- 172.21.15.72:0/3875602285 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efef4013470 con 0x7eff000a0a30 2023-10-03T10:17:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.884+0000 7eff053b0700 1 -- 172.21.15.72:0/3875602285 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff000747f0 con 0x7eff000a0a30 2023-10-03T10:17:40.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.884+0000 7efee77fe700 1 -- 172.21.15.72:0/3875602285 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efef403f750 con 0x7eff000a0a30 2023-10-03T10:17:40.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.889+0000 7efee77fe700 1 -- 172.21.15.72:0/3875602285 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efef4021020 con 0x7eff000a0a30 2023-10-03T10:17:40.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.919+0000 7fe1923b7700 1 Processor -- start 2023-10-03T10:17:40.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.919+0000 7fe1923b7700 1 -- start start 2023-10-03T10:17:40.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.920+0000 7fe1923b7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe18c136710 0x7fe18c138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.920+0000 7fe1923b7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe18c139030 0x7fe18c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.920+0000 7fe1923b7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c06ef30 con 0x7fe18c1338a0 2023-10-03T10:17:40.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.920+0000 7fe1923b7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18c06fef0 con 0x7fe18c136710 2023-10-03T10:17:40.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.920+0000 7fe1923b7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c1334b0 con 0x7fe18c139030 2023-10-03T10:17:40.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.920+0000 7fe18b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe18c136710 0x7fe18c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.920+0000 7fe18b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe18c136710 0x7fe18c138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40918/0 (socket says 172.21.15.72:40918) 2023-10-03T10:17:40.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.920+0000 7fe18b7fe700 1 -- 172.21.15.72:0/3371535788 learned_addr learned my addr 172.21.15.72:0/3371535788 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:40.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.920+0000 7fe190954700 1 --2- 172.21.15.72:0/3371535788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe18c139030 0x7fe18c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.920+0000 7fe18b7fe700 1 -- 172.21.15.72:0/3371535788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe18c139030 msgr2=0x7fe18c13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.920+0000 7fe18b7fe700 1 --2- 172.21.15.72:0/3371535788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe18c139030 0x7fe18c13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.920+0000 7fe18b7fe700 1 -- 172.21.15.72:0/3371535788 >> v1:172.21.15.72:6789/0 conn(0x7fe18c1338a0 legacy=0x7fe18c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.920+0000 7fe18b7fe700 1 -- 172.21.15.72:0/3371535788 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c06fc30 con 0x7fe18c136710 2023-10-03T10:17:40.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.920+0000 7fe18affd700 1 -- 172.21.15.72:0/3371535788 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229819420 0 0) 0x7fe18c06ef30 con 0x7fe18c1338a0 2023-10-03T10:17:40.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.921+0000 7fe18b7fe700 1 --2- 172.21.15.72:0/3371535788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe18c136710 0x7fe18c138af0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fe1800098f0 tx=0x7fe180009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5770c283fa807f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.921+0000 7fe18affd700 1 -- 172.21.15.72:0/3371535788 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe180011830 con 0x7fe18c136710 2023-10-03T10:17:40.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.921+0000 7fe18affd700 1 -- 172.21.15.72:0/3371535788 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe180011990 con 0x7fe18c136710 2023-10-03T10:17:40.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.921+0000 7fe18affd700 1 -- 172.21.15.72:0/3371535788 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe180011d20 con 0x7fe18c136710 2023-10-03T10:17:40.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.921+0000 7fe1923b7700 1 -- 172.21.15.72:0/3371535788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe18c136710 msgr2=0x7fe18c138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.921+0000 7fe1923b7700 1 --2- 172.21.15.72:0/3371535788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe18c136710 0x7fe18c138af0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fe1800098f0 tx=0x7fe180009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:40.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.921+0000 7fe1923b7700 1 -- 172.21.15.72:0/3371535788 shutdown_connections 2023-10-03T10:17:40.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.921+0000 7fe1923b7700 1 --2- 172.21.15.72:0/3371535788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe18c139030 0x7fe18c13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.921+0000 7fe1923b7700 1 --2- 172.21.15.72:0/3371535788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe18c136710 0x7fe18c138af0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.921+0000 7fe1923b7700 1 -- 172.21.15.72:0/3371535788 >> 172.21.15.72:0/3371535788 conn(0x7fe18c0a2aa0 msgr2=0x7fe18c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.921+0000 7fe1923b7700 1 -- 172.21.15.72:0/3371535788 shutdown_connections 2023-10-03T10:17:40.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.921+0000 7fe1923b7700 1 -- 172.21.15.72:0/3371535788 wait complete. 2023-10-03T10:17:40.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.923+0000 7fe1923b7700 1 Processor -- start 2023-10-03T10:17:40.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.923+0000 7fe1923b7700 1 -- start start 2023-10-03T10:17:40.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.923+0000 7fe1923b7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe18c1338a0 0x7fe18c11ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.923+0000 7fe1923b7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe18c136710 0x7fe18c11b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.923+0000 7fe1923b7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe18c139030 0x7fe18c11b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.923+0000 7fe1923b7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c11e770 con 0x7fe18c1338a0 2023-10-03T10:17:40.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.923+0000 7fe1923b7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c138d90 con 0x7fe18c136710 2023-10-03T10:17:40.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.923+0000 7fe1923b7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c06f640 con 0x7fe18c139030 2023-10-03T10:17:40.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.923+0000 7fe18b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe18c136710 0x7fe18c11b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.923+0000 7fe18b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe18c136710 0x7fe18c11b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39660/0 (socket says 172.21.15.72:39660) 2023-10-03T10:17:40.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.923+0000 7fe18b7fe700 1 -- 172.21.15.72:0/631661027 learned_addr learned my addr 172.21.15.72:0/631661027 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:40.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.923+0000 7fe18bfff700 1 --2- 172.21.15.72:0/631661027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe18c1338a0 0x7fe18c11ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.924+0000 7fe190954700 1 --2- 172.21.15.72:0/631661027 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe18c139030 0x7fe18c11b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.924+0000 7fe18b7fe700 1 -- 172.21.15.72:0/631661027 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe18c139030 msgr2=0x7fe18c11b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.924+0000 7fe18b7fe700 1 --2- 172.21.15.72:0/631661027 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe18c139030 0x7fe18c11b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.924+0000 7fe18b7fe700 1 -- 172.21.15.72:0/631661027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe18c1338a0 msgr2=0x7fe18c11ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.924+0000 7fe18b7fe700 1 --2- 172.21.15.72:0/631661027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe18c1338a0 0x7fe18c11ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.924+0000 7fe18b7fe700 1 -- 172.21.15.72:0/631661027 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe180009550 con 0x7fe18c136710 2023-10-03T10:17:40.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.924+0000 7fe18b7fe700 1 --2- 172.21.15.72:0/631661027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe18c136710 0x7fe18c11b190 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe180009c40 tx=0x7fe180004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.924+0000 7fe188ff9700 1 -- 172.21.15.72:0/631661027 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe180004300 con 0x7fe18c136710 2023-10-03T10:17:40.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.924+0000 7fe188ff9700 1 -- 172.21.15.72:0/631661027 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18001f070 con 0x7fe18c136710 2023-10-03T10:17:40.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.924+0000 7fe188ff9700 1 -- 172.21.15.72:0/631661027 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800036a0 con 0x7fe18c136710 2023-10-03T10:17:40.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.924+0000 7fe1923b7700 1 -- 172.21.15.72:0/631661027 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18c11c860 con 0x7fe18c136710 2023-10-03T10:17:40.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.924+0000 7fe1923b7700 1 -- 172.21.15.72:0/631661027 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18c11d050 con 0x7fe18c136710 2023-10-03T10:17:40.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.925+0000 7fe188ff9700 1 -- 172.21.15.72:0/631661027 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe180021030 con 0x7fe18c136710 2023-10-03T10:17:40.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.925+0000 7fe188ff9700 1 -- 172.21.15.72:0/631661027 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe180040980 con 0x7fe18c136710 2023-10-03T10:17:40.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.925+0000 7fe1923b7700 1 -- 172.21.15.72:0/631661027 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18c074ea0 con 0x7fe18c136710 2023-10-03T10:17:40.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:40.934+0000 7fe188ff9700 1 -- 172.21.15.72:0/631661027 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe180015080 con 0x7fe18c136710 2023-10-03T10:17:41.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.035+0000 7f37f5c3c700 1 -- 172.21.15.72:0/1917428385 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37f006b9e0 con 0x7f37f01338c0 2023-10-03T10:17:41.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.035+0000 7f37d7fff700 1 -- 172.21.15.72:0/1917428385 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f37e4011b00 con 0x7f37f01338c0 2023-10-03T10:17:41.036 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:41.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.037+0000 7f37f5c3c700 1 -- 172.21.15.72:0/1917428385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f01338c0 msgr2=0x7f37f011fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.037+0000 7f37f5c3c700 1 --2- 172.21.15.72:0/1917428385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f01338c0 0x7f37f011fee0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f37e400ebe0 tx=0x7f37e400eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.037+0000 7f37f5c3c700 1 -- 172.21.15.72:0/1917428385 shutdown_connections 2023-10-03T10:17:41.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.037+0000 7f37f5c3c700 1 --2- 172.21.15.72:0/1917428385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f37f01341d0 0x7f37f0120420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.037+0000 7f37f5c3c700 1 --2- 172.21.15.72:0/1917428385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37f009e390 0x7f37f011f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.037+0000 7f37f5c3c700 1 --2- 172.21.15.72:0/1917428385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37f01338c0 0x7f37f011fee0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.037+0000 7f37f5c3c700 1 -- 172.21.15.72:0/1917428385 >> 172.21.15.72:0/1917428385 conn(0x7f37f00a2aa0 msgr2=0x7f37f009f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.037+0000 7f37f5c3c700 1 -- 172.21.15.72:0/1917428385 shutdown_connections 2023-10-03T10:17:41.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.037+0000 7f37f5c3c700 1 -- 172.21.15.72:0/1917428385 wait complete. 2023-10-03T10:17:41.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:41.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.088+0000 7eff053b0700 1 -- 172.21.15.72:0/3875602285 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7eff00133580 con 0x7eff000a0a30 2023-10-03T10:17:41.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.088+0000 7efee77fe700 1 -- 172.21.15.72:0/3875602285 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efef400cea0 con 0x7eff000a0a30 2023-10-03T10:17:41.089 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:41.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.091+0000 7eff053b0700 1 -- 172.21.15.72:0/3875602285 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff000a0a30 msgr2=0x7eff00133040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.091+0000 7eff053b0700 1 --2- 172.21.15.72:0/3875602285 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff000a0a30 0x7eff00133040 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7efef400ebe0 tx=0x7efef400eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.091+0000 7eff053b0700 1 -- 172.21.15.72:0/3875602285 shutdown_connections 2023-10-03T10:17:41.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.091+0000 7eff053b0700 1 --2- 172.21.15.72:0/3875602285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff0009d630 0x7eff00132b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.091+0000 7eff053b0700 1 --2- 172.21.15.72:0/3875602285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff00133930 0x7eff001c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.091+0000 7eff053b0700 1 --2- 172.21.15.72:0/3875602285 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff000a0a30 0x7eff00133040 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.091+0000 7eff053b0700 1 -- 172.21.15.72:0/3875602285 >> 172.21.15.72:0/3875602285 conn(0x7eff000a3050 msgr2=0x7eff0009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.091+0000 7eff053b0700 1 -- 172.21.15.72:0/3875602285 shutdown_connections 2023-10-03T10:17:41.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.091+0000 7eff053b0700 1 -- 172.21.15.72:0/3875602285 wait complete. 2023-10-03T10:17:41.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:41.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.150+0000 7fe1923b7700 1 -- 172.21.15.72:0/631661027 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe18c06b9e0 con 0x7fe18c136710 2023-10-03T10:17:41.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.150+0000 7fe188ff9700 1 -- 172.21.15.72:0/631661027 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe1800199a0 con 0x7fe18c136710 2023-10-03T10:17:41.151 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:41.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.152+0000 7fe1923b7700 1 -- 172.21.15.72:0/631661027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe18c136710 msgr2=0x7fe18c11b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.152+0000 7fe1923b7700 1 --2- 172.21.15.72:0/631661027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe18c136710 0x7fe18c11b190 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe180009c40 tx=0x7fe180004750 comp rx=0 tx=0).stop 2023-10-03T10:17:41.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.152+0000 7fe1923b7700 1 -- 172.21.15.72:0/631661027 shutdown_connections 2023-10-03T10:17:41.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.152+0000 7fe1923b7700 1 --2- 172.21.15.72:0/631661027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe18c1338a0 0x7fe18c11ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.152+0000 7fe1923b7700 1 --2- 172.21.15.72:0/631661027 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe18c139030 0x7fe18c11b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.152+0000 7fe1923b7700 1 --2- 172.21.15.72:0/631661027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe18c136710 0x7fe18c11b190 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.152+0000 7fe1923b7700 1 -- 172.21.15.72:0/631661027 >> 172.21.15.72:0/631661027 conn(0x7fe18c0a2aa0 msgr2=0x7fe18c1344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.152+0000 7fe1923b7700 1 -- 172.21.15.72:0/631661027 shutdown_connections 2023-10-03T10:17:41.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.153+0000 7fe1923b7700 1 -- 172.21.15.72:0/631661027 wait complete. 2023-10-03T10:17:41.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:41.364 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:41.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.485+0000 7f3b68ead700 1 Processor -- start 2023-10-03T10:17:41.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.485+0000 7f3b68ead700 1 -- start start 2023-10-03T10:17:41.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.485+0000 7f3b68ead700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3b6409d6f0 0x7f3b6409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.485+0000 7f3b68ead700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b6409e000 0x7f3b64130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.485+0000 7f3b68ead700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b6409e410 0x7f3b64130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.485+0000 7f3b68ead700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6409f520 con 0x7f3b6409d6f0 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.485+0000 7f3b68ead700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6409f130 con 0x7f3b6409e410 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.485+0000 7f3b68ead700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6409e930 con 0x7f3b6409e000 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b61d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b6409e000 0x7f3b64130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b62d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b6409e410 0x7f3b64130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b6259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3b6409d6f0 0x7f3b6409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b61d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b6409e000 0x7f3b64130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58956/0 (socket says 172.21.15.72:58956) 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b61d9b700 1 -- 172.21.15.72:0/4141532509 learned_addr learned my addr 172.21.15.72:0/4141532509 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b62d9d700 1 --2- 172.21.15.72:0/4141532509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b6409e410 0x7f3b64130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39666/0 (socket says 172.21.15.72:39666) 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b6259c700 1 -- 172.21.15.72:0/4141532509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b6409e000 msgr2=0x7f3b64130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b6259c700 1 --2- 172.21.15.72:0/4141532509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b6409e000 0x7f3b64130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b6259c700 1 -- 172.21.15.72:0/4141532509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b6409e410 msgr2=0x7f3b64130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b6259c700 1 --2- 172.21.15.72:0/4141532509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b6409e410 0x7f3b64130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b6259c700 1 -- 172.21.15.72:0/4141532509 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6409b2d0 con 0x7f3b6409d6f0 2023-10-03T10:17:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b61d9b700 1 --2- 172.21.15.72:0/4141532509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b6409e000 0x7f3b64130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b62d9d700 1 --2- 172.21.15.72:0/4141532509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b6409e410 0x7f3b64130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b6259c700 1 --2- 172.21.15.72:0/4141532509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6409d6f0 0x7f3b6409dac0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800bb10 tx=0x7f3b5800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e3154f858e91e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b6159a700 1 -- 172.21.15.72:0/4141532509 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5800dc30 con 0x7f3b6409d6f0 2023-10-03T10:17:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b6159a700 1 -- 172.21.15.72:0/4141532509 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5800dd90 con 0x7f3b6409d6f0 2023-10-03T10:17:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.486+0000 7f3b6159a700 1 -- 172.21.15.72:0/4141532509 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b58010690 con 0x7f3b6409d6f0 2023-10-03T10:17:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.487+0000 7f3b68ead700 1 -- 172.21.15.72:0/4141532509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6409d6f0 msgr2=0x7f3b6409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.487+0000 7f3b68ead700 1 --2- 172.21.15.72:0/4141532509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6409d6f0 0x7f3b6409dac0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800bb10 tx=0x7f3b5800be20 comp rx=0 tx=0).stop 2023-10-03T10:17:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.487+0000 7f3b68ead700 1 -- 172.21.15.72:0/4141532509 shutdown_connections 2023-10-03T10:17:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.487+0000 7f3b68ead700 1 --2- 172.21.15.72:0/4141532509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b6409e410 0x7f3b64130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.487+0000 7f3b68ead700 1 --2- 172.21.15.72:0/4141532509 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6409d6f0 0x7f3b6409dac0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.487+0000 7f3b68ead700 1 --2- 172.21.15.72:0/4141532509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b6409e000 0x7f3b64130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.487+0000 7f3b68ead700 1 -- 172.21.15.72:0/4141532509 >> 172.21.15.72:0/4141532509 conn(0x7f3b64066f50 msgr2=0x7f3b6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.487+0000 7f3b68ead700 1 -- 172.21.15.72:0/4141532509 shutdown_connections 2023-10-03T10:17:41.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.487+0000 7f3b68ead700 1 -- 172.21.15.72:0/4141532509 wait complete. 2023-10-03T10:17:41.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.488+0000 7f3b68ead700 1 Processor -- start 2023-10-03T10:17:41.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.488+0000 7f3b68ead700 1 -- start start 2023-10-03T10:17:41.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.488+0000 7f3b68ead700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6409d6f0 0x7f3b64122490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.488+0000 7f3b68ead700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b6409e000 0x7f3b641229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.488+0000 7f3b68ead700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b6409e410 0x7f3b64122f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:41.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.488+0000 7f3b68ead700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b64125cd0 con 0x7f3b6409d6f0 2023-10-03T10:17:41.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.488+0000 7f3b68ead700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b641241b0 con 0x7f3b6409e410 2023-10-03T10:17:41.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.488+0000 7f3b68ead700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b640a1a50 con 0x7f3b6409e000 2023-10-03T10:17:41.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b6259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6409d6f0 0x7f3b64122490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b61d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b6409e000 0x7f3b641229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b62d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b6409e410 0x7f3b64122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b6259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6409d6f0 0x7f3b64122490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40942/0 (socket says 172.21.15.72:40942) 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b61d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b6409e000 0x7f3b641229d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58964/0 (socket says 172.21.15.72:58964) 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b62d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b6409e410 0x7f3b64122f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39670/0 (socket says 172.21.15.72:39670) 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b6259c700 1 -- 172.21.15.72:0/452006580 learned_addr learned my addr 172.21.15.72:0/452006580 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b62d9d700 1 -- 172.21.15.72:0/452006580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b6409e000 msgr2=0x7f3b641229d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b62d9d700 1 --2- 172.21.15.72:0/452006580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b6409e000 0x7f3b641229d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b62d9d700 1 -- 172.21.15.72:0/452006580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6409d6f0 msgr2=0x7f3b64122490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b62d9d700 1 --2- 172.21.15.72:0/452006580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6409d6f0 0x7f3b64122490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b62d9d700 1 -- 172.21.15.72:0/452006580 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b54009550 con 0x7f3b6409e410 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b61d9b700 1 --2- 172.21.15.72:0/452006580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b6409e000 0x7f3b641229d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b6259c700 1 --2- 172.21.15.72:0/452006580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6409d6f0 0x7f3b64122490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:41.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b62d9d700 1 --2- 172.21.15.72:0/452006580 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b6409e410 0x7f3b64122f10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00efc0 tx=0x7f3b5c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:41.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b52ffd700 1 -- 172.21.15.72:0/452006580 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c009e60 con 0x7f3b6409e410 2023-10-03T10:17:41.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b52ffd700 1 -- 172.21.15.72:0/452006580 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5c00f040 con 0x7f3b6409e410 2023-10-03T10:17:41.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b68ead700 1 -- 172.21.15.72:0/452006580 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5c009a70 con 0x7f3b6409e410 2023-10-03T10:17:41.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b52ffd700 1 -- 172.21.15.72:0/452006580 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c00cd60 con 0x7f3b6409e410 2023-10-03T10:17:41.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.489+0000 7f3b68ead700 1 -- 172.21.15.72:0/452006580 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5800b740 con 0x7f3b6409e410 2023-10-03T10:17:41.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.490+0000 7f3b52ffd700 1 -- 172.21.15.72:0/452006580 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b5c014480 con 0x7f3b6409e410 2023-10-03T10:17:41.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.490+0000 7f3b68ead700 1 -- 172.21.15.72:0/452006580 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b64074ea0 con 0x7f3b6409e410 2023-10-03T10:17:41.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.490+0000 7f3b52ffd700 1 -- 172.21.15.72:0/452006580 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3b5c03fc60 con 0x7f3b6409e410 2023-10-03T10:17:41.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.495+0000 7f3b52ffd700 1 -- 172.21.15.72:0/452006580 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b5c012930 con 0x7f3b6409e410 2023-10-03T10:17:41.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.678+0000 7f3b68ead700 1 -- 172.21.15.72:0/452006580 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3b64125a70 con 0x7f3b6409e410 2023-10-03T10:17:41.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.679+0000 7f3b52ffd700 1 -- 172.21.15.72:0/452006580 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b5c012340 con 0x7f3b6409e410 2023-10-03T10:17:41.679 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:41.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.681+0000 7f3b68ead700 1 -- 172.21.15.72:0/452006580 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b6409e410 msgr2=0x7f3b64122f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.681+0000 7f3b68ead700 1 --2- 172.21.15.72:0/452006580 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b6409e410 0x7f3b64122f10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00efc0 tx=0x7f3b5c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.681+0000 7f3b68ead700 1 -- 172.21.15.72:0/452006580 shutdown_connections 2023-10-03T10:17:41.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.681+0000 7f3b68ead700 1 --2- 172.21.15.72:0/452006580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b6409d6f0 0x7f3b64122490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.681+0000 7f3b68ead700 1 --2- 172.21.15.72:0/452006580 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b6409e410 0x7f3b64122f10 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.681+0000 7f3b68ead700 1 --2- 172.21.15.72:0/452006580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b6409e000 0x7f3b641229d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.681+0000 7f3b68ead700 1 -- 172.21.15.72:0/452006580 >> 172.21.15.72:0/452006580 conn(0x7f3b64066f50 msgr2=0x7f3b6406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.681+0000 7f3b68ead700 1 -- 172.21.15.72:0/452006580 shutdown_connections 2023-10-03T10:17:41.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:41.681+0000 7f3b68ead700 1 -- 172.21.15.72:0/452006580 wait complete. 2023-10-03T10:17:41.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:42.052 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:42.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:42.165 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.180+0000 7f299bc0d700 1 Processor -- start 2023-10-03T10:17:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.180+0000 7f299bc0d700 1 -- start start 2023-10-03T10:17:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.181+0000 7f299bc0d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f299409d6f0 0x7f299409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.181+0000 7f299bc0d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f299409e000 0x7f2994130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.181+0000 7f299bc0d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299409f130 con 0x7f299409e410 2023-10-03T10:17:42.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.181+0000 7f299bc0d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299409f520 con 0x7f299409e000 2023-10-03T10:17:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.181+0000 7f299bc0d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299409e930 con 0x7f299409d6f0 2023-10-03T10:17:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.181+0000 7f29999a9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f299409d6f0 0x7f299409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.181+0000 7f29991a8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f299409e000 0x7f2994130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.181+0000 7f29999a9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f299409d6f0 0x7f299409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39686/0 (socket says 172.21.15.72:39686) 2023-10-03T10:17:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.181+0000 7f29999a9700 1 -- 172.21.15.72:0/353551958 learned_addr learned my addr 172.21.15.72:0/353551958 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.181+0000 7f29999a9700 1 -- 172.21.15.72:0/353551958 >> v2:172.21.15.72:3300/0 conn(0x7f299409e000 msgr2=0x7f2994130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.181+0000 7f29999a9700 1 --2- 172.21.15.72:0/353551958 >> v2:172.21.15.72:3300/0 conn(0x7f299409e000 0x7f2994130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.181+0000 7f29999a9700 1 -- 172.21.15.72:0/353551958 >> v1:172.21.15.72:6789/0 conn(0x7f299409e410 legacy=0x7f2994130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.181+0000 7f29999a9700 1 -- 172.21.15.72:0/353551958 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299409b2d0 con 0x7f299409d6f0 2023-10-03T10:17:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.182+0000 7f29999a9700 1 --2- 172.21.15.72:0/353551958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f299409d6f0 0x7f299409dac0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f29900098f0 tx=0x7f2990009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=336b24023066269e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.182+0000 7f29989a7700 1 -- 172.21.15.72:0/353551958 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990011830 con 0x7f299409d6f0 2023-10-03T10:17:42.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.182+0000 7f29989a7700 1 -- 172.21.15.72:0/353551958 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2990011990 con 0x7f299409d6f0 2023-10-03T10:17:42.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.182+0000 7f29989a7700 1 -- 172.21.15.72:0/353551958 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990011d20 con 0x7f299409d6f0 2023-10-03T10:17:42.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.182+0000 7f299bc0d700 1 -- 172.21.15.72:0/353551958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f299409d6f0 msgr2=0x7f299409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.182+0000 7f299bc0d700 1 --2- 172.21.15.72:0/353551958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f299409d6f0 0x7f299409dac0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f29900098f0 tx=0x7f2990009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:42.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.182+0000 7f299bc0d700 1 -- 172.21.15.72:0/353551958 shutdown_connections 2023-10-03T10:17:42.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.182+0000 7f299bc0d700 1 --2- 172.21.15.72:0/353551958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f299409d6f0 0x7f299409dac0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.182+0000 7f299bc0d700 1 --2- 172.21.15.72:0/353551958 >> v2:172.21.15.72:3300/0 conn(0x7f299409e000 0x7f2994130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.182+0000 7f299bc0d700 1 -- 172.21.15.72:0/353551958 >> 172.21.15.72:0/353551958 conn(0x7f2994066f50 msgr2=0x7f299409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.183+0000 7f299bc0d700 1 -- 172.21.15.72:0/353551958 shutdown_connections 2023-10-03T10:17:42.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.183+0000 7f299bc0d700 1 -- 172.21.15.72:0/353551958 wait complete. 2023-10-03T10:17:42.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.183+0000 7f299bc0d700 1 Processor -- start 2023-10-03T10:17:42.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f299bc0d700 1 -- start start 2023-10-03T10:17:42.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f299bc0d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f299409d6f0 0x7f29941202b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f299bc0d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299409e000 0x7f29941207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f299bc0d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f299409e410 0x7f2994120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f299bc0d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2994123c80 con 0x7f299409e000 2023-10-03T10:17:42.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f299bc0d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2994121680 con 0x7f299409d6f0 2023-10-03T10:17:42.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f299bc0d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29940a1f10 con 0x7f299409e410 2023-10-03T10:17:42.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f29991a8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299409e000 0x7f29941207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f29991a8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299409e000 0x7f29941207f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40960/0 (socket says 172.21.15.72:40960) 2023-10-03T10:17:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f29991a8700 1 -- 172.21.15.72:0/3920481182 learned_addr learned my addr 172.21.15.72:0/3920481182 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f29999a9700 1 --2- 172.21.15.72:0/3920481182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f299409d6f0 0x7f29941202b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f29991a8700 1 -- 172.21.15.72:0/3920481182 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f299409e410 msgr2=0x7f2994120d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f29991a8700 1 --2- 172.21.15.72:0/3920481182 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f299409e410 0x7f2994120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f29991a8700 1 -- 172.21.15.72:0/3920481182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f299409d6f0 msgr2=0x7f29941202b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f29991a8700 1 --2- 172.21.15.72:0/3920481182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f299409d6f0 0x7f29941202b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f29991a8700 1 -- 172.21.15.72:0/3920481182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2990009550 con 0x7f299409e000 2023-10-03T10:17:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.184+0000 7f29999a9700 1 --2- 172.21.15.72:0/3920481182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f299409d6f0 0x7f29941202b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.185+0000 7f29991a8700 1 --2- 172.21.15.72:0/3920481182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299409e000 0x7f29941207f0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f298400e980 tx=0x7f298400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.185+0000 7f298a7fc700 1 -- 172.21.15.72:0/3920481182 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984009710 con 0x7f299409e000 2023-10-03T10:17:42.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.185+0000 7f298a7fc700 1 -- 172.21.15.72:0/3920481182 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298400eed0 con 0x7f299409e000 2023-10-03T10:17:42.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.185+0000 7f299bc0d700 1 -- 172.21.15.72:0/3920481182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299409c700 con 0x7f299409e000 2023-10-03T10:17:42.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.185+0000 7f298a7fc700 1 -- 172.21.15.72:0/3920481182 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298400ca70 con 0x7f299409e000 2023-10-03T10:17:42.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.185+0000 7f299bc0d700 1 -- 172.21.15.72:0/3920481182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29941300a0 con 0x7f299409e000 2023-10-03T10:17:42.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.186+0000 7f299bc0d700 1 -- 172.21.15.72:0/3920481182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2994123820 con 0x7f299409e000 2023-10-03T10:17:42.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.186+0000 7f298a7fc700 1 -- 172.21.15.72:0/3920481182 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f298400cbd0 con 0x7f299409e000 2023-10-03T10:17:42.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.187+0000 7f298a7fc700 1 -- 172.21.15.72:0/3920481182 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f298403ffa0 con 0x7f299409e000 2023-10-03T10:17:42.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.191+0000 7f298a7fc700 1 -- 172.21.15.72:0/3920481182 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2984024350 con 0x7f299409e000 2023-10-03T10:17:42.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.231+0000 7f9911c60700 1 Processor -- start 2023-10-03T10:17:42.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.231+0000 7f9911c60700 1 -- start start 2023-10-03T10:17:42.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f9911c60700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f990c0a0a30 0x7f990c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f9911c60700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f990c134170 0x7f990c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f9911c60700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f990c09edd0 con 0x7f990c0a1340 2023-10-03T10:17:42.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f9911c60700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990c09e1f0 con 0x7f990c0a0a30 2023-10-03T10:17:42.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f9911c60700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f990c09dc50 con 0x7f990c134170 2023-10-03T10:17:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f990b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f990c0a0a30 0x7f990c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f990b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f990c0a0a30 0x7f990c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40970/0 (socket says 172.21.15.72:40970) 2023-10-03T10:17:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f990b7fe700 1 -- 172.21.15.72:0/3926294330 learned_addr learned my addr 172.21.15.72:0/3926294330 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f990affd700 1 --1- 172.21.15.72:0/3926294330 >> v1:172.21.15.72:6789/0 conn(0x7f990c0a1340 0x7f990c133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41320/0 (socket says 172.21.15.72:41320) 2023-10-03T10:17:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f990bfff700 1 --2- 172.21.15.72:0/3926294330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f990c134170 0x7f990c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f990a7fc700 1 -- 172.21.15.72:0/3926294330 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294413204 0 0) 0x7f990c09edd0 con 0x7f990c0a1340 2023-10-03T10:17:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f990a7fc700 1 -- 172.21.15.72:0/3926294330 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98f40035b0 con 0x7f990c0a1340 2023-10-03T10:17:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f990bfff700 1 -- 172.21.15.72:0/3926294330 >> v2:172.21.15.72:3300/0 conn(0x7f990c0a0a30 msgr2=0x7f990c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f990bfff700 1 --2- 172.21.15.72:0/3926294330 >> v2:172.21.15.72:3300/0 conn(0x7f990c0a0a30 0x7f990c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f990bfff700 1 -- 172.21.15.72:0/3926294330 >> v1:172.21.15.72:6789/0 conn(0x7f990c0a1340 legacy=0x7f990c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f990bfff700 1 -- 172.21.15.72:0/3926294330 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c0a1fe0 con 0x7f990c134170 2023-10-03T10:17:42.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f990b7fe700 1 --2- 172.21.15.72:0/3926294330 >> v2:172.21.15.72:3300/0 conn(0x7f990c0a0a30 0x7f990c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.232+0000 7f990bfff700 1 --2- 172.21.15.72:0/3926294330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f990c134170 0x7f990c13bd30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9904009d90 tx=0x7f990400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14f85bbd26bc92cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.233+0000 7f990a7fc700 1 -- 172.21.15.72:0/3926294330 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990400e070 con 0x7f990c134170 2023-10-03T10:17:42.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.233+0000 7f990a7fc700 1 -- 172.21.15.72:0/3926294330 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990400bae0 con 0x7f990c134170 2023-10-03T10:17:42.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.233+0000 7f990a7fc700 1 -- 172.21.15.72:0/3926294330 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990400be70 con 0x7f990c134170 2023-10-03T10:17:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.233+0000 7f9911c60700 1 -- 172.21.15.72:0/3926294330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f990c134170 msgr2=0x7f990c13bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.233+0000 7f9911c60700 1 --2- 172.21.15.72:0/3926294330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f990c134170 0x7f990c13bd30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9904009d90 tx=0x7f990400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.233+0000 7f9911c60700 1 -- 172.21.15.72:0/3926294330 shutdown_connections 2023-10-03T10:17:42.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.233+0000 7f9911c60700 1 --2- 172.21.15.72:0/3926294330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f990c134170 0x7f990c13bd30 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.233+0000 7f9911c60700 1 --2- 172.21.15.72:0/3926294330 >> v2:172.21.15.72:3300/0 conn(0x7f990c0a0a30 0x7f990c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.233+0000 7f9911c60700 1 -- 172.21.15.72:0/3926294330 >> 172.21.15.72:0/3926294330 conn(0x7f990c0a6550 msgr2=0x7f990c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.233+0000 7f9911c60700 1 -- 172.21.15.72:0/3926294330 shutdown_connections 2023-10-03T10:17:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.233+0000 7f9911c60700 1 -- 172.21.15.72:0/3926294330 wait complete. 2023-10-03T10:17:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.235+0000 7f9911c60700 1 Processor -- start 2023-10-03T10:17:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.235+0000 7f9911c60700 1 -- start start 2023-10-03T10:17:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f9911c60700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f990c0a0a30 0x7f990c1232c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f9911c60700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f990c0a1340 0x7f990c123800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f9911c60700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f990c134170 0x7f990c1c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f9911c60700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990c124600 con 0x7f990c0a0a30 2023-10-03T10:17:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f9911c60700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990c124ed0 con 0x7f990c134170 2023-10-03T10:17:42.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f9911c60700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f990c124bb0 con 0x7f990c0a1340 2023-10-03T10:17:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f990c0a0a30 0x7f990c1232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f990affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f990c0a1340 0x7f990c123800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f990b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f990c0a0a30 0x7f990c1232c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40984/0 (socket says 172.21.15.72:40984) 2023-10-03T10:17:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f990b7fe700 1 -- 172.21.15.72:0/2463698648 learned_addr learned my addr 172.21.15.72:0/2463698648 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f990affd700 1 -- 172.21.15.72:0/2463698648 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f990c134170 msgr2=0x7f990c1c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f990affd700 1 --2- 172.21.15.72:0/2463698648 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f990c134170 0x7f990c1c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f990affd700 1 -- 172.21.15.72:0/2463698648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f990c0a0a30 msgr2=0x7f990c1232c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f990affd700 1 --2- 172.21.15.72:0/2463698648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f990c0a0a30 0x7f990c1232c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f990affd700 1 -- 172.21.15.72:0/2463698648 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc009550 con 0x7f990c0a1340 2023-10-03T10:17:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f990b7fe700 1 --2- 172.21.15.72:0/2463698648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f990c0a0a30 0x7f990c1232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f990affd700 1 --2- 172.21.15.72:0/2463698648 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f990c0a1340 0x7f990c123800 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f990000c4e0 tx=0x7f990000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f98f3fff700 1 -- 172.21.15.72:0/2463698648 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9900004c80 con 0x7f990c0a1340 2023-10-03T10:17:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f98f3fff700 1 -- 172.21.15.72:0/2463698648 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9900004e00 con 0x7f990c0a1340 2023-10-03T10:17:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f9911c60700 1 -- 172.21.15.72:0/2463698648 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9904009a70 con 0x7f990c0a1340 2023-10-03T10:17:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f98f3fff700 1 -- 172.21.15.72:0/2463698648 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9900007310 con 0x7f990c0a1340 2023-10-03T10:17:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.236+0000 7f9911c60700 1 -- 172.21.15.72:0/2463698648 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990c0a25e0 con 0x7f990c0a1340 2023-10-03T10:17:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.238+0000 7f9911c60700 1 -- 172.21.15.72:0/2463698648 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990c074ea0 con 0x7f990c0a1340 2023-10-03T10:17:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.238+0000 7f98f3fff700 1 -- 172.21.15.72:0/2463698648 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9900007470 con 0x7f990c0a1340 2023-10-03T10:17:42.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.238+0000 7f98f3fff700 1 -- 172.21.15.72:0/2463698648 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f990003fa10 con 0x7f990c0a1340 2023-10-03T10:17:42.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.242+0000 7f98f3fff700 1 -- 172.21.15.72:0/2463698648 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f990001bcc0 con 0x7f990c0a1340 2023-10-03T10:17:42.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.291+0000 7f0b2c68d700 1 Processor -- start 2023-10-03T10:17:42.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.291+0000 7f0b2c68d700 1 -- start start 2023-10-03T10:17:42.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.292+0000 7f0b2c68d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b2409d6f0 0x7f0b2409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.292+0000 7f0b2c68d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b2409e410 0x7f0b24134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.292+0000 7f0b2c68d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b2409b120 con 0x7f0b2409e000 2023-10-03T10:17:42.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.292+0000 7f0b2c68d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2406b460 con 0x7f0b2409d6f0 2023-10-03T10:17:42.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.292+0000 7f0b2c68d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2409a7e0 con 0x7f0b2409e410 2023-10-03T10:17:42.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.292+0000 7f0b2a429700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b2409d6f0 0x7f0b2409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.292+0000 7f0b29c28700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0b2409e000 0x7f0b241339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41336/0 (socket says 172.21.15.72:41336) 2023-10-03T10:17:42.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.292+0000 7f0b2ac2a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b2409e410 0x7f0b24134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.292+0000 7f0b29c28700 1 -- 172.21.15.72:0/3209179746 learned_addr learned my addr 172.21.15.72:0/3209179746 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:42.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.292+0000 7f0b2ac2a700 1 -- 172.21.15.72:0/3209179746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b2409d6f0 msgr2=0x7f0b2409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.292+0000 7f0b2ac2a700 1 --2- 172.21.15.72:0/3209179746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b2409d6f0 0x7f0b2409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.292+0000 7f0b2ac2a700 1 -- 172.21.15.72:0/3209179746 >> v1:172.21.15.72:6789/0 conn(0x7f0b2409e000 legacy=0x7f0b241339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.292+0000 7f0b29427700 1 -- 172.21.15.72:0/3209179746 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190754053 0 0) 0x7f0b2409b120 con 0x7f0b2409e000 2023-10-03T10:17:42.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.292+0000 7f0b2ac2a700 1 -- 172.21.15.72:0/3209179746 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2409a500 con 0x7f0b2409e410 2023-10-03T10:17:42.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.292+0000 7f0b2a429700 1 --2- 172.21.15.72:0/3209179746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b2409d6f0 0x7f0b2409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.293+0000 7f0b2ac2a700 1 --2- 172.21.15.72:0/3209179746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b2409e410 0x7f0b24134100 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009df0 tx=0x7f0b1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbe55be8ee583e66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.293+0000 7f0b29427700 1 -- 172.21.15.72:0/3209179746 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00e070 con 0x7f0b2409e410 2023-10-03T10:17:42.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.293+0000 7f0b29427700 1 -- 172.21.15.72:0/3209179746 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c00bae0 con 0x7f0b2409e410 2023-10-03T10:17:42.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.293+0000 7f0b29427700 1 -- 172.21.15.72:0/3209179746 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00be90 con 0x7f0b2409e410 2023-10-03T10:17:42.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.293+0000 7f0b2c68d700 1 -- 172.21.15.72:0/3209179746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b2409e410 msgr2=0x7f0b24134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.293+0000 7f0b2c68d700 1 --2- 172.21.15.72:0/3209179746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b2409e410 0x7f0b24134100 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009df0 tx=0x7f0b1c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:42.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.293+0000 7f0b2c68d700 1 -- 172.21.15.72:0/3209179746 shutdown_connections 2023-10-03T10:17:42.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.293+0000 7f0b2c68d700 1 --2- 172.21.15.72:0/3209179746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b2409e410 0x7f0b24134100 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.293+0000 7f0b2c68d700 1 --2- 172.21.15.72:0/3209179746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b2409d6f0 0x7f0b2409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.293+0000 7f0b2c68d700 1 -- 172.21.15.72:0/3209179746 >> 172.21.15.72:0/3209179746 conn(0x7f0b24066f50 msgr2=0x7f0b2409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.293+0000 7f0b2c68d700 1 -- 172.21.15.72:0/3209179746 shutdown_connections 2023-10-03T10:17:42.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.294+0000 7f0b2c68d700 1 -- 172.21.15.72:0/3209179746 wait complete. 2023-10-03T10:17:42.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.294+0000 7f0b2c68d700 1 Processor -- start 2023-10-03T10:17:42.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.294+0000 7f0b2c68d700 1 -- start start 2023-10-03T10:17:42.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.295+0000 7f0b2c68d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b2409d6f0 0x7f0b24122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.295+0000 7f0b2c68d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b2409e000 0x7f0b24122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.295+0000 7f0b2c68d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b2409e410 0x7f0b24122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.295+0000 7f0b2c68d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b241237f0 con 0x7f0b2409e000 2023-10-03T10:17:42.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.295+0000 7f0b2c68d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b24124e00 con 0x7f0b2409e410 2023-10-03T10:17:42.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.295+0000 7f0b2c68d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b24125e40 con 0x7f0b2409d6f0 2023-10-03T10:17:42.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.295+0000 7f0b29c28700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b2409e000 0x7f0b24122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.295+0000 7f0b29c28700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b2409e000 0x7f0b24122860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40988/0 (socket says 172.21.15.72:40988) 2023-10-03T10:17:42.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.295+0000 7f0b29c28700 1 -- 172.21.15.72:0/3632015323 learned_addr learned my addr 172.21.15.72:0/3632015323 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:42.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.295+0000 7f0b2a429700 1 --2- 172.21.15.72:0/3632015323 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b2409d6f0 0x7f0b24122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.295+0000 7f0b2ac2a700 1 --2- 172.21.15.72:0/3632015323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b2409e410 0x7f0b24122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.296+0000 7f0b29c28700 1 -- 172.21.15.72:0/3632015323 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b2409d6f0 msgr2=0x7f0b24122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.296+0000 7f0b29c28700 1 --2- 172.21.15.72:0/3632015323 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b2409d6f0 0x7f0b24122320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.296+0000 7f0b29c28700 1 -- 172.21.15.72:0/3632015323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b2409e410 msgr2=0x7f0b24122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.296+0000 7f0b29c28700 1 --2- 172.21.15.72:0/3632015323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b2409e410 0x7f0b24122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.296+0000 7f0b29c28700 1 -- 172.21.15.72:0/3632015323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b200094a0 con 0x7f0b2409e000 2023-10-03T10:17:42.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.296+0000 7f0b2a429700 1 --2- 172.21.15.72:0/3632015323 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b2409d6f0 0x7f0b24122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.296+0000 7f0b29c28700 1 --2- 172.21.15.72:0/3632015323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b2409e000 0x7f0b24122860 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400c520 tx=0x7f0b1400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.296+0000 7f0b1affd700 1 -- 172.21.15.72:0/3632015323 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14004c80 con 0x7f0b2409e000 2023-10-03T10:17:42.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.296+0000 7f0b1affd700 1 -- 172.21.15.72:0/3632015323 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b14004de0 con 0x7f0b2409e000 2023-10-03T10:17:42.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.296+0000 7f0b2c68d700 1 -- 172.21.15.72:0/3632015323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1c009a70 con 0x7f0b2409e000 2023-10-03T10:17:42.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.296+0000 7f0b1affd700 1 -- 172.21.15.72:0/3632015323 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14007310 con 0x7f0b2409e000 2023-10-03T10:17:42.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.296+0000 7f0b2c68d700 1 -- 172.21.15.72:0/3632015323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b240a2020 con 0x7f0b2409e000 2023-10-03T10:17:42.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.297+0000 7f0b2c68d700 1 -- 172.21.15.72:0/3632015323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2411f030 con 0x7f0b2409e000 2023-10-03T10:17:42.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.297+0000 7f0b1affd700 1 -- 172.21.15.72:0/3632015323 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b14007470 con 0x7f0b2409e000 2023-10-03T10:17:42.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.298+0000 7f0b1affd700 1 -- 172.21.15.72:0/3632015323 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0b1403f9c0 con 0x7f0b2409e000 2023-10-03T10:17:42.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.302+0000 7f0b1affd700 1 -- 172.21.15.72:0/3632015323 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b140133c0 con 0x7f0b2409e000 2023-10-03T10:17:42.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.389+0000 7f299bc0d700 1 -- 172.21.15.72:0/3920481182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2994074ea0 con 0x7f299409e000 2023-10-03T10:17:42.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.390+0000 7f298a7fc700 1 -- 172.21.15.72:0/3920481182 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f298402a090 con 0x7f299409e000 2023-10-03T10:17:42.390 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:42.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.393+0000 7f299bc0d700 1 -- 172.21.15.72:0/3920481182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299409e000 msgr2=0x7f29941207f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.393+0000 7f299bc0d700 1 --2- 172.21.15.72:0/3920481182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299409e000 0x7f29941207f0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f298400e980 tx=0x7f298400ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:42.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.393+0000 7f299bc0d700 1 -- 172.21.15.72:0/3920481182 shutdown_connections 2023-10-03T10:17:42.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.393+0000 7f299bc0d700 1 --2- 172.21.15.72:0/3920481182 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f299409e410 0x7f2994120d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.393+0000 7f299bc0d700 1 --2- 172.21.15.72:0/3920481182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f299409d6f0 0x7f29941202b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.393+0000 7f299bc0d700 1 --2- 172.21.15.72:0/3920481182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f299409e000 0x7f29941207f0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.393+0000 7f299bc0d700 1 -- 172.21.15.72:0/3920481182 >> 172.21.15.72:0/3920481182 conn(0x7f2994066f50 msgr2=0x7f299406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.393+0000 7f299bc0d700 1 -- 172.21.15.72:0/3920481182 shutdown_connections 2023-10-03T10:17:42.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.393+0000 7f299bc0d700 1 -- 172.21.15.72:0/3920481182 wait complete. 2023-10-03T10:17:42.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:42.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.452+0000 7f9911c60700 1 -- 172.21.15.72:0/2463698648 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f990c09bcb0 con 0x7f990c0a1340 2023-10-03T10:17:42.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.453+0000 7f98f3fff700 1 -- 172.21.15.72:0/2463698648 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f990001bae0 con 0x7f990c0a1340 2023-10-03T10:17:42.453 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:42.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.455+0000 7f9911c60700 1 -- 172.21.15.72:0/2463698648 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f990c0a1340 msgr2=0x7f990c123800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.455+0000 7f9911c60700 1 --2- 172.21.15.72:0/2463698648 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f990c0a1340 0x7f990c123800 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f990000c4e0 tx=0x7f990000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.455+0000 7f9911c60700 1 -- 172.21.15.72:0/2463698648 shutdown_connections 2023-10-03T10:17:42.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.455+0000 7f9911c60700 1 --2- 172.21.15.72:0/2463698648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f990c0a0a30 0x7f990c1232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.455+0000 7f9911c60700 1 --2- 172.21.15.72:0/2463698648 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f990c134170 0x7f990c1c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.455+0000 7f9911c60700 1 --2- 172.21.15.72:0/2463698648 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f990c0a1340 0x7f990c123800 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.455+0000 7f9911c60700 1 -- 172.21.15.72:0/2463698648 >> 172.21.15.72:0/2463698648 conn(0x7f990c0a6550 msgr2=0x7f990c09edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.455+0000 7f9911c60700 1 -- 172.21.15.72:0/2463698648 shutdown_connections 2023-10-03T10:17:42.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.455+0000 7f9911c60700 1 -- 172.21.15.72:0/2463698648 wait complete. 2023-10-03T10:17:42.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.516+0000 7f0b2c68d700 1 -- 172.21.15.72:0/3632015323 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0b24074ea0 con 0x7f0b2409e000 2023-10-03T10:17:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.516+0000 7f0b1affd700 1 -- 172.21.15.72:0/3632015323 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0b14011360 con 0x7f0b2409e000 2023-10-03T10:17:42.517 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:42.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.518+0000 7f0b2c68d700 1 -- 172.21.15.72:0/3632015323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b2409e000 msgr2=0x7f0b24122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.518+0000 7f0b2c68d700 1 --2- 172.21.15.72:0/3632015323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b2409e000 0x7f0b24122860 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400c520 tx=0x7f0b1400c830 comp rx=0 tx=0).stop 2023-10-03T10:17:42.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.518+0000 7f0b2c68d700 1 -- 172.21.15.72:0/3632015323 shutdown_connections 2023-10-03T10:17:42.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.518+0000 7f0b2c68d700 1 --2- 172.21.15.72:0/3632015323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b2409e410 0x7f0b24122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.518+0000 7f0b2c68d700 1 --2- 172.21.15.72:0/3632015323 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b2409d6f0 0x7f0b24122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.518+0000 7f0b2c68d700 1 --2- 172.21.15.72:0/3632015323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b2409e000 0x7f0b24122860 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.518+0000 7f0b2c68d700 1 -- 172.21.15.72:0/3632015323 >> 172.21.15.72:0/3632015323 conn(0x7f0b24066f50 msgr2=0x7f0b24133de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.518+0000 7f0b2c68d700 1 -- 172.21.15.72:0/3632015323 shutdown_connections 2023-10-03T10:17:42.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.518+0000 7f0b2c68d700 1 -- 172.21.15.72:0/3632015323 wait complete. 2023-10-03T10:17:42.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:42.694 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:42.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.817+0000 7feb169d5700 1 Processor -- start 2023-10-03T10:17:42.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.817+0000 7feb169d5700 1 -- start start 2023-10-03T10:17:42.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.817+0000 7feb169d5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb1009e1d0 0x7feb10138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.817+0000 7feb169d5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb10139170 0x7feb1013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.817+0000 7feb169d5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1009b120 con 0x7feb1009d6f0 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.817+0000 7feb169d5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1006b460 con 0x7feb10139170 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.817+0000 7feb169d5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb1009a7e0 con 0x7feb1009e1d0 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.818+0000 7feb0f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb1009e1d0 0x7feb10138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.818+0000 7feb0ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7feb1009d6f0 0x7feb1009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41344/0 (socket says 172.21.15.72:41344) 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.818+0000 7feb14f72700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb10139170 0x7feb1013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.818+0000 7feb0ffff700 1 -- 172.21.15.72:0/1371070685 learned_addr learned my addr 172.21.15.72:0/1371070685 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.818+0000 7feb0f7fe700 1 -- 172.21.15.72:0/1371070685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb10139170 msgr2=0x7feb1013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.818+0000 7feb0f7fe700 1 --2- 172.21.15.72:0/1371070685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb10139170 0x7feb1013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.818+0000 7feb0f7fe700 1 -- 172.21.15.72:0/1371070685 >> v1:172.21.15.72:6789/0 conn(0x7feb1009d6f0 legacy=0x7feb1009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.818+0000 7feb0effd700 1 -- 172.21.15.72:0/1371070685 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562780808 0 0) 0x7feb1009b120 con 0x7feb1009d6f0 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.818+0000 7feb0f7fe700 1 -- 172.21.15.72:0/1371070685 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1009a500 con 0x7feb1009e1d0 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.818+0000 7feb14f72700 1 --2- 172.21.15.72:0/1371070685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb10139170 0x7feb1013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.818+0000 7feb0f7fe700 1 --2- 172.21.15.72:0/1371070685 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb1009e1d0 0x7feb10138c30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7feb000098a0 tx=0x7feb00009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=700806b6fdc3510f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.818+0000 7feb0effd700 1 -- 172.21.15.72:0/1371070685 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb00011830 con 0x7feb1009e1d0 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.818+0000 7feb0effd700 1 -- 172.21.15.72:0/1371070685 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb00011990 con 0x7feb1009e1d0 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.818+0000 7feb0effd700 1 -- 172.21.15.72:0/1371070685 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb00011d20 con 0x7feb1009e1d0 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.819+0000 7feb169d5700 1 -- 172.21.15.72:0/1371070685 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb1009e1d0 msgr2=0x7feb10138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.819+0000 7feb169d5700 1 --2- 172.21.15.72:0/1371070685 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb1009e1d0 0x7feb10138c30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7feb000098a0 tx=0x7feb00009bb0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.819+0000 7feb169d5700 1 -- 172.21.15.72:0/1371070685 shutdown_connections 2023-10-03T10:17:42.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.819+0000 7feb169d5700 1 --2- 172.21.15.72:0/1371070685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb10139170 0x7feb1013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.819+0000 7feb169d5700 1 --2- 172.21.15.72:0/1371070685 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb1009e1d0 0x7feb10138c30 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.819+0000 7feb169d5700 1 -- 172.21.15.72:0/1371070685 >> 172.21.15.72:0/1371070685 conn(0x7feb10066f50 msgr2=0x7feb1009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.819+0000 7feb169d5700 1 -- 172.21.15.72:0/1371070685 shutdown_connections 2023-10-03T10:17:42.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.819+0000 7feb169d5700 1 -- 172.21.15.72:0/1371070685 wait complete. 2023-10-03T10:17:42.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.820+0000 7feb169d5700 1 Processor -- start 2023-10-03T10:17:42.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.820+0000 7feb169d5700 1 -- start start 2023-10-03T10:17:42.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb169d5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb1009d6f0 0x7feb101c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb169d5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb1009e1d0 0x7feb101c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb169d5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb10139170 0x7feb101c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb169d5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb10072210 con 0x7feb1009e1d0 2023-10-03T10:17:42.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb169d5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb10120680 con 0x7feb1009d6f0 2023-10-03T10:17:42.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb169d5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb10121d20 con 0x7feb10139170 2023-10-03T10:17:42.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb0ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb1009d6f0 0x7feb101c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb14f72700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb10139170 0x7feb101c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb0ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb1009d6f0 0x7feb101c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39742/0 (socket says 172.21.15.72:39742) 2023-10-03T10:17:42.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb0ffff700 1 -- 172.21.15.72:0/291062836 learned_addr learned my addr 172.21.15.72:0/291062836 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:42.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb0f7fe700 1 --2- 172.21.15.72:0/291062836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb1009e1d0 0x7feb101c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb14f72700 1 -- 172.21.15.72:0/291062836 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb1009d6f0 msgr2=0x7feb101c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb14f72700 1 --2- 172.21.15.72:0/291062836 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb1009d6f0 0x7feb101c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb14f72700 1 -- 172.21.15.72:0/291062836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb1009e1d0 msgr2=0x7feb101c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb14f72700 1 --2- 172.21.15.72:0/291062836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb1009e1d0 0x7feb101c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb14f72700 1 -- 172.21.15.72:0/291062836 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb08009a70 con 0x7feb10139170 2023-10-03T10:17:42.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb14f72700 1 --2- 172.21.15.72:0/291062836 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb10139170 0x7feb101c8ee0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7feb0800efc0 tx=0x7feb0800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb0cff9700 1 -- 172.21.15.72:0/291062836 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0800ca90 con 0x7feb10139170 2023-10-03T10:17:42.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb0cff9700 1 -- 172.21.15.72:0/291062836 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0800f040 con 0x7feb10139170 2023-10-03T10:17:42.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb0cff9700 1 -- 172.21.15.72:0/291062836 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0800ce30 con 0x7feb10139170 2023-10-03T10:17:42.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb169d5700 1 -- 172.21.15.72:0/291062836 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb000094a0 con 0x7feb10139170 2023-10-03T10:17:42.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.821+0000 7feb169d5700 1 -- 172.21.15.72:0/291062836 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb101222b0 con 0x7feb10139170 2023-10-03T10:17:42.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.822+0000 7feb0cff9700 1 -- 172.21.15.72:0/291062836 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb08014480 con 0x7feb10139170 2023-10-03T10:17:42.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.822+0000 7feb0cff9700 1 -- 172.21.15.72:0/291062836 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feb0803fdc0 con 0x7feb10139170 2023-10-03T10:17:42.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.822+0000 7feb169d5700 1 -- 172.21.15.72:0/291062836 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb100a1dd0 con 0x7feb10139170 2023-10-03T10:17:42.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:42.827+0000 7feb0cff9700 1 -- 172.21.15.72:0/291062836 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb08012910 con 0x7feb10139170 2023-10-03T10:17:43.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.010+0000 7feb169d5700 1 -- 172.21.15.72:0/291062836 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feb100a0720 con 0x7feb10139170 2023-10-03T10:17:43.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.011+0000 7feb0cff9700 1 -- 172.21.15.72:0/291062836 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb08012340 con 0x7feb10139170 2023-10-03T10:17:43.012 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:43.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.013+0000 7feb169d5700 1 -- 172.21.15.72:0/291062836 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb10139170 msgr2=0x7feb101c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.013+0000 7feb169d5700 1 --2- 172.21.15.72:0/291062836 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb10139170 0x7feb101c8ee0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7feb0800efc0 tx=0x7feb0800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.013+0000 7feb169d5700 1 -- 172.21.15.72:0/291062836 shutdown_connections 2023-10-03T10:17:43.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.013+0000 7feb169d5700 1 --2- 172.21.15.72:0/291062836 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7feb10139170 0x7feb101c8ee0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.013+0000 7feb169d5700 1 --2- 172.21.15.72:0/291062836 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb1009d6f0 0x7feb101c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.013+0000 7feb169d5700 1 --2- 172.21.15.72:0/291062836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb1009e1d0 0x7feb101c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.013+0000 7feb169d5700 1 -- 172.21.15.72:0/291062836 >> 172.21.15.72:0/291062836 conn(0x7feb10066f50 msgr2=0x7feb10136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.013+0000 7feb169d5700 1 -- 172.21.15.72:0/291062836 shutdown_connections 2023-10-03T10:17:43.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.013+0000 7feb169d5700 1 -- 172.21.15.72:0/291062836 wait complete. 2023-10-03T10:17:43.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:43.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:43.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:43.531 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:43.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.539+0000 7f49ab301700 1 Processor -- start 2023-10-03T10:17:43.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.539+0000 7f49ab301700 1 -- start start 2023-10-03T10:17:43.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f49ab301700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49a4136820 0x7f49a4138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f49ab301700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49a4139140 0x7f49a413b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f49ab301700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a406bc00 con 0x7f49a4133a80 2023-10-03T10:17:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f49ab301700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a406c570 con 0x7f49a4136820 2023-10-03T10:17:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f49ab301700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49a40a0040 con 0x7f49a4139140 2023-10-03T10:17:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f49a889c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49a4136820 0x7f49a4138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f49a889c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49a4136820 0x7f49a4138c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39756/0 (socket says 172.21.15.72:39756) 2023-10-03T10:17:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f49a909d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f49a4133a80 0x7f49a4133e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41346/0 (socket says 172.21.15.72:41346) 2023-10-03T10:17:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f49a889c700 1 -- 172.21.15.72:0/2689443648 learned_addr learned my addr 172.21.15.72:0/2689443648 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f49a989e700 1 --2- 172.21.15.72:0/2689443648 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49a4139140 0x7f49a413b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f49a889c700 1 -- 172.21.15.72:0/2689443648 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49a4139140 msgr2=0x7f49a413b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:43.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f49a889c700 1 --2- 172.21.15.72:0/2689443648 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49a4139140 0x7f49a413b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f49a889c700 1 -- 172.21.15.72:0/2689443648 >> v1:172.21.15.72:6789/0 conn(0x7f49a4133a80 legacy=0x7f49a4133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f499bfff700 1 -- 172.21.15.72:0/2689443648 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 789090165 0 0) 0x7f49a406bc00 con 0x7f49a4133a80 2023-10-03T10:17:43.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f49a889c700 1 -- 172.21.15.72:0/2689443648 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a4133860 con 0x7f49a4136820 2023-10-03T10:17:43.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.540+0000 7f49a989e700 1 --2- 172.21.15.72:0/2689443648 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49a4139140 0x7f49a413b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:43.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.541+0000 7f49a889c700 1 --2- 172.21.15.72:0/2689443648 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49a4136820 0x7f49a4138c00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4994009920 tx=0x7f4994009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24cbea2f7bc8a946 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.541+0000 7f499bfff700 1 -- 172.21.15.72:0/2689443648 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994011830 con 0x7f49a4136820 2023-10-03T10:17:43.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.541+0000 7f499bfff700 1 -- 172.21.15.72:0/2689443648 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4994011990 con 0x7f49a4136820 2023-10-03T10:17:43.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.541+0000 7f499bfff700 1 -- 172.21.15.72:0/2689443648 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994011d20 con 0x7f49a4136820 2023-10-03T10:17:43.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.541+0000 7f49ab301700 1 -- 172.21.15.72:0/2689443648 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49a4136820 msgr2=0x7f49a4138c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.541+0000 7f49ab301700 1 --2- 172.21.15.72:0/2689443648 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49a4136820 0x7f49a4138c00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4994009920 tx=0x7f4994009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:43.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.542+0000 7f49ab301700 1 -- 172.21.15.72:0/2689443648 shutdown_connections 2023-10-03T10:17:43.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.542+0000 7f49ab301700 1 --2- 172.21.15.72:0/2689443648 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49a4139140 0x7f49a413b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.542+0000 7f49ab301700 1 --2- 172.21.15.72:0/2689443648 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49a4136820 0x7f49a4138c00 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.542+0000 7f49ab301700 1 -- 172.21.15.72:0/2689443648 >> 172.21.15.72:0/2689443648 conn(0x7f49a40a4210 msgr2=0x7f49a40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.542+0000 7f49ab301700 1 -- 172.21.15.72:0/2689443648 shutdown_connections 2023-10-03T10:17:43.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.542+0000 7f49ab301700 1 -- 172.21.15.72:0/2689443648 wait complete. 2023-10-03T10:17:43.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.542+0000 7f49ab301700 1 Processor -- start 2023-10-03T10:17:43.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49ab301700 1 -- start start 2023-10-03T10:17:43.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49ab301700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4133a80 0x7f49a409b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49ab301700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49a4136820 0x7f49a409bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49ab301700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49a4139140 0x7f49a41c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49ab301700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a409dd90 con 0x7f49a4133a80 2023-10-03T10:17:43.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49ab301700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a409e050 con 0x7f49a4136820 2023-10-03T10:17:43.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49ab301700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49a409e3a0 con 0x7f49a4139140 2023-10-03T10:17:43.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49a909d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4133a80 0x7f49a409b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49a909d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4133a80 0x7f49a409b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41006/0 (socket says 172.21.15.72:41006) 2023-10-03T10:17:43.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49a909d700 1 -- 172.21.15.72:0/4092265391 learned_addr learned my addr 172.21.15.72:0/4092265391 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:43.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49a889c700 1 --2- 172.21.15.72:0/4092265391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49a4136820 0x7f49a409bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49a989e700 1 --2- 172.21.15.72:0/4092265391 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49a4139140 0x7f49a41c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49a909d700 1 -- 172.21.15.72:0/4092265391 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49a4139140 msgr2=0x7f49a41c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49a909d700 1 --2- 172.21.15.72:0/4092265391 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49a4139140 0x7f49a41c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49a909d700 1 -- 172.21.15.72:0/4092265391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49a4136820 msgr2=0x7f49a409bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49a909d700 1 --2- 172.21.15.72:0/4092265391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49a4136820 0x7f49a409bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49a909d700 1 -- 172.21.15.72:0/4092265391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c009a70 con 0x7f49a4133a80 2023-10-03T10:17:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49a989e700 1 --2- 172.21.15.72:0/4092265391 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49a4139140 0x7f49a41c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.543+0000 7f49a889c700 1 --2- 172.21.15.72:0/4092265391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49a4136820 0x7f49a409bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.544+0000 7f49a909d700 1 --2- 172.21.15.72:0/4092265391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4133a80 0x7f49a409b9e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f49a000c520 tx=0x7f49a000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.544+0000 7f4999ffb700 1 -- 172.21.15.72:0/4092265391 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a0004c80 con 0x7f49a4133a80 2023-10-03T10:17:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.544+0000 7f4999ffb700 1 -- 172.21.15.72:0/4092265391 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a0004e00 con 0x7f49a4133a80 2023-10-03T10:17:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.544+0000 7f4999ffb700 1 -- 172.21.15.72:0/4092265391 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a0007310 con 0x7f49a4133a80 2023-10-03T10:17:43.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.544+0000 7f49ab301700 1 -- 172.21.15.72:0/4092265391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4994009550 con 0x7f49a4133a80 2023-10-03T10:17:43.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.544+0000 7f49ab301700 1 -- 172.21.15.72:0/4092265391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a409c460 con 0x7f49a4133a80 2023-10-03T10:17:43.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.545+0000 7f4999ffb700 1 -- 172.21.15.72:0/4092265391 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49a0007470 con 0x7f49a4133a80 2023-10-03T10:17:43.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.545+0000 7f4999ffb700 1 -- 172.21.15.72:0/4092265391 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f49a003f270 con 0x7f49a4133a80 2023-10-03T10:17:43.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.545+0000 7f49ab301700 1 -- 172.21.15.72:0/4092265391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a409c710 con 0x7f49a4133a80 2023-10-03T10:17:43.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.550+0000 7f4999ffb700 1 -- 172.21.15.72:0/4092265391 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49a00123b0 con 0x7f49a4133a80 2023-10-03T10:17:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.596+0000 7f696f6d2700 1 Processor -- start 2023-10-03T10:17:43.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.596+0000 7f696f6d2700 1 -- start start 2023-10-03T10:17:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.596+0000 7f696f6d2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f696809f410 0x7f6968136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.596+0000 7f696f6d2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968136fe0 0x7f69681393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.596+0000 7f696f6d2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6968070940 con 0x7f696809e930 2023-10-03T10:17:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.596+0000 7f696f6d2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696806fd60 con 0x7f696809f410 2023-10-03T10:17:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.596+0000 7f696f6d2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f696806fa80 con 0x7f6968136fe0 2023-10-03T10:17:43.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.597+0000 7f696dc6f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968136fe0 0x7f69681393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.597+0000 7f696cc6d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f696809f410 0x7f6968136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.597+0000 7f696d46e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f696809e930 0x7f696809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41360/0 (socket says 172.21.15.72:41360) 2023-10-03T10:17:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.597+0000 7f696d46e700 1 -- 172.21.15.72:0/2951019964 learned_addr learned my addr 172.21.15.72:0/2951019964 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.597+0000 7f696dc6f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968136fe0 0x7f69681393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59050/0 (socket says 172.21.15.72:59050) 2023-10-03T10:17:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.597+0000 7f696cc6d700 1 -- 172.21.15.72:0/2951019964 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968136fe0 msgr2=0x7f69681393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.597+0000 7f696cc6d700 1 --2- 172.21.15.72:0/2951019964 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968136fe0 0x7f69681393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.597+0000 7f696cc6d700 1 -- 172.21.15.72:0/2951019964 >> v1:172.21.15.72:6789/0 conn(0x7f696809e930 legacy=0x7f696809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.597+0000 7f696cc6d700 1 -- 172.21.15.72:0/2951019964 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696809fb60 con 0x7f696809f410 2023-10-03T10:17:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.597+0000 7f696cc6d700 1 --2- 172.21.15.72:0/2951019964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f696809f410 0x7f6968136aa0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f6958009840 tx=0x7f6958009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9266d41c70464774 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.597+0000 7f695ffff700 1 -- 172.21.15.72:0/2951019964 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6958011830 con 0x7f696809f410 2023-10-03T10:17:43.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.597+0000 7f695ffff700 1 -- 172.21.15.72:0/2951019964 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6958011990 con 0x7f696809f410 2023-10-03T10:17:43.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.597+0000 7f695ffff700 1 -- 172.21.15.72:0/2951019964 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6958011d20 con 0x7f696809f410 2023-10-03T10:17:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.598+0000 7f696f6d2700 1 -- 172.21.15.72:0/2951019964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f696809f410 msgr2=0x7f6968136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.598+0000 7f696f6d2700 1 --2- 172.21.15.72:0/2951019964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f696809f410 0x7f6968136aa0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f6958009840 tx=0x7f6958009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.598+0000 7f696f6d2700 1 -- 172.21.15.72:0/2951019964 shutdown_connections 2023-10-03T10:17:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.598+0000 7f696f6d2700 1 --2- 172.21.15.72:0/2951019964 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968136fe0 0x7f69681393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.598+0000 7f696f6d2700 1 --2- 172.21.15.72:0/2951019964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f696809f410 0x7f6968136aa0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.598+0000 7f696f6d2700 1 -- 172.21.15.72:0/2951019964 >> 172.21.15.72:0/2951019964 conn(0x7f69680a4210 msgr2=0x7f69680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.598+0000 7f696f6d2700 1 -- 172.21.15.72:0/2951019964 shutdown_connections 2023-10-03T10:17:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.598+0000 7f696f6d2700 1 -- 172.21.15.72:0/2951019964 wait complete. 2023-10-03T10:17:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.599+0000 7f696f6d2700 1 Processor -- start 2023-10-03T10:17:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.599+0000 7f696f6d2700 1 -- start start 2023-10-03T10:17:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696f6d2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f696809e930 0x7f696806c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696f6d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f696809f410 0x7f696806c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696f6d2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968136fe0 0x7f69681c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696f6d2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69681222e0 con 0x7f696809e930 2023-10-03T10:17:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696f6d2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6968132340 con 0x7f696809f410 2023-10-03T10:17:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696f6d2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f696806bd70 con 0x7f6968136fe0 2023-10-03T10:17:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696d46e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f696809e930 0x7f696806c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696cc6d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f696809f410 0x7f696806c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696d46e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f696809e930 0x7f696806c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41020/0 (socket says 172.21.15.72:41020) 2023-10-03T10:17:43.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696d46e700 1 -- 172.21.15.72:0/2953288713 learned_addr learned my addr 172.21.15.72:0/2953288713 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:43.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696dc6f700 1 --2- 172.21.15.72:0/2953288713 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968136fe0 0x7f69681c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696d46e700 1 -- 172.21.15.72:0/2953288713 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968136fe0 msgr2=0x7f69681c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696d46e700 1 --2- 172.21.15.72:0/2953288713 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968136fe0 0x7f69681c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696d46e700 1 -- 172.21.15.72:0/2953288713 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f696809f410 msgr2=0x7f696806c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696d46e700 1 --2- 172.21.15.72:0/2953288713 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f696809f410 0x7f696806c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696d46e700 1 -- 172.21.15.72:0/2953288713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69580094a0 con 0x7f696809e930 2023-10-03T10:17:43.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f696d46e700 1 --2- 172.21.15.72:0/2953288713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f696809e930 0x7f696806c310 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f696400c550 tx=0x7f696400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.600+0000 7f695dffb700 1 -- 172.21.15.72:0/2953288713 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964005d70 con 0x7f696809e930 2023-10-03T10:17:43.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.601+0000 7f695dffb700 1 -- 172.21.15.72:0/2953288713 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69640070d0 con 0x7f696809e930 2023-10-03T10:17:43.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.601+0000 7f695dffb700 1 -- 172.21.15.72:0/2953288713 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964007440 con 0x7f696809e930 2023-10-03T10:17:43.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.601+0000 7f696f6d2700 1 -- 172.21.15.72:0/2953288713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69681224e0 con 0x7f696809e930 2023-10-03T10:17:43.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.601+0000 7f696f6d2700 1 -- 172.21.15.72:0/2953288713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69680a2f40 con 0x7f696809e930 2023-10-03T10:17:43.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.601+0000 7f695dffb700 1 -- 172.21.15.72:0/2953288713 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f69640075a0 con 0x7f696809e930 2023-10-03T10:17:43.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.602+0000 7f695dffb700 1 -- 172.21.15.72:0/2953288713 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f696403eab0 con 0x7f696809e930 2023-10-03T10:17:43.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.602+0000 7f696f6d2700 1 -- 172.21.15.72:0/2953288713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6968071d20 con 0x7f696809e930 2023-10-03T10:17:43.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.611+0000 7f695dffb700 1 -- 172.21.15.72:0/2953288713 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6964017020 con 0x7f696809e930 2023-10-03T10:17:43.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.657+0000 7f7d87d32700 1 Processor -- start 2023-10-03T10:17:43.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.658+0000 7f7d87d32700 1 -- start start 2023-10-03T10:17:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.658+0000 7f7d87d32700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d8009d6f0 0x7f7d8009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.658+0000 7f7d87d32700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7d8009e410 0x7f7d80134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.658+0000 7f7d87d32700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8009b120 con 0x7f7d8009e000 2023-10-03T10:17:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.658+0000 7f7d87d32700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8006b460 con 0x7f7d8009e410 2023-10-03T10:17:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.658+0000 7f7d87d32700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8009a7e0 con 0x7f7d8009d6f0 2023-10-03T10:17:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.658+0000 7f7d852cd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7d8009e000 0x7f7d801339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41368/0 (socket says 172.21.15.72:41368) 2023-10-03T10:17:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.658+0000 7f7d852cd700 1 -- 172.21.15.72:0/1363777451 learned_addr learned my addr 172.21.15.72:0/1363777451 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.658+0000 7f7d85ace700 1 --2- 172.21.15.72:0/1363777451 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d8009d6f0 0x7f7d8009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.659+0000 7f7d862cf700 1 --2- 172.21.15.72:0/1363777451 >> v2:172.21.15.72:3300/0 conn(0x7f7d8009e410 0x7f7d80134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.659+0000 7f7d85ace700 1 -- 172.21.15.72:0/1363777451 >> v2:172.21.15.72:3300/0 conn(0x7f7d8009e410 msgr2=0x7f7d80134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.659+0000 7f7d85ace700 1 --2- 172.21.15.72:0/1363777451 >> v2:172.21.15.72:3300/0 conn(0x7f7d8009e410 0x7f7d80134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.659+0000 7f7d85ace700 1 -- 172.21.15.72:0/1363777451 >> v1:172.21.15.72:6789/0 conn(0x7f7d8009e000 legacy=0x7f7d801339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.659+0000 7f7d85ace700 1 -- 172.21.15.72:0/1363777451 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8009a500 con 0x7f7d8009d6f0 2023-10-03T10:17:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.659+0000 7f7d85ace700 1 --2- 172.21.15.72:0/1363777451 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d8009d6f0 0x7f7d8009dac0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009870 tx=0x7f7d7c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5fef26891c260d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.659+0000 7f7d84acc700 1 -- 172.21.15.72:0/1363777451 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c011830 con 0x7f7d8009d6f0 2023-10-03T10:17:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.659+0000 7f7d84acc700 1 -- 172.21.15.72:0/1363777451 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c011990 con 0x7f7d8009d6f0 2023-10-03T10:17:43.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.659+0000 7f7d84acc700 1 -- 172.21.15.72:0/1363777451 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c011d20 con 0x7f7d8009d6f0 2023-10-03T10:17:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.660+0000 7f7d87d32700 1 -- 172.21.15.72:0/1363777451 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d8009d6f0 msgr2=0x7f7d8009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.660+0000 7f7d87d32700 1 --2- 172.21.15.72:0/1363777451 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d8009d6f0 0x7f7d8009dac0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009870 tx=0x7f7d7c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.660+0000 7f7d87d32700 1 -- 172.21.15.72:0/1363777451 shutdown_connections 2023-10-03T10:17:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.660+0000 7f7d87d32700 1 --2- 172.21.15.72:0/1363777451 >> v2:172.21.15.72:3300/0 conn(0x7f7d8009e410 0x7f7d80134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.660+0000 7f7d87d32700 1 --2- 172.21.15.72:0/1363777451 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d8009d6f0 0x7f7d8009dac0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.660+0000 7f7d87d32700 1 -- 172.21.15.72:0/1363777451 >> 172.21.15.72:0/1363777451 conn(0x7f7d80066f50 msgr2=0x7f7d8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.660+0000 7f7d87d32700 1 -- 172.21.15.72:0/1363777451 shutdown_connections 2023-10-03T10:17:43.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.660+0000 7f7d87d32700 1 -- 172.21.15.72:0/1363777451 wait complete. 2023-10-03T10:17:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.661+0000 7f7d87d32700 1 Processor -- start 2023-10-03T10:17:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.661+0000 7f7d87d32700 1 -- start start 2023-10-03T10:17:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d87d32700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d8009d6f0 0x7f7d801a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d87d32700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d8009e000 0x7f7d801a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d87d32700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d8009e410 0x7f7d801a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d87d32700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d801a97f0 con 0x7f7d8009e410 2023-10-03T10:17:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d87d32700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d801a99f0 con 0x7f7d8009d6f0 2023-10-03T10:17:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d87d32700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d801a88e0 con 0x7f7d8009e000 2023-10-03T10:17:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d852cd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d8009e000 0x7f7d801a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d85ace700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d8009d6f0 0x7f7d801a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d852cd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d8009e000 0x7f7d801a64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59090/0 (socket says 172.21.15.72:59090) 2023-10-03T10:17:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d852cd700 1 -- 172.21.15.72:0/4146997755 learned_addr learned my addr 172.21.15.72:0/4146997755 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d862cf700 1 --2- 172.21.15.72:0/4146997755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d8009e410 0x7f7d801a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d85ace700 1 -- 172.21.15.72:0/4146997755 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d8009e000 msgr2=0x7f7d801a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d85ace700 1 --2- 172.21.15.72:0/4146997755 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d8009e000 0x7f7d801a64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d85ace700 1 -- 172.21.15.72:0/4146997755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d8009e410 msgr2=0x7f7d801a69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d85ace700 1 --2- 172.21.15.72:0/4146997755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d8009e410 0x7f7d801a69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d85ace700 1 -- 172.21.15.72:0/4146997755 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c0094a0 con 0x7f7d8009d6f0 2023-10-03T10:17:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.662+0000 7f7d852cd700 1 --2- 172.21.15.72:0/4146997755 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d8009e000 0x7f7d801a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:43.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.663+0000 7f7d85ace700 1 --2- 172.21.15.72:0/4146997755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d8009d6f0 0x7f7d801a5f60 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c016000 tx=0x7f7d7c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.663+0000 7f7d767fc700 1 -- 172.21.15.72:0/4146997755 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0036a0 con 0x7f7d8009d6f0 2023-10-03T10:17:43.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.663+0000 7f7d767fc700 1 -- 172.21.15.72:0/4146997755 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c01f070 con 0x7f7d8009d6f0 2023-10-03T10:17:43.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.663+0000 7f7d87d32700 1 -- 172.21.15.72:0/4146997755 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d801a7b80 con 0x7f7d8009d6f0 2023-10-03T10:17:43.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.663+0000 7f7d767fc700 1 -- 172.21.15.72:0/4146997755 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c003a20 con 0x7f7d8009d6f0 2023-10-03T10:17:43.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.663+0000 7f7d87d32700 1 -- 172.21.15.72:0/4146997755 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8009c710 con 0x7f7d8009d6f0 2023-10-03T10:17:43.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.664+0000 7f7d87d32700 1 -- 172.21.15.72:0/4146997755 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d80074ea0 con 0x7f7d8009d6f0 2023-10-03T10:17:43.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.664+0000 7f7d767fc700 1 -- 172.21.15.72:0/4146997755 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d7c003b80 con 0x7f7d8009d6f0 2023-10-03T10:17:43.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.664+0000 7f7d767fc700 1 -- 172.21.15.72:0/4146997755 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d7c021070 con 0x7f7d8009d6f0 2023-10-03T10:17:43.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.673+0000 7f7d767fc700 1 -- 172.21.15.72:0/4146997755 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d7c010b70 con 0x7f7d8009d6f0 2023-10-03T10:17:43.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.751+0000 7f49ab301700 1 -- 172.21.15.72:0/4092265391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f49a404ea50 con 0x7f49a4133a80 2023-10-03T10:17:43.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.751+0000 7f4999ffb700 1 -- 172.21.15.72:0/4092265391 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f49a000ce60 con 0x7f49a4133a80 2023-10-03T10:17:43.753 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.753+0000 7f49ab301700 1 -- 172.21.15.72:0/4092265391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4133a80 msgr2=0x7f49a409b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.753+0000 7f49ab301700 1 --2- 172.21.15.72:0/4092265391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4133a80 0x7f49a409b9e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f49a000c520 tx=0x7f49a000c830 comp rx=0 tx=0).stop 2023-10-03T10:17:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.753+0000 7f49ab301700 1 -- 172.21.15.72:0/4092265391 shutdown_connections 2023-10-03T10:17:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.753+0000 7f49ab301700 1 --2- 172.21.15.72:0/4092265391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49a4133a80 0x7f49a409b9e0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.753+0000 7f49ab301700 1 --2- 172.21.15.72:0/4092265391 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f49a4139140 0x7f49a41c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.753+0000 7f49ab301700 1 --2- 172.21.15.72:0/4092265391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49a4136820 0x7f49a409bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.753+0000 7f49ab301700 1 -- 172.21.15.72:0/4092265391 >> 172.21.15.72:0/4092265391 conn(0x7f49a40a4210 msgr2=0x7f49a40a0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.753+0000 7f49ab301700 1 -- 172.21.15.72:0/4092265391 shutdown_connections 2023-10-03T10:17:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.753+0000 7f49ab301700 1 -- 172.21.15.72:0/4092265391 wait complete. 2023-10-03T10:17:43.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:43.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.814+0000 7f696f6d2700 1 -- 172.21.15.72:0/2953288713 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6968074ea0 con 0x7f696809e930 2023-10-03T10:17:43.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.814+0000 7f695dffb700 1 -- 172.21.15.72:0/2953288713 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6964019b40 con 0x7f696809e930 2023-10-03T10:17:43.815 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:43.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.816+0000 7f696f6d2700 1 -- 172.21.15.72:0/2953288713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f696809e930 msgr2=0x7f696806c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.816+0000 7f696f6d2700 1 --2- 172.21.15.72:0/2953288713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f696809e930 0x7f696806c310 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f696400c550 tx=0x7f696400c860 comp rx=0 tx=0).stop 2023-10-03T10:17:43.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.816+0000 7f696f6d2700 1 -- 172.21.15.72:0/2953288713 shutdown_connections 2023-10-03T10:17:43.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.816+0000 7f696f6d2700 1 --2- 172.21.15.72:0/2953288713 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f696809e930 0x7f696806c310 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.816+0000 7f696f6d2700 1 --2- 172.21.15.72:0/2953288713 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6968136fe0 0x7f69681c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.816+0000 7f696f6d2700 1 --2- 172.21.15.72:0/2953288713 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f696809f410 0x7f696806c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.816+0000 7f696f6d2700 1 -- 172.21.15.72:0/2953288713 >> 172.21.15.72:0/2953288713 conn(0x7f69680a4210 msgr2=0x7f696809be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.816+0000 7f696f6d2700 1 -- 172.21.15.72:0/2953288713 shutdown_connections 2023-10-03T10:17:43.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.816+0000 7f696f6d2700 1 -- 172.21.15.72:0/2953288713 wait complete. 2023-10-03T10:17:43.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:43.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.868+0000 7f7d87d32700 1 -- 172.21.15.72:0/4146997755 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7d801a9610 con 0x7f7d8009d6f0 2023-10-03T10:17:43.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.869+0000 7f7d767fc700 1 -- 172.21.15.72:0/4146997755 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7d7c015030 con 0x7f7d8009d6f0 2023-10-03T10:17:43.869 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:43.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.871+0000 7f7d87d32700 1 -- 172.21.15.72:0/4146997755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d8009d6f0 msgr2=0x7f7d801a5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.871+0000 7f7d87d32700 1 --2- 172.21.15.72:0/4146997755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d8009d6f0 0x7f7d801a5f60 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c016000 tx=0x7f7d7c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:43.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.871+0000 7f7d87d32700 1 -- 172.21.15.72:0/4146997755 shutdown_connections 2023-10-03T10:17:43.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.871+0000 7f7d87d32700 1 --2- 172.21.15.72:0/4146997755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d8009e410 0x7f7d801a69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.871+0000 7f7d87d32700 1 --2- 172.21.15.72:0/4146997755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d8009d6f0 0x7f7d801a5f60 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.871+0000 7f7d87d32700 1 --2- 172.21.15.72:0/4146997755 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d8009e000 0x7f7d801a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.871+0000 7f7d87d32700 1 -- 172.21.15.72:0/4146997755 >> 172.21.15.72:0/4146997755 conn(0x7f7d80066f50 msgr2=0x7f7d801baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.871+0000 7f7d87d32700 1 -- 172.21.15.72:0/4146997755 shutdown_connections 2023-10-03T10:17:43.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:43.871+0000 7f7d87d32700 1 -- 172.21.15.72:0/4146997755 wait complete. 2023-10-03T10:17:43.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:44.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:44.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.148+0000 7f2d8c43b700 1 Processor -- start 2023-10-03T10:17:44.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.148+0000 7f2d8c43b700 1 -- start start 2023-10-03T10:17:44.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.148+0000 7f2d8c43b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d8409e1d0 0x7f2d84138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.148+0000 7f2d8c43b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d84139170 0x7f2d8413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.148+0000 7f2d8c43b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8409b120 con 0x7f2d8409d6f0 2023-10-03T10:17:44.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.148+0000 7f2d8c43b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8406b460 con 0x7f2d84139170 2023-10-03T10:17:44.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.148+0000 7f2d8c43b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8409a7e0 con 0x7f2d8409e1d0 2023-10-03T10:17:44.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.148+0000 7f2d899d6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d8409e1d0 0x7f2d84138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.148+0000 7f2d8a1d7700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2d8409d6f0 0x7f2d8409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41370/0 (socket says 172.21.15.72:41370) 2023-10-03T10:17:44.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.148+0000 7f2d8a9d8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d84139170 0x7f2d8413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.148+0000 7f2d8a1d7700 1 -- 172.21.15.72:0/661698745 learned_addr learned my addr 172.21.15.72:0/661698745 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:44.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.149+0000 7f2d8a9d8700 1 -- 172.21.15.72:0/661698745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d8409e1d0 msgr2=0x7f2d84138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.149+0000 7f2d8a9d8700 1 --2- 172.21.15.72:0/661698745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d8409e1d0 0x7f2d84138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.149+0000 7f2d8a9d8700 1 -- 172.21.15.72:0/661698745 >> v1:172.21.15.72:6789/0 conn(0x7f2d8409d6f0 legacy=0x7f2d8409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.149+0000 7f2d891d5700 1 -- 172.21.15.72:0/661698745 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478685999 0 0) 0x7f2d8409b120 con 0x7f2d8409d6f0 2023-10-03T10:17:44.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.149+0000 7f2d8a9d8700 1 -- 172.21.15.72:0/661698745 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8409a500 con 0x7f2d84139170 2023-10-03T10:17:44.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.149+0000 7f2d899d6700 1 --2- 172.21.15.72:0/661698745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d8409e1d0 0x7f2d84138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.149+0000 7f2d8a9d8700 1 --2- 172.21.15.72:0/661698745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d84139170 0x7f2d8413b550 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009dc0 tx=0x7f2d7c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a435da78865f85f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.149+0000 7f2d891d5700 1 -- 172.21.15.72:0/661698745 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c00e070 con 0x7f2d84139170 2023-10-03T10:17:44.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.149+0000 7f2d891d5700 1 -- 172.21.15.72:0/661698745 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c00bb20 con 0x7f2d84139170 2023-10-03T10:17:44.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.149+0000 7f2d891d5700 1 -- 172.21.15.72:0/661698745 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c012430 con 0x7f2d84139170 2023-10-03T10:17:44.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.150+0000 7f2d8c43b700 1 -- 172.21.15.72:0/661698745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d84139170 msgr2=0x7f2d8413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.150+0000 7f2d8c43b700 1 --2- 172.21.15.72:0/661698745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d84139170 0x7f2d8413b550 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009dc0 tx=0x7f2d7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:44.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.150+0000 7f2d8c43b700 1 -- 172.21.15.72:0/661698745 shutdown_connections 2023-10-03T10:17:44.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.150+0000 7f2d8c43b700 1 --2- 172.21.15.72:0/661698745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d84139170 0x7f2d8413b550 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.150+0000 7f2d8c43b700 1 --2- 172.21.15.72:0/661698745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d8409e1d0 0x7f2d84138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.150+0000 7f2d8c43b700 1 -- 172.21.15.72:0/661698745 >> 172.21.15.72:0/661698745 conn(0x7f2d84066f50 msgr2=0x7f2d8409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.150+0000 7f2d8c43b700 1 -- 172.21.15.72:0/661698745 shutdown_connections 2023-10-03T10:17:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.150+0000 7f2d8c43b700 1 -- 172.21.15.72:0/661698745 wait complete. 2023-10-03T10:17:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.151+0000 7f2d8c43b700 1 Processor -- start 2023-10-03T10:17:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.151+0000 7f2d8c43b700 1 -- start start 2023-10-03T10:17:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.151+0000 7f2d8c43b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d8409d6f0 0x7f2d841205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.151+0000 7f2d8c43b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d8409e1d0 0x7f2d84120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.151+0000 7f2d8c43b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d84139170 0x7f2d84121060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.151+0000 7f2d8c43b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84123e90 con 0x7f2d84139170 2023-10-03T10:17:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.151+0000 7f2d8c43b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84122290 con 0x7f2d8409e1d0 2023-10-03T10:17:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.151+0000 7f2d8c43b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8409c710 con 0x7f2d8409d6f0 2023-10-03T10:17:44.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.151+0000 7f2d8a9d8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d84139170 0x7f2d84121060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.151+0000 7f2d899d6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d8409e1d0 0x7f2d84120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.151+0000 7f2d8a9d8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d84139170 0x7f2d84121060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41044/0 (socket says 172.21.15.72:41044) 2023-10-03T10:17:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.151+0000 7f2d899d6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d8409e1d0 0x7f2d84120b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39778/0 (socket says 172.21.15.72:39778) 2023-10-03T10:17:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.151+0000 7f2d8a9d8700 1 -- 172.21.15.72:0/378270657 learned_addr learned my addr 172.21.15.72:0/378270657 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.151+0000 7f2d8a1d7700 1 --2- 172.21.15.72:0/378270657 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d8409d6f0 0x7f2d841205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.152+0000 7f2d8a9d8700 1 -- 172.21.15.72:0/378270657 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d8409d6f0 msgr2=0x7f2d841205e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.152+0000 7f2d8a9d8700 1 --2- 172.21.15.72:0/378270657 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d8409d6f0 0x7f2d841205e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.152+0000 7f2d8a9d8700 1 -- 172.21.15.72:0/378270657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d8409e1d0 msgr2=0x7f2d84120b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.152+0000 7f2d8a9d8700 1 --2- 172.21.15.72:0/378270657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d8409e1d0 0x7f2d84120b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.152+0000 7f2d8a9d8700 1 -- 172.21.15.72:0/378270657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740094a0 con 0x7f2d84139170 2023-10-03T10:17:44.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.152+0000 7f2d899d6700 1 --2- 172.21.15.72:0/378270657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d8409e1d0 0x7f2d84120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.152+0000 7f2d8a9d8700 1 --2- 172.21.15.72:0/378270657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d84139170 0x7f2d84121060 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00b680 tx=0x7f2d7c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.152+0000 7f2d7affd700 1 -- 172.21.15.72:0/378270657 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c012430 con 0x7f2d84139170 2023-10-03T10:17:44.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.152+0000 7f2d7affd700 1 -- 172.21.15.72:0/378270657 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c020070 con 0x7f2d84139170 2023-10-03T10:17:44.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.152+0000 7f2d8c43b700 1 -- 172.21.15.72:0/378270657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7c009a70 con 0x7f2d84139170 2023-10-03T10:17:44.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.152+0000 7f2d7affd700 1 -- 172.21.15.72:0/378270657 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c004280 con 0x7f2d84139170 2023-10-03T10:17:44.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.152+0000 7f2d8c43b700 1 -- 172.21.15.72:0/378270657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d84072040 con 0x7f2d84139170 2023-10-03T10:17:44.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.153+0000 7f2d7affd700 1 -- 172.21.15.72:0/378270657 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d7c0043e0 con 0x7f2d84139170 2023-10-03T10:17:44.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.153+0000 7f2d7affd700 1 -- 172.21.15.72:0/378270657 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2d7c022070 con 0x7f2d84139170 2023-10-03T10:17:44.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.153+0000 7f2d8c43b700 1 -- 172.21.15.72:0/378270657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d84074ea0 con 0x7f2d84139170 2023-10-03T10:17:44.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.157+0000 7f2d7affd700 1 -- 172.21.15.72:0/378270657 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d7c01a380 con 0x7f2d84139170 2023-10-03T10:17:44.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.342+0000 7f2d8c43b700 1 -- 172.21.15.72:0/378270657 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2d84124880 con 0x7f2d84139170 2023-10-03T10:17:44.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.342+0000 7f2d7affd700 1 -- 172.21.15.72:0/378270657 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d7c035090 con 0x7f2d84139170 2023-10-03T10:17:44.343 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:44.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.344+0000 7f2d8c43b700 1 -- 172.21.15.72:0/378270657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d84139170 msgr2=0x7f2d84121060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.344+0000 7f2d8c43b700 1 --2- 172.21.15.72:0/378270657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d84139170 0x7f2d84121060 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00b680 tx=0x7f2d7c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.344+0000 7f2d8c43b700 1 -- 172.21.15.72:0/378270657 shutdown_connections 2023-10-03T10:17:44.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.344+0000 7f2d8c43b700 1 --2- 172.21.15.72:0/378270657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d84139170 0x7f2d84121060 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.344+0000 7f2d8c43b700 1 --2- 172.21.15.72:0/378270657 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2d8409d6f0 0x7f2d841205e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.344+0000 7f2d8c43b700 1 --2- 172.21.15.72:0/378270657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d8409e1d0 0x7f2d84120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.344+0000 7f2d8c43b700 1 -- 172.21.15.72:0/378270657 >> 172.21.15.72:0/378270657 conn(0x7f2d84066f50 msgr2=0x7f2d84136a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.344+0000 7f2d8c43b700 1 -- 172.21.15.72:0/378270657 shutdown_connections 2023-10-03T10:17:44.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.344+0000 7f2d8c43b700 1 -- 172.21.15.72:0/378270657 wait complete. 2023-10-03T10:17:44.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:44.767 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:44.830 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:44.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:44.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.891+0000 7f035b3f7700 1 Processor -- start 2023-10-03T10:17:44.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.892+0000 7f035b3f7700 1 -- start start 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.892+0000 7f035b3f7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f035409d6f0 0x7f035409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.892+0000 7f035b3f7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f035409e000 0x7f0354130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.892+0000 7f035b3f7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f035409e410 0x7f0354130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.892+0000 7f035b3f7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f035409f520 con 0x7f035409e410 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.892+0000 7f035b3f7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035409f130 con 0x7f035409d6f0 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.892+0000 7f035b3f7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f035409e930 con 0x7f035409e000 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.892+0000 7f0359193700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f035409d6f0 0x7f035409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.892+0000 7f0359193700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f035409d6f0 0x7f035409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39788/0 (socket says 172.21.15.72:39788) 2023-10-03T10:17:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.892+0000 7f0359193700 1 -- 172.21.15.72:0/250410323 learned_addr learned my addr 172.21.15.72:0/250410323 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.892+0000 7f0359994700 1 --2- 172.21.15.72:0/250410323 >> v2:172.21.15.72:3300/0 conn(0x7f035409e410 0x7f0354130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.892+0000 7f0358992700 1 --2- 172.21.15.72:0/250410323 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f035409e000 0x7f0354130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.893+0000 7f0359994700 1 -- 172.21.15.72:0/250410323 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f035409e000 msgr2=0x7f0354130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.893+0000 7f0359994700 1 --2- 172.21.15.72:0/250410323 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f035409e000 0x7f0354130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.893+0000 7f0359994700 1 -- 172.21.15.72:0/250410323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f035409d6f0 msgr2=0x7f035409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.893+0000 7f0359994700 1 --2- 172.21.15.72:0/250410323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f035409d6f0 0x7f035409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.893+0000 7f0359994700 1 -- 172.21.15.72:0/250410323 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035409b2d0 con 0x7f035409e410 2023-10-03T10:17:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.893+0000 7f0359193700 1 --2- 172.21.15.72:0/250410323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f035409d6f0 0x7f035409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.893+0000 7f0359994700 1 --2- 172.21.15.72:0/250410323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f035409e410 0x7f0354130ba0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f034c009d90 tx=0x7f034c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8ca3f8e4909055 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.893+0000 7f034bfff700 1 -- 172.21.15.72:0/250410323 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c00e070 con 0x7f035409e410 2023-10-03T10:17:44.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.893+0000 7f034bfff700 1 -- 172.21.15.72:0/250410323 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c00bb20 con 0x7f035409e410 2023-10-03T10:17:44.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.893+0000 7f034bfff700 1 -- 172.21.15.72:0/250410323 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c012430 con 0x7f035409e410 2023-10-03T10:17:44.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.894+0000 7f035b3f7700 1 -- 172.21.15.72:0/250410323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f035409e410 msgr2=0x7f0354130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.894+0000 7f035b3f7700 1 --2- 172.21.15.72:0/250410323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f035409e410 0x7f0354130ba0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f034c009d90 tx=0x7f034c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:44.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.894+0000 7f035b3f7700 1 -- 172.21.15.72:0/250410323 shutdown_connections 2023-10-03T10:17:44.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.894+0000 7f035b3f7700 1 --2- 172.21.15.72:0/250410323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f035409e410 0x7f0354130ba0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.894+0000 7f035b3f7700 1 --2- 172.21.15.72:0/250410323 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f035409d6f0 0x7f035409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.894+0000 7f035b3f7700 1 --2- 172.21.15.72:0/250410323 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f035409e000 0x7f0354130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.894+0000 7f035b3f7700 1 -- 172.21.15.72:0/250410323 >> 172.21.15.72:0/250410323 conn(0x7f0354066f50 msgr2=0x7f035409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.894+0000 7f035b3f7700 1 -- 172.21.15.72:0/250410323 shutdown_connections 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.894+0000 7f035b3f7700 1 -- 172.21.15.72:0/250410323 wait complete. 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.896+0000 7f035b3f7700 1 Processor -- start 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.896+0000 7f035b3f7700 1 -- start start 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.896+0000 7f035b3f7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f035409d6f0 0x7f03541225d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.896+0000 7f035b3f7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f035409e000 0x7f0354122b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.896+0000 7f035b3f7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f035409e410 0x7f0354123050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.896+0000 7f035b3f7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0354125b50 con 0x7f035409e000 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.896+0000 7f035b3f7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0354125ef0 con 0x7f035409d6f0 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.896+0000 7f035b3f7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03541260f0 con 0x7f035409e410 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.896+0000 7f0358992700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f035409e000 0x7f0354122b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.896+0000 7f0358992700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f035409e000 0x7f0354122b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41054/0 (socket says 172.21.15.72:41054) 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.896+0000 7f0359994700 1 --2- 172.21.15.72:0/553504047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f035409e410 0x7f0354123050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.896+0000 7f0358992700 1 -- 172.21.15.72:0/553504047 learned_addr learned my addr 172.21.15.72:0/553504047 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.897+0000 7f0359193700 1 --2- 172.21.15.72:0/553504047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f035409d6f0 0x7f03541225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.897+0000 7f0359994700 1 -- 172.21.15.72:0/553504047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f035409d6f0 msgr2=0x7f03541225d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.897+0000 7f0359994700 1 --2- 172.21.15.72:0/553504047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f035409d6f0 0x7f03541225d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.897+0000 7f0359994700 1 -- 172.21.15.72:0/553504047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f035409e000 msgr2=0x7f0354122b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.897+0000 7f0359994700 1 --2- 172.21.15.72:0/553504047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f035409e000 0x7f0354122b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.897+0000 7f0359994700 1 -- 172.21.15.72:0/553504047 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035000b7f0 con 0x7f035409e410 2023-10-03T10:17:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.897+0000 7f0358992700 1 --2- 172.21.15.72:0/553504047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f035409e000 0x7f0354122b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.897+0000 7f0359994700 1 --2- 172.21.15.72:0/553504047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f035409e410 0x7f0354123050 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f034c016000 tx=0x7f034c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.897+0000 7f0349ffb700 1 -- 172.21.15.72:0/553504047 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c0048f0 con 0x7f035409e410 2023-10-03T10:17:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.897+0000 7f0349ffb700 1 -- 172.21.15.72:0/553504047 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c020070 con 0x7f035409e410 2023-10-03T10:17:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.897+0000 7f035b3f7700 1 -- 172.21.15.72:0/553504047 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034c009a70 con 0x7f035409e410 2023-10-03T10:17:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.897+0000 7f0349ffb700 1 -- 172.21.15.72:0/553504047 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c0276c0 con 0x7f035409e410 2023-10-03T10:17:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.898+0000 7f035b3f7700 1 -- 172.21.15.72:0/553504047 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035409c700 con 0x7f035409e410 2023-10-03T10:17:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.898+0000 7f0349ffb700 1 -- 172.21.15.72:0/553504047 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f034c012430 con 0x7f035409e410 2023-10-03T10:17:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.898+0000 7f0349ffb700 1 -- 172.21.15.72:0/553504047 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f034c022070 con 0x7f035409e410 2023-10-03T10:17:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.899+0000 7f035b3f7700 1 -- 172.21.15.72:0/553504047 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0354125d20 con 0x7f035409e410 2023-10-03T10:17:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.904+0000 7f0349ffb700 1 -- 172.21.15.72:0/553504047 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f034c01b400 con 0x7f035409e410 2023-10-03T10:17:44.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.968+0000 7f7a745a4700 1 Processor -- start 2023-10-03T10:17:44.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.968+0000 7f7a745a4700 1 -- start start 2023-10-03T10:17:44.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.969+0000 7f7a745a4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6c09c650 0x7f7a6c09ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.969+0000 7f7a745a4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6c0a0090 0x7f7a6c09cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.969+0000 7f7a745a4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a6c131970 0x7f7a6c131e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.969+0000 7f7a745a4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a6c09ba70 con 0x7f7a6c131970 2023-10-03T10:17:44.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.969+0000 7f7a745a4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c09d4a0 con 0x7f7a6c0a0090 2023-10-03T10:17:44.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.969+0000 7f7a745a4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c09e8f0 con 0x7f7a6c09c650 2023-10-03T10:17:44.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.969+0000 7f7a72340700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6c09c650 0x7f7a6c09ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.969+0000 7f7a71b3f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6c0a0090 0x7f7a6c09cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.969+0000 7f7a72340700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6c09c650 0x7f7a6c09ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59138/0 (socket says 172.21.15.72:59138) 2023-10-03T10:17:44.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.969+0000 7f7a72340700 1 -- 172.21.15.72:0/1578292229 learned_addr learned my addr 172.21.15.72:0/1578292229 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:44.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.969+0000 7f7a72b41700 1 --2- 172.21.15.72:0/1578292229 >> v2:172.21.15.72:3300/0 conn(0x7f7a6c131970 0x7f7a6c131e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.970+0000 7f7a71b3f700 1 -- 172.21.15.72:0/1578292229 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6c09c650 msgr2=0x7f7a6c09ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.970+0000 7f7a71b3f700 1 --2- 172.21.15.72:0/1578292229 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6c09c650 0x7f7a6c09ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.970+0000 7f7a71b3f700 1 -- 172.21.15.72:0/1578292229 >> v2:172.21.15.72:3300/0 conn(0x7f7a6c131970 msgr2=0x7f7a6c131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.970+0000 7f7a71b3f700 1 --2- 172.21.15.72:0/1578292229 >> v2:172.21.15.72:3300/0 conn(0x7f7a6c131970 0x7f7a6c131e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.970+0000 7f7a71b3f700 1 -- 172.21.15.72:0/1578292229 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6c0a0760 con 0x7f7a6c0a0090 2023-10-03T10:17:44.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.970+0000 7f7a71b3f700 1 --2- 172.21.15.72:0/1578292229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6c0a0090 0x7f7a6c09cf60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009870 tx=0x7f7a5c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9523b670e2b0f430 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.970+0000 7f7a7133e700 1 -- 172.21.15.72:0/1578292229 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c011830 con 0x7f7a6c0a0090 2023-10-03T10:17:44.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.970+0000 7f7a7133e700 1 -- 172.21.15.72:0/1578292229 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c011990 con 0x7f7a6c0a0090 2023-10-03T10:17:44.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.970+0000 7f7a7133e700 1 -- 172.21.15.72:0/1578292229 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c011d20 con 0x7f7a6c0a0090 2023-10-03T10:17:44.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.971+0000 7f7a745a4700 1 -- 172.21.15.72:0/1578292229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6c0a0090 msgr2=0x7f7a6c09cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.971+0000 7f7a745a4700 1 --2- 172.21.15.72:0/1578292229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6c0a0090 0x7f7a6c09cf60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009870 tx=0x7f7a5c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:44.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.971+0000 7f7a745a4700 1 -- 172.21.15.72:0/1578292229 shutdown_connections 2023-10-03T10:17:44.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.971+0000 7f7a745a4700 1 --2- 172.21.15.72:0/1578292229 >> v2:172.21.15.72:3300/0 conn(0x7f7a6c131970 0x7f7a6c131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.971+0000 7f7a745a4700 1 --2- 172.21.15.72:0/1578292229 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6c09c650 0x7f7a6c09ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.971+0000 7f7a745a4700 1 --2- 172.21.15.72:0/1578292229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6c0a0090 0x7f7a6c09cf60 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.971+0000 7f7a745a4700 1 -- 172.21.15.72:0/1578292229 >> 172.21.15.72:0/1578292229 conn(0x7f7a6c0a3f70 msgr2=0x7f7a6c0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.971+0000 7f7a745a4700 1 -- 172.21.15.72:0/1578292229 shutdown_connections 2023-10-03T10:17:44.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.971+0000 7f7a745a4700 1 -- 172.21.15.72:0/1578292229 wait complete. 2023-10-03T10:17:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.972+0000 7f7a745a4700 1 Processor -- start 2023-10-03T10:17:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.972+0000 7f7a745a4700 1 -- start start 2023-10-03T10:17:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.972+0000 7f7a745a4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6c09c650 0x7f7a6c11a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.972+0000 7f7a745a4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6c0a0090 0x7f7a6c11ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.972+0000 7f7a745a4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6c131970 0x7f7a6c11b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.972+0000 7f7a745a4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c0724b0 con 0x7f7a6c09c650 2023-10-03T10:17:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.972+0000 7f7a745a4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c11c020 con 0x7f7a6c0a0090 2023-10-03T10:17:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.972+0000 7f7a745a4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6c11e2b0 con 0x7f7a6c131970 2023-10-03T10:17:44.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.972+0000 7f7a71b3f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6c0a0090 0x7f7a6c11ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.972+0000 7f7a72b41700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6c131970 0x7f7a6c11b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.972+0000 7f7a71b3f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6c0a0090 0x7f7a6c11ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39828/0 (socket says 172.21.15.72:39828) 2023-10-03T10:17:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.972+0000 7f7a72b41700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6c131970 0x7f7a6c11b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59144/0 (socket says 172.21.15.72:59144) 2023-10-03T10:17:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.972+0000 7f7a71b3f700 1 -- 172.21.15.72:0/4034090155 learned_addr learned my addr 172.21.15.72:0/4034090155 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.972+0000 7f7a72340700 1 --2- 172.21.15.72:0/4034090155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6c09c650 0x7f7a6c11a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.973+0000 7f7a72b41700 1 -- 172.21.15.72:0/4034090155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6c0a0090 msgr2=0x7f7a6c11ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.973+0000 7f7a72b41700 1 --2- 172.21.15.72:0/4034090155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6c0a0090 0x7f7a6c11ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.973+0000 7f7a72b41700 1 -- 172.21.15.72:0/4034090155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6c09c650 msgr2=0x7f7a6c11a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.973+0000 7f7a72b41700 1 --2- 172.21.15.72:0/4034090155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6c09c650 0x7f7a6c11a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.973+0000 7f7a72b41700 1 -- 172.21.15.72:0/4034090155 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c0094a0 con 0x7f7a6c131970 2023-10-03T10:17:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.973+0000 7f7a71b3f700 1 --2- 172.21.15.72:0/4034090155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6c0a0090 0x7f7a6c11ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.973+0000 7f7a72340700 1 --2- 172.21.15.72:0/4034090155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6c09c650 0x7f7a6c11a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.973+0000 7f7a72b41700 1 --2- 172.21.15.72:0/4034090155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6c131970 0x7f7a6c11b0a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400efc0 tx=0x7f7a6400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.973+0000 7f7a62ffd700 1 -- 172.21.15.72:0/4034090155 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6400cc90 con 0x7f7a6c131970 2023-10-03T10:17:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.973+0000 7f7a62ffd700 1 -- 172.21.15.72:0/4034090155 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6400f040 con 0x7f7a6c131970 2023-10-03T10:17:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.973+0000 7f7a745a4700 1 -- 172.21.15.72:0/4034090155 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a6c130010 con 0x7f7a6c131970 2023-10-03T10:17:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.973+0000 7f7a62ffd700 1 -- 172.21.15.72:0/4034090155 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a640146c0 con 0x7f7a6c131970 2023-10-03T10:17:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.973+0000 7f7a745a4700 1 -- 172.21.15.72:0/4034090155 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a6c11cc30 con 0x7f7a6c131970 2023-10-03T10:17:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.974+0000 7f7a62ffd700 1 -- 172.21.15.72:0/4034090155 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a64014820 con 0x7f7a6c131970 2023-10-03T10:17:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.974+0000 7f7a745a4700 1 -- 172.21.15.72:0/4034090155 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a6c0747f0 con 0x7f7a6c131970 2023-10-03T10:17:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.974+0000 7f7a62ffd700 1 -- 172.21.15.72:0/4034090155 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7a64040270 con 0x7f7a6c131970 2023-10-03T10:17:44.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:44.979+0000 7f7a62ffd700 1 -- 172.21.15.72:0/4034090155 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a6401d400 con 0x7f7a6c131970 2023-10-03T10:17:45.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.010+0000 7f069dbcf700 1 Processor -- start 2023-10-03T10:17:45.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.010+0000 7f069dbcf700 1 -- start start 2023-10-03T10:17:45.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f069dbcf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f069809e1d0 0x7f0698135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f069dbcf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0698135e50 0x7f0698138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f069dbcf700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069809f130 con 0x7f069809d6f0 2023-10-03T10:17:45.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f069dbcf700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069809f520 con 0x7f0698135e50 2023-10-03T10:17:45.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f069dbcf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f069809e930 con 0x7f069809e1d0 2023-10-03T10:17:45.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f0697fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0698135e50 0x7f0698138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f0696ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f069809e1d0 0x7f0698135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f06977fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f069809d6f0 0x7f069809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41374/0 (socket says 172.21.15.72:41374) 2023-10-03T10:17:45.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f06977fe700 1 -- 172.21.15.72:0/2914338223 learned_addr learned my addr 172.21.15.72:0/2914338223 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:45.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f0697fff700 1 -- 172.21.15.72:0/2914338223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f069809e1d0 msgr2=0x7f0698135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f0697fff700 1 --2- 172.21.15.72:0/2914338223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f069809e1d0 0x7f0698135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f0697fff700 1 -- 172.21.15.72:0/2914338223 >> v1:172.21.15.72:6789/0 conn(0x7f069809d6f0 legacy=0x7f069809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f06967fc700 1 -- 172.21.15.72:0/2914338223 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883786973 0 0) 0x7f069809f130 con 0x7f069809d6f0 2023-10-03T10:17:45.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f0697fff700 1 -- 172.21.15.72:0/2914338223 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069809b2d0 con 0x7f0698135e50 2023-10-03T10:17:45.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f0697fff700 1 --2- 172.21.15.72:0/2914338223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0698135e50 0x7f0698138230 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f0690009dc0 tx=0x7f069000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2448d79ec36517d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f06967fc700 1 -- 172.21.15.72:0/2914338223 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069000e070 con 0x7f0698135e50 2023-10-03T10:17:45.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.011+0000 7f06967fc700 1 -- 172.21.15.72:0/2914338223 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069000bae0 con 0x7f0698135e50 2023-10-03T10:17:45.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.012+0000 7f06967fc700 1 -- 172.21.15.72:0/2914338223 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069000be90 con 0x7f0698135e50 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.012+0000 7f069dbcf700 1 -- 172.21.15.72:0/2914338223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0698135e50 msgr2=0x7f0698138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.012+0000 7f069dbcf700 1 --2- 172.21.15.72:0/2914338223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0698135e50 0x7f0698138230 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f0690009dc0 tx=0x7f069000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.012+0000 7f069dbcf700 1 -- 172.21.15.72:0/2914338223 shutdown_connections 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.012+0000 7f069dbcf700 1 --2- 172.21.15.72:0/2914338223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0698135e50 0x7f0698138230 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.012+0000 7f069dbcf700 1 --2- 172.21.15.72:0/2914338223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f069809e1d0 0x7f0698135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.012+0000 7f069dbcf700 1 -- 172.21.15.72:0/2914338223 >> 172.21.15.72:0/2914338223 conn(0x7f0698066f50 msgr2=0x7f069809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.012+0000 7f069dbcf700 1 -- 172.21.15.72:0/2914338223 shutdown_connections 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.012+0000 7f069dbcf700 1 -- 172.21.15.72:0/2914338223 wait complete. 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.013+0000 7f069dbcf700 1 Processor -- start 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f069dbcf700 1 -- start start 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f069dbcf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f069809d6f0 0x7f06981c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f069dbcf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f069809e1d0 0x7f06981c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f069dbcf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0698135e50 0x7f069806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f069dbcf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0698122ea0 con 0x7f0698135e50 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f069dbcf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06981c8fb0 con 0x7f069809e1d0 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f069dbcf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0698123080 con 0x7f069809d6f0 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f0696ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f069809e1d0 0x7f06981c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f0696ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f069809e1d0 0x7f06981c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39838/0 (socket says 172.21.15.72:39838) 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f0696ffd700 1 -- 172.21.15.72:0/3095777354 learned_addr learned my addr 172.21.15.72:0/3095777354 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f06977fe700 1 --2- 172.21.15.72:0/3095777354 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f069809d6f0 0x7f06981c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f0697fff700 1 --2- 172.21.15.72:0/3095777354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0698135e50 0x7f069806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f0696ffd700 1 -- 172.21.15.72:0/3095777354 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f069809d6f0 msgr2=0x7f06981c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f0696ffd700 1 --2- 172.21.15.72:0/3095777354 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f069809d6f0 0x7f06981c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f0696ffd700 1 -- 172.21.15.72:0/3095777354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0698135e50 msgr2=0x7f069806e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f0696ffd700 1 --2- 172.21.15.72:0/3095777354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0698135e50 0x7f069806e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.014+0000 7f0696ffd700 1 -- 172.21.15.72:0/3095777354 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0690009a70 con 0x7f069809e1d0 2023-10-03T10:17:45.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.015+0000 7f0696ffd700 1 --2- 172.21.15.72:0/3095777354 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f069809e1d0 0x7f06981c8a70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f068c00e9b0 tx=0x7f068c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.015+0000 7f067ffff700 1 -- 172.21.15.72:0/3095777354 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c009710 con 0x7f069809e1d0 2023-10-03T10:17:45.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.015+0000 7f067ffff700 1 -- 172.21.15.72:0/3095777354 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c00ee50 con 0x7f069809e1d0 2023-10-03T10:17:45.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.015+0000 7f067ffff700 1 -- 172.21.15.72:0/3095777354 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c00ca50 con 0x7f069809e1d0 2023-10-03T10:17:45.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.015+0000 7f069dbcf700 1 -- 172.21.15.72:0/3095777354 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06981baf30 con 0x7f069809e1d0 2023-10-03T10:17:45.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.015+0000 7f069dbcf700 1 -- 172.21.15.72:0/3095777354 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06980a1b80 con 0x7f069809e1d0 2023-10-03T10:17:45.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.016+0000 7f069dbcf700 1 -- 172.21.15.72:0/3095777354 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0698074ea0 con 0x7f069809e1d0 2023-10-03T10:17:45.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.016+0000 7f067ffff700 1 -- 172.21.15.72:0/3095777354 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f068c00cbb0 con 0x7f069809e1d0 2023-10-03T10:17:45.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.016+0000 7f067ffff700 1 -- 172.21.15.72:0/3095777354 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f068c03f6e0 con 0x7f069809e1d0 2023-10-03T10:17:45.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.025+0000 7f067ffff700 1 -- 172.21.15.72:0/3095777354 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f068c0232f0 con 0x7f069809e1d0 2023-10-03T10:17:45.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.115+0000 7f035b3f7700 1 -- 172.21.15.72:0/553504047 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0354074ea0 con 0x7f035409e410 2023-10-03T10:17:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.115+0000 7f0349ffb700 1 -- 172.21.15.72:0/553504047 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f034c01a380 con 0x7f035409e410 2023-10-03T10:17:45.116 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:45.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.117+0000 7f035b3f7700 1 -- 172.21.15.72:0/553504047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f035409e410 msgr2=0x7f0354123050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.117+0000 7f035b3f7700 1 --2- 172.21.15.72:0/553504047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f035409e410 0x7f0354123050 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f034c016000 tx=0x7f034c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.117+0000 7f035b3f7700 1 -- 172.21.15.72:0/553504047 shutdown_connections 2023-10-03T10:17:45.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.117+0000 7f035b3f7700 1 --2- 172.21.15.72:0/553504047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f035409e410 0x7f0354123050 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.117+0000 7f035b3f7700 1 --2- 172.21.15.72:0/553504047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f035409d6f0 0x7f03541225d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.117+0000 7f035b3f7700 1 --2- 172.21.15.72:0/553504047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f035409e000 0x7f0354122b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.118+0000 7f035b3f7700 1 -- 172.21.15.72:0/553504047 >> 172.21.15.72:0/553504047 conn(0x7f0354066f50 msgr2=0x7f03540a1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.118+0000 7f035b3f7700 1 -- 172.21.15.72:0/553504047 shutdown_connections 2023-10-03T10:17:45.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.118+0000 7f035b3f7700 1 -- 172.21.15.72:0/553504047 wait complete. 2023-10-03T10:17:45.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:45.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.180+0000 7f7a745a4700 1 -- 172.21.15.72:0/4034090155 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7a6c11ba00 con 0x7f7a6c131970 2023-10-03T10:17:45.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.180+0000 7f7a62ffd700 1 -- 172.21.15.72:0/4034090155 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a6403e020 con 0x7f7a6c131970 2023-10-03T10:17:45.181 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:45.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.182+0000 7f7a745a4700 1 -- 172.21.15.72:0/4034090155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6c131970 msgr2=0x7f7a6c11b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.182+0000 7f7a745a4700 1 --2- 172.21.15.72:0/4034090155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6c131970 0x7f7a6c11b0a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400efc0 tx=0x7f7a6400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.182+0000 7f7a745a4700 1 -- 172.21.15.72:0/4034090155 shutdown_connections 2023-10-03T10:17:45.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.182+0000 7f7a745a4700 1 --2- 172.21.15.72:0/4034090155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a6c09c650 0x7f7a6c11a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.182+0000 7f7a745a4700 1 --2- 172.21.15.72:0/4034090155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a6c131970 0x7f7a6c11b0a0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.182+0000 7f7a745a4700 1 --2- 172.21.15.72:0/4034090155 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a6c0a0090 0x7f7a6c11ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.182+0000 7f7a745a4700 1 -- 172.21.15.72:0/4034090155 >> 172.21.15.72:0/4034090155 conn(0x7f7a6c0a3f70 msgr2=0x7f7a6c12ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.182+0000 7f7a745a4700 1 -- 172.21.15.72:0/4034090155 shutdown_connections 2023-10-03T10:17:45.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.182+0000 7f7a745a4700 1 -- 172.21.15.72:0/4034090155 wait complete. 2023-10-03T10:17:45.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:45.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.218+0000 7f069dbcf700 1 -- 172.21.15.72:0/3095777354 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0698070480 con 0x7f069809e1d0 2023-10-03T10:17:45.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.218+0000 7f067ffff700 1 -- 172.21.15.72:0/3095777354 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f068c01ae80 con 0x7f069809e1d0 2023-10-03T10:17:45.219 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:45.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.220+0000 7f069dbcf700 1 -- 172.21.15.72:0/3095777354 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f069809e1d0 msgr2=0x7f06981c8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.220+0000 7f069dbcf700 1 --2- 172.21.15.72:0/3095777354 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f069809e1d0 0x7f06981c8a70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f068c00e9b0 tx=0x7f068c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.220+0000 7f069dbcf700 1 -- 172.21.15.72:0/3095777354 shutdown_connections 2023-10-03T10:17:45.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.220+0000 7f069dbcf700 1 --2- 172.21.15.72:0/3095777354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0698135e50 0x7f069806e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.220+0000 7f069dbcf700 1 --2- 172.21.15.72:0/3095777354 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f069809d6f0 0x7f06981c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.220+0000 7f069dbcf700 1 --2- 172.21.15.72:0/3095777354 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f069809e1d0 0x7f06981c8a70 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.220+0000 7f069dbcf700 1 -- 172.21.15.72:0/3095777354 >> 172.21.15.72:0/3095777354 conn(0x7f0698066f50 msgr2=0x7f0698134810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.220+0000 7f069dbcf700 1 -- 172.21.15.72:0/3095777354 shutdown_connections 2023-10-03T10:17:45.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.220+0000 7f069dbcf700 1 -- 172.21.15.72:0/3095777354 wait complete. 2023-10-03T10:17:45.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:45.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:45.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.479+0000 7f86e2e7b700 1 Processor -- start 2023-10-03T10:17:45.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.479+0000 7f86e2e7b700 1 -- start start 2023-10-03T10:17:45.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86e2e7b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86dc06b250 0x7f86dc136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86e2e7b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86dc136d80 0x7f86dc139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86e2e7b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86dc09ece0 con 0x7f86dc06a770 2023-10-03T10:17:45.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86e2e7b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc06b640 con 0x7f86dc136d80 2023-10-03T10:17:45.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86e2e7b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc09e760 con 0x7f86dc06b250 2023-10-03T10:17:45.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86dbfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86dc06b250 0x7f86dc136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86e1418700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86dc136d80 0x7f86dc139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86e0c17700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f86dc06a770 0x7f86dc06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41382/0 (socket says 172.21.15.72:41382) 2023-10-03T10:17:45.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86e0c17700 1 -- 172.21.15.72:0/586602158 learned_addr learned my addr 172.21.15.72:0/586602158 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:45.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86db7fe700 1 -- 172.21.15.72:0/586602158 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840961186 0 0) 0x7f86dc09ece0 con 0x7f86dc06a770 2023-10-03T10:17:45.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86dbfff700 1 -- 172.21.15.72:0/586602158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86dc136d80 msgr2=0x7f86dc139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86dbfff700 1 --2- 172.21.15.72:0/586602158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86dc136d80 0x7f86dc139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86dbfff700 1 -- 172.21.15.72:0/586602158 >> v1:172.21.15.72:6789/0 conn(0x7f86dc06a770 legacy=0x7f86dc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86dbfff700 1 -- 172.21.15.72:0/586602158 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc09e040 con 0x7f86dc06b250 2023-10-03T10:17:45.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86e1418700 1 --2- 172.21.15.72:0/586602158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86dc136d80 0x7f86dc139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86dbfff700 1 --2- 172.21.15.72:0/586602158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86dc06b250 0x7f86dc136840 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009870 tx=0x7f86c8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=660801cd973e5ece server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86db7fe700 1 -- 172.21.15.72:0/586602158 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8011830 con 0x7f86dc06b250 2023-10-03T10:17:45.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86db7fe700 1 -- 172.21.15.72:0/586602158 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c8011990 con 0x7f86dc06b250 2023-10-03T10:17:45.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.480+0000 7f86db7fe700 1 -- 172.21.15.72:0/586602158 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8011d20 con 0x7f86dc06b250 2023-10-03T10:17:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.481+0000 7f86e2e7b700 1 -- 172.21.15.72:0/586602158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86dc06b250 msgr2=0x7f86dc136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.481+0000 7f86e2e7b700 1 --2- 172.21.15.72:0/586602158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86dc06b250 0x7f86dc136840 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009870 tx=0x7f86c8009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.481+0000 7f86e2e7b700 1 -- 172.21.15.72:0/586602158 shutdown_connections 2023-10-03T10:17:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.481+0000 7f86e2e7b700 1 --2- 172.21.15.72:0/586602158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86dc136d80 0x7f86dc139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.481+0000 7f86e2e7b700 1 --2- 172.21.15.72:0/586602158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86dc06b250 0x7f86dc136840 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.481+0000 7f86e2e7b700 1 -- 172.21.15.72:0/586602158 >> 172.21.15.72:0/586602158 conn(0x7f86dc066f50 msgr2=0x7f86dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.481+0000 7f86e2e7b700 1 -- 172.21.15.72:0/586602158 shutdown_connections 2023-10-03T10:17:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.481+0000 7f86e2e7b700 1 -- 172.21.15.72:0/586602158 wait complete. 2023-10-03T10:17:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.482+0000 7f86e2e7b700 1 Processor -- start 2023-10-03T10:17:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.482+0000 7f86e2e7b700 1 -- start start 2023-10-03T10:17:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.482+0000 7f86e2e7b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc06a770 0x7f86dc131560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.482+0000 7f86e2e7b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86dc06b250 0x7f86dc131aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.482+0000 7f86e2e7b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86dc136d80 0x7f86dc1c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.482+0000 7f86e2e7b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc09a8b0 con 0x7f86dc06a770 2023-10-03T10:17:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.482+0000 7f86e2e7b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc1220b0 con 0x7f86dc06b250 2023-10-03T10:17:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.482+0000 7f86e2e7b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc071e60 con 0x7f86dc136d80 2023-10-03T10:17:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86e1418700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86dc136d80 0x7f86dc1c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86e0c17700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc06a770 0x7f86dc131560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86e1418700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86dc136d80 0x7f86dc1c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59186/0 (socket says 172.21.15.72:59186) 2023-10-03T10:17:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86e1418700 1 -- 172.21.15.72:0/3855686397 learned_addr learned my addr 172.21.15.72:0/3855686397 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86dbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86dc06b250 0x7f86dc131aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86e0c17700 1 -- 172.21.15.72:0/3855686397 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86dc136d80 msgr2=0x7f86dc1c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86e0c17700 1 --2- 172.21.15.72:0/3855686397 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86dc136d80 0x7f86dc1c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86e0c17700 1 -- 172.21.15.72:0/3855686397 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86dc06b250 msgr2=0x7f86dc131aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86e0c17700 1 --2- 172.21.15.72:0/3855686397 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86dc06b250 0x7f86dc131aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86e0c17700 1 -- 172.21.15.72:0/3855686397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d4009a70 con 0x7f86dc06a770 2023-10-03T10:17:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86dbfff700 1 --2- 172.21.15.72:0/3855686397 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86dc06b250 0x7f86dc131aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86e1418700 1 --2- 172.21.15.72:0/3855686397 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86dc136d80 0x7f86dc1c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86e0c17700 1 --2- 172.21.15.72:0/3855686397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc06a770 0x7f86dc131560 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f86d000c3c0 tx=0x7f86d000c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86d97fa700 1 -- 172.21.15.72:0/3855686397 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d0004a70 con 0x7f86dc06a770 2023-10-03T10:17:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86d97fa700 1 -- 172.21.15.72:0/3855686397 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d0004bf0 con 0x7f86dc06a770 2023-10-03T10:17:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86e2e7b700 1 -- 172.21.15.72:0/3855686397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c80094a0 con 0x7f86dc06a770 2023-10-03T10:17:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86d97fa700 1 -- 172.21.15.72:0/3855686397 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d00070d0 con 0x7f86dc06a770 2023-10-03T10:17:45.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.483+0000 7f86e2e7b700 1 -- 172.21.15.72:0/3855686397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86dc120b90 con 0x7f86dc06a770 2023-10-03T10:17:45.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.484+0000 7f86d97fa700 1 -- 172.21.15.72:0/3855686397 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86d0007230 con 0x7f86dc06a770 2023-10-03T10:17:45.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.484+0000 7f86d97fa700 1 -- 172.21.15.72:0/3855686397 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f86d003f130 con 0x7f86dc06a770 2023-10-03T10:17:45.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.484+0000 7f86e2e7b700 1 -- 172.21.15.72:0/3855686397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86dc074ea0 con 0x7f86dc06a770 2023-10-03T10:17:45.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.489+0000 7f86d97fa700 1 -- 172.21.15.72:0/3855686397 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86d00074e0 con 0x7f86dc06a770 2023-10-03T10:17:45.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.678+0000 7f86e2e7b700 1 -- 172.21.15.72:0/3855686397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f86dc09f6b0 con 0x7f86dc06a770 2023-10-03T10:17:45.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.678+0000 7f86d97fa700 1 -- 172.21.15.72:0/3855686397 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86d001b340 con 0x7f86dc06a770 2023-10-03T10:17:45.679 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:45.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.680+0000 7f86e2e7b700 1 -- 172.21.15.72:0/3855686397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc06a770 msgr2=0x7f86dc131560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.680+0000 7f86e2e7b700 1 --2- 172.21.15.72:0/3855686397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc06a770 0x7f86dc131560 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f86d000c3c0 tx=0x7f86d000c6d0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.681+0000 7f86e2e7b700 1 -- 172.21.15.72:0/3855686397 shutdown_connections 2023-10-03T10:17:45.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.681+0000 7f86e2e7b700 1 --2- 172.21.15.72:0/3855686397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86dc06a770 0x7f86dc131560 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.681+0000 7f86e2e7b700 1 --2- 172.21.15.72:0/3855686397 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86dc136d80 0x7f86dc1c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.681+0000 7f86e2e7b700 1 --2- 172.21.15.72:0/3855686397 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86dc06b250 0x7f86dc131aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.681+0000 7f86e2e7b700 1 -- 172.21.15.72:0/3855686397 >> 172.21.15.72:0/3855686397 conn(0x7f86dc066f50 msgr2=0x7f86dc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.681+0000 7f86e2e7b700 1 -- 172.21.15.72:0/3855686397 shutdown_connections 2023-10-03T10:17:45.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:45.681+0000 7f86e2e7b700 1 -- 172.21.15.72:0/3855686397 wait complete. 2023-10-03T10:17:45.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:46.132 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:46.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:46.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.261+0000 7f7463daf700 1 Processor -- start 2023-10-03T10:17:46.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.261+0000 7f7463daf700 1 -- start start 2023-10-03T10:17:46.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f7463daf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c131630 0x7f745c131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f7463daf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c131f40 0x7f745c06e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f7463daf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f745c06e9d0 0x7f745c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f7463daf700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745c071a00 con 0x7f745c06e9d0 2023-10-03T10:17:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f7463daf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745c131430 con 0x7f745c131f40 2023-10-03T10:17:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f7463daf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f745c09a510 con 0x7f745c131630 2023-10-03T10:17:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f7461b4b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c131630 0x7f745c131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f7461b4b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c131630 0x7f745c131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59200/0 (socket says 172.21.15.72:59200) 2023-10-03T10:17:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f7461b4b700 1 -- 172.21.15.72:0/3114348260 learned_addr learned my addr 172.21.15.72:0/3114348260 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f746134a700 1 --2- 172.21.15.72:0/3114348260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c131f40 0x7f745c06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f746234c700 1 --2- 172.21.15.72:0/3114348260 >> v2:172.21.15.72:3300/0 conn(0x7f745c06e9d0 0x7f745c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f746134a700 1 -- 172.21.15.72:0/3114348260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c131630 msgr2=0x7f745c131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f746134a700 1 --2- 172.21.15.72:0/3114348260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c131630 0x7f745c131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f746134a700 1 -- 172.21.15.72:0/3114348260 >> v2:172.21.15.72:3300/0 conn(0x7f745c06e9d0 msgr2=0x7f745c06ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f746134a700 1 --2- 172.21.15.72:0/3114348260 >> v2:172.21.15.72:3300/0 conn(0x7f745c06e9d0 0x7f745c06ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f746134a700 1 -- 172.21.15.72:0/3114348260 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c0721c0 con 0x7f745c131f40 2023-10-03T10:17:46.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.262+0000 7f746134a700 1 --2- 172.21.15.72:0/3114348260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c131f40 0x7f745c06e490 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f744c009840 tx=0x7f744c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b108d36bb0bfe25b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.263+0000 7f7460b49700 1 -- 172.21.15.72:0/3114348260 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c014e90 con 0x7f745c131f40 2023-10-03T10:17:46.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.263+0000 7f7460b49700 1 -- 172.21.15.72:0/3114348260 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c01c440 con 0x7f745c131f40 2023-10-03T10:17:46.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.263+0000 7f7460b49700 1 -- 172.21.15.72:0/3114348260 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c01c7d0 con 0x7f745c131f40 2023-10-03T10:17:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.263+0000 7f7463daf700 1 -- 172.21.15.72:0/3114348260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c131f40 msgr2=0x7f745c06e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.263+0000 7f7463daf700 1 --2- 172.21.15.72:0/3114348260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c131f40 0x7f745c06e490 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f744c009840 tx=0x7f744c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.263+0000 7f7463daf700 1 -- 172.21.15.72:0/3114348260 shutdown_connections 2023-10-03T10:17:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.263+0000 7f7463daf700 1 --2- 172.21.15.72:0/3114348260 >> v2:172.21.15.72:3300/0 conn(0x7f745c06e9d0 0x7f745c06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.263+0000 7f7463daf700 1 --2- 172.21.15.72:0/3114348260 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c131630 0x7f745c131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.263+0000 7f7463daf700 1 --2- 172.21.15.72:0/3114348260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c131f40 0x7f745c06e490 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.263+0000 7f7463daf700 1 -- 172.21.15.72:0/3114348260 >> 172.21.15.72:0/3114348260 conn(0x7f745c0a2aa0 msgr2=0x7f745c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.264+0000 7f7463daf700 1 -- 172.21.15.72:0/3114348260 shutdown_connections 2023-10-03T10:17:46.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.264+0000 7f7463daf700 1 -- 172.21.15.72:0/3114348260 wait complete. 2023-10-03T10:17:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.264+0000 7f7463daf700 1 Processor -- start 2023-10-03T10:17:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f7463daf700 1 -- start start 2023-10-03T10:17:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f7463daf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c06e9d0 0x7f745c11b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f7463daf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c131630 0x7f745c11ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f7463daf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c131f40 0x7f745c11bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f7463daf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c11f9c0 con 0x7f745c06e9d0 2023-10-03T10:17:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f7463daf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745c11d0f0 con 0x7f745c131f40 2023-10-03T10:17:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f7463daf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f745c11d710 con 0x7f745c131630 2023-10-03T10:17:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f7461b4b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c06e9d0 0x7f745c11b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f7461b4b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c06e9d0 0x7f745c11b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41098/0 (socket says 172.21.15.72:41098) 2023-10-03T10:17:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f7461b4b700 1 -- 172.21.15.72:0/1056398195 learned_addr learned my addr 172.21.15.72:0/1056398195 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:46.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f746134a700 1 --2- 172.21.15.72:0/1056398195 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c131630 0x7f745c11ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f746234c700 1 --2- 172.21.15.72:0/1056398195 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c131f40 0x7f745c11bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f7461b4b700 1 -- 172.21.15.72:0/1056398195 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c131630 msgr2=0x7f745c11ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f7461b4b700 1 --2- 172.21.15.72:0/1056398195 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c131630 0x7f745c11ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f7461b4b700 1 -- 172.21.15.72:0/1056398195 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c131f40 msgr2=0x7f745c11bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f7461b4b700 1 --2- 172.21.15.72:0/1056398195 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c131f40 0x7f745c11bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.265+0000 7f7461b4b700 1 -- 172.21.15.72:0/1056398195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c0094a0 con 0x7f745c06e9d0 2023-10-03T10:17:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.266+0000 7f7461b4b700 1 --2- 172.21.15.72:0/1056398195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c06e9d0 0x7f745c11b4e0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f74580098a0 tx=0x7f7458009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.266+0000 7f74527fc700 1 -- 172.21.15.72:0/1056398195 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458017600 con 0x7f745c06e9d0 2023-10-03T10:17:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.266+0000 7f74527fc700 1 -- 172.21.15.72:0/1056398195 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7458017760 con 0x7f745c06e9d0 2023-10-03T10:17:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.266+0000 7f7463daf700 1 -- 172.21.15.72:0/1056398195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745c11e340 con 0x7f745c06e9d0 2023-10-03T10:17:46.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.266+0000 7f74527fc700 1 -- 172.21.15.72:0/1056398195 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458017b10 con 0x7f745c06e9d0 2023-10-03T10:17:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.266+0000 7f7463daf700 1 -- 172.21.15.72:0/1056398195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745c099f20 con 0x7f745c06e9d0 2023-10-03T10:17:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.267+0000 7f74527fc700 1 -- 172.21.15.72:0/1056398195 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7458017c70 con 0x7f745c06e9d0 2023-10-03T10:17:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.267+0000 7f7463daf700 1 -- 172.21.15.72:0/1056398195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745c074ea0 con 0x7f745c06e9d0 2023-10-03T10:17:46.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.267+0000 7f74527fc700 1 -- 172.21.15.72:0/1056398195 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f745803ece0 con 0x7f745c06e9d0 2023-10-03T10:17:46.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.272+0000 7f74527fc700 1 -- 172.21.15.72:0/1056398195 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f745801eb20 con 0x7f745c06e9d0 2023-10-03T10:17:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.323+0000 7f56286bc700 1 Processor -- start 2023-10-03T10:17:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.323+0000 7f56286bc700 1 -- start start 2023-10-03T10:17:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.324+0000 7f56286bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133420 0x7f56201337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.324+0000 7f56286bc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5620134260 0x7f56201306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.324+0000 7f56286bc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f562006b990 con 0x7f5620133e30 2023-10-03T10:17:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.324+0000 7f56286bc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56200a0590 con 0x7f5620134260 2023-10-03T10:17:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.324+0000 7f56286bc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562009fb80 con 0x7f5620133420 2023-10-03T10:17:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.324+0000 7f5626458700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133420 0x7f56201337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.324+0000 7f5626458700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133420 0x7f56201337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39892/0 (socket says 172.21.15.72:39892) 2023-10-03T10:17:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.324+0000 7f5626458700 1 -- 172.21.15.72:0/2999349305 learned_addr learned my addr 172.21.15.72:0/2999349305 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.324+0000 7f5626c59700 1 --2- 172.21.15.72:0/2999349305 >> v2:172.21.15.72:3300/0 conn(0x7f5620134260 0x7f56201306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.324+0000 7f5626458700 1 -- 172.21.15.72:0/2999349305 >> v2:172.21.15.72:3300/0 conn(0x7f5620134260 msgr2=0x7f56201306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.324+0000 7f5626458700 1 --2- 172.21.15.72:0/2999349305 >> v2:172.21.15.72:3300/0 conn(0x7f5620134260 0x7f56201306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.324+0000 7f5626458700 1 -- 172.21.15.72:0/2999349305 >> v1:172.21.15.72:6789/0 conn(0x7f5620133e30 legacy=0x7f562012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.324+0000 7f5626458700 1 -- 172.21.15.72:0/2999349305 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56200a0030 con 0x7f5620133420 2023-10-03T10:17:46.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.324+0000 7f5626458700 1 --2- 172.21.15.72:0/2999349305 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133420 0x7f56201337f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f561c0098f0 tx=0x7f561c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3520c9b922ea0b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.325+0000 7f5625456700 1 -- 172.21.15.72:0/2999349305 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c011830 con 0x7f5620133420 2023-10-03T10:17:46.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.325+0000 7f5625456700 1 -- 172.21.15.72:0/2999349305 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561c011990 con 0x7f5620133420 2023-10-03T10:17:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.325+0000 7f5625456700 1 -- 172.21.15.72:0/2999349305 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561c011d20 con 0x7f5620133420 2023-10-03T10:17:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.325+0000 7f56286bc700 1 -- 172.21.15.72:0/2999349305 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133420 msgr2=0x7f56201337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.325+0000 7f56286bc700 1 --2- 172.21.15.72:0/2999349305 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133420 0x7f56201337f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f561c0098f0 tx=0x7f561c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.325+0000 7f56286bc700 1 -- 172.21.15.72:0/2999349305 shutdown_connections 2023-10-03T10:17:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.325+0000 7f56286bc700 1 --2- 172.21.15.72:0/2999349305 >> v2:172.21.15.72:3300/0 conn(0x7f5620134260 0x7f56201306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.325+0000 7f56286bc700 1 --2- 172.21.15.72:0/2999349305 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133420 0x7f56201337f0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.325+0000 7f56286bc700 1 -- 172.21.15.72:0/2999349305 >> 172.21.15.72:0/2999349305 conn(0x7f56200a4210 msgr2=0x7f56200a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.325+0000 7f56286bc700 1 -- 172.21.15.72:0/2999349305 shutdown_connections 2023-10-03T10:17:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.325+0000 7f56286bc700 1 -- 172.21.15.72:0/2999349305 wait complete. 2023-10-03T10:17:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.326+0000 7f56286bc700 1 Processor -- start 2023-10-03T10:17:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.326+0000 7f56286bc700 1 -- start start 2023-10-03T10:17:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f56286bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133420 0x7f562009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f56286bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5620133e30 0x7f562009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f56286bc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5620134260 0x7f562009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f56286bc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56201201c0 con 0x7f5620133e30 2023-10-03T10:17:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f56286bc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562009ddb0 con 0x7f5620133420 2023-10-03T10:17:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f56286bc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f562011fc20 con 0x7f5620134260 2023-10-03T10:17:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f5626458700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133420 0x7f562009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f5626458700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133420 0x7f562009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39894/0 (socket says 172.21.15.72:39894) 2023-10-03T10:17:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f5626458700 1 -- 172.21.15.72:0/862213559 learned_addr learned my addr 172.21.15.72:0/862213559 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f5625c57700 1 --2- 172.21.15.72:0/862213559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5620133e30 0x7f562009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f5626c59700 1 --2- 172.21.15.72:0/862213559 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5620134260 0x7f562009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f5625c57700 1 -- 172.21.15.72:0/862213559 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5620134260 msgr2=0x7f562009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f5625c57700 1 --2- 172.21.15.72:0/862213559 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5620134260 0x7f562009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f5625c57700 1 -- 172.21.15.72:0/862213559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133420 msgr2=0x7f562009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f5625c57700 1 --2- 172.21.15.72:0/862213559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133420 0x7f562009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f5625c57700 1 -- 172.21.15.72:0/862213559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561c009550 con 0x7f5620133e30 2023-10-03T10:17:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f5626458700 1 --2- 172.21.15.72:0/862213559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133420 0x7f562009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.327+0000 7f5625c57700 1 --2- 172.21.15.72:0/862213559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5620133e30 0x7f562009c9c0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f5610000f60 tx=0x7f561000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.328+0000 7f5616ffd700 1 -- 172.21.15.72:0/862213559 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56100050d0 con 0x7f5620133e30 2023-10-03T10:17:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.328+0000 7f5616ffd700 1 -- 172.21.15.72:0/862213559 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5610005230 con 0x7f5620133e30 2023-10-03T10:17:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.328+0000 7f5616ffd700 1 -- 172.21.15.72:0/862213559 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610003680 con 0x7f5620133e30 2023-10-03T10:17:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.328+0000 7f56286bc700 1 -- 172.21.15.72:0/862213559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f562011fee0 con 0x7f5620133e30 2023-10-03T10:17:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.328+0000 7f56286bc700 1 -- 172.21.15.72:0/862213559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5620120950 con 0x7f5620133e30 2023-10-03T10:17:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.328+0000 7f5616ffd700 1 -- 172.21.15.72:0/862213559 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56100037e0 con 0x7f5620133e30 2023-10-03T10:17:46.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.329+0000 7f5616ffd700 1 -- 172.21.15.72:0/862213559 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f561003eab0 con 0x7f5620133e30 2023-10-03T10:17:46.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.329+0000 7f56286bc700 1 -- 172.21.15.72:0/862213559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5620074ea0 con 0x7f5620133e30 2023-10-03T10:17:46.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.338+0000 7f5616ffd700 1 -- 172.21.15.72:0/862213559 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5610011590 con 0x7f5620133e30 2023-10-03T10:17:46.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.380+0000 7f22a69b9700 1 Processor -- start 2023-10-03T10:17:46.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.380+0000 7f22a69b9700 1 -- start start 2023-10-03T10:17:46.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.380+0000 7f22a69b9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22a00a0090 0x7f22a0136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.380+0000 7f22a69b9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22a009d130 0x7f22a0139170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.380+0000 7f22a69b9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a009ba70 con 0x7f22a009c650 2023-10-03T10:17:46.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.380+0000 7f22a69b9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a009e8f0 con 0x7f22a00a0090 2023-10-03T10:17:46.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.380+0000 7f22a69b9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00a0760 con 0x7f22a009d130 2023-10-03T10:17:46.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.380+0000 7f229f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22a00a0090 0x7f22a0136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.381+0000 7f229f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22a00a0090 0x7f22a0136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41134/0 (socket says 172.21.15.72:41134) 2023-10-03T10:17:46.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.381+0000 7f229ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f22a009c650 0x7f22a009ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41390/0 (socket says 172.21.15.72:41390) 2023-10-03T10:17:46.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.381+0000 7f229f7fe700 1 -- 172.21.15.72:0/1421309655 learned_addr learned my addr 172.21.15.72:0/1421309655 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:46.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.381+0000 7f22a4f56700 1 --2- 172.21.15.72:0/1421309655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22a009d130 0x7f22a0139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.381+0000 7f229f7fe700 1 -- 172.21.15.72:0/1421309655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22a009d130 msgr2=0x7f22a0139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.381+0000 7f229f7fe700 1 --2- 172.21.15.72:0/1421309655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22a009d130 0x7f22a0139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.381+0000 7f229f7fe700 1 -- 172.21.15.72:0/1421309655 >> v1:172.21.15.72:6789/0 conn(0x7f22a009c650 legacy=0x7f22a009ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.381+0000 7f229f7fe700 1 -- 172.21.15.72:0/1421309655 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a009a080 con 0x7f22a00a0090 2023-10-03T10:17:46.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.381+0000 7f229effd700 1 -- 172.21.15.72:0/1421309655 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578796770 0 0) 0x7f22a009ba70 con 0x7f22a009c650 2023-10-03T10:17:46.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.381+0000 7f229f7fe700 1 --2- 172.21.15.72:0/1421309655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22a00a0090 0x7f22a0136c20 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f22940098f0 tx=0x7f2294009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f79e58519c7b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.381+0000 7f229effd700 1 -- 172.21.15.72:0/1421309655 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294011830 con 0x7f22a00a0090 2023-10-03T10:17:46.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.381+0000 7f229effd700 1 -- 172.21.15.72:0/1421309655 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2294011990 con 0x7f22a00a0090 2023-10-03T10:17:46.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.381+0000 7f229effd700 1 -- 172.21.15.72:0/1421309655 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294011d20 con 0x7f22a00a0090 2023-10-03T10:17:46.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.382+0000 7f22a69b9700 1 -- 172.21.15.72:0/1421309655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22a00a0090 msgr2=0x7f22a0136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.382+0000 7f22a69b9700 1 --2- 172.21.15.72:0/1421309655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22a00a0090 0x7f22a0136c20 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f22940098f0 tx=0x7f2294009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:46.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.382+0000 7f22a69b9700 1 -- 172.21.15.72:0/1421309655 shutdown_connections 2023-10-03T10:17:46.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.382+0000 7f22a69b9700 1 --2- 172.21.15.72:0/1421309655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22a009d130 0x7f22a0139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.382+0000 7f22a69b9700 1 --2- 172.21.15.72:0/1421309655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22a00a0090 0x7f22a0136c20 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.382+0000 7f22a69b9700 1 -- 172.21.15.72:0/1421309655 >> 172.21.15.72:0/1421309655 conn(0x7f22a00a3f70 msgr2=0x7f22a00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.382+0000 7f22a69b9700 1 -- 172.21.15.72:0/1421309655 shutdown_connections 2023-10-03T10:17:46.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.382+0000 7f22a69b9700 1 -- 172.21.15.72:0/1421309655 wait complete. 2023-10-03T10:17:46.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.383+0000 7f22a69b9700 1 Processor -- start 2023-10-03T10:17:46.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.383+0000 7f22a69b9700 1 -- start start 2023-10-03T10:17:46.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f22a69b9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22a009c650 0x7f22a0135210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f22a69b9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22a009d130 0x7f22a0135750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f22a69b9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22a00a0090 0x7f22a0135c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f22a69b9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a011aa30 con 0x7f22a00a0090 2023-10-03T10:17:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f22a69b9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a0138790 con 0x7f22a009d130 2023-10-03T10:17:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f22a69b9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22a01384c0 con 0x7f22a009c650 2023-10-03T10:17:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f229ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22a009c650 0x7f22a0135210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f229ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22a009c650 0x7f22a0135210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59226/0 (socket says 172.21.15.72:59226) 2023-10-03T10:17:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f229ffff700 1 -- 172.21.15.72:0/106474815 learned_addr learned my addr 172.21.15.72:0/106474815 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f229f7fe700 1 --2- 172.21.15.72:0/106474815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22a009d130 0x7f22a0135750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f22a4f56700 1 --2- 172.21.15.72:0/106474815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22a00a0090 0x7f22a0135c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f229ffff700 1 -- 172.21.15.72:0/106474815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22a009d130 msgr2=0x7f22a0135750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f229ffff700 1 --2- 172.21.15.72:0/106474815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22a009d130 0x7f22a0135750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f229ffff700 1 -- 172.21.15.72:0/106474815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22a00a0090 msgr2=0x7f22a0135c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f229ffff700 1 --2- 172.21.15.72:0/106474815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22a00a0090 0x7f22a0135c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f229ffff700 1 -- 172.21.15.72:0/106474815 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2294009550 con 0x7f22a009c650 2023-10-03T10:17:46.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f229f7fe700 1 --2- 172.21.15.72:0/106474815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22a009d130 0x7f22a0135750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f22a4f56700 1 --2- 172.21.15.72:0/106474815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22a00a0090 0x7f22a0135c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.384+0000 7f229ffff700 1 --2- 172.21.15.72:0/106474815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22a009c650 0x7f22a0135210 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f229000c520 tx=0x7f229000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.385+0000 7f229cff9700 1 -- 172.21.15.72:0/106474815 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2290004c80 con 0x7f22a009c650 2023-10-03T10:17:46.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.385+0000 7f229cff9700 1 -- 172.21.15.72:0/106474815 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2290004e00 con 0x7f22a009c650 2023-10-03T10:17:46.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.385+0000 7f22a69b9700 1 -- 172.21.15.72:0/106474815 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a0137650 con 0x7f22a009c650 2023-10-03T10:17:46.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.385+0000 7f229cff9700 1 -- 172.21.15.72:0/106474815 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2290007310 con 0x7f22a009c650 2023-10-03T10:17:46.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.385+0000 7f22a69b9700 1 -- 172.21.15.72:0/106474815 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a0136e20 con 0x7f22a009c650 2023-10-03T10:17:46.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.386+0000 7f22a69b9700 1 -- 172.21.15.72:0/106474815 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a00747f0 con 0x7f22a009c650 2023-10-03T10:17:46.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.386+0000 7f229cff9700 1 -- 172.21.15.72:0/106474815 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2290007470 con 0x7f22a009c650 2023-10-03T10:17:46.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.386+0000 7f229cff9700 1 -- 172.21.15.72:0/106474815 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2290040cc0 con 0x7f22a009c650 2023-10-03T10:17:46.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.395+0000 7f229cff9700 1 -- 172.21.15.72:0/106474815 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2290044060 con 0x7f22a009c650 2023-10-03T10:17:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.496+0000 7f7463daf700 1 -- 172.21.15.72:0/1056398195 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f745c06b9e0 con 0x7f745c06e9d0 2023-10-03T10:17:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.496+0000 7f74527fc700 1 -- 172.21.15.72:0/1056398195 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f745801c030 con 0x7f745c06e9d0 2023-10-03T10:17:46.497 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.498+0000 7f7463daf700 1 -- 172.21.15.72:0/1056398195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c06e9d0 msgr2=0x7f745c11b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.498+0000 7f7463daf700 1 --2- 172.21.15.72:0/1056398195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c06e9d0 0x7f745c11b4e0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f74580098a0 tx=0x7f7458009bb0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.498+0000 7f7463daf700 1 -- 172.21.15.72:0/1056398195 shutdown_connections 2023-10-03T10:17:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.498+0000 7f7463daf700 1 --2- 172.21.15.72:0/1056398195 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c06e9d0 0x7f745c11b4e0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.498+0000 7f7463daf700 1 --2- 172.21.15.72:0/1056398195 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f745c131f40 0x7f745c11bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.498+0000 7f7463daf700 1 --2- 172.21.15.72:0/1056398195 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f745c131630 0x7f745c11ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.498+0000 7f7463daf700 1 -- 172.21.15.72:0/1056398195 >> 172.21.15.72:0/1056398195 conn(0x7f745c0a2aa0 msgr2=0x7f745c070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.498+0000 7f7463daf700 1 -- 172.21.15.72:0/1056398195 shutdown_connections 2023-10-03T10:17:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.498+0000 7f7463daf700 1 -- 172.21.15.72:0/1056398195 wait complete. 2023-10-03T10:17:46.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:46.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.533+0000 7f56286bc700 1 -- 172.21.15.72:0/862213559 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f562006b250 con 0x7f5620133e30 2023-10-03T10:17:46.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.533+0000 7f5616ffd700 1 -- 172.21.15.72:0/862213559 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56100192c0 con 0x7f5620133e30 2023-10-03T10:17:46.534 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:46.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.535+0000 7f56286bc700 1 -- 172.21.15.72:0/862213559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5620133e30 msgr2=0x7f562009c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.535+0000 7f56286bc700 1 --2- 172.21.15.72:0/862213559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5620133e30 0x7f562009c9c0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f5610000f60 tx=0x7f561000c730 comp rx=0 tx=0).stop 2023-10-03T10:17:46.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.535+0000 7f56286bc700 1 -- 172.21.15.72:0/862213559 shutdown_connections 2023-10-03T10:17:46.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.535+0000 7f56286bc700 1 --2- 172.21.15.72:0/862213559 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5620134260 0x7f562009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.535+0000 7f56286bc700 1 --2- 172.21.15.72:0/862213559 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5620133420 0x7f562009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.535+0000 7f56286bc700 1 --2- 172.21.15.72:0/862213559 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5620133e30 0x7f562009c9c0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.535+0000 7f56286bc700 1 -- 172.21.15.72:0/862213559 >> 172.21.15.72:0/862213559 conn(0x7f56200a4210 msgr2=0x7f56200a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.535+0000 7f56286bc700 1 -- 172.21.15.72:0/862213559 shutdown_connections 2023-10-03T10:17:46.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.535+0000 7f56286bc700 1 -- 172.21.15.72:0/862213559 wait complete. 2023-10-03T10:17:46.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:46.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.597+0000 7f22a69b9700 1 -- 172.21.15.72:0/106474815 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f22a0072840 con 0x7f22a009c650 2023-10-03T10:17:46.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.597+0000 7f229cff9700 1 -- 172.21.15.72:0/106474815 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2290044030 con 0x7f22a009c650 2023-10-03T10:17:46.598 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.599+0000 7f22a69b9700 1 -- 172.21.15.72:0/106474815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22a009c650 msgr2=0x7f22a0135210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.599+0000 7f22a69b9700 1 --2- 172.21.15.72:0/106474815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22a009c650 0x7f22a0135210 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f229000c520 tx=0x7f229000c830 comp rx=0 tx=0).stop 2023-10-03T10:17:46.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.599+0000 7f22a69b9700 1 -- 172.21.15.72:0/106474815 shutdown_connections 2023-10-03T10:17:46.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.599+0000 7f22a69b9700 1 --2- 172.21.15.72:0/106474815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22a00a0090 0x7f22a0135c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.599+0000 7f22a69b9700 1 --2- 172.21.15.72:0/106474815 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22a009c650 0x7f22a0135210 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.599+0000 7f22a69b9700 1 --2- 172.21.15.72:0/106474815 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22a009d130 0x7f22a0135750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.599+0000 7f22a69b9700 1 -- 172.21.15.72:0/106474815 >> 172.21.15.72:0/106474815 conn(0x7f22a00a3f70 msgr2=0x7f22a0138cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.599+0000 7f22a69b9700 1 -- 172.21.15.72:0/106474815 shutdown_connections 2023-10-03T10:17:46.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.599+0000 7f22a69b9700 1 -- 172.21.15.72:0/106474815 wait complete. 2023-10-03T10:17:46.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:46.694 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:46.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.817+0000 7f43a8c31700 1 Processor -- start 2023-10-03T10:17:46.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.817+0000 7f43a8c31700 1 -- start start 2023-10-03T10:17:46.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a8c31700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a4133420 0x7f43a41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a8c31700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a4133e30 0x7f43a412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a8c31700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a406b990 con 0x7f43a4134260 2023-10-03T10:17:46.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a8c31700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a40a0590 con 0x7f43a4133e30 2023-10-03T10:17:46.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a8c31700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43a409fb80 con 0x7f43a4133420 2023-10-03T10:17:46.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a4133420 0x7f43a41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a2d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f43a4134260 0x7f43a41304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41404/0 (socket says 172.21.15.72:41404) 2023-10-03T10:17:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a2d9d700 1 -- 172.21.15.72:0/3624166751 learned_addr learned my addr 172.21.15.72:0/3624166751 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a1d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a4133e30 0x7f43a412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a259c700 1 -- 172.21.15.72:0/3624166751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a4133e30 msgr2=0x7f43a412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a259c700 1 --2- 172.21.15.72:0/3624166751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a4133e30 0x7f43a412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a159a700 1 -- 172.21.15.72:0/3624166751 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467707876 0 0) 0x7f43a406b990 con 0x7f43a4134260 2023-10-03T10:17:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a259c700 1 -- 172.21.15.72:0/3624166751 >> v1:172.21.15.72:6789/0 conn(0x7f43a4134260 legacy=0x7f43a41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a259c700 1 -- 172.21.15.72:0/3624166751 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a40a0030 con 0x7f43a4133420 2023-10-03T10:17:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a1d9b700 1 --2- 172.21.15.72:0/3624166751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a4133e30 0x7f43a412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a259c700 1 --2- 172.21.15.72:0/3624166751 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a4133420 0x7f43a41337f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4398009870 tx=0x7f4398009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1be9ebd2454b40a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.818+0000 7f43a159a700 1 -- 172.21.15.72:0/3624166751 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398011830 con 0x7f43a4133420 2023-10-03T10:17:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.819+0000 7f43a159a700 1 -- 172.21.15.72:0/3624166751 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4398011990 con 0x7f43a4133420 2023-10-03T10:17:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.819+0000 7f43a159a700 1 -- 172.21.15.72:0/3624166751 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398011d20 con 0x7f43a4133420 2023-10-03T10:17:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.819+0000 7f43a8c31700 1 -- 172.21.15.72:0/3624166751 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a4133420 msgr2=0x7f43a41337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.819+0000 7f43a8c31700 1 --2- 172.21.15.72:0/3624166751 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a4133420 0x7f43a41337f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4398009870 tx=0x7f4398009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.819+0000 7f43a8c31700 1 -- 172.21.15.72:0/3624166751 shutdown_connections 2023-10-03T10:17:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.819+0000 7f43a8c31700 1 --2- 172.21.15.72:0/3624166751 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a4133420 0x7f43a41337f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.819+0000 7f43a8c31700 1 --2- 172.21.15.72:0/3624166751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a4133e30 0x7f43a412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.819+0000 7f43a8c31700 1 -- 172.21.15.72:0/3624166751 >> 172.21.15.72:0/3624166751 conn(0x7f43a40a4210 msgr2=0x7f43a40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.819+0000 7f43a8c31700 1 -- 172.21.15.72:0/3624166751 shutdown_connections 2023-10-03T10:17:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.819+0000 7f43a8c31700 1 -- 172.21.15.72:0/3624166751 wait complete. 2023-10-03T10:17:46.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.820+0000 7f43a8c31700 1 Processor -- start 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.820+0000 7f43a8c31700 1 -- start start 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a8c31700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a4133420 0x7f43a409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a8c31700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a4133e30 0x7f43a409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a8c31700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a4134260 0x7f43a409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a8c31700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a411ef10 con 0x7f43a4133e30 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a8c31700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a412d8c0 con 0x7f43a4133420 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a8c31700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43a411fa60 con 0x7f43a4134260 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a4133e30 0x7f43a409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a2d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a4134260 0x7f43a409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a4133e30 0x7f43a409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41152/0 (socket says 172.21.15.72:41152) 2023-10-03T10:17:46.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a4133420 0x7f43a409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a1d9b700 1 -- 172.21.15.72:0/3340325935 learned_addr learned my addr 172.21.15.72:0/3340325935 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a2d9d700 1 -- 172.21.15.72:0/3340325935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a4133420 msgr2=0x7f43a409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a2d9d700 1 --2- 172.21.15.72:0/3340325935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a4133420 0x7f43a409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a2d9d700 1 -- 172.21.15.72:0/3340325935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a4133e30 msgr2=0x7f43a409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a2d9d700 1 --2- 172.21.15.72:0/3340325935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a4133e30 0x7f43a409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a2d9d700 1 -- 172.21.15.72:0/3340325935 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43940094a0 con 0x7f43a4134260 2023-10-03T10:17:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a1d9b700 1 --2- 172.21.15.72:0/3340325935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a4133e30 0x7f43a409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a259c700 1 --2- 172.21.15.72:0/3340325935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a4133420 0x7f43a409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a2d9d700 1 --2- 172.21.15.72:0/3340325935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a4134260 0x7f43a409cf00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f439c00cbe0 tx=0x7f439c00cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f4392ffd700 1 -- 172.21.15.72:0/3340325935 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c00aa40 con 0x7f43a4134260 2023-10-03T10:17:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f4392ffd700 1 -- 172.21.15.72:0/3340325935 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c00abc0 con 0x7f43a4134260 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f4392ffd700 1 -- 172.21.15.72:0/3340325935 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0070d0 con 0x7f43a4134260 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a8c31700 1 -- 172.21.15.72:0/3340325935 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43980094a0 con 0x7f43a4134260 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.821+0000 7f43a8c31700 1 -- 172.21.15.72:0/3340325935 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a411fd20 con 0x7f43a4134260 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.822+0000 7f4392ffd700 1 -- 172.21.15.72:0/3340325935 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f439c007230 con 0x7f43a4134260 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.822+0000 7f4392ffd700 1 -- 172.21.15.72:0/3340325935 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f439c03efe0 con 0x7f43a4134260 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.822+0000 7f43a8c31700 1 -- 172.21.15.72:0/3340325935 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a4074ea0 con 0x7f43a4134260 2023-10-03T10:17:46.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:46.827+0000 7f4392ffd700 1 -- 172.21.15.72:0/3340325935 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f439c018070 con 0x7f43a4134260 2023-10-03T10:17:47.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.009+0000 7f43a8c31700 1 -- 172.21.15.72:0/3340325935 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f43a406b250 con 0x7f43a4134260 2023-10-03T10:17:47.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.010+0000 7f4392ffd700 1 -- 172.21.15.72:0/3340325935 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f439c0074e0 con 0x7f43a4134260 2023-10-03T10:17:47.011 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:47.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.011+0000 7f43a8c31700 1 -- 172.21.15.72:0/3340325935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a4134260 msgr2=0x7f43a409cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.011+0000 7f43a8c31700 1 --2- 172.21.15.72:0/3340325935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a4134260 0x7f43a409cf00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f439c00cbe0 tx=0x7f439c00cef0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.012+0000 7f43a8c31700 1 -- 172.21.15.72:0/3340325935 shutdown_connections 2023-10-03T10:17:47.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.012+0000 7f43a8c31700 1 --2- 172.21.15.72:0/3340325935 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f43a4134260 0x7f43a409cf00 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.012+0000 7f43a8c31700 1 --2- 172.21.15.72:0/3340325935 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43a4133420 0x7f43a409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.012+0000 7f43a8c31700 1 --2- 172.21.15.72:0/3340325935 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a4133e30 0x7f43a409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.012+0000 7f43a8c31700 1 -- 172.21.15.72:0/3340325935 >> 172.21.15.72:0/3340325935 conn(0x7f43a40a4210 msgr2=0x7f43a40a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.012+0000 7f43a8c31700 1 -- 172.21.15.72:0/3340325935 shutdown_connections 2023-10-03T10:17:47.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.012+0000 7f43a8c31700 1 -- 172.21.15.72:0/3340325935 wait complete. 2023-10-03T10:17:47.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:47.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:47.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:47.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:47.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.649+0000 7f79aa32b700 1 Processor -- start 2023-10-03T10:17:47.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.649+0000 7f79aa32b700 1 -- start start 2023-10-03T10:17:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79aa32b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79a4130540 0x7f79a4130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79aa32b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79a4130e50 0x7f79a406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79aa32b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79a406fb20 0x7f79a406ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79aa32b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a409a390 con 0x7f79a406fb20 2023-10-03T10:17:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79aa32b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40716a0 con 0x7f79a4130540 2023-10-03T10:17:47.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79aa32b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79a4071290 con 0x7f79a4130e50 2023-10-03T10:17:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79a4130e50 0x7f79a406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79a4130540 0x7f79a4130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79a4130e50 0x7f79a406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59250/0 (socket says 172.21.15.72:59250) 2023-10-03T10:17:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79a4130540 0x7f79a4130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39950/0 (socket says 172.21.15.72:39950) 2023-10-03T10:17:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a37fe700 1 -- 172.21.15.72:0/739567328 learned_addr learned my addr 172.21.15.72:0/739567328 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a88c8700 1 --2- 172.21.15.72:0/739567328 >> v2:172.21.15.72:3300/0 conn(0x7f79a406fb20 0x7f79a406ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a37fe700 1 -- 172.21.15.72:0/739567328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79a4130540 msgr2=0x7f79a4130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a37fe700 1 --2- 172.21.15.72:0/739567328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79a4130540 0x7f79a4130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a37fe700 1 -- 172.21.15.72:0/739567328 >> v2:172.21.15.72:3300/0 conn(0x7f79a406fb20 msgr2=0x7f79a406ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a37fe700 1 --2- 172.21.15.72:0/739567328 >> v2:172.21.15.72:3300/0 conn(0x7f79a406fb20 0x7f79a406ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a37fe700 1 -- 172.21.15.72:0/739567328 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a4130340 con 0x7f79a4130e50 2023-10-03T10:17:47.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a3fff700 1 --2- 172.21.15.72:0/739567328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79a4130540 0x7f79a4130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a88c8700 1 --2- 172.21.15.72:0/739567328 >> v2:172.21.15.72:3300/0 conn(0x7f79a406fb20 0x7f79a406ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a37fe700 1 --2- 172.21.15.72:0/739567328 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79a4130e50 0x7f79a406f5e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f799800b9d0 tx=0x7f799800bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0284ae7e9fccee3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a2ffd700 1 -- 172.21.15.72:0/739567328 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799800cc20 con 0x7f79a4130e50 2023-10-03T10:17:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.650+0000 7f79a2ffd700 1 -- 172.21.15.72:0/739567328 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799800cd80 con 0x7f79a4130e50 2023-10-03T10:17:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.651+0000 7f79a2ffd700 1 -- 172.21.15.72:0/739567328 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799800f680 con 0x7f79a4130e50 2023-10-03T10:17:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.651+0000 7f79aa32b700 1 -- 172.21.15.72:0/739567328 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79a4130e50 msgr2=0x7f79a406f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.651+0000 7f79aa32b700 1 --2- 172.21.15.72:0/739567328 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79a4130e50 0x7f79a406f5e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f799800b9d0 tx=0x7f799800bce0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.651+0000 7f79aa32b700 1 -- 172.21.15.72:0/739567328 shutdown_connections 2023-10-03T10:17:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.651+0000 7f79aa32b700 1 --2- 172.21.15.72:0/739567328 >> v2:172.21.15.72:3300/0 conn(0x7f79a406fb20 0x7f79a406ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.651+0000 7f79aa32b700 1 --2- 172.21.15.72:0/739567328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79a4130540 0x7f79a4130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.651+0000 7f79aa32b700 1 --2- 172.21.15.72:0/739567328 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79a4130e50 0x7f79a406f5e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.651+0000 7f79aa32b700 1 -- 172.21.15.72:0/739567328 >> 172.21.15.72:0/739567328 conn(0x7f79a40a2aa0 msgr2=0x7f79a40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.651+0000 7f79aa32b700 1 -- 172.21.15.72:0/739567328 shutdown_connections 2023-10-03T10:17:47.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.651+0000 7f79aa32b700 1 -- 172.21.15.72:0/739567328 wait complete. 2023-10-03T10:17:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.652+0000 7f79aa32b700 1 Processor -- start 2023-10-03T10:17:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.652+0000 7f79aa32b700 1 -- start start 2023-10-03T10:17:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.653+0000 7f79aa32b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79a406fb20 0x7f79a4118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.653+0000 7f79aa32b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79a4130540 0x7f79a4119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.653+0000 7f79aa32b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79a4130e50 0x7f79a4119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.653+0000 7f79aa32b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40a0c70 con 0x7f79a4130540 2023-10-03T10:17:47.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.653+0000 7f79aa32b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40718e0 con 0x7f79a406fb20 2023-10-03T10:17:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.653+0000 7f79aa32b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79a411ba00 con 0x7f79a4130e50 2023-10-03T10:17:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.653+0000 7f79a37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79a4130540 0x7f79a4119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.653+0000 7f79a37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79a4130540 0x7f79a4119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41174/0 (socket says 172.21.15.72:41174) 2023-10-03T10:17:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.653+0000 7f79a37fe700 1 -- 172.21.15.72:0/3489076567 learned_addr learned my addr 172.21.15.72:0/3489076567 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.653+0000 7f79a88c8700 1 --2- 172.21.15.72:0/3489076567 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79a4130e50 0x7f79a4119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.653+0000 7f79a3fff700 1 --2- 172.21.15.72:0/3489076567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79a406fb20 0x7f79a4118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.653+0000 7f79a88c8700 1 -- 172.21.15.72:0/3489076567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79a406fb20 msgr2=0x7f79a4118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.654+0000 7f79a88c8700 1 --2- 172.21.15.72:0/3489076567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79a406fb20 0x7f79a4118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.654+0000 7f79a88c8700 1 -- 172.21.15.72:0/3489076567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79a4130540 msgr2=0x7f79a4119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.654+0000 7f79a88c8700 1 --2- 172.21.15.72:0/3489076567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79a4130540 0x7f79a4119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.654+0000 7f79a88c8700 1 -- 172.21.15.72:0/3489076567 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c009a70 con 0x7f79a4130e50 2023-10-03T10:17:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.654+0000 7f79a37fe700 1 --2- 172.21.15.72:0/3489076567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79a4130540 0x7f79a4119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.654+0000 7f79a88c8700 1 --2- 172.21.15.72:0/3489076567 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79a4130e50 0x7f79a4119750 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f799c009e50 tx=0x7f799c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.654+0000 7f79a0ff9700 1 -- 172.21.15.72:0/3489076567 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c00ca90 con 0x7f79a4130e50 2023-10-03T10:17:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.654+0000 7f79a0ff9700 1 -- 172.21.15.72:0/3489076567 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c00f040 con 0x7f79a4130e50 2023-10-03T10:17:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.654+0000 7f79aa32b700 1 -- 172.21.15.72:0/3489076567 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799400d940 con 0x7f79a4130e50 2023-10-03T10:17:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.654+0000 7f79a0ff9700 1 -- 172.21.15.72:0/3489076567 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c00ce50 con 0x7f79a4130e50 2023-10-03T10:17:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.654+0000 7f79aa32b700 1 -- 172.21.15.72:0/3489076567 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799800b600 con 0x7f79a4130e50 2023-10-03T10:17:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.655+0000 7f79aa32b700 1 -- 172.21.15.72:0/3489076567 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a411af50 con 0x7f79a4130e50 2023-10-03T10:17:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.655+0000 7f79a0ff9700 1 -- 172.21.15.72:0/3489076567 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f799c003a20 con 0x7f79a4130e50 2023-10-03T10:17:47.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.656+0000 7f79a0ff9700 1 -- 172.21.15.72:0/3489076567 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f799c0404c0 con 0x7f79a4130e50 2023-10-03T10:17:47.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.660+0000 7f79a0ff9700 1 -- 172.21.15.72:0/3489076567 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f799c024370 con 0x7f79a4130e50 2023-10-03T10:17:47.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.688+0000 7fea40ec4700 1 Processor -- start 2023-10-03T10:17:47.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.688+0000 7fea40ec4700 1 -- start start 2023-10-03T10:17:47.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea40ec4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea3c09e850 0x7fea3c09ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea40ec4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea3c09f160 0x7fea3c133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea40ec4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c06bc50 con 0x7fea3c1340c0 2023-10-03T10:17:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea40ec4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3c09ae60 con 0x7fea3c09f160 2023-10-03T10:17:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea40ec4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c06b990 con 0x7fea3c09e850 2023-10-03T10:17:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea39d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea3c09f160 0x7fea3c133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea3a59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea3c09e850 0x7fea3c09ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea39d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fea3c09f160 0x7fea3c133b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41180/0 (socket says 172.21.15.72:41180) 2023-10-03T10:17:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea39d9b700 1 -- 172.21.15.72:0/4047606136 learned_addr learned my addr 172.21.15.72:0/4047606136 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea3a59c700 1 -- 172.21.15.72:0/4047606136 >> v2:172.21.15.72:3300/0 conn(0x7fea3c09f160 msgr2=0x7fea3c133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea3a59c700 1 --2- 172.21.15.72:0/4047606136 >> v2:172.21.15.72:3300/0 conn(0x7fea3c09f160 0x7fea3c133b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea3a59c700 1 -- 172.21.15.72:0/4047606136 >> v1:172.21.15.72:6789/0 conn(0x7fea3c1340c0 legacy=0x7fea3c13ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea3a59c700 1 -- 172.21.15.72:0/4047606136 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c06cb10 con 0x7fea3c09e850 2023-10-03T10:17:47.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea3959a700 1 -- 172.21.15.72:0/4047606136 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698768253 0 0) 0x7fea3c06bc50 con 0x7fea3c1340c0 2023-10-03T10:17:47.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea39d9b700 1 --2- 172.21.15.72:0/4047606136 >> v2:172.21.15.72:3300/0 conn(0x7fea3c09f160 0x7fea3c133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.689+0000 7fea3a59c700 1 --2- 172.21.15.72:0/4047606136 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea3c09e850 0x7fea3c09ec20 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009840 tx=0x7fea2c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c78d6b890cf1b56 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.690+0000 7fea3959a700 1 -- 172.21.15.72:0/4047606136 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c011830 con 0x7fea3c09e850 2023-10-03T10:17:47.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.690+0000 7fea3959a700 1 -- 172.21.15.72:0/4047606136 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c011990 con 0x7fea3c09e850 2023-10-03T10:17:47.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.690+0000 7fea3959a700 1 -- 172.21.15.72:0/4047606136 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c011d20 con 0x7fea3c09e850 2023-10-03T10:17:47.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.690+0000 7fea40ec4700 1 -- 172.21.15.72:0/4047606136 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea3c09e850 msgr2=0x7fea3c09ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.690+0000 7fea40ec4700 1 --2- 172.21.15.72:0/4047606136 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea3c09e850 0x7fea3c09ec20 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009840 tx=0x7fea2c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:47.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.690+0000 7fea40ec4700 1 -- 172.21.15.72:0/4047606136 shutdown_connections 2023-10-03T10:17:47.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.690+0000 7fea40ec4700 1 --2- 172.21.15.72:0/4047606136 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea3c09e850 0x7fea3c09ec20 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.690+0000 7fea40ec4700 1 --2- 172.21.15.72:0/4047606136 >> v2:172.21.15.72:3300/0 conn(0x7fea3c09f160 0x7fea3c133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.690+0000 7fea40ec4700 1 -- 172.21.15.72:0/4047606136 >> 172.21.15.72:0/4047606136 conn(0x7fea3c0a3f70 msgr2=0x7fea3c0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.690+0000 7fea40ec4700 1 -- 172.21.15.72:0/4047606136 shutdown_connections 2023-10-03T10:17:47.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.690+0000 7fea40ec4700 1 -- 172.21.15.72:0/4047606136 wait complete. 2023-10-03T10:17:47.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.691+0000 7fea40ec4700 1 Processor -- start 2023-10-03T10:17:47.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.691+0000 7fea40ec4700 1 -- start start 2023-10-03T10:17:47.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea40ec4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c09e850 0x7fea3c1c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea40ec4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea3c09f160 0x7fea3c1c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea40ec4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea3c1340c0 0x7fea3c1c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea40ec4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c1266a0 con 0x7fea3c09e850 2023-10-03T10:17:47.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea40ec4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c124700 con 0x7fea3c1340c0 2023-10-03T10:17:47.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea40ec4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c06fb30 con 0x7fea3c09f160 2023-10-03T10:17:47.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea39d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea3c09f160 0x7fea3c1c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea3a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c09e850 0x7fea3c1c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea39d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea3c09f160 0x7fea3c1c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59282/0 (socket says 172.21.15.72:59282) 2023-10-03T10:17:47.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea39d9b700 1 -- 172.21.15.72:0/952644400 learned_addr learned my addr 172.21.15.72:0/952644400 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:47.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea3ad9d700 1 --2- 172.21.15.72:0/952644400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea3c1340c0 0x7fea3c1c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea39d9b700 1 -- 172.21.15.72:0/952644400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea3c1340c0 msgr2=0x7fea3c1c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea39d9b700 1 --2- 172.21.15.72:0/952644400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea3c1340c0 0x7fea3c1c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea39d9b700 1 -- 172.21.15.72:0/952644400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c09e850 msgr2=0x7fea3c1c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea39d9b700 1 --2- 172.21.15.72:0/952644400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c09e850 0x7fea3c1c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea39d9b700 1 -- 172.21.15.72:0/952644400 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea30009550 con 0x7fea3c09f160 2023-10-03T10:17:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.692+0000 7fea3a59c700 1 --2- 172.21.15.72:0/952644400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c09e850 0x7fea3c1c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.693+0000 7fea39d9b700 1 --2- 172.21.15.72:0/952644400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea3c09f160 0x7fea3c1c8840 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fea3000ec10 tx=0x7fea3000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.693+0000 7fea2affd700 1 -- 172.21.15.72:0/952644400 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3000c850 con 0x7fea3c09f160 2023-10-03T10:17:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.693+0000 7fea2affd700 1 -- 172.21.15.72:0/952644400 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3000c9b0 con 0x7fea3c09f160 2023-10-03T10:17:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.693+0000 7fea2affd700 1 -- 172.21.15.72:0/952644400 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3000cd40 con 0x7fea3c09f160 2023-10-03T10:17:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.693+0000 7fea40ec4700 1 -- 172.21.15.72:0/952644400 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2c0094a0 con 0x7fea3c09f160 2023-10-03T10:17:47.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.693+0000 7fea40ec4700 1 -- 172.21.15.72:0/952644400 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3c126070 con 0x7fea3c09f160 2023-10-03T10:17:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.694+0000 7fea2affd700 1 -- 172.21.15.72:0/952644400 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea30013470 con 0x7fea3c09f160 2023-10-03T10:17:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.694+0000 7fea2affd700 1 -- 172.21.15.72:0/952644400 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fea3003fc00 con 0x7fea3c09f160 2023-10-03T10:17:47.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.694+0000 7fea40ec4700 1 -- 172.21.15.72:0/952644400 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3c1264e0 con 0x7fea3c09f160 2023-10-03T10:17:47.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.699+0000 7fea2affd700 1 -- 172.21.15.72:0/952644400 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea3c1264e0 con 0x7fea3c09f160 2023-10-03T10:17:47.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.743+0000 7f7dc575f700 1 Processor -- start 2023-10-03T10:17:47.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.743+0000 7f7dc575f700 1 -- start start 2023-10-03T10:17:47.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.743+0000 7f7dc575f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc009f410 0x7f7dc0136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.743+0000 7f7dc575f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc0136fe0 0x7f7dc01393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.743+0000 7f7dc575f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc0070940 con 0x7f7dc009e930 2023-10-03T10:17:47.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.743+0000 7f7dc575f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc006fd60 con 0x7f7dc0136fe0 2023-10-03T10:17:47.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.743+0000 7f7dc575f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc006fa80 con 0x7f7dc009f410 2023-10-03T10:17:47.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.744+0000 7f7dbe7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc009f410 0x7f7dc0136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.744+0000 7f7dbe7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc009f410 0x7f7dc0136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59288/0 (socket says 172.21.15.72:59288) 2023-10-03T10:17:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.744+0000 7f7dbe7fc700 1 -- 172.21.15.72:0/1621004642 learned_addr learned my addr 172.21.15.72:0/1621004642 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.744+0000 7f7dbeffd700 1 --1- 172.21.15.72:0/1621004642 >> v1:172.21.15.72:6789/0 conn(0x7f7dc009e930 0x7f7dc009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:41422/0 (socket says 172.21.15.72:41422) 2023-10-03T10:17:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.744+0000 7f7dbf7fe700 1 --2- 172.21.15.72:0/1621004642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc0136fe0 0x7f7dc01393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.744+0000 7f7dbdffb700 1 -- 172.21.15.72:0/1621004642 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182490441 0 0) 0x7f7dc0070940 con 0x7f7dc009e930 2023-10-03T10:17:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.744+0000 7f7dbdffb700 1 -- 172.21.15.72:0/1621004642 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7da80035b0 con 0x7f7dc009e930 2023-10-03T10:17:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.744+0000 7f7dbf7fe700 1 -- 172.21.15.72:0/1621004642 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc009f410 msgr2=0x7f7dc0136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.744+0000 7f7dbf7fe700 1 --2- 172.21.15.72:0/1621004642 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc009f410 0x7f7dc0136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.744+0000 7f7dbf7fe700 1 -- 172.21.15.72:0/1621004642 >> v1:172.21.15.72:6789/0 conn(0x7f7dc009e930 legacy=0x7f7dc009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.744+0000 7f7dbf7fe700 1 -- 172.21.15.72:0/1621004642 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc009fb60 con 0x7f7dc0136fe0 2023-10-03T10:17:47.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.744+0000 7f7dbf7fe700 1 --2- 172.21.15.72:0/1621004642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc0136fe0 0x7f7dc01393c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009dc0 tx=0x7f7db800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1981fae2e2f50a6f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.744+0000 7f7dbdffb700 1 -- 172.21.15.72:0/1621004642 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db800e070 con 0x7f7dc0136fe0 2023-10-03T10:17:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.744+0000 7f7dbdffb700 1 -- 172.21.15.72:0/1621004642 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db800bae0 con 0x7f7dc0136fe0 2023-10-03T10:17:47.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.744+0000 7f7dbdffb700 1 -- 172.21.15.72:0/1621004642 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db800be90 con 0x7f7dc0136fe0 2023-10-03T10:17:47.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.745+0000 7f7dc575f700 1 -- 172.21.15.72:0/1621004642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc0136fe0 msgr2=0x7f7dc01393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.745+0000 7f7dc575f700 1 --2- 172.21.15.72:0/1621004642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc0136fe0 0x7f7dc01393c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009dc0 tx=0x7f7db800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.745+0000 7f7dc575f700 1 -- 172.21.15.72:0/1621004642 shutdown_connections 2023-10-03T10:17:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.745+0000 7f7dc575f700 1 --2- 172.21.15.72:0/1621004642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc0136fe0 0x7f7dc01393c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.745+0000 7f7dc575f700 1 --2- 172.21.15.72:0/1621004642 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc009f410 0x7f7dc0136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.745+0000 7f7dc575f700 1 -- 172.21.15.72:0/1621004642 >> 172.21.15.72:0/1621004642 conn(0x7f7dc00a4210 msgr2=0x7f7dc00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.745+0000 7f7dc575f700 1 -- 172.21.15.72:0/1621004642 shutdown_connections 2023-10-03T10:17:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.745+0000 7f7dc575f700 1 -- 172.21.15.72:0/1621004642 wait complete. 2023-10-03T10:17:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.747+0000 7f7dc575f700 1 Processor -- start 2023-10-03T10:17:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.747+0000 7f7dc575f700 1 -- start start 2023-10-03T10:17:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.747+0000 7f7dc575f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc009e930 0x7f7dc006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.747+0000 7f7dc575f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc009f410 0x7f7dc006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.747+0000 7f7dc575f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dc0136fe0 0x7f7dc006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.747+0000 7f7dc575f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc006d4c0 con 0x7f7dc0136fe0 2023-10-03T10:17:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.747+0000 7f7dc575f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc006d6b0 con 0x7f7dc009e930 2023-10-03T10:17:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.747+0000 7f7dc575f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc0124260 con 0x7f7dc009f410 2023-10-03T10:17:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7dbe7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc009f410 0x7f7dc006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7dbe7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc009f410 0x7f7dc006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59290/0 (socket says 172.21.15.72:59290) 2023-10-03T10:17:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7dbe7fc700 1 -- 172.21.15.72:0/3485301549 learned_addr learned my addr 172.21.15.72:0/3485301549 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7dbf7fe700 1 --2- 172.21.15.72:0/3485301549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dc0136fe0 0x7f7dc006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7dbeffd700 1 --2- 172.21.15.72:0/3485301549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc009e930 0x7f7dc006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7dbe7fc700 1 -- 172.21.15.72:0/3485301549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc009e930 msgr2=0x7f7dc006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7dbe7fc700 1 --2- 172.21.15.72:0/3485301549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc009e930 0x7f7dc006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7dbe7fc700 1 -- 172.21.15.72:0/3485301549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dc0136fe0 msgr2=0x7f7dc006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7dbe7fc700 1 --2- 172.21.15.72:0/3485301549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dc0136fe0 0x7f7dc006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7dbe7fc700 1 -- 172.21.15.72:0/3485301549 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db8009a70 con 0x7f7dc009f410 2023-10-03T10:17:47.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7dbe7fc700 1 --2- 172.21.15.72:0/3485301549 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc009f410 0x7f7dc006bdf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7db400e910 tx=0x7f7db400ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7da77fe700 1 -- 172.21.15.72:0/3485301549 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db40096a0 con 0x7f7dc009f410 2023-10-03T10:17:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7da77fe700 1 -- 172.21.15.72:0/3485301549 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db4013680 con 0x7f7dc009f410 2023-10-03T10:17:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7dc575f700 1 -- 172.21.15.72:0/3485301549 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc00a3310 con 0x7f7dc009f410 2023-10-03T10:17:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7da77fe700 1 -- 172.21.15.72:0/3485301549 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db4013a30 con 0x7f7dc009f410 2023-10-03T10:17:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.748+0000 7f7dc575f700 1 -- 172.21.15.72:0/3485301549 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc0122b40 con 0x7f7dc009f410 2023-10-03T10:17:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.750+0000 7f7dc575f700 1 -- 172.21.15.72:0/3485301549 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc0074ea0 con 0x7f7dc009f410 2023-10-03T10:17:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.750+0000 7f7da77fe700 1 -- 172.21.15.72:0/3485301549 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7db4013b90 con 0x7f7dc009f410 2023-10-03T10:17:47.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.750+0000 7f7da77fe700 1 -- 172.21.15.72:0/3485301549 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7db403fe20 con 0x7f7dc009f410 2023-10-03T10:17:47.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.755+0000 7f7da77fe700 1 -- 172.21.15.72:0/3485301549 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7db4011350 con 0x7f7dc009f410 2023-10-03T10:17:47.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.860+0000 7f79aa32b700 1 -- 172.21.15.72:0/3489076567 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f79a411af50 con 0x7f79a4130e50 2023-10-03T10:17:47.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.861+0000 7f79a0ff9700 1 -- 172.21.15.72:0/3489076567 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f79a411af50 con 0x7f79a4130e50 2023-10-03T10:17:47.861 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:47.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.864+0000 7f79aa32b700 1 -- 172.21.15.72:0/3489076567 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79a4130e50 msgr2=0x7f79a4119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.864+0000 7f79aa32b700 1 --2- 172.21.15.72:0/3489076567 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79a4130e50 0x7f79a4119750 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f799c009e50 tx=0x7f799c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.864+0000 7f79aa32b700 1 -- 172.21.15.72:0/3489076567 shutdown_connections 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.864+0000 7f79aa32b700 1 --2- 172.21.15.72:0/3489076567 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79a4130e50 0x7f79a4119750 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.864+0000 7f79aa32b700 1 --2- 172.21.15.72:0/3489076567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79a406fb20 0x7f79a4118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.864+0000 7f79aa32b700 1 --2- 172.21.15.72:0/3489076567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79a4130540 0x7f79a4119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.864+0000 7f79aa32b700 1 -- 172.21.15.72:0/3489076567 >> 172.21.15.72:0/3489076567 conn(0x7f79a40a2aa0 msgr2=0x7f79a412d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.864+0000 7f79aa32b700 1 -- 172.21.15.72:0/3489076567 shutdown_connections 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.864+0000 7f79aa32b700 1 -- 172.21.15.72:0/3489076567 wait complete. 2023-10-03T10:17:47.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:47.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.909+0000 7fea40ec4700 1 -- 172.21.15.72:0/952644400 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fea3c1264e0 con 0x7fea3c09f160 2023-10-03T10:17:47.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.909+0000 7fea2affd700 1 -- 172.21.15.72:0/952644400 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea3c1264e0 con 0x7fea3c09f160 2023-10-03T10:17:47.910 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:47.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.911+0000 7fea40ec4700 1 -- 172.21.15.72:0/952644400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea3c09f160 msgr2=0x7fea3c1c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.911+0000 7fea40ec4700 1 --2- 172.21.15.72:0/952644400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea3c09f160 0x7fea3c1c8840 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fea3000ec10 tx=0x7fea3000ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:47.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.911+0000 7fea40ec4700 1 -- 172.21.15.72:0/952644400 shutdown_connections 2023-10-03T10:17:47.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.911+0000 7fea40ec4700 1 --2- 172.21.15.72:0/952644400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fea3c09e850 0x7fea3c1c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.911+0000 7fea40ec4700 1 --2- 172.21.15.72:0/952644400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fea3c1340c0 0x7fea3c1c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.911+0000 7fea40ec4700 1 --2- 172.21.15.72:0/952644400 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fea3c09f160 0x7fea3c1c8840 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.911+0000 7fea40ec4700 1 -- 172.21.15.72:0/952644400 >> 172.21.15.72:0/952644400 conn(0x7fea3c0a3f70 msgr2=0x7fea3c070ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.912+0000 7fea40ec4700 1 -- 172.21.15.72:0/952644400 shutdown_connections 2023-10-03T10:17:47.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.912+0000 7fea40ec4700 1 -- 172.21.15.72:0/952644400 wait complete. 2023-10-03T10:17:47.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:47.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.949+0000 7f7dc575f700 1 -- 172.21.15.72:0/3485301549 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7dc006b250 con 0x7f7dc009f410 2023-10-03T10:17:47.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.950+0000 7f7da77fe700 1 -- 172.21.15.72:0/3485301549 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7db4017070 con 0x7f7dc009f410 2023-10-03T10:17:47.950 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:47.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.952+0000 7f7dc575f700 1 -- 172.21.15.72:0/3485301549 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc009f410 msgr2=0x7f7dc006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.952+0000 7f7dc575f700 1 --2- 172.21.15.72:0/3485301549 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc009f410 0x7f7dc006bdf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7db400e910 tx=0x7f7db400ec20 comp rx=0 tx=0).stop 2023-10-03T10:17:47.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.952+0000 7f7dc575f700 1 -- 172.21.15.72:0/3485301549 shutdown_connections 2023-10-03T10:17:47.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.952+0000 7f7dc575f700 1 --2- 172.21.15.72:0/3485301549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7dc0136fe0 0x7f7dc006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.952+0000 7f7dc575f700 1 --2- 172.21.15.72:0/3485301549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7dc009e930 0x7f7dc006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.952+0000 7f7dc575f700 1 --2- 172.21.15.72:0/3485301549 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7dc009f410 0x7f7dc006bdf0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.952+0000 7f7dc575f700 1 -- 172.21.15.72:0/3485301549 >> 172.21.15.72:0/3485301549 conn(0x7f7dc00a4210 msgr2=0x7f7dc0134890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.952+0000 7f7dc575f700 1 -- 172.21.15.72:0/3485301549 shutdown_connections 2023-10-03T10:17:47.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:47.952+0000 7f7dc575f700 1 -- 172.21.15.72:0/3485301549 wait complete. 2023-10-03T10:17:47.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:48.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:48.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.145+0000 7fb0800a8700 1 Processor -- start 2023-10-03T10:17:48.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.145+0000 7fb0800a8700 1 -- start start 2023-10-03T10:17:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb0800a8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb07809d6f0 0x7fb07809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb0800a8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb07809e000 0x7fb078130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb0800a8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb07809e410 0x7fb078130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb0800a8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07809f520 con 0x7fb07809d6f0 2023-10-03T10:17:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb0800a8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07809f130 con 0x7fb07809e000 2023-10-03T10:17:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb0800a8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb07809e930 con 0x7fb07809e410 2023-10-03T10:17:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb07de44700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb07809d6f0 0x7fb07809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb07e645700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb07809e410 0x7fb078130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb07d643700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb07809e000 0x7fb078130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb07e645700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb07809e410 0x7fb078130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59292/0 (socket says 172.21.15.72:59292) 2023-10-03T10:17:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb07de44700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb07809d6f0 0x7fb07809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41212/0 (socket says 172.21.15.72:41212) 2023-10-03T10:17:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb07d643700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb07809e000 0x7fb078130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:39986/0 (socket says 172.21.15.72:39986) 2023-10-03T10:17:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb07e645700 1 -- 172.21.15.72:0/2730439902 learned_addr learned my addr 172.21.15.72:0/2730439902 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb07e645700 1 -- 172.21.15.72:0/2730439902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb07809e000 msgr2=0x7fb078130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb07e645700 1 --2- 172.21.15.72:0/2730439902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb07809e000 0x7fb078130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb07e645700 1 -- 172.21.15.72:0/2730439902 >> v2:172.21.15.72:3300/0 conn(0x7fb07809d6f0 msgr2=0x7fb07809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb07e645700 1 --2- 172.21.15.72:0/2730439902 >> v2:172.21.15.72:3300/0 conn(0x7fb07809d6f0 0x7fb07809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb07e645700 1 -- 172.21.15.72:0/2730439902 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07809b2d0 con 0x7fb07809e410 2023-10-03T10:17:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb07d643700 1 --2- 172.21.15.72:0/2730439902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb07809e000 0x7fb078130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb07de44700 1 --2- 172.21.15.72:0/2730439902 >> v2:172.21.15.72:3300/0 conn(0x7fb07809d6f0 0x7fb07809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.146+0000 7fb07e645700 1 --2- 172.21.15.72:0/2730439902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb07809e410 0x7fb078130ba0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb068009e80 tx=0x7fb06800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d60864ea2a20218 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.147+0000 7fb07ce42700 1 -- 172.21.15.72:0/2730439902 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06800e070 con 0x7fb07809e410 2023-10-03T10:17:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.147+0000 7fb07ce42700 1 -- 172.21.15.72:0/2730439902 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06800b8d0 con 0x7fb07809e410 2023-10-03T10:17:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.147+0000 7fb07ce42700 1 -- 172.21.15.72:0/2730439902 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06800bc80 con 0x7fb07809e410 2023-10-03T10:17:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.147+0000 7fb0800a8700 1 -- 172.21.15.72:0/2730439902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb07809e410 msgr2=0x7fb078130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.147+0000 7fb0800a8700 1 --2- 172.21.15.72:0/2730439902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb07809e410 0x7fb078130ba0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb068009e80 tx=0x7fb06800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.147+0000 7fb0800a8700 1 -- 172.21.15.72:0/2730439902 shutdown_connections 2023-10-03T10:17:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.147+0000 7fb0800a8700 1 --2- 172.21.15.72:0/2730439902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb07809e410 0x7fb078130ba0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.147+0000 7fb0800a8700 1 --2- 172.21.15.72:0/2730439902 >> v2:172.21.15.72:3300/0 conn(0x7fb07809d6f0 0x7fb07809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.147+0000 7fb0800a8700 1 --2- 172.21.15.72:0/2730439902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb07809e000 0x7fb078130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.147+0000 7fb0800a8700 1 -- 172.21.15.72:0/2730439902 >> 172.21.15.72:0/2730439902 conn(0x7fb078066f50 msgr2=0x7fb07809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.147+0000 7fb0800a8700 1 -- 172.21.15.72:0/2730439902 shutdown_connections 2023-10-03T10:17:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.147+0000 7fb0800a8700 1 -- 172.21.15.72:0/2730439902 wait complete. 2023-10-03T10:17:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.148+0000 7fb0800a8700 1 Processor -- start 2023-10-03T10:17:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.148+0000 7fb0800a8700 1 -- start start 2023-10-03T10:17:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb0800a8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb07809d6f0 0x7fb078122960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb0800a8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb07809e000 0x7fb078122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb0800a8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb07809e410 0x7fb0781233e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb0800a8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb078126fe0 con 0x7fb07809d6f0 2023-10-03T10:17:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb0800a8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb078125e60 con 0x7fb07809e000 2023-10-03T10:17:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb0800a8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb078126120 con 0x7fb07809e410 2023-10-03T10:17:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb07de44700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb07809d6f0 0x7fb078122960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb07de44700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb07809d6f0 0x7fb078122960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41226/0 (socket says 172.21.15.72:41226) 2023-10-03T10:17:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb07de44700 1 -- 172.21.15.72:0/2805495060 learned_addr learned my addr 172.21.15.72:0/2805495060 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb07e645700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb07809e410 0x7fb0781233e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb07d643700 1 --2- 172.21.15.72:0/2805495060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb07809e000 0x7fb078122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb07de44700 1 -- 172.21.15.72:0/2805495060 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb07809e410 msgr2=0x7fb0781233e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb07de44700 1 --2- 172.21.15.72:0/2805495060 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb07809e410 0x7fb0781233e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb07de44700 1 -- 172.21.15.72:0/2805495060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb07809e000 msgr2=0x7fb078122ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb07de44700 1 --2- 172.21.15.72:0/2805495060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb07809e000 0x7fb078122ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb07de44700 1 -- 172.21.15.72:0/2805495060 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0700094a0 con 0x7fb07809d6f0 2023-10-03T10:17:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb07e645700 1 --2- 172.21.15.72:0/2805495060 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb07809e410 0x7fb0781233e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb07d643700 1 --2- 172.21.15.72:0/2805495060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb07809e000 0x7fb078122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb07de44700 1 --2- 172.21.15.72:0/2805495060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb07809d6f0 0x7fb078122960 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fb07000ebe0 tx=0x7fb07000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb0767fc700 1 -- 172.21.15.72:0/2805495060 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070009780 con 0x7fb07809d6f0 2023-10-03T10:17:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb0767fc700 1 -- 172.21.15.72:0/2805495060 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07000c850 con 0x7fb07809d6f0 2023-10-03T10:17:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb0800a8700 1 -- 172.21.15.72:0/2805495060 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06c0094a0 con 0x7fb07809d6f0 2023-10-03T10:17:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb0767fc700 1 -- 172.21.15.72:0/2805495060 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07000cbe0 con 0x7fb07809d6f0 2023-10-03T10:17:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.149+0000 7fb0800a8700 1 -- 172.21.15.72:0/2805495060 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb068009b30 con 0x7fb07809d6f0 2023-10-03T10:17:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.150+0000 7fb0767fc700 1 -- 172.21.15.72:0/2805495060 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb07000cd40 con 0x7fb07809d6f0 2023-10-03T10:17:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.150+0000 7fb0767fc700 1 -- 172.21.15.72:0/2805495060 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb07003f720 con 0x7fb07809d6f0 2023-10-03T10:17:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.150+0000 7fb0800a8700 1 -- 172.21.15.72:0/2805495060 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb078074ea0 con 0x7fb07809d6f0 2023-10-03T10:17:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.155+0000 7fb0767fc700 1 -- 172.21.15.72:0/2805495060 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0700232f0 con 0x7fb07809d6f0 2023-10-03T10:17:48.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.338+0000 7fb0800a8700 1 -- 172.21.15.72:0/2805495060 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb0780721b0 con 0x7fb07809d6f0 2023-10-03T10:17:48.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.338+0000 7fb0767fc700 1 -- 172.21.15.72:0/2805495060 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb070021030 con 0x7fb07809d6f0 2023-10-03T10:17:48.339 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.340+0000 7fb0800a8700 1 -- 172.21.15.72:0/2805495060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb07809d6f0 msgr2=0x7fb078122960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.340+0000 7fb0800a8700 1 --2- 172.21.15.72:0/2805495060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb07809d6f0 0x7fb078122960 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fb07000ebe0 tx=0x7fb07000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.340+0000 7fb0800a8700 1 -- 172.21.15.72:0/2805495060 shutdown_connections 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.340+0000 7fb0800a8700 1 --2- 172.21.15.72:0/2805495060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb07809d6f0 0x7fb078122960 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.340+0000 7fb0800a8700 1 --2- 172.21.15.72:0/2805495060 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb07809e410 0x7fb0781233e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.340+0000 7fb0800a8700 1 --2- 172.21.15.72:0/2805495060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb07809e000 0x7fb078122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.340+0000 7fb0800a8700 1 -- 172.21.15.72:0/2805495060 >> 172.21.15.72:0/2805495060 conn(0x7fb078066f50 msgr2=0x7fb07806b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.340+0000 7fb0800a8700 1 -- 172.21.15.72:0/2805495060 shutdown_connections 2023-10-03T10:17:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:48.340+0000 7fb0800a8700 1 -- 172.21.15.72:0/2805495060 wait complete. 2023-10-03T10:17:48.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:48.882 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:48.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:48.965 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:49.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.013+0000 7f0ae0752700 1 Processor -- start 2023-10-03T10:17:49.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.013+0000 7f0ae0752700 1 -- start start 2023-10-03T10:17:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0ae0752700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ad81316c0 0x7f0ad8131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0ae0752700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ad806ae80 0x7f0ad8139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0ae0752700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad809e130 con 0x7f0ad809d9f0 2023-10-03T10:17:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0ae0752700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad81312b0 con 0x7f0ad81316c0 2023-10-03T10:17:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0ae0752700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad809f6e0 con 0x7f0ad806ae80 2023-10-03T10:17:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0ade4ee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ad81316c0 0x7f0ad8131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0ade4ee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ad81316c0 0x7f0ad8131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53670/0 (socket says 172.21.15.72:53670) 2023-10-03T10:17:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0ade4ee700 1 -- 172.21.15.72:0/2770863216 learned_addr learned my addr 172.21.15.72:0/2770863216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0adecef700 1 --2- 172.21.15.72:0/2770863216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ad806ae80 0x7f0ad8139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0adecef700 1 -- 172.21.15.72:0/2770863216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ad81316c0 msgr2=0x7f0ad8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0adecef700 1 --2- 172.21.15.72:0/2770863216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ad81316c0 0x7f0ad8131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0adecef700 1 -- 172.21.15.72:0/2770863216 >> v1:172.21.15.72:6789/0 conn(0x7f0ad809d9f0 legacy=0x7f0ad806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0adecef700 1 -- 172.21.15.72:0/2770863216 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad809e760 con 0x7f0ad806ae80 2023-10-03T10:17:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0adecef700 1 --2- 172.21.15.72:0/2770863216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ad806ae80 0x7f0ad8139550 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009dc0 tx=0x7f0ad000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba17270ca3afbcd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0add4ec700 1 -- 172.21.15.72:0/2770863216 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad000e070 con 0x7f0ad806ae80 2023-10-03T10:17:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0add4ec700 1 -- 172.21.15.72:0/2770863216 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad000bb20 con 0x7f0ad806ae80 2023-10-03T10:17:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.014+0000 7f0add4ec700 1 -- 172.21.15.72:0/2770863216 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0012430 con 0x7f0ad806ae80 2023-10-03T10:17:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.015+0000 7f0ae0752700 1 -- 172.21.15.72:0/2770863216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ad806ae80 msgr2=0x7f0ad8139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.015+0000 7f0ae0752700 1 --2- 172.21.15.72:0/2770863216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ad806ae80 0x7f0ad8139550 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009dc0 tx=0x7f0ad000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.015+0000 7f0ae0752700 1 -- 172.21.15.72:0/2770863216 shutdown_connections 2023-10-03T10:17:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.015+0000 7f0ae0752700 1 --2- 172.21.15.72:0/2770863216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ad806ae80 0x7f0ad8139550 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.015+0000 7f0ae0752700 1 --2- 172.21.15.72:0/2770863216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ad81316c0 0x7f0ad8131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.015+0000 7f0ae0752700 1 -- 172.21.15.72:0/2770863216 >> 172.21.15.72:0/2770863216 conn(0x7f0ad8066f50 msgr2=0x7f0ad809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.016+0000 7f0ae0752700 1 -- 172.21.15.72:0/2770863216 shutdown_connections 2023-10-03T10:17:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.016+0000 7f0ae0752700 1 -- 172.21.15.72:0/2770863216 wait complete. 2023-10-03T10:17:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.017+0000 7f0ae0752700 1 Processor -- start 2023-10-03T10:17:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.017+0000 7f0ae0752700 1 -- start start 2023-10-03T10:17:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0ae0752700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ad806ae80 0x7f0ad8070a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0ae0752700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ad809d9f0 0x7f0ad8070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0ae0752700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ad81316c0 0x7f0ad8071500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0ae0752700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad8071ec0 con 0x7f0ad81316c0 2023-10-03T10:17:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0ae0752700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad80a36b0 con 0x7f0ad806ae80 2023-10-03T10:17:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0ae0752700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad811bac0 con 0x7f0ad809d9f0 2023-10-03T10:17:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0addced700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ad809d9f0 0x7f0ad8070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0ade4ee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ad806ae80 0x7f0ad8070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0adecef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ad81316c0 0x7f0ad8071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0addced700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ad809d9f0 0x7f0ad8070fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41818/0 (socket says 172.21.15.72:41818) 2023-10-03T10:17:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0adecef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ad81316c0 0x7f0ad8071500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51502/0 (socket says 172.21.15.72:51502) 2023-10-03T10:17:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0ade4ee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ad806ae80 0x7f0ad8070a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53678/0 (socket says 172.21.15.72:53678) 2023-10-03T10:17:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0addced700 1 -- 172.21.15.72:0/4024142841 learned_addr learned my addr 172.21.15.72:0/4024142841 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0adecef700 1 -- 172.21.15.72:0/4024142841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ad809d9f0 msgr2=0x7f0ad8070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0adecef700 1 --2- 172.21.15.72:0/4024142841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ad809d9f0 0x7f0ad8070fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0adecef700 1 -- 172.21.15.72:0/4024142841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ad806ae80 msgr2=0x7f0ad8070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0adecef700 1 --2- 172.21.15.72:0/4024142841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ad806ae80 0x7f0ad8070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0adecef700 1 -- 172.21.15.72:0/4024142841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad0009a70 con 0x7f0ad81316c0 2023-10-03T10:17:49.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0addced700 1 --2- 172.21.15.72:0/4024142841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ad809d9f0 0x7f0ad8070fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0ade4ee700 1 --2- 172.21.15.72:0/4024142841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ad806ae80 0x7f0ad8070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0adecef700 1 --2- 172.21.15.72:0/4024142841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ad81316c0 0x7f0ad8071500 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0016000 tx=0x7f0ad0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.018+0000 7f0aceffd700 1 -- 172.21.15.72:0/4024142841 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0004800 con 0x7f0ad81316c0 2023-10-03T10:17:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.019+0000 7f0aceffd700 1 -- 172.21.15.72:0/4024142841 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad0020070 con 0x7f0ad81316c0 2023-10-03T10:17:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.019+0000 7f0ae0752700 1 -- 172.21.15.72:0/4024142841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad80726a0 con 0x7f0ad81316c0 2023-10-03T10:17:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.019+0000 7f0aceffd700 1 -- 172.21.15.72:0/4024142841 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00276c0 con 0x7f0ad81316c0 2023-10-03T10:17:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.019+0000 7f0ae0752700 1 -- 172.21.15.72:0/4024142841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad81197c0 con 0x7f0ad81316c0 2023-10-03T10:17:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.019+0000 7f0aceffd700 1 -- 172.21.15.72:0/4024142841 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ad0012430 con 0x7f0ad81316c0 2023-10-03T10:17:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.020+0000 7f0aceffd700 1 -- 172.21.15.72:0/4024142841 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0ad0022070 con 0x7f0ad81316c0 2023-10-03T10:17:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.020+0000 7f0ae0752700 1 -- 172.21.15.72:0/4024142841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad8074ea0 con 0x7f0ad81316c0 2023-10-03T10:17:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.024+0000 7f0aceffd700 1 -- 172.21.15.72:0/4024142841 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ad001c400 con 0x7f0ad81316c0 2023-10-03T10:17:49.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.053+0000 7f4a6366c700 1 Processor -- start 2023-10-03T10:17:49.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.053+0000 7f4a6366c700 1 -- start start 2023-10-03T10:17:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a6366c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a5c09e930 0x7f4a5c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a6366c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a5c09f240 0x7f4a5c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a6366c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4a5c09f650 0x7f4a5c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a6366c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5c070940 con 0x7f4a5c09f650 2023-10-03T10:17:49.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a6366c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c06fd60 con 0x7f4a5c09e930 2023-10-03T10:17:49.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a6366c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c06fa80 con 0x7f4a5c09f240 2023-10-03T10:17:49.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a60c07700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a5c09f240 0x7f4a5c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a61c09700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4a5c09f650 0x7f4a5c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a61408700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a5c09e930 0x7f4a5c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a60c07700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a5c09f240 0x7f4a5c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41834/0 (socket says 172.21.15.72:41834) 2023-10-03T10:17:49.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a61408700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a5c09e930 0x7f4a5c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53692/0 (socket says 172.21.15.72:53692) 2023-10-03T10:17:49.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a60c07700 1 -- 172.21.15.72:0/1076183762 learned_addr learned my addr 172.21.15.72:0/1076183762 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:49.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a61c09700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4a5c09f650 0x7f4a5c131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51518/0 (socket says 172.21.15.72:51518) 2023-10-03T10:17:49.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a61408700 1 -- 172.21.15.72:0/1076183762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a5c09f240 msgr2=0x7f4a5c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a61408700 1 --2- 172.21.15.72:0/1076183762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a5c09f240 0x7f4a5c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a61408700 1 -- 172.21.15.72:0/1076183762 >> v2:172.21.15.72:3300/0 conn(0x7f4a5c09f650 msgr2=0x7f4a5c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a61408700 1 --2- 172.21.15.72:0/1076183762 >> v2:172.21.15.72:3300/0 conn(0x7f4a5c09f650 0x7f4a5c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a61408700 1 -- 172.21.15.72:0/1076183762 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c09fb60 con 0x7f4a5c09e930 2023-10-03T10:17:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.054+0000 7f4a61c09700 1 --2- 172.21.15.72:0/1076183762 >> v2:172.21.15.72:3300/0 conn(0x7f4a5c09f650 0x7f4a5c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.055+0000 7f4a61408700 1 --2- 172.21.15.72:0/1076183762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a5c09e930 0x7f4a5c09ed00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009840 tx=0x7f4a58009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41c7bedf3a6a9388 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.055+0000 7f4a53fff700 1 -- 172.21.15.72:0/1076183762 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58011830 con 0x7f4a5c09e930 2023-10-03T10:17:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.055+0000 7f4a53fff700 1 -- 172.21.15.72:0/1076183762 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a58011990 con 0x7f4a5c09e930 2023-10-03T10:17:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.055+0000 7f4a53fff700 1 -- 172.21.15.72:0/1076183762 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58011d20 con 0x7f4a5c09e930 2023-10-03T10:17:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.055+0000 7f4a6366c700 1 -- 172.21.15.72:0/1076183762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a5c09e930 msgr2=0x7f4a5c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.055+0000 7f4a6366c700 1 --2- 172.21.15.72:0/1076183762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a5c09e930 0x7f4a5c09ed00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009840 tx=0x7f4a58009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.055+0000 7f4a6366c700 1 -- 172.21.15.72:0/1076183762 shutdown_connections 2023-10-03T10:17:49.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.055+0000 7f4a6366c700 1 --2- 172.21.15.72:0/1076183762 >> v2:172.21.15.72:3300/0 conn(0x7f4a5c09f650 0x7f4a5c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.055+0000 7f4a6366c700 1 --2- 172.21.15.72:0/1076183762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a5c09e930 0x7f4a5c09ed00 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.055+0000 7f4a6366c700 1 --2- 172.21.15.72:0/1076183762 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a5c09f240 0x7f4a5c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.055+0000 7f4a6366c700 1 -- 172.21.15.72:0/1076183762 >> 172.21.15.72:0/1076183762 conn(0x7f4a5c0a4210 msgr2=0x7f4a5c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.056+0000 7f4a6366c700 1 -- 172.21.15.72:0/1076183762 shutdown_connections 2023-10-03T10:17:49.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.056+0000 7f4a6366c700 1 -- 172.21.15.72:0/1076183762 wait complete. 2023-10-03T10:17:49.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.057+0000 7f4a6366c700 1 Processor -- start 2023-10-03T10:17:49.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.057+0000 7f4a6366c700 1 -- start start 2023-10-03T10:17:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a6366c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a5c09e930 0x7f4a5c1a2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a6366c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a5c09f240 0x7f4a5c1a3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a6366c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a5c09f650 0x7f4a5c1a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a6366c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c1a6500 con 0x7f4a5c09f240 2023-10-03T10:17:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a6366c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c1a49e0 con 0x7f4a5c09f650 2023-10-03T10:17:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a6366c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c0a3580 con 0x7f4a5c09e930 2023-10-03T10:17:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a61c09700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a5c09f650 0x7f4a5c1a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a61c09700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a5c09f650 0x7f4a5c1a3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53696/0 (socket says 172.21.15.72:53696) 2023-10-03T10:17:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a61c09700 1 -- 172.21.15.72:0/3540338214 learned_addr learned my addr 172.21.15.72:0/3540338214 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a61408700 1 --2- 172.21.15.72:0/3540338214 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a5c09e930 0x7f4a5c1a2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a60c07700 1 --2- 172.21.15.72:0/3540338214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a5c09f240 0x7f4a5c1a3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a61c09700 1 -- 172.21.15.72:0/3540338214 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a5c09e930 msgr2=0x7f4a5c1a2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a61c09700 1 --2- 172.21.15.72:0/3540338214 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a5c09e930 0x7f4a5c1a2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a61c09700 1 -- 172.21.15.72:0/3540338214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a5c09f240 msgr2=0x7f4a5c1a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a61c09700 1 --2- 172.21.15.72:0/3540338214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a5c09f240 0x7f4a5c1a3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a61c09700 1 -- 172.21.15.72:0/3540338214 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a54009a70 con 0x7f4a5c09f650 2023-10-03T10:17:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a61c09700 1 --2- 172.21.15.72:0/3540338214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a5c09f650 0x7f4a5c1a3740 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400ef90 tx=0x7f4a5400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a51ffb700 1 -- 172.21.15.72:0/3540338214 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5400cd40 con 0x7f4a5c09f650 2023-10-03T10:17:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a51ffb700 1 -- 172.21.15.72:0/3540338214 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5400f040 con 0x7f4a5c09f650 2023-10-03T10:17:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a6366c700 1 -- 172.21.15.72:0/3540338214 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a580094a0 con 0x7f4a5c09f650 2023-10-03T10:17:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.058+0000 7f4a51ffb700 1 -- 172.21.15.72:0/3540338214 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54013800 con 0x7f4a5c09f650 2023-10-03T10:17:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.059+0000 7f4a6366c700 1 -- 172.21.15.72:0/3540338214 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5c0a0190 con 0x7f4a5c09f650 2023-10-03T10:17:49.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.059+0000 7f4a51ffb700 1 -- 172.21.15.72:0/3540338214 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a54013960 con 0x7f4a5c09f650 2023-10-03T10:17:49.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.059+0000 7f4a51ffb700 1 -- 172.21.15.72:0/3540338214 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4a54043bc0 con 0x7f4a5c09f650 2023-10-03T10:17:49.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.060+0000 7f4a6366c700 1 -- 172.21.15.72:0/3540338214 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5c074ea0 con 0x7f4a5c09f650 2023-10-03T10:17:49.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.065+0000 7f4a51ffb700 1 -- 172.21.15.72:0/3540338214 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a54007d70 con 0x7f4a5c09f650 2023-10-03T10:17:49.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.101+0000 7f8759b80700 1 Processor -- start 2023-10-03T10:17:49.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.101+0000 7f8759b80700 1 -- start start 2023-10-03T10:17:49.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.101+0000 7f8759b80700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8754130750 0x7f8754130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.101+0000 7f8759b80700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875409d6f0 0x7f875409db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.101+0000 7f8759b80700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875409e080 0x7f87541374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.101+0000 7f8759b80700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f875409c190 con 0x7f8754130750 2023-10-03T10:17:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.101+0000 7f8759b80700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875409b090 con 0x7f875409e080 2023-10-03T10:17:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.101+0000 7f8759b80700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f875409a6c0 con 0x7f875409d6f0 2023-10-03T10:17:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.101+0000 7f8752ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875409d6f0 0x7f875409db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.101+0000 7f87537fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8754130750 0x7f8754130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.102+0000 7f8752ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875409d6f0 0x7f875409db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41844/0 (socket says 172.21.15.72:41844) 2023-10-03T10:17:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.102+0000 7f8752ffd700 1 -- 172.21.15.72:0/3367181690 learned_addr learned my addr 172.21.15.72:0/3367181690 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.102+0000 7f8753fff700 1 --2- 172.21.15.72:0/3367181690 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875409e080 0x7f87541374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.102+0000 7f8752ffd700 1 -- 172.21.15.72:0/3367181690 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875409e080 msgr2=0x7f87541374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.102+0000 7f8752ffd700 1 --2- 172.21.15.72:0/3367181690 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875409e080 0x7f87541374b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.102+0000 7f8752ffd700 1 -- 172.21.15.72:0/3367181690 >> v2:172.21.15.72:3300/0 conn(0x7f8754130750 msgr2=0x7f8754130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.102+0000 7f8752ffd700 1 --2- 172.21.15.72:0/3367181690 >> v2:172.21.15.72:3300/0 conn(0x7f8754130750 0x7f8754130b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.102+0000 7f8752ffd700 1 -- 172.21.15.72:0/3367181690 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8754131060 con 0x7f875409d6f0 2023-10-03T10:17:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.102+0000 7f8753fff700 1 --2- 172.21.15.72:0/3367181690 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875409e080 0x7f87541374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.102+0000 7f87537fe700 1 --2- 172.21.15.72:0/3367181690 >> v2:172.21.15.72:3300/0 conn(0x7f8754130750 0x7f8754130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.102+0000 7f8752ffd700 1 --2- 172.21.15.72:0/3367181690 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875409d6f0 0x7f875409db40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f87480098f0 tx=0x7f8748009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=537cbd3076dfddc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.102+0000 7f87527fc700 1 -- 172.21.15.72:0/3367181690 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874800d940 con 0x7f875409d6f0 2023-10-03T10:17:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.102+0000 7f87527fc700 1 -- 172.21.15.72:0/3367181690 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874800c070 con 0x7f875409d6f0 2023-10-03T10:17:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.102+0000 7f87527fc700 1 -- 172.21.15.72:0/3367181690 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874800dcc0 con 0x7f875409d6f0 2023-10-03T10:17:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.103+0000 7f8759b80700 1 -- 172.21.15.72:0/3367181690 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875409d6f0 msgr2=0x7f875409db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.103+0000 7f8759b80700 1 --2- 172.21.15.72:0/3367181690 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875409d6f0 0x7f875409db40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f87480098f0 tx=0x7f8748009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.103+0000 7f8759b80700 1 -- 172.21.15.72:0/3367181690 shutdown_connections 2023-10-03T10:17:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.103+0000 7f8759b80700 1 --2- 172.21.15.72:0/3367181690 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875409e080 0x7f87541374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.103+0000 7f8759b80700 1 --2- 172.21.15.72:0/3367181690 >> v2:172.21.15.72:3300/0 conn(0x7f8754130750 0x7f8754130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.103+0000 7f8759b80700 1 --2- 172.21.15.72:0/3367181690 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f875409d6f0 0x7f875409db40 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.103+0000 7f8759b80700 1 -- 172.21.15.72:0/3367181690 >> 172.21.15.72:0/3367181690 conn(0x7f875409f470 msgr2=0x7f87540a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.103+0000 7f8759b80700 1 -- 172.21.15.72:0/3367181690 shutdown_connections 2023-10-03T10:17:49.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.103+0000 7f8759b80700 1 -- 172.21.15.72:0/3367181690 wait complete. 2023-10-03T10:17:49.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.104+0000 7f8759b80700 1 Processor -- start 2023-10-03T10:17:49.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.104+0000 7f8759b80700 1 -- start start 2023-10-03T10:17:49.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.104+0000 7f8759b80700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875409d6f0 0x7f875412ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.104+0000 7f8759b80700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875409e080 0x7f875412b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.104+0000 7f8759b80700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8754130750 0x7f875412b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.104+0000 7f8759b80700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875412e5e0 con 0x7f875409d6f0 2023-10-03T10:17:49.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.104+0000 7f8759b80700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875412d4d0 con 0x7f875409e080 2023-10-03T10:17:49.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.104+0000 7f8759b80700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f875412d990 con 0x7f8754130750 2023-10-03T10:17:49.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f8752ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875409e080 0x7f875412b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f8752ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875409e080 0x7f875412b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53712/0 (socket says 172.21.15.72:53712) 2023-10-03T10:17:49.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f8752ffd700 1 -- 172.21.15.72:0/1491218284 learned_addr learned my addr 172.21.15.72:0/1491218284 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:49.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f8753fff700 1 --2- 172.21.15.72:0/1491218284 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8754130750 0x7f875412b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f87537fe700 1 --2- 172.21.15.72:0/1491218284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875409d6f0 0x7f875412ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f8753fff700 1 -- 172.21.15.72:0/1491218284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875409e080 msgr2=0x7f875412b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f8753fff700 1 --2- 172.21.15.72:0/1491218284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875409e080 0x7f875412b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f8753fff700 1 -- 172.21.15.72:0/1491218284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875409d6f0 msgr2=0x7f875412ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f8753fff700 1 --2- 172.21.15.72:0/1491218284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875409d6f0 0x7f875412ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f8753fff700 1 -- 172.21.15.72:0/1491218284 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c009a70 con 0x7f8754130750 2023-10-03T10:17:49.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f8753fff700 1 --2- 172.21.15.72:0/1491218284 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8754130750 0x7f875412b590 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f874c012110 tx=0x7f874c012420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f873bfff700 1 -- 172.21.15.72:0/1491218284 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c014040 con 0x7f8754130750 2023-10-03T10:17:49.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f873bfff700 1 -- 172.21.15.72:0/1491218284 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c012cb0 con 0x7f8754130750 2023-10-03T10:17:49.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f873bfff700 1 -- 172.21.15.72:0/1491218284 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c003a20 con 0x7f8754130750 2023-10-03T10:17:49.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f8759b80700 1 -- 172.21.15.72:0/1491218284 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87440094a0 con 0x7f8754130750 2023-10-03T10:17:49.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.105+0000 7f8759b80700 1 -- 172.21.15.72:0/1491218284 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8748009550 con 0x7f8754130750 2023-10-03T10:17:49.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.106+0000 7f873bfff700 1 -- 172.21.15.72:0/1491218284 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f874c021410 con 0x7f8754130750 2023-10-03T10:17:49.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.106+0000 7f8759b80700 1 -- 172.21.15.72:0/1491218284 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87540747f0 con 0x7f8754130750 2023-10-03T10:17:49.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.107+0000 7f873bfff700 1 -- 172.21.15.72:0/1491218284 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f874c043fd0 con 0x7f8754130750 2023-10-03T10:17:49.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.111+0000 7f873bfff700 1 -- 172.21.15.72:0/1491218284 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f874c007920 con 0x7f8754130750 2023-10-03T10:17:49.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.223+0000 7f0ae0752700 1 -- 172.21.15.72:0/4024142841 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0ad81301b0 con 0x7f0ad81316c0 2023-10-03T10:17:49.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.223+0000 7f0aceffd700 1 -- 172.21.15.72:0/4024142841 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0ad00263e0 con 0x7f0ad81316c0 2023-10-03T10:17:49.224 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:49.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.226+0000 7f0ae0752700 1 -- 172.21.15.72:0/4024142841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ad81316c0 msgr2=0x7f0ad8071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.226+0000 7f0ae0752700 1 --2- 172.21.15.72:0/4024142841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ad81316c0 0x7f0ad8071500 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0016000 tx=0x7f0ad0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.226+0000 7f0ae0752700 1 -- 172.21.15.72:0/4024142841 shutdown_connections 2023-10-03T10:17:49.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.226+0000 7f0ae0752700 1 --2- 172.21.15.72:0/4024142841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ad81316c0 0x7f0ad8071500 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.226+0000 7f0ae0752700 1 --2- 172.21.15.72:0/4024142841 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ad806ae80 0x7f0ad8070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.226+0000 7f0ae0752700 1 --2- 172.21.15.72:0/4024142841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0ad809d9f0 0x7f0ad8070fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.226+0000 7f0ae0752700 1 -- 172.21.15.72:0/4024142841 >> 172.21.15.72:0/4024142841 conn(0x7f0ad8066f50 msgr2=0x7f0ad80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.226+0000 7f0ae0752700 1 -- 172.21.15.72:0/4024142841 shutdown_connections 2023-10-03T10:17:49.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.226+0000 7f0ae0752700 1 -- 172.21.15.72:0/4024142841 wait complete. 2023-10-03T10:17:49.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:49.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.261+0000 7f4a6366c700 1 -- 172.21.15.72:0/3540338214 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4a5c06b250 con 0x7f4a5c09f650 2023-10-03T10:17:49.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.261+0000 7f4a51ffb700 1 -- 172.21.15.72:0/3540338214 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4a54020020 con 0x7f4a5c09f650 2023-10-03T10:17:49.262 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:49.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.263+0000 7f4a6366c700 1 -- 172.21.15.72:0/3540338214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a5c09f650 msgr2=0x7f4a5c1a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.263+0000 7f4a6366c700 1 --2- 172.21.15.72:0/3540338214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a5c09f650 0x7f4a5c1a3740 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400ef90 tx=0x7f4a5400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.263+0000 7f4a6366c700 1 -- 172.21.15.72:0/3540338214 shutdown_connections 2023-10-03T10:17:49.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.263+0000 7f4a6366c700 1 --2- 172.21.15.72:0/3540338214 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a5c09f650 0x7f4a5c1a3740 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.263+0000 7f4a6366c700 1 --2- 172.21.15.72:0/3540338214 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a5c09e930 0x7f4a5c1a2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.263+0000 7f4a6366c700 1 --2- 172.21.15.72:0/3540338214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a5c09f240 0x7f4a5c1a3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.263+0000 7f4a6366c700 1 -- 172.21.15.72:0/3540338214 >> 172.21.15.72:0/3540338214 conn(0x7f4a5c0a4210 msgr2=0x7f4a5c09c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.263+0000 7f4a6366c700 1 -- 172.21.15.72:0/3540338214 shutdown_connections 2023-10-03T10:17:49.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.263+0000 7f4a6366c700 1 -- 172.21.15.72:0/3540338214 wait complete. 2023-10-03T10:17:49.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:49.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.306+0000 7f8759b80700 1 -- 172.21.15.72:0/1491218284 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f875406b250 con 0x7f8754130750 2023-10-03T10:17:49.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.306+0000 7f873bfff700 1 -- 172.21.15.72:0/1491218284 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f874c007330 con 0x7f8754130750 2023-10-03T10:17:49.307 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:49.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.308+0000 7f8759b80700 1 -- 172.21.15.72:0/1491218284 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8754130750 msgr2=0x7f875412b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.308+0000 7f8759b80700 1 --2- 172.21.15.72:0/1491218284 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8754130750 0x7f875412b590 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f874c012110 tx=0x7f874c012420 comp rx=0 tx=0).stop 2023-10-03T10:17:49.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.308+0000 7f8759b80700 1 -- 172.21.15.72:0/1491218284 shutdown_connections 2023-10-03T10:17:49.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.308+0000 7f8759b80700 1 --2- 172.21.15.72:0/1491218284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f875409d6f0 0x7f875412ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.308+0000 7f8759b80700 1 --2- 172.21.15.72:0/1491218284 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8754130750 0x7f875412b590 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.308+0000 7f8759b80700 1 --2- 172.21.15.72:0/1491218284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f875409e080 0x7f875412b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.308+0000 7f8759b80700 1 -- 172.21.15.72:0/1491218284 >> 172.21.15.72:0/1491218284 conn(0x7f875409f470 msgr2=0x7f87540718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.308+0000 7f8759b80700 1 -- 172.21.15.72:0/1491218284 shutdown_connections 2023-10-03T10:17:49.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.308+0000 7f8759b80700 1 -- 172.21.15.72:0/1491218284 wait complete. 2023-10-03T10:17:49.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:49.354 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:49.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.481+0000 7f91d0278700 1 Processor -- start 2023-10-03T10:17:49.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.481+0000 7f91d0278700 1 -- start start 2023-10-03T10:17:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91d0278700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91c809e1b0 0x7f91c8138a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91d0278700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91c8138f50 0x7f91c813b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91d0278700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c809a570 con 0x7f91c809d6d0 2023-10-03T10:17:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91d0278700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c809e5a0 con 0x7f91c8138f50 2023-10-03T10:17:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91d0278700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c809b1c0 con 0x7f91c809e1b0 2023-10-03T10:17:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91cd813700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91c809e1b0 0x7f91c8138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91ce815700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91c8138f50 0x7f91c813b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91ce815700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91c8138f50 0x7f91c813b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51560/0 (socket says 172.21.15.72:51560) 2023-10-03T10:17:49.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91cd813700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91c809e1b0 0x7f91c8138a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53718/0 (socket says 172.21.15.72:53718) 2023-10-03T10:17:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91ce815700 1 -- 172.21.15.72:0/3876011948 learned_addr learned my addr 172.21.15.72:0/3876011948 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91ce014700 1 --1- 172.21.15.72:0/3876011948 >> v1:172.21.15.72:6789/0 conn(0x7f91c809d6d0 0x7f91c809daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52572/0 (socket says 172.21.15.72:52572) 2023-10-03T10:17:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91cd813700 1 -- 172.21.15.72:0/3876011948 >> v2:172.21.15.72:3300/0 conn(0x7f91c8138f50 msgr2=0x7f91c813b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91cd813700 1 --2- 172.21.15.72:0/3876011948 >> v2:172.21.15.72:3300/0 conn(0x7f91c8138f50 0x7f91c813b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91cd813700 1 -- 172.21.15.72:0/3876011948 >> v1:172.21.15.72:6789/0 conn(0x7f91c809d6d0 legacy=0x7f91c809daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91cd813700 1 -- 172.21.15.72:0/3876011948 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c809f240 con 0x7f91c809e1b0 2023-10-03T10:17:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91ce815700 1 --2- 172.21.15.72:0/3876011948 >> v2:172.21.15.72:3300/0 conn(0x7f91c8138f50 0x7f91c813b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91cd813700 1 --2- 172.21.15.72:0/3876011948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91c809e1b0 0x7f91c8138a10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009840 tx=0x7f91c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=669f1bc19533bbf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91cd012700 1 -- 172.21.15.72:0/3876011948 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4011830 con 0x7f91c809e1b0 2023-10-03T10:17:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91cd012700 1 -- 172.21.15.72:0/3876011948 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c4011990 con 0x7f91c809e1b0 2023-10-03T10:17:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.482+0000 7f91cd012700 1 -- 172.21.15.72:0/3876011948 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4011d20 con 0x7f91c809e1b0 2023-10-03T10:17:49.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.483+0000 7f91d0278700 1 -- 172.21.15.72:0/3876011948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91c809e1b0 msgr2=0x7f91c8138a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.483+0000 7f91d0278700 1 --2- 172.21.15.72:0/3876011948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91c809e1b0 0x7f91c8138a10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009840 tx=0x7f91c4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:49.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.483+0000 7f91d0278700 1 -- 172.21.15.72:0/3876011948 shutdown_connections 2023-10-03T10:17:49.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.483+0000 7f91d0278700 1 --2- 172.21.15.72:0/3876011948 >> v2:172.21.15.72:3300/0 conn(0x7f91c8138f50 0x7f91c813b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.483+0000 7f91d0278700 1 --2- 172.21.15.72:0/3876011948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91c809e1b0 0x7f91c8138a10 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.483+0000 7f91d0278700 1 -- 172.21.15.72:0/3876011948 >> 172.21.15.72:0/3876011948 conn(0x7f91c8099c20 msgr2=0x7f91c80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.483+0000 7f91d0278700 1 -- 172.21.15.72:0/3876011948 shutdown_connections 2023-10-03T10:17:49.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.483+0000 7f91d0278700 1 -- 172.21.15.72:0/3876011948 wait complete. 2023-10-03T10:17:49.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.484+0000 7f91d0278700 1 Processor -- start 2023-10-03T10:17:49.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.484+0000 7f91d0278700 1 -- start start 2023-10-03T10:17:49.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.484+0000 7f91d0278700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91c809d6d0 0x7f91c811dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.484+0000 7f91d0278700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91c809e1b0 0x7f91c811e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.484+0000 7f91d0278700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c8138f50 0x7f91c81c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.484+0000 7f91d0278700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c809c900 con 0x7f91c8138f50 2023-10-03T10:17:49.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.484+0000 7f91d0278700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c811dbd0 con 0x7f91c809e1b0 2023-10-03T10:17:49.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.484+0000 7f91d0278700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91c8138140 con 0x7f91c809d6d0 2023-10-03T10:17:49.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91cd813700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91c809e1b0 0x7f91c811e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91ce014700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91c809d6d0 0x7f91c811dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91ce815700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c8138f50 0x7f91c81c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91cd813700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91c809e1b0 0x7f91c811e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53730/0 (socket says 172.21.15.72:53730) 2023-10-03T10:17:49.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91cd813700 1 -- 172.21.15.72:0/2551736070 learned_addr learned my addr 172.21.15.72:0/2551736070 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:49.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91ce815700 1 -- 172.21.15.72:0/2551736070 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91c809d6d0 msgr2=0x7f91c811dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91ce815700 1 --2- 172.21.15.72:0/2551736070 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91c809d6d0 0x7f91c811dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91ce815700 1 -- 172.21.15.72:0/2551736070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91c809e1b0 msgr2=0x7f91c811e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91ce815700 1 --2- 172.21.15.72:0/2551736070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91c809e1b0 0x7f91c811e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91ce815700 1 -- 172.21.15.72:0/2551736070 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c0009b30 con 0x7f91c8138f50 2023-10-03T10:17:49.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91cd813700 1 --2- 172.21.15.72:0/2551736070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91c809e1b0 0x7f91c811e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91ce815700 1 --2- 172.21.15.72:0/2551736070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c8138f50 0x7f91c81c8180 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f91c000ef90 tx=0x7f91c000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91beffd700 1 -- 172.21.15.72:0/2551736070 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0018070 con 0x7f91c8138f50 2023-10-03T10:17:49.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91beffd700 1 -- 172.21.15.72:0/2551736070 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c000f040 con 0x7f91c8138f50 2023-10-03T10:17:49.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91d0278700 1 -- 172.21.15.72:0/2551736070 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c40094a0 con 0x7f91c8138f50 2023-10-03T10:17:49.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91beffd700 1 -- 172.21.15.72:0/2551736070 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0003c60 con 0x7f91c8138f50 2023-10-03T10:17:49.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.485+0000 7f91d0278700 1 -- 172.21.15.72:0/2551736070 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c811ffd0 con 0x7f91c8138f50 2023-10-03T10:17:49.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.486+0000 7f91beffd700 1 -- 172.21.15.72:0/2551736070 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91c000c880 con 0x7f91c8138f50 2023-10-03T10:17:49.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.486+0000 7f91d0278700 1 -- 172.21.15.72:0/2551736070 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c811fb20 con 0x7f91c8138f50 2023-10-03T10:17:49.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.486+0000 7f91beffd700 1 -- 172.21.15.72:0/2551736070 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f91c003f5f0 con 0x7f91c8138f50 2023-10-03T10:17:49.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.491+0000 7f91beffd700 1 -- 172.21.15.72:0/2551736070 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91c0003dc0 con 0x7f91c8138f50 2023-10-03T10:17:49.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.673+0000 7f91d0278700 1 -- 172.21.15.72:0/2551736070 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f91c8120e90 con 0x7f91c8138f50 2023-10-03T10:17:49.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.674+0000 7f91beffd700 1 -- 172.21.15.72:0/2551736070 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91c8120e90 con 0x7f91c8138f50 2023-10-03T10:17:49.674 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:49.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.676+0000 7f91d0278700 1 -- 172.21.15.72:0/2551736070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c8138f50 msgr2=0x7f91c81c8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.676+0000 7f91d0278700 1 --2- 172.21.15.72:0/2551736070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c8138f50 0x7f91c81c8180 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f91c000ef90 tx=0x7f91c000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.676+0000 7f91d0278700 1 -- 172.21.15.72:0/2551736070 shutdown_connections 2023-10-03T10:17:49.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.676+0000 7f91d0278700 1 --2- 172.21.15.72:0/2551736070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91c8138f50 0x7f91c81c8180 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.676+0000 7f91d0278700 1 --2- 172.21.15.72:0/2551736070 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91c809d6d0 0x7f91c811dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.676+0000 7f91d0278700 1 --2- 172.21.15.72:0/2551736070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91c809e1b0 0x7f91c811e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.676+0000 7f91d0278700 1 -- 172.21.15.72:0/2551736070 >> 172.21.15.72:0/2551736070 conn(0x7f91c8099c20 msgr2=0x7f91c81338f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.676+0000 7f91d0278700 1 -- 172.21.15.72:0/2551736070 shutdown_connections 2023-10-03T10:17:49.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:49.676+0000 7f91d0278700 1 -- 172.21.15.72:0/2551736070 wait complete. 2023-10-03T10:17:49.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:50.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:50.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:50.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:50.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.373+0000 7f98388c8700 1 Processor -- start 2023-10-03T10:17:50.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.374+0000 7f98388c8700 1 -- start start 2023-10-03T10:17:50.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.374+0000 7f98388c8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f983406e570 0x7f983406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.374+0000 7f98388c8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f983409eca0 0x7f983406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.374+0000 7f98388c8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9834134610 0x7f9834134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.374+0000 7f98388c8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9834070ee0 con 0x7f983409eca0 2023-10-03T10:17:50.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.374+0000 7f98388c8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9834071480 con 0x7f9834134610 2023-10-03T10:17:50.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.374+0000 7f98388c8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f983406f3c0 con 0x7f983406e570 2023-10-03T10:17:50.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.374+0000 7f983259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f983406e570 0x7f983406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.374+0000 7f9831d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f983409eca0 0x7f983406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.374+0000 7f983259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f983406e570 0x7f983406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41876/0 (socket says 172.21.15.72:41876) 2023-10-03T10:17:50.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.374+0000 7f983259c700 1 -- 172.21.15.72:0/3458889535 learned_addr learned my addr 172.21.15.72:0/3458889535 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:50.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.375+0000 7f9832d9d700 1 --2- 172.21.15.72:0/3458889535 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9834134610 0x7f9834134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.375+0000 7f9831d9b700 1 -- 172.21.15.72:0/3458889535 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f983406e570 msgr2=0x7f983406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.375+0000 7f9831d9b700 1 --2- 172.21.15.72:0/3458889535 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f983406e570 0x7f983406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.375+0000 7f9831d9b700 1 -- 172.21.15.72:0/3458889535 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9834134610 msgr2=0x7f9834134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.375+0000 7f9831d9b700 1 --2- 172.21.15.72:0/3458889535 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9834134610 0x7f9834134a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.375+0000 7f9831d9b700 1 -- 172.21.15.72:0/3458889535 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9834071b90 con 0x7f983409eca0 2023-10-03T10:17:50.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.375+0000 7f983259c700 1 --2- 172.21.15.72:0/3458889535 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f983406e570 0x7f983406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.375+0000 7f9832d9d700 1 --2- 172.21.15.72:0/3458889535 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9834134610 0x7f9834134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.375+0000 7f9831d9b700 1 --2- 172.21.15.72:0/3458889535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f983409eca0 0x7f983406ee80 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f9828009840 tx=0x7f9828009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8198d634ac099e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.375+0000 7f983159a700 1 -- 172.21.15.72:0/3458889535 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828011830 con 0x7f983409eca0 2023-10-03T10:17:50.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.375+0000 7f983159a700 1 -- 172.21.15.72:0/3458889535 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9828011990 con 0x7f983409eca0 2023-10-03T10:17:50.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.375+0000 7f983159a700 1 -- 172.21.15.72:0/3458889535 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828011d20 con 0x7f983409eca0 2023-10-03T10:17:50.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.376+0000 7f98388c8700 1 -- 172.21.15.72:0/3458889535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f983409eca0 msgr2=0x7f983406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.376+0000 7f98388c8700 1 --2- 172.21.15.72:0/3458889535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f983409eca0 0x7f983406ee80 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f9828009840 tx=0x7f9828009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:50.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.376+0000 7f98388c8700 1 -- 172.21.15.72:0/3458889535 shutdown_connections 2023-10-03T10:17:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.376+0000 7f98388c8700 1 --2- 172.21.15.72:0/3458889535 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9834134610 0x7f9834134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.376+0000 7f98388c8700 1 --2- 172.21.15.72:0/3458889535 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f983406e570 0x7f983406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.376+0000 7f98388c8700 1 --2- 172.21.15.72:0/3458889535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f983409eca0 0x7f983406ee80 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.376+0000 7f98388c8700 1 -- 172.21.15.72:0/3458889535 >> 172.21.15.72:0/3458889535 conn(0x7f98340a2aa0 msgr2=0x7f98340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.376+0000 7f98388c8700 1 -- 172.21.15.72:0/3458889535 shutdown_connections 2023-10-03T10:17:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.376+0000 7f98388c8700 1 -- 172.21.15.72:0/3458889535 wait complete. 2023-10-03T10:17:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.377+0000 7f98388c8700 1 Processor -- start 2023-10-03T10:17:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.377+0000 7f98388c8700 1 -- start start 2023-10-03T10:17:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.377+0000 7f98388c8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f983406e570 0x7f98341214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.377+0000 7f98388c8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9834134610 0x7f9834121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f98388c8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9834121f60 0x7f98341d2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f98388c8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9834123200 con 0x7f983406e570 2023-10-03T10:17:50.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f98388c8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9834124ab0 con 0x7f9834134610 2023-10-03T10:17:50.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f98388c8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9834124240 con 0x7f9834121f60 2023-10-03T10:17:50.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f9832d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9834121f60 0x7f98341d2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f983259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f983406e570 0x7f98341214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f9832d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9834121f60 0x7f98341d2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41880/0 (socket says 172.21.15.72:41880) 2023-10-03T10:17:50.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f983259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f983406e570 0x7f98341214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51588/0 (socket says 172.21.15.72:51588) 2023-10-03T10:17:50.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f9832d9d700 1 -- 172.21.15.72:0/566694505 learned_addr learned my addr 172.21.15.72:0/566694505 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:50.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f9831d9b700 1 --2- 172.21.15.72:0/566694505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9834134610 0x7f9834121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f9832d9d700 1 -- 172.21.15.72:0/566694505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9834134610 msgr2=0x7f9834121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f9832d9d700 1 --2- 172.21.15.72:0/566694505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9834134610 0x7f9834121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f9832d9d700 1 -- 172.21.15.72:0/566694505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f983406e570 msgr2=0x7f98341214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f9832d9d700 1 --2- 172.21.15.72:0/566694505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f983406e570 0x7f98341214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f9832d9d700 1 -- 172.21.15.72:0/566694505 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9824009550 con 0x7f9834121f60 2023-10-03T10:17:50.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f983259c700 1 --2- 172.21.15.72:0/566694505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f983406e570 0x7f98341214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f9832d9d700 1 --2- 172.21.15.72:0/566694505 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9834121f60 0x7f98341d2d90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f982c00efc0 tx=0x7f982c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f9822ffd700 1 -- 172.21.15.72:0/566694505 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c00ca90 con 0x7f9834121f60 2023-10-03T10:17:50.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f9822ffd700 1 -- 172.21.15.72:0/566694505 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c00f040 con 0x7f9834121f60 2023-10-03T10:17:50.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f98388c8700 1 -- 172.21.15.72:0/566694505 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982c009a70 con 0x7f9834121f60 2023-10-03T10:17:50.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.378+0000 7f9822ffd700 1 -- 172.21.15.72:0/566694505 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c00ce10 con 0x7f9834121f60 2023-10-03T10:17:50.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.379+0000 7f98388c8700 1 -- 172.21.15.72:0/566694505 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98280094a0 con 0x7f9834121f60 2023-10-03T10:17:50.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.379+0000 7f9822ffd700 1 -- 172.21.15.72:0/566694505 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f982c014480 con 0x7f9834121f60 2023-10-03T10:17:50.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.379+0000 7f9822ffd700 1 -- 172.21.15.72:0/566694505 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f982c03fc40 con 0x7f9834121f60 2023-10-03T10:17:50.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.380+0000 7f98388c8700 1 -- 172.21.15.72:0/566694505 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983409b1e0 con 0x7f9834121f60 2023-10-03T10:17:50.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.384+0000 7f9822ffd700 1 -- 172.21.15.72:0/566694505 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f982c012930 con 0x7f9834121f60 2023-10-03T10:17:50.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.413+0000 7ff3d1b38700 1 Processor -- start 2023-10-03T10:17:50.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.413+0000 7ff3d1b38700 1 -- start start 2023-10-03T10:17:50.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.413+0000 7ff3d1b38700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3cc09e930 0x7ff3cc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.413+0000 7ff3d1b38700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3cc09f650 0x7ff3cc131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.413+0000 7ff3d1b38700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3cc070940 con 0x7ff3cc09f240 2023-10-03T10:17:50.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.413+0000 7ff3d1b38700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc06fd60 con 0x7ff3cc09e930 2023-10-03T10:17:50.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.413+0000 7ff3d1b38700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc06fa80 con 0x7ff3cc09f650 2023-10-03T10:17:50.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.413+0000 7ff3caffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff3cc09f240 0x7ff3cc1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52584/0 (socket says 172.21.15.72:52584) 2023-10-03T10:17:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.413+0000 7ff3cbfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3cc09f650 0x7ff3cc131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.413+0000 7ff3caffd700 1 -- 172.21.15.72:0/1161396951 learned_addr learned my addr 172.21.15.72:0/1161396951 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.413+0000 7ff3cb7fe700 1 --2- 172.21.15.72:0/1161396951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3cc09e930 0x7ff3cc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.414+0000 7ff3ca7fc700 1 -- 172.21.15.72:0/1161396951 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617732337 0 0) 0x7ff3cc070940 con 0x7ff3cc09f240 2023-10-03T10:17:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.414+0000 7ff3cb7fe700 1 -- 172.21.15.72:0/1161396951 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3cc09f650 msgr2=0x7ff3cc131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.414+0000 7ff3cb7fe700 1 --2- 172.21.15.72:0/1161396951 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3cc09f650 0x7ff3cc131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.414+0000 7ff3cb7fe700 1 -- 172.21.15.72:0/1161396951 >> v1:172.21.15.72:6789/0 conn(0x7ff3cc09f240 legacy=0x7ff3cc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.414+0000 7ff3cb7fe700 1 -- 172.21.15.72:0/1161396951 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc09fb60 con 0x7ff3cc09e930 2023-10-03T10:17:50.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.414+0000 7ff3cb7fe700 1 --2- 172.21.15.72:0/1161396951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3cc09e930 0x7ff3cc09ed00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009870 tx=0x7ff3bc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae1a06aba5290f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.414+0000 7ff3ca7fc700 1 -- 172.21.15.72:0/1161396951 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc011830 con 0x7ff3cc09e930 2023-10-03T10:17:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.414+0000 7ff3ca7fc700 1 -- 172.21.15.72:0/1161396951 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc011990 con 0x7ff3cc09e930 2023-10-03T10:17:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.414+0000 7ff3ca7fc700 1 -- 172.21.15.72:0/1161396951 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc011d20 con 0x7ff3cc09e930 2023-10-03T10:17:50.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.415+0000 7ff3d1b38700 1 -- 172.21.15.72:0/1161396951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3cc09e930 msgr2=0x7ff3cc09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.415+0000 7ff3d1b38700 1 --2- 172.21.15.72:0/1161396951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3cc09e930 0x7ff3cc09ed00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009870 tx=0x7ff3bc009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.415+0000 7ff3d1b38700 1 -- 172.21.15.72:0/1161396951 shutdown_connections 2023-10-03T10:17:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.415+0000 7ff3d1b38700 1 --2- 172.21.15.72:0/1161396951 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3cc09f650 0x7ff3cc131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.415+0000 7ff3d1b38700 1 --2- 172.21.15.72:0/1161396951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3cc09e930 0x7ff3cc09ed00 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.415+0000 7ff3d1b38700 1 -- 172.21.15.72:0/1161396951 >> 172.21.15.72:0/1161396951 conn(0x7ff3cc0a4210 msgr2=0x7ff3cc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.415+0000 7ff3d1b38700 1 -- 172.21.15.72:0/1161396951 shutdown_connections 2023-10-03T10:17:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.415+0000 7ff3d1b38700 1 -- 172.21.15.72:0/1161396951 wait complete. 2023-10-03T10:17:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.416+0000 7ff3d1b38700 1 Processor -- start 2023-10-03T10:17:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.416+0000 7ff3d1b38700 1 -- start start 2023-10-03T10:17:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.416+0000 7ff3d1b38700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3cc09e930 0x7ff3cc06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.416+0000 7ff3d1b38700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3cc09f240 0x7ff3cc06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.416+0000 7ff3d1b38700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc09f650 0x7ff3cc06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.416+0000 7ff3d1b38700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc06cd80 con 0x7ff3cc09f650 2023-10-03T10:17:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.416+0000 7ff3d1b38700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc1b7190 con 0x7ff3cc09e930 2023-10-03T10:17:50.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.416+0000 7ff3d1b38700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc1a9340 con 0x7ff3cc09f240 2023-10-03T10:17:50.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.416+0000 7ff3cb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3cc09e930 0x7ff3cc06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.416+0000 7ff3cb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3cc09e930 0x7ff3cc06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53766/0 (socket says 172.21.15.72:53766) 2023-10-03T10:17:50.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.416+0000 7ff3cb7fe700 1 -- 172.21.15.72:0/2292324902 learned_addr learned my addr 172.21.15.72:0/2292324902 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:50.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.416+0000 7ff3caffd700 1 --2- 172.21.15.72:0/2292324902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3cc09f240 0x7ff3cc06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.416+0000 7ff3cbfff700 1 --2- 172.21.15.72:0/2292324902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc09f650 0x7ff3cc06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.417+0000 7ff3cb7fe700 1 -- 172.21.15.72:0/2292324902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3cc09f240 msgr2=0x7ff3cc06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.417+0000 7ff3cb7fe700 1 --2- 172.21.15.72:0/2292324902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3cc09f240 0x7ff3cc06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.417+0000 7ff3cb7fe700 1 -- 172.21.15.72:0/2292324902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc09f650 msgr2=0x7ff3cc06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.417+0000 7ff3cb7fe700 1 --2- 172.21.15.72:0/2292324902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc09f650 0x7ff3cc06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.417+0000 7ff3cb7fe700 1 -- 172.21.15.72:0/2292324902 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc0094a0 con 0x7ff3cc09e930 2023-10-03T10:17:50.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.417+0000 7ff3cb7fe700 1 --2- 172.21.15.72:0/2292324902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3cc09e930 0x7ff3cc06b8b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009840 tx=0x7ff3bc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.417+0000 7ff3b3fff700 1 -- 172.21.15.72:0/2292324902 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc004510 con 0x7ff3cc09e930 2023-10-03T10:17:50.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.417+0000 7ff3b3fff700 1 -- 172.21.15.72:0/2292324902 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc01f070 con 0x7ff3cc09e930 2023-10-03T10:17:50.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.417+0000 7ff3d1b38700 1 -- 172.21.15.72:0/2292324902 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3cc0a0190 con 0x7ff3cc09e930 2023-10-03T10:17:50.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.417+0000 7ff3b3fff700 1 -- 172.21.15.72:0/2292324902 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc0038e0 con 0x7ff3cc09e930 2023-10-03T10:17:50.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.417+0000 7ff3d1b38700 1 -- 172.21.15.72:0/2292324902 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3cc1a9070 con 0x7ff3cc09e930 2023-10-03T10:17:50.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.418+0000 7ff3b3fff700 1 -- 172.21.15.72:0/2292324902 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff3bc003a40 con 0x7ff3cc09e930 2023-10-03T10:17:50.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.418+0000 7ff3b3fff700 1 -- 172.21.15.72:0/2292324902 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff3bc021070 con 0x7ff3cc09e930 2023-10-03T10:17:50.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.418+0000 7ff3d1b38700 1 -- 172.21.15.72:0/2292324902 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3cc0a34c0 con 0x7ff3cc09e930 2023-10-03T10:17:50.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.423+0000 7ff3b3fff700 1 -- 172.21.15.72:0/2292324902 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3bc010380 con 0x7ff3cc09e930 2023-10-03T10:17:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.455+0000 7f697ee8a700 1 Processor -- start 2023-10-03T10:17:50.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.455+0000 7f697ee8a700 1 -- start start 2023-10-03T10:17:50.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.455+0000 7f697ee8a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6978133420 0x7f69781337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.455+0000 7f697ee8a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6978133e30 0x7f697812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.455+0000 7f697ee8a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697806b990 con 0x7f6978134260 2023-10-03T10:17:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.455+0000 7f697ee8a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69780a0590 con 0x7f6978133e30 2023-10-03T10:17:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.455+0000 7f697ee8a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f697809fb80 con 0x7f6978133420 2023-10-03T10:17:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.455+0000 7f697d427700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6978134260 0x7f69781304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52600/0 (socket says 172.21.15.72:52600) 2023-10-03T10:17:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.455+0000 7f6977fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6978133e30 0x7f697812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.455+0000 7f697d427700 1 -- 172.21.15.72:0/1047146485 learned_addr learned my addr 172.21.15.72:0/1047146485 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.455+0000 7f697cc26700 1 --2- 172.21.15.72:0/1047146485 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6978133420 0x7f69781337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.456+0000 7f69777fe700 1 -- 172.21.15.72:0/1047146485 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366520296 0 0) 0x7f697806b990 con 0x7f6978134260 2023-10-03T10:17:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.456+0000 7f69777fe700 1 -- 172.21.15.72:0/1047146485 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69680035b0 con 0x7f6978134260 2023-10-03T10:17:50.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.456+0000 7f697cc26700 1 -- 172.21.15.72:0/1047146485 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6978133e30 msgr2=0x7f697812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.456+0000 7f697cc26700 1 --2- 172.21.15.72:0/1047146485 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6978133e30 0x7f697812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.456+0000 7f697cc26700 1 -- 172.21.15.72:0/1047146485 >> v1:172.21.15.72:6789/0 conn(0x7f6978134260 legacy=0x7f69781304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.456+0000 7f697cc26700 1 -- 172.21.15.72:0/1047146485 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69780a0030 con 0x7f6978133420 2023-10-03T10:17:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.456+0000 7f6977fff700 1 --2- 172.21.15.72:0/1047146485 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6978133e30 0x7f697812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.456+0000 7f697cc26700 1 --2- 172.21.15.72:0/1047146485 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6978133420 0x7f69781337f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f696c009870 tx=0x7f696c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3016c4e50d56cdd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.456+0000 7f69777fe700 1 -- 172.21.15.72:0/1047146485 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c011830 con 0x7f6978133420 2023-10-03T10:17:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.456+0000 7f69777fe700 1 -- 172.21.15.72:0/1047146485 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c011990 con 0x7f6978133420 2023-10-03T10:17:50.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.456+0000 7f69777fe700 1 -- 172.21.15.72:0/1047146485 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c011d00 con 0x7f6978133420 2023-10-03T10:17:50.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.457+0000 7f697ee8a700 1 -- 172.21.15.72:0/1047146485 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6978133420 msgr2=0x7f69781337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.457+0000 7f697ee8a700 1 --2- 172.21.15.72:0/1047146485 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6978133420 0x7f69781337f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f696c009870 tx=0x7f696c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:50.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.457+0000 7f697ee8a700 1 -- 172.21.15.72:0/1047146485 shutdown_connections 2023-10-03T10:17:50.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.457+0000 7f697ee8a700 1 --2- 172.21.15.72:0/1047146485 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6978133420 0x7f69781337f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.457+0000 7f697ee8a700 1 --2- 172.21.15.72:0/1047146485 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6978133e30 0x7f697812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.457+0000 7f697ee8a700 1 -- 172.21.15.72:0/1047146485 >> 172.21.15.72:0/1047146485 conn(0x7f69780a4210 msgr2=0x7f69780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.457+0000 7f697ee8a700 1 -- 172.21.15.72:0/1047146485 shutdown_connections 2023-10-03T10:17:50.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.457+0000 7f697ee8a700 1 -- 172.21.15.72:0/1047146485 wait complete. 2023-10-03T10:17:50.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.458+0000 7f697ee8a700 1 Processor -- start 2023-10-03T10:17:50.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.458+0000 7f697ee8a700 1 -- start start 2023-10-03T10:17:50.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.459+0000 7f697ee8a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6978133420 0x7f697809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.459+0000 7f697ee8a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6978133e30 0x7f697809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.459+0000 7f697ee8a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6978134260 0x7f697809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.459+0000 7f697ee8a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697811ffb0 con 0x7f6978134260 2023-10-03T10:17:50.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.459+0000 7f697ee8a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697811f4b0 con 0x7f6978133e30 2023-10-03T10:17:50.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.459+0000 7f697ee8a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6978120190 con 0x7f6978133420 2023-10-03T10:17:50.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.459+0000 7f697cc26700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6978133420 0x7f697809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.459+0000 7f697cc26700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6978133420 0x7f697809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41920/0 (socket says 172.21.15.72:41920) 2023-10-03T10:17:50.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.459+0000 7f6977fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6978133e30 0x7f697809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.459+0000 7f697cc26700 1 -- 172.21.15.72:0/919587305 learned_addr learned my addr 172.21.15.72:0/919587305 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:50.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.459+0000 7f697d427700 1 --2- 172.21.15.72:0/919587305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6978134260 0x7f697809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.460+0000 7f697cc26700 1 -- 172.21.15.72:0/919587305 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6978133e30 msgr2=0x7f697809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.460+0000 7f697cc26700 1 --2- 172.21.15.72:0/919587305 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6978133e30 0x7f697809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.460+0000 7f697cc26700 1 -- 172.21.15.72:0/919587305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6978134260 msgr2=0x7f697809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.460+0000 7f697cc26700 1 --2- 172.21.15.72:0/919587305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6978134260 0x7f697809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.460+0000 7f697cc26700 1 -- 172.21.15.72:0/919587305 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640094a0 con 0x7f6978133420 2023-10-03T10:17:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.460+0000 7f697d427700 1 --2- 172.21.15.72:0/919587305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6978134260 0x7f697809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.460+0000 7f697cc26700 1 --2- 172.21.15.72:0/919587305 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6978133420 0x7f697809c480 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f696c009bc0 tx=0x7f696c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.460+0000 7f69757fa700 1 -- 172.21.15.72:0/919587305 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c004550 con 0x7f6978133420 2023-10-03T10:17:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.460+0000 7f69757fa700 1 -- 172.21.15.72:0/919587305 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c01f070 con 0x7f6978133420 2023-10-03T10:17:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.460+0000 7f69757fa700 1 -- 172.21.15.72:0/919587305 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c0038a0 con 0x7f6978133420 2023-10-03T10:17:50.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.460+0000 7f697ee8a700 1 -- 172.21.15.72:0/919587305 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c0094a0 con 0x7f6978133420 2023-10-03T10:17:50.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.460+0000 7f697ee8a700 1 -- 172.21.15.72:0/919587305 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697811fbf0 con 0x7f6978133420 2023-10-03T10:17:50.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.461+0000 7f69757fa700 1 -- 172.21.15.72:0/919587305 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f696c003a00 con 0x7f6978133420 2023-10-03T10:17:50.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.461+0000 7f697ee8a700 1 -- 172.21.15.72:0/919587305 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697811fde0 con 0x7f6978133420 2023-10-03T10:17:50.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.461+0000 7f69757fa700 1 -- 172.21.15.72:0/919587305 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f696c021070 con 0x7f6978133420 2023-10-03T10:17:50.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.470+0000 7f69757fa700 1 -- 172.21.15.72:0/919587305 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f696c02b080 con 0x7f6978133420 2023-10-03T10:17:50.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.583+0000 7f98388c8700 1 -- 172.21.15.72:0/566694505 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9834124650 con 0x7f9834121f60 2023-10-03T10:17:50.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.583+0000 7f9822ffd700 1 -- 172.21.15.72:0/566694505 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f982c02a090 con 0x7f9834121f60 2023-10-03T10:17:50.584 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:50.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.585+0000 7f98388c8700 1 -- 172.21.15.72:0/566694505 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9834121f60 msgr2=0x7f98341d2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.585+0000 7f98388c8700 1 --2- 172.21.15.72:0/566694505 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9834121f60 0x7f98341d2d90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f982c00efc0 tx=0x7f982c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.585+0000 7f98388c8700 1 -- 172.21.15.72:0/566694505 shutdown_connections 2023-10-03T10:17:50.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.585+0000 7f98388c8700 1 --2- 172.21.15.72:0/566694505 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f983406e570 0x7f98341214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.585+0000 7f98388c8700 1 --2- 172.21.15.72:0/566694505 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9834121f60 0x7f98341d2d90 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.585+0000 7f98388c8700 1 --2- 172.21.15.72:0/566694505 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9834134610 0x7f9834121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.585+0000 7f98388c8700 1 -- 172.21.15.72:0/566694505 >> 172.21.15.72:0/566694505 conn(0x7f98340a2aa0 msgr2=0x7f98341bf170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.586+0000 7f98388c8700 1 -- 172.21.15.72:0/566694505 shutdown_connections 2023-10-03T10:17:50.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.586+0000 7f98388c8700 1 -- 172.21.15.72:0/566694505 wait complete. 2023-10-03T10:17:50.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:50.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.625+0000 7ff3d1b38700 1 -- 172.21.15.72:0/2292324902 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff3cc074ea0 con 0x7ff3cc09e930 2023-10-03T10:17:50.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.625+0000 7ff3b3fff700 1 -- 172.21.15.72:0/2292324902 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff3bc024b70 con 0x7ff3cc09e930 2023-10-03T10:17:50.626 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:50.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.627+0000 7ff3d1b38700 1 -- 172.21.15.72:0/2292324902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3cc09e930 msgr2=0x7ff3cc06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.627+0000 7ff3d1b38700 1 --2- 172.21.15.72:0/2292324902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3cc09e930 0x7ff3cc06b8b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009840 tx=0x7ff3bc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.627+0000 7ff3d1b38700 1 -- 172.21.15.72:0/2292324902 shutdown_connections 2023-10-03T10:17:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.627+0000 7ff3d1b38700 1 --2- 172.21.15.72:0/2292324902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc09f650 0x7ff3cc06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.627+0000 7ff3d1b38700 1 --2- 172.21.15.72:0/2292324902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3cc09e930 0x7ff3cc06b8b0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.627+0000 7ff3d1b38700 1 --2- 172.21.15.72:0/2292324902 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff3cc09f240 0x7ff3cc06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.627+0000 7ff3d1b38700 1 -- 172.21.15.72:0/2292324902 >> 172.21.15.72:0/2292324902 conn(0x7ff3cc0a4210 msgr2=0x7ff3cc1b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.627+0000 7ff3d1b38700 1 -- 172.21.15.72:0/2292324902 shutdown_connections 2023-10-03T10:17:50.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.627+0000 7ff3d1b38700 1 -- 172.21.15.72:0/2292324902 wait complete. 2023-10-03T10:17:50.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:50.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.671+0000 7f697ee8a700 1 -- 172.21.15.72:0/919587305 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6978074ea0 con 0x7f6978133420 2023-10-03T10:17:50.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.671+0000 7f69757fa700 1 -- 172.21.15.72:0/919587305 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f696c015070 con 0x7f6978133420 2023-10-03T10:17:50.672 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:50.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.673+0000 7f697ee8a700 1 -- 172.21.15.72:0/919587305 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6978133420 msgr2=0x7f697809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.673+0000 7f697ee8a700 1 --2- 172.21.15.72:0/919587305 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6978133420 0x7f697809c480 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f696c009bc0 tx=0x7f696c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:50.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.673+0000 7f697ee8a700 1 -- 172.21.15.72:0/919587305 shutdown_connections 2023-10-03T10:17:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.673+0000 7f697ee8a700 1 --2- 172.21.15.72:0/919587305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6978134260 0x7f697809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.673+0000 7f697ee8a700 1 --2- 172.21.15.72:0/919587305 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6978133420 0x7f697809c480 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.673+0000 7f697ee8a700 1 --2- 172.21.15.72:0/919587305 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6978133e30 0x7f697809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.673+0000 7f697ee8a700 1 -- 172.21.15.72:0/919587305 >> 172.21.15.72:0/919587305 conn(0x7f69780a4210 msgr2=0x7f69780a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.674+0000 7f697ee8a700 1 -- 172.21.15.72:0/919587305 shutdown_connections 2023-10-03T10:17:50.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.674+0000 7f697ee8a700 1 -- 172.21.15.72:0/919587305 wait complete. 2023-10-03T10:17:50.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:50.689 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:50.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.847+0000 7fe6eb265700 1 Processor -- start 2023-10-03T10:17:50.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.848+0000 7fe6eb265700 1 -- start start 2023-10-03T10:17:50.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.848+0000 7fe6eb265700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6e409d6f0 0x7fe6e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.848+0000 7fe6eb265700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6e409e000 0x7fe6e41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.848+0000 7fe6eb265700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6e409e410 0x7fe6e4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.848+0000 7fe6eb265700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e406b460 con 0x7fe6e409e410 2023-10-03T10:17:50.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.848+0000 7fe6eb265700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e409b120 con 0x7fe6e409e000 2023-10-03T10:17:50.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.848+0000 7fe6eb265700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e409a7e0 con 0x7fe6e409d6f0 2023-10-03T10:17:50.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.848+0000 7fe6e8800700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6e409e000 0x7fe6e41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.848+0000 7fe6e8800700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6e409e000 0x7fe6e41339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53784/0 (socket says 172.21.15.72:53784) 2023-10-03T10:17:50.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.848+0000 7fe6e8800700 1 -- 172.21.15.72:0/4193770158 learned_addr learned my addr 172.21.15.72:0/4193770158 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:50.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.848+0000 7fe6e9001700 1 --2- 172.21.15.72:0/4193770158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6e409d6f0 0x7fe6e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.848+0000 7fe6e9802700 1 --2- 172.21.15.72:0/4193770158 >> v2:172.21.15.72:3300/0 conn(0x7fe6e409e410 0x7fe6e4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.849+0000 7fe6e8800700 1 -- 172.21.15.72:0/4193770158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6e409d6f0 msgr2=0x7fe6e409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.849+0000 7fe6e8800700 1 --2- 172.21.15.72:0/4193770158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6e409d6f0 0x7fe6e409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.849+0000 7fe6e8800700 1 -- 172.21.15.72:0/4193770158 >> v2:172.21.15.72:3300/0 conn(0x7fe6e409e410 msgr2=0x7fe6e4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.849+0000 7fe6e8800700 1 --2- 172.21.15.72:0/4193770158 >> v2:172.21.15.72:3300/0 conn(0x7fe6e409e410 0x7fe6e4133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.849+0000 7fe6e8800700 1 -- 172.21.15.72:0/4193770158 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e409a500 con 0x7fe6e409e000 2023-10-03T10:17:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.849+0000 7fe6e9001700 1 --2- 172.21.15.72:0/4193770158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6e409d6f0 0x7fe6e409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.849+0000 7fe6e9802700 1 --2- 172.21.15.72:0/4193770158 >> v2:172.21.15.72:3300/0 conn(0x7fe6e409e410 0x7fe6e4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.849+0000 7fe6e8800700 1 --2- 172.21.15.72:0/4193770158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6e409e000 0x7fe6e41339f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009920 tx=0x7fe6d4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da191919e31d831 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.849+0000 7fe6dbfff700 1 -- 172.21.15.72:0/4193770158 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4011830 con 0x7fe6e409e000 2023-10-03T10:17:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.849+0000 7fe6dbfff700 1 -- 172.21.15.72:0/4193770158 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d4011990 con 0x7fe6e409e000 2023-10-03T10:17:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.849+0000 7fe6dbfff700 1 -- 172.21.15.72:0/4193770158 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4011d20 con 0x7fe6e409e000 2023-10-03T10:17:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.850+0000 7fe6eb265700 1 -- 172.21.15.72:0/4193770158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6e409e000 msgr2=0x7fe6e41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.850+0000 7fe6eb265700 1 --2- 172.21.15.72:0/4193770158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6e409e000 0x7fe6e41339f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009920 tx=0x7fe6d4009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.850+0000 7fe6eb265700 1 -- 172.21.15.72:0/4193770158 shutdown_connections 2023-10-03T10:17:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.850+0000 7fe6eb265700 1 --2- 172.21.15.72:0/4193770158 >> v2:172.21.15.72:3300/0 conn(0x7fe6e409e410 0x7fe6e4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.850+0000 7fe6eb265700 1 --2- 172.21.15.72:0/4193770158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6e409d6f0 0x7fe6e409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.850+0000 7fe6eb265700 1 --2- 172.21.15.72:0/4193770158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6e409e000 0x7fe6e41339f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.850+0000 7fe6eb265700 1 -- 172.21.15.72:0/4193770158 >> 172.21.15.72:0/4193770158 conn(0x7fe6e4066f50 msgr2=0x7fe6e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.850+0000 7fe6eb265700 1 -- 172.21.15.72:0/4193770158 shutdown_connections 2023-10-03T10:17:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.850+0000 7fe6eb265700 1 -- 172.21.15.72:0/4193770158 wait complete. 2023-10-03T10:17:50.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6eb265700 1 Processor -- start 2023-10-03T10:17:50.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6eb265700 1 -- start start 2023-10-03T10:17:50.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6eb265700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6e409d6f0 0x7fe6e41b91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6eb265700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6e409e000 0x7fe6e41a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6eb265700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e409e410 0x7fe6e41a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6eb265700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e41aa2c0 con 0x7fe6e409e410 2023-10-03T10:17:50.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6eb265700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e41a9900 con 0x7fe6e409d6f0 2023-10-03T10:17:50.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6eb265700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e41a9090 con 0x7fe6e409e000 2023-10-03T10:17:50.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6e8800700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6e409e000 0x7fe6e41a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6e9802700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e409e410 0x7fe6e41a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6e8800700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6e409e000 0x7fe6e41a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41938/0 (socket says 172.21.15.72:41938) 2023-10-03T10:17:50.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6e8800700 1 -- 172.21.15.72:0/768413148 learned_addr learned my addr 172.21.15.72:0/768413148 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:50.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6e9001700 1 --2- 172.21.15.72:0/768413148 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6e409d6f0 0x7fe6e41b91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6e8800700 1 -- 172.21.15.72:0/768413148 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6e409d6f0 msgr2=0x7fe6e41b91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6e8800700 1 --2- 172.21.15.72:0/768413148 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6e409d6f0 0x7fe6e41b91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6e8800700 1 -- 172.21.15.72:0/768413148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e409e410 msgr2=0x7fe6e41a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6e8800700 1 --2- 172.21.15.72:0/768413148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e409e410 0x7fe6e41a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6e8800700 1 -- 172.21.15.72:0/768413148 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e00094a0 con 0x7fe6e409e000 2023-10-03T10:17:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.851+0000 7fe6e9802700 1 --2- 172.21.15.72:0/768413148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e409e410 0x7fe6e41a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.852+0000 7fe6e8800700 1 --2- 172.21.15.72:0/768413148 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6e409e000 0x7fe6e41a5de0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009c70 tx=0x7fe6d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.852+0000 7fe6d9ffb700 1 -- 172.21.15.72:0/768413148 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4004240 con 0x7fe6e409e000 2023-10-03T10:17:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.852+0000 7fe6d9ffb700 1 -- 172.21.15.72:0/768413148 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d401f070 con 0x7fe6e409e000 2023-10-03T10:17:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.852+0000 7fe6eb265700 1 -- 172.21.15.72:0/768413148 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6dc009a70 con 0x7fe6e409e000 2023-10-03T10:17:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.852+0000 7fe6d9ffb700 1 -- 172.21.15.72:0/768413148 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40036a0 con 0x7fe6e409e000 2023-10-03T10:17:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.852+0000 7fe6eb265700 1 -- 172.21.15.72:0/768413148 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d4009550 con 0x7fe6e409e000 2023-10-03T10:17:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.853+0000 7fe6d9ffb700 1 -- 172.21.15.72:0/768413148 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe6d4021030 con 0x7fe6e409e000 2023-10-03T10:17:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.853+0000 7fe6d9ffb700 1 -- 172.21.15.72:0/768413148 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe6d4040910 con 0x7fe6e409e000 2023-10-03T10:17:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.853+0000 7fe6eb265700 1 -- 172.21.15.72:0/768413148 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e41a92c0 con 0x7fe6e409e000 2023-10-03T10:17:50.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:50.858+0000 7fe6d9ffb700 1 -- 172.21.15.72:0/768413148 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe6e41a92c0 con 0x7fe6e409e000 2023-10-03T10:17:51.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.041+0000 7fe6eb265700 1 -- 172.21.15.72:0/768413148 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe6e41a92c0 con 0x7fe6e409e000 2023-10-03T10:17:51.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.041+0000 7fe6d9ffb700 1 -- 172.21.15.72:0/768413148 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe6e41a92c0 con 0x7fe6e409e000 2023-10-03T10:17:51.042 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.043+0000 7fe6eb265700 1 -- 172.21.15.72:0/768413148 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6e409e000 msgr2=0x7fe6e41a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.043+0000 7fe6eb265700 1 --2- 172.21.15.72:0/768413148 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6e409e000 0x7fe6e41a5de0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009c70 tx=0x7fe6d4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.043+0000 7fe6eb265700 1 -- 172.21.15.72:0/768413148 shutdown_connections 2023-10-03T10:17:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.043+0000 7fe6eb265700 1 --2- 172.21.15.72:0/768413148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6e409e410 0x7fe6e41a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.043+0000 7fe6eb265700 1 --2- 172.21.15.72:0/768413148 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6e409d6f0 0x7fe6e41b91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.043+0000 7fe6eb265700 1 --2- 172.21.15.72:0/768413148 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe6e409e000 0x7fe6e41a5de0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.043+0000 7fe6eb265700 1 -- 172.21.15.72:0/768413148 >> 172.21.15.72:0/768413148 conn(0x7fe6e4066f50 msgr2=0x7fe6e41badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.043+0000 7fe6eb265700 1 -- 172.21.15.72:0/768413148 shutdown_connections 2023-10-03T10:17:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.043+0000 7fe6eb265700 1 -- 172.21.15.72:0/768413148 wait complete. 2023-10-03T10:17:51.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:51.604 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:51.640 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:51.687 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:51.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.733+0000 7f9ccc259700 1 Processor -- start 2023-10-03T10:17:51.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.734+0000 7f9ccc259700 1 -- start start 2023-10-03T10:17:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.734+0000 7f9ccc259700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cc40a0a30 0x7f9cc40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.734+0000 7f9ccc259700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cc40a1340 0x7f9cc4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.734+0000 7f9ccc259700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cc4133fa0 0x7f9cc4134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.734+0000 7f9ccc259700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc409edd0 con 0x7f9cc4133fa0 2023-10-03T10:17:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.734+0000 7f9ccc259700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc409e1f0 con 0x7f9cc40a0a30 2023-10-03T10:17:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.734+0000 7f9ccc259700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc409dc50 con 0x7f9cc40a1340 2023-10-03T10:17:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.734+0000 7f9cc97f4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cc40a1340 0x7f9cc4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.734+0000 7f9cc9ff5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cc40a0a30 0x7f9cc40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.734+0000 7f9cc97f4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cc40a1340 0x7f9cc4133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41948/0 (socket says 172.21.15.72:41948) 2023-10-03T10:17:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.734+0000 7f9cc97f4700 1 -- 172.21.15.72:0/775265958 learned_addr learned my addr 172.21.15.72:0/775265958 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.734+0000 7f9cc9ff5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cc40a0a30 0x7f9cc40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53800/0 (socket says 172.21.15.72:53800) 2023-10-03T10:17:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.734+0000 7f9cca7f6700 1 --2- 172.21.15.72:0/775265958 >> v2:172.21.15.72:3300/0 conn(0x7f9cc4133fa0 0x7f9cc4134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.735+0000 7f9cc97f4700 1 -- 172.21.15.72:0/775265958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cc40a0a30 msgr2=0x7f9cc40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.735+0000 7f9cc97f4700 1 --2- 172.21.15.72:0/775265958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cc40a0a30 0x7f9cc40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.735+0000 7f9cc97f4700 1 -- 172.21.15.72:0/775265958 >> v2:172.21.15.72:3300/0 conn(0x7f9cc4133fa0 msgr2=0x7f9cc4134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.735+0000 7f9cc97f4700 1 --2- 172.21.15.72:0/775265958 >> v2:172.21.15.72:3300/0 conn(0x7f9cc4133fa0 0x7f9cc4134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.735+0000 7f9cc97f4700 1 -- 172.21.15.72:0/775265958 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc40a1fe0 con 0x7f9cc40a1340 2023-10-03T10:17:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.735+0000 7f9cc9ff5700 1 --2- 172.21.15.72:0/775265958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cc40a0a30 0x7f9cc40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.735+0000 7f9cca7f6700 1 --2- 172.21.15.72:0/775265958 >> v2:172.21.15.72:3300/0 conn(0x7f9cc4133fa0 0x7f9cc4134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.735+0000 7f9cc97f4700 1 --2- 172.21.15.72:0/775265958 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cc40a1340 0x7f9cc4133a60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40098f0 tx=0x7f9cb4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ef213d3b2204d36 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.735+0000 7f9cc8ff3700 1 -- 172.21.15.72:0/775265958 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4011830 con 0x7f9cc40a1340 2023-10-03T10:17:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.735+0000 7f9cc8ff3700 1 -- 172.21.15.72:0/775265958 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb4011990 con 0x7f9cc40a1340 2023-10-03T10:17:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.735+0000 7f9cc8ff3700 1 -- 172.21.15.72:0/775265958 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4011d20 con 0x7f9cc40a1340 2023-10-03T10:17:51.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.736+0000 7f9ccc259700 1 -- 172.21.15.72:0/775265958 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cc40a1340 msgr2=0x7f9cc4133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.736+0000 7f9ccc259700 1 --2- 172.21.15.72:0/775265958 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cc40a1340 0x7f9cc4133a60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40098f0 tx=0x7f9cb4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.736+0000 7f9ccc259700 1 -- 172.21.15.72:0/775265958 shutdown_connections 2023-10-03T10:17:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.736+0000 7f9ccc259700 1 --2- 172.21.15.72:0/775265958 >> v2:172.21.15.72:3300/0 conn(0x7f9cc4133fa0 0x7f9cc4134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.736+0000 7f9ccc259700 1 --2- 172.21.15.72:0/775265958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cc40a0a30 0x7f9cc40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.736+0000 7f9ccc259700 1 --2- 172.21.15.72:0/775265958 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cc40a1340 0x7f9cc4133a60 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.736+0000 7f9ccc259700 1 -- 172.21.15.72:0/775265958 >> 172.21.15.72:0/775265958 conn(0x7f9cc40a6550 msgr2=0x7f9cc40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.736+0000 7f9ccc259700 1 -- 172.21.15.72:0/775265958 shutdown_connections 2023-10-03T10:17:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.736+0000 7f9ccc259700 1 -- 172.21.15.72:0/775265958 wait complete. 2023-10-03T10:17:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.737+0000 7f9ccc259700 1 Processor -- start 2023-10-03T10:17:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.737+0000 7f9ccc259700 1 -- start start 2023-10-03T10:17:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9ccc259700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cc40a0a30 0x7f9cc4120060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9ccc259700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cc40a1340 0x7f9cc41205a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9ccc259700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc4133fa0 0x7f9cc4120ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9ccc259700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc41238a0 con 0x7f9cc4133fa0 2023-10-03T10:17:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9ccc259700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc4121d80 con 0x7f9cc40a1340 2023-10-03T10:17:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9ccc259700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc40a3680 con 0x7f9cc40a0a30 2023-10-03T10:17:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9cc9ff5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cc40a0a30 0x7f9cc4120060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9cc9ff5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cc40a0a30 0x7f9cc4120060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:41962/0 (socket says 172.21.15.72:41962) 2023-10-03T10:17:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9cc9ff5700 1 -- 172.21.15.72:0/436807822 learned_addr learned my addr 172.21.15.72:0/436807822 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9cc97f4700 1 --2- 172.21.15.72:0/436807822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cc40a1340 0x7f9cc41205a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9cca7f6700 1 --2- 172.21.15.72:0/436807822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc4133fa0 0x7f9cc4120ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9cc9ff5700 1 -- 172.21.15.72:0/436807822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cc40a1340 msgr2=0x7f9cc41205a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9cc9ff5700 1 --2- 172.21.15.72:0/436807822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cc40a1340 0x7f9cc41205a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9cc9ff5700 1 -- 172.21.15.72:0/436807822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc4133fa0 msgr2=0x7f9cc4120ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9cc9ff5700 1 --2- 172.21.15.72:0/436807822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc4133fa0 0x7f9cc4120ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9cc9ff5700 1 -- 172.21.15.72:0/436807822 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc00094a0 con 0x7f9cc40a0a30 2023-10-03T10:17:51.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9cc9ff5700 1 --2- 172.21.15.72:0/436807822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cc40a0a30 0x7f9cc4120060 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000ebe0 tx=0x7f9cc000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.738+0000 7f9cba7fc700 1 -- 172.21.15.72:0/436807822 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0009760 con 0x7f9cc40a0a30 2023-10-03T10:17:51.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.739+0000 7f9cba7fc700 1 -- 172.21.15.72:0/436807822 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc000c850 con 0x7f9cc40a0a30 2023-10-03T10:17:51.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.739+0000 7f9ccc259700 1 -- 172.21.15.72:0/436807822 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc009a70 con 0x7f9cc40a0a30 2023-10-03T10:17:51.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.739+0000 7f9cba7fc700 1 -- 172.21.15.72:0/436807822 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc000cbe0 con 0x7f9cc40a0a30 2023-10-03T10:17:51.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.739+0000 7f9ccc259700 1 -- 172.21.15.72:0/436807822 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb4009550 con 0x7f9cc40a0a30 2023-10-03T10:17:51.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.740+0000 7f9ccc259700 1 -- 172.21.15.72:0/436807822 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc4074ea0 con 0x7f9cc40a0a30 2023-10-03T10:17:51.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.740+0000 7f9cba7fc700 1 -- 172.21.15.72:0/436807822 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9cc000cd40 con 0x7f9cc40a0a30 2023-10-03T10:17:51.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.740+0000 7f9cba7fc700 1 -- 172.21.15.72:0/436807822 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9cc003fa90 con 0x7f9cc40a0a30 2023-10-03T10:17:51.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.748+0000 7f9cba7fc700 1 -- 172.21.15.72:0/436807822 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cc001b3b0 con 0x7f9cc40a0a30 2023-10-03T10:17:51.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.781+0000 7fdcda985700 1 Processor -- start 2023-10-03T10:17:51.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.781+0000 7fdcda985700 1 -- start start 2023-10-03T10:17:51.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.781+0000 7fdcda985700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdcd406f5d0 0x7fdcd412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.781+0000 7fdcda985700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdcd4135c20 0x7fdcd4138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.781+0000 7fdcda985700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd406fa40 con 0x7fdcd412cf60 2023-10-03T10:17:51.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.781+0000 7fdcda985700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd412cd90 con 0x7fdcd406f5d0 2023-10-03T10:17:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.781+0000 7fdcda985700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd4071780 con 0x7fdcd4135c20 2023-10-03T10:17:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.782+0000 7fdcd37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdcd406f5d0 0x7fdcd412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.782+0000 7fdcd3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdcd412cf60 0x7fdcd412f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52616/0 (socket says 172.21.15.72:52616) 2023-10-03T10:17:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.782+0000 7fdcd3fff700 1 -- 172.21.15.72:0/3496341769 learned_addr learned my addr 172.21.15.72:0/3496341769 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.782+0000 7fdcd8f22700 1 --2- 172.21.15.72:0/3496341769 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdcd4135c20 0x7fdcd4138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.782+0000 7fdcd2ffd700 1 -- 172.21.15.72:0/3496341769 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966113912 0 0) 0x7fdcd406fa40 con 0x7fdcd412cf60 2023-10-03T10:17:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.782+0000 7fdcd2ffd700 1 -- 172.21.15.72:0/3496341769 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcbc0035b0 con 0x7fdcd412cf60 2023-10-03T10:17:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.782+0000 7fdcd37fe700 1 -- 172.21.15.72:0/3496341769 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdcd4135c20 msgr2=0x7fdcd4138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.782+0000 7fdcd37fe700 1 --2- 172.21.15.72:0/3496341769 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdcd4135c20 0x7fdcd4138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.782+0000 7fdcd37fe700 1 -- 172.21.15.72:0/3496341769 >> v1:172.21.15.72:6789/0 conn(0x7fdcd412cf60 legacy=0x7fdcd412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.782+0000 7fdcd37fe700 1 -- 172.21.15.72:0/3496341769 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd4071a40 con 0x7fdcd406f5d0 2023-10-03T10:17:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.782+0000 7fdcd37fe700 1 --2- 172.21.15.72:0/3496341769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdcd406f5d0 0x7fdcd412ffc0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009870 tx=0x7fdcc8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9896405cfe8752e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.782+0000 7fdcd2ffd700 1 -- 172.21.15.72:0/3496341769 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc800c880 con 0x7fdcd406f5d0 2023-10-03T10:17:51.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.782+0000 7fdcd2ffd700 1 -- 172.21.15.72:0/3496341769 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc800c9e0 con 0x7fdcd406f5d0 2023-10-03T10:17:51.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.782+0000 7fdcd2ffd700 1 -- 172.21.15.72:0/3496341769 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc800cd70 con 0x7fdcd406f5d0 2023-10-03T10:17:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.783+0000 7fdcda985700 1 -- 172.21.15.72:0/3496341769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdcd406f5d0 msgr2=0x7fdcd412ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.783+0000 7fdcda985700 1 --2- 172.21.15.72:0/3496341769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdcd406f5d0 0x7fdcd412ffc0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009870 tx=0x7fdcc8009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.783+0000 7fdcda985700 1 -- 172.21.15.72:0/3496341769 shutdown_connections 2023-10-03T10:17:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.783+0000 7fdcda985700 1 --2- 172.21.15.72:0/3496341769 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdcd4135c20 0x7fdcd4138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.783+0000 7fdcda985700 1 --2- 172.21.15.72:0/3496341769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdcd406f5d0 0x7fdcd412ffc0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.783+0000 7fdcda985700 1 -- 172.21.15.72:0/3496341769 >> 172.21.15.72:0/3496341769 conn(0x7fdcd40a2aa0 msgr2=0x7fdcd40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.783+0000 7fdcda985700 1 -- 172.21.15.72:0/3496341769 shutdown_connections 2023-10-03T10:17:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.783+0000 7fdcda985700 1 -- 172.21.15.72:0/3496341769 wait complete. 2023-10-03T10:17:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.784+0000 7fdcda985700 1 Processor -- start 2023-10-03T10:17:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.785+0000 7fdcda985700 1 -- start start 2023-10-03T10:17:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.785+0000 7fdcda985700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdcd406f5d0 0x7fdcd41c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.785+0000 7fdcda985700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdcd412cf60 0x7fdcd41c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.785+0000 7fdcda985700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcd4135c20 0x7fdcd4099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.785+0000 7fdcda985700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd409ca30 con 0x7fdcd4135c20 2023-10-03T10:17:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.785+0000 7fdcda985700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd41c6030 con 0x7fdcd406f5d0 2023-10-03T10:17:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.785+0000 7fdcda985700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd41c6ea0 con 0x7fdcd412cf60 2023-10-03T10:17:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.785+0000 7fdcd3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdcd406f5d0 0x7fdcd41c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.785+0000 7fdcd8f22700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcd4135c20 0x7fdcd4099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.785+0000 7fdcd8f22700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcd4135c20 0x7fdcd4099d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51646/0 (socket says 172.21.15.72:51646) 2023-10-03T10:17:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.785+0000 7fdcd3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdcd406f5d0 0x7fdcd41c6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53824/0 (socket says 172.21.15.72:53824) 2023-10-03T10:17:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.785+0000 7fdcd8f22700 1 -- 172.21.15.72:0/3296639954 learned_addr learned my addr 172.21.15.72:0/3296639954 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.785+0000 7fdcd37fe700 1 --2- 172.21.15.72:0/3296639954 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdcd412cf60 0x7fdcd41c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.786+0000 7fdcd3fff700 1 -- 172.21.15.72:0/3296639954 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdcd412cf60 msgr2=0x7fdcd41c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.786+0000 7fdcd3fff700 1 --2- 172.21.15.72:0/3296639954 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdcd412cf60 0x7fdcd41c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.786+0000 7fdcd3fff700 1 -- 172.21.15.72:0/3296639954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcd4135c20 msgr2=0x7fdcd4099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.786+0000 7fdcd3fff700 1 --2- 172.21.15.72:0/3296639954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcd4135c20 0x7fdcd4099d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.786+0000 7fdcd3fff700 1 -- 172.21.15.72:0/3296639954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc80094a0 con 0x7fdcd406f5d0 2023-10-03T10:17:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.786+0000 7fdcd8f22700 1 --2- 172.21.15.72:0/3296639954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcd4135c20 0x7fdcd4099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.786+0000 7fdcd3fff700 1 --2- 172.21.15.72:0/3296639954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdcd406f5d0 0x7fdcd41c6420 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400c4c0 tx=0x7fdcc400c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.786+0000 7fdcd0ff9700 1 -- 172.21.15.72:0/3296639954 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4005d70 con 0x7fdcd406f5d0 2023-10-03T10:17:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.786+0000 7fdcd0ff9700 1 -- 172.21.15.72:0/3296639954 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc40070d0 con 0x7fdcd406f5d0 2023-10-03T10:17:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.786+0000 7fdcda985700 1 -- 172.21.15.72:0/3296639954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd4129fa0 con 0x7fdcd406f5d0 2023-10-03T10:17:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.786+0000 7fdcd0ff9700 1 -- 172.21.15.72:0/3296639954 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4007440 con 0x7fdcd406f5d0 2023-10-03T10:17:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.786+0000 7fdcda985700 1 -- 172.21.15.72:0/3296639954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd409ecd0 con 0x7fdcd406f5d0 2023-10-03T10:17:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.787+0000 7fdcd0ff9700 1 -- 172.21.15.72:0/3296639954 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdcc40075a0 con 0x7fdcd406f5d0 2023-10-03T10:17:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.787+0000 7fdcd0ff9700 1 -- 172.21.15.72:0/3296639954 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdcc403ea20 con 0x7fdcd406f5d0 2023-10-03T10:17:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.788+0000 7fdcda985700 1 -- 172.21.15.72:0/3296639954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd409cb80 con 0x7fdcd406f5d0 2023-10-03T10:17:51.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.792+0000 7fdcd0ff9700 1 -- 172.21.15.72:0/3296639954 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdcc4017070 con 0x7fdcd406f5d0 2023-10-03T10:17:51.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.821+0000 7fb47167f700 1 Processor -- start 2023-10-03T10:17:51.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.821+0000 7fb47167f700 1 -- start start 2023-10-03T10:17:51.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.821+0000 7fb47167f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46c06a770 0x7fb46c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb47167f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46c09dc30 0x7fb46c09e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb47167f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb46c13c1e0 0x7fb46c13e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb47167f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46c06ab40 con 0x7fb46c13c1e0 2023-10-03T10:17:51.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb47167f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c09ebc0 con 0x7fb46c09dc30 2023-10-03T10:17:51.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb47167f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c09a810 con 0x7fb46c06a770 2023-10-03T10:17:51.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb46b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb46c13c1e0 0x7fb46c13e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb46b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb46c13c1e0 0x7fb46c13e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51656/0 (socket says 172.21.15.72:51656) 2023-10-03T10:17:51.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb46b7fe700 1 -- 172.21.15.72:0/673239977 learned_addr learned my addr 172.21.15.72:0/673239977 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:51.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb46a7fc700 1 --2- 172.21.15.72:0/673239977 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46c09dc30 0x7fb46c09e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb46affd700 1 --2- 172.21.15.72:0/673239977 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46c06a770 0x7fb46c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb46a7fc700 1 -- 172.21.15.72:0/673239977 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46c06a770 msgr2=0x7fb46c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb46a7fc700 1 --2- 172.21.15.72:0/673239977 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46c06a770 0x7fb46c09d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb46a7fc700 1 -- 172.21.15.72:0/673239977 >> v2:172.21.15.72:3300/0 conn(0x7fb46c13c1e0 msgr2=0x7fb46c13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:51.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb46a7fc700 1 --2- 172.21.15.72:0/673239977 >> v2:172.21.15.72:3300/0 conn(0x7fb46c13c1e0 0x7fb46c13e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb46a7fc700 1 -- 172.21.15.72:0/673239977 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c09e920 con 0x7fb46c09dc30 2023-10-03T10:17:51.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb46b7fe700 1 --2- 172.21.15.72:0/673239977 >> v2:172.21.15.72:3300/0 conn(0x7fb46c13c1e0 0x7fb46c13e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:51.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb46a7fc700 1 --2- 172.21.15.72:0/673239977 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46c09dc30 0x7fb46c09e080 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb460009870 tx=0x7fb460009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44d8db07dec573e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb469ffb700 1 -- 172.21.15.72:0/673239977 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460011830 con 0x7fb46c09dc30 2023-10-03T10:17:51.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb469ffb700 1 -- 172.21.15.72:0/673239977 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb460011990 con 0x7fb46c09dc30 2023-10-03T10:17:51.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.822+0000 7fb469ffb700 1 -- 172.21.15.72:0/673239977 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460011d20 con 0x7fb46c09dc30 2023-10-03T10:17:51.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.823+0000 7fb47167f700 1 -- 172.21.15.72:0/673239977 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46c09dc30 msgr2=0x7fb46c09e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.823+0000 7fb47167f700 1 --2- 172.21.15.72:0/673239977 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46c09dc30 0x7fb46c09e080 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb460009870 tx=0x7fb460009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:51.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.823+0000 7fb47167f700 1 -- 172.21.15.72:0/673239977 shutdown_connections 2023-10-03T10:17:51.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.823+0000 7fb47167f700 1 --2- 172.21.15.72:0/673239977 >> v2:172.21.15.72:3300/0 conn(0x7fb46c13c1e0 0x7fb46c13e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.823+0000 7fb47167f700 1 --2- 172.21.15.72:0/673239977 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46c06a770 0x7fb46c09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.823+0000 7fb47167f700 1 --2- 172.21.15.72:0/673239977 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46c09dc30 0x7fb46c09e080 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.823+0000 7fb47167f700 1 -- 172.21.15.72:0/673239977 >> 172.21.15.72:0/673239977 conn(0x7fb46c066f50 msgr2=0x7fb46c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.823+0000 7fb47167f700 1 -- 172.21.15.72:0/673239977 shutdown_connections 2023-10-03T10:17:51.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.823+0000 7fb47167f700 1 -- 172.21.15.72:0/673239977 wait complete. 2023-10-03T10:17:51.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.825+0000 7fb47167f700 1 Processor -- start 2023-10-03T10:17:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.825+0000 7fb47167f700 1 -- start start 2023-10-03T10:17:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.825+0000 7fb47167f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46c06a770 0x7fb46c127140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.825+0000 7fb47167f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb46c09dc30 0x7fb46c127680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.825+0000 7fb47167f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46c13c1e0 0x7fb46c1cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.825+0000 7fb47167f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c09f1a0 con 0x7fb46c09dc30 2023-10-03T10:17:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.825+0000 7fb47167f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c126e20 con 0x7fb46c06a770 2023-10-03T10:17:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.825+0000 7fb47167f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c1298d0 con 0x7fb46c13c1e0 2023-10-03T10:17:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.825+0000 7fb46a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb46c09dc30 0x7fb46c127680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.825+0000 7fb46affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46c06a770 0x7fb46c127140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.825+0000 7fb46a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb46c09dc30 0x7fb46c127680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51658/0 (socket says 172.21.15.72:51658) 2023-10-03T10:17:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.825+0000 7fb46a7fc700 1 -- 172.21.15.72:0/3154322330 learned_addr learned my addr 172.21.15.72:0/3154322330 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.826+0000 7fb46b7fe700 1 --2- 172.21.15.72:0/3154322330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46c13c1e0 0x7fb46c1cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.826+0000 7fb46a7fc700 1 -- 172.21.15.72:0/3154322330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46c13c1e0 msgr2=0x7fb46c1cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.826+0000 7fb46a7fc700 1 --2- 172.21.15.72:0/3154322330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46c13c1e0 0x7fb46c1cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.826+0000 7fb46a7fc700 1 -- 172.21.15.72:0/3154322330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46c06a770 msgr2=0x7fb46c127140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.826+0000 7fb46a7fc700 1 --2- 172.21.15.72:0/3154322330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46c06a770 0x7fb46c127140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.826+0000 7fb46a7fc700 1 -- 172.21.15.72:0/3154322330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb464009b30 con 0x7fb46c09dc30 2023-10-03T10:17:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.826+0000 7fb46affd700 1 --2- 172.21.15.72:0/3154322330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46c06a770 0x7fb46c127140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.826+0000 7fb46a7fc700 1 --2- 172.21.15.72:0/3154322330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb46c09dc30 0x7fb46c127680 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fb460000c00 tx=0x7fb460004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.826+0000 7fb4537fe700 1 -- 172.21.15.72:0/3154322330 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460004450 con 0x7fb46c09dc30 2023-10-03T10:17:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.826+0000 7fb4537fe700 1 -- 172.21.15.72:0/3154322330 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46001f070 con 0x7fb46c09dc30 2023-10-03T10:17:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.826+0000 7fb47167f700 1 -- 172.21.15.72:0/3154322330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4600094a0 con 0x7fb46c09dc30 2023-10-03T10:17:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.826+0000 7fb4537fe700 1 -- 172.21.15.72:0/3154322330 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4600038a0 con 0x7fb46c09dc30 2023-10-03T10:17:51.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.826+0000 7fb47167f700 1 -- 172.21.15.72:0/3154322330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46c127f80 con 0x7fb46c09dc30 2023-10-03T10:17:51.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.827+0000 7fb47167f700 1 -- 172.21.15.72:0/3154322330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46c129f70 con 0x7fb46c09dc30 2023-10-03T10:17:51.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.827+0000 7fb4537fe700 1 -- 172.21.15.72:0/3154322330 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb460003a00 con 0x7fb46c09dc30 2023-10-03T10:17:51.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.828+0000 7fb4537fe700 1 -- 172.21.15.72:0/3154322330 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb460021070 con 0x7fb46c09dc30 2023-10-03T10:17:51.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.832+0000 7fb4537fe700 1 -- 172.21.15.72:0/3154322330 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4600045b0 con 0x7fb46c09dc30 2023-10-03T10:17:51.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.952+0000 7f9ccc259700 1 -- 172.21.15.72:0/436807822 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9cc40a28e0 con 0x7f9cc40a0a30 2023-10-03T10:17:51.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.953+0000 7f9cba7fc700 1 -- 172.21.15.72:0/436807822 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9cc0017070 con 0x7f9cc40a0a30 2023-10-03T10:17:51.953 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:51.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.954+0000 7f9ccc259700 1 -- 172.21.15.72:0/436807822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cc40a0a30 msgr2=0x7f9cc4120060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.954+0000 7f9ccc259700 1 --2- 172.21.15.72:0/436807822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cc40a0a30 0x7f9cc4120060 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000ebe0 tx=0x7f9cc000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.955+0000 7f9ccc259700 1 -- 172.21.15.72:0/436807822 shutdown_connections 2023-10-03T10:17:51.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.955+0000 7f9ccc259700 1 --2- 172.21.15.72:0/436807822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc4133fa0 0x7f9cc4120ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.955+0000 7f9ccc259700 1 --2- 172.21.15.72:0/436807822 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9cc40a0a30 0x7f9cc4120060 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.955+0000 7f9ccc259700 1 --2- 172.21.15.72:0/436807822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cc40a1340 0x7f9cc41205a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.955+0000 7f9ccc259700 1 -- 172.21.15.72:0/436807822 >> 172.21.15.72:0/436807822 conn(0x7f9cc40a6550 msgr2=0x7f9cc40a4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.955+0000 7f9ccc259700 1 -- 172.21.15.72:0/436807822 shutdown_connections 2023-10-03T10:17:51.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.955+0000 7f9ccc259700 1 -- 172.21.15.72:0/436807822 wait complete. 2023-10-03T10:17:51.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:51.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.989+0000 7fdcda985700 1 -- 172.21.15.72:0/3296639954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdcd4074ea0 con 0x7fdcd406f5d0 2023-10-03T10:17:51.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.990+0000 7fdcd0ff9700 1 -- 172.21.15.72:0/3296639954 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdcc401bb10 con 0x7fdcd406f5d0 2023-10-03T10:17:51.990 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:51.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.992+0000 7fdcda985700 1 -- 172.21.15.72:0/3296639954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdcd406f5d0 msgr2=0x7fdcd41c6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.992+0000 7fdcda985700 1 --2- 172.21.15.72:0/3296639954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdcd406f5d0 0x7fdcd41c6420 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400c4c0 tx=0x7fdcc400c7d0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.992+0000 7fdcda985700 1 -- 172.21.15.72:0/3296639954 shutdown_connections 2023-10-03T10:17:51.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.992+0000 7fdcda985700 1 --2- 172.21.15.72:0/3296639954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcd4135c20 0x7fdcd4099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.992+0000 7fdcda985700 1 --2- 172.21.15.72:0/3296639954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdcd406f5d0 0x7fdcd41c6420 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.992+0000 7fdcda985700 1 --2- 172.21.15.72:0/3296639954 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdcd412cf60 0x7fdcd41c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.992+0000 7fdcda985700 1 -- 172.21.15.72:0/3296639954 >> 172.21.15.72:0/3296639954 conn(0x7fdcd40a2aa0 msgr2=0x7fdcd412a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.992+0000 7fdcda985700 1 -- 172.21.15.72:0/3296639954 shutdown_connections 2023-10-03T10:17:51.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:51.992+0000 7fdcda985700 1 -- 172.21.15.72:0/3296639954 wait complete. 2023-10-03T10:17:52.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:52.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.026+0000 7fb47167f700 1 -- 172.21.15.72:0/3154322330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb46c09e540 con 0x7fb46c09dc30 2023-10-03T10:17:52.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.026+0000 7fb4537fe700 1 -- 172.21.15.72:0/3154322330 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb46002b030 con 0x7fb46c09dc30 2023-10-03T10:17:52.027 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:52.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.028+0000 7fb47167f700 1 -- 172.21.15.72:0/3154322330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb46c09dc30 msgr2=0x7fb46c127680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.028+0000 7fb47167f700 1 --2- 172.21.15.72:0/3154322330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb46c09dc30 0x7fb46c127680 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fb460000c00 tx=0x7fb460004750 comp rx=0 tx=0).stop 2023-10-03T10:17:52.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.028+0000 7fb47167f700 1 -- 172.21.15.72:0/3154322330 shutdown_connections 2023-10-03T10:17:52.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.028+0000 7fb47167f700 1 --2- 172.21.15.72:0/3154322330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb46c13c1e0 0x7fb46c1cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.028+0000 7fb47167f700 1 --2- 172.21.15.72:0/3154322330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb46c06a770 0x7fb46c127140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.028+0000 7fb47167f700 1 --2- 172.21.15.72:0/3154322330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb46c09dc30 0x7fb46c127680 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.028+0000 7fb47167f700 1 -- 172.21.15.72:0/3154322330 >> 172.21.15.72:0/3154322330 conn(0x7fb46c066f50 msgr2=0x7fb46c13b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.028+0000 7fb47167f700 1 -- 172.21.15.72:0/3154322330 shutdown_connections 2023-10-03T10:17:52.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.028+0000 7fb47167f700 1 -- 172.21.15.72:0/3154322330 wait complete. 2023-10-03T10:17:52.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:52.057 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.202+0000 7f21c3698700 1 Processor -- start 2023-10-03T10:17:52.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.202+0000 7f21c3698700 1 -- start start 2023-10-03T10:17:52.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.202+0000 7f21c3698700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21bc09d6f0 0x7f21bc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.202+0000 7f21c3698700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21bc09e000 0x7f21bc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.202+0000 7f21c3698700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21bc09e410 0x7f21bc130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.202+0000 7f21c3698700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc09f520 con 0x7f21bc09d6f0 2023-10-03T10:17:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.202+0000 7f21c3698700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc09f130 con 0x7f21bc09e410 2023-10-03T10:17:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.202+0000 7f21c3698700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc09e930 con 0x7f21bc09e000 2023-10-03T10:17:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.202+0000 7f21c0c33700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21bc09e000 0x7f21bc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.202+0000 7f21c1434700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21bc09d6f0 0x7f21bc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.202+0000 7f21c1c35700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21bc09e410 0x7f21bc130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.202+0000 7f21c1434700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21bc09d6f0 0x7f21bc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51664/0 (socket says 172.21.15.72:51664) 2023-10-03T10:17:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.202+0000 7f21c0c33700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21bc09e000 0x7f21bc130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42000/0 (socket says 172.21.15.72:42000) 2023-10-03T10:17:52.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.202+0000 7f21c1434700 1 -- 172.21.15.72:0/192765611 learned_addr learned my addr 172.21.15.72:0/192765611 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.203+0000 7f21c1434700 1 -- 172.21.15.72:0/192765611 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21bc09e000 msgr2=0x7f21bc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.203+0000 7f21c1434700 1 --2- 172.21.15.72:0/192765611 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21bc09e000 0x7f21bc130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.203+0000 7f21c1434700 1 -- 172.21.15.72:0/192765611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21bc09e410 msgr2=0x7f21bc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.203+0000 7f21c1434700 1 --2- 172.21.15.72:0/192765611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21bc09e410 0x7f21bc130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.203+0000 7f21c1434700 1 -- 172.21.15.72:0/192765611 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc09b2d0 con 0x7f21bc09d6f0 2023-10-03T10:17:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.203+0000 7f21c1c35700 1 --2- 172.21.15.72:0/192765611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21bc09e410 0x7f21bc130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.203+0000 7f21c0c33700 1 --2- 172.21.15.72:0/192765611 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21bc09e000 0x7f21bc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.203+0000 7f21c1434700 1 --2- 172.21.15.72:0/192765611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc09d6f0 0x7f21bc09dac0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f21b800bbc0 tx=0x7f21b800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7858abb7a9828ee1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.203+0000 7f21b3fff700 1 -- 172.21.15.72:0/192765611 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800dcf0 con 0x7f21bc09d6f0 2023-10-03T10:17:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.203+0000 7f21b3fff700 1 -- 172.21.15.72:0/192765611 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b800de50 con 0x7f21bc09d6f0 2023-10-03T10:17:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.203+0000 7f21b3fff700 1 -- 172.21.15.72:0/192765611 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8010690 con 0x7f21bc09d6f0 2023-10-03T10:17:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.204+0000 7f21c3698700 1 -- 172.21.15.72:0/192765611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc09d6f0 msgr2=0x7f21bc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.204+0000 7f21c3698700 1 --2- 172.21.15.72:0/192765611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc09d6f0 0x7f21bc09dac0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f21b800bbc0 tx=0x7f21b800bed0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.204+0000 7f21c3698700 1 -- 172.21.15.72:0/192765611 shutdown_connections 2023-10-03T10:17:52.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.204+0000 7f21c3698700 1 --2- 172.21.15.72:0/192765611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21bc09e410 0x7f21bc130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.204+0000 7f21c3698700 1 --2- 172.21.15.72:0/192765611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc09d6f0 0x7f21bc09dac0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.204+0000 7f21c3698700 1 --2- 172.21.15.72:0/192765611 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21bc09e000 0x7f21bc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.204+0000 7f21c3698700 1 -- 172.21.15.72:0/192765611 >> 172.21.15.72:0/192765611 conn(0x7f21bc066f50 msgr2=0x7f21bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.204+0000 7f21c3698700 1 -- 172.21.15.72:0/192765611 shutdown_connections 2023-10-03T10:17:52.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.204+0000 7f21c3698700 1 -- 172.21.15.72:0/192765611 wait complete. 2023-10-03T10:17:52.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c3698700 1 Processor -- start 2023-10-03T10:17:52.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c3698700 1 -- start start 2023-10-03T10:17:52.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c3698700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21bc09d6f0 0x7f21bc11e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c3698700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21bc09e000 0x7f21bc11e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c3698700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc09e410 0x7f21bc11ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c3698700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc121c20 con 0x7f21bc09e410 2023-10-03T10:17:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c3698700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0a1a40 con 0x7f21bc09e000 2023-10-03T10:17:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c3698700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc09c700 con 0x7f21bc09d6f0 2023-10-03T10:17:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c1434700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21bc09d6f0 0x7f21bc11e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c1434700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21bc09d6f0 0x7f21bc11e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42008/0 (socket says 172.21.15.72:42008) 2023-10-03T10:17:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c1c35700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc09e410 0x7f21bc11ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c1434700 1 -- 172.21.15.72:0/3977509349 learned_addr learned my addr 172.21.15.72:0/3977509349 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c0c33700 1 --2- 172.21.15.72:0/3977509349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21bc09e000 0x7f21bc11e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c1c35700 1 -- 172.21.15.72:0/3977509349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21bc09d6f0 msgr2=0x7f21bc11e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c1c35700 1 --2- 172.21.15.72:0/3977509349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21bc09d6f0 0x7f21bc11e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c1c35700 1 -- 172.21.15.72:0/3977509349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21bc09e000 msgr2=0x7f21bc11e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c1c35700 1 --2- 172.21.15.72:0/3977509349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21bc09e000 0x7f21bc11e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c1c35700 1 -- 172.21.15.72:0/3977509349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac0094a0 con 0x7f21bc09e410 2023-10-03T10:17:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.205+0000 7f21c1434700 1 --2- 172.21.15.72:0/3977509349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21bc09d6f0 0x7f21bc11e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.206+0000 7f21c1c35700 1 --2- 172.21.15.72:0/3977509349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc09e410 0x7f21bc11ebd0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f21b400efc0 tx=0x7f21b400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.206+0000 7f21b1ffb700 1 -- 172.21.15.72:0/3977509349 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b400ca90 con 0x7f21bc09e410 2023-10-03T10:17:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.206+0000 7f21b1ffb700 1 -- 172.21.15.72:0/3977509349 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b400f040 con 0x7f21bc09e410 2023-10-03T10:17:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.206+0000 7f21c3698700 1 -- 172.21.15.72:0/3977509349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b4009a70 con 0x7f21bc09e410 2023-10-03T10:17:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.206+0000 7f21b1ffb700 1 -- 172.21.15.72:0/3977509349 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b400ce30 con 0x7f21bc09e410 2023-10-03T10:17:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.206+0000 7f21c3698700 1 -- 172.21.15.72:0/3977509349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b800b7f0 con 0x7f21bc09e410 2023-10-03T10:17:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.206+0000 7f21b1ffb700 1 -- 172.21.15.72:0/3977509349 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21b4014480 con 0x7f21bc09e410 2023-10-03T10:17:52.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.207+0000 7f21b1ffb700 1 -- 172.21.15.72:0/3977509349 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f21b403fc10 con 0x7f21bc09e410 2023-10-03T10:17:52.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.207+0000 7f21c3698700 1 -- 172.21.15.72:0/3977509349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21bc121470 con 0x7f21bc09e410 2023-10-03T10:17:52.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.211+0000 7f21b1ffb700 1 -- 172.21.15.72:0/3977509349 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21b4012930 con 0x7f21bc09e410 2023-10-03T10:17:52.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.395+0000 7f21c3698700 1 -- 172.21.15.72:0/3977509349 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f21bc074ea0 con 0x7f21bc09e410 2023-10-03T10:17:52.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.395+0000 7f21b1ffb700 1 -- 172.21.15.72:0/3977509349 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21b402b090 con 0x7f21bc09e410 2023-10-03T10:17:52.396 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:52.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.397+0000 7f21c3698700 1 -- 172.21.15.72:0/3977509349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc09e410 msgr2=0x7f21bc11ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.397+0000 7f21c3698700 1 --2- 172.21.15.72:0/3977509349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc09e410 0x7f21bc11ebd0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f21b400efc0 tx=0x7f21b400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.397+0000 7f21c3698700 1 -- 172.21.15.72:0/3977509349 shutdown_connections 2023-10-03T10:17:52.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.397+0000 7f21c3698700 1 --2- 172.21.15.72:0/3977509349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21bc09e410 0x7f21bc11ebd0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.397+0000 7f21c3698700 1 --2- 172.21.15.72:0/3977509349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21bc09d6f0 0x7f21bc11e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.397+0000 7f21c3698700 1 --2- 172.21.15.72:0/3977509349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21bc09e000 0x7f21bc11e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.397+0000 7f21c3698700 1 -- 172.21.15.72:0/3977509349 >> 172.21.15.72:0/3977509349 conn(0x7f21bc066f50 msgr2=0x7f21bc06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.397+0000 7f21c3698700 1 -- 172.21.15.72:0/3977509349 shutdown_connections 2023-10-03T10:17:52.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:52.397+0000 7f21c3698700 1 -- 172.21.15.72:0/3977509349 wait complete. 2023-10-03T10:17:52.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:52.968 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:53.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:53.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:53.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.098+0000 7f38962cb700 1 Processor -- start 2023-10-03T10:17:53.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.098+0000 7f38962cb700 1 -- start start 2023-10-03T10:17:53.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.099+0000 7f38962cb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f389009d6f0 0x7f389009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.099+0000 7f38962cb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389009e440 0x7f3890134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.099+0000 7f38962cb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389009b120 con 0x7f389009e000 2023-10-03T10:17:53.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.099+0000 7f38962cb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389006b460 con 0x7f389009d6f0 2023-10-03T10:17:53.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.099+0000 7f38962cb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389009a7e0 con 0x7f389009e440 2023-10-03T10:17:53.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.099+0000 7f388ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f389009d6f0 0x7f389009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.099+0000 7f388f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f389009e000 0x7f38901339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52624/0 (socket says 172.21.15.72:52624) 2023-10-03T10:17:53.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.099+0000 7f388f7fe700 1 -- 172.21.15.72:0/808019062 learned_addr learned my addr 172.21.15.72:0/808019062 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:53.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.099+0000 7f3894868700 1 --2- 172.21.15.72:0/808019062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389009e440 0x7f3890134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.100+0000 7f388ffff700 1 -- 172.21.15.72:0/808019062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389009e440 msgr2=0x7f3890134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.100+0000 7f388ffff700 1 --2- 172.21.15.72:0/808019062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389009e440 0x7f3890134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.100+0000 7f388ffff700 1 -- 172.21.15.72:0/808019062 >> v1:172.21.15.72:6789/0 conn(0x7f389009e000 legacy=0x7f38901339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.100+0000 7f388effd700 1 -- 172.21.15.72:0/808019062 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384237267 0 0) 0x7f389009b120 con 0x7f389009e000 2023-10-03T10:17:53.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.100+0000 7f388ffff700 1 -- 172.21.15.72:0/808019062 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389009a500 con 0x7f389009d6f0 2023-10-03T10:17:53.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.100+0000 7f3894868700 1 --2- 172.21.15.72:0/808019062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389009e440 0x7f3890134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.100+0000 7f388ffff700 1 --2- 172.21.15.72:0/808019062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389009d6f0 0x7f389009dac0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f3880009870 tx=0x7f3880009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10117ffd198dc844 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.100+0000 7f388effd700 1 -- 172.21.15.72:0/808019062 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880011830 con 0x7f389009d6f0 2023-10-03T10:17:53.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.100+0000 7f388effd700 1 -- 172.21.15.72:0/808019062 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3880011990 con 0x7f389009d6f0 2023-10-03T10:17:53.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.100+0000 7f388effd700 1 -- 172.21.15.72:0/808019062 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880011d20 con 0x7f389009d6f0 2023-10-03T10:17:53.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.101+0000 7f38962cb700 1 -- 172.21.15.72:0/808019062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389009d6f0 msgr2=0x7f389009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.101+0000 7f38962cb700 1 --2- 172.21.15.72:0/808019062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389009d6f0 0x7f389009dac0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f3880009870 tx=0x7f3880009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:53.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.101+0000 7f38962cb700 1 -- 172.21.15.72:0/808019062 shutdown_connections 2023-10-03T10:17:53.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.101+0000 7f38962cb700 1 --2- 172.21.15.72:0/808019062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389009e440 0x7f3890134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.101+0000 7f38962cb700 1 --2- 172.21.15.72:0/808019062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389009d6f0 0x7f389009dac0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.101+0000 7f38962cb700 1 -- 172.21.15.72:0/808019062 >> 172.21.15.72:0/808019062 conn(0x7f3890066f50 msgr2=0x7f389009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.101+0000 7f38962cb700 1 -- 172.21.15.72:0/808019062 shutdown_connections 2023-10-03T10:17:53.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.101+0000 7f38962cb700 1 -- 172.21.15.72:0/808019062 wait complete. 2023-10-03T10:17:53.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.102+0000 7f38962cb700 1 Processor -- start 2023-10-03T10:17:53.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.102+0000 7f38962cb700 1 -- start start 2023-10-03T10:17:53.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.103+0000 7f38962cb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389009d6f0 0x7f38901c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.103+0000 7f38962cb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389009e000 0x7f38901c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.103+0000 7f38962cb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389009e440 0x7f38901c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.103+0000 7f38962cb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38901a6f70 con 0x7f389009e440 2023-10-03T10:17:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.103+0000 7f38962cb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38901a6410 con 0x7f389009e000 2023-10-03T10:17:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.103+0000 7f38962cb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f389009c710 con 0x7f389009d6f0 2023-10-03T10:17:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.103+0000 7f388f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389009e000 0x7f38901c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.103+0000 7f3894868700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389009e440 0x7f38901c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.103+0000 7f388f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389009e000 0x7f38901c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53882/0 (socket says 172.21.15.72:53882) 2023-10-03T10:17:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.103+0000 7f3894868700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389009e440 0x7f38901c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51686/0 (socket says 172.21.15.72:51686) 2023-10-03T10:17:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.103+0000 7f388f7fe700 1 -- 172.21.15.72:0/2418464545 learned_addr learned my addr 172.21.15.72:0/2418464545 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.103+0000 7f388ffff700 1 --2- 172.21.15.72:0/2418464545 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389009d6f0 0x7f38901c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.104+0000 7f388f7fe700 1 -- 172.21.15.72:0/2418464545 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389009d6f0 msgr2=0x7f38901c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.104+0000 7f388f7fe700 1 --2- 172.21.15.72:0/2418464545 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389009d6f0 0x7f38901c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.104+0000 7f388f7fe700 1 -- 172.21.15.72:0/2418464545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389009e440 msgr2=0x7f38901c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.104+0000 7f388f7fe700 1 --2- 172.21.15.72:0/2418464545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389009e440 0x7f38901c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.104+0000 7f388f7fe700 1 -- 172.21.15.72:0/2418464545 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3888009a70 con 0x7f389009e000 2023-10-03T10:17:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.104+0000 7f3894868700 1 --2- 172.21.15.72:0/2418464545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389009e440 0x7f38901c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.104+0000 7f388ffff700 1 --2- 172.21.15.72:0/2418464545 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389009d6f0 0x7f38901c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.104+0000 7f388f7fe700 1 --2- 172.21.15.72:0/2418464545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389009e000 0x7f38901c8480 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f388400c520 tx=0x7f388400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.104+0000 7f388cff9700 1 -- 172.21.15.72:0/2418464545 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884004c80 con 0x7f389009e000 2023-10-03T10:17:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.104+0000 7f388cff9700 1 -- 172.21.15.72:0/2418464545 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3884004e00 con 0x7f389009e000 2023-10-03T10:17:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.104+0000 7f38962cb700 1 -- 172.21.15.72:0/2418464545 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38800094a0 con 0x7f389009e000 2023-10-03T10:17:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.104+0000 7f388cff9700 1 -- 172.21.15.72:0/2418464545 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884007310 con 0x7f389009e000 2023-10-03T10:17:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.104+0000 7f38962cb700 1 -- 172.21.15.72:0/2418464545 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38901a7f70 con 0x7f389009e000 2023-10-03T10:17:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.105+0000 7f388cff9700 1 -- 172.21.15.72:0/2418464545 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3884007470 con 0x7f389009e000 2023-10-03T10:17:53.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.105+0000 7f38962cb700 1 -- 172.21.15.72:0/2418464545 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38901b91f0 con 0x7f389009e000 2023-10-03T10:17:53.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.105+0000 7f388cff9700 1 -- 172.21.15.72:0/2418464545 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f388403f270 con 0x7f389009e000 2023-10-03T10:17:53.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.110+0000 7f388cff9700 1 -- 172.21.15.72:0/2418464545 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38901b91f0 con 0x7f389009e000 2023-10-03T10:17:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.140+0000 7f94152b0700 1 Processor -- start 2023-10-03T10:17:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.140+0000 7f94152b0700 1 -- start start 2023-10-03T10:17:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f94152b0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f941006a770 0x7f941006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f94152b0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f941006b080 0x7f9410131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f94152b0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9410131b40 0x7f9410131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f94152b0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941009ece0 con 0x7f9410131b40 2023-10-03T10:17:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f94152b0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941009e760 con 0x7f941006b080 2023-10-03T10:17:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f94152b0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f941009e040 con 0x7f941006a770 2023-10-03T10:17:53.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f940effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f941006a770 0x7f941006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f940effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f941006a770 0x7f941006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42016/0 (socket says 172.21.15.72:42016) 2023-10-03T10:17:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f940effd700 1 -- 172.21.15.72:0/3101281778 learned_addr learned my addr 172.21.15.72:0/3101281778 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f940e7fc700 1 --2- 172.21.15.72:0/3101281778 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f941006b080 0x7f9410131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f940f7fe700 1 --2- 172.21.15.72:0/3101281778 >> v2:172.21.15.72:3300/0 conn(0x7f9410131b40 0x7f9410131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f940e7fc700 1 -- 172.21.15.72:0/3101281778 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f941006a770 msgr2=0x7f941006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f940e7fc700 1 --2- 172.21.15.72:0/3101281778 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f941006a770 0x7f941006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f940e7fc700 1 -- 172.21.15.72:0/3101281778 >> v2:172.21.15.72:3300/0 conn(0x7f9410131b40 msgr2=0x7f9410131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f940e7fc700 1 --2- 172.21.15.72:0/3101281778 >> v2:172.21.15.72:3300/0 conn(0x7f9410131b40 0x7f9410131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f940e7fc700 1 -- 172.21.15.72:0/3101281778 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941009f630 con 0x7f941006b080 2023-10-03T10:17:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f940f7fe700 1 --2- 172.21.15.72:0/3101281778 >> v2:172.21.15.72:3300/0 conn(0x7f9410131b40 0x7f9410131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f940effd700 1 --2- 172.21.15.72:0/3101281778 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f941006a770 0x7f941006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.141+0000 7f940e7fc700 1 --2- 172.21.15.72:0/3101281778 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f941006b080 0x7f9410131600 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9404009840 tx=0x7f9404009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=520ab61f324bdcb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.142+0000 7f940dffb700 1 -- 172.21.15.72:0/3101281778 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404011830 con 0x7f941006b080 2023-10-03T10:17:53.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.142+0000 7f940dffb700 1 -- 172.21.15.72:0/3101281778 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9404011990 con 0x7f941006b080 2023-10-03T10:17:53.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.142+0000 7f940dffb700 1 -- 172.21.15.72:0/3101281778 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404011d00 con 0x7f941006b080 2023-10-03T10:17:53.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.142+0000 7f94152b0700 1 -- 172.21.15.72:0/3101281778 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f941006b080 msgr2=0x7f9410131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.142+0000 7f94152b0700 1 --2- 172.21.15.72:0/3101281778 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f941006b080 0x7f9410131600 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9404009840 tx=0x7f9404009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:53.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.142+0000 7f94152b0700 1 -- 172.21.15.72:0/3101281778 shutdown_connections 2023-10-03T10:17:53.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.142+0000 7f94152b0700 1 --2- 172.21.15.72:0/3101281778 >> v2:172.21.15.72:3300/0 conn(0x7f9410131b40 0x7f9410131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.142+0000 7f94152b0700 1 --2- 172.21.15.72:0/3101281778 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f941006a770 0x7f941006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.142+0000 7f94152b0700 1 --2- 172.21.15.72:0/3101281778 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f941006b080 0x7f9410131600 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.142+0000 7f94152b0700 1 -- 172.21.15.72:0/3101281778 >> 172.21.15.72:0/3101281778 conn(0x7f9410066f50 msgr2=0x7f941009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.142+0000 7f94152b0700 1 -- 172.21.15.72:0/3101281778 shutdown_connections 2023-10-03T10:17:53.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.142+0000 7f94152b0700 1 -- 172.21.15.72:0/3101281778 wait complete. 2023-10-03T10:17:53.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.143+0000 7f94152b0700 1 Processor -- start 2023-10-03T10:17:53.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.143+0000 7f94152b0700 1 -- start start 2023-10-03T10:17:53.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f94152b0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941006a770 0x7f9410119770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f94152b0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f941006b080 0x7f9410119cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f94152b0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9410131b40 0x7f94101cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f94152b0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941012af40 con 0x7f941006a770 2023-10-03T10:17:53.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f94152b0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941011b070 con 0x7f9410131b40 2023-10-03T10:17:53.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f94152b0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94100a35d0 con 0x7f941006b080 2023-10-03T10:17:53.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f940e7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f941006b080 0x7f9410119cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f940e7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f941006b080 0x7f9410119cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42022/0 (socket says 172.21.15.72:42022) 2023-10-03T10:17:53.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f940e7fc700 1 -- 172.21.15.72:0/3327834253 learned_addr learned my addr 172.21.15.72:0/3327834253 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:53.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f940effd700 1 --2- 172.21.15.72:0/3327834253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941006a770 0x7f9410119770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f940f7fe700 1 --2- 172.21.15.72:0/3327834253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9410131b40 0x7f94101cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f940e7fc700 1 -- 172.21.15.72:0/3327834253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9410131b40 msgr2=0x7f94101cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f940e7fc700 1 --2- 172.21.15.72:0/3327834253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9410131b40 0x7f94101cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f940e7fc700 1 -- 172.21.15.72:0/3327834253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941006a770 msgr2=0x7f9410119770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f940e7fc700 1 --2- 172.21.15.72:0/3327834253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941006a770 0x7f9410119770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.144+0000 7f940e7fc700 1 -- 172.21.15.72:0/3327834253 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9400009550 con 0x7f941006b080 2023-10-03T10:17:53.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.145+0000 7f940e7fc700 1 --2- 172.21.15.72:0/3327834253 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f941006b080 0x7f9410119cb0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f94040090b0 tx=0x7f9404004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.145+0000 7f93f77fe700 1 -- 172.21.15.72:0/3327834253 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404004450 con 0x7f941006b080 2023-10-03T10:17:53.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.145+0000 7f93f77fe700 1 -- 172.21.15.72:0/3327834253 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940401f070 con 0x7f941006b080 2023-10-03T10:17:53.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.145+0000 7f94152b0700 1 -- 172.21.15.72:0/3327834253 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9408009a70 con 0x7f941006b080 2023-10-03T10:17:53.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.145+0000 7f93f77fe700 1 -- 172.21.15.72:0/3327834253 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94040045f0 con 0x7f941006b080 2023-10-03T10:17:53.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.145+0000 7f94152b0700 1 -- 172.21.15.72:0/3327834253 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94040094a0 con 0x7f941006b080 2023-10-03T10:17:53.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.146+0000 7f93f77fe700 1 -- 172.21.15.72:0/3327834253 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f94040038e0 con 0x7f941006b080 2023-10-03T10:17:53.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.146+0000 7f94152b0700 1 -- 172.21.15.72:0/3327834253 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9410074ea0 con 0x7f941006b080 2023-10-03T10:17:53.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.146+0000 7f93f77fe700 1 -- 172.21.15.72:0/3327834253 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9404021070 con 0x7f941006b080 2023-10-03T10:17:53.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.151+0000 7f93f77fe700 1 -- 172.21.15.72:0/3327834253 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f940402f760 con 0x7f941006b080 2023-10-03T10:17:53.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.182+0000 7ffb23ff7700 1 Processor -- start 2023-10-03T10:17:53.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.182+0000 7ffb23ff7700 1 -- start start 2023-10-03T10:17:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.183+0000 7ffb23ff7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffb1c09e930 0x7ffb1c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.183+0000 7ffb23ff7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09f650 0x7ffb1c131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.183+0000 7ffb23ff7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1c070940 con 0x7ffb1c09f240 2023-10-03T10:17:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.183+0000 7ffb23ff7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1c06fd60 con 0x7ffb1c09e930 2023-10-03T10:17:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.183+0000 7ffb23ff7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c06fa80 con 0x7ffb1c09f650 2023-10-03T10:17:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.183+0000 7ffb21d93700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffb1c09e930 0x7ffb1c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.183+0000 7ffb22594700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09f650 0x7ffb1c131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.183+0000 7ffb21d93700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffb1c09e930 0x7ffb1c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51702/0 (socket says 172.21.15.72:51702) 2023-10-03T10:17:53.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.183+0000 7ffb22594700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09f650 0x7ffb1c131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53916/0 (socket says 172.21.15.72:53916) 2023-10-03T10:17:53.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.183+0000 7ffb21d93700 1 -- 172.21.15.72:0/3135970745 learned_addr learned my addr 172.21.15.72:0/3135970745 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:53.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.184+0000 7ffb22594700 1 -- 172.21.15.72:0/3135970745 >> v2:172.21.15.72:3300/0 conn(0x7ffb1c09e930 msgr2=0x7ffb1c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.184+0000 7ffb22594700 1 --2- 172.21.15.72:0/3135970745 >> v2:172.21.15.72:3300/0 conn(0x7ffb1c09e930 0x7ffb1c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.184+0000 7ffb22594700 1 -- 172.21.15.72:0/3135970745 >> v1:172.21.15.72:6789/0 conn(0x7ffb1c09f240 legacy=0x7ffb1c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.184+0000 7ffb22594700 1 -- 172.21.15.72:0/3135970745 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c09fb60 con 0x7ffb1c09f650 2023-10-03T10:17:53.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.184+0000 7ffb22594700 1 --2- 172.21.15.72:0/3135970745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09f650 0x7ffb1c131f00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009d90 tx=0x7ffb1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2e486c2a7084701 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.184+0000 7ffb20d91700 1 -- 172.21.15.72:0/3135970745 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400e070 con 0x7ffb1c09f650 2023-10-03T10:17:53.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.184+0000 7ffb20d91700 1 -- 172.21.15.72:0/3135970745 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1400bb20 con 0x7ffb1c09f650 2023-10-03T10:17:53.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.184+0000 7ffb20d91700 1 -- 172.21.15.72:0/3135970745 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14012430 con 0x7ffb1c09f650 2023-10-03T10:17:53.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.185+0000 7ffb23ff7700 1 -- 172.21.15.72:0/3135970745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09f650 msgr2=0x7ffb1c131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.185+0000 7ffb23ff7700 1 --2- 172.21.15.72:0/3135970745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09f650 0x7ffb1c131f00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009d90 tx=0x7ffb1400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:53.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.185+0000 7ffb23ff7700 1 -- 172.21.15.72:0/3135970745 shutdown_connections 2023-10-03T10:17:53.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.185+0000 7ffb23ff7700 1 --2- 172.21.15.72:0/3135970745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09f650 0x7ffb1c131f00 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.185+0000 7ffb23ff7700 1 --2- 172.21.15.72:0/3135970745 >> v2:172.21.15.72:3300/0 conn(0x7ffb1c09e930 0x7ffb1c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.185+0000 7ffb23ff7700 1 -- 172.21.15.72:0/3135970745 >> 172.21.15.72:0/3135970745 conn(0x7ffb1c0a4210 msgr2=0x7ffb1c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.185+0000 7ffb23ff7700 1 -- 172.21.15.72:0/3135970745 shutdown_connections 2023-10-03T10:17:53.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.185+0000 7ffb23ff7700 1 -- 172.21.15.72:0/3135970745 wait complete. 2023-10-03T10:17:53.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.186+0000 7ffb23ff7700 1 Processor -- start 2023-10-03T10:17:53.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.186+0000 7ffb23ff7700 1 -- start start 2023-10-03T10:17:53.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb23ff7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09e930 0x7ffb1c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb23ff7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09f240 0x7ffb1c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb23ff7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb1c09f650 0x7ffb1c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb23ff7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c1a91d0 con 0x7ffb1c09f650 2023-10-03T10:17:53.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb23ff7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c0a34f0 con 0x7ffb1c09e930 2023-10-03T10:17:53.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb23ff7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c1b7320 con 0x7ffb1c09f240 2023-10-03T10:17:53.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb22594700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb1c09f650 0x7ffb1c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb21d93700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09e930 0x7ffb1c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb22594700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb1c09f650 0x7ffb1c06c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51716/0 (socket says 172.21.15.72:51716) 2023-10-03T10:17:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb22594700 1 -- 172.21.15.72:0/1414574853 learned_addr learned my addr 172.21.15.72:0/1414574853 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb21592700 1 --2- 172.21.15.72:0/1414574853 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09f240 0x7ffb1c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb21d93700 1 -- 172.21.15.72:0/1414574853 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09f240 msgr2=0x7ffb1c06bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb21d93700 1 --2- 172.21.15.72:0/1414574853 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09f240 0x7ffb1c06bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb21d93700 1 -- 172.21.15.72:0/1414574853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb1c09f650 msgr2=0x7ffb1c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb21d93700 1 --2- 172.21.15.72:0/1414574853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb1c09f650 0x7ffb1c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb21d93700 1 -- 172.21.15.72:0/1414574853 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb14009a70 con 0x7ffb1c09e930 2023-10-03T10:17:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb22594700 1 --2- 172.21.15.72:0/1414574853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb1c09f650 0x7ffb1c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.187+0000 7ffb21592700 1 --2- 172.21.15.72:0/1414574853 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09f240 0x7ffb1c06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.188+0000 7ffb21d93700 1 --2- 172.21.15.72:0/1414574853 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09e930 0x7ffb1c06b880 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800e8e0 tx=0x7ffb1800ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.188+0000 7ffb127fc700 1 -- 172.21.15.72:0/1414574853 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18013680 con 0x7ffb1c09e930 2023-10-03T10:17:53.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.188+0000 7ffb127fc700 1 -- 172.21.15.72:0/1414574853 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb180137e0 con 0x7ffb1c09e930 2023-10-03T10:17:53.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.188+0000 7ffb23ff7700 1 -- 172.21.15.72:0/1414574853 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1c0a0190 con 0x7ffb1c09e930 2023-10-03T10:17:53.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.188+0000 7ffb127fc700 1 -- 172.21.15.72:0/1414574853 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb18013b70 con 0x7ffb1c09e930 2023-10-03T10:17:53.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.188+0000 7ffb23ff7700 1 -- 172.21.15.72:0/1414574853 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c1a96f0 con 0x7ffb1c09e930 2023-10-03T10:17:53.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.188+0000 7ffb127fc700 1 -- 172.21.15.72:0/1414574853 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb18013cd0 con 0x7ffb1c09e930 2023-10-03T10:17:53.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.189+0000 7ffb127fc700 1 -- 172.21.15.72:0/1414574853 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb1803f9e0 con 0x7ffb1c09e930 2023-10-03T10:17:53.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.189+0000 7ffb23ff7700 1 -- 172.21.15.72:0/1414574853 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1c1a0b30 con 0x7ffb1c09e930 2023-10-03T10:17:53.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.198+0000 7ffb127fc700 1 -- 172.21.15.72:0/1414574853 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb180119a0 con 0x7ffb1c09e930 2023-10-03T10:17:53.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.312+0000 7f38962cb700 1 -- 172.21.15.72:0/2418464545 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f38901b91f0 con 0x7f389009e000 2023-10-03T10:17:53.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.312+0000 7f388cff9700 1 -- 172.21.15.72:0/2418464545 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f38901b91f0 con 0x7f389009e000 2023-10-03T10:17:53.313 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:53.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.315+0000 7f38962cb700 1 -- 172.21.15.72:0/2418464545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389009e000 msgr2=0x7f38901c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.315+0000 7f38962cb700 1 --2- 172.21.15.72:0/2418464545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389009e000 0x7f38901c8480 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f388400c520 tx=0x7f388400c830 comp rx=0 tx=0).stop 2023-10-03T10:17:53.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.315+0000 7f38962cb700 1 -- 172.21.15.72:0/2418464545 shutdown_connections 2023-10-03T10:17:53.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.315+0000 7f38962cb700 1 --2- 172.21.15.72:0/2418464545 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389009e440 0x7f38901c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.315+0000 7f38962cb700 1 --2- 172.21.15.72:0/2418464545 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f389009d6f0 0x7f38901c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.315+0000 7f38962cb700 1 --2- 172.21.15.72:0/2418464545 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f389009e000 0x7f38901c8480 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.315+0000 7f38962cb700 1 -- 172.21.15.72:0/2418464545 >> 172.21.15.72:0/2418464545 conn(0x7f3890066f50 msgr2=0x7f38901bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.315+0000 7f38962cb700 1 -- 172.21.15.72:0/2418464545 shutdown_connections 2023-10-03T10:17:53.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.315+0000 7f38962cb700 1 -- 172.21.15.72:0/2418464545 wait complete. 2023-10-03T10:17:53.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.357+0000 7f94152b0700 1 -- 172.21.15.72:0/3327834253 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f941011b860 con 0x7f941006b080 2023-10-03T10:17:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.357+0000 7f93f77fe700 1 -- 172.21.15.72:0/3327834253 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f940402b070 con 0x7f941006b080 2023-10-03T10:17:53.357 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:53.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.360+0000 7f94152b0700 1 -- 172.21.15.72:0/3327834253 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f941006b080 msgr2=0x7f9410119cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.360+0000 7f94152b0700 1 --2- 172.21.15.72:0/3327834253 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f941006b080 0x7f9410119cb0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f94040090b0 tx=0x7f9404004750 comp rx=0 tx=0).stop 2023-10-03T10:17:53.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.360+0000 7f94152b0700 1 -- 172.21.15.72:0/3327834253 shutdown_connections 2023-10-03T10:17:53.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.360+0000 7f94152b0700 1 --2- 172.21.15.72:0/3327834253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941006a770 0x7f9410119770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.360+0000 7f94152b0700 1 --2- 172.21.15.72:0/3327834253 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9410131b40 0x7f94101cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.360+0000 7f94152b0700 1 --2- 172.21.15.72:0/3327834253 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f941006b080 0x7f9410119cb0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.360+0000 7f94152b0700 1 -- 172.21.15.72:0/3327834253 >> 172.21.15.72:0/3327834253 conn(0x7f9410066f50 msgr2=0x7f94100a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.360+0000 7f94152b0700 1 -- 172.21.15.72:0/3327834253 shutdown_connections 2023-10-03T10:17:53.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.360+0000 7f94152b0700 1 -- 172.21.15.72:0/3327834253 wait complete. 2023-10-03T10:17:53.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.401+0000 7ffb23ff7700 1 -- 172.21.15.72:0/1414574853 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffb1c074ea0 con 0x7ffb1c09e930 2023-10-03T10:17:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.401+0000 7ffb127fc700 1 -- 172.21.15.72:0/1414574853 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffb18021030 con 0x7ffb1c09e930 2023-10-03T10:17:53.402 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:53.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.403+0000 7ffb23ff7700 1 -- 172.21.15.72:0/1414574853 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09e930 msgr2=0x7ffb1c06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.403+0000 7ffb23ff7700 1 --2- 172.21.15.72:0/1414574853 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09e930 0x7ffb1c06b880 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800e8e0 tx=0x7ffb1800ebf0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.403+0000 7ffb23ff7700 1 -- 172.21.15.72:0/1414574853 shutdown_connections 2023-10-03T10:17:53.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.403+0000 7ffb23ff7700 1 --2- 172.21.15.72:0/1414574853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb1c09f650 0x7ffb1c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.403+0000 7ffb23ff7700 1 --2- 172.21.15.72:0/1414574853 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb1c09e930 0x7ffb1c06b880 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.403+0000 7ffb23ff7700 1 --2- 172.21.15.72:0/1414574853 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb1c09f240 0x7ffb1c06bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.403+0000 7ffb23ff7700 1 -- 172.21.15.72:0/1414574853 >> 172.21.15.72:0/1414574853 conn(0x7ffb1c0a4210 msgr2=0x7ffb1c1b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.403+0000 7ffb23ff7700 1 -- 172.21.15.72:0/1414574853 shutdown_connections 2023-10-03T10:17:53.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.403+0000 7ffb23ff7700 1 -- 172.21.15.72:0/1414574853 wait complete. 2023-10-03T10:17:53.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:53.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:53.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc7b0c9700 1 Processor -- start 2023-10-03T10:17:53.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc7b0c9700 1 -- start start 2023-10-03T10:17:53.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc7b0c9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc7409d6f0 0x7fdc7409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc7b0c9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdc7409e000 0x7fdc74130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc7b0c9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc7409e410 0x7fdc74130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc7b0c9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7409f520 con 0x7fdc7409d6f0 2023-10-03T10:17:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc7b0c9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7409f130 con 0x7fdc7409e410 2023-10-03T10:17:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc7b0c9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7409e930 con 0x7fdc7409e000 2023-10-03T10:17:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc78e65700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc7409d6f0 0x7fdc7409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc73fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdc7409e000 0x7fdc74130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc78e65700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc7409d6f0 0x7fdc7409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51720/0 (socket says 172.21.15.72:51720) 2023-10-03T10:17:53.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc73fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdc7409e000 0x7fdc74130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42036/0 (socket says 172.21.15.72:42036) 2023-10-03T10:17:53.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc78e65700 1 -- 172.21.15.72:0/2017399395 learned_addr learned my addr 172.21.15.72:0/2017399395 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:53.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc79666700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc7409e410 0x7fdc74130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc73fff700 1 -- 172.21.15.72:0/2017399395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc7409e410 msgr2=0x7fdc74130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc73fff700 1 --2- 172.21.15.72:0/2017399395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc7409e410 0x7fdc74130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc73fff700 1 -- 172.21.15.72:0/2017399395 >> v2:172.21.15.72:3300/0 conn(0x7fdc7409d6f0 msgr2=0x7fdc7409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc73fff700 1 --2- 172.21.15.72:0/2017399395 >> v2:172.21.15.72:3300/0 conn(0x7fdc7409d6f0 0x7fdc7409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc73fff700 1 -- 172.21.15.72:0/2017399395 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7409b2d0 con 0x7fdc7409e000 2023-10-03T10:17:53.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.532+0000 7fdc78e65700 1 --2- 172.21.15.72:0/2017399395 >> v2:172.21.15.72:3300/0 conn(0x7fdc7409d6f0 0x7fdc7409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.533+0000 7fdc73fff700 1 --2- 172.21.15.72:0/2017399395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdc7409e000 0x7fdc74130660 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdc60009870 tx=0x7fdc60009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17094a6a69c45b91 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.533+0000 7fdc737fe700 1 -- 172.21.15.72:0/2017399395 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60011830 con 0x7fdc7409e000 2023-10-03T10:17:53.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.533+0000 7fdc737fe700 1 -- 172.21.15.72:0/2017399395 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc60011990 con 0x7fdc7409e000 2023-10-03T10:17:53.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.533+0000 7fdc737fe700 1 -- 172.21.15.72:0/2017399395 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60011d20 con 0x7fdc7409e000 2023-10-03T10:17:53.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.533+0000 7fdc7b0c9700 1 -- 172.21.15.72:0/2017399395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdc7409e000 msgr2=0x7fdc74130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.533+0000 7fdc7b0c9700 1 --2- 172.21.15.72:0/2017399395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdc7409e000 0x7fdc74130660 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdc60009870 tx=0x7fdc60009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:53.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.533+0000 7fdc7b0c9700 1 -- 172.21.15.72:0/2017399395 shutdown_connections 2023-10-03T10:17:53.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.533+0000 7fdc7b0c9700 1 --2- 172.21.15.72:0/2017399395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc7409e410 0x7fdc74130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.533+0000 7fdc7b0c9700 1 --2- 172.21.15.72:0/2017399395 >> v2:172.21.15.72:3300/0 conn(0x7fdc7409d6f0 0x7fdc7409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.533+0000 7fdc7b0c9700 1 --2- 172.21.15.72:0/2017399395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdc7409e000 0x7fdc74130660 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.533+0000 7fdc7b0c9700 1 -- 172.21.15.72:0/2017399395 >> 172.21.15.72:0/2017399395 conn(0x7fdc74066f50 msgr2=0x7fdc7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.533+0000 7fdc7b0c9700 1 -- 172.21.15.72:0/2017399395 shutdown_connections 2023-10-03T10:17:53.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.533+0000 7fdc7b0c9700 1 -- 172.21.15.72:0/2017399395 wait complete. 2023-10-03T10:17:53.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.534+0000 7fdc7b0c9700 1 Processor -- start 2023-10-03T10:17:53.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.534+0000 7fdc7b0c9700 1 -- start start 2023-10-03T10:17:53.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc7b0c9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc7409d6f0 0x7fdc74122670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc7b0c9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc7409e000 0x7fdc74122bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc7b0c9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdc7409e410 0x7fdc741230f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc7b0c9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74130a50 con 0x7fdc7409e000 2023-10-03T10:17:53.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc7b0c9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74126220 con 0x7fdc7409d6f0 2023-10-03T10:17:53.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc7b0c9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74130590 con 0x7fdc7409e410 2023-10-03T10:17:53.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc78e65700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc7409d6f0 0x7fdc74122670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc78e65700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc7409d6f0 0x7fdc74122670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53942/0 (socket says 172.21.15.72:53942) 2023-10-03T10:17:53.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc78e65700 1 -- 172.21.15.72:0/3795237905 learned_addr learned my addr 172.21.15.72:0/3795237905 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:53.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc79666700 1 --2- 172.21.15.72:0/3795237905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdc7409e410 0x7fdc741230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc73fff700 1 --2- 172.21.15.72:0/3795237905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc7409e000 0x7fdc74122bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc78e65700 1 -- 172.21.15.72:0/3795237905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdc7409e410 msgr2=0x7fdc741230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc78e65700 1 --2- 172.21.15.72:0/3795237905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdc7409e410 0x7fdc741230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc78e65700 1 -- 172.21.15.72:0/3795237905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc7409e000 msgr2=0x7fdc74122bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc78e65700 1 --2- 172.21.15.72:0/3795237905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc7409e000 0x7fdc74122bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc78e65700 1 -- 172.21.15.72:0/3795237905 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc68009550 con 0x7fdc7409d6f0 2023-10-03T10:17:53.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc73fff700 1 --2- 172.21.15.72:0/3795237905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc7409e000 0x7fdc74122bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc78e65700 1 --2- 172.21.15.72:0/3795237905 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc7409d6f0 0x7fdc74122670 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800ebe0 tx=0x7fdc6800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.535+0000 7fdc717fa700 1 -- 172.21.15.72:0/3795237905 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68004030 con 0x7fdc7409d6f0 2023-10-03T10:17:53.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.536+0000 7fdc717fa700 1 -- 172.21.15.72:0/3795237905 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc68004190 con 0x7fdc7409d6f0 2023-10-03T10:17:53.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.536+0000 7fdc7b0c9700 1 -- 172.21.15.72:0/3795237905 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc600094a0 con 0x7fdc7409d6f0 2023-10-03T10:17:53.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.536+0000 7fdc717fa700 1 -- 172.21.15.72:0/3795237905 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68004520 con 0x7fdc7409d6f0 2023-10-03T10:17:53.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.536+0000 7fdc7b0c9700 1 -- 172.21.15.72:0/3795237905 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7409c750 con 0x7fdc7409d6f0 2023-10-03T10:17:53.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.536+0000 7fdc717fa700 1 -- 172.21.15.72:0/3795237905 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc6800c850 con 0x7fdc7409d6f0 2023-10-03T10:17:53.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.536+0000 7fdc717fa700 1 -- 172.21.15.72:0/3795237905 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdc6803f520 con 0x7fdc7409d6f0 2023-10-03T10:17:53.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.536+0000 7fdc7b0c9700 1 -- 172.21.15.72:0/3795237905 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc741269e0 con 0x7fdc7409d6f0 2023-10-03T10:17:53.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.541+0000 7fdc717fa700 1 -- 172.21.15.72:0/3795237905 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc680036a0 con 0x7fdc7409d6f0 2023-10-03T10:17:53.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.727+0000 7fdc7b0c9700 1 -- 172.21.15.72:0/3795237905 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdc74074ea0 con 0x7fdc7409d6f0 2023-10-03T10:17:53.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.727+0000 7fdc717fa700 1 -- 172.21.15.72:0/3795237905 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc68019ab0 con 0x7fdc7409d6f0 2023-10-03T10:17:53.728 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:53.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.729+0000 7fdc7b0c9700 1 -- 172.21.15.72:0/3795237905 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc7409d6f0 msgr2=0x7fdc74122670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.729+0000 7fdc7b0c9700 1 --2- 172.21.15.72:0/3795237905 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc7409d6f0 0x7fdc74122670 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800ebe0 tx=0x7fdc6800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.729+0000 7fdc7b0c9700 1 -- 172.21.15.72:0/3795237905 shutdown_connections 2023-10-03T10:17:53.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.729+0000 7fdc7b0c9700 1 --2- 172.21.15.72:0/3795237905 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdc7409e410 0x7fdc741230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.729+0000 7fdc7b0c9700 1 --2- 172.21.15.72:0/3795237905 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdc7409d6f0 0x7fdc74122670 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.729+0000 7fdc7b0c9700 1 --2- 172.21.15.72:0/3795237905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc7409e000 0x7fdc74122bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.729+0000 7fdc7b0c9700 1 -- 172.21.15.72:0/3795237905 >> 172.21.15.72:0/3795237905 conn(0x7fdc74066f50 msgr2=0x7fdc7406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.729+0000 7fdc7b0c9700 1 -- 172.21.15.72:0/3795237905 shutdown_connections 2023-10-03T10:17:53.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:53.729+0000 7fdc7b0c9700 1 -- 172.21.15.72:0/3795237905 wait complete. 2023-10-03T10:17:53.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:54.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:54.377 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:54.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:54.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.468+0000 7ff7da3ff700 1 Processor -- start 2023-10-03T10:17:54.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.468+0000 7ff7da3ff700 1 -- start start 2023-10-03T10:17:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7da3ff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7d4130540 0x7ff7d4130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7da3ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7d406fcf0 0x7ff7d4138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7da3ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d40716a0 con 0x7ff7d4130e50 2023-10-03T10:17:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7da3ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d409a390 con 0x7ff7d406fcf0 2023-10-03T10:17:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7da3ff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d4071290 con 0x7ff7d4130540 2023-10-03T10:17:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7d3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7d4130540 0x7ff7d4130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7d899c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7d406fcf0 0x7ff7d4138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7d899c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7d406fcf0 0x7ff7d4138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51736/0 (socket says 172.21.15.72:51736) 2023-10-03T10:17:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7d3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7d4130540 0x7ff7d4130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53944/0 (socket says 172.21.15.72:53944) 2023-10-03T10:17:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7d899c700 1 -- 172.21.15.72:0/1400921274 learned_addr learned my addr 172.21.15.72:0/1400921274 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:54.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7d899c700 1 -- 172.21.15.72:0/1400921274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7d4130540 msgr2=0x7ff7d4130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:54.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7d899c700 1 --2- 172.21.15.72:0/1400921274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7d4130540 0x7ff7d4130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7d899c700 1 -- 172.21.15.72:0/1400921274 >> v1:172.21.15.72:6789/0 conn(0x7ff7d4130e50 legacy=0x7ff7d406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7d2ffd700 1 -- 172.21.15.72:0/1400921274 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250658968 0 0) 0x7ff7d40716a0 con 0x7ff7d4130e50 2023-10-03T10:17:54.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7d899c700 1 -- 172.21.15.72:0/1400921274 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d4130340 con 0x7ff7d406fcf0 2023-10-03T10:17:54.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.469+0000 7ff7d3fff700 1 --2- 172.21.15.72:0/1400921274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7d4130540 0x7ff7d4130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.470+0000 7ff7d899c700 1 --2- 172.21.15.72:0/1400921274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7d406fcf0 0x7ff7d4138570 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009480 tx=0x7ff7cc00f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b035abb06a55df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.470+0000 7ff7d2ffd700 1 -- 172.21.15.72:0/1400921274 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc012070 con 0x7ff7d406fcf0 2023-10-03T10:17:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.470+0000 7ff7d2ffd700 1 -- 172.21.15.72:0/1400921274 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc016430 con 0x7ff7d406fcf0 2023-10-03T10:17:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.470+0000 7ff7d2ffd700 1 -- 172.21.15.72:0/1400921274 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0167c0 con 0x7ff7d406fcf0 2023-10-03T10:17:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.470+0000 7ff7da3ff700 1 -- 172.21.15.72:0/1400921274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7d406fcf0 msgr2=0x7ff7d4138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.470+0000 7ff7da3ff700 1 --2- 172.21.15.72:0/1400921274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7d406fcf0 0x7ff7d4138570 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009480 tx=0x7ff7cc00f5c0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.471+0000 7ff7da3ff700 1 -- 172.21.15.72:0/1400921274 shutdown_connections 2023-10-03T10:17:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.471+0000 7ff7da3ff700 1 --2- 172.21.15.72:0/1400921274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7d406fcf0 0x7ff7d4138570 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.471+0000 7ff7da3ff700 1 --2- 172.21.15.72:0/1400921274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7d4130540 0x7ff7d4130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.471+0000 7ff7da3ff700 1 -- 172.21.15.72:0/1400921274 >> 172.21.15.72:0/1400921274 conn(0x7ff7d40a2aa0 msgr2=0x7ff7d40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.471+0000 7ff7da3ff700 1 -- 172.21.15.72:0/1400921274 shutdown_connections 2023-10-03T10:17:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.471+0000 7ff7da3ff700 1 -- 172.21.15.72:0/1400921274 wait complete. 2023-10-03T10:17:54.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.471+0000 7ff7da3ff700 1 Processor -- start 2023-10-03T10:17:54.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.472+0000 7ff7da3ff700 1 -- start start 2023-10-03T10:17:54.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.472+0000 7ff7da3ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7d406fcf0 0x7ff7d41c0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.472+0000 7ff7da3ff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7d4130540 0x7ff7d41c0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.472+0000 7ff7da3ff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7d4130e50 0x7ff7d41c3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.472+0000 7ff7da3ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d41c1390 con 0x7ff7d406fcf0 2023-10-03T10:17:54.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.472+0000 7ff7da3ff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d411deb0 con 0x7ff7d4130540 2023-10-03T10:17:54.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.472+0000 7ff7da3ff700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d411bfa0 con 0x7ff7d4130e50 2023-10-03T10:17:54.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.472+0000 7ff7d3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7d406fcf0 0x7ff7d41c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.472+0000 7ff7d899c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7d4130e50 0x7ff7d41c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.472+0000 7ff7d3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7d406fcf0 0x7ff7d41c0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51742/0 (socket says 172.21.15.72:51742) 2023-10-03T10:17:54.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.472+0000 7ff7d3fff700 1 -- 172.21.15.72:0/3935521097 learned_addr learned my addr 172.21.15.72:0/3935521097 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:54.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.472+0000 7ff7d899c700 1 --2- 172.21.15.72:0/3935521097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7d4130e50 0x7ff7d41c3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42044/0 (socket says 172.21.15.72:42044) 2023-10-03T10:17:54.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.472+0000 7ff7d37fe700 1 --2- 172.21.15.72:0/3935521097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7d4130540 0x7ff7d41c0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.473+0000 7ff7d3fff700 1 -- 172.21.15.72:0/3935521097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7d4130e50 msgr2=0x7ff7d41c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.473+0000 7ff7d3fff700 1 --2- 172.21.15.72:0/3935521097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7d4130e50 0x7ff7d41c3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.473+0000 7ff7d3fff700 1 -- 172.21.15.72:0/3935521097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7d4130540 msgr2=0x7ff7d41c0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.473+0000 7ff7d3fff700 1 --2- 172.21.15.72:0/3935521097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7d4130540 0x7ff7d41c0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.473+0000 7ff7d3fff700 1 -- 172.21.15.72:0/3935521097 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c40094a0 con 0x7ff7d406fcf0 2023-10-03T10:17:54.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.473+0000 7ff7d37fe700 1 --2- 172.21.15.72:0/3935521097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7d4130540 0x7ff7d41c0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:54.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.473+0000 7ff7d3fff700 1 --2- 172.21.15.72:0/3935521097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7d406fcf0 0x7ff7d41c0910 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400ebe0 tx=0x7ff7c400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.473+0000 7ff7d0ff9700 1 -- 172.21.15.72:0/3935521097 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400c850 con 0x7ff7d406fcf0 2023-10-03T10:17:54.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.473+0000 7ff7d0ff9700 1 -- 172.21.15.72:0/3935521097 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c400c9b0 con 0x7ff7d406fcf0 2023-10-03T10:17:54.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.473+0000 7ff7da3ff700 1 -- 172.21.15.72:0/3935521097 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc00f050 con 0x7ff7d406fcf0 2023-10-03T10:17:54.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.473+0000 7ff7d0ff9700 1 -- 172.21.15.72:0/3935521097 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400cd40 con 0x7ff7d406fcf0 2023-10-03T10:17:54.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.473+0000 7ff7da3ff700 1 -- 172.21.15.72:0/3935521097 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d411d1f0 con 0x7ff7d406fcf0 2023-10-03T10:17:54.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.474+0000 7ff7d0ff9700 1 -- 172.21.15.72:0/3935521097 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff7c4013470 con 0x7ff7d406fcf0 2023-10-03T10:17:54.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.474+0000 7ff7d0ff9700 1 -- 172.21.15.72:0/3935521097 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff7c403f730 con 0x7ff7d406fcf0 2023-10-03T10:17:54.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.474+0000 7ff7da3ff700 1 -- 172.21.15.72:0/3935521097 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d411db30 con 0x7ff7d406fcf0 2023-10-03T10:17:54.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.479+0000 7ff7d0ff9700 1 -- 172.21.15.72:0/3935521097 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7c4013720 con 0x7ff7d406fcf0 2023-10-03T10:17:54.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.514+0000 7fb5e04f5700 1 Processor -- start 2023-10-03T10:17:54.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.514+0000 7fb5e04f5700 1 -- start start 2023-10-03T10:17:54.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.514+0000 7fb5e04f5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5d80a0a30 0x7fb5d80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.514+0000 7fb5e04f5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5d809d630 0x7fb5d80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.514+0000 7fb5e04f5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d80a2a70 con 0x7fb5d8133930 2023-10-03T10:17:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.514+0000 7fb5e04f5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80a01d0 con 0x7fb5d80a0a30 2023-10-03T10:17:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.514+0000 7fb5e04f5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d809e2b0 con 0x7fb5d809d630 2023-10-03T10:17:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.514+0000 7fb5de291700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5d80a0a30 0x7fb5d80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.514+0000 7fb5de291700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5d80a0a30 0x7fb5d80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53974/0 (socket says 172.21.15.72:53974) 2023-10-03T10:17:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.514+0000 7fb5de291700 1 -- 172.21.15.72:0/3678752334 learned_addr learned my addr 172.21.15.72:0/3678752334 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.514+0000 7fb5dda90700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5d809d630 0x7fb5d80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.515+0000 7fb5dda90700 1 -- 172.21.15.72:0/3678752334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5d80a0a30 msgr2=0x7fb5d80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.515+0000 7fb5dda90700 1 --2- 172.21.15.72:0/3678752334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5d80a0a30 0x7fb5d80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.515+0000 7fb5dda90700 1 -- 172.21.15.72:0/3678752334 >> v1:172.21.15.72:6789/0 conn(0x7fb5d8133930 legacy=0x7fb5d8133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.515+0000 7fb5dda90700 1 -- 172.21.15.72:0/3678752334 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d809dc50 con 0x7fb5d809d630 2023-10-03T10:17:54.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.515+0000 7fb5dd28f700 1 -- 172.21.15.72:0/3678752334 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228485932 0 0) 0x7fb5d80a2a70 con 0x7fb5d8133930 2023-10-03T10:17:54.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.515+0000 7fb5de291700 1 --2- 172.21.15.72:0/3678752334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5d80a0a30 0x7fb5d80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:54.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.515+0000 7fb5dda90700 1 --2- 172.21.15.72:0/3678752334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5d809d630 0x7fb5d80a1340 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009870 tx=0x7fb5c8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d70dbbb0311fdf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.515+0000 7fb5dd28f700 1 -- 172.21.15.72:0/3678752334 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8011830 con 0x7fb5d809d630 2023-10-03T10:17:54.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.515+0000 7fb5dd28f700 1 -- 172.21.15.72:0/3678752334 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c8011990 con 0x7fb5d809d630 2023-10-03T10:17:54.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.515+0000 7fb5dd28f700 1 -- 172.21.15.72:0/3678752334 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8011d20 con 0x7fb5d809d630 2023-10-03T10:17:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.516+0000 7fb5e04f5700 1 -- 172.21.15.72:0/3678752334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5d809d630 msgr2=0x7fb5d80a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.516+0000 7fb5e04f5700 1 --2- 172.21.15.72:0/3678752334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5d809d630 0x7fb5d80a1340 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009870 tx=0x7fb5c8009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.516+0000 7fb5e04f5700 1 -- 172.21.15.72:0/3678752334 shutdown_connections 2023-10-03T10:17:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.516+0000 7fb5e04f5700 1 --2- 172.21.15.72:0/3678752334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5d80a0a30 0x7fb5d80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.516+0000 7fb5e04f5700 1 --2- 172.21.15.72:0/3678752334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5d809d630 0x7fb5d80a1340 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.516+0000 7fb5e04f5700 1 -- 172.21.15.72:0/3678752334 >> 172.21.15.72:0/3678752334 conn(0x7fb5d80a3050 msgr2=0x7fb5d80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.516+0000 7fb5e04f5700 1 -- 172.21.15.72:0/3678752334 shutdown_connections 2023-10-03T10:17:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.516+0000 7fb5e04f5700 1 -- 172.21.15.72:0/3678752334 wait complete. 2023-10-03T10:17:54.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.517+0000 7fb5e04f5700 1 Processor -- start 2023-10-03T10:17:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.517+0000 7fb5e04f5700 1 -- start start 2023-10-03T10:17:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.517+0000 7fb5e04f5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5d809d630 0x7fb5d81c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.517+0000 7fb5e04f5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d80a0a30 0x7fb5d81c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.517+0000 7fb5e04f5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5d8133930 0x7fb5d81c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.517+0000 7fb5e04f5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d8120ae0 con 0x7fb5d80a0a30 2023-10-03T10:17:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.517+0000 7fb5e04f5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80a0480 con 0x7fb5d809d630 2023-10-03T10:17:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.517+0000 7fb5e04f5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d8120640 con 0x7fb5d8133930 2023-10-03T10:17:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.517+0000 7fb5dea92700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5d8133930 0x7fb5d81c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.517+0000 7fb5dda90700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d80a0a30 0x7fb5d81c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.517+0000 7fb5dea92700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5d8133930 0x7fb5d81c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42058/0 (socket says 172.21.15.72:42058) 2023-10-03T10:17:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.517+0000 7fb5dea92700 1 -- 172.21.15.72:0/1112644215 learned_addr learned my addr 172.21.15.72:0/1112644215 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:54.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.518+0000 7fb5de291700 1 --2- 172.21.15.72:0/1112644215 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5d809d630 0x7fb5d81c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.518+0000 7fb5dea92700 1 -- 172.21.15.72:0/1112644215 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5d809d630 msgr2=0x7fb5d81c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.518+0000 7fb5dea92700 1 --2- 172.21.15.72:0/1112644215 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5d809d630 0x7fb5d81c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.518+0000 7fb5dea92700 1 -- 172.21.15.72:0/1112644215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d80a0a30 msgr2=0x7fb5d81c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.518+0000 7fb5dea92700 1 --2- 172.21.15.72:0/1112644215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d80a0a30 0x7fb5d81c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.518+0000 7fb5dea92700 1 -- 172.21.15.72:0/1112644215 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d4009550 con 0x7fb5d8133930 2023-10-03T10:17:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.518+0000 7fb5dea92700 1 --2- 172.21.15.72:0/1112644215 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5d8133930 0x7fb5d81c8a10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0001560 tx=0x7fb5d000cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.518+0000 7fb5ceffd700 1 -- 172.21.15.72:0/1112644215 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0003e30 con 0x7fb5d8133930 2023-10-03T10:17:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.518+0000 7fb5ceffd700 1 -- 172.21.15.72:0/1112644215 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d0005070 con 0x7fb5d8133930 2023-10-03T10:17:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.518+0000 7fb5e04f5700 1 -- 172.21.15.72:0/1112644215 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c80094a0 con 0x7fb5d8133930 2023-10-03T10:17:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.518+0000 7fb5ceffd700 1 -- 172.21.15.72:0/1112644215 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d00053e0 con 0x7fb5d8133930 2023-10-03T10:17:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.518+0000 7fb5e04f5700 1 -- 172.21.15.72:0/1112644215 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d81220f0 con 0x7fb5d8133930 2023-10-03T10:17:54.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.519+0000 7fb5e04f5700 1 -- 172.21.15.72:0/1112644215 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d8120d10 con 0x7fb5d8133930 2023-10-03T10:17:54.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.519+0000 7fb5ceffd700 1 -- 172.21.15.72:0/1112644215 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5d0005540 con 0x7fb5d8133930 2023-10-03T10:17:54.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.519+0000 7fb5ceffd700 1 -- 172.21.15.72:0/1112644215 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb5d003ecb0 con 0x7fb5d8133930 2023-10-03T10:17:54.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.524+0000 7fb5ceffd700 1 -- 172.21.15.72:0/1112644215 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5d001b3b0 con 0x7fb5d8133930 2023-10-03T10:17:54.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.552+0000 7f79d79b7700 1 Processor -- start 2023-10-03T10:17:54.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.552+0000 7f79d79b7700 1 -- start start 2023-10-03T10:17:54.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.553+0000 7f79d79b7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d009c650 0x7f79d009ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.553+0000 7f79d79b7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d00a0090 0x7f79d009cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.553+0000 7f79d79b7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d009ba70 con 0x7f79d0131970 2023-10-03T10:17:54.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.553+0000 7f79d79b7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d009d4a0 con 0x7f79d00a0090 2023-10-03T10:17:54.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.553+0000 7f79d79b7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79d009e8f0 con 0x7f79d009c650 2023-10-03T10:17:54.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.553+0000 7f79d5753700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d009c650 0x7f79d009ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.553+0000 7f79d5753700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d009c650 0x7f79d009ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42070/0 (socket says 172.21.15.72:42070) 2023-10-03T10:17:54.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.553+0000 7f79d5753700 1 -- 172.21.15.72:0/3098293479 learned_addr learned my addr 172.21.15.72:0/3098293479 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:54.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.553+0000 7f79d4f52700 1 --2- 172.21.15.72:0/3098293479 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d00a0090 0x7f79d009cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.553+0000 7f79d5753700 1 -- 172.21.15.72:0/3098293479 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d00a0090 msgr2=0x7f79d009cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:54.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.553+0000 7f79d5753700 1 --2- 172.21.15.72:0/3098293479 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d00a0090 0x7f79d009cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.553+0000 7f79d5753700 1 -- 172.21.15.72:0/3098293479 >> v1:172.21.15.72:6789/0 conn(0x7f79d0131970 legacy=0x7f79d0131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.553+0000 7f79d5753700 1 -- 172.21.15.72:0/3098293479 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d00a0760 con 0x7f79d009c650 2023-10-03T10:17:54.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.553+0000 7f79d4f52700 1 --2- 172.21.15.72:0/3098293479 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d00a0090 0x7f79d009cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:54.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.554+0000 7f79d5753700 1 --2- 172.21.15.72:0/3098293479 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d009c650 0x7f79d009ca20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009950 tx=0x7f79cc009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d026958ae9b0c12e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.554+0000 7f79c7fff700 1 -- 172.21.15.72:0/3098293479 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc011830 con 0x7f79d009c650 2023-10-03T10:17:54.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.554+0000 7f79c7fff700 1 -- 172.21.15.72:0/3098293479 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc011990 con 0x7f79d009c650 2023-10-03T10:17:54.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.554+0000 7f79c7fff700 1 -- 172.21.15.72:0/3098293479 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc011d40 con 0x7f79d009c650 2023-10-03T10:17:54.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.554+0000 7f79d79b7700 1 -- 172.21.15.72:0/3098293479 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d009c650 msgr2=0x7f79d009ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.554+0000 7f79d79b7700 1 --2- 172.21.15.72:0/3098293479 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d009c650 0x7f79d009ca20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009950 tx=0x7f79cc009c60 comp rx=0 tx=0).stop 2023-10-03T10:17:54.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.554+0000 7f79d79b7700 1 -- 172.21.15.72:0/3098293479 shutdown_connections 2023-10-03T10:17:54.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.554+0000 7f79d79b7700 1 --2- 172.21.15.72:0/3098293479 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d009c650 0x7f79d009ca20 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.554+0000 7f79d79b7700 1 --2- 172.21.15.72:0/3098293479 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d00a0090 0x7f79d009cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.554+0000 7f79d79b7700 1 -- 172.21.15.72:0/3098293479 >> 172.21.15.72:0/3098293479 conn(0x7f79d00a3f70 msgr2=0x7f79d00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.555+0000 7f79d79b7700 1 -- 172.21.15.72:0/3098293479 shutdown_connections 2023-10-03T10:17:54.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.555+0000 7f79d79b7700 1 -- 172.21.15.72:0/3098293479 wait complete. 2023-10-03T10:17:54.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.556+0000 7f79d79b7700 1 Processor -- start 2023-10-03T10:17:54.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.556+0000 7f79d79b7700 1 -- start start 2023-10-03T10:17:54.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d79b7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d009c650 0x7f79d011bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d79b7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79d00a0090 0x7f79d011c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d79b7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d0131970 0x7f79d011c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d79b7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d011fab0 con 0x7f79d00a0090 2023-10-03T10:17:54.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d79b7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d011d410 con 0x7f79d009c650 2023-10-03T10:17:54.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d79b7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79d009d980 con 0x7f79d0131970 2023-10-03T10:17:54.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d5753700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d009c650 0x7f79d011bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d5753700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d009c650 0x7f79d011bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:53994/0 (socket says 172.21.15.72:53994) 2023-10-03T10:17:54.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d5753700 1 -- 172.21.15.72:0/355039526 learned_addr learned my addr 172.21.15.72:0/355039526 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:54.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d5f54700 1 --2- 172.21.15.72:0/355039526 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d0131970 0x7f79d011c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d4f52700 1 --2- 172.21.15.72:0/355039526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79d00a0090 0x7f79d011c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d5753700 1 -- 172.21.15.72:0/355039526 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d0131970 msgr2=0x7f79d011c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d5753700 1 --2- 172.21.15.72:0/355039526 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d0131970 0x7f79d011c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d5753700 1 -- 172.21.15.72:0/355039526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79d00a0090 msgr2=0x7f79d011c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d5753700 1 --2- 172.21.15.72:0/355039526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79d00a0090 0x7f79d011c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d5753700 1 -- 172.21.15.72:0/355039526 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00094a0 con 0x7f79d009c650 2023-10-03T10:17:54.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d5753700 1 --2- 172.21.15.72:0/355039526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d009c650 0x7f79d011bf60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f79d009ea80 tx=0x7f79cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79c5ffb700 1 -- 172.21.15.72:0/355039526 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc004240 con 0x7f79d009c650 2023-10-03T10:17:54.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79c5ffb700 1 -- 172.21.15.72:0/355039526 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc01f070 con 0x7f79d009c650 2023-10-03T10:17:54.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79d79b7700 1 -- 172.21.15.72:0/355039526 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79cc009550 con 0x7f79d009c650 2023-10-03T10:17:54.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.557+0000 7f79c5ffb700 1 -- 172.21.15.72:0/355039526 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc0045e0 con 0x7f79d009c650 2023-10-03T10:17:54.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.558+0000 7f79d79b7700 1 -- 172.21.15.72:0/355039526 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d012ffd0 con 0x7f79d009c650 2023-10-03T10:17:54.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.559+0000 7f79c5ffb700 1 -- 172.21.15.72:0/355039526 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79cc021030 con 0x7f79d009c650 2023-10-03T10:17:54.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.559+0000 7f79c5ffb700 1 -- 172.21.15.72:0/355039526 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f79cc0408e0 con 0x7f79d009c650 2023-10-03T10:17:54.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.559+0000 7f79d79b7700 1 -- 172.21.15.72:0/355039526 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d00747f0 con 0x7f79d009c650 2023-10-03T10:17:54.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.563+0000 7f79c5ffb700 1 -- 172.21.15.72:0/355039526 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f79cc01a450 con 0x7f79d009c650 2023-10-03T10:17:54.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.684+0000 7ff7da3ff700 1 -- 172.21.15.72:0/3935521097 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff7d4074ea0 con 0x7ff7d406fcf0 2023-10-03T10:17:54.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.684+0000 7ff7d0ff9700 1 -- 172.21.15.72:0/3935521097 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff7c4021020 con 0x7ff7d406fcf0 2023-10-03T10:17:54.685 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:54.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.686+0000 7ff7da3ff700 1 -- 172.21.15.72:0/3935521097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7d406fcf0 msgr2=0x7ff7d41c0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.686+0000 7ff7da3ff700 1 --2- 172.21.15.72:0/3935521097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7d406fcf0 0x7ff7d41c0910 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400ebe0 tx=0x7ff7c400eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.686+0000 7ff7da3ff700 1 -- 172.21.15.72:0/3935521097 shutdown_connections 2023-10-03T10:17:54.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.686+0000 7ff7da3ff700 1 --2- 172.21.15.72:0/3935521097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7d406fcf0 0x7ff7d41c0910 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.686+0000 7ff7da3ff700 1 --2- 172.21.15.72:0/3935521097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff7d4130e50 0x7ff7d41c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.686+0000 7ff7da3ff700 1 --2- 172.21.15.72:0/3935521097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7d4130540 0x7ff7d41c0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.686+0000 7ff7da3ff700 1 -- 172.21.15.72:0/3935521097 >> 172.21.15.72:0/3935521097 conn(0x7ff7d40a2aa0 msgr2=0x7ff7d412d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.686+0000 7ff7da3ff700 1 -- 172.21.15.72:0/3935521097 shutdown_connections 2023-10-03T10:17:54.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.686+0000 7ff7da3ff700 1 -- 172.21.15.72:0/3935521097 wait complete. 2023-10-03T10:17:54.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:54.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.722+0000 7fb5e04f5700 1 -- 172.21.15.72:0/1112644215 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb5d8074770 con 0x7fb5d8133930 2023-10-03T10:17:54.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.722+0000 7fb5ceffd700 1 -- 172.21.15.72:0/1112644215 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5d0017030 con 0x7fb5d8133930 2023-10-03T10:17:54.723 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.724+0000 7fb5e04f5700 1 -- 172.21.15.72:0/1112644215 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5d8133930 msgr2=0x7fb5d81c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.724+0000 7fb5e04f5700 1 --2- 172.21.15.72:0/1112644215 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5d8133930 0x7fb5d81c8a10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0001560 tx=0x7fb5d000cb50 comp rx=0 tx=0).stop 2023-10-03T10:17:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.724+0000 7fb5e04f5700 1 -- 172.21.15.72:0/1112644215 shutdown_connections 2023-10-03T10:17:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.724+0000 7fb5e04f5700 1 --2- 172.21.15.72:0/1112644215 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5d8133930 0x7fb5d81c8a10 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.724+0000 7fb5e04f5700 1 --2- 172.21.15.72:0/1112644215 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5d809d630 0x7fb5d81c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.724+0000 7fb5e04f5700 1 --2- 172.21.15.72:0/1112644215 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5d80a0a30 0x7fb5d81c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.724+0000 7fb5e04f5700 1 -- 172.21.15.72:0/1112644215 >> 172.21.15.72:0/1112644215 conn(0x7fb5d80a3050 msgr2=0x7fb5d81bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.724+0000 7fb5e04f5700 1 -- 172.21.15.72:0/1112644215 shutdown_connections 2023-10-03T10:17:54.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.724+0000 7fb5e04f5700 1 -- 172.21.15.72:0/1112644215 wait complete. 2023-10-03T10:17:54.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:54.742 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:54.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.762+0000 7f79d79b7700 1 -- 172.21.15.72:0/355039526 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f79d0072840 con 0x7f79d009c650 2023-10-03T10:17:54.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.762+0000 7f79c5ffb700 1 -- 172.21.15.72:0/355039526 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f79cc015020 con 0x7f79d009c650 2023-10-03T10:17:54.763 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:54.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.764+0000 7f79d79b7700 1 -- 172.21.15.72:0/355039526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d009c650 msgr2=0x7f79d011bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.764+0000 7f79d79b7700 1 --2- 172.21.15.72:0/355039526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d009c650 0x7f79d011bf60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f79d009ea80 tx=0x7f79cc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:54.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.764+0000 7f79d79b7700 1 -- 172.21.15.72:0/355039526 shutdown_connections 2023-10-03T10:17:54.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.764+0000 7f79d79b7700 1 --2- 172.21.15.72:0/355039526 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f79d0131970 0x7f79d011c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.764+0000 7f79d79b7700 1 --2- 172.21.15.72:0/355039526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79d009c650 0x7f79d011bf60 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.764+0000 7f79d79b7700 1 --2- 172.21.15.72:0/355039526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79d00a0090 0x7f79d011c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.764+0000 7f79d79b7700 1 -- 172.21.15.72:0/355039526 >> 172.21.15.72:0/355039526 conn(0x7f79d00a3f70 msgr2=0x7f79d00a1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.764+0000 7f79d79b7700 1 -- 172.21.15.72:0/355039526 shutdown_connections 2023-10-03T10:17:54.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.764+0000 7f79d79b7700 1 -- 172.21.15.72:0/355039526 wait complete. 2023-10-03T10:17:54.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:54.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.882+0000 7fd29d053700 1 Processor -- start 2023-10-03T10:17:54.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.882+0000 7fd29d053700 1 -- start start 2023-10-03T10:17:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.882+0000 7fd29d053700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2981316c0 0x7fd298131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.882+0000 7fd29d053700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd29806ae80 0x7fd298139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.882+0000 7fd29d053700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29809e130 con 0x7fd29809d9f0 2023-10-03T10:17:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.882+0000 7fd29d053700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2981312b0 con 0x7fd2981316c0 2023-10-03T10:17:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.882+0000 7fd29d053700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd29809f6e0 con 0x7fd29806ae80 2023-10-03T10:17:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.883+0000 7fd296d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2981316c0 0x7fd298131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.883+0000 7fd296d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2981316c0 0x7fd298131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51764/0 (socket says 172.21.15.72:51764) 2023-10-03T10:17:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.883+0000 7fd296d9d700 1 -- 172.21.15.72:0/2928438886 learned_addr learned my addr 172.21.15.72:0/2928438886 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.883+0000 7fd29759e700 1 --2- 172.21.15.72:0/2928438886 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd29806ae80 0x7fd298139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.883+0000 7fd296d9d700 1 -- 172.21.15.72:0/2928438886 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd29806ae80 msgr2=0x7fd298139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:54.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.883+0000 7fd296d9d700 1 --2- 172.21.15.72:0/2928438886 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd29806ae80 0x7fd298139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.883+0000 7fd296d9d700 1 -- 172.21.15.72:0/2928438886 >> v1:172.21.15.72:6789/0 conn(0x7fd29809d9f0 legacy=0x7fd29806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.883+0000 7fd296d9d700 1 -- 172.21.15.72:0/2928438886 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29809e760 con 0x7fd2981316c0 2023-10-03T10:17:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.883+0000 7fd296d9d700 1 --2- 172.21.15.72:0/2928438886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2981316c0 0x7fd298131a90 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fd2880098f0 tx=0x7fd288009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eced007dc3ceda0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.883+0000 7fd295d9b700 1 -- 172.21.15.72:0/2928438886 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288011830 con 0x7fd2981316c0 2023-10-03T10:17:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.883+0000 7fd295d9b700 1 -- 172.21.15.72:0/2928438886 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd288011990 con 0x7fd2981316c0 2023-10-03T10:17:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.883+0000 7fd295d9b700 1 -- 172.21.15.72:0/2928438886 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288011d20 con 0x7fd2981316c0 2023-10-03T10:17:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.884+0000 7fd29d053700 1 -- 172.21.15.72:0/2928438886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2981316c0 msgr2=0x7fd298131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.884+0000 7fd29d053700 1 --2- 172.21.15.72:0/2928438886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2981316c0 0x7fd298131a90 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fd2880098f0 tx=0x7fd288009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.884+0000 7fd29d053700 1 -- 172.21.15.72:0/2928438886 shutdown_connections 2023-10-03T10:17:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.884+0000 7fd29d053700 1 --2- 172.21.15.72:0/2928438886 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd29806ae80 0x7fd298139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.884+0000 7fd29d053700 1 --2- 172.21.15.72:0/2928438886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2981316c0 0x7fd298131a90 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.884+0000 7fd29d053700 1 -- 172.21.15.72:0/2928438886 >> 172.21.15.72:0/2928438886 conn(0x7fd298066f50 msgr2=0x7fd29809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.884+0000 7fd29d053700 1 -- 172.21.15.72:0/2928438886 shutdown_connections 2023-10-03T10:17:54.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.884+0000 7fd29d053700 1 -- 172.21.15.72:0/2928438886 wait complete. 2023-10-03T10:17:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.885+0000 7fd29d053700 1 Processor -- start 2023-10-03T10:17:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.885+0000 7fd29d053700 1 -- start start 2023-10-03T10:17:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd29d053700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd29806ae80 0x7fd298070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd29d053700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd29809d9f0 0x7fd298071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd29d053700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2981316c0 0x7fd298071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd29d053700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd298128510 con 0x7fd29809d9f0 2023-10-03T10:17:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd29d053700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29811ac20 con 0x7fd2981316c0 2023-10-03T10:17:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd29d053700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd29811bc60 con 0x7fd29806ae80 2023-10-03T10:17:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd296d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd29806ae80 0x7fd298070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd296d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd29806ae80 0x7fd298070ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42098/0 (socket says 172.21.15.72:42098) 2023-10-03T10:17:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd296d9d700 1 -- 172.21.15.72:0/920069953 learned_addr learned my addr 172.21.15.72:0/920069953 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd29759e700 1 --2- 172.21.15.72:0/920069953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2981316c0 0x7fd298071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd29659c700 1 --2- 172.21.15.72:0/920069953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd29809d9f0 0x7fd298071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd29759e700 1 -- 172.21.15.72:0/920069953 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd29806ae80 msgr2=0x7fd298070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd29759e700 1 --2- 172.21.15.72:0/920069953 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd29806ae80 0x7fd298070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd29759e700 1 -- 172.21.15.72:0/920069953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd29809d9f0 msgr2=0x7fd298071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd29759e700 1 --2- 172.21.15.72:0/920069953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd29809d9f0 0x7fd298071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.886+0000 7fd29759e700 1 -- 172.21.15.72:0/920069953 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd288009550 con 0x7fd2981316c0 2023-10-03T10:17:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.887+0000 7fd29759e700 1 --2- 172.21.15.72:0/920069953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2981316c0 0x7fd298071560 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd29000efc0 tx=0x7fd29000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.887+0000 7fd27f7fe700 1 -- 172.21.15.72:0/920069953 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29000cc90 con 0x7fd2981316c0 2023-10-03T10:17:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.887+0000 7fd27f7fe700 1 -- 172.21.15.72:0/920069953 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29000f040 con 0x7fd2981316c0 2023-10-03T10:17:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.887+0000 7fd27f7fe700 1 -- 172.21.15.72:0/920069953 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2900146c0 con 0x7fd2981316c0 2023-10-03T10:17:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.887+0000 7fd29d053700 1 -- 172.21.15.72:0/920069953 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29811a6a0 con 0x7fd2981316c0 2023-10-03T10:17:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.887+0000 7fd29d053700 1 -- 172.21.15.72:0/920069953 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29811b690 con 0x7fd2981316c0 2023-10-03T10:17:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.887+0000 7fd27f7fe700 1 -- 172.21.15.72:0/920069953 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd290014820 con 0x7fd2981316c0 2023-10-03T10:17:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.888+0000 7fd27f7fe700 1 -- 172.21.15.72:0/920069953 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd2900401b0 con 0x7fd2981316c0 2023-10-03T10:17:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.888+0000 7fd29d053700 1 -- 172.21.15.72:0/920069953 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd298074ea0 con 0x7fd2981316c0 2023-10-03T10:17:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:54.892+0000 7fd27f7fe700 1 -- 172.21.15.72:0/920069953 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd290018020 con 0x7fd2981316c0 2023-10-03T10:17:55.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.076+0000 7fd29d053700 1 -- 172.21.15.72:0/920069953 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd29806c360 con 0x7fd2981316c0 2023-10-03T10:17:55.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.077+0000 7fd27f7fe700 1 -- 172.21.15.72:0/920069953 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd29002b090 con 0x7fd2981316c0 2023-10-03T10:17:55.077 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:55.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.079+0000 7fd29d053700 1 -- 172.21.15.72:0/920069953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2981316c0 msgr2=0x7fd298071560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.079+0000 7fd29d053700 1 --2- 172.21.15.72:0/920069953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2981316c0 0x7fd298071560 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd29000efc0 tx=0x7fd29000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.079+0000 7fd29d053700 1 -- 172.21.15.72:0/920069953 shutdown_connections 2023-10-03T10:17:55.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.079+0000 7fd29d053700 1 --2- 172.21.15.72:0/920069953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2981316c0 0x7fd298071560 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.079+0000 7fd29d053700 1 --2- 172.21.15.72:0/920069953 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd29806ae80 0x7fd298070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.079+0000 7fd29d053700 1 --2- 172.21.15.72:0/920069953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd29809d9f0 0x7fd298071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.079+0000 7fd29d053700 1 -- 172.21.15.72:0/920069953 >> 172.21.15.72:0/920069953 conn(0x7fd298066f50 msgr2=0x7fd2980a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.079+0000 7fd29d053700 1 -- 172.21.15.72:0/920069953 shutdown_connections 2023-10-03T10:17:55.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.079+0000 7fd29d053700 1 -- 172.21.15.72:0/920069953 wait complete. 2023-10-03T10:17:55.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:55.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:55.738 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:55.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:55.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.833+0000 7f896c58b700 1 Processor -- start 2023-10-03T10:17:55.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.833+0000 7f896c58b700 1 -- start start 2023-10-03T10:17:55.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.834+0000 7f896c58b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896409f410 0x7f8964136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.834+0000 7f896c58b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8964136fe0 0x7f89641393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.834+0000 7f896c58b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8964070940 con 0x7f896409e930 2023-10-03T10:17:55.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.834+0000 7f896c58b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896406fd60 con 0x7f896409f410 2023-10-03T10:17:55.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.834+0000 7f896c58b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f896406fa80 con 0x7f8964136fe0 2023-10-03T10:17:55.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.834+0000 7f896a327700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f896409e930 0x7f896409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52704/0 (socket says 172.21.15.72:52704) 2023-10-03T10:17:55.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.834+0000 7f896a327700 1 -- 172.21.15.72:0/3332418315 learned_addr learned my addr 172.21.15.72:0/3332418315 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:55.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.834+0000 7f8969b26700 1 --2- 172.21.15.72:0/3332418315 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896409f410 0x7f8964136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.834+0000 7f896ab28700 1 --2- 172.21.15.72:0/3332418315 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8964136fe0 0x7f89641393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.834+0000 7f8969b26700 1 -- 172.21.15.72:0/3332418315 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8964136fe0 msgr2=0x7f89641393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.834+0000 7f8969b26700 1 --2- 172.21.15.72:0/3332418315 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8964136fe0 0x7f89641393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.834+0000 7f8969b26700 1 -- 172.21.15.72:0/3332418315 >> v1:172.21.15.72:6789/0 conn(0x7f896409e930 legacy=0x7f896409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.834+0000 7f8969325700 1 -- 172.21.15.72:0/3332418315 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031476167 0 0) 0x7f8964070940 con 0x7f896409e930 2023-10-03T10:17:55.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.834+0000 7f8969b26700 1 -- 172.21.15.72:0/3332418315 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896409fb60 con 0x7f896409f410 2023-10-03T10:17:55.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.835+0000 7f8969b26700 1 --2- 172.21.15.72:0/3332418315 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896409f410 0x7f8964136aa0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8954009870 tx=0x7f8954009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae3a7e24cb78259a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.835+0000 7f8969325700 1 -- 172.21.15.72:0/3332418315 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954011830 con 0x7f896409f410 2023-10-03T10:17:55.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.835+0000 7f8969325700 1 -- 172.21.15.72:0/3332418315 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8954011990 con 0x7f896409f410 2023-10-03T10:17:55.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.835+0000 7f8969325700 1 -- 172.21.15.72:0/3332418315 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954011d20 con 0x7f896409f410 2023-10-03T10:17:55.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.835+0000 7f896c58b700 1 -- 172.21.15.72:0/3332418315 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896409f410 msgr2=0x7f8964136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.835+0000 7f896c58b700 1 --2- 172.21.15.72:0/3332418315 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896409f410 0x7f8964136aa0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8954009870 tx=0x7f8954009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:55.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.836+0000 7f896c58b700 1 -- 172.21.15.72:0/3332418315 shutdown_connections 2023-10-03T10:17:55.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.836+0000 7f896c58b700 1 --2- 172.21.15.72:0/3332418315 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8964136fe0 0x7f89641393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.836+0000 7f896c58b700 1 --2- 172.21.15.72:0/3332418315 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896409f410 0x7f8964136aa0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.836+0000 7f896c58b700 1 -- 172.21.15.72:0/3332418315 >> 172.21.15.72:0/3332418315 conn(0x7f89640a4210 msgr2=0x7f89640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.836+0000 7f896c58b700 1 -- 172.21.15.72:0/3332418315 shutdown_connections 2023-10-03T10:17:55.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.836+0000 7f896c58b700 1 -- 172.21.15.72:0/3332418315 wait complete. 2023-10-03T10:17:55.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.837+0000 7f896c58b700 1 Processor -- start 2023-10-03T10:17:55.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.837+0000 7f896c58b700 1 -- start start 2023-10-03T10:17:55.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f896c58b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896409e930 0x7f896406c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f896c58b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f896409f410 0x7f896406c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f896c58b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8964136fe0 0x7f89641c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f896c58b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8964121160 con 0x7f8964136fe0 2023-10-03T10:17:55.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f896c58b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896406d5c0 con 0x7f896409e930 2023-10-03T10:17:55.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f896c58b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f896406cc40 con 0x7f896409f410 2023-10-03T10:17:55.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f8969b26700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f896409f410 0x7f896406c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f8969b26700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f896409f410 0x7f896406c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42114/0 (socket says 172.21.15.72:42114) 2023-10-03T10:17:55.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f8969b26700 1 -- 172.21.15.72:0/2229413385 learned_addr learned my addr 172.21.15.72:0/2229413385 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:55.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f896ab28700 1 --2- 172.21.15.72:0/2229413385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8964136fe0 0x7f89641c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f896a327700 1 --2- 172.21.15.72:0/2229413385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896409e930 0x7f896406c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f8969b26700 1 -- 172.21.15.72:0/2229413385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896409e930 msgr2=0x7f896406c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f8969b26700 1 --2- 172.21.15.72:0/2229413385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896409e930 0x7f896406c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f8969b26700 1 -- 172.21.15.72:0/2229413385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8964136fe0 msgr2=0x7f89641c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f8969b26700 1 --2- 172.21.15.72:0/2229413385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8964136fe0 0x7f89641c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f8969b26700 1 -- 172.21.15.72:0/2229413385 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89540094a0 con 0x7f896409f410 2023-10-03T10:17:55.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f896ab28700 1 --2- 172.21.15.72:0/2229413385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8964136fe0 0x7f89641c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.838+0000 7f8969b26700 1 --2- 172.21.15.72:0/2229413385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f896409f410 0x7f896406c700 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f89540090b0 tx=0x7f8954004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.839+0000 7f895affd700 1 -- 172.21.15.72:0/2229413385 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954004510 con 0x7f896409f410 2023-10-03T10:17:55.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.839+0000 7f895affd700 1 -- 172.21.15.72:0/2229413385 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895401f070 con 0x7f896409f410 2023-10-03T10:17:55.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.839+0000 7f896c58b700 1 -- 172.21.15.72:0/2229413385 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8964132640 con 0x7f896409f410 2023-10-03T10:17:55.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.839+0000 7f895affd700 1 -- 172.21.15.72:0/2229413385 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89540038e0 con 0x7f896409f410 2023-10-03T10:17:55.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.839+0000 7f896c58b700 1 -- 172.21.15.72:0/2229413385 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896409df70 con 0x7f896409f410 2023-10-03T10:17:55.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.840+0000 7f895affd700 1 -- 172.21.15.72:0/2229413385 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8954003a40 con 0x7f896409f410 2023-10-03T10:17:55.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.840+0000 7f896c58b700 1 -- 172.21.15.72:0/2229413385 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8964071d80 con 0x7f896409f410 2023-10-03T10:17:55.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.840+0000 7f895affd700 1 -- 172.21.15.72:0/2229413385 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8954021070 con 0x7f896409f410 2023-10-03T10:17:55.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.844+0000 7f895affd700 1 -- 172.21.15.72:0/2229413385 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8954010380 con 0x7f896409f410 2023-10-03T10:17:55.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.873+0000 7fc285760700 1 Processor -- start 2023-10-03T10:17:55.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.873+0000 7fc285760700 1 -- start start 2023-10-03T10:17:55.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.873+0000 7fc285760700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc28009d6f0 0x7fc28009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.873+0000 7fc285760700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc28009e000 0x7fc2801339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.873+0000 7fc285760700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc28009e410 0x7fc280133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.873+0000 7fc285760700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc28006b460 con 0x7fc28009e000 2023-10-03T10:17:55.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.873+0000 7fc285760700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28009b120 con 0x7fc28009e410 2023-10-03T10:17:55.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.873+0000 7fc285760700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc28009a7e0 con 0x7fc28009d6f0 2023-10-03T10:17:55.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc28009d6f0 0x7fc28009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc28009e410 0x7fc280133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc28009d6f0 0x7fc28009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42130/0 (socket says 172.21.15.72:42130) 2023-10-03T10:17:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27effd700 1 -- 172.21.15.72:0/2130419667 learned_addr learned my addr 172.21.15.72:0/2130419667 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27e7fc700 1 --2- 172.21.15.72:0/2130419667 >> v2:172.21.15.72:3300/0 conn(0x7fc28009e000 0x7fc2801339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27f7fe700 1 -- 172.21.15.72:0/2130419667 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc28009d6f0 msgr2=0x7fc28009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27f7fe700 1 --2- 172.21.15.72:0/2130419667 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc28009d6f0 0x7fc28009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27f7fe700 1 -- 172.21.15.72:0/2130419667 >> v2:172.21.15.72:3300/0 conn(0x7fc28009e000 msgr2=0x7fc2801339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27f7fe700 1 --2- 172.21.15.72:0/2130419667 >> v2:172.21.15.72:3300/0 conn(0x7fc28009e000 0x7fc2801339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27f7fe700 1 -- 172.21.15.72:0/2130419667 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28009a500 con 0x7fc28009e410 2023-10-03T10:17:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27e7fc700 1 --2- 172.21.15.72:0/2130419667 >> v2:172.21.15.72:3300/0 conn(0x7fc28009e000 0x7fc2801339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27effd700 1 --2- 172.21.15.72:0/2130419667 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc28009d6f0 0x7fc28009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27f7fe700 1 --2- 172.21.15.72:0/2130419667 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc28009e410 0x7fc280133f30 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc278009dc0 tx=0x7fc27800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba42e38391c4dac2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27dffb700 1 -- 172.21.15.72:0/2130419667 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27800e070 con 0x7fc28009e410 2023-10-03T10:17:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27dffb700 1 -- 172.21.15.72:0/2130419667 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27800bae0 con 0x7fc28009e410 2023-10-03T10:17:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.874+0000 7fc27dffb700 1 -- 172.21.15.72:0/2130419667 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27800be90 con 0x7fc28009e410 2023-10-03T10:17:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.875+0000 7fc285760700 1 -- 172.21.15.72:0/2130419667 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc28009e410 msgr2=0x7fc280133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.875+0000 7fc285760700 1 --2- 172.21.15.72:0/2130419667 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc28009e410 0x7fc280133f30 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc278009dc0 tx=0x7fc27800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:55.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.875+0000 7fc285760700 1 -- 172.21.15.72:0/2130419667 shutdown_connections 2023-10-03T10:17:55.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.875+0000 7fc285760700 1 --2- 172.21.15.72:0/2130419667 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc28009e410 0x7fc280133f30 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.875+0000 7fc285760700 1 --2- 172.21.15.72:0/2130419667 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc28009d6f0 0x7fc28009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.875+0000 7fc285760700 1 --2- 172.21.15.72:0/2130419667 >> v2:172.21.15.72:3300/0 conn(0x7fc28009e000 0x7fc2801339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.875+0000 7fc285760700 1 -- 172.21.15.72:0/2130419667 >> 172.21.15.72:0/2130419667 conn(0x7fc280066f50 msgr2=0x7fc28009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.875+0000 7fc285760700 1 -- 172.21.15.72:0/2130419667 shutdown_connections 2023-10-03T10:17:55.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.875+0000 7fc285760700 1 -- 172.21.15.72:0/2130419667 wait complete. 2023-10-03T10:17:55.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.876+0000 7fc285760700 1 Processor -- start 2023-10-03T10:17:55.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.876+0000 7fc285760700 1 -- start start 2023-10-03T10:17:55.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc285760700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc28009d6f0 0x7fc2801c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc285760700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc28009e000 0x7fc2801c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc285760700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc28009e410 0x7fc2801c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc285760700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2801a6420 con 0x7fc28009e410 2023-10-03T10:17:55.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc285760700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2801a7c10 con 0x7fc28009e000 2023-10-03T10:17:55.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc285760700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc28009c710 con 0x7fc28009d6f0 2023-10-03T10:17:55.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc27e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc28009e000 0x7fc2801c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc27e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc28009e000 0x7fc2801c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54042/0 (socket says 172.21.15.72:54042) 2023-10-03T10:17:55.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc27e7fc700 1 -- 172.21.15.72:0/3153954453 learned_addr learned my addr 172.21.15.72:0/3153954453 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:55.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc27f7fe700 1 --2- 172.21.15.72:0/3153954453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc28009e410 0x7fc2801c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc27effd700 1 --2- 172.21.15.72:0/3153954453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc28009d6f0 0x7fc2801c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc27e7fc700 1 -- 172.21.15.72:0/3153954453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc28009d6f0 msgr2=0x7fc2801c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc27e7fc700 1 --2- 172.21.15.72:0/3153954453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc28009d6f0 0x7fc2801c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc27e7fc700 1 -- 172.21.15.72:0/3153954453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc28009e410 msgr2=0x7fc2801c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc27e7fc700 1 --2- 172.21.15.72:0/3153954453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc28009e410 0x7fc2801c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc27e7fc700 1 -- 172.21.15.72:0/3153954453 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc270009550 con 0x7fc28009e000 2023-10-03T10:17:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc27effd700 1 --2- 172.21.15.72:0/3153954453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc28009d6f0 0x7fc2801c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc27e7fc700 1 --2- 172.21.15.72:0/3153954453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc28009e000 0x7fc2801c84f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc27400ebb0 tx=0x7fc27400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc2677fe700 1 -- 172.21.15.72:0/3153954453 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27400c850 con 0x7fc28009e000 2023-10-03T10:17:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc2677fe700 1 -- 172.21.15.72:0/3153954453 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27400c9b0 con 0x7fc28009e000 2023-10-03T10:17:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc285760700 1 -- 172.21.15.72:0/3153954453 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2740094a0 con 0x7fc28009e000 2023-10-03T10:17:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc2677fe700 1 -- 172.21.15.72:0/3153954453 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27400cd40 con 0x7fc28009e000 2023-10-03T10:17:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.877+0000 7fc285760700 1 -- 172.21.15.72:0/3153954453 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc278009a70 con 0x7fc28009e000 2023-10-03T10:17:55.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.878+0000 7fc2677fe700 1 -- 172.21.15.72:0/3153954453 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc274013470 con 0x7fc28009e000 2023-10-03T10:17:55.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.878+0000 7fc2677fe700 1 -- 172.21.15.72:0/3153954453 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc27403fb90 con 0x7fc28009e000 2023-10-03T10:17:55.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.879+0000 7fc285760700 1 -- 172.21.15.72:0/3153954453 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc280074ea0 con 0x7fc28009e000 2023-10-03T10:17:55.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.883+0000 7fc2677fe700 1 -- 172.21.15.72:0/3153954453 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc274017080 con 0x7fc28009e000 2023-10-03T10:17:55.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.914+0000 7f5b9d088700 1 Processor -- start 2023-10-03T10:17:55.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.914+0000 7f5b9d088700 1 -- start start 2023-10-03T10:17:55.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.914+0000 7f5b9d088700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b9809e930 0x7f5b9809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.914+0000 7f5b9d088700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5b9809f650 0x7f5b98131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.914+0000 7f5b9d088700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b98070940 con 0x7f5b9809f240 2023-10-03T10:17:55.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.914+0000 7f5b9d088700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9806fd60 con 0x7f5b9809f650 2023-10-03T10:17:55.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.914+0000 7f5b9d088700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9806fa80 con 0x7f5b9809e930 2023-10-03T10:17:55.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.914+0000 7f5b96d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b9809e930 0x7f5b9809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.914+0000 7f5b96d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b9809e930 0x7f5b9809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54052/0 (socket says 172.21.15.72:54052) 2023-10-03T10:17:55.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.914+0000 7f5b9659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5b9809f240 0x7f5b981317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52710/0 (socket says 172.21.15.72:52710) 2023-10-03T10:17:55.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.914+0000 7f5b96d9d700 1 -- 172.21.15.72:0/2030100578 learned_addr learned my addr 172.21.15.72:0/2030100578 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:55.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.914+0000 7f5b9759e700 1 --2- 172.21.15.72:0/2030100578 >> v2:172.21.15.72:3300/0 conn(0x7f5b9809f650 0x7f5b98131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.915+0000 7f5b9759e700 1 -- 172.21.15.72:0/2030100578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b9809e930 msgr2=0x7f5b9809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.915+0000 7f5b9759e700 1 --2- 172.21.15.72:0/2030100578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b9809e930 0x7f5b9809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.915+0000 7f5b9759e700 1 -- 172.21.15.72:0/2030100578 >> v1:172.21.15.72:6789/0 conn(0x7f5b9809f240 legacy=0x7f5b981317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.915+0000 7f5b9759e700 1 -- 172.21.15.72:0/2030100578 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9809fb60 con 0x7f5b9809f650 2023-10-03T10:17:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.915+0000 7f5b96d9d700 1 --2- 172.21.15.72:0/2030100578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b9809e930 0x7f5b9809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.915+0000 7f5b9759e700 1 --2- 172.21.15.72:0/2030100578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b9809f650 0x7f5b98131f00 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009d90 tx=0x7f5b9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19a613d566557a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.915+0000 7f5b95d9b700 1 -- 172.21.15.72:0/2030100578 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9000e070 con 0x7f5b9809f650 2023-10-03T10:17:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.915+0000 7f5b95d9b700 1 -- 172.21.15.72:0/2030100578 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9000bb20 con 0x7f5b9809f650 2023-10-03T10:17:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.915+0000 7f5b95d9b700 1 -- 172.21.15.72:0/2030100578 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90012430 con 0x7f5b9809f650 2023-10-03T10:17:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.916+0000 7f5b9d088700 1 -- 172.21.15.72:0/2030100578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b9809f650 msgr2=0x7f5b98131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.916+0000 7f5b9d088700 1 --2- 172.21.15.72:0/2030100578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b9809f650 0x7f5b98131f00 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009d90 tx=0x7f5b9000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.916+0000 7f5b9d088700 1 -- 172.21.15.72:0/2030100578 shutdown_connections 2023-10-03T10:17:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.916+0000 7f5b9d088700 1 --2- 172.21.15.72:0/2030100578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b9809f650 0x7f5b98131f00 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.916+0000 7f5b9d088700 1 --2- 172.21.15.72:0/2030100578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b9809e930 0x7f5b9809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.916+0000 7f5b9d088700 1 -- 172.21.15.72:0/2030100578 >> 172.21.15.72:0/2030100578 conn(0x7f5b980a4210 msgr2=0x7f5b980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.916+0000 7f5b9d088700 1 -- 172.21.15.72:0/2030100578 shutdown_connections 2023-10-03T10:17:55.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.916+0000 7f5b9d088700 1 -- 172.21.15.72:0/2030100578 wait complete. 2023-10-03T10:17:55.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.917+0000 7f5b9d088700 1 Processor -- start 2023-10-03T10:17:55.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.917+0000 7f5b9d088700 1 -- start start 2023-10-03T10:17:55.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.917+0000 7f5b9d088700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b9809e930 0x7f5b981a1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.917+0000 7f5b9d088700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b9809f240 0x7f5b981a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.917+0000 7f5b9d088700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b9809f650 0x7f5b981c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.917+0000 7f5b9d088700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b981a3f10 con 0x7f5b9809f650 2023-10-03T10:17:55.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.917+0000 7f5b9d088700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b981a40f0 con 0x7f5b9809f240 2023-10-03T10:17:55.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.917+0000 7f5b9d088700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b981b4f60 con 0x7f5b9809e930 2023-10-03T10:17:55.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b9759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b9809f650 0x7f5b981c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b9759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b9809f650 0x7f5b981c3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51808/0 (socket says 172.21.15.72:51808) 2023-10-03T10:17:55.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b9759e700 1 -- 172.21.15.72:0/3757105704 learned_addr learned my addr 172.21.15.72:0/3757105704 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:55.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b96d9d700 1 --2- 172.21.15.72:0/3757105704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b9809e930 0x7f5b981a1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b9659c700 1 --2- 172.21.15.72:0/3757105704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b9809f240 0x7f5b981a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b9759e700 1 -- 172.21.15.72:0/3757105704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b9809e930 msgr2=0x7f5b981a1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b9759e700 1 --2- 172.21.15.72:0/3757105704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b9809e930 0x7f5b981a1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b9759e700 1 -- 172.21.15.72:0/3757105704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b9809f240 msgr2=0x7f5b981a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b9759e700 1 --2- 172.21.15.72:0/3757105704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b9809f240 0x7f5b981a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b9759e700 1 -- 172.21.15.72:0/3757105704 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b88009550 con 0x7f5b9809f650 2023-10-03T10:17:55.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b9659c700 1 --2- 172.21.15.72:0/3757105704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b9809f240 0x7f5b981a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b9759e700 1 --2- 172.21.15.72:0/3757105704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b9809f650 0x7f5b981c3d20 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f5b980a0b00 tx=0x7f5b90004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b7f7fe700 1 -- 172.21.15.72:0/3757105704 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90012430 con 0x7f5b9809f650 2023-10-03T10:17:55.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b7f7fe700 1 -- 172.21.15.72:0/3757105704 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b90020070 con 0x7f5b9809f650 2023-10-03T10:17:55.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b9d088700 1 -- 172.21.15.72:0/3757105704 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b90009a70 con 0x7f5b9809f650 2023-10-03T10:17:55.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b7f7fe700 1 -- 172.21.15.72:0/3757105704 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90003ea0 con 0x7f5b9809f650 2023-10-03T10:17:55.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.918+0000 7f5b9d088700 1 -- 172.21.15.72:0/3757105704 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b980a0190 con 0x7f5b9809f650 2023-10-03T10:17:55.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.919+0000 7f5b7f7fe700 1 -- 172.21.15.72:0/3757105704 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b90004040 con 0x7f5b9809f650 2023-10-03T10:17:55.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.919+0000 7f5b7f7fe700 1 -- 172.21.15.72:0/3757105704 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5b90022070 con 0x7f5b9809f650 2023-10-03T10:17:55.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.919+0000 7f5b9d088700 1 -- 172.21.15.72:0/3757105704 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b98071d80 con 0x7f5b9809f650 2023-10-03T10:17:55.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:55.924+0000 7f5b7f7fe700 1 -- 172.21.15.72:0/3757105704 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b9001a970 con 0x7f5b9809f650 2023-10-03T10:17:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.044+0000 7f896c58b700 1 -- 172.21.15.72:0/2229413385 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f89640a3d20 con 0x7f896409f410 2023-10-03T10:17:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.045+0000 7f895affd700 1 -- 172.21.15.72:0/2229413385 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8954024b70 con 0x7f896409f410 2023-10-03T10:17:56.045 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:56.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.047+0000 7f896c58b700 1 -- 172.21.15.72:0/2229413385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f896409f410 msgr2=0x7f896406c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.047+0000 7f896c58b700 1 --2- 172.21.15.72:0/2229413385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f896409f410 0x7f896406c700 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f89540090b0 tx=0x7f8954004750 comp rx=0 tx=0).stop 2023-10-03T10:17:56.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.047+0000 7f896c58b700 1 -- 172.21.15.72:0/2229413385 shutdown_connections 2023-10-03T10:17:56.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.047+0000 7f896c58b700 1 --2- 172.21.15.72:0/2229413385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8964136fe0 0x7f89641c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.047+0000 7f896c58b700 1 --2- 172.21.15.72:0/2229413385 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896409e930 0x7f896406c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.047+0000 7f896c58b700 1 --2- 172.21.15.72:0/2229413385 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f896409f410 0x7f896406c700 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.047+0000 7f896c58b700 1 -- 172.21.15.72:0/2229413385 >> 172.21.15.72:0/2229413385 conn(0x7f89640a4210 msgr2=0x7f8964135c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.047+0000 7f896c58b700 1 -- 172.21.15.72:0/2229413385 shutdown_connections 2023-10-03T10:17:56.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.047+0000 7f896c58b700 1 -- 172.21.15.72:0/2229413385 wait complete. 2023-10-03T10:17:56.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:56.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.078+0000 7fc285760700 1 -- 172.21.15.72:0/3153954453 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc2801a6f10 con 0x7fc28009e000 2023-10-03T10:17:56.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.078+0000 7fc2677fe700 1 -- 172.21.15.72:0/3153954453 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc274021020 con 0x7fc28009e000 2023-10-03T10:17:56.079 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.081+0000 7fc285760700 1 -- 172.21.15.72:0/3153954453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc28009e000 msgr2=0x7fc2801c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.081+0000 7fc285760700 1 --2- 172.21.15.72:0/3153954453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc28009e000 0x7fc2801c84f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc27400ebb0 tx=0x7fc27400eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.081+0000 7fc285760700 1 -- 172.21.15.72:0/3153954453 shutdown_connections 2023-10-03T10:17:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.081+0000 7fc285760700 1 --2- 172.21.15.72:0/3153954453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc28009e410 0x7fc2801c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.081+0000 7fc285760700 1 --2- 172.21.15.72:0/3153954453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc28009d6f0 0x7fc2801c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.081+0000 7fc285760700 1 --2- 172.21.15.72:0/3153954453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc28009e000 0x7fc2801c84f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.081+0000 7fc285760700 1 -- 172.21.15.72:0/3153954453 >> 172.21.15.72:0/3153954453 conn(0x7fc280066f50 msgr2=0x7fc2801bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.081+0000 7fc285760700 1 -- 172.21.15.72:0/3153954453 shutdown_connections 2023-10-03T10:17:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.081+0000 7fc285760700 1 -- 172.21.15.72:0/3153954453 wait complete. 2023-10-03T10:17:56.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:56.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.118+0000 7f5b9d088700 1 -- 172.21.15.72:0/3757105704 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5b98074ea0 con 0x7f5b9809f650 2023-10-03T10:17:56.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.118+0000 7f5b7f7fe700 1 -- 172.21.15.72:0/3757105704 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5b9002c020 con 0x7f5b9809f650 2023-10-03T10:17:56.119 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:56.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.120+0000 7f5b9d088700 1 -- 172.21.15.72:0/3757105704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b9809f650 msgr2=0x7f5b981c3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.120+0000 7f5b9d088700 1 --2- 172.21.15.72:0/3757105704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b9809f650 0x7f5b981c3d20 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f5b980a0b00 tx=0x7f5b90004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.121+0000 7f5b9d088700 1 -- 172.21.15.72:0/3757105704 shutdown_connections 2023-10-03T10:17:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.121+0000 7f5b9d088700 1 --2- 172.21.15.72:0/3757105704 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b9809f650 0x7f5b981c3d20 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.121+0000 7f5b9d088700 1 --2- 172.21.15.72:0/3757105704 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5b9809e930 0x7f5b981a1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.121+0000 7f5b9d088700 1 --2- 172.21.15.72:0/3757105704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b9809f240 0x7f5b981a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.121+0000 7f5b9d088700 1 -- 172.21.15.72:0/3757105704 >> 172.21.15.72:0/3757105704 conn(0x7f5b980a4210 msgr2=0x7f5b9806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.121+0000 7f5b9d088700 1 -- 172.21.15.72:0/3757105704 shutdown_connections 2023-10-03T10:17:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.121+0000 7f5b9d088700 1 -- 172.21.15.72:0/3757105704 wait complete. 2023-10-03T10:17:56.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:56.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.214+0000 7f836d11d700 1 Processor -- start 2023-10-03T10:17:56.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.214+0000 7f836d11d700 1 -- start start 2023-10-03T10:17:56.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.214+0000 7f836d11d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f836809d6f0 0x7f836809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.214+0000 7f836d11d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f836809e410 0x7f8368130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.214+0000 7f836d11d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836809f130 con 0x7f836809e000 2023-10-03T10:17:56.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.214+0000 7f836d11d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836809f520 con 0x7f836809e410 2023-10-03T10:17:56.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.214+0000 7f836d11d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f836809e930 con 0x7f836809d6f0 2023-10-03T10:17:56.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.215+0000 7f8366d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f836809d6f0 0x7f836809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.215+0000 7f836759e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f836809e410 0x7f8368130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.215+0000 7f836759e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f836809e410 0x7f8368130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51812/0 (socket says 172.21.15.72:51812) 2023-10-03T10:17:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.215+0000 7f8366d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f836809d6f0 0x7f836809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42154/0 (socket says 172.21.15.72:42154) 2023-10-03T10:17:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.215+0000 7f836759e700 1 -- 172.21.15.72:0/921209684 learned_addr learned my addr 172.21.15.72:0/921209684 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.215+0000 7f8366d9d700 1 -- 172.21.15.72:0/921209684 >> v2:172.21.15.72:3300/0 conn(0x7f836809e410 msgr2=0x7f8368130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.215+0000 7f8366d9d700 1 --2- 172.21.15.72:0/921209684 >> v2:172.21.15.72:3300/0 conn(0x7f836809e410 0x7f8368130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.215+0000 7f8366d9d700 1 -- 172.21.15.72:0/921209684 >> v1:172.21.15.72:6789/0 conn(0x7f836809e000 legacy=0x7f8368130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.215+0000 7f8366d9d700 1 -- 172.21.15.72:0/921209684 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836809b2d0 con 0x7f836809d6f0 2023-10-03T10:17:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.215+0000 7f8365d9b700 1 -- 172.21.15.72:0/921209684 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522158462 0 0) 0x7f836809f130 con 0x7f836809e000 2023-10-03T10:17:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.215+0000 7f836759e700 1 --2- 172.21.15.72:0/921209684 >> v2:172.21.15.72:3300/0 conn(0x7f836809e410 0x7f8368130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.215+0000 7f8366d9d700 1 --2- 172.21.15.72:0/921209684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f836809d6f0 0x7f836809dac0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8358009840 tx=0x7f8358009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80f442c544c86bc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.215+0000 7f8365d9b700 1 -- 172.21.15.72:0/921209684 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8358011830 con 0x7f836809d6f0 2023-10-03T10:17:56.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.215+0000 7f8365d9b700 1 -- 172.21.15.72:0/921209684 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8358011990 con 0x7f836809d6f0 2023-10-03T10:17:56.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.215+0000 7f8365d9b700 1 -- 172.21.15.72:0/921209684 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8358011d20 con 0x7f836809d6f0 2023-10-03T10:17:56.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.216+0000 7f836d11d700 1 -- 172.21.15.72:0/921209684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f836809d6f0 msgr2=0x7f836809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.216+0000 7f836d11d700 1 --2- 172.21.15.72:0/921209684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f836809d6f0 0x7f836809dac0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8358009840 tx=0x7f8358009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:56.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.216+0000 7f836d11d700 1 -- 172.21.15.72:0/921209684 shutdown_connections 2023-10-03T10:17:56.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.216+0000 7f836d11d700 1 --2- 172.21.15.72:0/921209684 >> v2:172.21.15.72:3300/0 conn(0x7f836809e410 0x7f8368130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.216+0000 7f836d11d700 1 --2- 172.21.15.72:0/921209684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f836809d6f0 0x7f836809dac0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.216+0000 7f836d11d700 1 -- 172.21.15.72:0/921209684 >> 172.21.15.72:0/921209684 conn(0x7f8368066f50 msgr2=0x7f836809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.216+0000 7f836d11d700 1 -- 172.21.15.72:0/921209684 shutdown_connections 2023-10-03T10:17:56.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.216+0000 7f836d11d700 1 -- 172.21.15.72:0/921209684 wait complete. 2023-10-03T10:17:56.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.217+0000 7f836d11d700 1 Processor -- start 2023-10-03T10:17:56.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.217+0000 7f836d11d700 1 -- start start 2023-10-03T10:17:56.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.217+0000 7f836d11d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f836809d6f0 0x7f8368136920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.217+0000 7f836d11d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f836809e000 0x7f8368136e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.217+0000 7f836d11d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f836809e410 0x7f83681373a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.217+0000 7f836d11d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8368135d40 con 0x7f836809e000 2023-10-03T10:17:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.217+0000 7f836d11d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83681354f0 con 0x7f836809e410 2023-10-03T10:17:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.217+0000 7f836d11d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8368134690 con 0x7f836809d6f0 2023-10-03T10:17:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f8366d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f836809d6f0 0x7f8368136920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f836659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f836809e000 0x7f8368136e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f8366d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f836809d6f0 0x7f8368136920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42160/0 (socket says 172.21.15.72:42160) 2023-10-03T10:17:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f8366d9d700 1 -- 172.21.15.72:0/1142357209 learned_addr learned my addr 172.21.15.72:0/1142357209 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f836759e700 1 --2- 172.21.15.72:0/1142357209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f836809e410 0x7f83681373a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f8366d9d700 1 -- 172.21.15.72:0/1142357209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f836809e410 msgr2=0x7f83681373a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f8366d9d700 1 --2- 172.21.15.72:0/1142357209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f836809e410 0x7f83681373a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f8366d9d700 1 -- 172.21.15.72:0/1142357209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f836809e000 msgr2=0x7f8368136e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f8366d9d700 1 --2- 172.21.15.72:0/1142357209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f836809e000 0x7f8368136e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f8366d9d700 1 -- 172.21.15.72:0/1142357209 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8360009b30 con 0x7f836809d6f0 2023-10-03T10:17:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f836659c700 1 --2- 172.21.15.72:0/1142357209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f836809e000 0x7f8368136e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f8366d9d700 1 --2- 172.21.15.72:0/1142357209 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f836809d6f0 0x7f8368136920 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f83580090b0 tx=0x7f8358004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f834f7fe700 1 -- 172.21.15.72:0/1142357209 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83580036a0 con 0x7f836809d6f0 2023-10-03T10:17:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f834f7fe700 1 -- 172.21.15.72:0/1142357209 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835801f070 con 0x7f836809d6f0 2023-10-03T10:17:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f836d11d700 1 -- 172.21.15.72:0/1142357209 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83580094a0 con 0x7f836809d6f0 2023-10-03T10:17:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f834f7fe700 1 -- 172.21.15.72:0/1142357209 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8358003a60 con 0x7f836809d6f0 2023-10-03T10:17:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.218+0000 7f836d11d700 1 -- 172.21.15.72:0/1142357209 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83680a1d90 con 0x7f836809d6f0 2023-10-03T10:17:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.219+0000 7f834f7fe700 1 -- 172.21.15.72:0/1142357209 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8358003bc0 con 0x7f836809d6f0 2023-10-03T10:17:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.219+0000 7f834f7fe700 1 -- 172.21.15.72:0/1142357209 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8358021070 con 0x7f836809d6f0 2023-10-03T10:17:56.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.219+0000 7f836d11d700 1 -- 172.21.15.72:0/1142357209 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83681358c0 con 0x7f836809d6f0 2023-10-03T10:17:56.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.224+0000 7f834f7fe700 1 -- 172.21.15.72:0/1142357209 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8358015020 con 0x7f836809d6f0 2023-10-03T10:17:56.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.408+0000 7f836d11d700 1 -- 172.21.15.72:0/1142357209 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8368074ea0 con 0x7f836809d6f0 2023-10-03T10:17:56.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.408+0000 7f834f7fe700 1 -- 172.21.15.72:0/1142357209 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f835801a430 con 0x7f836809d6f0 2023-10-03T10:17:56.409 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:56.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.410+0000 7f836d11d700 1 -- 172.21.15.72:0/1142357209 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f836809d6f0 msgr2=0x7f8368136920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.410+0000 7f836d11d700 1 --2- 172.21.15.72:0/1142357209 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f836809d6f0 0x7f8368136920 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f83580090b0 tx=0x7f8358004750 comp rx=0 tx=0).stop 2023-10-03T10:17:56.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.410+0000 7f836d11d700 1 -- 172.21.15.72:0/1142357209 shutdown_connections 2023-10-03T10:17:56.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.410+0000 7f836d11d700 1 --2- 172.21.15.72:0/1142357209 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f836809e410 0x7f83681373a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.410+0000 7f836d11d700 1 --2- 172.21.15.72:0/1142357209 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f836809d6f0 0x7f8368136920 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.410+0000 7f836d11d700 1 --2- 172.21.15.72:0/1142357209 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f836809e000 0x7f8368136e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.410+0000 7f836d11d700 1 -- 172.21.15.72:0/1142357209 >> 172.21.15.72:0/1142357209 conn(0x7f8368066f50 msgr2=0x7f8368070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.410+0000 7f836d11d700 1 -- 172.21.15.72:0/1142357209 shutdown_connections 2023-10-03T10:17:56.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:56.410+0000 7f836d11d700 1 -- 172.21.15.72:0/1142357209 wait complete. 2023-10-03T10:17:56.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:57.060 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:57.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:57.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:57.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.193+0000 7f424f042700 1 Processor -- start 2023-10-03T10:17:57.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.193+0000 7f424f042700 1 -- start start 2023-10-03T10:17:57.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424f042700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f424809d6f0 0x7f424809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424f042700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f424809e000 0x7f42481339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424f042700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f424809e410 0x7f4248133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424f042700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424806b460 con 0x7f424809e000 2023-10-03T10:17:57.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424f042700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424809b120 con 0x7f424809d6f0 2023-10-03T10:17:57.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424f042700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f424809a7e0 con 0x7f424809e410 2023-10-03T10:17:57.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424cdde700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f424809d6f0 0x7f424809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424cdde700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f424809d6f0 0x7f424809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54072/0 (socket says 172.21.15.72:54072) 2023-10-03T10:17:57.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424cdde700 1 -- 172.21.15.72:0/2286582729 learned_addr learned my addr 172.21.15.72:0/2286582729 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:57.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f4247fff700 1 --2- 172.21.15.72:0/2286582729 >> v2:172.21.15.72:3300/0 conn(0x7f424809e000 0x7f42481339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424d5df700 1 --2- 172.21.15.72:0/2286582729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f424809e410 0x7f4248133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424cdde700 1 -- 172.21.15.72:0/2286582729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f424809e410 msgr2=0x7f4248133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:57.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424cdde700 1 --2- 172.21.15.72:0/2286582729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f424809e410 0x7f4248133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424cdde700 1 -- 172.21.15.72:0/2286582729 >> v2:172.21.15.72:3300/0 conn(0x7f424809e000 msgr2=0x7f42481339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:57.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424cdde700 1 --2- 172.21.15.72:0/2286582729 >> v2:172.21.15.72:3300/0 conn(0x7f424809e000 0x7f42481339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424cdde700 1 -- 172.21.15.72:0/2286582729 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424809a500 con 0x7f424809d6f0 2023-10-03T10:17:57.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f4247fff700 1 --2- 172.21.15.72:0/2286582729 >> v2:172.21.15.72:3300/0 conn(0x7f424809e000 0x7f42481339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.194+0000 7f424cdde700 1 --2- 172.21.15.72:0/2286582729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f424809d6f0 0x7f424809dac0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f423c009920 tx=0x7f423c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a08213267568acd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.195+0000 7f42477fe700 1 -- 172.21.15.72:0/2286582729 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c011830 con 0x7f424809d6f0 2023-10-03T10:17:57.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.195+0000 7f42477fe700 1 -- 172.21.15.72:0/2286582729 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c011990 con 0x7f424809d6f0 2023-10-03T10:17:57.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.195+0000 7f42477fe700 1 -- 172.21.15.72:0/2286582729 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c011d20 con 0x7f424809d6f0 2023-10-03T10:17:57.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.195+0000 7f424f042700 1 -- 172.21.15.72:0/2286582729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f424809d6f0 msgr2=0x7f424809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.195+0000 7f424f042700 1 --2- 172.21.15.72:0/2286582729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f424809d6f0 0x7f424809dac0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f423c009920 tx=0x7f423c009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:57.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.195+0000 7f424f042700 1 -- 172.21.15.72:0/2286582729 shutdown_connections 2023-10-03T10:17:57.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.195+0000 7f424f042700 1 --2- 172.21.15.72:0/2286582729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f424809e410 0x7f4248133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.195+0000 7f424f042700 1 --2- 172.21.15.72:0/2286582729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f424809d6f0 0x7f424809dac0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.195+0000 7f424f042700 1 --2- 172.21.15.72:0/2286582729 >> v2:172.21.15.72:3300/0 conn(0x7f424809e000 0x7f42481339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.195+0000 7f424f042700 1 -- 172.21.15.72:0/2286582729 >> 172.21.15.72:0/2286582729 conn(0x7f4248066f50 msgr2=0x7f424809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.195+0000 7f424f042700 1 -- 172.21.15.72:0/2286582729 shutdown_connections 2023-10-03T10:17:57.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.195+0000 7f424f042700 1 -- 172.21.15.72:0/2286582729 wait complete. 2023-10-03T10:17:57.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.196+0000 7f424f042700 1 Processor -- start 2023-10-03T10:17:57.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.196+0000 7f424f042700 1 -- start start 2023-10-03T10:17:57.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.197+0000 7f424f042700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f424809d6f0 0x7f42481c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.197+0000 7f424f042700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424809e000 0x7f42481c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.197+0000 7f424f042700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f424809e410 0x7f42481c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.197+0000 7f424f042700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42481a65f0 con 0x7f424809e000 2023-10-03T10:17:57.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.197+0000 7f424f042700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42480a2090 con 0x7f424809e410 2023-10-03T10:17:57.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.197+0000 7f424f042700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f424809c710 con 0x7f424809d6f0 2023-10-03T10:17:57.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.197+0000 7f424cdde700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f424809d6f0 0x7f42481c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.197+0000 7f4247fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424809e000 0x7f42481c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.197+0000 7f424cdde700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f424809d6f0 0x7f42481c42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42190/0 (socket says 172.21.15.72:42190) 2023-10-03T10:17:57.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.197+0000 7f424cdde700 1 -- 172.21.15.72:0/869360181 learned_addr learned my addr 172.21.15.72:0/869360181 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:57.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.197+0000 7f424d5df700 1 --2- 172.21.15.72:0/869360181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f424809e410 0x7f42481c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.197+0000 7f424cdde700 1 -- 172.21.15.72:0/869360181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f424809e410 msgr2=0x7f42481c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.198+0000 7f424cdde700 1 --2- 172.21.15.72:0/869360181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f424809e410 0x7f42481c05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.198+0000 7f424cdde700 1 -- 172.21.15.72:0/869360181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424809e000 msgr2=0x7f42481c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.198+0000 7f424cdde700 1 --2- 172.21.15.72:0/869360181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424809e000 0x7f42481c4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.198+0000 7f424cdde700 1 -- 172.21.15.72:0/869360181 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42340094a0 con 0x7f424809d6f0 2023-10-03T10:17:57.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.198+0000 7f4247fff700 1 --2- 172.21.15.72:0/869360181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424809e000 0x7f42481c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.198+0000 7f424d5df700 1 --2- 172.21.15.72:0/869360181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f424809e410 0x7f42481c05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.198+0000 7f424cdde700 1 --2- 172.21.15.72:0/869360181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f424809d6f0 0x7f42481c42f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f423c0098f0 tx=0x7f423c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.198+0000 7f42457fa700 1 -- 172.21.15.72:0/869360181 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c004240 con 0x7f424809d6f0 2023-10-03T10:17:57.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.198+0000 7f42457fa700 1 -- 172.21.15.72:0/869360181 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c01f070 con 0x7f424809d6f0 2023-10-03T10:17:57.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.198+0000 7f424f042700 1 -- 172.21.15.72:0/869360181 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c009550 con 0x7f424809d6f0 2023-10-03T10:17:57.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.198+0000 7f42457fa700 1 -- 172.21.15.72:0/869360181 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c0036a0 con 0x7f424809d6f0 2023-10-03T10:17:57.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.198+0000 7f424f042700 1 -- 172.21.15.72:0/869360181 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42481a59b0 con 0x7f424809d6f0 2023-10-03T10:17:57.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.199+0000 7f424f042700 1 -- 172.21.15.72:0/869360181 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4248074ea0 con 0x7f424809d6f0 2023-10-03T10:17:57.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.199+0000 7f42457fa700 1 -- 172.21.15.72:0/869360181 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f423c021030 con 0x7f424809d6f0 2023-10-03T10:17:57.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.199+0000 7f42457fa700 1 -- 172.21.15.72:0/869360181 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f423c0405d0 con 0x7f424809d6f0 2023-10-03T10:17:57.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.204+0000 7f42457fa700 1 -- 172.21.15.72:0/869360181 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f423c0237e0 con 0x7f424809d6f0 2023-10-03T10:17:57.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.234+0000 7fadb7e3e700 1 Processor -- start 2023-10-03T10:17:57.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.235+0000 7fadb7e3e700 1 -- start start 2023-10-03T10:17:57.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.235+0000 7fadb7e3e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fadb012c2f0 0x7fadb0130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.235+0000 7fadb7e3e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb012cff0 0x7fadb0137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.235+0000 7fadb7e3e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb009a510 con 0x7fadb012cc20 2023-10-03T10:17:57.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.235+0000 7fadb7e3e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb012c7d0 con 0x7fadb012c2f0 2023-10-03T10:17:57.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.235+0000 7fadb7e3e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadb009c190 con 0x7fadb012cff0 2023-10-03T10:17:57.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.235+0000 7fadb53d9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fadb012c2f0 0x7fadb0130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.235+0000 7fadb53d9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fadb012c2f0 0x7fadb0130040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51850/0 (socket says 172.21.15.72:51850) 2023-10-03T10:17:57.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.235+0000 7fadb63db700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb012cff0 0x7fadb0137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.235+0000 7fadb53d9700 1 -- 172.21.15.72:0/3491987586 learned_addr learned my addr 172.21.15.72:0/3491987586 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:57.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.236+0000 7fadb63db700 1 -- 172.21.15.72:0/3491987586 >> v2:172.21.15.72:3300/0 conn(0x7fadb012c2f0 msgr2=0x7fadb0130040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:57.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.236+0000 7fadb63db700 1 --2- 172.21.15.72:0/3491987586 >> v2:172.21.15.72:3300/0 conn(0x7fadb012c2f0 0x7fadb0130040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.236+0000 7fadb63db700 1 -- 172.21.15.72:0/3491987586 >> v1:172.21.15.72:6789/0 conn(0x7fadb012cc20 legacy=0x7fadb012f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.236+0000 7fadb63db700 1 -- 172.21.15.72:0/3491987586 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb009b540 con 0x7fadb012cff0 2023-10-03T10:17:57.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.236+0000 7fadb63db700 1 --2- 172.21.15.72:0/3491987586 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb012cff0 0x7fadb0137cd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fada8009d90 tx=0x7fada800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f0afa85576bce3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.236+0000 7fadb4bd8700 1 -- 172.21.15.72:0/3491987586 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada800e070 con 0x7fadb012cff0 2023-10-03T10:17:57.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.236+0000 7fadb4bd8700 1 -- 172.21.15.72:0/3491987586 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada800bb20 con 0x7fadb012cff0 2023-10-03T10:17:57.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.236+0000 7fadb4bd8700 1 -- 172.21.15.72:0/3491987586 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8012430 con 0x7fadb012cff0 2023-10-03T10:17:57.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.237+0000 7fadb7e3e700 1 -- 172.21.15.72:0/3491987586 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb012cff0 msgr2=0x7fadb0137cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.237+0000 7fadb7e3e700 1 --2- 172.21.15.72:0/3491987586 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb012cff0 0x7fadb0137cd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fada8009d90 tx=0x7fada800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:57.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.237+0000 7fadb7e3e700 1 -- 172.21.15.72:0/3491987586 shutdown_connections 2023-10-03T10:17:57.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.237+0000 7fadb7e3e700 1 --2- 172.21.15.72:0/3491987586 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb012cff0 0x7fadb0137cd0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.237+0000 7fadb7e3e700 1 --2- 172.21.15.72:0/3491987586 >> v2:172.21.15.72:3300/0 conn(0x7fadb012c2f0 0x7fadb0130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.237+0000 7fadb7e3e700 1 -- 172.21.15.72:0/3491987586 >> 172.21.15.72:0/3491987586 conn(0x7fadb009f470 msgr2=0x7fadb00a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.237+0000 7fadb7e3e700 1 -- 172.21.15.72:0/3491987586 shutdown_connections 2023-10-03T10:17:57.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.237+0000 7fadb7e3e700 1 -- 172.21.15.72:0/3491987586 wait complete. 2023-10-03T10:17:57.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.238+0000 7fadb7e3e700 1 Processor -- start 2023-10-03T10:17:57.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.238+0000 7fadb7e3e700 1 -- start start 2023-10-03T10:17:57.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.238+0000 7fadb7e3e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb012c2f0 0x7fadb0071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.238+0000 7fadb7e3e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadb012cc20 0x7fadb0134e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.238+0000 7fadb7e3e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb012cff0 0x7fadb01353d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.238+0000 7fadb7e3e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb0139b90 con 0x7fadb012cc20 2023-10-03T10:17:57.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.238+0000 7fadb7e3e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb012b230 con 0x7fadb012cff0 2023-10-03T10:17:57.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.238+0000 7fadb7e3e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadb0138550 con 0x7fadb012c2f0 2023-10-03T10:17:57.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.238+0000 7fadb5bda700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb012c2f0 0x7fadb0071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.238+0000 7fadb63db700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb012cff0 0x7fadb01353d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.238+0000 7fadb5bda700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb012c2f0 0x7fadb0071cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42208/0 (socket says 172.21.15.72:42208) 2023-10-03T10:17:57.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.238+0000 7fadb5bda700 1 -- 172.21.15.72:0/949427848 learned_addr learned my addr 172.21.15.72:0/949427848 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:57.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.238+0000 7fadb53d9700 1 --2- 172.21.15.72:0/949427848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadb012cc20 0x7fadb0134e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.239+0000 7fadb63db700 1 -- 172.21.15.72:0/949427848 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb012c2f0 msgr2=0x7fadb0071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.239+0000 7fadb63db700 1 --2- 172.21.15.72:0/949427848 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb012c2f0 0x7fadb0071cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.239+0000 7fadb63db700 1 -- 172.21.15.72:0/949427848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadb012cc20 msgr2=0x7fadb0134e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.239+0000 7fadb63db700 1 --2- 172.21.15.72:0/949427848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadb012cc20 0x7fadb0134e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.239+0000 7fadb63db700 1 -- 172.21.15.72:0/949427848 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada8009a70 con 0x7fadb012cff0 2023-10-03T10:17:57.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.239+0000 7fadb63db700 1 --2- 172.21.15.72:0/949427848 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb012cff0 0x7fadb01353d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fada8016000 tx=0x7fada8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.239+0000 7fada67fc700 1 -- 172.21.15.72:0/949427848 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8004800 con 0x7fadb012cff0 2023-10-03T10:17:57.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.239+0000 7fada67fc700 1 -- 172.21.15.72:0/949427848 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada8020070 con 0x7fadb012cff0 2023-10-03T10:17:57.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.239+0000 7fada67fc700 1 -- 172.21.15.72:0/949427848 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada80276c0 con 0x7fadb012cff0 2023-10-03T10:17:57.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.239+0000 7fadb7e3e700 1 -- 172.21.15.72:0/949427848 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb0135ff0 con 0x7fadb012cff0 2023-10-03T10:17:57.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.239+0000 7fadb7e3e700 1 -- 172.21.15.72:0/949427848 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb0137580 con 0x7fadb012cff0 2023-10-03T10:17:57.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.240+0000 7fada67fc700 1 -- 172.21.15.72:0/949427848 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fada8012430 con 0x7fadb012cff0 2023-10-03T10:17:57.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.240+0000 7fadb7e3e700 1 -- 172.21.15.72:0/949427848 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb01285a0 con 0x7fadb012cff0 2023-10-03T10:17:57.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.240+0000 7fada67fc700 1 -- 172.21.15.72:0/949427848 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fada8022070 con 0x7fadb012cff0 2023-10-03T10:17:57.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.245+0000 7fada67fc700 1 -- 172.21.15.72:0/949427848 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fada801c400 con 0x7fadb012cff0 2023-10-03T10:17:57.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.277+0000 7fc5c9c56700 1 Processor -- start 2023-10-03T10:17:57.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.277+0000 7fc5c9c56700 1 -- start start 2023-10-03T10:17:57.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c9c56700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c40a0a30 0x7fc5c40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c9c56700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5c40a1340 0x7fc5c4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c9c56700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c409edd0 con 0x7fc5c4133fa0 2023-10-03T10:17:57.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c9c56700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c409e1f0 con 0x7fc5c40a1340 2023-10-03T10:17:57.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c9c56700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c409dc50 con 0x7fc5c40a0a30 2023-10-03T10:17:57.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c40a0a30 0x7fc5c40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c40a0a30 0x7fc5c40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54104/0 (socket says 172.21.15.72:54104) 2023-10-03T10:17:57.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c37fe700 1 -- 172.21.15.72:0/2435113830 learned_addr learned my addr 172.21.15.72:0/2435113830 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:57.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c2ffd700 1 --2- 172.21.15.72:0/2435113830 >> v2:172.21.15.72:3300/0 conn(0x7fc5c40a1340 0x7fc5c4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c37fe700 1 -- 172.21.15.72:0/2435113830 >> v2:172.21.15.72:3300/0 conn(0x7fc5c40a1340 msgr2=0x7fc5c4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:57.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c37fe700 1 --2- 172.21.15.72:0/2435113830 >> v2:172.21.15.72:3300/0 conn(0x7fc5c40a1340 0x7fc5c4133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c37fe700 1 -- 172.21.15.72:0/2435113830 >> v1:172.21.15.72:6789/0 conn(0x7fc5c4133fa0 legacy=0x7fc5c413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c37fe700 1 -- 172.21.15.72:0/2435113830 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c40a1fe0 con 0x7fc5c40a0a30 2023-10-03T10:17:57.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c37fe700 1 --2- 172.21.15.72:0/2435113830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c40a0a30 0x7fc5c40a0e00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40098f0 tx=0x7fc5b4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea86526887030e68 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c27fc700 1 -- 172.21.15.72:0/2435113830 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4011830 con 0x7fc5c40a0a30 2023-10-03T10:17:57.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c27fc700 1 -- 172.21.15.72:0/2435113830 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b4011990 con 0x7fc5c40a0a30 2023-10-03T10:17:57.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.278+0000 7fc5c27fc700 1 -- 172.21.15.72:0/2435113830 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4011d20 con 0x7fc5c40a0a30 2023-10-03T10:17:57.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.279+0000 7fc5c9c56700 1 -- 172.21.15.72:0/2435113830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c40a0a30 msgr2=0x7fc5c40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.279+0000 7fc5c9c56700 1 --2- 172.21.15.72:0/2435113830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c40a0a30 0x7fc5c40a0e00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40098f0 tx=0x7fc5b4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:57.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.279+0000 7fc5c9c56700 1 -- 172.21.15.72:0/2435113830 shutdown_connections 2023-10-03T10:17:57.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.279+0000 7fc5c9c56700 1 --2- 172.21.15.72:0/2435113830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c40a0a30 0x7fc5c40a0e00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.279+0000 7fc5c9c56700 1 --2- 172.21.15.72:0/2435113830 >> v2:172.21.15.72:3300/0 conn(0x7fc5c40a1340 0x7fc5c4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.279+0000 7fc5c9c56700 1 -- 172.21.15.72:0/2435113830 >> 172.21.15.72:0/2435113830 conn(0x7fc5c40a6550 msgr2=0x7fc5c40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.279+0000 7fc5c9c56700 1 -- 172.21.15.72:0/2435113830 shutdown_connections 2023-10-03T10:17:57.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.279+0000 7fc5c9c56700 1 -- 172.21.15.72:0/2435113830 wait complete. 2023-10-03T10:17:57.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.280+0000 7fc5c9c56700 1 Processor -- start 2023-10-03T10:17:57.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.280+0000 7fc5c9c56700 1 -- start start 2023-10-03T10:17:57.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c9c56700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c40a0a30 0x7fc5c411e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c9c56700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5c40a1340 0x7fc5c411ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c9c56700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c4133fa0 0x7fc5c411f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c9c56700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4121f50 con 0x7fc5c4133fa0 2023-10-03T10:17:57.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c9c56700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4120430 con 0x7fc5c40a0a30 2023-10-03T10:17:57.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c9c56700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40a37e0 con 0x7fc5c40a1340 2023-10-03T10:17:57.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c40a0a30 0x7fc5c411e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c2ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5c40a1340 0x7fc5c411ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c40a0a30 0x7fc5c411e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54112/0 (socket says 172.21.15.72:54112) 2023-10-03T10:17:57.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c37fe700 1 -- 172.21.15.72:0/1213541806 learned_addr learned my addr 172.21.15.72:0/1213541806 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:57.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c3fff700 1 --2- 172.21.15.72:0/1213541806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c4133fa0 0x7fc5c411f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c37fe700 1 -- 172.21.15.72:0/1213541806 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5c40a1340 msgr2=0x7fc5c411ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c37fe700 1 --2- 172.21.15.72:0/1213541806 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5c40a1340 0x7fc5c411ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c37fe700 1 -- 172.21.15.72:0/1213541806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c4133fa0 msgr2=0x7fc5c411f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c37fe700 1 --2- 172.21.15.72:0/1213541806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c4133fa0 0x7fc5c411f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c37fe700 1 -- 172.21.15.72:0/1213541806 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b4009550 con 0x7fc5c40a0a30 2023-10-03T10:17:57.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c37fe700 1 --2- 172.21.15.72:0/1213541806 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c40a0a30 0x7fc5c411e7a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4009c40 tx=0x7fc5b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5abfff700 1 -- 172.21.15.72:0/1213541806 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4004400 con 0x7fc5c40a0a30 2023-10-03T10:17:57.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5abfff700 1 -- 172.21.15.72:0/1213541806 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b401f070 con 0x7fc5c40a0a30 2023-10-03T10:17:57.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c9c56700 1 -- 172.21.15.72:0/1213541806 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c40a0220 con 0x7fc5c40a0a30 2023-10-03T10:17:57.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5abfff700 1 -- 172.21.15.72:0/1213541806 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b40038e0 con 0x7fc5c40a0a30 2023-10-03T10:17:57.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.281+0000 7fc5c9c56700 1 -- 172.21.15.72:0/1213541806 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c41229c0 con 0x7fc5c40a0a30 2023-10-03T10:17:57.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.282+0000 7fc5c9c56700 1 -- 172.21.15.72:0/1213541806 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c4074ea0 con 0x7fc5c40a0a30 2023-10-03T10:17:57.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.283+0000 7fc5abfff700 1 -- 172.21.15.72:0/1213541806 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5b4021030 con 0x7fc5c40a0a30 2023-10-03T10:17:57.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.283+0000 7fc5abfff700 1 -- 172.21.15.72:0/1213541806 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc5b4040e40 con 0x7fc5c40a0a30 2023-10-03T10:17:57.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.291+0000 7fc5abfff700 1 -- 172.21.15.72:0/1213541806 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5b400b9d0 con 0x7fc5c40a0a30 2023-10-03T10:17:57.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.401+0000 7f424f042700 1 -- 172.21.15.72:0/869360181 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f42481a59b0 con 0x7f424809d6f0 2023-10-03T10:17:57.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.401+0000 7f42457fa700 1 -- 172.21.15.72:0/869360181 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f42481a59b0 con 0x7f424809d6f0 2023-10-03T10:17:57.402 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:57.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.403+0000 7f424f042700 1 -- 172.21.15.72:0/869360181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f424809d6f0 msgr2=0x7f42481c42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.403+0000 7f424f042700 1 --2- 172.21.15.72:0/869360181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f424809d6f0 0x7f42481c42f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f423c0098f0 tx=0x7f423c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:57.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.403+0000 7f424f042700 1 -- 172.21.15.72:0/869360181 shutdown_connections 2023-10-03T10:17:57.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.403+0000 7f424f042700 1 --2- 172.21.15.72:0/869360181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f424809e410 0x7f42481c05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.403+0000 7f424f042700 1 --2- 172.21.15.72:0/869360181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f424809d6f0 0x7f42481c42f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.403+0000 7f424f042700 1 --2- 172.21.15.72:0/869360181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f424809e000 0x7f42481c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.403+0000 7f424f042700 1 -- 172.21.15.72:0/869360181 >> 172.21.15.72:0/869360181 conn(0x7f4248066f50 msgr2=0x7f4248071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.403+0000 7f424f042700 1 -- 172.21.15.72:0/869360181 shutdown_connections 2023-10-03T10:17:57.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.403+0000 7f424f042700 1 -- 172.21.15.72:0/869360181 wait complete. 2023-10-03T10:17:57.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:57.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:57.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.454+0000 7fadb7e3e700 1 -- 172.21.15.72:0/949427848 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fadb0129f50 con 0x7fadb012cff0 2023-10-03T10:17:57.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.454+0000 7fada67fc700 1 -- 172.21.15.72:0/949427848 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fada80263e0 con 0x7fadb012cff0 2023-10-03T10:17:57.455 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.456+0000 7fadb7e3e700 1 -- 172.21.15.72:0/949427848 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb012cff0 msgr2=0x7fadb01353d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.456+0000 7fadb7e3e700 1 --2- 172.21.15.72:0/949427848 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb012cff0 0x7fadb01353d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fada8016000 tx=0x7fada8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.456+0000 7fadb7e3e700 1 -- 172.21.15.72:0/949427848 shutdown_connections 2023-10-03T10:17:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.456+0000 7fadb7e3e700 1 --2- 172.21.15.72:0/949427848 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadb012cff0 0x7fadb01353d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.456+0000 7fadb7e3e700 1 --2- 172.21.15.72:0/949427848 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fadb012c2f0 0x7fadb0071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.456+0000 7fadb7e3e700 1 --2- 172.21.15.72:0/949427848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadb012cc20 0x7fadb0134e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.456+0000 7fadb7e3e700 1 -- 172.21.15.72:0/949427848 >> 172.21.15.72:0/949427848 conn(0x7fadb009f470 msgr2=0x7fadb012f840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.456+0000 7fadb7e3e700 1 -- 172.21.15.72:0/949427848 shutdown_connections 2023-10-03T10:17:57.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.456+0000 7fadb7e3e700 1 -- 172.21.15.72:0/949427848 wait complete. 2023-10-03T10:17:57.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:57.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.487+0000 7fc5c9c56700 1 -- 172.21.15.72:0/1213541806 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc5c40a28e0 con 0x7fc5c40a0a30 2023-10-03T10:17:57.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.487+0000 7fc5abfff700 1 -- 172.21.15.72:0/1213541806 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc5b4015070 con 0x7fc5c40a0a30 2023-10-03T10:17:57.488 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:57.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.489+0000 7fc5c9c56700 1 -- 172.21.15.72:0/1213541806 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c40a0a30 msgr2=0x7fc5c411e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.489+0000 7fc5c9c56700 1 --2- 172.21.15.72:0/1213541806 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c40a0a30 0x7fc5c411e7a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4009c40 tx=0x7fc5b4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:57.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.489+0000 7fc5c9c56700 1 -- 172.21.15.72:0/1213541806 shutdown_connections 2023-10-03T10:17:57.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.489+0000 7fc5c9c56700 1 --2- 172.21.15.72:0/1213541806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5c4133fa0 0x7fc5c411f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.489+0000 7fc5c9c56700 1 --2- 172.21.15.72:0/1213541806 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc5c40a0a30 0x7fc5c411e7a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.489+0000 7fc5c9c56700 1 --2- 172.21.15.72:0/1213541806 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc5c40a1340 0x7fc5c411ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.489+0000 7fc5c9c56700 1 -- 172.21.15.72:0/1213541806 >> 172.21.15.72:0/1213541806 conn(0x7fc5c40a6550 msgr2=0x7fc5c41b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.490+0000 7fc5c9c56700 1 -- 172.21.15.72:0/1213541806 shutdown_connections 2023-10-03T10:17:57.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.490+0000 7fc5c9c56700 1 -- 172.21.15.72:0/1213541806 wait complete. 2023-10-03T10:17:57.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:57.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.549+0000 7f13cf47e700 1 Processor -- start 2023-10-03T10:17:57.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cf47e700 1 -- start start 2023-10-03T10:17:57.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cf47e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f13c809d6f0 0x7f13c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cf47e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13c809e000 0x7f13c81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cf47e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13c809e410 0x7f13c8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cf47e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c806b460 con 0x7f13c809d6f0 2023-10-03T10:17:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cf47e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c809b120 con 0x7f13c809e410 2023-10-03T10:17:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cf47e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13c809a7e0 con 0x7f13c809e000 2023-10-03T10:17:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cca19700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13c809e000 0x7f13c81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cd21a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f13c809d6f0 0x7f13c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cda1b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13c809e410 0x7f13c8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cca19700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13c809e000 0x7f13c81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:42224/0 (socket says 172.21.15.72:42224) 2023-10-03T10:17:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cd21a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f13c809d6f0 0x7f13c809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51874/0 (socket says 172.21.15.72:51874) 2023-10-03T10:17:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cca19700 1 -- 172.21.15.72:0/3064024285 learned_addr learned my addr 172.21.15.72:0/3064024285 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cda1b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13c809e410 0x7f13c8133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54114/0 (socket says 172.21.15.72:54114) 2023-10-03T10:17:57.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cda1b700 1 -- 172.21.15.72:0/3064024285 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13c809e000 msgr2=0x7f13c81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cda1b700 1 --2- 172.21.15.72:0/3064024285 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13c809e000 0x7f13c81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cda1b700 1 -- 172.21.15.72:0/3064024285 >> v2:172.21.15.72:3300/0 conn(0x7f13c809d6f0 msgr2=0x7f13c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cda1b700 1 --2- 172.21.15.72:0/3064024285 >> v2:172.21.15.72:3300/0 conn(0x7f13c809d6f0 0x7f13c809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cda1b700 1 -- 172.21.15.72:0/3064024285 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c809a500 con 0x7f13c809e410 2023-10-03T10:17:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cca19700 1 --2- 172.21.15.72:0/3064024285 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13c809e000 0x7f13c81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.550+0000 7f13cd21a700 1 --2- 172.21.15.72:0/3064024285 >> v2:172.21.15.72:3300/0 conn(0x7f13c809d6f0 0x7f13c809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.551+0000 7f13cda1b700 1 --2- 172.21.15.72:0/3064024285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13c809e410 0x7f13c8133f30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009dc0 tx=0x7f13c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f1e793336d5dbf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.551+0000 7f13bbfff700 1 -- 172.21.15.72:0/3064024285 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c000e070 con 0x7f13c809e410 2023-10-03T10:17:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.551+0000 7f13bbfff700 1 -- 172.21.15.72:0/3064024285 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c000bae0 con 0x7f13c809e410 2023-10-03T10:17:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.551+0000 7f13bbfff700 1 -- 172.21.15.72:0/3064024285 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c000be90 con 0x7f13c809e410 2023-10-03T10:17:57.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.551+0000 7f13cf47e700 1 -- 172.21.15.72:0/3064024285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13c809e410 msgr2=0x7f13c8133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.551+0000 7f13cf47e700 1 --2- 172.21.15.72:0/3064024285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13c809e410 0x7f13c8133f30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009dc0 tx=0x7f13c000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:57.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.551+0000 7f13cf47e700 1 -- 172.21.15.72:0/3064024285 shutdown_connections 2023-10-03T10:17:57.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.551+0000 7f13cf47e700 1 --2- 172.21.15.72:0/3064024285 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13c809e410 0x7f13c8133f30 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.551+0000 7f13cf47e700 1 --2- 172.21.15.72:0/3064024285 >> v2:172.21.15.72:3300/0 conn(0x7f13c809d6f0 0x7f13c809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.551+0000 7f13cf47e700 1 --2- 172.21.15.72:0/3064024285 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13c809e000 0x7f13c81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.551+0000 7f13cf47e700 1 -- 172.21.15.72:0/3064024285 >> 172.21.15.72:0/3064024285 conn(0x7f13c8066f50 msgr2=0x7f13c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.551+0000 7f13cf47e700 1 -- 172.21.15.72:0/3064024285 shutdown_connections 2023-10-03T10:17:57.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.551+0000 7f13cf47e700 1 -- 172.21.15.72:0/3064024285 wait complete. 2023-10-03T10:17:57.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.552+0000 7f13cf47e700 1 Processor -- start 2023-10-03T10:17:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.552+0000 7f13cf47e700 1 -- start start 2023-10-03T10:17:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cf47e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13c809d6f0 0x7f13c81c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cf47e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c809e000 0x7f13c81c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cf47e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13c809e410 0x7f13c81c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cf47e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c81a8a00 con 0x7f13c809e000 2023-10-03T10:17:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cf47e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c81a85d0 con 0x7f13c809d6f0 2023-10-03T10:17:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cf47e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13c81a91f0 con 0x7f13c809e410 2023-10-03T10:17:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cd21a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13c809d6f0 0x7f13c81c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cca19700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c809e000 0x7f13c81c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cda1b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13c809e410 0x7f13c81c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cd21a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13c809d6f0 0x7f13c81c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:54120/0 (socket says 172.21.15.72:54120) 2023-10-03T10:17:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cd21a700 1 -- 172.21.15.72:0/3370734723 learned_addr learned my addr 172.21.15.72:0/3370734723 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cca19700 1 --2- 172.21.15.72:0/3370734723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c809e000 0x7f13c81c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51888/0 (socket says 172.21.15.72:51888) 2023-10-03T10:17:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cd21a700 1 -- 172.21.15.72:0/3370734723 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13c809e410 msgr2=0x7f13c81c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cd21a700 1 --2- 172.21.15.72:0/3370734723 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13c809e410 0x7f13c81c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cd21a700 1 -- 172.21.15.72:0/3370734723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c809e000 msgr2=0x7f13c81c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cd21a700 1 --2- 172.21.15.72:0/3370734723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c809e000 0x7f13c81c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cd21a700 1 -- 172.21.15.72:0/3370734723 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc0094a0 con 0x7f13c809d6f0 2023-10-03T10:17:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cca19700 1 --2- 172.21.15.72:0/3370734723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c809e000 0x7f13c81c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cda1b700 1 --2- 172.21.15.72:0/3370734723 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13c809e410 0x7f13c81c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.553+0000 7f13cd21a700 1 --2- 172.21.15.72:0/3370734723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13c809d6f0 0x7f13c81c84f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00ebe0 tx=0x7f13bc00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.554+0000 7f13b9ffb700 1 -- 172.21.15.72:0/3370734723 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00c850 con 0x7f13c809d6f0 2023-10-03T10:17:57.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.554+0000 7f13b9ffb700 1 -- 172.21.15.72:0/3370734723 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc00c9b0 con 0x7f13c809d6f0 2023-10-03T10:17:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.554+0000 7f13cf47e700 1 -- 172.21.15.72:0/3370734723 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c4009550 con 0x7f13c809d6f0 2023-10-03T10:17:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.554+0000 7f13b9ffb700 1 -- 172.21.15.72:0/3370734723 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00cd40 con 0x7f13c809d6f0 2023-10-03T10:17:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.554+0000 7f13cf47e700 1 -- 172.21.15.72:0/3370734723 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c0009a70 con 0x7f13c809d6f0 2023-10-03T10:17:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.555+0000 7f13b9ffb700 1 -- 172.21.15.72:0/3370734723 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13bc013470 con 0x7f13c809d6f0 2023-10-03T10:17:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.555+0000 7f13b9ffb700 1 -- 172.21.15.72:0/3370734723 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f13bc03f780 con 0x7f13c809d6f0 2023-10-03T10:17:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.555+0000 7f13cf47e700 1 -- 172.21.15.72:0/3370734723 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c8074ea0 con 0x7f13c809d6f0 2023-10-03T10:17:57.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.559+0000 7f13b9ffb700 1 -- 172.21.15.72:0/3370734723 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13bc013720 con 0x7f13c809d6f0 2023-10-03T10:17:57.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.745+0000 7f13cf47e700 1 -- 172.21.15.72:0/3370734723 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f13c806c360 con 0x7f13c809d6f0 2023-10-03T10:17:57.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.746+0000 7f13b9ffb700 1 -- 172.21.15.72:0/3370734723 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13bc021020 con 0x7f13c809d6f0 2023-10-03T10:17:57.747 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.748+0000 7f13cf47e700 1 -- 172.21.15.72:0/3370734723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13c809d6f0 msgr2=0x7f13c81c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.748+0000 7f13cf47e700 1 --2- 172.21.15.72:0/3370734723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13c809d6f0 0x7f13c81c84f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00ebe0 tx=0x7f13bc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.748+0000 7f13cf47e700 1 -- 172.21.15.72:0/3370734723 shutdown_connections 2023-10-03T10:17:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.748+0000 7f13cf47e700 1 --2- 172.21.15.72:0/3370734723 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f13c809e410 0x7f13c81c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.748+0000 7f13cf47e700 1 --2- 172.21.15.72:0/3370734723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13c809d6f0 0x7f13c81c84f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.748+0000 7f13cf47e700 1 --2- 172.21.15.72:0/3370734723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13c809e000 0x7f13c81c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.748+0000 7f13cf47e700 1 -- 172.21.15.72:0/3370734723 >> 172.21.15.72:0/3370734723 conn(0x7f13c8066f50 msgr2=0x7f13c81bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.748+0000 7f13cf47e700 1 -- 172.21.15.72:0/3370734723 shutdown_connections 2023-10-03T10:17:57.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:57.748+0000 7f13cf47e700 1 -- 172.21.15.72:0/3370734723 wait complete. 2023-10-03T10:17:57.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:58.421 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:58.469 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:58.503 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:58.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.569+0000 7f15afcbe700 1 Processor -- start 2023-10-03T10:17:58.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.569+0000 7f15afcbe700 1 -- start start 2023-10-03T10:17:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.569+0000 7f15afcbe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15a809d6f0 0x7f15a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.569+0000 7f15afcbe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15a809e000 0x7f15a81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.569+0000 7f15afcbe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15a809e410 0x7f15a8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.569+0000 7f15afcbe700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a806b460 con 0x7f15a809d6f0 2023-10-03T10:17:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.569+0000 7f15afcbe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a809b120 con 0x7f15a809e000 2023-10-03T10:17:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.569+0000 7f15afcbe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15a809a7e0 con 0x7f15a809e410 2023-10-03T10:17:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.570+0000 7f15ada5a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15a809d6f0 0x7f15a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.570+0000 7f15ada5a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f15a809d6f0 0x7f15a809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40990/0 (socket says 172.21.15.72:40990) 2023-10-03T10:17:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.570+0000 7f15ada5a700 1 -- 172.21.15.72:0/2701095908 learned_addr learned my addr 172.21.15.72:0/2701095908 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:58.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.570+0000 7f15ad259700 1 --2- 172.21.15.72:0/2701095908 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15a809e000 0x7f15a81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.570+0000 7f15ae25b700 1 --2- 172.21.15.72:0/2701095908 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15a809e410 0x7f15a8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.570+0000 7f15ada5a700 1 -- 172.21.15.72:0/2701095908 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15a809e410 msgr2=0x7f15a8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.570+0000 7f15ada5a700 1 --2- 172.21.15.72:0/2701095908 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15a809e410 0x7f15a8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.570+0000 7f15ada5a700 1 -- 172.21.15.72:0/2701095908 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15a809e000 msgr2=0x7f15a81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.570+0000 7f15ada5a700 1 --2- 172.21.15.72:0/2701095908 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15a809e000 0x7f15a81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.570+0000 7f15ada5a700 1 -- 172.21.15.72:0/2701095908 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a809a500 con 0x7f15a809d6f0 2023-10-03T10:17:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.570+0000 7f15ada5a700 1 --2- 172.21.15.72:0/2701095908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15a809d6f0 0x7f15a809dac0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f15a40098f0 tx=0x7f15a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3ac2b104a04d94 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.570+0000 7f15aca58700 1 -- 172.21.15.72:0/2701095908 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4011830 con 0x7f15a809d6f0 2023-10-03T10:17:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.570+0000 7f15aca58700 1 -- 172.21.15.72:0/2701095908 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a4011990 con 0x7f15a809d6f0 2023-10-03T10:17:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.570+0000 7f15aca58700 1 -- 172.21.15.72:0/2701095908 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4011d20 con 0x7f15a809d6f0 2023-10-03T10:17:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.571+0000 7f15afcbe700 1 -- 172.21.15.72:0/2701095908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15a809d6f0 msgr2=0x7f15a809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.571+0000 7f15afcbe700 1 --2- 172.21.15.72:0/2701095908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15a809d6f0 0x7f15a809dac0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f15a40098f0 tx=0x7f15a4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:58.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.571+0000 7f15afcbe700 1 -- 172.21.15.72:0/2701095908 shutdown_connections 2023-10-03T10:17:58.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.571+0000 7f15afcbe700 1 --2- 172.21.15.72:0/2701095908 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15a809e410 0x7f15a8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.571+0000 7f15afcbe700 1 --2- 172.21.15.72:0/2701095908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15a809d6f0 0x7f15a809dac0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.571+0000 7f15afcbe700 1 --2- 172.21.15.72:0/2701095908 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15a809e000 0x7f15a81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.571+0000 7f15afcbe700 1 -- 172.21.15.72:0/2701095908 >> 172.21.15.72:0/2701095908 conn(0x7f15a8066f50 msgr2=0x7f15a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.571+0000 7f15afcbe700 1 -- 172.21.15.72:0/2701095908 shutdown_connections 2023-10-03T10:17:58.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.571+0000 7f15afcbe700 1 -- 172.21.15.72:0/2701095908 wait complete. 2023-10-03T10:17:58.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.572+0000 7f15afcbe700 1 Processor -- start 2023-10-03T10:17:58.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.573+0000 7f15afcbe700 1 -- start start 2023-10-03T10:17:58.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.573+0000 7f15afcbe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15a809d6f0 0x7f15a81a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.573+0000 7f15afcbe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15a809e000 0x7f15a81a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.573+0000 7f15afcbe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15a809e410 0x7f15a81c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.573+0000 7f15afcbe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a80a1f20 con 0x7f15a809e410 2023-10-03T10:17:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.573+0000 7f15afcbe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a81a80a0 con 0x7f15a809e000 2023-10-03T10:17:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.573+0000 7f15afcbe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15a81b91f0 con 0x7f15a809d6f0 2023-10-03T10:17:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.573+0000 7f15ada5a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15a809d6f0 0x7f15a81a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.573+0000 7f15ada5a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15a809d6f0 0x7f15a81a5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37706/0 (socket says 172.21.15.72:37706) 2023-10-03T10:17:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.573+0000 7f15ada5a700 1 -- 172.21.15.72:0/1143250047 learned_addr learned my addr 172.21.15.72:0/1143250047 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.573+0000 7f15ad259700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15a809e000 0x7f15a81a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.573+0000 7f15ae25b700 1 --2- 172.21.15.72:0/1143250047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15a809e410 0x7f15a81c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.574+0000 7f15ad259700 1 -- 172.21.15.72:0/1143250047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15a809d6f0 msgr2=0x7f15a81a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.574+0000 7f15ad259700 1 --2- 172.21.15.72:0/1143250047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15a809d6f0 0x7f15a81a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.574+0000 7f15ad259700 1 -- 172.21.15.72:0/1143250047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15a809e410 msgr2=0x7f15a81c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.574+0000 7f15ad259700 1 --2- 172.21.15.72:0/1143250047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15a809e410 0x7f15a81c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.574+0000 7f15ad259700 1 -- 172.21.15.72:0/1143250047 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a4009550 con 0x7f15a809e000 2023-10-03T10:17:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.574+0000 7f15ad259700 1 --2- 172.21.15.72:0/1143250047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15a809e000 0x7f15a81a5670 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f159800e930 tx=0x7f159800ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.574+0000 7f159e7fc700 1 -- 172.21.15.72:0/1143250047 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598013680 con 0x7f15a809e000 2023-10-03T10:17:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.574+0000 7f159e7fc700 1 -- 172.21.15.72:0/1143250047 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15980137e0 con 0x7f15a809e000 2023-10-03T10:17:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.574+0000 7f15afcbe700 1 -- 172.21.15.72:0/1143250047 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a81a4d40 con 0x7f15a809e000 2023-10-03T10:17:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.574+0000 7f159e7fc700 1 -- 172.21.15.72:0/1143250047 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598013b50 con 0x7f15a809e000 2023-10-03T10:17:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.574+0000 7f15afcbe700 1 -- 172.21.15.72:0/1143250047 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a81a6470 con 0x7f15a809e000 2023-10-03T10:17:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.575+0000 7f159e7fc700 1 -- 172.21.15.72:0/1143250047 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1598013cb0 con 0x7f15a809e000 2023-10-03T10:17:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.575+0000 7f159e7fc700 1 -- 172.21.15.72:0/1143250047 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f159803f9a0 con 0x7f15a809e000 2023-10-03T10:17:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.575+0000 7f15afcbe700 1 -- 172.21.15.72:0/1143250047 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a81a81e0 con 0x7f15a809e000 2023-10-03T10:17:58.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.580+0000 7f159e7fc700 1 -- 172.21.15.72:0/1143250047 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15a81a81e0 con 0x7f15a809e000 2023-10-03T10:17:58.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.611+0000 7f63ba104700 1 Processor -- start 2023-10-03T10:17:58.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.611+0000 7f63ba104700 1 -- start start 2023-10-03T10:17:58.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.612+0000 7f63ba104700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63b40a0a30 0x7f63b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.612+0000 7f63ba104700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f63b4138d80 0x7f63b413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.612+0000 7f63ba104700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b40a2a70 con 0x7f63b409d630 2023-10-03T10:17:58.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.612+0000 7f63ba104700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b40a01d0 con 0x7f63b4138d80 2023-10-03T10:17:58.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.612+0000 7f63ba104700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63b409e2b0 con 0x7f63b40a0a30 2023-10-03T10:17:58.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.612+0000 7f63b2ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f63b409d630 0x7f63b40a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36442/0 (socket says 172.21.15.72:36442) 2023-10-03T10:17:58.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.612+0000 7f63b37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63b40a0a30 0x7f63b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.612+0000 7f63b2ffd700 1 -- 172.21.15.72:0/3568805787 learned_addr learned my addr 172.21.15.72:0/3568805787 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:17:58.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.612+0000 7f63b3fff700 1 --2- 172.21.15.72:0/3568805787 >> v2:172.21.15.72:3300/0 conn(0x7f63b4138d80 0x7f63b413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.612+0000 7f63b3fff700 1 -- 172.21.15.72:0/3568805787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63b40a0a30 msgr2=0x7f63b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.612+0000 7f63b3fff700 1 --2- 172.21.15.72:0/3568805787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63b40a0a30 0x7f63b40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.612+0000 7f63b3fff700 1 -- 172.21.15.72:0/3568805787 >> v1:172.21.15.72:6789/0 conn(0x7f63b409d630 legacy=0x7f63b40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.612+0000 7f63b3fff700 1 -- 172.21.15.72:0/3568805787 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b409dc50 con 0x7f63b4138d80 2023-10-03T10:17:58.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.612+0000 7f63b27fc700 1 -- 172.21.15.72:0/3568805787 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840498671 0 0) 0x7f63b40a2a70 con 0x7f63b409d630 2023-10-03T10:17:58.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.612+0000 7f63b3fff700 1 --2- 172.21.15.72:0/3568805787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63b4138d80 0x7f63b413b160 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009840 tx=0x7f63ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4531e8488e2d40 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.613+0000 7f63b27fc700 1 -- 172.21.15.72:0/3568805787 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac011830 con 0x7f63b4138d80 2023-10-03T10:17:58.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.613+0000 7f63b27fc700 1 -- 172.21.15.72:0/3568805787 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac011990 con 0x7f63b4138d80 2023-10-03T10:17:58.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.613+0000 7f63b27fc700 1 -- 172.21.15.72:0/3568805787 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac011d20 con 0x7f63b4138d80 2023-10-03T10:17:58.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.613+0000 7f63ba104700 1 -- 172.21.15.72:0/3568805787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63b4138d80 msgr2=0x7f63b413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.613+0000 7f63ba104700 1 --2- 172.21.15.72:0/3568805787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63b4138d80 0x7f63b413b160 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009840 tx=0x7f63ac009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:58.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.614+0000 7f63ba104700 1 -- 172.21.15.72:0/3568805787 shutdown_connections 2023-10-03T10:17:58.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.614+0000 7f63ba104700 1 --2- 172.21.15.72:0/3568805787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63b4138d80 0x7f63b413b160 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.614+0000 7f63ba104700 1 --2- 172.21.15.72:0/3568805787 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63b40a0a30 0x7f63b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.614+0000 7f63ba104700 1 -- 172.21.15.72:0/3568805787 >> 172.21.15.72:0/3568805787 conn(0x7f63b40a3050 msgr2=0x7f63b40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.614+0000 7f63ba104700 1 -- 172.21.15.72:0/3568805787 shutdown_connections 2023-10-03T10:17:58.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.614+0000 7f63ba104700 1 -- 172.21.15.72:0/3568805787 wait complete. 2023-10-03T10:17:58.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.615+0000 7f63ba104700 1 Processor -- start 2023-10-03T10:17:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.615+0000 7f63ba104700 1 -- start start 2023-10-03T10:17:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63ba104700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63b409d630 0x7f63b4133830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63ba104700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63b40a0a30 0x7f63b4133d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63ba104700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63b4138d80 0x7f63b41342b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63ba104700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b4134d00 con 0x7f63b4138d80 2023-10-03T10:17:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63ba104700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b4136700 con 0x7f63b40a0a30 2023-10-03T10:17:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63ba104700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63b4137070 con 0x7f63b409d630 2023-10-03T10:17:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63b37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63b409d630 0x7f63b4133830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63b37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63b409d630 0x7f63b4133830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37718/0 (socket says 172.21.15.72:37718) 2023-10-03T10:17:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63b37fe700 1 -- 172.21.15.72:0/2204227652 learned_addr learned my addr 172.21.15.72:0/2204227652 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63b3fff700 1 --2- 172.21.15.72:0/2204227652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63b4138d80 0x7f63b41342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63b2ffd700 1 --2- 172.21.15.72:0/2204227652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63b40a0a30 0x7f63b4133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63b37fe700 1 -- 172.21.15.72:0/2204227652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63b40a0a30 msgr2=0x7f63b4133d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63b37fe700 1 --2- 172.21.15.72:0/2204227652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63b40a0a30 0x7f63b4133d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63b37fe700 1 -- 172.21.15.72:0/2204227652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63b4138d80 msgr2=0x7f63b41342b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63b37fe700 1 --2- 172.21.15.72:0/2204227652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63b4138d80 0x7f63b41342b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63b37fe700 1 -- 172.21.15.72:0/2204227652 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac0094a0 con 0x7f63b409d630 2023-10-03T10:17:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63b2ffd700 1 --2- 172.21.15.72:0/2204227652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63b40a0a30 0x7f63b4133d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.616+0000 7f63b37fe700 1 --2- 172.21.15.72:0/2204227652 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63b409d630 0x7f63b4133830 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009db0 tx=0x7f63a400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.617+0000 7f63abfff700 1 -- 172.21.15.72:0/2204227652 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4009c20 con 0x7f63b409d630 2023-10-03T10:17:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.617+0000 7f63abfff700 1 -- 172.21.15.72:0/2204227652 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a400f040 con 0x7f63b409d630 2023-10-03T10:17:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.617+0000 7f63abfff700 1 -- 172.21.15.72:0/2204227652 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4014480 con 0x7f63b409d630 2023-10-03T10:17:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.617+0000 7f63ba104700 1 -- 172.21.15.72:0/2204227652 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b40a0410 con 0x7f63b409d630 2023-10-03T10:17:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.617+0000 7f63ba104700 1 -- 172.21.15.72:0/2204227652 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b4136e00 con 0x7f63b409d630 2023-10-03T10:17:58.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.618+0000 7f63abfff700 1 -- 172.21.15.72:0/2204227652 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f63a40145e0 con 0x7f63b409d630 2023-10-03T10:17:58.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.618+0000 7f63abfff700 1 -- 172.21.15.72:0/2204227652 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f63a403fe90 con 0x7f63b409d630 2023-10-03T10:17:58.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.618+0000 7f63ba104700 1 -- 172.21.15.72:0/2204227652 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b4135ce0 con 0x7f63b409d630 2023-10-03T10:17:58.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.623+0000 7f63abfff700 1 -- 172.21.15.72:0/2204227652 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63a406b750 con 0x7f63b409d630 2023-10-03T10:17:58.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.644+0000 7fcc2d50c700 1 Processor -- start 2023-10-03T10:17:58.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.644+0000 7fcc2d50c700 1 -- start start 2023-10-03T10:17:58.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.645+0000 7fcc2d50c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2809d6f0 0x7fcc2809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.645+0000 7fcc2d50c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc2809e000 0x7fcc28130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.645+0000 7fcc2d50c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc2809f130 con 0x7fcc2809e410 2023-10-03T10:17:58.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.645+0000 7fcc2d50c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2809f520 con 0x7fcc2809d6f0 2023-10-03T10:17:58.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.645+0000 7fcc2d50c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2809e930 con 0x7fcc2809e000 2023-10-03T10:17:58.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.645+0000 7fcc267fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc2809e000 0x7fcc28130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.645+0000 7fcc267fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc2809e000 0x7fcc28130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37734/0 (socket says 172.21.15.72:37734) 2023-10-03T10:17:58.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.645+0000 7fcc267fc700 1 -- 172.21.15.72:0/2407340040 learned_addr learned my addr 172.21.15.72:0/2407340040 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:58.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.645+0000 7fcc26ffd700 1 --2- 172.21.15.72:0/2407340040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2809d6f0 0x7fcc2809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.646+0000 7fcc267fc700 1 -- 172.21.15.72:0/2407340040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2809d6f0 msgr2=0x7fcc2809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.646+0000 7fcc267fc700 1 --2- 172.21.15.72:0/2407340040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2809d6f0 0x7fcc2809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.646+0000 7fcc267fc700 1 -- 172.21.15.72:0/2407340040 >> v1:172.21.15.72:6789/0 conn(0x7fcc2809e410 legacy=0x7fcc28130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.646+0000 7fcc267fc700 1 -- 172.21.15.72:0/2407340040 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2809b2d0 con 0x7fcc2809e000 2023-10-03T10:17:58.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.646+0000 7fcc26ffd700 1 --2- 172.21.15.72:0/2407340040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2809d6f0 0x7fcc2809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.646+0000 7fcc267fc700 1 --2- 172.21.15.72:0/2407340040 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc2809e000 0x7fcc28130660 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009950 tx=0x7fcc1c009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aec1156951ce56b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.646+0000 7fcc25ffb700 1 -- 172.21.15.72:0/2407340040 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c011830 con 0x7fcc2809e000 2023-10-03T10:17:58.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.646+0000 7fcc25ffb700 1 -- 172.21.15.72:0/2407340040 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c011990 con 0x7fcc2809e000 2023-10-03T10:17:58.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.646+0000 7fcc25ffb700 1 -- 172.21.15.72:0/2407340040 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c011d40 con 0x7fcc2809e000 2023-10-03T10:17:58.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.647+0000 7fcc2d50c700 1 -- 172.21.15.72:0/2407340040 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc2809e000 msgr2=0x7fcc28130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.647+0000 7fcc2d50c700 1 --2- 172.21.15.72:0/2407340040 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc2809e000 0x7fcc28130660 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009950 tx=0x7fcc1c009c60 comp rx=0 tx=0).stop 2023-10-03T10:17:58.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.647+0000 7fcc2d50c700 1 -- 172.21.15.72:0/2407340040 shutdown_connections 2023-10-03T10:17:58.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.647+0000 7fcc2d50c700 1 --2- 172.21.15.72:0/2407340040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2809d6f0 0x7fcc2809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.647+0000 7fcc2d50c700 1 --2- 172.21.15.72:0/2407340040 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc2809e000 0x7fcc28130660 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.647+0000 7fcc2d50c700 1 -- 172.21.15.72:0/2407340040 >> 172.21.15.72:0/2407340040 conn(0x7fcc28066f50 msgr2=0x7fcc2809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.647+0000 7fcc2d50c700 1 -- 172.21.15.72:0/2407340040 shutdown_connections 2023-10-03T10:17:58.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.647+0000 7fcc2d50c700 1 -- 172.21.15.72:0/2407340040 wait complete. 2023-10-03T10:17:58.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.648+0000 7fcc2d50c700 1 Processor -- start 2023-10-03T10:17:58.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.648+0000 7fcc2d50c700 1 -- start start 2023-10-03T10:17:58.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.648+0000 7fcc2d50c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc2809d6f0 0x7fcc281301a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.648+0000 7fcc2d50c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc2809e000 0x7fcc281306e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.648+0000 7fcc2d50c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2809e410 0x7fcc28130c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.648+0000 7fcc2d50c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2812e170 con 0x7fcc2809e000 2023-10-03T10:17:58.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.648+0000 7fcc2d50c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2812f5c0 con 0x7fcc2809e410 2023-10-03T10:17:58.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.648+0000 7fcc2d50c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280724b0 con 0x7fcc2809d6f0 2023-10-03T10:17:58.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc26ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc2809d6f0 0x7fcc281301a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc26ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc2809d6f0 0x7fcc281301a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37740/0 (socket says 172.21.15.72:37740) 2023-10-03T10:17:58.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc26ffd700 1 -- 172.21.15.72:0/1196076395 learned_addr learned my addr 172.21.15.72:0/1196076395 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:58.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc277fe700 1 --2- 172.21.15.72:0/1196076395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2809e410 0x7fcc28130c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc267fc700 1 --2- 172.21.15.72:0/1196076395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc2809e000 0x7fcc281306e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc277fe700 1 -- 172.21.15.72:0/1196076395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc2809d6f0 msgr2=0x7fcc281301a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc277fe700 1 --2- 172.21.15.72:0/1196076395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc2809d6f0 0x7fcc281301a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc277fe700 1 -- 172.21.15.72:0/1196076395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc2809e000 msgr2=0x7fcc281306e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc277fe700 1 --2- 172.21.15.72:0/1196076395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc2809e000 0x7fcc281306e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc277fe700 1 -- 172.21.15.72:0/1196076395 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc180094a0 con 0x7fcc2809e410 2023-10-03T10:17:58.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc26ffd700 1 --2- 172.21.15.72:0/1196076395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc2809d6f0 0x7fcc281301a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc267fc700 1 --2- 172.21.15.72:0/1196076395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc2809e000 0x7fcc281306e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc277fe700 1 --2- 172.21.15.72:0/1196076395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2809e410 0x7fcc28130c20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000cb90 tx=0x7fcc2000cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc0f7fe700 1 -- 172.21.15.72:0/1196076395 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc20003c00 con 0x7fcc2809e410 2023-10-03T10:17:58.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc0f7fe700 1 -- 172.21.15.72:0/1196076395 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc20003d60 con 0x7fcc2809e410 2023-10-03T10:17:58.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc0f7fe700 1 -- 172.21.15.72:0/1196076395 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2000aa80 con 0x7fcc2809e410 2023-10-03T10:17:58.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc2d50c700 1 -- 172.21.15.72:0/1196076395 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c009550 con 0x7fcc2809e410 2023-10-03T10:17:58.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.649+0000 7fcc2d50c700 1 -- 172.21.15.72:0/1196076395 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2809c700 con 0x7fcc2809e410 2023-10-03T10:17:58.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.651+0000 7fcc2d50c700 1 -- 172.21.15.72:0/1196076395 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc28131290 con 0x7fcc2809e410 2023-10-03T10:17:58.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.651+0000 7fcc0f7fe700 1 -- 172.21.15.72:0/1196076395 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcc2000abe0 con 0x7fcc2809e410 2023-10-03T10:17:58.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.651+0000 7fcc0f7fe700 1 -- 172.21.15.72:0/1196076395 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcc2003ff30 con 0x7fcc2809e410 2023-10-03T10:17:58.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.655+0000 7fcc0f7fe700 1 -- 172.21.15.72:0/1196076395 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcc20011970 con 0x7fcc2809e410 2023-10-03T10:17:58.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:58.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.779+0000 7f15afcbe700 1 -- 172.21.15.72:0/1143250047 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f15a81a81e0 con 0x7f15a809e000 2023-10-03T10:17:58.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.780+0000 7f159e7fc700 1 -- 172.21.15.72:0/1143250047 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f15a81a81e0 con 0x7f15a809e000 2023-10-03T10:17:58.780 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:58.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.782+0000 7f15afcbe700 1 -- 172.21.15.72:0/1143250047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15a809e000 msgr2=0x7f15a81a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.782+0000 7f15afcbe700 1 --2- 172.21.15.72:0/1143250047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15a809e000 0x7f15a81a5670 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f159800e930 tx=0x7f159800ec40 comp rx=0 tx=0).stop 2023-10-03T10:17:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.782+0000 7f15afcbe700 1 -- 172.21.15.72:0/1143250047 shutdown_connections 2023-10-03T10:17:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.782+0000 7f15afcbe700 1 --2- 172.21.15.72:0/1143250047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15a809e410 0x7f15a81c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.782+0000 7f15afcbe700 1 --2- 172.21.15.72:0/1143250047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f15a809d6f0 0x7f15a81a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.782+0000 7f15afcbe700 1 --2- 172.21.15.72:0/1143250047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15a809e000 0x7f15a81a5670 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.782+0000 7f15afcbe700 1 -- 172.21.15.72:0/1143250047 >> 172.21.15.72:0/1143250047 conn(0x7f15a8066f50 msgr2=0x7f15a81bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.782+0000 7f15afcbe700 1 -- 172.21.15.72:0/1143250047 shutdown_connections 2023-10-03T10:17:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.782+0000 7f15afcbe700 1 -- 172.21.15.72:0/1143250047 wait complete. 2023-10-03T10:17:58.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:17:58.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.822+0000 7f63ba104700 1 -- 172.21.15.72:0/2204227652 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f63b40a4b50 con 0x7f63b409d630 2023-10-03T10:17:58.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.823+0000 7f63abfff700 1 -- 172.21.15.72:0/2204227652 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63a4014890 con 0x7f63b409d630 2023-10-03T10:17:58.823 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:17:58.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.825+0000 7f63ba104700 1 -- 172.21.15.72:0/2204227652 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63b409d630 msgr2=0x7f63b4133830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.825+0000 7f63ba104700 1 --2- 172.21.15.72:0/2204227652 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63b409d630 0x7f63b4133830 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009db0 tx=0x7f63a400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.825+0000 7f63ba104700 1 -- 172.21.15.72:0/2204227652 shutdown_connections 2023-10-03T10:17:58.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.825+0000 7f63ba104700 1 --2- 172.21.15.72:0/2204227652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63b4138d80 0x7f63b41342b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.825+0000 7f63ba104700 1 --2- 172.21.15.72:0/2204227652 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f63b409d630 0x7f63b4133830 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.825+0000 7f63ba104700 1 --2- 172.21.15.72:0/2204227652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63b40a0a30 0x7f63b4133d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.825+0000 7f63ba104700 1 -- 172.21.15.72:0/2204227652 >> 172.21.15.72:0/2204227652 conn(0x7f63b40a3050 msgr2=0x7f63b409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.825+0000 7f63ba104700 1 -- 172.21.15.72:0/2204227652 shutdown_connections 2023-10-03T10:17:58.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.825+0000 7f63ba104700 1 -- 172.21.15.72:0/2204227652 wait complete. 2023-10-03T10:17:58.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:17:58.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.853+0000 7fcc2d50c700 1 -- 172.21.15.72:0/1196076395 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcc28131290 con 0x7fcc2809e410 2023-10-03T10:17:58.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.853+0000 7fcc0f7fe700 1 -- 172.21.15.72:0/1196076395 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcc28131290 con 0x7fcc2809e410 2023-10-03T10:17:58.854 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:17:58.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.855+0000 7fcc2d50c700 1 -- 172.21.15.72:0/1196076395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2809e410 msgr2=0x7fcc28130c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.855+0000 7fcc2d50c700 1 --2- 172.21.15.72:0/1196076395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2809e410 0x7fcc28130c20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000cb90 tx=0x7fcc2000cea0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.855+0000 7fcc2d50c700 1 -- 172.21.15.72:0/1196076395 shutdown_connections 2023-10-03T10:17:58.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.855+0000 7fcc2d50c700 1 --2- 172.21.15.72:0/1196076395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2809e410 0x7fcc28130c20 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.855+0000 7fcc2d50c700 1 --2- 172.21.15.72:0/1196076395 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcc2809d6f0 0x7fcc281301a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.855+0000 7fcc2d50c700 1 --2- 172.21.15.72:0/1196076395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc2809e000 0x7fcc281306e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.855+0000 7fcc2d50c700 1 -- 172.21.15.72:0/1196076395 >> 172.21.15.72:0/1196076395 conn(0x7fcc28066f50 msgr2=0x7fcc280a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.855+0000 7fcc2d50c700 1 -- 172.21.15.72:0/1196076395 shutdown_connections 2023-10-03T10:17:58.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.855+0000 7fcc2d50c700 1 -- 172.21.15.72:0/1196076395 wait complete. 2023-10-03T10:17:58.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:17:58.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.890+0000 7fd61320e700 1 Processor -- start 2023-10-03T10:17:58.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.890+0000 7fd61320e700 1 -- start start 2023-10-03T10:17:58.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd61320e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd60c06a770 0x7fd60c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd61320e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd60c06b080 0x7fd60c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd61320e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c09ece0 con 0x7fd60c131b40 2023-10-03T10:17:58.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd61320e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c09e760 con 0x7fd60c06b080 2023-10-03T10:17:58.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd61320e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c09e040 con 0x7fd60c06a770 2023-10-03T10:17:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd610faa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd60c06a770 0x7fd60c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd60bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd60c06b080 0x7fd60c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd610faa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd60c06a770 0x7fd60c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37750/0 (socket says 172.21.15.72:37750) 2023-10-03T10:17:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd60bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd60c06b080 0x7fd60c131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41034/0 (socket says 172.21.15.72:41034) 2023-10-03T10:17:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd610faa700 1 -- 172.21.15.72:0/3867333345 learned_addr learned my addr 172.21.15.72:0/3867333345 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd60bfff700 1 -- 172.21.15.72:0/3867333345 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd60c06a770 msgr2=0x7fd60c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd60bfff700 1 --2- 172.21.15.72:0/3867333345 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd60c06a770 0x7fd60c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd60bfff700 1 -- 172.21.15.72:0/3867333345 >> v1:172.21.15.72:6789/0 conn(0x7fd60c131b40 legacy=0x7fd60c138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd60b7fe700 1 -- 172.21.15.72:0/3867333345 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131219183 0 0) 0x7fd60c09ece0 con 0x7fd60c131b40 2023-10-03T10:17:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd60bfff700 1 -- 172.21.15.72:0/3867333345 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c09f630 con 0x7fd60c06b080 2023-10-03T10:17:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.891+0000 7fd610faa700 1 --2- 172.21.15.72:0/3867333345 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd60c06a770 0x7fd60c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.892+0000 7fd60bfff700 1 --2- 172.21.15.72:0/3867333345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd60c06b080 0x7fd60c131600 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8009840 tx=0x7fd5f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804740a20aade3f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.892+0000 7fd60b7fe700 1 -- 172.21.15.72:0/3867333345 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8011830 con 0x7fd60c06b080 2023-10-03T10:17:58.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.892+0000 7fd60b7fe700 1 -- 172.21.15.72:0/3867333345 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8011990 con 0x7fd60c06b080 2023-10-03T10:17:58.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.892+0000 7fd60b7fe700 1 -- 172.21.15.72:0/3867333345 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8011d20 con 0x7fd60c06b080 2023-10-03T10:17:58.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.892+0000 7fd61320e700 1 -- 172.21.15.72:0/3867333345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd60c06b080 msgr2=0x7fd60c131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.892+0000 7fd61320e700 1 --2- 172.21.15.72:0/3867333345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd60c06b080 0x7fd60c131600 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8009840 tx=0x7fd5f8009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:58.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.892+0000 7fd61320e700 1 -- 172.21.15.72:0/3867333345 shutdown_connections 2023-10-03T10:17:58.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.892+0000 7fd61320e700 1 --2- 172.21.15.72:0/3867333345 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd60c06a770 0x7fd60c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.892+0000 7fd61320e700 1 --2- 172.21.15.72:0/3867333345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd60c06b080 0x7fd60c131600 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.892+0000 7fd61320e700 1 -- 172.21.15.72:0/3867333345 >> 172.21.15.72:0/3867333345 conn(0x7fd60c066f50 msgr2=0x7fd60c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.892+0000 7fd61320e700 1 -- 172.21.15.72:0/3867333345 shutdown_connections 2023-10-03T10:17:58.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.892+0000 7fd61320e700 1 -- 172.21.15.72:0/3867333345 wait complete. 2023-10-03T10:17:58.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.893+0000 7fd61320e700 1 Processor -- start 2023-10-03T10:17:58.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.893+0000 7fd61320e700 1 -- start start 2023-10-03T10:17:58.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd61320e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd60c06a770 0x7fd60c11c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd61320e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd60c06b080 0x7fd60c11ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd61320e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd60c131b40 0x7fd60c11cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:58.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd61320e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c06ed20 con 0x7fd60c131b40 2023-10-03T10:17:58.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd61320e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c071e60 con 0x7fd60c06a770 2023-10-03T10:17:58.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd61320e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c11e1e0 con 0x7fd60c06b080 2023-10-03T10:17:58.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd60bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd60c06b080 0x7fd60c11ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd610faa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd60c06a770 0x7fd60c11c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd610faa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd60c06a770 0x7fd60c11c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:36626/0 (socket says 172.21.15.72:36626) 2023-10-03T10:17:58.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd60bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd60c06b080 0x7fd60c11ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37762/0 (socket says 172.21.15.72:37762) 2023-10-03T10:17:58.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd610faa700 1 -- 172.21.15.72:0/517837342 learned_addr learned my addr 172.21.15.72:0/517837342 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:58.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd6117ab700 1 --2- 172.21.15.72:0/517837342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd60c131b40 0x7fd60c11cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:58.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd610faa700 1 -- 172.21.15.72:0/517837342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd60c06b080 msgr2=0x7fd60c11ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd610faa700 1 --2- 172.21.15.72:0/517837342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd60c06b080 0x7fd60c11ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd610faa700 1 -- 172.21.15.72:0/517837342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd60c131b40 msgr2=0x7fd60c11cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd610faa700 1 --2- 172.21.15.72:0/517837342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd60c131b40 0x7fd60c11cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd610faa700 1 -- 172.21.15.72:0/517837342 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd600009550 con 0x7fd60c06a770 2023-10-03T10:17:58.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd60bfff700 1 --2- 172.21.15.72:0/517837342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd60c06b080 0x7fd60c11ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd6117ab700 1 --2- 172.21.15.72:0/517837342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd60c131b40 0x7fd60c11cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:58.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd610faa700 1 --2- 172.21.15.72:0/517837342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd60c06a770 0x7fd60c11c4e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd60000ebe0 tx=0x7fd60000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:58.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.894+0000 7fd6097fa700 1 -- 172.21.15.72:0/517837342 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60000c850 con 0x7fd60c06a770 2023-10-03T10:17:58.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.895+0000 7fd6097fa700 1 -- 172.21.15.72:0/517837342 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60000c9b0 con 0x7fd60c06a770 2023-10-03T10:17:58.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.895+0000 7fd61320e700 1 -- 172.21.15.72:0/517837342 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f80094a0 con 0x7fd60c06a770 2023-10-03T10:17:58.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.895+0000 7fd6097fa700 1 -- 172.21.15.72:0/517837342 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60000cd40 con 0x7fd60c06a770 2023-10-03T10:17:58.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.895+0000 7fd61320e700 1 -- 172.21.15.72:0/517837342 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c130f00 con 0x7fd60c06a770 2023-10-03T10:17:58.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.895+0000 7fd6097fa700 1 -- 172.21.15.72:0/517837342 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd600013470 con 0x7fd60c06a770 2023-10-03T10:17:58.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.895+0000 7fd6097fa700 1 -- 172.21.15.72:0/517837342 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd60003f860 con 0x7fd60c06a770 2023-10-03T10:17:58.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.896+0000 7fd61320e700 1 -- 172.21.15.72:0/517837342 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60c074ea0 con 0x7fd60c06a770 2023-10-03T10:17:58.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:58.900+0000 7fd6097fa700 1 -- 172.21.15.72:0/517837342 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd600017080 con 0x7fd60c06a770 2023-10-03T10:17:59.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.084+0000 7fd61320e700 1 -- 172.21.15.72:0/517837342 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd60c06c360 con 0x7fd60c06a770 2023-10-03T10:17:59.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.084+0000 7fd6097fa700 1 -- 172.21.15.72:0/517837342 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd600021020 con 0x7fd60c06a770 2023-10-03T10:17:59.085 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:17:59.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.086+0000 7fd61320e700 1 -- 172.21.15.72:0/517837342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd60c06a770 msgr2=0x7fd60c11c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.086+0000 7fd61320e700 1 --2- 172.21.15.72:0/517837342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd60c06a770 0x7fd60c11c4e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd60000ebe0 tx=0x7fd60000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.086+0000 7fd61320e700 1 -- 172.21.15.72:0/517837342 shutdown_connections 2023-10-03T10:17:59.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.086+0000 7fd61320e700 1 --2- 172.21.15.72:0/517837342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd60c131b40 0x7fd60c11cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.086+0000 7fd61320e700 1 --2- 172.21.15.72:0/517837342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd60c06a770 0x7fd60c11c4e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.086+0000 7fd61320e700 1 --2- 172.21.15.72:0/517837342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd60c06b080 0x7fd60c11ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.086+0000 7fd61320e700 1 -- 172.21.15.72:0/517837342 >> 172.21.15.72:0/517837342 conn(0x7fd60c066f50 msgr2=0x7fd60c0700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.086+0000 7fd61320e700 1 -- 172.21.15.72:0/517837342 shutdown_connections 2023-10-03T10:17:59.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.086+0000 7fd61320e700 1 -- 172.21.15.72:0/517837342 wait complete. 2023-10-03T10:17:59.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:17:59.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:59.838 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:59.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:59.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.929+0000 7f4ede3e1700 1 Processor -- start 2023-10-03T10:17:59.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.929+0000 7f4ede3e1700 1 -- start start 2023-10-03T10:17:59.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.929+0000 7f4ede3e1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4ed81337f0 0x7f4ed8138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.929+0000 7f4ede3e1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4ed8138dc0 0x7f4ed813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.929+0000 7f4ede3e1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed806b990 con 0x7f4ed8133420 2023-10-03T10:17:59.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.929+0000 7f4ede3e1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed809b0e0 con 0x7f4ed81337f0 2023-10-03T10:17:59.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.929+0000 7f4ede3e1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8133c20 con 0x7f4ed8138dc0 2023-10-03T10:17:59.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.929+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4ed81337f0 0x7f4ed8138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.929+0000 7f4edc97e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4ed8138dc0 0x7f4ed813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.929+0000 7f4ed77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4ed81337f0 0x7f4ed8138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41052/0 (socket says 172.21.15.72:41052) 2023-10-03T10:17:59.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.929+0000 7f4ed77fe700 1 -- 172.21.15.72:0/448481622 learned_addr learned my addr 172.21.15.72:0/448481622 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:59.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.929+0000 7f4ed7fff700 1 --1- 172.21.15.72:0/448481622 >> v1:172.21.15.72:6789/0 conn(0x7f4ed8133420 0x7f4ed8133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36466/0 (socket says 172.21.15.72:36466) 2023-10-03T10:17:59.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.930+0000 7f4ed77fe700 1 -- 172.21.15.72:0/448481622 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4ed8138dc0 msgr2=0x7f4ed813b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.930+0000 7f4ed77fe700 1 --2- 172.21.15.72:0/448481622 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4ed8138dc0 0x7f4ed813b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.930+0000 7f4ed77fe700 1 -- 172.21.15.72:0/448481622 >> v1:172.21.15.72:6789/0 conn(0x7f4ed8133420 legacy=0x7f4ed8133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.930+0000 7f4ed77fe700 1 -- 172.21.15.72:0/448481622 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed80a0590 con 0x7f4ed81337f0 2023-10-03T10:17:59.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.930+0000 7f4ed6ffd700 1 -- 172.21.15.72:0/448481622 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899006896 0 0) 0x7f4ed806b990 con 0x7f4ed8133420 2023-10-03T10:17:59.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.930+0000 7f4edc97e700 1 --2- 172.21.15.72:0/448481622 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4ed8138dc0 0x7f4ed813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.930+0000 7f4ed77fe700 1 --2- 172.21.15.72:0/448481622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed81337f0 0x7f4ed8138880 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0098f0 tx=0x7f4ecc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b14712fe9e8f80 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.930+0000 7f4ed6ffd700 1 -- 172.21.15.72:0/448481622 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc011830 con 0x7f4ed81337f0 2023-10-03T10:17:59.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.930+0000 7f4ed6ffd700 1 -- 172.21.15.72:0/448481622 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc011990 con 0x7f4ed81337f0 2023-10-03T10:17:59.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.930+0000 7f4ed6ffd700 1 -- 172.21.15.72:0/448481622 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc011d20 con 0x7f4ed81337f0 2023-10-03T10:17:59.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.931+0000 7f4ede3e1700 1 -- 172.21.15.72:0/448481622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed81337f0 msgr2=0x7f4ed8138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.931+0000 7f4ede3e1700 1 --2- 172.21.15.72:0/448481622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed81337f0 0x7f4ed8138880 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0098f0 tx=0x7f4ecc009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:59.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.931+0000 7f4ede3e1700 1 -- 172.21.15.72:0/448481622 shutdown_connections 2023-10-03T10:17:59.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.931+0000 7f4ede3e1700 1 --2- 172.21.15.72:0/448481622 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4ed8138dc0 0x7f4ed813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.931+0000 7f4ede3e1700 1 --2- 172.21.15.72:0/448481622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed81337f0 0x7f4ed8138880 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.931+0000 7f4ede3e1700 1 -- 172.21.15.72:0/448481622 >> 172.21.15.72:0/448481622 conn(0x7f4ed80a4210 msgr2=0x7f4ed80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.931+0000 7f4ede3e1700 1 -- 172.21.15.72:0/448481622 shutdown_connections 2023-10-03T10:17:59.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.931+0000 7f4ede3e1700 1 -- 172.21.15.72:0/448481622 wait complete. 2023-10-03T10:17:59.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.932+0000 7f4ede3e1700 1 Processor -- start 2023-10-03T10:17:59.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.932+0000 7f4ede3e1700 1 -- start start 2023-10-03T10:17:59.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.933+0000 7f4ede3e1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed8133420 0x7f4ed812ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.933+0000 7f4ede3e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ed81337f0 0x7f4ed812f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.933+0000 7f4ede3e1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4ed8138dc0 0x7f4ed812f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.933+0000 7f4ede3e1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed809d9b0 con 0x7f4ed8133420 2023-10-03T10:17:59.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.933+0000 7f4ede3e1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed809e0b0 con 0x7f4ed81337f0 2023-10-03T10:17:59.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.933+0000 7f4ede3e1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed809ceb0 con 0x7f4ed8138dc0 2023-10-03T10:17:59.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.933+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed8133420 0x7f4ed812ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.933+0000 7f4ed7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed8133420 0x7f4ed812ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41066/0 (socket says 172.21.15.72:41066) 2023-10-03T10:17:59.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.933+0000 7f4ed7fff700 1 -- 172.21.15.72:0/3627987236 learned_addr learned my addr 172.21.15.72:0/3627987236 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:59.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.933+0000 7f4edc97e700 1 --2- 172.21.15.72:0/3627987236 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4ed8138dc0 0x7f4ed812f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.934+0000 7f4ed7fff700 1 -- 172.21.15.72:0/3627987236 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4ed8138dc0 msgr2=0x7f4ed812f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.934+0000 7f4ed7fff700 1 --2- 172.21.15.72:0/3627987236 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4ed8138dc0 0x7f4ed812f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.934+0000 7f4ed7fff700 1 -- 172.21.15.72:0/3627987236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ed81337f0 msgr2=0x7f4ed812f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.934+0000 7f4ed7fff700 1 --2- 172.21.15.72:0/3627987236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ed81337f0 0x7f4ed812f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.934+0000 7f4ed7fff700 1 -- 172.21.15.72:0/3627987236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed0009a70 con 0x7f4ed8133420 2023-10-03T10:17:59.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.934+0000 7f4edc97e700 1 --2- 172.21.15.72:0/3627987236 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4ed8138dc0 0x7f4ed812f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.934+0000 7f4ed7fff700 1 --2- 172.21.15.72:0/3627987236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed8133420 0x7f4ed812ee50 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f4ec800c520 tx=0x7f4ec800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.934+0000 7f4ed4ff9700 1 -- 172.21.15.72:0/3627987236 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8004c80 con 0x7f4ed8133420 2023-10-03T10:17:59.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.934+0000 7f4ed4ff9700 1 -- 172.21.15.72:0/3627987236 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec8004e00 con 0x7f4ed8133420 2023-10-03T10:17:59.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.934+0000 7f4ede3e1700 1 -- 172.21.15.72:0/3627987236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ecc009550 con 0x7f4ed8133420 2023-10-03T10:17:59.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.934+0000 7f4ed4ff9700 1 -- 172.21.15.72:0/3627987236 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8007310 con 0x7f4ed8133420 2023-10-03T10:17:59.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.934+0000 7f4ede3e1700 1 -- 172.21.15.72:0/3627987236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed809c830 con 0x7f4ed8133420 2023-10-03T10:17:59.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.935+0000 7f4ed4ff9700 1 -- 172.21.15.72:0/3627987236 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ec8007470 con 0x7f4ed8133420 2023-10-03T10:17:59.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.935+0000 7f4ede3e1700 1 -- 172.21.15.72:0/3627987236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed8074ea0 con 0x7f4ed8133420 2023-10-03T10:17:59.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.935+0000 7f4ed4ff9700 1 -- 172.21.15.72:0/3627987236 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4ec803f3c0 con 0x7f4ed8133420 2023-10-03T10:17:59.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.944+0000 7f4ed4ff9700 1 -- 172.21.15.72:0/3627987236 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ec80123b0 con 0x7f4ed8133420 2023-10-03T10:17:59.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.972+0000 7f8a620dc700 1 Processor -- start 2023-10-03T10:17:59.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.972+0000 7f8a620dc700 1 -- start start 2023-10-03T10:17:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.972+0000 7f8a620dc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a5c06a770 0x7f8a5c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.972+0000 7f8a620dc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a5c06b080 0x7f8a5c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.972+0000 7f8a620dc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5c09ece0 con 0x7f8a5c131b40 2023-10-03T10:17:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.972+0000 7f8a620dc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a5c09e760 con 0x7f8a5c06a770 2023-10-03T10:17:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.972+0000 7f8a620dc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c09e040 con 0x7f8a5c06b080 2023-10-03T10:17:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.972+0000 7f8a5b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a5c06a770 0x7f8a5c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.972+0000 7f8a5b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a5c06a770 0x7f8a5c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41080/0 (socket says 172.21.15.72:41080) 2023-10-03T10:17:59.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.972+0000 7f8a5b7fe700 1 -- 172.21.15.72:0/1624311103 learned_addr learned my addr 172.21.15.72:0/1624311103 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.972+0000 7f8a5bfff700 1 --1- 172.21.15.72:0/1624311103 >> v1:172.21.15.72:6789/0 conn(0x7f8a5c131b40 0x7f8a5c138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36472/0 (socket says 172.21.15.72:36472) 2023-10-03T10:17:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.972+0000 7f8a5affd700 1 --2- 172.21.15.72:0/1624311103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a5c06b080 0x7f8a5c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.973+0000 7f8a5a7fc700 1 -- 172.21.15.72:0/1624311103 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413332261 0 0) 0x7f8a5c09ece0 con 0x7f8a5c131b40 2023-10-03T10:17:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.973+0000 7f8a5affd700 1 -- 172.21.15.72:0/1624311103 >> v2:172.21.15.72:3300/0 conn(0x7f8a5c06a770 msgr2=0x7f8a5c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.973+0000 7f8a5affd700 1 --2- 172.21.15.72:0/1624311103 >> v2:172.21.15.72:3300/0 conn(0x7f8a5c06a770 0x7f8a5c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.973+0000 7f8a5affd700 1 -- 172.21.15.72:0/1624311103 >> v1:172.21.15.72:6789/0 conn(0x7f8a5c131b40 legacy=0x7f8a5c138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.973+0000 7f8a5affd700 1 -- 172.21.15.72:0/1624311103 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c09f630 con 0x7f8a5c06b080 2023-10-03T10:17:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.973+0000 7f8a5affd700 1 --2- 172.21.15.72:0/1624311103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a5c06b080 0x7f8a5c131600 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009840 tx=0x7f8a50009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=122ab9fb1d8587d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.973+0000 7f8a5a7fc700 1 -- 172.21.15.72:0/1624311103 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a50011830 con 0x7f8a5c06b080 2023-10-03T10:17:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.973+0000 7f8a5a7fc700 1 -- 172.21.15.72:0/1624311103 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a50011990 con 0x7f8a5c06b080 2023-10-03T10:17:59.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.973+0000 7f8a5a7fc700 1 -- 172.21.15.72:0/1624311103 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a50011d20 con 0x7f8a5c06b080 2023-10-03T10:17:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.974+0000 7f8a620dc700 1 -- 172.21.15.72:0/1624311103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a5c06b080 msgr2=0x7f8a5c131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.974+0000 7f8a620dc700 1 --2- 172.21.15.72:0/1624311103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a5c06b080 0x7f8a5c131600 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009840 tx=0x7f8a50009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.974+0000 7f8a620dc700 1 -- 172.21.15.72:0/1624311103 shutdown_connections 2023-10-03T10:17:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.974+0000 7f8a620dc700 1 --2- 172.21.15.72:0/1624311103 >> v2:172.21.15.72:3300/0 conn(0x7f8a5c06a770 0x7f8a5c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.974+0000 7f8a620dc700 1 --2- 172.21.15.72:0/1624311103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a5c06b080 0x7f8a5c131600 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.974+0000 7f8a620dc700 1 -- 172.21.15.72:0/1624311103 >> 172.21.15.72:0/1624311103 conn(0x7f8a5c066f50 msgr2=0x7f8a5c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.974+0000 7f8a620dc700 1 -- 172.21.15.72:0/1624311103 shutdown_connections 2023-10-03T10:17:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.974+0000 7f8a620dc700 1 -- 172.21.15.72:0/1624311103 wait complete. 2023-10-03T10:17:59.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.975+0000 7f8a620dc700 1 Processor -- start 2023-10-03T10:17:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.975+0000 7f8a620dc700 1 -- start start 2023-10-03T10:17:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.975+0000 7f8a620dc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a5c06a770 0x7f8a5c1c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.975+0000 7f8a620dc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a5c06b080 0x7f8a5c1c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.975+0000 7f8a620dc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5c131b40 0x7f8a5c1c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.975+0000 7f8a620dc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c1221a0 con 0x7f8a5c131b40 2023-10-03T10:17:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.975+0000 7f8a620dc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c071ed0 con 0x7f8a5c06b080 2023-10-03T10:17:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.975+0000 7f8a620dc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c131190 con 0x7f8a5c06a770 2023-10-03T10:17:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a5affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a5c06b080 0x7f8a5c1c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a5b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a5c06a770 0x7f8a5c1c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a5affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a5c06b080 0x7f8a5c1c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:36656/0 (socket says 172.21.15.72:36656) 2023-10-03T10:17:59.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a5b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a5c06a770 0x7f8a5c1c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37790/0 (socket says 172.21.15.72:37790) 2023-10-03T10:17:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a5affd700 1 -- 172.21.15.72:0/1227672341 learned_addr learned my addr 172.21.15.72:0/1227672341 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:17:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a5bfff700 1 --2- 172.21.15.72:0/1227672341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5c131b40 0x7f8a5c1c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a5b7fe700 1 -- 172.21.15.72:0/1227672341 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a5c06b080 msgr2=0x7f8a5c1c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a5b7fe700 1 --2- 172.21.15.72:0/1227672341 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a5c06b080 0x7f8a5c1c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a5b7fe700 1 -- 172.21.15.72:0/1227672341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5c131b40 msgr2=0x7f8a5c1c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a5b7fe700 1 --2- 172.21.15.72:0/1227672341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5c131b40 0x7f8a5c1c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a5b7fe700 1 -- 172.21.15.72:0/1227672341 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a500094a0 con 0x7f8a5c06a770 2023-10-03T10:17:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a5affd700 1 --2- 172.21.15.72:0/1227672341 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a5c06b080 0x7f8a5c1c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a5b7fe700 1 --2- 172.21.15.72:0/1227672341 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a5c06a770 0x7f8a5c1c5dc0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00e910 tx=0x7f8a4c00ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a43fff700 1 -- 172.21.15.72:0/1227672341 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c013680 con 0x7f8a5c06a770 2023-10-03T10:17:59.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a43fff700 1 -- 172.21.15.72:0/1227672341 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c0137e0 con 0x7f8a5c06a770 2023-10-03T10:17:59.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a620dc700 1 -- 172.21.15.72:0/1227672341 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5c123b10 con 0x7f8a5c06a770 2023-10-03T10:17:59.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a43fff700 1 -- 172.21.15.72:0/1227672341 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c013b70 con 0x7f8a5c06a770 2023-10-03T10:17:59.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.976+0000 7f8a620dc700 1 -- 172.21.15.72:0/1227672341 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5c131550 con 0x7f8a5c06a770 2023-10-03T10:17:59.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.978+0000 7f8a620dc700 1 -- 172.21.15.72:0/1227672341 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a5c074ea0 con 0x7f8a5c06a770 2023-10-03T10:17:59.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.978+0000 7f8a43fff700 1 -- 172.21.15.72:0/1227672341 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a4c013cd0 con 0x7f8a5c06a770 2023-10-03T10:17:59.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.978+0000 7f8a43fff700 1 -- 172.21.15.72:0/1227672341 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8a4c03fae0 con 0x7f8a5c06a770 2023-10-03T10:17:59.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:17:59.982+0000 7f8a43fff700 1 -- 172.21.15.72:0/1227672341 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a4c011db0 con 0x7f8a5c06a770 2023-10-03T10:18:00.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.010+0000 7f21ebf95700 1 Processor -- start 2023-10-03T10:18:00.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.010+0000 7f21ebf95700 1 -- start start 2023-10-03T10:18:00.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.011+0000 7f21ebf95700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21e409d630 0x7f21e40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.011+0000 7f21ebf95700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e4138d80 0x7f21e413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.011+0000 7f21ebf95700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e40a2a70 con 0x7f21e40a0a30 2023-10-03T10:18:00.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.011+0000 7f21ebf95700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40a01d0 con 0x7f21e4138d80 2023-10-03T10:18:00.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.011+0000 7f21ebf95700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21e409e2b0 con 0x7f21e409d630 2023-10-03T10:18:00.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.011+0000 7f21e9530700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21e409d630 0x7f21e40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.011+0000 7f21e9530700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21e409d630 0x7f21e40a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37802/0 (socket says 172.21.15.72:37802) 2023-10-03T10:18:00.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.011+0000 7f21e9530700 1 -- 172.21.15.72:0/1176713984 learned_addr learned my addr 172.21.15.72:0/1176713984 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:00.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.011+0000 7f21e9d31700 1 --1- 172.21.15.72:0/1176713984 >> v1:172.21.15.72:6789/0 conn(0x7f21e40a0a30 0x7f21e40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36482/0 (socket says 172.21.15.72:36482) 2023-10-03T10:18:00.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.011+0000 7f21ea532700 1 --2- 172.21.15.72:0/1176713984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e4138d80 0x7f21e413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.011+0000 7f21e9530700 1 -- 172.21.15.72:0/1176713984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e4138d80 msgr2=0x7f21e413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.011+0000 7f21e9530700 1 --2- 172.21.15.72:0/1176713984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e4138d80 0x7f21e413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.011+0000 7f21e8d2f700 1 -- 172.21.15.72:0/1176713984 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252464936 0 0) 0x7f21e40a2a70 con 0x7f21e40a0a30 2023-10-03T10:18:00.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.011+0000 7f21e9530700 1 -- 172.21.15.72:0/1176713984 >> v1:172.21.15.72:6789/0 conn(0x7f21e40a0a30 legacy=0x7f21e40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.011+0000 7f21e9530700 1 -- 172.21.15.72:0/1176713984 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e409dc50 con 0x7f21e409d630 2023-10-03T10:18:00.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.012+0000 7f21e9530700 1 --2- 172.21.15.72:0/1176713984 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21e409d630 0x7f21e40a1510 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009920 tx=0x7f21d4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=756c68e06b02f316 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.012+0000 7f21e8d2f700 1 -- 172.21.15.72:0/1176713984 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4011830 con 0x7f21e409d630 2023-10-03T10:18:00.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.012+0000 7f21e8d2f700 1 -- 172.21.15.72:0/1176713984 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d4011990 con 0x7f21e409d630 2023-10-03T10:18:00.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.012+0000 7f21e8d2f700 1 -- 172.21.15.72:0/1176713984 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4011d20 con 0x7f21e409d630 2023-10-03T10:18:00.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.012+0000 7f21ebf95700 1 -- 172.21.15.72:0/1176713984 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21e409d630 msgr2=0x7f21e40a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.012+0000 7f21ebf95700 1 --2- 172.21.15.72:0/1176713984 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21e409d630 0x7f21e40a1510 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009920 tx=0x7f21d4009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:00.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.012+0000 7f21ebf95700 1 -- 172.21.15.72:0/1176713984 shutdown_connections 2023-10-03T10:18:00.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.012+0000 7f21ebf95700 1 --2- 172.21.15.72:0/1176713984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e4138d80 0x7f21e413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.012+0000 7f21ebf95700 1 --2- 172.21.15.72:0/1176713984 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21e409d630 0x7f21e40a1510 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.012+0000 7f21ebf95700 1 -- 172.21.15.72:0/1176713984 >> 172.21.15.72:0/1176713984 conn(0x7f21e40a3050 msgr2=0x7f21e40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.012+0000 7f21ebf95700 1 -- 172.21.15.72:0/1176713984 shutdown_connections 2023-10-03T10:18:00.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.013+0000 7f21ebf95700 1 -- 172.21.15.72:0/1176713984 wait complete. 2023-10-03T10:18:00.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.014+0000 7f21ebf95700 1 Processor -- start 2023-10-03T10:18:00.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.014+0000 7f21ebf95700 1 -- start start 2023-10-03T10:18:00.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.014+0000 7f21ebf95700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21e409d630 0x7f21e41339c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.014+0000 7f21ebf95700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e40a0a30 0x7f21e4133f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.014+0000 7f21ebf95700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21e4138d80 0x7f21e4134440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.014+0000 7f21ebf95700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e4136e10 con 0x7f21e4138d80 2023-10-03T10:18:00.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.014+0000 7f21ebf95700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e4136b40 con 0x7f21e40a0a30 2023-10-03T10:18:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.014+0000 7f21ebf95700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40a4c30 con 0x7f21e409d630 2023-10-03T10:18:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.014+0000 7f21e9d31700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21e409d630 0x7f21e41339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.014+0000 7f21ea532700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21e4138d80 0x7f21e4134440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.014+0000 7f21e9530700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e40a0a30 0x7f21e4133f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21e9d31700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21e409d630 0x7f21e41339c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37804/0 (socket says 172.21.15.72:37804) 2023-10-03T10:18:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21e9d31700 1 -- 172.21.15.72:0/1752585691 learned_addr learned my addr 172.21.15.72:0/1752585691 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21ea532700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21e4138d80 0x7f21e4134440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41100/0 (socket says 172.21.15.72:41100) 2023-10-03T10:18:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21e9530700 1 -- 172.21.15.72:0/1752585691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21e409d630 msgr2=0x7f21e41339c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21e9530700 1 --2- 172.21.15.72:0/1752585691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21e409d630 0x7f21e41339c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21e9530700 1 -- 172.21.15.72:0/1752585691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21e4138d80 msgr2=0x7f21e4134440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21e9530700 1 --2- 172.21.15.72:0/1752585691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21e4138d80 0x7f21e4134440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21e9530700 1 -- 172.21.15.72:0/1752585691 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d4009550 con 0x7f21e40a0a30 2023-10-03T10:18:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21e9d31700 1 --2- 172.21.15.72:0/1752585691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21e409d630 0x7f21e41339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21ea532700 1 --2- 172.21.15.72:0/1752585691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21e4138d80 0x7f21e4134440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21e9530700 1 --2- 172.21.15.72:0/1752585691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e40a0a30 0x7f21e4133f00 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f21d4016000 tx=0x7f21d4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21da7fc700 1 -- 172.21.15.72:0/1752585691 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4004450 con 0x7f21e40a0a30 2023-10-03T10:18:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21da7fc700 1 -- 172.21.15.72:0/1752585691 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d40045d0 con 0x7f21e40a0a30 2023-10-03T10:18:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21ebf95700 1 -- 172.21.15.72:0/1752585691 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e40a0410 con 0x7f21e40a0a30 2023-10-03T10:18:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21da7fc700 1 -- 172.21.15.72:0/1752585691 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d40038e0 con 0x7f21e40a0a30 2023-10-03T10:18:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.015+0000 7f21ebf95700 1 -- 172.21.15.72:0/1752585691 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e4137b40 con 0x7f21e40a0a30 2023-10-03T10:18:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.016+0000 7f21da7fc700 1 -- 172.21.15.72:0/1752585691 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21d4003a40 con 0x7f21e40a0a30 2023-10-03T10:18:00.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.016+0000 7f21ebf95700 1 -- 172.21.15.72:0/1752585691 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e40747f0 con 0x7f21e40a0a30 2023-10-03T10:18:00.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.016+0000 7f21da7fc700 1 -- 172.21.15.72:0/1752585691 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f21d4021030 con 0x7f21e40a0a30 2023-10-03T10:18:00.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.021+0000 7f21da7fc700 1 -- 172.21.15.72:0/1752585691 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21d401a430 con 0x7f21e40a0a30 2023-10-03T10:18:00.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:00.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.144+0000 7f4ede3e1700 1 -- 172.21.15.72:0/3627987236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4ed806b250 con 0x7f4ed8133420 2023-10-03T10:18:00.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.144+0000 7f4ed4ff9700 1 -- 172.21.15.72:0/3627987236 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4ec8011360 con 0x7f4ed8133420 2023-10-03T10:18:00.145 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:00.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.147+0000 7f4ede3e1700 1 -- 172.21.15.72:0/3627987236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed8133420 msgr2=0x7f4ed812ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.147+0000 7f4ede3e1700 1 --2- 172.21.15.72:0/3627987236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed8133420 0x7f4ed812ee50 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f4ec800c520 tx=0x7f4ec800c8e0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.147+0000 7f4ede3e1700 1 -- 172.21.15.72:0/3627987236 shutdown_connections 2023-10-03T10:18:00.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.147+0000 7f4ede3e1700 1 --2- 172.21.15.72:0/3627987236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed8133420 0x7f4ed812ee50 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.147+0000 7f4ede3e1700 1 --2- 172.21.15.72:0/3627987236 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4ed8138dc0 0x7f4ed812f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.147+0000 7f4ede3e1700 1 --2- 172.21.15.72:0/3627987236 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ed81337f0 0x7f4ed812f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.147+0000 7f4ede3e1700 1 -- 172.21.15.72:0/3627987236 >> 172.21.15.72:0/3627987236 conn(0x7f4ed80a4210 msgr2=0x7f4ed80a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.147+0000 7f4ede3e1700 1 -- 172.21.15.72:0/3627987236 shutdown_connections 2023-10-03T10:18:00.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.147+0000 7f4ede3e1700 1 -- 172.21.15.72:0/3627987236 wait complete. 2023-10-03T10:18:00.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.192+0000 7f8a620dc700 1 -- 172.21.15.72:0/1227672341 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8a5c06c360 con 0x7f8a5c06a770 2023-10-03T10:18:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.193+0000 7f8a43fff700 1 -- 172.21.15.72:0/1227672341 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a4c021020 con 0x7f8a5c06a770 2023-10-03T10:18:00.193 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.195+0000 7f8a620dc700 1 -- 172.21.15.72:0/1227672341 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a5c06a770 msgr2=0x7f8a5c1c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.195+0000 7f8a620dc700 1 --2- 172.21.15.72:0/1227672341 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a5c06a770 0x7f8a5c1c5dc0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00e910 tx=0x7f8a4c00ec20 comp rx=0 tx=0).stop 2023-10-03T10:18:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.195+0000 7f8a620dc700 1 -- 172.21.15.72:0/1227672341 shutdown_connections 2023-10-03T10:18:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.195+0000 7f8a620dc700 1 --2- 172.21.15.72:0/1227672341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5c131b40 0x7f8a5c1c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.195+0000 7f8a620dc700 1 --2- 172.21.15.72:0/1227672341 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a5c06a770 0x7f8a5c1c5dc0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.195+0000 7f8a620dc700 1 --2- 172.21.15.72:0/1227672341 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a5c06b080 0x7f8a5c1c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.195+0000 7f8a620dc700 1 -- 172.21.15.72:0/1227672341 >> 172.21.15.72:0/1227672341 conn(0x7f8a5c066f50 msgr2=0x7f8a5c06ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.195+0000 7f8a620dc700 1 -- 172.21.15.72:0/1227672341 shutdown_connections 2023-10-03T10:18:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.195+0000 7f8a620dc700 1 -- 172.21.15.72:0/1227672341 wait complete. 2023-10-03T10:18:00.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:00.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.218+0000 7f21ebf95700 1 -- 172.21.15.72:0/1752585691 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f21e4072980 con 0x7f21e40a0a30 2023-10-03T10:18:00.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.219+0000 7f21da7fc700 1 -- 172.21.15.72:0/1752585691 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f21d402b070 con 0x7f21e40a0a30 2023-10-03T10:18:00.219 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:00.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.221+0000 7f21ebf95700 1 -- 172.21.15.72:0/1752585691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e40a0a30 msgr2=0x7f21e4133f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.221+0000 7f21ebf95700 1 --2- 172.21.15.72:0/1752585691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e40a0a30 0x7f21e4133f00 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f21d4016000 tx=0x7f21d4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:00.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.221+0000 7f21ebf95700 1 -- 172.21.15.72:0/1752585691 shutdown_connections 2023-10-03T10:18:00.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.221+0000 7f21ebf95700 1 --2- 172.21.15.72:0/1752585691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21e4138d80 0x7f21e4134440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.221+0000 7f21ebf95700 1 --2- 172.21.15.72:0/1752585691 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f21e409d630 0x7f21e41339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.221+0000 7f21ebf95700 1 --2- 172.21.15.72:0/1752585691 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e40a0a30 0x7f21e4133f00 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.221+0000 7f21ebf95700 1 -- 172.21.15.72:0/1752585691 >> 172.21.15.72:0/1752585691 conn(0x7f21e40a3050 msgr2=0x7f21e409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.221+0000 7f21ebf95700 1 -- 172.21.15.72:0/1752585691 shutdown_connections 2023-10-03T10:18:00.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.221+0000 7f21ebf95700 1 -- 172.21.15.72:0/1752585691 wait complete. 2023-10-03T10:18:00.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.228+0000 7f84bb37f700 1 Processor -- start 2023-10-03T10:18:00.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.228+0000 7f84bb37f700 1 -- start start 2023-10-03T10:18:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.228+0000 7f84bb37f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84b409e1d0 0x7f84b4135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.228+0000 7f84bb37f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84b4135e50 0x7f84b4138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.228+0000 7f84bb37f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b409f130 con 0x7f84b409d6f0 2023-10-03T10:18:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84bb37f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b409f520 con 0x7f84b4135e50 2023-10-03T10:18:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84bb37f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84b409e930 con 0x7f84b409e1d0 2023-10-03T10:18:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84b891a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84b409e1d0 0x7f84b4135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84b911b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f84b409d6f0 0x7f84b409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36496/0 (socket says 172.21.15.72:36496) 2023-10-03T10:18:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84b911b700 1 -- 172.21.15.72:0/3034464969 learned_addr learned my addr 172.21.15.72:0/3034464969 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84b991c700 1 --2- 172.21.15.72:0/3034464969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84b4135e50 0x7f84b4138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84abfff700 1 -- 172.21.15.72:0/3034464969 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560311693 0 0) 0x7f84b409f130 con 0x7f84b409d6f0 2023-10-03T10:18:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84abfff700 1 -- 172.21.15.72:0/3034464969 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84a00035b0 con 0x7f84b409d6f0 2023-10-03T10:18:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84b991c700 1 -- 172.21.15.72:0/3034464969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84b409e1d0 msgr2=0x7f84b4135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84b991c700 1 --2- 172.21.15.72:0/3034464969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84b409e1d0 0x7f84b4135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84b991c700 1 -- 172.21.15.72:0/3034464969 >> v1:172.21.15.72:6789/0 conn(0x7f84b409d6f0 legacy=0x7f84b409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84b991c700 1 -- 172.21.15.72:0/3034464969 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b409b2d0 con 0x7f84b4135e50 2023-10-03T10:18:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84b891a700 1 --2- 172.21.15.72:0/3034464969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84b409e1d0 0x7f84b4135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84b991c700 1 --2- 172.21.15.72:0/3034464969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84b4135e50 0x7f84b4138230 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009dc0 tx=0x7f84ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d680ccf56a204bfb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84abfff700 1 -- 172.21.15.72:0/3034464969 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac00e070 con 0x7f84b4135e50 2023-10-03T10:18:00.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84abfff700 1 -- 172.21.15.72:0/3034464969 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac00bb20 con 0x7f84b4135e50 2023-10-03T10:18:00.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.229+0000 7f84abfff700 1 -- 172.21.15.72:0/3034464969 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac012430 con 0x7f84b4135e50 2023-10-03T10:18:00.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.230+0000 7f84bb37f700 1 -- 172.21.15.72:0/3034464969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84b4135e50 msgr2=0x7f84b4138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.230+0000 7f84bb37f700 1 --2- 172.21.15.72:0/3034464969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84b4135e50 0x7f84b4138230 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009dc0 tx=0x7f84ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:00.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.230+0000 7f84bb37f700 1 -- 172.21.15.72:0/3034464969 shutdown_connections 2023-10-03T10:18:00.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.230+0000 7f84bb37f700 1 --2- 172.21.15.72:0/3034464969 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84b4135e50 0x7f84b4138230 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.230+0000 7f84bb37f700 1 --2- 172.21.15.72:0/3034464969 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84b409e1d0 0x7f84b4135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.230+0000 7f84bb37f700 1 -- 172.21.15.72:0/3034464969 >> 172.21.15.72:0/3034464969 conn(0x7f84b4066f50 msgr2=0x7f84b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.230+0000 7f84bb37f700 1 -- 172.21.15.72:0/3034464969 shutdown_connections 2023-10-03T10:18:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.230+0000 7f84bb37f700 1 -- 172.21.15.72:0/3034464969 wait complete. 2023-10-03T10:18:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.231+0000 7f84bb37f700 1 Processor -- start 2023-10-03T10:18:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.231+0000 7f84bb37f700 1 -- start start 2023-10-03T10:18:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84bb37f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84b409d6f0 0x7f84b411d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84bb37f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84b409e1d0 0x7f84b411d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84bb37f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84b4135e50 0x7f84b411de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84bb37f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b41209a0 con 0x7f84b4135e50 2023-10-03T10:18:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84bb37f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b411f060 con 0x7f84b409d6f0 2023-10-03T10:18:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84bb37f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84b4120bf0 con 0x7f84b409e1d0 2023-10-03T10:18:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84b911b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84b409d6f0 0x7f84b411d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84b891a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84b409e1d0 0x7f84b411d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84b911b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84b409d6f0 0x7f84b411d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:36706/0 (socket says 172.21.15.72:36706) 2023-10-03T10:18:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84b911b700 1 -- 172.21.15.72:0/3740430526 learned_addr learned my addr 172.21.15.72:0/3740430526 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84b991c700 1 --2- 172.21.15.72:0/3740430526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84b4135e50 0x7f84b411de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84b911b700 1 -- 172.21.15.72:0/3740430526 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84b409e1d0 msgr2=0x7f84b411d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84b911b700 1 --2- 172.21.15.72:0/3740430526 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84b409e1d0 0x7f84b411d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84b911b700 1 -- 172.21.15.72:0/3740430526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84b4135e50 msgr2=0x7f84b411de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84b911b700 1 --2- 172.21.15.72:0/3740430526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84b4135e50 0x7f84b411de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84b911b700 1 -- 172.21.15.72:0/3740430526 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a40094a0 con 0x7f84b409d6f0 2023-10-03T10:18:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84b991c700 1 --2- 172.21.15.72:0/3740430526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84b4135e50 0x7f84b411de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84b911b700 1 --2- 172.21.15.72:0/3740430526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84b409d6f0 0x7f84b411d3b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f84b0001eb0 tx=0x7f84b000c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84a9ffb700 1 -- 172.21.15.72:0/3740430526 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0005d70 con 0x7f84b409d6f0 2023-10-03T10:18:00.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84a9ffb700 1 -- 172.21.15.72:0/3740430526 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b00070d0 con 0x7f84b409d6f0 2023-10-03T10:18:00.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84a9ffb700 1 -- 172.21.15.72:0/3740430526 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0007460 con 0x7f84b409d6f0 2023-10-03T10:18:00.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.232+0000 7f84bb37f700 1 -- 172.21.15.72:0/3740430526 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ac009a70 con 0x7f84b409d6f0 2023-10-03T10:18:00.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.233+0000 7f84bb37f700 1 -- 172.21.15.72:0/3740430526 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b411f7b0 con 0x7f84b409d6f0 2023-10-03T10:18:00.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.233+0000 7f84a9ffb700 1 -- 172.21.15.72:0/3740430526 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84b00075c0 con 0x7f84b409d6f0 2023-10-03T10:18:00.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.233+0000 7f84a9ffb700 1 -- 172.21.15.72:0/3740430526 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f84b003eb70 con 0x7f84b409d6f0 2023-10-03T10:18:00.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:00.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.234+0000 7f84bb37f700 1 -- 172.21.15.72:0/3740430526 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b4074ea0 con 0x7f84b409d6f0 2023-10-03T10:18:00.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.238+0000 7f84a9ffb700 1 -- 172.21.15.72:0/3740430526 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84b0017070 con 0x7f84b409d6f0 2023-10-03T10:18:00.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.420+0000 7f84bb37f700 1 -- 172.21.15.72:0/3740430526 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f84b406c360 con 0x7f84b409d6f0 2023-10-03T10:18:00.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.421+0000 7f84a9ffb700 1 -- 172.21.15.72:0/3740430526 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84b000f260 con 0x7f84b409d6f0 2023-10-03T10:18:00.422 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:00.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.423+0000 7f84bb37f700 1 -- 172.21.15.72:0/3740430526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84b409d6f0 msgr2=0x7f84b411d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.423+0000 7f84bb37f700 1 --2- 172.21.15.72:0/3740430526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84b409d6f0 0x7f84b411d3b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f84b0001eb0 tx=0x7f84b000c7b0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.423+0000 7f84bb37f700 1 -- 172.21.15.72:0/3740430526 shutdown_connections 2023-10-03T10:18:00.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.423+0000 7f84bb37f700 1 --2- 172.21.15.72:0/3740430526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84b4135e50 0x7f84b411de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.423+0000 7f84bb37f700 1 --2- 172.21.15.72:0/3740430526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84b409d6f0 0x7f84b411d3b0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.423+0000 7f84bb37f700 1 --2- 172.21.15.72:0/3740430526 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84b409e1d0 0x7f84b411d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.423+0000 7f84bb37f700 1 -- 172.21.15.72:0/3740430526 >> 172.21.15.72:0/3740430526 conn(0x7f84b4066f50 msgr2=0x7f84b4071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.423+0000 7f84bb37f700 1 -- 172.21.15.72:0/3740430526 shutdown_connections 2023-10-03T10:18:00.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:00.423+0000 7f84bb37f700 1 -- 172.21.15.72:0/3740430526 wait complete. 2023-10-03T10:18:00.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:01.165 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:01.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:01.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:01.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.304+0000 7fbdf703e700 1 Processor -- start 2023-10-03T10:18:01.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.304+0000 7fbdf703e700 1 -- start start 2023-10-03T10:18:01.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.305+0000 7fbdf703e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbdf009d6f0 0x7fbdf009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.305+0000 7fbdf703e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdf009e000 0x7fbdf0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.305+0000 7fbdf703e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf009f130 con 0x7fbdf009e410 2023-10-03T10:18:01.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.305+0000 7fbdf703e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf009f520 con 0x7fbdf009d6f0 2023-10-03T10:18:01.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.305+0000 7fbdf703e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf009e930 con 0x7fbdf009e000 2023-10-03T10:18:01.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.305+0000 7fbdf4dda700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbdf009d6f0 0x7fbdf009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.305+0000 7fbdf4dda700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbdf009d6f0 0x7fbdf009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41124/0 (socket says 172.21.15.72:41124) 2023-10-03T10:18:01.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.305+0000 7fbdf4dda700 1 -- 172.21.15.72:0/2988276826 learned_addr learned my addr 172.21.15.72:0/2988276826 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:01.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.305+0000 7fbdeffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdf009e000 0x7fbdf0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.305+0000 7fbdeffff700 1 -- 172.21.15.72:0/2988276826 >> v2:172.21.15.72:3300/0 conn(0x7fbdf009d6f0 msgr2=0x7fbdf009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:01.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.305+0000 7fbdeffff700 1 --2- 172.21.15.72:0/2988276826 >> v2:172.21.15.72:3300/0 conn(0x7fbdf009d6f0 0x7fbdf009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.305+0000 7fbdeffff700 1 -- 172.21.15.72:0/2988276826 >> v1:172.21.15.72:6789/0 conn(0x7fbdf009e410 legacy=0x7fbdf0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.305+0000 7fbdef7fe700 1 -- 172.21.15.72:0/2988276826 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237738905 0 0) 0x7fbdf009f130 con 0x7fbdf009e410 2023-10-03T10:18:01.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.305+0000 7fbdeffff700 1 -- 172.21.15.72:0/2988276826 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf009b2d0 con 0x7fbdf009e000 2023-10-03T10:18:01.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.305+0000 7fbdf4dda700 1 --2- 172.21.15.72:0/2988276826 >> v2:172.21.15.72:3300/0 conn(0x7fbdf009d6f0 0x7fbdf009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.306+0000 7fbdeffff700 1 --2- 172.21.15.72:0/2988276826 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdf009e000 0x7fbdf0130660 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009840 tx=0x7fbddc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5156badae4d9f2d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:01.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.306+0000 7fbdef7fe700 1 -- 172.21.15.72:0/2988276826 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc011830 con 0x7fbdf009e000 2023-10-03T10:18:01.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.306+0000 7fbdef7fe700 1 -- 172.21.15.72:0/2988276826 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc011990 con 0x7fbdf009e000 2023-10-03T10:18:01.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.306+0000 7fbdef7fe700 1 -- 172.21.15.72:0/2988276826 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc011d20 con 0x7fbdf009e000 2023-10-03T10:18:01.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.307+0000 7fbdf703e700 1 -- 172.21.15.72:0/2988276826 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdf009e000 msgr2=0x7fbdf0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.307+0000 7fbdf703e700 1 --2- 172.21.15.72:0/2988276826 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdf009e000 0x7fbdf0130660 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009840 tx=0x7fbddc009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:01.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.307+0000 7fbdf703e700 1 -- 172.21.15.72:0/2988276826 shutdown_connections 2023-10-03T10:18:01.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.307+0000 7fbdf703e700 1 --2- 172.21.15.72:0/2988276826 >> v2:172.21.15.72:3300/0 conn(0x7fbdf009d6f0 0x7fbdf009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.307+0000 7fbdf703e700 1 --2- 172.21.15.72:0/2988276826 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdf009e000 0x7fbdf0130660 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.307+0000 7fbdf703e700 1 -- 172.21.15.72:0/2988276826 >> 172.21.15.72:0/2988276826 conn(0x7fbdf0066f50 msgr2=0x7fbdf009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.307+0000 7fbdf703e700 1 -- 172.21.15.72:0/2988276826 shutdown_connections 2023-10-03T10:18:01.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.307+0000 7fbdf703e700 1 -- 172.21.15.72:0/2988276826 wait complete. 2023-10-03T10:18:01.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.308+0000 7fbdf703e700 1 Processor -- start 2023-10-03T10:18:01.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.308+0000 7fbdf703e700 1 -- start start 2023-10-03T10:18:01.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.308+0000 7fbdf703e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdf009d6f0 0x7fbdf0130bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.308+0000 7fbdf703e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdf009e000 0x7fbdf0136760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.308+0000 7fbdf703e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdf009e410 0x7fbdf0136ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.308+0000 7fbdf703e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf013a080 con 0x7fbdf009e410 2023-10-03T10:18:01.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.308+0000 7fbdf703e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf0131100 con 0x7fbdf009e000 2023-10-03T10:18:01.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.308+0000 7fbdf703e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf013a280 con 0x7fbdf009d6f0 2023-10-03T10:18:01.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.308+0000 7fbdf55db700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdf009e410 0x7fbdf0136ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.308+0000 7fbdf55db700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdf009e410 0x7fbdf0136ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41128/0 (socket says 172.21.15.72:41128) 2023-10-03T10:18:01.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.308+0000 7fbdf55db700 1 -- 172.21.15.72:0/3925591725 learned_addr learned my addr 172.21.15.72:0/3925591725 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:01.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.308+0000 7fbdf4dda700 1 --2- 172.21.15.72:0/3925591725 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdf009d6f0 0x7fbdf0130bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.309+0000 7fbdf4dda700 1 -- 172.21.15.72:0/3925591725 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdf009e000 msgr2=0x7fbdf0136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.309+0000 7fbdf4dda700 1 --2- 172.21.15.72:0/3925591725 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdf009e000 0x7fbdf0136760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.309+0000 7fbdf4dda700 1 -- 172.21.15.72:0/3925591725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdf009e410 msgr2=0x7fbdf0136ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.309+0000 7fbdf4dda700 1 --2- 172.21.15.72:0/3925591725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdf009e410 0x7fbdf0136ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.309+0000 7fbdf4dda700 1 -- 172.21.15.72:0/3925591725 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde4009550 con 0x7fbdf009d6f0 2023-10-03T10:18:01.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.309+0000 7fbdf55db700 1 --2- 172.21.15.72:0/3925591725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdf009e410 0x7fbdf0136ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.309+0000 7fbdf4dda700 1 --2- 172.21.15.72:0/3925591725 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdf009d6f0 0x7fbdf0130bc0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fbde400e9d0 tx=0x7fbde400ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:01.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.309+0000 7fbded7fa700 1 -- 172.21.15.72:0/3925591725 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4004030 con 0x7fbdf009d6f0 2023-10-03T10:18:01.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.309+0000 7fbded7fa700 1 -- 172.21.15.72:0/3925591725 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde4004190 con 0x7fbdf009d6f0 2023-10-03T10:18:01.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.309+0000 7fbdf703e700 1 -- 172.21.15.72:0/3925591725 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbddc0094a0 con 0x7fbdf009d6f0 2023-10-03T10:18:01.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.309+0000 7fbded7fa700 1 -- 172.21.15.72:0/3925591725 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4004520 con 0x7fbdf009d6f0 2023-10-03T10:18:01.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.309+0000 7fbdf703e700 1 -- 172.21.15.72:0/3925591725 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf009c700 con 0x7fbdf009d6f0 2023-10-03T10:18:01.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.310+0000 7fbded7fa700 1 -- 172.21.15.72:0/3925591725 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbde400c850 con 0x7fbdf009d6f0 2023-10-03T10:18:01.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.310+0000 7fbded7fa700 1 -- 172.21.15.72:0/3925591725 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbde403f5a0 con 0x7fbdf009d6f0 2023-10-03T10:18:01.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.310+0000 7fbdf703e700 1 -- 172.21.15.72:0/3925591725 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf0131270 con 0x7fbdf009d6f0 2023-10-03T10:18:01.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.315+0000 7fbded7fa700 1 -- 172.21.15.72:0/3925591725 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbde40036a0 con 0x7fbdf009d6f0 2023-10-03T10:18:01.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.362+0000 7f7faf387700 1 Processor -- start 2023-10-03T10:18:01.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.363+0000 7f7faf387700 1 -- start start 2023-10-03T10:18:01.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.363+0000 7f7faf387700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7fa812cc20 0x7f7fa812f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.363+0000 7f7faf387700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7fa812c2f0 0x7f7fa812fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.363+0000 7f7faf387700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7fa812cff0 0x7f7fa81303b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.363+0000 7f7faf387700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa809a510 con 0x7f7fa812c2f0 2023-10-03T10:18:01.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.363+0000 7f7faf387700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa812c7d0 con 0x7f7fa812cc20 2023-10-03T10:18:01.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.363+0000 7f7faf387700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa809c190 con 0x7f7fa812cff0 2023-10-03T10:18:01.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.363+0000 7f7fad123700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7fa812cc20 0x7f7fa812f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.363+0000 7f7fad123700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7fa812cc20 0x7f7fa812f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:36714/0 (socket says 172.21.15.72:36714) 2023-10-03T10:18:01.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.363+0000 7f7fad123700 1 -- 172.21.15.72:0/1012471016 learned_addr learned my addr 172.21.15.72:0/1012471016 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:01.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.363+0000 7f7fac922700 1 --2- 172.21.15.72:0/1012471016 >> v2:172.21.15.72:3300/0 conn(0x7f7fa812c2f0 0x7f7fa812fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.363+0000 7f7fad924700 1 --2- 172.21.15.72:0/1012471016 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7fa812cff0 0x7f7fa81303b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.364+0000 7f7fac922700 1 -- 172.21.15.72:0/1012471016 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7fa812cff0 msgr2=0x7f7fa81303b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:01.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.364+0000 7f7fac922700 1 --2- 172.21.15.72:0/1012471016 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7fa812cff0 0x7f7fa81303b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.364+0000 7f7fac922700 1 -- 172.21.15.72:0/1012471016 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7fa812cc20 msgr2=0x7f7fa812f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:01.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.364+0000 7f7fac922700 1 --2- 172.21.15.72:0/1012471016 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7fa812cc20 0x7f7fa812f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.364+0000 7f7fac922700 1 -- 172.21.15.72:0/1012471016 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa809b540 con 0x7f7fa812c2f0 2023-10-03T10:18:01.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.364+0000 7f7fad123700 1 --2- 172.21.15.72:0/1012471016 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7fa812cc20 0x7f7fa812f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.364+0000 7f7fad924700 1 --2- 172.21.15.72:0/1012471016 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7fa812cff0 0x7f7fa81303b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.364+0000 7f7fac922700 1 --2- 172.21.15.72:0/1012471016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa812c2f0 0x7f7fa812fe70 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009840 tx=0x7f7f98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a762d477f54f98d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:01.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.364+0000 7f7f9ffff700 1 -- 172.21.15.72:0/1012471016 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98011830 con 0x7f7fa812c2f0 2023-10-03T10:18:01.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.364+0000 7f7f9ffff700 1 -- 172.21.15.72:0/1012471016 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f98011990 con 0x7f7fa812c2f0 2023-10-03T10:18:01.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.364+0000 7f7f9ffff700 1 -- 172.21.15.72:0/1012471016 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98011d20 con 0x7f7fa812c2f0 2023-10-03T10:18:01.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.365+0000 7f7faf387700 1 -- 172.21.15.72:0/1012471016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa812c2f0 msgr2=0x7f7fa812fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.365+0000 7f7faf387700 1 --2- 172.21.15.72:0/1012471016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa812c2f0 0x7f7fa812fe70 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009840 tx=0x7f7f98009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:01.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.365+0000 7f7faf387700 1 -- 172.21.15.72:0/1012471016 shutdown_connections 2023-10-03T10:18:01.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.365+0000 7f7faf387700 1 --2- 172.21.15.72:0/1012471016 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7fa812cff0 0x7f7fa81303b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.365+0000 7f7faf387700 1 --2- 172.21.15.72:0/1012471016 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7fa812cc20 0x7f7fa812f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.365+0000 7f7faf387700 1 --2- 172.21.15.72:0/1012471016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa812c2f0 0x7f7fa812fe70 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.365+0000 7f7faf387700 1 -- 172.21.15.72:0/1012471016 >> 172.21.15.72:0/1012471016 conn(0x7f7fa809f470 msgr2=0x7f7fa80a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.365+0000 7f7faf387700 1 -- 172.21.15.72:0/1012471016 shutdown_connections 2023-10-03T10:18:01.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.365+0000 7f7faf387700 1 -- 172.21.15.72:0/1012471016 wait complete. 2023-10-03T10:18:01.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.366+0000 7f7faf387700 1 Processor -- start 2023-10-03T10:18:01.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.366+0000 7f7faf387700 1 -- start start 2023-10-03T10:18:01.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7faf387700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa812c2f0 0x7f7fa81c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7faf387700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7fa812cc20 0x7f7fa81c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7faf387700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7fa812cff0 0x7f7fa81c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7faf387700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa806f100 con 0x7f7fa812c2f0 2023-10-03T10:18:01.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7faf387700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa806e140 con 0x7f7fa812cff0 2023-10-03T10:18:01.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7faf387700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa806da80 con 0x7f7fa812cc20 2023-10-03T10:18:01.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7fac922700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7fa812cc20 0x7f7fa81c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7fac922700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7fa812cc20 0x7f7fa81c4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37854/0 (socket says 172.21.15.72:37854) 2023-10-03T10:18:01.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7fac922700 1 -- 172.21.15.72:0/1603315593 learned_addr learned my addr 172.21.15.72:0/1603315593 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:01.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7fad123700 1 --2- 172.21.15.72:0/1603315593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa812c2f0 0x7f7fa81c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7fad924700 1 --2- 172.21.15.72:0/1603315593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7fa812cff0 0x7f7fa81c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7fac922700 1 -- 172.21.15.72:0/1603315593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7fa812cff0 msgr2=0x7f7fa81c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7fac922700 1 --2- 172.21.15.72:0/1603315593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7fa812cff0 0x7f7fa81c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7fac922700 1 -- 172.21.15.72:0/1603315593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa812c2f0 msgr2=0x7f7fa81c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7fac922700 1 --2- 172.21.15.72:0/1603315593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa812c2f0 0x7f7fa81c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7fac922700 1 -- 172.21.15.72:0/1603315593 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4009550 con 0x7f7fa812cc20 2023-10-03T10:18:01.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.367+0000 7f7fad123700 1 --2- 172.21.15.72:0/1603315593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa812c2f0 0x7f7fa81c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.368+0000 7f7fac922700 1 --2- 172.21.15.72:0/1603315593 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7fa812cc20 0x7f7fa81c4320 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7f980090b0 tx=0x7f7f98004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:01.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.368+0000 7f7f9dffb700 1 -- 172.21.15.72:0/1603315593 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98004450 con 0x7f7fa812cc20 2023-10-03T10:18:01.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.368+0000 7f7f9dffb700 1 -- 172.21.15.72:0/1603315593 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9801f070 con 0x7f7fa812cc20 2023-10-03T10:18:01.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.368+0000 7f7faf387700 1 -- 172.21.15.72:0/1603315593 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa00099e0 con 0x7f7fa812cc20 2023-10-03T10:18:01.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.368+0000 7f7f9dffb700 1 -- 172.21.15.72:0/1603315593 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f980038e0 con 0x7f7fa812cc20 2023-10-03T10:18:01.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.368+0000 7f7faf387700 1 -- 172.21.15.72:0/1603315593 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f980094a0 con 0x7f7fa812cc20 2023-10-03T10:18:01.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.369+0000 7f7f9dffb700 1 -- 172.21.15.72:0/1603315593 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f98003a40 con 0x7f7fa812cc20 2023-10-03T10:18:01.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.369+0000 7f7f9dffb700 1 -- 172.21.15.72:0/1603315593 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7f98021070 con 0x7f7fa812cc20 2023-10-03T10:18:01.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.369+0000 7f7faf387700 1 -- 172.21.15.72:0/1603315593 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa80747f0 con 0x7f7fa812cc20 2023-10-03T10:18:01.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.374+0000 7f7f9dffb700 1 -- 172.21.15.72:0/1603315593 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f98015030 con 0x7f7fa812cc20 2023-10-03T10:18:01.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.383+0000 7f8a2747d700 1 Processor -- start 2023-10-03T10:18:01.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.383+0000 7f8a2747d700 1 -- start start 2023-10-03T10:18:01.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.383+0000 7f8a2747d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a200a1510 0x7f8a20138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.383+0000 7f8a2747d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a20139250 0x7f8a2013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.383+0000 7f8a2747d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2009edd0 con 0x7f8a200a0a30 2023-10-03T10:18:01.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a2747d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a200a18e0 con 0x7f8a200a1510 2023-10-03T10:18:01.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a2747d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2009e1f0 con 0x7f8a20139250 2023-10-03T10:18:01.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a25a1a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a20139250 0x7f8a2013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a24a18700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a200a1510 0x7f8a20138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a25a1a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a20139250 0x7f8a2013b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37868/0 (socket says 172.21.15.72:37868) 2023-10-03T10:18:01.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a25a1a700 1 -- 172.21.15.72:0/3150918657 learned_addr learned my addr 172.21.15.72:0/3150918657 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:01.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a25a1a700 1 -- 172.21.15.72:0/3150918657 >> v2:172.21.15.72:3300/0 conn(0x7f8a200a1510 msgr2=0x7f8a20138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:01.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a25a1a700 1 --2- 172.21.15.72:0/3150918657 >> v2:172.21.15.72:3300/0 conn(0x7f8a200a1510 0x7f8a20138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a25a1a700 1 -- 172.21.15.72:0/3150918657 >> v1:172.21.15.72:6789/0 conn(0x7f8a200a0a30 legacy=0x7f8a200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a17fff700 1 -- 172.21.15.72:0/3150918657 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411127746 0 0) 0x7f8a2009edd0 con 0x7f8a200a0a30 2023-10-03T10:18:01.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a25a1a700 1 -- 172.21.15.72:0/3150918657 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2009dc50 con 0x7f8a20139250 2023-10-03T10:18:01.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a24a18700 1 --2- 172.21.15.72:0/3150918657 >> v2:172.21.15.72:3300/0 conn(0x7f8a200a1510 0x7f8a20138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:01.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a25a1a700 1 --2- 172.21.15.72:0/3150918657 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a20139250 0x7f8a2013b630 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009e50 tx=0x7f8a1800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1624c06fb51948be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:01.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a17fff700 1 -- 172.21.15.72:0/3150918657 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1800e070 con 0x7f8a20139250 2023-10-03T10:18:01.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a17fff700 1 -- 172.21.15.72:0/3150918657 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1800b910 con 0x7f8a20139250 2023-10-03T10:18:01.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.384+0000 7f8a17fff700 1 -- 172.21.15.72:0/3150918657 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1800bcc0 con 0x7f8a20139250 2023-10-03T10:18:01.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.385+0000 7f8a2747d700 1 -- 172.21.15.72:0/3150918657 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a20139250 msgr2=0x7f8a2013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.385+0000 7f8a2747d700 1 --2- 172.21.15.72:0/3150918657 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a20139250 0x7f8a2013b630 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009e50 tx=0x7f8a1800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:01.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.385+0000 7f8a2747d700 1 -- 172.21.15.72:0/3150918657 shutdown_connections 2023-10-03T10:18:01.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.385+0000 7f8a2747d700 1 --2- 172.21.15.72:0/3150918657 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a20139250 0x7f8a2013b630 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.385+0000 7f8a2747d700 1 --2- 172.21.15.72:0/3150918657 >> v2:172.21.15.72:3300/0 conn(0x7f8a200a1510 0x7f8a20138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.385+0000 7f8a2747d700 1 -- 172.21.15.72:0/3150918657 >> 172.21.15.72:0/3150918657 conn(0x7f8a200a6550 msgr2=0x7f8a200a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.385+0000 7f8a2747d700 1 -- 172.21.15.72:0/3150918657 shutdown_connections 2023-10-03T10:18:01.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.385+0000 7f8a2747d700 1 -- 172.21.15.72:0/3150918657 wait complete. 2023-10-03T10:18:01.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.386+0000 7f8a2747d700 1 Processor -- start 2023-10-03T10:18:01.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.386+0000 7f8a2747d700 1 -- start start 2023-10-03T10:18:01.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a2747d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a200a0a30 0x7f8a2011e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a2747d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a200a1510 0x7f8a2011eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a2747d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a20139250 0x7f8a2011f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a2747d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a201221f0 con 0x7f8a200a0a30 2023-10-03T10:18:01.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a2747d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a201218e0 con 0x7f8a20139250 2023-10-03T10:18:01.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a2747d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a200a5040 con 0x7f8a200a1510 2023-10-03T10:18:01.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a24a18700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a200a1510 0x7f8a2011eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a24a18700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a200a1510 0x7f8a2011eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37876/0 (socket says 172.21.15.72:37876) 2023-10-03T10:18:01.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a24a18700 1 -- 172.21.15.72:0/1548696162 learned_addr learned my addr 172.21.15.72:0/1548696162 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:01.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a25a1a700 1 --2- 172.21.15.72:0/1548696162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a20139250 0x7f8a2011f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a25219700 1 --2- 172.21.15.72:0/1548696162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a200a0a30 0x7f8a2011e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a24a18700 1 -- 172.21.15.72:0/1548696162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a20139250 msgr2=0x7f8a2011f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a24a18700 1 --2- 172.21.15.72:0/1548696162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a20139250 0x7f8a2011f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a24a18700 1 -- 172.21.15.72:0/1548696162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a200a0a30 msgr2=0x7f8a2011e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a24a18700 1 --2- 172.21.15.72:0/1548696162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a200a0a30 0x7f8a2011e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.387+0000 7f8a24a18700 1 -- 172.21.15.72:0/1548696162 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a100094a0 con 0x7f8a200a1510 2023-10-03T10:18:01.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.388+0000 7f8a24a18700 1 --2- 172.21.15.72:0/1548696162 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a200a1510 0x7f8a2011eb70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000ec10 tx=0x7f8a1000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:01.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.388+0000 7f8a15ffb700 1 -- 172.21.15.72:0/1548696162 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1000c850 con 0x7f8a200a1510 2023-10-03T10:18:01.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.388+0000 7f8a15ffb700 1 -- 172.21.15.72:0/1548696162 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1000c9b0 con 0x7f8a200a1510 2023-10-03T10:18:01.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.388+0000 7f8a15ffb700 1 -- 172.21.15.72:0/1548696162 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1000cd20 con 0x7f8a200a1510 2023-10-03T10:18:01.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.388+0000 7f8a2747d700 1 -- 172.21.15.72:0/1548696162 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a18009b30 con 0x7f8a200a1510 2023-10-03T10:18:01.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.388+0000 7f8a2747d700 1 -- 172.21.15.72:0/1548696162 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a200a0280 con 0x7f8a200a1510 2023-10-03T10:18:01.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.389+0000 7f8a15ffb700 1 -- 172.21.15.72:0/1548696162 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a10013470 con 0x7f8a200a1510 2023-10-03T10:18:01.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.389+0000 7f8a15ffb700 1 -- 172.21.15.72:0/1548696162 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8a10042220 con 0x7f8a200a1510 2023-10-03T10:18:01.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.389+0000 7f8a2747d700 1 -- 172.21.15.72:0/1548696162 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a200a1d00 con 0x7f8a200a1510 2023-10-03T10:18:01.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.394+0000 7f8a15ffb700 1 -- 172.21.15.72:0/1548696162 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a10013720 con 0x7f8a200a1510 2023-10-03T10:18:01.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:01.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.536+0000 7fbdf703e700 1 -- 172.21.15.72:0/3925591725 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbdf0074ea0 con 0x7fbdf009d6f0 2023-10-03T10:18:01.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.536+0000 7fbded7fa700 1 -- 172.21.15.72:0/3925591725 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbde4013e60 con 0x7fbdf009d6f0 2023-10-03T10:18:01.537 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:01.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.538+0000 7fbdf703e700 1 -- 172.21.15.72:0/3925591725 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdf009d6f0 msgr2=0x7fbdf0130bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.538+0000 7fbdf703e700 1 --2- 172.21.15.72:0/3925591725 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdf009d6f0 0x7fbdf0130bc0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fbde400e9d0 tx=0x7fbde400ece0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.538+0000 7fbdf703e700 1 -- 172.21.15.72:0/3925591725 shutdown_connections 2023-10-03T10:18:01.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.538+0000 7fbdf703e700 1 --2- 172.21.15.72:0/3925591725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdf009e410 0x7fbdf0136ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.538+0000 7fbdf703e700 1 --2- 172.21.15.72:0/3925591725 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbdf009d6f0 0x7fbdf0130bc0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.538+0000 7fbdf703e700 1 --2- 172.21.15.72:0/3925591725 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdf009e000 0x7fbdf0136760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.539+0000 7fbdf703e700 1 -- 172.21.15.72:0/3925591725 >> 172.21.15.72:0/3925591725 conn(0x7fbdf0066f50 msgr2=0x7fbdf006eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.539+0000 7fbdf703e700 1 -- 172.21.15.72:0/3925591725 shutdown_connections 2023-10-03T10:18:01.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.539+0000 7fbdf703e700 1 -- 172.21.15.72:0/3925591725 wait complete. 2023-10-03T10:18:01.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:01.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.564+0000 7f56bd31f700 1 Processor -- start 2023-10-03T10:18:01.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.564+0000 7f56bd31f700 1 -- start start 2023-10-03T10:18:01.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.564+0000 7f56bd31f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56b81316c0 0x7f56b8131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.564+0000 7f56bd31f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56b809d9f0 0x7f56b806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.564+0000 7f56bd31f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b809e130 con 0x7f56b806acb0 2023-10-03T10:18:01.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.564+0000 7f56bd31f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b81312b0 con 0x7f56b809d9f0 2023-10-03T10:18:01.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.564+0000 7f56bd31f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56b809f6e0 con 0x7f56b81316c0 2023-10-03T10:18:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.564+0000 7f56b6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56b81316c0 0x7f56b8131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.564+0000 7f56b6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56b81316c0 0x7f56b8131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37886/0 (socket says 172.21.15.72:37886) 2023-10-03T10:18:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.564+0000 7f56b6ffd700 1 -- 172.21.15.72:0/1668115455 learned_addr learned my addr 172.21.15.72:0/1668115455 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.565+0000 7f56b67fc700 1 --2- 172.21.15.72:0/1668115455 >> v2:172.21.15.72:3300/0 conn(0x7f56b809d9f0 0x7f56b806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.565+0000 7f56b6ffd700 1 -- 172.21.15.72:0/1668115455 >> v2:172.21.15.72:3300/0 conn(0x7f56b809d9f0 msgr2=0x7f56b806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.565+0000 7f56b6ffd700 1 --2- 172.21.15.72:0/1668115455 >> v2:172.21.15.72:3300/0 conn(0x7f56b809d9f0 0x7f56b806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.565+0000 7f56b6ffd700 1 -- 172.21.15.72:0/1668115455 >> v1:172.21.15.72:6789/0 conn(0x7f56b806acb0 legacy=0x7f56b8138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.565+0000 7f56b6ffd700 1 -- 172.21.15.72:0/1668115455 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b809e760 con 0x7f56b81316c0 2023-10-03T10:18:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.565+0000 7f56b67fc700 1 --2- 172.21.15.72:0/1668115455 >> v2:172.21.15.72:3300/0 conn(0x7f56b809d9f0 0x7f56b806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.565+0000 7f56b6ffd700 1 --2- 172.21.15.72:0/1668115455 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56b81316c0 0x7f56b8131a90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f56a80098f0 tx=0x7f56a8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8aa6412927692a9d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:01.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.566+0000 7f56b5ffb700 1 -- 172.21.15.72:0/1668115455 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8004230 con 0x7f56b81316c0 2023-10-03T10:18:01.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.566+0000 7f56b5ffb700 1 -- 172.21.15.72:0/1668115455 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a8004390 con 0x7f56b81316c0 2023-10-03T10:18:01.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.566+0000 7f56b5ffb700 1 -- 172.21.15.72:0/1668115455 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a80036a0 con 0x7f56b81316c0 2023-10-03T10:18:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.567+0000 7f56bd31f700 1 -- 172.21.15.72:0/1668115455 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56b81316c0 msgr2=0x7f56b8131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.567+0000 7f56bd31f700 1 --2- 172.21.15.72:0/1668115455 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56b81316c0 0x7f56b8131a90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f56a80098f0 tx=0x7f56a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.567+0000 7f56bd31f700 1 -- 172.21.15.72:0/1668115455 shutdown_connections 2023-10-03T10:18:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.567+0000 7f56bd31f700 1 --2- 172.21.15.72:0/1668115455 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56b81316c0 0x7f56b8131a90 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.567+0000 7f56bd31f700 1 --2- 172.21.15.72:0/1668115455 >> v2:172.21.15.72:3300/0 conn(0x7f56b809d9f0 0x7f56b806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.567+0000 7f56bd31f700 1 -- 172.21.15.72:0/1668115455 >> 172.21.15.72:0/1668115455 conn(0x7f56b8066f50 msgr2=0x7f56b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.567+0000 7f56bd31f700 1 -- 172.21.15.72:0/1668115455 shutdown_connections 2023-10-03T10:18:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.567+0000 7f56bd31f700 1 -- 172.21.15.72:0/1668115455 wait complete. 2023-10-03T10:18:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.568+0000 7f56bd31f700 1 Processor -- start 2023-10-03T10:18:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.568+0000 7f56bd31f700 1 -- start start 2023-10-03T10:18:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.568+0000 7f56bd31f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56b806acb0 0x7f56b8070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.568+0000 7f56bd31f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56b809d9f0 0x7f56b80710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.568+0000 7f56bd31f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56b81316c0 0x7f56b8071630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.568+0000 7f56bd31f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b812b900 con 0x7f56b81316c0 2023-10-03T10:18:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.568+0000 7f56bd31f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8127f50 con 0x7f56b809d9f0 2023-10-03T10:18:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.568+0000 7f56bd31f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56b811ad00 con 0x7f56b806acb0 2023-10-03T10:18:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f56b67fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56b809d9f0 0x7f56b80710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f56b67fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56b809d9f0 0x7f56b80710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:36736/0 (socket says 172.21.15.72:36736) 2023-10-03T10:18:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f56b67fc700 1 -- 172.21.15.72:0/399759159 learned_addr learned my addr 172.21.15.72:0/399759159 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f56b77fe700 1 --2- 172.21.15.72:0/399759159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56b81316c0 0x7f56b8071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f56b6ffd700 1 --2- 172.21.15.72:0/399759159 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56b806acb0 0x7f56b8070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f56b67fc700 1 -- 172.21.15.72:0/399759159 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56b806acb0 msgr2=0x7f56b8070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f56b67fc700 1 --2- 172.21.15.72:0/399759159 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56b806acb0 0x7f56b8070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f56b67fc700 1 -- 172.21.15.72:0/399759159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56b81316c0 msgr2=0x7f56b8071630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f56b67fc700 1 --2- 172.21.15.72:0/399759159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56b81316c0 0x7f56b8071630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f56b67fc700 1 -- 172.21.15.72:0/399759159 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a8009550 con 0x7f56b809d9f0 2023-10-03T10:18:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f56b67fc700 1 --2- 172.21.15.72:0/399759159 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56b809d9f0 0x7f56b80710f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00e840 tx=0x7f56ac00eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f569f7fe700 1 -- 172.21.15.72:0/399759159 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac013610 con 0x7f56b809d9f0 2023-10-03T10:18:01.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f569f7fe700 1 -- 172.21.15.72:0/399759159 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ac013770 con 0x7f56b809d9f0 2023-10-03T10:18:01.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f569f7fe700 1 -- 172.21.15.72:0/399759159 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac013b00 con 0x7f56b809d9f0 2023-10-03T10:18:01.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f56bd31f700 1 -- 172.21.15.72:0/399759159 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b811af70 con 0x7f56b809d9f0 2023-10-03T10:18:01.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.569+0000 7f56bd31f700 1 -- 172.21.15.72:0/399759159 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b811a9d0 con 0x7f56b809d9f0 2023-10-03T10:18:01.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.571+0000 7f56bd31f700 1 -- 172.21.15.72:0/399759159 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b8074ea0 con 0x7f56b809d9f0 2023-10-03T10:18:01.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.571+0000 7f569f7fe700 1 -- 172.21.15.72:0/399759159 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56ac013c60 con 0x7f56b809d9f0 2023-10-03T10:18:01.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.571+0000 7f569f7fe700 1 -- 172.21.15.72:0/399759159 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f56ac03f6a0 con 0x7f56b809d9f0 2023-10-03T10:18:01.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.576+0000 7f569f7fe700 1 -- 172.21.15.72:0/399759159 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56ac026480 con 0x7f56b809d9f0 2023-10-03T10:18:01.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.596+0000 7f8a2747d700 1 -- 172.21.15.72:0/1548696162 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8a20074ea0 con 0x7f8a200a1510 2023-10-03T10:18:01.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.597+0000 7f8a15ffb700 1 -- 172.21.15.72:0/1548696162 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8a10017030 con 0x7f8a200a1510 2023-10-03T10:18:01.597 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.599+0000 7f8a2747d700 1 -- 172.21.15.72:0/1548696162 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a200a1510 msgr2=0x7f8a2011eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.599+0000 7f8a2747d700 1 --2- 172.21.15.72:0/1548696162 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a200a1510 0x7f8a2011eb70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000ec10 tx=0x7f8a1000ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:01.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.599+0000 7f8a2747d700 1 -- 172.21.15.72:0/1548696162 shutdown_connections 2023-10-03T10:18:01.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.599+0000 7f8a2747d700 1 --2- 172.21.15.72:0/1548696162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a200a0a30 0x7f8a2011e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.599+0000 7f8a2747d700 1 --2- 172.21.15.72:0/1548696162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a20139250 0x7f8a2011f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.599+0000 7f8a2747d700 1 --2- 172.21.15.72:0/1548696162 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8a200a1510 0x7f8a2011eb70 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.599+0000 7f8a2747d700 1 -- 172.21.15.72:0/1548696162 >> 172.21.15.72:0/1548696162 conn(0x7f8a200a6550 msgr2=0x7f8a200a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.599+0000 7f8a2747d700 1 -- 172.21.15.72:0/1548696162 shutdown_connections 2023-10-03T10:18:01.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.599+0000 7f8a2747d700 1 -- 172.21.15.72:0/1548696162 wait complete. 2023-10-03T10:18:01.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.604+0000 7f7faf387700 1 -- 172.21.15.72:0/1603315593 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7fa809a060 con 0x7f7fa812cc20 2023-10-03T10:18:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.604+0000 7f7f9dffb700 1 -- 172.21.15.72:0/1603315593 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f980253e0 con 0x7f7fa812cc20 2023-10-03T10:18:01.605 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.608+0000 7f7faf387700 1 -- 172.21.15.72:0/1603315593 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7fa812cc20 msgr2=0x7f7fa81c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.608+0000 7f7faf387700 1 --2- 172.21.15.72:0/1603315593 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7fa812cc20 0x7f7fa81c4320 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7f980090b0 tx=0x7f7f98004750 comp rx=0 tx=0).stop 2023-10-03T10:18:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.608+0000 7f7faf387700 1 -- 172.21.15.72:0/1603315593 shutdown_connections 2023-10-03T10:18:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.608+0000 7f7faf387700 1 --2- 172.21.15.72:0/1603315593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fa812c2f0 0x7f7fa81c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.608+0000 7f7faf387700 1 --2- 172.21.15.72:0/1603315593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7fa812cff0 0x7f7fa81c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.608+0000 7f7faf387700 1 --2- 172.21.15.72:0/1603315593 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7fa812cc20 0x7f7fa81c4320 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.608+0000 7f7faf387700 1 -- 172.21.15.72:0/1603315593 >> 172.21.15.72:0/1603315593 conn(0x7f7fa809f470 msgr2=0x7f7fa812a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.608+0000 7f7faf387700 1 -- 172.21.15.72:0/1603315593 shutdown_connections 2023-10-03T10:18:01.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.608+0000 7f7faf387700 1 -- 172.21.15.72:0/1603315593 wait complete. 2023-10-03T10:18:01.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:01.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:01.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.783+0000 7f56bd31f700 1 -- 172.21.15.72:0/399759159 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f56b806c360 con 0x7f56b809d9f0 2023-10-03T10:18:01.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.783+0000 7f569f7fe700 1 -- 172.21.15.72:0/399759159 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56ac012e60 con 0x7f56b809d9f0 2023-10-03T10:18:01.784 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:01.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.785+0000 7f56bd31f700 1 -- 172.21.15.72:0/399759159 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56b809d9f0 msgr2=0x7f56b80710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.785+0000 7f56bd31f700 1 --2- 172.21.15.72:0/399759159 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56b809d9f0 0x7f56b80710f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00e840 tx=0x7f56ac00eb50 comp rx=0 tx=0).stop 2023-10-03T10:18:01.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.785+0000 7f56bd31f700 1 -- 172.21.15.72:0/399759159 shutdown_connections 2023-10-03T10:18:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.785+0000 7f56bd31f700 1 --2- 172.21.15.72:0/399759159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56b81316c0 0x7f56b8071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.785+0000 7f56bd31f700 1 --2- 172.21.15.72:0/399759159 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f56b806acb0 0x7f56b8070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.785+0000 7f56bd31f700 1 --2- 172.21.15.72:0/399759159 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56b809d9f0 0x7f56b80710f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.785+0000 7f56bd31f700 1 -- 172.21.15.72:0/399759159 >> 172.21.15.72:0/399759159 conn(0x7f56b8066f50 msgr2=0x7f56b80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.785+0000 7f56bd31f700 1 -- 172.21.15.72:0/399759159 shutdown_connections 2023-10-03T10:18:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:01.785+0000 7f56bd31f700 1 -- 172.21.15.72:0/399759159 wait complete. 2023-10-03T10:18:01.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:02.552 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:02.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:02.627 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:02.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.693+0000 7f6bdd36c700 1 Processor -- start 2023-10-03T10:18:02.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.693+0000 7f6bdd36c700 1 -- start start 2023-10-03T10:18:02.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.694+0000 7f6bdd36c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6bd809e7e0 0x7f6bd809ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.694+0000 7f6bdd36c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bd81391d0 0x7f6bd813b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.694+0000 7f6bdd36c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd806bd70 con 0x7f6bd809f0f0 2023-10-03T10:18:02.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.694+0000 7f6bdd36c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd806cc30 con 0x7f6bd809e7e0 2023-10-03T10:18:02.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.694+0000 7f6bdd36c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd806d870 con 0x7f6bd81391d0 2023-10-03T10:18:02.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.694+0000 7f6bd67fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6bd809f0f0 0x7f6bd8137ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36538/0 (socket says 172.21.15.72:36538) 2023-10-03T10:18:02.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.694+0000 7f6bd6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6bd809e7e0 0x7f6bd809ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.694+0000 7f6bd67fc700 1 -- 172.21.15.72:0/4149291616 learned_addr learned my addr 172.21.15.72:0/4149291616 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:02.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.694+0000 7f6bd77fe700 1 --2- 172.21.15.72:0/4149291616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bd81391d0 0x7f6bd813b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.694+0000 7f6bd6ffd700 1 -- 172.21.15.72:0/4149291616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bd81391d0 msgr2=0x7f6bd813b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.694+0000 7f6bd6ffd700 1 --2- 172.21.15.72:0/4149291616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bd81391d0 0x7f6bd813b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.694+0000 7f6bd6ffd700 1 -- 172.21.15.72:0/4149291616 >> v1:172.21.15.72:6789/0 conn(0x7f6bd809f0f0 legacy=0x7f6bd8137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.694+0000 7f6bd6ffd700 1 -- 172.21.15.72:0/4149291616 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd806bab0 con 0x7f6bd809e7e0 2023-10-03T10:18:02.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.694+0000 7f6bd6ffd700 1 --2- 172.21.15.72:0/4149291616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bd809e7e0 0x7f6bd809ebb0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009840 tx=0x7f6bc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce22f5eb7a0c4bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.695+0000 7f6bd5ffb700 1 -- 172.21.15.72:0/4149291616 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8011830 con 0x7f6bd809e7e0 2023-10-03T10:18:02.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.695+0000 7f6bd5ffb700 1 -- 172.21.15.72:0/4149291616 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc8011990 con 0x7f6bd809e7e0 2023-10-03T10:18:02.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.695+0000 7f6bd5ffb700 1 -- 172.21.15.72:0/4149291616 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8011d20 con 0x7f6bd809e7e0 2023-10-03T10:18:02.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.695+0000 7f6bdd36c700 1 -- 172.21.15.72:0/4149291616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bd809e7e0 msgr2=0x7f6bd809ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.695+0000 7f6bdd36c700 1 --2- 172.21.15.72:0/4149291616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bd809e7e0 0x7f6bd809ebb0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009840 tx=0x7f6bc8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:02.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.695+0000 7f6bdd36c700 1 -- 172.21.15.72:0/4149291616 shutdown_connections 2023-10-03T10:18:02.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.695+0000 7f6bdd36c700 1 --2- 172.21.15.72:0/4149291616 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bd81391d0 0x7f6bd813b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.695+0000 7f6bdd36c700 1 --2- 172.21.15.72:0/4149291616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bd809e7e0 0x7f6bd809ebb0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.695+0000 7f6bdd36c700 1 -- 172.21.15.72:0/4149291616 >> 172.21.15.72:0/4149291616 conn(0x7f6bd80a4300 msgr2=0x7f6bd80a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.695+0000 7f6bdd36c700 1 -- 172.21.15.72:0/4149291616 shutdown_connections 2023-10-03T10:18:02.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.695+0000 7f6bdd36c700 1 -- 172.21.15.72:0/4149291616 wait complete. 2023-10-03T10:18:02.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.697+0000 7f6bdd36c700 1 Processor -- start 2023-10-03T10:18:02.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.697+0000 7f6bdd36c700 1 -- start start 2023-10-03T10:18:02.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bdd36c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bd809e7e0 0x7f6bd8121780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bdd36c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bd809f0f0 0x7f6bd8121cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bdd36c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bd81391d0 0x7f6bd8122200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bdd36c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd8123390 con 0x7f6bd809e7e0 2023-10-03T10:18:02.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bdd36c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd8124d00 con 0x7f6bd81391d0 2023-10-03T10:18:02.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bdd36c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd8125380 con 0x7f6bd809f0f0 2023-10-03T10:18:02.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bd6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bd809e7e0 0x7f6bd8121780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bd67fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bd809f0f0 0x7f6bd8121cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bd6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bd809e7e0 0x7f6bd8121780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41202/0 (socket says 172.21.15.72:41202) 2023-10-03T10:18:02.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bd6ffd700 1 -- 172.21.15.72:0/2934340555 learned_addr learned my addr 172.21.15.72:0/2934340555 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:02.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bd77fe700 1 --2- 172.21.15.72:0/2934340555 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bd81391d0 0x7f6bd8122200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bd67fc700 1 -- 172.21.15.72:0/2934340555 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bd81391d0 msgr2=0x7f6bd8122200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bd67fc700 1 --2- 172.21.15.72:0/2934340555 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bd81391d0 0x7f6bd8122200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bd67fc700 1 -- 172.21.15.72:0/2934340555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bd809e7e0 msgr2=0x7f6bd8121780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bd67fc700 1 --2- 172.21.15.72:0/2934340555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bd809e7e0 0x7f6bd8121780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bd67fc700 1 -- 172.21.15.72:0/2934340555 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc80094a0 con 0x7f6bd809f0f0 2023-10-03T10:18:02.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bd6ffd700 1 --2- 172.21.15.72:0/2934340555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bd809e7e0 0x7f6bd8121780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bd77fe700 1 --2- 172.21.15.72:0/2934340555 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bd81391d0 0x7f6bd8122200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bd67fc700 1 --2- 172.21.15.72:0/2934340555 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bd809f0f0 0x7f6bd8121cc0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00c500 tx=0x7f6bcc00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.698+0000 7f6bbf7fe700 1 -- 172.21.15.72:0/2934340555 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc005d70 con 0x7f6bd809f0f0 2023-10-03T10:18:02.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.699+0000 7f6bbf7fe700 1 -- 172.21.15.72:0/2934340555 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc0070d0 con 0x7f6bd809f0f0 2023-10-03T10:18:02.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.699+0000 7f6bbf7fe700 1 -- 172.21.15.72:0/2934340555 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc007440 con 0x7f6bd809f0f0 2023-10-03T10:18:02.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.699+0000 7f6bdd36c700 1 -- 172.21.15.72:0/2934340555 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd80a05d0 con 0x7f6bd809f0f0 2023-10-03T10:18:02.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.699+0000 7f6bdd36c700 1 -- 172.21.15.72:0/2934340555 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd8125a30 con 0x7f6bd809f0f0 2023-10-03T10:18:02.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.699+0000 7f6bbf7fe700 1 -- 172.21.15.72:0/2934340555 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bcc0075a0 con 0x7f6bd809f0f0 2023-10-03T10:18:02.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.700+0000 7f6bbf7fe700 1 -- 172.21.15.72:0/2934340555 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6bcc03e9c0 con 0x7f6bd809f0f0 2023-10-03T10:18:02.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.700+0000 7f6bdd36c700 1 -- 172.21.15.72:0/2934340555 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd804f2a0 con 0x7f6bd809f0f0 2023-10-03T10:18:02.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.705+0000 7f6bbf7fe700 1 -- 172.21.15.72:0/2934340555 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bcc019d20 con 0x7f6bd809f0f0 2023-10-03T10:18:02.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.747+0000 7f4f6573e700 1 Processor -- start 2023-10-03T10:18:02.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.747+0000 7f4f6573e700 1 -- start start 2023-10-03T10:18:02.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f6573e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f6009e930 0x7f4f6009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f6573e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f6009f650 0x7f4f60131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f6573e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f60070940 con 0x7f4f6009f240 2023-10-03T10:18:02.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f6573e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6006fd60 con 0x7f4f6009e930 2023-10-03T10:18:02.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f6573e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6006fa80 con 0x7f4f6009f650 2023-10-03T10:18:02.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f5effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f6009e930 0x7f4f6009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f5effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f6009e930 0x7f4f6009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41208/0 (socket says 172.21.15.72:41208) 2023-10-03T10:18:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f5effd700 1 -- 172.21.15.72:0/4097003996 learned_addr learned my addr 172.21.15.72:0/4097003996 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f5f7fe700 1 --2- 172.21.15.72:0/4097003996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f6009f650 0x7f4f60131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f5f7fe700 1 -- 172.21.15.72:0/4097003996 >> v2:172.21.15.72:3300/0 conn(0x7f4f6009e930 msgr2=0x7f4f6009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f5f7fe700 1 --2- 172.21.15.72:0/4097003996 >> v2:172.21.15.72:3300/0 conn(0x7f4f6009e930 0x7f4f6009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f5f7fe700 1 -- 172.21.15.72:0/4097003996 >> v1:172.21.15.72:6789/0 conn(0x7f4f6009f240 legacy=0x7f4f601317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f5f7fe700 1 -- 172.21.15.72:0/4097003996 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6009fb60 con 0x7f4f6009f650 2023-10-03T10:18:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f5dffb700 1 -- 172.21.15.72:0/4097003996 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567126212 0 0) 0x7f4f60070940 con 0x7f4f6009f240 2023-10-03T10:18:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f5effd700 1 --2- 172.21.15.72:0/4097003996 >> v2:172.21.15.72:3300/0 conn(0x7f4f6009e930 0x7f4f6009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f5f7fe700 1 --2- 172.21.15.72:0/4097003996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f6009f650 0x7f4f60131f00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009d90 tx=0x7f4f5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a24324b7c335372c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f5dffb700 1 -- 172.21.15.72:0/4097003996 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5800e070 con 0x7f4f6009f650 2023-10-03T10:18:02.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.748+0000 7f4f5dffb700 1 -- 172.21.15.72:0/4097003996 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5800bb20 con 0x7f4f6009f650 2023-10-03T10:18:02.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.749+0000 7f4f5dffb700 1 -- 172.21.15.72:0/4097003996 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f58012430 con 0x7f4f6009f650 2023-10-03T10:18:02.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.749+0000 7f4f6573e700 1 -- 172.21.15.72:0/4097003996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f6009f650 msgr2=0x7f4f60131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.749+0000 7f4f6573e700 1 --2- 172.21.15.72:0/4097003996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f6009f650 0x7f4f60131f00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009d90 tx=0x7f4f5800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:02.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.749+0000 7f4f6573e700 1 -- 172.21.15.72:0/4097003996 shutdown_connections 2023-10-03T10:18:02.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.749+0000 7f4f6573e700 1 --2- 172.21.15.72:0/4097003996 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f6009f650 0x7f4f60131f00 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.749+0000 7f4f6573e700 1 --2- 172.21.15.72:0/4097003996 >> v2:172.21.15.72:3300/0 conn(0x7f4f6009e930 0x7f4f6009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.749+0000 7f4f6573e700 1 -- 172.21.15.72:0/4097003996 >> 172.21.15.72:0/4097003996 conn(0x7f4f600a4210 msgr2=0x7f4f600a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.749+0000 7f4f6573e700 1 -- 172.21.15.72:0/4097003996 shutdown_connections 2023-10-03T10:18:02.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.749+0000 7f4f6573e700 1 -- 172.21.15.72:0/4097003996 wait complete. 2023-10-03T10:18:02.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.750+0000 7f4f6573e700 1 Processor -- start 2023-10-03T10:18:02.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.750+0000 7f4f6573e700 1 -- start start 2023-10-03T10:18:02.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.751+0000 7f4f6573e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f6009e930 0x7f4f601a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.751+0000 7f4f6573e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f6009f240 0x7f4f601a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.751+0000 7f4f6573e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f6009f650 0x7f4f601c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.751+0000 7f4f6573e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f601a7250 con 0x7f4f6009e930 2023-10-03T10:18:02.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.751+0000 7f4f6573e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f601a6730 con 0x7f4f6009f650 2023-10-03T10:18:02.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.751+0000 7f4f6573e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f601a6f90 con 0x7f4f6009f240 2023-10-03T10:18:02.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.751+0000 7f4f5effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f6009e930 0x7f4f601a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.751+0000 7f4f5effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f6009e930 0x7f4f601a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41222/0 (socket says 172.21.15.72:41222) 2023-10-03T10:18:02.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.751+0000 7f4f5effd700 1 -- 172.21.15.72:0/2502038917 learned_addr learned my addr 172.21.15.72:0/2502038917 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.751+0000 7f4f5e7fc700 1 --2- 172.21.15.72:0/2502038917 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f6009f240 0x7f4f601a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.751+0000 7f4f5f7fe700 1 --2- 172.21.15.72:0/2502038917 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f6009f650 0x7f4f601c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.752+0000 7f4f5effd700 1 -- 172.21.15.72:0/2502038917 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f6009f240 msgr2=0x7f4f601a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.752+0000 7f4f5effd700 1 --2- 172.21.15.72:0/2502038917 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f6009f240 0x7f4f601a4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.752+0000 7f4f5effd700 1 -- 172.21.15.72:0/2502038917 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f6009f650 msgr2=0x7f4f601c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.752+0000 7f4f5effd700 1 --2- 172.21.15.72:0/2502038917 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f6009f650 0x7f4f601c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.752+0000 7f4f5effd700 1 -- 172.21.15.72:0/2502038917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f50009550 con 0x7f4f6009e930 2023-10-03T10:18:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.752+0000 7f4f5effd700 1 --2- 172.21.15.72:0/2502038917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f6009e930 0x7f4f601a43d0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000ebe0 tx=0x7f4f5000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.752+0000 7f4f477fe700 1 -- 172.21.15.72:0/2502038917 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5000c850 con 0x7f4f6009e930 2023-10-03T10:18:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.752+0000 7f4f477fe700 1 -- 172.21.15.72:0/2502038917 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5000c9b0 con 0x7f4f6009e930 2023-10-03T10:18:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.752+0000 7f4f6573e700 1 -- 172.21.15.72:0/2502038917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f58009a70 con 0x7f4f6009e930 2023-10-03T10:18:02.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.752+0000 7f4f477fe700 1 -- 172.21.15.72:0/2502038917 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5000cd40 con 0x7f4f6009e930 2023-10-03T10:18:02.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.752+0000 7f4f6573e700 1 -- 172.21.15.72:0/2502038917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f600a0190 con 0x7f4f6009e930 2023-10-03T10:18:02.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.753+0000 7f4f477fe700 1 -- 172.21.15.72:0/2502038917 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f50013470 con 0x7f4f6009e930 2023-10-03T10:18:02.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.753+0000 7f4f477fe700 1 -- 172.21.15.72:0/2502038917 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4f5003f830 con 0x7f4f6009e930 2023-10-03T10:18:02.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.753+0000 7f4f6573e700 1 -- 172.21.15.72:0/2502038917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f601a6ca0 con 0x7f4f6009e930 2023-10-03T10:18:02.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.758+0000 7f4f477fe700 1 -- 172.21.15.72:0/2502038917 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f500232f0 con 0x7f4f6009e930 2023-10-03T10:18:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.788+0000 7f89634fe700 1 Processor -- start 2023-10-03T10:18:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.789+0000 7f89634fe700 1 -- start start 2023-10-03T10:18:02.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.789+0000 7f89634fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f895c09e1d0 0x7f895c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.789+0000 7f89634fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895c135e50 0x7f895c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.789+0000 7f89634fe700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895c09f130 con 0x7f895c09d6f0 2023-10-03T10:18:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.789+0000 7f89634fe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c09f520 con 0x7f895c135e50 2023-10-03T10:18:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.789+0000 7f89634fe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f895c09e930 con 0x7f895c09e1d0 2023-10-03T10:18:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.789+0000 7f896129a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f895c09d6f0 0x7f895c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36564/0 (socket says 172.21.15.72:36564) 2023-10-03T10:18:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.789+0000 7f896129a700 1 -- 172.21.15.72:0/1260000088 learned_addr learned my addr 172.21.15.72:0/1260000088 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:02.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.789+0000 7f8961a9b700 1 --2- 172.21.15.72:0/1260000088 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895c135e50 0x7f895c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.789+0000 7f8960a99700 1 --2- 172.21.15.72:0/1260000088 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f895c09e1d0 0x7f895c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.790+0000 7f8953fff700 1 -- 172.21.15.72:0/1260000088 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260042708 0 0) 0x7f895c09f130 con 0x7f895c09d6f0 2023-10-03T10:18:02.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.790+0000 7f8953fff700 1 -- 172.21.15.72:0/1260000088 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89480035b0 con 0x7f895c09d6f0 2023-10-03T10:18:02.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.790+0000 7f8961a9b700 1 -- 172.21.15.72:0/1260000088 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f895c09e1d0 msgr2=0x7f895c135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.790+0000 7f8961a9b700 1 --2- 172.21.15.72:0/1260000088 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f895c09e1d0 0x7f895c135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.790+0000 7f8961a9b700 1 -- 172.21.15.72:0/1260000088 >> v1:172.21.15.72:6789/0 conn(0x7f895c09d6f0 legacy=0x7f895c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.790+0000 7f8961a9b700 1 -- 172.21.15.72:0/1260000088 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c09b2d0 con 0x7f895c135e50 2023-10-03T10:18:02.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.790+0000 7f8961a9b700 1 --2- 172.21.15.72:0/1260000088 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895c135e50 0x7f895c138230 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8954009dc0 tx=0x7f895400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0e57856eeecc553 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.790+0000 7f8953fff700 1 -- 172.21.15.72:0/1260000088 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895400e070 con 0x7f895c135e50 2023-10-03T10:18:02.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.790+0000 7f8953fff700 1 -- 172.21.15.72:0/1260000088 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895400bb20 con 0x7f895c135e50 2023-10-03T10:18:02.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.790+0000 7f8953fff700 1 -- 172.21.15.72:0/1260000088 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895400be90 con 0x7f895c135e50 2023-10-03T10:18:02.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.791+0000 7f89634fe700 1 -- 172.21.15.72:0/1260000088 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895c135e50 msgr2=0x7f895c138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.791+0000 7f89634fe700 1 --2- 172.21.15.72:0/1260000088 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895c135e50 0x7f895c138230 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8954009dc0 tx=0x7f895400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.791+0000 7f89634fe700 1 -- 172.21.15.72:0/1260000088 shutdown_connections 2023-10-03T10:18:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.791+0000 7f89634fe700 1 --2- 172.21.15.72:0/1260000088 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895c135e50 0x7f895c138230 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.791+0000 7f89634fe700 1 --2- 172.21.15.72:0/1260000088 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f895c09e1d0 0x7f895c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.791+0000 7f89634fe700 1 -- 172.21.15.72:0/1260000088 >> 172.21.15.72:0/1260000088 conn(0x7f895c066f50 msgr2=0x7f895c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.791+0000 7f89634fe700 1 -- 172.21.15.72:0/1260000088 shutdown_connections 2023-10-03T10:18:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.791+0000 7f89634fe700 1 -- 172.21.15.72:0/1260000088 wait complete. 2023-10-03T10:18:02.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.792+0000 7f89634fe700 1 Processor -- start 2023-10-03T10:18:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.792+0000 7f89634fe700 1 -- start start 2023-10-03T10:18:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.792+0000 7f89634fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f895c09d6f0 0x7f895c1c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.792+0000 7f89634fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f895c09e1d0 0x7f895c1c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.792+0000 7f89634fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895c135e50 0x7f895c1c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.792+0000 7f89634fe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c122090 con 0x7f895c09d6f0 2023-10-03T10:18:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.792+0000 7f89634fe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c09a0c0 con 0x7f895c135e50 2023-10-03T10:18:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.792+0000 7f89634fe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f895c09c700 con 0x7f895c09e1d0 2023-10-03T10:18:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.792+0000 7f8960a99700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f895c09e1d0 0x7f895c1c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.792+0000 7f8961a9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895c135e50 0x7f895c1c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.792+0000 7f8960a99700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f895c09e1d0 0x7f895c1c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37936/0 (socket says 172.21.15.72:37936) 2023-10-03T10:18:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.792+0000 7f8960a99700 1 -- 172.21.15.72:0/4134718392 learned_addr learned my addr 172.21.15.72:0/4134718392 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.792+0000 7f896129a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f895c09d6f0 0x7f895c1c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.793+0000 7f8961a9b700 1 -- 172.21.15.72:0/4134718392 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f895c09e1d0 msgr2=0x7f895c1c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.793+0000 7f8961a9b700 1 --2- 172.21.15.72:0/4134718392 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f895c09e1d0 0x7f895c1c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.793+0000 7f8961a9b700 1 -- 172.21.15.72:0/4134718392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f895c09d6f0 msgr2=0x7f895c1c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.793+0000 7f8961a9b700 1 --2- 172.21.15.72:0/4134718392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f895c09d6f0 0x7f895c1c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.793+0000 7f8961a9b700 1 -- 172.21.15.72:0/4134718392 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8954009a70 con 0x7f895c135e50 2023-10-03T10:18:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.793+0000 7f896129a700 1 --2- 172.21.15.72:0/4134718392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f895c09d6f0 0x7f895c1c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.793+0000 7f8961a9b700 1 --2- 172.21.15.72:0/4134718392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895c135e50 0x7f895c1c8d00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f895c09f6f0 tx=0x7f8954004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.793+0000 7f8951ffb700 1 -- 172.21.15.72:0/4134718392 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954007000 con 0x7f895c135e50 2023-10-03T10:18:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.793+0000 7f8951ffb700 1 -- 172.21.15.72:0/4134718392 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8954020070 con 0x7f895c135e50 2023-10-03T10:18:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.793+0000 7f89634fe700 1 -- 172.21.15.72:0/4134718392 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895c11b520 con 0x7f895c135e50 2023-10-03T10:18:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.793+0000 7f8951ffb700 1 -- 172.21.15.72:0/4134718392 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954009480 con 0x7f895c135e50 2023-10-03T10:18:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.793+0000 7f89634fe700 1 -- 172.21.15.72:0/4134718392 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895c06b280 con 0x7f895c135e50 2023-10-03T10:18:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.794+0000 7f8951ffb700 1 -- 172.21.15.72:0/4134718392 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8954027480 con 0x7f895c135e50 2023-10-03T10:18:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.794+0000 7f8951ffb700 1 -- 172.21.15.72:0/4134718392 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8954022070 con 0x7f895c135e50 2023-10-03T10:18:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.794+0000 7f89634fe700 1 -- 172.21.15.72:0/4134718392 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895c074ea0 con 0x7f895c135e50 2023-10-03T10:18:02.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.799+0000 7f8951ffb700 1 -- 172.21.15.72:0/4134718392 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89540117a0 con 0x7f895c135e50 2023-10-03T10:18:02.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.907+0000 7f6bdd36c700 1 -- 172.21.15.72:0/2934340555 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6bd81379b0 con 0x7f6bd809f0f0 2023-10-03T10:18:02.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.907+0000 7f6bbf7fe700 1 -- 172.21.15.72:0/2934340555 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6bcc017020 con 0x7f6bd809f0f0 2023-10-03T10:18:02.908 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:02.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.910+0000 7f6bdd36c700 1 -- 172.21.15.72:0/2934340555 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bd809f0f0 msgr2=0x7f6bd8121cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.910+0000 7f6bdd36c700 1 --2- 172.21.15.72:0/2934340555 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bd809f0f0 0x7f6bd8121cc0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00c500 tx=0x7f6bcc00c810 comp rx=0 tx=0).stop 2023-10-03T10:18:02.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.910+0000 7f6bdd36c700 1 -- 172.21.15.72:0/2934340555 shutdown_connections 2023-10-03T10:18:02.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.910+0000 7f6bdd36c700 1 --2- 172.21.15.72:0/2934340555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bd809e7e0 0x7f6bd8121780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.910+0000 7f6bdd36c700 1 --2- 172.21.15.72:0/2934340555 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bd81391d0 0x7f6bd8122200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.910+0000 7f6bdd36c700 1 --2- 172.21.15.72:0/2934340555 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6bd809f0f0 0x7f6bd8121cc0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.910+0000 7f6bdd36c700 1 -- 172.21.15.72:0/2934340555 >> 172.21.15.72:0/2934340555 conn(0x7f6bd80a4300 msgr2=0x7f6bd8070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.910+0000 7f6bdd36c700 1 -- 172.21.15.72:0/2934340555 shutdown_connections 2023-10-03T10:18:02.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.910+0000 7f6bdd36c700 1 -- 172.21.15.72:0/2934340555 wait complete. 2023-10-03T10:18:02.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:02.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.929+0000 7f2a150a0700 1 Processor -- start 2023-10-03T10:18:02.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.929+0000 7f2a150a0700 1 -- start start 2023-10-03T10:18:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.929+0000 7f2a150a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a10136710 0x7f2a10138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.929+0000 7f2a150a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a10139030 0x7f2a1013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.929+0000 7f2a150a0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a1006ef30 con 0x7f2a101338a0 2023-10-03T10:18:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.929+0000 7f2a150a0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1006fef0 con 0x7f2a10139030 2023-10-03T10:18:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.929+0000 7f2a150a0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a101334b0 con 0x7f2a10136710 2023-10-03T10:18:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.930+0000 7f2a0ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2a101338a0 0x7f2a10133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36574/0 (socket says 172.21.15.72:36574) 2023-10-03T10:18:02.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.930+0000 7f2a0ed9d700 1 -- 172.21.15.72:0/4195314150 learned_addr learned my addr 172.21.15.72:0/4195314150 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:02.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.930+0000 7f2a0e59c700 1 --2- 172.21.15.72:0/4195314150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a10136710 0x7f2a10138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.930+0000 7f2a0f59e700 1 --2- 172.21.15.72:0/4195314150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a10139030 0x7f2a1013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.930+0000 7f2a0e59c700 1 -- 172.21.15.72:0/4195314150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a10139030 msgr2=0x7f2a1013b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.930+0000 7f2a0e59c700 1 --2- 172.21.15.72:0/4195314150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a10139030 0x7f2a1013b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.930+0000 7f2a0e59c700 1 -- 172.21.15.72:0/4195314150 >> v1:172.21.15.72:6789/0 conn(0x7f2a101338a0 legacy=0x7f2a10133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.930+0000 7f2a0e59c700 1 -- 172.21.15.72:0/4195314150 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1006fc30 con 0x7f2a10136710 2023-10-03T10:18:02.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.930+0000 7f2a0e59c700 1 --2- 172.21.15.72:0/4195314150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a10136710 0x7f2a10138af0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009870 tx=0x7f2a04009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61d4f73a4213d15c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.930+0000 7f2a0dd9b700 1 -- 172.21.15.72:0/4195314150 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04011830 con 0x7f2a10136710 2023-10-03T10:18:02.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.930+0000 7f2a0dd9b700 1 -- 172.21.15.72:0/4195314150 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a04011990 con 0x7f2a10136710 2023-10-03T10:18:02.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.930+0000 7f2a0dd9b700 1 -- 172.21.15.72:0/4195314150 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04011d20 con 0x7f2a10136710 2023-10-03T10:18:02.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.931+0000 7f2a150a0700 1 -- 172.21.15.72:0/4195314150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a10136710 msgr2=0x7f2a10138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.931+0000 7f2a150a0700 1 --2- 172.21.15.72:0/4195314150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a10136710 0x7f2a10138af0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009870 tx=0x7f2a04009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:02.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.931+0000 7f2a150a0700 1 -- 172.21.15.72:0/4195314150 shutdown_connections 2023-10-03T10:18:02.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.931+0000 7f2a150a0700 1 --2- 172.21.15.72:0/4195314150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a10139030 0x7f2a1013b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.931+0000 7f2a150a0700 1 --2- 172.21.15.72:0/4195314150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a10136710 0x7f2a10138af0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.931+0000 7f2a150a0700 1 -- 172.21.15.72:0/4195314150 >> 172.21.15.72:0/4195314150 conn(0x7f2a100a2aa0 msgr2=0x7f2a100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.931+0000 7f2a150a0700 1 -- 172.21.15.72:0/4195314150 shutdown_connections 2023-10-03T10:18:02.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.931+0000 7f2a150a0700 1 -- 172.21.15.72:0/4195314150 wait complete. 2023-10-03T10:18:02.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.932+0000 7f2a150a0700 1 Processor -- start 2023-10-03T10:18:02.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.932+0000 7f2a150a0700 1 -- start start 2023-10-03T10:18:02.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a150a0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a101338a0 0x7f2a101c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a150a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a10136710 0x7f2a101c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a150a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a10139030 0x7f2a1011ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a150a0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1011e690 con 0x7f2a101338a0 2023-10-03T10:18:02.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a150a0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a101c9160 con 0x7f2a10136710 2023-10-03T10:18:02.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a150a0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10138b00 con 0x7f2a10139030 2023-10-03T10:18:02.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a0ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a101338a0 0x7f2a101c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a0e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a10136710 0x7f2a101c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a0ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a101338a0 0x7f2a101c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41234/0 (socket says 172.21.15.72:41234) 2023-10-03T10:18:02.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a0e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a10136710 0x7f2a101c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:36796/0 (socket says 172.21.15.72:36796) 2023-10-03T10:18:02.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a0ed9d700 1 -- 172.21.15.72:0/4145602952 learned_addr learned my addr 172.21.15.72:0/4145602952 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:02.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a0f59e700 1 --2- 172.21.15.72:0/4145602952 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a10139030 0x7f2a1011ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a0e59c700 1 -- 172.21.15.72:0/4145602952 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a10139030 msgr2=0x7f2a1011ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a0e59c700 1 --2- 172.21.15.72:0/4145602952 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a10139030 0x7f2a1011ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a0e59c700 1 -- 172.21.15.72:0/4145602952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a101338a0 msgr2=0x7f2a101c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a0e59c700 1 --2- 172.21.15.72:0/4145602952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a101338a0 0x7f2a101c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a0e59c700 1 -- 172.21.15.72:0/4145602952 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a040094a0 con 0x7f2a10136710 2023-10-03T10:18:02.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a0ed9d700 1 --2- 172.21.15.72:0/4145602952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a101338a0 0x7f2a101c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a0e59c700 1 --2- 172.21.15.72:0/4145602952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a10136710 0x7f2a101c8c20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2a04016000 tx=0x7f2a04004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f29f77fe700 1 -- 172.21.15.72:0/4145602952 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a04004450 con 0x7f2a10136710 2023-10-03T10:18:02.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f29f77fe700 1 -- 172.21.15.72:0/4145602952 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0401f070 con 0x7f2a10136710 2023-10-03T10:18:02.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f29f77fe700 1 -- 172.21.15.72:0/4145602952 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a040038e0 con 0x7f2a10136710 2023-10-03T10:18:02.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.933+0000 7f2a150a0700 1 -- 172.21.15.72:0/4145602952 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1006f6a0 con 0x7f2a10136710 2023-10-03T10:18:02.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.934+0000 7f2a150a0700 1 -- 172.21.15.72:0/4145602952 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1011e9e0 con 0x7f2a10136710 2023-10-03T10:18:02.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.934+0000 7f2a150a0700 1 -- 172.21.15.72:0/4145602952 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a10074ea0 con 0x7f2a10136710 2023-10-03T10:18:02.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.934+0000 7f29f77fe700 1 -- 172.21.15.72:0/4145602952 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a04003a40 con 0x7f2a10136710 2023-10-03T10:18:02.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.935+0000 7f29f77fe700 1 -- 172.21.15.72:0/4145602952 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2a04021070 con 0x7f2a10136710 2023-10-03T10:18:02.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.939+0000 7f29f77fe700 1 -- 172.21.15.72:0/4145602952 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a04010380 con 0x7f2a10136710 2023-10-03T10:18:02.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.986+0000 7f4f6573e700 1 -- 172.21.15.72:0/2502038917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4f60074ea0 con 0x7f4f6009e930 2023-10-03T10:18:02.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.986+0000 7f4f477fe700 1 -- 172.21.15.72:0/2502038917 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4f50021020 con 0x7f4f6009e930 2023-10-03T10:18:02.987 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.988+0000 7f4f6573e700 1 -- 172.21.15.72:0/2502038917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f6009e930 msgr2=0x7f4f601a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.988+0000 7f4f6573e700 1 --2- 172.21.15.72:0/2502038917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f6009e930 0x7f4f601a43d0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000ebe0 tx=0x7f4f5000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.988+0000 7f4f6573e700 1 -- 172.21.15.72:0/2502038917 shutdown_connections 2023-10-03T10:18:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.988+0000 7f4f6573e700 1 --2- 172.21.15.72:0/2502038917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f6009e930 0x7f4f601a43d0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.988+0000 7f4f6573e700 1 --2- 172.21.15.72:0/2502038917 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f6009f650 0x7f4f601c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.988+0000 7f4f6573e700 1 --2- 172.21.15.72:0/2502038917 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f6009f240 0x7f4f601a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.988+0000 7f4f6573e700 1 -- 172.21.15.72:0/2502038917 >> 172.21.15.72:0/2502038917 conn(0x7f4f600a4210 msgr2=0x7f4f601b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.988+0000 7f4f6573e700 1 -- 172.21.15.72:0/2502038917 shutdown_connections 2023-10-03T10:18:02.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:02.988+0000 7f4f6573e700 1 -- 172.21.15.72:0/2502038917 wait complete. 2023-10-03T10:18:03.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:03.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.022+0000 7f89634fe700 1 -- 172.21.15.72:0/4134718392 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f895c06ec10 con 0x7f895c135e50 2023-10-03T10:18:03.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.023+0000 7f8951ffb700 1 -- 172.21.15.72:0/4134718392 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8954036090 con 0x7f895c135e50 2023-10-03T10:18:03.024 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:03.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.025+0000 7f89634fe700 1 -- 172.21.15.72:0/4134718392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895c135e50 msgr2=0x7f895c1c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.025+0000 7f89634fe700 1 --2- 172.21.15.72:0/4134718392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895c135e50 0x7f895c1c8d00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f895c09f6f0 tx=0x7f8954004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.025+0000 7f89634fe700 1 -- 172.21.15.72:0/4134718392 shutdown_connections 2023-10-03T10:18:03.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.025+0000 7f89634fe700 1 --2- 172.21.15.72:0/4134718392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f895c09d6f0 0x7f895c1c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.025+0000 7f89634fe700 1 --2- 172.21.15.72:0/4134718392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f895c135e50 0x7f895c1c8d00 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.025+0000 7f89634fe700 1 --2- 172.21.15.72:0/4134718392 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f895c09e1d0 0x7f895c1c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.025+0000 7f89634fe700 1 -- 172.21.15.72:0/4134718392 >> 172.21.15.72:0/4134718392 conn(0x7f895c066f50 msgr2=0x7f895c1339c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.025+0000 7f89634fe700 1 -- 172.21.15.72:0/4134718392 shutdown_connections 2023-10-03T10:18:03.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.025+0000 7f89634fe700 1 -- 172.21.15.72:0/4134718392 wait complete. 2023-10-03T10:18:03.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:03.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.131+0000 7f2a150a0700 1 -- 172.21.15.72:0/4145602952 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2a1011e440 con 0x7f2a10136710 2023-10-03T10:18:03.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.131+0000 7f29f77fe700 1 -- 172.21.15.72:0/4145602952 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a0402b030 con 0x7f2a10136710 2023-10-03T10:18:03.132 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:03.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.133+0000 7f2a150a0700 1 -- 172.21.15.72:0/4145602952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a10136710 msgr2=0x7f2a101c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.133+0000 7f2a150a0700 1 --2- 172.21.15.72:0/4145602952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a10136710 0x7f2a101c8c20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2a04016000 tx=0x7f2a04004750 comp rx=0 tx=0).stop 2023-10-03T10:18:03.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.133+0000 7f2a150a0700 1 -- 172.21.15.72:0/4145602952 shutdown_connections 2023-10-03T10:18:03.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.133+0000 7f2a150a0700 1 --2- 172.21.15.72:0/4145602952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a101338a0 0x7f2a101c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.133+0000 7f2a150a0700 1 --2- 172.21.15.72:0/4145602952 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a10139030 0x7f2a1011ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.133+0000 7f2a150a0700 1 --2- 172.21.15.72:0/4145602952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a10136710 0x7f2a101c8c20 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.133+0000 7f2a150a0700 1 -- 172.21.15.72:0/4145602952 >> 172.21.15.72:0/4145602952 conn(0x7f2a100a2aa0 msgr2=0x7f2a10137270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.133+0000 7f2a150a0700 1 -- 172.21.15.72:0/4145602952 shutdown_connections 2023-10-03T10:18:03.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:03.133+0000 7f2a150a0700 1 -- 172.21.15.72:0/4145602952 wait complete. 2023-10-03T10:18:03.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:03.924 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:04.003 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:04.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:04.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.062+0000 7f624bb42700 1 Processor -- start 2023-10-03T10:18:04.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.062+0000 7f624bb42700 1 -- start start 2023-10-03T10:18:04.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.063+0000 7f624bb42700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f62441338a0 0x7f6244133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.063+0000 7f624bb42700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f624409de50 0x7f624409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.063+0000 7f624bb42700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624406ef30 con 0x7f624409e760 2023-10-03T10:18:04.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.063+0000 7f624bb42700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624406fef0 con 0x7f62441338a0 2023-10-03T10:18:04.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.063+0000 7f624bb42700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62441334b0 con 0x7f624409de50 2023-10-03T10:18:04.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.063+0000 7f62490dd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f624409de50 0x7f624409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.063+0000 7f62498de700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f62441338a0 0x7f6244133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.063+0000 7f62490dd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f624409de50 0x7f624409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:36804/0 (socket says 172.21.15.72:36804) 2023-10-03T10:18:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.063+0000 7f62490dd700 1 -- 172.21.15.72:0/3506452363 learned_addr learned my addr 172.21.15.72:0/3506452363 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.063+0000 7f62498de700 1 -- 172.21.15.72:0/3506452363 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f624409de50 msgr2=0x7f624409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.063+0000 7f62498de700 1 --2- 172.21.15.72:0/3506452363 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f624409de50 0x7f624409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.063+0000 7f62498de700 1 -- 172.21.15.72:0/3506452363 >> v1:172.21.15.72:6789/0 conn(0x7f624409e760 legacy=0x7f624413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.063+0000 7f62498de700 1 -- 172.21.15.72:0/3506452363 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624406fc30 con 0x7f62441338a0 2023-10-03T10:18:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.064+0000 7f62498de700 1 --2- 172.21.15.72:0/3506452363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62441338a0 0x7f6244133c70 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f6240009840 tx=0x7f6240009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e506b404a4c677 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.064+0000 7f62488dc700 1 -- 172.21.15.72:0/3506452363 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6240011830 con 0x7f62441338a0 2023-10-03T10:18:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.064+0000 7f62488dc700 1 -- 172.21.15.72:0/3506452363 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6240011990 con 0x7f62441338a0 2023-10-03T10:18:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.064+0000 7f62488dc700 1 -- 172.21.15.72:0/3506452363 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6240011d20 con 0x7f62441338a0 2023-10-03T10:18:04.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.064+0000 7f624bb42700 1 -- 172.21.15.72:0/3506452363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62441338a0 msgr2=0x7f6244133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.064+0000 7f624bb42700 1 --2- 172.21.15.72:0/3506452363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62441338a0 0x7f6244133c70 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f6240009840 tx=0x7f6240009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:04.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.064+0000 7f624bb42700 1 -- 172.21.15.72:0/3506452363 shutdown_connections 2023-10-03T10:18:04.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.064+0000 7f624bb42700 1 --2- 172.21.15.72:0/3506452363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62441338a0 0x7f6244133c70 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.064+0000 7f624bb42700 1 --2- 172.21.15.72:0/3506452363 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f624409de50 0x7f624409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.064+0000 7f624bb42700 1 -- 172.21.15.72:0/3506452363 >> 172.21.15.72:0/3506452363 conn(0x7f62440a2aa0 msgr2=0x7f62440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.065+0000 7f624bb42700 1 -- 172.21.15.72:0/3506452363 shutdown_connections 2023-10-03T10:18:04.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.065+0000 7f624bb42700 1 -- 172.21.15.72:0/3506452363 wait complete. 2023-10-03T10:18:04.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.065+0000 7f624bb42700 1 Processor -- start 2023-10-03T10:18:04.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.065+0000 7f624bb42700 1 -- start start 2023-10-03T10:18:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f624bb42700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f624409de50 0x7f624411eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f624bb42700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f624409e760 0x7f624411f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f624bb42700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62441338a0 0x7f624411f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f624bb42700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624412f6e0 con 0x7f624409de50 2023-10-03T10:18:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f624bb42700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6244121ce0 con 0x7f624409e760 2023-10-03T10:18:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f624bb42700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62441206f0 con 0x7f62441338a0 2023-10-03T10:18:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f62498de700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f624409de50 0x7f624411eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f62498de700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f624409de50 0x7f624411eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41244/0 (socket says 172.21.15.72:41244) 2023-10-03T10:18:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f62498de700 1 -- 172.21.15.72:0/677221987 learned_addr learned my addr 172.21.15.72:0/677221987 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f624a0df700 1 --2- 172.21.15.72:0/677221987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62441338a0 0x7f624411f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f62490dd700 1 --2- 172.21.15.72:0/677221987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f624409e760 0x7f624411f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f62498de700 1 -- 172.21.15.72:0/677221987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62441338a0 msgr2=0x7f624411f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f62498de700 1 --2- 172.21.15.72:0/677221987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62441338a0 0x7f624411f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f62498de700 1 -- 172.21.15.72:0/677221987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f624409e760 msgr2=0x7f624411f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f62498de700 1 --2- 172.21.15.72:0/677221987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f624409e760 0x7f624411f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f62498de700 1 -- 172.21.15.72:0/677221987 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400094a0 con 0x7f624409de50 2023-10-03T10:18:04.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.066+0000 7f624a0df700 1 --2- 172.21.15.72:0/677221987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62441338a0 0x7f624411f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.067+0000 7f62498de700 1 --2- 172.21.15.72:0/677221987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f624409de50 0x7f624411eae0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f62400090b0 tx=0x7f6240004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.067+0000 7f623a7fc700 1 -- 172.21.15.72:0/677221987 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400036a0 con 0x7f624409de50 2023-10-03T10:18:04.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.067+0000 7f623a7fc700 1 -- 172.21.15.72:0/677221987 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624001f070 con 0x7f624409de50 2023-10-03T10:18:04.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.067+0000 7f624bb42700 1 -- 172.21.15.72:0/677221987 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6244122600 con 0x7f624409de50 2023-10-03T10:18:04.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.067+0000 7f623a7fc700 1 -- 172.21.15.72:0/677221987 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6240003a40 con 0x7f624409de50 2023-10-03T10:18:04.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.067+0000 7f624bb42700 1 -- 172.21.15.72:0/677221987 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6244122320 con 0x7f624409de50 2023-10-03T10:18:04.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.068+0000 7f623a7fc700 1 -- 172.21.15.72:0/677221987 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6240003ba0 con 0x7f624409de50 2023-10-03T10:18:04.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.068+0000 7f624bb42700 1 -- 172.21.15.72:0/677221987 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6244074ea0 con 0x7f624409de50 2023-10-03T10:18:04.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.068+0000 7f623a7fc700 1 -- 172.21.15.72:0/677221987 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6240021070 con 0x7f624409de50 2023-10-03T10:18:04.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.077+0000 7f623a7fc700 1 -- 172.21.15.72:0/677221987 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6240019d80 con 0x7f624409de50 2023-10-03T10:18:04.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.137+0000 7f0a8ade3700 1 Processor -- start 2023-10-03T10:18:04.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.137+0000 7f0a8ade3700 1 -- start start 2023-10-03T10:18:04.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a8ade3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a8409d9f0 0x7f0a84136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a8ade3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a84136a70 0x7f0a84138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a8ade3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8409e130 con 0x7f0a841316c0 2023-10-03T10:18:04.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a8ade3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a841321a0 con 0x7f0a8409d9f0 2023-10-03T10:18:04.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a8ade3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a841312b0 con 0x7f0a84136a70 2023-10-03T10:18:04.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a83fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a8409d9f0 0x7f0a84136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a88b7f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0a841316c0 0x7f0a84131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36596/0 (socket says 172.21.15.72:36596) 2023-10-03T10:18:04.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a83fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a8409d9f0 0x7f0a84136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41248/0 (socket says 172.21.15.72:41248) 2023-10-03T10:18:04.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a88b7f700 1 -- 172.21.15.72:0/3675155019 learned_addr learned my addr 172.21.15.72:0/3675155019 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:04.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a89380700 1 --2- 172.21.15.72:0/3675155019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a84136a70 0x7f0a84138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a83fff700 1 -- 172.21.15.72:0/3675155019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a84136a70 msgr2=0x7f0a84138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a83fff700 1 --2- 172.21.15.72:0/3675155019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a84136a70 0x7f0a84138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a83fff700 1 -- 172.21.15.72:0/3675155019 >> v1:172.21.15.72:6789/0 conn(0x7f0a841316c0 legacy=0x7f0a84131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a83fff700 1 -- 172.21.15.72:0/3675155019 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8409f6e0 con 0x7f0a8409d9f0 2023-10-03T10:18:04.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a837fe700 1 -- 172.21.15.72:0/3675155019 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873552431 0 0) 0x7f0a78001110 con 0x7f0a841316c0 2023-10-03T10:18:04.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a89380700 1 --2- 172.21.15.72:0/3675155019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a84136a70 0x7f0a84138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a83fff700 1 --2- 172.21.15.72:0/3675155019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a8409d9f0 0x7f0a84136530 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009840 tx=0x7f0a70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7066de71224ac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.138+0000 7f0a837fe700 1 -- 172.21.15.72:0/3675155019 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70011830 con 0x7f0a8409d9f0 2023-10-03T10:18:04.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.139+0000 7f0a837fe700 1 -- 172.21.15.72:0/3675155019 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a70011990 con 0x7f0a8409d9f0 2023-10-03T10:18:04.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.139+0000 7f0a837fe700 1 -- 172.21.15.72:0/3675155019 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70011d20 con 0x7f0a8409d9f0 2023-10-03T10:18:04.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.139+0000 7f0a8ade3700 1 -- 172.21.15.72:0/3675155019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a8409d9f0 msgr2=0x7f0a84136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.139+0000 7f0a8ade3700 1 --2- 172.21.15.72:0/3675155019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a8409d9f0 0x7f0a84136530 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009840 tx=0x7f0a70009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:04.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.139+0000 7f0a8ade3700 1 -- 172.21.15.72:0/3675155019 shutdown_connections 2023-10-03T10:18:04.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.139+0000 7f0a8ade3700 1 --2- 172.21.15.72:0/3675155019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a84136a70 0x7f0a84138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.139+0000 7f0a8ade3700 1 --2- 172.21.15.72:0/3675155019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a8409d9f0 0x7f0a84136530 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.139+0000 7f0a8ade3700 1 -- 172.21.15.72:0/3675155019 >> 172.21.15.72:0/3675155019 conn(0x7f0a84066f50 msgr2=0x7f0a8409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.139+0000 7f0a8ade3700 1 -- 172.21.15.72:0/3675155019 shutdown_connections 2023-10-03T10:18:04.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.139+0000 7f0a8ade3700 1 -- 172.21.15.72:0/3675155019 wait complete. 2023-10-03T10:18:04.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.140+0000 7f0a8ade3700 1 Processor -- start 2023-10-03T10:18:04.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.140+0000 7f0a8ade3700 1 -- start start 2023-10-03T10:18:04.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a8ade3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a8409d9f0 0x7f0a8412ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a8ade3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a841316c0 0x7f0a8412b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a8ade3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a84136a70 0x7f0a841342f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a8ade3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8409b650 con 0x7f0a841316c0 2023-10-03T10:18:04.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a8ade3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8409c3a0 con 0x7f0a84136a70 2023-10-03T10:18:04.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a8ade3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8409b840 con 0x7f0a8409d9f0 2023-10-03T10:18:04.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a83fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a841316c0 0x7f0a8412b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a83fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a841316c0 0x7f0a8412b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41256/0 (socket says 172.21.15.72:41256) 2023-10-03T10:18:04.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a83fff700 1 -- 172.21.15.72:0/1963033347 learned_addr learned my addr 172.21.15.72:0/1963033347 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:04.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a88b7f700 1 --2- 172.21.15.72:0/1963033347 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a8409d9f0 0x7f0a8412ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a89380700 1 --2- 172.21.15.72:0/1963033347 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a84136a70 0x7f0a841342f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a88b7f700 1 -- 172.21.15.72:0/1963033347 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a84136a70 msgr2=0x7f0a841342f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a88b7f700 1 --2- 172.21.15.72:0/1963033347 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a84136a70 0x7f0a841342f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a88b7f700 1 -- 172.21.15.72:0/1963033347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a841316c0 msgr2=0x7f0a8412b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a88b7f700 1 --2- 172.21.15.72:0/1963033347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a841316c0 0x7f0a8412b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a88b7f700 1 -- 172.21.15.72:0/1963033347 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c009a70 con 0x7f0a8409d9f0 2023-10-03T10:18:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a83fff700 1 --2- 172.21.15.72:0/1963033347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a841316c0 0x7f0a8412b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a89380700 1 --2- 172.21.15.72:0/1963033347 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a84136a70 0x7f0a841342f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.141+0000 7f0a88b7f700 1 --2- 172.21.15.72:0/1963033347 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a8409d9f0 0x7f0a8412ae00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800c750 tx=0x7f0a7800ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.142+0000 7f0a817fa700 1 -- 172.21.15.72:0/1963033347 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78004c80 con 0x7f0a8409d9f0 2023-10-03T10:18:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.142+0000 7f0a817fa700 1 -- 172.21.15.72:0/1963033347 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a78004e00 con 0x7f0a8409d9f0 2023-10-03T10:18:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.142+0000 7f0a8ade3700 1 -- 172.21.15.72:0/1963033347 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a700094a0 con 0x7f0a8409d9f0 2023-10-03T10:18:04.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.142+0000 7f0a817fa700 1 -- 172.21.15.72:0/1963033347 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78007310 con 0x7f0a8409d9f0 2023-10-03T10:18:04.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:04.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.142+0000 7f0a8ade3700 1 -- 172.21.15.72:0/1963033347 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8409b120 con 0x7f0a8409d9f0 2023-10-03T10:18:04.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.142+0000 7f0a817fa700 1 -- 172.21.15.72:0/1963033347 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a78007470 con 0x7f0a8409d9f0 2023-10-03T10:18:04.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.143+0000 7f0a817fa700 1 -- 172.21.15.72:0/1963033347 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0a7803f100 con 0x7f0a8409d9f0 2023-10-03T10:18:04.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.143+0000 7f0a8ade3700 1 -- 172.21.15.72:0/1963033347 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8409e130 con 0x7f0a8409d9f0 2023-10-03T10:18:04.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.148+0000 7f0a817fa700 1 -- 172.21.15.72:0/1963033347 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a8409e130 con 0x7f0a8409d9f0 2023-10-03T10:18:04.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.176+0000 7ffb8a516700 1 Processor -- start 2023-10-03T10:18:04.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.176+0000 7ffb8a516700 1 -- start start 2023-10-03T10:18:04.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.177+0000 7ffb8a516700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb84130540 0x7ffb84130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.177+0000 7ffb8a516700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb84130e50 0x7ffb8406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.177+0000 7ffb8a516700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb840716a0 con 0x7ffb8406fb20 2023-10-03T10:18:04.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.177+0000 7ffb8a516700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8409a390 con 0x7ffb84130540 2023-10-03T10:18:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.177+0000 7ffb8a516700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb84071290 con 0x7ffb84130e50 2023-10-03T10:18:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.177+0000 7ffb83fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb84130540 0x7ffb84130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.177+0000 7ffb88ab3700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffb8406fb20 0x7ffb84137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36606/0 (socket says 172.21.15.72:36606) 2023-10-03T10:18:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.177+0000 7ffb83fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb84130540 0x7ffb84130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:36834/0 (socket says 172.21.15.72:36834) 2023-10-03T10:18:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.177+0000 7ffb88ab3700 1 -- 172.21.15.72:0/2030032948 learned_addr learned my addr 172.21.15.72:0/2030032948 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.177+0000 7ffb837fe700 1 --2- 172.21.15.72:0/2030032948 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb84130e50 0x7ffb8406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.177+0000 7ffb83fff700 1 -- 172.21.15.72:0/2030032948 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb84130e50 msgr2=0x7ffb8406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.177+0000 7ffb83fff700 1 --2- 172.21.15.72:0/2030032948 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb84130e50 0x7ffb8406f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.177+0000 7ffb83fff700 1 -- 172.21.15.72:0/2030032948 >> v1:172.21.15.72:6789/0 conn(0x7ffb8406fb20 legacy=0x7ffb84137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.177+0000 7ffb83fff700 1 -- 172.21.15.72:0/2030032948 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb84130340 con 0x7ffb84130540 2023-10-03T10:18:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.177+0000 7ffb837fe700 1 --2- 172.21.15.72:0/2030032948 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb84130e50 0x7ffb8406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.178+0000 7ffb83fff700 1 --2- 172.21.15.72:0/2030032948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb84130540 0x7ffb84130910 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ffb740098a0 tx=0x7ffb74009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81a3981c30229c9d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.178+0000 7ffb82ffd700 1 -- 172.21.15.72:0/2030032948 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74011830 con 0x7ffb84130540 2023-10-03T10:18:04.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.178+0000 7ffb82ffd700 1 -- 172.21.15.72:0/2030032948 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb74011990 con 0x7ffb84130540 2023-10-03T10:18:04.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.178+0000 7ffb82ffd700 1 -- 172.21.15.72:0/2030032948 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74011d20 con 0x7ffb84130540 2023-10-03T10:18:04.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.179+0000 7ffb8a516700 1 -- 172.21.15.72:0/2030032948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb84130540 msgr2=0x7ffb84130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.179+0000 7ffb8a516700 1 --2- 172.21.15.72:0/2030032948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb84130540 0x7ffb84130910 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ffb740098a0 tx=0x7ffb74009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.179+0000 7ffb8a516700 1 -- 172.21.15.72:0/2030032948 shutdown_connections 2023-10-03T10:18:04.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.179+0000 7ffb8a516700 1 --2- 172.21.15.72:0/2030032948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb84130540 0x7ffb84130910 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.179+0000 7ffb8a516700 1 --2- 172.21.15.72:0/2030032948 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb84130e50 0x7ffb8406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.179+0000 7ffb8a516700 1 -- 172.21.15.72:0/2030032948 >> 172.21.15.72:0/2030032948 conn(0x7ffb840a2aa0 msgr2=0x7ffb840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.179+0000 7ffb8a516700 1 -- 172.21.15.72:0/2030032948 shutdown_connections 2023-10-03T10:18:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.179+0000 7ffb8a516700 1 -- 172.21.15.72:0/2030032948 wait complete. 2023-10-03T10:18:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.180+0000 7ffb8a516700 1 Processor -- start 2023-10-03T10:18:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.180+0000 7ffb8a516700 1 -- start start 2023-10-03T10:18:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb8a516700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb8406fb20 0x7ffb8412abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb8a516700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb84130540 0x7ffb8412b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb8a516700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb84130e50 0x7ffb841c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb8a516700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8412ddf0 con 0x7ffb84130e50 2023-10-03T10:18:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb8a516700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8412a7e0 con 0x7ffb84130540 2023-10-03T10:18:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb8a516700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb84139a80 con 0x7ffb8406fb20 2023-10-03T10:18:04.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb837fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb84130540 0x7ffb8412b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb837fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb84130540 0x7ffb8412b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:36836/0 (socket says 172.21.15.72:36836) 2023-10-03T10:18:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb837fe700 1 -- 172.21.15.72:0/250946643 learned_addr learned my addr 172.21.15.72:0/250946643 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb88ab3700 1 --2- 172.21.15.72:0/250946643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb84130e50 0x7ffb841c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb83fff700 1 --2- 172.21.15.72:0/250946643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb8406fb20 0x7ffb8412abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb837fe700 1 -- 172.21.15.72:0/250946643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb8406fb20 msgr2=0x7ffb8412abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb837fe700 1 --2- 172.21.15.72:0/250946643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb8406fb20 0x7ffb8412abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb837fe700 1 -- 172.21.15.72:0/250946643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb84130e50 msgr2=0x7ffb841c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb837fe700 1 --2- 172.21.15.72:0/250946643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb84130e50 0x7ffb841c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb837fe700 1 -- 172.21.15.72:0/250946643 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb780094a0 con 0x7ffb84130540 2023-10-03T10:18:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.181+0000 7ffb837fe700 1 --2- 172.21.15.72:0/250946643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb84130540 0x7ffb8412b130 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800ebb0 tx=0x7ffb7800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.182+0000 7ffb80ff9700 1 -- 172.21.15.72:0/250946643 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800c850 con 0x7ffb84130540 2023-10-03T10:18:04.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.182+0000 7ffb80ff9700 1 -- 172.21.15.72:0/250946643 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7800c9b0 con 0x7ffb84130540 2023-10-03T10:18:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.182+0000 7ffb8a516700 1 -- 172.21.15.72:0/250946643 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb740094a0 con 0x7ffb84130540 2023-10-03T10:18:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.182+0000 7ffb80ff9700 1 -- 172.21.15.72:0/250946643 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800cd20 con 0x7ffb84130540 2023-10-03T10:18:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.182+0000 7ffb8a516700 1 -- 172.21.15.72:0/250946643 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8413a080 con 0x7ffb84130540 2023-10-03T10:18:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.182+0000 7ffb80ff9700 1 -- 172.21.15.72:0/250946643 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb78013470 con 0x7ffb84130540 2023-10-03T10:18:04.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.183+0000 7ffb8a516700 1 -- 172.21.15.72:0/250946643 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb84074ea0 con 0x7ffb84130540 2023-10-03T10:18:04.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.183+0000 7ffb80ff9700 1 -- 172.21.15.72:0/250946643 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb7801bd80 con 0x7ffb84130540 2023-10-03T10:18:04.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.188+0000 7ffb80ff9700 1 -- 172.21.15.72:0/250946643 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb78017070 con 0x7ffb84130540 2023-10-03T10:18:04.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.273+0000 7fcb97996700 1 Processor -- start 2023-10-03T10:18:04.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.273+0000 7fcb97996700 1 -- start start 2023-10-03T10:18:04.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb97996700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb9009d6f0 0x7fcb9009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb97996700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb9009e000 0x7fcb90130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb97996700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9009e410 0x7fcb90130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb97996700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9009f520 con 0x7fcb9009e000 2023-10-03T10:18:04.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb97996700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9009f130 con 0x7fcb9009d6f0 2023-10-03T10:18:04.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb97996700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9009e930 con 0x7fcb9009e410 2023-10-03T10:18:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb95732700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb9009d6f0 0x7fcb9009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb94f31700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb9009e000 0x7fcb90130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb95732700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb9009d6f0 0x7fcb9009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:36838/0 (socket says 172.21.15.72:36838) 2023-10-03T10:18:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb95732700 1 -- 172.21.15.72:0/1102874290 learned_addr learned my addr 172.21.15.72:0/1102874290 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb95f33700 1 --2- 172.21.15.72:0/1102874290 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9009e410 0x7fcb90130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb95732700 1 -- 172.21.15.72:0/1102874290 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9009e410 msgr2=0x7fcb90130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb95732700 1 --2- 172.21.15.72:0/1102874290 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9009e410 0x7fcb90130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb95732700 1 -- 172.21.15.72:0/1102874290 >> v2:172.21.15.72:3300/0 conn(0x7fcb9009e000 msgr2=0x7fcb90130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb95732700 1 --2- 172.21.15.72:0/1102874290 >> v2:172.21.15.72:3300/0 conn(0x7fcb9009e000 0x7fcb90130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb95732700 1 -- 172.21.15.72:0/1102874290 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9009b2d0 con 0x7fcb9009d6f0 2023-10-03T10:18:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb94f31700 1 --2- 172.21.15.72:0/1102874290 >> v2:172.21.15.72:3300/0 conn(0x7fcb9009e000 0x7fcb90130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.274+0000 7fcb95732700 1 --2- 172.21.15.72:0/1102874290 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb9009d6f0 0x7fcb9009dac0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00b9a0 tx=0x7fcb8c00bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88b26dd951cc237c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.275+0000 7fcb87fff700 1 -- 172.21.15.72:0/1102874290 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00caa0 con 0x7fcb9009d6f0 2023-10-03T10:18:04.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.275+0000 7fcb87fff700 1 -- 172.21.15.72:0/1102874290 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c00cc00 con 0x7fcb9009d6f0 2023-10-03T10:18:04.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.275+0000 7fcb87fff700 1 -- 172.21.15.72:0/1102874290 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00f460 con 0x7fcb9009d6f0 2023-10-03T10:18:04.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.275+0000 7fcb97996700 1 -- 172.21.15.72:0/1102874290 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb9009d6f0 msgr2=0x7fcb9009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.275+0000 7fcb97996700 1 --2- 172.21.15.72:0/1102874290 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb9009d6f0 0x7fcb9009dac0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00b9a0 tx=0x7fcb8c00bcb0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.275+0000 7fcb97996700 1 -- 172.21.15.72:0/1102874290 shutdown_connections 2023-10-03T10:18:04.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.275+0000 7fcb97996700 1 --2- 172.21.15.72:0/1102874290 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9009e410 0x7fcb90130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.275+0000 7fcb97996700 1 --2- 172.21.15.72:0/1102874290 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb9009d6f0 0x7fcb9009dac0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.275+0000 7fcb97996700 1 --2- 172.21.15.72:0/1102874290 >> v2:172.21.15.72:3300/0 conn(0x7fcb9009e000 0x7fcb90130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.275+0000 7fcb97996700 1 -- 172.21.15.72:0/1102874290 >> 172.21.15.72:0/1102874290 conn(0x7fcb90066f50 msgr2=0x7fcb9009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.276+0000 7fcb97996700 1 -- 172.21.15.72:0/1102874290 shutdown_connections 2023-10-03T10:18:04.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.276+0000 7fcb97996700 1 -- 172.21.15.72:0/1102874290 wait complete. 2023-10-03T10:18:04.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.276+0000 7fcb97996700 1 Processor -- start 2023-10-03T10:18:04.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.277+0000 7fcb97996700 1 -- start start 2023-10-03T10:18:04.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.277+0000 7fcb97996700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb9009d6f0 0x7fcb9011dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.277+0000 7fcb97996700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9009e000 0x7fcb9011e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.277+0000 7fcb97996700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9009e410 0x7fcb9011ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.277+0000 7fcb97996700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90121810 con 0x7fcb9009e410 2023-10-03T10:18:04.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.277+0000 7fcb97996700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90120200 con 0x7fcb9009d6f0 2023-10-03T10:18:04.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.277+0000 7fcb97996700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90121280 con 0x7fcb9009e000 2023-10-03T10:18:04.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.277+0000 7fcb95732700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb9009d6f0 0x7fcb9011dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.277+0000 7fcb95732700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb9009d6f0 0x7fcb9011dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:36840/0 (socket says 172.21.15.72:36840) 2023-10-03T10:18:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.277+0000 7fcb95732700 1 -- 172.21.15.72:0/69517014 learned_addr learned my addr 172.21.15.72:0/69517014 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.277+0000 7fcb95f33700 1 --2- 172.21.15.72:0/69517014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9009e410 0x7fcb9011ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.277+0000 7fcb94f31700 1 --2- 172.21.15.72:0/69517014 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9009e000 0x7fcb9011e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.277+0000 7fcb95732700 1 -- 172.21.15.72:0/69517014 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9009e000 msgr2=0x7fcb9011e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.277+0000 7fcb95732700 1 --2- 172.21.15.72:0/69517014 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9009e000 0x7fcb9011e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.277+0000 7fcb95732700 1 -- 172.21.15.72:0/69517014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9009e410 msgr2=0x7fcb9011ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.278+0000 7fcb95732700 1 --2- 172.21.15.72:0/69517014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9009e410 0x7fcb9011ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.278+0000 7fcb95732700 1 -- 172.21.15.72:0/69517014 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8000d940 con 0x7fcb9009d6f0 2023-10-03T10:18:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.278+0000 7fcb95732700 1 --2- 172.21.15.72:0/69517014 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb9009d6f0 0x7fcb9011dfd0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0090b0 tx=0x7fcb8c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.278+0000 7fcb85ffb700 1 -- 172.21.15.72:0/69517014 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c01c070 con 0x7fcb9009d6f0 2023-10-03T10:18:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.278+0000 7fcb85ffb700 1 -- 172.21.15.72:0/69517014 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c00c8a0 con 0x7fcb9009d6f0 2023-10-03T10:18:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.278+0000 7fcb85ffb700 1 -- 172.21.15.72:0/69517014 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c004250 con 0x7fcb9009d6f0 2023-10-03T10:18:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.278+0000 7fcb97996700 1 -- 172.21.15.72:0/69517014 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c00b600 con 0x7fcb9009d6f0 2023-10-03T10:18:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.278+0000 7fcb97996700 1 -- 172.21.15.72:0/69517014 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb90121af0 con 0x7fcb9009d6f0 2023-10-03T10:18:04.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.279+0000 7fcb97996700 1 -- 172.21.15.72:0/69517014 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb90120e90 con 0x7fcb9009d6f0 2023-10-03T10:18:04.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.280+0000 7fcb85ffb700 1 -- 172.21.15.72:0/69517014 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb8c0043b0 con 0x7fcb9009d6f0 2023-10-03T10:18:04.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.280+0000 7fcb85ffb700 1 -- 172.21.15.72:0/69517014 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcb8c041010 con 0x7fcb9009d6f0 2023-10-03T10:18:04.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.288+0000 7fcb85ffb700 1 -- 172.21.15.72:0/69517014 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb8c00ca10 con 0x7fcb9009d6f0 2023-10-03T10:18:04.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.305+0000 7f624bb42700 1 -- 172.21.15.72:0/677221987 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f62440a1110 con 0x7f624409de50 2023-10-03T10:18:04.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.305+0000 7f623a7fc700 1 -- 172.21.15.72:0/677221987 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6240015030 con 0x7f624409de50 2023-10-03T10:18:04.306 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:04.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.307+0000 7f624bb42700 1 -- 172.21.15.72:0/677221987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f624409de50 msgr2=0x7f624411eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.308+0000 7f624bb42700 1 --2- 172.21.15.72:0/677221987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f624409de50 0x7f624411eae0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f62400090b0 tx=0x7f6240004750 comp rx=0 tx=0).stop 2023-10-03T10:18:04.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.308+0000 7f624bb42700 1 -- 172.21.15.72:0/677221987 shutdown_connections 2023-10-03T10:18:04.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.308+0000 7f624bb42700 1 --2- 172.21.15.72:0/677221987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f624409de50 0x7f624411eae0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.308+0000 7f624bb42700 1 --2- 172.21.15.72:0/677221987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62441338a0 0x7f624411f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.308+0000 7f624bb42700 1 --2- 172.21.15.72:0/677221987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f624409e760 0x7f624411f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.308+0000 7f624bb42700 1 -- 172.21.15.72:0/677221987 >> 172.21.15.72:0/677221987 conn(0x7f62440a2aa0 msgr2=0x7f624409ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.308+0000 7f624bb42700 1 -- 172.21.15.72:0/677221987 shutdown_connections 2023-10-03T10:18:04.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.308+0000 7f624bb42700 1 -- 172.21.15.72:0/677221987 wait complete. 2023-10-03T10:18:04.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:04.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.377+0000 7f0a8ade3700 1 -- 172.21.15.72:0/1963033347 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0a8409e130 con 0x7f0a8409d9f0 2023-10-03T10:18:04.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.378+0000 7f0a817fa700 1 -- 172.21.15.72:0/1963033347 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0a8409e130 con 0x7f0a8409d9f0 2023-10-03T10:18:04.379 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:04.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.380+0000 7f0a8ade3700 1 -- 172.21.15.72:0/1963033347 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a8409d9f0 msgr2=0x7f0a8412ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.380+0000 7f0a8ade3700 1 --2- 172.21.15.72:0/1963033347 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a8409d9f0 0x7f0a8412ae00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800c750 tx=0x7f0a7800ca60 comp rx=0 tx=0).stop 2023-10-03T10:18:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.380+0000 7f0a8ade3700 1 -- 172.21.15.72:0/1963033347 shutdown_connections 2023-10-03T10:18:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.380+0000 7f0a8ade3700 1 --2- 172.21.15.72:0/1963033347 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0a84136a70 0x7f0a841342f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.380+0000 7f0a8ade3700 1 --2- 172.21.15.72:0/1963033347 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0a8409d9f0 0x7f0a8412ae00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.380+0000 7f0a8ade3700 1 --2- 172.21.15.72:0/1963033347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a841316c0 0x7f0a8412b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.380+0000 7f0a8ade3700 1 -- 172.21.15.72:0/1963033347 >> 172.21.15.72:0/1963033347 conn(0x7f0a84066f50 msgr2=0x7f0a84136e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.380+0000 7f0a8ade3700 1 -- 172.21.15.72:0/1963033347 shutdown_connections 2023-10-03T10:18:04.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.380+0000 7f0a8ade3700 1 -- 172.21.15.72:0/1963033347 wait complete. 2023-10-03T10:18:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.387+0000 7ffb8a516700 1 -- 172.21.15.72:0/250946643 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffb8412b670 con 0x7ffb84130540 2023-10-03T10:18:04.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.387+0000 7ffb80ff9700 1 -- 172.21.15.72:0/250946643 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb78017030 con 0x7ffb84130540 2023-10-03T10:18:04.388 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.389+0000 7ffb8a516700 1 -- 172.21.15.72:0/250946643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb84130540 msgr2=0x7ffb8412b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.389+0000 7ffb8a516700 1 --2- 172.21.15.72:0/250946643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb84130540 0x7ffb8412b130 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800ebb0 tx=0x7ffb7800eec0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.389+0000 7ffb8a516700 1 -- 172.21.15.72:0/250946643 shutdown_connections 2023-10-03T10:18:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.389+0000 7ffb8a516700 1 --2- 172.21.15.72:0/250946643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb84130e50 0x7ffb841c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.389+0000 7ffb8a516700 1 --2- 172.21.15.72:0/250946643 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffb8406fb20 0x7ffb8412abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.389+0000 7ffb8a516700 1 --2- 172.21.15.72:0/250946643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb84130540 0x7ffb8412b130 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.389+0000 7ffb8a516700 1 -- 172.21.15.72:0/250946643 >> 172.21.15.72:0/250946643 conn(0x7ffb840a2aa0 msgr2=0x7ffb8406e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.389+0000 7ffb8a516700 1 -- 172.21.15.72:0/250946643 shutdown_connections 2023-10-03T10:18:04.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.389+0000 7ffb8a516700 1 -- 172.21.15.72:0/250946643 wait complete. 2023-10-03T10:18:04.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:04.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:04.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.481+0000 7fcb97996700 1 -- 172.21.15.72:0/69517014 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb90074ea0 con 0x7fcb9009d6f0 2023-10-03T10:18:04.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.481+0000 7fcb85ffb700 1 -- 172.21.15.72:0/69517014 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb8c028b50 con 0x7fcb9009d6f0 2023-10-03T10:18:04.482 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.483+0000 7fcb97996700 1 -- 172.21.15.72:0/69517014 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb9009d6f0 msgr2=0x7fcb9011dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.483+0000 7fcb97996700 1 --2- 172.21.15.72:0/69517014 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb9009d6f0 0x7fcb9011dfd0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0090b0 tx=0x7fcb8c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.483+0000 7fcb97996700 1 -- 172.21.15.72:0/69517014 shutdown_connections 2023-10-03T10:18:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.483+0000 7fcb97996700 1 --2- 172.21.15.72:0/69517014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb9009e410 0x7fcb9011ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.483+0000 7fcb97996700 1 --2- 172.21.15.72:0/69517014 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcb9009d6f0 0x7fcb9011dfd0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.483+0000 7fcb97996700 1 --2- 172.21.15.72:0/69517014 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcb9009e000 0x7fcb9011e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.483+0000 7fcb97996700 1 -- 172.21.15.72:0/69517014 >> 172.21.15.72:0/69517014 conn(0x7fcb90066f50 msgr2=0x7fcb90070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.483+0000 7fcb97996700 1 -- 172.21.15.72:0/69517014 shutdown_connections 2023-10-03T10:18:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:04.483+0000 7fcb97996700 1 -- 172.21.15.72:0/69517014 wait complete. 2023-10-03T10:18:04.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:05.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:05.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:05.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:05.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.459+0000 7f128c0fb700 1 Processor -- start 2023-10-03T10:18:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.459+0000 7f128c0fb700 1 -- start start 2023-10-03T10:18:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.460+0000 7f128c0fb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f128409d6f0 0x7f128409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.460+0000 7f128c0fb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f128409e000 0x7f12841339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.460+0000 7f128c0fb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128409b120 con 0x7f128409e410 2023-10-03T10:18:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.460+0000 7f128c0fb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128406b460 con 0x7f128409e000 2023-10-03T10:18:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.460+0000 7f128c0fb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f128409a7e0 con 0x7f128409d6f0 2023-10-03T10:18:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.460+0000 7f1289e97700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f128409d6f0 0x7f128409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.460+0000 7f1289e97700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f128409d6f0 0x7f128409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:37982/0 (socket says 172.21.15.72:37982) 2023-10-03T10:18:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.460+0000 7f1289e97700 1 -- 172.21.15.72:0/2545880436 learned_addr learned my addr 172.21.15.72:0/2545880436 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.460+0000 7f1289696700 1 --2- 172.21.15.72:0/2545880436 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f128409e000 0x7f12841339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.460+0000 7f1289e97700 1 -- 172.21.15.72:0/2545880436 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f128409e000 msgr2=0x7f12841339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.460+0000 7f1289e97700 1 --2- 172.21.15.72:0/2545880436 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f128409e000 0x7f12841339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.460+0000 7f1289e97700 1 -- 172.21.15.72:0/2545880436 >> v1:172.21.15.72:6789/0 conn(0x7f128409e410 legacy=0x7f1284133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.460+0000 7f1289e97700 1 -- 172.21.15.72:0/2545880436 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128409a500 con 0x7f128409d6f0 2023-10-03T10:18:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.460+0000 7f1289696700 1 --2- 172.21.15.72:0/2545880436 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f128409e000 0x7f12841339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.461+0000 7f1289e97700 1 --2- 172.21.15.72:0/2545880436 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f128409d6f0 0x7f128409dac0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1274009eb0 tx=0x7f127400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63ebb5d780318588 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.461+0000 7f1288e95700 1 -- 172.21.15.72:0/2545880436 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400e070 con 0x7f128409d6f0 2023-10-03T10:18:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.461+0000 7f1288e95700 1 -- 172.21.15.72:0/2545880436 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127400b980 con 0x7f128409d6f0 2023-10-03T10:18:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.461+0000 7f1288e95700 1 -- 172.21.15.72:0/2545880436 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400bd30 con 0x7f128409d6f0 2023-10-03T10:18:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.461+0000 7f128c0fb700 1 -- 172.21.15.72:0/2545880436 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f128409d6f0 msgr2=0x7f128409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.461+0000 7f128c0fb700 1 --2- 172.21.15.72:0/2545880436 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f128409d6f0 0x7f128409dac0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1274009eb0 tx=0x7f127400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.462+0000 7f128c0fb700 1 -- 172.21.15.72:0/2545880436 shutdown_connections 2023-10-03T10:18:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.462+0000 7f128c0fb700 1 --2- 172.21.15.72:0/2545880436 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f128409d6f0 0x7f128409dac0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.462+0000 7f128c0fb700 1 --2- 172.21.15.72:0/2545880436 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f128409e000 0x7f12841339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.462+0000 7f128c0fb700 1 -- 172.21.15.72:0/2545880436 >> 172.21.15.72:0/2545880436 conn(0x7f1284066f50 msgr2=0x7f128409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.462+0000 7f128c0fb700 1 -- 172.21.15.72:0/2545880436 shutdown_connections 2023-10-03T10:18:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.462+0000 7f128c0fb700 1 -- 172.21.15.72:0/2545880436 wait complete. 2023-10-03T10:18:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.463+0000 7f128c0fb700 1 Processor -- start 2023-10-03T10:18:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.463+0000 7f128c0fb700 1 -- start start 2023-10-03T10:18:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.463+0000 7f128c0fb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f128409d6f0 0x7f12841a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.463+0000 7f128c0fb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f128409e000 0x7f12841a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.463+0000 7f128c0fb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f128409e410 0x7f12841a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.463+0000 7f128c0fb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12841a7350 con 0x7f128409e000 2023-10-03T10:18:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.463+0000 7f128c0fb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12841a7ab0 con 0x7f128409d6f0 2023-10-03T10:18:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.463+0000 7f128c0fb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12841a8d00 con 0x7f128409e410 2023-10-03T10:18:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.464+0000 7f1289696700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f128409e000 0x7f12841a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.464+0000 7f1289696700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f128409e000 0x7f12841a63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41292/0 (socket says 172.21.15.72:41292) 2023-10-03T10:18:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.464+0000 7f1289696700 1 -- 172.21.15.72:0/3345260804 learned_addr learned my addr 172.21.15.72:0/3345260804 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.464+0000 7f1289e97700 1 --2- 172.21.15.72:0/3345260804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f128409d6f0 0x7f12841a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.464+0000 7f128a698700 1 --2- 172.21.15.72:0/3345260804 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f128409e410 0x7f12841a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.464+0000 7f1289e97700 1 -- 172.21.15.72:0/3345260804 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f128409e410 msgr2=0x7f12841a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.464+0000 7f1289e97700 1 --2- 172.21.15.72:0/3345260804 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f128409e410 0x7f12841a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.464+0000 7f1289e97700 1 -- 172.21.15.72:0/3345260804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f128409e000 msgr2=0x7f12841a63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.464+0000 7f1289e97700 1 --2- 172.21.15.72:0/3345260804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f128409e000 0x7f12841a63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.464+0000 7f1289e97700 1 -- 172.21.15.72:0/3345260804 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1274009b30 con 0x7f128409d6f0 2023-10-03T10:18:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.464+0000 7f128a698700 1 --2- 172.21.15.72:0/3345260804 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f128409e410 0x7f12841a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.464+0000 7f1289696700 1 --2- 172.21.15.72:0/3345260804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f128409e000 0x7f12841a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.464+0000 7f1289e97700 1 --2- 172.21.15.72:0/3345260804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f128409d6f0 0x7f12841a5ea0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f128409e9b0 tx=0x7f1274004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.464+0000 7f12827fc700 1 -- 172.21.15.72:0/3345260804 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12740044d0 con 0x7f128409d6f0 2023-10-03T10:18:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.464+0000 7f128c0fb700 1 -- 172.21.15.72:0/3345260804 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12841a8090 con 0x7f128409d6f0 2023-10-03T10:18:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.465+0000 7f12827fc700 1 -- 172.21.15.72:0/3345260804 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1274004630 con 0x7f128409d6f0 2023-10-03T10:18:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.465+0000 7f12827fc700 1 -- 172.21.15.72:0/3345260804 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127401c440 con 0x7f128409d6f0 2023-10-03T10:18:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.465+0000 7f128c0fb700 1 -- 172.21.15.72:0/3345260804 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12840a32a0 con 0x7f128409d6f0 2023-10-03T10:18:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.466+0000 7f12827fc700 1 -- 172.21.15.72:0/3345260804 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f127401c5a0 con 0x7f128409d6f0 2023-10-03T10:18:05.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.466+0000 7f128c0fb700 1 -- 172.21.15.72:0/3345260804 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128409c710 con 0x7f128409d6f0 2023-10-03T10:18:05.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.466+0000 7f12827fc700 1 -- 172.21.15.72:0/3345260804 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f127401c850 con 0x7f128409d6f0 2023-10-03T10:18:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.471+0000 7f12827fc700 1 -- 172.21.15.72:0/3345260804 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1274046060 con 0x7f128409d6f0 2023-10-03T10:18:05.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:05.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.529+0000 7f73d670a700 1 Processor -- start 2023-10-03T10:18:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.529+0000 7f73d670a700 1 -- start start 2023-10-03T10:18:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.530+0000 7f73d670a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f73d0130040 0x7f73d012c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.530+0000 7f73d670a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73d012ccb0 0x7f73d0135940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.530+0000 7f73d670a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d009be70 con 0x7f73d012fc70 2023-10-03T10:18:05.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.530+0000 7f73d670a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d009a6e0 con 0x7f73d0130040 2023-10-03T10:18:05.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.530+0000 7f73d670a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73d009ac80 con 0x7f73d012ccb0 2023-10-03T10:18:05.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.530+0000 7f73cffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f73d012fc70 0x7f73d012c060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36620/0 (socket says 172.21.15.72:36620) 2023-10-03T10:18:05.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.530+0000 7f73cffff700 1 -- 172.21.15.72:0/1935972297 learned_addr learned my addr 172.21.15.72:0/1935972297 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:05.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.530+0000 7f73cf7fe700 1 --2- 172.21.15.72:0/1935972297 >> v2:172.21.15.72:3300/0 conn(0x7f73d0130040 0x7f73d012c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.530+0000 7f73cf7fe700 1 -- 172.21.15.72:0/1935972297 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73d012ccb0 msgr2=0x7f73d0135940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.530+0000 7f73cf7fe700 1 --2- 172.21.15.72:0/1935972297 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73d012ccb0 0x7f73d0135940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.530+0000 7f73cf7fe700 1 -- 172.21.15.72:0/1935972297 >> v1:172.21.15.72:6789/0 conn(0x7f73d012fc70 legacy=0x7f73d012c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.530+0000 7f73cf7fe700 1 -- 172.21.15.72:0/1935972297 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d0099b00 con 0x7f73d0130040 2023-10-03T10:18:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.531+0000 7f73cf7fe700 1 --2- 172.21.15.72:0/1935972297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d0130040 0x7f73d012c770 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009840 tx=0x7f73c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d87725378a878a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.531+0000 7f73ceffd700 1 -- 172.21.15.72:0/1935972297 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c4011830 con 0x7f73d0130040 2023-10-03T10:18:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.531+0000 7f73ceffd700 1 -- 172.21.15.72:0/1935972297 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c4011990 con 0x7f73d0130040 2023-10-03T10:18:05.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.531+0000 7f73ceffd700 1 -- 172.21.15.72:0/1935972297 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c4011d20 con 0x7f73d0130040 2023-10-03T10:18:05.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.532+0000 7f73d670a700 1 -- 172.21.15.72:0/1935972297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d0130040 msgr2=0x7f73d012c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.532+0000 7f73d670a700 1 --2- 172.21.15.72:0/1935972297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d0130040 0x7f73d012c770 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009840 tx=0x7f73c4009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:05.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.532+0000 7f73d670a700 1 -- 172.21.15.72:0/1935972297 shutdown_connections 2023-10-03T10:18:05.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.532+0000 7f73d670a700 1 --2- 172.21.15.72:0/1935972297 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73d012ccb0 0x7f73d0135940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.532+0000 7f73d670a700 1 --2- 172.21.15.72:0/1935972297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d0130040 0x7f73d012c770 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.532+0000 7f73d670a700 1 -- 172.21.15.72:0/1935972297 >> 172.21.15.72:0/1935972297 conn(0x7f73d009e7e0 msgr2=0x7f73d009ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.532+0000 7f73d670a700 1 -- 172.21.15.72:0/1935972297 shutdown_connections 2023-10-03T10:18:05.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.532+0000 7f73d670a700 1 -- 172.21.15.72:0/1935972297 wait complete. 2023-10-03T10:18:05.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.533+0000 7f73d670a700 1 Processor -- start 2023-10-03T10:18:05.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.534+0000 7f73d670a700 1 -- start start 2023-10-03T10:18:05.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.534+0000 7f73d670a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d012ccb0 0x7f73d00983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.534+0000 7f73d670a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73d012fc70 0x7f73d0098930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.534+0000 7f73d670a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73d0130040 0x7f73d0131b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.534+0000 7f73d670a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d0134770 con 0x7f73d012ccb0 2023-10-03T10:18:05.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.534+0000 7f73d670a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d0133790 con 0x7f73d0130040 2023-10-03T10:18:05.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.534+0000 7f73d670a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73d006d730 con 0x7f73d012fc70 2023-10-03T10:18:05.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.534+0000 7f73d4ca7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73d0130040 0x7f73d0131b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.534+0000 7f73d4ca7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73d0130040 0x7f73d0131b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:36854/0 (socket says 172.21.15.72:36854) 2023-10-03T10:18:05.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.534+0000 7f73d4ca7700 1 -- 172.21.15.72:0/3824410412 learned_addr learned my addr 172.21.15.72:0/3824410412 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:05.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.535+0000 7f73cffff700 1 --2- 172.21.15.72:0/3824410412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d012ccb0 0x7f73d00983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.535+0000 7f73d4ca7700 1 -- 172.21.15.72:0/3824410412 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73d012fc70 msgr2=0x7f73d0098930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.535+0000 7f73d4ca7700 1 --2- 172.21.15.72:0/3824410412 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73d012fc70 0x7f73d0098930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.535+0000 7f73d4ca7700 1 -- 172.21.15.72:0/3824410412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d012ccb0 msgr2=0x7f73d00983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.535+0000 7f73d4ca7700 1 --2- 172.21.15.72:0/3824410412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d012ccb0 0x7f73d00983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.535+0000 7f73d4ca7700 1 -- 172.21.15.72:0/3824410412 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c40094a0 con 0x7f73d0130040 2023-10-03T10:18:05.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.535+0000 7f73cffff700 1 --2- 172.21.15.72:0/3824410412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d012ccb0 0x7f73d00983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.535+0000 7f73d4ca7700 1 --2- 172.21.15.72:0/3824410412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73d0130040 0x7f73d0131b90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f73c800b9a0 tx=0x7f73c800bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.535+0000 7f73ccff9700 1 -- 172.21.15.72:0/3824410412 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c800d8e0 con 0x7f73d0130040 2023-10-03T10:18:05.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.535+0000 7f73ccff9700 1 -- 172.21.15.72:0/3824410412 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c800da60 con 0x7f73d0130040 2023-10-03T10:18:05.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.535+0000 7f73ccff9700 1 -- 172.21.15.72:0/3824410412 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c800de10 con 0x7f73d0130040 2023-10-03T10:18:05.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.535+0000 7f73d670a700 1 -- 172.21.15.72:0/3824410412 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d0133b60 con 0x7f73d0130040 2023-10-03T10:18:05.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.536+0000 7f73d670a700 1 -- 172.21.15.72:0/3824410412 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d006e1d0 con 0x7f73d0130040 2023-10-03T10:18:05.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.536+0000 7f73ccff9700 1 -- 172.21.15.72:0/3824410412 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73c8015420 con 0x7f73d0130040 2023-10-03T10:18:05.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.537+0000 7f73d670a700 1 -- 172.21.15.72:0/3824410412 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d012f950 con 0x7f73d0130040 2023-10-03T10:18:05.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.537+0000 7f73ccff9700 1 -- 172.21.15.72:0/3824410412 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f73c8011070 con 0x7f73d0130040 2023-10-03T10:18:05.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.545+0000 7f73ccff9700 1 -- 172.21.15.72:0/3824410412 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73c8013920 con 0x7f73d0130040 2023-10-03T10:18:05.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.575+0000 7f0bb17b8700 1 Processor -- start 2023-10-03T10:18:05.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.575+0000 7f0bb17b8700 1 -- start start 2023-10-03T10:18:05.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.575+0000 7f0bb17b8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0bac06a770 0x7f0bac09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.575+0000 7f0bb17b8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0bac13d1f0 0x7f0bac13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.575+0000 7f0bb17b8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bac09a810 con 0x7f0bac09dc30 2023-10-03T10:18:05.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.576+0000 7f0bb17b8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bac06ab40 con 0x7f0bac13d1f0 2023-10-03T10:18:05.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.576+0000 7f0bb17b8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac09ebc0 con 0x7f0bac06a770 2023-10-03T10:18:05.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.576+0000 7f0bab7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0bac13d1f0 0x7f0bac13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.576+0000 7f0baaffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0bac06a770 0x7f0bac09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.576+0000 7f0bab7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0bac13d1f0 0x7f0bac13f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41324/0 (socket says 172.21.15.72:41324) 2023-10-03T10:18:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.576+0000 7f0bab7fe700 1 -- 172.21.15.72:0/3256586125 learned_addr learned my addr 172.21.15.72:0/3256586125 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.576+0000 7f0baaffd700 1 --2- 172.21.15.72:0/3256586125 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0bac06a770 0x7f0bac09d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38014/0 (socket says 172.21.15.72:38014) 2023-10-03T10:18:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.576+0000 7f0baaffd700 1 -- 172.21.15.72:0/3256586125 >> v2:172.21.15.72:3300/0 conn(0x7f0bac13d1f0 msgr2=0x7f0bac13f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.576+0000 7f0baaffd700 1 --2- 172.21.15.72:0/3256586125 >> v2:172.21.15.72:3300/0 conn(0x7f0bac13d1f0 0x7f0bac13f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.576+0000 7f0baaffd700 1 -- 172.21.15.72:0/3256586125 >> v1:172.21.15.72:6789/0 conn(0x7f0bac09dc30 legacy=0x7f0bac09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.576+0000 7f0baaffd700 1 -- 172.21.15.72:0/3256586125 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac09e920 con 0x7f0bac06a770 2023-10-03T10:18:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.576+0000 7f0bab7fe700 1 --2- 172.21.15.72:0/3256586125 >> v2:172.21.15.72:3300/0 conn(0x7f0bac13d1f0 0x7f0bac13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.576+0000 7f0baaffd700 1 --2- 172.21.15.72:0/3256586125 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0bac06a770 0x7f0bac09d6f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009870 tx=0x7f0b9c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaa5e2a3b6efe9fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.576+0000 7f0ba9ffb700 1 -- 172.21.15.72:0/3256586125 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c011830 con 0x7f0bac06a770 2023-10-03T10:18:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.577+0000 7f0ba9ffb700 1 -- 172.21.15.72:0/3256586125 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c011990 con 0x7f0bac06a770 2023-10-03T10:18:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.577+0000 7f0ba9ffb700 1 -- 172.21.15.72:0/3256586125 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c011d20 con 0x7f0bac06a770 2023-10-03T10:18:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.577+0000 7f0bb17b8700 1 -- 172.21.15.72:0/3256586125 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0bac06a770 msgr2=0x7f0bac09d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.577+0000 7f0bb17b8700 1 --2- 172.21.15.72:0/3256586125 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0bac06a770 0x7f0bac09d6f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009870 tx=0x7f0b9c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.577+0000 7f0bb17b8700 1 -- 172.21.15.72:0/3256586125 shutdown_connections 2023-10-03T10:18:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.577+0000 7f0bb17b8700 1 --2- 172.21.15.72:0/3256586125 >> v2:172.21.15.72:3300/0 conn(0x7f0bac13d1f0 0x7f0bac13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.577+0000 7f0bb17b8700 1 --2- 172.21.15.72:0/3256586125 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0bac06a770 0x7f0bac09d6f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.577+0000 7f0bb17b8700 1 -- 172.21.15.72:0/3256586125 >> 172.21.15.72:0/3256586125 conn(0x7f0bac066f50 msgr2=0x7f0bac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.577+0000 7f0bb17b8700 1 -- 172.21.15.72:0/3256586125 shutdown_connections 2023-10-03T10:18:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.577+0000 7f0bb17b8700 1 -- 172.21.15.72:0/3256586125 wait complete. 2023-10-03T10:18:05.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.579+0000 7f0bb17b8700 1 Processor -- start 2023-10-03T10:18:05.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.579+0000 7f0bb17b8700 1 -- start start 2023-10-03T10:18:05.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.579+0000 7f0bb17b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bac06a770 0x7f0bac1260a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.579+0000 7f0bb17b8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bac09dc30 0x7f0bac1265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.579+0000 7f0bb17b8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0bac13d1f0 0x7f0bac126b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.579+0000 7f0bb17b8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac127c50 con 0x7f0bac09dc30 2023-10-03T10:18:05.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.579+0000 7f0bb17b8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac129180 con 0x7f0bac06a770 2023-10-03T10:18:05.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.579+0000 7f0bb17b8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac128810 con 0x7f0bac13d1f0 2023-10-03T10:18:05.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0bab7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0bac13d1f0 0x7f0bac126b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0baaffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bac06a770 0x7f0bac1260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0baa7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bac09dc30 0x7f0bac1265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0bab7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0bac13d1f0 0x7f0bac126b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38024/0 (socket says 172.21.15.72:38024) 2023-10-03T10:18:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0baaffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bac06a770 0x7f0bac1260a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:36870/0 (socket says 172.21.15.72:36870) 2023-10-03T10:18:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0bab7fe700 1 -- 172.21.15.72:0/3705030151 learned_addr learned my addr 172.21.15.72:0/3705030151 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0baaffd700 1 -- 172.21.15.72:0/3705030151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0bac13d1f0 msgr2=0x7f0bac126b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0baaffd700 1 --2- 172.21.15.72:0/3705030151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0bac13d1f0 0x7f0bac126b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0baaffd700 1 -- 172.21.15.72:0/3705030151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bac09dc30 msgr2=0x7f0bac1265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0baaffd700 1 --2- 172.21.15.72:0/3705030151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bac09dc30 0x7f0bac1265e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0baaffd700 1 -- 172.21.15.72:0/3705030151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba4009b30 con 0x7f0bac06a770 2023-10-03T10:18:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0bab7fe700 1 --2- 172.21.15.72:0/3705030151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0bac13d1f0 0x7f0bac126b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:05.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0baaffd700 1 --2- 172.21.15.72:0/3705030151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bac06a770 0x7f0bac1260a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c016000 tx=0x7f0b9c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0b937fe700 1 -- 172.21.15.72:0/3705030151 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c0045d0 con 0x7f0bac06a770 2023-10-03T10:18:05.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0b937fe700 1 -- 172.21.15.72:0/3705030151 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c01e070 con 0x7f0bac06a770 2023-10-03T10:18:05.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0bb17b8700 1 -- 172.21.15.72:0/3705030151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9c0094a0 con 0x7f0bac06a770 2023-10-03T10:18:05.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0b937fe700 1 -- 172.21.15.72:0/3705030151 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c0038a0 con 0x7f0bac06a770 2023-10-03T10:18:05.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.580+0000 7f0bb17b8700 1 -- 172.21.15.72:0/3705030151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bac09f1a0 con 0x7f0bac06a770 2023-10-03T10:18:05.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.581+0000 7f0bb17b8700 1 -- 172.21.15.72:0/3705030151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bac128150 con 0x7f0bac06a770 2023-10-03T10:18:05.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.582+0000 7f0b937fe700 1 -- 172.21.15.72:0/3705030151 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b9c003a00 con 0x7f0bac06a770 2023-10-03T10:18:05.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.582+0000 7f0b937fe700 1 -- 172.21.15.72:0/3705030151 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0b9c0409b0 con 0x7f0bac06a770 2023-10-03T10:18:05.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.591+0000 7f0b937fe700 1 -- 172.21.15.72:0/3705030151 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b9c010970 con 0x7f0bac06a770 2023-10-03T10:18:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.629+0000 7fdb0cef2700 1 Processor -- start 2023-10-03T10:18:05.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.629+0000 7fdb0cef2700 1 -- start start 2023-10-03T10:18:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb0cef2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb0806a770 0x7fdb0806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb0cef2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0806b080 0x7fdb08131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb0cef2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb08131b40 0x7fdb08131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb0cef2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0809ece0 con 0x7fdb0806a770 2023-10-03T10:18:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb0cef2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0809e760 con 0x7fdb08131b40 2023-10-03T10:18:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb0cef2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0809e040 con 0x7fdb0806b080 2023-10-03T10:18:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb0659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb0806a770 0x7fdb0806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb05d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0806b080 0x7fdb08131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb0659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb0806a770 0x7fdb0806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41336/0 (socket says 172.21.15.72:41336) 2023-10-03T10:18:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb05d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0806b080 0x7fdb08131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38026/0 (socket says 172.21.15.72:38026) 2023-10-03T10:18:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb0659c700 1 -- 172.21.15.72:0/474764816 learned_addr learned my addr 172.21.15.72:0/474764816 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb06d9d700 1 --2- 172.21.15.72:0/474764816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb08131b40 0x7fdb08131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb0659c700 1 -- 172.21.15.72:0/474764816 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0806b080 msgr2=0x7fdb08131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb0659c700 1 --2- 172.21.15.72:0/474764816 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0806b080 0x7fdb08131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb0659c700 1 -- 172.21.15.72:0/474764816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb08131b40 msgr2=0x7fdb08131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:05.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb0659c700 1 --2- 172.21.15.72:0/474764816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb08131b40 0x7fdb08131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.630+0000 7fdb0659c700 1 -- 172.21.15.72:0/474764816 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0809f630 con 0x7fdb0806a770 2023-10-03T10:18:05.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.631+0000 7fdb0659c700 1 --2- 172.21.15.72:0/474764816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb0806a770 0x7fdb0806ab40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80098f0 tx=0x7fdaf8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28e30ba000c9bd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.631+0000 7fdb0559a700 1 -- 172.21.15.72:0/474764816 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8011830 con 0x7fdb0806a770 2023-10-03T10:18:05.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.631+0000 7fdb0559a700 1 -- 172.21.15.72:0/474764816 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf8011990 con 0x7fdb0806a770 2023-10-03T10:18:05.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.631+0000 7fdb0559a700 1 -- 172.21.15.72:0/474764816 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8011d20 con 0x7fdb0806a770 2023-10-03T10:18:05.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.631+0000 7fdb0cef2700 1 -- 172.21.15.72:0/474764816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb0806a770 msgr2=0x7fdb0806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.631+0000 7fdb0cef2700 1 --2- 172.21.15.72:0/474764816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb0806a770 0x7fdb0806ab40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80098f0 tx=0x7fdaf8009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:05.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.631+0000 7fdb0cef2700 1 -- 172.21.15.72:0/474764816 shutdown_connections 2023-10-03T10:18:05.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.631+0000 7fdb0cef2700 1 --2- 172.21.15.72:0/474764816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb08131b40 0x7fdb08131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.631+0000 7fdb0cef2700 1 --2- 172.21.15.72:0/474764816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb0806a770 0x7fdb0806ab40 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.631+0000 7fdb0cef2700 1 --2- 172.21.15.72:0/474764816 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0806b080 0x7fdb08131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.631+0000 7fdb0cef2700 1 -- 172.21.15.72:0/474764816 >> 172.21.15.72:0/474764816 conn(0x7fdb08066f50 msgr2=0x7fdb0809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.632+0000 7fdb0cef2700 1 -- 172.21.15.72:0/474764816 shutdown_connections 2023-10-03T10:18:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.632+0000 7fdb0cef2700 1 -- 172.21.15.72:0/474764816 wait complete. 2023-10-03T10:18:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.633+0000 7fdb0cef2700 1 Processor -- start 2023-10-03T10:18:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.633+0000 7fdb0cef2700 1 -- start start 2023-10-03T10:18:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.633+0000 7fdb0cef2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb0806a770 0x7fdb081c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.633+0000 7fdb0cef2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0806b080 0x7fdb081c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.633+0000 7fdb0cef2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb08131b40 0x7fdb081c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.633+0000 7fdb0cef2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0811ef20 con 0x7fdb08131b40 2023-10-03T10:18:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.633+0000 7fdb0cef2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb08131410 con 0x7fdb0806a770 2023-10-03T10:18:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.633+0000 7fdb0cef2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0811d890 con 0x7fdb0806b080 2023-10-03T10:18:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.633+0000 7fdb0659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb0806a770 0x7fdb081c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.633+0000 7fdb0659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb0806a770 0x7fdb081c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:36896/0 (socket says 172.21.15.72:36896) 2023-10-03T10:18:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.633+0000 7fdb0659c700 1 -- 172.21.15.72:0/1060276458 learned_addr learned my addr 172.21.15.72:0/1060276458 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.633+0000 7fdb05d9b700 1 --2- 172.21.15.72:0/1060276458 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0806b080 0x7fdb081c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.633+0000 7fdb06d9d700 1 --2- 172.21.15.72:0/1060276458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb08131b40 0x7fdb081c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.634+0000 7fdb0659c700 1 -- 172.21.15.72:0/1060276458 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0806b080 msgr2=0x7fdb081c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.634+0000 7fdb0659c700 1 --2- 172.21.15.72:0/1060276458 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0806b080 0x7fdb081c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.634+0000 7fdb0659c700 1 -- 172.21.15.72:0/1060276458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb08131b40 msgr2=0x7fdb081c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.634+0000 7fdb0659c700 1 --2- 172.21.15.72:0/1060276458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb08131b40 0x7fdb081c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.634+0000 7fdb0659c700 1 -- 172.21.15.72:0/1060276458 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf8009550 con 0x7fdb0806a770 2023-10-03T10:18:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.634+0000 7fdb0659c700 1 --2- 172.21.15.72:0/1060276458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb0806a770 0x7fdb081c8120 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8000c00 tx=0x7fdaf8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.634+0000 7fdaf6ffd700 1 -- 172.21.15.72:0/1060276458 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8004300 con 0x7fdb0806a770 2023-10-03T10:18:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.634+0000 7fdaf6ffd700 1 -- 172.21.15.72:0/1060276458 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf801f070 con 0x7fdb0806a770 2023-10-03T10:18:05.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.634+0000 7fdaf6ffd700 1 -- 172.21.15.72:0/1060276458 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf80036a0 con 0x7fdb0806a770 2023-10-03T10:18:05.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.635+0000 7fdb0cef2700 1 -- 172.21.15.72:0/1060276458 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb081bcb30 con 0x7fdb0806a770 2023-10-03T10:18:05.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.635+0000 7fdb0cef2700 1 -- 172.21.15.72:0/1060276458 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0809a530 con 0x7fdb0806a770 2023-10-03T10:18:05.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.636+0000 7fdb0cef2700 1 -- 172.21.15.72:0/1060276458 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb08074ea0 con 0x7fdb0806a770 2023-10-03T10:18:05.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.637+0000 7fdaf6ffd700 1 -- 172.21.15.72:0/1060276458 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdaf8021030 con 0x7fdb0806a770 2023-10-03T10:18:05.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.637+0000 7fdaf6ffd700 1 -- 172.21.15.72:0/1060276458 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdaf80483b0 con 0x7fdb0806a770 2023-10-03T10:18:05.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.645+0000 7fdaf6ffd700 1 -- 172.21.15.72:0/1060276458 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdaf800b9d0 con 0x7fdb0806a770 2023-10-03T10:18:05.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.678+0000 7f128c0fb700 1 -- 172.21.15.72:0/3345260804 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f12841a9380 con 0x7f128409d6f0 2023-10-03T10:18:05.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.678+0000 7f12827fc700 1 -- 172.21.15.72:0/3345260804 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1274046090 con 0x7f128409d6f0 2023-10-03T10:18:05.679 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.680+0000 7f128c0fb700 1 -- 172.21.15.72:0/3345260804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f128409d6f0 msgr2=0x7f12841a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.680+0000 7f128c0fb700 1 --2- 172.21.15.72:0/3345260804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f128409d6f0 0x7f12841a5ea0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f128409e9b0 tx=0x7f1274004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.680+0000 7f128c0fb700 1 -- 172.21.15.72:0/3345260804 shutdown_connections 2023-10-03T10:18:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.680+0000 7f128c0fb700 1 --2- 172.21.15.72:0/3345260804 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f128409e410 0x7f12841a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.680+0000 7f128c0fb700 1 --2- 172.21.15.72:0/3345260804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f128409d6f0 0x7f12841a5ea0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.680+0000 7f128c0fb700 1 --2- 172.21.15.72:0/3345260804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f128409e000 0x7f12841a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.681+0000 7f128c0fb700 1 -- 172.21.15.72:0/3345260804 >> 172.21.15.72:0/3345260804 conn(0x7f1284066f50 msgr2=0x7f12841baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.681+0000 7f128c0fb700 1 -- 172.21.15.72:0/3345260804 shutdown_connections 2023-10-03T10:18:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.681+0000 7f128c0fb700 1 -- 172.21.15.72:0/3345260804 wait complete. 2023-10-03T10:18:05.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:05.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.751+0000 7f73d670a700 1 -- 172.21.15.72:0/3824410412 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f73d01335b0 con 0x7f73d0130040 2023-10-03T10:18:05.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.752+0000 7f73ccff9700 1 -- 172.21.15.72:0/3824410412 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f73c8013330 con 0x7f73d0130040 2023-10-03T10:18:05.752 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.754+0000 7f73d670a700 1 -- 172.21.15.72:0/3824410412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73d0130040 msgr2=0x7f73d0131b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.754+0000 7f73d670a700 1 --2- 172.21.15.72:0/3824410412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73d0130040 0x7f73d0131b90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f73c800b9a0 tx=0x7f73c800bcb0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.754+0000 7f73d670a700 1 -- 172.21.15.72:0/3824410412 shutdown_connections 2023-10-03T10:18:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.754+0000 7f73d670a700 1 --2- 172.21.15.72:0/3824410412 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73d012ccb0 0x7f73d00983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.754+0000 7f73d670a700 1 --2- 172.21.15.72:0/3824410412 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73d0130040 0x7f73d0131b90 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.754+0000 7f73d670a700 1 --2- 172.21.15.72:0/3824410412 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73d012fc70 0x7f73d0098930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.754+0000 7f73d670a700 1 -- 172.21.15.72:0/3824410412 >> 172.21.15.72:0/3824410412 conn(0x7f73d009e7e0 msgr2=0x7f73d0128fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.754+0000 7f73d670a700 1 -- 172.21.15.72:0/3824410412 shutdown_connections 2023-10-03T10:18:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.754+0000 7f73d670a700 1 -- 172.21.15.72:0/3824410412 wait complete. 2023-10-03T10:18:05.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:05.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.789+0000 7f0bb17b8700 1 -- 172.21.15.72:0/3705030151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0bac074ea0 con 0x7f0bac06a770 2023-10-03T10:18:05.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.789+0000 7f0b937fe700 1 -- 172.21.15.72:0/3705030151 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b9c015070 con 0x7f0bac06a770 2023-10-03T10:18:05.790 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:05.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.791+0000 7f0bb17b8700 1 -- 172.21.15.72:0/3705030151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bac06a770 msgr2=0x7f0bac1260a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.791+0000 7f0bb17b8700 1 --2- 172.21.15.72:0/3705030151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bac06a770 0x7f0bac1260a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c016000 tx=0x7f0b9c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:05.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.791+0000 7f0bb17b8700 1 -- 172.21.15.72:0/3705030151 shutdown_connections 2023-10-03T10:18:05.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.791+0000 7f0bb17b8700 1 --2- 172.21.15.72:0/3705030151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0bac13d1f0 0x7f0bac126b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.791+0000 7f0bb17b8700 1 --2- 172.21.15.72:0/3705030151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bac06a770 0x7f0bac1260a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.791+0000 7f0bb17b8700 1 --2- 172.21.15.72:0/3705030151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bac09dc30 0x7f0bac1265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.791+0000 7f0bb17b8700 1 -- 172.21.15.72:0/3705030151 >> 172.21.15.72:0/3705030151 conn(0x7f0bac066f50 msgr2=0x7f0bac13e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.791+0000 7f0bb17b8700 1 -- 172.21.15.72:0/3705030151 shutdown_connections 2023-10-03T10:18:05.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.791+0000 7f0bb17b8700 1 -- 172.21.15.72:0/3705030151 wait complete. 2023-10-03T10:18:05.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:05.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.848+0000 7fdb0cef2700 1 -- 172.21.15.72:0/1060276458 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb081bc200 con 0x7fdb0806a770 2023-10-03T10:18:05.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.849+0000 7fdaf6ffd700 1 -- 172.21.15.72:0/1060276458 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdaf8015030 con 0x7fdb0806a770 2023-10-03T10:18:05.849 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:05.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.850+0000 7fdb0cef2700 1 -- 172.21.15.72:0/1060276458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb0806a770 msgr2=0x7fdb081c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.850+0000 7fdb0cef2700 1 --2- 172.21.15.72:0/1060276458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb0806a770 0x7fdb081c8120 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8000c00 tx=0x7fdaf8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:05.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.851+0000 7fdb0cef2700 1 -- 172.21.15.72:0/1060276458 shutdown_connections 2023-10-03T10:18:05.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.851+0000 7fdb0cef2700 1 --2- 172.21.15.72:0/1060276458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb08131b40 0x7fdb081c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.851+0000 7fdb0cef2700 1 --2- 172.21.15.72:0/1060276458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb0806a770 0x7fdb081c8120 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.851+0000 7fdb0cef2700 1 --2- 172.21.15.72:0/1060276458 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdb0806b080 0x7fdb081c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.851+0000 7fdb0cef2700 1 -- 172.21.15.72:0/1060276458 >> 172.21.15.72:0/1060276458 conn(0x7fdb08066f50 msgr2=0x7fdb080708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.851+0000 7fdb0cef2700 1 -- 172.21.15.72:0/1060276458 shutdown_connections 2023-10-03T10:18:05.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:05.851+0000 7fdb0cef2700 1 -- 172.21.15.72:0/1060276458 wait complete. 2023-10-03T10:18:05.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:06.694 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:06.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:06.804 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:06.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.833+0000 7f5e41812700 1 Processor -- start 2023-10-03T10:18:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.833+0000 7f5e41812700 1 -- start start 2023-10-03T10:18:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.834+0000 7f5e41812700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e3c1305f0 0x7f5e3c1309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.834+0000 7f5e41812700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5e3c070160 0x7f5e3c138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.834+0000 7f5e41812700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3c1301c0 con 0x7f5e3c06f660 2023-10-03T10:18:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.834+0000 7f5e41812700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e3c09a2e0 con 0x7f5e3c070160 2023-10-03T10:18:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.834+0000 7f5e41812700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c071ff0 con 0x7f5e3c1305f0 2023-10-03T10:18:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.834+0000 7f5e3a7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5e3c06f660 0x7f5e3c06fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36638/0 (socket says 172.21.15.72:36638) 2023-10-03T10:18:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.834+0000 7f5e3a7fc700 1 -- 172.21.15.72:0/804754934 learned_addr learned my addr 172.21.15.72:0/804754934 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.834+0000 7f5e3affd700 1 --2- 172.21.15.72:0/804754934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e3c1305f0 0x7f5e3c1309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.834+0000 7f5e3b7fe700 1 --2- 172.21.15.72:0/804754934 >> v2:172.21.15.72:3300/0 conn(0x7f5e3c070160 0x7f5e3c138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.834+0000 7f5e39ffb700 1 -- 172.21.15.72:0/804754934 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990666319 0 0) 0x7f5e3c1301c0 con 0x7f5e3c06f660 2023-10-03T10:18:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.834+0000 7f5e39ffb700 1 -- 172.21.15.72:0/804754934 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e240035b0 con 0x7f5e3c06f660 2023-10-03T10:18:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.835+0000 7f5e3b7fe700 1 -- 172.21.15.72:0/804754934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e3c1305f0 msgr2=0x7f5e3c1309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.835+0000 7f5e3b7fe700 1 --2- 172.21.15.72:0/804754934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e3c1305f0 0x7f5e3c1309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.835+0000 7f5e3b7fe700 1 -- 172.21.15.72:0/804754934 >> v1:172.21.15.72:6789/0 conn(0x7f5e3c06f660 legacy=0x7f5e3c06fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.835+0000 7f5e3b7fe700 1 -- 172.21.15.72:0/804754934 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c070e70 con 0x7f5e3c070160 2023-10-03T10:18:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.835+0000 7f5e3affd700 1 --2- 172.21.15.72:0/804754934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e3c1305f0 0x7f5e3c1309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.835+0000 7f5e3b7fe700 1 --2- 172.21.15.72:0/804754934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c070160 0x7f5e3c138540 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009d90 tx=0x7f5e3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3394dc8c194f99 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.835+0000 7f5e39ffb700 1 -- 172.21.15.72:0/804754934 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400e070 con 0x7f5e3c070160 2023-10-03T10:18:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.835+0000 7f5e39ffb700 1 -- 172.21.15.72:0/804754934 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3400bb20 con 0x7f5e3c070160 2023-10-03T10:18:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.835+0000 7f5e39ffb700 1 -- 172.21.15.72:0/804754934 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34012430 con 0x7f5e3c070160 2023-10-03T10:18:06.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.836+0000 7f5e41812700 1 -- 172.21.15.72:0/804754934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c070160 msgr2=0x7f5e3c138540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.836+0000 7f5e41812700 1 --2- 172.21.15.72:0/804754934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c070160 0x7f5e3c138540 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009d90 tx=0x7f5e3400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:06.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.836+0000 7f5e41812700 1 -- 172.21.15.72:0/804754934 shutdown_connections 2023-10-03T10:18:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.836+0000 7f5e41812700 1 --2- 172.21.15.72:0/804754934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c070160 0x7f5e3c138540 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.836+0000 7f5e41812700 1 --2- 172.21.15.72:0/804754934 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e3c1305f0 0x7f5e3c1309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.836+0000 7f5e41812700 1 -- 172.21.15.72:0/804754934 >> 172.21.15.72:0/804754934 conn(0x7f5e3c0a2aa0 msgr2=0x7f5e3c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.836+0000 7f5e41812700 1 -- 172.21.15.72:0/804754934 shutdown_connections 2023-10-03T10:18:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.836+0000 7f5e41812700 1 -- 172.21.15.72:0/804754934 wait complete. 2023-10-03T10:18:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.837+0000 7f5e41812700 1 Processor -- start 2023-10-03T10:18:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.837+0000 7f5e41812700 1 -- start start 2023-10-03T10:18:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e41812700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e3c06f660 0x7f5e3c138610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e41812700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c070160 0x7f5e3c138b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e41812700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e3c1305f0 0x7f5e3c1c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e41812700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c137370 con 0x7f5e3c070160 2023-10-03T10:18:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e41812700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0a0b30 con 0x7f5e3c06f660 2023-10-03T10:18:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e41812700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c135660 con 0x7f5e3c1305f0 2023-10-03T10:18:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e3a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c070160 0x7f5e3c138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e3a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c070160 0x7f5e3c138b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41364/0 (socket says 172.21.15.72:41364) 2023-10-03T10:18:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e3a7fc700 1 -- 172.21.15.72:0/3724759745 learned_addr learned my addr 172.21.15.72:0/3724759745 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e3b7fe700 1 --2- 172.21.15.72:0/3724759745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e3c1305f0 0x7f5e3c1c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e3affd700 1 --2- 172.21.15.72:0/3724759745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e3c06f660 0x7f5e3c138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e3b7fe700 1 -- 172.21.15.72:0/3724759745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e3c06f660 msgr2=0x7f5e3c138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e3b7fe700 1 --2- 172.21.15.72:0/3724759745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e3c06f660 0x7f5e3c138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e3b7fe700 1 -- 172.21.15.72:0/3724759745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c070160 msgr2=0x7f5e3c138b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e3b7fe700 1 --2- 172.21.15.72:0/3724759745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c070160 0x7f5e3c138b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e3b7fe700 1 -- 172.21.15.72:0/3724759745 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2c0094a0 con 0x7f5e3c1305f0 2023-10-03T10:18:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e3a7fc700 1 --2- 172.21.15.72:0/3724759745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c070160 0x7f5e3c138b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.838+0000 7f5e3b7fe700 1 --2- 172.21.15.72:0/3724759745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e3c1305f0 0x7f5e3c1c5d80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009d90 tx=0x7f5e34004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.839+0000 7f5e23fff700 1 -- 172.21.15.72:0/3724759745 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34012430 con 0x7f5e3c1305f0 2023-10-03T10:18:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.839+0000 7f5e23fff700 1 -- 172.21.15.72:0/3724759745 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e34020070 con 0x7f5e3c1305f0 2023-10-03T10:18:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.839+0000 7f5e23fff700 1 -- 172.21.15.72:0/3724759745 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34004280 con 0x7f5e3c1305f0 2023-10-03T10:18:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.839+0000 7f5e41812700 1 -- 172.21.15.72:0/3724759745 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e34009a70 con 0x7f5e3c1305f0 2023-10-03T10:18:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.839+0000 7f5e41812700 1 -- 172.21.15.72:0/3724759745 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3c139090 con 0x7f5e3c1305f0 2023-10-03T10:18:06.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.840+0000 7f5e41812700 1 -- 172.21.15.72:0/3724759745 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3c139280 con 0x7f5e3c1305f0 2023-10-03T10:18:06.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.840+0000 7f5e23fff700 1 -- 172.21.15.72:0/3724759745 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e340043e0 con 0x7f5e3c1305f0 2023-10-03T10:18:06.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.840+0000 7f5e23fff700 1 -- 172.21.15.72:0/3724759745 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5e34022070 con 0x7f5e3c1305f0 2023-10-03T10:18:06.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.845+0000 7f5e23fff700 1 -- 172.21.15.72:0/3724759745 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e34003e10 con 0x7f5e3c1305f0 2023-10-03T10:18:06.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:06.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.904+0000 7f36dbaea700 1 Processor -- start 2023-10-03T10:18:06.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.904+0000 7f36dbaea700 1 -- start start 2023-10-03T10:18:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.904+0000 7f36dbaea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d409e1d0 0x7f36d4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.904+0000 7f36dbaea700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d4139170 0x7f36d413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.904+0000 7f36dbaea700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d409b120 con 0x7f36d409d6f0 2023-10-03T10:18:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.904+0000 7f36dbaea700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d406b460 con 0x7f36d4139170 2023-10-03T10:18:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.904+0000 7f36dbaea700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36d409a7e0 con 0x7f36d409e1d0 2023-10-03T10:18:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.905+0000 7f36d9085700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d409e1d0 0x7f36d4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.905+0000 7f36d9886700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f36d409d6f0 0x7f36d409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:36648/0 (socket says 172.21.15.72:36648) 2023-10-03T10:18:06.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.905+0000 7f36d9886700 1 -- 172.21.15.72:0/1718048324 learned_addr learned my addr 172.21.15.72:0/1718048324 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:06.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.905+0000 7f36d8884700 1 -- 172.21.15.72:0/1718048324 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862638235 0 0) 0x7f36d409b120 con 0x7f36d409d6f0 2023-10-03T10:18:06.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.905+0000 7f36d9085700 1 -- 172.21.15.72:0/1718048324 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d4139170 msgr2=0x7f36d413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.905+0000 7f36d9085700 1 --2- 172.21.15.72:0/1718048324 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d4139170 0x7f36d413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.905+0000 7f36d9085700 1 -- 172.21.15.72:0/1718048324 >> v1:172.21.15.72:6789/0 conn(0x7f36d409d6f0 legacy=0x7f36d409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.905+0000 7f36d9085700 1 -- 172.21.15.72:0/1718048324 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d409a500 con 0x7f36d409e1d0 2023-10-03T10:18:06.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.905+0000 7f36d9085700 1 --2- 172.21.15.72:0/1718048324 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d409e1d0 0x7f36d4138c30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f36c40098a0 tx=0x7f36c4009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e53fd377edc625e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.905+0000 7f36d8884700 1 -- 172.21.15.72:0/1718048324 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4011830 con 0x7f36d409e1d0 2023-10-03T10:18:06.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.905+0000 7f36d8884700 1 -- 172.21.15.72:0/1718048324 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c4011990 con 0x7f36d409e1d0 2023-10-03T10:18:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.905+0000 7f36d8884700 1 -- 172.21.15.72:0/1718048324 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4011d40 con 0x7f36d409e1d0 2023-10-03T10:18:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.906+0000 7f36dbaea700 1 -- 172.21.15.72:0/1718048324 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d409e1d0 msgr2=0x7f36d4138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.906+0000 7f36dbaea700 1 --2- 172.21.15.72:0/1718048324 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d409e1d0 0x7f36d4138c30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f36c40098a0 tx=0x7f36c4009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.906+0000 7f36dbaea700 1 -- 172.21.15.72:0/1718048324 shutdown_connections 2023-10-03T10:18:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.906+0000 7f36dbaea700 1 --2- 172.21.15.72:0/1718048324 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d4139170 0x7f36d413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.906+0000 7f36dbaea700 1 --2- 172.21.15.72:0/1718048324 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d409e1d0 0x7f36d4138c30 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.906+0000 7f36dbaea700 1 -- 172.21.15.72:0/1718048324 >> 172.21.15.72:0/1718048324 conn(0x7f36d4066f50 msgr2=0x7f36d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.906+0000 7f36dbaea700 1 -- 172.21.15.72:0/1718048324 shutdown_connections 2023-10-03T10:18:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.906+0000 7f36dbaea700 1 -- 172.21.15.72:0/1718048324 wait complete. 2023-10-03T10:18:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.907+0000 7f36dbaea700 1 Processor -- start 2023-10-03T10:18:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.907+0000 7f36dbaea700 1 -- start start 2023-10-03T10:18:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36dbaea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d409d6f0 0x7f36d411e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36dbaea700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36d409e1d0 0x7f36d411ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36dbaea700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d4139170 0x7f36d411f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36dbaea700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d40a3b40 con 0x7f36d409e1d0 2023-10-03T10:18:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36dbaea700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4122360 con 0x7f36d4139170 2023-10-03T10:18:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36dbaea700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36d4121a00 con 0x7f36d409d6f0 2023-10-03T10:18:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36d9085700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36d409e1d0 0x7f36d411ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36d9085700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36d409e1d0 0x7f36d411ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41378/0 (socket says 172.21.15.72:41378) 2023-10-03T10:18:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36d9085700 1 -- 172.21.15.72:0/3917401719 learned_addr learned my addr 172.21.15.72:0/3917401719 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36da087700 1 --2- 172.21.15.72:0/3917401719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d4139170 0x7f36d411f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36d9886700 1 --2- 172.21.15.72:0/3917401719 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d409d6f0 0x7f36d411e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36da087700 1 -- 172.21.15.72:0/3917401719 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d409d6f0 msgr2=0x7f36d411e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36da087700 1 --2- 172.21.15.72:0/3917401719 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d409d6f0 0x7f36d411e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36da087700 1 -- 172.21.15.72:0/3917401719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36d409e1d0 msgr2=0x7f36d411ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36da087700 1 --2- 172.21.15.72:0/3917401719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36d409e1d0 0x7f36d411ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36da087700 1 -- 172.21.15.72:0/3917401719 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c40094a0 con 0x7f36d4139170 2023-10-03T10:18:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36d9085700 1 --2- 172.21.15.72:0/3917401719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36d409e1d0 0x7f36d411ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36d9886700 1 --2- 172.21.15.72:0/3917401719 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d409d6f0 0x7f36d411e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.908+0000 7f36da087700 1 --2- 172.21.15.72:0/3917401719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d4139170 0x7f36d411f1b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f36cc00be20 tx=0x7f36cc009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.909+0000 7f36ca7fc700 1 -- 172.21.15.72:0/3917401719 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc00cc10 con 0x7f36d4139170 2023-10-03T10:18:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.909+0000 7f36ca7fc700 1 -- 172.21.15.72:0/3917401719 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc00cd90 con 0x7f36d4139170 2023-10-03T10:18:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.909+0000 7f36ca7fc700 1 -- 172.21.15.72:0/3917401719 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc014680 con 0x7f36d4139170 2023-10-03T10:18:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.909+0000 7f36dbaea700 1 -- 172.21.15.72:0/3917401719 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d4121cb0 con 0x7f36d4139170 2023-10-03T10:18:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.909+0000 7f36dbaea700 1 -- 172.21.15.72:0/3917401719 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d4120af0 con 0x7f36d4139170 2023-10-03T10:18:06.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.910+0000 7f36ca7fc700 1 -- 172.21.15.72:0/3917401719 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36cc01c360 con 0x7f36d4139170 2023-10-03T10:18:06.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.911+0000 7f36ca7fc700 1 -- 172.21.15.72:0/3917401719 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f36cc006e40 con 0x7f36d4139170 2023-10-03T10:18:06.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.911+0000 7f36dbaea700 1 -- 172.21.15.72:0/3917401719 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d4074ea0 con 0x7f36d4139170 2023-10-03T10:18:06.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.920+0000 7f36ca7fc700 1 -- 172.21.15.72:0/3917401719 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36cc019070 con 0x7f36d4139170 2023-10-03T10:18:06.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.947+0000 7ff38b195700 1 Processor -- start 2023-10-03T10:18:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.947+0000 7ff38b195700 1 -- start start 2023-10-03T10:18:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff38b195700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff38409d6f0 0x7ff38409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff38b195700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff38409e000 0x7ff3841339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff38b195700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff38409e410 0x7ff384133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff38b195700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38406b460 con 0x7ff38409e410 2023-10-03T10:18:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff38b195700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38409b120 con 0x7ff38409d6f0 2023-10-03T10:18:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff38b195700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff38409a7e0 con 0x7ff38409e000 2023-10-03T10:18:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff383fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff38409e000 0x7ff3841339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff388f31700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff38409d6f0 0x7ff38409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff383fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff38409e000 0x7ff3841339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38070/0 (socket says 172.21.15.72:38070) 2023-10-03T10:18:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff383fff700 1 -- 172.21.15.72:0/1187428918 learned_addr learned my addr 172.21.15.72:0/1187428918 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff389732700 1 --2- 172.21.15.72:0/1187428918 >> v2:172.21.15.72:3300/0 conn(0x7ff38409e410 0x7ff384133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff383fff700 1 -- 172.21.15.72:0/1187428918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff38409d6f0 msgr2=0x7ff38409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff383fff700 1 --2- 172.21.15.72:0/1187428918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff38409d6f0 0x7ff38409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff383fff700 1 -- 172.21.15.72:0/1187428918 >> v2:172.21.15.72:3300/0 conn(0x7ff38409e410 msgr2=0x7ff384133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff383fff700 1 --2- 172.21.15.72:0/1187428918 >> v2:172.21.15.72:3300/0 conn(0x7ff38409e410 0x7ff384133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff383fff700 1 -- 172.21.15.72:0/1187428918 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38409a500 con 0x7ff38409e000 2023-10-03T10:18:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff389732700 1 --2- 172.21.15.72:0/1187428918 >> v2:172.21.15.72:3300/0 conn(0x7ff38409e410 0x7ff384133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.948+0000 7ff388f31700 1 --2- 172.21.15.72:0/1187428918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff38409d6f0 0x7ff38409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.949+0000 7ff383fff700 1 --2- 172.21.15.72:0/1187428918 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff38409e000 0x7ff3841339f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff370009920 tx=0x7ff370009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ba43c4b4854d0cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.949+0000 7ff3837fe700 1 -- 172.21.15.72:0/1187428918 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370011830 con 0x7ff38409e000 2023-10-03T10:18:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.949+0000 7ff3837fe700 1 -- 172.21.15.72:0/1187428918 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff370011990 con 0x7ff38409e000 2023-10-03T10:18:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.949+0000 7ff3837fe700 1 -- 172.21.15.72:0/1187428918 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370011d20 con 0x7ff38409e000 2023-10-03T10:18:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.950+0000 7ff38b195700 1 -- 172.21.15.72:0/1187428918 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff38409e000 msgr2=0x7ff3841339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.950+0000 7ff38b195700 1 --2- 172.21.15.72:0/1187428918 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff38409e000 0x7ff3841339f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff370009920 tx=0x7ff370009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.950+0000 7ff38b195700 1 -- 172.21.15.72:0/1187428918 shutdown_connections 2023-10-03T10:18:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.950+0000 7ff38b195700 1 --2- 172.21.15.72:0/1187428918 >> v2:172.21.15.72:3300/0 conn(0x7ff38409e410 0x7ff384133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.950+0000 7ff38b195700 1 --2- 172.21.15.72:0/1187428918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff38409d6f0 0x7ff38409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.950+0000 7ff38b195700 1 --2- 172.21.15.72:0/1187428918 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff38409e000 0x7ff3841339f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.950+0000 7ff38b195700 1 -- 172.21.15.72:0/1187428918 >> 172.21.15.72:0/1187428918 conn(0x7ff384066f50 msgr2=0x7ff38409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.950+0000 7ff38b195700 1 -- 172.21.15.72:0/1187428918 shutdown_connections 2023-10-03T10:18:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.950+0000 7ff38b195700 1 -- 172.21.15.72:0/1187428918 wait complete. 2023-10-03T10:18:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.951+0000 7ff38b195700 1 Processor -- start 2023-10-03T10:18:06.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.952+0000 7ff38b195700 1 -- start start 2023-10-03T10:18:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.953+0000 7ff38b195700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff38409d6f0 0x7ff3841b91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.953+0000 7ff38b195700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff38409e000 0x7ff3841a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.953+0000 7ff38b195700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff38409e410 0x7ff3841a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.953+0000 7ff38b195700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3841aa2c0 con 0x7ff38409d6f0 2023-10-03T10:18:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.953+0000 7ff38b195700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3841a9900 con 0x7ff38409e410 2023-10-03T10:18:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.953+0000 7ff38b195700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3841a9090 con 0x7ff38409e000 2023-10-03T10:18:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.953+0000 7ff383fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff38409e000 0x7ff3841a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.953+0000 7ff383fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff38409e000 0x7ff3841a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38080/0 (socket says 172.21.15.72:38080) 2023-10-03T10:18:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.953+0000 7ff383fff700 1 -- 172.21.15.72:0/1316485799 learned_addr learned my addr 172.21.15.72:0/1316485799 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.954+0000 7ff388f31700 1 --2- 172.21.15.72:0/1316485799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff38409d6f0 0x7ff3841b91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.954+0000 7ff383fff700 1 -- 172.21.15.72:0/1316485799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff38409e410 msgr2=0x7ff3841a6320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:18:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.954+0000 7ff383fff700 1 --2- 172.21.15.72:0/1316485799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff38409e410 0x7ff3841a6320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.954+0000 7ff383fff700 1 -- 172.21.15.72:0/1316485799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff38409d6f0 msgr2=0x7ff3841b91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.954+0000 7ff383fff700 1 --2- 172.21.15.72:0/1316485799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff38409d6f0 0x7ff3841b91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.954+0000 7ff383fff700 1 -- 172.21.15.72:0/1316485799 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3780094a0 con 0x7ff38409e000 2023-10-03T10:18:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.954+0000 7ff383fff700 1 --2- 172.21.15.72:0/1316485799 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff38409e000 0x7ff3841a5de0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff370009c70 tx=0x7ff370004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.954+0000 7ff3817fa700 1 -- 172.21.15.72:0/1316485799 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370004300 con 0x7ff38409e000 2023-10-03T10:18:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.954+0000 7ff3817fa700 1 -- 172.21.15.72:0/1316485799 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37001f070 con 0x7ff38409e000 2023-10-03T10:18:06.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.954+0000 7ff3817fa700 1 -- 172.21.15.72:0/1316485799 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3700036a0 con 0x7ff38409e000 2023-10-03T10:18:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.955+0000 7ff38b195700 1 -- 172.21.15.72:0/1316485799 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37c009a70 con 0x7ff38409e000 2023-10-03T10:18:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.955+0000 7ff38b195700 1 -- 172.21.15.72:0/1316485799 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff370009550 con 0x7ff38409e000 2023-10-03T10:18:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.956+0000 7ff3817fa700 1 -- 172.21.15.72:0/1316485799 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff370021030 con 0x7ff38409e000 2023-10-03T10:18:06.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.956+0000 7ff38b195700 1 -- 172.21.15.72:0/1316485799 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38409c710 con 0x7ff38409e000 2023-10-03T10:18:06.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.956+0000 7ff3817fa700 1 -- 172.21.15.72:0/1316485799 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff3700407e0 con 0x7ff38409e000 2023-10-03T10:18:06.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.961+0000 7ff3817fa700 1 -- 172.21.15.72:0/1316485799 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff370023790 con 0x7ff38409e000 2023-10-03T10:18:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.995+0000 7f9b413d2700 1 Processor -- start 2023-10-03T10:18:06.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.995+0000 7f9b413d2700 1 -- start start 2023-10-03T10:18:06.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.995+0000 7f9b413d2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9b3c09d6f0 0x7f9b3c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.995+0000 7f9b413d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b3c09e000 0x7f9b3c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.995+0000 7f9b413d2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b3c09e410 0x7f9b3c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.995+0000 7f9b413d2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3c09f520 con 0x7f9b3c09d6f0 2023-10-03T10:18:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.995+0000 7f9b413d2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c09f130 con 0x7f9b3c09e000 2023-10-03T10:18:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.995+0000 7f9b413d2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c09e930 con 0x7f9b3c09e410 2023-10-03T10:18:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.996+0000 7f9b3affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9b3c09d6f0 0x7f9b3c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.996+0000 7f9b3affd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9b3c09d6f0 0x7f9b3c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41410/0 (socket says 172.21.15.72:41410) 2023-10-03T10:18:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.996+0000 7f9b3affd700 1 -- 172.21.15.72:0/779855309 learned_addr learned my addr 172.21.15.72:0/779855309 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.996+0000 7f9b3b7fe700 1 --2- 172.21.15.72:0/779855309 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b3c09e410 0x7f9b3c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.996+0000 7f9b3a7fc700 1 --2- 172.21.15.72:0/779855309 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b3c09e000 0x7f9b3c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.996+0000 7f9b3affd700 1 -- 172.21.15.72:0/779855309 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b3c09e410 msgr2=0x7f9b3c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.996+0000 7f9b3affd700 1 --2- 172.21.15.72:0/779855309 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b3c09e410 0x7f9b3c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.996+0000 7f9b3affd700 1 -- 172.21.15.72:0/779855309 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b3c09e000 msgr2=0x7f9b3c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.996+0000 7f9b3affd700 1 --2- 172.21.15.72:0/779855309 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b3c09e000 0x7f9b3c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.996+0000 7f9b3affd700 1 -- 172.21.15.72:0/779855309 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c09b2d0 con 0x7f9b3c09d6f0 2023-10-03T10:18:06.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.996+0000 7f9b3affd700 1 --2- 172.21.15.72:0/779855309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b3c09d6f0 0x7f9b3c09dac0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009920 tx=0x7f9b2c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e2fdd8fd86c41f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.996+0000 7f9b39ffb700 1 -- 172.21.15.72:0/779855309 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c011830 con 0x7f9b3c09d6f0 2023-10-03T10:18:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.997+0000 7f9b39ffb700 1 -- 172.21.15.72:0/779855309 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c011990 con 0x7f9b3c09d6f0 2023-10-03T10:18:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.997+0000 7f9b39ffb700 1 -- 172.21.15.72:0/779855309 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c011d20 con 0x7f9b3c09d6f0 2023-10-03T10:18:06.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.997+0000 7f9b413d2700 1 -- 172.21.15.72:0/779855309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b3c09d6f0 msgr2=0x7f9b3c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.997+0000 7f9b413d2700 1 --2- 172.21.15.72:0/779855309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b3c09d6f0 0x7f9b3c09dac0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009920 tx=0x7f9b2c009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:07.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.997+0000 7f9b413d2700 1 -- 172.21.15.72:0/779855309 shutdown_connections 2023-10-03T10:18:07.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.997+0000 7f9b413d2700 1 --2- 172.21.15.72:0/779855309 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b3c09e410 0x7f9b3c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.997+0000 7f9b413d2700 1 --2- 172.21.15.72:0/779855309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b3c09d6f0 0x7f9b3c09dac0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.997+0000 7f9b413d2700 1 --2- 172.21.15.72:0/779855309 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b3c09e000 0x7f9b3c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.997+0000 7f9b413d2700 1 -- 172.21.15.72:0/779855309 >> 172.21.15.72:0/779855309 conn(0x7f9b3c066f50 msgr2=0x7f9b3c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.997+0000 7f9b413d2700 1 -- 172.21.15.72:0/779855309 shutdown_connections 2023-10-03T10:18:07.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.997+0000 7f9b413d2700 1 -- 172.21.15.72:0/779855309 wait complete. 2023-10-03T10:18:07.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.998+0000 7f9b413d2700 1 Processor -- start 2023-10-03T10:18:07.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.999+0000 7f9b413d2700 1 -- start start 2023-10-03T10:18:07.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.999+0000 7f9b413d2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b3c09d6f0 0x7f9b3c11e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.999+0000 7f9b413d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b3c09e000 0x7f9b3c11e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.999+0000 7f9b413d2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b3c09e410 0x7f9b3c11eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.999+0000 7f9b413d2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c11fb90 con 0x7f9b3c09e410 2023-10-03T10:18:07.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.999+0000 7f9b413d2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c120de0 con 0x7f9b3c09e000 2023-10-03T10:18:07.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.999+0000 7f9b413d2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c11f480 con 0x7f9b3c09d6f0 2023-10-03T10:18:07.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.999+0000 7f9b3affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b3c09d6f0 0x7f9b3c11e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.999+0000 7f9b3affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b3c09d6f0 0x7f9b3c11e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38098/0 (socket says 172.21.15.72:38098) 2023-10-03T10:18:07.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.999+0000 7f9b3affd700 1 -- 172.21.15.72:0/3100918471 learned_addr learned my addr 172.21.15.72:0/3100918471 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:07.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.999+0000 7f9b3a7fc700 1 --2- 172.21.15.72:0/3100918471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b3c09e000 0x7f9b3c11e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:06.999+0000 7f9b3b7fe700 1 --2- 172.21.15.72:0/3100918471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b3c09e410 0x7f9b3c11eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.000+0000 7f9b3b7fe700 1 -- 172.21.15.72:0/3100918471 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b3c09d6f0 msgr2=0x7f9b3c11e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.000+0000 7f9b3b7fe700 1 --2- 172.21.15.72:0/3100918471 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b3c09d6f0 0x7f9b3c11e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.000+0000 7f9b3b7fe700 1 -- 172.21.15.72:0/3100918471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b3c09e000 msgr2=0x7f9b3c11e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.000+0000 7f9b3b7fe700 1 --2- 172.21.15.72:0/3100918471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b3c09e000 0x7f9b3c11e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.000+0000 7f9b3b7fe700 1 -- 172.21.15.72:0/3100918471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c009550 con 0x7f9b3c09e410 2023-10-03T10:18:07.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.000+0000 7f9b3b7fe700 1 --2- 172.21.15.72:0/3100918471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b3c09e410 0x7f9b3c11eaa0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400e300 tx=0x7f9b3400e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.000+0000 7f9b237fe700 1 -- 172.21.15.72:0/3100918471 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3400ee20 con 0x7f9b3c09e410 2023-10-03T10:18:07.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.000+0000 7f9b237fe700 1 -- 172.21.15.72:0/3100918471 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b34011450 con 0x7f9b3c09e410 2023-10-03T10:18:07.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.000+0000 7f9b413d2700 1 -- 172.21.15.72:0/3100918471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3c120180 con 0x7f9b3c09e410 2023-10-03T10:18:07.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.000+0000 7f9b237fe700 1 -- 172.21.15.72:0/3100918471 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b340117e0 con 0x7f9b3c09e410 2023-10-03T10:18:07.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.000+0000 7f9b413d2700 1 -- 172.21.15.72:0/3100918471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c09c700 con 0x7f9b3c09e410 2023-10-03T10:18:07.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.001+0000 7f9b413d2700 1 -- 172.21.15.72:0/3100918471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3c074ea0 con 0x7f9b3c09e410 2023-10-03T10:18:07.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.002+0000 7f9b237fe700 1 -- 172.21.15.72:0/3100918471 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b34011940 con 0x7f9b3c09e410 2023-10-03T10:18:07.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.002+0000 7f9b237fe700 1 -- 172.21.15.72:0/3100918471 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9b3403fde0 con 0x7f9b3c09e410 2023-10-03T10:18:07.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.011+0000 7f9b237fe700 1 -- 172.21.15.72:0/3100918471 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b340218b0 con 0x7f9b3c09e410 2023-10-03T10:18:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.057+0000 7f5e41812700 1 -- 172.21.15.72:0/3724759745 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5e3c074ea0 con 0x7f5e3c1305f0 2023-10-03T10:18:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.057+0000 7f5e23fff700 1 -- 172.21.15.72:0/3724759745 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5e3402c020 con 0x7f5e3c1305f0 2023-10-03T10:18:07.058 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:07.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.061+0000 7f5e41812700 1 -- 172.21.15.72:0/3724759745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e3c1305f0 msgr2=0x7f5e3c1c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.061+0000 7f5e41812700 1 --2- 172.21.15.72:0/3724759745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e3c1305f0 0x7f5e3c1c5d80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009d90 tx=0x7f5e34004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.061+0000 7f5e41812700 1 -- 172.21.15.72:0/3724759745 shutdown_connections 2023-10-03T10:18:07.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.061+0000 7f5e41812700 1 --2- 172.21.15.72:0/3724759745 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5e3c1305f0 0x7f5e3c1c5d80 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.061+0000 7f5e41812700 1 --2- 172.21.15.72:0/3724759745 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5e3c06f660 0x7f5e3c138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.061+0000 7f5e41812700 1 --2- 172.21.15.72:0/3724759745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e3c070160 0x7f5e3c138b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.061+0000 7f5e41812700 1 -- 172.21.15.72:0/3724759745 >> 172.21.15.72:0/3724759745 conn(0x7f5e3c0a2aa0 msgr2=0x7f5e3c0677c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.061+0000 7f5e41812700 1 -- 172.21.15.72:0/3724759745 shutdown_connections 2023-10-03T10:18:07.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.061+0000 7f5e41812700 1 -- 172.21.15.72:0/3724759745 wait complete. 2023-10-03T10:18:07.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:07.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.124+0000 7f36dbaea700 1 -- 172.21.15.72:0/3917401719 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f36d409c690 con 0x7f36d4139170 2023-10-03T10:18:07.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.124+0000 7f36ca7fc700 1 -- 172.21.15.72:0/3917401719 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f36cc01d3b0 con 0x7f36d4139170 2023-10-03T10:18:07.124 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.126+0000 7f36dbaea700 1 -- 172.21.15.72:0/3917401719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d4139170 msgr2=0x7f36d411f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.126+0000 7f36dbaea700 1 --2- 172.21.15.72:0/3917401719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d4139170 0x7f36d411f1b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f36cc00be20 tx=0x7f36cc009ed0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.126+0000 7f36dbaea700 1 -- 172.21.15.72:0/3917401719 shutdown_connections 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.126+0000 7f36dbaea700 1 --2- 172.21.15.72:0/3917401719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36d4139170 0x7f36d411f1b0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.126+0000 7f36dbaea700 1 --2- 172.21.15.72:0/3917401719 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f36d409d6f0 0x7f36d411e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.126+0000 7f36dbaea700 1 --2- 172.21.15.72:0/3917401719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36d409e1d0 0x7f36d411ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.126+0000 7f36dbaea700 1 -- 172.21.15.72:0/3917401719 >> 172.21.15.72:0/3917401719 conn(0x7f36d4066f50 msgr2=0x7f36d4138090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.126+0000 7f36dbaea700 1 -- 172.21.15.72:0/3917401719 shutdown_connections 2023-10-03T10:18:07.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.126+0000 7f36dbaea700 1 -- 172.21.15.72:0/3917401719 wait complete. 2023-10-03T10:18:07.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:07.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.165+0000 7ff38b195700 1 -- 172.21.15.72:0/1316485799 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff384074ea0 con 0x7ff38409e000 2023-10-03T10:18:07.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.165+0000 7ff3817fa700 1 -- 172.21.15.72:0/1316485799 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff370015070 con 0x7ff38409e000 2023-10-03T10:18:07.165 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.167+0000 7ff38b195700 1 -- 172.21.15.72:0/1316485799 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff38409e000 msgr2=0x7ff3841a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.167+0000 7ff38b195700 1 --2- 172.21.15.72:0/1316485799 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff38409e000 0x7ff3841a5de0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff370009c70 tx=0x7ff370004750 comp rx=0 tx=0).stop 2023-10-03T10:18:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.167+0000 7ff38b195700 1 -- 172.21.15.72:0/1316485799 shutdown_connections 2023-10-03T10:18:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.167+0000 7ff38b195700 1 --2- 172.21.15.72:0/1316485799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff38409d6f0 0x7ff3841b91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.167+0000 7ff38b195700 1 --2- 172.21.15.72:0/1316485799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff38409e410 0x7ff3841a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.167+0000 7ff38b195700 1 --2- 172.21.15.72:0/1316485799 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff38409e000 0x7ff3841a5de0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.167+0000 7ff38b195700 1 -- 172.21.15.72:0/1316485799 >> 172.21.15.72:0/1316485799 conn(0x7ff384066f50 msgr2=0x7ff3841badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.167+0000 7ff38b195700 1 -- 172.21.15.72:0/1316485799 shutdown_connections 2023-10-03T10:18:07.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.167+0000 7ff38b195700 1 -- 172.21.15.72:0/1316485799 wait complete. 2023-10-03T10:18:07.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:07.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.206+0000 7f9b413d2700 1 -- 172.21.15.72:0/3100918471 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9b3c06c360 con 0x7f9b3c09e410 2023-10-03T10:18:07.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.206+0000 7f9b237fe700 1 -- 172.21.15.72:0/3100918471 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b34021680 con 0x7f9b3c09e410 2023-10-03T10:18:07.207 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:07.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.208+0000 7f9b413d2700 1 -- 172.21.15.72:0/3100918471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b3c09e410 msgr2=0x7f9b3c11eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.208+0000 7f9b413d2700 1 --2- 172.21.15.72:0/3100918471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b3c09e410 0x7f9b3c11eaa0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400e300 tx=0x7f9b3400e610 comp rx=0 tx=0).stop 2023-10-03T10:18:07.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.208+0000 7f9b413d2700 1 -- 172.21.15.72:0/3100918471 shutdown_connections 2023-10-03T10:18:07.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.208+0000 7f9b413d2700 1 --2- 172.21.15.72:0/3100918471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b3c09e410 0x7f9b3c11eaa0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.208+0000 7f9b413d2700 1 --2- 172.21.15.72:0/3100918471 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9b3c09d6f0 0x7f9b3c11e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.208+0000 7f9b413d2700 1 --2- 172.21.15.72:0/3100918471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9b3c09e000 0x7f9b3c11e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.208+0000 7f9b413d2700 1 -- 172.21.15.72:0/3100918471 >> 172.21.15.72:0/3100918471 conn(0x7f9b3c066f50 msgr2=0x7f9b3c070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.208+0000 7f9b413d2700 1 -- 172.21.15.72:0/3100918471 shutdown_connections 2023-10-03T10:18:07.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:07.208+0000 7f9b413d2700 1 -- 172.21.15.72:0/3100918471 wait complete. 2023-10-03T10:18:07.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:08.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:08.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:08.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:08.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.220+0000 7f25f7fdf700 1 Processor -- start 2023-10-03T10:18:08.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.220+0000 7f25f7fdf700 1 -- start start 2023-10-03T10:18:08.221 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:08.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.221+0000 7f25f7fdf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f0134630 0x7f25f0136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.221+0000 7f25f7fdf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25f0136f50 0x7f25f0139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.221+0000 7f25f7fdf700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f009b4f0 con 0x7f25f0131810 2023-10-03T10:18:08.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.221+0000 7f25f7fdf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f01313c0 con 0x7f25f0134630 2023-10-03T10:18:08.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.221+0000 7f25f7fdf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f006e8c0 con 0x7f25f0136f50 2023-10-03T10:18:08.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.221+0000 7f25f557a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f0134630 0x7f25f0136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.221+0000 7f25f557a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f0134630 0x7f25f0136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:36930/0 (socket says 172.21.15.72:36930) 2023-10-03T10:18:08.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.221+0000 7f25f557a700 1 -- 172.21.15.72:0/2767226679 learned_addr learned my addr 172.21.15.72:0/2767226679 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:08.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.221+0000 7f25f657c700 1 --2- 172.21.15.72:0/2767226679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25f0136f50 0x7f25f0139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.221+0000 7f25f557a700 1 -- 172.21.15.72:0/2767226679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25f0136f50 msgr2=0x7f25f0139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:08.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.221+0000 7f25f557a700 1 --2- 172.21.15.72:0/2767226679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25f0136f50 0x7f25f0139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.221+0000 7f25f4d79700 1 -- 172.21.15.72:0/2767226679 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389519905 0 0) 0x7f25f009b4f0 con 0x7f25f0131810 2023-10-03T10:18:08.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.221+0000 7f25f557a700 1 -- 172.21.15.72:0/2767226679 >> v1:172.21.15.72:6789/0 conn(0x7f25f0131810 legacy=0x7f25f0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.221+0000 7f25f557a700 1 -- 172.21.15.72:0/2767226679 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0071d20 con 0x7f25f0134630 2023-10-03T10:18:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.221+0000 7f25f657c700 1 --2- 172.21.15.72:0/2767226679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25f0136f50 0x7f25f0139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.222+0000 7f25f557a700 1 --2- 172.21.15.72:0/2767226679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f0134630 0x7f25f0136a10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009920 tx=0x7f25e0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61d9930a9f248d26 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.222+0000 7f25f4d79700 1 -- 172.21.15.72:0/2767226679 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0011830 con 0x7f25f0134630 2023-10-03T10:18:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.222+0000 7f25f4d79700 1 -- 172.21.15.72:0/2767226679 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e0011990 con 0x7f25f0134630 2023-10-03T10:18:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.222+0000 7f25f4d79700 1 -- 172.21.15.72:0/2767226679 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0011d20 con 0x7f25f0134630 2023-10-03T10:18:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.222+0000 7f25f7fdf700 1 -- 172.21.15.72:0/2767226679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f0134630 msgr2=0x7f25f0136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.222+0000 7f25f7fdf700 1 --2- 172.21.15.72:0/2767226679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f0134630 0x7f25f0136a10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f25e0009920 tx=0x7f25e0009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.223+0000 7f25f7fdf700 1 -- 172.21.15.72:0/2767226679 shutdown_connections 2023-10-03T10:18:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.223+0000 7f25f7fdf700 1 --2- 172.21.15.72:0/2767226679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25f0136f50 0x7f25f0139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.223+0000 7f25f7fdf700 1 --2- 172.21.15.72:0/2767226679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f0134630 0x7f25f0136a10 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.223+0000 7f25f7fdf700 1 -- 172.21.15.72:0/2767226679 >> 172.21.15.72:0/2767226679 conn(0x7f25f00a2aa0 msgr2=0x7f25f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.223+0000 7f25f7fdf700 1 -- 172.21.15.72:0/2767226679 shutdown_connections 2023-10-03T10:18:08.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.223+0000 7f25f7fdf700 1 -- 172.21.15.72:0/2767226679 wait complete. 2023-10-03T10:18:08.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.224+0000 7f25f7fdf700 1 Processor -- start 2023-10-03T10:18:08.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.224+0000 7f25f7fdf700 1 -- start start 2023-10-03T10:18:08.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.224+0000 7f25f7fdf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f0131810 0x7f25f0071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.224+0000 7f25f7fdf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25f0134630 0x7f25f011b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.224+0000 7f25f7fdf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f0136f50 0x7f25f011b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.224+0000 7f25f7fdf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f011c250 con 0x7f25f0136f50 2023-10-03T10:18:08.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.224+0000 7f25f7fdf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f0071680 con 0x7f25f0131810 2023-10-03T10:18:08.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.224+0000 7f25f7fdf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f011a2a0 con 0x7f25f0134630 2023-10-03T10:18:08.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.225+0000 7f25f557a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25f0134630 0x7f25f011b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.225+0000 7f25f557a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25f0134630 0x7f25f011b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:38112/0 (socket says 172.21.15.72:38112) 2023-10-03T10:18:08.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.225+0000 7f25f557a700 1 -- 172.21.15.72:0/1849576440 learned_addr learned my addr 172.21.15.72:0/1849576440 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:08.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.225+0000 7f25f657c700 1 --2- 172.21.15.72:0/1849576440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f0136f50 0x7f25f011b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.225+0000 7f25f657c700 1 -- 172.21.15.72:0/1849576440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25f0134630 msgr2=0x7f25f011b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.225+0000 7f25f657c700 1 --2- 172.21.15.72:0/1849576440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25f0134630 0x7f25f011b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.225+0000 7f25f657c700 1 -- 172.21.15.72:0/1849576440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f0131810 msgr2=0x7f25f0071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.225+0000 7f25f657c700 1 --2- 172.21.15.72:0/1849576440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f0131810 0x7f25f0071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.225+0000 7f25f657c700 1 -- 172.21.15.72:0/1849576440 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e8009a70 con 0x7f25f0136f50 2023-10-03T10:18:08.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.225+0000 7f25f557a700 1 --2- 172.21.15.72:0/1849576440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25f0134630 0x7f25f011b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.225+0000 7f25f657c700 1 --2- 172.21.15.72:0/1849576440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f0136f50 0x7f25f011b6a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f25f012eee0 tx=0x7f25e800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.225+0000 7f25e67fc700 1 -- 172.21.15.72:0/1849576440 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e800cad0 con 0x7f25f0136f50 2023-10-03T10:18:08.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.226+0000 7f25f7fdf700 1 -- 172.21.15.72:0/1849576440 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e0009550 con 0x7f25f0136f50 2023-10-03T10:18:08.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.226+0000 7f25f7fdf700 1 -- 172.21.15.72:0/1849576440 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f0118e60 con 0x7f25f0136f50 2023-10-03T10:18:08.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.226+0000 7f25e67fc700 1 -- 172.21.15.72:0/1849576440 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e800f040 con 0x7f25f0136f50 2023-10-03T10:18:08.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.226+0000 7f25e67fc700 1 -- 172.21.15.72:0/1849576440 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e800ce70 con 0x7f25f0136f50 2023-10-03T10:18:08.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.226+0000 7f25e67fc700 1 -- 172.21.15.72:0/1849576440 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25e8014480 con 0x7f25f0136f50 2023-10-03T10:18:08.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.227+0000 7f25e67fc700 1 -- 172.21.15.72:0/1849576440 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f25e803fc80 con 0x7f25f0136f50 2023-10-03T10:18:08.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.227+0000 7f25f7fdf700 1 -- 172.21.15.72:0/1849576440 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d80052e0 con 0x7f25f0136f50 2023-10-03T10:18:08.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.233+0000 7f25e67fc700 1 -- 172.21.15.72:0/1849576440 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25e8012700 con 0x7f25f0136f50 2023-10-03T10:18:08.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.287+0000 7f87b3d60700 1 Processor -- start 2023-10-03T10:18:08.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.287+0000 7f87b3d60700 1 -- start start 2023-10-03T10:18:08.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.288+0000 7f87b3d60700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87ac09f410 0x7f87ac136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.288+0000 7f87b3d60700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87ac136fe0 0x7f87ac1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.288+0000 7f87b3d60700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac070940 con 0x7f87ac09e930 2023-10-03T10:18:08.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.288+0000 7f87b3d60700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac06fd60 con 0x7f87ac09f410 2023-10-03T10:18:08.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.288+0000 7f87b3d60700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac06fa80 con 0x7f87ac136fe0 2023-10-03T10:18:08.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.288+0000 7f87b22fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87ac136fe0 0x7f87ac1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.288+0000 7f87b12fb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87ac09f410 0x7f87ac136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.288+0000 7f87b22fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87ac136fe0 0x7f87ac1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55378/0 (socket says 172.21.15.72:55378) 2023-10-03T10:18:08.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.288+0000 7f87b12fb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87ac09f410 0x7f87ac136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57588/0 (socket says 172.21.15.72:57588) 2023-10-03T10:18:08.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.288+0000 7f87b22fd700 1 -- 172.21.15.72:0/1089018231 learned_addr learned my addr 172.21.15.72:0/1089018231 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:08.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.289+0000 7f87b22fd700 1 -- 172.21.15.72:0/1089018231 >> v2:172.21.15.72:3300/0 conn(0x7f87ac09f410 msgr2=0x7f87ac136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:08.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.289+0000 7f87b22fd700 1 --2- 172.21.15.72:0/1089018231 >> v2:172.21.15.72:3300/0 conn(0x7f87ac09f410 0x7f87ac136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.289+0000 7f87b22fd700 1 -- 172.21.15.72:0/1089018231 >> v1:172.21.15.72:6789/0 conn(0x7f87ac09e930 legacy=0x7f87ac09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.289+0000 7f87b22fd700 1 -- 172.21.15.72:0/1089018231 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac09fb60 con 0x7f87ac136fe0 2023-10-03T10:18:08.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.289+0000 7f87b22fd700 1 --2- 172.21.15.72:0/1089018231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87ac136fe0 0x7f87ac1393c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f87a400f370 tx=0x7f87a400f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b3ea6f9ef8e8fdd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.289+0000 7f87b0afa700 1 -- 172.21.15.72:0/1089018231 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4012070 con 0x7f87ac136fe0 2023-10-03T10:18:08.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.289+0000 7f87b0afa700 1 -- 172.21.15.72:0/1089018231 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a400d0d0 con 0x7f87ac136fe0 2023-10-03T10:18:08.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.289+0000 7f87b0afa700 1 -- 172.21.15.72:0/1089018231 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400d480 con 0x7f87ac136fe0 2023-10-03T10:18:08.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.290+0000 7f87b3d60700 1 -- 172.21.15.72:0/1089018231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87ac136fe0 msgr2=0x7f87ac1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.290+0000 7f87b3d60700 1 --2- 172.21.15.72:0/1089018231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87ac136fe0 0x7f87ac1393c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f87a400f370 tx=0x7f87a400f680 comp rx=0 tx=0).stop 2023-10-03T10:18:08.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.290+0000 7f87b3d60700 1 -- 172.21.15.72:0/1089018231 shutdown_connections 2023-10-03T10:18:08.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.290+0000 7f87b3d60700 1 --2- 172.21.15.72:0/1089018231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87ac136fe0 0x7f87ac1393c0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.290+0000 7f87b3d60700 1 --2- 172.21.15.72:0/1089018231 >> v2:172.21.15.72:3300/0 conn(0x7f87ac09f410 0x7f87ac136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.290+0000 7f87b3d60700 1 -- 172.21.15.72:0/1089018231 >> 172.21.15.72:0/1089018231 conn(0x7f87ac0a4210 msgr2=0x7f87ac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.290+0000 7f87b3d60700 1 -- 172.21.15.72:0/1089018231 shutdown_connections 2023-10-03T10:18:08.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.290+0000 7f87b3d60700 1 -- 172.21.15.72:0/1089018231 wait complete. 2023-10-03T10:18:08.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.291+0000 7f87b3d60700 1 Processor -- start 2023-10-03T10:18:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.291+0000 7f87b3d60700 1 -- start start 2023-10-03T10:18:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.291+0000 7f87b3d60700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87ac09e930 0x7f87ac11a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.291+0000 7f87b3d60700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87ac09f410 0x7f87ac11abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.291+0000 7f87b3d60700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87ac136fe0 0x7f87ac11b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.291+0000 7f87b3d60700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac11df50 con 0x7f87ac09f410 2023-10-03T10:18:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.291+0000 7f87b3d60700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac11d8a0 con 0x7f87ac136fe0 2023-10-03T10:18:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.291+0000 7f87b3d60700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac132660 con 0x7f87ac09e930 2023-10-03T10:18:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.292+0000 7f87b22fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87ac136fe0 0x7f87ac11b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.292+0000 7f87b22fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87ac136fe0 0x7f87ac11b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55386/0 (socket says 172.21.15.72:55386) 2023-10-03T10:18:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.292+0000 7f87b22fd700 1 -- 172.21.15.72:0/1717577776 learned_addr learned my addr 172.21.15.72:0/1717577776 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.292+0000 7f87b1afc700 1 --2- 172.21.15.72:0/1717577776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87ac09e930 0x7f87ac11a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.292+0000 7f87b12fb700 1 --2- 172.21.15.72:0/1717577776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87ac09f410 0x7f87ac11abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.292+0000 7f87b22fd700 1 -- 172.21.15.72:0/1717577776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87ac09e930 msgr2=0x7f87ac11a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.292+0000 7f87b22fd700 1 --2- 172.21.15.72:0/1717577776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87ac09e930 0x7f87ac11a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.292+0000 7f87b22fd700 1 -- 172.21.15.72:0/1717577776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87ac09f410 msgr2=0x7f87ac11abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.292+0000 7f87b22fd700 1 --2- 172.21.15.72:0/1717577776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87ac09f410 0x7f87ac11abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.292+0000 7f87b22fd700 1 -- 172.21.15.72:0/1717577776 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a400f050 con 0x7f87ac136fe0 2023-10-03T10:18:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.292+0000 7f87b22fd700 1 --2- 172.21.15.72:0/1717577776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87ac136fe0 0x7f87ac11b100 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f87ac06fbc0 tx=0x7f87a4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.293+0000 7f87a27fc700 1 -- 172.21.15.72:0/1717577776 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400bc10 con 0x7f87ac136fe0 2023-10-03T10:18:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.293+0000 7f87a27fc700 1 -- 172.21.15.72:0/1717577776 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a400bd70 con 0x7f87ac136fe0 2023-10-03T10:18:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.293+0000 7f87b3d60700 1 -- 172.21.15.72:0/1717577776 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac0a32d0 con 0x7f87ac136fe0 2023-10-03T10:18:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.293+0000 7f87a27fc700 1 -- 172.21.15.72:0/1717577776 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4004280 con 0x7f87ac136fe0 2023-10-03T10:18:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.293+0000 7f87b3d60700 1 -- 172.21.15.72:0/1717577776 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac11e5d0 con 0x7f87ac136fe0 2023-10-03T10:18:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.293+0000 7f87a27fc700 1 -- 172.21.15.72:0/1717577776 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f87a40043e0 con 0x7f87ac136fe0 2023-10-03T10:18:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.294+0000 7f87a27fc700 1 -- 172.21.15.72:0/1717577776 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f87a4045b00 con 0x7f87ac136fe0 2023-10-03T10:18:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.294+0000 7f87b3d60700 1 -- 172.21.15.72:0/1717577776 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac074ea0 con 0x7f87ac136fe0 2023-10-03T10:18:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.299+0000 7f87a27fc700 1 -- 172.21.15.72:0/1717577776 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87a4030390 con 0x7f87ac136fe0 2023-10-03T10:18:08.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.314+0000 7f400b2bf700 1 Processor -- start 2023-10-03T10:18:08.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.315+0000 7f400b2bf700 1 -- start start 2023-10-03T10:18:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.315+0000 7f400b2bf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4004130540 0x7f4004130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.315+0000 7f400b2bf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004130e50 0x7f400406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.315+0000 7f400b2bf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400406fb20 0x7f400406ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.315+0000 7f400b2bf700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400409a390 con 0x7f4004130540 2023-10-03T10:18:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.315+0000 7f400b2bf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40040716a0 con 0x7f400406fb20 2023-10-03T10:18:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.315+0000 7f400b2bf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4004071290 con 0x7f4004130e50 2023-10-03T10:18:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.315+0000 7f400885a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004130e50 0x7f400406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.315+0000 7f400885a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004130e50 0x7f400406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47954/0 (socket says 172.21.15.72:47954) 2023-10-03T10:18:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.315+0000 7f400985c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400406fb20 0x7f400406ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.315+0000 7f400885a700 1 -- 172.21.15.72:0/3492388720 learned_addr learned my addr 172.21.15.72:0/3492388720 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.315+0000 7f400905b700 1 --2- 172.21.15.72:0/3492388720 >> v2:172.21.15.72:3300/0 conn(0x7f4004130540 0x7f4004130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.316+0000 7f400985c700 1 -- 172.21.15.72:0/3492388720 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004130e50 msgr2=0x7f400406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.316+0000 7f400985c700 1 --2- 172.21.15.72:0/3492388720 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004130e50 0x7f400406f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.316+0000 7f400985c700 1 -- 172.21.15.72:0/3492388720 >> v2:172.21.15.72:3300/0 conn(0x7f4004130540 msgr2=0x7f4004130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.316+0000 7f400985c700 1 --2- 172.21.15.72:0/3492388720 >> v2:172.21.15.72:3300/0 conn(0x7f4004130540 0x7f4004130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.316+0000 7f400985c700 1 -- 172.21.15.72:0/3492388720 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4004130340 con 0x7f400406fb20 2023-10-03T10:18:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.316+0000 7f400885a700 1 --2- 172.21.15.72:0/3492388720 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004130e50 0x7f400406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.316+0000 7f400985c700 1 --2- 172.21.15.72:0/3492388720 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400406fb20 0x7f400406ffa0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc009d90 tx=0x7f3ffc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d36f58b3189ccdb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.316+0000 7f3ffbfff700 1 -- 172.21.15.72:0/3492388720 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc00e070 con 0x7f400406fb20 2023-10-03T10:18:08.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.316+0000 7f3ffbfff700 1 -- 172.21.15.72:0/3492388720 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc00bb20 con 0x7f400406fb20 2023-10-03T10:18:08.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.316+0000 7f3ffbfff700 1 -- 172.21.15.72:0/3492388720 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc012430 con 0x7f400406fb20 2023-10-03T10:18:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.317+0000 7f400b2bf700 1 -- 172.21.15.72:0/3492388720 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400406fb20 msgr2=0x7f400406ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.317+0000 7f400b2bf700 1 --2- 172.21.15.72:0/3492388720 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400406fb20 0x7f400406ffa0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc009d90 tx=0x7f3ffc00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.317+0000 7f400b2bf700 1 -- 172.21.15.72:0/3492388720 shutdown_connections 2023-10-03T10:18:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.317+0000 7f400b2bf700 1 --2- 172.21.15.72:0/3492388720 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400406fb20 0x7f400406ffa0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.317+0000 7f400b2bf700 1 --2- 172.21.15.72:0/3492388720 >> v2:172.21.15.72:3300/0 conn(0x7f4004130540 0x7f4004130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.317+0000 7f400b2bf700 1 --2- 172.21.15.72:0/3492388720 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004130e50 0x7f400406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.317+0000 7f400b2bf700 1 -- 172.21.15.72:0/3492388720 >> 172.21.15.72:0/3492388720 conn(0x7f40040a2aa0 msgr2=0x7f40040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.317+0000 7f400b2bf700 1 -- 172.21.15.72:0/3492388720 shutdown_connections 2023-10-03T10:18:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.317+0000 7f400b2bf700 1 -- 172.21.15.72:0/3492388720 wait complete. 2023-10-03T10:18:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.318+0000 7f400b2bf700 1 Processor -- start 2023-10-03T10:18:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.318+0000 7f400b2bf700 1 -- start start 2023-10-03T10:18:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400b2bf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400406fb20 0x7f4004138640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400b2bf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4004130540 0x7f4004138b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400b2bf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004130e50 0x7f40041390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400b2bf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4004135430 con 0x7f4004130540 2023-10-03T10:18:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400b2bf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4004137a60 con 0x7f400406fb20 2023-10-03T10:18:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400b2bf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40040718e0 con 0x7f4004130e50 2023-10-03T10:18:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400905b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400406fb20 0x7f4004138640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400905b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400406fb20 0x7f4004138640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55402/0 (socket says 172.21.15.72:55402) 2023-10-03T10:18:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400905b700 1 -- 172.21.15.72:0/3113521580 learned_addr learned my addr 172.21.15.72:0/3113521580 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400885a700 1 --2- 172.21.15.72:0/3113521580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4004130540 0x7f4004138b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400985c700 1 --2- 172.21.15.72:0/3113521580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004130e50 0x7f40041390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400905b700 1 -- 172.21.15.72:0/3113521580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004130e50 msgr2=0x7f40041390c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400905b700 1 --2- 172.21.15.72:0/3113521580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004130e50 0x7f40041390c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400905b700 1 -- 172.21.15.72:0/3113521580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4004130540 msgr2=0x7f4004138b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400905b700 1 --2- 172.21.15.72:0/3113521580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4004130540 0x7f4004138b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.319+0000 7f400905b700 1 -- 172.21.15.72:0/3113521580 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff4009550 con 0x7f400406fb20 2023-10-03T10:18:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.320+0000 7f400905b700 1 --2- 172.21.15.72:0/3113521580 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400406fb20 0x7f4004138640 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f400000e9b0 tx=0x7f400000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.320+0000 7f3ff9ffb700 1 -- 172.21.15.72:0/3113521580 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000009710 con 0x7f400406fb20 2023-10-03T10:18:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.320+0000 7f3ff9ffb700 1 -- 172.21.15.72:0/3113521580 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400000c850 con 0x7f400406fb20 2023-10-03T10:18:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.320+0000 7f3ff9ffb700 1 -- 172.21.15.72:0/3113521580 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400000cbc0 con 0x7f400406fb20 2023-10-03T10:18:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.320+0000 7f400b2bf700 1 -- 172.21.15.72:0/3113521580 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ffc009a70 con 0x7f400406fb20 2023-10-03T10:18:08.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.320+0000 7f400b2bf700 1 -- 172.21.15.72:0/3113521580 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40040a0810 con 0x7f400406fb20 2023-10-03T10:18:08.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.321+0000 7f3ff9ffb700 1 -- 172.21.15.72:0/3113521580 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f400000cd20 con 0x7f400406fb20 2023-10-03T10:18:08.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.321+0000 7f400b2bf700 1 -- 172.21.15.72:0/3113521580 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4004074ea0 con 0x7f400406fb20 2023-10-03T10:18:08.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.321+0000 7f3ff9ffb700 1 -- 172.21.15.72:0/3113521580 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f400003fba0 con 0x7f400406fb20 2023-10-03T10:18:08.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.326+0000 7f3ff9ffb700 1 -- 172.21.15.72:0/3113521580 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f400001adc0 con 0x7f400406fb20 2023-10-03T10:18:08.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.353+0000 7f73aa921700 1 Processor -- start 2023-10-03T10:18:08.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.353+0000 7f73aa921700 1 -- start start 2023-10-03T10:18:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.353+0000 7f73aa921700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f73a409f410 0x7f73a4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.353+0000 7f73aa921700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73a4136fe0 0x7f73a41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.353+0000 7f73aa921700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a4070940 con 0x7f73a409e930 2023-10-03T10:18:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.353+0000 7f73aa921700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a406fd60 con 0x7f73a409f410 2023-10-03T10:18:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.353+0000 7f73aa921700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73a406fa80 con 0x7f73a4136fe0 2023-10-03T10:18:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.354+0000 7f73a37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f73a409f410 0x7f73a4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.354+0000 7f73a8ebe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73a4136fe0 0x7f73a41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.354+0000 7f73a8ebe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73a4136fe0 0x7f73a41393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47970/0 (socket says 172.21.15.72:47970) 2023-10-03T10:18:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.354+0000 7f73a37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f73a409f410 0x7f73a4136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57634/0 (socket says 172.21.15.72:57634) 2023-10-03T10:18:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.354+0000 7f73a8ebe700 1 -- 172.21.15.72:0/2167436028 learned_addr learned my addr 172.21.15.72:0/2167436028 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.354+0000 7f73a37fe700 1 -- 172.21.15.72:0/2167436028 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73a4136fe0 msgr2=0x7f73a41393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.354+0000 7f73a37fe700 1 --2- 172.21.15.72:0/2167436028 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73a4136fe0 0x7f73a41393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.354+0000 7f73a37fe700 1 -- 172.21.15.72:0/2167436028 >> v1:172.21.15.72:6789/0 conn(0x7f73a409e930 legacy=0x7f73a409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.354+0000 7f73a37fe700 1 -- 172.21.15.72:0/2167436028 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a409fb60 con 0x7f73a409f410 2023-10-03T10:18:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.354+0000 7f73a8ebe700 1 --2- 172.21.15.72:0/2167436028 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73a4136fe0 0x7f73a41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.354+0000 7f73a37fe700 1 --2- 172.21.15.72:0/2167436028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73a409f410 0x7f73a4136aa0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f7398009840 tx=0x7f7398009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659ad07f977333d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.354+0000 7f73a2ffd700 1 -- 172.21.15.72:0/2167436028 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398011830 con 0x7f73a409f410 2023-10-03T10:18:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.354+0000 7f73a2ffd700 1 -- 172.21.15.72:0/2167436028 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7398011990 con 0x7f73a409f410 2023-10-03T10:18:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.354+0000 7f73a2ffd700 1 -- 172.21.15.72:0/2167436028 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398011d20 con 0x7f73a409f410 2023-10-03T10:18:08.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.355+0000 7f73aa921700 1 -- 172.21.15.72:0/2167436028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73a409f410 msgr2=0x7f73a4136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.355+0000 7f73aa921700 1 --2- 172.21.15.72:0/2167436028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73a409f410 0x7f73a4136aa0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f7398009840 tx=0x7f7398009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:08.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.355+0000 7f73aa921700 1 -- 172.21.15.72:0/2167436028 shutdown_connections 2023-10-03T10:18:08.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.355+0000 7f73aa921700 1 --2- 172.21.15.72:0/2167436028 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73a4136fe0 0x7f73a41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.355+0000 7f73aa921700 1 --2- 172.21.15.72:0/2167436028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73a409f410 0x7f73a4136aa0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.355+0000 7f73aa921700 1 -- 172.21.15.72:0/2167436028 >> 172.21.15.72:0/2167436028 conn(0x7f73a40a4210 msgr2=0x7f73a40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.355+0000 7f73aa921700 1 -- 172.21.15.72:0/2167436028 shutdown_connections 2023-10-03T10:18:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.355+0000 7f73aa921700 1 -- 172.21.15.72:0/2167436028 wait complete. 2023-10-03T10:18:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.356+0000 7f73aa921700 1 Processor -- start 2023-10-03T10:18:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.356+0000 7f73aa921700 1 -- start start 2023-10-03T10:18:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.356+0000 7f73aa921700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73a409e930 0x7f73a411c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73aa921700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73a409f410 0x7f73a411cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73aa921700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73a4136fe0 0x7f73a411d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73aa921700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a40a2f40 con 0x7f73a409f410 2023-10-03T10:18:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73aa921700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a411e390 con 0x7f73a4136fe0 2023-10-03T10:18:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73aa921700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73a4071d20 con 0x7f73a409e930 2023-10-03T10:18:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73a3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73a409e930 0x7f73a411c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73a3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73a409e930 0x7f73a411c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47974/0 (socket says 172.21.15.72:47974) 2023-10-03T10:18:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73a3fff700 1 -- 172.21.15.72:0/3737547393 learned_addr learned my addr 172.21.15.72:0/3737547393 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:08.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73a37fe700 1 --2- 172.21.15.72:0/3737547393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73a409f410 0x7f73a411cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73a8ebe700 1 --2- 172.21.15.72:0/3737547393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73a4136fe0 0x7f73a411d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73a3fff700 1 -- 172.21.15.72:0/3737547393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73a4136fe0 msgr2=0x7f73a411d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73a3fff700 1 --2- 172.21.15.72:0/3737547393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73a4136fe0 0x7f73a411d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73a3fff700 1 -- 172.21.15.72:0/3737547393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73a409f410 msgr2=0x7f73a411cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73a3fff700 1 --2- 172.21.15.72:0/3737547393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73a409f410 0x7f73a411cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73a3fff700 1 -- 172.21.15.72:0/3737547393 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c009b30 con 0x7f73a409e930 2023-10-03T10:18:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73a37fe700 1 --2- 172.21.15.72:0/3737547393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73a409f410 0x7f73a411cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73a3fff700 1 --2- 172.21.15.72:0/3737547393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73a409e930 0x7f73a411c670 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f739400c4e0 tx=0x7f739400c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.357+0000 7f73a0ff9700 1 -- 172.21.15.72:0/3737547393 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940052d0 con 0x7f73a409e930 2023-10-03T10:18:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.358+0000 7f73a0ff9700 1 -- 172.21.15.72:0/3737547393 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7394005430 con 0x7f73a409e930 2023-10-03T10:18:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.358+0000 7f73aa921700 1 -- 172.21.15.72:0/3737547393 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73980094a0 con 0x7f73a409e930 2023-10-03T10:18:08.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.358+0000 7f73a0ff9700 1 -- 172.21.15.72:0/3737547393 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940119b0 con 0x7f73a409e930 2023-10-03T10:18:08.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.358+0000 7f73aa921700 1 -- 172.21.15.72:0/3737547393 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a411ea30 con 0x7f73a409e930 2023-10-03T10:18:08.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.358+0000 7f73a0ff9700 1 -- 172.21.15.72:0/3737547393 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7394011b10 con 0x7f73a409e930 2023-10-03T10:18:08.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.359+0000 7f73a0ff9700 1 -- 172.21.15.72:0/3737547393 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7394042c60 con 0x7f73a409e930 2023-10-03T10:18:08.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.359+0000 7f73aa921700 1 -- 172.21.15.72:0/3737547393 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a4074ea0 con 0x7f73a409e930 2023-10-03T10:18:08.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.364+0000 7f73a0ff9700 1 -- 172.21.15.72:0/3737547393 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73940223f0 con 0x7f73a409e930 2023-10-03T10:18:08.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.499+0000 7f25f7fdf700 1 -- 172.21.15.72:0/1849576440 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f25d8005590 con 0x7f25f0136f50 2023-10-03T10:18:08.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.499+0000 7f25e67fc700 1 -- 172.21.15.72:0/1849576440 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f25e801c3b0 con 0x7f25f0136f50 2023-10-03T10:18:08.500 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:08.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.502+0000 7f25f7fdf700 1 -- 172.21.15.72:0/1849576440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f0136f50 msgr2=0x7f25f011b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.502+0000 7f25f7fdf700 1 --2- 172.21.15.72:0/1849576440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f0136f50 0x7f25f011b6a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f25f012eee0 tx=0x7f25e800ef90 comp rx=0 tx=0).stop 2023-10-03T10:18:08.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.502+0000 7f25f7fdf700 1 -- 172.21.15.72:0/1849576440 shutdown_connections 2023-10-03T10:18:08.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.502+0000 7f25f7fdf700 1 --2- 172.21.15.72:0/1849576440 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f0136f50 0x7f25f011b6a0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.502+0000 7f25f7fdf700 1 --2- 172.21.15.72:0/1849576440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f0131810 0x7f25f0071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.502+0000 7f25f7fdf700 1 --2- 172.21.15.72:0/1849576440 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f25f0134630 0x7f25f011b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.502+0000 7f25f7fdf700 1 -- 172.21.15.72:0/1849576440 >> 172.21.15.72:0/1849576440 conn(0x7f25f00a2aa0 msgr2=0x7f25f00a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.503+0000 7f25f7fdf700 1 -- 172.21.15.72:0/1849576440 shutdown_connections 2023-10-03T10:18:08.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.503+0000 7f25f7fdf700 1 -- 172.21.15.72:0/1849576440 wait complete. 2023-10-03T10:18:08.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:08.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.521+0000 7f400b2bf700 1 -- 172.21.15.72:0/3113521580 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f40041376c0 con 0x7f400406fb20 2023-10-03T10:18:08.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.522+0000 7f3ff9ffb700 1 -- 172.21.15.72:0/3113521580 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40041376c0 con 0x7f400406fb20 2023-10-03T10:18:08.522 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:08.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.525+0000 7f400b2bf700 1 -- 172.21.15.72:0/3113521580 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400406fb20 msgr2=0x7f4004138640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.525+0000 7f400b2bf700 1 --2- 172.21.15.72:0/3113521580 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400406fb20 0x7f4004138640 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f400000e9b0 tx=0x7f400000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.525+0000 7f400b2bf700 1 -- 172.21.15.72:0/3113521580 shutdown_connections 2023-10-03T10:18:08.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.525+0000 7f400b2bf700 1 --2- 172.21.15.72:0/3113521580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4004130e50 0x7f40041390c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.525+0000 7f400b2bf700 1 --2- 172.21.15.72:0/3113521580 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f400406fb20 0x7f4004138640 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.525+0000 7f400b2bf700 1 --2- 172.21.15.72:0/3113521580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4004130540 0x7f4004138b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.525+0000 7f400b2bf700 1 -- 172.21.15.72:0/3113521580 >> 172.21.15.72:0/3113521580 conn(0x7f40040a2aa0 msgr2=0x7f400406ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.525+0000 7f400b2bf700 1 -- 172.21.15.72:0/3113521580 shutdown_connections 2023-10-03T10:18:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.525+0000 7f400b2bf700 1 -- 172.21.15.72:0/3113521580 wait complete. 2023-10-03T10:18:08.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:08.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.555+0000 7f87b3d60700 1 -- 172.21.15.72:0/1717577776 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f87ac06b250 con 0x7f87ac136fe0 2023-10-03T10:18:08.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.555+0000 7f87a27fc700 1 -- 172.21.15.72:0/1717577776 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f87a401fb90 con 0x7f87ac136fe0 2023-10-03T10:18:08.556 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:08.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.557+0000 7f87b3d60700 1 -- 172.21.15.72:0/1717577776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87ac136fe0 msgr2=0x7f87ac11b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.557+0000 7f87b3d60700 1 --2- 172.21.15.72:0/1717577776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87ac136fe0 0x7f87ac11b100 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f87ac06fbc0 tx=0x7f87a4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.557+0000 7f87b3d60700 1 -- 172.21.15.72:0/1717577776 shutdown_connections 2023-10-03T10:18:08.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.557+0000 7f87b3d60700 1 --2- 172.21.15.72:0/1717577776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87ac136fe0 0x7f87ac11b100 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.557+0000 7f87b3d60700 1 --2- 172.21.15.72:0/1717577776 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f87ac09e930 0x7f87ac11a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.557+0000 7f87b3d60700 1 --2- 172.21.15.72:0/1717577776 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87ac09f410 0x7f87ac11abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.557+0000 7f87b3d60700 1 -- 172.21.15.72:0/1717577776 >> 172.21.15.72:0/1717577776 conn(0x7f87ac0a4210 msgr2=0x7f87ac132870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.557+0000 7f87b3d60700 1 -- 172.21.15.72:0/1717577776 shutdown_connections 2023-10-03T10:18:08.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.557+0000 7f87b3d60700 1 -- 172.21.15.72:0/1717577776 wait complete. 2023-10-03T10:18:08.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.561+0000 7f73aa921700 1 -- 172.21.15.72:0/3737547393 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f73a411fb50 con 0x7f73a409e930 2023-10-03T10:18:08.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.562+0000 7f73a0ff9700 1 -- 172.21.15.72:0/3737547393 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73940172f0 con 0x7f73a409e930 2023-10-03T10:18:08.562 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:08.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.564+0000 7f73aa921700 1 -- 172.21.15.72:0/3737547393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73a409e930 msgr2=0x7f73a411c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.564+0000 7f73aa921700 1 --2- 172.21.15.72:0/3737547393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73a409e930 0x7f73a411c670 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f739400c4e0 tx=0x7f739400c7f0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.564+0000 7f73aa921700 1 -- 172.21.15.72:0/3737547393 shutdown_connections 2023-10-03T10:18:08.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.564+0000 7f73aa921700 1 --2- 172.21.15.72:0/3737547393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73a4136fe0 0x7f73a411d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.564+0000 7f73aa921700 1 --2- 172.21.15.72:0/3737547393 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f73a409e930 0x7f73a411c670 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.564+0000 7f73aa921700 1 --2- 172.21.15.72:0/3737547393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73a409f410 0x7f73a411cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.564+0000 7f73aa921700 1 -- 172.21.15.72:0/3737547393 >> 172.21.15.72:0/3737547393 conn(0x7f73a40a4210 msgr2=0x7f73a40a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.564+0000 7f73aa921700 1 -- 172.21.15.72:0/3737547393 shutdown_connections 2023-10-03T10:18:08.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:08.564+0000 7f73aa921700 1 -- 172.21.15.72:0/3737547393 wait complete. 2023-10-03T10:18:08.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:08.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:09.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:09.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:09.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:09.578 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:09.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.661+0000 7ffa0fe75700 1 Processor -- start 2023-10-03T10:18:09.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.662+0000 7ffa0fe75700 1 -- start start 2023-10-03T10:18:09.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.662+0000 7ffa0fe75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa081338a0 0x7ffa08133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.662+0000 7ffa0fe75700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa0809de50 0x7ffa0809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.662+0000 7ffa0fe75700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0806ef30 con 0x7ffa0809e760 2023-10-03T10:18:09.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.662+0000 7ffa0fe75700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0806fef0 con 0x7ffa0809de50 2023-10-03T10:18:09.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.662+0000 7ffa0fe75700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa081334b0 con 0x7ffa081338a0 2023-10-03T10:18:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.662+0000 7ffa0dc11700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa081338a0 0x7ffa08133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.662+0000 7ffa0dc11700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa081338a0 0x7ffa08133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55422/0 (socket says 172.21.15.72:55422) 2023-10-03T10:18:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.662+0000 7ffa0e412700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffa0809e760 0x7ffa0813a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42226/0 (socket says 172.21.15.72:42226) 2023-10-03T10:18:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.662+0000 7ffa0dc11700 1 -- 172.21.15.72:0/4093651754 learned_addr learned my addr 172.21.15.72:0/4093651754 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.662+0000 7ffa0d410700 1 --2- 172.21.15.72:0/4093651754 >> v2:172.21.15.72:3300/0 conn(0x7ffa0809de50 0x7ffa0809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.663+0000 7ffa0dc11700 1 -- 172.21.15.72:0/4093651754 >> v2:172.21.15.72:3300/0 conn(0x7ffa0809de50 msgr2=0x7ffa0809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.663+0000 7ffa0dc11700 1 --2- 172.21.15.72:0/4093651754 >> v2:172.21.15.72:3300/0 conn(0x7ffa0809de50 0x7ffa0809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.663+0000 7ffa0dc11700 1 -- 172.21.15.72:0/4093651754 >> v1:172.21.15.72:6789/0 conn(0x7ffa0809e760 legacy=0x7ffa0813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.663+0000 7ffa0dc11700 1 -- 172.21.15.72:0/4093651754 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0806fc30 con 0x7ffa081338a0 2023-10-03T10:18:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.663+0000 7ffa0dc11700 1 --2- 172.21.15.72:0/4093651754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa081338a0 0x7ffa08133c70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ffa040098f0 tx=0x7ffa04009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28db3dd300038533 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.663+0000 7ffa0cc0f700 1 -- 172.21.15.72:0/4093651754 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04011830 con 0x7ffa081338a0 2023-10-03T10:18:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.663+0000 7ffa0cc0f700 1 -- 172.21.15.72:0/4093651754 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04011990 con 0x7ffa081338a0 2023-10-03T10:18:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.663+0000 7ffa0cc0f700 1 -- 172.21.15.72:0/4093651754 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04011d20 con 0x7ffa081338a0 2023-10-03T10:18:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.664+0000 7ffa0fe75700 1 -- 172.21.15.72:0/4093651754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa081338a0 msgr2=0x7ffa08133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.664+0000 7ffa0fe75700 1 --2- 172.21.15.72:0/4093651754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa081338a0 0x7ffa08133c70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ffa040098f0 tx=0x7ffa04009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.664+0000 7ffa0fe75700 1 -- 172.21.15.72:0/4093651754 shutdown_connections 2023-10-03T10:18:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.664+0000 7ffa0fe75700 1 --2- 172.21.15.72:0/4093651754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa081338a0 0x7ffa08133c70 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.664+0000 7ffa0fe75700 1 --2- 172.21.15.72:0/4093651754 >> v2:172.21.15.72:3300/0 conn(0x7ffa0809de50 0x7ffa0809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.664+0000 7ffa0fe75700 1 -- 172.21.15.72:0/4093651754 >> 172.21.15.72:0/4093651754 conn(0x7ffa080a2aa0 msgr2=0x7ffa080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.664+0000 7ffa0fe75700 1 -- 172.21.15.72:0/4093651754 shutdown_connections 2023-10-03T10:18:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.664+0000 7ffa0fe75700 1 -- 172.21.15.72:0/4093651754 wait complete. 2023-10-03T10:18:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.665+0000 7ffa0fe75700 1 Processor -- start 2023-10-03T10:18:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.665+0000 7ffa0fe75700 1 -- start start 2023-10-03T10:18:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.665+0000 7ffa0fe75700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0809de50 0x7ffa0811d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.665+0000 7ffa0fe75700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa0809e760 0x7ffa0811dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.665+0000 7ffa0fe75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa081338a0 0x7ffa0811e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.665+0000 7ffa0fe75700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0811f300 con 0x7ffa0809de50 2023-10-03T10:18:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.665+0000 7ffa0fe75700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0811f920 con 0x7ffa081338a0 2023-10-03T10:18:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.665+0000 7ffa0fe75700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa08120550 con 0x7ffa0809e760 2023-10-03T10:18:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.665+0000 7ffa0dc11700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0809de50 0x7ffa0811d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ffa0dc11700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0809de50 0x7ffa0811d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57674/0 (socket says 172.21.15.72:57674) 2023-10-03T10:18:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ffa0dc11700 1 -- 172.21.15.72:0/1101345807 learned_addr learned my addr 172.21.15.72:0/1101345807 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ffa0e412700 1 --2- 172.21.15.72:0/1101345807 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa081338a0 0x7ffa0811e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ffa0d410700 1 --2- 172.21.15.72:0/1101345807 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa0809e760 0x7ffa0811dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ffa0dc11700 1 -- 172.21.15.72:0/1101345807 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa0809e760 msgr2=0x7ffa0811dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ffa0dc11700 1 --2- 172.21.15.72:0/1101345807 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa0809e760 0x7ffa0811dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ffa0dc11700 1 -- 172.21.15.72:0/1101345807 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa081338a0 msgr2=0x7ffa0811e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ffa0dc11700 1 --2- 172.21.15.72:0/1101345807 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa081338a0 0x7ffa0811e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ffa0dc11700 1 -- 172.21.15.72:0/1101345807 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa04009550 con 0x7ffa0809de50 2023-10-03T10:18:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ffa0d410700 1 --2- 172.21.15.72:0/1101345807 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa0809e760 0x7ffa0811dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ffa0dc11700 1 --2- 172.21.15.72:0/1101345807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0809de50 0x7ffa0811d6f0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7ffa081335f0 tx=0x7ffa04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ff9fe7fc700 1 -- 172.21.15.72:0/1101345807 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa040036a0 con 0x7ffa0809de50 2023-10-03T10:18:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ff9fe7fc700 1 -- 172.21.15.72:0/1101345807 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04003800 con 0x7ffa0809de50 2023-10-03T10:18:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ffa0fe75700 1 -- 172.21.15.72:0/1101345807 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa08120f30 con 0x7ffa0809de50 2023-10-03T10:18:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ff9fe7fc700 1 -- 172.21.15.72:0/1101345807 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04003bb0 con 0x7ffa0809de50 2023-10-03T10:18:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.666+0000 7ffa0fe75700 1 -- 172.21.15.72:0/1101345807 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0806f640 con 0x7ffa0809de50 2023-10-03T10:18:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.667+0000 7ff9fe7fc700 1 -- 172.21.15.72:0/1101345807 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa04003d10 con 0x7ffa0809de50 2023-10-03T10:18:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.667+0000 7ffa0fe75700 1 -- 172.21.15.72:0/1101345807 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0811a470 con 0x7ffa0809de50 2023-10-03T10:18:09.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.668+0000 7ff9fe7fc700 1 -- 172.21.15.72:0/1101345807 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffa04021030 con 0x7ffa0809de50 2023-10-03T10:18:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.672+0000 7ff9fe7fc700 1 -- 172.21.15.72:0/1101345807 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa04010380 con 0x7ffa0809de50 2023-10-03T10:18:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.699+0000 7fbfb8281700 1 Processor -- start 2023-10-03T10:18:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.699+0000 7fbfb8281700 1 -- start start 2023-10-03T10:18:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.700+0000 7fbfb8281700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb0130670 0x7fbfb0130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.700+0000 7fbfb8281700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb00701a0 0x7fbfb0138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.700+0000 7fbfb8281700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb0130260 con 0x7fbfb006f680 2023-10-03T10:18:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.700+0000 7fbfb8281700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb009a350 con 0x7fbfb00701a0 2023-10-03T10:18:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.700+0000 7fbfb8281700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0071ff0 con 0x7fbfb0130670 2023-10-03T10:18:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.700+0000 7fbfb581c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbfb006f680 0x7fbfb006fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42236/0 (socket says 172.21.15.72:42236) 2023-10-03T10:18:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.700+0000 7fbfb581c700 1 -- 172.21.15.72:0/1250042619 learned_addr learned my addr 172.21.15.72:0/1250042619 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.700+0000 7fbfb601d700 1 --2- 172.21.15.72:0/1250042619 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb0130670 0x7fbfb0130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.700+0000 7fbfb681e700 1 --2- 172.21.15.72:0/1250042619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb00701a0 0x7fbfb0138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.700+0000 7fbfb501b700 1 -- 172.21.15.72:0/1250042619 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186811554 0 0) 0x7fbfb0130260 con 0x7fbfb006f680 2023-10-03T10:18:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.700+0000 7fbfb501b700 1 -- 172.21.15.72:0/1250042619 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf9c0035b0 con 0x7fbfb006f680 2023-10-03T10:18:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.701+0000 7fbfb681e700 1 -- 172.21.15.72:0/1250042619 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb0130670 msgr2=0x7fbfb0130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.701+0000 7fbfb681e700 1 --2- 172.21.15.72:0/1250042619 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb0130670 0x7fbfb0130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.701+0000 7fbfb681e700 1 -- 172.21.15.72:0/1250042619 >> v1:172.21.15.72:6789/0 conn(0x7fbfb006f680 legacy=0x7fbfb006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.701+0000 7fbfb681e700 1 -- 172.21.15.72:0/1250042619 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb009ecf0 con 0x7fbfb00701a0 2023-10-03T10:18:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.701+0000 7fbfb601d700 1 --2- 172.21.15.72:0/1250042619 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb0130670 0x7fbfb0130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.701+0000 7fbfb681e700 1 --2- 172.21.15.72:0/1250042619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb00701a0 0x7fbfb0138540 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009dc0 tx=0x7fbfa800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2eeaeb17c66ac40 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.701+0000 7fbfb501b700 1 -- 172.21.15.72:0/1250042619 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa800e070 con 0x7fbfb00701a0 2023-10-03T10:18:09.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.701+0000 7fbfb501b700 1 -- 172.21.15.72:0/1250042619 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa800bb20 con 0x7fbfb00701a0 2023-10-03T10:18:09.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.701+0000 7fbfb501b700 1 -- 172.21.15.72:0/1250042619 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa800be90 con 0x7fbfb00701a0 2023-10-03T10:18:09.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.702+0000 7fbfb8281700 1 -- 172.21.15.72:0/1250042619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb00701a0 msgr2=0x7fbfb0138540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.702+0000 7fbfb8281700 1 --2- 172.21.15.72:0/1250042619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb00701a0 0x7fbfb0138540 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009dc0 tx=0x7fbfa800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:09.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.702+0000 7fbfb8281700 1 -- 172.21.15.72:0/1250042619 shutdown_connections 2023-10-03T10:18:09.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.702+0000 7fbfb8281700 1 --2- 172.21.15.72:0/1250042619 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb00701a0 0x7fbfb0138540 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.702+0000 7fbfb8281700 1 --2- 172.21.15.72:0/1250042619 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb0130670 0x7fbfb0130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.702+0000 7fbfb8281700 1 -- 172.21.15.72:0/1250042619 >> 172.21.15.72:0/1250042619 conn(0x7fbfb00a2aa0 msgr2=0x7fbfb00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.702+0000 7fbfb8281700 1 -- 172.21.15.72:0/1250042619 shutdown_connections 2023-10-03T10:18:09.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.702+0000 7fbfb8281700 1 -- 172.21.15.72:0/1250042619 wait complete. 2023-10-03T10:18:09.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.703+0000 7fbfb8281700 1 Processor -- start 2023-10-03T10:18:09.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.703+0000 7fbfb8281700 1 -- start start 2023-10-03T10:18:09.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.704+0000 7fbfb8281700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb006f680 0x7fbfb01c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.704+0000 7fbfb8281700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb00701a0 0x7fbfb01c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.704+0000 7fbfb8281700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb0130670 0x7fbfb01c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.704+0000 7fbfb8281700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0128970 con 0x7fbfb00701a0 2023-10-03T10:18:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.704+0000 7fbfb8281700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0071820 con 0x7fbfb0130670 2023-10-03T10:18:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.704+0000 7fbfb8281700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb012a8b0 con 0x7fbfb006f680 2023-10-03T10:18:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.704+0000 7fbfb681e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb0130670 0x7fbfb01c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.704+0000 7fbfb681e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb0130670 0x7fbfb01c4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55442/0 (socket says 172.21.15.72:55442) 2023-10-03T10:18:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.704+0000 7fbfb681e700 1 -- 172.21.15.72:0/3444524001 learned_addr learned my addr 172.21.15.72:0/3444524001 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.704+0000 7fbfb581c700 1 --2- 172.21.15.72:0/3444524001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb00701a0 0x7fbfb01c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.704+0000 7fbfb601d700 1 --2- 172.21.15.72:0/3444524001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb006f680 0x7fbfb01c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.704+0000 7fbfb681e700 1 -- 172.21.15.72:0/3444524001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb006f680 msgr2=0x7fbfb01c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.704+0000 7fbfb681e700 1 --2- 172.21.15.72:0/3444524001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb006f680 0x7fbfb01c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.705+0000 7fbfb681e700 1 -- 172.21.15.72:0/3444524001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb00701a0 msgr2=0x7fbfb01c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.705+0000 7fbfb681e700 1 --2- 172.21.15.72:0/3444524001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb00701a0 0x7fbfb01c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.705+0000 7fbfb681e700 1 -- 172.21.15.72:0/3444524001 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac0094a0 con 0x7fbfb0130670 2023-10-03T10:18:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.705+0000 7fbfb581c700 1 --2- 172.21.15.72:0/3444524001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb00701a0 0x7fbfb01c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.705+0000 7fbfb681e700 1 --2- 172.21.15.72:0/3444524001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb0130670 0x7fbfb01c4dc0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800b370 tx=0x7fbfa8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.705+0000 7fbfa6ffd700 1 -- 172.21.15.72:0/3444524001 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80048b0 con 0x7fbfb0130670 2023-10-03T10:18:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.705+0000 7fbfa6ffd700 1 -- 172.21.15.72:0/3444524001 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa8020070 con 0x7fbfb0130670 2023-10-03T10:18:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.705+0000 7fbfa6ffd700 1 -- 172.21.15.72:0/3444524001 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80276c0 con 0x7fbfb0130670 2023-10-03T10:18:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.705+0000 7fbfb8281700 1 -- 172.21.15.72:0/3444524001 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa8009a70 con 0x7fbfb0130670 2023-10-03T10:18:09.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.705+0000 7fbfb8281700 1 -- 172.21.15.72:0/3444524001 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb012ab70 con 0x7fbfb0130670 2023-10-03T10:18:09.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.706+0000 7fbfa6ffd700 1 -- 172.21.15.72:0/3444524001 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbfa8012430 con 0x7fbfb0130670 2023-10-03T10:18:09.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.706+0000 7fbfa6ffd700 1 -- 172.21.15.72:0/3444524001 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbfa8022070 con 0x7fbfb0130670 2023-10-03T10:18:09.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.706+0000 7fbfb8281700 1 -- 172.21.15.72:0/3444524001 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb0074ea0 con 0x7fbfb0130670 2023-10-03T10:18:09.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.715+0000 7fbfa6ffd700 1 -- 172.21.15.72:0/3444524001 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfa8003e10 con 0x7fbfb0130670 2023-10-03T10:18:09.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.738+0000 7f00e1749700 1 Processor -- start 2023-10-03T10:18:09.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.738+0000 7f00e1749700 1 -- start start 2023-10-03T10:18:09.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.739+0000 7f00e1749700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00dc09d6f0 0x7f00dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.739+0000 7f00e1749700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00dc09e000 0x7f00dc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.739+0000 7f00e1749700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00dc09b120 con 0x7f00dc09e410 2023-10-03T10:18:09.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.739+0000 7f00e1749700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc06b460 con 0x7f00dc09d6f0 2023-10-03T10:18:09.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.739+0000 7f00e1749700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc09a7e0 con 0x7f00dc09e000 2023-10-03T10:18:09.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.739+0000 7f00db7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f00dc09e410 0x7f00dc133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42240/0 (socket says 172.21.15.72:42240) 2023-10-03T10:18:09.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.739+0000 7f00da7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00dc09e000 0x7f00dc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.739+0000 7f00db7fe700 1 -- 172.21.15.72:0/3127634724 learned_addr learned my addr 172.21.15.72:0/3127634724 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:09.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.739+0000 7f00daffd700 1 --2- 172.21.15.72:0/3127634724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00dc09d6f0 0x7f00dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.740+0000 7f00da7fc700 1 -- 172.21.15.72:0/3127634724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00dc09d6f0 msgr2=0x7f00dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.740+0000 7f00d9ffb700 1 -- 172.21.15.72:0/3127634724 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683416385 0 0) 0x7f00dc09b120 con 0x7f00dc09e410 2023-10-03T10:18:09.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.740+0000 7f00da7fc700 1 --2- 172.21.15.72:0/3127634724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00dc09d6f0 0x7f00dc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.740+0000 7f00da7fc700 1 -- 172.21.15.72:0/3127634724 >> v1:172.21.15.72:6789/0 conn(0x7f00dc09e410 legacy=0x7f00dc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.740+0000 7f00da7fc700 1 -- 172.21.15.72:0/3127634724 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc09a500 con 0x7f00dc09e000 2023-10-03T10:18:09.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.740+0000 7f00da7fc700 1 --2- 172.21.15.72:0/3127634724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00dc09e000 0x7f00dc1339f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f00d00098a0 tx=0x7f00d0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9998fbbfaf43009 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.740+0000 7f00d9ffb700 1 -- 172.21.15.72:0/3127634724 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0011830 con 0x7f00dc09e000 2023-10-03T10:18:09.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.740+0000 7f00d9ffb700 1 -- 172.21.15.72:0/3127634724 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d0011990 con 0x7f00dc09e000 2023-10-03T10:18:09.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.740+0000 7f00d9ffb700 1 -- 172.21.15.72:0/3127634724 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0011d20 con 0x7f00dc09e000 2023-10-03T10:18:09.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.741+0000 7f00e1749700 1 -- 172.21.15.72:0/3127634724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00dc09e000 msgr2=0x7f00dc1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.741+0000 7f00e1749700 1 --2- 172.21.15.72:0/3127634724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00dc09e000 0x7f00dc1339f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f00d00098a0 tx=0x7f00d0009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.741+0000 7f00e1749700 1 -- 172.21.15.72:0/3127634724 shutdown_connections 2023-10-03T10:18:09.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.741+0000 7f00e1749700 1 --2- 172.21.15.72:0/3127634724 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00dc09d6f0 0x7f00dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.741+0000 7f00e1749700 1 --2- 172.21.15.72:0/3127634724 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00dc09e000 0x7f00dc1339f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.741+0000 7f00e1749700 1 -- 172.21.15.72:0/3127634724 >> 172.21.15.72:0/3127634724 conn(0x7f00dc066f50 msgr2=0x7f00dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.741+0000 7f00e1749700 1 -- 172.21.15.72:0/3127634724 shutdown_connections 2023-10-03T10:18:09.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.741+0000 7f00e1749700 1 -- 172.21.15.72:0/3127634724 wait complete. 2023-10-03T10:18:09.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.742+0000 7f00e1749700 1 Processor -- start 2023-10-03T10:18:09.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.742+0000 7f00e1749700 1 -- start start 2023-10-03T10:18:09.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00e1749700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00dc09d6f0 0x7f00dc1c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00e1749700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00dc09e000 0x7f00dc1c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00e1749700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00dc09e410 0x7f00dc1c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00e1749700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc1a83a0 con 0x7f00dc09e000 2023-10-03T10:18:09.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00e1749700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc1a6690 con 0x7f00dc09e410 2023-10-03T10:18:09.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00e1749700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc0a2e20 con 0x7f00dc09d6f0 2023-10-03T10:18:09.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00daffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00dc09d6f0 0x7f00dc1c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00daffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00dc09d6f0 0x7f00dc1c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48018/0 (socket says 172.21.15.72:48018) 2023-10-03T10:18:09.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00daffd700 1 -- 172.21.15.72:0/2884605113 learned_addr learned my addr 172.21.15.72:0/2884605113 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:09.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00db7fe700 1 --2- 172.21.15.72:0/2884605113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00dc09e410 0x7f00dc1c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00da7fc700 1 --2- 172.21.15.72:0/2884605113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00dc09e000 0x7f00dc1c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00daffd700 1 -- 172.21.15.72:0/2884605113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00dc09e410 msgr2=0x7f00dc1c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00daffd700 1 --2- 172.21.15.72:0/2884605113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00dc09e410 0x7f00dc1c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00daffd700 1 -- 172.21.15.72:0/2884605113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00dc09e000 msgr2=0x7f00dc1c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00daffd700 1 --2- 172.21.15.72:0/2884605113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00dc09e000 0x7f00dc1c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.743+0000 7f00daffd700 1 -- 172.21.15.72:0/2884605113 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d00094a0 con 0x7f00dc09d6f0 2023-10-03T10:18:09.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.744+0000 7f00daffd700 1 --2- 172.21.15.72:0/2884605113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00dc09d6f0 0x7f00dc1c82c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00e9b0 tx=0x7f00cc00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.744+0000 7f00c37fe700 1 -- 172.21.15.72:0/2884605113 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc009710 con 0x7f00dc09d6f0 2023-10-03T10:18:09.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.744+0000 7f00c37fe700 1 -- 172.21.15.72:0/2884605113 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc00ee50 con 0x7f00dc09d6f0 2023-10-03T10:18:09.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.744+0000 7f00e1749700 1 -- 172.21.15.72:0/2884605113 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00dc09c710 con 0x7f00dc09d6f0 2023-10-03T10:18:09.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.744+0000 7f00c37fe700 1 -- 172.21.15.72:0/2884605113 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00ca50 con 0x7f00dc09d6f0 2023-10-03T10:18:09.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.744+0000 7f00e1749700 1 -- 172.21.15.72:0/2884605113 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc1a8d30 con 0x7f00dc09d6f0 2023-10-03T10:18:09.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.745+0000 7f00c37fe700 1 -- 172.21.15.72:0/2884605113 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00cc00cbb0 con 0x7f00dc09d6f0 2023-10-03T10:18:09.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.745+0000 7f00e1749700 1 -- 172.21.15.72:0/2884605113 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00dc074ea0 con 0x7f00dc09d6f0 2023-10-03T10:18:09.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.745+0000 7f00c37fe700 1 -- 172.21.15.72:0/2884605113 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f00cc013990 con 0x7f00dc09d6f0 2023-10-03T10:18:09.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.748+0000 7ff27f3b5700 1 Processor -- start 2023-10-03T10:18:09.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.748+0000 7ff27f3b5700 1 -- start start 2023-10-03T10:18:09.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.748+0000 7ff27f3b5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff27809d6f0 0x7ff27809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.748+0000 7ff27f3b5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27809e000 0x7ff278130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.748+0000 7ff27f3b5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27809f130 con 0x7ff27809e410 2023-10-03T10:18:09.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.748+0000 7ff27f3b5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27809f520 con 0x7ff27809d6f0 2023-10-03T10:18:09.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.748+0000 7ff27f3b5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff27809e930 con 0x7ff27809e000 2023-10-03T10:18:09.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.749+0000 7ff27d952700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff27809e410 0x7ff278130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42256/0 (socket says 172.21.15.72:42256) 2023-10-03T10:18:09.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.749+0000 7ff27c950700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27809e000 0x7ff278130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.749+0000 7ff27d952700 1 -- 172.21.15.72:0/2329530880 learned_addr learned my addr 172.21.15.72:0/2329530880 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:09.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.749+0000 7ff26ffff700 1 -- 172.21.15.72:0/2329530880 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461465274 0 0) 0x7ff27809f130 con 0x7ff27809e410 2023-10-03T10:18:09.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.749+0000 7ff26ffff700 1 -- 172.21.15.72:0/2329530880 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2640035b0 con 0x7ff27809e410 2023-10-03T10:18:09.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.749+0000 7ff27c950700 1 -- 172.21.15.72:0/2329530880 >> v2:172.21.15.72:3300/0 conn(0x7ff27809d6f0 msgr2=0x7ff27809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.749+0000 7ff27c950700 1 --2- 172.21.15.72:0/2329530880 >> v2:172.21.15.72:3300/0 conn(0x7ff27809d6f0 0x7ff27809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.749+0000 7ff27c950700 1 -- 172.21.15.72:0/2329530880 >> v1:172.21.15.72:6789/0 conn(0x7ff27809e410 legacy=0x7ff278130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.749+0000 7ff27c950700 1 -- 172.21.15.72:0/2329530880 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27809b2d0 con 0x7ff27809e000 2023-10-03T10:18:09.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.749+0000 7ff27c950700 1 --2- 172.21.15.72:0/2329530880 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27809e000 0x7ff278130660 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff268009840 tx=0x7ff268009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a613ca7522551c5d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.751+0000 7ff26ffff700 1 -- 172.21.15.72:0/2329530880 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268004230 con 0x7ff27809e000 2023-10-03T10:18:09.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.751+0000 7ff26ffff700 1 -- 172.21.15.72:0/2329530880 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff268004390 con 0x7ff27809e000 2023-10-03T10:18:09.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.751+0000 7ff26ffff700 1 -- 172.21.15.72:0/2329530880 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2680036a0 con 0x7ff27809e000 2023-10-03T10:18:09.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.751+0000 7f00c37fe700 1 -- 172.21.15.72:0/2884605113 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00cc03fe60 con 0x7f00dc09d6f0 2023-10-03T10:18:09.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.752+0000 7ff27f3b5700 1 -- 172.21.15.72:0/2329530880 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27809e000 msgr2=0x7ff278130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.752+0000 7ff27f3b5700 1 --2- 172.21.15.72:0/2329530880 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27809e000 0x7ff278130660 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff268009840 tx=0x7ff268009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:09.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.752+0000 7ff27f3b5700 1 -- 172.21.15.72:0/2329530880 shutdown_connections 2023-10-03T10:18:09.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.752+0000 7ff27f3b5700 1 --2- 172.21.15.72:0/2329530880 >> v2:172.21.15.72:3300/0 conn(0x7ff27809d6f0 0x7ff27809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.752+0000 7ff27f3b5700 1 --2- 172.21.15.72:0/2329530880 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27809e000 0x7ff278130660 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.752+0000 7ff27f3b5700 1 -- 172.21.15.72:0/2329530880 >> 172.21.15.72:0/2329530880 conn(0x7ff278066f50 msgr2=0x7ff27809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.752+0000 7ff27f3b5700 1 -- 172.21.15.72:0/2329530880 shutdown_connections 2023-10-03T10:18:09.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.752+0000 7ff27f3b5700 1 -- 172.21.15.72:0/2329530880 wait complete. 2023-10-03T10:18:09.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.753+0000 7ff27f3b5700 1 Processor -- start 2023-10-03T10:18:09.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.753+0000 7ff27f3b5700 1 -- start start 2023-10-03T10:18:09.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27f3b5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27809d6f0 0x7ff278130cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27f3b5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27809e000 0x7ff278136820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27f3b5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27809e410 0x7ff278136d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27f3b5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27813b540 con 0x7ff27809e410 2023-10-03T10:18:09.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27f3b5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff278139da0 con 0x7ff27809d6f0 2023-10-03T10:18:09.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27f3b5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780721a0 con 0x7ff27809e000 2023-10-03T10:18:09.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27d952700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27809e410 0x7ff278136d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27d151700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27809d6f0 0x7ff278130cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27c950700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27809e000 0x7ff278136820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27d151700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27809d6f0 0x7ff278130cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55478/0 (socket says 172.21.15.72:55478) 2023-10-03T10:18:09.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27d952700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27809e410 0x7ff278136d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57710/0 (socket says 172.21.15.72:57710) 2023-10-03T10:18:09.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27d151700 1 -- 172.21.15.72:0/1791045914 learned_addr learned my addr 172.21.15.72:0/1791045914 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:09.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27c950700 1 -- 172.21.15.72:0/1791045914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27809d6f0 msgr2=0x7ff278130cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27c950700 1 --2- 172.21.15.72:0/1791045914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27809d6f0 0x7ff278130cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27c950700 1 -- 172.21.15.72:0/1791045914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27809e410 msgr2=0x7ff278136d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27c950700 1 --2- 172.21.15.72:0/1791045914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27809e410 0x7ff278136d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27c950700 1 -- 172.21.15.72:0/1791045914 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2680094a0 con 0x7ff27809e000 2023-10-03T10:18:09.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.754+0000 7ff27d151700 1 --2- 172.21.15.72:0/1791045914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27809d6f0 0x7ff278130cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.755+0000 7ff27c950700 1 --2- 172.21.15.72:0/1791045914 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27809e000 0x7ff278136820 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff268013000 tx=0x7ff268004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.755+0000 7ff26dffb700 1 -- 172.21.15.72:0/1791045914 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268003c70 con 0x7ff27809e000 2023-10-03T10:18:09.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.755+0000 7ff26dffb700 1 -- 172.21.15.72:0/1791045914 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff268003df0 con 0x7ff27809e000 2023-10-03T10:18:09.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.755+0000 7ff26dffb700 1 -- 172.21.15.72:0/1791045914 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268011870 con 0x7ff27809e000 2023-10-03T10:18:09.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.755+0000 7ff27f3b5700 1 -- 172.21.15.72:0/1791045914 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff278138c50 con 0x7ff27809e000 2023-10-03T10:18:09.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.755+0000 7ff27f3b5700 1 -- 172.21.15.72:0/1791045914 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27813a340 con 0x7ff27809e000 2023-10-03T10:18:09.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.756+0000 7ff27f3b5700 1 -- 172.21.15.72:0/1791045914 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff278131290 con 0x7ff27809e000 2023-10-03T10:18:09.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.756+0000 7ff26dffb700 1 -- 172.21.15.72:0/1791045914 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff268018040 con 0x7ff27809e000 2023-10-03T10:18:09.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.757+0000 7ff26dffb700 1 -- 172.21.15.72:0/1791045914 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff268040230 con 0x7ff27809e000 2023-10-03T10:18:09.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.765+0000 7ff26dffb700 1 -- 172.21.15.72:0/1791045914 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff278131290 con 0x7ff27809e000 2023-10-03T10:18:09.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.923+0000 7ffa0fe75700 1 -- 172.21.15.72:0/1101345807 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffa08074ea0 con 0x7ffa0809de50 2023-10-03T10:18:09.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.923+0000 7ff9fe7fc700 1 -- 172.21.15.72:0/1101345807 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffa04015070 con 0x7ffa0809de50 2023-10-03T10:18:09.924 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:09.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.927+0000 7ffa0fe75700 1 -- 172.21.15.72:0/1101345807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0809de50 msgr2=0x7ffa0811d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.927+0000 7ffa0fe75700 1 --2- 172.21.15.72:0/1101345807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0809de50 0x7ffa0811d6f0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7ffa081335f0 tx=0x7ffa04004750 comp rx=0 tx=0).stop 2023-10-03T10:18:09.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.927+0000 7ffa0fe75700 1 -- 172.21.15.72:0/1101345807 shutdown_connections 2023-10-03T10:18:09.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.927+0000 7ffa0fe75700 1 --2- 172.21.15.72:0/1101345807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa0809de50 0x7ffa0811d6f0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.927+0000 7ffa0fe75700 1 --2- 172.21.15.72:0/1101345807 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa081338a0 0x7ffa0811e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.927+0000 7ffa0fe75700 1 --2- 172.21.15.72:0/1101345807 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa0809e760 0x7ffa0811dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.927+0000 7ffa0fe75700 1 -- 172.21.15.72:0/1101345807 >> 172.21.15.72:0/1101345807 conn(0x7ffa080a2aa0 msgr2=0x7ffa081bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.927+0000 7fbfb8281700 1 -- 172.21.15.72:0/3444524001 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbfb0072210 con 0x7fbfb0130670 2023-10-03T10:18:09.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.927+0000 7ffa0fe75700 1 -- 172.21.15.72:0/1101345807 shutdown_connections 2023-10-03T10:18:09.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.927+0000 7ffa0fe75700 1 -- 172.21.15.72:0/1101345807 wait complete. 2023-10-03T10:18:09.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.927+0000 7fbfa6ffd700 1 -- 172.21.15.72:0/3444524001 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbfa8011390 con 0x7fbfb0130670 2023-10-03T10:18:09.929 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:09.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.929+0000 7fbfb8281700 1 -- 172.21.15.72:0/3444524001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb0130670 msgr2=0x7fbfb01c4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.929+0000 7fbfb8281700 1 --2- 172.21.15.72:0/3444524001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb0130670 0x7fbfb01c4dc0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800b370 tx=0x7fbfa8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.929+0000 7fbfb8281700 1 -- 172.21.15.72:0/3444524001 shutdown_connections 2023-10-03T10:18:09.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.929+0000 7fbfb8281700 1 --2- 172.21.15.72:0/3444524001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfb0130670 0x7fbfb01c4dc0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.929+0000 7fbfb8281700 1 --2- 172.21.15.72:0/3444524001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbfb006f680 0x7fbfb01c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.929+0000 7fbfb8281700 1 --2- 172.21.15.72:0/3444524001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfb00701a0 0x7fbfb01c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.929+0000 7fbfb8281700 1 -- 172.21.15.72:0/3444524001 >> 172.21.15.72:0/3444524001 conn(0x7fbfb00a2aa0 msgr2=0x7fbfb0124e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.929+0000 7fbfb8281700 1 -- 172.21.15.72:0/3444524001 shutdown_connections 2023-10-03T10:18:09.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.930+0000 7fbfb8281700 1 -- 172.21.15.72:0/3444524001 wait complete. 2023-10-03T10:18:09.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:09.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:09.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.951+0000 7f00e1749700 1 -- 172.21.15.72:0/2884605113 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f00dc072600 con 0x7f00dc09d6f0 2023-10-03T10:18:09.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.951+0000 7f00c37fe700 1 -- 172.21.15.72:0/2884605113 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f00cc017070 con 0x7f00dc09d6f0 2023-10-03T10:18:09.951 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:09.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.953+0000 7f00e1749700 1 -- 172.21.15.72:0/2884605113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00dc09d6f0 msgr2=0x7f00dc1c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.953+0000 7f00e1749700 1 --2- 172.21.15.72:0/2884605113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00dc09d6f0 0x7f00dc1c82c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00e9b0 tx=0x7f00cc00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.953+0000 7f00e1749700 1 -- 172.21.15.72:0/2884605113 shutdown_connections 2023-10-03T10:18:09.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.953+0000 7f00e1749700 1 --2- 172.21.15.72:0/2884605113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00dc09e410 0x7f00dc1c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.953+0000 7f00e1749700 1 --2- 172.21.15.72:0/2884605113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00dc09d6f0 0x7f00dc1c82c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.953+0000 7f00e1749700 1 --2- 172.21.15.72:0/2884605113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00dc09e000 0x7f00dc1c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.953+0000 7f00e1749700 1 -- 172.21.15.72:0/2884605113 >> 172.21.15.72:0/2884605113 conn(0x7f00dc066f50 msgr2=0x7f00dc06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.953+0000 7f00e1749700 1 -- 172.21.15.72:0/2884605113 shutdown_connections 2023-10-03T10:18:09.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:09.953+0000 7f00e1749700 1 -- 172.21.15.72:0/2884605113 wait complete. 2023-10-03T10:18:09.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:10.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:10.005+0000 7ff27f3b5700 1 -- 172.21.15.72:0/1791045914 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff278131290 con 0x7ff27809e000 2023-10-03T10:18:10.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:10.005+0000 7ff26dffb700 1 -- 172.21.15.72:0/1791045914 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff278131290 con 0x7ff27809e000 2023-10-03T10:18:10.006 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:10.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:10.007+0000 7ff27f3b5700 1 -- 172.21.15.72:0/1791045914 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27809e000 msgr2=0x7ff278136820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:10.007+0000 7ff27f3b5700 1 --2- 172.21.15.72:0/1791045914 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27809e000 0x7ff278136820 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff268013000 tx=0x7ff268004750 comp rx=0 tx=0).stop 2023-10-03T10:18:10.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:10.007+0000 7ff27f3b5700 1 -- 172.21.15.72:0/1791045914 shutdown_connections 2023-10-03T10:18:10.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:10.007+0000 7ff27f3b5700 1 --2- 172.21.15.72:0/1791045914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27809e410 0x7ff278136d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:10.007+0000 7ff27f3b5700 1 --2- 172.21.15.72:0/1791045914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27809d6f0 0x7ff278130cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:10.007+0000 7ff27f3b5700 1 --2- 172.21.15.72:0/1791045914 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff27809e000 0x7ff278136820 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:10.007+0000 7ff27f3b5700 1 -- 172.21.15.72:0/1791045914 >> 172.21.15.72:0/1791045914 conn(0x7ff278066f50 msgr2=0x7ff2780a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:10.007+0000 7ff27f3b5700 1 -- 172.21.15.72:0/1791045914 shutdown_connections 2023-10-03T10:18:10.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:10.007+0000 7ff27f3b5700 1 -- 172.21.15.72:0/1791045914 wait complete. 2023-10-03T10:18:10.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:10.942 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:10.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:10.966 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:11.021 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:11.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.083+0000 7f6a8d170700 1 Processor -- start 2023-10-03T10:18:11.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.083+0000 7f6a8d170700 1 -- start start 2023-10-03T10:18:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a8d170700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a8806e570 0x7f6a8806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a8d170700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a8809eca0 0x7f6a8806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a8d170700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a88134610 0x7f6a88134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a8d170700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a88070ee0 con 0x7f6a8809eca0 2023-10-03T10:18:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a8d170700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a88071480 con 0x7f6a88134610 2023-10-03T10:18:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a8d170700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8806f3c0 con 0x7f6a8806e570 2023-10-03T10:18:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a8759e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a88134610 0x7f6a88134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a8759e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a88134610 0x7f6a88134a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55482/0 (socket says 172.21.15.72:55482) 2023-10-03T10:18:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a8759e700 1 -- 172.21.15.72:0/3008879131 learned_addr learned my addr 172.21.15.72:0/3008879131 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a8659c700 1 --2- 172.21.15.72:0/3008879131 >> v2:172.21.15.72:3300/0 conn(0x7f6a8809eca0 0x7f6a8806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a8759e700 1 -- 172.21.15.72:0/3008879131 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a8806e570 msgr2=0x7f6a8806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a86d9d700 1 --2- 172.21.15.72:0/3008879131 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a8806e570 0x7f6a8806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a8759e700 1 --2- 172.21.15.72:0/3008879131 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a8806e570 0x7f6a8806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a8759e700 1 -- 172.21.15.72:0/3008879131 >> v2:172.21.15.72:3300/0 conn(0x7f6a8809eca0 msgr2=0x7f6a8806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a8759e700 1 --2- 172.21.15.72:0/3008879131 >> v2:172.21.15.72:3300/0 conn(0x7f6a8809eca0 0x7f6a8806ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.084+0000 7f6a8759e700 1 -- 172.21.15.72:0/3008879131 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a88071b90 con 0x7f6a88134610 2023-10-03T10:18:11.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.085+0000 7f6a86d9d700 1 --2- 172.21.15.72:0/3008879131 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a8806e570 0x7f6a8806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:11.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.085+0000 7f6a8759e700 1 --2- 172.21.15.72:0/3008879131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a88134610 0x7f6a88134a40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009e50 tx=0x7f6a8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cedeeee4e0b3a1e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.085+0000 7f6a85d9b700 1 -- 172.21.15.72:0/3008879131 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000e070 con 0x7f6a88134610 2023-10-03T10:18:11.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.085+0000 7f6a85d9b700 1 -- 172.21.15.72:0/3008879131 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8000b910 con 0x7f6a88134610 2023-10-03T10:18:11.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.085+0000 7f6a85d9b700 1 -- 172.21.15.72:0/3008879131 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000bcc0 con 0x7f6a88134610 2023-10-03T10:18:11.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.086+0000 7f6a8d170700 1 -- 172.21.15.72:0/3008879131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a88134610 msgr2=0x7f6a88134a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.086+0000 7f6a8d170700 1 --2- 172.21.15.72:0/3008879131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a88134610 0x7f6a88134a40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009e50 tx=0x7f6a8000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:11.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.086+0000 7f6a8d170700 1 -- 172.21.15.72:0/3008879131 shutdown_connections 2023-10-03T10:18:11.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.086+0000 7f6a8d170700 1 --2- 172.21.15.72:0/3008879131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a88134610 0x7f6a88134a40 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.086+0000 7f6a8d170700 1 --2- 172.21.15.72:0/3008879131 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a8806e570 0x7f6a8806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.086+0000 7f6a8d170700 1 --2- 172.21.15.72:0/3008879131 >> v2:172.21.15.72:3300/0 conn(0x7f6a8809eca0 0x7f6a8806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.086+0000 7f6a8d170700 1 -- 172.21.15.72:0/3008879131 >> 172.21.15.72:0/3008879131 conn(0x7f6a880a2aa0 msgr2=0x7f6a880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.086+0000 7f6a8d170700 1 -- 172.21.15.72:0/3008879131 shutdown_connections 2023-10-03T10:18:11.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.086+0000 7f6a8d170700 1 -- 172.21.15.72:0/3008879131 wait complete. 2023-10-03T10:18:11.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.087+0000 7f6a8d170700 1 Processor -- start 2023-10-03T10:18:11.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.087+0000 7f6a8d170700 1 -- start start 2023-10-03T10:18:11.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.087+0000 7f6a8d170700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a8806e570 0x7f6a881d4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.087+0000 7f6a8d170700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a88134610 0x7f6a881d5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.087+0000 7f6a8d170700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a881d56c0 0x7f6a88126db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.087+0000 7f6a8d170700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8813b2a0 con 0x7f6a8806e570 2023-10-03T10:18:11.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.087+0000 7f6a8d170700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a880a1f70 con 0x7f6a88134610 2023-10-03T10:18:11.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.087+0000 7f6a8d170700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8813e460 con 0x7f6a881d56c0 2023-10-03T10:18:11.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.088+0000 7f6a86d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a8806e570 0x7f6a881d4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.088+0000 7f6a86d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a8806e570 0x7f6a881d4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57722/0 (socket says 172.21.15.72:57722) 2023-10-03T10:18:11.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.088+0000 7f6a86d9d700 1 -- 172.21.15.72:0/2715415636 learned_addr learned my addr 172.21.15.72:0/2715415636 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:11.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.088+0000 7f6a8659c700 1 --2- 172.21.15.72:0/2715415636 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a88134610 0x7f6a881d5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.088+0000 7f6a8759e700 1 --2- 172.21.15.72:0/2715415636 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a881d56c0 0x7f6a88126db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.088+0000 7f6a86d9d700 1 -- 172.21.15.72:0/2715415636 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a881d56c0 msgr2=0x7f6a88126db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.088+0000 7f6a86d9d700 1 --2- 172.21.15.72:0/2715415636 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a881d56c0 0x7f6a88126db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.088+0000 7f6a86d9d700 1 -- 172.21.15.72:0/2715415636 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a88134610 msgr2=0x7f6a881d5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.088+0000 7f6a86d9d700 1 --2- 172.21.15.72:0/2715415636 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a88134610 0x7f6a881d5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.088+0000 7f6a86d9d700 1 -- 172.21.15.72:0/2715415636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a80009b30 con 0x7f6a8806e570 2023-10-03T10:18:11.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.088+0000 7f6a8759e700 1 --2- 172.21.15.72:0/2715415636 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a881d56c0 0x7f6a88126db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.088+0000 7f6a8659c700 1 --2- 172.21.15.72:0/2715415636 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a88134610 0x7f6a881d5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.088+0000 7f6a86d9d700 1 --2- 172.21.15.72:0/2715415636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a8806e570 0x7f6a881d4c40 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800c750 tx=0x7f6a7800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.088+0000 7f6a6f7fe700 1 -- 172.21.15.72:0/2715415636 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a78011800 con 0x7f6a8806e570 2023-10-03T10:18:11.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.089+0000 7f6a8d170700 1 -- 172.21.15.72:0/2715415636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8813d5a0 con 0x7f6a8806e570 2023-10-03T10:18:11.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.089+0000 7f6a6f7fe700 1 -- 172.21.15.72:0/2715415636 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a78011960 con 0x7f6a8806e570 2023-10-03T10:18:11.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.089+0000 7f6a6f7fe700 1 -- 172.21.15.72:0/2715415636 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a78011cd0 con 0x7f6a8806e570 2023-10-03T10:18:11.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.089+0000 7f6a8d170700 1 -- 172.21.15.72:0/2715415636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8813c160 con 0x7f6a8806e570 2023-10-03T10:18:11.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.090+0000 7f6a8d170700 1 -- 172.21.15.72:0/2715415636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8813b9d0 con 0x7f6a8806e570 2023-10-03T10:18:11.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.090+0000 7f6a6f7fe700 1 -- 172.21.15.72:0/2715415636 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a78021350 con 0x7f6a8806e570 2023-10-03T10:18:11.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.090+0000 7f6a6f7fe700 1 -- 172.21.15.72:0/2715415636 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6a7803f6f0 con 0x7f6a8806e570 2023-10-03T10:18:11.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.094+0000 7f6a6f7fe700 1 -- 172.21.15.72:0/2715415636 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a78011e30 con 0x7f6a8806e570 2023-10-03T10:18:11.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.097+0000 7fb5cb704700 1 Processor -- start 2023-10-03T10:18:11.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.097+0000 7fb5cb704700 1 -- start start 2023-10-03T10:18:11.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.098+0000 7fb5cb704700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5c406e570 0x7fb5c406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.098+0000 7fb5cb704700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5c409eca0 0x7fb5c406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.098+0000 7fb5cb704700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c4070ee0 con 0x7fb5c4134610 2023-10-03T10:18:11.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.098+0000 7fb5cb704700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c4071480 con 0x7fb5c409eca0 2023-10-03T10:18:11.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.098+0000 7fb5cb704700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c406f3c0 con 0x7fb5c406e570 2023-10-03T10:18:11.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.098+0000 7fb5c94a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5c406e570 0x7fb5c406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.098+0000 7fb5c94a0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5c406e570 0x7fb5c406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48058/0 (socket says 172.21.15.72:48058) 2023-10-03T10:18:11.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.098+0000 7fb5c94a0700 1 -- 172.21.15.72:0/2141930923 learned_addr learned my addr 172.21.15.72:0/2141930923 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:11.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.098+0000 7fb5c94a0700 1 -- 172.21.15.72:0/2141930923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5c409eca0 msgr2=0x7fb5c406ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.098+0000 7fb5c94a0700 1 --2- 172.21.15.72:0/2141930923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5c409eca0 0x7fb5c406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.098+0000 7fb5c94a0700 1 -- 172.21.15.72:0/2141930923 >> v1:172.21.15.72:6789/0 conn(0x7fb5c4134610 legacy=0x7fb5c4134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.098+0000 7fb5c94a0700 1 -- 172.21.15.72:0/2141930923 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c4071b90 con 0x7fb5c406e570 2023-10-03T10:18:11.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.099+0000 7fb5c94a0700 1 --2- 172.21.15.72:0/2141930923 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5c406e570 0x7fb5c406e940 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009920 tx=0x7fb5c0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dee5eba6160fc6c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.099+0000 7fb5bbfff700 1 -- 172.21.15.72:0/2141930923 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c000ba60 con 0x7fb5c406e570 2023-10-03T10:18:11.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.099+0000 7fb5bbfff700 1 -- 172.21.15.72:0/2141930923 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c000bbc0 con 0x7fb5c406e570 2023-10-03T10:18:11.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.099+0000 7fb5bbfff700 1 -- 172.21.15.72:0/2141930923 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0009e70 con 0x7fb5c406e570 2023-10-03T10:18:11.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.099+0000 7fb5cb704700 1 -- 172.21.15.72:0/2141930923 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5c406e570 msgr2=0x7fb5c406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.099+0000 7fb5cb704700 1 --2- 172.21.15.72:0/2141930923 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5c406e570 0x7fb5c406e940 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009920 tx=0x7fb5c0009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:11.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.099+0000 7fb5cb704700 1 -- 172.21.15.72:0/2141930923 shutdown_connections 2023-10-03T10:18:11.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.099+0000 7fb5cb704700 1 --2- 172.21.15.72:0/2141930923 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5c406e570 0x7fb5c406e940 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.099+0000 7fb5cb704700 1 --2- 172.21.15.72:0/2141930923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5c409eca0 0x7fb5c406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.099+0000 7fb5cb704700 1 -- 172.21.15.72:0/2141930923 >> 172.21.15.72:0/2141930923 conn(0x7fb5c40a2aa0 msgr2=0x7fb5c40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.100+0000 7fb5cb704700 1 -- 172.21.15.72:0/2141930923 shutdown_connections 2023-10-03T10:18:11.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.100+0000 7fb5cb704700 1 -- 172.21.15.72:0/2141930923 wait complete. 2023-10-03T10:18:11.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.100+0000 7fb5cb704700 1 Processor -- start 2023-10-03T10:18:11.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5cb704700 1 -- start start 2023-10-03T10:18:11.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5cb704700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c406e570 0x7fb5c413f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5cb704700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5c4134610 0x7fb5c413f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5cb704700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5c413fb60 0x7fb5c4132e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5cb704700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c4070610 con 0x7fb5c406e570 2023-10-03T10:18:11.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5cb704700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40a1d90 con 0x7fb5c4134610 2023-10-03T10:18:11.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5cb704700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c413dc90 con 0x7fb5c413fb60 2023-10-03T10:18:11.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5c94a0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c406e570 0x7fb5c413f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5c9ca1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5c413fb60 0x7fb5c4132e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5c94a0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c406e570 0x7fb5c413f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57736/0 (socket says 172.21.15.72:57736) 2023-10-03T10:18:11.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5c94a0700 1 -- 172.21.15.72:0/1367660793 learned_addr learned my addr 172.21.15.72:0/1367660793 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:11.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5c8c9f700 1 --2- 172.21.15.72:0/1367660793 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5c4134610 0x7fb5c413f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5c9ca1700 1 -- 172.21.15.72:0/1367660793 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5c4134610 msgr2=0x7fb5c413f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5c9ca1700 1 --2- 172.21.15.72:0/1367660793 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5c4134610 0x7fb5c413f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5c9ca1700 1 -- 172.21.15.72:0/1367660793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c406e570 msgr2=0x7fb5c413f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5c9ca1700 1 --2- 172.21.15.72:0/1367660793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c406e570 0x7fb5c413f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.101+0000 7fb5c9ca1700 1 -- 172.21.15.72:0/1367660793 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c0009550 con 0x7fb5c413fb60 2023-10-03T10:18:11.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.102+0000 7fb5c9ca1700 1 --2- 172.21.15.72:0/1367660793 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5c413fb60 0x7fb5c4132e70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00cb90 tx=0x7fb5bc00cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.102+0000 7fb5b9ffb700 1 -- 172.21.15.72:0/1367660793 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc003c00 con 0x7fb5c413fb60 2023-10-03T10:18:11.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.102+0000 7fb5b9ffb700 1 -- 172.21.15.72:0/1367660793 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc003d60 con 0x7fb5c413fb60 2023-10-03T10:18:11.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.102+0000 7fb5b9ffb700 1 -- 172.21.15.72:0/1367660793 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc00aaa0 con 0x7fb5c413fb60 2023-10-03T10:18:11.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.102+0000 7fb5cb704700 1 -- 172.21.15.72:0/1367660793 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c413cde0 con 0x7fb5c413fb60 2023-10-03T10:18:11.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.102+0000 7fb5cb704700 1 -- 172.21.15.72:0/1367660793 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c413ffd0 con 0x7fb5c413fb60 2023-10-03T10:18:11.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.103+0000 7fb5b9ffb700 1 -- 172.21.15.72:0/1367660793 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5bc00ac00 con 0x7fb5c413fb60 2023-10-03T10:18:11.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.103+0000 7fb5b9ffb700 1 -- 172.21.15.72:0/1367660793 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb5bc03f620 con 0x7fb5c413fb60 2023-10-03T10:18:11.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.103+0000 7fb5cb704700 1 -- 172.21.15.72:0/1367660793 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c413e330 con 0x7fb5c413fb60 2023-10-03T10:18:11.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.108+0000 7fb5b9ffb700 1 -- 172.21.15.72:0/1367660793 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5bc0198f0 con 0x7fb5c413fb60 2023-10-03T10:18:11.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.125+0000 7fb6857d4700 1 Processor -- start 2023-10-03T10:18:11.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.125+0000 7fb6857d4700 1 -- start start 2023-10-03T10:18:11.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb6857d4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb68009d6f0 0x7fb68009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb6857d4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb68009e000 0x7fb6801339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb6857d4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68009b120 con 0x7fb68009e410 2023-10-03T10:18:11.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb6857d4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68006b460 con 0x7fb68009d6f0 2023-10-03T10:18:11.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb6857d4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68009a7e0 con 0x7fb68009e000 2023-10-03T10:18:11.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb67e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb68009e000 0x7fb6801339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb67effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb68009d6f0 0x7fb68009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb67e7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb68009e000 0x7fb6801339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55540/0 (socket says 172.21.15.72:55540) 2023-10-03T10:18:11.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb67f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb68009e410 0x7fb680133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42266/0 (socket says 172.21.15.72:42266) 2023-10-03T10:18:11.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb67e7fc700 1 -- 172.21.15.72:0/920919869 learned_addr learned my addr 172.21.15.72:0/920919869 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:11.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb67e7fc700 1 -- 172.21.15.72:0/920919869 >> v2:172.21.15.72:3300/0 conn(0x7fb68009d6f0 msgr2=0x7fb68009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb67e7fc700 1 --2- 172.21.15.72:0/920919869 >> v2:172.21.15.72:3300/0 conn(0x7fb68009d6f0 0x7fb68009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb67dffb700 1 -- 172.21.15.72:0/920919869 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485742062 0 0) 0x7fb68009b120 con 0x7fb68009e410 2023-10-03T10:18:11.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb67e7fc700 1 -- 172.21.15.72:0/920919869 >> v1:172.21.15.72:6789/0 conn(0x7fb68009e410 legacy=0x7fb680133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb67e7fc700 1 -- 172.21.15.72:0/920919869 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68009a500 con 0x7fb68009e000 2023-10-03T10:18:11.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb67effd700 1 --2- 172.21.15.72:0/920919869 >> v2:172.21.15.72:3300/0 conn(0x7fb68009d6f0 0x7fb68009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:11.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.126+0000 7fb67e7fc700 1 --2- 172.21.15.72:0/920919869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb68009e000 0x7fb6801339f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb674009920 tx=0x7fb674009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d88f87ff0c183b56 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.127+0000 7fb67dffb700 1 -- 172.21.15.72:0/920919869 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674011830 con 0x7fb68009e000 2023-10-03T10:18:11.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.127+0000 7fb67dffb700 1 -- 172.21.15.72:0/920919869 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb674011990 con 0x7fb68009e000 2023-10-03T10:18:11.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.127+0000 7fb67dffb700 1 -- 172.21.15.72:0/920919869 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674011d20 con 0x7fb68009e000 2023-10-03T10:18:11.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.128+0000 7fb6857d4700 1 -- 172.21.15.72:0/920919869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb68009e000 msgr2=0x7fb6801339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.128+0000 7fb6857d4700 1 --2- 172.21.15.72:0/920919869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb68009e000 0x7fb6801339f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb674009920 tx=0x7fb674009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:11.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.128+0000 7fb6857d4700 1 -- 172.21.15.72:0/920919869 shutdown_connections 2023-10-03T10:18:11.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.128+0000 7fb6857d4700 1 --2- 172.21.15.72:0/920919869 >> v2:172.21.15.72:3300/0 conn(0x7fb68009d6f0 0x7fb68009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.128+0000 7fb6857d4700 1 --2- 172.21.15.72:0/920919869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb68009e000 0x7fb6801339f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.128+0000 7fb6857d4700 1 -- 172.21.15.72:0/920919869 >> 172.21.15.72:0/920919869 conn(0x7fb680066f50 msgr2=0x7fb68009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.128+0000 7fb6857d4700 1 -- 172.21.15.72:0/920919869 shutdown_connections 2023-10-03T10:18:11.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.128+0000 7fb6857d4700 1 -- 172.21.15.72:0/920919869 wait complete. 2023-10-03T10:18:11.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.129+0000 7fb6857d4700 1 Processor -- start 2023-10-03T10:18:11.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.129+0000 7fb6857d4700 1 -- start start 2023-10-03T10:18:11.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb6857d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb68009d6f0 0x7fb6801c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb6857d4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb68009e000 0x7fb6801c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb6857d4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb68009e410 0x7fb6801c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb6857d4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6801a6340 con 0x7fb68009d6f0 2023-10-03T10:18:11.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb6857d4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6800a2da0 con 0x7fb68009e410 2023-10-03T10:18:11.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb6857d4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb68009c710 con 0x7fb68009e000 2023-10-03T10:18:11.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb67f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb68009e410 0x7fb6801c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb67f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb68009e410 0x7fb6801c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55550/0 (socket says 172.21.15.72:55550) 2023-10-03T10:18:11.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb67f7fe700 1 -- 172.21.15.72:0/1665372647 learned_addr learned my addr 172.21.15.72:0/1665372647 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:11.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb67e7fc700 1 --2- 172.21.15.72:0/1665372647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb68009e000 0x7fb6801c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb67effd700 1 --2- 172.21.15.72:0/1665372647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb68009d6f0 0x7fb6801c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb67f7fe700 1 -- 172.21.15.72:0/1665372647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb68009e000 msgr2=0x7fb6801c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb67f7fe700 1 --2- 172.21.15.72:0/1665372647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb68009e000 0x7fb6801c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb67f7fe700 1 -- 172.21.15.72:0/1665372647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb68009d6f0 msgr2=0x7fb6801c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb67f7fe700 1 --2- 172.21.15.72:0/1665372647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb68009d6f0 0x7fb6801c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.130+0000 7fb67f7fe700 1 -- 172.21.15.72:0/1665372647 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6700094a0 con 0x7fb68009e410 2023-10-03T10:18:11.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.131+0000 7fb67f7fe700 1 --2- 172.21.15.72:0/1665372647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb68009e410 0x7fb6801c8aa0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb67800cca0 tx=0x7fb67800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.131+0000 7fb6677fe700 1 -- 172.21.15.72:0/1665372647 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67800ab70 con 0x7fb68009e410 2023-10-03T10:18:11.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.131+0000 7fb6857d4700 1 -- 172.21.15.72:0/1665372647 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb674009550 con 0x7fb68009e410 2023-10-03T10:18:11.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.131+0000 7fb6677fe700 1 -- 172.21.15.72:0/1665372647 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67800acd0 con 0x7fb68009e410 2023-10-03T10:18:11.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.131+0000 7fb6677fe700 1 -- 172.21.15.72:0/1665372647 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb678007310 con 0x7fb68009e410 2023-10-03T10:18:11.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.131+0000 7fb6857d4700 1 -- 172.21.15.72:0/1665372647 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6801a7d00 con 0x7fb68009e410 2023-10-03T10:18:11.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.132+0000 7fb6677fe700 1 -- 172.21.15.72:0/1665372647 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb678007470 con 0x7fb68009e410 2023-10-03T10:18:11.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.132+0000 7fb6857d4700 1 -- 172.21.15.72:0/1665372647 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6801a8380 con 0x7fb68009e410 2023-10-03T10:18:11.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.132+0000 7fb6677fe700 1 -- 172.21.15.72:0/1665372647 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb67803f2e0 con 0x7fb68009e410 2023-10-03T10:18:11.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.142+0000 7fb6677fe700 1 -- 172.21.15.72:0/1665372647 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb67800ae40 con 0x7fb68009e410 2023-10-03T10:18:11.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.180+0000 7fa01f146700 1 Processor -- start 2023-10-03T10:18:11.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.180+0000 7fa01f146700 1 -- start start 2023-10-03T10:18:11.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa01f146700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa0180a0a30 0x7fa0180a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa01f146700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa01809d630 0x7fa0180a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa01f146700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa018133930 0x7fa018133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa01f146700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0180a2a70 con 0x7fa0180a0a30 2023-10-03T10:18:11.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa01f146700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0180a01d0 con 0x7fa01809d630 2023-10-03T10:18:11.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa01f146700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa01809e2b0 con 0x7fa018133930 2023-10-03T10:18:11.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa017fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa01809d630 0x7fa0180a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa017fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa01809d630 0x7fa0180a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55558/0 (socket says 172.21.15.72:55558) 2023-10-03T10:18:11.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa017fff700 1 -- 172.21.15.72:0/1018480047 learned_addr learned my addr 172.21.15.72:0/1018480047 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:11.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa01d6e3700 1 --2- 172.21.15.72:0/1018480047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa018133930 0x7fa018133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa01cee2700 1 --2- 172.21.15.72:0/1018480047 >> v2:172.21.15.72:3300/0 conn(0x7fa0180a0a30 0x7fa0180a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa017fff700 1 -- 172.21.15.72:0/1018480047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa018133930 msgr2=0x7fa018133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa017fff700 1 --2- 172.21.15.72:0/1018480047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa018133930 0x7fa018133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa017fff700 1 -- 172.21.15.72:0/1018480047 >> v2:172.21.15.72:3300/0 conn(0x7fa0180a0a30 msgr2=0x7fa0180a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:11.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa017fff700 1 --2- 172.21.15.72:0/1018480047 >> v2:172.21.15.72:3300/0 conn(0x7fa0180a0a30 0x7fa0180a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.181+0000 7fa017fff700 1 -- 172.21.15.72:0/1018480047 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01809dc50 con 0x7fa01809d630 2023-10-03T10:18:11.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.182+0000 7fa017fff700 1 --2- 172.21.15.72:0/1018480047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa01809d630 0x7fa0180a1340 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa0040098f0 tx=0x7fa004009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=140d3f289329e89 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.182+0000 7fa01cee2700 1 --2- 172.21.15.72:0/1018480047 >> v2:172.21.15.72:3300/0 conn(0x7fa0180a0a30 0x7fa0180a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:11.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.182+0000 7fa0177fe700 1 -- 172.21.15.72:0/1018480047 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004011830 con 0x7fa01809d630 2023-10-03T10:18:11.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.182+0000 7fa0177fe700 1 -- 172.21.15.72:0/1018480047 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa004011990 con 0x7fa01809d630 2023-10-03T10:18:11.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.182+0000 7fa0177fe700 1 -- 172.21.15.72:0/1018480047 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004011d00 con 0x7fa01809d630 2023-10-03T10:18:11.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.183+0000 7fa01f146700 1 -- 172.21.15.72:0/1018480047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa01809d630 msgr2=0x7fa0180a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.183+0000 7fa01f146700 1 --2- 172.21.15.72:0/1018480047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa01809d630 0x7fa0180a1340 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa0040098f0 tx=0x7fa004009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:11.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.183+0000 7fa01f146700 1 -- 172.21.15.72:0/1018480047 shutdown_connections 2023-10-03T10:18:11.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.183+0000 7fa01f146700 1 --2- 172.21.15.72:0/1018480047 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa018133930 0x7fa018133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.183+0000 7fa01f146700 1 --2- 172.21.15.72:0/1018480047 >> v2:172.21.15.72:3300/0 conn(0x7fa0180a0a30 0x7fa0180a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.183+0000 7fa01f146700 1 --2- 172.21.15.72:0/1018480047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa01809d630 0x7fa0180a1340 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.183+0000 7fa01f146700 1 -- 172.21.15.72:0/1018480047 >> 172.21.15.72:0/1018480047 conn(0x7fa0180a3050 msgr2=0x7fa0180a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.183+0000 7fa01f146700 1 -- 172.21.15.72:0/1018480047 shutdown_connections 2023-10-03T10:18:11.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.183+0000 7fa01f146700 1 -- 172.21.15.72:0/1018480047 wait complete. 2023-10-03T10:18:11.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.184+0000 7fa01f146700 1 Processor -- start 2023-10-03T10:18:11.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.184+0000 7fa01f146700 1 -- start start 2023-10-03T10:18:11.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.185+0000 7fa01f146700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa01809d630 0x7fa0181c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.185+0000 7fa01f146700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0180a0a30 0x7fa0181c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.185+0000 7fa01f146700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa018133930 0x7fa01811e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:11.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.185+0000 7fa01f146700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa018122160 con 0x7fa01809d630 2023-10-03T10:18:11.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.185+0000 7fa01f146700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa018122340 con 0x7fa0180a0a30 2023-10-03T10:18:11.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.185+0000 7fa01f146700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0181bcf70 con 0x7fa018133930 2023-10-03T10:18:11.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.185+0000 7fa017fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0180a0a30 0x7fa0181c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.185+0000 7fa017fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0180a0a30 0x7fa0181c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55564/0 (socket says 172.21.15.72:55564) 2023-10-03T10:18:11.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.185+0000 7fa017fff700 1 -- 172.21.15.72:0/3871919121 learned_addr learned my addr 172.21.15.72:0/3871919121 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:11.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.185+0000 7fa01d6e3700 1 --2- 172.21.15.72:0/3871919121 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa018133930 0x7fa01811e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:11.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.185+0000 7fa017fff700 1 -- 172.21.15.72:0/3871919121 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa018133930 msgr2=0x7fa01811e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.185+0000 7fa017fff700 1 --2- 172.21.15.72:0/3871919121 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa018133930 0x7fa01811e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.185+0000 7fa017fff700 1 -- 172.21.15.72:0/3871919121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa01809d630 msgr2=0x7fa0181c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.185+0000 7fa017fff700 1 --2- 172.21.15.72:0/3871919121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa01809d630 0x7fa0181c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.185+0000 7fa017fff700 1 -- 172.21.15.72:0/3871919121 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa004009550 con 0x7fa0180a0a30 2023-10-03T10:18:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.186+0000 7fa017fff700 1 --2- 172.21.15.72:0/3871919121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0180a0a30 0x7fa0181c8ab0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa0180a0310 tx=0x7fa004004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.186+0000 7fa0157fa700 1 -- 172.21.15.72:0/3871919121 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004004590 con 0x7fa0180a0a30 2023-10-03T10:18:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.186+0000 7fa0157fa700 1 -- 172.21.15.72:0/3871919121 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00401f070 con 0x7fa0180a0a30 2023-10-03T10:18:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.186+0000 7fa0157fa700 1 -- 172.21.15.72:0/3871919121 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0040038a0 con 0x7fa0180a0a30 2023-10-03T10:18:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.186+0000 7fa01f146700 1 -- 172.21.15.72:0/3871919121 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0181331b0 con 0x7fa0180a0a30 2023-10-03T10:18:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.186+0000 7fa01f146700 1 -- 172.21.15.72:0/3871919121 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0180a0410 con 0x7fa0180a0a30 2023-10-03T10:18:11.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.187+0000 7fa0157fa700 1 -- 172.21.15.72:0/3871919121 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa004003a00 con 0x7fa0180a0a30 2023-10-03T10:18:11.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.187+0000 7fa0157fa700 1 -- 172.21.15.72:0/3871919121 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa004021070 con 0x7fa0180a0a30 2023-10-03T10:18:11.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.187+0000 7fa01f146700 1 -- 172.21.15.72:0/3871919121 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0180747f0 con 0x7fa0180a0a30 2023-10-03T10:18:11.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.192+0000 7fa0157fa700 1 -- 172.21.15.72:0/3871919121 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa004015030 con 0x7fa0180a0a30 2023-10-03T10:18:11.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.311+0000 7fb5cb704700 1 -- 172.21.15.72:0/1367660793 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb5c4135140 con 0x7fb5c413fb60 2023-10-03T10:18:11.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.311+0000 7fb5b9ffb700 1 -- 172.21.15.72:0/1367660793 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb5bc011380 con 0x7fb5c413fb60 2023-10-03T10:18:11.311 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:11.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.311+0000 7f6a8d170700 1 -- 172.21.15.72:0/2715415636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6a88074ea0 con 0x7f6a8806e570 2023-10-03T10:18:11.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.312+0000 7f6a6f7fe700 1 -- 172.21.15.72:0/2715415636 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a78017af0 con 0x7f6a8806e570 2023-10-03T10:18:11.312 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:11.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7f6a8d170700 1 -- 172.21.15.72:0/2715415636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a8806e570 msgr2=0x7f6a881d4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7f6a8d170700 1 --2- 172.21.15.72:0/2715415636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a8806e570 0x7f6a881d4c40 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800c750 tx=0x7f6a7800ca60 comp rx=0 tx=0).stop 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7f6a8d170700 1 -- 172.21.15.72:0/2715415636 shutdown_connections 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7f6a8d170700 1 --2- 172.21.15.72:0/2715415636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a8806e570 0x7f6a881d4c40 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7f6a8d170700 1 --2- 172.21.15.72:0/2715415636 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6a881d56c0 0x7f6a88126db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7f6a8d170700 1 --2- 172.21.15.72:0/2715415636 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a88134610 0x7f6a881d5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7f6a8d170700 1 -- 172.21.15.72:0/2715415636 >> 172.21.15.72:0/2715415636 conn(0x7f6a880a2aa0 msgr2=0x7f6a88137970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7f6a8d170700 1 -- 172.21.15.72:0/2715415636 shutdown_connections 2023-10-03T10:18:11.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7f6a8d170700 1 -- 172.21.15.72:0/2715415636 wait complete. 2023-10-03T10:18:11.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7fb5cb704700 1 -- 172.21.15.72:0/1367660793 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5c413fb60 msgr2=0x7fb5c4132e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7fb5cb704700 1 --2- 172.21.15.72:0/1367660793 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5c413fb60 0x7fb5c4132e70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00cb90 tx=0x7fb5bc00cea0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7fb5cb704700 1 -- 172.21.15.72:0/1367660793 shutdown_connections 2023-10-03T10:18:11.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7fb5cb704700 1 --2- 172.21.15.72:0/1367660793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c406e570 0x7fb5c413f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7fb5cb704700 1 --2- 172.21.15.72:0/1367660793 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb5c413fb60 0x7fb5c4132e70 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7fb5cb704700 1 --2- 172.21.15.72:0/1367660793 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5c4134610 0x7fb5c413f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.314+0000 7fb5cb704700 1 -- 172.21.15.72:0/1367660793 >> 172.21.15.72:0/1367660793 conn(0x7fb5c40a2aa0 msgr2=0x7fb5c4136840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.315+0000 7fb5cb704700 1 -- 172.21.15.72:0/1367660793 shutdown_connections 2023-10-03T10:18:11.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.315+0000 7fb5cb704700 1 -- 172.21.15.72:0/1367660793 wait complete. 2023-10-03T10:18:11.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:11.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:11.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.339+0000 7fb6857d4700 1 -- 172.21.15.72:0/1665372647 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb680074ea0 con 0x7fb68009e410 2023-10-03T10:18:11.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.340+0000 7fb6677fe700 1 -- 172.21.15.72:0/1665372647 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb67801a310 con 0x7fb68009e410 2023-10-03T10:18:11.339 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.342+0000 7fb6857d4700 1 -- 172.21.15.72:0/1665372647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb68009e410 msgr2=0x7fb6801c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.342+0000 7fb6857d4700 1 --2- 172.21.15.72:0/1665372647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb68009e410 0x7fb6801c8aa0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb67800cca0 tx=0x7fb67800a060 comp rx=0 tx=0).stop 2023-10-03T10:18:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.342+0000 7fb6857d4700 1 -- 172.21.15.72:0/1665372647 shutdown_connections 2023-10-03T10:18:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.342+0000 7fb6857d4700 1 --2- 172.21.15.72:0/1665372647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb68009d6f0 0x7fb6801c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.342+0000 7fb6857d4700 1 --2- 172.21.15.72:0/1665372647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb68009e410 0x7fb6801c8aa0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.342+0000 7fb6857d4700 1 --2- 172.21.15.72:0/1665372647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb68009e000 0x7fb6801c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.342+0000 7fb6857d4700 1 -- 172.21.15.72:0/1665372647 >> 172.21.15.72:0/1665372647 conn(0x7fb680066f50 msgr2=0x7fb68006f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.342+0000 7fb6857d4700 1 -- 172.21.15.72:0/1665372647 shutdown_connections 2023-10-03T10:18:11.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.342+0000 7fb6857d4700 1 -- 172.21.15.72:0/1665372647 wait complete. 2023-10-03T10:18:11.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:11.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.401+0000 7fa01f146700 1 -- 172.21.15.72:0/3871919121 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa018120430 con 0x7fa0180a0a30 2023-10-03T10:18:11.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.402+0000 7fa0157fa700 1 -- 172.21.15.72:0/3871919121 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa004045060 con 0x7fa0180a0a30 2023-10-03T10:18:11.401 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:11.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.404+0000 7fa01f146700 1 -- 172.21.15.72:0/3871919121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0180a0a30 msgr2=0x7fa0181c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:11.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.404+0000 7fa01f146700 1 --2- 172.21.15.72:0/3871919121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0180a0a30 0x7fa0181c8ab0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa0180a0310 tx=0x7fa004004750 comp rx=0 tx=0).stop 2023-10-03T10:18:11.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.404+0000 7fa01f146700 1 -- 172.21.15.72:0/3871919121 shutdown_connections 2023-10-03T10:18:11.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.404+0000 7fa01f146700 1 --2- 172.21.15.72:0/3871919121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa01809d630 0x7fa0181c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.404+0000 7fa01f146700 1 --2- 172.21.15.72:0/3871919121 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa018133930 0x7fa01811e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.404+0000 7fa01f146700 1 --2- 172.21.15.72:0/3871919121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa0180a0a30 0x7fa0181c8ab0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:11.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.404+0000 7fa01f146700 1 -- 172.21.15.72:0/3871919121 >> 172.21.15.72:0/3871919121 conn(0x7fa0180a3050 msgr2=0x7fa01809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:11.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.404+0000 7fa01f146700 1 -- 172.21.15.72:0/3871919121 shutdown_connections 2023-10-03T10:18:11.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:11.404+0000 7fa01f146700 1 -- 172.21.15.72:0/3871919121 wait complete. 2023-10-03T10:18:11.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:12.329 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:12.332 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:12.354 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:12.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:12.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.476+0000 7fb0c7482700 1 Processor -- start 2023-10-03T10:18:12.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.476+0000 7fb0c7482700 1 -- start start 2023-10-03T10:18:12.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.477+0000 7fb0c7482700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0c009e1d0 0x7fb0c0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.477+0000 7fb0c7482700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0c0135e50 0x7fb0c0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.477+0000 7fb0c7482700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c009f130 con 0x7fb0c009d6f0 2023-10-03T10:18:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.477+0000 7fb0c7482700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c009f520 con 0x7fb0c009e1d0 2023-10-03T10:18:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.477+0000 7fb0c7482700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c009e930 con 0x7fb0c0135e50 2023-10-03T10:18:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.477+0000 7fb0c5a1f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0c0135e50 0x7fb0c0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.477+0000 7fb0c4a1d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0c009e1d0 0x7fb0c0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.477+0000 7fb0c5a1f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0c0135e50 0x7fb0c0138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48104/0 (socket says 172.21.15.72:48104) 2023-10-03T10:18:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.477+0000 7fb0c5a1f700 1 -- 172.21.15.72:0/1958477888 learned_addr learned my addr 172.21.15.72:0/1958477888 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:12.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.477+0000 7fb0c4a1d700 1 -- 172.21.15.72:0/1958477888 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0c0135e50 msgr2=0x7fb0c0138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.477+0000 7fb0c4a1d700 1 --2- 172.21.15.72:0/1958477888 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0c0135e50 0x7fb0c0138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.477+0000 7fb0c4a1d700 1 -- 172.21.15.72:0/1958477888 >> v1:172.21.15.72:6789/0 conn(0x7fb0c009d6f0 legacy=0x7fb0c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.477+0000 7fb0c4a1d700 1 -- 172.21.15.72:0/1958477888 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c009b2d0 con 0x7fb0c009e1d0 2023-10-03T10:18:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.477+0000 7fb0c4a1d700 1 --2- 172.21.15.72:0/1958477888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c009e1d0 0x7fb0c0135910 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009840 tx=0x7fb0b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e169bc22468b12 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.478+0000 7fb0b7fff700 1 -- 172.21.15.72:0/1958477888 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0011830 con 0x7fb0c009e1d0 2023-10-03T10:18:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.478+0000 7fb0b7fff700 1 -- 172.21.15.72:0/1958477888 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b0011990 con 0x7fb0c009e1d0 2023-10-03T10:18:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.478+0000 7fb0b7fff700 1 -- 172.21.15.72:0/1958477888 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0011d20 con 0x7fb0c009e1d0 2023-10-03T10:18:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.478+0000 7fb0c7482700 1 -- 172.21.15.72:0/1958477888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c009e1d0 msgr2=0x7fb0c0135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.478+0000 7fb0c7482700 1 --2- 172.21.15.72:0/1958477888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c009e1d0 0x7fb0c0135910 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009840 tx=0x7fb0b0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.478+0000 7fb0c7482700 1 -- 172.21.15.72:0/1958477888 shutdown_connections 2023-10-03T10:18:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.478+0000 7fb0c7482700 1 --2- 172.21.15.72:0/1958477888 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0c0135e50 0x7fb0c0138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.478+0000 7fb0c7482700 1 --2- 172.21.15.72:0/1958477888 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c009e1d0 0x7fb0c0135910 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.478+0000 7fb0c7482700 1 -- 172.21.15.72:0/1958477888 >> 172.21.15.72:0/1958477888 conn(0x7fb0c0066f50 msgr2=0x7fb0c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.479+0000 7fb0c7482700 1 -- 172.21.15.72:0/1958477888 shutdown_connections 2023-10-03T10:18:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.479+0000 7fb0c7482700 1 -- 172.21.15.72:0/1958477888 wait complete. 2023-10-03T10:18:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.480+0000 7fb0c7482700 1 Processor -- start 2023-10-03T10:18:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.480+0000 7fb0c7482700 1 -- start start 2023-10-03T10:18:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c7482700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0c009d6f0 0x7fb0c0132ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c7482700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0c009e1d0 0x7fb0c0133000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c7482700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c0135e50 0x7fb0c0133540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c7482700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c0119c20 con 0x7fb0c0135e50 2023-10-03T10:18:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c7482700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c0135890 con 0x7fb0c009e1d0 2023-10-03T10:18:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c7482700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c0119600 con 0x7fb0c009d6f0 2023-10-03T10:18:12.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c521e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0c009d6f0 0x7fb0c0132ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c521e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0c009d6f0 0x7fb0c0132ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48108/0 (socket says 172.21.15.72:48108) 2023-10-03T10:18:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c521e700 1 -- 172.21.15.72:0/611712753 learned_addr learned my addr 172.21.15.72:0/611712753 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c4a1d700 1 --2- 172.21.15.72:0/611712753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0c009e1d0 0x7fb0c0133000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c5a1f700 1 --2- 172.21.15.72:0/611712753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c0135e50 0x7fb0c0133540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c521e700 1 -- 172.21.15.72:0/611712753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0c009e1d0 msgr2=0x7fb0c0133000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c521e700 1 --2- 172.21.15.72:0/611712753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0c009e1d0 0x7fb0c0133000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c521e700 1 -- 172.21.15.72:0/611712753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c0135e50 msgr2=0x7fb0c0133540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c521e700 1 --2- 172.21.15.72:0/611712753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c0135e50 0x7fb0c0133540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c521e700 1 -- 172.21.15.72:0/611712753 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b00094a0 con 0x7fb0c009d6f0 2023-10-03T10:18:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c4a1d700 1 --2- 172.21.15.72:0/611712753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0c009e1d0 0x7fb0c0133000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c5a1f700 1 --2- 172.21.15.72:0/611712753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c0135e50 0x7fb0c0133540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.481+0000 7fb0c521e700 1 --2- 172.21.15.72:0/611712753 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0c009d6f0 0x7fb0c0132ac0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c450 tx=0x7fb0bc00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.482+0000 7fb0b5ffb700 1 -- 172.21.15.72:0/611712753 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0052d0 con 0x7fb0c009d6f0 2023-10-03T10:18:12.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.482+0000 7fb0b5ffb700 1 -- 172.21.15.72:0/611712753 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc005430 con 0x7fb0c009d6f0 2023-10-03T10:18:12.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.482+0000 7fb0c7482700 1 -- 172.21.15.72:0/611712753 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c0134bf0 con 0x7fb0c009d6f0 2023-10-03T10:18:12.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.482+0000 7fb0b5ffb700 1 -- 172.21.15.72:0/611712753 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0038c0 con 0x7fb0c009d6f0 2023-10-03T10:18:12.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.482+0000 7fb0c7482700 1 -- 172.21.15.72:0/611712753 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c0134e30 con 0x7fb0c009d6f0 2023-10-03T10:18:12.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.483+0000 7fb0c7482700 1 -- 172.21.15.72:0/611712753 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c0071700 con 0x7fb0c009d6f0 2023-10-03T10:18:12.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.483+0000 7fb0b5ffb700 1 -- 172.21.15.72:0/611712753 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0bc003a20 con 0x7fb0c009d6f0 2023-10-03T10:18:12.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.483+0000 7fb0b5ffb700 1 -- 172.21.15.72:0/611712753 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb0bc03e9e0 con 0x7fb0c009d6f0 2023-10-03T10:18:12.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.492+0000 7fb0b5ffb700 1 -- 172.21.15.72:0/611712753 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0bc011590 con 0x7fb0c009d6f0 2023-10-03T10:18:12.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.507+0000 7f3457847700 1 Processor -- start 2023-10-03T10:18:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.507+0000 7f3457847700 1 -- start start 2023-10-03T10:18:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.508+0000 7f3457847700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f345009e1d0 0x7f3450135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.508+0000 7f3457847700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3450135e50 0x7f3450138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.508+0000 7f3457847700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345009f130 con 0x7f345009d6f0 2023-10-03T10:18:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.508+0000 7f3457847700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345009f520 con 0x7f345009e1d0 2023-10-03T10:18:12.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.508+0000 7f3457847700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345009e930 con 0x7f3450135e50 2023-10-03T10:18:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.508+0000 7f3455de4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3450135e50 0x7f3450138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.508+0000 7f3455de4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3450135e50 0x7f3450138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55572/0 (socket says 172.21.15.72:55572) 2023-10-03T10:18:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.508+0000 7f3455de4700 1 -- 172.21.15.72:0/1259360314 learned_addr learned my addr 172.21.15.72:0/1259360314 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.508+0000 7f3454de2700 1 --2- 172.21.15.72:0/1259360314 >> v2:172.21.15.72:3300/0 conn(0x7f345009e1d0 0x7f3450135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.508+0000 7f3454de2700 1 -- 172.21.15.72:0/1259360314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3450135e50 msgr2=0x7f3450138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.508+0000 7f3454de2700 1 --2- 172.21.15.72:0/1259360314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3450135e50 0x7f3450138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.508+0000 7f3454de2700 1 -- 172.21.15.72:0/1259360314 >> v1:172.21.15.72:6789/0 conn(0x7f345009d6f0 legacy=0x7f345009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.508+0000 7f3454de2700 1 -- 172.21.15.72:0/1259360314 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345009b2d0 con 0x7f345009e1d0 2023-10-03T10:18:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.508+0000 7f3455de4700 1 --2- 172.21.15.72:0/1259360314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3450135e50 0x7f3450138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.508+0000 7f3454de2700 1 --2- 172.21.15.72:0/1259360314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f345009e1d0 0x7f3450135910 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f344000dc60 tx=0x7f344000df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b520ea2433674af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.509+0000 7f3447fff700 1 -- 172.21.15.72:0/1259360314 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440012070 con 0x7f345009e1d0 2023-10-03T10:18:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.509+0000 7f3447fff700 1 -- 172.21.15.72:0/1259360314 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344000d2e0 con 0x7f345009e1d0 2023-10-03T10:18:12.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.509+0000 7f3447fff700 1 -- 172.21.15.72:0/1259360314 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344000f900 con 0x7f345009e1d0 2023-10-03T10:18:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.509+0000 7f3457847700 1 -- 172.21.15.72:0/1259360314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f345009e1d0 msgr2=0x7f3450135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.509+0000 7f3457847700 1 --2- 172.21.15.72:0/1259360314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f345009e1d0 0x7f3450135910 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f344000dc60 tx=0x7f344000df70 comp rx=0 tx=0).stop 2023-10-03T10:18:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.509+0000 7f3457847700 1 -- 172.21.15.72:0/1259360314 shutdown_connections 2023-10-03T10:18:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.509+0000 7f3457847700 1 --2- 172.21.15.72:0/1259360314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3450135e50 0x7f3450138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.509+0000 7f3457847700 1 --2- 172.21.15.72:0/1259360314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f345009e1d0 0x7f3450135910 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.509+0000 7f3457847700 1 -- 172.21.15.72:0/1259360314 >> 172.21.15.72:0/1259360314 conn(0x7f3450066f50 msgr2=0x7f345009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.509+0000 7f3457847700 1 -- 172.21.15.72:0/1259360314 shutdown_connections 2023-10-03T10:18:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.510+0000 7f3457847700 1 -- 172.21.15.72:0/1259360314 wait complete. 2023-10-03T10:18:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.511+0000 7f3457847700 1 Processor -- start 2023-10-03T10:18:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.511+0000 7f3457847700 1 -- start start 2023-10-03T10:18:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.511+0000 7f3457847700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f345009d6f0 0x7f34501c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.511+0000 7f3457847700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f345009e1d0 0x7f34501c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.511+0000 7f3457847700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3450135e50 0x7f34501194f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.511+0000 7f3457847700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34501baf30 con 0x7f3450135e50 2023-10-03T10:18:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.511+0000 7f3457847700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345011cd70 con 0x7f345009d6f0 2023-10-03T10:18:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.511+0000 7f3457847700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34500a1e20 con 0x7f345009e1d0 2023-10-03T10:18:12.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f34555e3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f345009d6f0 0x7f34501c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f3455de4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3450135e50 0x7f34501194f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f34555e3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f345009d6f0 0x7f34501c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55586/0 (socket says 172.21.15.72:55586) 2023-10-03T10:18:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f3455de4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3450135e50 0x7f34501194f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57814/0 (socket says 172.21.15.72:57814) 2023-10-03T10:18:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f34555e3700 1 -- 172.21.15.72:0/662278751 learned_addr learned my addr 172.21.15.72:0/662278751 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f3455de4700 1 -- 172.21.15.72:0/662278751 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f345009e1d0 msgr2=0x7f34501c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f3455de4700 1 --2- 172.21.15.72:0/662278751 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f345009e1d0 0x7f34501c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f3455de4700 1 -- 172.21.15.72:0/662278751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f345009d6f0 msgr2=0x7f34501c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f3455de4700 1 --2- 172.21.15.72:0/662278751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f345009d6f0 0x7f34501c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f3455de4700 1 -- 172.21.15.72:0/662278751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344800bb50 con 0x7f3450135e50 2023-10-03T10:18:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f34555e3700 1 --2- 172.21.15.72:0/662278751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f345009d6f0 0x7f34501c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f3455de4700 1 --2- 172.21.15.72:0/662278751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3450135e50 0x7f34501194f0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f3448009f60 tx=0x7f3448009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f3445ffb700 1 -- 172.21.15.72:0/662278751 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448010040 con 0x7f3450135e50 2023-10-03T10:18:12.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f3445ffb700 1 -- 172.21.15.72:0/662278751 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3448008e90 con 0x7f3450135e50 2023-10-03T10:18:12.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f3457847700 1 -- 172.21.15.72:0/662278751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344000d940 con 0x7f3450135e50 2023-10-03T10:18:12.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f3445ffb700 1 -- 172.21.15.72:0/662278751 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448003c60 con 0x7f3450135e50 2023-10-03T10:18:12.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.512+0000 7f3457847700 1 -- 172.21.15.72:0/662278751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3450130280 con 0x7f3450135e50 2023-10-03T10:18:12.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.514+0000 7f3457847700 1 -- 172.21.15.72:0/662278751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3450074ea0 con 0x7f3450135e50 2023-10-03T10:18:12.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.514+0000 7f3445ffb700 1 -- 172.21.15.72:0/662278751 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f344801f400 con 0x7f3450135e50 2023-10-03T10:18:12.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.514+0000 7f3445ffb700 1 -- 172.21.15.72:0/662278751 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f344803fd00 con 0x7f3450135e50 2023-10-03T10:18:12.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.519+0000 7f3445ffb700 1 -- 172.21.15.72:0/662278751 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3448013930 con 0x7f3450135e50 2023-10-03T10:18:12.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.523+0000 7f3eea7d3700 1 Processor -- start 2023-10-03T10:18:12.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.523+0000 7f3eea7d3700 1 -- start start 2023-10-03T10:18:12.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.524+0000 7f3eea7d3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ee409e930 0x7f3ee409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.524+0000 7f3eea7d3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ee409f650 0x7f3ee4131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.524+0000 7f3eea7d3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee4070940 con 0x7f3ee409f240 2023-10-03T10:18:12.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.524+0000 7f3eea7d3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee406fd60 con 0x7f3ee409f650 2023-10-03T10:18:12.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.524+0000 7f3eea7d3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee406fa80 con 0x7f3ee409e930 2023-10-03T10:18:12.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.524+0000 7f3ee37fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3ee409f240 0x7f3ee41317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42292/0 (socket says 172.21.15.72:42292) 2023-10-03T10:18:12.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.524+0000 7f3ee37fe700 1 -- 172.21.15.72:0/1893955042 learned_addr learned my addr 172.21.15.72:0/1893955042 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:12.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.524+0000 7f3ee8d70700 1 --2- 172.21.15.72:0/1893955042 >> v2:172.21.15.72:3300/0 conn(0x7f3ee409f650 0x7f3ee4131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.524+0000 7f3ee3fff700 1 --2- 172.21.15.72:0/1893955042 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ee409e930 0x7f3ee409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.524+0000 7f3ee8d70700 1 -- 172.21.15.72:0/1893955042 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ee409e930 msgr2=0x7f3ee409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.524+0000 7f3ee8d70700 1 --2- 172.21.15.72:0/1893955042 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ee409e930 0x7f3ee409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.524+0000 7f3ee8d70700 1 -- 172.21.15.72:0/1893955042 >> v1:172.21.15.72:6789/0 conn(0x7f3ee409f240 legacy=0x7f3ee41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.524+0000 7f3ee8d70700 1 -- 172.21.15.72:0/1893955042 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee409fb60 con 0x7f3ee409f650 2023-10-03T10:18:12.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.524+0000 7f3ee8d70700 1 --2- 172.21.15.72:0/1893955042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ee409f650 0x7f3ee4131f00 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009d90 tx=0x7f3edc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48813e1d1852bb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.524+0000 7f3ee2ffd700 1 -- 172.21.15.72:0/1893955042 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00e070 con 0x7f3ee409f650 2023-10-03T10:18:12.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.525+0000 7f3ee2ffd700 1 -- 172.21.15.72:0/1893955042 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc00bb20 con 0x7f3ee409f650 2023-10-03T10:18:12.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.525+0000 7f3ee2ffd700 1 -- 172.21.15.72:0/1893955042 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc012430 con 0x7f3ee409f650 2023-10-03T10:18:12.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.525+0000 7f3eea7d3700 1 -- 172.21.15.72:0/1893955042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ee409f650 msgr2=0x7f3ee4131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.525+0000 7f3eea7d3700 1 --2- 172.21.15.72:0/1893955042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ee409f650 0x7f3ee4131f00 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009d90 tx=0x7f3edc00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:12.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.525+0000 7f3eea7d3700 1 -- 172.21.15.72:0/1893955042 shutdown_connections 2023-10-03T10:18:12.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.525+0000 7f3eea7d3700 1 --2- 172.21.15.72:0/1893955042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ee409f650 0x7f3ee4131f00 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.525+0000 7f3eea7d3700 1 --2- 172.21.15.72:0/1893955042 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ee409e930 0x7f3ee409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.525+0000 7f3eea7d3700 1 -- 172.21.15.72:0/1893955042 >> 172.21.15.72:0/1893955042 conn(0x7f3ee40a4210 msgr2=0x7f3ee40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.525+0000 7f3eea7d3700 1 -- 172.21.15.72:0/1893955042 shutdown_connections 2023-10-03T10:18:12.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.525+0000 7f3eea7d3700 1 -- 172.21.15.72:0/1893955042 wait complete. 2023-10-03T10:18:12.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.527+0000 7f3eea7d3700 1 Processor -- start 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.527+0000 7f3eea7d3700 1 -- start start 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.527+0000 7f3eea7d3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ee409e930 0x7f3ee406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.527+0000 7f3eea7d3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ee409f240 0x7f3ee406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.527+0000 7f3eea7d3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ee409f650 0x7f3ee406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.527+0000 7f3eea7d3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee41a8990 con 0x7f3ee409f240 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.527+0000 7f3eea7d3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40a34f0 con 0x7f3ee409e930 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.527+0000 7f3eea7d3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee406cc80 con 0x7f3ee409f650 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.527+0000 7f3ee8d70700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ee409f650 0x7f3ee406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.528+0000 7f3ee8d70700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ee409f650 0x7f3ee406c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48140/0 (socket says 172.21.15.72:48140) 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.528+0000 7f3ee8d70700 1 -- 172.21.15.72:0/3453013680 learned_addr learned my addr 172.21.15.72:0/3453013680 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.528+0000 7f3ee37fe700 1 --2- 172.21.15.72:0/3453013680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ee409f240 0x7f3ee406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.528+0000 7f3ee8d70700 1 -- 172.21.15.72:0/3453013680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ee409e930 msgr2=0x7f3ee406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.528+0000 7f3ee8d70700 1 --2- 172.21.15.72:0/3453013680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ee409e930 0x7f3ee406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.528+0000 7f3ee8d70700 1 -- 172.21.15.72:0/3453013680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ee409f240 msgr2=0x7f3ee406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.528+0000 7f3ee8d70700 1 --2- 172.21.15.72:0/3453013680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ee409f240 0x7f3ee406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.528+0000 7f3ee8d70700 1 -- 172.21.15.72:0/3453013680 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc009a70 con 0x7f3ee409f650 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.528+0000 7f3ee8d70700 1 --2- 172.21.15.72:0/3453013680 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ee409f650 0x7f3ee406c330 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3edc014040 tx=0x7f3edc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.528+0000 7f3ee0ff9700 1 -- 172.21.15.72:0/3453013680 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc012430 con 0x7f3ee409f650 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.528+0000 7f3ee0ff9700 1 -- 172.21.15.72:0/3453013680 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc020070 con 0x7f3ee409f650 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.528+0000 7f3eea7d3700 1 -- 172.21.15.72:0/3453013680 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee40a0190 con 0x7f3ee409f650 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.528+0000 7f3ee0ff9700 1 -- 172.21.15.72:0/3453013680 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc003ea0 con 0x7f3ee409f650 2023-10-03T10:18:12.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.528+0000 7f3eea7d3700 1 -- 172.21.15.72:0/3453013680 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee41a91d0 con 0x7f3ee409f650 2023-10-03T10:18:12.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.529+0000 7f3eea7d3700 1 -- 172.21.15.72:0/3453013680 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee4074ea0 con 0x7f3ee409f650 2023-10-03T10:18:12.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.530+0000 7f3ee0ff9700 1 -- 172.21.15.72:0/3453013680 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3edc004280 con 0x7f3ee409f650 2023-10-03T10:18:12.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.530+0000 7f3ee0ff9700 1 -- 172.21.15.72:0/3453013680 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3edc022070 con 0x7f3ee409f650 2023-10-03T10:18:12.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.534+0000 7f3ee0ff9700 1 -- 172.21.15.72:0/3453013680 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3edc004910 con 0x7f3ee409f650 2023-10-03T10:18:12.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.568+0000 7f00d434a700 1 Processor -- start 2023-10-03T10:18:12.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.568+0000 7f00d434a700 1 -- start start 2023-10-03T10:18:12.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.568+0000 7f00d434a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00cc06b250 0x7f00cc136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.568+0000 7f00d434a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f00cc136d80 0x7f00cc139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.569+0000 7f00d434a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00cc09ece0 con 0x7f00cc06a770 2023-10-03T10:18:12.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.569+0000 7f00d434a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00cc06b640 con 0x7f00cc136d80 2023-10-03T10:18:12.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.569+0000 7f00d434a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc09e760 con 0x7f00cc06b250 2023-10-03T10:18:12.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.569+0000 7f00d18e5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00cc06b250 0x7f00cc136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.569+0000 7f00d18e5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00cc06b250 0x7f00cc136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48150/0 (socket says 172.21.15.72:48150) 2023-10-03T10:18:12.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.569+0000 7f00d18e5700 1 -- 172.21.15.72:0/3860892396 learned_addr learned my addr 172.21.15.72:0/3860892396 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:12.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.569+0000 7f00d28e7700 1 --2- 172.21.15.72:0/3860892396 >> v2:172.21.15.72:3300/0 conn(0x7f00cc136d80 0x7f00cc139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.569+0000 7f00d28e7700 1 -- 172.21.15.72:0/3860892396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00cc06b250 msgr2=0x7f00cc136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.569+0000 7f00d28e7700 1 --2- 172.21.15.72:0/3860892396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00cc06b250 0x7f00cc136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.569+0000 7f00d28e7700 1 -- 172.21.15.72:0/3860892396 >> v1:172.21.15.72:6789/0 conn(0x7f00cc06a770 legacy=0x7f00cc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.569+0000 7f00d28e7700 1 -- 172.21.15.72:0/3860892396 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc09e040 con 0x7f00cc136d80 2023-10-03T10:18:12.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.569+0000 7f00d28e7700 1 --2- 172.21.15.72:0/3860892396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc136d80 0x7f00cc139160 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f00c4009d90 tx=0x7f00c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46b6573dbf919e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.570+0000 7f00d10e4700 1 -- 172.21.15.72:0/3860892396 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c400e070 con 0x7f00cc136d80 2023-10-03T10:18:12.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.570+0000 7f00d10e4700 1 -- 172.21.15.72:0/3860892396 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c400bb20 con 0x7f00cc136d80 2023-10-03T10:18:12.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.570+0000 7f00d10e4700 1 -- 172.21.15.72:0/3860892396 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4012430 con 0x7f00cc136d80 2023-10-03T10:18:12.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.570+0000 7f00d434a700 1 -- 172.21.15.72:0/3860892396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc136d80 msgr2=0x7f00cc139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.570+0000 7f00d434a700 1 --2- 172.21.15.72:0/3860892396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc136d80 0x7f00cc139160 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f00c4009d90 tx=0x7f00c400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:12.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.570+0000 7f00d434a700 1 -- 172.21.15.72:0/3860892396 shutdown_connections 2023-10-03T10:18:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.570+0000 7f00d434a700 1 --2- 172.21.15.72:0/3860892396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc136d80 0x7f00cc139160 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.570+0000 7f00d434a700 1 --2- 172.21.15.72:0/3860892396 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00cc06b250 0x7f00cc136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.570+0000 7f00d434a700 1 -- 172.21.15.72:0/3860892396 >> 172.21.15.72:0/3860892396 conn(0x7f00cc066f50 msgr2=0x7f00cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.570+0000 7f00d434a700 1 -- 172.21.15.72:0/3860892396 shutdown_connections 2023-10-03T10:18:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.570+0000 7f00d434a700 1 -- 172.21.15.72:0/3860892396 wait complete. 2023-10-03T10:18:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.571+0000 7f00d434a700 1 Processor -- start 2023-10-03T10:18:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.571+0000 7f00d434a700 1 -- start start 2023-10-03T10:18:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d434a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc06a770 0x7f00cc09add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d434a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00cc06b250 0x7f00cc09b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d434a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00cc136d80 0x7f00cc1c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d434a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc09b850 con 0x7f00cc06a770 2023-10-03T10:18:12.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d434a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc122380 con 0x7f00cc136d80 2023-10-03T10:18:12.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d434a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc071e60 con 0x7f00cc06b250 2023-10-03T10:18:12.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d18e5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00cc06b250 0x7f00cc09b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d18e5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00cc06b250 0x7f00cc09b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48158/0 (socket says 172.21.15.72:48158) 2023-10-03T10:18:12.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d18e5700 1 -- 172.21.15.72:0/1134462517 learned_addr learned my addr 172.21.15.72:0/1134462517 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:12.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d20e6700 1 --2- 172.21.15.72:0/1134462517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc06a770 0x7f00cc09add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d28e7700 1 --2- 172.21.15.72:0/1134462517 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00cc136d80 0x7f00cc1c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d18e5700 1 -- 172.21.15.72:0/1134462517 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00cc136d80 msgr2=0x7f00cc1c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d18e5700 1 --2- 172.21.15.72:0/1134462517 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00cc136d80 0x7f00cc1c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d18e5700 1 -- 172.21.15.72:0/1134462517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc06a770 msgr2=0x7f00cc09add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d18e5700 1 --2- 172.21.15.72:0/1134462517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc06a770 0x7f00cc09add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d18e5700 1 -- 172.21.15.72:0/1134462517 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c4009a70 con 0x7f00cc06b250 2023-10-03T10:18:12.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.572+0000 7f00d18e5700 1 --2- 172.21.15.72:0/1134462517 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00cc06b250 0x7f00cc09b310 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00e970 tx=0x7f00bc00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.573+0000 7f00c2ffd700 1 -- 172.21.15.72:0/1134462517 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc0096a0 con 0x7f00cc06b250 2023-10-03T10:18:12.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.573+0000 7f00c2ffd700 1 -- 172.21.15.72:0/1134462517 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00bc013680 con 0x7f00cc06b250 2023-10-03T10:18:12.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.573+0000 7f00d434a700 1 -- 172.21.15.72:0/1134462517 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00cc132410 con 0x7f00cc06b250 2023-10-03T10:18:12.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.573+0000 7f00c2ffd700 1 -- 172.21.15.72:0/1134462517 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc013a30 con 0x7f00cc06b250 2023-10-03T10:18:12.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.573+0000 7f00d434a700 1 -- 172.21.15.72:0/1134462517 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00cc09a8d0 con 0x7f00cc06b250 2023-10-03T10:18:12.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.574+0000 7f00d434a700 1 -- 172.21.15.72:0/1134462517 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00cc122bd0 con 0x7f00cc06b250 2023-10-03T10:18:12.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.574+0000 7f00c2ffd700 1 -- 172.21.15.72:0/1134462517 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00bc013b90 con 0x7f00cc06b250 2023-10-03T10:18:12.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.574+0000 7f00c2ffd700 1 -- 172.21.15.72:0/1134462517 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f00bc03f9f0 con 0x7f00cc06b250 2023-10-03T10:18:12.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.578+0000 7f00c2ffd700 1 -- 172.21.15.72:0/1134462517 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00bc011d90 con 0x7f00cc06b250 2023-10-03T10:18:12.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.699+0000 7fb0c7482700 1 -- 172.21.15.72:0/611712753 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb0c009ed10 con 0x7fb0c009d6f0 2023-10-03T10:18:12.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.699+0000 7fb0b5ffb700 1 -- 172.21.15.72:0/611712753 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0bc017070 con 0x7fb0c009d6f0 2023-10-03T10:18:12.699 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:12.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.701+0000 7fb0c7482700 1 -- 172.21.15.72:0/611712753 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0c009d6f0 msgr2=0x7fb0c0132ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.701+0000 7fb0c7482700 1 --2- 172.21.15.72:0/611712753 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0c009d6f0 0x7fb0c0132ac0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c450 tx=0x7fb0bc00c760 comp rx=0 tx=0).stop 2023-10-03T10:18:12.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.701+0000 7fb0c7482700 1 -- 172.21.15.72:0/611712753 shutdown_connections 2023-10-03T10:18:12.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.701+0000 7fb0c7482700 1 --2- 172.21.15.72:0/611712753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0c0135e50 0x7fb0c0133540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.701+0000 7fb0c7482700 1 --2- 172.21.15.72:0/611712753 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0c009d6f0 0x7fb0c0132ac0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.701+0000 7fb0c7482700 1 --2- 172.21.15.72:0/611712753 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0c009e1d0 0x7fb0c0133000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.701+0000 7fb0c7482700 1 -- 172.21.15.72:0/611712753 >> 172.21.15.72:0/611712753 conn(0x7fb0c0066f50 msgr2=0x7fb0c006e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.701+0000 7fb0c7482700 1 -- 172.21.15.72:0/611712753 shutdown_connections 2023-10-03T10:18:12.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.701+0000 7fb0c7482700 1 -- 172.21.15.72:0/611712753 wait complete. 2023-10-03T10:18:12.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:12.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.732+0000 7f3eea7d3700 1 -- 172.21.15.72:0/3453013680 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3ee41b72a0 con 0x7f3ee409f650 2023-10-03T10:18:12.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.732+0000 7f3ee0ff9700 1 -- 172.21.15.72:0/3453013680 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3edc035090 con 0x7f3ee409f650 2023-10-03T10:18:12.732 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.734+0000 7f3eea7d3700 1 -- 172.21.15.72:0/3453013680 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ee409f650 msgr2=0x7f3ee406c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.734+0000 7f3eea7d3700 1 --2- 172.21.15.72:0/3453013680 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ee409f650 0x7f3ee406c330 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3edc014040 tx=0x7f3edc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.734+0000 7f3eea7d3700 1 -- 172.21.15.72:0/3453013680 shutdown_connections 2023-10-03T10:18:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.734+0000 7f3eea7d3700 1 --2- 172.21.15.72:0/3453013680 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ee409f650 0x7f3ee406c330 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.734+0000 7f3eea7d3700 1 --2- 172.21.15.72:0/3453013680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ee409e930 0x7f3ee406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.734+0000 7f3eea7d3700 1 --2- 172.21.15.72:0/3453013680 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ee409f240 0x7f3ee406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.734+0000 7f3eea7d3700 1 -- 172.21.15.72:0/3453013680 >> 172.21.15.72:0/3453013680 conn(0x7f3ee40a4210 msgr2=0x7f3ee41b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.734+0000 7f3eea7d3700 1 -- 172.21.15.72:0/3453013680 shutdown_connections 2023-10-03T10:18:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.734+0000 7f3eea7d3700 1 -- 172.21.15.72:0/3453013680 wait complete. 2023-10-03T10:18:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.734+0000 7f3457847700 1 -- 172.21.15.72:0/662278751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f34501c4e00 con 0x7f3450135e50 2023-10-03T10:18:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.735+0000 7f3445ffb700 1 -- 172.21.15.72:0/662278751 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f344800bda0 con 0x7f3450135e50 2023-10-03T10:18:12.735 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:12.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.737+0000 7f3457847700 1 -- 172.21.15.72:0/662278751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3450135e50 msgr2=0x7f34501194f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.737+0000 7f3457847700 1 --2- 172.21.15.72:0/662278751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3450135e50 0x7f34501194f0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f3448009f60 tx=0x7f3448009f90 comp rx=0 tx=0).stop 2023-10-03T10:18:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.737+0000 7f3457847700 1 -- 172.21.15.72:0/662278751 shutdown_connections 2023-10-03T10:18:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.737+0000 7f3457847700 1 --2- 172.21.15.72:0/662278751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3450135e50 0x7f34501194f0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.737+0000 7f3457847700 1 --2- 172.21.15.72:0/662278751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f345009d6f0 0x7f34501c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.737+0000 7f3457847700 1 --2- 172.21.15.72:0/662278751 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f345009e1d0 0x7f34501c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.737+0000 7f3457847700 1 -- 172.21.15.72:0/662278751 >> 172.21.15.72:0/662278751 conn(0x7f3450066f50 msgr2=0x7f345006f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.737+0000 7f3457847700 1 -- 172.21.15.72:0/662278751 shutdown_connections 2023-10-03T10:18:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.737+0000 7f3457847700 1 -- 172.21.15.72:0/662278751 wait complete. 2023-10-03T10:18:12.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:12.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:12.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.776+0000 7f00d434a700 1 -- 172.21.15.72:0/1134462517 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f00cc074ea0 con 0x7f00cc06b250 2023-10-03T10:18:12.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.776+0000 7f00c2ffd700 1 -- 172.21.15.72:0/1134462517 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00bc021070 con 0x7f00cc06b250 2023-10-03T10:18:12.776 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:12.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.778+0000 7f00d434a700 1 -- 172.21.15.72:0/1134462517 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00cc06b250 msgr2=0x7f00cc09b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.778+0000 7f00d434a700 1 --2- 172.21.15.72:0/1134462517 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00cc06b250 0x7f00cc09b310 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00e970 tx=0x7f00bc00ec80 comp rx=0 tx=0).stop 2023-10-03T10:18:12.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.778+0000 7f00d434a700 1 -- 172.21.15.72:0/1134462517 shutdown_connections 2023-10-03T10:18:12.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.778+0000 7f00d434a700 1 --2- 172.21.15.72:0/1134462517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00cc06a770 0x7f00cc09add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.778+0000 7f00d434a700 1 --2- 172.21.15.72:0/1134462517 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f00cc136d80 0x7f00cc1c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.778+0000 7f00d434a700 1 --2- 172.21.15.72:0/1134462517 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f00cc06b250 0x7f00cc09b310 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.778+0000 7f00d434a700 1 -- 172.21.15.72:0/1134462517 >> 172.21.15.72:0/1134462517 conn(0x7f00cc066f50 msgr2=0x7f00cc135e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.778+0000 7f00d434a700 1 -- 172.21.15.72:0/1134462517 shutdown_connections 2023-10-03T10:18:12.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:12.778+0000 7f00d434a700 1 -- 172.21.15.72:0/1134462517 wait complete. 2023-10-03T10:18:12.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:13.714 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:13.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:13.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:13.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:13.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.860+0000 7fd627de3700 1 Processor -- start 2023-10-03T10:18:13.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.860+0000 7fd627de3700 1 -- start start 2023-10-03T10:18:13.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.861+0000 7fd627de3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd62009d6f0 0x7fd62009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.861+0000 7fd627de3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd62009e440 0x7fd620134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.861+0000 7fd627de3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62009b120 con 0x7fd62009e000 2023-10-03T10:18:13.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.861+0000 7fd627de3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62006b460 con 0x7fd62009d6f0 2023-10-03T10:18:13.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.861+0000 7fd627de3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62009a7e0 con 0x7fd62009e440 2023-10-03T10:18:13.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.861+0000 7fd625b7f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd62009d6f0 0x7fd62009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.861+0000 7fd625b7f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd62009d6f0 0x7fd62009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57858/0 (socket says 172.21.15.72:57858) 2023-10-03T10:18:13.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.861+0000 7fd625b7f700 1 -- 172.21.15.72:0/53454169 learned_addr learned my addr 172.21.15.72:0/53454169 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:13.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.861+0000 7fd625b7f700 1 -- 172.21.15.72:0/53454169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd62009e440 msgr2=0x7fd620134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.861+0000 7fd625b7f700 1 --2- 172.21.15.72:0/53454169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd62009e440 0x7fd620134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.861+0000 7fd625b7f700 1 -- 172.21.15.72:0/53454169 >> v1:172.21.15.72:6789/0 conn(0x7fd62009e000 legacy=0x7fd6201339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.861+0000 7fd625b7f700 1 -- 172.21.15.72:0/53454169 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62009a500 con 0x7fd62009d6f0 2023-10-03T10:18:13.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.861+0000 7fd625b7f700 1 --2- 172.21.15.72:0/53454169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd62009d6f0 0x7fd62009dac0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fd61c009920 tx=0x7fd61c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee62a4e962eb720 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.862+0000 7fd624b7d700 1 -- 172.21.15.72:0/53454169 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c00ba20 con 0x7fd62009d6f0 2023-10-03T10:18:13.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.862+0000 7fd624b7d700 1 -- 172.21.15.72:0/53454169 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c00bb80 con 0x7fd62009d6f0 2023-10-03T10:18:13.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.862+0000 7fd624b7d700 1 -- 172.21.15.72:0/53454169 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c009e70 con 0x7fd62009d6f0 2023-10-03T10:18:13.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.862+0000 7fd627de3700 1 -- 172.21.15.72:0/53454169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd62009d6f0 msgr2=0x7fd62009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.862+0000 7fd627de3700 1 --2- 172.21.15.72:0/53454169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd62009d6f0 0x7fd62009dac0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fd61c009920 tx=0x7fd61c009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:13.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.863+0000 7fd627de3700 1 -- 172.21.15.72:0/53454169 shutdown_connections 2023-10-03T10:18:13.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.863+0000 7fd627de3700 1 --2- 172.21.15.72:0/53454169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd62009e440 0x7fd620134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.863+0000 7fd627de3700 1 --2- 172.21.15.72:0/53454169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd62009d6f0 0x7fd62009dac0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.863+0000 7fd627de3700 1 -- 172.21.15.72:0/53454169 >> 172.21.15.72:0/53454169 conn(0x7fd620066f50 msgr2=0x7fd62009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.863+0000 7fd627de3700 1 -- 172.21.15.72:0/53454169 shutdown_connections 2023-10-03T10:18:13.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.863+0000 7fd627de3700 1 -- 172.21.15.72:0/53454169 wait complete. 2023-10-03T10:18:13.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.864+0000 7fd627de3700 1 Processor -- start 2023-10-03T10:18:13.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.864+0000 7fd627de3700 1 -- start start 2023-10-03T10:18:13.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.864+0000 7fd627de3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd62009d6f0 0x7fd6201a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.864+0000 7fd627de3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd62009e000 0x7fd6201a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.864+0000 7fd627de3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd62009e440 0x7fd6201a68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.864+0000 7fd627de3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6201a9960 con 0x7fd62009e000 2023-10-03T10:18:13.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.864+0000 7fd627de3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6201a7af0 con 0x7fd62009d6f0 2023-10-03T10:18:13.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.864+0000 7fd627de3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200a21b0 con 0x7fd62009e440 2023-10-03T10:18:13.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.864+0000 7fd626380700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd62009e440 0x7fd6201a68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.864+0000 7fd626380700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd62009e440 0x7fd6201a68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48160/0 (socket says 172.21.15.72:48160) 2023-10-03T10:18:13.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.864+0000 7fd626380700 1 -- 172.21.15.72:0/2220196456 learned_addr learned my addr 172.21.15.72:0/2220196456 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:13.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.864+0000 7fd62537e700 1 --2- 172.21.15.72:0/2220196456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd62009e000 0x7fd6201a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.865+0000 7fd625b7f700 1 --2- 172.21.15.72:0/2220196456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd62009d6f0 0x7fd6201a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.865+0000 7fd626380700 1 -- 172.21.15.72:0/2220196456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd62009d6f0 msgr2=0x7fd6201a5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.865+0000 7fd626380700 1 --2- 172.21.15.72:0/2220196456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd62009d6f0 0x7fd6201a5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.865+0000 7fd626380700 1 -- 172.21.15.72:0/2220196456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd62009e000 msgr2=0x7fd6201a6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.865+0000 7fd626380700 1 --2- 172.21.15.72:0/2220196456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd62009e000 0x7fd6201a6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.865+0000 7fd626380700 1 -- 172.21.15.72:0/2220196456 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c009550 con 0x7fd62009e440 2023-10-03T10:18:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.865+0000 7fd625b7f700 1 --2- 172.21.15.72:0/2220196456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd62009d6f0 0x7fd6201a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.865+0000 7fd626380700 1 --2- 172.21.15.72:0/2220196456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd62009e440 0x7fd6201a68c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd61800b970 tx=0x7fd61800bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.865+0000 7fd6167fc700 1 -- 172.21.15.72:0/2220196456 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61800c930 con 0x7fd62009e440 2023-10-03T10:18:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.865+0000 7fd6167fc700 1 -- 172.21.15.72:0/2220196456 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61800cab0 con 0x7fd62009e440 2023-10-03T10:18:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.865+0000 7fd6167fc700 1 -- 172.21.15.72:0/2220196456 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61800ce60 con 0x7fd62009e440 2023-10-03T10:18:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.865+0000 7fd627de3700 1 -- 172.21.15.72:0/2220196456 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62009c710 con 0x7fd62009e440 2023-10-03T10:18:13.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.865+0000 7fd627de3700 1 -- 172.21.15.72:0/2220196456 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6201a8850 con 0x7fd62009e440 2023-10-03T10:18:13.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.866+0000 7fd627de3700 1 -- 172.21.15.72:0/2220196456 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd620074ea0 con 0x7fd62009e440 2023-10-03T10:18:13.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.867+0000 7fd6167fc700 1 -- 172.21.15.72:0/2220196456 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd61801d3b0 con 0x7fd62009e440 2023-10-03T10:18:13.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.867+0000 7fd6167fc700 1 -- 172.21.15.72:0/2220196456 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd618006e40 con 0x7fd62009e440 2023-10-03T10:18:13.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.875+0000 7fd6167fc700 1 -- 172.21.15.72:0/2220196456 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd618007370 con 0x7fd62009e440 2023-10-03T10:18:13.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.896+0000 7fa848fd7700 1 Processor -- start 2023-10-03T10:18:13.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.896+0000 7fa848fd7700 1 -- start start 2023-10-03T10:18:13.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.896+0000 7f680f2a5700 1 Processor -- start 2023-10-03T10:18:13.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.896+0000 7f680f2a5700 1 -- start start 2023-10-03T10:18:13.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.896+0000 7fa848fd7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa844134630 0x7fa844136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.896+0000 7fa848fd7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa844136f50 0x7fa844139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.896+0000 7fa848fd7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84409b4f0 con 0x7fa844131810 2023-10-03T10:18:13.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.896+0000 7fa848fd7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8441313c0 con 0x7fa844136f50 2023-10-03T10:18:13.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.896+0000 7fa848fd7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa84406e8c0 con 0x7fa844134630 2023-10-03T10:18:13.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7fa841d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa844134630 0x7fa844136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7fa841d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa844134630 0x7fa844136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48172/0 (socket says 172.21.15.72:48172) 2023-10-03T10:18:13.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7fa841d9b700 1 -- 172.21.15.72:0/3120676641 learned_addr learned my addr 172.21.15.72:0/3120676641 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7f680f2a5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6808130e20 0x7f6808136760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7f680f2a5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6808136ca0 0x7f6808139080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7f680f2a5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68080716a0 con 0x7f6808130340 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7f680f2a5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680809a390 con 0x7f6808130e20 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7f680f2a5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6808071290 con 0x7f6808136ca0 2023-10-03T10:18:13.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7fa841d9b700 1 -- 172.21.15.72:0/3120676641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa844136f50 msgr2=0x7fa844139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7fa841d9b700 1 --2- 172.21.15.72:0/3120676641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa844136f50 0x7fa844139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7fa841d9b700 1 -- 172.21.15.72:0/3120676641 >> v1:172.21.15.72:6789/0 conn(0x7fa844131810 legacy=0x7fa844131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7fa841d9b700 1 -- 172.21.15.72:0/3120676641 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa844071d20 con 0x7fa844134630 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7f680d842700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6808136ca0 0x7f6808139080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7f680d842700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6808136ca0 0x7f6808139080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55624/0 (socket says 172.21.15.72:55624) 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7f680d842700 1 -- 172.21.15.72:0/2819847100 learned_addr learned my addr 172.21.15.72:0/2819847100 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7f680c840700 1 --2- 172.21.15.72:0/2819847100 >> v2:172.21.15.72:3300/0 conn(0x7f6808130e20 0x7f6808136760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7fa841d9b700 1 --2- 172.21.15.72:0/3120676641 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa844134630 0x7fa844136a10 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa838009920 tx=0x7fa838009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a30fde894179230d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7f680d842700 1 -- 172.21.15.72:0/2819847100 >> v2:172.21.15.72:3300/0 conn(0x7f6808130e20 msgr2=0x7f6808136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7f680d842700 1 --2- 172.21.15.72:0/2819847100 >> v2:172.21.15.72:3300/0 conn(0x7f6808130e20 0x7f6808136760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7f680d842700 1 -- 172.21.15.72:0/2819847100 >> v1:172.21.15.72:6789/0 conn(0x7f6808130340 legacy=0x7f6808130710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.897+0000 7f680d842700 1 -- 172.21.15.72:0/2819847100 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6808070b80 con 0x7f6808136ca0 2023-10-03T10:18:13.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.898+0000 7f680d842700 1 --2- 172.21.15.72:0/2819847100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6808136ca0 0x7f6808139080 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6800009e50 tx=0x7f680000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4e5591406e3b21d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.898+0000 7fa84159a700 1 -- 172.21.15.72:0/3120676641 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838004230 con 0x7fa844134630 2023-10-03T10:18:13.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.898+0000 7fa84159a700 1 -- 172.21.15.72:0/3120676641 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa838004390 con 0x7fa844134630 2023-10-03T10:18:13.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.898+0000 7fa84159a700 1 -- 172.21.15.72:0/3120676641 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838009e70 con 0x7fa844134630 2023-10-03T10:18:13.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.898+0000 7f67fffff700 1 -- 172.21.15.72:0/2819847100 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680000e070 con 0x7f6808136ca0 2023-10-03T10:18:13.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.898+0000 7f67fffff700 1 -- 172.21.15.72:0/2819847100 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680000b9c0 con 0x7f6808136ca0 2023-10-03T10:18:13.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.898+0000 7f67fffff700 1 -- 172.21.15.72:0/2819847100 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680000bd70 con 0x7f6808136ca0 2023-10-03T10:18:13.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.898+0000 7fa848fd7700 1 -- 172.21.15.72:0/3120676641 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa844134630 msgr2=0x7fa844136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.898+0000 7fa848fd7700 1 --2- 172.21.15.72:0/3120676641 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa844134630 0x7fa844136a10 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa838009920 tx=0x7fa838009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:13.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.898+0000 7f680f2a5700 1 -- 172.21.15.72:0/2819847100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6808136ca0 msgr2=0x7f6808139080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.898+0000 7f680f2a5700 1 --2- 172.21.15.72:0/2819847100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6808136ca0 0x7f6808139080 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6800009e50 tx=0x7f680000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:13.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.899+0000 7f680f2a5700 1 -- 172.21.15.72:0/2819847100 shutdown_connections 2023-10-03T10:18:13.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.899+0000 7f680f2a5700 1 --2- 172.21.15.72:0/2819847100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6808136ca0 0x7f6808139080 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.899+0000 7f680f2a5700 1 --2- 172.21.15.72:0/2819847100 >> v2:172.21.15.72:3300/0 conn(0x7f6808130e20 0x7f6808136760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.899+0000 7fa848fd7700 1 -- 172.21.15.72:0/3120676641 shutdown_connections 2023-10-03T10:18:13.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.899+0000 7fa848fd7700 1 --2- 172.21.15.72:0/3120676641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa844136f50 0x7fa844139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.899+0000 7fa848fd7700 1 --2- 172.21.15.72:0/3120676641 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa844134630 0x7fa844136a10 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.899+0000 7fa848fd7700 1 -- 172.21.15.72:0/3120676641 >> 172.21.15.72:0/3120676641 conn(0x7fa8440a2aa0 msgr2=0x7fa8440a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.899+0000 7f680f2a5700 1 -- 172.21.15.72:0/2819847100 >> 172.21.15.72:0/2819847100 conn(0x7f68080a2aa0 msgr2=0x7f68080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.899+0000 7fa848fd7700 1 -- 172.21.15.72:0/3120676641 shutdown_connections 2023-10-03T10:18:13.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.899+0000 7f680f2a5700 1 -- 172.21.15.72:0/2819847100 shutdown_connections 2023-10-03T10:18:13.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.899+0000 7f680f2a5700 1 -- 172.21.15.72:0/2819847100 wait complete. 2023-10-03T10:18:13.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.899+0000 7fa848fd7700 1 -- 172.21.15.72:0/3120676641 wait complete. 2023-10-03T10:18:13.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7f680f2a5700 1 Processor -- start 2023-10-03T10:18:13.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7f680f2a5700 1 -- start start 2023-10-03T10:18:13.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7fa848fd7700 1 Processor -- start 2023-10-03T10:18:13.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7fa848fd7700 1 -- start start 2023-10-03T10:18:13.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7f680f2a5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6808130340 0x7f6808133710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7f680f2a5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6808130e20 0x7f6808133c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7f680f2a5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6808136ca0 0x7f6808134190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7f680f2a5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68080718e0 con 0x7f6808130340 2023-10-03T10:18:13.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7f680f2a5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6808137820 con 0x7f6808136ca0 2023-10-03T10:18:13.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7f680f2a5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6808136580 con 0x7f6808130e20 2023-10-03T10:18:13.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7fa848fd7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa844131810 0x7fa8441c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7fa848fd7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa844134630 0x7fa8441c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7fa848fd7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa844136f50 0x7fa8441c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7fa848fd7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84409e5f0 con 0x7fa844136f50 2023-10-03T10:18:13.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7fa848fd7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84406eb00 con 0x7fa844131810 2023-10-03T10:18:13.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7fa848fd7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa84411a5f0 con 0x7fa844134630 2023-10-03T10:18:13.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7f680d842700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6808136ca0 0x7f6808134190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7f680d842700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6808136ca0 0x7f6808134190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55638/0 (socket says 172.21.15.72:55638) 2023-10-03T10:18:13.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7f680d842700 1 -- 172.21.15.72:0/578562404 learned_addr learned my addr 172.21.15.72:0/578562404 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:13.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7f680d041700 1 --2- 172.21.15.72:0/578562404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6808130340 0x7f6808133710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7fa842d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa844136f50 0x7fa8441c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7fa842d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa844136f50 0x7fa8441c4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57884/0 (socket says 172.21.15.72:57884) 2023-10-03T10:18:13.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.900+0000 7fa842d9d700 1 -- 172.21.15.72:0/3698085336 learned_addr learned my addr 172.21.15.72:0/3698085336 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:13.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7fa841d9b700 1 --2- 172.21.15.72:0/3698085336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa844134630 0x7fa8441c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7f680d842700 1 -- 172.21.15.72:0/578562404 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6808130e20 msgr2=0x7f6808133c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7f680d842700 1 --2- 172.21.15.72:0/578562404 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6808130e20 0x7f6808133c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7f680d842700 1 -- 172.21.15.72:0/578562404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6808130340 msgr2=0x7f6808133710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7f680d842700 1 --2- 172.21.15.72:0/578562404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6808130340 0x7f6808133710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7f680d842700 1 -- 172.21.15.72:0/578562404 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6800009b30 con 0x7f6808136ca0 2023-10-03T10:18:13.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7fa842d9d700 1 -- 172.21.15.72:0/3698085336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa844134630 msgr2=0x7fa8441c4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7fa842d9d700 1 --2- 172.21.15.72:0/3698085336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa844134630 0x7fa8441c4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7fa842d9d700 1 -- 172.21.15.72:0/3698085336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa844131810 msgr2=0x7fa8441c4120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:18:13.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7fa842d9d700 1 --2- 172.21.15.72:0/3698085336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa844131810 0x7fa8441c4120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7fa842d9d700 1 -- 172.21.15.72:0/3698085336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa838009550 con 0x7fa844136f50 2023-10-03T10:18:13.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7fa841d9b700 1 --2- 172.21.15.72:0/3698085336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa844134630 0x7fa8441c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:13.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7fa842d9d700 1 --2- 172.21.15.72:0/3698085336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa844136f50 0x7fa8441c4ba0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00b9e0 tx=0x7fa83c00bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7f680d842700 1 --2- 172.21.15.72:0/578562404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6808136ca0 0x7f6808134190 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f68080713d0 tx=0x7f6800004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7fa832ffd700 1 -- 172.21.15.72:0/3698085336 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c00d8e0 con 0x7fa844136f50 2023-10-03T10:18:13.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7fa832ffd700 1 -- 172.21.15.72:0/3698085336 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c00da40 con 0x7fa844136f50 2023-10-03T10:18:13.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.901+0000 7fa832ffd700 1 -- 172.21.15.72:0/3698085336 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c00ddf0 con 0x7fa844136f50 2023-10-03T10:18:13.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.902+0000 7f67fdffb700 1 -- 172.21.15.72:0/578562404 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000048b0 con 0x7f6808136ca0 2023-10-03T10:18:13.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.902+0000 7f67fdffb700 1 -- 172.21.15.72:0/578562404 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68000092e0 con 0x7f6808136ca0 2023-10-03T10:18:13.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.902+0000 7f67fdffb700 1 -- 172.21.15.72:0/578562404 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680001c630 con 0x7f6808136ca0 2023-10-03T10:18:13.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.902+0000 7fa848fd7700 1 -- 172.21.15.72:0/3698085336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa844136bd0 con 0x7fa844136f50 2023-10-03T10:18:13.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.902+0000 7fa848fd7700 1 -- 172.21.15.72:0/3698085336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84411b060 con 0x7fa844136f50 2023-10-03T10:18:13.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.902+0000 7f680f2a5700 1 -- 172.21.15.72:0/578562404 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68081353a0 con 0x7f6808136ca0 2023-10-03T10:18:13.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.902+0000 7f680f2a5700 1 -- 172.21.15.72:0/578562404 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6808136090 con 0x7f6808136ca0 2023-10-03T10:18:13.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.903+0000 7f67fdffb700 1 -- 172.21.15.72:0/578562404 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f680001c790 con 0x7f6808136ca0 2023-10-03T10:18:13.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.903+0000 7f680f2a5700 1 -- 172.21.15.72:0/578562404 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6808074ea0 con 0x7f6808136ca0 2023-10-03T10:18:13.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.903+0000 7f67fdffb700 1 -- 172.21.15.72:0/578562404 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f68000196a0 con 0x7f6808136ca0 2023-10-03T10:18:13.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.904+0000 7fa848fd7700 1 -- 172.21.15.72:0/3698085336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84411a290 con 0x7fa844136f50 2023-10-03T10:18:13.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.904+0000 7fa832ffd700 1 -- 172.21.15.72:0/3698085336 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa83c015420 con 0x7fa844136f50 2023-10-03T10:18:13.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.905+0000 7fa832ffd700 1 -- 172.21.15.72:0/3698085336 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa83c011070 con 0x7fa844136f50 2023-10-03T10:18:13.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.909+0000 7fa832ffd700 1 -- 172.21.15.72:0/3698085336 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa83c007720 con 0x7fa844136f50 2023-10-03T10:18:13.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.909+0000 7f67fdffb700 1 -- 172.21.15.72:0/578562404 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68000123f0 con 0x7f6808136ca0 2023-10-03T10:18:13.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.949+0000 7f2c2bb0c700 1 Processor -- start 2023-10-03T10:18:13.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.950+0000 7f2c2bb0c700 1 -- start start 2023-10-03T10:18:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.950+0000 7f2c2bb0c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c241338a0 0x7f2c24133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.950+0000 7f2c2bb0c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c2409de50 0x7f2c2409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.950+0000 7f2c2bb0c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c2409e760 0x7f2c2413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.950+0000 7f2c2bb0c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c2406fef0 con 0x7f2c2409de50 2023-10-03T10:18:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.950+0000 7f2c2bb0c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2406ef30 con 0x7f2c241338a0 2023-10-03T10:18:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.950+0000 7f2c2bb0c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c241334b0 con 0x7f2c2409e760 2023-10-03T10:18:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.951+0000 7f2c298a8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c241338a0 0x7f2c24133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.951+0000 7f2c298a8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c241338a0 0x7f2c24133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55650/0 (socket says 172.21.15.72:55650) 2023-10-03T10:18:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.951+0000 7f2c298a8700 1 -- 172.21.15.72:0/2941581151 learned_addr learned my addr 172.21.15.72:0/2941581151 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.951+0000 7f2c2a0a9700 1 --2- 172.21.15.72:0/2941581151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c2409e760 0x7f2c2413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.951+0000 7f2c290a7700 1 --2- 172.21.15.72:0/2941581151 >> v2:172.21.15.72:3300/0 conn(0x7f2c2409de50 0x7f2c2409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.951+0000 7f2c2a0a9700 1 -- 172.21.15.72:0/2941581151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c241338a0 msgr2=0x7f2c24133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.951+0000 7f2c2a0a9700 1 --2- 172.21.15.72:0/2941581151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c241338a0 0x7f2c24133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.951+0000 7f2c2a0a9700 1 -- 172.21.15.72:0/2941581151 >> v2:172.21.15.72:3300/0 conn(0x7f2c2409de50 msgr2=0x7f2c2409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.951+0000 7f2c2a0a9700 1 --2- 172.21.15.72:0/2941581151 >> v2:172.21.15.72:3300/0 conn(0x7f2c2409de50 0x7f2c2409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.951+0000 7f2c2a0a9700 1 -- 172.21.15.72:0/2941581151 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2406fc30 con 0x7f2c2409e760 2023-10-03T10:18:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.951+0000 7f2c290a7700 1 --2- 172.21.15.72:0/2941581151 >> v2:172.21.15.72:3300/0 conn(0x7f2c2409de50 0x7f2c2409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.951+0000 7f2c2a0a9700 1 --2- 172.21.15.72:0/2941581151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c2409e760 0x7f2c2413a730 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009d90 tx=0x7f2c1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0b2c6856f472a10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.951+0000 7f2c288a6700 1 -- 172.21.15.72:0/2941581151 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c00e070 con 0x7f2c2409e760 2023-10-03T10:18:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.951+0000 7f2c288a6700 1 -- 172.21.15.72:0/2941581151 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1c00bb20 con 0x7f2c2409e760 2023-10-03T10:18:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.951+0000 7f2c288a6700 1 -- 172.21.15.72:0/2941581151 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c012430 con 0x7f2c2409e760 2023-10-03T10:18:13.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.952+0000 7f2c2bb0c700 1 -- 172.21.15.72:0/2941581151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c2409e760 msgr2=0x7f2c2413a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.952+0000 7f2c2bb0c700 1 --2- 172.21.15.72:0/2941581151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c2409e760 0x7f2c2413a730 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009d90 tx=0x7f2c1c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:13.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.952+0000 7f2c2bb0c700 1 -- 172.21.15.72:0/2941581151 shutdown_connections 2023-10-03T10:18:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.952+0000 7f2c2bb0c700 1 --2- 172.21.15.72:0/2941581151 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c2409e760 0x7f2c2413a730 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.952+0000 7f2c2bb0c700 1 --2- 172.21.15.72:0/2941581151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c241338a0 0x7f2c24133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.952+0000 7f2c2bb0c700 1 --2- 172.21.15.72:0/2941581151 >> v2:172.21.15.72:3300/0 conn(0x7f2c2409de50 0x7f2c2409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.952+0000 7f2c2bb0c700 1 -- 172.21.15.72:0/2941581151 >> 172.21.15.72:0/2941581151 conn(0x7f2c240a2aa0 msgr2=0x7f2c240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.952+0000 7f2c2bb0c700 1 -- 172.21.15.72:0/2941581151 shutdown_connections 2023-10-03T10:18:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.952+0000 7f2c2bb0c700 1 -- 172.21.15.72:0/2941581151 wait complete. 2023-10-03T10:18:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.954+0000 7f2c2bb0c700 1 Processor -- start 2023-10-03T10:18:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.954+0000 7f2c2bb0c700 1 -- start start 2023-10-03T10:18:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.954+0000 7f2c2bb0c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c2409de50 0x7f2c2411d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.954+0000 7f2c2bb0c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c2409e760 0x7f2c2411dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.954+0000 7f2c2bb0c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c241338a0 0x7f2c2411e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.954+0000 7f2c2bb0c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2411f260 con 0x7f2c2409e760 2023-10-03T10:18:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.954+0000 7f2c2bb0c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2411f880 con 0x7f2c241338a0 2023-10-03T10:18:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.954+0000 7f2c2bb0c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c241204b0 con 0x7f2c2409de50 2023-10-03T10:18:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.954+0000 7f2c2a0a9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c241338a0 0x7f2c2411e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.954+0000 7f2c2a0a9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c241338a0 0x7f2c2411e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55662/0 (socket says 172.21.15.72:55662) 2023-10-03T10:18:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.955+0000 7f2c2a0a9700 1 -- 172.21.15.72:0/209112770 learned_addr learned my addr 172.21.15.72:0/209112770 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.955+0000 7f2c298a8700 1 --2- 172.21.15.72:0/209112770 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c2409de50 0x7f2c2411d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.955+0000 7f2c290a7700 1 --2- 172.21.15.72:0/209112770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c2409e760 0x7f2c2411dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.955+0000 7f2c298a8700 1 -- 172.21.15.72:0/209112770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c241338a0 msgr2=0x7f2c2411e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.955+0000 7f2c298a8700 1 --2- 172.21.15.72:0/209112770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c241338a0 0x7f2c2411e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.955+0000 7f2c298a8700 1 -- 172.21.15.72:0/209112770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c2409e760 msgr2=0x7f2c2411dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.955+0000 7f2c298a8700 1 --2- 172.21.15.72:0/209112770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c2409e760 0x7f2c2411dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.955+0000 7f2c298a8700 1 -- 172.21.15.72:0/209112770 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c140094a0 con 0x7f2c2409de50 2023-10-03T10:18:13.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.955+0000 7f2c298a8700 1 --2- 172.21.15.72:0/209112770 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c2409de50 0x7f2c2411d6a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000e8e0 tx=0x7f2c2000ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.955+0000 7f2c1a7fc700 1 -- 172.21.15.72:0/209112770 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20013680 con 0x7f2c2409de50 2023-10-03T10:18:13.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.955+0000 7f2c1a7fc700 1 -- 172.21.15.72:0/209112770 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c200137e0 con 0x7f2c2409de50 2023-10-03T10:18:13.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.955+0000 7f2c2bb0c700 1 -- 172.21.15.72:0/209112770 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1c009a70 con 0x7f2c2409de50 2023-10-03T10:18:13.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.955+0000 7f2c1a7fc700 1 -- 172.21.15.72:0/209112770 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20013b50 con 0x7f2c2409de50 2023-10-03T10:18:13.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.955+0000 7f2c2bb0c700 1 -- 172.21.15.72:0/209112770 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c240a0f30 con 0x7f2c2409de50 2023-10-03T10:18:13.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.956+0000 7f2c2bb0c700 1 -- 172.21.15.72:0/209112770 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2406f6a0 con 0x7f2c2409de50 2023-10-03T10:18:13.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.957+0000 7f2c1a7fc700 1 -- 172.21.15.72:0/209112770 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c20013cb0 con 0x7f2c2409de50 2023-10-03T10:18:13.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.960+0000 7f2c1a7fc700 1 -- 172.21.15.72:0/209112770 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2c20011e80 con 0x7f2c2409de50 2023-10-03T10:18:13.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:13.962+0000 7f2c1a7fc700 1 -- 172.21.15.72:0/209112770 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c20044060 con 0x7f2c2409de50 2023-10-03T10:18:14.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.073+0000 7fd627de3700 1 -- 172.21.15.72:0/2220196456 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd62009f420 con 0x7fd62009e440 2023-10-03T10:18:14.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.074+0000 7fd6167fc700 1 -- 172.21.15.72:0/2220196456 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd618019030 con 0x7fd62009e440 2023-10-03T10:18:14.074 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:14.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.076+0000 7fd627de3700 1 -- 172.21.15.72:0/2220196456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd62009e440 msgr2=0x7fd6201a68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.076+0000 7fd627de3700 1 --2- 172.21.15.72:0/2220196456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd62009e440 0x7fd6201a68c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd61800b970 tx=0x7fd61800bc80 comp rx=0 tx=0).stop 2023-10-03T10:18:14.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.076+0000 7fd627de3700 1 -- 172.21.15.72:0/2220196456 shutdown_connections 2023-10-03T10:18:14.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.076+0000 7fd627de3700 1 --2- 172.21.15.72:0/2220196456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd62009e440 0x7fd6201a68c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.076+0000 7fd627de3700 1 --2- 172.21.15.72:0/2220196456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd62009d6f0 0x7fd6201a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.076+0000 7fd627de3700 1 --2- 172.21.15.72:0/2220196456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd62009e000 0x7fd6201a6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.076+0000 7fd627de3700 1 -- 172.21.15.72:0/2220196456 >> 172.21.15.72:0/2220196456 conn(0x7fd620066f50 msgr2=0x7fd6201bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.076+0000 7fd627de3700 1 -- 172.21.15.72:0/2220196456 shutdown_connections 2023-10-03T10:18:14.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.076+0000 7fd627de3700 1 -- 172.21.15.72:0/2220196456 wait complete. 2023-10-03T10:18:14.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:14.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.109+0000 7fa848fd7700 1 -- 172.21.15.72:0/3698085336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa84411a290 con 0x7fa844136f50 2023-10-03T10:18:14.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.109+0000 7fa832ffd700 1 -- 172.21.15.72:0/3698085336 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa84411a290 con 0x7fa844136f50 2023-10-03T10:18:14.109 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:14.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.111+0000 7f680f2a5700 1 -- 172.21.15.72:0/578562404 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6808137d90 con 0x7f6808136ca0 2023-10-03T10:18:14.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.111+0000 7f67fdffb700 1 -- 172.21.15.72:0/578562404 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f68000123f0 con 0x7f6808136ca0 2023-10-03T10:18:14.111 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:14.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.111+0000 7fa848fd7700 1 -- 172.21.15.72:0/3698085336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa844136f50 msgr2=0x7fa8441c4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.111+0000 7fa848fd7700 1 --2- 172.21.15.72:0/3698085336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa844136f50 0x7fa8441c4ba0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00b9e0 tx=0x7fa83c00bcf0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.111+0000 7fa848fd7700 1 -- 172.21.15.72:0/3698085336 shutdown_connections 2023-10-03T10:18:14.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.111+0000 7fa848fd7700 1 --2- 172.21.15.72:0/3698085336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa844136f50 0x7fa8441c4ba0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.111+0000 7fa848fd7700 1 --2- 172.21.15.72:0/3698085336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa844131810 0x7fa8441c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.111+0000 7fa848fd7700 1 --2- 172.21.15.72:0/3698085336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa844134630 0x7fa8441c4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.111+0000 7fa848fd7700 1 -- 172.21.15.72:0/3698085336 >> 172.21.15.72:0/3698085336 conn(0x7fa8440a2aa0 msgr2=0x7fa844134a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.112+0000 7fa848fd7700 1 -- 172.21.15.72:0/3698085336 shutdown_connections 2023-10-03T10:18:14.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.112+0000 7fa848fd7700 1 -- 172.21.15.72:0/3698085336 wait complete. 2023-10-03T10:18:14.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.113+0000 7f680f2a5700 1 -- 172.21.15.72:0/578562404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6808136ca0 msgr2=0x7f6808134190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.113+0000 7f680f2a5700 1 --2- 172.21.15.72:0/578562404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6808136ca0 0x7f6808134190 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f68080713d0 tx=0x7f6800004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.113+0000 7f680f2a5700 1 -- 172.21.15.72:0/578562404 shutdown_connections 2023-10-03T10:18:14.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.113+0000 7f680f2a5700 1 --2- 172.21.15.72:0/578562404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6808130340 0x7f6808133710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.113+0000 7f680f2a5700 1 --2- 172.21.15.72:0/578562404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6808136ca0 0x7f6808134190 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.113+0000 7f680f2a5700 1 --2- 172.21.15.72:0/578562404 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6808130e20 0x7f6808133c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.113+0000 7f680f2a5700 1 -- 172.21.15.72:0/578562404 >> 172.21.15.72:0/578562404 conn(0x7f68080a2aa0 msgr2=0x7f680806e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.113+0000 7f680f2a5700 1 -- 172.21.15.72:0/578562404 shutdown_connections 2023-10-03T10:18:14.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.113+0000 7f680f2a5700 1 -- 172.21.15.72:0/578562404 wait complete. 2023-10-03T10:18:14.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:14.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.159+0000 7f2c2bb0c700 1 -- 172.21.15.72:0/209112770 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2c2411a470 con 0x7f2c2409de50 2023-10-03T10:18:14.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.160+0000 7f2c1a7fc700 1 -- 172.21.15.72:0/209112770 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c20017020 con 0x7f2c2409de50 2023-10-03T10:18:14.159 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:14.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.162+0000 7f2c2bb0c700 1 -- 172.21.15.72:0/209112770 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c2409de50 msgr2=0x7f2c2411d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.162+0000 7f2c2bb0c700 1 --2- 172.21.15.72:0/209112770 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c2409de50 0x7f2c2411d6a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2c2000e8e0 tx=0x7f2c2000ebf0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.162+0000 7f2c2bb0c700 1 -- 172.21.15.72:0/209112770 shutdown_connections 2023-10-03T10:18:14.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.162+0000 7f2c2bb0c700 1 --2- 172.21.15.72:0/209112770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c241338a0 0x7f2c2411e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.162+0000 7f2c2bb0c700 1 --2- 172.21.15.72:0/209112770 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c2409de50 0x7f2c2411d6a0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.162+0000 7f2c2bb0c700 1 --2- 172.21.15.72:0/209112770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c2409e760 0x7f2c2411dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.162+0000 7f2c2bb0c700 1 -- 172.21.15.72:0/209112770 >> 172.21.15.72:0/209112770 conn(0x7f2c240a2aa0 msgr2=0x7f2c241bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.162+0000 7f2c2bb0c700 1 -- 172.21.15.72:0/209112770 shutdown_connections 2023-10-03T10:18:14.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:14.162+0000 7f2c2bb0c700 1 -- 172.21.15.72:0/209112770 wait complete. 2023-10-03T10:18:14.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:15.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:15.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:15.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:15.174 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:15.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.228+0000 7f99c1a6e700 1 Processor -- start 2023-10-03T10:18:15.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.228+0000 7f99c1a6e700 1 -- start start 2023-10-03T10:18:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.228+0000 7f99c1a6e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99bc06f5d0 0x7f99bc12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.228+0000 7f99c1a6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99bc135c20 0x7f99bc138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.228+0000 7f99c1a6e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc06fa40 con 0x7f99bc12cf60 2023-10-03T10:18:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.228+0000 7f99c1a6e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc12cd90 con 0x7f99bc135c20 2023-10-03T10:18:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.228+0000 7f99c1a6e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc071780 con 0x7f99bc06f5d0 2023-10-03T10:18:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.228+0000 7f99baffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99bc06f5d0 0x7f99bc12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.228+0000 7f99baffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99bc06f5d0 0x7f99bc12ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48218/0 (socket says 172.21.15.72:48218) 2023-10-03T10:18:15.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.228+0000 7f99baffd700 1 -- 172.21.15.72:0/428852733 learned_addr learned my addr 172.21.15.72:0/428852733 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.229+0000 7f99bbfff700 1 --2- 172.21.15.72:0/428852733 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99bc135c20 0x7f99bc138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.229+0000 7f99bbfff700 1 -- 172.21.15.72:0/428852733 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99bc06f5d0 msgr2=0x7f99bc12ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.229+0000 7f99bbfff700 1 --2- 172.21.15.72:0/428852733 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99bc06f5d0 0x7f99bc12ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.229+0000 7f99bbfff700 1 -- 172.21.15.72:0/428852733 >> v1:172.21.15.72:6789/0 conn(0x7f99bc12cf60 legacy=0x7f99bc12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.229+0000 7f99ba7fc700 1 -- 172.21.15.72:0/428852733 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871515472 0 0) 0x7f99bc06fa40 con 0x7f99bc12cf60 2023-10-03T10:18:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.229+0000 7f99bbfff700 1 -- 172.21.15.72:0/428852733 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc071a40 con 0x7f99bc135c20 2023-10-03T10:18:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.229+0000 7f99bbfff700 1 --2- 172.21.15.72:0/428852733 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99bc135c20 0x7f99bc138000 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009dc0 tx=0x7f99b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24cdcd6ef39dd823 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.229+0000 7f99ba7fc700 1 -- 172.21.15.72:0/428852733 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b400e070 con 0x7f99bc135c20 2023-10-03T10:18:15.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.229+0000 7f99ba7fc700 1 -- 172.21.15.72:0/428852733 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b400bb20 con 0x7f99bc135c20 2023-10-03T10:18:15.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.229+0000 7f99ba7fc700 1 -- 172.21.15.72:0/428852733 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4012430 con 0x7f99bc135c20 2023-10-03T10:18:15.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.230+0000 7f99c1a6e700 1 -- 172.21.15.72:0/428852733 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99bc135c20 msgr2=0x7f99bc138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.230+0000 7f99c1a6e700 1 --2- 172.21.15.72:0/428852733 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99bc135c20 0x7f99bc138000 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009dc0 tx=0x7f99b400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:15.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.230+0000 7f99c1a6e700 1 -- 172.21.15.72:0/428852733 shutdown_connections 2023-10-03T10:18:15.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.230+0000 7f99c1a6e700 1 --2- 172.21.15.72:0/428852733 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99bc135c20 0x7f99bc138000 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.230+0000 7f99c1a6e700 1 --2- 172.21.15.72:0/428852733 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99bc06f5d0 0x7f99bc12ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.230+0000 7f99c1a6e700 1 -- 172.21.15.72:0/428852733 >> 172.21.15.72:0/428852733 conn(0x7f99bc0a2aa0 msgr2=0x7f99bc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.230+0000 7f99c1a6e700 1 -- 172.21.15.72:0/428852733 shutdown_connections 2023-10-03T10:18:15.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.230+0000 7f99c1a6e700 1 -- 172.21.15.72:0/428852733 wait complete. 2023-10-03T10:18:15.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.231+0000 7f99c1a6e700 1 Processor -- start 2023-10-03T10:18:15.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.231+0000 7f99c1a6e700 1 -- start start 2023-10-03T10:18:15.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99c1a6e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99bc06f5d0 0x7f99bc1c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99c1a6e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99bc12cf60 0x7f99bc1c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99c1a6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99bc135c20 0x7f99bc1c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99c1a6e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc129a40 con 0x7f99bc06f5d0 2023-10-03T10:18:15.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99c1a6e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc09e850 con 0x7f99bc135c20 2023-10-03T10:18:15.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99c1a6e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc09cda0 con 0x7f99bc12cf60 2023-10-03T10:18:15.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99bbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99bc135c20 0x7f99bc1c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99bbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99bc135c20 0x7f99bc1c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55670/0 (socket says 172.21.15.72:55670) 2023-10-03T10:18:15.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99bbfff700 1 -- 172.21.15.72:0/4207035632 learned_addr learned my addr 172.21.15.72:0/4207035632 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:15.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99bb7fe700 1 --2- 172.21.15.72:0/4207035632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99bc06f5d0 0x7f99bc1c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99baffd700 1 --2- 172.21.15.72:0/4207035632 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99bc12cf60 0x7f99bc1c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99bbfff700 1 -- 172.21.15.72:0/4207035632 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99bc12cf60 msgr2=0x7f99bc1c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99bbfff700 1 --2- 172.21.15.72:0/4207035632 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99bc12cf60 0x7f99bc1c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99bbfff700 1 -- 172.21.15.72:0/4207035632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99bc06f5d0 msgr2=0x7f99bc1c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99bbfff700 1 --2- 172.21.15.72:0/4207035632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99bc06f5d0 0x7f99bc1c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.232+0000 7f99bbfff700 1 -- 172.21.15.72:0/4207035632 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b4009a70 con 0x7f99bc135c20 2023-10-03T10:18:15.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.233+0000 7f99bbfff700 1 --2- 172.21.15.72:0/4207035632 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99bc135c20 0x7f99bc1c8c40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f99b4014040 tx=0x7f99b4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.233+0000 7f99a3fff700 1 -- 172.21.15.72:0/4207035632 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4027680 con 0x7f99bc135c20 2023-10-03T10:18:15.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.233+0000 7f99a3fff700 1 -- 172.21.15.72:0/4207035632 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b4020070 con 0x7f99bc135c20 2023-10-03T10:18:15.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.233+0000 7f99a3fff700 1 -- 172.21.15.72:0/4207035632 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b4027a40 con 0x7f99bc135c20 2023-10-03T10:18:15.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.233+0000 7f99c1a6e700 1 -- 172.21.15.72:0/4207035632 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc129fa0 con 0x7f99bc135c20 2023-10-03T10:18:15.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.233+0000 7f99c1a6e700 1 -- 172.21.15.72:0/4207035632 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc119140 con 0x7f99bc135c20 2023-10-03T10:18:15.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.234+0000 7f99c1a6e700 1 -- 172.21.15.72:0/4207035632 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc074ea0 con 0x7f99bc135c20 2023-10-03T10:18:15.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.234+0000 7f99a3fff700 1 -- 172.21.15.72:0/4207035632 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99b4027ba0 con 0x7f99bc135c20 2023-10-03T10:18:15.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.239+0000 7f99a3fff700 1 -- 172.21.15.72:0/4207035632 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f99b4022070 con 0x7f99bc135c20 2023-10-03T10:18:15.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.243+0000 7f99a3fff700 1 -- 172.21.15.72:0/4207035632 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99b4046060 con 0x7f99bc135c20 2023-10-03T10:18:15.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.274+0000 7fc7004ef700 1 Processor -- start 2023-10-03T10:18:15.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.274+0000 7fc7004ef700 1 -- start start 2023-10-03T10:18:15.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.274+0000 7ff4a7133700 1 Processor -- start 2023-10-03T10:18:15.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.274+0000 7ff4a7133700 1 -- start start 2023-10-03T10:18:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7fc7004ef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6f8066410 0x7fc6f806e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7fc7004ef700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6f806eb80 0x7fc6f806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7fc7004ef700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f8099b50 con 0x7fc6f812f320 2023-10-03T10:18:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7fc7004ef700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80667e0 con 0x7fc6f8066410 2023-10-03T10:18:15.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7fc7004ef700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f8099f60 con 0x7fc6f806eb80 2023-10-03T10:18:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7ff4a7133700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4a009d9f0 0x7ff4a0136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7ff4a7133700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4a0136a70 0x7ff4a0138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7ff4a7133700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a009e130 con 0x7ff4a01316c0 2023-10-03T10:18:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7ff4a7133700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a01321a0 con 0x7ff4a009d9f0 2023-10-03T10:18:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7ff4a7133700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a01312b0 con 0x7ff4a0136a70 2023-10-03T10:18:15.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7fc6fda8a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6f806eb80 0x7fc6f806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7fc6fda8a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6f806eb80 0x7fc6f806ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48242/0 (socket says 172.21.15.72:48242) 2023-10-03T10:18:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7fc6fda8a700 1 -- 172.21.15.72:0/570062509 learned_addr learned my addr 172.21.15.72:0/570062509 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7ff4a4ecf700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff4a01316c0 0x7ff4a0131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42368/0 (socket says 172.21.15.72:42368) 2023-10-03T10:18:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7ff4a4ecf700 1 -- 172.21.15.72:0/244226565 learned_addr learned my addr 172.21.15.72:0/244226565 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:15.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.275+0000 7ff4a56d0700 1 --2- 172.21.15.72:0/244226565 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4a0136a70 0x7ff4a0138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7fc6fe28b700 1 --2- 172.21.15.72:0/570062509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6f8066410 0x7fc6f806e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7fc6fd289700 1 -- 172.21.15.72:0/570062509 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023853993 0 0) 0x7fc6f8099b50 con 0x7fc6f812f320 2023-10-03T10:18:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7fc6fda8a700 1 -- 172.21.15.72:0/570062509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6f8066410 msgr2=0x7fc6f806e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7fc6fda8a700 1 --2- 172.21.15.72:0/570062509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6f8066410 0x7fc6f806e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7fc6fda8a700 1 -- 172.21.15.72:0/570062509 >> v1:172.21.15.72:6789/0 conn(0x7fc6f812f320 legacy=0x7fc6f812f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7fc6fda8a700 1 -- 172.21.15.72:0/570062509 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f809a920 con 0x7fc6f806eb80 2023-10-03T10:18:15.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7fc6fe28b700 1 --2- 172.21.15.72:0/570062509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6f8066410 0x7fc6f806e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:15.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7ff4a56d0700 1 -- 172.21.15.72:0/244226565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4a009d9f0 msgr2=0x7ff4a0136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7ff4a56d0700 1 --2- 172.21.15.72:0/244226565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4a009d9f0 0x7ff4a0136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7ff4a56d0700 1 -- 172.21.15.72:0/244226565 >> v1:172.21.15.72:6789/0 conn(0x7ff4a01316c0 legacy=0x7ff4a0131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7ff4a56d0700 1 -- 172.21.15.72:0/244226565 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a009f6e0 con 0x7ff4a0136a70 2023-10-03T10:18:15.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7fc6fda8a700 1 --2- 172.21.15.72:0/570062509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6f806eb80 0x7fc6f806ef70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009950 tx=0x7fc6e8009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7293acdcb0268b02 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7ff4a56d0700 1 --2- 172.21.15.72:0/244226565 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4a0136a70 0x7ff4a0138e50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff498009df0 tx=0x7ff49800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97e55d3dc7061546 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7ff49f7fe700 1 -- 172.21.15.72:0/244226565 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49800e070 con 0x7ff4a0136a70 2023-10-03T10:18:15.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7ff49f7fe700 1 -- 172.21.15.72:0/244226565 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49800bb90 con 0x7ff4a0136a70 2023-10-03T10:18:15.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7ff49f7fe700 1 -- 172.21.15.72:0/244226565 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff498012430 con 0x7ff4a0136a70 2023-10-03T10:18:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7fc6fd289700 1 -- 172.21.15.72:0/570062509 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8009ea0 con 0x7fc6f806eb80 2023-10-03T10:18:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7fc6fd289700 1 -- 172.21.15.72:0/570062509 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e800ba20 con 0x7fc6f806eb80 2023-10-03T10:18:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.276+0000 7fc6fd289700 1 -- 172.21.15.72:0/570062509 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e800bdb0 con 0x7fc6f806eb80 2023-10-03T10:18:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7ff4a7133700 1 -- 172.21.15.72:0/244226565 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4a0136a70 msgr2=0x7ff4a0138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7ff4a7133700 1 --2- 172.21.15.72:0/244226565 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4a0136a70 0x7ff4a0138e50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff498009df0 tx=0x7ff49800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:15.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7fc7004ef700 1 -- 172.21.15.72:0/570062509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6f806eb80 msgr2=0x7fc6f806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7fc7004ef700 1 --2- 172.21.15.72:0/570062509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6f806eb80 0x7fc6f806ef70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009950 tx=0x7fc6e8009c60 comp rx=0 tx=0).stop 2023-10-03T10:18:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7ff4a7133700 1 -- 172.21.15.72:0/244226565 shutdown_connections 2023-10-03T10:18:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7ff4a7133700 1 --2- 172.21.15.72:0/244226565 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4a0136a70 0x7ff4a0138e50 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7ff4a7133700 1 --2- 172.21.15.72:0/244226565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4a009d9f0 0x7ff4a0136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7ff4a7133700 1 -- 172.21.15.72:0/244226565 >> 172.21.15.72:0/244226565 conn(0x7ff4a0066f50 msgr2=0x7ff4a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7fc7004ef700 1 -- 172.21.15.72:0/570062509 shutdown_connections 2023-10-03T10:18:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7ff4a7133700 1 -- 172.21.15.72:0/244226565 shutdown_connections 2023-10-03T10:18:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7fc7004ef700 1 --2- 172.21.15.72:0/570062509 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6f8066410 0x7fc6f806e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7fc7004ef700 1 --2- 172.21.15.72:0/570062509 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6f806eb80 0x7fc6f806ef70 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7fc7004ef700 1 -- 172.21.15.72:0/570062509 >> 172.21.15.72:0/570062509 conn(0x7fc6f80a2aa0 msgr2=0x7fc6f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7ff4a7133700 1 -- 172.21.15.72:0/244226565 wait complete. 2023-10-03T10:18:15.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7fc7004ef700 1 -- 172.21.15.72:0/570062509 shutdown_connections 2023-10-03T10:18:15.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.277+0000 7fc7004ef700 1 -- 172.21.15.72:0/570062509 wait complete. 2023-10-03T10:18:15.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.278+0000 7ff4a7133700 1 Processor -- start 2023-10-03T10:18:15.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.279+0000 7fc7004ef700 1 Processor -- start 2023-10-03T10:18:15.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.279+0000 7ff4a7133700 1 -- start start 2023-10-03T10:18:15.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.279+0000 7fc7004ef700 1 -- start start 2023-10-03T10:18:15.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.279+0000 7fc7004ef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6f8066410 0x7fc6f8119860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.279+0000 7fc7004ef700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6f806eb80 0x7fc6f8119da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.279+0000 7fc7004ef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6f812f320 0x7fc6f811a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.279+0000 7fc7004ef700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f811d010 con 0x7fc6f812f320 2023-10-03T10:18:15.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.279+0000 7fc7004ef700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f811c2f0 con 0x7fc6f8066410 2023-10-03T10:18:15.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.279+0000 7fc7004ef700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80a1e70 con 0x7fc6f806eb80 2023-10-03T10:18:15.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.279+0000 7fc6fe28b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6f8066410 0x7fc6f8119860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.279+0000 7fc6fe28b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6f8066410 0x7fc6f8119860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55702/0 (socket says 172.21.15.72:55702) 2023-10-03T10:18:15.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.279+0000 7fc6fe28b700 1 -- 172.21.15.72:0/2589391801 learned_addr learned my addr 172.21.15.72:0/2589391801 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:15.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.279+0000 7ff4a7133700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4a009d9f0 0x7ff4a01c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.279+0000 7ff4a7133700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4a01316c0 0x7ff4a01c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.279+0000 7ff4a7133700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4a0136a70 0x7ff4a01c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7ff4a7133700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a012b900 con 0x7ff4a0136a70 2023-10-03T10:18:15.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7ff4a7133700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a006fb90 con 0x7ff4a009d9f0 2023-10-03T10:18:15.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7ff4a7133700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a0136110 con 0x7ff4a01316c0 2023-10-03T10:18:15.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7fc6fda8a700 1 --2- 172.21.15.72:0/2589391801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6f806eb80 0x7fc6f8119da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7fc6fea8c700 1 --2- 172.21.15.72:0/2589391801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6f812f320 0x7fc6f811a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7ff4a56d0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4a0136a70 0x7ff4a01c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7ff4a56d0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4a0136a70 0x7ff4a01c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57926/0 (socket says 172.21.15.72:57926) 2023-10-03T10:18:15.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7ff4a56d0700 1 -- 172.21.15.72:0/1673658573 learned_addr learned my addr 172.21.15.72:0/1673658573 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:15.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7fc6fe28b700 1 -- 172.21.15.72:0/2589391801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6f806eb80 msgr2=0x7fc6f8119da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7fc6fe28b700 1 --2- 172.21.15.72:0/2589391801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6f806eb80 0x7fc6f8119da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7fc6fe28b700 1 -- 172.21.15.72:0/2589391801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6f812f320 msgr2=0x7fc6f811a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7fc6fe28b700 1 --2- 172.21.15.72:0/2589391801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6f812f320 0x7fc6f811a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7fc6fe28b700 1 -- 172.21.15.72:0/2589391801 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e8009550 con 0x7fc6f8066410 2023-10-03T10:18:15.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7fc6fe28b700 1 --2- 172.21.15.72:0/2589391801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6f8066410 0x7fc6f8119860 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400c7f0 tx=0x7fc6f400cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7fc6eeffd700 1 -- 172.21.15.72:0/2589391801 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4011800 con 0x7fc6f8066410 2023-10-03T10:18:15.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7fc6eeffd700 1 -- 172.21.15.72:0/2589391801 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f4011960 con 0x7fc6f8066410 2023-10-03T10:18:15.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7fc6eeffd700 1 -- 172.21.15.72:0/2589391801 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4011d10 con 0x7fc6f8066410 2023-10-03T10:18:15.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7ff4a4ecf700 1 --2- 172.21.15.72:0/1673658573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4a009d9f0 0x7ff4a01c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.280+0000 7fc7004ef700 1 -- 172.21.15.72:0/2589391801 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f809a180 con 0x7fc6f8066410 2023-10-03T10:18:15.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.281+0000 7fc7004ef700 1 -- 172.21.15.72:0/2589391801 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f811d9f0 con 0x7fc6f8066410 2023-10-03T10:18:15.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.281+0000 7ff49ffff700 1 --2- 172.21.15.72:0/1673658573 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4a01316c0 0x7ff4a01c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.281+0000 7ff4a56d0700 1 -- 172.21.15.72:0/1673658573 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4a01316c0 msgr2=0x7ff4a01c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.281+0000 7ff4a56d0700 1 --2- 172.21.15.72:0/1673658573 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4a01316c0 0x7ff4a01c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.281+0000 7ff4a56d0700 1 -- 172.21.15.72:0/1673658573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4a009d9f0 msgr2=0x7ff4a01c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.281+0000 7ff4a56d0700 1 --2- 172.21.15.72:0/1673658573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4a009d9f0 0x7ff4a01c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.281+0000 7ff4a56d0700 1 -- 172.21.15.72:0/1673658573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498009a70 con 0x7ff4a0136a70 2023-10-03T10:18:15.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.281+0000 7ff4a56d0700 1 --2- 172.21.15.72:0/1673658573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4a0136a70 0x7ff4a01c6db0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7ff49800b370 tx=0x7ff498004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.282+0000 7ff49d7fa700 1 -- 172.21.15.72:0/1673658573 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4980046a0 con 0x7ff4a0136a70 2023-10-03T10:18:15.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.282+0000 7ff49d7fa700 1 -- 172.21.15.72:0/1673658573 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff498028070 con 0x7ff4a0136a70 2023-10-03T10:18:15.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.282+0000 7ff49d7fa700 1 -- 172.21.15.72:0/1673658573 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49802d430 con 0x7ff4a0136a70 2023-10-03T10:18:15.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.282+0000 7ff4a7133700 1 -- 172.21.15.72:0/1673658573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a006fe10 con 0x7ff4a0136a70 2023-10-03T10:18:15.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.282+0000 7fc6eeffd700 1 -- 172.21.15.72:0/2589391801 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6f4018360 con 0x7fc6f8066410 2023-10-03T10:18:15.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.282+0000 7fc7004ef700 1 -- 172.21.15.72:0/2589391801 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f804ea50 con 0x7fc6f8066410 2023-10-03T10:18:15.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.282+0000 7ff4a7133700 1 -- 172.21.15.72:0/1673658573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a0070ab0 con 0x7ff4a0136a70 2023-10-03T10:18:15.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.282+0000 7fc6eeffd700 1 -- 172.21.15.72:0/2589391801 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc6f403f620 con 0x7fc6f8066410 2023-10-03T10:18:15.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.283+0000 7ff4a7133700 1 -- 172.21.15.72:0/1673658573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a0074ea0 con 0x7ff4a0136a70 2023-10-03T10:18:15.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.284+0000 7ff49d7fa700 1 -- 172.21.15.72:0/1673658573 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff49802a030 con 0x7ff4a0136a70 2023-10-03T10:18:15.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.284+0000 7ff49d7fa700 1 -- 172.21.15.72:0/1673658573 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff49804a410 con 0x7ff4a0136a70 2023-10-03T10:18:15.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.288+0000 7ff49d7fa700 1 -- 172.21.15.72:0/1673658573 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff498036430 con 0x7ff4a0136a70 2023-10-03T10:18:15.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.291+0000 7fc6eeffd700 1 -- 172.21.15.72:0/2589391801 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6f400e2f0 con 0x7fc6f8066410 2023-10-03T10:18:15.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.314+0000 7eff8e9e7700 1 Processor -- start 2023-10-03T10:18:15.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.314+0000 7eff8e9e7700 1 -- start start 2023-10-03T10:18:15.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.314+0000 7eff8e9e7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff8806e570 0x7eff8806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.314+0000 7eff8e9e7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff8809eca0 0x7eff8806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.314+0000 7eff8e9e7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff88134610 0x7eff88134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.314+0000 7eff8e9e7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff88070ee0 con 0x7eff8809eca0 2023-10-03T10:18:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.314+0000 7eff8e9e7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff88071480 con 0x7eff88134610 2023-10-03T10:18:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.314+0000 7eff8e9e7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff8806f3c0 con 0x7eff8806e570 2023-10-03T10:18:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.314+0000 7eff87fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff8806e570 0x7eff8806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.314+0000 7eff877fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff8809eca0 0x7eff8806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.314+0000 7eff87fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff8806e570 0x7eff8806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48278/0 (socket says 172.21.15.72:48278) 2023-10-03T10:18:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.314+0000 7eff877fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff8809eca0 0x7eff8806ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:57928/0 (socket says 172.21.15.72:57928) 2023-10-03T10:18:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.314+0000 7eff87fff700 1 -- 172.21.15.72:0/4234000272 learned_addr learned my addr 172.21.15.72:0/4234000272 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.315+0000 7eff8cf84700 1 --2- 172.21.15.72:0/4234000272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff88134610 0x7eff88134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.315+0000 7eff877fe700 1 -- 172.21.15.72:0/4234000272 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff8806e570 msgr2=0x7eff8806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.315+0000 7eff877fe700 1 --2- 172.21.15.72:0/4234000272 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff8806e570 0x7eff8806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.315+0000 7eff877fe700 1 -- 172.21.15.72:0/4234000272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff88134610 msgr2=0x7eff88134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.315+0000 7eff877fe700 1 --2- 172.21.15.72:0/4234000272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff88134610 0x7eff88134a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.315+0000 7eff877fe700 1 -- 172.21.15.72:0/4234000272 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff88071b90 con 0x7eff8809eca0 2023-10-03T10:18:15.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.315+0000 7eff87fff700 1 --2- 172.21.15.72:0/4234000272 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff8806e570 0x7eff8806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.315+0000 7eff877fe700 1 --2- 172.21.15.72:0/4234000272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8809eca0 0x7eff8806ee80 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009840 tx=0x7eff7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee218543fceb7ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.315+0000 7eff86ffd700 1 -- 172.21.15.72:0/4234000272 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c011830 con 0x7eff8809eca0 2023-10-03T10:18:15.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.315+0000 7eff86ffd700 1 -- 172.21.15.72:0/4234000272 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c011990 con 0x7eff8809eca0 2023-10-03T10:18:15.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.315+0000 7eff86ffd700 1 -- 172.21.15.72:0/4234000272 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c011d20 con 0x7eff8809eca0 2023-10-03T10:18:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.316+0000 7eff8e9e7700 1 -- 172.21.15.72:0/4234000272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8809eca0 msgr2=0x7eff8806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.316+0000 7eff8e9e7700 1 --2- 172.21.15.72:0/4234000272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8809eca0 0x7eff8806ee80 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009840 tx=0x7eff7c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.316+0000 7eff8e9e7700 1 -- 172.21.15.72:0/4234000272 shutdown_connections 2023-10-03T10:18:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.316+0000 7eff8e9e7700 1 --2- 172.21.15.72:0/4234000272 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff88134610 0x7eff88134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.316+0000 7eff8e9e7700 1 --2- 172.21.15.72:0/4234000272 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff8806e570 0x7eff8806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.316+0000 7eff8e9e7700 1 --2- 172.21.15.72:0/4234000272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8809eca0 0x7eff8806ee80 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.316+0000 7eff8e9e7700 1 -- 172.21.15.72:0/4234000272 >> 172.21.15.72:0/4234000272 conn(0x7eff880a2aa0 msgr2=0x7eff880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.316+0000 7eff8e9e7700 1 -- 172.21.15.72:0/4234000272 shutdown_connections 2023-10-03T10:18:15.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.316+0000 7eff8e9e7700 1 -- 172.21.15.72:0/4234000272 wait complete. 2023-10-03T10:18:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.317+0000 7eff8e9e7700 1 Processor -- start 2023-10-03T10:18:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.317+0000 7eff8e9e7700 1 -- start start 2023-10-03T10:18:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.317+0000 7eff8e9e7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8806e570 0x7eff8809d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.317+0000 7eff8e9e7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff88134610 0x7eff88127500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.317+0000 7eff8e9e7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff8809be10 0x7eff8809c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.317+0000 7eff8e9e7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8809d1e0 con 0x7eff8806e570 2023-10-03T10:18:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.317+0000 7eff8e9e7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff881392d0 con 0x7eff88134610 2023-10-03T10:18:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.317+0000 7eff8e9e7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff88139d20 con 0x7eff8809be10 2023-10-03T10:18:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff877fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff88134610 0x7eff88127500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff8cf84700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff8809be10 0x7eff8809c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff8cf84700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff8809be10 0x7eff8809c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48284/0 (socket says 172.21.15.72:48284) 2023-10-03T10:18:15.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff877fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff88134610 0x7eff88127500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55722/0 (socket says 172.21.15.72:55722) 2023-10-03T10:18:15.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff8cf84700 1 -- 172.21.15.72:0/782410951 learned_addr learned my addr 172.21.15.72:0/782410951 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:15.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff87fff700 1 --2- 172.21.15.72:0/782410951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8806e570 0x7eff8809d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff8cf84700 1 -- 172.21.15.72:0/782410951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff88134610 msgr2=0x7eff88127500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff8cf84700 1 --2- 172.21.15.72:0/782410951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff88134610 0x7eff88127500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff8cf84700 1 -- 172.21.15.72:0/782410951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8806e570 msgr2=0x7eff8809d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff8cf84700 1 --2- 172.21.15.72:0/782410951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8806e570 0x7eff8809d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff8cf84700 1 -- 172.21.15.72:0/782410951 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff78009550 con 0x7eff8809be10 2023-10-03T10:18:15.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff8cf84700 1 --2- 172.21.15.72:0/782410951 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff8809be10 0x7eff8809c2b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7eff8000efc0 tx=0x7eff8000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff84ff9700 1 -- 172.21.15.72:0/782410951 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80009ea0 con 0x7eff8809be10 2023-10-03T10:18:15.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff84ff9700 1 -- 172.21.15.72:0/782410951 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8000f040 con 0x7eff8809be10 2023-10-03T10:18:15.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff8e9e7700 1 -- 172.21.15.72:0/782410951 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff7c0094a0 con 0x7eff8809be10 2023-10-03T10:18:15.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.318+0000 7eff8e9e7700 1 -- 172.21.15.72:0/782410951 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff881395b0 con 0x7eff8809be10 2023-10-03T10:18:15.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.319+0000 7eff84ff9700 1 -- 172.21.15.72:0/782410951 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80014480 con 0x7eff8809be10 2023-10-03T10:18:15.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.320+0000 7eff84ff9700 1 -- 172.21.15.72:0/782410951 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff800145e0 con 0x7eff8809be10 2023-10-03T10:18:15.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.320+0000 7eff8e9e7700 1 -- 172.21.15.72:0/782410951 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff680052e0 con 0x7eff8809be10 2023-10-03T10:18:15.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.320+0000 7eff84ff9700 1 -- 172.21.15.72:0/782410951 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7eff8003fe90 con 0x7eff8809be10 2023-10-03T10:18:15.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.325+0000 7eff84ff9700 1 -- 172.21.15.72:0/782410951 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff80018070 con 0x7eff8809be10 2023-10-03T10:18:15.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.445+0000 7f99c1a6e700 1 -- 172.21.15.72:0/4207035632 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f99bc0713a0 con 0x7f99bc135c20 2023-10-03T10:18:15.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.445+0000 7f99a3fff700 1 -- 172.21.15.72:0/4207035632 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99b402c020 con 0x7f99bc135c20 2023-10-03T10:18:15.445 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:15.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.448+0000 7f99c1a6e700 1 -- 172.21.15.72:0/4207035632 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99bc135c20 msgr2=0x7f99bc1c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.448+0000 7f99c1a6e700 1 --2- 172.21.15.72:0/4207035632 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99bc135c20 0x7f99bc1c8c40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f99b4014040 tx=0x7f99b4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.448+0000 7f99c1a6e700 1 -- 172.21.15.72:0/4207035632 shutdown_connections 2023-10-03T10:18:15.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.448+0000 7f99c1a6e700 1 --2- 172.21.15.72:0/4207035632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99bc06f5d0 0x7f99bc1c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.448+0000 7f99c1a6e700 1 --2- 172.21.15.72:0/4207035632 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f99bc135c20 0x7f99bc1c8c40 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.448+0000 7f99c1a6e700 1 --2- 172.21.15.72:0/4207035632 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f99bc12cf60 0x7f99bc1c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.448+0000 7f99c1a6e700 1 -- 172.21.15.72:0/4207035632 >> 172.21.15.72:0/4207035632 conn(0x7f99bc0a2aa0 msgr2=0x7f99bc06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.448+0000 7f99c1a6e700 1 -- 172.21.15.72:0/4207035632 shutdown_connections 2023-10-03T10:18:15.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.448+0000 7f99c1a6e700 1 -- 172.21.15.72:0/4207035632 wait complete. 2023-10-03T10:18:15.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:15.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.483+0000 7ff4a7133700 1 -- 172.21.15.72:0/1673658573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff4a009e980 con 0x7ff4a0136a70 2023-10-03T10:18:15.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.483+0000 7ff49d7fa700 1 -- 172.21.15.72:0/1673658573 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff49802c3d0 con 0x7ff4a0136a70 2023-10-03T10:18:15.483 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:15.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.485+0000 7ff4a7133700 1 -- 172.21.15.72:0/1673658573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4a0136a70 msgr2=0x7ff4a01c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.485+0000 7ff4a7133700 1 --2- 172.21.15.72:0/1673658573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4a0136a70 0x7ff4a01c6db0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7ff49800b370 tx=0x7ff498004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.485+0000 7ff4a7133700 1 -- 172.21.15.72:0/1673658573 shutdown_connections 2023-10-03T10:18:15.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.485+0000 7ff4a7133700 1 --2- 172.21.15.72:0/1673658573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4a0136a70 0x7ff4a01c6db0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.485+0000 7ff4a7133700 1 --2- 172.21.15.72:0/1673658573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4a009d9f0 0x7ff4a01c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.485+0000 7ff4a7133700 1 --2- 172.21.15.72:0/1673658573 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff4a01316c0 0x7ff4a01c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.485+0000 7ff4a7133700 1 -- 172.21.15.72:0/1673658573 >> 172.21.15.72:0/1673658573 conn(0x7ff4a0066f50 msgr2=0x7ff4a00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.485+0000 7ff4a7133700 1 -- 172.21.15.72:0/1673658573 shutdown_connections 2023-10-03T10:18:15.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.485+0000 7ff4a7133700 1 -- 172.21.15.72:0/1673658573 wait complete. 2023-10-03T10:18:15.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.489+0000 7fc7004ef700 1 -- 172.21.15.72:0/2589391801 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc6f812ecc0 con 0x7fc6f8066410 2023-10-03T10:18:15.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.489+0000 7fc6eeffd700 1 -- 172.21.15.72:0/2589391801 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc6f401f030 con 0x7fc6f8066410 2023-10-03T10:18:15.489 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.492+0000 7fc7004ef700 1 -- 172.21.15.72:0/2589391801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6f8066410 msgr2=0x7fc6f8119860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.492+0000 7fc7004ef700 1 --2- 172.21.15.72:0/2589391801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6f8066410 0x7fc6f8119860 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400c7f0 tx=0x7fc6f400cb00 comp rx=0 tx=0).stop 2023-10-03T10:18:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.492+0000 7fc7004ef700 1 -- 172.21.15.72:0/2589391801 shutdown_connections 2023-10-03T10:18:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.492+0000 7fc7004ef700 1 --2- 172.21.15.72:0/2589391801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6f812f320 0x7fc6f811a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.492+0000 7fc7004ef700 1 --2- 172.21.15.72:0/2589391801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6f8066410 0x7fc6f8119860 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.492+0000 7fc7004ef700 1 --2- 172.21.15.72:0/2589391801 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc6f806eb80 0x7fc6f8119da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.492+0000 7fc7004ef700 1 -- 172.21.15.72:0/2589391801 >> 172.21.15.72:0/2589391801 conn(0x7fc6f80a2aa0 msgr2=0x7fc6f8130210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.492+0000 7fc7004ef700 1 -- 172.21.15.72:0/2589391801 shutdown_connections 2023-10-03T10:18:15.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.492+0000 7fc7004ef700 1 -- 172.21.15.72:0/2589391801 wait complete. 2023-10-03T10:18:15.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:15.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:15.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.528+0000 7eff8e9e7700 1 -- 172.21.15.72:0/782410951 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7eff68005590 con 0x7eff8809be10 2023-10-03T10:18:15.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.528+0000 7eff84ff9700 1 -- 172.21.15.72:0/782410951 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff8001a4a0 con 0x7eff8809be10 2023-10-03T10:18:15.528 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:15.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.530+0000 7eff8e9e7700 1 -- 172.21.15.72:0/782410951 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff8809be10 msgr2=0x7eff8809c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.530+0000 7eff8e9e7700 1 --2- 172.21.15.72:0/782410951 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff8809be10 0x7eff8809c2b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7eff8000efc0 tx=0x7eff8000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.531+0000 7eff8e9e7700 1 -- 172.21.15.72:0/782410951 shutdown_connections 2023-10-03T10:18:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.531+0000 7eff8e9e7700 1 --2- 172.21.15.72:0/782410951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8806e570 0x7eff8809d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.531+0000 7eff8e9e7700 1 --2- 172.21.15.72:0/782410951 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7eff8809be10 0x7eff8809c2b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.531+0000 7eff8e9e7700 1 --2- 172.21.15.72:0/782410951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff88134610 0x7eff88127500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.531+0000 7eff8e9e7700 1 -- 172.21.15.72:0/782410951 >> 172.21.15.72:0/782410951 conn(0x7eff880a2aa0 msgr2=0x7eff88136670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.531+0000 7eff8e9e7700 1 -- 172.21.15.72:0/782410951 shutdown_connections 2023-10-03T10:18:15.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:15.531+0000 7eff8e9e7700 1 -- 172.21.15.72:0/782410951 wait complete. 2023-10-03T10:18:15.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:16.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:16.499 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:16.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:16.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:16.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.607+0000 7f7d9e017700 1 Processor -- start 2023-10-03T10:18:16.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.608+0000 7f7d9e017700 1 -- start start 2023-10-03T10:18:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.608+0000 7f7d9e017700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d9806e570 0x7f7d9806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.608+0000 7f7d9e017700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7d9806ee80 0x7f7d98134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.608+0000 7f7d9e017700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d98070ee0 con 0x7f7d9809eca0 2023-10-03T10:18:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.608+0000 7f7d9e017700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d98071480 con 0x7f7d9806ee80 2023-10-03T10:18:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.608+0000 7f7d9e017700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98071b90 con 0x7f7d9806e570 2023-10-03T10:18:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.608+0000 7f7d977fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d9806e570 0x7f7d9806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.608+0000 7f7d977fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d9806e570 0x7f7d9806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55734/0 (socket says 172.21.15.72:55734) 2023-10-03T10:18:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.608+0000 7f7d977fe700 1 -- 172.21.15.72:0/1653066057 learned_addr learned my addr 172.21.15.72:0/1653066057 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.608+0000 7f7d97fff700 1 --2- 172.21.15.72:0/1653066057 >> v2:172.21.15.72:3300/0 conn(0x7f7d9806ee80 0x7f7d98134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.609+0000 7f7d977fe700 1 -- 172.21.15.72:0/1653066057 >> v2:172.21.15.72:3300/0 conn(0x7f7d9806ee80 msgr2=0x7f7d98134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.609+0000 7f7d977fe700 1 --2- 172.21.15.72:0/1653066057 >> v2:172.21.15.72:3300/0 conn(0x7f7d9806ee80 0x7f7d98134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.609+0000 7f7d977fe700 1 -- 172.21.15.72:0/1653066057 >> v1:172.21.15.72:6789/0 conn(0x7f7d9809eca0 legacy=0x7f7d98134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.609+0000 7f7d967fc700 1 -- 172.21.15.72:0/1653066057 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599981500 0 0) 0x7f7d98070ee0 con 0x7f7d9809eca0 2023-10-03T10:18:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.609+0000 7f7d977fe700 1 -- 172.21.15.72:0/1653066057 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d980711a0 con 0x7f7d9806e570 2023-10-03T10:18:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.609+0000 7f7d97fff700 1 --2- 172.21.15.72:0/1653066057 >> v2:172.21.15.72:3300/0 conn(0x7f7d9806ee80 0x7f7d98134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.609+0000 7f7d977fe700 1 --2- 172.21.15.72:0/1653066057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d9806e570 0x7f7d9806e940 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7d880098f0 tx=0x7f7d88009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b68ee1b3e2f61e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.609+0000 7f7d967fc700 1 -- 172.21.15.72:0/1653066057 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8800b8a0 con 0x7f7d9806e570 2023-10-03T10:18:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.609+0000 7f7d967fc700 1 -- 172.21.15.72:0/1653066057 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8800ba00 con 0x7f7d9806e570 2023-10-03T10:18:16.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.609+0000 7f7d967fc700 1 -- 172.21.15.72:0/1653066057 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8800bd90 con 0x7f7d9806e570 2023-10-03T10:18:16.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.610+0000 7f7d9e017700 1 -- 172.21.15.72:0/1653066057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d9806e570 msgr2=0x7f7d9806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.610+0000 7f7d9e017700 1 --2- 172.21.15.72:0/1653066057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d9806e570 0x7f7d9806e940 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7d880098f0 tx=0x7f7d88009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.610+0000 7f7d9e017700 1 -- 172.21.15.72:0/1653066057 shutdown_connections 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.610+0000 7f7d9e017700 1 --2- 172.21.15.72:0/1653066057 >> v2:172.21.15.72:3300/0 conn(0x7f7d9806ee80 0x7f7d98134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.610+0000 7f7d9e017700 1 --2- 172.21.15.72:0/1653066057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d9806e570 0x7f7d9806e940 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.610+0000 7f7d9e017700 1 -- 172.21.15.72:0/1653066057 >> 172.21.15.72:0/1653066057 conn(0x7f7d980a2aa0 msgr2=0x7f7d980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.610+0000 7f7d9e017700 1 -- 172.21.15.72:0/1653066057 shutdown_connections 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.610+0000 7f7d9e017700 1 -- 172.21.15.72:0/1653066057 wait complete. 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.611+0000 7f7d9e017700 1 Processor -- start 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.611+0000 7f7d9e017700 1 -- start start 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d9e017700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d9806ee80 0x7f7d98140270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d9e017700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d9813b290 0x7f7d9813b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d9e017700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d9813bc00 0x7f7d98133e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d9e017700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9813fa20 con 0x7f7d9813bc00 2023-10-03T10:18:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d9e017700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9813d700 con 0x7f7d9813b290 2023-10-03T10:18:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d9e017700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9813edb0 con 0x7f7d9806ee80 2023-10-03T10:18:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d977fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d9806ee80 0x7f7d98140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d977fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d9806ee80 0x7f7d98140270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48286/0 (socket says 172.21.15.72:48286) 2023-10-03T10:18:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d977fe700 1 -- 172.21.15.72:0/2357824342 learned_addr learned my addr 172.21.15.72:0/2357824342 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d96ffd700 1 --2- 172.21.15.72:0/2357824342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d9813b290 0x7f7d9813b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d97fff700 1 --2- 172.21.15.72:0/2357824342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d9813bc00 0x7f7d98133e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d977fe700 1 -- 172.21.15.72:0/2357824342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d9813b290 msgr2=0x7f7d9813b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d977fe700 1 --2- 172.21.15.72:0/2357824342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d9813b290 0x7f7d9813b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d977fe700 1 -- 172.21.15.72:0/2357824342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d9813bc00 msgr2=0x7f7d98133e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d977fe700 1 --2- 172.21.15.72:0/2357824342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d9813bc00 0x7f7d98133e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d977fe700 1 -- 172.21.15.72:0/2357824342 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d88009550 con 0x7f7d9806ee80 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.612+0000 7f7d97fff700 1 --2- 172.21.15.72:0/2357824342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d9813bc00 0x7f7d98133e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.613+0000 7f7d977fe700 1 --2- 172.21.15.72:0/2357824342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d9806ee80 0x7f7d98140270 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7d88013000 tx=0x7f7d88004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.613+0000 7f7d7ffff700 1 -- 172.21.15.72:0/2357824342 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88004240 con 0x7f7d9806ee80 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.613+0000 7f7d7ffff700 1 -- 172.21.15.72:0/2357824342 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8801f070 con 0x7f7d9806ee80 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.613+0000 7f7d9e017700 1 -- 172.21.15.72:0/2357824342 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d98135970 con 0x7f7d9806ee80 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.613+0000 7f7d7ffff700 1 -- 172.21.15.72:0/2357824342 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d880045c0 con 0x7f7d9806ee80 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.613+0000 7f7d9e017700 1 -- 172.21.15.72:0/2357824342 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9813e540 con 0x7f7d9806ee80 2023-10-03T10:18:16.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.614+0000 7f7d7ffff700 1 -- 172.21.15.72:0/2357824342 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d88021030 con 0x7f7d9806ee80 2023-10-03T10:18:16.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.614+0000 7f7d9e017700 1 -- 172.21.15.72:0/2357824342 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9813e930 con 0x7f7d9806ee80 2023-10-03T10:18:16.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.614+0000 7f7d7ffff700 1 -- 172.21.15.72:0/2357824342 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d880408b0 con 0x7f7d9806ee80 2023-10-03T10:18:16.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.619+0000 7f7d7ffff700 1 -- 172.21.15.72:0/2357824342 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d9813e930 con 0x7f7d9806ee80 2023-10-03T10:18:16.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.648+0000 7ffa8da5e700 1 Processor -- start 2023-10-03T10:18:16.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.648+0000 7ffa8da5e700 1 -- start start 2023-10-03T10:18:16.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.648+0000 7ffa8da5e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa880a1510 0x7ffa88138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.648+0000 7ffa8da5e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa88139250 0x7ffa8813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.648+0000 7ffa8da5e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8809edd0 con 0x7ffa880a0a30 2023-10-03T10:18:16.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.648+0000 7ffa8da5e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa880a18e0 con 0x7ffa88139250 2023-10-03T10:18:16.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.648+0000 7ffa8da5e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8809e1f0 con 0x7ffa880a1510 2023-10-03T10:18:16.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.648+0000 7ffa867fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa880a1510 0x7ffa88138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.648+0000 7ffa867fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa880a1510 0x7ffa88138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48296/0 (socket says 172.21.15.72:48296) 2023-10-03T10:18:16.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.648+0000 7ffa867fc700 1 -- 172.21.15.72:0/3427424672 learned_addr learned my addr 172.21.15.72:0/3427424672 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:16.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.648+0000 7ffa877fe700 1 --2- 172.21.15.72:0/3427424672 >> v2:172.21.15.72:3300/0 conn(0x7ffa88139250 0x7ffa8813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.649+0000 7ffa867fc700 1 -- 172.21.15.72:0/3427424672 >> v2:172.21.15.72:3300/0 conn(0x7ffa88139250 msgr2=0x7ffa8813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.649+0000 7ffa867fc700 1 --2- 172.21.15.72:0/3427424672 >> v2:172.21.15.72:3300/0 conn(0x7ffa88139250 0x7ffa8813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.649+0000 7ffa867fc700 1 -- 172.21.15.72:0/3427424672 >> v1:172.21.15.72:6789/0 conn(0x7ffa880a0a30 legacy=0x7ffa880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.649+0000 7ffa867fc700 1 -- 172.21.15.72:0/3427424672 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8809dc50 con 0x7ffa880a1510 2023-10-03T10:18:16.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.649+0000 7ffa867fc700 1 --2- 172.21.15.72:0/3427424672 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa880a1510 0x7ffa88138d10 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009920 tx=0x7ffa7c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84fa3350f8979c5c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.649+0000 7ffa85ffb700 1 -- 172.21.15.72:0/3427424672 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c011830 con 0x7ffa880a1510 2023-10-03T10:18:16.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.649+0000 7ffa85ffb700 1 -- 172.21.15.72:0/3427424672 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c011990 con 0x7ffa880a1510 2023-10-03T10:18:16.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.649+0000 7ffa85ffb700 1 -- 172.21.15.72:0/3427424672 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c011d20 con 0x7ffa880a1510 2023-10-03T10:18:16.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.650+0000 7ffa8da5e700 1 -- 172.21.15.72:0/3427424672 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa880a1510 msgr2=0x7ffa88138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.650+0000 7ffa8da5e700 1 --2- 172.21.15.72:0/3427424672 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa880a1510 0x7ffa88138d10 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009920 tx=0x7ffa7c009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:16.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.650+0000 7ffa8da5e700 1 -- 172.21.15.72:0/3427424672 shutdown_connections 2023-10-03T10:18:16.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.650+0000 7ffa8da5e700 1 --2- 172.21.15.72:0/3427424672 >> v2:172.21.15.72:3300/0 conn(0x7ffa88139250 0x7ffa8813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.650+0000 7ffa8da5e700 1 --2- 172.21.15.72:0/3427424672 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa880a1510 0x7ffa88138d10 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.650+0000 7ffa8da5e700 1 -- 172.21.15.72:0/3427424672 >> 172.21.15.72:0/3427424672 conn(0x7ffa880a6550 msgr2=0x7ffa880a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.650+0000 7ffa8da5e700 1 -- 172.21.15.72:0/3427424672 shutdown_connections 2023-10-03T10:18:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.650+0000 7ffa8da5e700 1 -- 172.21.15.72:0/3427424672 wait complete. 2023-10-03T10:18:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.651+0000 7ffa8da5e700 1 Processor -- start 2023-10-03T10:18:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.651+0000 7ffa8da5e700 1 -- start start 2023-10-03T10:18:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.651+0000 7ffa8da5e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa880a0a30 0x7ffa881218c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.651+0000 7ffa8da5e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa880a1510 0x7ffa88121e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.651+0000 7ffa8da5e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa88139250 0x7ffa88122340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.651+0000 7ffa8da5e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa881236c0 con 0x7ffa880a0a30 2023-10-03T10:18:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.651+0000 7ffa8da5e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa881234d0 con 0x7ffa88139250 2023-10-03T10:18:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.651+0000 7ffa8da5e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa881253e0 con 0x7ffa880a1510 2023-10-03T10:18:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.652+0000 7ffa867fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa880a1510 0x7ffa88121e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.652+0000 7ffa867fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa880a1510 0x7ffa88121e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48306/0 (socket says 172.21.15.72:48306) 2023-10-03T10:18:16.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.652+0000 7ffa867fc700 1 -- 172.21.15.72:0/2687975750 learned_addr learned my addr 172.21.15.72:0/2687975750 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.652+0000 7ffa877fe700 1 --2- 172.21.15.72:0/2687975750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa88139250 0x7ffa88122340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.652+0000 7f05a1267700 1 Processor -- start 2023-10-03T10:18:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.652+0000 7ffa86ffd700 1 --2- 172.21.15.72:0/2687975750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa880a0a30 0x7ffa881218c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.652+0000 7ffa867fc700 1 -- 172.21.15.72:0/2687975750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa88139250 msgr2=0x7ffa88122340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.652+0000 7ffa867fc700 1 --2- 172.21.15.72:0/2687975750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa88139250 0x7ffa88122340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.652+0000 7ffa867fc700 1 -- 172.21.15.72:0/2687975750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa880a0a30 msgr2=0x7ffa881218c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.652+0000 7ffa867fc700 1 --2- 172.21.15.72:0/2687975750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa880a0a30 0x7ffa881218c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.652+0000 7ffa867fc700 1 -- 172.21.15.72:0/2687975750 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c009550 con 0x7ffa880a1510 2023-10-03T10:18:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.652+0000 7ffa877fe700 1 --2- 172.21.15.72:0/2687975750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa88139250 0x7ffa88122340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.652+0000 7ffa867fc700 1 --2- 172.21.15.72:0/2687975750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa880a1510 0x7ffa88121e00 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0098f0 tx=0x7ffa7c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.652+0000 7f05a1267700 1 -- start start 2023-10-03T10:18:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.652+0000 7ffa6ffff700 1 -- 172.21.15.72:0/2687975750 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c004240 con 0x7ffa880a1510 2023-10-03T10:18:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7ffa6ffff700 1 -- 172.21.15.72:0/2687975750 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c027070 con 0x7ffa880a1510 2023-10-03T10:18:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7ffa6ffff700 1 -- 172.21.15.72:0/2687975750 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c0036a0 con 0x7ffa880a1510 2023-10-03T10:18:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7ffa8da5e700 1 -- 172.21.15.72:0/2687975750 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa88138bd0 con 0x7ffa880a1510 2023-10-03T10:18:16.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7ffa8da5e700 1 -- 172.21.15.72:0/2687975750 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa88123cc0 con 0x7ffa880a1510 2023-10-03T10:18:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7f05a1267700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f059c130660 0x7f059c130a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7f05a1267700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f059c130f70 0x7f059c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7f05a1267700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c09f130 con 0x7f059c06acb0 2023-10-03T10:18:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7f05a1267700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c09f520 con 0x7f059c130660 2023-10-03T10:18:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7f05a1267700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c133900 con 0x7f059c130f70 2023-10-03T10:18:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7f059a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f059c130f70 0x7f059c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7f059a7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f059c130f70 0x7f059c06a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55744/0 (socket says 172.21.15.72:55744) 2023-10-03T10:18:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7f059a7fc700 1 -- 172.21.15.72:0/2099105030 learned_addr learned my addr 172.21.15.72:0/2099105030 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:16.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7f059a7fc700 1 -- 172.21.15.72:0/2099105030 >> v2:172.21.15.72:3300/0 conn(0x7f059c130660 msgr2=0x7f059c130a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7f059a7fc700 1 --2- 172.21.15.72:0/2099105030 >> v2:172.21.15.72:3300/0 conn(0x7f059c130660 0x7f059c130a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7f059a7fc700 1 -- 172.21.15.72:0/2099105030 >> v1:172.21.15.72:6789/0 conn(0x7f059c06acb0 legacy=0x7f059c06b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7f059a7fc700 1 -- 172.21.15.72:0/2099105030 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c09e700 con 0x7f059c130f70 2023-10-03T10:18:16.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.653+0000 7f059a7fc700 1 --2- 172.21.15.72:0/2099105030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f059c130f70 0x7f059c06a770 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f05940098f0 tx=0x7f0594009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d955313fead76beb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.654+0000 7ffa6ffff700 1 -- 172.21.15.72:0/2687975750 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa7c029030 con 0x7ffa880a1510 2023-10-03T10:18:16.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.654+0000 7f0599ffb700 1 -- 172.21.15.72:0/2099105030 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594004030 con 0x7f059c130f70 2023-10-03T10:18:16.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.654+0000 7f0599ffb700 1 -- 172.21.15.72:0/2099105030 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0594004190 con 0x7f059c130f70 2023-10-03T10:18:16.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.654+0000 7f0599ffb700 1 -- 172.21.15.72:0/2099105030 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594004520 con 0x7f059c130f70 2023-10-03T10:18:16.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.654+0000 7ffa8da5e700 1 -- 172.21.15.72:0/2687975750 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa88074ea0 con 0x7ffa880a1510 2023-10-03T10:18:16.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.654+0000 7ffa6ffff700 1 -- 172.21.15.72:0/2687975750 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffa7c0495e0 con 0x7ffa880a1510 2023-10-03T10:18:16.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.655+0000 7f05a1267700 1 -- 172.21.15.72:0/2099105030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f059c130f70 msgr2=0x7f059c06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.655+0000 7f05a1267700 1 --2- 172.21.15.72:0/2099105030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f059c130f70 0x7f059c06a770 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f05940098f0 tx=0x7f0594009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:16.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.655+0000 7f05a1267700 1 -- 172.21.15.72:0/2099105030 shutdown_connections 2023-10-03T10:18:16.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.655+0000 7f05a1267700 1 --2- 172.21.15.72:0/2099105030 >> v2:172.21.15.72:3300/0 conn(0x7f059c130660 0x7f059c130a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.655+0000 7f05a1267700 1 --2- 172.21.15.72:0/2099105030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f059c130f70 0x7f059c06a770 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.655+0000 7f05a1267700 1 -- 172.21.15.72:0/2099105030 >> 172.21.15.72:0/2099105030 conn(0x7f059c066f50 msgr2=0x7f059c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.655+0000 7f05a1267700 1 -- 172.21.15.72:0/2099105030 shutdown_connections 2023-10-03T10:18:16.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.655+0000 7f05a1267700 1 -- 172.21.15.72:0/2099105030 wait complete. 2023-10-03T10:18:16.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.656+0000 7f05a1267700 1 Processor -- start 2023-10-03T10:18:16.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.656+0000 7f05a1267700 1 -- start start 2023-10-03T10:18:16.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.657+0000 7f05a1267700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f059c06acb0 0x7f059c1c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.657+0000 7f05a1267700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f059c130660 0x7f059c1c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.657+0000 7f05a1267700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f059c130f70 0x7f059c119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.657+0000 7f05a1267700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c11c4d0 con 0x7f059c06acb0 2023-10-03T10:18:16.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.657+0000 7f05a1267700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c11c6b0 con 0x7f059c130f70 2023-10-03T10:18:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.657+0000 7f05a1267700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f059c1c3f00 con 0x7f059c130660 2023-10-03T10:18:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.657+0000 7f059b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f059c130f70 0x7f059c119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.657+0000 7f059b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f059c130f70 0x7f059c119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55752/0 (socket says 172.21.15.72:55752) 2023-10-03T10:18:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.657+0000 7f059b7fe700 1 -- 172.21.15.72:0/2106107985 learned_addr learned my addr 172.21.15.72:0/2106107985 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.657+0000 7f059affd700 1 --2- 172.21.15.72:0/2106107985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f059c06acb0 0x7f059c1c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.657+0000 7f059a7fc700 1 --2- 172.21.15.72:0/2106107985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f059c130660 0x7f059c1c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.658+0000 7f059b7fe700 1 -- 172.21.15.72:0/2106107985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f059c130660 msgr2=0x7f059c1c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.658+0000 7f059b7fe700 1 --2- 172.21.15.72:0/2106107985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f059c130660 0x7f059c1c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.658+0000 7f059b7fe700 1 -- 172.21.15.72:0/2106107985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f059c06acb0 msgr2=0x7f059c1c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.658+0000 7f059b7fe700 1 --2- 172.21.15.72:0/2106107985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f059c06acb0 0x7f059c1c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.658+0000 7f059b7fe700 1 -- 172.21.15.72:0/2106107985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0594009550 con 0x7f059c130f70 2023-10-03T10:18:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.658+0000 7f059a7fc700 1 --2- 172.21.15.72:0/2106107985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f059c130660 0x7f059c1c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.658+0000 7f059b7fe700 1 --2- 172.21.15.72:0/2106107985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f059c130f70 0x7f059c119480 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f058c00b9f0 tx=0x7f058c00bd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.658+0000 7f05837fe700 1 -- 172.21.15.72:0/2106107985 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c00d8e0 con 0x7f059c130f70 2023-10-03T10:18:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.658+0000 7f05837fe700 1 -- 172.21.15.72:0/2106107985 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c00da40 con 0x7f059c130f70 2023-10-03T10:18:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.658+0000 7f05a1267700 1 -- 172.21.15.72:0/2106107985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c09c700 con 0x7f059c130f70 2023-10-03T10:18:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.658+0000 7f05837fe700 1 -- 172.21.15.72:0/2106107985 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c00ddd0 con 0x7f059c130f70 2023-10-03T10:18:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.658+0000 7f05a1267700 1 -- 172.21.15.72:0/2106107985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c1c4dd0 con 0x7f059c130f70 2023-10-03T10:18:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.659+0000 7f05a1267700 1 -- 172.21.15.72:0/2106107985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c074ea0 con 0x7f059c130f70 2023-10-03T10:18:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.660+0000 7f05837fe700 1 -- 172.21.15.72:0/2106107985 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f058c006d50 con 0x7f059c130f70 2023-10-03T10:18:16.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.660+0000 7ffa6ffff700 1 -- 172.21.15.72:0/2687975750 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa7c00b9d0 con 0x7ffa880a1510 2023-10-03T10:18:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.667+0000 7f05837fe700 1 -- 172.21.15.72:0/2106107985 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f058c041020 con 0x7f059c130f70 2023-10-03T10:18:16.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.669+0000 7f05837fe700 1 -- 172.21.15.72:0/2106107985 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f058c074750 con 0x7f059c130f70 2023-10-03T10:18:16.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.692+0000 7ffab8f1b700 1 Processor -- start 2023-10-03T10:18:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.693+0000 7ffab8f1b700 1 -- start start 2023-10-03T10:18:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.693+0000 7ffab8f1b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab409d6f0 0x7ffab409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.693+0000 7ffab8f1b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab409e000 0x7ffab4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.693+0000 7ffab8f1b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffab409e410 0x7ffab4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.693+0000 7ffab8f1b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab409f520 con 0x7ffab409e410 2023-10-03T10:18:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.693+0000 7ffab8f1b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab409f130 con 0x7ffab409e000 2023-10-03T10:18:16.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.693+0000 7ffab8f1b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffab409e930 con 0x7ffab409d6f0 2023-10-03T10:18:16.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.693+0000 7ffab259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab409d6f0 0x7ffab409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.693+0000 7ffab1d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab409e000 0x7ffab4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.693+0000 7ffab2d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffab409e410 0x7ffab4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.693+0000 7ffab259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab409d6f0 0x7ffab409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48324/0 (socket says 172.21.15.72:48324) 2023-10-03T10:18:16.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.694+0000 7ffab259c700 1 -- 172.21.15.72:0/2383125735 learned_addr learned my addr 172.21.15.72:0/2383125735 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:16.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.694+0000 7ffab2d9d700 1 -- 172.21.15.72:0/2383125735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab409d6f0 msgr2=0x7ffab409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.694+0000 7ffab2d9d700 1 --2- 172.21.15.72:0/2383125735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab409d6f0 0x7ffab409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.694+0000 7ffab2d9d700 1 -- 172.21.15.72:0/2383125735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab409e000 msgr2=0x7ffab4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.694+0000 7ffab2d9d700 1 --2- 172.21.15.72:0/2383125735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab409e000 0x7ffab4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.694+0000 7ffab2d9d700 1 -- 172.21.15.72:0/2383125735 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab409b2d0 con 0x7ffab409e410 2023-10-03T10:18:16.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.694+0000 7ffab2d9d700 1 --2- 172.21.15.72:0/2383125735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab409e410 0x7ffab4130ba0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009d90 tx=0x7ffaac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835b63733c50ea86 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.694+0000 7ffab159a700 1 -- 172.21.15.72:0/2383125735 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac00e070 con 0x7ffab409e410 2023-10-03T10:18:16.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.694+0000 7ffab159a700 1 -- 172.21.15.72:0/2383125735 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac00bb20 con 0x7ffab409e410 2023-10-03T10:18:16.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.694+0000 7ffab159a700 1 -- 172.21.15.72:0/2383125735 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac012430 con 0x7ffab409e410 2023-10-03T10:18:16.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.695+0000 7ffab8f1b700 1 -- 172.21.15.72:0/2383125735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab409e410 msgr2=0x7ffab4130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.695+0000 7ffab8f1b700 1 --2- 172.21.15.72:0/2383125735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab409e410 0x7ffab4130ba0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009d90 tx=0x7ffaac00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:16.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.695+0000 7ffab8f1b700 1 -- 172.21.15.72:0/2383125735 shutdown_connections 2023-10-03T10:18:16.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.695+0000 7ffab8f1b700 1 --2- 172.21.15.72:0/2383125735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab409e410 0x7ffab4130ba0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.695+0000 7ffab8f1b700 1 --2- 172.21.15.72:0/2383125735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab409d6f0 0x7ffab409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.695+0000 7ffab8f1b700 1 --2- 172.21.15.72:0/2383125735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab409e000 0x7ffab4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.695+0000 7ffab8f1b700 1 -- 172.21.15.72:0/2383125735 >> 172.21.15.72:0/2383125735 conn(0x7ffab4066f50 msgr2=0x7ffab409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.695+0000 7ffab8f1b700 1 -- 172.21.15.72:0/2383125735 shutdown_connections 2023-10-03T10:18:16.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.695+0000 7ffab8f1b700 1 -- 172.21.15.72:0/2383125735 wait complete. 2023-10-03T10:18:16.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.696+0000 7ffab8f1b700 1 Processor -- start 2023-10-03T10:18:16.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.696+0000 7ffab8f1b700 1 -- start start 2023-10-03T10:18:16.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab8f1b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab409d6f0 0x7ffab41371c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab8f1b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab409e000 0x7ffab4137700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab8f1b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab409e410 0x7ffab41c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab8f1b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab4119dd0 con 0x7ffab409e000 2023-10-03T10:18:16.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab8f1b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab4136cd0 con 0x7ffab409e410 2023-10-03T10:18:16.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab8f1b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffab4137c40 con 0x7ffab409d6f0 2023-10-03T10:18:16.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab409e410 0x7ffab41c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab409e410 0x7ffab41c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55770/0 (socket says 172.21.15.72:55770) 2023-10-03T10:18:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab2d9d700 1 -- 172.21.15.72:0/4110547629 learned_addr learned my addr 172.21.15.72:0/4110547629 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab259c700 1 --2- 172.21.15.72:0/4110547629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab409d6f0 0x7ffab41371c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab1d9b700 1 --2- 172.21.15.72:0/4110547629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab409e000 0x7ffab4137700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab259c700 1 -- 172.21.15.72:0/4110547629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab409e410 msgr2=0x7ffab41c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab259c700 1 --2- 172.21.15.72:0/4110547629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab409e410 0x7ffab41c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab259c700 1 -- 172.21.15.72:0/4110547629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab409e000 msgr2=0x7ffab4137700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab259c700 1 --2- 172.21.15.72:0/4110547629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab409e000 0x7ffab4137700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab259c700 1 -- 172.21.15.72:0/4110547629 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac009a70 con 0x7ffab409d6f0 2023-10-03T10:18:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffab259c700 1 --2- 172.21.15.72:0/4110547629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab409d6f0 0x7ffab41371c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400e860 tx=0x7ffaa400eb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.697+0000 7ffaa2ffd700 1 -- 172.21.15.72:0/4110547629 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4013680 con 0x7ffab409d6f0 2023-10-03T10:18:16.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.698+0000 7ffaa2ffd700 1 -- 172.21.15.72:0/4110547629 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa40137e0 con 0x7ffab409d6f0 2023-10-03T10:18:16.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.698+0000 7ffab8f1b700 1 -- 172.21.15.72:0/4110547629 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab4119fb0 con 0x7ffab409d6f0 2023-10-03T10:18:16.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.698+0000 7ffaa2ffd700 1 -- 172.21.15.72:0/4110547629 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4013b50 con 0x7ffab409d6f0 2023-10-03T10:18:16.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.698+0000 7ffab8f1b700 1 -- 172.21.15.72:0/4110547629 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab40a3790 con 0x7ffab409d6f0 2023-10-03T10:18:16.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.699+0000 7ffaa2ffd700 1 -- 172.21.15.72:0/4110547629 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffaa4013cb0 con 0x7ffab409d6f0 2023-10-03T10:18:16.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.699+0000 7ffab8f1b700 1 -- 172.21.15.72:0/4110547629 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab4119c10 con 0x7ffab409d6f0 2023-10-03T10:18:16.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.699+0000 7ffaa2ffd700 1 -- 172.21.15.72:0/4110547629 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffaa403f9d0 con 0x7ffab409d6f0 2023-10-03T10:18:16.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.708+0000 7ffaa2ffd700 1 -- 172.21.15.72:0/4110547629 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffaa401adc0 con 0x7ffab409d6f0 2023-10-03T10:18:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.822+0000 7f7d9e017700 1 -- 172.21.15.72:0/2357824342 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7d9813e930 con 0x7f7d9806ee80 2023-10-03T10:18:16.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.823+0000 7f7d7ffff700 1 -- 172.21.15.72:0/2357824342 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d9813e930 con 0x7f7d9806ee80 2023-10-03T10:18:16.823 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:16.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.826+0000 7f7d9e017700 1 -- 172.21.15.72:0/2357824342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d9806ee80 msgr2=0x7f7d98140270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.826+0000 7f7d9e017700 1 --2- 172.21.15.72:0/2357824342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d9806ee80 0x7f7d98140270 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7d88013000 tx=0x7f7d88004750 comp rx=0 tx=0).stop 2023-10-03T10:18:16.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.826+0000 7f7d9e017700 1 -- 172.21.15.72:0/2357824342 shutdown_connections 2023-10-03T10:18:16.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.826+0000 7f7d9e017700 1 --2- 172.21.15.72:0/2357824342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d9813bc00 0x7f7d98133e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.826+0000 7f7d9e017700 1 --2- 172.21.15.72:0/2357824342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7d9806ee80 0x7f7d98140270 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.826+0000 7f7d9e017700 1 --2- 172.21.15.72:0/2357824342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d9813b290 0x7f7d9813b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.826+0000 7f7d9e017700 1 -- 172.21.15.72:0/2357824342 >> 172.21.15.72:0/2357824342 conn(0x7f7d980a2aa0 msgr2=0x7f7d9809e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.827+0000 7f7d9e017700 1 -- 172.21.15.72:0/2357824342 shutdown_connections 2023-10-03T10:18:16.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.828+0000 7f7d9e017700 1 -- 172.21.15.72:0/2357824342 wait complete. 2023-10-03T10:18:16.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:16.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.858+0000 7ffa8da5e700 1 -- 172.21.15.72:0/2687975750 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffa88124d50 con 0x7ffa880a1510 2023-10-03T10:18:16.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.858+0000 7ffa6ffff700 1 -- 172.21.15.72:0/2687975750 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ffa7c015070 con 0x7ffa880a1510 2023-10-03T10:18:16.858 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.860+0000 7ffa8da5e700 1 -- 172.21.15.72:0/2687975750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa880a1510 msgr2=0x7ffa88121e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.860+0000 7ffa8da5e700 1 --2- 172.21.15.72:0/2687975750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa880a1510 0x7ffa88121e00 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c0098f0 tx=0x7ffa7c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.860+0000 7ffa8da5e700 1 -- 172.21.15.72:0/2687975750 shutdown_connections 2023-10-03T10:18:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.860+0000 7ffa8da5e700 1 --2- 172.21.15.72:0/2687975750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa880a0a30 0x7ffa881218c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.860+0000 7ffa8da5e700 1 --2- 172.21.15.72:0/2687975750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa88139250 0x7ffa88122340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.860+0000 7ffa8da5e700 1 --2- 172.21.15.72:0/2687975750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa880a1510 0x7ffa88121e00 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.860+0000 7ffa8da5e700 1 -- 172.21.15.72:0/2687975750 >> 172.21.15.72:0/2687975750 conn(0x7ffa880a6550 msgr2=0x7ffa88137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.860+0000 7ffa8da5e700 1 -- 172.21.15.72:0/2687975750 shutdown_connections 2023-10-03T10:18:16.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.860+0000 7ffa8da5e700 1 -- 172.21.15.72:0/2687975750 wait complete. 2023-10-03T10:18:16.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:16.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.872+0000 7f05a1267700 1 -- 172.21.15.72:0/2106107985 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f059c11c150 con 0x7f059c130f70 2023-10-03T10:18:16.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.872+0000 7f05837fe700 1 -- 172.21.15.72:0/2106107985 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f058c03f030 con 0x7f059c130f70 2023-10-03T10:18:16.873 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.875+0000 7f05a1267700 1 -- 172.21.15.72:0/2106107985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f059c130f70 msgr2=0x7f059c119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.875+0000 7f05a1267700 1 --2- 172.21.15.72:0/2106107985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f059c130f70 0x7f059c119480 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f058c00b9f0 tx=0x7f058c00bd00 comp rx=0 tx=0).stop 2023-10-03T10:18:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.875+0000 7f05a1267700 1 -- 172.21.15.72:0/2106107985 shutdown_connections 2023-10-03T10:18:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.875+0000 7f05a1267700 1 --2- 172.21.15.72:0/2106107985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f059c06acb0 0x7f059c1c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.875+0000 7f05a1267700 1 --2- 172.21.15.72:0/2106107985 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f059c130f70 0x7f059c119480 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.875+0000 7f05a1267700 1 --2- 172.21.15.72:0/2106107985 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f059c130660 0x7f059c1c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.875+0000 7f05a1267700 1 -- 172.21.15.72:0/2106107985 >> 172.21.15.72:0/2106107985 conn(0x7f059c066f50 msgr2=0x7f059c12fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.875+0000 7f05a1267700 1 -- 172.21.15.72:0/2106107985 shutdown_connections 2023-10-03T10:18:16.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.875+0000 7f05a1267700 1 -- 172.21.15.72:0/2106107985 wait complete. 2023-10-03T10:18:16.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.911+0000 7ffab8f1b700 1 -- 172.21.15.72:0/4110547629 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffab4074ea0 con 0x7ffab409d6f0 2023-10-03T10:18:16.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.911+0000 7ffaa2ffd700 1 -- 172.21.15.72:0/4110547629 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffaa4017020 con 0x7ffab409d6f0 2023-10-03T10:18:16.911 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:16.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.913+0000 7ffab8f1b700 1 -- 172.21.15.72:0/4110547629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab409d6f0 msgr2=0x7ffab41371c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.913+0000 7ffab8f1b700 1 --2- 172.21.15.72:0/4110547629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab409d6f0 0x7ffab41371c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400e860 tx=0x7ffaa400eb70 comp rx=0 tx=0).stop 2023-10-03T10:18:16.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.913+0000 7ffab8f1b700 1 -- 172.21.15.72:0/4110547629 shutdown_connections 2023-10-03T10:18:16.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.913+0000 7ffab8f1b700 1 --2- 172.21.15.72:0/4110547629 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffab409e410 0x7ffab41c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.913+0000 7ffab8f1b700 1 --2- 172.21.15.72:0/4110547629 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffab409d6f0 0x7ffab41371c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.913+0000 7ffab8f1b700 1 --2- 172.21.15.72:0/4110547629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab409e000 0x7ffab4137700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.913+0000 7ffab8f1b700 1 -- 172.21.15.72:0/4110547629 >> 172.21.15.72:0/4110547629 conn(0x7ffab4066f50 msgr2=0x7ffab4070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.913+0000 7ffab8f1b700 1 -- 172.21.15.72:0/4110547629 shutdown_connections 2023-10-03T10:18:16.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:16.913+0000 7ffab8f1b700 1 -- 172.21.15.72:0/4110547629 wait complete. 2023-10-03T10:18:16.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:17.844 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:17.872 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:17.888 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:17.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:17.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.990+0000 7f580fc3a700 1 Processor -- start 2023-10-03T10:18:17.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.991+0000 7f580fc3a700 1 -- start start 2023-10-03T10:18:17.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.991+0000 7f580fc3a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580812cf60 0x7f580806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.991+0000 7f580fc3a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f580812f8b0 0x7f580812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.991+0000 7f580fc3a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580812cd90 con 0x7f5808130260 2023-10-03T10:18:17.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.991+0000 7f580fc3a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580812d330 con 0x7f580812f8b0 2023-10-03T10:18:17.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.991+0000 7f580fc3a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58081306e0 con 0x7f580812cf60 2023-10-03T10:18:17.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.992+0000 7f580d9d6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580812cf60 0x7f580806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.992+0000 7f580d1d5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f580812f8b0 0x7f580812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.992+0000 7f580d9d6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580812cf60 0x7f580806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48352/0 (socket says 172.21.15.72:48352) 2023-10-03T10:18:17.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.992+0000 7f580d9d6700 1 -- 172.21.15.72:0/3266540184 learned_addr learned my addr 172.21.15.72:0/3266540184 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.992+0000 7f580d9d6700 1 -- 172.21.15.72:0/3266540184 >> v2:172.21.15.72:3300/0 conn(0x7f580812f8b0 msgr2=0x7f580812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.992+0000 7f580d9d6700 1 --2- 172.21.15.72:0/3266540184 >> v2:172.21.15.72:3300/0 conn(0x7f580812f8b0 0x7f580812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.992+0000 7f580d9d6700 1 -- 172.21.15.72:0/3266540184 >> v1:172.21.15.72:6789/0 conn(0x7f5808130260 legacy=0x7f5808136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.992+0000 7f580d9d6700 1 -- 172.21.15.72:0/3266540184 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5808071780 con 0x7f580812cf60 2023-10-03T10:18:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.992+0000 7f580d1d5700 1 --2- 172.21.15.72:0/3266540184 >> v2:172.21.15.72:3300/0 conn(0x7f580812f8b0 0x7f580812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.992+0000 7f580d9d6700 1 --2- 172.21.15.72:0/3266540184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580812cf60 0x7f580806f5d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f58040098f0 tx=0x7f5804009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46980e54374a6f4a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.992+0000 7f580c9d4700 1 -- 172.21.15.72:0/3266540184 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400f940 con 0x7f580812cf60 2023-10-03T10:18:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.992+0000 7f580c9d4700 1 -- 172.21.15.72:0/3266540184 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580400faa0 con 0x7f580812cf60 2023-10-03T10:18:17.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.992+0000 7f580c9d4700 1 -- 172.21.15.72:0/3266540184 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400fe30 con 0x7f580812cf60 2023-10-03T10:18:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.993+0000 7f580fc3a700 1 -- 172.21.15.72:0/3266540184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580812cf60 msgr2=0x7f580806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.993+0000 7f580fc3a700 1 --2- 172.21.15.72:0/3266540184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580812cf60 0x7f580806f5d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f58040098f0 tx=0x7f5804009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.993+0000 7f580fc3a700 1 -- 172.21.15.72:0/3266540184 shutdown_connections 2023-10-03T10:18:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.993+0000 7f580fc3a700 1 --2- 172.21.15.72:0/3266540184 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f580812cf60 0x7f580806f5d0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.993+0000 7f580fc3a700 1 --2- 172.21.15.72:0/3266540184 >> v2:172.21.15.72:3300/0 conn(0x7f580812f8b0 0x7f580812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.993+0000 7f580fc3a700 1 -- 172.21.15.72:0/3266540184 >> 172.21.15.72:0/3266540184 conn(0x7f58080a2aa0 msgr2=0x7f58080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.993+0000 7f580fc3a700 1 -- 172.21.15.72:0/3266540184 shutdown_connections 2023-10-03T10:18:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.994+0000 7f580fc3a700 1 -- 172.21.15.72:0/3266540184 wait complete. 2023-10-03T10:18:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.994+0000 7f580fc3a700 1 Processor -- start 2023-10-03T10:18:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.994+0000 7f580fc3a700 1 -- start start 2023-10-03T10:18:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580fc3a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f580812cf60 0x7f58081c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580fc3a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f580812f8b0 0x7f58081c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580fc3a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5808130260 0x7f58081c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580fc3a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580812d820 con 0x7f580812cf60 2023-10-03T10:18:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580fc3a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580809c6d0 con 0x7f580812f8b0 2023-10-03T10:18:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580fc3a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5808129fa0 con 0x7f5808130260 2023-10-03T10:18:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580e1d7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5808130260 0x7f58081c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580e1d7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5808130260 0x7f58081c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48362/0 (socket says 172.21.15.72:48362) 2023-10-03T10:18:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580e1d7700 1 -- 172.21.15.72:0/3470051425 learned_addr learned my addr 172.21.15.72:0/3470051425 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580d1d5700 1 --2- 172.21.15.72:0/3470051425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f580812f8b0 0x7f58081c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580d9d6700 1 --2- 172.21.15.72:0/3470051425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f580812cf60 0x7f58081c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580d1d5700 1 -- 172.21.15.72:0/3470051425 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5808130260 msgr2=0x7f58081c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580d1d5700 1 --2- 172.21.15.72:0/3470051425 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5808130260 0x7f58081c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580d1d5700 1 -- 172.21.15.72:0/3470051425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f580812cf60 msgr2=0x7f58081c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580d1d5700 1 --2- 172.21.15.72:0/3470051425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f580812cf60 0x7f58081c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.995+0000 7f580d1d5700 1 -- 172.21.15.72:0/3470051425 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f80094a0 con 0x7f580812f8b0 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.996+0000 7f580e1d7700 1 --2- 172.21.15.72:0/3470051425 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5808130260 0x7f58081c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.996+0000 7f580d1d5700 1 --2- 172.21.15.72:0/3470051425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f580812f8b0 0x7f58081c5940 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f57f800e9b0 tx=0x7f57f800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.996+0000 7f57fe7fc700 1 -- 172.21.15.72:0/3470051425 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f800ee50 con 0x7f580812f8b0 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.996+0000 7f57fe7fc700 1 -- 172.21.15.72:0/3470051425 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f800c850 con 0x7f580812f8b0 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.996+0000 7f580fc3a700 1 -- 172.21.15.72:0/3470051425 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5804009550 con 0x7f580812f8b0 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.996+0000 7f57fe7fc700 1 -- 172.21.15.72:0/3470051425 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f800cbe0 con 0x7f580812f8b0 2023-10-03T10:18:17.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.997+0000 7f57fe7fc700 1 -- 172.21.15.72:0/3470051425 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57f800cd40 con 0x7f580812f8b0 2023-10-03T10:18:17.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.997+0000 7f580fc3a700 1 -- 172.21.15.72:0/3470051425 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580809cd90 con 0x7f580812f8b0 2023-10-03T10:18:17.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.997+0000 7f57fe7fc700 1 -- 172.21.15.72:0/3470051425 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f57f801bd80 con 0x7f580812f8b0 2023-10-03T10:18:17.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:17.998+0000 7f580fc3a700 1 -- 172.21.15.72:0/3470051425 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580809cf80 con 0x7f580812f8b0 2023-10-03T10:18:18.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.003+0000 7f57fe7fc700 1 -- 172.21.15.72:0/3470051425 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57f8017070 con 0x7f580812f8b0 2023-10-03T10:18:18.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.032+0000 7fda55225700 1 Processor -- start 2023-10-03T10:18:18.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.033+0000 7fda55225700 1 -- start start 2023-10-03T10:18:18.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.033+0000 7fda55225700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda50130540 0x7fda50130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.033+0000 7fda55225700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fda50130e50 0x7fda5006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.033+0000 7fda55225700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda500716a0 con 0x7fda5006fb20 2023-10-03T10:18:18.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.033+0000 7fda55225700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5009a390 con 0x7fda50130e50 2023-10-03T10:18:18.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.033+0000 7fda55225700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda50071290 con 0x7fda50130540 2023-10-03T10:18:18.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.033+0000 7fda4f59e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fda5006fb20 0x7fda50137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42414/0 (socket says 172.21.15.72:42414) 2023-10-03T10:18:18.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.033+0000 7fda4e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fda50130e50 0x7fda5006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.033+0000 7fda4f59e700 1 -- 172.21.15.72:0/2083386264 learned_addr learned my addr 172.21.15.72:0/2083386264 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:18.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.033+0000 7fda4ed9d700 1 --2- 172.21.15.72:0/2083386264 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda50130540 0x7fda50130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.034+0000 7fda4e59c700 1 -- 172.21.15.72:0/2083386264 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda50130540 msgr2=0x7fda50130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:18.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.034+0000 7fda4e59c700 1 --2- 172.21.15.72:0/2083386264 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda50130540 0x7fda50130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.034+0000 7fda4e59c700 1 -- 172.21.15.72:0/2083386264 >> v1:172.21.15.72:6789/0 conn(0x7fda5006fb20 legacy=0x7fda50137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.034+0000 7fda4dd9b700 1 -- 172.21.15.72:0/2083386264 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638379352 0 0) 0x7fda500716a0 con 0x7fda5006fb20 2023-10-03T10:18:18.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.034+0000 7fda4e59c700 1 -- 172.21.15.72:0/2083386264 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda50130340 con 0x7fda50130e50 2023-10-03T10:18:18.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.034+0000 7fda4e59c700 1 --2- 172.21.15.72:0/2083386264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda50130e50 0x7fda5006f5e0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fda4400b8f0 tx=0x7fda4400bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65304a90f61f70f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.034+0000 7fda4dd9b700 1 -- 172.21.15.72:0/2083386264 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4400c770 con 0x7fda50130e50 2023-10-03T10:18:18.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.034+0000 7fda4dd9b700 1 -- 172.21.15.72:0/2083386264 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda44015e90 con 0x7fda50130e50 2023-10-03T10:18:18.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.034+0000 7fda4dd9b700 1 -- 172.21.15.72:0/2083386264 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4400caf0 con 0x7fda50130e50 2023-10-03T10:18:18.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.034+0000 7fe062671700 1 Processor -- start 2023-10-03T10:18:18.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.034+0000 7fe062671700 1 -- start start 2023-10-03T10:18:18.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fe062671700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05c0a0a30 0x7fe05c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fe062671700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe05c09d630 0x7fe05c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fe062671700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05c0a2a70 con 0x7fe05c133930 2023-10-03T10:18:18.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fe062671700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0a01d0 con 0x7fe05c0a0a30 2023-10-03T10:18:18.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fe062671700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c09e2b0 con 0x7fe05c09d630 2023-10-03T10:18:18.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fe05bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05c0a0a30 0x7fe05c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fe05b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe05c09d630 0x7fe05c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fe05bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05c0a0a30 0x7fe05c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55792/0 (socket says 172.21.15.72:55792) 2023-10-03T10:18:18.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fe05b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe05c09d630 0x7fe05c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48392/0 (socket says 172.21.15.72:48392) 2023-10-03T10:18:18.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fe05bfff700 1 -- 172.21.15.72:0/2090425693 learned_addr learned my addr 172.21.15.72:0/2090425693 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:18.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fda55225700 1 -- 172.21.15.72:0/2083386264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda50130e50 msgr2=0x7fda5006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fda55225700 1 --2- 172.21.15.72:0/2083386264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda50130e50 0x7fda5006f5e0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fda4400b8f0 tx=0x7fda4400bc00 comp rx=0 tx=0).stop 2023-10-03T10:18:18.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fda55225700 1 -- 172.21.15.72:0/2083386264 shutdown_connections 2023-10-03T10:18:18.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fda55225700 1 --2- 172.21.15.72:0/2083386264 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda50130540 0x7fda50130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fda55225700 1 --2- 172.21.15.72:0/2083386264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda50130e50 0x7fda5006f5e0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fda55225700 1 -- 172.21.15.72:0/2083386264 >> 172.21.15.72:0/2083386264 conn(0x7fda500a2aa0 msgr2=0x7fda500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fe05b7fe700 1 -- 172.21.15.72:0/2090425693 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05c0a0a30 msgr2=0x7fe05c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fe05b7fe700 1 --2- 172.21.15.72:0/2090425693 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05c0a0a30 0x7fe05c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fe05b7fe700 1 -- 172.21.15.72:0/2090425693 >> v1:172.21.15.72:6789/0 conn(0x7fe05c133930 legacy=0x7fe05c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:18.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fe05b7fe700 1 -- 172.21.15.72:0/2090425693 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c09dc50 con 0x7fe05c09d630 2023-10-03T10:18:18.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fda55225700 1 -- 172.21.15.72:0/2083386264 shutdown_connections 2023-10-03T10:18:18.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.035+0000 7fda55225700 1 -- 172.21.15.72:0/2083386264 wait complete. 2023-10-03T10:18:18.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.036+0000 7fe05b7fe700 1 --2- 172.21.15.72:0/2090425693 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe05c09d630 0x7fe05c0a1340 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009870 tx=0x7fe04c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73b9c2520223e0a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.036+0000 7fe05affd700 1 -- 172.21.15.72:0/2090425693 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c004230 con 0x7fe05c09d630 2023-10-03T10:18:18.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.036+0000 7fe05affd700 1 -- 172.21.15.72:0/2090425693 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c004390 con 0x7fe05c09d630 2023-10-03T10:18:18.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.036+0000 7fe05affd700 1 -- 172.21.15.72:0/2090425693 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0036a0 con 0x7fe05c09d630 2023-10-03T10:18:18.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.037+0000 7fe062671700 1 -- 172.21.15.72:0/2090425693 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe05c09d630 msgr2=0x7fe05c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.037+0000 7fe062671700 1 --2- 172.21.15.72:0/2090425693 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe05c09d630 0x7fe05c0a1340 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009870 tx=0x7fe04c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.037+0000 7fda55225700 1 Processor -- start 2023-10-03T10:18:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.037+0000 7fe062671700 1 -- 172.21.15.72:0/2090425693 shutdown_connections 2023-10-03T10:18:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.037+0000 7fe062671700 1 --2- 172.21.15.72:0/2090425693 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05c0a0a30 0x7fe05c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.037+0000 7fe062671700 1 --2- 172.21.15.72:0/2090425693 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe05c09d630 0x7fe05c0a1340 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.037+0000 7fe062671700 1 -- 172.21.15.72:0/2090425693 >> 172.21.15.72:0/2090425693 conn(0x7fe05c0a3050 msgr2=0x7fe05c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.037+0000 7fda55225700 1 -- start start 2023-10-03T10:18:18.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.037+0000 7fe062671700 1 -- 172.21.15.72:0/2090425693 shutdown_connections 2023-10-03T10:18:18.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.037+0000 7fe062671700 1 -- 172.21.15.72:0/2090425693 wait complete. 2023-10-03T10:18:18.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.037+0000 7fda55225700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda5006fb20 0x7fda5011a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda55225700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda50130540 0x7fda5011ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda55225700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda50130e50 0x7fda5011b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda55225700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5011d160 con 0x7fda50130e50 2023-10-03T10:18:18.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda55225700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5012cb50 con 0x7fda5006fb20 2023-10-03T10:18:18.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda55225700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda5011cbc0 con 0x7fda50130540 2023-10-03T10:18:18.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda4e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda50130540 0x7fda5011ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda4e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda50130540 0x7fda5011ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48398/0 (socket says 172.21.15.72:48398) 2023-10-03T10:18:18.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda4e59c700 1 -- 172.21.15.72:0/3672998777 learned_addr learned my addr 172.21.15.72:0/3672998777 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:18.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda4e59c700 1 -- 172.21.15.72:0/3672998777 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda5006fb20 msgr2=0x7fda5011a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda4e59c700 1 --2- 172.21.15.72:0/3672998777 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda5006fb20 0x7fda5011a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda4e59c700 1 -- 172.21.15.72:0/3672998777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda50130e50 msgr2=0x7fda5011b240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:18:18.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda4e59c700 1 --2- 172.21.15.72:0/3672998777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda50130e50 0x7fda5011b240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda4e59c700 1 -- 172.21.15.72:0/3672998777 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4400b550 con 0x7fda50130540 2023-10-03T10:18:18.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda4e59c700 1 --2- 172.21.15.72:0/3672998777 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda50130540 0x7fda5011ad00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fda4401f040 tx=0x7fda44004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fe062671700 1 Processor -- start 2023-10-03T10:18:18.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda377fe700 1 -- 172.21.15.72:0/3672998777 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4401dbc0 con 0x7fda50130540 2023-10-03T10:18:18.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda377fe700 1 -- 172.21.15.72:0/3672998777 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4401dd20 con 0x7fda50130540 2023-10-03T10:18:18.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.038+0000 7fda377fe700 1 -- 172.21.15.72:0/3672998777 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda44026640 con 0x7fda50130540 2023-10-03T10:18:18.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.039+0000 7fda55225700 1 -- 172.21.15.72:0/3672998777 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5011e270 con 0x7fda50130540 2023-10-03T10:18:18.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.039+0000 7fda55225700 1 -- 172.21.15.72:0/3672998777 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda500718e0 con 0x7fda50130540 2023-10-03T10:18:18.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fda377fe700 1 -- 172.21.15.72:0/3672998777 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fda440267a0 con 0x7fda50130540 2023-10-03T10:18:18.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fda377fe700 1 -- 172.21.15.72:0/3672998777 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fda44049e10 con 0x7fda50130540 2023-10-03T10:18:18.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fda55225700 1 -- 172.21.15.72:0/3672998777 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5006d5a0 con 0x7fda50130540 2023-10-03T10:18:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.039+0000 7fe062671700 1 -- start start 2023-10-03T10:18:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.039+0000 7fe062671700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05c09d630 0x7fe05c11d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.039+0000 7fe062671700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c0a0a30 0x7fe05c11dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.039+0000 7fe062671700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe05c133930 0x7fe05c1d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.039+0000 7fe062671700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c11f140 con 0x7fe05c0a0a30 2023-10-03T10:18:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.039+0000 7fe062671700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c11ff60 con 0x7fe05c09d630 2023-10-03T10:18:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.039+0000 7fe062671700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0a41c0 con 0x7fe05c133930 2023-10-03T10:18:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fe060c0e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe05c133930 0x7fe05c1d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fe060c0e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe05c133930 0x7fe05c1d4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48402/0 (socket says 172.21.15.72:48402) 2023-10-03T10:18:18.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fe060c0e700 1 -- 172.21.15.72:0/4187508903 learned_addr learned my addr 172.21.15.72:0/4187508903 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fe05bfff700 1 --2- 172.21.15.72:0/4187508903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05c09d630 0x7fe05c11d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fe05b7fe700 1 --2- 172.21.15.72:0/4187508903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c0a0a30 0x7fe05c11dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fe05bfff700 1 -- 172.21.15.72:0/4187508903 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe05c133930 msgr2=0x7fe05c1d4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fe05bfff700 1 --2- 172.21.15.72:0/4187508903 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe05c133930 0x7fe05c1d4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fe05bfff700 1 -- 172.21.15.72:0/4187508903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c0a0a30 msgr2=0x7fe05c11dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fe05bfff700 1 --2- 172.21.15.72:0/4187508903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c0a0a30 0x7fe05c11dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fe05bfff700 1 -- 172.21.15.72:0/4187508903 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0094a0 con 0x7fe05c09d630 2023-10-03T10:18:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fe060c0e700 1 --2- 172.21.15.72:0/4187508903 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe05c133930 0x7fe05c1d4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fe05b7fe700 1 --2- 172.21.15.72:0/4187508903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c0a0a30 0x7fe05c11dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.040+0000 7fe05bfff700 1 --2- 172.21.15.72:0/4187508903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05c09d630 0x7fe05c11d580 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe05000e8e0 tx=0x7fe05000ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.041+0000 7fe058ff9700 1 -- 172.21.15.72:0/4187508903 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05000c690 con 0x7fe05c09d630 2023-10-03T10:18:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.041+0000 7fe058ff9700 1 -- 172.21.15.72:0/4187508903 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05000c7f0 con 0x7fe05c09d630 2023-10-03T10:18:18.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.041+0000 7fe058ff9700 1 -- 172.21.15.72:0/4187508903 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05000cb80 con 0x7fe05c09d630 2023-10-03T10:18:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.041+0000 7fe062671700 1 -- 172.21.15.72:0/4187508903 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05c0a0470 con 0x7fe05c09d630 2023-10-03T10:18:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.041+0000 7fe062671700 1 -- 172.21.15.72:0/4187508903 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c11e000 con 0x7fe05c09d630 2023-10-03T10:18:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.042+0000 7fe062671700 1 -- 172.21.15.72:0/4187508903 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05c0747f0 con 0x7fe05c09d630 2023-10-03T10:18:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.042+0000 7fe058ff9700 1 -- 172.21.15.72:0/4187508903 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe05000cce0 con 0x7fe05c09d630 2023-10-03T10:18:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.042+0000 7fe058ff9700 1 -- 172.21.15.72:0/4187508903 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe05003f720 con 0x7fe05c09d630 2023-10-03T10:18:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.045+0000 7fda377fe700 1 -- 172.21.15.72:0/3672998777 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fda44037070 con 0x7fda50130540 2023-10-03T10:18:18.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.051+0000 7fe058ff9700 1 -- 172.21.15.72:0/4187508903 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0500232f0 con 0x7fe05c09d630 2023-10-03T10:18:18.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.076+0000 7f1d83268700 1 Processor -- start 2023-10-03T10:18:18.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.076+0000 7f1d83268700 1 -- start start 2023-10-03T10:18:18.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.077+0000 7f1d83268700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d7c136830 0x7f1d7c138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.077+0000 7f1d83268700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d7c139150 0x7f1d7c13b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.077+0000 7f1d83268700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c06f720 con 0x7f1d7c1338c0 2023-10-03T10:18:18.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.077+0000 7f1d83268700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c070c80 con 0x7f1d7c136830 2023-10-03T10:18:18.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.077+0000 7f1d83268700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c06fce0 con 0x7f1d7c139150 2023-10-03T10:18:18.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.077+0000 7f1d81805700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d7c139150 0x7f1d7c13b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.077+0000 7f1d80803700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d7c136830 0x7f1d7c138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.077+0000 7f1d81805700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d7c139150 0x7f1d7c13b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48418/0 (socket says 172.21.15.72:48418) 2023-10-03T10:18:18.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.077+0000 7f1d80803700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d7c136830 0x7f1d7c138c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:58048/0 (socket says 172.21.15.72:58048) 2023-10-03T10:18:18.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.077+0000 7f1d81805700 1 -- 172.21.15.72:0/3539196433 learned_addr learned my addr 172.21.15.72:0/3539196433 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:18.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.077+0000 7f1d81805700 1 -- 172.21.15.72:0/3539196433 >> v2:172.21.15.72:3300/0 conn(0x7f1d7c136830 msgr2=0x7f1d7c138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:18.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.077+0000 7f1d81805700 1 --2- 172.21.15.72:0/3539196433 >> v2:172.21.15.72:3300/0 conn(0x7f1d7c136830 0x7f1d7c138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.077+0000 7f1d81805700 1 -- 172.21.15.72:0/3539196433 >> v1:172.21.15.72:6789/0 conn(0x7f1d7c1338c0 legacy=0x7f1d7c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.077+0000 7f1d81805700 1 -- 172.21.15.72:0/3539196433 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c1336a0 con 0x7f1d7c139150 2023-10-03T10:18:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.077+0000 7f1d81805700 1 --2- 172.21.15.72:0/3539196433 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d7c139150 0x7f1d7c13b530 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009e50 tx=0x7f1d7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfef939333c84745 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.078+0000 7f1d73fff700 1 -- 172.21.15.72:0/3539196433 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7400e070 con 0x7f1d7c139150 2023-10-03T10:18:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.078+0000 7f1d73fff700 1 -- 172.21.15.72:0/3539196433 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7400b910 con 0x7f1d7c139150 2023-10-03T10:18:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.078+0000 7f1d73fff700 1 -- 172.21.15.72:0/3539196433 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7400bcc0 con 0x7f1d7c139150 2023-10-03T10:18:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.079+0000 7f1d83268700 1 -- 172.21.15.72:0/3539196433 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d7c139150 msgr2=0x7f1d7c13b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.079+0000 7f1d83268700 1 --2- 172.21.15.72:0/3539196433 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d7c139150 0x7f1d7c13b530 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009e50 tx=0x7f1d7400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.079+0000 7f1d83268700 1 -- 172.21.15.72:0/3539196433 shutdown_connections 2023-10-03T10:18:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.079+0000 7f1d83268700 1 --2- 172.21.15.72:0/3539196433 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d7c139150 0x7f1d7c13b530 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.079+0000 7f1d83268700 1 --2- 172.21.15.72:0/3539196433 >> v2:172.21.15.72:3300/0 conn(0x7f1d7c136830 0x7f1d7c138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.079+0000 7f1d83268700 1 -- 172.21.15.72:0/3539196433 >> 172.21.15.72:0/3539196433 conn(0x7f1d7c0a2aa0 msgr2=0x7f1d7c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.079+0000 7f1d83268700 1 -- 172.21.15.72:0/3539196433 shutdown_connections 2023-10-03T10:18:18.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.079+0000 7f1d83268700 1 -- 172.21.15.72:0/3539196433 wait complete. 2023-10-03T10:18:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.080+0000 7f1d83268700 1 Processor -- start 2023-10-03T10:18:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.080+0000 7f1d83268700 1 -- start start 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.081+0000 7f1d83268700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d7c1338c0 0x7f1d7c1c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.081+0000 7f1d83268700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d7c136830 0x7f1d7c1c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.081+0000 7f1d83268700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d7c139150 0x7f1d7c119f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.081+0000 7f1d83268700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c130050 con 0x7f1d7c139150 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.081+0000 7f1d83268700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c1be2d0 con 0x7f1d7c1338c0 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.081+0000 7f1d83268700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c11d120 con 0x7f1d7c136830 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.081+0000 7f1d81004700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d7c1338c0 0x7f1d7c1c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.081+0000 7f1d81004700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d7c1338c0 0x7f1d7c1c8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55822/0 (socket says 172.21.15.72:55822) 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.081+0000 7f1d81004700 1 -- 172.21.15.72:0/3772739612 learned_addr learned my addr 172.21.15.72:0/3772739612 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.081+0000 7f1d80803700 1 --2- 172.21.15.72:0/3772739612 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d7c136830 0x7f1d7c1c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.081+0000 7f1d81805700 1 --2- 172.21.15.72:0/3772739612 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d7c139150 0x7f1d7c119f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.082+0000 7f1d80803700 1 -- 172.21.15.72:0/3772739612 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d7c1338c0 msgr2=0x7f1d7c1c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.082+0000 7f1d80803700 1 --2- 172.21.15.72:0/3772739612 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d7c1338c0 0x7f1d7c1c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.082+0000 7f1d80803700 1 -- 172.21.15.72:0/3772739612 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d7c139150 msgr2=0x7f1d7c119f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.082+0000 7f1d80803700 1 --2- 172.21.15.72:0/3772739612 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d7c139150 0x7f1d7c119f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.082+0000 7f1d80803700 1 -- 172.21.15.72:0/3772739612 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d74009b30 con 0x7f1d7c136830 2023-10-03T10:18:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.082+0000 7f1d80803700 1 --2- 172.21.15.72:0/3772739612 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d7c136830 0x7f1d7c1c8a40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00e8d0 tx=0x7f1d6c00ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.082+0000 7f1d71ffb700 1 -- 172.21.15.72:0/3772739612 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c013680 con 0x7f1d7c136830 2023-10-03T10:18:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.082+0000 7f1d71ffb700 1 -- 172.21.15.72:0/3772739612 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c0137e0 con 0x7f1d7c136830 2023-10-03T10:18:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.082+0000 7f1d71ffb700 1 -- 172.21.15.72:0/3772739612 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c013b50 con 0x7f1d7c136830 2023-10-03T10:18:18.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.083+0000 7f1d83268700 1 -- 172.21.15.72:0/3772739612 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c11d990 con 0x7f1d7c136830 2023-10-03T10:18:18.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.083+0000 7f1d83268700 1 -- 172.21.15.72:0/3772739612 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c11e120 con 0x7f1d7c136830 2023-10-03T10:18:18.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.084+0000 7f1d71ffb700 1 -- 172.21.15.72:0/3772739612 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d6c013cb0 con 0x7f1d7c136830 2023-10-03T10:18:18.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.084+0000 7f1d83268700 1 -- 172.21.15.72:0/3772739612 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c074ea0 con 0x7f1d7c136830 2023-10-03T10:18:18.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.084+0000 7f1d71ffb700 1 -- 172.21.15.72:0/3772739612 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1d6c0421c0 con 0x7f1d7c136830 2023-10-03T10:18:18.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.089+0000 7f1d71ffb700 1 -- 172.21.15.72:0/3772739612 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d6c017020 con 0x7f1d7c136830 2023-10-03T10:18:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.206+0000 7f580fc3a700 1 -- 172.21.15.72:0/3470051425 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5808074ea0 con 0x7f580812f8b0 2023-10-03T10:18:18.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.207+0000 7f57fe7fc700 1 -- 172.21.15.72:0/3470051425 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57f80102b0 con 0x7f580812f8b0 2023-10-03T10:18:18.206 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.209+0000 7f580fc3a700 1 -- 172.21.15.72:0/3470051425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f580812f8b0 msgr2=0x7f58081c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.209+0000 7f580fc3a700 1 --2- 172.21.15.72:0/3470051425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f580812f8b0 0x7f58081c5940 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f57f800e9b0 tx=0x7f57f800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.209+0000 7f580fc3a700 1 -- 172.21.15.72:0/3470051425 shutdown_connections 2023-10-03T10:18:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.209+0000 7f580fc3a700 1 --2- 172.21.15.72:0/3470051425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f580812cf60 0x7f58081c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.209+0000 7f580fc3a700 1 --2- 172.21.15.72:0/3470051425 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5808130260 0x7f58081c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.209+0000 7f580fc3a700 1 --2- 172.21.15.72:0/3470051425 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f580812f8b0 0x7f58081c5940 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.209+0000 7f580fc3a700 1 -- 172.21.15.72:0/3470051425 >> 172.21.15.72:0/3470051425 conn(0x7f58080a2aa0 msgr2=0x7f580806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.209+0000 7f580fc3a700 1 -- 172.21.15.72:0/3470051425 shutdown_connections 2023-10-03T10:18:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.209+0000 7f580fc3a700 1 -- 172.21.15.72:0/3470051425 wait complete. 2023-10-03T10:18:18.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:18.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.252+0000 7fe062671700 1 -- 172.21.15.72:0/4187508903 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe05c072980 con 0x7fe05c09d630 2023-10-03T10:18:18.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.252+0000 7fe058ff9700 1 -- 172.21.15.72:0/4187508903 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe05001bb60 con 0x7fe05c09d630 2023-10-03T10:18:18.252 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:18.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.252+0000 7fda55225700 1 -- 172.21.15.72:0/3672998777 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fda50074ea0 con 0x7fda50130540 2023-10-03T10:18:18.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.253+0000 7fda377fe700 1 -- 172.21.15.72:0/3672998777 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fda440319a0 con 0x7fda50130540 2023-10-03T10:18:18.253 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:18.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.254+0000 7fe062671700 1 -- 172.21.15.72:0/4187508903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05c09d630 msgr2=0x7fe05c11d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.254+0000 7fe062671700 1 --2- 172.21.15.72:0/4187508903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05c09d630 0x7fe05c11d580 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe05000e8e0 tx=0x7fe05000ebf0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.254+0000 7fe062671700 1 -- 172.21.15.72:0/4187508903 shutdown_connections 2023-10-03T10:18:18.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.254+0000 7fe062671700 1 --2- 172.21.15.72:0/4187508903 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe05c133930 0x7fe05c1d4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.254+0000 7fe062671700 1 --2- 172.21.15.72:0/4187508903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe05c09d630 0x7fe05c11d580 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.254+0000 7fe062671700 1 --2- 172.21.15.72:0/4187508903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe05c0a0a30 0x7fe05c11dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.254+0000 7fe062671700 1 -- 172.21.15.72:0/4187508903 >> 172.21.15.72:0/4187508903 conn(0x7fe05c0a3050 msgr2=0x7fe05c132b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.254+0000 7fe062671700 1 -- 172.21.15.72:0/4187508903 shutdown_connections 2023-10-03T10:18:18.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.254+0000 7fe062671700 1 -- 172.21.15.72:0/4187508903 wait complete. 2023-10-03T10:18:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.255+0000 7fda55225700 1 -- 172.21.15.72:0/3672998777 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda50130540 msgr2=0x7fda5011ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.255+0000 7fda55225700 1 --2- 172.21.15.72:0/3672998777 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda50130540 0x7fda5011ad00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fda4401f040 tx=0x7fda44004750 comp rx=0 tx=0).stop 2023-10-03T10:18:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.255+0000 7fda55225700 1 -- 172.21.15.72:0/3672998777 shutdown_connections 2023-10-03T10:18:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.255+0000 7fda55225700 1 --2- 172.21.15.72:0/3672998777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda50130e50 0x7fda5011b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.255+0000 7fda55225700 1 --2- 172.21.15.72:0/3672998777 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fda5006fb20 0x7fda5011a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.255+0000 7fda55225700 1 --2- 172.21.15.72:0/3672998777 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fda50130540 0x7fda5011ad00 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.255+0000 7fda55225700 1 -- 172.21.15.72:0/3672998777 >> 172.21.15.72:0/3672998777 conn(0x7fda500a2aa0 msgr2=0x7fda5012d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.255+0000 7fda55225700 1 -- 172.21.15.72:0/3672998777 shutdown_connections 2023-10-03T10:18:18.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.255+0000 7fda55225700 1 -- 172.21.15.72:0/3672998777 wait complete. 2023-10-03T10:18:18.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:18.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:18.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.283+0000 7f1d83268700 1 -- 172.21.15.72:0/3772739612 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1d7c11d5d0 con 0x7f1d7c136830 2023-10-03T10:18:18.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.283+0000 7f1d71ffb700 1 -- 172.21.15.72:0/3772739612 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d6c044060 con 0x7f1d7c136830 2023-10-03T10:18:18.283 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:18.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.285+0000 7f1d83268700 1 -- 172.21.15.72:0/3772739612 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d7c136830 msgr2=0x7f1d7c1c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.285+0000 7f1d83268700 1 --2- 172.21.15.72:0/3772739612 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d7c136830 0x7f1d7c1c8a40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00e8d0 tx=0x7f1d6c00ebe0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.286+0000 7f1d83268700 1 -- 172.21.15.72:0/3772739612 shutdown_connections 2023-10-03T10:18:18.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.286+0000 7f1d83268700 1 --2- 172.21.15.72:0/3772739612 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d7c139150 0x7f1d7c119f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.286+0000 7f1d83268700 1 --2- 172.21.15.72:0/3772739612 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d7c1338c0 0x7f1d7c1c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.286+0000 7f1d83268700 1 --2- 172.21.15.72:0/3772739612 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1d7c136830 0x7f1d7c1c8a40 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.286+0000 7f1d83268700 1 -- 172.21.15.72:0/3772739612 >> 172.21.15.72:0/3772739612 conn(0x7f1d7c0a2aa0 msgr2=0x7f1d7c09de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.286+0000 7f1d83268700 1 -- 172.21.15.72:0/3772739612 shutdown_connections 2023-10-03T10:18:18.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:18.286+0000 7f1d83268700 1 -- 172.21.15.72:0/3772739612 wait complete. 2023-10-03T10:18:18.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:19.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:19.269 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:19.269 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:19.298 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:19.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.367+0000 7fbba0fb7700 1 Processor -- start 2023-10-03T10:18:19.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.367+0000 7fbba0fb7700 1 -- start start 2023-10-03T10:18:19.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.368+0000 7fbba0fb7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb9c06e570 0x7fbb9c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.368+0000 7fbba0fb7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb9c06ee80 0x7fbb9c134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.368+0000 7fbba0fb7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c070ee0 con 0x7fbb9c09eca0 2023-10-03T10:18:19.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.368+0000 7fbba0fb7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c071480 con 0x7fbb9c06ee80 2023-10-03T10:18:19.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.368+0000 7fbba0fb7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c071b90 con 0x7fbb9c06e570 2023-10-03T10:18:19.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.368+0000 7fbb9ad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb9c06ee80 0x7fbb9c134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.368+0000 7fbb99d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbb9c09eca0 0x7fbb9c134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55242/0 (socket says 172.21.15.72:55242) 2023-10-03T10:18:19.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.368+0000 7fbb99d9b700 1 -- 172.21.15.72:0/807693347 learned_addr learned my addr 172.21.15.72:0/807693347 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:19.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.368+0000 7fbb9a59c700 1 --2- 172.21.15.72:0/807693347 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb9c06e570 0x7fbb9c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.368+0000 7fbb9959a700 1 -- 172.21.15.72:0/807693347 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178744971 0 0) 0x7fbb9c070ee0 con 0x7fbb9c09eca0 2023-10-03T10:18:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.368+0000 7fbb9ad9d700 1 -- 172.21.15.72:0/807693347 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb9c06e570 msgr2=0x7fbb9c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.368+0000 7fbb9ad9d700 1 --2- 172.21.15.72:0/807693347 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb9c06e570 0x7fbb9c06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.368+0000 7fbb9ad9d700 1 -- 172.21.15.72:0/807693347 >> v1:172.21.15.72:6789/0 conn(0x7fbb9c09eca0 legacy=0x7fbb9c134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.369+0000 7fbb9ad9d700 1 -- 172.21.15.72:0/807693347 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c0711a0 con 0x7fbb9c06ee80 2023-10-03T10:18:19.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.369+0000 7fbb9ad9d700 1 --2- 172.21.15.72:0/807693347 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb9c06ee80 0x7fbb9c134d20 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009dc0 tx=0x7fbb9400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0d86a2adce57405 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.369+0000 7fbb9959a700 1 -- 172.21.15.72:0/807693347 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9400e070 con 0x7fbb9c06ee80 2023-10-03T10:18:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.369+0000 7fbb9959a700 1 -- 172.21.15.72:0/807693347 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9400bb20 con 0x7fbb9c06ee80 2023-10-03T10:18:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.369+0000 7fbb9959a700 1 -- 172.21.15.72:0/807693347 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94012430 con 0x7fbb9c06ee80 2023-10-03T10:18:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.370+0000 7fbba0fb7700 1 -- 172.21.15.72:0/807693347 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb9c06ee80 msgr2=0x7fbb9c134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.370+0000 7fbba0fb7700 1 --2- 172.21.15.72:0/807693347 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb9c06ee80 0x7fbb9c134d20 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009dc0 tx=0x7fbb9400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.370+0000 7fbba0fb7700 1 -- 172.21.15.72:0/807693347 shutdown_connections 2023-10-03T10:18:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.370+0000 7fbba0fb7700 1 --2- 172.21.15.72:0/807693347 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb9c06ee80 0x7fbb9c134d20 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.370+0000 7fbba0fb7700 1 --2- 172.21.15.72:0/807693347 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb9c06e570 0x7fbb9c06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.370+0000 7fbba0fb7700 1 -- 172.21.15.72:0/807693347 >> 172.21.15.72:0/807693347 conn(0x7fbb9c0a2aa0 msgr2=0x7fbb9c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.370+0000 7fbba0fb7700 1 -- 172.21.15.72:0/807693347 shutdown_connections 2023-10-03T10:18:19.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.370+0000 7fbba0fb7700 1 -- 172.21.15.72:0/807693347 wait complete. 2023-10-03T10:18:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.371+0000 7fbba0fb7700 1 Processor -- start 2023-10-03T10:18:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.371+0000 7fbba0fb7700 1 -- start start 2023-10-03T10:18:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.371+0000 7fbba0fb7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb9c06e570 0x7fbb9c1231e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.371+0000 7fbba0fb7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb9c06ee80 0x7fbb9c123720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.371+0000 7fbba0fb7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb9c123c60 0x7fbb9c1d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.371+0000 7fbba0fb7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c1268c0 con 0x7fbb9c123c60 2023-10-03T10:18:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.371+0000 7fbba0fb7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c125560 con 0x7fbb9c06ee80 2023-10-03T10:18:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.371+0000 7fbba0fb7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c135780 con 0x7fbb9c06e570 2023-10-03T10:18:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbb99d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb9c06ee80 0x7fbb9c123720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbb99d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb9c06ee80 0x7fbb9c123720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55788/0 (socket says 172.21.15.72:55788) 2023-10-03T10:18:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbb99d9b700 1 -- 172.21.15.72:0/2016732943 learned_addr learned my addr 172.21.15.72:0/2016732943 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbb9a59c700 1 --2- 172.21.15.72:0/2016732943 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb9c06e570 0x7fbb9c1231e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbb9ad9d700 1 --2- 172.21.15.72:0/2016732943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb9c123c60 0x7fbb9c1d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbb99d9b700 1 -- 172.21.15.72:0/2016732943 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb9c06e570 msgr2=0x7fbb9c1231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbb99d9b700 1 --2- 172.21.15.72:0/2016732943 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb9c06e570 0x7fbb9c1231e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbb99d9b700 1 -- 172.21.15.72:0/2016732943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb9c123c60 msgr2=0x7fbb9c1d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbb99d9b700 1 --2- 172.21.15.72:0/2016732943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb9c123c60 0x7fbb9c1d2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbb99d9b700 1 -- 172.21.15.72:0/2016732943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb94009a70 con 0x7fbb9c06ee80 2023-10-03T10:18:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbb99d9b700 1 --2- 172.21.15.72:0/2016732943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb9c06ee80 0x7fbb9c123720 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000c550 tx=0x7fbb9000c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbb8affd700 1 -- 172.21.15.72:0/2016732943 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90004c80 con 0x7fbb9c06ee80 2023-10-03T10:18:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbb8affd700 1 -- 172.21.15.72:0/2016732943 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb90004de0 con 0x7fbb9c06ee80 2023-10-03T10:18:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbba0fb7700 1 -- 172.21.15.72:0/2016732943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9c070610 con 0x7fbb9c06ee80 2023-10-03T10:18:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbb8affd700 1 -- 172.21.15.72:0/2016732943 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90007310 con 0x7fbb9c06ee80 2023-10-03T10:18:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.372+0000 7fbba0fb7700 1 -- 172.21.15.72:0/2016732943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9c125ab0 con 0x7fbb9c06ee80 2023-10-03T10:18:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.373+0000 7fbb8affd700 1 -- 172.21.15.72:0/2016732943 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb90007470 con 0x7fbb9c06ee80 2023-10-03T10:18:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.373+0000 7fbb8affd700 1 -- 172.21.15.72:0/2016732943 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbb9003f220 con 0x7fbb9c06ee80 2023-10-03T10:18:19.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.374+0000 7fbba0fb7700 1 -- 172.21.15.72:0/2016732943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9c126720 con 0x7fbb9c06ee80 2023-10-03T10:18:19.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.378+0000 7fbb8affd700 1 -- 172.21.15.72:0/2016732943 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb9c126720 con 0x7fbb9c06ee80 2023-10-03T10:18:19.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.405+0000 7f6014626700 1 Processor -- start 2023-10-03T10:18:19.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.405+0000 7f6014626700 1 -- start start 2023-10-03T10:18:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f6014626700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600c131630 0x7f600c131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f6014626700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f600c06eba0 0x7f600c139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f6014626700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600c071a00 con 0x7f600c131f40 2023-10-03T10:18:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f6014626700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600c131430 con 0x7f600c06eba0 2023-10-03T10:18:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f6014626700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f600c09a510 con 0x7f600c131630 2023-10-03T10:18:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f6012bc3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f600c06eba0 0x7f600c139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f60123c2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600c131630 0x7f600c131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f60123c2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600c131630 0x7f600c131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36418/0 (socket says 172.21.15.72:36418) 2023-10-03T10:18:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f6012bc3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f600c06eba0 0x7f600c139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47498/0 (socket says 172.21.15.72:47498) 2023-10-03T10:18:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f60123c2700 1 -- 172.21.15.72:0/496444929 learned_addr learned my addr 172.21.15.72:0/496444929 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f60123c2700 1 -- 172.21.15.72:0/496444929 >> v2:172.21.15.72:3300/0 conn(0x7f600c06eba0 msgr2=0x7f600c139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f60123c2700 1 --2- 172.21.15.72:0/496444929 >> v2:172.21.15.72:3300/0 conn(0x7f600c06eba0 0x7f600c139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f60123c2700 1 -- 172.21.15.72:0/496444929 >> v1:172.21.15.72:6789/0 conn(0x7f600c131f40 legacy=0x7f600c06e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f60123c2700 1 -- 172.21.15.72:0/496444929 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c0721c0 con 0x7f600c131630 2023-10-03T10:18:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f6012bc3700 1 --2- 172.21.15.72:0/496444929 >> v2:172.21.15.72:3300/0 conn(0x7f600c06eba0 0x7f600c139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.406+0000 7f60123c2700 1 --2- 172.21.15.72:0/496444929 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600c131630 0x7f600c131a00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f60080098f0 tx=0x7f6008009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5199921d2c51eb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.407+0000 7f60113c0700 1 -- 172.21.15.72:0/496444929 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008011830 con 0x7f600c131630 2023-10-03T10:18:19.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.407+0000 7f60113c0700 1 -- 172.21.15.72:0/496444929 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6008011990 con 0x7f600c131630 2023-10-03T10:18:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.407+0000 7f60113c0700 1 -- 172.21.15.72:0/496444929 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6008011d20 con 0x7f600c131630 2023-10-03T10:18:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.407+0000 7f6014626700 1 -- 172.21.15.72:0/496444929 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600c131630 msgr2=0x7f600c131a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.407+0000 7f6014626700 1 --2- 172.21.15.72:0/496444929 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600c131630 0x7f600c131a00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f60080098f0 tx=0x7f6008009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.407+0000 7f6014626700 1 -- 172.21.15.72:0/496444929 shutdown_connections 2023-10-03T10:18:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.407+0000 7f6014626700 1 --2- 172.21.15.72:0/496444929 >> v2:172.21.15.72:3300/0 conn(0x7f600c06eba0 0x7f600c139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.407+0000 7f6014626700 1 --2- 172.21.15.72:0/496444929 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600c131630 0x7f600c131a00 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.407+0000 7f6014626700 1 -- 172.21.15.72:0/496444929 >> 172.21.15.72:0/496444929 conn(0x7f600c0a2aa0 msgr2=0x7f600c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.409+0000 7f6014626700 1 -- 172.21.15.72:0/496444929 shutdown_connections 2023-10-03T10:18:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.409+0000 7f6014626700 1 -- 172.21.15.72:0/496444929 wait complete. 2023-10-03T10:18:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.410+0000 7f6014626700 1 Processor -- start 2023-10-03T10:18:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.410+0000 7f6014626700 1 -- start start 2023-10-03T10:18:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.410+0000 7f6014626700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600c06eba0 0x7f600c1194f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.410+0000 7f6014626700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600c131630 0x7f600c119a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.411+0000 7f60123c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600c06eba0 0x7f600c1194f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.411+0000 7f60123c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600c06eba0 0x7f600c1194f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55794/0 (socket says 172.21.15.72:55794) 2023-10-03T10:18:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.411+0000 7f6014626700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600c131f40 0x7f600c119f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.411+0000 7f6014626700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c11d9d0 con 0x7f600c131630 2023-10-03T10:18:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.411+0000 7f6014626700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c11d010 con 0x7f600c06eba0 2023-10-03T10:18:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.411+0000 7f6014626700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f600c11c3c0 con 0x7f600c131f40 2023-10-03T10:18:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.411+0000 7f6011bc1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600c131630 0x7f600c119a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.411+0000 7f6011bc1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600c131630 0x7f600c119a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47506/0 (socket says 172.21.15.72:47506) 2023-10-03T10:18:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.411+0000 7f6011bc1700 1 -- 172.21.15.72:0/2041528716 learned_addr learned my addr 172.21.15.72:0/2041528716 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.411+0000 7f6011bc1700 1 -- 172.21.15.72:0/2041528716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600c131f40 msgr2=0x7f600c119f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.411+0000 7f6011bc1700 1 --2- 172.21.15.72:0/2041528716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600c131f40 0x7f600c119f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.411+0000 7f6011bc1700 1 -- 172.21.15.72:0/2041528716 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600c06eba0 msgr2=0x7f600c1194f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.411+0000 7f6011bc1700 1 --2- 172.21.15.72:0/2041528716 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600c06eba0 0x7f600c1194f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.411+0000 7f6011bc1700 1 -- 172.21.15.72:0/2041528716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6004009a70 con 0x7f600c131630 2023-10-03T10:18:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.412+0000 7f6011bc1700 1 --2- 172.21.15.72:0/2041528716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600c131630 0x7f600c119a30 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc00c430 tx=0x7f5ffc00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.413+0000 7f6002ffd700 1 -- 172.21.15.72:0/2041528716 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc0052d0 con 0x7f600c131630 2023-10-03T10:18:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.413+0000 7f6002ffd700 1 -- 172.21.15.72:0/2041528716 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ffc005430 con 0x7f600c131630 2023-10-03T10:18:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.413+0000 7f6002ffd700 1 -- 172.21.15.72:0/2041528716 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc0038c0 con 0x7f600c131630 2023-10-03T10:18:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.413+0000 7f6014626700 1 -- 172.21.15.72:0/2041528716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6008009550 con 0x7f600c131630 2023-10-03T10:18:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.413+0000 7f6014626700 1 -- 172.21.15.72:0/2041528716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600c099f20 con 0x7f600c131630 2023-10-03T10:18:19.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.414+0000 7f6014626700 1 -- 172.21.15.72:0/2041528716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600c074ea0 con 0x7f600c131630 2023-10-03T10:18:19.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.415+0000 7f6002ffd700 1 -- 172.21.15.72:0/2041528716 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ffc003a20 con 0x7f600c131630 2023-10-03T10:18:19.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.418+0000 7fd7bbb5f700 1 Processor -- start 2023-10-03T10:18:19.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.419+0000 7f6002ffd700 1 -- 172.21.15.72:0/2041528716 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5ffc01ade0 con 0x7f600c131630 2023-10-03T10:18:19.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.419+0000 7fd7bbb5f700 1 -- start start 2023-10-03T10:18:19.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.419+0000 7fd7bbb5f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b409de00 0x7fd7b409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.419+0000 7fd7bbb5f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b413d1f0 0x7fd7b413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.419+0000 7fd7bbb5f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b409a810 con 0x7fd7b406a770 2023-10-03T10:18:19.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.419+0000 7fd7bbb5f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b406ab40 con 0x7fd7b413d1f0 2023-10-03T10:18:19.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.419+0000 7fd7bbb5f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b409ebc0 con 0x7fd7b409de00 2023-10-03T10:18:19.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.420+0000 7fd7b98fb700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd7b406a770 0x7fd7b409d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55272/0 (socket says 172.21.15.72:55272) 2023-10-03T10:18:19.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.420+0000 7fd7b98fb700 1 -- 172.21.15.72:0/3702380665 learned_addr learned my addr 172.21.15.72:0/3702380665 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:19.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.420+0000 7fd7ba0fc700 1 --2- 172.21.15.72:0/3702380665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b413d1f0 0x7fd7b413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.420+0000 7fd7b90fa700 1 --2- 172.21.15.72:0/3702380665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b409de00 0x7fd7b409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.420+0000 7fd7b90fa700 1 -- 172.21.15.72:0/3702380665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b413d1f0 msgr2=0x7fd7b413f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.420+0000 7fd7b90fa700 1 --2- 172.21.15.72:0/3702380665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b413d1f0 0x7fd7b413f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.420+0000 7fd7b90fa700 1 -- 172.21.15.72:0/3702380665 >> v1:172.21.15.72:6789/0 conn(0x7fd7b406a770 legacy=0x7fd7b409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.420+0000 7fd7b90fa700 1 -- 172.21.15.72:0/3702380665 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b409e920 con 0x7fd7b409de00 2023-10-03T10:18:19.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.420+0000 7fd7b90fa700 1 --2- 172.21.15.72:0/3702380665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b409de00 0x7fd7b409e250 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009870 tx=0x7fd7a4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42fa51657403817e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.421+0000 7fd7b88f9700 1 -- 172.21.15.72:0/3702380665 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4011830 con 0x7fd7b409de00 2023-10-03T10:18:19.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.421+0000 7fd7b88f9700 1 -- 172.21.15.72:0/3702380665 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a4011990 con 0x7fd7b409de00 2023-10-03T10:18:19.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.421+0000 7fd7b88f9700 1 -- 172.21.15.72:0/3702380665 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4011d20 con 0x7fd7b409de00 2023-10-03T10:18:19.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.421+0000 7f6002ffd700 1 -- 172.21.15.72:0/2041528716 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ffc044060 con 0x7f600c131630 2023-10-03T10:18:19.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.422+0000 7fd7bbb5f700 1 -- 172.21.15.72:0/3702380665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b409de00 msgr2=0x7fd7b409e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.422+0000 7fd7bbb5f700 1 --2- 172.21.15.72:0/3702380665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b409de00 0x7fd7b409e250 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4009870 tx=0x7fd7a4009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:19.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.422+0000 7fd7bbb5f700 1 -- 172.21.15.72:0/3702380665 shutdown_connections 2023-10-03T10:18:19.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.422+0000 7fd7bbb5f700 1 --2- 172.21.15.72:0/3702380665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b413d1f0 0x7fd7b413f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.422+0000 7fd7bbb5f700 1 --2- 172.21.15.72:0/3702380665 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b409de00 0x7fd7b409e250 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.422+0000 7fd7bbb5f700 1 -- 172.21.15.72:0/3702380665 >> 172.21.15.72:0/3702380665 conn(0x7fd7b4066f50 msgr2=0x7fd7b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.422+0000 7fd7bbb5f700 1 -- 172.21.15.72:0/3702380665 shutdown_connections 2023-10-03T10:18:19.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.422+0000 7fd7bbb5f700 1 -- 172.21.15.72:0/3702380665 wait complete. 2023-10-03T10:18:19.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.423+0000 7fd7bbb5f700 1 Processor -- start 2023-10-03T10:18:19.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.423+0000 7fd7bbb5f700 1 -- start start 2023-10-03T10:18:19.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7bbb5f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b406a770 0x7fd7b411c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7bbb5f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b409de00 0x7fd7b413b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7bbb5f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b413d1f0 0x7fd7b413bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7bbb5f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b411cfb0 con 0x7fd7b409de00 2023-10-03T10:18:19.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7bbb5f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b411d7f0 con 0x7fd7b406a770 2023-10-03T10:18:19.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7bbb5f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b411e710 con 0x7fd7b413d1f0 2023-10-03T10:18:19.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7b90fa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b409de00 0x7fd7b413b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7b90fa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b409de00 0x7fd7b413b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47514/0 (socket says 172.21.15.72:47514) 2023-10-03T10:18:19.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7b90fa700 1 -- 172.21.15.72:0/2670535708 learned_addr learned my addr 172.21.15.72:0/2670535708 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:19.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7ba0fc700 1 --2- 172.21.15.72:0/2670535708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b413d1f0 0x7fd7b413bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7b98fb700 1 --2- 172.21.15.72:0/2670535708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b406a770 0x7fd7b411c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7b90fa700 1 -- 172.21.15.72:0/2670535708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b413d1f0 msgr2=0x7fd7b413bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7b90fa700 1 --2- 172.21.15.72:0/2670535708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b413d1f0 0x7fd7b413bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7b90fa700 1 -- 172.21.15.72:0/2670535708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b406a770 msgr2=0x7fd7b411c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7b90fa700 1 --2- 172.21.15.72:0/2670535708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b406a770 0x7fd7b411c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7b90fa700 1 -- 172.21.15.72:0/2670535708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a40094a0 con 0x7fd7b409de00 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.424+0000 7fd7b98fb700 1 --2- 172.21.15.72:0/2670535708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b406a770 0x7fd7b411c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.425+0000 7fd7b90fa700 1 --2- 172.21.15.72:0/2670535708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b409de00 0x7fd7b413b5f0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fd7a40090b0 tx=0x7fd7a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.425+0000 7fd7aa7fc700 1 -- 172.21.15.72:0/2670535708 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a40036a0 con 0x7fd7b409de00 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.425+0000 7fd7aa7fc700 1 -- 172.21.15.72:0/2670535708 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a401f070 con 0x7fd7b409de00 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.425+0000 7fd7aa7fc700 1 -- 172.21.15.72:0/2670535708 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4003a60 con 0x7fd7b409de00 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.425+0000 7fd7bbb5f700 1 -- 172.21.15.72:0/2670535708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b413cd10 con 0x7fd7b409de00 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.425+0000 7fd7bbb5f700 1 -- 172.21.15.72:0/2670535708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b411f010 con 0x7fd7b409de00 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.426+0000 7fd7aa7fc700 1 -- 172.21.15.72:0/2670535708 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd7a4003bc0 con 0x7fd7b409de00 2023-10-03T10:18:19.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.426+0000 7fd7aa7fc700 1 -- 172.21.15.72:0/2670535708 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd7a4021070 con 0x7fd7b409de00 2023-10-03T10:18:19.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.426+0000 7fd7bbb5f700 1 -- 172.21.15.72:0/2670535708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b4074ea0 con 0x7fd7b409de00 2023-10-03T10:18:19.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.431+0000 7fd7aa7fc700 1 -- 172.21.15.72:0/2670535708 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7a4015080 con 0x7fd7b409de00 2023-10-03T10:18:19.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.450+0000 7f8be3200700 1 Processor -- start 2023-10-03T10:18:19.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.450+0000 7f8be3200700 1 -- start start 2023-10-03T10:18:19.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.450+0000 7f8be3200700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8bdc09e930 0x7f8bdc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.450+0000 7f8be3200700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8bdc09f240 0x7f8bdc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.450+0000 7f8be3200700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8bdc09f650 0x7f8bdc131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.450+0000 7f8be3200700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bdc070940 con 0x7f8bdc09f240 2023-10-03T10:18:19.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.450+0000 7f8be3200700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc06fd60 con 0x7f8bdc09f650 2023-10-03T10:18:19.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.450+0000 7f8be3200700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc06fa80 con 0x7f8bdc09e930 2023-10-03T10:18:19.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.451+0000 7f8bdbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8bdc09f240 0x7f8bdc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.451+0000 7f8be0f9c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8bdc09e930 0x7f8bdc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.451+0000 7f8bdbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8bdc09f240 0x7f8bdc1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47528/0 (socket says 172.21.15.72:47528) 2023-10-03T10:18:19.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.451+0000 7f8be0f9c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8bdc09e930 0x7f8bdc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36472/0 (socket says 172.21.15.72:36472) 2023-10-03T10:18:19.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.451+0000 7f8bdbfff700 1 -- 172.21.15.72:0/2090398845 learned_addr learned my addr 172.21.15.72:0/2090398845 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:19.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.451+0000 7f8be179d700 1 --2- 172.21.15.72:0/2090398845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8bdc09f650 0x7f8bdc131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.451+0000 7f8bdbfff700 1 -- 172.21.15.72:0/2090398845 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8bdc09e930 msgr2=0x7f8bdc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.451+0000 7f8bdbfff700 1 --2- 172.21.15.72:0/2090398845 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8bdc09e930 0x7f8bdc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.451+0000 7f8bdbfff700 1 -- 172.21.15.72:0/2090398845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8bdc09f650 msgr2=0x7f8bdc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.451+0000 7f8bdbfff700 1 --2- 172.21.15.72:0/2090398845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8bdc09f650 0x7f8bdc131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.451+0000 7f8bdbfff700 1 -- 172.21.15.72:0/2090398845 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc09fb60 con 0x7f8bdc09f240 2023-10-03T10:18:19.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.451+0000 7f8bdbfff700 1 --2- 172.21.15.72:0/2090398845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bdc09f240 0x7f8bdc1317f0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80098f0 tx=0x7f8bc8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b49784ddbce045f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.451+0000 7f8bdb7fe700 1 -- 172.21.15.72:0/2090398845 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8011830 con 0x7f8bdc09f240 2023-10-03T10:18:19.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.451+0000 7f8bdb7fe700 1 -- 172.21.15.72:0/2090398845 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc8011990 con 0x7f8bdc09f240 2023-10-03T10:18:19.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.451+0000 7f8bdb7fe700 1 -- 172.21.15.72:0/2090398845 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8011d20 con 0x7f8bdc09f240 2023-10-03T10:18:19.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.452+0000 7f8be3200700 1 -- 172.21.15.72:0/2090398845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bdc09f240 msgr2=0x7f8bdc1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.452+0000 7f8be3200700 1 --2- 172.21.15.72:0/2090398845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bdc09f240 0x7f8bdc1317f0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80098f0 tx=0x7f8bc8009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:19.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.452+0000 7f8be3200700 1 -- 172.21.15.72:0/2090398845 shutdown_connections 2023-10-03T10:18:19.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.452+0000 7f8be3200700 1 --2- 172.21.15.72:0/2090398845 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8bdc09f650 0x7f8bdc131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.452+0000 7f8be3200700 1 --2- 172.21.15.72:0/2090398845 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8bdc09e930 0x7f8bdc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.452+0000 7f8be3200700 1 --2- 172.21.15.72:0/2090398845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bdc09f240 0x7f8bdc1317f0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.452+0000 7f8be3200700 1 -- 172.21.15.72:0/2090398845 >> 172.21.15.72:0/2090398845 conn(0x7f8bdc0a4210 msgr2=0x7f8bdc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.452+0000 7f8be3200700 1 -- 172.21.15.72:0/2090398845 shutdown_connections 2023-10-03T10:18:19.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.452+0000 7f8be3200700 1 -- 172.21.15.72:0/2090398845 wait complete. 2023-10-03T10:18:19.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.454+0000 7f8be3200700 1 Processor -- start 2023-10-03T10:18:19.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.454+0000 7f8be3200700 1 -- start start 2023-10-03T10:18:19.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.454+0000 7f8be3200700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8bdc09e930 0x7f8bdc1a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.454+0000 7f8be3200700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bdc09f240 0x7f8bdc1a21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.454+0000 7f8be3200700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8bdc09f650 0x7f8bdc1a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.454+0000 7f8be3200700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc1a3150 con 0x7f8bdc09f240 2023-10-03T10:18:19.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.454+0000 7f8be3200700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc1a38b0 con 0x7f8bdc09e930 2023-10-03T10:18:19.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.454+0000 7f8be3200700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc1a3ed0 con 0x7f8bdc09f650 2023-10-03T10:18:19.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.455+0000 7f8be0f9c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8bdc09e930 0x7f8bdc1a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.455+0000 7f8be0f9c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8bdc09e930 0x7f8bdc1a1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55832/0 (socket says 172.21.15.72:55832) 2023-10-03T10:18:19.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.455+0000 7f8be0f9c700 1 -- 172.21.15.72:0/1128576442 learned_addr learned my addr 172.21.15.72:0/1128576442 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:19.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.455+0000 7f8be179d700 1 --2- 172.21.15.72:0/1128576442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8bdc09f650 0x7f8bdc1a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.455+0000 7f8bdbfff700 1 --2- 172.21.15.72:0/1128576442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bdc09f240 0x7f8bdc1a21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.455+0000 7f8be179d700 1 -- 172.21.15.72:0/1128576442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8bdc09e930 msgr2=0x7f8bdc1a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.455+0000 7f8be179d700 1 --2- 172.21.15.72:0/1128576442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8bdc09e930 0x7f8bdc1a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.455+0000 7f8be179d700 1 -- 172.21.15.72:0/1128576442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bdc09f240 msgr2=0x7f8bdc1a21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.455+0000 7f8be179d700 1 --2- 172.21.15.72:0/1128576442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bdc09f240 0x7f8bdc1a21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.455+0000 7f8be179d700 1 -- 172.21.15.72:0/1128576442 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc8009550 con 0x7f8bdc09f650 2023-10-03T10:18:19.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.455+0000 7f8bdbfff700 1 --2- 172.21.15.72:0/1128576442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bdc09f240 0x7f8bdc1a21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.455+0000 7f8be179d700 1 --2- 172.21.15.72:0/1128576442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8bdc09f650 0x7f8bdc1a2720 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4007d90 tx=0x7f8bd400e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.456+0000 7f8bd97fa700 1 -- 172.21.15.72:0/1128576442 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4018070 con 0x7f8bdc09f650 2023-10-03T10:18:19.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.456+0000 7f8bd97fa700 1 -- 172.21.15.72:0/1128576442 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd400eb30 con 0x7f8bdc09f650 2023-10-03T10:18:19.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.456+0000 7f8be3200700 1 -- 172.21.15.72:0/1128576442 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bdc0a0190 con 0x7f8bdc09f650 2023-10-03T10:18:19.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.456+0000 7f8bd97fa700 1 -- 172.21.15.72:0/1128576442 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd400eec0 con 0x7f8bdc09f650 2023-10-03T10:18:19.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.456+0000 7f8be3200700 1 -- 172.21.15.72:0/1128576442 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bdc1a5540 con 0x7f8bdc09f650 2023-10-03T10:18:19.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.457+0000 7f8be3200700 1 -- 172.21.15.72:0/1128576442 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bdc1a4b00 con 0x7f8bdc09f650 2023-10-03T10:18:19.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.457+0000 7f8bd97fa700 1 -- 172.21.15.72:0/1128576442 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bd4003a20 con 0x7f8bdc09f650 2023-10-03T10:18:19.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.458+0000 7f8bd97fa700 1 -- 172.21.15.72:0/1128576442 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8bd403ff00 con 0x7f8bdc09f650 2023-10-03T10:18:19.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.462+0000 7f8bd97fa700 1 -- 172.21.15.72:0/1128576442 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bd4003cd0 con 0x7f8bdc09f650 2023-10-03T10:18:19.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.617+0000 7fbba0fb7700 1 -- 172.21.15.72:0/2016732943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbb9c126720 con 0x7fbb9c06ee80 2023-10-03T10:18:19.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.618+0000 7fbb8affd700 1 -- 172.21.15.72:0/2016732943 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb9c126720 con 0x7fbb9c06ee80 2023-10-03T10:18:19.617 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:19.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.620+0000 7f6014626700 1 -- 172.21.15.72:0/2041528716 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f600c06b9e0 con 0x7f600c131630 2023-10-03T10:18:19.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.620+0000 7f6002ffd700 1 -- 172.21.15.72:0/2041528716 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5ffc017090 con 0x7f600c131630 2023-10-03T10:18:19.620 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:19.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.620+0000 7fbba0fb7700 1 -- 172.21.15.72:0/2016732943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb9c06ee80 msgr2=0x7fbb9c123720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.620+0000 7fbba0fb7700 1 --2- 172.21.15.72:0/2016732943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb9c06ee80 0x7fbb9c123720 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000c550 tx=0x7fbb9000c860 comp rx=0 tx=0).stop 2023-10-03T10:18:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.620+0000 7fbba0fb7700 1 -- 172.21.15.72:0/2016732943 shutdown_connections 2023-10-03T10:18:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.620+0000 7fbba0fb7700 1 --2- 172.21.15.72:0/2016732943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb9c123c60 0x7fbb9c1d2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.620+0000 7fbba0fb7700 1 --2- 172.21.15.72:0/2016732943 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb9c06e570 0x7fbb9c1231e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.620+0000 7fbba0fb7700 1 --2- 172.21.15.72:0/2016732943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb9c06ee80 0x7fbb9c123720 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.620+0000 7fbba0fb7700 1 -- 172.21.15.72:0/2016732943 >> 172.21.15.72:0/2016732943 conn(0x7fbb9c0a2aa0 msgr2=0x7fbb9c0a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.620+0000 7fbba0fb7700 1 -- 172.21.15.72:0/2016732943 shutdown_connections 2023-10-03T10:18:19.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.620+0000 7fbba0fb7700 1 -- 172.21.15.72:0/2016732943 wait complete. 2023-10-03T10:18:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.622+0000 7f6014626700 1 -- 172.21.15.72:0/2041528716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600c131630 msgr2=0x7f600c119a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.622+0000 7f6014626700 1 --2- 172.21.15.72:0/2041528716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600c131630 0x7f600c119a30 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc00c430 tx=0x7f5ffc00c740 comp rx=0 tx=0).stop 2023-10-03T10:18:19.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.626+0000 7f6014626700 1 -- 172.21.15.72:0/2041528716 shutdown_connections 2023-10-03T10:18:19.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.626+0000 7f6014626700 1 --2- 172.21.15.72:0/2041528716 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f600c131f40 0x7f600c119f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.626+0000 7f6014626700 1 --2- 172.21.15.72:0/2041528716 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f600c06eba0 0x7f600c1194f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.626+0000 7f6014626700 1 --2- 172.21.15.72:0/2041528716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f600c131630 0x7f600c119a30 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.626+0000 7f6014626700 1 -- 172.21.15.72:0/2041528716 >> 172.21.15.72:0/2041528716 conn(0x7f600c0a2aa0 msgr2=0x7f600c12e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.626+0000 7f6014626700 1 -- 172.21.15.72:0/2041528716 shutdown_connections 2023-10-03T10:18:19.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.626+0000 7f6014626700 1 -- 172.21.15.72:0/2041528716 wait complete. 2023-10-03T10:18:19.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:19.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:19.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.655+0000 7f8be3200700 1 -- 172.21.15.72:0/1128576442 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8bdc071d20 con 0x7f8bdc09f650 2023-10-03T10:18:19.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.655+0000 7f8bd97fa700 1 -- 172.21.15.72:0/1128576442 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bd401c370 con 0x7f8bdc09f650 2023-10-03T10:18:19.655 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.657+0000 7f8be3200700 1 -- 172.21.15.72:0/1128576442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8bdc09f650 msgr2=0x7f8bdc1a2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.657+0000 7f8be3200700 1 --2- 172.21.15.72:0/1128576442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8bdc09f650 0x7f8bdc1a2720 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4007d90 tx=0x7f8bd400e3c0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.657+0000 7f8be3200700 1 -- 172.21.15.72:0/1128576442 shutdown_connections 2023-10-03T10:18:19.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.657+0000 7f8be3200700 1 --2- 172.21.15.72:0/1128576442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8bdc09f650 0x7f8bdc1a2720 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.657+0000 7f8be3200700 1 --2- 172.21.15.72:0/1128576442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8bdc09e930 0x7f8bdc1a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.657+0000 7f8be3200700 1 --2- 172.21.15.72:0/1128576442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8bdc09f240 0x7f8bdc1a21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.657+0000 7f8be3200700 1 -- 172.21.15.72:0/1128576442 >> 172.21.15.72:0/1128576442 conn(0x7f8bdc0a4210 msgr2=0x7f8bdc1b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.658+0000 7f8be3200700 1 -- 172.21.15.72:0/1128576442 shutdown_connections 2023-10-03T10:18:19.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.658+0000 7f8be3200700 1 -- 172.21.15.72:0/1128576442 wait complete. 2023-10-03T10:18:19.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.665+0000 7fd7bbb5f700 1 -- 172.21.15.72:0/2670535708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd7b409a3d0 con 0x7fd7b409de00 2023-10-03T10:18:19.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.666+0000 7fd7aa7fc700 1 -- 172.21.15.72:0/2670535708 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd7a4019b50 con 0x7fd7b409de00 2023-10-03T10:18:19.665 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:19.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.668+0000 7fd7bbb5f700 1 -- 172.21.15.72:0/2670535708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b409de00 msgr2=0x7fd7b413b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.668+0000 7fd7bbb5f700 1 --2- 172.21.15.72:0/2670535708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b409de00 0x7fd7b413b5f0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fd7a40090b0 tx=0x7fd7a4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:19.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.668+0000 7fd7bbb5f700 1 -- 172.21.15.72:0/2670535708 shutdown_connections 2023-10-03T10:18:19.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.668+0000 7fd7bbb5f700 1 --2- 172.21.15.72:0/2670535708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd7b413d1f0 0x7fd7b413bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.668+0000 7fd7bbb5f700 1 --2- 172.21.15.72:0/2670535708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd7b406a770 0x7fd7b411c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.668+0000 7fd7bbb5f700 1 --2- 172.21.15.72:0/2670535708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7b409de00 0x7fd7b413b5f0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.668+0000 7fd7bbb5f700 1 -- 172.21.15.72:0/2670535708 >> 172.21.15.72:0/2670535708 conn(0x7fd7b4066f50 msgr2=0x7fd7b40a2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.668+0000 7fd7bbb5f700 1 -- 172.21.15.72:0/2670535708 shutdown_connections 2023-10-03T10:18:19.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:19.668+0000 7fd7bbb5f700 1 -- 172.21.15.72:0/2670535708 wait complete. 2023-10-03T10:18:19.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:19.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:20.638 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:20.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:20.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:20.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.775+0000 7f885aeee700 1 Processor -- start 2023-10-03T10:18:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.775+0000 7f885aeee700 1 -- start start 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.776+0000 7f885aeee700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f885409e1d0 0x7f8854135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.776+0000 7f885aeee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8854135e50 0x7f8854138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.776+0000 7f885aeee700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885409f130 con 0x7f885409d6f0 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.776+0000 7f885aeee700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885409f520 con 0x7f885409e1d0 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.776+0000 7f885aeee700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885409e930 con 0x7f8854135e50 2023-10-03T10:18:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.776+0000 7f885948b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8854135e50 0x7f8854138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.776+0000 7f885948b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8854135e50 0x7f8854138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55834/0 (socket says 172.21.15.72:55834) 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.776+0000 7f885948b700 1 -- 172.21.15.72:0/2618527557 learned_addr learned my addr 172.21.15.72:0/2618527557 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.776+0000 7f885948b700 1 -- 172.21.15.72:0/2618527557 >> v2:172.21.15.72:3300/0 conn(0x7f885409e1d0 msgr2=0x7f8854135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.776+0000 7f885948b700 1 --2- 172.21.15.72:0/2618527557 >> v2:172.21.15.72:3300/0 conn(0x7f885409e1d0 0x7f8854135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.776+0000 7f885948b700 1 -- 172.21.15.72:0/2618527557 >> v1:172.21.15.72:6789/0 conn(0x7f885409d6f0 legacy=0x7f885409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.776+0000 7f885948b700 1 -- 172.21.15.72:0/2618527557 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885409b2d0 con 0x7f8854135e50 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.776+0000 7f885948b700 1 --2- 172.21.15.72:0/2618527557 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8854135e50 0x7f8854138230 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f884c00d150 tx=0x7f884c00d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eb09ee7a05fbcbb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.776+0000 7f88537fe700 1 -- 172.21.15.72:0/2618527557 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c010070 con 0x7f8854135e50 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.777+0000 7f88537fe700 1 -- 172.21.15.72:0/2618527557 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c00dd80 con 0x7f8854135e50 2023-10-03T10:18:20.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.777+0000 7f88537fe700 1 -- 172.21.15.72:0/2618527557 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c00b310 con 0x7f8854135e50 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.777+0000 7f885aeee700 1 -- 172.21.15.72:0/2618527557 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8854135e50 msgr2=0x7f8854138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.777+0000 7f885aeee700 1 --2- 172.21.15.72:0/2618527557 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8854135e50 0x7f8854138230 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f884c00d150 tx=0x7f884c00d460 comp rx=0 tx=0).stop 2023-10-03T10:18:20.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.778+0000 7f885aeee700 1 -- 172.21.15.72:0/2618527557 shutdown_connections 2023-10-03T10:18:20.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.778+0000 7f885aeee700 1 --2- 172.21.15.72:0/2618527557 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8854135e50 0x7f8854138230 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.778+0000 7f885aeee700 1 --2- 172.21.15.72:0/2618527557 >> v2:172.21.15.72:3300/0 conn(0x7f885409e1d0 0x7f8854135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.778+0000 7f885aeee700 1 -- 172.21.15.72:0/2618527557 >> 172.21.15.72:0/2618527557 conn(0x7f8854066f50 msgr2=0x7f885409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.778+0000 7f885aeee700 1 -- 172.21.15.72:0/2618527557 shutdown_connections 2023-10-03T10:18:20.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.778+0000 7f885aeee700 1 -- 172.21.15.72:0/2618527557 wait complete. 2023-10-03T10:18:20.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.779+0000 7f885aeee700 1 Processor -- start 2023-10-03T10:18:20.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.779+0000 7f885aeee700 1 -- start start 2023-10-03T10:18:20.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.780+0000 7f885aeee700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f885409d6f0 0x7f8854134830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.780+0000 7f885aeee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885409e1d0 0x7f8854134d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.780+0000 7f885aeee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8854135e50 0x7f88541352b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.780+0000 7f885aeee700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88541312c0 con 0x7f885409e1d0 2023-10-03T10:18:20.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.780+0000 7f885aeee700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885411acd0 con 0x7f8854135e50 2023-10-03T10:18:20.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.780+0000 7f885aeee700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f885411a2e0 con 0x7f885409d6f0 2023-10-03T10:18:20.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.780+0000 7f8853fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885409e1d0 0x7f8854134d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.780+0000 7f8858c8a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f885409d6f0 0x7f8854134830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.780+0000 7f8853fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885409e1d0 0x7f8854134d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47568/0 (socket says 172.21.15.72:47568) 2023-10-03T10:18:20.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.780+0000 7f8853fff700 1 -- 172.21.15.72:0/2350036421 learned_addr learned my addr 172.21.15.72:0/2350036421 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:20.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.780+0000 7f885948b700 1 --2- 172.21.15.72:0/2350036421 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8854135e50 0x7f88541352b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.781+0000 7f8858c8a700 1 -- 172.21.15.72:0/2350036421 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8854135e50 msgr2=0x7f88541352b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.781+0000 7f8858c8a700 1 --2- 172.21.15.72:0/2350036421 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8854135e50 0x7f88541352b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.781+0000 7f8858c8a700 1 -- 172.21.15.72:0/2350036421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885409e1d0 msgr2=0x7f8854134d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.781+0000 7f8858c8a700 1 --2- 172.21.15.72:0/2350036421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885409e1d0 0x7f8854134d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.781+0000 7f8858c8a700 1 -- 172.21.15.72:0/2350036421 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c00bd40 con 0x7f885409d6f0 2023-10-03T10:18:20.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.781+0000 7f885948b700 1 --2- 172.21.15.72:0/2350036421 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8854135e50 0x7f88541352b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.781+0000 7f8858c8a700 1 --2- 172.21.15.72:0/2350036421 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f885409d6f0 0x7f8854134830 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f884800c3e0 tx=0x7f884800c6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.781+0000 7f88517fa700 1 -- 172.21.15.72:0/2350036421 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480052d0 con 0x7f885409d6f0 2023-10-03T10:18:20.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.781+0000 7f88517fa700 1 -- 172.21.15.72:0/2350036421 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8848005450 con 0x7f885409d6f0 2023-10-03T10:18:20.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.781+0000 7f88517fa700 1 -- 172.21.15.72:0/2350036421 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480038c0 con 0x7f885409d6f0 2023-10-03T10:18:20.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.781+0000 7f885aeee700 1 -- 172.21.15.72:0/2350036421 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885411b710 con 0x7f885409d6f0 2023-10-03T10:18:20.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.781+0000 7f885aeee700 1 -- 172.21.15.72:0/2350036421 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885409c700 con 0x7f885409d6f0 2023-10-03T10:18:20.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.782+0000 7f88517fa700 1 -- 172.21.15.72:0/2350036421 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8848003a20 con 0x7f885409d6f0 2023-10-03T10:18:20.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.782+0000 7f88517fa700 1 -- 172.21.15.72:0/2350036421 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f884803e5a0 con 0x7f885409d6f0 2023-10-03T10:18:20.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.783+0000 7f885aeee700 1 -- 172.21.15.72:0/2350036421 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885409e5a0 con 0x7f885409d6f0 2023-10-03T10:18:20.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.785+0000 7f3749112700 1 Processor -- start 2023-10-03T10:18:20.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.785+0000 7f3749112700 1 -- start start 2023-10-03T10:18:20.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.785+0000 7f3749112700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f374409d6f0 0x7f374409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3749112700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f374409e000 0x7f37441339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3749112700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f374409e410 0x7f3744133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3749112700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374406b460 con 0x7f374409d6f0 2023-10-03T10:18:20.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3749112700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374409b120 con 0x7f374409e410 2023-10-03T10:18:20.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3749112700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f374409a7e0 con 0x7f374409e000 2023-10-03T10:18:20.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3742d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f374409d6f0 0x7f374409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3742d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f374409d6f0 0x7f374409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47578/0 (socket says 172.21.15.72:47578) 2023-10-03T10:18:20.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3742d9d700 1 -- 172.21.15.72:0/4080616731 learned_addr learned my addr 172.21.15.72:0/4080616731 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:20.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3742d9d700 1 -- 172.21.15.72:0/4080616731 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f374409e000 msgr2=0x7f37441339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3742d9d700 1 --2- 172.21.15.72:0/4080616731 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f374409e000 0x7f37441339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3742d9d700 1 -- 172.21.15.72:0/4080616731 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f374409e410 msgr2=0x7f3744133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3742d9d700 1 --2- 172.21.15.72:0/4080616731 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f374409e410 0x7f3744133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3742d9d700 1 -- 172.21.15.72:0/4080616731 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374409a500 con 0x7f374409d6f0 2023-10-03T10:18:20.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3742d9d700 1 --2- 172.21.15.72:0/4080616731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374409d6f0 0x7f374409dac0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f37340098f0 tx=0x7f3734009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6f22fc610ac61d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3741d9b700 1 -- 172.21.15.72:0/4080616731 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373400b8a0 con 0x7f374409d6f0 2023-10-03T10:18:20.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3741d9b700 1 -- 172.21.15.72:0/4080616731 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373400ba00 con 0x7f374409d6f0 2023-10-03T10:18:20.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.786+0000 7f3741d9b700 1 -- 172.21.15.72:0/4080616731 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373400bd90 con 0x7f374409d6f0 2023-10-03T10:18:20.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.787+0000 7f3749112700 1 -- 172.21.15.72:0/4080616731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374409d6f0 msgr2=0x7f374409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.787+0000 7f3749112700 1 --2- 172.21.15.72:0/4080616731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374409d6f0 0x7f374409dac0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f37340098f0 tx=0x7f3734009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:20.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.787+0000 7f3749112700 1 -- 172.21.15.72:0/4080616731 shutdown_connections 2023-10-03T10:18:20.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.787+0000 7f3749112700 1 --2- 172.21.15.72:0/4080616731 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f374409e410 0x7f3744133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.787+0000 7f3749112700 1 --2- 172.21.15.72:0/4080616731 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374409d6f0 0x7f374409dac0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.787+0000 7f3749112700 1 --2- 172.21.15.72:0/4080616731 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f374409e000 0x7f37441339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.787+0000 7f3749112700 1 -- 172.21.15.72:0/4080616731 >> 172.21.15.72:0/4080616731 conn(0x7f3744066f50 msgr2=0x7f374409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.787+0000 7f3749112700 1 -- 172.21.15.72:0/4080616731 shutdown_connections 2023-10-03T10:18:20.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.787+0000 7f3749112700 1 -- 172.21.15.72:0/4080616731 wait complete. 2023-10-03T10:18:20.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.789+0000 7f3749112700 1 Processor -- start 2023-10-03T10:18:20.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.789+0000 7f88517fa700 1 -- 172.21.15.72:0/2350036421 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f885409e5a0 con 0x7f885409d6f0 2023-10-03T10:18:20.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.789+0000 7f3749112700 1 -- start start 2023-10-03T10:18:20.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.789+0000 7f3749112700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374409d6f0 0x7f37441a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.789+0000 7f3749112700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f374409e000 0x7f37441a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.789+0000 7f3749112700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f374409e410 0x7f37441a6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.789+0000 7f3749112700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37440a2320 con 0x7f374409d6f0 2023-10-03T10:18:20.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.789+0000 7f3749112700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37441a7ab0 con 0x7f374409e000 2023-10-03T10:18:20.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.789+0000 7f3749112700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f374409c710 con 0x7f374409e410 2023-10-03T10:18:20.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.790+0000 7f374259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f374409e000 0x7f37441a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.790+0000 7f374259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f374409e000 0x7f37441a62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55844/0 (socket says 172.21.15.72:55844) 2023-10-03T10:18:20.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.790+0000 7f374259c700 1 -- 172.21.15.72:0/3205035556 learned_addr learned my addr 172.21.15.72:0/3205035556 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:20.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.790+0000 7f3742d9d700 1 --2- 172.21.15.72:0/3205035556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374409d6f0 0x7f37441a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.790+0000 7f374259c700 1 -- 172.21.15.72:0/3205035556 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f374409e410 msgr2=0x7f37441a6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.790+0000 7f374259c700 1 --2- 172.21.15.72:0/3205035556 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f374409e410 0x7f37441a6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.790+0000 7f374259c700 1 -- 172.21.15.72:0/3205035556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374409d6f0 msgr2=0x7f37441a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.790+0000 7f374259c700 1 --2- 172.21.15.72:0/3205035556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374409d6f0 0x7f37441a5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.790+0000 7f374259c700 1 -- 172.21.15.72:0/3205035556 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3734009550 con 0x7f374409e000 2023-10-03T10:18:20.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.790+0000 7f374259c700 1 --2- 172.21.15.72:0/3205035556 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f374409e000 0x7f37441a62d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f373800b530 tx=0x7f373800b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.790+0000 7f372b7fe700 1 -- 172.21.15.72:0/3205035556 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3738011830 con 0x7f374409e000 2023-10-03T10:18:20.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.790+0000 7f372b7fe700 1 -- 172.21.15.72:0/3205035556 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37380119b0 con 0x7f374409e000 2023-10-03T10:18:20.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.790+0000 7f372b7fe700 1 -- 172.21.15.72:0/3205035556 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3738011d60 con 0x7f374409e000 2023-10-03T10:18:20.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.790+0000 7f3749112700 1 -- 172.21.15.72:0/3205035556 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37441a8c60 con 0x7f374409e000 2023-10-03T10:18:20.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.790+0000 7f3749112700 1 -- 172.21.15.72:0/3205035556 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37441a98b0 con 0x7f374409e000 2023-10-03T10:18:20.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.792+0000 7f372b7fe700 1 -- 172.21.15.72:0/3205035556 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f373801a400 con 0x7f374409e000 2023-10-03T10:18:20.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.792+0000 7f372b7fe700 1 -- 172.21.15.72:0/3205035556 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f373803f8f0 con 0x7f374409e000 2023-10-03T10:18:20.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.792+0000 7f3749112700 1 -- 172.21.15.72:0/3205035556 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3744074ea0 con 0x7f374409e000 2023-10-03T10:18:20.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.801+0000 7f372b7fe700 1 -- 172.21.15.72:0/3205035556 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3738015070 con 0x7f374409e000 2023-10-03T10:18:20.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.820+0000 7f6042b41700 1 Processor -- start 2023-10-03T10:18:20.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.820+0000 7f6042b41700 1 -- start start 2023-10-03T10:18:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.820+0000 7f6042b41700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f603c06c0e0 0x7f603c09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.820+0000 7f6042b41700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f603c134ec0 0x7f603c1379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.820+0000 7f6042b41700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c134980 con 0x7f603c137f20 2023-10-03T10:18:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.820+0000 7f6042b41700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603c06c4b0 con 0x7f603c134ec0 2023-10-03T10:18:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.820+0000 7f6042b41700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0a09c0 con 0x7f603c06c0e0 2023-10-03T10:18:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.820+0000 7f60408dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f603c06c0e0 0x7f603c09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.820+0000 7f603bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f603c134ec0 0x7f603c1379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.820+0000 7f60408dd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f603c06c0e0 0x7f603c09ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36524/0 (socket says 172.21.15.72:36524) 2023-10-03T10:18:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.820+0000 7f60408dd700 1 -- 172.21.15.72:0/3771762280 learned_addr learned my addr 172.21.15.72:0/3771762280 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.821+0000 7f60408dd700 1 -- 172.21.15.72:0/3771762280 >> v2:172.21.15.72:3300/0 conn(0x7f603c134ec0 msgr2=0x7f603c1379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.821+0000 7f60408dd700 1 --2- 172.21.15.72:0/3771762280 >> v2:172.21.15.72:3300/0 conn(0x7f603c134ec0 0x7f603c1379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.821+0000 7f60408dd700 1 -- 172.21.15.72:0/3771762280 >> v1:172.21.15.72:6789/0 conn(0x7f603c137f20 legacy=0x7f603c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.821+0000 7f60408dd700 1 -- 172.21.15.72:0/3771762280 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c0a0600 con 0x7f603c06c0e0 2023-10-03T10:18:20.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.821+0000 7f60408dd700 1 --2- 172.21.15.72:0/3771762280 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f603c06c0e0 0x7f603c09ac90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f60300098f0 tx=0x7f6030009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8ebf4017214bbee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.821+0000 7f603b7fe700 1 -- 172.21.15.72:0/3771762280 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030011830 con 0x7f603c06c0e0 2023-10-03T10:18:20.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.821+0000 7f603b7fe700 1 -- 172.21.15.72:0/3771762280 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6030011990 con 0x7f603c06c0e0 2023-10-03T10:18:20.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.821+0000 7f603b7fe700 1 -- 172.21.15.72:0/3771762280 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030011d20 con 0x7f603c06c0e0 2023-10-03T10:18:20.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.822+0000 7f6042b41700 1 -- 172.21.15.72:0/3771762280 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f603c06c0e0 msgr2=0x7f603c09ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.822+0000 7f6042b41700 1 --2- 172.21.15.72:0/3771762280 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f603c06c0e0 0x7f603c09ac90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f60300098f0 tx=0x7f6030009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:20.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.822+0000 7f6042b41700 1 -- 172.21.15.72:0/3771762280 shutdown_connections 2023-10-03T10:18:20.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.822+0000 7f6042b41700 1 --2- 172.21.15.72:0/3771762280 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f603c06c0e0 0x7f603c09ac90 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.822+0000 7f6042b41700 1 --2- 172.21.15.72:0/3771762280 >> v2:172.21.15.72:3300/0 conn(0x7f603c134ec0 0x7f603c1379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.822+0000 7f6042b41700 1 -- 172.21.15.72:0/3771762280 >> 172.21.15.72:0/3771762280 conn(0x7f603c0a4210 msgr2=0x7f603c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.822+0000 7f6042b41700 1 -- 172.21.15.72:0/3771762280 shutdown_connections 2023-10-03T10:18:20.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.822+0000 7f6042b41700 1 -- 172.21.15.72:0/3771762280 wait complete. 2023-10-03T10:18:20.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.823+0000 7f6042b41700 1 Processor -- start 2023-10-03T10:18:20.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.823+0000 7f6042b41700 1 -- start start 2023-10-03T10:18:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.824+0000 7f6042b41700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f603c06c0e0 0x7f603c11ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.824+0000 7f6042b41700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f603c134ec0 0x7f603c11b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.824+0000 7f6042b41700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f603c137f20 0x7f603c11b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.824+0000 7f6042b41700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0a3d30 con 0x7f603c137f20 2023-10-03T10:18:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.824+0000 7f6042b41700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c11e5e0 con 0x7f603c06c0e0 2023-10-03T10:18:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.824+0000 7f6042b41700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0a03f0 con 0x7f603c134ec0 2023-10-03T10:18:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.824+0000 7f60408dd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f603c06c0e0 0x7f603c11ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.824+0000 7f60408dd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f603c06c0e0 0x7f603c11ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55850/0 (socket says 172.21.15.72:55850) 2023-10-03T10:18:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.824+0000 7f60408dd700 1 -- 172.21.15.72:0/1718098252 learned_addr learned my addr 172.21.15.72:0/1718098252 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.824+0000 7f60410de700 1 --2- 172.21.15.72:0/1718098252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f603c137f20 0x7f603c11b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.824+0000 7f603bfff700 1 --2- 172.21.15.72:0/1718098252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f603c134ec0 0x7f603c11b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.825+0000 7f60408dd700 1 -- 172.21.15.72:0/1718098252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f603c134ec0 msgr2=0x7f603c11b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.825+0000 7f60408dd700 1 --2- 172.21.15.72:0/1718098252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f603c134ec0 0x7f603c11b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.825+0000 7f60408dd700 1 -- 172.21.15.72:0/1718098252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f603c137f20 msgr2=0x7f603c11b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.825+0000 7f60408dd700 1 --2- 172.21.15.72:0/1718098252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f603c137f20 0x7f603c11b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.825+0000 7f60408dd700 1 -- 172.21.15.72:0/1718098252 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6030009550 con 0x7f603c06c0e0 2023-10-03T10:18:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.825+0000 7f60410de700 1 --2- 172.21.15.72:0/1718098252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f603c137f20 0x7f603c11b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.825+0000 7f60408dd700 1 --2- 172.21.15.72:0/1718098252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f603c06c0e0 0x7f603c11ac10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6030014040 tx=0x7f6030004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.825+0000 7f60397fa700 1 -- 172.21.15.72:0/1718098252 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60300044d0 con 0x7f603c06c0e0 2023-10-03T10:18:20.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.825+0000 7f60397fa700 1 -- 172.21.15.72:0/1718098252 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603001e070 con 0x7f603c06c0e0 2023-10-03T10:18:20.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.825+0000 7f6042b41700 1 -- 172.21.15.72:0/1718098252 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c11c660 con 0x7f603c06c0e0 2023-10-03T10:18:20.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.825+0000 7f60397fa700 1 -- 172.21.15.72:0/1718098252 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60300038a0 con 0x7f603c06c0e0 2023-10-03T10:18:20.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.825+0000 7f6042b41700 1 -- 172.21.15.72:0/1718098252 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c11ce50 con 0x7f603c06c0e0 2023-10-03T10:18:20.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.826+0000 7f60397fa700 1 -- 172.21.15.72:0/1718098252 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6030003a00 con 0x7f603c06c0e0 2023-10-03T10:18:20.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.826+0000 7f60397fa700 1 -- 172.21.15.72:0/1718098252 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6030040500 con 0x7f603c06c0e0 2023-10-03T10:18:20.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.826+0000 7f6042b41700 1 -- 172.21.15.72:0/1718098252 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c11dfa0 con 0x7f603c06c0e0 2023-10-03T10:18:20.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.827+0000 7f1013378700 1 Processor -- start 2023-10-03T10:18:20.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.827+0000 7f1013378700 1 -- start start 2023-10-03T10:18:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.828+0000 7f1013378700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f100c134960 0x7f100c134d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.828+0000 7f1013378700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f100c06e430 0x7f100c06e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.828+0000 7f1013378700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100c06fa60 con 0x7f100c06edc0 2023-10-03T10:18:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.828+0000 7f1013378700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c06f8d0 con 0x7f100c134960 2023-10-03T10:18:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.828+0000 7f1013378700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f100c070f10 con 0x7f100c06e430 2023-10-03T10:18:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.828+0000 7f1011915700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f100c06edc0 0x7f100c13ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55290/0 (socket says 172.21.15.72:55290) 2023-10-03T10:18:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.828+0000 7f1011915700 1 -- 172.21.15.72:0/1533511794 learned_addr learned my addr 172.21.15.72:0/1533511794 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.828+0000 7f1011114700 1 --2- 172.21.15.72:0/1533511794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f100c134960 0x7f100c134d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.828+0000 7f1011114700 1 -- 172.21.15.72:0/1533511794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f100c06e430 msgr2=0x7f100c06e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.828+0000 7f1011114700 1 --2- 172.21.15.72:0/1533511794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f100c06e430 0x7f100c06e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.828+0000 7f1011114700 1 -- 172.21.15.72:0/1533511794 >> v1:172.21.15.72:6789/0 conn(0x7f100c06edc0 legacy=0x7f100c13ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.828+0000 7f1011114700 1 -- 172.21.15.72:0/1533511794 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c06f260 con 0x7f100c134960 2023-10-03T10:18:20.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.829+0000 7f1011114700 1 --2- 172.21.15.72:0/1533511794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f100c134960 0x7f100c134d30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1008009870 tx=0x7f1008009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba23c39d1b72f027 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.832+0000 7f1003fff700 1 -- 172.21.15.72:0/1533511794 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008011830 con 0x7f100c134960 2023-10-03T10:18:20.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.832+0000 7f1003fff700 1 -- 172.21.15.72:0/1533511794 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1008011990 con 0x7f100c134960 2023-10-03T10:18:20.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.832+0000 7f1003fff700 1 -- 172.21.15.72:0/1533511794 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008011d20 con 0x7f100c134960 2023-10-03T10:18:20.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.832+0000 7f60397fa700 1 -- 172.21.15.72:0/1718098252 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f603c11dfa0 con 0x7f603c06c0e0 2023-10-03T10:18:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.833+0000 7f1013378700 1 -- 172.21.15.72:0/1533511794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f100c134960 msgr2=0x7f100c134d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.833+0000 7f1013378700 1 --2- 172.21.15.72:0/1533511794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f100c134960 0x7f100c134d30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1008009870 tx=0x7f1008009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.833+0000 7f1013378700 1 -- 172.21.15.72:0/1533511794 shutdown_connections 2023-10-03T10:18:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.833+0000 7f1013378700 1 --2- 172.21.15.72:0/1533511794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f100c134960 0x7f100c134d30 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.833+0000 7f1013378700 1 --2- 172.21.15.72:0/1533511794 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f100c06e430 0x7f100c06e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.833+0000 7f1013378700 1 -- 172.21.15.72:0/1533511794 >> 172.21.15.72:0/1533511794 conn(0x7f100c0a2aa0 msgr2=0x7f100c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.833+0000 7f1013378700 1 -- 172.21.15.72:0/1533511794 shutdown_connections 2023-10-03T10:18:20.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.833+0000 7f1013378700 1 -- 172.21.15.72:0/1533511794 wait complete. 2023-10-03T10:18:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.834+0000 7f1013378700 1 Processor -- start 2023-10-03T10:18:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.834+0000 7f1013378700 1 -- start start 2023-10-03T10:18:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.834+0000 7f1013378700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f100c06e430 0x7f100c13eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.834+0000 7f1013378700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f100c06edc0 0x7f100c13f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.834+0000 7f1013378700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f100c134960 0x7f100c13f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.834+0000 7f1013378700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c13c940 con 0x7f100c06e430 2023-10-03T10:18:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.834+0000 7f1013378700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c13e000 con 0x7f100c134960 2023-10-03T10:18:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.834+0000 7f1013378700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f100c13d6f0 con 0x7f100c06edc0 2023-10-03T10:18:20.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.834+0000 7f1011114700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f100c06e430 0x7f100c13eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.834+0000 7f1011915700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f100c134960 0x7f100c13f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.834+0000 7f1011114700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f100c06e430 0x7f100c13eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47608/0 (socket says 172.21.15.72:47608) 2023-10-03T10:18:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.834+0000 7f1011114700 1 -- 172.21.15.72:0/3996839854 learned_addr learned my addr 172.21.15.72:0/3996839854 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.834+0000 7f1010913700 1 --2- 172.21.15.72:0/3996839854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f100c06edc0 0x7f100c13f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.835+0000 7f1011915700 1 -- 172.21.15.72:0/3996839854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f100c06edc0 msgr2=0x7f100c13f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.835+0000 7f1011915700 1 --2- 172.21.15.72:0/3996839854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f100c06edc0 0x7f100c13f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.835+0000 7f1011915700 1 -- 172.21.15.72:0/3996839854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f100c06e430 msgr2=0x7f100c13eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.835+0000 7f1011915700 1 --2- 172.21.15.72:0/3996839854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f100c06e430 0x7f100c13eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.835+0000 7f1011915700 1 -- 172.21.15.72:0/3996839854 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080094a0 con 0x7f100c134960 2023-10-03T10:18:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.835+0000 7f1011915700 1 --2- 172.21.15.72:0/3996839854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f100c134960 0x7f100c13f5c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f100400caa0 tx=0x7f100400cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.835+0000 7f1001ffb700 1 -- 172.21.15.72:0/3996839854 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100400a9a0 con 0x7f100c134960 2023-10-03T10:18:20.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.835+0000 7f1001ffb700 1 -- 172.21.15.72:0/3996839854 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100400ab00 con 0x7f100c134960 2023-10-03T10:18:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.835+0000 7f1001ffb700 1 -- 172.21.15.72:0/3996839854 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100400ae70 con 0x7f100c134960 2023-10-03T10:18:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.835+0000 7f1013378700 1 -- 172.21.15.72:0/3996839854 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100c134e00 con 0x7f100c134960 2023-10-03T10:18:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.835+0000 7f1013378700 1 -- 172.21.15.72:0/3996839854 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100c13dc80 con 0x7f100c134960 2023-10-03T10:18:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.836+0000 7f1013378700 1 -- 172.21.15.72:0/3996839854 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100c074ea0 con 0x7f100c134960 2023-10-03T10:18:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.836+0000 7f1001ffb700 1 -- 172.21.15.72:0/3996839854 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1004012400 con 0x7f100c134960 2023-10-03T10:18:20.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.837+0000 7f1001ffb700 1 -- 172.21.15.72:0/3996839854 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f100403f250 con 0x7f100c134960 2023-10-03T10:18:20.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:20.841+0000 7f1001ffb700 1 -- 172.21.15.72:0/3996839854 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1004010710 con 0x7f100c134960 2023-10-03T10:18:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.025+0000 7f6042b41700 1 -- 172.21.15.72:0/1718098252 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f603c11e160 con 0x7f603c06c0e0 2023-10-03T10:18:21.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.025+0000 7f60397fa700 1 -- 172.21.15.72:0/1718098252 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f603c11e160 con 0x7f603c06c0e0 2023-10-03T10:18:21.025 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:21.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.026+0000 7f885aeee700 1 -- 172.21.15.72:0/2350036421 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f885411b180 con 0x7f885409d6f0 2023-10-03T10:18:21.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.026+0000 7f88517fa700 1 -- 172.21.15.72:0/2350036421 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f885411b180 con 0x7f885409d6f0 2023-10-03T10:18:21.026 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:21.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.028+0000 7f885aeee700 1 -- 172.21.15.72:0/2350036421 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f885409d6f0 msgr2=0x7f8854134830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.028+0000 7f885aeee700 1 --2- 172.21.15.72:0/2350036421 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f885409d6f0 0x7f8854134830 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f884800c3e0 tx=0x7f884800c6f0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.028+0000 7f6042b41700 1 -- 172.21.15.72:0/1718098252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f603c06c0e0 msgr2=0x7f603c11ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.028+0000 7f6042b41700 1 --2- 172.21.15.72:0/1718098252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f603c06c0e0 0x7f603c11ac10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6030014040 tx=0x7f6030004750 comp rx=0 tx=0).stop 2023-10-03T10:18:21.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.029+0000 7f885aeee700 1 -- 172.21.15.72:0/2350036421 shutdown_connections 2023-10-03T10:18:21.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.029+0000 7f885aeee700 1 --2- 172.21.15.72:0/2350036421 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8854135e50 0x7f88541352b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.029+0000 7f885aeee700 1 --2- 172.21.15.72:0/2350036421 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f885409d6f0 0x7f8854134830 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.029+0000 7f885aeee700 1 --2- 172.21.15.72:0/2350036421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f885409e1d0 0x7f8854134d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.029+0000 7f885aeee700 1 -- 172.21.15.72:0/2350036421 >> 172.21.15.72:0/2350036421 conn(0x7f8854066f50 msgr2=0x7f8854136a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.029+0000 7f885aeee700 1 -- 172.21.15.72:0/2350036421 shutdown_connections 2023-10-03T10:18:21.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.029+0000 7f885aeee700 1 -- 172.21.15.72:0/2350036421 wait complete. 2023-10-03T10:18:21.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.030+0000 7f6042b41700 1 -- 172.21.15.72:0/1718098252 shutdown_connections 2023-10-03T10:18:21.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.030+0000 7f6042b41700 1 --2- 172.21.15.72:0/1718098252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f603c137f20 0x7f603c11b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.030+0000 7f6042b41700 1 --2- 172.21.15.72:0/1718098252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f603c06c0e0 0x7f603c11ac10 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.030+0000 7f6042b41700 1 --2- 172.21.15.72:0/1718098252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f603c134ec0 0x7f603c11b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.030+0000 7f6042b41700 1 -- 172.21.15.72:0/1718098252 >> 172.21.15.72:0/1718098252 conn(0x7f603c0a4210 msgr2=0x7f603c06c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.030+0000 7f6042b41700 1 -- 172.21.15.72:0/1718098252 shutdown_connections 2023-10-03T10:18:21.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.030+0000 7f6042b41700 1 -- 172.21.15.72:0/1718098252 wait complete. 2023-10-03T10:18:21.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.034+0000 7f3749112700 1 -- 172.21.15.72:0/3205035556 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37441a93d0 con 0x7f374409e000 2023-10-03T10:18:21.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.035+0000 7f372b7fe700 1 -- 172.21.15.72:0/3205035556 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f373800f8d0 con 0x7f374409e000 2023-10-03T10:18:21.034 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:21.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.037+0000 7f3749112700 1 -- 172.21.15.72:0/3205035556 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f374409e000 msgr2=0x7f37441a62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.037+0000 7f3749112700 1 --2- 172.21.15.72:0/3205035556 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f374409e000 0x7f37441a62d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f373800b530 tx=0x7f373800b840 comp rx=0 tx=0).stop 2023-10-03T10:18:21.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.040+0000 7f3749112700 1 -- 172.21.15.72:0/3205035556 shutdown_connections 2023-10-03T10:18:21.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.040+0000 7f3749112700 1 --2- 172.21.15.72:0/3205035556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f374409d6f0 0x7f37441a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.040+0000 7f3749112700 1 --2- 172.21.15.72:0/3205035556 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f374409e410 0x7f37441a6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.040+0000 7f3749112700 1 --2- 172.21.15.72:0/3205035556 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f374409e000 0x7f37441a62d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.040+0000 7f3749112700 1 -- 172.21.15.72:0/3205035556 >> 172.21.15.72:0/3205035556 conn(0x7f3744066f50 msgr2=0x7f37441bac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.040+0000 7f3749112700 1 -- 172.21.15.72:0/3205035556 shutdown_connections 2023-10-03T10:18:21.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.040+0000 7f3749112700 1 -- 172.21.15.72:0/3205035556 wait complete. 2023-10-03T10:18:21.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.041+0000 7f1013378700 1 -- 172.21.15.72:0/3996839854 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f100c06b9e0 con 0x7f100c134960 2023-10-03T10:18:21.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.041+0000 7f1001ffb700 1 -- 172.21.15.72:0/3996839854 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1004017020 con 0x7f100c134960 2023-10-03T10:18:21.041 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:21.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:21.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.043+0000 7f1013378700 1 -- 172.21.15.72:0/3996839854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f100c134960 msgr2=0x7f100c13f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.043+0000 7f1013378700 1 --2- 172.21.15.72:0/3996839854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f100c134960 0x7f100c13f5c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f100400caa0 tx=0x7f100400cdb0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.043+0000 7f1013378700 1 -- 172.21.15.72:0/3996839854 shutdown_connections 2023-10-03T10:18:21.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.043+0000 7f1013378700 1 --2- 172.21.15.72:0/3996839854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f100c06e430 0x7f100c13eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.043+0000 7f1013378700 1 --2- 172.21.15.72:0/3996839854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f100c134960 0x7f100c13f5c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.043+0000 7f1013378700 1 --2- 172.21.15.72:0/3996839854 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f100c06edc0 0x7f100c13f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.043+0000 7f1013378700 1 -- 172.21.15.72:0/3996839854 >> 172.21.15.72:0/3996839854 conn(0x7f100c0a2aa0 msgr2=0x7f100c09e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.044+0000 7f1013378700 1 -- 172.21.15.72:0/3996839854 shutdown_connections 2023-10-03T10:18:21.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:21.044+0000 7f1013378700 1 -- 172.21.15.72:0/3996839854 wait complete. 2023-10-03T10:18:21.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:21.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:21.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:22.044 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:22.050 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:22.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:22.058 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:22.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.189+0000 7f106a244700 1 Processor -- start 2023-10-03T10:18:22.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.189+0000 7f106a244700 1 -- start start 2023-10-03T10:18:22.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.190+0000 7f106a244700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10641338a0 0x7f1064133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.190+0000 7f106a244700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f106409de50 0x7f106409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.190+0000 7f106a244700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f106409e760 0x7f106413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.190+0000 7f106a244700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106406fef0 con 0x7f106409de50 2023-10-03T10:18:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.190+0000 7f106a244700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106406ef30 con 0x7f10641338a0 2023-10-03T10:18:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.190+0000 7f106a244700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10641334b0 con 0x7f106409e760 2023-10-03T10:18:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.190+0000 7f1063fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f106409e760 0x7f106413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.190+0000 7f10637fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10641338a0 0x7f1064133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.190+0000 7f1063fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f106409e760 0x7f106413a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36564/0 (socket says 172.21.15.72:36564) 2023-10-03T10:18:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.190+0000 7f1063fff700 1 -- 172.21.15.72:0/737959465 learned_addr learned my addr 172.21.15.72:0/737959465 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.191+0000 7f10637fe700 1 -- 172.21.15.72:0/737959465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f106409e760 msgr2=0x7f106413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.191+0000 7f10637fe700 1 --2- 172.21.15.72:0/737959465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f106409e760 0x7f106413a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.191+0000 7f10637fe700 1 -- 172.21.15.72:0/737959465 >> v2:172.21.15.72:3300/0 conn(0x7f106409de50 msgr2=0x7f106409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.191+0000 7f10637fe700 1 --2- 172.21.15.72:0/737959465 >> v2:172.21.15.72:3300/0 conn(0x7f106409de50 0x7f106409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.191+0000 7f10637fe700 1 -- 172.21.15.72:0/737959465 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106406fc30 con 0x7f10641338a0 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.191+0000 7f10637fe700 1 --2- 172.21.15.72:0/737959465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10641338a0 0x7f1064133c70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f1054009840 tx=0x7f1054009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=886f6ec075e6e9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.191+0000 7f10627fc700 1 -- 172.21.15.72:0/737959465 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1054011830 con 0x7f10641338a0 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.191+0000 7f10627fc700 1 -- 172.21.15.72:0/737959465 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1054011990 con 0x7f10641338a0 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.191+0000 7f10627fc700 1 -- 172.21.15.72:0/737959465 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1054011d20 con 0x7f10641338a0 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.192+0000 7f106a244700 1 -- 172.21.15.72:0/737959465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10641338a0 msgr2=0x7f1064133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.192+0000 7f106a244700 1 --2- 172.21.15.72:0/737959465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10641338a0 0x7f1064133c70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f1054009840 tx=0x7f1054009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.192+0000 7f106a244700 1 -- 172.21.15.72:0/737959465 shutdown_connections 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.192+0000 7f106a244700 1 --2- 172.21.15.72:0/737959465 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f106409e760 0x7f106413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.192+0000 7f106a244700 1 --2- 172.21.15.72:0/737959465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10641338a0 0x7f1064133c70 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.192+0000 7f106a244700 1 --2- 172.21.15.72:0/737959465 >> v2:172.21.15.72:3300/0 conn(0x7f106409de50 0x7f106409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.192+0000 7f106a244700 1 -- 172.21.15.72:0/737959465 >> 172.21.15.72:0/737959465 conn(0x7f10640a2aa0 msgr2=0x7f10640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.192+0000 7f106a244700 1 -- 172.21.15.72:0/737959465 shutdown_connections 2023-10-03T10:18:22.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.192+0000 7f106a244700 1 -- 172.21.15.72:0/737959465 wait complete. 2023-10-03T10:18:22.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.193+0000 7f106a244700 1 Processor -- start 2023-10-03T10:18:22.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.193+0000 7f106a244700 1 -- start start 2023-10-03T10:18:22.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.194+0000 7f106a244700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f106409de50 0x7f106411ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.194+0000 7f106a244700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f106409e760 0x7f106411ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.194+0000 7f106a244700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10641338a0 0x7f106411f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.194+0000 7f106a244700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106412f9c0 con 0x7f10641338a0 2023-10-03T10:18:22.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.194+0000 7f106a244700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1064120720 con 0x7f106409e760 2023-10-03T10:18:22.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.194+0000 7f106a244700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1064121f80 con 0x7f106409de50 2023-10-03T10:18:22.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.194+0000 7f1062ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f106409e760 0x7f106411ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.194+0000 7f10637fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f106409de50 0x7f106411ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.194+0000 7f1062ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f106409e760 0x7f106411ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55898/0 (socket says 172.21.15.72:55898) 2023-10-03T10:18:22.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.194+0000 7f1062ffd700 1 -- 172.21.15.72:0/2579541252 learned_addr learned my addr 172.21.15.72:0/2579541252 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:22.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.194+0000 7f1063fff700 1 --2- 172.21.15.72:0/2579541252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10641338a0 0x7f106411f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.195+0000 7f10637fe700 1 -- 172.21.15.72:0/2579541252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f106409e760 msgr2=0x7f106411ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.195+0000 7f10637fe700 1 --2- 172.21.15.72:0/2579541252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f106409e760 0x7f106411ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.195+0000 7f10637fe700 1 -- 172.21.15.72:0/2579541252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10641338a0 msgr2=0x7f106411f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.195+0000 7f10637fe700 1 --2- 172.21.15.72:0/2579541252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10641338a0 0x7f106411f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.195+0000 7f10637fe700 1 -- 172.21.15.72:0/2579541252 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10540094a0 con 0x7f106409de50 2023-10-03T10:18:22.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.195+0000 7f1063fff700 1 --2- 172.21.15.72:0/2579541252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10641338a0 0x7f106411f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.195+0000 7f10637fe700 1 --2- 172.21.15.72:0/2579541252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f106409de50 0x7f106411ea00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1054016000 tx=0x7f1054004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.195+0000 7f104bfff700 1 -- 172.21.15.72:0/2579541252 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1054004450 con 0x7f106409de50 2023-10-03T10:18:22.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.195+0000 7f104bfff700 1 -- 172.21.15.72:0/2579541252 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10540036a0 con 0x7f106409de50 2023-10-03T10:18:22.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.195+0000 7f106a244700 1 -- 172.21.15.72:0/2579541252 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106406f640 con 0x7f106409de50 2023-10-03T10:18:22.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.195+0000 7f104bfff700 1 -- 172.21.15.72:0/2579541252 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10540045f0 con 0x7f106409de50 2023-10-03T10:18:22.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.195+0000 7f106a244700 1 -- 172.21.15.72:0/2579541252 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1064122cb0 con 0x7f106409de50 2023-10-03T10:18:22.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.196+0000 7f104bfff700 1 -- 172.21.15.72:0/2579541252 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1054003a50 con 0x7f106409de50 2023-10-03T10:18:22.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.196+0000 7f104bfff700 1 -- 172.21.15.72:0/2579541252 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f10540409a0 con 0x7f106409de50 2023-10-03T10:18:22.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.197+0000 7f106a244700 1 -- 172.21.15.72:0/2579541252 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1064074ea0 con 0x7f106409de50 2023-10-03T10:18:22.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.205+0000 7f104bfff700 1 -- 172.21.15.72:0/2579541252 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1054003d00 con 0x7f106409de50 2023-10-03T10:18:22.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.224+0000 7fec98bc7700 1 Processor -- start 2023-10-03T10:18:22.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.224+0000 7f1414ee9700 1 Processor -- start 2023-10-03T10:18:22.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.225+0000 7f1414ee9700 1 -- start start 2023-10-03T10:18:22.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.225+0000 7fec98bc7700 1 -- start start 2023-10-03T10:18:22.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.225+0000 7fec98bc7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec941337f0 0x7fec94138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.225+0000 7fec98bc7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec94138dc0 0x7fec9413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.225+0000 7fec98bc7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9406b990 con 0x7fec94133420 2023-10-03T10:18:22.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.225+0000 7fec98bc7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9409b0e0 con 0x7fec94138dc0 2023-10-03T10:18:22.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.225+0000 7fec98bc7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec94133c20 con 0x7fec941337f0 2023-10-03T10:18:22.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.225+0000 7f1414ee9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f141009d630 0x7f14100a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.225+0000 7f1414ee9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1410138d80 0x7f141013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.225+0000 7f1414ee9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14100a2a70 con 0x7f14100a0a30 2023-10-03T10:18:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.225+0000 7f1414ee9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14100a01d0 con 0x7f141009d630 2023-10-03T10:18:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.225+0000 7f1414ee9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f141009e2b0 con 0x7f1410138d80 2023-10-03T10:18:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7f140dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f141009d630 0x7f14100a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7f140e59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f14100a0a30 0x7f14100a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55304/0 (socket says 172.21.15.72:55304) 2023-10-03T10:18:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7f140e59c700 1 -- 172.21.15.72:0/944715414 learned_addr learned my addr 172.21.15.72:0/944715414 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7f140ed9d700 1 --2- 172.21.15.72:0/944715414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1410138d80 0x7f141013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.225+0000 7fec9259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fec94133420 0x7fec94133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55302/0 (socket says 172.21.15.72:55302) 2023-10-03T10:18:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7fec9259c700 1 -- 172.21.15.72:0/1458651097 learned_addr learned my addr 172.21.15.72:0/1458651097 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7fec91d9b700 1 --2- 172.21.15.72:0/1458651097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec941337f0 0x7fec94138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7fec91d9b700 1 -- 172.21.15.72:0/1458651097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec94138dc0 msgr2=0x7fec9413b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7fec91d9b700 1 --2- 172.21.15.72:0/1458651097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec94138dc0 0x7fec9413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7fec91d9b700 1 -- 172.21.15.72:0/1458651097 >> v1:172.21.15.72:6789/0 conn(0x7fec94133420 legacy=0x7fec94133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7fec91d9b700 1 -- 172.21.15.72:0/1458651097 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec940a0590 con 0x7fec941337f0 2023-10-03T10:18:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7fec9159a700 1 -- 172.21.15.72:0/1458651097 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039820965 0 0) 0x7fec9406b990 con 0x7fec94133420 2023-10-03T10:18:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7fec91d9b700 1 --2- 172.21.15.72:0/1458651097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec941337f0 0x7fec94138880 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fec88009870 tx=0x7fec88009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a06b06aea35debae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7fec9159a700 1 -- 172.21.15.72:0/1458651097 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec88011830 con 0x7fec941337f0 2023-10-03T10:18:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7fec9159a700 1 -- 172.21.15.72:0/1458651097 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec88011990 con 0x7fec941337f0 2023-10-03T10:18:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7fec9159a700 1 -- 172.21.15.72:0/1458651097 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec88011d20 con 0x7fec941337f0 2023-10-03T10:18:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7f140dd9b700 1 -- 172.21.15.72:0/944715414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1410138d80 msgr2=0x7f141013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7f140dd9b700 1 --2- 172.21.15.72:0/944715414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1410138d80 0x7f141013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7f140dd9b700 1 -- 172.21.15.72:0/944715414 >> v1:172.21.15.72:6789/0 conn(0x7f14100a0a30 legacy=0x7f14100a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7f140dd9b700 1 -- 172.21.15.72:0/944715414 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141009dc50 con 0x7f141009d630 2023-10-03T10:18:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7f140dd9b700 1 --2- 172.21.15.72:0/944715414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f141009d630 0x7f14100a1510 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f1404009840 tx=0x7f1404009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2873310ea367883 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7f140d59a700 1 -- 172.21.15.72:0/944715414 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404011830 con 0x7f141009d630 2023-10-03T10:18:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7f140d59a700 1 -- 172.21.15.72:0/944715414 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1404011990 con 0x7f141009d630 2023-10-03T10:18:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.226+0000 7f140d59a700 1 -- 172.21.15.72:0/944715414 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404011d20 con 0x7f141009d630 2023-10-03T10:18:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7f1414ee9700 1 -- 172.21.15.72:0/944715414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f141009d630 msgr2=0x7f14100a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7f1414ee9700 1 --2- 172.21.15.72:0/944715414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f141009d630 0x7f14100a1510 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f1404009840 tx=0x7f1404009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7f1414ee9700 1 -- 172.21.15.72:0/944715414 shutdown_connections 2023-10-03T10:18:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7f1414ee9700 1 --2- 172.21.15.72:0/944715414 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1410138d80 0x7f141013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7f1414ee9700 1 --2- 172.21.15.72:0/944715414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f141009d630 0x7f14100a1510 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7f1414ee9700 1 -- 172.21.15.72:0/944715414 >> 172.21.15.72:0/944715414 conn(0x7f14100a3050 msgr2=0x7f14100a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7f1414ee9700 1 -- 172.21.15.72:0/944715414 shutdown_connections 2023-10-03T10:18:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7f1414ee9700 1 -- 172.21.15.72:0/944715414 wait complete. 2023-10-03T10:18:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.228+0000 7f1414ee9700 1 Processor -- start 2023-10-03T10:18:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.228+0000 7f1414ee9700 1 -- start start 2023-10-03T10:18:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7f1414ee9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f141009d630 0x7f141008a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7f1414ee9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14100a0a30 0x7f141008a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7f1414ee9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1410138d80 0x7f1410133900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7f1414ee9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1410137390 con 0x7f1410138d80 2023-10-03T10:18:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7f1414ee9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1410136df0 con 0x7f14100a0a30 2023-10-03T10:18:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7f1414ee9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1410134d40 con 0x7f141009d630 2023-10-03T10:18:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7f140ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1410138d80 0x7f1410133900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7f140ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1410138d80 0x7f1410133900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47644/0 (socket says 172.21.15.72:47644) 2023-10-03T10:18:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7f140ed9d700 1 -- 172.21.15.72:0/953492137 learned_addr learned my addr 172.21.15.72:0/953492137 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7f140ed9d700 1 -- 172.21.15.72:0/953492137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f141009d630 msgr2=0x7f141008a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7f140ed9d700 1 --2- 172.21.15.72:0/953492137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f141009d630 0x7f141008a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7f140ed9d700 1 -- 172.21.15.72:0/953492137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14100a0a30 msgr2=0x7f141008a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7f140ed9d700 1 --2- 172.21.15.72:0/953492137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14100a0a30 0x7f141008a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7f140ed9d700 1 -- 172.21.15.72:0/953492137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14040094a0 con 0x7f1410138d80 2023-10-03T10:18:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.230+0000 7f140ed9d700 1 --2- 172.21.15.72:0/953492137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1410138d80 0x7f1410133900 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f1408009e30 tx=0x7f140800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.230+0000 7f13feffd700 1 -- 172.21.15.72:0/953492137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408009ca0 con 0x7f1410138d80 2023-10-03T10:18:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.231+0000 7f13feffd700 1 -- 172.21.15.72:0/953492137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140800f040 con 0x7f1410138d80 2023-10-03T10:18:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.231+0000 7f13feffd700 1 -- 172.21.15.72:0/953492137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408014480 con 0x7f1410138d80 2023-10-03T10:18:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.231+0000 7f1414ee9700 1 -- 172.21.15.72:0/953492137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1410138010 con 0x7f1410138d80 2023-10-03T10:18:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.231+0000 7f1414ee9700 1 -- 172.21.15.72:0/953492137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141008ad70 con 0x7f1410138d80 2023-10-03T10:18:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.232+0000 7f1414ee9700 1 -- 172.21.15.72:0/953492137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14100747f0 con 0x7f1410138d80 2023-10-03T10:18:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.232+0000 7f13feffd700 1 -- 172.21.15.72:0/953492137 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14080145e0 con 0x7f1410138d80 2023-10-03T10:18:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.232+0000 7f13feffd700 1 -- 172.21.15.72:0/953492137 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f14080403e0 con 0x7f1410138d80 2023-10-03T10:18:22.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7fec98bc7700 1 -- 172.21.15.72:0/1458651097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec941337f0 msgr2=0x7fec94138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7fec98bc7700 1 --2- 172.21.15.72:0/1458651097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec941337f0 0x7fec94138880 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fec88009870 tx=0x7fec88009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7fec98bc7700 1 -- 172.21.15.72:0/1458651097 shutdown_connections 2023-10-03T10:18:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7fec98bc7700 1 --2- 172.21.15.72:0/1458651097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec94138dc0 0x7fec9413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7fec98bc7700 1 --2- 172.21.15.72:0/1458651097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec941337f0 0x7fec94138880 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7fec98bc7700 1 -- 172.21.15.72:0/1458651097 >> 172.21.15.72:0/1458651097 conn(0x7fec940a4210 msgr2=0x7fec940a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7fec98bc7700 1 -- 172.21.15.72:0/1458651097 shutdown_connections 2023-10-03T10:18:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.227+0000 7fec98bc7700 1 -- 172.21.15.72:0/1458651097 wait complete. 2023-10-03T10:18:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7fec98bc7700 1 Processor -- start 2023-10-03T10:18:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7fec98bc7700 1 -- start start 2023-10-03T10:18:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7fec98bc7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec94133420 0x7fec940709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7fec98bc7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec941337f0 0x7fec94070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7fec98bc7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec94138dc0 0x7fec94071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7fec98bc7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9409c910 con 0x7fec941337f0 2023-10-03T10:18:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7fec98bc7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9409dac0 con 0x7fec94133420 2023-10-03T10:18:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.229+0000 7fec98bc7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec9409e000 con 0x7fec94138dc0 2023-10-03T10:18:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.230+0000 7fec91d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec941337f0 0x7fec94070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.230+0000 7fec91d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec941337f0 0x7fec94070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47648/0 (socket says 172.21.15.72:47648) 2023-10-03T10:18:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.230+0000 7fec91d9b700 1 -- 172.21.15.72:0/1685224560 learned_addr learned my addr 172.21.15.72:0/1685224560 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.230+0000 7fec91d9b700 1 -- 172.21.15.72:0/1685224560 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec94138dc0 msgr2=0x7fec94071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.230+0000 7fec91d9b700 1 --2- 172.21.15.72:0/1685224560 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec94138dc0 0x7fec94071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.230+0000 7fec91d9b700 1 -- 172.21.15.72:0/1685224560 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec94133420 msgr2=0x7fec940709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.230+0000 7fec91d9b700 1 --2- 172.21.15.72:0/1685224560 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec94133420 0x7fec940709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.230+0000 7fec91d9b700 1 -- 172.21.15.72:0/1685224560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec880094a0 con 0x7fec941337f0 2023-10-03T10:18:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.230+0000 7fec91d9b700 1 --2- 172.21.15.72:0/1685224560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec941337f0 0x7fec94070ee0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fec88000c00 tx=0x7fec88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.230+0000 7fec82ffd700 1 -- 172.21.15.72:0/1685224560 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec880044c0 con 0x7fec941337f0 2023-10-03T10:18:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.231+0000 7fec98bc7700 1 -- 172.21.15.72:0/1685224560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9409cbc0 con 0x7fec941337f0 2023-10-03T10:18:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.231+0000 7fec82ffd700 1 -- 172.21.15.72:0/1685224560 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8801f070 con 0x7fec941337f0 2023-10-03T10:18:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.231+0000 7fec82ffd700 1 -- 172.21.15.72:0/1685224560 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec880038e0 con 0x7fec941337f0 2023-10-03T10:18:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.231+0000 7fec98bc7700 1 -- 172.21.15.72:0/1685224560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec940726a0 con 0x7fec941337f0 2023-10-03T10:18:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.231+0000 7fec82ffd700 1 -- 172.21.15.72:0/1685224560 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec88021030 con 0x7fec941337f0 2023-10-03T10:18:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.232+0000 7fec82ffd700 1 -- 172.21.15.72:0/1685224560 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fec880407c0 con 0x7fec941337f0 2023-10-03T10:18:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.232+0000 7fec98bc7700 1 -- 172.21.15.72:0/1685224560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec940726a0 con 0x7fec941337f0 2023-10-03T10:18:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.237+0000 7fec82ffd700 1 -- 172.21.15.72:0/1685224560 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec940726a0 con 0x7fec941337f0 2023-10-03T10:18:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.239+0000 7fe7053a4700 1 Processor -- start 2023-10-03T10:18:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.239+0000 7fe7053a4700 1 -- start start 2023-10-03T10:18:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.239+0000 7fe7053a4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7001316c0 0x7fe700131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.239+0000 7fe7053a4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe70006ae80 0x7fe700139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.239+0000 7fe7053a4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70009e130 con 0x7fe70009d9f0 2023-10-03T10:18:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.239+0000 7fe7053a4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7001312b0 con 0x7fe7001316c0 2023-10-03T10:18:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.239+0000 7fe7053a4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe70009f6e0 con 0x7fe70006ae80 2023-10-03T10:18:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.240+0000 7fe6fe7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe70009d9f0 0x7fe70006a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55312/0 (socket says 172.21.15.72:55312) 2023-10-03T10:18:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.240+0000 7fe6fe7fc700 1 -- 172.21.15.72:0/3789983841 learned_addr learned my addr 172.21.15.72:0/3789983841 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:22.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.242+0000 7fe6ff7fe700 1 --2- 172.21.15.72:0/3789983841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe70006ae80 0x7fe700139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.242+0000 7fe6fdffb700 1 -- 172.21.15.72:0/3789983841 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062826493 0 0) 0x7fe6f4001110 con 0x7fe70009d9f0 2023-10-03T10:18:22.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.242+0000 7fe6fdffb700 1 -- 172.21.15.72:0/3789983841 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6e80035b0 con 0x7fe70009d9f0 2023-10-03T10:18:22.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.242+0000 7fe6feffd700 1 --2- 172.21.15.72:0/3789983841 >> v2:172.21.15.72:3300/0 conn(0x7fe7001316c0 0x7fe700131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.242+0000 7fe6feffd700 1 -- 172.21.15.72:0/3789983841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe70006ae80 msgr2=0x7fe700139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.242+0000 7fe6feffd700 1 --2- 172.21.15.72:0/3789983841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe70006ae80 0x7fe700139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.242+0000 7fe6feffd700 1 -- 172.21.15.72:0/3789983841 >> v1:172.21.15.72:6789/0 conn(0x7fe70009d9f0 legacy=0x7fe70006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.242+0000 7f13feffd700 1 -- 172.21.15.72:0/953492137 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1408007510 con 0x7f1410138d80 2023-10-03T10:18:22.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.242+0000 7fe6feffd700 1 -- 172.21.15.72:0/3789983841 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70009e760 con 0x7fe7001316c0 2023-10-03T10:18:22.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.242+0000 7fe6feffd700 1 --2- 172.21.15.72:0/3789983841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7001316c0 0x7fe700131a90 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0009840 tx=0x7fe6f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888257832877ac6f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.242+0000 7fe6fdffb700 1 -- 172.21.15.72:0/3789983841 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0011830 con 0x7fe7001316c0 2023-10-03T10:18:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.242+0000 7fe6fdffb700 1 -- 172.21.15.72:0/3789983841 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f0011990 con 0x7fe7001316c0 2023-10-03T10:18:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.242+0000 7fe6fdffb700 1 -- 172.21.15.72:0/3789983841 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0011d20 con 0x7fe7001316c0 2023-10-03T10:18:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.243+0000 7fe7053a4700 1 -- 172.21.15.72:0/3789983841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7001316c0 msgr2=0x7fe700131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.243+0000 7fe7053a4700 1 --2- 172.21.15.72:0/3789983841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7001316c0 0x7fe700131a90 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0009840 tx=0x7fe6f0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.243+0000 7fe7053a4700 1 -- 172.21.15.72:0/3789983841 shutdown_connections 2023-10-03T10:18:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.243+0000 7fe7053a4700 1 --2- 172.21.15.72:0/3789983841 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe70006ae80 0x7fe700139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.243+0000 7fe7053a4700 1 --2- 172.21.15.72:0/3789983841 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7001316c0 0x7fe700131a90 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.243+0000 7fe7053a4700 1 -- 172.21.15.72:0/3789983841 >> 172.21.15.72:0/3789983841 conn(0x7fe700066f50 msgr2=0x7fe70009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.243+0000 7fe7053a4700 1 -- 172.21.15.72:0/3789983841 shutdown_connections 2023-10-03T10:18:22.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.243+0000 7fe7053a4700 1 -- 172.21.15.72:0/3789983841 wait complete. 2023-10-03T10:18:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.244+0000 7fe7053a4700 1 Processor -- start 2023-10-03T10:18:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.244+0000 7fe7053a4700 1 -- start start 2023-10-03T10:18:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.245+0000 7fe7053a4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe70006ae80 0x7fe70006e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.245+0000 7fe7053a4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70009d9f0 0x7fe70006ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.245+0000 7fe7053a4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7001316c0 0x7fe70006f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.245+0000 7fe7053a4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe700072520 con 0x7fe70009d9f0 2023-10-03T10:18:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.245+0000 7fe7053a4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000715c0 con 0x7fe70006ae80 2023-10-03T10:18:22.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.245+0000 7fe7053a4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe70013a590 con 0x7fe7001316c0 2023-10-03T10:18:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.245+0000 7fe6ff7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7001316c0 0x7fe70006f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.245+0000 7fe6ff7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7001316c0 0x7fe70006f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36606/0 (socket says 172.21.15.72:36606) 2023-10-03T10:18:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.245+0000 7fe6ff7fe700 1 -- 172.21.15.72:0/55745702 learned_addr learned my addr 172.21.15.72:0/55745702 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.245+0000 7fe6fe7fc700 1 --2- 172.21.15.72:0/55745702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70009d9f0 0x7fe70006ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.245+0000 7fe6ff7fe700 1 -- 172.21.15.72:0/55745702 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe70006ae80 msgr2=0x7fe70006e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.245+0000 7fe6ff7fe700 1 --2- 172.21.15.72:0/55745702 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe70006ae80 0x7fe70006e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.245+0000 7fe6ff7fe700 1 -- 172.21.15.72:0/55745702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70009d9f0 msgr2=0x7fe70006ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.245+0000 7fe6ff7fe700 1 --2- 172.21.15.72:0/55745702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70009d9f0 0x7fe70006ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.245+0000 7fe6ff7fe700 1 -- 172.21.15.72:0/55745702 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f00094a0 con 0x7fe7001316c0 2023-10-03T10:18:22.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.246+0000 7fe6ff7fe700 1 --2- 172.21.15.72:0/55745702 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7001316c0 0x7fe70006f360 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009dd0 tx=0x7fe6f800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.246+0000 7fe6e77fe700 1 -- 172.21.15.72:0/55745702 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8009c40 con 0x7fe7001316c0 2023-10-03T10:18:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.246+0000 7fe6e77fe700 1 -- 172.21.15.72:0/55745702 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f800f040 con 0x7fe7001316c0 2023-10-03T10:18:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.246+0000 7fe6e77fe700 1 -- 172.21.15.72:0/55745702 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8014480 con 0x7fe7001316c0 2023-10-03T10:18:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.246+0000 7fe7053a4700 1 -- 172.21.15.72:0/55745702 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7000704b0 con 0x7fe7001316c0 2023-10-03T10:18:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.246+0000 7fe7053a4700 1 -- 172.21.15.72:0/55745702 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe700070920 con 0x7fe7001316c0 2023-10-03T10:18:22.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.247+0000 7fe7053a4700 1 -- 172.21.15.72:0/55745702 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70012f110 con 0x7fe7001316c0 2023-10-03T10:18:22.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.247+0000 7fe6e77fe700 1 -- 172.21.15.72:0/55745702 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe6f80145e0 con 0x7fe7001316c0 2023-10-03T10:18:22.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.248+0000 7fe6e77fe700 1 -- 172.21.15.72:0/55745702 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe6f803fec0 con 0x7fe7001316c0 2023-10-03T10:18:22.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.252+0000 7fe6e77fe700 1 -- 172.21.15.72:0/55745702 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe6f80116d0 con 0x7fe7001316c0 2023-10-03T10:18:22.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.430+0000 7f106a244700 1 -- 172.21.15.72:0/2579541252 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1064122580 con 0x7f106409de50 2023-10-03T10:18:22.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.431+0000 7f104bfff700 1 -- 172.21.15.72:0/2579541252 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1054015020 con 0x7f106409de50 2023-10-03T10:18:22.430 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.434+0000 7f106a244700 1 -- 172.21.15.72:0/2579541252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f106409de50 msgr2=0x7f106411ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.434+0000 7f106a244700 1 --2- 172.21.15.72:0/2579541252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f106409de50 0x7f106411ea00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1054016000 tx=0x7f1054004750 comp rx=0 tx=0).stop 2023-10-03T10:18:22.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.434+0000 7f106a244700 1 -- 172.21.15.72:0/2579541252 shutdown_connections 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.434+0000 7f106a244700 1 --2- 172.21.15.72:0/2579541252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10641338a0 0x7f106411f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.434+0000 7f106a244700 1 --2- 172.21.15.72:0/2579541252 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f106409de50 0x7f106411ea00 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.434+0000 7f106a244700 1 --2- 172.21.15.72:0/2579541252 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f106409e760 0x7f106411ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.434+0000 7f106a244700 1 -- 172.21.15.72:0/2579541252 >> 172.21.15.72:0/2579541252 conn(0x7f10640a2aa0 msgr2=0x7f106409ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.434+0000 7f106a244700 1 -- 172.21.15.72:0/2579541252 shutdown_connections 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.434+0000 7f106a244700 1 -- 172.21.15.72:0/2579541252 wait complete. 2023-10-03T10:18:22.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.434+0000 7fec98bc7700 1 -- 172.21.15.72:0/1685224560 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fec940726a0 con 0x7fec941337f0 2023-10-03T10:18:22.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.435+0000 7fec82ffd700 1 -- 172.21.15.72:0/1685224560 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec940726a0 con 0x7fec941337f0 2023-10-03T10:18:22.435 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:22.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.436+0000 7f1414ee9700 1 -- 172.21.15.72:0/953492137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1410072980 con 0x7f1410138d80 2023-10-03T10:18:22.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.436+0000 7f13feffd700 1 -- 172.21.15.72:0/953492137 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1408007330 con 0x7f1410138d80 2023-10-03T10:18:22.436 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:22.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.437+0000 7fec98bc7700 1 -- 172.21.15.72:0/1685224560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec941337f0 msgr2=0x7fec94070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.437+0000 7fec98bc7700 1 --2- 172.21.15.72:0/1685224560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec941337f0 0x7fec94070ee0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fec88000c00 tx=0x7fec88004750 comp rx=0 tx=0).stop 2023-10-03T10:18:22.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.437+0000 7fec98bc7700 1 -- 172.21.15.72:0/1685224560 shutdown_connections 2023-10-03T10:18:22.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.437+0000 7fec98bc7700 1 --2- 172.21.15.72:0/1685224560 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec94138dc0 0x7fec94071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.437+0000 7fec98bc7700 1 --2- 172.21.15.72:0/1685224560 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec94133420 0x7fec940709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.437+0000 7fec98bc7700 1 --2- 172.21.15.72:0/1685224560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec941337f0 0x7fec94070ee0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.437+0000 7fec98bc7700 1 -- 172.21.15.72:0/1685224560 >> 172.21.15.72:0/1685224560 conn(0x7fec940a4210 msgr2=0x7fec940a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.438+0000 7fec98bc7700 1 -- 172.21.15.72:0/1685224560 shutdown_connections 2023-10-03T10:18:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.438+0000 7fec98bc7700 1 -- 172.21.15.72:0/1685224560 wait complete. 2023-10-03T10:18:22.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.438+0000 7f1414ee9700 1 -- 172.21.15.72:0/953492137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1410138d80 msgr2=0x7f1410133900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.438+0000 7f1414ee9700 1 --2- 172.21.15.72:0/953492137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1410138d80 0x7f1410133900 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f1408009e30 tx=0x7f140800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.438+0000 7f1414ee9700 1 -- 172.21.15.72:0/953492137 shutdown_connections 2023-10-03T10:18:22.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.438+0000 7f1414ee9700 1 --2- 172.21.15.72:0/953492137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1410138d80 0x7f1410133900 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.438+0000 7f1414ee9700 1 --2- 172.21.15.72:0/953492137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f141009d630 0x7f141008a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.438+0000 7f1414ee9700 1 --2- 172.21.15.72:0/953492137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14100a0a30 0x7f141008a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.438+0000 7f1414ee9700 1 -- 172.21.15.72:0/953492137 >> 172.21.15.72:0/953492137 conn(0x7f14100a3050 msgr2=0x7f141009f620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.438+0000 7f1414ee9700 1 -- 172.21.15.72:0/953492137 shutdown_connections 2023-10-03T10:18:22.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.438+0000 7f1414ee9700 1 -- 172.21.15.72:0/953492137 wait complete. 2023-10-03T10:18:22.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:22.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:22.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:22.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.465+0000 7fe7053a4700 1 -- 172.21.15.72:0/55745702 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe7000708f0 con 0x7fe7001316c0 2023-10-03T10:18:22.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.465+0000 7fe6e77fe700 1 -- 172.21.15.72:0/55745702 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe6f8018070 con 0x7fe7001316c0 2023-10-03T10:18:22.465 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.467+0000 7fe7053a4700 1 -- 172.21.15.72:0/55745702 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7001316c0 msgr2=0x7fe70006f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.467+0000 7fe7053a4700 1 --2- 172.21.15.72:0/55745702 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7001316c0 0x7fe70006f360 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009dd0 tx=0x7fe6f800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.467+0000 7fe7053a4700 1 -- 172.21.15.72:0/55745702 shutdown_connections 2023-10-03T10:18:22.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.467+0000 7fe7053a4700 1 --2- 172.21.15.72:0/55745702 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7001316c0 0x7fe70006f360 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.467+0000 7fe7053a4700 1 --2- 172.21.15.72:0/55745702 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe70006ae80 0x7fe70006e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.467+0000 7fe7053a4700 1 --2- 172.21.15.72:0/55745702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70009d9f0 0x7fe70006ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.467+0000 7fe7053a4700 1 -- 172.21.15.72:0/55745702 >> 172.21.15.72:0/55745702 conn(0x7fe700066f50 msgr2=0x7fe7001301c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.467+0000 7fe7053a4700 1 -- 172.21.15.72:0/55745702 shutdown_connections 2023-10-03T10:18:22.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:22.467+0000 7fe7053a4700 1 -- 172.21.15.72:0/55745702 wait complete. 2023-10-03T10:18:22.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:23.451 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:23.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:23.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:23.479 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:23.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.594+0000 7f8215ddf700 1 Processor -- start 2023-10-03T10:18:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.594+0000 7fb80df71700 1 Processor -- start 2023-10-03T10:18:23.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.594+0000 7fb80df71700 1 -- start start 2023-10-03T10:18:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.594+0000 7f8215ddf700 1 -- start start 2023-10-03T10:18:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7f8215ddf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f821006a770 0x7f821009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7f8215ddf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f821009dc30 0x7f821009e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7f8215ddf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f821013c1e0 0x7f821013e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7f8215ddf700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821006ab40 con 0x7f821009dc30 2023-10-03T10:18:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7f8215ddf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821009ebc0 con 0x7f821013c1e0 2023-10-03T10:18:23.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7f8215ddf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f821009a810 con 0x7f821006a770 2023-10-03T10:18:23.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7fb80df71700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8081338a0 0x7fb808133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7fb80df71700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80809de50 0x7fb80809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7fb80df71700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80806ef30 con 0x7fb80809e760 2023-10-03T10:18:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7fb80df71700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80806fef0 con 0x7fb8081338a0 2023-10-03T10:18:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7fb80df71700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8081334b0 con 0x7fb80809de50 2023-10-03T10:18:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7fb8077fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8081338a0 0x7fb808133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7fb8077fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8081338a0 0x7fb808133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55974/0 (socket says 172.21.15.72:55974) 2023-10-03T10:18:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7fb8077fe700 1 -- 172.21.15.72:0/967916780 learned_addr learned my addr 172.21.15.72:0/967916780 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7f820ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f821013c1e0 0x7f821013e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7f820ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f821013c1e0 0x7f821013e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55958/0 (socket says 172.21.15.72:55958) 2023-10-03T10:18:23.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7f820ffff700 1 -- 172.21.15.72:0/3141463238 learned_addr learned my addr 172.21.15.72:0/3141463238 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7f820effd700 1 --2- 172.21.15.72:0/3141463238 >> v2:172.21.15.72:3300/0 conn(0x7f821009dc30 0x7f821009e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.595+0000 7fb806ffd700 1 --2- 172.21.15.72:0/967916780 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80809de50 0x7fb80809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7fb806ffd700 1 -- 172.21.15.72:0/967916780 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8081338a0 msgr2=0x7fb808133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7fb806ffd700 1 --2- 172.21.15.72:0/967916780 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8081338a0 0x7fb808133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7fb806ffd700 1 -- 172.21.15.72:0/967916780 >> v1:172.21.15.72:6789/0 conn(0x7fb80809e760 legacy=0x7fb80813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7fb806ffd700 1 -- 172.21.15.72:0/967916780 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80806fc30 con 0x7fb80809de50 2023-10-03T10:18:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7f820ffff700 1 -- 172.21.15.72:0/3141463238 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f821006a770 msgr2=0x7f821009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7f820f7fe700 1 --2- 172.21.15.72:0/3141463238 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f821006a770 0x7f821009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7f820ffff700 1 --2- 172.21.15.72:0/3141463238 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f821006a770 0x7f821009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7f820ffff700 1 -- 172.21.15.72:0/3141463238 >> v2:172.21.15.72:3300/0 conn(0x7f821009dc30 msgr2=0x7f821009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7f820ffff700 1 --2- 172.21.15.72:0/3141463238 >> v2:172.21.15.72:3300/0 conn(0x7f821009dc30 0x7f821009e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7f820ffff700 1 -- 172.21.15.72:0/3141463238 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821009e920 con 0x7f821013c1e0 2023-10-03T10:18:23.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7fb806ffd700 1 --2- 172.21.15.72:0/967916780 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80809de50 0x7fb80809e220 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80098a0 tx=0x7fb7f8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d0cf843a8caff85 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7f820f7fe700 1 --2- 172.21.15.72:0/3141463238 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f821006a770 0x7f821009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:23.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7f820ffff700 1 --2- 172.21.15.72:0/3141463238 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f821013c1e0 0x7f821013e5c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8208009e50 tx=0x7f820800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=332afeaecac1e35f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7fb8067fc700 1 -- 172.21.15.72:0/967916780 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8011830 con 0x7fb80809de50 2023-10-03T10:18:23.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7fb8067fc700 1 -- 172.21.15.72:0/967916780 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f8011990 con 0x7fb80809de50 2023-10-03T10:18:23.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7fb8067fc700 1 -- 172.21.15.72:0/967916780 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8011d20 con 0x7fb80809de50 2023-10-03T10:18:23.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7f820e7fc700 1 -- 172.21.15.72:0/3141463238 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800e070 con 0x7f821013c1e0 2023-10-03T10:18:23.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7f820e7fc700 1 -- 172.21.15.72:0/3141463238 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820800b910 con 0x7f821013c1e0 2023-10-03T10:18:23.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.596+0000 7f820e7fc700 1 -- 172.21.15.72:0/3141463238 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800bcc0 con 0x7f821013c1e0 2023-10-03T10:18:23.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7fb80df71700 1 -- 172.21.15.72:0/967916780 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80809de50 msgr2=0x7fb80809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7fb80df71700 1 --2- 172.21.15.72:0/967916780 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80809de50 0x7fb80809e220 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80098a0 tx=0x7fb7f8009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7f8215ddf700 1 -- 172.21.15.72:0/3141463238 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f821013c1e0 msgr2=0x7f821013e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7f8215ddf700 1 --2- 172.21.15.72:0/3141463238 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f821013c1e0 0x7f821013e5c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8208009e50 tx=0x7f820800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:23.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7f8215ddf700 1 -- 172.21.15.72:0/3141463238 shutdown_connections 2023-10-03T10:18:23.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7f8215ddf700 1 --2- 172.21.15.72:0/3141463238 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f821013c1e0 0x7f821013e5c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7f8215ddf700 1 --2- 172.21.15.72:0/3141463238 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f821006a770 0x7f821009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7f8215ddf700 1 --2- 172.21.15.72:0/3141463238 >> v2:172.21.15.72:3300/0 conn(0x7f821009dc30 0x7f821009e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7f8215ddf700 1 -- 172.21.15.72:0/3141463238 >> 172.21.15.72:0/3141463238 conn(0x7f8210066f50 msgr2=0x7f821009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7f8215ddf700 1 -- 172.21.15.72:0/3141463238 shutdown_connections 2023-10-03T10:18:23.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7f8215ddf700 1 -- 172.21.15.72:0/3141463238 wait complete. 2023-10-03T10:18:23.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7fb80df71700 1 -- 172.21.15.72:0/967916780 shutdown_connections 2023-10-03T10:18:23.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7fb80df71700 1 --2- 172.21.15.72:0/967916780 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8081338a0 0x7fb808133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7fb80df71700 1 --2- 172.21.15.72:0/967916780 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80809de50 0x7fb80809e220 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7fb80df71700 1 -- 172.21.15.72:0/967916780 >> 172.21.15.72:0/967916780 conn(0x7fb8080a2aa0 msgr2=0x7fb8080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7fb80df71700 1 -- 172.21.15.72:0/967916780 shutdown_connections 2023-10-03T10:18:23.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.598+0000 7f8215ddf700 1 Processor -- start 2023-10-03T10:18:23.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.598+0000 7f8215ddf700 1 -- start start 2023-10-03T10:18:23.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.597+0000 7fb80df71700 1 -- 172.21.15.72:0/967916780 wait complete. 2023-10-03T10:18:23.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.598+0000 7fb80df71700 1 Processor -- start 2023-10-03T10:18:23.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.598+0000 7fb80df71700 1 -- start start 2023-10-03T10:18:23.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7fb80df71700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb80809de50 0x7fb80812b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7fb80df71700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80809e760 0x7fb80812bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7f8215ddf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f821006a770 0x7f82101cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7f8215ddf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f821009dc30 0x7f82101ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7f8215ddf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f821013c1e0 0x7f82101270d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7f8215ddf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821009f1a0 con 0x7f821006a770 2023-10-03T10:18:23.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7f8215ddf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821012a5d0 con 0x7f821013c1e0 2023-10-03T10:18:23.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7f8215ddf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82101c1360 con 0x7f821009dc30 2023-10-03T10:18:23.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7fb80df71700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8081338a0 0x7fb80812c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7fb80df71700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80812d930 con 0x7fb80809de50 2023-10-03T10:18:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7fb80df71700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080a1140 con 0x7fb8081338a0 2023-10-03T10:18:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7fb80df71700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb80806f640 con 0x7fb80809e760 2023-10-03T10:18:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7fb807fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8081338a0 0x7fb80812c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7fb807fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8081338a0 0x7fb80812c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55990/0 (socket says 172.21.15.72:55990) 2023-10-03T10:18:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7fb807fff700 1 -- 172.21.15.72:0/4077359453 learned_addr learned my addr 172.21.15.72:0/4077359453 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:23.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7fb8077fe700 1 --2- 172.21.15.72:0/4077359453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb80809de50 0x7fb80812b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7f820ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f821013c1e0 0x7f82101270d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7f820ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f821013c1e0 0x7f82101270d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:55982/0 (socket says 172.21.15.72:55982) 2023-10-03T10:18:23.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7f820ffff700 1 -- 172.21.15.72:0/1147546197 learned_addr learned my addr 172.21.15.72:0/1147546197 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:23.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7fb807fff700 1 -- 172.21.15.72:0/4077359453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80809e760 msgr2=0x7fb80812bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7fb807fff700 1 --2- 172.21.15.72:0/4077359453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80809e760 0x7fb80812bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7fb807fff700 1 -- 172.21.15.72:0/4077359453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb80809de50 msgr2=0x7fb80812b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7fb807fff700 1 --2- 172.21.15.72:0/4077359453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb80809de50 0x7fb80812b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7fb807fff700 1 -- 172.21.15.72:0/4077359453 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f80094a0 con 0x7fb8081338a0 2023-10-03T10:18:23.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.599+0000 7f820f7fe700 1 --2- 172.21.15.72:0/1147546197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f821006a770 0x7f82101cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7f820effd700 1 --2- 172.21.15.72:0/1147546197 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f821009dc30 0x7f82101ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7f820ffff700 1 -- 172.21.15.72:0/1147546197 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f821009dc30 msgr2=0x7f82101ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7f820ffff700 1 --2- 172.21.15.72:0/1147546197 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f821009dc30 0x7f82101ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7f820ffff700 1 -- 172.21.15.72:0/1147546197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f821006a770 msgr2=0x7f82101cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7f820ffff700 1 --2- 172.21.15.72:0/1147546197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f821006a770 0x7f82101cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7f820ffff700 1 -- 172.21.15.72:0/1147546197 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8208009b30 con 0x7f821013c1e0 2023-10-03T10:18:23.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7f820ffff700 1 --2- 172.21.15.72:0/1147546197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f821013c1e0 0x7f82101270d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8208003f80 tx=0x7f8208004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7fb807fff700 1 --2- 172.21.15.72:0/4077359453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8081338a0 0x7fb80812c180 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb80000cc50 tx=0x7fb80000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7f81f7fff700 1 -- 172.21.15.72:0/1147546197 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208004450 con 0x7f821013c1e0 2023-10-03T10:18:23.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7fb7fffff700 1 -- 172.21.15.72:0/4077359453 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800003c00 con 0x7fb8081338a0 2023-10-03T10:18:23.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7fb7fffff700 1 -- 172.21.15.72:0/4077359453 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb800003d60 con 0x7fb8081338a0 2023-10-03T10:18:23.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7fb7fffff700 1 -- 172.21.15.72:0/4077359453 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80000ab60 con 0x7fb8081338a0 2023-10-03T10:18:23.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7f8215ddf700 1 -- 172.21.15.72:0/1147546197 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821013bc10 con 0x7f821013c1e0 2023-10-03T10:18:23.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7f8215ddf700 1 -- 172.21.15.72:0/1147546197 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82100722e0 con 0x7f821013c1e0 2023-10-03T10:18:23.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7f81f7fff700 1 -- 172.21.15.72:0/1147546197 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82080045b0 con 0x7f821013c1e0 2023-10-03T10:18:23.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.600+0000 7f81f7fff700 1 -- 172.21.15.72:0/1147546197 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208004960 con 0x7f821013c1e0 2023-10-03T10:18:23.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.601+0000 7fb80df71700 1 -- 172.21.15.72:0/4077359453 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80812e9b0 con 0x7fb8081338a0 2023-10-03T10:18:23.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.601+0000 7fb80df71700 1 -- 172.21.15.72:0/4077359453 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80812db00 con 0x7fb8081338a0 2023-10-03T10:18:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.601+0000 7f81f7fff700 1 -- 172.21.15.72:0/1147546197 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f820801c410 con 0x7f821013c1e0 2023-10-03T10:18:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.601+0000 7f8215ddf700 1 -- 172.21.15.72:0/1147546197 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f00052e0 con 0x7f821013c1e0 2023-10-03T10:18:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.601+0000 7f81f7fff700 1 -- 172.21.15.72:0/1147546197 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8208041610 con 0x7f821013c1e0 2023-10-03T10:18:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.602+0000 7fb7fffff700 1 -- 172.21.15.72:0/4077359453 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb80000acc0 con 0x7fb8081338a0 2023-10-03T10:18:23.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.602+0000 7fb7fffff700 1 -- 172.21.15.72:0/4077359453 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb80003f730 con 0x7fb8081338a0 2023-10-03T10:18:23.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.602+0000 7fb80df71700 1 -- 172.21.15.72:0/4077359453 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80812ed80 con 0x7fb8081338a0 2023-10-03T10:18:23.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.605+0000 7f81dfbd2700 1 Processor -- start 2023-10-03T10:18:23.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.605+0000 7f81dfbd2700 1 -- start start 2023-10-03T10:18:23.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.606+0000 7f81dfbd2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81d809d9f0 0x7f81d8136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.606+0000 7f81dfbd2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81d8136a70 0x7f81d8138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.606+0000 7f81dfbd2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d809e130 con 0x7f81d81316c0 2023-10-03T10:18:23.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.606+0000 7f81dfbd2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d81321a0 con 0x7f81d809d9f0 2023-10-03T10:18:23.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.606+0000 7f81dfbd2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81d81312b0 con 0x7f81d8136a70 2023-10-03T10:18:23.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.606+0000 7f81dd16d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81d809d9f0 0x7f81d8136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.606+0000 7f81de16f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81d8136a70 0x7f81d8138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.606+0000 7f81dd16d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81d809d9f0 0x7f81d8136530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47690/0 (socket says 172.21.15.72:47690) 2023-10-03T10:18:23.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.606+0000 7f81dd16d700 1 -- 172.21.15.72:0/1462073113 learned_addr learned my addr 172.21.15.72:0/1462073113 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:23.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.606+0000 7f81dd16d700 1 -- 172.21.15.72:0/1462073113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81d8136a70 msgr2=0x7f81d8138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.606+0000 7f81dd16d700 1 --2- 172.21.15.72:0/1462073113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81d8136a70 0x7f81d8138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.606+0000 7f81dd16d700 1 -- 172.21.15.72:0/1462073113 >> v1:172.21.15.72:6789/0 conn(0x7f81d81316c0 legacy=0x7f81d8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.606+0000 7f81dd16d700 1 -- 172.21.15.72:0/1462073113 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d809f6e0 con 0x7f81d809d9f0 2023-10-03T10:18:23.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.607+0000 7f81f7fff700 1 -- 172.21.15.72:0/1147546197 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f820801c6c0 con 0x7f821013c1e0 2023-10-03T10:18:23.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.607+0000 7f81dd16d700 1 --2- 172.21.15.72:0/1462073113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81d809d9f0 0x7f81d8136530 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f81c80098f0 tx=0x7f81c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf77683392d9deaf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.607+0000 7f81dc96c700 1 -- 172.21.15.72:0/1462073113 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8011830 con 0x7f81d809d9f0 2023-10-03T10:18:23.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.607+0000 7f81dc96c700 1 -- 172.21.15.72:0/1462073113 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c8011990 con 0x7f81d809d9f0 2023-10-03T10:18:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.607+0000 7f81dc96c700 1 -- 172.21.15.72:0/1462073113 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8011d20 con 0x7f81d809d9f0 2023-10-03T10:18:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.608+0000 7f81dfbd2700 1 -- 172.21.15.72:0/1462073113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81d809d9f0 msgr2=0x7f81d8136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.608+0000 7f81dfbd2700 1 --2- 172.21.15.72:0/1462073113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81d809d9f0 0x7f81d8136530 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f81c80098f0 tx=0x7f81c8009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.608+0000 7f81dfbd2700 1 -- 172.21.15.72:0/1462073113 shutdown_connections 2023-10-03T10:18:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.608+0000 7f81dfbd2700 1 --2- 172.21.15.72:0/1462073113 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81d8136a70 0x7f81d8138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.608+0000 7f81dfbd2700 1 --2- 172.21.15.72:0/1462073113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81d809d9f0 0x7f81d8136530 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.608+0000 7f81dfbd2700 1 -- 172.21.15.72:0/1462073113 >> 172.21.15.72:0/1462073113 conn(0x7f81d8066f50 msgr2=0x7f81d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.608+0000 7f81dfbd2700 1 -- 172.21.15.72:0/1462073113 shutdown_connections 2023-10-03T10:18:23.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.608+0000 7f81dfbd2700 1 -- 172.21.15.72:0/1462073113 wait complete. 2023-10-03T10:18:23.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.609+0000 7f81dfbd2700 1 Processor -- start 2023-10-03T10:18:23.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.609+0000 7f81dfbd2700 1 -- start start 2023-10-03T10:18:23.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81dfbd2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81d809d9f0 0x7f81d81c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81dfbd2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81d81316c0 0x7f81d81c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81dfbd2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81d8136a70 0x7f81d81c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81dfbd2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8135700 con 0x7f81d809d9f0 2023-10-03T10:18:23.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81dfbd2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8072220 con 0x7f81d8136a70 2023-10-03T10:18:23.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81dfbd2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8136550 con 0x7f81d81316c0 2023-10-03T10:18:23.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81dd96e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81d809d9f0 0x7f81d81c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81dd16d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81d81316c0 0x7f81d81c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81dd96e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81d809d9f0 0x7f81d81c6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47696/0 (socket says 172.21.15.72:47696) 2023-10-03T10:18:23.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81dd96e700 1 -- 172.21.15.72:0/139601487 learned_addr learned my addr 172.21.15.72:0/139601487 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:23.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81de16f700 1 --2- 172.21.15.72:0/139601487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81d8136a70 0x7f81d81c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81dd96e700 1 -- 172.21.15.72:0/139601487 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81d81316c0 msgr2=0x7f81d81c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81dd96e700 1 --2- 172.21.15.72:0/139601487 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81d81316c0 0x7f81d81c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81dd96e700 1 -- 172.21.15.72:0/139601487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81d8136a70 msgr2=0x7f81d81c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81dd96e700 1 --2- 172.21.15.72:0/139601487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81d8136a70 0x7f81d81c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.610+0000 7f81dd96e700 1 -- 172.21.15.72:0/139601487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8009550 con 0x7f81d809d9f0 2023-10-03T10:18:23.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.611+0000 7f81dd96e700 1 --2- 172.21.15.72:0/139601487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81d809d9f0 0x7f81d81c6330 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f81d400c4e0 tx=0x7f81d400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.611+0000 7f81ce7fc700 1 -- 172.21.15.72:0/139601487 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d40052d0 con 0x7f81d809d9f0 2023-10-03T10:18:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.611+0000 7f81ce7fc700 1 -- 172.21.15.72:0/139601487 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d4005430 con 0x7f81d809d9f0 2023-10-03T10:18:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.611+0000 7f81ce7fc700 1 -- 172.21.15.72:0/139601487 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d40119b0 con 0x7f81d809d9f0 2023-10-03T10:18:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.611+0000 7f81dfbd2700 1 -- 172.21.15.72:0/139601487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d812b900 con 0x7f81d809d9f0 2023-10-03T10:18:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.611+0000 7f81dfbd2700 1 -- 172.21.15.72:0/139601487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d80702f0 con 0x7f81d809d9f0 2023-10-03T10:18:23.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.611+0000 7fb7fffff700 1 -- 172.21.15.72:0/4077359453 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8000198f0 con 0x7fb8081338a0 2023-10-03T10:18:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.612+0000 7f81dfbd2700 1 -- 172.21.15.72:0/139601487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d8074ea0 con 0x7f81d809d9f0 2023-10-03T10:18:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.612+0000 7f81ce7fc700 1 -- 172.21.15.72:0/139601487 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81d4011b10 con 0x7f81d809d9f0 2023-10-03T10:18:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.612+0000 7f81ce7fc700 1 -- 172.21.15.72:0/139601487 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f81d4019de0 con 0x7f81d809d9f0 2023-10-03T10:18:23.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.621+0000 7f81ce7fc700 1 -- 172.21.15.72:0/139601487 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81d4047060 con 0x7f81d809d9f0 2023-10-03T10:18:23.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.648+0000 7ff5ac05a700 1 Processor -- start 2023-10-03T10:18:23.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.648+0000 7ff5ac05a700 1 -- start start 2023-10-03T10:18:23.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.649+0000 7ff5ac05a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5a40a0a30 0x7ff5a40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.649+0000 7ff5ac05a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff5a4138d80 0x7ff5a413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.649+0000 7ff5ac05a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a40a2a70 con 0x7ff5a409d630 2023-10-03T10:18:23.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.649+0000 7ff5ac05a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a40a01d0 con 0x7ff5a40a0a30 2023-10-03T10:18:23.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.649+0000 7ff5ac05a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a409e2b0 con 0x7ff5a4138d80 2023-10-03T10:18:23.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.649+0000 7ff5a9df6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5a40a0a30 0x7ff5a40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.649+0000 7ff5a9df6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5a40a0a30 0x7ff5a40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47704/0 (socket says 172.21.15.72:47704) 2023-10-03T10:18:23.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.649+0000 7ff5a9df6700 1 -- 172.21.15.72:0/2382053791 learned_addr learned my addr 172.21.15.72:0/2382053791 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:23.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.649+0000 7ff5aa5f7700 1 --2- 172.21.15.72:0/2382053791 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff5a4138d80 0x7ff5a413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.649+0000 7ff5a9df6700 1 -- 172.21.15.72:0/2382053791 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff5a4138d80 msgr2=0x7ff5a413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.649+0000 7ff5a9df6700 1 --2- 172.21.15.72:0/2382053791 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff5a4138d80 0x7ff5a413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.649+0000 7ff5a9df6700 1 -- 172.21.15.72:0/2382053791 >> v1:172.21.15.72:6789/0 conn(0x7ff5a409d630 legacy=0x7ff5a40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.649+0000 7ff5a9df6700 1 -- 172.21.15.72:0/2382053791 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a409dc50 con 0x7ff5a40a0a30 2023-10-03T10:18:23.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.649+0000 7ff5a9df6700 1 --2- 172.21.15.72:0/2382053791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5a40a0a30 0x7ff5a40a0e00 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00098f0 tx=0x7ff5a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e000079ac3ff849 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.650+0000 7ff5a8df4700 1 -- 172.21.15.72:0/2382053791 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0004230 con 0x7ff5a40a0a30 2023-10-03T10:18:23.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.650+0000 7ff5a8df4700 1 -- 172.21.15.72:0/2382053791 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a0004390 con 0x7ff5a40a0a30 2023-10-03T10:18:23.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.650+0000 7ff5a8df4700 1 -- 172.21.15.72:0/2382053791 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a00036a0 con 0x7ff5a40a0a30 2023-10-03T10:18:23.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.650+0000 7ff5ac05a700 1 -- 172.21.15.72:0/2382053791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5a40a0a30 msgr2=0x7ff5a40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.650+0000 7ff5ac05a700 1 --2- 172.21.15.72:0/2382053791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5a40a0a30 0x7ff5a40a0e00 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00098f0 tx=0x7ff5a0009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:23.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.650+0000 7ff5ac05a700 1 -- 172.21.15.72:0/2382053791 shutdown_connections 2023-10-03T10:18:23.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.650+0000 7ff5ac05a700 1 --2- 172.21.15.72:0/2382053791 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff5a4138d80 0x7ff5a413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.650+0000 7ff5ac05a700 1 --2- 172.21.15.72:0/2382053791 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5a40a0a30 0x7ff5a40a0e00 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.650+0000 7ff5ac05a700 1 -- 172.21.15.72:0/2382053791 >> 172.21.15.72:0/2382053791 conn(0x7ff5a40a3050 msgr2=0x7ff5a40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.650+0000 7ff5ac05a700 1 -- 172.21.15.72:0/2382053791 shutdown_connections 2023-10-03T10:18:23.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.650+0000 7ff5ac05a700 1 -- 172.21.15.72:0/2382053791 wait complete. 2023-10-03T10:18:23.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.652+0000 7ff5ac05a700 1 Processor -- start 2023-10-03T10:18:23.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.652+0000 7ff5ac05a700 1 -- start start 2023-10-03T10:18:23.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.652+0000 7ff5ac05a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5a409d630 0x7ff5a4120770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.652+0000 7ff5ac05a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff5a40a0a30 0x7ff5a4120cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.652+0000 7ff5ac05a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5a4138d80 0x7ff5a41211f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff5ac05a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40a4e40 con 0x7ff5a409d630 2023-10-03T10:18:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff5ac05a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40a0410 con 0x7ff5a4138d80 2023-10-03T10:18:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff5ac05a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a41239d0 con 0x7ff5a40a0a30 2023-10-03T10:18:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff5a9df6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5a409d630 0x7ff5a4120770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff5a9df6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5a409d630 0x7ff5a4120770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47708/0 (socket says 172.21.15.72:47708) 2023-10-03T10:18:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff5a9df6700 1 -- 172.21.15.72:0/1933541685 learned_addr learned my addr 172.21.15.72:0/1933541685 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff5aa5f7700 1 --2- 172.21.15.72:0/1933541685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5a4138d80 0x7ff5a41211f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff5a9df6700 1 -- 172.21.15.72:0/1933541685 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff5a40a0a30 msgr2=0x7ff5a4120cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff5a9df6700 1 --2- 172.21.15.72:0/1933541685 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff5a40a0a30 0x7ff5a4120cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff5a9df6700 1 -- 172.21.15.72:0/1933541685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5a4138d80 msgr2=0x7ff5a41211f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff5a9df6700 1 --2- 172.21.15.72:0/1933541685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5a4138d80 0x7ff5a41211f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff5a9df6700 1 -- 172.21.15.72:0/1933541685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0009550 con 0x7ff5a409d630 2023-10-03T10:18:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff5a9df6700 1 --2- 172.21.15.72:0/1933541685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5a409d630 0x7ff5a4120770 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009130 tx=0x7ff5a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff59a7fc700 1 -- 172.21.15.72:0/1933541685 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0003c10 con 0x7ff5a409d630 2023-10-03T10:18:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff59a7fc700 1 -- 172.21.15.72:0/1933541685 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a001f070 con 0x7ff5a409d630 2023-10-03T10:18:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff5ac05a700 1 -- 172.21.15.72:0/1933541685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a4123f60 con 0x7ff5a409d630 2023-10-03T10:18:23.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff59a7fc700 1 -- 172.21.15.72:0/1933541685 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0011630 con 0x7ff5a409d630 2023-10-03T10:18:23.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.653+0000 7ff5ac05a700 1 -- 172.21.15.72:0/1933541685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a41249d0 con 0x7ff5a409d630 2023-10-03T10:18:23.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.654+0000 7ff59a7fc700 1 -- 172.21.15.72:0/1933541685 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5a0021030 con 0x7ff5a409d630 2023-10-03T10:18:23.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.654+0000 7ff59a7fc700 1 -- 172.21.15.72:0/1933541685 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff5a0040bd0 con 0x7ff5a409d630 2023-10-03T10:18:23.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.655+0000 7ff5ac05a700 1 -- 172.21.15.72:0/1933541685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a4123580 con 0x7ff5a409d630 2023-10-03T10:18:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.659+0000 7ff59a7fc700 1 -- 172.21.15.72:0/1933541685 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5a00239c0 con 0x7ff5a409d630 2023-10-03T10:18:23.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.807+0000 7fb80df71700 1 -- 172.21.15.72:0/4077359453 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb808074ea0 con 0x7fb8081338a0 2023-10-03T10:18:23.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.807+0000 7f8215ddf700 1 -- 172.21.15.72:0/1147546197 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f81f0005590 con 0x7f821013c1e0 2023-10-03T10:18:23.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.807+0000 7fb7fffff700 1 -- 172.21.15.72:0/4077359453 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb800011380 con 0x7fb8081338a0 2023-10-03T10:18:23.808 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:23.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.807+0000 7f81f7fff700 1 -- 172.21.15.72:0/1147546197 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8208032070 con 0x7f821013c1e0 2023-10-03T10:18:23.809 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:23.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.809+0000 7fb80df71700 1 -- 172.21.15.72:0/4077359453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8081338a0 msgr2=0x7fb80812c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.809+0000 7fb80df71700 1 --2- 172.21.15.72:0/4077359453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8081338a0 0x7fb80812c180 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb80000cc50 tx=0x7fb80000cf60 comp rx=0 tx=0).stop 2023-10-03T10:18:23.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.809+0000 7fb80df71700 1 -- 172.21.15.72:0/4077359453 shutdown_connections 2023-10-03T10:18:23.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.809+0000 7fb80df71700 1 --2- 172.21.15.72:0/4077359453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb80809de50 0x7fb80812b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.809+0000 7fb80df71700 1 --2- 172.21.15.72:0/4077359453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb8081338a0 0x7fb80812c180 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.809+0000 7fb80df71700 1 --2- 172.21.15.72:0/4077359453 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb80809e760 0x7fb80812bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.809+0000 7fb80df71700 1 -- 172.21.15.72:0/4077359453 >> 172.21.15.72:0/4077359453 conn(0x7fb8080a2aa0 msgr2=0x7fb808132b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.809+0000 7fb80df71700 1 -- 172.21.15.72:0/4077359453 shutdown_connections 2023-10-03T10:18:23.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.809+0000 7fb80df71700 1 -- 172.21.15.72:0/4077359453 wait complete. 2023-10-03T10:18:23.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.810+0000 7f8215ddf700 1 -- 172.21.15.72:0/1147546197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f821013c1e0 msgr2=0x7f82101270d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.810+0000 7f8215ddf700 1 --2- 172.21.15.72:0/1147546197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f821013c1e0 0x7f82101270d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8208003f80 tx=0x7f8208004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.810+0000 7f8215ddf700 1 -- 172.21.15.72:0/1147546197 shutdown_connections 2023-10-03T10:18:23.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.810+0000 7f8215ddf700 1 --2- 172.21.15.72:0/1147546197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f821006a770 0x7f82101cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.810+0000 7f8215ddf700 1 --2- 172.21.15.72:0/1147546197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f821013c1e0 0x7f82101270d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.810+0000 7f8215ddf700 1 --2- 172.21.15.72:0/1147546197 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f821009dc30 0x7f82101ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.810+0000 7f8215ddf700 1 -- 172.21.15.72:0/1147546197 >> 172.21.15.72:0/1147546197 conn(0x7f8210066f50 msgr2=0x7f821009b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.810+0000 7f8215ddf700 1 -- 172.21.15.72:0/1147546197 shutdown_connections 2023-10-03T10:18:23.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.810+0000 7f8215ddf700 1 -- 172.21.15.72:0/1147546197 wait complete. 2023-10-03T10:18:23.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:23.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:23.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.829+0000 7f81dfbd2700 1 -- 172.21.15.72:0/139601487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f81d809e130 con 0x7f81d809d9f0 2023-10-03T10:18:23.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.829+0000 7f81ce7fc700 1 -- 172.21.15.72:0/139601487 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f81d809e130 con 0x7f81d809d9f0 2023-10-03T10:18:23.829 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:23.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.831+0000 7f81dfbd2700 1 -- 172.21.15.72:0/139601487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81d809d9f0 msgr2=0x7f81d81c6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.831+0000 7f81dfbd2700 1 --2- 172.21.15.72:0/139601487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81d809d9f0 0x7f81d81c6330 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f81d400c4e0 tx=0x7f81d400c7f0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.831+0000 7f81dfbd2700 1 -- 172.21.15.72:0/139601487 shutdown_connections 2023-10-03T10:18:23.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.831+0000 7f81dfbd2700 1 --2- 172.21.15.72:0/139601487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81d809d9f0 0x7f81d81c6330 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.831+0000 7f81dfbd2700 1 --2- 172.21.15.72:0/139601487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81d8136a70 0x7f81d81c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.831+0000 7f81dfbd2700 1 --2- 172.21.15.72:0/139601487 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f81d81316c0 0x7f81d81c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.832+0000 7f81dfbd2700 1 -- 172.21.15.72:0/139601487 >> 172.21.15.72:0/139601487 conn(0x7f81d8066f50 msgr2=0x7f81d81386e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.832+0000 7f81dfbd2700 1 -- 172.21.15.72:0/139601487 shutdown_connections 2023-10-03T10:18:23.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.832+0000 7f81dfbd2700 1 -- 172.21.15.72:0/139601487 wait complete. 2023-10-03T10:18:23.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:23.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.864+0000 7ff5ac05a700 1 -- 172.21.15.72:0/1933541685 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff5a4123580 con 0x7ff5a409d630 2023-10-03T10:18:23.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.864+0000 7ff59a7fc700 1 -- 172.21.15.72:0/1933541685 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff5a001b440 con 0x7ff5a409d630 2023-10-03T10:18:23.863 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:23.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.866+0000 7ff5ac05a700 1 -- 172.21.15.72:0/1933541685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5a409d630 msgr2=0x7ff5a4120770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.866+0000 7ff5ac05a700 1 --2- 172.21.15.72:0/1933541685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5a409d630 0x7ff5a4120770 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009130 tx=0x7ff5a0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:23.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.866+0000 7ff5ac05a700 1 -- 172.21.15.72:0/1933541685 shutdown_connections 2023-10-03T10:18:23.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.866+0000 7ff5ac05a700 1 --2- 172.21.15.72:0/1933541685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5a409d630 0x7ff5a4120770 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.866+0000 7ff5ac05a700 1 --2- 172.21.15.72:0/1933541685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5a4138d80 0x7ff5a41211f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.866+0000 7ff5ac05a700 1 --2- 172.21.15.72:0/1933541685 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff5a40a0a30 0x7ff5a4120cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.866+0000 7ff5ac05a700 1 -- 172.21.15.72:0/1933541685 >> 172.21.15.72:0/1933541685 conn(0x7ff5a40a3050 msgr2=0x7ff5a40a5270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.866+0000 7ff5ac05a700 1 -- 172.21.15.72:0/1933541685 shutdown_connections 2023-10-03T10:18:23.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:23.866+0000 7ff5ac05a700 1 -- 172.21.15.72:0/1933541685 wait complete. 2023-10-03T10:18:23.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:24.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:24.827 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:24.844 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:24.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:24.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.976+0000 7f647270a700 1 Processor -- start 2023-10-03T10:18:24.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.976+0000 7f647270a700 1 -- start start 2023-10-03T10:18:24.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.977+0000 7f647270a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f646c131630 0x7f646c131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.977+0000 7f647270a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f646c131f40 0x7f646c06e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.977+0000 7f647270a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646c071a00 con 0x7f646c06e9d0 2023-10-03T10:18:24.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.977+0000 7f647270a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c131430 con 0x7f646c131630 2023-10-03T10:18:24.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.977+0000 7f647270a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f646c09a510 con 0x7f646c131f40 2023-10-03T10:18:24.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.977+0000 7f646bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f646c131630 0x7f646c131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.977+0000 7f646b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f646c131f40 0x7f646c06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.977+0000 7f646bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f646c131630 0x7f646c131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56022/0 (socket says 172.21.15.72:56022) 2023-10-03T10:18:24.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.977+0000 7f646b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f646c131f40 0x7f646c06e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36670/0 (socket says 172.21.15.72:36670) 2023-10-03T10:18:24.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.977+0000 7f646bfff700 1 -- 172.21.15.72:0/2759004070 learned_addr learned my addr 172.21.15.72:0/2759004070 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:24.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.978+0000 7f646b7fe700 1 -- 172.21.15.72:0/2759004070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f646c131630 msgr2=0x7f646c131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.978+0000 7f646b7fe700 1 --2- 172.21.15.72:0/2759004070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f646c131630 0x7f646c131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.978+0000 7f646b7fe700 1 -- 172.21.15.72:0/2759004070 >> v1:172.21.15.72:6789/0 conn(0x7f646c06e9d0 legacy=0x7f646c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.978+0000 7f646b7fe700 1 -- 172.21.15.72:0/2759004070 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c0721c0 con 0x7f646c131f40 2023-10-03T10:18:24.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.978+0000 7f646bfff700 1 --2- 172.21.15.72:0/2759004070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f646c131630 0x7f646c131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.978+0000 7f646b7fe700 1 --2- 172.21.15.72:0/2759004070 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f646c131f40 0x7f646c06e490 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6460009870 tx=0x7f6460009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63f18cf17ef60e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.978+0000 7f646affd700 1 -- 172.21.15.72:0/2759004070 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460004230 con 0x7f646c131f40 2023-10-03T10:18:24.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.978+0000 7f646affd700 1 -- 172.21.15.72:0/2759004070 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6460004390 con 0x7f646c131f40 2023-10-03T10:18:24.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.978+0000 7f646affd700 1 -- 172.21.15.72:0/2759004070 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64600036a0 con 0x7f646c131f40 2023-10-03T10:18:24.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.979+0000 7f647270a700 1 -- 172.21.15.72:0/2759004070 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f646c131f40 msgr2=0x7f646c06e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.979+0000 7f647270a700 1 --2- 172.21.15.72:0/2759004070 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f646c131f40 0x7f646c06e490 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6460009870 tx=0x7f6460009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:24.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.979+0000 7f647270a700 1 -- 172.21.15.72:0/2759004070 shutdown_connections 2023-10-03T10:18:24.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.979+0000 7f647270a700 1 --2- 172.21.15.72:0/2759004070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f646c131630 0x7f646c131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.979+0000 7f647270a700 1 --2- 172.21.15.72:0/2759004070 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f646c131f40 0x7f646c06e490 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.979+0000 7f647270a700 1 -- 172.21.15.72:0/2759004070 >> 172.21.15.72:0/2759004070 conn(0x7f646c0a2aa0 msgr2=0x7f646c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.979+0000 7f647270a700 1 -- 172.21.15.72:0/2759004070 shutdown_connections 2023-10-03T10:18:24.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.979+0000 7f647270a700 1 -- 172.21.15.72:0/2759004070 wait complete. 2023-10-03T10:18:24.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.980+0000 7f647270a700 1 Processor -- start 2023-10-03T10:18:24.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.980+0000 7f647270a700 1 -- start start 2023-10-03T10:18:24.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.980+0000 7f647270a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f646c06e9d0 0x7f646c11b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.980+0000 7f647270a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f646c131630 0x7f646c11bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.980+0000 7f647270a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f646c131f40 0x7f646c11c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.980+0000 7f647270a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c11e1a0 con 0x7f646c131630 2023-10-03T10:18:24.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.980+0000 7f647270a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646c11f400 con 0x7f646c131f40 2023-10-03T10:18:24.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.980+0000 7f647270a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f646c11e7d0 con 0x7f646c06e9d0 2023-10-03T10:18:24.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.981+0000 7f646bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f646c06e9d0 0x7f646c11b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.981+0000 7f646bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f646c06e9d0 0x7f646c11b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36678/0 (socket says 172.21.15.72:36678) 2023-10-03T10:18:24.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.981+0000 7f646bfff700 1 -- 172.21.15.72:0/4162036912 learned_addr learned my addr 172.21.15.72:0/4162036912 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:24.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.981+0000 7f646b7fe700 1 --2- 172.21.15.72:0/4162036912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f646c131630 0x7f646c11bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.981+0000 7f6470ca7700 1 --2- 172.21.15.72:0/4162036912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f646c131f40 0x7f646c11c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.981+0000 7f646bfff700 1 -- 172.21.15.72:0/4162036912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f646c131f40 msgr2=0x7f646c11c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.981+0000 7f646bfff700 1 --2- 172.21.15.72:0/4162036912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f646c131f40 0x7f646c11c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.981+0000 7f646bfff700 1 -- 172.21.15.72:0/4162036912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f646c131630 msgr2=0x7f646c11bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.981+0000 7f646bfff700 1 --2- 172.21.15.72:0/4162036912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f646c131630 0x7f646c11bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.981+0000 7f646bfff700 1 -- 172.21.15.72:0/4162036912 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c009550 con 0x7f646c06e9d0 2023-10-03T10:18:24.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.981+0000 7f646bfff700 1 --2- 172.21.15.72:0/4162036912 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f646c06e9d0 0x7f646c11b960 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f645c00ec10 tx=0x7f645c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.981+0000 7f6468ff9700 1 -- 172.21.15.72:0/4162036912 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c00c850 con 0x7f646c06e9d0 2023-10-03T10:18:24.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.981+0000 7f6468ff9700 1 -- 172.21.15.72:0/4162036912 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c00c9b0 con 0x7f646c06e9d0 2023-10-03T10:18:24.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.981+0000 7f6468ff9700 1 -- 172.21.15.72:0/4162036912 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c00cd40 con 0x7f646c06e9d0 2023-10-03T10:18:24.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.982+0000 7f647270a700 1 -- 172.21.15.72:0/4162036912 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64600094a0 con 0x7f646c06e9d0 2023-10-03T10:18:24.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.982+0000 7f647270a700 1 -- 172.21.15.72:0/4162036912 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646c0a3070 con 0x7f646c06e9d0 2023-10-03T10:18:24.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.983+0000 7f6468ff9700 1 -- 172.21.15.72:0/4162036912 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f645c013470 con 0x7f646c06e9d0 2023-10-03T10:18:24.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.983+0000 7f6468ff9700 1 -- 172.21.15.72:0/4162036912 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f645c03fc00 con 0x7f646c06e9d0 2023-10-03T10:18:24.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.983+0000 7f647270a700 1 -- 172.21.15.72:0/4162036912 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646c071f30 con 0x7f646c06e9d0 2023-10-03T10:18:24.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:24.989+0000 7f6468ff9700 1 -- 172.21.15.72:0/4162036912 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f645c021080 con 0x7f646c06e9d0 2023-10-03T10:18:25.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.005+0000 7fed13c55700 1 Processor -- start 2023-10-03T10:18:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.005+0000 7fed13c55700 1 -- start start 2023-10-03T10:18:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.005+0000 7fed13c55700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c095690 0x7fed0c134cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.005+0000 7fed13c55700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c138430 0x7fed0c13fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.005+0000 7fed13c55700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0c09e800 con 0x7fed0c1378f0 2023-10-03T10:18:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.005+0000 7fed13c55700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c095a60 con 0x7fed0c095690 2023-10-03T10:18:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.005+0000 7fed13c55700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c094bd0 con 0x7fed0c138430 2023-10-03T10:18:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.006+0000 7fed119f1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c095690 0x7fed0c134cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.006+0000 7fed111f0700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fed0c1378f0 0x7fed0c137d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55362/0 (socket says 172.21.15.72:55362) 2023-10-03T10:18:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.006+0000 7fed111f0700 1 -- 172.21.15.72:0/2738486639 learned_addr learned my addr 172.21.15.72:0/2738486639 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.006+0000 7fed121f2700 1 --2- 172.21.15.72:0/2738486639 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c138430 0x7fed0c13fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.006+0000 7fed109ef700 1 -- 172.21.15.72:0/2738486639 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066786290 0 0) 0x7fed0c09e800 con 0x7fed0c1378f0 2023-10-03T10:18:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.006+0000 7fed109ef700 1 -- 172.21.15.72:0/2738486639 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf80035b0 con 0x7fed0c1378f0 2023-10-03T10:18:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.006+0000 7fed121f2700 1 -- 172.21.15.72:0/2738486639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c095690 msgr2=0x7fed0c134cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.006+0000 7fed121f2700 1 --2- 172.21.15.72:0/2738486639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c095690 0x7fed0c134cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.006+0000 7fed121f2700 1 -- 172.21.15.72:0/2738486639 >> v1:172.21.15.72:6789/0 conn(0x7fed0c1378f0 legacy=0x7fed0c137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.006+0000 7fed121f2700 1 -- 172.21.15.72:0/2738486639 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c0940e0 con 0x7fed0c138430 2023-10-03T10:18:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.006+0000 7fed119f1700 1 --2- 172.21.15.72:0/2738486639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c095690 0x7fed0c134cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.006+0000 7fed121f2700 1 --2- 172.21.15.72:0/2738486639 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c138430 0x7fed0c13fc30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fed04009dc0 tx=0x7fed0400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9712ad1a39fe065 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.006+0000 7fed109ef700 1 -- 172.21.15.72:0/2738486639 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0400e070 con 0x7fed0c138430 2023-10-03T10:18:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.006+0000 7fed109ef700 1 -- 172.21.15.72:0/2738486639 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0400bb20 con 0x7fed0c138430 2023-10-03T10:18:25.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.006+0000 7fed109ef700 1 -- 172.21.15.72:0/2738486639 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04012430 con 0x7fed0c138430 2023-10-03T10:18:25.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.007+0000 7fed13c55700 1 -- 172.21.15.72:0/2738486639 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c138430 msgr2=0x7fed0c13fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.007+0000 7fed13c55700 1 --2- 172.21.15.72:0/2738486639 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c138430 0x7fed0c13fc30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fed04009dc0 tx=0x7fed0400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:25.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.007+0000 7fed13c55700 1 -- 172.21.15.72:0/2738486639 shutdown_connections 2023-10-03T10:18:25.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.007+0000 7fed13c55700 1 --2- 172.21.15.72:0/2738486639 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c138430 0x7fed0c13fc30 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.007+0000 7fed13c55700 1 --2- 172.21.15.72:0/2738486639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c095690 0x7fed0c134cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.007+0000 7fed13c55700 1 -- 172.21.15.72:0/2738486639 >> 172.21.15.72:0/2738486639 conn(0x7fed0c0a2360 msgr2=0x7fed0c0a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.007+0000 7fed13c55700 1 -- 172.21.15.72:0/2738486639 shutdown_connections 2023-10-03T10:18:25.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.007+0000 7fed13c55700 1 -- 172.21.15.72:0/2738486639 wait complete. 2023-10-03T10:18:25.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.008+0000 7fed13c55700 1 Processor -- start 2023-10-03T10:18:25.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.008+0000 7fed13c55700 1 -- start start 2023-10-03T10:18:25.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed13c55700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c095690 0x7fed0c133740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed13c55700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c1378f0 0x7fed0c133c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed13c55700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed0c138430 0x7fed0c1322f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed13c55700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c071030 con 0x7fed0c138430 2023-10-03T10:18:25.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed13c55700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0a06c0 con 0x7fed0c1378f0 2023-10-03T10:18:25.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed13c55700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0946d0 con 0x7fed0c095690 2023-10-03T10:18:25.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed121f2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed0c138430 0x7fed0c1322f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed111f0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c1378f0 0x7fed0c133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed119f1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c095690 0x7fed0c133740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed121f2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed0c138430 0x7fed0c1322f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47722/0 (socket says 172.21.15.72:47722) 2023-10-03T10:18:25.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed119f1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c095690 0x7fed0c133740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36690/0 (socket says 172.21.15.72:36690) 2023-10-03T10:18:25.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed121f2700 1 -- 172.21.15.72:0/1357929987 learned_addr learned my addr 172.21.15.72:0/1357929987 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:25.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed111f0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c1378f0 0x7fed0c133c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56056/0 (socket says 172.21.15.72:56056) 2023-10-03T10:18:25.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed111f0700 1 -- 172.21.15.72:0/1357929987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c095690 msgr2=0x7fed0c133740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed111f0700 1 --2- 172.21.15.72:0/1357929987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c095690 0x7fed0c133740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed111f0700 1 -- 172.21.15.72:0/1357929987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed0c138430 msgr2=0x7fed0c1322f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed111f0700 1 --2- 172.21.15.72:0/1357929987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed0c138430 0x7fed0c1322f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed111f0700 1 -- 172.21.15.72:0/1357929987 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed080094a0 con 0x7fed0c1378f0 2023-10-03T10:18:25.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed121f2700 1 --2- 172.21.15.72:0/1357929987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed0c138430 0x7fed0c1322f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:25.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.009+0000 7fed119f1700 1 --2- 172.21.15.72:0/1357929987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c095690 0x7fed0c133740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:25.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.010+0000 7fed111f0700 1 --2- 172.21.15.72:0/1357929987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c1378f0 0x7fed0c133c80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00c460 tx=0x7fecfc00c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.010+0000 7fed027fc700 1 -- 172.21.15.72:0/1357929987 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc005d70 con 0x7fed0c1378f0 2023-10-03T10:18:25.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.010+0000 7fed027fc700 1 -- 172.21.15.72:0/1357929987 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc0070d0 con 0x7fed0c1378f0 2023-10-03T10:18:25.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.010+0000 7fed027fc700 1 -- 172.21.15.72:0/1357929987 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc007440 con 0x7fed0c1378f0 2023-10-03T10:18:25.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.010+0000 7fed13c55700 1 -- 172.21.15.72:0/1357929987 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed04009a70 con 0x7fed0c1378f0 2023-10-03T10:18:25.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.010+0000 7fed13c55700 1 -- 172.21.15.72:0/1357929987 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0c06eca0 con 0x7fed0c1378f0 2023-10-03T10:18:25.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.011+0000 7fed13c55700 1 -- 172.21.15.72:0/1357929987 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0c071510 con 0x7fed0c1378f0 2023-10-03T10:18:25.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.011+0000 7fed027fc700 1 -- 172.21.15.72:0/1357929987 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fecfc0075a0 con 0x7fed0c1378f0 2023-10-03T10:18:25.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.012+0000 7fed027fc700 1 -- 172.21.15.72:0/1357929987 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fecfc03f090 con 0x7fed0c1378f0 2023-10-03T10:18:25.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.013+0000 7f70199ff700 1 Processor -- start 2023-10-03T10:18:25.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.013+0000 7f70199ff700 1 -- start start 2023-10-03T10:18:25.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.014+0000 7f70199ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f701406a770 0x7f7014133830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.014+0000 7f70199ff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7014133d70 0x7f70141303d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.014+0000 7f70199ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70141341a0 con 0x7f7014133280 2023-10-03T10:18:25.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.014+0000 7f70199ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701406ab40 con 0x7f701406a770 2023-10-03T10:18:25.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.014+0000 7f70199ff700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f701409a2c0 con 0x7f7014133d70 2023-10-03T10:18:25.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.014+0000 7f70137fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7014133d70 0x7f70141303d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.014+0000 7f70137fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7014133d70 0x7f70141303d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36694/0 (socket says 172.21.15.72:36694) 2023-10-03T10:18:25.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.014+0000 7f70137fe700 1 -- 172.21.15.72:0/2717443803 learned_addr learned my addr 172.21.15.72:0/2717443803 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:25.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.014+0000 7f70137fe700 1 -- 172.21.15.72:0/2717443803 >> v2:172.21.15.72:3300/0 conn(0x7f701406a770 msgr2=0x7f7014133830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:25.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.014+0000 7f70137fe700 1 --2- 172.21.15.72:0/2717443803 >> v2:172.21.15.72:3300/0 conn(0x7f701406a770 0x7f7014133830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.014+0000 7f70137fe700 1 -- 172.21.15.72:0/2717443803 >> v1:172.21.15.72:6789/0 conn(0x7f7014133280 legacy=0x7f701412fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:25.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.014+0000 7f70137fe700 1 -- 172.21.15.72:0/2717443803 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701409f440 con 0x7f7014133d70 2023-10-03T10:18:25.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.015+0000 7f70137fe700 1 --2- 172.21.15.72:0/2717443803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7014133d70 0x7f70141303d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f700c009e50 tx=0x7f700c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c42b285cca2459f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.015+0000 7f7011ffb700 1 -- 172.21.15.72:0/2717443803 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00e070 con 0x7f7014133d70 2023-10-03T10:18:25.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.015+0000 7f7011ffb700 1 -- 172.21.15.72:0/2717443803 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c003a20 con 0x7f7014133d70 2023-10-03T10:18:25.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.015+0000 7f7011ffb700 1 -- 172.21.15.72:0/2717443803 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c003dd0 con 0x7f7014133d70 2023-10-03T10:18:25.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.016+0000 7f70199ff700 1 -- 172.21.15.72:0/2717443803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7014133d70 msgr2=0x7f70141303d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.016+0000 7f70199ff700 1 --2- 172.21.15.72:0/2717443803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7014133d70 0x7f70141303d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f700c009e50 tx=0x7f700c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:25.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.016+0000 7f70199ff700 1 -- 172.21.15.72:0/2717443803 shutdown_connections 2023-10-03T10:18:25.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.016+0000 7f70199ff700 1 --2- 172.21.15.72:0/2717443803 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7014133d70 0x7f70141303d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.016+0000 7f70199ff700 1 --2- 172.21.15.72:0/2717443803 >> v2:172.21.15.72:3300/0 conn(0x7f701406a770 0x7f7014133830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.016+0000 7f70199ff700 1 -- 172.21.15.72:0/2717443803 >> 172.21.15.72:0/2717443803 conn(0x7f70140a2cc0 msgr2=0x7f70140a30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.016+0000 7f70199ff700 1 -- 172.21.15.72:0/2717443803 shutdown_connections 2023-10-03T10:18:25.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.016+0000 7f70199ff700 1 -- 172.21.15.72:0/2717443803 wait complete. 2023-10-03T10:18:25.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.016+0000 7fed027fc700 1 -- 172.21.15.72:0/1357929987 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecfc011be0 con 0x7fed0c1378f0 2023-10-03T10:18:25.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.017+0000 7f70199ff700 1 Processor -- start 2023-10-03T10:18:25.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.017+0000 7f70199ff700 1 -- start start 2023-10-03T10:18:25.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.017+0000 7f70199ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f701406a770 0x7f70141343b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.017+0000 7f70199ff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7014133280 0x7f70141348f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.017+0000 7f70199ff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7014133d70 0x7f7014134e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.017+0000 7f70199ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7014072250 con 0x7f701406a770 2023-10-03T10:18:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.017+0000 7f70199ff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7014137800 con 0x7f7014133d70 2023-10-03T10:18:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.017+0000 7f70199ff700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7014136eb0 con 0x7f7014133280 2023-10-03T10:18:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.018+0000 7f70127fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7014133280 0x7f70141348f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.018+0000 7f70127fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7014133280 0x7f70141348f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36704/0 (socket says 172.21.15.72:36704) 2023-10-03T10:18:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.018+0000 7f70127fc700 1 -- 172.21.15.72:0/4249078951 learned_addr learned my addr 172.21.15.72:0/4249078951 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.018+0000 7f70137fe700 1 --2- 172.21.15.72:0/4249078951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7014133d70 0x7f7014134e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.018+0000 7f70127fc700 1 -- 172.21.15.72:0/4249078951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7014133d70 msgr2=0x7f7014134e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.018+0000 7f70127fc700 1 --2- 172.21.15.72:0/4249078951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7014133d70 0x7f7014134e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.018+0000 7f70127fc700 1 -- 172.21.15.72:0/4249078951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f701406a770 msgr2=0x7f70141343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.018+0000 7f70127fc700 1 --2- 172.21.15.72:0/4249078951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f701406a770 0x7f70141343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.018+0000 7f70127fc700 1 -- 172.21.15.72:0/4249078951 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c009b30 con 0x7f7014133280 2023-10-03T10:18:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.018+0000 7f70127fc700 1 --2- 172.21.15.72:0/4249078951 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7014133280 0x7f70141348f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f700800c4a0 tx=0x7f700800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.018+0000 7f6ffbfff700 1 -- 172.21.15.72:0/4249078951 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080054e0 con 0x7f7014133280 2023-10-03T10:18:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.018+0000 7f6ffbfff700 1 -- 172.21.15.72:0/4249078951 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7008003680 con 0x7f7014133280 2023-10-03T10:18:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.018+0000 7f70199ff700 1 -- 172.21.15.72:0/4249078951 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7014136590 con 0x7f7014133280 2023-10-03T10:18:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.019+0000 7f6ffbfff700 1 -- 172.21.15.72:0/4249078951 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008003a30 con 0x7f7014133280 2023-10-03T10:18:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.019+0000 7f70199ff700 1 -- 172.21.15.72:0/4249078951 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701412d900 con 0x7f7014133280 2023-10-03T10:18:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.020+0000 7f70199ff700 1 -- 172.21.15.72:0/4249078951 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701404f2a0 con 0x7f7014133280 2023-10-03T10:18:25.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.020+0000 7f6ffbfff700 1 -- 172.21.15.72:0/4249078951 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7008003b90 con 0x7f7014133280 2023-10-03T10:18:25.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.020+0000 7f6ffbfff700 1 -- 172.21.15.72:0/4249078951 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f700803e6f0 con 0x7f7014133280 2023-10-03T10:18:25.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.025+0000 7f6ffbfff700 1 -- 172.21.15.72:0/4249078951 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7008003e40 con 0x7f7014133280 2023-10-03T10:18:25.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.068+0000 7f8896591700 1 Processor -- start 2023-10-03T10:18:25.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.068+0000 7f8896591700 1 -- start start 2023-10-03T10:18:25.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f8896591700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f889009f410 0x7f8890136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f8896591700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8890136fe0 0x7f88901393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f8896591700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8890070940 con 0x7f889009e930 2023-10-03T10:18:25.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f8896591700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889006fd60 con 0x7f8890136fe0 2023-10-03T10:18:25.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f8896591700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f889006fa80 con 0x7f889009f410 2023-10-03T10:18:25.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f888ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f889009e930 0x7f889009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55370/0 (socket says 172.21.15.72:55370) 2023-10-03T10:18:25.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f888ffff700 1 -- 172.21.15.72:0/338129178 learned_addr learned my addr 172.21.15.72:0/338129178 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:25.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f888f7fe700 1 --2- 172.21.15.72:0/338129178 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f889009f410 0x7f8890136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f8894b2e700 1 --2- 172.21.15.72:0/338129178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8890136fe0 0x7f88901393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f888effd700 1 -- 172.21.15.72:0/338129178 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914732410 0 0) 0x7f8890070940 con 0x7f889009e930 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f888effd700 1 -- 172.21.15.72:0/338129178 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88780035b0 con 0x7f889009e930 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f888f7fe700 1 -- 172.21.15.72:0/338129178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8890136fe0 msgr2=0x7f88901393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f888f7fe700 1 --2- 172.21.15.72:0/338129178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8890136fe0 0x7f88901393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f888f7fe700 1 -- 172.21.15.72:0/338129178 >> v1:172.21.15.72:6789/0 conn(0x7f889009e930 legacy=0x7f889009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f888f7fe700 1 -- 172.21.15.72:0/338129178 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889009fb60 con 0x7f889009f410 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.069+0000 7f888f7fe700 1 --2- 172.21.15.72:0/338129178 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f889009f410 0x7f8890136aa0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8884009870 tx=0x7f8884009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea3c6f04224ae58f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.070+0000 7f888effd700 1 -- 172.21.15.72:0/338129178 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8884011830 con 0x7f889009f410 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.070+0000 7f888effd700 1 -- 172.21.15.72:0/338129178 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8884011990 con 0x7f889009f410 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.070+0000 7f888effd700 1 -- 172.21.15.72:0/338129178 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8884011d00 con 0x7f889009f410 2023-10-03T10:18:25.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.070+0000 7f8896591700 1 -- 172.21.15.72:0/338129178 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f889009f410 msgr2=0x7f8890136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.070+0000 7f8896591700 1 --2- 172.21.15.72:0/338129178 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f889009f410 0x7f8890136aa0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8884009870 tx=0x7f8884009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:25.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.071+0000 7f8896591700 1 -- 172.21.15.72:0/338129178 shutdown_connections 2023-10-03T10:18:25.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.071+0000 7f8896591700 1 --2- 172.21.15.72:0/338129178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8890136fe0 0x7f88901393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.071+0000 7f8896591700 1 --2- 172.21.15.72:0/338129178 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f889009f410 0x7f8890136aa0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.071+0000 7f8896591700 1 -- 172.21.15.72:0/338129178 >> 172.21.15.72:0/338129178 conn(0x7f88900a4210 msgr2=0x7f88900a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.071+0000 7f8896591700 1 -- 172.21.15.72:0/338129178 shutdown_connections 2023-10-03T10:18:25.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.071+0000 7f8896591700 1 -- 172.21.15.72:0/338129178 wait complete. 2023-10-03T10:18:25.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.071+0000 7f8896591700 1 Processor -- start 2023-10-03T10:18:25.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.072+0000 7f8896591700 1 -- start start 2023-10-03T10:18:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.072+0000 7f8896591700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889009e930 0x7f889011b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.072+0000 7f8896591700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f889009f410 0x7f889011b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.072+0000 7f8896591700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8890136fe0 0x7f889011bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.072+0000 7f8896591700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88900a3310 con 0x7f889009e930 2023-10-03T10:18:25.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.072+0000 7f8896591700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8890071d20 con 0x7f8890136fe0 2023-10-03T10:18:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.072+0000 7f8896591700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f889011e5f0 con 0x7f889009f410 2023-10-03T10:18:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.072+0000 7f888ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889009e930 0x7f889011b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.072+0000 7f888ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889009e930 0x7f889011b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47748/0 (socket says 172.21.15.72:47748) 2023-10-03T10:18:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.072+0000 7f888ffff700 1 -- 172.21.15.72:0/1520858950 learned_addr learned my addr 172.21.15.72:0/1520858950 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.072+0000 7f8894b2e700 1 --2- 172.21.15.72:0/1520858950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8890136fe0 0x7f889011bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.072+0000 7f888f7fe700 1 --2- 172.21.15.72:0/1520858950 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f889009f410 0x7f889011b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.072+0000 7f888ffff700 1 -- 172.21.15.72:0/1520858950 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f889009f410 msgr2=0x7f889011b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.073+0000 7f888ffff700 1 --2- 172.21.15.72:0/1520858950 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f889009f410 0x7f889011b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.073+0000 7f888ffff700 1 -- 172.21.15.72:0/1520858950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8890136fe0 msgr2=0x7f889011bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.073+0000 7f888ffff700 1 --2- 172.21.15.72:0/1520858950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8890136fe0 0x7f889011bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.073+0000 7f888ffff700 1 -- 172.21.15.72:0/1520858950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88840094a0 con 0x7f889009e930 2023-10-03T10:18:25.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.073+0000 7f8894b2e700 1 --2- 172.21.15.72:0/1520858950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8890136fe0 0x7f889011bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:25.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.073+0000 7f888ffff700 1 --2- 172.21.15.72:0/1520858950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889009e930 0x7f889011b340 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f8880001eb0 tx=0x7f888000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.073+0000 7f888cff9700 1 -- 172.21.15.72:0/1520858950 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8880005d70 con 0x7f889009e930 2023-10-03T10:18:25.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.073+0000 7f888cff9700 1 -- 172.21.15.72:0/1520858950 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88800070d0 con 0x7f889009e930 2023-10-03T10:18:25.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.073+0000 7f888cff9700 1 -- 172.21.15.72:0/1520858950 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8880007460 con 0x7f889009e930 2023-10-03T10:18:25.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.073+0000 7f8896591700 1 -- 172.21.15.72:0/1520858950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889011eb80 con 0x7f889009e930 2023-10-03T10:18:25.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.073+0000 7f8896591700 1 -- 172.21.15.72:0/1520858950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889011f5f0 con 0x7f889009e930 2023-10-03T10:18:25.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.074+0000 7f888cff9700 1 -- 172.21.15.72:0/1520858950 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88800075c0 con 0x7f889009e930 2023-10-03T10:18:25.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.074+0000 7f8896591700 1 -- 172.21.15.72:0/1520858950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889011e7c0 con 0x7f889009e930 2023-10-03T10:18:25.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.074+0000 7f888cff9700 1 -- 172.21.15.72:0/1520858950 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f888003ec00 con 0x7f889009e930 2023-10-03T10:18:25.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.079+0000 7f888cff9700 1 -- 172.21.15.72:0/1520858950 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f888000e280 con 0x7f889009e930 2023-10-03T10:18:25.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.233+0000 7f70199ff700 1 -- 172.21.15.72:0/4249078951 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f701413b280 con 0x7f7014133280 2023-10-03T10:18:25.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.233+0000 7f6ffbfff700 1 -- 172.21.15.72:0/4249078951 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7008017070 con 0x7f7014133280 2023-10-03T10:18:25.233 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:25.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.236+0000 7f70199ff700 1 -- 172.21.15.72:0/4249078951 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7014133280 msgr2=0x7f70141348f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.236+0000 7f70199ff700 1 --2- 172.21.15.72:0/4249078951 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7014133280 0x7f70141348f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f700800c4a0 tx=0x7f700800c7b0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.237+0000 7f70199ff700 1 -- 172.21.15.72:0/4249078951 shutdown_connections 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.237+0000 7f70199ff700 1 --2- 172.21.15.72:0/4249078951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f701406a770 0x7f70141343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.237+0000 7f70199ff700 1 --2- 172.21.15.72:0/4249078951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7014133d70 0x7f7014134e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.237+0000 7f70199ff700 1 --2- 172.21.15.72:0/4249078951 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7014133280 0x7f70141348f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.237+0000 7f70199ff700 1 -- 172.21.15.72:0/4249078951 >> 172.21.15.72:0/4249078951 conn(0x7f70140a2cc0 msgr2=0x7f701409d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.237+0000 7f70199ff700 1 -- 172.21.15.72:0/4249078951 shutdown_connections 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.237+0000 7f70199ff700 1 -- 172.21.15.72:0/4249078951 wait complete. 2023-10-03T10:18:25.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.238+0000 7f647270a700 1 -- 172.21.15.72:0/4162036912 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f646c099f20 con 0x7f646c06e9d0 2023-10-03T10:18:25.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.239+0000 7f6468ff9700 1 -- 172.21.15.72:0/4162036912 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f645c013720 con 0x7f646c06e9d0 2023-10-03T10:18:25.238 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:25.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.242+0000 7f647270a700 1 -- 172.21.15.72:0/4162036912 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f646c06e9d0 msgr2=0x7f646c11b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.242+0000 7f647270a700 1 --2- 172.21.15.72:0/4162036912 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f646c06e9d0 0x7f646c11b960 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f645c00ec10 tx=0x7f645c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:25.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.243+0000 7f647270a700 1 -- 172.21.15.72:0/4162036912 shutdown_connections 2023-10-03T10:18:25.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.243+0000 7f647270a700 1 --2- 172.21.15.72:0/4162036912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f646c131f40 0x7f646c11c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.243+0000 7f647270a700 1 --2- 172.21.15.72:0/4162036912 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f646c06e9d0 0x7f646c11b960 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.243+0000 7f647270a700 1 --2- 172.21.15.72:0/4162036912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f646c131630 0x7f646c11bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.243+0000 7f647270a700 1 -- 172.21.15.72:0/4162036912 >> 172.21.15.72:0/4162036912 conn(0x7f646c0a2aa0 msgr2=0x7f646c1b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.243+0000 7f647270a700 1 -- 172.21.15.72:0/4162036912 shutdown_connections 2023-10-03T10:18:25.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.243+0000 7f647270a700 1 -- 172.21.15.72:0/4162036912 wait complete. 2023-10-03T10:18:25.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:25.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:25.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.264+0000 7fed13c55700 1 -- 172.21.15.72:0/1357929987 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fed0c095e70 con 0x7fed0c1378f0 2023-10-03T10:18:25.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.264+0000 7fed027fc700 1 -- 172.21.15.72:0/1357929987 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fecfc010e00 con 0x7fed0c1378f0 2023-10-03T10:18:25.264 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.266+0000 7fed13c55700 1 -- 172.21.15.72:0/1357929987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c1378f0 msgr2=0x7fed0c133c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.266+0000 7fed13c55700 1 --2- 172.21.15.72:0/1357929987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c1378f0 0x7fed0c133c80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fecfc00c460 tx=0x7fecfc00c770 comp rx=0 tx=0).stop 2023-10-03T10:18:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.266+0000 7fed13c55700 1 -- 172.21.15.72:0/1357929987 shutdown_connections 2023-10-03T10:18:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.266+0000 7fed13c55700 1 --2- 172.21.15.72:0/1357929987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed0c138430 0x7fed0c1322f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.266+0000 7fed13c55700 1 --2- 172.21.15.72:0/1357929987 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fed0c095690 0x7fed0c133740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.266+0000 7fed13c55700 1 --2- 172.21.15.72:0/1357929987 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed0c1378f0 0x7fed0c133c80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.266+0000 7fed13c55700 1 -- 172.21.15.72:0/1357929987 >> 172.21.15.72:0/1357929987 conn(0x7fed0c0a2360 msgr2=0x7fed0c136c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.266+0000 7fed13c55700 1 -- 172.21.15.72:0/1357929987 shutdown_connections 2023-10-03T10:18:25.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.266+0000 7fed13c55700 1 -- 172.21.15.72:0/1357929987 wait complete. 2023-10-03T10:18:25.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.276+0000 7f8896591700 1 -- 172.21.15.72:0/1520858950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f889011e1a0 con 0x7f889009e930 2023-10-03T10:18:25.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.276+0000 7f888cff9700 1 -- 172.21.15.72:0/1520858950 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8880011360 con 0x7f889009e930 2023-10-03T10:18:25.276 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:25.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:25.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.279+0000 7f8896591700 1 -- 172.21.15.72:0/1520858950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889009e930 msgr2=0x7f889011b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.279+0000 7f8896591700 1 --2- 172.21.15.72:0/1520858950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889009e930 0x7f889011b340 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f8880001eb0 tx=0x7f888000c860 comp rx=0 tx=0).stop 2023-10-03T10:18:25.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.279+0000 7f8896591700 1 -- 172.21.15.72:0/1520858950 shutdown_connections 2023-10-03T10:18:25.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.279+0000 7f8896591700 1 --2- 172.21.15.72:0/1520858950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f889009e930 0x7f889011b340 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.279+0000 7f8896591700 1 --2- 172.21.15.72:0/1520858950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8890136fe0 0x7f889011bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.279+0000 7f8896591700 1 --2- 172.21.15.72:0/1520858950 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f889009f410 0x7f889011b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.279+0000 7f8896591700 1 -- 172.21.15.72:0/1520858950 >> 172.21.15.72:0/1520858950 conn(0x7f88900a4210 msgr2=0x7f889006c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.279+0000 7f8896591700 1 -- 172.21.15.72:0/1520858950 shutdown_connections 2023-10-03T10:18:25.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:25.279+0000 7f8896591700 1 -- 172.21.15.72:0/1520858950 wait complete. 2023-10-03T10:18:25.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:26.255 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:26.258 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:26.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:26.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:26.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.409+0000 7f7ff4f4d700 1 Processor -- start 2023-10-03T10:18:26.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.409+0000 7f7ff4f4d700 1 -- start start 2023-10-03T10:18:26.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.410+0000 7f7ff4f4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff009e930 0x7f7ff009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.410+0000 7f7ff4f4d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff009f240 0x7f7ff01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.410+0000 7f7ff4f4d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff0070940 con 0x7f7ff009f650 2023-10-03T10:18:26.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.410+0000 7f7ff4f4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff006fd60 con 0x7f7ff009e930 2023-10-03T10:18:26.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.410+0000 7f7ff4f4d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff006fa80 con 0x7f7ff009f240 2023-10-03T10:18:26.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.411+0000 7f7fedd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff009f240 0x7f7ff01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.411+0000 7f7fee59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff009e930 0x7f7ff009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.411+0000 7f7fedd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff009f240 0x7f7ff01317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36724/0 (socket says 172.21.15.72:36724) 2023-10-03T10:18:26.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.411+0000 7f7fee59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff009e930 0x7f7ff009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56086/0 (socket says 172.21.15.72:56086) 2023-10-03T10:18:26.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.411+0000 7f7fedd9b700 1 -- 172.21.15.72:0/1270680174 learned_addr learned my addr 172.21.15.72:0/1270680174 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:26.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.411+0000 7f7fedd9b700 1 -- 172.21.15.72:0/1270680174 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff009e930 msgr2=0x7f7ff009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.411+0000 7f7fedd9b700 1 --2- 172.21.15.72:0/1270680174 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff009e930 0x7f7ff009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.411+0000 7f7fedd9b700 1 -- 172.21.15.72:0/1270680174 >> v1:172.21.15.72:6789/0 conn(0x7f7ff009f650 legacy=0x7f7ff0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.411+0000 7f7fedd9b700 1 -- 172.21.15.72:0/1270680174 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff009fb60 con 0x7f7ff009f240 2023-10-03T10:18:26.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.411+0000 7f7fedd9b700 1 --2- 172.21.15.72:0/1270680174 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff009f240 0x7f7ff01317f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400dd40 tx=0x7f7fe400f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7843e60f8291898 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.411+0000 7f7fed59a700 1 -- 172.21.15.72:0/1270680174 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4012070 con 0x7f7ff009f240 2023-10-03T10:18:26.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.411+0000 7f7fed59a700 1 -- 172.21.15.72:0/1270680174 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe400de90 con 0x7f7ff009f240 2023-10-03T10:18:26.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.411+0000 7f7fed59a700 1 -- 172.21.15.72:0/1270680174 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400fb30 con 0x7f7ff009f240 2023-10-03T10:18:26.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.412+0000 7f7ff4f4d700 1 -- 172.21.15.72:0/1270680174 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff009f240 msgr2=0x7f7ff01317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.412+0000 7f7ff4f4d700 1 --2- 172.21.15.72:0/1270680174 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff009f240 0x7f7ff01317f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400dd40 tx=0x7f7fe400f330 comp rx=0 tx=0).stop 2023-10-03T10:18:26.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.413+0000 7f7ff4f4d700 1 -- 172.21.15.72:0/1270680174 shutdown_connections 2023-10-03T10:18:26.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.413+0000 7f7ff4f4d700 1 --2- 172.21.15.72:0/1270680174 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff009e930 0x7f7ff009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.413+0000 7f7ff4f4d700 1 --2- 172.21.15.72:0/1270680174 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff009f240 0x7f7ff01317f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.413+0000 7f7ff4f4d700 1 -- 172.21.15.72:0/1270680174 >> 172.21.15.72:0/1270680174 conn(0x7f7ff00a4210 msgr2=0x7f7ff00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.413+0000 7f7ff4f4d700 1 -- 172.21.15.72:0/1270680174 shutdown_connections 2023-10-03T10:18:26.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.413+0000 7f7ff4f4d700 1 -- 172.21.15.72:0/1270680174 wait complete. 2023-10-03T10:18:26.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.414+0000 7f7ff4f4d700 1 Processor -- start 2023-10-03T10:18:26.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.414+0000 7f7ff4f4d700 1 -- start start 2023-10-03T10:18:26.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.415+0000 7f7ff4f4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff009e930 0x7f7ff01a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.415+0000 7f7ff4f4d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff009f240 0x7f7ff01a2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.415+0000 7f7ff4f4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff009f650 0x7f7ff01a2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.415+0000 7f7ff4f4d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff01a2fc0 con 0x7f7ff009e930 2023-10-03T10:18:26.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.415+0000 7f7ff4f4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff01a5fd0 con 0x7f7ff009f650 2023-10-03T10:18:26.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.415+0000 7f7ff4f4d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff01a3700 con 0x7f7ff009f240 2023-10-03T10:18:26.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.415+0000 7f7fee59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff009e930 0x7f7ff01a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.415+0000 7f7fee59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff009e930 0x7f7ff01a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47762/0 (socket says 172.21.15.72:47762) 2023-10-03T10:18:26.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.415+0000 7f7fee59c700 1 -- 172.21.15.72:0/2180329245 learned_addr learned my addr 172.21.15.72:0/2180329245 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:26.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.415+0000 7f7fedd9b700 1 --2- 172.21.15.72:0/2180329245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff009f240 0x7f7ff01a2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.415+0000 7f7fee59c700 1 -- 172.21.15.72:0/2180329245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff009f240 msgr2=0x7f7ff01a2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.415+0000 7f7fee59c700 1 --2- 172.21.15.72:0/2180329245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff009f240 0x7f7ff01a2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.415+0000 7f7fee59c700 1 -- 172.21.15.72:0/2180329245 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff009f650 msgr2=0x7f7ff01a2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.415+0000 7f7fee59c700 1 --2- 172.21.15.72:0/2180329245 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff009f650 0x7f7ff01a2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.415+0000 7f7fee59c700 1 -- 172.21.15.72:0/2180329245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe400d9f0 con 0x7f7ff009e930 2023-10-03T10:18:26.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.416+0000 7f7fee59c700 1 --2- 172.21.15.72:0/2180329245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff009e930 0x7f7ff01a1af0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000ea10 tx=0x7f7fe000ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.416+0000 7f7fdeffd700 1 -- 172.21.15.72:0/2180329245 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0009710 con 0x7f7ff009e930 2023-10-03T10:18:26.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.416+0000 7f7fdeffd700 1 -- 172.21.15.72:0/2180329245 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe000c850 con 0x7f7ff009e930 2023-10-03T10:18:26.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.416+0000 7f7fdeffd700 1 -- 172.21.15.72:0/2180329245 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe000cbc0 con 0x7f7ff009e930 2023-10-03T10:18:26.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.416+0000 7f7ff4f4d700 1 -- 172.21.15.72:0/2180329245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff00a0190 con 0x7f7ff009e930 2023-10-03T10:18:26.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.416+0000 7f7ff4f4d700 1 -- 172.21.15.72:0/2180329245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff00a3630 con 0x7f7ff009e930 2023-10-03T10:18:26.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.417+0000 7f7ff4f4d700 1 -- 172.21.15.72:0/2180329245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff0074ea0 con 0x7f7ff009e930 2023-10-03T10:18:26.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.417+0000 7f7fdeffd700 1 -- 172.21.15.72:0/2180329245 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7fe000cd20 con 0x7f7ff009e930 2023-10-03T10:18:26.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.418+0000 7f7fdeffd700 1 -- 172.21.15.72:0/2180329245 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7fe003f760 con 0x7f7ff009e930 2023-10-03T10:18:26.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.422+0000 7f7fdeffd700 1 -- 172.21.15.72:0/2180329245 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7fe00232f0 con 0x7f7ff009e930 2023-10-03T10:18:26.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.437+0000 7fc1f5224700 1 Processor -- start 2023-10-03T10:18:26.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.437+0000 7fc1f5224700 1 -- start start 2023-10-03T10:18:26.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.437+0000 7f93ded83700 1 Processor -- start 2023-10-03T10:18:26.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7fc1f5224700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc1f01338a0 0x7fc1f0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7fc1f5224700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1f009e930 0x7fc1f013b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7fc1f5224700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f006ef30 con 0x7fc1f009de50 2023-10-03T10:18:26.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7fc1f5224700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f006fef0 con 0x7fc1f01338a0 2023-10-03T10:18:26.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7fc1f5224700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f01334b0 con 0x7fc1f009e930 2023-10-03T10:18:26.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7fc1ef59e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1f009e930 0x7fc1f013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7fc1ef59e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1f009e930 0x7fc1f013b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36750/0 (socket says 172.21.15.72:36750) 2023-10-03T10:18:26.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7fc1ef59e700 1 -- 172.21.15.72:0/2543437979 learned_addr learned my addr 172.21.15.72:0/2543437979 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:26.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.437+0000 7f93ded83700 1 -- start start 2023-10-03T10:18:26.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7f93ded83700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93d809d6f0 0x7f93d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7f93ded83700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f93d809e000 0x7f93d8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7f93ded83700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d809f130 con 0x7f93d809e410 2023-10-03T10:18:26.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7f93ded83700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d809f520 con 0x7f93d809d6f0 2023-10-03T10:18:26.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7f93ded83700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93d809e930 con 0x7f93d809e000 2023-10-03T10:18:26.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7f93d7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f93d809e000 0x7f93d8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7f93d7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f93d809e000 0x7f93d8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36760/0 (socket says 172.21.15.72:36760) 2023-10-03T10:18:26.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7f93d7fff700 1 -- 172.21.15.72:0/984636934 learned_addr learned my addr 172.21.15.72:0/984636934 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:26.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7fc1ef59e700 1 -- 172.21.15.72:0/2543437979 >> v2:172.21.15.72:3300/0 conn(0x7fc1f01338a0 msgr2=0x7fc1f0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7fc1ef59e700 1 --2- 172.21.15.72:0/2543437979 >> v2:172.21.15.72:3300/0 conn(0x7fc1f01338a0 0x7fc1f0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7fc1ef59e700 1 -- 172.21.15.72:0/2543437979 >> v1:172.21.15.72:6789/0 conn(0x7fc1f009de50 legacy=0x7fc1f009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7fc1ef59e700 1 -- 172.21.15.72:0/2543437979 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f006fc30 con 0x7fc1f009e930 2023-10-03T10:18:26.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7fc1ef59e700 1 --2- 172.21.15.72:0/2543437979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1f009e930 0x7fc1f013b740 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009e50 tx=0x7fc1e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3488988f15ca849 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7f93d7fff700 1 -- 172.21.15.72:0/984636934 >> v2:172.21.15.72:3300/0 conn(0x7f93d809d6f0 msgr2=0x7f93d809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7f93d7fff700 1 --2- 172.21.15.72:0/984636934 >> v2:172.21.15.72:3300/0 conn(0x7f93d809d6f0 0x7f93d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7f93d7fff700 1 -- 172.21.15.72:0/984636934 >> v1:172.21.15.72:6789/0 conn(0x7f93d809e410 legacy=0x7f93d8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.438+0000 7f93d7fff700 1 -- 172.21.15.72:0/984636934 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d809b2d0 con 0x7f93d809e000 2023-10-03T10:18:26.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.439+0000 7f93d7fff700 1 --2- 172.21.15.72:0/984636934 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f93d809e000 0x7f93d8130660 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f93c400bb90 tx=0x7f93c400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ee78ac9aaf44037 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.439+0000 7fc1edd9b700 1 -- 172.21.15.72:0/2543437979 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e800e070 con 0x7fc1f009e930 2023-10-03T10:18:26.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.439+0000 7f93d77fe700 1 -- 172.21.15.72:0/984636934 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c400dd10 con 0x7f93d809e000 2023-10-03T10:18:26.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.440+0000 7fc1edd9b700 1 -- 172.21.15.72:0/2543437979 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e8003a20 con 0x7fc1f009e930 2023-10-03T10:18:26.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.440+0000 7fc1edd9b700 1 -- 172.21.15.72:0/2543437979 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8003dd0 con 0x7fc1f009e930 2023-10-03T10:18:26.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.440+0000 7f93d77fe700 1 -- 172.21.15.72:0/984636934 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c400de70 con 0x7f93d809e000 2023-10-03T10:18:26.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.440+0000 7f93d77fe700 1 -- 172.21.15.72:0/984636934 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c4004230 con 0x7f93d809e000 2023-10-03T10:18:26.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.440+0000 7f93ded83700 1 -- 172.21.15.72:0/984636934 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f93d809e000 msgr2=0x7f93d8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.440+0000 7f93ded83700 1 --2- 172.21.15.72:0/984636934 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f93d809e000 0x7f93d8130660 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f93c400bb90 tx=0x7f93c400bea0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.440+0000 7f93ded83700 1 -- 172.21.15.72:0/984636934 shutdown_connections 2023-10-03T10:18:26.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.440+0000 7f93ded83700 1 --2- 172.21.15.72:0/984636934 >> v2:172.21.15.72:3300/0 conn(0x7f93d809d6f0 0x7f93d809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.440+0000 7f93ded83700 1 --2- 172.21.15.72:0/984636934 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f93d809e000 0x7f93d8130660 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.440+0000 7f93ded83700 1 -- 172.21.15.72:0/984636934 >> 172.21.15.72:0/984636934 conn(0x7f93d8066f50 msgr2=0x7f93d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.440+0000 7fc1f5224700 1 -- 172.21.15.72:0/2543437979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1f009e930 msgr2=0x7fc1f013b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.440+0000 7fc1f5224700 1 --2- 172.21.15.72:0/2543437979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1f009e930 0x7fc1f013b740 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009e50 tx=0x7fc1e800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.440+0000 7f93ded83700 1 -- 172.21.15.72:0/984636934 shutdown_connections 2023-10-03T10:18:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.440+0000 7f93ded83700 1 -- 172.21.15.72:0/984636934 wait complete. 2023-10-03T10:18:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.441+0000 7fc1f5224700 1 -- 172.21.15.72:0/2543437979 shutdown_connections 2023-10-03T10:18:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.441+0000 7fc1f5224700 1 --2- 172.21.15.72:0/2543437979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1f009e930 0x7fc1f013b740 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.441+0000 7fc1f5224700 1 --2- 172.21.15.72:0/2543437979 >> v2:172.21.15.72:3300/0 conn(0x7fc1f01338a0 0x7fc1f0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.441+0000 7fc1f5224700 1 -- 172.21.15.72:0/2543437979 >> 172.21.15.72:0/2543437979 conn(0x7fc1f00a2aa0 msgr2=0x7fc1f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.441+0000 7fc1f5224700 1 -- 172.21.15.72:0/2543437979 shutdown_connections 2023-10-03T10:18:26.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.441+0000 7fc1f5224700 1 -- 172.21.15.72:0/2543437979 wait complete. 2023-10-03T10:18:26.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.441+0000 7f93ded83700 1 Processor -- start 2023-10-03T10:18:26.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.441+0000 7f93ded83700 1 -- start start 2023-10-03T10:18:26.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.442+0000 7f93ded83700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93d809d6f0 0x7f93d811dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.442+0000 7f93ded83700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93d809e000 0x7f93d811e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.442+0000 7f93ded83700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f93d809e410 0x7f93d811ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.442+0000 7f93ded83700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8120210 con 0x7f93d809e000 2023-10-03T10:18:26.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.442+0000 7f93ded83700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d81303c0 con 0x7f93d809d6f0 2023-10-03T10:18:26.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.442+0000 7f93ded83700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93d809c700 con 0x7f93d809e410 2023-10-03T10:18:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.442+0000 7f93dd320700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f93d809e410 0x7f93d811ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.442+0000 7f93dd320700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f93d809e410 0x7f93d811ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36772/0 (socket says 172.21.15.72:36772) 2023-10-03T10:18:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.442+0000 7f93dd320700 1 -- 172.21.15.72:0/2880475644 learned_addr learned my addr 172.21.15.72:0/2880475644 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.442+0000 7fc1f5224700 1 Processor -- start 2023-10-03T10:18:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.442+0000 7fc1f5224700 1 -- start start 2023-10-03T10:18:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.442+0000 7f93d7fff700 1 --2- 172.21.15.72:0/2880475644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93d809e000 0x7f93d811e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.442+0000 7f93dd320700 1 -- 172.21.15.72:0/2880475644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93d809d6f0 msgr2=0x7f93d811dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7f93dd320700 1 --2- 172.21.15.72:0/2880475644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93d809d6f0 0x7f93d811dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7f93dd320700 1 -- 172.21.15.72:0/2880475644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93d809e000 msgr2=0x7f93d811e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7f93dd320700 1 --2- 172.21.15.72:0/2880475644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93d809e000 0x7f93d811e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7f93dd320700 1 -- 172.21.15.72:0/2880475644 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c400b7f0 con 0x7f93d809e410 2023-10-03T10:18:26.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7f93d7fff700 1 --2- 172.21.15.72:0/2880475644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93d809e000 0x7f93d811e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7f93dd320700 1 --2- 172.21.15.72:0/2880475644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f93d809e410 0x7f93d811ea60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f93d000c7a0 tx=0x7f93d000cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7fc1f5224700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1f009de50 0x7fc1f0099ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7fc1f5224700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1f009e930 0x7fc1f009a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7fc1f5224700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1f01338a0 0x7fc1f01cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7fc1f5224700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f006f640 con 0x7fc1f01338a0 2023-10-03T10:18:26.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7fc1f5224700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f009cf60 con 0x7fc1f009e930 2023-10-03T10:18:26.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7fc1f5224700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f009b690 con 0x7fc1f009de50 2023-10-03T10:18:26.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7fc1eed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1f009de50 0x7fc1f0099ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7fc1eed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1f009de50 0x7fc1f0099ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36780/0 (socket says 172.21.15.72:36780) 2023-10-03T10:18:26.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7fc1eed9d700 1 -- 172.21.15.72:0/1203743137 learned_addr learned my addr 172.21.15.72:0/1203743137 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:26.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7fc1ee59c700 1 --2- 172.21.15.72:0/1203743137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1f009e930 0x7fc1f009a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7fc1ef59e700 1 --2- 172.21.15.72:0/1203743137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1f01338a0 0x7fc1f01cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.444+0000 7fc1ef59e700 1 -- 172.21.15.72:0/1203743137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1f009de50 msgr2=0x7fc1f0099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.444+0000 7fc1ef59e700 1 --2- 172.21.15.72:0/1203743137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1f009de50 0x7fc1f0099ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.444+0000 7fc1ef59e700 1 -- 172.21.15.72:0/1203743137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1f009e930 msgr2=0x7fc1f009a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.444+0000 7fc1ef59e700 1 --2- 172.21.15.72:0/1203743137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1f009e930 0x7fc1f009a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.444+0000 7fc1ef59e700 1 -- 172.21.15.72:0/1203743137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e8009b30 con 0x7fc1f01338a0 2023-10-03T10:18:26.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.444+0000 7fc1ef59e700 1 --2- 172.21.15.72:0/1203743137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1f01338a0 0x7fc1f01cc620 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8014000 tx=0x7fc1e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.444+0000 7fc1d77fe700 1 -- 172.21.15.72:0/1203743137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8004440 con 0x7fc1f01338a0 2023-10-03T10:18:26.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7f93d57fa700 1 -- 172.21.15.72:0/2880475644 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0003e10 con 0x7f93d809e410 2023-10-03T10:18:26.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7f93ded83700 1 -- 172.21.15.72:0/2880475644 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d80a1df0 con 0x7f93d809e410 2023-10-03T10:18:26.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7f93ded83700 1 -- 172.21.15.72:0/2880475644 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d8121b60 con 0x7f93d809e410 2023-10-03T10:18:26.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7f93d57fa700 1 -- 172.21.15.72:0/2880475644 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d0005070 con 0x7f93d809e410 2023-10-03T10:18:26.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.443+0000 7f93d57fa700 1 -- 172.21.15.72:0/2880475644 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0005420 con 0x7f93d809e410 2023-10-03T10:18:26.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.444+0000 7fc1d77fe700 1 -- 172.21.15.72:0/1203743137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e80045a0 con 0x7fc1f01338a0 2023-10-03T10:18:26.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.444+0000 7f93d57fa700 1 -- 172.21.15.72:0/2880475644 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93d0005580 con 0x7f93d809e410 2023-10-03T10:18:26.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.444+0000 7fc1d77fe700 1 -- 172.21.15.72:0/1203743137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8004950 con 0x7fc1f01338a0 2023-10-03T10:18:26.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.444+0000 7fc1f5224700 1 -- 172.21.15.72:0/1203743137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f009da00 con 0x7fc1f01338a0 2023-10-03T10:18:26.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.444+0000 7fc1f5224700 1 -- 172.21.15.72:0/1203743137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f009c260 con 0x7fc1f01338a0 2023-10-03T10:18:26.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.444+0000 7f93d57fa700 1 -- 172.21.15.72:0/2880475644 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f93d003ede0 con 0x7f93d809e410 2023-10-03T10:18:26.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.445+0000 7f93ded83700 1 -- 172.21.15.72:0/2880475644 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b80052e0 con 0x7f93d809e410 2023-10-03T10:18:26.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.445+0000 7fc1f5224700 1 -- 172.21.15.72:0/1203743137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f006ea40 con 0x7fc1f01338a0 2023-10-03T10:18:26.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.445+0000 7fc1d77fe700 1 -- 172.21.15.72:0/1203743137 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1e8019030 con 0x7fc1f01338a0 2023-10-03T10:18:26.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.446+0000 7fc1d77fe700 1 -- 172.21.15.72:0/1203743137 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc1e8040850 con 0x7fc1f01338a0 2023-10-03T10:18:26.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.449+0000 7fd15391f700 1 Processor -- start 2023-10-03T10:18:26.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.449+0000 7fd15391f700 1 -- start start 2023-10-03T10:18:26.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.450+0000 7fd15391f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd14c0a0a30 0x7fd14c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.450+0000 7fd15391f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c0a1340 0x7fd14c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.450+0000 7fd15391f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c133fa0 0x7fd14c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.450+0000 7fd15391f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14c09edd0 con 0x7fd14c0a0a30 2023-10-03T10:18:26.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.450+0000 7fd15391f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c09e1f0 con 0x7fd14c0a1340 2023-10-03T10:18:26.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.450+0000 7fd15391f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c09dc50 con 0x7fd14c133fa0 2023-10-03T10:18:26.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.450+0000 7fd150eba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c0a1340 0x7fd14c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.450+0000 7fd150eba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c0a1340 0x7fd14c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56130/0 (socket says 172.21.15.72:56130) 2023-10-03T10:18:26.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.450+0000 7fd150eba700 1 -- 172.21.15.72:0/2157375786 learned_addr learned my addr 172.21.15.72:0/2157375786 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:26.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.450+0000 7fd1516bb700 1 --2- 172.21.15.72:0/2157375786 >> v2:172.21.15.72:3300/0 conn(0x7fd14c0a0a30 0x7fd14c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.450+0000 7fd151ebc700 1 --2- 172.21.15.72:0/2157375786 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c133fa0 0x7fd14c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.451+0000 7fd1516bb700 1 -- 172.21.15.72:0/2157375786 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c133fa0 msgr2=0x7fd14c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.451+0000 7fd1516bb700 1 --2- 172.21.15.72:0/2157375786 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c133fa0 0x7fd14c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.451+0000 7fd1516bb700 1 -- 172.21.15.72:0/2157375786 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c0a1340 msgr2=0x7fd14c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.451+0000 7fd1516bb700 1 --2- 172.21.15.72:0/2157375786 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c0a1340 0x7fd14c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.451+0000 7fd1516bb700 1 -- 172.21.15.72:0/2157375786 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c0a1fe0 con 0x7fd14c0a0a30 2023-10-03T10:18:26.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.451+0000 7fd150eba700 1 --2- 172.21.15.72:0/2157375786 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c0a1340 0x7fd14c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.451+0000 7f93d57fa700 1 -- 172.21.15.72:0/2880475644 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93d000acf0 con 0x7f93d809e410 2023-10-03T10:18:26.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.451+0000 7fd1516bb700 1 --2- 172.21.15.72:0/2157375786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c0a0a30 0x7fd14c0a0e00 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fd148009840 tx=0x7fd148009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3cecb008bab5965 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.451+0000 7fd143fff700 1 -- 172.21.15.72:0/2157375786 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148011830 con 0x7fd14c0a0a30 2023-10-03T10:18:26.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.451+0000 7fc1d77fe700 1 -- 172.21.15.72:0/1203743137 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1e8024a00 con 0x7fc1f01338a0 2023-10-03T10:18:26.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.451+0000 7fd143fff700 1 -- 172.21.15.72:0/2157375786 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd148011990 con 0x7fd14c0a0a30 2023-10-03T10:18:26.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.451+0000 7fd143fff700 1 -- 172.21.15.72:0/2157375786 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148011d20 con 0x7fd14c0a0a30 2023-10-03T10:18:26.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.452+0000 7fd15391f700 1 -- 172.21.15.72:0/2157375786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c0a0a30 msgr2=0x7fd14c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.452+0000 7fd15391f700 1 --2- 172.21.15.72:0/2157375786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c0a0a30 0x7fd14c0a0e00 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fd148009840 tx=0x7fd148009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:26.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.452+0000 7fd15391f700 1 -- 172.21.15.72:0/2157375786 shutdown_connections 2023-10-03T10:18:26.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.452+0000 7fd15391f700 1 --2- 172.21.15.72:0/2157375786 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c133fa0 0x7fd14c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.452+0000 7fd15391f700 1 --2- 172.21.15.72:0/2157375786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c0a0a30 0x7fd14c0a0e00 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.452+0000 7fd15391f700 1 --2- 172.21.15.72:0/2157375786 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c0a1340 0x7fd14c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.452+0000 7fd15391f700 1 -- 172.21.15.72:0/2157375786 >> 172.21.15.72:0/2157375786 conn(0x7fd14c0a6550 msgr2=0x7fd14c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.455+0000 7fd15391f700 1 -- 172.21.15.72:0/2157375786 shutdown_connections 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.455+0000 7fd15391f700 1 -- 172.21.15.72:0/2157375786 wait complete. 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.456+0000 7fd15391f700 1 Processor -- start 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.456+0000 7fd15391f700 1 -- start start 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd15391f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c0a0a30 0x7fd14c136960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd15391f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c0a1340 0x7fd14c136ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd15391f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c133fa0 0x7fd14c1373e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd15391f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c139c10 con 0x7fd14c133fa0 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd15391f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c0a0220 con 0x7fd14c0a1340 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd15391f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c0a3310 con 0x7fd14c0a0a30 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd151ebc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c133fa0 0x7fd14c1373e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd151ebc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c133fa0 0x7fd14c1373e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47820/0 (socket says 172.21.15.72:47820) 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd151ebc700 1 -- 172.21.15.72:0/735859158 learned_addr learned my addr 172.21.15.72:0/735859158 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd1516bb700 1 --2- 172.21.15.72:0/735859158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c0a0a30 0x7fd14c136960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd150eba700 1 --2- 172.21.15.72:0/735859158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c0a1340 0x7fd14c136ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd151ebc700 1 -- 172.21.15.72:0/735859158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c0a0a30 msgr2=0x7fd14c136960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd151ebc700 1 --2- 172.21.15.72:0/735859158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c0a0a30 0x7fd14c136960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd151ebc700 1 -- 172.21.15.72:0/735859158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c0a1340 msgr2=0x7fd14c136ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd151ebc700 1 --2- 172.21.15.72:0/735859158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c0a1340 0x7fd14c136ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd151ebc700 1 -- 172.21.15.72:0/735859158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c009550 con 0x7fd14c133fa0 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd150eba700 1 --2- 172.21.15.72:0/735859158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c0a1340 0x7fd14c136ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.457+0000 7fd151ebc700 1 --2- 172.21.15.72:0/735859158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c133fa0 0x7fd14c1373e0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fd14400efc0 tx=0x7fd14400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.458+0000 7fd141ffb700 1 -- 172.21.15.72:0/735859158 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14400cb80 con 0x7fd14c133fa0 2023-10-03T10:18:26.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.458+0000 7fd141ffb700 1 -- 172.21.15.72:0/735859158 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14400f040 con 0x7fd14c133fa0 2023-10-03T10:18:26.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.458+0000 7fd141ffb700 1 -- 172.21.15.72:0/735859158 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144014480 con 0x7fd14c133fa0 2023-10-03T10:18:26.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.458+0000 7fd15391f700 1 -- 172.21.15.72:0/735859158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1480094a0 con 0x7fd14c133fa0 2023-10-03T10:18:26.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.458+0000 7fd15391f700 1 -- 172.21.15.72:0/735859158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14c138d20 con 0x7fd14c133fa0 2023-10-03T10:18:26.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.459+0000 7fd141ffb700 1 -- 172.21.15.72:0/735859158 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1440145e0 con 0x7fd14c133fa0 2023-10-03T10:18:26.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.459+0000 7fd141ffb700 1 -- 172.21.15.72:0/735859158 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd14403ff20 con 0x7fd14c133fa0 2023-10-03T10:18:26.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.459+0000 7fd15391f700 1 -- 172.21.15.72:0/735859158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14c074ea0 con 0x7fd14c133fa0 2023-10-03T10:18:26.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.464+0000 7fd141ffb700 1 -- 172.21.15.72:0/735859158 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1440248f0 con 0x7fd14c133fa0 2023-10-03T10:18:26.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.627+0000 7f7ff4f4d700 1 -- 172.21.15.72:0/2180329245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7ff0071ce0 con 0x7f7ff009e930 2023-10-03T10:18:26.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.628+0000 7f7fdeffd700 1 -- 172.21.15.72:0/2180329245 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7fe0021070 con 0x7f7ff009e930 2023-10-03T10:18:26.627 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:26.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.629+0000 7f7ff4f4d700 1 -- 172.21.15.72:0/2180329245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff009e930 msgr2=0x7f7ff01a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.629+0000 7f7ff4f4d700 1 --2- 172.21.15.72:0/2180329245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff009e930 0x7f7ff01a1af0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000ea10 tx=0x7f7fe000ed20 comp rx=0 tx=0).stop 2023-10-03T10:18:26.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.629+0000 7f7ff4f4d700 1 -- 172.21.15.72:0/2180329245 shutdown_connections 2023-10-03T10:18:26.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.629+0000 7f7ff4f4d700 1 --2- 172.21.15.72:0/2180329245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff009e930 0x7f7ff01a1af0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.629+0000 7f7ff4f4d700 1 --2- 172.21.15.72:0/2180329245 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff009f650 0x7f7ff01a2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.629+0000 7f7ff4f4d700 1 --2- 172.21.15.72:0/2180329245 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff009f240 0x7f7ff01a2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.629+0000 7f7ff4f4d700 1 -- 172.21.15.72:0/2180329245 >> 172.21.15.72:0/2180329245 conn(0x7f7ff00a4210 msgr2=0x7f7ff01b6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.630+0000 7f7ff4f4d700 1 -- 172.21.15.72:0/2180329245 shutdown_connections 2023-10-03T10:18:26.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.630+0000 7f7ff4f4d700 1 -- 172.21.15.72:0/2180329245 wait complete. 2023-10-03T10:18:26.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:26.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.652+0000 7f93ded83700 1 -- 172.21.15.72:0/2880475644 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f93b8005590 con 0x7f93d809e410 2023-10-03T10:18:26.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.653+0000 7f93d57fa700 1 -- 172.21.15.72:0/2880475644 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f93d003e020 con 0x7f93d809e410 2023-10-03T10:18:26.652 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:26.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.655+0000 7f93ded83700 1 -- 172.21.15.72:0/2880475644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f93d809e410 msgr2=0x7f93d811ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.655+0000 7f93ded83700 1 --2- 172.21.15.72:0/2880475644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f93d809e410 0x7f93d811ea60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f93d000c7a0 tx=0x7f93d000cab0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.655+0000 7f93ded83700 1 -- 172.21.15.72:0/2880475644 shutdown_connections 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.655+0000 7f93ded83700 1 --2- 172.21.15.72:0/2880475644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f93d809e410 0x7f93d811ea60 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.655+0000 7f93ded83700 1 --2- 172.21.15.72:0/2880475644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93d809d6f0 0x7f93d811dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.655+0000 7f93ded83700 1 --2- 172.21.15.72:0/2880475644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93d809e000 0x7f93d811e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.655+0000 7f93ded83700 1 -- 172.21.15.72:0/2880475644 >> 172.21.15.72:0/2880475644 conn(0x7f93d8066f50 msgr2=0x7f93d806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.655+0000 7f93ded83700 1 -- 172.21.15.72:0/2880475644 shutdown_connections 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.655+0000 7f93ded83700 1 -- 172.21.15.72:0/2880475644 wait complete. 2023-10-03T10:18:26.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.667+0000 7fc1f5224700 1 -- 172.21.15.72:0/1203743137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc1f0074ea0 con 0x7fc1f01338a0 2023-10-03T10:18:26.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:26.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.667+0000 7fc1d77fe700 1 -- 172.21.15.72:0/1203743137 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc1e801be20 con 0x7fc1f01338a0 2023-10-03T10:18:26.667 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:26.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.669+0000 7fc1f5224700 1 -- 172.21.15.72:0/1203743137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1f01338a0 msgr2=0x7fc1f01cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.669+0000 7fc1f5224700 1 --2- 172.21.15.72:0/1203743137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1f01338a0 0x7fc1f01cc620 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8014000 tx=0x7fc1e8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.669+0000 7fc1f5224700 1 -- 172.21.15.72:0/1203743137 shutdown_connections 2023-10-03T10:18:26.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.669+0000 7fc1f5224700 1 --2- 172.21.15.72:0/1203743137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1f01338a0 0x7fc1f01cc620 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.669+0000 7fc1f5224700 1 --2- 172.21.15.72:0/1203743137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1f009de50 0x7fc1f0099ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.669+0000 7fc1f5224700 1 --2- 172.21.15.72:0/1203743137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1f009e930 0x7fc1f009a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.669+0000 7fc1f5224700 1 -- 172.21.15.72:0/1203743137 >> 172.21.15.72:0/1203743137 conn(0x7fc1f00a2aa0 msgr2=0x7fc1f009ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.669+0000 7fc1f5224700 1 -- 172.21.15.72:0/1203743137 shutdown_connections 2023-10-03T10:18:26.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.669+0000 7fc1f5224700 1 -- 172.21.15.72:0/1203743137 wait complete. 2023-10-03T10:18:26.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.680+0000 7fd15391f700 1 -- 172.21.15.72:0/735859158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd14c1397c0 con 0x7fd14c133fa0 2023-10-03T10:18:26.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.680+0000 7fd141ffb700 1 -- 172.21.15.72:0/735859158 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd144024300 con 0x7fd14c133fa0 2023-10-03T10:18:26.680 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:26.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:26.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.683+0000 7fd15391f700 1 -- 172.21.15.72:0/735859158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c133fa0 msgr2=0x7fd14c1373e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.683+0000 7fd15391f700 1 --2- 172.21.15.72:0/735859158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c133fa0 0x7fd14c1373e0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fd14400efc0 tx=0x7fd14400c0c0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.683+0000 7fd15391f700 1 -- 172.21.15.72:0/735859158 shutdown_connections 2023-10-03T10:18:26.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.683+0000 7fd15391f700 1 --2- 172.21.15.72:0/735859158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd14c133fa0 0x7fd14c1373e0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.683+0000 7fd15391f700 1 --2- 172.21.15.72:0/735859158 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd14c0a0a30 0x7fd14c136960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.683+0000 7fd15391f700 1 --2- 172.21.15.72:0/735859158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd14c0a1340 0x7fd14c136ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.683+0000 7fd15391f700 1 -- 172.21.15.72:0/735859158 >> 172.21.15.72:0/735859158 conn(0x7fd14c0a6550 msgr2=0x7fd14c09aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.683+0000 7fd15391f700 1 -- 172.21.15.72:0/735859158 shutdown_connections 2023-10-03T10:18:26.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:26.683+0000 7fd15391f700 1 -- 172.21.15.72:0/735859158 wait complete. 2023-10-03T10:18:26.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:27.642 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:27.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:27.682 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:27.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:27.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.791+0000 7f1964375700 1 Processor -- start 2023-10-03T10:18:27.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.791+0000 7f1964375700 1 -- start start 2023-10-03T10:18:27.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.792+0000 7f1964375700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f195c12cf60 0x7f195c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.792+0000 7f1964375700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f195c12f8b0 0x7f195c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.792+0000 7f1964375700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c12cd90 con 0x7f195c130260 2023-10-03T10:18:27.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.792+0000 7f1964375700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c12d330 con 0x7f195c12f8b0 2023-10-03T10:18:27.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.792+0000 7f1964375700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c1306e0 con 0x7f195c12cf60 2023-10-03T10:18:27.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.792+0000 7f1962912700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f195c130260 0x7f195c136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55408/0 (socket says 172.21.15.72:55408) 2023-10-03T10:18:27.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.792+0000 7f1962912700 1 -- 172.21.15.72:0/1194494192 learned_addr learned my addr 172.21.15.72:0/1194494192 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:27.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.792+0000 7f1961910700 1 --2- 172.21.15.72:0/1194494192 >> v2:172.21.15.72:3300/0 conn(0x7f195c12f8b0 0x7f195c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.792+0000 7f1962111700 1 --2- 172.21.15.72:0/1194494192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f195c12cf60 0x7f195c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.792+0000 7f1961910700 1 -- 172.21.15.72:0/1194494192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f195c12cf60 msgr2=0x7f195c06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.792+0000 7f1961910700 1 --2- 172.21.15.72:0/1194494192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f195c12cf60 0x7f195c06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.792+0000 7f1961910700 1 -- 172.21.15.72:0/1194494192 >> v1:172.21.15.72:6789/0 conn(0x7f195c130260 legacy=0x7f195c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.792+0000 7f1961910700 1 -- 172.21.15.72:0/1194494192 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c071780 con 0x7f195c12f8b0 2023-10-03T10:18:27.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.792+0000 7f196110f700 1 -- 172.21.15.72:0/1194494192 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546216021 0 0) 0x7f195c12cd90 con 0x7f195c130260 2023-10-03T10:18:27.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.792+0000 7f1962111700 1 --2- 172.21.15.72:0/1194494192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f195c12cf60 0x7f195c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.793+0000 7f1961910700 1 --2- 172.21.15.72:0/1194494192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f195c12f8b0 0x7f195c12fd20 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f194c009840 tx=0x7f194c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09d6b583b73ef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.793+0000 7f196110f700 1 -- 172.21.15.72:0/1194494192 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c011830 con 0x7f195c12f8b0 2023-10-03T10:18:27.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.793+0000 7f196110f700 1 -- 172.21.15.72:0/1194494192 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c011990 con 0x7f195c12f8b0 2023-10-03T10:18:27.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.793+0000 7f196110f700 1 -- 172.21.15.72:0/1194494192 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c011d20 con 0x7f195c12f8b0 2023-10-03T10:18:27.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.794+0000 7f1964375700 1 -- 172.21.15.72:0/1194494192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f195c12f8b0 msgr2=0x7f195c12fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.794+0000 7f1964375700 1 --2- 172.21.15.72:0/1194494192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f195c12f8b0 0x7f195c12fd20 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f194c009840 tx=0x7f194c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:27.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.794+0000 7f1964375700 1 -- 172.21.15.72:0/1194494192 shutdown_connections 2023-10-03T10:18:27.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.794+0000 7f1964375700 1 --2- 172.21.15.72:0/1194494192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f195c12cf60 0x7f195c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.794+0000 7f1964375700 1 --2- 172.21.15.72:0/1194494192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f195c12f8b0 0x7f195c12fd20 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.794+0000 7f1964375700 1 -- 172.21.15.72:0/1194494192 >> 172.21.15.72:0/1194494192 conn(0x7f195c0a2aa0 msgr2=0x7f195c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.794+0000 7f1964375700 1 -- 172.21.15.72:0/1194494192 shutdown_connections 2023-10-03T10:18:27.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.794+0000 7f1964375700 1 -- 172.21.15.72:0/1194494192 wait complete. 2023-10-03T10:18:27.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.795+0000 7f1964375700 1 Processor -- start 2023-10-03T10:18:27.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.795+0000 7f1964375700 1 -- start start 2023-10-03T10:18:27.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.796+0000 7f1964375700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f195c12cf60 0x7f195c129190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.796+0000 7f1964375700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f195c12f8b0 0x7f195c1296d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.796+0000 7f1964375700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f195c130260 0x7f195c13a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.796+0000 7f1964375700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c09e830 con 0x7f195c12cf60 2023-10-03T10:18:27.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.796+0000 7f1964375700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c13c500 con 0x7f195c130260 2023-10-03T10:18:27.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.796+0000 7f1964375700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f195c139430 con 0x7f195c12f8b0 2023-10-03T10:18:27.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.796+0000 7f1961910700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f195c12f8b0 0x7f195c1296d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.796+0000 7f1962912700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f195c130260 0x7f195c13a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.796+0000 7f1961910700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f195c12f8b0 0x7f195c1296d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36804/0 (socket says 172.21.15.72:36804) 2023-10-03T10:18:27.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.796+0000 7f1961910700 1 -- 172.21.15.72:0/2111806851 learned_addr learned my addr 172.21.15.72:0/2111806851 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:27.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.797+0000 7f1961910700 1 -- 172.21.15.72:0/2111806851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f195c130260 msgr2=0x7f195c13a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.797+0000 7f1961910700 1 --2- 172.21.15.72:0/2111806851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f195c130260 0x7f195c13a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.797+0000 7f1961910700 1 -- 172.21.15.72:0/2111806851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f195c12cf60 msgr2=0x7f195c129190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.797+0000 7f1962111700 1 --2- 172.21.15.72:0/2111806851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f195c12cf60 0x7f195c129190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.797+0000 7f1961910700 1 --2- 172.21.15.72:0/2111806851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f195c12cf60 0x7f195c129190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.797+0000 7f1961910700 1 -- 172.21.15.72:0/2111806851 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19580094a0 con 0x7f195c12f8b0 2023-10-03T10:18:27.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.797+0000 7f1962912700 1 --2- 172.21.15.72:0/2111806851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f195c130260 0x7f195c13a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.797+0000 7f1962111700 1 --2- 172.21.15.72:0/2111806851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f195c12cf60 0x7f195c129190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:27.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.797+0000 7f1961910700 1 --2- 172.21.15.72:0/2111806851 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f195c12f8b0 0x7f195c1296d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f194c009fd0 tx=0x7f194c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.797+0000 7f1952ffd700 1 -- 172.21.15.72:0/2111806851 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c004480 con 0x7f195c12f8b0 2023-10-03T10:18:27.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.797+0000 7f1952ffd700 1 -- 172.21.15.72:0/2111806851 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c01f070 con 0x7f195c12f8b0 2023-10-03T10:18:27.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.797+0000 7f1964375700 1 -- 172.21.15.72:0/2111806851 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194c0094a0 con 0x7f195c12f8b0 2023-10-03T10:18:27.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.797+0000 7f1952ffd700 1 -- 172.21.15.72:0/2111806851 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c0038c0 con 0x7f195c12f8b0 2023-10-03T10:18:27.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.797+0000 7f1964375700 1 -- 172.21.15.72:0/2111806851 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c129fa0 con 0x7f195c12f8b0 2023-10-03T10:18:27.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.798+0000 7f1964375700 1 -- 172.21.15.72:0/2111806851 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c074ea0 con 0x7f195c12f8b0 2023-10-03T10:18:27.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.799+0000 7f1952ffd700 1 -- 172.21.15.72:0/2111806851 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f194c021030 con 0x7f195c12f8b0 2023-10-03T10:18:27.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.800+0000 7f1952ffd700 1 -- 172.21.15.72:0/2111806851 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f194c0197b0 con 0x7f195c12f8b0 2023-10-03T10:18:27.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.804+0000 7f1952ffd700 1 -- 172.21.15.72:0/2111806851 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f194c003cb0 con 0x7f195c12f8b0 2023-10-03T10:18:27.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.822+0000 7f83bc213700 1 Processor -- start 2023-10-03T10:18:27.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.823+0000 7f83bc213700 1 -- start start 2023-10-03T10:18:27.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.823+0000 7f83bc213700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83b40a0a30 0x7f83b40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.823+0000 7f83bc213700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b4134170 0x7f83b413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.823+0000 7f83bc213700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b409edd0 con 0x7f83b40a1340 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.823+0000 7f83bc213700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b409e1f0 con 0x7f83b4134170 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.823+0000 7f83bc213700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83b409dc50 con 0x7f83b40a0a30 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.823+0000 7f83b9faf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83b40a0a30 0x7f83b40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.823+0000 7f83ba7b0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b4134170 0x7f83b413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.823+0000 7f83b9faf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83b40a0a30 0x7f83b40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36816/0 (socket says 172.21.15.72:36816) 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.823+0000 7f83b9faf700 1 -- 172.21.15.72:0/3149300791 learned_addr learned my addr 172.21.15.72:0/3149300791 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.824+0000 7f83ba7b0700 1 -- 172.21.15.72:0/3149300791 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83b40a0a30 msgr2=0x7f83b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.824+0000 7f83ba7b0700 1 --2- 172.21.15.72:0/3149300791 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83b40a0a30 0x7f83b40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.824+0000 7f83ba7b0700 1 -- 172.21.15.72:0/3149300791 >> v1:172.21.15.72:6789/0 conn(0x7f83b40a1340 legacy=0x7f83b4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.824+0000 7f83ba7b0700 1 -- 172.21.15.72:0/3149300791 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b40a1fe0 con 0x7f83b4134170 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.824+0000 7f83ba7b0700 1 --2- 172.21.15.72:0/3149300791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b4134170 0x7f83b413bd30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009dc0 tx=0x7f83ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12f7808722509121 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.824+0000 7f83b8fad700 1 -- 172.21.15.72:0/3149300791 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00e070 con 0x7f83b4134170 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.824+0000 7f83b8fad700 1 -- 172.21.15.72:0/3149300791 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac00bb20 con 0x7f83b4134170 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.824+0000 7f83b8fad700 1 -- 172.21.15.72:0/3149300791 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac012430 con 0x7f83b4134170 2023-10-03T10:18:27.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.825+0000 7f83bc213700 1 -- 172.21.15.72:0/3149300791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b4134170 msgr2=0x7f83b413bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.825+0000 7f83bc213700 1 --2- 172.21.15.72:0/3149300791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b4134170 0x7f83b413bd30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009dc0 tx=0x7f83ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:27.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.825+0000 7f83bc213700 1 -- 172.21.15.72:0/3149300791 shutdown_connections 2023-10-03T10:18:27.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.825+0000 7f83bc213700 1 --2- 172.21.15.72:0/3149300791 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b4134170 0x7f83b413bd30 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.825+0000 7f83bc213700 1 --2- 172.21.15.72:0/3149300791 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83b40a0a30 0x7f83b40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.825+0000 7f83bc213700 1 -- 172.21.15.72:0/3149300791 >> 172.21.15.72:0/3149300791 conn(0x7f83b40a6550 msgr2=0x7f83b40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.825+0000 7f83bc213700 1 -- 172.21.15.72:0/3149300791 shutdown_connections 2023-10-03T10:18:27.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.825+0000 7f83bc213700 1 -- 172.21.15.72:0/3149300791 wait complete. 2023-10-03T10:18:27.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.825+0000 7fc3a1fb7700 1 Processor -- start 2023-10-03T10:18:27.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.825+0000 7fc3a1fb7700 1 -- start start 2023-10-03T10:18:27.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc3a1fb7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc39c06a770 0x7fc39c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc3a1fb7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc39c09dc30 0x7fc39c09e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc3a1fb7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc39c13c1e0 0x7fc39c13e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc3a1fb7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39c06ab40 con 0x7fc39c06a770 2023-10-03T10:18:27.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc3a1fb7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c09ebc0 con 0x7fc39c13c1e0 2023-10-03T10:18:27.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc3a1fb7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c09a810 con 0x7fc39c09dc30 2023-10-03T10:18:27.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc39bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc39c13c1e0 0x7fc39c13e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc39bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc39c13c1e0 0x7fc39c13e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56172/0 (socket says 172.21.15.72:56172) 2023-10-03T10:18:27.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc39bfff700 1 -- 172.21.15.72:0/444887630 learned_addr learned my addr 172.21.15.72:0/444887630 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:27.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7f83bc213700 1 Processor -- start 2023-10-03T10:18:27.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7f83bc213700 1 -- start start 2023-10-03T10:18:27.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc39bfff700 1 -- 172.21.15.72:0/444887630 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc39c09dc30 msgr2=0x7fc39c09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc39bfff700 1 --2- 172.21.15.72:0/444887630 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc39c09dc30 0x7fc39c09e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc39bfff700 1 -- 172.21.15.72:0/444887630 >> v2:172.21.15.72:3300/0 conn(0x7fc39c06a770 msgr2=0x7fc39c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc39bfff700 1 --2- 172.21.15.72:0/444887630 >> v2:172.21.15.72:3300/0 conn(0x7fc39c06a770 0x7fc39c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc39bfff700 1 -- 172.21.15.72:0/444887630 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c09e920 con 0x7fc39c13c1e0 2023-10-03T10:18:27.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc39bfff700 1 --2- 172.21.15.72:0/444887630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc39c13c1e0 0x7fc39c13e5c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc394009e50 tx=0x7fc39400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c81406919529b847 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.826+0000 7fc39a7fc700 1 -- 172.21.15.72:0/444887630 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39400e070 con 0x7fc39c13c1e0 2023-10-03T10:18:27.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7fc39a7fc700 1 -- 172.21.15.72:0/444887630 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39400b9c0 con 0x7fc39c13c1e0 2023-10-03T10:18:27.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7fc39a7fc700 1 -- 172.21.15.72:0/444887630 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39400bd70 con 0x7fc39c13c1e0 2023-10-03T10:18:27.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7f83bc213700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b40a0a30 0x7f83b4122a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7f83bc213700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83b40a1340 0x7f83b4122f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7f83b9faf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b40a0a30 0x7f83b4122a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7f83b9faf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b40a0a30 0x7f83b4122a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56182/0 (socket says 172.21.15.72:56182) 2023-10-03T10:18:27.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7f83bc213700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83b4134170 0x7f83b4123490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7f83b97ae700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83b40a1340 0x7f83b4122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7f83bc213700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b4124ac0 con 0x7f83b4134170 2023-10-03T10:18:27.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7f83bc213700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b40a0220 con 0x7f83b40a0a30 2023-10-03T10:18:27.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7f83bc213700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83b4125e80 con 0x7f83b40a1340 2023-10-03T10:18:27.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7f83b9faf700 1 -- 172.21.15.72:0/3973288660 learned_addr learned my addr 172.21.15.72:0/3973288660 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:27.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7f83b9faf700 1 -- 172.21.15.72:0/3973288660 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83b40a1340 msgr2=0x7f83b4122f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7f83b9faf700 1 --2- 172.21.15.72:0/3973288660 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83b40a1340 0x7f83b4122f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7f83b9faf700 1 -- 172.21.15.72:0/3973288660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83b4134170 msgr2=0x7f83b4123490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7f83b9faf700 1 --2- 172.21.15.72:0/3973288660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83b4134170 0x7f83b4123490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7f83b9faf700 1 -- 172.21.15.72:0/3973288660 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac009a70 con 0x7f83b40a0a30 2023-10-03T10:18:27.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7fc3a1fb7700 1 -- 172.21.15.72:0/444887630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc39c13c1e0 msgr2=0x7fc39c13e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.827+0000 7fc3a1fb7700 1 --2- 172.21.15.72:0/444887630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc39c13c1e0 0x7fc39c13e5c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc394009e50 tx=0x7fc39400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:27.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.828+0000 7f83b9faf700 1 --2- 172.21.15.72:0/3973288660 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b40a0a30 0x7f83b4122a10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f83b000e910 tx=0x7f83b000ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.828+0000 7fc3a1fb7700 1 -- 172.21.15.72:0/444887630 shutdown_connections 2023-10-03T10:18:27.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.828+0000 7fc3a1fb7700 1 --2- 172.21.15.72:0/444887630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc39c13c1e0 0x7fc39c13e5c0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.828+0000 7fc3a1fb7700 1 --2- 172.21.15.72:0/444887630 >> v2:172.21.15.72:3300/0 conn(0x7fc39c06a770 0x7fc39c09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.828+0000 7fc3a1fb7700 1 --2- 172.21.15.72:0/444887630 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc39c09dc30 0x7fc39c09e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.828+0000 7fc3a1fb7700 1 -- 172.21.15.72:0/444887630 >> 172.21.15.72:0/444887630 conn(0x7fc39c066f50 msgr2=0x7fc39c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.828+0000 7fc3a1fb7700 1 -- 172.21.15.72:0/444887630 shutdown_connections 2023-10-03T10:18:27.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.828+0000 7fc3a1fb7700 1 -- 172.21.15.72:0/444887630 wait complete. 2023-10-03T10:18:27.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.828+0000 7f83aa7fc700 1 -- 172.21.15.72:0/3973288660 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b00096a0 con 0x7f83b40a0a30 2023-10-03T10:18:27.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.829+0000 7fc3a1fb7700 1 Processor -- start 2023-10-03T10:18:27.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.828+0000 7f83aa7fc700 1 -- 172.21.15.72:0/3973288660 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b000ee60 con 0x7f83b40a0a30 2023-10-03T10:18:27.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.828+0000 7f83bc213700 1 -- 172.21.15.72:0/3973288660 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b40a25e0 con 0x7f83b40a0a30 2023-10-03T10:18:27.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.828+0000 7f83aa7fc700 1 -- 172.21.15.72:0/3973288660 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b000ca90 con 0x7f83b40a0a30 2023-10-03T10:18:27.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.828+0000 7f83bc213700 1 -- 172.21.15.72:0/3973288660 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b4126bb0 con 0x7f83b40a0a30 2023-10-03T10:18:27.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.829+0000 7f83aa7fc700 1 -- 172.21.15.72:0/3973288660 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83b000cbf0 con 0x7f83b40a0a30 2023-10-03T10:18:27.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.829+0000 7f83bc213700 1 -- 172.21.15.72:0/3973288660 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b4074ea0 con 0x7f83b40a0a30 2023-10-03T10:18:27.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.829+0000 7f83aa7fc700 1 -- 172.21.15.72:0/3973288660 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f83b003f6b0 con 0x7f83b40a0a30 2023-10-03T10:18:27.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.829+0000 7fc3a1fb7700 1 -- start start 2023-10-03T10:18:27.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc3a1fb7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc39c06a770 0x7fc39c13bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc3a1fb7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc39c09dc30 0x7fc39c11d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc3a1fb7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc39c13c1e0 0x7fc39c11dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc3a1fb7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c11fb10 con 0x7fc39c09dc30 2023-10-03T10:18:27.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc3a1fb7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c0725b0 con 0x7fc39c06a770 2023-10-03T10:18:27.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc3a1fb7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c09f1a0 con 0x7fc39c13c1e0 2023-10-03T10:18:27.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc39bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc39c13c1e0 0x7fc39c11dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc39bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc39c13c1e0 0x7fc39c11dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36832/0 (socket says 172.21.15.72:36832) 2023-10-03T10:18:27.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc39bfff700 1 -- 172.21.15.72:0/2965400373 learned_addr learned my addr 172.21.15.72:0/2965400373 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:27.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc39b7fe700 1 --2- 172.21.15.72:0/2965400373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc39c06a770 0x7fc39c13bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc39affd700 1 --2- 172.21.15.72:0/2965400373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc39c09dc30 0x7fc39c11d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc39b7fe700 1 -- 172.21.15.72:0/2965400373 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc39c13c1e0 msgr2=0x7fc39c11dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc39b7fe700 1 --2- 172.21.15.72:0/2965400373 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc39c13c1e0 0x7fc39c11dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc39b7fe700 1 -- 172.21.15.72:0/2965400373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc39c09dc30 msgr2=0x7fc39c11d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc39b7fe700 1 --2- 172.21.15.72:0/2965400373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc39c09dc30 0x7fc39c11d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc39b7fe700 1 -- 172.21.15.72:0/2965400373 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc394009b30 con 0x7fc39c06a770 2023-10-03T10:18:27.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc39bfff700 1 --2- 172.21.15.72:0/2965400373 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc39c13c1e0 0x7fc39c11dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.830+0000 7fc39b7fe700 1 --2- 172.21.15.72:0/2965400373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc39c06a770 0x7fc39c13bc90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00b450 tx=0x7fc38c00b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.838+0000 7fc383fff700 1 -- 172.21.15.72:0/2965400373 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c011830 con 0x7fc39c06a770 2023-10-03T10:18:27.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.838+0000 7fc383fff700 1 -- 172.21.15.72:0/2965400373 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c011990 con 0x7fc39c06a770 2023-10-03T10:18:27.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.838+0000 7fc383fff700 1 -- 172.21.15.72:0/2965400373 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c011d40 con 0x7fc39c06a770 2023-10-03T10:18:27.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.838+0000 7fc3a1fb7700 1 -- 172.21.15.72:0/2965400373 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39c11f460 con 0x7fc39c06a770 2023-10-03T10:18:27.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.838+0000 7f83aa7fc700 1 -- 172.21.15.72:0/3973288660 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83b0017080 con 0x7f83b40a0a30 2023-10-03T10:18:27.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.838+0000 7fc3a1fb7700 1 -- 172.21.15.72:0/2965400373 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39c071bf0 con 0x7fc39c06a770 2023-10-03T10:18:27.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.839+0000 7fc383fff700 1 -- 172.21.15.72:0/2965400373 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc38c01a400 con 0x7fc39c06a770 2023-10-03T10:18:27.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.839+0000 7fc3a1fb7700 1 -- 172.21.15.72:0/2965400373 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39c11fc80 con 0x7fc39c06a770 2023-10-03T10:18:27.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.839+0000 7fc383fff700 1 -- 172.21.15.72:0/2965400373 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc38c03f690 con 0x7fc39c06a770 2023-10-03T10:18:27.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.848+0000 7fc383fff700 1 -- 172.21.15.72:0/2965400373 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc38c00f8d0 con 0x7fc39c06a770 2023-10-03T10:18:27.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.869+0000 7f5828c99700 1 Processor -- start 2023-10-03T10:18:27.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.870+0000 7f5828c99700 1 -- start start 2023-10-03T10:18:27.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.870+0000 7f5828c99700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f582409e1d0 0x7f5824138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.870+0000 7f5828c99700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5824139170 0x7f582413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.870+0000 7f5828c99700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582409b120 con 0x7f582409d6f0 2023-10-03T10:18:27.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.870+0000 7f5828c99700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582406b460 con 0x7f5824139170 2023-10-03T10:18:27.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.870+0000 7f5828c99700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f582409a7e0 con 0x7f582409e1d0 2023-10-03T10:18:27.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.870+0000 7f5821d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f582409e1d0 0x7f5824138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.870+0000 7f5821d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f582409e1d0 0x7f5824138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36836/0 (socket says 172.21.15.72:36836) 2023-10-03T10:18:27.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.870+0000 7f5821d9b700 1 -- 172.21.15.72:0/577444066 learned_addr learned my addr 172.21.15.72:0/577444066 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:27.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.871+0000 7f5822d9d700 1 --2- 172.21.15.72:0/577444066 >> v2:172.21.15.72:3300/0 conn(0x7f5824139170 0x7f582413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.871+0000 7f5821d9b700 1 -- 172.21.15.72:0/577444066 >> v2:172.21.15.72:3300/0 conn(0x7f5824139170 msgr2=0x7f582413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.871+0000 7f5821d9b700 1 --2- 172.21.15.72:0/577444066 >> v2:172.21.15.72:3300/0 conn(0x7f5824139170 0x7f582413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.871+0000 7f5821d9b700 1 -- 172.21.15.72:0/577444066 >> v1:172.21.15.72:6789/0 conn(0x7f582409d6f0 legacy=0x7f582409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.871+0000 7f5821d9b700 1 -- 172.21.15.72:0/577444066 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582409a500 con 0x7f582409e1d0 2023-10-03T10:18:27.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.871+0000 7f5822d9d700 1 --2- 172.21.15.72:0/577444066 >> v2:172.21.15.72:3300/0 conn(0x7f5824139170 0x7f582413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:27.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.871+0000 7f5821d9b700 1 --2- 172.21.15.72:0/577444066 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f582409e1d0 0x7f5824138c30 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5818009920 tx=0x7f5818009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ad8f192c6546aaf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.871+0000 7f582159a700 1 -- 172.21.15.72:0/577444066 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581800ba20 con 0x7f582409e1d0 2023-10-03T10:18:27.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.871+0000 7f582159a700 1 -- 172.21.15.72:0/577444066 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581800bb80 con 0x7f582409e1d0 2023-10-03T10:18:27.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.871+0000 7f582159a700 1 -- 172.21.15.72:0/577444066 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5818009e70 con 0x7f582409e1d0 2023-10-03T10:18:27.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.872+0000 7f5828c99700 1 -- 172.21.15.72:0/577444066 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f582409e1d0 msgr2=0x7f5824138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.872+0000 7f5828c99700 1 --2- 172.21.15.72:0/577444066 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f582409e1d0 0x7f5824138c30 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5818009920 tx=0x7f5818009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:27.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.872+0000 7f5828c99700 1 -- 172.21.15.72:0/577444066 shutdown_connections 2023-10-03T10:18:27.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.872+0000 7f5828c99700 1 --2- 172.21.15.72:0/577444066 >> v2:172.21.15.72:3300/0 conn(0x7f5824139170 0x7f582413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.872+0000 7f5828c99700 1 --2- 172.21.15.72:0/577444066 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f582409e1d0 0x7f5824138c30 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.872+0000 7f5828c99700 1 -- 172.21.15.72:0/577444066 >> 172.21.15.72:0/577444066 conn(0x7f5824066f50 msgr2=0x7f582409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.872+0000 7f5828c99700 1 -- 172.21.15.72:0/577444066 shutdown_connections 2023-10-03T10:18:27.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.872+0000 7f5828c99700 1 -- 172.21.15.72:0/577444066 wait complete. 2023-10-03T10:18:27.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.873+0000 7f5828c99700 1 Processor -- start 2023-10-03T10:18:27.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.873+0000 7f5828c99700 1 -- start start 2023-10-03T10:18:27.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.873+0000 7f5828c99700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582409d6f0 0x7f5824120840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.873+0000 7f5828c99700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f582409e1d0 0x7f5824120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f5828c99700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5824139170 0x7f58241212c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f5828c99700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5824122aa0 con 0x7f582409d6f0 2023-10-03T10:18:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f5828c99700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5824122560 con 0x7f5824139170 2023-10-03T10:18:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f5828c99700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58240a1910 con 0x7f582409e1d0 2023-10-03T10:18:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f582259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582409d6f0 0x7f5824120840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f582259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582409d6f0 0x7f5824120840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47870/0 (socket says 172.21.15.72:47870) 2023-10-03T10:18:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f582259c700 1 -- 172.21.15.72:0/739011378 learned_addr learned my addr 172.21.15.72:0/739011378 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f5821d9b700 1 --2- 172.21.15.72:0/739011378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f582409e1d0 0x7f5824120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f5822d9d700 1 --2- 172.21.15.72:0/739011378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5824139170 0x7f58241212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f582259c700 1 -- 172.21.15.72:0/739011378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f582409e1d0 msgr2=0x7f5824120d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f582259c700 1 --2- 172.21.15.72:0/739011378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f582409e1d0 0x7f5824120d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f582259c700 1 -- 172.21.15.72:0/739011378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5824139170 msgr2=0x7f58241212c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f582259c700 1 --2- 172.21.15.72:0/739011378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5824139170 0x7f58241212c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f582259c700 1 -- 172.21.15.72:0/739011378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5818009550 con 0x7f582409d6f0 2023-10-03T10:18:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f5821d9b700 1 --2- 172.21.15.72:0/739011378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f582409e1d0 0x7f5824120d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f582259c700 1 --2- 172.21.15.72:0/739011378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582409d6f0 0x7f5824120840 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f581400c4e0 tx=0x7f581400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.874+0000 7f5812ffd700 1 -- 172.21.15.72:0/739011378 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58140052d0 con 0x7f582409d6f0 2023-10-03T10:18:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.875+0000 7f5812ffd700 1 -- 172.21.15.72:0/739011378 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5814005430 con 0x7f582409d6f0 2023-10-03T10:18:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.875+0000 7f5828c99700 1 -- 172.21.15.72:0/739011378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582409c710 con 0x7f582409d6f0 2023-10-03T10:18:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.875+0000 7f5812ffd700 1 -- 172.21.15.72:0/739011378 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58140038c0 con 0x7f582409d6f0 2023-10-03T10:18:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.875+0000 7f5828c99700 1 -- 172.21.15.72:0/739011378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5824124130 con 0x7f582409d6f0 2023-10-03T10:18:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.876+0000 7f5812ffd700 1 -- 172.21.15.72:0/739011378 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5814003a20 con 0x7f582409d6f0 2023-10-03T10:18:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.876+0000 7f5828c99700 1 -- 172.21.15.72:0/739011378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5824124bb0 con 0x7f582409d6f0 2023-10-03T10:18:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.876+0000 7f5812ffd700 1 -- 172.21.15.72:0/739011378 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f581403ea70 con 0x7f582409d6f0 2023-10-03T10:18:27.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:27.885+0000 7f5812ffd700 1 -- 172.21.15.72:0/739011378 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5814040e60 con 0x7f582409d6f0 2023-10-03T10:18:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.006+0000 7f1964375700 1 -- 172.21.15.72:0/2111806851 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f195c0713a0 con 0x7f195c12f8b0 2023-10-03T10:18:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.007+0000 7f1952ffd700 1 -- 172.21.15.72:0/2111806851 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f194c015030 con 0x7f195c12f8b0 2023-10-03T10:18:28.007 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:28.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.009+0000 7f1964375700 1 -- 172.21.15.72:0/2111806851 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f195c12f8b0 msgr2=0x7f195c1296d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.009+0000 7f1964375700 1 --2- 172.21.15.72:0/2111806851 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f195c12f8b0 0x7f195c1296d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f194c009fd0 tx=0x7f194c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.009+0000 7f1964375700 1 -- 172.21.15.72:0/2111806851 shutdown_connections 2023-10-03T10:18:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.009+0000 7f1964375700 1 --2- 172.21.15.72:0/2111806851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f195c12cf60 0x7f195c129190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.009+0000 7f1964375700 1 --2- 172.21.15.72:0/2111806851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f195c130260 0x7f195c13a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.009+0000 7f1964375700 1 --2- 172.21.15.72:0/2111806851 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f195c12f8b0 0x7f195c1296d0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.009+0000 7f1964375700 1 -- 172.21.15.72:0/2111806851 >> 172.21.15.72:0/2111806851 conn(0x7f195c0a2aa0 msgr2=0x7f195c12a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.009+0000 7f1964375700 1 -- 172.21.15.72:0/2111806851 shutdown_connections 2023-10-03T10:18:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.009+0000 7f1964375700 1 -- 172.21.15.72:0/2111806851 wait complete. 2023-10-03T10:18:28.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:28.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.039+0000 7f83bc213700 1 -- 172.21.15.72:0/3973288660 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f83b4125fc0 con 0x7f83b40a0a30 2023-10-03T10:18:28.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.040+0000 7f83aa7fc700 1 -- 172.21.15.72:0/3973288660 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83b00232f0 con 0x7f83b40a0a30 2023-10-03T10:18:28.040 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:28.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.041+0000 7f83bc213700 1 -- 172.21.15.72:0/3973288660 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b40a0a30 msgr2=0x7f83b4122a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.041+0000 7f83bc213700 1 --2- 172.21.15.72:0/3973288660 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b40a0a30 0x7f83b4122a10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f83b000e910 tx=0x7f83b000ec20 comp rx=0 tx=0).stop 2023-10-03T10:18:28.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.041+0000 7f83bc213700 1 -- 172.21.15.72:0/3973288660 shutdown_connections 2023-10-03T10:18:28.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.041+0000 7f83bc213700 1 --2- 172.21.15.72:0/3973288660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83b4134170 0x7f83b4123490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.042+0000 7f83bc213700 1 --2- 172.21.15.72:0/3973288660 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b40a0a30 0x7f83b4122a10 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.042+0000 7f83bc213700 1 --2- 172.21.15.72:0/3973288660 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f83b40a1340 0x7f83b4122f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.042+0000 7f83bc213700 1 -- 172.21.15.72:0/3973288660 >> 172.21.15.72:0/3973288660 conn(0x7f83b40a6550 msgr2=0x7f83b409ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.042+0000 7f83bc213700 1 -- 172.21.15.72:0/3973288660 shutdown_connections 2023-10-03T10:18:28.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.042+0000 7f83bc213700 1 -- 172.21.15.72:0/3973288660 wait complete. 2023-10-03T10:18:28.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:28.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.056+0000 7fc3a1fb7700 1 -- 172.21.15.72:0/2965400373 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc39c074ea0 con 0x7fc39c06a770 2023-10-03T10:18:28.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.056+0000 7fc383fff700 1 -- 172.21.15.72:0/2965400373 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc38c015030 con 0x7fc39c06a770 2023-10-03T10:18:28.057 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:28.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.059+0000 7fc3a1fb7700 1 -- 172.21.15.72:0/2965400373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc39c06a770 msgr2=0x7fc39c13bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.059+0000 7fc3a1fb7700 1 --2- 172.21.15.72:0/2965400373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc39c06a770 0x7fc39c13bc90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00b450 tx=0x7fc38c00b760 comp rx=0 tx=0).stop 2023-10-03T10:18:28.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.059+0000 7fc3a1fb7700 1 -- 172.21.15.72:0/2965400373 shutdown_connections 2023-10-03T10:18:28.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.059+0000 7fc3a1fb7700 1 --2- 172.21.15.72:0/2965400373 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc39c13c1e0 0x7fc39c11dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.059+0000 7fc3a1fb7700 1 --2- 172.21.15.72:0/2965400373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc39c06a770 0x7fc39c13bc90 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.059+0000 7fc3a1fb7700 1 --2- 172.21.15.72:0/2965400373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc39c09dc30 0x7fc39c11d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.059+0000 7fc3a1fb7700 1 -- 172.21.15.72:0/2965400373 >> 172.21.15.72:0/2965400373 conn(0x7fc39c066f50 msgr2=0x7fc39c09b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.059+0000 7fc3a1fb7700 1 -- 172.21.15.72:0/2965400373 shutdown_connections 2023-10-03T10:18:28.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.059+0000 7fc3a1fb7700 1 -- 172.21.15.72:0/2965400373 wait complete. 2023-10-03T10:18:28.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:28.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.092+0000 7f5828c99700 1 -- 172.21.15.72:0/739011378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f582409f420 con 0x7f582409d6f0 2023-10-03T10:18:28.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.092+0000 7f5812ffd700 1 -- 172.21.15.72:0/739011378 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5814017070 con 0x7f582409d6f0 2023-10-03T10:18:28.093 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:28.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.094+0000 7f5828c99700 1 -- 172.21.15.72:0/739011378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582409d6f0 msgr2=0x7f5824120840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.094+0000 7f5828c99700 1 --2- 172.21.15.72:0/739011378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582409d6f0 0x7f5824120840 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f581400c4e0 tx=0x7f581400c7f0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.094+0000 7f5828c99700 1 -- 172.21.15.72:0/739011378 shutdown_connections 2023-10-03T10:18:28.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.094+0000 7f5828c99700 1 --2- 172.21.15.72:0/739011378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f582409d6f0 0x7f5824120840 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.094+0000 7f5828c99700 1 --2- 172.21.15.72:0/739011378 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5824139170 0x7f58241212c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.094+0000 7f5828c99700 1 --2- 172.21.15.72:0/739011378 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f582409e1d0 0x7f5824120d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.094+0000 7f5828c99700 1 -- 172.21.15.72:0/739011378 >> 172.21.15.72:0/739011378 conn(0x7f5824066f50 msgr2=0x7f582409b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.094+0000 7f5828c99700 1 -- 172.21.15.72:0/739011378 shutdown_connections 2023-10-03T10:18:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:28.094+0000 7f5828c99700 1 -- 172.21.15.72:0/739011378 wait complete. 2023-10-03T10:18:28.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:29.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:29.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:29.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:29.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:29.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.165+0000 7f7ffe7e4700 1 Processor -- start 2023-10-03T10:18:29.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.165+0000 7f7ffe7e4700 1 -- start start 2023-10-03T10:18:29.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.166+0000 7f7ffe7e4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff809d6f0 0x7f7ff809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.166+0000 7f7ffe7e4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff809e000 0x7f7ff81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.166+0000 7f7ffe7e4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff809b120 con 0x7f7ff809e410 2023-10-03T10:18:29.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.166+0000 7f7ffe7e4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff806b460 con 0x7f7ff809e000 2023-10-03T10:18:29.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.166+0000 7f7ffe7e4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff809a7e0 con 0x7f7ff809d6f0 2023-10-03T10:18:29.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.166+0000 7f7ff7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff809d6f0 0x7f7ff809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.166+0000 7f7ff7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff809d6f0 0x7f7ff809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49666/0 (socket says 172.21.15.72:49666) 2023-10-03T10:18:29.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.166+0000 7f7ff7fff700 1 -- 172.21.15.72:0/243444097 learned_addr learned my addr 172.21.15.72:0/243444097 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:29.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.166+0000 7f7ff77fe700 1 --2- 172.21.15.72:0/243444097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff809e000 0x7f7ff81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.167+0000 7f7ff77fe700 1 -- 172.21.15.72:0/243444097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff809d6f0 msgr2=0x7f7ff809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.167+0000 7f7ff77fe700 1 --2- 172.21.15.72:0/243444097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff809d6f0 0x7f7ff809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.167+0000 7f7ff77fe700 1 -- 172.21.15.72:0/243444097 >> v1:172.21.15.72:6789/0 conn(0x7f7ff809e410 legacy=0x7f7ff8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.167+0000 7f7ff77fe700 1 -- 172.21.15.72:0/243444097 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff809a500 con 0x7f7ff809e000 2023-10-03T10:18:29.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.167+0000 7f7ff77fe700 1 --2- 172.21.15.72:0/243444097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff809e000 0x7f7ff81339f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009870 tx=0x7f7fec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f28cc7c9a6f1a7ad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.167+0000 7f7ff6ffd700 1 -- 172.21.15.72:0/243444097 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec004230 con 0x7f7ff809e000 2023-10-03T10:18:29.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.167+0000 7f7ff6ffd700 1 -- 172.21.15.72:0/243444097 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec004390 con 0x7f7ff809e000 2023-10-03T10:18:29.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.167+0000 7f7ff6ffd700 1 -- 172.21.15.72:0/243444097 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0036a0 con 0x7f7ff809e000 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.168+0000 7f7ffe7e4700 1 -- 172.21.15.72:0/243444097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff809e000 msgr2=0x7f7ff81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.168+0000 7f7ffe7e4700 1 --2- 172.21.15.72:0/243444097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff809e000 0x7f7ff81339f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009870 tx=0x7f7fec009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.168+0000 7f7ffe7e4700 1 -- 172.21.15.72:0/243444097 shutdown_connections 2023-10-03T10:18:29.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.168+0000 7f7ffe7e4700 1 --2- 172.21.15.72:0/243444097 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff809d6f0 0x7f7ff809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.168+0000 7f7ffe7e4700 1 --2- 172.21.15.72:0/243444097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff809e000 0x7f7ff81339f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.168+0000 7f7ffe7e4700 1 -- 172.21.15.72:0/243444097 >> 172.21.15.72:0/243444097 conn(0x7f7ff8066f50 msgr2=0x7f7ff809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.168+0000 7f7ffe7e4700 1 -- 172.21.15.72:0/243444097 shutdown_connections 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.168+0000 7f7ffe7e4700 1 -- 172.21.15.72:0/243444097 wait complete. 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.169+0000 7f7ffe7e4700 1 Processor -- start 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.169+0000 7f7ffe7e4700 1 -- start start 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.169+0000 7f7ffe7e4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff809d6f0 0x7f7ff8122560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.169+0000 7f7ffe7e4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff809e000 0x7f7ff8122aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.169+0000 7f7ffe7e4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff809e410 0x7f7ff8122fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.169+0000 7f7ffe7e4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff809c780 con 0x7f7ff809e410 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.169+0000 7f7ffe7e4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff81239a0 con 0x7f7ff809d6f0 2023-10-03T10:18:29.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.170+0000 7f7ffe7e4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff8125da0 con 0x7f7ff809e000 2023-10-03T10:18:29.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.170+0000 7f7ff7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff809d6f0 0x7f7ff8122560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.170+0000 7f7ff7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff809d6f0 0x7f7ff8122560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56516/0 (socket says 172.21.15.72:56516) 2023-10-03T10:18:29.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.170+0000 7f7ff7fff700 1 -- 172.21.15.72:0/771277282 learned_addr learned my addr 172.21.15.72:0/771277282 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:29.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.170+0000 7f7ff77fe700 1 --2- 172.21.15.72:0/771277282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff809e000 0x7f7ff8122aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.170+0000 7f7ffcd81700 1 --2- 172.21.15.72:0/771277282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff809e410 0x7f7ff8122fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.170+0000 7f7ff77fe700 1 -- 172.21.15.72:0/771277282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff809d6f0 msgr2=0x7f7ff8122560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.170+0000 7f7ff77fe700 1 --2- 172.21.15.72:0/771277282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff809d6f0 0x7f7ff8122560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.170+0000 7f7ff77fe700 1 -- 172.21.15.72:0/771277282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff809e410 msgr2=0x7f7ff8122fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.170+0000 7f7ff77fe700 1 --2- 172.21.15.72:0/771277282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff809e410 0x7f7ff8122fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.170+0000 7f7ff77fe700 1 -- 172.21.15.72:0/771277282 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec0094a0 con 0x7f7ff809e000 2023-10-03T10:18:29.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.170+0000 7f7ff77fe700 1 --2- 172.21.15.72:0/771277282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff809e000 0x7f7ff8122aa0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7ff806e510 tx=0x7f7fec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.171+0000 7f7ff4ff9700 1 -- 172.21.15.72:0/771277282 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec003d70 con 0x7f7ff809e000 2023-10-03T10:18:29.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.171+0000 7f7ff4ff9700 1 -- 172.21.15.72:0/771277282 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec01e070 con 0x7f7ff809e000 2023-10-03T10:18:29.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.171+0000 7f7ff4ff9700 1 -- 172.21.15.72:0/771277282 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec011870 con 0x7f7ff809e000 2023-10-03T10:18:29.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.171+0000 7f7ffe7e4700 1 -- 172.21.15.72:0/771277282 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff8124990 con 0x7f7ff809e000 2023-10-03T10:18:29.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.171+0000 7f7ffe7e4700 1 -- 172.21.15.72:0/771277282 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff81334b0 con 0x7f7ff809e000 2023-10-03T10:18:29.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.172+0000 7f7ff4ff9700 1 -- 172.21.15.72:0/771277282 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7fec0119d0 con 0x7f7ff809e000 2023-10-03T10:18:29.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.172+0000 7f7ff4ff9700 1 -- 172.21.15.72:0/771277282 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7fec0405e0 con 0x7f7ff809e000 2023-10-03T10:18:29.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.172+0000 7f7ffe7e4700 1 -- 172.21.15.72:0/771277282 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff81330e0 con 0x7f7ff809e000 2023-10-03T10:18:29.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.177+0000 7f7ff4ff9700 1 -- 172.21.15.72:0/771277282 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7fec02d970 con 0x7f7ff809e000 2023-10-03T10:18:29.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.206+0000 7fc12b4d0700 1 Processor -- start 2023-10-03T10:18:29.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.206+0000 7fc12b4d0700 1 -- start start 2023-10-03T10:18:29.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.207+0000 7fc12b4d0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc124130560 0x7fc124130930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.207+0000 7fc12b4d0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc124130e70 0x7fc12406fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.207+0000 7fc12b4d0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc124070a50 con 0x7fc12409eca0 2023-10-03T10:18:29.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.207+0000 7fc12b4d0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1240717d0 con 0x7fc124130560 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.207+0000 7fc12b4d0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc124130340 con 0x7fc124130e70 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.207+0000 7fc12926c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc124130560 0x7fc124130930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.207+0000 7fc12926c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc124130560 0x7fc124130930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54338/0 (socket says 172.21.15.72:54338) 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.207+0000 7fc12926c700 1 -- 172.21.15.72:0/670591971 learned_addr learned my addr 172.21.15.72:0/670591971 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:29.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.207+0000 7fc129a6d700 1 --2- 172.21.15.72:0/670591971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc124130e70 0x7fc12406fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.207+0000 7fc129a6d700 1 -- 172.21.15.72:0/670591971 >> v2:172.21.15.72:3300/0 conn(0x7fc124130560 msgr2=0x7fc124130930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.207+0000 7fc129a6d700 1 --2- 172.21.15.72:0/670591971 >> v2:172.21.15.72:3300/0 conn(0x7fc124130560 0x7fc124130930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.207+0000 7fc129a6d700 1 -- 172.21.15.72:0/670591971 >> v1:172.21.15.72:6789/0 conn(0x7fc12409eca0 legacy=0x7fc12406f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.207+0000 7fc129a6d700 1 -- 172.21.15.72:0/670591971 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc124071060 con 0x7fc124130e70 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.207+0000 7fc11bfff700 1 -- 172.21.15.72:0/670591971 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128518263 0 0) 0x7fc124070a50 con 0x7fc12409eca0 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.208+0000 7fc12926c700 1 --2- 172.21.15.72:0/670591971 >> v2:172.21.15.72:3300/0 conn(0x7fc124130560 0x7fc124130930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.208+0000 7fc129a6d700 1 --2- 172.21.15.72:0/670591971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc124130e70 0x7fc12406fd30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009d90 tx=0x7fc11c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41ee917f236b55f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.208+0000 7fc11bfff700 1 -- 172.21.15.72:0/670591971 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00e070 con 0x7fc124130e70 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.208+0000 7fc11bfff700 1 -- 172.21.15.72:0/670591971 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c00bb20 con 0x7fc124130e70 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.208+0000 7fc11bfff700 1 -- 172.21.15.72:0/670591971 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c012430 con 0x7fc124130e70 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.208+0000 7fc12b4d0700 1 -- 172.21.15.72:0/670591971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc124130e70 msgr2=0x7fc12406fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.208+0000 7fc12b4d0700 1 --2- 172.21.15.72:0/670591971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc124130e70 0x7fc12406fd30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009d90 tx=0x7fc11c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.208+0000 7fc12b4d0700 1 -- 172.21.15.72:0/670591971 shutdown_connections 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.209+0000 7fc12b4d0700 1 --2- 172.21.15.72:0/670591971 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc124130e70 0x7fc12406fd30 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.209+0000 7fc12b4d0700 1 --2- 172.21.15.72:0/670591971 >> v2:172.21.15.72:3300/0 conn(0x7fc124130560 0x7fc124130930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.209+0000 7fc12b4d0700 1 -- 172.21.15.72:0/670591971 >> 172.21.15.72:0/670591971 conn(0x7fc1240a2aa0 msgr2=0x7fc1240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.209+0000 7fc12b4d0700 1 -- 172.21.15.72:0/670591971 shutdown_connections 2023-10-03T10:18:29.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.209+0000 7fc12b4d0700 1 -- 172.21.15.72:0/670591971 wait complete. 2023-10-03T10:18:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.210+0000 7fc12b4d0700 1 Processor -- start 2023-10-03T10:18:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.210+0000 7fc12b4d0700 1 -- start start 2023-10-03T10:18:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.210+0000 7fc12b4d0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc12409eca0 0x7fc12411a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.210+0000 7fc12b4d0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc124130560 0x7fc12411ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.210+0000 7fc12b4d0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc124130e70 0x7fc12411b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.210+0000 7fc12b4d0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12411e2f0 con 0x7fc124130e70 2023-10-03T10:18:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.210+0000 7fc12b4d0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12411d6a0 con 0x7fc12409eca0 2023-10-03T10:18:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.210+0000 7fc12b4d0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc12412cc70 con 0x7fc124130560 2023-10-03T10:18:29.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.210+0000 7fc12926c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc12409eca0 0x7fc12411a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.210+0000 7fc12926c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc12409eca0 0x7fc12411a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56548/0 (socket says 172.21.15.72:56548) 2023-10-03T10:18:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.210+0000 7fc12926c700 1 -- 172.21.15.72:0/2237766906 learned_addr learned my addr 172.21.15.72:0/2237766906 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.210+0000 7fc129a6d700 1 --2- 172.21.15.72:0/2237766906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc124130e70 0x7fc12411b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.210+0000 7fc12926c700 1 -- 172.21.15.72:0/2237766906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc124130560 msgr2=0x7fc12411ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.210+0000 7fc128a6b700 1 --2- 172.21.15.72:0/2237766906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc124130560 0x7fc12411ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.211+0000 7fc12926c700 1 --2- 172.21.15.72:0/2237766906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc124130560 0x7fc12411ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.211+0000 7fc12926c700 1 -- 172.21.15.72:0/2237766906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc124130e70 msgr2=0x7fc12411b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.211+0000 7fc12926c700 1 --2- 172.21.15.72:0/2237766906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc124130e70 0x7fc12411b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.211+0000 7fc12926c700 1 -- 172.21.15.72:0/2237766906 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12000b7f0 con 0x7fc12409eca0 2023-10-03T10:18:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.211+0000 7fc128a6b700 1 --2- 172.21.15.72:0/2237766906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc124130560 0x7fc12411ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.211+0000 7fc129a6d700 1 --2- 172.21.15.72:0/2237766906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc124130e70 0x7fc12411b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.211+0000 7fc12926c700 1 --2- 172.21.15.72:0/2237766906 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc12409eca0 0x7fc12411a7d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc120010fa0 tx=0x7fc12000e640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.211+0000 7fc119ffb700 1 -- 172.21.15.72:0/2237766906 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc120011650 con 0x7fc12409eca0 2023-10-03T10:18:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.211+0000 7fc119ffb700 1 -- 172.21.15.72:0/2237766906 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1200117b0 con 0x7fc12409eca0 2023-10-03T10:18:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.211+0000 7fc119ffb700 1 -- 172.21.15.72:0/2237766906 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc120011b20 con 0x7fc12409eca0 2023-10-03T10:18:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.211+0000 7fc12b4d0700 1 -- 172.21.15.72:0/2237766906 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c009a70 con 0x7fc12409eca0 2023-10-03T10:18:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.211+0000 7fc12b4d0700 1 -- 172.21.15.72:0/2237766906 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc124071a40 con 0x7fc12409eca0 2023-10-03T10:18:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.212+0000 7fc119ffb700 1 -- 172.21.15.72:0/2237766906 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc120011c80 con 0x7fc12409eca0 2023-10-03T10:18:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.212+0000 7fc12b4d0700 1 -- 172.21.15.72:0/2237766906 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12411df50 con 0x7fc12409eca0 2023-10-03T10:18:29.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.212+0000 7fc119ffb700 1 -- 172.21.15.72:0/2237766906 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc1200425a0 con 0x7fc12409eca0 2023-10-03T10:18:29.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.217+0000 7fc119ffb700 1 -- 172.21.15.72:0/2237766906 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc12411df50 con 0x7fc12409eca0 2023-10-03T10:18:29.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.251+0000 7f094ddf3700 1 Processor -- start 2023-10-03T10:18:29.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.251+0000 7f094ddf3700 1 -- start start 2023-10-03T10:18:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.251+0000 7f094ddf3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f094809e1d0 0x7f0948138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.251+0000 7f094ddf3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0948139170 0x7f094813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.251+0000 7f094ddf3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094809b120 con 0x7f094809d6f0 2023-10-03T10:18:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.251+0000 7f094ddf3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094806b460 con 0x7f0948139170 2023-10-03T10:18:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.251+0000 7f094ddf3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094809a7e0 con 0x7f094809e1d0 2023-10-03T10:18:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.251+0000 7f0946ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f094809e1d0 0x7f0948138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.251+0000 7f0946ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f094809e1d0 0x7f0948138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56564/0 (socket says 172.21.15.72:56564) 2023-10-03T10:18:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.251+0000 7f0946ffd700 1 -- 172.21.15.72:0/1536166655 learned_addr learned my addr 172.21.15.72:0/1536166655 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.251+0000 7f0947fff700 1 --2- 172.21.15.72:0/1536166655 >> v2:172.21.15.72:3300/0 conn(0x7f0948139170 0x7f094813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.252+0000 7f0946ffd700 1 -- 172.21.15.72:0/1536166655 >> v2:172.21.15.72:3300/0 conn(0x7f0948139170 msgr2=0x7f094813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.252+0000 7f0946ffd700 1 --2- 172.21.15.72:0/1536166655 >> v2:172.21.15.72:3300/0 conn(0x7f0948139170 0x7f094813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.252+0000 7f0946ffd700 1 -- 172.21.15.72:0/1536166655 >> v1:172.21.15.72:6789/0 conn(0x7f094809d6f0 legacy=0x7f094809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.252+0000 7f0946ffd700 1 -- 172.21.15.72:0/1536166655 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094809a500 con 0x7f094809e1d0 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.252+0000 7f0946ffd700 1 --2- 172.21.15.72:0/1536166655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f094809e1d0 0x7f0948138c30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f093c009920 tx=0x7f093c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63e496e9d94ecab4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.252+0000 7f09467fc700 1 -- 172.21.15.72:0/1536166655 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c011830 con 0x7f094809e1d0 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.252+0000 7f09467fc700 1 -- 172.21.15.72:0/1536166655 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c011990 con 0x7f094809e1d0 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.252+0000 7f09467fc700 1 -- 172.21.15.72:0/1536166655 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c011d20 con 0x7f094809e1d0 2023-10-03T10:18:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.253+0000 7f094ddf3700 1 -- 172.21.15.72:0/1536166655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f094809e1d0 msgr2=0x7f0948138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.253+0000 7f094ddf3700 1 --2- 172.21.15.72:0/1536166655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f094809e1d0 0x7f0948138c30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f093c009920 tx=0x7f093c009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.253+0000 7f094ddf3700 1 -- 172.21.15.72:0/1536166655 shutdown_connections 2023-10-03T10:18:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.253+0000 7f094ddf3700 1 --2- 172.21.15.72:0/1536166655 >> v2:172.21.15.72:3300/0 conn(0x7f0948139170 0x7f094813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.253+0000 7f094ddf3700 1 --2- 172.21.15.72:0/1536166655 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f094809e1d0 0x7f0948138c30 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.253+0000 7f094ddf3700 1 -- 172.21.15.72:0/1536166655 >> 172.21.15.72:0/1536166655 conn(0x7f0948066f50 msgr2=0x7f094809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.253+0000 7f094ddf3700 1 -- 172.21.15.72:0/1536166655 shutdown_connections 2023-10-03T10:18:29.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.253+0000 7f094ddf3700 1 -- 172.21.15.72:0/1536166655 wait complete. 2023-10-03T10:18:29.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.254+0000 7f094ddf3700 1 Processor -- start 2023-10-03T10:18:29.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.255+0000 7f094ddf3700 1 -- start start 2023-10-03T10:18:29.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.255+0000 7f094ddf3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f094809d6f0 0x7f09481209f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.255+0000 7f094ddf3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094809e1d0 0x7f0948120f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.255+0000 7f094ddf3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0948139170 0x7f0948121470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.255+0000 7f094ddf3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948122780 con 0x7f094809e1d0 2023-10-03T10:18:29.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.255+0000 7f094ddf3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0948124730 con 0x7f094809d6f0 2023-10-03T10:18:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.255+0000 7f094ddf3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0948124230 con 0x7f0948139170 2023-10-03T10:18:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.255+0000 7f09477fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f094809d6f0 0x7f09481209f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.255+0000 7f09477fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f094809d6f0 0x7f09481209f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56570/0 (socket says 172.21.15.72:56570) 2023-10-03T10:18:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.255+0000 7f09477fe700 1 -- 172.21.15.72:0/3833968714 learned_addr learned my addr 172.21.15.72:0/3833968714 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.256+0000 7f0947fff700 1 --2- 172.21.15.72:0/3833968714 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0948139170 0x7f0948121470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.256+0000 7f0946ffd700 1 --2- 172.21.15.72:0/3833968714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094809e1d0 0x7f0948120f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.256+0000 7f09477fe700 1 -- 172.21.15.72:0/3833968714 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0948139170 msgr2=0x7f0948121470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.256+0000 7f09477fe700 1 --2- 172.21.15.72:0/3833968714 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0948139170 0x7f0948121470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.256+0000 7f09477fe700 1 -- 172.21.15.72:0/3833968714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094809e1d0 msgr2=0x7f0948120f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.256+0000 7f09477fe700 1 --2- 172.21.15.72:0/3833968714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094809e1d0 0x7f0948120f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.256+0000 7f09477fe700 1 -- 172.21.15.72:0/3833968714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c009550 con 0x7f094809d6f0 2023-10-03T10:18:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.256+0000 7f09477fe700 1 --2- 172.21.15.72:0/3833968714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f094809d6f0 0x7f09481209f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f093800c4e0 tx=0x7f093800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.256+0000 7f092ffff700 1 -- 172.21.15.72:0/3833968714 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09380052d0 con 0x7f094809d6f0 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.256+0000 7f092ffff700 1 -- 172.21.15.72:0/3833968714 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0938005430 con 0x7f094809d6f0 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.256+0000 7f094ddf3700 1 -- 172.21.15.72:0/3833968714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0948123ca0 con 0x7f094809d6f0 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.256+0000 7f092ffff700 1 -- 172.21.15.72:0/3833968714 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09380038c0 con 0x7f094809d6f0 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.256+0000 7f094ddf3700 1 -- 172.21.15.72:0/3833968714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0948122e00 con 0x7f094809d6f0 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.257+0000 7f092ffff700 1 -- 172.21.15.72:0/3833968714 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0938003a20 con 0x7f094809d6f0 2023-10-03T10:18:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.257+0000 7f094ddf3700 1 -- 172.21.15.72:0/3833968714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0948074ea0 con 0x7f094809d6f0 2023-10-03T10:18:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.258+0000 7f092ffff700 1 -- 172.21.15.72:0/3833968714 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f093803ead0 con 0x7f094809d6f0 2023-10-03T10:18:29.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.267+0000 7f092ffff700 1 -- 172.21.15.72:0/3833968714 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0938019c50 con 0x7f094809d6f0 2023-10-03T10:18:29.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.270+0000 7f7ff359e700 1 Processor -- start 2023-10-03T10:18:29.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.270+0000 7f7ff359e700 1 -- start start 2023-10-03T10:18:29.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.271+0000 7f7ff359e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff409d8d0 0x7f7ff409dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.271+0000 7f7ff359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff409e610 0x7f7ff4130b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.271+0000 7f7ff359e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff409b6e0 con 0x7f7ff409e1e0 2023-10-03T10:18:29.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.271+0000 7f7ff359e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff409b470 con 0x7f7ff409e610 2023-10-03T10:18:29.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.271+0000 7f7ff359e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff409eb80 con 0x7f7ff409d8d0 2023-10-03T10:18:29.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.271+0000 7f7ff1d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7ff409e1e0 0x7f7ff4130460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51632/0 (socket says 172.21.15.72:51632) 2023-10-03T10:18:29.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.271+0000 7f7ff1d9b700 1 -- 172.21.15.72:0/2250240330 learned_addr learned my addr 172.21.15.72:0/2250240330 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:29.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.271+0000 7f7ff2d9d700 1 --2- 172.21.15.72:0/2250240330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff409e610 0x7f7ff4130b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.271+0000 7f7ff259c700 1 --2- 172.21.15.72:0/2250240330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff409d8d0 0x7f7ff409dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.272+0000 7f7ff159a700 1 -- 172.21.15.72:0/2250240330 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189664291 0 0) 0x7f7ff409b6e0 con 0x7f7ff409e1e0 2023-10-03T10:18:29.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.272+0000 7f7ff159a700 1 -- 172.21.15.72:0/2250240330 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fdc0035b0 con 0x7f7ff409e1e0 2023-10-03T10:18:29.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.272+0000 7f7ff2d9d700 1 -- 172.21.15.72:0/2250240330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff409d8d0 msgr2=0x7f7ff409dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.272+0000 7f7ff2d9d700 1 --2- 172.21.15.72:0/2250240330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff409d8d0 0x7f7ff409dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.272+0000 7f7ff2d9d700 1 -- 172.21.15.72:0/2250240330 >> v1:172.21.15.72:6789/0 conn(0x7f7ff409e1e0 legacy=0x7f7ff4130460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.272+0000 7f7ff2d9d700 1 -- 172.21.15.72:0/2250240330 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff409ae00 con 0x7f7ff409e610 2023-10-03T10:18:29.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.272+0000 7f7ff2d9d700 1 --2- 172.21.15.72:0/2250240330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff409e610 0x7f7ff4130b70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009dc0 tx=0x7f7fec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fab8a9eaf873a2a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.272+0000 7f7ff159a700 1 -- 172.21.15.72:0/2250240330 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec00e070 con 0x7f7ff409e610 2023-10-03T10:18:29.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.272+0000 7f7ff159a700 1 -- 172.21.15.72:0/2250240330 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec00bb20 con 0x7f7ff409e610 2023-10-03T10:18:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.272+0000 7f7ff159a700 1 -- 172.21.15.72:0/2250240330 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec012430 con 0x7f7ff409e610 2023-10-03T10:18:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.273+0000 7f7ff359e700 1 -- 172.21.15.72:0/2250240330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff409e610 msgr2=0x7f7ff4130b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.273+0000 7f7ff359e700 1 --2- 172.21.15.72:0/2250240330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff409e610 0x7f7ff4130b70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009dc0 tx=0x7f7fec00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.273+0000 7f7ff359e700 1 -- 172.21.15.72:0/2250240330 shutdown_connections 2023-10-03T10:18:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.273+0000 7f7ff359e700 1 --2- 172.21.15.72:0/2250240330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff409e610 0x7f7ff4130b70 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.273+0000 7f7ff359e700 1 --2- 172.21.15.72:0/2250240330 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff409d8d0 0x7f7ff409dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.273+0000 7f7ff359e700 1 -- 172.21.15.72:0/2250240330 >> 172.21.15.72:0/2250240330 conn(0x7f7ff40a2e20 msgr2=0x7f7ff40a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.273+0000 7f7ff359e700 1 -- 172.21.15.72:0/2250240330 shutdown_connections 2023-10-03T10:18:29.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.273+0000 7f7ff359e700 1 -- 172.21.15.72:0/2250240330 wait complete. 2023-10-03T10:18:29.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.274+0000 7f7ff359e700 1 Processor -- start 2023-10-03T10:18:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.274+0000 7f7ff359e700 1 -- start start 2023-10-03T10:18:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.275+0000 7f7ff359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff409d8d0 0x7f7ff411ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.275+0000 7f7ff359e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff409e1e0 0x7f7ff411f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.275+0000 7f7ff359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff409e610 0x7f7ff411f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.275+0000 7f7ff359e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff41225c0 con 0x7f7ff409d8d0 2023-10-03T10:18:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.275+0000 7f7ff359e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff41208f0 con 0x7f7ff409e610 2023-10-03T10:18:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.275+0000 7f7ff359e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff4121780 con 0x7f7ff409e1e0 2023-10-03T10:18:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.275+0000 7f7ff1d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff409e1e0 0x7f7ff411f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.275+0000 7f7ff1d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff409e1e0 0x7f7ff411f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49704/0 (socket says 172.21.15.72:49704) 2023-10-03T10:18:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.275+0000 7f7ff1d9b700 1 -- 172.21.15.72:0/2721094578 learned_addr learned my addr 172.21.15.72:0/2721094578 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:29.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.275+0000 7f7ff2d9d700 1 --2- 172.21.15.72:0/2721094578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff409e610 0x7f7ff411f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.275+0000 7f7ff259c700 1 --2- 172.21.15.72:0/2721094578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff409d8d0 0x7f7ff411ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.276+0000 7f7ff2d9d700 1 -- 172.21.15.72:0/2721094578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff409e1e0 msgr2=0x7f7ff411f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.276+0000 7f7ff2d9d700 1 --2- 172.21.15.72:0/2721094578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff409e1e0 0x7f7ff411f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.276+0000 7f7ff2d9d700 1 -- 172.21.15.72:0/2721094578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff409d8d0 msgr2=0x7f7ff411ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.276+0000 7f7ff2d9d700 1 --2- 172.21.15.72:0/2721094578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff409d8d0 0x7f7ff411ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.276+0000 7f7ff2d9d700 1 -- 172.21.15.72:0/2721094578 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec009a70 con 0x7f7ff409e610 2023-10-03T10:18:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.276+0000 7f7ff1d9b700 1 --2- 172.21.15.72:0/2721094578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff409e1e0 0x7f7ff411f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.276+0000 7f7ff2d9d700 1 --2- 172.21.15.72:0/2721094578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff409e610 0x7f7ff411f760 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7fec016000 tx=0x7f7fec004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.276+0000 7f7fe2ffd700 1 -- 172.21.15.72:0/2721094578 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec012430 con 0x7f7ff409e610 2023-10-03T10:18:29.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.276+0000 7f7fe2ffd700 1 -- 172.21.15.72:0/2721094578 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec020070 con 0x7f7ff409e610 2023-10-03T10:18:29.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.276+0000 7f7ff359e700 1 -- 172.21.15.72:0/2721094578 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff4122260 con 0x7f7ff409e610 2023-10-03T10:18:29.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.276+0000 7f7ff359e700 1 -- 172.21.15.72:0/2721094578 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff4121f90 con 0x7f7ff409e610 2023-10-03T10:18:29.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.276+0000 7f7fe2ffd700 1 -- 172.21.15.72:0/2721094578 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec004280 con 0x7f7ff409e610 2023-10-03T10:18:29.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.277+0000 7f7fe2ffd700 1 -- 172.21.15.72:0/2721094578 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7fec0043e0 con 0x7f7ff409e610 2023-10-03T10:18:29.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.277+0000 7f7ff359e700 1 -- 172.21.15.72:0/2721094578 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd80052e0 con 0x7f7ff409e610 2023-10-03T10:18:29.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.278+0000 7f7fe2ffd700 1 -- 172.21.15.72:0/2721094578 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7fec022070 con 0x7f7ff409e610 2023-10-03T10:18:29.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.286+0000 7f7fe2ffd700 1 -- 172.21.15.72:0/2721094578 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7fec012e40 con 0x7f7ff409e610 2023-10-03T10:18:29.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.415+0000 7f7ffe7e4700 1 -- 172.21.15.72:0/771277282 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7ff8074ea0 con 0x7f7ff809e000 2023-10-03T10:18:29.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.416+0000 7f7ff4ff9700 1 -- 172.21.15.72:0/771277282 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7fec010b70 con 0x7f7ff809e000 2023-10-03T10:18:29.416 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:29.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.418+0000 7f7ffe7e4700 1 -- 172.21.15.72:0/771277282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff809e000 msgr2=0x7f7ff8122aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.418+0000 7f7ffe7e4700 1 --2- 172.21.15.72:0/771277282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff809e000 0x7f7ff8122aa0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7ff806e510 tx=0x7f7fec004750 comp rx=0 tx=0).stop 2023-10-03T10:18:29.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.418+0000 7f7ffe7e4700 1 -- 172.21.15.72:0/771277282 shutdown_connections 2023-10-03T10:18:29.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.418+0000 7f7ffe7e4700 1 --2- 172.21.15.72:0/771277282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff809e410 0x7f7ff8122fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.418+0000 7f7ffe7e4700 1 --2- 172.21.15.72:0/771277282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff809d6f0 0x7f7ff8122560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.418+0000 7f7ffe7e4700 1 --2- 172.21.15.72:0/771277282 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff809e000 0x7f7ff8122aa0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.418+0000 7f7ffe7e4700 1 -- 172.21.15.72:0/771277282 >> 172.21.15.72:0/771277282 conn(0x7f7ff8066f50 msgr2=0x7f7ff80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.418+0000 7f7ffe7e4700 1 -- 172.21.15.72:0/771277282 shutdown_connections 2023-10-03T10:18:29.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.418+0000 7f7ffe7e4700 1 -- 172.21.15.72:0/771277282 wait complete. 2023-10-03T10:18:29.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.428+0000 7fc12b4d0700 1 -- 172.21.15.72:0/2237766906 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc12412e5f0 con 0x7fc12409eca0 2023-10-03T10:18:29.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.428+0000 7fc119ffb700 1 -- 172.21.15.72:0/2237766906 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc12001e020 con 0x7fc12409eca0 2023-10-03T10:18:29.429 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:29.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:29.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.431+0000 7fc12b4d0700 1 -- 172.21.15.72:0/2237766906 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc12409eca0 msgr2=0x7fc12411a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.431+0000 7fc12b4d0700 1 --2- 172.21.15.72:0/2237766906 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc12409eca0 0x7fc12411a7d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc120010fa0 tx=0x7fc12000e640 comp rx=0 tx=0).stop 2023-10-03T10:18:29.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.431+0000 7fc12b4d0700 1 -- 172.21.15.72:0/2237766906 shutdown_connections 2023-10-03T10:18:29.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.431+0000 7fc12b4d0700 1 --2- 172.21.15.72:0/2237766906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc124130e70 0x7fc12411b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.431+0000 7fc12b4d0700 1 --2- 172.21.15.72:0/2237766906 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc12409eca0 0x7fc12411a7d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.431+0000 7fc12b4d0700 1 --2- 172.21.15.72:0/2237766906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc124130560 0x7fc12411ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.431+0000 7fc12b4d0700 1 -- 172.21.15.72:0/2237766906 >> 172.21.15.72:0/2237766906 conn(0x7fc1240a2aa0 msgr2=0x7fc12412d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.431+0000 7fc12b4d0700 1 -- 172.21.15.72:0/2237766906 shutdown_connections 2023-10-03T10:18:29.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.431+0000 7fc12b4d0700 1 -- 172.21.15.72:0/2237766906 wait complete. 2023-10-03T10:18:29.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:29.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.466+0000 7f094ddf3700 1 -- 172.21.15.72:0/3833968714 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f094806c360 con 0x7f094809d6f0 2023-10-03T10:18:29.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.466+0000 7f092ffff700 1 -- 172.21.15.72:0/3833968714 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f09380102e0 con 0x7f094809d6f0 2023-10-03T10:18:29.467 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:29.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.468+0000 7f094ddf3700 1 -- 172.21.15.72:0/3833968714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f094809d6f0 msgr2=0x7f09481209f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.468+0000 7f094ddf3700 1 --2- 172.21.15.72:0/3833968714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f094809d6f0 0x7f09481209f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f093800c4e0 tx=0x7f093800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.468+0000 7f094ddf3700 1 -- 172.21.15.72:0/3833968714 shutdown_connections 2023-10-03T10:18:29.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.468+0000 7f094ddf3700 1 --2- 172.21.15.72:0/3833968714 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0948139170 0x7f0948121470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.468+0000 7f094ddf3700 1 --2- 172.21.15.72:0/3833968714 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f094809d6f0 0x7f09481209f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.468+0000 7f094ddf3700 1 --2- 172.21.15.72:0/3833968714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f094809e1d0 0x7f0948120f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.468+0000 7f094ddf3700 1 -- 172.21.15.72:0/3833968714 >> 172.21.15.72:0/3833968714 conn(0x7f0948066f50 msgr2=0x7f094809b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.468+0000 7f094ddf3700 1 -- 172.21.15.72:0/3833968714 shutdown_connections 2023-10-03T10:18:29.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.468+0000 7f094ddf3700 1 -- 172.21.15.72:0/3833968714 wait complete. 2023-10-03T10:18:29.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:29.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.482+0000 7f7ff359e700 1 -- 172.21.15.72:0/2721094578 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7fd8005590 con 0x7f7ff409e610 2023-10-03T10:18:29.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.482+0000 7f7fe2ffd700 1 -- 172.21.15.72:0/2721094578 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7fec026bd0 con 0x7f7ff409e610 2023-10-03T10:18:29.483 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:29.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.484+0000 7f7ff359e700 1 -- 172.21.15.72:0/2721094578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff409e610 msgr2=0x7f7ff411f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.484+0000 7f7ff359e700 1 --2- 172.21.15.72:0/2721094578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff409e610 0x7f7ff411f760 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7fec016000 tx=0x7f7fec004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.484+0000 7f7ff359e700 1 -- 172.21.15.72:0/2721094578 shutdown_connections 2023-10-03T10:18:29.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.484+0000 7f7ff359e700 1 --2- 172.21.15.72:0/2721094578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ff409d8d0 0x7f7ff411ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.484+0000 7f7ff359e700 1 --2- 172.21.15.72:0/2721094578 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ff409e610 0x7f7ff411f760 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.484+0000 7f7ff359e700 1 --2- 172.21.15.72:0/2721094578 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7ff409e1e0 0x7f7ff411f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.484+0000 7f7ff359e700 1 -- 172.21.15.72:0/2721094578 >> 172.21.15.72:0/2721094578 conn(0x7f7ff40a2e20 msgr2=0x7f7ff4130900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.484+0000 7f7ff359e700 1 -- 172.21.15.72:0/2721094578 shutdown_connections 2023-10-03T10:18:29.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:29.484+0000 7f7ff359e700 1 -- 172.21.15.72:0/2721094578 wait complete. 2023-10-03T10:18:29.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:30.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:30.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:30.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:30.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:30.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.575+0000 7f8d3c7fe700 1 Processor -- start 2023-10-03T10:18:30.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.575+0000 7f8d3c7fe700 1 -- start start 2023-10-03T10:18:30.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.576+0000 7f8d3c7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d3409d6f0 0x7f8d3409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.576+0000 7f8d3c7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d3409e000 0x7f8d34130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.576+0000 7f8d3c7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d3409e410 0x7f8d34130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.576+0000 7f8d3c7fe700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d3409f520 con 0x7f8d3409e000 2023-10-03T10:18:30.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.576+0000 7f8d3c7fe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3409f130 con 0x7f8d3409e410 2023-10-03T10:18:30.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.576+0000 7f8d3c7fe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3409e930 con 0x7f8d3409d6f0 2023-10-03T10:18:30.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.576+0000 7f8d3a59a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d3409d6f0 0x7f8d3409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.576+0000 7f8d3a59a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d3409d6f0 0x7f8d3409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49718/0 (socket says 172.21.15.72:49718) 2023-10-03T10:18:30.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.576+0000 7f8d3a59a700 1 -- 172.21.15.72:0/3376853044 learned_addr learned my addr 172.21.15.72:0/3376853044 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:30.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.576+0000 7f8d39d99700 1 --2- 172.21.15.72:0/3376853044 >> v2:172.21.15.72:3300/0 conn(0x7f8d3409e000 0x7f8d34130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.576+0000 7f8d3ad9b700 1 --2- 172.21.15.72:0/3376853044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d3409e410 0x7f8d34130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.577+0000 7f8d3a59a700 1 -- 172.21.15.72:0/3376853044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d3409e410 msgr2=0x7f8d34130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.577+0000 7f8d3a59a700 1 --2- 172.21.15.72:0/3376853044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d3409e410 0x7f8d34130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.577+0000 7f8d3a59a700 1 -- 172.21.15.72:0/3376853044 >> v2:172.21.15.72:3300/0 conn(0x7f8d3409e000 msgr2=0x7f8d34130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.577+0000 7f8d3a59a700 1 --2- 172.21.15.72:0/3376853044 >> v2:172.21.15.72:3300/0 conn(0x7f8d3409e000 0x7f8d34130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.577+0000 7f8d3a59a700 1 -- 172.21.15.72:0/3376853044 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3409b2d0 con 0x7f8d3409d6f0 2023-10-03T10:18:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.577+0000 7f8d39d99700 1 --2- 172.21.15.72:0/3376853044 >> v2:172.21.15.72:3300/0 conn(0x7f8d3409e000 0x7f8d34130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.577+0000 7f8d3a59a700 1 --2- 172.21.15.72:0/3376853044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d3409d6f0 0x7f8d3409dac0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009920 tx=0x7f8d30009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6104a2f76abd2c28 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.577+0000 7f8d39598700 1 -- 172.21.15.72:0/3376853044 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d30011830 con 0x7f8d3409d6f0 2023-10-03T10:18:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.577+0000 7f8d39598700 1 -- 172.21.15.72:0/3376853044 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d30011990 con 0x7f8d3409d6f0 2023-10-03T10:18:30.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.577+0000 7f8d39598700 1 -- 172.21.15.72:0/3376853044 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d30011d20 con 0x7f8d3409d6f0 2023-10-03T10:18:30.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.578+0000 7f8d3c7fe700 1 -- 172.21.15.72:0/3376853044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d3409d6f0 msgr2=0x7f8d3409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.578+0000 7f8d3c7fe700 1 --2- 172.21.15.72:0/3376853044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d3409d6f0 0x7f8d3409dac0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009920 tx=0x7f8d30009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:30.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.578+0000 7f8d3c7fe700 1 -- 172.21.15.72:0/3376853044 shutdown_connections 2023-10-03T10:18:30.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.578+0000 7f8d3c7fe700 1 --2- 172.21.15.72:0/3376853044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d3409e410 0x7f8d34130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.578+0000 7f8d3c7fe700 1 --2- 172.21.15.72:0/3376853044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d3409d6f0 0x7f8d3409dac0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.578+0000 7f8d3c7fe700 1 --2- 172.21.15.72:0/3376853044 >> v2:172.21.15.72:3300/0 conn(0x7f8d3409e000 0x7f8d34130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.578+0000 7f8d3c7fe700 1 -- 172.21.15.72:0/3376853044 >> 172.21.15.72:0/3376853044 conn(0x7f8d34066f50 msgr2=0x7f8d3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.578+0000 7f8d3c7fe700 1 -- 172.21.15.72:0/3376853044 shutdown_connections 2023-10-03T10:18:30.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.578+0000 7f8d3c7fe700 1 -- 172.21.15.72:0/3376853044 wait complete. 2023-10-03T10:18:30.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.579+0000 7f8d3c7fe700 1 Processor -- start 2023-10-03T10:18:30.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.580+0000 7f8d3c7fe700 1 -- start start 2023-10-03T10:18:30.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.580+0000 7f8d3c7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d3409d6f0 0x7f8d341222d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.580+0000 7f8d3c7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d3409e000 0x7f8d34122810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.580+0000 7f8d3c7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d3409e410 0x7f8d34122d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.580+0000 7f8d3c7fe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d341254d0 con 0x7f8d3409d6f0 2023-10-03T10:18:30.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.580+0000 7f8d3c7fe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d34123ee0 con 0x7f8d3409e000 2023-10-03T10:18:30.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.580+0000 7f8d3c7fe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d34124770 con 0x7f8d3409e410 2023-10-03T10:18:30.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.580+0000 7f8d3a59a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d3409d6f0 0x7f8d341222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.580+0000 7f8d3a59a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d3409d6f0 0x7f8d341222d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54380/0 (socket says 172.21.15.72:54380) 2023-10-03T10:18:30.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.580+0000 7f8d3a59a700 1 -- 172.21.15.72:0/2255035544 learned_addr learned my addr 172.21.15.72:0/2255035544 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:30.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.580+0000 7f8d3ad9b700 1 --2- 172.21.15.72:0/2255035544 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d3409e410 0x7f8d34122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.581+0000 7f8d39d99700 1 --2- 172.21.15.72:0/2255035544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d3409e000 0x7f8d34122810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.581+0000 7f8d3a59a700 1 -- 172.21.15.72:0/2255035544 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d3409e410 msgr2=0x7f8d34122d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.581+0000 7f8d3a59a700 1 --2- 172.21.15.72:0/2255035544 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d3409e410 0x7f8d34122d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.581+0000 7f8d3a59a700 1 -- 172.21.15.72:0/2255035544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d3409e000 msgr2=0x7f8d34122810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.581+0000 7f8d3a59a700 1 --2- 172.21.15.72:0/2255035544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d3409e000 0x7f8d34122810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.581+0000 7f8d3a59a700 1 -- 172.21.15.72:0/2255035544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d240094a0 con 0x7f8d3409d6f0 2023-10-03T10:18:30.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.581+0000 7f8d3a59a700 1 --2- 172.21.15.72:0/2255035544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d3409d6f0 0x7f8d341222d0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009c70 tx=0x7f8d30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.581+0000 7f8d2affd700 1 -- 172.21.15.72:0/2255035544 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d30004380 con 0x7f8d3409d6f0 2023-10-03T10:18:30.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.581+0000 7f8d2affd700 1 -- 172.21.15.72:0/2255035544 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3001f070 con 0x7f8d3409d6f0 2023-10-03T10:18:30.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.581+0000 7f8d2affd700 1 -- 172.21.15.72:0/2255035544 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d300036a0 con 0x7f8d3409d6f0 2023-10-03T10:18:30.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.581+0000 7f8d3c7fe700 1 -- 172.21.15.72:0/2255035544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d30009550 con 0x7f8d3409d6f0 2023-10-03T10:18:30.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.581+0000 7f8d3c7fe700 1 -- 172.21.15.72:0/2255035544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3409c700 con 0x7f8d3409d6f0 2023-10-03T10:18:30.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.582+0000 7f8d2affd700 1 -- 172.21.15.72:0/2255035544 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d30021030 con 0x7f8d3409d6f0 2023-10-03T10:18:30.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.582+0000 7f8d3c7fe700 1 -- 172.21.15.72:0/2255035544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d34074ea0 con 0x7f8d3409d6f0 2023-10-03T10:18:30.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.583+0000 7f8d2affd700 1 -- 172.21.15.72:0/2255035544 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8d30040890 con 0x7f8d3409d6f0 2023-10-03T10:18:30.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.591+0000 7f8d2affd700 1 -- 172.21.15.72:0/2255035544 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d300199a0 con 0x7f8d3409d6f0 2023-10-03T10:18:30.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.623+0000 7f5502688700 1 Processor -- start 2023-10-03T10:18:30.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.623+0000 7f5502688700 1 -- start start 2023-10-03T10:18:30.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f5502688700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54fc09e1d0 0x7f54fc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f5502688700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54fc139170 0x7f54fc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f5502688700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54fc09b120 con 0x7f54fc09d6f0 2023-10-03T10:18:30.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f5502688700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc06b460 con 0x7f54fc139170 2023-10-03T10:18:30.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f5502688700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc09a7e0 con 0x7f54fc09e1d0 2023-10-03T10:18:30.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54fc09e1d0 0x7f54fc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54fc09e1d0 0x7f54fc138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49736/0 (socket says 172.21.15.72:49736) 2023-10-03T10:18:30.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f54fb7fe700 1 -- 172.21.15.72:0/4292284760 learned_addr learned my addr 172.21.15.72:0/4292284760 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:30.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f54fbfff700 1 --1- 172.21.15.72:0/4292284760 >> v1:172.21.15.72:6789/0 conn(0x7f54fc09d6f0 0x7f54fc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51642/0 (socket says 172.21.15.72:51642) 2023-10-03T10:18:30.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f5500c25700 1 --2- 172.21.15.72:0/4292284760 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54fc139170 0x7f54fc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f5500c25700 1 -- 172.21.15.72:0/4292284760 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54fc09e1d0 msgr2=0x7f54fc138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f5500c25700 1 --2- 172.21.15.72:0/4292284760 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54fc09e1d0 0x7f54fc138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f5500c25700 1 -- 172.21.15.72:0/4292284760 >> v1:172.21.15.72:6789/0 conn(0x7f54fc09d6f0 legacy=0x7f54fc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f5500c25700 1 -- 172.21.15.72:0/4292284760 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc09a500 con 0x7f54fc139170 2023-10-03T10:18:30.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f54fb7fe700 1 --2- 172.21.15.72:0/4292284760 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54fc09e1d0 0x7f54fc138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.624+0000 7f5500c25700 1 --2- 172.21.15.72:0/4292284760 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54fc139170 0x7f54fc13b550 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009dc0 tx=0x7f54f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd6c6dbbdd824f8c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.625+0000 7f54faffd700 1 -- 172.21.15.72:0/4292284760 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f400e070 con 0x7f54fc139170 2023-10-03T10:18:30.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.625+0000 7f54faffd700 1 -- 172.21.15.72:0/4292284760 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f400bb20 con 0x7f54fc139170 2023-10-03T10:18:30.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.625+0000 7f54faffd700 1 -- 172.21.15.72:0/4292284760 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4012430 con 0x7f54fc139170 2023-10-03T10:18:30.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.625+0000 7f5502688700 1 -- 172.21.15.72:0/4292284760 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54fc139170 msgr2=0x7f54fc13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.625+0000 7f5502688700 1 --2- 172.21.15.72:0/4292284760 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54fc139170 0x7f54fc13b550 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009dc0 tx=0x7f54f400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:30.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.625+0000 7f5502688700 1 -- 172.21.15.72:0/4292284760 shutdown_connections 2023-10-03T10:18:30.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.625+0000 7f5502688700 1 --2- 172.21.15.72:0/4292284760 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54fc139170 0x7f54fc13b550 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.625+0000 7f5502688700 1 --2- 172.21.15.72:0/4292284760 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54fc09e1d0 0x7f54fc138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.625+0000 7f5502688700 1 -- 172.21.15.72:0/4292284760 >> 172.21.15.72:0/4292284760 conn(0x7f54fc066f50 msgr2=0x7f54fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.625+0000 7f5502688700 1 -- 172.21.15.72:0/4292284760 shutdown_connections 2023-10-03T10:18:30.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.625+0000 7f5502688700 1 -- 172.21.15.72:0/4292284760 wait complete. 2023-10-03T10:18:30.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.627+0000 7f5502688700 1 Processor -- start 2023-10-03T10:18:30.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.627+0000 7f5502688700 1 -- start start 2023-10-03T10:18:30.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f5502688700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54fc09d6f0 0x7f54fc11e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f5502688700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54fc09e1d0 0x7f54fc11ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f5502688700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54fc139170 0x7f54fc11f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f5502688700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0a1990 con 0x7f54fc139170 2023-10-03T10:18:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f5502688700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc120490 con 0x7f54fc09d6f0 2023-10-03T10:18:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f5502688700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc121fb0 con 0x7f54fc09e1d0 2023-10-03T10:18:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54fc09e1d0 0x7f54fc11ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f54fb7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54fc09e1d0 0x7f54fc11ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49750/0 (socket says 172.21.15.72:49750) 2023-10-03T10:18:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f54fb7fe700 1 -- 172.21.15.72:0/3743909281 learned_addr learned my addr 172.21.15.72:0/3743909281 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f5500c25700 1 --2- 172.21.15.72:0/3743909281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54fc139170 0x7f54fc11f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f54fbfff700 1 --2- 172.21.15.72:0/3743909281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54fc09d6f0 0x7f54fc11e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f5500c25700 1 -- 172.21.15.72:0/3743909281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54fc09e1d0 msgr2=0x7f54fc11ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f5500c25700 1 --2- 172.21.15.72:0/3743909281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54fc09e1d0 0x7f54fc11ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f5500c25700 1 -- 172.21.15.72:0/3743909281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54fc09d6f0 msgr2=0x7f54fc11e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f5500c25700 1 --2- 172.21.15.72:0/3743909281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54fc09d6f0 0x7f54fc11e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f5500c25700 1 -- 172.21.15.72:0/3743909281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f0009550 con 0x7f54fc139170 2023-10-03T10:18:30.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f54fb7fe700 1 --2- 172.21.15.72:0/3743909281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54fc09e1d0 0x7f54fc11ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.628+0000 7f5500c25700 1 --2- 172.21.15.72:0/3743909281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54fc139170 0x7f54fc11f360 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009dc0 tx=0x7f54f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.629+0000 7f54f8ff9700 1 -- 172.21.15.72:0/3743909281 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4004880 con 0x7f54fc139170 2023-10-03T10:18:30.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.629+0000 7f54f8ff9700 1 -- 172.21.15.72:0/3743909281 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f4020070 con 0x7f54fc139170 2023-10-03T10:18:30.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.629+0000 7f5502688700 1 -- 172.21.15.72:0/3743909281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f4009a70 con 0x7f54fc139170 2023-10-03T10:18:30.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.629+0000 7f54f8ff9700 1 -- 172.21.15.72:0/3743909281 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f40276c0 con 0x7f54fc139170 2023-10-03T10:18:30.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.629+0000 7f5502688700 1 -- 172.21.15.72:0/3743909281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc120b70 con 0x7f54fc139170 2023-10-03T10:18:30.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.630+0000 7f54f8ff9700 1 -- 172.21.15.72:0/3743909281 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f54f4012430 con 0x7f54fc139170 2023-10-03T10:18:30.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.630+0000 7f5502688700 1 -- 172.21.15.72:0/3743909281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54fc121df0 con 0x7f54fc139170 2023-10-03T10:18:30.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.630+0000 7f54f8ff9700 1 -- 172.21.15.72:0/3743909281 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f54f4022070 con 0x7f54fc139170 2023-10-03T10:18:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.638+0000 7f54f8ff9700 1 -- 172.21.15.72:0/3743909281 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54f4046060 con 0x7f54fc139170 2023-10-03T10:18:30.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.656+0000 7f774401b700 1 Processor -- start 2023-10-03T10:18:30.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.656+0000 7f774401b700 1 -- start start 2023-10-03T10:18:30.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.657+0000 7f774401b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f773c06a770 0x7f773c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.657+0000 7f774401b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f773c131d10 0x7f773c139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.657+0000 7f774401b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c09ece0 con 0x7f773c06b080 2023-10-03T10:18:30.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.657+0000 7f774401b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c09e760 con 0x7f773c131d10 2023-10-03T10:18:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.657+0000 7f774401b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f773c09e040 con 0x7f773c06a770 2023-10-03T10:18:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.657+0000 7f7741db7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f773c06a770 0x7f773c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.657+0000 7f77425b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f773c131d10 0x7f773c139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.657+0000 7f7741db7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f773c06a770 0x7f773c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49766/0 (socket says 172.21.15.72:49766) 2023-10-03T10:18:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.657+0000 7f7741db7700 1 -- 172.21.15.72:0/670900798 learned_addr learned my addr 172.21.15.72:0/670900798 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.657+0000 7f77425b8700 1 -- 172.21.15.72:0/670900798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f773c06a770 msgr2=0x7f773c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.657+0000 7f77425b8700 1 --2- 172.21.15.72:0/670900798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f773c06a770 0x7f773c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.657+0000 7f77425b8700 1 -- 172.21.15.72:0/670900798 >> v1:172.21.15.72:6789/0 conn(0x7f773c06b080 legacy=0x7f773c131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.657+0000 7f77425b8700 1 -- 172.21.15.72:0/670900798 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c09f630 con 0x7f773c131d10 2023-10-03T10:18:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.657+0000 7f7741db7700 1 --2- 172.21.15.72:0/670900798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f773c06a770 0x7f773c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.658+0000 7f77425b8700 1 --2- 172.21.15.72:0/670900798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f773c131d10 0x7f773c139860 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7734009dc0 tx=0x7f773400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b284647359cadbe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.658+0000 7f7740db5700 1 -- 172.21.15.72:0/670900798 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773400e070 con 0x7f773c131d10 2023-10-03T10:18:30.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.658+0000 7f7740db5700 1 -- 172.21.15.72:0/670900798 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773400bae0 con 0x7f773c131d10 2023-10-03T10:18:30.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.658+0000 7f7740db5700 1 -- 172.21.15.72:0/670900798 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773400be90 con 0x7f773c131d10 2023-10-03T10:18:30.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.659+0000 7f774401b700 1 -- 172.21.15.72:0/670900798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f773c131d10 msgr2=0x7f773c139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.659+0000 7f774401b700 1 --2- 172.21.15.72:0/670900798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f773c131d10 0x7f773c139860 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7734009dc0 tx=0x7f773400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:30.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.660+0000 7f774401b700 1 -- 172.21.15.72:0/670900798 shutdown_connections 2023-10-03T10:18:30.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.660+0000 7f774401b700 1 --2- 172.21.15.72:0/670900798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f773c131d10 0x7f773c139860 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.660+0000 7f774401b700 1 --2- 172.21.15.72:0/670900798 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f773c06a770 0x7f773c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.660+0000 7f774401b700 1 -- 172.21.15.72:0/670900798 >> 172.21.15.72:0/670900798 conn(0x7f773c066f50 msgr2=0x7f773c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.660+0000 7f774401b700 1 -- 172.21.15.72:0/670900798 shutdown_connections 2023-10-03T10:18:30.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.660+0000 7f774401b700 1 -- 172.21.15.72:0/670900798 wait complete. 2023-10-03T10:18:30.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.661+0000 7f774401b700 1 Processor -- start 2023-10-03T10:18:30.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.661+0000 7f774401b700 1 -- start start 2023-10-03T10:18:30.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.661+0000 7f774401b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f773c06a770 0x7f773c11d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.661+0000 7f774401b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f773c06b080 0x7f773c11d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.661+0000 7f774401b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f773c131d10 0x7f773c1c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.661+0000 7f774401b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c11efa0 con 0x7f773c06b080 2023-10-03T10:18:30.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.661+0000 7f774401b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c11ccd0 con 0x7f773c131d10 2023-10-03T10:18:30.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.661+0000 7f774401b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f773c11fba0 con 0x7f773c06a770 2023-10-03T10:18:30.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.661+0000 7f7741db7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f773c06a770 0x7f773c11d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.661+0000 7f7741db7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f773c06a770 0x7f773c11d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49770/0 (socket says 172.21.15.72:49770) 2023-10-03T10:18:30.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.661+0000 7f7741db7700 1 -- 172.21.15.72:0/1722508877 learned_addr learned my addr 172.21.15.72:0/1722508877 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:30.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.661+0000 7f77425b8700 1 --2- 172.21.15.72:0/1722508877 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f773c131d10 0x7f773c1c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.662+0000 7f77415b6700 1 --2- 172.21.15.72:0/1722508877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f773c06b080 0x7f773c11d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.662+0000 7f7741db7700 1 -- 172.21.15.72:0/1722508877 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f773c131d10 msgr2=0x7f773c1c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.662+0000 7f7741db7700 1 --2- 172.21.15.72:0/1722508877 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f773c131d10 0x7f773c1c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.662+0000 7f7741db7700 1 -- 172.21.15.72:0/1722508877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f773c06b080 msgr2=0x7f773c11d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.662+0000 7f7741db7700 1 --2- 172.21.15.72:0/1722508877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f773c06b080 0x7f773c11d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.662+0000 7f7741db7700 1 -- 172.21.15.72:0/1722508877 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7738009550 con 0x7f773c06a770 2023-10-03T10:18:30.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.662+0000 7f77425b8700 1 --2- 172.21.15.72:0/1722508877 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f773c131d10 0x7f773c1c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.662+0000 7f7741db7700 1 --2- 172.21.15.72:0/1722508877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f773c06a770 0x7f773c11d220 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7738009f50 tx=0x7f773800ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.662+0000 7f77327fc700 1 -- 172.21.15.72:0/1722508877 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738021b50 con 0x7f773c06a770 2023-10-03T10:18:30.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.662+0000 7f77327fc700 1 -- 172.21.15.72:0/1722508877 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7738021cb0 con 0x7f773c06a770 2023-10-03T10:18:30.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.662+0000 7f774401b700 1 -- 172.21.15.72:0/1722508877 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7734009a70 con 0x7f773c06a770 2023-10-03T10:18:30.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.662+0000 7f77327fc700 1 -- 172.21.15.72:0/1722508877 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773800c9d0 con 0x7f773c06a770 2023-10-03T10:18:30.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.662+0000 7f774401b700 1 -- 172.21.15.72:0/1722508877 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773c120140 con 0x7f773c06a770 2023-10-03T10:18:30.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.663+0000 7f77327fc700 1 -- 172.21.15.72:0/1722508877 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f773800cb30 con 0x7f773c06a770 2023-10-03T10:18:30.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.663+0000 7f77327fc700 1 -- 172.21.15.72:0/1722508877 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7738047ff0 con 0x7f773c06a770 2023-10-03T10:18:30.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.664+0000 7f774401b700 1 -- 172.21.15.72:0/1722508877 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773c074ea0 con 0x7f773c06a770 2023-10-03T10:18:30.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.668+0000 7f86a8aeb700 1 Processor -- start 2023-10-03T10:18:30.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.668+0000 7f86a8aeb700 1 -- start start 2023-10-03T10:18:30.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.668+0000 7f86a8aeb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a4136710 0x7f86a4138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.668+0000 7f86a8aeb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a4139030 0x7f86a413b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.668+0000 7f86a8aeb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a406ef30 con 0x7f86a41338a0 2023-10-03T10:18:30.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.668+0000 7f86a8aeb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a406fef0 con 0x7f86a4136710 2023-10-03T10:18:30.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.668+0000 7f86a8aeb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86a41334b0 con 0x7f86a4139030 2023-10-03T10:18:30.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.669+0000 7f86a1d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a4136710 0x7f86a4138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.669+0000 7f86a259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f86a41338a0 0x7f86a4133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51664/0 (socket says 172.21.15.72:51664) 2023-10-03T10:18:30.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.669+0000 7f86a259c700 1 -- 172.21.15.72:0/2204364445 learned_addr learned my addr 172.21.15.72:0/2204364445 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:30.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.669+0000 7f86a2d9d700 1 --2- 172.21.15.72:0/2204364445 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a4139030 0x7f86a413b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.669+0000 7f77327fc700 1 -- 172.21.15.72:0/1722508877 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7738028750 con 0x7f773c06a770 2023-10-03T10:18:30.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.669+0000 7f86a159a700 1 -- 172.21.15.72:0/2204364445 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579387678 0 0) 0x7f86a406ef30 con 0x7f86a41338a0 2023-10-03T10:18:30.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.669+0000 7f86a159a700 1 -- 172.21.15.72:0/2204364445 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f868c0035b0 con 0x7f86a41338a0 2023-10-03T10:18:30.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.669+0000 7f86a1d9b700 1 -- 172.21.15.72:0/2204364445 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a4139030 msgr2=0x7f86a413b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.669+0000 7f86a1d9b700 1 --2- 172.21.15.72:0/2204364445 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a4139030 0x7f86a413b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.669+0000 7f86a1d9b700 1 -- 172.21.15.72:0/2204364445 >> v1:172.21.15.72:6789/0 conn(0x7f86a41338a0 legacy=0x7f86a4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.669+0000 7f86a1d9b700 1 -- 172.21.15.72:0/2204364445 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a406fc30 con 0x7f86a4136710 2023-10-03T10:18:30.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.669+0000 7f86a1d9b700 1 --2- 172.21.15.72:0/2204364445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a4136710 0x7f86a4138af0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8698009870 tx=0x7f8698009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fc98b0d526a7ca9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.670+0000 7f86a159a700 1 -- 172.21.15.72:0/2204364445 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8698011830 con 0x7f86a4136710 2023-10-03T10:18:30.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.670+0000 7f86a159a700 1 -- 172.21.15.72:0/2204364445 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8698011990 con 0x7f86a4136710 2023-10-03T10:18:30.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.670+0000 7f86a159a700 1 -- 172.21.15.72:0/2204364445 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8698011d00 con 0x7f86a4136710 2023-10-03T10:18:30.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.671+0000 7f86a8aeb700 1 -- 172.21.15.72:0/2204364445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a4136710 msgr2=0x7f86a4138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.671+0000 7f86a8aeb700 1 --2- 172.21.15.72:0/2204364445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a4136710 0x7f86a4138af0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8698009870 tx=0x7f8698009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:30.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.671+0000 7f86a8aeb700 1 -- 172.21.15.72:0/2204364445 shutdown_connections 2023-10-03T10:18:30.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.671+0000 7f86a8aeb700 1 --2- 172.21.15.72:0/2204364445 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a4139030 0x7f86a413b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.671+0000 7f86a8aeb700 1 --2- 172.21.15.72:0/2204364445 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a4136710 0x7f86a4138af0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.671+0000 7f86a8aeb700 1 -- 172.21.15.72:0/2204364445 >> 172.21.15.72:0/2204364445 conn(0x7f86a40a2aa0 msgr2=0x7f86a40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.671+0000 7f86a8aeb700 1 -- 172.21.15.72:0/2204364445 shutdown_connections 2023-10-03T10:18:30.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.671+0000 7f86a8aeb700 1 -- 172.21.15.72:0/2204364445 wait complete. 2023-10-03T10:18:30.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.672+0000 7f86a8aeb700 1 Processor -- start 2023-10-03T10:18:30.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.672+0000 7f86a8aeb700 1 -- start start 2023-10-03T10:18:30.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.673+0000 7f86a8aeb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a41338a0 0x7f86a411ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.673+0000 7f86a8aeb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a4136710 0x7f86a411b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.673+0000 7f86a8aeb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a4139030 0x7f86a411b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.673+0000 7f86a8aeb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a411d0f0 con 0x7f86a41338a0 2023-10-03T10:18:30.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.673+0000 7f86a8aeb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a411e730 con 0x7f86a4139030 2023-10-03T10:18:30.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.673+0000 7f86a8aeb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86a411dee0 con 0x7f86a4136710 2023-10-03T10:18:30.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.673+0000 7f86a2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a4139030 0x7f86a411b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.673+0000 7f86a2d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a4139030 0x7f86a411b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56662/0 (socket says 172.21.15.72:56662) 2023-10-03T10:18:30.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.673+0000 7f86a2d9d700 1 -- 172.21.15.72:0/881033829 learned_addr learned my addr 172.21.15.72:0/881033829 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:30.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.673+0000 7f86a1d9b700 1 --2- 172.21.15.72:0/881033829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a4136710 0x7f86a411b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.673+0000 7f86a2d9d700 1 -- 172.21.15.72:0/881033829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a4136710 msgr2=0x7f86a411b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.674+0000 7f86a2d9d700 1 --2- 172.21.15.72:0/881033829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a4136710 0x7f86a411b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.674+0000 7f86a2d9d700 1 -- 172.21.15.72:0/881033829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a41338a0 msgr2=0x7f86a411ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.674+0000 7f86a2d9d700 1 --2- 172.21.15.72:0/881033829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a41338a0 0x7f86a411ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.674+0000 7f86a2d9d700 1 -- 172.21.15.72:0/881033829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86980094a0 con 0x7f86a4139030 2023-10-03T10:18:30.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.674+0000 7f86a2d9d700 1 --2- 172.21.15.72:0/881033829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a4139030 0x7f86a411b710 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f869c00efc0 tx=0x7f869c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.674+0000 7f8692ffd700 1 -- 172.21.15.72:0/881033829 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c00cd40 con 0x7f86a4139030 2023-10-03T10:18:30.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.674+0000 7f8692ffd700 1 -- 172.21.15.72:0/881033829 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c00f040 con 0x7f86a4139030 2023-10-03T10:18:30.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.674+0000 7f86a8aeb700 1 -- 172.21.15.72:0/881033829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a4138cb0 con 0x7f86a4139030 2023-10-03T10:18:30.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.674+0000 7f8692ffd700 1 -- 172.21.15.72:0/881033829 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c0146c0 con 0x7f86a4139030 2023-10-03T10:18:30.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.674+0000 7f86a8aeb700 1 -- 172.21.15.72:0/881033829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a406f690 con 0x7f86a4139030 2023-10-03T10:18:30.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.675+0000 7f86a8aeb700 1 -- 172.21.15.72:0/881033829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a411e560 con 0x7f86a4139030 2023-10-03T10:18:30.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.675+0000 7f8692ffd700 1 -- 172.21.15.72:0/881033829 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f869c014820 con 0x7f86a4139030 2023-10-03T10:18:30.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.675+0000 7f8692ffd700 1 -- 172.21.15.72:0/881033829 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f869c0402b0 con 0x7f86a4139030 2023-10-03T10:18:30.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.684+0000 7f8692ffd700 1 -- 172.21.15.72:0/881033829 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f869c007920 con 0x7f86a4139030 2023-10-03T10:18:30.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.801+0000 7f8d3c7fe700 1 -- 172.21.15.72:0/2255035544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8d3406c360 con 0x7f8d3409d6f0 2023-10-03T10:18:30.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.801+0000 7f8d2affd700 1 -- 172.21.15.72:0/2255035544 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8d30015030 con 0x7f8d3409d6f0 2023-10-03T10:18:30.802 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:30.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.803+0000 7f8d3c7fe700 1 -- 172.21.15.72:0/2255035544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d3409d6f0 msgr2=0x7f8d341222d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.803+0000 7f8d3c7fe700 1 --2- 172.21.15.72:0/2255035544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d3409d6f0 0x7f8d341222d0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009c70 tx=0x7f8d30004750 comp rx=0 tx=0).stop 2023-10-03T10:18:30.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.803+0000 7f8d3c7fe700 1 -- 172.21.15.72:0/2255035544 shutdown_connections 2023-10-03T10:18:30.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.803+0000 7f8d3c7fe700 1 --2- 172.21.15.72:0/2255035544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d3409d6f0 0x7f8d341222d0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.803+0000 7f8d3c7fe700 1 --2- 172.21.15.72:0/2255035544 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8d3409e410 0x7f8d34122d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.803+0000 7f8d3c7fe700 1 --2- 172.21.15.72:0/2255035544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d3409e000 0x7f8d34122810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.803+0000 7f8d3c7fe700 1 -- 172.21.15.72:0/2255035544 >> 172.21.15.72:0/2255035544 conn(0x7f8d34066f50 msgr2=0x7f8d340a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.804+0000 7f8d3c7fe700 1 -- 172.21.15.72:0/2255035544 shutdown_connections 2023-10-03T10:18:30.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.804+0000 7f8d3c7fe700 1 -- 172.21.15.72:0/2255035544 wait complete. 2023-10-03T10:18:30.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:30.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.865+0000 7f774401b700 1 -- 172.21.15.72:0/1722508877 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f773c0718f0 con 0x7f773c06a770 2023-10-03T10:18:30.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.865+0000 7f77327fc700 1 -- 172.21.15.72:0/1722508877 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7738011340 con 0x7f773c06a770 2023-10-03T10:18:30.866 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:30.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.868+0000 7f774401b700 1 -- 172.21.15.72:0/1722508877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f773c06a770 msgr2=0x7f773c11d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.868+0000 7f774401b700 1 --2- 172.21.15.72:0/1722508877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f773c06a770 0x7f773c11d220 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7738009f50 tx=0x7f773800ee10 comp rx=0 tx=0).stop 2023-10-03T10:18:30.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.868+0000 7f774401b700 1 -- 172.21.15.72:0/1722508877 shutdown_connections 2023-10-03T10:18:30.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.868+0000 7f774401b700 1 --2- 172.21.15.72:0/1722508877 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f773c131d10 0x7f773c1c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.868+0000 7f774401b700 1 --2- 172.21.15.72:0/1722508877 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f773c06a770 0x7f773c11d220 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.868+0000 7f774401b700 1 --2- 172.21.15.72:0/1722508877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f773c06b080 0x7f773c11d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.868+0000 7f774401b700 1 -- 172.21.15.72:0/1722508877 >> 172.21.15.72:0/1722508877 conn(0x7f773c066f50 msgr2=0x7f773c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.868+0000 7f774401b700 1 -- 172.21.15.72:0/1722508877 shutdown_connections 2023-10-03T10:18:30.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.868+0000 7f774401b700 1 -- 172.21.15.72:0/1722508877 wait complete. 2023-10-03T10:18:30.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:30.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.881+0000 7f5502688700 1 -- 172.21.15.72:0/3743909281 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f54fc074ea0 con 0x7f54fc139170 2023-10-03T10:18:30.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.881+0000 7f54f8ff9700 1 -- 172.21.15.72:0/3743909281 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54f40267a0 con 0x7f54fc139170 2023-10-03T10:18:30.882 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:30.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.883+0000 7f5502688700 1 -- 172.21.15.72:0/3743909281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54fc139170 msgr2=0x7f54fc11f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.883+0000 7f5502688700 1 --2- 172.21.15.72:0/3743909281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54fc139170 0x7f54fc11f360 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009dc0 tx=0x7f54f4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.883+0000 7f5502688700 1 -- 172.21.15.72:0/3743909281 shutdown_connections 2023-10-03T10:18:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.883+0000 7f5502688700 1 --2- 172.21.15.72:0/3743909281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54fc139170 0x7f54fc11f360 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.883+0000 7f5502688700 1 --2- 172.21.15.72:0/3743909281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54fc09d6f0 0x7f54fc11e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.883+0000 7f5502688700 1 --2- 172.21.15.72:0/3743909281 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f54fc09e1d0 0x7f54fc11ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.883+0000 7f5502688700 1 -- 172.21.15.72:0/3743909281 >> 172.21.15.72:0/3743909281 conn(0x7f54fc066f50 msgr2=0x7f54fc09b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.884+0000 7f5502688700 1 -- 172.21.15.72:0/3743909281 shutdown_connections 2023-10-03T10:18:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.884+0000 7f5502688700 1 -- 172.21.15.72:0/3743909281 wait complete. 2023-10-03T10:18:30.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:30.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.910+0000 7f86a8aeb700 1 -- 172.21.15.72:0/881033829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f86a4074ea0 con 0x7f86a4139030 2023-10-03T10:18:30.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.911+0000 7f8692ffd700 1 -- 172.21.15.72:0/881033829 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f869c018020 con 0x7f86a4139030 2023-10-03T10:18:30.912 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:30.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.913+0000 7f86a8aeb700 1 -- 172.21.15.72:0/881033829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a4139030 msgr2=0x7f86a411b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.913+0000 7f86a8aeb700 1 --2- 172.21.15.72:0/881033829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a4139030 0x7f86a411b710 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f869c00efc0 tx=0x7f869c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.913+0000 7f86a8aeb700 1 -- 172.21.15.72:0/881033829 shutdown_connections 2023-10-03T10:18:30.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.913+0000 7f86a8aeb700 1 --2- 172.21.15.72:0/881033829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a41338a0 0x7f86a411ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.913+0000 7f86a8aeb700 1 --2- 172.21.15.72:0/881033829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86a4139030 0x7f86a411b710 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.913+0000 7f86a8aeb700 1 --2- 172.21.15.72:0/881033829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f86a4136710 0x7f86a411b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.913+0000 7f86a8aeb700 1 -- 172.21.15.72:0/881033829 >> 172.21.15.72:0/881033829 conn(0x7f86a40a2aa0 msgr2=0x7f86a4137250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.913+0000 7f86a8aeb700 1 -- 172.21.15.72:0/881033829 shutdown_connections 2023-10-03T10:18:30.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:30.913+0000 7f86a8aeb700 1 -- 172.21.15.72:0/881033829 wait complete. 2023-10-03T10:18:30.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:31.817 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:31.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:31.897 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:31.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:31.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.957+0000 7f2a6ab4c700 1 Processor -- start 2023-10-03T10:18:31.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.957+0000 7f2a6ab4c700 1 -- start start 2023-10-03T10:18:31.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.958+0000 7f2a6ab4c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a64133420 0x7f2a641337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.958+0000 7f2a6ab4c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a64134260 0x7f2a641306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.958+0000 7f2a6ab4c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6406b990 con 0x7f2a64133e30 2023-10-03T10:18:31.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.958+0000 7f2a6ab4c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640a0590 con 0x7f2a64133420 2023-10-03T10:18:31.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.958+0000 7f2a6ab4c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6409fb80 con 0x7f2a64134260 2023-10-03T10:18:31.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.958+0000 7f2a63fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2a64133e30 0x7f2a6412ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51680/0 (socket says 172.21.15.72:51680) 2023-10-03T10:18:31.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.958+0000 7f2a63fff700 1 -- 172.21.15.72:0/1480491043 learned_addr learned my addr 172.21.15.72:0/1480491043 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:31.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.958+0000 7f2a690e9700 1 --2- 172.21.15.72:0/1480491043 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a64134260 0x7f2a641306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.958+0000 7f2a688e8700 1 --2- 172.21.15.72:0/1480491043 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a64133420 0x7f2a641337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.958+0000 7f2a690e9700 1 -- 172.21.15.72:0/1480491043 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a64133420 msgr2=0x7f2a641337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.958+0000 7f2a690e9700 1 --2- 172.21.15.72:0/1480491043 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a64133420 0x7f2a641337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.958+0000 7f2a690e9700 1 -- 172.21.15.72:0/1480491043 >> v1:172.21.15.72:6789/0 conn(0x7f2a64133e30 legacy=0x7f2a6412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.958+0000 7f2a690e9700 1 -- 172.21.15.72:0/1480491043 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a640a0030 con 0x7f2a64134260 2023-10-03T10:18:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.958+0000 7f2a690e9700 1 --2- 172.21.15.72:0/1480491043 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a64134260 0x7f2a641306a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009dc0 tx=0x7f2a5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16a8833a47dd374e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.959+0000 7f2a637fe700 1 -- 172.21.15.72:0/1480491043 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c00e070 con 0x7f2a64134260 2023-10-03T10:18:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.959+0000 7f2a637fe700 1 -- 172.21.15.72:0/1480491043 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c00bb20 con 0x7f2a64134260 2023-10-03T10:18:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.959+0000 7f2a637fe700 1 -- 172.21.15.72:0/1480491043 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c012430 con 0x7f2a64134260 2023-10-03T10:18:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.959+0000 7f2a6ab4c700 1 -- 172.21.15.72:0/1480491043 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a64134260 msgr2=0x7f2a641306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.959+0000 7f2a6ab4c700 1 --2- 172.21.15.72:0/1480491043 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a64134260 0x7f2a641306a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009dc0 tx=0x7f2a5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.959+0000 7f2a6ab4c700 1 -- 172.21.15.72:0/1480491043 shutdown_connections 2023-10-03T10:18:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.959+0000 7f2a6ab4c700 1 --2- 172.21.15.72:0/1480491043 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a64134260 0x7f2a641306a0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.959+0000 7f2a6ab4c700 1 --2- 172.21.15.72:0/1480491043 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a64133420 0x7f2a641337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.959+0000 7f2a6ab4c700 1 -- 172.21.15.72:0/1480491043 >> 172.21.15.72:0/1480491043 conn(0x7f2a640a4210 msgr2=0x7f2a640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.959+0000 7f2a6ab4c700 1 -- 172.21.15.72:0/1480491043 shutdown_connections 2023-10-03T10:18:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.960+0000 7f2a6ab4c700 1 -- 172.21.15.72:0/1480491043 wait complete. 2023-10-03T10:18:31.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.961+0000 7f2a6ab4c700 1 Processor -- start 2023-10-03T10:18:31.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.961+0000 7f2a6ab4c700 1 -- start start 2023-10-03T10:18:31.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a6ab4c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a64133420 0x7f2a6409c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a6ab4c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a64133e30 0x7f2a6409c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a6ab4c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a64134260 0x7f2a6409cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a6ab4c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6411ff80 con 0x7f2a64134260 2023-10-03T10:18:31.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a6ab4c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6411fa20 con 0x7f2a64133420 2023-10-03T10:18:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a6ab4c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6409df50 con 0x7f2a64133e30 2023-10-03T10:18:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a688e8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a64133420 0x7f2a6409c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a688e8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a64133420 0x7f2a6409c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56672/0 (socket says 172.21.15.72:56672) 2023-10-03T10:18:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a688e8700 1 -- 172.21.15.72:0/566159452 learned_addr learned my addr 172.21.15.72:0/566159452 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a63fff700 1 --2- 172.21.15.72:0/566159452 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a64133e30 0x7f2a6409c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a690e9700 1 --2- 172.21.15.72:0/566159452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a64134260 0x7f2a6409cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a63fff700 1 -- 172.21.15.72:0/566159452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a64133420 msgr2=0x7f2a6409c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a63fff700 1 --2- 172.21.15.72:0/566159452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a64133420 0x7f2a6409c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a63fff700 1 -- 172.21.15.72:0/566159452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a64134260 msgr2=0x7f2a6409cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a63fff700 1 --2- 172.21.15.72:0/566159452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a64134260 0x7f2a6409cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a63fff700 1 -- 172.21.15.72:0/566159452 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c009a70 con 0x7f2a64133e30 2023-10-03T10:18:31.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a690e9700 1 --2- 172.21.15.72:0/566159452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a64134260 0x7f2a6409cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.962+0000 7f2a688e8700 1 --2- 172.21.15.72:0/566159452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a64133420 0x7f2a6409c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.963+0000 7f2a63fff700 1 --2- 172.21.15.72:0/566159452 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a64133e30 0x7f2a6409c810 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000c4d0 tx=0x7f2a5000c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.963+0000 7f2a617fa700 1 -- 172.21.15.72:0/566159452 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50005d70 con 0x7f2a64133e30 2023-10-03T10:18:31.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.963+0000 7f2a617fa700 1 -- 172.21.15.72:0/566159452 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5000ce80 con 0x7f2a64133e30 2023-10-03T10:18:31.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.963+0000 7f2a617fa700 1 -- 172.21.15.72:0/566159452 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a500072d0 con 0x7f2a64133e30 2023-10-03T10:18:31.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.963+0000 7f2a6ab4c700 1 -- 172.21.15.72:0/566159452 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6411fcc0 con 0x7f2a64133e30 2023-10-03T10:18:31.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.963+0000 7f2a6ab4c700 1 -- 172.21.15.72:0/566159452 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a641209f0 con 0x7f2a64133e30 2023-10-03T10:18:31.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.964+0000 7f2a617fa700 1 -- 172.21.15.72:0/566159452 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a50007430 con 0x7f2a64133e30 2023-10-03T10:18:31.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.964+0000 7f2a617fa700 1 -- 172.21.15.72:0/566159452 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2a5003eb10 con 0x7f2a64133e30 2023-10-03T10:18:31.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.964+0000 7f2a6ab4c700 1 -- 172.21.15.72:0/566159452 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a64074ea0 con 0x7f2a64133e30 2023-10-03T10:18:31.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:31.973+0000 7f2a617fa700 1 -- 172.21.15.72:0/566159452 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a50017020 con 0x7f2a64133e30 2023-10-03T10:18:32.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.016+0000 7f3282bfd700 1 Processor -- start 2023-10-03T10:18:32.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.016+0000 7f3282bfd700 1 -- start start 2023-10-03T10:18:32.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.017+0000 7f3282bfd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f327c09d6f0 0x7f327c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.017+0000 7f3282bfd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f327c09e000 0x7f327c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.017+0000 7f3282bfd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f327c09e410 0x7f327c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.017+0000 7f3282bfd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f327c06b460 con 0x7f327c09e410 2023-10-03T10:18:32.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.017+0000 7f3282bfd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327c09b120 con 0x7f327c09e000 2023-10-03T10:18:32.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.017+0000 7f3282bfd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f327c09a7e0 con 0x7f327c09d6f0 2023-10-03T10:18:32.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.017+0000 7f3280999700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f327c09d6f0 0x7f327c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.017+0000 7f3280999700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f327c09d6f0 0x7f327c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49816/0 (socket says 172.21.15.72:49816) 2023-10-03T10:18:32.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.017+0000 7f3280999700 1 -- 172.21.15.72:0/2872631707 learned_addr learned my addr 172.21.15.72:0/2872631707 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:32.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.017+0000 7f328119a700 1 --2- 172.21.15.72:0/2872631707 >> v2:172.21.15.72:3300/0 conn(0x7f327c09e410 0x7f327c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.017+0000 7f327bfff700 1 --2- 172.21.15.72:0/2872631707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f327c09e000 0x7f327c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.017+0000 7f328119a700 1 -- 172.21.15.72:0/2872631707 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f327c09d6f0 msgr2=0x7f327c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.018+0000 7f328119a700 1 --2- 172.21.15.72:0/2872631707 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f327c09d6f0 0x7f327c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.018+0000 7f328119a700 1 -- 172.21.15.72:0/2872631707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f327c09e000 msgr2=0x7f327c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.018+0000 7f328119a700 1 --2- 172.21.15.72:0/2872631707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f327c09e000 0x7f327c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.018+0000 7f328119a700 1 -- 172.21.15.72:0/2872631707 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c09a500 con 0x7f327c09e410 2023-10-03T10:18:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.018+0000 7f3280999700 1 --2- 172.21.15.72:0/2872631707 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f327c09d6f0 0x7f327c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.018+0000 7f328119a700 1 --2- 172.21.15.72:0/2872631707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f327c09e410 0x7f327c133f30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f3274009d90 tx=0x7f327400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c61cbad3f85b25 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.018+0000 7f327b7fe700 1 -- 172.21.15.72:0/2872631707 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327400e070 con 0x7f327c09e410 2023-10-03T10:18:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.018+0000 7f327b7fe700 1 -- 172.21.15.72:0/2872631707 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327400bb20 con 0x7f327c09e410 2023-10-03T10:18:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.018+0000 7f327b7fe700 1 -- 172.21.15.72:0/2872631707 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274012430 con 0x7f327c09e410 2023-10-03T10:18:32.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.019+0000 7f3282bfd700 1 -- 172.21.15.72:0/2872631707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f327c09e410 msgr2=0x7f327c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.019+0000 7f3282bfd700 1 --2- 172.21.15.72:0/2872631707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f327c09e410 0x7f327c133f30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f3274009d90 tx=0x7f327400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:32.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.019+0000 7f3282bfd700 1 -- 172.21.15.72:0/2872631707 shutdown_connections 2023-10-03T10:18:32.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.019+0000 7f3282bfd700 1 --2- 172.21.15.72:0/2872631707 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f327c09e410 0x7f327c133f30 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.019+0000 7f3282bfd700 1 --2- 172.21.15.72:0/2872631707 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f327c09d6f0 0x7f327c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.019+0000 7f3282bfd700 1 --2- 172.21.15.72:0/2872631707 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f327c09e000 0x7f327c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.019+0000 7f3282bfd700 1 -- 172.21.15.72:0/2872631707 >> 172.21.15.72:0/2872631707 conn(0x7f327c066f50 msgr2=0x7f327c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.019+0000 7f3282bfd700 1 -- 172.21.15.72:0/2872631707 shutdown_connections 2023-10-03T10:18:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.019+0000 7f3282bfd700 1 -- 172.21.15.72:0/2872631707 wait complete. 2023-10-03T10:18:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.020+0000 7f3282bfd700 1 Processor -- start 2023-10-03T10:18:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.020+0000 7f3282bfd700 1 -- start start 2023-10-03T10:18:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.021+0000 7f3282bfd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f327c09d6f0 0x7f327c1c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.021+0000 7f3282bfd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f327c09e000 0x7f327c1c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.021+0000 7f3282bfd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f327c09e410 0x7f327c1c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.021+0000 7f3282bfd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c1a9620 con 0x7f327c09e000 2023-10-03T10:18:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.021+0000 7f3282bfd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327c1a8b60 con 0x7f327c09d6f0 2023-10-03T10:18:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.021+0000 7f3282bfd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f327c1c5aa0 con 0x7f327c09e410 2023-10-03T10:18:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.021+0000 7f327bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f327c09e000 0x7f327c1c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.021+0000 7f327bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f327c09e000 0x7f327c1c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54450/0 (socket says 172.21.15.72:54450) 2023-10-03T10:18:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.021+0000 7f327bfff700 1 -- 172.21.15.72:0/2108337933 learned_addr learned my addr 172.21.15.72:0/2108337933 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:32.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.021+0000 7f3280999700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f327c09d6f0 0x7f327c1c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.021+0000 7f328119a700 1 --2- 172.21.15.72:0/2108337933 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f327c09e410 0x7f327c1c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.022+0000 7f3280999700 1 -- 172.21.15.72:0/2108337933 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f327c09e410 msgr2=0x7f327c1c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.022+0000 7f3280999700 1 --2- 172.21.15.72:0/2108337933 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f327c09e410 0x7f327c1c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.022+0000 7f3280999700 1 -- 172.21.15.72:0/2108337933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f327c09e000 msgr2=0x7f327c1c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.022+0000 7f3280999700 1 --2- 172.21.15.72:0/2108337933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f327c09e000 0x7f327c1c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.022+0000 7f3280999700 1 -- 172.21.15.72:0/2108337933 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270009550 con 0x7f327c09d6f0 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.022+0000 7f3280999700 1 --2- 172.21.15.72:0/2108337933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f327c09d6f0 0x7f327c1c5020 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f327000e9a0 tx=0x7f327000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.022+0000 7f32797fa700 1 -- 172.21.15.72:0/2108337933 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270004030 con 0x7f327c09d6f0 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.022+0000 7f32797fa700 1 -- 172.21.15.72:0/2108337933 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270004190 con 0x7f327c09d6f0 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.022+0000 7f32797fa700 1 -- 172.21.15.72:0/2108337933 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270004520 con 0x7f327c09d6f0 2023-10-03T10:18:32.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.022+0000 7f3282bfd700 1 -- 172.21.15.72:0/2108337933 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3274009a70 con 0x7f327c09d6f0 2023-10-03T10:18:32.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.022+0000 7f3282bfd700 1 -- 172.21.15.72:0/2108337933 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327c0a30f0 con 0x7f327c09d6f0 2023-10-03T10:18:32.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.023+0000 7f32797fa700 1 -- 172.21.15.72:0/2108337933 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f32700036a0 con 0x7f327c09d6f0 2023-10-03T10:18:32.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.023+0000 7f32797fa700 1 -- 172.21.15.72:0/2108337933 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f327003f570 con 0x7f327c09d6f0 2023-10-03T10:18:32.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.024+0000 7f3282bfd700 1 -- 172.21.15.72:0/2108337933 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327c074ea0 con 0x7f327c09d6f0 2023-10-03T10:18:32.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.028+0000 7f32797fa700 1 -- 172.21.15.72:0/2108337933 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3270019d60 con 0x7f327c09d6f0 2023-10-03T10:18:32.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.057+0000 7f5f9e117700 1 Processor -- start 2023-10-03T10:18:32.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.057+0000 7f5f9e117700 1 -- start start 2023-10-03T10:18:32.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f9e117700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f981338a0 0x7f5f98133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f9e117700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f9809de50 0x7f5f9809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f9e117700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5f9809e760 0x7f5f9813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f9e117700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9806fef0 con 0x7f5f9809e760 2023-10-03T10:18:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f9e117700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9806ef30 con 0x7f5f981338a0 2023-10-03T10:18:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f9e117700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f981334b0 con 0x7f5f9809de50 2023-10-03T10:18:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f977fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f981338a0 0x7f5f98133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f977fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f981338a0 0x7f5f98133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56700/0 (socket says 172.21.15.72:56700) 2023-10-03T10:18:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f977fe700 1 -- 172.21.15.72:0/2728551617 learned_addr learned my addr 172.21.15.72:0/2728551617 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f97fff700 1 --2- 172.21.15.72:0/2728551617 >> v2:172.21.15.72:3300/0 conn(0x7f5f9809e760 0x7f5f9813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f96ffd700 1 --2- 172.21.15.72:0/2728551617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f9809de50 0x7f5f9809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f977fe700 1 -- 172.21.15.72:0/2728551617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f9809de50 msgr2=0x7f5f9809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f977fe700 1 --2- 172.21.15.72:0/2728551617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f9809de50 0x7f5f9809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f977fe700 1 -- 172.21.15.72:0/2728551617 >> v2:172.21.15.72:3300/0 conn(0x7f5f9809e760 msgr2=0x7f5f9813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f977fe700 1 --2- 172.21.15.72:0/2728551617 >> v2:172.21.15.72:3300/0 conn(0x7f5f9809e760 0x7f5f9813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.058+0000 7f5f977fe700 1 -- 172.21.15.72:0/2728551617 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9806fc30 con 0x7f5f981338a0 2023-10-03T10:18:32.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.059+0000 7f5f977fe700 1 --2- 172.21.15.72:0/2728551617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f981338a0 0x7f5f98133c70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009920 tx=0x7f5f88009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7181091fd72ed53 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.059+0000 7f5f967fc700 1 -- 172.21.15.72:0/2728551617 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88011830 con 0x7f5f981338a0 2023-10-03T10:18:32.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.059+0000 7f5f967fc700 1 -- 172.21.15.72:0/2728551617 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f88011990 con 0x7f5f981338a0 2023-10-03T10:18:32.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.059+0000 7f5f967fc700 1 -- 172.21.15.72:0/2728551617 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88011d20 con 0x7f5f981338a0 2023-10-03T10:18:32.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.059+0000 7f5f9e117700 1 -- 172.21.15.72:0/2728551617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f981338a0 msgr2=0x7f5f98133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.059+0000 7f5f9e117700 1 --2- 172.21.15.72:0/2728551617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f981338a0 0x7f5f98133c70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009920 tx=0x7f5f88009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:32.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.059+0000 7f5f9e117700 1 -- 172.21.15.72:0/2728551617 shutdown_connections 2023-10-03T10:18:32.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.059+0000 7f5f9e117700 1 --2- 172.21.15.72:0/2728551617 >> v2:172.21.15.72:3300/0 conn(0x7f5f9809e760 0x7f5f9813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.059+0000 7f5f9e117700 1 --2- 172.21.15.72:0/2728551617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f981338a0 0x7f5f98133c70 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.059+0000 7f5f9e117700 1 --2- 172.21.15.72:0/2728551617 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f9809de50 0x7f5f9809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.060+0000 7f5f9e117700 1 -- 172.21.15.72:0/2728551617 >> 172.21.15.72:0/2728551617 conn(0x7f5f980a2aa0 msgr2=0x7f5f980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.060+0000 7f5f9e117700 1 -- 172.21.15.72:0/2728551617 shutdown_connections 2023-10-03T10:18:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.060+0000 7f5f9e117700 1 -- 172.21.15.72:0/2728551617 wait complete. 2023-10-03T10:18:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.060+0000 7f5f9e117700 1 Processor -- start 2023-10-03T10:18:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.061+0000 7f5f9e117700 1 -- start start 2023-10-03T10:18:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.061+0000 7f5f9e117700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f9809de50 0x7f5f9811eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.061+0000 7f5f9e117700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f9809e760 0x7f5f9811f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.061+0000 7f5f9e117700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f981338a0 0x7f5f9811f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.061+0000 7f5f9e117700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f98120cc0 con 0x7f5f9809e760 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.061+0000 7f5f9e117700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f98122030 con 0x7f5f9809de50 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.061+0000 7f5f9e117700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9806f640 con 0x7f5f981338a0 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.061+0000 7f5f977fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f9809de50 0x7f5f9811eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.061+0000 7f5f977fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f9809de50 0x7f5f9811eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56706/0 (socket says 172.21.15.72:56706) 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.061+0000 7f5f977fe700 1 -- 172.21.15.72:0/810471847 learned_addr learned my addr 172.21.15.72:0/810471847 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.061+0000 7f5f97fff700 1 --2- 172.21.15.72:0/810471847 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f981338a0 0x7f5f9811f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.061+0000 7f5f96ffd700 1 --2- 172.21.15.72:0/810471847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f9809e760 0x7f5f9811f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.062+0000 7f5f977fe700 1 -- 172.21.15.72:0/810471847 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f981338a0 msgr2=0x7f5f9811f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.062+0000 7f5f977fe700 1 --2- 172.21.15.72:0/810471847 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f981338a0 0x7f5f9811f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.062+0000 7f5f977fe700 1 -- 172.21.15.72:0/810471847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f9809e760 msgr2=0x7f5f9811f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.062+0000 7f5f977fe700 1 --2- 172.21.15.72:0/810471847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f9809e760 0x7f5f9811f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.062+0000 7f5f977fe700 1 -- 172.21.15.72:0/810471847 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f88009550 con 0x7f5f9809de50 2023-10-03T10:18:32.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.062+0000 7f5f97fff700 1 --2- 172.21.15.72:0/810471847 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f981338a0 0x7f5f9811f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.062+0000 7f5f977fe700 1 --2- 172.21.15.72:0/810471847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f9809de50 0x7f5f9811eb30 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5f88000c00 tx=0x7f5f88004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.062+0000 7f5f7ffff700 1 -- 172.21.15.72:0/810471847 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88004450 con 0x7f5f9809de50 2023-10-03T10:18:32.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.062+0000 7f5f7ffff700 1 -- 172.21.15.72:0/810471847 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f880045b0 con 0x7f5f9809de50 2023-10-03T10:18:32.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.062+0000 7f5f7ffff700 1 -- 172.21.15.72:0/810471847 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f880038e0 con 0x7f5f9809de50 2023-10-03T10:18:32.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.063+0000 7f5f9e117700 1 -- 172.21.15.72:0/810471847 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f98123250 con 0x7f5f9809de50 2023-10-03T10:18:32.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.063+0000 7f5f9e117700 1 -- 172.21.15.72:0/810471847 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f98122700 con 0x7f5f9809de50 2023-10-03T10:18:32.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.064+0000 7f5f9e117700 1 -- 172.21.15.72:0/810471847 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f98122530 con 0x7f5f9809de50 2023-10-03T10:18:32.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.064+0000 7f5f7ffff700 1 -- 172.21.15.72:0/810471847 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f88003a40 con 0x7f5f9809de50 2023-10-03T10:18:32.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.064+0000 7f5f7ffff700 1 -- 172.21.15.72:0/810471847 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5f880403a0 con 0x7f5f9809de50 2023-10-03T10:18:32.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.073+0000 7f5f7ffff700 1 -- 172.21.15.72:0/810471847 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f8801a420 con 0x7f5f9809de50 2023-10-03T10:18:32.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.089+0000 7f3220eba700 1 Processor -- start 2023-10-03T10:18:32.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.089+0000 7f3220eba700 1 -- start start 2023-10-03T10:18:32.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f3220eba700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f321c09e1d0 0x7f321c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f3220eba700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f321c139170 0x7f321c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f3220eba700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321c09b120 con 0x7f321c09d6f0 2023-10-03T10:18:32.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f3220eba700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321c06b460 con 0x7f321c139170 2023-10-03T10:18:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f3220eba700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f321c09a7e0 con 0x7f321c09e1d0 2023-10-03T10:18:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f321a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f321c09d6f0 0x7f321c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51692/0 (socket says 172.21.15.72:51692) 2023-10-03T10:18:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f321ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f321c139170 0x7f321c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f321a59c700 1 -- 172.21.15.72:0/28483290 learned_addr learned my addr 172.21.15.72:0/28483290 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f3219d9b700 1 --2- 172.21.15.72:0/28483290 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f321c09e1d0 0x7f321c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f321959a700 1 -- 172.21.15.72:0/28483290 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755180265 0 0) 0x7f321c09b120 con 0x7f321c09d6f0 2023-10-03T10:18:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f321959a700 1 -- 172.21.15.72:0/28483290 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32040035b0 con 0x7f321c09d6f0 2023-10-03T10:18:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f3219d9b700 1 -- 172.21.15.72:0/28483290 >> v2:172.21.15.72:3300/0 conn(0x7f321c139170 msgr2=0x7f321c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f3219d9b700 1 --2- 172.21.15.72:0/28483290 >> v2:172.21.15.72:3300/0 conn(0x7f321c139170 0x7f321c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f3219d9b700 1 -- 172.21.15.72:0/28483290 >> v1:172.21.15.72:6789/0 conn(0x7f321c09d6f0 legacy=0x7f321c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f3219d9b700 1 -- 172.21.15.72:0/28483290 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c09a500 con 0x7f321c09e1d0 2023-10-03T10:18:32.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.090+0000 7f3219d9b700 1 --2- 172.21.15.72:0/28483290 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f321c09e1d0 0x7f321c138c30 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3210009870 tx=0x7f3210009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fd3ccbb14fd8300 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.091+0000 7f321959a700 1 -- 172.21.15.72:0/28483290 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3210011830 con 0x7f321c09e1d0 2023-10-03T10:18:32.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.091+0000 7f321959a700 1 -- 172.21.15.72:0/28483290 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3210011990 con 0x7f321c09e1d0 2023-10-03T10:18:32.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.091+0000 7f321959a700 1 -- 172.21.15.72:0/28483290 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3210011d20 con 0x7f321c09e1d0 2023-10-03T10:18:32.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.091+0000 7f3220eba700 1 -- 172.21.15.72:0/28483290 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f321c09e1d0 msgr2=0x7f321c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.091+0000 7f3220eba700 1 --2- 172.21.15.72:0/28483290 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f321c09e1d0 0x7f321c138c30 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3210009870 tx=0x7f3210009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:32.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.092+0000 7f3220eba700 1 -- 172.21.15.72:0/28483290 shutdown_connections 2023-10-03T10:18:32.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.092+0000 7f3220eba700 1 --2- 172.21.15.72:0/28483290 >> v2:172.21.15.72:3300/0 conn(0x7f321c139170 0x7f321c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.092+0000 7f3220eba700 1 --2- 172.21.15.72:0/28483290 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f321c09e1d0 0x7f321c138c30 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.092+0000 7f3220eba700 1 -- 172.21.15.72:0/28483290 >> 172.21.15.72:0/28483290 conn(0x7f321c066f50 msgr2=0x7f321c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.092+0000 7f3220eba700 1 -- 172.21.15.72:0/28483290 shutdown_connections 2023-10-03T10:18:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.092+0000 7f3220eba700 1 -- 172.21.15.72:0/28483290 wait complete. 2023-10-03T10:18:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.093+0000 7f3220eba700 1 Processor -- start 2023-10-03T10:18:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.093+0000 7f3220eba700 1 -- start start 2023-10-03T10:18:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.093+0000 7f3220eba700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f321c09d6f0 0x7f321c120730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.093+0000 7f3220eba700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f321c09e1d0 0x7f321c120c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.093+0000 7f3220eba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f321c139170 0x7f321c1211b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.093+0000 7f3220eba700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c136060 con 0x7f321c09e1d0 2023-10-03T10:18:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.093+0000 7f3220eba700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321c136620 con 0x7f321c139170 2023-10-03T10:18:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.093+0000 7f3220eba700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f321c124250 con 0x7f321c09d6f0 2023-10-03T10:18:32.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.093+0000 7f3219d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f321c09e1d0 0x7f321c120c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.093+0000 7f3219d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f321c09e1d0 0x7f321c120c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54486/0 (socket says 172.21.15.72:54486) 2023-10-03T10:18:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.093+0000 7f3219d9b700 1 -- 172.21.15.72:0/1540125181 learned_addr learned my addr 172.21.15.72:0/1540125181 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.093+0000 7f321a59c700 1 --2- 172.21.15.72:0/1540125181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f321c09d6f0 0x7f321c120730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.094+0000 7f3219d9b700 1 -- 172.21.15.72:0/1540125181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f321c09d6f0 msgr2=0x7f321c120730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.094+0000 7f3219d9b700 1 --2- 172.21.15.72:0/1540125181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f321c09d6f0 0x7f321c120730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.094+0000 7f3219d9b700 1 -- 172.21.15.72:0/1540125181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f321c139170 msgr2=0x7f321c1211b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.094+0000 7f3219d9b700 1 --2- 172.21.15.72:0/1540125181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f321c139170 0x7f321c1211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.094+0000 7f3219d9b700 1 -- 172.21.15.72:0/1540125181 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32100094a0 con 0x7f321c09e1d0 2023-10-03T10:18:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.094+0000 7f3219d9b700 1 --2- 172.21.15.72:0/1540125181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f321c09e1d0 0x7f321c120c70 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f3210000c00 tx=0x7f3210004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.094+0000 7f320affd700 1 -- 172.21.15.72:0/1540125181 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3210004590 con 0x7f321c09e1d0 2023-10-03T10:18:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.094+0000 7f320affd700 1 -- 172.21.15.72:0/1540125181 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321001f070 con 0x7f321c09e1d0 2023-10-03T10:18:32.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.094+0000 7f320affd700 1 -- 172.21.15.72:0/1540125181 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32100038c0 con 0x7f321c09e1d0 2023-10-03T10:18:32.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.094+0000 7f3220eba700 1 -- 172.21.15.72:0/1540125181 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321c071eb0 con 0x7f321c09e1d0 2023-10-03T10:18:32.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.094+0000 7f3220eba700 1 -- 172.21.15.72:0/1540125181 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321c122b40 con 0x7f321c09e1d0 2023-10-03T10:18:32.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.095+0000 7f320affd700 1 -- 172.21.15.72:0/1540125181 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3210003a20 con 0x7f321c09e1d0 2023-10-03T10:18:32.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.095+0000 7f3220eba700 1 -- 172.21.15.72:0/1540125181 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321c074ea0 con 0x7f321c09e1d0 2023-10-03T10:18:32.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.095+0000 7f320affd700 1 -- 172.21.15.72:0/1540125181 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3210021070 con 0x7f321c09e1d0 2023-10-03T10:18:32.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.104+0000 7f320affd700 1 -- 172.21.15.72:0/1540125181 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f32100253e0 con 0x7f321c09e1d0 2023-10-03T10:18:32.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.181+0000 7f2a6ab4c700 1 -- 172.21.15.72:0/566159452 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2a6412db90 con 0x7f2a64133e30 2023-10-03T10:18:32.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.181+0000 7f2a617fa700 1 -- 172.21.15.72:0/566159452 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2a50024070 con 0x7f2a64133e30 2023-10-03T10:18:32.182 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:32.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.183+0000 7f2a6ab4c700 1 -- 172.21.15.72:0/566159452 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a64133e30 msgr2=0x7f2a6409c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.183+0000 7f2a6ab4c700 1 --2- 172.21.15.72:0/566159452 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a64133e30 0x7f2a6409c810 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000c4d0 tx=0x7f2a5000c7e0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.184+0000 7f2a6ab4c700 1 -- 172.21.15.72:0/566159452 shutdown_connections 2023-10-03T10:18:32.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.184+0000 7f2a6ab4c700 1 --2- 172.21.15.72:0/566159452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a64134260 0x7f2a6409cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.184+0000 7f2a6ab4c700 1 --2- 172.21.15.72:0/566159452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a64133420 0x7f2a6409c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.184+0000 7f2a6ab4c700 1 --2- 172.21.15.72:0/566159452 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a64133e30 0x7f2a6409c810 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.184+0000 7f2a6ab4c700 1 -- 172.21.15.72:0/566159452 >> 172.21.15.72:0/566159452 conn(0x7f2a640a4210 msgr2=0x7f2a640a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.184+0000 7f2a6ab4c700 1 -- 172.21.15.72:0/566159452 shutdown_connections 2023-10-03T10:18:32.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.184+0000 7f2a6ab4c700 1 -- 172.21.15.72:0/566159452 wait complete. 2023-10-03T10:18:32.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:32.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.238+0000 7f3282bfd700 1 -- 172.21.15.72:0/2108337933 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f327c06c360 con 0x7f327c09d6f0 2023-10-03T10:18:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.238+0000 7f32797fa700 1 -- 172.21.15.72:0/2108337933 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3270019300 con 0x7f327c09d6f0 2023-10-03T10:18:32.239 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.240+0000 7f3282bfd700 1 -- 172.21.15.72:0/2108337933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f327c09d6f0 msgr2=0x7f327c1c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.240+0000 7f3282bfd700 1 --2- 172.21.15.72:0/2108337933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f327c09d6f0 0x7f327c1c5020 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f327000e9a0 tx=0x7f327000ecb0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.240+0000 7f3282bfd700 1 -- 172.21.15.72:0/2108337933 shutdown_connections 2023-10-03T10:18:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.240+0000 7f3282bfd700 1 --2- 172.21.15.72:0/2108337933 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f327c09e410 0x7f327c1c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.240+0000 7f3282bfd700 1 --2- 172.21.15.72:0/2108337933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f327c09d6f0 0x7f327c1c5020 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.240+0000 7f3282bfd700 1 --2- 172.21.15.72:0/2108337933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f327c09e000 0x7f327c1c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.240+0000 7f3282bfd700 1 -- 172.21.15.72:0/2108337933 >> 172.21.15.72:0/2108337933 conn(0x7f327c066f50 msgr2=0x7f327c1bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.240+0000 7f3282bfd700 1 -- 172.21.15.72:0/2108337933 shutdown_connections 2023-10-03T10:18:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.240+0000 7f3282bfd700 1 -- 172.21.15.72:0/2108337933 wait complete. 2023-10-03T10:18:32.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:32.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.273+0000 7f5f9e117700 1 -- 172.21.15.72:0/810471847 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5f98122250 con 0x7f5f9809de50 2023-10-03T10:18:32.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.273+0000 7f5f7ffff700 1 -- 172.21.15.72:0/810471847 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f88028070 con 0x7f5f9809de50 2023-10-03T10:18:32.274 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:32.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.275+0000 7f5f9e117700 1 -- 172.21.15.72:0/810471847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f9809de50 msgr2=0x7f5f9811eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.275+0000 7f5f9e117700 1 --2- 172.21.15.72:0/810471847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f9809de50 0x7f5f9811eb30 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5f88000c00 tx=0x7f5f88004750 comp rx=0 tx=0).stop 2023-10-03T10:18:32.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.275+0000 7f5f9e117700 1 -- 172.21.15.72:0/810471847 shutdown_connections 2023-10-03T10:18:32.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.275+0000 7f5f9e117700 1 --2- 172.21.15.72:0/810471847 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5f981338a0 0x7f5f9811f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.275+0000 7f5f9e117700 1 --2- 172.21.15.72:0/810471847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f9809de50 0x7f5f9811eb30 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.275+0000 7f5f9e117700 1 --2- 172.21.15.72:0/810471847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f9809e760 0x7f5f9811f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.275+0000 7f5f9e117700 1 -- 172.21.15.72:0/810471847 >> 172.21.15.72:0/810471847 conn(0x7f5f980a2aa0 msgr2=0x7f5f9809ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.275+0000 7f5f9e117700 1 -- 172.21.15.72:0/810471847 shutdown_connections 2023-10-03T10:18:32.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.275+0000 7f5f9e117700 1 -- 172.21.15.72:0/810471847 wait complete. 2023-10-03T10:18:32.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:32.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.297+0000 7f3220eba700 1 -- 172.21.15.72:0/1540125181 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f321c09f420 con 0x7f321c09e1d0 2023-10-03T10:18:32.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.297+0000 7f320affd700 1 -- 172.21.15.72:0/1540125181 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3210015070 con 0x7f321c09e1d0 2023-10-03T10:18:32.298 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:32.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.299+0000 7f3220eba700 1 -- 172.21.15.72:0/1540125181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f321c09e1d0 msgr2=0x7f321c120c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.299+0000 7f3220eba700 1 --2- 172.21.15.72:0/1540125181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f321c09e1d0 0x7f321c120c70 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f3210000c00 tx=0x7f3210004750 comp rx=0 tx=0).stop 2023-10-03T10:18:32.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.299+0000 7f3220eba700 1 -- 172.21.15.72:0/1540125181 shutdown_connections 2023-10-03T10:18:32.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.299+0000 7f3220eba700 1 --2- 172.21.15.72:0/1540125181 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f321c139170 0x7f321c1211b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.299+0000 7f3220eba700 1 --2- 172.21.15.72:0/1540125181 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f321c09d6f0 0x7f321c120730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.299+0000 7f3220eba700 1 --2- 172.21.15.72:0/1540125181 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f321c09e1d0 0x7f321c120c70 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.299+0000 7f3220eba700 1 -- 172.21.15.72:0/1540125181 >> 172.21.15.72:0/1540125181 conn(0x7f321c066f50 msgr2=0x7f321c136b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.299+0000 7f3220eba700 1 -- 172.21.15.72:0/1540125181 shutdown_connections 2023-10-03T10:18:32.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:32.299+0000 7f3220eba700 1 -- 172.21.15.72:0/1540125181 wait complete. 2023-10-03T10:18:32.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:33.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:33.253 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:33.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:33.312 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:33.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.339+0000 7fc55000d700 1 Processor -- start 2023-10-03T10:18:33.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.339+0000 7fc55000d700 1 -- start start 2023-10-03T10:18:33.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.340+0000 7fc55000d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc54806a770 0x7fc54806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.340+0000 7fc55000d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc548131d10 0x7fc548139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.340+0000 7fc55000d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54809ece0 con 0x7fc54806b080 2023-10-03T10:18:33.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.340+0000 7fc55000d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54809e760 con 0x7fc548131d10 2023-10-03T10:18:33.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.340+0000 7fc55000d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc54809e040 con 0x7fc54806a770 2023-10-03T10:18:33.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.340+0000 7fc54dda9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc54806a770 0x7fc54806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.340+0000 7fc54dda9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc54806a770 0x7fc54806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49882/0 (socket says 172.21.15.72:49882) 2023-10-03T10:18:33.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.340+0000 7fc54dda9700 1 -- 172.21.15.72:0/3121063054 learned_addr learned my addr 172.21.15.72:0/3121063054 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:33.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.340+0000 7fc54e5aa700 1 --2- 172.21.15.72:0/3121063054 >> v2:172.21.15.72:3300/0 conn(0x7fc548131d10 0x7fc548139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.341+0000 7fc54e5aa700 1 -- 172.21.15.72:0/3121063054 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc54806a770 msgr2=0x7fc54806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.341+0000 7fc54e5aa700 1 --2- 172.21.15.72:0/3121063054 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc54806a770 0x7fc54806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.341+0000 7fc54e5aa700 1 -- 172.21.15.72:0/3121063054 >> v1:172.21.15.72:6789/0 conn(0x7fc54806b080 legacy=0x7fc548131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.341+0000 7fc54e5aa700 1 -- 172.21.15.72:0/3121063054 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54809f630 con 0x7fc548131d10 2023-10-03T10:18:33.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.341+0000 7fc54cda7700 1 -- 172.21.15.72:0/3121063054 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010055533 0 0) 0x7fc54809ece0 con 0x7fc54806b080 2023-10-03T10:18:33.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.341+0000 7fc54dda9700 1 --2- 172.21.15.72:0/3121063054 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc54806a770 0x7fc54806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.341+0000 7fc54e5aa700 1 --2- 172.21.15.72:0/3121063054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc548131d10 0x7fc548139860 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fc54000f370 tx=0x7fc54000f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba9056cdca5b9e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.341+0000 7fc54cda7700 1 -- 172.21.15.72:0/3121063054 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc540012070 con 0x7fc548131d10 2023-10-03T10:18:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.341+0000 7fc54cda7700 1 -- 172.21.15.72:0/3121063054 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54000fe70 con 0x7fc548131d10 2023-10-03T10:18:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.341+0000 7fc54cda7700 1 -- 172.21.15.72:0/3121063054 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54000d2f0 con 0x7fc548131d10 2023-10-03T10:18:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.342+0000 7fc55000d700 1 -- 172.21.15.72:0/3121063054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc548131d10 msgr2=0x7fc548139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.342+0000 7fc55000d700 1 --2- 172.21.15.72:0/3121063054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc548131d10 0x7fc548139860 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fc54000f370 tx=0x7fc54000f680 comp rx=0 tx=0).stop 2023-10-03T10:18:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.342+0000 7fc55000d700 1 -- 172.21.15.72:0/3121063054 shutdown_connections 2023-10-03T10:18:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.342+0000 7fc55000d700 1 --2- 172.21.15.72:0/3121063054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc548131d10 0x7fc548139860 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.342+0000 7fc55000d700 1 --2- 172.21.15.72:0/3121063054 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc54806a770 0x7fc54806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.342+0000 7fc55000d700 1 -- 172.21.15.72:0/3121063054 >> 172.21.15.72:0/3121063054 conn(0x7fc548066f50 msgr2=0x7fc54809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.342+0000 7fc55000d700 1 -- 172.21.15.72:0/3121063054 shutdown_connections 2023-10-03T10:18:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.342+0000 7fc55000d700 1 -- 172.21.15.72:0/3121063054 wait complete. 2023-10-03T10:18:33.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.343+0000 7fc55000d700 1 Processor -- start 2023-10-03T10:18:33.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.343+0000 7fc55000d700 1 -- start start 2023-10-03T10:18:33.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.343+0000 7fc55000d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc54806a770 0x7fc54811e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.343+0000 7fc55000d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc54806b080 0x7fc54811e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.343+0000 7fc55000d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc548131d10 0x7fc54811eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.343+0000 7fc55000d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc548071e60 con 0x7fc54806a770 2023-10-03T10:18:33.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.343+0000 7fc55000d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc548131300 con 0x7fc548131d10 2023-10-03T10:18:33.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.343+0000 7fc55000d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc548121f40 con 0x7fc54806b080 2023-10-03T10:18:33.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.343+0000 7fc54dda9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc54806a770 0x7fc54811e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.343+0000 7fc54dda9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc54806a770 0x7fc54811e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54506/0 (socket says 172.21.15.72:54506) 2023-10-03T10:18:33.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.343+0000 7fc54dda9700 1 -- 172.21.15.72:0/2666892129 learned_addr learned my addr 172.21.15.72:0/2666892129 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:33.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.344+0000 7fc54e5aa700 1 --2- 172.21.15.72:0/2666892129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc548131d10 0x7fc54811eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.344+0000 7fc54d5a8700 1 --2- 172.21.15.72:0/2666892129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc54806b080 0x7fc54811e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.344+0000 7fc54dda9700 1 -- 172.21.15.72:0/2666892129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc54806b080 msgr2=0x7fc54811e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.344+0000 7fc54dda9700 1 --2- 172.21.15.72:0/2666892129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc54806b080 0x7fc54811e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.344+0000 7fc54dda9700 1 -- 172.21.15.72:0/2666892129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc548131d10 msgr2=0x7fc54811eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.344+0000 7fc54dda9700 1 --2- 172.21.15.72:0/2666892129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc548131d10 0x7fc54811eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.344+0000 7fc54dda9700 1 -- 172.21.15.72:0/2666892129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc544009550 con 0x7fc54806a770 2023-10-03T10:18:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.344+0000 7fc54e5aa700 1 --2- 172.21.15.72:0/2666892129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc548131d10 0x7fc54811eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.344+0000 7fc54dda9700 1 --2- 172.21.15.72:0/2666892129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc54806a770 0x7fc54811e320 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fc54400ebe0 tx=0x7fc54400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.344+0000 7fc53e7fc700 1 -- 172.21.15.72:0/2666892129 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54400c850 con 0x7fc54806a770 2023-10-03T10:18:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.344+0000 7fc53e7fc700 1 -- 172.21.15.72:0/2666892129 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54400c9b0 con 0x7fc54806a770 2023-10-03T10:18:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.344+0000 7fc55000d700 1 -- 172.21.15.72:0/2666892129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54000f050 con 0x7fc54806a770 2023-10-03T10:18:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.344+0000 7fc53e7fc700 1 -- 172.21.15.72:0/2666892129 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54400cd40 con 0x7fc54806a770 2023-10-03T10:18:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.344+0000 7fc55000d700 1 -- 172.21.15.72:0/2666892129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5481218a0 con 0x7fc54806a770 2023-10-03T10:18:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.345+0000 7fc53e7fc700 1 -- 172.21.15.72:0/2666892129 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc544013470 con 0x7fc54806a770 2023-10-03T10:18:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.345+0000 7fc53e7fc700 1 -- 172.21.15.72:0/2666892129 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc54403fd10 con 0x7fc54806a770 2023-10-03T10:18:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.346+0000 7fc55000d700 1 -- 172.21.15.72:0/2666892129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc548074ea0 con 0x7fc54806a770 2023-10-03T10:18:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.351+0000 7fc53e7fc700 1 -- 172.21.15.72:0/2666892129 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc54401b3b0 con 0x7fc54806a770 2023-10-03T10:18:33.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.387+0000 7f6b7b14f700 1 Processor -- start 2023-10-03T10:18:33.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.387+0000 7f6b7b14f700 1 -- start start 2023-10-03T10:18:33.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.388+0000 7f6b7b14f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b7409e1d0 0x7f6b74138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.388+0000 7f6b7b14f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6b74139170 0x7f6b7413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.388+0000 7f6b7b14f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7409b120 con 0x7f6b7409d6f0 2023-10-03T10:18:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.388+0000 7f6b7b14f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b7406b460 con 0x7f6b74139170 2023-10-03T10:18:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.388+0000 7f6b7b14f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7409a7e0 con 0x7f6b7409e1d0 2023-10-03T10:18:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.388+0000 7f6b73fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b7409e1d0 0x7f6b74138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.388+0000 7f6b73fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b7409e1d0 0x7f6b74138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49910/0 (socket says 172.21.15.72:49910) 2023-10-03T10:18:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.388+0000 7f6b73fff700 1 -- 172.21.15.72:0/1144771486 learned_addr learned my addr 172.21.15.72:0/1144771486 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.388+0000 7f6b796ec700 1 --2- 172.21.15.72:0/1144771486 >> v2:172.21.15.72:3300/0 conn(0x7f6b74139170 0x7f6b7413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.388+0000 7f6b796ec700 1 -- 172.21.15.72:0/1144771486 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b7409e1d0 msgr2=0x7f6b74138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.388+0000 7f6b796ec700 1 --2- 172.21.15.72:0/1144771486 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b7409e1d0 0x7f6b74138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.388+0000 7f6b796ec700 1 -- 172.21.15.72:0/1144771486 >> v1:172.21.15.72:6789/0 conn(0x7f6b7409d6f0 legacy=0x7f6b7409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.389+0000 7f6b796ec700 1 -- 172.21.15.72:0/1144771486 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7409a500 con 0x7f6b74139170 2023-10-03T10:18:33.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.389+0000 7f6b796ec700 1 --2- 172.21.15.72:0/1144771486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b74139170 0x7f6b7413b550 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c009d90 tx=0x7f6b6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba43a44c74a36fdd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.389+0000 7f6b737fe700 1 -- 172.21.15.72:0/1144771486 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c00e070 con 0x7f6b74139170 2023-10-03T10:18:33.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.389+0000 7f6b737fe700 1 -- 172.21.15.72:0/1144771486 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c00bb20 con 0x7f6b74139170 2023-10-03T10:18:33.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.389+0000 7f6b737fe700 1 -- 172.21.15.72:0/1144771486 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c012430 con 0x7f6b74139170 2023-10-03T10:18:33.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.390+0000 7f6b7b14f700 1 -- 172.21.15.72:0/1144771486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b74139170 msgr2=0x7f6b7413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.390+0000 7f6b7b14f700 1 --2- 172.21.15.72:0/1144771486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b74139170 0x7f6b7413b550 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c009d90 tx=0x7f6b6c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:33.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.390+0000 7f6b7b14f700 1 -- 172.21.15.72:0/1144771486 shutdown_connections 2023-10-03T10:18:33.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.390+0000 7f6b7b14f700 1 --2- 172.21.15.72:0/1144771486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b74139170 0x7f6b7413b550 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.390+0000 7f6b7b14f700 1 --2- 172.21.15.72:0/1144771486 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b7409e1d0 0x7f6b74138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.390+0000 7f6b7b14f700 1 -- 172.21.15.72:0/1144771486 >> 172.21.15.72:0/1144771486 conn(0x7f6b74066f50 msgr2=0x7f6b7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.390+0000 7f6b7b14f700 1 -- 172.21.15.72:0/1144771486 shutdown_connections 2023-10-03T10:18:33.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.390+0000 7f6b7b14f700 1 -- 172.21.15.72:0/1144771486 wait complete. 2023-10-03T10:18:33.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.391+0000 7f6b7b14f700 1 Processor -- start 2023-10-03T10:18:33.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.391+0000 7f6b7b14f700 1 -- start start 2023-10-03T10:18:33.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.391+0000 7f6b7b14f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b7409d6f0 0x7f6b7411f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.391+0000 7f6b7b14f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b7409e1d0 0x7f6b7411f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.391+0000 7f6b7b14f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b74139170 0x7f6b741c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.391+0000 7f6b7b14f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74122510 con 0x7f6b7409d6f0 2023-10-03T10:18:33.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.391+0000 7f6b7b14f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74121ee0 con 0x7f6b7409e1d0 2023-10-03T10:18:33.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.391+0000 7f6b7b14f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b740a3b10 con 0x7f6b74139170 2023-10-03T10:18:33.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.391+0000 7f6b78eeb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b7409d6f0 0x7f6b7411f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b78eeb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b7409d6f0 0x7f6b7411f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54512/0 (socket says 172.21.15.72:54512) 2023-10-03T10:18:33.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b78eeb700 1 -- 172.21.15.72:0/3641805384 learned_addr learned my addr 172.21.15.72:0/3641805384 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:33.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b73fff700 1 --2- 172.21.15.72:0/3641805384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b7409e1d0 0x7f6b7411f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b796ec700 1 --2- 172.21.15.72:0/3641805384 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b74139170 0x7f6b741c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b78eeb700 1 -- 172.21.15.72:0/3641805384 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b74139170 msgr2=0x7f6b741c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b78eeb700 1 --2- 172.21.15.72:0/3641805384 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b74139170 0x7f6b741c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b78eeb700 1 -- 172.21.15.72:0/3641805384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b7409e1d0 msgr2=0x7f6b7411f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b78eeb700 1 --2- 172.21.15.72:0/3641805384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b7409e1d0 0x7f6b7411f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b78eeb700 1 -- 172.21.15.72:0/3641805384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c009a70 con 0x7f6b7409d6f0 2023-10-03T10:18:33.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b73fff700 1 --2- 172.21.15.72:0/3641805384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b7409e1d0 0x7f6b7411f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b78eeb700 1 --2- 172.21.15.72:0/3641805384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b7409d6f0 0x7f6b7411f340 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800c4e0 tx=0x7f6b6800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b717fa700 1 -- 172.21.15.72:0/3641805384 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680052d0 con 0x7f6b7409d6f0 2023-10-03T10:18:33.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b717fa700 1 -- 172.21.15.72:0/3641805384 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b68005430 con 0x7f6b7409d6f0 2023-10-03T10:18:33.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b717fa700 1 -- 172.21.15.72:0/3641805384 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680038c0 con 0x7f6b7409d6f0 2023-10-03T10:18:33.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b7b14f700 1 -- 172.21.15.72:0/3641805384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7409c710 con 0x7f6b7409d6f0 2023-10-03T10:18:33.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.392+0000 7f6b7b14f700 1 -- 172.21.15.72:0/3641805384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7411fdc0 con 0x7f6b7409d6f0 2023-10-03T10:18:33.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.393+0000 7f6b717fa700 1 -- 172.21.15.72:0/3641805384 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6b68003a20 con 0x7f6b7409d6f0 2023-10-03T10:18:33.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.393+0000 7f6b717fa700 1 -- 172.21.15.72:0/3641805384 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6b6803ea10 con 0x7f6b7409d6f0 2023-10-03T10:18:33.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.394+0000 7f6b7b14f700 1 -- 172.21.15.72:0/3641805384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b74122100 con 0x7f6b7409d6f0 2023-10-03T10:18:33.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.402+0000 7f6b717fa700 1 -- 172.21.15.72:0/3641805384 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6b68017080 con 0x7f6b7409d6f0 2023-10-03T10:18:33.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.427+0000 7fab28b8a700 1 Processor -- start 2023-10-03T10:18:33.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.427+0000 7fab28b8a700 1 -- start start 2023-10-03T10:18:33.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab28b8a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab2409d6f0 0x7fab2409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab28b8a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab2409e000 0x7fab24130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab28b8a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab2409e410 0x7fab24130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab28b8a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2409f520 con 0x7fab2409d6f0 2023-10-03T10:18:33.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab28b8a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2409f130 con 0x7fab2409e000 2023-10-03T10:18:33.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab28b8a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab2409e930 con 0x7fab2409e410 2023-10-03T10:18:33.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab22d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab2409e410 0x7fab24130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab22d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab2409e410 0x7fab24130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49918/0 (socket says 172.21.15.72:49918) 2023-10-03T10:18:33.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab22d9d700 1 -- 172.21.15.72:0/3798271503 learned_addr learned my addr 172.21.15.72:0/3798271503 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:33.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab2259c700 1 --2- 172.21.15.72:0/3798271503 >> v2:172.21.15.72:3300/0 conn(0x7fab2409d6f0 0x7fab2409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab21d9b700 1 --2- 172.21.15.72:0/3798271503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab2409e000 0x7fab24130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab22d9d700 1 -- 172.21.15.72:0/3798271503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab2409e000 msgr2=0x7fab24130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab22d9d700 1 --2- 172.21.15.72:0/3798271503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab2409e000 0x7fab24130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab22d9d700 1 -- 172.21.15.72:0/3798271503 >> v2:172.21.15.72:3300/0 conn(0x7fab2409d6f0 msgr2=0x7fab2409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab22d9d700 1 --2- 172.21.15.72:0/3798271503 >> v2:172.21.15.72:3300/0 conn(0x7fab2409d6f0 0x7fab2409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.428+0000 7fab22d9d700 1 -- 172.21.15.72:0/3798271503 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2409b2d0 con 0x7fab2409e410 2023-10-03T10:18:33.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.429+0000 7fab22d9d700 1 --2- 172.21.15.72:0/3798271503 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab2409e410 0x7fab24130ba0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009e80 tx=0x7fab1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f2fca0558339482 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.429+0000 7fab2159a700 1 -- 172.21.15.72:0/3798271503 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c00e070 con 0x7fab2409e410 2023-10-03T10:18:33.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.429+0000 7fab2159a700 1 -- 172.21.15.72:0/3798271503 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c00b8d0 con 0x7fab2409e410 2023-10-03T10:18:33.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.429+0000 7fab2159a700 1 -- 172.21.15.72:0/3798271503 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c00bc60 con 0x7fab2409e410 2023-10-03T10:18:33.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.429+0000 7fab28b8a700 1 -- 172.21.15.72:0/3798271503 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab2409e410 msgr2=0x7fab24130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.429+0000 7fab28b8a700 1 --2- 172.21.15.72:0/3798271503 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab2409e410 0x7fab24130ba0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009e80 tx=0x7fab1c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:33.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.430+0000 7fab28b8a700 1 -- 172.21.15.72:0/3798271503 shutdown_connections 2023-10-03T10:18:33.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.430+0000 7fab28b8a700 1 --2- 172.21.15.72:0/3798271503 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab2409e410 0x7fab24130ba0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.430+0000 7fab28b8a700 1 --2- 172.21.15.72:0/3798271503 >> v2:172.21.15.72:3300/0 conn(0x7fab2409d6f0 0x7fab2409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.430+0000 7fab28b8a700 1 --2- 172.21.15.72:0/3798271503 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab2409e000 0x7fab24130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.430+0000 7fab28b8a700 1 -- 172.21.15.72:0/3798271503 >> 172.21.15.72:0/3798271503 conn(0x7fab24066f50 msgr2=0x7fab2409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.430+0000 7fab28b8a700 1 -- 172.21.15.72:0/3798271503 shutdown_connections 2023-10-03T10:18:33.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.430+0000 7fab28b8a700 1 -- 172.21.15.72:0/3798271503 wait complete. 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.431+0000 7fab28b8a700 1 Processor -- start 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.431+0000 7fab28b8a700 1 -- start start 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.431+0000 7fab28b8a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab2409d6f0 0x7fab2411e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.431+0000 7fab28b8a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab2409e000 0x7fab2411e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.431+0000 7fab28b8a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab2409e410 0x7fab2411eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.431+0000 7fab28b8a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab24130470 con 0x7fab2409e000 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.431+0000 7fab28b8a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab241202c0 con 0x7fab2409d6f0 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.431+0000 7fab28b8a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab24120ef0 con 0x7fab2409e410 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.431+0000 7fab22d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab2409e410 0x7fab2411eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.431+0000 7fab22d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab2409e410 0x7fab2411eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49922/0 (socket says 172.21.15.72:49922) 2023-10-03T10:18:33.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.431+0000 7fab22d9d700 1 -- 172.21.15.72:0/1163317983 learned_addr learned my addr 172.21.15.72:0/1163317983 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:33.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.431+0000 7fab2259c700 1 --2- 172.21.15.72:0/1163317983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab2409d6f0 0x7fab2411e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.432+0000 7fab21d9b700 1 --2- 172.21.15.72:0/1163317983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab2409e000 0x7fab2411e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.432+0000 7fab22d9d700 1 -- 172.21.15.72:0/1163317983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab2409d6f0 msgr2=0x7fab2411e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.432+0000 7fab22d9d700 1 --2- 172.21.15.72:0/1163317983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab2409d6f0 0x7fab2411e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.432+0000 7fab22d9d700 1 -- 172.21.15.72:0/1163317983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab2409e000 msgr2=0x7fab2411e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.432+0000 7fab22d9d700 1 --2- 172.21.15.72:0/1163317983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab2409e000 0x7fab2411e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.432+0000 7fab22d9d700 1 -- 172.21.15.72:0/1163317983 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c009b30 con 0x7fab2409e410 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.432+0000 7fab21d9b700 1 --2- 172.21.15.72:0/1163317983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab2409e000 0x7fab2411e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.432+0000 7fab2259c700 1 --2- 172.21.15.72:0/1163317983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab2409d6f0 0x7fab2411e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.432+0000 7fab22d9d700 1 --2- 172.21.15.72:0/1163317983 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab2409e410 0x7fab2411eb10 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fab2409f270 tx=0x7fab1c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.432+0000 7fab12ffd700 1 -- 172.21.15.72:0/1163317983 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c004450 con 0x7fab2409e410 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.432+0000 7fab28b8a700 1 -- 172.21.15.72:0/1163317983 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab24121340 con 0x7fab2409e410 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.432+0000 7fab12ffd700 1 -- 172.21.15.72:0/1163317983 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c0045d0 con 0x7fab2409e410 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.432+0000 7fab12ffd700 1 -- 172.21.15.72:0/1163317983 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c003e10 con 0x7fab2409e410 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.432+0000 7fab28b8a700 1 -- 172.21.15.72:0/1163317983 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab241218d0 con 0x7fab2409e410 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.433+0000 7fab12ffd700 1 -- 172.21.15.72:0/1163317983 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab1c01c410 con 0x7fab2409e410 2023-10-03T10:18:33.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.433+0000 7fab12ffd700 1 -- 172.21.15.72:0/1163317983 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fab1c041220 con 0x7fab2409e410 2023-10-03T10:18:33.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.433+0000 7fab28b8a700 1 -- 172.21.15.72:0/1163317983 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab24074ea0 con 0x7fab2409e410 2023-10-03T10:18:33.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.442+0000 7fab12ffd700 1 -- 172.21.15.72:0/1163317983 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab1c02a070 con 0x7fab2409e410 2023-10-03T10:18:33.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.474+0000 7f9abce6d700 1 Processor -- start 2023-10-03T10:18:33.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.474+0000 7f9abce6d700 1 -- start start 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.475+0000 7f9abce6d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ab809e850 0x7f9ab809ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.475+0000 7f9abce6d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9ab809f590 0x7f9ab813faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.475+0000 7f9abce6d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab809aa30 con 0x7f9ab809f160 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.475+0000 7f9abce6d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab806c930 con 0x7f9ab809f590 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.475+0000 7f9abce6d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab806bf30 con 0x7f9ab809e850 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.475+0000 7f9ab659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ab809e850 0x7f9ab809ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.475+0000 7f9ab659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ab809e850 0x7f9ab809ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56754/0 (socket says 172.21.15.72:56754) 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.475+0000 7f9ab659c700 1 -- 172.21.15.72:0/3967285380 learned_addr learned my addr 172.21.15.72:0/3967285380 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.475+0000 7f9ab6d9d700 1 --2- 172.21.15.72:0/3967285380 >> v2:172.21.15.72:3300/0 conn(0x7f9ab809f590 0x7f9ab813faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.476+0000 7f9ab6d9d700 1 -- 172.21.15.72:0/3967285380 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ab809e850 msgr2=0x7f9ab809ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.476+0000 7f9ab6d9d700 1 --2- 172.21.15.72:0/3967285380 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ab809e850 0x7f9ab809ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.476+0000 7f9ab6d9d700 1 -- 172.21.15.72:0/3967285380 >> v1:172.21.15.72:6789/0 conn(0x7f9ab809f160 legacy=0x7f9ab813c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.476+0000 7f9ab559a700 1 -- 172.21.15.72:0/3967285380 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388185835 0 0) 0x7f9ab809aa30 con 0x7f9ab809f160 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.476+0000 7f9ab6d9d700 1 -- 172.21.15.72:0/3967285380 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab80a0250 con 0x7f9ab809f590 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.476+0000 7f9ab659c700 1 --2- 172.21.15.72:0/3967285380 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ab809e850 0x7f9ab809ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.476+0000 7f9ab6d9d700 1 --2- 172.21.15.72:0/3967285380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ab809f590 0x7f9ab813faa0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009d90 tx=0x7f9ab000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba22dfb82692e0f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.476+0000 7f9ab559a700 1 -- 172.21.15.72:0/3967285380 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000e070 con 0x7f9ab809f590 2023-10-03T10:18:33.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.476+0000 7f9ab559a700 1 -- 172.21.15.72:0/3967285380 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab000bb20 con 0x7f9ab809f590 2023-10-03T10:18:33.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.476+0000 7f9ab559a700 1 -- 172.21.15.72:0/3967285380 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0012430 con 0x7f9ab809f590 2023-10-03T10:18:33.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.476+0000 7f9abce6d700 1 -- 172.21.15.72:0/3967285380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ab809f590 msgr2=0x7f9ab813faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.477+0000 7f9abce6d700 1 --2- 172.21.15.72:0/3967285380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ab809f590 0x7f9ab813faa0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009d90 tx=0x7f9ab000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:33.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.477+0000 7f9abce6d700 1 -- 172.21.15.72:0/3967285380 shutdown_connections 2023-10-03T10:18:33.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.477+0000 7f9abce6d700 1 --2- 172.21.15.72:0/3967285380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ab809f590 0x7f9ab813faa0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.477+0000 7f9abce6d700 1 --2- 172.21.15.72:0/3967285380 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ab809e850 0x7f9ab809ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.477+0000 7f9abce6d700 1 -- 172.21.15.72:0/3967285380 >> 172.21.15.72:0/3967285380 conn(0x7f9ab80a3f70 msgr2=0x7f9ab80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.477+0000 7f9abce6d700 1 -- 172.21.15.72:0/3967285380 shutdown_connections 2023-10-03T10:18:33.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.477+0000 7f9abce6d700 1 -- 172.21.15.72:0/3967285380 wait complete. 2023-10-03T10:18:33.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.478+0000 7f9abce6d700 1 Processor -- start 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.478+0000 7f9abce6d700 1 -- start start 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.478+0000 7f9abce6d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ab809e850 0x7f9ab81cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.478+0000 7f9abce6d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ab809f160 0x7f9ab81ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.478+0000 7f9abce6d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ab809f590 0x7f9ab81cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.478+0000 7f9abce6d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab81bfe80 con 0x7f9ab809e850 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.478+0000 7f9abce6d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab806f810 con 0x7f9ab809f160 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.478+0000 7f9abce6d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80a0490 con 0x7f9ab809f590 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.478+0000 7f9ab659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ab809e850 0x7f9ab81cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.478+0000 7f9ab659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ab809e850 0x7f9ab81cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54552/0 (socket says 172.21.15.72:54552) 2023-10-03T10:18:33.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.478+0000 7f9ab659c700 1 -- 172.21.15.72:0/1587172570 learned_addr learned my addr 172.21.15.72:0/1587172570 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:33.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.479+0000 7f9ab659c700 1 -- 172.21.15.72:0/1587172570 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ab809f590 msgr2=0x7f9ab81cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.479+0000 7f9ab659c700 1 --2- 172.21.15.72:0/1587172570 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ab809f590 0x7f9ab81cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.479+0000 7f9ab659c700 1 -- 172.21.15.72:0/1587172570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ab809f160 msgr2=0x7f9ab81ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.479+0000 7f9ab659c700 1 --2- 172.21.15.72:0/1587172570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ab809f160 0x7f9ab81ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.479+0000 7f9ab659c700 1 -- 172.21.15.72:0/1587172570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa8009550 con 0x7f9ab809e850 2023-10-03T10:18:33.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.479+0000 7f9ab659c700 1 --2- 172.21.15.72:0/1587172570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ab809e850 0x7f9ab81cc690 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800ebe0 tx=0x7f9aa8009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.479+0000 7f9aa6ffd700 1 -- 172.21.15.72:0/1587172570 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa800c8b0 con 0x7f9ab809e850 2023-10-03T10:18:33.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.479+0000 7f9aa6ffd700 1 -- 172.21.15.72:0/1587172570 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa800ca10 con 0x7f9ab809e850 2023-10-03T10:18:33.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.479+0000 7f9aa6ffd700 1 -- 172.21.15.72:0/1587172570 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa800cd80 con 0x7f9ab809e850 2023-10-03T10:18:33.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.479+0000 7f9abce6d700 1 -- 172.21.15.72:0/1587172570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab0009a70 con 0x7f9ab809e850 2023-10-03T10:18:33.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.479+0000 7f9abce6d700 1 -- 172.21.15.72:0/1587172570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab81ad590 con 0x7f9ab809e850 2023-10-03T10:18:33.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.480+0000 7f9aa6ffd700 1 -- 172.21.15.72:0/1587172570 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9aa8013470 con 0x7f9ab809e850 2023-10-03T10:18:33.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.480+0000 7f9aa6ffd700 1 -- 172.21.15.72:0/1587172570 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9aa803fca0 con 0x7f9ab809e850 2023-10-03T10:18:33.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.480+0000 7f9abce6d700 1 -- 172.21.15.72:0/1587172570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab81ae830 con 0x7f9ab809e850 2023-10-03T10:18:33.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.489+0000 7f9aa6ffd700 1 -- 172.21.15.72:0/1587172570 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ab81ae830 con 0x7f9ab809e850 2023-10-03T10:18:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.589+0000 7fc55000d700 1 -- 172.21.15.72:0/2666892129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc548121670 con 0x7fc54806a770 2023-10-03T10:18:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.589+0000 7fc53e7fc700 1 -- 172.21.15.72:0/2666892129 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc544024350 con 0x7fc54806a770 2023-10-03T10:18:33.590 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:33.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.591+0000 7fc55000d700 1 -- 172.21.15.72:0/2666892129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc54806a770 msgr2=0x7fc54811e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.591+0000 7fc55000d700 1 --2- 172.21.15.72:0/2666892129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc54806a770 0x7fc54811e320 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fc54400ebe0 tx=0x7fc54400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.591+0000 7fc55000d700 1 -- 172.21.15.72:0/2666892129 shutdown_connections 2023-10-03T10:18:33.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.592+0000 7fc55000d700 1 --2- 172.21.15.72:0/2666892129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc54806a770 0x7fc54811e320 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.592+0000 7fc55000d700 1 --2- 172.21.15.72:0/2666892129 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc548131d10 0x7fc54811eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.592+0000 7fc55000d700 1 --2- 172.21.15.72:0/2666892129 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc54806b080 0x7fc54811e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.592+0000 7fc55000d700 1 -- 172.21.15.72:0/2666892129 >> 172.21.15.72:0/2666892129 conn(0x7fc548066f50 msgr2=0x7fc5480a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.592+0000 7fc55000d700 1 -- 172.21.15.72:0/2666892129 shutdown_connections 2023-10-03T10:18:33.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.592+0000 7fc55000d700 1 -- 172.21.15.72:0/2666892129 wait complete. 2023-10-03T10:18:33.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.602+0000 7f6b7b14f700 1 -- 172.21.15.72:0/3641805384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6b74074ea0 con 0x7f6b7409d6f0 2023-10-03T10:18:33.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.602+0000 7f6b717fa700 1 -- 172.21.15.72:0/3641805384 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6b68018260 con 0x7f6b7409d6f0 2023-10-03T10:18:33.603 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:33.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:33.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.604+0000 7f6b7b14f700 1 -- 172.21.15.72:0/3641805384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b7409d6f0 msgr2=0x7f6b7411f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.604+0000 7f6b7b14f700 1 --2- 172.21.15.72:0/3641805384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b7409d6f0 0x7f6b7411f340 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800c4e0 tx=0x7f6b6800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.605+0000 7f6b7b14f700 1 -- 172.21.15.72:0/3641805384 shutdown_connections 2023-10-03T10:18:33.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.605+0000 7f6b7b14f700 1 --2- 172.21.15.72:0/3641805384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b7409d6f0 0x7f6b7411f340 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.605+0000 7f6b7b14f700 1 --2- 172.21.15.72:0/3641805384 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6b74139170 0x7f6b741c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.605+0000 7f6b7b14f700 1 --2- 172.21.15.72:0/3641805384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6b7409e1d0 0x7f6b7411f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.605+0000 7f6b7b14f700 1 -- 172.21.15.72:0/3641805384 >> 172.21.15.72:0/3641805384 conn(0x7f6b74066f50 msgr2=0x7f6b74136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.605+0000 7f6b7b14f700 1 -- 172.21.15.72:0/3641805384 shutdown_connections 2023-10-03T10:18:33.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.605+0000 7f6b7b14f700 1 -- 172.21.15.72:0/3641805384 wait complete. 2023-10-03T10:18:33.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:33.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.646+0000 7fab28b8a700 1 -- 172.21.15.72:0/1163317983 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fab240a1f90 con 0x7fab2409e410 2023-10-03T10:18:33.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.646+0000 7fab12ffd700 1 -- 172.21.15.72:0/1163317983 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab1c034090 con 0x7fab2409e410 2023-10-03T10:18:33.647 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:33.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.648+0000 7fab28b8a700 1 -- 172.21.15.72:0/1163317983 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab2409e410 msgr2=0x7fab2411eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.648+0000 7fab28b8a700 1 --2- 172.21.15.72:0/1163317983 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab2409e410 0x7fab2411eb10 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fab2409f270 tx=0x7fab1c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.648+0000 7fab28b8a700 1 -- 172.21.15.72:0/1163317983 shutdown_connections 2023-10-03T10:18:33.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.648+0000 7fab28b8a700 1 --2- 172.21.15.72:0/1163317983 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fab2409e410 0x7fab2411eb10 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.648+0000 7fab28b8a700 1 --2- 172.21.15.72:0/1163317983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab2409d6f0 0x7fab2411e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.648+0000 7fab28b8a700 1 --2- 172.21.15.72:0/1163317983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab2409e000 0x7fab2411e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.648+0000 7fab28b8a700 1 -- 172.21.15.72:0/1163317983 >> 172.21.15.72:0/1163317983 conn(0x7fab24066f50 msgr2=0x7fab24070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.648+0000 7fab28b8a700 1 -- 172.21.15.72:0/1163317983 shutdown_connections 2023-10-03T10:18:33.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.648+0000 7fab28b8a700 1 -- 172.21.15.72:0/1163317983 wait complete. 2023-10-03T10:18:33.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:33.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.717+0000 7f9abce6d700 1 -- 172.21.15.72:0/1587172570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9ab81ae830 con 0x7f9ab809e850 2023-10-03T10:18:33.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.717+0000 7f9aa6ffd700 1 -- 172.21.15.72:0/1587172570 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ab81ae830 con 0x7f9ab809e850 2023-10-03T10:18:33.718 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:33.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.719+0000 7f9abce6d700 1 -- 172.21.15.72:0/1587172570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ab809e850 msgr2=0x7f9ab81cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.719+0000 7f9abce6d700 1 --2- 172.21.15.72:0/1587172570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ab809e850 0x7f9ab81cc690 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800ebe0 tx=0x7f9aa8009e70 comp rx=0 tx=0).stop 2023-10-03T10:18:33.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.719+0000 7f9abce6d700 1 -- 172.21.15.72:0/1587172570 shutdown_connections 2023-10-03T10:18:33.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.719+0000 7f9abce6d700 1 --2- 172.21.15.72:0/1587172570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ab809e850 0x7f9ab81cc690 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.719+0000 7f9abce6d700 1 --2- 172.21.15.72:0/1587172570 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ab809f590 0x7f9ab81cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.719+0000 7f9abce6d700 1 --2- 172.21.15.72:0/1587172570 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ab809f160 0x7f9ab81ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.719+0000 7f9abce6d700 1 -- 172.21.15.72:0/1587172570 >> 172.21.15.72:0/1587172570 conn(0x7f9ab80a3f70 msgr2=0x7f9ab80a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.719+0000 7f9abce6d700 1 -- 172.21.15.72:0/1587172570 shutdown_connections 2023-10-03T10:18:33.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:33.719+0000 7f9abce6d700 1 -- 172.21.15.72:0/1587172570 wait complete. 2023-10-03T10:18:33.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:34.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:34.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:34.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:34.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:34.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.746+0000 7f0098c5a700 1 Processor -- start 2023-10-03T10:18:34.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.746+0000 7f0098c5a700 1 -- start start 2023-10-03T10:18:34.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f0098c5a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0094134630 0x7f0094136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f0098c5a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0094136f50 0x7f0094139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f0098c5a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f009409b4f0 con 0x7f0094131810 2023-10-03T10:18:34.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f0098c5a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00941313c0 con 0x7f0094134630 2023-10-03T10:18:34.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f0098c5a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f009406e8c0 con 0x7f0094136f50 2023-10-03T10:18:34.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f009259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0094131810 0x7f0094131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51742/0 (socket says 172.21.15.72:51742) 2023-10-03T10:18:34.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f009259c700 1 -- 172.21.15.72:0/963276483 learned_addr learned my addr 172.21.15.72:0/963276483 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:34.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f0092d9d700 1 --2- 172.21.15.72:0/963276483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0094136f50 0x7f0094139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f009159a700 1 -- 172.21.15.72:0/963276483 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895705462 0 0) 0x7f009409b4f0 con 0x7f0094131810 2023-10-03T10:18:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f009159a700 1 -- 172.21.15.72:0/963276483 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f007c0035b0 con 0x7f0094131810 2023-10-03T10:18:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f0091d9b700 1 --2- 172.21.15.72:0/963276483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0094134630 0x7f0094136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f0092d9d700 1 -- 172.21.15.72:0/963276483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0094134630 msgr2=0x7f0094136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f0092d9d700 1 --2- 172.21.15.72:0/963276483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0094134630 0x7f0094136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f0092d9d700 1 -- 172.21.15.72:0/963276483 >> v1:172.21.15.72:6789/0 conn(0x7f0094131810 legacy=0x7f0094131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f0092d9d700 1 -- 172.21.15.72:0/963276483 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0094071d20 con 0x7f0094136f50 2023-10-03T10:18:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.747+0000 7f0091d9b700 1 --2- 172.21.15.72:0/963276483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0094134630 0x7f0094136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.748+0000 7f0092d9d700 1 --2- 172.21.15.72:0/963276483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0094136f50 0x7f0094139330 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f008c009dc0 tx=0x7f008c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb71486926d0bf0d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.748+0000 7f009159a700 1 -- 172.21.15.72:0/963276483 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c00e070 con 0x7f0094136f50 2023-10-03T10:18:34.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.748+0000 7f009159a700 1 -- 172.21.15.72:0/963276483 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c00bb20 con 0x7f0094136f50 2023-10-03T10:18:34.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.748+0000 7f009159a700 1 -- 172.21.15.72:0/963276483 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c012430 con 0x7f0094136f50 2023-10-03T10:18:34.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.749+0000 7f0098c5a700 1 -- 172.21.15.72:0/963276483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0094136f50 msgr2=0x7f0094139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.749+0000 7f0098c5a700 1 --2- 172.21.15.72:0/963276483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0094136f50 0x7f0094139330 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f008c009dc0 tx=0x7f008c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:34.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.749+0000 7f0098c5a700 1 -- 172.21.15.72:0/963276483 shutdown_connections 2023-10-03T10:18:34.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.749+0000 7f0098c5a700 1 --2- 172.21.15.72:0/963276483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0094136f50 0x7f0094139330 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.749+0000 7f0098c5a700 1 --2- 172.21.15.72:0/963276483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0094134630 0x7f0094136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.749+0000 7f0098c5a700 1 -- 172.21.15.72:0/963276483 >> 172.21.15.72:0/963276483 conn(0x7f00940a2aa0 msgr2=0x7f00940a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.749+0000 7f0098c5a700 1 -- 172.21.15.72:0/963276483 shutdown_connections 2023-10-03T10:18:34.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.749+0000 7f0098c5a700 1 -- 172.21.15.72:0/963276483 wait complete. 2023-10-03T10:18:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.751+0000 7f0098c5a700 1 Processor -- start 2023-10-03T10:18:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.751+0000 7f0098c5a700 1 -- start start 2023-10-03T10:18:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.751+0000 7f0098c5a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0094131810 0x7f0094134a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.751+0000 7f0098c5a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0094134630 0x7f0094134f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.751+0000 7f0098c5a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0094136f50 0x7f0094135480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.751+0000 7f0098c5a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009412ed50 con 0x7f0094134630 2023-10-03T10:18:34.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.751+0000 7f0098c5a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009409bc00 con 0x7f0094136f50 2023-10-03T10:18:34.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.751+0000 7f0098c5a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f009409cdb0 con 0x7f0094131810 2023-10-03T10:18:34.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.751+0000 7f009259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0094131810 0x7f0094134a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.752+0000 7f009259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0094131810 0x7f0094134a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49960/0 (socket says 172.21.15.72:49960) 2023-10-03T10:18:34.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.752+0000 7f009259c700 1 -- 172.21.15.72:0/3268656593 learned_addr learned my addr 172.21.15.72:0/3268656593 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:34.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.752+0000 7f0091d9b700 1 --2- 172.21.15.72:0/3268656593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0094134630 0x7f0094134f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.752+0000 7f0092d9d700 1 --2- 172.21.15.72:0/3268656593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0094136f50 0x7f0094135480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.752+0000 7f009259c700 1 -- 172.21.15.72:0/3268656593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0094136f50 msgr2=0x7f0094135480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.752+0000 7f009259c700 1 --2- 172.21.15.72:0/3268656593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0094136f50 0x7f0094135480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.752+0000 7f009259c700 1 -- 172.21.15.72:0/3268656593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0094134630 msgr2=0x7f0094134f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.752+0000 7f009259c700 1 --2- 172.21.15.72:0/3268656593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0094134630 0x7f0094134f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.752+0000 7f009259c700 1 -- 172.21.15.72:0/3268656593 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c009a70 con 0x7f0094131810 2023-10-03T10:18:34.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.752+0000 7f009259c700 1 --2- 172.21.15.72:0/3268656593 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0094131810 0x7f0094134a00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f008400c700 tx=0x7f008400ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.752+0000 7f0082ffd700 1 -- 172.21.15.72:0/3268656593 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0084005d70 con 0x7f0094131810 2023-10-03T10:18:34.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.752+0000 7f0082ffd700 1 -- 172.21.15.72:0/3268656593 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00840070d0 con 0x7f0094131810 2023-10-03T10:18:34.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.752+0000 7f0098c5a700 1 -- 172.21.15.72:0/3268656593 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009406eb00 con 0x7f0094131810 2023-10-03T10:18:34.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.752+0000 7f0082ffd700 1 -- 172.21.15.72:0/3268656593 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0084007440 con 0x7f0094131810 2023-10-03T10:18:34.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.753+0000 7f0098c5a700 1 -- 172.21.15.72:0/3268656593 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0094136320 con 0x7f0094131810 2023-10-03T10:18:34.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.754+0000 7f0098c5a700 1 -- 172.21.15.72:0/3268656593 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00780052e0 con 0x7f0094131810 2023-10-03T10:18:34.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.754+0000 7f0082ffd700 1 -- 172.21.15.72:0/3268656593 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00840075a0 con 0x7f0094131810 2023-10-03T10:18:34.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.754+0000 7f0082ffd700 1 -- 172.21.15.72:0/3268656593 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0084010300 con 0x7f0094131810 2023-10-03T10:18:34.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.759+0000 7f0082ffd700 1 -- 172.21.15.72:0/3268656593 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0084044060 con 0x7f0094131810 2023-10-03T10:18:34.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.786+0000 7f52d0572700 1 Processor -- start 2023-10-03T10:18:34.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.786+0000 7f52d0572700 1 -- start start 2023-10-03T10:18:34.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.787+0000 7f52d0572700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c809d9f0 0x7f52c8136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.787+0000 7f52d0572700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52c8136a70 0x7f52c8138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.787+0000 7f52d0572700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c809e130 con 0x7f52c81316c0 2023-10-03T10:18:34.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.787+0000 7f52d0572700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c81321a0 con 0x7f52c8136a70 2023-10-03T10:18:34.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.787+0000 7f52d0572700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52c81312b0 con 0x7f52c809d9f0 2023-10-03T10:18:34.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.787+0000 7f52ce30e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f52c81316c0 0x7f52c8131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51758/0 (socket says 172.21.15.72:51758) 2023-10-03T10:18:34.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.787+0000 7f52ce30e700 1 -- 172.21.15.72:0/2926971882 learned_addr learned my addr 172.21.15.72:0/2926971882 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:34.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.787+0000 7f52ceb0f700 1 --2- 172.21.15.72:0/2926971882 >> v2:172.21.15.72:3300/0 conn(0x7f52c8136a70 0x7f52c8138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.787+0000 7f52cdb0d700 1 --2- 172.21.15.72:0/2926971882 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c809d9f0 0x7f52c8136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.787+0000 7f52cd30c700 1 -- 172.21.15.72:0/2926971882 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265539363 0 0) 0x7f52c4001110 con 0x7f52c81316c0 2023-10-03T10:18:34.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.788+0000 7f52cdb0d700 1 -- 172.21.15.72:0/2926971882 >> v2:172.21.15.72:3300/0 conn(0x7f52c8136a70 msgr2=0x7f52c8138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.788+0000 7f52cdb0d700 1 --2- 172.21.15.72:0/2926971882 >> v2:172.21.15.72:3300/0 conn(0x7f52c8136a70 0x7f52c8138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.788+0000 7f52cdb0d700 1 -- 172.21.15.72:0/2926971882 >> v1:172.21.15.72:6789/0 conn(0x7f52c81316c0 legacy=0x7f52c8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.788+0000 7f52cdb0d700 1 -- 172.21.15.72:0/2926971882 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c809f6e0 con 0x7f52c809d9f0 2023-10-03T10:18:34.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.788+0000 7f52ceb0f700 1 --2- 172.21.15.72:0/2926971882 >> v2:172.21.15.72:3300/0 conn(0x7f52c8136a70 0x7f52c8138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.788+0000 7f52cdb0d700 1 --2- 172.21.15.72:0/2926971882 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c809d9f0 0x7f52c8136530 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009840 tx=0x7f52b8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc548861f23d04d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.788+0000 7f52cd30c700 1 -- 172.21.15.72:0/2926971882 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8011830 con 0x7f52c809d9f0 2023-10-03T10:18:34.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.788+0000 7f52cd30c700 1 -- 172.21.15.72:0/2926971882 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b8011990 con 0x7f52c809d9f0 2023-10-03T10:18:34.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.788+0000 7f52cd30c700 1 -- 172.21.15.72:0/2926971882 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8011d20 con 0x7f52c809d9f0 2023-10-03T10:18:34.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.789+0000 7f52d0572700 1 -- 172.21.15.72:0/2926971882 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c809d9f0 msgr2=0x7f52c8136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.789+0000 7f52d0572700 1 --2- 172.21.15.72:0/2926971882 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c809d9f0 0x7f52c8136530 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009840 tx=0x7f52b8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:34.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.789+0000 7f52d0572700 1 -- 172.21.15.72:0/2926971882 shutdown_connections 2023-10-03T10:18:34.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.789+0000 7f52d0572700 1 --2- 172.21.15.72:0/2926971882 >> v2:172.21.15.72:3300/0 conn(0x7f52c8136a70 0x7f52c8138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.789+0000 7f52d0572700 1 --2- 172.21.15.72:0/2926971882 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c809d9f0 0x7f52c8136530 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.789+0000 7f52d0572700 1 -- 172.21.15.72:0/2926971882 >> 172.21.15.72:0/2926971882 conn(0x7f52c8066f50 msgr2=0x7f52c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.789+0000 7f52d0572700 1 -- 172.21.15.72:0/2926971882 shutdown_connections 2023-10-03T10:18:34.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.789+0000 7f52d0572700 1 -- 172.21.15.72:0/2926971882 wait complete. 2023-10-03T10:18:34.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.791+0000 7f52d0572700 1 Processor -- start 2023-10-03T10:18:34.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.791+0000 7f52d0572700 1 -- start start 2023-10-03T10:18:34.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.791+0000 7f52d0572700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c809d9f0 0x7f52c812ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.791+0000 7f52d0572700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c81316c0 0x7f52c8134390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.791+0000 7f52d0572700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c8136a70 0x7f52c81348d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.791+0000 7f52d0572700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c812b900 con 0x7f52c81316c0 2023-10-03T10:18:34.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.791+0000 7f52d0572700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c8136120 con 0x7f52c809d9f0 2023-10-03T10:18:34.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.791+0000 7f52d0572700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52c8072650 con 0x7f52c8136a70 2023-10-03T10:18:34.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52ceb0f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c8136a70 0x7f52c81348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52ceb0f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c8136a70 0x7f52c81348d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:49984/0 (socket says 172.21.15.72:49984) 2023-10-03T10:18:34.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52ceb0f700 1 -- 172.21.15.72:0/3099252980 learned_addr learned my addr 172.21.15.72:0/3099252980 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:34.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52cdb0d700 1 --2- 172.21.15.72:0/3099252980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c81316c0 0x7f52c8134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52cdb0d700 1 -- 172.21.15.72:0/3099252980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c8136a70 msgr2=0x7f52c81348d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52cdb0d700 1 --2- 172.21.15.72:0/3099252980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c8136a70 0x7f52c81348d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52cdb0d700 1 -- 172.21.15.72:0/3099252980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c809d9f0 msgr2=0x7f52c812ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52cdb0d700 1 --2- 172.21.15.72:0/3099252980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c809d9f0 0x7f52c812ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52cdb0d700 1 -- 172.21.15.72:0/3099252980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c0009a70 con 0x7f52c81316c0 2023-10-03T10:18:34.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52ceb0f700 1 --2- 172.21.15.72:0/3099252980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c8136a70 0x7f52c81348d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52cdb0d700 1 --2- 172.21.15.72:0/3099252980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c81316c0 0x7f52c8134390 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f52b8016000 tx=0x7f52b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52beffd700 1 -- 172.21.15.72:0/3099252980 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8004380 con 0x7f52c81316c0 2023-10-03T10:18:34.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52beffd700 1 -- 172.21.15.72:0/3099252980 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b801f070 con 0x7f52c81316c0 2023-10-03T10:18:34.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52d0572700 1 -- 172.21.15.72:0/3099252980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b80094a0 con 0x7f52c81316c0 2023-10-03T10:18:34.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52beffd700 1 -- 172.21.15.72:0/3099252980 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b80036a0 con 0x7f52c81316c0 2023-10-03T10:18:34.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.792+0000 7f52d0572700 1 -- 172.21.15.72:0/3099252980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c809bf40 con 0x7f52c81316c0 2023-10-03T10:18:34.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.793+0000 7f52beffd700 1 -- 172.21.15.72:0/3099252980 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52b8021030 con 0x7f52c81316c0 2023-10-03T10:18:34.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.793+0000 7f52d0572700 1 -- 172.21.15.72:0/3099252980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b00052e0 con 0x7f52c81316c0 2023-10-03T10:18:34.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.794+0000 7f52beffd700 1 -- 172.21.15.72:0/3099252980 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f52b8040810 con 0x7f52c81316c0 2023-10-03T10:18:34.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.802+0000 7f52beffd700 1 -- 172.21.15.72:0/3099252980 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52b80239c0 con 0x7f52c81316c0 2023-10-03T10:18:34.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.838+0000 7f8e977fa700 1 Processor -- start 2023-10-03T10:18:34.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.838+0000 7f8e977fa700 1 -- start start 2023-10-03T10:18:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e977fa700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e900a0a30 0x7f8e900a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e977fa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e90138d80 0x7f8e9013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e977fa700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e900a2a70 con 0x7f8e9009d630 2023-10-03T10:18:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e977fa700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e900a01d0 con 0x7f8e900a0a30 2023-10-03T10:18:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e977fa700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9009e2b0 con 0x7f8e90138d80 2023-10-03T10:18:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e94d95700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8e9009d630 0x7f8e900a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51764/0 (socket says 172.21.15.72:51764) 2023-10-03T10:18:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e94d95700 1 -- 172.21.15.72:0/3874918191 learned_addr learned my addr 172.21.15.72:0/3874918191 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e95596700 1 --2- 172.21.15.72:0/3874918191 >> v2:172.21.15.72:3300/0 conn(0x7f8e900a0a30 0x7f8e900a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e95d97700 1 --2- 172.21.15.72:0/3874918191 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e90138d80 0x7f8e9013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e95596700 1 -- 172.21.15.72:0/3874918191 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e90138d80 msgr2=0x7f8e9013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e95596700 1 --2- 172.21.15.72:0/3874918191 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e90138d80 0x7f8e9013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e95596700 1 -- 172.21.15.72:0/3874918191 >> v1:172.21.15.72:6789/0 conn(0x7f8e9009d630 legacy=0x7f8e900a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e95596700 1 -- 172.21.15.72:0/3874918191 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9009dc50 con 0x7f8e900a0a30 2023-10-03T10:18:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e87fff700 1 -- 172.21.15.72:0/3874918191 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073459111 0 0) 0x7f8e900a2a70 con 0x7f8e9009d630 2023-10-03T10:18:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e95d97700 1 --2- 172.21.15.72:0/3874918191 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e90138d80 0x7f8e9013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.839+0000 7f8e95596700 1 --2- 172.21.15.72:0/3874918191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e900a0a30 0x7f8e900a0e00 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009840 tx=0x7f8e8c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896cfd127f04fe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.840+0000 7f8e87fff700 1 -- 172.21.15.72:0/3874918191 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c011830 con 0x7f8e900a0a30 2023-10-03T10:18:34.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.840+0000 7f8e87fff700 1 -- 172.21.15.72:0/3874918191 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c011990 con 0x7f8e900a0a30 2023-10-03T10:18:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.840+0000 7f8e87fff700 1 -- 172.21.15.72:0/3874918191 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c011d20 con 0x7f8e900a0a30 2023-10-03T10:18:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.840+0000 7f8e977fa700 1 -- 172.21.15.72:0/3874918191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e900a0a30 msgr2=0x7f8e900a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.840+0000 7f8e977fa700 1 --2- 172.21.15.72:0/3874918191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e900a0a30 0x7f8e900a0e00 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009840 tx=0x7f8e8c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.840+0000 7f8e977fa700 1 -- 172.21.15.72:0/3874918191 shutdown_connections 2023-10-03T10:18:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.840+0000 7f8e977fa700 1 --2- 172.21.15.72:0/3874918191 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e90138d80 0x7f8e9013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.840+0000 7f8e977fa700 1 --2- 172.21.15.72:0/3874918191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e900a0a30 0x7f8e900a0e00 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.840+0000 7f8e977fa700 1 -- 172.21.15.72:0/3874918191 >> 172.21.15.72:0/3874918191 conn(0x7f8e900a3050 msgr2=0x7f8e900a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.840+0000 7f8e977fa700 1 -- 172.21.15.72:0/3874918191 shutdown_connections 2023-10-03T10:18:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.840+0000 7f8e977fa700 1 -- 172.21.15.72:0/3874918191 wait complete. 2023-10-03T10:18:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.841+0000 7f8e977fa700 1 Processor -- start 2023-10-03T10:18:34.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.841+0000 7f8e977fa700 1 -- start start 2023-10-03T10:18:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e977fa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e9009d630 0x7f8e90133620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e977fa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e900a0a30 0x7f8e90133b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e977fa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e90138d80 0x7f8e901340a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e977fa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e901360b0 con 0x7f8e900a0a30 2023-10-03T10:18:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e977fa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e90134a80 con 0x7f8e9009d630 2023-10-03T10:18:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e977fa700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e90136dd0 con 0x7f8e90138d80 2023-10-03T10:18:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e95596700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e9009d630 0x7f8e90133620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e95596700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e9009d630 0x7f8e90133620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56804/0 (socket says 172.21.15.72:56804) 2023-10-03T10:18:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e94d95700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e900a0a30 0x7f8e90133b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e95596700 1 -- 172.21.15.72:0/2410950764 learned_addr learned my addr 172.21.15.72:0/2410950764 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e95d97700 1 --2- 172.21.15.72:0/2410950764 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e90138d80 0x7f8e901340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e94d95700 1 -- 172.21.15.72:0/2410950764 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e90138d80 msgr2=0x7f8e901340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e94d95700 1 --2- 172.21.15.72:0/2410950764 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e90138d80 0x7f8e901340a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e94d95700 1 -- 172.21.15.72:0/2410950764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e9009d630 msgr2=0x7f8e90133620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e94d95700 1 --2- 172.21.15.72:0/2410950764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e9009d630 0x7f8e90133620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e94d95700 1 -- 172.21.15.72:0/2410950764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e88009a70 con 0x7f8e900a0a30 2023-10-03T10:18:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.842+0000 7f8e95596700 1 --2- 172.21.15.72:0/2410950764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e9009d630 0x7f8e90133620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.843+0000 7f8e94d95700 1 --2- 172.21.15.72:0/2410950764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e900a0a30 0x7f8e90133b60 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000c4b0 tx=0x7f8e8000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.843+0000 7f8e85ffb700 1 -- 172.21.15.72:0/2410950764 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e80004c80 con 0x7f8e900a0a30 2023-10-03T10:18:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.843+0000 7f8e977fa700 1 -- 172.21.15.72:0/2410950764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c0094a0 con 0x7f8e900a0a30 2023-10-03T10:18:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.843+0000 7f8e85ffb700 1 -- 172.21.15.72:0/2410950764 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e80004e00 con 0x7f8e900a0a30 2023-10-03T10:18:34.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.843+0000 7f8e85ffb700 1 -- 172.21.15.72:0/2410950764 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e80007310 con 0x7f8e900a0a30 2023-10-03T10:18:34.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.843+0000 7f8e977fa700 1 -- 172.21.15.72:0/2410950764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e900a0410 con 0x7f8e900a0a30 2023-10-03T10:18:34.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.844+0000 7f8e85ffb700 1 -- 172.21.15.72:0/2410950764 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e80007470 con 0x7f8e900a0a30 2023-10-03T10:18:34.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.844+0000 7f8e85ffb700 1 -- 172.21.15.72:0/2410950764 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8e80011360 con 0x7f8e900a0a30 2023-10-03T10:18:34.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.844+0000 7f8e977fa700 1 -- 172.21.15.72:0/2410950764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e900747f0 con 0x7f8e900a0a30 2023-10-03T10:18:34.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.853+0000 7f8e85ffb700 1 -- 172.21.15.72:0/2410950764 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e8000ce60 con 0x7f8e900a0a30 2023-10-03T10:18:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.868+0000 7f6ebe7da700 1 Processor -- start 2023-10-03T10:18:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.868+0000 7f6ebe7da700 1 -- start start 2023-10-03T10:18:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6ebe7da700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6eb809d6f0 0x7f6eb809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6ebe7da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809e000 0x7f6eb8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6ebe7da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb809e410 0x7f6eb8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6ebe7da700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb809f520 con 0x7f6eb809d6f0 2023-10-03T10:18:34.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6ebe7da700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb809f130 con 0x7f6eb809e000 2023-10-03T10:18:34.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6ebe7da700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb809e930 con 0x7f6eb809e410 2023-10-03T10:18:34.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6eb77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809e000 0x7f6eb8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6eb7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6eb809d6f0 0x7f6eb809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6eb77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809e000 0x7f6eb8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56806/0 (socket says 172.21.15.72:56806) 2023-10-03T10:18:34.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6eb77fe700 1 -- 172.21.15.72:0/1521780684 learned_addr learned my addr 172.21.15.72:0/1521780684 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:34.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6ebcd77700 1 --2- 172.21.15.72:0/1521780684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb809e410 0x7f6eb8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6eb77fe700 1 -- 172.21.15.72:0/1521780684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb809e410 msgr2=0x7f6eb8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6eb77fe700 1 --2- 172.21.15.72:0/1521780684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb809e410 0x7f6eb8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6eb77fe700 1 -- 172.21.15.72:0/1521780684 >> v2:172.21.15.72:3300/0 conn(0x7f6eb809d6f0 msgr2=0x7f6eb809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6eb77fe700 1 --2- 172.21.15.72:0/1521780684 >> v2:172.21.15.72:3300/0 conn(0x7f6eb809d6f0 0x7f6eb809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6eb77fe700 1 -- 172.21.15.72:0/1521780684 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb809b2d0 con 0x7f6eb809e000 2023-10-03T10:18:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.869+0000 7f6eb7fff700 1 --2- 172.21.15.72:0/1521780684 >> v2:172.21.15.72:3300/0 conn(0x7f6eb809d6f0 0x7f6eb809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.870+0000 7f6eb77fe700 1 --2- 172.21.15.72:0/1521780684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809e000 0x7f6eb8130660 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00b9a0 tx=0x7f6eac00bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4112017285f34bf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.870+0000 7f6eb6ffd700 1 -- 172.21.15.72:0/1521780684 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00caa0 con 0x7f6eb809e000 2023-10-03T10:18:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.870+0000 7f6eb6ffd700 1 -- 172.21.15.72:0/1521780684 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac00cc00 con 0x7f6eb809e000 2023-10-03T10:18:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.870+0000 7f6eb6ffd700 1 -- 172.21.15.72:0/1521780684 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00f460 con 0x7f6eb809e000 2023-10-03T10:18:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.871+0000 7f6ebe7da700 1 -- 172.21.15.72:0/1521780684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809e000 msgr2=0x7f6eb8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.871+0000 7f6ebe7da700 1 --2- 172.21.15.72:0/1521780684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809e000 0x7f6eb8130660 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00b9a0 tx=0x7f6eac00bcb0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.871+0000 7f6ebe7da700 1 -- 172.21.15.72:0/1521780684 shutdown_connections 2023-10-03T10:18:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.871+0000 7f6ebe7da700 1 --2- 172.21.15.72:0/1521780684 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb809e410 0x7f6eb8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.871+0000 7f6ebe7da700 1 --2- 172.21.15.72:0/1521780684 >> v2:172.21.15.72:3300/0 conn(0x7f6eb809d6f0 0x7f6eb809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.871+0000 7f6ebe7da700 1 --2- 172.21.15.72:0/1521780684 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809e000 0x7f6eb8130660 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.871+0000 7f6ebe7da700 1 -- 172.21.15.72:0/1521780684 >> 172.21.15.72:0/1521780684 conn(0x7f6eb8066f50 msgr2=0x7f6eb809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.871+0000 7f6ebe7da700 1 -- 172.21.15.72:0/1521780684 shutdown_connections 2023-10-03T10:18:34.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.871+0000 7f6ebe7da700 1 -- 172.21.15.72:0/1521780684 wait complete. 2023-10-03T10:18:34.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.872+0000 7f6ebe7da700 1 Processor -- start 2023-10-03T10:18:34.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.872+0000 7f6ebe7da700 1 -- start start 2023-10-03T10:18:34.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.873+0000 7f6ebe7da700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6eb809d6f0 0x7f6eb811e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.873+0000 7f6ebe7da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809e000 0x7f6eb811e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.873+0000 7f6ebe7da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb809e410 0x7f6eb811ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.873+0000 7f6ebe7da700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8121480 con 0x7f6eb809d6f0 2023-10-03T10:18:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.873+0000 7f6ebe7da700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb81204c0 con 0x7f6eb809e000 2023-10-03T10:18:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.873+0000 7f6ebe7da700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8121da0 con 0x7f6eb809e410 2023-10-03T10:18:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.873+0000 7f6eb77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809e000 0x7f6eb811e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.873+0000 7f6eb77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809e000 0x7f6eb811e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56816/0 (socket says 172.21.15.72:56816) 2023-10-03T10:18:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.873+0000 7f6ebcd77700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb809e410 0x7f6eb811ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.873+0000 7f6eb77fe700 1 -- 172.21.15.72:0/3243486536 learned_addr learned my addr 172.21.15.72:0/3243486536 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.873+0000 7f6eb7fff700 1 --2- 172.21.15.72:0/3243486536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6eb809d6f0 0x7f6eb811e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.873+0000 7f6eb7fff700 1 -- 172.21.15.72:0/3243486536 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb809e410 msgr2=0x7f6eb811ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.873+0000 7f6eb7fff700 1 --2- 172.21.15.72:0/3243486536 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb809e410 0x7f6eb811ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.873+0000 7f6eb7fff700 1 -- 172.21.15.72:0/3243486536 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809e000 msgr2=0x7f6eb811e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.873+0000 7f6eb7fff700 1 --2- 172.21.15.72:0/3243486536 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809e000 0x7f6eb811e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.874+0000 7f6eb7fff700 1 -- 172.21.15.72:0/3243486536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea800d940 con 0x7f6eb809d6f0 2023-10-03T10:18:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.874+0000 7f6eb7fff700 1 --2- 172.21.15.72:0/3243486536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6eb809d6f0 0x7f6eb811e280 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8012f00 tx=0x7f6ea8012f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.874+0000 7f6eb4ff9700 1 -- 172.21.15.72:0/3243486536 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8014040 con 0x7f6eb809d6f0 2023-10-03T10:18:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.874+0000 7f6eb4ff9700 1 -- 172.21.15.72:0/3243486536 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea800f860 con 0x7f6eb809d6f0 2023-10-03T10:18:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.874+0000 7f6ebe7da700 1 -- 172.21.15.72:0/3243486536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac00b600 con 0x7f6eb809d6f0 2023-10-03T10:18:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.874+0000 7f6eb4ff9700 1 -- 172.21.15.72:0/3243486536 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea800fbf0 con 0x7f6eb809d6f0 2023-10-03T10:18:34.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.874+0000 7f6ebe7da700 1 -- 172.21.15.72:0/3243486536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb809c700 con 0x7f6eb809d6f0 2023-10-03T10:18:34.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.875+0000 7f6ebe7da700 1 -- 172.21.15.72:0/3243486536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb8074ea0 con 0x7f6eb809d6f0 2023-10-03T10:18:34.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.875+0000 7f6eb4ff9700 1 -- 172.21.15.72:0/3243486536 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ea800fd50 con 0x7f6eb809d6f0 2023-10-03T10:18:34.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.875+0000 7f6eb4ff9700 1 -- 172.21.15.72:0/3243486536 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6ea8043470 con 0x7f6eb809d6f0 2023-10-03T10:18:34.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.880+0000 7f6eb4ff9700 1 -- 172.21.15.72:0/3243486536 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ea800b450 con 0x7f6eb809d6f0 2023-10-03T10:18:34.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.961+0000 7f0098c5a700 1 -- 172.21.15.72:0/3268656593 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0078005590 con 0x7f0094131810 2023-10-03T10:18:34.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.962+0000 7f0082ffd700 1 -- 172.21.15.72:0/3268656593 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0084044070 con 0x7f0094131810 2023-10-03T10:18:34.962 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:34.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.965+0000 7f0098c5a700 1 -- 172.21.15.72:0/3268656593 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0094131810 msgr2=0x7f0094134a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.965+0000 7f0098c5a700 1 --2- 172.21.15.72:0/3268656593 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0094131810 0x7f0094134a00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f008400c700 tx=0x7f008400ca10 comp rx=0 tx=0).stop 2023-10-03T10:18:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.965+0000 7f0098c5a700 1 -- 172.21.15.72:0/3268656593 shutdown_connections 2023-10-03T10:18:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.965+0000 7f0098c5a700 1 --2- 172.21.15.72:0/3268656593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0094136f50 0x7f0094135480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.965+0000 7f0098c5a700 1 --2- 172.21.15.72:0/3268656593 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0094131810 0x7f0094134a00 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.965+0000 7f0098c5a700 1 --2- 172.21.15.72:0/3268656593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0094134630 0x7f0094134f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.965+0000 7f0098c5a700 1 -- 172.21.15.72:0/3268656593 >> 172.21.15.72:0/3268656593 conn(0x7f00940a2aa0 msgr2=0x7f00940a0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.965+0000 7f0098c5a700 1 -- 172.21.15.72:0/3268656593 shutdown_connections 2023-10-03T10:18:34.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:34.965+0000 7f0098c5a700 1 -- 172.21.15.72:0/3268656593 wait complete. 2023-10-03T10:18:34.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:35.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.022+0000 7f52d0572700 1 -- 172.21.15.72:0/3099252980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f52b0005590 con 0x7f52c81316c0 2023-10-03T10:18:35.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.022+0000 7f52beffd700 1 -- 172.21.15.72:0/3099252980 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f52b8015030 con 0x7f52c81316c0 2023-10-03T10:18:35.023 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:35.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.024+0000 7f52d0572700 1 -- 172.21.15.72:0/3099252980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c81316c0 msgr2=0x7f52c8134390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.024+0000 7f52d0572700 1 --2- 172.21.15.72:0/3099252980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c81316c0 0x7f52c8134390 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f52b8016000 tx=0x7f52b8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:35.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.024+0000 7f52d0572700 1 -- 172.21.15.72:0/3099252980 shutdown_connections 2023-10-03T10:18:35.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.024+0000 7f52d0572700 1 --2- 172.21.15.72:0/3099252980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f52c8136a70 0x7f52c81348d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.024+0000 7f52d0572700 1 --2- 172.21.15.72:0/3099252980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52c809d9f0 0x7f52c812ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.024+0000 7f52d0572700 1 --2- 172.21.15.72:0/3099252980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c81316c0 0x7f52c8134390 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.024+0000 7f52d0572700 1 -- 172.21.15.72:0/3099252980 >> 172.21.15.72:0/3099252980 conn(0x7f52c8066f50 msgr2=0x7f52c8138600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.025+0000 7f52d0572700 1 -- 172.21.15.72:0/3099252980 shutdown_connections 2023-10-03T10:18:35.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.025+0000 7f52d0572700 1 -- 172.21.15.72:0/3099252980 wait complete. 2023-10-03T10:18:35.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:35.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.050+0000 7f8e977fa700 1 -- 172.21.15.72:0/2410950764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8e90072980 con 0x7f8e900a0a30 2023-10-03T10:18:35.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.051+0000 7f8e85ffb700 1 -- 172.21.15.72:0/2410950764 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e8001bb30 con 0x7f8e900a0a30 2023-10-03T10:18:35.051 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.053+0000 7f8e977fa700 1 -- 172.21.15.72:0/2410950764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e900a0a30 msgr2=0x7f8e90133b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.053+0000 7f8e977fa700 1 --2- 172.21.15.72:0/2410950764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e900a0a30 0x7f8e90133b60 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000c4b0 tx=0x7f8e8000c7c0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.053+0000 7f8e977fa700 1 -- 172.21.15.72:0/2410950764 shutdown_connections 2023-10-03T10:18:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.053+0000 7f8e977fa700 1 --2- 172.21.15.72:0/2410950764 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8e90138d80 0x7f8e901340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.053+0000 7f8e977fa700 1 --2- 172.21.15.72:0/2410950764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8e9009d630 0x7f8e90133620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.053+0000 7f8e977fa700 1 --2- 172.21.15.72:0/2410950764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e900a0a30 0x7f8e90133b60 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.053+0000 7f8e977fa700 1 -- 172.21.15.72:0/2410950764 >> 172.21.15.72:0/2410950764 conn(0x7f8e900a3050 msgr2=0x7f8e9009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.053+0000 7f8e977fa700 1 -- 172.21.15.72:0/2410950764 shutdown_connections 2023-10-03T10:18:35.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.053+0000 7f8e977fa700 1 -- 172.21.15.72:0/2410950764 wait complete. 2023-10-03T10:18:35.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:35.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.076+0000 7f6ebe7da700 1 -- 172.21.15.72:0/3243486536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6eb8072010 con 0x7f6eb809d6f0 2023-10-03T10:18:35.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.076+0000 7f6eb4ff9700 1 -- 172.21.15.72:0/3243486536 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ea8017360 con 0x7f6eb809d6f0 2023-10-03T10:18:35.077 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:35.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.078+0000 7f6ebe7da700 1 -- 172.21.15.72:0/3243486536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6eb809d6f0 msgr2=0x7f6eb811e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.078+0000 7f6ebe7da700 1 --2- 172.21.15.72:0/3243486536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6eb809d6f0 0x7f6eb811e280 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8012f00 tx=0x7f6ea8012f30 comp rx=0 tx=0).stop 2023-10-03T10:18:35.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.078+0000 7f6ebe7da700 1 -- 172.21.15.72:0/3243486536 shutdown_connections 2023-10-03T10:18:35.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.078+0000 7f6ebe7da700 1 --2- 172.21.15.72:0/3243486536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6eb809d6f0 0x7f6eb811e280 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.078+0000 7f6ebe7da700 1 --2- 172.21.15.72:0/3243486536 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb809e410 0x7f6eb811ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.078+0000 7f6ebe7da700 1 --2- 172.21.15.72:0/3243486536 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809e000 0x7f6eb811e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.078+0000 7f6ebe7da700 1 -- 172.21.15.72:0/3243486536 >> 172.21.15.72:0/3243486536 conn(0x7f6eb8066f50 msgr2=0x7f6eb806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.078+0000 7f6ebe7da700 1 -- 172.21.15.72:0/3243486536 shutdown_connections 2023-10-03T10:18:35.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:35.078+0000 7f6ebe7da700 1 -- 172.21.15.72:0/3243486536 wait complete. 2023-10-03T10:18:35.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:35.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:36.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:36.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:36.091 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:36.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.121+0000 7f2f7a816700 1 Processor -- start 2023-10-03T10:18:36.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.122+0000 7f2f7a816700 1 -- start start 2023-10-03T10:18:36.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.122+0000 7f2f7a816700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f7409f410 0x7f2f74136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.122+0000 7f2f7a816700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f74136fe0 0x7f2f741393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.122+0000 7f2f7a816700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f74070940 con 0x7f2f7409e930 2023-10-03T10:18:36.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.122+0000 7f2f7a816700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7406fd60 con 0x7f2f7409f410 2023-10-03T10:18:36.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.122+0000 7f2f7a816700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7406fa80 con 0x7f2f74136fe0 2023-10-03T10:18:36.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.122+0000 7f2f737fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f7409f410 0x7f2f74136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.122+0000 7f2f737fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f7409f410 0x7f2f74136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54630/0 (socket says 172.21.15.72:54630) 2023-10-03T10:18:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.122+0000 7f2f737fe700 1 -- 172.21.15.72:0/1107472888 learned_addr learned my addr 172.21.15.72:0/1107472888 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.122+0000 7f2f78db3700 1 --2- 172.21.15.72:0/1107472888 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f74136fe0 0x7f2f741393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.122+0000 7f2f78db3700 1 -- 172.21.15.72:0/1107472888 >> v2:172.21.15.72:3300/0 conn(0x7f2f7409f410 msgr2=0x7f2f74136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.122+0000 7f2f78db3700 1 --2- 172.21.15.72:0/1107472888 >> v2:172.21.15.72:3300/0 conn(0x7f2f7409f410 0x7f2f74136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.122+0000 7f2f78db3700 1 -- 172.21.15.72:0/1107472888 >> v1:172.21.15.72:6789/0 conn(0x7f2f7409e930 legacy=0x7f2f7409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.122+0000 7f2f78db3700 1 -- 172.21.15.72:0/1107472888 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7409fb60 con 0x7f2f74136fe0 2023-10-03T10:18:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.123+0000 7f2f78db3700 1 --2- 172.21.15.72:0/1107472888 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f74136fe0 0x7f2f741393c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009d90 tx=0x7f2f6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9738d45fcb1cea69 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.123+0000 7f2f72ffd700 1 -- 172.21.15.72:0/1107472888 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00e070 con 0x7f2f74136fe0 2023-10-03T10:18:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.123+0000 7f2f72ffd700 1 -- 172.21.15.72:0/1107472888 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c00bb20 con 0x7f2f74136fe0 2023-10-03T10:18:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.123+0000 7f2f72ffd700 1 -- 172.21.15.72:0/1107472888 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c012430 con 0x7f2f74136fe0 2023-10-03T10:18:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.124+0000 7f2f7a816700 1 -- 172.21.15.72:0/1107472888 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f74136fe0 msgr2=0x7f2f741393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.124+0000 7f2f7a816700 1 --2- 172.21.15.72:0/1107472888 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f74136fe0 0x7f2f741393c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009d90 tx=0x7f2f6c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.124+0000 7f2f7a816700 1 -- 172.21.15.72:0/1107472888 shutdown_connections 2023-10-03T10:18:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.124+0000 7f2f7a816700 1 --2- 172.21.15.72:0/1107472888 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f74136fe0 0x7f2f741393c0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.124+0000 7f2f7a816700 1 --2- 172.21.15.72:0/1107472888 >> v2:172.21.15.72:3300/0 conn(0x7f2f7409f410 0x7f2f74136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.124+0000 7f2f7a816700 1 -- 172.21.15.72:0/1107472888 >> 172.21.15.72:0/1107472888 conn(0x7f2f740a4210 msgr2=0x7f2f740a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.124+0000 7f2f7a816700 1 -- 172.21.15.72:0/1107472888 shutdown_connections 2023-10-03T10:18:36.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.124+0000 7f2f7a816700 1 -- 172.21.15.72:0/1107472888 wait complete. 2023-10-03T10:18:36.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.125+0000 7f2f7a816700 1 Processor -- start 2023-10-03T10:18:36.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.125+0000 7f2f7a816700 1 -- start start 2023-10-03T10:18:36.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f7a816700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f7409e930 0x7f2f741c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f7a816700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f7409f410 0x7f2f741c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f7a816700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f74136fe0 0x7f2f74121c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f7a816700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f741bd380 con 0x7f2f7409f410 2023-10-03T10:18:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f7a816700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f740a32f0 con 0x7f2f74136fe0 2023-10-03T10:18:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f7a816700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f74071d20 con 0x7f2f7409e930 2023-10-03T10:18:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f73fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f7409e930 0x7f2f741c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f73fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f7409e930 0x7f2f741c8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50048/0 (socket says 172.21.15.72:50048) 2023-10-03T10:18:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f73fff700 1 -- 172.21.15.72:0/1821696002 learned_addr learned my addr 172.21.15.72:0/1821696002 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f737fe700 1 --2- 172.21.15.72:0/1821696002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f7409f410 0x7f2f741c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f73fff700 1 -- 172.21.15.72:0/1821696002 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f74136fe0 msgr2=0x7f2f74121c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f73fff700 1 --2- 172.21.15.72:0/1821696002 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f74136fe0 0x7f2f74121c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f73fff700 1 -- 172.21.15.72:0/1821696002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f7409f410 msgr2=0x7f2f741c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f73fff700 1 --2- 172.21.15.72:0/1821696002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f7409f410 0x7f2f741c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f73fff700 1 -- 172.21.15.72:0/1821696002 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c009a70 con 0x7f2f7409e930 2023-10-03T10:18:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f737fe700 1 --2- 172.21.15.72:0/1821696002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f7409f410 0x7f2f741c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.126+0000 7f2f73fff700 1 --2- 172.21.15.72:0/1821696002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f7409e930 0x7f2f741c8780 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c4e0 tx=0x7f2f6400c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.127+0000 7f2f70ff9700 1 -- 172.21.15.72:0/1821696002 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f640052d0 con 0x7f2f7409e930 2023-10-03T10:18:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.127+0000 7f2f70ff9700 1 -- 172.21.15.72:0/1821696002 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f64005430 con 0x7f2f7409e930 2023-10-03T10:18:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.127+0000 7f2f70ff9700 1 -- 172.21.15.72:0/1821696002 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f640038c0 con 0x7f2f7409e930 2023-10-03T10:18:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.127+0000 7f2f7a816700 1 -- 172.21.15.72:0/1821696002 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f74125870 con 0x7f2f7409e930 2023-10-03T10:18:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.127+0000 7f2f7a816700 1 -- 172.21.15.72:0/1821696002 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f741253b0 con 0x7f2f7409e930 2023-10-03T10:18:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.128+0000 7f2f70ff9700 1 -- 172.21.15.72:0/1821696002 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f64003a20 con 0x7f2f7409e930 2023-10-03T10:18:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.128+0000 7f2f70ff9700 1 -- 172.21.15.72:0/1821696002 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2f6403eb30 con 0x7f2f7409e930 2023-10-03T10:18:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.128+0000 7f2f7a816700 1 -- 172.21.15.72:0/1821696002 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f74125000 con 0x7f2f7409e930 2023-10-03T10:18:36.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.134+0000 7f2f70ff9700 1 -- 172.21.15.72:0/1821696002 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f64017080 con 0x7f2f7409e930 2023-10-03T10:18:36.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.173+0000 7fe7f4ce7700 1 Processor -- start 2023-10-03T10:18:36.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.174+0000 7fe7f4ce7700 1 -- start start 2023-10-03T10:18:36.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.174+0000 7fe7f4ce7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7f0134630 0x7fe7f0136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.174+0000 7fe7f4ce7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f0136f50 0x7fe7f0139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.174+0000 7fe7f4ce7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f009b4f0 con 0x7fe7f0131810 2023-10-03T10:18:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.174+0000 7fe7f4ce7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f01313c0 con 0x7fe7f0134630 2023-10-03T10:18:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.174+0000 7fe7f4ce7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f006e8c0 con 0x7fe7f0136f50 2023-10-03T10:18:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.174+0000 7fe7edd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7f0134630 0x7fe7f0136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.174+0000 7fe7eed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f0136f50 0x7fe7f0139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.174+0000 7fe7edd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7f0134630 0x7fe7f0136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54648/0 (socket says 172.21.15.72:54648) 2023-10-03T10:18:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.174+0000 7fe7eed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f0136f50 0x7fe7f0139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56834/0 (socket says 172.21.15.72:56834) 2023-10-03T10:18:36.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.174+0000 7fe7edd9b700 1 -- 172.21.15.72:0/53868294 learned_addr learned my addr 172.21.15.72:0/53868294 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:36.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.175+0000 7fe7eed9d700 1 -- 172.21.15.72:0/53868294 >> v2:172.21.15.72:3300/0 conn(0x7fe7f0134630 msgr2=0x7fe7f0136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.175+0000 7fe7eed9d700 1 --2- 172.21.15.72:0/53868294 >> v2:172.21.15.72:3300/0 conn(0x7fe7f0134630 0x7fe7f0136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.175+0000 7fe7eed9d700 1 -- 172.21.15.72:0/53868294 >> v1:172.21.15.72:6789/0 conn(0x7fe7f0131810 legacy=0x7fe7f0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.175+0000 7fe7eed9d700 1 -- 172.21.15.72:0/53868294 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f0071d20 con 0x7fe7f0136f50 2023-10-03T10:18:36.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.175+0000 7fe7eed9d700 1 --2- 172.21.15.72:0/53868294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f0136f50 0x7fe7f0139330 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800f370 tx=0x7fe7e800f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=194a786b6b262d2b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.175+0000 7fe7ed59a700 1 -- 172.21.15.72:0/53868294 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8012070 con 0x7fe7f0136f50 2023-10-03T10:18:36.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.175+0000 7fe7ed59a700 1 -- 172.21.15.72:0/53868294 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e800fe70 con 0x7fe7f0136f50 2023-10-03T10:18:36.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.175+0000 7fe7ed59a700 1 -- 172.21.15.72:0/53868294 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800d2f0 con 0x7fe7f0136f50 2023-10-03T10:18:36.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.176+0000 7fe7f4ce7700 1 -- 172.21.15.72:0/53868294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f0136f50 msgr2=0x7fe7f0139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.176+0000 7fe7f4ce7700 1 --2- 172.21.15.72:0/53868294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f0136f50 0x7fe7f0139330 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800f370 tx=0x7fe7e800f680 comp rx=0 tx=0).stop 2023-10-03T10:18:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.176+0000 7fe7f4ce7700 1 -- 172.21.15.72:0/53868294 shutdown_connections 2023-10-03T10:18:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.176+0000 7fe7f4ce7700 1 --2- 172.21.15.72:0/53868294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f0136f50 0x7fe7f0139330 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.176+0000 7fe7f4ce7700 1 --2- 172.21.15.72:0/53868294 >> v2:172.21.15.72:3300/0 conn(0x7fe7f0134630 0x7fe7f0136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.176+0000 7fe7f4ce7700 1 -- 172.21.15.72:0/53868294 >> 172.21.15.72:0/53868294 conn(0x7fe7f00a2aa0 msgr2=0x7fe7f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.176+0000 7fe7f4ce7700 1 -- 172.21.15.72:0/53868294 shutdown_connections 2023-10-03T10:18:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.176+0000 7fe7f4ce7700 1 -- 172.21.15.72:0/53868294 wait complete. 2023-10-03T10:18:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.177+0000 7fe7f4ce7700 1 Processor -- start 2023-10-03T10:18:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.177+0000 7fe7f4ce7700 1 -- start start 2023-10-03T10:18:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.178+0000 7fe7f4ce7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f0131810 0x7fe7f009ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.178+0000 7fe7f4ce7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f0134630 0x7fe7f009cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.178+0000 7fe7f4ce7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7f0136f50 0x7fe7f009d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.178+0000 7fe7f4ce7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f011a410 con 0x7fe7f0131810 2023-10-03T10:18:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.178+0000 7fe7f4ce7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f011a5f0 con 0x7fe7f0134630 2023-10-03T10:18:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.178+0000 7fe7f4ce7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f009e5f0 con 0x7fe7f0136f50 2023-10-03T10:18:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.178+0000 7fe7ee59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f0131810 0x7fe7f009ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.178+0000 7fe7ee59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f0131810 0x7fe7f009ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54660/0 (socket says 172.21.15.72:54660) 2023-10-03T10:18:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.178+0000 7fe7ee59c700 1 -- 172.21.15.72:0/1386671633 learned_addr learned my addr 172.21.15.72:0/1386671633 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.178+0000 7fe7edd9b700 1 --2- 172.21.15.72:0/1386671633 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f0134630 0x7fe7f009cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.178+0000 7fe7ee59c700 1 -- 172.21.15.72:0/1386671633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7f0136f50 msgr2=0x7fe7f009d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.178+0000 7fe7ee59c700 1 --2- 172.21.15.72:0/1386671633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7f0136f50 0x7fe7f009d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.178+0000 7fe7ee59c700 1 -- 172.21.15.72:0/1386671633 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f0134630 msgr2=0x7fe7f009cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.178+0000 7fe7ee59c700 1 --2- 172.21.15.72:0/1386671633 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f0134630 0x7fe7f009cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.178+0000 7fe7ee59c700 1 -- 172.21.15.72:0/1386671633 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e800f050 con 0x7fe7f0131810 2023-10-03T10:18:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.179+0000 7fe7ee59c700 1 --2- 172.21.15.72:0/1386671633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f0131810 0x7fe7f009ca10 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800c4e0 tx=0x7fe7d800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.179+0000 7fe7e6ffd700 1 -- 172.21.15.72:0/1386671633 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80052d0 con 0x7fe7f0131810 2023-10-03T10:18:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.179+0000 7fe7e6ffd700 1 -- 172.21.15.72:0/1386671633 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d8005430 con 0x7fe7f0131810 2023-10-03T10:18:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.179+0000 7fe7e6ffd700 1 -- 172.21.15.72:0/1386671633 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80038c0 con 0x7fe7f0131810 2023-10-03T10:18:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.179+0000 7fe7f4ce7700 1 -- 172.21.15.72:0/1386671633 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f0071570 con 0x7fe7f0131810 2023-10-03T10:18:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.179+0000 7fe7f4ce7700 1 -- 172.21.15.72:0/1386671633 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f011b060 con 0x7fe7f0131810 2023-10-03T10:18:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.180+0000 7fe7e6ffd700 1 -- 172.21.15.72:0/1386671633 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe7d8003a20 con 0x7fe7f0131810 2023-10-03T10:18:36.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.180+0000 7fe7e6ffd700 1 -- 172.21.15.72:0/1386671633 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe7d803ead0 con 0x7fe7f0131810 2023-10-03T10:18:36.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.180+0000 7fe7f4ce7700 1 -- 172.21.15.72:0/1386671633 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f011a730 con 0x7fe7f0131810 2023-10-03T10:18:36.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.185+0000 7fe7e6ffd700 1 -- 172.21.15.72:0/1386671633 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7f011a730 con 0x7fe7f0131810 2023-10-03T10:18:36.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.246+0000 7fa2c33ae700 1 Processor -- start 2023-10-03T10:18:36.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.246+0000 7fa2c33ae700 1 -- start start 2023-10-03T10:18:36.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2c33ae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2bc0a0a30 0x7fa2bc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2c33ae700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa2bc138d80 0x7fa2bc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2c33ae700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2bc0a2a70 con 0x7fa2bc09d630 2023-10-03T10:18:36.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2c33ae700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2bc0a01d0 con 0x7fa2bc138d80 2023-10-03T10:18:36.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2c33ae700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc09e2b0 con 0x7fa2bc0a0a30 2023-10-03T10:18:36.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2c114a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2bc0a0a30 0x7fa2bc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2c0949700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa2bc09d630 0x7fa2bc0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51806/0 (socket says 172.21.15.72:51806) 2023-10-03T10:18:36.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2c114a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2bc0a0a30 0x7fa2bc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56858/0 (socket says 172.21.15.72:56858) 2023-10-03T10:18:36.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2c0949700 1 -- 172.21.15.72:0/1240068356 learned_addr learned my addr 172.21.15.72:0/1240068356 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:36.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2c194b700 1 --2- 172.21.15.72:0/1240068356 >> v2:172.21.15.72:3300/0 conn(0x7fa2bc138d80 0x7fa2bc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2c194b700 1 -- 172.21.15.72:0/1240068356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2bc0a0a30 msgr2=0x7fa2bc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2c194b700 1 --2- 172.21.15.72:0/1240068356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2bc0a0a30 0x7fa2bc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2c194b700 1 -- 172.21.15.72:0/1240068356 >> v1:172.21.15.72:6789/0 conn(0x7fa2bc09d630 legacy=0x7fa2bc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2c194b700 1 -- 172.21.15.72:0/1240068356 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc09dc50 con 0x7fa2bc138d80 2023-10-03T10:18:36.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2b3fff700 1 -- 172.21.15.72:0/1240068356 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886668885 0 0) 0x7fa2bc0a2a70 con 0x7fa2bc09d630 2023-10-03T10:18:36.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.247+0000 7fa2c114a700 1 --2- 172.21.15.72:0/1240068356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2bc0a0a30 0x7fa2bc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.248+0000 7fa2c194b700 1 --2- 172.21.15.72:0/1240068356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2bc138d80 0x7fa2bc13b160 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009d90 tx=0x7fa2b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6760da5a742d4d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.248+0000 7fa2b3fff700 1 -- 172.21.15.72:0/1240068356 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b400e070 con 0x7fa2bc138d80 2023-10-03T10:18:36.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.248+0000 7fa2b3fff700 1 -- 172.21.15.72:0/1240068356 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b400bb20 con 0x7fa2bc138d80 2023-10-03T10:18:36.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.248+0000 7fa2b3fff700 1 -- 172.21.15.72:0/1240068356 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4012430 con 0x7fa2bc138d80 2023-10-03T10:18:36.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.248+0000 7fa2c33ae700 1 -- 172.21.15.72:0/1240068356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2bc138d80 msgr2=0x7fa2bc13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.248+0000 7fa2c33ae700 1 --2- 172.21.15.72:0/1240068356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2bc138d80 0x7fa2bc13b160 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4009d90 tx=0x7fa2b400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:36.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.248+0000 7fa2c33ae700 1 -- 172.21.15.72:0/1240068356 shutdown_connections 2023-10-03T10:18:36.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.248+0000 7fa2c33ae700 1 --2- 172.21.15.72:0/1240068356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2bc138d80 0x7fa2bc13b160 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.248+0000 7fa2c33ae700 1 --2- 172.21.15.72:0/1240068356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2bc0a0a30 0x7fa2bc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.248+0000 7fa2c33ae700 1 -- 172.21.15.72:0/1240068356 >> 172.21.15.72:0/1240068356 conn(0x7fa2bc0a3050 msgr2=0x7fa2bc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.248+0000 7fa2c33ae700 1 -- 172.21.15.72:0/1240068356 shutdown_connections 2023-10-03T10:18:36.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.248+0000 7fa2c33ae700 1 -- 172.21.15.72:0/1240068356 wait complete. 2023-10-03T10:18:36.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.250+0000 7fa2c33ae700 1 Processor -- start 2023-10-03T10:18:36.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.250+0000 7fa2c33ae700 1 -- start start 2023-10-03T10:18:36.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.250+0000 7fdf98b73700 1 Processor -- start 2023-10-03T10:18:36.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.250+0000 7fdf98b73700 1 -- start start 2023-10-03T10:18:36.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.250+0000 7fa2c33ae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2bc09d630 0x7fa2bc12da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.250+0000 7fdf98b73700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf94134630 0x7fdf94136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fdf98b73700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf94136f50 0x7fdf94139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fdf98b73700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9409b4f0 con 0x7fdf94131810 2023-10-03T10:18:36.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fdf98b73700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf941313c0 con 0x7fdf94136f50 2023-10-03T10:18:36.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fdf98b73700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9406e8c0 con 0x7fdf94134630 2023-10-03T10:18:36.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.250+0000 7fa2c33ae700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2bc0a0a30 0x7fa2bc12df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.250+0000 7fa2c33ae700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2bc138d80 0x7fa2bc12e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.250+0000 7fa2c33ae700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc09b100 con 0x7fa2bc0a0a30 2023-10-03T10:18:36.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.250+0000 7fa2c33ae700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc09b860 con 0x7fa2bc09d630 2023-10-03T10:18:36.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.250+0000 7fa2c33ae700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc12cb80 con 0x7fa2bc138d80 2023-10-03T10:18:36.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fa2c0949700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2bc0a0a30 0x7fa2bc12df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fa2c194b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2bc138d80 0x7fa2bc12e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fa2c194b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2bc138d80 0x7fa2bc12e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50066/0 (socket says 172.21.15.72:50066) 2023-10-03T10:18:36.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fa2c194b700 1 -- 172.21.15.72:0/360851388 learned_addr learned my addr 172.21.15.72:0/360851388 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:36.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fa2c0949700 1 --2- 172.21.15.72:0/360851388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2bc0a0a30 0x7fa2bc12df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54670/0 (socket says 172.21.15.72:54670) 2023-10-03T10:18:36.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fdf92d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf94136f50 0x7fdf94139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fdf92d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf94136f50 0x7fdf94139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54686/0 (socket says 172.21.15.72:54686) 2023-10-03T10:18:36.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fdf92d9d700 1 -- 172.21.15.72:0/925352667 learned_addr learned my addr 172.21.15.72:0/925352667 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:36.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fa2c114a700 1 --2- 172.21.15.72:0/360851388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2bc09d630 0x7fa2bc12da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fa2c194b700 1 -- 172.21.15.72:0/360851388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2bc09d630 msgr2=0x7fa2bc12da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fa2c194b700 1 --2- 172.21.15.72:0/360851388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2bc09d630 0x7fa2bc12da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fa2c194b700 1 -- 172.21.15.72:0/360851388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2bc0a0a30 msgr2=0x7fa2bc12df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fa2c194b700 1 --2- 172.21.15.72:0/360851388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2bc0a0a30 0x7fa2bc12df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fa2c194b700 1 -- 172.21.15.72:0/360851388 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b80094a0 con 0x7fa2bc138d80 2023-10-03T10:18:36.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fa2c0949700 1 --2- 172.21.15.72:0/360851388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2bc0a0a30 0x7fa2bc12df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fdf91d9b700 1 --2- 172.21.15.72:0/925352667 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf94134630 0x7fdf94136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fdf92d9d700 1 -- 172.21.15.72:0/925352667 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf94134630 msgr2=0x7fdf94136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fdf92d9d700 1 --2- 172.21.15.72:0/925352667 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf94134630 0x7fdf94136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fdf92d9d700 1 -- 172.21.15.72:0/925352667 >> v1:172.21.15.72:6789/0 conn(0x7fdf94131810 legacy=0x7fdf94131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fdf92d9d700 1 -- 172.21.15.72:0/925352667 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf94071d20 con 0x7fdf94136f50 2023-10-03T10:18:36.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fa2c194b700 1 --2- 172.21.15.72:0/360851388 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2bc138d80 0x7fa2bc12e4c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc0a2c00 tx=0x7fa2b4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.251+0000 7fdf92d9d700 1 --2- 172.21.15.72:0/925352667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf94136f50 0x7fdf94139330 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009e50 tx=0x7fdf8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8fc12c856a5c9c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.252+0000 7fdf9159a700 1 -- 172.21.15.72:0/925352667 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c00e070 con 0x7fdf94136f50 2023-10-03T10:18:36.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.252+0000 7fdf9159a700 1 -- 172.21.15.72:0/925352667 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c003a20 con 0x7fdf94136f50 2023-10-03T10:18:36.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.252+0000 7fdf9159a700 1 -- 172.21.15.72:0/925352667 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c003dd0 con 0x7fdf94136f50 2023-10-03T10:18:36.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.252+0000 7fa2b1ffb700 1 -- 172.21.15.72:0/360851388 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4012430 con 0x7fa2bc138d80 2023-10-03T10:18:36.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.252+0000 7fa2b1ffb700 1 -- 172.21.15.72:0/360851388 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b4020070 con 0x7fa2bc138d80 2023-10-03T10:18:36.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.252+0000 7fa2c33ae700 1 -- 172.21.15.72:0/360851388 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b4009a70 con 0x7fa2bc138d80 2023-10-03T10:18:36.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.252+0000 7fa2b1ffb700 1 -- 172.21.15.72:0/360851388 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4004280 con 0x7fa2bc138d80 2023-10-03T10:18:36.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.252+0000 7fa2c33ae700 1 -- 172.21.15.72:0/360851388 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2bc12c8c0 con 0x7fa2bc138d80 2023-10-03T10:18:36.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.253+0000 7fdf98b73700 1 -- 172.21.15.72:0/925352667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf94136f50 msgr2=0x7fdf94139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.253+0000 7fdf98b73700 1 --2- 172.21.15.72:0/925352667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf94136f50 0x7fdf94139330 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009e50 tx=0x7fdf8c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:36.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.253+0000 7fdf98b73700 1 -- 172.21.15.72:0/925352667 shutdown_connections 2023-10-03T10:18:36.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.253+0000 7fdf98b73700 1 --2- 172.21.15.72:0/925352667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf94136f50 0x7fdf94139330 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.253+0000 7fdf98b73700 1 --2- 172.21.15.72:0/925352667 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf94134630 0x7fdf94136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.253+0000 7fdf98b73700 1 -- 172.21.15.72:0/925352667 >> 172.21.15.72:0/925352667 conn(0x7fdf940a2aa0 msgr2=0x7fdf940a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.253+0000 7fa2b1ffb700 1 -- 172.21.15.72:0/360851388 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2b40043e0 con 0x7fa2bc138d80 2023-10-03T10:18:36.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.253+0000 7fa2b1ffb700 1 -- 172.21.15.72:0/360851388 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa2b4022070 con 0x7fa2bc138d80 2023-10-03T10:18:36.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.253+0000 7fa2c33ae700 1 -- 172.21.15.72:0/360851388 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2bc0747f0 con 0x7fa2bc138d80 2023-10-03T10:18:36.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.253+0000 7fdf98b73700 1 -- 172.21.15.72:0/925352667 shutdown_connections 2023-10-03T10:18:36.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.254+0000 7fdf98b73700 1 -- 172.21.15.72:0/925352667 wait complete. 2023-10-03T10:18:36.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.255+0000 7fdf98b73700 1 Processor -- start 2023-10-03T10:18:36.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.255+0000 7fdf98b73700 1 -- start start 2023-10-03T10:18:36.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.255+0000 7fdf98b73700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf94131810 0x7fdf94119a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.255+0000 7fdf98b73700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf94134630 0x7fdf94119f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.255+0000 7fdf98b73700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf94136f50 0x7fdf941c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.255+0000 7fdf98b73700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9406eb00 con 0x7fdf94131810 2023-10-03T10:18:36.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.255+0000 7fdf98b73700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940a20d0 con 0x7fdf94136f50 2023-10-03T10:18:36.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.255+0000 7fdf98b73700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf94119560 con 0x7fdf94134630 2023-10-03T10:18:36.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.255+0000 7fdf92d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf94136f50 0x7fdf941c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.255+0000 7fdf92d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf94136f50 0x7fdf941c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56884/0 (socket says 172.21.15.72:56884) 2023-10-03T10:18:36.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.255+0000 7fdf92d9d700 1 -- 172.21.15.72:0/1104007988 learned_addr learned my addr 172.21.15.72:0/1104007988 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:36.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.256+0000 7fdf91d9b700 1 --2- 172.21.15.72:0/1104007988 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf94134630 0x7fdf94119f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.256+0000 7fdf92d9d700 1 -- 172.21.15.72:0/1104007988 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf94134630 msgr2=0x7fdf94119f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.256+0000 7fdf92d9d700 1 --2- 172.21.15.72:0/1104007988 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf94134630 0x7fdf94119f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.256+0000 7fdf92d9d700 1 -- 172.21.15.72:0/1104007988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf94131810 msgr2=0x7fdf94119a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.256+0000 7fdf92d9d700 1 --2- 172.21.15.72:0/1104007988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf94131810 0x7fdf94119a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.256+0000 7fdf92d9d700 1 -- 172.21.15.72:0/1104007988 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c009b30 con 0x7fdf94136f50 2023-10-03T10:18:36.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.256+0000 7fdf92d9d700 1 --2- 172.21.15.72:0/1104007988 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf94136f50 0x7fdf941c6140 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c004000 tx=0x7fdf8c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.256+0000 7fdf82ffd700 1 -- 172.21.15.72:0/1104007988 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c004440 con 0x7fdf94136f50 2023-10-03T10:18:36.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.256+0000 7fdf82ffd700 1 -- 172.21.15.72:0/1104007988 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c0045c0 con 0x7fdf94136f50 2023-10-03T10:18:36.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.256+0000 7fdf98b73700 1 -- 172.21.15.72:0/1104007988 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9411a480 con 0x7fdf94136f50 2023-10-03T10:18:36.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.256+0000 7fdf82ffd700 1 -- 172.21.15.72:0/1104007988 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c004970 con 0x7fdf94136f50 2023-10-03T10:18:36.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.256+0000 7fdf98b73700 1 -- 172.21.15.72:0/1104007988 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9411c920 con 0x7fdf94136f50 2023-10-03T10:18:36.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.257+0000 7fdf82ffd700 1 -- 172.21.15.72:0/1104007988 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf8c012430 con 0x7fdf94136f50 2023-10-03T10:18:36.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.258+0000 7fdf82ffd700 1 -- 172.21.15.72:0/1104007988 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdf8c0408c0 con 0x7fdf94136f50 2023-10-03T10:18:36.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.258+0000 7fdf98b73700 1 -- 172.21.15.72:0/1104007988 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9411c220 con 0x7fdf94136f50 2023-10-03T10:18:36.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.260+0000 7fa2b1ffb700 1 -- 172.21.15.72:0/360851388 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2b40263e0 con 0x7fa2bc138d80 2023-10-03T10:18:36.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.262+0000 7fdf82ffd700 1 -- 172.21.15.72:0/1104007988 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf8c011390 con 0x7fdf94136f50 2023-10-03T10:18:36.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.383+0000 7fe7f4ce7700 1 -- 172.21.15.72:0/1386671633 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe7f011a730 con 0x7fe7f0131810 2023-10-03T10:18:36.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.383+0000 7fe7e6ffd700 1 -- 172.21.15.72:0/1386671633 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe7f011a730 con 0x7fe7f0131810 2023-10-03T10:18:36.384 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:36.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.386+0000 7fe7f4ce7700 1 -- 172.21.15.72:0/1386671633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f0131810 msgr2=0x7fe7f009ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.386+0000 7fe7f4ce7700 1 --2- 172.21.15.72:0/1386671633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f0131810 0x7fe7f009ca10 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800c4e0 tx=0x7fe7d800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.386+0000 7fe7f4ce7700 1 -- 172.21.15.72:0/1386671633 shutdown_connections 2023-10-03T10:18:36.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.386+0000 7fe7f4ce7700 1 --2- 172.21.15.72:0/1386671633 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f0131810 0x7fe7f009ca10 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.386+0000 7fe7f4ce7700 1 --2- 172.21.15.72:0/1386671633 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe7f0136f50 0x7fe7f009d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.386+0000 7fe7f4ce7700 1 --2- 172.21.15.72:0/1386671633 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7f0134630 0x7fe7f009cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.386+0000 7fe7f4ce7700 1 -- 172.21.15.72:0/1386671633 >> 172.21.15.72:0/1386671633 conn(0x7fe7f00a2aa0 msgr2=0x7fe7f0132410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.386+0000 7fe7f4ce7700 1 -- 172.21.15.72:0/1386671633 shutdown_connections 2023-10-03T10:18:36.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.386+0000 7fe7f4ce7700 1 -- 172.21.15.72:0/1386671633 wait complete. 2023-10-03T10:18:36.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.393+0000 7f2f7a816700 1 -- 172.21.15.72:0/1821696002 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2f740a3cd0 con 0x7f2f7409e930 2023-10-03T10:18:36.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.394+0000 7f2f70ff9700 1 -- 172.21.15.72:0/1821696002 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2f64018260 con 0x7f2f7409e930 2023-10-03T10:18:36.394 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:36.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.397+0000 7f2f7a816700 1 -- 172.21.15.72:0/1821696002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f7409e930 msgr2=0x7f2f741c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.397+0000 7f2f7a816700 1 --2- 172.21.15.72:0/1821696002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f7409e930 0x7f2f741c8780 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c4e0 tx=0x7f2f6400c7f0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.397+0000 7f2f7a816700 1 -- 172.21.15.72:0/1821696002 shutdown_connections 2023-10-03T10:18:36.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.397+0000 7f2f7a816700 1 --2- 172.21.15.72:0/1821696002 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f74136fe0 0x7f2f74121c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.397+0000 7f2f7a816700 1 --2- 172.21.15.72:0/1821696002 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2f7409e930 0x7f2f741c8780 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.397+0000 7f2f7a816700 1 --2- 172.21.15.72:0/1821696002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f7409f410 0x7f2f741c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.397+0000 7f2f7a816700 1 -- 172.21.15.72:0/1821696002 >> 172.21.15.72:0/1821696002 conn(0x7f2f740a4210 msgr2=0x7f2f741bc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.397+0000 7f2f7a816700 1 -- 172.21.15.72:0/1821696002 shutdown_connections 2023-10-03T10:18:36.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.397+0000 7f2f7a816700 1 -- 172.21.15.72:0/1821696002 wait complete. 2023-10-03T10:18:36.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:36.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:36.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.458+0000 7fdf98b73700 1 -- 172.21.15.72:0/1104007988 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdf9404ea50 con 0x7fdf94136f50 2023-10-03T10:18:36.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.458+0000 7fdf82ffd700 1 -- 172.21.15.72:0/1104007988 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf8c017030 con 0x7fdf94136f50 2023-10-03T10:18:36.459 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:36.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.460+0000 7fdf98b73700 1 -- 172.21.15.72:0/1104007988 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf94136f50 msgr2=0x7fdf941c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.460+0000 7fdf98b73700 1 --2- 172.21.15.72:0/1104007988 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf94136f50 0x7fdf941c6140 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c004000 tx=0x7fdf8c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.460+0000 7fdf98b73700 1 -- 172.21.15.72:0/1104007988 shutdown_connections 2023-10-03T10:18:36.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.460+0000 7fdf98b73700 1 --2- 172.21.15.72:0/1104007988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf94131810 0x7fdf94119a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.460+0000 7fdf98b73700 1 --2- 172.21.15.72:0/1104007988 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf94136f50 0x7fdf941c6140 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.460+0000 7fdf98b73700 1 --2- 172.21.15.72:0/1104007988 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf94134630 0x7fdf94119f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.460+0000 7fdf98b73700 1 -- 172.21.15.72:0/1104007988 >> 172.21.15.72:0/1104007988 conn(0x7fdf940a2aa0 msgr2=0x7fdf9409f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.460+0000 7fdf98b73700 1 -- 172.21.15.72:0/1104007988 shutdown_connections 2023-10-03T10:18:36.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.460+0000 7fdf98b73700 1 -- 172.21.15.72:0/1104007988 wait complete. 2023-10-03T10:18:36.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:36.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.476+0000 7fa2c33ae700 1 -- 172.21.15.72:0/360851388 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa2bc12d650 con 0x7fa2bc138d80 2023-10-03T10:18:36.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.476+0000 7fa2b1ffb700 1 -- 172.21.15.72:0/360851388 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2b401ab70 con 0x7fa2bc138d80 2023-10-03T10:18:36.477 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:36.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.478+0000 7fa2c33ae700 1 -- 172.21.15.72:0/360851388 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2bc138d80 msgr2=0x7fa2bc12e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.478+0000 7fa2c33ae700 1 --2- 172.21.15.72:0/360851388 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2bc138d80 0x7fa2bc12e4c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc0a2c00 tx=0x7fa2b4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.478+0000 7fa2c33ae700 1 -- 172.21.15.72:0/360851388 shutdown_connections 2023-10-03T10:18:36.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.478+0000 7fa2c33ae700 1 --2- 172.21.15.72:0/360851388 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2bc138d80 0x7fa2bc12e4c0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.478+0000 7fa2c33ae700 1 --2- 172.21.15.72:0/360851388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2bc09d630 0x7fa2bc12da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.478+0000 7fa2c33ae700 1 --2- 172.21.15.72:0/360851388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2bc0a0a30 0x7fa2bc12df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.478+0000 7fa2c33ae700 1 -- 172.21.15.72:0/360851388 >> 172.21.15.72:0/360851388 conn(0x7fa2bc0a3050 msgr2=0x7fa2bc13a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.478+0000 7fa2c33ae700 1 -- 172.21.15.72:0/360851388 shutdown_connections 2023-10-03T10:18:36.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:36.478+0000 7fa2c33ae700 1 -- 172.21.15.72:0/360851388 wait complete. 2023-10-03T10:18:36.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:37.400 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:37.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:37.474 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:37.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:37.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.539+0000 7f847e22f700 1 Processor -- start 2023-10-03T10:18:37.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.539+0000 7f847e22f700 1 -- start start 2023-10-03T10:18:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.540+0000 7f847e22f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f847809d6f0 0x7f847809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.540+0000 7f847e22f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f847809e410 0x7f8478130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.540+0000 7f847e22f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f847809f130 con 0x7f847809e000 2023-10-03T10:18:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.540+0000 7f847e22f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847809f520 con 0x7f847809e410 2023-10-03T10:18:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.540+0000 7f847e22f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847809e930 con 0x7f847809d6f0 2023-10-03T10:18:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.540+0000 7f8476ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f847809e000 0x7f8478130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51820/0 (socket says 172.21.15.72:51820) 2023-10-03T10:18:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.540+0000 7f84777fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f847809d6f0 0x7f847809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.540+0000 7f8476ffd700 1 -- 172.21.15.72:0/1146552488 learned_addr learned my addr 172.21.15.72:0/1146552488 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.540+0000 7f8477fff700 1 --2- 172.21.15.72:0/1146552488 >> v2:172.21.15.72:3300/0 conn(0x7f847809e410 0x7f8478130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.540+0000 7f84777fe700 1 -- 172.21.15.72:0/1146552488 >> v2:172.21.15.72:3300/0 conn(0x7f847809e410 msgr2=0x7f8478130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.540+0000 7f84777fe700 1 --2- 172.21.15.72:0/1146552488 >> v2:172.21.15.72:3300/0 conn(0x7f847809e410 0x7f8478130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.540+0000 7f84777fe700 1 -- 172.21.15.72:0/1146552488 >> v1:172.21.15.72:6789/0 conn(0x7f847809e000 legacy=0x7f8478130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.540+0000 7f84777fe700 1 -- 172.21.15.72:0/1146552488 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847809b2d0 con 0x7f847809d6f0 2023-10-03T10:18:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.541+0000 7f84777fe700 1 --2- 172.21.15.72:0/1146552488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f847809d6f0 0x7f847809dac0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f846800bae0 tx=0x7f846800bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ede75452a5085d83 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.541+0000 7f84767fc700 1 -- 172.21.15.72:0/1146552488 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846800dd30 con 0x7f847809d6f0 2023-10-03T10:18:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.541+0000 7f84767fc700 1 -- 172.21.15.72:0/1146552488 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846800de90 con 0x7f847809d6f0 2023-10-03T10:18:37.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.541+0000 7f84767fc700 1 -- 172.21.15.72:0/1146552488 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468010690 con 0x7f847809d6f0 2023-10-03T10:18:37.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.542+0000 7f847e22f700 1 -- 172.21.15.72:0/1146552488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f847809d6f0 msgr2=0x7f847809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.542+0000 7f847e22f700 1 --2- 172.21.15.72:0/1146552488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f847809d6f0 0x7f847809dac0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f846800bae0 tx=0x7f846800bdf0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.542+0000 7f847e22f700 1 -- 172.21.15.72:0/1146552488 shutdown_connections 2023-10-03T10:18:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.542+0000 7f847e22f700 1 --2- 172.21.15.72:0/1146552488 >> v2:172.21.15.72:3300/0 conn(0x7f847809e410 0x7f8478130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.542+0000 7f847e22f700 1 --2- 172.21.15.72:0/1146552488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f847809d6f0 0x7f847809dac0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.542+0000 7f847e22f700 1 -- 172.21.15.72:0/1146552488 >> 172.21.15.72:0/1146552488 conn(0x7f8478066f50 msgr2=0x7f847809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.542+0000 7f847e22f700 1 -- 172.21.15.72:0/1146552488 shutdown_connections 2023-10-03T10:18:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.542+0000 7f847e22f700 1 -- 172.21.15.72:0/1146552488 wait complete. 2023-10-03T10:18:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.543+0000 7f847e22f700 1 Processor -- start 2023-10-03T10:18:37.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.543+0000 7f847e22f700 1 -- start start 2023-10-03T10:18:37.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.544+0000 7f847e22f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f847809d6f0 0x7f847811e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.544+0000 7f847e22f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f847809e000 0x7f847811e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.544+0000 7f847e22f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f847809e410 0x7f847811eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.544+0000 7f847e22f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847811f510 con 0x7f847809e410 2023-10-03T10:18:37.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.544+0000 7f847e22f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8478121b10 con 0x7f847809d6f0 2023-10-03T10:18:37.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.544+0000 7f847e22f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84781303d0 con 0x7f847809e000 2023-10-03T10:18:37.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.544+0000 7f84777fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f847809d6f0 0x7f847811e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.544+0000 7f84777fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f847809d6f0 0x7f847811e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56900/0 (socket says 172.21.15.72:56900) 2023-10-03T10:18:37.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.544+0000 7f84777fe700 1 -- 172.21.15.72:0/2761422984 learned_addr learned my addr 172.21.15.72:0/2761422984 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:37.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.544+0000 7f8477fff700 1 --2- 172.21.15.72:0/2761422984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f847809e410 0x7f847811eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.545+0000 7f8477fff700 1 -- 172.21.15.72:0/2761422984 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f847809e000 msgr2=0x7f847811e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.545+0000 7f8477fff700 1 --2- 172.21.15.72:0/2761422984 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f847809e000 0x7f847811e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.545+0000 7f8477fff700 1 -- 172.21.15.72:0/2761422984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f847809d6f0 msgr2=0x7f847811e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.545+0000 7f8477fff700 1 --2- 172.21.15.72:0/2761422984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f847809d6f0 0x7f847811e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.545+0000 7f8477fff700 1 -- 172.21.15.72:0/2761422984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846800b740 con 0x7f847809e410 2023-10-03T10:18:37.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.545+0000 7f84777fe700 1 --2- 172.21.15.72:0/2761422984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f847809d6f0 0x7f847811e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.545+0000 7f8477fff700 1 --2- 172.21.15.72:0/2761422984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f847809e410 0x7f847811eac0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f8470007d90 tx=0x7f847000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.545+0000 7f845ffff700 1 -- 172.21.15.72:0/2761422984 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470018070 con 0x7f847809e410 2023-10-03T10:18:37.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.545+0000 7f845ffff700 1 -- 172.21.15.72:0/2761422984 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847000ebe0 con 0x7f847809e410 2023-10-03T10:18:37.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.545+0000 7f847e22f700 1 -- 172.21.15.72:0/2761422984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84781201e0 con 0x7f847809e410 2023-10-03T10:18:37.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.545+0000 7f845ffff700 1 -- 172.21.15.72:0/2761422984 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470003a20 con 0x7f847809e410 2023-10-03T10:18:37.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.545+0000 7f847e22f700 1 -- 172.21.15.72:0/2761422984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847809c750 con 0x7f847809e410 2023-10-03T10:18:37.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.546+0000 7f845ffff700 1 -- 172.21.15.72:0/2761422984 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8470014420 con 0x7f847809e410 2023-10-03T10:18:37.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.546+0000 7f845ffff700 1 -- 172.21.15.72:0/2761422984 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f847003f630 con 0x7f847809e410 2023-10-03T10:18:37.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.546+0000 7f847e22f700 1 -- 172.21.15.72:0/2761422984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8478074ea0 con 0x7f847809e410 2023-10-03T10:18:37.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.551+0000 7f845ffff700 1 -- 172.21.15.72:0/2761422984 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84700128d0 con 0x7f847809e410 2023-10-03T10:18:37.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.586+0000 7fb29c453700 1 Processor -- start 2023-10-03T10:18:37.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.586+0000 7fb29c453700 1 -- start start 2023-10-03T10:18:37.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb29c453700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb29406c0e0 0x7fb29409ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb29c453700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb294134ec0 0x7fb2941379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb29c453700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb294137f20 0x7fb294138390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb29c453700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29406c4b0 con 0x7fb294137f20 2023-10-03T10:18:37.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb29c453700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940a09c0 con 0x7fb29406c0e0 2023-10-03T10:18:37.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb29c453700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb294134980 con 0x7fb294134ec0 2023-10-03T10:18:37.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb29a1ef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb29406c0e0 0x7fb29409ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb2999ee700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb294134ec0 0x7fb2941379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb29a1ef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb29406c0e0 0x7fb29409ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56910/0 (socket says 172.21.15.72:56910) 2023-10-03T10:18:37.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb29a1ef700 1 -- 172.21.15.72:0/3400900980 learned_addr learned my addr 172.21.15.72:0/3400900980 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:37.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb29a9f0700 1 --2- 172.21.15.72:0/3400900980 >> v2:172.21.15.72:3300/0 conn(0x7fb294137f20 0x7fb294138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb29a1ef700 1 -- 172.21.15.72:0/3400900980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb294134ec0 msgr2=0x7fb2941379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb29a1ef700 1 --2- 172.21.15.72:0/3400900980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb294134ec0 0x7fb2941379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb29a1ef700 1 -- 172.21.15.72:0/3400900980 >> v2:172.21.15.72:3300/0 conn(0x7fb294137f20 msgr2=0x7fb294138390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb29a1ef700 1 --2- 172.21.15.72:0/3400900980 >> v2:172.21.15.72:3300/0 conn(0x7fb294137f20 0x7fb294138390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb29a1ef700 1 -- 172.21.15.72:0/3400900980 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2940a0600 con 0x7fb29406c0e0 2023-10-03T10:18:37.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.587+0000 7fb2999ee700 1 --2- 172.21.15.72:0/3400900980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb294134ec0 0x7fb2941379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.588+0000 7fb29a1ef700 1 --2- 172.21.15.72:0/3400900980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb29406c0e0 0x7fb29409ac90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb290009920 tx=0x7fb290009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8c422372637c9cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.588+0000 7fb2991ed700 1 -- 172.21.15.72:0/3400900980 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290011830 con 0x7fb29406c0e0 2023-10-03T10:18:37.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.588+0000 7fb2991ed700 1 -- 172.21.15.72:0/3400900980 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb290011990 con 0x7fb29406c0e0 2023-10-03T10:18:37.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.588+0000 7fb2991ed700 1 -- 172.21.15.72:0/3400900980 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290011d20 con 0x7fb29406c0e0 2023-10-03T10:18:37.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.589+0000 7fb29c453700 1 -- 172.21.15.72:0/3400900980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb29406c0e0 msgr2=0x7fb29409ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.589+0000 7fb29c453700 1 --2- 172.21.15.72:0/3400900980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb29406c0e0 0x7fb29409ac90 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb290009920 tx=0x7fb290009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:37.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.589+0000 7fb29c453700 1 -- 172.21.15.72:0/3400900980 shutdown_connections 2023-10-03T10:18:37.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.589+0000 7fb29c453700 1 --2- 172.21.15.72:0/3400900980 >> v2:172.21.15.72:3300/0 conn(0x7fb294137f20 0x7fb294138390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.589+0000 7fb29c453700 1 --2- 172.21.15.72:0/3400900980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb29406c0e0 0x7fb29409ac90 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.589+0000 7fb29c453700 1 --2- 172.21.15.72:0/3400900980 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb294134ec0 0x7fb2941379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.589+0000 7fb29c453700 1 -- 172.21.15.72:0/3400900980 >> 172.21.15.72:0/3400900980 conn(0x7fb2940a4210 msgr2=0x7fb2940a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.589+0000 7fb29c453700 1 -- 172.21.15.72:0/3400900980 shutdown_connections 2023-10-03T10:18:37.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.589+0000 7fb29c453700 1 -- 172.21.15.72:0/3400900980 wait complete. 2023-10-03T10:18:37.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.590+0000 7fb29c453700 1 Processor -- start 2023-10-03T10:18:37.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.590+0000 7fb29c453700 1 -- start start 2023-10-03T10:18:37.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.590+0000 7fb29c453700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb29406c0e0 0x7fb29411a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.590+0000 7fb29c453700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb294134ec0 0x7fb29411ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.590+0000 7fb29c453700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb294137f20 0x7fb29411b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.590+0000 7fb29c453700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29411da60 con 0x7fb294137f20 2023-10-03T10:18:37.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.590+0000 7fb29c453700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29411bf40 con 0x7fb294134ec0 2023-10-03T10:18:37.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.590+0000 7fb29c453700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940a03f0 con 0x7fb29406c0e0 2023-10-03T10:18:37.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb2999ee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb294134ec0 0x7fb29411ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb2999ee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb294134ec0 0x7fb29411ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56916/0 (socket says 172.21.15.72:56916) 2023-10-03T10:18:37.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb2999ee700 1 -- 172.21.15.72:0/1506377481 learned_addr learned my addr 172.21.15.72:0/1506377481 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:37.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb29a9f0700 1 --2- 172.21.15.72:0/1506377481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb294137f20 0x7fb29411b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb29a1ef700 1 --2- 172.21.15.72:0/1506377481 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb29406c0e0 0x7fb29411a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb2999ee700 1 -- 172.21.15.72:0/1506377481 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb29406c0e0 msgr2=0x7fb29411a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb2999ee700 1 --2- 172.21.15.72:0/1506377481 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb29406c0e0 0x7fb29411a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb2999ee700 1 -- 172.21.15.72:0/1506377481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb294137f20 msgr2=0x7fb29411b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb2999ee700 1 --2- 172.21.15.72:0/1506377481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb294137f20 0x7fb29411b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb2999ee700 1 -- 172.21.15.72:0/1506377481 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2840094a0 con 0x7fb294134ec0 2023-10-03T10:18:37.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb2999ee700 1 --2- 172.21.15.72:0/1506377481 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb294134ec0 0x7fb29411ae30 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb28400ebb0 tx=0x7fb28400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb28affd700 1 -- 172.21.15.72:0/1506377481 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400c850 con 0x7fb294134ec0 2023-10-03T10:18:37.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb28affd700 1 -- 172.21.15.72:0/1506377481 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28400c9b0 con 0x7fb294134ec0 2023-10-03T10:18:37.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb29c453700 1 -- 172.21.15.72:0/1506377481 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb290009550 con 0x7fb294134ec0 2023-10-03T10:18:37.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb28affd700 1 -- 172.21.15.72:0/1506377481 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400cd40 con 0x7fb294134ec0 2023-10-03T10:18:37.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.591+0000 7fb29c453700 1 -- 172.21.15.72:0/1506377481 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29411dd40 con 0x7fb294134ec0 2023-10-03T10:18:37.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.593+0000 7fb29c453700 1 -- 172.21.15.72:0/1506377481 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb294074ea0 con 0x7fb294134ec0 2023-10-03T10:18:37.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.593+0000 7fb28affd700 1 -- 172.21.15.72:0/1506377481 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb284013470 con 0x7fb294134ec0 2023-10-03T10:18:37.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.593+0000 7fb28affd700 1 -- 172.21.15.72:0/1506377481 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb28403fbc0 con 0x7fb294134ec0 2023-10-03T10:18:37.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.602+0000 7fb28affd700 1 -- 172.21.15.72:0/1506377481 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb28401b3b0 con 0x7fb294134ec0 2023-10-03T10:18:37.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.631+0000 7fe10152d700 1 Processor -- start 2023-10-03T10:18:37.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.631+0000 7fe10152d700 1 -- start start 2023-10-03T10:18:37.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.631+0000 7fe10152d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe0fc0a1510 0x7fe0fc138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.631+0000 7fe10152d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0fc139250 0x7fe0fc13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.631+0000 7fe10152d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc09edd0 con 0x7fe0fc0a0a30 2023-10-03T10:18:37.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.631+0000 7fe10152d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc0a18e0 con 0x7fe0fc0a1510 2023-10-03T10:18:37.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.631+0000 7fe10152d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc09e1f0 con 0x7fe0fc139250 2023-10-03T10:18:37.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.631+0000 7fe0fb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0fc139250 0x7fe0fc13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.631+0000 7fe0fb7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0fc139250 0x7fe0fc13b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56924/0 (socket says 172.21.15.72:56924) 2023-10-03T10:18:37.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.631+0000 7fe0fb7fe700 1 -- 172.21.15.72:0/951220765 learned_addr learned my addr 172.21.15.72:0/951220765 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:37.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.632+0000 7fe0fb7fe700 1 -- 172.21.15.72:0/951220765 >> v2:172.21.15.72:3300/0 conn(0x7fe0fc0a1510 msgr2=0x7fe0fc138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.632+0000 7fe0fb7fe700 1 --2- 172.21.15.72:0/951220765 >> v2:172.21.15.72:3300/0 conn(0x7fe0fc0a1510 0x7fe0fc138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.632+0000 7fe0fb7fe700 1 -- 172.21.15.72:0/951220765 >> v1:172.21.15.72:6789/0 conn(0x7fe0fc0a0a30 legacy=0x7fe0fc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.632+0000 7fe0fb7fe700 1 -- 172.21.15.72:0/951220765 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc09dc50 con 0x7fe0fc139250 2023-10-03T10:18:37.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.632+0000 7fe0fb7fe700 1 --2- 172.21.15.72:0/951220765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0fc139250 0x7fe0fc13b630 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4009e50 tx=0x7fe0f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=277e8739a9c62eee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.632+0000 7fe0f9ffb700 1 -- 172.21.15.72:0/951220765 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f400e070 con 0x7fe0fc139250 2023-10-03T10:18:37.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.632+0000 7fe0f9ffb700 1 -- 172.21.15.72:0/951220765 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f4003a20 con 0x7fe0fc139250 2023-10-03T10:18:37.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.632+0000 7fe0f9ffb700 1 -- 172.21.15.72:0/951220765 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4003dd0 con 0x7fe0fc139250 2023-10-03T10:18:37.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.633+0000 7fe10152d700 1 -- 172.21.15.72:0/951220765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0fc139250 msgr2=0x7fe0fc13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.633+0000 7fe10152d700 1 --2- 172.21.15.72:0/951220765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0fc139250 0x7fe0fc13b630 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4009e50 tx=0x7fe0f400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:37.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.633+0000 7fe10152d700 1 -- 172.21.15.72:0/951220765 shutdown_connections 2023-10-03T10:18:37.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.633+0000 7fe10152d700 1 --2- 172.21.15.72:0/951220765 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0fc139250 0x7fe0fc13b630 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.633+0000 7fe10152d700 1 --2- 172.21.15.72:0/951220765 >> v2:172.21.15.72:3300/0 conn(0x7fe0fc0a1510 0x7fe0fc138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.633+0000 7fe10152d700 1 -- 172.21.15.72:0/951220765 >> 172.21.15.72:0/951220765 conn(0x7fe0fc0a6550 msgr2=0x7fe0fc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.633+0000 7fe10152d700 1 -- 172.21.15.72:0/951220765 shutdown_connections 2023-10-03T10:18:37.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.633+0000 7fe10152d700 1 -- 172.21.15.72:0/951220765 wait complete. 2023-10-03T10:18:37.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.634+0000 7fe10152d700 1 Processor -- start 2023-10-03T10:18:37.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.634+0000 7fe10152d700 1 -- start start 2023-10-03T10:18:37.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.634+0000 7fe10152d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0fc0a0a30 0x7fe0fc122510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.634+0000 7fe10152d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0fc0a1510 0x7fe0fc122a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.634+0000 7fe10152d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0fc139250 0x7fe0fc1c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.634+0000 7fe10152d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc1251d0 con 0x7fe0fc0a0a30 2023-10-03T10:18:37.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.634+0000 7fe10152d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0a0220 con 0x7fe0fc0a1510 2023-10-03T10:18:37.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.634+0000 7fe10152d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc122050 con 0x7fe0fc139250 2023-10-03T10:18:37.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe0fa7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0fc0a1510 0x7fe0fc122a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe0fa7fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0fc0a1510 0x7fe0fc122a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56932/0 (socket says 172.21.15.72:56932) 2023-10-03T10:18:37.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe0fa7fc700 1 -- 172.21.15.72:0/2801977483 learned_addr learned my addr 172.21.15.72:0/2801977483 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:37.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe0fb7fe700 1 --2- 172.21.15.72:0/2801977483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0fc139250 0x7fe0fc1c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe0faffd700 1 --2- 172.21.15.72:0/2801977483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0fc0a0a30 0x7fe0fc122510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe0fa7fc700 1 -- 172.21.15.72:0/2801977483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0fc139250 msgr2=0x7fe0fc1c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe0fa7fc700 1 --2- 172.21.15.72:0/2801977483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0fc139250 0x7fe0fc1c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe0fa7fc700 1 -- 172.21.15.72:0/2801977483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0fc0a0a30 msgr2=0x7fe0fc122510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe0fa7fc700 1 --2- 172.21.15.72:0/2801977483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0fc0a0a30 0x7fe0fc122510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe0fa7fc700 1 -- 172.21.15.72:0/2801977483 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f4009b30 con 0x7fe0fc0a1510 2023-10-03T10:18:37.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe0fa7fc700 1 --2- 172.21.15.72:0/2801977483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0fc0a1510 0x7fe0fc122a50 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000b530 tx=0x7fe0f000b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe0e37fe700 1 -- 172.21.15.72:0/2801977483 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0011830 con 0x7fe0fc0a1510 2023-10-03T10:18:37.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe0e37fe700 1 -- 172.21.15.72:0/2801977483 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f0011990 con 0x7fe0fc0a1510 2023-10-03T10:18:37.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe10152d700 1 -- 172.21.15.72:0/2801977483 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0fc124210 con 0x7fe0fc0a1510 2023-10-03T10:18:37.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe0e37fe700 1 -- 172.21.15.72:0/2801977483 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0011d40 con 0x7fe0fc0a1510 2023-10-03T10:18:37.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.635+0000 7fe10152d700 1 -- 172.21.15.72:0/2801977483 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0fc125c40 con 0x7fe0fc0a1510 2023-10-03T10:18:37.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.636+0000 7fe0e37fe700 1 -- 172.21.15.72:0/2801977483 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe0f001a400 con 0x7fe0fc0a1510 2023-10-03T10:18:37.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.636+0000 7fe0e37fe700 1 -- 172.21.15.72:0/2801977483 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe0f003f5a0 con 0x7fe0fc0a1510 2023-10-03T10:18:37.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.637+0000 7fe10152d700 1 -- 172.21.15.72:0/2801977483 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0fc125320 con 0x7fe0fc0a1510 2023-10-03T10:18:37.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.641+0000 7fe0e37fe700 1 -- 172.21.15.72:0/2801977483 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0f000f8d0 con 0x7fe0fc0a1510 2023-10-03T10:18:37.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.682+0000 7f204aeb4700 1 Processor -- start 2023-10-03T10:18:37.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.682+0000 7f204aeb4700 1 -- start start 2023-10-03T10:18:37.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f204aeb4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f204409d6f0 0x7f204409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f204aeb4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f204409e000 0x7f2044130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f204aeb4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f204409e410 0x7f2044130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f204aeb4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204409f520 con 0x7f204409d6f0 2023-10-03T10:18:37.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f204aeb4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204409f130 con 0x7f204409e410 2023-10-03T10:18:37.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f204aeb4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f204409e930 con 0x7f204409e000 2023-10-03T10:18:37.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f2043fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f204409e000 0x7f2044130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f2043fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f204409e000 0x7f2044130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:50132/0 (socket says 172.21.15.72:50132) 2023-10-03T10:18:37.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f2043fff700 1 -- 172.21.15.72:0/393756666 learned_addr learned my addr 172.21.15.72:0/393756666 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:37.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f2049451700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f204409e410 0x7f2044130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f2048c50700 1 --2- 172.21.15.72:0/393756666 >> v2:172.21.15.72:3300/0 conn(0x7f204409d6f0 0x7f204409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f2043fff700 1 -- 172.21.15.72:0/393756666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f204409e410 msgr2=0x7f2044130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f2043fff700 1 --2- 172.21.15.72:0/393756666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f204409e410 0x7f2044130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f2043fff700 1 -- 172.21.15.72:0/393756666 >> v2:172.21.15.72:3300/0 conn(0x7f204409d6f0 msgr2=0x7f204409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f2043fff700 1 --2- 172.21.15.72:0/393756666 >> v2:172.21.15.72:3300/0 conn(0x7f204409d6f0 0x7f204409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f2043fff700 1 -- 172.21.15.72:0/393756666 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204409b2d0 con 0x7f204409e000 2023-10-03T10:18:37.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f2049451700 1 --2- 172.21.15.72:0/393756666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f204409e410 0x7f2044130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:37.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.683+0000 7f2043fff700 1 --2- 172.21.15.72:0/393756666 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f204409e000 0x7f2044130660 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2030009920 tx=0x7f2030009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59da05b689f36d04 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.684+0000 7f20437fe700 1 -- 172.21.15.72:0/393756666 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030011830 con 0x7f204409e000 2023-10-03T10:18:37.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.684+0000 7f20437fe700 1 -- 172.21.15.72:0/393756666 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2030011990 con 0x7f204409e000 2023-10-03T10:18:37.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.684+0000 7f20437fe700 1 -- 172.21.15.72:0/393756666 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030011d20 con 0x7f204409e000 2023-10-03T10:18:37.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.684+0000 7f204aeb4700 1 -- 172.21.15.72:0/393756666 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f204409e000 msgr2=0x7f2044130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.684+0000 7f204aeb4700 1 --2- 172.21.15.72:0/393756666 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f204409e000 0x7f2044130660 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2030009920 tx=0x7f2030009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:37.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.684+0000 7f204aeb4700 1 -- 172.21.15.72:0/393756666 shutdown_connections 2023-10-03T10:18:37.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.684+0000 7f204aeb4700 1 --2- 172.21.15.72:0/393756666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f204409e410 0x7f2044130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.684+0000 7f204aeb4700 1 --2- 172.21.15.72:0/393756666 >> v2:172.21.15.72:3300/0 conn(0x7f204409d6f0 0x7f204409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.684+0000 7f204aeb4700 1 --2- 172.21.15.72:0/393756666 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f204409e000 0x7f2044130660 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.684+0000 7f204aeb4700 1 -- 172.21.15.72:0/393756666 >> 172.21.15.72:0/393756666 conn(0x7f2044066f50 msgr2=0x7f204409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.684+0000 7f204aeb4700 1 -- 172.21.15.72:0/393756666 shutdown_connections 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.684+0000 7f204aeb4700 1 -- 172.21.15.72:0/393756666 wait complete. 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.686+0000 7f204aeb4700 1 Processor -- start 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.686+0000 7f204aeb4700 1 -- start start 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f204aeb4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f204409d6f0 0x7f2044131650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f204aeb4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f204409e000 0x7f2044131b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f204aeb4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f204409e410 0x7f20441320d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f204aeb4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2044132bc0 con 0x7f204409d6f0 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f204aeb4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204409c700 con 0x7f204409e000 2023-10-03T10:18:37.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f204aeb4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20441339f0 con 0x7f204409e410 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f2043fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f204409e000 0x7f2044131b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f2049451700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f204409e410 0x7f20441320d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f2043fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f204409e000 0x7f2044131b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:56954/0 (socket says 172.21.15.72:56954) 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f2043fff700 1 -- 172.21.15.72:0/1506127947 learned_addr learned my addr 172.21.15.72:0/1506127947 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f2048c50700 1 --2- 172.21.15.72:0/1506127947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f204409d6f0 0x7f2044131650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f2049451700 1 -- 172.21.15.72:0/1506127947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f204409e000 msgr2=0x7f2044131b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f2049451700 1 --2- 172.21.15.72:0/1506127947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f204409e000 0x7f2044131b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f2049451700 1 -- 172.21.15.72:0/1506127947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f204409d6f0 msgr2=0x7f2044131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f2049451700 1 --2- 172.21.15.72:0/1506127947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f204409d6f0 0x7f2044131650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f2049451700 1 -- 172.21.15.72:0/1506127947 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2030009550 con 0x7f204409e410 2023-10-03T10:18:37.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f2043fff700 1 --2- 172.21.15.72:0/1506127947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f204409e000 0x7f2044131b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f2048c50700 1 --2- 172.21.15.72:0/1506127947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f204409d6f0 0x7f2044131650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:37.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.687+0000 7f2049451700 1 --2- 172.21.15.72:0/1506127947 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f204409e410 0x7f20441320d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f203c007e60 tx=0x7f203c00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.688+0000 7f20417fa700 1 -- 172.21.15.72:0/1506127947 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c00ddd0 con 0x7f204409e410 2023-10-03T10:18:37.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.688+0000 7f20417fa700 1 -- 172.21.15.72:0/1506127947 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c00f040 con 0x7f204409e410 2023-10-03T10:18:37.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.688+0000 7f20417fa700 1 -- 172.21.15.72:0/1506127947 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c003c60 con 0x7f204409e410 2023-10-03T10:18:37.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.688+0000 7f204aeb4700 1 -- 172.21.15.72:0/1506127947 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2044134420 con 0x7f204409e410 2023-10-03T10:18:37.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.688+0000 7f204aeb4700 1 -- 172.21.15.72:0/1506127947 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2044134a50 con 0x7f204409e410 2023-10-03T10:18:37.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.689+0000 7f20417fa700 1 -- 172.21.15.72:0/1506127947 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f203c004030 con 0x7f204409e410 2023-10-03T10:18:37.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.689+0000 7f20417fa700 1 -- 172.21.15.72:0/1506127947 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f203c03f780 con 0x7f204409e410 2023-10-03T10:18:37.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.689+0000 7f204aeb4700 1 -- 172.21.15.72:0/1506127947 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2044074ea0 con 0x7f204409e410 2023-10-03T10:18:37.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.698+0000 7f20417fa700 1 -- 172.21.15.72:0/1506127947 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f203c01e3b0 con 0x7f204409e410 2023-10-03T10:18:37.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.753+0000 7f847e22f700 1 -- 172.21.15.72:0/2761422984 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8478121300 con 0x7f847809e410 2023-10-03T10:18:37.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.754+0000 7f845ffff700 1 -- 172.21.15.72:0/2761422984 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f84700122e0 con 0x7f847809e410 2023-10-03T10:18:37.754 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:37.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.756+0000 7f847e22f700 1 -- 172.21.15.72:0/2761422984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f847809e410 msgr2=0x7f847811eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.756+0000 7f847e22f700 1 --2- 172.21.15.72:0/2761422984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f847809e410 0x7f847811eac0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f8470007d90 tx=0x7f847000e3c0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.756+0000 7f847e22f700 1 -- 172.21.15.72:0/2761422984 shutdown_connections 2023-10-03T10:18:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.756+0000 7f847e22f700 1 --2- 172.21.15.72:0/2761422984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f847809e410 0x7f847811eac0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.756+0000 7f847e22f700 1 --2- 172.21.15.72:0/2761422984 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f847809d6f0 0x7f847811e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.756+0000 7f847e22f700 1 --2- 172.21.15.72:0/2761422984 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f847809e000 0x7f847811e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.756+0000 7f847e22f700 1 -- 172.21.15.72:0/2761422984 >> 172.21.15.72:0/2761422984 conn(0x7f8478066f50 msgr2=0x7f84780a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.756+0000 7f847e22f700 1 -- 172.21.15.72:0/2761422984 shutdown_connections 2023-10-03T10:18:37.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.756+0000 7f847e22f700 1 -- 172.21.15.72:0/2761422984 wait complete. 2023-10-03T10:18:37.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:37.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.827+0000 7fb29c453700 1 -- 172.21.15.72:0/1506377481 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb29411cc50 con 0x7fb294134ec0 2023-10-03T10:18:37.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.828+0000 7fb28affd700 1 -- 172.21.15.72:0/1506377481 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb284017070 con 0x7fb294134ec0 2023-10-03T10:18:37.828 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.830+0000 7fb29c453700 1 -- 172.21.15.72:0/1506377481 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb294134ec0 msgr2=0x7fb29411ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.830+0000 7fb29c453700 1 --2- 172.21.15.72:0/1506377481 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb294134ec0 0x7fb29411ae30 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb28400ebb0 tx=0x7fb28400eec0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.830+0000 7fb29c453700 1 -- 172.21.15.72:0/1506377481 shutdown_connections 2023-10-03T10:18:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.830+0000 7fb29c453700 1 --2- 172.21.15.72:0/1506377481 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb294137f20 0x7fb29411b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.830+0000 7fb29c453700 1 --2- 172.21.15.72:0/1506377481 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb29406c0e0 0x7fb29411a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.830+0000 7fb29c453700 1 --2- 172.21.15.72:0/1506377481 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb294134ec0 0x7fb29411ae30 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.830+0000 7fb29c453700 1 -- 172.21.15.72:0/1506377481 >> 172.21.15.72:0/1506377481 conn(0x7fb2940a4210 msgr2=0x7fb294099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.830+0000 7fb29c453700 1 -- 172.21.15.72:0/1506377481 shutdown_connections 2023-10-03T10:18:37.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.830+0000 7fb29c453700 1 -- 172.21.15.72:0/1506377481 wait complete. 2023-10-03T10:18:37.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:37.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.850+0000 7fe10152d700 1 -- 172.21.15.72:0/2801977483 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe0fc074ea0 con 0x7fe0fc0a1510 2023-10-03T10:18:37.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.851+0000 7fe0e37fe700 1 -- 172.21.15.72:0/2801977483 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0f0022350 con 0x7fe0fc0a1510 2023-10-03T10:18:37.851 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:37.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.853+0000 7fe10152d700 1 -- 172.21.15.72:0/2801977483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0fc0a1510 msgr2=0x7fe0fc122a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.853+0000 7fe10152d700 1 --2- 172.21.15.72:0/2801977483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0fc0a1510 0x7fe0fc122a50 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000b530 tx=0x7fe0f000b840 comp rx=0 tx=0).stop 2023-10-03T10:18:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.853+0000 7fe10152d700 1 -- 172.21.15.72:0/2801977483 shutdown_connections 2023-10-03T10:18:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.853+0000 7fe10152d700 1 --2- 172.21.15.72:0/2801977483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0fc0a0a30 0x7fe0fc122510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.853+0000 7fe10152d700 1 --2- 172.21.15.72:0/2801977483 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe0fc139250 0x7fe0fc1c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.853+0000 7fe10152d700 1 --2- 172.21.15.72:0/2801977483 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0fc0a1510 0x7fe0fc122a50 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.853+0000 7fe10152d700 1 -- 172.21.15.72:0/2801977483 >> 172.21.15.72:0/2801977483 conn(0x7fe0fc0a6550 msgr2=0x7fe0fc137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.853+0000 7fe10152d700 1 -- 172.21.15.72:0/2801977483 shutdown_connections 2023-10-03T10:18:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.853+0000 7fe10152d700 1 -- 172.21.15.72:0/2801977483 wait complete. 2023-10-03T10:18:37.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.895+0000 7f204aeb4700 1 -- 172.21.15.72:0/1506127947 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2044134890 con 0x7f204409e410 2023-10-03T10:18:37.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.895+0000 7f20417fa700 1 -- 172.21.15.72:0/1506127947 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2044134890 con 0x7f204409e410 2023-10-03T10:18:37.896 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:37.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.897+0000 7f204aeb4700 1 -- 172.21.15.72:0/1506127947 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f204409e410 msgr2=0x7f20441320d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.897+0000 7f204aeb4700 1 --2- 172.21.15.72:0/1506127947 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f204409e410 0x7f20441320d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f203c007e60 tx=0x7f203c00d3b0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.897+0000 7f204aeb4700 1 -- 172.21.15.72:0/1506127947 shutdown_connections 2023-10-03T10:18:37.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.897+0000 7f204aeb4700 1 --2- 172.21.15.72:0/1506127947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f204409d6f0 0x7f2044131650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.897+0000 7f204aeb4700 1 --2- 172.21.15.72:0/1506127947 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f204409e410 0x7f20441320d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.897+0000 7f204aeb4700 1 --2- 172.21.15.72:0/1506127947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f204409e000 0x7f2044131b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.897+0000 7f204aeb4700 1 -- 172.21.15.72:0/1506127947 >> 172.21.15.72:0/1506127947 conn(0x7f2044066f50 msgr2=0x7f2044070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.897+0000 7f204aeb4700 1 -- 172.21.15.72:0/1506127947 shutdown_connections 2023-10-03T10:18:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:37.897+0000 7f204aeb4700 1 -- 172.21.15.72:0/1506127947 wait complete. 2023-10-03T10:18:37.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:38.774 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:38.843 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:38.866 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:38.910 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.916+0000 7fa2cb08b700 1 Processor -- start 2023-10-03T10:18:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.916+0000 7fa2cb08b700 1 -- start start 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2cb08b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa2c41338a0 0x7fa2c4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2cb08b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2c409de50 0x7fa2c409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2cb08b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2c409e760 0x7fa2c413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2cb08b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2c406fef0 con 0x7fa2c41338a0 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2cb08b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c406ef30 con 0x7fa2c409de50 2023-10-03T10:18:38.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2cb08b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c41334b0 con 0x7fa2c409e760 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2c9628700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2c409e760 0x7fa2c413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2c3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2c409de50 0x7fa2c409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2c9628700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2c409e760 0x7fa2c413a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60356/0 (socket says 172.21.15.72:60356) 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2c9628700 1 -- 172.21.15.72:0/1348205656 learned_addr learned my addr 172.21.15.72:0/1348205656 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2c8e27700 1 --2- 172.21.15.72:0/1348205656 >> v2:172.21.15.72:3300/0 conn(0x7fa2c41338a0 0x7fa2c4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2c9628700 1 -- 172.21.15.72:0/1348205656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2c409de50 msgr2=0x7fa2c409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2c9628700 1 --2- 172.21.15.72:0/1348205656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2c409de50 0x7fa2c409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2c9628700 1 -- 172.21.15.72:0/1348205656 >> v2:172.21.15.72:3300/0 conn(0x7fa2c41338a0 msgr2=0x7fa2c4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2c9628700 1 --2- 172.21.15.72:0/1348205656 >> v2:172.21.15.72:3300/0 conn(0x7fa2c41338a0 0x7fa2c4133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2c9628700 1 -- 172.21.15.72:0/1348205656 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c406fc30 con 0x7fa2c409e760 2023-10-03T10:18:38.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.917+0000 7fa2c3fff700 1 --2- 172.21.15.72:0/1348205656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2c409de50 0x7fa2c409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.918+0000 7fa2c9628700 1 --2- 172.21.15.72:0/1348205656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2c409e760 0x7fa2c413a730 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009e50 tx=0x7fa2bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fd0556bcdf164b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.918+0000 7fa2c37fe700 1 -- 172.21.15.72:0/1348205656 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc00e070 con 0x7fa2c409e760 2023-10-03T10:18:38.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.918+0000 7fa2c37fe700 1 -- 172.21.15.72:0/1348205656 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc00b910 con 0x7fa2c409e760 2023-10-03T10:18:38.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.918+0000 7fa2c37fe700 1 -- 172.21.15.72:0/1348205656 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc00bcc0 con 0x7fa2c409e760 2023-10-03T10:18:38.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.918+0000 7fa2cb08b700 1 -- 172.21.15.72:0/1348205656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2c409e760 msgr2=0x7fa2c413a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.918+0000 7fa2cb08b700 1 --2- 172.21.15.72:0/1348205656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2c409e760 0x7fa2c413a730 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009e50 tx=0x7fa2bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.919+0000 7fa2cb08b700 1 -- 172.21.15.72:0/1348205656 shutdown_connections 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.919+0000 7fa2cb08b700 1 --2- 172.21.15.72:0/1348205656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2c409e760 0x7fa2c413a730 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.919+0000 7fa2cb08b700 1 --2- 172.21.15.72:0/1348205656 >> v2:172.21.15.72:3300/0 conn(0x7fa2c41338a0 0x7fa2c4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.919+0000 7fa2cb08b700 1 --2- 172.21.15.72:0/1348205656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2c409de50 0x7fa2c409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.919+0000 7fa2cb08b700 1 -- 172.21.15.72:0/1348205656 >> 172.21.15.72:0/1348205656 conn(0x7fa2c40a2aa0 msgr2=0x7fa2c40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.919+0000 7fa2cb08b700 1 -- 172.21.15.72:0/1348205656 shutdown_connections 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.919+0000 7fa2cb08b700 1 -- 172.21.15.72:0/1348205656 wait complete. 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.920+0000 7fa2cb08b700 1 Processor -- start 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.920+0000 7fa2cb08b700 1 -- start start 2023-10-03T10:18:38.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.920+0000 7fa2cb08b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2c409de50 0x7fa2c411a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.920+0000 7fa2cb08b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2c409e760 0x7fa2c411aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.920+0000 7fa2cb08b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2c41338a0 0x7fa2c411b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.920+0000 7fa2cb08b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c411e9f0 con 0x7fa2c409de50 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.920+0000 7fa2cb08b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c411e030 con 0x7fa2c41338a0 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.920+0000 7fa2cb08b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c411d370 con 0x7fa2c409e760 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.920+0000 7fa2c3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2c409e760 0x7fa2c411aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.920+0000 7fa2c9628700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2c41338a0 0x7fa2c411b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.921+0000 7fa2c3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2c409e760 0x7fa2c411aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60362/0 (socket says 172.21.15.72:60362) 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.921+0000 7fa2c3fff700 1 -- 172.21.15.72:0/1665132168 learned_addr learned my addr 172.21.15.72:0/1665132168 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.921+0000 7fa2c3fff700 1 -- 172.21.15.72:0/1665132168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2c41338a0 msgr2=0x7fa2c411b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.921+0000 7fa2c3fff700 1 --2- 172.21.15.72:0/1665132168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2c41338a0 0x7fa2c411b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.921+0000 7fa2c3fff700 1 -- 172.21.15.72:0/1665132168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2c409de50 msgr2=0x7fa2c411a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.921+0000 7fa2c3fff700 1 --2- 172.21.15.72:0/1665132168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2c409de50 0x7fa2c411a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.921+0000 7fa2c3fff700 1 -- 172.21.15.72:0/1665132168 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b00094a0 con 0x7fa2c409e760 2023-10-03T10:18:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.921+0000 7fa2c9628700 1 --2- 172.21.15.72:0/1665132168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2c41338a0 0x7fa2c411b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.921+0000 7fa2c3fff700 1 --2- 172.21.15.72:0/1665132168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2c409e760 0x7fa2c411aae0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa2b000ec10 tx=0x7fa2b000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.921+0000 7fa2c17fa700 1 -- 172.21.15.72:0/1665132168 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b000c850 con 0x7fa2c409e760 2023-10-03T10:18:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.921+0000 7fa2c17fa700 1 -- 172.21.15.72:0/1665132168 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2b000c9b0 con 0x7fa2c409e760 2023-10-03T10:18:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.921+0000 7fa2cb08b700 1 -- 172.21.15.72:0/1665132168 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2bc009b30 con 0x7fa2c409e760 2023-10-03T10:18:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.921+0000 7fa2c17fa700 1 -- 172.21.15.72:0/1665132168 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2b000cd40 con 0x7fa2c409e760 2023-10-03T10:18:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.921+0000 7fa2cb08b700 1 -- 172.21.15.72:0/1665132168 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c411c120 con 0x7fa2c409e760 2023-10-03T10:18:38.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.922+0000 7fa2c17fa700 1 -- 172.21.15.72:0/1665132168 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa2b0013470 con 0x7fa2c409e760 2023-10-03T10:18:38.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.923+0000 7fa2c17fa700 1 -- 172.21.15.72:0/1665132168 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa2b003fb60 con 0x7fa2c409e760 2023-10-03T10:18:38.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.924+0000 7fa2cb08b700 1 -- 172.21.15.72:0/1665132168 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c411dbd0 con 0x7fa2c409e760 2023-10-03T10:18:38.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.929+0000 7fa2c17fa700 1 -- 172.21.15.72:0/1665132168 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa2b0013720 con 0x7fa2c409e760 2023-10-03T10:18:38.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.978+0000 7f78247c6700 1 Processor -- start 2023-10-03T10:18:38.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.978+0000 7f78247c6700 1 -- start start 2023-10-03T10:18:38.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.979+0000 7f78247c6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f781c09eca0 0x7f781c13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.979+0000 7f78247c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c06f050 0x7f781c13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.979+0000 7f78247c6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781c070ee0 con 0x7f781c06e570 2023-10-03T10:18:38.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.979+0000 7f78247c6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c071980 con 0x7f781c09eca0 2023-10-03T10:18:38.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.979+0000 7f78247c6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f781c071480 con 0x7f781c06f050 2023-10-03T10:18:38.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.979+0000 7f7822d63700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c06f050 0x7f781c13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.979+0000 7f7821d61700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f781c09eca0 0x7f781c13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.979+0000 7f7822d63700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c06f050 0x7f781c13f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60376/0 (socket says 172.21.15.72:60376) 2023-10-03T10:18:38.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.979+0000 7f7822d63700 1 -- 172.21.15.72:0/476503063 learned_addr learned my addr 172.21.15.72:0/476503063 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:38.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.979+0000 7f7822d63700 1 -- 172.21.15.72:0/476503063 >> v2:172.21.15.72:3300/0 conn(0x7f781c09eca0 msgr2=0x7f781c13cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.979+0000 7f7822d63700 1 --2- 172.21.15.72:0/476503063 >> v2:172.21.15.72:3300/0 conn(0x7f781c09eca0 0x7f781c13cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.979+0000 7f7822d63700 1 -- 172.21.15.72:0/476503063 >> v1:172.21.15.72:6789/0 conn(0x7f781c06e570 legacy=0x7f781c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.979+0000 7f7822d63700 1 -- 172.21.15.72:0/476503063 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c071b90 con 0x7f781c06f050 2023-10-03T10:18:38.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.979+0000 7f7821d61700 1 --2- 172.21.15.72:0/476503063 >> v2:172.21.15.72:3300/0 conn(0x7f781c09eca0 0x7f781c13cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.980+0000 7f7822d63700 1 --2- 172.21.15.72:0/476503063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c06f050 0x7f781c13f3f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7814009e50 tx=0x7f781400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24a504ad091889e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.980+0000 7f7821560700 1 -- 172.21.15.72:0/476503063 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400e070 con 0x7f781c06f050 2023-10-03T10:18:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.980+0000 7f7821560700 1 -- 172.21.15.72:0/476503063 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781400b910 con 0x7f781c06f050 2023-10-03T10:18:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.980+0000 7f7821560700 1 -- 172.21.15.72:0/476503063 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400bcc0 con 0x7f781c06f050 2023-10-03T10:18:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.980+0000 7f78247c6700 1 -- 172.21.15.72:0/476503063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c06f050 msgr2=0x7f781c13f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.980+0000 7f78247c6700 1 --2- 172.21.15.72:0/476503063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c06f050 0x7f781c13f3f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7814009e50 tx=0x7f781400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.981+0000 7f78247c6700 1 -- 172.21.15.72:0/476503063 shutdown_connections 2023-10-03T10:18:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.981+0000 7f78247c6700 1 --2- 172.21.15.72:0/476503063 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c06f050 0x7f781c13f3f0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.981+0000 7f78247c6700 1 --2- 172.21.15.72:0/476503063 >> v2:172.21.15.72:3300/0 conn(0x7f781c09eca0 0x7f781c13cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.981+0000 7f78247c6700 1 -- 172.21.15.72:0/476503063 >> 172.21.15.72:0/476503063 conn(0x7f781c0a2aa0 msgr2=0x7f781c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.981+0000 7f78247c6700 1 -- 172.21.15.72:0/476503063 shutdown_connections 2023-10-03T10:18:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.981+0000 7f78247c6700 1 -- 172.21.15.72:0/476503063 wait complete. 2023-10-03T10:18:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.982+0000 7f78247c6700 1 Processor -- start 2023-10-03T10:18:38.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.982+0000 7f78247c6700 1 -- start start 2023-10-03T10:18:38.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.982+0000 7f78247c6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c06e570 0x7f781c13cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.982+0000 7f78247c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c06f050 0x7f781c13d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.982+0000 7f78247c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c1383e0 0x7f781c13d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.982+0000 7f78247c6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c13e730 con 0x7f781c06e570 2023-10-03T10:18:38.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.982+0000 7f78247c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781c13ec60 con 0x7f781c06f050 2023-10-03T10:18:38.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.982+0000 7f78247c6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f781c070610 con 0x7f781c1383e0 2023-10-03T10:18:38.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.982+0000 7f7822562700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c06e570 0x7f781c13cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.982+0000 7f7822562700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c06e570 0x7f781c13cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40544/0 (socket says 172.21.15.72:40544) 2023-10-03T10:18:38.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.982+0000 7f7822562700 1 -- 172.21.15.72:0/2530206586 learned_addr learned my addr 172.21.15.72:0/2530206586 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:38.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.982+0000 7f7822d63700 1 --2- 172.21.15.72:0/2530206586 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c1383e0 0x7f781c13d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.983+0000 7f7822562700 1 -- 172.21.15.72:0/2530206586 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c1383e0 msgr2=0x7f781c13d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.983+0000 7f7822562700 1 --2- 172.21.15.72:0/2530206586 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c1383e0 0x7f781c13d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.983+0000 7f7822562700 1 -- 172.21.15.72:0/2530206586 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c06f050 msgr2=0x7f781c13d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.983+0000 7f7822562700 1 --2- 172.21.15.72:0/2530206586 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c06f050 0x7f781c13d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.983+0000 7f7822562700 1 -- 172.21.15.72:0/2530206586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c0094a0 con 0x7f781c06e570 2023-10-03T10:18:38.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.983+0000 7f7822562700 1 --2- 172.21.15.72:0/2530206586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c06e570 0x7f781c13cb20 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f781800c4e0 tx=0x7f781800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.983+0000 7f7812ffd700 1 -- 172.21.15.72:0/2530206586 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78180052d0 con 0x7f781c06e570 2023-10-03T10:18:38.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.983+0000 7f7812ffd700 1 -- 172.21.15.72:0/2530206586 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7818005430 con 0x7f781c06e570 2023-10-03T10:18:38.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.983+0000 7f7812ffd700 1 -- 172.21.15.72:0/2530206586 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78180038c0 con 0x7f781c06e570 2023-10-03T10:18:38.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.983+0000 7f78247c6700 1 -- 172.21.15.72:0/2530206586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7814009b30 con 0x7f781c06e570 2023-10-03T10:18:38.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.983+0000 7f78247c6700 1 -- 172.21.15.72:0/2530206586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781c12db60 con 0x7f781c06e570 2023-10-03T10:18:38.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.984+0000 7f78247c6700 1 -- 172.21.15.72:0/2530206586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781c074ea0 con 0x7f781c06e570 2023-10-03T10:18:38.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.985+0000 7f7812ffd700 1 -- 172.21.15.72:0/2530206586 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7818003a20 con 0x7f781c06e570 2023-10-03T10:18:38.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.985+0000 7f7812ffd700 1 -- 172.21.15.72:0/2530206586 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f781803ef80 con 0x7f781c06e570 2023-10-03T10:18:38.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:38.993+0000 7f7812ffd700 1 -- 172.21.15.72:0/2530206586 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7818018260 con 0x7f781c06e570 2023-10-03T10:18:39.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.022+0000 7f9751602700 1 Processor -- start 2023-10-03T10:18:39.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.022+0000 7f9751602700 1 -- start start 2023-10-03T10:18:39.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.023+0000 7f9751602700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f974c09a2e0 0x7f974c135800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.023+0000 7f9751602700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f974c135d40 0x7f974c138120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.023+0000 7f9751602700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f974c09eae0 con 0x7f974c099800 2023-10-03T10:18:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.023+0000 7f9751602700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974c09bb40 con 0x7f974c09a2e0 2023-10-03T10:18:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.023+0000 7f9751602700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f974c09be00 con 0x7f974c135d40 2023-10-03T10:18:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.023+0000 7f97427fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f974c09a2e0 0x7f974c135800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.023+0000 7f97427fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f974c09a2e0 0x7f974c135800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40552/0 (socket says 172.21.15.72:40552) 2023-10-03T10:18:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.023+0000 7f97427fc700 1 -- 172.21.15.72:0/1934207268 learned_addr learned my addr 172.21.15.72:0/1934207268 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.023+0000 7f974b7fe700 1 --2- 172.21.15.72:0/1934207268 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f974c135d40 0x7f974c138120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.024+0000 7f97427fc700 1 -- 172.21.15.72:0/1934207268 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f974c135d40 msgr2=0x7f974c138120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.024+0000 7f97427fc700 1 --2- 172.21.15.72:0/1934207268 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f974c135d40 0x7f974c138120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.024+0000 7f97427fc700 1 -- 172.21.15.72:0/1934207268 >> v1:172.21.15.72:6789/0 conn(0x7f974c099800 legacy=0x7f974c099bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.024+0000 7f97427fc700 1 -- 172.21.15.72:0/1934207268 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c09ac70 con 0x7f974c09a2e0 2023-10-03T10:18:39.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.024+0000 7f97427fc700 1 --2- 172.21.15.72:0/1934207268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f974c09a2e0 0x7f974c135800 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f97340098f0 tx=0x7f9734009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d61607dd29d4f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.024+0000 7f974a7fc700 1 -- 172.21.15.72:0/1934207268 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734011830 con 0x7f974c09a2e0 2023-10-03T10:18:39.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.024+0000 7f974a7fc700 1 -- 172.21.15.72:0/1934207268 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9734011990 con 0x7f974c09a2e0 2023-10-03T10:18:39.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.024+0000 7f974a7fc700 1 -- 172.21.15.72:0/1934207268 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734011d20 con 0x7f974c09a2e0 2023-10-03T10:18:39.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.025+0000 7f9751602700 1 -- 172.21.15.72:0/1934207268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f974c09a2e0 msgr2=0x7f974c135800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.025+0000 7f9751602700 1 --2- 172.21.15.72:0/1934207268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f974c09a2e0 0x7f974c135800 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f97340098f0 tx=0x7f9734009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:39.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.025+0000 7f9751602700 1 -- 172.21.15.72:0/1934207268 shutdown_connections 2023-10-03T10:18:39.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.025+0000 7f9751602700 1 --2- 172.21.15.72:0/1934207268 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f974c135d40 0x7f974c138120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.025+0000 7f9751602700 1 --2- 172.21.15.72:0/1934207268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f974c09a2e0 0x7f974c135800 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.025+0000 7f9751602700 1 -- 172.21.15.72:0/1934207268 >> 172.21.15.72:0/1934207268 conn(0x7f974c0a27f0 msgr2=0x7f974c0a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.025+0000 7f9751602700 1 -- 172.21.15.72:0/1934207268 shutdown_connections 2023-10-03T10:18:39.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.025+0000 7f9751602700 1 -- 172.21.15.72:0/1934207268 wait complete. 2023-10-03T10:18:39.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.026+0000 7f9751602700 1 Processor -- start 2023-10-03T10:18:39.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.027+0000 7f9751602700 1 -- start start 2023-10-03T10:18:39.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.027+0000 7f9751602700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f974c099800 0x7f974c070940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.027+0000 7f9751602700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f974c09a2e0 0x7f974c070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.027+0000 7f9751602700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f974c135d40 0x7f974c1c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.027+0000 7f9751602700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974c098890 con 0x7f974c09a2e0 2023-10-03T10:18:39.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.027+0000 7f9751602700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974c070540 con 0x7f974c135d40 2023-10-03T10:18:39.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.027+0000 7f9751602700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f974c12c140 con 0x7f974c099800 2023-10-03T10:18:39.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.027+0000 7f974affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f974c099800 0x7f974c070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f974affd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f974c099800 0x7f974c070940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60398/0 (socket says 172.21.15.72:60398) 2023-10-03T10:18:39.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f974affd700 1 -- 172.21.15.72:0/2520092817 learned_addr learned my addr 172.21.15.72:0/2520092817 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:39.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f97427fc700 1 --2- 172.21.15.72:0/2520092817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f974c09a2e0 0x7f974c070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f974b7fe700 1 --2- 172.21.15.72:0/2520092817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f974c135d40 0x7f974c1c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f974affd700 1 -- 172.21.15.72:0/2520092817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f974c135d40 msgr2=0x7f974c1c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f974affd700 1 --2- 172.21.15.72:0/2520092817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f974c135d40 0x7f974c1c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f974affd700 1 -- 172.21.15.72:0/2520092817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f974c09a2e0 msgr2=0x7f974c070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f974affd700 1 --2- 172.21.15.72:0/2520092817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f974c09a2e0 0x7f974c070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f974affd700 1 -- 172.21.15.72:0/2520092817 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9734009550 con 0x7f974c099800 2023-10-03T10:18:39.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f97427fc700 1 --2- 172.21.15.72:0/2520092817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f974c09a2e0 0x7f974c070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f974affd700 1 --2- 172.21.15.72:0/2520092817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f974c099800 0x7f974c070940 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f973c00c510 tx=0x7f973c00c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f9743fff700 1 -- 172.21.15.72:0/2520092817 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c0052d0 con 0x7f974c099800 2023-10-03T10:18:39.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f9751602700 1 -- 172.21.15.72:0/2520092817 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974c097660 con 0x7f974c099800 2023-10-03T10:18:39.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f9751602700 1 -- 172.21.15.72:0/2520092817 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974c0722e0 con 0x7f974c099800 2023-10-03T10:18:39.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f9743fff700 1 -- 172.21.15.72:0/2520092817 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c005430 con 0x7f974c099800 2023-10-03T10:18:39.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.028+0000 7f9743fff700 1 -- 172.21.15.72:0/2520092817 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c003880 con 0x7f974c099800 2023-10-03T10:18:39.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.029+0000 7f9743fff700 1 -- 172.21.15.72:0/2520092817 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f973c0039e0 con 0x7f974c099800 2023-10-03T10:18:39.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.030+0000 7f9743fff700 1 -- 172.21.15.72:0/2520092817 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f973c03e9a0 con 0x7f974c099800 2023-10-03T10:18:39.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.030+0000 7f9751602700 1 -- 172.21.15.72:0/2520092817 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974c04f2a0 con 0x7f974c099800 2023-10-03T10:18:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.037+0000 7f9743fff700 1 -- 172.21.15.72:0/2520092817 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f973c017070 con 0x7f974c099800 2023-10-03T10:18:39.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.053+0000 7f00203da700 1 Processor -- start 2023-10-03T10:18:39.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.053+0000 7f00203da700 1 -- start start 2023-10-03T10:18:39.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f00203da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f001812cf60 0x7f001806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f00203da700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0018130430 0x7f0018137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f00203da700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001812cd90 con 0x7f001812f8b0 2023-10-03T10:18:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f00203da700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001812d330 con 0x7f0018130430 2023-10-03T10:18:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f00203da700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0018071780 con 0x7f001812cf60 2023-10-03T10:18:39.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f001e176700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f001812cf60 0x7f001806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f001d975700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f001812f8b0 0x7f001812fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53098/0 (socket says 172.21.15.72:53098) 2023-10-03T10:18:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f001d975700 1 -- 172.21.15.72:0/3864817793 learned_addr learned my addr 172.21.15.72:0/3864817793 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f001e977700 1 --2- 172.21.15.72:0/3864817793 >> v2:172.21.15.72:3300/0 conn(0x7f0018130430 0x7f0018137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f001d174700 1 -- 172.21.15.72:0/3864817793 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679670878 0 0) 0x7f001812cd90 con 0x7f001812f8b0 2023-10-03T10:18:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f001d174700 1 -- 172.21.15.72:0/3864817793 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00040034d0 con 0x7f001812f8b0 2023-10-03T10:18:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f001e176700 1 -- 172.21.15.72:0/3864817793 >> v2:172.21.15.72:3300/0 conn(0x7f0018130430 msgr2=0x7f0018137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f001e176700 1 --2- 172.21.15.72:0/3864817793 >> v2:172.21.15.72:3300/0 conn(0x7f0018130430 0x7f0018137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f001e176700 1 -- 172.21.15.72:0/3864817793 >> v1:172.21.15.72:6789/0 conn(0x7f001812f8b0 legacy=0x7f001812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f001e176700 1 -- 172.21.15.72:0/3864817793 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0018071a40 con 0x7f001812cf60 2023-10-03T10:18:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f001e977700 1 --2- 172.21.15.72:0/3864817793 >> v2:172.21.15.72:3300/0 conn(0x7f0018130430 0x7f0018137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.054+0000 7f001e176700 1 --2- 172.21.15.72:0/3864817793 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f001812cf60 0x7f001806f5d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0014009840 tx=0x7f0014009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc11447c730c2ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.055+0000 7f001d174700 1 -- 172.21.15.72:0/3864817793 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0014011830 con 0x7f001812cf60 2023-10-03T10:18:39.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.055+0000 7f001d174700 1 -- 172.21.15.72:0/3864817793 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0014011990 con 0x7f001812cf60 2023-10-03T10:18:39.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.055+0000 7f001d174700 1 -- 172.21.15.72:0/3864817793 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0014011d20 con 0x7f001812cf60 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.055+0000 7f00203da700 1 -- 172.21.15.72:0/3864817793 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f001812cf60 msgr2=0x7f001806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.055+0000 7f00203da700 1 --2- 172.21.15.72:0/3864817793 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f001812cf60 0x7f001806f5d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0014009840 tx=0x7f0014009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.055+0000 7f00203da700 1 -- 172.21.15.72:0/3864817793 shutdown_connections 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.055+0000 7f00203da700 1 --2- 172.21.15.72:0/3864817793 >> v2:172.21.15.72:3300/0 conn(0x7f0018130430 0x7f0018137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.055+0000 7f00203da700 1 --2- 172.21.15.72:0/3864817793 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f001812cf60 0x7f001806f5d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.055+0000 7f00203da700 1 -- 172.21.15.72:0/3864817793 >> 172.21.15.72:0/3864817793 conn(0x7f00180a2aa0 msgr2=0x7f00180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.055+0000 7f00203da700 1 -- 172.21.15.72:0/3864817793 shutdown_connections 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.056+0000 7f00203da700 1 -- 172.21.15.72:0/3864817793 wait complete. 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.056+0000 7f00203da700 1 Processor -- start 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.056+0000 7f00203da700 1 -- start start 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f00203da700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f001812cf60 0x7f001809b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f00203da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f001812f8b0 0x7f001809bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f00203da700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0018130430 0x7f001809c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f00203da700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001809da70 con 0x7f001812cf60 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f00203da700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001809e670 con 0x7f001812f8b0 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f00203da700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f001809de10 con 0x7f0018130430 2023-10-03T10:18:39.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f001e176700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f001812cf60 0x7f001809b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f001e176700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f001812cf60 0x7f001809b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40594/0 (socket says 172.21.15.72:40594) 2023-10-03T10:18:39.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f001e176700 1 -- 172.21.15.72:0/3468566371 learned_addr learned my addr 172.21.15.72:0/3468566371 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:39.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f001e977700 1 --2- 172.21.15.72:0/3468566371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0018130430 0x7f001809c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f001d975700 1 --2- 172.21.15.72:0/3468566371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f001812f8b0 0x7f001809bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f001e977700 1 -- 172.21.15.72:0/3468566371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f001812f8b0 msgr2=0x7f001809bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f001e977700 1 --2- 172.21.15.72:0/3468566371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f001812f8b0 0x7f001809bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f001e977700 1 -- 172.21.15.72:0/3468566371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f001812cf60 msgr2=0x7f001809b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f001e977700 1 --2- 172.21.15.72:0/3468566371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f001812cf60 0x7f001809b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.057+0000 7f001e977700 1 -- 172.21.15.72:0/3468566371 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0010009a70 con 0x7f0018130430 2023-10-03T10:18:39.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.058+0000 7f001e176700 1 --2- 172.21.15.72:0/3468566371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f001812cf60 0x7f001809b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.058+0000 7f001e977700 1 --2- 172.21.15.72:0/3468566371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0018130430 0x7f001809c220 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f001000ef90 tx=0x7f001000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.058+0000 7f000effd700 1 -- 172.21.15.72:0/3468566371 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001000ca90 con 0x7f0018130430 2023-10-03T10:18:39.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.058+0000 7f000effd700 1 -- 172.21.15.72:0/3468566371 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001000f040 con 0x7f0018130430 2023-10-03T10:18:39.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.058+0000 7f00203da700 1 -- 172.21.15.72:0/3468566371 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00140094a0 con 0x7f0018130430 2023-10-03T10:18:39.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.058+0000 7f000effd700 1 -- 172.21.15.72:0/3468566371 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001000ce30 con 0x7f0018130430 2023-10-03T10:18:39.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.058+0000 7f00203da700 1 -- 172.21.15.72:0/3468566371 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001811d4e0 con 0x7f0018130430 2023-10-03T10:18:39.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.059+0000 7f000effd700 1 -- 172.21.15.72:0/3468566371 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0010014480 con 0x7f0018130430 2023-10-03T10:18:39.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.059+0000 7f000effd700 1 -- 172.21.15.72:0/3468566371 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f001003fbd0 con 0x7f0018130430 2023-10-03T10:18:39.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.059+0000 7f00203da700 1 -- 172.21.15.72:0/3468566371 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0018074ea0 con 0x7f0018130430 2023-10-03T10:18:39.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.064+0000 7f000effd700 1 -- 172.21.15.72:0/3468566371 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0010012930 con 0x7f0018130430 2023-10-03T10:18:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.172+0000 7fa2cb08b700 1 -- 172.21.15.72:0/1665132168 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa2c4074ea0 con 0x7fa2c409e760 2023-10-03T10:18:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.173+0000 7fa2c17fa700 1 -- 172.21.15.72:0/1665132168 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa2b0017020 con 0x7fa2c409e760 2023-10-03T10:18:39.173 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:39.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.174+0000 7fa2cb08b700 1 -- 172.21.15.72:0/1665132168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2c409e760 msgr2=0x7fa2c411aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.174+0000 7fa2cb08b700 1 --2- 172.21.15.72:0/1665132168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2c409e760 0x7fa2c411aae0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa2b000ec10 tx=0x7fa2b000ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:39.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.175+0000 7fa2cb08b700 1 -- 172.21.15.72:0/1665132168 shutdown_connections 2023-10-03T10:18:39.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.175+0000 7fa2cb08b700 1 --2- 172.21.15.72:0/1665132168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2c409de50 0x7fa2c411a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.175+0000 7fa2cb08b700 1 --2- 172.21.15.72:0/1665132168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2c41338a0 0x7fa2c411b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.175+0000 7fa2cb08b700 1 --2- 172.21.15.72:0/1665132168 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa2c409e760 0x7fa2c411aae0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.175+0000 7fa2cb08b700 1 -- 172.21.15.72:0/1665132168 >> 172.21.15.72:0/1665132168 conn(0x7fa2c40a2aa0 msgr2=0x7fa2c4130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.176+0000 7fa2cb08b700 1 -- 172.21.15.72:0/1665132168 shutdown_connections 2023-10-03T10:18:39.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.176+0000 7fa2cb08b700 1 -- 172.21.15.72:0/1665132168 wait complete. 2023-10-03T10:18:39.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:39.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.195+0000 7f78247c6700 1 -- 172.21.15.72:0/2530206586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f781c06b9e0 con 0x7f781c06e570 2023-10-03T10:18:39.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.195+0000 7f7812ffd700 1 -- 172.21.15.72:0/2530206586 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7818017030 con 0x7f781c06e570 2023-10-03T10:18:39.196 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:39.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.198+0000 7f78247c6700 1 -- 172.21.15.72:0/2530206586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c06e570 msgr2=0x7f781c13cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.198+0000 7f78247c6700 1 --2- 172.21.15.72:0/2530206586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c06e570 0x7f781c13cb20 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f781800c4e0 tx=0x7f781800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.198+0000 7f78247c6700 1 -- 172.21.15.72:0/2530206586 shutdown_connections 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.198+0000 7f78247c6700 1 --2- 172.21.15.72:0/2530206586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f781c06e570 0x7f781c13cb20 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.198+0000 7f78247c6700 1 --2- 172.21.15.72:0/2530206586 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f781c1383e0 0x7f781c13d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.198+0000 7f78247c6700 1 --2- 172.21.15.72:0/2530206586 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f781c06f050 0x7f781c13d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.198+0000 7f78247c6700 1 -- 172.21.15.72:0/2530206586 >> 172.21.15.72:0/2530206586 conn(0x7f781c0a2aa0 msgr2=0x7f781c09cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.198+0000 7f78247c6700 1 -- 172.21.15.72:0/2530206586 shutdown_connections 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.198+0000 7f78247c6700 1 -- 172.21.15.72:0/2530206586 wait complete. 2023-10-03T10:18:39.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.257+0000 7f00203da700 1 -- 172.21.15.72:0/3468566371 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f00180713a0 con 0x7f0018130430 2023-10-03T10:18:39.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.258+0000 7f000effd700 1 -- 172.21.15.72:0/3468566371 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0010012340 con 0x7f0018130430 2023-10-03T10:18:39.258 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:39.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.260+0000 7f00203da700 1 -- 172.21.15.72:0/3468566371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0018130430 msgr2=0x7f001809c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.260+0000 7f00203da700 1 --2- 172.21.15.72:0/3468566371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0018130430 0x7f001809c220 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f001000ef90 tx=0x7f001000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.260+0000 7f00203da700 1 -- 172.21.15.72:0/3468566371 shutdown_connections 2023-10-03T10:18:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.260+0000 7f00203da700 1 --2- 172.21.15.72:0/3468566371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f001812cf60 0x7f001809b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.260+0000 7f00203da700 1 --2- 172.21.15.72:0/3468566371 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0018130430 0x7f001809c220 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.260+0000 7f00203da700 1 --2- 172.21.15.72:0/3468566371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f001812f8b0 0x7f001809bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.260+0000 7f00203da700 1 -- 172.21.15.72:0/3468566371 >> 172.21.15.72:0/3468566371 conn(0x7f00180a2aa0 msgr2=0x7f00180a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.260+0000 7f00203da700 1 -- 172.21.15.72:0/3468566371 shutdown_connections 2023-10-03T10:18:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.260+0000 7f00203da700 1 -- 172.21.15.72:0/3468566371 wait complete. 2023-10-03T10:18:39.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:39.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.279+0000 7f9751602700 1 -- 172.21.15.72:0/2520092817 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f974c12bde0 con 0x7f974c099800 2023-10-03T10:18:39.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.279+0000 7f9743fff700 1 -- 172.21.15.72:0/2520092817 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f974c12bde0 con 0x7f974c099800 2023-10-03T10:18:39.280 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.281+0000 7f9751602700 1 -- 172.21.15.72:0/2520092817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f974c099800 msgr2=0x7f974c070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.281+0000 7f9751602700 1 --2- 172.21.15.72:0/2520092817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f974c099800 0x7f974c070940 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f973c00c510 tx=0x7f973c00c820 comp rx=0 tx=0).stop 2023-10-03T10:18:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.281+0000 7f9751602700 1 -- 172.21.15.72:0/2520092817 shutdown_connections 2023-10-03T10:18:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.281+0000 7f9751602700 1 --2- 172.21.15.72:0/2520092817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f974c135d40 0x7f974c1c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.281+0000 7f9751602700 1 --2- 172.21.15.72:0/2520092817 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f974c099800 0x7f974c070940 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.281+0000 7f9751602700 1 --2- 172.21.15.72:0/2520092817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f974c09a2e0 0x7f974c070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.281+0000 7f9751602700 1 -- 172.21.15.72:0/2520092817 >> 172.21.15.72:0/2520092817 conn(0x7f974c0a27f0 msgr2=0x7f974c0965c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.282+0000 7f9751602700 1 -- 172.21.15.72:0/2520092817 shutdown_connections 2023-10-03T10:18:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:39.282+0000 7f9751602700 1 -- 172.21.15.72:0/2520092817 wait complete. 2023-10-03T10:18:39.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:40.194 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:40.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:40.273 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:40.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:40.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.336+0000 7ff2ecbab700 1 Processor -- start 2023-10-03T10:18:40.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.336+0000 7ff2ecbab700 1 -- start start 2023-10-03T10:18:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.337+0000 7ff2ecbab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e81338a0 0x7ff2e8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.337+0000 7ff2ecbab700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff2e809de50 0x7ff2e809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.337+0000 7ff2ecbab700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e806ef30 con 0x7ff2e809e760 2023-10-03T10:18:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.337+0000 7ff2ecbab700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e806fef0 con 0x7ff2e809de50 2023-10-03T10:18:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.337+0000 7ff2ecbab700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e81334b0 con 0x7ff2e81338a0 2023-10-03T10:18:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.337+0000 7ff2e6d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff2e809e760 0x7ff2e813a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53114/0 (socket says 172.21.15.72:53114) 2023-10-03T10:18:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.337+0000 7ff2e6d9d700 1 -- 172.21.15.72:0/3784291298 learned_addr learned my addr 172.21.15.72:0/3784291298 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.337+0000 7ff2e5d9b700 1 --2- 172.21.15.72:0/3784291298 >> v2:172.21.15.72:3300/0 conn(0x7ff2e809de50 0x7ff2e809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.337+0000 7ff2e659c700 1 --2- 172.21.15.72:0/3784291298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e81338a0 0x7ff2e8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.337+0000 7ff2e5d9b700 1 -- 172.21.15.72:0/3784291298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e81338a0 msgr2=0x7ff2e8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.337+0000 7ff2e5d9b700 1 --2- 172.21.15.72:0/3784291298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e81338a0 0x7ff2e8133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.337+0000 7ff2e5d9b700 1 -- 172.21.15.72:0/3784291298 >> v1:172.21.15.72:6789/0 conn(0x7ff2e809e760 legacy=0x7ff2e813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.337+0000 7ff2e5d9b700 1 -- 172.21.15.72:0/3784291298 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e806fc30 con 0x7ff2e809de50 2023-10-03T10:18:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.337+0000 7ff2e659c700 1 --2- 172.21.15.72:0/3784291298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e81338a0 0x7ff2e8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.338+0000 7ff2e5d9b700 1 --2- 172.21.15.72:0/3784291298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2e809de50 0x7ff2e809e220 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009840 tx=0x7ff2dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767c4f39dc7b568c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.338+0000 7ff2e559a700 1 -- 172.21.15.72:0/3784291298 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc011830 con 0x7ff2e809de50 2023-10-03T10:18:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.338+0000 7ff2e559a700 1 -- 172.21.15.72:0/3784291298 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc011990 con 0x7ff2e809de50 2023-10-03T10:18:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.338+0000 7ff2e559a700 1 -- 172.21.15.72:0/3784291298 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc011d20 con 0x7ff2e809de50 2023-10-03T10:18:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.339+0000 7ff2ecbab700 1 -- 172.21.15.72:0/3784291298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2e809de50 msgr2=0x7ff2e809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.339+0000 7ff2ecbab700 1 --2- 172.21.15.72:0/3784291298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2e809de50 0x7ff2e809e220 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009840 tx=0x7ff2dc009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.339+0000 7ff2ecbab700 1 -- 172.21.15.72:0/3784291298 shutdown_connections 2023-10-03T10:18:40.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.339+0000 7ff2ecbab700 1 --2- 172.21.15.72:0/3784291298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e81338a0 0x7ff2e8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.339+0000 7ff2ecbab700 1 --2- 172.21.15.72:0/3784291298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2e809de50 0x7ff2e809e220 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.339+0000 7ff2ecbab700 1 -- 172.21.15.72:0/3784291298 >> 172.21.15.72:0/3784291298 conn(0x7ff2e80a2aa0 msgr2=0x7ff2e80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.339+0000 7ff2ecbab700 1 -- 172.21.15.72:0/3784291298 shutdown_connections 2023-10-03T10:18:40.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.339+0000 7ff2ecbab700 1 -- 172.21.15.72:0/3784291298 wait complete. 2023-10-03T10:18:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.340+0000 7ff2ecbab700 1 Processor -- start 2023-10-03T10:18:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.341+0000 7ff2ecbab700 1 -- start start 2023-10-03T10:18:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.341+0000 7ff2ecbab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2e809de50 0x7ff2e811eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.341+0000 7ff2ecbab700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2e809e760 0x7ff2e811f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.341+0000 7ff2ecbab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e81338a0 0x7ff2e811f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.341+0000 7ff2ecbab700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e812f650 con 0x7ff2e809de50 2023-10-03T10:18:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.341+0000 7ff2ecbab700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8122040 con 0x7ff2e81338a0 2023-10-03T10:18:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.341+0000 7ff2ecbab700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e81225e0 con 0x7ff2e809e760 2023-10-03T10:18:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.341+0000 7ff2e6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e81338a0 0x7ff2e811f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.341+0000 7ff2e6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e81338a0 0x7ff2e811f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34230/0 (socket says 172.21.15.72:34230) 2023-10-03T10:18:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.341+0000 7ff2e6d9d700 1 -- 172.21.15.72:0/988503746 learned_addr learned my addr 172.21.15.72:0/988503746 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:40.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.341+0000 7ff2e5d9b700 1 --2- 172.21.15.72:0/988503746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2e809e760 0x7ff2e811f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.341+0000 7ff2e659c700 1 --2- 172.21.15.72:0/988503746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2e809de50 0x7ff2e811eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.342+0000 7ff2e6d9d700 1 -- 172.21.15.72:0/988503746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2e809e760 msgr2=0x7ff2e811f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.342+0000 7ff2e6d9d700 1 --2- 172.21.15.72:0/988503746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2e809e760 0x7ff2e811f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.342+0000 7ff2e6d9d700 1 -- 172.21.15.72:0/988503746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2e809de50 msgr2=0x7ff2e811eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.342+0000 7ff2e6d9d700 1 --2- 172.21.15.72:0/988503746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2e809de50 0x7ff2e811eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.342+0000 7ff2e6d9d700 1 -- 172.21.15.72:0/988503746 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80094a0 con 0x7ff2e81338a0 2023-10-03T10:18:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.342+0000 7ff2e6d9d700 1 --2- 172.21.15.72:0/988503746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e81338a0 0x7ff2e811f590 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000cbc0 tx=0x7ff2e000ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.342+0000 7ff2d6ffd700 1 -- 172.21.15.72:0/988503746 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000a9e0 con 0x7ff2e81338a0 2023-10-03T10:18:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.342+0000 7ff2d6ffd700 1 -- 172.21.15.72:0/988503746 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e000ab40 con 0x7ff2e81338a0 2023-10-03T10:18:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.342+0000 7ff2ecbab700 1 -- 172.21.15.72:0/988503746 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2dc0094a0 con 0x7ff2e81338a0 2023-10-03T10:18:40.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.342+0000 7ff2d6ffd700 1 -- 172.21.15.72:0/988503746 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0012400 con 0x7ff2e81338a0 2023-10-03T10:18:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.343+0000 7ff2ecbab700 1 -- 172.21.15.72:0/988503746 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e806f640 con 0x7ff2e81338a0 2023-10-03T10:18:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.343+0000 7ff2d6ffd700 1 -- 172.21.15.72:0/988503746 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2e0012560 con 0x7ff2e81338a0 2023-10-03T10:18:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.344+0000 7ff2ecbab700 1 -- 172.21.15.72:0/988503746 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e8074ea0 con 0x7ff2e81338a0 2023-10-03T10:18:40.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.344+0000 7ff2d6ffd700 1 -- 172.21.15.72:0/988503746 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff2e0012810 con 0x7ff2e81338a0 2023-10-03T10:18:40.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.352+0000 7ff2d6ffd700 1 -- 172.21.15.72:0/988503746 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2e0040020 con 0x7ff2e81338a0 2023-10-03T10:18:40.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.375+0000 7f75c16fb700 1 Processor -- start 2023-10-03T10:18:40.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.375+0000 7f75c16fb700 1 -- start start 2023-10-03T10:18:40.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75c16fb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75bc09d9f0 0x7f75bc136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75c16fb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75bc136a70 0x7f75bc138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75c16fb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc09e130 con 0x7f75bc1316c0 2023-10-03T10:18:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75c16fb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc1321a0 con 0x7f75bc136a70 2023-10-03T10:18:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75c16fb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1312b0 con 0x7f75bc09d9f0 2023-10-03T10:18:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75baffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f75bc1316c0 0x7f75bc131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53124/0 (socket says 172.21.15.72:53124) 2023-10-03T10:18:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75baffd700 1 -- 172.21.15.72:0/3384431838 learned_addr learned my addr 172.21.15.72:0/3384431838 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75ba7fc700 1 --2- 172.21.15.72:0/3384431838 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75bc09d9f0 0x7f75bc136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75bb7fe700 1 --2- 172.21.15.72:0/3384431838 >> v2:172.21.15.72:3300/0 conn(0x7f75bc136a70 0x7f75bc138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75b9ffb700 1 -- 172.21.15.72:0/3384431838 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120951925 0 0) 0x7f75ac001110 con 0x7f75bc1316c0 2023-10-03T10:18:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75b9ffb700 1 -- 172.21.15.72:0/3384431838 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75a40035b0 con 0x7f75bc1316c0 2023-10-03T10:18:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75ba7fc700 1 -- 172.21.15.72:0/3384431838 >> v2:172.21.15.72:3300/0 conn(0x7f75bc136a70 msgr2=0x7f75bc138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75ba7fc700 1 --2- 172.21.15.72:0/3384431838 >> v2:172.21.15.72:3300/0 conn(0x7f75bc136a70 0x7f75bc138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75ba7fc700 1 -- 172.21.15.72:0/3384431838 >> v1:172.21.15.72:6789/0 conn(0x7f75bc1316c0 legacy=0x7f75bc131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75ba7fc700 1 -- 172.21.15.72:0/3384431838 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc09f6e0 con 0x7f75bc09d9f0 2023-10-03T10:18:40.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.376+0000 7f75bb7fe700 1 --2- 172.21.15.72:0/3384431838 >> v2:172.21.15.72:3300/0 conn(0x7f75bc136a70 0x7f75bc138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.377+0000 7f75ba7fc700 1 --2- 172.21.15.72:0/3384431838 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75bc09d9f0 0x7f75bc136530 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009840 tx=0x7f75b0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=625ed9bdf8d8d812 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.377+0000 7f75b9ffb700 1 -- 172.21.15.72:0/3384431838 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0011830 con 0x7f75bc09d9f0 2023-10-03T10:18:40.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.377+0000 7f75b9ffb700 1 -- 172.21.15.72:0/3384431838 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b0011990 con 0x7f75bc09d9f0 2023-10-03T10:18:40.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.377+0000 7f75b9ffb700 1 -- 172.21.15.72:0/3384431838 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0011d20 con 0x7f75bc09d9f0 2023-10-03T10:18:40.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.377+0000 7f75c16fb700 1 -- 172.21.15.72:0/3384431838 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75bc09d9f0 msgr2=0x7f75bc136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.377+0000 7f75c16fb700 1 --2- 172.21.15.72:0/3384431838 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75bc09d9f0 0x7f75bc136530 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009840 tx=0x7f75b0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:40.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.377+0000 7f75c16fb700 1 -- 172.21.15.72:0/3384431838 shutdown_connections 2023-10-03T10:18:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.377+0000 7f75c16fb700 1 --2- 172.21.15.72:0/3384431838 >> v2:172.21.15.72:3300/0 conn(0x7f75bc136a70 0x7f75bc138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.377+0000 7f75c16fb700 1 --2- 172.21.15.72:0/3384431838 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75bc09d9f0 0x7f75bc136530 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.377+0000 7f75c16fb700 1 -- 172.21.15.72:0/3384431838 >> 172.21.15.72:0/3384431838 conn(0x7f75bc066f50 msgr2=0x7f75bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.377+0000 7f75c16fb700 1 -- 172.21.15.72:0/3384431838 shutdown_connections 2023-10-03T10:18:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.378+0000 7f75c16fb700 1 -- 172.21.15.72:0/3384431838 wait complete. 2023-10-03T10:18:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.379+0000 7f75c16fb700 1 Processor -- start 2023-10-03T10:18:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.379+0000 7f75c16fb700 1 -- start start 2023-10-03T10:18:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.379+0000 7f75c16fb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75bc09d9f0 0x7f75bc070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.379+0000 7f75c16fb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75bc1316c0 0x7f75bc0714b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.379+0000 7f75c16fb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc136a70 0x7f75bc0719f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.379+0000 7f75c16fb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc06e9e0 con 0x7f75bc136a70 2023-10-03T10:18:40.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.379+0000 7f75c16fb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc135ee0 con 0x7f75bc1316c0 2023-10-03T10:18:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.379+0000 7f75c16fb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0700b0 con 0x7f75bc09d9f0 2023-10-03T10:18:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.379+0000 7f75baffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75bc09d9f0 0x7f75bc070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.379+0000 7f75baffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75bc09d9f0 0x7f75bc070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60444/0 (socket says 172.21.15.72:60444) 2023-10-03T10:18:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.379+0000 7f75baffd700 1 -- 172.21.15.72:0/4006101911 learned_addr learned my addr 172.21.15.72:0/4006101911 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.379+0000 7f75bb7fe700 1 --2- 172.21.15.72:0/4006101911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc136a70 0x7f75bc0719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.380+0000 7f75baffd700 1 -- 172.21.15.72:0/4006101911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75bc1316c0 msgr2=0x7f75bc0714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.380+0000 7f75baffd700 1 --2- 172.21.15.72:0/4006101911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75bc1316c0 0x7f75bc0714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.380+0000 7f75baffd700 1 -- 172.21.15.72:0/4006101911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc136a70 msgr2=0x7f75bc0719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.380+0000 7f75baffd700 1 --2- 172.21.15.72:0/4006101911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc136a70 0x7f75bc0719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.380+0000 7f75baffd700 1 -- 172.21.15.72:0/4006101911 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b4009a70 con 0x7f75bc09d9f0 2023-10-03T10:18:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.380+0000 7f75bb7fe700 1 --2- 172.21.15.72:0/4006101911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc136a70 0x7f75bc0719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.380+0000 7f75baffd700 1 --2- 172.21.15.72:0/4006101911 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75bc09d9f0 0x7f75bc070f70 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00c700 tx=0x7f75ac00cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.380+0000 7f75a37fe700 1 -- 172.21.15.72:0/4006101911 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac005d70 con 0x7f75bc09d9f0 2023-10-03T10:18:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.380+0000 7f75a37fe700 1 -- 172.21.15.72:0/4006101911 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac0070d0 con 0x7f75bc09d9f0 2023-10-03T10:18:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.380+0000 7f75c16fb700 1 -- 172.21.15.72:0/4006101911 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b00094a0 con 0x7f75bc09d9f0 2023-10-03T10:18:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.380+0000 7f75a37fe700 1 -- 172.21.15.72:0/4006101911 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac007460 con 0x7f75bc09d9f0 2023-10-03T10:18:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.380+0000 7f75c16fb700 1 -- 172.21.15.72:0/4006101911 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc070390 con 0x7f75bc09d9f0 2023-10-03T10:18:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.381+0000 7f75c16fb700 1 -- 172.21.15.72:0/4006101911 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc074ea0 con 0x7f75bc09d9f0 2023-10-03T10:18:40.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.381+0000 7f75a37fe700 1 -- 172.21.15.72:0/4006101911 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75ac0075c0 con 0x7f75bc09d9f0 2023-10-03T10:18:40.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.381+0000 7f75a37fe700 1 -- 172.21.15.72:0/4006101911 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f75ac03f190 con 0x7f75bc09d9f0 2023-10-03T10:18:40.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.386+0000 7f75a37fe700 1 -- 172.21.15.72:0/4006101911 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75ac01b3b0 con 0x7f75bc09d9f0 2023-10-03T10:18:40.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.442+0000 7f494738a700 1 Processor -- start 2023-10-03T10:18:40.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.442+0000 7f494738a700 1 -- start start 2023-10-03T10:18:40.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.442+0000 7f494738a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f494006f5d0 0x7f494012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.442+0000 7f494738a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4940135c20 0x7f4940138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.442+0000 7f494738a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494006fa40 con 0x7f494012cf60 2023-10-03T10:18:40.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.442+0000 7f494738a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494012cd90 con 0x7f4940135c20 2023-10-03T10:18:40.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.442+0000 7f494738a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4940071780 con 0x7f494006f5d0 2023-10-03T10:18:40.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.443+0000 7f4945927700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4940135c20 0x7f4940138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.443+0000 7f4945126700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f494012cf60 0x7f494012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53132/0 (socket says 172.21.15.72:53132) 2023-10-03T10:18:40.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.443+0000 7f4945126700 1 -- 172.21.15.72:0/2939761837 learned_addr learned my addr 172.21.15.72:0/2939761837 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:40.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.443+0000 7f4944925700 1 --2- 172.21.15.72:0/2939761837 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f494006f5d0 0x7f494012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.443+0000 7f4937fff700 1 -- 172.21.15.72:0/2939761837 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889037980 0 0) 0x7f494006fa40 con 0x7f494012cf60 2023-10-03T10:18:40.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.443+0000 7f4937fff700 1 -- 172.21.15.72:0/2939761837 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f492c0035b0 con 0x7f494012cf60 2023-10-03T10:18:40.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.443+0000 7f4944925700 1 -- 172.21.15.72:0/2939761837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4940135c20 msgr2=0x7f4940138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.443+0000 7f4944925700 1 --2- 172.21.15.72:0/2939761837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4940135c20 0x7f4940138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.443+0000 7f4944925700 1 -- 172.21.15.72:0/2939761837 >> v1:172.21.15.72:6789/0 conn(0x7f494012cf60 legacy=0x7f494012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.443+0000 7f4944925700 1 -- 172.21.15.72:0/2939761837 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4940071a40 con 0x7f494006f5d0 2023-10-03T10:18:40.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.443+0000 7f4945927700 1 --2- 172.21.15.72:0/2939761837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4940135c20 0x7f4940138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.443+0000 7f4944925700 1 --2- 172.21.15.72:0/2939761837 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f494006f5d0 0x7f494012ffc0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f493000dcc0 tx=0x7f493000f050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9460c8666ac4435 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.443+0000 7f4937fff700 1 -- 172.21.15.72:0/2939761837 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930012070 con 0x7f494006f5d0 2023-10-03T10:18:40.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.443+0000 7f4937fff700 1 -- 172.21.15.72:0/2939761837 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493000d2e0 con 0x7f494006f5d0 2023-10-03T10:18:40.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.443+0000 7f4937fff700 1 -- 172.21.15.72:0/2939761837 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493000f8e0 con 0x7f494006f5d0 2023-10-03T10:18:40.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.444+0000 7f494738a700 1 -- 172.21.15.72:0/2939761837 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f494006f5d0 msgr2=0x7f494012ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.444+0000 7f494738a700 1 --2- 172.21.15.72:0/2939761837 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f494006f5d0 0x7f494012ffc0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f493000dcc0 tx=0x7f493000f050 comp rx=0 tx=0).stop 2023-10-03T10:18:40.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.444+0000 7f494738a700 1 -- 172.21.15.72:0/2939761837 shutdown_connections 2023-10-03T10:18:40.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.444+0000 7f494738a700 1 --2- 172.21.15.72:0/2939761837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4940135c20 0x7f4940138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.444+0000 7f494738a700 1 --2- 172.21.15.72:0/2939761837 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f494006f5d0 0x7f494012ffc0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.444+0000 7f494738a700 1 -- 172.21.15.72:0/2939761837 >> 172.21.15.72:0/2939761837 conn(0x7f49400a2aa0 msgr2=0x7f49400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.444+0000 7f494738a700 1 -- 172.21.15.72:0/2939761837 shutdown_connections 2023-10-03T10:18:40.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.444+0000 7f494738a700 1 -- 172.21.15.72:0/2939761837 wait complete. 2023-10-03T10:18:40.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.445+0000 7f494738a700 1 Processor -- start 2023-10-03T10:18:40.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.446+0000 7f494738a700 1 -- start start 2023-10-03T10:18:40.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.446+0000 7f494738a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f494006f5d0 0x7f494009a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.446+0000 7f494738a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f494012cf60 0x7f494009ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.446+0000 7f494738a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4940135c20 0x7f49401c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.446+0000 7f494738a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494009c6b0 con 0x7f494006f5d0 2023-10-03T10:18:40.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.446+0000 7f494738a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494009b9f0 con 0x7f494012cf60 2023-10-03T10:18:40.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.446+0000 7f494738a700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f494009cbf0 con 0x7f4940135c20 2023-10-03T10:18:40.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.446+0000 7f4945126700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f494006f5d0 0x7f494009a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.446+0000 7f4945126700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f494006f5d0 0x7f494009a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40662/0 (socket says 172.21.15.72:40662) 2023-10-03T10:18:40.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.446+0000 7f4945126700 1 -- 172.21.15.72:0/3723329696 learned_addr learned my addr 172.21.15.72:0/3723329696 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:40.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.446+0000 7f4945927700 1 --2- 172.21.15.72:0/3723329696 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4940135c20 0x7f49401c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.447+0000 7f4944925700 1 --2- 172.21.15.72:0/3723329696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f494012cf60 0x7f494009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.447+0000 7f4945126700 1 -- 172.21.15.72:0/3723329696 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4940135c20 msgr2=0x7f49401c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.447+0000 7f4945126700 1 --2- 172.21.15.72:0/3723329696 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4940135c20 0x7f49401c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.447+0000 7f4945126700 1 -- 172.21.15.72:0/3723329696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f494012cf60 msgr2=0x7f494009ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.447+0000 7f4945126700 1 --2- 172.21.15.72:0/3723329696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f494012cf60 0x7f494009ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.447+0000 7f4945126700 1 -- 172.21.15.72:0/3723329696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493800ba90 con 0x7f494006f5d0 2023-10-03T10:18:40.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.447+0000 7f4944925700 1 --2- 172.21.15.72:0/3723329696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f494012cf60 0x7f494009ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:40.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.447+0000 7f4945126700 1 --2- 172.21.15.72:0/3723329696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f494006f5d0 0x7f494009a630 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f493c005990 tx=0x7f493c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.447+0000 7f4935ffb700 1 -- 172.21.15.72:0/3723329696 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c016070 con 0x7f494006f5d0 2023-10-03T10:18:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.447+0000 7f4935ffb700 1 -- 172.21.15.72:0/3723329696 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c004870 con 0x7f494006f5d0 2023-10-03T10:18:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.447+0000 7f494738a700 1 -- 172.21.15.72:0/3723329696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493000d940 con 0x7f494006f5d0 2023-10-03T10:18:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.447+0000 7f4935ffb700 1 -- 172.21.15.72:0/3723329696 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c004c00 con 0x7f494006f5d0 2023-10-03T10:18:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.447+0000 7f494738a700 1 -- 172.21.15.72:0/3723329696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494009a230 con 0x7f494006f5d0 2023-10-03T10:18:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.448+0000 7f4935ffb700 1 -- 172.21.15.72:0/3723329696 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f493c011590 con 0x7f494006f5d0 2023-10-03T10:18:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.448+0000 7f494738a700 1 -- 172.21.15.72:0/3723329696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494009c500 con 0x7f494006f5d0 2023-10-03T10:18:40.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.448+0000 7f4935ffb700 1 -- 172.21.15.72:0/3723329696 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f493c004ea0 con 0x7f494006f5d0 2023-10-03T10:18:40.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.453+0000 7f4935ffb700 1 -- 172.21.15.72:0/3723329696 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f493c044060 con 0x7f494006f5d0 2023-10-03T10:18:40.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.462+0000 7f0f8ea32700 1 Processor -- start 2023-10-03T10:18:40.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.463+0000 7f0f8ea32700 1 -- start start 2023-10-03T10:18:40.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.463+0000 7f0f8ea32700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0f880a0a30 0x7f0f880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.463+0000 7f0f8ea32700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f8809d630 0x7f0f880a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.463+0000 7f0f8ea32700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f880a2a70 con 0x7f0f88133930 2023-10-03T10:18:40.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.463+0000 7f0f8ea32700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f880a01d0 con 0x7f0f880a0a30 2023-10-03T10:18:40.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.463+0000 7f0f8ea32700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8809e2b0 con 0x7f0f8809d630 2023-10-03T10:18:40.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.463+0000 7f0f877fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f8809d630 0x7f0f880a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.463+0000 7f0f877fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f8809d630 0x7f0f880a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60478/0 (socket says 172.21.15.72:60478) 2023-10-03T10:18:40.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.463+0000 7f0f877fe700 1 -- 172.21.15.72:0/236587204 learned_addr learned my addr 172.21.15.72:0/236587204 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:40.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.463+0000 7f0f87fff700 1 --2- 172.21.15.72:0/236587204 >> v2:172.21.15.72:3300/0 conn(0x7f0f880a0a30 0x7f0f880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.464+0000 7f0f877fe700 1 -- 172.21.15.72:0/236587204 >> v2:172.21.15.72:3300/0 conn(0x7f0f880a0a30 msgr2=0x7f0f880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.464+0000 7f0f877fe700 1 --2- 172.21.15.72:0/236587204 >> v2:172.21.15.72:3300/0 conn(0x7f0f880a0a30 0x7f0f880a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.464+0000 7f0f877fe700 1 -- 172.21.15.72:0/236587204 >> v1:172.21.15.72:6789/0 conn(0x7f0f88133930 legacy=0x7f0f88133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.464+0000 7f0f877fe700 1 -- 172.21.15.72:0/236587204 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8809dc50 con 0x7f0f8809d630 2023-10-03T10:18:40.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.464+0000 7f0f877fe700 1 --2- 172.21.15.72:0/236587204 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f8809d630 0x7f0f880a1340 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0098f0 tx=0x7f0f7c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3c907df3728a93 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.464+0000 7f0f86ffd700 1 -- 172.21.15.72:0/236587204 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c00b8a0 con 0x7f0f8809d630 2023-10-03T10:18:40.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.464+0000 7f0f86ffd700 1 -- 172.21.15.72:0/236587204 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c00ba00 con 0x7f0f8809d630 2023-10-03T10:18:40.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.464+0000 7f0f86ffd700 1 -- 172.21.15.72:0/236587204 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c00bd90 con 0x7f0f8809d630 2023-10-03T10:18:40.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.465+0000 7f0f8ea32700 1 -- 172.21.15.72:0/236587204 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f8809d630 msgr2=0x7f0f880a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.465+0000 7f0f8ea32700 1 --2- 172.21.15.72:0/236587204 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f8809d630 0x7f0f880a1340 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0098f0 tx=0x7f0f7c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:40.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.465+0000 7f0f8ea32700 1 -- 172.21.15.72:0/236587204 shutdown_connections 2023-10-03T10:18:40.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.465+0000 7f0f8ea32700 1 --2- 172.21.15.72:0/236587204 >> v2:172.21.15.72:3300/0 conn(0x7f0f880a0a30 0x7f0f880a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.465+0000 7f0f8ea32700 1 --2- 172.21.15.72:0/236587204 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f8809d630 0x7f0f880a1340 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.465+0000 7f0f8ea32700 1 -- 172.21.15.72:0/236587204 >> 172.21.15.72:0/236587204 conn(0x7f0f880a3050 msgr2=0x7f0f880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.465+0000 7f0f8ea32700 1 -- 172.21.15.72:0/236587204 shutdown_connections 2023-10-03T10:18:40.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.465+0000 7f0f8ea32700 1 -- 172.21.15.72:0/236587204 wait complete. 2023-10-03T10:18:40.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.466+0000 7f0f8ea32700 1 Processor -- start 2023-10-03T10:18:40.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.466+0000 7f0f8ea32700 1 -- start start 2023-10-03T10:18:40.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.467+0000 7f0f8ea32700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f8809d630 0x7f0f881c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.467+0000 7f0f8ea32700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f880a0a30 0x7f0f881c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.467+0000 7f0f8ea32700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f88133930 0x7f0f881c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.467+0000 7f0f8ea32700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f88133530 con 0x7f0f88133930 2023-10-03T10:18:40.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.467+0000 7f0f8ea32700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f88120710 con 0x7f0f880a0a30 2023-10-03T10:18:40.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.467+0000 7f0f8ea32700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f88121f00 con 0x7f0f8809d630 2023-10-03T10:18:40.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.467+0000 7f0f877fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f880a0a30 0x7f0f881c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.467+0000 7f0f877fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f880a0a30 0x7f0f881c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34262/0 (socket says 172.21.15.72:34262) 2023-10-03T10:18:40.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.467+0000 7f0f877fe700 1 -- 172.21.15.72:0/2087375850 learned_addr learned my addr 172.21.15.72:0/2087375850 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:40.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.467+0000 7f0f8cfcf700 1 --2- 172.21.15.72:0/2087375850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f88133930 0x7f0f881c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.468+0000 7f0f87fff700 1 --2- 172.21.15.72:0/2087375850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f8809d630 0x7f0f881c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.468+0000 7f0f877fe700 1 -- 172.21.15.72:0/2087375850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f8809d630 msgr2=0x7f0f881c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.468+0000 7f0f877fe700 1 --2- 172.21.15.72:0/2087375850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f8809d630 0x7f0f881c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.468+0000 7f0f877fe700 1 -- 172.21.15.72:0/2087375850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f88133930 msgr2=0x7f0f881c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.468+0000 7f0f877fe700 1 --2- 172.21.15.72:0/2087375850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f88133930 0x7f0f881c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.468+0000 7f0f877fe700 1 -- 172.21.15.72:0/2087375850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c009550 con 0x7f0f880a0a30 2023-10-03T10:18:40.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.468+0000 7f0f87fff700 1 --2- 172.21.15.72:0/2087375850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f8809d630 0x7f0f881c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:40.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.468+0000 7f0f877fe700 1 --2- 172.21.15.72:0/2087375850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f880a0a30 0x7f0f881c86d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c000c00 tx=0x7f0f7c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.468+0000 7f0f84ff9700 1 -- 172.21.15.72:0/2087375850 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c004590 con 0x7f0f880a0a30 2023-10-03T10:18:40.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.468+0000 7f0f84ff9700 1 -- 172.21.15.72:0/2087375850 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c0036a0 con 0x7f0f880a0a30 2023-10-03T10:18:40.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.468+0000 7f0f8ea32700 1 -- 172.21.15.72:0/2087375850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f880a0410 con 0x7f0f880a0a30 2023-10-03T10:18:40.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.468+0000 7f0f84ff9700 1 -- 172.21.15.72:0/2087375850 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c003a10 con 0x7f0f880a0a30 2023-10-03T10:18:40.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.468+0000 7f0f8ea32700 1 -- 172.21.15.72:0/2087375850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f88122c30 con 0x7f0f880a0a30 2023-10-03T10:18:40.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.469+0000 7f0f8ea32700 1 -- 172.21.15.72:0/2087375850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f880008d0 con 0x7f0f880a0a30 2023-10-03T10:18:40.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.470+0000 7f0f84ff9700 1 -- 172.21.15.72:0/2087375850 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f7c021070 con 0x7f0f880a0a30 2023-10-03T10:18:40.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.470+0000 7f0f84ff9700 1 -- 172.21.15.72:0/2087375850 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0f7c040bc0 con 0x7f0f880a0a30 2023-10-03T10:18:40.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.479+0000 7f0f84ff9700 1 -- 172.21.15.72:0/2087375850 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f7c02e7b0 con 0x7f0f880a0a30 2023-10-03T10:18:40.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.590+0000 7f75c16fb700 1 -- 172.21.15.72:0/4006101911 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f75bc09e130 con 0x7f75bc09d9f0 2023-10-03T10:18:40.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.590+0000 7f75a37fe700 1 -- 172.21.15.72:0/4006101911 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f75bc09e130 con 0x7f75bc09d9f0 2023-10-03T10:18:40.591 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:40.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.593+0000 7f75c16fb700 1 -- 172.21.15.72:0/4006101911 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75bc09d9f0 msgr2=0x7f75bc070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.593+0000 7f75c16fb700 1 --2- 172.21.15.72:0/4006101911 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75bc09d9f0 0x7f75bc070f70 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00c700 tx=0x7f75ac00cac0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.593+0000 7f75c16fb700 1 -- 172.21.15.72:0/4006101911 shutdown_connections 2023-10-03T10:18:40.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.593+0000 7f75c16fb700 1 --2- 172.21.15.72:0/4006101911 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75bc136a70 0x7f75bc0719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.593+0000 7f75c16fb700 1 --2- 172.21.15.72:0/4006101911 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f75bc09d9f0 0x7f75bc070f70 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.593+0000 7f75c16fb700 1 --2- 172.21.15.72:0/4006101911 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75bc1316c0 0x7f75bc0714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.593+0000 7f75c16fb700 1 -- 172.21.15.72:0/4006101911 >> 172.21.15.72:0/4006101911 conn(0x7f75bc066f50 msgr2=0x7f75bc136e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.594+0000 7f75c16fb700 1 -- 172.21.15.72:0/4006101911 shutdown_connections 2023-10-03T10:18:40.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.594+0000 7f75c16fb700 1 -- 172.21.15.72:0/4006101911 wait complete. 2023-10-03T10:18:40.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:40.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.620+0000 7ff2ecbab700 1 -- 172.21.15.72:0/988503746 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff2e812fa10 con 0x7ff2e81338a0 2023-10-03T10:18:40.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.620+0000 7ff2d6ffd700 1 -- 172.21.15.72:0/988503746 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff2e0017020 con 0x7ff2e81338a0 2023-10-03T10:18:40.621 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.622+0000 7ff2ecbab700 1 -- 172.21.15.72:0/988503746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e81338a0 msgr2=0x7ff2e811f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.622+0000 7ff2ecbab700 1 --2- 172.21.15.72:0/988503746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e81338a0 0x7ff2e811f590 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000cbc0 tx=0x7ff2e000ced0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.622+0000 7ff2ecbab700 1 -- 172.21.15.72:0/988503746 shutdown_connections 2023-10-03T10:18:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.622+0000 7ff2ecbab700 1 --2- 172.21.15.72:0/988503746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2e809de50 0x7ff2e811eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.622+0000 7ff2ecbab700 1 --2- 172.21.15.72:0/988503746 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e81338a0 0x7ff2e811f590 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.622+0000 7ff2ecbab700 1 --2- 172.21.15.72:0/988503746 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2e809e760 0x7ff2e811f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.622+0000 7ff2ecbab700 1 -- 172.21.15.72:0/988503746 >> 172.21.15.72:0/988503746 conn(0x7ff2e80a2aa0 msgr2=0x7ff2e809edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.622+0000 7ff2ecbab700 1 -- 172.21.15.72:0/988503746 shutdown_connections 2023-10-03T10:18:40.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.622+0000 7ff2ecbab700 1 -- 172.21.15.72:0/988503746 wait complete. 2023-10-03T10:18:40.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:40.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.660+0000 7f494738a700 1 -- 172.21.15.72:0/3723329696 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4940135050 con 0x7f494006f5d0 2023-10-03T10:18:40.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.660+0000 7f4935ffb700 1 -- 172.21.15.72:0/3723329696 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f493c044030 con 0x7f494006f5d0 2023-10-03T10:18:40.661 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:40.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.662+0000 7f494738a700 1 -- 172.21.15.72:0/3723329696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f494006f5d0 msgr2=0x7f494009a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.662+0000 7f494738a700 1 --2- 172.21.15.72:0/3723329696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f494006f5d0 0x7f494009a630 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f493c005990 tx=0x7f493c00ca90 comp rx=0 tx=0).stop 2023-10-03T10:18:40.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.662+0000 7f494738a700 1 -- 172.21.15.72:0/3723329696 shutdown_connections 2023-10-03T10:18:40.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.662+0000 7f494738a700 1 --2- 172.21.15.72:0/3723329696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f494006f5d0 0x7f494009a630 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.662+0000 7f494738a700 1 --2- 172.21.15.72:0/3723329696 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4940135c20 0x7f49401c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.662+0000 7f494738a700 1 --2- 172.21.15.72:0/3723329696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f494012cf60 0x7f494009ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.662+0000 7f494738a700 1 -- 172.21.15.72:0/3723329696 >> 172.21.15.72:0/3723329696 conn(0x7f49400a2aa0 msgr2=0x7f494012f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.662+0000 7f494738a700 1 -- 172.21.15.72:0/3723329696 shutdown_connections 2023-10-03T10:18:40.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.662+0000 7f494738a700 1 -- 172.21.15.72:0/3723329696 wait complete. 2023-10-03T10:18:40.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:40.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.698+0000 7f0f8ea32700 1 -- 172.21.15.72:0/2087375850 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0f88072980 con 0x7f0f880a0a30 2023-10-03T10:18:40.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.699+0000 7f0f84ff9700 1 -- 172.21.15.72:0/2087375850 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f7c029070 con 0x7f0f880a0a30 2023-10-03T10:18:40.699 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:40.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.700+0000 7f0f8ea32700 1 -- 172.21.15.72:0/2087375850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f880a0a30 msgr2=0x7f0f881c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.700+0000 7f0f8ea32700 1 --2- 172.21.15.72:0/2087375850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f880a0a30 0x7f0f881c86d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c000c00 tx=0x7f0f7c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.701+0000 7f0f8ea32700 1 -- 172.21.15.72:0/2087375850 shutdown_connections 2023-10-03T10:18:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.701+0000 7f0f8ea32700 1 --2- 172.21.15.72:0/2087375850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f88133930 0x7f0f881c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.701+0000 7f0f8ea32700 1 --2- 172.21.15.72:0/2087375850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f8809d630 0x7f0f881c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.701+0000 7f0f8ea32700 1 --2- 172.21.15.72:0/2087375850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f880a0a30 0x7f0f881c86d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.701+0000 7f0f8ea32700 1 -- 172.21.15.72:0/2087375850 >> 172.21.15.72:0/2087375850 conn(0x7f0f880a3050 msgr2=0x7f0f881bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.701+0000 7f0f8ea32700 1 -- 172.21.15.72:0/2087375850 shutdown_connections 2023-10-03T10:18:40.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:40.701+0000 7f0f8ea32700 1 -- 172.21.15.72:0/2087375850 wait complete. 2023-10-03T10:18:40.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:41.611 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:41.636 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:41.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:41.714 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:41.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.753+0000 7f4c9eb6b700 1 Processor -- start 2023-10-03T10:18:41.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.753+0000 7f4c9eb6b700 1 -- start start 2023-10-03T10:18:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.754+0000 7f4c9eb6b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c9809de00 0x7f4c9809e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.754+0000 7f4c9eb6b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4c9813d1f0 0x7f4c9813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.754+0000 7f4c9eb6b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c9809a810 con 0x7f4c9806a770 2023-10-03T10:18:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.754+0000 7f4c9eb6b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9806ab40 con 0x7f4c9813d1f0 2023-10-03T10:18:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.754+0000 7f4c9eb6b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9809ebc0 con 0x7f4c9809de00 2023-10-03T10:18:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.754+0000 7f4c9c907700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4c9806a770 0x7f4c9809d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53156/0 (socket says 172.21.15.72:53156) 2023-10-03T10:18:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.754+0000 7f4c9c907700 1 -- 172.21.15.72:0/1397410343 learned_addr learned my addr 172.21.15.72:0/1397410343 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.754+0000 7f4c97fff700 1 --2- 172.21.15.72:0/1397410343 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c9809de00 0x7f4c9809e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.754+0000 7f4c9d108700 1 --2- 172.21.15.72:0/1397410343 >> v2:172.21.15.72:3300/0 conn(0x7f4c9813d1f0 0x7f4c9813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.754+0000 7f4c977fe700 1 -- 172.21.15.72:0/1397410343 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777767307 0 0) 0x7f4c9809a810 con 0x7f4c9806a770 2023-10-03T10:18:41.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.754+0000 7f4c977fe700 1 -- 172.21.15.72:0/1397410343 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c880035b0 con 0x7f4c9806a770 2023-10-03T10:18:41.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.755+0000 7f4c9d108700 1 -- 172.21.15.72:0/1397410343 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c9809de00 msgr2=0x7f4c9809e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.755+0000 7f4c9d108700 1 --2- 172.21.15.72:0/1397410343 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c9809de00 0x7f4c9809e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.755+0000 7f4c9d108700 1 -- 172.21.15.72:0/1397410343 >> v1:172.21.15.72:6789/0 conn(0x7f4c9806a770 legacy=0x7f4c9809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.755+0000 7f4c9d108700 1 -- 172.21.15.72:0/1397410343 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9809e920 con 0x7f4c9813d1f0 2023-10-03T10:18:41.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.755+0000 7f4c9d108700 1 --2- 172.21.15.72:0/1397410343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9813d1f0 0x7f4c9813f5d0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009d90 tx=0x7f4c9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26cc4bdbc21e3ba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.755+0000 7f4c977fe700 1 -- 172.21.15.72:0/1397410343 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000e070 con 0x7f4c9813d1f0 2023-10-03T10:18:41.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.755+0000 7f4c977fe700 1 -- 172.21.15.72:0/1397410343 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9000bb20 con 0x7f4c9813d1f0 2023-10-03T10:18:41.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.755+0000 7f4c977fe700 1 -- 172.21.15.72:0/1397410343 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90012430 con 0x7f4c9813d1f0 2023-10-03T10:18:41.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.756+0000 7f4c9eb6b700 1 -- 172.21.15.72:0/1397410343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9813d1f0 msgr2=0x7f4c9813f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.756+0000 7f4c9eb6b700 1 --2- 172.21.15.72:0/1397410343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9813d1f0 0x7f4c9813f5d0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009d90 tx=0x7f4c9000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:41.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.756+0000 7f4c9eb6b700 1 -- 172.21.15.72:0/1397410343 shutdown_connections 2023-10-03T10:18:41.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.756+0000 7f4c9eb6b700 1 --2- 172.21.15.72:0/1397410343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9813d1f0 0x7f4c9813f5d0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.756+0000 7f4c9eb6b700 1 --2- 172.21.15.72:0/1397410343 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c9809de00 0x7f4c9809e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.756+0000 7f4c9eb6b700 1 -- 172.21.15.72:0/1397410343 >> 172.21.15.72:0/1397410343 conn(0x7f4c98066f50 msgr2=0x7f4c9809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.756+0000 7f4c9eb6b700 1 -- 172.21.15.72:0/1397410343 shutdown_connections 2023-10-03T10:18:41.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.756+0000 7f4c9eb6b700 1 -- 172.21.15.72:0/1397410343 wait complete. 2023-10-03T10:18:41.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.757+0000 7f4c9eb6b700 1 Processor -- start 2023-10-03T10:18:41.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.757+0000 7f4c9eb6b700 1 -- start start 2023-10-03T10:18:41.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9eb6b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c9806a770 0x7f4c981cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9eb6b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c9809de00 0x7f4c981ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9eb6b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9813d1f0 0x7f4c981cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9eb6b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c980a35f0 con 0x7f4c9813d1f0 2023-10-03T10:18:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9eb6b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9811d190 con 0x7f4c9806a770 2023-10-03T10:18:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9eb6b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9811a800 con 0x7f4c9809de00 2023-10-03T10:18:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9c907700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c9806a770 0x7f4c981cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9c907700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c9806a770 0x7f4c981cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34272/0 (socket says 172.21.15.72:34272) 2023-10-03T10:18:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9c907700 1 -- 172.21.15.72:0/1943759771 learned_addr learned my addr 172.21.15.72:0/1943759771 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c97fff700 1 --2- 172.21.15.72:0/1943759771 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c9809de00 0x7f4c981ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9d108700 1 --2- 172.21.15.72:0/1943759771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9813d1f0 0x7f4c981cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9c907700 1 -- 172.21.15.72:0/1943759771 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c9809de00 msgr2=0x7f4c981ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9c907700 1 --2- 172.21.15.72:0/1943759771 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c9809de00 0x7f4c981ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9c907700 1 -- 172.21.15.72:0/1943759771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9813d1f0 msgr2=0x7f4c981cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9c907700 1 --2- 172.21.15.72:0/1943759771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9813d1f0 0x7f4c981cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9c907700 1 -- 172.21.15.72:0/1943759771 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c90009a70 con 0x7f4c9806a770 2023-10-03T10:18:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.758+0000 7f4c9c907700 1 --2- 172.21.15.72:0/1943759771 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c9806a770 0x7f4c981cc9c0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00c700 tx=0x7f4c8c00ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.759+0000 7f4c957fa700 1 -- 172.21.15.72:0/1943759771 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c005d70 con 0x7f4c9806a770 2023-10-03T10:18:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.759+0000 7f4c957fa700 1 -- 172.21.15.72:0/1943759771 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c0070d0 con 0x7f4c9806a770 2023-10-03T10:18:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.759+0000 7f4c9eb6b700 1 -- 172.21.15.72:0/1943759771 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9809f1a0 con 0x7f4c9806a770 2023-10-03T10:18:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.759+0000 7f4c9eb6b700 1 -- 172.21.15.72:0/1943759771 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9811b530 con 0x7f4c9806a770 2023-10-03T10:18:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.760+0000 7f4c957fa700 1 -- 172.21.15.72:0/1943759771 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c007440 con 0x7f4c9806a770 2023-10-03T10:18:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.760+0000 7f4c957fa700 1 -- 172.21.15.72:0/1943759771 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c8c007660 con 0x7f4c9806a770 2023-10-03T10:18:41.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.760+0000 7f4c957fa700 1 -- 172.21.15.72:0/1943759771 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4c8c03ec60 con 0x7f4c9806a770 2023-10-03T10:18:41.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.761+0000 7f4c9eb6b700 1 -- 172.21.15.72:0/1943759771 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9811abc0 con 0x7f4c9806a770 2023-10-03T10:18:41.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.766+0000 7f4c957fa700 1 -- 172.21.15.72:0/1943759771 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c8c017080 con 0x7f4c9806a770 2023-10-03T10:18:41.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.791+0000 7f2c9bc2f700 1 Processor -- start 2023-10-03T10:18:41.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.791+0000 7f2c9bc2f700 1 -- start start 2023-10-03T10:18:41.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.792+0000 7f2c9bc2f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9412cf60 0x7f2c9406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.792+0000 7f2c9bc2f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c94130430 0x7f2c94137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.792+0000 7f2c9bc2f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c9412cd90 con 0x7f2c9412f8b0 2023-10-03T10:18:41.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.792+0000 7f2c9bc2f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c9412d330 con 0x7f2c94130430 2023-10-03T10:18:41.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.792+0000 7f2c9bc2f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94071780 con 0x7f2c9412cf60 2023-10-03T10:18:41.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.792+0000 7f2c999cb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9412cf60 0x7f2c9406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.792+0000 7f2c991ca700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2c9412f8b0 0x7f2c9412fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53172/0 (socket says 172.21.15.72:53172) 2023-10-03T10:18:41.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.792+0000 7f2c999cb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9412cf60 0x7f2c9406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60510/0 (socket says 172.21.15.72:60510) 2023-10-03T10:18:41.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.792+0000 7f2c991ca700 1 -- 172.21.15.72:0/2897558602 learned_addr learned my addr 172.21.15.72:0/2897558602 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:41.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.792+0000 7f2c9a1cc700 1 --2- 172.21.15.72:0/2897558602 >> v2:172.21.15.72:3300/0 conn(0x7f2c94130430 0x7f2c94137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.792+0000 7f2c999cb700 1 -- 172.21.15.72:0/2897558602 >> v2:172.21.15.72:3300/0 conn(0x7f2c94130430 msgr2=0x7f2c94137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.792+0000 7f2c999cb700 1 --2- 172.21.15.72:0/2897558602 >> v2:172.21.15.72:3300/0 conn(0x7f2c94130430 0x7f2c94137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.792+0000 7f2c999cb700 1 -- 172.21.15.72:0/2897558602 >> v1:172.21.15.72:6789/0 conn(0x7f2c9412f8b0 legacy=0x7f2c9412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.792+0000 7f2c999cb700 1 -- 172.21.15.72:0/2897558602 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c94071a40 con 0x7f2c9412cf60 2023-10-03T10:18:41.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.792+0000 7f2c9a1cc700 1 --2- 172.21.15.72:0/2897558602 >> v2:172.21.15.72:3300/0 conn(0x7f2c94130430 0x7f2c94137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.793+0000 7f2c999cb700 1 --2- 172.21.15.72:0/2897558602 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9412cf60 0x7f2c9406f5d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009840 tx=0x7f2c90009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b20427ec95a453a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.793+0000 7f2c989c9700 1 -- 172.21.15.72:0/2897558602 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90011830 con 0x7f2c9412cf60 2023-10-03T10:18:41.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.793+0000 7f2c989c9700 1 -- 172.21.15.72:0/2897558602 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c90011990 con 0x7f2c9412cf60 2023-10-03T10:18:41.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.793+0000 7f2c989c9700 1 -- 172.21.15.72:0/2897558602 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90011d20 con 0x7f2c9412cf60 2023-10-03T10:18:41.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.793+0000 7f2c9bc2f700 1 -- 172.21.15.72:0/2897558602 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9412cf60 msgr2=0x7f2c9406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.793+0000 7f2c9bc2f700 1 --2- 172.21.15.72:0/2897558602 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9412cf60 0x7f2c9406f5d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009840 tx=0x7f2c90009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:41.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.793+0000 7f2c9bc2f700 1 -- 172.21.15.72:0/2897558602 shutdown_connections 2023-10-03T10:18:41.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.793+0000 7f2c9bc2f700 1 --2- 172.21.15.72:0/2897558602 >> v2:172.21.15.72:3300/0 conn(0x7f2c94130430 0x7f2c94137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.793+0000 7f2c9bc2f700 1 --2- 172.21.15.72:0/2897558602 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9412cf60 0x7f2c9406f5d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.793+0000 7f2c9bc2f700 1 -- 172.21.15.72:0/2897558602 >> 172.21.15.72:0/2897558602 conn(0x7f2c940a2aa0 msgr2=0x7f2c940a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.794+0000 7f2c9bc2f700 1 -- 172.21.15.72:0/2897558602 shutdown_connections 2023-10-03T10:18:41.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.794+0000 7f2c9bc2f700 1 -- 172.21.15.72:0/2897558602 wait complete. 2023-10-03T10:18:41.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.794+0000 7f2c9bc2f700 1 Processor -- start 2023-10-03T10:18:41.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.795+0000 7f2c9bc2f700 1 -- start start 2023-10-03T10:18:41.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.795+0000 7f2c9bc2f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9412cf60 0x7f2c941c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.795+0000 7f2c9bc2f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9412f8b0 0x7f2c941c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.795+0000 7f2c9bc2f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c94130430 0x7f2c941309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.795+0000 7f2c9bc2f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94132d50 con 0x7f2c9412cf60 2023-10-03T10:18:41.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.795+0000 7f2c9bc2f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94131ea0 con 0x7f2c94130430 2023-10-03T10:18:41.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.795+0000 7f2c9bc2f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9409eaf0 con 0x7f2c9412f8b0 2023-10-03T10:18:41.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.795+0000 7f2c999cb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9412cf60 0x7f2c941c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.795+0000 7f2c999cb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9412cf60 0x7f2c941c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40694/0 (socket says 172.21.15.72:40694) 2023-10-03T10:18:41.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.795+0000 7f2c999cb700 1 -- 172.21.15.72:0/3670307719 learned_addr learned my addr 172.21.15.72:0/3670307719 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:41.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.795+0000 7f2c9a1cc700 1 --2- 172.21.15.72:0/3670307719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c94130430 0x7f2c941309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.795+0000 7f2c991ca700 1 --2- 172.21.15.72:0/3670307719 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9412f8b0 0x7f2c941c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.796+0000 7f2c999cb700 1 -- 172.21.15.72:0/3670307719 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9412f8b0 msgr2=0x7f2c941c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.796+0000 7f2c999cb700 1 --2- 172.21.15.72:0/3670307719 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9412f8b0 0x7f2c941c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.796+0000 7f2c999cb700 1 -- 172.21.15.72:0/3670307719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c94130430 msgr2=0x7f2c941309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.796+0000 7f2c999cb700 1 --2- 172.21.15.72:0/3670307719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c94130430 0x7f2c941309e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.796+0000 7f2c999cb700 1 -- 172.21.15.72:0/3670307719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c009a70 con 0x7f2c9412cf60 2023-10-03T10:18:41.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.796+0000 7f2c999cb700 1 --2- 172.21.15.72:0/3670307719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9412cf60 0x7f2c941c86d0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009fd0 tx=0x7f2c90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.796+0000 7f2c8a7fc700 1 -- 172.21.15.72:0/3670307719 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c900045d0 con 0x7f2c9412cf60 2023-10-03T10:18:41.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.796+0000 7f2c8a7fc700 1 -- 172.21.15.72:0/3670307719 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9001f070 con 0x7f2c9412cf60 2023-10-03T10:18:41.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.796+0000 7f2c9bc2f700 1 -- 172.21.15.72:0/3670307719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c900094a0 con 0x7f2c9412cf60 2023-10-03T10:18:41.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.796+0000 7f2c8a7fc700 1 -- 172.21.15.72:0/3670307719 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c900038e0 con 0x7f2c9412cf60 2023-10-03T10:18:41.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.796+0000 7f2c9bc2f700 1 -- 172.21.15.72:0/3670307719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9413b470 con 0x7f2c9412cf60 2023-10-03T10:18:41.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.797+0000 7f2c8a7fc700 1 -- 172.21.15.72:0/3670307719 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c90003a40 con 0x7f2c9412cf60 2023-10-03T10:18:41.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.797+0000 7f2c8a7fc700 1 -- 172.21.15.72:0/3670307719 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2c90021070 con 0x7f2c9412cf60 2023-10-03T10:18:41.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.797+0000 7f2c9bc2f700 1 -- 172.21.15.72:0/3670307719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c94074ea0 con 0x7f2c9412cf60 2023-10-03T10:18:41.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.802+0000 7f2c8a7fc700 1 -- 172.21.15.72:0/3670307719 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c90015080 con 0x7f2c9412cf60 2023-10-03T10:18:41.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.864+0000 7ff6a8dff700 1 Processor -- start 2023-10-03T10:18:41.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.864+0000 7ff6a8dff700 1 -- start start 2023-10-03T10:18:41.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.864+0000 7ff6a8dff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a409e930 0x7ff6a409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.864+0000 7ff6a8dff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6a409f240 0x7ff6a41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a8dff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a409f650 0x7ff6a4131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a8dff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a4070940 con 0x7ff6a409f240 2023-10-03T10:18:41.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a8dff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a406fd60 con 0x7ff6a409f650 2023-10-03T10:18:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a8dff700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a406fa80 con 0x7ff6a409e930 2023-10-03T10:18:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a409e930 0x7ff6a409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a409e930 0x7ff6a409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60518/0 (socket says 172.21.15.72:60518) 2023-10-03T10:18:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a259c700 1 -- 172.21.15.72:0/299201543 learned_addr learned my addr 172.21.15.72:0/299201543 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a1d9b700 1 --2- 172.21.15.72:0/299201543 >> v2:172.21.15.72:3300/0 conn(0x7ff6a409f240 0x7ff6a41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a259c700 1 -- 172.21.15.72:0/299201543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a409f650 msgr2=0x7ff6a4131d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:18:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a259c700 1 --2- 172.21.15.72:0/299201543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a409f650 0x7ff6a4131d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a259c700 1 -- 172.21.15.72:0/299201543 >> v2:172.21.15.72:3300/0 conn(0x7ff6a409f240 msgr2=0x7ff6a41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a259c700 1 --2- 172.21.15.72:0/299201543 >> v2:172.21.15.72:3300/0 conn(0x7ff6a409f240 0x7ff6a41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a259c700 1 -- 172.21.15.72:0/299201543 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a409fb60 con 0x7ff6a409e930 2023-10-03T10:18:41.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a259c700 1 --2- 172.21.15.72:0/299201543 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a409e930 0x7ff6a409ed00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff6940098f0 tx=0x7ff694009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2909c0f5da9014db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a159a700 1 -- 172.21.15.72:0/299201543 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694011830 con 0x7ff6a409e930 2023-10-03T10:18:41.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a159a700 1 -- 172.21.15.72:0/299201543 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff694011990 con 0x7ff6a409e930 2023-10-03T10:18:41.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.865+0000 7ff6a159a700 1 -- 172.21.15.72:0/299201543 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694011d20 con 0x7ff6a409e930 2023-10-03T10:18:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.866+0000 7ff6a8dff700 1 -- 172.21.15.72:0/299201543 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a409e930 msgr2=0x7ff6a409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.866+0000 7ff6a8dff700 1 --2- 172.21.15.72:0/299201543 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a409e930 0x7ff6a409ed00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff6940098f0 tx=0x7ff694009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.866+0000 7ff6a8dff700 1 -- 172.21.15.72:0/299201543 shutdown_connections 2023-10-03T10:18:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.866+0000 7ff6a8dff700 1 --2- 172.21.15.72:0/299201543 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a409f650 0x7ff6a4131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.866+0000 7ff6a8dff700 1 --2- 172.21.15.72:0/299201543 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a409e930 0x7ff6a409ed00 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.866+0000 7ff6a8dff700 1 --2- 172.21.15.72:0/299201543 >> v2:172.21.15.72:3300/0 conn(0x7ff6a409f240 0x7ff6a41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.866+0000 7ff6a8dff700 1 -- 172.21.15.72:0/299201543 >> 172.21.15.72:0/299201543 conn(0x7ff6a40a4210 msgr2=0x7ff6a40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.866+0000 7ff6a8dff700 1 -- 172.21.15.72:0/299201543 shutdown_connections 2023-10-03T10:18:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.866+0000 7ff6a8dff700 1 -- 172.21.15.72:0/299201543 wait complete. 2023-10-03T10:18:41.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.868+0000 7ff6a8dff700 1 Processor -- start 2023-10-03T10:18:41.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.868+0000 7ff6a8dff700 1 -- start start 2023-10-03T10:18:41.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a8dff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a409e930 0x7ff6a406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a8dff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a409f240 0x7ff6a406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a8dff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a409f650 0x7ff6a406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a8dff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a41b7330 con 0x7ff6a409f650 2023-10-03T10:18:41.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a8dff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a41a94e0 con 0x7ff6a409f240 2023-10-03T10:18:41.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a8dff700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a41a9840 con 0x7ff6a409e930 2023-10-03T10:18:41.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a409e930 0x7ff6a406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a409e930 0x7ff6a406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60526/0 (socket says 172.21.15.72:60526) 2023-10-03T10:18:41.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a259c700 1 -- 172.21.15.72:0/3840893580 learned_addr learned my addr 172.21.15.72:0/3840893580 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:41.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a2d9d700 1 --2- 172.21.15.72:0/3840893580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a409f650 0x7ff6a406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a259c700 1 -- 172.21.15.72:0/3840893580 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a409f240 msgr2=0x7ff6a406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a259c700 1 --2- 172.21.15.72:0/3840893580 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a409f240 0x7ff6a406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a259c700 1 -- 172.21.15.72:0/3840893580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a409f650 msgr2=0x7ff6a406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a259c700 1 --2- 172.21.15.72:0/3840893580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a409f650 0x7ff6a406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a259c700 1 -- 172.21.15.72:0/3840893580 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff694009550 con 0x7ff6a409e930 2023-10-03T10:18:41.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.869+0000 7ff6a259c700 1 --2- 172.21.15.72:0/3840893580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a409e930 0x7ff6a406b8b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff694000c00 tx=0x7ff694004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.870+0000 7ff692ffd700 1 -- 172.21.15.72:0/3840893580 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694004380 con 0x7ff6a409e930 2023-10-03T10:18:41.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.870+0000 7ff692ffd700 1 -- 172.21.15.72:0/3840893580 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69401f070 con 0x7ff6a409e930 2023-10-03T10:18:41.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.870+0000 7ff692ffd700 1 -- 172.21.15.72:0/3840893580 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6940036a0 con 0x7ff6a409e930 2023-10-03T10:18:41.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.870+0000 7ff6a8dff700 1 -- 172.21.15.72:0/3840893580 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a40a0190 con 0x7ff6a409e930 2023-10-03T10:18:41.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.870+0000 7ff6a8dff700 1 -- 172.21.15.72:0/3840893580 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a40a3700 con 0x7ff6a409e930 2023-10-03T10:18:41.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.870+0000 7ff692ffd700 1 -- 172.21.15.72:0/3840893580 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff694021030 con 0x7ff6a409e930 2023-10-03T10:18:41.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.871+0000 7ff692ffd700 1 -- 172.21.15.72:0/3840893580 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff6940408b0 con 0x7ff6a409e930 2023-10-03T10:18:41.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.871+0000 7ff6a8dff700 1 -- 172.21.15.72:0/3840893580 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a4071d20 con 0x7ff6a409e930 2023-10-03T10:18:41.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.876+0000 7ff692ffd700 1 -- 172.21.15.72:0/3840893580 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6940199a0 con 0x7ff6a409e930 2023-10-03T10:18:41.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.878+0000 7fefa38e0700 1 Processor -- start 2023-10-03T10:18:41.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.878+0000 7fefa38e0700 1 -- start start 2023-10-03T10:18:41.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.878+0000 7fefa38e0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef9c136710 0x7fef9c138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.878+0000 7fefa38e0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef9c139030 0x7fef9c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.878+0000 7fefa38e0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c06ef30 con 0x7fef9c1338a0 2023-10-03T10:18:41.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.878+0000 7fefa38e0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c06fef0 con 0x7fef9c139030 2023-10-03T10:18:41.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.878+0000 7fefa38e0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c1334b0 con 0x7fef9c136710 2023-10-03T10:18:41.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.878+0000 7fefa0e7b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef9c136710 0x7fef9c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.878+0000 7fefa0e7b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef9c136710 0x7fef9c138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60528/0 (socket says 172.21.15.72:60528) 2023-10-03T10:18:41.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.878+0000 7fefa1e7d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef9c139030 0x7fef9c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.878+0000 7fefa0e7b700 1 -- 172.21.15.72:0/1091271325 learned_addr learned my addr 172.21.15.72:0/1091271325 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:41.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.879+0000 7fefa1e7d700 1 -- 172.21.15.72:0/1091271325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef9c136710 msgr2=0x7fef9c138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.879+0000 7fefa1e7d700 1 --2- 172.21.15.72:0/1091271325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef9c136710 0x7fef9c138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.879+0000 7fefa1e7d700 1 -- 172.21.15.72:0/1091271325 >> v1:172.21.15.72:6789/0 conn(0x7fef9c1338a0 legacy=0x7fef9c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.879+0000 7fefa1e7d700 1 -- 172.21.15.72:0/1091271325 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c06fc30 con 0x7fef9c139030 2023-10-03T10:18:41.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.879+0000 7fefa0e7b700 1 --2- 172.21.15.72:0/1091271325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef9c136710 0x7fef9c138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.879+0000 7fefa1e7d700 1 --2- 172.21.15.72:0/1091271325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef9c139030 0x7fef9c13b410 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fef94009d90 tx=0x7fef9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17f1f0b7ba532cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.879+0000 7fef93fff700 1 -- 172.21.15.72:0/1091271325 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9400e070 con 0x7fef9c139030 2023-10-03T10:18:41.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.879+0000 7fef93fff700 1 -- 172.21.15.72:0/1091271325 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9400bb20 con 0x7fef9c139030 2023-10-03T10:18:41.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.879+0000 7fef93fff700 1 -- 172.21.15.72:0/1091271325 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94012430 con 0x7fef9c139030 2023-10-03T10:18:41.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.880+0000 7fefa38e0700 1 -- 172.21.15.72:0/1091271325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef9c139030 msgr2=0x7fef9c13b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.880+0000 7fefa38e0700 1 --2- 172.21.15.72:0/1091271325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef9c139030 0x7fef9c13b410 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fef94009d90 tx=0x7fef9400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:41.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.880+0000 7fefa38e0700 1 -- 172.21.15.72:0/1091271325 shutdown_connections 2023-10-03T10:18:41.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.880+0000 7fefa38e0700 1 --2- 172.21.15.72:0/1091271325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef9c139030 0x7fef9c13b410 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.880+0000 7fefa38e0700 1 --2- 172.21.15.72:0/1091271325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef9c136710 0x7fef9c138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.880+0000 7fefa38e0700 1 -- 172.21.15.72:0/1091271325 >> 172.21.15.72:0/1091271325 conn(0x7fef9c0a2aa0 msgr2=0x7fef9c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.880+0000 7fefa38e0700 1 -- 172.21.15.72:0/1091271325 shutdown_connections 2023-10-03T10:18:41.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.880+0000 7fefa38e0700 1 -- 172.21.15.72:0/1091271325 wait complete. 2023-10-03T10:18:41.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.881+0000 7fefa38e0700 1 Processor -- start 2023-10-03T10:18:41.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.881+0000 7fefa38e0700 1 -- start start 2023-10-03T10:18:41.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.881+0000 7fefa38e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef9c1338a0 0x7fef9c1c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.881+0000 7fefa38e0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef9c136710 0x7fef9c1c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa38e0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef9c139030 0x7fef9c11ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa38e0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c11e570 con 0x7fef9c1338a0 2023-10-03T10:18:41.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa38e0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c11e750 con 0x7fef9c136710 2023-10-03T10:18:41.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa38e0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c1be110 con 0x7fef9c139030 2023-10-03T10:18:41.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa167c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef9c1338a0 0x7fef9c1c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa167c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef9c1338a0 0x7fef9c1c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40732/0 (socket says 172.21.15.72:40732) 2023-10-03T10:18:41.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa167c700 1 -- 172.21.15.72:0/1706704009 learned_addr learned my addr 172.21.15.72:0/1706704009 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:41.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa0e7b700 1 --2- 172.21.15.72:0/1706704009 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef9c136710 0x7fef9c1c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa1e7d700 1 --2- 172.21.15.72:0/1706704009 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef9c139030 0x7fef9c11ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa167c700 1 -- 172.21.15.72:0/1706704009 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef9c139030 msgr2=0x7fef9c11ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa167c700 1 --2- 172.21.15.72:0/1706704009 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef9c139030 0x7fef9c11ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa167c700 1 -- 172.21.15.72:0/1706704009 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef9c136710 msgr2=0x7fef9c1c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa167c700 1 --2- 172.21.15.72:0/1706704009 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef9c136710 0x7fef9c1c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa167c700 1 -- 172.21.15.72:0/1706704009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c009550 con 0x7fef9c1338a0 2023-10-03T10:18:41.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa167c700 1 --2- 172.21.15.72:0/1706704009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef9c1338a0 0x7fef9c1c8570 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fef9800c510 tx=0x7fef9800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fef91ffb700 1 -- 172.21.15.72:0/1706704009 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef980052d0 con 0x7fef9c1338a0 2023-10-03T10:18:41.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fef91ffb700 1 -- 172.21.15.72:0/1706704009 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef98005430 con 0x7fef9c1338a0 2023-10-03T10:18:41.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fef91ffb700 1 -- 172.21.15.72:0/1706704009 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef980038c0 con 0x7fef9c1338a0 2023-10-03T10:18:41.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.882+0000 7fefa38e0700 1 -- 172.21.15.72:0/1706704009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef94009a70 con 0x7fef9c1338a0 2023-10-03T10:18:41.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.883+0000 7fefa38e0700 1 -- 172.21.15.72:0/1706704009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c1c8ff0 con 0x7fef9c1338a0 2023-10-03T10:18:41.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.883+0000 7fef91ffb700 1 -- 172.21.15.72:0/1706704009 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef98003a20 con 0x7fef9c1338a0 2023-10-03T10:18:41.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.884+0000 7fefa38e0700 1 -- 172.21.15.72:0/1706704009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c074ea0 con 0x7fef9c1338a0 2023-10-03T10:18:41.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.884+0000 7fef91ffb700 1 -- 172.21.15.72:0/1706704009 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef9803ea60 con 0x7fef9c1338a0 2023-10-03T10:18:41.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:41.893+0000 7fef91ffb700 1 -- 172.21.15.72:0/1706704009 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef98018260 con 0x7fef9c1338a0 2023-10-03T10:18:42.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.005+0000 7f2c9bc2f700 1 -- 172.21.15.72:0/3670307719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2c940713a0 con 0x7f2c9412cf60 2023-10-03T10:18:42.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.005+0000 7f2c8a7fc700 1 -- 172.21.15.72:0/3670307719 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2c9002b020 con 0x7f2c9412cf60 2023-10-03T10:18:42.006 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:42.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.007+0000 7f2c9bc2f700 1 -- 172.21.15.72:0/3670307719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9412cf60 msgr2=0x7f2c941c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.007+0000 7f2c9bc2f700 1 --2- 172.21.15.72:0/3670307719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9412cf60 0x7f2c941c86d0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009fd0 tx=0x7f2c90004750 comp rx=0 tx=0).stop 2023-10-03T10:18:42.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.007+0000 7f2c9bc2f700 1 -- 172.21.15.72:0/3670307719 shutdown_connections 2023-10-03T10:18:42.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.007+0000 7f2c9bc2f700 1 --2- 172.21.15.72:0/3670307719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c9412cf60 0x7f2c941c86d0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.007+0000 7f2c9bc2f700 1 --2- 172.21.15.72:0/3670307719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c94130430 0x7f2c941309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.007+0000 7f2c9bc2f700 1 --2- 172.21.15.72:0/3670307719 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2c9412f8b0 0x7f2c941c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.007+0000 7f2c9bc2f700 1 -- 172.21.15.72:0/3670307719 >> 172.21.15.72:0/3670307719 conn(0x7f2c940a2aa0 msgr2=0x7f2c9406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.008+0000 7f2c9bc2f700 1 -- 172.21.15.72:0/3670307719 shutdown_connections 2023-10-03T10:18:42.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.008+0000 7f2c9bc2f700 1 -- 172.21.15.72:0/3670307719 wait complete. 2023-10-03T10:18:42.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:42.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.037+0000 7f4c9eb6b700 1 -- 172.21.15.72:0/1943759771 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4c98074ea0 con 0x7f4c9806a770 2023-10-03T10:18:42.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.038+0000 7f4c957fa700 1 -- 172.21.15.72:0/1943759771 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f4c8c019d20 con 0x7f4c9806a770 2023-10-03T10:18:42.038 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:42.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.040+0000 7f4c9eb6b700 1 -- 172.21.15.72:0/1943759771 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c9806a770 msgr2=0x7f4c981cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.040+0000 7f4c9eb6b700 1 --2- 172.21.15.72:0/1943759771 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c9806a770 0x7f4c981cc9c0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00c700 tx=0x7f4c8c00ca10 comp rx=0 tx=0).stop 2023-10-03T10:18:42.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.040+0000 7f4c9eb6b700 1 -- 172.21.15.72:0/1943759771 shutdown_connections 2023-10-03T10:18:42.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.040+0000 7f4c9eb6b700 1 --2- 172.21.15.72:0/1943759771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c9813d1f0 0x7f4c981cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.040+0000 7f4c9eb6b700 1 --2- 172.21.15.72:0/1943759771 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c9806a770 0x7f4c981cc9c0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.040+0000 7f4c9eb6b700 1 --2- 172.21.15.72:0/1943759771 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4c9809de00 0x7f4c981ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.040+0000 7f4c9eb6b700 1 -- 172.21.15.72:0/1943759771 >> 172.21.15.72:0/1943759771 conn(0x7f4c98066f50 msgr2=0x7f4c9813c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.040+0000 7f4c9eb6b700 1 -- 172.21.15.72:0/1943759771 shutdown_connections 2023-10-03T10:18:42.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.040+0000 7f4c9eb6b700 1 -- 172.21.15.72:0/1943759771 wait complete. 2023-10-03T10:18:42.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:42.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.085+0000 7fefa38e0700 1 -- 172.21.15.72:0/1706704009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fef9c11e3b0 con 0x7fef9c1338a0 2023-10-03T10:18:42.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.086+0000 7fef91ffb700 1 -- 172.21.15.72:0/1706704009 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef9c11e3b0 con 0x7fef9c1338a0 2023-10-03T10:18:42.086 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.088+0000 7fefa38e0700 1 -- 172.21.15.72:0/1706704009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef9c1338a0 msgr2=0x7fef9c1c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.088+0000 7fefa38e0700 1 --2- 172.21.15.72:0/1706704009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef9c1338a0 0x7fef9c1c8570 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fef9800c510 tx=0x7fef9800c820 comp rx=0 tx=0).stop 2023-10-03T10:18:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.088+0000 7fefa38e0700 1 -- 172.21.15.72:0/1706704009 shutdown_connections 2023-10-03T10:18:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.088+0000 7fefa38e0700 1 --2- 172.21.15.72:0/1706704009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef9c1338a0 0x7fef9c1c8570 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.088+0000 7fefa38e0700 1 --2- 172.21.15.72:0/1706704009 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef9c139030 0x7fef9c11ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.088+0000 7fefa38e0700 1 --2- 172.21.15.72:0/1706704009 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef9c136710 0x7fef9c1c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.088+0000 7fefa38e0700 1 -- 172.21.15.72:0/1706704009 >> 172.21.15.72:0/1706704009 conn(0x7fef9c0a2aa0 msgr2=0x7fef9c136f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.088+0000 7fefa38e0700 1 -- 172.21.15.72:0/1706704009 shutdown_connections 2023-10-03T10:18:42.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.088+0000 7fefa38e0700 1 -- 172.21.15.72:0/1706704009 wait complete. 2023-10-03T10:18:42.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:42.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.102+0000 7ff6a8dff700 1 -- 172.21.15.72:0/3840893580 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff6a4074ea0 con 0x7ff6a409e930 2023-10-03T10:18:42.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.102+0000 7ff692ffd700 1 -- 172.21.15.72:0/3840893580 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff69401b430 con 0x7ff6a409e930 2023-10-03T10:18:42.103 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:42.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.105+0000 7ff6a8dff700 1 -- 172.21.15.72:0/3840893580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a409e930 msgr2=0x7ff6a406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.105+0000 7ff6a8dff700 1 --2- 172.21.15.72:0/3840893580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a409e930 0x7ff6a406b8b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff694000c00 tx=0x7ff694004750 comp rx=0 tx=0).stop 2023-10-03T10:18:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.105+0000 7ff6a8dff700 1 -- 172.21.15.72:0/3840893580 shutdown_connections 2023-10-03T10:18:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.105+0000 7ff6a8dff700 1 --2- 172.21.15.72:0/3840893580 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6a409f650 0x7ff6a406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.105+0000 7ff6a8dff700 1 --2- 172.21.15.72:0/3840893580 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff6a409e930 0x7ff6a406b8b0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.105+0000 7ff6a8dff700 1 --2- 172.21.15.72:0/3840893580 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6a409f240 0x7ff6a406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.105+0000 7ff6a8dff700 1 -- 172.21.15.72:0/3840893580 >> 172.21.15.72:0/3840893580 conn(0x7ff6a40a4210 msgr2=0x7ff6a41b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.105+0000 7ff6a8dff700 1 -- 172.21.15.72:0/3840893580 shutdown_connections 2023-10-03T10:18:42.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:42.105+0000 7ff6a8dff700 1 -- 172.21.15.72:0/3840893580 wait complete. 2023-10-03T10:18:42.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:43.021 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:43.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:43.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:43.118 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:43.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.162+0000 7f0872880700 1 Processor -- start 2023-10-03T10:18:43.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.162+0000 7f0872880700 1 -- start start 2023-10-03T10:18:43.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.162+0000 7f0872880700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f086c09d6f0 0x7f086c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.162+0000 7f0872880700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f086c09e000 0x7f086c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.162+0000 7f0872880700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c09b120 con 0x7f086c09e410 2023-10-03T10:18:43.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.162+0000 7f0872880700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c06b460 con 0x7f086c09d6f0 2023-10-03T10:18:43.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.162+0000 7f0872880700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f086c09a7e0 con 0x7f086c09e000 2023-10-03T10:18:43.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.163+0000 7f086bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f086c09d6f0 0x7f086c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.163+0000 7f086b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f086c09e000 0x7f086c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.163+0000 7f086bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f086c09d6f0 0x7f086c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34328/0 (socket says 172.21.15.72:34328) 2023-10-03T10:18:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.163+0000 7f086bfff700 1 -- 172.21.15.72:0/2525463261 learned_addr learned my addr 172.21.15.72:0/2525463261 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.163+0000 7f086b7fe700 1 -- 172.21.15.72:0/2525463261 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f086c09d6f0 msgr2=0x7f086c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.163+0000 7f086b7fe700 1 --2- 172.21.15.72:0/2525463261 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f086c09d6f0 0x7f086c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.163+0000 7f086b7fe700 1 -- 172.21.15.72:0/2525463261 >> v1:172.21.15.72:6789/0 conn(0x7f086c09e410 legacy=0x7f086c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.163+0000 7f086b7fe700 1 -- 172.21.15.72:0/2525463261 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c09a500 con 0x7f086c09e000 2023-10-03T10:18:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.163+0000 7f086bfff700 1 --2- 172.21.15.72:0/2525463261 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f086c09d6f0 0x7f086c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.163+0000 7f086b7fe700 1 --2- 172.21.15.72:0/2525463261 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f086c09e000 0x7f086c1339f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f08600098a0 tx=0x7f0860009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5134f38392196c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.163+0000 7f086affd700 1 -- 172.21.15.72:0/2525463261 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0860004230 con 0x7f086c09e000 2023-10-03T10:18:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.163+0000 7f086affd700 1 -- 172.21.15.72:0/2525463261 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0860004390 con 0x7f086c09e000 2023-10-03T10:18:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.163+0000 7f086affd700 1 -- 172.21.15.72:0/2525463261 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600036a0 con 0x7f086c09e000 2023-10-03T10:18:43.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.164+0000 7f0872880700 1 -- 172.21.15.72:0/2525463261 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f086c09e000 msgr2=0x7f086c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.164+0000 7f0872880700 1 --2- 172.21.15.72:0/2525463261 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f086c09e000 0x7f086c1339f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f08600098a0 tx=0x7f0860009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.164+0000 7f0872880700 1 -- 172.21.15.72:0/2525463261 shutdown_connections 2023-10-03T10:18:43.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.164+0000 7f0872880700 1 --2- 172.21.15.72:0/2525463261 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f086c09d6f0 0x7f086c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.164+0000 7f0872880700 1 --2- 172.21.15.72:0/2525463261 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f086c09e000 0x7f086c1339f0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.164+0000 7f0872880700 1 -- 172.21.15.72:0/2525463261 >> 172.21.15.72:0/2525463261 conn(0x7f086c066f50 msgr2=0x7f086c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.164+0000 7f0872880700 1 -- 172.21.15.72:0/2525463261 shutdown_connections 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.165+0000 7f0872880700 1 -- 172.21.15.72:0/2525463261 wait complete. 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.166+0000 7f0872880700 1 Processor -- start 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.166+0000 7f0872880700 1 -- start start 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.166+0000 7f0872880700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f086c09d6f0 0x7f086c122540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.166+0000 7f0872880700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f086c09e000 0x7f086c122a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.166+0000 7f0872880700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f086c09e410 0x7f086c122fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.166+0000 7f0872880700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c09c780 con 0x7f086c09d6f0 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.166+0000 7f0872880700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c123980 con 0x7f086c09e000 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.166+0000 7f0872880700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f086c125d80 con 0x7f086c09e410 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.166+0000 7f086bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f086c09d6f0 0x7f086c122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.166+0000 7f086bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f086c09d6f0 0x7f086c122540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40736/0 (socket says 172.21.15.72:40736) 2023-10-03T10:18:43.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.166+0000 7f086bfff700 1 -- 172.21.15.72:0/3324771336 learned_addr learned my addr 172.21.15.72:0/3324771336 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:43.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.167+0000 7f0870e1d700 1 --2- 172.21.15.72:0/3324771336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f086c09e410 0x7f086c122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.167+0000 7f086b7fe700 1 --2- 172.21.15.72:0/3324771336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f086c09e000 0x7f086c122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.167+0000 7f086bfff700 1 -- 172.21.15.72:0/3324771336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f086c09e410 msgr2=0x7f086c122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.167+0000 7f086bfff700 1 --2- 172.21.15.72:0/3324771336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f086c09e410 0x7f086c122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.167+0000 7f086bfff700 1 -- 172.21.15.72:0/3324771336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f086c09e000 msgr2=0x7f086c122a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.167+0000 7f086bfff700 1 --2- 172.21.15.72:0/3324771336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f086c09e000 0x7f086c122a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.167+0000 7f086bfff700 1 -- 172.21.15.72:0/3324771336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c009550 con 0x7f086c09d6f0 2023-10-03T10:18:43.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.167+0000 7f0870e1d700 1 --2- 172.21.15.72:0/3324771336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f086c09e410 0x7f086c122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.167+0000 7f086bfff700 1 --2- 172.21.15.72:0/3324771336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f086c09d6f0 0x7f086c122540 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f085c00ebe0 tx=0x7f085c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.167+0000 7f0868ff9700 1 -- 172.21.15.72:0/3324771336 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c00c850 con 0x7f086c09d6f0 2023-10-03T10:18:43.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.167+0000 7f0868ff9700 1 -- 172.21.15.72:0/3324771336 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c00c9b0 con 0x7f086c09d6f0 2023-10-03T10:18:43.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.167+0000 7f0868ff9700 1 -- 172.21.15.72:0/3324771336 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c00cd40 con 0x7f086c09d6f0 2023-10-03T10:18:43.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.168+0000 7f0872880700 1 -- 172.21.15.72:0/3324771336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08600094a0 con 0x7f086c09d6f0 2023-10-03T10:18:43.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.168+0000 7f0872880700 1 -- 172.21.15.72:0/3324771336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c0a2c20 con 0x7f086c09d6f0 2023-10-03T10:18:43.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.169+0000 7f0872880700 1 -- 172.21.15.72:0/3324771336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c1334f0 con 0x7f086c09d6f0 2023-10-03T10:18:43.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.169+0000 7f0868ff9700 1 -- 172.21.15.72:0/3324771336 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f085c013470 con 0x7f086c09d6f0 2023-10-03T10:18:43.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.169+0000 7f0868ff9700 1 -- 172.21.15.72:0/3324771336 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f085c03fc00 con 0x7f086c09d6f0 2023-10-03T10:18:43.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.174+0000 7f0868ff9700 1 -- 172.21.15.72:0/3324771336 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f085c01b3b0 con 0x7f086c09d6f0 2023-10-03T10:18:43.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.208+0000 7f5202e92700 1 Processor -- start 2023-10-03T10:18:43.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.208+0000 7f5202e92700 1 -- start start 2023-10-03T10:18:43.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f5202e92700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51fc09f410 0x7f51fc136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f5202e92700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51fc136fe0 0x7f51fc1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f5202e92700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51fc070940 con 0x7f51fc09e930 2023-10-03T10:18:43.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f5202e92700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51fc06fd60 con 0x7f51fc136fe0 2023-10-03T10:18:43.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f5202e92700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc06fa80 con 0x7f51fc09f410 2023-10-03T10:18:43.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f520142f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51fc136fe0 0x7f51fc1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f51fbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51fc09f410 0x7f51fc136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f520142f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51fc136fe0 0x7f51fc1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40750/0 (socket says 172.21.15.72:40750) 2023-10-03T10:18:43.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f51fbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51fc09f410 0x7f51fc136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34350/0 (socket says 172.21.15.72:34350) 2023-10-03T10:18:43.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f520142f700 1 -- 172.21.15.72:0/3097113639 learned_addr learned my addr 172.21.15.72:0/3097113639 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:43.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f5200c2e700 1 --1- 172.21.15.72:0/3097113639 >> v1:172.21.15.72:6789/0 conn(0x7f51fc09e930 0x7f51fc09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53192/0 (socket says 172.21.15.72:53192) 2023-10-03T10:18:43.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f520142f700 1 -- 172.21.15.72:0/3097113639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51fc09f410 msgr2=0x7f51fc136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f520142f700 1 --2- 172.21.15.72:0/3097113639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51fc09f410 0x7f51fc136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f520142f700 1 -- 172.21.15.72:0/3097113639 >> v1:172.21.15.72:6789/0 conn(0x7f51fc09e930 legacy=0x7f51fc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f520142f700 1 -- 172.21.15.72:0/3097113639 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc09fb60 con 0x7f51fc136fe0 2023-10-03T10:18:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f51fb7fe700 1 -- 172.21.15.72:0/3097113639 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366402486 0 0) 0x7f51fc070940 con 0x7f51fc09e930 2023-10-03T10:18:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.209+0000 7f51fbfff700 1 --2- 172.21.15.72:0/3097113639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51fc09f410 0x7f51fc136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.210+0000 7f520142f700 1 --2- 172.21.15.72:0/3097113639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc136fe0 0x7f51fc1393c0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009e50 tx=0x7f51f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1abb78cba93ffca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.210+0000 7f51fb7fe700 1 -- 172.21.15.72:0/3097113639 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f400e070 con 0x7f51fc136fe0 2023-10-03T10:18:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.210+0000 7f51fb7fe700 1 -- 172.21.15.72:0/3097113639 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f400b910 con 0x7f51fc136fe0 2023-10-03T10:18:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.210+0000 7f51fb7fe700 1 -- 172.21.15.72:0/3097113639 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f400bcc0 con 0x7f51fc136fe0 2023-10-03T10:18:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.211+0000 7f5202e92700 1 -- 172.21.15.72:0/3097113639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc136fe0 msgr2=0x7f51fc1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.211+0000 7f5202e92700 1 --2- 172.21.15.72:0/3097113639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc136fe0 0x7f51fc1393c0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009e50 tx=0x7f51f400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:43.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.211+0000 7f5202e92700 1 -- 172.21.15.72:0/3097113639 shutdown_connections 2023-10-03T10:18:43.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.211+0000 7f5202e92700 1 --2- 172.21.15.72:0/3097113639 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc136fe0 0x7f51fc1393c0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.211+0000 7f5202e92700 1 --2- 172.21.15.72:0/3097113639 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51fc09f410 0x7f51fc136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.211+0000 7f5202e92700 1 -- 172.21.15.72:0/3097113639 >> 172.21.15.72:0/3097113639 conn(0x7f51fc0a4210 msgr2=0x7f51fc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.211+0000 7f5202e92700 1 -- 172.21.15.72:0/3097113639 shutdown_connections 2023-10-03T10:18:43.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.211+0000 7f5202e92700 1 -- 172.21.15.72:0/3097113639 wait complete. 2023-10-03T10:18:43.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.212+0000 7f5202e92700 1 Processor -- start 2023-10-03T10:18:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.212+0000 7f5202e92700 1 -- start start 2023-10-03T10:18:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.213+0000 7f5202e92700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51fc09e930 0x7f51fc11e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.213+0000 7f5202e92700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51fc09f410 0x7f51fc11ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.213+0000 7f5202e92700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc136fe0 0x7f51fc11f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.213+0000 7f5202e92700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc1209a0 con 0x7f51fc136fe0 2023-10-03T10:18:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.213+0000 7f5202e92700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc09de30 con 0x7f51fc09f410 2023-10-03T10:18:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.213+0000 7f5202e92700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc120500 con 0x7f51fc09e930 2023-10-03T10:18:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.213+0000 7f520142f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc136fe0 0x7f51fc11f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.213+0000 7f5200c2e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51fc09e930 0x7f51fc11e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.213+0000 7f520142f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc136fe0 0x7f51fc11f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40756/0 (socket says 172.21.15.72:40756) 2023-10-03T10:18:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.213+0000 7f520142f700 1 -- 172.21.15.72:0/3253810547 learned_addr learned my addr 172.21.15.72:0/3253810547 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.214+0000 7f520142f700 1 -- 172.21.15.72:0/3253810547 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51fc09e930 msgr2=0x7f51fc11e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.214+0000 7f520142f700 1 --2- 172.21.15.72:0/3253810547 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51fc09e930 0x7f51fc11e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.214+0000 7f520142f700 1 -- 172.21.15.72:0/3253810547 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51fc09f410 msgr2=0x7f51fc11ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.214+0000 7f520142f700 1 --2- 172.21.15.72:0/3253810547 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51fc09f410 0x7f51fc11ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.214+0000 7f520142f700 1 -- 172.21.15.72:0/3253810547 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e80094a0 con 0x7f51fc136fe0 2023-10-03T10:18:43.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.214+0000 7f520142f700 1 --2- 172.21.15.72:0/3253810547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc136fe0 0x7f51fc11f1f0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f51fc06fea0 tx=0x7f51f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.214+0000 7f51f97fa700 1 -- 172.21.15.72:0/3253810547 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4004930 con 0x7f51fc136fe0 2023-10-03T10:18:43.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.214+0000 7f51f97fa700 1 -- 172.21.15.72:0/3253810547 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f40092e0 con 0x7f51fc136fe0 2023-10-03T10:18:43.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.214+0000 7f51f97fa700 1 -- 172.21.15.72:0/3253810547 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f401c640 con 0x7f51fc136fe0 2023-10-03T10:18:43.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.214+0000 7f5202e92700 1 -- 172.21.15.72:0/3253810547 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f4009b30 con 0x7f51fc136fe0 2023-10-03T10:18:43.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.214+0000 7f5202e92700 1 -- 172.21.15.72:0/3253810547 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51fc120b70 con 0x7f51fc136fe0 2023-10-03T10:18:43.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.215+0000 7f51f97fa700 1 -- 172.21.15.72:0/3253810547 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51f401c7a0 con 0x7f51fc136fe0 2023-10-03T10:18:43.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.215+0000 7f51f97fa700 1 -- 172.21.15.72:0/3253810547 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f51f40410c0 con 0x7f51fc136fe0 2023-10-03T10:18:43.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.215+0000 7f5202e92700 1 -- 172.21.15.72:0/3253810547 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51fc121c50 con 0x7f51fc136fe0 2023-10-03T10:18:43.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.220+0000 7f51f97fa700 1 -- 172.21.15.72:0/3253810547 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51fc121c50 con 0x7f51fc136fe0 2023-10-03T10:18:43.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.254+0000 7f21474b8700 1 Processor -- start 2023-10-03T10:18:43.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.255+0000 7f21474b8700 1 -- start start 2023-10-03T10:18:43.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.255+0000 7f21474b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f214009de00 0x7f214009e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.255+0000 7f21474b8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f214013d1f0 0x7f214013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.255+0000 7f21474b8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214009a810 con 0x7f214006a770 2023-10-03T10:18:43.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.255+0000 7f21474b8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214006ab40 con 0x7f214009de00 2023-10-03T10:18:43.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.255+0000 7f21474b8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f214009ebc0 con 0x7f214013d1f0 2023-10-03T10:18:43.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.255+0000 7f2145a55700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f214013d1f0 0x7f214013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.255+0000 7f2144a53700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f214009de00 0x7f214009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.255+0000 7f2144a53700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f214009de00 0x7f214009e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34370/0 (socket says 172.21.15.72:34370) 2023-10-03T10:18:43.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.255+0000 7f2145a55700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f214013d1f0 0x7f214013f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60582/0 (socket says 172.21.15.72:60582) 2023-10-03T10:18:43.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.255+0000 7f2144a53700 1 -- 172.21.15.72:0/3689571455 learned_addr learned my addr 172.21.15.72:0/3689571455 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:43.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.256+0000 7f2144a53700 1 -- 172.21.15.72:0/3689571455 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f214013d1f0 msgr2=0x7f214013f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.256+0000 7f2144a53700 1 --2- 172.21.15.72:0/3689571455 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f214013d1f0 0x7f214013f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.256+0000 7f2144a53700 1 -- 172.21.15.72:0/3689571455 >> v1:172.21.15.72:6789/0 conn(0x7f214006a770 legacy=0x7f214009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.256+0000 7f2144a53700 1 -- 172.21.15.72:0/3689571455 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214009e920 con 0x7f214009de00 2023-10-03T10:18:43.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.256+0000 7f2145a55700 1 --2- 172.21.15.72:0/3689571455 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f214013d1f0 0x7f214013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.256+0000 7f2144a53700 1 --2- 172.21.15.72:0/3689571455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f214009de00 0x7f214009e250 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2130009920 tx=0x7f2130009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a00018804c93464f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.256+0000 7f2137fff700 1 -- 172.21.15.72:0/3689571455 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130011830 con 0x7f214009de00 2023-10-03T10:18:43.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.256+0000 7f2137fff700 1 -- 172.21.15.72:0/3689571455 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2130011990 con 0x7f214009de00 2023-10-03T10:18:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.256+0000 7f2137fff700 1 -- 172.21.15.72:0/3689571455 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130011d20 con 0x7f214009de00 2023-10-03T10:18:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.257+0000 7f21474b8700 1 -- 172.21.15.72:0/3689571455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f214009de00 msgr2=0x7f214009e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.257+0000 7f21474b8700 1 --2- 172.21.15.72:0/3689571455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f214009de00 0x7f214009e250 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2130009920 tx=0x7f2130009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.257+0000 7f21474b8700 1 -- 172.21.15.72:0/3689571455 shutdown_connections 2023-10-03T10:18:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.257+0000 7f21474b8700 1 --2- 172.21.15.72:0/3689571455 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f214013d1f0 0x7f214013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.257+0000 7f21474b8700 1 --2- 172.21.15.72:0/3689571455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f214009de00 0x7f214009e250 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.257+0000 7f21474b8700 1 -- 172.21.15.72:0/3689571455 >> 172.21.15.72:0/3689571455 conn(0x7f2140066f50 msgr2=0x7f214009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.257+0000 7f21474b8700 1 -- 172.21.15.72:0/3689571455 shutdown_connections 2023-10-03T10:18:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.257+0000 7f21474b8700 1 -- 172.21.15.72:0/3689571455 wait complete. 2023-10-03T10:18:43.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.258+0000 7f21474b8700 1 Processor -- start 2023-10-03T10:18:43.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.258+0000 7f21474b8700 1 -- start start 2023-10-03T10:18:43.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.259+0000 7f21474b8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f214006a770 0x7f21401260a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.259+0000 7f21474b8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f214009de00 0x7f21401265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.259+0000 7f21474b8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f214013d1f0 0x7f2140126b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.259+0000 7f21474b8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2140072190 con 0x7f214013d1f0 2023-10-03T10:18:43.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.259+0000 7f21474b8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2140127560 con 0x7f214006a770 2023-10-03T10:18:43.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.259+0000 7f21474b8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f214009f210 con 0x7f214009de00 2023-10-03T10:18:43.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.259+0000 7f2145254700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f214006a770 0x7f21401260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.259+0000 7f2145254700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f214006a770 0x7f21401260a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34386/0 (socket says 172.21.15.72:34386) 2023-10-03T10:18:43.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.259+0000 7f2145254700 1 -- 172.21.15.72:0/2087418459 learned_addr learned my addr 172.21.15.72:0/2087418459 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:43.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.259+0000 7f2145a55700 1 --2- 172.21.15.72:0/2087418459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f214013d1f0 0x7f2140126b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.260+0000 7f2145254700 1 -- 172.21.15.72:0/2087418459 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f214009de00 msgr2=0x7f21401265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.260+0000 7f2145254700 1 --2- 172.21.15.72:0/2087418459 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f214009de00 0x7f21401265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.260+0000 7f2145254700 1 -- 172.21.15.72:0/2087418459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f214013d1f0 msgr2=0x7f2140126b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.260+0000 7f2145254700 1 --2- 172.21.15.72:0/2087418459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f214013d1f0 0x7f2140126b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.260+0000 7f2145254700 1 -- 172.21.15.72:0/2087418459 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2138009a70 con 0x7f214006a770 2023-10-03T10:18:43.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.260+0000 7f2145254700 1 --2- 172.21.15.72:0/2087418459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f214006a770 0x7f21401260a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c4e0 tx=0x7f213c00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.260+0000 7f2135ffb700 1 -- 172.21.15.72:0/2087418459 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c0052d0 con 0x7f214006a770 2023-10-03T10:18:43.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.260+0000 7f21474b8700 1 -- 172.21.15.72:0/2087418459 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2130009550 con 0x7f214006a770 2023-10-03T10:18:43.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.260+0000 7f2135ffb700 1 -- 172.21.15.72:0/2087418459 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c005430 con 0x7f214006a770 2023-10-03T10:18:43.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.260+0000 7f2135ffb700 1 -- 172.21.15.72:0/2087418459 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c0038c0 con 0x7f214006a770 2023-10-03T10:18:43.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.260+0000 7f21474b8700 1 -- 172.21.15.72:0/2087418459 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2140128500 con 0x7f214006a770 2023-10-03T10:18:43.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.261+0000 7f21474b8700 1 -- 172.21.15.72:0/2087418459 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2140128310 con 0x7f214006a770 2023-10-03T10:18:43.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.262+0000 7f2135ffb700 1 -- 172.21.15.72:0/2087418459 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f213c003a20 con 0x7f214006a770 2023-10-03T10:18:43.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.262+0000 7f2135ffb700 1 -- 172.21.15.72:0/2087418459 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f213c011a60 con 0x7f214006a770 2023-10-03T10:18:43.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.266+0000 7f2135ffb700 1 -- 172.21.15.72:0/2087418459 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2140128310 con 0x7f214006a770 2023-10-03T10:18:43.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.286+0000 7f308f47d700 1 Processor -- start 2023-10-03T10:18:43.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.286+0000 7f308f47d700 1 -- start start 2023-10-03T10:18:43.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.286+0000 7f308f47d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f308809e930 0x7f308809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.286+0000 7f308f47d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f308809f240 0x7f30881317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.286+0000 7f308f47d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f308809f650 0x7f3088131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.286+0000 7f308f47d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3088070940 con 0x7f308809f240 2023-10-03T10:18:43.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.286+0000 7f308f47d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308806fd60 con 0x7f308809f650 2023-10-03T10:18:43.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.286+0000 7f308f47d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f308806fa80 con 0x7f308809e930 2023-10-03T10:18:43.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.286+0000 7f308ca18700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f308809f240 0x7f30881317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.286+0000 7f308ca18700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f308809f240 0x7f30881317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40768/0 (socket says 172.21.15.72:40768) 2023-10-03T10:18:43.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.286+0000 7f308ca18700 1 -- 172.21.15.72:0/944940152 learned_addr learned my addr 172.21.15.72:0/944940152 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:43.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.286+0000 7f308d219700 1 --2- 172.21.15.72:0/944940152 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f308809e930 0x7f308809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.287+0000 7f308ca18700 1 -- 172.21.15.72:0/944940152 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f308809e930 msgr2=0x7f308809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.287+0000 7f308ca18700 1 --2- 172.21.15.72:0/944940152 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f308809e930 0x7f308809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.287+0000 7f308ca18700 1 -- 172.21.15.72:0/944940152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f308809f650 msgr2=0x7f3088131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.287+0000 7f308ca18700 1 --2- 172.21.15.72:0/944940152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f308809f650 0x7f3088131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.287+0000 7f308ca18700 1 -- 172.21.15.72:0/944940152 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308809fb60 con 0x7f308809f240 2023-10-03T10:18:43.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.287+0000 7f308ca18700 1 --2- 172.21.15.72:0/944940152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f308809f240 0x7f30881317f0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f30780098f0 tx=0x7f3078009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca410d93c0e9797 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.287+0000 7f307ffff700 1 -- 172.21.15.72:0/944940152 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078011830 con 0x7f308809f240 2023-10-03T10:18:43.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.287+0000 7f307ffff700 1 -- 172.21.15.72:0/944940152 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3078011990 con 0x7f308809f240 2023-10-03T10:18:43.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.287+0000 7f307ffff700 1 -- 172.21.15.72:0/944940152 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078011d20 con 0x7f308809f240 2023-10-03T10:18:43.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.288+0000 7f308f47d700 1 -- 172.21.15.72:0/944940152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f308809f240 msgr2=0x7f30881317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.288+0000 7f308f47d700 1 --2- 172.21.15.72:0/944940152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f308809f240 0x7f30881317f0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f30780098f0 tx=0x7f3078009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:43.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.288+0000 7f308f47d700 1 -- 172.21.15.72:0/944940152 shutdown_connections 2023-10-03T10:18:43.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.288+0000 7f308f47d700 1 --2- 172.21.15.72:0/944940152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f308809f650 0x7f3088131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.288+0000 7f308f47d700 1 --2- 172.21.15.72:0/944940152 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f308809e930 0x7f308809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.288+0000 7f308f47d700 1 --2- 172.21.15.72:0/944940152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f308809f240 0x7f30881317f0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.288+0000 7f308f47d700 1 -- 172.21.15.72:0/944940152 >> 172.21.15.72:0/944940152 conn(0x7f30880a4210 msgr2=0x7f30880a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.288+0000 7f308f47d700 1 -- 172.21.15.72:0/944940152 shutdown_connections 2023-10-03T10:18:43.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.288+0000 7f308f47d700 1 -- 172.21.15.72:0/944940152 wait complete. 2023-10-03T10:18:43.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.289+0000 7f308f47d700 1 Processor -- start 2023-10-03T10:18:43.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.289+0000 7f308f47d700 1 -- start start 2023-10-03T10:18:43.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308f47d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f308809e930 0x7f3088135d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308f47d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f308809f240 0x7f3088136290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308f47d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f308809f650 0x7f30881367d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308f47d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308813ca00 con 0x7f308809f240 2023-10-03T10:18:43.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308f47d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3088071d20 con 0x7f308809f650 2023-10-03T10:18:43.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308f47d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3088137df0 con 0x7f308809e930 2023-10-03T10:18:43.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308d219700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f308809e930 0x7f3088135d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308d219700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f308809e930 0x7f3088135d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60614/0 (socket says 172.21.15.72:60614) 2023-10-03T10:18:43.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308d219700 1 -- 172.21.15.72:0/2542866495 learned_addr learned my addr 172.21.15.72:0/2542866495 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:43.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308ca18700 1 --2- 172.21.15.72:0/2542866495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f308809f240 0x7f3088136290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308da1a700 1 --2- 172.21.15.72:0/2542866495 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f308809f650 0x7f30881367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308ca18700 1 -- 172.21.15.72:0/2542866495 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f308809e930 msgr2=0x7f3088135d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308ca18700 1 --2- 172.21.15.72:0/2542866495 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f308809e930 0x7f3088135d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308ca18700 1 -- 172.21.15.72:0/2542866495 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f308809f650 msgr2=0x7f30881367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308ca18700 1 --2- 172.21.15.72:0/2542866495 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f308809f650 0x7f30881367d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308ca18700 1 -- 172.21.15.72:0/2542866495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3078009550 con 0x7f308809f240 2023-10-03T10:18:43.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.290+0000 7f308ca18700 1 --2- 172.21.15.72:0/2542866495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f308809f240 0x7f3088136290 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f3078016000 tx=0x7f3078004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.291+0000 7f307dffb700 1 -- 172.21.15.72:0/2542866495 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078004300 con 0x7f308809f240 2023-10-03T10:18:43.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.291+0000 7f307dffb700 1 -- 172.21.15.72:0/2542866495 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307801f070 con 0x7f308809f240 2023-10-03T10:18:43.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.291+0000 7f307dffb700 1 -- 172.21.15.72:0/2542866495 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30780036a0 con 0x7f308809f240 2023-10-03T10:18:43.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.291+0000 7f308f47d700 1 -- 172.21.15.72:0/2542866495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30880a0190 con 0x7f308809f240 2023-10-03T10:18:43.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.291+0000 7f308f47d700 1 -- 172.21.15.72:0/2542866495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3088137920 con 0x7f308809f240 2023-10-03T10:18:43.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.292+0000 7f307dffb700 1 -- 172.21.15.72:0/2542866495 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3078021030 con 0x7f308809f240 2023-10-03T10:18:43.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.293+0000 7f307dffb700 1 -- 172.21.15.72:0/2542866495 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f30780406e0 con 0x7f308809f240 2023-10-03T10:18:43.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.293+0000 7f308f47d700 1 -- 172.21.15.72:0/2542866495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30880a19d0 con 0x7f308809f240 2023-10-03T10:18:43.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.297+0000 7f307dffb700 1 -- 172.21.15.72:0/2542866495 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3078015020 con 0x7f308809f240 2023-10-03T10:18:43.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.374+0000 7f0872880700 1 -- 172.21.15.72:0/3324771336 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f086c074ea0 con 0x7f086c09d6f0 2023-10-03T10:18:43.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.375+0000 7f0868ff9700 1 -- 172.21.15.72:0/3324771336 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f085c024350 con 0x7f086c09d6f0 2023-10-03T10:18:43.375 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:43.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.378+0000 7f0872880700 1 -- 172.21.15.72:0/3324771336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f086c09d6f0 msgr2=0x7f086c122540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.378+0000 7f0872880700 1 --2- 172.21.15.72:0/3324771336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f086c09d6f0 0x7f086c122540 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f085c00ebe0 tx=0x7f085c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.378+0000 7f0872880700 1 -- 172.21.15.72:0/3324771336 shutdown_connections 2023-10-03T10:18:43.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.378+0000 7f0872880700 1 --2- 172.21.15.72:0/3324771336 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f086c09d6f0 0x7f086c122540 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.378+0000 7f0872880700 1 --2- 172.21.15.72:0/3324771336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f086c09e410 0x7f086c122fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.378+0000 7f0872880700 1 --2- 172.21.15.72:0/3324771336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f086c09e000 0x7f086c122a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.378+0000 7f0872880700 1 -- 172.21.15.72:0/3324771336 >> 172.21.15.72:0/3324771336 conn(0x7f086c066f50 msgr2=0x7f086c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.378+0000 7f0872880700 1 -- 172.21.15.72:0/3324771336 shutdown_connections 2023-10-03T10:18:43.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.378+0000 7f0872880700 1 -- 172.21.15.72:0/3324771336 wait complete. 2023-10-03T10:18:43.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:43.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.431+0000 7f5202e92700 1 -- 172.21.15.72:0/3253810547 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f51fc121c50 con 0x7f51fc136fe0 2023-10-03T10:18:43.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.431+0000 7f51f97fa700 1 -- 172.21.15.72:0/3253810547 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f51fc121c50 con 0x7f51fc136fe0 2023-10-03T10:18:43.432 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.433+0000 7f5202e92700 1 -- 172.21.15.72:0/3253810547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc136fe0 msgr2=0x7f51fc11f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.433+0000 7f5202e92700 1 --2- 172.21.15.72:0/3253810547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc136fe0 0x7f51fc11f1f0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f51fc06fea0 tx=0x7f51f4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.433+0000 7f5202e92700 1 -- 172.21.15.72:0/3253810547 shutdown_connections 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.433+0000 7f5202e92700 1 --2- 172.21.15.72:0/3253810547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51fc136fe0 0x7f51fc11f1f0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.433+0000 7f5202e92700 1 --2- 172.21.15.72:0/3253810547 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51fc09e930 0x7f51fc11e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.433+0000 7f5202e92700 1 --2- 172.21.15.72:0/3253810547 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51fc09f410 0x7f51fc11ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.433+0000 7f5202e92700 1 -- 172.21.15.72:0/3253810547 >> 172.21.15.72:0/3253810547 conn(0x7f51fc0a4210 msgr2=0x7f51fc134900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.433+0000 7f5202e92700 1 -- 172.21.15.72:0/3253810547 shutdown_connections 2023-10-03T10:18:43.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.433+0000 7f5202e92700 1 -- 172.21.15.72:0/3253810547 wait complete. 2023-10-03T10:18:43.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:43.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.465+0000 7f21474b8700 1 -- 172.21.15.72:0/2087418459 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2140128310 con 0x7f214006a770 2023-10-03T10:18:43.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.465+0000 7f2135ffb700 1 -- 172.21.15.72:0/2087418459 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2140128310 con 0x7f214006a770 2023-10-03T10:18:43.466 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:43.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.467+0000 7f21474b8700 1 -- 172.21.15.72:0/2087418459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f214006a770 msgr2=0x7f21401260a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.467+0000 7f21474b8700 1 --2- 172.21.15.72:0/2087418459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f214006a770 0x7f21401260a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c4e0 tx=0x7f213c00c8a0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.467+0000 7f21474b8700 1 -- 172.21.15.72:0/2087418459 shutdown_connections 2023-10-03T10:18:43.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.467+0000 7f21474b8700 1 --2- 172.21.15.72:0/2087418459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f214013d1f0 0x7f2140126b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.467+0000 7f21474b8700 1 --2- 172.21.15.72:0/2087418459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f214006a770 0x7f21401260a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.467+0000 7f21474b8700 1 --2- 172.21.15.72:0/2087418459 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f214009de00 0x7f21401265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.467+0000 7f21474b8700 1 -- 172.21.15.72:0/2087418459 >> 172.21.15.72:0/2087418459 conn(0x7f2140066f50 msgr2=0x7f21400a1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.467+0000 7f21474b8700 1 -- 172.21.15.72:0/2087418459 shutdown_connections 2023-10-03T10:18:43.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.467+0000 7f21474b8700 1 -- 172.21.15.72:0/2087418459 wait complete. 2023-10-03T10:18:43.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:43.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.490+0000 7f308f47d700 1 -- 172.21.15.72:0/2542866495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3088074ea0 con 0x7f308809f240 2023-10-03T10:18:43.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.490+0000 7f307dffb700 1 -- 172.21.15.72:0/2542866495 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30780239c0 con 0x7f308809f240 2023-10-03T10:18:43.491 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.492+0000 7f308f47d700 1 -- 172.21.15.72:0/2542866495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f308809f240 msgr2=0x7f3088136290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.492+0000 7f308f47d700 1 --2- 172.21.15.72:0/2542866495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f308809f240 0x7f3088136290 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f3078016000 tx=0x7f3078004750 comp rx=0 tx=0).stop 2023-10-03T10:18:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.492+0000 7f308f47d700 1 -- 172.21.15.72:0/2542866495 shutdown_connections 2023-10-03T10:18:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.492+0000 7f308f47d700 1 --2- 172.21.15.72:0/2542866495 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f308809f650 0x7f30881367d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.492+0000 7f308f47d700 1 --2- 172.21.15.72:0/2542866495 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f308809e930 0x7f3088135d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.492+0000 7f308f47d700 1 --2- 172.21.15.72:0/2542866495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f308809f240 0x7f3088136290 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.492+0000 7f308f47d700 1 -- 172.21.15.72:0/2542866495 >> 172.21.15.72:0/2542866495 conn(0x7f30880a4210 msgr2=0x7f3088131050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.492+0000 7f308f47d700 1 -- 172.21.15.72:0/2542866495 shutdown_connections 2023-10-03T10:18:43.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:43.492+0000 7f308f47d700 1 -- 172.21.15.72:0/2542866495 wait complete. 2023-10-03T10:18:43.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:44.391 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:44.447 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:44.480 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:44.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:44.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.530+0000 7f050ee4c700 1 Processor -- start 2023-10-03T10:18:44.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.530+0000 7f050ee4c700 1 -- start start 2023-10-03T10:18:44.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.530+0000 7f050ee4c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f050809d6f0 0x7f050809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.530+0000 7f050ee4c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050809e410 0x7f0508134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.530+0000 7f050ee4c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050809b120 con 0x7f050809e000 2023-10-03T10:18:44.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.530+0000 7f050ee4c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050806b460 con 0x7f050809e410 2023-10-03T10:18:44.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.530+0000 7f050ee4c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f050809a7e0 con 0x7f050809d6f0 2023-10-03T10:18:44.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.530+0000 7f050cbe8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f050809d6f0 0x7f050809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.530+0000 7f0507fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f050809e000 0x7f05081339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53202/0 (socket says 172.21.15.72:53202) 2023-10-03T10:18:44.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.531+0000 7f0507fff700 1 -- 172.21.15.72:0/1050903058 learned_addr learned my addr 172.21.15.72:0/1050903058 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:44.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.531+0000 7f050d3e9700 1 --2- 172.21.15.72:0/1050903058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050809e410 0x7f0508134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.531+0000 7f05077fe700 1 -- 172.21.15.72:0/1050903058 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40595446 0 0) 0x7f050809b120 con 0x7f050809e000 2023-10-03T10:18:44.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.531+0000 7f05077fe700 1 -- 172.21.15.72:0/1050903058 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f80035b0 con 0x7f050809e000 2023-10-03T10:18:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.531+0000 7f050cbe8700 1 -- 172.21.15.72:0/1050903058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050809e410 msgr2=0x7f0508134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.531+0000 7f050cbe8700 1 --2- 172.21.15.72:0/1050903058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050809e410 0x7f0508134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.531+0000 7f050cbe8700 1 -- 172.21.15.72:0/1050903058 >> v1:172.21.15.72:6789/0 conn(0x7f050809e000 legacy=0x7f05081339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.531+0000 7f050cbe8700 1 -- 172.21.15.72:0/1050903058 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050809a500 con 0x7f050809d6f0 2023-10-03T10:18:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.531+0000 7f050d3e9700 1 --2- 172.21.15.72:0/1050903058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050809e410 0x7f0508134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.531+0000 7f050cbe8700 1 --2- 172.21.15.72:0/1050903058 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f050809d6f0 0x7f050809dac0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0098a0 tx=0x7f04fc009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d3210c68f1014b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.531+0000 7f05077fe700 1 -- 172.21.15.72:0/1050903058 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc011830 con 0x7f050809d6f0 2023-10-03T10:18:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.531+0000 7f05077fe700 1 -- 172.21.15.72:0/1050903058 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc011990 con 0x7f050809d6f0 2023-10-03T10:18:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.531+0000 7f05077fe700 1 -- 172.21.15.72:0/1050903058 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc011d20 con 0x7f050809d6f0 2023-10-03T10:18:44.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.532+0000 7f050ee4c700 1 -- 172.21.15.72:0/1050903058 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f050809d6f0 msgr2=0x7f050809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.532+0000 7f050ee4c700 1 --2- 172.21.15.72:0/1050903058 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f050809d6f0 0x7f050809dac0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0098a0 tx=0x7f04fc009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.532+0000 7f050ee4c700 1 -- 172.21.15.72:0/1050903058 shutdown_connections 2023-10-03T10:18:44.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.532+0000 7f050ee4c700 1 --2- 172.21.15.72:0/1050903058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050809e410 0x7f0508134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.532+0000 7f050ee4c700 1 --2- 172.21.15.72:0/1050903058 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f050809d6f0 0x7f050809dac0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.532+0000 7f050ee4c700 1 -- 172.21.15.72:0/1050903058 >> 172.21.15.72:0/1050903058 conn(0x7f0508066f50 msgr2=0x7f050809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.532+0000 7f050ee4c700 1 -- 172.21.15.72:0/1050903058 shutdown_connections 2023-10-03T10:18:44.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.532+0000 7f050ee4c700 1 -- 172.21.15.72:0/1050903058 wait complete. 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.534+0000 7f050ee4c700 1 Processor -- start 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.534+0000 7f050ee4c700 1 -- start start 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.534+0000 7f050ee4c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f050809d6f0 0x7f0508122260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.534+0000 7f050ee4c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050809e000 0x7f05081227a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.534+0000 7f050ee4c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050809e410 0x7f0508122ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.534+0000 7f050ee4c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0508125850 con 0x7f050809e000 2023-10-03T10:18:44.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.534+0000 7f050ee4c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0508125b40 con 0x7f050809e410 2023-10-03T10:18:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.534+0000 7f050ee4c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0508123e70 con 0x7f050809d6f0 2023-10-03T10:18:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.535+0000 7f050cbe8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f050809d6f0 0x7f0508122260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.535+0000 7f050cbe8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f050809d6f0 0x7f0508122260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60638/0 (socket says 172.21.15.72:60638) 2023-10-03T10:18:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.535+0000 7f050cbe8700 1 -- 172.21.15.72:0/2105028698 learned_addr learned my addr 172.21.15.72:0/2105028698 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.535+0000 7f0507fff700 1 --2- 172.21.15.72:0/2105028698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050809e000 0x7f05081227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.535+0000 7f050cbe8700 1 -- 172.21.15.72:0/2105028698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050809e410 msgr2=0x7f0508122ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.535+0000 7f050cbe8700 1 --2- 172.21.15.72:0/2105028698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050809e410 0x7f0508122ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.535+0000 7f050cbe8700 1 -- 172.21.15.72:0/2105028698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050809e000 msgr2=0x7f05081227a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.535+0000 7f050cbe8700 1 --2- 172.21.15.72:0/2105028698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050809e000 0x7f05081227a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.535+0000 7f050cbe8700 1 -- 172.21.15.72:0/2105028698 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0500009a70 con 0x7f050809d6f0 2023-10-03T10:18:44.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.535+0000 7f0507fff700 1 --2- 172.21.15.72:0/2105028698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050809e000 0x7f05081227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.535+0000 7f050cbe8700 1 --2- 172.21.15.72:0/2105028698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f050809d6f0 0x7f0508122260 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f04fc000c00 tx=0x7f04fc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.535+0000 7f05057fa700 1 -- 172.21.15.72:0/2105028698 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc004450 con 0x7f050809d6f0 2023-10-03T10:18:44.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.535+0000 7f05057fa700 1 -- 172.21.15.72:0/2105028698 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc01f070 con 0x7f050809d6f0 2023-10-03T10:18:44.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.536+0000 7f05057fa700 1 -- 172.21.15.72:0/2105028698 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc0038c0 con 0x7f050809d6f0 2023-10-03T10:18:44.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.536+0000 7f050ee4c700 1 -- 172.21.15.72:0/2105028698 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04fc0094a0 con 0x7f050809d6f0 2023-10-03T10:18:44.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.536+0000 7f050ee4c700 1 -- 172.21.15.72:0/2105028698 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05080a1930 con 0x7f050809d6f0 2023-10-03T10:18:44.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.537+0000 7f050ee4c700 1 -- 172.21.15.72:0/2105028698 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050811f030 con 0x7f050809d6f0 2023-10-03T10:18:44.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.537+0000 7f05057fa700 1 -- 172.21.15.72:0/2105028698 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f04fc003a20 con 0x7f050809d6f0 2023-10-03T10:18:44.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.537+0000 7f05057fa700 1 -- 172.21.15.72:0/2105028698 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f04fc021070 con 0x7f050809d6f0 2023-10-03T10:18:44.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.543+0000 7f05057fa700 1 -- 172.21.15.72:0/2105028698 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f04fc0045b0 con 0x7f050809d6f0 2023-10-03T10:18:44.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.580+0000 7f3b9a912700 1 Processor -- start 2023-10-03T10:18:44.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.580+0000 7f3b9a912700 1 -- start start 2023-10-03T10:18:44.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.581+0000 7f3b9a912700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9409d6f0 0x7f3b9409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.581+0000 7f3b9a912700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b9409e410 0x7f3b94134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.581+0000 7f3b9a912700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9409b120 con 0x7f3b9409e000 2023-10-03T10:18:44.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.581+0000 7f3b9a912700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9406b460 con 0x7f3b9409d6f0 2023-10-03T10:18:44.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.581+0000 7f3b9a912700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9409a7e0 con 0x7f3b9409e410 2023-10-03T10:18:44.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.581+0000 7f3b93fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9409d6f0 0x7f3b9409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.581+0000 7f3b937fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3b9409e000 0x7f3b941339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53214/0 (socket says 172.21.15.72:53214) 2023-10-03T10:18:44.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.581+0000 7f3b937fe700 1 -- 172.21.15.72:0/1955010533 learned_addr learned my addr 172.21.15.72:0/1955010533 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:44.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.581+0000 7f3b98eaf700 1 --2- 172.21.15.72:0/1955010533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b9409e410 0x7f3b94134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.582+0000 7f3b93fff700 1 -- 172.21.15.72:0/1955010533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b9409e410 msgr2=0x7f3b94134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.582+0000 7f3b93fff700 1 --2- 172.21.15.72:0/1955010533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b9409e410 0x7f3b94134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.582+0000 7f3b93fff700 1 -- 172.21.15.72:0/1955010533 >> v1:172.21.15.72:6789/0 conn(0x7f3b9409e000 legacy=0x7f3b941339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.582+0000 7f3b93fff700 1 -- 172.21.15.72:0/1955010533 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9409a500 con 0x7f3b9409d6f0 2023-10-03T10:18:44.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.582+0000 7f3b93fff700 1 --2- 172.21.15.72:0/1955010533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9409d6f0 0x7f3b9409dac0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009870 tx=0x7f3b84009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5ba18c6c27bc61f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.582+0000 7f3b92ffd700 1 -- 172.21.15.72:0/1955010533 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84011830 con 0x7f3b9409d6f0 2023-10-03T10:18:44.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.582+0000 7f3b92ffd700 1 -- 172.21.15.72:0/1955010533 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b84011990 con 0x7f3b9409d6f0 2023-10-03T10:18:44.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.582+0000 7f3b92ffd700 1 -- 172.21.15.72:0/1955010533 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84011d20 con 0x7f3b9409d6f0 2023-10-03T10:18:44.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.583+0000 7f3b9a912700 1 -- 172.21.15.72:0/1955010533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9409d6f0 msgr2=0x7f3b9409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.583+0000 7f3b9a912700 1 --2- 172.21.15.72:0/1955010533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9409d6f0 0x7f3b9409dac0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009870 tx=0x7f3b84009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:44.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.583+0000 7f3b9a912700 1 -- 172.21.15.72:0/1955010533 shutdown_connections 2023-10-03T10:18:44.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.583+0000 7f3b9a912700 1 --2- 172.21.15.72:0/1955010533 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b9409e410 0x7f3b94134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.583+0000 7f3b9a912700 1 --2- 172.21.15.72:0/1955010533 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9409d6f0 0x7f3b9409dac0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.583+0000 7f3b9a912700 1 -- 172.21.15.72:0/1955010533 >> 172.21.15.72:0/1955010533 conn(0x7f3b94066f50 msgr2=0x7f3b9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.583+0000 7f3b9a912700 1 -- 172.21.15.72:0/1955010533 shutdown_connections 2023-10-03T10:18:44.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.583+0000 7f3b9a912700 1 -- 172.21.15.72:0/1955010533 wait complete. 2023-10-03T10:18:44.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.584+0000 7f3b9a912700 1 Processor -- start 2023-10-03T10:18:44.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.585+0000 7f3b9a912700 1 -- start start 2023-10-03T10:18:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.585+0000 7f3b9a912700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b9409d6f0 0x7f3b941a5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.585+0000 7f3b9a912700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b9409e000 0x7f3b941a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.585+0000 7f3b9a912700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9409e410 0x7f3b941a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.585+0000 7f3b9a912700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b941a7440 con 0x7f3b9409e000 2023-10-03T10:18:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.585+0000 7f3b9a912700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b941a7b10 con 0x7f3b9409e410 2023-10-03T10:18:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.585+0000 7f3b9a912700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b941a8130 con 0x7f3b9409d6f0 2023-10-03T10:18:44.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.586+0000 7f3b937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b9409e000 0x7f3b941a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.586+0000 7f3b937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b9409e000 0x7f3b941a64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40800/0 (socket says 172.21.15.72:40800) 2023-10-03T10:18:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.586+0000 7f3b937fe700 1 -- 172.21.15.72:0/222638501 learned_addr learned my addr 172.21.15.72:0/222638501 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.586+0000 7f3b93fff700 1 --2- 172.21.15.72:0/222638501 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b9409d6f0 0x7f3b941a5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.586+0000 7f3b98eaf700 1 --2- 172.21.15.72:0/222638501 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9409e410 0x7f3b941a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.586+0000 7f3b93fff700 1 -- 172.21.15.72:0/222638501 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9409e410 msgr2=0x7f3b941a6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.586+0000 7f3b93fff700 1 --2- 172.21.15.72:0/222638501 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9409e410 0x7f3b941a6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.586+0000 7f3b93fff700 1 -- 172.21.15.72:0/222638501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b9409e000 msgr2=0x7f3b941a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.586+0000 7f3b93fff700 1 --2- 172.21.15.72:0/222638501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b9409e000 0x7f3b941a64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.586+0000 7f3b93fff700 1 -- 172.21.15.72:0/222638501 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b840094a0 con 0x7f3b9409d6f0 2023-10-03T10:18:44.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.586+0000 7f3b93fff700 1 --2- 172.21.15.72:0/222638501 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b9409d6f0 0x7f3b941a5f90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009870 tx=0x7f3b84004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.586+0000 7f3b90ff9700 1 -- 172.21.15.72:0/222638501 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8401a6d0 con 0x7f3b9409d6f0 2023-10-03T10:18:44.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.586+0000 7f3b9a912700 1 -- 172.21.15.72:0/222638501 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b941a9740 con 0x7f3b9409d6f0 2023-10-03T10:18:44.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.586+0000 7f3b90ff9700 1 -- 172.21.15.72:0/222638501 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8401a830 con 0x7f3b9409d6f0 2023-10-03T10:18:44.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.586+0000 7f3b90ff9700 1 -- 172.21.15.72:0/222638501 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8401abc0 con 0x7f3b9409d6f0 2023-10-03T10:18:44.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.587+0000 7f3b9a912700 1 -- 172.21.15.72:0/222638501 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b941a9200 con 0x7f3b9409d6f0 2023-10-03T10:18:44.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.587+0000 7f3b90ff9700 1 -- 172.21.15.72:0/222638501 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b84022070 con 0x7f3b9409d6f0 2023-10-03T10:18:44.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.587+0000 7f3b90ff9700 1 -- 172.21.15.72:0/222638501 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3b84040470 con 0x7f3b9409d6f0 2023-10-03T10:18:44.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.588+0000 7f3b9a912700 1 -- 172.21.15.72:0/222638501 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9409c770 con 0x7f3b9409d6f0 2023-10-03T10:18:44.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.596+0000 7f3b90ff9700 1 -- 172.21.15.72:0/222638501 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b84015080 con 0x7f3b9409d6f0 2023-10-03T10:18:44.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.626+0000 7f62ebf3f700 1 Processor -- start 2023-10-03T10:18:44.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.626+0000 7f62ebf3f700 1 -- start start 2023-10-03T10:18:44.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62ebf3f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f62e409e1d0 0x7f62e4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62ebf3f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62e4139170 0x7f62e413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62ebf3f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e409b120 con 0x7f62e409d6f0 2023-10-03T10:18:44.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62ebf3f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e406b460 con 0x7f62e409e1d0 2023-10-03T10:18:44.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62ebf3f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62e409a7e0 con 0x7f62e4139170 2023-10-03T10:18:44.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62e9cdb700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f62e409d6f0 0x7f62e409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53220/0 (socket says 172.21.15.72:53220) 2023-10-03T10:18:44.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62e9cdb700 1 -- 172.21.15.72:0/1940277904 learned_addr learned my addr 172.21.15.72:0/1940277904 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:44.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62e94da700 1 --2- 172.21.15.72:0/1940277904 >> v2:172.21.15.72:3300/0 conn(0x7f62e409e1d0 0x7f62e4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62e94da700 1 -- 172.21.15.72:0/1940277904 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62e4139170 msgr2=0x7f62e413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62e94da700 1 --2- 172.21.15.72:0/1940277904 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62e4139170 0x7f62e413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62e94da700 1 -- 172.21.15.72:0/1940277904 >> v1:172.21.15.72:6789/0 conn(0x7f62e409d6f0 legacy=0x7f62e409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62e94da700 1 -- 172.21.15.72:0/1940277904 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e409a500 con 0x7f62e409e1d0 2023-10-03T10:18:44.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62e94da700 1 --2- 172.21.15.72:0/1940277904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e409e1d0 0x7f62e4138c30 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009870 tx=0x7f62d4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31551524cc6ac199 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62e8cd9700 1 -- 172.21.15.72:0/1940277904 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d4011830 con 0x7f62e409e1d0 2023-10-03T10:18:44.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62e8cd9700 1 -- 172.21.15.72:0/1940277904 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d4011990 con 0x7f62e409e1d0 2023-10-03T10:18:44.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.627+0000 7f62e8cd9700 1 -- 172.21.15.72:0/1940277904 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d4011d20 con 0x7f62e409e1d0 2023-10-03T10:18:44.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.628+0000 7f62ebf3f700 1 -- 172.21.15.72:0/1940277904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e409e1d0 msgr2=0x7f62e4138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.628+0000 7f62ebf3f700 1 --2- 172.21.15.72:0/1940277904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e409e1d0 0x7f62e4138c30 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009870 tx=0x7f62d4009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:44.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.628+0000 7f62ebf3f700 1 -- 172.21.15.72:0/1940277904 shutdown_connections 2023-10-03T10:18:44.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.628+0000 7f62ebf3f700 1 --2- 172.21.15.72:0/1940277904 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62e4139170 0x7f62e413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.628+0000 7f62ebf3f700 1 --2- 172.21.15.72:0/1940277904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e409e1d0 0x7f62e4138c30 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.628+0000 7f62ebf3f700 1 -- 172.21.15.72:0/1940277904 >> 172.21.15.72:0/1940277904 conn(0x7f62e4066f50 msgr2=0x7f62e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.628+0000 7f62ebf3f700 1 -- 172.21.15.72:0/1940277904 shutdown_connections 2023-10-03T10:18:44.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.628+0000 7f62ebf3f700 1 -- 172.21.15.72:0/1940277904 wait complete. 2023-10-03T10:18:44.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.629+0000 7f62ebf3f700 1 Processor -- start 2023-10-03T10:18:44.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.630+0000 7f62ebf3f700 1 -- start start 2023-10-03T10:18:44.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.630+0000 7f62ebf3f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62e409d6f0 0x7f62e411f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.630+0000 7f62ebf3f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62e409e1d0 0x7f62e411fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.630+0000 7f62ebf3f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e4139170 0x7f62e41c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.630+0000 7f62ebf3f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e411ef30 con 0x7f62e4139170 2023-10-03T10:18:44.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.630+0000 7f62ebf3f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40721e0 con 0x7f62e409d6f0 2023-10-03T10:18:44.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.630+0000 7f62ebf3f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62e409c710 con 0x7f62e409e1d0 2023-10-03T10:18:44.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.630+0000 7f62ea4dc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e4139170 0x7f62e41c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.630+0000 7f62ea4dc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e4139170 0x7f62e41c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40810/0 (socket says 172.21.15.72:40810) 2023-10-03T10:18:44.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.630+0000 7f62ea4dc700 1 -- 172.21.15.72:0/523493223 learned_addr learned my addr 172.21.15.72:0/523493223 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:44.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.630+0000 7f62e94da700 1 --2- 172.21.15.72:0/523493223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62e409e1d0 0x7f62e411fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.631+0000 7f62e94da700 1 -- 172.21.15.72:0/523493223 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62e409d6f0 msgr2=0x7f62e411f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.631+0000 7f62e94da700 1 --2- 172.21.15.72:0/523493223 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62e409d6f0 0x7f62e411f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.631+0000 7f62e94da700 1 -- 172.21.15.72:0/523493223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e4139170 msgr2=0x7f62e41c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.631+0000 7f62e94da700 1 --2- 172.21.15.72:0/523493223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e4139170 0x7f62e41c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.631+0000 7f62e94da700 1 -- 172.21.15.72:0/523493223 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d40094a0 con 0x7f62e409e1d0 2023-10-03T10:18:44.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.631+0000 7f62e94da700 1 --2- 172.21.15.72:0/523493223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62e409e1d0 0x7f62e411fac0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f62d4016000 tx=0x7f62d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.631+0000 7f62da7fc700 1 -- 172.21.15.72:0/523493223 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d40036a0 con 0x7f62e409e1d0 2023-10-03T10:18:44.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.631+0000 7f62da7fc700 1 -- 172.21.15.72:0/523493223 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d401f070 con 0x7f62e409e1d0 2023-10-03T10:18:44.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.631+0000 7f62da7fc700 1 -- 172.21.15.72:0/523493223 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d4003a40 con 0x7f62e409e1d0 2023-10-03T10:18:44.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.631+0000 7f62ebf3f700 1 -- 172.21.15.72:0/523493223 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e4121f80 con 0x7f62e409e1d0 2023-10-03T10:18:44.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.631+0000 7f62ebf3f700 1 -- 172.21.15.72:0/523493223 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e4121280 con 0x7f62e409e1d0 2023-10-03T10:18:44.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.632+0000 7f62ebf3f700 1 -- 172.21.15.72:0/523493223 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e4074ea0 con 0x7f62e409e1d0 2023-10-03T10:18:44.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.632+0000 7f62da7fc700 1 -- 172.21.15.72:0/523493223 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62d4003ba0 con 0x7f62e409e1d0 2023-10-03T10:18:44.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.633+0000 7f62da7fc700 1 -- 172.21.15.72:0/523493223 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f62d4021070 con 0x7f62e409e1d0 2023-10-03T10:18:44.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.637+0000 7f62da7fc700 1 -- 172.21.15.72:0/523493223 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62d402f3a0 con 0x7f62e409e1d0 2023-10-03T10:18:44.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.704+0000 7f048d0c6700 1 Processor -- start 2023-10-03T10:18:44.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.704+0000 7f048d0c6700 1 -- start start 2023-10-03T10:18:44.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.705+0000 7f048d0c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f048809d6f0 0x7f048809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.705+0000 7f048d0c6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f048809e000 0x7f0488130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.705+0000 7f048d0c6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048809f130 con 0x7f048809e410 2023-10-03T10:18:44.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.705+0000 7f048d0c6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f048809f520 con 0x7f048809e000 2023-10-03T10:18:44.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.705+0000 7f048d0c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048809e930 con 0x7f048809d6f0 2023-10-03T10:18:44.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.705+0000 7f0486d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f048809d6f0 0x7f048809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.705+0000 7f0486d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f048809d6f0 0x7f048809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34448/0 (socket says 172.21.15.72:34448) 2023-10-03T10:18:44.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.705+0000 7f047ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f048809e000 0x7f0488130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.705+0000 7f0486d9d700 1 -- 172.21.15.72:0/3971005948 learned_addr learned my addr 172.21.15.72:0/3971005948 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:44.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.706+0000 7f0486d9d700 1 -- 172.21.15.72:0/3971005948 >> v2:172.21.15.72:3300/0 conn(0x7f048809e000 msgr2=0x7f0488130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.706+0000 7f0486d9d700 1 --2- 172.21.15.72:0/3971005948 >> v2:172.21.15.72:3300/0 conn(0x7f048809e000 0x7f0488130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.706+0000 7f0486d9d700 1 -- 172.21.15.72:0/3971005948 >> v1:172.21.15.72:6789/0 conn(0x7f048809e410 legacy=0x7f0488130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.706+0000 7f0486d9d700 1 -- 172.21.15.72:0/3971005948 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048809b2d0 con 0x7f048809d6f0 2023-10-03T10:18:44.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.706+0000 7f0486d9d700 1 --2- 172.21.15.72:0/3971005948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f048809d6f0 0x7f048809dac0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f04780098f0 tx=0x7f0478009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3326de3bad286f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.706+0000 7f048659c700 1 -- 172.21.15.72:0/3971005948 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478011830 con 0x7f048809d6f0 2023-10-03T10:18:44.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.706+0000 7f048659c700 1 -- 172.21.15.72:0/3971005948 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0478011990 con 0x7f048809d6f0 2023-10-03T10:18:44.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.706+0000 7f048659c700 1 -- 172.21.15.72:0/3971005948 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478011d20 con 0x7f048809d6f0 2023-10-03T10:18:44.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.707+0000 7f048d0c6700 1 -- 172.21.15.72:0/3971005948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f048809d6f0 msgr2=0x7f048809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.707+0000 7f048d0c6700 1 --2- 172.21.15.72:0/3971005948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f048809d6f0 0x7f048809dac0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f04780098f0 tx=0x7f0478009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:44.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.707+0000 7f048d0c6700 1 -- 172.21.15.72:0/3971005948 shutdown_connections 2023-10-03T10:18:44.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.707+0000 7f048d0c6700 1 --2- 172.21.15.72:0/3971005948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f048809d6f0 0x7f048809dac0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.707+0000 7f048d0c6700 1 --2- 172.21.15.72:0/3971005948 >> v2:172.21.15.72:3300/0 conn(0x7f048809e000 0x7f0488130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.707+0000 7f048d0c6700 1 -- 172.21.15.72:0/3971005948 >> 172.21.15.72:0/3971005948 conn(0x7f0488066f50 msgr2=0x7f048809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.707+0000 7f048d0c6700 1 -- 172.21.15.72:0/3971005948 shutdown_connections 2023-10-03T10:18:44.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.707+0000 7f048d0c6700 1 -- 172.21.15.72:0/3971005948 wait complete. 2023-10-03T10:18:44.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.709+0000 7f048d0c6700 1 Processor -- start 2023-10-03T10:18:44.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.709+0000 7f048d0c6700 1 -- start start 2023-10-03T10:18:44.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.709+0000 7f048d0c6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f048809d6f0 0x7f04881c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f048d0c6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048809e000 0x7f04881c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f048d0c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f048809e410 0x7f04881c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f048d0c6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0488125ef0 con 0x7f048809e000 2023-10-03T10:18:44.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f048d0c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0488121000 con 0x7f048809e410 2023-10-03T10:18:44.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f048d0c6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f048806ea60 con 0x7f048809d6f0 2023-10-03T10:18:44.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f0486d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f048809d6f0 0x7f04881c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f0486d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f048809d6f0 0x7f04881c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60684/0 (socket says 172.21.15.72:60684) 2023-10-03T10:18:44.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f0486d9d700 1 -- 172.21.15.72:0/298449345 learned_addr learned my addr 172.21.15.72:0/298449345 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:44.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f048759e700 1 --2- 172.21.15.72:0/298449345 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f048809e410 0x7f04881c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f047ffff700 1 --2- 172.21.15.72:0/298449345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048809e000 0x7f04881c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f0486d9d700 1 -- 172.21.15.72:0/298449345 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f048809e410 msgr2=0x7f04881c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f0486d9d700 1 --2- 172.21.15.72:0/298449345 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f048809e410 0x7f04881c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f0486d9d700 1 -- 172.21.15.72:0/298449345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048809e000 msgr2=0x7f04881c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f0486d9d700 1 --2- 172.21.15.72:0/298449345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048809e000 0x7f04881c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f0486d9d700 1 -- 172.21.15.72:0/298449345 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0478009550 con 0x7f048809d6f0 2023-10-03T10:18:44.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f0486d9d700 1 --2- 172.21.15.72:0/298449345 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f048809d6f0 0x7f04881c84a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0478009c40 tx=0x7f0478004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f047f7fe700 1 -- 172.21.15.72:0/298449345 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478004510 con 0x7f048809d6f0 2023-10-03T10:18:44.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f047f7fe700 1 -- 172.21.15.72:0/298449345 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047801e070 con 0x7f048809d6f0 2023-10-03T10:18:44.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.710+0000 7f048d0c6700 1 -- 172.21.15.72:0/298449345 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048809c700 con 0x7f048809d6f0 2023-10-03T10:18:44.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.711+0000 7f047f7fe700 1 -- 172.21.15.72:0/298449345 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04780038e0 con 0x7f048809d6f0 2023-10-03T10:18:44.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.711+0000 7f048d0c6700 1 -- 172.21.15.72:0/298449345 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048806a9e0 con 0x7f048809d6f0 2023-10-03T10:18:44.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.712+0000 7f047f7fe700 1 -- 172.21.15.72:0/298449345 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0478003a40 con 0x7f048809d6f0 2023-10-03T10:18:44.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.712+0000 7f048d0c6700 1 -- 172.21.15.72:0/298449345 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0488074ea0 con 0x7f048809d6f0 2023-10-03T10:18:44.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.712+0000 7f047f7fe700 1 -- 172.21.15.72:0/298449345 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0478010740 con 0x7f048809d6f0 2023-10-03T10:18:44.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.717+0000 7f047f7fe700 1 -- 172.21.15.72:0/298449345 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0478045060 con 0x7f048809d6f0 2023-10-03T10:18:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.766+0000 7f050ee4c700 1 -- 172.21.15.72:0/2105028698 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f050809c710 con 0x7f050809d6f0 2023-10-03T10:18:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.766+0000 7f05057fa700 1 -- 172.21.15.72:0/2105028698 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f04fc015030 con 0x7f050809d6f0 2023-10-03T10:18:44.767 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.769+0000 7f050ee4c700 1 -- 172.21.15.72:0/2105028698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f050809d6f0 msgr2=0x7f0508122260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.769+0000 7f050ee4c700 1 --2- 172.21.15.72:0/2105028698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f050809d6f0 0x7f0508122260 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f04fc000c00 tx=0x7f04fc004750 comp rx=0 tx=0).stop 2023-10-03T10:18:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.769+0000 7f050ee4c700 1 -- 172.21.15.72:0/2105028698 shutdown_connections 2023-10-03T10:18:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.769+0000 7f050ee4c700 1 --2- 172.21.15.72:0/2105028698 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050809e410 0x7f0508122ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.770+0000 7f050ee4c700 1 --2- 172.21.15.72:0/2105028698 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f050809d6f0 0x7f0508122260 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.770+0000 7f050ee4c700 1 --2- 172.21.15.72:0/2105028698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f050809e000 0x7f05081227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.770+0000 7f050ee4c700 1 -- 172.21.15.72:0/2105028698 >> 172.21.15.72:0/2105028698 conn(0x7f0508066f50 msgr2=0x7f0508133e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.771+0000 7f050ee4c700 1 -- 172.21.15.72:0/2105028698 shutdown_connections 2023-10-03T10:18:44.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.771+0000 7f050ee4c700 1 -- 172.21.15.72:0/2105028698 wait complete. 2023-10-03T10:18:44.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:44.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.843+0000 7f62ebf3f700 1 -- 172.21.15.72:0/523493223 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f62e409f420 con 0x7f62e409e1d0 2023-10-03T10:18:44.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.843+0000 7f62da7fc700 1 -- 172.21.15.72:0/523493223 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62d402b070 con 0x7f62e409e1d0 2023-10-03T10:18:44.844 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.845+0000 7f62ebf3f700 1 -- 172.21.15.72:0/523493223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62e409e1d0 msgr2=0x7f62e411fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.845+0000 7f62ebf3f700 1 --2- 172.21.15.72:0/523493223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62e409e1d0 0x7f62e411fac0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f62d4016000 tx=0x7f62d4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.845+0000 7f62ebf3f700 1 -- 172.21.15.72:0/523493223 shutdown_connections 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.845+0000 7f62ebf3f700 1 --2- 172.21.15.72:0/523493223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62e4139170 0x7f62e41c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.845+0000 7f62ebf3f700 1 --2- 172.21.15.72:0/523493223 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62e409d6f0 0x7f62e411f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.845+0000 7f62ebf3f700 1 --2- 172.21.15.72:0/523493223 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f62e409e1d0 0x7f62e411fac0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.845+0000 7f62ebf3f700 1 -- 172.21.15.72:0/523493223 >> 172.21.15.72:0/523493223 conn(0x7f62e4066f50 msgr2=0x7f62e4136c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.845+0000 7f62ebf3f700 1 -- 172.21.15.72:0/523493223 shutdown_connections 2023-10-03T10:18:44.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.845+0000 7f62ebf3f700 1 -- 172.21.15.72:0/523493223 wait complete. 2023-10-03T10:18:44.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.846+0000 7f3b9a912700 1 -- 172.21.15.72:0/222638501 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3b941a8dc0 con 0x7f3b9409d6f0 2023-10-03T10:18:44.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.846+0000 7f3b90ff9700 1 -- 172.21.15.72:0/222638501 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3b84029030 con 0x7f3b9409d6f0 2023-10-03T10:18:44.847 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:44.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.848+0000 7f3b9a912700 1 -- 172.21.15.72:0/222638501 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b9409d6f0 msgr2=0x7f3b941a5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.848+0000 7f3b9a912700 1 --2- 172.21.15.72:0/222638501 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b9409d6f0 0x7f3b941a5f90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009870 tx=0x7f3b84004750 comp rx=0 tx=0).stop 2023-10-03T10:18:44.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.848+0000 7f3b9a912700 1 -- 172.21.15.72:0/222638501 shutdown_connections 2023-10-03T10:18:44.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.848+0000 7f3b9a912700 1 --2- 172.21.15.72:0/222638501 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9409e410 0x7f3b941a6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.848+0000 7f3b9a912700 1 --2- 172.21.15.72:0/222638501 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b9409d6f0 0x7f3b941a5f90 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.848+0000 7f3b9a912700 1 --2- 172.21.15.72:0/222638501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b9409e000 0x7f3b941a64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.848+0000 7f3b9a912700 1 -- 172.21.15.72:0/222638501 >> 172.21.15.72:0/222638501 conn(0x7f3b94066f50 msgr2=0x7f3b941bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.848+0000 7f3b9a912700 1 -- 172.21.15.72:0/222638501 shutdown_connections 2023-10-03T10:18:44.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.849+0000 7f3b9a912700 1 -- 172.21.15.72:0/222638501 wait complete. 2023-10-03T10:18:44.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:44.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.934+0000 7f048d0c6700 1 -- 172.21.15.72:0/298449345 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f048806c360 con 0x7f048809d6f0 2023-10-03T10:18:44.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.935+0000 7f047f7fe700 1 -- 172.21.15.72:0/298449345 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0478015090 con 0x7f048809d6f0 2023-10-03T10:18:44.936 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.937+0000 7f048d0c6700 1 -- 172.21.15.72:0/298449345 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f048809d6f0 msgr2=0x7f04881c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.937+0000 7f048d0c6700 1 --2- 172.21.15.72:0/298449345 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f048809d6f0 0x7f04881c84a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0478009c40 tx=0x7f0478004750 comp rx=0 tx=0).stop 2023-10-03T10:18:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.937+0000 7f048d0c6700 1 -- 172.21.15.72:0/298449345 shutdown_connections 2023-10-03T10:18:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.937+0000 7f048d0c6700 1 --2- 172.21.15.72:0/298449345 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f048809e410 0x7f04881c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.937+0000 7f048d0c6700 1 --2- 172.21.15.72:0/298449345 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f048809d6f0 0x7f04881c84a0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.937+0000 7f048d0c6700 1 --2- 172.21.15.72:0/298449345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048809e000 0x7f04881c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.937+0000 7f048d0c6700 1 -- 172.21.15.72:0/298449345 >> 172.21.15.72:0/298449345 conn(0x7f0488066f50 msgr2=0x7f0488130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.937+0000 7f048d0c6700 1 -- 172.21.15.72:0/298449345 shutdown_connections 2023-10-03T10:18:44.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:44.937+0000 7f048d0c6700 1 -- 172.21.15.72:0/298449345 wait complete. 2023-10-03T10:18:44.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:45.788 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:45.860 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:45.862 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:45.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.927+0000 7fa436921700 1 Processor -- start 2023-10-03T10:18:45.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.927+0000 7fa436921700 1 -- start start 2023-10-03T10:18:45.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.928+0000 7fa436921700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4300a0a30 0x7fa4300a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.928+0000 7fa436921700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa43009d630 0x7fa4300a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.928+0000 7fa436921700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa430133930 0x7fa430133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.928+0000 7fa436921700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4300a2a70 con 0x7fa43009d630 2023-10-03T10:18:45.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.928+0000 7fa436921700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300a01d0 con 0x7fa430133930 2023-10-03T10:18:45.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.928+0000 7fa436921700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa43009e2b0 con 0x7fa4300a0a30 2023-10-03T10:18:45.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.928+0000 7fa42ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4300a0a30 0x7fa4300a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.928+0000 7fa42f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa43009d630 0x7fa4300a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.928+0000 7fa42ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4300a0a30 0x7fa4300a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60694/0 (socket says 172.21.15.72:60694) 2023-10-03T10:18:45.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.928+0000 7fa42ffff700 1 -- 172.21.15.72:0/2348793072 learned_addr learned my addr 172.21.15.72:0/2348793072 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:45.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.928+0000 7fa434ebe700 1 --2- 172.21.15.72:0/2348793072 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa430133930 0x7fa430133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.929+0000 7fa42f7fe700 1 -- 172.21.15.72:0/2348793072 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4300a0a30 msgr2=0x7fa4300a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.929+0000 7fa42f7fe700 1 --2- 172.21.15.72:0/2348793072 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4300a0a30 0x7fa4300a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.929+0000 7fa42f7fe700 1 -- 172.21.15.72:0/2348793072 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa430133930 msgr2=0x7fa430133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.929+0000 7fa42f7fe700 1 --2- 172.21.15.72:0/2348793072 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa430133930 0x7fa430133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.929+0000 7fa42f7fe700 1 -- 172.21.15.72:0/2348793072 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43009dc50 con 0x7fa43009d630 2023-10-03T10:18:45.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.929+0000 7fa42ffff700 1 --2- 172.21.15.72:0/2348793072 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4300a0a30 0x7fa4300a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.929+0000 7fa434ebe700 1 --2- 172.21.15.72:0/2348793072 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa430133930 0x7fa430133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.929+0000 7fa42f7fe700 1 --2- 172.21.15.72:0/2348793072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43009d630 0x7fa4300a1340 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fa424009840 tx=0x7fa424009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2652f25a05fec6a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.929+0000 7fa42effd700 1 -- 172.21.15.72:0/2348793072 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424011830 con 0x7fa43009d630 2023-10-03T10:18:45.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.929+0000 7fa42effd700 1 -- 172.21.15.72:0/2348793072 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa424011990 con 0x7fa43009d630 2023-10-03T10:18:45.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.929+0000 7fa42effd700 1 -- 172.21.15.72:0/2348793072 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424011d20 con 0x7fa43009d630 2023-10-03T10:18:45.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.930+0000 7fa436921700 1 -- 172.21.15.72:0/2348793072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43009d630 msgr2=0x7fa4300a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.930+0000 7fa436921700 1 --2- 172.21.15.72:0/2348793072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43009d630 0x7fa4300a1340 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fa424009840 tx=0x7fa424009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:45.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.930+0000 7fa436921700 1 -- 172.21.15.72:0/2348793072 shutdown_connections 2023-10-03T10:18:45.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.930+0000 7fa436921700 1 --2- 172.21.15.72:0/2348793072 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa430133930 0x7fa430133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.930+0000 7fa436921700 1 --2- 172.21.15.72:0/2348793072 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4300a0a30 0x7fa4300a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.930+0000 7fa436921700 1 --2- 172.21.15.72:0/2348793072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa43009d630 0x7fa4300a1340 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.930+0000 7fa436921700 1 -- 172.21.15.72:0/2348793072 >> 172.21.15.72:0/2348793072 conn(0x7fa4300a3050 msgr2=0x7fa4300a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.930+0000 7fa436921700 1 -- 172.21.15.72:0/2348793072 shutdown_connections 2023-10-03T10:18:45.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.930+0000 7fa436921700 1 -- 172.21.15.72:0/2348793072 wait complete. 2023-10-03T10:18:45.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.931+0000 7fa436921700 1 Processor -- start 2023-10-03T10:18:45.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.932+0000 7fa436921700 1 -- start start 2023-10-03T10:18:45.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.932+0000 7fa436921700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d630 0x7fa43011f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.932+0000 7fa436921700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4300a0a30 0x7fa43011fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.932+0000 7fa436921700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa430133930 0x7fa4301c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.932+0000 7fa436921700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4301222e0 con 0x7fa4300a0a30 2023-10-03T10:18:45.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.932+0000 7fa436921700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa430122800 con 0x7fa430133930 2023-10-03T10:18:45.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.932+0000 7fa436921700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa430133430 con 0x7fa43009d630 2023-10-03T10:18:45.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa42ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d630 0x7fa43011f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa42f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4300a0a30 0x7fa43011fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa42ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d630 0x7fa43011f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60696/0 (socket says 172.21.15.72:60696) 2023-10-03T10:18:45.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa42ffff700 1 -- 172.21.15.72:0/820271449 learned_addr learned my addr 172.21.15.72:0/820271449 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:45.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa434ebe700 1 --2- 172.21.15.72:0/820271449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa430133930 0x7fa4301c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa42ffff700 1 -- 172.21.15.72:0/820271449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa430133930 msgr2=0x7fa4301c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa42ffff700 1 --2- 172.21.15.72:0/820271449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa430133930 0x7fa4301c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa42ffff700 1 -- 172.21.15.72:0/820271449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4300a0a30 msgr2=0x7fa43011fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa42ffff700 1 --2- 172.21.15.72:0/820271449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4300a0a30 0x7fa43011fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa42ffff700 1 -- 172.21.15.72:0/820271449 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa420009550 con 0x7fa43009d630 2023-10-03T10:18:45.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa42f7fe700 1 --2- 172.21.15.72:0/820271449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4300a0a30 0x7fa43011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa42ffff700 1 --2- 172.21.15.72:0/820271449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d630 0x7fa43011f500 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa42000ec10 tx=0x7fa42000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa42cff9700 1 -- 172.21.15.72:0/820271449 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42000c850 con 0x7fa43009d630 2023-10-03T10:18:45.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa42cff9700 1 -- 172.21.15.72:0/820271449 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42000c9b0 con 0x7fa43009d630 2023-10-03T10:18:45.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa436921700 1 -- 172.21.15.72:0/820271449 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa428009a70 con 0x7fa43009d630 2023-10-03T10:18:45.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa42cff9700 1 -- 172.21.15.72:0/820271449 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42000cd20 con 0x7fa43009d630 2023-10-03T10:18:45.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.933+0000 7fa436921700 1 -- 172.21.15.72:0/820271449 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4240094a0 con 0x7fa43009d630 2023-10-03T10:18:45.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.934+0000 7fa42cff9700 1 -- 172.21.15.72:0/820271449 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa420013470 con 0x7fa43009d630 2023-10-03T10:18:45.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.934+0000 7fa42cff9700 1 -- 172.21.15.72:0/820271449 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa42003fc40 con 0x7fa43009d630 2023-10-03T10:18:45.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.935+0000 7fa436921700 1 -- 172.21.15.72:0/820271449 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa430122420 con 0x7fa43009d630 2023-10-03T10:18:45.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:45.943+0000 7fa42cff9700 1 -- 172.21.15.72:0/820271449 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa430122420 con 0x7fa43009d630 2023-10-03T10:18:45.950 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:46.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.001+0000 7f84e0688700 1 Processor -- start 2023-10-03T10:18:46.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.001+0000 7f84e0688700 1 -- start start 2023-10-03T10:18:46.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.001+0000 7f84e0688700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d809d6f0 0x7f84d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.001+0000 7f84e0688700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d809e000 0x7f84d8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.001+0000 7f84e0688700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84d809e410 0x7f84d8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.001+0000 7f84e0688700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d809f520 con 0x7f84d809e410 2023-10-03T10:18:46.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.001+0000 7f84e0688700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d809f130 con 0x7f84d809e000 2023-10-03T10:18:46.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.001+0000 7f84e0688700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84d809e930 con 0x7f84d809d6f0 2023-10-03T10:18:46.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.002+0000 7f84ddc23700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d809e000 0x7f84d8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.002+0000 7f84ddc23700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d809e000 0x7f84d8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34480/0 (socket says 172.21.15.72:34480) 2023-10-03T10:18:46.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.002+0000 7f84ddc23700 1 -- 172.21.15.72:0/506546150 learned_addr learned my addr 172.21.15.72:0/506546150 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:46.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.002+0000 7f84de424700 1 --2- 172.21.15.72:0/506546150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d809d6f0 0x7f84d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.002+0000 7f84dec25700 1 --2- 172.21.15.72:0/506546150 >> v2:172.21.15.72:3300/0 conn(0x7f84d809e410 0x7f84d8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.002+0000 7f84ddc23700 1 -- 172.21.15.72:0/506546150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d809d6f0 msgr2=0x7f84d809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:46.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.002+0000 7f84ddc23700 1 --2- 172.21.15.72:0/506546150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d809d6f0 0x7f84d809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.002+0000 7f84ddc23700 1 -- 172.21.15.72:0/506546150 >> v2:172.21.15.72:3300/0 conn(0x7f84d809e410 msgr2=0x7f84d8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:46.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.002+0000 7f84ddc23700 1 --2- 172.21.15.72:0/506546150 >> v2:172.21.15.72:3300/0 conn(0x7f84d809e410 0x7f84d8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.002+0000 7f84ddc23700 1 -- 172.21.15.72:0/506546150 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d809b2d0 con 0x7f84d809e000 2023-10-03T10:18:46.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.002+0000 7f84de424700 1 --2- 172.21.15.72:0/506546150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d809d6f0 0x7f84d809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:46.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.002+0000 7f84ddc23700 1 --2- 172.21.15.72:0/506546150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d809e000 0x7f84d8130660 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009920 tx=0x7f84c8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=651978b342222cb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.002+0000 7f84dd422700 1 -- 172.21.15.72:0/506546150 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c8011830 con 0x7f84d809e000 2023-10-03T10:18:46.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.002+0000 7f84dd422700 1 -- 172.21.15.72:0/506546150 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c8011990 con 0x7f84d809e000 2023-10-03T10:18:46.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.002+0000 7f84dd422700 1 -- 172.21.15.72:0/506546150 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c8011d20 con 0x7f84d809e000 2023-10-03T10:18:46.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.003+0000 7f84e0688700 1 -- 172.21.15.72:0/506546150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d809e000 msgr2=0x7f84d8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.003+0000 7f84e0688700 1 --2- 172.21.15.72:0/506546150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d809e000 0x7f84d8130660 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009920 tx=0x7f84c8009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:46.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.003+0000 7f84e0688700 1 -- 172.21.15.72:0/506546150 shutdown_connections 2023-10-03T10:18:46.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.003+0000 7f84e0688700 1 --2- 172.21.15.72:0/506546150 >> v2:172.21.15.72:3300/0 conn(0x7f84d809e410 0x7f84d8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.003+0000 7f84e0688700 1 --2- 172.21.15.72:0/506546150 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d809d6f0 0x7f84d809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.003+0000 7f84e0688700 1 --2- 172.21.15.72:0/506546150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d809e000 0x7f84d8130660 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.003+0000 7f84e0688700 1 -- 172.21.15.72:0/506546150 >> 172.21.15.72:0/506546150 conn(0x7f84d8066f50 msgr2=0x7f84d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.003+0000 7f84e0688700 1 -- 172.21.15.72:0/506546150 shutdown_connections 2023-10-03T10:18:46.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.003+0000 7f84e0688700 1 -- 172.21.15.72:0/506546150 wait complete. 2023-10-03T10:18:46.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.004+0000 7f84e0688700 1 Processor -- start 2023-10-03T10:18:46.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.004+0000 7f84e0688700 1 -- start start 2023-10-03T10:18:46.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84e0688700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d809d6f0 0x7f84d811e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84e0688700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d809e000 0x7f84d811e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84e0688700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d809e410 0x7f84d811eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84e0688700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8121880 con 0x7f84d809e000 2023-10-03T10:18:46.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84e0688700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8130380 con 0x7f84d809d6f0 2023-10-03T10:18:46.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84e0688700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8120e00 con 0x7f84d809e410 2023-10-03T10:18:46.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84dec25700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d809e410 0x7f84d811eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84dec25700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d809e410 0x7f84d811eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60716/0 (socket says 172.21.15.72:60716) 2023-10-03T10:18:46.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84dec25700 1 -- 172.21.15.72:0/3410561334 learned_addr learned my addr 172.21.15.72:0/3410561334 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:46.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84ddc23700 1 --2- 172.21.15.72:0/3410561334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d809e000 0x7f84d811e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84de424700 1 --2- 172.21.15.72:0/3410561334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d809d6f0 0x7f84d811e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84dec25700 1 -- 172.21.15.72:0/3410561334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d809d6f0 msgr2=0x7f84d811e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84dec25700 1 --2- 172.21.15.72:0/3410561334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d809d6f0 0x7f84d811e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84dec25700 1 -- 172.21.15.72:0/3410561334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d809e000 msgr2=0x7f84d811e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84dec25700 1 --2- 172.21.15.72:0/3410561334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d809e000 0x7f84d811e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84dec25700 1 -- 172.21.15.72:0/3410561334 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d40094a0 con 0x7f84d809e410 2023-10-03T10:18:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84ddc23700 1 --2- 172.21.15.72:0/3410561334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d809e000 0x7f84d811e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.005+0000 7f84dec25700 1 --2- 172.21.15.72:0/3410561334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d809e410 0x7f84d811eac0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f84d0010fa0 tx=0x7f84d000e3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.007+0000 7f84ceffd700 1 -- 172.21.15.72:0/3410561334 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d000e960 con 0x7f84d809e410 2023-10-03T10:18:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.007+0000 7f84ceffd700 1 -- 172.21.15.72:0/3410561334 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d0011040 con 0x7f84d809e410 2023-10-03T10:18:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.007+0000 7f84e0688700 1 -- 172.21.15.72:0/3410561334 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c8009550 con 0x7f84d809e410 2023-10-03T10:18:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.007+0000 7f84ceffd700 1 -- 172.21.15.72:0/3410561334 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d000ed20 con 0x7f84d809e410 2023-10-03T10:18:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.008+0000 7f84e0688700 1 -- 172.21.15.72:0/3410561334 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d80a1710 con 0x7f84d809e410 2023-10-03T10:18:46.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.008+0000 7f7af7d18700 1 Processor -- start 2023-10-03T10:18:46.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.008+0000 7f84ceffd700 1 -- 172.21.15.72:0/3410561334 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84d0009070 con 0x7f84d809e410 2023-10-03T10:18:46.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.008+0000 7f84e0688700 1 -- 172.21.15.72:0/3410561334 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c00052e0 con 0x7f84d809e410 2023-10-03T10:18:46.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.009+0000 7f84ceffd700 1 -- 172.21.15.72:0/3410561334 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f84d0043670 con 0x7f84d809e410 2023-10-03T10:18:46.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.009+0000 7f7af7d18700 1 -- start start 2023-10-03T10:18:46.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.009+0000 7f7af7d18700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7af012cf60 0x7f7af006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.009+0000 7f7af7d18700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7af0130430 0x7f7af0137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.009+0000 7f7af7d18700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af012cd90 con 0x7f7af012f8b0 2023-10-03T10:18:46.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.009+0000 7f7af7d18700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af012d330 con 0x7f7af0130430 2023-10-03T10:18:46.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.009+0000 7f7af7d18700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7af0071780 con 0x7f7af012cf60 2023-10-03T10:18:46.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.009+0000 7f7af5ab4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7af012cf60 0x7f7af006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.009+0000 7f7af5ab4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7af012cf60 0x7f7af006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60722/0 (socket says 172.21.15.72:60722) 2023-10-03T10:18:46.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.009+0000 7f7af5ab4700 1 -- 172.21.15.72:0/2749769120 learned_addr learned my addr 172.21.15.72:0/2749769120 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:46.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.010+0000 7f7af62b5700 1 --2- 172.21.15.72:0/2749769120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7af0130430 0x7f7af0137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.010+0000 7f7af5ab4700 1 -- 172.21.15.72:0/2749769120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7af0130430 msgr2=0x7f7af0137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:46.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.010+0000 7f7af5ab4700 1 --2- 172.21.15.72:0/2749769120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7af0130430 0x7f7af0137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.010+0000 7f7af5ab4700 1 -- 172.21.15.72:0/2749769120 >> v1:172.21.15.72:6789/0 conn(0x7f7af012f8b0 legacy=0x7f7af012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.010+0000 7f7af5ab4700 1 -- 172.21.15.72:0/2749769120 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af0071a40 con 0x7f7af012cf60 2023-10-03T10:18:46.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.010+0000 7f7af5ab4700 1 --2- 172.21.15.72:0/2749769120 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7af012cf60 0x7f7af006f5d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0009920 tx=0x7f7ae0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b84fee602e1be5d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.018+0000 7f84ceffd700 1 -- 172.21.15.72:0/3410561334 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84d000ee80 con 0x7f84d809e410 2023-10-03T10:18:46.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.019+0000 7f7af4ab2700 1 -- 172.21.15.72:0/2749769120 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0011830 con 0x7f7af012cf60 2023-10-03T10:18:46.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.019+0000 7f7af4ab2700 1 -- 172.21.15.72:0/2749769120 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae0011990 con 0x7f7af012cf60 2023-10-03T10:18:46.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.019+0000 7f7af4ab2700 1 -- 172.21.15.72:0/2749769120 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0011d20 con 0x7f7af012cf60 2023-10-03T10:18:46.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.019+0000 7f7af7d18700 1 -- 172.21.15.72:0/2749769120 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7af012cf60 msgr2=0x7f7af006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.019+0000 7f7af7d18700 1 --2- 172.21.15.72:0/2749769120 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7af012cf60 0x7f7af006f5d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0009920 tx=0x7f7ae0009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:46.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.019+0000 7f7af7d18700 1 -- 172.21.15.72:0/2749769120 shutdown_connections 2023-10-03T10:18:46.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.019+0000 7f7af7d18700 1 --2- 172.21.15.72:0/2749769120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7af0130430 0x7f7af0137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.019+0000 7f7af7d18700 1 --2- 172.21.15.72:0/2749769120 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7af012cf60 0x7f7af006f5d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.019+0000 7f7af7d18700 1 -- 172.21.15.72:0/2749769120 >> 172.21.15.72:0/2749769120 conn(0x7f7af00a2aa0 msgr2=0x7f7af00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.020+0000 7f7af7d18700 1 -- 172.21.15.72:0/2749769120 shutdown_connections 2023-10-03T10:18:46.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.020+0000 7f7af7d18700 1 -- 172.21.15.72:0/2749769120 wait complete. 2023-10-03T10:18:46.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.020+0000 7f7af7d18700 1 Processor -- start 2023-10-03T10:18:46.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.021+0000 7f7af7d18700 1 -- start start 2023-10-03T10:18:46.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.021+0000 7f7af7d18700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7af012cf60 0x7f7af0099d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.021+0000 7f7af7d18700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7af012f8b0 0x7f7af009a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.021+0000 7f7af7d18700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7af0130430 0x7f7af009a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.021+0000 7f7af7d18700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af011ff90 con 0x7f7af012cf60 2023-10-03T10:18:46.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.021+0000 7f7af7d18700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af009b1e0 con 0x7f7af0130430 2023-10-03T10:18:46.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.021+0000 7f7af7d18700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7af0120170 con 0x7f7af012f8b0 2023-10-03T10:18:46.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.021+0000 7f7af52b3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7af012f8b0 0x7f7af009a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.021+0000 7f7af52b3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7af012f8b0 0x7f7af009a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60728/0 (socket says 172.21.15.72:60728) 2023-10-03T10:18:46.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.021+0000 7f7af5ab4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7af012cf60 0x7f7af0099d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.021+0000 7f7af52b3700 1 -- 172.21.15.72:0/1792526965 learned_addr learned my addr 172.21.15.72:0/1792526965 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:46.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.021+0000 7f7af62b5700 1 --2- 172.21.15.72:0/1792526965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7af0130430 0x7f7af009a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.021+0000 7f7af52b3700 1 -- 172.21.15.72:0/1792526965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7af0130430 msgr2=0x7f7af009a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.022+0000 7f7af52b3700 1 --2- 172.21.15.72:0/1792526965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7af0130430 0x7f7af009a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.022+0000 7f7af52b3700 1 -- 172.21.15.72:0/1792526965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7af012cf60 msgr2=0x7f7af0099d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.022+0000 7f7af52b3700 1 --2- 172.21.15.72:0/1792526965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7af012cf60 0x7f7af0099d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.022+0000 7f7af52b3700 1 -- 172.21.15.72:0/1792526965 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae0009550 con 0x7f7af012f8b0 2023-10-03T10:18:46.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.022+0000 7f7af62b5700 1 --2- 172.21.15.72:0/1792526965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7af0130430 0x7f7af009a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:46.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.022+0000 7f7af52b3700 1 --2- 172.21.15.72:0/1792526965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7af012f8b0 0x7f7af009a2c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00c4e0 tx=0x7f7aec00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.022+0000 7f7ae67fc700 1 -- 172.21.15.72:0/1792526965 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec0052d0 con 0x7f7af012f8b0 2023-10-03T10:18:46.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.022+0000 7f7af7d18700 1 -- 172.21.15.72:0/1792526965 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af012d7b0 con 0x7f7af012f8b0 2023-10-03T10:18:46.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.022+0000 7f7af7d18700 1 -- 172.21.15.72:0/1792526965 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af011f820 con 0x7f7af012f8b0 2023-10-03T10:18:46.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.022+0000 7f7ae67fc700 1 -- 172.21.15.72:0/1792526965 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aec005430 con 0x7f7af012f8b0 2023-10-03T10:18:46.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.022+0000 7f7ae67fc700 1 -- 172.21.15.72:0/1792526965 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec003880 con 0x7f7af012f8b0 2023-10-03T10:18:46.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.023+0000 7f7ae67fc700 1 -- 172.21.15.72:0/1792526965 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7aec0039e0 con 0x7f7af012f8b0 2023-10-03T10:18:46.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.023+0000 7f7af7d18700 1 -- 172.21.15.72:0/1792526965 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af0120ca0 con 0x7f7af012f8b0 2023-10-03T10:18:46.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.023+0000 7f7ae67fc700 1 -- 172.21.15.72:0/1792526965 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7aec03ebd0 con 0x7f7af012f8b0 2023-10-03T10:18:46.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.032+0000 7f7ae67fc700 1 -- 172.21.15.72:0/1792526965 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7aec017080 con 0x7f7af012f8b0 2023-10-03T10:18:46.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.079+0000 7f80ccbea700 1 Processor -- start 2023-10-03T10:18:46.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.079+0000 7f80ccbea700 1 -- start start 2023-10-03T10:18:46.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.080+0000 7f80ccbea700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f80c809e1d0 0x7f80c8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.080+0000 7f80ccbea700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80c8139170 0x7f80c813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.080+0000 7f80ccbea700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c809b120 con 0x7f80c809d6f0 2023-10-03T10:18:46.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.080+0000 7f80ccbea700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c806b460 con 0x7f80c809e1d0 2023-10-03T10:18:46.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.080+0000 7f80ccbea700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c809a7e0 con 0x7f80c8139170 2023-10-03T10:18:46.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.080+0000 7f80c5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f80c809e1d0 0x7f80c8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.080+0000 7f80c5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f80c809e1d0 0x7f80c8138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40868/0 (socket says 172.21.15.72:40868) 2023-10-03T10:18:46.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.080+0000 7f80c6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80c8139170 0x7f80c813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.080+0000 7f80c5d9b700 1 -- 172.21.15.72:0/2702639686 learned_addr learned my addr 172.21.15.72:0/2702639686 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:46.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.080+0000 7f80c6d9d700 1 -- 172.21.15.72:0/2702639686 >> v2:172.21.15.72:3300/0 conn(0x7f80c809e1d0 msgr2=0x7f80c8138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:46.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.080+0000 7f80c6d9d700 1 --2- 172.21.15.72:0/2702639686 >> v2:172.21.15.72:3300/0 conn(0x7f80c809e1d0 0x7f80c8138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.080+0000 7f80c6d9d700 1 -- 172.21.15.72:0/2702639686 >> v1:172.21.15.72:6789/0 conn(0x7f80c809d6f0 legacy=0x7f80c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.080+0000 7f80c6d9d700 1 -- 172.21.15.72:0/2702639686 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c809a500 con 0x7f80c8139170 2023-10-03T10:18:46.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.081+0000 7f80c6d9d700 1 --2- 172.21.15.72:0/2702639686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80c8139170 0x7f80c813b550 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009dc0 tx=0x7f80c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4433ede249c0c32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.081+0000 7f80c559a700 1 -- 172.21.15.72:0/2702639686 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c000e070 con 0x7f80c8139170 2023-10-03T10:18:46.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.081+0000 7f80c559a700 1 -- 172.21.15.72:0/2702639686 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c000bae0 con 0x7f80c8139170 2023-10-03T10:18:46.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.081+0000 7f80c559a700 1 -- 172.21.15.72:0/2702639686 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c000be90 con 0x7f80c8139170 2023-10-03T10:18:46.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.081+0000 7f80ccbea700 1 -- 172.21.15.72:0/2702639686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80c8139170 msgr2=0x7f80c813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.081+0000 7f80ccbea700 1 --2- 172.21.15.72:0/2702639686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80c8139170 0x7f80c813b550 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009dc0 tx=0x7f80c000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:46.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.081+0000 7f80ccbea700 1 -- 172.21.15.72:0/2702639686 shutdown_connections 2023-10-03T10:18:46.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.081+0000 7f80ccbea700 1 --2- 172.21.15.72:0/2702639686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80c8139170 0x7f80c813b550 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.081+0000 7f80ccbea700 1 --2- 172.21.15.72:0/2702639686 >> v2:172.21.15.72:3300/0 conn(0x7f80c809e1d0 0x7f80c8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.081+0000 7f80ccbea700 1 -- 172.21.15.72:0/2702639686 >> 172.21.15.72:0/2702639686 conn(0x7f80c8066f50 msgr2=0x7f80c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.082+0000 7f80ccbea700 1 -- 172.21.15.72:0/2702639686 shutdown_connections 2023-10-03T10:18:46.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.082+0000 7f80ccbea700 1 -- 172.21.15.72:0/2702639686 wait complete. 2023-10-03T10:18:46.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.083+0000 7f80ccbea700 1 Processor -- start 2023-10-03T10:18:46.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.083+0000 7f80ccbea700 1 -- start start 2023-10-03T10:18:46.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80ccbea700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80c809d6f0 0x7f80c8121930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80ccbea700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80c809e1d0 0x7f80c8121e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80ccbea700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80c8139170 0x7f80c81223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80ccbea700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c8125170 con 0x7f80c809e1d0 2023-10-03T10:18:46.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80ccbea700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c8124bc0 con 0x7f80c8139170 2023-10-03T10:18:46.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80ccbea700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80c80a1910 con 0x7f80c809d6f0 2023-10-03T10:18:46.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80c659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80c809d6f0 0x7f80c8121930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80c659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80c809d6f0 0x7f80c8121930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60730/0 (socket says 172.21.15.72:60730) 2023-10-03T10:18:46.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80c659c700 1 -- 172.21.15.72:0/2541507171 learned_addr learned my addr 172.21.15.72:0/2541507171 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:46.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80c6d9d700 1 --2- 172.21.15.72:0/2541507171 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80c8139170 0x7f80c81223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80c5d9b700 1 --2- 172.21.15.72:0/2541507171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80c809e1d0 0x7f80c8121e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80c659c700 1 -- 172.21.15.72:0/2541507171 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80c8139170 msgr2=0x7f80c81223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80c659c700 1 --2- 172.21.15.72:0/2541507171 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80c8139170 0x7f80c81223b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80c659c700 1 -- 172.21.15.72:0/2541507171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80c809e1d0 msgr2=0x7f80c8121e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80c659c700 1 --2- 172.21.15.72:0/2541507171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80c809e1d0 0x7f80c8121e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.084+0000 7f80c659c700 1 -- 172.21.15.72:0/2541507171 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c0009a70 con 0x7f80c809d6f0 2023-10-03T10:18:46.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.085+0000 7f80c659c700 1 --2- 172.21.15.72:0/2541507171 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80c809d6f0 0x7f80c8121930 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f80b800c510 tx=0x7f80b800c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.085+0000 7f80b6ffd700 1 -- 172.21.15.72:0/2541507171 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80052d0 con 0x7f80c809d6f0 2023-10-03T10:18:46.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.085+0000 7f80b6ffd700 1 -- 172.21.15.72:0/2541507171 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b8005430 con 0x7f80c809d6f0 2023-10-03T10:18:46.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.085+0000 7f80ccbea700 1 -- 172.21.15.72:0/2541507171 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c809c710 con 0x7f80c809d6f0 2023-10-03T10:18:46.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.085+0000 7f80b6ffd700 1 -- 172.21.15.72:0/2541507171 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80038c0 con 0x7f80c809d6f0 2023-10-03T10:18:46.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.085+0000 7f80ccbea700 1 -- 172.21.15.72:0/2541507171 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c8123cf0 con 0x7f80c809d6f0 2023-10-03T10:18:46.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.086+0000 7f80b6ffd700 1 -- 172.21.15.72:0/2541507171 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80b8003a20 con 0x7f80c809d6f0 2023-10-03T10:18:46.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.086+0000 7f80b6ffd700 1 -- 172.21.15.72:0/2541507171 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f80b803ea60 con 0x7f80c809d6f0 2023-10-03T10:18:46.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.086+0000 7f80ccbea700 1 -- 172.21.15.72:0/2541507171 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c81252b0 con 0x7f80c809d6f0 2023-10-03T10:18:46.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.091+0000 7f80b6ffd700 1 -- 172.21.15.72:0/2541507171 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80c81252b0 con 0x7f80c809d6f0 2023-10-03T10:18:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.165+0000 7fa436921700 1 -- 172.21.15.72:0/820271449 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa430121f60 con 0x7fa43009d630 2023-10-03T10:18:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.166+0000 7fa42cff9700 1 -- 172.21.15.72:0/820271449 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa430121f60 con 0x7fa43009d630 2023-10-03T10:18:46.167 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:46.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.168+0000 7fa436921700 1 -- 172.21.15.72:0/820271449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d630 msgr2=0x7fa43011f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.168+0000 7fa436921700 1 --2- 172.21.15.72:0/820271449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d630 0x7fa43011f500 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa42000ec10 tx=0x7fa42000ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:46.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.168+0000 7fa436921700 1 -- 172.21.15.72:0/820271449 shutdown_connections 2023-10-03T10:18:46.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.168+0000 7fa436921700 1 --2- 172.21.15.72:0/820271449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa430133930 0x7fa4301c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.168+0000 7fa436921700 1 --2- 172.21.15.72:0/820271449 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa43009d630 0x7fa43011f500 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.168+0000 7fa436921700 1 --2- 172.21.15.72:0/820271449 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4300a0a30 0x7fa43011fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.168+0000 7fa436921700 1 -- 172.21.15.72:0/820271449 >> 172.21.15.72:0/820271449 conn(0x7fa4300a3050 msgr2=0x7fa4301bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.168+0000 7fa436921700 1 -- 172.21.15.72:0/820271449 shutdown_connections 2023-10-03T10:18:46.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.168+0000 7fa436921700 1 -- 172.21.15.72:0/820271449 wait complete. 2023-10-03T10:18:46.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:46.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.215+0000 7f84e0688700 1 -- 172.21.15.72:0/3410561334 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f84c0005590 con 0x7f84d809e410 2023-10-03T10:18:46.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.215+0000 7f84ceffd700 1 -- 172.21.15.72:0/3410561334 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84d002e090 con 0x7f84d809e410 2023-10-03T10:18:46.216 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:46.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.217+0000 7f84e0688700 1 -- 172.21.15.72:0/3410561334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d809e410 msgr2=0x7f84d811eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.217+0000 7f84e0688700 1 --2- 172.21.15.72:0/3410561334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d809e410 0x7f84d811eac0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f84d0010fa0 tx=0x7f84d000e3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.217+0000 7f84e0688700 1 -- 172.21.15.72:0/3410561334 shutdown_connections 2023-10-03T10:18:46.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.217+0000 7f84e0688700 1 --2- 172.21.15.72:0/3410561334 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f84d809e410 0x7f84d811eac0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.217+0000 7f84e0688700 1 --2- 172.21.15.72:0/3410561334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f84d809d6f0 0x7f84d811e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.217+0000 7f84e0688700 1 --2- 172.21.15.72:0/3410561334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d809e000 0x7f84d811e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.217+0000 7f84e0688700 1 -- 172.21.15.72:0/3410561334 >> 172.21.15.72:0/3410561334 conn(0x7f84d8066f50 msgr2=0x7f84d8130900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.217+0000 7f84e0688700 1 -- 172.21.15.72:0/3410561334 shutdown_connections 2023-10-03T10:18:46.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.217+0000 7f84e0688700 1 -- 172.21.15.72:0/3410561334 wait complete. 2023-10-03T10:18:46.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:46.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.233+0000 7f7af7d18700 1 -- 172.21.15.72:0/1792526965 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7af011fdc0 con 0x7f7af012f8b0 2023-10-03T10:18:46.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.234+0000 7f7ae67fc700 1 -- 172.21.15.72:0/1792526965 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f7aec019b40 con 0x7f7af012f8b0 2023-10-03T10:18:46.234 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:46.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.235+0000 7f7af7d18700 1 -- 172.21.15.72:0/1792526965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7af012f8b0 msgr2=0x7f7af009a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.235+0000 7f7af7d18700 1 --2- 172.21.15.72:0/1792526965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7af012f8b0 0x7f7af009a2c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00c4e0 tx=0x7f7aec00c7f0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.236+0000 7f7af7d18700 1 -- 172.21.15.72:0/1792526965 shutdown_connections 2023-10-03T10:18:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.236+0000 7f7af7d18700 1 --2- 172.21.15.72:0/1792526965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7af012cf60 0x7f7af0099d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.236+0000 7f7af7d18700 1 --2- 172.21.15.72:0/1792526965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7af0130430 0x7f7af009a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.236+0000 7f7af7d18700 1 --2- 172.21.15.72:0/1792526965 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7af012f8b0 0x7f7af009a2c0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.236+0000 7f7af7d18700 1 -- 172.21.15.72:0/1792526965 >> 172.21.15.72:0/1792526965 conn(0x7f7af00a2aa0 msgr2=0x7f7af009e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.236+0000 7f7af7d18700 1 -- 172.21.15.72:0/1792526965 shutdown_connections 2023-10-03T10:18:46.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.236+0000 7f7af7d18700 1 -- 172.21.15.72:0/1792526965 wait complete. 2023-10-03T10:18:46.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:46.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.286+0000 7f80ccbea700 1 -- 172.21.15.72:0/2541507171 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f80c81252b0 con 0x7f80c809d6f0 2023-10-03T10:18:46.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.287+0000 7f80b6ffd700 1 -- 172.21.15.72:0/2541507171 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f80c81252b0 con 0x7f80c809d6f0 2023-10-03T10:18:46.287 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:46.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.289+0000 7f80ccbea700 1 -- 172.21.15.72:0/2541507171 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80c809d6f0 msgr2=0x7f80c8121930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.289+0000 7f80ccbea700 1 --2- 172.21.15.72:0/2541507171 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80c809d6f0 0x7f80c8121930 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f80b800c510 tx=0x7f80b800c820 comp rx=0 tx=0).stop 2023-10-03T10:18:46.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.289+0000 7f80ccbea700 1 -- 172.21.15.72:0/2541507171 shutdown_connections 2023-10-03T10:18:46.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.289+0000 7f80ccbea700 1 --2- 172.21.15.72:0/2541507171 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80c8139170 0x7f80c81223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.289+0000 7f80ccbea700 1 --2- 172.21.15.72:0/2541507171 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f80c809d6f0 0x7f80c8121930 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.289+0000 7f80ccbea700 1 --2- 172.21.15.72:0/2541507171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80c809e1d0 0x7f80c8121e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.289+0000 7f80ccbea700 1 -- 172.21.15.72:0/2541507171 >> 172.21.15.72:0/2541507171 conn(0x7f80c8066f50 msgr2=0x7f80c809b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.289+0000 7f80ccbea700 1 -- 172.21.15.72:0/2541507171 shutdown_connections 2023-10-03T10:18:46.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:46.289+0000 7f80ccbea700 1 -- 172.21.15.72:0/2541507171 wait complete. 2023-10-03T10:18:46.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:47.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:47.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:47.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:47.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:47.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.313+0000 7fd36e7a7700 1 Processor -- start 2023-10-03T10:18:47.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.313+0000 7fd36e7a7700 1 -- start start 2023-10-03T10:18:47.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd36e7a7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd368131810 0x7fd368131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd36e7a7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36809a580 0x7fd368139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd36e7a7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3681313c0 con 0x7fd368099a40 2023-10-03T10:18:47.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd36e7a7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd36806e8c0 con 0x7fd368131810 2023-10-03T10:18:47.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd36e7a7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd368071d20 con 0x7fd36809a580 2023-10-03T10:18:47.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd36cd44700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36809a580 0x7fd368139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd367fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd368131810 0x7fd368131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd367fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd368131810 0x7fd368131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40874/0 (socket says 172.21.15.72:40874) 2023-10-03T10:18:47.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd36cd44700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36809a580 0x7fd368139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34530/0 (socket says 172.21.15.72:34530) 2023-10-03T10:18:47.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd367fff700 1 -- 172.21.15.72:0/2096799303 learned_addr learned my addr 172.21.15.72:0/2096799303 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:47.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd366ffd700 1 -- 172.21.15.72:0/2096799303 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612341765 0 0) 0x7fd3681313c0 con 0x7fd368099a40 2023-10-03T10:18:47.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd366ffd700 1 -- 172.21.15.72:0/2096799303 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3500035b0 con 0x7fd368099a40 2023-10-03T10:18:47.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd36cd44700 1 -- 172.21.15.72:0/2096799303 >> v2:172.21.15.72:3300/0 conn(0x7fd368131810 msgr2=0x7fd368131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd36cd44700 1 --2- 172.21.15.72:0/2096799303 >> v2:172.21.15.72:3300/0 conn(0x7fd368131810 0x7fd368131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd36cd44700 1 -- 172.21.15.72:0/2096799303 >> v1:172.21.15.72:6789/0 conn(0x7fd368099a40 legacy=0x7fd368099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd36cd44700 1 -- 172.21.15.72:0/2096799303 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3680721a0 con 0x7fd36809a580 2023-10-03T10:18:47.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd367fff700 1 --2- 172.21.15.72:0/2096799303 >> v2:172.21.15.72:3300/0 conn(0x7fd368131810 0x7fd368131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.314+0000 7fd36cd44700 1 --2- 172.21.15.72:0/2096799303 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36809a580 0x7fd368139660 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd360009d90 tx=0x7fd36000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4598822d28db73e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.315+0000 7fd366ffd700 1 -- 172.21.15.72:0/2096799303 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36000bd20 con 0x7fd36809a580 2023-10-03T10:18:47.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.315+0000 7fd366ffd700 1 -- 172.21.15.72:0/2096799303 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36000be80 con 0x7fd36809a580 2023-10-03T10:18:47.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.315+0000 7fd366ffd700 1 -- 172.21.15.72:0/2096799303 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360010710 con 0x7fd36809a580 2023-10-03T10:18:47.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.315+0000 7fd36e7a7700 1 -- 172.21.15.72:0/2096799303 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36809a580 msgr2=0x7fd368139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.315+0000 7fd36e7a7700 1 --2- 172.21.15.72:0/2096799303 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36809a580 0x7fd368139660 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd360009d90 tx=0x7fd36000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:47.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.315+0000 7fd36e7a7700 1 -- 172.21.15.72:0/2096799303 shutdown_connections 2023-10-03T10:18:47.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.315+0000 7fd36e7a7700 1 --2- 172.21.15.72:0/2096799303 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd36809a580 0x7fd368139660 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.315+0000 7fd36e7a7700 1 --2- 172.21.15.72:0/2096799303 >> v2:172.21.15.72:3300/0 conn(0x7fd368131810 0x7fd368131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.315+0000 7fd36e7a7700 1 -- 172.21.15.72:0/2096799303 >> 172.21.15.72:0/2096799303 conn(0x7fd3680a2aa0 msgr2=0x7fd3680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.316+0000 7fd36e7a7700 1 -- 172.21.15.72:0/2096799303 shutdown_connections 2023-10-03T10:18:47.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.316+0000 7fd36e7a7700 1 -- 172.21.15.72:0/2096799303 wait complete. 2023-10-03T10:18:47.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.317+0000 7fd36e7a7700 1 Processor -- start 2023-10-03T10:18:47.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.317+0000 7fd36e7a7700 1 -- start start 2023-10-03T10:18:47.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd36e7a7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd368099a40 0x7fd36811b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd36e7a7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36809a580 0x7fd36811be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd36e7a7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd368131810 0x7fd36811c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd36e7a7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36811f060 con 0x7fd36809a580 2023-10-03T10:18:47.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd36e7a7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3680a1bd0 con 0x7fd368131810 2023-10-03T10:18:47.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd36e7a7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd36811ccf0 con 0x7fd368099a40 2023-10-03T10:18:47.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd367fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd368099a40 0x7fd36811b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd367fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd368099a40 0x7fd36811b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60732/0 (socket says 172.21.15.72:60732) 2023-10-03T10:18:47.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd367fff700 1 -- 172.21.15.72:0/2980716266 learned_addr learned my addr 172.21.15.72:0/2980716266 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:47.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd36cd44700 1 --2- 172.21.15.72:0/2980716266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd368131810 0x7fd36811c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd3677fe700 1 --2- 172.21.15.72:0/2980716266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36809a580 0x7fd36811be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd367fff700 1 -- 172.21.15.72:0/2980716266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd368131810 msgr2=0x7fd36811c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd367fff700 1 --2- 172.21.15.72:0/2980716266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd368131810 0x7fd36811c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd367fff700 1 -- 172.21.15.72:0/2980716266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36809a580 msgr2=0x7fd36811be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd367fff700 1 --2- 172.21.15.72:0/2980716266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36809a580 0x7fd36811be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd367fff700 1 -- 172.21.15.72:0/2980716266 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd358009550 con 0x7fd368099a40 2023-10-03T10:18:47.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd3677fe700 1 --2- 172.21.15.72:0/2980716266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36809a580 0x7fd36811be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:47.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.318+0000 7fd367fff700 1 --2- 172.21.15.72:0/2980716266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd368099a40 0x7fd36811b900 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd35800ebe0 tx=0x7fd35800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.319+0000 7fd364ff9700 1 -- 172.21.15.72:0/2980716266 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35800c850 con 0x7fd368099a40 2023-10-03T10:18:47.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.319+0000 7fd364ff9700 1 -- 172.21.15.72:0/2980716266 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35800c9b0 con 0x7fd368099a40 2023-10-03T10:18:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.319+0000 7fd364ff9700 1 -- 172.21.15.72:0/2980716266 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35800cd20 con 0x7fd368099a40 2023-10-03T10:18:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.319+0000 7fd36e7a7700 1 -- 172.21.15.72:0/2980716266 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd360009a70 con 0x7fd368099a40 2023-10-03T10:18:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.319+0000 7fd36e7a7700 1 -- 172.21.15.72:0/2980716266 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36806eb00 con 0x7fd368099a40 2023-10-03T10:18:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.320+0000 7fd364ff9700 1 -- 172.21.15.72:0/2980716266 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd358013470 con 0x7fd368099a40 2023-10-03T10:18:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.320+0000 7fd36e7a7700 1 -- 172.21.15.72:0/2980716266 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd368074ea0 con 0x7fd368099a40 2023-10-03T10:18:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.321+0000 7fd364ff9700 1 -- 172.21.15.72:0/2980716266 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd358013720 con 0x7fd368099a40 2023-10-03T10:18:47.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.329+0000 7fd364ff9700 1 -- 172.21.15.72:0/2980716266 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd358017020 con 0x7fd368099a40 2023-10-03T10:18:47.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.363+0000 7f7522eef700 1 Processor -- start 2023-10-03T10:18:47.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.363+0000 7f7522eef700 1 -- start start 2023-10-03T10:18:47.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f7522eef700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f751c131810 0x7f751c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f7522eef700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f751c099a40 0x7f751c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f7522eef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f751c09a3b0 0x7f751c138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f7522eef700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751c1313c0 con 0x7f751c099a40 2023-10-03T10:18:47.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f7522eef700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c06e8c0 con 0x7f751c09a3b0 2023-10-03T10:18:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f7522eef700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f751c09a820 con 0x7f751c131810 2023-10-03T10:18:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f751bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f751c099a40 0x7f751c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f7520c8b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f751c131810 0x7f751c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f751bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f751c099a40 0x7f751c099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40900/0 (socket says 172.21.15.72:40900) 2023-10-03T10:18:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f751bfff700 1 -- 172.21.15.72:0/1670180496 learned_addr learned my addr 172.21.15.72:0/1670180496 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f752148c700 1 --2- 172.21.15.72:0/1670180496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f751c09a3b0 0x7f751c138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f751bfff700 1 -- 172.21.15.72:0/1670180496 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f751c131810 msgr2=0x7f751c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f751bfff700 1 --2- 172.21.15.72:0/1670180496 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f751c131810 0x7f751c131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f751bfff700 1 -- 172.21.15.72:0/1670180496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f751c09a3b0 msgr2=0x7f751c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f751bfff700 1 --2- 172.21.15.72:0/1670180496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f751c09a3b0 0x7f751c138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.364+0000 7f751bfff700 1 -- 172.21.15.72:0/1670180496 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c071d20 con 0x7f751c099a40 2023-10-03T10:18:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.365+0000 7f751bfff700 1 --2- 172.21.15.72:0/1670180496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c099a40 0x7f751c099e70 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f75080098f0 tx=0x7f7508009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c974af3e716b02b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.365+0000 7f751b7fe700 1 -- 172.21.15.72:0/1670180496 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508011830 con 0x7f751c099a40 2023-10-03T10:18:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.365+0000 7f751b7fe700 1 -- 172.21.15.72:0/1670180496 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7508011990 con 0x7f751c099a40 2023-10-03T10:18:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.365+0000 7f751b7fe700 1 -- 172.21.15.72:0/1670180496 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508011d20 con 0x7f751c099a40 2023-10-03T10:18:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.366+0000 7f7522eef700 1 -- 172.21.15.72:0/1670180496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c099a40 msgr2=0x7f751c099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.366+0000 7f7522eef700 1 --2- 172.21.15.72:0/1670180496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c099a40 0x7f751c099e70 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f75080098f0 tx=0x7f7508009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.366+0000 7f7522eef700 1 -- 172.21.15.72:0/1670180496 shutdown_connections 2023-10-03T10:18:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.366+0000 7f7522eef700 1 --2- 172.21.15.72:0/1670180496 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f751c09a3b0 0x7f751c138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.366+0000 7f7522eef700 1 --2- 172.21.15.72:0/1670180496 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f751c131810 0x7f751c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.366+0000 7f7522eef700 1 --2- 172.21.15.72:0/1670180496 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c099a40 0x7f751c099e70 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.366+0000 7f7522eef700 1 -- 172.21.15.72:0/1670180496 >> 172.21.15.72:0/1670180496 conn(0x7f751c0a2aa0 msgr2=0x7f751c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.366+0000 7f7522eef700 1 -- 172.21.15.72:0/1670180496 shutdown_connections 2023-10-03T10:18:47.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.366+0000 7f7522eef700 1 -- 172.21.15.72:0/1670180496 wait complete. 2023-10-03T10:18:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.367+0000 7f7522eef700 1 Processor -- start 2023-10-03T10:18:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.367+0000 7f7522eef700 1 -- start start 2023-10-03T10:18:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f7522eef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c099a40 0x7f751c11b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f7522eef700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f751c09a3b0 0x7f751c11bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f7522eef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f751c131810 0x7f751c11c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f7522eef700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c11d270 con 0x7f751c099a40 2023-10-03T10:18:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f7522eef700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c11d890 con 0x7f751c131810 2023-10-03T10:18:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f7522eef700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f751c11e4c0 con 0x7f751c09a3b0 2023-10-03T10:18:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f7520c8b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c099a40 0x7f751c11b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f751bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f751c09a3b0 0x7f751c11bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f7520c8b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c099a40 0x7f751c11b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40902/0 (socket says 172.21.15.72:40902) 2023-10-03T10:18:47.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f751bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f751c09a3b0 0x7f751c11bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60736/0 (socket says 172.21.15.72:60736) 2023-10-03T10:18:47.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f7520c8b700 1 -- 172.21.15.72:0/580483035 learned_addr learned my addr 172.21.15.72:0/580483035 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:47.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f752148c700 1 --2- 172.21.15.72:0/580483035 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f751c131810 0x7f751c11c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f7520c8b700 1 -- 172.21.15.72:0/580483035 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f751c09a3b0 msgr2=0x7f751c11bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f7520c8b700 1 --2- 172.21.15.72:0/580483035 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f751c09a3b0 0x7f751c11bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f7520c8b700 1 -- 172.21.15.72:0/580483035 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f751c131810 msgr2=0x7f751c11c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f7520c8b700 1 --2- 172.21.15.72:0/580483035 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f751c131810 0x7f751c11c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.368+0000 7f7520c8b700 1 -- 172.21.15.72:0/580483035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7508009550 con 0x7f751c099a40 2023-10-03T10:18:47.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.369+0000 7f7520c8b700 1 --2- 172.21.15.72:0/580483035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c099a40 0x7f751c11b660 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f7510009d40 tx=0x7f75100133b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.369+0000 7f75197fa700 1 -- 172.21.15.72:0/580483035 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7510013d20 con 0x7f751c099a40 2023-10-03T10:18:47.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.369+0000 7f75197fa700 1 -- 172.21.15.72:0/580483035 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7510015040 con 0x7f751c099a40 2023-10-03T10:18:47.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.369+0000 7f7522eef700 1 -- 172.21.15.72:0/580483035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751c11e910 con 0x7f751c099a40 2023-10-03T10:18:47.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.369+0000 7f75197fa700 1 -- 172.21.15.72:0/580483035 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751001b600 con 0x7f751c099a40 2023-10-03T10:18:47.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.369+0000 7f7522eef700 1 -- 172.21.15.72:0/580483035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751c11eea0 con 0x7f751c099a40 2023-10-03T10:18:47.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.370+0000 7f75197fa700 1 -- 172.21.15.72:0/580483035 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f751001b760 con 0x7f751c099a40 2023-10-03T10:18:47.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.370+0000 7f75197fa700 1 -- 172.21.15.72:0/580483035 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7510043490 con 0x7f751c099a40 2023-10-03T10:18:47.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.370+0000 7f7522eef700 1 -- 172.21.15.72:0/580483035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751c074ea0 con 0x7f751c099a40 2023-10-03T10:18:47.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.380+0000 7f75197fa700 1 -- 172.21.15.72:0/580483035 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7510009e30 con 0x7f751c099a40 2023-10-03T10:18:47.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.414+0000 7fb4879bd700 1 Processor -- start 2023-10-03T10:18:47.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.415+0000 7fb4879bd700 1 -- start start 2023-10-03T10:18:47.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.415+0000 7fb4879bd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb48009e930 0x7fb48009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.415+0000 7fb4879bd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb48009f650 0x7fb480131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.415+0000 7fb4879bd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb480070940 con 0x7fb48009f240 2023-10-03T10:18:47.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.415+0000 7fb4879bd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48006fd60 con 0x7fb48009e930 2023-10-03T10:18:47.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.415+0000 7fb4879bd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48006fa80 con 0x7fb48009f650 2023-10-03T10:18:47.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.416+0000 7fb485f5a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb48009f650 0x7fb480131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.416+0000 7fb485f5a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb48009f650 0x7fb480131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:34580/0 (socket says 172.21.15.72:34580) 2023-10-03T10:18:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.416+0000 7fb485f5a700 1 -- 172.21.15.72:0/1275926857 learned_addr learned my addr 172.21.15.72:0/1275926857 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:47.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.416+0000 7fb485759700 1 --2- 172.21.15.72:0/1275926857 >> v2:172.21.15.72:3300/0 conn(0x7fb48009e930 0x7fb48009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.416+0000 7fb485759700 1 -- 172.21.15.72:0/1275926857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb48009f650 msgr2=0x7fb480131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.416+0000 7fb485759700 1 --2- 172.21.15.72:0/1275926857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb48009f650 0x7fb480131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.416+0000 7fb485759700 1 -- 172.21.15.72:0/1275926857 >> v1:172.21.15.72:6789/0 conn(0x7fb48009f240 legacy=0x7fb4801317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.416+0000 7fb477fff700 1 -- 172.21.15.72:0/1275926857 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346327018 0 0) 0x7fb480070940 con 0x7fb48009f240 2023-10-03T10:18:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.416+0000 7fb485759700 1 -- 172.21.15.72:0/1275926857 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48009fb60 con 0x7fb48009e930 2023-10-03T10:18:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.416+0000 7fb485f5a700 1 --2- 172.21.15.72:0/1275926857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb48009f650 0x7fb480131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.416+0000 7fb485759700 1 --2- 172.21.15.72:0/1275926857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48009e930 0x7fb48009ed00 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009840 tx=0x7fb47c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c607ef23cdada661 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.416+0000 7fb477fff700 1 -- 172.21.15.72:0/1275926857 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c011830 con 0x7fb48009e930 2023-10-03T10:18:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.416+0000 7fb477fff700 1 -- 172.21.15.72:0/1275926857 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c011990 con 0x7fb48009e930 2023-10-03T10:18:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.416+0000 7fb477fff700 1 -- 172.21.15.72:0/1275926857 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c011d20 con 0x7fb48009e930 2023-10-03T10:18:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.417+0000 7fb4879bd700 1 -- 172.21.15.72:0/1275926857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48009e930 msgr2=0x7fb48009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.417+0000 7fb4879bd700 1 --2- 172.21.15.72:0/1275926857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48009e930 0x7fb48009ed00 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009840 tx=0x7fb47c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.417+0000 7fb4879bd700 1 -- 172.21.15.72:0/1275926857 shutdown_connections 2023-10-03T10:18:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.417+0000 7fb4879bd700 1 --2- 172.21.15.72:0/1275926857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb48009f650 0x7fb480131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.417+0000 7fb4879bd700 1 --2- 172.21.15.72:0/1275926857 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48009e930 0x7fb48009ed00 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.417+0000 7fb4879bd700 1 -- 172.21.15.72:0/1275926857 >> 172.21.15.72:0/1275926857 conn(0x7fb4800a4210 msgr2=0x7fb4800a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.417+0000 7fb4879bd700 1 -- 172.21.15.72:0/1275926857 shutdown_connections 2023-10-03T10:18:47.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.417+0000 7fb4879bd700 1 -- 172.21.15.72:0/1275926857 wait complete. 2023-10-03T10:18:47.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.419+0000 7fb4879bd700 1 Processor -- start 2023-10-03T10:18:47.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.419+0000 7fb4879bd700 1 -- start start 2023-10-03T10:18:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.419+0000 7fb4879bd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48009e930 0x7fb480139850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.419+0000 7fb4879bd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb48009f240 0x7fb480139d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.419+0000 7fb4879bd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb48009f650 0x7fb48013a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.419+0000 7fb4879bd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb480130660 con 0x7fb48009e930 2023-10-03T10:18:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.419+0000 7fb4879bd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb480137fb0 con 0x7fb48009f240 2023-10-03T10:18:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.419+0000 7fb4879bd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4801365b0 con 0x7fb48009f650 2023-10-03T10:18:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.420+0000 7fb485759700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48009e930 0x7fb480139850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.420+0000 7fb485759700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48009e930 0x7fb480139850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40914/0 (socket says 172.21.15.72:40914) 2023-10-03T10:18:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.420+0000 7fb485759700 1 -- 172.21.15.72:0/745497131 learned_addr learned my addr 172.21.15.72:0/745497131 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.420+0000 7fb484f58700 1 --2- 172.21.15.72:0/745497131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb48009f240 0x7fb480139d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.420+0000 7fb485f5a700 1 --2- 172.21.15.72:0/745497131 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb48009f650 0x7fb48013a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.420+0000 7fb484f58700 1 -- 172.21.15.72:0/745497131 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb48009f650 msgr2=0x7fb48013a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.420+0000 7fb484f58700 1 --2- 172.21.15.72:0/745497131 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb48009f650 0x7fb48013a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.420+0000 7fb484f58700 1 -- 172.21.15.72:0/745497131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48009e930 msgr2=0x7fb480139850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.420+0000 7fb484f58700 1 --2- 172.21.15.72:0/745497131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48009e930 0x7fb480139850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.420+0000 7fb484f58700 1 -- 172.21.15.72:0/745497131 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb478009b30 con 0x7fb48009f240 2023-10-03T10:18:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.420+0000 7fb484f58700 1 --2- 172.21.15.72:0/745497131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb48009f240 0x7fb480139d90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb47000c460 tx=0x7fb47000c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.420+0000 7fb475ffb700 1 -- 172.21.15.72:0/745497131 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700054e0 con 0x7fb48009f240 2023-10-03T10:18:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.420+0000 7fb475ffb700 1 -- 172.21.15.72:0/745497131 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47000ce30 con 0x7fb48009f240 2023-10-03T10:18:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.420+0000 7fb4879bd700 1 -- 172.21.15.72:0/745497131 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47c0094a0 con 0x7fb48009f240 2023-10-03T10:18:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.420+0000 7fb475ffb700 1 -- 172.21.15.72:0/745497131 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700038c0 con 0x7fb48009f240 2023-10-03T10:18:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.421+0000 7fb4879bd700 1 -- 172.21.15.72:0/745497131 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4800a0190 con 0x7fb48009f240 2023-10-03T10:18:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.422+0000 7fb475ffb700 1 -- 172.21.15.72:0/745497131 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb470003a20 con 0x7fb48009f240 2023-10-03T10:18:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.422+0000 7fb4879bd700 1 -- 172.21.15.72:0/745497131 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4800a3160 con 0x7fb48009f240 2023-10-03T10:18:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.422+0000 7fb475ffb700 1 -- 172.21.15.72:0/745497131 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb470040a00 con 0x7fb48009f240 2023-10-03T10:18:47.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.427+0000 7fb475ffb700 1 -- 172.21.15.72:0/745497131 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb470044060 con 0x7fb48009f240 2023-10-03T10:18:47.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.459+0000 7ff2ba233700 1 Processor -- start 2023-10-03T10:18:47.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.459+0000 7ff2ba233700 1 -- start start 2023-10-03T10:18:47.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.460+0000 7ff2ba233700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2b409e930 0x7ff2b409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.460+0000 7ff2ba233700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff2b409f240 0x7ff2b41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.460+0000 7ff2ba233700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b4070940 con 0x7ff2b409f650 2023-10-03T10:18:47.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.460+0000 7ff2ba233700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b406fd60 con 0x7ff2b409f240 2023-10-03T10:18:47.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.460+0000 7ff2ba233700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b406fa80 con 0x7ff2b409e930 2023-10-03T10:18:47.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.460+0000 7ff2b37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2b409e930 0x7ff2b409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.460+0000 7ff2b37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2b409e930 0x7ff2b409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60744/0 (socket says 172.21.15.72:60744) 2023-10-03T10:18:47.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.460+0000 7ff2b37fe700 1 -- 172.21.15.72:0/2039550605 learned_addr learned my addr 172.21.15.72:0/2039550605 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:47.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.460+0000 7ff2b2ffd700 1 --2- 172.21.15.72:0/2039550605 >> v2:172.21.15.72:3300/0 conn(0x7ff2b409f240 0x7ff2b41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.460+0000 7ff2b37fe700 1 -- 172.21.15.72:0/2039550605 >> v2:172.21.15.72:3300/0 conn(0x7ff2b409f240 msgr2=0x7ff2b41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.460+0000 7ff2b37fe700 1 --2- 172.21.15.72:0/2039550605 >> v2:172.21.15.72:3300/0 conn(0x7ff2b409f240 0x7ff2b41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.460+0000 7ff2b37fe700 1 -- 172.21.15.72:0/2039550605 >> v1:172.21.15.72:6789/0 conn(0x7ff2b409f650 legacy=0x7ff2b4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.460+0000 7ff2b37fe700 1 -- 172.21.15.72:0/2039550605 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b409fb60 con 0x7ff2b409e930 2023-10-03T10:18:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.461+0000 7ff2b37fe700 1 --2- 172.21.15.72:0/2039550605 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2b409e930 0x7ff2b409ed00 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40098f0 tx=0x7ff2a4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=964a63320245a828 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.461+0000 7ff2b27fc700 1 -- 172.21.15.72:0/2039550605 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4011830 con 0x7ff2b409e930 2023-10-03T10:18:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.461+0000 7ff2b27fc700 1 -- 172.21.15.72:0/2039550605 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a4011990 con 0x7ff2b409e930 2023-10-03T10:18:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.461+0000 7ff2b27fc700 1 -- 172.21.15.72:0/2039550605 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4011d20 con 0x7ff2b409e930 2023-10-03T10:18:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.461+0000 7ff2ba233700 1 -- 172.21.15.72:0/2039550605 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2b409e930 msgr2=0x7ff2b409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.461+0000 7ff2ba233700 1 --2- 172.21.15.72:0/2039550605 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2b409e930 0x7ff2b409ed00 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40098f0 tx=0x7ff2a4009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.461+0000 7ff2ba233700 1 -- 172.21.15.72:0/2039550605 shutdown_connections 2023-10-03T10:18:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.461+0000 7ff2ba233700 1 --2- 172.21.15.72:0/2039550605 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2b409e930 0x7ff2b409ed00 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.461+0000 7ff2ba233700 1 --2- 172.21.15.72:0/2039550605 >> v2:172.21.15.72:3300/0 conn(0x7ff2b409f240 0x7ff2b41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.461+0000 7ff2ba233700 1 -- 172.21.15.72:0/2039550605 >> 172.21.15.72:0/2039550605 conn(0x7ff2b40a4210 msgr2=0x7ff2b40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.461+0000 7ff2ba233700 1 -- 172.21.15.72:0/2039550605 shutdown_connections 2023-10-03T10:18:47.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.461+0000 7ff2ba233700 1 -- 172.21.15.72:0/2039550605 wait complete. 2023-10-03T10:18:47.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.463+0000 7ff2ba233700 1 Processor -- start 2023-10-03T10:18:47.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.463+0000 7ff2ba233700 1 -- start start 2023-10-03T10:18:47.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.463+0000 7ff2ba233700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2b409e930 0x7ff2b406b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.463+0000 7ff2ba233700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2b409f240 0x7ff2b406bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.463+0000 7ff2ba233700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2b409f650 0x7ff2b406c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.463+0000 7ff2ba233700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b41a89f0 con 0x7ff2b409f240 2023-10-03T10:18:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.463+0000 7ff2ba233700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b406cc50 con 0x7ff2b409e930 2023-10-03T10:18:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.463+0000 7ff2ba233700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b406d3e0 con 0x7ff2b409f650 2023-10-03T10:18:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.464+0000 7ff2b3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2b409f650 0x7ff2b406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.464+0000 7ff2b3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2b409f650 0x7ff2b406c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:60752/0 (socket says 172.21.15.72:60752) 2023-10-03T10:18:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.464+0000 7ff2b3fff700 1 -- 172.21.15.72:0/3248905044 learned_addr learned my addr 172.21.15.72:0/3248905044 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.464+0000 7ff2b2ffd700 1 --2- 172.21.15.72:0/3248905044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2b409f240 0x7ff2b406bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.464+0000 7ff2b37fe700 1 --2- 172.21.15.72:0/3248905044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2b409e930 0x7ff2b406b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.464+0000 7ff2b3fff700 1 -- 172.21.15.72:0/3248905044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2b409e930 msgr2=0x7ff2b406b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.464+0000 7ff2b3fff700 1 --2- 172.21.15.72:0/3248905044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2b409e930 0x7ff2b406b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.464+0000 7ff2b3fff700 1 -- 172.21.15.72:0/3248905044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2b409f240 msgr2=0x7ff2b406bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.464+0000 7ff2b3fff700 1 --2- 172.21.15.72:0/3248905044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2b409f240 0x7ff2b406bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.464+0000 7ff2b3fff700 1 -- 172.21.15.72:0/3248905044 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a4009550 con 0x7ff2b409f650 2023-10-03T10:18:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.464+0000 7ff2b2ffd700 1 --2- 172.21.15.72:0/3248905044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2b409f240 0x7ff2b406bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.464+0000 7ff2b3fff700 1 --2- 172.21.15.72:0/3248905044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2b409f650 0x7ff2b406c300 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00cc50 tx=0x7ff2ac00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.464+0000 7ff29bfff700 1 -- 172.21.15.72:0/3248905044 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac003c00 con 0x7ff2b409f650 2023-10-03T10:18:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.464+0000 7ff29bfff700 1 -- 172.21.15.72:0/3248905044 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac003d60 con 0x7ff2b409f650 2023-10-03T10:18:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.464+0000 7ff2ba233700 1 -- 172.21.15.72:0/3248905044 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b40a0190 con 0x7ff2b409f650 2023-10-03T10:18:47.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.465+0000 7ff29bfff700 1 -- 172.21.15.72:0/3248905044 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac00ab60 con 0x7ff2b409f650 2023-10-03T10:18:47.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.465+0000 7ff2ba233700 1 -- 172.21.15.72:0/3248905044 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b4071d20 con 0x7ff2b409f650 2023-10-03T10:18:47.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.465+0000 7ff29bfff700 1 -- 172.21.15.72:0/3248905044 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2ac00acc0 con 0x7ff2b409f650 2023-10-03T10:18:47.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.466+0000 7ff29bfff700 1 -- 172.21.15.72:0/3248905044 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff2ac03f700 con 0x7ff2b409f650 2023-10-03T10:18:47.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.467+0000 7ff2ba233700 1 -- 172.21.15.72:0/3248905044 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b41b6020 con 0x7ff2b409f650 2023-10-03T10:18:47.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.475+0000 7ff29bfff700 1 -- 172.21.15.72:0/3248905044 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2ac0198f0 con 0x7ff2b409f650 2023-10-03T10:18:47.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.538+0000 7fd36e7a7700 1 -- 172.21.15.72:0/2980716266 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd36811e680 con 0x7fd368099a40 2023-10-03T10:18:47.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.538+0000 7fd364ff9700 1 -- 172.21.15.72:0/2980716266 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd358017020 con 0x7fd368099a40 2023-10-03T10:18:47.539 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:47.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.541+0000 7fd36e7a7700 1 -- 172.21.15.72:0/2980716266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd368099a40 msgr2=0x7fd36811b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.541+0000 7fd36e7a7700 1 --2- 172.21.15.72:0/2980716266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd368099a40 0x7fd36811b900 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd35800ebe0 tx=0x7fd35800eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.541+0000 7fd36e7a7700 1 -- 172.21.15.72:0/2980716266 shutdown_connections 2023-10-03T10:18:47.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.541+0000 7fd36e7a7700 1 --2- 172.21.15.72:0/2980716266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd368131810 0x7fd36811c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.541+0000 7fd36e7a7700 1 --2- 172.21.15.72:0/2980716266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd368099a40 0x7fd36811b900 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.541+0000 7fd36e7a7700 1 --2- 172.21.15.72:0/2980716266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd36809a580 0x7fd36811be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.541+0000 7fd36e7a7700 1 -- 172.21.15.72:0/2980716266 >> 172.21.15.72:0/2980716266 conn(0x7fd3680a2aa0 msgr2=0x7fd368070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.541+0000 7fd36e7a7700 1 -- 172.21.15.72:0/2980716266 shutdown_connections 2023-10-03T10:18:47.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.541+0000 7fd36e7a7700 1 -- 172.21.15.72:0/2980716266 wait complete. 2023-10-03T10:18:47.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:47.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.578+0000 7f7522eef700 1 -- 172.21.15.72:0/580483035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f751c06b9e0 con 0x7f751c099a40 2023-10-03T10:18:47.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.578+0000 7f75197fa700 1 -- 172.21.15.72:0/580483035 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7510020020 con 0x7f751c099a40 2023-10-03T10:18:47.579 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:47.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.581+0000 7f7522eef700 1 -- 172.21.15.72:0/580483035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c099a40 msgr2=0x7f751c11b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.581+0000 7f7522eef700 1 --2- 172.21.15.72:0/580483035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c099a40 0x7f751c11b660 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f7510009d40 tx=0x7f75100133b0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.582+0000 7f7522eef700 1 -- 172.21.15.72:0/580483035 shutdown_connections 2023-10-03T10:18:47.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.582+0000 7f7522eef700 1 --2- 172.21.15.72:0/580483035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f751c099a40 0x7f751c11b660 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.582+0000 7f7522eef700 1 --2- 172.21.15.72:0/580483035 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f751c131810 0x7f751c11c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.582+0000 7f7522eef700 1 --2- 172.21.15.72:0/580483035 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f751c09a3b0 0x7f751c11bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.582+0000 7f7522eef700 1 -- 172.21.15.72:0/580483035 >> 172.21.15.72:0/580483035 conn(0x7f751c0a2aa0 msgr2=0x7f751c070df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.582+0000 7f7522eef700 1 -- 172.21.15.72:0/580483035 shutdown_connections 2023-10-03T10:18:47.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.582+0000 7f7522eef700 1 -- 172.21.15.72:0/580483035 wait complete. 2023-10-03T10:18:47.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:47.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.643+0000 7fb4879bd700 1 -- 172.21.15.72:0/745497131 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb48009ffe0 con 0x7fb48009f240 2023-10-03T10:18:47.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.644+0000 7fb475ffb700 1 -- 172.21.15.72:0/745497131 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb470044020 con 0x7fb48009f240 2023-10-03T10:18:47.645 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:47.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.646+0000 7fb4879bd700 1 -- 172.21.15.72:0/745497131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb48009f240 msgr2=0x7fb480139d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.646+0000 7fb4879bd700 1 --2- 172.21.15.72:0/745497131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb48009f240 0x7fb480139d90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb47000c460 tx=0x7fb47000c770 comp rx=0 tx=0).stop 2023-10-03T10:18:47.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.646+0000 7fb4879bd700 1 -- 172.21.15.72:0/745497131 shutdown_connections 2023-10-03T10:18:47.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.646+0000 7fb4879bd700 1 --2- 172.21.15.72:0/745497131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48009e930 0x7fb480139850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.646+0000 7fb4879bd700 1 --2- 172.21.15.72:0/745497131 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb48009f650 0x7fb48013a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.646+0000 7fb4879bd700 1 --2- 172.21.15.72:0/745497131 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb48009f240 0x7fb480139d90 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.646+0000 7fb4879bd700 1 -- 172.21.15.72:0/745497131 >> 172.21.15.72:0/745497131 conn(0x7fb4800a4210 msgr2=0x7fb480132b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.646+0000 7fb4879bd700 1 -- 172.21.15.72:0/745497131 shutdown_connections 2023-10-03T10:18:47.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.646+0000 7fb4879bd700 1 -- 172.21.15.72:0/745497131 wait complete. 2023-10-03T10:18:47.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.680+0000 7ff2ba233700 1 -- 172.21.15.72:0/3248905044 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff2b4074ea0 con 0x7ff2b409f650 2023-10-03T10:18:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.680+0000 7ff29bfff700 1 -- 172.21.15.72:0/3248905044 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2ac019300 con 0x7ff2b409f650 2023-10-03T10:18:47.681 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:47.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.682+0000 7ff2ba233700 1 -- 172.21.15.72:0/3248905044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2b409f650 msgr2=0x7ff2b406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.682+0000 7ff2ba233700 1 --2- 172.21.15.72:0/3248905044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2b409f650 0x7ff2b406c300 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00cc50 tx=0x7ff2ac00cf60 comp rx=0 tx=0).stop 2023-10-03T10:18:47.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.682+0000 7ff2ba233700 1 -- 172.21.15.72:0/3248905044 shutdown_connections 2023-10-03T10:18:47.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.682+0000 7ff2ba233700 1 --2- 172.21.15.72:0/3248905044 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff2b409f650 0x7ff2b406c300 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.682+0000 7ff2ba233700 1 --2- 172.21.15.72:0/3248905044 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2b409e930 0x7ff2b406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.682+0000 7ff2ba233700 1 --2- 172.21.15.72:0/3248905044 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2b409f240 0x7ff2b406bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.682+0000 7ff2ba233700 1 -- 172.21.15.72:0/3248905044 >> 172.21.15.72:0/3248905044 conn(0x7ff2b40a4210 msgr2=0x7ff2b41b8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.682+0000 7ff2ba233700 1 -- 172.21.15.72:0/3248905044 shutdown_connections 2023-10-03T10:18:47.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:47.682+0000 7ff2ba233700 1 -- 172.21.15.72:0/3248905044 wait complete. 2023-10-03T10:18:47.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:48.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:48.599 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:48.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:48.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:48.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.698+0000 7fe2bdfac700 1 Processor -- start 2023-10-03T10:18:48.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.699+0000 7fe2bdfac700 1 -- start start 2023-10-03T10:18:48.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.699+0000 7fe2bdfac700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b809d6f0 0x7fe2b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.699+0000 7fe2bdfac700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2b809e000 0x7fe2b81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.699+0000 7fe2bdfac700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b809b120 con 0x7fe2b809e410 2023-10-03T10:18:48.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.699+0000 7fe2bdfac700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b806b460 con 0x7fe2b809e000 2023-10-03T10:18:48.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.699+0000 7fe2bdfac700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b809a7e0 con 0x7fe2b809d6f0 2023-10-03T10:18:48.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.699+0000 7fe2b77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b809d6f0 0x7fe2b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.699+0000 7fe2b6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2b809e000 0x7fe2b81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.699+0000 7fe2b77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b809d6f0 0x7fe2b809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36098/0 (socket says 172.21.15.72:36098) 2023-10-03T10:18:48.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.699+0000 7fe2b77fe700 1 -- 172.21.15.72:0/1514684094 learned_addr learned my addr 172.21.15.72:0/1514684094 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:48.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.700+0000 7fe2b77fe700 1 -- 172.21.15.72:0/1514684094 >> v2:172.21.15.72:3300/0 conn(0x7fe2b809e000 msgr2=0x7fe2b81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.700+0000 7fe2b77fe700 1 --2- 172.21.15.72:0/1514684094 >> v2:172.21.15.72:3300/0 conn(0x7fe2b809e000 0x7fe2b81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.700+0000 7fe2b77fe700 1 -- 172.21.15.72:0/1514684094 >> v1:172.21.15.72:6789/0 conn(0x7fe2b809e410 legacy=0x7fe2b8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.700+0000 7fe2b77fe700 1 -- 172.21.15.72:0/1514684094 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b809a500 con 0x7fe2b809d6f0 2023-10-03T10:18:48.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.700+0000 7fe2b77fe700 1 --2- 172.21.15.72:0/1514684094 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b809d6f0 0x7fe2b809dac0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009920 tx=0x7fe2a8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=802c37c9ad568bc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.700+0000 7fe2b67fc700 1 -- 172.21.15.72:0/1514684094 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8011830 con 0x7fe2b809d6f0 2023-10-03T10:18:48.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.700+0000 7fe2b67fc700 1 -- 172.21.15.72:0/1514684094 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a8011990 con 0x7fe2b809d6f0 2023-10-03T10:18:48.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.700+0000 7fe2b67fc700 1 -- 172.21.15.72:0/1514684094 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8011d20 con 0x7fe2b809d6f0 2023-10-03T10:18:48.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.701+0000 7fe2bdfac700 1 -- 172.21.15.72:0/1514684094 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b809d6f0 msgr2=0x7fe2b809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.701+0000 7fe2bdfac700 1 --2- 172.21.15.72:0/1514684094 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b809d6f0 0x7fe2b809dac0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009920 tx=0x7fe2a8009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:48.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.701+0000 7fe2bdfac700 1 -- 172.21.15.72:0/1514684094 shutdown_connections 2023-10-03T10:18:48.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.701+0000 7fe2bdfac700 1 --2- 172.21.15.72:0/1514684094 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b809d6f0 0x7fe2b809dac0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.701+0000 7fe2bdfac700 1 --2- 172.21.15.72:0/1514684094 >> v2:172.21.15.72:3300/0 conn(0x7fe2b809e000 0x7fe2b81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.701+0000 7fe2bdfac700 1 -- 172.21.15.72:0/1514684094 >> 172.21.15.72:0/1514684094 conn(0x7fe2b8066f50 msgr2=0x7fe2b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.701+0000 7fe2bdfac700 1 -- 172.21.15.72:0/1514684094 shutdown_connections 2023-10-03T10:18:48.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.701+0000 7fe2bdfac700 1 -- 172.21.15.72:0/1514684094 wait complete. 2023-10-03T10:18:48.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.703+0000 7fe2bdfac700 1 Processor -- start 2023-10-03T10:18:48.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.703+0000 7fe2bdfac700 1 -- start start 2023-10-03T10:18:48.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.703+0000 7fe2bdfac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b809d6f0 0x7fe2b81a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2bdfac700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b809e000 0x7fe2b81a6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2bdfac700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b809e410 0x7fe2b81a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2bdfac700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b81a7cb0 con 0x7fe2b809e410 2023-10-03T10:18:48.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2bdfac700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b81a9820 con 0x7fe2b809d6f0 2023-10-03T10:18:48.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2bdfac700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b80a3380 con 0x7fe2b809e000 2023-10-03T10:18:48.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b809e410 0x7fe2b81a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2b7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b809e410 0x7fe2b81a6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50808/0 (socket says 172.21.15.72:50808) 2023-10-03T10:18:48.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2b77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b809d6f0 0x7fe2b81a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2b7fff700 1 -- 172.21.15.72:0/2977615692 learned_addr learned my addr 172.21.15.72:0/2977615692 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:48.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2b6ffd700 1 --2- 172.21.15.72:0/2977615692 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b809e000 0x7fe2b81a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2b6ffd700 1 -- 172.21.15.72:0/2977615692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b809d6f0 msgr2=0x7fe2b81a60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2b6ffd700 1 --2- 172.21.15.72:0/2977615692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b809d6f0 0x7fe2b81a60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2b6ffd700 1 -- 172.21.15.72:0/2977615692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b809e410 msgr2=0x7fe2b81a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2b6ffd700 1 --2- 172.21.15.72:0/2977615692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b809e410 0x7fe2b81a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2b6ffd700 1 -- 172.21.15.72:0/2977615692 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a8009550 con 0x7fe2b809e000 2023-10-03T10:18:48.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2b7fff700 1 --2- 172.21.15.72:0/2977615692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b809e410 0x7fe2b81a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.704+0000 7fe2b6ffd700 1 --2- 172.21.15.72:0/2977615692 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b809e000 0x7fe2b81a6630 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00e900 tx=0x7fe2ac00ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.705+0000 7fe29ffff700 1 -- 172.21.15.72:0/2977615692 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac013680 con 0x7fe2b809e000 2023-10-03T10:18:48.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.705+0000 7fe29ffff700 1 -- 172.21.15.72:0/2977615692 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac0137e0 con 0x7fe2b809e000 2023-10-03T10:18:48.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.705+0000 7fe2bdfac700 1 -- 172.21.15.72:0/2977615692 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b809c710 con 0x7fe2b809e000 2023-10-03T10:18:48.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.705+0000 7fe29ffff700 1 -- 172.21.15.72:0/2977615692 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac013b50 con 0x7fe2b809e000 2023-10-03T10:18:48.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.705+0000 7fe2bdfac700 1 -- 172.21.15.72:0/2977615692 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b81a9b00 con 0x7fe2b809e000 2023-10-03T10:18:48.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.706+0000 7fe29ffff700 1 -- 172.21.15.72:0/2977615692 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2ac013cb0 con 0x7fe2b809e000 2023-10-03T10:18:48.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.706+0000 7fe29ffff700 1 -- 172.21.15.72:0/2977615692 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe2ac03f9b0 con 0x7fe2b809e000 2023-10-03T10:18:48.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.706+0000 7fe2bdfac700 1 -- 172.21.15.72:0/2977615692 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b8074ea0 con 0x7fe2b809e000 2023-10-03T10:18:48.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.712+0000 7fe29ffff700 1 -- 172.21.15.72:0/2977615692 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2ac017070 con 0x7fe2b809e000 2023-10-03T10:18:48.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.740+0000 7fd1cb6f1700 1 Processor -- start 2023-10-03T10:18:48.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.741+0000 7fd1cb6f1700 1 -- start start 2023-10-03T10:18:48.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.741+0000 7fd1cb6f1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1c409d6f0 0x7fd1c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.741+0000 7fd1cb6f1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1c409e410 0x7fd1c4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.741+0000 7fd1cb6f1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c409f130 con 0x7fd1c409e000 2023-10-03T10:18:48.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.741+0000 7fd1cb6f1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c409f520 con 0x7fd1c409e410 2023-10-03T10:18:48.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.741+0000 7fd1cb6f1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c409e930 con 0x7fd1c409d6f0 2023-10-03T10:18:48.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.741+0000 7fd1c8c8c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd1c409e000 0x7fd1c4130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48748/0 (socket says 172.21.15.72:48748) 2023-10-03T10:18:48.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.741+0000 7fd1c8c8c700 1 -- 172.21.15.72:0/1991457445 learned_addr learned my addr 172.21.15.72:0/1991457445 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:48.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.741+0000 7fd1c948d700 1 --2- 172.21.15.72:0/1991457445 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1c409d6f0 0x7fd1c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.741+0000 7fd1c9c8e700 1 --2- 172.21.15.72:0/1991457445 >> v2:172.21.15.72:3300/0 conn(0x7fd1c409e410 0x7fd1c4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.742+0000 7fd1c948d700 1 -- 172.21.15.72:0/1991457445 >> v2:172.21.15.72:3300/0 conn(0x7fd1c409e410 msgr2=0x7fd1c4130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.742+0000 7fd1c948d700 1 --2- 172.21.15.72:0/1991457445 >> v2:172.21.15.72:3300/0 conn(0x7fd1c409e410 0x7fd1c4130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.742+0000 7fd1c948d700 1 -- 172.21.15.72:0/1991457445 >> v1:172.21.15.72:6789/0 conn(0x7fd1c409e000 legacy=0x7fd1c4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.742+0000 7fd1c948d700 1 -- 172.21.15.72:0/1991457445 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c409b2d0 con 0x7fd1c409d6f0 2023-10-03T10:18:48.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.742+0000 7fd1c948d700 1 --2- 172.21.15.72:0/1991457445 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1c409d6f0 0x7fd1c409dac0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009840 tx=0x7fd1c0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33e2df6417e7016 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.746+0000 7fd1bbfff700 1 -- 172.21.15.72:0/1991457445 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0011830 con 0x7fd1c409d6f0 2023-10-03T10:18:48.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.746+0000 7fd1bbfff700 1 -- 172.21.15.72:0/1991457445 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c0011990 con 0x7fd1c409d6f0 2023-10-03T10:18:48.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.746+0000 7fd1bbfff700 1 -- 172.21.15.72:0/1991457445 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0011d20 con 0x7fd1c409d6f0 2023-10-03T10:18:48.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.747+0000 7fd1cb6f1700 1 -- 172.21.15.72:0/1991457445 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1c409d6f0 msgr2=0x7fd1c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.747+0000 7fd1cb6f1700 1 --2- 172.21.15.72:0/1991457445 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1c409d6f0 0x7fd1c409dac0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009840 tx=0x7fd1c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.747+0000 7fd1cb6f1700 1 -- 172.21.15.72:0/1991457445 shutdown_connections 2023-10-03T10:18:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.747+0000 7fd1cb6f1700 1 --2- 172.21.15.72:0/1991457445 >> v2:172.21.15.72:3300/0 conn(0x7fd1c409e410 0x7fd1c4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.747+0000 7fd1cb6f1700 1 --2- 172.21.15.72:0/1991457445 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1c409d6f0 0x7fd1c409dac0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.747+0000 7fd1cb6f1700 1 -- 172.21.15.72:0/1991457445 >> 172.21.15.72:0/1991457445 conn(0x7fd1c4066f50 msgr2=0x7fd1c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.747+0000 7fd1cb6f1700 1 -- 172.21.15.72:0/1991457445 shutdown_connections 2023-10-03T10:18:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.747+0000 7fd1cb6f1700 1 -- 172.21.15.72:0/1991457445 wait complete. 2023-10-03T10:18:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.748+0000 7fd1cb6f1700 1 Processor -- start 2023-10-03T10:18:48.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.748+0000 7fd1cb6f1700 1 -- start start 2023-10-03T10:18:48.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1cb6f1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1c409d6f0 0x7fd1c41204c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1cb6f1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c409e000 0x7fd1c4120a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1cb6f1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1c409e410 0x7fd1c4120f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1cb6f1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4122190 con 0x7fd1c409e000 2023-10-03T10:18:48.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1cb6f1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4123cb0 con 0x7fd1c409e410 2023-10-03T10:18:48.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1cb6f1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40a2030 con 0x7fd1c409d6f0 2023-10-03T10:18:48.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1c8c8c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c409e000 0x7fd1c4120a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1c8c8c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c409e000 0x7fd1c4120a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50830/0 (socket says 172.21.15.72:50830) 2023-10-03T10:18:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1c8c8c700 1 -- 172.21.15.72:0/118678796 learned_addr learned my addr 172.21.15.72:0/118678796 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1c9c8e700 1 --2- 172.21.15.72:0/118678796 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1c409e410 0x7fd1c4120f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1c948d700 1 --2- 172.21.15.72:0/118678796 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1c409d6f0 0x7fd1c41204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1c9c8e700 1 -- 172.21.15.72:0/118678796 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1c409d6f0 msgr2=0x7fd1c41204c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1c9c8e700 1 --2- 172.21.15.72:0/118678796 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1c409d6f0 0x7fd1c41204c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1c9c8e700 1 -- 172.21.15.72:0/118678796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c409e000 msgr2=0x7fd1c4120a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1c9c8e700 1 --2- 172.21.15.72:0/118678796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c409e000 0x7fd1c4120a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.749+0000 7fd1c9c8e700 1 -- 172.21.15.72:0/118678796 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c00094a0 con 0x7fd1c409e410 2023-10-03T10:18:48.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.750+0000 7fd1c9c8e700 1 --2- 172.21.15.72:0/118678796 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1c409e410 0x7fd1c4120f40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00ef90 tx=0x7fd1bc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.752+0000 7fd1b9ffb700 1 -- 172.21.15.72:0/118678796 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc00cc90 con 0x7fd1c409e410 2023-10-03T10:18:48.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.752+0000 7fd1b9ffb700 1 -- 172.21.15.72:0/118678796 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc00f040 con 0x7fd1c409e410 2023-10-03T10:18:48.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.752+0000 7fd1b9ffb700 1 -- 172.21.15.72:0/118678796 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0146c0 con 0x7fd1c409e410 2023-10-03T10:18:48.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.752+0000 7fd1cb6f1700 1 -- 172.21.15.72:0/118678796 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c409c700 con 0x7fd1c409e410 2023-10-03T10:18:48.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.752+0000 7fd1cb6f1700 1 -- 172.21.15.72:0/118678796 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c4124720 con 0x7fd1c409e410 2023-10-03T10:18:48.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.753+0000 7fd1cb6f1700 1 -- 172.21.15.72:0/118678796 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c409dcd0 con 0x7fd1c409e410 2023-10-03T10:18:48.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.754+0000 7fd1b9ffb700 1 -- 172.21.15.72:0/118678796 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1bc014820 con 0x7fd1c409e410 2023-10-03T10:18:48.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.754+0000 7fd1b9ffb700 1 -- 172.21.15.72:0/118678796 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd1bc0403d0 con 0x7fd1c409e410 2023-10-03T10:18:48.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.763+0000 7fd1b9ffb700 1 -- 172.21.15.72:0/118678796 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1bc012930 con 0x7fd1c409e410 2023-10-03T10:18:48.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.794+0000 7f6d2ae40700 1 Processor -- start 2023-10-03T10:18:48.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.794+0000 7f6d2ae40700 1 -- start start 2023-10-03T10:18:48.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d2ae40700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6d241316c0 0x7f6d24131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d2ae40700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d2409d9f0 0x7f6d2406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d2ae40700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6d2406acb0 0x7f6d2406b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d2ae40700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2409e130 con 0x7f6d241316c0 2023-10-03T10:18:48.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d2ae40700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d241312b0 con 0x7f6d2409d9f0 2023-10-03T10:18:48.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d2ae40700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2409f6e0 con 0x7f6d2406acb0 2023-10-03T10:18:48.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d23fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d2409d9f0 0x7f6d2406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d23fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d2409d9f0 0x7f6d2406a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40618/0 (socket says 172.21.15.72:40618) 2023-10-03T10:18:48.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d23fff700 1 -- 172.21.15.72:0/4205521342 learned_addr learned my addr 172.21.15.72:0/4205521342 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:48.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d28bdc700 1 --2- 172.21.15.72:0/4205521342 >> v2:172.21.15.72:3300/0 conn(0x7f6d241316c0 0x7f6d24131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d293dd700 1 --2- 172.21.15.72:0/4205521342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6d2406acb0 0x7f6d2406b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d23fff700 1 -- 172.21.15.72:0/4205521342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6d2406acb0 msgr2=0x7f6d2406b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d23fff700 1 --2- 172.21.15.72:0/4205521342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6d2406acb0 0x7f6d2406b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d23fff700 1 -- 172.21.15.72:0/4205521342 >> v2:172.21.15.72:3300/0 conn(0x7f6d241316c0 msgr2=0x7f6d24131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d23fff700 1 --2- 172.21.15.72:0/4205521342 >> v2:172.21.15.72:3300/0 conn(0x7f6d241316c0 0x7f6d24131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d23fff700 1 -- 172.21.15.72:0/4205521342 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2409e760 con 0x7f6d2409d9f0 2023-10-03T10:18:48.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d23fff700 1 --2- 172.21.15.72:0/4205521342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d2409d9f0 0x7f6d2406a770 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6d100098f0 tx=0x7f6d10009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68303e56cddd92c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.795+0000 7f6d237fe700 1 -- 172.21.15.72:0/4205521342 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10011830 con 0x7f6d2409d9f0 2023-10-03T10:18:48.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.796+0000 7f6d237fe700 1 -- 172.21.15.72:0/4205521342 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d10011990 con 0x7f6d2409d9f0 2023-10-03T10:18:48.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.796+0000 7f6d237fe700 1 -- 172.21.15.72:0/4205521342 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10011d20 con 0x7f6d2409d9f0 2023-10-03T10:18:48.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.796+0000 7f6d2ae40700 1 -- 172.21.15.72:0/4205521342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d2409d9f0 msgr2=0x7f6d2406a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.796+0000 7f6d2ae40700 1 --2- 172.21.15.72:0/4205521342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d2409d9f0 0x7f6d2406a770 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6d100098f0 tx=0x7f6d10009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:48.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.796+0000 7f6d2ae40700 1 -- 172.21.15.72:0/4205521342 shutdown_connections 2023-10-03T10:18:48.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.797+0000 7f6d2ae40700 1 --2- 172.21.15.72:0/4205521342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6d2406acb0 0x7f6d2406b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.797+0000 7f6d2ae40700 1 --2- 172.21.15.72:0/4205521342 >> v2:172.21.15.72:3300/0 conn(0x7f6d241316c0 0x7f6d24131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.797+0000 7f6d2ae40700 1 --2- 172.21.15.72:0/4205521342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d2409d9f0 0x7f6d2406a770 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.797+0000 7f6d2ae40700 1 -- 172.21.15.72:0/4205521342 >> 172.21.15.72:0/4205521342 conn(0x7f6d24066f50 msgr2=0x7f6d2409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.797+0000 7f6d2ae40700 1 -- 172.21.15.72:0/4205521342 shutdown_connections 2023-10-03T10:18:48.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.797+0000 7f6d2ae40700 1 -- 172.21.15.72:0/4205521342 wait complete. 2023-10-03T10:18:48.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.798+0000 7f6d2ae40700 1 Processor -- start 2023-10-03T10:18:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.798+0000 7f6d2ae40700 1 -- start start 2023-10-03T10:18:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d2ae40700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d2406acb0 0x7f6d240708b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d2ae40700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d2409d9f0 0x7f6d24070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d2ae40700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6d241316c0 0x7f6d24071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d2ae40700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2411ad30 con 0x7f6d2409d9f0 2023-10-03T10:18:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d2ae40700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d24119cd0 con 0x7f6d2406acb0 2023-10-03T10:18:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d2ae40700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d240a3660 con 0x7f6d241316c0 2023-10-03T10:18:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d28bdc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d2406acb0 0x7f6d240708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d28bdc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d2406acb0 0x7f6d240708b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40634/0 (socket says 172.21.15.72:40634) 2023-10-03T10:18:48.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d28bdc700 1 -- 172.21.15.72:0/710304424 learned_addr learned my addr 172.21.15.72:0/710304424 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:48.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d293dd700 1 --2- 172.21.15.72:0/710304424 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6d241316c0 0x7f6d24071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d23fff700 1 --2- 172.21.15.72:0/710304424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d2409d9f0 0x7f6d24070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d28bdc700 1 -- 172.21.15.72:0/710304424 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6d241316c0 msgr2=0x7f6d24071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d28bdc700 1 --2- 172.21.15.72:0/710304424 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6d241316c0 0x7f6d24071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d28bdc700 1 -- 172.21.15.72:0/710304424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d2409d9f0 msgr2=0x7f6d24070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d28bdc700 1 --2- 172.21.15.72:0/710304424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d2409d9f0 0x7f6d24070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d28bdc700 1 -- 172.21.15.72:0/710304424 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d10009550 con 0x7f6d2406acb0 2023-10-03T10:18:48.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.799+0000 7f6d23fff700 1 --2- 172.21.15.72:0/710304424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d2409d9f0 0x7f6d24070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:48.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.800+0000 7f6d28bdc700 1 --2- 172.21.15.72:0/710304424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d2406acb0 0x7f6d240708b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800e9b0 tx=0x7f6d1800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.800+0000 7f6d217fa700 1 -- 172.21.15.72:0/710304424 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18009710 con 0x7f6d2406acb0 2023-10-03T10:18:48.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.800+0000 7f6d217fa700 1 -- 172.21.15.72:0/710304424 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1800c850 con 0x7f6d2406acb0 2023-10-03T10:18:48.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.800+0000 7f6d217fa700 1 -- 172.21.15.72:0/710304424 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1800cbc0 con 0x7f6d2406acb0 2023-10-03T10:18:48.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.800+0000 7f6d2ae40700 1 -- 172.21.15.72:0/710304424 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2412b900 con 0x7f6d2406acb0 2023-10-03T10:18:48.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.800+0000 7f6d2ae40700 1 -- 172.21.15.72:0/710304424 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d241285e0 con 0x7f6d2406acb0 2023-10-03T10:18:48.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.801+0000 7f6d217fa700 1 -- 172.21.15.72:0/710304424 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d1800cd20 con 0x7f6d2406acb0 2023-10-03T10:18:48.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.801+0000 7f6d2ae40700 1 -- 172.21.15.72:0/710304424 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d24074ea0 con 0x7f6d2406acb0 2023-10-03T10:18:48.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.802+0000 7f6d217fa700 1 -- 172.21.15.72:0/710304424 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6d1803fc00 con 0x7f6d2406acb0 2023-10-03T10:18:48.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.810+0000 7f6d217fa700 1 -- 172.21.15.72:0/710304424 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d18021080 con 0x7f6d2406acb0 2023-10-03T10:18:48.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.843+0000 7f3b9603e700 1 Processor -- start 2023-10-03T10:18:48.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.843+0000 7f3b9603e700 1 -- start start 2023-10-03T10:18:48.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.844+0000 7f3b9603e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3b90131810 0x7f3b90131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.844+0000 7f3b9603e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b90099a40 0x7f3b90099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.844+0000 7f3b9603e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b901313c0 con 0x7f3b9009a3b0 2023-10-03T10:18:48.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.844+0000 7f3b9603e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9009b580 con 0x7f3b90131810 2023-10-03T10:18:48.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.844+0000 7f3b9603e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9006e8c0 con 0x7f3b90099a40 2023-10-03T10:18:48.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.844+0000 7f3b8effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b90099a40 0x7f3b90099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.844+0000 7f3b8effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b90099a40 0x7f3b90099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36152/0 (socket says 172.21.15.72:36152) 2023-10-03T10:18:48.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.844+0000 7f3b8f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3b90131810 0x7f3b90131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.844+0000 7f3b8effd700 1 -- 172.21.15.72:0/1656447348 learned_addr learned my addr 172.21.15.72:0/1656447348 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:48.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.844+0000 7f3b8effd700 1 -- 172.21.15.72:0/1656447348 >> v2:172.21.15.72:3300/0 conn(0x7f3b90131810 msgr2=0x7f3b90131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.844+0000 7f3b8effd700 1 --2- 172.21.15.72:0/1656447348 >> v2:172.21.15.72:3300/0 conn(0x7f3b90131810 0x7f3b90131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.844+0000 7f3b8effd700 1 -- 172.21.15.72:0/1656447348 >> v1:172.21.15.72:6789/0 conn(0x7f3b9009a3b0 legacy=0x7f3b90138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.844+0000 7f3b8effd700 1 -- 172.21.15.72:0/1656447348 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9009a830 con 0x7f3b90099a40 2023-10-03T10:18:48.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.844+0000 7f3b8f7fe700 1 --2- 172.21.15.72:0/1656447348 >> v2:172.21.15.72:3300/0 conn(0x7f3b90131810 0x7f3b90131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.844+0000 7f3b8effd700 1 --2- 172.21.15.72:0/1656447348 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b90099a40 0x7f3b90099e70 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009920 tx=0x7f3b84009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f641355d8d2c1442 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.845+0000 7f3b8e7fc700 1 -- 172.21.15.72:0/1656447348 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84011830 con 0x7f3b90099a40 2023-10-03T10:18:48.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.845+0000 7f3b8e7fc700 1 -- 172.21.15.72:0/1656447348 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b84011990 con 0x7f3b90099a40 2023-10-03T10:18:48.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.845+0000 7f3b8e7fc700 1 -- 172.21.15.72:0/1656447348 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84011d20 con 0x7f3b90099a40 2023-10-03T10:18:48.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.845+0000 7f3b9603e700 1 -- 172.21.15.72:0/1656447348 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b90099a40 msgr2=0x7f3b90099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.845+0000 7f3b9603e700 1 --2- 172.21.15.72:0/1656447348 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b90099a40 0x7f3b90099e70 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009920 tx=0x7f3b84009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:48.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.846+0000 7f3b9603e700 1 -- 172.21.15.72:0/1656447348 shutdown_connections 2023-10-03T10:18:48.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.846+0000 7f3b9603e700 1 --2- 172.21.15.72:0/1656447348 >> v2:172.21.15.72:3300/0 conn(0x7f3b90131810 0x7f3b90131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.846+0000 7f3b9603e700 1 --2- 172.21.15.72:0/1656447348 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b90099a40 0x7f3b90099e70 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.846+0000 7f3b9603e700 1 -- 172.21.15.72:0/1656447348 >> 172.21.15.72:0/1656447348 conn(0x7f3b900a2aa0 msgr2=0x7f3b900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.846+0000 7f3b9603e700 1 -- 172.21.15.72:0/1656447348 shutdown_connections 2023-10-03T10:18:48.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.846+0000 7f3b9603e700 1 -- 172.21.15.72:0/1656447348 wait complete. 2023-10-03T10:18:48.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.847+0000 7f3b9603e700 1 Processor -- start 2023-10-03T10:18:48.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.847+0000 7f3b9603e700 1 -- start start 2023-10-03T10:18:48.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.848+0000 7f3b9603e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b90099a40 0x7f3b9006f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.848+0000 7f3b9603e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9009a3b0 0x7f3b9006fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.848+0000 7f3b9603e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b90131810 0x7f3b90070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.848+0000 7f3b9603e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b90121610 con 0x7f3b90099a40 2023-10-03T10:18:48.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.848+0000 7f3b9603e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b900a1c50 con 0x7f3b9009a3b0 2023-10-03T10:18:48.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.848+0000 7f3b9603e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9006eb00 con 0x7f3b90131810 2023-10-03T10:18:48.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.848+0000 7f3b8effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9009a3b0 0x7f3b9006fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.848+0000 7f3b8f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b90099a40 0x7f3b9006f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.848+0000 7f3b8effd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9009a3b0 0x7f3b9006fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40638/0 (socket says 172.21.15.72:40638) 2023-10-03T10:18:48.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.848+0000 7f3b8effd700 1 -- 172.21.15.72:0/1611833579 learned_addr learned my addr 172.21.15.72:0/1611833579 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:48.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.848+0000 7f3b8f7fe700 1 -- 172.21.15.72:0/1611833579 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b90131810 msgr2=0x7f3b90070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.848+0000 7f3b8f7fe700 1 --2- 172.21.15.72:0/1611833579 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b90131810 0x7f3b90070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.848+0000 7f3b8f7fe700 1 -- 172.21.15.72:0/1611833579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9009a3b0 msgr2=0x7f3b9006fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.848+0000 7f3b8f7fe700 1 --2- 172.21.15.72:0/1611833579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9009a3b0 0x7f3b9006fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.848+0000 7f3b8f7fe700 1 -- 172.21.15.72:0/1611833579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b800094a0 con 0x7f3b90099a40 2023-10-03T10:18:48.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.849+0000 7f3b8f7fe700 1 --2- 172.21.15.72:0/1611833579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b90099a40 0x7f3b9006f610 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000e9b0 tx=0x7f3b8000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.849+0000 7f3b77fff700 1 -- 172.21.15.72:0/1611833579 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000c850 con 0x7f3b90099a40 2023-10-03T10:18:48.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.849+0000 7f3b77fff700 1 -- 172.21.15.72:0/1611833579 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8000c9b0 con 0x7f3b90099a40 2023-10-03T10:18:48.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.849+0000 7f3b77fff700 1 -- 172.21.15.72:0/1611833579 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000cd60 con 0x7f3b90099a40 2023-10-03T10:18:48.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.849+0000 7f3b9603e700 1 -- 172.21.15.72:0/1611833579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b84009550 con 0x7f3b90099a40 2023-10-03T10:18:48.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.849+0000 7f3b9603e700 1 -- 172.21.15.72:0/1611833579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b90120520 con 0x7f3b90099a40 2023-10-03T10:18:48.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.850+0000 7f3b77fff700 1 -- 172.21.15.72:0/1611833579 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3b80013470 con 0x7f3b90099a40 2023-10-03T10:18:48.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.850+0000 7f3b77fff700 1 -- 172.21.15.72:0/1611833579 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3b800421c0 con 0x7f3b90099a40 2023-10-03T10:18:48.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.850+0000 7f3b9603e700 1 -- 172.21.15.72:0/1611833579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b700052e0 con 0x7f3b90099a40 2023-10-03T10:18:48.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.859+0000 7f3b77fff700 1 -- 172.21.15.72:0/1611833579 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3b80017020 con 0x7f3b90099a40 2023-10-03T10:18:48.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.918+0000 7fe2bdfac700 1 -- 172.21.15.72:0/2977615692 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe2b806c360 con 0x7fe2b809e000 2023-10-03T10:18:48.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.918+0000 7fe29ffff700 1 -- 172.21.15.72:0/2977615692 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe2ac02a090 con 0x7fe2b809e000 2023-10-03T10:18:48.919 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:48.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.921+0000 7fe2bdfac700 1 -- 172.21.15.72:0/2977615692 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b809e000 msgr2=0x7fe2b81a6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.921+0000 7fe2bdfac700 1 --2- 172.21.15.72:0/2977615692 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b809e000 0x7fe2b81a6630 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00e900 tx=0x7fe2ac00ec10 comp rx=0 tx=0).stop 2023-10-03T10:18:48.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.921+0000 7fe2bdfac700 1 -- 172.21.15.72:0/2977615692 shutdown_connections 2023-10-03T10:18:48.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.921+0000 7fe2bdfac700 1 --2- 172.21.15.72:0/2977615692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2b809e410 0x7fe2b81a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.921+0000 7fe2bdfac700 1 --2- 172.21.15.72:0/2977615692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2b809d6f0 0x7fe2b81a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.921+0000 7fe2bdfac700 1 --2- 172.21.15.72:0/2977615692 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe2b809e000 0x7fe2b81a6630 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.921+0000 7fe2bdfac700 1 -- 172.21.15.72:0/2977615692 >> 172.21.15.72:0/2977615692 conn(0x7fe2b8066f50 msgr2=0x7fe2b81baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.922+0000 7fe2bdfac700 1 -- 172.21.15.72:0/2977615692 shutdown_connections 2023-10-03T10:18:48.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.922+0000 7fe2bdfac700 1 -- 172.21.15.72:0/2977615692 wait complete. 2023-10-03T10:18:48.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:48.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.969+0000 7fd1cb6f1700 1 -- 172.21.15.72:0/118678796 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd1c4074ea0 con 0x7fd1c409e410 2023-10-03T10:18:48.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.969+0000 7fd1b9ffb700 1 -- 172.21.15.72:0/118678796 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd1bc012340 con 0x7fd1c409e410 2023-10-03T10:18:48.970 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:48.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.973+0000 7fd1cb6f1700 1 -- 172.21.15.72:0/118678796 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1c409e410 msgr2=0x7fd1c4120f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.973+0000 7fd1cb6f1700 1 --2- 172.21.15.72:0/118678796 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1c409e410 0x7fd1c4120f40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00ef90 tx=0x7fd1bc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.973+0000 7fd1cb6f1700 1 -- 172.21.15.72:0/118678796 shutdown_connections 2023-10-03T10:18:48.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.973+0000 7fd1cb6f1700 1 --2- 172.21.15.72:0/118678796 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1c409e410 0x7fd1c4120f40 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.973+0000 7fd1cb6f1700 1 --2- 172.21.15.72:0/118678796 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd1c409d6f0 0x7fd1c41204c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.973+0000 7fd1cb6f1700 1 --2- 172.21.15.72:0/118678796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c409e000 0x7fd1c4120a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.973+0000 7fd1cb6f1700 1 -- 172.21.15.72:0/118678796 >> 172.21.15.72:0/118678796 conn(0x7fd1c4066f50 msgr2=0x7fd1c40a2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.974+0000 7fd1cb6f1700 1 -- 172.21.15.72:0/118678796 shutdown_connections 2023-10-03T10:18:48.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:48.974+0000 7fd1cb6f1700 1 -- 172.21.15.72:0/118678796 wait complete. 2023-10-03T10:18:48.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.017+0000 7f6d2ae40700 1 -- 172.21.15.72:0/710304424 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6d2409e980 con 0x7f6d2406acb0 2023-10-03T10:18:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.017+0000 7f6d217fa700 1 -- 172.21.15.72:0/710304424 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6d18017020 con 0x7f6d2406acb0 2023-10-03T10:18:49.018 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.020+0000 7f6d2ae40700 1 -- 172.21.15.72:0/710304424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d2406acb0 msgr2=0x7f6d240708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.020+0000 7f6d2ae40700 1 --2- 172.21.15.72:0/710304424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d2406acb0 0x7f6d240708b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800e9b0 tx=0x7f6d1800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.020+0000 7f6d2ae40700 1 -- 172.21.15.72:0/710304424 shutdown_connections 2023-10-03T10:18:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.020+0000 7f6d2ae40700 1 --2- 172.21.15.72:0/710304424 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6d241316c0 0x7f6d24071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.020+0000 7f6d2ae40700 1 --2- 172.21.15.72:0/710304424 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6d2406acb0 0x7f6d240708b0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.020+0000 7f6d2ae40700 1 --2- 172.21.15.72:0/710304424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d2409d9f0 0x7f6d24070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.020+0000 7f6d2ae40700 1 -- 172.21.15.72:0/710304424 >> 172.21.15.72:0/710304424 conn(0x7f6d24066f50 msgr2=0x7f6d240a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.020+0000 7f6d2ae40700 1 -- 172.21.15.72:0/710304424 shutdown_connections 2023-10-03T10:18:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.020+0000 7f6d2ae40700 1 -- 172.21.15.72:0/710304424 wait complete. 2023-10-03T10:18:49.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.055+0000 7f3b9603e700 1 -- 172.21.15.72:0/1611833579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3b70005590 con 0x7f3b90099a40 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.056+0000 7f3b77fff700 1 -- 172.21.15.72:0/1611833579 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3b80044060 con 0x7f3b90099a40 2023-10-03T10:18:49.056 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:49.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.058+0000 7f3b9603e700 1 -- 172.21.15.72:0/1611833579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b90099a40 msgr2=0x7f3b9006f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.058+0000 7f3b9603e700 1 --2- 172.21.15.72:0/1611833579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b90099a40 0x7f3b9006f610 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000e9b0 tx=0x7f3b8000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.058+0000 7f3b9603e700 1 -- 172.21.15.72:0/1611833579 shutdown_connections 2023-10-03T10:18:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.058+0000 7f3b9603e700 1 --2- 172.21.15.72:0/1611833579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b90099a40 0x7f3b9006f610 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.058+0000 7f3b9603e700 1 --2- 172.21.15.72:0/1611833579 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3b90131810 0x7f3b90070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.058+0000 7f3b9603e700 1 --2- 172.21.15.72:0/1611833579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b9009a3b0 0x7f3b9006fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.058+0000 7f3b9603e700 1 -- 172.21.15.72:0/1611833579 >> 172.21.15.72:0/1611833579 conn(0x7f3b900a2aa0 msgr2=0x7f3b9009d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.058+0000 7f3b9603e700 1 -- 172.21.15.72:0/1611833579 shutdown_connections 2023-10-03T10:18:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:49.058+0000 7f3b9603e700 1 -- 172.21.15.72:0/1611833579 wait complete. 2023-10-03T10:18:49.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:49.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:49.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:50.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:50.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:50.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.082+0000 7f4958fad700 1 Processor -- start 2023-10-03T10:18:50.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.082+0000 7f4958fad700 1 -- start start 2023-10-03T10:18:50.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.083+0000 7f4958fad700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495412cf60 0x7f495406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.083+0000 7f4958fad700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4954130430 0x7f4954137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.083+0000 7f4958fad700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f495412cd90 con 0x7f495412f8b0 2023-10-03T10:18:50.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.083+0000 7f4958fad700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495412d330 con 0x7f4954130430 2023-10-03T10:18:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.083+0000 7f4958fad700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4954071780 con 0x7f495412cf60 2023-10-03T10:18:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.083+0000 7f495259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495412cf60 0x7f495406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.083+0000 7f495259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495412cf60 0x7f495406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40650/0 (socket says 172.21.15.72:40650) 2023-10-03T10:18:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.083+0000 7f495259c700 1 -- 172.21.15.72:0/3864328206 learned_addr learned my addr 172.21.15.72:0/3864328206 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.083+0000 7f4952d9d700 1 --2- 172.21.15.72:0/3864328206 >> v2:172.21.15.72:3300/0 conn(0x7f4954130430 0x7f4954137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.083+0000 7f495259c700 1 -- 172.21.15.72:0/3864328206 >> v2:172.21.15.72:3300/0 conn(0x7f4954130430 msgr2=0x7f4954137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.083+0000 7f495259c700 1 --2- 172.21.15.72:0/3864328206 >> v2:172.21.15.72:3300/0 conn(0x7f4954130430 0x7f4954137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.083+0000 7f495259c700 1 -- 172.21.15.72:0/3864328206 >> v1:172.21.15.72:6789/0 conn(0x7f495412f8b0 legacy=0x7f495412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.083+0000 7f495259c700 1 -- 172.21.15.72:0/3864328206 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4954071a40 con 0x7f495412cf60 2023-10-03T10:18:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.083+0000 7f495259c700 1 --2- 172.21.15.72:0/3864328206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495412cf60 0x7f495406f5d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f49440098f0 tx=0x7f4944009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79c301a87c397959 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.084+0000 7f495159a700 1 -- 172.21.15.72:0/3864328206 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494400b8a0 con 0x7f495412cf60 2023-10-03T10:18:50.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.084+0000 7f495159a700 1 -- 172.21.15.72:0/3864328206 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494400ba00 con 0x7f495412cf60 2023-10-03T10:18:50.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.084+0000 7f495159a700 1 -- 172.21.15.72:0/3864328206 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494400bd90 con 0x7f495412cf60 2023-10-03T10:18:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.085+0000 7f4958fad700 1 -- 172.21.15.72:0/3864328206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495412cf60 msgr2=0x7f495406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.085+0000 7f4958fad700 1 --2- 172.21.15.72:0/3864328206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495412cf60 0x7f495406f5d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f49440098f0 tx=0x7f4944009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.085+0000 7f4958fad700 1 -- 172.21.15.72:0/3864328206 shutdown_connections 2023-10-03T10:18:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.085+0000 7f4958fad700 1 --2- 172.21.15.72:0/3864328206 >> v2:172.21.15.72:3300/0 conn(0x7f4954130430 0x7f4954137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.085+0000 7f4958fad700 1 --2- 172.21.15.72:0/3864328206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495412cf60 0x7f495406f5d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.085+0000 7f4958fad700 1 -- 172.21.15.72:0/3864328206 >> 172.21.15.72:0/3864328206 conn(0x7f49540a2aa0 msgr2=0x7f49540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.085+0000 7f4958fad700 1 -- 172.21.15.72:0/3864328206 shutdown_connections 2023-10-03T10:18:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.085+0000 7f4958fad700 1 -- 172.21.15.72:0/3864328206 wait complete. 2023-10-03T10:18:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.086+0000 7f4958fad700 1 Processor -- start 2023-10-03T10:18:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.086+0000 7f4958fad700 1 -- start start 2023-10-03T10:18:50.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.087+0000 7f4958fad700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495412cf60 0x7f495409bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.087+0000 7f4958fad700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495412f8b0 0x7f495409c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.087+0000 7f4958fad700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4954130430 0x7f49541c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.087+0000 7f4958fad700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495409b840 con 0x7f495412f8b0 2023-10-03T10:18:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.087+0000 7f4958fad700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495412f5d0 con 0x7f495412cf60 2023-10-03T10:18:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.087+0000 7f4958fad700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f495409e8b0 con 0x7f4954130430 2023-10-03T10:18:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.087+0000 7f495259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495412cf60 0x7f495409bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.087+0000 7f495259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495412cf60 0x7f495409bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40666/0 (socket says 172.21.15.72:40666) 2023-10-03T10:18:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.087+0000 7f495259c700 1 -- 172.21.15.72:0/1360377246 learned_addr learned my addr 172.21.15.72:0/1360377246 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.087+0000 7f4952d9d700 1 --2- 172.21.15.72:0/1360377246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4954130430 0x7f49541c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.087+0000 7f4951d9b700 1 --2- 172.21.15.72:0/1360377246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495412f8b0 0x7f495409c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.088+0000 7f495259c700 1 -- 172.21.15.72:0/1360377246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4954130430 msgr2=0x7f49541c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.088+0000 7f495259c700 1 --2- 172.21.15.72:0/1360377246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4954130430 0x7f49541c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.088+0000 7f495259c700 1 -- 172.21.15.72:0/1360377246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495412f8b0 msgr2=0x7f495409c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.088+0000 7f495259c700 1 --2- 172.21.15.72:0/1360377246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495412f8b0 0x7f495409c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.088+0000 7f495259c700 1 -- 172.21.15.72:0/1360377246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4944009550 con 0x7f495412cf60 2023-10-03T10:18:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.088+0000 7f4952d9d700 1 --2- 172.21.15.72:0/1360377246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4954130430 0x7f49541c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.088+0000 7f495259c700 1 --2- 172.21.15.72:0/1360377246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495412cf60 0x7f495409bb00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4944009c40 tx=0x7f4944004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.088+0000 7f4942ffd700 1 -- 172.21.15.72:0/1360377246 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944004510 con 0x7f495412cf60 2023-10-03T10:18:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.088+0000 7f4942ffd700 1 -- 172.21.15.72:0/1360377246 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494401f840 con 0x7f495412cf60 2023-10-03T10:18:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.088+0000 7f4942ffd700 1 -- 172.21.15.72:0/1360377246 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494401fbd0 con 0x7f495412cf60 2023-10-03T10:18:50.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.088+0000 7f4958fad700 1 -- 172.21.15.72:0/1360377246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f495409dea0 con 0x7f495412cf60 2023-10-03T10:18:50.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.088+0000 7f4958fad700 1 -- 172.21.15.72:0/1360377246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4954129fa0 con 0x7f495412cf60 2023-10-03T10:18:50.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.089+0000 7f4942ffd700 1 -- 172.21.15.72:0/1360377246 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4944025070 con 0x7f495412cf60 2023-10-03T10:18:50.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.089+0000 7f4942ffd700 1 -- 172.21.15.72:0/1360377246 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4944044f30 con 0x7f495412cf60 2023-10-03T10:18:50.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.090+0000 7f4958fad700 1 -- 172.21.15.72:0/1360377246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f495409ec90 con 0x7f495412cf60 2023-10-03T10:18:50.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.094+0000 7f4942ffd700 1 -- 172.21.15.72:0/1360377246 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f494402d020 con 0x7f495412cf60 2023-10-03T10:18:50.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.124+0000 7f0b7e3c5700 1 Processor -- start 2023-10-03T10:18:50.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.124+0000 7f0b7e3c5700 1 -- start start 2023-10-03T10:18:50.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.125+0000 7f0b7e3c5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b7809d6f0 0x7f0b7809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.125+0000 7f0b7e3c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7809e410 0x7f0b78134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.125+0000 7f0b7e3c5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7809b120 con 0x7f0b7809e000 2023-10-03T10:18:50.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.125+0000 7f0b7e3c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7806b460 con 0x7f0b7809e410 2023-10-03T10:18:50.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.125+0000 7f0b7e3c5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7809a7e0 con 0x7f0b7809d6f0 2023-10-03T10:18:50.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.125+0000 7f0b777fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0b7809e000 0x7f0b781339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48780/0 (socket says 172.21.15.72:48780) 2023-10-03T10:18:50.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.125+0000 7f0b777fe700 1 -- 172.21.15.72:0/3356722259 learned_addr learned my addr 172.21.15.72:0/3356722259 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:50.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.125+0000 7f0b7c962700 1 --2- 172.21.15.72:0/3356722259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7809e410 0x7f0b78134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.125+0000 7f0b76ffd700 1 -- 172.21.15.72:0/3356722259 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13535692 0 0) 0x7f0b7809b120 con 0x7f0b7809e000 2023-10-03T10:18:50.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.125+0000 7f0b76ffd700 1 -- 172.21.15.72:0/3356722259 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b600035b0 con 0x7f0b7809e000 2023-10-03T10:18:50.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.125+0000 7f0b77fff700 1 --2- 172.21.15.72:0/3356722259 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b7809d6f0 0x7f0b7809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.125+0000 7f0b7c962700 1 -- 172.21.15.72:0/3356722259 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b7809d6f0 msgr2=0x7f0b7809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.125+0000 7f0b7c962700 1 --2- 172.21.15.72:0/3356722259 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b7809d6f0 0x7f0b7809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.125+0000 7f0b7c962700 1 -- 172.21.15.72:0/3356722259 >> v1:172.21.15.72:6789/0 conn(0x7f0b7809e000 legacy=0x7f0b781339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.126+0000 7f0b7c962700 1 -- 172.21.15.72:0/3356722259 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7809a500 con 0x7f0b7809e410 2023-10-03T10:18:50.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.126+0000 7f0b77fff700 1 --2- 172.21.15.72:0/3356722259 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b7809d6f0 0x7f0b7809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.126+0000 7f0b7c962700 1 --2- 172.21.15.72:0/3356722259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7809e410 0x7f0b78134100 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009dc0 tx=0x7f0b7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1384a76b06047b9a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.126+0000 7f0b76ffd700 1 -- 172.21.15.72:0/3356722259 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7000e070 con 0x7f0b7809e410 2023-10-03T10:18:50.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.126+0000 7f0b76ffd700 1 -- 172.21.15.72:0/3356722259 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7000bb20 con 0x7f0b7809e410 2023-10-03T10:18:50.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.126+0000 7f0b76ffd700 1 -- 172.21.15.72:0/3356722259 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b70012430 con 0x7f0b7809e410 2023-10-03T10:18:50.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.127+0000 7f0b7e3c5700 1 -- 172.21.15.72:0/3356722259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7809e410 msgr2=0x7f0b78134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.127+0000 7f0b7e3c5700 1 --2- 172.21.15.72:0/3356722259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7809e410 0x7f0b78134100 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009dc0 tx=0x7f0b7000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:50.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.127+0000 7f0b7e3c5700 1 -- 172.21.15.72:0/3356722259 shutdown_connections 2023-10-03T10:18:50.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.127+0000 7f0b7e3c5700 1 --2- 172.21.15.72:0/3356722259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7809e410 0x7f0b78134100 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.127+0000 7f0b7e3c5700 1 --2- 172.21.15.72:0/3356722259 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b7809d6f0 0x7f0b7809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.127+0000 7f0b7e3c5700 1 -- 172.21.15.72:0/3356722259 >> 172.21.15.72:0/3356722259 conn(0x7f0b78066f50 msgr2=0x7f0b7809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.127+0000 7f0b7e3c5700 1 -- 172.21.15.72:0/3356722259 shutdown_connections 2023-10-03T10:18:50.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.127+0000 7f0b7e3c5700 1 -- 172.21.15.72:0/3356722259 wait complete. 2023-10-03T10:18:50.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.128+0000 7f0b7e3c5700 1 Processor -- start 2023-10-03T10:18:50.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.128+0000 7f0b7e3c5700 1 -- start start 2023-10-03T10:18:50.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.128+0000 7f0b7e3c5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b7809d6f0 0x7f0b78122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.128+0000 7f0b7e3c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7809e000 0x7f0b78122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.128+0000 7f0b7e3c5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b7809e410 0x7f0b78122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.128+0000 7f0b7e3c5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78125b10 con 0x7f0b7809d6f0 2023-10-03T10:18:50.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.128+0000 7f0b7e3c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78124c00 con 0x7f0b7809e000 2023-10-03T10:18:50.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.128+0000 7f0b7e3c5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78123ea0 con 0x7f0b7809e410 2023-10-03T10:18:50.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.128+0000 7f0b7c962700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b7809e410 0x7f0b78122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.128+0000 7f0b777fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7809e000 0x7f0b78122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.128+0000 7f0b7c962700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b7809e410 0x7f0b78122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36176/0 (socket says 172.21.15.72:36176) 2023-10-03T10:18:50.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.128+0000 7f0b7c962700 1 -- 172.21.15.72:0/3788416298 learned_addr learned my addr 172.21.15.72:0/3788416298 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:50.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.128+0000 7f0b77fff700 1 --2- 172.21.15.72:0/3788416298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b7809d6f0 0x7f0b78122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.129+0000 7f0b77fff700 1 -- 172.21.15.72:0/3788416298 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b7809e410 msgr2=0x7f0b78122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.129+0000 7f0b77fff700 1 --2- 172.21.15.72:0/3788416298 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b7809e410 0x7f0b78122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.129+0000 7f0b77fff700 1 -- 172.21.15.72:0/3788416298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7809e000 msgr2=0x7f0b78122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.129+0000 7f0b77fff700 1 --2- 172.21.15.72:0/3788416298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7809e000 0x7f0b78122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.129+0000 7f0b77fff700 1 -- 172.21.15.72:0/3788416298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b680094a0 con 0x7f0b7809d6f0 2023-10-03T10:18:50.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.129+0000 7f0b7c962700 1 --2- 172.21.15.72:0/3788416298 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b7809e410 0x7f0b78122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.129+0000 7f0b77fff700 1 --2- 172.21.15.72:0/3788416298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b7809d6f0 0x7f0b78122320 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800e9b0 tx=0x7f0b6800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.129+0000 7f0b74ff9700 1 -- 172.21.15.72:0/3788416298 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800ee50 con 0x7f0b7809d6f0 2023-10-03T10:18:50.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.129+0000 7f0b74ff9700 1 -- 172.21.15.72:0/3788416298 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6800c850 con 0x7f0b7809d6f0 2023-10-03T10:18:50.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.129+0000 7f0b7e3c5700 1 -- 172.21.15.72:0/3788416298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b70009a70 con 0x7f0b7809d6f0 2023-10-03T10:18:50.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.129+0000 7f0b74ff9700 1 -- 172.21.15.72:0/3788416298 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800cbe0 con 0x7f0b7809d6f0 2023-10-03T10:18:50.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.129+0000 7f0b7e3c5700 1 -- 172.21.15.72:0/3788416298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b780a3bc0 con 0x7f0b7809d6f0 2023-10-03T10:18:50.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.130+0000 7f0b74ff9700 1 -- 172.21.15.72:0/3788416298 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b6800cd40 con 0x7f0b7809d6f0 2023-10-03T10:18:50.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.131+0000 7f0b74ff9700 1 -- 172.21.15.72:0/3788416298 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0b6803fb10 con 0x7f0b7809d6f0 2023-10-03T10:18:50.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.131+0000 7f0b7e3c5700 1 -- 172.21.15.72:0/3788416298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7811f030 con 0x7f0b7809d6f0 2023-10-03T10:18:50.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.139+0000 7f0b74ff9700 1 -- 172.21.15.72:0/3788416298 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b68021030 con 0x7f0b7809d6f0 2023-10-03T10:18:50.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.173+0000 7fd621ec9700 1 Processor -- start 2023-10-03T10:18:50.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.174+0000 7fd621ec9700 1 -- start start 2023-10-03T10:18:50.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.174+0000 7fd621ec9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd61c09d6f0 0x7fd61c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.174+0000 7fd621ec9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd61c09e000 0x7fd61c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.174+0000 7fd621ec9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61c09f130 con 0x7fd61c09e410 2023-10-03T10:18:50.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.174+0000 7fd621ec9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61c09f520 con 0x7fd61c09d6f0 2023-10-03T10:18:50.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.174+0000 7fd621ec9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c09e930 con 0x7fd61c09e000 2023-10-03T10:18:50.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.174+0000 7fd61b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd61c09d6f0 0x7fd61c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.174+0000 7fd61bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd61c09e410 0x7fd61c130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48792/0 (socket says 172.21.15.72:48792) 2023-10-03T10:18:50.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.174+0000 7fd61bfff700 1 -- 172.21.15.72:0/2962691137 learned_addr learned my addr 172.21.15.72:0/2962691137 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:50.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.174+0000 7fd61affd700 1 --2- 172.21.15.72:0/2962691137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd61c09e000 0x7fd61c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 -- 172.21.15.72:0/2962691137 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065371650 0 0) 0x7fd61c09f130 con 0x7fd61c09e410 2023-10-03T10:18:50.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 -- 172.21.15.72:0/2962691137 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6040057c0 con 0x7fd61c09e410 2023-10-03T10:18:50.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 -- 172.21.15.72:0/2962691137 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1044047259 0 0) 0x7fd6040057c0 con 0x7fd61c09e410 2023-10-03T10:18:50.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 -- 172.21.15.72:0/2962691137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd61c09e000 msgr2=0x7fd61c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 --2- 172.21.15.72:0/2962691137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd61c09e000 0x7fd61c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 -- 172.21.15.72:0/2962691137 >> v2:172.21.15.72:3300/0 conn(0x7fd61c09d6f0 msgr2=0x7fd61c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 --2- 172.21.15.72:0/2962691137 >> v2:172.21.15.72:3300/0 conn(0x7fd61c09d6f0 0x7fd61c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 -- 172.21.15.72:0/2962691137 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c09b2d0 con 0x7fd61c09e410 2023-10-03T10:18:50.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 -- 172.21.15.72:0/2962691137 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 244944926 0 0) 0x7fd6140019f0 con 0x7fd61c09e410 2023-10-03T10:18:50.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 -- 172.21.15.72:0/2962691137 >> v1:172.21.15.72:6789/0 conn(0x7fd61c09e410 legacy=0x7fd61c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 --2- 172.21.15.72:0/2962691137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd604005c10 0x7fd604006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 --2- 172.21.15.72:0/2962691137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6040065a0 0x7fd604006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 --2- 172.21.15.72:0/2962691137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd61c09e000 0x7fd604007200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 -- 172.21.15.72:0/2962691137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c09e930 con 0x7fd6040065a0 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 -- 172.21.15.72:0/2962691137 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60400dc20 con 0x7fd604005c10 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61a7fc700 1 -- 172.21.15.72:0/2962691137 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd60400dd60 con 0x7fd61c09e000 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61affd700 1 --2- 172.21.15.72:0/2962691137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6040065a0 0x7fd604006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61affd700 1 -- 172.21.15.72:0/2962691137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd61c09e000 msgr2=0x7fd604007200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61affd700 1 --2- 172.21.15.72:0/2962691137 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd61c09e000 0x7fd604007200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61affd700 1 -- 172.21.15.72:0/2962691137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd604005c10 msgr2=0x7fd604006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61affd700 1 --2- 172.21.15.72:0/2962691137 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd604005c10 0x7fd604006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.175+0000 7fd61affd700 1 -- 172.21.15.72:0/2962691137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c09b2d0 con 0x7fd6040065a0 2023-10-03T10:18:50.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.176+0000 7fd61affd700 1 --2- 172.21.15.72:0/2962691137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6040065a0 0x7fd604006a60 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fd610009b60 tx=0x7fd604007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc0c6e5338412c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.176+0000 7fd61a7fc700 1 -- 172.21.15.72:0/2962691137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61000e6c0 con 0x7fd6040065a0 2023-10-03T10:18:50.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.176+0000 7fd61a7fc700 1 -- 172.21.15.72:0/2962691137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61000e820 con 0x7fd6040065a0 2023-10-03T10:18:50.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.176+0000 7fd61a7fc700 1 -- 172.21.15.72:0/2962691137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61000eb90 con 0x7fd6040065a0 2023-10-03T10:18:50.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.176+0000 7fd621ec9700 1 -- 172.21.15.72:0/2962691137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6040065a0 msgr2=0x7fd604006a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.176+0000 7fd621ec9700 1 --2- 172.21.15.72:0/2962691137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6040065a0 0x7fd604006a60 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fd610009b60 tx=0x7fd604007a90 comp rx=0 tx=0).stop 2023-10-03T10:18:50.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.176+0000 7fd61bfff700 1 -- 172.21.15.72:0/2962691137 reap_dead start 2023-10-03T10:18:50.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.176+0000 7fd621ec9700 1 -- 172.21.15.72:0/2962691137 shutdown_connections 2023-10-03T10:18:50.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.177+0000 7fd621ec9700 1 -- 172.21.15.72:0/2962691137 >> 172.21.15.72:0/2962691137 conn(0x7fd61c066f50 msgr2=0x7fd61c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.177+0000 7fd621ec9700 1 -- 172.21.15.72:0/2962691137 shutdown_connections 2023-10-03T10:18:50.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.177+0000 7fd621ec9700 1 -- 172.21.15.72:0/2962691137 wait complete. 2023-10-03T10:18:50.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.178+0000 7fd621ec9700 1 Processor -- start 2023-10-03T10:18:50.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.178+0000 7fd621ec9700 1 -- start start 2023-10-03T10:18:50.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd621ec9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6040065a0 0x7fd61c122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd621ec9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd61c122860 0x7fd61c122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd621ec9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd61c1c8460 0x7fd61c1c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd621ec9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c125540 con 0x7fd61c1c8460 2023-10-03T10:18:50.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd621ec9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c123f30 con 0x7fd61c122860 2023-10-03T10:18:50.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd621ec9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c124800 con 0x7fd6040065a0 2023-10-03T10:18:50.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd61affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd61c122860 0x7fd61c122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd61b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6040065a0 0x7fd61c122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd61bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd61c1c8460 0x7fd61c1c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd61affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd61c122860 0x7fd61c122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40704/0 (socket says 172.21.15.72:40704) 2023-10-03T10:18:50.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd61b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6040065a0 0x7fd61c122320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36194/0 (socket says 172.21.15.72:36194) 2023-10-03T10:18:50.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd61affd700 1 -- 172.21.15.72:0/1296269228 learned_addr learned my addr 172.21.15.72:0/1296269228 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:50.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd61bfff700 1 -- 172.21.15.72:0/1296269228 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6040065a0 msgr2=0x7fd61c122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd61bfff700 1 --2- 172.21.15.72:0/1296269228 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6040065a0 0x7fd61c122320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd61bfff700 1 -- 172.21.15.72:0/1296269228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd61c122860 msgr2=0x7fd61c122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd61bfff700 1 --2- 172.21.15.72:0/1296269228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd61c122860 0x7fd61c122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.179+0000 7fd61bfff700 1 -- 172.21.15.72:0/1296269228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c0a1740 con 0x7fd61c1c8460 2023-10-03T10:18:50.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.180+0000 7fd61bfff700 1 --2- 172.21.15.72:0/1296269228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd61c1c8460 0x7fd61c1c88b0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fd61c06dff0 tx=0x7fd6140021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.180+0000 7fd603fff700 1 -- 172.21.15.72:0/1296269228 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61400aa50 con 0x7fd61c1c8460 2023-10-03T10:18:50.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.180+0000 7fd603fff700 1 -- 172.21.15.72:0/1296269228 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61400abd0 con 0x7fd61c1c8460 2023-10-03T10:18:50.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.180+0000 7fd621ec9700 1 -- 172.21.15.72:0/1296269228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61c125e40 con 0x7fd61c1c8460 2023-10-03T10:18:50.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.180+0000 7fd603fff700 1 -- 172.21.15.72:0/1296269228 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6140070d0 con 0x7fd61c1c8460 2023-10-03T10:18:50.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.180+0000 7fd621ec9700 1 -- 172.21.15.72:0/1296269228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61c125b60 con 0x7fd61c1c8460 2023-10-03T10:18:50.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.180+0000 7fd603fff700 1 -- 172.21.15.72:0/1296269228 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd614007230 con 0x7fd61c1c8460 2023-10-03T10:18:50.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.181+0000 7fd603fff700 1 -- 172.21.15.72:0/1296269228 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd61403eee0 con 0x7fd61c1c8460 2023-10-03T10:18:50.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.181+0000 7fd621ec9700 1 -- 172.21.15.72:0/1296269228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5fc0052e0 con 0x7fd61c1c8460 2023-10-03T10:18:50.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.190+0000 7fd603fff700 1 -- 172.21.15.72:0/1296269228 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd614018080 con 0x7fd61c1c8460 2023-10-03T10:18:50.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.213+0000 7fe72a214700 1 Processor -- start 2023-10-03T10:18:50.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.213+0000 7fe72a214700 1 -- start start 2023-10-03T10:18:50.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.213+0000 7fe72a214700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe72406e570 0x7fe72406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.213+0000 7fe72a214700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe72409eca0 0x7fe72406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.213+0000 7fe72a214700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe724070ee0 con 0x7fe724134610 2023-10-03T10:18:50.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.213+0000 7fe72a214700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe724071480 con 0x7fe72409eca0 2023-10-03T10:18:50.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.213+0000 7fe72a214700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe72406f3c0 con 0x7fe72406e570 2023-10-03T10:18:50.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.214+0000 7fe722ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe72409eca0 0x7fe72406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.214+0000 7fe722ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe72409eca0 0x7fe72406ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50926/0 (socket says 172.21.15.72:50926) 2023-10-03T10:18:50.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.214+0000 7fe722ffd700 1 -- 172.21.15.72:0/2229116357 learned_addr learned my addr 172.21.15.72:0/2229116357 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:50.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.214+0000 7fe723fff700 1 --1- 172.21.15.72:0/2229116357 >> v1:172.21.15.72:6789/0 conn(0x7fe724134610 0x7fe724134a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48804/0 (socket says 172.21.15.72:48804) 2023-10-03T10:18:50.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.214+0000 7fe7237fe700 1 --2- 172.21.15.72:0/2229116357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe72406e570 0x7fe72406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.214+0000 7fe722ffd700 1 -- 172.21.15.72:0/2229116357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe72406e570 msgr2=0x7fe72406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.214+0000 7fe722ffd700 1 --2- 172.21.15.72:0/2229116357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe72406e570 0x7fe72406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.214+0000 7fe722ffd700 1 -- 172.21.15.72:0/2229116357 >> v1:172.21.15.72:6789/0 conn(0x7fe724134610 legacy=0x7fe724134a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.214+0000 7fe722ffd700 1 -- 172.21.15.72:0/2229116357 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe724071b90 con 0x7fe72409eca0 2023-10-03T10:18:50.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.214+0000 7fe722ffd700 1 --2- 172.21.15.72:0/2229116357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe72409eca0 0x7fe72406ee80 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fe7180098f0 tx=0x7fe718009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37466036fdd135f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.214+0000 7fe7227fc700 1 -- 172.21.15.72:0/2229116357 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71800b8a0 con 0x7fe72409eca0 2023-10-03T10:18:50.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.214+0000 7fe7227fc700 1 -- 172.21.15.72:0/2229116357 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71800ba00 con 0x7fe72409eca0 2023-10-03T10:18:50.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.214+0000 7fe7227fc700 1 -- 172.21.15.72:0/2229116357 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71800bd90 con 0x7fe72409eca0 2023-10-03T10:18:50.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.215+0000 7fe72a214700 1 -- 172.21.15.72:0/2229116357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe72409eca0 msgr2=0x7fe72406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.215+0000 7fe72a214700 1 --2- 172.21.15.72:0/2229116357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe72409eca0 0x7fe72406ee80 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fe7180098f0 tx=0x7fe718009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:50.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.215+0000 7fe72a214700 1 -- 172.21.15.72:0/2229116357 shutdown_connections 2023-10-03T10:18:50.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.215+0000 7fe72a214700 1 --2- 172.21.15.72:0/2229116357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe72406e570 0x7fe72406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.215+0000 7fe72a214700 1 --2- 172.21.15.72:0/2229116357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe72409eca0 0x7fe72406ee80 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.215+0000 7fe72a214700 1 -- 172.21.15.72:0/2229116357 >> 172.21.15.72:0/2229116357 conn(0x7fe7240a2aa0 msgr2=0x7fe7240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.215+0000 7fe72a214700 1 -- 172.21.15.72:0/2229116357 shutdown_connections 2023-10-03T10:18:50.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.215+0000 7fe72a214700 1 -- 172.21.15.72:0/2229116357 wait complete. 2023-10-03T10:18:50.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.216+0000 7fe72a214700 1 Processor -- start 2023-10-03T10:18:50.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.217+0000 7fe72a214700 1 -- start start 2023-10-03T10:18:50.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.217+0000 7fe72a214700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe72406e570 0x7fe72413ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.217+0000 7fe72a214700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe724134610 0x7fe72413f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.217+0000 7fe72a214700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe72413f6e0 0x7fe724132e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.217+0000 7fe72a214700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72413ba30 con 0x7fe72406e570 2023-10-03T10:18:50.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.217+0000 7fe72a214700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72413e120 con 0x7fe72413f6e0 2023-10-03T10:18:50.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.217+0000 7fe72a214700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe72413ca60 con 0x7fe724134610 2023-10-03T10:18:50.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.217+0000 7fe722ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe724134610 0x7fe72413f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.217+0000 7fe7237fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe72406e570 0x7fe72413ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.217+0000 7fe722ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe724134610 0x7fe72413f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36212/0 (socket says 172.21.15.72:36212) 2023-10-03T10:18:50.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.217+0000 7fe722ffd700 1 -- 172.21.15.72:0/1352899814 learned_addr learned my addr 172.21.15.72:0/1352899814 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:50.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.217+0000 7fe723fff700 1 --2- 172.21.15.72:0/1352899814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe72413f6e0 0x7fe724132e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.218+0000 7fe722ffd700 1 -- 172.21.15.72:0/1352899814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe72413f6e0 msgr2=0x7fe724132e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.218+0000 7fe722ffd700 1 --2- 172.21.15.72:0/1352899814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe72413f6e0 0x7fe724132e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.218+0000 7fe722ffd700 1 -- 172.21.15.72:0/1352899814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe72406e570 msgr2=0x7fe72413ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.218+0000 7fe722ffd700 1 --2- 172.21.15.72:0/1352899814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe72406e570 0x7fe72413ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.218+0000 7fe722ffd700 1 -- 172.21.15.72:0/1352899814 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe718009550 con 0x7fe724134610 2023-10-03T10:18:50.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.218+0000 7fe7237fe700 1 --2- 172.21.15.72:0/1352899814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe72406e570 0x7fe72413ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.218+0000 7fe723fff700 1 --2- 172.21.15.72:0/1352899814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe72413f6e0 0x7fe724132e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.218+0000 7fe722ffd700 1 --2- 172.21.15.72:0/1352899814 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe724134610 0x7fe72413f1a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe718009c40 tx=0x7fe718004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.218+0000 7fe70bfff700 1 -- 172.21.15.72:0/1352899814 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180044d0 con 0x7fe724134610 2023-10-03T10:18:50.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.218+0000 7fe70bfff700 1 -- 172.21.15.72:0/1352899814 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71801f070 con 0x7fe724134610 2023-10-03T10:18:50.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.218+0000 7fe72a214700 1 -- 172.21.15.72:0/1352899814 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7240a1fe0 con 0x7fe724134610 2023-10-03T10:18:50.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.218+0000 7fe70bfff700 1 -- 172.21.15.72:0/1352899814 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180038e0 con 0x7fe724134610 2023-10-03T10:18:50.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.218+0000 7fe72a214700 1 -- 172.21.15.72:0/1352899814 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72413d810 con 0x7fe724134610 2023-10-03T10:18:50.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.219+0000 7fe72a214700 1 -- 172.21.15.72:0/1352899814 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72413fb80 con 0x7fe724134610 2023-10-03T10:18:50.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.220+0000 7fe70bfff700 1 -- 172.21.15.72:0/1352899814 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe718003a40 con 0x7fe724134610 2023-10-03T10:18:50.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.220+0000 7fe70bfff700 1 -- 172.21.15.72:0/1352899814 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe718021070 con 0x7fe724134610 2023-10-03T10:18:50.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.224+0000 7fe70bfff700 1 -- 172.21.15.72:0/1352899814 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe718045060 con 0x7fe724134610 2023-10-03T10:18:50.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.298+0000 7f4958fad700 1 -- 172.21.15.72:0/1360377246 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4954074ea0 con 0x7f495412cf60 2023-10-03T10:18:50.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.298+0000 7f4942ffd700 1 -- 172.21.15.72:0/1360377246 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f494402d020 con 0x7f495412cf60 2023-10-03T10:18:50.299 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:50.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.300+0000 7f4958fad700 1 -- 172.21.15.72:0/1360377246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495412cf60 msgr2=0x7f495409bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.300+0000 7f4958fad700 1 --2- 172.21.15.72:0/1360377246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495412cf60 0x7f495409bb00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4944009c40 tx=0x7f4944004750 comp rx=0 tx=0).stop 2023-10-03T10:18:50.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.301+0000 7f4958fad700 1 -- 172.21.15.72:0/1360377246 shutdown_connections 2023-10-03T10:18:50.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.301+0000 7f4958fad700 1 --2- 172.21.15.72:0/1360377246 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4954130430 0x7f49541c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.301+0000 7f4958fad700 1 --2- 172.21.15.72:0/1360377246 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f495412cf60 0x7f495409bb00 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.301+0000 7f4958fad700 1 --2- 172.21.15.72:0/1360377246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f495412f8b0 0x7f495409c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.301+0000 7f4958fad700 1 -- 172.21.15.72:0/1360377246 >> 172.21.15.72:0/1360377246 conn(0x7f49540a2aa0 msgr2=0x7f495406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.301+0000 7f4958fad700 1 -- 172.21.15.72:0/1360377246 shutdown_connections 2023-10-03T10:18:50.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.301+0000 7f4958fad700 1 -- 172.21.15.72:0/1360377246 wait complete. 2023-10-03T10:18:50.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:50.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.351+0000 7f0b7e3c5700 1 -- 172.21.15.72:0/3788416298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0b78074ea0 con 0x7f0b7809d6f0 2023-10-03T10:18:50.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.352+0000 7f0b74ff9700 1 -- 172.21.15.72:0/3788416298 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b6802b090 con 0x7f0b7809d6f0 2023-10-03T10:18:50.353 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:50.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.354+0000 7f0b7e3c5700 1 -- 172.21.15.72:0/3788416298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b7809d6f0 msgr2=0x7f0b78122320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.354+0000 7f0b7e3c5700 1 --2- 172.21.15.72:0/3788416298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b7809d6f0 0x7f0b78122320 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800e9b0 tx=0x7f0b6800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.354+0000 7f0b7e3c5700 1 -- 172.21.15.72:0/3788416298 shutdown_connections 2023-10-03T10:18:50.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.354+0000 7f0b7e3c5700 1 --2- 172.21.15.72:0/3788416298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b7809d6f0 0x7f0b78122320 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.354+0000 7f0b7e3c5700 1 --2- 172.21.15.72:0/3788416298 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0b7809e410 0x7f0b78122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.354+0000 7f0b7e3c5700 1 --2- 172.21.15.72:0/3788416298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7809e000 0x7f0b78122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.354+0000 7f0b7e3c5700 1 -- 172.21.15.72:0/3788416298 >> 172.21.15.72:0/3788416298 conn(0x7f0b78066f50 msgr2=0x7f0b78133f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.354+0000 7f0b7e3c5700 1 -- 172.21.15.72:0/3788416298 shutdown_connections 2023-10-03T10:18:50.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.354+0000 7f0b7e3c5700 1 -- 172.21.15.72:0/3788416298 wait complete. 2023-10-03T10:18:50.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.386+0000 7fd621ec9700 1 -- 172.21.15.72:0/1296269228 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd5fc005590 con 0x7fd61c1c8460 2023-10-03T10:18:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.386+0000 7fd603fff700 1 -- 172.21.15.72:0/1296269228 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd6140074e0 con 0x7fd61c1c8460 2023-10-03T10:18:50.387 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.388+0000 7fd621ec9700 1 -- 172.21.15.72:0/1296269228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd61c1c8460 msgr2=0x7fd61c1c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.388+0000 7fd621ec9700 1 --2- 172.21.15.72:0/1296269228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd61c1c8460 0x7fd61c1c88b0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fd61c06dff0 tx=0x7fd6140021e0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.388+0000 7fd621ec9700 1 -- 172.21.15.72:0/1296269228 shutdown_connections 2023-10-03T10:18:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.388+0000 7fd621ec9700 1 --2- 172.21.15.72:0/1296269228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd61c1c8460 0x7fd61c1c88b0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.388+0000 7fd621ec9700 1 --2- 172.21.15.72:0/1296269228 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6040065a0 0x7fd61c122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.388+0000 7fd621ec9700 1 --2- 172.21.15.72:0/1296269228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd61c122860 0x7fd61c122c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.388+0000 7fd621ec9700 1 -- 172.21.15.72:0/1296269228 >> 172.21.15.72:0/1296269228 conn(0x7fd61c066f50 msgr2=0x7fd61c130b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.388+0000 7fd621ec9700 1 -- 172.21.15.72:0/1296269228 shutdown_connections 2023-10-03T10:18:50.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.388+0000 7fd621ec9700 1 -- 172.21.15.72:0/1296269228 wait complete. 2023-10-03T10:18:50.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:50.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.429+0000 7fe72a214700 1 -- 172.21.15.72:0/1352899814 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe724074ea0 con 0x7fe724134610 2023-10-03T10:18:50.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.429+0000 7fe70bfff700 1 -- 172.21.15.72:0/1352899814 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe718015070 con 0x7fe724134610 2023-10-03T10:18:50.430 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:50.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.431+0000 7fe72a214700 1 -- 172.21.15.72:0/1352899814 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe724134610 msgr2=0x7fe72413f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.431+0000 7fe72a214700 1 --2- 172.21.15.72:0/1352899814 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe724134610 0x7fe72413f1a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe718009c40 tx=0x7fe718004750 comp rx=0 tx=0).stop 2023-10-03T10:18:50.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.431+0000 7fe72a214700 1 -- 172.21.15.72:0/1352899814 shutdown_connections 2023-10-03T10:18:50.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.431+0000 7fe72a214700 1 --2- 172.21.15.72:0/1352899814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe72406e570 0x7fe72413ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.431+0000 7fe72a214700 1 --2- 172.21.15.72:0/1352899814 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe72413f6e0 0x7fe724132e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.431+0000 7fe72a214700 1 --2- 172.21.15.72:0/1352899814 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe724134610 0x7fe72413f1a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.431+0000 7fe72a214700 1 -- 172.21.15.72:0/1352899814 >> 172.21.15.72:0/1352899814 conn(0x7fe7240a2aa0 msgr2=0x7fe7240a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.431+0000 7fe72a214700 1 -- 172.21.15.72:0/1352899814 shutdown_connections 2023-10-03T10:18:50.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:50.431+0000 7fe72a214700 1 -- 172.21.15.72:0/1352899814 wait complete. 2023-10-03T10:18:50.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:51.319 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:51.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:51.401 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:51.445 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:51.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.461+0000 7fb9c8f4e700 1 Processor -- start 2023-10-03T10:18:51.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.461+0000 7fb9c8f4e700 1 -- start start 2023-10-03T10:18:51.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.461+0000 7fb9c8f4e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9c412cf60 0x7fb9c406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.461+0000 7fb9c8f4e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9c412f8b0 0x7fb9c412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.461+0000 7fb9c8f4e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c412cd90 con 0x7fb9c4130260 2023-10-03T10:18:51.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.461+0000 7fb9c8f4e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c412d330 con 0x7fb9c412f8b0 2023-10-03T10:18:51.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.462+0000 7fb9c8f4e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c41306d0 con 0x7fb9c412cf60 2023-10-03T10:18:51.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.462+0000 7fb9c259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9c412cf60 0x7fb9c406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.462+0000 7fb9c2d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb9c4130260 0x7fb9c4136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48810/0 (socket says 172.21.15.72:48810) 2023-10-03T10:18:51.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.462+0000 7fb9c259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9c412cf60 0x7fb9c406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36218/0 (socket says 172.21.15.72:36218) 2023-10-03T10:18:51.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.462+0000 7fb9c2d9d700 1 -- 172.21.15.72:0/3761800346 learned_addr learned my addr 172.21.15.72:0/3761800346 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:51.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.462+0000 7fb9c1d9b700 1 --2- 172.21.15.72:0/3761800346 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9c412f8b0 0x7fb9c412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.462+0000 7fb9c259c700 1 -- 172.21.15.72:0/3761800346 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9c412f8b0 msgr2=0x7fb9c412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.462+0000 7fb9c259c700 1 --2- 172.21.15.72:0/3761800346 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9c412f8b0 0x7fb9c412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.462+0000 7fb9c259c700 1 -- 172.21.15.72:0/3761800346 >> v1:172.21.15.72:6789/0 conn(0x7fb9c4130260 legacy=0x7fb9c4136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.462+0000 7fb9c159a700 1 -- 172.21.15.72:0/3761800346 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640212319 0 0) 0x7fb9c412cd90 con 0x7fb9c4130260 2023-10-03T10:18:51.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.462+0000 7fb9c259c700 1 -- 172.21.15.72:0/3761800346 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c4071780 con 0x7fb9c412cf60 2023-10-03T10:18:51.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.462+0000 7fb9c259c700 1 --2- 172.21.15.72:0/3761800346 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9c412cf60 0x7fb9c406f5d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400aa10 tx=0x7fb9b400ad20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6e2e1f65738eb7b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.463+0000 7fb9c159a700 1 -- 172.21.15.72:0/3761800346 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b400cb70 con 0x7fb9c412cf60 2023-10-03T10:18:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.463+0000 7fb9c159a700 1 -- 172.21.15.72:0/3761800346 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b400ccd0 con 0x7fb9c412cf60 2023-10-03T10:18:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.463+0000 7fb9c159a700 1 -- 172.21.15.72:0/3761800346 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4018620 con 0x7fb9c412cf60 2023-10-03T10:18:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.463+0000 7fb9c8f4e700 1 -- 172.21.15.72:0/3761800346 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9c412cf60 msgr2=0x7fb9c406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.463+0000 7fb9c8f4e700 1 --2- 172.21.15.72:0/3761800346 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9c412cf60 0x7fb9c406f5d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400aa10 tx=0x7fb9b400ad20 comp rx=0 tx=0).stop 2023-10-03T10:18:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.463+0000 7fb9c8f4e700 1 -- 172.21.15.72:0/3761800346 shutdown_connections 2023-10-03T10:18:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.463+0000 7fb9c8f4e700 1 --2- 172.21.15.72:0/3761800346 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9c412cf60 0x7fb9c406f5d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.463+0000 7fb9c8f4e700 1 --2- 172.21.15.72:0/3761800346 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9c412f8b0 0x7fb9c412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.464+0000 7fb9c8f4e700 1 -- 172.21.15.72:0/3761800346 >> 172.21.15.72:0/3761800346 conn(0x7fb9c40a2aa0 msgr2=0x7fb9c40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.464+0000 7fb9c8f4e700 1 -- 172.21.15.72:0/3761800346 shutdown_connections 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.464+0000 7fb9c8f4e700 1 -- 172.21.15.72:0/3761800346 wait complete. 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.465+0000 7fb9c8f4e700 1 Processor -- start 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.465+0000 7fb9c8f4e700 1 -- start start 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.465+0000 7fb9c8f4e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9c412cf60 0x7fb9c409b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.465+0000 7fb9c8f4e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c412f8b0 0x7fb9c409b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.465+0000 7fb9c8f4e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9c4130260 0x7fb9c41c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.465+0000 7fb9c8f4e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c409ce70 con 0x7fb9c412f8b0 2023-10-03T10:18:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.465+0000 7fb9c8f4e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c409de20 con 0x7fb9c4130260 2023-10-03T10:18:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.465+0000 7fb9c8f4e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c409e680 con 0x7fb9c412cf60 2023-10-03T10:18:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.466+0000 7fb9c259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9c412cf60 0x7fb9c409b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.466+0000 7fb9c1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c412f8b0 0x7fb9c409b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.466+0000 7fb9c259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9c412cf60 0x7fb9c409b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36226/0 (socket says 172.21.15.72:36226) 2023-10-03T10:18:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.466+0000 7fb9c259c700 1 -- 172.21.15.72:0/2589653772 learned_addr learned my addr 172.21.15.72:0/2589653772 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.466+0000 7fb9c1d9b700 1 --2- 172.21.15.72:0/2589653772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c412f8b0 0x7fb9c409b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50944/0 (socket says 172.21.15.72:50944) 2023-10-03T10:18:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.466+0000 7fb9c2d9d700 1 --2- 172.21.15.72:0/2589653772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9c4130260 0x7fb9c41c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.466+0000 7fb9c1d9b700 1 -- 172.21.15.72:0/2589653772 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9c412cf60 msgr2=0x7fb9c409b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.466+0000 7fb9c1d9b700 1 --2- 172.21.15.72:0/2589653772 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9c412cf60 0x7fb9c409b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.466+0000 7fb9c1d9b700 1 -- 172.21.15.72:0/2589653772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9c4130260 msgr2=0x7fb9c41c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.466+0000 7fb9c1d9b700 1 --2- 172.21.15.72:0/2589653772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9c4130260 0x7fb9c41c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.466+0000 7fb9c1d9b700 1 -- 172.21.15.72:0/2589653772 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b400a640 con 0x7fb9c412f8b0 2023-10-03T10:18:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.466+0000 7fb9c1d9b700 1 --2- 172.21.15.72:0/2589653772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c412f8b0 0x7fb9c409b8b0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800e7e0 tx=0x7fb9b800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.466+0000 7fb9b2ffd700 1 -- 172.21.15.72:0/2589653772 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b800c070 con 0x7fb9c412f8b0 2023-10-03T10:18:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.467+0000 7fb9b2ffd700 1 -- 172.21.15.72:0/2589653772 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b8013610 con 0x7fb9c412f8b0 2023-10-03T10:18:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.467+0000 7fb9c8f4e700 1 -- 172.21.15.72:0/2589653772 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c409d980 con 0x7fb9c412f8b0 2023-10-03T10:18:51.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.467+0000 7fb9b2ffd700 1 -- 172.21.15.72:0/2589653772 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80139a0 con 0x7fb9c412f8b0 2023-10-03T10:18:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.467+0000 7fb9c8f4e700 1 -- 172.21.15.72:0/2589653772 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c409bdf0 con 0x7fb9c412f8b0 2023-10-03T10:18:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.468+0000 7fb9c8f4e700 1 -- 172.21.15.72:0/2589653772 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c4074ea0 con 0x7fb9c412f8b0 2023-10-03T10:18:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.468+0000 7fb9b2ffd700 1 -- 172.21.15.72:0/2589653772 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9b8013b00 con 0x7fb9c412f8b0 2023-10-03T10:18:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.468+0000 7fb9b2ffd700 1 -- 172.21.15.72:0/2589653772 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb9b803f860 con 0x7fb9c412f8b0 2023-10-03T10:18:51.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.476+0000 7fb9b2ffd700 1 -- 172.21.15.72:0/2589653772 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9b8024ba0 con 0x7fb9c412f8b0 2023-10-03T10:18:51.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.509+0000 7f9d32cbc700 1 Processor -- start 2023-10-03T10:18:51.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.509+0000 7f9d32cbc700 1 -- start start 2023-10-03T10:18:51.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.510+0000 7f9d32cbc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d2c131630 0x7f9d2c131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.510+0000 7f9d32cbc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d2c131f40 0x7f9d2c06e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.510+0000 7f9d32cbc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c071a00 con 0x7f9d2c06e9d0 2023-10-03T10:18:51.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.510+0000 7f9d32cbc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2c131430 con 0x7f9d2c131f40 2023-10-03T10:18:51.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.510+0000 7f9d32cbc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c09a510 con 0x7f9d2c131630 2023-10-03T10:18:51.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.510+0000 7f9d30a58700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d2c131630 0x7f9d2c131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.510+0000 7f9d30a58700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d2c131630 0x7f9d2c131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36230/0 (socket says 172.21.15.72:36230) 2023-10-03T10:18:51.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.510+0000 7f9d30a58700 1 -- 172.21.15.72:0/3291773335 learned_addr learned my addr 172.21.15.72:0/3291773335 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:51.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.510+0000 7f9d2bfff700 1 --2- 172.21.15.72:0/3291773335 >> v2:172.21.15.72:3300/0 conn(0x7f9d2c131f40 0x7f9d2c06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.511+0000 7f9d2bfff700 1 -- 172.21.15.72:0/3291773335 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d2c131630 msgr2=0x7f9d2c131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.511+0000 7f9d2bfff700 1 --2- 172.21.15.72:0/3291773335 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d2c131630 0x7f9d2c131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.511+0000 7f9d2bfff700 1 -- 172.21.15.72:0/3291773335 >> v1:172.21.15.72:6789/0 conn(0x7f9d2c06e9d0 legacy=0x7f9d2c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.511+0000 7f9d2bfff700 1 -- 172.21.15.72:0/3291773335 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c0721c0 con 0x7f9d2c131f40 2023-10-03T10:18:51.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.511+0000 7f9d2bfff700 1 --2- 172.21.15.72:0/3291773335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d2c131f40 0x7f9d2c06e490 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009840 tx=0x7f9d18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead887abb007bd1a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.511+0000 7f9d2b7fe700 1 -- 172.21.15.72:0/3291773335 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18011830 con 0x7f9d2c131f40 2023-10-03T10:18:51.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.511+0000 7f9d2b7fe700 1 -- 172.21.15.72:0/3291773335 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d18011990 con 0x7f9d2c131f40 2023-10-03T10:18:51.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.511+0000 7f9d2b7fe700 1 -- 172.21.15.72:0/3291773335 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18011d20 con 0x7f9d2c131f40 2023-10-03T10:18:51.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.512+0000 7f9d32cbc700 1 -- 172.21.15.72:0/3291773335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d2c131f40 msgr2=0x7f9d2c06e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.512+0000 7f9d32cbc700 1 --2- 172.21.15.72:0/3291773335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d2c131f40 0x7f9d2c06e490 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009840 tx=0x7f9d18009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:51.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.512+0000 7f9d32cbc700 1 -- 172.21.15.72:0/3291773335 shutdown_connections 2023-10-03T10:18:51.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.512+0000 7f9d32cbc700 1 --2- 172.21.15.72:0/3291773335 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d2c131630 0x7f9d2c131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.512+0000 7f9d32cbc700 1 --2- 172.21.15.72:0/3291773335 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d2c131f40 0x7f9d2c06e490 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.512+0000 7f9d32cbc700 1 -- 172.21.15.72:0/3291773335 >> 172.21.15.72:0/3291773335 conn(0x7f9d2c0a2aa0 msgr2=0x7f9d2c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.512+0000 7f9d32cbc700 1 -- 172.21.15.72:0/3291773335 shutdown_connections 2023-10-03T10:18:51.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.512+0000 7f9d32cbc700 1 -- 172.21.15.72:0/3291773335 wait complete. 2023-10-03T10:18:51.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.513+0000 7f9d32cbc700 1 Processor -- start 2023-10-03T10:18:51.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.513+0000 7f9d32cbc700 1 -- start start 2023-10-03T10:18:51.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.513+0000 7f9d32cbc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d2c06e9d0 0x7f9d2c06f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.513+0000 7f9d32cbc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d2c131630 0x7f9d2c06fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.513+0000 7f9d32cbc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d2c131f40 0x7f9d2c070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.513+0000 7f9d32cbc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c1214a0 con 0x7f9d2c131f40 2023-10-03T10:18:51.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.513+0000 7f9d32cbc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0a1ba0 con 0x7f9d2c131630 2023-10-03T10:18:51.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.513+0000 7f9d32cbc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c099f20 con 0x7f9d2c06e9d0 2023-10-03T10:18:51.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.514+0000 7f9d31259700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d2c131f40 0x7f9d2c070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.514+0000 7f9d31259700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d2c131f40 0x7f9d2c070090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50970/0 (socket says 172.21.15.72:50970) 2023-10-03T10:18:51.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.514+0000 7f9d31259700 1 -- 172.21.15.72:0/255288747 learned_addr learned my addr 172.21.15.72:0/255288747 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:51.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.514+0000 7f9d2bfff700 1 --2- 172.21.15.72:0/255288747 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d2c131630 0x7f9d2c06fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.514+0000 7f9d30a58700 1 --2- 172.21.15.72:0/255288747 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d2c06e9d0 0x7f9d2c06f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.514+0000 7f9d31259700 1 -- 172.21.15.72:0/255288747 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d2c06e9d0 msgr2=0x7f9d2c06f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.514+0000 7f9d31259700 1 --2- 172.21.15.72:0/255288747 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d2c06e9d0 0x7f9d2c06f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.514+0000 7f9d31259700 1 -- 172.21.15.72:0/255288747 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d2c131630 msgr2=0x7f9d2c06fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.514+0000 7f9d31259700 1 --2- 172.21.15.72:0/255288747 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d2c131630 0x7f9d2c06fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.514+0000 7f9d31259700 1 -- 172.21.15.72:0/255288747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d180094a0 con 0x7f9d2c131f40 2023-10-03T10:18:51.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.514+0000 7f9d31259700 1 --2- 172.21.15.72:0/255288747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d2c131f40 0x7f9d2c070090 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400cc50 tx=0x7f9d2400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.514+0000 7f9d297fa700 1 -- 172.21.15.72:0/255288747 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24003c00 con 0x7f9d2c131f40 2023-10-03T10:18:51.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.514+0000 7f9d297fa700 1 -- 172.21.15.72:0/255288747 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d24003d60 con 0x7f9d2c131f40 2023-10-03T10:18:51.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.514+0000 7f9d32cbc700 1 -- 172.21.15.72:0/255288747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2c1207e0 con 0x7f9d2c131f40 2023-10-03T10:18:51.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.514+0000 7f9d32cbc700 1 -- 172.21.15.72:0/255288747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c120c30 con 0x7f9d2c131f40 2023-10-03T10:18:51.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.515+0000 7f9d297fa700 1 -- 172.21.15.72:0/255288747 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2400ab40 con 0x7f9d2c131f40 2023-10-03T10:18:51.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.515+0000 7f9d32cbc700 1 -- 172.21.15.72:0/255288747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2c074ea0 con 0x7f9d2c131f40 2023-10-03T10:18:51.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.516+0000 7f9d297fa700 1 -- 172.21.15.72:0/255288747 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d2400ace0 con 0x7f9d2c131f40 2023-10-03T10:18:51.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.516+0000 7f9d297fa700 1 -- 172.21.15.72:0/255288747 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9d2403f7e0 con 0x7f9d2c131f40 2023-10-03T10:18:51.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.524+0000 7f9d297fa700 1 -- 172.21.15.72:0/255288747 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d240198f0 con 0x7f9d2c131f40 2023-10-03T10:18:51.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.557+0000 7f5a72edc700 1 Processor -- start 2023-10-03T10:18:51.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.557+0000 7f5a72edc700 1 -- start start 2023-10-03T10:18:51.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.557+0000 7f5a72edc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a6c09d6f0 0x7f5a6c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a72edc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a6c09e000 0x7f5a6c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a72edc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a6c09e410 0x7f5a6c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a72edc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6c09f520 con 0x7f5a6c09d6f0 2023-10-03T10:18:51.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a72edc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c09f130 con 0x7f5a6c09e000 2023-10-03T10:18:51.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a72edc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c09e930 con 0x7f5a6c09e410 2023-10-03T10:18:51.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a71479700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a6c09e410 0x7f5a6c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a6bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a6c09e000 0x7f5a6c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a71479700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a6c09e410 0x7f5a6c130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36250/0 (socket says 172.21.15.72:36250) 2023-10-03T10:18:51.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a6bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a6c09e000 0x7f5a6c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40740/0 (socket says 172.21.15.72:40740) 2023-10-03T10:18:51.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a71479700 1 -- 172.21.15.72:0/813927352 learned_addr learned my addr 172.21.15.72:0/813927352 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:51.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a70c78700 1 --2- 172.21.15.72:0/813927352 >> v2:172.21.15.72:3300/0 conn(0x7f5a6c09d6f0 0x7f5a6c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a71479700 1 -- 172.21.15.72:0/813927352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a6c09e000 msgr2=0x7f5a6c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a71479700 1 --2- 172.21.15.72:0/813927352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a6c09e000 0x7f5a6c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a71479700 1 -- 172.21.15.72:0/813927352 >> v2:172.21.15.72:3300/0 conn(0x7f5a6c09d6f0 msgr2=0x7f5a6c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a71479700 1 --2- 172.21.15.72:0/813927352 >> v2:172.21.15.72:3300/0 conn(0x7f5a6c09d6f0 0x7f5a6c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a71479700 1 -- 172.21.15.72:0/813927352 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c09b2d0 con 0x7f5a6c09e410 2023-10-03T10:18:51.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.558+0000 7f5a71479700 1 --2- 172.21.15.72:0/813927352 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a6c09e410 0x7f5a6c130ba0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f5a64009e80 tx=0x7f5a6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15626303871bc119 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.559+0000 7f5a6b7fe700 1 -- 172.21.15.72:0/813927352 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400e070 con 0x7f5a6c09e410 2023-10-03T10:18:51.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.559+0000 7f5a6b7fe700 1 -- 172.21.15.72:0/813927352 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6400b8d0 con 0x7f5a6c09e410 2023-10-03T10:18:51.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.559+0000 7f5a6b7fe700 1 -- 172.21.15.72:0/813927352 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400bc80 con 0x7f5a6c09e410 2023-10-03T10:18:51.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.559+0000 7f5a72edc700 1 -- 172.21.15.72:0/813927352 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a6c09e410 msgr2=0x7f5a6c130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.559+0000 7f5a72edc700 1 --2- 172.21.15.72:0/813927352 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a6c09e410 0x7f5a6c130ba0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f5a64009e80 tx=0x7f5a6400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:51.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.560+0000 7f5a72edc700 1 -- 172.21.15.72:0/813927352 shutdown_connections 2023-10-03T10:18:51.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.560+0000 7f5a72edc700 1 --2- 172.21.15.72:0/813927352 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a6c09e410 0x7f5a6c130ba0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.560+0000 7f5a72edc700 1 --2- 172.21.15.72:0/813927352 >> v2:172.21.15.72:3300/0 conn(0x7f5a6c09d6f0 0x7f5a6c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.560+0000 7f5a72edc700 1 --2- 172.21.15.72:0/813927352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a6c09e000 0x7f5a6c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.560+0000 7f5a72edc700 1 -- 172.21.15.72:0/813927352 >> 172.21.15.72:0/813927352 conn(0x7f5a6c066f50 msgr2=0x7f5a6c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.560+0000 7f5a72edc700 1 -- 172.21.15.72:0/813927352 shutdown_connections 2023-10-03T10:18:51.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.560+0000 7f5a72edc700 1 -- 172.21.15.72:0/813927352 wait complete. 2023-10-03T10:18:51.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.561+0000 7f5a72edc700 1 Processor -- start 2023-10-03T10:18:51.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.561+0000 7f5a72edc700 1 -- start start 2023-10-03T10:18:51.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a72edc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a6c09d6f0 0x7f5a6c11de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a72edc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a6c09e000 0x7f5a6c11e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a72edc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a6c09e410 0x7f5a6c11e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a72edc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c11f2d0 con 0x7f5a6c09e410 2023-10-03T10:18:51.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a72edc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c11fa30 con 0x7f5a6c09e000 2023-10-03T10:18:51.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a72edc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c120c80 con 0x7f5a6c09d6f0 2023-10-03T10:18:51.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a70c78700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a6c09d6f0 0x7f5a6c11de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a70c78700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a6c09d6f0 0x7f5a6c11de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36252/0 (socket says 172.21.15.72:36252) 2023-10-03T10:18:51.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a70c78700 1 -- 172.21.15.72:0/1251207310 learned_addr learned my addr 172.21.15.72:0/1251207310 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:51.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a71479700 1 --2- 172.21.15.72:0/1251207310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a6c09e410 0x7f5a6c11e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a6bfff700 1 --2- 172.21.15.72:0/1251207310 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a6c09e000 0x7f5a6c11e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a71479700 1 -- 172.21.15.72:0/1251207310 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a6c09d6f0 msgr2=0x7f5a6c11de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a71479700 1 --2- 172.21.15.72:0/1251207310 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a6c09d6f0 0x7f5a6c11de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a71479700 1 -- 172.21.15.72:0/1251207310 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a6c09e000 msgr2=0x7f5a6c11e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a71479700 1 --2- 172.21.15.72:0/1251207310 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a6c09e000 0x7f5a6c11e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.562+0000 7f5a71479700 1 -- 172.21.15.72:0/1251207310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a64009b30 con 0x7f5a6c09e410 2023-10-03T10:18:51.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.563+0000 7f5a71479700 1 --2- 172.21.15.72:0/1251207310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a6c09e410 0x7f5a6c11e8a0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c09f6f0 tx=0x7f5a64004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.563+0000 7f5a697fa700 1 -- 172.21.15.72:0/1251207310 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64004450 con 0x7f5a6c09e410 2023-10-03T10:18:51.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.563+0000 7f5a697fa700 1 -- 172.21.15.72:0/1251207310 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a640045b0 con 0x7f5a6c09e410 2023-10-03T10:18:51.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.563+0000 7f5a72edc700 1 -- 172.21.15.72:0/1251207310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6c121660 con 0x7f5a6c09e410 2023-10-03T10:18:51.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.563+0000 7f5a697fa700 1 -- 172.21.15.72:0/1251207310 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64004960 con 0x7f5a6c09e410 2023-10-03T10:18:51.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.563+0000 7f5a72edc700 1 -- 172.21.15.72:0/1251207310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6c0a3b10 con 0x7f5a6c09e410 2023-10-03T10:18:51.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.565+0000 7f5a72edc700 1 -- 172.21.15.72:0/1251207310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6c11ac20 con 0x7f5a6c09e410 2023-10-03T10:18:51.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.565+0000 7f5a697fa700 1 -- 172.21.15.72:0/1251207310 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a6401c410 con 0x7f5a6c09e410 2023-10-03T10:18:51.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.565+0000 7f5a697fa700 1 -- 172.21.15.72:0/1251207310 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5a640411f0 con 0x7f5a6c09e410 2023-10-03T10:18:51.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.569+0000 7f5a697fa700 1 -- 172.21.15.72:0/1251207310 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a640243c0 con 0x7f5a6c09e410 2023-10-03T10:18:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.602+0000 7f0747d3b700 1 Processor -- start 2023-10-03T10:18:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.603+0000 7f0747d3b700 1 -- start start 2023-10-03T10:18:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.603+0000 7f0747d3b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0740098a30 0x7f0740090450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.603+0000 7f0747d3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0740090990 0x7f0740090dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.603+0000 7f0747d3b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f074008a0a0 0x7f074008c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.603+0000 7f0747d3b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074009ab80 con 0x7f0740098a30 2023-10-03T10:18:51.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.603+0000 7f0747d3b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0740091300 con 0x7f0740090990 2023-10-03T10:18:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.603+0000 7f0747d3b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f074009be70 con 0x7f074008a0a0 2023-10-03T10:18:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.603+0000 7f07462d8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f074008a0a0 0x7f074008c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.603+0000 7f07452d6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0740090990 0x7f0740090dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.603+0000 7f07452d6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0740090990 0x7f0740090dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40758/0 (socket says 172.21.15.72:40758) 2023-10-03T10:18:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.603+0000 7f07462d8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f074008a0a0 0x7f074008c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36262/0 (socket says 172.21.15.72:36262) 2023-10-03T10:18:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.603+0000 7f0745ad7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0740098a30 0x7f0740090450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.608+0000 7f07452d6700 1 -- 172.21.15.72:0/1518972230 learned_addr learned my addr 172.21.15.72:0/1518972230 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.608+0000 7f07452d6700 1 -- 172.21.15.72:0/1518972230 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f074008a0a0 msgr2=0x7f074008c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.608+0000 7f07452d6700 1 --2- 172.21.15.72:0/1518972230 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f074008a0a0 0x7f074008c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.608+0000 7f07452d6700 1 -- 172.21.15.72:0/1518972230 >> v2:172.21.15.72:3300/0 conn(0x7f0740098a30 msgr2=0x7f0740090450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.608+0000 7f07452d6700 1 --2- 172.21.15.72:0/1518972230 >> v2:172.21.15.72:3300/0 conn(0x7f0740098a30 0x7f0740090450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.608+0000 7f07452d6700 1 -- 172.21.15.72:0/1518972230 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074009ca10 con 0x7f0740090990 2023-10-03T10:18:51.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.608+0000 7f07462d8700 1 --2- 172.21.15.72:0/1518972230 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f074008a0a0 0x7f074008c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.608+0000 7f0745ad7700 1 --2- 172.21.15.72:0/1518972230 >> v2:172.21.15.72:3300/0 conn(0x7f0740098a30 0x7f0740090450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:51.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.608+0000 7f07452d6700 1 --2- 172.21.15.72:0/1518972230 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0740090990 0x7f0740090dc0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f073000ba00 tx=0x7f073000bd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0968662f249f1e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.608+0000 7f0744ad5700 1 -- 172.21.15.72:0/1518972230 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073000bea0 con 0x7f0740090990 2023-10-03T10:18:51.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.608+0000 7f0744ad5700 1 -- 172.21.15.72:0/1518972230 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073000cbe0 con 0x7f0740090990 2023-10-03T10:18:51.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.608+0000 7f0744ad5700 1 -- 172.21.15.72:0/1518972230 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073000f460 con 0x7f0740090990 2023-10-03T10:18:51.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.609+0000 7f0747d3b700 1 -- 172.21.15.72:0/1518972230 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0740090990 msgr2=0x7f0740090dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.609+0000 7f0747d3b700 1 --2- 172.21.15.72:0/1518972230 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0740090990 0x7f0740090dc0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f073000ba00 tx=0x7f073000bd10 comp rx=0 tx=0).stop 2023-10-03T10:18:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.609+0000 7f0747d3b700 1 -- 172.21.15.72:0/1518972230 shutdown_connections 2023-10-03T10:18:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.609+0000 7f0747d3b700 1 --2- 172.21.15.72:0/1518972230 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f074008a0a0 0x7f074008c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.609+0000 7f0747d3b700 1 --2- 172.21.15.72:0/1518972230 >> v2:172.21.15.72:3300/0 conn(0x7f0740098a30 0x7f0740090450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.609+0000 7f0747d3b700 1 --2- 172.21.15.72:0/1518972230 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0740090990 0x7f0740090dc0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.609+0000 7f0747d3b700 1 -- 172.21.15.72:0/1518972230 >> 172.21.15.72:0/1518972230 conn(0x7f074009e7e0 msgr2=0x7f074009ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.610+0000 7f0747d3b700 1 -- 172.21.15.72:0/1518972230 shutdown_connections 2023-10-03T10:18:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.610+0000 7f0747d3b700 1 -- 172.21.15.72:0/1518972230 wait complete. 2023-10-03T10:18:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.610+0000 7f0747d3b700 1 Processor -- start 2023-10-03T10:18:51.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.610+0000 7f0747d3b700 1 -- start start 2023-10-03T10:18:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f0747d3b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f074008a0a0 0x7f07400897a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f0747d3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0740090990 0x7f074008e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f0747d3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0740098a30 0x7f074008ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f0747d3b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0740091970 con 0x7f0740090990 2023-10-03T10:18:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f0747d3b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07400932d0 con 0x7f0740098a30 2023-10-03T10:18:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f0747d3b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0740092d30 con 0x7f074008a0a0 2023-10-03T10:18:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f0745ad7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f074008a0a0 0x7f07400897a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f0745ad7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f074008a0a0 0x7f07400897a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36274/0 (socket says 172.21.15.72:36274) 2023-10-03T10:18:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f0745ad7700 1 -- 172.21.15.72:0/2628865280 learned_addr learned my addr 172.21.15.72:0/2628865280 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f07462d8700 1 --2- 172.21.15.72:0/2628865280 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0740098a30 0x7f074008ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f07452d6700 1 --2- 172.21.15.72:0/2628865280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0740090990 0x7f074008e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f0745ad7700 1 -- 172.21.15.72:0/2628865280 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0740098a30 msgr2=0x7f074008ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f0745ad7700 1 --2- 172.21.15.72:0/2628865280 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0740098a30 0x7f074008ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f0745ad7700 1 -- 172.21.15.72:0/2628865280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0740090990 msgr2=0x7f074008e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f0745ad7700 1 --2- 172.21.15.72:0/2628865280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0740090990 0x7f074008e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f0745ad7700 1 -- 172.21.15.72:0/2628865280 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073800f050 con 0x7f074008a0a0 2023-10-03T10:18:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.611+0000 7f07452d6700 1 --2- 172.21.15.72:0/2628865280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0740090990 0x7f074008e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.612+0000 7f0745ad7700 1 --2- 172.21.15.72:0/2628865280 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f074008a0a0 0x7f07400897a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f073c00d7a0 tx=0x7f073c00dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.612+0000 7f07367fc700 1 -- 172.21.15.72:0/2628865280 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c018070 con 0x7f074008a0a0 2023-10-03T10:18:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.612+0000 7f07367fc700 1 -- 172.21.15.72:0/2628865280 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c006af0 con 0x7f074008a0a0 2023-10-03T10:18:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.612+0000 7f07367fc700 1 -- 172.21.15.72:0/2628865280 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c006e80 con 0x7f074008a0a0 2023-10-03T10:18:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.612+0000 7f0747d3b700 1 -- 172.21.15.72:0/2628865280 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073000b600 con 0x7f074008a0a0 2023-10-03T10:18:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.612+0000 7f0747d3b700 1 -- 172.21.15.72:0/2628865280 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0740098250 con 0x7f074008a0a0 2023-10-03T10:18:51.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.613+0000 7f07367fc700 1 -- 172.21.15.72:0/2628865280 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f073c004020 con 0x7f074008a0a0 2023-10-03T10:18:51.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.613+0000 7f07367fc700 1 -- 172.21.15.72:0/2628865280 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f073c03f430 con 0x7f074008a0a0 2023-10-03T10:18:51.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.613+0000 7f0747d3b700 1 -- 172.21.15.72:0/2628865280 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07400747f0 con 0x7f074008a0a0 2023-10-03T10:18:51.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.618+0000 7f07367fc700 1 -- 172.21.15.72:0/2628865280 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f073c0042d0 con 0x7f074008a0a0 2023-10-03T10:18:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.679+0000 7fb9c8f4e700 1 -- 172.21.15.72:0/2589653772 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb9c40713a0 con 0x7fb9c412f8b0 2023-10-03T10:18:51.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.680+0000 7fb9b2ffd700 1 -- 172.21.15.72:0/2589653772 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb9b802a070 con 0x7fb9c412f8b0 2023-10-03T10:18:51.681 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:51.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.683+0000 7fb9c8f4e700 1 -- 172.21.15.72:0/2589653772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c412f8b0 msgr2=0x7fb9c409b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.683+0000 7fb9c8f4e700 1 --2- 172.21.15.72:0/2589653772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c412f8b0 0x7fb9c409b8b0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800e7e0 tx=0x7fb9b800eaf0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.683+0000 7fb9c8f4e700 1 -- 172.21.15.72:0/2589653772 shutdown_connections 2023-10-03T10:18:51.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.683+0000 7fb9c8f4e700 1 --2- 172.21.15.72:0/2589653772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9c4130260 0x7fb9c41c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.683+0000 7fb9c8f4e700 1 --2- 172.21.15.72:0/2589653772 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb9c412cf60 0x7fb9c409b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.683+0000 7fb9c8f4e700 1 --2- 172.21.15.72:0/2589653772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9c412f8b0 0x7fb9c409b8b0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.683+0000 7fb9c8f4e700 1 -- 172.21.15.72:0/2589653772 >> 172.21.15.72:0/2589653772 conn(0x7fb9c40a2aa0 msgr2=0x7fb9c40a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.683+0000 7fb9c8f4e700 1 -- 172.21.15.72:0/2589653772 shutdown_connections 2023-10-03T10:18:51.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.683+0000 7fb9c8f4e700 1 -- 172.21.15.72:0/2589653772 wait complete. 2023-10-03T10:18:51.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:51.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.732+0000 7f9d32cbc700 1 -- 172.21.15.72:0/255288747 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9d2c120dc0 con 0x7f9d2c131f40 2023-10-03T10:18:51.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.732+0000 7f9d297fa700 1 -- 172.21.15.72:0/255288747 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d24011380 con 0x7f9d2c131f40 2023-10-03T10:18:51.733 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.734+0000 7f9d32cbc700 1 -- 172.21.15.72:0/255288747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d2c131f40 msgr2=0x7f9d2c070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.734+0000 7f9d32cbc700 1 --2- 172.21.15.72:0/255288747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d2c131f40 0x7f9d2c070090 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400cc50 tx=0x7f9d2400cf60 comp rx=0 tx=0).stop 2023-10-03T10:18:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.734+0000 7f9d32cbc700 1 -- 172.21.15.72:0/255288747 shutdown_connections 2023-10-03T10:18:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.734+0000 7f9d32cbc700 1 --2- 172.21.15.72:0/255288747 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d2c131f40 0x7f9d2c070090 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.734+0000 7f9d32cbc700 1 --2- 172.21.15.72:0/255288747 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d2c06e9d0 0x7f9d2c06f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.734+0000 7f9d32cbc700 1 --2- 172.21.15.72:0/255288747 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d2c131630 0x7f9d2c06fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.734+0000 7f9d32cbc700 1 -- 172.21.15.72:0/255288747 >> 172.21.15.72:0/255288747 conn(0x7f9d2c0a2aa0 msgr2=0x7f9d2c1b8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.734+0000 7f9d32cbc700 1 -- 172.21.15.72:0/255288747 shutdown_connections 2023-10-03T10:18:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.734+0000 7f9d32cbc700 1 -- 172.21.15.72:0/255288747 wait complete. 2023-10-03T10:18:51.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:51.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.795+0000 7f5a72edc700 1 -- 172.21.15.72:0/1251207310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5a6c09c700 con 0x7f5a6c09e410 2023-10-03T10:18:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.795+0000 7f5a697fa700 1 -- 172.21.15.72:0/1251207310 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5a6401abb0 con 0x7f5a6c09e410 2023-10-03T10:18:51.796 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:51.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.797+0000 7f5a72edc700 1 -- 172.21.15.72:0/1251207310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a6c09e410 msgr2=0x7f5a6c11e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.797+0000 7f5a72edc700 1 --2- 172.21.15.72:0/1251207310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a6c09e410 0x7f5a6c11e8a0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c09f6f0 tx=0x7f5a64004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.797+0000 7f5a72edc700 1 -- 172.21.15.72:0/1251207310 shutdown_connections 2023-10-03T10:18:51.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.797+0000 7f5a72edc700 1 --2- 172.21.15.72:0/1251207310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a6c09e410 0x7f5a6c11e8a0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.797+0000 7f5a72edc700 1 --2- 172.21.15.72:0/1251207310 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5a6c09d6f0 0x7f5a6c11de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.797+0000 7f5a72edc700 1 --2- 172.21.15.72:0/1251207310 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5a6c09e000 0x7f5a6c11e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.797+0000 7f5a72edc700 1 -- 172.21.15.72:0/1251207310 >> 172.21.15.72:0/1251207310 conn(0x7f5a6c066f50 msgr2=0x7f5a6c130890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.797+0000 7f5a72edc700 1 -- 172.21.15.72:0/1251207310 shutdown_connections 2023-10-03T10:18:51.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.797+0000 7f5a72edc700 1 -- 172.21.15.72:0/1251207310 wait complete. 2023-10-03T10:18:51.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.828+0000 7f0747d3b700 1 -- 172.21.15.72:0/2628865280 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0740099ff0 con 0x7f074008a0a0 2023-10-03T10:18:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.829+0000 7f07367fc700 1 -- 172.21.15.72:0/2628865280 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0740099ff0 con 0x7f074008a0a0 2023-10-03T10:18:51.829 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:51.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.831+0000 7f0747d3b700 1 -- 172.21.15.72:0/2628865280 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f074008a0a0 msgr2=0x7f07400897a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.831+0000 7f0747d3b700 1 --2- 172.21.15.72:0/2628865280 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f074008a0a0 0x7f07400897a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f073c00d7a0 tx=0x7f073c00dab0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.831+0000 7f0747d3b700 1 -- 172.21.15.72:0/2628865280 shutdown_connections 2023-10-03T10:18:51.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.831+0000 7f0747d3b700 1 --2- 172.21.15.72:0/2628865280 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0740098a30 0x7f074008ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.831+0000 7f0747d3b700 1 --2- 172.21.15.72:0/2628865280 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f074008a0a0 0x7f07400897a0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.831+0000 7f0747d3b700 1 --2- 172.21.15.72:0/2628865280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0740090990 0x7f074008e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.831+0000 7f0747d3b700 1 -- 172.21.15.72:0/2628865280 >> 172.21.15.72:0/2628865280 conn(0x7f074009e7e0 msgr2=0x7f07400a0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.831+0000 7f0747d3b700 1 -- 172.21.15.72:0/2628865280 shutdown_connections 2023-10-03T10:18:51.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:51.831+0000 7f0747d3b700 1 -- 172.21.15.72:0/2628865280 wait complete. 2023-10-03T10:18:51.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:52.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:52.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:52.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:52.843 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:52.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.845+0000 7f88b723d700 1 Processor -- start 2023-10-03T10:18:52.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.845+0000 7f88b723d700 1 -- start start 2023-10-03T10:18:52.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.845+0000 7f88b723d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b01338a0 0x7f88b0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.845+0000 7f88b723d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88b009de50 0x7f88b009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.845+0000 7f88b723d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b006ef30 con 0x7f88b009e760 2023-10-03T10:18:52.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.845+0000 7f88b723d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b006fef0 con 0x7f88b009de50 2023-10-03T10:18:52.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.845+0000 7f88b723d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b01334b0 con 0x7f88b01338a0 2023-10-03T10:18:52.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.846+0000 7f88b4fd9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b01338a0 0x7f88b0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.846+0000 7f88affff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88b009de50 0x7f88b009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.846+0000 7f88b4fd9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b01338a0 0x7f88b0133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40786/0 (socket says 172.21.15.72:40786) 2023-10-03T10:18:52.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.846+0000 7f88b4fd9700 1 -- 172.21.15.72:0/2847189965 learned_addr learned my addr 172.21.15.72:0/2847189965 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:52.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.846+0000 7f88affff700 1 -- 172.21.15.72:0/2847189965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b01338a0 msgr2=0x7f88b0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.846+0000 7f88affff700 1 --2- 172.21.15.72:0/2847189965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b01338a0 0x7f88b0133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.846+0000 7f88affff700 1 -- 172.21.15.72:0/2847189965 >> v1:172.21.15.72:6789/0 conn(0x7f88b009e760 legacy=0x7f88b013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.846+0000 7f88affff700 1 -- 172.21.15.72:0/2847189965 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b006fc30 con 0x7f88b009de50 2023-10-03T10:18:52.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.846+0000 7f88affff700 1 --2- 172.21.15.72:0/2847189965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b009de50 0x7f88b009e220 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f889c009840 tx=0x7f889c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecc0d24f1b7f8f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.846+0000 7f88af7fe700 1 -- 172.21.15.72:0/2847189965 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c011830 con 0x7f88b009de50 2023-10-03T10:18:52.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.846+0000 7f88af7fe700 1 -- 172.21.15.72:0/2847189965 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c011990 con 0x7f88b009de50 2023-10-03T10:18:52.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.846+0000 7f88af7fe700 1 -- 172.21.15.72:0/2847189965 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c011d20 con 0x7f88b009de50 2023-10-03T10:18:52.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.847+0000 7f88b723d700 1 -- 172.21.15.72:0/2847189965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b009de50 msgr2=0x7f88b009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.847+0000 7f88b723d700 1 --2- 172.21.15.72:0/2847189965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b009de50 0x7f88b009e220 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f889c009840 tx=0x7f889c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.847+0000 7f88b723d700 1 -- 172.21.15.72:0/2847189965 shutdown_connections 2023-10-03T10:18:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.847+0000 7f88b723d700 1 --2- 172.21.15.72:0/2847189965 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b01338a0 0x7f88b0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.847+0000 7f88b723d700 1 --2- 172.21.15.72:0/2847189965 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b009de50 0x7f88b009e220 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.847+0000 7f88b723d700 1 -- 172.21.15.72:0/2847189965 >> 172.21.15.72:0/2847189965 conn(0x7f88b00a2aa0 msgr2=0x7f88b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.847+0000 7f88b723d700 1 -- 172.21.15.72:0/2847189965 shutdown_connections 2023-10-03T10:18:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.847+0000 7f88b723d700 1 -- 172.21.15.72:0/2847189965 wait complete. 2023-10-03T10:18:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.848+0000 7f88b723d700 1 Processor -- start 2023-10-03T10:18:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.848+0000 7f88b723d700 1 -- start start 2023-10-03T10:18:52.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.849+0000 7f88b723d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009de50 0x7f88b0099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.849+0000 7f88b723d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b009e760 0x7f88b0099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.849+0000 7f88b723d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b01338a0 0x7f88b009a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.849+0000 7f88b723d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b009c3f0 con 0x7f88b009e760 2023-10-03T10:18:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.849+0000 7f88b723d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b0127890 con 0x7f88b01338a0 2023-10-03T10:18:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.849+0000 7f88b723d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88b009b800 con 0x7f88b009de50 2023-10-03T10:18:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.849+0000 7f88b4fd9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009de50 0x7f88b0099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.849+0000 7f88b4fd9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009de50 0x7f88b0099a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36280/0 (socket says 172.21.15.72:36280) 2023-10-03T10:18:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.849+0000 7f88b4fd9700 1 -- 172.21.15.72:0/1249748407 learned_addr learned my addr 172.21.15.72:0/1249748407 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:52.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.849+0000 7f88b4fd9700 1 -- 172.21.15.72:0/1249748407 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b01338a0 msgr2=0x7f88b009a4f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:18:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.849+0000 7f88b4fd9700 1 --2- 172.21.15.72:0/1249748407 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b01338a0 0x7f88b009a4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.849+0000 7f88b4fd9700 1 -- 172.21.15.72:0/1249748407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b009e760 msgr2=0x7f88b0099fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:18:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.849+0000 7f88b4fd9700 1 --2- 172.21.15.72:0/1249748407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b009e760 0x7f88b0099fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.849+0000 7f88b4fd9700 1 -- 172.21.15.72:0/1249748407 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c0094a0 con 0x7f88b009de50 2023-10-03T10:18:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.850+0000 7f88b4fd9700 1 --2- 172.21.15.72:0/1249748407 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009de50 0x7f88b0099a70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f88a400e910 tx=0x7f88a400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.850+0000 7f88ad7fa700 1 -- 172.21.15.72:0/1249748407 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a40096a0 con 0x7f88b009de50 2023-10-03T10:18:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.850+0000 7f88ad7fa700 1 -- 172.21.15.72:0/1249748407 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a400c850 con 0x7f88b009de50 2023-10-03T10:18:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.850+0000 7f88b723d700 1 -- 172.21.15.72:0/1249748407 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b006f640 con 0x7f88b009de50 2023-10-03T10:18:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.850+0000 7f88ad7fa700 1 -- 172.21.15.72:0/1249748407 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a400cc00 con 0x7f88b009de50 2023-10-03T10:18:52.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.850+0000 7f88b723d700 1 -- 172.21.15.72:0/1249748407 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b009cff0 con 0x7f88b009de50 2023-10-03T10:18:52.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.851+0000 7f88ad7fa700 1 -- 172.21.15.72:0/1249748407 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88a400cd60 con 0x7f88b009de50 2023-10-03T10:18:52.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.851+0000 7f88ad7fa700 1 -- 172.21.15.72:0/1249748407 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f88a40421c0 con 0x7f88b009de50 2023-10-03T10:18:52.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.851+0000 7f88b723d700 1 -- 172.21.15.72:0/1249748407 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b0074ea0 con 0x7f88b009de50 2023-10-03T10:18:52.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.857+0000 7f88ad7fa700 1 -- 172.21.15.72:0/1249748407 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88a4017020 con 0x7f88b009de50 2023-10-03T10:18:52.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.887+0000 7fdf20250700 1 Processor -- start 2023-10-03T10:18:52.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.887+0000 7fdf20250700 1 -- start start 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.888+0000 7fdf20250700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf18136710 0x7fdf18138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.888+0000 7fdf20250700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf18139030 0x7fdf1813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.888+0000 7fdf20250700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1806ef30 con 0x7fdf181338a0 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.888+0000 7fdf20250700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1806fef0 con 0x7fdf18139030 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.888+0000 7fdf20250700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf181334b0 con 0x7fdf18136710 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.888+0000 7fdf1e7ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf18139030 0x7fdf1813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.888+0000 7fdf1e7ed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf18139030 0x7fdf1813b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40792/0 (socket says 172.21.15.72:40792) 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.888+0000 7fdf1e7ed700 1 -- 172.21.15.72:0/3142663792 learned_addr learned my addr 172.21.15.72:0/3142663792 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.888+0000 7fdf1e7ed700 1 -- 172.21.15.72:0/3142663792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf18136710 msgr2=0x7fdf18138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.888+0000 7fdf1e7ed700 1 --2- 172.21.15.72:0/3142663792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf18136710 0x7fdf18138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.888+0000 7fdf1e7ed700 1 -- 172.21.15.72:0/3142663792 >> v1:172.21.15.72:6789/0 conn(0x7fdf181338a0 legacy=0x7fdf18133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.888+0000 7fdf1e7ed700 1 -- 172.21.15.72:0/3142663792 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1806fc30 con 0x7fdf18139030 2023-10-03T10:18:52.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.888+0000 7fdf1e7ed700 1 --2- 172.21.15.72:0/3142663792 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf18139030 0x7fdf1813b410 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009e80 tx=0x7fdf1000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76f66f197e17ec24 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.889+0000 7fdf1cfea700 1 -- 172.21.15.72:0/3142663792 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1000e070 con 0x7fdf18139030 2023-10-03T10:18:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.889+0000 7fdf1cfea700 1 -- 172.21.15.72:0/3142663792 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1000b9c0 con 0x7fdf18139030 2023-10-03T10:18:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.889+0000 7fdf1cfea700 1 -- 172.21.15.72:0/3142663792 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1000bd70 con 0x7fdf18139030 2023-10-03T10:18:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.889+0000 7fdf20250700 1 -- 172.21.15.72:0/3142663792 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf18139030 msgr2=0x7fdf1813b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.889+0000 7fdf20250700 1 --2- 172.21.15.72:0/3142663792 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf18139030 0x7fdf1813b410 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009e80 tx=0x7fdf1000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.889+0000 7fdf20250700 1 -- 172.21.15.72:0/3142663792 shutdown_connections 2023-10-03T10:18:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.889+0000 7fdf20250700 1 --2- 172.21.15.72:0/3142663792 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf18139030 0x7fdf1813b410 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.889+0000 7fdf20250700 1 --2- 172.21.15.72:0/3142663792 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf18136710 0x7fdf18138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.889+0000 7fdf20250700 1 -- 172.21.15.72:0/3142663792 >> 172.21.15.72:0/3142663792 conn(0x7fdf180a2aa0 msgr2=0x7fdf180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.889+0000 7fdf20250700 1 -- 172.21.15.72:0/3142663792 shutdown_connections 2023-10-03T10:18:52.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.889+0000 7fdf20250700 1 -- 172.21.15.72:0/3142663792 wait complete. 2023-10-03T10:18:52.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.891+0000 7fdf20250700 1 Processor -- start 2023-10-03T10:18:52.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.891+0000 7fdf20250700 1 -- start start 2023-10-03T10:18:52.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.891+0000 7fdf20250700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf181338a0 0x7fdf1811b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf20250700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf18136710 0x7fdf1811bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf20250700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf18139030 0x7fdf181c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf20250700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1811e4a0 con 0x7fdf18136710 2023-10-03T10:18:52.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf20250700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1811d780 con 0x7fdf18139030 2023-10-03T10:18:52.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf20250700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf18138b00 con 0x7fdf181338a0 2023-10-03T10:18:52.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf1dfec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf181338a0 0x7fdf1811b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf1dfec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf181338a0 0x7fdf1811b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36302/0 (socket says 172.21.15.72:36302) 2023-10-03T10:18:52.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf1dfec700 1 -- 172.21.15.72:0/80661679 learned_addr learned my addr 172.21.15.72:0/80661679 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf1e7ed700 1 --2- 172.21.15.72:0/80661679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf18139030 0x7fdf181c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf1d7eb700 1 --2- 172.21.15.72:0/80661679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf18136710 0x7fdf1811bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf1dfec700 1 -- 172.21.15.72:0/80661679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf18139030 msgr2=0x7fdf181c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf1dfec700 1 --2- 172.21.15.72:0/80661679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf18139030 0x7fdf181c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf1dfec700 1 -- 172.21.15.72:0/80661679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf18136710 msgr2=0x7fdf1811bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf1dfec700 1 --2- 172.21.15.72:0/80661679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf18136710 0x7fdf1811bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf1dfec700 1 -- 172.21.15.72:0/80661679 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf10009b30 con 0x7fdf181338a0 2023-10-03T10:18:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf1d7eb700 1 --2- 172.21.15.72:0/80661679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf18136710 0x7fdf1811bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.892+0000 7fdf1dfec700 1 --2- 172.21.15.72:0/80661679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf181338a0 0x7fdf1811b760 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400c4e0 tx=0x7fdf1400c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.893+0000 7fdf0e7fc700 1 -- 172.21.15.72:0/80661679 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf140052d0 con 0x7fdf181338a0 2023-10-03T10:18:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.893+0000 7fdf0e7fc700 1 -- 172.21.15.72:0/80661679 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf14005430 con 0x7fdf181338a0 2023-10-03T10:18:52.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.893+0000 7fdf20250700 1 -- 172.21.15.72:0/80661679 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1811e6d0 con 0x7fdf181338a0 2023-10-03T10:18:52.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.893+0000 7fdf0e7fc700 1 -- 172.21.15.72:0/80661679 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf140038c0 con 0x7fdf181338a0 2023-10-03T10:18:52.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.893+0000 7fdf20250700 1 -- 172.21.15.72:0/80661679 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1811d050 con 0x7fdf181338a0 2023-10-03T10:18:52.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.894+0000 7fdf0e7fc700 1 -- 172.21.15.72:0/80661679 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf14003a20 con 0x7fdf181338a0 2023-10-03T10:18:52.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.894+0000 7fdf0e7fc700 1 -- 172.21.15.72:0/80661679 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdf1403ea70 con 0x7fdf181338a0 2023-10-03T10:18:52.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.894+0000 7fdf20250700 1 -- 172.21.15.72:0/80661679 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1811d2f0 con 0x7fdf181338a0 2023-10-03T10:18:52.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.903+0000 7fdf0e7fc700 1 -- 172.21.15.72:0/80661679 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf14018260 con 0x7fdf181338a0 2023-10-03T10:18:52.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.954+0000 7f542b3d7700 1 Processor -- start 2023-10-03T10:18:52.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.954+0000 7f542b3d7700 1 -- start start 2023-10-03T10:18:52.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.955+0000 7f542b3d7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f542412cf60 0x7f542406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.955+0000 7f542b3d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f542412f8b0 0x7f542412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.955+0000 7f542b3d7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542412cd90 con 0x7f5424130260 2023-10-03T10:18:52.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.955+0000 7f542b3d7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542412d330 con 0x7f542412f8b0 2023-10-03T10:18:52.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.955+0000 7f542b3d7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54241306d0 con 0x7f542412cf60 2023-10-03T10:18:52.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.955+0000 7f5428972700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f542412f8b0 0x7f542412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.955+0000 7f5429974700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5424130260 0x7f5424136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48832/0 (socket says 172.21.15.72:48832) 2023-10-03T10:18:52.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.955+0000 7f5429173700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f542412cf60 0x7f542406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.955+0000 7f5429974700 1 -- 172.21.15.72:0/4238103487 learned_addr learned my addr 172.21.15.72:0/4238103487 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:52.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.955+0000 7f541bfff700 1 -- 172.21.15.72:0/4238103487 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327332237 0 0) 0x7f542412cd90 con 0x7f5424130260 2023-10-03T10:18:52.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.956+0000 7f541bfff700 1 -- 172.21.15.72:0/4238103487 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54100035b0 con 0x7f5424130260 2023-10-03T10:18:52.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.956+0000 7f5428972700 1 -- 172.21.15.72:0/4238103487 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f542412cf60 msgr2=0x7f542406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.956+0000 7f5428972700 1 --2- 172.21.15.72:0/4238103487 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f542412cf60 0x7f542406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.956+0000 7f5428972700 1 -- 172.21.15.72:0/4238103487 >> v1:172.21.15.72:6789/0 conn(0x7f5424130260 legacy=0x7f5424136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.956+0000 7f5428972700 1 -- 172.21.15.72:0/4238103487 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5424071780 con 0x7f542412f8b0 2023-10-03T10:18:52.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.956+0000 7f5429173700 1 --2- 172.21.15.72:0/4238103487 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f542412cf60 0x7f542406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.956+0000 7f5428972700 1 --2- 172.21.15.72:0/4238103487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f542412f8b0 0x7f542412fd20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f5414009870 tx=0x7f5414009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3339a9e2509abad1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.956+0000 7f541bfff700 1 -- 172.21.15.72:0/4238103487 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5414011830 con 0x7f542412f8b0 2023-10-03T10:18:52.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.956+0000 7f541bfff700 1 -- 172.21.15.72:0/4238103487 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5414011990 con 0x7f542412f8b0 2023-10-03T10:18:52.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.956+0000 7f541bfff700 1 -- 172.21.15.72:0/4238103487 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5414011d00 con 0x7f542412f8b0 2023-10-03T10:18:52.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.957+0000 7f542b3d7700 1 -- 172.21.15.72:0/4238103487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f542412f8b0 msgr2=0x7f542412fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.957+0000 7f542b3d7700 1 --2- 172.21.15.72:0/4238103487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f542412f8b0 0x7f542412fd20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f5414009870 tx=0x7f5414009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:52.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.957+0000 7f542b3d7700 1 -- 172.21.15.72:0/4238103487 shutdown_connections 2023-10-03T10:18:52.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.957+0000 7f542b3d7700 1 --2- 172.21.15.72:0/4238103487 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f542412cf60 0x7f542406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.957+0000 7f542b3d7700 1 --2- 172.21.15.72:0/4238103487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f542412f8b0 0x7f542412fd20 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.957+0000 7f542b3d7700 1 -- 172.21.15.72:0/4238103487 >> 172.21.15.72:0/4238103487 conn(0x7f54240a2aa0 msgr2=0x7f54240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.957+0000 7f542b3d7700 1 -- 172.21.15.72:0/4238103487 shutdown_connections 2023-10-03T10:18:52.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.957+0000 7f542b3d7700 1 -- 172.21.15.72:0/4238103487 wait complete. 2023-10-03T10:18:52.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.958+0000 7f542b3d7700 1 Processor -- start 2023-10-03T10:18:52.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.958+0000 7f542b3d7700 1 -- start start 2023-10-03T10:18:52.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.959+0000 7f542b3d7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f542412cf60 0x7f54241309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.959+0000 7f542b3d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f542412f8b0 0x7f5424130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.959+0000 7f542b3d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5424130260 0x7f5424131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.959+0000 7f542b3d7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5424129fa0 con 0x7f542412f8b0 2023-10-03T10:18:52.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.959+0000 7f542b3d7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54241333a0 con 0x7f5424130260 2023-10-03T10:18:52.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.959+0000 7f542b3d7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f542412d960 con 0x7f542412cf60 2023-10-03T10:18:52.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.959+0000 7f5429173700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f542412cf60 0x7f54241309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.959+0000 7f5429173700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f542412cf60 0x7f54241309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36318/0 (socket says 172.21.15.72:36318) 2023-10-03T10:18:52.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.959+0000 7f5429173700 1 -- 172.21.15.72:0/1946695161 learned_addr learned my addr 172.21.15.72:0/1946695161 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:52.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.959+0000 7f5428972700 1 --2- 172.21.15.72:0/1946695161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f542412f8b0 0x7f5424130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.959+0000 7f5429974700 1 --2- 172.21.15.72:0/1946695161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5424130260 0x7f5424131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.960+0000 7f5429173700 1 -- 172.21.15.72:0/1946695161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5424130260 msgr2=0x7f5424131460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.960+0000 7f5429173700 1 --2- 172.21.15.72:0/1946695161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5424130260 0x7f5424131460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.960+0000 7f5429173700 1 -- 172.21.15.72:0/1946695161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f542412f8b0 msgr2=0x7f5424130f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.960+0000 7f5429173700 1 --2- 172.21.15.72:0/1946695161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f542412f8b0 0x7f5424130f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.960+0000 7f5429173700 1 -- 172.21.15.72:0/1946695161 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54200094a0 con 0x7f542412cf60 2023-10-03T10:18:52.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.960+0000 7f5428972700 1 --2- 172.21.15.72:0/1946695161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f542412f8b0 0x7f5424130f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.960+0000 7f5429173700 1 --2- 172.21.15.72:0/1946695161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f542412cf60 0x7f54241309e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f542000ebe0 tx=0x7f542000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.960+0000 7f5419ffb700 1 -- 172.21.15.72:0/1946695161 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542000c850 con 0x7f542412cf60 2023-10-03T10:18:52.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.960+0000 7f5419ffb700 1 -- 172.21.15.72:0/1946695161 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542000c9b0 con 0x7f542412cf60 2023-10-03T10:18:52.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.960+0000 7f542b3d7700 1 -- 172.21.15.72:0/1946695161 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54140094a0 con 0x7f542412cf60 2023-10-03T10:18:52.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.960+0000 7f5419ffb700 1 -- 172.21.15.72:0/1946695161 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542000cd40 con 0x7f542412cf60 2023-10-03T10:18:52.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.960+0000 7f542b3d7700 1 -- 172.21.15.72:0/1946695161 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5424134050 con 0x7f542412cf60 2023-10-03T10:18:52.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.961+0000 7f5419ffb700 1 -- 172.21.15.72:0/1946695161 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5420013470 con 0x7f542412cf60 2023-10-03T10:18:52.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.961+0000 7f5419ffb700 1 -- 172.21.15.72:0/1946695161 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f542003f740 con 0x7f542412cf60 2023-10-03T10:18:52.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.962+0000 7f542b3d7700 1 -- 172.21.15.72:0/1946695161 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5424132ee0 con 0x7f542412cf60 2023-10-03T10:18:52.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.971+0000 7f5419ffb700 1 -- 172.21.15.72:0/1946695161 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5424132ee0 con 0x7f542412cf60 2023-10-03T10:18:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.978+0000 7f5c39c0e700 1 Processor -- start 2023-10-03T10:18:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.978+0000 7f5c39c0e700 1 -- start start 2023-10-03T10:18:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.979+0000 7f5c39c0e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5c3409e930 0x7f5c3409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.979+0000 7f5c39c0e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c3409f240 0x7f5c341317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.979+0000 7f5c39c0e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5c3409f650 0x7f5c34131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.979+0000 7f5c39c0e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c34070940 con 0x7f5c3409e930 2023-10-03T10:18:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.979+0000 7f5c39c0e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3406fd60 con 0x7f5c3409f240 2023-10-03T10:18:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.979+0000 7f5c39c0e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3406fa80 con 0x7f5c3409f650 2023-10-03T10:18:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.979+0000 7f5c337fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5c3409e930 0x7f5c3409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.979+0000 7f5c337fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5c3409e930 0x7f5c3409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51034/0 (socket says 172.21.15.72:51034) 2023-10-03T10:18:52.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.979+0000 7f5c337fe700 1 -- 172.21.15.72:0/2060525193 learned_addr learned my addr 172.21.15.72:0/2060525193 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:52.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.979+0000 7f5c32ffd700 1 --2- 172.21.15.72:0/2060525193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c3409f240 0x7f5c341317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.979+0000 7f5c33fff700 1 --2- 172.21.15.72:0/2060525193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5c3409f650 0x7f5c34131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.979+0000 7f5c33fff700 1 -- 172.21.15.72:0/2060525193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c3409f240 msgr2=0x7f5c341317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.979+0000 7f5c33fff700 1 --2- 172.21.15.72:0/2060525193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c3409f240 0x7f5c341317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.979+0000 7f5c33fff700 1 -- 172.21.15.72:0/2060525193 >> v2:172.21.15.72:3300/0 conn(0x7f5c3409e930 msgr2=0x7f5c3409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.980+0000 7f5c33fff700 1 --2- 172.21.15.72:0/2060525193 >> v2:172.21.15.72:3300/0 conn(0x7f5c3409e930 0x7f5c3409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.980+0000 7f5c33fff700 1 -- 172.21.15.72:0/2060525193 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3409fb60 con 0x7f5c3409f650 2023-10-03T10:18:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.980+0000 7f5c337fe700 1 --2- 172.21.15.72:0/2060525193 >> v2:172.21.15.72:3300/0 conn(0x7f5c3409e930 0x7f5c3409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.980+0000 7f5c33fff700 1 --2- 172.21.15.72:0/2060525193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5c3409f650 0x7f5c34131d30 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009d90 tx=0x7f5c2c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a708d68ace599c0f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.980+0000 7f5c327fc700 1 -- 172.21.15.72:0/2060525193 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c00bd20 con 0x7f5c3409f650 2023-10-03T10:18:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.980+0000 7f5c327fc700 1 -- 172.21.15.72:0/2060525193 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c00be80 con 0x7f5c3409f650 2023-10-03T10:18:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.980+0000 7f5c327fc700 1 -- 172.21.15.72:0/2060525193 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c010710 con 0x7f5c3409f650 2023-10-03T10:18:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.980+0000 7f5c39c0e700 1 -- 172.21.15.72:0/2060525193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5c3409f650 msgr2=0x7f5c34131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.980+0000 7f5c39c0e700 1 --2- 172.21.15.72:0/2060525193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5c3409f650 0x7f5c34131d30 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009d90 tx=0x7f5c2c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.981+0000 7f5c39c0e700 1 -- 172.21.15.72:0/2060525193 shutdown_connections 2023-10-03T10:18:52.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.981+0000 7f5c39c0e700 1 --2- 172.21.15.72:0/2060525193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5c3409f650 0x7f5c34131d30 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.981+0000 7f5c39c0e700 1 --2- 172.21.15.72:0/2060525193 >> v2:172.21.15.72:3300/0 conn(0x7f5c3409e930 0x7f5c3409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.981+0000 7f5c39c0e700 1 --2- 172.21.15.72:0/2060525193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c3409f240 0x7f5c341317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.981+0000 7f5c39c0e700 1 -- 172.21.15.72:0/2060525193 >> 172.21.15.72:0/2060525193 conn(0x7f5c340a4210 msgr2=0x7f5c340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.981+0000 7f5c39c0e700 1 -- 172.21.15.72:0/2060525193 shutdown_connections 2023-10-03T10:18:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.981+0000 7f5c39c0e700 1 -- 172.21.15.72:0/2060525193 wait complete. 2023-10-03T10:18:52.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.982+0000 7f5c39c0e700 1 Processor -- start 2023-10-03T10:18:52.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.982+0000 7f5c39c0e700 1 -- start start 2023-10-03T10:18:52.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.982+0000 7f5c39c0e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c3409e930 0x7f5c341c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.982+0000 7f5c39c0e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c3409f240 0x7f5c341c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.982+0000 7f5c39c0e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5c3409f650 0x7f5c341cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.982+0000 7f5c39c0e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c341beb90 con 0x7f5c3409f240 2023-10-03T10:18:52.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.982+0000 7f5c39c0e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c341bfaa0 con 0x7f5c3409e930 2023-10-03T10:18:52.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.982+0000 7f5c39c0e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c341bd7e0 con 0x7f5c3409f650 2023-10-03T10:18:52.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.982+0000 7f5c33fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5c3409f650 0x7f5c341cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.982+0000 7f5c33fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5c3409f650 0x7f5c341cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36330/0 (socket says 172.21.15.72:36330) 2023-10-03T10:18:52.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.982+0000 7f5c33fff700 1 -- 172.21.15.72:0/125650926 learned_addr learned my addr 172.21.15.72:0/125650926 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:52.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.982+0000 7f5c337fe700 1 --2- 172.21.15.72:0/125650926 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c3409e930 0x7f5c341c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.983+0000 7f5c33fff700 1 -- 172.21.15.72:0/125650926 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c3409e930 msgr2=0x7f5c341c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.983+0000 7f5c33fff700 1 --2- 172.21.15.72:0/125650926 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c3409e930 0x7f5c341c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.983+0000 7f5c33fff700 1 -- 172.21.15.72:0/125650926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c3409f240 msgr2=0x7f5c341c0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.983+0000 7f5c32ffd700 1 --2- 172.21.15.72:0/125650926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c3409f240 0x7f5c341c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.983+0000 7f5c33fff700 1 --2- 172.21.15.72:0/125650926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c3409f240 0x7f5c341c0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.983+0000 7f5c33fff700 1 -- 172.21.15.72:0/125650926 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c24009550 con 0x7f5c3409f650 2023-10-03T10:18:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.983+0000 7f5c32ffd700 1 --2- 172.21.15.72:0/125650926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c3409f240 0x7f5c341c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.983+0000 7f5c33fff700 1 --2- 172.21.15.72:0/125650926 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5c3409f650 0x7f5c341cc800 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00b680 tx=0x7f5c2c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.983+0000 7f5c1bfff700 1 -- 172.21.15.72:0/125650926 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c010070 con 0x7f5c3409f650 2023-10-03T10:18:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.983+0000 7f5c1bfff700 1 -- 172.21.15.72:0/125650926 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c0042d0 con 0x7f5c3409f650 2023-10-03T10:18:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.983+0000 7f5c1bfff700 1 -- 172.21.15.72:0/125650926 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c004660 con 0x7f5c3409f650 2023-10-03T10:18:52.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.983+0000 7f5c39c0e700 1 -- 172.21.15.72:0/125650926 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2c009a70 con 0x7f5c3409f650 2023-10-03T10:18:52.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.983+0000 7f5c39c0e700 1 -- 172.21.15.72:0/125650926 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c340a0190 con 0x7f5c3409f650 2023-10-03T10:18:52.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.984+0000 7f5c39c0e700 1 -- 172.21.15.72:0/125650926 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c341bedb0 con 0x7f5c3409f650 2023-10-03T10:18:52.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.984+0000 7f5c1bfff700 1 -- 172.21.15.72:0/125650926 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c2c0047c0 con 0x7f5c3409f650 2023-10-03T10:18:52.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.985+0000 7f5c1bfff700 1 -- 172.21.15.72:0/125650926 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5c2c0403b0 con 0x7f5c3409f650 2023-10-03T10:18:52.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:52.993+0000 7f5c1bfff700 1 -- 172.21.15.72:0/125650926 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c2c021bf0 con 0x7f5c3409f650 2023-10-03T10:18:53.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.087+0000 7f88b723d700 1 -- 172.21.15.72:0/1249748407 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f88b00a0b90 con 0x7f88b009de50 2023-10-03T10:18:53.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.087+0000 7f88ad7fa700 1 -- 172.21.15.72:0/1249748407 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f88a4044060 con 0x7f88b009de50 2023-10-03T10:18:53.088 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:53.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.089+0000 7f88b723d700 1 -- 172.21.15.72:0/1249748407 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009de50 msgr2=0x7f88b0099a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.089+0000 7f88b723d700 1 --2- 172.21.15.72:0/1249748407 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009de50 0x7f88b0099a70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f88a400e910 tx=0x7f88a400ecd0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.089+0000 7f88b723d700 1 -- 172.21.15.72:0/1249748407 shutdown_connections 2023-10-03T10:18:53.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.089+0000 7f88b723d700 1 --2- 172.21.15.72:0/1249748407 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b01338a0 0x7f88b009a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.089+0000 7f88b723d700 1 --2- 172.21.15.72:0/1249748407 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009de50 0x7f88b0099a70 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.089+0000 7f88b723d700 1 --2- 172.21.15.72:0/1249748407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b009e760 0x7f88b0099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.089+0000 7f88b723d700 1 -- 172.21.15.72:0/1249748407 >> 172.21.15.72:0/1249748407 conn(0x7f88b00a2aa0 msgr2=0x7f88b009edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.089+0000 7f88b723d700 1 -- 172.21.15.72:0/1249748407 shutdown_connections 2023-10-03T10:18:53.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.089+0000 7f88b723d700 1 -- 172.21.15.72:0/1249748407 wait complete. 2023-10-03T10:18:53.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:53.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.105+0000 7fdf20250700 1 -- 172.21.15.72:0/80661679 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdf18074ea0 con 0x7fdf181338a0 2023-10-03T10:18:53.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.105+0000 7fdf0e7fc700 1 -- 172.21.15.72:0/80661679 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf14017020 con 0x7fdf181338a0 2023-10-03T10:18:53.106 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:53.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.108+0000 7fdf20250700 1 -- 172.21.15.72:0/80661679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf181338a0 msgr2=0x7fdf1811b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.108+0000 7fdf20250700 1 --2- 172.21.15.72:0/80661679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf181338a0 0x7fdf1811b760 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400c4e0 tx=0x7fdf1400c7f0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.108+0000 7fdf20250700 1 -- 172.21.15.72:0/80661679 shutdown_connections 2023-10-03T10:18:53.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.108+0000 7fdf20250700 1 --2- 172.21.15.72:0/80661679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf18139030 0x7fdf181c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.108+0000 7fdf20250700 1 --2- 172.21.15.72:0/80661679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdf181338a0 0x7fdf1811b760 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.108+0000 7fdf20250700 1 --2- 172.21.15.72:0/80661679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf18136710 0x7fdf1811bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.108+0000 7fdf20250700 1 -- 172.21.15.72:0/80661679 >> 172.21.15.72:0/80661679 conn(0x7fdf180a2aa0 msgr2=0x7fdf181344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.108+0000 7fdf20250700 1 -- 172.21.15.72:0/80661679 shutdown_connections 2023-10-03T10:18:53.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.108+0000 7fdf20250700 1 -- 172.21.15.72:0/80661679 wait complete. 2023-10-03T10:18:53.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:53.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.197+0000 7f542b3d7700 1 -- 172.21.15.72:0/1946695161 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5424132ee0 con 0x7f542412cf60 2023-10-03T10:18:53.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.197+0000 7f5419ffb700 1 -- 172.21.15.72:0/1946695161 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f5424132ee0 con 0x7f542412cf60 2023-10-03T10:18:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.199+0000 7f542b3d7700 1 -- 172.21.15.72:0/1946695161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f542412cf60 msgr2=0x7f54241309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.199+0000 7f542b3d7700 1 --2- 172.21.15.72:0/1946695161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f542412cf60 0x7f54241309e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f542000ebe0 tx=0x7f542000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.199+0000 7f542b3d7700 1 -- 172.21.15.72:0/1946695161 shutdown_connections 2023-10-03T10:18:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.199+0000 7f542b3d7700 1 --2- 172.21.15.72:0/1946695161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5424130260 0x7f5424131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.199+0000 7f542b3d7700 1 --2- 172.21.15.72:0/1946695161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f542412cf60 0x7f54241309e0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.199+0000 7f542b3d7700 1 --2- 172.21.15.72:0/1946695161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f542412f8b0 0x7f5424130f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.199+0000 7f542b3d7700 1 -- 172.21.15.72:0/1946695161 >> 172.21.15.72:0/1946695161 conn(0x7f54240a2aa0 msgr2=0x7f54240a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.199+0000 7f542b3d7700 1 -- 172.21.15.72:0/1946695161 shutdown_connections 2023-10-03T10:18:53.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.199+0000 7f542b3d7700 1 -- 172.21.15.72:0/1946695161 wait complete. 2023-10-03T10:18:53.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.216+0000 7f5c39c0e700 1 -- 172.21.15.72:0/125650926 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5c34074ea0 con 0x7f5c3409f650 2023-10-03T10:18:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.217+0000 7f5c1bfff700 1 -- 172.21.15.72:0/125650926 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c2c027070 con 0x7f5c3409f650 2023-10-03T10:18:53.217 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:53.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.219+0000 7f5c39c0e700 1 -- 172.21.15.72:0/125650926 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5c3409f650 msgr2=0x7f5c341cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.219+0000 7f5c39c0e700 1 --2- 172.21.15.72:0/125650926 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5c3409f650 0x7f5c341cc800 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00b680 tx=0x7f5c2c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.219+0000 7f5c39c0e700 1 -- 172.21.15.72:0/125650926 shutdown_connections 2023-10-03T10:18:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.219+0000 7f5c39c0e700 1 --2- 172.21.15.72:0/125650926 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5c3409f650 0x7f5c341cc800 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.219+0000 7f5c39c0e700 1 --2- 172.21.15.72:0/125650926 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5c3409e930 0x7f5c341c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.219+0000 7f5c39c0e700 1 --2- 172.21.15.72:0/125650926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c3409f240 0x7f5c341c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.219+0000 7f5c39c0e700 1 -- 172.21.15.72:0/125650926 >> 172.21.15.72:0/125650926 conn(0x7f5c340a4210 msgr2=0x7f5c340a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.219+0000 7f5c39c0e700 1 -- 172.21.15.72:0/125650926 shutdown_connections 2023-10-03T10:18:53.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:53.219+0000 7f5c39c0e700 1 -- 172.21.15.72:0/125650926 wait complete. 2023-10-03T10:18:53.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:54.104 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:54.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:54.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:54.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:54.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.246+0000 7f8c6863b700 1 Processor -- start 2023-10-03T10:18:54.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.246+0000 7f8c6863b700 1 -- start start 2023-10-03T10:18:54.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.247+0000 7f8c6863b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8c6009e1d0 0x7f8c60135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.247+0000 7f8c6863b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c60135e50 0x7f8c60138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.247+0000 7f8c6863b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6009f130 con 0x7f8c6009d6f0 2023-10-03T10:18:54.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.247+0000 7f8c6863b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6009f520 con 0x7f8c6009e1d0 2023-10-03T10:18:54.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.247+0000 7f8c6863b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6009e930 con 0x7f8c60135e50 2023-10-03T10:18:54.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.247+0000 7f8c65bd6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8c6009e1d0 0x7f8c60135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.247+0000 7f8c65bd6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8c6009e1d0 0x7f8c60135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51052/0 (socket says 172.21.15.72:51052) 2023-10-03T10:18:54.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.247+0000 7f8c65bd6700 1 -- 172.21.15.72:0/1273660480 learned_addr learned my addr 172.21.15.72:0/1273660480 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:54.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.247+0000 7f8c66bd8700 1 --2- 172.21.15.72:0/1273660480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c60135e50 0x7f8c60138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.248+0000 7f8c65bd6700 1 -- 172.21.15.72:0/1273660480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c60135e50 msgr2=0x7f8c60138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.248+0000 7f8c65bd6700 1 --2- 172.21.15.72:0/1273660480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c60135e50 0x7f8c60138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.248+0000 7f8c65bd6700 1 -- 172.21.15.72:0/1273660480 >> v1:172.21.15.72:6789/0 conn(0x7f8c6009d6f0 legacy=0x7f8c6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.248+0000 7f8c65bd6700 1 -- 172.21.15.72:0/1273660480 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6009b2d0 con 0x7f8c6009e1d0 2023-10-03T10:18:54.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.248+0000 7f8c66bd8700 1 --2- 172.21.15.72:0/1273660480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c60135e50 0x7f8c60138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.248+0000 7f8c65bd6700 1 --2- 172.21.15.72:0/1273660480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c6009e1d0 0x7f8c60135910 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f8c500098f0 tx=0x7f8c50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54a694a9b66e9e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.248+0000 7f8c653d5700 1 -- 172.21.15.72:0/1273660480 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c50011830 con 0x7f8c6009e1d0 2023-10-03T10:18:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.248+0000 7f8c653d5700 1 -- 172.21.15.72:0/1273660480 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c50011990 con 0x7f8c6009e1d0 2023-10-03T10:18:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.248+0000 7f8c653d5700 1 -- 172.21.15.72:0/1273660480 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c50011d20 con 0x7f8c6009e1d0 2023-10-03T10:18:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.249+0000 7f8c6863b700 1 -- 172.21.15.72:0/1273660480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c6009e1d0 msgr2=0x7f8c60135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.249+0000 7f8c6863b700 1 --2- 172.21.15.72:0/1273660480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c6009e1d0 0x7f8c60135910 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f8c500098f0 tx=0x7f8c50009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.249+0000 7f8c6863b700 1 -- 172.21.15.72:0/1273660480 shutdown_connections 2023-10-03T10:18:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.249+0000 7f8c6863b700 1 --2- 172.21.15.72:0/1273660480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c60135e50 0x7f8c60138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.249+0000 7f8c6863b700 1 --2- 172.21.15.72:0/1273660480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c6009e1d0 0x7f8c60135910 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.249+0000 7f8c6863b700 1 -- 172.21.15.72:0/1273660480 >> 172.21.15.72:0/1273660480 conn(0x7f8c60066f50 msgr2=0x7f8c6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.249+0000 7f8c6863b700 1 -- 172.21.15.72:0/1273660480 shutdown_connections 2023-10-03T10:18:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.249+0000 7f8c6863b700 1 -- 172.21.15.72:0/1273660480 wait complete. 2023-10-03T10:18:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.250+0000 7f8c6863b700 1 Processor -- start 2023-10-03T10:18:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.250+0000 7f8c6863b700 1 -- start start 2023-10-03T10:18:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.251+0000 7f8c6863b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c6009d6f0 0x7f8c6011e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.251+0000 7f8c6863b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c6009e1d0 0x7f8c6011e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.251+0000 7f8c6863b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c60135e50 0x7f8c601c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.251+0000 7f8c6863b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c601213b0 con 0x7f8c6009d6f0 2023-10-03T10:18:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.251+0000 7f8c6863b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c601204f0 con 0x7f8c60135e50 2023-10-03T10:18:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.251+0000 7f8c6863b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c601218d0 con 0x7f8c6009e1d0 2023-10-03T10:18:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.251+0000 7f8c663d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c6009d6f0 0x7f8c6011e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.251+0000 7f8c65bd6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c6009e1d0 0x7f8c6011e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.251+0000 7f8c663d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c6009d6f0 0x7f8c6011e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51058/0 (socket says 172.21.15.72:51058) 2023-10-03T10:18:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.251+0000 7f8c663d7700 1 -- 172.21.15.72:0/98402283 learned_addr learned my addr 172.21.15.72:0/98402283 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.252+0000 7f8c663d7700 1 -- 172.21.15.72:0/98402283 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c6009e1d0 msgr2=0x7f8c6011e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.252+0000 7f8c663d7700 1 --2- 172.21.15.72:0/98402283 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c6009e1d0 0x7f8c6011e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.252+0000 7f8c663d7700 1 -- 172.21.15.72:0/98402283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c60135e50 msgr2=0x7f8c601c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.252+0000 7f8c663d7700 1 --2- 172.21.15.72:0/98402283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c60135e50 0x7f8c601c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.252+0000 7f8c663d7700 1 -- 172.21.15.72:0/98402283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c58009a70 con 0x7f8c6009d6f0 2023-10-03T10:18:54.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.252+0000 7f8c65bd6700 1 --2- 172.21.15.72:0/98402283 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c6009e1d0 0x7f8c6011e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.252+0000 7f8c663d7700 1 --2- 172.21.15.72:0/98402283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c6009d6f0 0x7f8c6011e300 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00c480 tx=0x7f8c5c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.252+0000 7f8c56ffd700 1 -- 172.21.15.72:0/98402283 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c00cea0 con 0x7f8c6009d6f0 2023-10-03T10:18:54.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.252+0000 7f8c56ffd700 1 -- 172.21.15.72:0/98402283 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c0052d0 con 0x7f8c6009d6f0 2023-10-03T10:18:54.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.252+0000 7f8c6863b700 1 -- 172.21.15.72:0/98402283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c50009550 con 0x7f8c6009d6f0 2023-10-03T10:18:54.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.252+0000 7f8c6863b700 1 -- 172.21.15.72:0/98402283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c60121e20 con 0x7f8c6009d6f0 2023-10-03T10:18:54.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.252+0000 7f8c56ffd700 1 -- 172.21.15.72:0/98402283 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c003680 con 0x7f8c6009d6f0 2023-10-03T10:18:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.253+0000 7f8c56ffd700 1 -- 172.21.15.72:0/98402283 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c5c0037e0 con 0x7f8c6009d6f0 2023-10-03T10:18:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.253+0000 7f8c56ffd700 1 -- 172.21.15.72:0/98402283 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c5c03ea70 con 0x7f8c6009d6f0 2023-10-03T10:18:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.253+0000 7f8c6863b700 1 -- 172.21.15.72:0/98402283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c480052e0 con 0x7f8c6009d6f0 2023-10-03T10:18:54.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.262+0000 7f8c56ffd700 1 -- 172.21.15.72:0/98402283 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c5c011590 con 0x7f8c6009d6f0 2023-10-03T10:18:54.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.284+0000 7fbba5c0b700 1 Processor -- start 2023-10-03T10:18:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.284+0000 7fbba5c0b700 1 -- start start 2023-10-03T10:18:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.284+0000 7fbba5c0b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbba006e570 0x7fbba006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.284+0000 7fbba5c0b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006ee80 0x7fbba0134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.284+0000 7fbba5c0b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba0070ee0 con 0x7fbba009eca0 2023-10-03T10:18:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.284+0000 7fbba5c0b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba0071480 con 0x7fbba006ee80 2023-10-03T10:18:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.284+0000 7fbba5c0b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbba0071b90 con 0x7fbba006e570 2023-10-03T10:18:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.284+0000 7fbb9f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbba006e570 0x7fbba006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.284+0000 7fbb9ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006ee80 0x7fbba0134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.284+0000 7fbb9f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbba006e570 0x7fbba006e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36370/0 (socket says 172.21.15.72:36370) 2023-10-03T10:18:54.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.284+0000 7fbb9ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006ee80 0x7fbba0134d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40880/0 (socket says 172.21.15.72:40880) 2023-10-03T10:18:54.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.284+0000 7fbb9f7fe700 1 -- 172.21.15.72:0/3341247862 learned_addr learned my addr 172.21.15.72:0/3341247862 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.285+0000 7fbb9f7fe700 1 -- 172.21.15.72:0/3341247862 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006ee80 msgr2=0x7fbba0134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.285+0000 7fbb9f7fe700 1 --2- 172.21.15.72:0/3341247862 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006ee80 0x7fbba0134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.285+0000 7fbb9f7fe700 1 -- 172.21.15.72:0/3341247862 >> v1:172.21.15.72:6789/0 conn(0x7fbba009eca0 legacy=0x7fbba0134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.285+0000 7fbb9f7fe700 1 -- 172.21.15.72:0/3341247862 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba00711a0 con 0x7fbba006e570 2023-10-03T10:18:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.285+0000 7fbb9f7fe700 1 --2- 172.21.15.72:0/3341247862 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbba006e570 0x7fbba006e940 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fbb90009920 tx=0x7fbb90009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90067779710414e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.285+0000 7fbb9e7fc700 1 -- 172.21.15.72:0/3341247862 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90004230 con 0x7fbba006e570 2023-10-03T10:18:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.285+0000 7fbb9e7fc700 1 -- 172.21.15.72:0/3341247862 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb90004390 con 0x7fbba006e570 2023-10-03T10:18:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.285+0000 7fbb9e7fc700 1 -- 172.21.15.72:0/3341247862 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb900036a0 con 0x7fbba006e570 2023-10-03T10:18:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.286+0000 7fbba5c0b700 1 -- 172.21.15.72:0/3341247862 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbba006e570 msgr2=0x7fbba006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.286+0000 7fbba5c0b700 1 --2- 172.21.15.72:0/3341247862 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbba006e570 0x7fbba006e940 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fbb90009920 tx=0x7fbb90009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.286+0000 7fbba5c0b700 1 -- 172.21.15.72:0/3341247862 shutdown_connections 2023-10-03T10:18:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.286+0000 7fbba5c0b700 1 --2- 172.21.15.72:0/3341247862 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006ee80 0x7fbba0134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.286+0000 7fbba5c0b700 1 --2- 172.21.15.72:0/3341247862 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbba006e570 0x7fbba006e940 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.286+0000 7fbba5c0b700 1 -- 172.21.15.72:0/3341247862 >> 172.21.15.72:0/3341247862 conn(0x7fbba00a2aa0 msgr2=0x7fbba00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.286+0000 7fbba5c0b700 1 -- 172.21.15.72:0/3341247862 shutdown_connections 2023-10-03T10:18:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.286+0000 7fbba5c0b700 1 -- 172.21.15.72:0/3341247862 wait complete. 2023-10-03T10:18:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.287+0000 7fbba5c0b700 1 Processor -- start 2023-10-03T10:18:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.287+0000 7fbba5c0b700 1 -- start start 2023-10-03T10:18:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.287+0000 7fbba5c0b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbba006e570 0x7fbba0140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.287+0000 7fbba5c0b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006ee80 0x7fbba013b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.287+0000 7fbba5c0b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba013b760 0x7fbba013bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.287+0000 7fbba5c0b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba0070610 con 0x7fbba013b760 2023-10-03T10:18:54.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.287+0000 7fbba5c0b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba013ed40 con 0x7fbba006ee80 2023-10-03T10:18:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.287+0000 7fbba5c0b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbba013c680 con 0x7fbba006e570 2023-10-03T10:18:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.287+0000 7fbb9f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbba006e570 0x7fbba0140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.287+0000 7fbb9f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbba006e570 0x7fbba0140430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36372/0 (socket says 172.21.15.72:36372) 2023-10-03T10:18:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.287+0000 7fbb9f7fe700 1 -- 172.21.15.72:0/1597561829 learned_addr learned my addr 172.21.15.72:0/1597561829 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.287+0000 7fbb9ffff700 1 --2- 172.21.15.72:0/1597561829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba013b760 0x7fbba013bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.287+0000 7fbb9effd700 1 --2- 172.21.15.72:0/1597561829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006ee80 0x7fbba013b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.288+0000 7fbb9f7fe700 1 -- 172.21.15.72:0/1597561829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006ee80 msgr2=0x7fbba013b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.288+0000 7fbb9f7fe700 1 --2- 172.21.15.72:0/1597561829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006ee80 0x7fbba013b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.288+0000 7fbb9f7fe700 1 -- 172.21.15.72:0/1597561829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba013b760 msgr2=0x7fbba013bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.288+0000 7fbb9f7fe700 1 --2- 172.21.15.72:0/1597561829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba013b760 0x7fbba013bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.288+0000 7fbb9f7fe700 1 -- 172.21.15.72:0/1597561829 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb90009550 con 0x7fbba006e570 2023-10-03T10:18:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.288+0000 7fbb9f7fe700 1 --2- 172.21.15.72:0/1597561829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbba006e570 0x7fbba0140430 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbb900098f0 tx=0x7fbb90004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.288+0000 7fbb87fff700 1 -- 172.21.15.72:0/1597561829 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90003db0 con 0x7fbba006e570 2023-10-03T10:18:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.288+0000 7fbb87fff700 1 -- 172.21.15.72:0/1597561829 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb90011630 con 0x7fbba006e570 2023-10-03T10:18:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.288+0000 7fbba5c0b700 1 -- 172.21.15.72:0/1597561829 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba0135bc0 con 0x7fbba006e570 2023-10-03T10:18:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.288+0000 7fbb87fff700 1 -- 172.21.15.72:0/1597561829 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb900119e0 con 0x7fbba006e570 2023-10-03T10:18:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.288+0000 7fbba5c0b700 1 -- 172.21.15.72:0/1597561829 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba013e4d0 con 0x7fbba006e570 2023-10-03T10:18:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.289+0000 7fbba5c0b700 1 -- 172.21.15.72:0/1597561829 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba0074ea0 con 0x7fbba006e570 2023-10-03T10:18:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.290+0000 7fbb87fff700 1 -- 172.21.15.72:0/1597561829 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb90021070 con 0x7fbba006e570 2023-10-03T10:18:54.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.290+0000 7fbb87fff700 1 -- 172.21.15.72:0/1597561829 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbb9001a7e0 con 0x7fbba006e570 2023-10-03T10:18:54.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.294+0000 7fbb87fff700 1 -- 172.21.15.72:0/1597561829 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb9001a460 con 0x7fbba006e570 2023-10-03T10:18:54.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.373+0000 7efdbeeba700 1 Processor -- start 2023-10-03T10:18:54.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.373+0000 7efdbeeba700 1 -- start start 2023-10-03T10:18:54.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.374+0000 7efdbeeba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdb809d6f0 0x7efdb809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.374+0000 7efdbeeba700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdb809e000 0x7efdb8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.374+0000 7efdbeeba700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efdb809e410 0x7efdb8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.374+0000 7efdbeeba700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb809f520 con 0x7efdb809e410 2023-10-03T10:18:54.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.374+0000 7efdbeeba700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb809f130 con 0x7efdb809d6f0 2023-10-03T10:18:54.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.374+0000 7efdbeeba700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdb809e930 con 0x7efdb809e000 2023-10-03T10:18:54.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.374+0000 7efdbcc56700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdb809d6f0 0x7efdb809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.374+0000 7efdbcc56700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdb809d6f0 0x7efdb809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40910/0 (socket says 172.21.15.72:40910) 2023-10-03T10:18:54.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.374+0000 7efdbcc56700 1 -- 172.21.15.72:0/193868719 learned_addr learned my addr 172.21.15.72:0/193868719 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:54.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.374+0000 7efdbd457700 1 --2- 172.21.15.72:0/193868719 >> v2:172.21.15.72:3300/0 conn(0x7efdb809e410 0x7efdb8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.374+0000 7efdbcc56700 1 -- 172.21.15.72:0/193868719 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdb809e000 msgr2=0x7efdb8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.374+0000 7efdbcc56700 1 --2- 172.21.15.72:0/193868719 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdb809e000 0x7efdb8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.375+0000 7efdbcc56700 1 -- 172.21.15.72:0/193868719 >> v2:172.21.15.72:3300/0 conn(0x7efdb809e410 msgr2=0x7efdb8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.375+0000 7efdbcc56700 1 --2- 172.21.15.72:0/193868719 >> v2:172.21.15.72:3300/0 conn(0x7efdb809e410 0x7efdb8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.375+0000 7efdbcc56700 1 -- 172.21.15.72:0/193868719 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb809b2d0 con 0x7efdb809d6f0 2023-10-03T10:18:54.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.375+0000 7efdbcc56700 1 --2- 172.21.15.72:0/193868719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdb809d6f0 0x7efdb809dac0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7efdac00bbc0 tx=0x7efdac00bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99d29463b8d07a3c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.375+0000 7f0f5de06700 1 Processor -- start 2023-10-03T10:18:54.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.375+0000 7f0f5de06700 1 -- start start 2023-10-03T10:18:54.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.375+0000 7efdb77fe700 1 -- 172.21.15.72:0/193868719 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac00dc30 con 0x7efdb809d6f0 2023-10-03T10:18:54.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.375+0000 7efdb77fe700 1 -- 172.21.15.72:0/193868719 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac00dd90 con 0x7efdb809d6f0 2023-10-03T10:18:54.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.375+0000 7efdb77fe700 1 -- 172.21.15.72:0/193868719 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac012990 con 0x7efdb809d6f0 2023-10-03T10:18:54.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7f0f5de06700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0f58130750 0x7f0f58130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7f0f5de06700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f5809d6f0 0x7f0f5809db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7f0f5de06700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5809c190 con 0x7f0f5809e080 2023-10-03T10:18:54.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7f0f5de06700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5809b090 con 0x7f0f58130750 2023-10-03T10:18:54.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7f0f5de06700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5809a6c0 con 0x7f0f5809d6f0 2023-10-03T10:18:54.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7efdbeeba700 1 -- 172.21.15.72:0/193868719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdb809d6f0 msgr2=0x7efdb809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7efdbeeba700 1 --2- 172.21.15.72:0/193868719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdb809d6f0 0x7efdb809dac0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7efdac00bbc0 tx=0x7efdac00bed0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7f0f577fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0f58130750 0x7f0f58130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7f0f577fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0f58130750 0x7f0f58130b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51092/0 (socket says 172.21.15.72:51092) 2023-10-03T10:18:54.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7f0f577fe700 1 -- 172.21.15.72:0/4285318320 learned_addr learned my addr 172.21.15.72:0/4285318320 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:54.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7efdbeeba700 1 -- 172.21.15.72:0/193868719 shutdown_connections 2023-10-03T10:18:54.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7efdbeeba700 1 --2- 172.21.15.72:0/193868719 >> v2:172.21.15.72:3300/0 conn(0x7efdb809e410 0x7efdb8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7efdbeeba700 1 --2- 172.21.15.72:0/193868719 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdb809d6f0 0x7efdb809dac0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7efdbeeba700 1 --2- 172.21.15.72:0/193868719 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdb809e000 0x7efdb8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7efdbeeba700 1 -- 172.21.15.72:0/193868719 >> 172.21.15.72:0/193868719 conn(0x7efdb8066f50 msgr2=0x7efdb809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7efdbeeba700 1 -- 172.21.15.72:0/193868719 shutdown_connections 2023-10-03T10:18:54.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7efdbeeba700 1 -- 172.21.15.72:0/193868719 wait complete. 2023-10-03T10:18:54.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7f0f56ffd700 1 --2- 172.21.15.72:0/4285318320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f5809d6f0 0x7f0f5809db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7f0f567fc700 1 -- 172.21.15.72:0/4285318320 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869446741 0 0) 0x7f0f5809c190 con 0x7f0f5809e080 2023-10-03T10:18:54.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.376+0000 7f0f567fc700 1 -- 172.21.15.72:0/4285318320 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f400079c0 con 0x7f0f5809e080 2023-10-03T10:18:54.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.377+0000 7f0f56ffd700 1 -- 172.21.15.72:0/4285318320 >> v2:172.21.15.72:3300/0 conn(0x7f0f58130750 msgr2=0x7f0f58130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.377+0000 7f0f56ffd700 1 --2- 172.21.15.72:0/4285318320 >> v2:172.21.15.72:3300/0 conn(0x7f0f58130750 0x7f0f58130b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.377+0000 7f0f567fc700 1 -- 172.21.15.72:0/4285318320 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2916074250 0 0) 0x7f0f400079c0 con 0x7f0f5809e080 2023-10-03T10:18:54.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.377+0000 7f0f56ffd700 1 -- 172.21.15.72:0/4285318320 >> v1:172.21.15.72:6789/0 conn(0x7f0f5809e080 legacy=0x7f0f581374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.377+0000 7f0f56ffd700 1 -- 172.21.15.72:0/4285318320 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5809e500 con 0x7f0f5809d6f0 2023-10-03T10:18:54.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.377+0000 7f0f56ffd700 1 --2- 172.21.15.72:0/4285318320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f5809d6f0 0x7f0f5809db40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009840 tx=0x7f0f4c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c30bd0f5ed5b6005 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.377+0000 7efdbeeba700 1 Processor -- start 2023-10-03T10:18:54.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.377+0000 7efdbeeba700 1 -- start start 2023-10-03T10:18:54.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.377+0000 7f0f567fc700 1 -- 172.21.15.72:0/4285318320 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f500019f0 con 0x7f0f5809d6f0 2023-10-03T10:18:54.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.377+0000 7f0f567fc700 1 -- 172.21.15.72:0/4285318320 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c004030 con 0x7f0f5809d6f0 2023-10-03T10:18:54.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.377+0000 7f0f567fc700 1 -- 172.21.15.72:0/4285318320 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c0043a0 con 0x7f0f5809d6f0 2023-10-03T10:18:54.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbeeba700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb809d6f0 0x7efdb811e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbeeba700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdb809e000 0x7efdb811e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbeeba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdb809e410 0x7efdb811ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbeeba700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb811f5b0 con 0x7efdb809d6f0 2023-10-03T10:18:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbeeba700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8072600 con 0x7efdb809e410 2023-10-03T10:18:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbeeba700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdb809c700 con 0x7efdb809e000 2023-10-03T10:18:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbcc56700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb809d6f0 0x7efdb811e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbcc56700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb809d6f0 0x7efdb811e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51094/0 (socket says 172.21.15.72:51094) 2023-10-03T10:18:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbcc56700 1 -- 172.21.15.72:0/2947040596 learned_addr learned my addr 172.21.15.72:0/2947040596 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbd457700 1 --2- 172.21.15.72:0/2947040596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdb809e410 0x7efdb811ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbd457700 1 -- 172.21.15.72:0/2947040596 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdb809e000 msgr2=0x7efdb811e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbd457700 1 --2- 172.21.15.72:0/2947040596 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdb809e000 0x7efdb811e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbd457700 1 -- 172.21.15.72:0/2947040596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb809d6f0 msgr2=0x7efdb811e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbd457700 1 --2- 172.21.15.72:0/2947040596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb809d6f0 0x7efdb811e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbd457700 1 -- 172.21.15.72:0/2947040596 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac00b7f0 con 0x7efdb809e410 2023-10-03T10:18:54.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbcc56700 1 --2- 172.21.15.72:0/2947040596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb809d6f0 0x7efdb811e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.378+0000 7efdbd457700 1 --2- 172.21.15.72:0/2947040596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdb809e410 0x7efdb811ec40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efdb000efc0 tx=0x7efdb000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.379+0000 7efdb57fa700 1 -- 172.21.15.72:0/2947040596 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb000cd40 con 0x7efdb809e410 2023-10-03T10:18:54.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.379+0000 7efdb57fa700 1 -- 172.21.15.72:0/2947040596 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb000f040 con 0x7efdb809e410 2023-10-03T10:18:54.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.379+0000 7efdb57fa700 1 -- 172.21.15.72:0/2947040596 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb000cea0 con 0x7efdb809e410 2023-10-03T10:18:54.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.379+0000 7f0f5de06700 1 -- 172.21.15.72:0/4285318320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f5809d6f0 msgr2=0x7f0f5809db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.379+0000 7f0f5de06700 1 --2- 172.21.15.72:0/4285318320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f5809d6f0 0x7f0f5809db40 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009840 tx=0x7f0f4c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:54.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.379+0000 7f0f5de06700 1 -- 172.21.15.72:0/4285318320 shutdown_connections 2023-10-03T10:18:54.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.379+0000 7f0f5de06700 1 --2- 172.21.15.72:0/4285318320 >> v2:172.21.15.72:3300/0 conn(0x7f0f58130750 0x7f0f58130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.379+0000 7f0f5de06700 1 --2- 172.21.15.72:0/4285318320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f5809d6f0 0x7f0f5809db40 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.379+0000 7f0f5de06700 1 -- 172.21.15.72:0/4285318320 >> 172.21.15.72:0/4285318320 conn(0x7f0f5809f470 msgr2=0x7f0f580a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.379+0000 7f0f5de06700 1 -- 172.21.15.72:0/4285318320 shutdown_connections 2023-10-03T10:18:54.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.379+0000 7efdbeeba700 1 -- 172.21.15.72:0/2947040596 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb8121360 con 0x7efdb809e410 2023-10-03T10:18:54.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.379+0000 7efdbeeba700 1 -- 172.21.15.72:0/2947040596 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb8120230 con 0x7efdb809e410 2023-10-03T10:18:54.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.380+0000 7efdbeeba700 1 -- 172.21.15.72:0/2947040596 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb8074ea0 con 0x7efdb809e410 2023-10-03T10:18:54.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.380+0000 7f0f5de06700 1 -- 172.21.15.72:0/4285318320 wait complete. 2023-10-03T10:18:54.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.380+0000 7efdb57fa700 1 -- 172.21.15.72:0/2947040596 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efdb00146c0 con 0x7efdb809e410 2023-10-03T10:18:54.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.381+0000 7efdb57fa700 1 -- 172.21.15.72:0/2947040596 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efdb0040920 con 0x7efdb809e410 2023-10-03T10:18:54.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.381+0000 7f0f5de06700 1 Processor -- start 2023-10-03T10:18:54.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.381+0000 7f0f5de06700 1 -- start start 2023-10-03T10:18:54.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.381+0000 7f0f5de06700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f5809d6f0 0x7f0f58128810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.381+0000 7f0f5de06700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f5809e080 0x7f0f58128d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.381+0000 7f0f5de06700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f58130750 0x7f0f58129290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.381+0000 7f0f5de06700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5812bfa0 con 0x7f0f5809d6f0 2023-10-03T10:18:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.381+0000 7f0f5de06700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5812c1a0 con 0x7f0f58130750 2023-10-03T10:18:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.381+0000 7f0f5de06700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5809d0e0 con 0x7f0f5809e080 2023-10-03T10:18:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f56ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f5809e080 0x7f0f58128d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f56ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f5809e080 0x7f0f58128d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36390/0 (socket says 172.21.15.72:36390) 2023-10-03T10:18:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f56ffd700 1 -- 172.21.15.72:0/1294162235 learned_addr learned my addr 172.21.15.72:0/1294162235 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f577fe700 1 --2- 172.21.15.72:0/1294162235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f5809d6f0 0x7f0f58128810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f57fff700 1 --2- 172.21.15.72:0/1294162235 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f58130750 0x7f0f58129290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f56ffd700 1 -- 172.21.15.72:0/1294162235 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f58130750 msgr2=0x7f0f58129290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f56ffd700 1 --2- 172.21.15.72:0/1294162235 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f58130750 0x7f0f58129290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f56ffd700 1 -- 172.21.15.72:0/1294162235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f5809d6f0 msgr2=0x7f0f58128810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f56ffd700 1 --2- 172.21.15.72:0/1294162235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f5809d6f0 0x7f0f58128810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f56ffd700 1 -- 172.21.15.72:0/1294162235 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c0094a0 con 0x7f0f5809e080 2023-10-03T10:18:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f56ffd700 1 --2- 172.21.15.72:0/1294162235 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f5809e080 0x7f0f58128d50 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00a010 tx=0x7f0f4c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f3ffff700 1 -- 172.21.15.72:0/1294162235 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c003a20 con 0x7f0f5809e080 2023-10-03T10:18:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f3ffff700 1 -- 172.21.15.72:0/1294162235 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c01f070 con 0x7f0f5809e080 2023-10-03T10:18:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f5de06700 1 -- 172.21.15.72:0/1294162235 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5812a370 con 0x7f0f5809e080 2023-10-03T10:18:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f3ffff700 1 -- 172.21.15.72:0/1294162235 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c003de0 con 0x7f0f5809e080 2023-10-03T10:18:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.382+0000 7f0f5de06700 1 -- 172.21.15.72:0/1294162235 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5809b300 con 0x7f0f5809e080 2023-10-03T10:18:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.383+0000 7f0f3dffb700 1 -- 172.21.15.72:0/1294162235 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f300052e0 con 0x7f0f5809e080 2023-10-03T10:18:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.384+0000 7f0f3ffff700 1 -- 172.21.15.72:0/1294162235 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f4c021030 con 0x7f0f5809e080 2023-10-03T10:18:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.384+0000 7f0f3ffff700 1 -- 172.21.15.72:0/1294162235 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0f4c0409b0 con 0x7f0f5809e080 2023-10-03T10:18:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.389+0000 7f0f3ffff700 1 -- 172.21.15.72:0/1294162235 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f4c023790 con 0x7f0f5809e080 2023-10-03T10:18:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.389+0000 7efdb57fa700 1 -- 172.21.15.72:0/2947040596 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efdb0012930 con 0x7efdb809e410 2023-10-03T10:18:54.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.493+0000 7fbba5c0b700 1 -- 172.21.15.72:0/1597561829 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbba013d5e0 con 0x7fbba006e570 2023-10-03T10:18:54.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.493+0000 7fbb87fff700 1 -- 172.21.15.72:0/1597561829 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb90023bc0 con 0x7fbba006e570 2023-10-03T10:18:54.494 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.496+0000 7fbba5c0b700 1 -- 172.21.15.72:0/1597561829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbba006e570 msgr2=0x7fbba0140430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.496+0000 7fbba5c0b700 1 --2- 172.21.15.72:0/1597561829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbba006e570 0x7fbba0140430 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbb900098f0 tx=0x7fbb90004750 comp rx=0 tx=0).stop 2023-10-03T10:18:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.496+0000 7fbba5c0b700 1 -- 172.21.15.72:0/1597561829 shutdown_connections 2023-10-03T10:18:54.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.496+0000 7fbba5c0b700 1 --2- 172.21.15.72:0/1597561829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba013b760 0x7fbba013bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.496+0000 7fbba5c0b700 1 --2- 172.21.15.72:0/1597561829 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbba006e570 0x7fbba0140430 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.496+0000 7fbba5c0b700 1 --2- 172.21.15.72:0/1597561829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006ee80 0x7fbba013b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.496+0000 7fbba5c0b700 1 -- 172.21.15.72:0/1597561829 >> 172.21.15.72:0/1597561829 conn(0x7fbba00a2aa0 msgr2=0x7fbba009e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.496+0000 7fbba5c0b700 1 -- 172.21.15.72:0/1597561829 shutdown_connections 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.497+0000 7fbba5c0b700 1 -- 172.21.15.72:0/1597561829 wait complete. 2023-10-03T10:18:54.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.504+0000 7f8c6863b700 1 -- 172.21.15.72:0/98402283 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8c48005590 con 0x7f8c6009d6f0 2023-10-03T10:18:54.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.505+0000 7f8c56ffd700 1 -- 172.21.15.72:0/98402283 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8c5c0192c0 con 0x7f8c6009d6f0 2023-10-03T10:18:54.505 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.507+0000 7f8c6863b700 1 -- 172.21.15.72:0/98402283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c6009d6f0 msgr2=0x7f8c6011e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.507+0000 7f8c6863b700 1 --2- 172.21.15.72:0/98402283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c6009d6f0 0x7f8c6011e300 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00c480 tx=0x7f8c5c00c790 comp rx=0 tx=0).stop 2023-10-03T10:18:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.507+0000 7f8c6863b700 1 -- 172.21.15.72:0/98402283 shutdown_connections 2023-10-03T10:18:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.507+0000 7f8c6863b700 1 --2- 172.21.15.72:0/98402283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c6009d6f0 0x7f8c6011e300 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.507+0000 7f8c6863b700 1 --2- 172.21.15.72:0/98402283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c60135e50 0x7f8c601c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.507+0000 7f8c6863b700 1 --2- 172.21.15.72:0/98402283 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8c6009e1d0 0x7f8c6011e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.507+0000 7f8c6863b700 1 -- 172.21.15.72:0/98402283 >> 172.21.15.72:0/98402283 conn(0x7f8c60066f50 msgr2=0x7f8c60132ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.507+0000 7f8c6863b700 1 -- 172.21.15.72:0/98402283 shutdown_connections 2023-10-03T10:18:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.507+0000 7f8c6863b700 1 -- 172.21.15.72:0/98402283 wait complete. 2023-10-03T10:18:54.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:54.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:54.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.584+0000 7f0f3dffb700 1 -- 172.21.15.72:0/1294162235 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0f30005860 con 0x7f0f5809e080 2023-10-03T10:18:54.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.584+0000 7f0f3ffff700 1 -- 172.21.15.72:0/1294162235 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f0f4c032070 con 0x7f0f5809e080 2023-10-03T10:18:54.585 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.586+0000 7f0f3dffb700 1 -- 172.21.15.72:0/1294162235 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f5809e080 msgr2=0x7f0f58128d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.586+0000 7f0f3dffb700 1 --2- 172.21.15.72:0/1294162235 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f5809e080 0x7f0f58128d50 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00a010 tx=0x7f0f4c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.586+0000 7f0f3dffb700 1 -- 172.21.15.72:0/1294162235 shutdown_connections 2023-10-03T10:18:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.586+0000 7f0f3dffb700 1 --2- 172.21.15.72:0/1294162235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0f5809d6f0 0x7f0f58128810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.586+0000 7f0f3dffb700 1 --2- 172.21.15.72:0/1294162235 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0f58130750 0x7f0f58129290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.586+0000 7f0f3dffb700 1 --2- 172.21.15.72:0/1294162235 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0f5809e080 0x7f0f58128d50 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.586+0000 7f0f3dffb700 1 -- 172.21.15.72:0/1294162235 >> 172.21.15.72:0/1294162235 conn(0x7f0f5809f470 msgr2=0x7f0f58098770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.586+0000 7f0f3dffb700 1 -- 172.21.15.72:0/1294162235 shutdown_connections 2023-10-03T10:18:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.586+0000 7f0f3dffb700 1 -- 172.21.15.72:0/1294162235 wait complete. 2023-10-03T10:18:54.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.591+0000 7efdbeeba700 1 -- 172.21.15.72:0/2947040596 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efdb806c360 con 0x7efdb809e410 2023-10-03T10:18:54.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.591+0000 7efdb57fa700 1 -- 172.21.15.72:0/2947040596 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efdb002a020 con 0x7efdb809e410 2023-10-03T10:18:54.592 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:54.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.593+0000 7efdbeeba700 1 -- 172.21.15.72:0/2947040596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdb809e410 msgr2=0x7efdb811ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.593+0000 7efdbeeba700 1 --2- 172.21.15.72:0/2947040596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdb809e410 0x7efdb811ec40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efdb000efc0 tx=0x7efdb000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.593+0000 7efdbeeba700 1 -- 172.21.15.72:0/2947040596 shutdown_connections 2023-10-03T10:18:54.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.593+0000 7efdbeeba700 1 --2- 172.21.15.72:0/2947040596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdb809d6f0 0x7efdb811e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.593+0000 7efdbeeba700 1 --2- 172.21.15.72:0/2947040596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdb809e410 0x7efdb811ec40 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.593+0000 7efdbeeba700 1 --2- 172.21.15.72:0/2947040596 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efdb809e000 0x7efdb811e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.593+0000 7efdbeeba700 1 -- 172.21.15.72:0/2947040596 >> 172.21.15.72:0/2947040596 conn(0x7efdb8066f50 msgr2=0x7efdb80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.593+0000 7efdbeeba700 1 -- 172.21.15.72:0/2947040596 shutdown_connections 2023-10-03T10:18:54.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:54.593+0000 7efdbeeba700 1 -- 172.21.15.72:0/2947040596 wait complete. 2023-10-03T10:18:54.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:54.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:55.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:55.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:55.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:55.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:55.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.651+0000 7f938031d700 1 Processor -- start 2023-10-03T10:18:55.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.651+0000 7f938031d700 1 -- start start 2023-10-03T10:18:55.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.652+0000 7f938031d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f937809d6f0 0x7f937809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.652+0000 7f938031d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f937809e000 0x7f9378130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.652+0000 7f938031d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f937809e410 0x7f9378130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.652+0000 7f938031d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937809f520 con 0x7f937809d6f0 2023-10-03T10:18:55.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.652+0000 7f938031d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937809f130 con 0x7f937809e410 2023-10-03T10:18:55.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.652+0000 7f938031d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f937809e930 con 0x7f937809e000 2023-10-03T10:18:55.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.652+0000 7f937d8b8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f937809e000 0x7f9378130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.652+0000 7f937e8ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f937809e410 0x7f9378130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.652+0000 7f937d8b8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f937809e000 0x7f9378130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36396/0 (socket says 172.21.15.72:36396) 2023-10-03T10:18:55.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.652+0000 7f937d8b8700 1 -- 172.21.15.72:0/2859391703 learned_addr learned my addr 172.21.15.72:0/2859391703 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:55.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.652+0000 7f937e8ba700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f937809e410 0x7f9378130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40932/0 (socket says 172.21.15.72:40932) 2023-10-03T10:18:55.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.652+0000 7f937e0b9700 1 --2- 172.21.15.72:0/2859391703 >> v2:172.21.15.72:3300/0 conn(0x7f937809d6f0 0x7f937809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.653+0000 7f937d8b8700 1 -- 172.21.15.72:0/2859391703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f937809e410 msgr2=0x7f9378130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.653+0000 7f937d8b8700 1 --2- 172.21.15.72:0/2859391703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f937809e410 0x7f9378130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.653+0000 7f937d8b8700 1 -- 172.21.15.72:0/2859391703 >> v2:172.21.15.72:3300/0 conn(0x7f937809d6f0 msgr2=0x7f937809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.653+0000 7f937d8b8700 1 --2- 172.21.15.72:0/2859391703 >> v2:172.21.15.72:3300/0 conn(0x7f937809d6f0 0x7f937809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.653+0000 7f937d8b8700 1 -- 172.21.15.72:0/2859391703 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937809b2d0 con 0x7f937809e000 2023-10-03T10:18:55.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.653+0000 7f937e8ba700 1 --2- 172.21.15.72:0/2859391703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f937809e410 0x7f9378130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.653+0000 7f937d8b8700 1 --2- 172.21.15.72:0/2859391703 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f937809e000 0x7f9378130660 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9368009920 tx=0x7f9368009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7208aaa765d6c822 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.653+0000 7f937d0b7700 1 -- 172.21.15.72:0/2859391703 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9368011830 con 0x7f937809e000 2023-10-03T10:18:55.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.653+0000 7f937d0b7700 1 -- 172.21.15.72:0/2859391703 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9368011990 con 0x7f937809e000 2023-10-03T10:18:55.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.653+0000 7f937d0b7700 1 -- 172.21.15.72:0/2859391703 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9368011d20 con 0x7f937809e000 2023-10-03T10:18:55.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.654+0000 7f938031d700 1 -- 172.21.15.72:0/2859391703 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f937809e000 msgr2=0x7f9378130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.654+0000 7f938031d700 1 --2- 172.21.15.72:0/2859391703 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f937809e000 0x7f9378130660 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9368009920 tx=0x7f9368009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:55.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.654+0000 7f938031d700 1 -- 172.21.15.72:0/2859391703 shutdown_connections 2023-10-03T10:18:55.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.654+0000 7f938031d700 1 --2- 172.21.15.72:0/2859391703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f937809e410 0x7f9378130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.654+0000 7f938031d700 1 --2- 172.21.15.72:0/2859391703 >> v2:172.21.15.72:3300/0 conn(0x7f937809d6f0 0x7f937809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.654+0000 7f938031d700 1 --2- 172.21.15.72:0/2859391703 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f937809e000 0x7f9378130660 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.654+0000 7f938031d700 1 -- 172.21.15.72:0/2859391703 >> 172.21.15.72:0/2859391703 conn(0x7f9378066f50 msgr2=0x7f937809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.654+0000 7f938031d700 1 -- 172.21.15.72:0/2859391703 shutdown_connections 2023-10-03T10:18:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.654+0000 7f938031d700 1 -- 172.21.15.72:0/2859391703 wait complete. 2023-10-03T10:18:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.655+0000 7f938031d700 1 Processor -- start 2023-10-03T10:18:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.655+0000 7f938031d700 1 -- start start 2023-10-03T10:18:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.655+0000 7f938031d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f937809d6f0 0x7f93781222e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.655+0000 7f938031d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f937809e000 0x7f9378122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.655+0000 7f938031d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f937809e410 0x7f9378122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.655+0000 7f938031d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9378125c00 con 0x7f937809e410 2023-10-03T10:18:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.655+0000 7f938031d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9378123ef0 con 0x7f937809e000 2023-10-03T10:18:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.655+0000 7f938031d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f937809c700 con 0x7f937809d6f0 2023-10-03T10:18:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.656+0000 7f937e0b9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f937809d6f0 0x7f93781222e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.656+0000 7f937e0b9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f937809d6f0 0x7f93781222e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36404/0 (socket says 172.21.15.72:36404) 2023-10-03T10:18:55.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.656+0000 7f937e0b9700 1 -- 172.21.15.72:0/3110941988 learned_addr learned my addr 172.21.15.72:0/3110941988 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:55.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.656+0000 7f937e8ba700 1 --2- 172.21.15.72:0/3110941988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f937809e410 0x7f9378122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.656+0000 7f937d8b8700 1 --2- 172.21.15.72:0/3110941988 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f937809e000 0x7f9378122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.656+0000 7f937e0b9700 1 -- 172.21.15.72:0/3110941988 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f937809e000 msgr2=0x7f9378122820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.656+0000 7f937e0b9700 1 --2- 172.21.15.72:0/3110941988 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f937809e000 0x7f9378122820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.656+0000 7f937e0b9700 1 -- 172.21.15.72:0/3110941988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f937809e410 msgr2=0x7f9378122d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.656+0000 7f937e0b9700 1 --2- 172.21.15.72:0/3110941988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f937809e410 0x7f9378122d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.656+0000 7f937e0b9700 1 -- 172.21.15.72:0/3110941988 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937000bc80 con 0x7f937809d6f0 2023-10-03T10:18:55.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.656+0000 7f937e8ba700 1 --2- 172.21.15.72:0/3110941988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f937809e410 0x7f9378122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.656+0000 7f937d8b8700 1 --2- 172.21.15.72:0/3110941988 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f937809e000 0x7f9378122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.656+0000 7f937e0b9700 1 --2- 172.21.15.72:0/3110941988 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f937809d6f0 0x7f93781222e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f937400e960 tx=0x7f937400ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.657+0000 7f936effd700 1 -- 172.21.15.72:0/3110941988 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9374013680 con 0x7f937809d6f0 2023-10-03T10:18:55.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.657+0000 7f936effd700 1 -- 172.21.15.72:0/3110941988 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93740137e0 con 0x7f937809d6f0 2023-10-03T10:18:55.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.657+0000 7f938031d700 1 -- 172.21.15.72:0/3110941988 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9368009550 con 0x7f937809d6f0 2023-10-03T10:18:55.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.657+0000 7f936effd700 1 -- 172.21.15.72:0/3110941988 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9374013b70 con 0x7f937809d6f0 2023-10-03T10:18:55.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.657+0000 7f938031d700 1 -- 172.21.15.72:0/3110941988 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9378126590 con 0x7f937809d6f0 2023-10-03T10:18:55.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.658+0000 7f938031d700 1 -- 172.21.15.72:0/3110941988 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9378074ea0 con 0x7f937809d6f0 2023-10-03T10:18:55.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.658+0000 7f936effd700 1 -- 172.21.15.72:0/3110941988 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9374013cd0 con 0x7f937809d6f0 2023-10-03T10:18:55.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.658+0000 7f936effd700 1 -- 172.21.15.72:0/3110941988 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f937403fa70 con 0x7f937809d6f0 2023-10-03T10:18:55.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.667+0000 7f936effd700 1 -- 172.21.15.72:0/3110941988 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9374011db0 con 0x7f937809d6f0 2023-10-03T10:18:55.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.696+0000 7f669ebf2700 1 Processor -- start 2023-10-03T10:18:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.696+0000 7f669ebf2700 1 -- start start 2023-10-03T10:18:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f669ebf2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f669806e570 0x7f669806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f669ebf2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f669809eca0 0x7f669806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f669ebf2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6698134610 0x7f6698134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f669ebf2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6698070ee0 con 0x7f6698134610 2023-10-03T10:18:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f669ebf2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6698071480 con 0x7f669809eca0 2023-10-03T10:18:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f669ebf2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f669806f3c0 con 0x7f669806e570 2023-10-03T10:18:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f6697fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f669809eca0 0x7f669806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f6697fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f669809eca0 0x7f669806ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40954/0 (socket says 172.21.15.72:40954) 2023-10-03T10:18:55.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f6697fff700 1 -- 172.21.15.72:0/584919679 learned_addr learned my addr 172.21.15.72:0/584919679 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:55.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f669c98e700 1 --2- 172.21.15.72:0/584919679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f669806e570 0x7f669806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f669d18f700 1 --2- 172.21.15.72:0/584919679 >> v2:172.21.15.72:3300/0 conn(0x7f6698134610 0x7f6698134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f669c98e700 1 -- 172.21.15.72:0/584919679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f669809eca0 msgr2=0x7f669806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f669c98e700 1 --2- 172.21.15.72:0/584919679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f669809eca0 0x7f669806ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f669c98e700 1 -- 172.21.15.72:0/584919679 >> v2:172.21.15.72:3300/0 conn(0x7f6698134610 msgr2=0x7f6698134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f669c98e700 1 --2- 172.21.15.72:0/584919679 >> v2:172.21.15.72:3300/0 conn(0x7f6698134610 0x7f6698134ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.697+0000 7f669c98e700 1 -- 172.21.15.72:0/584919679 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6698071b90 con 0x7f669806e570 2023-10-03T10:18:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.698+0000 7f669c98e700 1 --2- 172.21.15.72:0/584919679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f669806e570 0x7f669806e940 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f668c009840 tx=0x7f668c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=935805ad225b8db0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.698+0000 7f66977fe700 1 -- 172.21.15.72:0/584919679 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c011830 con 0x7f669806e570 2023-10-03T10:18:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.698+0000 7f66977fe700 1 -- 172.21.15.72:0/584919679 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c011990 con 0x7f669806e570 2023-10-03T10:18:55.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.698+0000 7f66977fe700 1 -- 172.21.15.72:0/584919679 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c011d20 con 0x7f669806e570 2023-10-03T10:18:55.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.699+0000 7f669ebf2700 1 -- 172.21.15.72:0/584919679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f669806e570 msgr2=0x7f669806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.699+0000 7f669ebf2700 1 --2- 172.21.15.72:0/584919679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f669806e570 0x7f669806e940 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f668c009840 tx=0x7f668c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:55.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.699+0000 7f669ebf2700 1 -- 172.21.15.72:0/584919679 shutdown_connections 2023-10-03T10:18:55.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.699+0000 7f669ebf2700 1 --2- 172.21.15.72:0/584919679 >> v2:172.21.15.72:3300/0 conn(0x7f6698134610 0x7f6698134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.699+0000 7f669ebf2700 1 --2- 172.21.15.72:0/584919679 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f669806e570 0x7f669806e940 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.699+0000 7f669ebf2700 1 --2- 172.21.15.72:0/584919679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f669809eca0 0x7f669806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.699+0000 7f669ebf2700 1 -- 172.21.15.72:0/584919679 >> 172.21.15.72:0/584919679 conn(0x7f66980a2aa0 msgr2=0x7f66980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.699+0000 7f669ebf2700 1 -- 172.21.15.72:0/584919679 shutdown_connections 2023-10-03T10:18:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.699+0000 7f669ebf2700 1 -- 172.21.15.72:0/584919679 wait complete. 2023-10-03T10:18:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.700+0000 7f669ebf2700 1 Processor -- start 2023-10-03T10:18:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.700+0000 7f669ebf2700 1 -- start start 2023-10-03T10:18:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.701+0000 7f669ebf2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f669806e570 0x7f6698133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.701+0000 7f669ebf2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6698134610 0x7f6698137c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.701+0000 7f669ebf2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6698134100 0x7f66981381a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.701+0000 7f669ebf2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669813b580 con 0x7f669806e570 2023-10-03T10:18:55.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.701+0000 7f669ebf2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669813a9a0 con 0x7f6698134610 2023-10-03T10:18:55.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.701+0000 7f669ebf2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f669813ab80 con 0x7f6698134100 2023-10-03T10:18:55.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.701+0000 7f669c98e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f669806e570 0x7f6698133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.701+0000 7f669c98e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f669806e570 0x7f6698133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51130/0 (socket says 172.21.15.72:51130) 2023-10-03T10:18:55.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.701+0000 7f669c98e700 1 -- 172.21.15.72:0/3669110068 learned_addr learned my addr 172.21.15.72:0/3669110068 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:55.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.701+0000 7f669d18f700 1 --2- 172.21.15.72:0/3669110068 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6698134100 0x7f66981381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.702+0000 7f6697fff700 1 --2- 172.21.15.72:0/3669110068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6698134610 0x7f6698137c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.702+0000 7f669c98e700 1 -- 172.21.15.72:0/3669110068 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6698134100 msgr2=0x7f66981381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.702+0000 7f669c98e700 1 --2- 172.21.15.72:0/3669110068 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6698134100 0x7f66981381a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.702+0000 7f669c98e700 1 -- 172.21.15.72:0/3669110068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6698134610 msgr2=0x7f6698137c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.702+0000 7f669c98e700 1 --2- 172.21.15.72:0/3669110068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6698134610 0x7f6698137c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.702+0000 7f669c98e700 1 -- 172.21.15.72:0/3669110068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c0094a0 con 0x7f669806e570 2023-10-03T10:18:55.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.702+0000 7f669d18f700 1 --2- 172.21.15.72:0/3669110068 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6698134100 0x7f66981381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.702+0000 7f6697fff700 1 --2- 172.21.15.72:0/3669110068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6698134610 0x7f6698137c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.702+0000 7f669c98e700 1 --2- 172.21.15.72:0/3669110068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f669806e570 0x7f6698133bc0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f668c000c00 tx=0x7f668c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.702+0000 7f66957fa700 1 -- 172.21.15.72:0/3669110068 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c004450 con 0x7f669806e570 2023-10-03T10:18:55.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.702+0000 7f66957fa700 1 -- 172.21.15.72:0/3669110068 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c01f070 con 0x7f669806e570 2023-10-03T10:18:55.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.702+0000 7f66957fa700 1 -- 172.21.15.72:0/3669110068 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c0038e0 con 0x7f669806e570 2023-10-03T10:18:55.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.702+0000 7f669ebf2700 1 -- 172.21.15.72:0/3669110068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66980a1e70 con 0x7f669806e570 2023-10-03T10:18:55.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.702+0000 7f669ebf2700 1 -- 172.21.15.72:0/3669110068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669809e300 con 0x7f669806e570 2023-10-03T10:18:55.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.704+0000 7f66957fa700 1 -- 172.21.15.72:0/3669110068 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f668c003a40 con 0x7f669806e570 2023-10-03T10:18:55.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.704+0000 7f669ebf2700 1 -- 172.21.15.72:0/3669110068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6698074ea0 con 0x7f669806e570 2023-10-03T10:18:55.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.704+0000 7f66957fa700 1 -- 172.21.15.72:0/3669110068 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f668c021070 con 0x7f669806e570 2023-10-03T10:18:55.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.713+0000 7f66957fa700 1 -- 172.21.15.72:0/3669110068 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f668c01a430 con 0x7f669806e570 2023-10-03T10:18:55.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.742+0000 7f6c301e7700 1 Processor -- start 2023-10-03T10:18:55.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.743+0000 7f6c301e7700 1 -- start start 2023-10-03T10:18:55.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.743+0000 7f6c301e7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c280a0a30 0x7f6c280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.743+0000 7f6c301e7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c28134170 0x7f6c2813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.743+0000 7f6c301e7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2809edd0 con 0x7f6c280a1340 2023-10-03T10:18:55.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.743+0000 7f6c301e7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2809e1f0 con 0x7f6c280a0a30 2023-10-03T10:18:55.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.743+0000 7f6c301e7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2809dc50 con 0x7f6c28134170 2023-10-03T10:18:55.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.743+0000 7f6c2df83700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c280a0a30 0x7f6c280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.744+0000 7f6c2e784700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c28134170 0x7f6c2813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.744+0000 7f6c2df83700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c280a0a30 0x7f6c280a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51136/0 (socket says 172.21.15.72:51136) 2023-10-03T10:18:55.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.744+0000 7f6c2e784700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c28134170 0x7f6c2813bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40974/0 (socket says 172.21.15.72:40974) 2023-10-03T10:18:55.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.744+0000 7f6c2df83700 1 -- 172.21.15.72:0/2821518471 learned_addr learned my addr 172.21.15.72:0/2821518471 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:55.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.744+0000 7f6c2e784700 1 -- 172.21.15.72:0/2821518471 >> v2:172.21.15.72:3300/0 conn(0x7f6c280a0a30 msgr2=0x7f6c280a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.744+0000 7f6c2e784700 1 --2- 172.21.15.72:0/2821518471 >> v2:172.21.15.72:3300/0 conn(0x7f6c280a0a30 0x7f6c280a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.744+0000 7f6c2e784700 1 -- 172.21.15.72:0/2821518471 >> v1:172.21.15.72:6789/0 conn(0x7f6c280a1340 legacy=0x7f6c28133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.744+0000 7f6c2cf81700 1 -- 172.21.15.72:0/2821518471 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034947683 0 0) 0x7f6c2809edd0 con 0x7f6c280a1340 2023-10-03T10:18:55.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.744+0000 7f6c2e784700 1 -- 172.21.15.72:0/2821518471 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c280a1fe0 con 0x7f6c28134170 2023-10-03T10:18:55.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.744+0000 7f6c2df83700 1 --2- 172.21.15.72:0/2821518471 >> v2:172.21.15.72:3300/0 conn(0x7f6c280a0a30 0x7f6c280a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.744+0000 7f6c2e784700 1 --2- 172.21.15.72:0/2821518471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c28134170 0x7f6c2813bd30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009d90 tx=0x7f6c2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69b7d7ffa2b0f6e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.744+0000 7f6c2cf81700 1 -- 172.21.15.72:0/2821518471 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2000e070 con 0x7f6c28134170 2023-10-03T10:18:55.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.744+0000 7f6c2cf81700 1 -- 172.21.15.72:0/2821518471 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2000bb20 con 0x7f6c28134170 2023-10-03T10:18:55.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.744+0000 7f6c2cf81700 1 -- 172.21.15.72:0/2821518471 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20012430 con 0x7f6c28134170 2023-10-03T10:18:55.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.745+0000 7f6c301e7700 1 -- 172.21.15.72:0/2821518471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c28134170 msgr2=0x7f6c2813bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.745+0000 7f6c301e7700 1 --2- 172.21.15.72:0/2821518471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c28134170 0x7f6c2813bd30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009d90 tx=0x7f6c2000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:55.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.745+0000 7f6c301e7700 1 -- 172.21.15.72:0/2821518471 shutdown_connections 2023-10-03T10:18:55.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.745+0000 7f6c301e7700 1 --2- 172.21.15.72:0/2821518471 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c28134170 0x7f6c2813bd30 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.745+0000 7f6c301e7700 1 --2- 172.21.15.72:0/2821518471 >> v2:172.21.15.72:3300/0 conn(0x7f6c280a0a30 0x7f6c280a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.745+0000 7f6c301e7700 1 -- 172.21.15.72:0/2821518471 >> 172.21.15.72:0/2821518471 conn(0x7f6c280a6550 msgr2=0x7f6c280a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.746+0000 7f6c301e7700 1 -- 172.21.15.72:0/2821518471 shutdown_connections 2023-10-03T10:18:55.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.746+0000 7f6c301e7700 1 -- 172.21.15.72:0/2821518471 wait complete. 2023-10-03T10:18:55.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.747+0000 7f6c301e7700 1 Processor -- start 2023-10-03T10:18:55.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.747+0000 7f6c301e7700 1 -- start start 2023-10-03T10:18:55.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c301e7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c280a0a30 0x7f6c28121760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c301e7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c280a1340 0x7f6c28121ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c301e7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c28134170 0x7f6c281221e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c301e7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c28132280 con 0x7f6c28134170 2023-10-03T10:18:55.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c301e7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c280a0220 con 0x7f6c280a0a30 2023-10-03T10:18:55.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c301e7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c281327c0 con 0x7f6c280a1340 2023-10-03T10:18:55.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c2df83700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c280a0a30 0x7f6c28121760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c2df83700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c280a0a30 0x7f6c28121760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:40990/0 (socket says 172.21.15.72:40990) 2023-10-03T10:18:55.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c2df83700 1 -- 172.21.15.72:0/53929075 learned_addr learned my addr 172.21.15.72:0/53929075 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:55.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c2e784700 1 --2- 172.21.15.72:0/53929075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c28134170 0x7f6c281221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c2d782700 1 --2- 172.21.15.72:0/53929075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c280a1340 0x7f6c28121ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c2df83700 1 -- 172.21.15.72:0/53929075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c280a1340 msgr2=0x7f6c28121ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c2df83700 1 --2- 172.21.15.72:0/53929075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c280a1340 0x7f6c28121ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c2df83700 1 -- 172.21.15.72:0/53929075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c28134170 msgr2=0x7f6c281221e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c2df83700 1 --2- 172.21.15.72:0/53929075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c28134170 0x7f6c281221e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c2df83700 1 -- 172.21.15.72:0/53929075 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c24009550 con 0x7f6c280a0a30 2023-10-03T10:18:55.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c2e784700 1 --2- 172.21.15.72:0/53929075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c28134170 0x7f6c281221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:55.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c2df83700 1 --2- 172.21.15.72:0/53929075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c280a0a30 0x7f6c28121760 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400ebe0 tx=0x7f6c24009e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c1e7fc700 1 -- 172.21.15.72:0/53929075 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2400c8b0 con 0x7f6c280a0a30 2023-10-03T10:18:55.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c1e7fc700 1 -- 172.21.15.72:0/53929075 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2400ca10 con 0x7f6c280a0a30 2023-10-03T10:18:55.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c301e7700 1 -- 172.21.15.72:0/53929075 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c20009a70 con 0x7f6c280a0a30 2023-10-03T10:18:55.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.748+0000 7f6c1e7fc700 1 -- 172.21.15.72:0/53929075 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2400cd80 con 0x7f6c280a0a30 2023-10-03T10:18:55.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.749+0000 7f6c301e7700 1 -- 172.21.15.72:0/53929075 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c280a25e0 con 0x7f6c280a0a30 2023-10-03T10:18:55.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.749+0000 7f6c1e7fc700 1 -- 172.21.15.72:0/53929075 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c24013470 con 0x7f6c280a0a30 2023-10-03T10:18:55.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.750+0000 7f6c1e7fc700 1 -- 172.21.15.72:0/53929075 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6c24043360 con 0x7f6c280a0a30 2023-10-03T10:18:55.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.750+0000 7f6c301e7700 1 -- 172.21.15.72:0/53929075 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c28074ea0 con 0x7f6c280a0a30 2023-10-03T10:18:55.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.759+0000 7f6c1e7fc700 1 -- 172.21.15.72:0/53929075 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c24017020 con 0x7f6c280a0a30 2023-10-03T10:18:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.780+0000 7fb0fa29d700 1 Processor -- start 2023-10-03T10:18:55.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.781+0000 7fb0fa29d700 1 -- start start 2023-10-03T10:18:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.781+0000 7fb0fa29d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f406b250 0x7fb0f4136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.781+0000 7fb0fa29d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0f4136d80 0x7fb0f4139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.781+0000 7fb0fa29d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f409ece0 con 0x7fb0f406a770 2023-10-03T10:18:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.781+0000 7fb0fa29d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f406b640 con 0x7fb0f4136d80 2023-10-03T10:18:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.781+0000 7fb0fa29d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f409e760 con 0x7fb0f406b250 2023-10-03T10:18:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.781+0000 7fb0f37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f406b250 0x7fb0f4136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.781+0000 7fb0f37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f406b250 0x7fb0f4136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41004/0 (socket says 172.21.15.72:41004) 2023-10-03T10:18:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.781+0000 7fb0f37fe700 1 -- 172.21.15.72:0/1873372113 learned_addr learned my addr 172.21.15.72:0/1873372113 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.781+0000 7fb0f883a700 1 --2- 172.21.15.72:0/1873372113 >> v2:172.21.15.72:3300/0 conn(0x7fb0f4136d80 0x7fb0f4139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.782+0000 7fb0f37fe700 1 -- 172.21.15.72:0/1873372113 >> v2:172.21.15.72:3300/0 conn(0x7fb0f4136d80 msgr2=0x7fb0f4139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.782+0000 7fb0f37fe700 1 --2- 172.21.15.72:0/1873372113 >> v2:172.21.15.72:3300/0 conn(0x7fb0f4136d80 0x7fb0f4139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.782+0000 7fb0f37fe700 1 -- 172.21.15.72:0/1873372113 >> v1:172.21.15.72:6789/0 conn(0x7fb0f406a770 legacy=0x7fb0f406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.782+0000 7fb0f37fe700 1 -- 172.21.15.72:0/1873372113 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f409e040 con 0x7fb0f406b250 2023-10-03T10:18:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.782+0000 7fb0f37fe700 1 --2- 172.21.15.72:0/1873372113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f406b250 0x7fb0f4136840 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80098f0 tx=0x7fb0e8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc0149ac81155f66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.782+0000 7fb0f2ffd700 1 -- 172.21.15.72:0/1873372113 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8004230 con 0x7fb0f406b250 2023-10-03T10:18:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.782+0000 7fb0f2ffd700 1 -- 172.21.15.72:0/1873372113 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e8004390 con 0x7fb0f406b250 2023-10-03T10:18:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.782+0000 7fb0f2ffd700 1 -- 172.21.15.72:0/1873372113 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80036a0 con 0x7fb0f406b250 2023-10-03T10:18:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.782+0000 7fb0fa29d700 1 -- 172.21.15.72:0/1873372113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f406b250 msgr2=0x7fb0f4136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.782+0000 7fb0fa29d700 1 --2- 172.21.15.72:0/1873372113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f406b250 0x7fb0f4136840 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80098f0 tx=0x7fb0e8009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.783+0000 7fb0fa29d700 1 -- 172.21.15.72:0/1873372113 shutdown_connections 2023-10-03T10:18:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.783+0000 7fb0fa29d700 1 --2- 172.21.15.72:0/1873372113 >> v2:172.21.15.72:3300/0 conn(0x7fb0f4136d80 0x7fb0f4139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.783+0000 7fb0fa29d700 1 --2- 172.21.15.72:0/1873372113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f406b250 0x7fb0f4136840 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.783+0000 7fb0fa29d700 1 -- 172.21.15.72:0/1873372113 >> 172.21.15.72:0/1873372113 conn(0x7fb0f4066f50 msgr2=0x7fb0f409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.783+0000 7fb0fa29d700 1 -- 172.21.15.72:0/1873372113 shutdown_connections 2023-10-03T10:18:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.783+0000 7fb0fa29d700 1 -- 172.21.15.72:0/1873372113 wait complete. 2023-10-03T10:18:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.784+0000 7fb0fa29d700 1 Processor -- start 2023-10-03T10:18:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.784+0000 7fb0fa29d700 1 -- start start 2023-10-03T10:18:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0fa29d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f406a770 0x7fb0f4119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0fa29d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0f406b250 0x7fb0f41199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0fa29d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f4136d80 0x7fb0f4119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0fa29d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4071e60 con 0x7fb0f406a770 2023-10-03T10:18:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0fa29d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4136a50 con 0x7fb0f4136d80 2023-10-03T10:18:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0fa29d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f411bc80 con 0x7fb0f406b250 2023-10-03T10:18:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0f3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f406a770 0x7fb0f4119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0f3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f406a770 0x7fb0f4119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51156/0 (socket says 172.21.15.72:51156) 2023-10-03T10:18:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0f3fff700 1 -- 172.21.15.72:0/1075724515 learned_addr learned my addr 172.21.15.72:0/1075724515 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0f37fe700 1 --2- 172.21.15.72:0/1075724515 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0f406b250 0x7fb0f41199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0f883a700 1 --2- 172.21.15.72:0/1075724515 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f4136d80 0x7fb0f4119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0f37fe700 1 -- 172.21.15.72:0/1075724515 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f4136d80 msgr2=0x7fb0f4119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0f37fe700 1 --2- 172.21.15.72:0/1075724515 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f4136d80 0x7fb0f4119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0f37fe700 1 -- 172.21.15.72:0/1075724515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f406a770 msgr2=0x7fb0f4119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0f37fe700 1 --2- 172.21.15.72:0/1075724515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f406a770 0x7fb0f4119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0f37fe700 1 -- 172.21.15.72:0/1075724515 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e8009550 con 0x7fb0f406b250 2023-10-03T10:18:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0f883a700 1 --2- 172.21.15.72:0/1075724515 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f4136d80 0x7fb0f4119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0f3fff700 1 --2- 172.21.15.72:0/1075724515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f406a770 0x7fb0f4119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0f37fe700 1 --2- 172.21.15.72:0/1075724515 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0f406b250 0x7fb0f41199c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8015000 tx=0x7fb0e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.785+0000 7fb0f0ff9700 1 -- 172.21.15.72:0/1075724515 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8003c50 con 0x7fb0f406b250 2023-10-03T10:18:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.786+0000 7fb0f0ff9700 1 -- 172.21.15.72:0/1075724515 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e801f070 con 0x7fb0f406b250 2023-10-03T10:18:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.786+0000 7fb0f0ff9700 1 -- 172.21.15.72:0/1075724515 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8011630 con 0x7fb0f406b250 2023-10-03T10:18:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.786+0000 7fb0fa29d700 1 -- 172.21.15.72:0/1075724515 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f409c270 con 0x7fb0f406b250 2023-10-03T10:18:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.786+0000 7fb0fa29d700 1 -- 172.21.15.72:0/1075724515 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f4136100 con 0x7fb0f406b250 2023-10-03T10:18:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.786+0000 7fb0f0ff9700 1 -- 172.21.15.72:0/1075724515 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0e8021030 con 0x7fb0f406b250 2023-10-03T10:18:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.787+0000 7fb0f0ff9700 1 -- 172.21.15.72:0/1075724515 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb0e8040c40 con 0x7fb0f406b250 2023-10-03T10:18:55.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.787+0000 7fb0fa29d700 1 -- 172.21.15.72:0/1075724515 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f411bac0 con 0x7fb0f406b250 2023-10-03T10:18:55.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.791+0000 7fb0f0ff9700 1 -- 172.21.15.72:0/1075724515 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0e80239c0 con 0x7fb0f406b250 2023-10-03T10:18:55.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.871+0000 7f938031d700 1 -- 172.21.15.72:0/3110941988 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9378130440 con 0x7f937809d6f0 2023-10-03T10:18:55.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.872+0000 7f936effd700 1 -- 172.21.15.72:0/3110941988 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f937403fe60 con 0x7f937809d6f0 2023-10-03T10:18:55.873 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:55.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.874+0000 7f938031d700 1 -- 172.21.15.72:0/3110941988 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f937809d6f0 msgr2=0x7f93781222e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.874+0000 7f938031d700 1 --2- 172.21.15.72:0/3110941988 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f937809d6f0 0x7f93781222e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f937400e960 tx=0x7f937400ec70 comp rx=0 tx=0).stop 2023-10-03T10:18:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.875+0000 7f938031d700 1 -- 172.21.15.72:0/3110941988 shutdown_connections 2023-10-03T10:18:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.875+0000 7f938031d700 1 --2- 172.21.15.72:0/3110941988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f937809e410 0x7f9378122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.875+0000 7f938031d700 1 --2- 172.21.15.72:0/3110941988 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f937809d6f0 0x7f93781222e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.875+0000 7f938031d700 1 --2- 172.21.15.72:0/3110941988 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f937809e000 0x7f9378122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.875+0000 7f938031d700 1 -- 172.21.15.72:0/3110941988 >> 172.21.15.72:0/3110941988 conn(0x7f9378066f50 msgr2=0x7f93780a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.875+0000 7f938031d700 1 -- 172.21.15.72:0/3110941988 shutdown_connections 2023-10-03T10:18:55.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.875+0000 7f938031d700 1 -- 172.21.15.72:0/3110941988 wait complete. 2023-10-03T10:18:55.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:55.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.961+0000 7f669ebf2700 1 -- 172.21.15.72:0/3669110068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6698071100 con 0x7f669806e570 2023-10-03T10:18:55.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.961+0000 7f66957fa700 1 -- 172.21.15.72:0/3669110068 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f668c015020 con 0x7f669806e570 2023-10-03T10:18:55.962 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:55.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.964+0000 7f669ebf2700 1 -- 172.21.15.72:0/3669110068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f669806e570 msgr2=0x7f6698133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.964+0000 7f669ebf2700 1 --2- 172.21.15.72:0/3669110068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f669806e570 0x7f6698133bc0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f668c000c00 tx=0x7f668c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:55.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.964+0000 7f669ebf2700 1 -- 172.21.15.72:0/3669110068 shutdown_connections 2023-10-03T10:18:55.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.964+0000 7f669ebf2700 1 --2- 172.21.15.72:0/3669110068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f669806e570 0x7f6698133bc0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.964+0000 7f669ebf2700 1 --2- 172.21.15.72:0/3669110068 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6698134100 0x7f66981381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.964+0000 7f669ebf2700 1 --2- 172.21.15.72:0/3669110068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6698134610 0x7f6698137c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.964+0000 7f669ebf2700 1 -- 172.21.15.72:0/3669110068 >> 172.21.15.72:0/3669110068 conn(0x7f66980a2aa0 msgr2=0x7f6698128310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.965+0000 7f669ebf2700 1 -- 172.21.15.72:0/3669110068 shutdown_connections 2023-10-03T10:18:55.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.965+0000 7f669ebf2700 1 -- 172.21.15.72:0/3669110068 wait complete. 2023-10-03T10:18:55.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:55.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.993+0000 7f6c301e7700 1 -- 172.21.15.72:0/53929075 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6c280a28e0 con 0x7f6c280a0a30 2023-10-03T10:18:55.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.993+0000 7f6c1e7fc700 1 -- 172.21.15.72:0/53929075 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6c24041020 con 0x7f6c280a0a30 2023-10-03T10:18:55.993 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:55.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.994+0000 7fb0fa29d700 1 -- 172.21.15.72:0/1075724515 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb0f411bac0 con 0x7fb0f406b250 2023-10-03T10:18:55.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.994+0000 7fb0f0ff9700 1 -- 172.21.15.72:0/1075724515 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0e8024430 con 0x7fb0f406b250 2023-10-03T10:18:55.994 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.995+0000 7f6c301e7700 1 -- 172.21.15.72:0/53929075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c280a0a30 msgr2=0x7f6c28121760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.995+0000 7f6c301e7700 1 --2- 172.21.15.72:0/53929075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c280a0a30 0x7f6c28121760 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400ebe0 tx=0x7f6c24009e70 comp rx=0 tx=0).stop 2023-10-03T10:18:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.995+0000 7f6c301e7700 1 -- 172.21.15.72:0/53929075 shutdown_connections 2023-10-03T10:18:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.995+0000 7f6c301e7700 1 --2- 172.21.15.72:0/53929075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c28134170 0x7f6c281221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.995+0000 7f6c301e7700 1 --2- 172.21.15.72:0/53929075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c280a0a30 0x7f6c28121760 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.995+0000 7f6c301e7700 1 --2- 172.21.15.72:0/53929075 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c280a1340 0x7f6c28121ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.995+0000 7f6c301e7700 1 -- 172.21.15.72:0/53929075 >> 172.21.15.72:0/53929075 conn(0x7f6c280a6550 msgr2=0x7f6c280a4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.995+0000 7f6c301e7700 1 -- 172.21.15.72:0/53929075 shutdown_connections 2023-10-03T10:18:55.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.995+0000 7f6c301e7700 1 -- 172.21.15.72:0/53929075 wait complete. 2023-10-03T10:18:55.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.996+0000 7fb0fa29d700 1 -- 172.21.15.72:0/1075724515 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0f406b250 msgr2=0x7fb0f41199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.996+0000 7fb0fa29d700 1 --2- 172.21.15.72:0/1075724515 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0f406b250 0x7fb0f41199c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8015000 tx=0x7fb0e8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:55.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.996+0000 7fb0fa29d700 1 -- 172.21.15.72:0/1075724515 shutdown_connections 2023-10-03T10:18:55.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.996+0000 7fb0fa29d700 1 --2- 172.21.15.72:0/1075724515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f406a770 0x7fb0f4119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.996+0000 7fb0fa29d700 1 --2- 172.21.15.72:0/1075724515 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f4136d80 0x7fb0f4119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.996+0000 7fb0fa29d700 1 --2- 172.21.15.72:0/1075724515 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0f406b250 0x7fb0f41199c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.996+0000 7fb0fa29d700 1 -- 172.21.15.72:0/1075724515 >> 172.21.15.72:0/1075724515 conn(0x7fb0f4066f50 msgr2=0x7fb0f40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.996+0000 7fb0fa29d700 1 -- 172.21.15.72:0/1075724515 shutdown_connections 2023-10-03T10:18:55.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:55.996+0000 7fb0fa29d700 1 -- 172.21.15.72:0/1075724515 wait complete. 2023-10-03T10:18:56.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:56.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:56.888 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:56.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:57.010 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:57.010 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:57.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.025+0000 7fc56220b700 1 Processor -- start 2023-10-03T10:18:57.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.025+0000 7fc56220b700 1 -- start start 2023-10-03T10:18:57.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc56220b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc55c09d6f0 0x7fc55c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc56220b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55c09e000 0x7fc55c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc56220b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc55c09e410 0x7fc55c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc56220b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc55c06b460 con 0x7fc55c09e410 2023-10-03T10:18:57.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc56220b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c09b120 con 0x7fc55c09e000 2023-10-03T10:18:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc56220b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c09a7e0 con 0x7fc55c09d6f0 2023-10-03T10:18:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc55b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc55c09d6f0 0x7fc55c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc55bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc55c09e410 0x7fc55c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc55b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc55c09d6f0 0x7fc55c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36430/0 (socket says 172.21.15.72:36430) 2023-10-03T10:18:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc55b7fe700 1 -- 172.21.15.72:0/1729309222 learned_addr learned my addr 172.21.15.72:0/1729309222 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc55affd700 1 --2- 172.21.15.72:0/1729309222 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55c09e000 0x7fc55c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc55bfff700 1 -- 172.21.15.72:0/1729309222 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc55c09d6f0 msgr2=0x7fc55c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc55bfff700 1 --2- 172.21.15.72:0/1729309222 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc55c09d6f0 0x7fc55c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc55bfff700 1 -- 172.21.15.72:0/1729309222 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55c09e000 msgr2=0x7fc55c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc55bfff700 1 --2- 172.21.15.72:0/1729309222 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55c09e000 0x7fc55c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc55bfff700 1 -- 172.21.15.72:0/1729309222 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c09a500 con 0x7fc55c09e410 2023-10-03T10:18:57.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc55b7fe700 1 --2- 172.21.15.72:0/1729309222 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc55c09d6f0 0x7fc55c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc55affd700 1 --2- 172.21.15.72:0/1729309222 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55c09e000 0x7fc55c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.026+0000 7fc55bfff700 1 --2- 172.21.15.72:0/1729309222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55c09e410 0x7fc55c133f30 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fc554009840 tx=0x7fc554009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bef77b5fda246c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.027+0000 7fc55a7fc700 1 -- 172.21.15.72:0/1729309222 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554011830 con 0x7fc55c09e410 2023-10-03T10:18:57.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.027+0000 7fc55a7fc700 1 -- 172.21.15.72:0/1729309222 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc554011990 con 0x7fc55c09e410 2023-10-03T10:18:57.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.027+0000 7fc55a7fc700 1 -- 172.21.15.72:0/1729309222 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554011d20 con 0x7fc55c09e410 2023-10-03T10:18:57.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.027+0000 7fc56220b700 1 -- 172.21.15.72:0/1729309222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55c09e410 msgr2=0x7fc55c133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.027+0000 7fc56220b700 1 --2- 172.21.15.72:0/1729309222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55c09e410 0x7fc55c133f30 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fc554009840 tx=0x7fc554009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:57.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.027+0000 7fc56220b700 1 -- 172.21.15.72:0/1729309222 shutdown_connections 2023-10-03T10:18:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.027+0000 7fc56220b700 1 --2- 172.21.15.72:0/1729309222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55c09e410 0x7fc55c133f30 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.027+0000 7fc56220b700 1 --2- 172.21.15.72:0/1729309222 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc55c09d6f0 0x7fc55c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.027+0000 7fc56220b700 1 --2- 172.21.15.72:0/1729309222 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55c09e000 0x7fc55c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.027+0000 7fc56220b700 1 -- 172.21.15.72:0/1729309222 >> 172.21.15.72:0/1729309222 conn(0x7fc55c066f50 msgr2=0x7fc55c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.027+0000 7fc56220b700 1 -- 172.21.15.72:0/1729309222 shutdown_connections 2023-10-03T10:18:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.028+0000 7fc56220b700 1 -- 172.21.15.72:0/1729309222 wait complete. 2023-10-03T10:18:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.029+0000 7fc56220b700 1 Processor -- start 2023-10-03T10:18:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.029+0000 7fc56220b700 1 -- start start 2023-10-03T10:18:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.030+0000 7fc56220b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55c09d6f0 0x7fc55c1a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.030+0000 7fc56220b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc55c09e000 0x7fc55c1a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.030+0000 7fc56220b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55c09e410 0x7fc55c1c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.030+0000 7fc56220b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c1a5c90 con 0x7fc55c09d6f0 2023-10-03T10:18:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.030+0000 7fc56220b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c1b9140 con 0x7fc55c09e410 2023-10-03T10:18:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.030+0000 7fc56220b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c1a4d20 con 0x7fc55c09e000 2023-10-03T10:18:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.030+0000 7fc55b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55c09d6f0 0x7fc55c1a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.030+0000 7fc55b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55c09d6f0 0x7fc55c1a5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51166/0 (socket says 172.21.15.72:51166) 2023-10-03T10:18:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.030+0000 7fc55b7fe700 1 -- 172.21.15.72:0/810860459 learned_addr learned my addr 172.21.15.72:0/810860459 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.030+0000 7fc55affd700 1 --2- 172.21.15.72:0/810860459 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc55c09e000 0x7fc55c1a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.030+0000 7fc55bfff700 1 --2- 172.21.15.72:0/810860459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55c09e410 0x7fc55c1c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.031+0000 7fc55b7fe700 1 -- 172.21.15.72:0/810860459 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc55c09e000 msgr2=0x7fc55c1a5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.031+0000 7fc55b7fe700 1 --2- 172.21.15.72:0/810860459 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc55c09e000 0x7fc55c1a5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.031+0000 7fc55b7fe700 1 -- 172.21.15.72:0/810860459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55c09e410 msgr2=0x7fc55c1c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.031+0000 7fc55b7fe700 1 --2- 172.21.15.72:0/810860459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55c09e410 0x7fc55c1c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.031+0000 7fc55b7fe700 1 -- 172.21.15.72:0/810860459 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c009b30 con 0x7fc55c09d6f0 2023-10-03T10:18:57.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.031+0000 7fc55bfff700 1 --2- 172.21.15.72:0/810860459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55c09e410 0x7fc55c1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.031+0000 7fc55b7fe700 1 --2- 172.21.15.72:0/810860459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55c09d6f0 0x7fc55c1a5210 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00efc0 tx=0x7fc54c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.031+0000 7fc553fff700 1 -- 172.21.15.72:0/810860459 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c00cb00 con 0x7fc55c09d6f0 2023-10-03T10:18:57.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.031+0000 7fc553fff700 1 -- 172.21.15.72:0/810860459 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c00f040 con 0x7fc55c09d6f0 2023-10-03T10:18:57.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.031+0000 7fc56220b700 1 -- 172.21.15.72:0/810860459 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5440094a0 con 0x7fc55c09d6f0 2023-10-03T10:18:57.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.031+0000 7fc553fff700 1 -- 172.21.15.72:0/810860459 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c00ce60 con 0x7fc55c09d6f0 2023-10-03T10:18:57.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.031+0000 7fc56220b700 1 -- 172.21.15.72:0/810860459 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5540094a0 con 0x7fc55c09d6f0 2023-10-03T10:18:57.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.032+0000 7fc56220b700 1 -- 172.21.15.72:0/810860459 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55c074ea0 con 0x7fc55c09d6f0 2023-10-03T10:18:57.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.034+0000 7fc553fff700 1 -- 172.21.15.72:0/810860459 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc54c014480 con 0x7fc55c09d6f0 2023-10-03T10:18:57.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.034+0000 7fc553fff700 1 -- 172.21.15.72:0/810860459 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc54c040de0 con 0x7fc55c09d6f0 2023-10-03T10:18:57.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.038+0000 7fc553fff700 1 -- 172.21.15.72:0/810860459 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc54c01d5a0 con 0x7fc55c09d6f0 2023-10-03T10:18:57.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.124+0000 7fc12229d700 1 Processor -- start 2023-10-03T10:18:57.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.125+0000 7fc12229d700 1 -- start start 2023-10-03T10:18:57.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.125+0000 7fc12229d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc11c09e930 0x7fc11c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.125+0000 7fc12229d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc11c09f240 0x7fc11c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.125+0000 7fc12229d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c070940 con 0x7fc11c09f650 2023-10-03T10:18:57.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.125+0000 7fc12229d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c06fd60 con 0x7fc11c09e930 2023-10-03T10:18:57.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.125+0000 7fc12229d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c06fa80 con 0x7fc11c09f240 2023-10-03T10:18:57.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.125+0000 7fc11bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc11c09e930 0x7fc11c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.125+0000 7fc11bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc11c09e930 0x7fc11c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41034/0 (socket says 172.21.15.72:41034) 2023-10-03T10:18:57.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.126+0000 7fc11bfff700 1 -- 172.21.15.72:0/203987601 learned_addr learned my addr 172.21.15.72:0/203987601 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:57.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.126+0000 7fc11b7fe700 1 --2- 172.21.15.72:0/203987601 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc11c09f240 0x7fc11c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.126+0000 7fc11bfff700 1 -- 172.21.15.72:0/203987601 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc11c09f240 msgr2=0x7fc11c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.126+0000 7fc11bfff700 1 --2- 172.21.15.72:0/203987601 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc11c09f240 0x7fc11c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.126+0000 7fc11affd700 1 -- 172.21.15.72:0/203987601 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123259369 0 0) 0x7fc11c070940 con 0x7fc11c09f650 2023-10-03T10:18:57.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.126+0000 7fc11bfff700 1 -- 172.21.15.72:0/203987601 >> v1:172.21.15.72:6789/0 conn(0x7fc11c09f650 legacy=0x7fc11c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.126+0000 7fc11bfff700 1 -- 172.21.15.72:0/203987601 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c09fb60 con 0x7fc11c09e930 2023-10-03T10:18:57.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.126+0000 7fc11bfff700 1 --2- 172.21.15.72:0/203987601 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc11c09e930 0x7fc11c09ed00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009920 tx=0x7fc10c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29b269b2d9a9d4d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.126+0000 7fc11affd700 1 -- 172.21.15.72:0/203987601 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c011830 con 0x7fc11c09e930 2023-10-03T10:18:57.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.126+0000 7fc11affd700 1 -- 172.21.15.72:0/203987601 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c011990 con 0x7fc11c09e930 2023-10-03T10:18:57.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.126+0000 7fc11affd700 1 -- 172.21.15.72:0/203987601 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c011d20 con 0x7fc11c09e930 2023-10-03T10:18:57.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.127+0000 7fc12229d700 1 -- 172.21.15.72:0/203987601 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc11c09e930 msgr2=0x7fc11c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.127+0000 7fc12229d700 1 --2- 172.21.15.72:0/203987601 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc11c09e930 0x7fc11c09ed00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc10c009920 tx=0x7fc10c009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:57.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.127+0000 7fc12229d700 1 -- 172.21.15.72:0/203987601 shutdown_connections 2023-10-03T10:18:57.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.127+0000 7fc12229d700 1 --2- 172.21.15.72:0/203987601 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc11c09e930 0x7fc11c09ed00 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.127+0000 7fc12229d700 1 --2- 172.21.15.72:0/203987601 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc11c09f240 0x7fc11c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.127+0000 7fc12229d700 1 -- 172.21.15.72:0/203987601 >> 172.21.15.72:0/203987601 conn(0x7fc11c0a4210 msgr2=0x7fc11c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.127+0000 7fc12229d700 1 -- 172.21.15.72:0/203987601 shutdown_connections 2023-10-03T10:18:57.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.127+0000 7fc12229d700 1 -- 172.21.15.72:0/203987601 wait complete. 2023-10-03T10:18:57.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.129+0000 7fc12229d700 1 Processor -- start 2023-10-03T10:18:57.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.129+0000 7fc12229d700 1 -- start start 2023-10-03T10:18:57.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.129+0000 7fc12229d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc11c09e930 0x7fc11c1a3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.129+0000 7fc12229d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc11c09f240 0x7fc11c1a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.129+0000 7fc12229d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc11c09f650 0x7fc11c1a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.129+0000 7fc12229d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c1a7940 con 0x7fc11c09e930 2023-10-03T10:18:57.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.129+0000 7fc12229d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c1a8180 con 0x7fc11c09f650 2023-10-03T10:18:57.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.129+0000 7fc12229d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c1a58b0 con 0x7fc11c09f240 2023-10-03T10:18:57.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.130+0000 7fc11b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc11c09f240 0x7fc11c1a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.130+0000 7fc11b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc11c09f240 0x7fc11c1a41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36456/0 (socket says 172.21.15.72:36456) 2023-10-03T10:18:57.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.130+0000 7fc11b7fe700 1 -- 172.21.15.72:0/1838677031 learned_addr learned my addr 172.21.15.72:0/1838677031 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:57.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.130+0000 7fc12083a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc11c09f650 0x7fc11c1a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.130+0000 7fc11bfff700 1 --2- 172.21.15.72:0/1838677031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc11c09e930 0x7fc11c1a3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.130+0000 7fc11bfff700 1 -- 172.21.15.72:0/1838677031 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc11c09f240 msgr2=0x7fc11c1a41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.130+0000 7fc11bfff700 1 --2- 172.21.15.72:0/1838677031 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc11c09f240 0x7fc11c1a41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.130+0000 7fc11bfff700 1 -- 172.21.15.72:0/1838677031 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc11c09f650 msgr2=0x7fc11c1a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.130+0000 7fc11bfff700 1 --2- 172.21.15.72:0/1838677031 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc11c09f650 0x7fc11c1a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.130+0000 7fc11bfff700 1 -- 172.21.15.72:0/1838677031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c009550 con 0x7fc11c09e930 2023-10-03T10:18:57.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.130+0000 7fc11bfff700 1 --2- 172.21.15.72:0/1838677031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc11c09e930 0x7fc11c1a3ca0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fc11c072a80 tx=0x7fc10c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.130+0000 7fc118ff9700 1 -- 172.21.15.72:0/1838677031 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c004450 con 0x7fc11c09e930 2023-10-03T10:18:57.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.130+0000 7fc118ff9700 1 -- 172.21.15.72:0/1838677031 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c0045b0 con 0x7fc11c09e930 2023-10-03T10:18:57.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.130+0000 7fc118ff9700 1 -- 172.21.15.72:0/1838677031 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c0038c0 con 0x7fc11c09e930 2023-10-03T10:18:57.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.130+0000 7fc12229d700 1 -- 172.21.15.72:0/1838677031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c0a0190 con 0x7fc11c09e930 2023-10-03T10:18:57.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.131+0000 7fc12229d700 1 -- 172.21.15.72:0/1838677031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c071d20 con 0x7fc11c09e930 2023-10-03T10:18:57.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.132+0000 7fc118ff9700 1 -- 172.21.15.72:0/1838677031 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc10c003a20 con 0x7fc11c09e930 2023-10-03T10:18:57.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.132+0000 7fc12229d700 1 -- 172.21.15.72:0/1838677031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11c074ea0 con 0x7fc11c09e930 2023-10-03T10:18:57.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.132+0000 7fc118ff9700 1 -- 172.21.15.72:0/1838677031 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc10c021030 con 0x7fc11c09e930 2023-10-03T10:18:57.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.137+0000 7fc118ff9700 1 -- 172.21.15.72:0/1838677031 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc10c01a430 con 0x7fc11c09e930 2023-10-03T10:18:57.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.157+0000 7f405345b700 1 Processor -- start 2023-10-03T10:18:57.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.157+0000 7f405345b700 1 -- start start 2023-10-03T10:18:57.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.158+0000 7f405345b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f404c0a0a30 0x7f404c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.158+0000 7f405345b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404c0a1340 0x7f404c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.158+0000 7f405345b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f404c133fa0 0x7f404c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.158+0000 7f405345b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404c09edd0 con 0x7f404c0a0a30 2023-10-03T10:18:57.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.158+0000 7f405345b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c09e1f0 con 0x7f404c0a1340 2023-10-03T10:18:57.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.158+0000 7f405345b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f404c09dc50 con 0x7f404c133fa0 2023-10-03T10:18:57.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.158+0000 7f40509f6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404c0a1340 0x7f404c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.158+0000 7f40509f6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404c0a1340 0x7f404c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41056/0 (socket says 172.21.15.72:41056) 2023-10-03T10:18:57.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.158+0000 7f40509f6700 1 -- 172.21.15.72:0/3153507621 learned_addr learned my addr 172.21.15.72:0/3153507621 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:57.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.158+0000 7f40519f8700 1 --2- 172.21.15.72:0/3153507621 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f404c133fa0 0x7f404c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.158+0000 7f40511f7700 1 --2- 172.21.15.72:0/3153507621 >> v2:172.21.15.72:3300/0 conn(0x7f404c0a0a30 0x7f404c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.159+0000 7f40511f7700 1 -- 172.21.15.72:0/3153507621 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f404c133fa0 msgr2=0x7f404c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.159+0000 7f40511f7700 1 --2- 172.21.15.72:0/3153507621 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f404c133fa0 0x7f404c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.159+0000 7f40511f7700 1 -- 172.21.15.72:0/3153507621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404c0a1340 msgr2=0x7f404c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.159+0000 7f40511f7700 1 --2- 172.21.15.72:0/3153507621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404c0a1340 0x7f404c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.159+0000 7f40511f7700 1 -- 172.21.15.72:0/3153507621 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c0a1fe0 con 0x7f404c0a0a30 2023-10-03T10:18:57.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.159+0000 7f40511f7700 1 --2- 172.21.15.72:0/3153507621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404c0a0a30 0x7f404c0a0e00 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f4048009840 tx=0x7f4048009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd51b2c20819c176 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.159+0000 7f4043fff700 1 -- 172.21.15.72:0/3153507621 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4048011830 con 0x7f404c0a0a30 2023-10-03T10:18:57.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.159+0000 7f4043fff700 1 -- 172.21.15.72:0/3153507621 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4048011990 con 0x7f404c0a0a30 2023-10-03T10:18:57.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.159+0000 7f4043fff700 1 -- 172.21.15.72:0/3153507621 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4048011d20 con 0x7f404c0a0a30 2023-10-03T10:18:57.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.160+0000 7f405345b700 1 -- 172.21.15.72:0/3153507621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404c0a0a30 msgr2=0x7f404c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.160+0000 7f405345b700 1 --2- 172.21.15.72:0/3153507621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404c0a0a30 0x7f404c0a0e00 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f4048009840 tx=0x7f4048009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:57.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.160+0000 7f405345b700 1 -- 172.21.15.72:0/3153507621 shutdown_connections 2023-10-03T10:18:57.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.160+0000 7f405345b700 1 --2- 172.21.15.72:0/3153507621 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f404c133fa0 0x7f404c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.160+0000 7f405345b700 1 --2- 172.21.15.72:0/3153507621 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404c0a0a30 0x7f404c0a0e00 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.160+0000 7f405345b700 1 --2- 172.21.15.72:0/3153507621 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404c0a1340 0x7f404c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.160+0000 7f405345b700 1 -- 172.21.15.72:0/3153507621 >> 172.21.15.72:0/3153507621 conn(0x7f404c0a6550 msgr2=0x7f404c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.160+0000 7f405345b700 1 -- 172.21.15.72:0/3153507621 shutdown_connections 2023-10-03T10:18:57.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.160+0000 7f405345b700 1 -- 172.21.15.72:0/3153507621 wait complete. 2023-10-03T10:18:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.161+0000 7f405345b700 1 Processor -- start 2023-10-03T10:18:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.161+0000 7f405345b700 1 -- start start 2023-10-03T10:18:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.161+0000 7f405345b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f404c0a0a30 0x7f404c120160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.161+0000 7f405345b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404c0a1340 0x7f404c1206a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.161+0000 7f405345b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404c133fa0 0x7f404c120be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.161+0000 7f405345b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c121d70 con 0x7f404c133fa0 2023-10-03T10:18:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.161+0000 7f405345b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c122fc0 con 0x7f404c0a1340 2023-10-03T10:18:57.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.161+0000 7f405345b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f404c122360 con 0x7f404c0a0a30 2023-10-03T10:18:57.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.161+0000 7f40511f7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f404c0a0a30 0x7f404c120160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.161+0000 7f40511f7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f404c0a0a30 0x7f404c120160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:36478/0 (socket says 172.21.15.72:36478) 2023-10-03T10:18:57.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.161+0000 7f40511f7700 1 -- 172.21.15.72:0/3743883831 learned_addr learned my addr 172.21.15.72:0/3743883831 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:57.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.161+0000 7f40519f8700 1 --2- 172.21.15.72:0/3743883831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404c133fa0 0x7f404c120be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.162+0000 7f40511f7700 1 -- 172.21.15.72:0/3743883831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404c0a1340 msgr2=0x7f404c1206a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:18:57.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.162+0000 7f40511f7700 1 --2- 172.21.15.72:0/3743883831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404c0a1340 0x7f404c1206a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.162+0000 7f40511f7700 1 -- 172.21.15.72:0/3743883831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404c133fa0 msgr2=0x7f404c120be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.162+0000 7f40511f7700 1 --2- 172.21.15.72:0/3743883831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404c133fa0 0x7f404c120be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.162+0000 7f40511f7700 1 -- 172.21.15.72:0/3743883831 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40480094a0 con 0x7f404c0a0a30 2023-10-03T10:18:57.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.162+0000 7f40519f8700 1 --2- 172.21.15.72:0/3743883831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404c133fa0 0x7f404c120be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.162+0000 7f40511f7700 1 --2- 172.21.15.72:0/3743883831 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f404c0a0a30 0x7f404c120160 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f4048009b90 tx=0x7f4048004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.162+0000 7f4041ffb700 1 -- 172.21.15.72:0/3743883831 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4048004510 con 0x7f404c0a0a30 2023-10-03T10:18:57.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.162+0000 7f405345b700 1 -- 172.21.15.72:0/3743883831 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404c123410 con 0x7f404c0a0a30 2023-10-03T10:18:57.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.162+0000 7f405345b700 1 -- 172.21.15.72:0/3743883831 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404c1239a0 con 0x7f404c0a0a30 2023-10-03T10:18:57.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.163+0000 7f4041ffb700 1 -- 172.21.15.72:0/3743883831 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404801e070 con 0x7f404c0a0a30 2023-10-03T10:18:57.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.163+0000 7f4041ffb700 1 -- 172.21.15.72:0/3743883831 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40480038c0 con 0x7f404c0a0a30 2023-10-03T10:18:57.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.164+0000 7f405345b700 1 -- 172.21.15.72:0/3743883831 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402c0052e0 con 0x7f404c0a0a30 2023-10-03T10:18:57.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.164+0000 7f4041ffb700 1 -- 172.21.15.72:0/3743883831 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4048003a20 con 0x7f404c0a0a30 2023-10-03T10:18:57.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.164+0000 7f4041ffb700 1 -- 172.21.15.72:0/3743883831 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4048040330 con 0x7f404c0a0a30 2023-10-03T10:18:57.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.165+0000 7fbb06f54700 1 Processor -- start 2023-10-03T10:18:57.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.165+0000 7fbb06f54700 1 -- start start 2023-10-03T10:18:57.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.166+0000 7fbb06f54700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb0009d6f0 0x7fbb0009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.166+0000 7fbb06f54700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb0009e440 0x7fbb00134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.166+0000 7fbb06f54700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0009b120 con 0x7fbb0009e000 2023-10-03T10:18:57.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.166+0000 7fbb06f54700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0006b460 con 0x7fbb0009d6f0 2023-10-03T10:18:57.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.166+0000 7fbb06f54700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0009a7e0 con 0x7fbb0009e440 2023-10-03T10:18:57.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.166+0000 7fbb04cf0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb0009d6f0 0x7fbb0009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.166+0000 7fbb04cf0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb0009d6f0 0x7fbb0009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51190/0 (socket says 172.21.15.72:51190) 2023-10-03T10:18:57.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.166+0000 7fbb04cf0700 1 -- 172.21.15.72:0/3451276852 learned_addr learned my addr 172.21.15.72:0/3451276852 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:57.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.166+0000 7fbb04cf0700 1 -- 172.21.15.72:0/3451276852 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb0009e440 msgr2=0x7fbb00134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.166+0000 7fbb04cf0700 1 --2- 172.21.15.72:0/3451276852 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb0009e440 0x7fbb00134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.166+0000 7fbb04cf0700 1 -- 172.21.15.72:0/3451276852 >> v1:172.21.15.72:6789/0 conn(0x7fbb0009e000 legacy=0x7fbb001339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.166+0000 7fbb04cf0700 1 -- 172.21.15.72:0/3451276852 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0009a500 con 0x7fbb0009d6f0 2023-10-03T10:18:57.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.166+0000 7fbb04cf0700 1 --2- 172.21.15.72:0/3451276852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb0009d6f0 0x7fbb0009dac0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009920 tx=0x7fbaf4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f994944dacda9ab1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.167+0000 7fbaff7fe700 1 -- 172.21.15.72:0/3451276852 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400ba20 con 0x7fbb0009d6f0 2023-10-03T10:18:57.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.167+0000 7fbaff7fe700 1 -- 172.21.15.72:0/3451276852 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf400bb80 con 0x7fbb0009d6f0 2023-10-03T10:18:57.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.167+0000 7fbaff7fe700 1 -- 172.21.15.72:0/3451276852 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4009e70 con 0x7fbb0009d6f0 2023-10-03T10:18:57.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.167+0000 7fbb06f54700 1 -- 172.21.15.72:0/3451276852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb0009d6f0 msgr2=0x7fbb0009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.167+0000 7fbb06f54700 1 --2- 172.21.15.72:0/3451276852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb0009d6f0 0x7fbb0009dac0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009920 tx=0x7fbaf4009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:57.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.167+0000 7fbb06f54700 1 -- 172.21.15.72:0/3451276852 shutdown_connections 2023-10-03T10:18:57.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.167+0000 7fbb06f54700 1 --2- 172.21.15.72:0/3451276852 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb0009e440 0x7fbb00134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.167+0000 7fbb06f54700 1 --2- 172.21.15.72:0/3451276852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb0009d6f0 0x7fbb0009dac0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.167+0000 7fbb06f54700 1 -- 172.21.15.72:0/3451276852 >> 172.21.15.72:0/3451276852 conn(0x7fbb00066f50 msgr2=0x7fbb0009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.167+0000 7fbb06f54700 1 -- 172.21.15.72:0/3451276852 shutdown_connections 2023-10-03T10:18:57.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.167+0000 7fbb06f54700 1 -- 172.21.15.72:0/3451276852 wait complete. 2023-10-03T10:18:57.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.168+0000 7fbb06f54700 1 Processor -- start 2023-10-03T10:18:57.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.168+0000 7fbb06f54700 1 -- start start 2023-10-03T10:18:57.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbb06f54700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb0009d6f0 0x7fbb001a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbb06f54700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb0009e000 0x7fbb001a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbb06f54700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb0009e440 0x7fbb001a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbb06f54700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb001a9a60 con 0x7fbb0009e000 2023-10-03T10:18:57.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbb06f54700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb001a8e10 con 0x7fbb0009e440 2023-10-03T10:18:57.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbb06f54700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb001a7bf0 con 0x7fbb0009d6f0 2023-10-03T10:18:57.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbafffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb0009e000 0x7fbb001a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbafffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb0009e000 0x7fbb001a6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51196/0 (socket says 172.21.15.72:51196) 2023-10-03T10:18:57.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbafffff700 1 -- 172.21.15.72:0/2493755718 learned_addr learned my addr 172.21.15.72:0/2493755718 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:57.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbb054f1700 1 --2- 172.21.15.72:0/2493755718 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb0009e440 0x7fbb001a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbb04cf0700 1 --2- 172.21.15.72:0/2493755718 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb0009d6f0 0x7fbb001a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbafffff700 1 -- 172.21.15.72:0/2493755718 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb0009d6f0 msgr2=0x7fbb001a5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbafffff700 1 --2- 172.21.15.72:0/2493755718 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb0009d6f0 0x7fbb001a5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbafffff700 1 -- 172.21.15.72:0/2493755718 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb0009e440 msgr2=0x7fbb001a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbafffff700 1 --2- 172.21.15.72:0/2493755718 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb0009e440 0x7fbb001a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.169+0000 7fbafffff700 1 -- 172.21.15.72:0/2493755718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf4009550 con 0x7fbb0009e000 2023-10-03T10:18:57.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.170+0000 7fbafffff700 1 --2- 172.21.15.72:0/2493755718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb0009e000 0x7fbb001a6480 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00c4e0 tx=0x7fbaec00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.170+0000 7fbafd7fa700 1 -- 172.21.15.72:0/2493755718 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0052d0 con 0x7fbb0009e000 2023-10-03T10:18:57.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.170+0000 7fbafd7fa700 1 -- 172.21.15.72:0/2493755718 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaec005430 con 0x7fbb0009e000 2023-10-03T10:18:57.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.170+0000 7fbb06f54700 1 -- 172.21.15.72:0/2493755718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb000a2200 con 0x7fbb0009e000 2023-10-03T10:18:57.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.170+0000 7fbafd7fa700 1 -- 172.21.15.72:0/2493755718 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0038c0 con 0x7fbb0009e000 2023-10-03T10:18:57.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.171+0000 7fbb06f54700 1 -- 172.21.15.72:0/2493755718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb001a9f60 con 0x7fbb0009e000 2023-10-03T10:18:57.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.171+0000 7fbafd7fa700 1 -- 172.21.15.72:0/2493755718 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbaec003a20 con 0x7fbb0009e000 2023-10-03T10:18:57.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.171+0000 7fbafd7fa700 1 -- 172.21.15.72:0/2493755718 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbaec040a60 con 0x7fbb0009e000 2023-10-03T10:18:57.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.171+0000 7fbb06f54700 1 -- 172.21.15.72:0/2493755718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb00074ea0 con 0x7fbb0009e000 2023-10-03T10:18:57.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.173+0000 7f4041ffb700 1 -- 172.21.15.72:0/3743883831 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4048010de0 con 0x7f404c0a0a30 2023-10-03T10:18:57.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.176+0000 7fbafd7fa700 1 -- 172.21.15.72:0/2493755718 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbaec044060 con 0x7fbb0009e000 2023-10-03T10:18:57.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.245+0000 7fc56220b700 1 -- 172.21.15.72:0/810860459 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc55c1a8160 con 0x7fc55c09d6f0 2023-10-03T10:18:57.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.245+0000 7fc553fff700 1 -- 172.21.15.72:0/810860459 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc54c01d3c0 con 0x7fc55c09d6f0 2023-10-03T10:18:57.246 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:57.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.247+0000 7fc56220b700 1 -- 172.21.15.72:0/810860459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55c09d6f0 msgr2=0x7fc55c1a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.247+0000 7fc56220b700 1 --2- 172.21.15.72:0/810860459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55c09d6f0 0x7fc55c1a5210 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00efc0 tx=0x7fc54c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.247+0000 7fc56220b700 1 -- 172.21.15.72:0/810860459 shutdown_connections 2023-10-03T10:18:57.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.247+0000 7fc56220b700 1 --2- 172.21.15.72:0/810860459 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55c09d6f0 0x7fc55c1a5210 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.247+0000 7fc56220b700 1 --2- 172.21.15.72:0/810860459 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc55c09e410 0x7fc55c1c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.247+0000 7fc56220b700 1 --2- 172.21.15.72:0/810860459 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc55c09e000 0x7fc55c1a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.247+0000 7fc56220b700 1 -- 172.21.15.72:0/810860459 >> 172.21.15.72:0/810860459 conn(0x7fc55c066f50 msgr2=0x7fc55c1bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.247+0000 7fc56220b700 1 -- 172.21.15.72:0/810860459 shutdown_connections 2023-10-03T10:18:57.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.247+0000 7fc56220b700 1 -- 172.21.15.72:0/810860459 wait complete. 2023-10-03T10:18:57.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:57.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.336+0000 7fc12229d700 1 -- 172.21.15.72:0/1838677031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc11c06b250 con 0x7fc11c09e930 2023-10-03T10:18:57.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.336+0000 7fc118ff9700 1 -- 172.21.15.72:0/1838677031 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc10c0211f0 con 0x7fc11c09e930 2023-10-03T10:18:57.337 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.338+0000 7fc12229d700 1 -- 172.21.15.72:0/1838677031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc11c09e930 msgr2=0x7fc11c1a3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.338+0000 7fc12229d700 1 --2- 172.21.15.72:0/1838677031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc11c09e930 0x7fc11c1a3ca0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fc11c072a80 tx=0x7fc10c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.338+0000 7fc12229d700 1 -- 172.21.15.72:0/1838677031 shutdown_connections 2023-10-03T10:18:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.338+0000 7fc12229d700 1 --2- 172.21.15.72:0/1838677031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc11c09e930 0x7fc11c1a3ca0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.338+0000 7fc12229d700 1 --2- 172.21.15.72:0/1838677031 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc11c09f650 0x7fc11c1a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.338+0000 7fc12229d700 1 --2- 172.21.15.72:0/1838677031 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc11c09f240 0x7fc11c1a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.338+0000 7fc12229d700 1 -- 172.21.15.72:0/1838677031 >> 172.21.15.72:0/1838677031 conn(0x7fc11c0a4210 msgr2=0x7fc11c1b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.338+0000 7fc12229d700 1 -- 172.21.15.72:0/1838677031 shutdown_connections 2023-10-03T10:18:57.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.338+0000 7fc12229d700 1 -- 172.21.15.72:0/1838677031 wait complete. 2023-10-03T10:18:57.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.370+0000 7fbb06f54700 1 -- 172.21.15.72:0/2493755718 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbb0009f420 con 0x7fbb0009e000 2023-10-03T10:18:57.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.370+0000 7fbafd7fa700 1 -- 172.21.15.72:0/2493755718 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fbaec017030 con 0x7fbb0009e000 2023-10-03T10:18:57.371 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.372+0000 7fbb06f54700 1 -- 172.21.15.72:0/2493755718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb0009e000 msgr2=0x7fbb001a6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.372+0000 7fbb06f54700 1 --2- 172.21.15.72:0/2493755718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb0009e000 0x7fbb001a6480 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00c4e0 tx=0x7fbaec00c7f0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.372+0000 7fbb06f54700 1 -- 172.21.15.72:0/2493755718 shutdown_connections 2023-10-03T10:18:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.372+0000 7fbb06f54700 1 --2- 172.21.15.72:0/2493755718 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb0009e440 0x7fbb001a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.372+0000 7fbb06f54700 1 --2- 172.21.15.72:0/2493755718 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb0009d6f0 0x7fbb001a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.372+0000 7fbb06f54700 1 --2- 172.21.15.72:0/2493755718 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb0009e000 0x7fbb001a6480 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.372+0000 7fbb06f54700 1 -- 172.21.15.72:0/2493755718 >> 172.21.15.72:0/2493755718 conn(0x7fbb00066f50 msgr2=0x7fbb001bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.372+0000 7fbb06f54700 1 -- 172.21.15.72:0/2493755718 shutdown_connections 2023-10-03T10:18:57.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.372+0000 7fbb06f54700 1 -- 172.21.15.72:0/2493755718 wait complete. 2023-10-03T10:18:57.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.377+0000 7f405345b700 1 -- 172.21.15.72:0/3743883831 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f402c005590 con 0x7f404c0a0a30 2023-10-03T10:18:57.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.377+0000 7f4041ffb700 1 -- 172.21.15.72:0/3743883831 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4048015030 con 0x7f404c0a0a30 2023-10-03T10:18:57.378 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.379+0000 7f405345b700 1 -- 172.21.15.72:0/3743883831 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f404c0a0a30 msgr2=0x7f404c120160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.379+0000 7f405345b700 1 --2- 172.21.15.72:0/3743883831 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f404c0a0a30 0x7f404c120160 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f4048009b90 tx=0x7f4048004750 comp rx=0 tx=0).stop 2023-10-03T10:18:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.379+0000 7f405345b700 1 -- 172.21.15.72:0/3743883831 shutdown_connections 2023-10-03T10:18:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.379+0000 7f405345b700 1 --2- 172.21.15.72:0/3743883831 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f404c133fa0 0x7f404c120be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.379+0000 7f405345b700 1 --2- 172.21.15.72:0/3743883831 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f404c0a0a30 0x7f404c120160 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.379+0000 7f405345b700 1 --2- 172.21.15.72:0/3743883831 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f404c0a1340 0x7f404c1206a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.379+0000 7f405345b700 1 -- 172.21.15.72:0/3743883831 >> 172.21.15.72:0/3743883831 conn(0x7f404c0a6550 msgr2=0x7f404c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.379+0000 7f405345b700 1 -- 172.21.15.72:0/3743883831 shutdown_connections 2023-10-03T10:18:57.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:57.379+0000 7f405345b700 1 -- 172.21.15.72:0/3743883831 wait complete. 2023-10-03T10:18:57.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:57.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:58.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:58.355 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:58.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:58.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.397+0000 7fb273018700 1 Processor -- start 2023-10-03T10:18:58.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.398+0000 7fb273018700 1 -- start start 2023-10-03T10:18:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.398+0000 7fb273018700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb26c09e1d0 0x7fb26c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.398+0000 7fb273018700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb26c135e50 0x7fb26c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.398+0000 7fb273018700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26c09f130 con 0x7fb26c09d6f0 2023-10-03T10:18:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.398+0000 7fb273018700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26c09f520 con 0x7fb26c135e50 2023-10-03T10:18:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.398+0000 7fb273018700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c09e930 con 0x7fb26c09e1d0 2023-10-03T10:18:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.398+0000 7fb26bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb26c09e1d0 0x7fb26c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.398+0000 7fb2715b5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb26c135e50 0x7fb26c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.398+0000 7fb2715b5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb26c135e50 0x7fb26c138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40238/0 (socket says 172.21.15.72:40238) 2023-10-03T10:18:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.399+0000 7fb2715b5700 1 -- 172.21.15.72:0/257685510 learned_addr learned my addr 172.21.15.72:0/257685510 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.398+0000 7fb26bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb26c09e1d0 0x7fb26c135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47838/0 (socket says 172.21.15.72:47838) 2023-10-03T10:18:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.399+0000 7fb26bfff700 1 -- 172.21.15.72:0/257685510 >> v2:172.21.15.72:3300/0 conn(0x7fb26c135e50 msgr2=0x7fb26c138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.399+0000 7fb26bfff700 1 --2- 172.21.15.72:0/257685510 >> v2:172.21.15.72:3300/0 conn(0x7fb26c135e50 0x7fb26c138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.399+0000 7fb26bfff700 1 -- 172.21.15.72:0/257685510 >> v1:172.21.15.72:6789/0 conn(0x7fb26c09d6f0 legacy=0x7fb26c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.399+0000 7fb26bfff700 1 -- 172.21.15.72:0/257685510 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c09b2d0 con 0x7fb26c09e1d0 2023-10-03T10:18:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.399+0000 7fb26bfff700 1 --2- 172.21.15.72:0/257685510 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb26c09e1d0 0x7fb26c135910 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb258009870 tx=0x7fb258009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=894b28392552ef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.399+0000 7fb26b7fe700 1 -- 172.21.15.72:0/257685510 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258011830 con 0x7fb26c09e1d0 2023-10-03T10:18:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.399+0000 7fb26b7fe700 1 -- 172.21.15.72:0/257685510 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb258011990 con 0x7fb26c09e1d0 2023-10-03T10:18:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.399+0000 7fb26b7fe700 1 -- 172.21.15.72:0/257685510 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258011d20 con 0x7fb26c09e1d0 2023-10-03T10:18:58.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.400+0000 7fb273018700 1 -- 172.21.15.72:0/257685510 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb26c09e1d0 msgr2=0x7fb26c135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.400+0000 7fb273018700 1 --2- 172.21.15.72:0/257685510 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb26c09e1d0 0x7fb26c135910 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb258009870 tx=0x7fb258009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.400+0000 7fb273018700 1 -- 172.21.15.72:0/257685510 shutdown_connections 2023-10-03T10:18:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.400+0000 7fb273018700 1 --2- 172.21.15.72:0/257685510 >> v2:172.21.15.72:3300/0 conn(0x7fb26c135e50 0x7fb26c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.400+0000 7fb273018700 1 --2- 172.21.15.72:0/257685510 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb26c09e1d0 0x7fb26c135910 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.400+0000 7fb273018700 1 -- 172.21.15.72:0/257685510 >> 172.21.15.72:0/257685510 conn(0x7fb26c066f50 msgr2=0x7fb26c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.400+0000 7fb273018700 1 -- 172.21.15.72:0/257685510 shutdown_connections 2023-10-03T10:18:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.400+0000 7fb273018700 1 -- 172.21.15.72:0/257685510 wait complete. 2023-10-03T10:18:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.402+0000 7fb273018700 1 Processor -- start 2023-10-03T10:18:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.402+0000 7fb273018700 1 -- start start 2023-10-03T10:18:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb273018700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb26c09d6f0 0x7fb26c1c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb273018700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb26c09e1d0 0x7fb26c1c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb273018700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb26c135e50 0x7fb26c119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb273018700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c1c4e70 con 0x7fb26c09e1d0 2023-10-03T10:18:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb273018700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c1301a0 con 0x7fb26c09d6f0 2023-10-03T10:18:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb273018700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c11b150 con 0x7fb26c135e50 2023-10-03T10:18:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb2715b5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb26c135e50 0x7fb26c119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb2715b5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb26c135e50 0x7fb26c119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47842/0 (socket says 172.21.15.72:47842) 2023-10-03T10:18:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb2715b5700 1 -- 172.21.15.72:0/2164864434 learned_addr learned my addr 172.21.15.72:0/2164864434 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb26bfff700 1 --2- 172.21.15.72:0/2164864434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb26c09e1d0 0x7fb26c1c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb270db4700 1 --2- 172.21.15.72:0/2164864434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb26c09d6f0 0x7fb26c1c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb2715b5700 1 -- 172.21.15.72:0/2164864434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb26c09d6f0 msgr2=0x7fb26c1c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb2715b5700 1 --2- 172.21.15.72:0/2164864434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb26c09d6f0 0x7fb26c1c43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb2715b5700 1 -- 172.21.15.72:0/2164864434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb26c09e1d0 msgr2=0x7fb26c1c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb2715b5700 1 --2- 172.21.15.72:0/2164864434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb26c09e1d0 0x7fb26c1c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.403+0000 7fb2715b5700 1 -- 172.21.15.72:0/2164864434 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2580094a0 con 0x7fb26c135e50 2023-10-03T10:18:58.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.404+0000 7fb2715b5700 1 --2- 172.21.15.72:0/2164864434 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb26c135e50 0x7fb26c119480 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb264010fc0 tx=0x7fb26400e450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.404+0000 7fb2697fa700 1 -- 172.21.15.72:0/2164864434 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264003a20 con 0x7fb26c135e50 2023-10-03T10:18:58.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.404+0000 7fb2697fa700 1 -- 172.21.15.72:0/2164864434 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb264011040 con 0x7fb26c135e50 2023-10-03T10:18:58.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.404+0000 7fb273018700 1 -- 172.21.15.72:0/2164864434 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26c11b7f0 con 0x7fb26c135e50 2023-10-03T10:18:58.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.404+0000 7fb273018700 1 -- 172.21.15.72:0/2164864434 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26c09c700 con 0x7fb26c135e50 2023-10-03T10:18:58.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.404+0000 7fb2697fa700 1 -- 172.21.15.72:0/2164864434 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264003de0 con 0x7fb26c135e50 2023-10-03T10:18:58.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.405+0000 7fb2697fa700 1 -- 172.21.15.72:0/2164864434 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb26400ea40 con 0x7fb26c135e50 2023-10-03T10:18:58.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.405+0000 7fb2697fa700 1 -- 172.21.15.72:0/2164864434 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb264043dc0 con 0x7fb26c135e50 2023-10-03T10:18:58.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.405+0000 7fb273018700 1 -- 172.21.15.72:0/2164864434 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24c0052e0 con 0x7fb26c135e50 2023-10-03T10:18:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.412+0000 7fb2697fa700 1 -- 172.21.15.72:0/2164864434 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb264008770 con 0x7fb26c135e50 2023-10-03T10:18:58.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.497+0000 7f1c11732700 1 Processor -- start 2023-10-03T10:18:58.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.497+0000 7f1c11732700 1 -- start start 2023-10-03T10:18:58.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.498+0000 7f1c11732700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1c0c09e930 0x7f1c0c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.498+0000 7f1c11732700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1c0c09f240 0x7f1c0c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.498+0000 7f1c11732700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0c070940 con 0x7f1c0c09f650 2023-10-03T10:18:58.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.498+0000 7f1c11732700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c06fd60 con 0x7f1c0c09e930 2023-10-03T10:18:58.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.498+0000 7f1c11732700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c06fa80 con 0x7f1c0c09f240 2023-10-03T10:18:58.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.498+0000 7f1c0a7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1c0c09f240 0x7f1c0c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.498+0000 7f1c0a7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1c0c09f240 0x7f1c0c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47844/0 (socket says 172.21.15.72:47844) 2023-10-03T10:18:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.498+0000 7f1c0a7fc700 1 -- 172.21.15.72:0/2054655979 learned_addr learned my addr 172.21.15.72:0/2054655979 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.499+0000 7f1c0affd700 1 --2- 172.21.15.72:0/2054655979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1c0c09e930 0x7f1c0c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.499+0000 7f1c09ffb700 1 -- 172.21.15.72:0/2054655979 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741421103 0 0) 0x7f1c0c070940 con 0x7f1c0c09f650 2023-10-03T10:18:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.499+0000 7f1c09ffb700 1 -- 172.21.15.72:0/2054655979 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bf40035b0 con 0x7f1c0c09f650 2023-10-03T10:18:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.499+0000 7f1c0a7fc700 1 -- 172.21.15.72:0/2054655979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1c0c09e930 msgr2=0x7f1c0c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.499+0000 7f1c0a7fc700 1 --2- 172.21.15.72:0/2054655979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1c0c09e930 0x7f1c0c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.499+0000 7f1c0a7fc700 1 -- 172.21.15.72:0/2054655979 >> v1:172.21.15.72:6789/0 conn(0x7f1c0c09f650 legacy=0x7f1c0c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.499+0000 7f1c0a7fc700 1 -- 172.21.15.72:0/2054655979 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c09fb60 con 0x7f1c0c09f240 2023-10-03T10:18:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.499+0000 7f1c0a7fc700 1 --2- 172.21.15.72:0/2054655979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1c0c09f240 0x7f1c0c1317f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009920 tx=0x7f1c00009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cfab5d5cb8581a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.499+0000 7f1c09ffb700 1 -- 172.21.15.72:0/2054655979 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00011830 con 0x7f1c0c09f240 2023-10-03T10:18:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.499+0000 7f1c09ffb700 1 -- 172.21.15.72:0/2054655979 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c00011990 con 0x7f1c0c09f240 2023-10-03T10:18:58.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.499+0000 7f1c09ffb700 1 -- 172.21.15.72:0/2054655979 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00011d00 con 0x7f1c0c09f240 2023-10-03T10:18:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.500+0000 7f1c11732700 1 -- 172.21.15.72:0/2054655979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1c0c09f240 msgr2=0x7f1c0c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.500+0000 7f1c11732700 1 --2- 172.21.15.72:0/2054655979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1c0c09f240 0x7f1c0c1317f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009920 tx=0x7f1c00009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.500+0000 7f1c11732700 1 -- 172.21.15.72:0/2054655979 shutdown_connections 2023-10-03T10:18:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.500+0000 7f1c11732700 1 --2- 172.21.15.72:0/2054655979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1c0c09e930 0x7f1c0c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.500+0000 7f1c11732700 1 --2- 172.21.15.72:0/2054655979 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1c0c09f240 0x7f1c0c1317f0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.500+0000 7f1c11732700 1 -- 172.21.15.72:0/2054655979 >> 172.21.15.72:0/2054655979 conn(0x7f1c0c0a4210 msgr2=0x7f1c0c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.500+0000 7f1c11732700 1 -- 172.21.15.72:0/2054655979 shutdown_connections 2023-10-03T10:18:58.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.500+0000 7f1c11732700 1 -- 172.21.15.72:0/2054655979 wait complete. 2023-10-03T10:18:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.502+0000 7f1c11732700 1 Processor -- start 2023-10-03T10:18:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.502+0000 7f1c11732700 1 -- start start 2023-10-03T10:18:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.502+0000 7f1c11732700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1c0c09e930 0x7f1c0c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.502+0000 7f1c11732700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c09f240 0x7f1c0c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.502+0000 7f1c11732700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1c0c09f650 0x7f1c0c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.502+0000 7f1c11732700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c1a8820 con 0x7f1c0c09f240 2023-10-03T10:18:58.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.502+0000 7f1c11732700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c1a9860 con 0x7f1c0c09e930 2023-10-03T10:18:58.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.502+0000 7f1c11732700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c06cd10 con 0x7f1c0c09f650 2023-10-03T10:18:58.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.502+0000 7f1c0affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1c0c09e930 0x7f1c0c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.502+0000 7f1c0b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1c0c09f650 0x7f1c0c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.502+0000 7f1c0affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1c0c09e930 0x7f1c0c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42470/0 (socket says 172.21.15.72:42470) 2023-10-03T10:18:58.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.502+0000 7f1c0affd700 1 -- 172.21.15.72:0/1456351672 learned_addr learned my addr 172.21.15.72:0/1456351672 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:58.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.502+0000 7f1c0a7fc700 1 --2- 172.21.15.72:0/1456351672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c09f240 0x7f1c0c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.503+0000 7f1c0b7fe700 1 -- 172.21.15.72:0/1456351672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1c0c09e930 msgr2=0x7f1c0c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.503+0000 7f1c0b7fe700 1 --2- 172.21.15.72:0/1456351672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1c0c09e930 0x7f1c0c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.503+0000 7f1c0b7fe700 1 -- 172.21.15.72:0/1456351672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c09f240 msgr2=0x7f1c0c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.503+0000 7f1c0b7fe700 1 --2- 172.21.15.72:0/1456351672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c09f240 0x7f1c0c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.503+0000 7f1c0b7fe700 1 -- 172.21.15.72:0/1456351672 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c00009550 con 0x7f1c0c09f650 2023-10-03T10:18:58.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.503+0000 7f1c0b7fe700 1 --2- 172.21.15.72:0/1456351672 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1c0c09f650 0x7f1c0c06c330 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400cb90 tx=0x7f1c0400cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.503+0000 7f1bf37fe700 1 -- 172.21.15.72:0/1456351672 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04003c00 con 0x7f1c0c09f650 2023-10-03T10:18:58.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.503+0000 7f1bf37fe700 1 -- 172.21.15.72:0/1456351672 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c04003d60 con 0x7f1c0c09f650 2023-10-03T10:18:58.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.503+0000 7f1c11732700 1 -- 172.21.15.72:0/1456351672 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0c0a0190 con 0x7f1c0c09f650 2023-10-03T10:18:58.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.503+0000 7f1bf37fe700 1 -- 172.21.15.72:0/1456351672 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0400aa80 con 0x7f1c0c09f650 2023-10-03T10:18:58.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.503+0000 7f1c11732700 1 -- 172.21.15.72:0/1456351672 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0c06d4c0 con 0x7f1c0c09f650 2023-10-03T10:18:58.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.504+0000 7f1bf37fe700 1 -- 172.21.15.72:0/1456351672 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c0400abe0 con 0x7f1c0c09f650 2023-10-03T10:18:58.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.504+0000 7f1bf37fe700 1 -- 172.21.15.72:0/1456351672 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1c0403f5a0 con 0x7f1c0c09f650 2023-10-03T10:18:58.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.505+0000 7f1c11732700 1 -- 172.21.15.72:0/1456351672 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0c1a0b30 con 0x7f1c0c09f650 2023-10-03T10:18:58.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.513+0000 7f1bf37fe700 1 -- 172.21.15.72:0/1456351672 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c040198f0 con 0x7f1c0c09f650 2023-10-03T10:18:58.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.530+0000 7f01b561b700 1 Processor -- start 2023-10-03T10:18:58.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.530+0000 7f01b561b700 1 -- start start 2023-10-03T10:18:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.530+0000 7f01b561b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01b009d6f0 0x7f01b009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.530+0000 7f01b561b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01b009e000 0x7f01b01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.530+0000 7f01b561b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b009b120 con 0x7f01b009e410 2023-10-03T10:18:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.530+0000 7f01b561b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b006b460 con 0x7f01b009e000 2023-10-03T10:18:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.530+0000 7f01b561b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01b009a7e0 con 0x7f01b009d6f0 2023-10-03T10:18:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.531+0000 7f01aeffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01b009d6f0 0x7f01b009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.531+0000 7f01aeffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01b009d6f0 0x7f01b009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47862/0 (socket says 172.21.15.72:47862) 2023-10-03T10:18:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.531+0000 7f01aeffd700 1 -- 172.21.15.72:0/2522052711 learned_addr learned my addr 172.21.15.72:0/2522052711 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:58.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.531+0000 7f01ae7fc700 1 --2- 172.21.15.72:0/2522052711 >> v2:172.21.15.72:3300/0 conn(0x7f01b009e000 0x7f01b01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.531+0000 7f01aeffd700 1 -- 172.21.15.72:0/2522052711 >> v2:172.21.15.72:3300/0 conn(0x7f01b009e000 msgr2=0x7f01b01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.531+0000 7f01aeffd700 1 --2- 172.21.15.72:0/2522052711 >> v2:172.21.15.72:3300/0 conn(0x7f01b009e000 0x7f01b01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.531+0000 7f01aeffd700 1 -- 172.21.15.72:0/2522052711 >> v1:172.21.15.72:6789/0 conn(0x7f01b009e410 legacy=0x7f01b0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.531+0000 7f01aeffd700 1 -- 172.21.15.72:0/2522052711 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b009a500 con 0x7f01b009d6f0 2023-10-03T10:18:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.531+0000 7f01aeffd700 1 --2- 172.21.15.72:0/2522052711 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01b009d6f0 0x7f01b009dac0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009920 tx=0x7f01a0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ae14f29d0a5266e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.531+0000 7f01adffb700 1 -- 172.21.15.72:0/2522052711 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0004230 con 0x7f01b009d6f0 2023-10-03T10:18:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.531+0000 7f01adffb700 1 -- 172.21.15.72:0/2522052711 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a0004390 con 0x7f01b009d6f0 2023-10-03T10:18:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.531+0000 7f01adffb700 1 -- 172.21.15.72:0/2522052711 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0009e70 con 0x7f01b009d6f0 2023-10-03T10:18:58.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.532+0000 7f01b561b700 1 -- 172.21.15.72:0/2522052711 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01b009d6f0 msgr2=0x7f01b009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.532+0000 7f01b561b700 1 --2- 172.21.15.72:0/2522052711 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01b009d6f0 0x7f01b009dac0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009920 tx=0x7f01a0009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:58.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.532+0000 7f01b561b700 1 -- 172.21.15.72:0/2522052711 shutdown_connections 2023-10-03T10:18:58.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.532+0000 7f01b561b700 1 --2- 172.21.15.72:0/2522052711 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01b009d6f0 0x7f01b009dac0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.532+0000 7f01b561b700 1 --2- 172.21.15.72:0/2522052711 >> v2:172.21.15.72:3300/0 conn(0x7f01b009e000 0x7f01b01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.532+0000 7f01b561b700 1 -- 172.21.15.72:0/2522052711 >> 172.21.15.72:0/2522052711 conn(0x7f01b0066f50 msgr2=0x7f01b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.532+0000 7f01b561b700 1 -- 172.21.15.72:0/2522052711 shutdown_connections 2023-10-03T10:18:58.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.532+0000 7f01b561b700 1 -- 172.21.15.72:0/2522052711 wait complete. 2023-10-03T10:18:58.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.533+0000 7f01b561b700 1 Processor -- start 2023-10-03T10:18:58.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.533+0000 7f01b561b700 1 -- start start 2023-10-03T10:18:58.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.534+0000 7f01b561b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01b009d6f0 0x7f01b01a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.534+0000 7f01b561b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01b009e000 0x7f01b01a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.534+0000 7f01b561b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01b009e410 0x7f01b01a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.534+0000 7f01b561b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b00a3290 con 0x7f01b009e000 2023-10-03T10:18:58.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.534+0000 7f01b561b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b01a8480 con 0x7f01b009d6f0 2023-10-03T10:18:58.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.534+0000 7f01b561b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01b01a6c90 con 0x7f01b009e410 2023-10-03T10:18:58.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.534+0000 7f01af7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01b009e410 0x7f01b01a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.534+0000 7f01ae7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01b009e000 0x7f01b01a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.534+0000 7f01ae7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01b009e000 0x7f01b01a55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40272/0 (socket says 172.21.15.72:40272) 2023-10-03T10:18:58.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.534+0000 7f01ae7fc700 1 -- 172.21.15.72:0/3719353206 learned_addr learned my addr 172.21.15.72:0/3719353206 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:58.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.535+0000 7f01ae7fc700 1 -- 172.21.15.72:0/3719353206 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01b009e410 msgr2=0x7f01b01a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.535+0000 7f01ae7fc700 1 --2- 172.21.15.72:0/3719353206 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01b009e410 0x7f01b01a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.535+0000 7f01ae7fc700 1 -- 172.21.15.72:0/3719353206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01b009d6f0 msgr2=0x7f01b01a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.535+0000 7f01ae7fc700 1 --2- 172.21.15.72:0/3719353206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01b009d6f0 0x7f01b01a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.535+0000 7f01ae7fc700 1 -- 172.21.15.72:0/3719353206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a0009550 con 0x7f01b009e000 2023-10-03T10:18:58.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.535+0000 7f01ae7fc700 1 --2- 172.21.15.72:0/3719353206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01b009e000 0x7f01b01a55b0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f01a400e810 tx=0x7f01a400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.535+0000 7f01977fe700 1 -- 172.21.15.72:0/3719353206 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a4013610 con 0x7f01b009e000 2023-10-03T10:18:58.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.535+0000 7f01977fe700 1 -- 172.21.15.72:0/3719353206 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a4013770 con 0x7f01b009e000 2023-10-03T10:18:58.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.535+0000 7f01977fe700 1 -- 172.21.15.72:0/3719353206 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a4013ae0 con 0x7f01b009e000 2023-10-03T10:18:58.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.535+0000 7f01b561b700 1 -- 172.21.15.72:0/3719353206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b009c710 con 0x7f01b009e000 2023-10-03T10:18:58.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.535+0000 7f01b561b700 1 -- 172.21.15.72:0/3719353206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b01a7dc0 con 0x7f01b009e000 2023-10-03T10:18:58.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.536+0000 7f01b561b700 1 -- 172.21.15.72:0/3719353206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b01a8b40 con 0x7f01b009e000 2023-10-03T10:18:58.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.536+0000 7f01977fe700 1 -- 172.21.15.72:0/3719353206 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01a4013c40 con 0x7f01b009e000 2023-10-03T10:18:58.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.536+0000 7f01977fe700 1 -- 172.21.15.72:0/3719353206 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f01a403f440 con 0x7f01b009e000 2023-10-03T10:18:58.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.541+0000 7f01977fe700 1 -- 172.21.15.72:0/3719353206 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01a4012370 con 0x7f01b009e000 2023-10-03T10:18:58.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.545+0000 7f9ca701f700 1 Processor -- start 2023-10-03T10:18:58.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.545+0000 7f9ca701f700 1 -- start start 2023-10-03T10:18:58.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.545+0000 7f9ca701f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ca006e570 0x7f9ca006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.545+0000 7f9ca701f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ca009eca0 0x7f9ca006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.545+0000 7f9ca701f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca0070ee0 con 0x7f9ca0134610 2023-10-03T10:18:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.545+0000 7f9ca701f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca0071480 con 0x7f9ca006e570 2023-10-03T10:18:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.545+0000 7f9ca701f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca006f3c0 con 0x7f9ca009eca0 2023-10-03T10:18:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.545+0000 7f9ca4dbb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ca006e570 0x7f9ca006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.545+0000 7f9ca4dbb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ca006e570 0x7f9ca006e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42488/0 (socket says 172.21.15.72:42488) 2023-10-03T10:18:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.545+0000 7f9ca4dbb700 1 -- 172.21.15.72:0/452925166 learned_addr learned my addr 172.21.15.72:0/452925166 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.546+0000 7f9c9ffff700 1 --2- 172.21.15.72:0/452925166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ca009eca0 0x7f9ca006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.546+0000 7f9ca4dbb700 1 -- 172.21.15.72:0/452925166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ca009eca0 msgr2=0x7f9ca006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.546+0000 7f9ca4dbb700 1 --2- 172.21.15.72:0/452925166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ca009eca0 0x7f9ca006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.546+0000 7f9ca4dbb700 1 -- 172.21.15.72:0/452925166 >> v1:172.21.15.72:6789/0 conn(0x7f9ca0134610 legacy=0x7f9ca0134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.546+0000 7f9ca4dbb700 1 -- 172.21.15.72:0/452925166 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca0071b90 con 0x7f9ca006e570 2023-10-03T10:18:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.546+0000 7f9ca4dbb700 1 --2- 172.21.15.72:0/452925166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ca006e570 0x7f9ca006e940 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009920 tx=0x7f9c94009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8c72f1bf6b25088 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.546+0000 7f9c9f7fe700 1 -- 172.21.15.72:0/452925166 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94004230 con 0x7f9ca006e570 2023-10-03T10:18:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.546+0000 7f9c9f7fe700 1 -- 172.21.15.72:0/452925166 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c94004390 con 0x7f9ca006e570 2023-10-03T10:18:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.546+0000 7f9c9f7fe700 1 -- 172.21.15.72:0/452925166 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94009e70 con 0x7f9ca006e570 2023-10-03T10:18:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.547+0000 7f9ca701f700 1 -- 172.21.15.72:0/452925166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ca006e570 msgr2=0x7f9ca006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.547+0000 7f9ca701f700 1 --2- 172.21.15.72:0/452925166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ca006e570 0x7f9ca006e940 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009920 tx=0x7f9c94009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.547+0000 7f9ca701f700 1 -- 172.21.15.72:0/452925166 shutdown_connections 2023-10-03T10:18:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.547+0000 7f9ca701f700 1 --2- 172.21.15.72:0/452925166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ca006e570 0x7f9ca006e940 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.547+0000 7f9ca701f700 1 --2- 172.21.15.72:0/452925166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ca009eca0 0x7f9ca006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.547+0000 7f9ca701f700 1 -- 172.21.15.72:0/452925166 >> 172.21.15.72:0/452925166 conn(0x7f9ca00a2aa0 msgr2=0x7f9ca00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.547+0000 7f9ca701f700 1 -- 172.21.15.72:0/452925166 shutdown_connections 2023-10-03T10:18:58.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.547+0000 7f9ca701f700 1 -- 172.21.15.72:0/452925166 wait complete. 2023-10-03T10:18:58.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.548+0000 7f9ca701f700 1 Processor -- start 2023-10-03T10:18:58.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.548+0000 7f9ca701f700 1 -- start start 2023-10-03T10:18:58.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.548+0000 7f9ca701f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ca006e570 0x7f9ca013efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.548+0000 7f9ca701f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ca0134610 0x7f9ca013f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.548+0000 7f9ca701f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ca013fa50 0x7f9ca0132e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.548+0000 7f9ca701f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca013e110 con 0x7f9ca013fa50 2023-10-03T10:18:58.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.548+0000 7f9ca701f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca013d3f0 con 0x7f9ca006e570 2023-10-03T10:18:58.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.548+0000 7f9ca701f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca013bd30 con 0x7f9ca0134610 2023-10-03T10:18:58.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.548+0000 7f9c9ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ca0134610 0x7f9ca013f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.548+0000 7f9ca4dbb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ca006e570 0x7f9ca013efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.549+0000 7f9c9ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ca0134610 0x7f9ca013f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47904/0 (socket says 172.21.15.72:47904) 2023-10-03T10:18:58.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.549+0000 7f9c9ffff700 1 -- 172.21.15.72:0/397759090 learned_addr learned my addr 172.21.15.72:0/397759090 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:58.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.549+0000 7f9ca4dbb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ca006e570 0x7f9ca013efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42498/0 (socket says 172.21.15.72:42498) 2023-10-03T10:18:58.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.549+0000 7f9c9ffff700 1 -- 172.21.15.72:0/397759090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ca006e570 msgr2=0x7f9ca013efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.549+0000 7f9c9ffff700 1 --2- 172.21.15.72:0/397759090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ca006e570 0x7f9ca013efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.549+0000 7f9c9ffff700 1 -- 172.21.15.72:0/397759090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ca013fa50 msgr2=0x7f9ca0132e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.549+0000 7f9c9ffff700 1 --2- 172.21.15.72:0/397759090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ca013fa50 0x7f9ca0132e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.549+0000 7f9c9ffff700 1 -- 172.21.15.72:0/397759090 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c94009550 con 0x7f9ca0134610 2023-10-03T10:18:58.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.549+0000 7f9c9ffff700 1 --2- 172.21.15.72:0/397759090 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ca0134610 0x7f9ca013f510 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00e7e0 tx=0x7f9c8c00eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.549+0000 7f9c9d7fa700 1 -- 172.21.15.72:0/397759090 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c013610 con 0x7f9ca0134610 2023-10-03T10:18:58.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.549+0000 7f9ca701f700 1 -- 172.21.15.72:0/397759090 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca013de50 con 0x7f9ca0134610 2023-10-03T10:18:58.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.549+0000 7f9ca701f700 1 -- 172.21.15.72:0/397759090 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca00a2060 con 0x7f9ca0134610 2023-10-03T10:18:58.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.549+0000 7f9c9d7fa700 1 -- 172.21.15.72:0/397759090 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c013770 con 0x7f9ca0134610 2023-10-03T10:18:58.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.549+0000 7f9c9d7fa700 1 -- 172.21.15.72:0/397759090 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c013b00 con 0x7f9ca0134610 2023-10-03T10:18:58.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.550+0000 7f9c9d7fa700 1 -- 172.21.15.72:0/397759090 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c8c013c60 con 0x7f9ca0134610 2023-10-03T10:18:58.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.550+0000 7f9ca701f700 1 -- 172.21.15.72:0/397759090 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c800052e0 con 0x7f9ca0134610 2023-10-03T10:18:58.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.551+0000 7f9c9d7fa700 1 -- 172.21.15.72:0/397759090 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9c8c03f2e0 con 0x7f9ca0134610 2023-10-03T10:18:58.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.559+0000 7f9c9d7fa700 1 -- 172.21.15.72:0/397759090 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c8c012370 con 0x7f9ca0134610 2023-10-03T10:18:58.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.616+0000 7fb273018700 1 -- 172.21.15.72:0/2164864434 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb24c005150 con 0x7fb26c135e50 2023-10-03T10:18:58.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.616+0000 7fb2697fa700 1 -- 172.21.15.72:0/2164864434 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb26402c070 con 0x7fb26c135e50 2023-10-03T10:18:58.617 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:18:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.618+0000 7fb273018700 1 -- 172.21.15.72:0/2164864434 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb26c135e50 msgr2=0x7fb26c119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.618+0000 7fb273018700 1 --2- 172.21.15.72:0/2164864434 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb26c135e50 0x7fb26c119480 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb264010fc0 tx=0x7fb26400e450 comp rx=0 tx=0).stop 2023-10-03T10:18:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.618+0000 7fb273018700 1 -- 172.21.15.72:0/2164864434 shutdown_connections 2023-10-03T10:18:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.618+0000 7fb273018700 1 --2- 172.21.15.72:0/2164864434 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb26c135e50 0x7fb26c119480 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.618+0000 7fb273018700 1 --2- 172.21.15.72:0/2164864434 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb26c09d6f0 0x7fb26c1c43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.618+0000 7fb273018700 1 --2- 172.21.15.72:0/2164864434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb26c09e1d0 0x7fb26c1c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.618+0000 7fb273018700 1 -- 172.21.15.72:0/2164864434 >> 172.21.15.72:0/2164864434 conn(0x7fb26c066f50 msgr2=0x7fb26c130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.618+0000 7fb273018700 1 -- 172.21.15.72:0/2164864434 shutdown_connections 2023-10-03T10:18:58.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.619+0000 7fb273018700 1 -- 172.21.15.72:0/2164864434 wait complete. 2023-10-03T10:18:58.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:18:58.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.757+0000 7f1c11732700 1 -- 172.21.15.72:0/1456351672 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1c0c074ea0 con 0x7f1c0c09f650 2023-10-03T10:18:58.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.758+0000 7f1bf37fe700 1 -- 172.21.15.72:0/1456351672 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1c04011380 con 0x7f1c0c09f650 2023-10-03T10:18:58.758 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.760+0000 7f1c11732700 1 -- 172.21.15.72:0/1456351672 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1c0c09f650 msgr2=0x7f1c0c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.760+0000 7f1c11732700 1 --2- 172.21.15.72:0/1456351672 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1c0c09f650 0x7f1c0c06c330 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400cb90 tx=0x7f1c0400cea0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.760+0000 7f1c11732700 1 -- 172.21.15.72:0/1456351672 shutdown_connections 2023-10-03T10:18:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.760+0000 7f1c11732700 1 --2- 172.21.15.72:0/1456351672 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1c0c09f650 0x7f1c0c06c330 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.760+0000 7f1c11732700 1 --2- 172.21.15.72:0/1456351672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1c0c09e930 0x7f1c0c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.760+0000 7f1c11732700 1 --2- 172.21.15.72:0/1456351672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c09f240 0x7f1c0c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.760+0000 7f1c11732700 1 -- 172.21.15.72:0/1456351672 >> 172.21.15.72:0/1456351672 conn(0x7f1c0c0a4210 msgr2=0x7f1c0c1b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.760+0000 7f1c11732700 1 -- 172.21.15.72:0/1456351672 shutdown_connections 2023-10-03T10:18:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.760+0000 7f1c11732700 1 -- 172.21.15.72:0/1456351672 wait complete. 2023-10-03T10:18:58.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.762+0000 7f01b561b700 1 -- 172.21.15.72:0/3719353206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f01b0074ea0 con 0x7f01b009e000 2023-10-03T10:18:58.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.762+0000 7f01977fe700 1 -- 172.21.15.72:0/3719353206 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f01a4021070 con 0x7f01b009e000 2023-10-03T10:18:58.763 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:18:58.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.764+0000 7f01b561b700 1 -- 172.21.15.72:0/3719353206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01b009e000 msgr2=0x7f01b01a55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.764+0000 7f01b561b700 1 --2- 172.21.15.72:0/3719353206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01b009e000 0x7f01b01a55b0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f01a400e810 tx=0x7f01a400eb20 comp rx=0 tx=0).stop 2023-10-03T10:18:58.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.765+0000 7f01b561b700 1 -- 172.21.15.72:0/3719353206 shutdown_connections 2023-10-03T10:18:58.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.765+0000 7f01b561b700 1 --2- 172.21.15.72:0/3719353206 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01b009e410 0x7f01b01a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.765+0000 7f01b561b700 1 --2- 172.21.15.72:0/3719353206 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01b009d6f0 0x7f01b01a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.765+0000 7f01b561b700 1 --2- 172.21.15.72:0/3719353206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01b009e000 0x7f01b01a55b0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.765+0000 7f01b561b700 1 -- 172.21.15.72:0/3719353206 >> 172.21.15.72:0/3719353206 conn(0x7f01b0066f50 msgr2=0x7f01b006f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.765+0000 7f01b561b700 1 -- 172.21.15.72:0/3719353206 shutdown_connections 2023-10-03T10:18:58.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.765+0000 7f01b561b700 1 -- 172.21.15.72:0/3719353206 wait complete. 2023-10-03T10:18:58.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:18:58.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:18:58.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.795+0000 7f9ca701f700 1 -- 172.21.15.72:0/397759090 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9c80005150 con 0x7f9ca0134610 2023-10-03T10:18:58.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.795+0000 7f9c9d7fa700 1 -- 172.21.15.72:0/397759090 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9c8c021070 con 0x7f9ca0134610 2023-10-03T10:18:58.796 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:18:58.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.797+0000 7f9ca701f700 1 -- 172.21.15.72:0/397759090 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ca0134610 msgr2=0x7f9ca013f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.797+0000 7f9ca701f700 1 --2- 172.21.15.72:0/397759090 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ca0134610 0x7f9ca013f510 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00e7e0 tx=0x7f9c8c00eaf0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.797+0000 7f9ca701f700 1 -- 172.21.15.72:0/397759090 shutdown_connections 2023-10-03T10:18:58.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.797+0000 7f9ca701f700 1 --2- 172.21.15.72:0/397759090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ca013fa50 0x7f9ca0132e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.797+0000 7f9ca701f700 1 --2- 172.21.15.72:0/397759090 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9ca006e570 0x7f9ca013efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.797+0000 7f9ca701f700 1 --2- 172.21.15.72:0/397759090 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9ca0134610 0x7f9ca013f510 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.797+0000 7f9ca701f700 1 -- 172.21.15.72:0/397759090 >> 172.21.15.72:0/397759090 conn(0x7f9ca00a2aa0 msgr2=0x7f9ca00a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.797+0000 7f9ca701f700 1 -- 172.21.15.72:0/397759090 shutdown_connections 2023-10-03T10:18:58.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:58.797+0000 7f9ca701f700 1 -- 172.21.15.72:0/397759090 wait complete. 2023-10-03T10:18:58.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:18:59.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.768+0000 7f40d64fd700 1 Processor -- start 2023-10-03T10:18:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.768+0000 7f40d64fd700 1 -- start start 2023-10-03T10:18:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40d64fd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40d009d6f0 0x7f40d009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40d64fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d009e000 0x7f40d01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40d64fd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d009b120 con 0x7f40d009e410 2023-10-03T10:18:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40d64fd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d006b460 con 0x7f40d009d6f0 2023-10-03T10:18:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40d64fd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d009a7e0 con 0x7f40d009e000 2023-10-03T10:18:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40cf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d009e000 0x7f40d01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40cffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40d009d6f0 0x7f40d009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40cf7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d009e000 0x7f40d01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42504/0 (socket says 172.21.15.72:42504) 2023-10-03T10:18:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40cf7fe700 1 -- 172.21.15.72:0/2726293596 learned_addr learned my addr 172.21.15.72:0/2726293596 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40cffff700 1 --2- 172.21.15.72:0/2726293596 >> v2:172.21.15.72:3300/0 conn(0x7f40d009d6f0 0x7f40d009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40288/0 (socket says 172.21.15.72:40288) 2023-10-03T10:18:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40cffff700 1 -- 172.21.15.72:0/2726293596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d009e000 msgr2=0x7f40d01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40cffff700 1 --2- 172.21.15.72:0/2726293596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d009e000 0x7f40d01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40cffff700 1 -- 172.21.15.72:0/2726293596 >> v1:172.21.15.72:6789/0 conn(0x7f40d009e410 legacy=0x7f40d0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40cffff700 1 -- 172.21.15.72:0/2726293596 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d009a500 con 0x7f40d009d6f0 2023-10-03T10:18:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40ceffd700 1 -- 172.21.15.72:0/2726293596 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471902154 0 0) 0x7f40d009b120 con 0x7f40d009e410 2023-10-03T10:18:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40cf7fe700 1 --2- 172.21.15.72:0/2726293596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d009e000 0x7f40d01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.769+0000 7f40cffff700 1 --2- 172.21.15.72:0/2726293596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009d6f0 0x7f40d009dac0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009840 tx=0x7f40c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70012c56fa44d16 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.770+0000 7f40ceffd700 1 -- 172.21.15.72:0/2726293596 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4011830 con 0x7f40d009d6f0 2023-10-03T10:18:59.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.770+0000 7f40ceffd700 1 -- 172.21.15.72:0/2726293596 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c4011990 con 0x7f40d009d6f0 2023-10-03T10:18:59.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.770+0000 7f40ceffd700 1 -- 172.21.15.72:0/2726293596 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4011d20 con 0x7f40d009d6f0 2023-10-03T10:18:59.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.770+0000 7f40d64fd700 1 -- 172.21.15.72:0/2726293596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009d6f0 msgr2=0x7f40d009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.770+0000 7f40d64fd700 1 --2- 172.21.15.72:0/2726293596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009d6f0 0x7f40d009dac0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009840 tx=0x7f40c4009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:59.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.770+0000 7f40d64fd700 1 -- 172.21.15.72:0/2726293596 shutdown_connections 2023-10-03T10:18:59.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.770+0000 7f40d64fd700 1 --2- 172.21.15.72:0/2726293596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009d6f0 0x7f40d009dac0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.770+0000 7f40d64fd700 1 --2- 172.21.15.72:0/2726293596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d009e000 0x7f40d01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.770+0000 7f40d64fd700 1 -- 172.21.15.72:0/2726293596 >> 172.21.15.72:0/2726293596 conn(0x7f40d0066f50 msgr2=0x7f40d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.770+0000 7f40d64fd700 1 -- 172.21.15.72:0/2726293596 shutdown_connections 2023-10-03T10:18:59.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.770+0000 7f40d64fd700 1 -- 172.21.15.72:0/2726293596 wait complete. 2023-10-03T10:18:59.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.771+0000 7f40d64fd700 1 Processor -- start 2023-10-03T10:18:59.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.772+0000 7f40d64fd700 1 -- start start 2023-10-03T10:18:59.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.772+0000 7f40d64fd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009d6f0 0x7f40d01c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.772+0000 7f40d64fd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d009e000 0x7f40d01c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.772+0000 7f40d64fd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d009e410 0x7f40d01c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.772+0000 7f40d64fd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d01a7680 con 0x7f40d009d6f0 2023-10-03T10:18:59.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.772+0000 7f40d64fd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d009c710 con 0x7f40d009e000 2023-10-03T10:18:59.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.772+0000 7f40d64fd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00a2ec0 con 0x7f40d009e410 2023-10-03T10:18:59.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.772+0000 7f40cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009d6f0 0x7f40d01c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.772+0000 7f40cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009d6f0 0x7f40d01c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40298/0 (socket says 172.21.15.72:40298) 2023-10-03T10:18:59.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.772+0000 7f40cffff700 1 -- 172.21.15.72:0/1009755013 learned_addr learned my addr 172.21.15.72:0/1009755013 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:59.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.772+0000 7f40d4a9a700 1 --2- 172.21.15.72:0/1009755013 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d009e410 0x7f40d01c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.772+0000 7f40cf7fe700 1 --2- 172.21.15.72:0/1009755013 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d009e000 0x7f40d01c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.773+0000 7f40cffff700 1 -- 172.21.15.72:0/1009755013 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d009e410 msgr2=0x7f40d01c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.773+0000 7f40cffff700 1 --2- 172.21.15.72:0/1009755013 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d009e410 0x7f40d01c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.773+0000 7f40cffff700 1 -- 172.21.15.72:0/1009755013 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d009e000 msgr2=0x7f40d01c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.773+0000 7f40cffff700 1 --2- 172.21.15.72:0/1009755013 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d009e000 0x7f40d01c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.773+0000 7f40cffff700 1 -- 172.21.15.72:0/1009755013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c0009550 con 0x7f40d009d6f0 2023-10-03T10:18:59.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.773+0000 7f40cf7fe700 1 --2- 172.21.15.72:0/1009755013 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d009e000 0x7f40d01c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.773+0000 7f40cffff700 1 --2- 172.21.15.72:0/1009755013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009d6f0 0x7f40d01c81c0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f40c4000c00 tx=0x7f40c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.773+0000 7f40ccff9700 1 -- 172.21.15.72:0/1009755013 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c401a7e0 con 0x7f40d009d6f0 2023-10-03T10:18:59.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.773+0000 7f40ccff9700 1 -- 172.21.15.72:0/1009755013 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c401a940 con 0x7f40d009d6f0 2023-10-03T10:18:59.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.773+0000 7f40d64fd700 1 -- 172.21.15.72:0/1009755013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c40094a0 con 0x7f40d009d6f0 2023-10-03T10:18:59.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.773+0000 7f40ccff9700 1 -- 172.21.15.72:0/1009755013 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c401acf0 con 0x7f40d009d6f0 2023-10-03T10:18:59.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.773+0000 7f40d64fd700 1 -- 172.21.15.72:0/1009755013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d01a6720 con 0x7f40d009d6f0 2023-10-03T10:18:59.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.774+0000 7f40ccff9700 1 -- 172.21.15.72:0/1009755013 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40c4022070 con 0x7f40d009d6f0 2023-10-03T10:18:59.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.774+0000 7f40ccff9700 1 -- 172.21.15.72:0/1009755013 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f40c40405e0 con 0x7f40d009d6f0 2023-10-03T10:18:59.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.774+0000 7f40d64fd700 1 -- 172.21.15.72:0/1009755013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d004ea50 con 0x7f40d009d6f0 2023-10-03T10:18:59.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:59.779 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:59.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.779+0000 7f40ccff9700 1 -- 172.21.15.72:0/1009755013 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40c402d3b0 con 0x7f40d009d6f0 2023-10-03T10:18:59.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:59.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.907+0000 7fe781bf4700 1 Processor -- start 2023-10-03T10:18:59.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.907+0000 7fe781bf4700 1 -- start start 2023-10-03T10:18:59.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.908+0000 7fe781bf4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe77c09e1d0 0x7fe77c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.908+0000 7fe781bf4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe77c135e50 0x7fe77c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.908+0000 7fe781bf4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe77c09f130 con 0x7fe77c09d6f0 2023-10-03T10:18:59.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.908+0000 7fe781bf4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c09f520 con 0x7fe77c135e50 2023-10-03T10:18:59.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.908+0000 7fe781bf4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c09e930 con 0x7fe77c09e1d0 2023-10-03T10:18:59.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.908+0000 7fe77affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe77c09e1d0 0x7fe77c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.908+0000 7fe77b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe77c09d6f0 0x7fe77c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33324/0 (socket says 172.21.15.72:33324) 2023-10-03T10:18:59.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.908+0000 7fe77b7fe700 1 -- 172.21.15.72:0/181261885 learned_addr learned my addr 172.21.15.72:0/181261885 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:59.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.908+0000 7fe77bfff700 1 --2- 172.21.15.72:0/181261885 >> v2:172.21.15.72:3300/0 conn(0x7fe77c135e50 0x7fe77c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.908+0000 7fe77affd700 1 -- 172.21.15.72:0/181261885 >> v2:172.21.15.72:3300/0 conn(0x7fe77c135e50 msgr2=0x7fe77c138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:59.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.908+0000 7fe77affd700 1 --2- 172.21.15.72:0/181261885 >> v2:172.21.15.72:3300/0 conn(0x7fe77c135e50 0x7fe77c138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.908+0000 7fe77affd700 1 -- 172.21.15.72:0/181261885 >> v1:172.21.15.72:6789/0 conn(0x7fe77c09d6f0 legacy=0x7fe77c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.908+0000 7fe77affd700 1 -- 172.21.15.72:0/181261885 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c09b2d0 con 0x7fe77c09e1d0 2023-10-03T10:18:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.908+0000 7fe77affd700 1 --2- 172.21.15.72:0/181261885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe77c09e1d0 0x7fe77c135910 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe77000bb10 tx=0x7fe77000be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a67d90f86186c30 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.909+0000 7fe77a7fc700 1 -- 172.21.15.72:0/181261885 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77000dcf0 con 0x7fe77c09e1d0 2023-10-03T10:18:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.909+0000 7fe77a7fc700 1 -- 172.21.15.72:0/181261885 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77000de50 con 0x7fe77c09e1d0 2023-10-03T10:18:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.909+0000 7fe77a7fc700 1 -- 172.21.15.72:0/181261885 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe770010690 con 0x7fe77c09e1d0 2023-10-03T10:18:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.909+0000 7fe781bf4700 1 -- 172.21.15.72:0/181261885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe77c09e1d0 msgr2=0x7fe77c135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.909+0000 7fe781bf4700 1 --2- 172.21.15.72:0/181261885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe77c09e1d0 0x7fe77c135910 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe77000bb10 tx=0x7fe77000be20 comp rx=0 tx=0).stop 2023-10-03T10:18:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.909+0000 7fe781bf4700 1 -- 172.21.15.72:0/181261885 shutdown_connections 2023-10-03T10:18:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.909+0000 7fe781bf4700 1 --2- 172.21.15.72:0/181261885 >> v2:172.21.15.72:3300/0 conn(0x7fe77c135e50 0x7fe77c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.909+0000 7fe781bf4700 1 --2- 172.21.15.72:0/181261885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe77c09e1d0 0x7fe77c135910 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.909+0000 7fe781bf4700 1 -- 172.21.15.72:0/181261885 >> 172.21.15.72:0/181261885 conn(0x7fe77c066f50 msgr2=0x7fe77c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.909+0000 7fe781bf4700 1 -- 172.21.15.72:0/181261885 shutdown_connections 2023-10-03T10:18:59.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.909+0000 7fe781bf4700 1 -- 172.21.15.72:0/181261885 wait complete. 2023-10-03T10:18:59.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.910+0000 7fe781bf4700 1 Processor -- start 2023-10-03T10:18:59.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.910+0000 7fe781bf4700 1 -- start start 2023-10-03T10:18:59.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.911+0000 7fe781bf4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe77c09d6f0 0x7fe77c1c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.911+0000 7fe781bf4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe77c09e1d0 0x7fe77c1c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.911+0000 7fe781bf4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe77c135e50 0x7fe77c1c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.911+0000 7fe781bf4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c121250 con 0x7fe77c09e1d0 2023-10-03T10:18:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.911+0000 7fe781bf4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0a1e20 con 0x7fe77c135e50 2023-10-03T10:18:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.911+0000 7fe781bf4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c11fb70 con 0x7fe77c09d6f0 2023-10-03T10:18:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.911+0000 7fe77b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe77c09d6f0 0x7fe77c1c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.911+0000 7fe77b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe77c09d6f0 0x7fe77c1c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47914/0 (socket says 172.21.15.72:47914) 2023-10-03T10:18:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.911+0000 7fe77b7fe700 1 -- 172.21.15.72:0/2548644506 learned_addr learned my addr 172.21.15.72:0/2548644506 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.911+0000 7fe77b7fe700 1 -- 172.21.15.72:0/2548644506 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe77c135e50 msgr2=0x7fe77c1c8ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:18:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.911+0000 7fe77b7fe700 1 --2- 172.21.15.72:0/2548644506 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe77c135e50 0x7fe77c1c8ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.911+0000 7fe77b7fe700 1 -- 172.21.15.72:0/2548644506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe77c09e1d0 msgr2=0x7fe77c1c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.911+0000 7fe77b7fe700 1 --2- 172.21.15.72:0/2548644506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe77c09e1d0 0x7fe77c1c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.911+0000 7fe77b7fe700 1 -- 172.21.15.72:0/2548644506 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77000b740 con 0x7fe77c09d6f0 2023-10-03T10:18:59.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.912+0000 7fe77b7fe700 1 --2- 172.21.15.72:0/2548644506 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe77c09d6f0 0x7fe77c1c8460 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00c550 tx=0x7fe76c00c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.912+0000 7f4f7aa4c700 1 Processor -- start 2023-10-03T10:18:59.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.912+0000 7f4f7aa4c700 1 -- start start 2023-10-03T10:18:59.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.912+0000 7fe763fff700 1 -- 172.21.15.72:0/2548644506 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c005d70 con 0x7fe77c09d6f0 2023-10-03T10:18:59.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.912+0000 7fe763fff700 1 -- 172.21.15.72:0/2548644506 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c0070d0 con 0x7fe77c09d6f0 2023-10-03T10:18:59.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.912+0000 7fe763fff700 1 -- 172.21.15.72:0/2548644506 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c007440 con 0x7fe77c09d6f0 2023-10-03T10:18:59.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.912+0000 7fe781bf4700 1 -- 172.21.15.72:0/2548644506 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c11f620 con 0x7fe77c09d6f0 2023-10-03T10:18:59.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.912+0000 7fe781bf4700 1 -- 172.21.15.72:0/2548644506 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c11dfc0 con 0x7fe77c09d6f0 2023-10-03T10:18:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.912+0000 7f4f7aa4c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f741305f0 0x7f4f741309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.912+0000 7f4f7aa4c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f7406f660 0x7f4f7406fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.912+0000 7f4f7aa4c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f741301c0 con 0x7f4f7406ff90 2023-10-03T10:18:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.912+0000 7f4f7aa4c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f74071ff0 con 0x7f4f741305f0 2023-10-03T10:18:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.912+0000 7f4f7aa4c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f74070e70 con 0x7f4f7406f660 2023-10-03T10:18:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.913+0000 7f4f73fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f741305f0 0x7f4f741309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.913+0000 7f4f73fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f741305f0 0x7f4f741309c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40330/0 (socket says 172.21.15.72:40330) 2023-10-03T10:18:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.913+0000 7f4f73fff700 1 -- 172.21.15.72:0/72956821 learned_addr learned my addr 172.21.15.72:0/72956821 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.913+0000 7f4f73fff700 1 -- 172.21.15.72:0/72956821 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f7406f660 msgr2=0x7f4f7406fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:59.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.913+0000 7f4f73fff700 1 --2- 172.21.15.72:0/72956821 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f7406f660 0x7f4f7406fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.913+0000 7f4f73fff700 1 -- 172.21.15.72:0/72956821 >> v1:172.21.15.72:6789/0 conn(0x7f4f7406ff90 legacy=0x7f4f74137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:59.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.913+0000 7f4f73fff700 1 -- 172.21.15.72:0/72956821 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f740722b0 con 0x7f4f741305f0 2023-10-03T10:18:59.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.913+0000 7fe781bf4700 1 -- 172.21.15.72:0/2548644506 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c09ef50 con 0x7fe77c09d6f0 2023-10-03T10:18:59.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.913+0000 7f4f73fff700 1 --2- 172.21.15.72:0/72956821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f741305f0 0x7f4f741309c0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00d150 tx=0x7f4f6c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86488707ee47079 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.913+0000 7f4f72ffd700 1 -- 172.21.15.72:0/72956821 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c010070 con 0x7f4f741305f0 2023-10-03T10:18:59.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.913+0000 7f4f72ffd700 1 -- 172.21.15.72:0/72956821 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6c00ddc0 con 0x7f4f741305f0 2023-10-03T10:18:59.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.913+0000 7f4f72ffd700 1 -- 172.21.15.72:0/72956821 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c00b310 con 0x7f4f741305f0 2023-10-03T10:18:59.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.914+0000 7fe763fff700 1 -- 172.21.15.72:0/2548644506 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe76c0075a0 con 0x7fe77c09d6f0 2023-10-03T10:18:59.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.914+0000 7fe763fff700 1 -- 172.21.15.72:0/2548644506 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe76c03f0e0 con 0x7fe77c09d6f0 2023-10-03T10:18:59.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.914+0000 7f4f7aa4c700 1 -- 172.21.15.72:0/72956821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f741305f0 msgr2=0x7f4f741309c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.914+0000 7f4f7aa4c700 1 --2- 172.21.15.72:0/72956821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f741305f0 0x7f4f741309c0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00d150 tx=0x7f4f6c00d460 comp rx=0 tx=0).stop 2023-10-03T10:18:59.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.914+0000 7f4f7aa4c700 1 -- 172.21.15.72:0/72956821 shutdown_connections 2023-10-03T10:18:59.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.914+0000 7f4f7aa4c700 1 --2- 172.21.15.72:0/72956821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f741305f0 0x7f4f741309c0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.914+0000 7f4f7aa4c700 1 --2- 172.21.15.72:0/72956821 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f7406f660 0x7f4f7406fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.914+0000 7f4f7aa4c700 1 -- 172.21.15.72:0/72956821 >> 172.21.15.72:0/72956821 conn(0x7f4f740a2aa0 msgr2=0x7f4f740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.914+0000 7f4f7aa4c700 1 -- 172.21.15.72:0/72956821 shutdown_connections 2023-10-03T10:18:59.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.915+0000 7f4f7aa4c700 1 -- 172.21.15.72:0/72956821 wait complete. 2023-10-03T10:18:59.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.916+0000 7f4f7aa4c700 1 Processor -- start 2023-10-03T10:18:59.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.916+0000 7f4f7aa4c700 1 -- start start 2023-10-03T10:18:59.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f7aa4c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f7406f660 0x7f4f7411bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f7aa4c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f7406ff90 0x7f4f7411c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f7aa4c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f741305f0 0x7f4f7411c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f7aa4c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7411f050 con 0x7f4f741305f0 2023-10-03T10:18:59.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f7aa4c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f74071820 con 0x7f4f7406f660 2023-10-03T10:18:59.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f7aa4c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7412daa0 con 0x7f4f7406ff90 2023-10-03T10:18:59.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f737fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f7406ff90 0x7f4f7411c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f737fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f7406ff90 0x7f4f7411c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47942/0 (socket says 172.21.15.72:47942) 2023-10-03T10:18:59.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f737fe700 1 -- 172.21.15.72:0/1560833480 learned_addr learned my addr 172.21.15.72:0/1560833480 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:59.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f78fe9700 1 --2- 172.21.15.72:0/1560833480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f741305f0 0x7f4f7411c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f737fe700 1 -- 172.21.15.72:0/1560833480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f7406f660 msgr2=0x7f4f7411bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f737fe700 1 --2- 172.21.15.72:0/1560833480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f7406f660 0x7f4f7411bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f737fe700 1 -- 172.21.15.72:0/1560833480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f741305f0 msgr2=0x7f4f7411c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f737fe700 1 --2- 172.21.15.72:0/1560833480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f741305f0 0x7f4f7411c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f737fe700 1 -- 172.21.15.72:0/1560833480 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c00bd40 con 0x7f4f7406ff90 2023-10-03T10:18:59.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f78fe9700 1 --2- 172.21.15.72:0/1560833480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f741305f0 0x7f4f7411c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.917+0000 7f4f737fe700 1 --2- 172.21.15.72:0/1560833480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f7406ff90 0x7f4f7411c010 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400b530 tx=0x7f4f6400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.922+0000 7f4f70ff9700 1 -- 172.21.15.72:0/1560833480 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64011830 con 0x7f4f7406ff90 2023-10-03T10:18:59.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.922+0000 7f4f70ff9700 1 -- 172.21.15.72:0/1560833480 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f64011990 con 0x7f4f7406ff90 2023-10-03T10:18:59.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.922+0000 7f4f70ff9700 1 -- 172.21.15.72:0/1560833480 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64011d20 con 0x7f4f7406ff90 2023-10-03T10:18:59.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.922+0000 7f4f7aa4c700 1 -- 172.21.15.72:0/1560833480 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7412d5e0 con 0x7f4f7406ff90 2023-10-03T10:18:59.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.922+0000 7fe763fff700 1 -- 172.21.15.72:0/2548644506 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe76c019b40 con 0x7fe77c09d6f0 2023-10-03T10:18:59.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.922+0000 7f4f7aa4c700 1 -- 172.21.15.72:0/1560833480 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7411fd80 con 0x7f4f7406ff90 2023-10-03T10:18:59.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.923+0000 7f4f70ff9700 1 -- 172.21.15.72:0/1560833480 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f6401a400 con 0x7f4f7406ff90 2023-10-03T10:18:59.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.923+0000 7f4f7aa4c700 1 -- 172.21.15.72:0/1560833480 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7412fae0 con 0x7f4f7406ff90 2023-10-03T10:18:59.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.924+0000 7f4f70ff9700 1 -- 172.21.15.72:0/1560833480 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4f6403f720 con 0x7f4f7406ff90 2023-10-03T10:18:59.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.932+0000 7f4f70ff9700 1 -- 172.21.15.72:0/1560833480 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f6400f8d0 con 0x7f4f7406ff90 2023-10-03T10:18:59.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.963+0000 7fa12e787700 1 Processor -- start 2023-10-03T10:18:59.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.963+0000 7fa12e787700 1 -- start start 2023-10-03T10:18:59.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.964+0000 7fa12e787700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa12806f5d0 0x7fa12812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.964+0000 7fa12e787700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa128135c20 0x7fa128138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.964+0000 7fa12e787700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12806fa40 con 0x7fa12812cf60 2023-10-03T10:18:59.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.964+0000 7fa12e787700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12812cd90 con 0x7fa12806f5d0 2023-10-03T10:18:59.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.964+0000 7fa12e787700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa128071780 con 0x7fa128135c20 2023-10-03T10:18:59.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.964+0000 7fa1277fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa12806f5d0 0x7fa12812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.964+0000 7fa127fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa12812cf60 0x7fa12812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33338/0 (socket says 172.21.15.72:33338) 2023-10-03T10:18:59.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.964+0000 7fa127fff700 1 -- 172.21.15.72:0/2717637379 learned_addr learned my addr 172.21.15.72:0/2717637379 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:18:59.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.964+0000 7fa1277fe700 1 -- 172.21.15.72:0/2717637379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa128135c20 msgr2=0x7fa128138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:59.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.964+0000 7fa1277fe700 1 --2- 172.21.15.72:0/2717637379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa128135c20 0x7fa128138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.964+0000 7fa1277fe700 1 -- 172.21.15.72:0/2717637379 >> v1:172.21.15.72:6789/0 conn(0x7fa12812cf60 legacy=0x7fa12812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.964+0000 7fa126ffd700 1 -- 172.21.15.72:0/2717637379 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909936477 0 0) 0x7fa12806fa40 con 0x7fa12812cf60 2023-10-03T10:18:59.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.964+0000 7fa1277fe700 1 -- 172.21.15.72:0/2717637379 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa128071a40 con 0x7fa12806f5d0 2023-10-03T10:18:59.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.965+0000 7fa1277fe700 1 --2- 172.21.15.72:0/2717637379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa12806f5d0 0x7fa12812ffc0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00a9e0 tx=0x7fa11c00acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401885bb1386a166 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.965+0000 7fa126ffd700 1 -- 172.21.15.72:0/2717637379 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c00cb70 con 0x7fa12806f5d0 2023-10-03T10:18:59.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.965+0000 7fa126ffd700 1 -- 172.21.15.72:0/2717637379 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c00ccd0 con 0x7fa12806f5d0 2023-10-03T10:18:59.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.965+0000 7fa126ffd700 1 -- 172.21.15.72:0/2717637379 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c00f690 con 0x7fa12806f5d0 2023-10-03T10:18:59.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.966+0000 7fa12e787700 1 -- 172.21.15.72:0/2717637379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa12806f5d0 msgr2=0x7fa12812ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.966+0000 7fa12e787700 1 --2- 172.21.15.72:0/2717637379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa12806f5d0 0x7fa12812ffc0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00a9e0 tx=0x7fa11c00acf0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.966+0000 7fa12e787700 1 -- 172.21.15.72:0/2717637379 shutdown_connections 2023-10-03T10:18:59.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.966+0000 7fa12e787700 1 --2- 172.21.15.72:0/2717637379 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa128135c20 0x7fa128138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.966+0000 7fa12e787700 1 --2- 172.21.15.72:0/2717637379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa12806f5d0 0x7fa12812ffc0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.966+0000 7fa12e787700 1 -- 172.21.15.72:0/2717637379 >> 172.21.15.72:0/2717637379 conn(0x7fa1280a2aa0 msgr2=0x7fa1280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.966+0000 7fa12e787700 1 -- 172.21.15.72:0/2717637379 shutdown_connections 2023-10-03T10:18:59.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.966+0000 7fa12e787700 1 -- 172.21.15.72:0/2717637379 wait complete. 2023-10-03T10:18:59.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.967+0000 7fa12e787700 1 Processor -- start 2023-10-03T10:18:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.967+0000 7fa12e787700 1 -- start start 2023-10-03T10:18:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.968+0000 7fa12e787700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa12806f5d0 0x7fa12809a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.968+0000 7fa12e787700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa12812cf60 0x7fa12809a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.968+0000 7fa12e787700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa128135c20 0x7fa1281c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.968+0000 7fa12e787700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa128129fa0 con 0x7fa12806f5d0 2023-10-03T10:18:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.968+0000 7fa12e787700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa128099ed0 con 0x7fa12812cf60 2023-10-03T10:18:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.968+0000 7fa12e787700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa12809c660 con 0x7fa128135c20 2023-10-03T10:18:59.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.968+0000 7fa127fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa12806f5d0 0x7fa12809a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.968+0000 7fa12cd24700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa128135c20 0x7fa1281c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.968+0000 7fa127fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa12806f5d0 0x7fa12809a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40360/0 (socket says 172.21.15.72:40360) 2023-10-03T10:18:59.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.968+0000 7fa127fff700 1 -- 172.21.15.72:0/3988628717 learned_addr learned my addr 172.21.15.72:0/3988628717 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:18:59.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.968+0000 7fa12cd24700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa128135c20 0x7fa1281c3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47956/0 (socket says 172.21.15.72:47956) 2023-10-03T10:18:59.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.969+0000 7fa12cd24700 1 -- 172.21.15.72:0/3988628717 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa12812cf60 msgr2=0x7fa12809a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.969+0000 7fa12cd24700 1 --2- 172.21.15.72:0/3988628717 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa12812cf60 0x7fa12809a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.969+0000 7fa12cd24700 1 -- 172.21.15.72:0/3988628717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa12806f5d0 msgr2=0x7fa12809a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.969+0000 7fa12cd24700 1 --2- 172.21.15.72:0/3988628717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa12806f5d0 0x7fa12809a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.969+0000 7fa12cd24700 1 -- 172.21.15.72:0/3988628717 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c00a640 con 0x7fa128135c20 2023-10-03T10:18:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.969+0000 7fa12cd24700 1 --2- 172.21.15.72:0/3988628717 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa128135c20 0x7fa1281c3e70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa12000bdf0 tx=0x7fa120009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.969+0000 7fa124ff9700 1 -- 172.21.15.72:0/3988628717 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12000cc10 con 0x7fa128135c20 2023-10-03T10:18:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.969+0000 7fa124ff9700 1 -- 172.21.15.72:0/3988628717 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12000cd90 con 0x7fa128135c20 2023-10-03T10:18:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.969+0000 7fa12e787700 1 -- 172.21.15.72:0/3988628717 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12809b960 con 0x7fa128135c20 2023-10-03T10:18:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.969+0000 7fa124ff9700 1 -- 172.21.15.72:0/3988628717 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120014680 con 0x7fa128135c20 2023-10-03T10:18:59.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.969+0000 7fa12e787700 1 -- 172.21.15.72:0/3988628717 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12809cc00 con 0x7fa128135c20 2023-10-03T10:18:59.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.970+0000 7fa124ff9700 1 -- 172.21.15.72:0/3988628717 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa12001d3b0 con 0x7fa128135c20 2023-10-03T10:18:59.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.972+0000 7fa124ff9700 1 -- 172.21.15.72:0/3988628717 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa120006e40 con 0x7fa128135c20 2023-10-03T10:18:59.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.972+0000 7fa12e787700 1 -- 172.21.15.72:0/3988628717 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa128074ea0 con 0x7fa128135c20 2023-10-03T10:18:59.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:18:59.981+0000 7fa124ff9700 1 -- 172.21.15.72:0/3988628717 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa120019020 con 0x7fa128135c20 2023-10-03T10:19:00.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.001+0000 7f40d64fd700 1 -- 172.21.15.72:0/1009755013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f40d0074ea0 con 0x7f40d009d6f0 2023-10-03T10:19:00.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.001+0000 7f40ccff9700 1 -- 172.21.15.72:0/1009755013 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40c4029020 con 0x7f40d009d6f0 2023-10-03T10:19:00.002 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:00.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.003+0000 7f40d64fd700 1 -- 172.21.15.72:0/1009755013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009d6f0 msgr2=0x7f40d01c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.003+0000 7f40d64fd700 1 --2- 172.21.15.72:0/1009755013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009d6f0 0x7f40d01c81c0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f40c4000c00 tx=0x7f40c4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:00.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.004+0000 7f40d64fd700 1 -- 172.21.15.72:0/1009755013 shutdown_connections 2023-10-03T10:19:00.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.004+0000 7f40d64fd700 1 --2- 172.21.15.72:0/1009755013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40d009d6f0 0x7f40d01c81c0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.004+0000 7f40d64fd700 1 --2- 172.21.15.72:0/1009755013 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f40d009e410 0x7f40d01c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.004+0000 7f40d64fd700 1 --2- 172.21.15.72:0/1009755013 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40d009e000 0x7f40d01c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.004+0000 7f40d64fd700 1 -- 172.21.15.72:0/1009755013 >> 172.21.15.72:0/1009755013 conn(0x7f40d0066f50 msgr2=0x7f40d01bba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.004+0000 7f40d64fd700 1 -- 172.21.15.72:0/1009755013 shutdown_connections 2023-10-03T10:19:00.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.004+0000 7f40d64fd700 1 -- 172.21.15.72:0/1009755013 wait complete. 2023-10-03T10:19:00.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:00.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.125+0000 7fe781bf4700 1 -- 172.21.15.72:0/2548644506 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe77c121390 con 0x7fe77c09d6f0 2023-10-03T10:19:00.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.125+0000 7fe763fff700 1 -- 172.21.15.72:0/2548644506 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fe77c121390 con 0x7fe77c09d6f0 2023-10-03T10:19:00.126 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:00.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.127+0000 7fe781bf4700 1 -- 172.21.15.72:0/2548644506 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe77c09d6f0 msgr2=0x7fe77c1c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.127+0000 7fe781bf4700 1 --2- 172.21.15.72:0/2548644506 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe77c09d6f0 0x7fe77c1c8460 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00c550 tx=0x7fe76c00c910 comp rx=0 tx=0).stop 2023-10-03T10:19:00.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.127+0000 7fe781bf4700 1 -- 172.21.15.72:0/2548644506 shutdown_connections 2023-10-03T10:19:00.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.127+0000 7fe781bf4700 1 --2- 172.21.15.72:0/2548644506 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe77c135e50 0x7fe77c1c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.127+0000 7fe781bf4700 1 --2- 172.21.15.72:0/2548644506 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fe77c09d6f0 0x7fe77c1c8460 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.127+0000 7fe781bf4700 1 --2- 172.21.15.72:0/2548644506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe77c09e1d0 0x7fe77c1c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.127+0000 7fe781bf4700 1 -- 172.21.15.72:0/2548644506 >> 172.21.15.72:0/2548644506 conn(0x7fe77c066f50 msgr2=0x7fe77c06f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.127+0000 7fe781bf4700 1 -- 172.21.15.72:0/2548644506 shutdown_connections 2023-10-03T10:19:00.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.127+0000 7fe781bf4700 1 -- 172.21.15.72:0/2548644506 wait complete. 2023-10-03T10:19:00.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:00.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.165+0000 7f4f7aa4c700 1 -- 172.21.15.72:0/1560833480 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4f74074ea0 con 0x7f4f7406ff90 2023-10-03T10:19:00.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.166+0000 7f4f70ff9700 1 -- 172.21.15.72:0/1560833480 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f64015070 con 0x7f4f7406ff90 2023-10-03T10:19:00.166 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:00.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.167+0000 7f4f7aa4c700 1 -- 172.21.15.72:0/1560833480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f7406ff90 msgr2=0x7f4f7411c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.167+0000 7f4f7aa4c700 1 --2- 172.21.15.72:0/1560833480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f7406ff90 0x7f4f7411c010 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400b530 tx=0x7f4f6400b840 comp rx=0 tx=0).stop 2023-10-03T10:19:00.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.167+0000 7f4f7aa4c700 1 -- 172.21.15.72:0/1560833480 shutdown_connections 2023-10-03T10:19:00.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.168+0000 7f4f7aa4c700 1 --2- 172.21.15.72:0/1560833480 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f741305f0 0x7f4f7411c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.168+0000 7f4f7aa4c700 1 --2- 172.21.15.72:0/1560833480 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4f7406f660 0x7f4f7411bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.168+0000 7f4f7aa4c700 1 --2- 172.21.15.72:0/1560833480 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4f7406ff90 0x7f4f7411c010 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.168+0000 7f4f7aa4c700 1 -- 172.21.15.72:0/1560833480 >> 172.21.15.72:0/1560833480 conn(0x7f4f740a2aa0 msgr2=0x7f4f7406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.168+0000 7f4f7aa4c700 1 -- 172.21.15.72:0/1560833480 shutdown_connections 2023-10-03T10:19:00.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.168+0000 7f4f7aa4c700 1 -- 172.21.15.72:0/1560833480 wait complete. 2023-10-03T10:19:00.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:00.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.210+0000 7fa12e787700 1 -- 172.21.15.72:0/3988628717 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa1280713a0 con 0x7fa128135c20 2023-10-03T10:19:00.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.210+0000 7fa124ff9700 1 -- 172.21.15.72:0/3988628717 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa120045060 con 0x7fa128135c20 2023-10-03T10:19:00.210 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:00.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.211+0000 7fa12e787700 1 -- 172.21.15.72:0/3988628717 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa128135c20 msgr2=0x7fa1281c3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.211+0000 7fa12e787700 1 --2- 172.21.15.72:0/3988628717 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa128135c20 0x7fa1281c3e70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa12000bdf0 tx=0x7fa120009ed0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.211+0000 7fa12e787700 1 -- 172.21.15.72:0/3988628717 shutdown_connections 2023-10-03T10:19:00.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.211+0000 7fa12e787700 1 --2- 172.21.15.72:0/3988628717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa12806f5d0 0x7fa12809a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.211+0000 7fa12e787700 1 --2- 172.21.15.72:0/3988628717 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa128135c20 0x7fa1281c3e70 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.211+0000 7fa12e787700 1 --2- 172.21.15.72:0/3988628717 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa12812cf60 0x7fa12809a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.211+0000 7fa12e787700 1 -- 172.21.15.72:0/3988628717 >> 172.21.15.72:0/3988628717 conn(0x7fa1280a2aa0 msgr2=0x7fa1280a17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.211+0000 7fa12e787700 1 -- 172.21.15.72:0/3988628717 shutdown_connections 2023-10-03T10:19:00.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:00.211+0000 7fa12e787700 1 -- 172.21.15.72:0/3988628717 wait complete. 2023-10-03T10:19:00.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:01.018 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:01.140 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:01.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.154+0000 7f9f0aca8700 1 Processor -- start 2023-10-03T10:19:01.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.154+0000 7f9f0aca8700 1 -- start start 2023-10-03T10:19:01.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.155+0000 7f9f0aca8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f041316c0 0x7f9f04131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.155+0000 7f9f0aca8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f0406ae80 0x7f9f04139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.155+0000 7f9f0aca8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0409e130 con 0x7f9f0409d9f0 2023-10-03T10:19:01.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.155+0000 7f9f0aca8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f041312b0 con 0x7f9f0406ae80 2023-10-03T10:19:01.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.155+0000 7f9f0aca8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0409f6e0 con 0x7f9f041316c0 2023-10-03T10:19:01.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.155+0000 7f9f09245700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f0406ae80 0x7f9f04139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.155+0000 7f9f08a44700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f041316c0 0x7f9f04131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.155+0000 7f9f08a44700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f041316c0 0x7f9f04131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47964/0 (socket says 172.21.15.72:47964) 2023-10-03T10:19:01.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.155+0000 7f9f08a44700 1 -- 172.21.15.72:0/3164098155 learned_addr learned my addr 172.21.15.72:0/3164098155 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:01.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.155+0000 7f9f09245700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9f0406ae80 0x7f9f04139550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40370/0 (socket says 172.21.15.72:40370) 2023-10-03T10:19:01.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.156+0000 7f9f08a44700 1 -- 172.21.15.72:0/3164098155 >> v2:172.21.15.72:3300/0 conn(0x7f9f0406ae80 msgr2=0x7f9f04139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.156+0000 7f9f08a44700 1 --2- 172.21.15.72:0/3164098155 >> v2:172.21.15.72:3300/0 conn(0x7f9f0406ae80 0x7f9f04139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.156+0000 7f9f08a44700 1 -- 172.21.15.72:0/3164098155 >> v1:172.21.15.72:6789/0 conn(0x7f9f0409d9f0 legacy=0x7f9f0406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.156+0000 7f9f08a44700 1 -- 172.21.15.72:0/3164098155 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0409e760 con 0x7f9f041316c0 2023-10-03T10:19:01.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.156+0000 7f9f09245700 1 --2- 172.21.15.72:0/3164098155 >> v2:172.21.15.72:3300/0 conn(0x7f9f0406ae80 0x7f9f04139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.156+0000 7f9f08a44700 1 --2- 172.21.15.72:0/3164098155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f041316c0 0x7f9f04131a90 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0098f0 tx=0x7f9efc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb071ca413b9f69f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.156+0000 7f9f037fe700 1 -- 172.21.15.72:0/3164098155 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc011830 con 0x7f9f041316c0 2023-10-03T10:19:01.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.156+0000 7f9f037fe700 1 -- 172.21.15.72:0/3164098155 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc011990 con 0x7f9f041316c0 2023-10-03T10:19:01.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.156+0000 7f9f037fe700 1 -- 172.21.15.72:0/3164098155 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc011d20 con 0x7f9f041316c0 2023-10-03T10:19:01.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.157+0000 7f9f0aca8700 1 -- 172.21.15.72:0/3164098155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f041316c0 msgr2=0x7f9f04131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.157+0000 7f9f0aca8700 1 --2- 172.21.15.72:0/3164098155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f041316c0 0x7f9f04131a90 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0098f0 tx=0x7f9efc009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:01.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.157+0000 7f9f0aca8700 1 -- 172.21.15.72:0/3164098155 shutdown_connections 2023-10-03T10:19:01.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.157+0000 7f9f0aca8700 1 --2- 172.21.15.72:0/3164098155 >> v2:172.21.15.72:3300/0 conn(0x7f9f0406ae80 0x7f9f04139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.157+0000 7f9f0aca8700 1 --2- 172.21.15.72:0/3164098155 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f041316c0 0x7f9f04131a90 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.157+0000 7f9f0aca8700 1 -- 172.21.15.72:0/3164098155 >> 172.21.15.72:0/3164098155 conn(0x7f9f04066f50 msgr2=0x7f9f0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.157+0000 7f9f0aca8700 1 -- 172.21.15.72:0/3164098155 shutdown_connections 2023-10-03T10:19:01.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.157+0000 7f9f0aca8700 1 -- 172.21.15.72:0/3164098155 wait complete. 2023-10-03T10:19:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.158+0000 7f9f0aca8700 1 Processor -- start 2023-10-03T10:19:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.158+0000 7f9f0aca8700 1 -- start start 2023-10-03T10:19:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.158+0000 7f9f0aca8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f0406ae80 0x7f9f04070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.158+0000 7f9f0aca8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f0409d9f0 0x7f9f04071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.158+0000 7f9f0aca8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f041316c0 0x7f9f04071590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.158+0000 7f9f0aca8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0411d9a0 con 0x7f9f041316c0 2023-10-03T10:19:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.158+0000 7f9f0aca8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0412b900 con 0x7f9f0406ae80 2023-10-03T10:19:01.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.158+0000 7f9f0aca8700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0409b840 con 0x7f9f0409d9f0 2023-10-03T10:19:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f03fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f0409d9f0 0x7f9f04071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f09245700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f041316c0 0x7f9f04071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f03fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f0409d9f0 0x7f9f04071050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47976/0 (socket says 172.21.15.72:47976) 2023-10-03T10:19:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f03fff700 1 -- 172.21.15.72:0/1714167229 learned_addr learned my addr 172.21.15.72:0/1714167229 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f08a44700 1 --2- 172.21.15.72:0/1714167229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f0406ae80 0x7f9f04070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f03fff700 1 -- 172.21.15.72:0/1714167229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f0406ae80 msgr2=0x7f9f04070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f03fff700 1 --2- 172.21.15.72:0/1714167229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f0406ae80 0x7f9f04070b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f03fff700 1 -- 172.21.15.72:0/1714167229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f041316c0 msgr2=0x7f9f04071590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f03fff700 1 --2- 172.21.15.72:0/1714167229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f041316c0 0x7f9f04071590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f03fff700 1 -- 172.21.15.72:0/1714167229 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef4009a70 con 0x7f9f0409d9f0 2023-10-03T10:19:01.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f08a44700 1 --2- 172.21.15.72:0/1714167229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f0406ae80 0x7f9f04070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f09245700 1 --2- 172.21.15.72:0/1714167229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f041316c0 0x7f9f04071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f03fff700 1 --2- 172.21.15.72:0/1714167229 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f0409d9f0 0x7f9f04071050 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800c450 tx=0x7f9ef800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f017fa700 1 -- 172.21.15.72:0/1714167229 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef80052d0 con 0x7f9f0409d9f0 2023-10-03T10:19:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f017fa700 1 -- 172.21.15.72:0/1714167229 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef8005430 con 0x7f9f0409d9f0 2023-10-03T10:19:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f0aca8700 1 -- 172.21.15.72:0/1714167229 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9efc009550 con 0x7f9f0409d9f0 2023-10-03T10:19:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f017fa700 1 -- 172.21.15.72:0/1714167229 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef80038c0 con 0x7f9f0409d9f0 2023-10-03T10:19:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.159+0000 7f9f0aca8700 1 -- 172.21.15.72:0/1714167229 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0409c2e0 con 0x7f9f0409d9f0 2023-10-03T10:19:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.160+0000 7f9f017fa700 1 -- 172.21.15.72:0/1714167229 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ef8003a20 con 0x7f9f0409d9f0 2023-10-03T10:19:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.160+0000 7f9f0aca8700 1 -- 172.21.15.72:0/1714167229 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0409e130 con 0x7f9f0409d9f0 2023-10-03T10:19:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.160+0000 7f9f017fa700 1 -- 172.21.15.72:0/1714167229 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9ef803e970 con 0x7f9f0409d9f0 2023-10-03T10:19:01.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.165+0000 7f9f017fa700 1 -- 172.21.15.72:0/1714167229 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f0409e130 con 0x7f9f0409d9f0 2023-10-03T10:19:01.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:01.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.270+0000 7f8938d44700 1 Processor -- start 2023-10-03T10:19:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.270+0000 7f8938d44700 1 -- start start 2023-10-03T10:19:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.270+0000 7f8938d44700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f893409d6f0 0x7f893409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.270+0000 7f8938d44700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f893409e410 0x7f8934134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.270+0000 7f8938d44700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893409b120 con 0x7f893409e000 2023-10-03T10:19:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.270+0000 7f8938d44700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893406b460 con 0x7f893409e410 2023-10-03T10:19:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.271+0000 7f8938d44700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f893409a7e0 con 0x7f893409d6f0 2023-10-03T10:19:01.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.271+0000 7f8931d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f893409e000 0x7f89341339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33356/0 (socket says 172.21.15.72:33356) 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.271+0000 7f8931d9b700 1 -- 172.21.15.72:0/3344957785 learned_addr learned my addr 172.21.15.72:0/3344957785 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.271+0000 7f8932d9d700 1 --2- 172.21.15.72:0/3344957785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f893409e410 0x7f8934134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.271+0000 7f893259c700 1 --2- 172.21.15.72:0/3344957785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f893409d6f0 0x7f893409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.271+0000 7f8932d9d700 1 -- 172.21.15.72:0/3344957785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f893409d6f0 msgr2=0x7f893409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.271+0000 7f8932d9d700 1 --2- 172.21.15.72:0/3344957785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f893409d6f0 0x7f893409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.271+0000 7f893159a700 1 -- 172.21.15.72:0/3344957785 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880915957 0 0) 0x7f893409b120 con 0x7f893409e000 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.271+0000 7f8932d9d700 1 -- 172.21.15.72:0/3344957785 >> v1:172.21.15.72:6789/0 conn(0x7f893409e000 legacy=0x7f89341339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.271+0000 7f8932d9d700 1 -- 172.21.15.72:0/3344957785 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893409a500 con 0x7f893409e410 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.271+0000 7f893259c700 1 --2- 172.21.15.72:0/3344957785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f893409d6f0 0x7f893409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.271+0000 7f8932d9d700 1 --2- 172.21.15.72:0/3344957785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f893409e410 0x7f8934134100 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f892c009dc0 tx=0x7f892c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a78d64d2497953c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.272+0000 7f893159a700 1 -- 172.21.15.72:0/3344957785 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c00e070 con 0x7f893409e410 2023-10-03T10:19:01.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.272+0000 7f893159a700 1 -- 172.21.15.72:0/3344957785 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c00bb20 con 0x7f893409e410 2023-10-03T10:19:01.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.272+0000 7f893159a700 1 -- 172.21.15.72:0/3344957785 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c012430 con 0x7f893409e410 2023-10-03T10:19:01.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.272+0000 7f8938d44700 1 -- 172.21.15.72:0/3344957785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f893409e410 msgr2=0x7f8934134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.272+0000 7f8938d44700 1 --2- 172.21.15.72:0/3344957785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f893409e410 0x7f8934134100 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f892c009dc0 tx=0x7f892c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.272+0000 7f8938d44700 1 -- 172.21.15.72:0/3344957785 shutdown_connections 2023-10-03T10:19:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.272+0000 7f8938d44700 1 --2- 172.21.15.72:0/3344957785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f893409e410 0x7f8934134100 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.272+0000 7f8938d44700 1 --2- 172.21.15.72:0/3344957785 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f893409d6f0 0x7f893409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.273+0000 7f8938d44700 1 -- 172.21.15.72:0/3344957785 >> 172.21.15.72:0/3344957785 conn(0x7f8934066f50 msgr2=0x7f893409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.273+0000 7f8938d44700 1 -- 172.21.15.72:0/3344957785 shutdown_connections 2023-10-03T10:19:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.273+0000 7f8938d44700 1 -- 172.21.15.72:0/3344957785 wait complete. 2023-10-03T10:19:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.274+0000 7f8938d44700 1 Processor -- start 2023-10-03T10:19:01.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.274+0000 7f8938d44700 1 -- start start 2023-10-03T10:19:01.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f8938d44700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f893409d6f0 0x7f89341c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f8938d44700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f893409e000 0x7f89341c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f8938d44700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f893409e410 0x7f89341c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f8938d44700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89341a6f20 con 0x7f893409e000 2023-10-03T10:19:01.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f8938d44700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89340a1d00 con 0x7f893409e410 2023-10-03T10:19:01.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f8938d44700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89341a6350 con 0x7f893409d6f0 2023-10-03T10:19:01.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f893259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f893409d6f0 0x7f89341c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f893259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f893409d6f0 0x7f89341c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:47994/0 (socket says 172.21.15.72:47994) 2023-10-03T10:19:01.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f893259c700 1 -- 172.21.15.72:0/3814955266 learned_addr learned my addr 172.21.15.72:0/3814955266 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:01.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f8931d9b700 1 --2- 172.21.15.72:0/3814955266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f893409e000 0x7f89341c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f8932d9d700 1 --2- 172.21.15.72:0/3814955266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f893409e410 0x7f89341c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f893259c700 1 -- 172.21.15.72:0/3814955266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f893409e410 msgr2=0x7f89341c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f893259c700 1 --2- 172.21.15.72:0/3814955266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f893409e410 0x7f89341c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f893259c700 1 -- 172.21.15.72:0/3814955266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f893409e000 msgr2=0x7f89341c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f893259c700 1 --2- 172.21.15.72:0/3814955266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f893409e000 0x7f89341c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.275+0000 7f893259c700 1 -- 172.21.15.72:0/3814955266 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89240094a0 con 0x7f893409d6f0 2023-10-03T10:19:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.276+0000 7f8931d9b700 1 --2- 172.21.15.72:0/3814955266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f893409e000 0x7f89341c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.276+0000 7f893259c700 1 --2- 172.21.15.72:0/3814955266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f893409d6f0 0x7f89341c7f40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f892400ebe0 tx=0x7f892400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.276+0000 7f8922ffd700 1 -- 172.21.15.72:0/3814955266 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924009800 con 0x7f893409d6f0 2023-10-03T10:19:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.276+0000 7f8922ffd700 1 -- 172.21.15.72:0/3814955266 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892400c910 con 0x7f893409d6f0 2023-10-03T10:19:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.276+0000 7f8922ffd700 1 -- 172.21.15.72:0/3814955266 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892400cc80 con 0x7f893409d6f0 2023-10-03T10:19:01.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.276+0000 7f8938d44700 1 -- 172.21.15.72:0/3814955266 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f892c009a70 con 0x7f893409d6f0 2023-10-03T10:19:01.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.276+0000 7f8938d44700 1 -- 172.21.15.72:0/3814955266 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89341a6a30 con 0x7f893409d6f0 2023-10-03T10:19:01.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.277+0000 7f8938d44700 1 -- 172.21.15.72:0/3814955266 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8934074ea0 con 0x7f893409d6f0 2023-10-03T10:19:01.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.277+0000 7f8922ffd700 1 -- 172.21.15.72:0/3814955266 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8924013470 con 0x7f893409d6f0 2023-10-03T10:19:01.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.280+0000 7f8922ffd700 1 -- 172.21.15.72:0/3814955266 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f89240123d0 con 0x7f893409d6f0 2023-10-03T10:19:01.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.282+0000 7f8922ffd700 1 -- 172.21.15.72:0/3814955266 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8924013720 con 0x7f893409d6f0 2023-10-03T10:19:01.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.323+0000 7f8ad00a3700 1 Processor -- start 2023-10-03T10:19:01.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.323+0000 7f8ad00a3700 1 -- start start 2023-10-03T10:19:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.324+0000 7f8ad00a3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ac809d6f0 0x7f8ac809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.324+0000 7f8ad00a3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ac809e000 0x7f8ac81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.324+0000 7f8ad00a3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac809b120 con 0x7f8ac809e410 2023-10-03T10:19:01.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.324+0000 7f8ad00a3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac806b460 con 0x7f8ac809e000 2023-10-03T10:19:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.324+0000 7f8ad00a3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac809a7e0 con 0x7f8ac809d6f0 2023-10-03T10:19:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.324+0000 7f8acde3f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ac809d6f0 0x7f8ac809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.324+0000 7f8acd63e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8ac809e000 0x7f8ac81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.324+0000 7f8acde3f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ac809d6f0 0x7f8ac809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42592/0 (socket says 172.21.15.72:42592) 2023-10-03T10:19:01.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.324+0000 7f8acde3f700 1 -- 172.21.15.72:0/1442316783 learned_addr learned my addr 172.21.15.72:0/1442316783 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.324+0000 7f8acde3f700 1 -- 172.21.15.72:0/1442316783 >> v2:172.21.15.72:3300/0 conn(0x7f8ac809e000 msgr2=0x7f8ac81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.324+0000 7f8acde3f700 1 --2- 172.21.15.72:0/1442316783 >> v2:172.21.15.72:3300/0 conn(0x7f8ac809e000 0x7f8ac81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.324+0000 7f8acde3f700 1 -- 172.21.15.72:0/1442316783 >> v1:172.21.15.72:6789/0 conn(0x7f8ac809e410 legacy=0x7f8ac8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.324+0000 7f8acde3f700 1 -- 172.21.15.72:0/1442316783 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac809a500 con 0x7f8ac809d6f0 2023-10-03T10:19:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.324+0000 7f8acde3f700 1 --2- 172.21.15.72:0/1442316783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ac809d6f0 0x7f8ac809dac0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009920 tx=0x7f8ac4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb10527d6cf1e471 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.325+0000 7f8acce3d700 1 -- 172.21.15.72:0/1442316783 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4011830 con 0x7f8ac809d6f0 2023-10-03T10:19:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.325+0000 7f8acce3d700 1 -- 172.21.15.72:0/1442316783 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac4011990 con 0x7f8ac809d6f0 2023-10-03T10:19:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.325+0000 7f8acce3d700 1 -- 172.21.15.72:0/1442316783 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4011d20 con 0x7f8ac809d6f0 2023-10-03T10:19:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.325+0000 7f8ad00a3700 1 -- 172.21.15.72:0/1442316783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ac809d6f0 msgr2=0x7f8ac809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.325+0000 7f8ad00a3700 1 --2- 172.21.15.72:0/1442316783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ac809d6f0 0x7f8ac809dac0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009920 tx=0x7f8ac4009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.325+0000 7f8ad00a3700 1 -- 172.21.15.72:0/1442316783 shutdown_connections 2023-10-03T10:19:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.325+0000 7f8ad00a3700 1 --2- 172.21.15.72:0/1442316783 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ac809d6f0 0x7f8ac809dac0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.325+0000 7f8ad00a3700 1 --2- 172.21.15.72:0/1442316783 >> v2:172.21.15.72:3300/0 conn(0x7f8ac809e000 0x7f8ac81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.325+0000 7f8ad00a3700 1 -- 172.21.15.72:0/1442316783 >> 172.21.15.72:0/1442316783 conn(0x7f8ac8066f50 msgr2=0x7f8ac809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.325+0000 7f8ad00a3700 1 -- 172.21.15.72:0/1442316783 shutdown_connections 2023-10-03T10:19:01.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.325+0000 7f8ad00a3700 1 -- 172.21.15.72:0/1442316783 wait complete. 2023-10-03T10:19:01.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.326+0000 7f8ad00a3700 1 Processor -- start 2023-10-03T10:19:01.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.326+0000 7f8ad00a3700 1 -- start start 2023-10-03T10:19:01.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8ad00a3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ac809d6f0 0x7f8ac81a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8ad00a3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ac809e000 0x7f8ac81a6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8ad00a3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ac809e410 0x7f8ac81a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8ad00a3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac81a74a0 con 0x7f8ac809e000 2023-10-03T10:19:01.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8ad00a3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac81a7b60 con 0x7f8ac809d6f0 2023-10-03T10:19:01.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8ad00a3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac81a8180 con 0x7f8ac809e410 2023-10-03T10:19:01.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8ace640700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ac809e410 0x7f8ac81a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8ace640700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ac809e410 0x7f8ac81a6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48006/0 (socket says 172.21.15.72:48006) 2023-10-03T10:19:01.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8ace640700 1 -- 172.21.15.72:0/2034835930 learned_addr learned my addr 172.21.15.72:0/2034835930 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:01.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8acde3f700 1 --2- 172.21.15.72:0/2034835930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ac809d6f0 0x7f8ac81a5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8acd63e700 1 --2- 172.21.15.72:0/2034835930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ac809e000 0x7f8ac81a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8ace640700 1 -- 172.21.15.72:0/2034835930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ac809d6f0 msgr2=0x7f8ac81a5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8ace640700 1 --2- 172.21.15.72:0/2034835930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ac809d6f0 0x7f8ac81a5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8ace640700 1 -- 172.21.15.72:0/2034835930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ac809e000 msgr2=0x7f8ac81a6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8ace640700 1 --2- 172.21.15.72:0/2034835930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ac809e000 0x7f8ac81a6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.327+0000 7f8ace640700 1 -- 172.21.15.72:0/2034835930 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac4009550 con 0x7f8ac809e410 2023-10-03T10:19:01.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.328+0000 7f8ace640700 1 --2- 172.21.15.72:0/2034835930 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ac809e410 0x7f8ac81a6a70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000cc80 tx=0x7f8ac000cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.328+0000 7f8abe7fc700 1 -- 172.21.15.72:0/2034835930 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0003c00 con 0x7f8ac809e410 2023-10-03T10:19:01.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.328+0000 7f8abe7fc700 1 -- 172.21.15.72:0/2034835930 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac0003d60 con 0x7f8ac809e410 2023-10-03T10:19:01.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.328+0000 7f8abe7fc700 1 -- 172.21.15.72:0/2034835930 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac000ab50 con 0x7f8ac809e410 2023-10-03T10:19:01.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.328+0000 7f8ad00a3700 1 -- 172.21.15.72:0/2034835930 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac81a9790 con 0x7f8ac809e410 2023-10-03T10:19:01.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.328+0000 7f8ad00a3700 1 -- 172.21.15.72:0/2034835930 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac80a32a0 con 0x7f8ac809e410 2023-10-03T10:19:01.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.329+0000 7f8abe7fc700 1 -- 172.21.15.72:0/2034835930 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ac000acb0 con 0x7f8ac809e410 2023-10-03T10:19:01.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.329+0000 7f8ad00a3700 1 -- 172.21.15.72:0/2034835930 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac809c710 con 0x7f8ac809e410 2023-10-03T10:19:01.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.330+0000 7f8abe7fc700 1 -- 172.21.15.72:0/2034835930 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8ac003f750 con 0x7f8ac809e410 2023-10-03T10:19:01.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.338+0000 7f8abe7fc700 1 -- 172.21.15.72:0/2034835930 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ac0012420 con 0x7f8ac809e410 2023-10-03T10:19:01.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.374+0000 7fc76c28c700 1 Processor -- start 2023-10-03T10:19:01.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.374+0000 7fc76c28c700 1 -- start start 2023-10-03T10:19:01.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.375+0000 7fc76c28c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc764130540 0x7fc764130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.375+0000 7fc76c28c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc764130e50 0x7fc76406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.375+0000 7fc76c28c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc76406fb20 0x7fc76406ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.375+0000 7fc76c28c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76409a390 con 0x7fc76406fb20 2023-10-03T10:19:01.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.375+0000 7fc76c28c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640716a0 con 0x7fc764130540 2023-10-03T10:19:01.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.375+0000 7fc76c28c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc764071290 con 0x7fc764130e50 2023-10-03T10:19:01.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.375+0000 7fc769827700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc764130e50 0x7fc76406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.375+0000 7fc769827700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc764130e50 0x7fc76406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48012/0 (socket says 172.21.15.72:48012) 2023-10-03T10:19:01.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.375+0000 7fc769827700 1 -- 172.21.15.72:0/2048062326 learned_addr learned my addr 172.21.15.72:0/2048062326 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:01.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.375+0000 7fc76a829700 1 --2- 172.21.15.72:0/2048062326 >> v2:172.21.15.72:3300/0 conn(0x7fc76406fb20 0x7fc76406ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.375+0000 7fc76a028700 1 --2- 172.21.15.72:0/2048062326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc764130540 0x7fc764130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.376+0000 7fc769827700 1 -- 172.21.15.72:0/2048062326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc764130540 msgr2=0x7fc764130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.376+0000 7fc769827700 1 --2- 172.21.15.72:0/2048062326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc764130540 0x7fc764130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.376+0000 7fc769827700 1 -- 172.21.15.72:0/2048062326 >> v2:172.21.15.72:3300/0 conn(0x7fc76406fb20 msgr2=0x7fc76406ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.376+0000 7fc769827700 1 --2- 172.21.15.72:0/2048062326 >> v2:172.21.15.72:3300/0 conn(0x7fc76406fb20 0x7fc76406ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.376+0000 7fc769827700 1 -- 172.21.15.72:0/2048062326 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764130340 con 0x7fc764130e50 2023-10-03T10:19:01.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.376+0000 7fc76a829700 1 --2- 172.21.15.72:0/2048062326 >> v2:172.21.15.72:3300/0 conn(0x7fc76406fb20 0x7fc76406ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:01.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.376+0000 7fc769827700 1 --2- 172.21.15.72:0/2048062326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc764130e50 0x7fc76406f5e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc754009920 tx=0x7fc754009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa02680cfff48d57 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.376+0000 7fc769026700 1 -- 172.21.15.72:0/2048062326 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754012970 con 0x7fc764130e50 2023-10-03T10:19:01.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.376+0000 7fc769026700 1 -- 172.21.15.72:0/2048062326 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc754012ad0 con 0x7fc764130e50 2023-10-03T10:19:01.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.376+0000 7fc769026700 1 -- 172.21.15.72:0/2048062326 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754012e60 con 0x7fc764130e50 2023-10-03T10:19:01.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.377+0000 7f9f0aca8700 1 -- 172.21.15.72:0/1714167229 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9f0409e130 con 0x7f9f0409d9f0 2023-10-03T10:19:01.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.377+0000 7fc76c28c700 1 -- 172.21.15.72:0/2048062326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc764130e50 msgr2=0x7fc76406f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.377+0000 7fc76c28c700 1 --2- 172.21.15.72:0/2048062326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc764130e50 0x7fc76406f5e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc754009920 tx=0x7fc754009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:01.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.377+0000 7f9f017fa700 1 -- 172.21.15.72:0/1714167229 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f0409e130 con 0x7f9f0409d9f0 2023-10-03T10:19:01.379 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:01.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.377+0000 7fc76c28c700 1 -- 172.21.15.72:0/2048062326 shutdown_connections 2023-10-03T10:19:01.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.377+0000 7fc76c28c700 1 --2- 172.21.15.72:0/2048062326 >> v2:172.21.15.72:3300/0 conn(0x7fc76406fb20 0x7fc76406ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.377+0000 7fc76c28c700 1 --2- 172.21.15.72:0/2048062326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc764130540 0x7fc764130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.377+0000 7fc76c28c700 1 --2- 172.21.15.72:0/2048062326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc764130e50 0x7fc76406f5e0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.377+0000 7fc76c28c700 1 -- 172.21.15.72:0/2048062326 >> 172.21.15.72:0/2048062326 conn(0x7fc7640a2aa0 msgr2=0x7fc7640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.377+0000 7fc76c28c700 1 -- 172.21.15.72:0/2048062326 shutdown_connections 2023-10-03T10:19:01.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.377+0000 7fc76c28c700 1 -- 172.21.15.72:0/2048062326 wait complete. 2023-10-03T10:19:01.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.379+0000 7fc76c28c700 1 Processor -- start 2023-10-03T10:19:01.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.379+0000 7fc76c28c700 1 -- start start 2023-10-03T10:19:01.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.379+0000 7f9f0aca8700 1 -- 172.21.15.72:0/1714167229 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f0409d9f0 msgr2=0x7f9f04071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.379+0000 7f9f0aca8700 1 --2- 172.21.15.72:0/1714167229 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f0409d9f0 0x7f9f04071050 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800c450 tx=0x7f9ef800c760 comp rx=0 tx=0).stop 2023-10-03T10:19:01.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.379+0000 7fc76c28c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76406fb20 0x7fc764118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.379+0000 7fc76c28c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc764130540 0x7fc764119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.379+0000 7fc76c28c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc764130e50 0x7fc764119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc76c28c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76411bf40 con 0x7fc764130e50 2023-10-03T10:19:01.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc76c28c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76411a650 con 0x7fc764130540 2023-10-03T10:19:01.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc76c28c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc76411b310 con 0x7fc76406fb20 2023-10-03T10:19:01.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc76a028700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76406fb20 0x7fc764118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc76a028700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76406fb20 0x7fc764118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48026/0 (socket says 172.21.15.72:48026) 2023-10-03T10:19:01.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc76a028700 1 -- 172.21.15.72:0/868331859 learned_addr learned my addr 172.21.15.72:0/868331859 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:01.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc769827700 1 --2- 172.21.15.72:0/868331859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc764130540 0x7fc764119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc76a829700 1 --2- 172.21.15.72:0/868331859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc764130e50 0x7fc764119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc76a028700 1 -- 172.21.15.72:0/868331859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc764130540 msgr2=0x7fc764119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc76a028700 1 --2- 172.21.15.72:0/868331859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc764130540 0x7fc764119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc76a028700 1 -- 172.21.15.72:0/868331859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc764130e50 msgr2=0x7fc764119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc76a028700 1 --2- 172.21.15.72:0/868331859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc764130e50 0x7fc764119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc76a028700 1 -- 172.21.15.72:0/868331859 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc754009550 con 0x7fc76406fb20 2023-10-03T10:19:01.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc76a028700 1 --2- 172.21.15.72:0/868331859 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76406fb20 0x7fc764118cd0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc76000e810 tx=0x7fc76000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc75affd700 1 -- 172.21.15.72:0/868331859 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76000c070 con 0x7fc76406fb20 2023-10-03T10:19:01.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc75affd700 1 -- 172.21.15.72:0/868331859 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc760013610 con 0x7fc76406fb20 2023-10-03T10:19:01.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc75affd700 1 -- 172.21.15.72:0/868331859 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600139c0 con 0x7fc76406fb20 2023-10-03T10:19:01.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc76c28c700 1 -- 172.21.15.72:0/868331859 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76411c8e0 con 0x7fc76406fb20 2023-10-03T10:19:01.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.380+0000 7fc76c28c700 1 -- 172.21.15.72:0/868331859 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7640a0c90 con 0x7fc76406fb20 2023-10-03T10:19:01.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.381+0000 7fc75affd700 1 -- 172.21.15.72:0/868331859 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc760013b20 con 0x7fc76406fb20 2023-10-03T10:19:01.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.381+0000 7fc75affd700 1 -- 172.21.15.72:0/868331859 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc76003f320 con 0x7fc76406fb20 2023-10-03T10:19:01.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.382+0000 7f9f0aca8700 1 -- 172.21.15.72:0/1714167229 shutdown_connections 2023-10-03T10:19:01.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.382+0000 7f9f0aca8700 1 --2- 172.21.15.72:0/1714167229 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f041316c0 0x7f9f04071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.382+0000 7f9f0aca8700 1 --2- 172.21.15.72:0/1714167229 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9f0406ae80 0x7f9f04070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.382+0000 7f9f0aca8700 1 --2- 172.21.15.72:0/1714167229 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9f0409d9f0 0x7f9f04071050 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.382+0000 7f9f0aca8700 1 -- 172.21.15.72:0/1714167229 >> 172.21.15.72:0/1714167229 conn(0x7f9f04066f50 msgr2=0x7f9f040a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.382+0000 7fc76c28c700 1 -- 172.21.15.72:0/868331859 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76411c8e0 con 0x7fc76406fb20 2023-10-03T10:19:01.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.382+0000 7f9f0aca8700 1 -- 172.21.15.72:0/1714167229 shutdown_connections 2023-10-03T10:19:01.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.382+0000 7f9f0aca8700 1 -- 172.21.15.72:0/1714167229 wait complete. 2023-10-03T10:19:01.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.387+0000 7fc75affd700 1 -- 172.21.15.72:0/868331859 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc76411c8e0 con 0x7fc76406fb20 2023-10-03T10:19:01.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:01.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.495+0000 7f8938d44700 1 -- 172.21.15.72:0/3814955266 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f89341b90e0 con 0x7f893409d6f0 2023-10-03T10:19:01.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.495+0000 7f8922ffd700 1 -- 172.21.15.72:0/3814955266 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f8924021070 con 0x7f893409d6f0 2023-10-03T10:19:01.495 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:01.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.498+0000 7f8938d44700 1 -- 172.21.15.72:0/3814955266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f893409d6f0 msgr2=0x7f89341c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.498+0000 7f8938d44700 1 --2- 172.21.15.72:0/3814955266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f893409d6f0 0x7f89341c7f40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f892400ebe0 tx=0x7f892400eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.498+0000 7f8938d44700 1 -- 172.21.15.72:0/3814955266 shutdown_connections 2023-10-03T10:19:01.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.498+0000 7f8938d44700 1 --2- 172.21.15.72:0/3814955266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f893409e410 0x7f89341c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.498+0000 7f8938d44700 1 --2- 172.21.15.72:0/3814955266 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f893409d6f0 0x7f89341c7f40 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.498+0000 7f8938d44700 1 --2- 172.21.15.72:0/3814955266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f893409e000 0x7f89341c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.498+0000 7f8938d44700 1 -- 172.21.15.72:0/3814955266 >> 172.21.15.72:0/3814955266 conn(0x7f8934066f50 msgr2=0x7f89341bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.498+0000 7f8938d44700 1 -- 172.21.15.72:0/3814955266 shutdown_connections 2023-10-03T10:19:01.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.498+0000 7f8938d44700 1 -- 172.21.15.72:0/3814955266 wait complete. 2023-10-03T10:19:01.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:01.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.561+0000 7f8ad00a3700 1 -- 172.21.15.72:0/2034835930 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8ac8074ea0 con 0x7f8ac809e410 2023-10-03T10:19:01.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.561+0000 7f8abe7fc700 1 -- 172.21.15.72:0/2034835930 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ac0019300 con 0x7f8ac809e410 2023-10-03T10:19:01.561 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:01.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.563+0000 7f8ad00a3700 1 -- 172.21.15.72:0/2034835930 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ac809e410 msgr2=0x7f8ac81a6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.563+0000 7f8ad00a3700 1 --2- 172.21.15.72:0/2034835930 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ac809e410 0x7f8ac81a6a70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000cc80 tx=0x7f8ac000cf90 comp rx=0 tx=0).stop 2023-10-03T10:19:01.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.563+0000 7f8ad00a3700 1 -- 172.21.15.72:0/2034835930 shutdown_connections 2023-10-03T10:19:01.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.563+0000 7f8ad00a3700 1 --2- 172.21.15.72:0/2034835930 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8ac809e410 0x7f8ac81a6a70 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.563+0000 7f8ad00a3700 1 --2- 172.21.15.72:0/2034835930 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ac809d6f0 0x7f8ac81a5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.563+0000 7f8ad00a3700 1 --2- 172.21.15.72:0/2034835930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ac809e000 0x7f8ac81a6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.563+0000 7f8ad00a3700 1 -- 172.21.15.72:0/2034835930 >> 172.21.15.72:0/2034835930 conn(0x7f8ac8066f50 msgr2=0x7f8ac81bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.563+0000 7f8ad00a3700 1 -- 172.21.15.72:0/2034835930 shutdown_connections 2023-10-03T10:19:01.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.563+0000 7f8ad00a3700 1 -- 172.21.15.72:0/2034835930 wait complete. 2023-10-03T10:19:01.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:01.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.593+0000 7fc76c28c700 1 -- 172.21.15.72:0/868331859 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc76411c8e0 con 0x7fc76406fb20 2023-10-03T10:19:01.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.593+0000 7fc75affd700 1 -- 172.21.15.72:0/868331859 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc76411c8e0 con 0x7fc76406fb20 2023-10-03T10:19:01.593 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:01.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.595+0000 7fc76c28c700 1 -- 172.21.15.72:0/868331859 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76406fb20 msgr2=0x7fc764118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.595+0000 7fc76c28c700 1 --2- 172.21.15.72:0/868331859 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76406fb20 0x7fc764118cd0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc76000e810 tx=0x7fc76000eb20 comp rx=0 tx=0).stop 2023-10-03T10:19:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.595+0000 7fc76c28c700 1 -- 172.21.15.72:0/868331859 shutdown_connections 2023-10-03T10:19:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.595+0000 7fc76c28c700 1 --2- 172.21.15.72:0/868331859 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc764130e50 0x7fc764119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.595+0000 7fc76c28c700 1 --2- 172.21.15.72:0/868331859 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc76406fb20 0x7fc764118cd0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.596+0000 7fc76c28c700 1 --2- 172.21.15.72:0/868331859 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc764130540 0x7fc764119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.596+0000 7fc76c28c700 1 -- 172.21.15.72:0/868331859 >> 172.21.15.72:0/868331859 conn(0x7fc7640a2aa0 msgr2=0x7fc76412d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.596+0000 7fc76c28c700 1 -- 172.21.15.72:0/868331859 shutdown_connections 2023-10-03T10:19:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:01.596+0000 7fc76c28c700 1 -- 172.21.15.72:0/868331859 wait complete. 2023-10-03T10:19:01.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:02.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:02.511 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:02.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.533+0000 7f34aee75700 1 Processor -- start 2023-10-03T10:19:02.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.533+0000 7f34aee75700 1 -- start start 2023-10-03T10:19:02.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.533+0000 7f34aee75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a809d6f0 0x7f34a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.533+0000 7f34aee75700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a809e000 0x7f34a8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.533+0000 7f34aee75700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34a809e410 0x7f34a8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.533+0000 7f34aee75700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a809f520 con 0x7f34a809e410 2023-10-03T10:19:02.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.533+0000 7f34aee75700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a809f130 con 0x7f34a809d6f0 2023-10-03T10:19:02.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.533+0000 7f34aee75700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34a809e930 con 0x7f34a809e000 2023-10-03T10:19:02.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.533+0000 7f34acc11700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a809d6f0 0x7f34a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34a7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a809e000 0x7f34a8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34a7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a809e000 0x7f34a8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48036/0 (socket says 172.21.15.72:48036) 2023-10-03T10:19:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34acc11700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a809d6f0 0x7f34a809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42634/0 (socket says 172.21.15.72:42634) 2023-10-03T10:19:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34a7fff700 1 -- 172.21.15.72:0/2105172729 learned_addr learned my addr 172.21.15.72:0/2105172729 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34ad412700 1 --2- 172.21.15.72:0/2105172729 >> v2:172.21.15.72:3300/0 conn(0x7f34a809e410 0x7f34a8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34a7fff700 1 -- 172.21.15.72:0/2105172729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a809d6f0 msgr2=0x7f34a809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34a7fff700 1 --2- 172.21.15.72:0/2105172729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a809d6f0 0x7f34a809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34a7fff700 1 -- 172.21.15.72:0/2105172729 >> v2:172.21.15.72:3300/0 conn(0x7f34a809e410 msgr2=0x7f34a8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34a7fff700 1 --2- 172.21.15.72:0/2105172729 >> v2:172.21.15.72:3300/0 conn(0x7f34a809e410 0x7f34a8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34a7fff700 1 -- 172.21.15.72:0/2105172729 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a809b2d0 con 0x7f34a809e000 2023-10-03T10:19:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34acc11700 1 --2- 172.21.15.72:0/2105172729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a809d6f0 0x7f34a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34ad412700 1 --2- 172.21.15.72:0/2105172729 >> v2:172.21.15.72:3300/0 conn(0x7f34a809e410 0x7f34a8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34a7fff700 1 --2- 172.21.15.72:0/2105172729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a809e000 0x7f34a8130660 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f3494009920 tx=0x7f3494009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38319e64a2663523 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34a77fe700 1 -- 172.21.15.72:0/2105172729 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494011830 con 0x7f34a809e000 2023-10-03T10:19:02.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34a77fe700 1 -- 172.21.15.72:0/2105172729 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3494011990 con 0x7f34a809e000 2023-10-03T10:19:02.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.534+0000 7f34a77fe700 1 -- 172.21.15.72:0/2105172729 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494011d20 con 0x7f34a809e000 2023-10-03T10:19:02.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.535+0000 7f34aee75700 1 -- 172.21.15.72:0/2105172729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a809e000 msgr2=0x7f34a8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.535+0000 7f34aee75700 1 --2- 172.21.15.72:0/2105172729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a809e000 0x7f34a8130660 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f3494009920 tx=0x7f3494009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:02.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.535+0000 7f34aee75700 1 -- 172.21.15.72:0/2105172729 shutdown_connections 2023-10-03T10:19:02.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.535+0000 7f34aee75700 1 --2- 172.21.15.72:0/2105172729 >> v2:172.21.15.72:3300/0 conn(0x7f34a809e410 0x7f34a8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.535+0000 7f34aee75700 1 --2- 172.21.15.72:0/2105172729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a809d6f0 0x7f34a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.535+0000 7f34aee75700 1 --2- 172.21.15.72:0/2105172729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a809e000 0x7f34a8130660 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.535+0000 7f34aee75700 1 -- 172.21.15.72:0/2105172729 >> 172.21.15.72:0/2105172729 conn(0x7f34a8066f50 msgr2=0x7f34a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.535+0000 7f34aee75700 1 -- 172.21.15.72:0/2105172729 shutdown_connections 2023-10-03T10:19:02.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.535+0000 7f34aee75700 1 -- 172.21.15.72:0/2105172729 wait complete. 2023-10-03T10:19:02.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.536+0000 7f34aee75700 1 Processor -- start 2023-10-03T10:19:02.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.536+0000 7f34aee75700 1 -- start start 2023-10-03T10:19:02.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.536+0000 7f34aee75700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a809d6f0 0x7f34a81223f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.536+0000 7f34aee75700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a809e000 0x7f34a8122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.536+0000 7f34aee75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a809e410 0x7f34a8122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34aee75700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8124420 con 0x7f34a809d6f0 2023-10-03T10:19:02.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34aee75700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8125f10 con 0x7f34a809e410 2023-10-03T10:19:02.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34aee75700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80a1720 con 0x7f34a809e000 2023-10-03T10:19:02.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34a7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a809e000 0x7f34a8122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34acc11700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a809d6f0 0x7f34a81223f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34ad412700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a809e410 0x7f34a8122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34a7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a809e000 0x7f34a8122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48048/0 (socket says 172.21.15.72:48048) 2023-10-03T10:19:02.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34a7fff700 1 -- 172.21.15.72:0/3947423991 learned_addr learned my addr 172.21.15.72:0/3947423991 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:02.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34ad412700 1 -- 172.21.15.72:0/3947423991 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a809e000 msgr2=0x7f34a8122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34ad412700 1 --2- 172.21.15.72:0/3947423991 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a809e000 0x7f34a8122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34ad412700 1 -- 172.21.15.72:0/3947423991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a809d6f0 msgr2=0x7f34a81223f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34ad412700 1 --2- 172.21.15.72:0/3947423991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a809d6f0 0x7f34a81223f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34ad412700 1 -- 172.21.15.72:0/3947423991 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c0094a0 con 0x7f34a809e410 2023-10-03T10:19:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34a7fff700 1 --2- 172.21.15.72:0/3947423991 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a809e000 0x7f34a8122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34acc11700 1 --2- 172.21.15.72:0/3947423991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a809d6f0 0x7f34a81223f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34ad412700 1 --2- 172.21.15.72:0/3947423991 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a809e410 0x7f34a8122e70 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f34a000efc0 tx=0x7f34a000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34a57fa700 1 -- 172.21.15.72:0/3947423991 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000ca90 con 0x7f34a809e410 2023-10-03T10:19:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34a57fa700 1 -- 172.21.15.72:0/3947423991 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a000f040 con 0x7f34a809e410 2023-10-03T10:19:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34a57fa700 1 -- 172.21.15.72:0/3947423991 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000ce30 con 0x7f34a809e410 2023-10-03T10:19:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.537+0000 7f34aee75700 1 -- 172.21.15.72:0/3947423991 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a0009a70 con 0x7f34a809e410 2023-10-03T10:19:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.538+0000 7f34aee75700 1 -- 172.21.15.72:0/3947423991 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3494009550 con 0x7f34a809e410 2023-10-03T10:19:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.538+0000 7f34a57fa700 1 -- 172.21.15.72:0/3947423991 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f34a0014480 con 0x7f34a809e410 2023-10-03T10:19:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.538+0000 7f34a57fa700 1 -- 172.21.15.72:0/3947423991 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f34a003fc60 con 0x7f34a809e410 2023-10-03T10:19:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.539+0000 7f34aee75700 1 -- 172.21.15.72:0/3947423991 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a81258d0 con 0x7f34a809e410 2023-10-03T10:19:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.544+0000 7f34a57fa700 1 -- 172.21.15.72:0/3947423991 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34a81258d0 con 0x7f34a809e410 2023-10-03T10:19:02.575 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:02.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:02.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.645+0000 7f1b14ad0700 1 Processor -- start 2023-10-03T10:19:02.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.645+0000 7f1b14ad0700 1 -- start start 2023-10-03T10:19:02.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.646+0000 7f1b14ad0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b1006e570 0x7f1b1006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.646+0000 7f1b14ad0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009eca0 0x7f1b1006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.646+0000 7f1b14ad0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b10070ee0 con 0x7f1b10134610 2023-10-03T10:19:02.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.646+0000 7f1b14ad0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b10071480 con 0x7f1b1006e570 2023-10-03T10:19:02.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.646+0000 7f1b14ad0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1006f3c0 con 0x7f1b1009eca0 2023-10-03T10:19:02.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.646+0000 7f1b0dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009eca0 0x7f1b1006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.646+0000 7f1b0e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b1006e570 0x7f1b1006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.646+0000 7f1b0e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b1006e570 0x7f1b1006e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40422/0 (socket says 172.21.15.72:40422) 2023-10-03T10:19:02.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.646+0000 7f1b0dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009eca0 0x7f1b1006ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42650/0 (socket says 172.21.15.72:42650) 2023-10-03T10:19:02.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.646+0000 7f1b0e59c700 1 -- 172.21.15.72:0/3104845201 learned_addr learned my addr 172.21.15.72:0/3104845201 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:02.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.646+0000 7f1b0dd9b700 1 -- 172.21.15.72:0/3104845201 >> v2:172.21.15.72:3300/0 conn(0x7f1b1006e570 msgr2=0x7f1b1006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.646+0000 7f1b0dd9b700 1 --2- 172.21.15.72:0/3104845201 >> v2:172.21.15.72:3300/0 conn(0x7f1b1006e570 0x7f1b1006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.646+0000 7f1b0dd9b700 1 -- 172.21.15.72:0/3104845201 >> v1:172.21.15.72:6789/0 conn(0x7f1b10134610 legacy=0x7f1b10134a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:19:02.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.646+0000 7f1b0dd9b700 1 -- 172.21.15.72:0/3104845201 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b10071b90 con 0x7f1b1009eca0 2023-10-03T10:19:02.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.646+0000 7f1b0e59c700 1 --2- 172.21.15.72:0/3104845201 >> v2:172.21.15.72:3300/0 conn(0x7f1b1006e570 0x7f1b1006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.647+0000 7f1b0dd9b700 1 --2- 172.21.15.72:0/3104845201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009eca0 0x7f1b1006ee80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009840 tx=0x7f1b04009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=668bbf4e274be7fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.647+0000 7f1b0d59a700 1 -- 172.21.15.72:0/3104845201 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04004230 con 0x7f1b1009eca0 2023-10-03T10:19:02.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.647+0000 7f1b0d59a700 1 -- 172.21.15.72:0/3104845201 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b04004390 con 0x7f1b1009eca0 2023-10-03T10:19:02.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.647+0000 7f1b0d59a700 1 -- 172.21.15.72:0/3104845201 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b040036a0 con 0x7f1b1009eca0 2023-10-03T10:19:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.647+0000 7f1b14ad0700 1 -- 172.21.15.72:0/3104845201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009eca0 msgr2=0x7f1b1006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.647+0000 7f1b14ad0700 1 --2- 172.21.15.72:0/3104845201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009eca0 0x7f1b1006ee80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009840 tx=0x7f1b04009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.648+0000 7f1b14ad0700 1 -- 172.21.15.72:0/3104845201 shutdown_connections 2023-10-03T10:19:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.648+0000 7f1b14ad0700 1 --2- 172.21.15.72:0/3104845201 >> v2:172.21.15.72:3300/0 conn(0x7f1b1006e570 0x7f1b1006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.648+0000 7f1b14ad0700 1 --2- 172.21.15.72:0/3104845201 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b1009eca0 0x7f1b1006ee80 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.648+0000 7f1b14ad0700 1 -- 172.21.15.72:0/3104845201 >> 172.21.15.72:0/3104845201 conn(0x7f1b100a2aa0 msgr2=0x7f1b100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.648+0000 7f1b14ad0700 1 -- 172.21.15.72:0/3104845201 shutdown_connections 2023-10-03T10:19:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.648+0000 7f1b14ad0700 1 -- 172.21.15.72:0/3104845201 wait complete. 2023-10-03T10:19:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.649+0000 7f1b14ad0700 1 Processor -- start 2023-10-03T10:19:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.649+0000 7f1b14ad0700 1 -- start start 2023-10-03T10:19:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b14ad0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b1006e570 0x7f1b101ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b14ad0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b10134610 0x7f1b101cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b14ad0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b101cd5f0 0x7f1b101c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b14ad0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b10125510 con 0x7f1b101cd5f0 2023-10-03T10:19:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b14ad0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b10125320 con 0x7f1b10134610 2023-10-03T10:19:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b14ad0700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b10125bb0 con 0x7f1b1006e570 2023-10-03T10:19:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b0dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b10134610 0x7f1b101cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b0ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b101cd5f0 0x7f1b101c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b0dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b10134610 0x7f1b101cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42660/0 (socket says 172.21.15.72:42660) 2023-10-03T10:19:02.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b0dd9b700 1 -- 172.21.15.72:0/2481737678 learned_addr learned my addr 172.21.15.72:0/2481737678 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:02.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b0dd9b700 1 -- 172.21.15.72:0/2481737678 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b1006e570 msgr2=0x7f1b101ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b0dd9b700 1 --2- 172.21.15.72:0/2481737678 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b1006e570 0x7f1b101ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b0dd9b700 1 -- 172.21.15.72:0/2481737678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b101cd5f0 msgr2=0x7f1b101c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b0dd9b700 1 --2- 172.21.15.72:0/2481737678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b101cd5f0 0x7f1b101c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b0dd9b700 1 -- 172.21.15.72:0/2481737678 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b00009550 con 0x7f1b10134610 2023-10-03T10:19:02.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.650+0000 7f1b0ed9d700 1 --2- 172.21.15.72:0/2481737678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b101cd5f0 0x7f1b101c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.651+0000 7f1b0dd9b700 1 --2- 172.21.15.72:0/2481737678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b10134610 0x7f1b101cd0b0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1b04000c00 tx=0x7f1b04004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.651+0000 7f1afeffd700 1 -- 172.21.15.72:0/2481737678 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04003ce0 con 0x7f1b10134610 2023-10-03T10:19:02.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.651+0000 7f1afeffd700 1 -- 172.21.15.72:0/2481737678 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b04003e60 con 0x7f1b10134610 2023-10-03T10:19:02.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.651+0000 7f1b14ad0700 1 -- 172.21.15.72:0/2481737678 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b040094a0 con 0x7f1b10134610 2023-10-03T10:19:02.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.651+0000 7f1afeffd700 1 -- 172.21.15.72:0/2481737678 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04011870 con 0x7f1b10134610 2023-10-03T10:19:02.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.651+0000 7f1b14ad0700 1 -- 172.21.15.72:0/2481737678 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b10125920 con 0x7f1b10134610 2023-10-03T10:19:02.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.652+0000 7f1afcff9700 1 -- 172.21.15.72:0/2481737678 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae80052e0 con 0x7f1b10134610 2023-10-03T10:19:02.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.652+0000 7f1afeffd700 1 -- 172.21.15.72:0/2481737678 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b04018040 con 0x7f1b10134610 2023-10-03T10:19:02.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.652+0000 7f1afeffd700 1 -- 172.21.15.72:0/2481737678 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1b04040140 con 0x7f1b10134610 2023-10-03T10:19:02.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.661+0000 7f1afeffd700 1 -- 172.21.15.72:0/2481737678 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b0401a400 con 0x7f1b10134610 2023-10-03T10:19:02.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.711+0000 7f850c645700 1 Processor -- start 2023-10-03T10:19:02.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.711+0000 7f850c645700 1 -- start start 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.712+0000 7f850c645700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f850409d6f0 0x7f850409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.712+0000 7f850c645700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850409e000 0x7f85041339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.712+0000 7f850c645700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850409b120 con 0x7f850409e410 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.712+0000 7f850c645700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850406b460 con 0x7f850409e000 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.712+0000 7f850c645700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f850409a7e0 con 0x7f850409d6f0 2023-10-03T10:19:02.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.712+0000 7f850a3e1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f850409d6f0 0x7f850409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.712+0000 7f8509be0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850409e000 0x7f85041339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.712+0000 7f850a3e1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f850409d6f0 0x7f850409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48070/0 (socket says 172.21.15.72:48070) 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.712+0000 7f850a3e1700 1 -- 172.21.15.72:0/2426503035 learned_addr learned my addr 172.21.15.72:0/2426503035 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.713+0000 7f8509be0700 1 -- 172.21.15.72:0/2426503035 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f850409d6f0 msgr2=0x7f850409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.713+0000 7f8509be0700 1 --2- 172.21.15.72:0/2426503035 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f850409d6f0 0x7f850409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.713+0000 7f8509be0700 1 -- 172.21.15.72:0/2426503035 >> v1:172.21.15.72:6789/0 conn(0x7f850409e410 legacy=0x7f8504133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.713+0000 7f8509be0700 1 -- 172.21.15.72:0/2426503035 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850409a500 con 0x7f850409e000 2023-10-03T10:19:02.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.713+0000 7f8509be0700 1 --2- 172.21.15.72:0/2426503035 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850409e000 0x7f85041339f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009870 tx=0x7f84f4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=988ae20329cf8787 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.713+0000 7f85093df700 1 -- 172.21.15.72:0/2426503035 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4004230 con 0x7f850409e000 2023-10-03T10:19:02.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.713+0000 7f85093df700 1 -- 172.21.15.72:0/2426503035 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f4004390 con 0x7f850409e000 2023-10-03T10:19:02.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.713+0000 7f85093df700 1 -- 172.21.15.72:0/2426503035 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40036a0 con 0x7f850409e000 2023-10-03T10:19:02.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.714+0000 7f850c645700 1 -- 172.21.15.72:0/2426503035 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850409e000 msgr2=0x7f85041339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.714+0000 7f850c645700 1 --2- 172.21.15.72:0/2426503035 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850409e000 0x7f85041339f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009870 tx=0x7f84f4009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:02.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.714+0000 7f850c645700 1 -- 172.21.15.72:0/2426503035 shutdown_connections 2023-10-03T10:19:02.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.714+0000 7f850c645700 1 --2- 172.21.15.72:0/2426503035 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f850409d6f0 0x7f850409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.714+0000 7f850c645700 1 --2- 172.21.15.72:0/2426503035 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850409e000 0x7f85041339f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.714+0000 7f850c645700 1 -- 172.21.15.72:0/2426503035 >> 172.21.15.72:0/2426503035 conn(0x7f8504066f50 msgr2=0x7f850409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.714+0000 7f850c645700 1 -- 172.21.15.72:0/2426503035 shutdown_connections 2023-10-03T10:19:02.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.714+0000 7f850c645700 1 -- 172.21.15.72:0/2426503035 wait complete. 2023-10-03T10:19:02.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.715+0000 7f850c645700 1 Processor -- start 2023-10-03T10:19:02.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.716+0000 7f850c645700 1 -- start start 2023-10-03T10:19:02.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.716+0000 7f850c645700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f850409d6f0 0x7f8504122600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.716+0000 7f850c645700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850409e000 0x7f8504122b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.716+0000 7f850c645700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f850409e410 0x7f8504123080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.716+0000 7f850c645700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8504124ae0 con 0x7f850409e410 2023-10-03T10:19:02.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.716+0000 7f850c645700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850409c710 con 0x7f850409e000 2023-10-03T10:19:02.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.716+0000 7f850c645700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8504124320 con 0x7f850409d6f0 2023-10-03T10:19:02.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.716+0000 7f8509be0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850409e000 0x7f8504122b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.716+0000 7f8509be0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850409e000 0x7f8504122b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42680/0 (socket says 172.21.15.72:42680) 2023-10-03T10:19:02.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.716+0000 7f8509be0700 1 -- 172.21.15.72:0/26516628 learned_addr learned my addr 172.21.15.72:0/26516628 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:02.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.716+0000 7f850a3e1700 1 --2- 172.21.15.72:0/26516628 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f850409d6f0 0x7f8504122600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.717+0000 7f8509be0700 1 -- 172.21.15.72:0/26516628 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f850409d6f0 msgr2=0x7f8504122600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.717+0000 7f8509be0700 1 --2- 172.21.15.72:0/26516628 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f850409d6f0 0x7f8504122600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.717+0000 7f8509be0700 1 -- 172.21.15.72:0/26516628 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f850409e410 msgr2=0x7f8504123080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.717+0000 7f8509be0700 1 --2- 172.21.15.72:0/26516628 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f850409e410 0x7f8504123080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.717+0000 7f8509be0700 1 -- 172.21.15.72:0/26516628 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f40094a0 con 0x7f850409e000 2023-10-03T10:19:02.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.717+0000 7f8509be0700 1 --2- 172.21.15.72:0/26516628 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850409e000 0x7f8504122b40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f84f4004000 tx=0x7f84f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.717+0000 7f84faffd700 1 -- 172.21.15.72:0/26516628 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4003e20 con 0x7f850409e000 2023-10-03T10:19:02.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.717+0000 7f84faffd700 1 -- 172.21.15.72:0/26516628 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f401e070 con 0x7f850409e000 2023-10-03T10:19:02.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.717+0000 7f84faffd700 1 -- 172.21.15.72:0/26516628 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4011870 con 0x7f850409e000 2023-10-03T10:19:02.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.717+0000 7f850c645700 1 -- 172.21.15.72:0/26516628 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8504125e40 con 0x7f850409e000 2023-10-03T10:19:02.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.717+0000 7f850c645700 1 -- 172.21.15.72:0/26516628 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85040a2cf0 con 0x7f850409e000 2023-10-03T10:19:02.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.718+0000 7f84faffd700 1 -- 172.21.15.72:0/26516628 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84f40119d0 con 0x7f850409e000 2023-10-03T10:19:02.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.718+0000 7f84faffd700 1 -- 172.21.15.72:0/26516628 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f84f4040a80 con 0x7f850409e000 2023-10-03T10:19:02.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.718+0000 7f850c645700 1 -- 172.21.15.72:0/26516628 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8504074ea0 con 0x7f850409e000 2023-10-03T10:19:02.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.727+0000 7f84faffd700 1 -- 172.21.15.72:0/26516628 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84f4010bd0 con 0x7f850409e000 2023-10-03T10:19:02.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.749+0000 7f34aee75700 1 -- 172.21.15.72:0/3947423991 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f34a81258d0 con 0x7f34a809e410 2023-10-03T10:19:02.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.749+0000 7f34a57fa700 1 -- 172.21.15.72:0/3947423991 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34a81258d0 con 0x7f34a809e410 2023-10-03T10:19:02.749 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:02.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.752+0000 7ff70ebe3700 1 Processor -- start 2023-10-03T10:19:02.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.752+0000 7ff70ebe3700 1 -- start start 2023-10-03T10:19:02.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.752+0000 7f34aee75700 1 -- 172.21.15.72:0/3947423991 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a809e410 msgr2=0x7f34a8122e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.752+0000 7f34aee75700 1 --2- 172.21.15.72:0/3947423991 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a809e410 0x7f34a8122e70 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f34a000efc0 tx=0x7f34a000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.752+0000 7f34aee75700 1 -- 172.21.15.72:0/3947423991 shutdown_connections 2023-10-03T10:19:02.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.752+0000 7f34aee75700 1 --2- 172.21.15.72:0/3947423991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34a809d6f0 0x7f34a81223f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.752+0000 7f34aee75700 1 --2- 172.21.15.72:0/3947423991 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f34a809e410 0x7f34a8122e70 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.752+0000 7f34aee75700 1 --2- 172.21.15.72:0/3947423991 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f34a809e000 0x7f34a8122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.752+0000 7f34aee75700 1 -- 172.21.15.72:0/3947423991 >> 172.21.15.72:0/3947423991 conn(0x7f34a8066f50 msgr2=0x7f34a806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.752+0000 7ff70ebe3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff70809e930 0x7ff70809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.752+0000 7ff70ebe3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff70809f240 0x7ff7081317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.752+0000 7ff70ebe3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff70809f650 0x7ff708131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.752+0000 7ff70ebe3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff708070940 con 0x7ff70809f240 2023-10-03T10:19:02.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.752+0000 7ff70ebe3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70806fd60 con 0x7ff70809f650 2023-10-03T10:19:02.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.752+0000 7ff70ebe3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff70806fa80 con 0x7ff70809e930 2023-10-03T10:19:02.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7f34aee75700 1 -- 172.21.15.72:0/3947423991 shutdown_connections 2023-10-03T10:19:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff70c97f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff70809e930 0x7ff70809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff70d180700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff70809f650 0x7ff708131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff707fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff70809f240 0x7ff7081317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff707fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff70809f240 0x7ff7081317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40440/0 (socket says 172.21.15.72:40440) 2023-10-03T10:19:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff707fff700 1 -- 172.21.15.72:0/2983355921 learned_addr learned my addr 172.21.15.72:0/2983355921 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff70c97f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff70809e930 0x7ff70809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48074/0 (socket says 172.21.15.72:48074) 2023-10-03T10:19:02.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff70d180700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff70809f650 0x7ff708131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42688/0 (socket says 172.21.15.72:42688) 2023-10-03T10:19:02.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff707fff700 1 -- 172.21.15.72:0/2983355921 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff70809e930 msgr2=0x7ff70809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff707fff700 1 --2- 172.21.15.72:0/2983355921 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff70809e930 0x7ff70809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff707fff700 1 -- 172.21.15.72:0/2983355921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff70809f650 msgr2=0x7ff708131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff707fff700 1 --2- 172.21.15.72:0/2983355921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff70809f650 0x7ff708131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff707fff700 1 -- 172.21.15.72:0/2983355921 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70809fb60 con 0x7ff70809f240 2023-10-03T10:19:02.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff70d180700 1 --2- 172.21.15.72:0/2983355921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff70809f650 0x7ff708131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff707fff700 1 --2- 172.21.15.72:0/2983355921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff70809f240 0x7ff7081317f0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40098f0 tx=0x7ff6f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff7572d8f1f95fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff7077fe700 1 -- 172.21.15.72:0/2983355921 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4011830 con 0x7ff70809f240 2023-10-03T10:19:02.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff7077fe700 1 -- 172.21.15.72:0/2983355921 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f4011990 con 0x7ff70809f240 2023-10-03T10:19:02.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.753+0000 7ff7077fe700 1 -- 172.21.15.72:0/2983355921 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4011d20 con 0x7ff70809f240 2023-10-03T10:19:02.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.754+0000 7f34aee75700 1 -- 172.21.15.72:0/3947423991 wait complete. 2023-10-03T10:19:02.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.754+0000 7ff70ebe3700 1 -- 172.21.15.72:0/2983355921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff70809f240 msgr2=0x7ff7081317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.754+0000 7ff70ebe3700 1 --2- 172.21.15.72:0/2983355921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff70809f240 0x7ff7081317f0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40098f0 tx=0x7ff6f4009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:02.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.754+0000 7ff70ebe3700 1 -- 172.21.15.72:0/2983355921 shutdown_connections 2023-10-03T10:19:02.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.754+0000 7ff70ebe3700 1 --2- 172.21.15.72:0/2983355921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff70809f650 0x7ff708131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.754+0000 7ff70ebe3700 1 --2- 172.21.15.72:0/2983355921 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff70809e930 0x7ff70809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.754+0000 7ff70ebe3700 1 --2- 172.21.15.72:0/2983355921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff70809f240 0x7ff7081317f0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.754+0000 7ff70ebe3700 1 -- 172.21.15.72:0/2983355921 >> 172.21.15.72:0/2983355921 conn(0x7ff7080a4210 msgr2=0x7ff7080a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.754+0000 7ff70ebe3700 1 -- 172.21.15.72:0/2983355921 shutdown_connections 2023-10-03T10:19:02.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.754+0000 7ff70ebe3700 1 -- 172.21.15.72:0/2983355921 wait complete. 2023-10-03T10:19:02.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.755+0000 7ff70ebe3700 1 Processor -- start 2023-10-03T10:19:02.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.755+0000 7ff70ebe3700 1 -- start start 2023-10-03T10:19:02.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff70ebe3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff70809e930 0x7ff7081a2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff70ebe3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff70809f240 0x7ff7081a2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff70ebe3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff70809f650 0x7ff7081c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff70ebe3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7081a2ea0 con 0x7ff70809f240 2023-10-03T10:19:02.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff70ebe3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7081a5760 con 0x7ff70809f650 2023-10-03T10:19:02.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff70ebe3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7081a1fb0 con 0x7ff70809e930 2023-10-03T10:19:02.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff707fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff70809f240 0x7ff7081a2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff707fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff70809f240 0x7ff7081a2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40452/0 (socket says 172.21.15.72:40452) 2023-10-03T10:19:02.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff707fff700 1 -- 172.21.15.72:0/1332358642 learned_addr learned my addr 172.21.15.72:0/1332358642 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:02.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff70c97f700 1 --2- 172.21.15.72:0/1332358642 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff70809e930 0x7ff7081a2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff70d180700 1 --2- 172.21.15.72:0/1332358642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff70809f650 0x7ff7081c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff707fff700 1 -- 172.21.15.72:0/1332358642 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff70809e930 msgr2=0x7ff7081a2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff707fff700 1 --2- 172.21.15.72:0/1332358642 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff70809e930 0x7ff7081a2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff707fff700 1 -- 172.21.15.72:0/1332358642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff70809f650 msgr2=0x7ff7081c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff707fff700 1 --2- 172.21.15.72:0/1332358642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff70809f650 0x7ff7081c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff707fff700 1 -- 172.21.15.72:0/1332358642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70000f050 con 0x7ff70809f240 2023-10-03T10:19:02.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff707fff700 1 --2- 172.21.15.72:0/1332358642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff70809f240 0x7ff7081a2960 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4013000 tx=0x7ff6f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.756+0000 7ff7057fa700 1 -- 172.21.15.72:0/1332358642 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4004450 con 0x7ff70809f240 2023-10-03T10:19:02.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.757+0000 7ff7057fa700 1 -- 172.21.15.72:0/1332358642 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f40045b0 con 0x7ff70809f240 2023-10-03T10:19:02.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.757+0000 7ff7057fa700 1 -- 172.21.15.72:0/1332358642 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f40038e0 con 0x7ff70809f240 2023-10-03T10:19:02.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.757+0000 7ff70ebe3700 1 -- 172.21.15.72:0/1332358642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f4009550 con 0x7ff70809f240 2023-10-03T10:19:02.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.757+0000 7ff70ebe3700 1 -- 172.21.15.72:0/1332358642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7080a0190 con 0x7ff70809f240 2023-10-03T10:19:02.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.758+0000 7ff7057fa700 1 -- 172.21.15.72:0/1332358642 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff6f4021070 con 0x7ff70809f240 2023-10-03T10:19:02.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.758+0000 7ff70ebe3700 1 -- 172.21.15.72:0/1332358642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7081a5040 con 0x7ff70809f240 2023-10-03T10:19:02.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.758+0000 7ff7057fa700 1 -- 172.21.15.72:0/1332358642 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff6f40409d0 con 0x7ff70809f240 2023-10-03T10:19:02.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.766+0000 7ff7057fa700 1 -- 172.21.15.72:0/1332358642 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6f4019770 con 0x7ff70809f240 2023-10-03T10:19:02.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:02.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.910+0000 7f1afcff9700 1 -- 172.21.15.72:0/2481737678 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1ae8005590 con 0x7f1b10134610 2023-10-03T10:19:02.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.910+0000 7f1afeffd700 1 -- 172.21.15.72:0/2481737678 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f1b04016020 con 0x7f1b10134610 2023-10-03T10:19:02.911 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:02.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.912+0000 7f1afcff9700 1 -- 172.21.15.72:0/2481737678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b10134610 msgr2=0x7f1b101cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.912+0000 7f1afcff9700 1 --2- 172.21.15.72:0/2481737678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b10134610 0x7f1b101cd0b0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1b04000c00 tx=0x7f1b04004750 comp rx=0 tx=0).stop 2023-10-03T10:19:02.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.912+0000 7f1afcff9700 1 -- 172.21.15.72:0/2481737678 shutdown_connections 2023-10-03T10:19:02.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.912+0000 7f1afcff9700 1 --2- 172.21.15.72:0/2481737678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b101cd5f0 0x7f1b101c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.912+0000 7f1afcff9700 1 --2- 172.21.15.72:0/2481737678 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f1b1006e570 0x7f1b101ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.912+0000 7f1afcff9700 1 --2- 172.21.15.72:0/2481737678 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b10134610 0x7f1b101cd0b0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.912+0000 7f1afcff9700 1 -- 172.21.15.72:0/2481737678 >> 172.21.15.72:0/2481737678 conn(0x7f1b100a2aa0 msgr2=0x7f1b100a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.913+0000 7f1afcff9700 1 -- 172.21.15.72:0/2481737678 shutdown_connections 2023-10-03T10:19:02.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.913+0000 7f1afcff9700 1 -- 172.21.15.72:0/2481737678 wait complete. 2023-10-03T10:19:02.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:02.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.960+0000 7ff70ebe3700 1 -- 172.21.15.72:0/1332358642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff708074ea0 con 0x7ff70809f240 2023-10-03T10:19:02.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.961+0000 7ff7057fa700 1 -- 172.21.15.72:0/1332358642 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7ff6f4029070 con 0x7ff70809f240 2023-10-03T10:19:02.961 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:02.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.963+0000 7ff70ebe3700 1 -- 172.21.15.72:0/1332358642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff70809f240 msgr2=0x7ff7081a2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.963+0000 7ff70ebe3700 1 --2- 172.21.15.72:0/1332358642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff70809f240 0x7ff7081a2960 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4013000 tx=0x7ff6f4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:02.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.963+0000 7ff70ebe3700 1 -- 172.21.15.72:0/1332358642 shutdown_connections 2023-10-03T10:19:02.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.963+0000 7ff70ebe3700 1 --2- 172.21.15.72:0/1332358642 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff70809f650 0x7ff7081c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.963+0000 7ff70ebe3700 1 --2- 172.21.15.72:0/1332358642 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff70809e930 0x7ff7081a2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.963+0000 7ff70ebe3700 1 --2- 172.21.15.72:0/1332358642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff70809f240 0x7ff7081a2960 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.963+0000 7ff70ebe3700 1 -- 172.21.15.72:0/1332358642 >> 172.21.15.72:0/1332358642 conn(0x7ff7080a4210 msgr2=0x7ff7081b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.963+0000 7ff70ebe3700 1 -- 172.21.15.72:0/1332358642 shutdown_connections 2023-10-03T10:19:02.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.963+0000 7ff70ebe3700 1 -- 172.21.15.72:0/1332358642 wait complete. 2023-10-03T10:19:02.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.969+0000 7f850c645700 1 -- 172.21.15.72:0/26516628 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8504126910 con 0x7f850409e000 2023-10-03T10:19:02.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.969+0000 7f84faffd700 1 -- 172.21.15.72:0/26516628 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84f4010e00 con 0x7f850409e000 2023-10-03T10:19:02.969 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:02.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.971+0000 7f850c645700 1 -- 172.21.15.72:0/26516628 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850409e000 msgr2=0x7f8504122b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.971+0000 7f850c645700 1 --2- 172.21.15.72:0/26516628 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850409e000 0x7f8504122b40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f84f4004000 tx=0x7f84f4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:02.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.971+0000 7f850c645700 1 -- 172.21.15.72:0/26516628 shutdown_connections 2023-10-03T10:19:02.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.971+0000 7f850c645700 1 --2- 172.21.15.72:0/26516628 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f850409e410 0x7f8504123080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.971+0000 7f850c645700 1 --2- 172.21.15.72:0/26516628 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f850409d6f0 0x7f8504122600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.971+0000 7f850c645700 1 --2- 172.21.15.72:0/26516628 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850409e000 0x7f8504122b40 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.971+0000 7f850c645700 1 -- 172.21.15.72:0/26516628 >> 172.21.15.72:0/26516628 conn(0x7f8504066f50 msgr2=0x7f85040a2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.971+0000 7f850c645700 1 -- 172.21.15.72:0/26516628 shutdown_connections 2023-10-03T10:19:02.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:02.971+0000 7f850c645700 1 -- 172.21.15.72:0/26516628 wait complete. 2023-10-03T10:19:02.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:02.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:03.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:03.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.908+0000 7f332ff6d700 1 Processor -- start 2023-10-03T10:19:03.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.908+0000 7f332ff6d700 1 -- start start 2023-10-03T10:19:03.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.909+0000 7f332ff6d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33281338a0 0x7f3328133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.909+0000 7f332ff6d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f332809e930 0x7f332813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.909+0000 7f332ff6d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332806ef30 con 0x7f332809de50 2023-10-03T10:19:03.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.909+0000 7f332ff6d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332806fef0 con 0x7f332809e930 2023-10-03T10:19:03.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.909+0000 7f332ff6d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33281334b0 con 0x7f33281338a0 2023-10-03T10:19:03.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.909+0000 7f332e50a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f332809e930 0x7f332813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.909+0000 7f332e50a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f332809e930 0x7f332813b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40466/0 (socket says 172.21.15.72:40466) 2023-10-03T10:19:03.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.909+0000 7f332e50a700 1 -- 172.21.15.72:0/3803500203 learned_addr learned my addr 172.21.15.72:0/3803500203 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:03.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.909+0000 7f332dd09700 1 --2- 172.21.15.72:0/3803500203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33281338a0 0x7f3328133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.909+0000 7f332e50a700 1 -- 172.21.15.72:0/3803500203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33281338a0 msgr2=0x7f3328133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:03.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.909+0000 7f332e50a700 1 --2- 172.21.15.72:0/3803500203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33281338a0 0x7f3328133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.909+0000 7f332e50a700 1 -- 172.21.15.72:0/3803500203 >> v1:172.21.15.72:6789/0 conn(0x7f332809de50 legacy=0x7f332809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.909+0000 7f332e50a700 1 -- 172.21.15.72:0/3803500203 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332806fc30 con 0x7f332809e930 2023-10-03T10:19:03.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.909+0000 7f332dd09700 1 --2- 172.21.15.72:0/3803500203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33281338a0 0x7f3328133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:03.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.909+0000 7f332e50a700 1 --2- 172.21.15.72:0/3803500203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f332809e930 0x7f332813b740 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f3320009e50 tx=0x7f332000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf4761d0d1c4fe4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:03.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.910+0000 7f332cd07700 1 -- 172.21.15.72:0/3803500203 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332000e070 con 0x7f332809e930 2023-10-03T10:19:03.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.910+0000 7f332cd07700 1 -- 172.21.15.72:0/3803500203 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332000b910 con 0x7f332809e930 2023-10-03T10:19:03.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.910+0000 7f332cd07700 1 -- 172.21.15.72:0/3803500203 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332000bcc0 con 0x7f332809e930 2023-10-03T10:19:03.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.910+0000 7f332ff6d700 1 -- 172.21.15.72:0/3803500203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f332809e930 msgr2=0x7f332813b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.910+0000 7f332ff6d700 1 --2- 172.21.15.72:0/3803500203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f332809e930 0x7f332813b740 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f3320009e50 tx=0x7f332000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:03.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.910+0000 7f332ff6d700 1 -- 172.21.15.72:0/3803500203 shutdown_connections 2023-10-03T10:19:03.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.910+0000 7f332ff6d700 1 --2- 172.21.15.72:0/3803500203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f332809e930 0x7f332813b740 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.910+0000 7f332ff6d700 1 --2- 172.21.15.72:0/3803500203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f33281338a0 0x7f3328133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.910+0000 7f332ff6d700 1 -- 172.21.15.72:0/3803500203 >> 172.21.15.72:0/3803500203 conn(0x7f33280a2aa0 msgr2=0x7f33280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:03.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.910+0000 7f332ff6d700 1 -- 172.21.15.72:0/3803500203 shutdown_connections 2023-10-03T10:19:03.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.910+0000 7f332ff6d700 1 -- 172.21.15.72:0/3803500203 wait complete. 2023-10-03T10:19:03.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.911+0000 7f332ff6d700 1 Processor -- start 2023-10-03T10:19:03.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.911+0000 7f332ff6d700 1 -- start start 2023-10-03T10:19:03.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332ff6d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f332809de50 0x7f332811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332ff6d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f332809e930 0x7f332811abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332ff6d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33281338a0 0x7f332811b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332ff6d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332811bae0 con 0x7f33281338a0 2023-10-03T10:19:03.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332ff6d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332811de80 con 0x7f332809de50 2023-10-03T10:19:03.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332ff6d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33280a1020 con 0x7f332809e930 2023-10-03T10:19:03.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332dd09700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f332809de50 0x7f332811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332dd09700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f332809de50 0x7f332811a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42714/0 (socket says 172.21.15.72:42714) 2023-10-03T10:19:03.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332dd09700 1 -- 172.21.15.72:0/3840764231 learned_addr learned my addr 172.21.15.72:0/3840764231 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:03.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332e50a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33281338a0 0x7f332811b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332d508700 1 --2- 172.21.15.72:0/3840764231 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f332809e930 0x7f332811abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332dd09700 1 -- 172.21.15.72:0/3840764231 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f332809e930 msgr2=0x7f332811abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332dd09700 1 --2- 172.21.15.72:0/3840764231 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f332809e930 0x7f332811abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332dd09700 1 -- 172.21.15.72:0/3840764231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33281338a0 msgr2=0x7f332811b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332dd09700 1 --2- 172.21.15.72:0/3840764231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33281338a0 0x7f332811b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332dd09700 1 -- 172.21.15.72:0/3840764231 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33180094a0 con 0x7f332809de50 2023-10-03T10:19:03.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332e50a700 1 --2- 172.21.15.72:0/3840764231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33281338a0 0x7f332811b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:03.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332dd09700 1 --2- 172.21.15.72:0/3840764231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f332809de50 0x7f332811a680 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f331800ebe0 tx=0x7f331800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:03.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f331e7fc700 1 -- 172.21.15.72:0/3840764231 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331800c850 con 0x7f332809de50 2023-10-03T10:19:03.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f331e7fc700 1 -- 172.21.15.72:0/3840764231 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331800c9b0 con 0x7f332809de50 2023-10-03T10:19:03.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332ff6d700 1 -- 172.21.15.72:0/3840764231 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3320009b30 con 0x7f332809de50 2023-10-03T10:19:03.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f331e7fc700 1 -- 172.21.15.72:0/3840764231 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331800cd40 con 0x7f332809de50 2023-10-03T10:19:03.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.912+0000 7f332ff6d700 1 -- 172.21.15.72:0/3840764231 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332806f640 con 0x7f332809de50 2023-10-03T10:19:03.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.913+0000 7f331e7fc700 1 -- 172.21.15.72:0/3840764231 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3318013470 con 0x7f332809de50 2023-10-03T10:19:03.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.913+0000 7f331e7fc700 1 -- 172.21.15.72:0/3840764231 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f331803f790 con 0x7f332809de50 2023-10-03T10:19:03.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.913+0000 7f332ff6d700 1 -- 172.21.15.72:0/3840764231 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3328074ea0 con 0x7f332809de50 2023-10-03T10:19:03.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:03.918+0000 7f331e7fc700 1 -- 172.21.15.72:0/3840764231 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3318013720 con 0x7f332809de50 2023-10-03T10:19:03.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:03.975 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:03.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:04.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.059+0000 7f2bdfd0c700 1 Processor -- start 2023-10-03T10:19:04.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.060+0000 7f2bdfd0c700 1 -- start start 2023-10-03T10:19:04.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.060+0000 7f2bdfd0c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bd8130540 0x7f2bd8130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.060+0000 7f2bdfd0c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bd8130e50 0x7f2bd806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.060+0000 7f2bdfd0c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd80716a0 con 0x7f2bd806fb20 2023-10-03T10:19:04.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.060+0000 7f2bdfd0c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd809a390 con 0x7f2bd8130540 2023-10-03T10:19:04.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.060+0000 7f2bdfd0c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd8071290 con 0x7f2bd8130e50 2023-10-03T10:19:04.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.060+0000 7f2bdd2a7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bd8130e50 0x7f2bd806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.060+0000 7f2bddaa8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bd8130540 0x7f2bd8130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.060+0000 7f2bdd2a7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bd8130e50 0x7f2bd806f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48110/0 (socket says 172.21.15.72:48110) 2023-10-03T10:19:04.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.060+0000 7f2bdd2a7700 1 -- 172.21.15.72:0/2320173413 learned_addr learned my addr 172.21.15.72:0/2320173413 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:04.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.061+0000 7f2bddaa8700 1 -- 172.21.15.72:0/2320173413 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bd8130e50 msgr2=0x7f2bd806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:04.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.061+0000 7f2bddaa8700 1 --2- 172.21.15.72:0/2320173413 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bd8130e50 0x7f2bd806f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.061+0000 7f2bddaa8700 1 -- 172.21.15.72:0/2320173413 >> v1:172.21.15.72:6789/0 conn(0x7f2bd806fb20 legacy=0x7f2bd8137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.061+0000 7f2bddaa8700 1 -- 172.21.15.72:0/2320173413 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd8130340 con 0x7f2bd8130540 2023-10-03T10:19:04.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.061+0000 7f2bdd2a7700 1 --2- 172.21.15.72:0/2320173413 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bd8130e50 0x7f2bd806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:04.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.061+0000 7f2bddaa8700 1 --2- 172.21.15.72:0/2320173413 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bd8130540 0x7f2bd8130910 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40098a0 tx=0x7f2bd4009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53b278a605552e6f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.061+0000 7f2bdcaa6700 1 -- 172.21.15.72:0/2320173413 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4011830 con 0x7f2bd8130540 2023-10-03T10:19:04.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.061+0000 7f2bdcaa6700 1 -- 172.21.15.72:0/2320173413 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd4011990 con 0x7f2bd8130540 2023-10-03T10:19:04.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.061+0000 7f2bdcaa6700 1 -- 172.21.15.72:0/2320173413 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4011d20 con 0x7f2bd8130540 2023-10-03T10:19:04.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.062+0000 7f2bdfd0c700 1 -- 172.21.15.72:0/2320173413 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bd8130540 msgr2=0x7f2bd8130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.062+0000 7f2bdfd0c700 1 --2- 172.21.15.72:0/2320173413 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bd8130540 0x7f2bd8130910 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40098a0 tx=0x7f2bd4009bb0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.062+0000 7f2bdfd0c700 1 -- 172.21.15.72:0/2320173413 shutdown_connections 2023-10-03T10:19:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.062+0000 7f2bdfd0c700 1 --2- 172.21.15.72:0/2320173413 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bd8130540 0x7f2bd8130910 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.062+0000 7f2bdfd0c700 1 --2- 172.21.15.72:0/2320173413 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bd8130e50 0x7f2bd806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.062+0000 7f2bdfd0c700 1 -- 172.21.15.72:0/2320173413 >> 172.21.15.72:0/2320173413 conn(0x7f2bd80a2aa0 msgr2=0x7f2bd80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.062+0000 7f2bdfd0c700 1 -- 172.21.15.72:0/2320173413 shutdown_connections 2023-10-03T10:19:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.062+0000 7f2bdfd0c700 1 -- 172.21.15.72:0/2320173413 wait complete. 2023-10-03T10:19:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.063+0000 7f2bdfd0c700 1 Processor -- start 2023-10-03T10:19:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.063+0000 7f2bdfd0c700 1 -- start start 2023-10-03T10:19:04.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.063+0000 7f2bdfd0c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bd806fb20 0x7f2bd811a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.063+0000 7f2bdfd0c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bd8130540 0x7f2bd811ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.063+0000 7f2bdfd0c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bd8130e50 0x7f2bd811b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.063+0000 7f2bdfd0c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd811d120 con 0x7f2bd806fb20 2023-10-03T10:19:04.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.063+0000 7f2bdfd0c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd811c3f0 con 0x7f2bd8130540 2023-10-03T10:19:04.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.063+0000 7f2bdfd0c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd811d550 con 0x7f2bd8130e50 2023-10-03T10:19:04.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.064+0000 7f2bddaa8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bd806fb20 0x7f2bd811a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.064+0000 7f2bddaa8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bd806fb20 0x7f2bd811a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40486/0 (socket says 172.21.15.72:40486) 2023-10-03T10:19:04.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.064+0000 7f2bddaa8700 1 -- 172.21.15.72:0/1550830384 learned_addr learned my addr 172.21.15.72:0/1550830384 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:04.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.064+0000 7f2bde2a9700 1 --2- 172.21.15.72:0/1550830384 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bd8130e50 0x7f2bd811b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.064+0000 7f2bdd2a7700 1 --2- 172.21.15.72:0/1550830384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bd8130540 0x7f2bd811ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.064+0000 7f2bddaa8700 1 -- 172.21.15.72:0/1550830384 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bd8130e50 msgr2=0x7f2bd811b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.064+0000 7f2bddaa8700 1 --2- 172.21.15.72:0/1550830384 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bd8130e50 0x7f2bd811b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.064+0000 7f2bddaa8700 1 -- 172.21.15.72:0/1550830384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bd8130540 msgr2=0x7f2bd811ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.064+0000 7f2bddaa8700 1 --2- 172.21.15.72:0/1550830384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bd8130540 0x7f2bd811ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.064+0000 7f2bddaa8700 1 -- 172.21.15.72:0/1550830384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc8009550 con 0x7f2bd806fb20 2023-10-03T10:19:04.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.064+0000 7f2bdd2a7700 1 --2- 172.21.15.72:0/1550830384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bd8130540 0x7f2bd811ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:04.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.064+0000 7f2bddaa8700 1 --2- 172.21.15.72:0/1550830384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bd806fb20 0x7f2bd811a8d0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40090b0 tx=0x7f2bd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.064+0000 7f2bce7fc700 1 -- 172.21.15.72:0/1550830384 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4004450 con 0x7f2bd806fb20 2023-10-03T10:19:04.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.065+0000 7f2bce7fc700 1 -- 172.21.15.72:0/1550830384 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd401f070 con 0x7f2bd806fb20 2023-10-03T10:19:04.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.065+0000 7f2bdfd0c700 1 -- 172.21.15.72:0/1550830384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd40094a0 con 0x7f2bd806fb20 2023-10-03T10:19:04.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.065+0000 7f2bce7fc700 1 -- 172.21.15.72:0/1550830384 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40038e0 con 0x7f2bd806fb20 2023-10-03T10:19:04.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.065+0000 7f2bdfd0c700 1 -- 172.21.15.72:0/1550830384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd811dec0 con 0x7f2bd806fb20 2023-10-03T10:19:04.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.066+0000 7f2bce7fc700 1 -- 172.21.15.72:0/1550830384 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2bd4003a40 con 0x7f2bd806fb20 2023-10-03T10:19:04.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.066+0000 7f2bce7fc700 1 -- 172.21.15.72:0/1550830384 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2bd4021070 con 0x7f2bd806fb20 2023-10-03T10:19:04.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.066+0000 7f2bdfd0c700 1 -- 172.21.15.72:0/1550830384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd811e2a0 con 0x7f2bd806fb20 2023-10-03T10:19:04.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.075+0000 7f2bce7fc700 1 -- 172.21.15.72:0/1550830384 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2bd4015080 con 0x7f2bd806fb20 2023-10-03T10:19:04.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.114+0000 7fec561e6700 1 Processor -- start 2023-10-03T10:19:04.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.114+0000 7fec561e6700 1 -- start start 2023-10-03T10:19:04.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.115+0000 7fec561e6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec5009d6f0 0x7fec5009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.115+0000 7fec561e6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec5009e000 0x7fec50130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.115+0000 7fec561e6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5009f130 con 0x7fec5009e410 2023-10-03T10:19:04.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.115+0000 7fec561e6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5009f520 con 0x7fec5009e000 2023-10-03T10:19:04.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.115+0000 7fec561e6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec5009e930 con 0x7fec5009d6f0 2023-10-03T10:19:04.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.115+0000 7fec4f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec5009d6f0 0x7fec5009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.115+0000 7fec4f7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec5009d6f0 0x7fec5009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48124/0 (socket says 172.21.15.72:48124) 2023-10-03T10:19:04.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.115+0000 7fec4f7fe700 1 -- 172.21.15.72:0/3465127473 learned_addr learned my addr 172.21.15.72:0/3465127473 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:04.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.115+0000 7fec4effd700 1 --2- 172.21.15.72:0/3465127473 >> v2:172.21.15.72:3300/0 conn(0x7fec5009e000 0x7fec50130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.115+0000 7fec4f7fe700 1 -- 172.21.15.72:0/3465127473 >> v2:172.21.15.72:3300/0 conn(0x7fec5009e000 msgr2=0x7fec50130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:04.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.115+0000 7fec4f7fe700 1 --2- 172.21.15.72:0/3465127473 >> v2:172.21.15.72:3300/0 conn(0x7fec5009e000 0x7fec50130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.115+0000 7fec4f7fe700 1 -- 172.21.15.72:0/3465127473 >> v1:172.21.15.72:6789/0 conn(0x7fec5009e410 legacy=0x7fec50130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.115+0000 7fec4f7fe700 1 -- 172.21.15.72:0/3465127473 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5009b2d0 con 0x7fec5009d6f0 2023-10-03T10:19:04.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.115+0000 7fec4f7fe700 1 --2- 172.21.15.72:0/3465127473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec5009d6f0 0x7fec5009dac0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fec400098f0 tx=0x7fec40009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6732364f064fd1ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.116+0000 7fec4e7fc700 1 -- 172.21.15.72:0/3465127473 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec40011830 con 0x7fec5009d6f0 2023-10-03T10:19:04.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.116+0000 7fec4e7fc700 1 -- 172.21.15.72:0/3465127473 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec40011990 con 0x7fec5009d6f0 2023-10-03T10:19:04.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.116+0000 7fec4e7fc700 1 -- 172.21.15.72:0/3465127473 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec40011d20 con 0x7fec5009d6f0 2023-10-03T10:19:04.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.116+0000 7fec561e6700 1 -- 172.21.15.72:0/3465127473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec5009d6f0 msgr2=0x7fec5009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.116+0000 7fec561e6700 1 --2- 172.21.15.72:0/3465127473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec5009d6f0 0x7fec5009dac0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fec400098f0 tx=0x7fec40009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:04.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.117+0000 7fec561e6700 1 -- 172.21.15.72:0/3465127473 shutdown_connections 2023-10-03T10:19:04.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.117+0000 7fec561e6700 1 --2- 172.21.15.72:0/3465127473 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec5009d6f0 0x7fec5009dac0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.117+0000 7fec561e6700 1 --2- 172.21.15.72:0/3465127473 >> v2:172.21.15.72:3300/0 conn(0x7fec5009e000 0x7fec50130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.117+0000 7fec561e6700 1 -- 172.21.15.72:0/3465127473 >> 172.21.15.72:0/3465127473 conn(0x7fec50066f50 msgr2=0x7fec5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.117+0000 7fec561e6700 1 -- 172.21.15.72:0/3465127473 shutdown_connections 2023-10-03T10:19:04.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.117+0000 7fec561e6700 1 -- 172.21.15.72:0/3465127473 wait complete. 2023-10-03T10:19:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.118+0000 7fec561e6700 1 Processor -- start 2023-10-03T10:19:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.118+0000 7fec561e6700 1 -- start start 2023-10-03T10:19:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec561e6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5009d6f0 0x7fec5006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec561e6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec5009e000 0x7fec5006ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec561e6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec5009e410 0x7fec5006f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec561e6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec500703e0 con 0x7fec5009d6f0 2023-10-03T10:19:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec561e6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec500a1f50 con 0x7fec5009e410 2023-10-03T10:19:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec561e6700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec50125c70 con 0x7fec5009e000 2023-10-03T10:19:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec4ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec5009e410 0x7fec5006f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec4effd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec5009e000 0x7fec5006ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec4ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec5009e410 0x7fec5006f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42744/0 (socket says 172.21.15.72:42744) 2023-10-03T10:19:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec4ffff700 1 -- 172.21.15.72:0/272672622 learned_addr learned my addr 172.21.15.72:0/272672622 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec4f7fe700 1 --2- 172.21.15.72:0/272672622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5009d6f0 0x7fec5006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec4ffff700 1 -- 172.21.15.72:0/272672622 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec5009e000 msgr2=0x7fec5006ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec4ffff700 1 --2- 172.21.15.72:0/272672622 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec5009e000 0x7fec5006ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec4ffff700 1 -- 172.21.15.72:0/272672622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5009d6f0 msgr2=0x7fec5006e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec4ffff700 1 --2- 172.21.15.72:0/272672622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5009d6f0 0x7fec5006e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.119+0000 7fec4ffff700 1 -- 172.21.15.72:0/272672622 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec40009550 con 0x7fec5009e410 2023-10-03T10:19:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.120+0000 7fec4ffff700 1 --2- 172.21.15.72:0/272672622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec5009e410 0x7fec5006f2c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fec4800cbc0 tx=0x7fec4800ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.122+0000 7fec37fff700 1 -- 172.21.15.72:0/272672622 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48003c00 con 0x7fec5009e410 2023-10-03T10:19:04.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.122+0000 7fec37fff700 1 -- 172.21.15.72:0/272672622 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec48003d60 con 0x7fec5009e410 2023-10-03T10:19:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.122+0000 7fec561e6700 1 -- 172.21.15.72:0/272672622 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec50125ee0 con 0x7fec5009e410 2023-10-03T10:19:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.122+0000 7fec37fff700 1 -- 172.21.15.72:0/272672622 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4800aae0 con 0x7fec5009e410 2023-10-03T10:19:04.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.122+0000 7fec561e6700 1 -- 172.21.15.72:0/272672622 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec501265e0 con 0x7fec5009e410 2023-10-03T10:19:04.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.123+0000 7fec37fff700 1 -- 172.21.15.72:0/272672622 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec4800ac40 con 0x7fec5009e410 2023-10-03T10:19:04.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.123+0000 7fec561e6700 1 -- 172.21.15.72:0/272672622 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec501258a0 con 0x7fec5009e410 2023-10-03T10:19:04.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.123+0000 7fec37fff700 1 -- 172.21.15.72:0/272672622 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fec4803f700 con 0x7fec5009e410 2023-10-03T10:19:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.125+0000 7f332ff6d700 1 -- 172.21.15.72:0/3840764231 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f332806b9e0 con 0x7f332809de50 2023-10-03T10:19:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.132+0000 7fec37fff700 1 -- 172.21.15.72:0/272672622 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec480198f0 con 0x7fec5009e410 2023-10-03T10:19:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.133+0000 7f331e7fc700 1 -- 172.21.15.72:0/3840764231 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f331802a090 con 0x7f332809de50 2023-10-03T10:19:04.132 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.135+0000 7f332ff6d700 1 -- 172.21.15.72:0/3840764231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f332809de50 msgr2=0x7f332811a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.135+0000 7f332ff6d700 1 --2- 172.21.15.72:0/3840764231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f332809de50 0x7f332811a680 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f331800ebe0 tx=0x7f331800eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.135+0000 7f332ff6d700 1 -- 172.21.15.72:0/3840764231 shutdown_connections 2023-10-03T10:19:04.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.135+0000 7f332ff6d700 1 --2- 172.21.15.72:0/3840764231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33281338a0 0x7f332811b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.135+0000 7f332ff6d700 1 --2- 172.21.15.72:0/3840764231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f332809de50 0x7f332811a680 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.135+0000 7f332ff6d700 1 --2- 172.21.15.72:0/3840764231 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f332809e930 0x7f332811abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.135+0000 7f332ff6d700 1 -- 172.21.15.72:0/3840764231 >> 172.21.15.72:0/3840764231 conn(0x7f33280a2aa0 msgr2=0x7f3328130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.135+0000 7f332ff6d700 1 -- 172.21.15.72:0/3840764231 shutdown_connections 2023-10-03T10:19:04.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.135+0000 7f332ff6d700 1 -- 172.21.15.72:0/3840764231 wait complete. 2023-10-03T10:19:04.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.161+0000 7f427fbed700 1 Processor -- start 2023-10-03T10:19:04.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.161+0000 7f427fbed700 1 -- start start 2023-10-03T10:19:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.161+0000 7f427fbed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278133420 0x7f42781337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.161+0000 7f427fbed700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4278134260 0x7f42781306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.161+0000 7f427fbed700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427806b990 con 0x7f4278133e30 2023-10-03T10:19:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.161+0000 7f427fbed700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42780a0590 con 0x7f4278134260 2023-10-03T10:19:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.161+0000 7f427fbed700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427809fb80 con 0x7f4278133420 2023-10-03T10:19:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.162+0000 7f427d989700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278133420 0x7f42781337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.162+0000 7f427d989700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278133420 0x7f42781337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42760/0 (socket says 172.21.15.72:42760) 2023-10-03T10:19:04.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.162+0000 7f427d989700 1 -- 172.21.15.72:0/782338005 learned_addr learned my addr 172.21.15.72:0/782338005 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.162+0000 7f427e18a700 1 --2- 172.21.15.72:0/782338005 >> v2:172.21.15.72:3300/0 conn(0x7f4278134260 0x7f42781306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.162+0000 7f427d989700 1 -- 172.21.15.72:0/782338005 >> v2:172.21.15.72:3300/0 conn(0x7f4278134260 msgr2=0x7f42781306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.162+0000 7f427d989700 1 --2- 172.21.15.72:0/782338005 >> v2:172.21.15.72:3300/0 conn(0x7f4278134260 0x7f42781306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.162+0000 7f427d989700 1 -- 172.21.15.72:0/782338005 >> v1:172.21.15.72:6789/0 conn(0x7f4278133e30 legacy=0x7f427812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.162+0000 7f427d989700 1 -- 172.21.15.72:0/782338005 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42780a0030 con 0x7f4278133420 2023-10-03T10:19:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.162+0000 7f427d989700 1 --2- 172.21.15.72:0/782338005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278133420 0x7f42781337f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f42740098f0 tx=0x7f4274009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a17a70d4d5240dc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.162+0000 7f427c987700 1 -- 172.21.15.72:0/782338005 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274011830 con 0x7f4278133420 2023-10-03T10:19:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.162+0000 7f427c987700 1 -- 172.21.15.72:0/782338005 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4274011990 con 0x7f4278133420 2023-10-03T10:19:04.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.162+0000 7f427c987700 1 -- 172.21.15.72:0/782338005 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274011d20 con 0x7f4278133420 2023-10-03T10:19:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.163+0000 7f427fbed700 1 -- 172.21.15.72:0/782338005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278133420 msgr2=0x7f42781337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.163+0000 7f427fbed700 1 --2- 172.21.15.72:0/782338005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278133420 0x7f42781337f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f42740098f0 tx=0x7f4274009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.163+0000 7f427fbed700 1 -- 172.21.15.72:0/782338005 shutdown_connections 2023-10-03T10:19:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.163+0000 7f427fbed700 1 --2- 172.21.15.72:0/782338005 >> v2:172.21.15.72:3300/0 conn(0x7f4278134260 0x7f42781306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.163+0000 7f427fbed700 1 --2- 172.21.15.72:0/782338005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278133420 0x7f42781337f0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.163+0000 7f427fbed700 1 -- 172.21.15.72:0/782338005 >> 172.21.15.72:0/782338005 conn(0x7f42780a4210 msgr2=0x7f42780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.163+0000 7f427fbed700 1 -- 172.21.15.72:0/782338005 shutdown_connections 2023-10-03T10:19:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.163+0000 7f427fbed700 1 -- 172.21.15.72:0/782338005 wait complete. 2023-10-03T10:19:04.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.164+0000 7f427fbed700 1 Processor -- start 2023-10-03T10:19:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.164+0000 7f427fbed700 1 -- start start 2023-10-03T10:19:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.164+0000 7f427fbed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278133420 0x7f427809c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.164+0000 7f427fbed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4278133e30 0x7f427809c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.164+0000 7f427fbed700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4278134260 0x7f427809ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.164+0000 7f427fbed700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427809d840 con 0x7f4278133e30 2023-10-03T10:19:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.164+0000 7f427fbed700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427809dfb0 con 0x7f4278133420 2023-10-03T10:19:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.164+0000 7f427fbed700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f427812d770 con 0x7f4278134260 2023-10-03T10:19:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.164+0000 7f427d989700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278133420 0x7f427809c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.164+0000 7f427d989700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278133420 0x7f427809c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42770/0 (socket says 172.21.15.72:42770) 2023-10-03T10:19:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.164+0000 7f427d989700 1 -- 172.21.15.72:0/3394878216 learned_addr learned my addr 172.21.15.72:0/3394878216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:04.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.165+0000 7f427d188700 1 --2- 172.21.15.72:0/3394878216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4278133e30 0x7f427809c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.165+0000 7f427e18a700 1 --2- 172.21.15.72:0/3394878216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4278134260 0x7f427809ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.165+0000 7f427d989700 1 -- 172.21.15.72:0/3394878216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4278134260 msgr2=0x7f427809ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.165+0000 7f427d989700 1 --2- 172.21.15.72:0/3394878216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4278134260 0x7f427809ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.165+0000 7f427d989700 1 -- 172.21.15.72:0/3394878216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4278133e30 msgr2=0x7f427809c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.165+0000 7f427d989700 1 --2- 172.21.15.72:0/3394878216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4278133e30 0x7f427809c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.165+0000 7f427d989700 1 -- 172.21.15.72:0/3394878216 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4274009550 con 0x7f4278133420 2023-10-03T10:19:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.165+0000 7f427e18a700 1 --2- 172.21.15.72:0/3394878216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4278134260 0x7f427809ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.165+0000 7f427d989700 1 --2- 172.21.15.72:0/3394878216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278133420 0x7f427809c3e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f4274000c00 tx=0x7f4274004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.165+0000 7f426e7fc700 1 -- 172.21.15.72:0/3394878216 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42740036a0 con 0x7f4278133420 2023-10-03T10:19:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.165+0000 7f426e7fc700 1 -- 172.21.15.72:0/3394878216 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4274003800 con 0x7f4278133420 2023-10-03T10:19:04.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.165+0000 7f426e7fc700 1 -- 172.21.15.72:0/3394878216 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274003bd0 con 0x7f4278133420 2023-10-03T10:19:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.165+0000 7f427fbed700 1 -- 172.21.15.72:0/3394878216 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427811fd10 con 0x7f4278133420 2023-10-03T10:19:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.165+0000 7f427fbed700 1 -- 172.21.15.72:0/3394878216 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427811f950 con 0x7f4278133420 2023-10-03T10:19:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.166+0000 7f426e7fc700 1 -- 172.21.15.72:0/3394878216 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4274021070 con 0x7f4278133420 2023-10-03T10:19:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.166+0000 7f426e7fc700 1 -- 172.21.15.72:0/3394878216 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4274040c40 con 0x7f4278133420 2023-10-03T10:19:04.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.166+0000 7f427fbed700 1 -- 172.21.15.72:0/3394878216 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4278074ea0 con 0x7f4278133420 2023-10-03T10:19:04.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.171+0000 7f426e7fc700 1 -- 172.21.15.72:0/3394878216 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4274029080 con 0x7f4278133420 2023-10-03T10:19:04.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.308+0000 7f2bdfd0c700 1 -- 172.21.15.72:0/1550830384 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2bd8074ea0 con 0x7f2bd806fb20 2023-10-03T10:19:04.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.309+0000 7f2bce7fc700 1 -- 172.21.15.72:0/1550830384 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2bd402b020 con 0x7f2bd806fb20 2023-10-03T10:19:04.308 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.312+0000 7f2bdfd0c700 1 -- 172.21.15.72:0/1550830384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bd806fb20 msgr2=0x7f2bd811a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.312+0000 7f2bdfd0c700 1 --2- 172.21.15.72:0/1550830384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bd806fb20 0x7f2bd811a8d0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40090b0 tx=0x7f2bd4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:04.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.312+0000 7f2bdfd0c700 1 -- 172.21.15.72:0/1550830384 shutdown_connections 2023-10-03T10:19:04.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.312+0000 7f2bdfd0c700 1 --2- 172.21.15.72:0/1550830384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bd806fb20 0x7f2bd811a8d0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.312+0000 7f2bdfd0c700 1 --2- 172.21.15.72:0/1550830384 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2bd8130e50 0x7f2bd811b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.312+0000 7f2bdfd0c700 1 --2- 172.21.15.72:0/1550830384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2bd8130540 0x7f2bd811ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.312+0000 7f2bdfd0c700 1 -- 172.21.15.72:0/1550830384 >> 172.21.15.72:0/1550830384 conn(0x7f2bd80a2aa0 msgr2=0x7f2bd809d370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.312+0000 7f2bdfd0c700 1 -- 172.21.15.72:0/1550830384 shutdown_connections 2023-10-03T10:19:04.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.312+0000 7f2bdfd0c700 1 -- 172.21.15.72:0/1550830384 wait complete. 2023-10-03T10:19:04.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.328+0000 7fec561e6700 1 -- 172.21.15.72:0/272672622 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fec50074ea0 con 0x7fec5009e410 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.328+0000 7fec37fff700 1 -- 172.21.15.72:0/272672622 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fec48019300 con 0x7fec5009e410 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:04.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.330+0000 7fec561e6700 1 -- 172.21.15.72:0/272672622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec5009e410 msgr2=0x7fec5006f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.330+0000 7fec561e6700 1 --2- 172.21.15.72:0/272672622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec5009e410 0x7fec5006f2c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fec4800cbc0 tx=0x7fec4800ced0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.330+0000 7fec561e6700 1 -- 172.21.15.72:0/272672622 shutdown_connections 2023-10-03T10:19:04.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.330+0000 7fec561e6700 1 --2- 172.21.15.72:0/272672622 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec5009d6f0 0x7fec5006e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.330+0000 7fec561e6700 1 --2- 172.21.15.72:0/272672622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec5009e410 0x7fec5006f2c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.330+0000 7fec561e6700 1 --2- 172.21.15.72:0/272672622 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fec5009e000 0x7fec5006ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.330+0000 7fec561e6700 1 -- 172.21.15.72:0/272672622 >> 172.21.15.72:0/272672622 conn(0x7fec50066f50 msgr2=0x7fec5006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.330+0000 7fec561e6700 1 -- 172.21.15.72:0/272672622 shutdown_connections 2023-10-03T10:19:04.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.330+0000 7fec561e6700 1 -- 172.21.15.72:0/272672622 wait complete. 2023-10-03T10:19:04.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:04.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.385+0000 7f427fbed700 1 -- 172.21.15.72:0/3394878216 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f427811fae0 con 0x7f4278133420 2023-10-03T10:19:04.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.385+0000 7f426e7fc700 1 -- 172.21.15.72:0/3394878216 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4274033090 con 0x7f4278133420 2023-10-03T10:19:04.386 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.387+0000 7f427fbed700 1 -- 172.21.15.72:0/3394878216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278133420 msgr2=0x7f427809c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.387+0000 7f427fbed700 1 --2- 172.21.15.72:0/3394878216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278133420 0x7f427809c3e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f4274000c00 tx=0x7f4274004750 comp rx=0 tx=0).stop 2023-10-03T10:19:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.387+0000 7f427fbed700 1 -- 172.21.15.72:0/3394878216 shutdown_connections 2023-10-03T10:19:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.387+0000 7f427fbed700 1 --2- 172.21.15.72:0/3394878216 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4278134260 0x7f427809ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.387+0000 7f427fbed700 1 --2- 172.21.15.72:0/3394878216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278133420 0x7f427809c3e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.387+0000 7f427fbed700 1 --2- 172.21.15.72:0/3394878216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4278133e30 0x7f427809c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.387+0000 7f427fbed700 1 -- 172.21.15.72:0/3394878216 >> 172.21.15.72:0/3394878216 conn(0x7f42780a4210 msgr2=0x7f42780a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.387+0000 7f427fbed700 1 -- 172.21.15.72:0/3394878216 shutdown_connections 2023-10-03T10:19:04.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:04.387+0000 7f427fbed700 1 -- 172.21.15.72:0/3394878216 wait complete. 2023-10-03T10:19:04.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:05.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:05.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.273+0000 7fefda835700 1 Processor -- start 2023-10-03T10:19:05.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.273+0000 7fefda835700 1 -- start start 2023-10-03T10:19:05.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefda835700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefd4133420 0x7fefd41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefda835700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefd4134260 0x7fefd41306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefda835700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd406b990 con 0x7fefd4133e30 2023-10-03T10:19:05.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefda835700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd40a0590 con 0x7fefd4133420 2023-10-03T10:19:05.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefda835700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefd409fb80 con 0x7fefd4134260 2023-10-03T10:19:05.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefd4133420 0x7fefd41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefd8dd2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefd4134260 0x7fefd41306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefd37fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fefd4133e30 0x7fefd412ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33412/0 (socket says 172.21.15.72:33412) 2023-10-03T10:19:05.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefd37fe700 1 -- 172.21.15.72:0/3041008947 learned_addr learned my addr 172.21.15.72:0/3041008947 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:05.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefd2ffd700 1 -- 172.21.15.72:0/3041008947 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116758044 0 0) 0x7fefd406b990 con 0x7fefd4133e30 2023-10-03T10:19:05.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefd8dd2700 1 -- 172.21.15.72:0/3041008947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefd4133420 msgr2=0x7fefd41337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefd8dd2700 1 --2- 172.21.15.72:0/3041008947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefd4133420 0x7fefd41337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefd8dd2700 1 -- 172.21.15.72:0/3041008947 >> v1:172.21.15.72:6789/0 conn(0x7fefd4133e30 legacy=0x7fefd412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefd8dd2700 1 -- 172.21.15.72:0/3041008947 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd40a0030 con 0x7fefd4134260 2023-10-03T10:19:05.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefd3fff700 1 --2- 172.21.15.72:0/3041008947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefd4133420 0x7fefd41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.274+0000 7fefd8dd2700 1 --2- 172.21.15.72:0/3041008947 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefd4134260 0x7fefd41306a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fefcc009dc0 tx=0x7fefcc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d69ab92935a3e81 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.275+0000 7fefd2ffd700 1 -- 172.21.15.72:0/3041008947 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc00e070 con 0x7fefd4134260 2023-10-03T10:19:05.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.275+0000 7fefd2ffd700 1 -- 172.21.15.72:0/3041008947 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc00bb20 con 0x7fefd4134260 2023-10-03T10:19:05.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.275+0000 7fefd2ffd700 1 -- 172.21.15.72:0/3041008947 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc012430 con 0x7fefd4134260 2023-10-03T10:19:05.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.275+0000 7fefda835700 1 -- 172.21.15.72:0/3041008947 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefd4134260 msgr2=0x7fefd41306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.275+0000 7fefda835700 1 --2- 172.21.15.72:0/3041008947 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefd4134260 0x7fefd41306a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fefcc009dc0 tx=0x7fefcc00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:05.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.275+0000 7fefda835700 1 -- 172.21.15.72:0/3041008947 shutdown_connections 2023-10-03T10:19:05.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.275+0000 7fefda835700 1 --2- 172.21.15.72:0/3041008947 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefd4134260 0x7fefd41306a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.275+0000 7fefda835700 1 --2- 172.21.15.72:0/3041008947 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefd4133420 0x7fefd41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.275+0000 7fefda835700 1 -- 172.21.15.72:0/3041008947 >> 172.21.15.72:0/3041008947 conn(0x7fefd40a4210 msgr2=0x7fefd40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.275+0000 7fefda835700 1 -- 172.21.15.72:0/3041008947 shutdown_connections 2023-10-03T10:19:05.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.275+0000 7fefda835700 1 -- 172.21.15.72:0/3041008947 wait complete. 2023-10-03T10:19:05.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.276+0000 7fefda835700 1 Processor -- start 2023-10-03T10:19:05.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.276+0000 7fefda835700 1 -- start start 2023-10-03T10:19:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefda835700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefd4133420 0x7fefd409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefda835700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd4133e30 0x7fefd409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefda835700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefd4134260 0x7fefd409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefda835700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd409de30 con 0x7fefd4133e30 2023-10-03T10:19:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefda835700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd411edf0 con 0x7fefd4134260 2023-10-03T10:19:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefda835700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefd411faf0 con 0x7fefd4133420 2023-10-03T10:19:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefd4133420 0x7fefd409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd3fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefd4133420 0x7fefd409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48166/0 (socket says 172.21.15.72:48166) 2023-10-03T10:19:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd4133e30 0x7fefd409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd3fff700 1 -- 172.21.15.72:0/4142705896 learned_addr learned my addr 172.21.15.72:0/4142705896 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:05.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd8dd2700 1 --2- 172.21.15.72:0/4142705896 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefd4134260 0x7fefd409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd3fff700 1 -- 172.21.15.72:0/4142705896 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefd4134260 msgr2=0x7fefd409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd3fff700 1 --2- 172.21.15.72:0/4142705896 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefd4134260 0x7fefd409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd3fff700 1 -- 172.21.15.72:0/4142705896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd4133e30 msgr2=0x7fefd409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd3fff700 1 --2- 172.21.15.72:0/4142705896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd4133e30 0x7fefd409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd3fff700 1 -- 172.21.15.72:0/4142705896 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc0094a0 con 0x7fefd4133420 2023-10-03T10:19:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd8dd2700 1 --2- 172.21.15.72:0/4142705896 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefd4134260 0x7fefd409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd37fe700 1 --2- 172.21.15.72:0/4142705896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd4133e30 0x7fefd409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd3fff700 1 --2- 172.21.15.72:0/4142705896 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefd4133420 0x7fefd409c480 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00ebe0 tx=0x7fefbc00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd0ff9700 1 -- 172.21.15.72:0/4142705896 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc00c850 con 0x7fefd4133420 2023-10-03T10:19:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd0ff9700 1 -- 172.21.15.72:0/4142705896 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefbc00c9b0 con 0x7fefd4133420 2023-10-03T10:19:05.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefda835700 1 -- 172.21.15.72:0/4142705896 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefcc009a70 con 0x7fefd4133420 2023-10-03T10:19:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefd0ff9700 1 -- 172.21.15.72:0/4142705896 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc00cd40 con 0x7fefd4133420 2023-10-03T10:19:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.277+0000 7fefda835700 1 -- 172.21.15.72:0/4142705896 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd411fdb0 con 0x7fefd4133420 2023-10-03T10:19:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.278+0000 7fefd0ff9700 1 -- 172.21.15.72:0/4142705896 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fefbc013470 con 0x7fefd4133420 2023-10-03T10:19:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.278+0000 7fefda835700 1 -- 172.21.15.72:0/4142705896 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd4074ea0 con 0x7fefd4133420 2023-10-03T10:19:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.278+0000 7fefd0ff9700 1 -- 172.21.15.72:0/4142705896 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fefbc03fb40 con 0x7fefd4133420 2023-10-03T10:19:05.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.283+0000 7fefd0ff9700 1 -- 172.21.15.72:0/4142705896 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fefbc00cea0 con 0x7fefd4133420 2023-10-03T10:19:05.329 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:05.343 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:05.400 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.456+0000 7f9783e10700 1 Processor -- start 2023-10-03T10:19:05.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.456+0000 7f9783e10700 1 -- start start 2023-10-03T10:19:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.456+0000 7f9783e10700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f977c131810 0x7f977c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.456+0000 7f9783e10700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f977c099a40 0x7f977c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.456+0000 7f9783e10700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f977c09a3b0 0x7f977c138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.456+0000 7f9783e10700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c1313c0 con 0x7f977c099a40 2023-10-03T10:19:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.456+0000 7f9783e10700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c06e8c0 con 0x7f977c131810 2023-10-03T10:19:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.456+0000 7f9783e10700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f977c09a820 con 0x7f977c09a3b0 2023-10-03T10:19:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.456+0000 7f97813ab700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f977c099a40 0x7f977c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.456+0000 7f9781bac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f977c131810 0x7f977c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.456+0000 7f97813ab700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f977c099a40 0x7f977c099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40548/0 (socket says 172.21.15.72:40548) 2023-10-03T10:19:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.457+0000 7f97813ab700 1 -- 172.21.15.72:0/2942733043 learned_addr learned my addr 172.21.15.72:0/2942733043 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.457+0000 7f97823ad700 1 --2- 172.21.15.72:0/2942733043 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f977c09a3b0 0x7f977c138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.457+0000 7f97813ab700 1 -- 172.21.15.72:0/2942733043 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f977c09a3b0 msgr2=0x7f977c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.457+0000 7f97813ab700 1 --2- 172.21.15.72:0/2942733043 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f977c09a3b0 0x7f977c138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.457+0000 7f97813ab700 1 -- 172.21.15.72:0/2942733043 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f977c131810 msgr2=0x7f977c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.457+0000 7f97813ab700 1 --2- 172.21.15.72:0/2942733043 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f977c131810 0x7f977c131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.457+0000 7f97813ab700 1 -- 172.21.15.72:0/2942733043 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c071d20 con 0x7f977c099a40 2023-10-03T10:19:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.457+0000 7f97813ab700 1 --2- 172.21.15.72:0/2942733043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c099a40 0x7f977c099e70 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f976c0098f0 tx=0x7f976c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744639228b8aeafc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.457+0000 7f9780baa700 1 -- 172.21.15.72:0/2942733043 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c011830 con 0x7f977c099a40 2023-10-03T10:19:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.457+0000 7f9780baa700 1 -- 172.21.15.72:0/2942733043 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c011990 con 0x7f977c099a40 2023-10-03T10:19:05.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.457+0000 7f9780baa700 1 -- 172.21.15.72:0/2942733043 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c011d20 con 0x7f977c099a40 2023-10-03T10:19:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.458+0000 7f9783e10700 1 -- 172.21.15.72:0/2942733043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c099a40 msgr2=0x7f977c099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.458+0000 7f9783e10700 1 --2- 172.21.15.72:0/2942733043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c099a40 0x7f977c099e70 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f976c0098f0 tx=0x7f976c009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.458+0000 7f9783e10700 1 -- 172.21.15.72:0/2942733043 shutdown_connections 2023-10-03T10:19:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.458+0000 7f9783e10700 1 --2- 172.21.15.72:0/2942733043 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f977c09a3b0 0x7f977c138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.458+0000 7f9783e10700 1 --2- 172.21.15.72:0/2942733043 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f977c131810 0x7f977c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.458+0000 7f9783e10700 1 --2- 172.21.15.72:0/2942733043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c099a40 0x7f977c099e70 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.458+0000 7f9783e10700 1 -- 172.21.15.72:0/2942733043 >> 172.21.15.72:0/2942733043 conn(0x7f977c0a2aa0 msgr2=0x7f977c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.458+0000 7f9783e10700 1 -- 172.21.15.72:0/2942733043 shutdown_connections 2023-10-03T10:19:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.458+0000 7f9783e10700 1 -- 172.21.15.72:0/2942733043 wait complete. 2023-10-03T10:19:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.459+0000 7f9783e10700 1 Processor -- start 2023-10-03T10:19:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.459+0000 7f9783e10700 1 -- start start 2023-10-03T10:19:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.459+0000 7f9783e10700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f977c099a40 0x7f977c119640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.459+0000 7f9783e10700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c09a3b0 0x7f977c119b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.459+0000 7f9783e10700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f977c131810 0x7f977c11a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.459+0000 7f9783e10700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c11c8f0 con 0x7f977c09a3b0 2023-10-03T10:19:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.459+0000 7f9783e10700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c06eb00 con 0x7f977c131810 2023-10-03T10:19:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.459+0000 7f9783e10700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0a1c80 con 0x7f977c099a40 2023-10-03T10:19:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f9781bac700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f977c099a40 0x7f977c119640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f9781bac700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f977c099a40 0x7f977c119640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48182/0 (socket says 172.21.15.72:48182) 2023-10-03T10:19:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f9781bac700 1 -- 172.21.15.72:0/145093198 learned_addr learned my addr 172.21.15.72:0/145093198 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f97813ab700 1 --2- 172.21.15.72:0/145093198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c09a3b0 0x7f977c119b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f97823ad700 1 --2- 172.21.15.72:0/145093198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f977c131810 0x7f977c11a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f97823ad700 1 -- 172.21.15.72:0/145093198 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f977c099a40 msgr2=0x7f977c119640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f97823ad700 1 --2- 172.21.15.72:0/145093198 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f977c099a40 0x7f977c119640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f97823ad700 1 -- 172.21.15.72:0/145093198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c09a3b0 msgr2=0x7f977c119b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f97823ad700 1 --2- 172.21.15.72:0/145093198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c09a3b0 0x7f977c119b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f97823ad700 1 -- 172.21.15.72:0/145093198 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c009550 con 0x7f977c131810 2023-10-03T10:19:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f97813ab700 1 --2- 172.21.15.72:0/145093198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c09a3b0 0x7f977c119b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f97823ad700 1 --2- 172.21.15.72:0/145093198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f977c131810 0x7f977c11a0c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9774007d90 tx=0x7f977400e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f97727fc700 1 -- 172.21.15.72:0/145093198 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774018070 con 0x7f977c131810 2023-10-03T10:19:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f9783e10700 1 -- 172.21.15.72:0/145093198 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c11b250 con 0x7f977c131810 2023-10-03T10:19:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f97727fc700 1 -- 172.21.15.72:0/145093198 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977400eb30 con 0x7f977c131810 2023-10-03T10:19:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f97727fc700 1 -- 172.21.15.72:0/145093198 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774003a20 con 0x7f977c131810 2023-10-03T10:19:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.460+0000 7f9783e10700 1 -- 172.21.15.72:0/145093198 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c11d660 con 0x7f977c131810 2023-10-03T10:19:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.461+0000 7f97727fc700 1 -- 172.21.15.72:0/145093198 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9774014420 con 0x7f977c131810 2023-10-03T10:19:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.461+0000 7f9783e10700 1 -- 172.21.15.72:0/145093198 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c11cd00 con 0x7f977c131810 2023-10-03T10:19:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.462+0000 7f97727fc700 1 -- 172.21.15.72:0/145093198 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f977403f630 con 0x7f977c131810 2023-10-03T10:19:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.471+0000 7f97727fc700 1 -- 172.21.15.72:0/145093198 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f97740146d0 con 0x7f977c131810 2023-10-03T10:19:05.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.486+0000 7fefda835700 1 -- 172.21.15.72:0/4142705896 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fefd4120880 con 0x7fefd4133420 2023-10-03T10:19:05.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.486+0000 7fefd0ff9700 1 -- 172.21.15.72:0/4142705896 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fefbc017030 con 0x7fefd4133420 2023-10-03T10:19:05.486 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.488+0000 7fefda835700 1 -- 172.21.15.72:0/4142705896 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefd4133420 msgr2=0x7fefd409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.488+0000 7fefda835700 1 --2- 172.21.15.72:0/4142705896 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefd4133420 0x7fefd409c480 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00ebe0 tx=0x7fefbc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.488+0000 7fefda835700 1 -- 172.21.15.72:0/4142705896 shutdown_connections 2023-10-03T10:19:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.488+0000 7fefda835700 1 --2- 172.21.15.72:0/4142705896 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefd4134260 0x7fefd409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.488+0000 7fefda835700 1 --2- 172.21.15.72:0/4142705896 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fefd4133420 0x7fefd409c480 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.488+0000 7fefda835700 1 --2- 172.21.15.72:0/4142705896 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefd4133e30 0x7fefd409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.489+0000 7fefda835700 1 -- 172.21.15.72:0/4142705896 >> 172.21.15.72:0/4142705896 conn(0x7fefd40a4210 msgr2=0x7fefd40a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.489+0000 7fefda835700 1 -- 172.21.15.72:0/4142705896 shutdown_connections 2023-10-03T10:19:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.489+0000 7fefda835700 1 -- 172.21.15.72:0/4142705896 wait complete. 2023-10-03T10:19:05.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:05.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.505+0000 7fa1cb909700 1 Processor -- start 2023-10-03T10:19:05.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.505+0000 7fa1cb909700 1 -- start start 2023-10-03T10:19:05.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.505+0000 7fa1cb909700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1c409e1d0 0x7fa1c4135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.505+0000 7fa1cb909700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1c4135e50 0x7fa1c4138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.505+0000 7fa1cb909700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c409f130 con 0x7fa1c409d6f0 2023-10-03T10:19:05.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.505+0000 7fa1cb909700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c409f520 con 0x7fa1c4135e50 2023-10-03T10:19:05.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.505+0000 7fa1cb909700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c409e930 con 0x7fa1c409e1d0 2023-10-03T10:19:05.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.506+0000 7fa1c8ea4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1c409e1d0 0x7fa1c4135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.506+0000 7fa1c8ea4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1c409e1d0 0x7fa1c4135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48198/0 (socket says 172.21.15.72:48198) 2023-10-03T10:19:05.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.506+0000 7fa1c8ea4700 1 -- 172.21.15.72:0/1522589410 learned_addr learned my addr 172.21.15.72:0/1522589410 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:05.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.506+0000 7fa1c9ea6700 1 --2- 172.21.15.72:0/1522589410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1c4135e50 0x7fa1c4138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.506+0000 7fa1c8ea4700 1 -- 172.21.15.72:0/1522589410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1c4135e50 msgr2=0x7fa1c4138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.506+0000 7fa1c8ea4700 1 --2- 172.21.15.72:0/1522589410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1c4135e50 0x7fa1c4138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.506+0000 7fa1c8ea4700 1 -- 172.21.15.72:0/1522589410 >> v1:172.21.15.72:6789/0 conn(0x7fa1c409d6f0 legacy=0x7fa1c409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.506+0000 7fa1c8ea4700 1 -- 172.21.15.72:0/1522589410 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c409b2d0 con 0x7fa1c409e1d0 2023-10-03T10:19:05.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.506+0000 7fa1c8ea4700 1 --2- 172.21.15.72:0/1522589410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1c409e1d0 0x7fa1c4135910 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400bbc0 tx=0x7fa1b400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=202f8e3d2388f8f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.506+0000 7fa1bbfff700 1 -- 172.21.15.72:0/1522589410 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b400dd30 con 0x7fa1c409e1d0 2023-10-03T10:19:05.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.506+0000 7fa1bbfff700 1 -- 172.21.15.72:0/1522589410 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b400de90 con 0x7fa1c409e1d0 2023-10-03T10:19:05.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.506+0000 7fa1bbfff700 1 -- 172.21.15.72:0/1522589410 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4010690 con 0x7fa1c409e1d0 2023-10-03T10:19:05.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.507+0000 7fa1cb909700 1 -- 172.21.15.72:0/1522589410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1c409e1d0 msgr2=0x7fa1c4135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.507+0000 7fa1cb909700 1 --2- 172.21.15.72:0/1522589410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1c409e1d0 0x7fa1c4135910 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fa1b400bbc0 tx=0x7fa1b400bed0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.507+0000 7fa1cb909700 1 -- 172.21.15.72:0/1522589410 shutdown_connections 2023-10-03T10:19:05.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.507+0000 7fa1cb909700 1 --2- 172.21.15.72:0/1522589410 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1c4135e50 0x7fa1c4138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.507+0000 7fa1cb909700 1 --2- 172.21.15.72:0/1522589410 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1c409e1d0 0x7fa1c4135910 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.507+0000 7fa1cb909700 1 -- 172.21.15.72:0/1522589410 >> 172.21.15.72:0/1522589410 conn(0x7fa1c4066f50 msgr2=0x7fa1c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.507+0000 7fa1cb909700 1 -- 172.21.15.72:0/1522589410 shutdown_connections 2023-10-03T10:19:05.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.507+0000 7fa1cb909700 1 -- 172.21.15.72:0/1522589410 wait complete. 2023-10-03T10:19:05.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.508+0000 7fa1cb909700 1 Processor -- start 2023-10-03T10:19:05.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.508+0000 7fa1cb909700 1 -- start start 2023-10-03T10:19:05.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1cb909700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c409d6f0 0x7fa1c41c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1cb909700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1c409e1d0 0x7fa1c41c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1cb909700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1c4135e50 0x7fa1c4119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1cb909700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c41c4f00 con 0x7fa1c409d6f0 2023-10-03T10:19:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1cb909700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c4130240 con 0x7fa1c4135e50 2023-10-03T10:19:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1cb909700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c41baf30 con 0x7fa1c409e1d0 2023-10-03T10:19:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1c8ea4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1c409e1d0 0x7fa1c41c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1c8ea4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1c409e1d0 0x7fa1c41c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48214/0 (socket says 172.21.15.72:48214) 2023-10-03T10:19:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1c8ea4700 1 -- 172.21.15.72:0/2486232715 learned_addr learned my addr 172.21.15.72:0/2486232715 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1c96a5700 1 --2- 172.21.15.72:0/2486232715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c409d6f0 0x7fa1c41c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1c9ea6700 1 --2- 172.21.15.72:0/2486232715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1c4135e50 0x7fa1c4119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1c8ea4700 1 -- 172.21.15.72:0/2486232715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1c4135e50 msgr2=0x7fa1c4119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1c8ea4700 1 --2- 172.21.15.72:0/2486232715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1c4135e50 0x7fa1c4119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1c8ea4700 1 -- 172.21.15.72:0/2486232715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c409d6f0 msgr2=0x7fa1c41c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1c8ea4700 1 --2- 172.21.15.72:0/2486232715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c409d6f0 0x7fa1c41c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1c8ea4700 1 -- 172.21.15.72:0/2486232715 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b400b7f0 con 0x7fa1c409e1d0 2023-10-03T10:19:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.509+0000 7fa1c8ea4700 1 --2- 172.21.15.72:0/2486232715 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1c409e1d0 0x7fa1c41c49c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4000c00 tx=0x7fa1b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.510+0000 7fa1b9ffb700 1 -- 172.21.15.72:0/2486232715 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b401f070 con 0x7fa1c409e1d0 2023-10-03T10:19:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.510+0000 7fa1b9ffb700 1 -- 172.21.15.72:0/2486232715 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b4003970 con 0x7fa1c409e1d0 2023-10-03T10:19:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.510+0000 7fa1b9ffb700 1 -- 172.21.15.72:0/2486232715 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4003d00 con 0x7fa1c409e1d0 2023-10-03T10:19:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.510+0000 7fa1cb909700 1 -- 172.21.15.72:0/2486232715 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c411c730 con 0x7fa1c409e1d0 2023-10-03T10:19:05.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.510+0000 7fa1cb909700 1 -- 172.21.15.72:0/2486232715 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c411b070 con 0x7fa1c409e1d0 2023-10-03T10:19:05.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.511+0000 7fa1b9ffb700 1 -- 172.21.15.72:0/2486232715 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1b4019400 con 0x7fa1c409e1d0 2023-10-03T10:19:05.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.511+0000 7fa1b9ffb700 1 -- 172.21.15.72:0/2486232715 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa1b40429b0 con 0x7fa1c409e1d0 2023-10-03T10:19:05.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.511+0000 7fa1cb909700 1 -- 172.21.15.72:0/2486232715 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c4074ea0 con 0x7fa1c409e1d0 2023-10-03T10:19:05.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.516+0000 7fa1b9ffb700 1 -- 172.21.15.72:0/2486232715 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1b4003e60 con 0x7fa1c409e1d0 2023-10-03T10:19:05.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.550+0000 7fac54fb4700 1 Processor -- start 2023-10-03T10:19:05.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.550+0000 7fac54fb4700 1 -- start start 2023-10-03T10:19:05.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac54fb4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac5009e850 0x7fac5009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac54fb4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac50134290 0x7fac5013be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac54fb4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5006bc50 con 0x7fac5009f160 2023-10-03T10:19:05.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac54fb4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5009ae60 con 0x7fac5009e850 2023-10-03T10:19:05.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac54fb4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5006b990 con 0x7fac50134290 2023-10-03T10:19:05.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac4e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac5009e850 0x7fac5009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac4ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac50134290 0x7fac5013be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac4e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac5009e850 0x7fac5009ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40582/0 (socket says 172.21.15.72:40582) 2023-10-03T10:19:05.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac4ed9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac50134290 0x7fac5013be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42846/0 (socket says 172.21.15.72:42846) 2023-10-03T10:19:05.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac4e59c700 1 -- 172.21.15.72:0/1504974194 learned_addr learned my addr 172.21.15.72:0/1504974194 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:05.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac4e59c700 1 -- 172.21.15.72:0/1504974194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac50134290 msgr2=0x7fac5013be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac4e59c700 1 --2- 172.21.15.72:0/1504974194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac50134290 0x7fac5013be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac4e59c700 1 -- 172.21.15.72:0/1504974194 >> v1:172.21.15.72:6789/0 conn(0x7fac5009f160 legacy=0x7fac50133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac4e59c700 1 -- 172.21.15.72:0/1504974194 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5006cb10 con 0x7fac5009e850 2023-10-03T10:19:05.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac4e59c700 1 --2- 172.21.15.72:0/1504974194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac5009e850 0x7fac5009ec20 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fac400098f0 tx=0x7fac40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e852398c3b3b06e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac4d59a700 1 -- 172.21.15.72:0/1504974194 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40011830 con 0x7fac5009e850 2023-10-03T10:19:05.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac4d59a700 1 -- 172.21.15.72:0/1504974194 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac40011990 con 0x7fac5009e850 2023-10-03T10:19:05.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.551+0000 7fac4d59a700 1 -- 172.21.15.72:0/1504974194 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40011d20 con 0x7fac5009e850 2023-10-03T10:19:05.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.552+0000 7fac54fb4700 1 -- 172.21.15.72:0/1504974194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac5009e850 msgr2=0x7fac5009ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.552+0000 7fac54fb4700 1 --2- 172.21.15.72:0/1504974194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac5009e850 0x7fac5009ec20 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fac400098f0 tx=0x7fac40009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:05.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.552+0000 7fac54fb4700 1 -- 172.21.15.72:0/1504974194 shutdown_connections 2023-10-03T10:19:05.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.552+0000 7fac54fb4700 1 --2- 172.21.15.72:0/1504974194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac50134290 0x7fac5013be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.552+0000 7fac54fb4700 1 --2- 172.21.15.72:0/1504974194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac5009e850 0x7fac5009ec20 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.552+0000 7fac54fb4700 1 -- 172.21.15.72:0/1504974194 >> 172.21.15.72:0/1504974194 conn(0x7fac500a3f70 msgr2=0x7fac500a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.552+0000 7fac54fb4700 1 -- 172.21.15.72:0/1504974194 shutdown_connections 2023-10-03T10:19:05.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.552+0000 7fac54fb4700 1 -- 172.21.15.72:0/1504974194 wait complete. 2023-10-03T10:19:05.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.553+0000 7fac54fb4700 1 Processor -- start 2023-10-03T10:19:05.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.553+0000 7fac54fb4700 1 -- start start 2023-10-03T10:19:05.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac54fb4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac5009e850 0x7fac501c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac54fb4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac5009f160 0x7fac501c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac54fb4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac50134290 0x7fac501c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac54fb4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac501240f0 con 0x7fac5009e850 2023-10-03T10:19:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac54fb4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac50124870 con 0x7fac50134290 2023-10-03T10:19:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac54fb4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac50126390 con 0x7fac5009f160 2023-10-03T10:19:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac4dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac5009f160 0x7fac501c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac4e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac5009e850 0x7fac501c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac4dd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac5009f160 0x7fac501c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48230/0 (socket says 172.21.15.72:48230) 2023-10-03T10:19:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac4dd9b700 1 -- 172.21.15.72:0/2569522644 learned_addr learned my addr 172.21.15.72:0/2569522644 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac4ed9d700 1 --2- 172.21.15.72:0/2569522644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac50134290 0x7fac501c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac4ed9d700 1 -- 172.21.15.72:0/2569522644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac5009f160 msgr2=0x7fac501c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac4ed9d700 1 --2- 172.21.15.72:0/2569522644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac5009f160 0x7fac501c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac4ed9d700 1 -- 172.21.15.72:0/2569522644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac5009e850 msgr2=0x7fac501c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac4ed9d700 1 --2- 172.21.15.72:0/2569522644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac5009e850 0x7fac501c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac4ed9d700 1 -- 172.21.15.72:0/2569522644 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac40009550 con 0x7fac50134290 2023-10-03T10:19:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac4e59c700 1 --2- 172.21.15.72:0/2569522644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac5009e850 0x7fac501c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac4dd9b700 1 --2- 172.21.15.72:0/2569522644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac5009f160 0x7fac501c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac4ed9d700 1 --2- 172.21.15.72:0/2569522644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac50134290 0x7fac501c8fb0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fac4800efc0 tx=0x7fac4800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.554+0000 7fac3effd700 1 -- 172.21.15.72:0/2569522644 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4800cc90 con 0x7fac50134290 2023-10-03T10:19:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.555+0000 7fac3effd700 1 -- 172.21.15.72:0/2569522644 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4800f040 con 0x7fac50134290 2023-10-03T10:19:05.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.555+0000 7fac3effd700 1 -- 172.21.15.72:0/2569522644 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac480146c0 con 0x7fac50134290 2023-10-03T10:19:05.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.555+0000 7fac54fb4700 1 -- 172.21.15.72:0/2569522644 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac50124f50 con 0x7fac50134290 2023-10-03T10:19:05.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.555+0000 7fac54fb4700 1 -- 172.21.15.72:0/2569522644 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac50126e00 con 0x7fac50134290 2023-10-03T10:19:05.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.556+0000 7fac3effd700 1 -- 172.21.15.72:0/2569522644 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac48014820 con 0x7fac50134290 2023-10-03T10:19:05.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.556+0000 7fac54fb4700 1 -- 172.21.15.72:0/2569522644 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5006cd80 con 0x7fac50134290 2023-10-03T10:19:05.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.556+0000 7fac3effd700 1 -- 172.21.15.72:0/2569522644 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fac480401b0 con 0x7fac50134290 2023-10-03T10:19:05.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.560+0000 7fac3effd700 1 -- 172.21.15.72:0/2569522644 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac48007900 con 0x7fac50134290 2023-10-03T10:19:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.671+0000 7f9783e10700 1 -- 172.21.15.72:0/145093198 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f977c074ea0 con 0x7f977c131810 2023-10-03T10:19:05.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.672+0000 7f97727fc700 1 -- 172.21.15.72:0/145093198 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f97740122e0 con 0x7f977c131810 2023-10-03T10:19:05.672 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:05.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.675+0000 7f9783e10700 1 -- 172.21.15.72:0/145093198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f977c131810 msgr2=0x7f977c11a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.675+0000 7f9783e10700 1 --2- 172.21.15.72:0/145093198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f977c131810 0x7f977c11a0c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9774007d90 tx=0x7f977400e3c0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.675+0000 7f9783e10700 1 -- 172.21.15.72:0/145093198 shutdown_connections 2023-10-03T10:19:05.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.675+0000 7f9783e10700 1 --2- 172.21.15.72:0/145093198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f977c131810 0x7f977c11a0c0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.675+0000 7f9783e10700 1 --2- 172.21.15.72:0/145093198 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f977c099a40 0x7f977c119640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.675+0000 7f9783e10700 1 --2- 172.21.15.72:0/145093198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f977c09a3b0 0x7f977c119b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.675+0000 7f9783e10700 1 -- 172.21.15.72:0/145093198 >> 172.21.15.72:0/145093198 conn(0x7f977c0a2aa0 msgr2=0x7f977c12e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.676+0000 7f9783e10700 1 -- 172.21.15.72:0/145093198 shutdown_connections 2023-10-03T10:19:05.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.676+0000 7f9783e10700 1 -- 172.21.15.72:0/145093198 wait complete. 2023-10-03T10:19:05.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:05.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.715+0000 7fa1cb909700 1 -- 172.21.15.72:0/2486232715 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa1c406c360 con 0x7fa1c409e1d0 2023-10-03T10:19:05.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.716+0000 7fa1b9ffb700 1 -- 172.21.15.72:0/2486232715 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa1b4028070 con 0x7fa1c409e1d0 2023-10-03T10:19:05.715 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:05.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.718+0000 7fa1cb909700 1 -- 172.21.15.72:0/2486232715 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1c409e1d0 msgr2=0x7fa1c41c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.718+0000 7fa1cb909700 1 --2- 172.21.15.72:0/2486232715 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1c409e1d0 0x7fa1c41c49c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4000c00 tx=0x7fa1b4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:05.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.718+0000 7fa1cb909700 1 -- 172.21.15.72:0/2486232715 shutdown_connections 2023-10-03T10:19:05.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.718+0000 7fa1cb909700 1 --2- 172.21.15.72:0/2486232715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1c409d6f0 0x7fa1c41c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.718+0000 7fa1cb909700 1 --2- 172.21.15.72:0/2486232715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1c4135e50 0x7fa1c4119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.718+0000 7fa1cb909700 1 --2- 172.21.15.72:0/2486232715 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa1c409e1d0 0x7fa1c41c49c0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.718+0000 7fa1cb909700 1 -- 172.21.15.72:0/2486232715 >> 172.21.15.72:0/2486232715 conn(0x7fa1c4066f50 msgr2=0x7fa1c41329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.718+0000 7fa1cb909700 1 -- 172.21.15.72:0/2486232715 shutdown_connections 2023-10-03T10:19:05.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.718+0000 7fa1cb909700 1 -- 172.21.15.72:0/2486232715 wait complete. 2023-10-03T10:19:05.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:05.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.756+0000 7fac54fb4700 1 -- 172.21.15.72:0/2569522644 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fac500747f0 con 0x7fac50134290 2023-10-03T10:19:05.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.756+0000 7fac3effd700 1 -- 172.21.15.72:0/2569522644 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac48018020 con 0x7fac50134290 2023-10-03T10:19:05.756 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:05.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.758+0000 7fac54fb4700 1 -- 172.21.15.72:0/2569522644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac50134290 msgr2=0x7fac501c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.758+0000 7fac54fb4700 1 --2- 172.21.15.72:0/2569522644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac50134290 0x7fac501c8fb0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fac4800efc0 tx=0x7fac4800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.758+0000 7fac54fb4700 1 -- 172.21.15.72:0/2569522644 shutdown_connections 2023-10-03T10:19:05.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.758+0000 7fac54fb4700 1 --2- 172.21.15.72:0/2569522644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac5009e850 0x7fac501c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.758+0000 7fac54fb4700 1 --2- 172.21.15.72:0/2569522644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac50134290 0x7fac501c8fb0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.758+0000 7fac54fb4700 1 --2- 172.21.15.72:0/2569522644 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fac5009f160 0x7fac501c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.758+0000 7fac54fb4700 1 -- 172.21.15.72:0/2569522644 >> 172.21.15.72:0/2569522644 conn(0x7fac500a3f70 msgr2=0x7fac500a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.758+0000 7fac54fb4700 1 -- 172.21.15.72:0/2569522644 shutdown_connections 2023-10-03T10:19:05.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:05.758+0000 7fac54fb4700 1 -- 172.21.15.72:0/2569522644 wait complete. 2023-10-03T10:19:05.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:06.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:06.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.638+0000 7fb7e21f7700 1 Processor -- start 2023-10-03T10:19:06.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.638+0000 7fb7e21f7700 1 -- start start 2023-10-03T10:19:06.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7e21f7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7dc1337f0 0x7fb7dc138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7e21f7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7dc138dc0 0x7fb7dc13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7e21f7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc06b990 con 0x7fb7dc133420 2023-10-03T10:19:06.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7e21f7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc09b0e0 con 0x7fb7dc138dc0 2023-10-03T10:19:06.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7e21f7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc133c20 con 0x7fb7dc1337f0 2023-10-03T10:19:06.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7dbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7dc138dc0 0x7fb7dc13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7daffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7dc1337f0 0x7fb7dc138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7db7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb7dc133420 0x7fb7dc133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33428/0 (socket says 172.21.15.72:33428) 2023-10-03T10:19:06.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7dbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7dc138dc0 0x7fb7dc13b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42860/0 (socket says 172.21.15.72:42860) 2023-10-03T10:19:06.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7db7fe700 1 -- 172.21.15.72:0/4199900647 learned_addr learned my addr 172.21.15.72:0/4199900647 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:06.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7daffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7dc1337f0 0x7fb7dc138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48232/0 (socket says 172.21.15.72:48232) 2023-10-03T10:19:06.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7daffd700 1 -- 172.21.15.72:0/4199900647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7dc138dc0 msgr2=0x7fb7dc13b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:06.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7daffd700 1 --2- 172.21.15.72:0/4199900647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7dc138dc0 0x7fb7dc13b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7daffd700 1 -- 172.21.15.72:0/4199900647 >> v1:172.21.15.72:6789/0 conn(0x7fb7dc133420 legacy=0x7fb7dc133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7da7fc700 1 -- 172.21.15.72:0/4199900647 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311807135 0 0) 0x7fb7dc06b990 con 0x7fb7dc133420 2023-10-03T10:19:06.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.639+0000 7fb7daffd700 1 -- 172.21.15.72:0/4199900647 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc0a0590 con 0x7fb7dc1337f0 2023-10-03T10:19:06.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.640+0000 7fb7daffd700 1 --2- 172.21.15.72:0/4199900647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7dc1337f0 0x7fb7dc138880 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009870 tx=0x7fb7cc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c747e44fe4a04c07 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.640+0000 7fb7da7fc700 1 -- 172.21.15.72:0/4199900647 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc011830 con 0x7fb7dc1337f0 2023-10-03T10:19:06.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.640+0000 7fb7da7fc700 1 -- 172.21.15.72:0/4199900647 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc011990 con 0x7fb7dc1337f0 2023-10-03T10:19:06.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.640+0000 7fb7da7fc700 1 -- 172.21.15.72:0/4199900647 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc011d20 con 0x7fb7dc1337f0 2023-10-03T10:19:06.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.640+0000 7fb7e21f7700 1 -- 172.21.15.72:0/4199900647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7dc1337f0 msgr2=0x7fb7dc138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.640+0000 7fb7e21f7700 1 --2- 172.21.15.72:0/4199900647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7dc1337f0 0x7fb7dc138880 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009870 tx=0x7fb7cc009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:06.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.640+0000 7fb7e21f7700 1 -- 172.21.15.72:0/4199900647 shutdown_connections 2023-10-03T10:19:06.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.640+0000 7fb7e21f7700 1 --2- 172.21.15.72:0/4199900647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7dc138dc0 0x7fb7dc13b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.640+0000 7fb7e21f7700 1 --2- 172.21.15.72:0/4199900647 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7dc1337f0 0x7fb7dc138880 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.640+0000 7fb7e21f7700 1 -- 172.21.15.72:0/4199900647 >> 172.21.15.72:0/4199900647 conn(0x7fb7dc0a4210 msgr2=0x7fb7dc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.640+0000 7fb7e21f7700 1 -- 172.21.15.72:0/4199900647 shutdown_connections 2023-10-03T10:19:06.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.640+0000 7fb7e21f7700 1 -- 172.21.15.72:0/4199900647 wait complete. 2023-10-03T10:19:06.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.641+0000 7fb7e21f7700 1 Processor -- start 2023-10-03T10:19:06.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.641+0000 7fb7e21f7700 1 -- start start 2023-10-03T10:19:06.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7e21f7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7dc133420 0x7fb7dc1c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7e21f7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7dc1337f0 0x7fb7dc1c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7e21f7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7dc138dc0 0x7fb7dc1c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7e21f7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc1330c0 con 0x7fb7dc138dc0 2023-10-03T10:19:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7e21f7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc09ca50 con 0x7fb7dc1337f0 2023-10-03T10:19:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7e21f7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc09bf60 con 0x7fb7dc133420 2023-10-03T10:19:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7db7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7dc133420 0x7fb7dc1c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7daffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7dc1337f0 0x7fb7dc1c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7db7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7dc133420 0x7fb7dc1c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48240/0 (socket says 172.21.15.72:48240) 2023-10-03T10:19:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7daffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7dc1337f0 0x7fb7dc1c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42862/0 (socket says 172.21.15.72:42862) 2023-10-03T10:19:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7dbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7dc138dc0 0x7fb7dc1c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7db7fe700 1 -- 172.21.15.72:0/1065795372 learned_addr learned my addr 172.21.15.72:0/1065795372 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:06.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7db7fe700 1 -- 172.21.15.72:0/1065795372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7dc1337f0 msgr2=0x7fb7dc1c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7db7fe700 1 --2- 172.21.15.72:0/1065795372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7dc1337f0 0x7fb7dc1c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7db7fe700 1 -- 172.21.15.72:0/1065795372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7dc138dc0 msgr2=0x7fb7dc1c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7db7fe700 1 --2- 172.21.15.72:0/1065795372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7dc138dc0 0x7fb7dc1c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7db7fe700 1 -- 172.21.15.72:0/1065795372 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc0094a0 con 0x7fb7dc133420 2023-10-03T10:19:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7daffd700 1 --2- 172.21.15.72:0/1065795372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7dc1337f0 0x7fb7dc1c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7db7fe700 1 --2- 172.21.15.72:0/1065795372 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7dc133420 0x7fb7dc1c86b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400c550 tx=0x7fb7c400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7d3fff700 1 -- 172.21.15.72:0/1065795372 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4004c80 con 0x7fb7dc133420 2023-10-03T10:19:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7d3fff700 1 -- 172.21.15.72:0/1065795372 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c4004e00 con 0x7fb7dc133420 2023-10-03T10:19:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7d3fff700 1 -- 172.21.15.72:0/1065795372 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4007310 con 0x7fb7dc133420 2023-10-03T10:19:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7e21f7700 1 -- 172.21.15.72:0/1065795372 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc09def0 con 0x7fb7dc133420 2023-10-03T10:19:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.642+0000 7fb7e21f7700 1 -- 172.21.15.72:0/1065795372 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc09d990 con 0x7fb7dc133420 2023-10-03T10:19:06.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.643+0000 7fb7d3fff700 1 -- 172.21.15.72:0/1065795372 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7c4007470 con 0x7fb7dc133420 2023-10-03T10:19:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.643+0000 7fb7e21f7700 1 -- 172.21.15.72:0/1065795372 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc09d030 con 0x7fb7dc133420 2023-10-03T10:19:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.643+0000 7fb7d3fff700 1 -- 172.21.15.72:0/1065795372 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb7c403f300 con 0x7fb7dc133420 2023-10-03T10:19:06.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.648+0000 7fb7d3fff700 1 -- 172.21.15.72:0/1065795372 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7c40123b0 con 0x7fb7dc133420 2023-10-03T10:19:06.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:06.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:06.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:06.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.826+0000 7f2328f2c700 1 Processor -- start 2023-10-03T10:19:06.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.826+0000 7f2328f2c700 1 -- start start 2023-10-03T10:19:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.827+0000 7f2328f2c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f232409e1d0 0x7f2324138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.827+0000 7f2328f2c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2324139170 0x7f232413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.827+0000 7f2328f2c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232409b120 con 0x7f232409d6f0 2023-10-03T10:19:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.827+0000 7f2328f2c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232406b460 con 0x7f232409e1d0 2023-10-03T10:19:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.827+0000 7f2328f2c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f232409a7e0 con 0x7f2324139170 2023-10-03T10:19:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.827+0000 7f232259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f232409d6f0 0x7f232409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33434/0 (socket says 172.21.15.72:33434) 2023-10-03T10:19:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.827+0000 7f232259c700 1 -- 172.21.15.72:0/2582647604 learned_addr learned my addr 172.21.15.72:0/2582647604 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.827+0000 7f2321d9b700 1 --2- 172.21.15.72:0/2582647604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f232409e1d0 0x7f2324138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.827+0000 7f2322d9d700 1 --2- 172.21.15.72:0/2582647604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2324139170 0x7f232413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.827+0000 7f232159a700 1 -- 172.21.15.72:0/2582647604 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241378951 0 0) 0x7f232409b120 con 0x7f232409d6f0 2023-10-03T10:19:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.827+0000 7f2321d9b700 1 -- 172.21.15.72:0/2582647604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2324139170 msgr2=0x7f232413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.827+0000 7f2321d9b700 1 --2- 172.21.15.72:0/2582647604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2324139170 0x7f232413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.827+0000 7f2321d9b700 1 -- 172.21.15.72:0/2582647604 >> v1:172.21.15.72:6789/0 conn(0x7f232409d6f0 legacy=0x7f232409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.827+0000 7f2321d9b700 1 -- 172.21.15.72:0/2582647604 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232409a500 con 0x7f232409e1d0 2023-10-03T10:19:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.828+0000 7f2321d9b700 1 --2- 172.21.15.72:0/2582647604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f232409e1d0 0x7f2324138c30 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2318009870 tx=0x7f2318009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a2d321d71b65400 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.828+0000 7f232159a700 1 -- 172.21.15.72:0/2582647604 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318011830 con 0x7f232409e1d0 2023-10-03T10:19:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.828+0000 7f232159a700 1 -- 172.21.15.72:0/2582647604 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2318011990 con 0x7f232409e1d0 2023-10-03T10:19:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.828+0000 7f232159a700 1 -- 172.21.15.72:0/2582647604 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318011d20 con 0x7f232409e1d0 2023-10-03T10:19:06.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.829+0000 7f2328f2c700 1 -- 172.21.15.72:0/2582647604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f232409e1d0 msgr2=0x7f2324138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.829+0000 7f2328f2c700 1 --2- 172.21.15.72:0/2582647604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f232409e1d0 0x7f2324138c30 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2318009870 tx=0x7f2318009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.829+0000 7f2328f2c700 1 -- 172.21.15.72:0/2582647604 shutdown_connections 2023-10-03T10:19:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.829+0000 7f2328f2c700 1 --2- 172.21.15.72:0/2582647604 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2324139170 0x7f232413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.829+0000 7f2328f2c700 1 --2- 172.21.15.72:0/2582647604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f232409e1d0 0x7f2324138c30 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.829+0000 7f2328f2c700 1 -- 172.21.15.72:0/2582647604 >> 172.21.15.72:0/2582647604 conn(0x7f2324066f50 msgr2=0x7f232409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.829+0000 7f2328f2c700 1 -- 172.21.15.72:0/2582647604 shutdown_connections 2023-10-03T10:19:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.829+0000 7f2328f2c700 1 -- 172.21.15.72:0/2582647604 wait complete. 2023-10-03T10:19:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.831+0000 7f2328f2c700 1 Processor -- start 2023-10-03T10:19:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.831+0000 7f2328f2c700 1 -- start start 2023-10-03T10:19:06.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.831+0000 7f2328f2c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f232409d6f0 0x7f232411e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.831+0000 7f2328f2c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f232409e1d0 0x7f232411ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.831+0000 7f2328f2c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2324139170 0x7f232411f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.831+0000 7f2328f2c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23241220b0 con 0x7f2324139170 2023-10-03T10:19:06.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.831+0000 7f2328f2c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232411f9f0 con 0x7f232409d6f0 2023-10-03T10:19:06.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.831+0000 7f2328f2c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2324121460 con 0x7f232409e1d0 2023-10-03T10:19:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f2322d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2324139170 0x7f232411f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f2322d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2324139170 0x7f232411f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40596/0 (socket says 172.21.15.72:40596) 2023-10-03T10:19:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f2322d9d700 1 -- 172.21.15.72:0/1915143114 learned_addr learned my addr 172.21.15.72:0/1915143114 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f232259c700 1 --2- 172.21.15.72:0/1915143114 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f232409d6f0 0x7f232411e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f2321d9b700 1 --2- 172.21.15.72:0/1915143114 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f232409e1d0 0x7f232411ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f232259c700 1 -- 172.21.15.72:0/1915143114 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f232409e1d0 msgr2=0x7f232411ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f232259c700 1 --2- 172.21.15.72:0/1915143114 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f232409e1d0 0x7f232411ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f232259c700 1 -- 172.21.15.72:0/1915143114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2324139170 msgr2=0x7f232411f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f232259c700 1 --2- 172.21.15.72:0/1915143114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2324139170 0x7f232411f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f232259c700 1 -- 172.21.15.72:0/1915143114 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180094a0 con 0x7f232409d6f0 2023-10-03T10:19:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f2321d9b700 1 --2- 172.21.15.72:0/1915143114 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f232409e1d0 0x7f232411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f2322d9d700 1 --2- 172.21.15.72:0/1915143114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2324139170 0x7f232411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f232259c700 1 --2- 172.21.15.72:0/1915143114 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f232409d6f0 0x7f232411e590 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f231400c470 tx=0x7f231400c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f2312ffd700 1 -- 172.21.15.72:0/1915143114 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314004c80 con 0x7f232409d6f0 2023-10-03T10:19:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f2312ffd700 1 -- 172.21.15.72:0/1915143114 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2314004de0 con 0x7f232409d6f0 2023-10-03T10:19:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f2312ffd700 1 -- 172.21.15.72:0/1915143114 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314007310 con 0x7f232409d6f0 2023-10-03T10:19:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.832+0000 7f2328f2c700 1 -- 172.21.15.72:0/1915143114 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23240a3a20 con 0x7f232409d6f0 2023-10-03T10:19:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.833+0000 7f2328f2c700 1 -- 172.21.15.72:0/1915143114 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2324122840 con 0x7f232409d6f0 2023-10-03T10:19:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.834+0000 7f2312ffd700 1 -- 172.21.15.72:0/1915143114 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2314007470 con 0x7f232409d6f0 2023-10-03T10:19:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.834+0000 7f2328f2c700 1 -- 172.21.15.72:0/1915143114 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2324074ea0 con 0x7f232409d6f0 2023-10-03T10:19:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.834+0000 7f2312ffd700 1 -- 172.21.15.72:0/1915143114 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f231403f2f0 con 0x7f232409d6f0 2023-10-03T10:19:06.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.843+0000 7f2312ffd700 1 -- 172.21.15.72:0/1915143114 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2314007720 con 0x7f232409d6f0 2023-10-03T10:19:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.862+0000 7f6ebec2e700 1 Processor -- start 2023-10-03T10:19:06.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.862+0000 7f6ebec2e700 1 -- start start 2023-10-03T10:19:06.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.863+0000 7f6ebec2e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809d9f0 0x7f6eb8136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.863+0000 7f6ebec2e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb8136a70 0x7f6eb8138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.863+0000 7f6ebec2e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb809e130 con 0x7f6eb81316c0 2023-10-03T10:19:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.863+0000 7f6ebec2e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb81321a0 con 0x7f6eb809d9f0 2023-10-03T10:19:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.863+0000 7f6ebec2e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb81312b0 con 0x7f6eb8136a70 2023-10-03T10:19:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.863+0000 7f6ebc9ca700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6eb81316c0 0x7f6eb8131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33442/0 (socket says 172.21.15.72:33442) 2023-10-03T10:19:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.863+0000 7f6ebc9ca700 1 -- 172.21.15.72:0/1182959161 learned_addr learned my addr 172.21.15.72:0/1182959161 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.863+0000 7f6eb7fff700 1 --2- 172.21.15.72:0/1182959161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809d9f0 0x7f6eb8136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.863+0000 7f6ebd1cb700 1 --2- 172.21.15.72:0/1182959161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb8136a70 0x7f6eb8138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.864+0000 7f6eb7fff700 1 -- 172.21.15.72:0/1182959161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb8136a70 msgr2=0x7f6eb8138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.864+0000 7f6eb7fff700 1 --2- 172.21.15.72:0/1182959161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb8136a70 0x7f6eb8138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.864+0000 7f6eb7fff700 1 -- 172.21.15.72:0/1182959161 >> v1:172.21.15.72:6789/0 conn(0x7f6eb81316c0 legacy=0x7f6eb8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.864+0000 7f6eb7fff700 1 -- 172.21.15.72:0/1182959161 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb809f6e0 con 0x7f6eb809d9f0 2023-10-03T10:19:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.864+0000 7f6ebd1cb700 1 --2- 172.21.15.72:0/1182959161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb8136a70 0x7f6eb8138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.864+0000 7f6eb7fff700 1 --2- 172.21.15.72:0/1182959161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809d9f0 0x7f6eb8136530 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009870 tx=0x7f6ea4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d854f742033f1f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.864+0000 7f6eb77fe700 1 -- 172.21.15.72:0/1182959161 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4011830 con 0x7f6eb809d9f0 2023-10-03T10:19:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.864+0000 7f6eb77fe700 1 -- 172.21.15.72:0/1182959161 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea4011990 con 0x7f6eb809d9f0 2023-10-03T10:19:06.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.864+0000 7f6eb77fe700 1 -- 172.21.15.72:0/1182959161 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4011d20 con 0x7f6eb809d9f0 2023-10-03T10:19:06.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.865+0000 7f6ebec2e700 1 -- 172.21.15.72:0/1182959161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809d9f0 msgr2=0x7f6eb8136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.865+0000 7f6ebec2e700 1 --2- 172.21.15.72:0/1182959161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809d9f0 0x7f6eb8136530 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009870 tx=0x7f6ea4009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:06.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.865+0000 7f6ebec2e700 1 -- 172.21.15.72:0/1182959161 shutdown_connections 2023-10-03T10:19:06.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.865+0000 7f6ebec2e700 1 --2- 172.21.15.72:0/1182959161 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb8136a70 0x7f6eb8138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.865+0000 7f6ebec2e700 1 --2- 172.21.15.72:0/1182959161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb809d9f0 0x7f6eb8136530 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.865+0000 7f6ebec2e700 1 -- 172.21.15.72:0/1182959161 >> 172.21.15.72:0/1182959161 conn(0x7f6eb8066f50 msgr2=0x7f6eb809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.865+0000 7f6ebec2e700 1 -- 172.21.15.72:0/1182959161 shutdown_connections 2023-10-03T10:19:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.865+0000 7f6ebec2e700 1 -- 172.21.15.72:0/1182959161 wait complete. 2023-10-03T10:19:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.866+0000 7f6ebec2e700 1 Processor -- start 2023-10-03T10:19:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.866+0000 7f6ebec2e700 1 -- start start 2023-10-03T10:19:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6ebec2e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6eb809d9f0 0x7f6eb8070e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6ebec2e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb81316c0 0x7f6eb8071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6ebec2e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb8136a70 0x7f6eb80718a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6ebec2e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb812b900 con 0x7f6eb809d9f0 2023-10-03T10:19:06.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6ebec2e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8135ea0 con 0x7f6eb8136a70 2023-10-03T10:19:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6ebec2e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8071f30 con 0x7f6eb81316c0 2023-10-03T10:19:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6eb7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb81316c0 0x7f6eb8071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6ebc9ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6eb809d9f0 0x7f6eb8070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6eb7fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb81316c0 0x7f6eb8071360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48270/0 (socket says 172.21.15.72:48270) 2023-10-03T10:19:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6eb7fff700 1 -- 172.21.15.72:0/1030277924 learned_addr learned my addr 172.21.15.72:0/1030277924 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6ebd1cb700 1 --2- 172.21.15.72:0/1030277924 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb8136a70 0x7f6eb80718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6eb7fff700 1 -- 172.21.15.72:0/1030277924 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb8136a70 msgr2=0x7f6eb80718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6eb7fff700 1 --2- 172.21.15.72:0/1030277924 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb8136a70 0x7f6eb80718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6eb7fff700 1 -- 172.21.15.72:0/1030277924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6eb809d9f0 msgr2=0x7f6eb8070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6eb7fff700 1 --2- 172.21.15.72:0/1030277924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6eb809d9f0 0x7f6eb8070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6eb7fff700 1 -- 172.21.15.72:0/1030277924 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb0009a70 con 0x7f6eb81316c0 2023-10-03T10:19:06.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.867+0000 7f6eb7fff700 1 --2- 172.21.15.72:0/1030277924 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb81316c0 0x7f6eb8071360 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009840 tx=0x7f6ea4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.868+0000 7f6eb57fa700 1 -- 172.21.15.72:0/1030277924 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40044d0 con 0x7f6eb81316c0 2023-10-03T10:19:06.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.868+0000 7f6eb57fa700 1 -- 172.21.15.72:0/1030277924 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea401f070 con 0x7f6eb81316c0 2023-10-03T10:19:06.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.868+0000 7f6ebec2e700 1 -- 172.21.15.72:0/1030277924 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea40094a0 con 0x7f6eb81316c0 2023-10-03T10:19:06.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.868+0000 7f6eb57fa700 1 -- 172.21.15.72:0/1030277924 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40038e0 con 0x7f6eb81316c0 2023-10-03T10:19:06.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.868+0000 7f6ebec2e700 1 -- 172.21.15.72:0/1030277924 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb806ff60 con 0x7f6eb81316c0 2023-10-03T10:19:06.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.869+0000 7f6eb57fa700 1 -- 172.21.15.72:0/1030277924 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ea4003a40 con 0x7f6eb81316c0 2023-10-03T10:19:06.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.869+0000 7f6eb57fa700 1 -- 172.21.15.72:0/1030277924 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6ea4021070 con 0x7f6eb81316c0 2023-10-03T10:19:06.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.870+0000 7f6ebec2e700 1 -- 172.21.15.72:0/1030277924 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb8074ea0 con 0x7f6eb81316c0 2023-10-03T10:19:06.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.872+0000 7fb7e21f7700 1 -- 172.21.15.72:0/1065795372 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb7dc134040 con 0x7fb7dc133420 2023-10-03T10:19:06.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.874+0000 7fb7d3fff700 1 -- 172.21.15.72:0/1065795372 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7c4011360 con 0x7fb7dc133420 2023-10-03T10:19:06.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.875+0000 7f6eb57fa700 1 -- 172.21.15.72:0/1030277924 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ea4015020 con 0x7f6eb81316c0 2023-10-03T10:19:06.874 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:06.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.878+0000 7fb7e21f7700 1 -- 172.21.15.72:0/1065795372 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7dc133420 msgr2=0x7fb7dc1c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.878+0000 7fb7e21f7700 1 --2- 172.21.15.72:0/1065795372 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7dc133420 0x7fb7dc1c86b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb7c400c550 tx=0x7fb7c400c860 comp rx=0 tx=0).stop 2023-10-03T10:19:06.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.878+0000 7fb7e21f7700 1 -- 172.21.15.72:0/1065795372 shutdown_connections 2023-10-03T10:19:06.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.878+0000 7fb7e21f7700 1 --2- 172.21.15.72:0/1065795372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7dc138dc0 0x7fb7dc1c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.878+0000 7fb7e21f7700 1 --2- 172.21.15.72:0/1065795372 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7dc133420 0x7fb7dc1c86b0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.878+0000 7fb7e21f7700 1 --2- 172.21.15.72:0/1065795372 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7dc1337f0 0x7fb7dc1c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.878+0000 7fb7e21f7700 1 -- 172.21.15.72:0/1065795372 >> 172.21.15.72:0/1065795372 conn(0x7fb7dc0a4210 msgr2=0x7fb7dc0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.878+0000 7fb7e21f7700 1 -- 172.21.15.72:0/1065795372 shutdown_connections 2023-10-03T10:19:06.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.878+0000 7fb7e21f7700 1 -- 172.21.15.72:0/1065795372 wait complete. 2023-10-03T10:19:06.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:06.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.908+0000 7fd992f4d700 1 Processor -- start 2023-10-03T10:19:06.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.908+0000 7fd992f4d700 1 -- start start 2023-10-03T10:19:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd992f4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98c09d6f0 0x7fd98c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd992f4d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd98c09e410 0x7fd98c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd992f4d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98c09b120 con 0x7fd98c09e000 2023-10-03T10:19:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd992f4d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98c06b460 con 0x7fd98c09e410 2023-10-03T10:19:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd992f4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c09a7e0 con 0x7fd98c09d6f0 2023-10-03T10:19:06.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd990ce9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98c09d6f0 0x7fd98c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd990ce9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98c09d6f0 0x7fd98c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42892/0 (socket says 172.21.15.72:42892) 2023-10-03T10:19:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd990ce9700 1 -- 172.21.15.72:0/1266153677 learned_addr learned my addr 172.21.15.72:0/1266153677 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd9914ea700 1 --2- 172.21.15.72:0/1266153677 >> v2:172.21.15.72:3300/0 conn(0x7fd98c09e410 0x7fd98c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd9914ea700 1 -- 172.21.15.72:0/1266153677 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98c09d6f0 msgr2=0x7fd98c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd9914ea700 1 --2- 172.21.15.72:0/1266153677 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98c09d6f0 0x7fd98c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd9914ea700 1 -- 172.21.15.72:0/1266153677 >> v1:172.21.15.72:6789/0 conn(0x7fd98c09e000 legacy=0x7fd98c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd9914ea700 1 -- 172.21.15.72:0/1266153677 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c09a500 con 0x7fd98c09e410 2023-10-03T10:19:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd98b7fe700 1 -- 172.21.15.72:0/1266153677 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716932106 0 0) 0x7fd98c09b120 con 0x7fd98c09e000 2023-10-03T10:19:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd990ce9700 1 --2- 172.21.15.72:0/1266153677 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98c09d6f0 0x7fd98c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd9914ea700 1 --2- 172.21.15.72:0/1266153677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98c09e410 0x7fd98c134100 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fd984009d90 tx=0x7fd98400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fd96929d5b2b31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd98b7fe700 1 -- 172.21.15.72:0/1266153677 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98400e070 con 0x7fd98c09e410 2023-10-03T10:19:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd98b7fe700 1 -- 172.21.15.72:0/1266153677 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98400bb20 con 0x7fd98c09e410 2023-10-03T10:19:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.909+0000 7fd98b7fe700 1 -- 172.21.15.72:0/1266153677 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984012430 con 0x7fd98c09e410 2023-10-03T10:19:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.910+0000 7fd992f4d700 1 -- 172.21.15.72:0/1266153677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98c09e410 msgr2=0x7fd98c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.910+0000 7fd992f4d700 1 --2- 172.21.15.72:0/1266153677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98c09e410 0x7fd98c134100 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fd984009d90 tx=0x7fd98400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.910+0000 7fd992f4d700 1 -- 172.21.15.72:0/1266153677 shutdown_connections 2023-10-03T10:19:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.910+0000 7fd992f4d700 1 --2- 172.21.15.72:0/1266153677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98c09e410 0x7fd98c134100 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.910+0000 7fd992f4d700 1 --2- 172.21.15.72:0/1266153677 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98c09d6f0 0x7fd98c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.910+0000 7fd992f4d700 1 -- 172.21.15.72:0/1266153677 >> 172.21.15.72:0/1266153677 conn(0x7fd98c066f50 msgr2=0x7fd98c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.910+0000 7fd992f4d700 1 -- 172.21.15.72:0/1266153677 shutdown_connections 2023-10-03T10:19:06.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.910+0000 7fd992f4d700 1 -- 172.21.15.72:0/1266153677 wait complete. 2023-10-03T10:19:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.911+0000 7fd992f4d700 1 Processor -- start 2023-10-03T10:19:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.911+0000 7fd992f4d700 1 -- start start 2023-10-03T10:19:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.912+0000 7fd992f4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98c09d6f0 0x7fd98c1c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.912+0000 7fd992f4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98c09e000 0x7fd98c1c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.912+0000 7fd992f4d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd98c09e410 0x7fd98c1c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.912+0000 7fd992f4d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c1a4c80 con 0x7fd98c09e000 2023-10-03T10:19:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.912+0000 7fd992f4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c1a65d0 con 0x7fd98c09d6f0 2023-10-03T10:19:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.912+0000 7fd992f4d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c1a63e0 con 0x7fd98c09e410 2023-10-03T10:19:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.912+0000 7fd990ce9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98c09d6f0 0x7fd98c1c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.912+0000 7fd990ce9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98c09d6f0 0x7fd98c1c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42904/0 (socket says 172.21.15.72:42904) 2023-10-03T10:19:06.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.912+0000 7fd990ce9700 1 -- 172.21.15.72:0/1126095541 learned_addr learned my addr 172.21.15.72:0/1126095541 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.912+0000 7fd98bfff700 1 --2- 172.21.15.72:0/1126095541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98c09e000 0x7fd98c1c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.912+0000 7fd9914ea700 1 --2- 172.21.15.72:0/1126095541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd98c09e410 0x7fd98c1c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.913+0000 7fd990ce9700 1 -- 172.21.15.72:0/1126095541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd98c09e410 msgr2=0x7fd98c1c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.913+0000 7fd990ce9700 1 --2- 172.21.15.72:0/1126095541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd98c09e410 0x7fd98c1c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.913+0000 7fd990ce9700 1 -- 172.21.15.72:0/1126095541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98c09e000 msgr2=0x7fd98c1c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.913+0000 7fd990ce9700 1 --2- 172.21.15.72:0/1126095541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98c09e000 0x7fd98c1c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.913+0000 7fd990ce9700 1 -- 172.21.15.72:0/1126095541 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd980009550 con 0x7fd98c09d6f0 2023-10-03T10:19:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.913+0000 7fd98bfff700 1 --2- 172.21.15.72:0/1126095541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98c09e000 0x7fd98c1c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.913+0000 7fd990ce9700 1 --2- 172.21.15.72:0/1126095541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98c09d6f0 0x7fd98c1c8040 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd98000ebe0 tx=0x7fd98000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.913+0000 7fd9897fa700 1 -- 172.21.15.72:0/1126095541 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98000c850 con 0x7fd98c09d6f0 2023-10-03T10:19:06.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.913+0000 7fd9897fa700 1 -- 172.21.15.72:0/1126095541 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98000c9b0 con 0x7fd98c09d6f0 2023-10-03T10:19:06.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.913+0000 7fd992f4d700 1 -- 172.21.15.72:0/1126095541 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd984009a70 con 0x7fd98c09d6f0 2023-10-03T10:19:06.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.913+0000 7fd9897fa700 1 -- 172.21.15.72:0/1126095541 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98000cd40 con 0x7fd98c09d6f0 2023-10-03T10:19:06.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.913+0000 7fd992f4d700 1 -- 172.21.15.72:0/1126095541 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c1a8010 con 0x7fd98c09d6f0 2023-10-03T10:19:06.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.914+0000 7fd9897fa700 1 -- 172.21.15.72:0/1126095541 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd980013470 con 0x7fd98c09d6f0 2023-10-03T10:19:06.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.914+0000 7fd9897fa700 1 -- 172.21.15.72:0/1126095541 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd98003f940 con 0x7fd98c09d6f0 2023-10-03T10:19:06.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.914+0000 7fd992f4d700 1 -- 172.21.15.72:0/1126095541 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c1a8200 con 0x7fd98c09d6f0 2023-10-03T10:19:06.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:06.919+0000 7fd9897fa700 1 -- 172.21.15.72:0/1126095541 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd980021080 con 0x7fd98c09d6f0 2023-10-03T10:19:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.056+0000 7f2328f2c700 1 -- 172.21.15.72:0/1915143114 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2324121c80 con 0x7f232409d6f0 2023-10-03T10:19:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.057+0000 7f2312ffd700 1 -- 172.21.15.72:0/1915143114 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2314011360 con 0x7f232409d6f0 2023-10-03T10:19:07.057 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:07.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.059+0000 7f2328f2c700 1 -- 172.21.15.72:0/1915143114 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f232409d6f0 msgr2=0x7f232411e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.059+0000 7f2328f2c700 1 --2- 172.21.15.72:0/1915143114 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f232409d6f0 0x7f232411e590 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f231400c470 tx=0x7f231400c780 comp rx=0 tx=0).stop 2023-10-03T10:19:07.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.059+0000 7f2328f2c700 1 -- 172.21.15.72:0/1915143114 shutdown_connections 2023-10-03T10:19:07.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.059+0000 7f2328f2c700 1 --2- 172.21.15.72:0/1915143114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2324139170 0x7f232411f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.059+0000 7f2328f2c700 1 --2- 172.21.15.72:0/1915143114 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f232409d6f0 0x7f232411e590 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.059+0000 7f2328f2c700 1 --2- 172.21.15.72:0/1915143114 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f232409e1d0 0x7f232411ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.059+0000 7f2328f2c700 1 -- 172.21.15.72:0/1915143114 >> 172.21.15.72:0/1915143114 conn(0x7f2324066f50 msgr2=0x7f2324136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.059+0000 7f2328f2c700 1 -- 172.21.15.72:0/1915143114 shutdown_connections 2023-10-03T10:19:07.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.059+0000 7f2328f2c700 1 -- 172.21.15.72:0/1915143114 wait complete. 2023-10-03T10:19:07.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:07.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.073+0000 7f6ebec2e700 1 -- 172.21.15.72:0/1030277924 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6eb809e980 con 0x7f6eb81316c0 2023-10-03T10:19:07.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.073+0000 7f6eb57fa700 1 -- 172.21.15.72:0/1030277924 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6ea4003cf0 con 0x7f6eb81316c0 2023-10-03T10:19:07.073 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:07.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.075+0000 7f6ebec2e700 1 -- 172.21.15.72:0/1030277924 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb81316c0 msgr2=0x7f6eb8071360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.075+0000 7f6ebec2e700 1 --2- 172.21.15.72:0/1030277924 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb81316c0 0x7f6eb8071360 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009840 tx=0x7f6ea4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:07.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.075+0000 7f6ebec2e700 1 -- 172.21.15.72:0/1030277924 shutdown_connections 2023-10-03T10:19:07.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.075+0000 7f6ebec2e700 1 --2- 172.21.15.72:0/1030277924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6eb809d9f0 0x7f6eb8070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.075+0000 7f6ebec2e700 1 --2- 172.21.15.72:0/1030277924 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6eb8136a70 0x7f6eb80718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.075+0000 7f6ebec2e700 1 --2- 172.21.15.72:0/1030277924 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6eb81316c0 0x7f6eb8071360 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.075+0000 7f6ebec2e700 1 -- 172.21.15.72:0/1030277924 >> 172.21.15.72:0/1030277924 conn(0x7f6eb8066f50 msgr2=0x7f6eb8136e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.075+0000 7f6ebec2e700 1 -- 172.21.15.72:0/1030277924 shutdown_connections 2023-10-03T10:19:07.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.075+0000 7f6ebec2e700 1 -- 172.21.15.72:0/1030277924 wait complete. 2023-10-03T10:19:07.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.112+0000 7fd992f4d700 1 -- 172.21.15.72:0/1126095541 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd98c074ea0 con 0x7fd98c09d6f0 2023-10-03T10:19:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.113+0000 7fd9897fa700 1 -- 172.21.15.72:0/1126095541 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd980017020 con 0x7fd98c09d6f0 2023-10-03T10:19:07.112 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:07.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.114+0000 7fd992f4d700 1 -- 172.21.15.72:0/1126095541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98c09d6f0 msgr2=0x7fd98c1c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.114+0000 7fd992f4d700 1 --2- 172.21.15.72:0/1126095541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98c09d6f0 0x7fd98c1c8040 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd98000ebe0 tx=0x7fd98000eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.115+0000 7fd992f4d700 1 -- 172.21.15.72:0/1126095541 shutdown_connections 2023-10-03T10:19:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.115+0000 7fd992f4d700 1 --2- 172.21.15.72:0/1126095541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd98c09e410 0x7fd98c1c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.115+0000 7fd992f4d700 1 --2- 172.21.15.72:0/1126095541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98c09d6f0 0x7fd98c1c8040 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.115+0000 7fd992f4d700 1 --2- 172.21.15.72:0/1126095541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd98c09e000 0x7fd98c1c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.115+0000 7fd992f4d700 1 -- 172.21.15.72:0/1126095541 >> 172.21.15.72:0/1126095541 conn(0x7fd98c066f50 msgr2=0x7fd98c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.115+0000 7fd992f4d700 1 -- 172.21.15.72:0/1126095541 shutdown_connections 2023-10-03T10:19:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:07.115+0000 7fd992f4d700 1 -- 172.21.15.72:0/1126095541 wait complete. 2023-10-03T10:19:07.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:07.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:08.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.026+0000 7f04a60f9700 1 Processor -- start 2023-10-03T10:19:08.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.026+0000 7f04a60f9700 1 -- start start 2023-10-03T10:19:08.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.026+0000 7f04a60f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04a009d6f0 0x7f04a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.026+0000 7f04a60f9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04a009e000 0x7f04a01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.026+0000 7f04a60f9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a009b120 con 0x7f04a009e410 2023-10-03T10:19:08.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.026+0000 7f04a60f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a006b460 con 0x7f04a009d6f0 2023-10-03T10:19:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.026+0000 7f04a60f9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04a009a7e0 con 0x7f04a009e000 2023-10-03T10:19:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.027+0000 7f049f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04a009d6f0 0x7f04a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.027+0000 7f0496ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04a009e000 0x7f04a01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.027+0000 7f049f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04a009d6f0 0x7f04a009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42908/0 (socket says 172.21.15.72:42908) 2023-10-03T10:19:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.027+0000 7f049ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f04a009e410 0x7f04a0133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33468/0 (socket says 172.21.15.72:33468) 2023-10-03T10:19:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.027+0000 7f049f7fe700 1 -- 172.21.15.72:0/220548477 learned_addr learned my addr 172.21.15.72:0/220548477 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.027+0000 7f049f7fe700 1 -- 172.21.15.72:0/220548477 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04a009e000 msgr2=0x7f04a01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.027+0000 7f049f7fe700 1 --2- 172.21.15.72:0/220548477 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04a009e000 0x7f04a01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.027+0000 7f049f7fe700 1 -- 172.21.15.72:0/220548477 >> v1:172.21.15.72:6789/0 conn(0x7f04a009e410 legacy=0x7f04a0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.027+0000 7f049f7fe700 1 -- 172.21.15.72:0/220548477 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a009a500 con 0x7f04a009d6f0 2023-10-03T10:19:08.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.027+0000 7f049effd700 1 -- 172.21.15.72:0/220548477 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125291983 0 0) 0x7f04a009b120 con 0x7f04a009e410 2023-10-03T10:19:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.027+0000 7f0496ffd700 1 --2- 172.21.15.72:0/220548477 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04a009e000 0x7f04a01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.027+0000 7f049f7fe700 1 --2- 172.21.15.72:0/220548477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04a009d6f0 0x7f04a009dac0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0490009920 tx=0x7f0490009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb0978e3499cddd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.027+0000 7f049effd700 1 -- 172.21.15.72:0/220548477 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0490011830 con 0x7f04a009d6f0 2023-10-03T10:19:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.027+0000 7f049effd700 1 -- 172.21.15.72:0/220548477 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0490011990 con 0x7f04a009d6f0 2023-10-03T10:19:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.027+0000 7f049effd700 1 -- 172.21.15.72:0/220548477 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0490011d20 con 0x7f04a009d6f0 2023-10-03T10:19:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.028+0000 7f04a60f9700 1 -- 172.21.15.72:0/220548477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04a009d6f0 msgr2=0x7f04a009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.028+0000 7f04a60f9700 1 --2- 172.21.15.72:0/220548477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04a009d6f0 0x7f04a009dac0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0490009920 tx=0x7f0490009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.028+0000 7f04a60f9700 1 -- 172.21.15.72:0/220548477 shutdown_connections 2023-10-03T10:19:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.028+0000 7f04a60f9700 1 --2- 172.21.15.72:0/220548477 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04a009d6f0 0x7f04a009dac0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.028+0000 7f04a60f9700 1 --2- 172.21.15.72:0/220548477 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04a009e000 0x7f04a01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.028+0000 7f04a60f9700 1 -- 172.21.15.72:0/220548477 >> 172.21.15.72:0/220548477 conn(0x7f04a0066f50 msgr2=0x7f04a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.028+0000 7f04a60f9700 1 -- 172.21.15.72:0/220548477 shutdown_connections 2023-10-03T10:19:08.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.028+0000 7f04a60f9700 1 -- 172.21.15.72:0/220548477 wait complete. 2023-10-03T10:19:08.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.029+0000 7f04a60f9700 1 Processor -- start 2023-10-03T10:19:08.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.029+0000 7f04a60f9700 1 -- start start 2023-10-03T10:19:08.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.029+0000 7f04a60f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04a009d6f0 0x7f04a01223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.029+0000 7f04a60f9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04a009e000 0x7f04a0122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.029+0000 7f04a60f9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04a009e410 0x7f04a0122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.029+0000 7f04a60f9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a01336f0 con 0x7f04a009e000 2023-10-03T10:19:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.029+0000 7f04a60f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a0123820 con 0x7f04a009d6f0 2023-10-03T10:19:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.029+0000 7f04a60f9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04a0124dc0 con 0x7f04a009e410 2023-10-03T10:19:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f049ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04a009e410 0x7f04a0122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f049f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04a009d6f0 0x7f04a01223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f0496ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04a009e000 0x7f04a0122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f049ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04a009e410 0x7f04a0122e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48298/0 (socket says 172.21.15.72:48298) 2023-10-03T10:19:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f049f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04a009d6f0 0x7f04a01223c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42922/0 (socket says 172.21.15.72:42922) 2023-10-03T10:19:08.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f049ffff700 1 -- 172.21.15.72:0/2722157912 learned_addr learned my addr 172.21.15.72:0/2722157912 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f049f7fe700 1 -- 172.21.15.72:0/2722157912 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04a009e410 msgr2=0x7f04a0122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f049f7fe700 1 --2- 172.21.15.72:0/2722157912 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04a009e410 0x7f04a0122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f049f7fe700 1 -- 172.21.15.72:0/2722157912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04a009e000 msgr2=0x7f04a0122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f049f7fe700 1 --2- 172.21.15.72:0/2722157912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04a009e000 0x7f04a0122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f049f7fe700 1 -- 172.21.15.72:0/2722157912 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04880094a0 con 0x7f04a009d6f0 2023-10-03T10:19:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f0496ffd700 1 --2- 172.21.15.72:0/2722157912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04a009e000 0x7f04a0122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f049f7fe700 1 --2- 172.21.15.72:0/2722157912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04a009d6f0 0x7f04a01223c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0490016000 tx=0x7f0490004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f049cff9700 1 -- 172.21.15.72:0/2722157912 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0490004240 con 0x7f04a009d6f0 2023-10-03T10:19:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f049cff9700 1 -- 172.21.15.72:0/2722157912 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049001f070 con 0x7f04a009d6f0 2023-10-03T10:19:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f04a60f9700 1 -- 172.21.15.72:0/2722157912 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0490009550 con 0x7f04a009d6f0 2023-10-03T10:19:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f049cff9700 1 -- 172.21.15.72:0/2722157912 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04900045a0 con 0x7f04a009d6f0 2023-10-03T10:19:08.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.030+0000 7f04a60f9700 1 -- 172.21.15.72:0/2722157912 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a00a2a10 con 0x7f04a009d6f0 2023-10-03T10:19:08.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.031+0000 7f049cff9700 1 -- 172.21.15.72:0/2722157912 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0490021030 con 0x7f04a009d6f0 2023-10-03T10:19:08.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.031+0000 7f049cff9700 1 -- 172.21.15.72:0/2722157912 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0490040800 con 0x7f04a009d6f0 2023-10-03T10:19:08.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.031+0000 7f04a60f9700 1 -- 172.21.15.72:0/2722157912 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a009c770 con 0x7f04a009d6f0 2023-10-03T10:19:08.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.036+0000 7f049cff9700 1 -- 172.21.15.72:0/2722157912 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0490015020 con 0x7f04a009d6f0 2023-10-03T10:19:08.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:08.088 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:08.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:08.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.199+0000 7f31f4cbf700 1 Processor -- start 2023-10-03T10:19:08.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.199+0000 7f31f4cbf700 1 -- start start 2023-10-03T10:19:08.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.200+0000 7f31f4cbf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f31f01338a0 0x7f31f0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.200+0000 7f31f4cbf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31f009de50 0x7f31f009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.200+0000 7f31f4cbf700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f006ef30 con 0x7f31f009e760 2023-10-03T10:19:08.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.200+0000 7f31f4cbf700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f006fef0 con 0x7f31f01338a0 2023-10-03T10:19:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.200+0000 7f31f4cbf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f01334b0 con 0x7f31f009de50 2023-10-03T10:19:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.200+0000 7f31edd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31f009de50 0x7f31f009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.200+0000 7f31edd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31f009de50 0x7f31f009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42928/0 (socket says 172.21.15.72:42928) 2023-10-03T10:19:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.200+0000 7f31edd9b700 1 -- 172.21.15.72:0/1124377182 learned_addr learned my addr 172.21.15.72:0/1124377182 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.200+0000 7f31ee59c700 1 --2- 172.21.15.72:0/1124377182 >> v2:172.21.15.72:3300/0 conn(0x7f31f01338a0 0x7f31f0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.200+0000 7f31edd9b700 1 -- 172.21.15.72:0/1124377182 >> v2:172.21.15.72:3300/0 conn(0x7f31f01338a0 msgr2=0x7f31f0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.200+0000 7f31edd9b700 1 --2- 172.21.15.72:0/1124377182 >> v2:172.21.15.72:3300/0 conn(0x7f31f01338a0 0x7f31f0133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.200+0000 7f31edd9b700 1 -- 172.21.15.72:0/1124377182 >> v1:172.21.15.72:6789/0 conn(0x7f31f009e760 legacy=0x7f31f013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.200+0000 7f31edd9b700 1 -- 172.21.15.72:0/1124377182 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f006fc30 con 0x7f31f009de50 2023-10-03T10:19:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.200+0000 7f31edd9b700 1 --2- 172.21.15.72:0/1124377182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31f009de50 0x7f31f009e220 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f31e40098f0 tx=0x7f31e4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cbcac327aa84f49 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.201+0000 7f31ed59a700 1 -- 172.21.15.72:0/1124377182 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e4011830 con 0x7f31f009de50 2023-10-03T10:19:08.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.201+0000 7f31ed59a700 1 -- 172.21.15.72:0/1124377182 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e4011990 con 0x7f31f009de50 2023-10-03T10:19:08.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.201+0000 7f31ed59a700 1 -- 172.21.15.72:0/1124377182 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e4011d20 con 0x7f31f009de50 2023-10-03T10:19:08.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.201+0000 7f31f4cbf700 1 -- 172.21.15.72:0/1124377182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31f009de50 msgr2=0x7f31f009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.201+0000 7f31f4cbf700 1 --2- 172.21.15.72:0/1124377182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31f009de50 0x7f31f009e220 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f31e40098f0 tx=0x7f31e4009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:08.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.201+0000 7f31f4cbf700 1 -- 172.21.15.72:0/1124377182 shutdown_connections 2023-10-03T10:19:08.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.201+0000 7f31f4cbf700 1 --2- 172.21.15.72:0/1124377182 >> v2:172.21.15.72:3300/0 conn(0x7f31f01338a0 0x7f31f0133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.201+0000 7f31f4cbf700 1 --2- 172.21.15.72:0/1124377182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31f009de50 0x7f31f009e220 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.201+0000 7f31f4cbf700 1 -- 172.21.15.72:0/1124377182 >> 172.21.15.72:0/1124377182 conn(0x7f31f00a2aa0 msgr2=0x7f31f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.202+0000 7f31f4cbf700 1 -- 172.21.15.72:0/1124377182 shutdown_connections 2023-10-03T10:19:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.202+0000 7f31f4cbf700 1 -- 172.21.15.72:0/1124377182 wait complete. 2023-10-03T10:19:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.203+0000 7f31f4cbf700 1 Processor -- start 2023-10-03T10:19:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.203+0000 7f31f4cbf700 1 -- start start 2023-10-03T10:19:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31f4cbf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31f009de50 0x7f31f011ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31f4cbf700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31f009e760 0x7f31f011ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31f4cbf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31f01338a0 0x7f31f011f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31f4cbf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f0120ea0 con 0x7f31f01338a0 2023-10-03T10:19:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31f4cbf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f0120720 con 0x7f31f009de50 2023-10-03T10:19:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31f4cbf700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31f0122240 con 0x7f31f009e760 2023-10-03T10:19:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31eed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31f01338a0 0x7f31f011f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31edd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31f009e760 0x7f31f011ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31eed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31f01338a0 0x7f31f011f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40670/0 (socket says 172.21.15.72:40670) 2023-10-03T10:19:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31edd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31f009e760 0x7f31f011ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:48308/0 (socket says 172.21.15.72:48308) 2023-10-03T10:19:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31eed9d700 1 -- 172.21.15.72:0/154428217 learned_addr learned my addr 172.21.15.72:0/154428217 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31ee59c700 1 --2- 172.21.15.72:0/154428217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31f009de50 0x7f31f011ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31eed9d700 1 -- 172.21.15.72:0/154428217 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31f009e760 msgr2=0x7f31f011ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31eed9d700 1 --2- 172.21.15.72:0/154428217 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31f009e760 0x7f31f011ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31eed9d700 1 -- 172.21.15.72:0/154428217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31f009de50 msgr2=0x7f31f011ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31eed9d700 1 --2- 172.21.15.72:0/154428217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31f009de50 0x7f31f011ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31eed9d700 1 -- 172.21.15.72:0/154428217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e4009550 con 0x7f31f01338a0 2023-10-03T10:19:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.204+0000 7f31eed9d700 1 --2- 172.21.15.72:0/154428217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31f01338a0 0x7f31f011f480 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f31e800cc50 tx=0x7f31e800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.205+0000 7f31deffd700 1 -- 172.21.15.72:0/154428217 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8003c00 con 0x7f31f01338a0 2023-10-03T10:19:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.205+0000 7f31deffd700 1 -- 172.21.15.72:0/154428217 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e8003d60 con 0x7f31f01338a0 2023-10-03T10:19:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.205+0000 7f31f4cbf700 1 -- 172.21.15.72:0/154428217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f00a1020 con 0x7f31f01338a0 2023-10-03T10:19:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.205+0000 7f31f4cbf700 1 -- 172.21.15.72:0/154428217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f0122cb0 con 0x7f31f01338a0 2023-10-03T10:19:08.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.205+0000 7f31deffd700 1 -- 172.21.15.72:0/154428217 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e800aab0 con 0x7f31f01338a0 2023-10-03T10:19:08.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.206+0000 7f31f4cbf700 1 -- 172.21.15.72:0/154428217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d40052e0 con 0x7f31f01338a0 2023-10-03T10:19:08.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.206+0000 7f31deffd700 1 -- 172.21.15.72:0/154428217 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31e800ac10 con 0x7f31f01338a0 2023-10-03T10:19:08.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.206+0000 7f31deffd700 1 -- 172.21.15.72:0/154428217 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f31e803f5c0 con 0x7f31f01338a0 2023-10-03T10:19:08.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.211+0000 7f31deffd700 1 -- 172.21.15.72:0/154428217 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31e80196c0 con 0x7f31f01338a0 2023-10-03T10:19:08.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.231+0000 7f04a60f9700 1 -- 172.21.15.72:0/2722157912 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f04a0074ea0 con 0x7f04a009d6f0 2023-10-03T10:19:08.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.232+0000 7f049cff9700 1 -- 172.21.15.72:0/2722157912 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f049001a450 con 0x7f04a009d6f0 2023-10-03T10:19:08.231 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:08.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.234+0000 7f04a60f9700 1 -- 172.21.15.72:0/2722157912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04a009d6f0 msgr2=0x7f04a01223c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.234+0000 7f04a60f9700 1 --2- 172.21.15.72:0/2722157912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04a009d6f0 0x7f04a01223c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0490016000 tx=0x7f0490004750 comp rx=0 tx=0).stop 2023-10-03T10:19:08.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.235+0000 7f04a60f9700 1 -- 172.21.15.72:0/2722157912 shutdown_connections 2023-10-03T10:19:08.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.235+0000 7f04a60f9700 1 --2- 172.21.15.72:0/2722157912 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f04a009e410 0x7f04a0122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.235+0000 7f04a60f9700 1 --2- 172.21.15.72:0/2722157912 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f04a009d6f0 0x7f04a01223c0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.235+0000 7f04a60f9700 1 --2- 172.21.15.72:0/2722157912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f04a009e000 0x7f04a0122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.235+0000 7f04a60f9700 1 -- 172.21.15.72:0/2722157912 >> 172.21.15.72:0/2722157912 conn(0x7f04a0066f50 msgr2=0x7f04a00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.235+0000 7f04a60f9700 1 -- 172.21.15.72:0/2722157912 shutdown_connections 2023-10-03T10:19:08.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.235+0000 7f04a60f9700 1 -- 172.21.15.72:0/2722157912 wait complete. 2023-10-03T10:19:08.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.245+0000 7f01cc934700 1 Processor -- start 2023-10-03T10:19:08.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.245+0000 7f01cc934700 1 -- start start 2023-10-03T10:19:08.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.246+0000 7f01cc934700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c809d9f0 0x7f01c8136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.246+0000 7f01cc934700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01c8136a70 0x7f01c8138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.246+0000 7f01cc934700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c809e130 con 0x7f01c81316c0 2023-10-03T10:19:08.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.246+0000 7f01cc934700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c81321a0 con 0x7f01c8136a70 2023-10-03T10:19:08.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.246+0000 7f01cc934700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c81312b0 con 0x7f01c809d9f0 2023-10-03T10:19:08.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.246+0000 7f01c659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f01c81316c0 0x7f01c8131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54518/0 (socket says 172.21.15.72:54518) 2023-10-03T10:19:08.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.246+0000 7f01c659c700 1 -- 172.21.15.72:0/316654022 learned_addr learned my addr 172.21.15.72:0/316654022 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:08.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.246+0000 7f01c6d9d700 1 --2- 172.21.15.72:0/316654022 >> v2:172.21.15.72:3300/0 conn(0x7f01c8136a70 0x7f01c8138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.246+0000 7f01c5d9b700 1 --2- 172.21.15.72:0/316654022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c809d9f0 0x7f01c8136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.246+0000 7f01c6d9d700 1 -- 172.21.15.72:0/316654022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c809d9f0 msgr2=0x7f01c8136530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.246+0000 7f01c6d9d700 1 --2- 172.21.15.72:0/316654022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c809d9f0 0x7f01c8136530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.246+0000 7f01c6d9d700 1 -- 172.21.15.72:0/316654022 >> v1:172.21.15.72:6789/0 conn(0x7f01c81316c0 legacy=0x7f01c8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.247+0000 7f01c6d9d700 1 -- 172.21.15.72:0/316654022 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c809f6e0 con 0x7f01c8136a70 2023-10-03T10:19:08.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.246+0000 7f01c559a700 1 -- 172.21.15.72:0/316654022 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33028991 0 0) 0x7f01b8001110 con 0x7f01c81316c0 2023-10-03T10:19:08.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.247+0000 7f01c5d9b700 1 --2- 172.21.15.72:0/316654022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c809d9f0 0x7f01c8136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:08.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.247+0000 7f01c6d9d700 1 --2- 172.21.15.72:0/316654022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c8136a70 0x7f01c8138e50 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009d90 tx=0x7f01c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab409ae10ff0a4e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.247+0000 7f01c559a700 1 -- 172.21.15.72:0/316654022 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c000e070 con 0x7f01c8136a70 2023-10-03T10:19:08.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.247+0000 7f01c559a700 1 -- 172.21.15.72:0/316654022 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c000bb20 con 0x7f01c8136a70 2023-10-03T10:19:08.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.247+0000 7f01c559a700 1 -- 172.21.15.72:0/316654022 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0012430 con 0x7f01c8136a70 2023-10-03T10:19:08.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:08.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.248+0000 7f01cc934700 1 -- 172.21.15.72:0/316654022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c8136a70 msgr2=0x7f01c8138e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.248+0000 7f01cc934700 1 --2- 172.21.15.72:0/316654022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c8136a70 0x7f01c8138e50 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009d90 tx=0x7f01c000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:08.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.248+0000 7f01cc934700 1 -- 172.21.15.72:0/316654022 shutdown_connections 2023-10-03T10:19:08.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.248+0000 7f01cc934700 1 --2- 172.21.15.72:0/316654022 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c8136a70 0x7f01c8138e50 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.248+0000 7f01cc934700 1 --2- 172.21.15.72:0/316654022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c809d9f0 0x7f01c8136530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.248+0000 7f01cc934700 1 -- 172.21.15.72:0/316654022 >> 172.21.15.72:0/316654022 conn(0x7f01c8066f50 msgr2=0x7f01c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.248+0000 7f01cc934700 1 -- 172.21.15.72:0/316654022 shutdown_connections 2023-10-03T10:19:08.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.248+0000 7f01cc934700 1 -- 172.21.15.72:0/316654022 wait complete. 2023-10-03T10:19:08.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.250+0000 7f01cc934700 1 Processor -- start 2023-10-03T10:19:08.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.250+0000 7f01cc934700 1 -- start start 2023-10-03T10:19:08.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.250+0000 7f01cc934700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c809d9f0 0x7f01c8070d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.250+0000 7f01cc934700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c81316c0 0x7f01c80712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.250+0000 7f01cc934700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01c8136a70 0x7f01c80717f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.250+0000 7f01cc934700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c806ffb0 con 0x7f01c81316c0 2023-10-03T10:19:08.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.250+0000 7f01cc934700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c8070190 con 0x7f01c809d9f0 2023-10-03T10:19:08.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.250+0000 7f01cc934700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01c8072690 con 0x7f01c8136a70 2023-10-03T10:19:08.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01c5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c81316c0 0x7f01c80712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01c659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c809d9f0 0x7f01c8070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01c5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c81316c0 0x7f01c80712b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35872/0 (socket says 172.21.15.72:35872) 2023-10-03T10:19:08.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01c5d9b700 1 -- 172.21.15.72:0/3258194920 learned_addr learned my addr 172.21.15.72:0/3258194920 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:08.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01c6d9d700 1 --2- 172.21.15.72:0/3258194920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01c8136a70 0x7f01c80717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01c6d9d700 1 -- 172.21.15.72:0/3258194920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c809d9f0 msgr2=0x7f01c8070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01c6d9d700 1 --2- 172.21.15.72:0/3258194920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c809d9f0 0x7f01c8070d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01c6d9d700 1 -- 172.21.15.72:0/3258194920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c81316c0 msgr2=0x7f01c80712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01c6d9d700 1 --2- 172.21.15.72:0/3258194920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c81316c0 0x7f01c80712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01c6d9d700 1 -- 172.21.15.72:0/3258194920 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc0094a0 con 0x7f01c8136a70 2023-10-03T10:19:08.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01c6d9d700 1 --2- 172.21.15.72:0/3258194920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01c8136a70 0x7f01c80717f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f01c0016000 tx=0x7f01c0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01b6ffd700 1 -- 172.21.15.72:0/3258194920 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0012430 con 0x7f01c8136a70 2023-10-03T10:19:08.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01b6ffd700 1 -- 172.21.15.72:0/3258194920 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c0020070 con 0x7f01c8136a70 2023-10-03T10:19:08.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01b6ffd700 1 -- 172.21.15.72:0/3258194920 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0004280 con 0x7f01c8136a70 2023-10-03T10:19:08.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01cc934700 1 -- 172.21.15.72:0/3258194920 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c0009a70 con 0x7f01c8136a70 2023-10-03T10:19:08.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.251+0000 7f01cc934700 1 -- 172.21.15.72:0/3258194920 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c806fbf0 con 0x7f01c8136a70 2023-10-03T10:19:08.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.252+0000 7f01b6ffd700 1 -- 172.21.15.72:0/3258194920 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01c00043e0 con 0x7f01c8136a70 2023-10-03T10:19:08.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.252+0000 7f01b6ffd700 1 -- 172.21.15.72:0/3258194920 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f01c0022070 con 0x7f01c8136a70 2023-10-03T10:19:08.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.253+0000 7f01cc934700 1 -- 172.21.15.72:0/3258194920 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c806fde0 con 0x7f01c8136a70 2023-10-03T10:19:08.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.261+0000 7f01b6ffd700 1 -- 172.21.15.72:0/3258194920 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01c00269d0 con 0x7f01c8136a70 2023-10-03T10:19:08.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.291+0000 7fef8c05b700 1 Processor -- start 2023-10-03T10:19:08.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.291+0000 7fef8c05b700 1 -- start start 2023-10-03T10:19:08.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.291+0000 7fef8c05b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef840a0a30 0x7fef840a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.291+0000 7fef8c05b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef8409d630 0x7fef840a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.291+0000 7fef8c05b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef84133930 0x7fef84133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.291+0000 7fef8c05b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef840a2a70 con 0x7fef840a0a30 2023-10-03T10:19:08.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.291+0000 7fef8c05b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef840a01d0 con 0x7fef8409d630 2023-10-03T10:19:08.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.291+0000 7fef8c05b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef8409e2b0 con 0x7fef84133930 2023-10-03T10:19:08.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef89df7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef840a0a30 0x7fef840a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef8a5f8700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef84133930 0x7fef84133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef895f6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef8409d630 0x7fef840a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef89df7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef840a0a30 0x7fef840a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35884/0 (socket says 172.21.15.72:35884) 2023-10-03T10:19:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef89df7700 1 -- 172.21.15.72:0/559563620 learned_addr learned my addr 172.21.15.72:0/559563620 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef8a5f8700 1 --2- 172.21.15.72:0/559563620 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef84133930 0x7fef84133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45750/0 (socket says 172.21.15.72:45750) 2023-10-03T10:19:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef8a5f8700 1 -- 172.21.15.72:0/559563620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef8409d630 msgr2=0x7fef840a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef8a5f8700 1 --2- 172.21.15.72:0/559563620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef8409d630 0x7fef840a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef8a5f8700 1 -- 172.21.15.72:0/559563620 >> v2:172.21.15.72:3300/0 conn(0x7fef840a0a30 msgr2=0x7fef840a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef8a5f8700 1 --2- 172.21.15.72:0/559563620 >> v2:172.21.15.72:3300/0 conn(0x7fef840a0a30 0x7fef840a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef8a5f8700 1 -- 172.21.15.72:0/559563620 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8409dc50 con 0x7fef84133930 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef895f6700 1 --2- 172.21.15.72:0/559563620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef8409d630 0x7fef840a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef89df7700 1 --2- 172.21.15.72:0/559563620 >> v2:172.21.15.72:3300/0 conn(0x7fef840a0a30 0x7fef840a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef8a5f8700 1 --2- 172.21.15.72:0/559563620 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef84133930 0x7fef84133db0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009d90 tx=0x7fef7c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9cb55f401c6246c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef88df5700 1 -- 172.21.15.72:0/559563620 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c00e070 con 0x7fef84133930 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef88df5700 1 -- 172.21.15.72:0/559563620 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c00bb20 con 0x7fef84133930 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.292+0000 7fef88df5700 1 -- 172.21.15.72:0/559563620 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c012430 con 0x7fef84133930 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.293+0000 7fef8c05b700 1 -- 172.21.15.72:0/559563620 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef84133930 msgr2=0x7fef84133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.293+0000 7fef8c05b700 1 --2- 172.21.15.72:0/559563620 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef84133930 0x7fef84133db0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009d90 tx=0x7fef7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.293+0000 7fef8c05b700 1 -- 172.21.15.72:0/559563620 shutdown_connections 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.293+0000 7fef8c05b700 1 --2- 172.21.15.72:0/559563620 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef84133930 0x7fef84133db0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.293+0000 7fef8c05b700 1 --2- 172.21.15.72:0/559563620 >> v2:172.21.15.72:3300/0 conn(0x7fef840a0a30 0x7fef840a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.293+0000 7fef8c05b700 1 --2- 172.21.15.72:0/559563620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef8409d630 0x7fef840a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.293+0000 7fef8c05b700 1 -- 172.21.15.72:0/559563620 >> 172.21.15.72:0/559563620 conn(0x7fef840a3050 msgr2=0x7fef840a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.293+0000 7fef8c05b700 1 -- 172.21.15.72:0/559563620 shutdown_connections 2023-10-03T10:19:08.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.293+0000 7fef8c05b700 1 -- 172.21.15.72:0/559563620 wait complete. 2023-10-03T10:19:08.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.294+0000 7fef8c05b700 1 Processor -- start 2023-10-03T10:19:08.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.294+0000 7fef8c05b700 1 -- start start 2023-10-03T10:19:08.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef8c05b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef8409d630 0x7fef841c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef8c05b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef840a0a30 0x7fef841c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef8c05b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef84133930 0x7fef841c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef8c05b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef84122720 con 0x7fef840a0a30 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef8c05b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef841209b0 con 0x7fef84133930 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef8c05b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef84120780 con 0x7fef8409d630 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef89df7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef8409d630 0x7fef841c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef89df7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef8409d630 0x7fef841c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45754/0 (socket says 172.21.15.72:45754) 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef89df7700 1 -- 172.21.15.72:0/1971858936 learned_addr learned my addr 172.21.15.72:0/1971858936 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef8a5f8700 1 --2- 172.21.15.72:0/1971858936 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef84133930 0x7fef841c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef895f6700 1 --2- 172.21.15.72:0/1971858936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef840a0a30 0x7fef841c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef89df7700 1 -- 172.21.15.72:0/1971858936 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef84133930 msgr2=0x7fef841c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef89df7700 1 --2- 172.21.15.72:0/1971858936 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef84133930 0x7fef841c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef89df7700 1 -- 172.21.15.72:0/1971858936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef840a0a30 msgr2=0x7fef841c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef89df7700 1 --2- 172.21.15.72:0/1971858936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef840a0a30 0x7fef841c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef89df7700 1 -- 172.21.15.72:0/1971858936 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef740094a0 con 0x7fef8409d630 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef89df7700 1 --2- 172.21.15.72:0/1971858936 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef8409d630 0x7fef841c8090 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fef8000ec10 tx=0x7fef8000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef7a7fc700 1 -- 172.21.15.72:0/1971858936 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8000c850 con 0x7fef8409d630 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.295+0000 7fef7a7fc700 1 -- 172.21.15.72:0/1971858936 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8000c9b0 con 0x7fef8409d630 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.296+0000 7fef8c05b700 1 -- 172.21.15.72:0/1971858936 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef80009550 con 0x7fef8409d630 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.296+0000 7fef7a7fc700 1 -- 172.21.15.72:0/1971858936 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8000cd40 con 0x7fef8409d630 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.296+0000 7fef8c05b700 1 -- 172.21.15.72:0/1971858936 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c009a70 con 0x7fef8409d630 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.297+0000 7fef7a7fc700 1 -- 172.21.15.72:0/1971858936 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef80013470 con 0x7fef8409d630 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.297+0000 7fef8c05b700 1 -- 172.21.15.72:0/1971858936 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef84121760 con 0x7fef8409d630 2023-10-03T10:19:08.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.297+0000 7fef7a7fc700 1 -- 172.21.15.72:0/1971858936 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef8003f790 con 0x7fef8409d630 2023-10-03T10:19:08.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.301+0000 7fef7a7fc700 1 -- 172.21.15.72:0/1971858936 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef80013720 con 0x7fef8409d630 2023-10-03T10:19:08.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.415+0000 7f31f4cbf700 1 -- 172.21.15.72:0/154428217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f31d4005590 con 0x7f31f01338a0 2023-10-03T10:19:08.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.415+0000 7f31deffd700 1 -- 172.21.15.72:0/154428217 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f31e8011380 con 0x7f31f01338a0 2023-10-03T10:19:08.415 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:08.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.418+0000 7f31f4cbf700 1 -- 172.21.15.72:0/154428217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31f01338a0 msgr2=0x7f31f011f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.418+0000 7f31f4cbf700 1 --2- 172.21.15.72:0/154428217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31f01338a0 0x7f31f011f480 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f31e800cc50 tx=0x7f31e800cf60 comp rx=0 tx=0).stop 2023-10-03T10:19:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.418+0000 7f31f4cbf700 1 -- 172.21.15.72:0/154428217 shutdown_connections 2023-10-03T10:19:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.418+0000 7f31f4cbf700 1 --2- 172.21.15.72:0/154428217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31f01338a0 0x7f31f011f480 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.418+0000 7f31f4cbf700 1 --2- 172.21.15.72:0/154428217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31f009de50 0x7f31f011ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.418+0000 7f31f4cbf700 1 --2- 172.21.15.72:0/154428217 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f31f009e760 0x7f31f011ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.418+0000 7f31f4cbf700 1 -- 172.21.15.72:0/154428217 >> 172.21.15.72:0/154428217 conn(0x7f31f00a2aa0 msgr2=0x7f31f009ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.418+0000 7f31f4cbf700 1 -- 172.21.15.72:0/154428217 shutdown_connections 2023-10-03T10:19:08.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.418+0000 7f31f4cbf700 1 -- 172.21.15.72:0/154428217 wait complete. 2023-10-03T10:19:08.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:08.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.457+0000 7f01cc934700 1 -- 172.21.15.72:0/3258194920 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f01c8074ea0 con 0x7f01c8136a70 2023-10-03T10:19:08.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.457+0000 7f01b6ffd700 1 -- 172.21.15.72:0/3258194920 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f01c00263e0 con 0x7f01c8136a70 2023-10-03T10:19:08.458 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:08.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.460+0000 7f01cc934700 1 -- 172.21.15.72:0/3258194920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01c8136a70 msgr2=0x7f01c80717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.460+0000 7f01cc934700 1 --2- 172.21.15.72:0/3258194920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01c8136a70 0x7f01c80717f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f01c0016000 tx=0x7f01c0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.460+0000 7f01cc934700 1 -- 172.21.15.72:0/3258194920 shutdown_connections 2023-10-03T10:19:08.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.460+0000 7f01cc934700 1 --2- 172.21.15.72:0/3258194920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f01c8136a70 0x7f01c80717f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.460+0000 7f01cc934700 1 --2- 172.21.15.72:0/3258194920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01c809d9f0 0x7f01c8070d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.460+0000 7f01cc934700 1 --2- 172.21.15.72:0/3258194920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c81316c0 0x7f01c80712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.460+0000 7f01cc934700 1 -- 172.21.15.72:0/3258194920 >> 172.21.15.72:0/3258194920 conn(0x7f01c8066f50 msgr2=0x7f01c80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.460+0000 7f01cc934700 1 -- 172.21.15.72:0/3258194920 shutdown_connections 2023-10-03T10:19:08.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.460+0000 7f01cc934700 1 -- 172.21.15.72:0/3258194920 wait complete. 2023-10-03T10:19:08.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:08.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.497+0000 7fef8c05b700 1 -- 172.21.15.72:0/1971858936 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fef84122580 con 0x7fef8409d630 2023-10-03T10:19:08.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.498+0000 7fef7a7fc700 1 -- 172.21.15.72:0/1971858936 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef84122580 con 0x7fef8409d630 2023-10-03T10:19:08.498 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:08.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.500+0000 7fef8c05b700 1 -- 172.21.15.72:0/1971858936 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef8409d630 msgr2=0x7fef841c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.500+0000 7fef8c05b700 1 --2- 172.21.15.72:0/1971858936 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef8409d630 0x7fef841c8090 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fef8000ec10 tx=0x7fef8000ef20 comp rx=0 tx=0).stop 2023-10-03T10:19:08.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.500+0000 7fef8c05b700 1 -- 172.21.15.72:0/1971858936 shutdown_connections 2023-10-03T10:19:08.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.500+0000 7fef8c05b700 1 --2- 172.21.15.72:0/1971858936 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef84133930 0x7fef841c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.500+0000 7fef8c05b700 1 --2- 172.21.15.72:0/1971858936 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fef8409d630 0x7fef841c8090 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.500+0000 7fef8c05b700 1 --2- 172.21.15.72:0/1971858936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef840a0a30 0x7fef841c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.500+0000 7fef8c05b700 1 -- 172.21.15.72:0/1971858936 >> 172.21.15.72:0/1971858936 conn(0x7fef840a3050 msgr2=0x7fef8409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.500+0000 7fef8c05b700 1 -- 172.21.15.72:0/1971858936 shutdown_connections 2023-10-03T10:19:08.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:08.500+0000 7fef8c05b700 1 -- 172.21.15.72:0/1971858936 wait complete. 2023-10-03T10:19:08.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:09.250 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:09.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.380+0000 7f91f7ed3700 1 Processor -- start 2023-10-03T10:19:09.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.380+0000 7f91f7ed3700 1 -- start start 2023-10-03T10:19:09.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f7ed3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91f0136710 0x7f91f0138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f7ed3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91f0139030 0x7f91f013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f7ed3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f006ef30 con 0x7f91f01338a0 2023-10-03T10:19:09.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f7ed3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f006fef0 con 0x7f91f0136710 2023-10-03T10:19:09.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f7ed3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f01334b0 con 0x7f91f0139030 2023-10-03T10:19:09.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f546e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91f0136710 0x7f91f0138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f6470700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91f0139030 0x7f91f013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f6470700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91f0139030 0x7f91f013b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41832/0 (socket says 172.21.15.72:41832) 2023-10-03T10:19:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f546e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91f0136710 0x7f91f0138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35900/0 (socket says 172.21.15.72:35900) 2023-10-03T10:19:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f6470700 1 -- 172.21.15.72:0/3008582232 learned_addr learned my addr 172.21.15.72:0/3008582232 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f6470700 1 -- 172.21.15.72:0/3008582232 >> v2:172.21.15.72:3300/0 conn(0x7f91f0136710 msgr2=0x7f91f0138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f6470700 1 --2- 172.21.15.72:0/3008582232 >> v2:172.21.15.72:3300/0 conn(0x7f91f0136710 0x7f91f0138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f6470700 1 -- 172.21.15.72:0/3008582232 >> v1:172.21.15.72:6789/0 conn(0x7f91f01338a0 legacy=0x7f91f0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f6470700 1 -- 172.21.15.72:0/3008582232 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f006fc30 con 0x7f91f0139030 2023-10-03T10:19:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f546e700 1 --2- 172.21.15.72:0/3008582232 >> v2:172.21.15.72:3300/0 conn(0x7f91f0136710 0x7f91f0138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.381+0000 7f91f6470700 1 --2- 172.21.15.72:0/3008582232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91f0139030 0x7f91f013b410 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f91e8009e50 tx=0x7f91e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ce998b1c4aa4d4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.382+0000 7f91f4c6d700 1 -- 172.21.15.72:0/3008582232 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e800e070 con 0x7f91f0139030 2023-10-03T10:19:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.382+0000 7f91f4c6d700 1 -- 172.21.15.72:0/3008582232 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e800b910 con 0x7f91f0139030 2023-10-03T10:19:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.382+0000 7f91f4c6d700 1 -- 172.21.15.72:0/3008582232 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e800bcc0 con 0x7f91f0139030 2023-10-03T10:19:09.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.382+0000 7f91f7ed3700 1 -- 172.21.15.72:0/3008582232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91f0139030 msgr2=0x7f91f013b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.382+0000 7f91f7ed3700 1 --2- 172.21.15.72:0/3008582232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91f0139030 0x7f91f013b410 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f91e8009e50 tx=0x7f91e800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.382+0000 7f91f7ed3700 1 -- 172.21.15.72:0/3008582232 shutdown_connections 2023-10-03T10:19:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.382+0000 7f91f7ed3700 1 --2- 172.21.15.72:0/3008582232 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91f0139030 0x7f91f013b410 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.382+0000 7f91f7ed3700 1 --2- 172.21.15.72:0/3008582232 >> v2:172.21.15.72:3300/0 conn(0x7f91f0136710 0x7f91f0138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.382+0000 7f91f7ed3700 1 -- 172.21.15.72:0/3008582232 >> 172.21.15.72:0/3008582232 conn(0x7f91f00a2aa0 msgr2=0x7f91f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.382+0000 7f91f7ed3700 1 -- 172.21.15.72:0/3008582232 shutdown_connections 2023-10-03T10:19:09.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.382+0000 7f91f7ed3700 1 -- 172.21.15.72:0/3008582232 wait complete. 2023-10-03T10:19:09.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.383+0000 7f91f7ed3700 1 Processor -- start 2023-10-03T10:19:09.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.383+0000 7f91f7ed3700 1 -- start start 2023-10-03T10:19:09.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.383+0000 7f91f7ed3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f01338a0 0x7f91f011ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f7ed3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91f0136710 0x7f91f011b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f7ed3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91f0139030 0x7f91f011b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f7ed3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f011ca60 con 0x7f91f01338a0 2023-10-03T10:19:09.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f7ed3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f0138b00 con 0x7f91f0136710 2023-10-03T10:19:09.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f7ed3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91f006f640 con 0x7f91f0139030 2023-10-03T10:19:09.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f5c6f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f01338a0 0x7f91f011ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f5c6f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f01338a0 0x7f91f011ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35908/0 (socket says 172.21.15.72:35908) 2023-10-03T10:19:09.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f5c6f700 1 -- 172.21.15.72:0/2634920074 learned_addr learned my addr 172.21.15.72:0/2634920074 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:09.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f6470700 1 --2- 172.21.15.72:0/2634920074 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91f0139030 0x7f91f011b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f546e700 1 --2- 172.21.15.72:0/2634920074 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91f0136710 0x7f91f011b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f5c6f700 1 -- 172.21.15.72:0/2634920074 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91f0139030 msgr2=0x7f91f011b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f5c6f700 1 --2- 172.21.15.72:0/2634920074 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91f0139030 0x7f91f011b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f5c6f700 1 -- 172.21.15.72:0/2634920074 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91f0136710 msgr2=0x7f91f011b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f5c6f700 1 --2- 172.21.15.72:0/2634920074 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91f0136710 0x7f91f011b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f5c6f700 1 -- 172.21.15.72:0/2634920074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec0094a0 con 0x7f91f01338a0 2023-10-03T10:19:09.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f5c6f700 1 --2- 172.21.15.72:0/2634920074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f01338a0 0x7f91f011ad40 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f91e000c4e0 tx=0x7f91e000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91e67fc700 1 -- 172.21.15.72:0/2634920074 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00052d0 con 0x7f91f01338a0 2023-10-03T10:19:09.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91e67fc700 1 -- 172.21.15.72:0/2634920074 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e0005430 con 0x7f91f01338a0 2023-10-03T10:19:09.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f7ed3700 1 -- 172.21.15.72:0/2634920074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e8009b30 con 0x7f91f01338a0 2023-10-03T10:19:09.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91e67fc700 1 -- 172.21.15.72:0/2634920074 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00038c0 con 0x7f91f01338a0 2023-10-03T10:19:09.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.384+0000 7f91f7ed3700 1 -- 172.21.15.72:0/2634920074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f011d140 con 0x7f91f01338a0 2023-10-03T10:19:09.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.385+0000 7f91e67fc700 1 -- 172.21.15.72:0/2634920074 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91e0003a20 con 0x7f91f01338a0 2023-10-03T10:19:09.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.385+0000 7f91e67fc700 1 -- 172.21.15.72:0/2634920074 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f91e003ea10 con 0x7f91f01338a0 2023-10-03T10:19:09.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.385+0000 7f91f7ed3700 1 -- 172.21.15.72:0/2634920074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f0074ea0 con 0x7f91f01338a0 2023-10-03T10:19:09.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.390+0000 7f91e67fc700 1 -- 172.21.15.72:0/2634920074 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91e0017080 con 0x7f91f01338a0 2023-10-03T10:19:09.430 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:09.473 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:09.513 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:09.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.557+0000 7fb3f7a8e700 1 Processor -- start 2023-10-03T10:19:09.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.558+0000 7fb3f7a8e700 1 -- start start 2023-10-03T10:19:09.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.558+0000 7fb3f7a8e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f0136710 0x7fb3f0138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.558+0000 7fb3f7a8e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f0139030 0x7fb3f013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.558+0000 7fb3f7a8e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f006ef30 con 0x7fb3f01338a0 2023-10-03T10:19:09.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.558+0000 7fb3f7a8e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f006fef0 con 0x7fb3f0139030 2023-10-03T10:19:09.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.558+0000 7fb3f7a8e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f01334b0 con 0x7fb3f0136710 2023-10-03T10:19:09.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.558+0000 7fb3f5029700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f0136710 0x7fb3f0138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.558+0000 7fb3f5029700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f0136710 0x7fb3f0138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45776/0 (socket says 172.21.15.72:45776) 2023-10-03T10:19:09.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.558+0000 7fb3f602b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f0139030 0x7fb3f013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.558+0000 7fb3f5029700 1 -- 172.21.15.72:0/4096049975 learned_addr learned my addr 172.21.15.72:0/4096049975 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:09.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.559+0000 7fb3f602b700 1 -- 172.21.15.72:0/4096049975 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f0136710 msgr2=0x7fb3f0138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.559+0000 7fb3f602b700 1 --2- 172.21.15.72:0/4096049975 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f0136710 0x7fb3f0138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.559+0000 7fb3f602b700 1 -- 172.21.15.72:0/4096049975 >> v1:172.21.15.72:6789/0 conn(0x7fb3f01338a0 legacy=0x7fb3f0133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.559+0000 7fb3f602b700 1 -- 172.21.15.72:0/4096049975 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f006fc30 con 0x7fb3f0139030 2023-10-03T10:19:09.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.559+0000 7fb3f5029700 1 --2- 172.21.15.72:0/4096049975 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f0136710 0x7fb3f0138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.559+0000 7fb3f602b700 1 --2- 172.21.15.72:0/4096049975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f0139030 0x7fb3f013b410 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009dc0 tx=0x7fb3e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f60c97549117ca72 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.559+0000 7fb3f4828700 1 -- 172.21.15.72:0/4096049975 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e800e070 con 0x7fb3f0139030 2023-10-03T10:19:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.559+0000 7fb3f4828700 1 -- 172.21.15.72:0/4096049975 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e800bb20 con 0x7fb3f0139030 2023-10-03T10:19:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.559+0000 7fb3f4828700 1 -- 172.21.15.72:0/4096049975 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8012430 con 0x7fb3f0139030 2023-10-03T10:19:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.560+0000 7fb3f7a8e700 1 -- 172.21.15.72:0/4096049975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f0139030 msgr2=0x7fb3f013b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.560+0000 7fb3f7a8e700 1 --2- 172.21.15.72:0/4096049975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f0139030 0x7fb3f013b410 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009dc0 tx=0x7fb3e800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.560+0000 7fb3f7a8e700 1 -- 172.21.15.72:0/4096049975 shutdown_connections 2023-10-03T10:19:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.560+0000 7fb3f7a8e700 1 --2- 172.21.15.72:0/4096049975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f0139030 0x7fb3f013b410 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.560+0000 7fb3f7a8e700 1 --2- 172.21.15.72:0/4096049975 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f0136710 0x7fb3f0138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.560+0000 7fb3f7a8e700 1 -- 172.21.15.72:0/4096049975 >> 172.21.15.72:0/4096049975 conn(0x7fb3f00a2aa0 msgr2=0x7fb3f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.560+0000 7fb3f7a8e700 1 -- 172.21.15.72:0/4096049975 shutdown_connections 2023-10-03T10:19:09.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.560+0000 7fb3f7a8e700 1 -- 172.21.15.72:0/4096049975 wait complete. 2023-10-03T10:19:09.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.561+0000 7fb3f7a8e700 1 Processor -- start 2023-10-03T10:19:09.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.561+0000 7fb3f7a8e700 1 -- start start 2023-10-03T10:19:09.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.562+0000 7fb3f7a8e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3f01338a0 0x7fb3f011aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.562+0000 7fb3f7a8e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f0136710 0x7fb3f011b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.562+0000 7fb3f7a8e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f0139030 0x7fb3f011b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.562+0000 7fb3f7a8e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f011cb60 con 0x7fb3f01338a0 2023-10-03T10:19:09.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.562+0000 7fb3f7a8e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f006f640 con 0x7fb3f0136710 2023-10-03T10:19:09.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.562+0000 7fb3f7a8e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f0138b00 con 0x7fb3f0139030 2023-10-03T10:19:09.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.562+0000 7fb3f5029700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f0136710 0x7fb3f011b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.562+0000 7fb3f582a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3f01338a0 0x7fb3f011aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.562+0000 7fb3f5029700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f0136710 0x7fb3f011b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41852/0 (socket says 172.21.15.72:41852) 2023-10-03T10:19:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.562+0000 7fb3f582a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3f01338a0 0x7fb3f011aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35914/0 (socket says 172.21.15.72:35914) 2023-10-03T10:19:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.562+0000 7fb3f5029700 1 -- 172.21.15.72:0/3812157686 learned_addr learned my addr 172.21.15.72:0/3812157686 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.562+0000 7fb3f602b700 1 --2- 172.21.15.72:0/3812157686 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f0139030 0x7fb3f011b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.563+0000 7fb3f582a700 1 -- 172.21.15.72:0/3812157686 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f0139030 msgr2=0x7fb3f011b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.563+0000 7fb3f582a700 1 --2- 172.21.15.72:0/3812157686 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f0139030 0x7fb3f011b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.563+0000 7fb3f582a700 1 -- 172.21.15.72:0/3812157686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f0136710 msgr2=0x7fb3f011b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.563+0000 7fb3f582a700 1 --2- 172.21.15.72:0/3812157686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f0136710 0x7fb3f011b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.563+0000 7fb3f582a700 1 -- 172.21.15.72:0/3812157686 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e0009550 con 0x7fb3f01338a0 2023-10-03T10:19:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.563+0000 7fb3f582a700 1 --2- 172.21.15.72:0/3812157686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3f01338a0 0x7fb3f011aef0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec000f60 tx=0x7fb3ec00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.563+0000 7fb3e67fc700 1 -- 172.21.15.72:0/3812157686 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0052d0 con 0x7fb3f01338a0 2023-10-03T10:19:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.563+0000 7fb3e67fc700 1 -- 172.21.15.72:0/3812157686 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec005430 con 0x7fb3f01338a0 2023-10-03T10:19:09.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.563+0000 7fb3f7a8e700 1 -- 172.21.15.72:0/3812157686 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e8009a70 con 0x7fb3f01338a0 2023-10-03T10:19:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.563+0000 7fb3e67fc700 1 -- 172.21.15.72:0/3812157686 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0038c0 con 0x7fb3f01338a0 2023-10-03T10:19:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.563+0000 7fb3f7a8e700 1 -- 172.21.15.72:0/3812157686 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f011e610 con 0x7fb3f01338a0 2023-10-03T10:19:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.564+0000 7fb3e67fc700 1 -- 172.21.15.72:0/3812157686 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3ec003a20 con 0x7fb3f01338a0 2023-10-03T10:19:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.564+0000 7fb3e67fc700 1 -- 172.21.15.72:0/3812157686 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb3ec03e990 con 0x7fb3f01338a0 2023-10-03T10:19:09.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.564+0000 7fb3f7a8e700 1 -- 172.21.15.72:0/3812157686 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f011d210 con 0x7fb3f01338a0 2023-10-03T10:19:09.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.573+0000 7fb3e67fc700 1 -- 172.21.15.72:0/3812157686 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3ec017080 con 0x7fb3f01338a0 2023-10-03T10:19:09.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.586+0000 7f91f7ed3700 1 -- 172.21.15.72:0/2634920074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f91f011f050 con 0x7f91f01338a0 2023-10-03T10:19:09.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.586+0000 7f91e67fc700 1 -- 172.21.15.72:0/2634920074 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91e0018260 con 0x7f91f01338a0 2023-10-03T10:19:09.586 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:09.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.588+0000 7f91f7ed3700 1 -- 172.21.15.72:0/2634920074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f01338a0 msgr2=0x7f91f011ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.588+0000 7f91f7ed3700 1 --2- 172.21.15.72:0/2634920074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f01338a0 0x7f91f011ad40 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f91e000c4e0 tx=0x7f91e000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.588+0000 7f91f7ed3700 1 -- 172.21.15.72:0/2634920074 shutdown_connections 2023-10-03T10:19:09.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.588+0000 7f91f7ed3700 1 --2- 172.21.15.72:0/2634920074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91f01338a0 0x7f91f011ad40 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.588+0000 7f91f7ed3700 1 --2- 172.21.15.72:0/2634920074 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f91f0139030 0x7f91f011b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.588+0000 7f91f7ed3700 1 --2- 172.21.15.72:0/2634920074 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91f0136710 0x7f91f011b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.589+0000 7f91f7ed3700 1 -- 172.21.15.72:0/2634920074 >> 172.21.15.72:0/2634920074 conn(0x7f91f00a2aa0 msgr2=0x7f91f01344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.589+0000 7f91f7ed3700 1 -- 172.21.15.72:0/2634920074 shutdown_connections 2023-10-03T10:19:09.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.589+0000 7f91f7ed3700 1 -- 172.21.15.72:0/2634920074 wait complete. 2023-10-03T10:19:09.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:09.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.612+0000 7f9c56d6e700 1 Processor -- start 2023-10-03T10:19:09.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.612+0000 7f9c56d6e700 1 -- start start 2023-10-03T10:19:09.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.612+0000 7f9c56d6e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c5009d6f0 0x7f9c5009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.612+0000 7f9c56d6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c5009e000 0x7f9c50130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.612+0000 7f9c56d6e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5009f130 con 0x7f9c5009e410 2023-10-03T10:19:09.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.612+0000 7f9c56d6e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5009f520 con 0x7f9c5009d6f0 2023-10-03T10:19:09.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.612+0000 7f9c56d6e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5009e930 con 0x7f9c5009e000 2023-10-03T10:19:09.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.612+0000 7f9c54b0a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c5009d6f0 0x7f9c5009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.612+0000 7f9c54b0a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c5009d6f0 0x7f9c5009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:35918/0 (socket says 172.21.15.72:35918) 2023-10-03T10:19:09.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.612+0000 7f9c54b0a700 1 -- 172.21.15.72:0/1989807502 learned_addr learned my addr 172.21.15.72:0/1989807502 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:09.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.612+0000 7f9c4ffff700 1 --2- 172.21.15.72:0/1989807502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c5009e000 0x7f9c50130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.613+0000 7f9c54b0a700 1 -- 172.21.15.72:0/1989807502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c5009e000 msgr2=0x7f9c50130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.613+0000 7f9c54b0a700 1 --2- 172.21.15.72:0/1989807502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c5009e000 0x7f9c50130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.613+0000 7f9c54b0a700 1 -- 172.21.15.72:0/1989807502 >> v1:172.21.15.72:6789/0 conn(0x7f9c5009e410 legacy=0x7f9c50130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.613+0000 7f9c4f7fe700 1 -- 172.21.15.72:0/1989807502 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049976486 0 0) 0x7f9c5009f130 con 0x7f9c5009e410 2023-10-03T10:19:09.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.613+0000 7f9c54b0a700 1 -- 172.21.15.72:0/1989807502 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5009b2d0 con 0x7f9c5009d6f0 2023-10-03T10:19:09.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.613+0000 7f9c4ffff700 1 --2- 172.21.15.72:0/1989807502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c5009e000 0x7f9c50130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.613+0000 7f9c54b0a700 1 --2- 172.21.15.72:0/1989807502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c5009d6f0 0x7f9c5009dac0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f9c440098f0 tx=0x7f9c44009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b0950eff5324e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.613+0000 7f9c4f7fe700 1 -- 172.21.15.72:0/1989807502 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44011830 con 0x7f9c5009d6f0 2023-10-03T10:19:09.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.613+0000 7f9c4f7fe700 1 -- 172.21.15.72:0/1989807502 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c44011990 con 0x7f9c5009d6f0 2023-10-03T10:19:09.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.613+0000 7f9c4f7fe700 1 -- 172.21.15.72:0/1989807502 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44011d20 con 0x7f9c5009d6f0 2023-10-03T10:19:09.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.614+0000 7f9c56d6e700 1 -- 172.21.15.72:0/1989807502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c5009d6f0 msgr2=0x7f9c5009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.614+0000 7f9c56d6e700 1 --2- 172.21.15.72:0/1989807502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c5009d6f0 0x7f9c5009dac0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f9c440098f0 tx=0x7f9c44009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.614+0000 7f9c56d6e700 1 -- 172.21.15.72:0/1989807502 shutdown_connections 2023-10-03T10:19:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.614+0000 7f9c56d6e700 1 --2- 172.21.15.72:0/1989807502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c5009d6f0 0x7f9c5009dac0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.614+0000 7f9c56d6e700 1 --2- 172.21.15.72:0/1989807502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c5009e000 0x7f9c50130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.614+0000 7f9c56d6e700 1 -- 172.21.15.72:0/1989807502 >> 172.21.15.72:0/1989807502 conn(0x7f9c50066f50 msgr2=0x7f9c5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.614+0000 7f9c56d6e700 1 -- 172.21.15.72:0/1989807502 shutdown_connections 2023-10-03T10:19:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.614+0000 7f9c56d6e700 1 -- 172.21.15.72:0/1989807502 wait complete. 2023-10-03T10:19:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.615+0000 7f9c56d6e700 1 Processor -- start 2023-10-03T10:19:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.615+0000 7f9c56d6e700 1 -- start start 2023-10-03T10:19:09.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c56d6e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c5009d6f0 0x7f9c5011dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c56d6e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c5009e000 0x7f9c5011e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c56d6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c5009e410 0x7f9c5011e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c56d6e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c50122270 con 0x7f9c5009d6f0 2023-10-03T10:19:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c56d6e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c501218b0 con 0x7f9c5009e410 2023-10-03T10:19:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c56d6e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c50120bf0 con 0x7f9c5009e000 2023-10-03T10:19:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c4ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c5009e000 0x7f9c5011e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c4ffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c5009e000 0x7f9c5011e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45802/0 (socket says 172.21.15.72:45802) 2023-10-03T10:19:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c4ffff700 1 -- 172.21.15.72:0/2455848511 learned_addr learned my addr 172.21.15.72:0/2455848511 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c54b0a700 1 --2- 172.21.15.72:0/2455848511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c5009d6f0 0x7f9c5011dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c5530b700 1 --2- 172.21.15.72:0/2455848511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c5009e410 0x7f9c5011e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c54b0a700 1 -- 172.21.15.72:0/2455848511 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c5009e000 msgr2=0x7f9c5011e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c54b0a700 1 --2- 172.21.15.72:0/2455848511 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c5009e000 0x7f9c5011e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c54b0a700 1 -- 172.21.15.72:0/2455848511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c5009e410 msgr2=0x7f9c5011e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c54b0a700 1 --2- 172.21.15.72:0/2455848511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c5009e410 0x7f9c5011e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c54b0a700 1 -- 172.21.15.72:0/2455848511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c00f610 con 0x7f9c5009d6f0 2023-10-03T10:19:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c4ffff700 1 --2- 172.21.15.72:0/2455848511 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c5009e000 0x7f9c5011e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.616+0000 7f9c5530b700 1 --2- 172.21.15.72:0/2455848511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c5009e410 0x7f9c5011e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.617+0000 7f9c54b0a700 1 --2- 172.21.15.72:0/2455848511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c5009d6f0 0x7f9c5011dd90 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f9c44016000 tx=0x7f9c44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.617+0000 7f9c4d7fa700 1 -- 172.21.15.72:0/2455848511 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44004300 con 0x7f9c5009d6f0 2023-10-03T10:19:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.617+0000 7f9c4d7fa700 1 -- 172.21.15.72:0/2455848511 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4401f070 con 0x7f9c5009d6f0 2023-10-03T10:19:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.617+0000 7f9c56d6e700 1 -- 172.21.15.72:0/2455848511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c44009550 con 0x7f9c5009d6f0 2023-10-03T10:19:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.617+0000 7f9c4d7fa700 1 -- 172.21.15.72:0/2455848511 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c440036a0 con 0x7f9c5009d6f0 2023-10-03T10:19:09.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.617+0000 7f9c56d6e700 1 -- 172.21.15.72:0/2455848511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c500a2050 con 0x7f9c5009d6f0 2023-10-03T10:19:09.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.618+0000 7f9c56d6e700 1 -- 172.21.15.72:0/2455848511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5011ac20 con 0x7f9c5009d6f0 2023-10-03T10:19:09.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.618+0000 7f9c4d7fa700 1 -- 172.21.15.72:0/2455848511 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c44021030 con 0x7f9c5009d6f0 2023-10-03T10:19:09.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.618+0000 7f9c4d7fa700 1 -- 172.21.15.72:0/2455848511 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9c44040e40 con 0x7f9c5009d6f0 2023-10-03T10:19:09.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.627+0000 7f9c4d7fa700 1 -- 172.21.15.72:0/2455848511 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c440239c0 con 0x7f9c5009d6f0 2023-10-03T10:19:09.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.652+0000 7fb957eeb700 1 Processor -- start 2023-10-03T10:19:09.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.652+0000 7fb957eeb700 1 -- start start 2023-10-03T10:19:09.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.653+0000 7fb957eeb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb95006c0e0 0x7fb95009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.653+0000 7fb957eeb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9501380f0 0x7fb95013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.653+0000 7fb957eeb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb950134980 con 0x7fb950134ec0 2023-10-03T10:19:09.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.653+0000 7fb957eeb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95006c4b0 con 0x7fb95006c0e0 2023-10-03T10:19:09.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.653+0000 7fb957eeb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9500a09c0 con 0x7fb9501380f0 2023-10-03T10:19:09.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.653+0000 7fb955c87700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb95006c0e0 0x7fb95009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.653+0000 7fb955486700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb950134ec0 0x7fb9501379e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54546/0 (socket says 172.21.15.72:54546) 2023-10-03T10:19:09.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.653+0000 7fb955486700 1 -- 172.21.15.72:0/1031926804 learned_addr learned my addr 172.21.15.72:0/1031926804 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:09.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.653+0000 7fb956488700 1 --2- 172.21.15.72:0/1031926804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9501380f0 0x7fb95013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.653+0000 7fb955c87700 1 -- 172.21.15.72:0/1031926804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9501380f0 msgr2=0x7fb95013fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.653+0000 7fb955c87700 1 --2- 172.21.15.72:0/1031926804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9501380f0 0x7fb95013fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.653+0000 7fb955c87700 1 -- 172.21.15.72:0/1031926804 >> v1:172.21.15.72:6789/0 conn(0x7fb950134ec0 legacy=0x7fb9501379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.654+0000 7fb954c85700 1 -- 172.21.15.72:0/1031926804 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616122266 0 0) 0x7fb950134980 con 0x7fb950134ec0 2023-10-03T10:19:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.654+0000 7fb955c87700 1 -- 172.21.15.72:0/1031926804 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9500a0600 con 0x7fb95006c0e0 2023-10-03T10:19:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.654+0000 7fb956488700 1 --2- 172.21.15.72:0/1031926804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9501380f0 0x7fb95013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.654+0000 7fb955c87700 1 --2- 172.21.15.72:0/1031926804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95006c0e0 0x7fb95009ac90 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009840 tx=0x7fb94c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120d7eba1fc2f62 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.654+0000 7fb954c85700 1 -- 172.21.15.72:0/1031926804 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c011830 con 0x7fb95006c0e0 2023-10-03T10:19:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.654+0000 7fb954c85700 1 -- 172.21.15.72:0/1031926804 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c011990 con 0x7fb95006c0e0 2023-10-03T10:19:09.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.654+0000 7fb954c85700 1 -- 172.21.15.72:0/1031926804 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c011d20 con 0x7fb95006c0e0 2023-10-03T10:19:09.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.655+0000 7fb957eeb700 1 -- 172.21.15.72:0/1031926804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95006c0e0 msgr2=0x7fb95009ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.655+0000 7fb957eeb700 1 --2- 172.21.15.72:0/1031926804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95006c0e0 0x7fb95009ac90 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009840 tx=0x7fb94c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:09.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.655+0000 7fb957eeb700 1 -- 172.21.15.72:0/1031926804 shutdown_connections 2023-10-03T10:19:09.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.655+0000 7fb957eeb700 1 --2- 172.21.15.72:0/1031926804 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9501380f0 0x7fb95013fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.655+0000 7fb957eeb700 1 --2- 172.21.15.72:0/1031926804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95006c0e0 0x7fb95009ac90 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.655+0000 7fb957eeb700 1 -- 172.21.15.72:0/1031926804 >> 172.21.15.72:0/1031926804 conn(0x7fb9500a4210 msgr2=0x7fb9500a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.655+0000 7fb957eeb700 1 -- 172.21.15.72:0/1031926804 shutdown_connections 2023-10-03T10:19:09.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.655+0000 7fb957eeb700 1 -- 172.21.15.72:0/1031926804 wait complete. 2023-10-03T10:19:09.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.656+0000 7fb957eeb700 1 Processor -- start 2023-10-03T10:19:09.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.656+0000 7fb957eeb700 1 -- start start 2023-10-03T10:19:09.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.656+0000 7fb957eeb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95006c0e0 0x7fb95011a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.656+0000 7fb957eeb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb950134ec0 0x7fb95011ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.656+0000 7fb957eeb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9501380f0 0x7fb95011b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.656+0000 7fb957eeb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb950134140 con 0x7fb95006c0e0 2023-10-03T10:19:09.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.656+0000 7fb957eeb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95011dbb0 con 0x7fb9501380f0 2023-10-03T10:19:09.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.656+0000 7fb957eeb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9500a3cc0 con 0x7fb950134ec0 2023-10-03T10:19:09.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.656+0000 7fb955486700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb950134ec0 0x7fb95011ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.656+0000 7fb955486700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb950134ec0 0x7fb95011ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45816/0 (socket says 172.21.15.72:45816) 2023-10-03T10:19:09.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.656+0000 7fb955486700 1 -- 172.21.15.72:0/3960048402 learned_addr learned my addr 172.21.15.72:0/3960048402 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:09.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.656+0000 7fb955c87700 1 --2- 172.21.15.72:0/3960048402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95006c0e0 0x7fb95011a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.656+0000 7fb956488700 1 --2- 172.21.15.72:0/3960048402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9501380f0 0x7fb95011b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.657+0000 7fb955c87700 1 -- 172.21.15.72:0/3960048402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb950134ec0 msgr2=0x7fb95011ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.657+0000 7fb955c87700 1 --2- 172.21.15.72:0/3960048402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb950134ec0 0x7fb95011ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.657+0000 7fb955c87700 1 -- 172.21.15.72:0/3960048402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9501380f0 msgr2=0x7fb95011b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.657+0000 7fb955c87700 1 --2- 172.21.15.72:0/3960048402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9501380f0 0x7fb95011b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.657+0000 7fb955c87700 1 -- 172.21.15.72:0/3960048402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb948009a70 con 0x7fb95006c0e0 2023-10-03T10:19:09.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.657+0000 7fb955c87700 1 --2- 172.21.15.72:0/3960048402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95006c0e0 0x7fb95011a8f0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fb94c016000 tx=0x7fb94c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.657+0000 7fb9467fc700 1 -- 172.21.15.72:0/3960048402 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0036a0 con 0x7fb95006c0e0 2023-10-03T10:19:09.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.657+0000 7fb9467fc700 1 -- 172.21.15.72:0/3960048402 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c01e070 con 0x7fb95006c0e0 2023-10-03T10:19:09.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.657+0000 7fb957eeb700 1 -- 172.21.15.72:0/3960048402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94c0094a0 con 0x7fb95006c0e0 2023-10-03T10:19:09.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.657+0000 7fb9467fc700 1 -- 172.21.15.72:0/3960048402 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c003a40 con 0x7fb95006c0e0 2023-10-03T10:19:09.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.657+0000 7fb957eeb700 1 -- 172.21.15.72:0/3960048402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95011c490 con 0x7fb95006c0e0 2023-10-03T10:19:09.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.658+0000 7fb9467fc700 1 -- 172.21.15.72:0/3960048402 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb94c003ba0 con 0x7fb95006c0e0 2023-10-03T10:19:09.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.658+0000 7fb957eeb700 1 -- 172.21.15.72:0/3960048402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb950074ea0 con 0x7fb95006c0e0 2023-10-03T10:19:09.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.658+0000 7fb9467fc700 1 -- 172.21.15.72:0/3960048402 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb94c040510 con 0x7fb95006c0e0 2023-10-03T10:19:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.667+0000 7fb9467fc700 1 -- 172.21.15.72:0/3960048402 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb94c01a420 con 0x7fb95006c0e0 2023-10-03T10:19:09.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.798+0000 7fb3f7a8e700 1 -- 172.21.15.72:0/3812157686 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb3f0074ea0 con 0x7fb3f01338a0 2023-10-03T10:19:09.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.799+0000 7fb3e67fc700 1 -- 172.21.15.72:0/3812157686 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb3ec011590 con 0x7fb3f01338a0 2023-10-03T10:19:09.798 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:09.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.801+0000 7fb3f7a8e700 1 -- 172.21.15.72:0/3812157686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3f01338a0 msgr2=0x7fb3f011aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.801+0000 7fb3f7a8e700 1 --2- 172.21.15.72:0/3812157686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3f01338a0 0x7fb3f011aef0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec000f60 tx=0x7fb3ec00c730 comp rx=0 tx=0).stop 2023-10-03T10:19:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.801+0000 7fb3f7a8e700 1 -- 172.21.15.72:0/3812157686 shutdown_connections 2023-10-03T10:19:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.801+0000 7fb3f7a8e700 1 --2- 172.21.15.72:0/3812157686 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb3f01338a0 0x7fb3f011aef0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.801+0000 7fb3f7a8e700 1 --2- 172.21.15.72:0/3812157686 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb3f0139030 0x7fb3f011b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.801+0000 7fb3f7a8e700 1 --2- 172.21.15.72:0/3812157686 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb3f0136710 0x7fb3f011b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.801+0000 7fb3f7a8e700 1 -- 172.21.15.72:0/3812157686 >> 172.21.15.72:0/3812157686 conn(0x7fb3f00a2aa0 msgr2=0x7fb3f01344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.801+0000 7fb3f7a8e700 1 -- 172.21.15.72:0/3812157686 shutdown_connections 2023-10-03T10:19:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.801+0000 7fb3f7a8e700 1 -- 172.21.15.72:0/3812157686 wait complete. 2023-10-03T10:19:09.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:09.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.846+0000 7f9c56d6e700 1 -- 172.21.15.72:0/2455848511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9c50121450 con 0x7f9c5009d6f0 2023-10-03T10:19:09.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.846+0000 7f9c4d7fa700 1 -- 172.21.15.72:0/2455848511 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9c44015070 con 0x7f9c5009d6f0 2023-10-03T10:19:09.846 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.848+0000 7f9c56d6e700 1 -- 172.21.15.72:0/2455848511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c5009d6f0 msgr2=0x7f9c5011dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.848+0000 7f9c56d6e700 1 --2- 172.21.15.72:0/2455848511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c5009d6f0 0x7f9c5011dd90 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f9c44016000 tx=0x7f9c44004750 comp rx=0 tx=0).stop 2023-10-03T10:19:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.848+0000 7f9c56d6e700 1 -- 172.21.15.72:0/2455848511 shutdown_connections 2023-10-03T10:19:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.848+0000 7f9c56d6e700 1 --2- 172.21.15.72:0/2455848511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c5009d6f0 0x7f9c5011dd90 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.848+0000 7f9c56d6e700 1 --2- 172.21.15.72:0/2455848511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c5009e410 0x7f9c5011e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.848+0000 7f9c56d6e700 1 --2- 172.21.15.72:0/2455848511 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9c5009e000 0x7f9c5011e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.848+0000 7f9c56d6e700 1 -- 172.21.15.72:0/2455848511 >> 172.21.15.72:0/2455848511 conn(0x7f9c50066f50 msgr2=0x7f9c50130a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.848+0000 7f9c56d6e700 1 -- 172.21.15.72:0/2455848511 shutdown_connections 2023-10-03T10:19:09.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.848+0000 7f9c56d6e700 1 -- 172.21.15.72:0/2455848511 wait complete. 2023-10-03T10:19:09.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:09.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.874+0000 7fb957eeb700 1 -- 172.21.15.72:0/3960048402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb95006b250 con 0x7fb95006c0e0 2023-10-03T10:19:09.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.875+0000 7fb9467fc700 1 -- 172.21.15.72:0/3960048402 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb94c02c3a0 con 0x7fb95006c0e0 2023-10-03T10:19:09.874 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:09.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.877+0000 7fb957eeb700 1 -- 172.21.15.72:0/3960048402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95006c0e0 msgr2=0x7fb95011a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.877+0000 7fb957eeb700 1 --2- 172.21.15.72:0/3960048402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95006c0e0 0x7fb95011a8f0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fb94c016000 tx=0x7fb94c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:09.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.877+0000 7fb957eeb700 1 -- 172.21.15.72:0/3960048402 shutdown_connections 2023-10-03T10:19:09.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.877+0000 7fb957eeb700 1 --2- 172.21.15.72:0/3960048402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb95006c0e0 0x7fb95011a8f0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.877+0000 7fb957eeb700 1 --2- 172.21.15.72:0/3960048402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9501380f0 0x7fb95011b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.877+0000 7fb957eeb700 1 --2- 172.21.15.72:0/3960048402 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb950134ec0 0x7fb95011ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.877+0000 7fb957eeb700 1 -- 172.21.15.72:0/3960048402 >> 172.21.15.72:0/3960048402 conn(0x7fb9500a4210 msgr2=0x7fb950099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.877+0000 7fb957eeb700 1 -- 172.21.15.72:0/3960048402 shutdown_connections 2023-10-03T10:19:09.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:09.877+0000 7fb957eeb700 1 -- 172.21.15.72:0/3960048402 wait complete. 2023-10-03T10:19:09.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:10.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:10.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.733+0000 7f747bbcd700 1 Processor -- start 2023-10-03T10:19:10.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.733+0000 7f747bbcd700 1 -- start start 2023-10-03T10:19:10.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f747bbcd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f747409d6f0 0x7f747409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f747bbcd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f747409e000 0x7f74741339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f747bbcd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747409b120 con 0x7f747409e410 2023-10-03T10:19:10.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f747bbcd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747406b460 con 0x7f747409e000 2023-10-03T10:19:10.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f747bbcd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f747409a7e0 con 0x7f747409d6f0 2023-10-03T10:19:10.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f7479969700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f747409d6f0 0x7f747409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f7479168700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f747409e000 0x7f74741339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f747a16a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f747409e410 0x7f7474133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54554/0 (socket says 172.21.15.72:54554) 2023-10-03T10:19:10.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f747a16a700 1 -- 172.21.15.72:0/1717387504 learned_addr learned my addr 172.21.15.72:0/1717387504 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:10.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f7479969700 1 -- 172.21.15.72:0/1717387504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f747409e000 msgr2=0x7f74741339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:10.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f7479969700 1 --2- 172.21.15.72:0/1717387504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f747409e000 0x7f74741339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f7479969700 1 -- 172.21.15.72:0/1717387504 >> v1:172.21.15.72:6789/0 conn(0x7f747409e410 legacy=0x7f7474133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f7479969700 1 -- 172.21.15.72:0/1717387504 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747409a500 con 0x7f747409d6f0 2023-10-03T10:19:10.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f7478967700 1 -- 172.21.15.72:0/1717387504 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985276135 0 0) 0x7f747409b120 con 0x7f747409e410 2023-10-03T10:19:10.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f7479168700 1 --2- 172.21.15.72:0/1717387504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f747409e000 0x7f74741339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:10.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f7479969700 1 --2- 172.21.15.72:0/1717387504 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f747409d6f0 0x7f747409dac0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f74640098a0 tx=0x7f7464009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30a55e2daeff36d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:10.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f7478967700 1 -- 172.21.15.72:0/1717387504 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464011830 con 0x7f747409d6f0 2023-10-03T10:19:10.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f7478967700 1 -- 172.21.15.72:0/1717387504 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7464011990 con 0x7f747409d6f0 2023-10-03T10:19:10.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.734+0000 7f7478967700 1 -- 172.21.15.72:0/1717387504 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464011d20 con 0x7f747409d6f0 2023-10-03T10:19:10.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.735+0000 7f747bbcd700 1 -- 172.21.15.72:0/1717387504 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f747409d6f0 msgr2=0x7f747409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.735+0000 7f747bbcd700 1 --2- 172.21.15.72:0/1717387504 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f747409d6f0 0x7f747409dac0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f74640098a0 tx=0x7f7464009bb0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.735+0000 7f747bbcd700 1 -- 172.21.15.72:0/1717387504 shutdown_connections 2023-10-03T10:19:10.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.735+0000 7f747bbcd700 1 --2- 172.21.15.72:0/1717387504 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f747409d6f0 0x7f747409dac0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.735+0000 7f747bbcd700 1 --2- 172.21.15.72:0/1717387504 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f747409e000 0x7f74741339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.735+0000 7f747bbcd700 1 -- 172.21.15.72:0/1717387504 >> 172.21.15.72:0/1717387504 conn(0x7f7474066f50 msgr2=0x7f747409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.735+0000 7f747bbcd700 1 -- 172.21.15.72:0/1717387504 shutdown_connections 2023-10-03T10:19:10.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.735+0000 7f747bbcd700 1 -- 172.21.15.72:0/1717387504 wait complete. 2023-10-03T10:19:10.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.736+0000 7f747bbcd700 1 Processor -- start 2023-10-03T10:19:10.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.736+0000 7f747bbcd700 1 -- start start 2023-10-03T10:19:10.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.736+0000 7f747bbcd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f747409d6f0 0x7f74741c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.736+0000 7f747bbcd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f747409e000 0x7f74741c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.736+0000 7f747bbcd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f747409e410 0x7f74741c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.736+0000 7f747bbcd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74741a72e0 con 0x7f747409e410 2023-10-03T10:19:10.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.736+0000 7f747bbcd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74741c5ad0 con 0x7f747409e000 2023-10-03T10:19:10.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.736+0000 7f747bbcd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74741a9820 con 0x7f747409d6f0 2023-10-03T10:19:10.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f7479969700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f747409d6f0 0x7f74741c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f747a16a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f747409e410 0x7f74741c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f7479969700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f747409d6f0 0x7f74741c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45830/0 (socket says 172.21.15.72:45830) 2023-10-03T10:19:10.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f7479969700 1 -- 172.21.15.72:0/2883834448 learned_addr learned my addr 172.21.15.72:0/2883834448 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:10.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f7479168700 1 --2- 172.21.15.72:0/2883834448 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f747409e000 0x7f74741c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f7479969700 1 -- 172.21.15.72:0/2883834448 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f747409e000 msgr2=0x7f74741c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f7479969700 1 --2- 172.21.15.72:0/2883834448 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f747409e000 0x7f74741c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f7479969700 1 -- 172.21.15.72:0/2883834448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f747409e410 msgr2=0x7f74741c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f7479969700 1 --2- 172.21.15.72:0/2883834448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f747409e410 0x7f74741c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f7479969700 1 -- 172.21.15.72:0/2883834448 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74700094a0 con 0x7f747409d6f0 2023-10-03T10:19:10.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f747a16a700 1 --2- 172.21.15.72:0/2883834448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f747409e410 0x7f74741c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:10.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f7479969700 1 --2- 172.21.15.72:0/2883834448 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f747409d6f0 0x7f74741c5050 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f74640097c0 tx=0x7f7464004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:10.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f746a7fc700 1 -- 172.21.15.72:0/2883834448 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464004450 con 0x7f747409d6f0 2023-10-03T10:19:10.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f746a7fc700 1 -- 172.21.15.72:0/2883834448 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746401f070 con 0x7f747409d6f0 2023-10-03T10:19:10.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f746a7fc700 1 -- 172.21.15.72:0/2883834448 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74640038e0 con 0x7f747409d6f0 2023-10-03T10:19:10.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f747bbcd700 1 -- 172.21.15.72:0/2883834448 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74640094a0 con 0x7f747409d6f0 2023-10-03T10:19:10.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.737+0000 7f747bbcd700 1 -- 172.21.15.72:0/2883834448 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74741a8b60 con 0x7f747409d6f0 2023-10-03T10:19:10.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.738+0000 7f746a7fc700 1 -- 172.21.15.72:0/2883834448 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7464003a40 con 0x7f747409d6f0 2023-10-03T10:19:10.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.738+0000 7f746a7fc700 1 -- 172.21.15.72:0/2883834448 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7464021070 con 0x7f747409d6f0 2023-10-03T10:19:10.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.738+0000 7f747bbcd700 1 -- 172.21.15.72:0/2883834448 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7474074ea0 con 0x7f747409d6f0 2023-10-03T10:19:10.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.743+0000 7f746a7fc700 1 -- 172.21.15.72:0/2883834448 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7464015080 con 0x7f747409d6f0 2023-10-03T10:19:10.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:10.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:10.889 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:10.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.937+0000 7f747bbcd700 1 -- 172.21.15.72:0/2883834448 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f747406c360 con 0x7f747409d6f0 2023-10-03T10:19:10.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.938+0000 7f746a7fc700 1 -- 172.21.15.72:0/2883834448 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7464035090 con 0x7f747409d6f0 2023-10-03T10:19:10.937 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:10.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.940+0000 7f64d4503700 1 Processor -- start 2023-10-03T10:19:10.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.940+0000 7f747bbcd700 1 -- 172.21.15.72:0/2883834448 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f747409d6f0 msgr2=0x7f74741c5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.940+0000 7f747bbcd700 1 --2- 172.21.15.72:0/2883834448 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f747409d6f0 0x7f74741c5050 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f74640097c0 tx=0x7f7464004750 comp rx=0 tx=0).stop 2023-10-03T10:19:10.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.940+0000 7f747bbcd700 1 -- 172.21.15.72:0/2883834448 shutdown_connections 2023-10-03T10:19:10.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.940+0000 7f747bbcd700 1 --2- 172.21.15.72:0/2883834448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f747409e410 0x7f74741c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.940+0000 7f747bbcd700 1 --2- 172.21.15.72:0/2883834448 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f747409d6f0 0x7f74741c5050 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.940+0000 7f747bbcd700 1 --2- 172.21.15.72:0/2883834448 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f747409e000 0x7f74741c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.940+0000 7f747bbcd700 1 -- 172.21.15.72:0/2883834448 >> 172.21.15.72:0/2883834448 conn(0x7f7474066f50 msgr2=0x7f74741bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f747bbcd700 1 -- 172.21.15.72:0/2883834448 shutdown_connections 2023-10-03T10:19:10.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f747bbcd700 1 -- 172.21.15.72:0/2883834448 wait complete. 2023-10-03T10:19:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.940+0000 7f64d4503700 1 -- start start 2023-10-03T10:19:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d4503700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64cc09e1d0 0x7f64cc135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d4503700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64cc135e50 0x7f64cc138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d4503700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc09f130 con 0x7f64cc09d6f0 2023-10-03T10:19:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d4503700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64cc09f520 con 0x7f64cc135e50 2023-10-03T10:19:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d4503700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc09e930 con 0x7f64cc09e1d0 2023-10-03T10:19:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d229f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f64cc09d6f0 0x7f64cc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54564/0 (socket says 172.21.15.72:54564) 2023-10-03T10:19:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d229f700 1 -- 172.21.15.72:0/892147442 learned_addr learned my addr 172.21.15.72:0/892147442 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d1a9e700 1 --2- 172.21.15.72:0/892147442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64cc09e1d0 0x7f64cc135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d2aa0700 1 --2- 172.21.15.72:0/892147442 >> v2:172.21.15.72:3300/0 conn(0x7f64cc135e50 0x7f64cc138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d129d700 1 -- 172.21.15.72:0/892147442 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063915412 0 0) 0x7f64cc09f130 con 0x7f64cc09d6f0 2023-10-03T10:19:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d129d700 1 -- 172.21.15.72:0/892147442 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64b80057c0 con 0x7f64cc09d6f0 2023-10-03T10:19:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d1a9e700 1 -- 172.21.15.72:0/892147442 >> v2:172.21.15.72:3300/0 conn(0x7f64cc135e50 msgr2=0x7f64cc138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d1a9e700 1 --2- 172.21.15.72:0/892147442 >> v2:172.21.15.72:3300/0 conn(0x7f64cc135e50 0x7f64cc138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d1a9e700 1 -- 172.21.15.72:0/892147442 >> v1:172.21.15.72:6789/0 conn(0x7f64cc09d6f0 legacy=0x7f64cc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d1a9e700 1 -- 172.21.15.72:0/892147442 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc09b2d0 con 0x7f64cc09e1d0 2023-10-03T10:19:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.941+0000 7f64d2aa0700 1 --2- 172.21.15.72:0/892147442 >> v2:172.21.15.72:3300/0 conn(0x7f64cc135e50 0x7f64cc138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.942+0000 7f64d1a9e700 1 --2- 172.21.15.72:0/892147442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64cc09e1d0 0x7f64cc135910 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009870 tx=0x7f64bc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc0349b547aea122 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.942+0000 7f64d129d700 1 -- 172.21.15.72:0/892147442 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc011830 con 0x7f64cc09e1d0 2023-10-03T10:19:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.942+0000 7f64d129d700 1 -- 172.21.15.72:0/892147442 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64bc011990 con 0x7f64cc09e1d0 2023-10-03T10:19:10.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.942+0000 7f64d129d700 1 -- 172.21.15.72:0/892147442 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc011d20 con 0x7f64cc09e1d0 2023-10-03T10:19:10.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.943+0000 7f64d4503700 1 -- 172.21.15.72:0/892147442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64cc09e1d0 msgr2=0x7f64cc135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.943+0000 7f64d4503700 1 --2- 172.21.15.72:0/892147442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64cc09e1d0 0x7f64cc135910 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009870 tx=0x7f64bc009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:10.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.943+0000 7f64d4503700 1 -- 172.21.15.72:0/892147442 shutdown_connections 2023-10-03T10:19:10.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.943+0000 7f64d4503700 1 --2- 172.21.15.72:0/892147442 >> v2:172.21.15.72:3300/0 conn(0x7f64cc135e50 0x7f64cc138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.943+0000 7f64d4503700 1 --2- 172.21.15.72:0/892147442 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64cc09e1d0 0x7f64cc135910 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.943+0000 7f64d4503700 1 -- 172.21.15.72:0/892147442 >> 172.21.15.72:0/892147442 conn(0x7f64cc066f50 msgr2=0x7f64cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.943+0000 7f64d4503700 1 -- 172.21.15.72:0/892147442 shutdown_connections 2023-10-03T10:19:10.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.943+0000 7f64d4503700 1 -- 172.21.15.72:0/892147442 wait complete. 2023-10-03T10:19:10.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.944+0000 7f64d4503700 1 Processor -- start 2023-10-03T10:19:10.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.944+0000 7f64d4503700 1 -- start start 2023-10-03T10:19:10.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.944+0000 7f64d4503700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64cc09d6f0 0x7f64cc11b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.944+0000 7f64d4503700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64cc09e1d0 0x7f64cc11b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.944+0000 7f64d4503700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64cc135e50 0x7f64cc11bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.944+0000 7f64d4503700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc11cdf0 con 0x7f64cc135e50 2023-10-03T10:19:10.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.944+0000 7f64d4503700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc11e040 con 0x7f64cc09d6f0 2023-10-03T10:19:10.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.944+0000 7f64d4503700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc11ea20 con 0x7f64cc09e1d0 2023-10-03T10:19:10.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64d229f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64cc09d6f0 0x7f64cc11b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64d1a9e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64cc09e1d0 0x7f64cc11b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64d229f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64cc09d6f0 0x7f64cc11b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41916/0 (socket says 172.21.15.72:41916) 2023-10-03T10:19:10.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64d229f700 1 -- 172.21.15.72:0/3821254326 learned_addr learned my addr 172.21.15.72:0/3821254326 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:10.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64d229f700 1 -- 172.21.15.72:0/3821254326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64cc09e1d0 msgr2=0x7f64cc11b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64d229f700 1 --2- 172.21.15.72:0/3821254326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64cc09e1d0 0x7f64cc11b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64d229f700 1 -- 172.21.15.72:0/3821254326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64cc135e50 msgr2=0x7f64cc11bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64d229f700 1 --2- 172.21.15.72:0/3821254326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64cc135e50 0x7f64cc11bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64d229f700 1 -- 172.21.15.72:0/3821254326 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c4009a70 con 0x7f64cc09d6f0 2023-10-03T10:19:10.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64d1a9e700 1 --2- 172.21.15.72:0/3821254326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64cc09e1d0 0x7f64cc11b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:10.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64d229f700 1 --2- 172.21.15.72:0/3821254326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64cc09d6f0 0x7f64cc11b1e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f64c800c700 tx=0x7f64c800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:10.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64c2ffd700 1 -- 172.21.15.72:0/3821254326 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8005d70 con 0x7f64cc09d6f0 2023-10-03T10:19:10.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64d4503700 1 -- 172.21.15.72:0/3821254326 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64bc0094a0 con 0x7f64cc09d6f0 2023-10-03T10:19:10.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64d4503700 1 -- 172.21.15.72:0/3821254326 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64cc11e4f0 con 0x7f64cc09d6f0 2023-10-03T10:19:10.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64c2ffd700 1 -- 172.21.15.72:0/3821254326 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c80070d0 con 0x7f64cc09d6f0 2023-10-03T10:19:10.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.945+0000 7f64c2ffd700 1 -- 172.21.15.72:0/3821254326 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c80012d0 con 0x7f64cc09d6f0 2023-10-03T10:19:10.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.946+0000 7f64c2ffd700 1 -- 172.21.15.72:0/3821254326 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f64c8007440 con 0x7f64cc09d6f0 2023-10-03T10:19:10.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.946+0000 7f64c2ffd700 1 -- 172.21.15.72:0/3821254326 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f64c803e8f0 con 0x7f64cc09d6f0 2023-10-03T10:19:10.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.947+0000 7f64d4503700 1 -- 172.21.15.72:0/3821254326 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b40052e0 con 0x7f64cc09d6f0 2023-10-03T10:19:10.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:10.955+0000 7f64c2ffd700 1 -- 172.21.15.72:0/3821254326 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f64c8017080 con 0x7f64cc09d6f0 2023-10-03T10:19:10.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:11.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.002+0000 7f3827dcd700 1 Processor -- start 2023-10-03T10:19:11.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.003+0000 7f3827dcd700 1 -- start start 2023-10-03T10:19:11.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.003+0000 7f3827dcd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38200a0a30 0x7f38200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.003+0000 7f3827dcd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3820138d80 0x7f382013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.003+0000 7f3827dcd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38200a2a70 con 0x7f382009d630 2023-10-03T10:19:11.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.003+0000 7f3827dcd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38200a01d0 con 0x7f38200a0a30 2023-10-03T10:19:11.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.003+0000 7f3827dcd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382009e2b0 con 0x7f3820138d80 2023-10-03T10:19:11.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.003+0000 7f382636a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3820138d80 0x7f382013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.003+0000 7f382636a700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3820138d80 0x7f382013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45870/0 (socket says 172.21.15.72:45870) 2023-10-03T10:19:11.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.003+0000 7f382636a700 1 -- 172.21.15.72:0/4204164788 learned_addr learned my addr 172.21.15.72:0/4204164788 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:11.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.003+0000 7f3825b69700 1 --2- 172.21.15.72:0/4204164788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38200a0a30 0x7f38200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.004+0000 7f382636a700 1 -- 172.21.15.72:0/4204164788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38200a0a30 msgr2=0x7f38200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.004+0000 7f382636a700 1 --2- 172.21.15.72:0/4204164788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38200a0a30 0x7f38200a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.004+0000 7f382636a700 1 -- 172.21.15.72:0/4204164788 >> v1:172.21.15.72:6789/0 conn(0x7f382009d630 legacy=0x7f38200a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.004+0000 7f382636a700 1 -- 172.21.15.72:0/4204164788 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382009dc50 con 0x7f3820138d80 2023-10-03T10:19:11.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.004+0000 7f382636a700 1 --2- 172.21.15.72:0/4204164788 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3820138d80 0x7f382013b160 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3818009e80 tx=0x7f381800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80e69e9ac5d537ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.004+0000 7f3824b67700 1 -- 172.21.15.72:0/4204164788 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800e070 con 0x7f3820138d80 2023-10-03T10:19:11.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.004+0000 7f3824b67700 1 -- 172.21.15.72:0/4204164788 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381800b910 con 0x7f3820138d80 2023-10-03T10:19:11.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.004+0000 7f3824b67700 1 -- 172.21.15.72:0/4204164788 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800bcc0 con 0x7f3820138d80 2023-10-03T10:19:11.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.005+0000 7f3827dcd700 1 -- 172.21.15.72:0/4204164788 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3820138d80 msgr2=0x7f382013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.005+0000 7f3827dcd700 1 --2- 172.21.15.72:0/4204164788 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3820138d80 0x7f382013b160 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3818009e80 tx=0x7f381800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:11.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.005+0000 7f3827dcd700 1 -- 172.21.15.72:0/4204164788 shutdown_connections 2023-10-03T10:19:11.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.005+0000 7f3827dcd700 1 --2- 172.21.15.72:0/4204164788 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3820138d80 0x7f382013b160 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.005+0000 7f3827dcd700 1 --2- 172.21.15.72:0/4204164788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38200a0a30 0x7f38200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.005+0000 7f3827dcd700 1 -- 172.21.15.72:0/4204164788 >> 172.21.15.72:0/4204164788 conn(0x7f38200a3050 msgr2=0x7f38200a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.005+0000 7f3827dcd700 1 -- 172.21.15.72:0/4204164788 shutdown_connections 2023-10-03T10:19:11.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.005+0000 7f3827dcd700 1 -- 172.21.15.72:0/4204164788 wait complete. 2023-10-03T10:19:11.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.006+0000 7f3827dcd700 1 Processor -- start 2023-10-03T10:19:11.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.006+0000 7f3827dcd700 1 -- start start 2023-10-03T10:19:11.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3827dcd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009d630 0x7f38201337f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3827dcd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38200a0a30 0x7f3820133d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3827dcd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3820138d80 0x7f3820134270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3827dcd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38200a0410 con 0x7f3820138d80 2023-10-03T10:19:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3827dcd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3820136550 con 0x7f382009d630 2023-10-03T10:19:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3827dcd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3820136c90 con 0x7f38200a0a30 2023-10-03T10:19:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3825b69700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009d630 0x7f38201337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3825368700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38200a0a30 0x7f3820133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3825b69700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009d630 0x7f38201337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41932/0 (socket says 172.21.15.72:41932) 2023-10-03T10:19:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3825368700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38200a0a30 0x7f3820133d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45884/0 (socket says 172.21.15.72:45884) 2023-10-03T10:19:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3825b69700 1 -- 172.21.15.72:0/1282496855 learned_addr learned my addr 172.21.15.72:0/1282496855 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f382636a700 1 --2- 172.21.15.72:0/1282496855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3820138d80 0x7f3820134270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3825368700 1 -- 172.21.15.72:0/1282496855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009d630 msgr2=0x7f38201337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3825368700 1 --2- 172.21.15.72:0/1282496855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009d630 0x7f38201337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3825368700 1 -- 172.21.15.72:0/1282496855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3820138d80 msgr2=0x7f3820134270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3825368700 1 --2- 172.21.15.72:0/1282496855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3820138d80 0x7f3820134270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3825368700 1 -- 172.21.15.72:0/1282496855 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3818009b30 con 0x7f38200a0a30 2023-10-03T10:19:11.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.007+0000 7f3825368700 1 --2- 172.21.15.72:0/1282496855 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38200a0a30 0x7f3820133d30 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3810000f60 tx=0x7f381000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.008+0000 7f38167fc700 1 -- 172.21.15.72:0/1282496855 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38100050d0 con 0x7f38200a0a30 2023-10-03T10:19:11.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.008+0000 7f38167fc700 1 -- 172.21.15.72:0/1282496855 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3810005230 con 0x7f38200a0a30 2023-10-03T10:19:11.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.008+0000 7f3827dcd700 1 -- 172.21.15.72:0/1282496855 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38201372c0 con 0x7f38200a0a30 2023-10-03T10:19:11.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.008+0000 7f38167fc700 1 -- 172.21.15.72:0/1282496855 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810003680 con 0x7f38200a0a30 2023-10-03T10:19:11.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.008+0000 7f3827dcd700 1 -- 172.21.15.72:0/1282496855 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38201360e0 con 0x7f38200a0a30 2023-10-03T10:19:11.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.008+0000 7f3827dcd700 1 -- 172.21.15.72:0/1282496855 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38200747f0 con 0x7f38200a0a30 2023-10-03T10:19:11.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.009+0000 7f38167fc700 1 -- 172.21.15.72:0/1282496855 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38100037e0 con 0x7f38200a0a30 2023-10-03T10:19:11.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.009+0000 7f38167fc700 1 -- 172.21.15.72:0/1282496855 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f381003ee10 con 0x7f38200a0a30 2023-10-03T10:19:11.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.013+0000 7f38167fc700 1 -- 172.21.15.72:0/1282496855 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3810011590 con 0x7f38200a0a30 2023-10-03T10:19:11.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.042+0000 7f4e57ea5700 1 Processor -- start 2023-10-03T10:19:11.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.042+0000 7f4e57ea5700 1 -- start start 2023-10-03T10:19:11.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.043+0000 7f4e57ea5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5009e1d0 0x7f4e50135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.043+0000 7f4e57ea5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4e50135e50 0x7f4e50138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.043+0000 7f4e57ea5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5009f130 con 0x7f4e5009d6f0 2023-10-03T10:19:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.043+0000 7f4e57ea5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5009f520 con 0x7f4e50135e50 2023-10-03T10:19:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.043+0000 7f4e57ea5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5009e930 con 0x7f4e5009e1d0 2023-10-03T10:19:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.043+0000 7f4e55440700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5009e1d0 0x7f4e50135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.043+0000 7f4e55440700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5009e1d0 0x7f4e50135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45892/0 (socket says 172.21.15.72:45892) 2023-10-03T10:19:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.043+0000 7f4e55440700 1 -- 172.21.15.72:0/3813824217 learned_addr learned my addr 172.21.15.72:0/3813824217 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.043+0000 7f4e56442700 1 --2- 172.21.15.72:0/3813824217 >> v2:172.21.15.72:3300/0 conn(0x7f4e50135e50 0x7f4e50138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.043+0000 7f4e55440700 1 -- 172.21.15.72:0/3813824217 >> v2:172.21.15.72:3300/0 conn(0x7f4e50135e50 msgr2=0x7f4e50138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.043+0000 7f4e55440700 1 --2- 172.21.15.72:0/3813824217 >> v2:172.21.15.72:3300/0 conn(0x7f4e50135e50 0x7f4e50138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.043+0000 7f4e55440700 1 -- 172.21.15.72:0/3813824217 >> v1:172.21.15.72:6789/0 conn(0x7f4e5009d6f0 legacy=0x7f4e5009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.043+0000 7f4e55440700 1 -- 172.21.15.72:0/3813824217 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5009b2d0 con 0x7f4e5009e1d0 2023-10-03T10:19:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.044+0000 7f4e55440700 1 --2- 172.21.15.72:0/3813824217 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5009e1d0 0x7f4e50135910 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000bbc0 tx=0x7f4e4000bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de0b5faa01411964 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.044+0000 7f4e54c3f700 1 -- 172.21.15.72:0/3813824217 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4000dcf0 con 0x7f4e5009e1d0 2023-10-03T10:19:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.044+0000 7f4e54c3f700 1 -- 172.21.15.72:0/3813824217 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4000de50 con 0x7f4e5009e1d0 2023-10-03T10:19:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.044+0000 7f4e54c3f700 1 -- 172.21.15.72:0/3813824217 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40010690 con 0x7f4e5009e1d0 2023-10-03T10:19:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.044+0000 7f4e57ea5700 1 -- 172.21.15.72:0/3813824217 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5009e1d0 msgr2=0x7f4e50135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.044+0000 7f4e57ea5700 1 --2- 172.21.15.72:0/3813824217 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5009e1d0 0x7f4e50135910 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4e4000bbc0 tx=0x7f4e4000bed0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.044+0000 7f4e57ea5700 1 -- 172.21.15.72:0/3813824217 shutdown_connections 2023-10-03T10:19:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.044+0000 7f4e57ea5700 1 --2- 172.21.15.72:0/3813824217 >> v2:172.21.15.72:3300/0 conn(0x7f4e50135e50 0x7f4e50138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.044+0000 7f4e57ea5700 1 --2- 172.21.15.72:0/3813824217 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e5009e1d0 0x7f4e50135910 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.044+0000 7f4e57ea5700 1 -- 172.21.15.72:0/3813824217 >> 172.21.15.72:0/3813824217 conn(0x7f4e50066f50 msgr2=0x7f4e5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.045+0000 7f4e57ea5700 1 -- 172.21.15.72:0/3813824217 shutdown_connections 2023-10-03T10:19:11.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.045+0000 7f4e57ea5700 1 -- 172.21.15.72:0/3813824217 wait complete. 2023-10-03T10:19:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.046+0000 7f4e57ea5700 1 Processor -- start 2023-10-03T10:19:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.046+0000 7f4e57ea5700 1 -- start start 2023-10-03T10:19:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.046+0000 7f4e57ea5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5009d6f0 0x7f4e5011a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.046+0000 7f4e57ea5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e5009e1d0 0x7f4e5011a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.046+0000 7f4e57ea5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e50135e50 0x7f4e501c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.046+0000 7f4e57ea5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5009c700 con 0x7f4e5009e1d0 2023-10-03T10:19:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.046+0000 7f4e57ea5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5011ce30 con 0x7f4e5009d6f0 2023-10-03T10:19:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.046+0000 7f4e57ea5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e50119c00 con 0x7f4e50135e50 2023-10-03T10:19:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.046+0000 7f4e55440700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e5009e1d0 0x7f4e5011a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.046+0000 7f4e55440700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e5009e1d0 0x7f4e5011a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36012/0 (socket says 172.21.15.72:36012) 2023-10-03T10:19:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.046+0000 7f4e55440700 1 -- 172.21.15.72:0/2607563666 learned_addr learned my addr 172.21.15.72:0/2607563666 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.046+0000 7f4e56442700 1 --2- 172.21.15.72:0/2607563666 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e50135e50 0x7f4e501c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.046+0000 7f4e55c41700 1 --2- 172.21.15.72:0/2607563666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5009d6f0 0x7f4e5011a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.047+0000 7f4e55440700 1 -- 172.21.15.72:0/2607563666 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e50135e50 msgr2=0x7f4e501c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.047+0000 7f4e55440700 1 --2- 172.21.15.72:0/2607563666 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e50135e50 0x7f4e501c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.047+0000 7f4e55440700 1 -- 172.21.15.72:0/2607563666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5009d6f0 msgr2=0x7f4e5011a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.047+0000 7f4e55440700 1 --2- 172.21.15.72:0/2607563666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5009d6f0 0x7f4e5011a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.047+0000 7f4e55440700 1 -- 172.21.15.72:0/2607563666 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4000b7f0 con 0x7f4e5009e1d0 2023-10-03T10:19:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.047+0000 7f4e56442700 1 --2- 172.21.15.72:0/2607563666 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e50135e50 0x7f4e501c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.047+0000 7f4e55440700 1 --2- 172.21.15.72:0/2607563666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e5009e1d0 0x7f4e5011a6c0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f4e5009ea70 tx=0x7f4e40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.047+0000 7f4e467fc700 1 -- 172.21.15.72:0/2607563666 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4001f070 con 0x7f4e5009e1d0 2023-10-03T10:19:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.047+0000 7f4e467fc700 1 -- 172.21.15.72:0/2607563666 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e40003970 con 0x7f4e5009e1d0 2023-10-03T10:19:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.047+0000 7f4e57ea5700 1 -- 172.21.15.72:0/2607563666 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e500a1e20 con 0x7f4e5009e1d0 2023-10-03T10:19:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.047+0000 7f4e467fc700 1 -- 172.21.15.72:0/2607563666 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40003d00 con 0x7f4e5009e1d0 2023-10-03T10:19:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.047+0000 7f4e57ea5700 1 -- 172.21.15.72:0/2607563666 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5011b220 con 0x7f4e5009e1d0 2023-10-03T10:19:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.048+0000 7f4e467fc700 1 -- 172.21.15.72:0/2607563666 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e40019400 con 0x7f4e5009e1d0 2023-10-03T10:19:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.048+0000 7f4e467fc700 1 -- 172.21.15.72:0/2607563666 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4e40043040 con 0x7f4e5009e1d0 2023-10-03T10:19:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.048+0000 7f4e57ea5700 1 -- 172.21.15.72:0/2607563666 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5011cf70 con 0x7f4e5009e1d0 2023-10-03T10:19:11.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.053+0000 7f4e467fc700 1 -- 172.21.15.72:0/2607563666 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e5011cf70 con 0x7f4e5009e1d0 2023-10-03T10:19:11.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.164+0000 7f64d4503700 1 -- 172.21.15.72:0/3821254326 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f64b4005590 con 0x7f64cc09d6f0 2023-10-03T10:19:11.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.165+0000 7f64c2ffd700 1 -- 172.21.15.72:0/3821254326 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f64c8011720 con 0x7f64cc09d6f0 2023-10-03T10:19:11.164 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:11.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.167+0000 7f64d4503700 1 -- 172.21.15.72:0/3821254326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64cc09d6f0 msgr2=0x7f64cc11b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.167+0000 7f64d4503700 1 --2- 172.21.15.72:0/3821254326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64cc09d6f0 0x7f64cc11b1e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f64c800c700 tx=0x7f64c800ca10 comp rx=0 tx=0).stop 2023-10-03T10:19:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.168+0000 7f64d4503700 1 -- 172.21.15.72:0/3821254326 shutdown_connections 2023-10-03T10:19:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.168+0000 7f64d4503700 1 --2- 172.21.15.72:0/3821254326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64cc135e50 0x7f64cc11bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.168+0000 7f64d4503700 1 --2- 172.21.15.72:0/3821254326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f64cc09d6f0 0x7f64cc11b1e0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.168+0000 7f64d4503700 1 --2- 172.21.15.72:0/3821254326 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f64cc09e1d0 0x7f64cc11b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.168+0000 7f64d4503700 1 -- 172.21.15.72:0/3821254326 >> 172.21.15.72:0/3821254326 conn(0x7f64cc066f50 msgr2=0x7f64cc132680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.168+0000 7f64d4503700 1 -- 172.21.15.72:0/3821254326 shutdown_connections 2023-10-03T10:19:11.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.168+0000 7f64d4503700 1 -- 172.21.15.72:0/3821254326 wait complete. 2023-10-03T10:19:11.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:11.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.228+0000 7f3827dcd700 1 -- 172.21.15.72:0/1282496855 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3820137eb0 con 0x7f38200a0a30 2023-10-03T10:19:11.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.228+0000 7f38167fc700 1 -- 172.21.15.72:0/1282496855 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f3810017030 con 0x7f38200a0a30 2023-10-03T10:19:11.228 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:11.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.230+0000 7f3827dcd700 1 -- 172.21.15.72:0/1282496855 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38200a0a30 msgr2=0x7f3820133d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.230+0000 7f3827dcd700 1 --2- 172.21.15.72:0/1282496855 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38200a0a30 0x7f3820133d30 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3810000f60 tx=0x7f381000c730 comp rx=0 tx=0).stop 2023-10-03T10:19:11.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.230+0000 7f3827dcd700 1 -- 172.21.15.72:0/1282496855 shutdown_connections 2023-10-03T10:19:11.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.230+0000 7f3827dcd700 1 --2- 172.21.15.72:0/1282496855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3820138d80 0x7f3820134270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.230+0000 7f3827dcd700 1 --2- 172.21.15.72:0/1282496855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f382009d630 0x7f38201337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.230+0000 7f3827dcd700 1 --2- 172.21.15.72:0/1282496855 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f38200a0a30 0x7f3820133d30 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.230+0000 7f3827dcd700 1 -- 172.21.15.72:0/1282496855 >> 172.21.15.72:0/1282496855 conn(0x7f38200a3050 msgr2=0x7f382009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.230+0000 7f3827dcd700 1 -- 172.21.15.72:0/1282496855 shutdown_connections 2023-10-03T10:19:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.230+0000 7f3827dcd700 1 -- 172.21.15.72:0/1282496855 wait complete. 2023-10-03T10:19:11.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:11.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.250+0000 7f4e57ea5700 1 -- 172.21.15.72:0/2607563666 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e5011cf70 con 0x7f4e5009e1d0 2023-10-03T10:19:11.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.250+0000 7f4e467fc700 1 -- 172.21.15.72:0/2607563666 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e5011cf70 con 0x7f4e5009e1d0 2023-10-03T10:19:11.250 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:11.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.252+0000 7f4e57ea5700 1 -- 172.21.15.72:0/2607563666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e5009e1d0 msgr2=0x7f4e5011a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.252+0000 7f4e57ea5700 1 --2- 172.21.15.72:0/2607563666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e5009e1d0 0x7f4e5011a6c0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f4e5009ea70 tx=0x7f4e40004750 comp rx=0 tx=0).stop 2023-10-03T10:19:11.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.252+0000 7f4e57ea5700 1 -- 172.21.15.72:0/2607563666 shutdown_connections 2023-10-03T10:19:11.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.252+0000 7f4e57ea5700 1 --2- 172.21.15.72:0/2607563666 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4e50135e50 0x7f4e501c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.252+0000 7f4e57ea5700 1 --2- 172.21.15.72:0/2607563666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e5009d6f0 0x7f4e5011a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.252+0000 7f4e57ea5700 1 --2- 172.21.15.72:0/2607563666 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e5009e1d0 0x7f4e5011a6c0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.252+0000 7f4e57ea5700 1 -- 172.21.15.72:0/2607563666 >> 172.21.15.72:0/2607563666 conn(0x7f4e50066f50 msgr2=0x7f4e5006f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.253+0000 7f4e57ea5700 1 -- 172.21.15.72:0/2607563666 shutdown_connections 2023-10-03T10:19:11.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:11.253+0000 7f4e57ea5700 1 -- 172.21.15.72:0/2607563666 wait complete. 2023-10-03T10:19:11.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:11.956 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:12.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.082+0000 7ff63a507700 1 Processor -- start 2023-10-03T10:19:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.082+0000 7ff63a507700 1 -- start start 2023-10-03T10:19:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.082+0000 7ff63a507700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff63409d6f0 0x7ff63409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.082+0000 7ff63a507700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff63409e000 0x7ff634130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.082+0000 7ff63a507700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff63409e410 0x7ff634130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.082+0000 7ff63a507700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff63409f520 con 0x7ff63409e000 2023-10-03T10:19:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.082+0000 7ff63a507700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63409f130 con 0x7ff63409e410 2023-10-03T10:19:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.082+0000 7ff63a507700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff63409e930 con 0x7ff63409d6f0 2023-10-03T10:19:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff633fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff63409d6f0 0x7ff63409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff6337fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff63409e000 0x7ff634130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff633fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff63409d6f0 0x7ff63409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45906/0 (socket says 172.21.15.72:45906) 2023-10-03T10:19:12.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff6337fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff63409e000 0x7ff634130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36020/0 (socket says 172.21.15.72:36020) 2023-10-03T10:19:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff633fff700 1 -- 172.21.15.72:0/405774857 learned_addr learned my addr 172.21.15.72:0/405774857 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff638aa4700 1 --2- 172.21.15.72:0/405774857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff63409e410 0x7ff634130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff633fff700 1 -- 172.21.15.72:0/405774857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff63409e410 msgr2=0x7ff634130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff633fff700 1 --2- 172.21.15.72:0/405774857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff63409e410 0x7ff634130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff633fff700 1 -- 172.21.15.72:0/405774857 >> v2:172.21.15.72:3300/0 conn(0x7ff63409e000 msgr2=0x7ff634130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff633fff700 1 --2- 172.21.15.72:0/405774857 >> v2:172.21.15.72:3300/0 conn(0x7ff63409e000 0x7ff634130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff633fff700 1 -- 172.21.15.72:0/405774857 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63409b2d0 con 0x7ff63409d6f0 2023-10-03T10:19:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff6337fe700 1 --2- 172.21.15.72:0/405774857 >> v2:172.21.15.72:3300/0 conn(0x7ff63409e000 0x7ff634130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff633fff700 1 --2- 172.21.15.72:0/405774857 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff63409d6f0 0x7ff63409dac0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff62400bbc0 tx=0x7ff62400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e9ba7605fa61aa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff632ffd700 1 -- 172.21.15.72:0/405774857 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62400dcf0 con 0x7ff63409d6f0 2023-10-03T10:19:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff632ffd700 1 -- 172.21.15.72:0/405774857 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62400de50 con 0x7ff63409d6f0 2023-10-03T10:19:12.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.083+0000 7ff632ffd700 1 -- 172.21.15.72:0/405774857 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff624010690 con 0x7ff63409d6f0 2023-10-03T10:19:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.084+0000 7ff63a507700 1 -- 172.21.15.72:0/405774857 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff63409d6f0 msgr2=0x7ff63409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.084+0000 7ff63a507700 1 --2- 172.21.15.72:0/405774857 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff63409d6f0 0x7ff63409dac0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff62400bbc0 tx=0x7ff62400bed0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.084+0000 7ff63a507700 1 -- 172.21.15.72:0/405774857 shutdown_connections 2023-10-03T10:19:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.084+0000 7ff63a507700 1 --2- 172.21.15.72:0/405774857 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff63409e410 0x7ff634130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.084+0000 7ff63a507700 1 --2- 172.21.15.72:0/405774857 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff63409d6f0 0x7ff63409dac0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.084+0000 7ff63a507700 1 --2- 172.21.15.72:0/405774857 >> v2:172.21.15.72:3300/0 conn(0x7ff63409e000 0x7ff634130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.084+0000 7ff63a507700 1 -- 172.21.15.72:0/405774857 >> 172.21.15.72:0/405774857 conn(0x7ff634066f50 msgr2=0x7ff63409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.084+0000 7ff63a507700 1 -- 172.21.15.72:0/405774857 shutdown_connections 2023-10-03T10:19:12.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.084+0000 7ff63a507700 1 -- 172.21.15.72:0/405774857 wait complete. 2023-10-03T10:19:12.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.085+0000 7ff63a507700 1 Processor -- start 2023-10-03T10:19:12.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.085+0000 7ff63a507700 1 -- start start 2023-10-03T10:19:12.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.085+0000 7ff63a507700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff63409d6f0 0x7ff6341c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.085+0000 7ff63a507700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff63409e000 0x7ff6341c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.085+0000 7ff63a507700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63409e410 0x7ff6341c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.085+0000 7ff63a507700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff634126190 con 0x7ff63409e410 2023-10-03T10:19:12.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.085+0000 7ff63a507700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff634124480 con 0x7ff63409d6f0 2023-10-03T10:19:12.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.085+0000 7ff63a507700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6340a1a00 con 0x7ff63409e000 2023-10-03T10:19:12.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.085+0000 7ff633fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff63409d6f0 0x7ff6341c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.085+0000 7ff638aa4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63409e410 0x7ff6341c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.085+0000 7ff6337fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff63409e000 0x7ff6341c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.085+0000 7ff633fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff63409d6f0 0x7ff6341c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41954/0 (socket says 172.21.15.72:41954) 2023-10-03T10:19:12.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.085+0000 7ff633fff700 1 -- 172.21.15.72:0/4259864584 learned_addr learned my addr 172.21.15.72:0/4259864584 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:12.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.086+0000 7ff633fff700 1 -- 172.21.15.72:0/4259864584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff63409e000 msgr2=0x7ff6341c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.086+0000 7ff633fff700 1 --2- 172.21.15.72:0/4259864584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff63409e000 0x7ff6341c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.086+0000 7ff633fff700 1 -- 172.21.15.72:0/4259864584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63409e410 msgr2=0x7ff6341c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.086+0000 7ff633fff700 1 --2- 172.21.15.72:0/4259864584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63409e410 0x7ff6341c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.086+0000 7ff633fff700 1 -- 172.21.15.72:0/4259864584 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c0094a0 con 0x7ff63409d6f0 2023-10-03T10:19:12.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.086+0000 7ff6337fe700 1 --2- 172.21.15.72:0/4259864584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff63409e000 0x7ff6341c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:12.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.086+0000 7ff638aa4700 1 --2- 172.21.15.72:0/4259864584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63409e410 0x7ff6341c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:12.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.086+0000 7ff633fff700 1 --2- 172.21.15.72:0/4259864584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff63409d6f0 0x7ff6341c8540 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff62400d5d0 tx=0x7ff624004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.086+0000 7ff630ff9700 1 -- 172.21.15.72:0/4259864584 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff624003b70 con 0x7ff63409d6f0 2023-10-03T10:19:12.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.086+0000 7ff630ff9700 1 -- 172.21.15.72:0/4259864584 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff624003cd0 con 0x7ff63409d6f0 2023-10-03T10:19:12.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.086+0000 7ff63a507700 1 -- 172.21.15.72:0/4259864584 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62400b7f0 con 0x7ff63409d6f0 2023-10-03T10:19:12.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.086+0000 7ff630ff9700 1 -- 172.21.15.72:0/4259864584 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff624010690 con 0x7ff63409d6f0 2023-10-03T10:19:12.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.086+0000 7ff63a507700 1 -- 172.21.15.72:0/4259864584 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff634126b20 con 0x7ff63409d6f0 2023-10-03T10:19:12.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.087+0000 7ff630ff9700 1 -- 172.21.15.72:0/4259864584 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff624019400 con 0x7ff63409d6f0 2023-10-03T10:19:12.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.087+0000 7ff630ff9700 1 -- 172.21.15.72:0/4259864584 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff6240407a0 con 0x7ff63409d6f0 2023-10-03T10:19:12.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.087+0000 7ff63a507700 1 -- 172.21.15.72:0/4259864584 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6340a29f0 con 0x7ff63409d6f0 2023-10-03T10:19:12.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.091+0000 7ff630ff9700 1 -- 172.21.15.72:0/4259864584 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff62400f3d0 con 0x7ff63409d6f0 2023-10-03T10:19:12.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:12.242 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:12.265 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:12.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.284+0000 7ff63a507700 1 -- 172.21.15.72:0/4259864584 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff634074ea0 con 0x7ff63409d6f0 2023-10-03T10:19:12.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.285+0000 7ff630ff9700 1 -- 172.21.15.72:0/4259864584 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff624018360 con 0x7ff63409d6f0 2023-10-03T10:19:12.284 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.287+0000 7ff63a507700 1 -- 172.21.15.72:0/4259864584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff63409d6f0 msgr2=0x7ff6341c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.287+0000 7ff63a507700 1 --2- 172.21.15.72:0/4259864584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff63409d6f0 0x7ff6341c8540 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff62400d5d0 tx=0x7ff624004750 comp rx=0 tx=0).stop 2023-10-03T10:19:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.287+0000 7ff63a507700 1 -- 172.21.15.72:0/4259864584 shutdown_connections 2023-10-03T10:19:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.287+0000 7ff63a507700 1 --2- 172.21.15.72:0/4259864584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff63409e410 0x7ff6341c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.287+0000 7ff63a507700 1 --2- 172.21.15.72:0/4259864584 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff63409d6f0 0x7ff6341c8540 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.287+0000 7ff63a507700 1 --2- 172.21.15.72:0/4259864584 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff63409e000 0x7ff6341c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.287+0000 7ff63a507700 1 -- 172.21.15.72:0/4259864584 >> 172.21.15.72:0/4259864584 conn(0x7ff634066f50 msgr2=0x7ff63406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.287+0000 7ff63a507700 1 -- 172.21.15.72:0/4259864584 shutdown_connections 2023-10-03T10:19:12.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.287+0000 7ff63a507700 1 -- 172.21.15.72:0/4259864584 wait complete. 2023-10-03T10:19:12.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:12.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.314+0000 7fd17cc04700 1 Processor -- start 2023-10-03T10:19:12.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.314+0000 7fd17cc04700 1 -- start start 2023-10-03T10:19:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.315+0000 7fd17cc04700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd178131630 0x7fd178131a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.315+0000 7fd17cc04700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd178131f40 0x7fd17806e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.315+0000 7fd17cc04700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd17806e9d0 0x7fd17806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.315+0000 7fd17cc04700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd178071a00 con 0x7fd17806e9d0 2023-10-03T10:19:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.315+0000 7fd17cc04700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd178131430 con 0x7fd178131630 2023-10-03T10:19:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.315+0000 7fd17cc04700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd17809a510 con 0x7fd178131f40 2023-10-03T10:19:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.315+0000 7fd17659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd178131630 0x7fd178131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.315+0000 7fd176d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd17806e9d0 0x7fd17806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.315+0000 7fd175d9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd178131f40 0x7fd17806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.315+0000 7fd17659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd178131630 0x7fd178131a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41964/0 (socket says 172.21.15.72:41964) 2023-10-03T10:19:12.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.315+0000 7fd17659c700 1 -- 172.21.15.72:0/315648784 learned_addr learned my addr 172.21.15.72:0/315648784 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:12.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.316+0000 7fd176d9d700 1 -- 172.21.15.72:0/315648784 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd178131f40 msgr2=0x7fd17806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.316+0000 7fd176d9d700 1 --2- 172.21.15.72:0/315648784 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd178131f40 0x7fd17806e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.316+0000 7fd176d9d700 1 -- 172.21.15.72:0/315648784 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd178131630 msgr2=0x7fd178131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.316+0000 7fd176d9d700 1 --2- 172.21.15.72:0/315648784 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd178131630 0x7fd178131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.316+0000 7fd176d9d700 1 -- 172.21.15.72:0/315648784 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1780721c0 con 0x7fd17806e9d0 2023-10-03T10:19:12.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.316+0000 7fd17659c700 1 --2- 172.21.15.72:0/315648784 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd178131630 0x7fd178131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:12.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.316+0000 7fd175d9b700 1 --2- 172.21.15.72:0/315648784 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd178131f40 0x7fd17806e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:12.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.316+0000 7fd176d9d700 1 --2- 172.21.15.72:0/315648784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd17806e9d0 0x7fd17806ee70 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fd170009d90 tx=0x7fd17000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5f2256b615429d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.316+0000 7fd17559a700 1 -- 172.21.15.72:0/315648784 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17000e070 con 0x7fd17806e9d0 2023-10-03T10:19:12.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.316+0000 7fd17559a700 1 -- 172.21.15.72:0/315648784 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17000bb20 con 0x7fd17806e9d0 2023-10-03T10:19:12.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.316+0000 7fd17559a700 1 -- 172.21.15.72:0/315648784 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170012430 con 0x7fd17806e9d0 2023-10-03T10:19:12.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.317+0000 7fd17cc04700 1 -- 172.21.15.72:0/315648784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd17806e9d0 msgr2=0x7fd17806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.317+0000 7fd17cc04700 1 --2- 172.21.15.72:0/315648784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd17806e9d0 0x7fd17806ee70 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fd170009d90 tx=0x7fd17000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:12.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.317+0000 7fd17cc04700 1 -- 172.21.15.72:0/315648784 shutdown_connections 2023-10-03T10:19:12.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.317+0000 7fd17cc04700 1 --2- 172.21.15.72:0/315648784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd17806e9d0 0x7fd17806ee70 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.317+0000 7fd17cc04700 1 --2- 172.21.15.72:0/315648784 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd178131630 0x7fd178131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.317+0000 7fd17cc04700 1 --2- 172.21.15.72:0/315648784 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd178131f40 0x7fd17806e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.317+0000 7fd17cc04700 1 -- 172.21.15.72:0/315648784 >> 172.21.15.72:0/315648784 conn(0x7fd1780a2aa0 msgr2=0x7fd1780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.317+0000 7fd17cc04700 1 -- 172.21.15.72:0/315648784 shutdown_connections 2023-10-03T10:19:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.317+0000 7fd17cc04700 1 -- 172.21.15.72:0/315648784 wait complete. 2023-10-03T10:19:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.319+0000 7fd17cc04700 1 Processor -- start 2023-10-03T10:19:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.319+0000 7fd17cc04700 1 -- start start 2023-10-03T10:19:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.319+0000 7fd17cc04700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd17806e9d0 0x7fd17811b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.319+0000 7fd17cc04700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd178131630 0x7fd17811bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.319+0000 7fd17cc04700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd178131f40 0x7fd17811c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.319+0000 7fd17cc04700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17811fa20 con 0x7fd178131f40 2023-10-03T10:19:12.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.319+0000 7fd17cc04700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17811d150 con 0x7fd17806e9d0 2023-10-03T10:19:12.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.319+0000 7fd17cc04700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd17811e3a0 con 0x7fd178131630 2023-10-03T10:19:12.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.319+0000 7fd17659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd17806e9d0 0x7fd17811b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.319+0000 7fd17659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd17806e9d0 0x7fd17811b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41966/0 (socket says 172.21.15.72:41966) 2023-10-03T10:19:12.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.319+0000 7fd17659c700 1 -- 172.21.15.72:0/2105294903 learned_addr learned my addr 172.21.15.72:0/2105294903 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:12.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.319+0000 7fd175d9b700 1 --2- 172.21.15.72:0/2105294903 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd178131630 0x7fd17811bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.319+0000 7fd176d9d700 1 --2- 172.21.15.72:0/2105294903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd178131f40 0x7fd17811c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.320+0000 7fd17659c700 1 -- 172.21.15.72:0/2105294903 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd178131630 msgr2=0x7fd17811bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.320+0000 7fd17659c700 1 --2- 172.21.15.72:0/2105294903 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd178131630 0x7fd17811bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.320+0000 7fd17659c700 1 -- 172.21.15.72:0/2105294903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd178131f40 msgr2=0x7fd17811c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.320+0000 7fd17659c700 1 --2- 172.21.15.72:0/2105294903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd178131f40 0x7fd17811c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.320+0000 7fd17659c700 1 -- 172.21.15.72:0/2105294903 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd168009550 con 0x7fd17806e9d0 2023-10-03T10:19:12.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.320+0000 7fd176d9d700 1 --2- 172.21.15.72:0/2105294903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd178131f40 0x7fd17811c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:12.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.320+0000 7fd175d9b700 1 --2- 172.21.15.72:0/2105294903 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd178131630 0x7fd17811bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:12.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.320+0000 7fd17659c700 1 --2- 172.21.15.72:0/2105294903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd17806e9d0 0x7fd17811b5e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd16800ec10 tx=0x7fd16800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.320+0000 7fd166ffd700 1 -- 172.21.15.72:0/2105294903 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16800c850 con 0x7fd17806e9d0 2023-10-03T10:19:12.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.320+0000 7fd17cc04700 1 -- 172.21.15.72:0/2105294903 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16c0094a0 con 0x7fd17806e9d0 2023-10-03T10:19:12.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.320+0000 7fd166ffd700 1 -- 172.21.15.72:0/2105294903 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16800c9b0 con 0x7fd17806e9d0 2023-10-03T10:19:12.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.320+0000 7fd166ffd700 1 -- 172.21.15.72:0/2105294903 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16800cd40 con 0x7fd17806e9d0 2023-10-03T10:19:12.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.320+0000 7fd17cc04700 1 -- 172.21.15.72:0/2105294903 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd170009a70 con 0x7fd17806e9d0 2023-10-03T10:19:12.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.321+0000 7fd166ffd700 1 -- 172.21.15.72:0/2105294903 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd168013470 con 0x7fd17806e9d0 2023-10-03T10:19:12.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.321+0000 7fd166ffd700 1 -- 172.21.15.72:0/2105294903 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd16803fc10 con 0x7fd17806e9d0 2023-10-03T10:19:12.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.321+0000 7fd17cc04700 1 -- 172.21.15.72:0/2105294903 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd178099f20 con 0x7fd17806e9d0 2023-10-03T10:19:12.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.330+0000 7fd166ffd700 1 -- 172.21.15.72:0/2105294903 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd168013720 con 0x7fd17806e9d0 2023-10-03T10:19:12.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.382+0000 7f4640cc4700 1 Processor -- start 2023-10-03T10:19:12.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.382+0000 7f4640cc4700 1 -- start start 2023-10-03T10:19:12.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.382+0000 7f4640cc4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f463c0a0a30 0x7f463c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.382+0000 7f4640cc4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f463c09d630 0x7f463c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.382+0000 7f4640cc4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f463c133930 0x7f463c133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f4640cc4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463c0a2a70 con 0x7f463c09d630 2023-10-03T10:19:12.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f4640cc4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0a01d0 con 0x7f463c0a0a30 2023-10-03T10:19:12.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f4640cc4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f463c09e2b0 con 0x7f463c133930 2023-10-03T10:19:12.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f463a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f463c0a0a30 0x7f463c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f4639d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f463c09d630 0x7f463c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f463a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f463c0a0a30 0x7f463c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:41976/0 (socket says 172.21.15.72:41976) 2023-10-03T10:19:12.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f463a59c700 1 -- 172.21.15.72:0/1945615579 learned_addr learned my addr 172.21.15.72:0/1945615579 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:12.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f4639d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f463c09d630 0x7f463c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36054/0 (socket says 172.21.15.72:36054) 2023-10-03T10:19:12.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f463ad9d700 1 --2- 172.21.15.72:0/1945615579 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f463c133930 0x7f463c133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f463a59c700 1 -- 172.21.15.72:0/1945615579 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f463c133930 msgr2=0x7f463c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f463a59c700 1 --2- 172.21.15.72:0/1945615579 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f463c133930 0x7f463c133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f463a59c700 1 -- 172.21.15.72:0/1945615579 >> v2:172.21.15.72:3300/0 conn(0x7f463c09d630 msgr2=0x7f463c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f463a59c700 1 --2- 172.21.15.72:0/1945615579 >> v2:172.21.15.72:3300/0 conn(0x7f463c09d630 0x7f463c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f463a59c700 1 -- 172.21.15.72:0/1945615579 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c09dc50 con 0x7f463c0a0a30 2023-10-03T10:19:12.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f463ad9d700 1 --2- 172.21.15.72:0/1945615579 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f463c133930 0x7f463c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:12.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f4639d9b700 1 --2- 172.21.15.72:0/1945615579 >> v2:172.21.15.72:3300/0 conn(0x7f463c09d630 0x7f463c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:12.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f463a59c700 1 --2- 172.21.15.72:0/1945615579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f463c0a0a30 0x7f463c0a0e00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f462c0098f0 tx=0x7f462c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70b6fbb837b5a70c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f463959a700 1 -- 172.21.15.72:0/1945615579 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c011830 con 0x7f463c0a0a30 2023-10-03T10:19:12.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f463959a700 1 -- 172.21.15.72:0/1945615579 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c011990 con 0x7f463c0a0a30 2023-10-03T10:19:12.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.383+0000 7f463959a700 1 -- 172.21.15.72:0/1945615579 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c011d20 con 0x7f463c0a0a30 2023-10-03T10:19:12.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.384+0000 7f4640cc4700 1 -- 172.21.15.72:0/1945615579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f463c0a0a30 msgr2=0x7f463c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.384+0000 7f4640cc4700 1 --2- 172.21.15.72:0/1945615579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f463c0a0a30 0x7f463c0a0e00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f462c0098f0 tx=0x7f462c009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:12.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.384+0000 7f4640cc4700 1 -- 172.21.15.72:0/1945615579 shutdown_connections 2023-10-03T10:19:12.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.384+0000 7f4640cc4700 1 --2- 172.21.15.72:0/1945615579 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f463c133930 0x7f463c133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.384+0000 7f4640cc4700 1 --2- 172.21.15.72:0/1945615579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f463c0a0a30 0x7f463c0a0e00 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.384+0000 7f4640cc4700 1 --2- 172.21.15.72:0/1945615579 >> v2:172.21.15.72:3300/0 conn(0x7f463c09d630 0x7f463c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.384+0000 7f4640cc4700 1 -- 172.21.15.72:0/1945615579 >> 172.21.15.72:0/1945615579 conn(0x7f463c0a3050 msgr2=0x7f463c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.384+0000 7f4640cc4700 1 -- 172.21.15.72:0/1945615579 shutdown_connections 2023-10-03T10:19:12.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.384+0000 7f4640cc4700 1 -- 172.21.15.72:0/1945615579 wait complete. 2023-10-03T10:19:12.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.385+0000 7f4640cc4700 1 Processor -- start 2023-10-03T10:19:12.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.385+0000 7f4640cc4700 1 -- start start 2023-10-03T10:19:12.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f4640cc4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f463c09d630 0x7f463c1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f4640cc4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f463c0a0a30 0x7f463c1c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f4640cc4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f463c133930 0x7f463c1c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f4640cc4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c120a90 con 0x7f463c0a0a30 2023-10-03T10:19:12.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f4640cc4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c0a41c0 con 0x7f463c133930 2023-10-03T10:19:12.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f4640cc4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f463c1205f0 con 0x7f463c09d630 2023-10-03T10:19:12.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f4639d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f463c0a0a30 0x7f463c1c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f4639d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f463c0a0a30 0x7f463c1c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36064/0 (socket says 172.21.15.72:36064) 2023-10-03T10:19:12.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f4639d9b700 1 -- 172.21.15.72:0/2199825572 learned_addr learned my addr 172.21.15.72:0/2199825572 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:12.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f463ad9d700 1 --2- 172.21.15.72:0/2199825572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f463c133930 0x7f463c1c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f463a59c700 1 --2- 172.21.15.72:0/2199825572 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f463c09d630 0x7f463c1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f463ad9d700 1 -- 172.21.15.72:0/2199825572 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f463c09d630 msgr2=0x7f463c1c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f463ad9d700 1 --2- 172.21.15.72:0/2199825572 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f463c09d630 0x7f463c1c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f463ad9d700 1 -- 172.21.15.72:0/2199825572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f463c0a0a30 msgr2=0x7f463c1c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f463ad9d700 1 --2- 172.21.15.72:0/2199825572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f463c0a0a30 0x7f463c1c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f463ad9d700 1 -- 172.21.15.72:0/2199825572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46300094a0 con 0x7f463c133930 2023-10-03T10:19:12.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f4639d9b700 1 --2- 172.21.15.72:0/2199825572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f463c0a0a30 0x7f463c1c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:12.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.386+0000 7f463ad9d700 1 --2- 172.21.15.72:0/2199825572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f463c133930 0x7f463c1c8b10 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f463400efc0 tx=0x7f463400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.387+0000 7f462affd700 1 -- 172.21.15.72:0/2199825572 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463400ca90 con 0x7f463c133930 2023-10-03T10:19:12.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.387+0000 7f462affd700 1 -- 172.21.15.72:0/2199825572 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463400f040 con 0x7f463c133930 2023-10-03T10:19:12.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.387+0000 7f462affd700 1 -- 172.21.15.72:0/2199825572 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463400ce30 con 0x7f463c133930 2023-10-03T10:19:12.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.387+0000 7f4640cc4700 1 -- 172.21.15.72:0/2199825572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4634009a70 con 0x7f463c133930 2023-10-03T10:19:12.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.387+0000 7f4640cc4700 1 -- 172.21.15.72:0/2199825572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462c009550 con 0x7f463c133930 2023-10-03T10:19:12.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.388+0000 7f4640cc4700 1 -- 172.21.15.72:0/2199825572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463c121db0 con 0x7f463c133930 2023-10-03T10:19:12.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.388+0000 7f462affd700 1 -- 172.21.15.72:0/2199825572 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4634003a20 con 0x7f463c133930 2023-10-03T10:19:12.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.388+0000 7f462affd700 1 -- 172.21.15.72:0/2199825572 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f46340406a0 con 0x7f463c133930 2023-10-03T10:19:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.393+0000 7f462affd700 1 -- 172.21.15.72:0/2199825572 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4634024760 con 0x7f463c133930 2023-10-03T10:19:12.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.422+0000 7fa4cbf98700 1 Processor -- start 2023-10-03T10:19:12.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.422+0000 7fa4cbf98700 1 -- start start 2023-10-03T10:19:12.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4cbf98700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4c409f410 0x7fa4c4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4cbf98700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4c4136fe0 0x7fa4c41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4cbf98700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c4070940 con 0x7fa4c409e930 2023-10-03T10:19:12.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4cbf98700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c406fd60 con 0x7fa4c4136fe0 2023-10-03T10:19:12.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4cbf98700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c406fa80 con 0x7fa4c409f410 2023-10-03T10:19:12.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4ca535700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4c4136fe0 0x7fa4c41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4c9533700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4c409f410 0x7fa4c4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4c9533700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4c409f410 0x7fa4c4136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45962/0 (socket says 172.21.15.72:45962) 2023-10-03T10:19:12.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4ca535700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4c4136fe0 0x7fa4c41393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36072/0 (socket says 172.21.15.72:36072) 2023-10-03T10:19:12.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4c9533700 1 -- 172.21.15.72:0/140780586 learned_addr learned my addr 172.21.15.72:0/140780586 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:12.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4c9d34700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa4c409e930 0x7fa4c409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54582/0 (socket says 172.21.15.72:54582) 2023-10-03T10:19:12.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4ca535700 1 -- 172.21.15.72:0/140780586 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4c409f410 msgr2=0x7fa4c4136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4ca535700 1 --2- 172.21.15.72:0/140780586 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4c409f410 0x7fa4c4136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4ca535700 1 -- 172.21.15.72:0/140780586 >> v1:172.21.15.72:6789/0 conn(0x7fa4c409e930 legacy=0x7fa4c409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4ca535700 1 -- 172.21.15.72:0/140780586 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c409fb60 con 0x7fa4c4136fe0 2023-10-03T10:19:12.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.423+0000 7fa4c8d32700 1 -- 172.21.15.72:0/140780586 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688737845 0 0) 0x7fa4c4070940 con 0x7fa4c409e930 2023-10-03T10:19:12.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.424+0000 7fa4ca535700 1 --2- 172.21.15.72:0/140780586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c4136fe0 0x7fa4c41393c0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009d90 tx=0x7fa4bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d447854775e38767 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.424+0000 7fa4c8d32700 1 -- 172.21.15.72:0/140780586 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc00e070 con 0x7fa4c4136fe0 2023-10-03T10:19:12.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.424+0000 7fa4c8d32700 1 -- 172.21.15.72:0/140780586 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc00bb20 con 0x7fa4c4136fe0 2023-10-03T10:19:12.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.424+0000 7fa4c8d32700 1 -- 172.21.15.72:0/140780586 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc012430 con 0x7fa4c4136fe0 2023-10-03T10:19:12.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.424+0000 7fa4cbf98700 1 -- 172.21.15.72:0/140780586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c4136fe0 msgr2=0x7fa4c41393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.424+0000 7fa4cbf98700 1 --2- 172.21.15.72:0/140780586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c4136fe0 0x7fa4c41393c0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009d90 tx=0x7fa4bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:12.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.424+0000 7fa4cbf98700 1 -- 172.21.15.72:0/140780586 shutdown_connections 2023-10-03T10:19:12.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.424+0000 7fa4cbf98700 1 --2- 172.21.15.72:0/140780586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c4136fe0 0x7fa4c41393c0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.424+0000 7fa4cbf98700 1 --2- 172.21.15.72:0/140780586 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4c409f410 0x7fa4c4136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.424+0000 7fa4cbf98700 1 -- 172.21.15.72:0/140780586 >> 172.21.15.72:0/140780586 conn(0x7fa4c40a4210 msgr2=0x7fa4c40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.424+0000 7fa4cbf98700 1 -- 172.21.15.72:0/140780586 shutdown_connections 2023-10-03T10:19:12.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.424+0000 7fa4cbf98700 1 -- 172.21.15.72:0/140780586 wait complete. 2023-10-03T10:19:12.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.425+0000 7fa4cbf98700 1 Processor -- start 2023-10-03T10:19:12.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.425+0000 7fa4cbf98700 1 -- start start 2023-10-03T10:19:12.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4cbf98700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4c409e930 0x7fa4c41c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4cbf98700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c409f410 0x7fa4c41c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4cbf98700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4c4136fe0 0x7fa4c411c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4cbf98700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c411ffb0 con 0x7fa4c409f410 2023-10-03T10:19:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4cbf98700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c411dbc0 con 0x7fa4c409e930 2023-10-03T10:19:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4cbf98700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4120190 con 0x7fa4c4136fe0 2023-10-03T10:19:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4c9533700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c409f410 0x7fa4c41c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4ca535700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4c4136fe0 0x7fa4c411c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4c9533700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c409f410 0x7fa4c41c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36080/0 (socket says 172.21.15.72:36080) 2023-10-03T10:19:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4c9533700 1 -- 172.21.15.72:0/2620931641 learned_addr learned my addr 172.21.15.72:0/2620931641 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4c9d34700 1 --2- 172.21.15.72:0/2620931641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4c409e930 0x7fa4c41c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4c9533700 1 -- 172.21.15.72:0/2620931641 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4c4136fe0 msgr2=0x7fa4c411c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4c9533700 1 --2- 172.21.15.72:0/2620931641 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4c4136fe0 0x7fa4c411c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4c9533700 1 -- 172.21.15.72:0/2620931641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4c409e930 msgr2=0x7fa4c41c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4c9533700 1 --2- 172.21.15.72:0/2620931641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4c409e930 0x7fa4c41c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4c9533700 1 -- 172.21.15.72:0/2620931641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc009a70 con 0x7fa4c409f410 2023-10-03T10:19:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4c9533700 1 --2- 172.21.15.72:0/2620931641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c409f410 0x7fa4c41c69c0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400e940 tx=0x7fa4b400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.426+0000 7fa4ba7fc700 1 -- 172.21.15.72:0/2620931641 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40096a0 con 0x7fa4c409f410 2023-10-03T10:19:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.427+0000 7fa4ba7fc700 1 -- 172.21.15.72:0/2620931641 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b400ee90 con 0x7fa4c409f410 2023-10-03T10:19:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.427+0000 7fa4ba7fc700 1 -- 172.21.15.72:0/2620931641 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400ca90 con 0x7fa4c409f410 2023-10-03T10:19:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.427+0000 7fa4cbf98700 1 -- 172.21.15.72:0/2620931641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c41bc0c0 con 0x7fa4c409f410 2023-10-03T10:19:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.427+0000 7fa4cbf98700 1 -- 172.21.15.72:0/2620931641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c41c6f00 con 0x7fa4c409f410 2023-10-03T10:19:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.427+0000 7fa4cbf98700 1 -- 172.21.15.72:0/2620931641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c4074ea0 con 0x7fa4c409f410 2023-10-03T10:19:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.428+0000 7fa4ba7fc700 1 -- 172.21.15.72:0/2620931641 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4b400cbf0 con 0x7fa4c409f410 2023-10-03T10:19:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.428+0000 7fa4ba7fc700 1 -- 172.21.15.72:0/2620931641 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa4b403f750 con 0x7fa4c409f410 2023-10-03T10:19:12.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.432+0000 7fa4ba7fc700 1 -- 172.21.15.72:0/2620931641 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4b40232f0 con 0x7fa4c409f410 2023-10-03T10:19:12.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.538+0000 7fd17cc04700 1 -- 172.21.15.72:0/2105294903 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd178074ea0 con 0x7fd17806e9d0 2023-10-03T10:19:12.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.538+0000 7fd166ffd700 1 -- 172.21.15.72:0/2105294903 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd168011960 con 0x7fd17806e9d0 2023-10-03T10:19:12.539 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:12.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.541+0000 7fd17cc04700 1 -- 172.21.15.72:0/2105294903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd17806e9d0 msgr2=0x7fd17811b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.541+0000 7fd17cc04700 1 --2- 172.21.15.72:0/2105294903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd17806e9d0 0x7fd17811b5e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd16800ec10 tx=0x7fd16800ef20 comp rx=0 tx=0).stop 2023-10-03T10:19:12.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.542+0000 7fd17cc04700 1 -- 172.21.15.72:0/2105294903 shutdown_connections 2023-10-03T10:19:12.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.542+0000 7fd17cc04700 1 --2- 172.21.15.72:0/2105294903 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd178131f40 0x7fd17811c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.542+0000 7fd17cc04700 1 --2- 172.21.15.72:0/2105294903 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd17806e9d0 0x7fd17811b5e0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.542+0000 7fd17cc04700 1 --2- 172.21.15.72:0/2105294903 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd178131630 0x7fd17811bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.542+0000 7fd17cc04700 1 -- 172.21.15.72:0/2105294903 >> 172.21.15.72:0/2105294903 conn(0x7fd1780a2aa0 msgr2=0x7fd1781b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.542+0000 7fd17cc04700 1 -- 172.21.15.72:0/2105294903 shutdown_connections 2023-10-03T10:19:12.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.544+0000 7fd17cc04700 1 -- 172.21.15.72:0/2105294903 wait complete. 2023-10-03T10:19:12.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:12.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.592+0000 7f4640cc4700 1 -- 172.21.15.72:0/2199825572 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f463c074770 con 0x7f463c133930 2023-10-03T10:19:12.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.592+0000 7f462affd700 1 -- 172.21.15.72:0/2199825572 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f463402a090 con 0x7f463c133930 2023-10-03T10:19:12.592 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.594+0000 7f4640cc4700 1 -- 172.21.15.72:0/2199825572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f463c133930 msgr2=0x7f463c1c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.594+0000 7f4640cc4700 1 --2- 172.21.15.72:0/2199825572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f463c133930 0x7f463c1c8b10 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f463400efc0 tx=0x7f463400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.594+0000 7f4640cc4700 1 -- 172.21.15.72:0/2199825572 shutdown_connections 2023-10-03T10:19:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.594+0000 7f4640cc4700 1 --2- 172.21.15.72:0/2199825572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f463c133930 0x7f463c1c8b10 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.594+0000 7f4640cc4700 1 --2- 172.21.15.72:0/2199825572 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f463c09d630 0x7f463c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.594+0000 7f4640cc4700 1 --2- 172.21.15.72:0/2199825572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f463c0a0a30 0x7f463c1c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.594+0000 7f4640cc4700 1 -- 172.21.15.72:0/2199825572 >> 172.21.15.72:0/2199825572 conn(0x7f463c0a3050 msgr2=0x7f463c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.594+0000 7f4640cc4700 1 -- 172.21.15.72:0/2199825572 shutdown_connections 2023-10-03T10:19:12.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.594+0000 7f4640cc4700 1 -- 172.21.15.72:0/2199825572 wait complete. 2023-10-03T10:19:12.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:12.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.627+0000 7fa4cbf98700 1 -- 172.21.15.72:0/2620931641 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa4c411fe10 con 0x7fa4c409f410 2023-10-03T10:19:12.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.627+0000 7fa4ba7fc700 1 -- 172.21.15.72:0/2620931641 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4c411fe10 con 0x7fa4c409f410 2023-10-03T10:19:12.627 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.629+0000 7fa4cbf98700 1 -- 172.21.15.72:0/2620931641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c409f410 msgr2=0x7fa4c41c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.629+0000 7fa4cbf98700 1 --2- 172.21.15.72:0/2620931641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c409f410 0x7fa4c41c69c0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400e940 tx=0x7fa4b400ec50 comp rx=0 tx=0).stop 2023-10-03T10:19:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.629+0000 7fa4cbf98700 1 -- 172.21.15.72:0/2620931641 shutdown_connections 2023-10-03T10:19:12.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.629+0000 7fa4cbf98700 1 --2- 172.21.15.72:0/2620931641 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa4c4136fe0 0x7fa4c411c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.629+0000 7fa4cbf98700 1 --2- 172.21.15.72:0/2620931641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa4c409e930 0x7fa4c41c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.629+0000 7fa4cbf98700 1 --2- 172.21.15.72:0/2620931641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4c409f410 0x7fa4c41c69c0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.629+0000 7fa4cbf98700 1 -- 172.21.15.72:0/2620931641 >> 172.21.15.72:0/2620931641 conn(0x7fa4c40a4210 msgr2=0x7fa4c4134a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.629+0000 7fa4cbf98700 1 -- 172.21.15.72:0/2620931641 shutdown_connections 2023-10-03T10:19:12.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:12.629+0000 7fa4cbf98700 1 -- 172.21.15.72:0/2620931641 wait complete. 2023-10-03T10:19:12.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:13.307 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.439+0000 7f7cdde07700 1 Processor -- start 2023-10-03T10:19:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.439+0000 7f7cdde07700 1 -- start start 2023-10-03T10:19:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cdde07700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd8066410 0x7f7cd806e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cdde07700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd806eb80 0x7f7cd806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cdde07700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd8099b50 con 0x7f7cd812f320 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cdde07700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80667e0 con 0x7f7cd806eb80 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cdde07700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8099f60 con 0x7f7cd8066410 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd8066410 0x7f7cd806e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd806eb80 0x7f7cd806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7cd812f320 0x7f7cd812f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54594/0 (socket says 172.21.15.72:54594) 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd8066410 0x7f7cd806e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45974/0 (socket says 172.21.15.72:45974) 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd806eb80 0x7f7cd806ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42000/0 (socket says 172.21.15.72:42000) 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd7fff700 1 -- 172.21.15.72:0/3076463350 learned_addr learned my addr 172.21.15.72:0/3076463350 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd77fe700 1 -- 172.21.15.72:0/3076463350 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd806eb80 msgr2=0x7f7cd806ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd77fe700 1 --2- 172.21.15.72:0/3076463350 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd806eb80 0x7f7cd806ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd77fe700 1 -- 172.21.15.72:0/3076463350 >> v1:172.21.15.72:6789/0 conn(0x7f7cd812f320 legacy=0x7f7cd812f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd67fc700 1 -- 172.21.15.72:0/3076463350 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061221756 0 0) 0x7f7cd8099b50 con 0x7f7cd812f320 2023-10-03T10:19:13.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd77fe700 1 -- 172.21.15.72:0/3076463350 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd809a920 con 0x7f7cd8066410 2023-10-03T10:19:13.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd6ffd700 1 --2- 172.21.15.72:0/3076463350 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd806eb80 0x7f7cd806ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:13.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd77fe700 1 --2- 172.21.15.72:0/3076463350 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd8066410 0x7f7cd806e640 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80098a0 tx=0x7f7cc8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8fe9392ff1e5090 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd67fc700 1 -- 172.21.15.72:0/3076463350 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8011830 con 0x7f7cd8066410 2023-10-03T10:19:13.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd67fc700 1 -- 172.21.15.72:0/3076463350 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc8011990 con 0x7f7cd8066410 2023-10-03T10:19:13.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.440+0000 7f7cd67fc700 1 -- 172.21.15.72:0/3076463350 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8011d20 con 0x7f7cd8066410 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.441+0000 7f7cdde07700 1 -- 172.21.15.72:0/3076463350 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd8066410 msgr2=0x7f7cd806e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.441+0000 7f7cdde07700 1 --2- 172.21.15.72:0/3076463350 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd8066410 0x7f7cd806e640 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80098a0 tx=0x7f7cc8009bb0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.441+0000 7f7cdde07700 1 -- 172.21.15.72:0/3076463350 shutdown_connections 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.441+0000 7f7cdde07700 1 --2- 172.21.15.72:0/3076463350 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd8066410 0x7f7cd806e640 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.441+0000 7f7cdde07700 1 --2- 172.21.15.72:0/3076463350 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd806eb80 0x7f7cd806ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.441+0000 7f7cdde07700 1 -- 172.21.15.72:0/3076463350 >> 172.21.15.72:0/3076463350 conn(0x7f7cd80a2aa0 msgr2=0x7f7cd80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.441+0000 7f7cdde07700 1 -- 172.21.15.72:0/3076463350 shutdown_connections 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.441+0000 7f7cdde07700 1 -- 172.21.15.72:0/3076463350 wait complete. 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.442+0000 7f7cdde07700 1 Processor -- start 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.442+0000 7f7cdde07700 1 -- start start 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.442+0000 7f7cdde07700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd8066410 0x7f7cd811a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.442+0000 7f7cdde07700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd806eb80 0x7f7cd811ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.442+0000 7f7cdde07700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd812f320 0x7f7cd811b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cdde07700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd811dc40 con 0x7f7cd812f320 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cdde07700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd811d0e0 con 0x7f7cd806eb80 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cdde07700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80a3000 con 0x7f7cd8066410 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cd77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd8066410 0x7f7cd811a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cd6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd806eb80 0x7f7cd811ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cd77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd8066410 0x7f7cd811a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:45990/0 (socket says 172.21.15.72:45990) 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cd77fe700 1 -- 172.21.15.72:0/1140625879 learned_addr learned my addr 172.21.15.72:0/1140625879 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cd7fff700 1 --2- 172.21.15.72:0/1140625879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd812f320 0x7f7cd811b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cd77fe700 1 -- 172.21.15.72:0/1140625879 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd806eb80 msgr2=0x7f7cd811ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cd77fe700 1 --2- 172.21.15.72:0/1140625879 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd806eb80 0x7f7cd811ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cd77fe700 1 -- 172.21.15.72:0/1140625879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd812f320 msgr2=0x7f7cd811b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cd77fe700 1 --2- 172.21.15.72:0/1140625879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd812f320 0x7f7cd811b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cd77fe700 1 -- 172.21.15.72:0/1140625879 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc0094a0 con 0x7f7cd8066410 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cd6ffd700 1 --2- 172.21.15.72:0/1140625879 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd806eb80 0x7f7cd811ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cd77fe700 1 --2- 172.21.15.72:0/1140625879 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd8066410 0x7f7cd811a6d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80090b0 tx=0x7f7cc8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cbffff700 1 -- 172.21.15.72:0/1140625879 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc801a720 con 0x7f7cd8066410 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cbffff700 1 -- 172.21.15.72:0/1140625879 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc801a880 con 0x7f7cd8066410 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cbffff700 1 -- 172.21.15.72:0/1140625879 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc801ac10 con 0x7f7cd8066410 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cdde07700 1 -- 172.21.15.72:0/1140625879 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc80094a0 con 0x7f7cd8066410 2023-10-03T10:19:13.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.443+0000 7f7cdde07700 1 -- 172.21.15.72:0/1140625879 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd809a1d0 con 0x7f7cd8066410 2023-10-03T10:19:13.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.444+0000 7f7cbffff700 1 -- 172.21.15.72:0/1140625879 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7cc8022070 con 0x7f7cd8066410 2023-10-03T10:19:13.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.444+0000 7f7cbffff700 1 -- 172.21.15.72:0/1140625879 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7cc8040400 con 0x7f7cd8066410 2023-10-03T10:19:13.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.444+0000 7f7cdde07700 1 -- 172.21.15.72:0/1140625879 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd8074ea0 con 0x7f7cd8066410 2023-10-03T10:19:13.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.449+0000 7f7cbffff700 1 -- 172.21.15.72:0/1140625879 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7cc80193b0 con 0x7f7cd8066410 2023-10-03T10:19:13.557 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:13.606 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:13.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.639+0000 7f7cdde07700 1 -- 172.21.15.72:0/1140625879 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7cd811d9a0 con 0x7f7cd8066410 2023-10-03T10:19:13.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.640+0000 7f7cbffff700 1 -- 172.21.15.72:0/1140625879 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7cc8029030 con 0x7f7cd8066410 2023-10-03T10:19:13.639 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.642+0000 7f7cdde07700 1 -- 172.21.15.72:0/1140625879 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd8066410 msgr2=0x7f7cd811a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.642+0000 7f7cdde07700 1 --2- 172.21.15.72:0/1140625879 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd8066410 0x7f7cd811a6d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80090b0 tx=0x7f7cc8004750 comp rx=0 tx=0).stop 2023-10-03T10:19:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.642+0000 7f7cdde07700 1 -- 172.21.15.72:0/1140625879 shutdown_connections 2023-10-03T10:19:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.642+0000 7f7cdde07700 1 --2- 172.21.15.72:0/1140625879 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7cd812f320 0x7f7cd811b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.642+0000 7f7cdde07700 1 --2- 172.21.15.72:0/1140625879 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7cd8066410 0x7f7cd811a6d0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.642+0000 7f7cdde07700 1 --2- 172.21.15.72:0/1140625879 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7cd806eb80 0x7f7cd811ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.642+0000 7f7cdde07700 1 -- 172.21.15.72:0/1140625879 >> 172.21.15.72:0/1140625879 conn(0x7f7cd80a2aa0 msgr2=0x7f7cd8130f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.642+0000 7f7cdde07700 1 -- 172.21.15.72:0/1140625879 shutdown_connections 2023-10-03T10:19:13.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.642+0000 7f7cdde07700 1 -- 172.21.15.72:0/1140625879 wait complete. 2023-10-03T10:19:13.643 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:13.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:13.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.690+0000 7f6f057fc700 1 Processor -- start 2023-10-03T10:19:13.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.690+0000 7f6f057fc700 1 -- start start 2023-10-03T10:19:13.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.690+0000 7f6f057fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f0009d6f0 0x7f6f0009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6f057fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f0009e410 0x7f6f00130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6f057fc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0009f130 con 0x7f6f0009e000 2023-10-03T10:19:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6f057fc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0009f520 con 0x7f6f0009d6f0 2023-10-03T10:19:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6f057fc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0009e930 con 0x7f6f0009e410 2023-10-03T10:19:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6eff7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f0009e410 0x7f6f00130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6efe7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6f0009e000 0x7f6f00130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54610/0 (socket says 172.21.15.72:54610) 2023-10-03T10:19:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6efe7fc700 1 -- 172.21.15.72:0/2395629221 learned_addr learned my addr 172.21.15.72:0/2395629221 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:13.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6efeffd700 1 --2- 172.21.15.72:0/2395629221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f0009d6f0 0x7f6f0009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6eff7fe700 1 -- 172.21.15.72:0/2395629221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f0009d6f0 msgr2=0x7f6f0009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:13.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6eff7fe700 1 --2- 172.21.15.72:0/2395629221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f0009d6f0 0x7f6f0009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6eff7fe700 1 -- 172.21.15.72:0/2395629221 >> v1:172.21.15.72:6789/0 conn(0x7f6f0009e000 legacy=0x7f6f00130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6efdffb700 1 -- 172.21.15.72:0/2395629221 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014785318 0 0) 0x7f6f0009f130 con 0x7f6f0009e000 2023-10-03T10:19:13.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6eff7fe700 1 -- 172.21.15.72:0/2395629221 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0009b2d0 con 0x7f6f0009e410 2023-10-03T10:19:13.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6efeffd700 1 --2- 172.21.15.72:0/2395629221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f0009d6f0 0x7f6f0009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:13.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6eff7fe700 1 --2- 172.21.15.72:0/2395629221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f0009e410 0x7f6f00130d70 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009dc0 tx=0x7f6ef800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26dc04c25209513c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.691+0000 7f6efdffb700 1 -- 172.21.15.72:0/2395629221 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef800bd20 con 0x7f6f0009e410 2023-10-03T10:19:13.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.692+0000 7f6efdffb700 1 -- 172.21.15.72:0/2395629221 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef800be80 con 0x7f6f0009e410 2023-10-03T10:19:13.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.692+0000 7f6efdffb700 1 -- 172.21.15.72:0/2395629221 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80116a0 con 0x7f6f0009e410 2023-10-03T10:19:13.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.692+0000 7f6f057fc700 1 -- 172.21.15.72:0/2395629221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f0009e410 msgr2=0x7f6f00130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.692+0000 7f6f057fc700 1 --2- 172.21.15.72:0/2395629221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f0009e410 0x7f6f00130d70 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009dc0 tx=0x7f6ef800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:13.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.692+0000 7f6f057fc700 1 -- 172.21.15.72:0/2395629221 shutdown_connections 2023-10-03T10:19:13.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.692+0000 7f6f057fc700 1 --2- 172.21.15.72:0/2395629221 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f0009e410 0x7f6f00130d70 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.692+0000 7f6f057fc700 1 --2- 172.21.15.72:0/2395629221 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f0009d6f0 0x7f6f0009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.692+0000 7f6f057fc700 1 -- 172.21.15.72:0/2395629221 >> 172.21.15.72:0/2395629221 conn(0x7f6f00066f50 msgr2=0x7f6f0009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.692+0000 7f6f057fc700 1 -- 172.21.15.72:0/2395629221 shutdown_connections 2023-10-03T10:19:13.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.692+0000 7f6f057fc700 1 -- 172.21.15.72:0/2395629221 wait complete. 2023-10-03T10:19:13.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.693+0000 7f6f057fc700 1 Processor -- start 2023-10-03T10:19:13.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.693+0000 7f6f057fc700 1 -- start start 2023-10-03T10:19:13.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6f057fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f0009d6f0 0x7f6f001c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6f057fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f0009e000 0x7f6f001c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6f057fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f0009e410 0x7f6f001c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6f057fc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001243c0 con 0x7f6f0009e000 2023-10-03T10:19:13.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6f057fc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001247f0 con 0x7f6f0009e410 2023-10-03T10:19:13.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6f057fc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0009c770 con 0x7f6f0009d6f0 2023-10-03T10:19:13.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6efe7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f0009e000 0x7f6f001c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6efeffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f0009d6f0 0x7f6f001c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6efe7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f0009e000 0x7f6f001c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36090/0 (socket says 172.21.15.72:36090) 2023-10-03T10:19:13.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6efeffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f0009d6f0 0x7f6f001c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46012/0 (socket says 172.21.15.72:46012) 2023-10-03T10:19:13.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6efe7fc700 1 -- 172.21.15.72:0/2419624583 learned_addr learned my addr 172.21.15.72:0/2419624583 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:13.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6eff7fe700 1 --2- 172.21.15.72:0/2419624583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f0009e410 0x7f6f001c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6efe7fc700 1 -- 172.21.15.72:0/2419624583 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f0009d6f0 msgr2=0x7f6f001c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6efe7fc700 1 --2- 172.21.15.72:0/2419624583 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f0009d6f0 0x7f6f001c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6efe7fc700 1 -- 172.21.15.72:0/2419624583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f0009e410 msgr2=0x7f6f001c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6efe7fc700 1 --2- 172.21.15.72:0/2419624583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f0009e410 0x7f6f001c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6efe7fc700 1 -- 172.21.15.72:0/2419624583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef00094a0 con 0x7f6f0009e000 2023-10-03T10:19:13.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.694+0000 7f6efe7fc700 1 --2- 172.21.15.72:0/2419624583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f0009e000 0x7f6f001c89e0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400c520 tx=0x7f6ef400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.695+0000 7f6ee77fe700 1 -- 172.21.15.72:0/2419624583 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4004c80 con 0x7f6f0009e000 2023-10-03T10:19:13.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.695+0000 7f6ee77fe700 1 -- 172.21.15.72:0/2419624583 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef4004de0 con 0x7f6f0009e000 2023-10-03T10:19:13.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.695+0000 7f6f057fc700 1 -- 172.21.15.72:0/2419624583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef8009a70 con 0x7f6f0009e000 2023-10-03T10:19:13.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.695+0000 7f6ee77fe700 1 -- 172.21.15.72:0/2419624583 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4007310 con 0x7f6f0009e000 2023-10-03T10:19:13.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.695+0000 7f6f057fc700 1 -- 172.21.15.72:0/2419624583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f00125e00 con 0x7f6f0009e000 2023-10-03T10:19:13.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.696+0000 7f6f057fc700 1 -- 172.21.15.72:0/2419624583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f00125ff0 con 0x7f6f0009e000 2023-10-03T10:19:13.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.696+0000 7f6ee77fe700 1 -- 172.21.15.72:0/2419624583 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ef4007470 con 0x7f6f0009e000 2023-10-03T10:19:13.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.696+0000 7f6ee77fe700 1 -- 172.21.15.72:0/2419624583 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6ef403fa10 con 0x7f6f0009e000 2023-10-03T10:19:13.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.704+0000 7f6ee77fe700 1 -- 172.21.15.72:0/2419624583 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ef40106d0 con 0x7f6f0009e000 2023-10-03T10:19:13.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.735+0000 7fb7287a1700 1 Processor -- start 2023-10-03T10:19:13.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.735+0000 7fb7287a1700 1 -- start start 2023-10-03T10:19:13.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.736+0000 7fb7287a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7200a0a30 0x7fb7200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.736+0000 7fb7287a1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb720138d80 0x7fb72013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.736+0000 7fb7287a1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7200a2a70 con 0x7fb72009d630 2023-10-03T10:19:13.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.736+0000 7fb7287a1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7200a01d0 con 0x7fb720138d80 2023-10-03T10:19:13.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.736+0000 7fb7287a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72009e2b0 con 0x7fb7200a0a30 2023-10-03T10:19:13.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.736+0000 7fb726d3e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb720138d80 0x7fb72013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.736+0000 7fb726d3e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb720138d80 0x7fb72013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36104/0 (socket says 172.21.15.72:36104) 2023-10-03T10:19:13.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.736+0000 7fb72653d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7200a0a30 0x7fb7200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.736+0000 7fb725d3c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb72009d630 0x7fb7200a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54626/0 (socket says 172.21.15.72:54626) 2023-10-03T10:19:13.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.736+0000 7fb726d3e700 1 -- 172.21.15.72:0/3671963392 learned_addr learned my addr 172.21.15.72:0/3671963392 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:13.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.737+0000 7fb726d3e700 1 -- 172.21.15.72:0/3671963392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7200a0a30 msgr2=0x7fb7200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:13.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.737+0000 7fb726d3e700 1 --2- 172.21.15.72:0/3671963392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7200a0a30 0x7fb7200a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.737+0000 7fb726d3e700 1 -- 172.21.15.72:0/3671963392 >> v1:172.21.15.72:6789/0 conn(0x7fb72009d630 legacy=0x7fb7200a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.737+0000 7fb726d3e700 1 -- 172.21.15.72:0/3671963392 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72009dc50 con 0x7fb720138d80 2023-10-03T10:19:13.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.737+0000 7fb72553b700 1 -- 172.21.15.72:0/3671963392 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034602309 0 0) 0x7fb7200a2a70 con 0x7fb72009d630 2023-10-03T10:19:13.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.737+0000 7fb726d3e700 1 --2- 172.21.15.72:0/3671963392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720138d80 0x7fb72013b160 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fb718009e50 tx=0x7fb71800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d31906fed72d75 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.737+0000 7fb72553b700 1 -- 172.21.15.72:0/3671963392 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71800e070 con 0x7fb720138d80 2023-10-03T10:19:13.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.737+0000 7fb72553b700 1 -- 172.21.15.72:0/3671963392 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71800b910 con 0x7fb720138d80 2023-10-03T10:19:13.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.737+0000 7fb72553b700 1 -- 172.21.15.72:0/3671963392 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71800bcc0 con 0x7fb720138d80 2023-10-03T10:19:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.738+0000 7fb7287a1700 1 -- 172.21.15.72:0/3671963392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720138d80 msgr2=0x7fb72013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.738+0000 7fb7287a1700 1 --2- 172.21.15.72:0/3671963392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720138d80 0x7fb72013b160 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fb718009e50 tx=0x7fb71800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.738+0000 7fb7287a1700 1 -- 172.21.15.72:0/3671963392 shutdown_connections 2023-10-03T10:19:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.738+0000 7fb7287a1700 1 --2- 172.21.15.72:0/3671963392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720138d80 0x7fb72013b160 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.738+0000 7fb7287a1700 1 --2- 172.21.15.72:0/3671963392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7200a0a30 0x7fb7200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.738+0000 7fb7287a1700 1 -- 172.21.15.72:0/3671963392 >> 172.21.15.72:0/3671963392 conn(0x7fb7200a3050 msgr2=0x7fb7200a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.738+0000 7fb7287a1700 1 -- 172.21.15.72:0/3671963392 shutdown_connections 2023-10-03T10:19:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.738+0000 7fb7287a1700 1 -- 172.21.15.72:0/3671963392 wait complete. 2023-10-03T10:19:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb7287a1700 1 Processor -- start 2023-10-03T10:19:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb7287a1700 1 -- start start 2023-10-03T10:19:13.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb7287a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72009d630 0x7fb720133830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb7287a1700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7200a0a30 0x7fb720133d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb7287a1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720138d80 0x7fb7201342b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb7287a1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb720134d00 con 0x7fb720138d80 2023-10-03T10:19:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb7287a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb720136700 con 0x7fb72009d630 2023-10-03T10:19:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb7287a1700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb720137070 con 0x7fb7200a0a30 2023-10-03T10:19:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb72653d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72009d630 0x7fb720133830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb725d3c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7200a0a30 0x7fb720133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb72653d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72009d630 0x7fb720133830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42038/0 (socket says 172.21.15.72:42038) 2023-10-03T10:19:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb72653d700 1 -- 172.21.15.72:0/3888753456 learned_addr learned my addr 172.21.15.72:0/3888753456 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb726d3e700 1 --2- 172.21.15.72:0/3888753456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720138d80 0x7fb7201342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb72653d700 1 -- 172.21.15.72:0/3888753456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7200a0a30 msgr2=0x7fb720133d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb72653d700 1 --2- 172.21.15.72:0/3888753456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7200a0a30 0x7fb720133d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb72653d700 1 -- 172.21.15.72:0/3888753456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720138d80 msgr2=0x7fb7201342b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.739+0000 7fb72653d700 1 --2- 172.21.15.72:0/3888753456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720138d80 0x7fb7201342b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.740+0000 7fb72653d700 1 -- 172.21.15.72:0/3888753456 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb718009b30 con 0x7fb72009d630 2023-10-03T10:19:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.740+0000 7fb725d3c700 1 --2- 172.21.15.72:0/3888753456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7200a0a30 0x7fb720133d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.740+0000 7fb72653d700 1 --2- 172.21.15.72:0/3888753456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72009d630 0x7fb720133830 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00e9b0 tx=0x7fb71c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.740+0000 7fb716ffd700 1 -- 172.21.15.72:0/3888753456 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c009710 con 0x7fb72009d630 2023-10-03T10:19:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.740+0000 7fb716ffd700 1 -- 172.21.15.72:0/3888753456 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c00ee50 con 0x7fb72009d630 2023-10-03T10:19:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.740+0000 7fb716ffd700 1 -- 172.21.15.72:0/3888753456 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c00ca50 con 0x7fb72009d630 2023-10-03T10:19:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.740+0000 7fb7287a1700 1 -- 172.21.15.72:0/3888753456 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7200a0410 con 0x7fb72009d630 2023-10-03T10:19:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.740+0000 7fb7287a1700 1 -- 172.21.15.72:0/3888753456 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb720136e00 con 0x7fb72009d630 2023-10-03T10:19:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.741+0000 7fb716ffd700 1 -- 172.21.15.72:0/3888753456 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb71c00cbb0 con 0x7fb72009d630 2023-10-03T10:19:13.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.741+0000 7fb716ffd700 1 -- 172.21.15.72:0/3888753456 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb71c03f6d0 con 0x7fb72009d630 2023-10-03T10:19:13.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.741+0000 7fb7287a1700 1 -- 172.21.15.72:0/3888753456 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb720137f30 con 0x7fb72009d630 2023-10-03T10:19:13.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.750+0000 7fb716ffd700 1 -- 172.21.15.72:0/3888753456 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb71c017070 con 0x7fb72009d630 2023-10-03T10:19:13.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.777+0000 7f867f92e700 1 Processor -- start 2023-10-03T10:19:13.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.778+0000 7f867f92e700 1 -- start start 2023-10-03T10:19:13.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.778+0000 7f867f92e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86780a0a30 0x7f86780a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.778+0000 7f867f92e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8678138d80 0x7f867813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.778+0000 7f867f92e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86780a2a70 con 0x7f867809d630 2023-10-03T10:19:13.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.778+0000 7f867f92e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86780a01d0 con 0x7f86780a0a30 2023-10-03T10:19:13.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.778+0000 7f867f92e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f867809e2b0 con 0x7f8678138d80 2023-10-03T10:19:13.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.779+0000 7f867d6ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86780a0a30 0x7f86780a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.779+0000 7f867d6ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86780a0a30 0x7f86780a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42042/0 (socket says 172.21.15.72:42042) 2023-10-03T10:19:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.779+0000 7f867decb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8678138d80 0x7f867813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.779+0000 7f867d6ca700 1 -- 172.21.15.72:0/957058750 learned_addr learned my addr 172.21.15.72:0/957058750 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.779+0000 7f867d6ca700 1 -- 172.21.15.72:0/957058750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8678138d80 msgr2=0x7f867813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.779+0000 7f867d6ca700 1 --2- 172.21.15.72:0/957058750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8678138d80 0x7f867813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.779+0000 7f867d6ca700 1 -- 172.21.15.72:0/957058750 >> v1:172.21.15.72:6789/0 conn(0x7f867809d630 legacy=0x7f86780a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.779+0000 7f867d6ca700 1 -- 172.21.15.72:0/957058750 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867809dc50 con 0x7f86780a0a30 2023-10-03T10:19:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.779+0000 7f867decb700 1 --2- 172.21.15.72:0/957058750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8678138d80 0x7f867813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.779+0000 7f867d6ca700 1 --2- 172.21.15.72:0/957058750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86780a0a30 0x7f86780a0e00 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f8674009920 tx=0x7f8674009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3d0d9da59dd94e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.779+0000 7f866ffff700 1 -- 172.21.15.72:0/957058750 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674011830 con 0x7f86780a0a30 2023-10-03T10:19:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.779+0000 7f866ffff700 1 -- 172.21.15.72:0/957058750 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674011990 con 0x7f86780a0a30 2023-10-03T10:19:13.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.779+0000 7f866ffff700 1 -- 172.21.15.72:0/957058750 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674011d20 con 0x7f86780a0a30 2023-10-03T10:19:13.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.780+0000 7f867f92e700 1 -- 172.21.15.72:0/957058750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86780a0a30 msgr2=0x7f86780a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.780+0000 7f867f92e700 1 --2- 172.21.15.72:0/957058750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86780a0a30 0x7f86780a0e00 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f8674009920 tx=0x7f8674009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:13.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.780+0000 7f867f92e700 1 -- 172.21.15.72:0/957058750 shutdown_connections 2023-10-03T10:19:13.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.780+0000 7f867f92e700 1 --2- 172.21.15.72:0/957058750 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8678138d80 0x7f867813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.780+0000 7f867f92e700 1 --2- 172.21.15.72:0/957058750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86780a0a30 0x7f86780a0e00 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.780+0000 7f867f92e700 1 -- 172.21.15.72:0/957058750 >> 172.21.15.72:0/957058750 conn(0x7f86780a3050 msgr2=0x7f86780a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.780+0000 7f867f92e700 1 -- 172.21.15.72:0/957058750 shutdown_connections 2023-10-03T10:19:13.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.780+0000 7f867f92e700 1 -- 172.21.15.72:0/957058750 wait complete. 2023-10-03T10:19:13.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.781+0000 7f867f92e700 1 Processor -- start 2023-10-03T10:19:13.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.781+0000 7f867f92e700 1 -- start start 2023-10-03T10:19:13.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.781+0000 7f867f92e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867809d630 0x7f8678120800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.781+0000 7f867f92e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86780a0a30 0x7f8678120d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.781+0000 7f867f92e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8678138d80 0x7f8678121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.781+0000 7f867f92e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86781230a0 con 0x7f867809d630 2023-10-03T10:19:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.781+0000 7f867f92e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86780a4ed0 con 0x7f86780a0a30 2023-10-03T10:19:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.781+0000 7f867f92e700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86780a0410 con 0x7f8678138d80 2023-10-03T10:19:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.781+0000 7f867d6ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867809d630 0x7f8678120800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.781+0000 7f867cec9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86780a0a30 0x7f8678120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.782+0000 7f867d6ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867809d630 0x7f8678120800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36126/0 (socket says 172.21.15.72:36126) 2023-10-03T10:19:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.782+0000 7f867d6ca700 1 -- 172.21.15.72:0/1378931717 learned_addr learned my addr 172.21.15.72:0/1378931717 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.782+0000 7f867decb700 1 --2- 172.21.15.72:0/1378931717 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8678138d80 0x7f8678121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.782+0000 7f867d6ca700 1 -- 172.21.15.72:0/1378931717 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8678138d80 msgr2=0x7f8678121280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.782+0000 7f867d6ca700 1 --2- 172.21.15.72:0/1378931717 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8678138d80 0x7f8678121280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.782+0000 7f867d6ca700 1 -- 172.21.15.72:0/1378931717 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86780a0a30 msgr2=0x7f8678120d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.782+0000 7f867d6ca700 1 --2- 172.21.15.72:0/1378931717 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86780a0a30 0x7f8678120d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.782+0000 7f867d6ca700 1 -- 172.21.15.72:0/1378931717 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8670009a70 con 0x7f867809d630 2023-10-03T10:19:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.782+0000 7f867d6ca700 1 --2- 172.21.15.72:0/1378931717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867809d630 0x7f8678120800 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f8674000c00 tx=0x7f8674004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.782+0000 7f866dffb700 1 -- 172.21.15.72:0/1378931717 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674004450 con 0x7f867809d630 2023-10-03T10:19:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.782+0000 7f866dffb700 1 -- 172.21.15.72:0/1378931717 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86740045b0 con 0x7f867809d630 2023-10-03T10:19:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.782+0000 7f867f92e700 1 -- 172.21.15.72:0/1378931717 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8674009550 con 0x7f867809d630 2023-10-03T10:19:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.782+0000 7f866dffb700 1 -- 172.21.15.72:0/1378931717 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740038a0 con 0x7f867809d630 2023-10-03T10:19:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.782+0000 7f867f92e700 1 -- 172.21.15.72:0/1378931717 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86781222a0 con 0x7f867809d630 2023-10-03T10:19:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.783+0000 7f867f92e700 1 -- 172.21.15.72:0/1378931717 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86780747f0 con 0x7f867809d630 2023-10-03T10:19:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.784+0000 7f866dffb700 1 -- 172.21.15.72:0/1378931717 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8674021070 con 0x7f867809d630 2023-10-03T10:19:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.784+0000 7f866dffb700 1 -- 172.21.15.72:0/1378931717 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8674040a20 con 0x7f867809d630 2023-10-03T10:19:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.788+0000 7f866dffb700 1 -- 172.21.15.72:0/1378931717 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f867400ba10 con 0x7f867809d630 2023-10-03T10:19:13.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.905+0000 7f6f057fc700 1 -- 172.21.15.72:0/2419624583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6f00074ea0 con 0x7f6f0009e000 2023-10-03T10:19:13.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.906+0000 7f6ee77fe700 1 -- 172.21.15.72:0/2419624583 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6ef40102c0 con 0x7f6f0009e000 2023-10-03T10:19:13.906 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:13.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.908+0000 7f6f057fc700 1 -- 172.21.15.72:0/2419624583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f0009e000 msgr2=0x7f6f001c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.908+0000 7f6f057fc700 1 --2- 172.21.15.72:0/2419624583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f0009e000 0x7f6f001c89e0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400c520 tx=0x7f6ef400c830 comp rx=0 tx=0).stop 2023-10-03T10:19:13.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.908+0000 7f6f057fc700 1 -- 172.21.15.72:0/2419624583 shutdown_connections 2023-10-03T10:19:13.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.908+0000 7f6f057fc700 1 --2- 172.21.15.72:0/2419624583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f0009e410 0x7f6f001c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.908+0000 7f6f057fc700 1 --2- 172.21.15.72:0/2419624583 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6f0009d6f0 0x7f6f001c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.908+0000 7f6f057fc700 1 --2- 172.21.15.72:0/2419624583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f0009e000 0x7f6f001c89e0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.908+0000 7f6f057fc700 1 -- 172.21.15.72:0/2419624583 >> 172.21.15.72:0/2419624583 conn(0x7f6f00066f50 msgr2=0x7f6f00070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.908+0000 7f6f057fc700 1 -- 172.21.15.72:0/2419624583 shutdown_connections 2023-10-03T10:19:13.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.908+0000 7f6f057fc700 1 -- 172.21.15.72:0/2419624583 wait complete. 2023-10-03T10:19:13.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:13.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.947+0000 7fb7287a1700 1 -- 172.21.15.72:0/3888753456 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb7200a4b50 con 0x7fb72009d630 2023-10-03T10:19:13.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.948+0000 7fb716ffd700 1 -- 172.21.15.72:0/3888753456 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb71c017030 con 0x7fb72009d630 2023-10-03T10:19:13.947 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:13.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.950+0000 7fb7287a1700 1 -- 172.21.15.72:0/3888753456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72009d630 msgr2=0x7fb720133830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.950+0000 7fb7287a1700 1 --2- 172.21.15.72:0/3888753456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72009d630 0x7fb720133830 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00e9b0 tx=0x7fb71c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.950+0000 7fb7287a1700 1 -- 172.21.15.72:0/3888753456 shutdown_connections 2023-10-03T10:19:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.950+0000 7fb7287a1700 1 --2- 172.21.15.72:0/3888753456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720138d80 0x7fb7201342b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.950+0000 7fb7287a1700 1 --2- 172.21.15.72:0/3888753456 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72009d630 0x7fb720133830 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.950+0000 7fb7287a1700 1 --2- 172.21.15.72:0/3888753456 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb7200a0a30 0x7fb720133d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.950+0000 7fb7287a1700 1 -- 172.21.15.72:0/3888753456 >> 172.21.15.72:0/3888753456 conn(0x7fb7200a3050 msgr2=0x7fb72009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.950+0000 7fb7287a1700 1 -- 172.21.15.72:0/3888753456 shutdown_connections 2023-10-03T10:19:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.950+0000 7fb7287a1700 1 -- 172.21.15.72:0/3888753456 wait complete. 2023-10-03T10:19:13.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:13.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.981+0000 7f867f92e700 1 -- 172.21.15.72:0/1378931717 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8678072980 con 0x7f867809d630 2023-10-03T10:19:13.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.981+0000 7f866dffb700 1 -- 172.21.15.72:0/1378931717 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8674015070 con 0x7f867809d630 2023-10-03T10:19:13.981 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:13.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.983+0000 7f867f92e700 1 -- 172.21.15.72:0/1378931717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867809d630 msgr2=0x7f8678120800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.983+0000 7f867f92e700 1 --2- 172.21.15.72:0/1378931717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867809d630 0x7f8678120800 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f8674000c00 tx=0x7f8674004750 comp rx=0 tx=0).stop 2023-10-03T10:19:13.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.983+0000 7f867f92e700 1 -- 172.21.15.72:0/1378931717 shutdown_connections 2023-10-03T10:19:13.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.983+0000 7f867f92e700 1 --2- 172.21.15.72:0/1378931717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f867809d630 0x7f8678120800 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.983+0000 7f867f92e700 1 --2- 172.21.15.72:0/1378931717 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8678138d80 0x7f8678121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.983+0000 7f867f92e700 1 --2- 172.21.15.72:0/1378931717 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f86780a0a30 0x7f8678120d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.983+0000 7f867f92e700 1 -- 172.21.15.72:0/1378931717 >> 172.21.15.72:0/1378931717 conn(0x7f86780a3050 msgr2=0x7f86780a5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.983+0000 7f867f92e700 1 -- 172.21.15.72:0/1378931717 shutdown_connections 2023-10-03T10:19:13.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:13.983+0000 7f867f92e700 1 -- 172.21.15.72:0/1378931717 wait complete. 2023-10-03T10:19:13.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:14.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:14.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.781+0000 7fcd1b790700 1 Processor -- start 2023-10-03T10:19:14.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.781+0000 7fcd1b790700 1 -- start start 2023-10-03T10:19:14.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.781+0000 7fcd1b790700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd1409f410 0x7fcd14136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.781+0000 7fcd1b790700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd14136fe0 0x7fcd141393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.781+0000 7fcd1b790700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd14070940 con 0x7fcd1409e930 2023-10-03T10:19:14.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.781+0000 7fcd1b790700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1406fd60 con 0x7fcd14136fe0 2023-10-03T10:19:14.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.781+0000 7fcd1b790700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1406fa80 con 0x7fcd1409f410 2023-10-03T10:19:14.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.781+0000 7fcd18d2b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd1409f410 0x7fcd14136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.781+0000 7fcd19d2d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd14136fe0 0x7fcd141393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.781+0000 7fcd18d2b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd1409f410 0x7fcd14136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46046/0 (socket says 172.21.15.72:46046) 2023-10-03T10:19:14.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.781+0000 7fcd18d2b700 1 -- 172.21.15.72:0/3737508061 learned_addr learned my addr 172.21.15.72:0/3737508061 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:14.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.782+0000 7fcd18d2b700 1 -- 172.21.15.72:0/3737508061 >> v2:172.21.15.72:3300/0 conn(0x7fcd14136fe0 msgr2=0x7fcd141393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:14.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.782+0000 7fcd18d2b700 1 --2- 172.21.15.72:0/3737508061 >> v2:172.21.15.72:3300/0 conn(0x7fcd14136fe0 0x7fcd141393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.782+0000 7fcd18d2b700 1 -- 172.21.15.72:0/3737508061 >> v1:172.21.15.72:6789/0 conn(0x7fcd1409e930 legacy=0x7fcd1409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.782+0000 7fcd18d2b700 1 -- 172.21.15.72:0/3737508061 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1409fb60 con 0x7fcd1409f410 2023-10-03T10:19:14.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.782+0000 7fcd19d2d700 1 --2- 172.21.15.72:0/3737508061 >> v2:172.21.15.72:3300/0 conn(0x7fcd14136fe0 0x7fcd141393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.782+0000 7fcd18d2b700 1 --2- 172.21.15.72:0/3737508061 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd1409f410 0x7fcd14136aa0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fcd100098f0 tx=0x7fcd10009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf1baa15860b8fa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.782+0000 7fcd0bfff700 1 -- 172.21.15.72:0/3737508061 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10011830 con 0x7fcd1409f410 2023-10-03T10:19:14.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.782+0000 7fcd0bfff700 1 -- 172.21.15.72:0/3737508061 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd10011990 con 0x7fcd1409f410 2023-10-03T10:19:14.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.782+0000 7fcd0bfff700 1 -- 172.21.15.72:0/3737508061 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10011d20 con 0x7fcd1409f410 2023-10-03T10:19:14.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.782+0000 7fcd1b790700 1 -- 172.21.15.72:0/3737508061 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd1409f410 msgr2=0x7fcd14136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.782+0000 7fcd1b790700 1 --2- 172.21.15.72:0/3737508061 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd1409f410 0x7fcd14136aa0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fcd100098f0 tx=0x7fcd10009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:14.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.783+0000 7fcd1b790700 1 -- 172.21.15.72:0/3737508061 shutdown_connections 2023-10-03T10:19:14.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.783+0000 7fcd1b790700 1 --2- 172.21.15.72:0/3737508061 >> v2:172.21.15.72:3300/0 conn(0x7fcd14136fe0 0x7fcd141393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.783+0000 7fcd1b790700 1 --2- 172.21.15.72:0/3737508061 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd1409f410 0x7fcd14136aa0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.783+0000 7fcd1b790700 1 -- 172.21.15.72:0/3737508061 >> 172.21.15.72:0/3737508061 conn(0x7fcd140a4210 msgr2=0x7fcd140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.783+0000 7fcd1b790700 1 -- 172.21.15.72:0/3737508061 shutdown_connections 2023-10-03T10:19:14.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.783+0000 7fcd1b790700 1 -- 172.21.15.72:0/3737508061 wait complete. 2023-10-03T10:19:14.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd1b790700 1 Processor -- start 2023-10-03T10:19:14.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd1b790700 1 -- start start 2023-10-03T10:19:14.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd1b790700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd1409e930 0x7fcd1411a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd1b790700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd1409f410 0x7fcd1411abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd1b790700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd14136fe0 0x7fcd1411b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd1b790700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1411ddf0 con 0x7fcd14136fe0 2023-10-03T10:19:14.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd1b790700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1411c0e0 con 0x7fcd1409e930 2023-10-03T10:19:14.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd1b790700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1411c690 con 0x7fcd1409f410 2023-10-03T10:19:14.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd18d2b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd1409f410 0x7fcd1411abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd1952c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd1409e930 0x7fcd1411a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd19d2d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd14136fe0 0x7fcd1411b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd18d2b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd1409f410 0x7fcd1411abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46058/0 (socket says 172.21.15.72:46058) 2023-10-03T10:19:14.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd18d2b700 1 -- 172.21.15.72:0/2372554899 learned_addr learned my addr 172.21.15.72:0/2372554899 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:14.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd19d2d700 1 -- 172.21.15.72:0/2372554899 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd1409f410 msgr2=0x7fcd1411abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd19d2d700 1 --2- 172.21.15.72:0/2372554899 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd1409f410 0x7fcd1411abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd19d2d700 1 -- 172.21.15.72:0/2372554899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd1409e930 msgr2=0x7fcd1411a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd19d2d700 1 --2- 172.21.15.72:0/2372554899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd1409e930 0x7fcd1411a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd19d2d700 1 -- 172.21.15.72:0/2372554899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c00f050 con 0x7fcd14136fe0 2023-10-03T10:19:14.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd1952c700 1 --2- 172.21.15.72:0/2372554899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd1409e930 0x7fcd1411a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.784+0000 7fcd18d2b700 1 --2- 172.21.15.72:0/2372554899 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd1409f410 0x7fcd1411abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.785+0000 7fcd19d2d700 1 --2- 172.21.15.72:0/2372554899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd14136fe0 0x7fcd1411b100 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00f500 tx=0x7fcd0c00f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.785+0000 7fcd09ffb700 1 -- 172.21.15.72:0/2372554899 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c012050 con 0x7fcd14136fe0 2023-10-03T10:19:14.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.785+0000 7fcd09ffb700 1 -- 172.21.15.72:0/2372554899 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c013040 con 0x7fcd14136fe0 2023-10-03T10:19:14.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.785+0000 7fcd1b790700 1 -- 172.21.15.72:0/2372554899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd10009550 con 0x7fcd14136fe0 2023-10-03T10:19:14.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.785+0000 7fcd09ffb700 1 -- 172.21.15.72:0/2372554899 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c01a8b0 con 0x7fcd14136fe0 2023-10-03T10:19:14.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.785+0000 7fcd1b790700 1 -- 172.21.15.72:0/2372554899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1411d360 con 0x7fcd14136fe0 2023-10-03T10:19:14.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.786+0000 7fcd09ffb700 1 -- 172.21.15.72:0/2372554899 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd0c017400 con 0x7fcd14136fe0 2023-10-03T10:19:14.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.786+0000 7fcd09ffb700 1 -- 172.21.15.72:0/2372554899 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd0c043e00 con 0x7fcd14136fe0 2023-10-03T10:19:14.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.786+0000 7fcd1b790700 1 -- 172.21.15.72:0/2372554899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd14074ea0 con 0x7fcd14136fe0 2023-10-03T10:19:14.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.790+0000 7fcd09ffb700 1 -- 172.21.15.72:0/2372554899 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd0c01f020 con 0x7fcd14136fe0 2023-10-03T10:19:14.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:14.962 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:14.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.979+0000 7fcd1b790700 1 -- 172.21.15.72:0/2372554899 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcd14132670 con 0x7fcd14136fe0 2023-10-03T10:19:14.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.980+0000 7fcd09ffb700 1 -- 172.21.15.72:0/2372554899 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd0c016360 con 0x7fcd14136fe0 2023-10-03T10:19:14.979 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.982+0000 7fcd1b790700 1 -- 172.21.15.72:0/2372554899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd14136fe0 msgr2=0x7fcd1411b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.982+0000 7fcd1b790700 1 --2- 172.21.15.72:0/2372554899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd14136fe0 0x7fcd1411b100 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00f500 tx=0x7fcd0c00f810 comp rx=0 tx=0).stop 2023-10-03T10:19:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.982+0000 7fcd1b790700 1 -- 172.21.15.72:0/2372554899 shutdown_connections 2023-10-03T10:19:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.982+0000 7fcd1b790700 1 --2- 172.21.15.72:0/2372554899 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd14136fe0 0x7fcd1411b100 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.982+0000 7fcd1b790700 1 --2- 172.21.15.72:0/2372554899 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd1409e930 0x7fcd1411a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.982+0000 7fcd1b790700 1 --2- 172.21.15.72:0/2372554899 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcd1409f410 0x7fcd1411abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.982+0000 7fcd1b790700 1 -- 172.21.15.72:0/2372554899 >> 172.21.15.72:0/2372554899 conn(0x7fcd140a4210 msgr2=0x7fcd140a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.982+0000 7fcd1b790700 1 -- 172.21.15.72:0/2372554899 shutdown_connections 2023-10-03T10:19:14.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:14.982+0000 7fcd1b790700 1 -- 172.21.15.72:0/2372554899 wait complete. 2023-10-03T10:19:14.995 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:14.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:15.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.047+0000 7f9e9efed700 1 Processor -- start 2023-10-03T10:19:15.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.047+0000 7f9e9efed700 1 -- start start 2023-10-03T10:19:15.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.048+0000 7f9e9efed700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e9809d6f0 0x7f9e9809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.048+0000 7f9e9efed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9809e410 0x7f9e98134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.048+0000 7f9e9efed700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9809b120 con 0x7f9e9809e000 2023-10-03T10:19:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.048+0000 7f9e9efed700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9806b460 con 0x7f9e9809e410 2023-10-03T10:19:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.048+0000 7f9e9efed700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9809a7e0 con 0x7f9e9809d6f0 2023-10-03T10:19:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.048+0000 7f9e9d58a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9809e410 0x7f9e98134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.048+0000 7f9e9cd89700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e9809d6f0 0x7f9e9809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.048+0000 7f9e97fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9e9809e000 0x7f9e981339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54662/0 (socket says 172.21.15.72:54662) 2023-10-03T10:19:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.048+0000 7f9e97fff700 1 -- 172.21.15.72:0/284038645 learned_addr learned my addr 172.21.15.72:0/284038645 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.048+0000 7f9e9d58a700 1 --2- 172.21.15.72:0/284038645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9809e410 0x7f9e98134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42078/0 (socket says 172.21.15.72:42078) 2023-10-03T10:19:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.048+0000 7f9e977fe700 1 -- 172.21.15.72:0/284038645 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270422416 0 0) 0x7f9e9809b120 con 0x7f9e9809e000 2023-10-03T10:19:15.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.048+0000 7f9e9cd89700 1 -- 172.21.15.72:0/284038645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9809e410 msgr2=0x7f9e98134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.048+0000 7f9e9cd89700 1 --2- 172.21.15.72:0/284038645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9809e410 0x7f9e98134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.048+0000 7f9e9cd89700 1 -- 172.21.15.72:0/284038645 >> v1:172.21.15.72:6789/0 conn(0x7f9e9809e000 legacy=0x7f9e981339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.048+0000 7f9e9cd89700 1 -- 172.21.15.72:0/284038645 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9809a500 con 0x7f9e9809d6f0 2023-10-03T10:19:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.049+0000 7f9e9cd89700 1 --2- 172.21.15.72:0/284038645 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e9809d6f0 0x7f9e9809dac0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0098a0 tx=0x7f9e8c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14bbec56a842eb6c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.049+0000 7f9e977fe700 1 -- 172.21.15.72:0/284038645 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c011830 con 0x7f9e9809d6f0 2023-10-03T10:19:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.049+0000 7f9e977fe700 1 -- 172.21.15.72:0/284038645 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8c011990 con 0x7f9e9809d6f0 2023-10-03T10:19:15.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.049+0000 7f9e977fe700 1 -- 172.21.15.72:0/284038645 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c011d20 con 0x7f9e9809d6f0 2023-10-03T10:19:15.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.049+0000 7f9e9efed700 1 -- 172.21.15.72:0/284038645 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e9809d6f0 msgr2=0x7f9e9809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.049+0000 7f9e9efed700 1 --2- 172.21.15.72:0/284038645 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e9809d6f0 0x7f9e9809dac0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0098a0 tx=0x7f9e8c009bb0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.050+0000 7f9e9efed700 1 -- 172.21.15.72:0/284038645 shutdown_connections 2023-10-03T10:19:15.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.050+0000 7f9e9efed700 1 --2- 172.21.15.72:0/284038645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9809e410 0x7f9e98134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.050+0000 7f9e9efed700 1 --2- 172.21.15.72:0/284038645 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e9809d6f0 0x7f9e9809dac0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.050+0000 7f9e9efed700 1 -- 172.21.15.72:0/284038645 >> 172.21.15.72:0/284038645 conn(0x7f9e98066f50 msgr2=0x7f9e9809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.050+0000 7f9e9efed700 1 -- 172.21.15.72:0/284038645 shutdown_connections 2023-10-03T10:19:15.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.050+0000 7f9e9efed700 1 -- 172.21.15.72:0/284038645 wait complete. 2023-10-03T10:19:15.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.051+0000 7f9e9efed700 1 Processor -- start 2023-10-03T10:19:15.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.051+0000 7f9e9efed700 1 -- start start 2023-10-03T10:19:15.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.051+0000 7f9e9efed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9809d6f0 0x7f9e981a5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.051+0000 7f9e9efed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9809e000 0x7f9e981c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.051+0000 7f9e9efed700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e9809e410 0x7f9e981c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.051+0000 7f9e9efed700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e981a8150 con 0x7f9e9809e000 2023-10-03T10:19:15.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.051+0000 7f9e9efed700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e981a8330 con 0x7f9e9809d6f0 2023-10-03T10:19:15.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.051+0000 7f9e9efed700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e981b91a0 con 0x7f9e9809e410 2023-10-03T10:19:15.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.051+0000 7f9e97fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9809e000 0x7f9e981c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.051+0000 7f9e97fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9809e000 0x7f9e981c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36160/0 (socket says 172.21.15.72:36160) 2023-10-03T10:19:15.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.051+0000 7f9e97fff700 1 -- 172.21.15.72:0/2299134152 learned_addr learned my addr 172.21.15.72:0/2299134152 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:15.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.051+0000 7f9e9d58a700 1 --2- 172.21.15.72:0/2299134152 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e9809e410 0x7f9e981c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.051+0000 7f9e9cd89700 1 --2- 172.21.15.72:0/2299134152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9809d6f0 0x7f9e981a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.052+0000 7f9e9d58a700 1 -- 172.21.15.72:0/2299134152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9809d6f0 msgr2=0x7f9e981a5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.052+0000 7f9e9d58a700 1 --2- 172.21.15.72:0/2299134152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9809d6f0 0x7f9e981a5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.052+0000 7f9e9d58a700 1 -- 172.21.15.72:0/2299134152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9809e000 msgr2=0x7f9e981c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.052+0000 7f9e9d58a700 1 --2- 172.21.15.72:0/2299134152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9809e000 0x7f9e981c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.052+0000 7f9e9d58a700 1 -- 172.21.15.72:0/2299134152 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c0094a0 con 0x7f9e9809e410 2023-10-03T10:19:15.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.052+0000 7f9e9cd89700 1 --2- 172.21.15.72:0/2299134152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9809d6f0 0x7f9e981a5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.052+0000 7f9e9d58a700 1 --2- 172.21.15.72:0/2299134152 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e9809e410 0x7f9e981c8510 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009d90 tx=0x7f9e9000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.052+0000 7f9e957fa700 1 -- 172.21.15.72:0/2299134152 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e90009c00 con 0x7f9e9809e410 2023-10-03T10:19:15.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.052+0000 7f9e957fa700 1 -- 172.21.15.72:0/2299134152 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9000f040 con 0x7f9e9809e410 2023-10-03T10:19:15.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.052+0000 7f9e9efed700 1 -- 172.21.15.72:0/2299134152 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e980a1d90 con 0x7f9e9809e410 2023-10-03T10:19:15.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.052+0000 7f9e957fa700 1 -- 172.21.15.72:0/2299134152 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e90014480 con 0x7f9e9809e410 2023-10-03T10:19:15.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.052+0000 7f9e9efed700 1 -- 172.21.15.72:0/2299134152 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e981a4da0 con 0x7f9e9809e410 2023-10-03T10:19:15.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.053+0000 7f9e957fa700 1 -- 172.21.15.72:0/2299134152 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9e900145e0 con 0x7f9e9809e410 2023-10-03T10:19:15.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.053+0000 7f9e957fa700 1 -- 172.21.15.72:0/2299134152 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9e90040210 con 0x7f9e9809e410 2023-10-03T10:19:15.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.053+0000 7f9e9efed700 1 -- 172.21.15.72:0/2299134152 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e98074ea0 con 0x7f9e9809e410 2023-10-03T10:19:15.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.058+0000 7f9e957fa700 1 -- 172.21.15.72:0/2299134152 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e90018080 con 0x7f9e9809e410 2023-10-03T10:19:15.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.092+0000 7fc40310c700 1 Processor -- start 2023-10-03T10:19:15.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.092+0000 7fc40310c700 1 -- start start 2023-10-03T10:19:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.092+0000 7fc40310c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3fc09e930 0x7fc3fc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc40310c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3fc09f240 0x7fc3fc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc40310c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3fc070940 con 0x7fc3fc09f650 2023-10-03T10:19:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc40310c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3fc06fd60 con 0x7fc3fc09e930 2023-10-03T10:19:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc40310c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc06fa80 con 0x7fc3fc09f240 2023-10-03T10:19:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc400ea8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3fc09e930 0x7fc3fc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc400ea8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3fc09e930 0x7fc3fc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36166/0 (socket says 172.21.15.72:36166) 2023-10-03T10:19:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc400ea8700 1 -- 172.21.15.72:0/259306256 learned_addr learned my addr 172.21.15.72:0/259306256 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc3fbfff700 1 --2- 172.21.15.72:0/259306256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3fc09f240 0x7fc3fc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc3fbfff700 1 -- 172.21.15.72:0/259306256 >> v2:172.21.15.72:3300/0 conn(0x7fc3fc09e930 msgr2=0x7fc3fc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc3fbfff700 1 --2- 172.21.15.72:0/259306256 >> v2:172.21.15.72:3300/0 conn(0x7fc3fc09e930 0x7fc3fc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc3fbfff700 1 -- 172.21.15.72:0/259306256 >> v1:172.21.15.72:6789/0 conn(0x7fc3fc09f650 legacy=0x7fc3fc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc3fbfff700 1 -- 172.21.15.72:0/259306256 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc09fb60 con 0x7fc3fc09f240 2023-10-03T10:19:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc3fbfff700 1 --2- 172.21.15.72:0/259306256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3fc09f240 0x7fc3fc1317f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009840 tx=0x7fc3e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b5c06d8401b8445 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc3fb7fe700 1 -- 172.21.15.72:0/259306256 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8011830 con 0x7fc3fc09f240 2023-10-03T10:19:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc3fb7fe700 1 -- 172.21.15.72:0/259306256 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e8011990 con 0x7fc3fc09f240 2023-10-03T10:19:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.093+0000 7fc3fb7fe700 1 -- 172.21.15.72:0/259306256 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8011d20 con 0x7fc3fc09f240 2023-10-03T10:19:15.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.094+0000 7fc40310c700 1 -- 172.21.15.72:0/259306256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3fc09f240 msgr2=0x7fc3fc1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.094+0000 7fc40310c700 1 --2- 172.21.15.72:0/259306256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3fc09f240 0x7fc3fc1317f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009840 tx=0x7fc3e8009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:15.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.094+0000 7fc40310c700 1 -- 172.21.15.72:0/259306256 shutdown_connections 2023-10-03T10:19:15.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.094+0000 7fc40310c700 1 --2- 172.21.15.72:0/259306256 >> v2:172.21.15.72:3300/0 conn(0x7fc3fc09e930 0x7fc3fc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.094+0000 7fc40310c700 1 --2- 172.21.15.72:0/259306256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3fc09f240 0x7fc3fc1317f0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.094+0000 7fc40310c700 1 -- 172.21.15.72:0/259306256 >> 172.21.15.72:0/259306256 conn(0x7fc3fc0a4210 msgr2=0x7fc3fc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.094+0000 7fc40310c700 1 -- 172.21.15.72:0/259306256 shutdown_connections 2023-10-03T10:19:15.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.094+0000 7fc40310c700 1 -- 172.21.15.72:0/259306256 wait complete. 2023-10-03T10:19:15.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.095+0000 7fc40310c700 1 Processor -- start 2023-10-03T10:19:15.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.095+0000 7fc40310c700 1 -- start start 2023-10-03T10:19:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.096+0000 7fc40310c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3fc09e930 0x7fc3fc1a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.096+0000 7fc40310c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3fc09f240 0x7fc3fc1a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.096+0000 7fc40310c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3fc09f650 0x7fc3fc1a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.096+0000 7fc40310c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc1a5e30 con 0x7fc3fc09f240 2023-10-03T10:19:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.096+0000 7fc40310c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc1a6ef0 con 0x7fc3fc09e930 2023-10-03T10:19:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.096+0000 7fc40310c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc071d20 con 0x7fc3fc09f650 2023-10-03T10:19:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.096+0000 7fc400ea8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3fc09e930 0x7fc3fc1a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.096+0000 7fc400ea8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3fc09e930 0x7fc3fc1a3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42102/0 (socket says 172.21.15.72:42102) 2023-10-03T10:19:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.096+0000 7fc400ea8700 1 -- 172.21.15.72:0/3341515800 learned_addr learned my addr 172.21.15.72:0/3341515800 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.096+0000 7fc4016a9700 1 --2- 172.21.15.72:0/3341515800 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3fc09f650 0x7fc3fc1a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.097+0000 7fc3fbfff700 1 --2- 172.21.15.72:0/3341515800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3fc09f240 0x7fc3fc1a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.097+0000 7fc400ea8700 1 -- 172.21.15.72:0/3341515800 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3fc09f650 msgr2=0x7fc3fc1a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.097+0000 7fc400ea8700 1 --2- 172.21.15.72:0/3341515800 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3fc09f650 0x7fc3fc1a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.097+0000 7fc400ea8700 1 -- 172.21.15.72:0/3341515800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3fc09f240 msgr2=0x7fc3fc1a4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.097+0000 7fc400ea8700 1 --2- 172.21.15.72:0/3341515800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3fc09f240 0x7fc3fc1a4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.097+0000 7fc400ea8700 1 -- 172.21.15.72:0/3341515800 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e80094a0 con 0x7fc3fc09e930 2023-10-03T10:19:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.097+0000 7fc400ea8700 1 --2- 172.21.15.72:0/3341515800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3fc09e930 0x7fc3fc1a3c40 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000e910 tx=0x7fc3f000ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.097+0000 7fc3f97fa700 1 -- 172.21.15.72:0/3341515800 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f00096a0 con 0x7fc3fc09e930 2023-10-03T10:19:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.097+0000 7fc3f97fa700 1 -- 172.21.15.72:0/3341515800 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f0013680 con 0x7fc3fc09e930 2023-10-03T10:19:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.097+0000 7fc40310c700 1 -- 172.21.15.72:0/3341515800 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3fc0a0190 con 0x7fc3fc09e930 2023-10-03T10:19:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.097+0000 7fc3f97fa700 1 -- 172.21.15.72:0/3341515800 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0013a30 con 0x7fc3fc09e930 2023-10-03T10:19:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.097+0000 7fc40310c700 1 -- 172.21.15.72:0/3341515800 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3fc1a5850 con 0x7fc3fc09e930 2023-10-03T10:19:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.098+0000 7fc3f97fa700 1 -- 172.21.15.72:0/3341515800 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3f0013b90 con 0x7fc3fc09e930 2023-10-03T10:19:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.098+0000 7fc40310c700 1 -- 172.21.15.72:0/3341515800 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3fc1a0b30 con 0x7fc3fc09e930 2023-10-03T10:19:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.098+0000 7fc3f97fa700 1 -- 172.21.15.72:0/3341515800 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc3f003f620 con 0x7fc3fc09e930 2023-10-03T10:19:15.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.103+0000 7fc3f97fa700 1 -- 172.21.15.72:0/3341515800 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3f001bdf0 con 0x7fc3fc09e930 2023-10-03T10:19:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.163+0000 7f012c929700 1 Processor -- start 2023-10-03T10:19:15.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.163+0000 7f012c929700 1 -- start start 2023-10-03T10:19:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f012c929700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01280a0a30 0x7f01280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f012c929700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0128138d80 0x7f012813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f012c929700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01280a2a70 con 0x7f012809d630 2023-10-03T10:19:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f012c929700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01280a01d0 con 0x7f01280a0a30 2023-10-03T10:19:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f012c929700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f012809e2b0 con 0x7f0128138d80 2023-10-03T10:19:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f012659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01280a0a30 0x7f01280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f0126d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0128138d80 0x7f012813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f0125d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f012809d630 0x7f01280a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54680/0 (socket says 172.21.15.72:54680) 2023-10-03T10:19:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f0125d9b700 1 -- 172.21.15.72:0/2945406735 learned_addr learned my addr 172.21.15.72:0/2945406735 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f012659c700 1 -- 172.21.15.72:0/2945406735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0128138d80 msgr2=0x7f012813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f012659c700 1 --2- 172.21.15.72:0/2945406735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0128138d80 0x7f012813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f012659c700 1 -- 172.21.15.72:0/2945406735 >> v1:172.21.15.72:6789/0 conn(0x7f012809d630 legacy=0x7f01280a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f012659c700 1 -- 172.21.15.72:0/2945406735 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012809dc50 con 0x7f01280a0a30 2023-10-03T10:19:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f0126d9d700 1 --2- 172.21.15.72:0/2945406735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0128138d80 0x7f012813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f012659c700 1 --2- 172.21.15.72:0/2945406735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01280a0a30 0x7f01280a0e00 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f0118009840 tx=0x7f0118009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c025889cc00aeb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f012559a700 1 -- 172.21.15.72:0/2945406735 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0118011830 con 0x7f01280a0a30 2023-10-03T10:19:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.164+0000 7f012559a700 1 -- 172.21.15.72:0/2945406735 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0118011990 con 0x7f01280a0a30 2023-10-03T10:19:15.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.165+0000 7f012559a700 1 -- 172.21.15.72:0/2945406735 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0118011d20 con 0x7f01280a0a30 2023-10-03T10:19:15.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.165+0000 7f012c929700 1 -- 172.21.15.72:0/2945406735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01280a0a30 msgr2=0x7f01280a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.165+0000 7f012c929700 1 --2- 172.21.15.72:0/2945406735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01280a0a30 0x7f01280a0e00 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f0118009840 tx=0x7f0118009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.165+0000 7f012c929700 1 -- 172.21.15.72:0/2945406735 shutdown_connections 2023-10-03T10:19:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.165+0000 7f012c929700 1 --2- 172.21.15.72:0/2945406735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0128138d80 0x7f012813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.165+0000 7f012c929700 1 --2- 172.21.15.72:0/2945406735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01280a0a30 0x7f01280a0e00 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.165+0000 7f012c929700 1 -- 172.21.15.72:0/2945406735 >> 172.21.15.72:0/2945406735 conn(0x7f01280a3050 msgr2=0x7f01280a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.165+0000 7f012c929700 1 -- 172.21.15.72:0/2945406735 shutdown_connections 2023-10-03T10:19:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.166+0000 7f012c929700 1 -- 172.21.15.72:0/2945406735 wait complete. 2023-10-03T10:19:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.167+0000 7f012c929700 1 Processor -- start 2023-10-03T10:19:15.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.167+0000 7f012c929700 1 -- start start 2023-10-03T10:19:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f012c929700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f012809d630 0x7f0128120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f012c929700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01280a0a30 0x7f0128120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f012c929700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0128138d80 0x7f0128121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f012c929700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0128123110 con 0x7f012809d630 2023-10-03T10:19:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f012c929700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0128122be0 con 0x7f01280a0a30 2023-10-03T10:19:15.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f012c929700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0128122310 con 0x7f0128138d80 2023-10-03T10:19:15.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f012659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f012809d630 0x7f0128120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f012659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f012809d630 0x7f0128120700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36202/0 (socket says 172.21.15.72:36202) 2023-10-03T10:19:15.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f012659c700 1 -- 172.21.15.72:0/1419521103 learned_addr learned my addr 172.21.15.72:0/1419521103 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:15.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f0125d9b700 1 --2- 172.21.15.72:0/1419521103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01280a0a30 0x7f0128120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f0126d9d700 1 --2- 172.21.15.72:0/1419521103 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0128138d80 0x7f0128121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f012659c700 1 -- 172.21.15.72:0/1419521103 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0128138d80 msgr2=0x7f0128121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f012659c700 1 --2- 172.21.15.72:0/1419521103 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0128138d80 0x7f0128121180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f012659c700 1 -- 172.21.15.72:0/1419521103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01280a0a30 msgr2=0x7f0128120c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f012659c700 1 --2- 172.21.15.72:0/1419521103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01280a0a30 0x7f0128120c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f012659c700 1 -- 172.21.15.72:0/1419521103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0120009a70 con 0x7f012809d630 2023-10-03T10:19:15.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f012659c700 1 --2- 172.21.15.72:0/1419521103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f012809d630 0x7f0128120700 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f01180090b0 tx=0x7f0118004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.168+0000 7f0116ffd700 1 -- 172.21.15.72:0/1419521103 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01180036a0 con 0x7f012809d630 2023-10-03T10:19:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.169+0000 7f0116ffd700 1 -- 172.21.15.72:0/1419521103 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011801f070 con 0x7f012809d630 2023-10-03T10:19:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.169+0000 7f012c929700 1 -- 172.21.15.72:0/1419521103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01180094a0 con 0x7f012809d630 2023-10-03T10:19:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.169+0000 7f0116ffd700 1 -- 172.21.15.72:0/1419521103 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0118003a40 con 0x7f012809d630 2023-10-03T10:19:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.169+0000 7f012c929700 1 -- 172.21.15.72:0/1419521103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01280a4ec0 con 0x7f012809d630 2023-10-03T10:19:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.170+0000 7f012c929700 1 -- 172.21.15.72:0/1419521103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01280a0470 con 0x7f012809d630 2023-10-03T10:19:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.170+0000 7f0116ffd700 1 -- 172.21.15.72:0/1419521103 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0118003ba0 con 0x7f012809d630 2023-10-03T10:19:15.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.170+0000 7f0116ffd700 1 -- 172.21.15.72:0/1419521103 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0118021070 con 0x7f012809d630 2023-10-03T10:19:15.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.178+0000 7f0116ffd700 1 -- 172.21.15.72:0/1419521103 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0118010d50 con 0x7f012809d630 2023-10-03T10:19:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.258+0000 7f9e9efed700 1 -- 172.21.15.72:0/2299134152 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9e981a6420 con 0x7f9e9809e410 2023-10-03T10:19:15.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.258+0000 7f9e957fa700 1 -- 172.21.15.72:0/2299134152 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f9e900076f0 con 0x7f9e9809e410 2023-10-03T10:19:15.258 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:15.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.261+0000 7f9e9efed700 1 -- 172.21.15.72:0/2299134152 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e9809e410 msgr2=0x7f9e981c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.261+0000 7f9e9efed700 1 --2- 172.21.15.72:0/2299134152 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e9809e410 0x7f9e981c8510 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009d90 tx=0x7f9e9000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.261+0000 7f9e9efed700 1 -- 172.21.15.72:0/2299134152 shutdown_connections 2023-10-03T10:19:15.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.261+0000 7f9e9efed700 1 --2- 172.21.15.72:0/2299134152 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9e9809e410 0x7f9e981c8510 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.261+0000 7f9e9efed700 1 --2- 172.21.15.72:0/2299134152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9809d6f0 0x7f9e981a5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.261+0000 7f9e9efed700 1 --2- 172.21.15.72:0/2299134152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9809e000 0x7f9e981c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.261+0000 7f9e9efed700 1 -- 172.21.15.72:0/2299134152 >> 172.21.15.72:0/2299134152 conn(0x7f9e98066f50 msgr2=0x7f9e980a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.261+0000 7f9e9efed700 1 -- 172.21.15.72:0/2299134152 shutdown_connections 2023-10-03T10:19:15.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.261+0000 7f9e9efed700 1 -- 172.21.15.72:0/2299134152 wait complete. 2023-10-03T10:19:15.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:15.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.311+0000 7fc40310c700 1 -- 172.21.15.72:0/3341515800 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc3fc074ea0 con 0x7fc3fc09e930 2023-10-03T10:19:15.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.311+0000 7fc3f97fa700 1 -- 172.21.15.72:0/3341515800 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc3f0017030 con 0x7fc3fc09e930 2023-10-03T10:19:15.311 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:15.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.314+0000 7fc40310c700 1 -- 172.21.15.72:0/3341515800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3fc09e930 msgr2=0x7fc3fc1a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.314+0000 7fc40310c700 1 --2- 172.21.15.72:0/3341515800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3fc09e930 0x7fc3fc1a3c40 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000e910 tx=0x7fc3f000ec20 comp rx=0 tx=0).stop 2023-10-03T10:19:15.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.314+0000 7fc40310c700 1 -- 172.21.15.72:0/3341515800 shutdown_connections 2023-10-03T10:19:15.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.314+0000 7fc40310c700 1 --2- 172.21.15.72:0/3341515800 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc3fc09f650 0x7fc3fc1a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.314+0000 7fc40310c700 1 --2- 172.21.15.72:0/3341515800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3fc09e930 0x7fc3fc1a3c40 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.314+0000 7fc40310c700 1 --2- 172.21.15.72:0/3341515800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3fc09f240 0x7fc3fc1a4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.314+0000 7fc40310c700 1 -- 172.21.15.72:0/3341515800 >> 172.21.15.72:0/3341515800 conn(0x7fc3fc0a4210 msgr2=0x7fc3fc1b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.314+0000 7fc40310c700 1 -- 172.21.15.72:0/3341515800 shutdown_connections 2023-10-03T10:19:15.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.314+0000 7fc40310c700 1 -- 172.21.15.72:0/3341515800 wait complete. 2023-10-03T10:19:15.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:15.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.380+0000 7f012c929700 1 -- 172.21.15.72:0/1419521103 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f01280747f0 con 0x7f012809d630 2023-10-03T10:19:15.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.380+0000 7f0116ffd700 1 -- 172.21.15.72:0/1419521103 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0118015070 con 0x7f012809d630 2023-10-03T10:19:15.380 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:15.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.382+0000 7f012c929700 1 -- 172.21.15.72:0/1419521103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f012809d630 msgr2=0x7f0128120700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.383+0000 7f012c929700 1 --2- 172.21.15.72:0/1419521103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f012809d630 0x7f0128120700 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f01180090b0 tx=0x7f0118004750 comp rx=0 tx=0).stop 2023-10-03T10:19:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.383+0000 7f012c929700 1 -- 172.21.15.72:0/1419521103 shutdown_connections 2023-10-03T10:19:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.383+0000 7f012c929700 1 --2- 172.21.15.72:0/1419521103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f012809d630 0x7f0128120700 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.383+0000 7f012c929700 1 --2- 172.21.15.72:0/1419521103 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0128138d80 0x7f0128121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.383+0000 7f012c929700 1 --2- 172.21.15.72:0/1419521103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01280a0a30 0x7f0128120c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.383+0000 7f012c929700 1 -- 172.21.15.72:0/1419521103 >> 172.21.15.72:0/1419521103 conn(0x7f01280a3050 msgr2=0x7f012809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.383+0000 7f012c929700 1 -- 172.21.15.72:0/1419521103 shutdown_connections 2023-10-03T10:19:15.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:15.383+0000 7f012c929700 1 -- 172.21.15.72:0/1419521103 wait complete. 2023-10-03T10:19:15.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:15.997 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.125+0000 7faf4fe23700 1 Processor -- start 2023-10-03T10:19:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.125+0000 7faf4fe23700 1 -- start start 2023-10-03T10:19:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4fe23700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf4809f410 0x7faf48136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4fe23700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf48136fe0 0x7faf481393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4fe23700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf48070940 con 0x7faf4809e930 2023-10-03T10:19:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4fe23700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4806fd60 con 0x7faf4809f410 2023-10-03T10:19:16.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4fe23700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf4806fa80 con 0x7faf48136fe0 2023-10-03T10:19:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4d3be700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf4809f410 0x7faf48136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4e3c0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf48136fe0 0x7faf481393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4e3c0700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf48136fe0 0x7faf481393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46122/0 (socket says 172.21.15.72:46122) 2023-10-03T10:19:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4d3be700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf4809f410 0x7faf48136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36218/0 (socket says 172.21.15.72:36218) 2023-10-03T10:19:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4e3c0700 1 -- 172.21.15.72:0/1037044949 learned_addr learned my addr 172.21.15.72:0/1037044949 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4d3be700 1 -- 172.21.15.72:0/1037044949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf48136fe0 msgr2=0x7faf481393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4d3be700 1 --2- 172.21.15.72:0/1037044949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf48136fe0 0x7faf481393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4d3be700 1 -- 172.21.15.72:0/1037044949 >> v1:172.21.15.72:6789/0 conn(0x7faf4809e930 legacy=0x7faf4809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4d3be700 1 -- 172.21.15.72:0/1037044949 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4809fb60 con 0x7faf4809f410 2023-10-03T10:19:16.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4cbbd700 1 -- 172.21.15.72:0/1037044949 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302072371 0 0) 0x7faf48070940 con 0x7faf4809e930 2023-10-03T10:19:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4e3c0700 1 --2- 172.21.15.72:0/1037044949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf48136fe0 0x7faf481393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4d3be700 1 --2- 172.21.15.72:0/1037044949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4809f410 0x7faf48136aa0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7faf44009840 tx=0x7faf44009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e633df29164a8a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4cbbd700 1 -- 172.21.15.72:0/1037044949 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf44011830 con 0x7faf4809f410 2023-10-03T10:19:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4cbbd700 1 -- 172.21.15.72:0/1037044949 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf44011990 con 0x7faf4809f410 2023-10-03T10:19:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.126+0000 7faf4cbbd700 1 -- 172.21.15.72:0/1037044949 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf44011d20 con 0x7faf4809f410 2023-10-03T10:19:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.127+0000 7faf4fe23700 1 -- 172.21.15.72:0/1037044949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4809f410 msgr2=0x7faf48136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.127+0000 7faf4fe23700 1 --2- 172.21.15.72:0/1037044949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4809f410 0x7faf48136aa0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7faf44009840 tx=0x7faf44009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.127+0000 7faf4fe23700 1 -- 172.21.15.72:0/1037044949 shutdown_connections 2023-10-03T10:19:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.127+0000 7faf4fe23700 1 --2- 172.21.15.72:0/1037044949 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf48136fe0 0x7faf481393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.127+0000 7faf4fe23700 1 --2- 172.21.15.72:0/1037044949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4809f410 0x7faf48136aa0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.127+0000 7faf4fe23700 1 -- 172.21.15.72:0/1037044949 >> 172.21.15.72:0/1037044949 conn(0x7faf480a4210 msgr2=0x7faf480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.127+0000 7faf4fe23700 1 -- 172.21.15.72:0/1037044949 shutdown_connections 2023-10-03T10:19:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.127+0000 7faf4fe23700 1 -- 172.21.15.72:0/1037044949 wait complete. 2023-10-03T10:19:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.128+0000 7faf4fe23700 1 Processor -- start 2023-10-03T10:19:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.128+0000 7faf4fe23700 1 -- start start 2023-10-03T10:19:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.128+0000 7faf4fe23700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4809e930 0x7faf481c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.128+0000 7faf4fe23700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf4809f410 0x7faf481c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.128+0000 7faf4fe23700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf48136fe0 0x7faf4806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.128+0000 7faf4fe23700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf48132270 con 0x7faf4809e930 2023-10-03T10:19:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.128+0000 7faf4fe23700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4809de80 con 0x7faf4809f410 2023-10-03T10:19:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.128+0000 7faf4fe23700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf481bc160 con 0x7faf48136fe0 2023-10-03T10:19:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.128+0000 7faf4dbbf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4809e930 0x7faf481c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf4dbbf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4809e930 0x7faf481c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36228/0 (socket says 172.21.15.72:36228) 2023-10-03T10:19:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf4dbbf700 1 -- 172.21.15.72:0/1042473276 learned_addr learned my addr 172.21.15.72:0/1042473276 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf4e3c0700 1 --2- 172.21.15.72:0/1042473276 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf48136fe0 0x7faf4806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf4d3be700 1 --2- 172.21.15.72:0/1042473276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf4809f410 0x7faf481c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf4dbbf700 1 -- 172.21.15.72:0/1042473276 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf48136fe0 msgr2=0x7faf4806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf4dbbf700 1 --2- 172.21.15.72:0/1042473276 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf48136fe0 0x7faf4806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf4dbbf700 1 -- 172.21.15.72:0/1042473276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf4809f410 msgr2=0x7faf481c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf4dbbf700 1 --2- 172.21.15.72:0/1042473276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf4809f410 0x7faf481c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf4dbbf700 1 -- 172.21.15.72:0/1042473276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf40009b30 con 0x7faf4809e930 2023-10-03T10:19:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf4d3be700 1 --2- 172.21.15.72:0/1042473276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf4809f410 0x7faf481c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf4dbbf700 1 --2- 172.21.15.72:0/1042473276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4809e930 0x7faf481c84d0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7faf38001eb0 tx=0x7faf3800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf3e7fc700 1 -- 172.21.15.72:0/1042473276 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf380054e0 con 0x7faf4809e930 2023-10-03T10:19:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf3e7fc700 1 -- 172.21.15.72:0/1042473276 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf38003680 con 0x7faf4809e930 2023-10-03T10:19:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf4fe23700 1 -- 172.21.15.72:0/1042473276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf440094a0 con 0x7faf4809e930 2023-10-03T10:19:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf3e7fc700 1 -- 172.21.15.72:0/1042473276 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf380039f0 con 0x7faf4809e930 2023-10-03T10:19:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.129+0000 7faf4fe23700 1 -- 172.21.15.72:0/1042473276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf481c8f50 con 0x7faf4809e930 2023-10-03T10:19:16.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.130+0000 7faf3e7fc700 1 -- 172.21.15.72:0/1042473276 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf38003b50 con 0x7faf4809e930 2023-10-03T10:19:16.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.130+0000 7faf3e7fc700 1 -- 172.21.15.72:0/1042473276 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faf3803ea30 con 0x7faf4809e930 2023-10-03T10:19:16.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.130+0000 7faf4fe23700 1 -- 172.21.15.72:0/1042473276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf48074ea0 con 0x7faf4809e930 2023-10-03T10:19:16.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.135+0000 7faf3e7fc700 1 -- 172.21.15.72:0/1042473276 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf3801b3b0 con 0x7faf4809e930 2023-10-03T10:19:16.274 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:16.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.322+0000 7faf4fe23700 1 -- 172.21.15.72:0/1042473276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faf480008d0 con 0x7faf4809e930 2023-10-03T10:19:16.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.323+0000 7faf3e7fc700 1 -- 172.21.15.72:0/1042473276 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf38017020 con 0x7faf4809e930 2023-10-03T10:19:16.322 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.325+0000 7faf4fe23700 1 -- 172.21.15.72:0/1042473276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4809e930 msgr2=0x7faf481c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.325+0000 7faf4fe23700 1 --2- 172.21.15.72:0/1042473276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4809e930 0x7faf481c84d0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7faf38001eb0 tx=0x7faf3800c800 comp rx=0 tx=0).stop 2023-10-03T10:19:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.325+0000 7faf4fe23700 1 -- 172.21.15.72:0/1042473276 shutdown_connections 2023-10-03T10:19:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.325+0000 7faf4fe23700 1 --2- 172.21.15.72:0/1042473276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf4809e930 0x7faf481c84d0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.325+0000 7faf4fe23700 1 --2- 172.21.15.72:0/1042473276 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7faf48136fe0 0x7faf4806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.325+0000 7faf4fe23700 1 --2- 172.21.15.72:0/1042473276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf4809f410 0x7faf481c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.325+0000 7faf4fe23700 1 -- 172.21.15.72:0/1042473276 >> 172.21.15.72:0/1042473276 conn(0x7faf480a4210 msgr2=0x7faf48134b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.325+0000 7faf4fe23700 1 -- 172.21.15.72:0/1042473276 shutdown_connections 2023-10-03T10:19:16.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.325+0000 7faf4fe23700 1 -- 172.21.15.72:0/1042473276 wait complete. 2023-10-03T10:19:16.327 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:16.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:16.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:16.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.403+0000 7f6c9a12b700 1 Processor -- start 2023-10-03T10:19:16.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.403+0000 7f6c9a12b700 1 -- start start 2023-10-03T10:19:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c9a12b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c94133540 0x7f6c94135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c9a12b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c94135e60 0x7f6c94138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c9a12b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c940716a0 con 0x7f6c94130540 2023-10-03T10:19:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c9a12b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c94071290 con 0x7f6c94133540 2023-10-03T10:19:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c9a12b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c94130340 con 0x7f6c94135e60 2023-10-03T10:19:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c92ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c94133540 0x7f6c94135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c93fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c94135e60 0x7f6c94138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c937fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6c94130540 0x7f6c94130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54694/0 (socket says 172.21.15.72:54694) 2023-10-03T10:19:16.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c937fe700 1 -- 172.21.15.72:0/2855445742 learned_addr learned my addr 172.21.15.72:0/2855445742 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:16.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c93fff700 1 -- 172.21.15.72:0/2855445742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c94133540 msgr2=0x7f6c94135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:16.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c93fff700 1 --2- 172.21.15.72:0/2855445742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c94133540 0x7f6c94135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c93fff700 1 -- 172.21.15.72:0/2855445742 >> v1:172.21.15.72:6789/0 conn(0x7f6c94130540 legacy=0x7f6c94130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c93fff700 1 -- 172.21.15.72:0/2855445742 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c94070b80 con 0x7f6c94135e60 2023-10-03T10:19:16.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c927fc700 1 -- 172.21.15.72:0/2855445742 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903292370 0 0) 0x7f6c940716a0 con 0x7f6c94130540 2023-10-03T10:19:16.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c92ffd700 1 --2- 172.21.15.72:0/2855445742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c94133540 0x7f6c94135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.404+0000 7f6c93fff700 1 --2- 172.21.15.72:0/2855445742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c94135e60 0x7f6c94138240 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00f3a0 tx=0x7f6c8c00f6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58480ea5e4548f23 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.405+0000 7f6c927fc700 1 -- 172.21.15.72:0/2855445742 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c012070 con 0x7f6c94135e60 2023-10-03T10:19:16.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.405+0000 7f6c927fc700 1 -- 172.21.15.72:0/2855445742 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8c00d0d0 con 0x7f6c94135e60 2023-10-03T10:19:16.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.405+0000 7f6c927fc700 1 -- 172.21.15.72:0/2855445742 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c00fea0 con 0x7f6c94135e60 2023-10-03T10:19:16.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.405+0000 7f6c9a12b700 1 -- 172.21.15.72:0/2855445742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c94135e60 msgr2=0x7f6c94138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.405+0000 7f6c9a12b700 1 --2- 172.21.15.72:0/2855445742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c94135e60 0x7f6c94138240 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c00f3a0 tx=0x7f6c8c00f6b0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.405+0000 7f6c9a12b700 1 -- 172.21.15.72:0/2855445742 shutdown_connections 2023-10-03T10:19:16.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.405+0000 7f6c9a12b700 1 --2- 172.21.15.72:0/2855445742 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c94135e60 0x7f6c94138240 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.405+0000 7f6c9a12b700 1 --2- 172.21.15.72:0/2855445742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c94133540 0x7f6c94135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.405+0000 7f6c9a12b700 1 -- 172.21.15.72:0/2855445742 >> 172.21.15.72:0/2855445742 conn(0x7f6c940a2aa0 msgr2=0x7f6c940a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.405+0000 7f6c9a12b700 1 -- 172.21.15.72:0/2855445742 shutdown_connections 2023-10-03T10:19:16.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.406+0000 7f6c9a12b700 1 -- 172.21.15.72:0/2855445742 wait complete. 2023-10-03T10:19:16.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.407+0000 7f6c9a12b700 1 Processor -- start 2023-10-03T10:19:16.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.407+0000 7f6c9a12b700 1 -- start start 2023-10-03T10:19:16.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c9a12b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c94130540 0x7f6c9409c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c9a12b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c94133540 0x7f6c9409ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c9a12b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c94135e60 0x7f6c9409cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c9a12b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9409e0f0 con 0x7f6c94130540 2023-10-03T10:19:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c9a12b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c94119a00 con 0x7f6c94133540 2023-10-03T10:19:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c9a12b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c94118f80 con 0x7f6c94135e60 2023-10-03T10:19:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c94130540 0x7f6c9409c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c94130540 0x7f6c9409c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36238/0 (socket says 172.21.15.72:36238) 2023-10-03T10:19:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c92ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c94133540 0x7f6c9409ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c937fe700 1 -- 172.21.15.72:0/2873961265 learned_addr learned my addr 172.21.15.72:0/2873961265 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c93fff700 1 --2- 172.21.15.72:0/2873961265 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c94135e60 0x7f6c9409cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c937fe700 1 -- 172.21.15.72:0/2873961265 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c94135e60 msgr2=0x7f6c9409cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c937fe700 1 --2- 172.21.15.72:0/2873961265 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c94135e60 0x7f6c9409cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c937fe700 1 -- 172.21.15.72:0/2873961265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c94133540 msgr2=0x7f6c9409ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c937fe700 1 --2- 172.21.15.72:0/2873961265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c94133540 0x7f6c9409ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c937fe700 1 -- 172.21.15.72:0/2873961265 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8800b550 con 0x7f6c94130540 2023-10-03T10:19:16.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c92ffd700 1 --2- 172.21.15.72:0/2873961265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c94133540 0x7f6c9409ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c93fff700 1 --2- 172.21.15.72:0/2873961265 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c94135e60 0x7f6c9409cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c937fe700 1 --2- 172.21.15.72:0/2873961265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c94130540 0x7f6c9409c530 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400c550 tx=0x7f6c8400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.408+0000 7f6c7bfff700 1 -- 172.21.15.72:0/2873961265 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c84004c80 con 0x7f6c94130540 2023-10-03T10:19:16.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.409+0000 7f6c7bfff700 1 -- 172.21.15.72:0/2873961265 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c84004de0 con 0x7f6c94130540 2023-10-03T10:19:16.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.409+0000 7f6c7bfff700 1 -- 172.21.15.72:0/2873961265 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c84007310 con 0x7f6c94130540 2023-10-03T10:19:16.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.409+0000 7f6c9a12b700 1 -- 172.21.15.72:0/2873961265 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8c00f050 con 0x7f6c94130540 2023-10-03T10:19:16.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.409+0000 7f6c9a12b700 1 -- 172.21.15.72:0/2873961265 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c94135930 con 0x7f6c94130540 2023-10-03T10:19:16.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.410+0000 7f6c9a12b700 1 -- 172.21.15.72:0/2873961265 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c94074ea0 con 0x7f6c94130540 2023-10-03T10:19:16.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.410+0000 7f6c7bfff700 1 -- 172.21.15.72:0/2873961265 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c84007470 con 0x7f6c94130540 2023-10-03T10:19:16.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.410+0000 7f6c7bfff700 1 -- 172.21.15.72:0/2873961265 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6c8403f220 con 0x7f6c94130540 2023-10-03T10:19:16.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.414+0000 7f6c7bfff700 1 -- 172.21.15.72:0/2873961265 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c840133c0 con 0x7f6c94130540 2023-10-03T10:19:16.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.457+0000 7fa04ab2d700 1 Processor -- start 2023-10-03T10:19:16.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.457+0000 7fa04ab2d700 1 -- start start 2023-10-03T10:19:16.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa04ab2d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa04409d6f0 0x7fa04409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa04ab2d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa04409e440 0x7fa044134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa04ab2d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04409b120 con 0x7fa04409e000 2023-10-03T10:19:16.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa04ab2d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04406b460 con 0x7fa04409d6f0 2023-10-03T10:19:16.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa04ab2d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04409a7e0 con 0x7fa04409e440 2023-10-03T10:19:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa0488c9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa04409d6f0 0x7fa04409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa0490ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa04409e440 0x7fa044134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa0488c9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa04409d6f0 0x7fa04409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36254/0 (socket says 172.21.15.72:36254) 2023-10-03T10:19:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa043fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa04409e000 0x7fa0441339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54700/0 (socket says 172.21.15.72:54700) 2023-10-03T10:19:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa0488c9700 1 -- 172.21.15.72:0/4086609049 learned_addr learned my addr 172.21.15.72:0/4086609049 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa0490ca700 1 -- 172.21.15.72:0/4086609049 >> v2:172.21.15.72:3300/0 conn(0x7fa04409d6f0 msgr2=0x7fa04409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa0490ca700 1 --2- 172.21.15.72:0/4086609049 >> v2:172.21.15.72:3300/0 conn(0x7fa04409d6f0 0x7fa04409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa0490ca700 1 -- 172.21.15.72:0/4086609049 >> v1:172.21.15.72:6789/0 conn(0x7fa04409e000 legacy=0x7fa0441339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa0490ca700 1 -- 172.21.15.72:0/4086609049 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04409a500 con 0x7fa04409e440 2023-10-03T10:19:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa0437fe700 1 -- 172.21.15.72:0/4086609049 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077573313 0 0) 0x7fa04409b120 con 0x7fa04409e000 2023-10-03T10:19:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa0488c9700 1 --2- 172.21.15.72:0/4086609049 >> v2:172.21.15.72:3300/0 conn(0x7fa04409d6f0 0x7fa04409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.458+0000 7fa0490ca700 1 --2- 172.21.15.72:0/4086609049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa04409e440 0x7fa044134100 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009dc0 tx=0x7fa03c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2243082ab48ec23a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.459+0000 7fa0437fe700 1 -- 172.21.15.72:0/4086609049 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00e070 con 0x7fa04409e440 2023-10-03T10:19:16.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.459+0000 7fa0437fe700 1 -- 172.21.15.72:0/4086609049 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c00bae0 con 0x7fa04409e440 2023-10-03T10:19:16.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.459+0000 7fa0437fe700 1 -- 172.21.15.72:0/4086609049 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00be90 con 0x7fa04409e440 2023-10-03T10:19:16.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.459+0000 7fa04ab2d700 1 -- 172.21.15.72:0/4086609049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa04409e440 msgr2=0x7fa044134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.459+0000 7fa04ab2d700 1 --2- 172.21.15.72:0/4086609049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa04409e440 0x7fa044134100 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009dc0 tx=0x7fa03c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:16.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.459+0000 7fa04ab2d700 1 -- 172.21.15.72:0/4086609049 shutdown_connections 2023-10-03T10:19:16.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.459+0000 7fa04ab2d700 1 --2- 172.21.15.72:0/4086609049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa04409e440 0x7fa044134100 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.459+0000 7fa04ab2d700 1 --2- 172.21.15.72:0/4086609049 >> v2:172.21.15.72:3300/0 conn(0x7fa04409d6f0 0x7fa04409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.459+0000 7fa04ab2d700 1 -- 172.21.15.72:0/4086609049 >> 172.21.15.72:0/4086609049 conn(0x7fa044066f50 msgr2=0x7fa04409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.459+0000 7fa04ab2d700 1 -- 172.21.15.72:0/4086609049 shutdown_connections 2023-10-03T10:19:16.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.459+0000 7fa04ab2d700 1 -- 172.21.15.72:0/4086609049 wait complete. 2023-10-03T10:19:16.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.460+0000 7fa04ab2d700 1 Processor -- start 2023-10-03T10:19:16.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.460+0000 7fa04ab2d700 1 -- start start 2023-10-03T10:19:16.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa04ab2d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa04409d6f0 0x7fa0441a4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa04ab2d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa04409e000 0x7fa0441a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa04ab2d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa04409e440 0x7fa0441c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa04ab2d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0441a52c0 con 0x7fa04409e000 2023-10-03T10:19:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa04ab2d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0441b8040 con 0x7fa04409d6f0 2023-10-03T10:19:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa04ab2d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa04409c710 con 0x7fa04409e440 2023-10-03T10:19:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa0488c9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa04409d6f0 0x7fa0441a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa0488c9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa04409d6f0 0x7fa0441a4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42160/0 (socket says 172.21.15.72:42160) 2023-10-03T10:19:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa0488c9700 1 -- 172.21.15.72:0/1762447344 learned_addr learned my addr 172.21.15.72:0/1762447344 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa043fff700 1 --2- 172.21.15.72:0/1762447344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa04409e000 0x7fa0441a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa0490ca700 1 --2- 172.21.15.72:0/1762447344 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa04409e440 0x7fa0441c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa0488c9700 1 -- 172.21.15.72:0/1762447344 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa04409e440 msgr2=0x7fa0441c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa0488c9700 1 --2- 172.21.15.72:0/1762447344 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa04409e440 0x7fa0441c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa0488c9700 1 -- 172.21.15.72:0/1762447344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa04409e000 msgr2=0x7fa0441a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa0488c9700 1 --2- 172.21.15.72:0/1762447344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa04409e000 0x7fa0441a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa0488c9700 1 -- 172.21.15.72:0/1762447344 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa038009550 con 0x7fa04409d6f0 2023-10-03T10:19:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa0488c9700 1 --2- 172.21.15.72:0/1762447344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa04409d6f0 0x7fa0441a4160 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa03800ec10 tx=0x7fa03800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.461+0000 7fa0417fa700 1 -- 172.21.15.72:0/1762447344 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800c850 con 0x7fa04409d6f0 2023-10-03T10:19:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.462+0000 7fa0417fa700 1 -- 172.21.15.72:0/1762447344 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03800c9b0 con 0x7fa04409d6f0 2023-10-03T10:19:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.462+0000 7fa04ab2d700 1 -- 172.21.15.72:0/1762447344 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c009a70 con 0x7fa04409d6f0 2023-10-03T10:19:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.462+0000 7fa0417fa700 1 -- 172.21.15.72:0/1762447344 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03800cd20 con 0x7fa04409d6f0 2023-10-03T10:19:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.462+0000 7fa04ab2d700 1 -- 172.21.15.72:0/1762447344 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0441a5ab0 con 0x7fa04409d6f0 2023-10-03T10:19:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.462+0000 7fa0417fa700 1 -- 172.21.15.72:0/1762447344 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa038013470 con 0x7fa04409d6f0 2023-10-03T10:19:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.462+0000 7fa0417fa700 1 -- 172.21.15.72:0/1762447344 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa03803f7e0 con 0x7fa04409d6f0 2023-10-03T10:19:16.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.463+0000 7fa04ab2d700 1 -- 172.21.15.72:0/1762447344 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa044074ea0 con 0x7fa04409d6f0 2023-10-03T10:19:16.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.467+0000 7fa0417fa700 1 -- 172.21.15.72:0/1762447344 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa038013720 con 0x7fa04409d6f0 2023-10-03T10:19:16.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.522+0000 7fbb1b47b700 1 Processor -- start 2023-10-03T10:19:16.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.522+0000 7fbb1b47b700 1 -- start start 2023-10-03T10:19:16.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.523+0000 7fbb1b47b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb141316c0 0x7fbb14131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.523+0000 7fbb1b47b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb1409d9f0 0x7fbb1406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.523+0000 7fbb1b47b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1409e130 con 0x7fbb1406acb0 2023-10-03T10:19:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.523+0000 7fbb1b47b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb141312b0 con 0x7fbb141316c0 2023-10-03T10:19:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.523+0000 7fbb1b47b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1409f6e0 con 0x7fbb1409d9f0 2023-10-03T10:19:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.523+0000 7fbb19217700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb141316c0 0x7fbb14131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.523+0000 7fbb19217700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb141316c0 0x7fbb14131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36278/0 (socket says 172.21.15.72:36278) 2023-10-03T10:19:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.523+0000 7fbb19217700 1 -- 172.21.15.72:0/1546304479 learned_addr learned my addr 172.21.15.72:0/1546304479 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.523+0000 7fbb18a16700 1 --2- 172.21.15.72:0/1546304479 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb1409d9f0 0x7fbb1406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.524+0000 7fbb19217700 1 -- 172.21.15.72:0/1546304479 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb1409d9f0 msgr2=0x7fbb1406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.524+0000 7fbb19217700 1 --2- 172.21.15.72:0/1546304479 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb1409d9f0 0x7fbb1406a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.524+0000 7fbb19217700 1 -- 172.21.15.72:0/1546304479 >> v1:172.21.15.72:6789/0 conn(0x7fbb1406acb0 legacy=0x7fbb14138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.524+0000 7fbb19217700 1 -- 172.21.15.72:0/1546304479 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1409e760 con 0x7fbb141316c0 2023-10-03T10:19:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.524+0000 7fbb0bfff700 1 -- 172.21.15.72:0/1546304479 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837347122 0 0) 0x7fbb0c001490 con 0x7fbb1406acb0 2023-10-03T10:19:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.524+0000 7fbb18a16700 1 --2- 172.21.15.72:0/1546304479 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb1409d9f0 0x7fbb1406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.524+0000 7fbb19217700 1 --2- 172.21.15.72:0/1546304479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb141316c0 0x7fbb14131a90 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fbb100098f0 tx=0x7fbb10009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c876f31250c7d751 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.524+0000 7fbb0bfff700 1 -- 172.21.15.72:0/1546304479 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10011830 con 0x7fbb141316c0 2023-10-03T10:19:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.524+0000 7fbb0bfff700 1 -- 172.21.15.72:0/1546304479 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb10011990 con 0x7fbb141316c0 2023-10-03T10:19:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.524+0000 7fbb0bfff700 1 -- 172.21.15.72:0/1546304479 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10011d20 con 0x7fbb141316c0 2023-10-03T10:19:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.525+0000 7fbb1b47b700 1 -- 172.21.15.72:0/1546304479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb141316c0 msgr2=0x7fbb14131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.525+0000 7fbb1b47b700 1 --2- 172.21.15.72:0/1546304479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb141316c0 0x7fbb14131a90 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fbb100098f0 tx=0x7fbb10009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.525+0000 7fbb1b47b700 1 -- 172.21.15.72:0/1546304479 shutdown_connections 2023-10-03T10:19:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.525+0000 7fbb1b47b700 1 --2- 172.21.15.72:0/1546304479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb141316c0 0x7fbb14131a90 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.525+0000 7fbb1b47b700 1 --2- 172.21.15.72:0/1546304479 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb1409d9f0 0x7fbb1406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.525+0000 7fbb1b47b700 1 -- 172.21.15.72:0/1546304479 >> 172.21.15.72:0/1546304479 conn(0x7fbb14066f50 msgr2=0x7fbb1409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.525+0000 7fbb1b47b700 1 -- 172.21.15.72:0/1546304479 shutdown_connections 2023-10-03T10:19:16.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.525+0000 7fbb1b47b700 1 -- 172.21.15.72:0/1546304479 wait complete. 2023-10-03T10:19:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.526+0000 7fbb1b47b700 1 Processor -- start 2023-10-03T10:19:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.526+0000 7fbb1b47b700 1 -- start start 2023-10-03T10:19:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb1b47b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb1406acb0 0x7fbb141c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb1b47b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb1409d9f0 0x7fbb141c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb1b47b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb141316c0 0x7fbb14070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb1b47b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1409bc70 con 0x7fbb141316c0 2023-10-03T10:19:16.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb1b47b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1412b900 con 0x7fbb1409d9f0 2023-10-03T10:19:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb1b47b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1409bec0 con 0x7fbb1406acb0 2023-10-03T10:19:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb18a16700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb1409d9f0 0x7fbb141c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb18a16700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb1409d9f0 0x7fbb141c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42176/0 (socket says 172.21.15.72:42176) 2023-10-03T10:19:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb18a16700 1 -- 172.21.15.72:0/3816466575 learned_addr learned my addr 172.21.15.72:0/3816466575 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb19217700 1 --2- 172.21.15.72:0/3816466575 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb1406acb0 0x7fbb141c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb19a18700 1 --2- 172.21.15.72:0/3816466575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb141316c0 0x7fbb14070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb19217700 1 -- 172.21.15.72:0/3816466575 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb1409d9f0 msgr2=0x7fbb141c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb19217700 1 --2- 172.21.15.72:0/3816466575 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb1409d9f0 0x7fbb141c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb19217700 1 -- 172.21.15.72:0/3816466575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb141316c0 msgr2=0x7fbb14070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb19217700 1 --2- 172.21.15.72:0/3816466575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb141316c0 0x7fbb14070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb19217700 1 -- 172.21.15.72:0/3816466575 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb040094a0 con 0x7fbb1406acb0 2023-10-03T10:19:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.527+0000 7fbb19217700 1 --2- 172.21.15.72:0/3816466575 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb1406acb0 0x7fbb141c85a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fbb10016000 tx=0x7fbb10004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.528+0000 7fbb09ffb700 1 -- 172.21.15.72:0/3816466575 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10004300 con 0x7fbb1406acb0 2023-10-03T10:19:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.528+0000 7fbb09ffb700 1 -- 172.21.15.72:0/3816466575 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1001f070 con 0x7fbb1406acb0 2023-10-03T10:19:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.528+0000 7fbb1b47b700 1 -- 172.21.15.72:0/3816466575 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb10009550 con 0x7fbb1406acb0 2023-10-03T10:19:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.528+0000 7fbb09ffb700 1 -- 172.21.15.72:0/3816466575 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb100036a0 con 0x7fbb1406acb0 2023-10-03T10:19:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.528+0000 7fbb1b47b700 1 -- 172.21.15.72:0/3816466575 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1409ead0 con 0x7fbb1406acb0 2023-10-03T10:19:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.529+0000 7fbb09ffb700 1 -- 172.21.15.72:0/3816466575 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb10021030 con 0x7fbb1406acb0 2023-10-03T10:19:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.529+0000 7fbb09ffb700 1 -- 172.21.15.72:0/3816466575 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbb100408f0 con 0x7fbb1406acb0 2023-10-03T10:19:16.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.529+0000 7fbb1b47b700 1 -- 172.21.15.72:0/3816466575 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb14074ea0 con 0x7fbb1406acb0 2023-10-03T10:19:16.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.534+0000 7fbb09ffb700 1 -- 172.21.15.72:0/3816466575 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb10015070 con 0x7fbb1406acb0 2023-10-03T10:19:16.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.612+0000 7f6c9a12b700 1 -- 172.21.15.72:0/2873961265 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6c9406b9e0 con 0x7f6c94130540 2023-10-03T10:19:16.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.612+0000 7f6c7bfff700 1 -- 172.21.15.72:0/2873961265 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f6c84011360 con 0x7f6c94130540 2023-10-03T10:19:16.612 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.614+0000 7f6c9a12b700 1 -- 172.21.15.72:0/2873961265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c94130540 msgr2=0x7f6c9409c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.614+0000 7f6c9a12b700 1 --2- 172.21.15.72:0/2873961265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c94130540 0x7f6c9409c530 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400c550 tx=0x7f6c8400c860 comp rx=0 tx=0).stop 2023-10-03T10:19:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.614+0000 7f6c9a12b700 1 -- 172.21.15.72:0/2873961265 shutdown_connections 2023-10-03T10:19:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.614+0000 7f6c9a12b700 1 --2- 172.21.15.72:0/2873961265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c94130540 0x7f6c9409c530 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.614+0000 7f6c9a12b700 1 --2- 172.21.15.72:0/2873961265 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f6c94135e60 0x7f6c9409cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.614+0000 7f6c9a12b700 1 --2- 172.21.15.72:0/2873961265 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c94133540 0x7f6c9409ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.614+0000 7f6c9a12b700 1 -- 172.21.15.72:0/2873961265 >> 172.21.15.72:0/2873961265 conn(0x7f6c940a2aa0 msgr2=0x7f6c940a0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.615+0000 7f6c9a12b700 1 -- 172.21.15.72:0/2873961265 shutdown_connections 2023-10-03T10:19:16.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.615+0000 7f6c9a12b700 1 -- 172.21.15.72:0/2873961265 wait complete. 2023-10-03T10:19:16.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.664+0000 7fa04ab2d700 1 -- 172.21.15.72:0/1762447344 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa04409f420 con 0x7fa04409d6f0 2023-10-03T10:19:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.664+0000 7fa0417fa700 1 -- 172.21.15.72:0/1762447344 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fa038021020 con 0x7fa04409d6f0 2023-10-03T10:19:16.663 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.666+0000 7fa04ab2d700 1 -- 172.21.15.72:0/1762447344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa04409d6f0 msgr2=0x7fa0441a4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.666+0000 7fa04ab2d700 1 --2- 172.21.15.72:0/1762447344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa04409d6f0 0x7fa0441a4160 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa03800ec10 tx=0x7fa03800ef20 comp rx=0 tx=0).stop 2023-10-03T10:19:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.666+0000 7fa04ab2d700 1 -- 172.21.15.72:0/1762447344 shutdown_connections 2023-10-03T10:19:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.666+0000 7fa04ab2d700 1 --2- 172.21.15.72:0/1762447344 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fa04409e440 0x7fa0441c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.666+0000 7fa04ab2d700 1 --2- 172.21.15.72:0/1762447344 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa04409d6f0 0x7fa0441a4160 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.666+0000 7fa04ab2d700 1 --2- 172.21.15.72:0/1762447344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa04409e000 0x7fa0441a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.666+0000 7fa04ab2d700 1 -- 172.21.15.72:0/1762447344 >> 172.21.15.72:0/1762447344 conn(0x7fa044066f50 msgr2=0x7fa0440a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.666+0000 7fa04ab2d700 1 -- 172.21.15.72:0/1762447344 shutdown_connections 2023-10-03T10:19:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.666+0000 7fa04ab2d700 1 -- 172.21.15.72:0/1762447344 wait complete. 2023-10-03T10:19:16.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:16.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.729+0000 7fbb1b47b700 1 -- 172.21.15.72:0/3816466575 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb1406c360 con 0x7fbb1406acb0 2023-10-03T10:19:16.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.729+0000 7fbb09ffb700 1 -- 172.21.15.72:0/3816466575 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb100239c0 con 0x7fbb1406acb0 2023-10-03T10:19:16.729 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:16.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.731+0000 7fbb1b47b700 1 -- 172.21.15.72:0/3816466575 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb1406acb0 msgr2=0x7fbb141c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.731+0000 7fbb1b47b700 1 --2- 172.21.15.72:0/3816466575 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb1406acb0 0x7fbb141c85a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fbb10016000 tx=0x7fbb10004750 comp rx=0 tx=0).stop 2023-10-03T10:19:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.731+0000 7fbb1b47b700 1 -- 172.21.15.72:0/3816466575 shutdown_connections 2023-10-03T10:19:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.731+0000 7fbb1b47b700 1 --2- 172.21.15.72:0/3816466575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb141316c0 0x7fbb14070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.731+0000 7fbb1b47b700 1 --2- 172.21.15.72:0/3816466575 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fbb1406acb0 0x7fbb141c85a0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.731+0000 7fbb1b47b700 1 --2- 172.21.15.72:0/3816466575 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb1409d9f0 0x7fbb141c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.731+0000 7fbb1b47b700 1 -- 172.21.15.72:0/3816466575 >> 172.21.15.72:0/3816466575 conn(0x7fbb14066f50 msgr2=0x7fbb140a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.732+0000 7fbb1b47b700 1 -- 172.21.15.72:0/3816466575 shutdown_connections 2023-10-03T10:19:16.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:16.732+0000 7fbb1b47b700 1 -- 172.21.15.72:0/3816466575 wait complete. 2023-10-03T10:19:16.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:17.338 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:17.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.467+0000 7f276e86f700 1 Processor -- start 2023-10-03T10:19:17.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.467+0000 7f276e86f700 1 -- start start 2023-10-03T10:19:17.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.467+0000 7f276e86f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276809d6f0 0x7f276809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.467+0000 7f276e86f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276809e000 0x7f27681339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.467+0000 7f276e86f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f276809e410 0x7f2768133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.467+0000 7f276e86f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276806b460 con 0x7f276809e410 2023-10-03T10:19:17.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.467+0000 7f276e86f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276809b120 con 0x7f276809e000 2023-10-03T10:19:17.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.467+0000 7f276e86f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f276809a7e0 con 0x7f276809d6f0 2023-10-03T10:19:17.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.467+0000 7f2767fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276809d6f0 0x7f276809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.467+0000 7f27677fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276809e000 0x7f27681339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.468+0000 7f2767fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276809d6f0 0x7f276809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46192/0 (socket says 172.21.15.72:46192) 2023-10-03T10:19:17.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.468+0000 7f27677fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276809e000 0x7f27681339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42180/0 (socket says 172.21.15.72:42180) 2023-10-03T10:19:17.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.468+0000 7f276ce0c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f276809e410 0x7f2768133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.468+0000 7f2767fff700 1 -- 172.21.15.72:0/610708802 learned_addr learned my addr 172.21.15.72:0/610708802 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:17.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.468+0000 7f2767fff700 1 -- 172.21.15.72:0/610708802 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276809e000 msgr2=0x7f27681339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:17.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.468+0000 7f2767fff700 1 --2- 172.21.15.72:0/610708802 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276809e000 0x7f27681339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.468+0000 7f2767fff700 1 -- 172.21.15.72:0/610708802 >> v2:172.21.15.72:3300/0 conn(0x7f276809e410 msgr2=0x7f2768133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:17.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.468+0000 7f2767fff700 1 --2- 172.21.15.72:0/610708802 >> v2:172.21.15.72:3300/0 conn(0x7f276809e410 0x7f2768133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.468+0000 7f2767fff700 1 -- 172.21.15.72:0/610708802 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276809a500 con 0x7f276809d6f0 2023-10-03T10:19:17.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.468+0000 7f27677fe700 1 --2- 172.21.15.72:0/610708802 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276809e000 0x7f27681339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:17.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.468+0000 7f276ce0c700 1 --2- 172.21.15.72:0/610708802 >> v2:172.21.15.72:3300/0 conn(0x7f276809e410 0x7f2768133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:17.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.468+0000 7f2767fff700 1 --2- 172.21.15.72:0/610708802 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276809d6f0 0x7f276809dac0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2758009920 tx=0x7f2758009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efeb3c02b9b8688 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:17.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.468+0000 7f2766ffd700 1 -- 172.21.15.72:0/610708802 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758011830 con 0x7f276809d6f0 2023-10-03T10:19:17.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.468+0000 7f2766ffd700 1 -- 172.21.15.72:0/610708802 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2758011990 con 0x7f276809d6f0 2023-10-03T10:19:17.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.468+0000 7f2766ffd700 1 -- 172.21.15.72:0/610708802 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758011d20 con 0x7f276809d6f0 2023-10-03T10:19:17.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.469+0000 7f276e86f700 1 -- 172.21.15.72:0/610708802 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276809d6f0 msgr2=0x7f276809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.469+0000 7f276e86f700 1 --2- 172.21.15.72:0/610708802 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276809d6f0 0x7f276809dac0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2758009920 tx=0x7f2758009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:17.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.469+0000 7f276e86f700 1 -- 172.21.15.72:0/610708802 shutdown_connections 2023-10-03T10:19:17.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.469+0000 7f276e86f700 1 --2- 172.21.15.72:0/610708802 >> v2:172.21.15.72:3300/0 conn(0x7f276809e410 0x7f2768133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.469+0000 7f276e86f700 1 --2- 172.21.15.72:0/610708802 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276809d6f0 0x7f276809dac0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.469+0000 7f276e86f700 1 --2- 172.21.15.72:0/610708802 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276809e000 0x7f27681339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.469+0000 7f276e86f700 1 -- 172.21.15.72:0/610708802 >> 172.21.15.72:0/610708802 conn(0x7f2768066f50 msgr2=0x7f276809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.469+0000 7f276e86f700 1 -- 172.21.15.72:0/610708802 shutdown_connections 2023-10-03T10:19:17.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.469+0000 7f276e86f700 1 -- 172.21.15.72:0/610708802 wait complete. 2023-10-03T10:19:17.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.470+0000 7f276e86f700 1 Processor -- start 2023-10-03T10:19:17.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.470+0000 7f276e86f700 1 -- start start 2023-10-03T10:19:17.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f276e86f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276809d6f0 0x7f27681c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f276e86f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276809e000 0x7f27681c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f276e86f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276809e410 0x7f27681c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f276e86f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27681a81b0 con 0x7f276809e000 2023-10-03T10:19:17.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f276e86f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27681a64f0 con 0x7f276809e410 2023-10-03T10:19:17.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f276e86f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27680a30d0 con 0x7f276809d6f0 2023-10-03T10:19:17.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f2767fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276809d6f0 0x7f27681c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f2767fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276809d6f0 0x7f27681c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46204/0 (socket says 172.21.15.72:46204) 2023-10-03T10:19:17.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f2767fff700 1 -- 172.21.15.72:0/745063946 learned_addr learned my addr 172.21.15.72:0/745063946 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:17.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f27677fe700 1 --2- 172.21.15.72:0/745063946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276809e000 0x7f27681c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f276ce0c700 1 --2- 172.21.15.72:0/745063946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276809e410 0x7f27681c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f2767fff700 1 -- 172.21.15.72:0/745063946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276809e410 msgr2=0x7f27681c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f2767fff700 1 --2- 172.21.15.72:0/745063946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276809e410 0x7f27681c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f2767fff700 1 -- 172.21.15.72:0/745063946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276809e000 msgr2=0x7f27681c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f2767fff700 1 --2- 172.21.15.72:0/745063946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276809e000 0x7f27681c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f2767fff700 1 -- 172.21.15.72:0/745063946 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c0094a0 con 0x7f276809d6f0 2023-10-03T10:19:17.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f27677fe700 1 --2- 172.21.15.72:0/745063946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276809e000 0x7f27681c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:17.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f2767fff700 1 --2- 172.21.15.72:0/745063946 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276809d6f0 0x7f27681c8120 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2758000c00 tx=0x7f2758004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:17.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f2764ff9700 1 -- 172.21.15.72:0/745063946 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758004240 con 0x7f276809d6f0 2023-10-03T10:19:17.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f2764ff9700 1 -- 172.21.15.72:0/745063946 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275801f070 con 0x7f276809d6f0 2023-10-03T10:19:17.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f276e86f700 1 -- 172.21.15.72:0/745063946 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2760009a70 con 0x7f276809d6f0 2023-10-03T10:19:17.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f2764ff9700 1 -- 172.21.15.72:0/745063946 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27580045c0 con 0x7f276809d6f0 2023-10-03T10:19:17.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.471+0000 7f276e86f700 1 -- 172.21.15.72:0/745063946 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2758009550 con 0x7f276809d6f0 2023-10-03T10:19:17.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.472+0000 7f2764ff9700 1 -- 172.21.15.72:0/745063946 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2758021030 con 0x7f276809d6f0 2023-10-03T10:19:17.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.472+0000 7f2764ff9700 1 -- 172.21.15.72:0/745063946 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2758040720 con 0x7f276809d6f0 2023-10-03T10:19:17.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.472+0000 7f276e86f700 1 -- 172.21.15.72:0/745063946 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2768074ea0 con 0x7f276809d6f0 2023-10-03T10:19:17.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.477+0000 7f2764ff9700 1 -- 172.21.15.72:0/745063946 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2758015070 con 0x7f276809d6f0 2023-10-03T10:19:17.627 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:17.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.668+0000 7f276e86f700 1 -- 172.21.15.72:0/745063946 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f27681a7f60 con 0x7f276809d6f0 2023-10-03T10:19:17.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.669+0000 7f2764ff9700 1 -- 172.21.15.72:0/745063946 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f275801a450 con 0x7f276809d6f0 2023-10-03T10:19:17.670 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:17.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.671+0000 7f276e86f700 1 -- 172.21.15.72:0/745063946 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276809d6f0 msgr2=0x7f27681c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.671+0000 7f276e86f700 1 --2- 172.21.15.72:0/745063946 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276809d6f0 0x7f27681c8120 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2758000c00 tx=0x7f2758004750 comp rx=0 tx=0).stop 2023-10-03T10:19:17.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.671+0000 7f276e86f700 1 -- 172.21.15.72:0/745063946 shutdown_connections 2023-10-03T10:19:17.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.671+0000 7f276e86f700 1 --2- 172.21.15.72:0/745063946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f276809e410 0x7f27681c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.671+0000 7f276e86f700 1 --2- 172.21.15.72:0/745063946 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f276809d6f0 0x7f27681c8120 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.671+0000 7f276e86f700 1 --2- 172.21.15.72:0/745063946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f276809e000 0x7f27681c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.671+0000 7f276e86f700 1 -- 172.21.15.72:0/745063946 >> 172.21.15.72:0/745063946 conn(0x7f2768066f50 msgr2=0x7f27681bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.671+0000 7f276e86f700 1 -- 172.21.15.72:0/745063946 shutdown_connections 2023-10-03T10:19:17.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.671+0000 7f276e86f700 1 -- 172.21.15.72:0/745063946 wait complete. 2023-10-03T10:19:17.678 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:17.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:17.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:17.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.753+0000 7f843aac3700 1 Processor -- start 2023-10-03T10:19:17.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.753+0000 7f843aac3700 1 -- start start 2023-10-03T10:19:17.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.754+0000 7f843aac3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f843409f410 0x7f8434136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.754+0000 7f843aac3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8434136fe0 0x7f84341393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.754+0000 7f843aac3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8434070940 con 0x7f843409e930 2023-10-03T10:19:17.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.754+0000 7f843aac3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843406fd60 con 0x7f8434136fe0 2023-10-03T10:19:17.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.754+0000 7f843aac3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843406fa80 con 0x7f843409f410 2023-10-03T10:19:17.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.754+0000 7f8433fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f843409f410 0x7f8434136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.754+0000 7f8439060700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8434136fe0 0x7f84341393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.754+0000 7f843885f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f843409e930 0x7f843409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54716/0 (socket says 172.21.15.72:54716) 2023-10-03T10:19:17.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.754+0000 7f843885f700 1 -- 172.21.15.72:0/1877547084 learned_addr learned my addr 172.21.15.72:0/1877547084 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:17.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.754+0000 7f8433fff700 1 -- 172.21.15.72:0/1877547084 >> v2:172.21.15.72:3300/0 conn(0x7f8434136fe0 msgr2=0x7f84341393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:17.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.754+0000 7f8433fff700 1 --2- 172.21.15.72:0/1877547084 >> v2:172.21.15.72:3300/0 conn(0x7f8434136fe0 0x7f84341393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.754+0000 7f8433fff700 1 -- 172.21.15.72:0/1877547084 >> v1:172.21.15.72:6789/0 conn(0x7f843409e930 legacy=0x7f843409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.754+0000 7f8433fff700 1 -- 172.21.15.72:0/1877547084 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843409fb60 con 0x7f843409f410 2023-10-03T10:19:17.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.755+0000 7f8433fff700 1 --2- 172.21.15.72:0/1877547084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f843409f410 0x7f8434136aa0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f8420009840 tx=0x7f8420009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2d40bb7d34da1e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:17.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.755+0000 7f84337fe700 1 -- 172.21.15.72:0/1877547084 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420011830 con 0x7f843409f410 2023-10-03T10:19:17.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.755+0000 7f84337fe700 1 -- 172.21.15.72:0/1877547084 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8420011990 con 0x7f843409f410 2023-10-03T10:19:17.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.755+0000 7f84337fe700 1 -- 172.21.15.72:0/1877547084 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420011d20 con 0x7f843409f410 2023-10-03T10:19:17.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.755+0000 7f843aac3700 1 -- 172.21.15.72:0/1877547084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f843409f410 msgr2=0x7f8434136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.755+0000 7f843aac3700 1 --2- 172.21.15.72:0/1877547084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f843409f410 0x7f8434136aa0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f8420009840 tx=0x7f8420009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:17.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.755+0000 7f843aac3700 1 -- 172.21.15.72:0/1877547084 shutdown_connections 2023-10-03T10:19:17.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.755+0000 7f843aac3700 1 --2- 172.21.15.72:0/1877547084 >> v2:172.21.15.72:3300/0 conn(0x7f8434136fe0 0x7f84341393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.755+0000 7f843aac3700 1 --2- 172.21.15.72:0/1877547084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f843409f410 0x7f8434136aa0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.755+0000 7f843aac3700 1 -- 172.21.15.72:0/1877547084 >> 172.21.15.72:0/1877547084 conn(0x7f84340a4210 msgr2=0x7f84340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.756+0000 7f843aac3700 1 -- 172.21.15.72:0/1877547084 shutdown_connections 2023-10-03T10:19:17.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.756+0000 7f843aac3700 1 -- 172.21.15.72:0/1877547084 wait complete. 2023-10-03T10:19:17.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.756+0000 7f843aac3700 1 Processor -- start 2023-10-03T10:19:17.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.756+0000 7f843aac3700 1 -- start start 2023-10-03T10:19:17.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.757+0000 7f843aac3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f843409e930 0x7f8434121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.757+0000 7f843aac3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f843409f410 0x7f8434121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.757+0000 7f843aac3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8434136fe0 0x7f84341224a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.757+0000 7f843aac3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8434125260 con 0x7f843409e930 2023-10-03T10:19:17.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.757+0000 7f843aac3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8434123740 con 0x7f8434136fe0 2023-10-03T10:19:17.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.757+0000 7f843aac3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f843406d780 con 0x7f843409f410 2023-10-03T10:19:17.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.757+0000 7f843885f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f843409e930 0x7f8434121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.757+0000 7f843885f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f843409e930 0x7f8434121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36330/0 (socket says 172.21.15.72:36330) 2023-10-03T10:19:17.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.757+0000 7f843885f700 1 -- 172.21.15.72:0/1640013095 learned_addr learned my addr 172.21.15.72:0/1640013095 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:17.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.757+0000 7f8433fff700 1 --2- 172.21.15.72:0/1640013095 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f843409f410 0x7f8434121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.757+0000 7f8439060700 1 --2- 172.21.15.72:0/1640013095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8434136fe0 0x7f84341224a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.758+0000 7f8433fff700 1 -- 172.21.15.72:0/1640013095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8434136fe0 msgr2=0x7f84341224a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.758+0000 7f8433fff700 1 --2- 172.21.15.72:0/1640013095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8434136fe0 0x7f84341224a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.758+0000 7f8433fff700 1 -- 172.21.15.72:0/1640013095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f843409e930 msgr2=0x7f8434121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.758+0000 7f8433fff700 1 --2- 172.21.15.72:0/1640013095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f843409e930 0x7f8434121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.758+0000 7f8433fff700 1 -- 172.21.15.72:0/1640013095 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84200094a0 con 0x7f843409f410 2023-10-03T10:19:17.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.758+0000 7f843885f700 1 --2- 172.21.15.72:0/1640013095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f843409e930 0x7f8434121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:17.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.758+0000 7f8433fff700 1 --2- 172.21.15.72:0/1640013095 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f843409f410 0x7f8434121f60 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8420016000 tx=0x7f8420004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:17.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.758+0000 7f84317fa700 1 -- 172.21.15.72:0/1640013095 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84200036a0 con 0x7f843409f410 2023-10-03T10:19:17.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.758+0000 7f84317fa700 1 -- 172.21.15.72:0/1640013095 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842001f070 con 0x7f843409f410 2023-10-03T10:19:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.758+0000 7f843aac3700 1 -- 172.21.15.72:0/1640013095 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8434071d20 con 0x7f843409f410 2023-10-03T10:19:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.758+0000 7f84317fa700 1 -- 172.21.15.72:0/1640013095 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420003a60 con 0x7f843409f410 2023-10-03T10:19:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.758+0000 7f843aac3700 1 -- 172.21.15.72:0/1640013095 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8434125cd0 con 0x7f843409f410 2023-10-03T10:19:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.759+0000 7f84317fa700 1 -- 172.21.15.72:0/1640013095 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8420003bc0 con 0x7f843409f410 2023-10-03T10:19:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.759+0000 7f843aac3700 1 -- 172.21.15.72:0/1640013095 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8434074ea0 con 0x7f843409f410 2023-10-03T10:19:17.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.759+0000 7f84317fa700 1 -- 172.21.15.72:0/1640013095 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8420021070 con 0x7f843409f410 2023-10-03T10:19:17.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.764+0000 7f84317fa700 1 -- 172.21.15.72:0/1640013095 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8420015030 con 0x7f843409f410 2023-10-03T10:19:17.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.807+0000 7fb0fa189700 1 Processor -- start 2023-10-03T10:19:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.807+0000 7fb0fa189700 1 -- start start 2023-10-03T10:19:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.807+0000 7fb0fa189700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0f409c650 0x7fb0f409ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.807+0000 7fb0fa189700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f40a0090 0x7fb0f409cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.807+0000 7fb0fa189700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f409ba70 con 0x7fb0f4131970 2023-10-03T10:19:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.807+0000 7fb0fa189700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f409d4a0 con 0x7fb0f409c650 2023-10-03T10:19:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.807+0000 7fb0fa189700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f409e8f0 con 0x7fb0f40a0090 2023-10-03T10:19:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.807+0000 7fb0f2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f40a0090 0x7fb0f409cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.807+0000 7fb0f37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0f409c650 0x7fb0f409ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.807+0000 7fb0f2ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f40a0090 0x7fb0f409cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42230/0 (socket says 172.21.15.72:42230) 2023-10-03T10:19:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.807+0000 7fb0f37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0f409c650 0x7fb0f409ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:36338/0 (socket says 172.21.15.72:36338) 2023-10-03T10:19:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.807+0000 7fb0f2ffd700 1 -- 172.21.15.72:0/1758272263 learned_addr learned my addr 172.21.15.72:0/1758272263 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.808+0000 7fb0f2ffd700 1 -- 172.21.15.72:0/1758272263 >> v2:172.21.15.72:3300/0 conn(0x7fb0f409c650 msgr2=0x7fb0f409ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.808+0000 7fb0f2ffd700 1 --2- 172.21.15.72:0/1758272263 >> v2:172.21.15.72:3300/0 conn(0x7fb0f409c650 0x7fb0f409ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.808+0000 7fb0f2ffd700 1 -- 172.21.15.72:0/1758272263 >> v1:172.21.15.72:6789/0 conn(0x7fb0f4131970 legacy=0x7fb0f4131db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.808+0000 7fb0f2ffd700 1 -- 172.21.15.72:0/1758272263 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f40a0760 con 0x7fb0f40a0090 2023-10-03T10:19:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.808+0000 7fb0f37fe700 1 --2- 172.21.15.72:0/1758272263 >> v2:172.21.15.72:3300/0 conn(0x7fb0f409c650 0x7fb0f409ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.808+0000 7fb0f2ffd700 1 --2- 172.21.15.72:0/1758272263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f40a0090 0x7fb0f409cf60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80098f0 tx=0x7fb0e8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd15383c03ebc47c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.808+0000 7fb0f27fc700 1 -- 172.21.15.72:0/1758272263 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8011830 con 0x7fb0f40a0090 2023-10-03T10:19:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.808+0000 7fb0f27fc700 1 -- 172.21.15.72:0/1758272263 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e8011990 con 0x7fb0f40a0090 2023-10-03T10:19:17.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.808+0000 7fb0f27fc700 1 -- 172.21.15.72:0/1758272263 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8011d20 con 0x7fb0f40a0090 2023-10-03T10:19:17.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.809+0000 7fb0fa189700 1 -- 172.21.15.72:0/1758272263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f40a0090 msgr2=0x7fb0f409cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.809+0000 7fb0fa189700 1 --2- 172.21.15.72:0/1758272263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f40a0090 0x7fb0f409cf60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80098f0 tx=0x7fb0e8009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:17.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.809+0000 7fb0fa189700 1 -- 172.21.15.72:0/1758272263 shutdown_connections 2023-10-03T10:19:17.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.809+0000 7fb0fa189700 1 --2- 172.21.15.72:0/1758272263 >> v2:172.21.15.72:3300/0 conn(0x7fb0f409c650 0x7fb0f409ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.809+0000 7fb0fa189700 1 --2- 172.21.15.72:0/1758272263 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f40a0090 0x7fb0f409cf60 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.809+0000 7fb0fa189700 1 -- 172.21.15.72:0/1758272263 >> 172.21.15.72:0/1758272263 conn(0x7fb0f40a3f70 msgr2=0x7fb0f40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.809+0000 7fb0fa189700 1 -- 172.21.15.72:0/1758272263 shutdown_connections 2023-10-03T10:19:17.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.809+0000 7fb0fa189700 1 -- 172.21.15.72:0/1758272263 wait complete. 2023-10-03T10:19:17.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.810+0000 7fb0fa189700 1 Processor -- start 2023-10-03T10:19:17.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.810+0000 7fb0fa189700 1 -- start start 2023-10-03T10:19:17.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.811+0000 7fb0fa189700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0f409c650 0x7fb0f411bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.811+0000 7fb0fa189700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f40a0090 0x7fb0f411c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.811+0000 7fb0fa189700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f4131970 0x7fb0f411ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.811+0000 7fb0fa189700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f411db30 con 0x7fb0f40a0090 2023-10-03T10:19:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.811+0000 7fb0fa189700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f409d980 con 0x7fb0f4131970 2023-10-03T10:19:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.811+0000 7fb0fa189700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f411f760 con 0x7fb0f409c650 2023-10-03T10:19:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.811+0000 7fb0f37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0f409c650 0x7fb0f411bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.811+0000 7fb0f37fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0f409c650 0x7fb0f411bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:46218/0 (socket says 172.21.15.72:46218) 2023-10-03T10:19:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.811+0000 7fb0f37fe700 1 -- 172.21.15.72:0/600210001 learned_addr learned my addr 172.21.15.72:0/600210001 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.811+0000 7fb0f2ffd700 1 --2- 172.21.15.72:0/600210001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f40a0090 0x7fb0f411c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.811+0000 7fb0f3fff700 1 --2- 172.21.15.72:0/600210001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f4131970 0x7fb0f411ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.812+0000 7fb0f37fe700 1 -- 172.21.15.72:0/600210001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f4131970 msgr2=0x7fb0f411ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.812+0000 7fb0f37fe700 1 --2- 172.21.15.72:0/600210001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f4131970 0x7fb0f411ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.812+0000 7fb0f37fe700 1 -- 172.21.15.72:0/600210001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f40a0090 msgr2=0x7fb0f411c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.812+0000 7fb0f37fe700 1 --2- 172.21.15.72:0/600210001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f40a0090 0x7fb0f411c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.812+0000 7fb0f37fe700 1 -- 172.21.15.72:0/600210001 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e40094a0 con 0x7fb0f409c650 2023-10-03T10:19:17.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.812+0000 7fb0f2ffd700 1 --2- 172.21.15.72:0/600210001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f40a0090 0x7fb0f411c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:17.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.812+0000 7fb0f37fe700 1 --2- 172.21.15.72:0/600210001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0f409c650 0x7fb0f411bff0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400ebe0 tx=0x7fb0e400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:17.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.812+0000 7fb0dbfff700 1 -- 172.21.15.72:0/600210001 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4009800 con 0x7fb0f409c650 2023-10-03T10:19:17.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.812+0000 7fb0dbfff700 1 -- 172.21.15.72:0/600210001 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e400c910 con 0x7fb0f409c650 2023-10-03T10:19:17.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.812+0000 7fb0fa189700 1 -- 172.21.15.72:0/600210001 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e8009550 con 0x7fb0f409c650 2023-10-03T10:19:17.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.812+0000 7fb0dbfff700 1 -- 172.21.15.72:0/600210001 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e400cc80 con 0x7fb0f409c650 2023-10-03T10:19:17.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.812+0000 7fb0fa189700 1 -- 172.21.15.72:0/600210001 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f411ed80 con 0x7fb0f409c650 2023-10-03T10:19:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.813+0000 7fb0dbfff700 1 -- 172.21.15.72:0/600210001 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0e4013470 con 0x7fb0f409c650 2023-10-03T10:19:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.813+0000 7fb0dbfff700 1 -- 172.21.15.72:0/600210001 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb0e403f950 con 0x7fb0f409c650 2023-10-03T10:19:17.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.813+0000 7fb0fa189700 1 -- 172.21.15.72:0/600210001 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f40747f0 con 0x7fb0f409c650 2023-10-03T10:19:17.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.818+0000 7fb0dbfff700 1 -- 172.21.15.72:0/600210001 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0e4021080 con 0x7fb0f409c650 2023-10-03T10:19:17.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.874+0000 7fd6e10bb700 1 Processor -- start 2023-10-03T10:19:17.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.875+0000 7fd6e10bb700 1 -- start start 2023-10-03T10:19:17.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.875+0000 7fd6e10bb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6dc09e930 0x7fd6dc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.875+0000 7fd6e10bb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd6dc09f240 0x7fd6dc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.875+0000 7fd6e10bb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6dc09f650 0x7fd6dc131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.875+0000 7fd6e10bb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc070940 con 0x7fd6dc09f240 2023-10-03T10:19:17.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.875+0000 7fd6e10bb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc06fd60 con 0x7fd6dc09e930 2023-10-03T10:19:17.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.875+0000 7fd6e10bb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc06fa80 con 0x7fd6dc09f650 2023-10-03T10:19:17.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.875+0000 7fd6dad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6dc09e930 0x7fd6dc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.875+0000 7fd6da59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd6dc09f240 0x7fd6dc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.875+0000 7fd6db59e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6dc09f650 0x7fd6dc131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.875+0000 7fd6dad9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6dc09e930 0x7fd6dc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42252/0 (socket says 172.21.15.72:42252) 2023-10-03T10:19:17.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.875+0000 7fd6dad9d700 1 -- 172.21.15.72:0/3627524729 learned_addr learned my addr 172.21.15.72:0/3627524729 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:17.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.875+0000 7fd6dad9d700 1 -- 172.21.15.72:0/3627524729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6dc09f650 msgr2=0x7fd6dc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:17.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.875+0000 7fd6dad9d700 1 --2- 172.21.15.72:0/3627524729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6dc09f650 0x7fd6dc131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.876+0000 7fd6dad9d700 1 -- 172.21.15.72:0/3627524729 >> v2:172.21.15.72:3300/0 conn(0x7fd6dc09f240 msgr2=0x7fd6dc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:17.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.876+0000 7fd6dad9d700 1 --2- 172.21.15.72:0/3627524729 >> v2:172.21.15.72:3300/0 conn(0x7fd6dc09f240 0x7fd6dc1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.876+0000 7fd6dad9d700 1 -- 172.21.15.72:0/3627524729 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc09fb60 con 0x7fd6dc09e930 2023-10-03T10:19:17.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.876+0000 7fd6db59e700 1 --2- 172.21.15.72:0/3627524729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6dc09f650 0x7fd6dc131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:17.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.876+0000 7fd6da59c700 1 --2- 172.21.15.72:0/3627524729 >> v2:172.21.15.72:3300/0 conn(0x7fd6dc09f240 0x7fd6dc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:17.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.876+0000 7fd6dad9d700 1 --2- 172.21.15.72:0/3627524729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6dc09e930 0x7fd6dc09ed00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0098f0 tx=0x7fd6cc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=950a48c45837fab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:17.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.876+0000 7fd6d9d9b700 1 -- 172.21.15.72:0/3627524729 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc011830 con 0x7fd6dc09e930 2023-10-03T10:19:17.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.876+0000 7fd6d9d9b700 1 -- 172.21.15.72:0/3627524729 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc011990 con 0x7fd6dc09e930 2023-10-03T10:19:17.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.876+0000 7fd6d9d9b700 1 -- 172.21.15.72:0/3627524729 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc011d20 con 0x7fd6dc09e930 2023-10-03T10:19:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.876+0000 7fd6e10bb700 1 -- 172.21.15.72:0/3627524729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6dc09e930 msgr2=0x7fd6dc09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.876+0000 7fd6e10bb700 1 --2- 172.21.15.72:0/3627524729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6dc09e930 0x7fd6dc09ed00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0098f0 tx=0x7fd6cc009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.877+0000 7fd6e10bb700 1 -- 172.21.15.72:0/3627524729 shutdown_connections 2023-10-03T10:19:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.877+0000 7fd6e10bb700 1 --2- 172.21.15.72:0/3627524729 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6dc09f650 0x7fd6dc131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.877+0000 7fd6e10bb700 1 --2- 172.21.15.72:0/3627524729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6dc09e930 0x7fd6dc09ed00 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.877+0000 7fd6e10bb700 1 --2- 172.21.15.72:0/3627524729 >> v2:172.21.15.72:3300/0 conn(0x7fd6dc09f240 0x7fd6dc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.877+0000 7fd6e10bb700 1 -- 172.21.15.72:0/3627524729 >> 172.21.15.72:0/3627524729 conn(0x7fd6dc0a4210 msgr2=0x7fd6dc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.877+0000 7fd6e10bb700 1 -- 172.21.15.72:0/3627524729 shutdown_connections 2023-10-03T10:19:17.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.877+0000 7fd6e10bb700 1 -- 172.21.15.72:0/3627524729 wait complete. 2023-10-03T10:19:17.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.878+0000 7fd6e10bb700 1 Processor -- start 2023-10-03T10:19:17.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.878+0000 7fd6e10bb700 1 -- start start 2023-10-03T10:19:17.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6e10bb700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6dc09e930 0x7fd6dc120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6e10bb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6dc09f240 0x7fd6dc120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6e10bb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6dc09f650 0x7fd6dc121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6e10bb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc122490 con 0x7fd6dc09f650 2023-10-03T10:19:17.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6e10bb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0a30d0 con 0x7fd6dc09f240 2023-10-03T10:19:17.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6e10bb700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc124220 con 0x7fd6dc09e930 2023-10-03T10:19:17.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6da59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6dc09f240 0x7fd6dc120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6da59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6dc09f240 0x7fd6dc120c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:42264/0 (socket says 172.21.15.72:42264) 2023-10-03T10:19:17.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6da59c700 1 -- 172.21.15.72:0/2775441712 learned_addr learned my addr 172.21.15.72:0/2775441712 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:17.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6dad9d700 1 --2- 172.21.15.72:0/2775441712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6dc09e930 0x7fd6dc120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6db59e700 1 --2- 172.21.15.72:0/2775441712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6dc09f650 0x7fd6dc121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6da59c700 1 -- 172.21.15.72:0/2775441712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6dc09e930 msgr2=0x7fd6dc120700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6da59c700 1 --2- 172.21.15.72:0/2775441712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6dc09e930 0x7fd6dc120700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6da59c700 1 -- 172.21.15.72:0/2775441712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6dc09f650 msgr2=0x7fd6dc121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6da59c700 1 --2- 172.21.15.72:0/2775441712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6dc09f650 0x7fd6dc121180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6da59c700 1 -- 172.21.15.72:0/2775441712 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d00094a0 con 0x7fd6dc09f240 2023-10-03T10:19:17.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.879+0000 7fd6dad9d700 1 --2- 172.21.15.72:0/2775441712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6dc09e930 0x7fd6dc120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:17.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.880+0000 7fd6da59c700 1 --2- 172.21.15.72:0/2775441712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6dc09f240 0x7fd6dc120c40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000ebb0 tx=0x7fd6d000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:17.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.880+0000 7fd6c37fe700 1 -- 172.21.15.72:0/2775441712 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d000c850 con 0x7fd6dc09f240 2023-10-03T10:19:17.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.880+0000 7fd6c37fe700 1 -- 172.21.15.72:0/2775441712 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d000c9b0 con 0x7fd6dc09f240 2023-10-03T10:19:17.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.880+0000 7fd6e10bb700 1 -- 172.21.15.72:0/2775441712 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d4009a70 con 0x7fd6dc09f240 2023-10-03T10:19:17.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.880+0000 7fd6c37fe700 1 -- 172.21.15.72:0/2775441712 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d000cd40 con 0x7fd6dc09f240 2023-10-03T10:19:17.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.880+0000 7fd6e10bb700 1 -- 172.21.15.72:0/2775441712 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6cc009550 con 0x7fd6dc09f240 2023-10-03T10:19:17.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.880+0000 7fd6c37fe700 1 -- 172.21.15.72:0/2775441712 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd6d0013470 con 0x7fd6dc09f240 2023-10-03T10:19:17.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.881+0000 7fd6c37fe700 1 -- 172.21.15.72:0/2775441712 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd6d003fb10 con 0x7fd6dc09f240 2023-10-03T10:19:17.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.881+0000 7fd6e10bb700 1 -- 172.21.15.72:0/2775441712 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6dc074ea0 con 0x7fd6dc09f240 2023-10-03T10:19:17.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.886+0000 7fd6c37fe700 1 -- 172.21.15.72:0/2775441712 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6d001b3b0 con 0x7fd6dc09f240 2023-10-03T10:19:17.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.965+0000 7f843aac3700 1 -- 172.21.15.72:0/1640013095 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f843406b250 con 0x7f843409f410 2023-10-03T10:19:17.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.965+0000 7f84317fa700 1 -- 172.21.15.72:0/1640013095 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f842002f3a0 con 0x7f843409f410 2023-10-03T10:19:17.966 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:17.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.967+0000 7f843aac3700 1 -- 172.21.15.72:0/1640013095 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f843409f410 msgr2=0x7f8434121f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.967+0000 7f843aac3700 1 --2- 172.21.15.72:0/1640013095 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f843409f410 0x7f8434121f60 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8420016000 tx=0x7f8420004750 comp rx=0 tx=0).stop 2023-10-03T10:19:17.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.968+0000 7f843aac3700 1 -- 172.21.15.72:0/1640013095 shutdown_connections 2023-10-03T10:19:17.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.968+0000 7f843aac3700 1 --2- 172.21.15.72:0/1640013095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f843409e930 0x7f8434121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.968+0000 7f843aac3700 1 --2- 172.21.15.72:0/1640013095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8434136fe0 0x7f84341224a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.968+0000 7f843aac3700 1 --2- 172.21.15.72:0/1640013095 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f843409f410 0x7f8434121f60 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.968+0000 7f843aac3700 1 -- 172.21.15.72:0/1640013095 >> 172.21.15.72:0/1640013095 conn(0x7f84340a4210 msgr2=0x7f84340a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.968+0000 7f843aac3700 1 -- 172.21.15.72:0/1640013095 shutdown_connections 2023-10-03T10:19:17.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:17.968+0000 7f843aac3700 1 -- 172.21.15.72:0/1640013095 wait complete. 2023-10-03T10:19:17.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:18.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.013+0000 7fb0fa189700 1 -- 172.21.15.72:0/600210001 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb0f4072840 con 0x7fb0f409c650 2023-10-03T10:19:18.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.013+0000 7fb0dbfff700 1 -- 172.21.15.72:0/600210001 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb0e401bd90 con 0x7fb0f409c650 2023-10-03T10:19:18.014 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:18.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.015+0000 7fb0fa189700 1 -- 172.21.15.72:0/600210001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0f409c650 msgr2=0x7fb0f411bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.015+0000 7fb0fa189700 1 --2- 172.21.15.72:0/600210001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0f409c650 0x7fb0f411bff0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400ebe0 tx=0x7fb0e400eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.015+0000 7fb0fa189700 1 -- 172.21.15.72:0/600210001 shutdown_connections 2023-10-03T10:19:18.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.015+0000 7fb0fa189700 1 --2- 172.21.15.72:0/600210001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0f4131970 0x7fb0f411ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.015+0000 7fb0fa189700 1 --2- 172.21.15.72:0/600210001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb0f409c650 0x7fb0f411bff0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.015+0000 7fb0fa189700 1 --2- 172.21.15.72:0/600210001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0f40a0090 0x7fb0f411c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.015+0000 7fb0fa189700 1 -- 172.21.15.72:0/600210001 >> 172.21.15.72:0/600210001 conn(0x7fb0f40a3f70 msgr2=0x7fb0f409eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.015+0000 7fb0fa189700 1 -- 172.21.15.72:0/600210001 shutdown_connections 2023-10-03T10:19:18.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.015+0000 7fb0fa189700 1 -- 172.21.15.72:0/600210001 wait complete. 2023-10-03T10:19:18.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.080+0000 7fd6e10bb700 1 -- 172.21.15.72:0/2775441712 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd6dc131220 con 0x7fd6dc09f240 2023-10-03T10:19:18.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.081+0000 7fd6c37fe700 1 -- 172.21.15.72:0/2775441712 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6d0011b40 con 0x7fd6dc09f240 2023-10-03T10:19:18.081 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.083+0000 7fd6e10bb700 1 -- 172.21.15.72:0/2775441712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6dc09f240 msgr2=0x7fd6dc120c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.083+0000 7fd6e10bb700 1 --2- 172.21.15.72:0/2775441712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6dc09f240 0x7fd6dc120c40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000ebb0 tx=0x7fd6d000eec0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.083+0000 7fd6e10bb700 1 -- 172.21.15.72:0/2775441712 shutdown_connections 2023-10-03T10:19:18.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.083+0000 7fd6e10bb700 1 --2- 172.21.15.72:0/2775441712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6dc09f650 0x7fd6dc121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.083+0000 7fd6e10bb700 1 --2- 172.21.15.72:0/2775441712 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd6dc09e930 0x7fd6dc120700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.083+0000 7fd6e10bb700 1 --2- 172.21.15.72:0/2775441712 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6dc09f240 0x7fd6dc120c40 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.083+0000 7fd6e10bb700 1 -- 172.21.15.72:0/2775441712 >> 172.21.15.72:0/2775441712 conn(0x7fd6dc0a4210 msgr2=0x7fd6dc0a27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.083+0000 7fd6e10bb700 1 -- 172.21.15.72:0/2775441712 shutdown_connections 2023-10-03T10:19:18.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.083+0000 7fd6e10bb700 1 -- 172.21.15.72:0/2775441712 wait complete. 2023-10-03T10:19:18.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:18.686 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.813+0000 7ffa6345d700 1 Processor -- start 2023-10-03T10:19:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.813+0000 7ffa6345d700 1 -- start start 2023-10-03T10:19:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.813+0000 7ffa6345d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa5c0a0a30 0x7ffa5c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.813+0000 7ffa6345d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa5c0a1340 0x7ffa5c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.813+0000 7ffa6345d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c09edd0 con 0x7ffa5c133fa0 2023-10-03T10:19:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.813+0000 7ffa6345d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c09e1f0 con 0x7ffa5c0a1340 2023-10-03T10:19:18.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.813+0000 7ffa6345d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c09dc50 con 0x7ffa5c0a0a30 2023-10-03T10:19:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.813+0000 7ffa609f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa5c0a1340 0x7ffa5c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.813+0000 7ffa611f9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa5c0a0a30 0x7ffa5c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.813+0000 7ffa619fa700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffa5c133fa0 0x7ffa5c13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39850/0 (socket says 172.21.15.72:39850) 2023-10-03T10:19:18.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.813+0000 7ffa619fa700 1 -- 172.21.15.72:0/1177549450 learned_addr learned my addr 172.21.15.72:0/1177549450 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:18.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.814+0000 7ffa611f9700 1 -- 172.21.15.72:0/1177549450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa5c0a1340 msgr2=0x7ffa5c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:18.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.814+0000 7ffa611f9700 1 --2- 172.21.15.72:0/1177549450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa5c0a1340 0x7ffa5c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.814+0000 7ffa53fff700 1 -- 172.21.15.72:0/1177549450 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267364271 0 0) 0x7ffa5c09edd0 con 0x7ffa5c133fa0 2023-10-03T10:19:18.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.814+0000 7ffa611f9700 1 -- 172.21.15.72:0/1177549450 >> v1:172.21.15.72:6789/0 conn(0x7ffa5c133fa0 legacy=0x7ffa5c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.814+0000 7ffa611f9700 1 -- 172.21.15.72:0/1177549450 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c0a1fe0 con 0x7ffa5c0a0a30 2023-10-03T10:19:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.814+0000 7ffa609f8700 1 --2- 172.21.15.72:0/1177549450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa5c0a1340 0x7ffa5c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.814+0000 7ffa611f9700 1 --2- 172.21.15.72:0/1177549450 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa5c0a0a30 0x7ffa5c0a0e00 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009870 tx=0x7ffa58009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a624904abc6a8ca5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.814+0000 7ffa53fff700 1 -- 172.21.15.72:0/1177549450 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa58011830 con 0x7ffa5c0a0a30 2023-10-03T10:19:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.814+0000 7ffa53fff700 1 -- 172.21.15.72:0/1177549450 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa58011990 con 0x7ffa5c0a0a30 2023-10-03T10:19:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.814+0000 7ffa53fff700 1 -- 172.21.15.72:0/1177549450 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa58011d20 con 0x7ffa5c0a0a30 2023-10-03T10:19:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.814+0000 7ffa6345d700 1 -- 172.21.15.72:0/1177549450 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa5c0a0a30 msgr2=0x7ffa5c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.814+0000 7ffa6345d700 1 --2- 172.21.15.72:0/1177549450 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa5c0a0a30 0x7ffa5c0a0e00 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009870 tx=0x7ffa58009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.815+0000 7ffa6345d700 1 -- 172.21.15.72:0/1177549450 shutdown_connections 2023-10-03T10:19:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.815+0000 7ffa6345d700 1 --2- 172.21.15.72:0/1177549450 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa5c0a0a30 0x7ffa5c0a0e00 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.815+0000 7ffa6345d700 1 --2- 172.21.15.72:0/1177549450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa5c0a1340 0x7ffa5c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.815+0000 7ffa6345d700 1 -- 172.21.15.72:0/1177549450 >> 172.21.15.72:0/1177549450 conn(0x7ffa5c0a6550 msgr2=0x7ffa5c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.815+0000 7ffa6345d700 1 -- 172.21.15.72:0/1177549450 shutdown_connections 2023-10-03T10:19:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.815+0000 7ffa6345d700 1 -- 172.21.15.72:0/1177549450 wait complete. 2023-10-03T10:19:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.815+0000 7ffa6345d700 1 Processor -- start 2023-10-03T10:19:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa6345d700 1 -- start start 2023-10-03T10:19:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa6345d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa5c0a0a30 0x7ffa5c1227e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa6345d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa5c0a1340 0x7ffa5c122d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa6345d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa5c133fa0 0x7ffa5c123260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa6345d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c124c90 con 0x7ffa5c133fa0 2023-10-03T10:19:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa6345d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c125d60 con 0x7ffa5c0a1340 2023-10-03T10:19:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa6345d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c124500 con 0x7ffa5c0a0a30 2023-10-03T10:19:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa609f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa5c0a1340 0x7ffa5c122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa619fa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa5c133fa0 0x7ffa5c123260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa611f9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa5c0a0a30 0x7ffa5c1227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa619fa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa5c133fa0 0x7ffa5c123260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50744/0 (socket says 172.21.15.72:50744) 2023-10-03T10:19:18.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa611f9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa5c0a0a30 0x7ffa5c1227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52134/0 (socket says 172.21.15.72:52134) 2023-10-03T10:19:18.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa619fa700 1 -- 172.21.15.72:0/2124633703 learned_addr learned my addr 172.21.15.72:0/2124633703 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:18.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa609f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa5c0a1340 0x7ffa5c122d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59032/0 (socket says 172.21.15.72:59032) 2023-10-03T10:19:18.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa609f8700 1 -- 172.21.15.72:0/2124633703 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa5c0a0a30 msgr2=0x7ffa5c1227e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa609f8700 1 --2- 172.21.15.72:0/2124633703 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa5c0a0a30 0x7ffa5c1227e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa609f8700 1 -- 172.21.15.72:0/2124633703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa5c133fa0 msgr2=0x7ffa5c123260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa609f8700 1 --2- 172.21.15.72:0/2124633703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa5c133fa0 0x7ffa5c123260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa609f8700 1 -- 172.21.15.72:0/2124633703 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c0094a0 con 0x7ffa5c0a1340 2023-10-03T10:19:18.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa619fa700 1 --2- 172.21.15.72:0/2124633703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa5c133fa0 0x7ffa5c123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:18.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.816+0000 7ffa609f8700 1 --2- 172.21.15.72:0/2124633703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa5c0a1340 0x7ffa5c122d20 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00e9b0 tx=0x7ffa4c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.817+0000 7ffa51ffb700 1 -- 172.21.15.72:0/2124633703 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00ee50 con 0x7ffa5c0a1340 2023-10-03T10:19:18.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.817+0000 7ffa51ffb700 1 -- 172.21.15.72:0/2124633703 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c00c850 con 0x7ffa5c0a1340 2023-10-03T10:19:18.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.817+0000 7ffa6345d700 1 -- 172.21.15.72:0/2124633703 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa580094a0 con 0x7ffa5c0a1340 2023-10-03T10:19:18.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.817+0000 7ffa51ffb700 1 -- 172.21.15.72:0/2124633703 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00cc00 con 0x7ffa5c0a1340 2023-10-03T10:19:18.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.817+0000 7ffa6345d700 1 -- 172.21.15.72:0/2124633703 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c0a25e0 con 0x7ffa5c0a1340 2023-10-03T10:19:18.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.817+0000 7ffa51ffb700 1 -- 172.21.15.72:0/2124633703 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa4c013470 con 0x7ffa5c0a1340 2023-10-03T10:19:18.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.818+0000 7ffa51ffb700 1 -- 172.21.15.72:0/2124633703 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffa4c03f740 con 0x7ffa5c0a1340 2023-10-03T10:19:18.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.818+0000 7ffa6345d700 1 -- 172.21.15.72:0/2124633703 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5c074ea0 con 0x7ffa5c0a1340 2023-10-03T10:19:18.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:18.822+0000 7ffa51ffb700 1 -- 172.21.15.72:0/2124633703 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa4c013720 con 0x7ffa5c0a1340 2023-10-03T10:19:18.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.013+0000 7ffa6345d700 1 -- 172.21.15.72:0/2124633703 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffa5c0a28e0 con 0x7ffa5c0a1340 2023-10-03T10:19:19.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.013+0000 7ffa51ffb700 1 -- 172.21.15.72:0/2124633703 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa4c021030 con 0x7ffa5c0a1340 2023-10-03T10:19:19.014 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.015+0000 7ffa6345d700 1 -- 172.21.15.72:0/2124633703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa5c0a1340 msgr2=0x7ffa5c122d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.015+0000 7ffa6345d700 1 --2- 172.21.15.72:0/2124633703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa5c0a1340 0x7ffa5c122d20 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00e9b0 tx=0x7ffa4c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.015+0000 7ffa6345d700 1 -- 172.21.15.72:0/2124633703 shutdown_connections 2023-10-03T10:19:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.015+0000 7ffa6345d700 1 --2- 172.21.15.72:0/2124633703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa5c133fa0 0x7ffa5c123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.015+0000 7ffa6345d700 1 --2- 172.21.15.72:0/2124633703 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ffa5c0a0a30 0x7ffa5c1227e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.015+0000 7ffa6345d700 1 --2- 172.21.15.72:0/2124633703 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa5c0a1340 0x7ffa5c122d20 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.015+0000 7ffa6345d700 1 -- 172.21.15.72:0/2124633703 >> 172.21.15.72:0/2124633703 conn(0x7ffa5c0a6550 msgr2=0x7ffa5c0a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.015+0000 7ffa6345d700 1 -- 172.21.15.72:0/2124633703 shutdown_connections 2023-10-03T10:19:19.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.015+0000 7ffa6345d700 1 -- 172.21.15.72:0/2124633703 wait complete. 2023-10-03T10:19:19.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:19.028 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:19.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:19.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.109+0000 7f857bbb2700 1 Processor -- start 2023-10-03T10:19:19.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.109+0000 7f857bbb2700 1 -- start start 2023-10-03T10:19:19.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857bbb2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409e930 0x7f857409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857bbb2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f857409f240 0x7f85741317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857bbb2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8574070940 con 0x7f857409f650 2023-10-03T10:19:19.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857bbb2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857406fd60 con 0x7f857409e930 2023-10-03T10:19:19.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857bbb2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f857406fa80 con 0x7f857409f240 2023-10-03T10:19:19.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857994e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409e930 0x7f857409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857a14f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f857409f650 0x7f8574131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39860/0 (socket says 172.21.15.72:39860) 2023-10-03T10:19:19.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857a14f700 1 -- 172.21.15.72:0/1953085907 learned_addr learned my addr 172.21.15.72:0/1953085907 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:19.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857914d700 1 --2- 172.21.15.72:0/1953085907 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f857409f240 0x7f85741317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857894c700 1 -- 172.21.15.72:0/1953085907 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317920684 0 0) 0x7f8574070940 con 0x7f857409f650 2023-10-03T10:19:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857894c700 1 -- 172.21.15.72:0/1953085907 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85600035b0 con 0x7f857409f650 2023-10-03T10:19:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857914d700 1 -- 172.21.15.72:0/1953085907 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409e930 msgr2=0x7f857409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857914d700 1 --2- 172.21.15.72:0/1953085907 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409e930 0x7f857409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857914d700 1 -- 172.21.15.72:0/1953085907 >> v1:172.21.15.72:6789/0 conn(0x7f857409f650 legacy=0x7f8574131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857914d700 1 -- 172.21.15.72:0/1953085907 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857409fb60 con 0x7f857409f240 2023-10-03T10:19:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857994e700 1 --2- 172.21.15.72:0/1953085907 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409e930 0x7f857409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.110+0000 7f857914d700 1 --2- 172.21.15.72:0/1953085907 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f857409f240 0x7f85741317f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f8564009870 tx=0x7f8564009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7924f9177028cbcd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.111+0000 7f857894c700 1 -- 172.21.15.72:0/1953085907 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564011830 con 0x7f857409f240 2023-10-03T10:19:19.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.111+0000 7f857894c700 1 -- 172.21.15.72:0/1953085907 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8564011990 con 0x7f857409f240 2023-10-03T10:19:19.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.111+0000 7f857894c700 1 -- 172.21.15.72:0/1953085907 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564011d20 con 0x7f857409f240 2023-10-03T10:19:19.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.111+0000 7f857bbb2700 1 -- 172.21.15.72:0/1953085907 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f857409f240 msgr2=0x7f85741317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.111+0000 7f857bbb2700 1 --2- 172.21.15.72:0/1953085907 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f857409f240 0x7f85741317f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f8564009870 tx=0x7f8564009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:19.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.112+0000 7f857bbb2700 1 -- 172.21.15.72:0/1953085907 shutdown_connections 2023-10-03T10:19:19.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.112+0000 7f857bbb2700 1 --2- 172.21.15.72:0/1953085907 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409e930 0x7f857409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.112+0000 7f857bbb2700 1 --2- 172.21.15.72:0/1953085907 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f857409f240 0x7f85741317f0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.112+0000 7f857bbb2700 1 -- 172.21.15.72:0/1953085907 >> 172.21.15.72:0/1953085907 conn(0x7f85740a4210 msgr2=0x7f85740a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.112+0000 7f857bbb2700 1 -- 172.21.15.72:0/1953085907 shutdown_connections 2023-10-03T10:19:19.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.112+0000 7f857bbb2700 1 -- 172.21.15.72:0/1953085907 wait complete. 2023-10-03T10:19:19.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857bbb2700 1 Processor -- start 2023-10-03T10:19:19.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857bbb2700 1 -- start start 2023-10-03T10:19:19.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857bbb2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f857409e930 0x7f85741a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857bbb2700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f857409f240 0x7f85741a4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857bbb2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409f650 0x7f85741a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857bbb2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85741a58a0 con 0x7f857409e930 2023-10-03T10:19:19.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857bbb2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8574071d20 con 0x7f857409f650 2023-10-03T10:19:19.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857bbb2700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85741a74d0 con 0x7f857409f240 2023-10-03T10:19:19.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857914d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f857409f240 0x7f85741a4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857914d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f857409f240 0x7f85741a4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52160/0 (socket says 172.21.15.72:52160) 2023-10-03T10:19:19.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857914d700 1 -- 172.21.15.72:0/1501593303 learned_addr learned my addr 172.21.15.72:0/1501593303 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:19.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857a14f700 1 --2- 172.21.15.72:0/1501593303 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409f650 0x7f85741a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857994e700 1 --2- 172.21.15.72:0/1501593303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f857409e930 0x7f85741a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857914d700 1 -- 172.21.15.72:0/1501593303 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409f650 msgr2=0x7f85741a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857914d700 1 --2- 172.21.15.72:0/1501593303 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409f650 0x7f85741a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857914d700 1 -- 172.21.15.72:0/1501593303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f857409e930 msgr2=0x7f85741a3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857914d700 1 --2- 172.21.15.72:0/1501593303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f857409e930 0x7f85741a3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.113+0000 7f857914d700 1 -- 172.21.15.72:0/1501593303 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85700094a0 con 0x7f857409f240 2023-10-03T10:19:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.114+0000 7f857914d700 1 --2- 172.21.15.72:0/1501593303 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f857409f240 0x7f85741a4250 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8564009bc0 tx=0x7f8564004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.114+0000 7f856a7fc700 1 -- 172.21.15.72:0/1501593303 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564004510 con 0x7f857409f240 2023-10-03T10:19:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.114+0000 7f856a7fc700 1 -- 172.21.15.72:0/1501593303 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856401f070 con 0x7f857409f240 2023-10-03T10:19:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.114+0000 7f856a7fc700 1 -- 172.21.15.72:0/1501593303 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85640038e0 con 0x7f857409f240 2023-10-03T10:19:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.114+0000 7f857bbb2700 1 -- 172.21.15.72:0/1501593303 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85640094a0 con 0x7f857409f240 2023-10-03T10:19:19.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.115+0000 7f857bbb2700 1 -- 172.21.15.72:0/1501593303 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85740a0190 con 0x7f857409f240 2023-10-03T10:19:19.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.115+0000 7f856a7fc700 1 -- 172.21.15.72:0/1501593303 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8564003a40 con 0x7f857409f240 2023-10-03T10:19:19.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.115+0000 7f856a7fc700 1 -- 172.21.15.72:0/1501593303 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8564021070 con 0x7f857409f240 2023-10-03T10:19:19.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.115+0000 7f857bbb2700 1 -- 172.21.15.72:0/1501593303 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85741a0b30 con 0x7f857409f240 2023-10-03T10:19:19.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.120+0000 7f856a7fc700 1 -- 172.21.15.72:0/1501593303 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8564015080 con 0x7f857409f240 2023-10-03T10:19:19.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.205+0000 7f24e0583700 1 Processor -- start 2023-10-03T10:19:19.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.205+0000 7f24e0583700 1 -- start start 2023-10-03T10:19:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24e0583700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24d809e850 0x7f24d809ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24e0583700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24d809f160 0x7f24d8133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24e0583700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24d81340c0 0x7f24d8134500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24e0583700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d809ae60 con 0x7f24d809e850 2023-10-03T10:19:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24e0583700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d8134a40 con 0x7f24d81340c0 2023-10-03T10:19:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24e0583700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24d806b990 con 0x7f24d809f160 2023-10-03T10:19:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24ddb1e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24d809f160 0x7f24d8133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24de31f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24d809e850 0x7f24d809ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24ddb1e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24d809f160 0x7f24d8133b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52174/0 (socket says 172.21.15.72:52174) 2023-10-03T10:19:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24ddb1e700 1 -- 172.21.15.72:0/3134931238 learned_addr learned my addr 172.21.15.72:0/3134931238 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24deb20700 1 --2- 172.21.15.72:0/3134931238 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24d81340c0 0x7f24d8134500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24de31f700 1 -- 172.21.15.72:0/3134931238 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24d809f160 msgr2=0x7f24d8133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24de31f700 1 --2- 172.21.15.72:0/3134931238 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24d809f160 0x7f24d8133b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24de31f700 1 -- 172.21.15.72:0/3134931238 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24d81340c0 msgr2=0x7f24d8134500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24de31f700 1 --2- 172.21.15.72:0/3134931238 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24d81340c0 0x7f24d8134500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24de31f700 1 -- 172.21.15.72:0/3134931238 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d806bc50 con 0x7f24d809e850 2023-10-03T10:19:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.206+0000 7f24deb20700 1 --2- 172.21.15.72:0/3134931238 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24d81340c0 0x7f24d8134500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.207+0000 7f24de31f700 1 --2- 172.21.15.72:0/3134931238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d809e850 0x7f24d809ec20 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009840 tx=0x7f24d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a1336aa5eb6988 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.207+0000 7f24dd31d700 1 -- 172.21.15.72:0/3134931238 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d4011830 con 0x7f24d809e850 2023-10-03T10:19:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.207+0000 7f24dd31d700 1 -- 172.21.15.72:0/3134931238 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d4011990 con 0x7f24d809e850 2023-10-03T10:19:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.207+0000 7f24dd31d700 1 -- 172.21.15.72:0/3134931238 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d4011d20 con 0x7f24d809e850 2023-10-03T10:19:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.207+0000 7f24e0583700 1 -- 172.21.15.72:0/3134931238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d809e850 msgr2=0x7f24d809ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.207+0000 7f24e0583700 1 --2- 172.21.15.72:0/3134931238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d809e850 0x7f24d809ec20 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009840 tx=0x7f24d4009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.207+0000 7f24e0583700 1 -- 172.21.15.72:0/3134931238 shutdown_connections 2023-10-03T10:19:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.207+0000 7f24e0583700 1 --2- 172.21.15.72:0/3134931238 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24d81340c0 0x7f24d8134500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.207+0000 7f24e0583700 1 --2- 172.21.15.72:0/3134931238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d809e850 0x7f24d809ec20 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.207+0000 7f24e0583700 1 --2- 172.21.15.72:0/3134931238 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24d809f160 0x7f24d8133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.207+0000 7f24e0583700 1 -- 172.21.15.72:0/3134931238 >> 172.21.15.72:0/3134931238 conn(0x7f24d80a3f70 msgr2=0x7f24d80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.207+0000 7f24e0583700 1 -- 172.21.15.72:0/3134931238 shutdown_connections 2023-10-03T10:19:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.207+0000 7f24e0583700 1 -- 172.21.15.72:0/3134931238 wait complete. 2023-10-03T10:19:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.208+0000 7f24e0583700 1 Processor -- start 2023-10-03T10:19:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.208+0000 7f24e0583700 1 -- start start 2023-10-03T10:19:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24e0583700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d809e850 0x7f24d8122670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24e0583700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24d809f160 0x7f24d8122bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24e0583700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24d81340c0 0x7f24d81230f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24e0583700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d8124ad0 con 0x7f24d809e850 2023-10-03T10:19:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24e0583700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d80a13c0 con 0x7f24d809f160 2023-10-03T10:19:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24e0583700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24d806cd30 con 0x7f24d81340c0 2023-10-03T10:19:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24deb20700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24d81340c0 0x7f24d81230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24de31f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d809e850 0x7f24d8122670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24deb20700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24d81340c0 0x7f24d81230f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52190/0 (socket says 172.21.15.72:52190) 2023-10-03T10:19:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24deb20700 1 -- 172.21.15.72:0/2369580305 learned_addr learned my addr 172.21.15.72:0/2369580305 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24ddb1e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24d809f160 0x7f24d8122bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24de31f700 1 -- 172.21.15.72:0/2369580305 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24d81340c0 msgr2=0x7f24d81230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24de31f700 1 --2- 172.21.15.72:0/2369580305 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24d81340c0 0x7f24d81230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24de31f700 1 -- 172.21.15.72:0/2369580305 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24d809f160 msgr2=0x7f24d8122bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24de31f700 1 --2- 172.21.15.72:0/2369580305 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24d809f160 0x7f24d8122bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24de31f700 1 -- 172.21.15.72:0/2369580305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d0009a70 con 0x7f24d809e850 2023-10-03T10:19:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24de31f700 1 --2- 172.21.15.72:0/2369580305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d809e850 0x7f24d8122670 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f24d4016000 tx=0x7f24d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.209+0000 7f24ceffd700 1 -- 172.21.15.72:0/2369580305 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d4004450 con 0x7f24d809e850 2023-10-03T10:19:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.210+0000 7f24ceffd700 1 -- 172.21.15.72:0/2369580305 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d401e070 con 0x7f24d809e850 2023-10-03T10:19:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.210+0000 7f24e0583700 1 -- 172.21.15.72:0/2369580305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d40094a0 con 0x7f24d809e850 2023-10-03T10:19:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.210+0000 7f24ceffd700 1 -- 172.21.15.72:0/2369580305 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d40038c0 con 0x7f24d809e850 2023-10-03T10:19:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.210+0000 7f24e0583700 1 -- 172.21.15.72:0/2369580305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d8125920 con 0x7f24d809e850 2023-10-03T10:19:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.210+0000 7f24ceffd700 1 -- 172.21.15.72:0/2369580305 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f24d4003a20 con 0x7f24d809e850 2023-10-03T10:19:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.211+0000 7f24ceffd700 1 -- 172.21.15.72:0/2369580305 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f24d4020070 con 0x7f24d809e850 2023-10-03T10:19:19.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.211+0000 7f24e0583700 1 -- 172.21.15.72:0/2369580305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d80747f0 con 0x7f24d809e850 2023-10-03T10:19:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.219+0000 7f24ceffd700 1 -- 172.21.15.72:0/2369580305 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24d4015080 con 0x7f24d809e850 2023-10-03T10:19:19.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.241+0000 7f5843509700 1 Processor -- start 2023-10-03T10:19:19.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.242+0000 7f5843509700 1 -- start start 2023-10-03T10:19:19.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.242+0000 7f5843509700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f583c09d630 0x7f583c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.242+0000 7f5843509700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c138d80 0x7f583c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.242+0000 7f5843509700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583c0a2a70 con 0x7f583c0a0a30 2023-10-03T10:19:19.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.242+0000 7f5843509700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583c0a01d0 con 0x7f583c09d630 2023-10-03T10:19:19.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.242+0000 7f5843509700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c09e2b0 con 0x7f583c138d80 2023-10-03T10:19:19.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.242+0000 7f5840aa4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f583c09d630 0x7f583c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.242+0000 7f5840aa4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f583c09d630 0x7f583c0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50774/0 (socket says 172.21.15.72:50774) 2023-10-03T10:19:19.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.242+0000 7f5840aa4700 1 -- 172.21.15.72:0/205650114 learned_addr learned my addr 172.21.15.72:0/205650114 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:19.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.242+0000 7f58412a5700 1 --1- 172.21.15.72:0/205650114 >> v1:172.21.15.72:6789/0 conn(0x7f583c0a0a30 0x7f583c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39876/0 (socket says 172.21.15.72:39876) 2023-10-03T10:19:19.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.242+0000 7f5841aa6700 1 --2- 172.21.15.72:0/205650114 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c138d80 0x7f583c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.242+0000 7f5840aa4700 1 -- 172.21.15.72:0/205650114 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c138d80 msgr2=0x7f583c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:19.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.242+0000 7f5840aa4700 1 --2- 172.21.15.72:0/205650114 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c138d80 0x7f583c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.242+0000 7f5840aa4700 1 -- 172.21.15.72:0/205650114 >> v1:172.21.15.72:6789/0 conn(0x7f583c0a0a30 legacy=0x7f583c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.243+0000 7f5840aa4700 1 -- 172.21.15.72:0/205650114 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c09dc50 con 0x7f583c09d630 2023-10-03T10:19:19.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.243+0000 7f5833fff700 1 -- 172.21.15.72:0/205650114 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198664963 0 0) 0x7f583c0a2a70 con 0x7f583c0a0a30 2023-10-03T10:19:19.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.243+0000 7f5841aa6700 1 --2- 172.21.15.72:0/205650114 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c138d80 0x7f583c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:19.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.243+0000 7f5840aa4700 1 --2- 172.21.15.72:0/205650114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c09d630 0x7f583c0a1510 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f582c0098f0 tx=0x7f582c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee213203d24a13b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.243+0000 7f5833fff700 1 -- 172.21.15.72:0/205650114 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c011830 con 0x7f583c09d630 2023-10-03T10:19:19.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.243+0000 7f5833fff700 1 -- 172.21.15.72:0/205650114 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c011990 con 0x7f583c09d630 2023-10-03T10:19:19.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.243+0000 7f5833fff700 1 -- 172.21.15.72:0/205650114 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c011d20 con 0x7f583c09d630 2023-10-03T10:19:19.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.243+0000 7f5843509700 1 -- 172.21.15.72:0/205650114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c09d630 msgr2=0x7f583c0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.243+0000 7f5843509700 1 --2- 172.21.15.72:0/205650114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c09d630 0x7f583c0a1510 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f582c0098f0 tx=0x7f582c009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.243+0000 7f5843509700 1 -- 172.21.15.72:0/205650114 shutdown_connections 2023-10-03T10:19:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.243+0000 7f5843509700 1 --2- 172.21.15.72:0/205650114 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c138d80 0x7f583c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.243+0000 7f5843509700 1 --2- 172.21.15.72:0/205650114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c09d630 0x7f583c0a1510 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.243+0000 7f5843509700 1 -- 172.21.15.72:0/205650114 >> 172.21.15.72:0/205650114 conn(0x7f583c0a3050 msgr2=0x7f583c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.244+0000 7f5843509700 1 -- 172.21.15.72:0/205650114 shutdown_connections 2023-10-03T10:19:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.244+0000 7f5843509700 1 -- 172.21.15.72:0/205650114 wait complete. 2023-10-03T10:19:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.245+0000 7f5843509700 1 Processor -- start 2023-10-03T10:19:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.245+0000 7f5843509700 1 -- start start 2023-10-03T10:19:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.245+0000 7f5843509700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09d630 0x7f583c133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.245+0000 7f5843509700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c0a0a30 0x7f583c133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.245+0000 7f5843509700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c138d80 0x7f583c134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.245+0000 7f5843509700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c136190 con 0x7f583c138d80 2023-10-03T10:19:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.245+0000 7f5843509700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c136eb0 con 0x7f583c09d630 2023-10-03T10:19:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.245+0000 7f5843509700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f583c0a4ba0 con 0x7f583c0a0a30 2023-10-03T10:19:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f58412a5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09d630 0x7f583c133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f5840aa4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c0a0a30 0x7f583c133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f58412a5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09d630 0x7f583c133700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59082/0 (socket says 172.21.15.72:59082) 2023-10-03T10:19:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f58412a5700 1 -- 172.21.15.72:0/198346091 learned_addr learned my addr 172.21.15.72:0/198346091 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f5841aa6700 1 --2- 172.21.15.72:0/198346091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c138d80 0x7f583c134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f5840aa4700 1 -- 172.21.15.72:0/198346091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09d630 msgr2=0x7f583c133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f5840aa4700 1 --2- 172.21.15.72:0/198346091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09d630 0x7f583c133700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f5840aa4700 1 -- 172.21.15.72:0/198346091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c138d80 msgr2=0x7f583c134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f5840aa4700 1 --2- 172.21.15.72:0/198346091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c138d80 0x7f583c134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f5840aa4700 1 -- 172.21.15.72:0/198346091 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834009a70 con 0x7f583c0a0a30 2023-10-03T10:19:19.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f5841aa6700 1 --2- 172.21.15.72:0/198346091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c138d80 0x7f583c134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:19.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f5840aa4700 1 --2- 172.21.15.72:0/198346091 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c0a0a30 0x7f583c133c40 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f582c016000 tx=0x7f582c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f5831ffb700 1 -- 172.21.15.72:0/198346091 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c004590 con 0x7f583c0a0a30 2023-10-03T10:19:19.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f5831ffb700 1 -- 172.21.15.72:0/198346091 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c0036a0 con 0x7f583c0a0a30 2023-10-03T10:19:19.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f5831ffb700 1 -- 172.21.15.72:0/198346091 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c003a50 con 0x7f583c0a0a30 2023-10-03T10:19:19.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f5843509700 1 -- 172.21.15.72:0/198346091 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c009550 con 0x7f583c0a0a30 2023-10-03T10:19:19.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.246+0000 7f5843509700 1 -- 172.21.15.72:0/198346091 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c0a0460 con 0x7f583c0a0a30 2023-10-03T10:19:19.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.247+0000 7f5831ffb700 1 -- 172.21.15.72:0/198346091 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f582c021070 con 0x7f583c0a0a30 2023-10-03T10:19:19.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.247+0000 7f5831ffb700 1 -- 172.21.15.72:0/198346091 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f582c040b80 con 0x7f583c0a0a30 2023-10-03T10:19:19.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.247+0000 7f5843509700 1 -- 172.21.15.72:0/198346091 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c0747f0 con 0x7f583c0a0a30 2023-10-03T10:19:19.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.252+0000 7f5831ffb700 1 -- 172.21.15.72:0/198346091 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f582c029020 con 0x7f583c0a0a30 2023-10-03T10:19:19.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.377+0000 7f857bbb2700 1 -- 172.21.15.72:0/1501593303 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8574074ea0 con 0x7f857409f240 2023-10-03T10:19:19.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.377+0000 7f856a7fc700 1 -- 172.21.15.72:0/1501593303 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f856402b020 con 0x7f857409f240 2023-10-03T10:19:19.378 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:19.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.380+0000 7f857bbb2700 1 -- 172.21.15.72:0/1501593303 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f857409f240 msgr2=0x7f85741a4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.380+0000 7f857bbb2700 1 --2- 172.21.15.72:0/1501593303 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f857409f240 0x7f85741a4250 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8564009bc0 tx=0x7f8564004750 comp rx=0 tx=0).stop 2023-10-03T10:19:19.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.380+0000 7f857bbb2700 1 -- 172.21.15.72:0/1501593303 shutdown_connections 2023-10-03T10:19:19.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.380+0000 7f857bbb2700 1 --2- 172.21.15.72:0/1501593303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f857409e930 0x7f85741a3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.380+0000 7f857bbb2700 1 --2- 172.21.15.72:0/1501593303 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f857409f650 0x7f85741a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.380+0000 7f857bbb2700 1 --2- 172.21.15.72:0/1501593303 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f857409f240 0x7f85741a4250 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.380+0000 7f857bbb2700 1 -- 172.21.15.72:0/1501593303 >> 172.21.15.72:0/1501593303 conn(0x7f85740a4210 msgr2=0x7f85741b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.380+0000 7f857bbb2700 1 -- 172.21.15.72:0/1501593303 shutdown_connections 2023-10-03T10:19:19.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.380+0000 7f857bbb2700 1 -- 172.21.15.72:0/1501593303 wait complete. 2023-10-03T10:19:19.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:19.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.444+0000 7f5843509700 1 -- 172.21.15.72:0/198346091 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f583c072980 con 0x7f583c0a0a30 2023-10-03T10:19:19.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.444+0000 7f5831ffb700 1 -- 172.21.15.72:0/198346091 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f582c015070 con 0x7f583c0a0a30 2023-10-03T10:19:19.445 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.447+0000 7f5843509700 1 -- 172.21.15.72:0/198346091 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c0a0a30 msgr2=0x7f583c133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.447+0000 7f5843509700 1 --2- 172.21.15.72:0/198346091 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c0a0a30 0x7f583c133c40 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f582c016000 tx=0x7f582c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.447+0000 7f5843509700 1 -- 172.21.15.72:0/198346091 shutdown_connections 2023-10-03T10:19:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.447+0000 7f5843509700 1 --2- 172.21.15.72:0/198346091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f583c138d80 0x7f583c134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.447+0000 7f5843509700 1 --2- 172.21.15.72:0/198346091 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f583c09d630 0x7f583c133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.447+0000 7f5843509700 1 --2- 172.21.15.72:0/198346091 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f583c0a0a30 0x7f583c133c40 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.447+0000 7f5843509700 1 -- 172.21.15.72:0/198346091 >> 172.21.15.72:0/198346091 conn(0x7f583c0a3050 msgr2=0x7f583c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.447+0000 7f5843509700 1 -- 172.21.15.72:0/198346091 shutdown_connections 2023-10-03T10:19:19.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.447+0000 7f5843509700 1 -- 172.21.15.72:0/198346091 wait complete. 2023-10-03T10:19:19.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:19.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.465+0000 7f24e0583700 1 -- 172.21.15.72:0/2369580305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f24d8072840 con 0x7f24d809e850 2023-10-03T10:19:19.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.466+0000 7f24ceffd700 1 -- 172.21.15.72:0/2369580305 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f24d4025480 con 0x7f24d809e850 2023-10-03T10:19:19.467 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:19.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.468+0000 7f24e0583700 1 -- 172.21.15.72:0/2369580305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d809e850 msgr2=0x7f24d8122670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.468+0000 7f24e0583700 1 --2- 172.21.15.72:0/2369580305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d809e850 0x7f24d8122670 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f24d4016000 tx=0x7f24d4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:19.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.468+0000 7f24e0583700 1 -- 172.21.15.72:0/2369580305 shutdown_connections 2023-10-03T10:19:19.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.468+0000 7f24e0583700 1 --2- 172.21.15.72:0/2369580305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d809e850 0x7f24d8122670 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.468+0000 7f24e0583700 1 --2- 172.21.15.72:0/2369580305 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f24d81340c0 0x7f24d81230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.468+0000 7f24e0583700 1 --2- 172.21.15.72:0/2369580305 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24d809f160 0x7f24d8122bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.468+0000 7f24e0583700 1 -- 172.21.15.72:0/2369580305 >> 172.21.15.72:0/2369580305 conn(0x7f24d80a3f70 msgr2=0x7f24d8070a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.468+0000 7f24e0583700 1 -- 172.21.15.72:0/2369580305 shutdown_connections 2023-10-03T10:19:19.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:19.468+0000 7f24e0583700 1 -- 172.21.15.72:0/2369580305 wait complete. 2023-10-03T10:19:19.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:20.029 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:20.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.154+0000 7f22ddc3b700 1 Processor -- start 2023-10-03T10:19:20.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.154+0000 7f22ddc3b700 1 -- start start 2023-10-03T10:19:20.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.155+0000 7f22ddc3b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22d809e1d0 0x7f22d8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.155+0000 7f22ddc3b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22d8135e50 0x7f22d8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.155+0000 7f22ddc3b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d809f130 con 0x7f22d809d6f0 2023-10-03T10:19:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.155+0000 7f22ddc3b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d809f520 con 0x7f22d8135e50 2023-10-03T10:19:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.155+0000 7f22ddc3b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22d809e930 con 0x7f22d809e1d0 2023-10-03T10:19:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.155+0000 7f22d7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22d8135e50 0x7f22d8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.155+0000 7f22d6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22d809e1d0 0x7f22d8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.155+0000 7f22d7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22d8135e50 0x7f22d8138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50794/0 (socket says 172.21.15.72:50794) 2023-10-03T10:19:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.155+0000 7f22d6ffd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22d809e1d0 0x7f22d8135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52202/0 (socket says 172.21.15.72:52202) 2023-10-03T10:19:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.155+0000 7f22d7fff700 1 -- 172.21.15.72:0/576032149 learned_addr learned my addr 172.21.15.72:0/576032149 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.155+0000 7f22d7fff700 1 -- 172.21.15.72:0/576032149 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22d809e1d0 msgr2=0x7f22d8135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.155+0000 7f22d7fff700 1 --2- 172.21.15.72:0/576032149 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22d809e1d0 0x7f22d8135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.155+0000 7f22d7fff700 1 -- 172.21.15.72:0/576032149 >> v1:172.21.15.72:6789/0 conn(0x7f22d809d6f0 legacy=0x7f22d809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.155+0000 7f22d7fff700 1 -- 172.21.15.72:0/576032149 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d809b2d0 con 0x7f22d8135e50 2023-10-03T10:19:20.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.155+0000 7f22d6ffd700 1 --2- 172.21.15.72:0/576032149 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22d809e1d0 0x7f22d8135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:20.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.156+0000 7f22d7fff700 1 --2- 172.21.15.72:0/576032149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d8135e50 0x7f22d8138230 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009e80 tx=0x7f22d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e299eaf44684a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:20.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.156+0000 7f22d67fc700 1 -- 172.21.15.72:0/576032149 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d000e070 con 0x7f22d8135e50 2023-10-03T10:19:20.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.156+0000 7f22d67fc700 1 -- 172.21.15.72:0/576032149 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d000b8d0 con 0x7f22d8135e50 2023-10-03T10:19:20.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.156+0000 7f22d67fc700 1 -- 172.21.15.72:0/576032149 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d000bc80 con 0x7f22d8135e50 2023-10-03T10:19:20.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.156+0000 7f22ddc3b700 1 -- 172.21.15.72:0/576032149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d8135e50 msgr2=0x7f22d8138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.156+0000 7f22ddc3b700 1 --2- 172.21.15.72:0/576032149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d8135e50 0x7f22d8138230 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009e80 tx=0x7f22d000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.156+0000 7f22ddc3b700 1 -- 172.21.15.72:0/576032149 shutdown_connections 2023-10-03T10:19:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.156+0000 7f22ddc3b700 1 --2- 172.21.15.72:0/576032149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d8135e50 0x7f22d8138230 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.156+0000 7f22ddc3b700 1 --2- 172.21.15.72:0/576032149 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22d809e1d0 0x7f22d8135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.156+0000 7f22ddc3b700 1 -- 172.21.15.72:0/576032149 >> 172.21.15.72:0/576032149 conn(0x7f22d8066f50 msgr2=0x7f22d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.156+0000 7f22ddc3b700 1 -- 172.21.15.72:0/576032149 shutdown_connections 2023-10-03T10:19:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.156+0000 7f22ddc3b700 1 -- 172.21.15.72:0/576032149 wait complete. 2023-10-03T10:19:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.157+0000 7f22ddc3b700 1 Processor -- start 2023-10-03T10:19:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.157+0000 7f22ddc3b700 1 -- start start 2023-10-03T10:19:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22ddc3b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22d809d6f0 0x7f22d8120430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22ddc3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d809e1d0 0x7f22d8120970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22ddc3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22d8135e50 0x7f22d81c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22ddc3b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d80a1d70 con 0x7f22d809e1d0 2023-10-03T10:19:20.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22ddc3b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d8120050 con 0x7f22d8135e50 2023-10-03T10:19:20.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22ddc3b700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22d809c700 con 0x7f22d809d6f0 2023-10-03T10:19:20.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22d6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d809e1d0 0x7f22d8120970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22d77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22d809d6f0 0x7f22d8120430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22d6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d809e1d0 0x7f22d8120970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50808/0 (socket says 172.21.15.72:50808) 2023-10-03T10:19:20.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22d7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22d8135e50 0x7f22d81c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22d6ffd700 1 -- 172.21.15.72:0/2208969852 learned_addr learned my addr 172.21.15.72:0/2208969852 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:20.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22d6ffd700 1 -- 172.21.15.72:0/2208969852 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22d809d6f0 msgr2=0x7f22d8120430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22d6ffd700 1 --2- 172.21.15.72:0/2208969852 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22d809d6f0 0x7f22d8120430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22d6ffd700 1 -- 172.21.15.72:0/2208969852 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22d8135e50 msgr2=0x7f22d81c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22d6ffd700 1 --2- 172.21.15.72:0/2208969852 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22d8135e50 0x7f22d81c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22d6ffd700 1 -- 172.21.15.72:0/2208969852 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c80094a0 con 0x7f22d809e1d0 2023-10-03T10:19:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22d77fe700 1 --2- 172.21.15.72:0/2208969852 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22d809d6f0 0x7f22d8120430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22d6ffd700 1 --2- 172.21.15.72:0/2208969852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d809e1d0 0x7f22d8120970 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f22c800ebe0 tx=0x7f22c800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.158+0000 7f22cffff700 1 -- 172.21.15.72:0/2208969852 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c800c850 con 0x7f22d809e1d0 2023-10-03T10:19:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.159+0000 7f22cffff700 1 -- 172.21.15.72:0/2208969852 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c800c9b0 con 0x7f22d809e1d0 2023-10-03T10:19:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.159+0000 7f22cffff700 1 -- 172.21.15.72:0/2208969852 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c800cd40 con 0x7f22d809e1d0 2023-10-03T10:19:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.159+0000 7f22ddc3b700 1 -- 172.21.15.72:0/2208969852 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d0009b30 con 0x7f22d809e1d0 2023-10-03T10:19:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.159+0000 7f22ddc3b700 1 -- 172.21.15.72:0/2208969852 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d81227c0 con 0x7f22d809e1d0 2023-10-03T10:19:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.159+0000 7f22cffff700 1 -- 172.21.15.72:0/2208969852 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22c8013470 con 0x7f22d809e1d0 2023-10-03T10:19:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.159+0000 7f22cffff700 1 -- 172.21.15.72:0/2208969852 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f22c803fb30 con 0x7f22d809e1d0 2023-10-03T10:19:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.159+0000 7f22ddc3b700 1 -- 172.21.15.72:0/2208969852 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d81223e0 con 0x7f22d809e1d0 2023-10-03T10:19:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.164+0000 7f22cffff700 1 -- 172.21.15.72:0/2208969852 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22c8017020 con 0x7f22d809e1d0 2023-10-03T10:19:20.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.350+0000 7f22ddc3b700 1 -- 172.21.15.72:0/2208969852 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f22d804ea50 con 0x7f22d809e1d0 2023-10-03T10:19:20.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.350+0000 7f22cffff700 1 -- 172.21.15.72:0/2208969852 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22c800cea0 con 0x7f22d809e1d0 2023-10-03T10:19:20.351 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:20.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.352+0000 7f22ddc3b700 1 -- 172.21.15.72:0/2208969852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d809e1d0 msgr2=0x7f22d8120970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.352+0000 7f22ddc3b700 1 --2- 172.21.15.72:0/2208969852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d809e1d0 0x7f22d8120970 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f22c800ebe0 tx=0x7f22c800eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.352+0000 7f22ddc3b700 1 -- 172.21.15.72:0/2208969852 shutdown_connections 2023-10-03T10:19:20.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.352+0000 7f22ddc3b700 1 --2- 172.21.15.72:0/2208969852 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22d8135e50 0x7f22d81c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.352+0000 7f22ddc3b700 1 --2- 172.21.15.72:0/2208969852 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f22d809d6f0 0x7f22d8120430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.352+0000 7f22ddc3b700 1 --2- 172.21.15.72:0/2208969852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d809e1d0 0x7f22d8120970 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.352+0000 7f22ddc3b700 1 -- 172.21.15.72:0/2208969852 >> 172.21.15.72:0/2208969852 conn(0x7f22d8066f50 msgr2=0x7f22d80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:20.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.353+0000 7f22ddc3b700 1 -- 172.21.15.72:0/2208969852 shutdown_connections 2023-10-03T10:19:20.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.353+0000 7f22ddc3b700 1 -- 172.21.15.72:0/2208969852 wait complete. 2023-10-03T10:19:20.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:20.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:20.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:20.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.518+0000 7fb341d80700 1 Processor -- start 2023-10-03T10:19:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.518+0000 7fb341d80700 1 -- start start 2023-10-03T10:19:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.518+0000 7fb341d80700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb33c1338a0 0x7fb33c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.518+0000 7fb341d80700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb33c09e930 0x7fb33c13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.518+0000 7fb341d80700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33c06ef30 con 0x7fb33c09de50 2023-10-03T10:19:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.518+0000 7fb341d80700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb33c06fef0 con 0x7fb33c1338a0 2023-10-03T10:19:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.518+0000 7fb341d80700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c1334b0 con 0x7fb33c09e930 2023-10-03T10:19:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.519+0000 7fb33bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb33c09e930 0x7fb33c13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.519+0000 7fb33bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb33c09e930 0x7fb33c13b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52220/0 (socket says 172.21.15.72:52220) 2023-10-03T10:19:20.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.519+0000 7fb33bfff700 1 -- 172.21.15.72:0/2713125118 learned_addr learned my addr 172.21.15.72:0/2713125118 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.519+0000 7fb33affd700 1 --1- 172.21.15.72:0/2713125118 >> v1:172.21.15.72:6789/0 conn(0x7fb33c09de50 0x7fb33c09e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39890/0 (socket says 172.21.15.72:39890) 2023-10-03T10:19:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.519+0000 7fb33b7fe700 1 --2- 172.21.15.72:0/2713125118 >> v2:172.21.15.72:3300/0 conn(0x7fb33c1338a0 0x7fb33c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.519+0000 7fb33a7fc700 1 -- 172.21.15.72:0/2713125118 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005774030 0 0) 0x7fb33c06ef30 con 0x7fb33c09de50 2023-10-03T10:19:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.519+0000 7fb33a7fc700 1 -- 172.21.15.72:0/2713125118 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3240035b0 con 0x7fb33c09de50 2023-10-03T10:19:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.519+0000 7fb33b7fe700 1 -- 172.21.15.72:0/2713125118 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb33c09e930 msgr2=0x7fb33c13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.519+0000 7fb33b7fe700 1 --2- 172.21.15.72:0/2713125118 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb33c09e930 0x7fb33c13b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.519+0000 7fb33b7fe700 1 -- 172.21.15.72:0/2713125118 >> v1:172.21.15.72:6789/0 conn(0x7fb33c09de50 legacy=0x7fb33c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.519+0000 7fb33b7fe700 1 -- 172.21.15.72:0/2713125118 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c06fc30 con 0x7fb33c1338a0 2023-10-03T10:19:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.519+0000 7fb33b7fe700 1 --2- 172.21.15.72:0/2713125118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb33c1338a0 0x7fb33c133c70 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009840 tx=0x7fb32c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d96a135c20ab29e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.519+0000 7fb33a7fc700 1 -- 172.21.15.72:0/2713125118 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c011830 con 0x7fb33c1338a0 2023-10-03T10:19:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.519+0000 7fb33a7fc700 1 -- 172.21.15.72:0/2713125118 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c011990 con 0x7fb33c1338a0 2023-10-03T10:19:20.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.519+0000 7fb33a7fc700 1 -- 172.21.15.72:0/2713125118 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c011d20 con 0x7fb33c1338a0 2023-10-03T10:19:20.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.520+0000 7fb341d80700 1 -- 172.21.15.72:0/2713125118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb33c1338a0 msgr2=0x7fb33c133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.520+0000 7fb341d80700 1 --2- 172.21.15.72:0/2713125118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb33c1338a0 0x7fb33c133c70 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009840 tx=0x7fb32c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:20.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.520+0000 7fb341d80700 1 -- 172.21.15.72:0/2713125118 shutdown_connections 2023-10-03T10:19:20.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.520+0000 7fb341d80700 1 --2- 172.21.15.72:0/2713125118 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb33c09e930 0x7fb33c13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.520+0000 7fb341d80700 1 --2- 172.21.15.72:0/2713125118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb33c1338a0 0x7fb33c133c70 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.520+0000 7fb341d80700 1 -- 172.21.15.72:0/2713125118 >> 172.21.15.72:0/2713125118 conn(0x7fb33c0a2aa0 msgr2=0x7fb33c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:20.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.520+0000 7fb341d80700 1 -- 172.21.15.72:0/2713125118 shutdown_connections 2023-10-03T10:19:20.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.520+0000 7fb341d80700 1 -- 172.21.15.72:0/2713125118 wait complete. 2023-10-03T10:19:20.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.521+0000 7fb341d80700 1 Processor -- start 2023-10-03T10:19:20.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.522+0000 7fb341d80700 1 -- start start 2023-10-03T10:19:20.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.522+0000 7fb341d80700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb33c09de50 0x7fb33c11a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.522+0000 7fb341d80700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb33c09e930 0x7fb33c11ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.522+0000 7fb341d80700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb33c1338a0 0x7fb33c11b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.522+0000 7fb341d80700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c11de20 con 0x7fb33c09de50 2023-10-03T10:19:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.522+0000 7fb341d80700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c06f640 con 0x7fb33c09e930 2023-10-03T10:19:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.522+0000 7fb341d80700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c11c300 con 0x7fb33c1338a0 2023-10-03T10:19:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.522+0000 7fb33b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb33c09de50 0x7fb33c11a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.523+0000 7fb33b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb33c09de50 0x7fb33c11a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50838/0 (socket says 172.21.15.72:50838) 2023-10-03T10:19:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.523+0000 7fb33b7fe700 1 -- 172.21.15.72:0/3875974247 learned_addr learned my addr 172.21.15.72:0/3875974247 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.523+0000 7fb33affd700 1 --2- 172.21.15.72:0/3875974247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb33c09e930 0x7fb33c11ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.523+0000 7fb33bfff700 1 --2- 172.21.15.72:0/3875974247 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb33c1338a0 0x7fb33c11b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.523+0000 7fb33b7fe700 1 -- 172.21.15.72:0/3875974247 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb33c1338a0 msgr2=0x7fb33c11b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.523+0000 7fb33b7fe700 1 --2- 172.21.15.72:0/3875974247 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb33c1338a0 0x7fb33c11b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.523+0000 7fb33b7fe700 1 -- 172.21.15.72:0/3875974247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb33c09e930 msgr2=0x7fb33c11ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.523+0000 7fb33b7fe700 1 --2- 172.21.15.72:0/3875974247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb33c09e930 0x7fb33c11ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.523+0000 7fb33b7fe700 1 -- 172.21.15.72:0/3875974247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c0094a0 con 0x7fb33c09de50 2023-10-03T10:19:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.523+0000 7fb33b7fe700 1 --2- 172.21.15.72:0/3875974247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb33c09de50 0x7fb33c11a630 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0090b0 tx=0x7fb32c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.523+0000 7fb323fff700 1 -- 172.21.15.72:0/3875974247 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c004590 con 0x7fb33c09de50 2023-10-03T10:19:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.523+0000 7fb323fff700 1 -- 172.21.15.72:0/3875974247 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c01f070 con 0x7fb33c09de50 2023-10-03T10:19:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.523+0000 7fb341d80700 1 -- 172.21.15.72:0/3875974247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33c0a0e00 con 0x7fb33c09de50 2023-10-03T10:19:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.523+0000 7fb323fff700 1 -- 172.21.15.72:0/3875974247 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0038e0 con 0x7fb33c09de50 2023-10-03T10:19:20.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.523+0000 7fb341d80700 1 -- 172.21.15.72:0/3875974247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33c11e100 con 0x7fb33c09de50 2023-10-03T10:19:20.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.524+0000 7fb323fff700 1 -- 172.21.15.72:0/3875974247 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb32c003a40 con 0x7fb33c09de50 2023-10-03T10:19:20.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.524+0000 7fb341d80700 1 -- 172.21.15.72:0/3875974247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb33c06ea40 con 0x7fb33c09de50 2023-10-03T10:19:20.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.525+0000 7fb323fff700 1 -- 172.21.15.72:0/3875974247 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb32c021070 con 0x7fb33c09de50 2023-10-03T10:19:20.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.533+0000 7fb323fff700 1 -- 172.21.15.72:0/3875974247 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb32c047080 con 0x7fb33c09de50 2023-10-03T10:19:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.593+0000 7f4879981700 1 Processor -- start 2023-10-03T10:19:20.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.593+0000 7f4879981700 1 -- start start 2023-10-03T10:19:20.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.593+0000 7f4879981700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f487409d6f0 0x7f487409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.593+0000 7f4879981700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f487409e000 0x7f48741339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.593+0000 7f4879981700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f487409e410 0x7f4874133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.593+0000 7f4879981700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487406b460 con 0x7f487409d6f0 2023-10-03T10:19:20.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.593+0000 7f4879981700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487409b120 con 0x7f487409e000 2023-10-03T10:19:20.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.593+0000 7f4879981700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f487409a7e0 con 0x7f487409e410 2023-10-03T10:19:20.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f48737fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f487409e410 0x7f4874133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f48727fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f487409e000 0x7f48741339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f4872ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f487409d6f0 0x7f487409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f48737fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f487409e410 0x7f4874133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52240/0 (socket says 172.21.15.72:52240) 2023-10-03T10:19:20.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f48727fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f487409e000 0x7f48741339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59090/0 (socket says 172.21.15.72:59090) 2023-10-03T10:19:20.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f48737fe700 1 -- 172.21.15.72:0/715496611 learned_addr learned my addr 172.21.15.72:0/715496611 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:20.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f48727fc700 1 -- 172.21.15.72:0/715496611 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f487409e410 msgr2=0x7f4874133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:20.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f48727fc700 1 --2- 172.21.15.72:0/715496611 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f487409e410 0x7f4874133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f48727fc700 1 -- 172.21.15.72:0/715496611 >> v2:172.21.15.72:3300/0 conn(0x7f487409d6f0 msgr2=0x7f487409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:20.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f48727fc700 1 --2- 172.21.15.72:0/715496611 >> v2:172.21.15.72:3300/0 conn(0x7f487409d6f0 0x7f487409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f48727fc700 1 -- 172.21.15.72:0/715496611 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487409a500 con 0x7f487409e000 2023-10-03T10:19:20.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f48737fe700 1 --2- 172.21.15.72:0/715496611 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f487409e410 0x7f4874133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:20.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f4872ffd700 1 --2- 172.21.15.72:0/715496611 >> v2:172.21.15.72:3300/0 conn(0x7f487409d6f0 0x7f487409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:20.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f48727fc700 1 --2- 172.21.15.72:0/715496611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f487409e000 0x7f48741339f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4868009870 tx=0x7f4868009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac9879e3ea75a623 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:20.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f4871ffb700 1 -- 172.21.15.72:0/715496611 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4868011830 con 0x7f487409e000 2023-10-03T10:19:20.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f4871ffb700 1 -- 172.21.15.72:0/715496611 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4868011990 con 0x7f487409e000 2023-10-03T10:19:20.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.594+0000 7f4871ffb700 1 -- 172.21.15.72:0/715496611 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4868011d20 con 0x7f487409e000 2023-10-03T10:19:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.595+0000 7f4879981700 1 -- 172.21.15.72:0/715496611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f487409e000 msgr2=0x7f48741339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.595+0000 7f4879981700 1 --2- 172.21.15.72:0/715496611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f487409e000 0x7f48741339f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4868009870 tx=0x7f4868009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.595+0000 7f4879981700 1 -- 172.21.15.72:0/715496611 shutdown_connections 2023-10-03T10:19:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.595+0000 7f4879981700 1 --2- 172.21.15.72:0/715496611 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f487409e410 0x7f4874133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.595+0000 7f4879981700 1 --2- 172.21.15.72:0/715496611 >> v2:172.21.15.72:3300/0 conn(0x7f487409d6f0 0x7f487409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.595+0000 7f4879981700 1 --2- 172.21.15.72:0/715496611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f487409e000 0x7f48741339f0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.595+0000 7f4879981700 1 -- 172.21.15.72:0/715496611 >> 172.21.15.72:0/715496611 conn(0x7f4874066f50 msgr2=0x7f487409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.595+0000 7f4879981700 1 -- 172.21.15.72:0/715496611 shutdown_connections 2023-10-03T10:19:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.595+0000 7f4879981700 1 -- 172.21.15.72:0/715496611 wait complete. 2023-10-03T10:19:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.596+0000 7f4879981700 1 Processor -- start 2023-10-03T10:19:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.596+0000 7f4879981700 1 -- start start 2023-10-03T10:19:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f4879981700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f487409d6f0 0x7f48741a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f4879981700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f487409e000 0x7f48741a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f4879981700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f487409e410 0x7f48741a6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f4879981700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48741a98d0 con 0x7f487409d6f0 2023-10-03T10:19:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f4879981700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48741aa270 con 0x7f487409e410 2023-10-03T10:19:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f4879981700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48741a9060 con 0x7f487409e000 2023-10-03T10:19:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f4872ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f487409d6f0 0x7f48741a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f48737fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f487409e410 0x7f48741a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f4872ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f487409d6f0 0x7f48741a5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50854/0 (socket says 172.21.15.72:50854) 2023-10-03T10:19:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f4872ffd700 1 -- 172.21.15.72:0/3759121640 learned_addr learned my addr 172.21.15.72:0/3759121640 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:20.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f48727fc700 1 --2- 172.21.15.72:0/3759121640 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f487409e000 0x7f48741a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f48737fe700 1 -- 172.21.15.72:0/3759121640 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f487409e000 msgr2=0x7f48741a62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f48737fe700 1 --2- 172.21.15.72:0/3759121640 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f487409e000 0x7f48741a62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f48737fe700 1 -- 172.21.15.72:0/3759121640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f487409d6f0 msgr2=0x7f48741a5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f48737fe700 1 --2- 172.21.15.72:0/3759121640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f487409d6f0 0x7f48741a5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.597+0000 7f48737fe700 1 -- 172.21.15.72:0/3759121640 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48640094a0 con 0x7f487409e410 2023-10-03T10:19:20.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.598+0000 7f48737fe700 1 --2- 172.21.15.72:0/3759121640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f487409e410 0x7f48741a6830 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f486c00efc0 tx=0x7f486c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:20.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.598+0000 7f485bfff700 1 -- 172.21.15.72:0/3759121640 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c018070 con 0x7f487409e410 2023-10-03T10:19:20.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.598+0000 7f485bfff700 1 -- 172.21.15.72:0/3759121640 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c00f040 con 0x7f487409e410 2023-10-03T10:19:20.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.598+0000 7f485bfff700 1 -- 172.21.15.72:0/3759121640 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c003c60 con 0x7f487409e410 2023-10-03T10:19:20.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.598+0000 7f4879981700 1 -- 172.21.15.72:0/3759121640 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486c009b30 con 0x7f487409e410 2023-10-03T10:19:20.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.598+0000 7f4879981700 1 -- 172.21.15.72:0/3759121640 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48680094a0 con 0x7f487409e410 2023-10-03T10:19:20.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.599+0000 7f485bfff700 1 -- 172.21.15.72:0/3759121640 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f486c00c880 con 0x7f487409e410 2023-10-03T10:19:20.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.599+0000 7f4879981700 1 -- 172.21.15.72:0/3759121640 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487409c770 con 0x7f487409e410 2023-10-03T10:19:20.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.599+0000 7f485bfff700 1 -- 172.21.15.72:0/3759121640 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f486c03f730 con 0x7f487409e410 2023-10-03T10:19:20.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.608+0000 7f485bfff700 1 -- 172.21.15.72:0/3759121640 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f486c0149a0 con 0x7f487409e410 2023-10-03T10:19:20.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.631+0000 7efc5c95f700 1 Processor -- start 2023-10-03T10:19:20.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.631+0000 7efc5c95f700 1 -- start start 2023-10-03T10:19:20.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc5c95f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc580a0a30 0x7efc580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc5c95f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efc5809d630 0x7efc580a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc5c95f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc58133930 0x7efc58133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc5c95f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc580a2a70 con 0x7efc5809d630 2023-10-03T10:19:20.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc5c95f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc580a01d0 con 0x7efc58133930 2023-10-03T10:19:20.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc5c95f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc5809e2b0 con 0x7efc580a0a30 2023-10-03T10:19:20.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc5659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc580a0a30 0x7efc580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc5659c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc580a0a30 0x7efc580a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52256/0 (socket says 172.21.15.72:52256) 2023-10-03T10:19:20.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc5659c700 1 -- 172.21.15.72:0/2142399546 learned_addr learned my addr 172.21.15.72:0/2142399546 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:20.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc56d9d700 1 --2- 172.21.15.72:0/2142399546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc58133930 0x7efc58133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc55d9b700 1 --2- 172.21.15.72:0/2142399546 >> v2:172.21.15.72:3300/0 conn(0x7efc5809d630 0x7efc580a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc5659c700 1 -- 172.21.15.72:0/2142399546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc58133930 msgr2=0x7efc58133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:20.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc5659c700 1 --2- 172.21.15.72:0/2142399546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc58133930 0x7efc58133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc5659c700 1 -- 172.21.15.72:0/2142399546 >> v2:172.21.15.72:3300/0 conn(0x7efc5809d630 msgr2=0x7efc580a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:20.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc5659c700 1 --2- 172.21.15.72:0/2142399546 >> v2:172.21.15.72:3300/0 conn(0x7efc5809d630 0x7efc580a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.632+0000 7efc5659c700 1 -- 172.21.15.72:0/2142399546 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5809dc50 con 0x7efc580a0a30 2023-10-03T10:19:20.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.633+0000 7efc5659c700 1 --2- 172.21.15.72:0/2142399546 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc580a0a30 0x7efc580a0e00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7efc480098f0 tx=0x7efc48009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54612cef9e16e8e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:20.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.633+0000 7efc5559a700 1 -- 172.21.15.72:0/2142399546 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48011830 con 0x7efc580a0a30 2023-10-03T10:19:20.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.633+0000 7efc5559a700 1 -- 172.21.15.72:0/2142399546 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc48011990 con 0x7efc580a0a30 2023-10-03T10:19:20.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.633+0000 7efc5559a700 1 -- 172.21.15.72:0/2142399546 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48011d20 con 0x7efc580a0a30 2023-10-03T10:19:20.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.633+0000 7efc5c95f700 1 -- 172.21.15.72:0/2142399546 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc580a0a30 msgr2=0x7efc580a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.633+0000 7efc5c95f700 1 --2- 172.21.15.72:0/2142399546 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc580a0a30 0x7efc580a0e00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7efc480098f0 tx=0x7efc48009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:20.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.633+0000 7efc5c95f700 1 -- 172.21.15.72:0/2142399546 shutdown_connections 2023-10-03T10:19:20.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.633+0000 7efc5c95f700 1 --2- 172.21.15.72:0/2142399546 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc58133930 0x7efc58133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.633+0000 7efc5c95f700 1 --2- 172.21.15.72:0/2142399546 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc580a0a30 0x7efc580a0e00 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.633+0000 7efc5c95f700 1 --2- 172.21.15.72:0/2142399546 >> v2:172.21.15.72:3300/0 conn(0x7efc5809d630 0x7efc580a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.633+0000 7efc5c95f700 1 -- 172.21.15.72:0/2142399546 >> 172.21.15.72:0/2142399546 conn(0x7efc580a3050 msgr2=0x7efc580a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:20.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.633+0000 7efc5c95f700 1 -- 172.21.15.72:0/2142399546 shutdown_connections 2023-10-03T10:19:20.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.633+0000 7efc5c95f700 1 -- 172.21.15.72:0/2142399546 wait complete. 2023-10-03T10:19:20.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.634+0000 7efc5c95f700 1 Processor -- start 2023-10-03T10:19:20.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc5c95f700 1 -- start start 2023-10-03T10:19:20.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc5c95f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5809d630 0x7efc581c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc5c95f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc580a0a30 0x7efc581c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc5c95f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc58133930 0x7efc581c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc5c95f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc581207d0 con 0x7efc580a0a30 2023-10-03T10:19:20.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc5c95f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc581205e0 con 0x7efc5809d630 2023-10-03T10:19:20.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc5c95f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc581224f0 con 0x7efc58133930 2023-10-03T10:19:20.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc5659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5809d630 0x7efc581c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc55d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc580a0a30 0x7efc581c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc55d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc580a0a30 0x7efc581c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50878/0 (socket says 172.21.15.72:50878) 2023-10-03T10:19:20.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc5659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5809d630 0x7efc581c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59122/0 (socket says 172.21.15.72:59122) 2023-10-03T10:19:20.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc55d9b700 1 -- 172.21.15.72:0/4062487325 learned_addr learned my addr 172.21.15.72:0/4062487325 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:20.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc56d9d700 1 --2- 172.21.15.72:0/4062487325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc58133930 0x7efc581c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc5659c700 1 -- 172.21.15.72:0/4062487325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc58133930 msgr2=0x7efc581c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc5659c700 1 --2- 172.21.15.72:0/4062487325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc58133930 0x7efc581c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc5659c700 1 -- 172.21.15.72:0/4062487325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc580a0a30 msgr2=0x7efc581c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc5659c700 1 --2- 172.21.15.72:0/4062487325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc580a0a30 0x7efc581c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.635+0000 7efc5659c700 1 -- 172.21.15.72:0/4062487325 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc48009550 con 0x7efc5809d630 2023-10-03T10:19:20.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.636+0000 7efc55d9b700 1 --2- 172.21.15.72:0/4062487325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc580a0a30 0x7efc581c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:20.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.636+0000 7efc5659c700 1 --2- 172.21.15.72:0/4062487325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5809d630 0x7efc581c8090 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7efc48016000 tx=0x7efc48004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:20.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.636+0000 7efc46ffd700 1 -- 172.21.15.72:0/4062487325 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48004450 con 0x7efc5809d630 2023-10-03T10:19:20.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.636+0000 7efc46ffd700 1 -- 172.21.15.72:0/4062487325 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc480045b0 con 0x7efc5809d630 2023-10-03T10:19:20.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.636+0000 7efc46ffd700 1 -- 172.21.15.72:0/4062487325 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc480038e0 con 0x7efc5809d630 2023-10-03T10:19:20.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.636+0000 7efc5c95f700 1 -- 172.21.15.72:0/4062487325 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc580a5e50 con 0x7efc5809d630 2023-10-03T10:19:20.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.636+0000 7efc5c95f700 1 -- 172.21.15.72:0/4062487325 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc58122210 con 0x7efc5809d630 2023-10-03T10:19:20.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.637+0000 7efc46ffd700 1 -- 172.21.15.72:0/4062487325 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc48021070 con 0x7efc5809d630 2023-10-03T10:19:20.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.637+0000 7efc46ffd700 1 -- 172.21.15.72:0/4062487325 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efc480408c0 con 0x7efc5809d630 2023-10-03T10:19:20.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.637+0000 7efc5c95f700 1 -- 172.21.15.72:0/4062487325 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc580008d0 con 0x7efc5809d630 2023-10-03T10:19:20.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.642+0000 7efc46ffd700 1 -- 172.21.15.72:0/4062487325 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc48029020 con 0x7efc5809d630 2023-10-03T10:19:20.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.737+0000 7fb341d80700 1 -- 172.21.15.72:0/3875974247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb33c074ea0 con 0x7fb33c09de50 2023-10-03T10:19:20.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.738+0000 7fb323fff700 1 -- 172.21.15.72:0/3875974247 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb32c015030 con 0x7fb33c09de50 2023-10-03T10:19:20.739 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.740+0000 7fb341d80700 1 -- 172.21.15.72:0/3875974247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb33c09de50 msgr2=0x7fb33c11a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.740+0000 7fb341d80700 1 --2- 172.21.15.72:0/3875974247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb33c09de50 0x7fb33c11a630 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0090b0 tx=0x7fb32c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.740+0000 7fb341d80700 1 -- 172.21.15.72:0/3875974247 shutdown_connections 2023-10-03T10:19:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.740+0000 7fb341d80700 1 --2- 172.21.15.72:0/3875974247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb33c09de50 0x7fb33c11a630 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.740+0000 7fb341d80700 1 --2- 172.21.15.72:0/3875974247 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb33c1338a0 0x7fb33c11b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.740+0000 7fb341d80700 1 --2- 172.21.15.72:0/3875974247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb33c09e930 0x7fb33c11ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.740+0000 7fb341d80700 1 -- 172.21.15.72:0/3875974247 >> 172.21.15.72:0/3875974247 conn(0x7fb33c0a2aa0 msgr2=0x7fb33c09ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.740+0000 7fb341d80700 1 -- 172.21.15.72:0/3875974247 shutdown_connections 2023-10-03T10:19:20.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.740+0000 7fb341d80700 1 -- 172.21.15.72:0/3875974247 wait complete. 2023-10-03T10:19:20.753 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:20.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.807+0000 7f4879981700 1 -- 172.21.15.72:0/3759121640 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4874074ea0 con 0x7f487409e410 2023-10-03T10:19:20.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.808+0000 7f485bfff700 1 -- 172.21.15.72:0/3759121640 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f486c01de00 con 0x7f487409e410 2023-10-03T10:19:20.808 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:20.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.810+0000 7f4879981700 1 -- 172.21.15.72:0/3759121640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f487409e410 msgr2=0x7f48741a6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.810+0000 7f4879981700 1 --2- 172.21.15.72:0/3759121640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f487409e410 0x7f48741a6830 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f486c00efc0 tx=0x7f486c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.810+0000 7f4879981700 1 -- 172.21.15.72:0/3759121640 shutdown_connections 2023-10-03T10:19:20.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.810+0000 7f4879981700 1 --2- 172.21.15.72:0/3759121640 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f487409d6f0 0x7f48741a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.810+0000 7f4879981700 1 --2- 172.21.15.72:0/3759121640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f487409e410 0x7f48741a6830 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.810+0000 7f4879981700 1 --2- 172.21.15.72:0/3759121640 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f487409e000 0x7f48741a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.810+0000 7f4879981700 1 -- 172.21.15.72:0/3759121640 >> 172.21.15.72:0/3759121640 conn(0x7f4874066f50 msgr2=0x7f48741bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:20.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.810+0000 7f4879981700 1 -- 172.21.15.72:0/3759121640 shutdown_connections 2023-10-03T10:19:20.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.810+0000 7f4879981700 1 -- 172.21.15.72:0/3759121640 wait complete. 2023-10-03T10:19:20.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:20.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.838+0000 7efc5c95f700 1 -- 172.21.15.72:0/4062487325 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efc58072980 con 0x7efc5809d630 2023-10-03T10:19:20.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.838+0000 7efc46ffd700 1 -- 172.21.15.72:0/4062487325 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7efc48015070 con 0x7efc5809d630 2023-10-03T10:19:20.839 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.840+0000 7efc5c95f700 1 -- 172.21.15.72:0/4062487325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5809d630 msgr2=0x7efc581c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.840+0000 7efc5c95f700 1 --2- 172.21.15.72:0/4062487325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5809d630 0x7efc581c8090 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7efc48016000 tx=0x7efc48004750 comp rx=0 tx=0).stop 2023-10-03T10:19:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.840+0000 7efc5c95f700 1 -- 172.21.15.72:0/4062487325 shutdown_connections 2023-10-03T10:19:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.840+0000 7efc5c95f700 1 --2- 172.21.15.72:0/4062487325 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7efc58133930 0x7efc581c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.840+0000 7efc5c95f700 1 --2- 172.21.15.72:0/4062487325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc5809d630 0x7efc581c8090 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.840+0000 7efc5c95f700 1 --2- 172.21.15.72:0/4062487325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc580a0a30 0x7efc581c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.840+0000 7efc5c95f700 1 -- 172.21.15.72:0/4062487325 >> 172.21.15.72:0/4062487325 conn(0x7efc580a3050 msgr2=0x7efc5809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.840+0000 7efc5c95f700 1 -- 172.21.15.72:0/4062487325 shutdown_connections 2023-10-03T10:19:20.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:20.840+0000 7efc5c95f700 1 -- 172.21.15.72:0/4062487325 wait complete. 2023-10-03T10:19:20.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:21.366 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:21.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.494+0000 7f2a588b9700 1 Processor -- start 2023-10-03T10:19:21.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.494+0000 7f2a588b9700 1 -- start start 2023-10-03T10:19:21.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a588b9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a541338a0 0x7f2a54133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a588b9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a5409e930 0x7f2a5413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a588b9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5406ef30 con 0x7f2a5409de50 2023-10-03T10:19:21.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a588b9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5406fef0 con 0x7f2a541338a0 2023-10-03T10:19:21.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a588b9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a541334b0 con 0x7f2a5409e930 2023-10-03T10:19:21.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a5259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a541338a0 0x7f2a54133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a52d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a5409e930 0x7f2a5413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a5259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a541338a0 0x7f2a54133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50884/0 (socket says 172.21.15.72:50884) 2023-10-03T10:19:21.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a5259c700 1 -- 172.21.15.72:0/25908926 learned_addr learned my addr 172.21.15.72:0/25908926 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:21.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a52d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a5409e930 0x7f2a5413b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52274/0 (socket says 172.21.15.72:52274) 2023-10-03T10:19:21.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a5259c700 1 -- 172.21.15.72:0/25908926 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a5409e930 msgr2=0x7f2a5413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a5259c700 1 --2- 172.21.15.72:0/25908926 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a5409e930 0x7f2a5413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a5259c700 1 -- 172.21.15.72:0/25908926 >> v1:172.21.15.72:6789/0 conn(0x7f2a5409de50 legacy=0x7f2a5409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a5259c700 1 -- 172.21.15.72:0/25908926 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5406fc30 con 0x7f2a541338a0 2023-10-03T10:19:21.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a52d9d700 1 --2- 172.21.15.72:0/25908926 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a5409e930 0x7f2a5413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a5259c700 1 --2- 172.21.15.72:0/25908926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a541338a0 0x7f2a54133c70 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f2a480098f0 tx=0x7f2a48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ce2b93cfe65e42 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a5159a700 1 -- 172.21.15.72:0/25908926 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48011830 con 0x7f2a541338a0 2023-10-03T10:19:21.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.495+0000 7f2a5159a700 1 -- 172.21.15.72:0/25908926 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a48011990 con 0x7f2a541338a0 2023-10-03T10:19:21.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.496+0000 7f2a5159a700 1 -- 172.21.15.72:0/25908926 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48011d20 con 0x7f2a541338a0 2023-10-03T10:19:21.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.496+0000 7f2a588b9700 1 -- 172.21.15.72:0/25908926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a541338a0 msgr2=0x7f2a54133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.496+0000 7f2a588b9700 1 --2- 172.21.15.72:0/25908926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a541338a0 0x7f2a54133c70 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f2a480098f0 tx=0x7f2a48009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:21.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.496+0000 7f2a588b9700 1 -- 172.21.15.72:0/25908926 shutdown_connections 2023-10-03T10:19:21.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.496+0000 7f2a588b9700 1 --2- 172.21.15.72:0/25908926 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a5409e930 0x7f2a5413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.496+0000 7f2a588b9700 1 --2- 172.21.15.72:0/25908926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a541338a0 0x7f2a54133c70 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.496+0000 7f2a588b9700 1 -- 172.21.15.72:0/25908926 >> 172.21.15.72:0/25908926 conn(0x7f2a540a2aa0 msgr2=0x7f2a540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.496+0000 7f2a588b9700 1 -- 172.21.15.72:0/25908926 shutdown_connections 2023-10-03T10:19:21.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.496+0000 7f2a588b9700 1 -- 172.21.15.72:0/25908926 wait complete. 2023-10-03T10:19:21.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.497+0000 7f2a588b9700 1 Processor -- start 2023-10-03T10:19:21.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.497+0000 7f2a588b9700 1 -- start start 2023-10-03T10:19:21.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a588b9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a5409de50 0x7f2a5411efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a588b9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a5409e930 0x7f2a5411f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a588b9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a541338a0 0x7f2a5411fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a588b9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a541210a0 con 0x7f2a541338a0 2023-10-03T10:19:21.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a588b9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a541226e0 con 0x7f2a5409e930 2023-10-03T10:19:21.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a588b9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a541207d0 con 0x7f2a5409de50 2023-10-03T10:19:21.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a5259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a5409de50 0x7f2a5411efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a5259c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a5409de50 0x7f2a5411efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52284/0 (socket says 172.21.15.72:52284) 2023-10-03T10:19:21.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a52d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a541338a0 0x7f2a5411fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a5259c700 1 -- 172.21.15.72:0/1716876166 learned_addr learned my addr 172.21.15.72:0/1716876166 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:21.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a51d9b700 1 --2- 172.21.15.72:0/1716876166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a5409e930 0x7f2a5411f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a5259c700 1 -- 172.21.15.72:0/1716876166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a5409e930 msgr2=0x7f2a5411f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a5259c700 1 --2- 172.21.15.72:0/1716876166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a5409e930 0x7f2a5411f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a5259c700 1 -- 172.21.15.72:0/1716876166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a541338a0 msgr2=0x7f2a5411fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a5259c700 1 --2- 172.21.15.72:0/1716876166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a541338a0 0x7f2a5411fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a5259c700 1 -- 172.21.15.72:0/1716876166 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c009a70 con 0x7f2a5409de50 2023-10-03T10:19:21.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a52d9d700 1 --2- 172.21.15.72:0/1716876166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a541338a0 0x7f2a5411fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a5259c700 1 --2- 172.21.15.72:0/1716876166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a5409de50 0x7f2a5411efa0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009c40 tx=0x7f2a48004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a42ffd700 1 -- 172.21.15.72:0/1716876166 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a480043c0 con 0x7f2a5409de50 2023-10-03T10:19:21.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a42ffd700 1 -- 172.21.15.72:0/1716876166 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4801f070 con 0x7f2a5409de50 2023-10-03T10:19:21.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a588b9700 1 -- 172.21.15.72:0/1716876166 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a48009550 con 0x7f2a5409de50 2023-10-03T10:19:21.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a42ffd700 1 -- 172.21.15.72:0/1716876166 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a480036a0 con 0x7f2a5409de50 2023-10-03T10:19:21.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.498+0000 7f2a588b9700 1 -- 172.21.15.72:0/1716876166 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5412f6e0 con 0x7f2a5409de50 2023-10-03T10:19:21.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.499+0000 7f2a42ffd700 1 -- 172.21.15.72:0/1716876166 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a48021030 con 0x7f2a5409de50 2023-10-03T10:19:21.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.499+0000 7f2a42ffd700 1 -- 172.21.15.72:0/1716876166 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2a48040940 con 0x7f2a5409de50 2023-10-03T10:19:21.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.499+0000 7f2a588b9700 1 -- 172.21.15.72:0/1716876166 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a54074ea0 con 0x7f2a5409de50 2023-10-03T10:19:21.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.504+0000 7f2a42ffd700 1 -- 172.21.15.72:0/1716876166 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a48015080 con 0x7f2a5409de50 2023-10-03T10:19:21.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.692+0000 7f2a588b9700 1 -- 172.21.15.72:0/1716876166 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2a5406b9e0 con 0x7f2a5409de50 2023-10-03T10:19:21.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.693+0000 7f2a42ffd700 1 -- 172.21.15.72:0/1716876166 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a480199a0 con 0x7f2a5409de50 2023-10-03T10:19:21.693 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.694+0000 7f2a588b9700 1 -- 172.21.15.72:0/1716876166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a5409de50 msgr2=0x7f2a5411efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.694+0000 7f2a588b9700 1 --2- 172.21.15.72:0/1716876166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a5409de50 0x7f2a5411efa0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009c40 tx=0x7f2a48004750 comp rx=0 tx=0).stop 2023-10-03T10:19:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.695+0000 7f2a588b9700 1 -- 172.21.15.72:0/1716876166 shutdown_connections 2023-10-03T10:19:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.695+0000 7f2a588b9700 1 --2- 172.21.15.72:0/1716876166 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a541338a0 0x7f2a5411fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.695+0000 7f2a588b9700 1 --2- 172.21.15.72:0/1716876166 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f2a5409de50 0x7f2a5411efa0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.695+0000 7f2a588b9700 1 --2- 172.21.15.72:0/1716876166 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a5409e930 0x7f2a5411f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.695+0000 7f2a588b9700 1 -- 172.21.15.72:0/1716876166 >> 172.21.15.72:0/1716876166 conn(0x7f2a540a2aa0 msgr2=0x7f2a5409ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.695+0000 7f2a588b9700 1 -- 172.21.15.72:0/1716876166 shutdown_connections 2023-10-03T10:19:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.695+0000 7f2a588b9700 1 -- 172.21.15.72:0/1716876166 wait complete. 2023-10-03T10:19:21.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:21.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:21.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:21.853 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.878+0000 7fc1e68c5700 1 Processor -- start 2023-10-03T10:19:21.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.878+0000 7fc1e68c5700 1 -- start start 2023-10-03T10:19:21.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.878+0000 7fc1e68c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1e009d6f0 0x7fc1e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.878+0000 7fc1e68c5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1e009e000 0x7fc1e01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.878+0000 7fc1e68c5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc1e009e410 0x7fc1e0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.878+0000 7fc1e68c5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e006b460 con 0x7fc1e009e410 2023-10-03T10:19:21.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.878+0000 7fc1e68c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e009b120 con 0x7fc1e009d6f0 2023-10-03T10:19:21.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.878+0000 7fc1e68c5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e009a7e0 con 0x7fc1e009e000 2023-10-03T10:19:21.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.879+0000 7fc1df7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1e009e000 0x7fc1e01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.879+0000 7fc1e4e62700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc1e009e410 0x7fc1e0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.879+0000 7fc1df7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1e009e000 0x7fc1e01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52298/0 (socket says 172.21.15.72:52298) 2023-10-03T10:19:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.879+0000 7fc1df7fe700 1 -- 172.21.15.72:0/4186848336 learned_addr learned my addr 172.21.15.72:0/4186848336 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.879+0000 7fc1dffff700 1 --2- 172.21.15.72:0/4186848336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1e009d6f0 0x7fc1e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.879+0000 7fc1df7fe700 1 -- 172.21.15.72:0/4186848336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1e009d6f0 msgr2=0x7fc1e009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.879+0000 7fc1df7fe700 1 --2- 172.21.15.72:0/4186848336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1e009d6f0 0x7fc1e009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.879+0000 7fc1df7fe700 1 -- 172.21.15.72:0/4186848336 >> v2:172.21.15.72:3300/0 conn(0x7fc1e009e410 msgr2=0x7fc1e0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.879+0000 7fc1df7fe700 1 --2- 172.21.15.72:0/4186848336 >> v2:172.21.15.72:3300/0 conn(0x7fc1e009e410 0x7fc1e0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.879+0000 7fc1df7fe700 1 -- 172.21.15.72:0/4186848336 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e009a500 con 0x7fc1e009e000 2023-10-03T10:19:21.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.879+0000 7fc1e4e62700 1 --2- 172.21.15.72:0/4186848336 >> v2:172.21.15.72:3300/0 conn(0x7fc1e009e410 0x7fc1e0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.879+0000 7fc1df7fe700 1 --2- 172.21.15.72:0/4186848336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1e009e000 0x7fc1e01339f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4009920 tx=0x7fc1d4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=221baf3586a9ac40 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.879+0000 7fc1deffd700 1 -- 172.21.15.72:0/4186848336 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4011830 con 0x7fc1e009e000 2023-10-03T10:19:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.879+0000 7fc1deffd700 1 -- 172.21.15.72:0/4186848336 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d4011990 con 0x7fc1e009e000 2023-10-03T10:19:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.879+0000 7fc1deffd700 1 -- 172.21.15.72:0/4186848336 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4011d20 con 0x7fc1e009e000 2023-10-03T10:19:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.880+0000 7fc1e68c5700 1 -- 172.21.15.72:0/4186848336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1e009e000 msgr2=0x7fc1e01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.880+0000 7fc1e68c5700 1 --2- 172.21.15.72:0/4186848336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1e009e000 0x7fc1e01339f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4009920 tx=0x7fc1d4009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.880+0000 7fc1e68c5700 1 -- 172.21.15.72:0/4186848336 shutdown_connections 2023-10-03T10:19:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.880+0000 7fc1e68c5700 1 --2- 172.21.15.72:0/4186848336 >> v2:172.21.15.72:3300/0 conn(0x7fc1e009e410 0x7fc1e0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.880+0000 7fc1e68c5700 1 --2- 172.21.15.72:0/4186848336 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1e009d6f0 0x7fc1e009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.880+0000 7fc1e68c5700 1 --2- 172.21.15.72:0/4186848336 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1e009e000 0x7fc1e01339f0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.880+0000 7fc1e68c5700 1 -- 172.21.15.72:0/4186848336 >> 172.21.15.72:0/4186848336 conn(0x7fc1e0066f50 msgr2=0x7fc1e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.880+0000 7fc1e68c5700 1 -- 172.21.15.72:0/4186848336 shutdown_connections 2023-10-03T10:19:21.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.880+0000 7fc1e68c5700 1 -- 172.21.15.72:0/4186848336 wait complete. 2023-10-03T10:19:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.881+0000 7fc1e68c5700 1 Processor -- start 2023-10-03T10:19:21.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.881+0000 7fc1e68c5700 1 -- start start 2023-10-03T10:19:21.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1e68c5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1e009d6f0 0x7fc1e0122640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1e68c5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1e009e000 0x7fc1e0122b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1e68c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1e009e410 0x7fc1e01230c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1e68c5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0125f60 con 0x7fc1e009e000 2023-10-03T10:19:21.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1e68c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0124250 con 0x7fc1e009e410 2023-10-03T10:19:21.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1e68c5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e009c710 con 0x7fc1e009d6f0 2023-10-03T10:19:21.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1dffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1e009d6f0 0x7fc1e0122640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1df7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1e009e000 0x7fc1e0122b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1dffff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1e009d6f0 0x7fc1e0122640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52300/0 (socket says 172.21.15.72:52300) 2023-10-03T10:19:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1df7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1e009e000 0x7fc1e0122b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50928/0 (socket says 172.21.15.72:50928) 2023-10-03T10:19:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1dffff700 1 -- 172.21.15.72:0/1895363596 learned_addr learned my addr 172.21.15.72:0/1895363596 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1e4e62700 1 --2- 172.21.15.72:0/1895363596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1e009e410 0x7fc1e01230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1df7fe700 1 -- 172.21.15.72:0/1895363596 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1e009d6f0 msgr2=0x7fc1e0122640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1df7fe700 1 --2- 172.21.15.72:0/1895363596 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1e009d6f0 0x7fc1e0122640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1df7fe700 1 -- 172.21.15.72:0/1895363596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1e009e410 msgr2=0x7fc1e01230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1df7fe700 1 --2- 172.21.15.72:0/1895363596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1e009e410 0x7fc1e01230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.882+0000 7fc1df7fe700 1 -- 172.21.15.72:0/1895363596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d8009a70 con 0x7fc1e009e000 2023-10-03T10:19:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.883+0000 7fc1df7fe700 1 --2- 172.21.15.72:0/1895363596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1e009e000 0x7fc1e0122b80 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4016000 tx=0x7fc1d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.883+0000 7fc1dcff9700 1 -- 172.21.15.72:0/1895363596 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4004450 con 0x7fc1e009e000 2023-10-03T10:19:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.883+0000 7fc1e68c5700 1 -- 172.21.15.72:0/1895363596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d4009550 con 0x7fc1e009e000 2023-10-03T10:19:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.883+0000 7fc1dcff9700 1 -- 172.21.15.72:0/1895363596 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d40045d0 con 0x7fc1e009e000 2023-10-03T10:19:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.883+0000 7fc1dcff9700 1 -- 172.21.15.72:0/1895363596 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d40038e0 con 0x7fc1e009e000 2023-10-03T10:19:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.883+0000 7fc1e68c5700 1 -- 172.21.15.72:0/1895363596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e01268f0 con 0x7fc1e009e000 2023-10-03T10:19:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.884+0000 7fc1dcff9700 1 -- 172.21.15.72:0/1895363596 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1d4003a40 con 0x7fc1e009e000 2023-10-03T10:19:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.884+0000 7fc1dcff9700 1 -- 172.21.15.72:0/1895363596 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc1d4040980 con 0x7fc1e009e000 2023-10-03T10:19:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.884+0000 7fc1e68c5700 1 -- 172.21.15.72:0/1895363596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e01331c0 con 0x7fc1e009e000 2023-10-03T10:19:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.889+0000 7fc1dcff9700 1 -- 172.21.15.72:0/1895363596 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1d4015080 con 0x7fc1e009e000 2023-10-03T10:19:21.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.950+0000 7fb88e5f9700 1 Processor -- start 2023-10-03T10:19:21.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.950+0000 7fb88e5f9700 1 -- start start 2023-10-03T10:19:21.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb88e5f9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8880a0a30 0x7fb8880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb88e5f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88809d630 0x7fb8880a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb88e5f9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb888133930 0x7fb888133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb88e5f9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8880a2a70 con 0x7fb8880a0a30 2023-10-03T10:19:21.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb88e5f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8880a01d0 con 0x7fb88809d630 2023-10-03T10:19:21.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb88e5f9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb88809e2b0 con 0x7fb888133930 2023-10-03T10:19:21.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb887fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8880a0a30 0x7fb8880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb8877fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88809d630 0x7fb8880a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb88cb96700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb888133930 0x7fb888133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb887fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb8880a0a30 0x7fb8880a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50934/0 (socket says 172.21.15.72:50934) 2023-10-03T10:19:21.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb8877fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88809d630 0x7fb8880a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59170/0 (socket says 172.21.15.72:59170) 2023-10-03T10:19:21.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb887fff700 1 -- 172.21.15.72:0/3371938615 learned_addr learned my addr 172.21.15.72:0/3371938615 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:21.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb8877fe700 1 -- 172.21.15.72:0/3371938615 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb888133930 msgr2=0x7fb888133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb8877fe700 1 --2- 172.21.15.72:0/3371938615 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb888133930 0x7fb888133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb8877fe700 1 -- 172.21.15.72:0/3371938615 >> v2:172.21.15.72:3300/0 conn(0x7fb8880a0a30 msgr2=0x7fb8880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb8877fe700 1 --2- 172.21.15.72:0/3371938615 >> v2:172.21.15.72:3300/0 conn(0x7fb8880a0a30 0x7fb8880a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.951+0000 7fb8877fe700 1 -- 172.21.15.72:0/3371938615 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88809dc50 con 0x7fb88809d630 2023-10-03T10:19:21.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.952+0000 7fb8877fe700 1 --2- 172.21.15.72:0/3371938615 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88809d630 0x7fb8880a1340 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009840 tx=0x7fb87c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb221b5a8bde04cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.952+0000 7fb886ffd700 1 -- 172.21.15.72:0/3371938615 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c011830 con 0x7fb88809d630 2023-10-03T10:19:21.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.952+0000 7fb886ffd700 1 -- 172.21.15.72:0/3371938615 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87c011990 con 0x7fb88809d630 2023-10-03T10:19:21.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.952+0000 7fb886ffd700 1 -- 172.21.15.72:0/3371938615 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c011d20 con 0x7fb88809d630 2023-10-03T10:19:21.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.952+0000 7fb88e5f9700 1 -- 172.21.15.72:0/3371938615 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88809d630 msgr2=0x7fb8880a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.952+0000 7fb88e5f9700 1 --2- 172.21.15.72:0/3371938615 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88809d630 0x7fb8880a1340 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009840 tx=0x7fb87c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:21.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.952+0000 7fb88e5f9700 1 -- 172.21.15.72:0/3371938615 shutdown_connections 2023-10-03T10:19:21.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.952+0000 7fb88e5f9700 1 --2- 172.21.15.72:0/3371938615 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb888133930 0x7fb888133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.952+0000 7fb88e5f9700 1 --2- 172.21.15.72:0/3371938615 >> v2:172.21.15.72:3300/0 conn(0x7fb8880a0a30 0x7fb8880a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.952+0000 7fb88e5f9700 1 --2- 172.21.15.72:0/3371938615 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88809d630 0x7fb8880a1340 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.952+0000 7fb88e5f9700 1 -- 172.21.15.72:0/3371938615 >> 172.21.15.72:0/3371938615 conn(0x7fb8880a3050 msgr2=0x7fb8880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.952+0000 7fb88e5f9700 1 -- 172.21.15.72:0/3371938615 shutdown_connections 2023-10-03T10:19:21.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.952+0000 7fb88e5f9700 1 -- 172.21.15.72:0/3371938615 wait complete. 2023-10-03T10:19:21.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.953+0000 7fb88e5f9700 1 Processor -- start 2023-10-03T10:19:21.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.953+0000 7fb88e5f9700 1 -- start start 2023-10-03T10:19:21.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb88e5f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88809d630 0x7fb88811f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb88e5f9700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb8880a0a30 0x7fb88811fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb88e5f9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb888133930 0x7fb8881c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb88e5f9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8881217a0 con 0x7fb888133930 2023-10-03T10:19:21.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb88e5f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb888121090 con 0x7fb88809d630 2023-10-03T10:19:21.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb88e5f9700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8881223e0 con 0x7fb8880a0a30 2023-10-03T10:19:21.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb8877fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb8880a0a30 0x7fb88811fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb887fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88809d630 0x7fb88811f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb88cb96700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb888133930 0x7fb8881c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb8877fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb8880a0a30 0x7fb88811fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52310/0 (socket says 172.21.15.72:52310) 2023-10-03T10:19:21.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb8877fe700 1 -- 172.21.15.72:0/3358893182 learned_addr learned my addr 172.21.15.72:0/3358893182 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:21.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb8877fe700 1 -- 172.21.15.72:0/3358893182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88809d630 msgr2=0x7fb88811f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb8877fe700 1 --2- 172.21.15.72:0/3358893182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88809d630 0x7fb88811f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb8877fe700 1 -- 172.21.15.72:0/3358893182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb888133930 msgr2=0x7fb8881c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb8877fe700 1 --2- 172.21.15.72:0/3358893182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb888133930 0x7fb8881c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb8877fe700 1 -- 172.21.15.72:0/3358893182 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c0094a0 con 0x7fb8880a0a30 2023-10-03T10:19:21.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb88cb96700 1 --2- 172.21.15.72:0/3358893182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb888133930 0x7fb8881c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.954+0000 7fb887fff700 1 --2- 172.21.15.72:0/3358893182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88809d630 0x7fb88811f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.955+0000 7fb8877fe700 1 --2- 172.21.15.72:0/3358893182 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb8880a0a30 0x7fb88811fbd0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fb87c000c00 tx=0x7fb87c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.955+0000 7fb884ff9700 1 -- 172.21.15.72:0/3358893182 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c004240 con 0x7fb8880a0a30 2023-10-03T10:19:21.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.955+0000 7fb884ff9700 1 -- 172.21.15.72:0/3358893182 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87c01f070 con 0x7fb8880a0a30 2023-10-03T10:19:21.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.955+0000 7fb88e5f9700 1 -- 172.21.15.72:0/3358893182 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb888133530 con 0x7fb8880a0a30 2023-10-03T10:19:21.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.955+0000 7fb884ff9700 1 -- 172.21.15.72:0/3358893182 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c0036a0 con 0x7fb8880a0a30 2023-10-03T10:19:21.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.955+0000 7fb88e5f9700 1 -- 172.21.15.72:0/3358893182 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb888122120 con 0x7fb8880a0a30 2023-10-03T10:19:21.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.956+0000 7fb884ff9700 1 -- 172.21.15.72:0/3358893182 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb87c021030 con 0x7fb8880a0a30 2023-10-03T10:19:21.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.956+0000 7fb884ff9700 1 -- 172.21.15.72:0/3358893182 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb87c040500 con 0x7fb8880a0a30 2023-10-03T10:19:21.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.956+0000 7fb88e5f9700 1 -- 172.21.15.72:0/3358893182 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb888122520 con 0x7fb8880a0a30 2023-10-03T10:19:21.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.961+0000 7fb884ff9700 1 -- 172.21.15.72:0/3358893182 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb888122520 con 0x7fb8880a0a30 2023-10-03T10:19:21.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.993+0000 7fdcee67f700 1 Processor -- start 2023-10-03T10:19:21.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.993+0000 7fdcee67f700 1 -- start start 2023-10-03T10:19:21.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.993+0000 7fdcee67f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdce80a0a30 0x7fdce80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.993+0000 7fdcee67f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdce809d630 0x7fdce80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.993+0000 7fdcee67f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce80a2a70 con 0x7fdce8133930 2023-10-03T10:19:21.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.993+0000 7fdcee67f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce80a01d0 con 0x7fdce80a0a30 2023-10-03T10:19:21.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.993+0000 7fdcee67f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce809e2b0 con 0x7fdce809d630 2023-10-03T10:19:21.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.994+0000 7fdce77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdce809d630 0x7fdce80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.994+0000 7fdce7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdce80a0a30 0x7fdce80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.994+0000 7fdce7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdce80a0a30 0x7fdce80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50958/0 (socket says 172.21.15.72:50958) 2023-10-03T10:19:21.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.994+0000 7fdce77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdce809d630 0x7fdce80a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59178/0 (socket says 172.21.15.72:59178) 2023-10-03T10:19:21.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.994+0000 7fdce7fff700 1 -- 172.21.15.72:0/3016021398 learned_addr learned my addr 172.21.15.72:0/3016021398 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.994+0000 7fdce7fff700 1 -- 172.21.15.72:0/3016021398 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdce809d630 msgr2=0x7fdce80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.994+0000 7fdce7fff700 1 --2- 172.21.15.72:0/3016021398 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdce809d630 0x7fdce80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.994+0000 7fdce7fff700 1 -- 172.21.15.72:0/3016021398 >> v1:172.21.15.72:6789/0 conn(0x7fdce8133930 legacy=0x7fdce8133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.994+0000 7fdce7fff700 1 -- 172.21.15.72:0/3016021398 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce809dc50 con 0x7fdce80a0a30 2023-10-03T10:19:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.994+0000 7fdce7fff700 1 --2- 172.21.15.72:0/3016021398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce80a0a30 0x7fdce80a0e00 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80098f0 tx=0x7fdcd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc75b4f3b5a1f909 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.994+0000 7fdce6ffd700 1 -- 172.21.15.72:0/3016021398 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8011830 con 0x7fdce80a0a30 2023-10-03T10:19:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.994+0000 7fdce6ffd700 1 -- 172.21.15.72:0/3016021398 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8011990 con 0x7fdce80a0a30 2023-10-03T10:19:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.994+0000 7fdce6ffd700 1 -- 172.21.15.72:0/3016021398 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8011d20 con 0x7fdce80a0a30 2023-10-03T10:19:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.995+0000 7fdcee67f700 1 -- 172.21.15.72:0/3016021398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce80a0a30 msgr2=0x7fdce80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.995+0000 7fdcee67f700 1 --2- 172.21.15.72:0/3016021398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce80a0a30 0x7fdce80a0e00 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80098f0 tx=0x7fdcd8009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.995+0000 7fdcee67f700 1 -- 172.21.15.72:0/3016021398 shutdown_connections 2023-10-03T10:19:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.995+0000 7fdcee67f700 1 --2- 172.21.15.72:0/3016021398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce80a0a30 0x7fdce80a0e00 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.995+0000 7fdcee67f700 1 --2- 172.21.15.72:0/3016021398 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdce809d630 0x7fdce80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.995+0000 7fdcee67f700 1 -- 172.21.15.72:0/3016021398 >> 172.21.15.72:0/3016021398 conn(0x7fdce80a3050 msgr2=0x7fdce80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.995+0000 7fdcee67f700 1 -- 172.21.15.72:0/3016021398 shutdown_connections 2023-10-03T10:19:21.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.995+0000 7fdcee67f700 1 -- 172.21.15.72:0/3016021398 wait complete. 2023-10-03T10:19:21.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.997+0000 7fdcee67f700 1 Processor -- start 2023-10-03T10:19:21.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.997+0000 7fdcee67f700 1 -- start start 2023-10-03T10:19:22.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.997+0000 7fdcee67f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdce809d630 0x7fdce81c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.997+0000 7fdcee67f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce80a0a30 0x7fdce81c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.997+0000 7fdcee67f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdce8133930 0x7fdce81c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.997+0000 7fdcee67f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce811eea0 con 0x7fdce80a0a30 2023-10-03T10:19:22.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.997+0000 7fdcee67f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce81207f0 con 0x7fdce809d630 2023-10-03T10:19:22.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.997+0000 7fdcee67f700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdce8120600 con 0x7fdce8133930 2023-10-03T10:19:22.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdce7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdce809d630 0x7fdce81c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdce77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce80a0a30 0x7fdce81c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdce7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdce809d630 0x7fdce81c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59184/0 (socket says 172.21.15.72:59184) 2023-10-03T10:19:22.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdce7fff700 1 -- 172.21.15.72:0/1870986541 learned_addr learned my addr 172.21.15.72:0/1870986541 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:22.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdce77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce80a0a30 0x7fdce81c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50968/0 (socket says 172.21.15.72:50968) 2023-10-03T10:19:22.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdcecc1c700 1 --2- 172.21.15.72:0/1870986541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdce8133930 0x7fdce81c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdce77fe700 1 -- 172.21.15.72:0/1870986541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdce8133930 msgr2=0x7fdce81c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdce77fe700 1 --2- 172.21.15.72:0/1870986541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdce8133930 0x7fdce81c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdce77fe700 1 -- 172.21.15.72:0/1870986541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdce809d630 msgr2=0x7fdce81c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdce77fe700 1 --2- 172.21.15.72:0/1870986541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdce809d630 0x7fdce81c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdce77fe700 1 -- 172.21.15.72:0/1870986541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd8009550 con 0x7fdce80a0a30 2023-10-03T10:19:22.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdce7fff700 1 --2- 172.21.15.72:0/1870986541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdce809d630 0x7fdce81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:22.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdcecc1c700 1 --2- 172.21.15.72:0/1870986541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdce8133930 0x7fdce81c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:22.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdce77fe700 1 --2- 172.21.15.72:0/1870986541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce80a0a30 0x7fdce81c8660 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00e900 tx=0x7fdcdc00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdce4ff9700 1 -- 172.21.15.72:0/1870986541 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc00ee50 con 0x7fdce80a0a30 2023-10-03T10:19:22.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdce4ff9700 1 -- 172.21.15.72:0/1870986541 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc00c850 con 0x7fdce80a0a30 2023-10-03T10:19:22.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdcee67f700 1 -- 172.21.15.72:0/1870986541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce8122510 con 0x7fdce80a0a30 2023-10-03T10:19:22.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdce4ff9700 1 -- 172.21.15.72:0/1870986541 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc00cbc0 con 0x7fdce80a0a30 2023-10-03T10:19:22.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.998+0000 7fdcee67f700 1 -- 172.21.15.72:0/1870986541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce8120df0 con 0x7fdce80a0a30 2023-10-03T10:19:22.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.999+0000 7fdce4ff9700 1 -- 172.21.15.72:0/1870986541 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdcdc00cd20 con 0x7fdce80a0a30 2023-10-03T10:19:22.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:21.999+0000 7fdce4ff9700 1 -- 172.21.15.72:0/1870986541 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdcdc03f6c0 con 0x7fdce80a0a30 2023-10-03T10:19:22.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.000+0000 7fdcee67f700 1 -- 172.21.15.72:0/1870986541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce8121eb0 con 0x7fdce80a0a30 2023-10-03T10:19:22.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.004+0000 7fdce4ff9700 1 -- 172.21.15.72:0/1870986541 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdcdc0232f0 con 0x7fdce80a0a30 2023-10-03T10:19:22.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.110+0000 7fc1e68c5700 1 -- 172.21.15.72:0/1895363596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc1e0125da0 con 0x7fc1e009e000 2023-10-03T10:19:22.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.111+0000 7fc1dcff9700 1 -- 172.21.15.72:0/1895363596 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fc1d402b020 con 0x7fc1e009e000 2023-10-03T10:19:22.111 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.114+0000 7fc1e68c5700 1 -- 172.21.15.72:0/1895363596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1e009e000 msgr2=0x7fc1e0122b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.114+0000 7fc1e68c5700 1 --2- 172.21.15.72:0/1895363596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1e009e000 0x7fc1e0122b80 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4016000 tx=0x7fc1d4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.114+0000 7fc1e68c5700 1 -- 172.21.15.72:0/1895363596 shutdown_connections 2023-10-03T10:19:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.114+0000 7fc1e68c5700 1 --2- 172.21.15.72:0/1895363596 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc1e009e410 0x7fc1e01230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.114+0000 7fc1e68c5700 1 --2- 172.21.15.72:0/1895363596 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fc1e009d6f0 0x7fc1e0122640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.114+0000 7fc1e68c5700 1 --2- 172.21.15.72:0/1895363596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1e009e000 0x7fc1e0122b80 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.114+0000 7fc1e68c5700 1 -- 172.21.15.72:0/1895363596 >> 172.21.15.72:0/1895363596 conn(0x7fc1e0066f50 msgr2=0x7fc1e00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.114+0000 7fc1e68c5700 1 -- 172.21.15.72:0/1895363596 shutdown_connections 2023-10-03T10:19:22.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.114+0000 7fc1e68c5700 1 -- 172.21.15.72:0/1895363596 wait complete. 2023-10-03T10:19:22.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:22.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.155+0000 7fb88e5f9700 1 -- 172.21.15.72:0/3358893182 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb888122520 con 0x7fb8880a0a30 2023-10-03T10:19:22.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.155+0000 7fb884ff9700 1 -- 172.21.15.72:0/3358893182 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb888122520 con 0x7fb8880a0a30 2023-10-03T10:19:22.156 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:22.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.157+0000 7fb88e5f9700 1 -- 172.21.15.72:0/3358893182 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb8880a0a30 msgr2=0x7fb88811fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.157+0000 7fb88e5f9700 1 --2- 172.21.15.72:0/3358893182 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb8880a0a30 0x7fb88811fbd0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fb87c000c00 tx=0x7fb87c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:22.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.157+0000 7fb88e5f9700 1 -- 172.21.15.72:0/3358893182 shutdown_connections 2023-10-03T10:19:22.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.157+0000 7fb88e5f9700 1 --2- 172.21.15.72:0/3358893182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb888133930 0x7fb8881c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.157+0000 7fb88e5f9700 1 --2- 172.21.15.72:0/3358893182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb88809d630 0x7fb88811f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.157+0000 7fb88e5f9700 1 --2- 172.21.15.72:0/3358893182 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb8880a0a30 0x7fb88811fbd0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.157+0000 7fb88e5f9700 1 -- 172.21.15.72:0/3358893182 >> 172.21.15.72:0/3358893182 conn(0x7fb8880a3050 msgr2=0x7fb88809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.157+0000 7fb88e5f9700 1 -- 172.21.15.72:0/3358893182 shutdown_connections 2023-10-03T10:19:22.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.157+0000 7fb88e5f9700 1 -- 172.21.15.72:0/3358893182 wait complete. 2023-10-03T10:19:22.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.228+0000 7fdcee67f700 1 -- 172.21.15.72:0/1870986541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdce80747f0 con 0x7fdce80a0a30 2023-10-03T10:19:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.229+0000 7fdce4ff9700 1 -- 172.21.15.72:0/1870986541 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fdcdc021030 con 0x7fdce80a0a30 2023-10-03T10:19:22.229 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.230+0000 7fdcee67f700 1 -- 172.21.15.72:0/1870986541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce80a0a30 msgr2=0x7fdce81c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.230+0000 7fdcee67f700 1 --2- 172.21.15.72:0/1870986541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce80a0a30 0x7fdce81c8660 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00e900 tx=0x7fdcdc00ec10 comp rx=0 tx=0).stop 2023-10-03T10:19:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.231+0000 7fdcee67f700 1 -- 172.21.15.72:0/1870986541 shutdown_connections 2023-10-03T10:19:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.231+0000 7fdcee67f700 1 --2- 172.21.15.72:0/1870986541 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fdce8133930 0x7fdce81c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.231+0000 7fdcee67f700 1 --2- 172.21.15.72:0/1870986541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdce809d630 0x7fdce81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.231+0000 7fdcee67f700 1 --2- 172.21.15.72:0/1870986541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce80a0a30 0x7fdce81c8660 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.231+0000 7fdcee67f700 1 -- 172.21.15.72:0/1870986541 >> 172.21.15.72:0/1870986541 conn(0x7fdce80a3050 msgr2=0x7fdce809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.231+0000 7fdcee67f700 1 -- 172.21.15.72:0/1870986541 shutdown_connections 2023-10-03T10:19:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.231+0000 7fdcee67f700 1 -- 172.21.15.72:0/1870986541 wait complete. 2023-10-03T10:19:22.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:22.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:22.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.830+0000 7f88b568d700 1 Processor -- start 2023-10-03T10:19:22.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.830+0000 7f88b568d700 1 -- start start 2023-10-03T10:19:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88b568d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b009d6f0 0x7f88b009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88b568d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009e000 0x7f88b01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88b568d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88b009e410 0x7f88b0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88b568d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b006b460 con 0x7f88b009e410 2023-10-03T10:19:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88b568d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b009b120 con 0x7f88b009d6f0 2023-10-03T10:19:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88b568d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88b009a7e0 con 0x7f88b009e000 2023-10-03T10:19:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88ae7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009e000 0x7f88b01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88aeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b009d6f0 0x7f88b009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88af7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88b009e410 0x7f88b0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88ae7fc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009e000 0x7f88b01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52334/0 (socket says 172.21.15.72:52334) 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88aeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b009d6f0 0x7f88b009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59194/0 (socket says 172.21.15.72:59194) 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88ae7fc700 1 -- 172.21.15.72:0/1257591688 learned_addr learned my addr 172.21.15.72:0/1257591688 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88ae7fc700 1 -- 172.21.15.72:0/1257591688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b009d6f0 msgr2=0x7f88b009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88ae7fc700 1 --2- 172.21.15.72:0/1257591688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b009d6f0 0x7f88b009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88ae7fc700 1 -- 172.21.15.72:0/1257591688 >> v2:172.21.15.72:3300/0 conn(0x7f88b009e410 msgr2=0x7f88b0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88ae7fc700 1 --2- 172.21.15.72:0/1257591688 >> v2:172.21.15.72:3300/0 conn(0x7f88b009e410 0x7f88b0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88ae7fc700 1 -- 172.21.15.72:0/1257591688 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b009a500 con 0x7f88b009e000 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88af7fe700 1 --2- 172.21.15.72:0/1257591688 >> v2:172.21.15.72:3300/0 conn(0x7f88b009e410 0x7f88b0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88aeffd700 1 --2- 172.21.15.72:0/1257591688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b009d6f0 0x7f88b009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:22.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88ae7fc700 1 --2- 172.21.15.72:0/1257591688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009e000 0x7f88b01339f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009920 tx=0x7f88a0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e192debc5c724fdc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88adffb700 1 -- 172.21.15.72:0/1257591688 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0011830 con 0x7f88b009e000 2023-10-03T10:19:22.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88adffb700 1 -- 172.21.15.72:0/1257591688 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a0011990 con 0x7f88b009e000 2023-10-03T10:19:22.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.831+0000 7f88adffb700 1 -- 172.21.15.72:0/1257591688 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0011d20 con 0x7f88b009e000 2023-10-03T10:19:22.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.832+0000 7f88b568d700 1 -- 172.21.15.72:0/1257591688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009e000 msgr2=0x7f88b01339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.832+0000 7f88b568d700 1 --2- 172.21.15.72:0/1257591688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009e000 0x7f88b01339f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009920 tx=0x7f88a0009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:22.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.832+0000 7f88b568d700 1 -- 172.21.15.72:0/1257591688 shutdown_connections 2023-10-03T10:19:22.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.832+0000 7f88b568d700 1 --2- 172.21.15.72:0/1257591688 >> v2:172.21.15.72:3300/0 conn(0x7f88b009e410 0x7f88b0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.832+0000 7f88b568d700 1 --2- 172.21.15.72:0/1257591688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b009d6f0 0x7f88b009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.832+0000 7f88b568d700 1 --2- 172.21.15.72:0/1257591688 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009e000 0x7f88b01339f0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.832+0000 7f88b568d700 1 -- 172.21.15.72:0/1257591688 >> 172.21.15.72:0/1257591688 conn(0x7f88b0066f50 msgr2=0x7f88b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.832+0000 7f88b568d700 1 -- 172.21.15.72:0/1257591688 shutdown_connections 2023-10-03T10:19:22.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.832+0000 7f88b568d700 1 -- 172.21.15.72:0/1257591688 wait complete. 2023-10-03T10:19:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.833+0000 7f88b568d700 1 Processor -- start 2023-10-03T10:19:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.833+0000 7f88b568d700 1 -- start start 2023-10-03T10:19:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88b568d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b009d6f0 0x7f88b01a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88b568d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b009e000 0x7f88b01a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88b568d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009e410 0x7f88b01a6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88b568d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b01a90e0 con 0x7f88b009d6f0 2023-10-03T10:19:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88b568d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b00a3110 con 0x7f88b009e000 2023-10-03T10:19:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88b568d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88b009c710 con 0x7f88b009e410 2023-10-03T10:19:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88aeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b009d6f0 0x7f88b01a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88aeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b009d6f0 0x7f88b01a5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50984/0 (socket says 172.21.15.72:50984) 2023-10-03T10:19:22.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88af7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009e410 0x7f88b01a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88aeffd700 1 -- 172.21.15.72:0/3866732863 learned_addr learned my addr 172.21.15.72:0/3866732863 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88ae7fc700 1 --2- 172.21.15.72:0/3866732863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b009e000 0x7f88b01a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88aeffd700 1 -- 172.21.15.72:0/3866732863 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009e410 msgr2=0x7f88b01a6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88aeffd700 1 --2- 172.21.15.72:0/3866732863 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009e410 0x7f88b01a6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88aeffd700 1 -- 172.21.15.72:0/3866732863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b009e000 msgr2=0x7f88b01a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88aeffd700 1 --2- 172.21.15.72:0/3866732863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b009e000 0x7f88b01a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88aeffd700 1 -- 172.21.15.72:0/3866732863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a40094a0 con 0x7f88b009d6f0 2023-10-03T10:19:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88ae7fc700 1 --2- 172.21.15.72:0/3866732863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b009e000 0x7f88b01a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88af7fe700 1 --2- 172.21.15.72:0/3866732863 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009e410 0x7f88b01a6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88aeffd700 1 --2- 172.21.15.72:0/3866732863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b009d6f0 0x7f88b01a5e00 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f88a400ebe0 tx=0x7f88a400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88977fe700 1 -- 172.21.15.72:0/3866732863 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a400c850 con 0x7f88b009d6f0 2023-10-03T10:19:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88977fe700 1 -- 172.21.15.72:0/3866732863 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a400c9b0 con 0x7f88b009d6f0 2023-10-03T10:19:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88b568d700 1 -- 172.21.15.72:0/3866732863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a8009a70 con 0x7f88b009d6f0 2023-10-03T10:19:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88977fe700 1 -- 172.21.15.72:0/3866732863 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a400cd40 con 0x7f88b009d6f0 2023-10-03T10:19:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.834+0000 7f88b568d700 1 -- 172.21.15.72:0/3866732863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a0009550 con 0x7f88b009d6f0 2023-10-03T10:19:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.835+0000 7f88977fe700 1 -- 172.21.15.72:0/3866732863 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88a4013470 con 0x7f88b009d6f0 2023-10-03T10:19:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.835+0000 7f88977fe700 1 -- 172.21.15.72:0/3866732863 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f88a403fb10 con 0x7f88b009d6f0 2023-10-03T10:19:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.835+0000 7f88b568d700 1 -- 172.21.15.72:0/3866732863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b0074ea0 con 0x7f88b009d6f0 2023-10-03T10:19:22.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:22.840+0000 7f88977fe700 1 -- 172.21.15.72:0/3866732863 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88a4017080 con 0x7f88b009d6f0 2023-10-03T10:19:23.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.025+0000 7f88b568d700 1 -- 172.21.15.72:0/3866732863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f88b01a8c20 con 0x7f88b009d6f0 2023-10-03T10:19:23.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.026+0000 7f88977fe700 1 -- 172.21.15.72:0/3866732863 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88a4021020 con 0x7f88b009d6f0 2023-10-03T10:19:23.026 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:23.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.028+0000 7f88b568d700 1 -- 172.21.15.72:0/3866732863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b009d6f0 msgr2=0x7f88b01a5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.028+0000 7f88b568d700 1 --2- 172.21.15.72:0/3866732863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b009d6f0 0x7f88b01a5e00 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f88a400ebe0 tx=0x7f88a400eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.028+0000 7f88b568d700 1 -- 172.21.15.72:0/3866732863 shutdown_connections 2023-10-03T10:19:23.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.028+0000 7f88b568d700 1 --2- 172.21.15.72:0/3866732863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88b009d6f0 0x7f88b01a5e00 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.028+0000 7f88b568d700 1 --2- 172.21.15.72:0/3866732863 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f88b009e410 0x7f88b01a6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.028+0000 7f88b568d700 1 --2- 172.21.15.72:0/3866732863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f88b009e000 0x7f88b01a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.028+0000 7f88b568d700 1 -- 172.21.15.72:0/3866732863 >> 172.21.15.72:0/3866732863 conn(0x7f88b0066f50 msgr2=0x7f88b00a3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:23.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.028+0000 7f88b568d700 1 -- 172.21.15.72:0/3866732863 shutdown_connections 2023-10-03T10:19:23.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.028+0000 7f88b568d700 1 -- 172.21.15.72:0/3866732863 wait complete. 2023-10-03T10:19:23.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:23.132 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:23.171 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:23.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:23.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.259+0000 7fcbf0259700 1 Processor -- start 2023-10-03T10:19:23.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.259+0000 7fcbf0259700 1 -- start start 2023-10-03T10:19:23.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.259+0000 7fcbf0259700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcbe80a0a30 0x7fcbe80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.259+0000 7fcbf0259700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbe8134170 0x7fcbe813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.259+0000 7fcbf0259700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe809edd0 con 0x7fcbe80a1340 2023-10-03T10:19:23.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.259+0000 7fcbf0259700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe809e1f0 con 0x7fcbe80a0a30 2023-10-03T10:19:23.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.259+0000 7fcbf0259700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe809dc50 con 0x7fcbe8134170 2023-10-03T10:19:23.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.260+0000 7fcbedff5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcbe80a0a30 0x7fcbe80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.260+0000 7fcbee7f6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbe8134170 0x7fcbe813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.260+0000 7fcbee7f6700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbe8134170 0x7fcbe813bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52352/0 (socket says 172.21.15.72:52352) 2023-10-03T10:19:23.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.260+0000 7fcbee7f6700 1 -- 172.21.15.72:0/2775918756 learned_addr learned my addr 172.21.15.72:0/2775918756 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:23.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.260+0000 7fcbedff5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcbe80a0a30 0x7fcbe80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50994/0 (socket says 172.21.15.72:50994) 2023-10-03T10:19:23.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.260+0000 7fcbedff5700 1 -- 172.21.15.72:0/2775918756 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbe8134170 msgr2=0x7fcbe813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.260+0000 7fcbedff5700 1 --2- 172.21.15.72:0/2775918756 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbe8134170 0x7fcbe813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.260+0000 7fcbedff5700 1 -- 172.21.15.72:0/2775918756 >> v1:172.21.15.72:6789/0 conn(0x7fcbe80a1340 legacy=0x7fcbe8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.260+0000 7fcbedff5700 1 -- 172.21.15.72:0/2775918756 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe80a1fe0 con 0x7fcbe80a0a30 2023-10-03T10:19:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.260+0000 7fcbee7f6700 1 --2- 172.21.15.72:0/2775918756 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbe8134170 0x7fcbe813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.260+0000 7fcbedff5700 1 --2- 172.21.15.72:0/2775918756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbe80a0a30 0x7fcbe80a0e00 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009840 tx=0x7fcbe4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4551b03156c74edd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.260+0000 7fcbecff3700 1 -- 172.21.15.72:0/2775918756 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4011830 con 0x7fcbe80a0a30 2023-10-03T10:19:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.260+0000 7fcbecff3700 1 -- 172.21.15.72:0/2775918756 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe4011990 con 0x7fcbe80a0a30 2023-10-03T10:19:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.260+0000 7fcbecff3700 1 -- 172.21.15.72:0/2775918756 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4011d20 con 0x7fcbe80a0a30 2023-10-03T10:19:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.261+0000 7fcbf0259700 1 -- 172.21.15.72:0/2775918756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbe80a0a30 msgr2=0x7fcbe80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.261+0000 7fcbf0259700 1 --2- 172.21.15.72:0/2775918756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbe80a0a30 0x7fcbe80a0e00 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009840 tx=0x7fcbe4009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.261+0000 7fcbf0259700 1 -- 172.21.15.72:0/2775918756 shutdown_connections 2023-10-03T10:19:23.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.261+0000 7fcbf0259700 1 --2- 172.21.15.72:0/2775918756 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbe8134170 0x7fcbe813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.261+0000 7fcbf0259700 1 --2- 172.21.15.72:0/2775918756 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbe80a0a30 0x7fcbe80a0e00 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.261+0000 7fcbf0259700 1 -- 172.21.15.72:0/2775918756 >> 172.21.15.72:0/2775918756 conn(0x7fcbe80a6550 msgr2=0x7fcbe80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:23.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.261+0000 7fcbf0259700 1 -- 172.21.15.72:0/2775918756 shutdown_connections 2023-10-03T10:19:23.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.261+0000 7fcbf0259700 1 -- 172.21.15.72:0/2775918756 wait complete. 2023-10-03T10:19:23.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.262+0000 7fcbf0259700 1 Processor -- start 2023-10-03T10:19:23.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.262+0000 7fcbf0259700 1 -- start start 2023-10-03T10:19:23.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbf0259700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbe80a0a30 0x7fcbe81c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbf0259700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbe80a1340 0x7fcbe81c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbf0259700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbe8134170 0x7fcbe81c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbf0259700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe81246b0 con 0x7fcbe80a1340 2023-10-03T10:19:23.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbf0259700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe80a0220 con 0x7fcbe8134170 2023-10-03T10:19:23.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbf0259700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe8126190 con 0x7fcbe80a0a30 2023-10-03T10:19:23.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbedff5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbe80a0a30 0x7fcbe81c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbedff5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbe80a0a30 0x7fcbe81c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52354/0 (socket says 172.21.15.72:52354) 2023-10-03T10:19:23.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbedff5700 1 -- 172.21.15.72:0/3657072920 learned_addr learned my addr 172.21.15.72:0/3657072920 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:23.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbed7f4700 1 --2- 172.21.15.72:0/3657072920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbe80a1340 0x7fcbe81c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbee7f6700 1 --2- 172.21.15.72:0/3657072920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbe8134170 0x7fcbe81c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbedff5700 1 -- 172.21.15.72:0/3657072920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbe8134170 msgr2=0x7fcbe81c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbedff5700 1 --2- 172.21.15.72:0/3657072920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbe8134170 0x7fcbe81c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbedff5700 1 -- 172.21.15.72:0/3657072920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbe80a1340 msgr2=0x7fcbe81c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbedff5700 1 --2- 172.21.15.72:0/3657072920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbe80a1340 0x7fcbe81c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbedff5700 1 -- 172.21.15.72:0/3657072920 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe0009b30 con 0x7fcbe80a0a30 2023-10-03T10:19:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbed7f4700 1 --2- 172.21.15.72:0/3657072920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbe80a1340 0x7fcbe81c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbedff5700 1 --2- 172.21.15.72:0/3657072920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbe80a0a30 0x7fcbe81c8480 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40090b0 tx=0x7fcbe4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbde7fc700 1 -- 172.21.15.72:0/3657072920 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4004590 con 0x7fcbe80a0a30 2023-10-03T10:19:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbde7fc700 1 -- 172.21.15.72:0/3657072920 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe401f070 con 0x7fcbe80a0a30 2023-10-03T10:19:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbf0259700 1 -- 172.21.15.72:0/3657072920 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe40094a0 con 0x7fcbe80a0a30 2023-10-03T10:19:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.263+0000 7fcbde7fc700 1 -- 172.21.15.72:0/3657072920 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe40038e0 con 0x7fcbe80a0a30 2023-10-03T10:19:23.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.264+0000 7fcbf0259700 1 -- 172.21.15.72:0/3657072920 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe80a25e0 con 0x7fcbe80a0a30 2023-10-03T10:19:23.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.264+0000 7fcbf0259700 1 -- 172.21.15.72:0/3657072920 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe8124cd0 con 0x7fcbe80a0a30 2023-10-03T10:19:23.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.264+0000 7fcbde7fc700 1 -- 172.21.15.72:0/3657072920 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcbe4003a40 con 0x7fcbe80a0a30 2023-10-03T10:19:23.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.265+0000 7fcbde7fc700 1 -- 172.21.15.72:0/3657072920 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcbe4021070 con 0x7fcbe80a0a30 2023-10-03T10:19:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.271+0000 7fcbde7fc700 1 -- 172.21.15.72:0/3657072920 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcbe4024bc0 con 0x7fcbe80a0a30 2023-10-03T10:19:23.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.301+0000 7fd61a8a5700 1 Processor -- start 2023-10-03T10:19:23.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.301+0000 7fd61a8a5700 1 -- start start 2023-10-03T10:19:23.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.302+0000 7fd61a8a5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd614130540 0x7fd614130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.302+0000 7fd61a8a5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd61406fcf0 0x7fd614138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.302+0000 7fd61a8a5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6140716a0 con 0x7fd614130e50 2023-10-03T10:19:23.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.302+0000 7fd61a8a5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61409a390 con 0x7fd614130540 2023-10-03T10:19:23.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.302+0000 7fd61a8a5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd614071290 con 0x7fd61406fcf0 2023-10-03T10:19:23.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.302+0000 7fd618e42700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd61406fcf0 0x7fd614138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.302+0000 7fd618e42700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd61406fcf0 0x7fd614138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52356/0 (socket says 172.21.15.72:52356) 2023-10-03T10:19:23.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.302+0000 7fd613fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd614130540 0x7fd614130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.302+0000 7fd618e42700 1 -- 172.21.15.72:0/1643361149 learned_addr learned my addr 172.21.15.72:0/1643361149 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:23.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.302+0000 7fd613fff700 1 -- 172.21.15.72:0/1643361149 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd61406fcf0 msgr2=0x7fd614138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:23.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.302+0000 7fd613fff700 1 --2- 172.21.15.72:0/1643361149 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd61406fcf0 0x7fd614138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.302+0000 7fd613fff700 1 -- 172.21.15.72:0/1643361149 >> v1:172.21.15.72:6789/0 conn(0x7fd614130e50 legacy=0x7fd61406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.302+0000 7fd612ffd700 1 -- 172.21.15.72:0/1643361149 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530267040 0 0) 0x7fd6140716a0 con 0x7fd614130e50 2023-10-03T10:19:23.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.303+0000 7fd613fff700 1 -- 172.21.15.72:0/1643361149 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd614130340 con 0x7fd614130540 2023-10-03T10:19:23.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.303+0000 7fd618e42700 1 --2- 172.21.15.72:0/1643361149 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd61406fcf0 0x7fd614138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:23.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.303+0000 7fd613fff700 1 --2- 172.21.15.72:0/1643361149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd614130540 0x7fd614130910 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fd604009840 tx=0x7fd604009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d9e705a8374e60 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.303+0000 7fd612ffd700 1 -- 172.21.15.72:0/1643361149 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd604011830 con 0x7fd614130540 2023-10-03T10:19:23.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.303+0000 7fd612ffd700 1 -- 172.21.15.72:0/1643361149 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd604011990 con 0x7fd614130540 2023-10-03T10:19:23.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.303+0000 7fd612ffd700 1 -- 172.21.15.72:0/1643361149 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd604011d20 con 0x7fd614130540 2023-10-03T10:19:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.303+0000 7fd61a8a5700 1 -- 172.21.15.72:0/1643361149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd614130540 msgr2=0x7fd614130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.303+0000 7fd61a8a5700 1 --2- 172.21.15.72:0/1643361149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd614130540 0x7fd614130910 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fd604009840 tx=0x7fd604009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.303+0000 7fd61a8a5700 1 -- 172.21.15.72:0/1643361149 shutdown_connections 2023-10-03T10:19:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.304+0000 7fd61a8a5700 1 --2- 172.21.15.72:0/1643361149 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd61406fcf0 0x7fd614138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.304+0000 7fd61a8a5700 1 --2- 172.21.15.72:0/1643361149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd614130540 0x7fd614130910 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.304+0000 7fd61a8a5700 1 -- 172.21.15.72:0/1643361149 >> 172.21.15.72:0/1643361149 conn(0x7fd6140a2aa0 msgr2=0x7fd6140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.304+0000 7fd61a8a5700 1 -- 172.21.15.72:0/1643361149 shutdown_connections 2023-10-03T10:19:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.304+0000 7fd61a8a5700 1 -- 172.21.15.72:0/1643361149 wait complete. 2023-10-03T10:19:23.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.305+0000 7fd61a8a5700 1 Processor -- start 2023-10-03T10:19:23.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.305+0000 7fd61a8a5700 1 -- start start 2023-10-03T10:19:23.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd61a8a5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd61406fcf0 0x7fd61411e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd61a8a5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd614130540 0x7fd61411ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd61a8a5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd614130e50 0x7fd61411f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd61a8a5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6140718e0 con 0x7fd614130e50 2023-10-03T10:19:23.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd61a8a5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd614122120 con 0x7fd61406fcf0 2023-10-03T10:19:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd61a8a5700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd614121400 con 0x7fd614130540 2023-10-03T10:19:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd6137fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd614130540 0x7fd61411ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd6137fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd614130540 0x7fd61411ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52360/0 (socket says 172.21.15.72:52360) 2023-10-03T10:19:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd618e42700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd614130e50 0x7fd61411f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd6137fe700 1 -- 172.21.15.72:0/3918978316 learned_addr learned my addr 172.21.15.72:0/3918978316 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd613fff700 1 --2- 172.21.15.72:0/3918978316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd61406fcf0 0x7fd61411e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd618e42700 1 -- 172.21.15.72:0/3918978316 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd614130540 msgr2=0x7fd61411ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd618e42700 1 --2- 172.21.15.72:0/3918978316 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd614130540 0x7fd61411ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd618e42700 1 -- 172.21.15.72:0/3918978316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd61406fcf0 msgr2=0x7fd61411e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd618e42700 1 --2- 172.21.15.72:0/3918978316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd61406fcf0 0x7fd61411e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd618e42700 1 -- 172.21.15.72:0/3918978316 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c009b30 con 0x7fd614130e50 2023-10-03T10:19:23.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd6137fe700 1 --2- 172.21.15.72:0/3918978316 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd614130540 0x7fd61411ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:23.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd613fff700 1 --2- 172.21.15.72:0/3918978316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd61406fcf0 0x7fd61411e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:23.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.306+0000 7fd618e42700 1 --2- 172.21.15.72:0/3918978316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd614130e50 0x7fd61411f360 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009e50 tx=0x7fd60c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.307+0000 7fd610ff9700 1 -- 172.21.15.72:0/3918978316 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c018070 con 0x7fd614130e50 2023-10-03T10:19:23.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.307+0000 7fd610ff9700 1 -- 172.21.15.72:0/3918978316 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c00f040 con 0x7fd614130e50 2023-10-03T10:19:23.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.307+0000 7fd61a8a5700 1 -- 172.21.15.72:0/3918978316 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6040094a0 con 0x7fd614130e50 2023-10-03T10:19:23.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.307+0000 7fd610ff9700 1 -- 172.21.15.72:0/3918978316 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c003c40 con 0x7fd614130e50 2023-10-03T10:19:23.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.307+0000 7fd61a8a5700 1 -- 172.21.15.72:0/3918978316 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd614122b90 con 0x7fd614130e50 2023-10-03T10:19:23.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.307+0000 7fd610ff9700 1 -- 172.21.15.72:0/3918978316 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd60c00c8d0 con 0x7fd614130e50 2023-10-03T10:19:23.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.308+0000 7fd610ff9700 1 -- 172.21.15.72:0/3918978316 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd60c03f710 con 0x7fd614130e50 2023-10-03T10:19:23.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.308+0000 7fd61a8a5700 1 -- 172.21.15.72:0/3918978316 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61409cd40 con 0x7fd614130e50 2023-10-03T10:19:23.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.312+0000 7fd610ff9700 1 -- 172.21.15.72:0/3918978316 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd60c012340 con 0x7fd614130e50 2023-10-03T10:19:23.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.372+0000 7fb9501aa700 1 Processor -- start 2023-10-03T10:19:23.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.372+0000 7fb9501aa700 1 -- start start 2023-10-03T10:19:23.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb9501aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb94809d6f0 0x7fb94809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb9501aa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb94809e000 0x7fb9481339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb9501aa700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb94809e410 0x7fb948133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb9501aa700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94806b460 con 0x7fb94809e410 2023-10-03T10:19:23.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb9501aa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94809b120 con 0x7fb94809d6f0 2023-10-03T10:19:23.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb9501aa700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb94809a7e0 con 0x7fb94809e000 2023-10-03T10:19:23.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb94df46700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb94809d6f0 0x7fb94809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb94d745700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb94809e000 0x7fb9481339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb94df46700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb94809d6f0 0x7fb94809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59238/0 (socket says 172.21.15.72:59238) 2023-10-03T10:19:23.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb94df46700 1 -- 172.21.15.72:0/1675231001 learned_addr learned my addr 172.21.15.72:0/1675231001 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:23.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb94e747700 1 --2- 172.21.15.72:0/1675231001 >> v2:172.21.15.72:3300/0 conn(0x7fb94809e410 0x7fb948133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb94df46700 1 -- 172.21.15.72:0/1675231001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb94809e000 msgr2=0x7fb9481339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb94df46700 1 --2- 172.21.15.72:0/1675231001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb94809e000 0x7fb9481339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb94df46700 1 -- 172.21.15.72:0/1675231001 >> v2:172.21.15.72:3300/0 conn(0x7fb94809e410 msgr2=0x7fb948133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb94df46700 1 --2- 172.21.15.72:0/1675231001 >> v2:172.21.15.72:3300/0 conn(0x7fb94809e410 0x7fb948133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb94df46700 1 -- 172.21.15.72:0/1675231001 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94809a500 con 0x7fb94809d6f0 2023-10-03T10:19:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb94d745700 1 --2- 172.21.15.72:0/1675231001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb94809e000 0x7fb9481339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb94df46700 1 --2- 172.21.15.72:0/1675231001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb94809d6f0 0x7fb94809dac0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb944009920 tx=0x7fb944009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e04868b5e2896db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.373+0000 7fb94cf44700 1 -- 172.21.15.72:0/1675231001 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944011830 con 0x7fb94809d6f0 2023-10-03T10:19:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.374+0000 7fb94cf44700 1 -- 172.21.15.72:0/1675231001 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb944011990 con 0x7fb94809d6f0 2023-10-03T10:19:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.374+0000 7fb94cf44700 1 -- 172.21.15.72:0/1675231001 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944011d20 con 0x7fb94809d6f0 2023-10-03T10:19:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.374+0000 7fb9501aa700 1 -- 172.21.15.72:0/1675231001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb94809d6f0 msgr2=0x7fb94809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.374+0000 7fb9501aa700 1 --2- 172.21.15.72:0/1675231001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb94809d6f0 0x7fb94809dac0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb944009920 tx=0x7fb944009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.374+0000 7fb9501aa700 1 -- 172.21.15.72:0/1675231001 shutdown_connections 2023-10-03T10:19:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.374+0000 7fb9501aa700 1 --2- 172.21.15.72:0/1675231001 >> v2:172.21.15.72:3300/0 conn(0x7fb94809e410 0x7fb948133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.374+0000 7fb9501aa700 1 --2- 172.21.15.72:0/1675231001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb94809d6f0 0x7fb94809dac0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.374+0000 7fb9501aa700 1 --2- 172.21.15.72:0/1675231001 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb94809e000 0x7fb9481339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.374+0000 7fb9501aa700 1 -- 172.21.15.72:0/1675231001 >> 172.21.15.72:0/1675231001 conn(0x7fb948066f50 msgr2=0x7fb94809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.374+0000 7fb9501aa700 1 -- 172.21.15.72:0/1675231001 shutdown_connections 2023-10-03T10:19:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.374+0000 7fb9501aa700 1 -- 172.21.15.72:0/1675231001 wait complete. 2023-10-03T10:19:23.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.375+0000 7fb9501aa700 1 Processor -- start 2023-10-03T10:19:23.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.375+0000 7fb9501aa700 1 -- start start 2023-10-03T10:19:23.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb9501aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb94809d6f0 0x7fb9481a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb9501aa700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb94809e000 0x7fb9481a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb9501aa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb94809e410 0x7fb9481a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb9501aa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9481a9170 con 0x7fb94809e410 2023-10-03T10:19:23.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb9501aa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9481a7a90 con 0x7fb94809d6f0 2023-10-03T10:19:23.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb9501aa700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9481a9620 con 0x7fb94809e000 2023-10-03T10:19:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb94d745700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb94809e000 0x7fb9481a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb94df46700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb94809d6f0 0x7fb9481a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb94d745700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb94809e000 0x7fb9481a6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52364/0 (socket says 172.21.15.72:52364) 2023-10-03T10:19:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb94d745700 1 -- 172.21.15.72:0/3759175251 learned_addr learned my addr 172.21.15.72:0/3759175251 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb94e747700 1 --2- 172.21.15.72:0/3759175251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb94809e410 0x7fb9481a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb94d745700 1 -- 172.21.15.72:0/3759175251 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb94809d6f0 msgr2=0x7fb9481a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb94d745700 1 --2- 172.21.15.72:0/3759175251 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb94809d6f0 0x7fb9481a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb94d745700 1 -- 172.21.15.72:0/3759175251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb94809e410 msgr2=0x7fb9481a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb94d745700 1 --2- 172.21.15.72:0/3759175251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb94809e410 0x7fb9481a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb94d745700 1 -- 172.21.15.72:0/3759175251 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9380094a0 con 0x7fb94809e000 2023-10-03T10:19:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb94df46700 1 --2- 172.21.15.72:0/3759175251 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb94809d6f0 0x7fb9481a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb94e747700 1 --2- 172.21.15.72:0/3759175251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb94809e410 0x7fb9481a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:23.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb94d745700 1 --2- 172.21.15.72:0/3759175251 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb94809e000 0x7fb9481a6370 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb93800ebe0 tx=0x7fb93800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb93e7fc700 1 -- 172.21.15.72:0/3759175251 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93800c910 con 0x7fb94809e000 2023-10-03T10:19:23.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb93e7fc700 1 -- 172.21.15.72:0/3759175251 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93800ca70 con 0x7fb94809e000 2023-10-03T10:19:23.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb9501aa700 1 -- 172.21.15.72:0/3759175251 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb944009550 con 0x7fb94809e000 2023-10-03T10:19:23.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb93e7fc700 1 -- 172.21.15.72:0/3759175251 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93800ce00 con 0x7fb94809e000 2023-10-03T10:19:23.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.376+0000 7fb9501aa700 1 -- 172.21.15.72:0/3759175251 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9481a8c40 con 0x7fb94809e000 2023-10-03T10:19:23.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.377+0000 7fb93e7fc700 1 -- 172.21.15.72:0/3759175251 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb938013470 con 0x7fb94809e000 2023-10-03T10:19:23.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.377+0000 7fb93e7fc700 1 -- 172.21.15.72:0/3759175251 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb93803fc00 con 0x7fb94809e000 2023-10-03T10:19:23.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.378+0000 7fb9501aa700 1 -- 172.21.15.72:0/3759175251 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb948074ea0 con 0x7fb94809e000 2023-10-03T10:19:23.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.387+0000 7fb93e7fc700 1 -- 172.21.15.72:0/3759175251 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb93801b3b0 con 0x7fb94809e000 2023-10-03T10:19:23.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.466+0000 7fcbf0259700 1 -- 172.21.15.72:0/3657072920 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcbe8074ea0 con 0x7fcbe80a0a30 2023-10-03T10:19:23.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.467+0000 7fcbde7fc700 1 -- 172.21.15.72:0/3657072920 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fcbe402b070 con 0x7fcbe80a0a30 2023-10-03T10:19:23.467 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:23.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.469+0000 7fcbf0259700 1 -- 172.21.15.72:0/3657072920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbe80a0a30 msgr2=0x7fcbe81c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.469+0000 7fcbf0259700 1 --2- 172.21.15.72:0/3657072920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbe80a0a30 0x7fcbe81c8480 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40090b0 tx=0x7fcbe4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:23.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.469+0000 7fcbf0259700 1 -- 172.21.15.72:0/3657072920 shutdown_connections 2023-10-03T10:19:23.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.469+0000 7fcbf0259700 1 --2- 172.21.15.72:0/3657072920 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcbe8134170 0x7fcbe81c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.469+0000 7fcbf0259700 1 --2- 172.21.15.72:0/3657072920 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fcbe80a0a30 0x7fcbe81c8480 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.469+0000 7fcbf0259700 1 --2- 172.21.15.72:0/3657072920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbe80a1340 0x7fcbe81c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.469+0000 7fcbf0259700 1 -- 172.21.15.72:0/3657072920 >> 172.21.15.72:0/3657072920 conn(0x7fcbe80a6550 msgr2=0x7fcbe811c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:23.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.469+0000 7fcbf0259700 1 -- 172.21.15.72:0/3657072920 shutdown_connections 2023-10-03T10:19:23.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.469+0000 7fcbf0259700 1 -- 172.21.15.72:0/3657072920 wait complete. 2023-10-03T10:19:23.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:23.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.515+0000 7fd61a8a5700 1 -- 172.21.15.72:0/3918978316 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd614074ea0 con 0x7fd614130e50 2023-10-03T10:19:23.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.515+0000 7fd610ff9700 1 -- 172.21.15.72:0/3918978316 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd60c01de00 con 0x7fd614130e50 2023-10-03T10:19:23.516 INFO:teuthology.orchestra.run.smithi072.stdout:128849018882 2023-10-03T10:19:23.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.517+0000 7fd61a8a5700 1 -- 172.21.15.72:0/3918978316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd614130e50 msgr2=0x7fd61411f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.518+0000 7fd61a8a5700 1 --2- 172.21.15.72:0/3918978316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd614130e50 0x7fd61411f360 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009e50 tx=0x7fd60c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.518+0000 7fd61a8a5700 1 -- 172.21.15.72:0/3918978316 shutdown_connections 2023-10-03T10:19:23.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.518+0000 7fd61a8a5700 1 --2- 172.21.15.72:0/3918978316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd614130e50 0x7fd61411f360 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.518+0000 7fd61a8a5700 1 --2- 172.21.15.72:0/3918978316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd61406fcf0 0x7fd61411e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.518+0000 7fd61a8a5700 1 --2- 172.21.15.72:0/3918978316 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd614130540 0x7fd61411ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.518+0000 7fd61a8a5700 1 -- 172.21.15.72:0/3918978316 >> 172.21.15.72:0/3918978316 conn(0x7fd6140a2aa0 msgr2=0x7fd61412d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:23.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.518+0000 7fd61a8a5700 1 -- 172.21.15.72:0/3918978316 shutdown_connections 2023-10-03T10:19:23.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.518+0000 7fd61a8a5700 1 -- 172.21.15.72:0/3918978316 wait complete. 2023-10-03T10:19:23.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018883 got 128849018882 for osd.1 2023-10-03T10:19:23.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.580+0000 7fb9501aa700 1 -- 172.21.15.72:0/3759175251 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb94806c360 con 0x7fb94809e000 2023-10-03T10:19:23.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.580+0000 7fb93e7fc700 1 -- 172.21.15.72:0/3759175251 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb938017030 con 0x7fb94809e000 2023-10-03T10:19:23.581 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:23.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.582+0000 7fb9501aa700 1 -- 172.21.15.72:0/3759175251 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb94809e000 msgr2=0x7fb9481a6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.582+0000 7fb9501aa700 1 --2- 172.21.15.72:0/3759175251 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb94809e000 0x7fb9481a6370 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb93800ebe0 tx=0x7fb93800eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.582+0000 7fb9501aa700 1 -- 172.21.15.72:0/3759175251 shutdown_connections 2023-10-03T10:19:23.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.582+0000 7fb9501aa700 1 --2- 172.21.15.72:0/3759175251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb94809e410 0x7fb9481a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.582+0000 7fb9501aa700 1 --2- 172.21.15.72:0/3759175251 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb94809d6f0 0x7fb9481a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.582+0000 7fb9501aa700 1 --2- 172.21.15.72:0/3759175251 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb94809e000 0x7fb9481a6370 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.582+0000 7fb9501aa700 1 -- 172.21.15.72:0/3759175251 >> 172.21.15.72:0/3759175251 conn(0x7fb948066f50 msgr2=0x7fb9481bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:23.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.582+0000 7fb9501aa700 1 -- 172.21.15.72:0/3759175251 shutdown_connections 2023-10-03T10:19:23.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:23.582+0000 7fb9501aa700 1 -- 172.21.15.72:0/3759175251 wait complete. 2023-10-03T10:19:23.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:24.041 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:24.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.163+0000 7f3fd3cdd700 1 Processor -- start 2023-10-03T10:19:24.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd3cdd700 1 -- start start 2023-10-03T10:19:24.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd3cdd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fcc133420 0x7f3fcc1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd3cdd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fcc133e30 0x7f3fcc12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd3cdd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fcc06b990 con 0x7f3fcc134260 2023-10-03T10:19:24.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd3cdd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0a0590 con 0x7f3fcc133420 2023-10-03T10:19:24.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd3cdd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc09fb80 con 0x7f3fcc133e30 2023-10-03T10:19:24.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd1a79700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fcc133420 0x7f3fcc1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd227a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3fcc134260 0x7f3fcc1304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39924/0 (socket says 172.21.15.72:39924) 2023-10-03T10:19:24.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd227a700 1 -- 172.21.15.72:0/3725049999 learned_addr learned my addr 172.21.15.72:0/3725049999 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:24.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd1278700 1 --2- 172.21.15.72:0/3725049999 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fcc133e30 0x7f3fcc12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd0a77700 1 -- 172.21.15.72:0/3725049999 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916336501 0 0) 0x7f3fcc06b990 con 0x7f3fcc134260 2023-10-03T10:19:24.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd1a79700 1 -- 172.21.15.72:0/3725049999 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fcc133e30 msgr2=0x7f3fcc12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:24.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd1a79700 1 --2- 172.21.15.72:0/3725049999 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fcc133e30 0x7f3fcc12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd1a79700 1 -- 172.21.15.72:0/3725049999 >> v1:172.21.15.72:6789/0 conn(0x7f3fcc134260 legacy=0x7f3fcc1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd1a79700 1 -- 172.21.15.72:0/3725049999 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc0a0030 con 0x7f3fcc133420 2023-10-03T10:19:24.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.164+0000 7f3fd1278700 1 --2- 172.21.15.72:0/3725049999 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fcc133e30 0x7f3fcc12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:24.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.165+0000 7f3fd1a79700 1 --2- 172.21.15.72:0/3725049999 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fcc133420 0x7f3fcc1337f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009870 tx=0x7f3fbc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db6c2720454c6275 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:24.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.165+0000 7f3fd0a77700 1 -- 172.21.15.72:0/3725049999 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc011830 con 0x7f3fcc133420 2023-10-03T10:19:24.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.165+0000 7f3fd0a77700 1 -- 172.21.15.72:0/3725049999 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc011990 con 0x7f3fcc133420 2023-10-03T10:19:24.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.165+0000 7f3fd0a77700 1 -- 172.21.15.72:0/3725049999 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc011d20 con 0x7f3fcc133420 2023-10-03T10:19:24.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.165+0000 7f3fd3cdd700 1 -- 172.21.15.72:0/3725049999 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fcc133420 msgr2=0x7f3fcc1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.165+0000 7f3fd3cdd700 1 --2- 172.21.15.72:0/3725049999 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fcc133420 0x7f3fcc1337f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009870 tx=0x7f3fbc009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:24.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.165+0000 7f3fd3cdd700 1 -- 172.21.15.72:0/3725049999 shutdown_connections 2023-10-03T10:19:24.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.165+0000 7f3fd3cdd700 1 --2- 172.21.15.72:0/3725049999 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fcc133420 0x7f3fcc1337f0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.165+0000 7f3fd3cdd700 1 --2- 172.21.15.72:0/3725049999 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fcc133e30 0x7f3fcc12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.165+0000 7f3fd3cdd700 1 -- 172.21.15.72:0/3725049999 >> 172.21.15.72:0/3725049999 conn(0x7f3fcc0a4210 msgr2=0x7f3fcc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.165+0000 7f3fd3cdd700 1 -- 172.21.15.72:0/3725049999 shutdown_connections 2023-10-03T10:19:24.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.165+0000 7f3fd3cdd700 1 -- 172.21.15.72:0/3725049999 wait complete. 2023-10-03T10:19:24.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.166+0000 7f3fd3cdd700 1 Processor -- start 2023-10-03T10:19:24.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.166+0000 7f3fd3cdd700 1 -- start start 2023-10-03T10:19:24.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd3cdd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fcc133420 0x7f3fcc09c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd3cdd700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fcc133e30 0x7f3fcc09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd3cdd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fcc134260 0x7f3fcc09d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd3cdd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc11fe10 con 0x7f3fcc133420 2023-10-03T10:19:24.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd3cdd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc11fae0 con 0x7f3fcc134260 2023-10-03T10:19:24.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd3cdd700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc131490 con 0x7f3fcc133e30 2023-10-03T10:19:24.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd1a79700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fcc133420 0x7f3fcc09c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd227a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fcc134260 0x7f3fcc09d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd1278700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fcc133e30 0x7f3fcc09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd1a79700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fcc133420 0x7f3fcc09c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51060/0 (socket says 172.21.15.72:51060) 2023-10-03T10:19:24.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd1a79700 1 -- 172.21.15.72:0/377511649 learned_addr learned my addr 172.21.15.72:0/377511649 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:24.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd1278700 1 -- 172.21.15.72:0/377511649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fcc134260 msgr2=0x7f3fcc09d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd1278700 1 --2- 172.21.15.72:0/377511649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fcc134260 0x7f3fcc09d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd1278700 1 -- 172.21.15.72:0/377511649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fcc133420 msgr2=0x7f3fcc09c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd1278700 1 --2- 172.21.15.72:0/377511649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fcc133420 0x7f3fcc09c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd1278700 1 -- 172.21.15.72:0/377511649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc80094a0 con 0x7f3fcc133e30 2023-10-03T10:19:24.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd1a79700 1 --2- 172.21.15.72:0/377511649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fcc133420 0x7f3fcc09c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:24.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd1278700 1 --2- 172.21.15.72:0/377511649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fcc133e30 0x7f3fcc09cc20 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800e980 tx=0x7f3fc800ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:24.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fc27fc700 1 -- 172.21.15.72:0/377511649 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc800c690 con 0x7f3fcc133e30 2023-10-03T10:19:24.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fc27fc700 1 -- 172.21.15.72:0/377511649 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc800c7f0 con 0x7f3fcc133e30 2023-10-03T10:19:24.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fc27fc700 1 -- 172.21.15.72:0/377511649 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc800cb80 con 0x7f3fcc133e30 2023-10-03T10:19:24.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd3cdd700 1 -- 172.21.15.72:0/377511649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fbc0094a0 con 0x7f3fcc133e30 2023-10-03T10:19:24.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.167+0000 7f3fd3cdd700 1 -- 172.21.15.72:0/377511649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fcc09e180 con 0x7f3fcc133e30 2023-10-03T10:19:24.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.168+0000 7f3fc27fc700 1 -- 172.21.15.72:0/377511649 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3fc800cce0 con 0x7f3fcc133e30 2023-10-03T10:19:24.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.168+0000 7f3fc27fc700 1 -- 172.21.15.72:0/377511649 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3fc803f6c0 con 0x7f3fcc133e30 2023-10-03T10:19:24.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.168+0000 7f3fd3cdd700 1 -- 172.21.15.72:0/377511649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fcc12dc70 con 0x7f3fcc133e30 2023-10-03T10:19:24.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.173+0000 7f3fc27fc700 1 -- 172.21.15.72:0/377511649 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fc801bba0 con 0x7f3fcc133e30 2023-10-03T10:19:24.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.356+0000 7f3fd3cdd700 1 -- 172.21.15.72:0/377511649 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3fcc074ea0 con 0x7f3fcc133e30 2023-10-03T10:19:24.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.357+0000 7f3fc27fc700 1 -- 172.21.15.72:0/377511649 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3fc8021020 con 0x7f3fcc133e30 2023-10-03T10:19:24.357 INFO:teuthology.orchestra.run.smithi072.stdout:124554051586 2023-10-03T10:19:24.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.359+0000 7f3fd3cdd700 1 -- 172.21.15.72:0/377511649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fcc133e30 msgr2=0x7f3fcc09cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.359+0000 7f3fd3cdd700 1 --2- 172.21.15.72:0/377511649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fcc133e30 0x7f3fcc09cc20 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800e980 tx=0x7f3fc800ec90 comp rx=0 tx=0).stop 2023-10-03T10:19:24.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.359+0000 7f3fd3cdd700 1 -- 172.21.15.72:0/377511649 shutdown_connections 2023-10-03T10:19:24.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.359+0000 7f3fd3cdd700 1 --2- 172.21.15.72:0/377511649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fcc133420 0x7f3fcc09c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.359+0000 7f3fd3cdd700 1 --2- 172.21.15.72:0/377511649 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fcc134260 0x7f3fcc09d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.359+0000 7f3fd3cdd700 1 --2- 172.21.15.72:0/377511649 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3fcc133e30 0x7f3fcc09cc20 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.359+0000 7f3fd3cdd700 1 -- 172.21.15.72:0/377511649 >> 172.21.15.72:0/377511649 conn(0x7f3fcc0a4210 msgr2=0x7f3fcc0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.359+0000 7f3fd3cdd700 1 -- 172.21.15.72:0/377511649 shutdown_connections 2023-10-03T10:19:24.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.359+0000 7f3fd3cdd700 1 -- 172.21.15.72:0/377511649 wait complete. 2023-10-03T10:19:24.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.0 2023-10-03T10:19:24.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:24.531 INFO:tasks.ceph:ignoring flush pg stats error, probably testing upgrade: timed out waiting for mon to be updated with osd.1: 128849018882 < 128849018883 2023-10-03T10:19:24.532 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:19:24.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:19:24.596 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:24.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.607+0000 7fd917ff7700 1 Processor -- start 2023-10-03T10:19:24.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.608+0000 7fd917ff7700 1 -- start start 2023-10-03T10:19:24.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.608+0000 7fd917ff7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910133540 0x7fd910135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.608+0000 7fd917ff7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd910135e60 0x7fd910138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.608+0000 7fd917ff7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9100716a0 con 0x7fd910130540 2023-10-03T10:19:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.608+0000 7fd917ff7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd910071290 con 0x7fd910133540 2023-10-03T10:19:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.608+0000 7fd917ff7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd910130340 con 0x7fd910135e60 2023-10-03T10:19:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.608+0000 7fd915592700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910133540 0x7fd910135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.608+0000 7fd916594700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd910135e60 0x7fd910138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.608+0000 7fd916594700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd910135e60 0x7fd910138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52392/0 (socket says 172.21.15.72:52392) 2023-10-03T10:19:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.608+0000 7fd915d93700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd910130540 0x7fd910130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39938/0 (socket says 172.21.15.72:39938) 2023-10-03T10:19:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.608+0000 7fd916594700 1 -- 172.21.15.72:0/652684549 learned_addr learned my addr 172.21.15.72:0/652684549 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.608+0000 7fd915592700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910133540 0x7fd910135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:59270/0 (socket says 172.21.15.72:59270) 2023-10-03T10:19:24.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.609+0000 7fd914d91700 1 -- 172.21.15.72:0/652684549 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614818290 0 0) 0x7fd9100716a0 con 0x7fd910130540 2023-10-03T10:19:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.609+0000 7fd916594700 1 -- 172.21.15.72:0/652684549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910133540 msgr2=0x7fd910135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.609+0000 7fd916594700 1 --2- 172.21.15.72:0/652684549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910133540 0x7fd910135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.609+0000 7fd916594700 1 -- 172.21.15.72:0/652684549 >> v1:172.21.15.72:6789/0 conn(0x7fd910130540 legacy=0x7fd910130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.609+0000 7fd916594700 1 -- 172.21.15.72:0/652684549 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd910070b80 con 0x7fd910135e60 2023-10-03T10:19:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.609+0000 7fd916594700 1 --2- 172.21.15.72:0/652684549 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd910135e60 0x7fd910138240 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fd908009e80 tx=0x7fd90800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6b133103c5da0fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.609+0000 7fd914d91700 1 -- 172.21.15.72:0/652684549 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90800e070 con 0x7fd910135e60 2023-10-03T10:19:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.609+0000 7fd914d91700 1 -- 172.21.15.72:0/652684549 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90800b910 con 0x7fd910135e60 2023-10-03T10:19:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.609+0000 7fd914d91700 1 -- 172.21.15.72:0/652684549 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90800bcc0 con 0x7fd910135e60 2023-10-03T10:19:24.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.610+0000 7fd917ff7700 1 -- 172.21.15.72:0/652684549 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd910135e60 msgr2=0x7fd910138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.610+0000 7fd917ff7700 1 --2- 172.21.15.72:0/652684549 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd910135e60 0x7fd910138240 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fd908009e80 tx=0x7fd90800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:24.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.610+0000 7fd917ff7700 1 -- 172.21.15.72:0/652684549 shutdown_connections 2023-10-03T10:19:24.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.610+0000 7fd917ff7700 1 --2- 172.21.15.72:0/652684549 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd910135e60 0x7fd910138240 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.610+0000 7fd917ff7700 1 --2- 172.21.15.72:0/652684549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910133540 0x7fd910135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.610+0000 7fd917ff7700 1 -- 172.21.15.72:0/652684549 >> 172.21.15.72:0/652684549 conn(0x7fd9100a2aa0 msgr2=0x7fd9100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.610+0000 7fd917ff7700 1 -- 172.21.15.72:0/652684549 shutdown_connections 2023-10-03T10:19:24.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.610+0000 7fd917ff7700 1 -- 172.21.15.72:0/652684549 wait complete. 2023-10-03T10:19:24.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.611+0000 7fd917ff7700 1 Processor -- start 2023-10-03T10:19:24.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.611+0000 7fd917ff7700 1 -- start start 2023-10-03T10:19:24.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd917ff7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd910130540 0x7fd91009d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd917ff7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910133540 0x7fd91009d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd917ff7700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd910135e60 0x7fd91009dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd917ff7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91011c100 con 0x7fd910130540 2023-10-03T10:19:24.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd917ff7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100a1ef0 con 0x7fd910133540 2023-10-03T10:19:24.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd917ff7700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100718e0 con 0x7fd910135e60 2023-10-03T10:19:24.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd916594700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd910135e60 0x7fd91009dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd915d93700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd910130540 0x7fd91009d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd916594700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd910135e60 0x7fd91009dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52406/0 (socket says 172.21.15.72:52406) 2023-10-03T10:19:24.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd916594700 1 -- 172.21.15.72:0/773932593 learned_addr learned my addr 172.21.15.72:0/773932593 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:24.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd915592700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910133540 0x7fd91009d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd916594700 1 -- 172.21.15.72:0/773932593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910133540 msgr2=0x7fd91009d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd916594700 1 --2- 172.21.15.72:0/773932593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910133540 0x7fd91009d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd916594700 1 -- 172.21.15.72:0/773932593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd910130540 msgr2=0x7fd91009d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd916594700 1 --2- 172.21.15.72:0/773932593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd910130540 0x7fd91009d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd916594700 1 -- 172.21.15.72:0/773932593 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd908009b30 con 0x7fd910135e60 2023-10-03T10:19:24.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd915592700 1 --2- 172.21.15.72:0/773932593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910133540 0x7fd91009d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:24.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.612+0000 7fd915d93700 1 --2- 172.21.15.72:0/773932593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd910130540 0x7fd91009d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:24.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.613+0000 7fd916594700 1 --2- 172.21.15.72:0/773932593 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd910135e60 0x7fd91009dc90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd908003f50 tx=0x7fd908004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:24.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.613+0000 7fd9067fc700 1 -- 172.21.15.72:0/773932593 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908004450 con 0x7fd910135e60 2023-10-03T10:19:24.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.613+0000 7fd9067fc700 1 -- 172.21.15.72:0/773932593 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9080045b0 con 0x7fd910135e60 2023-10-03T10:19:24.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.613+0000 7fd917ff7700 1 -- 172.21.15.72:0/773932593 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91011bd50 con 0x7fd910135e60 2023-10-03T10:19:24.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.613+0000 7fd9067fc700 1 -- 172.21.15.72:0/773932593 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908004940 con 0x7fd910135e60 2023-10-03T10:19:24.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.613+0000 7fd917ff7700 1 -- 172.21.15.72:0/773932593 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91006e770 con 0x7fd910135e60 2023-10-03T10:19:24.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.614+0000 7fd917ff7700 1 -- 172.21.15.72:0/773932593 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd910074ea0 con 0x7fd910135e60 2023-10-03T10:19:24.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.614+0000 7fd9067fc700 1 -- 172.21.15.72:0/773932593 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd90801c410 con 0x7fd910135e60 2023-10-03T10:19:24.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.615+0000 7fd9067fc700 1 -- 172.21.15.72:0/773932593 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd908041730 con 0x7fd910135e60 2023-10-03T10:19:24.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.623+0000 7fd9067fc700 1 -- 172.21.15.72:0/773932593 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd90802d7a0 con 0x7fd910135e60 2023-10-03T10:19:24.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.667+0000 7f51d38a4700 1 Processor -- start 2023-10-03T10:19:24.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.668+0000 7f51d38a4700 1 -- start start 2023-10-03T10:19:24.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.668+0000 7f51d38a4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51cc0a0a30 0x7f51cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.668+0000 7f51d38a4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51cc09d630 0x7f51cc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.668+0000 7f51d38a4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51cc0a2a70 con 0x7f51cc133930 2023-10-03T10:19:24.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.668+0000 7f51d38a4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51cc0a01d0 con 0x7f51cc0a0a30 2023-10-03T10:19:24.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.668+0000 7f51d38a4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc09e2b0 con 0x7f51cc09d630 2023-10-03T10:19:24.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.668+0000 7f51d1640700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51cc0a0a30 0x7f51cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.668+0000 7f51d1640700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f51cc0a0a30 0x7f51cc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51078/0 (socket says 172.21.15.72:51078) 2023-10-03T10:19:24.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.668+0000 7f51d1640700 1 -- 172.21.15.72:0/2252822075 learned_addr learned my addr 172.21.15.72:0/2252822075 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:24.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.668+0000 7f51d0e3f700 1 --2- 172.21.15.72:0/2252822075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51cc09d630 0x7f51cc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.669+0000 7f51d1640700 1 -- 172.21.15.72:0/2252822075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51cc09d630 msgr2=0x7f51cc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:24.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.669+0000 7f51d1640700 1 --2- 172.21.15.72:0/2252822075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51cc09d630 0x7f51cc0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.669+0000 7f51d1640700 1 -- 172.21.15.72:0/2252822075 >> v1:172.21.15.72:6789/0 conn(0x7f51cc133930 legacy=0x7f51cc133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:24.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.669+0000 7f51d1640700 1 -- 172.21.15.72:0/2252822075 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc09dc50 con 0x7f51cc0a0a30 2023-10-03T10:19:24.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.669+0000 7f51d1640700 1 --2- 172.21.15.72:0/2252822075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51cc0a0a30 0x7f51cc0a0e00 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f51c80098f0 tx=0x7f51c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be32f7380f40301f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:24.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.669+0000 7f51c3fff700 1 -- 172.21.15.72:0/2252822075 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c8004230 con 0x7f51cc0a0a30 2023-10-03T10:19:24.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.669+0000 7f51c3fff700 1 -- 172.21.15.72:0/2252822075 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c8004390 con 0x7f51cc0a0a30 2023-10-03T10:19:24.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.669+0000 7f51c3fff700 1 -- 172.21.15.72:0/2252822075 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c80036a0 con 0x7f51cc0a0a30 2023-10-03T10:19:24.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.669+0000 7f51d38a4700 1 -- 172.21.15.72:0/2252822075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51cc0a0a30 msgr2=0x7f51cc0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.669+0000 7f51d38a4700 1 --2- 172.21.15.72:0/2252822075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51cc0a0a30 0x7f51cc0a0e00 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f51c80098f0 tx=0x7f51c8009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:24.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.670+0000 7f51d38a4700 1 -- 172.21.15.72:0/2252822075 shutdown_connections 2023-10-03T10:19:24.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.670+0000 7f51d38a4700 1 --2- 172.21.15.72:0/2252822075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51cc0a0a30 0x7f51cc0a0e00 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.670+0000 7f51d38a4700 1 --2- 172.21.15.72:0/2252822075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51cc09d630 0x7f51cc0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.670+0000 7f51d38a4700 1 -- 172.21.15.72:0/2252822075 >> 172.21.15.72:0/2252822075 conn(0x7f51cc0a3050 msgr2=0x7f51cc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.670+0000 7f51d38a4700 1 -- 172.21.15.72:0/2252822075 shutdown_connections 2023-10-03T10:19:24.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.670+0000 7f51d38a4700 1 -- 172.21.15.72:0/2252822075 wait complete. 2023-10-03T10:19:24.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.671+0000 7f51d38a4700 1 Processor -- start 2023-10-03T10:19:24.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.671+0000 7f51d38a4700 1 -- start start 2023-10-03T10:19:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d38a4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51cc09d630 0x7f51cc11f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d38a4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51cc0a0a30 0x7f51cc11f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d38a4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51cc133930 0x7f51cc1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d38a4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc121fb0 con 0x7f51cc0a0a30 2023-10-03T10:19:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d38a4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc11eef0 con 0x7f51cc09d630 2023-10-03T10:19:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d38a4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc120640 con 0x7f51cc133930 2023-10-03T10:19:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d0e3f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51cc0a0a30 0x7f51cc11f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d1640700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51cc09d630 0x7f51cc11f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d0e3f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51cc0a0a30 0x7f51cc11f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51092/0 (socket says 172.21.15.72:51092) 2023-10-03T10:19:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d0e3f700 1 -- 172.21.15.72:0/2780618476 learned_addr learned my addr 172.21.15.72:0/2780618476 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:24.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d1e41700 1 --2- 172.21.15.72:0/2780618476 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51cc133930 0x7f51cc1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d0e3f700 1 -- 172.21.15.72:0/2780618476 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51cc133930 msgr2=0x7f51cc1c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d0e3f700 1 --2- 172.21.15.72:0/2780618476 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f51cc133930 0x7f51cc1c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d0e3f700 1 -- 172.21.15.72:0/2780618476 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51cc09d630 msgr2=0x7f51cc11f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d0e3f700 1 --2- 172.21.15.72:0/2780618476 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51cc09d630 0x7f51cc11f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d0e3f700 1 -- 172.21.15.72:0/2780618476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c8009550 con 0x7f51cc0a0a30 2023-10-03T10:19:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.672+0000 7f51d0e3f700 1 --2- 172.21.15.72:0/2780618476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51cc0a0a30 0x7f51cc11f9d0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00e9b0 tx=0x7f51bc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.673+0000 7f51c1ffb700 1 -- 172.21.15.72:0/2780618476 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00ee50 con 0x7f51cc0a0a30 2023-10-03T10:19:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.673+0000 7f51c1ffb700 1 -- 172.21.15.72:0/2780618476 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc00c850 con 0x7f51cc0a0a30 2023-10-03T10:19:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.673+0000 7f51c1ffb700 1 -- 172.21.15.72:0/2780618476 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00cbc0 con 0x7f51cc0a0a30 2023-10-03T10:19:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.673+0000 7f51d38a4700 1 -- 172.21.15.72:0/2780618476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51cc0a4030 con 0x7f51cc0a0a30 2023-10-03T10:19:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.673+0000 7f51d38a4700 1 -- 172.21.15.72:0/2780618476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51cc1334e0 con 0x7f51cc0a0a30 2023-10-03T10:19:24.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.674+0000 7f51c1ffb700 1 -- 172.21.15.72:0/2780618476 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51bc00cd20 con 0x7f51cc0a0a30 2023-10-03T10:19:24.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.674+0000 7f51c1ffb700 1 -- 172.21.15.72:0/2780618476 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f51bc03fa60 con 0x7f51cc0a0a30 2023-10-03T10:19:24.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.675+0000 7f51d38a4700 1 -- 172.21.15.72:0/2780618476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51cc11ff10 con 0x7f51cc0a0a30 2023-10-03T10:19:24.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.679+0000 7f51c1ffb700 1 -- 172.21.15.72:0/2780618476 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51bc017080 con 0x7f51cc0a0a30 2023-10-03T10:19:24.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.722+0000 7f838243c700 1 Processor -- start 2023-10-03T10:19:24.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.722+0000 7f838243c700 1 -- start start 2023-10-03T10:19:24.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.723+0000 7f838243c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f837c09d6f0 0x7f837c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.723+0000 7f838243c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f837c09e410 0x7f837c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.723+0000 7f838243c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837c09b120 con 0x7f837c09e000 2023-10-03T10:19:24.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.723+0000 7f838243c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837c06b460 con 0x7f837c09e410 2023-10-03T10:19:24.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.723+0000 7f838243c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f837c09a7e0 con 0x7f837c09d6f0 2023-10-03T10:19:24.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.723+0000 7f837bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f837c09d6f0 0x7f837c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.723+0000 7f83809d9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f837c09e410 0x7f837c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.723+0000 7f837b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f837c09e000 0x7f837c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39958/0 (socket says 172.21.15.72:39958) 2023-10-03T10:19:24.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.723+0000 7f837b7fe700 1 -- 172.21.15.72:0/2494843361 learned_addr learned my addr 172.21.15.72:0/2494843361 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:24.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.723+0000 7f837bfff700 1 -- 172.21.15.72:0/2494843361 >> v2:172.21.15.72:3300/0 conn(0x7f837c09e410 msgr2=0x7f837c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:24.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.723+0000 7f837bfff700 1 --2- 172.21.15.72:0/2494843361 >> v2:172.21.15.72:3300/0 conn(0x7f837c09e410 0x7f837c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.723+0000 7f837bfff700 1 -- 172.21.15.72:0/2494843361 >> v1:172.21.15.72:6789/0 conn(0x7f837c09e000 legacy=0x7f837c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.723+0000 7f837bfff700 1 -- 172.21.15.72:0/2494843361 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c09a500 con 0x7f837c09d6f0 2023-10-03T10:19:24.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.723+0000 7f837bfff700 1 --2- 172.21.15.72:0/2494843361 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f837c09d6f0 0x7f837c09dac0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f836c009870 tx=0x7f836c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f7f0d499e881df2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:24.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.724+0000 7f837affd700 1 -- 172.21.15.72:0/2494843361 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c011830 con 0x7f837c09d6f0 2023-10-03T10:19:24.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.724+0000 7f837affd700 1 -- 172.21.15.72:0/2494843361 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c011990 con 0x7f837c09d6f0 2023-10-03T10:19:24.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.724+0000 7f837affd700 1 -- 172.21.15.72:0/2494843361 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c011d20 con 0x7f837c09d6f0 2023-10-03T10:19:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.724+0000 7f838243c700 1 -- 172.21.15.72:0/2494843361 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f837c09d6f0 msgr2=0x7f837c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.724+0000 7f838243c700 1 --2- 172.21.15.72:0/2494843361 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f837c09d6f0 0x7f837c09dac0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f836c009870 tx=0x7f836c009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:24.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.724+0000 7f838243c700 1 -- 172.21.15.72:0/2494843361 shutdown_connections 2023-10-03T10:19:24.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.724+0000 7f838243c700 1 --2- 172.21.15.72:0/2494843361 >> v2:172.21.15.72:3300/0 conn(0x7f837c09e410 0x7f837c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.724+0000 7f838243c700 1 --2- 172.21.15.72:0/2494843361 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f837c09d6f0 0x7f837c09dac0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.724+0000 7f838243c700 1 -- 172.21.15.72:0/2494843361 >> 172.21.15.72:0/2494843361 conn(0x7f837c066f50 msgr2=0x7f837c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.724+0000 7f838243c700 1 -- 172.21.15.72:0/2494843361 shutdown_connections 2023-10-03T10:19:24.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.724+0000 7f838243c700 1 -- 172.21.15.72:0/2494843361 wait complete. 2023-10-03T10:19:24.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.725+0000 7f838243c700 1 Processor -- start 2023-10-03T10:19:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.725+0000 7f838243c700 1 -- start start 2023-10-03T10:19:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f838243c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f837c09d6f0 0x7f837c1a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f838243c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f837c09e000 0x7f837c1a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f838243c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f837c09e410 0x7f837c1a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f838243c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c1a97f0 con 0x7f837c09d6f0 2023-10-03T10:19:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f838243c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c1a99f0 con 0x7f837c09e410 2023-10-03T10:19:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f838243c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f837c1a88e0 con 0x7f837c09e000 2023-10-03T10:19:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f837b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f837c09e000 0x7f837c1a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f837bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f837c09d6f0 0x7f837c1a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f837b7fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f837c09e000 0x7f837c1a64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52438/0 (socket says 172.21.15.72:52438) 2023-10-03T10:19:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f837b7fe700 1 -- 172.21.15.72:0/2629706774 learned_addr learned my addr 172.21.15.72:0/2629706774 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f837bfff700 1 -- 172.21.15.72:0/2629706774 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f837c09e000 msgr2=0x7f837c1a64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f837bfff700 1 --2- 172.21.15.72:0/2629706774 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f837c09e000 0x7f837c1a64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f837bfff700 1 -- 172.21.15.72:0/2629706774 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f837c09e410 msgr2=0x7f837c1a69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f837bfff700 1 --2- 172.21.15.72:0/2629706774 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f837c09e410 0x7f837c1a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f837bfff700 1 -- 172.21.15.72:0/2629706774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c0094a0 con 0x7f837c09d6f0 2023-10-03T10:19:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.726+0000 7f837bfff700 1 --2- 172.21.15.72:0/2629706774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f837c09d6f0 0x7f837c1a5f60 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f836c016000 tx=0x7f836c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.727+0000 7f8378ff9700 1 -- 172.21.15.72:0/2629706774 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c0036a0 con 0x7f837c09d6f0 2023-10-03T10:19:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.727+0000 7f8378ff9700 1 -- 172.21.15.72:0/2629706774 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c01f070 con 0x7f837c09d6f0 2023-10-03T10:19:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.727+0000 7f8378ff9700 1 -- 172.21.15.72:0/2629706774 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c003a00 con 0x7f837c09d6f0 2023-10-03T10:19:24.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.727+0000 7f838243c700 1 -- 172.21.15.72:0/2629706774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c1a7b80 con 0x7f837c09d6f0 2023-10-03T10:19:24.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.727+0000 7f838243c700 1 -- 172.21.15.72:0/2629706774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c0a3340 con 0x7f837c09d6f0 2023-10-03T10:19:24.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.728+0000 7f8378ff9700 1 -- 172.21.15.72:0/2629706774 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f836c003b60 con 0x7f837c09d6f0 2023-10-03T10:19:24.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.728+0000 7f8378ff9700 1 -- 172.21.15.72:0/2629706774 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f836c021070 con 0x7f837c09d6f0 2023-10-03T10:19:24.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.728+0000 7f838243c700 1 -- 172.21.15.72:0/2629706774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c074ea0 con 0x7f837c09d6f0 2023-10-03T10:19:24.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.732+0000 7f8378ff9700 1 -- 172.21.15.72:0/2629706774 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f836c015030 con 0x7f837c09d6f0 2023-10-03T10:19:24.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.848+0000 7fd917ff7700 1 -- 172.21.15.72:0/773932593 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd91006b9e0 con 0x7fd910135e60 2023-10-03T10:19:24.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.849+0000 7fd9067fc700 1 -- 172.21.15.72:0/773932593 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fd90801b3a0 con 0x7fd910135e60 2023-10-03T10:19:24.849 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:24.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.850+0000 7fd917ff7700 1 -- 172.21.15.72:0/773932593 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd910135e60 msgr2=0x7fd91009dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.850+0000 7fd917ff7700 1 --2- 172.21.15.72:0/773932593 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd910135e60 0x7fd91009dc90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd908003f50 tx=0x7fd908004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.851+0000 7fd917ff7700 1 -- 172.21.15.72:0/773932593 shutdown_connections 2023-10-03T10:19:24.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.851+0000 7fd917ff7700 1 --2- 172.21.15.72:0/773932593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd910130540 0x7fd91009d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.851+0000 7fd917ff7700 1 --2- 172.21.15.72:0/773932593 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fd910135e60 0x7fd91009dc90 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.851+0000 7fd917ff7700 1 --2- 172.21.15.72:0/773932593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910133540 0x7fd91009d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.851+0000 7fd917ff7700 1 -- 172.21.15.72:0/773932593 >> 172.21.15.72:0/773932593 conn(0x7fd9100a2aa0 msgr2=0x7fd910131d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.851+0000 7fd917ff7700 1 -- 172.21.15.72:0/773932593 shutdown_connections 2023-10-03T10:19:24.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.851+0000 7fd917ff7700 1 -- 172.21.15.72:0/773932593 wait complete. 2023-10-03T10:19:24.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:19:24.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.924+0000 7f838243c700 1 -- 172.21.15.72:0/2629706774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f837c06c360 con 0x7f837c09d6f0 2023-10-03T10:19:24.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.924+0000 7f8378ff9700 1 -- 172.21.15.72:0/2629706774 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f836c02b020 con 0x7f837c09d6f0 2023-10-03T10:19:24.925 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.926+0000 7f838243c700 1 -- 172.21.15.72:0/2629706774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f837c09d6f0 msgr2=0x7f837c1a5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.926+0000 7f838243c700 1 --2- 172.21.15.72:0/2629706774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f837c09d6f0 0x7f837c1a5f60 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f836c016000 tx=0x7f836c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.926+0000 7f838243c700 1 -- 172.21.15.72:0/2629706774 shutdown_connections 2023-10-03T10:19:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.926+0000 7f838243c700 1 --2- 172.21.15.72:0/2629706774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f837c09d6f0 0x7f837c1a5f60 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.926+0000 7f838243c700 1 --2- 172.21.15.72:0/2629706774 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f837c09e410 0x7f837c1a69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.926+0000 7f838243c700 1 --2- 172.21.15.72:0/2629706774 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f837c09e000 0x7f837c1a64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.926+0000 7f838243c700 1 -- 172.21.15.72:0/2629706774 >> 172.21.15.72:0/2629706774 conn(0x7f837c066f50 msgr2=0x7f837c1baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.927+0000 7f838243c700 1 -- 172.21.15.72:0/2629706774 shutdown_connections 2023-10-03T10:19:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:24.927+0000 7f838243c700 1 -- 172.21.15.72:0/2629706774 wait complete. 2023-10-03T10:19:24.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986179 got 1 for osd.2 2023-10-03T10:19:25.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:25.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.997+0000 7fb18f851700 1 Processor -- start 2023-10-03T10:19:25.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.998+0000 7fb18f851700 1 -- start start 2023-10-03T10:19:26.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.998+0000 7fb18f851700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb18809f410 0x7fb188136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.998+0000 7fb18f851700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb188136fe0 0x7fb1881393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.998+0000 7fb18f851700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb188070940 con 0x7fb18809e930 2023-10-03T10:19:26.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.998+0000 7fb18f851700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18806fd60 con 0x7fb188136fe0 2023-10-03T10:19:26.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.998+0000 7fb18f851700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb18806fa80 con 0x7fb18809f410 2023-10-03T10:19:26.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.998+0000 7fb18ddee700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb188136fe0 0x7fb1881393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.998+0000 7fb18cdec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb18809f410 0x7fb188136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.998+0000 7fb18d5ed700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb18809e930 0x7fb18809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:39962/0 (socket says 172.21.15.72:39962) 2023-10-03T10:19:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.998+0000 7fb18d5ed700 1 -- 172.21.15.72:0/183960882 learned_addr learned my addr 172.21.15.72:0/183960882 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:19:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.998+0000 7fb18cdec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb18809f410 0x7fb188136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:52442/0 (socket says 172.21.15.72:52442) 2023-10-03T10:19:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.998+0000 7fb18ddee700 1 --2- 172.21.15.72:0/183960882 >> v2:172.21.15.72:3300/0 conn(0x7fb188136fe0 0x7fb1881393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51138/0 (socket says 172.21.15.72:51138) 2023-10-03T10:19:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.998+0000 7fb18ddee700 1 -- 172.21.15.72:0/183960882 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb18809f410 msgr2=0x7fb188136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.998+0000 7fb18ddee700 1 --2- 172.21.15.72:0/183960882 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb18809f410 0x7fb188136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.999+0000 7fb18ddee700 1 -- 172.21.15.72:0/183960882 >> v1:172.21.15.72:6789/0 conn(0x7fb18809e930 legacy=0x7fb18809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.999+0000 7fb18ddee700 1 -- 172.21.15.72:0/183960882 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18809fb60 con 0x7fb188136fe0 2023-10-03T10:19:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.999+0000 7fb187fff700 1 -- 172.21.15.72:0/183960882 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237353002 0 0) 0x7fb188070940 con 0x7fb18809e930 2023-10-03T10:19:26.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.999+0000 7fb18cdec700 1 --2- 172.21.15.72:0/183960882 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb18809f410 0x7fb188136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.999+0000 7fb18ddee700 1 --2- 172.21.15.72:0/183960882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb188136fe0 0x7fb1881393c0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fb180009840 tx=0x7fb180009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2faf50e47f1303c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.999+0000 7fb187fff700 1 -- 172.21.15.72:0/183960882 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180011830 con 0x7fb188136fe0 2023-10-03T10:19:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.999+0000 7fb187fff700 1 -- 172.21.15.72:0/183960882 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb180011990 con 0x7fb188136fe0 2023-10-03T10:19:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.999+0000 7fb187fff700 1 -- 172.21.15.72:0/183960882 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180011d20 con 0x7fb188136fe0 2023-10-03T10:19:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.999+0000 7fb18f851700 1 -- 172.21.15.72:0/183960882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb188136fe0 msgr2=0x7fb1881393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.999+0000 7fb18f851700 1 --2- 172.21.15.72:0/183960882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb188136fe0 0x7fb1881393c0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fb180009840 tx=0x7fb180009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.999+0000 7fb18f851700 1 -- 172.21.15.72:0/183960882 shutdown_connections 2023-10-03T10:19:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.999+0000 7fb18f851700 1 --2- 172.21.15.72:0/183960882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb188136fe0 0x7fb1881393c0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.999+0000 7fb18f851700 1 --2- 172.21.15.72:0/183960882 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb18809f410 0x7fb188136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:25.999+0000 7fb18f851700 1 -- 172.21.15.72:0/183960882 >> 172.21.15.72:0/183960882 conn(0x7fb1880a4210 msgr2=0x7fb1880a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:26.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.000+0000 7fb18f851700 1 -- 172.21.15.72:0/183960882 shutdown_connections 2023-10-03T10:19:26.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.000+0000 7fb18f851700 1 -- 172.21.15.72:0/183960882 wait complete. 2023-10-03T10:19:26.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.000+0000 7fb18f851700 1 Processor -- start 2023-10-03T10:19:26.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.000+0000 7fb18f851700 1 -- start start 2023-10-03T10:19:26.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18f851700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb18809e930 0x7fb18811e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18f851700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb18809f410 0x7fb18811ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18f851700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb188136fe0 0x7fb18811f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18f851700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb188120590 con 0x7fb18809e930 2023-10-03T10:19:26.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18f851700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1881346f0 con 0x7fb188136fe0 2023-10-03T10:19:26.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18f851700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb188122320 con 0x7fb18809f410 2023-10-03T10:19:26.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18d5ed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb18809e930 0x7fb18811e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18cdec700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb18809f410 0x7fb18811ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18d5ed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb18809e930 0x7fb18811e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51152/0 (socket says 172.21.15.72:51152) 2023-10-03T10:19:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18d5ed700 1 -- 172.21.15.72:0/3729891084 learned_addr learned my addr 172.21.15.72:0/3729891084 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:19:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18ddee700 1 --2- 172.21.15.72:0/3729891084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb188136fe0 0x7fb18811f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18d5ed700 1 -- 172.21.15.72:0/3729891084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb18809f410 msgr2=0x7fb18811ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18d5ed700 1 --2- 172.21.15.72:0/3729891084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb18809f410 0x7fb18811ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18d5ed700 1 -- 172.21.15.72:0/3729891084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb188136fe0 msgr2=0x7fb18811f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18d5ed700 1 --2- 172.21.15.72:0/3729891084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb188136fe0 0x7fb18811f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18d5ed700 1 -- 172.21.15.72:0/3729891084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0094a0 con 0x7fb18809e930 2023-10-03T10:19:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18cdec700 1 --2- 172.21.15.72:0/3729891084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb18809f410 0x7fb18811ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:26.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.001+0000 7fb18d5ed700 1 --2- 172.21.15.72:0/3729891084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb18809e930 0x7fb18811e850 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fb17800cc80 tx=0x7fb17800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.002+0000 7fb185ffb700 1 -- 172.21.15.72:0/3729891084 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17800ab00 con 0x7fb18809e930 2023-10-03T10:19:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.002+0000 7fb185ffb700 1 -- 172.21.15.72:0/3729891084 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17800ac60 con 0x7fb18809e930 2023-10-03T10:19:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.002+0000 7fb185ffb700 1 -- 172.21.15.72:0/3729891084 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1780070d0 con 0x7fb18809e930 2023-10-03T10:19:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.002+0000 7fb18f851700 1 -- 172.21.15.72:0/3729891084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1800094a0 con 0x7fb18809e930 2023-10-03T10:19:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.002+0000 7fb18f851700 1 -- 172.21.15.72:0/3729891084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1880a32a0 con 0x7fb18809e930 2023-10-03T10:19:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.002+0000 7fb185ffb700 1 -- 172.21.15.72:0/3729891084 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb178007230 con 0x7fb18809e930 2023-10-03T10:19:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.003+0000 7fb185ffb700 1 -- 172.21.15.72:0/3729891084 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb17803f3a0 con 0x7fb18809e930 2023-10-03T10:19:26.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.003+0000 7fb18f851700 1 -- 172.21.15.72:0/3729891084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb188074ea0 con 0x7fb18809e930 2023-10-03T10:19:26.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.007+0000 7fb185ffb700 1 -- 172.21.15.72:0/3729891084 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb178018070 con 0x7fb18809e930 2023-10-03T10:19:26.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.192+0000 7fb18f851700 1 -- 172.21.15.72:0/3729891084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb188122100 con 0x7fb18809e930 2023-10-03T10:19:26.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.192+0000 7fb185ffb700 1 -- 172.21.15.72:0/3729891084 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fb178019860 con 0x7fb18809e930 2023-10-03T10:19:26.193 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-03T10:19:26.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.195+0000 7fb18f851700 1 -- 172.21.15.72:0/3729891084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb18809e930 msgr2=0x7fb18811e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.195+0000 7fb18f851700 1 --2- 172.21.15.72:0/3729891084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb18809e930 0x7fb18811e850 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fb17800cc80 tx=0x7fb17800cf90 comp rx=0 tx=0).stop 2023-10-03T10:19:26.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.195+0000 7fb18f851700 1 -- 172.21.15.72:0/3729891084 shutdown_connections 2023-10-03T10:19:26.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.195+0000 7fb18f851700 1 --2- 172.21.15.72:0/3729891084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb18809e930 0x7fb18811e850 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.195+0000 7fb18f851700 1 --2- 172.21.15.72:0/3729891084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb188136fe0 0x7fb18811f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.195+0000 7fb18f851700 1 --2- 172.21.15.72:0/3729891084 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fb18809f410 0x7fb18811ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.195+0000 7fb18f851700 1 -- 172.21.15.72:0/3729891084 >> 172.21.15.72:0/3729891084 conn(0x7fb1880a4210 msgr2=0x7fb188134900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:26.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.195+0000 7fb18f851700 1 -- 172.21.15.72:0/3729891084 shutdown_connections 2023-10-03T10:19:26.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:19:26.195+0000 7fb18f851700 1 -- 172.21.15.72:0/3729891084 wait complete. 2023-10-03T10:19:26.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953475 got 1 for osd.3 2023-10-03T10:21:24.565 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-03T10:21:24.566 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:21:24.634 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=81e94f0751c045238401bb4f3fbbe8a2 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:21:24.639 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-03T10:21:24.651 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2023-10-03T10:21:24.660 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-03T10:21:24.670 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-03T10:21:24.680 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2023-10-03T10:21:24.689 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-03T10:21:24.699 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-03T10:21:24.700 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-10-03T10:21:24.700 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T10:21:24.727 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-10-03T10:21:24.727 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T10:21:24.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:21:24.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.922+0000 7f08037dc700 1 Processor -- start 2023-10-03T10:21:24.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.922+0000 7f08037dc700 1 -- start start 2023-10-03T10:21:24.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f08037dc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07fc06a770 0x7f07fc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:24.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f08037dc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07fc06b080 0x7f07fc131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:24.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f08037dc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f07fc131b40 0x7f07fc131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:24.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f08037dc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07fc09ece0 con 0x7f07fc131b40 2023-10-03T10:21:24.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f08037dc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc09e760 con 0x7f07fc06b080 2023-10-03T10:21:24.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f08037dc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc09e040 con 0x7f07fc06a770 2023-10-03T10:21:24.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f0800d77700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07fc06b080 0x7f07fc131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:24.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f0801d79700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f07fc131b40 0x7f07fc131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:24.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f0800d77700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07fc06b080 0x7f07fc131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43468/0 (socket says 172.21.15.72:43468) 2023-10-03T10:21:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f0800d77700 1 -- 172.21.15.72:0/2552841502 learned_addr learned my addr 172.21.15.72:0/2552841502 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f0801578700 1 --2- 172.21.15.72:0/2552841502 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07fc06a770 0x7f07fc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f0801d79700 1 -- 172.21.15.72:0/2552841502 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07fc06a770 msgr2=0x7f07fc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f0801d79700 1 --2- 172.21.15.72:0/2552841502 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07fc06a770 0x7f07fc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f0801d79700 1 -- 172.21.15.72:0/2552841502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07fc06b080 msgr2=0x7f07fc131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f0801d79700 1 --2- 172.21.15.72:0/2552841502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07fc06b080 0x7f07fc131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f0801d79700 1 -- 172.21.15.72:0/2552841502 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc09f630 con 0x7f07fc131b40 2023-10-03T10:21:24.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f0801578700 1 --2- 172.21.15.72:0/2552841502 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07fc06a770 0x7f07fc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f0800d77700 1 --2- 172.21.15.72:0/2552841502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07fc06b080 0x7f07fc131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f0801d79700 1 --2- 172.21.15.72:0/2552841502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07fc131b40 0x7f07fc131fe0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009d90 tx=0x7f07f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e26be79eabf092 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f07f3fff700 1 -- 172.21.15.72:0/2552841502 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f400e070 con 0x7f07fc131b40 2023-10-03T10:21:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f07f3fff700 1 -- 172.21.15.72:0/2552841502 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f400bb20 con 0x7f07fc131b40 2023-10-03T10:21:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.923+0000 7f07f3fff700 1 -- 172.21.15.72:0/2552841502 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4012430 con 0x7f07fc131b40 2023-10-03T10:21:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.924+0000 7f08037dc700 1 -- 172.21.15.72:0/2552841502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07fc131b40 msgr2=0x7f07fc131fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.924+0000 7f08037dc700 1 --2- 172.21.15.72:0/2552841502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07fc131b40 0x7f07fc131fe0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009d90 tx=0x7f07f400b330 comp rx=0 tx=0).stop 2023-10-03T10:21:24.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.924+0000 7f08037dc700 1 -- 172.21.15.72:0/2552841502 shutdown_connections 2023-10-03T10:21:24.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.924+0000 7f08037dc700 1 --2- 172.21.15.72:0/2552841502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07fc131b40 0x7f07fc131fe0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:24.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.924+0000 7f08037dc700 1 --2- 172.21.15.72:0/2552841502 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07fc06a770 0x7f07fc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:24.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.924+0000 7f08037dc700 1 --2- 172.21.15.72:0/2552841502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07fc06b080 0x7f07fc131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:24.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.924+0000 7f08037dc700 1 -- 172.21.15.72:0/2552841502 >> 172.21.15.72:0/2552841502 conn(0x7f07fc066f50 msgr2=0x7f07fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:24.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.924+0000 7f08037dc700 1 -- 172.21.15.72:0/2552841502 shutdown_connections 2023-10-03T10:21:24.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.924+0000 7f08037dc700 1 -- 172.21.15.72:0/2552841502 wait complete. 2023-10-03T10:21:24.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.925+0000 7f08037dc700 1 Processor -- start 2023-10-03T10:21:24.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.925+0000 7f08037dc700 1 -- start start 2023-10-03T10:21:24.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.925+0000 7f08037dc700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07fc06a770 0x7f07fc11f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:24.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.925+0000 7f08037dc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07fc06b080 0x7f07fc11f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:24.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.925+0000 7f08037dc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07fc131b40 0x7f07fc11fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:24.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.925+0000 7f08037dc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc1304d0 con 0x7f07fc131b40 2023-10-03T10:21:24.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.925+0000 7f08037dc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc0a3bd0 con 0x7f07fc06b080 2023-10-03T10:21:24.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.925+0000 7f08037dc700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc071e60 con 0x7f07fc06a770 2023-10-03T10:21:24.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f0800d77700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07fc06b080 0x7f07fc11f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:24.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f0801578700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07fc06a770 0x7f07fc11f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:24.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f0801d79700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07fc131b40 0x7f07fc11fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:24.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f0800d77700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07fc06b080 0x7f07fc11f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43482/0 (socket says 172.21.15.72:43482) 2023-10-03T10:21:24.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f0800d77700 1 -- 172.21.15.72:0/2405937430 learned_addr learned my addr 172.21.15.72:0/2405937430 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:24.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f0800d77700 1 -- 172.21.15.72:0/2405937430 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07fc06a770 msgr2=0x7f07fc11f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:24.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f0800d77700 1 --2- 172.21.15.72:0/2405937430 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07fc06a770 0x7f07fc11f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:24.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f0800d77700 1 -- 172.21.15.72:0/2405937430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07fc131b40 msgr2=0x7f07fc11fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:24.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f0800d77700 1 --2- 172.21.15.72:0/2405937430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07fc131b40 0x7f07fc11fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:24.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f0800d77700 1 -- 172.21.15.72:0/2405937430 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec0094a0 con 0x7f07fc06b080 2023-10-03T10:21:24.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f0801d79700 1 --2- 172.21.15.72:0/2405937430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07fc131b40 0x7f07fc11fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:24.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f0801578700 1 --2- 172.21.15.72:0/2405937430 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07fc06a770 0x7f07fc11f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:24.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f0800d77700 1 --2- 172.21.15.72:0/2405937430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07fc06b080 0x7f07fc11f5d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f07f800ebe0 tx=0x7f07f800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:24.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f07f1ffb700 1 -- 172.21.15.72:0/2405937430 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f800c850 con 0x7f07fc06b080 2023-10-03T10:21:24.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f07f1ffb700 1 -- 172.21.15.72:0/2405937430 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f800c9b0 con 0x7f07fc06b080 2023-10-03T10:21:24.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f08037dc700 1 -- 172.21.15.72:0/2405937430 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f8009550 con 0x7f07fc06b080 2023-10-03T10:21:24.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f07f1ffb700 1 -- 172.21.15.72:0/2405937430 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f800cd60 con 0x7f07fc06b080 2023-10-03T10:21:24.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.926+0000 7f08037dc700 1 -- 172.21.15.72:0/2405937430 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f4009a70 con 0x7f07fc06b080 2023-10-03T10:21:24.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.927+0000 7f07f1ffb700 1 -- 172.21.15.72:0/2405937430 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07f8013470 con 0x7f07fc06b080 2023-10-03T10:21:24.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.927+0000 7f07f1ffb700 1 -- 172.21.15.72:0/2405937430 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f07f803f680 con 0x7f07fc06b080 2023-10-03T10:21:24.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.927+0000 7f08037dc700 1 -- 172.21.15.72:0/2405937430 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07fc11bc30 con 0x7f07fc06b080 2023-10-03T10:21:24.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:24.932+0000 7f07f1ffb700 1 -- 172.21.15.72:0/2405937430 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07f80232f0 con 0x7f07fc06b080 2023-10-03T10:21:25.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.117+0000 7f08037dc700 1 -- 172.21.15.72:0/2405937430 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07fc074ea0 con 0x7f07fc06b080 2023-10-03T10:21:25.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.118+0000 7f07f1ffb700 1 -- 172.21.15.72:0/2405937430 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+13394 (secure 0 0 0) 0x7f07f8017020 con 0x7f07fc06b080 2023-10-03T10:21:25.119 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:21:25.119 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:13:00.483506+0000","last_up_change":"2023-10-03T10:12:25.534779+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":129472}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":129472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":129472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":129472}]},"public_addr":"172.21.15.72:6804/129472","cluster_addr":"172.21.15.72:6805/129472","heartbeat_back_addr":"172.21.15.72:6807/129472","heartbeat_front_addr":"172.21.15.72:6806/129472","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":129570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":129570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":129570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":129570}]},"public_addr":"172.21.15.72:6800/129570","cluster_addr":"172.21.15.72:6801/129570","heartbeat_back_addr":"172.21.15.72:6803/129570","heartbeat_front_addr":"172.21.15.72:6802/129570","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":129702}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":129702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":129702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":129702}]},"public_addr":"172.21.15.72:6808/129702","cluster_addr":"172.21.15.72:6809/129702","heartbeat_back_addr":"172.21.15.72:6811/129702","heartbeat_front_addr":"172.21.15.72:6810/129702","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":130020}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":130020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":130020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":130020}]},"public_addr":"172.21.15.72:6812/130020","cluster_addr":"172.21.15.72:6813/130020","heartbeat_back_addr":"172.21.15.72:6815/130020","heartbeat_front_addr":"172.21.15.72:6814/130020","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:19.493196+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":0}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":0}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/412002554":"2023-10-04T10:13:00.483478+0000","172.21.15.72:0/405703097":"2023-10-04T10:13:00.483478+0000","172.21.15.72:0/3554355102":"2023-10-04T10:13:00.483478+0000","172.21.15.72:0/2966012812":"2023-10-04T10:12:06.073551+0000","172.21.15.72:6816/126756":"2023-10-04T10:13:00.483478+0000","172.21.15.72:0/3319279924":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/2679211469":"2023-10-04T10:13:00.483478+0000","172.21.15.72:6817/542674768":"2023-10-04T10:12:27.583946+0000","172.21.15.72:0/1449937992":"2023-10-04T10:13:00.483478+0000","172.21.15.72:6816/118184":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/2763351041":"2023-10-04T10:13:00.483478+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:21:25.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.120+0000 7f08037dc700 1 -- 172.21.15.72:0/2405937430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07fc06b080 msgr2=0x7f07fc11f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:25.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.120+0000 7f08037dc700 1 --2- 172.21.15.72:0/2405937430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07fc06b080 0x7f07fc11f5d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f07f800ebe0 tx=0x7f07f800eef0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.120+0000 7f08037dc700 1 -- 172.21.15.72:0/2405937430 shutdown_connections 2023-10-03T10:21:25.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.120+0000 7f08037dc700 1 --2- 172.21.15.72:0/2405937430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07fc131b40 0x7f07fc11fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.120+0000 7f08037dc700 1 --2- 172.21.15.72:0/2405937430 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f07fc06a770 0x7f07fc11f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.120+0000 7f08037dc700 1 --2- 172.21.15.72:0/2405937430 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07fc06b080 0x7f07fc11f5d0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.120+0000 7f08037dc700 1 -- 172.21.15.72:0/2405937430 >> 172.21.15.72:0/2405937430 conn(0x7f07fc066f50 msgr2=0x7f07fc130e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:25.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.120+0000 7f08037dc700 1 -- 172.21.15.72:0/2405937430 shutdown_connections 2023-10-03T10:21:25.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.121+0000 7f08037dc700 1 -- 172.21.15.72:0/2405937430 wait complete. 2023-10-03T10:21:25.133 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:38.963446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:40.092839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:44.713857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:45.314387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:21:25.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:21:25.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.259+0000 7f0fdc1c3700 1 Processor -- start 2023-10-03T10:21:25.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.259+0000 7f0fdc1c3700 1 -- start start 2023-10-03T10:21:25.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.259+0000 7f0fdc1c3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd412e180 0x7f0fd412e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.259+0000 7f0fdc1c3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd406a770 0x7f0fd406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.259+0000 7f0fdc1c3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fd406b0a0 0x7f0fd4138580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.259+0000 7f0fdc1c3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd412df80 con 0x7f0fd406b0a0 2023-10-03T10:21:25.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.259+0000 7f0fdc1c3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd409e640 con 0x7f0fd406a770 2023-10-03T10:21:25.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.259+0000 7f0fdc1c3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd409f7c0 con 0x7f0fd412e180 2023-10-03T10:21:25.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.259+0000 7f0fd9f5f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd412e180 0x7f0fd412e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.259+0000 7f0fd9f5f700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd412e180 0x7f0fd412e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51686/0 (socket says 172.21.15.72:51686) 2023-10-03T10:21:25.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.259+0000 7f0fd9f5f700 1 -- 172.21.15.72:0/1500486224 learned_addr learned my addr 172.21.15.72:0/1500486224 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:25.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.259+0000 7f0fd975e700 1 --2- 172.21.15.72:0/1500486224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd406a770 0x7f0fd406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.259+0000 7f0fda760700 1 --2- 172.21.15.72:0/1500486224 >> v2:172.21.15.72:3300/0 conn(0x7f0fd406b0a0 0x7f0fd4138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.260+0000 7f0fd975e700 1 -- 172.21.15.72:0/1500486224 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd412e180 msgr2=0x7f0fd412e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.260+0000 7f0fd975e700 1 --2- 172.21.15.72:0/1500486224 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd412e180 0x7f0fd412e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.260+0000 7f0fd975e700 1 -- 172.21.15.72:0/1500486224 >> v2:172.21.15.72:3300/0 conn(0x7f0fd406b0a0 msgr2=0x7f0fd4138580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.260+0000 7f0fd975e700 1 --2- 172.21.15.72:0/1500486224 >> v2:172.21.15.72:3300/0 conn(0x7f0fd406b0a0 0x7f0fd4138580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.260+0000 7f0fd975e700 1 -- 172.21.15.72:0/1500486224 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd409e900 con 0x7f0fd406a770 2023-10-03T10:21:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.260+0000 7f0fd9f5f700 1 --2- 172.21.15.72:0/1500486224 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd412e180 0x7f0fd412e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.260+0000 7f0fda760700 1 --2- 172.21.15.72:0/1500486224 >> v2:172.21.15.72:3300/0 conn(0x7f0fd406b0a0 0x7f0fd4138580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.260+0000 7f0fd975e700 1 --2- 172.21.15.72:0/1500486224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd406a770 0x7f0fd406ab60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009840 tx=0x7f0fc4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f11d7427c50986d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:25.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.260+0000 7f0fd8f5d700 1 -- 172.21.15.72:0/1500486224 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4011830 con 0x7f0fd406a770 2023-10-03T10:21:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.260+0000 7f0fd8f5d700 1 -- 172.21.15.72:0/1500486224 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc4011990 con 0x7f0fd406a770 2023-10-03T10:21:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.260+0000 7f0fd8f5d700 1 -- 172.21.15.72:0/1500486224 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4011d20 con 0x7f0fd406a770 2023-10-03T10:21:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.261+0000 7f0fdc1c3700 1 -- 172.21.15.72:0/1500486224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd406a770 msgr2=0x7f0fd406ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.261+0000 7f0fdc1c3700 1 --2- 172.21.15.72:0/1500486224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd406a770 0x7f0fd406ab60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009840 tx=0x7f0fc4009b50 comp rx=0 tx=0).stop 2023-10-03T10:21:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.261+0000 7f0fdc1c3700 1 -- 172.21.15.72:0/1500486224 shutdown_connections 2023-10-03T10:21:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.261+0000 7f0fdc1c3700 1 --2- 172.21.15.72:0/1500486224 >> v2:172.21.15.72:3300/0 conn(0x7f0fd406b0a0 0x7f0fd4138580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.261+0000 7f0fdc1c3700 1 --2- 172.21.15.72:0/1500486224 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd412e180 0x7f0fd412e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.261+0000 7f0fdc1c3700 1 --2- 172.21.15.72:0/1500486224 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd406a770 0x7f0fd406ab60 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.261+0000 7f0fdc1c3700 1 -- 172.21.15.72:0/1500486224 >> 172.21.15.72:0/1500486224 conn(0x7f0fd4066d70 msgr2=0x7f0fd40a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.261+0000 7f0fdc1c3700 1 -- 172.21.15.72:0/1500486224 shutdown_connections 2023-10-03T10:21:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.261+0000 7f0fdc1c3700 1 -- 172.21.15.72:0/1500486224 wait complete. 2023-10-03T10:21:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fdc1c3700 1 Processor -- start 2023-10-03T10:21:25.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fdc1c3700 1 -- start start 2023-10-03T10:21:25.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fdc1c3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd406a770 0x7f0fd41c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fdc1c3700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd406b0a0 0x7f0fd41c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fdc1c3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd412e180 0x7f0fd409a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fdc1c3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd411fab0 con 0x7f0fd406a770 2023-10-03T10:21:25.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fdc1c3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40a1060 con 0x7f0fd412e180 2023-10-03T10:21:25.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fdc1c3700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd412b840 con 0x7f0fd406b0a0 2023-10-03T10:21:25.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fd975e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd406b0a0 0x7f0fd41c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fd9f5f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd406a770 0x7f0fd41c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fd9f5f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd406a770 0x7f0fd41c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40138/0 (socket says 172.21.15.72:40138) 2023-10-03T10:21:25.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fd975e700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd406b0a0 0x7f0fd41c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51702/0 (socket says 172.21.15.72:51702) 2023-10-03T10:21:25.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fd9f5f700 1 -- 172.21.15.72:0/860387111 learned_addr learned my addr 172.21.15.72:0/860387111 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:25.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fda760700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd412e180 0x7f0fd409a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fd975e700 1 -- 172.21.15.72:0/860387111 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd412e180 msgr2=0x7f0fd409a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:25.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fd975e700 1 --2- 172.21.15.72:0/860387111 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd412e180 0x7f0fd409a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fd975e700 1 -- 172.21.15.72:0/860387111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd406a770 msgr2=0x7f0fd41c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:25.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fd975e700 1 --2- 172.21.15.72:0/860387111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd406a770 0x7f0fd41c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fd975e700 1 -- 172.21.15.72:0/860387111 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc009a70 con 0x7f0fd406b0a0 2023-10-03T10:21:25.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.262+0000 7f0fd9f5f700 1 --2- 172.21.15.72:0/860387111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd406a770 0x7f0fd41c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:25.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.263+0000 7f0fd975e700 1 --2- 172.21.15.72:0/860387111 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd406b0a0 0x7f0fd41c8c00 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f0fd409cdc0 tx=0x7f0fc4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:25.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.263+0000 7f0fca7fc700 1 -- 172.21.15.72:0/860387111 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4004450 con 0x7f0fd406b0a0 2023-10-03T10:21:25.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.263+0000 7f0fca7fc700 1 -- 172.21.15.72:0/860387111 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc401f070 con 0x7f0fd406b0a0 2023-10-03T10:21:25.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.263+0000 7f0fdc1c3700 1 -- 172.21.15.72:0/860387111 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd0009550 con 0x7f0fd406b0a0 2023-10-03T10:21:25.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.263+0000 7f0fca7fc700 1 -- 172.21.15.72:0/860387111 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40038e0 con 0x7f0fd406b0a0 2023-10-03T10:21:25.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.263+0000 7f0fdc1c3700 1 -- 172.21.15.72:0/860387111 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc40094a0 con 0x7f0fd406b0a0 2023-10-03T10:21:25.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.263+0000 7f0fca7fc700 1 -- 172.21.15.72:0/860387111 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0fc4003a40 con 0x7f0fd406b0a0 2023-10-03T10:21:25.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.264+0000 7f0fca7fc700 1 -- 172.21.15.72:0/860387111 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0fc4021070 con 0x7f0fd406b0a0 2023-10-03T10:21:25.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.264+0000 7f0fdc1c3700 1 -- 172.21.15.72:0/860387111 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd41207e0 con 0x7f0fd406b0a0 2023-10-03T10:21:25.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.269+0000 7f0fca7fc700 1 -- 172.21.15.72:0/860387111 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0fc401a950 con 0x7f0fd406b0a0 2023-10-03T10:21:25.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.451+0000 7f0fdc1c3700 1 -- 172.21.15.72:0/860387111 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0fd404f2a0 con 0x7f0fd406b0a0 2023-10-03T10:21:25.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.451+0000 7f0fca7fc700 1 -- 172.21.15.72:0/860387111 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0fc4010b70 con 0x7f0fd406b0a0 2023-10-03T10:21:25.452 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-03T10:21:25.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.453+0000 7f0fdc1c3700 1 -- 172.21.15.72:0/860387111 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd406b0a0 msgr2=0x7f0fd41c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:25.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.453+0000 7f0fdc1c3700 1 --2- 172.21.15.72:0/860387111 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd406b0a0 0x7f0fd41c8c00 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f0fd409cdc0 tx=0x7f0fc4004750 comp rx=0 tx=0).stop 2023-10-03T10:21:25.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.453+0000 7f0fdc1c3700 1 -- 172.21.15.72:0/860387111 shutdown_connections 2023-10-03T10:21:25.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.453+0000 7f0fdc1c3700 1 --2- 172.21.15.72:0/860387111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fd406a770 0x7f0fd41c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.453+0000 7f0fdc1c3700 1 --2- 172.21.15.72:0/860387111 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fd412e180 0x7f0fd409a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.453+0000 7f0fdc1c3700 1 --2- 172.21.15.72:0/860387111 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0fd406b0a0 0x7f0fd41c8c00 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.453+0000 7f0fdc1c3700 1 -- 172.21.15.72:0/860387111 >> 172.21.15.72:0/860387111 conn(0x7f0fd4066d70 msgr2=0x7f0fd412ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:25.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.453+0000 7f0fdc1c3700 1 -- 172.21.15.72:0/860387111 shutdown_connections 2023-10-03T10:21:25.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.453+0000 7f0fdc1c3700 1 -- 172.21.15.72:0/860387111 wait complete. 2023-10-03T10:21:25.466 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:21:25.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.589+0000 7f3ab4f4d700 1 Processor -- start 2023-10-03T10:21:25.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.589+0000 7f3ab4f4d700 1 -- start start 2023-10-03T10:21:25.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.590+0000 7f3ab4f4d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ab0136780 0x7f3ab0138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.590+0000 7f3ab4f4d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ab01390a0 0x7f3ab013b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.590+0000 7f3ab4f4d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab01301c0 con 0x7f3ab01303c0 2023-10-03T10:21:25.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.590+0000 7f3ab4f4d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab009f620 con 0x7f3ab01390a0 2023-10-03T10:21:25.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.590+0000 7f3ab4f4d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab009e1b0 con 0x7f3ab0136780 2023-10-03T10:21:25.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.590+0000 7f3aadd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ab0136780 0x7f3ab0138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.590+0000 7f3aaed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ab01390a0 0x7f3ab013b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.590+0000 7f3aadd9b700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ab0136780 0x7f3ab0138b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51714/0 (socket says 172.21.15.72:51714) 2023-10-03T10:21:25.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.590+0000 7f3aaed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ab01390a0 0x7f3ab013b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40142/0 (socket says 172.21.15.72:40142) 2023-10-03T10:21:25.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.590+0000 7f3aadd9b700 1 -- 172.21.15.72:0/31541721 learned_addr learned my addr 172.21.15.72:0/31541721 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:25.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.590+0000 7f3aaed9d700 1 -- 172.21.15.72:0/31541721 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ab0136780 msgr2=0x7f3ab0138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:25.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.590+0000 7f3aaed9d700 1 --2- 172.21.15.72:0/31541721 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ab0136780 0x7f3ab0138b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.590+0000 7f3aaed9d700 1 -- 172.21.15.72:0/31541721 >> v1:172.21.15.72:6789/0 conn(0x7f3ab01303c0 legacy=0x7f3ab0130790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:25.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.590+0000 7f3aaed9d700 1 -- 172.21.15.72:0/31541721 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab00a3a60 con 0x7f3ab01390a0 2023-10-03T10:21:25.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.590+0000 7f3aadd9b700 1 --2- 172.21.15.72:0/31541721 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ab0136780 0x7f3ab0138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:25.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.591+0000 7f3aaed9d700 1 --2- 172.21.15.72:0/31541721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ab01390a0 0x7f3ab013b480 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009d90 tx=0x7f3aa800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac346e469b98b1b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:25.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.591+0000 7f3aad59a700 1 -- 172.21.15.72:0/31541721 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa800e070 con 0x7f3ab01390a0 2023-10-03T10:21:25.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.591+0000 7f3aad59a700 1 -- 172.21.15.72:0/31541721 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa800bb20 con 0x7f3ab01390a0 2023-10-03T10:21:25.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.591+0000 7f3aad59a700 1 -- 172.21.15.72:0/31541721 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8012430 con 0x7f3ab01390a0 2023-10-03T10:21:25.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.591+0000 7f3ab4f4d700 1 -- 172.21.15.72:0/31541721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ab01390a0 msgr2=0x7f3ab013b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:25.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.591+0000 7f3ab4f4d700 1 --2- 172.21.15.72:0/31541721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ab01390a0 0x7f3ab013b480 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009d90 tx=0x7f3aa800b330 comp rx=0 tx=0).stop 2023-10-03T10:21:25.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.591+0000 7f3ab4f4d700 1 -- 172.21.15.72:0/31541721 shutdown_connections 2023-10-03T10:21:25.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.591+0000 7f3ab4f4d700 1 --2- 172.21.15.72:0/31541721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ab01390a0 0x7f3ab013b480 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.591+0000 7f3ab4f4d700 1 --2- 172.21.15.72:0/31541721 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ab0136780 0x7f3ab0138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.591+0000 7f3ab4f4d700 1 -- 172.21.15.72:0/31541721 >> 172.21.15.72:0/31541721 conn(0x7f3ab0066d70 msgr2=0x7f3ab00a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:25.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.591+0000 7f3ab4f4d700 1 -- 172.21.15.72:0/31541721 shutdown_connections 2023-10-03T10:21:25.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.591+0000 7f3ab4f4d700 1 -- 172.21.15.72:0/31541721 wait complete. 2023-10-03T10:21:25.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.592+0000 7f3ab4f4d700 1 Processor -- start 2023-10-03T10:21:25.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.592+0000 7f3ab4f4d700 1 -- start start 2023-10-03T10:21:25.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3ab4f4d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ab01303c0 0x7f3ab0132260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3ab4f4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ab0136780 0x7f3ab01327a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3ab4f4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ab01390a0 0x7f3ab0132ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3ab4f4d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab0070200 con 0x7f3ab01390a0 2023-10-03T10:21:25.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3ab4f4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab006f280 con 0x7f3ab0136780 2023-10-03T10:21:25.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3ab4f4d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab0072970 con 0x7f3ab01303c0 2023-10-03T10:21:25.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3aae59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ab01303c0 0x7f3ab0132260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3aadd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ab0136780 0x7f3ab01327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3aae59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ab01303c0 0x7f3ab0132260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51726/0 (socket says 172.21.15.72:51726) 2023-10-03T10:21:25.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3aaed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ab01390a0 0x7f3ab0132ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3aae59c700 1 -- 172.21.15.72:0/3228066342 learned_addr learned my addr 172.21.15.72:0/3228066342 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:25.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3aae59c700 1 -- 172.21.15.72:0/3228066342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ab0136780 msgr2=0x7f3ab01327a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:25.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3aae59c700 1 --2- 172.21.15.72:0/3228066342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ab0136780 0x7f3ab01327a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3aae59c700 1 -- 172.21.15.72:0/3228066342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ab01390a0 msgr2=0x7f3ab0132ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:25.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3aae59c700 1 --2- 172.21.15.72:0/3228066342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ab01390a0 0x7f3ab0132ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3aae59c700 1 -- 172.21.15.72:0/3228066342 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa0009550 con 0x7f3ab01303c0 2023-10-03T10:21:25.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3aae59c700 1 --2- 172.21.15.72:0/3228066342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ab01303c0 0x7f3ab0132260 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400c510 tx=0x7f3aa400c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:25.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3a9effd700 1 -- 172.21.15.72:0/3228066342 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa40052d0 con 0x7f3ab01303c0 2023-10-03T10:21:25.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3a9effd700 1 -- 172.21.15.72:0/3228066342 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa4005430 con 0x7f3ab01303c0 2023-10-03T10:21:25.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3ab4f4d700 1 -- 172.21.15.72:0/3228066342 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa8009a70 con 0x7f3ab01303c0 2023-10-03T10:21:25.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.593+0000 7f3a9effd700 1 -- 172.21.15.72:0/3228066342 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa40038c0 con 0x7f3ab01303c0 2023-10-03T10:21:25.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.594+0000 7f3ab4f4d700 1 -- 172.21.15.72:0/3228066342 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab012da60 con 0x7f3ab01303c0 2023-10-03T10:21:25.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.594+0000 7f3ab4f4d700 1 -- 172.21.15.72:0/3228066342 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab006f3c0 con 0x7f3ab01303c0 2023-10-03T10:21:25.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.595+0000 7f3a9effd700 1 -- 172.21.15.72:0/3228066342 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3aa4003a20 con 0x7f3ab01303c0 2023-10-03T10:21:25.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.595+0000 7f3a9effd700 1 -- 172.21.15.72:0/3228066342 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3aa403ec50 con 0x7f3ab01303c0 2023-10-03T10:21:25.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.599+0000 7f3a9effd700 1 -- 172.21.15.72:0/3228066342 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3aa403ee60 con 0x7f3ab01303c0 2023-10-03T10:21:25.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.779+0000 7f3ab4f4d700 1 -- 172.21.15.72:0/3228066342 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3ab004f2a0 con 0x7f3ab01303c0 2023-10-03T10:21:25.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.779+0000 7f3a9effd700 1 -- 172.21.15.72:0/3228066342 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3aa4017020 con 0x7f3ab01303c0 2023-10-03T10:21:25.780 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-10-03T10:21:25.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.781+0000 7f3ab4f4d700 1 -- 172.21.15.72:0/3228066342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ab01303c0 msgr2=0x7f3ab0132260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:25.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.781+0000 7f3ab4f4d700 1 --2- 172.21.15.72:0/3228066342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ab01303c0 0x7f3ab0132260 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400c510 tx=0x7f3aa400c820 comp rx=0 tx=0).stop 2023-10-03T10:21:25.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.781+0000 7f3ab4f4d700 1 -- 172.21.15.72:0/3228066342 shutdown_connections 2023-10-03T10:21:25.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.781+0000 7f3ab4f4d700 1 --2- 172.21.15.72:0/3228066342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ab01390a0 0x7f3ab0132ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.781+0000 7f3ab4f4d700 1 --2- 172.21.15.72:0/3228066342 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f3ab01303c0 0x7f3ab0132260 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.781+0000 7f3ab4f4d700 1 --2- 172.21.15.72:0/3228066342 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ab0136780 0x7f3ab01327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.781+0000 7f3ab4f4d700 1 -- 172.21.15.72:0/3228066342 >> 172.21.15.72:0/3228066342 conn(0x7f3ab0066d70 msgr2=0x7f3ab012cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:25.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.781+0000 7f3ab4f4d700 1 -- 172.21.15.72:0/3228066342 shutdown_connections 2023-10-03T10:21:25.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.781+0000 7f3ab4f4d700 1 -- 172.21.15.72:0/3228066342 wait complete. 2023-10-03T10:21:25.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:21:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.917+0000 7fde3e924700 1 Processor -- start 2023-10-03T10:21:25.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.917+0000 7fde3e924700 1 -- start start 2023-10-03T10:21:25.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde3e924700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fde3809d7d0 0x7fde3809dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde3e924700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde3809e0e0 0x7fde38130770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde3e924700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde38130cb0 0x7fde38131130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde3e924700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3809b620 con 0x7fde3809d7d0 2023-10-03T10:21:25.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde3e924700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3809f370 con 0x7fde38130cb0 2023-10-03T10:21:25.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde3e924700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde3809b800 con 0x7fde3809e0e0 2023-10-03T10:21:25.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde377fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde3809e0e0 0x7fde38130770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde3cec1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde38130cb0 0x7fde38131130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde37fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fde3809d7d0 0x7fde3809dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde377fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde3809e0e0 0x7fde38130770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51740/0 (socket says 172.21.15.72:51740) 2023-10-03T10:21:25.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde3cec1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde38130cb0 0x7fde38131130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43528/0 (socket says 172.21.15.72:43528) 2023-10-03T10:21:25.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde377fe700 1 -- 172.21.15.72:0/1414877656 learned_addr learned my addr 172.21.15.72:0/1414877656 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde377fe700 1 -- 172.21.15.72:0/1414877656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde38130cb0 msgr2=0x7fde38131130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde377fe700 1 --2- 172.21.15.72:0/1414877656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde38130cb0 0x7fde38131130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde377fe700 1 -- 172.21.15.72:0/1414877656 >> v2:172.21.15.72:3300/0 conn(0x7fde3809d7d0 msgr2=0x7fde3809dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde377fe700 1 --2- 172.21.15.72:0/1414877656 >> v2:172.21.15.72:3300/0 conn(0x7fde3809d7d0 0x7fde3809dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde377fe700 1 -- 172.21.15.72:0/1414877656 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3809ef80 con 0x7fde3809e0e0 2023-10-03T10:21:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde37fff700 1 --2- 172.21.15.72:0/1414877656 >> v2:172.21.15.72:3300/0 conn(0x7fde3809d7d0 0x7fde3809dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde3cec1700 1 --2- 172.21.15.72:0/1414877656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde38130cb0 0x7fde38131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:25.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.918+0000 7fde377fe700 1 --2- 172.21.15.72:0/1414877656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde3809e0e0 0x7fde38130770 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fde2800dd40 tx=0x7fde2800f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d34b768a317c4b1d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.919+0000 7fde36ffd700 1 -- 172.21.15.72:0/1414877656 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde28012070 con 0x7fde3809e0e0 2023-10-03T10:21:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.919+0000 7fde36ffd700 1 -- 172.21.15.72:0/1414877656 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2800de90 con 0x7fde3809e0e0 2023-10-03T10:21:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.919+0000 7fde36ffd700 1 -- 172.21.15.72:0/1414877656 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2800faf0 con 0x7fde3809e0e0 2023-10-03T10:21:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.919+0000 7fde3e924700 1 -- 172.21.15.72:0/1414877656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde3809e0e0 msgr2=0x7fde38130770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.919+0000 7fde3e924700 1 --2- 172.21.15.72:0/1414877656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde3809e0e0 0x7fde38130770 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fde2800dd40 tx=0x7fde2800f330 comp rx=0 tx=0).stop 2023-10-03T10:21:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.919+0000 7fde3e924700 1 -- 172.21.15.72:0/1414877656 shutdown_connections 2023-10-03T10:21:25.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.919+0000 7fde3e924700 1 --2- 172.21.15.72:0/1414877656 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde38130cb0 0x7fde38131130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.919+0000 7fde3e924700 1 --2- 172.21.15.72:0/1414877656 >> v2:172.21.15.72:3300/0 conn(0x7fde3809d7d0 0x7fde3809dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.919+0000 7fde3e924700 1 --2- 172.21.15.72:0/1414877656 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde3809e0e0 0x7fde38130770 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.919+0000 7fde3e924700 1 -- 172.21.15.72:0/1414877656 >> 172.21.15.72:0/1414877656 conn(0x7fde38066d70 msgr2=0x7fde380a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:25.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.919+0000 7fde3e924700 1 -- 172.21.15.72:0/1414877656 shutdown_connections 2023-10-03T10:21:25.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.919+0000 7fde3e924700 1 -- 172.21.15.72:0/1414877656 wait complete. 2023-10-03T10:21:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.920+0000 7fde3e924700 1 Processor -- start 2023-10-03T10:21:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.920+0000 7fde3e924700 1 -- start start 2023-10-03T10:21:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde3e924700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde3809d7d0 0x7fde38119f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde3e924700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde3809e0e0 0x7fde3811a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde3e924700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde38130cb0 0x7fde3811a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde3e924700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3811c170 con 0x7fde38130cb0 2023-10-03T10:21:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde3e924700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3811da30 con 0x7fde3809d7d0 2023-10-03T10:21:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde3e924700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde3811ce00 con 0x7fde3809e0e0 2023-10-03T10:21:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde37fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde3809d7d0 0x7fde38119f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde377fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde3809e0e0 0x7fde3811a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde37fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde3809d7d0 0x7fde38119f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43534/0 (socket says 172.21.15.72:43534) 2023-10-03T10:21:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde3cec1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde38130cb0 0x7fde3811a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde37fff700 1 -- 172.21.15.72:0/3472959397 learned_addr learned my addr 172.21.15.72:0/3472959397 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:25.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde377fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde3809e0e0 0x7fde3811a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51746/0 (socket says 172.21.15.72:51746) 2023-10-03T10:21:25.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde37fff700 1 -- 172.21.15.72:0/3472959397 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde3809e0e0 msgr2=0x7fde3811a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:25.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde37fff700 1 --2- 172.21.15.72:0/3472959397 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde3809e0e0 0x7fde3811a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde37fff700 1 -- 172.21.15.72:0/3472959397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde38130cb0 msgr2=0x7fde3811a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:25.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde37fff700 1 --2- 172.21.15.72:0/3472959397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde38130cb0 0x7fde3811a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:25.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde37fff700 1 -- 172.21.15.72:0/3472959397 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c0094a0 con 0x7fde3809d7d0 2023-10-03T10:21:25.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde3cec1700 1 --2- 172.21.15.72:0/3472959397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde38130cb0 0x7fde3811a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:25.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde37fff700 1 --2- 172.21.15.72:0/3472959397 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde3809d7d0 0x7fde38119f10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fde2c00ebe0 tx=0x7fde2c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde34ff9700 1 -- 172.21.15.72:0/3472959397 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c009780 con 0x7fde3809d7d0 2023-10-03T10:21:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde34ff9700 1 -- 172.21.15.72:0/3472959397 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2c00c850 con 0x7fde3809d7d0 2023-10-03T10:21:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde3e924700 1 -- 172.21.15.72:0/3472959397 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde30009a70 con 0x7fde3809d7d0 2023-10-03T10:21:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde34ff9700 1 -- 172.21.15.72:0/3472959397 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c00cbe0 con 0x7fde3809d7d0 2023-10-03T10:21:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.921+0000 7fde3e924700 1 -- 172.21.15.72:0/3472959397 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2800d9f0 con 0x7fde3809d7d0 2023-10-03T10:21:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.922+0000 7fde34ff9700 1 -- 172.21.15.72:0/3472959397 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde2c00cd40 con 0x7fde3809d7d0 2023-10-03T10:21:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.922+0000 7fde34ff9700 1 -- 172.21.15.72:0/3472959397 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fde2c03f720 con 0x7fde3809d7d0 2023-10-03T10:21:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.922+0000 7fde3e924700 1 -- 172.21.15.72:0/3472959397 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3809a700 con 0x7fde3809d7d0 2023-10-03T10:21:25.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:25.927+0000 7fde34ff9700 1 -- 172.21.15.72:0/3472959397 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde2c0232f0 con 0x7fde3809d7d0 2023-10-03T10:21:26.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.110+0000 7fde3e924700 1 -- 172.21.15.72:0/3472959397 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde3804f2a0 con 0x7fde3809d7d0 2023-10-03T10:21:26.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.111+0000 7fde34ff9700 1 -- 172.21.15.72:0/3472959397 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde2c011350 con 0x7fde3809d7d0 2023-10-03T10:21:26.111 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-03T10:21:26.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.113+0000 7fde3e924700 1 -- 172.21.15.72:0/3472959397 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde3809d7d0 msgr2=0x7fde38119f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.113+0000 7fde3e924700 1 --2- 172.21.15.72:0/3472959397 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde3809d7d0 0x7fde38119f10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fde2c00ebe0 tx=0x7fde2c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.113+0000 7fde3e924700 1 -- 172.21.15.72:0/3472959397 shutdown_connections 2023-10-03T10:21:26.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.113+0000 7fde3e924700 1 --2- 172.21.15.72:0/3472959397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde38130cb0 0x7fde3811a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.113+0000 7fde3e924700 1 --2- 172.21.15.72:0/3472959397 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fde3809d7d0 0x7fde38119f10 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.113+0000 7fde3e924700 1 --2- 172.21.15.72:0/3472959397 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7fde3809e0e0 0x7fde3811a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.113+0000 7fde3e924700 1 -- 172.21.15.72:0/3472959397 >> 172.21.15.72:0/3472959397 conn(0x7fde38066d70 msgr2=0x7fde38130000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:26.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.113+0000 7fde3e924700 1 -- 172.21.15.72:0/3472959397 shutdown_connections 2023-10-03T10:21:26.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.113+0000 7fde3e924700 1 -- 172.21.15.72:0/3472959397 wait complete. 2023-10-03T10:21:26.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:21:26.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.249+0000 7f91472a4700 1 Processor -- start 2023-10-03T10:21:26.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.249+0000 7f91472a4700 1 -- start start 2023-10-03T10:21:26.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f91472a4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f914009d7d0 0x7f914009dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f91472a4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9140130e80 0x7f9140138a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f91472a4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914009b800 con 0x7f914009e0e0 2023-10-03T10:21:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f91472a4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914009b620 con 0x7f914009d7d0 2023-10-03T10:21:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f91472a4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914009f370 con 0x7f9140130e80 2023-10-03T10:21:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f9145040700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f914009d7d0 0x7f914009dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f9145841700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9140130e80 0x7f9140138a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f9145841700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9140130e80 0x7f9140138a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43548/0 (socket says 172.21.15.72:43548) 2023-10-03T10:21:26.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f9145040700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f914009d7d0 0x7f914009dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40178/0 (socket says 172.21.15.72:40178) 2023-10-03T10:21:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f9145841700 1 -- 172.21.15.72:0/3182168537 learned_addr learned my addr 172.21.15.72:0/3182168537 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f914483f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f914009e0e0 0x7f9140130770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42076/0 (socket says 172.21.15.72:42076) 2023-10-03T10:21:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f9145841700 1 -- 172.21.15.72:0/3182168537 >> v2:172.21.15.72:3300/0 conn(0x7f914009d7d0 msgr2=0x7f914009dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f9145841700 1 --2- 172.21.15.72:0/3182168537 >> v2:172.21.15.72:3300/0 conn(0x7f914009d7d0 0x7f914009dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f9145841700 1 -- 172.21.15.72:0/3182168537 >> v1:172.21.15.72:6789/0 conn(0x7f914009e0e0 legacy=0x7f9140130770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f9145841700 1 -- 172.21.15.72:0/3182168537 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914009ef80 con 0x7f9140130e80 2023-10-03T10:21:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f9145040700 1 --2- 172.21.15.72:0/3182168537 >> v2:172.21.15.72:3300/0 conn(0x7f914009d7d0 0x7f914009dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:26.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.250+0000 7f9145841700 1 --2- 172.21.15.72:0/3182168537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9140130e80 0x7f9140138a40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9138009e50 tx=0x7f913800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f03362623a365ed9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.251+0000 7f9137fff700 1 -- 172.21.15.72:0/3182168537 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913800e070 con 0x7f9140130e80 2023-10-03T10:21:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.251+0000 7f9137fff700 1 -- 172.21.15.72:0/3182168537 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913800b910 con 0x7f9140130e80 2023-10-03T10:21:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.251+0000 7f9137fff700 1 -- 172.21.15.72:0/3182168537 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913800bcc0 con 0x7f9140130e80 2023-10-03T10:21:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.251+0000 7f91472a4700 1 -- 172.21.15.72:0/3182168537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9140130e80 msgr2=0x7f9140138a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.251+0000 7f91472a4700 1 --2- 172.21.15.72:0/3182168537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9140130e80 0x7f9140138a40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9138009e50 tx=0x7f913800b330 comp rx=0 tx=0).stop 2023-10-03T10:21:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.251+0000 7f91472a4700 1 -- 172.21.15.72:0/3182168537 shutdown_connections 2023-10-03T10:21:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.251+0000 7f91472a4700 1 --2- 172.21.15.72:0/3182168537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9140130e80 0x7f9140138a40 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.251+0000 7f91472a4700 1 --2- 172.21.15.72:0/3182168537 >> v2:172.21.15.72:3300/0 conn(0x7f914009d7d0 0x7f914009dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.251+0000 7f91472a4700 1 -- 172.21.15.72:0/3182168537 >> 172.21.15.72:0/3182168537 conn(0x7f9140066d70 msgr2=0x7f91400a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:26.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.251+0000 7f91472a4700 1 -- 172.21.15.72:0/3182168537 shutdown_connections 2023-10-03T10:21:26.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.251+0000 7f91472a4700 1 -- 172.21.15.72:0/3182168537 wait complete. 2023-10-03T10:21:26.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.252+0000 7f91472a4700 1 Processor -- start 2023-10-03T10:21:26.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.252+0000 7f91472a4700 1 -- start start 2023-10-03T10:21:26.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.252+0000 7f91472a4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f914009d7d0 0x7f914011f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.252+0000 7f91472a4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f914009e0e0 0x7f914011fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f91472a4700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9140130e80 0x7f914011ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f91472a4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9140122f90 con 0x7f914009d7d0 2023-10-03T10:21:26.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f91472a4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91401303c0 con 0x7f914009e0e0 2023-10-03T10:21:26.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f91472a4700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9140121080 con 0x7f9140130e80 2023-10-03T10:21:26.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f9145040700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f914009d7d0 0x7f914011f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f9145040700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f914009d7d0 0x7f914011f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40190/0 (socket says 172.21.15.72:40190) 2023-10-03T10:21:26.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f9145040700 1 -- 172.21.15.72:0/517137193 learned_addr learned my addr 172.21.15.72:0/517137193 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:26.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f914483f700 1 --2- 172.21.15.72:0/517137193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f914009e0e0 0x7f914011fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f9145841700 1 --2- 172.21.15.72:0/517137193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9140130e80 0x7f914011ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f9145040700 1 -- 172.21.15.72:0/517137193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9140130e80 msgr2=0x7f914011ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f9145040700 1 --2- 172.21.15.72:0/517137193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9140130e80 0x7f914011ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f9145040700 1 -- 172.21.15.72:0/517137193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f914009e0e0 msgr2=0x7f914011fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f9145040700 1 --2- 172.21.15.72:0/517137193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f914009e0e0 0x7f914011fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f9145040700 1 -- 172.21.15.72:0/517137193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91300094a0 con 0x7f914009d7d0 2023-10-03T10:21:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f914483f700 1 --2- 172.21.15.72:0/517137193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f914009e0e0 0x7f914011fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f9145040700 1 --2- 172.21.15.72:0/517137193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f914009d7d0 0x7f914011f510 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f9130010df0 tx=0x7f913000c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:26.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f9135ffb700 1 -- 172.21.15.72:0/517137193 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913000cb90 con 0x7f914009d7d0 2023-10-03T10:21:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f9135ffb700 1 -- 172.21.15.72:0/517137193 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913000ccf0 con 0x7f914009d7d0 2023-10-03T10:21:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f91472a4700 1 -- 172.21.15.72:0/517137193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9138009b30 con 0x7f914009d7d0 2023-10-03T10:21:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f9135ffb700 1 -- 172.21.15.72:0/517137193 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130011650 con 0x7f914009d7d0 2023-10-03T10:21:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.253+0000 7f91472a4700 1 -- 172.21.15.72:0/517137193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914012ff90 con 0x7f914009d7d0 2023-10-03T10:21:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.254+0000 7f9135ffb700 1 -- 172.21.15.72:0/517137193 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91300117b0 con 0x7f914009d7d0 2023-10-03T10:21:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.254+0000 7f9135ffb700 1 -- 172.21.15.72:0/517137193 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9130041860 con 0x7f914009d7d0 2023-10-03T10:21:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.254+0000 7f91472a4700 1 -- 172.21.15.72:0/517137193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914004f2a0 con 0x7f914009d7d0 2023-10-03T10:21:26.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.259+0000 7f9135ffb700 1 -- 172.21.15.72:0/517137193 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9130019440 con 0x7f914009d7d0 2023-10-03T10:21:26.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.442+0000 7f91472a4700 1 -- 172.21.15.72:0/517137193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f914006c380 con 0x7f914009d7d0 2023-10-03T10:21:26.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.442+0000 7f9135ffb700 1 -- 172.21.15.72:0/517137193 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9130021360 con 0x7f914009d7d0 2023-10-03T10:21:26.443 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-03T10:21:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.444+0000 7f91472a4700 1 -- 172.21.15.72:0/517137193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f914009d7d0 msgr2=0x7f914011f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.444+0000 7f91472a4700 1 --2- 172.21.15.72:0/517137193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f914009d7d0 0x7f914011f510 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f9130010df0 tx=0x7f913000c430 comp rx=0 tx=0).stop 2023-10-03T10:21:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.444+0000 7f91472a4700 1 -- 172.21.15.72:0/517137193 shutdown_connections 2023-10-03T10:21:26.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.444+0000 7f91472a4700 1 --2- 172.21.15.72:0/517137193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f914009d7d0 0x7f914011f510 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.444+0000 7f91472a4700 1 --2- 172.21.15.72:0/517137193 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9140130e80 0x7f914011ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.444+0000 7f91472a4700 1 --2- 172.21.15.72:0/517137193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f914009e0e0 0x7f914011fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.445+0000 7f91472a4700 1 -- 172.21.15.72:0/517137193 >> 172.21.15.72:0/517137193 conn(0x7f9140066d70 msgr2=0x7f91400a0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.445+0000 7f91472a4700 1 -- 172.21.15.72:0/517137193 shutdown_connections 2023-10-03T10:21:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.445+0000 7f91472a4700 1 -- 172.21.15.72:0/517137193 wait complete. 2023-10-03T10:21:26.457 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T10:21:26.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.578+0000 7f4a72f37700 1 Processor -- start 2023-10-03T10:21:26.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.578+0000 7f4a72f37700 1 -- start start 2023-10-03T10:21:26.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.578+0000 7f4a72f37700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a6c09e1d0 0x7f4a6c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.578+0000 7f4a72f37700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a6c139170 0x7f4a6c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a72f37700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6c09b120 con 0x7f4a6c09d6f0 2023-10-03T10:21:26.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a72f37700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c06b460 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a72f37700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c09a7e0 con 0x7f4a6c139170 2023-10-03T10:21:26.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a6bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a6c09e1d0 0x7f4a6c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a70cd3700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4a6c09d6f0 0x7f4a6c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42078/0 (socket says 172.21.15.72:42078) 2023-10-03T10:21:26.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a70cd3700 1 -- 172.21.15.72:0/362224735 learned_addr learned my addr 172.21.15.72:0/362224735 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:21:26.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a714d4700 1 --2- 172.21.15.72:0/362224735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a6c139170 0x7f4a6c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a6b7fe700 1 -- 172.21.15.72:0/362224735 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275886571 0 0) 0x7f4a6c09b120 con 0x7f4a6c09d6f0 2023-10-03T10:21:26.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a6b7fe700 1 -- 172.21.15.72:0/362224735 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a5c0035b0 con 0x7f4a6c09d6f0 2023-10-03T10:21:26.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a6bfff700 1 -- 172.21.15.72:0/362224735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a6c139170 msgr2=0x7f4a6c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:26.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a6bfff700 1 --2- 172.21.15.72:0/362224735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a6c139170 0x7f4a6c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a6bfff700 1 -- 172.21.15.72:0/362224735 >> v1:172.21.15.72:6789/0 conn(0x7f4a6c09d6f0 legacy=0x7f4a6c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a6bfff700 1 -- 172.21.15.72:0/362224735 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c09a500 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a714d4700 1 --2- 172.21.15.72:0/362224735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a6c139170 0x7f4a6c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:26.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a6bfff700 1 --2- 172.21.15.72:0/362224735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a6c09e1d0 0x7f4a6c138c30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009870 tx=0x7f4a58009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1738b552bb2e3c77 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:26.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a6b7fe700 1 -- 172.21.15.72:0/362224735 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58011830 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a6b7fe700 1 -- 172.21.15.72:0/362224735 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a58011990 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.579+0000 7f4a6b7fe700 1 -- 172.21.15.72:0/362224735 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58011d20 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.580+0000 7f4a72f37700 1 -- 172.21.15.72:0/362224735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a6c09e1d0 msgr2=0x7f4a6c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.580+0000 7f4a72f37700 1 --2- 172.21.15.72:0/362224735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a6c09e1d0 0x7f4a6c138c30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009870 tx=0x7f4a58009b80 comp rx=0 tx=0).stop 2023-10-03T10:21:26.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.580+0000 7f4a72f37700 1 -- 172.21.15.72:0/362224735 shutdown_connections 2023-10-03T10:21:26.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.580+0000 7f4a72f37700 1 --2- 172.21.15.72:0/362224735 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a6c139170 0x7f4a6c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.580+0000 7f4a72f37700 1 --2- 172.21.15.72:0/362224735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a6c09e1d0 0x7f4a6c138c30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.580+0000 7f4a72f37700 1 -- 172.21.15.72:0/362224735 >> 172.21.15.72:0/362224735 conn(0x7f4a6c066f50 msgr2=0x7f4a6c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:26.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.580+0000 7f4a72f37700 1 -- 172.21.15.72:0/362224735 shutdown_connections 2023-10-03T10:21:26.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.580+0000 7f4a72f37700 1 -- 172.21.15.72:0/362224735 wait complete. 2023-10-03T10:21:26.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.581+0000 7f4a72f37700 1 Processor -- start 2023-10-03T10:21:26.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.581+0000 7f4a72f37700 1 -- start start 2023-10-03T10:21:26.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.581+0000 7f4a72f37700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a6c09d6f0 0x7f4a6c1216a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.581+0000 7f4a72f37700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a6c09e1d0 0x7f4a6c121be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.581+0000 7f4a72f37700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a6c139170 0x7f4a6c122120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.581+0000 7f4a72f37700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c1251c0 con 0x7f4a6c139170 2023-10-03T10:21:26.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.581+0000 7f4a72f37700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c1240b0 con 0x7f4a6c09d6f0 2023-10-03T10:21:26.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.581+0000 7f4a72f37700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0a1780 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.581+0000 7f4a70cd3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a6c09d6f0 0x7f4a6c1216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.581+0000 7f4a6bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a6c09e1d0 0x7f4a6c121be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.581+0000 7f4a714d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a6c139170 0x7f4a6c122120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.581+0000 7f4a70cd3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a6c09d6f0 0x7f4a6c1216a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43576/0 (socket says 172.21.15.72:43576) 2023-10-03T10:21:26.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.581+0000 7f4a6bfff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a6c09e1d0 0x7f4a6c121be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51762/0 (socket says 172.21.15.72:51762) 2023-10-03T10:21:26.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.581+0000 7f4a70cd3700 1 -- 172.21.15.72:0/1758056645 learned_addr learned my addr 172.21.15.72:0/1758056645 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:26.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.582+0000 7f4a6bfff700 1 -- 172.21.15.72:0/1758056645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a6c09d6f0 msgr2=0x7f4a6c1216a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.582+0000 7f4a6bfff700 1 --2- 172.21.15.72:0/1758056645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a6c09d6f0 0x7f4a6c1216a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.582+0000 7f4a6bfff700 1 -- 172.21.15.72:0/1758056645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a6c139170 msgr2=0x7f4a6c122120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.582+0000 7f4a6bfff700 1 --2- 172.21.15.72:0/1758056645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a6c139170 0x7f4a6c122120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.582+0000 7f4a6bfff700 1 -- 172.21.15.72:0/1758056645 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a64009a70 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.582+0000 7f4a70cd3700 1 --2- 172.21.15.72:0/1758056645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a6c09d6f0 0x7f4a6c1216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.582+0000 7f4a6bfff700 1 --2- 172.21.15.72:0/1758056645 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a6c09e1d0 0x7f4a6c121be0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009870 tx=0x7f4a58004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.582+0000 7f4a697fa700 1 -- 172.21.15.72:0/1758056645 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58004450 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.582+0000 7f4a697fa700 1 -- 172.21.15.72:0/1758056645 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5801f070 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.582+0000 7f4a72f37700 1 -- 172.21.15.72:0/1758056645 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a580094a0 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.582+0000 7f4a697fa700 1 -- 172.21.15.72:0/1758056645 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a580038e0 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.582+0000 7f4a72f37700 1 -- 172.21.15.72:0/1758056645 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6c123350 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.583+0000 7f4a697fa700 1 -- 172.21.15.72:0/1758056645 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4a58003a40 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.583+0000 7f4a697fa700 1 -- 172.21.15.72:0/1758056645 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4a58021070 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.583+0000 7f4a72f37700 1 -- 172.21.15.72:0/1758056645 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6c074ea0 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.588+0000 7f4a697fa700 1 -- 172.21.15.72:0/1758056645 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4a5802b080 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.787+0000 7f4a72f37700 1 -- 172.21.15.72:0/1758056645 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4a6c124570 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.788+0000 7f4a697fa700 1 -- 172.21.15.72:0/1758056645 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v40) v1 ==== 81+0+636 (secure 0 0 0) 0x7f4a58015020 con 0x7f4a6c09e1d0 2023-10-03T10:21:26.789 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/412002554 2023-10-04T10:13:00.483478+0000 2023-10-03T10:21:26.789 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/405703097 2023-10-04T10:13:00.483478+0000 2023-10-03T10:21:26.789 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3554355102 2023-10-04T10:13:00.483478+0000 2023-10-03T10:21:26.789 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2966012812 2023-10-04T10:12:06.073551+0000 2023-10-03T10:21:26.790 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6816/126756 2023-10-04T10:13:00.483478+0000 2023-10-03T10:21:26.790 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3319279924 2023-10-04T10:12:06.073551+0000 2023-10-03T10:21:26.790 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2679211469 2023-10-04T10:13:00.483478+0000 2023-10-03T10:21:26.790 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6817/542674768 2023-10-04T10:12:27.583946+0000 2023-10-03T10:21:26.790 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1449937992 2023-10-04T10:13:00.483478+0000 2023-10-03T10:21:26.790 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6816/118184 2023-10-04T10:12:06.073551+0000 2023-10-03T10:21:26.790 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2763351041 2023-10-04T10:13:00.483478+0000 2023-10-03T10:21:26.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.790+0000 7f4a72f37700 1 -- 172.21.15.72:0/1758056645 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a6c09e1d0 msgr2=0x7f4a6c121be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.790+0000 7f4a72f37700 1 --2- 172.21.15.72:0/1758056645 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a6c09e1d0 0x7f4a6c121be0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009870 tx=0x7f4a58004750 comp rx=0 tx=0).stop 2023-10-03T10:21:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.790+0000 7f4a72f37700 1 -- 172.21.15.72:0/1758056645 shutdown_connections 2023-10-03T10:21:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.790+0000 7f4a72f37700 1 --2- 172.21.15.72:0/1758056645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a6c139170 0x7f4a6c122120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.790+0000 7f4a72f37700 1 --2- 172.21.15.72:0/1758056645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a6c09d6f0 0x7f4a6c1216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.790+0000 7f4a72f37700 1 --2- 172.21.15.72:0/1758056645 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f4a6c09e1d0 0x7f4a6c121be0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.790+0000 7f4a72f37700 1 -- 172.21.15.72:0/1758056645 >> 172.21.15.72:0/1758056645 conn(0x7f4a6c066f50 msgr2=0x7f4a6c09b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.790+0000 7f4a72f37700 1 -- 172.21.15.72:0/1758056645 shutdown_connections 2023-10-03T10:21:26.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.790+0000 7f4a72f37700 1 -- 172.21.15.72:0/1758056645 wait complete. 2023-10-03T10:21:26.793 INFO:teuthology.orchestra.run.smithi072.stderr:listed 11 entries 2023-10-03T10:21:26.802 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-10-03T10:21:26.803 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T10:21:26.825 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:21:26.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.945+0000 7f9d4c303700 1 Processor -- start 2023-10-03T10:21:26.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.945+0000 7f9d4c303700 1 -- start start 2023-10-03T10:21:26.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.945+0000 7f9d4c303700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d441337f0 0x7f9d44138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.945+0000 7f9d4c303700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d44138dc0 0x7f9d4413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.945+0000 7f9d4c303700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4406b990 con 0x7f9d44133420 2023-10-03T10:21:26.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.945+0000 7f9d4c303700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4409b0e0 con 0x7f9d441337f0 2023-10-03T10:21:26.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.945+0000 7f9d4c303700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d44133c20 con 0x7f9d44138dc0 2023-10-03T10:21:26.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.945+0000 7f9d4989e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d441337f0 0x7f9d44138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.945+0000 7f9d4a8a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d44138dc0 0x7f9d4413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.945+0000 7f9d4989e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d441337f0 0x7f9d44138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40212/0 (socket says 172.21.15.72:40212) 2023-10-03T10:21:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.945+0000 7f9d4a8a0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d44138dc0 0x7f9d4413b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43588/0 (socket says 172.21.15.72:43588) 2023-10-03T10:21:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.945+0000 7f9d4989e700 1 -- 172.21.15.72:0/935952488 learned_addr learned my addr 172.21.15.72:0/935952488 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.946+0000 7f9d4989e700 1 -- 172.21.15.72:0/935952488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d44138dc0 msgr2=0x7f9d4413b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.946+0000 7f9d4989e700 1 --2- 172.21.15.72:0/935952488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d44138dc0 0x7f9d4413b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.946+0000 7f9d4989e700 1 -- 172.21.15.72:0/935952488 >> v1:172.21.15.72:6789/0 conn(0x7f9d44133420 legacy=0x7f9d44133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.946+0000 7f9d4989e700 1 -- 172.21.15.72:0/935952488 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d440a0590 con 0x7f9d441337f0 2023-10-03T10:21:26.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.946+0000 7f9d4a8a0700 1 --2- 172.21.15.72:0/935952488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d44138dc0 0x7f9d4413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:26.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.946+0000 7f9d4909d700 1 -- 172.21.15.72:0/935952488 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357605998 0 0) 0x7f9d4406b990 con 0x7f9d44133420 2023-10-03T10:21:26.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.946+0000 7f9d4989e700 1 --2- 172.21.15.72:0/935952488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d441337f0 0x7f9d44138880 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f9d400098f0 tx=0x7f9d40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a19fa9096f0f86 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:26.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.946+0000 7f9d4909d700 1 -- 172.21.15.72:0/935952488 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40011830 con 0x7f9d441337f0 2023-10-03T10:21:26.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.946+0000 7f9d4909d700 1 -- 172.21.15.72:0/935952488 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d40011990 con 0x7f9d441337f0 2023-10-03T10:21:26.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.946+0000 7f9d4909d700 1 -- 172.21.15.72:0/935952488 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40011d20 con 0x7f9d441337f0 2023-10-03T10:21:26.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.946+0000 7f9d4c303700 1 -- 172.21.15.72:0/935952488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d441337f0 msgr2=0x7f9d44138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.946+0000 7f9d4c303700 1 --2- 172.21.15.72:0/935952488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d441337f0 0x7f9d44138880 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f9d400098f0 tx=0x7f9d40009c00 comp rx=0 tx=0).stop 2023-10-03T10:21:26.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.947+0000 7f9d4c303700 1 -- 172.21.15.72:0/935952488 shutdown_connections 2023-10-03T10:21:26.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.947+0000 7f9d4c303700 1 --2- 172.21.15.72:0/935952488 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d44138dc0 0x7f9d4413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.947+0000 7f9d4c303700 1 --2- 172.21.15.72:0/935952488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d441337f0 0x7f9d44138880 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.947+0000 7f9d4c303700 1 -- 172.21.15.72:0/935952488 >> 172.21.15.72:0/935952488 conn(0x7f9d440a4210 msgr2=0x7f9d440a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:26.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.947+0000 7f9d4c303700 1 -- 172.21.15.72:0/935952488 shutdown_connections 2023-10-03T10:21:26.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.947+0000 7f9d4c303700 1 -- 172.21.15.72:0/935952488 wait complete. 2023-10-03T10:21:26.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.947+0000 7f9d4c303700 1 Processor -- start 2023-10-03T10:21:26.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.947+0000 7f9d4c303700 1 -- start start 2023-10-03T10:21:26.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4c303700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d44133420 0x7f9d44137810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4c303700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d441337f0 0x7f9d44137d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4c303700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d44138dc0 0x7f9d4409c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:26.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4c303700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d44134650 con 0x7f9d44138dc0 2023-10-03T10:21:26.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4c303700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4409e020 con 0x7f9d441337f0 2023-10-03T10:21:26.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4c303700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d44130ab0 con 0x7f9d44133420 2023-10-03T10:21:26.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4989e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d441337f0 0x7f9d44137d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4989e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d441337f0 0x7f9d44137d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:43590/0 (socket says 172.21.15.72:43590) 2023-10-03T10:21:26.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4989e700 1 -- 172.21.15.72:0/4124034349 learned_addr learned my addr 172.21.15.72:0/4124034349 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:26.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4a8a0700 1 --2- 172.21.15.72:0/4124034349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d44138dc0 0x7f9d4409c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4a09f700 1 --2- 172.21.15.72:0/4124034349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d44133420 0x7f9d44137810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:26.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4989e700 1 -- 172.21.15.72:0/4124034349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d44133420 msgr2=0x7f9d44137810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4989e700 1 --2- 172.21.15.72:0/4124034349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d44133420 0x7f9d44137810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4989e700 1 -- 172.21.15.72:0/4124034349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d44138dc0 msgr2=0x7f9d4409c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:26.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4989e700 1 --2- 172.21.15.72:0/4124034349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d44138dc0 0x7f9d4409c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:26.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4989e700 1 -- 172.21.15.72:0/4124034349 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c009a70 con 0x7f9d441337f0 2023-10-03T10:21:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4a8a0700 1 --2- 172.21.15.72:0/4124034349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d44138dc0 0x7f9d4409c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.948+0000 7f9d4989e700 1 --2- 172.21.15.72:0/4124034349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d441337f0 0x7f9d44137d50 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009c40 tx=0x7f9d40004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.949+0000 7f9d3affd700 1 -- 172.21.15.72:0/4124034349 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40004550 con 0x7f9d441337f0 2023-10-03T10:21:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.949+0000 7f9d3affd700 1 -- 172.21.15.72:0/4124034349 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d400036a0 con 0x7f9d441337f0 2023-10-03T10:21:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.949+0000 7f9d4c303700 1 -- 172.21.15.72:0/4124034349 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d40009550 con 0x7f9d441337f0 2023-10-03T10:21:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.949+0000 7f9d3affd700 1 -- 172.21.15.72:0/4124034349 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40003a50 con 0x7f9d441337f0 2023-10-03T10:21:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.949+0000 7f9d4c303700 1 -- 172.21.15.72:0/4124034349 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4412f280 con 0x7f9d441337f0 2023-10-03T10:21:26.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.949+0000 7f9d3affd700 1 -- 172.21.15.72:0/4124034349 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d40021070 con 0x7f9d441337f0 2023-10-03T10:21:26.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.949+0000 7f9d3affd700 1 -- 172.21.15.72:0/4124034349 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9d40040a40 con 0x7f9d441337f0 2023-10-03T10:21:26.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.950+0000 7f9d4c303700 1 -- 172.21.15.72:0/4124034349 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d44130020 con 0x7f9d441337f0 2023-10-03T10:21:26.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:26.954+0000 7f9d3affd700 1 -- 172.21.15.72:0/4124034349 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d40029080 con 0x7f9d441337f0 2023-10-03T10:21:27.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.140+0000 7f9d4c303700 1 -- 172.21.15.72:0/4124034349 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d440a47a0 con 0x7f9d441337f0 2023-10-03T10:21:27.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.141+0000 7f9d3affd700 1 -- 172.21.15.72:0/4124034349 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+13394 (secure 0 0 0) 0x7f9d40015020 con 0x7f9d441337f0 2023-10-03T10:21:27.142 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-03T10:21:27.142 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":40,"fsid":"33894c9a-ea73-4e47-9ce0-b9e281957c98","created":"2023-10-03T10:09:30.970008+0000","modified":"2023-10-03T10:13:00.483506+0000","last_up_change":"2023-10-03T10:12:25.534779+0000","last_in_change":"2023-10-03T10:09:32.210536+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:09:38.963446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:09:40.092839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:09:44.713857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:09:45.314387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48d870e9-7887-40a6-bb5e-b2634b374762","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6804","nonce":129472}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6805","nonce":129472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6807","nonce":129472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6806","nonce":129472}]},"public_addr":"172.21.15.72:6804/129472","cluster_addr":"172.21.15.72:6805/129472","heartbeat_back_addr":"172.21.15.72:6807/129472","heartbeat_front_addr":"172.21.15.72:6806/129472","state":["exists","up"]},{"osd":1,"uuid":"9f579570-81c8-4dcb-aa20-b72cf8df944d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6800","nonce":129570}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6801","nonce":129570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6803","nonce":129570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6802","nonce":129570}]},"public_addr":"172.21.15.72:6800/129570","cluster_addr":"172.21.15.72:6801/129570","heartbeat_back_addr":"172.21.15.72:6803/129570","heartbeat_front_addr":"172.21.15.72:6802/129570","state":["exists","up"]},{"osd":2,"uuid":"fd55a9ee-4434-4270-8e10-d8ed0a66164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6808","nonce":129702}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6809","nonce":129702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6811","nonce":129702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6810","nonce":129702}]},"public_addr":"172.21.15.72:6808/129702","cluster_addr":"172.21.15.72:6809/129702","heartbeat_back_addr":"172.21.15.72:6811/129702","heartbeat_front_addr":"172.21.15.72:6810/129702","state":["exists","up"]},{"osd":3,"uuid":"b7aa354b-4fb5-45d4-8210-97d6af9d4a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6812","nonce":130020}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6813","nonce":130020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6815","nonce":130020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.72:6814","nonce":130020}]},"public_addr":"172.21.15.72:6812/130020","cluster_addr":"172.21.15.72:6813/130020","heartbeat_back_addr":"172.21.15.72:6815/130020","heartbeat_front_addr":"172.21.15.72:6814/130020","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.346892+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.339081+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.609392+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:12:19.493196+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:09:37.577218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":0}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":0}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:0/412002554":"2023-10-04T10:13:00.483478+0000","172.21.15.72:0/405703097":"2023-10-04T10:13:00.483478+0000","172.21.15.72:0/3554355102":"2023-10-04T10:13:00.483478+0000","172.21.15.72:0/2966012812":"2023-10-04T10:12:06.073551+0000","172.21.15.72:6816/126756":"2023-10-04T10:13:00.483478+0000","172.21.15.72:0/3319279924":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/2679211469":"2023-10-04T10:13:00.483478+0000","172.21.15.72:6817/542674768":"2023-10-04T10:12:27.583946+0000","172.21.15.72:0/1449937992":"2023-10-04T10:13:00.483478+0000","172.21.15.72:6816/118184":"2023-10-04T10:12:06.073551+0000","172.21.15.72:0/2763351041":"2023-10-04T10:13:00.483478+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:21:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.143+0000 7f9d4c303700 1 -- 172.21.15.72:0/4124034349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d441337f0 msgr2=0x7f9d44137d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.143+0000 7f9d4c303700 1 --2- 172.21.15.72:0/4124034349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d441337f0 0x7f9d44137d50 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009c40 tx=0x7f9d40004750 comp rx=0 tx=0).stop 2023-10-03T10:21:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.143+0000 7f9d4c303700 1 -- 172.21.15.72:0/4124034349 shutdown_connections 2023-10-03T10:21:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.143+0000 7f9d4c303700 1 --2- 172.21.15.72:0/4124034349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d44138dc0 0x7f9d4409c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.143+0000 7f9d4c303700 1 --2- 172.21.15.72:0/4124034349 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f9d44133420 0x7f9d44137810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.143+0000 7f9d4c303700 1 --2- 172.21.15.72:0/4124034349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d441337f0 0x7f9d44137d50 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.143+0000 7f9d4c303700 1 -- 172.21.15.72:0/4124034349 >> 172.21.15.72:0/4124034349 conn(0x7f9d440a4210 msgr2=0x7f9d440a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.143+0000 7f9d4c303700 1 -- 172.21.15.72:0/4124034349 shutdown_connections 2023-10-03T10:21:27.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.143+0000 7f9d4c303700 1 -- 172.21.15.72:0/4124034349 wait complete. 2023-10-03T10:21:27.156 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:09:38.963446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:09:40.092839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:09:44.713857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:09:45.314387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:21:27.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:21:27.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.281+0000 7f088fd09700 1 Processor -- start 2023-10-03T10:21:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.281+0000 7f088fd09700 1 -- start start 2023-10-03T10:21:27.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.281+0000 7f088fd09700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0888133e70 0x7f0888134240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:27.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.281+0000 7f088fd09700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f088809e400 0x7f088813bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:27.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.281+0000 7f088fd09700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088809d060 con 0x7f088809d880 2023-10-03T10:21:27.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.281+0000 7f088fd09700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088809acd0 con 0x7f088809e400 2023-10-03T10:21:27.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.281+0000 7f088fd09700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f088809eef0 con 0x7f0888133e70 2023-10-03T10:21:27.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.281+0000 7f088e2a6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f088809e400 0x7f088813bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:27.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.281+0000 7f088daa5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0888133e70 0x7f0888134240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:27.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.281+0000 7f088e2a6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f088809e400 0x7f088813bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40234/0 (socket says 172.21.15.72:40234) 2023-10-03T10:21:27.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.281+0000 7f088daa5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0888133e70 0x7f0888134240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51794/0 (socket says 172.21.15.72:51794) 2023-10-03T10:21:27.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.281+0000 7f088e2a6700 1 -- 172.21.15.72:0/3827666906 learned_addr learned my addr 172.21.15.72:0/3827666906 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:27.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.282+0000 7f088e2a6700 1 -- 172.21.15.72:0/3827666906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0888133e70 msgr2=0x7f0888134240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:27.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.282+0000 7f088e2a6700 1 --2- 172.21.15.72:0/3827666906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0888133e70 0x7f0888134240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.282+0000 7f088e2a6700 1 -- 172.21.15.72:0/3827666906 >> v1:172.21.15.72:6789/0 conn(0x7f088809d880 legacy=0x7f088809dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.282+0000 7f088e2a6700 1 -- 172.21.15.72:0/3827666906 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0888134780 con 0x7f088809e400 2023-10-03T10:21:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.282+0000 7f088daa5700 1 --2- 172.21.15.72:0/3827666906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0888133e70 0x7f0888134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.282+0000 7f088e2a6700 1 --2- 172.21.15.72:0/3827666906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f088809e400 0x7f088813bbe0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f0880009e50 tx=0x7f088000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c99cc2d37f10f1d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.282+0000 7f088caa3700 1 -- 172.21.15.72:0/3827666906 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088000e070 con 0x7f088809e400 2023-10-03T10:21:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.282+0000 7f088caa3700 1 -- 172.21.15.72:0/3827666906 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088000b910 con 0x7f088809e400 2023-10-03T10:21:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.282+0000 7f088caa3700 1 -- 172.21.15.72:0/3827666906 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088000bcc0 con 0x7f088809e400 2023-10-03T10:21:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.282+0000 7f088fd09700 1 -- 172.21.15.72:0/3827666906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f088809e400 msgr2=0x7f088813bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:27.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.282+0000 7f088fd09700 1 --2- 172.21.15.72:0/3827666906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f088809e400 0x7f088813bbe0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f0880009e50 tx=0x7f088000b330 comp rx=0 tx=0).stop 2023-10-03T10:21:27.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.283+0000 7f088fd09700 1 -- 172.21.15.72:0/3827666906 shutdown_connections 2023-10-03T10:21:27.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.283+0000 7f088fd09700 1 --2- 172.21.15.72:0/3827666906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f088809e400 0x7f088813bbe0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.283+0000 7f088fd09700 1 --2- 172.21.15.72:0/3827666906 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f0888133e70 0x7f0888134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.283+0000 7f088fd09700 1 -- 172.21.15.72:0/3827666906 >> 172.21.15.72:0/3827666906 conn(0x7f08880a2c10 msgr2=0x7f08880a3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:27.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.283+0000 7f088fd09700 1 -- 172.21.15.72:0/3827666906 shutdown_connections 2023-10-03T10:21:27.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.283+0000 7f088fd09700 1 -- 172.21.15.72:0/3827666906 wait complete. 2023-10-03T10:21:27.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.284+0000 7f088fd09700 1 Processor -- start 2023-10-03T10:21:27.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.284+0000 7f088fd09700 1 -- start start 2023-10-03T10:21:27.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.284+0000 7f088fd09700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f088809d880 0x7f088811a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:27.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.284+0000 7f088fd09700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088809e400 0x7f088811ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:27.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.284+0000 7f088fd09700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0888133e70 0x7f088811b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:27.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088fd09700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088812daf0 con 0x7f0888133e70 2023-10-03T10:21:27.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088fd09700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088811e420 con 0x7f088809e400 2023-10-03T10:21:27.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088fd09700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08880a3320 con 0x7f088809d880 2023-10-03T10:21:27.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088daa5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f088809d880 0x7f088811a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:27.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088daa5700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f088809d880 0x7f088811a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51804/0 (socket says 172.21.15.72:51804) 2023-10-03T10:21:27.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088e2a6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0888133e70 0x7f088811b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:27.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088daa5700 1 -- 172.21.15.72:0/3117582375 learned_addr learned my addr 172.21.15.72:0/3117582375 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:27.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088d2a4700 1 --2- 172.21.15.72:0/3117582375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088809e400 0x7f088811ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:27.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088daa5700 1 -- 172.21.15.72:0/3117582375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088809e400 msgr2=0x7f088811ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:27.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088daa5700 1 --2- 172.21.15.72:0/3117582375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088809e400 0x7f088811ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088daa5700 1 -- 172.21.15.72:0/3117582375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0888133e70 msgr2=0x7f088811b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:27.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088daa5700 1 --2- 172.21.15.72:0/3117582375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0888133e70 0x7f088811b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088daa5700 1 -- 172.21.15.72:0/3117582375 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08840094a0 con 0x7f088809d880 2023-10-03T10:21:27.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088e2a6700 1 --2- 172.21.15.72:0/3117582375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0888133e70 0x7f088811b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088daa5700 1 --2- 172.21.15.72:0/3117582375 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f088809d880 0x7f088811a8c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f088400ec10 tx=0x7f088400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f087e7fc700 1 -- 172.21.15.72:0/3117582375 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088400c850 con 0x7f088809d880 2023-10-03T10:21:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f087e7fc700 1 -- 172.21.15.72:0/3117582375 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088400c9b0 con 0x7f088809d880 2023-10-03T10:21:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088fd09700 1 -- 172.21.15.72:0/3117582375 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0880009b30 con 0x7f088809d880 2023-10-03T10:21:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f087e7fc700 1 -- 172.21.15.72:0/3117582375 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088400cd20 con 0x7f088809d880 2023-10-03T10:21:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.285+0000 7f088fd09700 1 -- 172.21.15.72:0/3117582375 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088811cb90 con 0x7f088809d880 2023-10-03T10:21:27.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.286+0000 7f087e7fc700 1 -- 172.21.15.72:0/3117582375 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0884013470 con 0x7f088809d880 2023-10-03T10:21:27.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.286+0000 7f087e7fc700 1 -- 172.21.15.72:0/3117582375 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f088403fb10 con 0x7f088809d880 2023-10-03T10:21:27.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.286+0000 7f088fd09700 1 -- 172.21.15.72:0/3117582375 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088811d230 con 0x7f088809d880 2023-10-03T10:21:27.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.291+0000 7f087e7fc700 1 -- 172.21.15.72:0/3117582375 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0884013720 con 0x7f088809d880 2023-10-03T10:21:27.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.473+0000 7f088fd09700 1 -- 172.21.15.72:0/3117582375 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f088812f920 con 0x7f088809d880 2023-10-03T10:21:27.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.473+0000 7f087e7fc700 1 -- 172.21.15.72:0/3117582375 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f088402a0a0 con 0x7f088809d880 2023-10-03T10:21:27.474 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-03T10:21:27.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.475+0000 7f088fd09700 1 -- 172.21.15.72:0/3117582375 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f088809d880 msgr2=0x7f088811a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:27.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.475+0000 7f088fd09700 1 --2- 172.21.15.72:0/3117582375 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f088809d880 0x7f088811a8c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f088400ec10 tx=0x7f088400ef20 comp rx=0 tx=0).stop 2023-10-03T10:21:27.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.475+0000 7f088fd09700 1 -- 172.21.15.72:0/3117582375 shutdown_connections 2023-10-03T10:21:27.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.475+0000 7f088fd09700 1 --2- 172.21.15.72:0/3117582375 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0888133e70 0x7f088811b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.475+0000 7f088fd09700 1 --2- 172.21.15.72:0/3117582375 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f088809d880 0x7f088811a8c0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.475+0000 7f088fd09700 1 --2- 172.21.15.72:0/3117582375 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f088809e400 0x7f088811ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.475+0000 7f088fd09700 1 -- 172.21.15.72:0/3117582375 >> 172.21.15.72:0/3117582375 conn(0x7f08880a2c10 msgr2=0x7f0888132330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:27.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.475+0000 7f088fd09700 1 -- 172.21.15.72:0/3117582375 shutdown_connections 2023-10-03T10:21:27.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.475+0000 7f088fd09700 1 -- 172.21.15.72:0/3117582375 wait complete. 2023-10-03T10:21:27.488 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:21:27.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.610+0000 7f7a25031700 1 Processor -- start 2023-10-03T10:21:27.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.610+0000 7f7a25031700 1 -- start start 2023-10-03T10:21:27.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.610+0000 7f7a25031700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a201303c0 0x7f7a20130790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:27.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.610+0000 7f7a25031700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a2006a770 0x7f7a2006ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:27.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.610+0000 7f7a25031700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2009f620 con 0x7f7a2006b0c0 2023-10-03T10:21:27.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.610+0000 7f7a25031700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a20130250 con 0x7f7a2006a770 2023-10-03T10:21:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.610+0000 7f7a25031700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2009e1b0 con 0x7f7a201303c0 2023-10-03T10:21:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.611+0000 7f7a1e59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a2006a770 0x7f7a2006ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.611+0000 7f7a1f59e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7a2006b0c0 0x7f7a2013a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42108/0 (socket says 172.21.15.72:42108) 2023-10-03T10:21:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.611+0000 7f7a1f59e700 1 -- 172.21.15.72:0/1365344357 learned_addr learned my addr 172.21.15.72:0/1365344357 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-03T10:21:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.611+0000 7f7a1ed9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a201303c0 0x7f7a20130790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.611+0000 7f7a1ed9d700 1 -- 172.21.15.72:0/1365344357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a2006a770 msgr2=0x7f7a2006ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.611+0000 7f7a1ed9d700 1 --2- 172.21.15.72:0/1365344357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a2006a770 0x7f7a2006ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.611+0000 7f7a1ed9d700 1 -- 172.21.15.72:0/1365344357 >> v1:172.21.15.72:6789/0 conn(0x7f7a2006b0c0 legacy=0x7f7a2013a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.611+0000 7f7a1ed9d700 1 -- 172.21.15.72:0/1365344357 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2006b530 con 0x7f7a201303c0 2023-10-03T10:21:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.611+0000 7f7a1dd9b700 1 -- 172.21.15.72:0/1365344357 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417876401 0 0) 0x7f7a2009f620 con 0x7f7a2006b0c0 2023-10-03T10:21:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.611+0000 7f7a1e59c700 1 --2- 172.21.15.72:0/1365344357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a2006a770 0x7f7a2006ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.611+0000 7f7a1ed9d700 1 --2- 172.21.15.72:0/1365344357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a201303c0 0x7f7a20130790 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009870 tx=0x7f7a14009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd719bbf858d6714 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.611+0000 7f7a1dd9b700 1 -- 172.21.15.72:0/1365344357 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14011830 con 0x7f7a201303c0 2023-10-03T10:21:27.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.611+0000 7f7a1dd9b700 1 -- 172.21.15.72:0/1365344357 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14011990 con 0x7f7a201303c0 2023-10-03T10:21:27.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.611+0000 7f7a1dd9b700 1 -- 172.21.15.72:0/1365344357 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14011d20 con 0x7f7a201303c0 2023-10-03T10:21:27.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.612+0000 7f7a25031700 1 -- 172.21.15.72:0/1365344357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a201303c0 msgr2=0x7f7a20130790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:27.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.612+0000 7f7a25031700 1 --2- 172.21.15.72:0/1365344357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a201303c0 0x7f7a20130790 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009870 tx=0x7f7a14009b80 comp rx=0 tx=0).stop 2023-10-03T10:21:27.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.612+0000 7f7a25031700 1 -- 172.21.15.72:0/1365344357 shutdown_connections 2023-10-03T10:21:27.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.612+0000 7f7a25031700 1 --2- 172.21.15.72:0/1365344357 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a201303c0 0x7f7a20130790 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.612+0000 7f7a25031700 1 --2- 172.21.15.72:0/1365344357 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a2006a770 0x7f7a2006ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.612+0000 7f7a25031700 1 -- 172.21.15.72:0/1365344357 >> 172.21.15.72:0/1365344357 conn(0x7f7a20066d70 msgr2=0x7f7a200a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:27.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.612+0000 7f7a25031700 1 -- 172.21.15.72:0/1365344357 shutdown_connections 2023-10-03T10:21:27.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.612+0000 7f7a25031700 1 -- 172.21.15.72:0/1365344357 wait complete. 2023-10-03T10:21:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.613+0000 7f7a25031700 1 Processor -- start 2023-10-03T10:21:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.613+0000 7f7a25031700 1 -- start start 2023-10-03T10:21:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.613+0000 7f7a25031700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a2006a770 0x7f7a2011d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.613+0000 7f7a25031700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a2006b0c0 0x7f7a2011de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.613+0000 7f7a25031700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a201303c0 0x7f7a2011e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.613+0000 7f7a25031700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2011fdd0 con 0x7f7a2006a770 2023-10-03T10:21:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.613+0000 7f7a25031700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2012d7f0 con 0x7f7a201303c0 2023-10-03T10:21:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.613+0000 7f7a25031700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a20120020 con 0x7f7a2006b0c0 2023-10-03T10:21:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.613+0000 7f7a1ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a2006a770 0x7f7a2011d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.613+0000 7f7a1e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a2006b0c0 0x7f7a2011de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.614+0000 7f7a1ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a2006a770 0x7f7a2011d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40254/0 (socket says 172.21.15.72:40254) 2023-10-03T10:21:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.614+0000 7f7a1ed9d700 1 -- 172.21.15.72:0/3101128823 learned_addr learned my addr 172.21.15.72:0/3101128823 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.614+0000 7f7a1e59c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a2006b0c0 0x7f7a2011de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51822/0 (socket says 172.21.15.72:51822) 2023-10-03T10:21:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.614+0000 7f7a1f59e700 1 --2- 172.21.15.72:0/3101128823 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a201303c0 0x7f7a2011e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.614+0000 7f7a1ed9d700 1 -- 172.21.15.72:0/3101128823 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a2006b0c0 msgr2=0x7f7a2011de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.614+0000 7f7a1ed9d700 1 --2- 172.21.15.72:0/3101128823 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a2006b0c0 0x7f7a2011de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.614+0000 7f7a1ed9d700 1 -- 172.21.15.72:0/3101128823 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a201303c0 msgr2=0x7f7a2011e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.614+0000 7f7a1ed9d700 1 --2- 172.21.15.72:0/3101128823 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a201303c0 0x7f7a2011e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.614+0000 7f7a1ed9d700 1 -- 172.21.15.72:0/3101128823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a100094a0 con 0x7f7a2006a770 2023-10-03T10:21:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.614+0000 7f7a1ed9d700 1 --2- 172.21.15.72:0/3101128823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a2006a770 0x7f7a2011d930 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009840 tx=0x7f7a14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.614+0000 7f7a077fe700 1 -- 172.21.15.72:0/3101128823 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14004510 con 0x7f7a2006a770 2023-10-03T10:21:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.614+0000 7f7a077fe700 1 -- 172.21.15.72:0/3101128823 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a140036a0 con 0x7f7a2006a770 2023-10-03T10:21:27.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.614+0000 7f7a25031700 1 -- 172.21.15.72:0/3101128823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a140094a0 con 0x7f7a2006a770 2023-10-03T10:21:27.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.614+0000 7f7a077fe700 1 -- 172.21.15.72:0/3101128823 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14003a50 con 0x7f7a2006a770 2023-10-03T10:21:27.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.614+0000 7f7a25031700 1 -- 172.21.15.72:0/3101128823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a20072190 con 0x7f7a2006a770 2023-10-03T10:21:27.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.615+0000 7f7a077fe700 1 -- 172.21.15.72:0/3101128823 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a14003bb0 con 0x7f7a2006a770 2023-10-03T10:21:27.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.615+0000 7f7a077fe700 1 -- 172.21.15.72:0/3101128823 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7a140409e0 con 0x7f7a2006a770 2023-10-03T10:21:27.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.615+0000 7f7a25031700 1 -- 172.21.15.72:0/3101128823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2004f2a0 con 0x7f7a2006a770 2023-10-03T10:21:27.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.619+0000 7f7a077fe700 1 -- 172.21.15.72:0/3101128823 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a1401a420 con 0x7f7a2006a770 2023-10-03T10:21:27.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.803+0000 7f7a25031700 1 -- 172.21.15.72:0/3101128823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7a2006c380 con 0x7f7a2006a770 2023-10-03T10:21:27.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.803+0000 7f7a077fe700 1 -- 172.21.15.72:0/3101128823 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7a14015020 con 0x7f7a2006a770 2023-10-03T10:21:27.804 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-10-03T10:21:27.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.805+0000 7f7a25031700 1 -- 172.21.15.72:0/3101128823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a2006a770 msgr2=0x7f7a2011d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:27.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.805+0000 7f7a25031700 1 --2- 172.21.15.72:0/3101128823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a2006a770 0x7f7a2011d930 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009840 tx=0x7f7a14004750 comp rx=0 tx=0).stop 2023-10-03T10:21:27.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.805+0000 7f7a25031700 1 -- 172.21.15.72:0/3101128823 shutdown_connections 2023-10-03T10:21:27.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.805+0000 7f7a25031700 1 --2- 172.21.15.72:0/3101128823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a2006a770 0x7f7a2011d930 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.805+0000 7f7a25031700 1 --2- 172.21.15.72:0/3101128823 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a201303c0 0x7f7a2011e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.805+0000 7f7a25031700 1 --2- 172.21.15.72:0/3101128823 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f7a2006b0c0 0x7f7a2011de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.805+0000 7f7a25031700 1 -- 172.21.15.72:0/3101128823 >> 172.21.15.72:0/3101128823 conn(0x7f7a20066d70 msgr2=0x7f7a20133320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:27.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.805+0000 7f7a25031700 1 -- 172.21.15.72:0/3101128823 shutdown_connections 2023-10-03T10:21:27.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.806+0000 7f7a25031700 1 -- 172.21.15.72:0/3101128823 wait complete. 2023-10-03T10:21:27.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:21:27.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.941+0000 7f8dde03d700 1 Processor -- start 2023-10-03T10:21:27.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.941+0000 7f8dde03d700 1 -- start start 2023-10-03T10:21:27.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.941+0000 7f8dde03d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8dd81303c0 0x7f8dd8130790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:27.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.941+0000 7f8dde03d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd806b290 0x7f8dd813b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:27.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.941+0000 7f8dde03d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd809f620 con 0x7f8dd806a770 2023-10-03T10:21:27.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.941+0000 7f8dde03d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd8130280 con 0x7f8dd806b290 2023-10-03T10:21:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.941+0000 7f8dde03d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd809e1b0 con 0x7f8dd81303c0 2023-10-03T10:21:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.941+0000 7f8dd77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8dd81303c0 0x7f8dd8130790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.941+0000 7f8dd77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8dd81303c0 0x7f8dd8130790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51830/0 (socket says 172.21.15.72:51830) 2023-10-03T10:21:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.941+0000 7f8dd6ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8dd806a770 0x7f8dd806ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42116/0 (socket says 172.21.15.72:42116) 2023-10-03T10:21:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.941+0000 7f8dd77fe700 1 -- 172.21.15.72:0/2171728900 learned_addr learned my addr 172.21.15.72:0/2171728900 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:27.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.941+0000 7f8dd7fff700 1 --2- 172.21.15.72:0/2171728900 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd806b290 0x7f8dd813b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.942+0000 7f8dd77fe700 1 -- 172.21.15.72:0/2171728900 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd806b290 msgr2=0x7f8dd813b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.942+0000 7f8dd77fe700 1 --2- 172.21.15.72:0/2171728900 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd806b290 0x7f8dd813b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.942+0000 7f8dd77fe700 1 -- 172.21.15.72:0/2171728900 >> v1:172.21.15.72:6789/0 conn(0x7f8dd806a770 legacy=0x7f8dd806ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.942+0000 7f8dd77fe700 1 -- 172.21.15.72:0/2171728900 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd8130cd0 con 0x7f8dd81303c0 2023-10-03T10:21:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.942+0000 7f8dd67fc700 1 -- 172.21.15.72:0/2171728900 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431351857 0 0) 0x7f8dd809f620 con 0x7f8dd806a770 2023-10-03T10:21:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.942+0000 7f8dd7fff700 1 --2- 172.21.15.72:0/2171728900 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd806b290 0x7f8dd813b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:27.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.942+0000 7f8dd77fe700 1 --2- 172.21.15.72:0/2171728900 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8dd81303c0 0x7f8dd8130790 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009920 tx=0x7f8dc8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4283df53b5679376 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.942+0000 7f8dd67fc700 1 -- 172.21.15.72:0/2171728900 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8011830 con 0x7f8dd81303c0 2023-10-03T10:21:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.942+0000 7f8dd67fc700 1 -- 172.21.15.72:0/2171728900 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc8011990 con 0x7f8dd81303c0 2023-10-03T10:21:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.942+0000 7f8dd67fc700 1 -- 172.21.15.72:0/2171728900 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8011d20 con 0x7f8dd81303c0 2023-10-03T10:21:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.943+0000 7f8dde03d700 1 -- 172.21.15.72:0/2171728900 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8dd81303c0 msgr2=0x7f8dd8130790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.943+0000 7f8dde03d700 1 --2- 172.21.15.72:0/2171728900 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8dd81303c0 0x7f8dd8130790 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009920 tx=0x7f8dc8009c30 comp rx=0 tx=0).stop 2023-10-03T10:21:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.943+0000 7f8dde03d700 1 -- 172.21.15.72:0/2171728900 shutdown_connections 2023-10-03T10:21:27.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.943+0000 7f8dde03d700 1 --2- 172.21.15.72:0/2171728900 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd806b290 0x7f8dd813b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.943+0000 7f8dde03d700 1 --2- 172.21.15.72:0/2171728900 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8dd81303c0 0x7f8dd8130790 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.943+0000 7f8dde03d700 1 -- 172.21.15.72:0/2171728900 >> 172.21.15.72:0/2171728900 conn(0x7f8dd8066d70 msgr2=0x7f8dd80a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:27.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.943+0000 7f8dde03d700 1 -- 172.21.15.72:0/2171728900 shutdown_connections 2023-10-03T10:21:27.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.943+0000 7f8dde03d700 1 -- 172.21.15.72:0/2171728900 wait complete. 2023-10-03T10:21:27.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dde03d700 1 Processor -- start 2023-10-03T10:21:27.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dde03d700 1 -- start start 2023-10-03T10:21:27.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dde03d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8dd806a770 0x7f8dd811d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:27.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dde03d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd806b290 0x7f8dd811de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:27.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dde03d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd81303c0 0x7f8dd811e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:27.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dde03d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd811ed10 con 0x7f8dd81303c0 2023-10-03T10:21:27.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dde03d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd811fea0 con 0x7f8dd806b290 2023-10-03T10:21:27.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dde03d700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd81202d0 con 0x7f8dd806a770 2023-10-03T10:21:27.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dd77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8dd806a770 0x7f8dd811d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:27.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dd77fe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8dd806a770 0x7f8dd811d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:51832/0 (socket says 172.21.15.72:51832) 2023-10-03T10:21:27.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dd77fe700 1 -- 172.21.15.72:0/3492432452 learned_addr learned my addr 172.21.15.72:0/3492432452 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:27.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dd6ffd700 1 --2- 172.21.15.72:0/3492432452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd806b290 0x7f8dd811de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:27.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dd7fff700 1 --2- 172.21.15.72:0/3492432452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd81303c0 0x7f8dd811e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:27.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dd6ffd700 1 -- 172.21.15.72:0/3492432452 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8dd806a770 msgr2=0x7f8dd811d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:27.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dd6ffd700 1 --2- 172.21.15.72:0/3492432452 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8dd806a770 0x7f8dd811d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dd6ffd700 1 -- 172.21.15.72:0/3492432452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd81303c0 msgr2=0x7f8dd811e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:27.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dd6ffd700 1 --2- 172.21.15.72:0/3492432452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd81303c0 0x7f8dd811e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:27.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dd6ffd700 1 -- 172.21.15.72:0/3492432452 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd0009a70 con 0x7f8dd806b290 2023-10-03T10:21:27.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.944+0000 7f8dd77fe700 1 --2- 172.21.15.72:0/3492432452 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8dd806a770 0x7f8dd811d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:27.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.945+0000 7f8dd6ffd700 1 --2- 172.21.15.72:0/3492432452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd806b290 0x7f8dd811de70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc00c470 tx=0x7f8dcc00c780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:27.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.945+0000 7f8dbffff700 1 -- 172.21.15.72:0/3492432452 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc004c80 con 0x7f8dd806b290 2023-10-03T10:21:27.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.945+0000 7f8dbffff700 1 -- 172.21.15.72:0/3492432452 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dcc004de0 con 0x7f8dd806b290 2023-10-03T10:21:27.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.945+0000 7f8dde03d700 1 -- 172.21.15.72:0/3492432452 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc8009550 con 0x7f8dd806b290 2023-10-03T10:21:27.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.945+0000 7f8dbffff700 1 -- 172.21.15.72:0/3492432452 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc007310 con 0x7f8dd806b290 2023-10-03T10:21:27.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.945+0000 7f8dde03d700 1 -- 172.21.15.72:0/3492432452 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd811fbe0 con 0x7f8dd806b290 2023-10-03T10:21:27.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.945+0000 7f8dbffff700 1 -- 172.21.15.72:0/3492432452 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8dcc007470 con 0x7f8dd806b290 2023-10-03T10:21:27.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.946+0000 7f8dbffff700 1 -- 172.21.15.72:0/3492432452 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8dcc03f1c0 con 0x7f8dd806b290 2023-10-03T10:21:27.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.946+0000 7f8dde03d700 1 -- 172.21.15.72:0/3492432452 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd81200e0 con 0x7f8dd806b290 2023-10-03T10:21:27.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:27.950+0000 7f8dbffff700 1 -- 172.21.15.72:0/3492432452 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8dcc007720 con 0x7f8dd806b290 2023-10-03T10:21:28.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.134+0000 7f8dde03d700 1 -- 172.21.15.72:0/3492432452 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8dd804f2a0 con 0x7f8dd806b290 2023-10-03T10:21:28.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.135+0000 7f8dbffff700 1 -- 172.21.15.72:0/3492432452 <== mon.1 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8dcc01ce50 con 0x7f8dd806b290 2023-10-03T10:21:28.136 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-03T10:21:28.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.136+0000 7f8dde03d700 1 -- 172.21.15.72:0/3492432452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd806b290 msgr2=0x7f8dd811de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:28.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.137+0000 7f8dde03d700 1 --2- 172.21.15.72:0/3492432452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd806b290 0x7f8dd811de70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc00c470 tx=0x7f8dcc00c780 comp rx=0 tx=0).stop 2023-10-03T10:21:28.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.137+0000 7f8dde03d700 1 -- 172.21.15.72:0/3492432452 shutdown_connections 2023-10-03T10:21:28.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.137+0000 7f8dde03d700 1 --2- 172.21.15.72:0/3492432452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dd81303c0 0x7f8dd811e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.137+0000 7f8dde03d700 1 --2- 172.21.15.72:0/3492432452 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f8dd806a770 0x7f8dd811d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.137+0000 7f8dde03d700 1 --2- 172.21.15.72:0/3492432452 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dd806b290 0x7f8dd811de70 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.137+0000 7f8dde03d700 1 -- 172.21.15.72:0/3492432452 >> 172.21.15.72:0/3492432452 conn(0x7f8dd8066d70 msgr2=0x7f8dd80a1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:28.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.137+0000 7f8dde03d700 1 -- 172.21.15.72:0/3492432452 shutdown_connections 2023-10-03T10:21:28.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.137+0000 7f8dde03d700 1 -- 172.21.15.72:0/3492432452 wait complete. 2023-10-03T10:21:28.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:21:28.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.272+0000 7f28acbfe700 1 Processor -- start 2023-10-03T10:21:28.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.272+0000 7f28acbfe700 1 -- start start 2023-10-03T10:21:28.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.273+0000 7f28acbfe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f28a8136b80 0x7f28a8138f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:28.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.273+0000 7f28acbfe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28a81394a0 0x7f28a813b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:28.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.273+0000 7f28acbfe700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a806bcc0 con 0x7f28a8071cd0 2023-10-03T10:21:28.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.273+0000 7f28acbfe700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a806cbf0 con 0x7f28a8136b80 2023-10-03T10:21:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.273+0000 7f28acbfe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28a806ba00 con 0x7f28a81394a0 2023-10-03T10:21:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.273+0000 7f28a5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f28a8136b80 0x7f28a8138f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.273+0000 7f28a6d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28a81394a0 0x7f28a813b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.273+0000 7f28a5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f28a8136b80 0x7f28a8138f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32784/0 (socket says 172.21.15.72:32784) 2023-10-03T10:21:28.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.273+0000 7f28a5d9b700 1 -- 172.21.15.72:0/2492043708 learned_addr learned my addr 172.21.15.72:0/2492043708 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:28.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.273+0000 7f28a6d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28a81394a0 0x7f28a813b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58966/0 (socket says 172.21.15.72:58966) 2023-10-03T10:21:28.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.273+0000 7f28a6d9d700 1 -- 172.21.15.72:0/2492043708 >> v2:172.21.15.72:3300/0 conn(0x7f28a8136b80 msgr2=0x7f28a8138f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:28.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.273+0000 7f28a6d9d700 1 --2- 172.21.15.72:0/2492043708 >> v2:172.21.15.72:3300/0 conn(0x7f28a8136b80 0x7f28a8138f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.273+0000 7f28a6d9d700 1 -- 172.21.15.72:0/2492043708 >> v1:172.21.15.72:6789/0 conn(0x7f28a8071cd0 legacy=0x7f28a80720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:28.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.273+0000 7f28a6d9d700 1 -- 172.21.15.72:0/2492043708 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a809f860 con 0x7f28a81394a0 2023-10-03T10:21:28.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.273+0000 7f28a5d9b700 1 --2- 172.21.15.72:0/2492043708 >> v2:172.21.15.72:3300/0 conn(0x7f28a8136b80 0x7f28a8138f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.274+0000 7f28a6d9d700 1 --2- 172.21.15.72:0/2492043708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28a81394a0 0x7f28a813b880 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009d90 tx=0x7f28a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10e4cd5e773b0bcc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.274+0000 7f28a559a700 1 -- 172.21.15.72:0/2492043708 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a000e070 con 0x7f28a81394a0 2023-10-03T10:21:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.274+0000 7f28a559a700 1 -- 172.21.15.72:0/2492043708 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a000bb20 con 0x7f28a81394a0 2023-10-03T10:21:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.274+0000 7f28a559a700 1 -- 172.21.15.72:0/2492043708 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0012430 con 0x7f28a81394a0 2023-10-03T10:21:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.274+0000 7f28acbfe700 1 -- 172.21.15.72:0/2492043708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28a81394a0 msgr2=0x7f28a813b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:28.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.274+0000 7f28acbfe700 1 --2- 172.21.15.72:0/2492043708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28a81394a0 0x7f28a813b880 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009d90 tx=0x7f28a000b330 comp rx=0 tx=0).stop 2023-10-03T10:21:28.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.274+0000 7f28acbfe700 1 -- 172.21.15.72:0/2492043708 shutdown_connections 2023-10-03T10:21:28.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.274+0000 7f28acbfe700 1 --2- 172.21.15.72:0/2492043708 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28a81394a0 0x7f28a813b880 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.274+0000 7f28acbfe700 1 --2- 172.21.15.72:0/2492043708 >> v2:172.21.15.72:3300/0 conn(0x7f28a8136b80 0x7f28a8138f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.274+0000 7f28acbfe700 1 -- 172.21.15.72:0/2492043708 >> 172.21.15.72:0/2492043708 conn(0x7f28a80a4130 msgr2=0x7f28a80a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:28.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.274+0000 7f28acbfe700 1 -- 172.21.15.72:0/2492043708 shutdown_connections 2023-10-03T10:21:28.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.274+0000 7f28acbfe700 1 -- 172.21.15.72:0/2492043708 wait complete. 2023-10-03T10:21:28.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.275+0000 7f28acbfe700 1 Processor -- start 2023-10-03T10:21:28.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28acbfe700 1 -- start start 2023-10-03T10:21:28.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28acbfe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28a8071cd0 0x7f28a811ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:28.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28acbfe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28a8136b80 0x7f28a811ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:28.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28acbfe700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28a81394a0 0x7f28a811f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:28.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28acbfe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a8120930 con 0x7f28a8071cd0 2023-10-03T10:21:28.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28acbfe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a8121730 con 0x7f28a8136b80 2023-10-03T10:21:28.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28acbfe700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28a8138f70 con 0x7f28a81394a0 2023-10-03T10:21:28.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28a659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28a8071cd0 0x7f28a811ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:28.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28a5d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28a8136b80 0x7f28a811ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:28.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28a6d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28a81394a0 0x7f28a811f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:28.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28a5d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28a8136b80 0x7f28a811ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49358/0 (socket says 172.21.15.72:49358) 2023-10-03T10:21:28.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28a5d9b700 1 -- 172.21.15.72:0/2742484813 learned_addr learned my addr 172.21.15.72:0/2742484813 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:28.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28a6d9d700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28a81394a0 0x7f28a811f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58982/0 (socket says 172.21.15.72:58982) 2023-10-03T10:21:28.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28a6d9d700 1 -- 172.21.15.72:0/2742484813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28a8136b80 msgr2=0x7f28a811ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:28.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28a6d9d700 1 --2- 172.21.15.72:0/2742484813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28a8136b80 0x7f28a811ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28a6d9d700 1 -- 172.21.15.72:0/2742484813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28a8071cd0 msgr2=0x7f28a811ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:28.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28a6d9d700 1 --2- 172.21.15.72:0/2742484813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28a8071cd0 0x7f28a811ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28a6d9d700 1 -- 172.21.15.72:0/2742484813 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2898009550 con 0x7f28a81394a0 2023-10-03T10:21:28.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28a659c700 1 --2- 172.21.15.72:0/2742484813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28a8071cd0 0x7f28a811ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:28.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.276+0000 7f28a5d9b700 1 --2- 172.21.15.72:0/2742484813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28a8136b80 0x7f28a811ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:28.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.277+0000 7f28a6d9d700 1 --2- 172.21.15.72:0/2742484813 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28a81394a0 0x7f28a811f490 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f28a0016000 tx=0x7f28a0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:28.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.277+0000 7f2896ffd700 1 -- 172.21.15.72:0/2742484813 <== mon.2 v2:172.21.15.72:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0012430 con 0x7f28a81394a0 2023-10-03T10:21:28.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.277+0000 7f2896ffd700 1 -- 172.21.15.72:0/2742484813 <== mon.2 v2:172.21.15.72:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a0020070 con 0x7f28a81394a0 2023-10-03T10:21:28.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.277+0000 7f28acbfe700 1 -- 172.21.15.72:0/2742484813 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a0009a70 con 0x7f28a81394a0 2023-10-03T10:21:28.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.277+0000 7f2896ffd700 1 -- 172.21.15.72:0/2742484813 <== mon.2 v2:172.21.15.72:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0004280 con 0x7f28a81394a0 2023-10-03T10:21:28.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.277+0000 7f28acbfe700 1 -- 172.21.15.72:0/2742484813 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a806c0f0 con 0x7f28a81394a0 2023-10-03T10:21:28.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.277+0000 7f2896ffd700 1 -- 172.21.15.72:0/2742484813 <== mon.2 v2:172.21.15.72:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28a00043e0 con 0x7f28a81394a0 2023-10-03T10:21:28.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.278+0000 7f2896ffd700 1 -- 172.21.15.72:0/2742484813 <== mon.2 v2:172.21.15.72:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f28a0022070 con 0x7f28a81394a0 2023-10-03T10:21:28.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.278+0000 7f28acbfe700 1 -- 172.21.15.72:0/2742484813 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a813b010 con 0x7f28a81394a0 2023-10-03T10:21:28.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.282+0000 7f2896ffd700 1 -- 172.21.15.72:0/2742484813 <== mon.2 v2:172.21.15.72:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28a001c400 con 0x7f28a81394a0 2023-10-03T10:21:28.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.465+0000 7f28acbfe700 1 -- 172.21.15.72:0/2742484813 --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28a8121b40 con 0x7f28a81394a0 2023-10-03T10:21:28.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.465+0000 7f2896ffd700 1 -- 172.21.15.72:0/2742484813 <== mon.2 v2:172.21.15.72:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28a001ab70 con 0x7f28a81394a0 2023-10-03T10:21:28.466 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-03T10:21:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.467+0000 7f28acbfe700 1 -- 172.21.15.72:0/2742484813 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28a81394a0 msgr2=0x7f28a811f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.467+0000 7f28acbfe700 1 --2- 172.21.15.72:0/2742484813 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28a81394a0 0x7f28a811f490 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f28a0016000 tx=0x7f28a0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.467+0000 7f28acbfe700 1 -- 172.21.15.72:0/2742484813 shutdown_connections 2023-10-03T10:21:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.467+0000 7f28acbfe700 1 --2- 172.21.15.72:0/2742484813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28a8071cd0 0x7f28a811ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.467+0000 7f28acbfe700 1 --2- 172.21.15.72:0/2742484813 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f28a81394a0 0x7f28a811f490 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.467+0000 7f28acbfe700 1 --2- 172.21.15.72:0/2742484813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f28a8136b80 0x7f28a811ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.467+0000 7f28acbfe700 1 -- 172.21.15.72:0/2742484813 >> 172.21.15.72:0/2742484813 conn(0x7f28a80a4130 msgr2=0x7f28a80a46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.467+0000 7f28acbfe700 1 -- 172.21.15.72:0/2742484813 shutdown_connections 2023-10-03T10:21:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.467+0000 7f28acbfe700 1 -- 172.21.15.72:0/2742484813 wait complete. 2023-10-03T10:21:28.480 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T10:21:28.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.602+0000 7f578df7c700 1 Processor -- start 2023-10-03T10:21:28.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.602+0000 7f578df7c700 1 -- start start 2023-10-03T10:21:28.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.602+0000 7f578df7c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f578809e1d0 0x7f5788135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:28.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.602+0000 7f578df7c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5788135e50 0x7f5788138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:28.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.602+0000 7f578df7c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578809f130 con 0x7f578809d6f0 2023-10-03T10:21:28.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.602+0000 7f578df7c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578809f520 con 0x7f578809e1d0 2023-10-03T10:21:28.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.602+0000 7f578df7c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f578809e930 con 0x7f5788135e50 2023-10-03T10:21:28.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.603+0000 7f5787fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5788135e50 0x7f5788138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:28.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.603+0000 7f5786ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f578809e1d0 0x7f5788135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:28.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.603+0000 7f5786ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f578809e1d0 0x7f5788135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:32802/0 (socket says 172.21.15.72:32802) 2023-10-03T10:21:28.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.603+0000 7f5787fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5788135e50 0x7f5788138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:58994/0 (socket says 172.21.15.72:58994) 2023-10-03T10:21:28.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.603+0000 7f5786ffd700 1 -- 172.21.15.72:0/1358336028 learned_addr learned my addr 172.21.15.72:0/1358336028 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:28.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.603+0000 7f5786ffd700 1 -- 172.21.15.72:0/1358336028 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5788135e50 msgr2=0x7f5788138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:28.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.603+0000 7f5786ffd700 1 --2- 172.21.15.72:0/1358336028 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5788135e50 0x7f5788138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.603+0000 7f5786ffd700 1 -- 172.21.15.72:0/1358336028 >> v1:172.21.15.72:6789/0 conn(0x7f578809d6f0 legacy=0x7f578809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:28.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.603+0000 7f5786ffd700 1 -- 172.21.15.72:0/1358336028 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578809b2d0 con 0x7f578809e1d0 2023-10-03T10:21:28.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.603+0000 7f57867fc700 1 -- 172.21.15.72:0/1358336028 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243473921 0 0) 0x7f578809f130 con 0x7f578809d6f0 2023-10-03T10:21:28.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.603+0000 7f5787fff700 1 --2- 172.21.15.72:0/1358336028 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5788135e50 0x7f5788138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:28.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.603+0000 7f5786ffd700 1 --2- 172.21.15.72:0/1358336028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f578809e1d0 0x7f5788135910 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f577800bb90 tx=0x7f577800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fb116ef6813965 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:28.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.603+0000 7f57867fc700 1 -- 172.21.15.72:0/1358336028 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577800dd30 con 0x7f578809e1d0 2023-10-03T10:21:28.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.603+0000 7f57867fc700 1 -- 172.21.15.72:0/1358336028 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577800de90 con 0x7f578809e1d0 2023-10-03T10:21:28.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.603+0000 7f57867fc700 1 -- 172.21.15.72:0/1358336028 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5778010690 con 0x7f578809e1d0 2023-10-03T10:21:28.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.604+0000 7f578df7c700 1 -- 172.21.15.72:0/1358336028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f578809e1d0 msgr2=0x7f5788135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:28.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.604+0000 7f578df7c700 1 --2- 172.21.15.72:0/1358336028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f578809e1d0 0x7f5788135910 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f577800bb90 tx=0x7f577800bea0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.604+0000 7f578df7c700 1 -- 172.21.15.72:0/1358336028 shutdown_connections 2023-10-03T10:21:28.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.604+0000 7f578df7c700 1 --2- 172.21.15.72:0/1358336028 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5788135e50 0x7f5788138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.604+0000 7f578df7c700 1 --2- 172.21.15.72:0/1358336028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f578809e1d0 0x7f5788135910 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.604+0000 7f578df7c700 1 -- 172.21.15.72:0/1358336028 >> 172.21.15.72:0/1358336028 conn(0x7f5788066f50 msgr2=0x7f578809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:28.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.604+0000 7f578df7c700 1 -- 172.21.15.72:0/1358336028 shutdown_connections 2023-10-03T10:21:28.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.604+0000 7f578df7c700 1 -- 172.21.15.72:0/1358336028 wait complete. 2023-10-03T10:21:28.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.605+0000 7f578df7c700 1 Processor -- start 2023-10-03T10:21:28.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.605+0000 7f578df7c700 1 -- start start 2023-10-03T10:21:28.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.605+0000 7f578df7c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f578809d6f0 0x7f578811e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:28.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.605+0000 7f578df7c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f578809e1d0 0x7f578811e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:28.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.605+0000 7f578df7c700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5788135e50 0x7f57881c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:28.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.605+0000 7f578df7c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578811eef0 con 0x7f578809e1d0 2023-10-03T10:21:28.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.605+0000 7f578df7c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578811f520 con 0x7f578809d6f0 2023-10-03T10:21:28.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.605+0000 7f578df7c700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f578811fb70 con 0x7f5788135e50 2023-10-03T10:21:28.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.605+0000 7f5787fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5788135e50 0x7f57881c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:28.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.605+0000 7f57877fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f578809d6f0 0x7f578811e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:28.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.605+0000 7f5786ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f578809e1d0 0x7f578811e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:28.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.605+0000 7f5787fff700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5788135e50 0x7f57881c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3302/0 says I am v2:172.21.15.72:59008/0 (socket says 172.21.15.72:59008) 2023-10-03T10:21:28.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.605+0000 7f5787fff700 1 -- 172.21.15.72:0/1186333850 learned_addr learned my addr 172.21.15.72:0/1186333850 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:28.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.606+0000 7f5786ffd700 1 -- 172.21.15.72:0/1186333850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5788135e50 msgr2=0x7f57881c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:28.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.606+0000 7f5786ffd700 1 --2- 172.21.15.72:0/1186333850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5788135e50 0x7f57881c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.606+0000 7f5786ffd700 1 -- 172.21.15.72:0/1186333850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f578809d6f0 msgr2=0x7f578811e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:28.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.606+0000 7f5786ffd700 1 --2- 172.21.15.72:0/1186333850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f578809d6f0 0x7f578811e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.606+0000 7f5786ffd700 1 -- 172.21.15.72:0/1186333850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780009a70 con 0x7f578809e1d0 2023-10-03T10:21:28.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.606+0000 7f57877fe700 1 --2- 172.21.15.72:0/1186333850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f578809d6f0 0x7f578811e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:28.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.606+0000 7f5786ffd700 1 --2- 172.21.15.72:0/1186333850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f578809e1d0 0x7f578811e9b0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f578809f6f0 tx=0x7f5778004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:28.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.606+0000 7f577ffff700 1 -- 172.21.15.72:0/1186333850 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5778003b70 con 0x7f578809e1d0 2023-10-03T10:21:28.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.606+0000 7f577ffff700 1 -- 172.21.15.72:0/1186333850 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5778003cd0 con 0x7f578809e1d0 2023-10-03T10:21:28.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.606+0000 7f578df7c700 1 -- 172.21.15.72:0/1186333850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577800b7f0 con 0x7f578809e1d0 2023-10-03T10:21:28.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.606+0000 7f577ffff700 1 -- 172.21.15.72:0/1186333850 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5778010690 con 0x7f578809e1d0 2023-10-03T10:21:28.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.606+0000 7f578df7c700 1 -- 172.21.15.72:0/1186333850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57881204a0 con 0x7f578809e1d0 2023-10-03T10:21:28.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.607+0000 7f577ffff700 1 -- 172.21.15.72:0/1186333850 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5778019400 con 0x7f578809e1d0 2023-10-03T10:21:28.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.607+0000 7f577ffff700 1 -- 172.21.15.72:0/1186333850 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5778040e60 con 0x7f578809e1d0 2023-10-03T10:21:28.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.607+0000 7f578df7c700 1 -- 172.21.15.72:0/1186333850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57880a2a60 con 0x7f578809e1d0 2023-10-03T10:21:28.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.611+0000 7f577ffff700 1 -- 172.21.15.72:0/1186333850 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5778003e40 con 0x7f578809e1d0 2023-10-03T10:21:28.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.808+0000 7f578df7c700 1 -- 172.21.15.72:0/1186333850 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5788074ea0 con 0x7f578809e1d0 2023-10-03T10:21:28.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.808+0000 7f577ffff700 1 -- 172.21.15.72:0/1186333850 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v40) v1 ==== 81+0+636 (secure 0 0 0) 0x7f5778021390 con 0x7f578809e1d0 2023-10-03T10:21:28.809 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/412002554 2023-10-04T10:13:00.483478+0000 2023-10-03T10:21:28.810 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/405703097 2023-10-04T10:13:00.483478+0000 2023-10-03T10:21:28.810 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3554355102 2023-10-04T10:13:00.483478+0000 2023-10-03T10:21:28.810 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2966012812 2023-10-04T10:12:06.073551+0000 2023-10-03T10:21:28.810 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6816/126756 2023-10-04T10:13:00.483478+0000 2023-10-03T10:21:28.810 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/3319279924 2023-10-04T10:12:06.073551+0000 2023-10-03T10:21:28.810 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2679211469 2023-10-04T10:13:00.483478+0000 2023-10-03T10:21:28.810 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6817/542674768 2023-10-04T10:12:27.583946+0000 2023-10-03T10:21:28.811 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/1449937992 2023-10-04T10:13:00.483478+0000 2023-10-03T10:21:28.811 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:6816/118184 2023-10-04T10:12:06.073551+0000 2023-10-03T10:21:28.811 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72:0/2763351041 2023-10-04T10:13:00.483478+0000 2023-10-03T10:21:28.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.810+0000 7f578df7c700 1 -- 172.21.15.72:0/1186333850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f578809e1d0 msgr2=0x7f578811e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:28.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.810+0000 7f578df7c700 1 --2- 172.21.15.72:0/1186333850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f578809e1d0 0x7f578811e9b0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f578809f6f0 tx=0x7f5778004750 comp rx=0 tx=0).stop 2023-10-03T10:21:28.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.810+0000 7f578df7c700 1 -- 172.21.15.72:0/1186333850 shutdown_connections 2023-10-03T10:21:28.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.810+0000 7f578df7c700 1 --2- 172.21.15.72:0/1186333850 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7f5788135e50 0x7f57881c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.810+0000 7f578df7c700 1 --2- 172.21.15.72:0/1186333850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f578809d6f0 0x7f578811e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.810+0000 7f578df7c700 1 --2- 172.21.15.72:0/1186333850 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f578809e1d0 0x7f578811e9b0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:28.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.810+0000 7f578df7c700 1 -- 172.21.15.72:0/1186333850 >> 172.21.15.72:0/1186333850 conn(0x7f5788066f50 msgr2=0x7f57881327f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:28.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.810+0000 7f578df7c700 1 -- 172.21.15.72:0/1186333850 shutdown_connections 2023-10-03T10:21:28.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:28.810+0000 7f578df7c700 1 -- 172.21.15.72:0/1186333850 wait complete. 2023-10-03T10:21:28.813 INFO:teuthology.orchestra.run.smithi072.stderr:listed 11 entries 2023-10-03T10:21:28.823 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2023-10-03T10:21:28.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:28.823 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-03T10:21:28.869 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi119.stderr:ceph-fuse[112299]: fuse finished with error 0 and tester_r 0 2023-10-03T10:21:28.871 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:21:28.945 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-10-03T10:21:28.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:28.945 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-03T10:21:28.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:28.981 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-10-03T10:21:29.041 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-03T10:21:29.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:29.042 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:21:29.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:21:29.120 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2023-10-03T10:21:29.230 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-03T10:21:29.241 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:21:29.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:21:29.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.364+0000 7ff604f99700 1 Processor -- start 2023-10-03T10:21:29.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.364+0000 7ff604f99700 1 -- start start 2023-10-03T10:21:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.364+0000 7ff604f99700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff60009d6f0 0x7ff60009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff604f99700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff60009e000 0x7ff6001339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff604f99700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60009b120 con 0x7ff60009e410 2023-10-03T10:21:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff604f99700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60006b460 con 0x7ff60009e000 2023-10-03T10:21:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff604f99700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60009a7e0 con 0x7ff60009d6f0 2023-10-03T10:21:29.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff5fe59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff60009d6f0 0x7ff60009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:29.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff5fe59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff60009d6f0 0x7ff60009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49382/0 (socket says 172.21.15.72:49382) 2023-10-03T10:21:29.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff5fe59c700 1 -- 172.21.15.72:0/2927042143 learned_addr learned my addr 172.21.15.72:0/2927042143 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:29.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff5fdd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff60009e000 0x7ff6001339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:29.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff5fe59c700 1 -- 172.21.15.72:0/2927042143 >> v2:172.21.15.72:3300/0 conn(0x7ff60009e000 msgr2=0x7ff6001339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:29.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff5fe59c700 1 --2- 172.21.15.72:0/2927042143 >> v2:172.21.15.72:3300/0 conn(0x7ff60009e000 0x7ff6001339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:29.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff5fe59c700 1 -- 172.21.15.72:0/2927042143 >> v1:172.21.15.72:6789/0 conn(0x7ff60009e410 legacy=0x7ff600133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:29.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff5fe59c700 1 -- 172.21.15.72:0/2927042143 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60009a500 con 0x7ff60009d6f0 2023-10-03T10:21:29.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff5fdd9b700 1 --2- 172.21.15.72:0/2927042143 >> v2:172.21.15.72:3300/0 conn(0x7ff60009e000 0x7ff6001339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:29.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff5fe59c700 1 --2- 172.21.15.72:0/2927042143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff60009d6f0 0x7ff60009dac0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009920 tx=0x7ff5f4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61b104755274d545 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:29.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff5fd59a700 1 -- 172.21.15.72:0/2927042143 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4011830 con 0x7ff60009d6f0 2023-10-03T10:21:29.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff5fd59a700 1 -- 172.21.15.72:0/2927042143 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f4011990 con 0x7ff60009d6f0 2023-10-03T10:21:29.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.365+0000 7ff5fd59a700 1 -- 172.21.15.72:0/2927042143 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4011d20 con 0x7ff60009d6f0 2023-10-03T10:21:29.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.366+0000 7ff604f99700 1 -- 172.21.15.72:0/2927042143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff60009d6f0 msgr2=0x7ff60009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.366+0000 7ff604f99700 1 --2- 172.21.15.72:0/2927042143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff60009d6f0 0x7ff60009dac0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009920 tx=0x7ff5f4009c30 comp rx=0 tx=0).stop 2023-10-03T10:21:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.366+0000 7ff604f99700 1 -- 172.21.15.72:0/2927042143 shutdown_connections 2023-10-03T10:21:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.366+0000 7ff604f99700 1 --2- 172.21.15.72:0/2927042143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff60009d6f0 0x7ff60009dac0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.366+0000 7ff604f99700 1 --2- 172.21.15.72:0/2927042143 >> v2:172.21.15.72:3300/0 conn(0x7ff60009e000 0x7ff6001339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.366+0000 7ff604f99700 1 -- 172.21.15.72:0/2927042143 >> 172.21.15.72:0/2927042143 conn(0x7ff600066f50 msgr2=0x7ff60009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:29.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.366+0000 7ff604f99700 1 -- 172.21.15.72:0/2927042143 shutdown_connections 2023-10-03T10:21:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.366+0000 7ff604f99700 1 -- 172.21.15.72:0/2927042143 wait complete. 2023-10-03T10:21:29.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.367+0000 7ff604f99700 1 Processor -- start 2023-10-03T10:21:29.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.367+0000 7ff604f99700 1 -- start start 2023-10-03T10:21:29.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.367+0000 7ff604f99700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff60009d6f0 0x7ff6001a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:29.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.367+0000 7ff604f99700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff60009e000 0x7ff6001a6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:29.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.367+0000 7ff604f99700 1 --2- >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff60009e410 0x7ff6001a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:29.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.367+0000 7ff604f99700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6001a7cb0 con 0x7ff60009e000 2023-10-03T10:21:29.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.367+0000 7ff604f99700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6001a9820 con 0x7ff60009d6f0 2023-10-03T10:21:29.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.367+0000 7ff604f99700 1 -- --> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000a3380 con 0x7ff60009e410 2023-10-03T10:21:29.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.367+0000 7ff5fe59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff60009d6f0 0x7ff6001a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:29.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.368+0000 7ff5fe59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff60009d6f0 0x7ff6001a60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:49388/0 (socket says 172.21.15.72:49388) 2023-10-03T10:21:29.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.368+0000 7ff5fe59c700 1 -- 172.21.15.72:0/3258879963 learned_addr learned my addr 172.21.15.72:0/3258879963 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-03T10:21:29.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.368+0000 7ff5fdd9b700 1 --2- 172.21.15.72:0/3258879963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff60009e000 0x7ff6001a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:29.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.368+0000 7ff5fed9d700 1 --2- 172.21.15.72:0/3258879963 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff60009e410 0x7ff6001a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:29.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.368+0000 7ff5fe59c700 1 -- 172.21.15.72:0/3258879963 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff60009e410 msgr2=0x7ff6001a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:29.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.368+0000 7ff5fe59c700 1 --2- 172.21.15.72:0/3258879963 >> [v2:172.21.15.72:3302/0,v1:172.21.15.72:6791/0] conn(0x7ff60009e410 0x7ff6001a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:29.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.368+0000 7ff5fe59c700 1 -- 172.21.15.72:0/3258879963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff60009e000 msgr2=0x7ff6001a6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:29.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.368+0000 7ff5fe59c700 1 --2- 172.21.15.72:0/3258879963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff60009e000 0x7ff6001a6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:29.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.368+0000 7ff5fe59c700 1 -- 172.21.15.72:0/3258879963 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f00094a0 con 0x7ff60009d6f0 2023-10-03T10:21:29.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.368+0000 7ff5fe59c700 1 --2- 172.21.15.72:0/3258879963 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff60009d6f0 0x7ff6001a60f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009c70 tx=0x7ff5f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:29.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.368+0000 7ff5eeffd700 1 -- 172.21.15.72:0/3258879963 <== mon.1 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4004240 con 0x7ff60009d6f0 2023-10-03T10:21:29.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.368+0000 7ff5eeffd700 1 -- 172.21.15.72:0/3258879963 <== mon.1 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f401f070 con 0x7ff60009d6f0 2023-10-03T10:21:29.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.368+0000 7ff5eeffd700 1 -- 172.21.15.72:0/3258879963 <== mon.1 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f40036a0 con 0x7ff60009d6f0 2023-10-03T10:21:29.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.368+0000 7ff604f99700 1 -- 172.21.15.72:0/3258879963 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f4009550 con 0x7ff60009d6f0 2023-10-03T10:21:29.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.368+0000 7ff604f99700 1 -- 172.21.15.72:0/3258879963 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6001a8330 con 0x7ff60009d6f0 2023-10-03T10:21:29.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.369+0000 7ff5eeffd700 1 -- 172.21.15.72:0/3258879963 <== mon.1 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5f4021030 con 0x7ff60009d6f0 2023-10-03T10:21:29.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.369+0000 7ff5eeffd700 1 -- 172.21.15.72:0/3258879963 <== mon.1 v2:172.21.15.72:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff5f4040900 con 0x7ff60009d6f0 2023-10-03T10:21:29.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.369+0000 7ff604f99700 1 -- 172.21.15.72:0/3258879963 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff600074ea0 con 0x7ff60009d6f0 2023-10-03T10:21:29.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-03T10:21:29.375+0000 7ff5eeffd700 1 -- 172.21.15.72:0/3258879963 <== mon.1 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5f4015080 con 0x7ff60009d6f0 2023-10-03T10:23:29.276 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-03T10:23:29.276 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:23:29.286 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-03T10:23:29.286 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T10:23:29.286 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:29.299 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T10:23:29.300 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-03T10:23:29.300 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-03T10:23:29.300 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:29.366 INFO:tasks.ceph.osd.0:Stopped 2023-10-03T10:23:29.366 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-03T10:23:29.366 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:29.435 INFO:tasks.ceph.osd.1:Stopped 2023-10-03T10:23:29.435 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-03T10:23:29.436 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:29.502 INFO:tasks.ceph.osd.2:Stopped 2023-10-03T10:23:29.502 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-03T10:23:29.502 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:29.578 INFO:tasks.ceph.osd.3:Stopped 2023-10-03T10:23:29.578 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-03T10:23:29.578 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-03T10:23:29.579 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:29.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:23:29.579 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-10-03T10:23:29.591 INFO:tasks.ceph.mgr.x:Stopped 2023-10-03T10:23:29.591 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-03T10:23:29.592 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-03T10:23:29.592 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:29.629 INFO:tasks.ceph.mon.a:Stopped 2023-10-03T10:23:29.630 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-03T10:23:29.630 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:29.681 INFO:tasks.ceph.mon.b:Stopped 2023-10-03T10:23:29.682 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-03T10:23:29.682 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:29.732 INFO:tasks.ceph.mon.c:Stopped 2023-10-03T10:23:29.732 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-03T10:23:29.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | head -n 1 2023-10-03T10:23:29.812 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-03T10:23:29.812 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-03T10:23:30.094 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-03T10:23:30.095 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-03T10:23:30.191 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-03T10:23:30.191 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-03T10:23:30.255 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-03T10:23:30.256 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-03T10:23:30.333 INFO:tasks.ceph:Archiving mon data... 2023-10-03T10:23:30.334 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573/data/mon.a.tgz 2023-10-03T10:23:30.335 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-10-03T10:23:30.352 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.QVCry0IGgs 2023-10-03T10:23:30.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.QVCry0IGgs 2023-10-03T10:23:30.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.QVCry0IGgs 2023-10-03T10:23:30.571 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.QVCry0IGgs is 315KB 2023-10-03T10:23:30.666 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.QVCry0IGgs 2023-10-03T10:23:30.683 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573/data/mon.b.tgz 2023-10-03T10:23:30.683 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-10-03T10:23:30.740 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.TJAohWfqAH 2023-10-03T10:23:30.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.TJAohWfqAH 2023-10-03T10:23:30.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.TJAohWfqAH 2023-10-03T10:23:30.952 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.TJAohWfqAH is 317KB 2023-10-03T10:23:31.045 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.TJAohWfqAH 2023-10-03T10:23:31.062 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573/data/mon.c.tgz 2023-10-03T10:23:31.062 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-10-03T10:23:31.119 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.ngNqNkx0qs 2023-10-03T10:23:31.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ngNqNkx0qs 2023-10-03T10:23:31.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.ngNqNkx0qs 2023-10-03T10:23:31.331 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.ngNqNkx0qs is 317KB 2023-10-03T10:23:31.425 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.ngNqNkx0qs 2023-10-03T10:23:31.442 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-03T10:23:31.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-03T10:23:31.483 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-03T10:23:31.522 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-03T10:23:31.522 DEBUG:teuthology.orchestra.run.smithi072:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-03T10:23:31.550 DEBUG:teuthology.orchestra.run.smithi119:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-03T10:23:31.576 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-03T10:23:31.594 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-03T10:23:31.601 INFO:tasks.ceph:Archiving crash dumps... 2023-10-03T10:23:31.602 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573/remote/smithi072/crash 2023-10-03T10:23:31.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-03T10:23:31.648 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573/remote/smithi119/crash 2023-10-03T10:23:31.649 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-03T10:23:31.689 INFO:tasks.ceph:Compressing logs... 2023-10-03T10:23:31.689 DEBUG:teuthology.orchestra.run.smithi072:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-03T10:23:31.692 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-03T10:23:31.717 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189588.log 2023-10-03T10:23:31.718 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152273.log 2023-10-03T10:23:31.768 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112299.log 2023-10-03T10:23:31.775 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.112299.log: 96.6% -- replaced with /var/log/ceph/ceph-client.0.112299.log.gz 2023-10-03T10:23:31.775 INFO:teuthology.orchestra.run.smithi119.stderr: 2023-10-03T10:23:31.775 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m0.019s 2023-10-03T10:23:31.776 INFO:teuthology.orchestra.run.smithi119.stderr:user 0m0.014s 2023-10-03T10:23:31.776 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m0.013s 2023-10-03T10:23:31.877 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160219.log 2023-10-03T10:23:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189588.log: /var/log/ceph/ceph-client.admin.152273.log: gzip 87.9%-5 -- replaced with /var/log/ceph/ceph-client.admin.189588.log.gz--verbose 2023-10-03T10:23:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.183209.log 2023-10-03T10:23:31.878 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.152273.log.gz 2023-10-03T10:23:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123449.log 2023-10-03T10:23:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180406.log 2023-10-03T10:23:31.878 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160219.log.gz 2023-10-03T10:23:31.879 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.183209.log.gz 2023-10-03T10:23:31.879 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157473.log 2023-10-03T10:23:31.879 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180406.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123449.log.gz 2023-10-03T10:23:31.879 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138055.log 2023-10-03T10:23:31.879 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.180406.log.gz 2023-10-03T10:23:31.879 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190054.log 2023-10-03T10:23:31.880 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157473.log.gz 2023-10-03T10:23:31.880 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124135.log 2023-10-03T10:23:31.880 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187898.log 2023-10-03T10:23:31.880 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138055.log.gz 2023-10-03T10:23:31.880 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.190054.log.gz 2023-10-03T10:23:31.880 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142267.log 2023-10-03T10:23:31.880 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.124135.log.gz 2023-10-03T10:23:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144458.log 2023-10-03T10:23:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187898.log: /var/log/ceph/ceph-client.admin.142267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138765.log 2023-10-03T10:23:31.881 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.187898.log.gz 2023-10-03T10:23:31.881 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142267.log.gz/var/log/ceph/ceph-client.admin.144458.log: 2023-10-03T10:23:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171848.log 2023-10-03T10:23:31.881 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138765.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144458.log.gz 2023-10-03T10:23:31.882 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158283.log 2023-10-03T10:23:31.882 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171848.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138765.log.gz 2023-10-03T10:23:31.882 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154094.log 2023-10-03T10:23:31.882 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.171848.log.gz 2023-10-03T10:23:31.882 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157622.log 2023-10-03T10:23:31.882 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.158283.log.gz 2023-10-03T10:23:31.882 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160903.log 2023-10-03T10:23:31.883 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157622.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.154094.log.gz 2023-10-03T10:23:31.883 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128909.log 2023-10-03T10:23:31.883 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157622.log.gz 2023-10-03T10:23:31.883 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124872.log 2023-10-03T10:23:31.883 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.160903.log.gz 2023-10-03T10:23:31.883 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163828.log 2023-10-03T10:23:31.884 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124872.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128909.log.gz 2023-10-03T10:23:31.884 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135821.log 2023-10-03T10:23:31.884 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124872.log.gz 2023-10-03T10:23:31.884 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186104.log 2023-10-03T10:23:31.884 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163828.log.gz 2023-10-03T10:23:31.884 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139405.log 2023-10-03T10:23:31.884 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186104.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135821.log.gz 2023-10-03T10:23:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129203.log 2023-10-03T10:23:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139405.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.186104.log.gz 2023-10-03T10:23:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186299.log 2023-10-03T10:23:31.885 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139405.log.gz 2023-10-03T10:23:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.129203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156715.log 2023-10-03T10:23:31.885 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186299.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129203.log.gz 2023-10-03T10:23:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150041.log 2023-10-03T10:23:31.886 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.186299.log.gz 2023-10-03T10:23:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179745.log 2023-10-03T10:23:31.886 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.156715.log.gz 2023-10-03T10:23:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161889.log 2023-10-03T10:23:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179745.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150041.log.gz 2023-10-03T10:23:31.886 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136779.log 2023-10-03T10:23:31.887 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179745.log.gz 2023-10-03T10:23:31.887 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125629.log 2023-10-03T10:23:31.887 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161889.log.gz 2023-10-03T10:23:31.887 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163510.log 2023-10-03T10:23:31.887 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137836.log 88.9% 2023-10-03T10:23:31.887 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.136779.log.gz 2023-10-03T10:23:31.888 INFO:teuthology.orchestra.run.smithi072.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.125629.log.gz 2023-10-03T10:23:31.888 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154925.log 2023-10-03T10:23:31.888 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163510.log.gz 2023-10-03T10:23:31.888 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128347.log 2023-10-03T10:23:31.888 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137836.log: /var/log/ceph/ceph-client.admin.154925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177262.log 2023-10-03T10:23:31.888 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137836.log.gz 2023-10-03T10:23:31.888 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154925.log.gz 2023-10-03T10:23:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178438.log 2023-10-03T10:23:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128347.log: /var/log/ceph/ceph-client.admin.177262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161003.log 2023-10-03T10:23:31.889 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128347.log.gz 2023-10-03T10:23:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178438.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177262.log.gz 2023-10-03T10:23:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135824.log 2023-10-03T10:23:31.889 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178438.log.gz 2023-10-03T10:23:31.890 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190446.log 2023-10-03T10:23:31.890 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161003.log.gz 2023-10-03T10:23:31.890 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185463.log 2023-10-03T10:23:31.890 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190446.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.135824.log.gz 2023-10-03T10:23:31.890 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149772.log 2023-10-03T10:23:31.890 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190446.log.gz 2023-10-03T10:23:31.890 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124429.log 2023-10-03T10:23:31.891 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.185463.log.gz 2023-10-03T10:23:31.891 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158845.log 2023-10-03T10:23:31.891 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124429.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.149772.log.gz 2023-10-03T10:23:31.891 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180088.log 2023-10-03T10:23:31.891 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158845.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124429.log.gzgzip 2023-10-03T10:23:31.891 INFO:teuthology.orchestra.run.smithi072.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.140750.log 2023-10-03T10:23:31.892 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180088.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158845.log.gz 2023-10-03T10:23:31.892 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188486.log 2023-10-03T10:23:31.892 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.180088.log.gz 2023-10-03T10:23:31.892 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136975.log 2023-10-03T10:23:31.892 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140750.log.gz 2023-10-03T10:23:31.892 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149921.log 2023-10-03T10:23:31.892 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188486.log.gz 2023-10-03T10:23:31.893 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149333.log 2023-10-03T10:23:31.893 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149921.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136975.log.gz 2023-10-03T10:23:31.893 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187498.log 2023-10-03T10:23:31.893 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.149921.log.gz 2023-10-03T10:23:31.893 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148353.log 2023-10-03T10:23:31.893 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187498.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149333.log.gz 2023-10-03T10:23:31.894 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188778.log 2023-10-03T10:23:31.894 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148353.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.187498.log.gz 2023-10-03T10:23:31.894 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134170.log 2023-10-03T10:23:31.894 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148353.log.gz 2023-10-03T10:23:31.894 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156642.log 2023-10-03T10:23:31.894 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188778.log.gz 2023-10-03T10:23:31.894 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.134170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173563.log 2023-10-03T10:23:31.895 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184901.log 2023-10-03T10:23:31.895 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.134170.log.gz 2023-10-03T10:23:31.895 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.156642.log.gz 2023-10-03T10:23:31.895 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189758.log 2023-10-03T10:23:31.895 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.173563.log.gz 2023-10-03T10:23:31.895 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173416.log 2023-10-03T10:23:31.895 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184901.log.gz 2023-10-03T10:23:31.896 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189466.log 2023-10-03T10:23:31.896 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.189758.log.gz 2023-10-03T10:23:31.896 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169561.log 2023-10-03T10:23:31.896 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.173416.log.gz 2023-10-03T10:23:31.896 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157695.log 2023-10-03T10:23:31.896 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.189466.log.gz 2023-10-03T10:23:31.896 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122435.log 2023-10-03T10:23:31.897 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169561.log.gz 2023-10-03T10:23:31.897 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144431.log 2023-10-03T10:23:31.897 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157695.log.gz 2023-10-03T10:23:31.897 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187424.log 2023-10-03T10:23:31.897 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122435.log.gz 2023-10-03T10:23:31.897 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146248.log 2023-10-03T10:23:31.897 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144431.log.gz 2023-10-03T10:23:31.898 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171921.log 2023-10-03T10:23:31.898 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.187424.log.gz 2023-10-03T10:23:31.898 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188582.log 2023-10-03T10:23:31.898 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146248.log: /var/log/ceph/ceph-client.admin.171921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160317.log 2023-10-03T10:23:31.898 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.146248.log.gz 2023-10-03T10:23:31.898 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171921.log.gz 2023-10-03T10:23:31.898 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190542.log 2023-10-03T10:23:31.899 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188582.log: /var/log/ceph/ceph-client.admin.160317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156885.log 2023-10-03T10:23:31.899 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.188582.log.gz 2023-10-03T10:23:31.899 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190542.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.160317.log.gz 2023-10-03T10:23:31.899 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143323.log 2023-10-03T10:23:31.899 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.190542.log.gz 2023-10-03T10:23:31.899 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176823.log 2023-10-03T10:23:31.899 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156885.log: /var/log/ceph/ceph-client.admin.143323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163632.log 2023-10-03T10:23:31.900 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156885.log.gz 2023-10-03T10:23:31.900 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143323.log.gz 2023-10-03T10:23:31.900 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193607.log 2023-10-03T10:23:31.900 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163632.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176823.log.gz 2023-10-03T10:23:31.900 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125166.log 2023-10-03T10:23:31.900 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193607.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.163632.log.gz 2023-10-03T10:23:31.900 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138791.log 2023-10-03T10:23:31.901 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.193607.log.gz 2023-10-03T10:23:31.901 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158161.log 2023-10-03T10:23:31.901 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176233.log 2023-10-03T10:23:31.901 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138791.log.gz 2023-10-03T10:23:31.901 INFO:teuthology.orchestra.run.smithi072.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.125166.log.gz 2023-10-03T10:23:31.901 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136190.log 2023-10-03T10:23:31.901 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158161.log.gz 2023-10-03T10:23:31.902 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146391.log 2023-10-03T10:23:31.902 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176233.log: /var/log/ceph/ceph-client.admin.136190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163065.log 2023-10-03T10:23:31.902 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176233.log.gz 2023-10-03T10:23:31.902 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146391.log: gzip -5 89.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.136190.log.gz/var/log/ceph/ceph-client.admin.166695.log 2023-10-03T10:23:31.902 INFO:teuthology.orchestra.run.smithi072.stderr: 2023-10-03T10:23:31.902 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146391.log.gz 2023-10-03T10:23:31.902 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125776.log 2023-10-03T10:23:31.903 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166695.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163065.log.gz 2023-10-03T10:23:31.903 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135875.log 2023-10-03T10:23:31.903 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125776.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166695.log.gz 2023-10-03T10:23:31.903 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193364.log 2023-10-03T10:23:31.903 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125776.log.gz 2023-10-03T10:23:31.903 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163606.log 2023-10-03T10:23:31.903 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135875.log.gz 2023-10-03T10:23:31.904 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156323.log 2023-10-03T10:23:31.904 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163606.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193364.log.gz 2023-10-03T10:23:31.904 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140555.log 2023-10-03T10:23:31.904 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.163606.log.gz 2023-10-03T10:23:31.904 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125117.log 2023-10-03T10:23:31.904 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156323.log.gz 2023-10-03T10:23:31.904 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171799.log 2023-10-03T10:23:31.905 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140555.log.gz 2023-10-03T10:23:31.905 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151589.log 2023-10-03T10:23:31.905 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171799.log: 87.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.125117.log.gz--verbose 2023-10-03T10:23:31.905 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.180872.log 2023-10-03T10:23:31.905 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151589.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171799.log.gz 2023-10-03T10:23:31.905 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189196.log 2023-10-03T10:23:31.905 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.151589.log.gz/var/log/ceph/ceph-client.admin.180872.log: 2023-10-03T10:23:31.906 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157107.log 2023-10-03T10:23:31.906 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.180872.log.gz 2023-10-03T10:23:31.906 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140973.log 2023-10-03T10:23:31.906 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.189196.log.gz 2023-10-03T10:23:31.906 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145510.log 2023-10-03T10:23:31.906 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157107.log.gz 2023-10-03T10:23:31.907 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177215.log 2023-10-03T10:23:31.907 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140973.log.gz 2023-10-03T10:23:31.907 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189562.log 2023-10-03T10:23:31.907 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177215.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.145510.log.gz 2023-10-03T10:23:31.907 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186888.log 2023-10-03T10:23:31.907 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177215.log.gz 2023-10-03T10:23:31.907 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142953.log 2023-10-03T10:23:31.908 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4%/var/log/ceph/ceph-client.admin.186888.log: -- replaced with /var/log/ceph/ceph-client.admin.189562.log.gz 2023-10-03T10:23:31.908 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129105.log 2023-10-03T10:23:31.908 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.186888.log.gz 2023-10-03T10:23:31.908 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143861.log 2023-10-03T10:23:31.908 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142953.log.gz 2023-10-03T10:23:31.908 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.129105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190009.log 2023-10-03T10:23:31.908 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129105.log.gz 2023-10-03T10:23:31.909 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182123.log 2023-10-03T10:23:31.909 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143861.log.gz 2023-10-03T10:23:31.909 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181758.log 2023-10-03T10:23:31.909 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.190009.log.gz 2023-10-03T10:23:31.909 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175645.log 2023-10-03T10:23:31.909 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182123.log.gz 2023-10-03T10:23:31.909 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146097.log 2023-10-03T10:23:31.910 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.181758.log.gz 2023-10-03T10:23:31.910 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174273.log 2023-10-03T10:23:31.910 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.175645.log.gz 2023-10-03T10:23:31.910 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182542.log 2023-10-03T10:23:31.910 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.146097.log.gz 2023-10-03T10:23:31.910 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181339.log 2023-10-03T10:23:31.910 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.174273.log.gz 2023-10-03T10:23:31.911 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152665.log 2023-10-03T10:23:31.911 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.182542.log.gz 2023-10-03T10:23:31.911 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175815.log 2023-10-03T10:23:31.911 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181339.log.gz 2023-10-03T10:23:31.911 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158087.log 2023-10-03T10:23:31.911 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152665.log.gz 2023-10-03T10:23:31.911 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171064.log 2023-10-03T10:23:31.911 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.175815.log.gz 2023-10-03T10:23:31.912 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158675.log 2023-10-03T10:23:31.912 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171064.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158087.log.gz 2023-10-03T10:23:31.912 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178961.log 2023-10-03T10:23:31.912 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171064.log.gz 2023-10-03T10:23:31.912 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125384.log 2023-10-03T10:23:31.912 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158675.log.gz 2023-10-03T10:23:31.912 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179390.log 2023-10-03T10:23:31.912 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125384.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178961.log.gz 2023-10-03T10:23:31.913 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124674.log 2023-10-03T10:23:31.913 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125384.log.gz 2023-10-03T10:23:31.913 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187398.log 2023-10-03T10:23:31.913 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179390.log.gz 2023-10-03T10:23:31.913 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136045.log 2023-10-03T10:23:31.913 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124674.log.gz/var/log/ceph/ceph-client.admin.187398.log: 2023-10-03T10:23:31.913 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128958.log 2023-10-03T10:23:31.913 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.187398.log.gz 2023-10-03T10:23:31.914 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192805.log 2023-10-03T10:23:31.914 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.136045.log.gz 2023-10-03T10:23:31.914 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164686.log 2023-10-03T10:23:31.914 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128958.log.gz 2023-10-03T10:23:31.914 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138177.log 2023-10-03T10:23:31.914 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.192805.log.gz 2023-10-03T10:23:31.914 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172901.log 2023-10-03T10:23:31.914 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.164686.log.gz 2023-10-03T10:23:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159825.log 2023-10-03T10:23:31.915 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138177.log.gz 2023-10-03T10:23:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181656.log 2023-10-03T10:23:31.915 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172901.log.gz 2023-10-03T10:23:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.159825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165323.log 2023-10-03T10:23:31.915 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159825.log.gz 2023-10-03T10:23:31.915 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141091.log 2023-10-03T10:23:31.915 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.181656.log.gz 2023-10-03T10:23:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123694.log 2023-10-03T10:23:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141091.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.165323.log.gz 2023-10-03T10:23:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194660.log 2023-10-03T10:23:31.916 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141091.log.gz 2023-10-03T10:23:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143521.log 2023-10-03T10:23:31.916 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123694.log.gz 2023-10-03T10:23:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186614.log 2023-10-03T10:23:31.916 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143521.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194660.log.gz 2023-10-03T10:23:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147078.log 2023-10-03T10:23:31.917 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143521.log.gz 2023-10-03T10:23:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143933.log 2023-10-03T10:23:31.917 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186614.log.gz 2023-10-03T10:23:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145697.log 2023-10-03T10:23:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143933.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147078.log.gz 2023-10-03T10:23:31.917 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185242.log 2023-10-03T10:23:31.917 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143933.log.gz 2023-10-03T10:23:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143934.log 2023-10-03T10:23:31.918 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.145697.log.gz 2023-10-03T10:23:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139379.log 2023-10-03T10:23:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143934.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.185242.log.gz 2023-10-03T10:23:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145473.log 2023-10-03T10:23:31.918 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143934.log.gz 2023-10-03T10:23:31.918 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128156.log 2023-10-03T10:23:31.919 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139379.log.gz 2023-10-03T10:23:31.919 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151293.log 2023-10-03T10:23:31.919 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128156.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.145473.log.gz 2023-10-03T10:23:31.919 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191990.log 2023-10-03T10:23:31.919 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128156.log.gz 2023-10-03T10:23:31.919 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141561.log 2023-10-03T10:23:31.919 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151293.log.gz 2023-10-03T10:23:31.920 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171875.log 2023-10-03T10:23:31.920 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141561.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191990.log.gz 2023-10-03T10:23:31.920 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194344.log 2023-10-03T10:23:31.920 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141561.log.gz 2023-10-03T10:23:31.920 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146979.log 2023-10-03T10:23:31.920 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171875.log.gz 2023-10-03T10:23:31.920 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173024.log 2023-10-03T10:23:31.921 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146979.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.194344.log.gz 2023-10-03T10:23:31.921 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124822.log 2023-10-03T10:23:31.921 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146979.log.gz 2023-10-03T10:23:31.921 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179696.log 2023-10-03T10:23:31.921 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173024.log.gz 2023-10-03T10:23:31.921 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143738.log 2023-10-03T10:23:31.921 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179696.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124822.log.gz 2023-10-03T10:23:31.922 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179500.log 2023-10-03T10:23:31.922 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179696.log.gz 2023-10-03T10:23:31.922 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145803.log 2023-10-03T10:23:31.922 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143738.log.gz 2023-10-03T10:23:31.922 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172387.log 2023-10-03T10:23:31.922 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145803.log: gzip 88.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.179500.log.gz--verbose 2023-10-03T10:23:31.922 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.176207.log 2023-10-03T10:23:31.923 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.145803.log.gz 2023-10-03T10:23:31.923 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149649.log 2023-10-03T10:23:31.923 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.172387.log.gz 2023-10-03T10:23:31.923 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175127.log 2023-10-03T10:23:31.923 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149649.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176207.log.gz 2023-10-03T10:23:31.923 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173489.log 2023-10-03T10:23:31.923 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149649.log.gz 2023-10-03T10:23:31.924 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154533.log 2023-10-03T10:23:31.924 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175127.log.gz 2023-10-03T10:23:31.924 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180529.log 2023-10-03T10:23:31.924 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154533.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.173489.log.gz 2023-10-03T10:23:31.924 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160611.log 2023-10-03T10:23:31.924 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.154533.log.gz 2023-10-03T10:23:31.924 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144725.log 2023-10-03T10:23:31.925 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.180529.log.gz 2023-10-03T10:23:31.925 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161099.log 2023-10-03T10:23:31.925 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.160611.log.gz 2023-10-03T10:23:31.925 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153849.log 2023-10-03T10:23:31.925 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9%/var/log/ceph/ceph-client.admin.161099.log: -- replaced with /var/log/ceph/ceph-client.admin.144725.log.gz 2023-10-03T10:23:31.925 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138596.log 2023-10-03T10:23:31.926 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153849.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161099.log.gz 2023-10-03T10:23:31.926 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167479.log 2023-10-03T10:23:31.926 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138596.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.153849.log.gz 2023-10-03T10:23:31.926 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166376.log 2023-10-03T10:23:31.926 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167479.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138596.log.gz 2023-10-03T10:23:31.926 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144331.log 2023-10-03T10:23:31.926 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.167479.log.gz 2023-10-03T10:23:31.927 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167675.log 2023-10-03T10:23:31.927 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144331.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166376.log.gz 2023-10-03T10:23:31.927 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181535.log 2023-10-03T10:23:31.927 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167675.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.144331.log.gz 2023-10-03T10:23:31.927 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184850.log 2023-10-03T10:23:31.927 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167675.log.gz 2023-10-03T10:23:31.927 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184262.log 2023-10-03T10:23:31.928 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.181535.log.gz 2023-10-03T10:23:31.928 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127015.log 2023-10-03T10:23:31.928 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3%/var/log/ceph/ceph-client.admin.184262.log: -- replaced with /var/log/ceph/ceph-client.admin.184850.log.gz 2023-10-03T10:23:31.928 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182515.log 2023-10-03T10:23:31.928 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.184262.log.gz 2023-10-03T10:23:31.928 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158357.log 2023-10-03T10:23:31.928 INFO:teuthology.orchestra.run.smithi072.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.127015.log.gz 2023-10-03T10:23:31.929 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171134.log 2023-10-03T10:23:31.929 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158357.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182515.log.gz 2023-10-03T10:23:31.929 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148865.log 2023-10-03T10:23:31.929 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171134.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158357.log.gz 2023-10-03T10:23:31.929 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147864.log 2023-10-03T10:23:31.929 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171134.log.gz 2023-10-03T10:23:31.929 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125019.log 2023-10-03T10:23:31.930 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148865.log.gz 2023-10-03T10:23:31.930 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123820.log 2023-10-03T10:23:31.930 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160366.log 2023-10-03T10:23:31.930 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147864.log.gz 2023-10-03T10:23:31.930 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177532.log 2023-10-03T10:23:31.930 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125019.log.gz 2023-10-03T10:23:31.930 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160366.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123820.log.gz 2023-10-03T10:23:31.931 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151685.log 2023-10-03T10:23:31.931 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.160366.log.gz 2023-10-03T10:23:31.931 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163802.log 2023-10-03T10:23:31.931 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.177532.log.gz 2023-10-03T10:23:31.931 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158994.log 2023-10-03T10:23:31.931 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151685.log.gz 2023-10-03T10:23:31.931 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169757.log 2023-10-03T10:23:31.932 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158994.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163802.log.gz 2023-10-03T10:23:31.932 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191010.log 2023-10-03T10:23:31.932 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169757.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158994.log.gz 2023-10-03T10:23:31.932 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172509.log 2023-10-03T10:23:31.932 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169757.log.gz 2023-10-03T10:23:31.932 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142754.log 2023-10-03T10:23:31.932 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.191010.log.gz 2023-10-03T10:23:31.933 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175841.log 2023-10-03T10:23:31.933 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.172509.log.gz 2023-10-03T10:23:31.933 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190372.log 2023-10-03T10:23:31.933 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142754.log.gz 2023-10-03T10:23:31.933 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180014.log 2023-10-03T10:23:31.933 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190372.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175841.log.gz 2023-10-03T10:23:31.933 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187994.log 2023-10-03T10:23:31.933 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.190372.log.gz/var/log/ceph/ceph-client.admin.180014.log: 2023-10-03T10:23:31.934 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166768.log 2023-10-03T10:23:31.934 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180014.log.gz 2023-10-03T10:23:31.934 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192606.log 2023-10-03T10:23:31.934 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166768.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.187994.log.gz 2023-10-03T10:23:31.934 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192552.log 2023-10-03T10:23:31.934 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.166768.log.gz 2023-10-03T10:23:31.934 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136242.log 2023-10-03T10:23:31.935 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192606.log.gz 2023-10-03T10:23:31.935 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129423.log 2023-10-03T10:23:31.935 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.192552.log.gz 2023-10-03T10:23:31.935 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181705.log 2023-10-03T10:23:31.935 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136242.log.gz 2023-10-03T10:23:31.935 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.129423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166644.log 2023-10-03T10:23:31.935 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181705.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129423.log.gz 2023-10-03T10:23:31.936 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168336.log 2023-10-03T10:23:31.936 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.181705.log.gz 2023-10-03T10:23:31.936 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192409.log 2023-10-03T10:23:31.936 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166644.log.gz 2023-10-03T10:23:31.936 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141338.log 2023-10-03T10:23:31.936 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168336.log.gz 2023-10-03T10:23:31.936 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180751.log 2023-10-03T10:23:31.937 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141338.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.192409.log.gz 2023-10-03T10:23:31.937 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138347.log 2023-10-03T10:23:31.937 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141338.log.gz 2023-10-03T10:23:31.937 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123351.log 2023-10-03T10:23:31.937 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180751.log.gz 2023-10-03T10:23:31.937 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193729.log 2023-10-03T10:23:31.937 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138347.log.gz 2023-10-03T10:23:31.938 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184536.log 2023-10-03T10:23:31.938 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193729.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.123351.log.gz 2023-10-03T10:23:31.938 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-03T10:23:31.938 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193729.log.gz 2023-10-03T10:23:31.938 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180333.log 2023-10-03T10:23:31.938 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.184536.log.gz 2023-10-03T10:23:31.938 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165715.log 2023-10-03T10:23:31.939 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162673.log 2023-10-03T10:23:31.939 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.180333.log.gz 2023-10-03T10:23:31.939 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147765.log 2023-10-03T10:23:31.939 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.165715.log.gz 2023-10-03T10:23:31.939 INFO:teuthology.orchestra.run.smithi072.stderr:gzip /var/log/ceph/ceph-client.admin.162673.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.163755.log 2023-10-03T10:23:31.939 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187701.log 2023-10-03T10:23:31.939 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162673.log.gz 2023-10-03T10:23:31.940 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163755.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147765.log.gz 2023-10-03T10:23:31.940 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176037.log 2023-10-03T10:23:31.940 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.163755.log.gz 2023-10-03T10:23:31.940 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160049.log 2023-10-03T10:23:31.940 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187701.log.gz 2023-10-03T10:23:31.940 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173955.log 2023-10-03T10:23:31.940 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176037.log.gz 2023-10-03T10:23:31.941 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171015.log 2023-10-03T10:23:31.941 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160049.log.gz 2023-10-03T10:23:31.941 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175449.log 2023-10-03T10:23:31.941 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.173955.log.gz 2023-10-03T10:23:31.941 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140211.log 2023-10-03T10:23:31.941 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175449.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171015.log.gz 2023-10-03T10:23:31.941 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142685.log 2023-10-03T10:23:31.942 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175449.log.gz 2023-10-03T10:23:31.942 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163203.log 2023-10-03T10:23:31.942 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142685.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140211.log.gz 2023-10-03T10:23:31.942 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179818.log 2023-10-03T10:23:31.942 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142685.log.gz 2023-10-03T10:23:31.942 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 /var/log/ceph/ceph-client.admin.163203.log: --verbose -- /var/log/ceph/ceph-client.admin.181954.log 2023-10-03T10:23:31.942 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163203.log.gz 2023-10-03T10:23:31.943 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161029.log 2023-10-03T10:23:31.943 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179818.log.gz 2023-10-03T10:23:31.943 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171529.log 2023-10-03T10:23:31.943 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161029.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181954.log.gz 2023-10-03T10:23:31.943 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166303.log 2023-10-03T10:23:31.943 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161029.log.gz 2023-10-03T10:23:31.943 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164220.log 2023-10-03T10:23:31.944 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171529.log.gz 2023-10-03T10:23:31.944 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183308.log 2023-10-03T10:23:31.944 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164220.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166303.log.gz 2023-10-03T10:23:31.944 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173655.log 2023-10-03T10:23:31.944 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.164220.log.gz 2023-10-03T10:23:31.944 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149604.log 2023-10-03T10:23:31.944 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.183308.log.gz 2023-10-03T10:23:31.945 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193803.log 2023-10-03T10:23:31.945 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149604.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173655.log.gz 2023-10-03T10:23:31.945 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185880.log 2023-10-03T10:23:31.945 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149604.log.gz 2023-10-03T10:23:31.945 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124016.log 2023-10-03T10:23:31.945 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193803.log.gz 2023-10-03T10:23:31.945 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138007.log 2023-10-03T10:23:31.945 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124016.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.185880.log.gz 2023-10-03T10:23:31.946 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161626.log 2023-10-03T10:23:31.946 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124016.log.gz 2023-10-03T10:23:31.946 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178987.log 2023-10-03T10:23:31.946 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138007.log.gz 2023-10-03T10:23:31.946 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183728.log 2023-10-03T10:23:31.946 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178987.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.161626.log.gz 2023-10-03T10:23:31.946 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159190.log 2023-10-03T10:23:31.946 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178987.log.gz 2023-10-03T10:23:31.947 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127576.log 2023-10-03T10:23:31.947 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.183728.log.gz 2023-10-03T10:23:31.947 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.159190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159974.log 2023-10-03T10:23:31.947 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127576.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159190.log.gz 2023-10-03T10:23:31.947 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136684.log 2023-10-03T10:23:31.947 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127576.log.gz 2023-10-03T10:23:31.947 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.159974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178708.log 2023-10-03T10:23:31.947 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176599.log 2023-10-03T10:23:31.948 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.159974.log.gz 2023-10-03T10:23:31.948 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178708.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.136684.log.gz 2023-10-03T10:23:31.948 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151219.log 2023-10-03T10:23:31.948 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.178708.log.gz 2023-10-03T10:23:31.948 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184458.log 2023-10-03T10:23:31.948 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176599.log: /var/log/ceph/ceph-client.admin.151219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189954.log 2023-10-03T10:23:31.948 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176599.log.gz 2023-10-03T10:23:31.948 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184458.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151219.log.gz 2023-10-03T10:23:31.949 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170427.log 2023-10-03T10:23:31.949 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.184458.log.gz 2023-10-03T10:23:31.949 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150008.log 2023-10-03T10:23:31.949 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140111.log 2023-10-03T10:23:31.949 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.189954.log.gz 2023-10-03T10:23:31.949 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150008.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170427.log.gz 2023-10-03T10:23:31.949 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135447.log 2023-10-03T10:23:31.949 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.150008.log.gz 2023-10-03T10:23:31.950 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128713.log 2023-10-03T10:23:31.950 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140111.log: /var/log/ceph/ceph-client.admin.135447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164024.log 2023-10-03T10:23:31.950 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140111.log.gz 2023-10-03T10:23:31.950 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128713.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135447.log.gz 2023-10-03T10:23:31.950 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140503.log 2023-10-03T10:23:31.950 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128713.log.gz 2023-10-03T10:23:31.950 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167918.log 2023-10-03T10:23:31.950 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164024.log.gz 2023-10-03T10:23:31.951 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152199.log 2023-10-03T10:23:31.951 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140503.log: /var/log/ceph/ceph-client.admin.167918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187628.log 2023-10-03T10:23:31.951 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140503.log.gz 2023-10-03T10:23:31.951 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152199.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167918.log.gz 2023-10-03T10:23:31.951 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193289.log 2023-10-03T10:23:31.951 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152199.log.gz 2023-10-03T10:23:31.951 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187105.log 2023-10-03T10:23:31.951 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187628.log: /var/log/ceph/ceph-client.admin.193289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175031.log 2023-10-03T10:23:31.952 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187628.log.gz 2023-10-03T10:23:31.952 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187105.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193289.log.gz 2023-10-03T10:23:31.952 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191598.log 2023-10-03T10:23:31.952 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.187105.log.gz 2023-10-03T10:23:31.952 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127549.log 2023-10-03T10:23:31.952 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175031.log.gz 2023-10-03T10:23:31.952 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194269.log 2023-10-03T10:23:31.952 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191598.log.gz 2023-10-03T10:23:31.953 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184509.log 2023-10-03T10:23:31.953 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127549.log: /var/log/ceph/ceph-client.admin.194269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161542.log 2023-10-03T10:23:31.953 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127549.log.gz 2023-10-03T10:23:31.953 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184509.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.194269.log.gz 2023-10-03T10:23:31.953 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191009.log 2023-10-03T10:23:31.953 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.184509.log.gz 2023-10-03T10:23:31.953 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188804.log 2023-10-03T10:23:31.954 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.161542.log.gz 2023-10-03T10:23:31.954 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139523.log 2023-10-03T10:23:31.954 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167871.log 2023-10-03T10:23:31.954 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.191009.log.gz 2023-10-03T10:23:31.954 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188804.log.gz 2023-10-03T10:23:31.954 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184144.log 2023-10-03T10:23:31.954 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.139523.log.gz 2023-10-03T10:23:31.954 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143665.log 2023-10-03T10:23:31.955 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167871.log: /var/log/ceph/ceph-client.admin.184144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144849.log 2023-10-03T10:23:31.955 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.167871.log.gz 2023-10-03T10:23:31.955 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.184144.log.gz 2023-10-03T10:23:31.955 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167134.log 2023-10-03T10:23:31.955 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.143665.log.gz 2023-10-03T10:23:31.955 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 /var/log/ceph/ceph-client.admin.144849.log: --verbose -- /var/log/ceph/ceph-client.admin.139941.log 2023-10-03T10:23:31.955 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167134.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144849.log.gz 2023-10-03T10:23:31.955 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151809.log 2023-10-03T10:23:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124970.log 2023-10-03T10:23:31.956 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167134.log.gz 2023-10-03T10:23:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151809.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139941.log.gz 2023-10-03T10:23:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189026.log 2023-10-03T10:23:31.956 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151809.log.gz 2023-10-03T10:23:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185464.log 2023-10-03T10:23:31.956 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124970.log.gz 2023-10-03T10:23:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191329.log 2023-10-03T10:23:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185464.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189026.log.gz 2023-10-03T10:23:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165666.log 2023-10-03T10:23:31.957 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185464.log.gz 2023-10-03T10:23:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182097.log 2023-10-03T10:23:31.957 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.191329.log.gz 2023-10-03T10:23:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149453.log 2023-10-03T10:23:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182097.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165666.log.gz 2023-10-03T10:23:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176011.log 2023-10-03T10:23:31.958 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.182097.log.gz 2023-10-03T10:23:31.958 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180947.log 2023-10-03T10:23:31.958 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176011.log: gzip -5 --verbose -- 87.6%/var/log/ceph/ceph-client.admin.174077.log -- replaced with /var/log/ceph/ceph-client.admin.149453.log.gz 2023-10-03T10:23:31.958 INFO:teuthology.orchestra.run.smithi072.stderr: 2023-10-03T10:23:31.958 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180947.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176011.log.gz 2023-10-03T10:23:31.958 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124478.log 2023-10-03T10:23:31.958 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.180947.log.gz 2023-10-03T10:23:31.958 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147633.log 2023-10-03T10:23:31.959 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124478.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174077.log.gz 2023-10-03T10:23:31.959 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155613.log 2023-10-03T10:23:31.959 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124478.log.gz 2023-10-03T10:23:31.959 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151144.log 2023-10-03T10:23:31.959 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.147633.log.gz 2023-10-03T10:23:31.959 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157377.log 2023-10-03T10:23:31.960 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183948.log 2023-10-03T10:23:31.960 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.155613.log.gz 2023-10-03T10:23:31.960 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151144.log.gz 2023-10-03T10:23:31.960 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170744.log 2023-10-03T10:23:31.960 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141972.log 2023-10-03T10:23:31.960 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157377.log.gz 2023-10-03T10:23:31.960 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183948.log: /var/log/ceph/ceph-client.admin.170744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127016.log 2023-10-03T10:23:31.961 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.183948.log.gz 2023-10-03T10:23:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141972.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.170744.log.gz 2023-10-03T10:23:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124723.log 2023-10-03T10:23:31.961 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.141972.log.gz 2023-10-03T10:23:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183773.log 2023-10-03T10:23:31.961 INFO:teuthology.orchestra.run.smithi072.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.127016.log.gz 2023-10-03T10:23:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166838.log 2023-10-03T10:23:31.962 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124723.log.gz 2023-10-03T10:23:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192017.log 2023-10-03T10:23:31.962 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.183773.log.gz 2023-10-03T10:23:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183504.log 2023-10-03T10:23:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192017.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166838.log.gz 2023-10-03T10:23:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135496.log 2023-10-03T10:23:31.962 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192017.log.gz 2023-10-03T10:23:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171333.log 2023-10-03T10:23:31.963 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183504.log: /var/log/ceph/ceph-client.admin.135496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175964.log 87.8% 2023-10-03T10:23:31.963 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.183504.log.gz 2023-10-03T10:23:31.963 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135496.log.gz 2023-10-03T10:23:31.963 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156297.log 2023-10-03T10:23:31.963 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173065.log 2023-10-03T10:23:31.963 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171333.log.gz 2023-10-03T10:23:31.963 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156297.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175964.log.gz 2023-10-03T10:23:31.964 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127466.log 2023-10-03T10:23:31.964 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156297.log.gz 2023-10-03T10:23:31.964 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123104.log 2023-10-03T10:23:31.964 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173065.log.gz 2023-10-03T10:23:31.964 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159141.log 2023-10-03T10:23:31.964 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127466.log.gz 2023-10-03T10:23:31.964 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154682.log 2023-10-03T10:23:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.159141.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123104.log.gz 2023-10-03T10:23:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187450.log 2023-10-03T10:23:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154682.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159141.log.gz 2023-10-03T10:23:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182835.log 2023-10-03T10:23:31.965 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.154682.log.gz 2023-10-03T10:23:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135253.log 2023-10-03T10:23:31.965 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182835.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.187450.log.gz 2023-10-03T10:23:31.966 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145241.log 2023-10-03T10:23:31.966 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182835.log.gz 2023-10-03T10:23:31.966 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149380.log 2023-10-03T10:23:31.966 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135253.log.gz 2023-10-03T10:23:31.966 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183112.log 2023-10-03T10:23:31.966 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149380.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.145241.log.gz 2023-10-03T10:23:31.966 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123155.log 2023-10-03T10:23:31.967 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.149380.log.gz 2023-10-03T10:23:31.967 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146491.log 2023-10-03T10:23:31.967 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.183112.log.gz 2023-10-03T10:23:31.967 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163998.log 2023-10-03T10:23:31.967 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146491.log: gzip 89.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.123155.log.gz--verbose 2023-10-03T10:23:31.967 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.163706.log 2023-10-03T10:23:31.967 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146491.log.gz 2023-10-03T10:23:31.968 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182319.log 2023-10-03T10:23:31.968 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163706.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.163998.log.gz 2023-10-03T10:23:31.968 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137271.log 2023-10-03T10:23:31.968 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163706.log.gz 2023-10-03T10:23:31.968 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125825.log 2023-10-03T10:23:31.968 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137271.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.182319.log.gz 2023-10-03T10:23:31.968 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136269.log 2023-10-03T10:23:31.969 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137271.log.gz 2023-10-03T10:23:31.969 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168406.log 2023-10-03T10:23:31.969 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186298.log 2023-10-03T10:23:31.969 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136269.log: /var/log/ceph/ceph-client.admin.168406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170941.log 2023-10-03T10:23:31.969 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136269.log.gz 2023-10-03T10:23:31.969 INFO:teuthology.orchestra.run.smithi072.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.125825.log.gz 2023-10-03T10:23:31.969 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168406.log.gz 2023-10-03T10:23:31.970 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151881.log 2023-10-03T10:23:31.970 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170941.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186298.log.gz 2023-10-03T10:23:31.970 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169953.log 2023-10-03T10:23:31.970 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170941.log.gz 2023-10-03T10:23:31.970 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163951.log 2023-10-03T10:23:31.970 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151881.log.gz 2023-10-03T10:23:31.970 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136879.log 2023-10-03T10:23:31.971 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153114.log 2023-10-03T10:23:31.971 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.169953.log.gz 2023-10-03T10:23:31.971 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163951.log.gz 2023-10-03T10:23:31.971 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178512.log 2023-10-03T10:23:31.971 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153114.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136879.log.gz 2023-10-03T10:23:31.971 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173877.log 2023-10-03T10:23:31.971 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.153114.log.gz 2023-10-03T10:23:31.972 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180602.log 2023-10-03T10:23:31.972 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178512.log.gz 2023-10-03T10:23:31.972 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170223.log 2023-10-03T10:23:31.972 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180602.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173877.log.gz 2023-10-03T10:23:31.972 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182240.log 2023-10-03T10:23:31.972 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170223.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180602.log.gz 2023-10-03T10:23:31.972 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155317.log 2023-10-03T10:23:31.972 INFO:teuthology.orchestra.run.smithi072.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.170223.log.gz 2023-10-03T10:23:31.973 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169831.log 2023-10-03T10:23:31.973 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155317.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.182240.log.gz 2023-10-03T10:23:31.973 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164882.log 2023-10-03T10:23:31.973 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.155317.log.gz 2023-10-03T10:23:31.973 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166742.log 2023-10-03T10:23:31.973 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169831.log.gz 2023-10-03T10:23:31.973 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.164882.log: -- /var/log/ceph/ceph-client.admin.176087.log 2023-10-03T10:23:31.974 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166742.log: gzip 89.5%-5 -- replaced with /var/log/ceph/ceph-client.admin.164882.log.gz--verbose 2023-10-03T10:23:31.974 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.187006.log 2023-10-03T10:23:31.974 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.166742.log.gz 2023-10-03T10:23:31.974 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128517.log 2023-10-03T10:23:31.974 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.176087.log.gz 2023-10-03T10:23:31.974 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169731.log 2023-10-03T10:23:31.974 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187006.log.gz 2023-10-03T10:23:31.975 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141169.log 2023-10-03T10:23:31.975 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193560.log 2023-10-03T10:23:31.975 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.128517.log.gz 2023-10-03T10:23:31.975 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141169.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169731.log.gz 2023-10-03T10:23:31.975 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191402.log 2023-10-03T10:23:31.975 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.141169.log.gz 2023-10-03T10:23:31.975 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169880.log 2023-10-03T10:23:31.976 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191402.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.193560.log.gz 2023-10-03T10:23:31.976 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187798.log 2023-10-03T10:23:31.976 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191402.log.gz 2023-10-03T10:23:31.976 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187302.log 2023-10-03T10:23:31.976 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187798.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169880.log.gz 2023-10-03T10:23:31.976 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189662.log 2023-10-03T10:23:31.976 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.187798.log.gz 2023-10-03T10:23:31.977 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137075.log 2023-10-03T10:23:31.977 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.187302.log.gz 2023-10-03T10:23:31.977 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173293.log 2023-10-03T10:23:31.977 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189662.log.gz 2023-10-03T10:23:31.977 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137644.log 2023-10-03T10:23:31.977 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137075.log.gz 2023-10-03T10:23:31.977 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157303.log 2023-10-03T10:23:31.978 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173293.log.gz 2023-10-03T10:23:31.978 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188438.log 2023-10-03T10:23:31.978 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157303.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137644.log.gz 2023-10-03T10:23:31.978 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150509.log 2023-10-03T10:23:31.978 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141562.log 88.8% 2023-10-03T10:23:31.978 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.157303.log.gz 2023-10-03T10:23:31.978 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.188438.log.gz 2023-10-03T10:23:31.979 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194827.log 2023-10-03T10:23:31.979 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0%/var/log/ceph/ceph-client.admin.141562.log: -- replaced with /var/log/ceph/ceph-client.admin.150509.log.gz 2023-10-03T10:23:31.979 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151005.log 2023-10-03T10:23:31.979 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141562.log.gz 2023-10-03T10:23:31.979 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178046.log 2023-10-03T10:23:31.979 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194827.log.gz 2023-10-03T10:23:31.979 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158798.log 2023-10-03T10:23:31.980 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178046.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151005.log.gz 2023-10-03T10:23:31.980 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171681.log 2023-10-03T10:23:31.980 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178046.log.gz 2023-10-03T10:23:31.980 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158798.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.111881.log 2023-10-03T10:23:31.980 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.158798.log.gz 2023-10-03T10:23:31.980 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169365.log 2023-10-03T10:23:31.980 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.171681.log.gz 2023-10-03T10:23:31.981 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.tmp-client.admin.111881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135157.log 2023-10-03T10:23:31.981 INFO:teuthology.orchestra.run.smithi072.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.111881.log.gz 2023-10-03T10:23:31.981 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181366.log 2023-10-03T10:23:31.981 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.169365.log.gz 2023-10-03T10:23:31.981 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148277.log 2023-10-03T10:23:31.981 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181366.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.135157.log.gz 2023-10-03T10:23:31.981 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162726.log 2023-10-03T10:23:31.981 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148277.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.181366.log.gz 2023-10-03T10:23:31.982 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160245.log 2023-10-03T10:23:31.982 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.148277.log.gz 2023-10-03T10:23:31.982 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148400.log 2023-10-03T10:23:31.982 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160245.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162726.log.gz 2023-10-03T10:23:31.982 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194391.log 2023-10-03T10:23:31.982 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148400.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160245.log.gz 2023-10-03T10:23:31.982 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157181.log 2023-10-03T10:23:31.983 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148400.log.gz 2023-10-03T10:23:31.983 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172436.log 2023-10-03T10:23:31.983 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157181.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.194391.log.gz 2023-10-03T10:23:31.983 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128420.log 2023-10-03T10:23:31.983 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157181.log.gz 2023-10-03T10:23:31.983 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127164.log 2023-10-03T10:23:31.983 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172436.log.gz 2023-10-03T10:23:31.984 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150827.log 2023-10-03T10:23:31.984 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127164.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128420.log.gz 2023-10-03T10:23:31.984 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186691.log 2023-10-03T10:23:31.984 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.127164.log.gz 2023-10-03T10:23:31.984 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194465.log 2023-10-03T10:23:31.984 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186691.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150827.log.gz 2023-10-03T10:23:31.984 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171603.log 2023-10-03T10:23:31.985 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194465.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.186691.log.gz 2023-10-03T10:23:31.985 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-03T10:23:31.985 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171603.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.194465.log.gz 2023-10-03T10:23:31.985 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192505.log 2023-10-03T10:23:31.985 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.171603.log.gz 2023-10-03T10:23:31.985 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147203.log 2023-10-03T10:23:31.985 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146444.log 2023-10-03T10:23:31.986 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192505.log.gz 2023-10-03T10:23:31.986 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168597.log 2023-10-03T10:23:31.986 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192309.log 2023-10-03T10:23:31.986 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.147203.log.gz 2023-10-03T10:23:31.986 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146444.log: /var/log/ceph/ceph-client.admin.168597.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146444.log.gz 2023-10-03T10:23:31.986 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168730.log 2023-10-03T10:23:31.986 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168597.log.gz 2023-10-03T10:23:31.986 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138569.log 2023-10-03T10:23:31.987 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192309.log.gz 2023-10-03T10:23:31.987 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150901.log 2023-10-03T10:23:31.987 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168730.log.gz 2023-10-03T10:23:31.987 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139575.log 2023-10-03T10:23:31.987 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155662.log 2023-10-03T10:23:31.987 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.138569.log.gz 2023-10-03T10:23:31.987 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150901.log: /var/log/ceph/ceph-client.admin.139575.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150901.log.gz 2023-10-03T10:23:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171137.log 2023-10-03T10:23:31.988 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.139575.log.gz 2023-10-03T10:23:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173097.log 2023-10-03T10:23:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171137.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155662.log.gz 2023-10-03T10:23:31.988 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171137.log.gz 2023-10-03T10:23:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173097.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173097.log.gz 2023-10-03T10:23:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128321.log 2023-10-03T10:23:31.989 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159337.log 2023-10-03T10:23:31.989 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191447.log 2023-10-03T10:23:31.989 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.159337.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128321.log.gz 2023-10-03T10:23:31.989 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137445.log 2023-10-03T10:23:31.989 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.159337.log.gz 2023-10-03T10:23:31.989 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137419.log 2023-10-03T10:23:31.989 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137445.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.191447.log.gz 2023-10-03T10:23:31.990 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136506.log 2023-10-03T10:23:31.990 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137445.log.gz 2023-10-03T10:23:31.990 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166180.log 2023-10-03T10:23:31.990 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136506.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.137419.log.gz 2023-10-03T10:23:31.990 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163118.log 2023-10-03T10:23:31.990 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.136506.log.gz 2023-10-03T10:23:31.990 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188020.log 2023-10-03T10:23:31.991 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.166180.log.gz 2023-10-03T10:23:31.991 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182890.log 2023-10-03T10:23:31.991 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163118.log.gz 2023-10-03T10:23:31.991 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147176.log 2023-10-03T10:23:31.991 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188020.log: /var/log/ceph/ceph-client.admin.182890.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188020.log.gz 2023-10-03T10:23:31.991 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159041.log 2023-10-03T10:23:31.991 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.182890.log.gz 2023-10-03T10:23:31.992 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174788.log 2023-10-03T10:23:31.992 INFO:teuthology.orchestra.run.smithi072.stderr: 95.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-03T10:23:31.992 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.159041.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147176.log.gz 2023-10-03T10:23:31.992 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175768.log 2023-10-03T10:23:31.992 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174788.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159041.log.gz 2023-10-03T10:23:31.992 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190640.log 2023-10-03T10:23:31.992 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.174788.log.gz 2023-10-03T10:23:31.993 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176991.log 2023-10-03T10:23:31.993 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150583.log 2023-10-03T10:23:31.993 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175768.log.gz 2023-10-03T10:23:31.993 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.190640.log.gz 2023-10-03T10:23:31.993 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188216.log 2023-10-03T10:23:31.993 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.176991.log.gz 2023-10-03T10:23:31.993 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154729.log 2023-10-03T10:23:31.994 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139574.log 2023-10-03T10:23:31.994 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.150583.log.gz 2023-10-03T10:23:31.994 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.188216.log.gz 2023-10-03T10:23:31.994 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158945.log 2023-10-03T10:23:31.994 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154729.log.gz 2023-10-03T10:23:31.994 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 /var/log/ceph/ceph-client.admin.139574.log: --verbose -- /var/log/ceph/ceph-client.admin.136412.log 2023-10-03T10:23:31.995 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192970.log 2023-10-03T10:23:31.995 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139574.log.gz 2023-10-03T10:23:31.995 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.158945.log.gz 2023-10-03T10:23:31.995 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127157.log 2023-10-03T10:23:31.995 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179575.log 2023-10-03T10:23:31.995 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136412.log.gz 2023-10-03T10:23:31.995 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.192970.log.gz 2023-10-03T10:23:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175572.log 2023-10-03T10:23:31.996 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127157.log.gz 2023-10-03T10:23:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152320.log 2023-10-03T10:23:31.996 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.179575.log.gz 2023-10-03T10:23:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137838.log 2023-10-03T10:23:31.996 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.175572.log.gz 2023-10-03T10:23:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191822.log 2023-10-03T10:23:31.997 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152320.log.gz 2023-10-03T10:23:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148251.log 2023-10-03T10:23:31.997 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137838.log.gz 2023-10-03T10:23:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167526.log 2023-10-03T10:23:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148251.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.191822.log.gz 2023-10-03T10:23:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186496.log 2023-10-03T10:23:31.998 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148251.log.gz 2023-10-03T10:23:31.998 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125237.log 2023-10-03T10:23:31.998 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.167526.log.gz 2023-10-03T10:23:31.998 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122312.log 2023-10-03T10:23:31.998 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125237.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186496.log.gz 2023-10-03T10:23:31.998 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195219.log 2023-10-03T10:23:31.998 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125237.log.gz 2023-10-03T10:23:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160954.log 2023-10-03T10:23:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195219.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122312.log.gz 2023-10-03T10:23:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163559.log 2023-10-03T10:23:31.999 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.195219.log.gz 2023-10-03T10:23:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146613.log 2023-10-03T10:23:31.999 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.160954.log.gz 2023-10-03T10:23:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169047.log 2023-10-03T10:23:32.000 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163559.log.gz 2023-10-03T10:23:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150804.log 2023-10-03T10:23:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169047.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.146613.log.gz 2023-10-03T10:23:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176160.log 2023-10-03T10:23:32.000 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.169047.log.gz 2023-10-03T10:23:32.001 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182436.log 2023-10-03T10:23:32.001 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150804.log.gz 2023-10-03T10:23:32.001 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162232.log 2023-10-03T10:23:32.001 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176160.log.gz 2023-10-03T10:23:32.001 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142659.log 2023-10-03T10:23:32.001 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182436.log: /var/log/ceph/ceph-client.admin.162232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155147.log 2023-10-03T10:23:32.001 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.182436.log.gz 2023-10-03T10:23:32.002 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142659.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.162232.log.gz 2023-10-03T10:23:32.002 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189392.log 2023-10-03T10:23:32.002 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142659.log.gz 2023-10-03T10:23:32.002 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127671.log 2023-10-03T10:23:32.002 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.155147.log.gz 2023-10-03T10:23:32.002 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176479.log 2023-10-03T10:23:32.003 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127671.log: 87.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.189392.log.gz--verbose 2023-10-03T10:23:32.003 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.195268.log 2023-10-03T10:23:32.003 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127671.log.gz 2023-10-03T10:23:32.003 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189074.log 2023-10-03T10:23:32.003 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195268.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176479.log.gz 2023-10-03T10:23:32.003 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160758.log 2023-10-03T10:23:32.003 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.195268.log.gz 2023-10-03T10:23:32.004 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179304.log 2023-10-03T10:23:32.004 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189074.log: /var/log/ceph/ceph-client.admin.160758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159533.log 2023-10-03T10:23:32.004 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189074.log.gz 2023-10-03T10:23:32.004 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179304.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.160758.log.gz 2023-10-03T10:23:32.004 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178757.log 2023-10-03T10:23:32.004 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179304.log.gz/var/log/ceph/ceph-client.admin.159533.log: 2023-10-03T10:23:32.004 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189615.log 2023-10-03T10:23:32.005 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.159533.log.gz 2023-10-03T10:23:32.005 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145437.log 2023-10-03T10:23:32.005 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178757.log: /var/log/ceph/ceph-client.admin.189615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173685.log 2023-10-03T10:23:32.005 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178757.log.gz 2023-10-03T10:23:32.005 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.189615.log.gz 2023-10-03T10:23:32.005 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127372.log 2023-10-03T10:23:32.005 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.145437.log.gz 2023-10-03T10:23:32.006 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155513.log 2023-10-03T10:23:32.006 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161942.log 2023-10-03T10:23:32.006 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173685.log.gz 2023-10-03T10:23:32.006 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127372.log.gz 2023-10-03T10:23:32.006 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122798.log 2023-10-03T10:23:32.006 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.155513.log.gz 2023-10-03T10:23:32.007 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160121.log 2023-10-03T10:23:32.007 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161942.log: /var/log/ceph/ceph-client.admin.122798.log: gzip 88.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.161942.log.gz--verbose 2023-10-03T10:23:32.007 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.168140.log 2023-10-03T10:23:32.007 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122798.log.gz 2023-10-03T10:23:32.007 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148549.log 2023-10-03T10:23:32.007 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160121.log: /var/log/ceph/ceph-client.admin.168140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140137.log 2023-10-03T10:23:32.007 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160121.log.gz 2023-10-03T10:23:32.008 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148549.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168140.log.gz 2023-10-03T10:23:32.008 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191036.log 2023-10-03T10:23:32.008 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148549.log.gz 2023-10-03T10:23:32.008 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145829.log 2023-10-03T10:23:32.008 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.140137.log.gz 2023-10-03T10:23:32.008 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175180.log 2023-10-03T10:23:32.009 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191036.log: /var/log/ceph/ceph-client.admin.145829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189366.log 2023-10-03T10:23:32.009 INFO:teuthology.orchestra.run.smithi072.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.191036.log.gz 2023-10-03T10:23:32.009 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175180.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145829.log.gz 2023-10-03T10:23:32.009 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150556.log 2023-10-03T10:23:32.009 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5%/var/log/ceph/ceph-client.admin.189366.log: -- replaced with /var/log/ceph/ceph-client.admin.175180.log.gz 2023-10-03T10:23:32.009 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171260.log 2023-10-03T10:23:32.009 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189366.log.gz 2023-10-03T10:23:32.009 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137197.log 2023-10-03T10:23:32.010 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150556.log.gz 2023-10-03T10:23:32.010 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178634.log 2023-10-03T10:23:32.010 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155417.log 2023-10-03T10:23:32.010 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.171260.log.gz 2023-10-03T10:23:32.010 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178634.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137197.log.gz 2023-10-03T10:23:32.010 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172583.log 2023-10-03T10:23:32.011 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178634.log.gz 2023-10-03T10:23:32.011 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125531.log 2023-10-03T10:23:32.011 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155417.log: /var/log/ceph/ceph-client.admin.172583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184091.log 2023-10-03T10:23:32.011 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.155417.log.gz 2023-10-03T10:23:32.011 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172583.log.gz 2023-10-03T10:23:32.011 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135277.log 2023-10-03T10:23:32.011 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175423.log 2023-10-03T10:23:32.012 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.125531.log.gz 2023-10-03T10:23:32.012 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184091.log: /var/log/ceph/ceph-client.admin.135277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178587.log 2023-10-03T10:23:32.012 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.184091.log.gz 2023-10-03T10:23:32.012 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135277.log.gz 2023-10-03T10:23:32.012 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179426.log 2023-10-03T10:23:32.012 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123818.log 2023-10-03T10:23:32.013 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175423.log.gz 2023-10-03T10:23:32.013 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178587.log.gz 2023-10-03T10:23:32.013 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154559.log 2023-10-03T10:23:32.013 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.179426.log.gz 2023-10-03T10:23:32.013 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160513.log 2023-10-03T10:23:32.013 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151097.log 2023-10-03T10:23:32.013 INFO:teuthology.orchestra.run.smithi072.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.123818.log.gz 2023-10-03T10:23:32.014 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154559.log.gz 2023-10-03T10:23:32.014 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178830.log 2023-10-03T10:23:32.014 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.160513.log.gz 2023-10-03T10:23:32.014 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145316.log 2023-10-03T10:23:32.014 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151097.log: /var/log/ceph/ceph-client.admin.178830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184510.log 2023-10-03T10:23:32.014 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.151097.log.gz 2023-10-03T10:23:32.014 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.178830.log.gz 2023-10-03T10:23:32.015 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172828.log 2023-10-03T10:23:32.015 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.145316.log.gz 2023-10-03T10:23:32.015 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155343.log 2023-10-03T10:23:32.015 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.184510.log.gz 2023-10-03T10:23:32.015 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169488.log 2023-10-03T10:23:32.015 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172828.log: /var/log/ceph/ceph-client.admin.155343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194729.log 2023-10-03T10:23:32.016 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172828.log.gz 2023-10-03T10:23:32.016 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.155343.log.gz/var/log/ceph/ceph-client.admin.169488.log: 2023-10-03T10:23:32.016 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149061.log 2023-10-03T10:23:32.016 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169488.log.gz 2023-10-03T10:23:32.016 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156397.log 2023-10-03T10:23:32.016 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194729.log: /var/log/ceph/ceph-client.admin.149061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173367.log 2023-10-03T10:23:32.016 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.194729.log.gz 2023-10-03T10:23:32.017 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0%/var/log/ceph/ceph-client.admin.156397.log: -- replaced with /var/log/ceph/ceph-client.admin.149061.log.gz 2023-10-03T10:23:32.017 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184902.log 2023-10-03T10:23:32.017 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156397.log.gz 2023-10-03T10:23:32.017 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190399.log 2023-10-03T10:23:32.017 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173367.log: /var/log/ceph/ceph-client.admin.184902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144332.log 2023-10-03T10:23:32.017 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173367.log.gz 2023-10-03T10:23:32.018 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.184902.log.gz 2023-10-03T10:23:32.018 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192897.log 2023-10-03T10:23:32.018 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190399.log.gz 2023-10-03T10:23:32.018 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-03T10:23:32.018 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144332.log: /var/log/ceph/ceph-client.admin.192897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148941.log 2023-10-03T10:23:32.018 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144332.log.gz 2023-10-03T10:23:32.018 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192897.log.gz 2023-10-03T10:23:32.019 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154241.log 2023-10-03T10:23:32.019 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166350.log 2023-10-03T10:23:32.019 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148941.log: /var/log/ceph/ceph-client.admin.154241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139940.log 2023-10-03T10:23:32.019 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148941.log.gz 2023-10-03T10:23:32.019 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154241.log.gz 2023-10-03T10:23:32.019 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129007.log 2023-10-03T10:23:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150117.log 2023-10-03T10:23:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139940.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.166350.log.gz 2023-10-03T10:23:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.129007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148060.log 2023-10-03T10:23:32.020 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139940.log.gz 2023-10-03T10:23:32.020 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129007.log.gz 2023-10-03T10:23:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144922.log 2023-10-03T10:23:32.020 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123302.log 2023-10-03T10:23:32.021 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148060.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.150117.log.gz 2023-10-03T10:23:32.021 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162579.log 2023-10-03T10:23:32.021 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148060.log.gz 2023-10-03T10:23:32.021 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148839.log 2023-10-03T10:23:32.021 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.144922.log.gz 2023-10-03T10:23:32.021 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162579.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123302.log.gz 2023-10-03T10:23:32.022 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158406.log 2023-10-03T10:23:32.022 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162579.log.gz 2023-10-03T10:23:32.022 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168114.log 2023-10-03T10:23:32.022 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.148839.log.gz 2023-10-03T10:23:32.022 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189980.log 2023-10-03T10:23:32.022 INFO:teuthology.orchestra.run.smithi072.stderr:gzip /var/log/ceph/ceph-client.admin.168114.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.172659.log 2023-10-03T10:23:32.022 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158406.log.gz 2023-10-03T10:23:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189980.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.168114.log.gz 2023-10-03T10:23:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172659.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189980.log.gz 2023-10-03T10:23:32.023 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172659.log.gz 2023-10-03T10:23:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167356.log 2023-10-03T10:23:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184654.log 2023-10-03T10:23:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181143.log 2023-10-03T10:23:32.023 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167356.log.gz 2023-10-03T10:23:32.023 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122361.log 2023-10-03T10:23:32.024 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184654.log.gz 2023-10-03T10:23:32.024 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193093.log 2023-10-03T10:23:32.024 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122361.log: gzip -5 --verbose 87.9%-- /var/log/ceph/ceph-client.admin.177581.log -- replaced with /var/log/ceph/ceph-client.admin.181143.log.gz 2023-10-03T10:23:32.024 INFO:teuthology.orchestra.run.smithi072.stderr: 2023-10-03T10:23:32.024 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122361.log.gz 2023-10-03T10:23:32.024 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163902.log 2023-10-03T10:23:32.024 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191233.log 2023-10-03T10:23:32.024 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.193093.log.gz/var/log/ceph/ceph-client.admin.177581.log: 2023-10-03T10:23:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163167.log 2023-10-03T10:23:32.025 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177581.log.gz 2023-10-03T10:23:32.025 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.163902.log.gz 2023-10-03T10:23:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158871.log 2023-10-03T10:23:32.025 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.191233.log.gz 2023-10-03T10:23:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137367.log 2023-10-03T10:23:32.025 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163167.log: /var/log/ceph/ceph-client.admin.158871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167283.log 2023-10-03T10:23:32.025 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163167.log.gz 2023-10-03T10:23:32.026 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.158871.log.gz 2023-10-03T10:23:32.026 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154486.log 2023-10-03T10:23:32.026 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167283.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137367.log.gz 2023-10-03T10:23:32.026 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151977.log 2023-10-03T10:23:32.026 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167283.log.gz 2023-10-03T10:23:32.026 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154486.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-03T10:23:32.027 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153945.log 2023-10-03T10:23:32.027 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154486.log.gz 2023-10-03T10:23:32.027 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151977.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153971.log 2023-10-03T10:23:32.027 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151977.log.gz 2023-10-03T10:23:32.027 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166499.log 2023-10-03T10:23:32.027 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153971.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.153945.log.gz 2023-10-03T10:23:32.027 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.153971.log.gz 2023-10-03T10:23:32.028 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166499.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166499.log.gz 2023-10-03T10:23:32.028 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180359.log 2023-10-03T10:23:32.028 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167622.log 2023-10-03T10:23:32.028 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148204.log 2023-10-03T10:23:32.028 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.180359.log.gz 2023-10-03T10:23:32.028 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135080.log 2023-10-03T10:23:32.028 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148204.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.167622.log.gz 2023-10-03T10:23:32.029 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172975.log 2023-10-03T10:23:32.029 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135080.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.148204.log.gz 2023-10-03T10:23:32.029 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127889.log 2023-10-03T10:23:32.029 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135080.log.gz 2023-10-03T10:23:32.029 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170076.log 2023-10-03T10:23:32.029 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155221.log 2023-10-03T10:23:32.029 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172975.log.gz 2023-10-03T10:23:32.029 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170076.log: 87.9%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.127889.log.gz--verbose 2023-10-03T10:23:32.030 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.125482.log 2023-10-03T10:23:32.030 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170076.log.gz 2023-10-03T10:23:32.030 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155221.log: /var/log/ceph/ceph-client.admin.125482.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155221.log.gz 2023-10-03T10:23:32.030 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.125482.log.gz 2023-10-03T10:23:32.030 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154633.log 2023-10-03T10:23:32.030 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186810.log 2023-10-03T10:23:32.031 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137981.log 2023-10-03T10:23:32.031 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162971.log 2023-10-03T10:23:32.031 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.154633.log.gz 2023-10-03T10:23:32.031 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184118.log 2023-10-03T10:23:32.031 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.186810.log.gz 2023-10-03T10:23:32.031 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162971.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.137981.log.gz 2023-10-03T10:23:32.031 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162971.log.gz 2023-10-03T10:23:32.031 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184118.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184118.log.gz 2023-10-03T10:23:32.032 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138859.log 2023-10-03T10:23:32.032 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140895.log 2023-10-03T10:23:32.032 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137223.log 2023-10-03T10:23:32.032 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140895.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138859.log.gz 2023-10-03T10:23:32.032 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137223.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140895.log.gz 2023-10-03T10:23:32.032 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137223.log.gz 2023-10-03T10:23:32.032 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189811.log 2023-10-03T10:23:32.033 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183282.log 2023-10-03T10:23:32.033 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123939.log 2023-10-03T10:23:32.033 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183282.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.189811.log.gz 2023-10-03T10:23:32.033 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123939.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.183282.log.gz 2023-10-03T10:23:32.033 INFO:teuthology.orchestra.run.smithi072.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.123939.log.gz 2023-10-03T10:23:32.033 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158553.log 2023-10-03T10:23:32.033 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142170.log 2023-10-03T10:23:32.034 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158553.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158553.log.gz 2023-10-03T10:23:32.034 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142170.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142170.log.gz 2023-10-03T10:23:32.034 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124625.log 2023-10-03T10:23:32.034 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128762.log 2023-10-03T10:23:32.034 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192213.log 2023-10-03T10:23:32.034 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0%/var/log/ceph/ceph-client.admin.128762.log: -- replaced with /var/log/ceph/ceph-client.admin.124625.log.gz 2023-10-03T10:23:32.034 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168533.log 2023-10-03T10:23:32.035 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142558.log 2023-10-03T10:23:32.035 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128762.log.gz 2023-10-03T10:23:32.035 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168533.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.192213.log.gz 2023-10-03T10:23:32.035 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182744.log 2023-10-03T10:23:32.035 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168533.log.gz 2023-10-03T10:23:32.035 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173249.log 2023-10-03T10:23:32.035 INFO:teuthology.orchestra.run.smithi072.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.142558.log.gz 2023-10-03T10:23:32.035 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185712.log 2023-10-03T10:23:32.036 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173249.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182744.log.gz 2023-10-03T10:23:32.036 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192356.log 2023-10-03T10:23:32.036 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173249.log.gz 2023-10-03T10:23:32.036 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185712.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.185712.log.gz/var/log/ceph/ceph-client.admin.192356.log: 2023-10-03T10:23:32.036 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192356.log.gz 2023-10-03T10:23:32.036 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151340.log 2023-10-03T10:23:32.036 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127220.log 2023-10-03T10:23:32.037 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135669.log 2023-10-03T10:23:32.037 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151340.log.gz 2023-10-03T10:23:32.037 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127220.log: /var/log/ceph/ceph-client.admin.135669.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127220.log.gz 2023-10-03T10:23:32.037 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135669.log.gz 2023-10-03T10:23:32.037 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152518.log 2023-10-03T10:23:32.037 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180921.log 2023-10-03T10:23:32.037 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149800.log 2023-10-03T10:23:32.037 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180921.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.152518.log.gz 2023-10-03T10:23:32.038 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149800.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.180921.log.gz 2023-10-03T10:23:32.038 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149800.log.gz 2023-10-03T10:23:32.038 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138205.log 2023-10-03T10:23:32.038 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150191.log 2023-10-03T10:23:32.038 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188974.log 2023-10-03T10:23:32.038 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138205.log.gz 2023-10-03T10:23:32.038 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168067.log 2023-10-03T10:23:32.039 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162998.log 2023-10-03T10:23:32.039 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188974.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150191.log.gz 2023-10-03T10:23:32.039 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193926.log 2023-10-03T10:23:32.039 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.188974.log.gz 2023-10-03T10:23:32.148 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168067.log.gz 2023-10-03T10:23:32.148 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194318.log 2023-10-03T10:23:32.148 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.162998.log.gz 2023-10-03T10:23:32.148 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176944.log 2023-10-03T10:23:32.148 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.193926.log.gz 2023-10-03T10:23:32.148 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129056.log 2023-10-03T10:23:32.149 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143639.log 2023-10-03T10:23:32.149 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176944.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.194318.log.gz 2023-10-03T10:23:32.149 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.129056.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176944.log.gz 2023-10-03T10:23:32.149 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127019.log 2023-10-03T10:23:32.149 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143639.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129056.log.gz 2023-10-03T10:23:32.149 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154141.log 2023-10-03T10:23:32.149 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143639.log.gz 2023-10-03T10:23:32.149 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127019.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127019.log.gz 2023-10-03T10:23:32.150 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154141.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.154141.log.gz 2023-10-03T10:23:32.150 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179941.log 2023-10-03T10:23:32.150 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148596.log 2023-10-03T10:23:32.150 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152003.log 2023-10-03T10:23:32.150 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179941.log.gz 2023-10-03T10:23:32.150 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192160.log 2023-10-03T10:23:32.151 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152003.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148596.log.gz 2023-10-03T10:23:32.151 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192160.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152003.log.gz 2023-10-03T10:23:32.151 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192160.log.gz 2023-10-03T10:23:32.151 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138151.log 2023-10-03T10:23:32.151 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187032.log 2023-10-03T10:23:32.151 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143103.log 2023-10-03T10:23:32.151 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138151.log.gz 2023-10-03T10:23:32.151 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140699.log 2023-10-03T10:23:32.152 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127629.log 2023-10-03T10:23:32.152 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143103.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.187032.log.gz 2023-10-03T10:23:32.152 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164782.log 2023-10-03T10:23:32.152 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.143103.log.gz 2023-10-03T10:23:32.152 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140699.log.gz 2023-10-03T10:23:32.152 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180555.log 2023-10-03T10:23:32.152 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127629.log.gz 2023-10-03T10:23:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164782.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164782.log.gz 2023-10-03T10:23:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180555.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180555.log.gz 2023-10-03T10:23:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170745.log 2023-10-03T10:23:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145411.log 2023-10-03T10:23:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174469.log 2023-10-03T10:23:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145411.log: 87.8%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.170745.log.gz--verbose 2023-10-03T10:23:32.153 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.183579.log 2023-10-03T10:23:32.154 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145411.log.gz 2023-10-03T10:23:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174469.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.174469.log.gz 2023-10-03T10:23:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183579.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.183579.log.gz 2023-10-03T10:23:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143737.log 2023-10-03T10:23:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146098.log 2023-10-03T10:23:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152395.log 2023-10-03T10:23:32.154 INFO:teuthology.orchestra.run.smithi072.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.143737.log.gz 2023-10-03T10:23:32.154 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180974.log 2023-10-03T10:23:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152395.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.146098.log.gz 2023-10-03T10:23:32.155 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152395.log.gz 2023-10-03T10:23:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180974.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.180974.log.gz 2023-10-03T10:23:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165127.log 2023-10-03T10:23:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144235.log 2023-10-03T10:23:32.155 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122553.log 2023-10-03T10:23:32.155 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165127.log.gz 2023-10-03T10:23:32.156 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169635.log 2023-10-03T10:23:32.156 INFO:teuthology.orchestra.run.smithi072.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.144235.log.gz/var/log/ceph/ceph-client.admin.122553.log: 2023-10-03T10:23:32.156 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173881.log 2023-10-03T10:23:32.156 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122553.log.gz 2023-10-03T10:23:32.156 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128615.log 2023-10-03T10:23:32.156 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172705.log 2023-10-03T10:23:32.156 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169635.log.gz 2023-10-03T10:23:32.157 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173881.log: /var/log/ceph/ceph-client.admin.128615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177608.log 2023-10-03T10:23:32.157 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173881.log.gz 2023-10-03T10:23:32.157 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172705.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.128615.log.gz 2023-10-03T10:23:32.157 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148988.log 2023-10-03T10:23:32.157 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172705.log.gz 2023-10-03T10:23:32.157 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181460.log 2023-10-03T10:23:32.157 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177608.log.gz 2023-10-03T10:23:32.157 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193757.log 2023-10-03T10:23:32.158 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148988.log.gz 2023-10-03T10:23:32.158 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181460.log: /var/log/ceph/ceph-client.admin.193757.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.181460.log.gz 2023-10-03T10:23:32.158 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.193757.log.gz 2023-10-03T10:23:32.158 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195072.log 2023-10-03T10:23:32.158 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168506.log 2023-10-03T10:23:32.158 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150948.log 2023-10-03T10:23:32.158 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195072.log: /var/log/ceph/ceph-client.admin.168506.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.195072.log.gz 2023-10-03T10:23:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150948.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.168506.log.gz 2023-10-03T10:23:32.159 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150948.log.gz 2023-10-03T10:23:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144526.log 2023-10-03T10:23:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190765.log 2023-10-03T10:23:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151415.log 2023-10-03T10:23:32.159 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144526.log.gz 2023-10-03T10:23:32.159 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186222.log 2023-10-03T10:23:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153506.log 2023-10-03T10:23:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151415.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.190765.log.gz 2023-10-03T10:23:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125286.log 2023-10-03T10:23:32.160 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151415.log.gz 2023-10-03T10:23:32.160 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186222.log.gz 2023-10-03T10:23:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143469.log 2023-10-03T10:23:32.160 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125286.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.153506.log.gz 2023-10-03T10:23:32.161 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125286.log.gz 2023-10-03T10:23:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143469.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143469.log.gz 2023-10-03T10:23:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143325.log 2023-10-03T10:23:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122749.log 2023-10-03T10:23:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193681.log 2023-10-03T10:23:32.161 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143325.log.gz 2023-10-03T10:23:32.161 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124380.log 2023-10-03T10:23:32.162 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193681.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122749.log.gz 2023-10-03T10:23:32.162 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.193681.log.gz 2023-10-03T10:23:32.162 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124380.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.124380.log.gz 2023-10-03T10:23:32.162 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184313.log 2023-10-03T10:23:32.162 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150360.log 2023-10-03T10:23:32.162 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152546.log 2023-10-03T10:23:32.162 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.184313.log.gz 2023-10-03T10:23:32.163 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163363.log 2023-10-03T10:23:32.163 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.150360.log.gz 2023-10-03T10:23:32.163 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152918.log 2023-10-03T10:23:32.163 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144898.log 88.4% 2023-10-03T10:23:32.163 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.152546.log.gz 2023-10-03T10:23:32.163 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163363.log: /var/log/ceph/ceph-client.admin.152918.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.163363.log.gz 2023-10-03T10:23:32.163 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152918.log.gz 2023-10-03T10:23:32.163 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144898.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.144898.log.gz 2023-10-03T10:23:32.164 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140307.log 2023-10-03T10:23:32.164 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151396.log 2023-10-03T10:23:32.164 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138987.log 2023-10-03T10:23:32.164 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0%/var/log/ceph/ceph-client.admin.151396.log: -- replaced with /var/log/ceph/ceph-client.admin.140307.log.gz 2023-10-03T10:23:32.164 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162869.log 2023-10-03T10:23:32.164 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9%/var/log/ceph/ceph-client.admin.138987.log: -- replaced with /var/log/ceph/ceph-client.admin.151396.log.gz 2023-10-03T10:23:32.164 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138250.log 2023-10-03T10:23:32.165 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162869.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138987.log.gz 2023-10-03T10:23:32.165 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.162869.log.gz 2023-10-03T10:23:32.165 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138250.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.138250.log.gz 2023-10-03T10:23:32.165 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139769.log 2023-10-03T10:23:32.165 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144530.log 2023-10-03T10:23:32.165 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118547.log 2023-10-03T10:23:32.165 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144530.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139769.log.gz 2023-10-03T10:23:32.165 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125580.log 2023-10-03T10:23:32.166 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144530.log.gz 2023-10-03T10:23:32.166 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118547.log: /var/log/ceph/ceph-client.admin.125580.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118547.log.gz 2023-10-03T10:23:32.166 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125580.log.gz 2023-10-03T10:23:32.166 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140163.log 2023-10-03T10:23:32.166 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148034.log 2023-10-03T10:23:32.166 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156250.log 2023-10-03T10:23:32.166 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140163.log.gz 2023-10-03T10:23:32.167 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182718.log 2023-10-03T10:23:32.167 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156250.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148034.log.gz 2023-10-03T10:23:32.167 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153357.log 2023-10-03T10:23:32.167 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156250.log.gz 2023-10-03T10:23:32.167 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182718.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.182718.log.gz 2023-10-03T10:23:32.167 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153357.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.153357.log.gz 2023-10-03T10:23:32.167 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154167.log 2023-10-03T10:23:32.168 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127956.log 2023-10-03T10:23:32.168 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140947.log 2023-10-03T10:23:32.168 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127956.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.154167.log.gz 2023-10-03T10:23:32.168 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127956.log.gz 2023-10-03T10:23:32.168 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140947.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140947.log.gz 2023-10-03T10:23:32.168 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128860.log 2023-10-03T10:23:32.168 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141705.log 2023-10-03T10:23:32.169 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193215.log 2023-10-03T10:23:32.169 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.128860.log.gz 2023-10-03T10:23:32.169 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157499.log 2023-10-03T10:23:32.169 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141705.log.gz 2023-10-03T10:23:32.169 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167230.log 2023-10-03T10:23:32.169 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157499.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193215.log.gz 2023-10-03T10:23:32.169 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157499.log.gz 2023-10-03T10:23:32.169 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167230.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167230.log.gz 2023-10-03T10:23:32.170 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171211.log 2023-10-03T10:23:32.170 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123055.log 2023-10-03T10:23:32.170 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153749.log 2023-10-03T10:23:32.170 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171211.log.gz 2023-10-03T10:23:32.170 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169684.log 2023-10-03T10:23:32.170 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123055.log.gz 2023-10-03T10:23:32.170 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185046.log 2023-10-03T10:23:32.171 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169684.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153749.log.gz 2023-10-03T10:23:32.171 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170819.log 2023-10-03T10:23:32.171 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185046.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169684.log.gz 2023-10-03T10:23:32.171 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185046.log.gz 2023-10-03T10:23:32.171 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170819.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170819.log.gz 2023-10-03T10:23:32.171 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165396.log 2023-10-03T10:23:32.171 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153653.log 2023-10-03T10:23:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135671.log 2023-10-03T10:23:32.172 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165396.log.gz 2023-10-03T10:23:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153653.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153653.log.gz 2023-10-03T10:23:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135671.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.135671.log.gz 2023-10-03T10:23:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149968.log 2023-10-03T10:23:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125727.log 2023-10-03T10:23:32.172 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156446.log 2023-10-03T10:23:32.173 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149968.log.gz/var/log/ceph/ceph-client.admin.125727.log: 2023-10-03T10:23:32.173 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125727.log.gz 2023-10-03T10:23:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156446.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156446.log.gz 2023-10-03T10:23:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156493.log 2023-10-03T10:23:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152944.log 2023-10-03T10:23:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153310.log 2023-10-03T10:23:32.173 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156493.log.gz 2023-10-03T10:23:32.173 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152944.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.152944.log.gz 2023-10-03T10:23:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153310.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.153310.log.gz 2023-10-03T10:23:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172117.log 2023-10-03T10:23:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170280.log 2023-10-03T10:23:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161295.log 2023-10-03T10:23:32.174 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170280.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172117.log.gz 2023-10-03T10:23:32.174 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170280.log.gz 2023-10-03T10:23:32.175 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147471.log 2023-10-03T10:23:32.175 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161295.log.gz 2023-10-03T10:23:32.175 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137785.log 2023-10-03T10:23:32.175 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158014.log 2023-10-03T10:23:32.175 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147471.log.gz 2023-10-03T10:23:32.175 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176795.log 2023-10-03T10:23:32.175 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158014.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137785.log.gz 2023-10-03T10:23:32.175 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158014.log.gz 2023-10-03T10:23:32.176 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176795.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.176795.log.gz 2023-10-03T10:23:32.176 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185634.log 2023-10-03T10:23:32.176 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168655.log 2023-10-03T10:23:32.176 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129154.log 2023-10-03T10:23:32.176 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.185634.log.gz 2023-10-03T10:23:32.176 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168655.log: /var/log/ceph/ceph-client.admin.129154.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.168655.log.gz 2023-10-03T10:23:32.176 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.129154.log.gz 2023-10-03T10:23:32.176 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147006.log 2023-10-03T10:23:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128664.log 2023-10-03T10:23:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128083.log 2023-10-03T10:23:32.177 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.147006.log.gz 2023-10-03T10:23:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128664.log: /var/log/ceph/ceph-client.admin.128083.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.128664.log.gz 2023-10-03T10:23:32.177 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128083.log.gz 2023-10-03T10:23:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165762.log 2023-10-03T10:23:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152740.log 2023-10-03T10:23:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157277.log 2023-10-03T10:23:32.178 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.165762.log.gz 2023-10-03T10:23:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160807.log 2023-10-03T10:23:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157277.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.152740.log.gz 2023-10-03T10:23:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128403.log 2023-10-03T10:23:32.178 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157277.log.gz 2023-10-03T10:23:32.178 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160807.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.160807.log.gz 2023-10-03T10:23:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152349.log 2023-10-03T10:23:32.179 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128403.log.gz 2023-10-03T10:23:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156789.log 2023-10-03T10:23:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152349.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.152349.log.gz 2023-10-03T10:23:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139860.log 2023-10-03T10:23:32.179 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.156789.log.gz 2023-10-03T10:23:32.179 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191768.log 2023-10-03T10:23:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185516.log 2023-10-03T10:23:32.180 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139860.log.gz 2023-10-03T10:23:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149184.log 2023-10-03T10:23:32.180 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.191768.log.gz 2023-10-03T10:23:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185516.log: /var/log/ceph/ceph-client.admin.149184.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185516.log.gz 2023-10-03T10:23:32.180 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.149184.log.gz 2023-10-03T10:23:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182047.log 2023-10-03T10:23:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170149.log 2023-10-03T10:23:32.181 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176674.log 2023-10-03T10:23:32.181 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.182047.log.gz 2023-10-03T10:23:32.181 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144653.log 2023-10-03T10:23:32.181 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139967.log 2023-10-03T10:23:32.181 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2%/var/log/ceph/ceph-client.admin.176674.log: -- replaced with /var/log/ceph/ceph-client.admin.170149.log.gz 2023-10-03T10:23:32.181 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161599.log 2023-10-03T10:23:32.181 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176674.log.gz 2023-10-03T10:23:32.181 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.144653.log.gz 2023-10-03T10:23:32.182 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139131.log 2023-10-03T10:23:32.182 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161599.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.139967.log.gz 2023-10-03T10:23:32.182 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139131.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161599.log.gz 2023-10-03T10:23:32.182 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122949.log 2023-10-03T10:23:32.182 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139131.log.gz 2023-10-03T10:23:32.182 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159386.log 2023-10-03T10:23:32.182 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124331.log 2023-10-03T10:23:32.182 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122949.log: /var/log/ceph/ceph-client.admin.159386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171298.log 2023-10-03T10:23:32.183 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122949.log.gz 2023-10-03T10:23:32.183 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159386.log.gz 2023-10-03T10:23:32.183 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160833.log 2023-10-03T10:23:32.183 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171298.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124331.log.gz 2023-10-03T10:23:32.183 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172191.log 2023-10-03T10:23:32.183 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171298.log.gz 2023-10-03T10:23:32.183 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160833.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160833.log.gz 2023-10-03T10:23:32.184 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172191.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172191.log.gz 2023-10-03T10:23:32.184 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164978.log 2023-10-03T10:23:32.184 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166058.log 2023-10-03T10:23:32.184 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172876.log 2023-10-03T10:23:32.184 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155074.log 2023-10-03T10:23:32.184 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164978.log.gz 2023-10-03T10:23:32.184 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.166058.log.gz 2023-10-03T10:23:32.184 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179034.log 2023-10-03T10:23:32.185 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146687.log 2023-10-03T10:23:32.185 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155074.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172876.log.gz 2023-10-03T10:23:32.185 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172313.log 2023-10-03T10:23:32.185 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155074.log.gz 2023-10-03T10:23:32.185 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179034.log.gz/var/log/ceph/ceph-client.admin.146687.log: 2023-10-03T10:23:32.185 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146687.log.gz 2023-10-03T10:23:32.185 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168974.log 2023-10-03T10:23:32.185 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172313.log.gz 2023-10-03T10:23:32.186 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144130.log 2023-10-03T10:23:32.186 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144057.log 2023-10-03T10:23:32.186 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168974.log.gz 2023-10-03T10:23:32.186 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186836.log 2023-10-03T10:23:32.186 INFO:teuthology.orchestra.run.smithi072.stderr:gzip /var/log/ceph/ceph-client.admin.144057.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.176403.log 2023-10-03T10:23:32.186 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.144130.log.gz 2023-10-03T10:23:32.186 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186836.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144057.log.gz 2023-10-03T10:23:32.187 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186836.log.gz 2023-10-03T10:23:32.187 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176403.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.176403.log.gz 2023-10-03T10:23:32.187 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158649.log 2023-10-03T10:23:32.187 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143102.log 2023-10-03T10:23:32.187 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146295.log 2023-10-03T10:23:32.187 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143102.log: 89.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.158649.log.gz--verbose 2023-10-03T10:23:32.187 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.154878.log 2023-10-03T10:23:32.188 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160637.log 88.2% 2023-10-03T10:23:32.188 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.143102.log.gz 2023-10-03T10:23:32.188 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154878.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.146295.log.gz 2023-10-03T10:23:32.188 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160637.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.154878.log.gz 2023-10-03T10:23:32.188 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160637.log.gz 2023-10-03T10:23:32.188 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144627.log 2023-10-03T10:23:32.188 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173759.log 2023-10-03T10:23:32.189 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174151.log 2023-10-03T10:23:32.189 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.144627.log.gz 2023-10-03T10:23:32.189 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183896.log 2023-10-03T10:23:32.189 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176625.log 2023-10-03T10:23:32.189 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174151.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173759.log.gz 2023-10-03T10:23:32.189 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183896.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174151.log.gz 2023-10-03T10:23:32.189 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183896.log.gz 2023-10-03T10:23:32.190 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176625.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176625.log.gz 2023-10-03T10:23:32.190 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135876.log 2023-10-03T10:23:32.190 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135006.log 2023-10-03T10:23:32.190 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177385.log 2023-10-03T10:23:32.190 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135876.log.gz 2023-10-03T10:23:32.190 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174737.log 2023-10-03T10:23:32.190 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188682.log 2023-10-03T10:23:32.191 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.135006.log.gz 2023-10-03T10:23:32.191 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177385.log: /var/log/ceph/ceph-client.admin.174737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168702.log 2023-10-03T10:23:32.191 INFO:teuthology.orchestra.run.smithi072.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.177385.log.gz 2023-10-03T10:23:32.191 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174737.log.gz 2023-10-03T10:23:32.191 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182916.log 2023-10-03T10:23:32.191 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168702.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.188682.log.gz 2023-10-03T10:23:32.191 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182916.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.168702.log.gz 2023-10-03T10:23:32.191 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182916.log.gz 2023-10-03T10:23:32.192 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172464.log 2023-10-03T10:23:32.192 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194876.log 2023-10-03T10:23:32.192 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190204.log 2023-10-03T10:23:32.192 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172464.log.gz 2023-10-03T10:23:32.192 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193877.log 2023-10-03T10:23:32.192 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143130.log 2023-10-03T10:23:32.192 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190204.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.194876.log.gz 2023-10-03T10:23:32.192 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193877.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190204.log.gz 2023-10-03T10:23:32.193 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.193877.log.gz/var/log/ceph/ceph-client.admin.143130.log: 2023-10-03T10:23:32.193 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143130.log.gz 2023-10-03T10:23:32.193 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141679.log 2023-10-03T10:23:32.193 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155121.log 2023-10-03T10:23:32.193 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174592.log 2023-10-03T10:23:32.193 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141679.log.gz 2023-10-03T10:23:32.193 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156985.log 2023-10-03T10:23:32.193 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195023.log 2023-10-03T10:23:32.194 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.155121.log.gz 2023-10-03T10:23:32.194 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174592.log: /var/log/ceph/ceph-client.admin.156985.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174592.log.gz 2023-10-03T10:23:32.194 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.156985.log.gz/var/log/ceph/ceph-client.admin.195023.log: 2023-10-03T10:23:32.194 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.195023.log.gz 2023-10-03T10:23:32.194 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180137.log 2023-10-03T10:23:32.194 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142855.log 2023-10-03T10:23:32.194 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168263.log 2023-10-03T10:23:32.194 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180137.log.gz 2023-10-03T10:23:32.195 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157426.log 2023-10-03T10:23:32.195 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171652.log 2023-10-03T10:23:32.195 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142855.log.gz 2023-10-03T10:23:32.195 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168263.log: /var/log/ceph/ceph-client.admin.157426.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.168263.log.gz 2023-10-03T10:23:32.195 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171652.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157426.log.gz 2023-10-03T10:23:32.195 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171652.log.gz 2023-10-03T10:23:32.195 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180779.log 2023-10-03T10:23:32.195 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194974.log 2023-10-03T10:23:32.196 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162424.log 2023-10-03T10:23:32.196 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180779.log.gz 2023-10-03T10:23:32.196 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193532.log 2023-10-03T10:23:32.196 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141339.log 2023-10-03T10:23:32.196 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.194974.log.gz/var/log/ceph/ceph-client.admin.162424.log: 2023-10-03T10:23:32.196 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185293.log 2023-10-03T10:23:32.196 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162424.log.gz 2023-10-03T10:23:32.196 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.193532.log.gz 2023-10-03T10:23:32.197 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124211.log 2023-10-03T10:23:32.197 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141339.log.gz 2023-10-03T10:23:32.197 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185293.log: /var/log/ceph/ceph-client.admin.124211.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185293.log.gz 2023-10-03T10:23:32.197 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-03T10:23:32.197 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124211.log.gz 2023-10-03T10:23:32.197 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186300.log 2023-10-03T10:23:32.197 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159265.log 2023-10-03T10:23:32.197 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.186300.log: /var/log/ceph/ceph-client.admin.159265.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.186300.log.gz 2023-10-03T10:23:32.198 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159265.log.gz 2023-10-03T10:23:32.198 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147791.log 2023-10-03T10:23:32.198 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178195.log 2023-10-03T10:23:32.198 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181562.log 2023-10-03T10:23:32.198 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147791.log.gz 2023-10-03T10:23:32.198 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139771.log 2023-10-03T10:23:32.198 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178195.log.gz 2023-10-03T10:23:32.199 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181562.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.181562.log.gz 2023-10-03T10:23:32.199 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139771.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139771.log.gz 2023-10-03T10:23:32.199 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159729.log 2023-10-03T10:23:32.199 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167160.log 2023-10-03T10:23:32.199 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.159729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124527.log 2023-10-03T10:23:32.199 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159729.log.gz 2023-10-03T10:23:32.199 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167160.log: /var/log/ceph/ceph-client.admin.124527.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.167160.log.gz 2023-10-03T10:23:32.199 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124527.log.gz 2023-10-03T10:23:32.200 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173220.log 2023-10-03T10:23:32.200 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146870.log 2023-10-03T10:23:32.200 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156689.log 2023-10-03T10:23:32.200 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173220.log.gz 2023-10-03T10:23:32.200 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146870.log: /var/log/ceph/ceph-client.admin.156689.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146870.log.gz 2023-10-03T10:23:32.200 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156689.log.gz 2023-10-03T10:23:32.200 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194148.log 2023-10-03T10:23:32.200 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150164.log 2023-10-03T10:23:32.201 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146195.log 2023-10-03T10:23:32.201 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.194148.log.gz 2023-10-03T10:23:32.201 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138400.log 2023-10-03T10:23:32.201 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.150164.log.gz 2023-10-03T10:23:32.201 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146195.log: /var/log/ceph/ceph-client.admin.138400.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146195.log.gz 2023-10-03T10:23:32.201 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138400.log.gz 2023-10-03T10:23:32.201 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136046.log 2023-10-03T10:23:32.201 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123498.log 2023-10-03T10:23:32.202 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149025.log 2023-10-03T10:23:32.202 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.136046.log.gz 2023-10-03T10:23:32.202 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123498.log: /var/log/ceph/ceph-client.admin.149025.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123498.log.gz 2023-10-03T10:23:32.202 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164735.log 2023-10-03T10:23:32.202 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.149025.log.gz 2023-10-03T10:23:32.202 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135672.log 2023-10-03T10:23:32.202 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124921.log 2023-10-03T10:23:32.202 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164735.log.gz 2023-10-03T10:23:32.203 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141142.log 2023-10-03T10:23:32.203 INFO:teuthology.orchestra.run.smithi072.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.135672.log.gz 2023-10-03T10:23:32.203 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124921.log: /var/log/ceph/ceph-client.admin.141142.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124921.log.gz 2023-10-03T10:23:32.203 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141142.log.gz 2023-10-03T10:23:32.203 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180210.log 2023-10-03T10:23:32.203 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167552.log 2023-10-03T10:23:32.203 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124772.log 2023-10-03T10:23:32.203 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.180210.log.gz 2023-10-03T10:23:32.204 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167552.log: /var/log/ceph/ceph-client.admin.124772.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167552.log.gz 2023-10-03T10:23:32.204 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124772.log.gz 2023-10-03T10:23:32.204 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124576.log 2023-10-03T10:23:32.204 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145999.log 2023-10-03T10:23:32.204 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157891.log 2023-10-03T10:23:32.204 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124576.log.gz 2023-10-03T10:23:32.204 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145999.log: /var/log/ceph/ceph-client.admin.157891.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145999.log.gz 2023-10-03T10:23:32.204 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157891.log.gz 2023-10-03T10:23:32.205 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193336.log 2023-10-03T10:23:32.205 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135204.log 2023-10-03T10:23:32.205 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193336.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.193336.log.gz 2023-10-03T10:23:32.205 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135204.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135204.log.gz 2023-10-03T10:23:32.205 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174073.log 2023-10-03T10:23:32.205 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183947.log 2023-10-03T10:23:32.205 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181509.log 2023-10-03T10:23:32.205 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174073.log.gz 2023-10-03T10:23:32.206 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145019.log 2023-10-03T10:23:32.206 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.183947.log.gz 2023-10-03T10:23:32.206 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181509.log: 88.2%/var/log/ceph/ceph-client.admin.145019.log: -- replaced with /var/log/ceph/ceph-client.admin.181509.log.gz 2023-10-03T10:23:32.206 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.145019.log.gz 2023-10-03T10:23:32.206 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165862.log 2023-10-03T10:23:32.206 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190251.log 2023-10-03T10:23:32.206 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170353.log 2023-10-03T10:23:32.206 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165862.log.gz 2023-10-03T10:23:32.207 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185882.log 2023-10-03T10:23:32.207 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.190251.log.gz 2023-10-03T10:23:32.207 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192774.log 2023-10-03T10:23:32.207 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.170353.log.gz 2023-10-03T10:23:32.207 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185882.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185882.log.gz 2023-10-03T10:23:32.207 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192774.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.192774.log.gz 2023-10-03T10:23:32.207 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154755.log 2023-10-03T10:23:32.207 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179230.log 2023-10-03T10:23:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154755.log: /var/log/ceph/ceph-client.admin.179230.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154755.log.gz 2023-10-03T10:23:32.208 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.179230.log.gz 2023-10-03T10:23:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151489.log 2023-10-03T10:23:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191525.log 2023-10-03T10:23:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185320.log 2023-10-03T10:23:32.208 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.151489.log.gz 2023-10-03T10:23:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153457.log 2023-10-03T10:23:32.208 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191525.log.gz 2023-10-03T10:23:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191964.log 2023-10-03T10:23:32.209 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.185320.log.gz 2023-10-03T10:23:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153457.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153457.log.gz 2023-10-03T10:23:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191964.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191964.log.gz 2023-10-03T10:23:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150386.log 2023-10-03T10:23:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187228.log 2023-10-03T10:23:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150386.log: /var/log/ceph/ceph-client.admin.187228.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150386.log.gz 2023-10-03T10:23:32.210 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.187228.log.gz 2023-10-03T10:23:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184705.log 2023-10-03T10:23:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145215.log 2023-10-03T10:23:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151781.log 2023-10-03T10:23:32.210 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.184705.log.gz 2023-10-03T10:23:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145215.log: /var/log/ceph/ceph-client.admin.151781.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.145215.log.gz 2023-10-03T10:23:32.210 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.151781.log.gz 2023-10-03T10:23:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174639.log 2023-10-03T10:23:32.211 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144823.log 2023-10-03T10:23:32.211 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154363.log 2023-10-03T10:23:32.211 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174639.log.gz 2023-10-03T10:23:32.211 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144823.log: /var/log/ceph/ceph-client.admin.154363.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.144823.log.gz 2023-10-03T10:23:32.211 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154363.log.gz 2023-10-03T10:23:32.211 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194925.log 2023-10-03T10:23:32.211 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177066.log 2023-10-03T10:23:32.211 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165004.log 2023-10-03T10:23:32.212 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.194925.log.gz 2023-10-03T10:23:32.212 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177066.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177066.log.gz 2023-10-03T10:23:32.212 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165004.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165004.log.gz 2023-10-03T10:23:32.212 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190346.log 2023-10-03T10:23:32.212 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159778.log 2023-10-03T10:23:32.212 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190346.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.190346.log.gz 2023-10-03T10:23:32.212 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.159778.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.159778.log.gz 2023-10-03T10:23:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187602.log 2023-10-03T10:23:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184092.log 2023-10-03T10:23:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187602.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.187602.log.gz 2023-10-03T10:23:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184092.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184092.log.gz 2023-10-03T10:23:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189269.log 2023-10-03T10:23:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139208.log 2023-10-03T10:23:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189269.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189269.log.gz 2023-10-03T10:23:32.213 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139208.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139208.log.gz 2023-10-03T10:23:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177411.log 2023-10-03T10:23:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169170.log 2023-10-03T10:23:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177411.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177411.log.gz 2023-10-03T10:23:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169170.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169170.log.gz 2023-10-03T10:23:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191206.log 2023-10-03T10:23:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193411.log 2023-10-03T10:23:32.214 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191206.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191206.log.gz 2023-10-03T10:23:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193411.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.193411.log.gz 2023-10-03T10:23:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128057.log 2023-10-03T10:23:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135301.log 2023-10-03T10:23:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128057.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128057.log.gz 2023-10-03T10:23:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135301.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.135301.log.gz 2023-10-03T10:23:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195121.log 2023-10-03T10:23:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194195.log 2023-10-03T10:23:32.215 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195121.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.195121.log.gz 2023-10-03T10:23:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194195.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.194195.log.gz 2023-10-03T10:23:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166572.log 2023-10-03T10:23:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135994.log 2023-10-03T10:23:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166572.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166572.log.gz 2023-10-03T10:23:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135994.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135994.log.gz 2023-10-03T10:23:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152991.log 2023-10-03T10:23:32.216 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183086.log 2023-10-03T10:23:32.217 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152991.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152991.log.gz 2023-10-03T10:23:32.217 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183086.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183086.log.gz 2023-10-03T10:23:32.217 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122700.log 2023-10-03T10:23:32.217 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167426.log 2023-10-03T10:23:32.217 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122700.log: /var/log/ceph/ceph-client.admin.167426.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122700.log.gz 2023-10-03T10:23:32.217 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.167426.log.gz 2023-10-03T10:23:32.217 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147453.log 2023-10-03T10:23:32.217 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181264.log 2023-10-03T10:23:32.218 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147453.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147453.log.gz 2023-10-03T10:23:32.218 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181264.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.181264.log.gz 2023-10-03T10:23:32.218 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169535.log 2023-10-03T10:23:32.218 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147668.log 2023-10-03T10:23:32.218 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163314.log 2023-10-03T10:23:32.218 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4%/var/log/ceph/ceph-client.admin.147668.log: -- replaced with /var/log/ceph/ceph-client.admin.169535.log.gz 2023-10-03T10:23:32.218 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.147668.log.gz 2023-10-03T10:23:32.219 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163314.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163314.log.gz 2023-10-03T10:23:32.219 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179157.log 2023-10-03T10:23:32.219 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155905.log 2023-10-03T10:23:32.219 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179157.log: /var/log/ceph/ceph-client.admin.155905.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179157.log.gz 2023-10-03T10:23:32.219 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155905.log.gz 2023-10-03T10:23:32.219 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176356.log 2023-10-03T10:23:32.219 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164343.log 2023-10-03T10:23:32.220 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162775.log 2023-10-03T10:23:32.220 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176356.log.gz 2023-10-03T10:23:32.220 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164343.log: /var/log/ceph/ceph-client.admin.162775.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164343.log.gz 2023-10-03T10:23:32.220 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.162775.log.gz 2023-10-03T10:23:32.220 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146221.log 2023-10-03T10:23:32.220 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151732.log 2023-10-03T10:23:32.220 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185908.log 2023-10-03T10:23:32.220 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146221.log.gz 2023-10-03T10:23:32.221 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151732.log: 90.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-03T10:23:32.221 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185908.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151732.log.gz 2023-10-03T10:23:32.221 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185908.log.gz 2023-10-03T10:23:32.221 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147373.log 2023-10-03T10:23:32.221 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139352.log 2023-10-03T10:23:32.221 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164194.log 2023-10-03T10:23:32.221 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147373.log.gz 2023-10-03T10:23:32.222 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139352.log: /var/log/ceph/ceph-client.admin.164194.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139352.log.gz 2023-10-03T10:23:32.222 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168335.log 2023-10-03T10:23:32.222 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164194.log.gz 2023-10-03T10:23:32.222 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164294.log 2023-10-03T10:23:32.222 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174665.log 2023-10-03T10:23:32.222 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168335.log.gz 2023-10-03T10:23:32.222 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164294.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164294.log.gz 2023-10-03T10:23:32.223 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174665.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.174665.log.gz 2023-10-03T10:23:32.223 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125335.log 2023-10-03T10:23:32.223 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168014.log 2023-10-03T10:23:32.223 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162383.log 2023-10-03T10:23:32.223 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168014.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125335.log.gz 2023-10-03T10:23:32.223 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.168014.log.gz 2023-10-03T10:23:32.223 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144726.log 2023-10-03T10:23:32.223 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162383.log.gz 2023-10-03T10:23:32.224 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137955.log 2023-10-03T10:23:32.224 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148157.log 2023-10-03T10:23:32.224 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144726.log.gz 2023-10-03T10:23:32.224 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137955.log: /var/log/ceph/ceph-client.admin.148157.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.137955.log.gz 2023-10-03T10:23:32.224 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148157.log.gz 2023-10-03T10:23:32.224 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165911.log 2023-10-03T10:23:32.224 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141483.log 2023-10-03T10:23:32.225 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161421.log 2023-10-03T10:23:32.225 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165911.log.gz 2023-10-03T10:23:32.225 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123596.log 2023-10-03T10:23:32.225 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145633.log 2023-10-03T10:23:32.225 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141483.log.gz 2023-10-03T10:23:32.225 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123596.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161421.log.gz 2023-10-03T10:23:32.225 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167034.log 2023-10-03T10:23:32.225 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123596.log.gz 2023-10-03T10:23:32.226 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145633.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145633.log.gz 2023-10-03T10:23:32.226 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167034.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.167034.log.gz 2023-10-03T10:23:32.226 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165174.log 2023-10-03T10:23:32.226 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183870.log 2023-10-03T10:23:32.226 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175376.log 2023-10-03T10:23:32.226 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165174.log.gz 2023-10-03T10:23:32.226 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183870.log: /var/log/ceph/ceph-client.admin.175376.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.183870.log.gz 2023-10-03T10:23:32.227 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.175376.log.gz 2023-10-03T10:23:32.227 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140333.log 2023-10-03T10:23:32.227 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150313.log 2023-10-03T10:23:32.227 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169291.log 2023-10-03T10:23:32.227 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140333.log.gz 2023-10-03T10:23:32.227 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195170.log 2023-10-03T10:23:32.227 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167087.log 2023-10-03T10:23:32.229 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.150313.log.gz 2023-10-03T10:23:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195170.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169291.log.gz 2023-10-03T10:23:32.229 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.195170.log.gz 2023-10-03T10:23:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167087.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.167087.log.gz 2023-10-03T10:23:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164098.log 2023-10-03T10:23:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186078.log 2023-10-03T10:23:32.229 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127960.log 2023-10-03T10:23:32.230 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.164098.log.gz 2023-10-03T10:23:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186078.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.186078.log.gz 2023-10-03T10:23:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127960.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.127960.log.gz 2023-10-03T10:23:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118158.log 2023-10-03T10:23:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175057.log 2023-10-03T10:23:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181927.log 2023-10-03T10:23:32.230 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145898.log 2023-10-03T10:23:32.230 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.118158.log.gz 2023-10-03T10:23:32.231 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141904.log 2023-10-03T10:23:32.231 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175057.log.gz 2023-10-03T10:23:32.231 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145898.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.181927.log.gz 2023-10-03T10:23:32.231 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141904.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145898.log.gz 2023-10-03T10:23:32.231 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141904.log.gz 2023-10-03T10:23:32.231 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175227.log 2023-10-03T10:23:32.231 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170145.log 2023-10-03T10:23:32.232 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139157.log 2023-10-03T10:23:32.232 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175227.log.gz 2023-10-03T10:23:32.232 INFO:teuthology.orchestra.run.smithi072.stderr:gzip /var/log/ceph/ceph-client.admin.170145.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.161795.log 2023-10-03T10:23:32.232 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123645.log 2023-10-03T10:23:32.232 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139157.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.170145.log.gz 2023-10-03T10:23:32.233 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147961.log 2023-10-03T10:23:32.233 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139157.log.gz 2023-10-03T10:23:32.233 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123645.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161795.log.gz 2023-10-03T10:23:32.233 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123645.log.gz 2023-10-03T10:23:32.233 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147961.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.147961.log.gz 2023-10-03T10:23:32.233 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179549.log 2023-10-03T10:23:32.233 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158257.log 2023-10-03T10:23:32.233 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162138.log 2023-10-03T10:23:32.234 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158257.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179549.log.gz 2023-10-03T10:23:32.234 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.158257.log.gz 2023-10-03T10:23:32.234 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152469.log 2023-10-03T10:23:32.234 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.162138.log.gz 2023-10-03T10:23:32.234 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146783.log 2023-10-03T10:23:32.234 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145292.log 2023-10-03T10:23:32.234 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152469.log.gz 2023-10-03T10:23:32.234 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162085.log 2023-10-03T10:23:32.235 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191180.log 2023-10-03T10:23:32.235 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145292.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146783.log.gz 2023-10-03T10:23:32.235 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153898.log 2023-10-03T10:23:32.235 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145292.log.gz 2023-10-03T10:23:32.235 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191180.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.162085.log.gz 2023-10-03T10:23:32.235 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180480.log 2023-10-03T10:23:32.235 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.191180.log.gz 2023-10-03T10:23:32.236 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153898.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.153898.log.gz 2023-10-03T10:23:32.236 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180480.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180480.log.gz 2023-10-03T10:23:32.236 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156101.log 2023-10-03T10:23:32.236 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182686.log 2023-10-03T10:23:32.236 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174443.log 2023-10-03T10:23:32.236 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182686.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156101.log.gz 2023-10-03T10:23:32.236 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172267.log 2023-10-03T10:23:32.236 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.182686.log.gz 2023-10-03T10:23:32.237 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140384.log 2023-10-03T10:23:32.237 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137589.log 2023-10-03T10:23:32.237 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172267.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.174443.log.gz 2023-10-03T10:23:32.237 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185515.log 2023-10-03T10:23:32.237 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172267.log.gz 2023-10-03T10:23:32.237 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137589.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140384.log.gz 2023-10-03T10:23:32.237 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.137589.log.gz 2023-10-03T10:23:32.237 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188290.log 2023-10-03T10:23:32.238 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- 87.7%/var/log/ceph/ceph-client.admin.153775.log 2023-10-03T10:23:32.238 INFO:teuthology.orchestra.run.smithi072.stderr: -- replaced with /var/log/ceph/ceph-client.admin.185515.log.gz 2023-10-03T10:23:32.238 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164490.log 2023-10-03T10:23:32.238 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188290.log.gz 2023-10-03T10:23:32.238 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153775.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.153775.log.gz 2023-10-03T10:23:32.238 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164490.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.164490.log.gz 2023-10-03T10:23:32.238 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155025.log 2023-10-03T10:23:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165984.log 2023-10-03T10:23:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124015.log 2023-10-03T10:23:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165984.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.155025.log.gz 2023-10-03T10:23:32.239 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.165984.log.gz 2023-10-03T10:23:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127346.log 2023-10-03T10:23:32.239 INFO:teuthology.orchestra.run.smithi072.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.124015.log.gz 2023-10-03T10:23:32.239 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178561.log 2023-10-03T10:23:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143522.log 2023-10-03T10:23:32.240 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127346.log.gz 2023-10-03T10:23:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181068.log 2023-10-03T10:23:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164390.log 2023-10-03T10:23:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143522.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.178561.log.gz 2023-10-03T10:23:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135327.log 2023-10-03T10:23:32.240 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.143522.log.gz 2023-10-03T10:23:32.240 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164390.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181068.log.gz 2023-10-03T10:23:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170868.log 2023-10-03T10:23:32.241 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164390.log.gz 2023-10-03T10:23:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135327.log: /var/log/ceph/ceph-client.admin.170868.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.135327.log.gz 2023-10-03T10:23:32.241 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170868.log.gz 2023-10-03T10:23:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149257.log 2023-10-03T10:23:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174247.log 2023-10-03T10:23:32.241 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149257.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-03T10:23:32.241 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149257.log.gz 2023-10-03T10:23:32.242 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174247.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174247.log.gz 2023-10-03T10:23:32.242 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123819.log 2023-10-03T10:23:32.242 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154951.log 2023-10-03T10:23:32.242 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123819.log: /var/log/ceph/ceph-client.admin.154951.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.123819.log.gz 2023-10-03T10:23:32.242 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154951.log.gz 2023-10-03T10:23:32.242 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155735.log 2023-10-03T10:23:32.242 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138373.log 2023-10-03T10:23:32.243 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142362.log 2023-10-03T10:23:32.243 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155735.log.gz 2023-10-03T10:23:32.243 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168459.log 2023-10-03T10:23:32.243 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138373.log.gz 2023-10-03T10:23:32.243 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142362.log: /var/log/ceph/ceph-client.admin.168459.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.142362.log.gz 2023-10-03T10:23:32.243 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.168459.log.gz 2023-10-03T10:23:32.243 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165566.log 2023-10-03T10:23:32.243 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190738.log 2023-10-03T10:23:32.244 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175891.log 2023-10-03T10:23:32.244 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165566.log.gz 2023-10-03T10:23:32.244 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190738.log: /var/log/ceph/ceph-client.admin.175891.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190738.log.gz 2023-10-03T10:23:32.244 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175891.log.gz 2023-10-03T10:23:32.244 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178783.log 2023-10-03T10:23:32.244 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161822.log 2023-10-03T10:23:32.244 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178783.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-03T10:23:32.244 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178783.log.gz 2023-10-03T10:23:32.245 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161822.log: /var/log/ceph/ceph-mds.a.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.161822.log.gz 2023-10-03T10:23:32.245 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162922.log 2023-10-03T10:23:32.245 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161225.log 2023-10-03T10:23:32.245 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162922.log: /var/log/ceph/ceph-client.admin.161225.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162922.log.gz 2023-10-03T10:23:32.245 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161225.log.gz 2023-10-03T10:23:32.245 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-03T10:23:32.245 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177728.log 2023-10-03T10:23:32.245 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.177728.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177728.log.gz 2023-10-03T10:23:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143835.log 2023-10-03T10:23:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143835.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143835.log.gz 2023-10-03T10:23:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137001.log 2023-10-03T10:23:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137001.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137001.log.gz 2023-10-03T10:23:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170937.log 2023-10-03T10:23:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170937.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170937.log.gz 2023-10-03T10:23:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160441.log 2023-10-03T10:23:32.246 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160441.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160441.log.gz 2023-10-03T10:23:32.247 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161346.log 2023-10-03T10:23:32.247 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161346.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161346.log.gz 2023-10-03T10:23:32.247 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118745.log 2023-10-03T10:23:32.247 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118745.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118745.log.gz 2023-10-03T10:23:32.247 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190641.log 2023-10-03T10:23:32.247 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190641.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190641.log.gz 2023-10-03T10:23:32.247 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174200.log 2023-10-03T10:23:32.248 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174200.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.174200.log.gz 2023-10-03T10:23:32.248 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178904.log 2023-10-03T10:23:32.248 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178904.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.178904.log.gz 2023-10-03T10:23:32.248 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189857.log 2023-10-03T10:23:32.248 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189857.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.189857.log.gz 2023-10-03T10:23:32.248 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160562.log 2023-10-03T10:23:32.248 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160562.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160562.log.gz 2023-10-03T10:23:32.248 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129252.log 2023-10-03T10:23:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.129252.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129252.log.gz 2023-10-03T10:23:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188412.log 2023-10-03T10:23:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188412.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188412.log.gz 2023-10-03T10:23:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153187.log 2023-10-03T10:23:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153187.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.153187.log.gz 2023-10-03T10:23:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160170.log 2023-10-03T10:23:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160170.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160170.log.gz 2023-10-03T10:23:32.249 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123253.log 2023-10-03T10:23:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123253.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.123253.log.gz 2023-10-03T10:23:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167330.log 2023-10-03T10:23:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167330.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.167330.log.gz 2023-10-03T10:23:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174984.log 2023-10-03T10:23:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174984.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.174984.log.gz 2023-10-03T10:23:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122602.log 2023-10-03T10:23:32.250 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122602.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.122602.log.gz 2023-10-03T10:23:32.251 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127757.log 2023-10-03T10:23:32.251 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127757.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127757.log.gz 2023-10-03T10:23:32.251 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175253.log 2023-10-03T10:23:32.251 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175253.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175253.log.gz 2023-10-03T10:23:32.251 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123006.log 2023-10-03T10:23:32.251 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123006.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123006.log.gz 2023-10-03T10:23:32.251 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192382.log 2023-10-03T10:23:32.251 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192382.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.192382.log.gz 2023-10-03T10:23:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177140.log 2023-10-03T10:23:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177140.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177140.log.gz 2023-10-03T10:23:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159853.log 2023-10-03T10:23:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.159853.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.159853.log.gz 2023-10-03T10:23:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142463.log 2023-10-03T10:23:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142463.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142463.log.gz 2023-10-03T10:23:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154437.log 2023-10-03T10:23:32.252 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154437.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154437.log.gz 2023-10-03T10:23:32.253 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180284.log 2023-10-03T10:23:32.253 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180284.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180284.log.gz 2023-10-03T10:23:32.253 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143273.log 2023-10-03T10:23:32.253 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143273.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143273.log.gz 2023-10-03T10:23:32.253 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171725.log 2023-10-03T10:23:32.253 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171725.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171725.log.gz 2023-10-03T10:23:32.253 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170549.log 2023-10-03T10:23:32.253 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170549.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170549.log.gz 2023-10-03T10:23:32.254 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122504.log 2023-10-03T10:23:32.254 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122504.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122504.log.gz 2023-10-03T10:23:32.254 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170027.log 2023-10-03T10:23:32.254 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170027.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.170027.log.gz 2023-10-03T10:23:32.254 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186640.log 2023-10-03T10:23:32.254 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186640.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186640.log.gz 2023-10-03T10:23:32.254 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171995.log 2023-10-03T10:23:32.254 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171995.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171995.log.gz 2023-10-03T10:23:32.255 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159237.log 2023-10-03T10:23:32.255 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.159237.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.159237.log.gz 2023-10-03T10:23:32.255 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183355.log 2023-10-03T10:23:32.255 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183355.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.183355.log.gz 2023-10-03T10:23:32.255 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137759.log 2023-10-03T10:23:32.255 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137759.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137759.log.gz 2023-10-03T10:23:32.255 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155539.log 2023-10-03T10:23:32.255 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155539.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.155539.log.gz 2023-10-03T10:23:32.256 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149137.log 2023-10-03T10:23:32.256 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149137.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149137.log.gz 2023-10-03T10:23:32.256 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172779.log 2023-10-03T10:23:32.256 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172779.log: 94.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-03T10:23:32.256 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172779.log.gz 2023-10-03T10:23:32.256 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186026.log 2023-10-03T10:23:32.256 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153065.log 2023-10-03T10:23:32.256 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186026.log: /var/log/ceph/ceph-client.admin.153065.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.186026.log.gz 2023-10-03T10:23:32.257 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153065.log.gz 2023-10-03T10:23:32.257 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152869.log 2023-10-03T10:23:32.257 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178391.log 2023-10-03T10:23:32.257 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152869.log: /var/log/ceph/ceph-client.admin.178391.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152869.log.gz 2023-10-03T10:23:32.257 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178391.log.gz 2023-10-03T10:23:32.257 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143247.log 2023-10-03T10:23:32.257 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172632.log 2023-10-03T10:23:32.257 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143247.log: /var/log/ceph/ceph-client.admin.172632.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143247.log.gz 2023-10-03T10:23:32.258 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172632.log.gz 2023-10-03T10:23:32.258 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-03T10:23:32.258 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167722.log 2023-10-03T10:23:32.258 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.167722.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167722.log.gz 2023-10-03T10:23:32.258 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164539.log 2023-10-03T10:23:32.258 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164539.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164539.log.gz 2023-10-03T10:23:32.258 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142128.log 2023-10-03T10:23:32.258 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142128.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142128.log.gz 2023-10-03T10:23:32.259 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171456.log 2023-10-03T10:23:32.259 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171456.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171456.log.gz 2023-10-03T10:23:32.259 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191917.log 2023-10-03T10:23:32.259 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185125.log 2023-10-03T10:23:32.259 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191917.log: /var/log/ceph/ceph-client.admin.185125.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191917.log.gz 2023-10-03T10:23:32.259 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185125.log.gz 2023-10-03T10:23:32.259 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139604.log 2023-10-03T10:23:32.260 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139604.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139604.log.gz 2023-10-03T10:23:32.260 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179892.log 2023-10-03T10:23:32.260 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179892.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.179892.log.gz 2023-10-03T10:23:32.260 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164808.log 2023-10-03T10:23:32.260 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164808.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164808.log.gz 2023-10-03T10:23:32.260 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176870.log 2023-10-03T10:23:32.260 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176870.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176870.log.gz 2023-10-03T10:23:32.260 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146417.log 2023-10-03T10:23:32.261 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146417.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146417.log.gz 2023-10-03T10:23:32.261 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150752.log 2023-10-03T10:23:32.261 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150752.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150752.log.gz 2023-10-03T10:23:32.261 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124017.log 2023-10-03T10:23:32.261 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124017.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124017.log.gz 2023-10-03T10:23:32.261 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191133.log 2023-10-03T10:23:32.261 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191133.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.191133.log.gz 2023-10-03T10:23:32.261 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138961.log 2023-10-03T10:23:32.261 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138961.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.138961.log.gz 2023-10-03T10:23:32.262 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192944.log 2023-10-03T10:23:32.262 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173612.log 2023-10-03T10:23:32.262 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192944.log: /var/log/ceph/ceph-client.admin.173612.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.192944.log.gz 2023-10-03T10:23:32.262 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173612.log.gz 2023-10-03T10:23:32.262 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173808.log 2023-10-03T10:23:32.262 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173808.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173808.log.gz 2023-10-03T10:23:32.262 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183700.log 2023-10-03T10:23:32.263 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183700.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.183700.log.gz 2023-10-03T10:23:32.263 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127190.log 2023-10-03T10:23:32.263 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127190.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.127190.log.gz 2023-10-03T10:23:32.263 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184314.log 2023-10-03T10:23:32.263 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184314.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.184314.log.gz 2023-10-03T10:23:32.263 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192748.log 2023-10-03T10:23:32.263 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192748.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.192748.log.gz 2023-10-03T10:23:32.263 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187824.log 2023-10-03T10:23:32.264 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187824.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.187824.log.gz 2023-10-03T10:23:32.264 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136634.log 2023-10-03T10:23:32.264 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136634.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136634.log.gz 2023-10-03T10:23:32.264 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135351.log 2023-10-03T10:23:32.264 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135351.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135351.log.gz 2023-10-03T10:23:32.264 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183478.log 2023-10-03T10:23:32.264 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.183478.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.183478.log.gz 2023-10-03T10:23:32.264 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189784.log 2023-10-03T10:23:32.265 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189784.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189784.log.gz 2023-10-03T10:23:32.265 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168926.log 2023-10-03T10:23:32.265 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168926.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168926.log.gz 2023-10-03T10:23:32.265 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141366.log 2023-10-03T10:23:32.265 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141366.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141366.log.gz 2023-10-03T10:23:32.265 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152787.log 2023-10-03T10:23:32.265 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152787.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152787.log.gz 2023-10-03T10:23:32.265 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165788.log 2023-10-03T10:23:32.265 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165788.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.165788.log.gz 2023-10-03T10:23:32.266 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162019.log 2023-10-03T10:23:32.266 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162019.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162019.log.gz 2023-10-03T10:23:32.266 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185098.log 2023-10-03T10:23:32.266 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185098.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.185098.log.gz 2023-10-03T10:23:32.266 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156127.log 2023-10-03T10:23:32.266 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156127.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.156127.log.gz 2023-10-03T10:23:32.266 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161489.log 2023-10-03T10:23:32.267 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161489.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161489.log.gz 2023-10-03T10:23:32.267 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151928.log 2023-10-03T10:23:32.267 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151928.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.151928.log.gz 2023-10-03T10:23:32.267 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156519.log 2023-10-03T10:23:32.267 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156519.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.156519.log.gz 2023-10-03T10:23:32.267 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190176.log 2023-10-03T10:23:32.267 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190176.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.190176.log.gz 2023-10-03T10:23:32.267 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135545.log 2023-10-03T10:23:32.267 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135545.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135545.log.gz 2023-10-03T10:23:32.268 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167748.log 2023-10-03T10:23:32.268 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167748.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.167748.log.gz 2023-10-03T10:23:32.268 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122651.log 2023-10-03T10:23:32.268 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122651.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122651.log.gz 2023-10-03T10:23:32.268 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153383.log 2023-10-03T10:23:32.268 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153383.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153383.log.gz 2023-10-03T10:23:32.268 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156054.log 2023-10-03T10:23:32.268 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156054.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156054.log.gz 2023-10-03T10:23:32.269 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155858.log 2023-10-03T10:23:32.269 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170476.log 2023-10-03T10:23:32.269 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155858.log: /var/log/ceph/ceph-client.admin.170476.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155858.log.gz 2023-10-03T10:23:32.269 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170476.log.gz 2023-10-03T10:23:32.269 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185097.log 2023-10-03T10:23:32.269 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185097.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.185097.log.gz 2023-10-03T10:23:32.269 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190837.log 2023-10-03T10:23:32.269 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190837.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190837.log.gz 2023-10-03T10:23:32.270 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158453.log 2023-10-03T10:23:32.270 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146809.log 2023-10-03T10:23:32.270 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158453.log: /var/log/ceph/ceph-client.admin.146809.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158453.log.gz 2023-10-03T10:23:32.270 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146809.log.gz 2023-10-03T10:23:32.270 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171483.log 2023-10-03T10:23:32.270 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.171483.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.171483.log.gz 2023-10-03T10:23:32.270 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160023.log 2023-10-03T10:23:32.270 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160023.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160023.log.gz 2023-10-03T10:23:32.271 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145902.log 2023-10-03T10:23:32.271 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145902.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.145902.log.gz 2023-10-03T10:23:32.271 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149576.log 2023-10-03T10:23:32.271 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174835.log 2023-10-03T10:23:32.271 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149576.log: /var/log/ceph/ceph-client.admin.174835.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149576.log.gz 2023-10-03T10:23:32.271 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174835.log.gz 2023-10-03T10:23:32.271 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184341.log 2023-10-03T10:23:32.271 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184341.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184341.log.gz 2023-10-03T10:23:32.272 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141509.log 2023-10-03T10:23:32.272 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141509.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141509.log.gz 2023-10-03T10:23:32.272 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162281.log 2023-10-03T10:23:32.332 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162281.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162281.log.gz 2023-10-03T10:23:32.332 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189419.log 2023-10-03T10:23:32.332 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189419.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.189419.log.gz 2023-10-03T10:23:32.332 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150631.log 2023-10-03T10:23:32.332 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150631.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150631.log.gz 2023-10-03T10:23:32.332 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136386.log 2023-10-03T10:23:32.332 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136386.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136386.log.gz 2023-10-03T10:23:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188831.log 2023-10-03T10:23:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188831.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.188831.log.gz 2023-10-03T10:23:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192701.log 2023-10-03T10:23:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192701.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.192701.log.gz 2023-10-03T10:23:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193999.log 2023-10-03T10:23:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193999.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.193999.log.gz 2023-10-03T10:23:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169094.log 2023-10-03T10:23:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169094.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169094.log.gz 2023-10-03T10:23:32.334 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156201.log 2023-10-03T10:23:32.334 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156201.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156201.log.gz 2023-10-03T10:23:32.334 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136608.log 2023-10-03T10:23:32.334 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136608.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136608.log.gz 2023-10-03T10:23:32.334 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118860.log 2023-10-03T10:23:32.334 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118860.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118860.log.gz 2023-10-03T10:23:32.334 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185710.log 2023-10-03T10:23:32.335 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185710.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.185710.log.gz 2023-10-03T10:23:32.335 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148792.log 2023-10-03T10:23:32.335 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148792.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148792.log.gz 2023-10-03T10:23:32.335 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146587.log 2023-10-03T10:23:32.335 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146587.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146587.log.gz 2023-10-03T10:23:32.335 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123204.log 2023-10-03T10:23:32.335 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123204.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123204.log.gz 2023-10-03T10:23:32.335 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187850.log 2023-10-03T10:23:32.336 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187850.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187850.log.gz 2023-10-03T10:23:32.336 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148643.log 2023-10-03T10:23:32.336 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148643.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148643.log.gz 2023-10-03T10:23:32.336 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125433.log 2023-10-03T10:23:32.336 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125433.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125433.log.gz 2023-10-03T10:23:32.336 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-03T10:23:32.336 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.log: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-03T10:23:32.336 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152077.log 2023-10-03T10:23:32.336 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152077.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.152077.log.gz 2023-10-03T10:23:32.337 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177336.log 2023-10-03T10:23:32.337 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177336.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177336.log.gz 2023-10-03T10:23:32.337 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175619.log 2023-10-03T10:23:32.337 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175619.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175619.log.gz 2023-10-03T10:23:32.337 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151023.log 2023-10-03T10:23:32.337 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151023.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.151023.log.gz 2023-10-03T10:23:32.337 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185294.log 2023-10-03T10:23:32.338 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185294.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.185294.log.gz 2023-10-03T10:23:32.338 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178242.log 2023-10-03T10:23:32.338 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178242.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178242.log.gz 2023-10-03T10:23:32.338 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186470.log 2023-10-03T10:23:32.338 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186470.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186470.log.gz 2023-10-03T10:23:32.338 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159461.log 2023-10-03T10:23:32.338 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.159461.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.159461.log.gz 2023-10-03T10:23:32.338 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148745.log 2023-10-03T10:23:32.339 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148745.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.148745.log.gz 2023-10-03T10:23:32.339 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162477.log 2023-10-03T10:23:32.339 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162477.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162477.log.gz 2023-10-03T10:23:32.339 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156593.log 2023-10-03T10:23:32.339 INFO:teuthology.orchestra.run.smithi072.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-03T10:23:32.339 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156593.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156593.log.gz 2023-10-03T10:23:32.339 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179771.log 2023-10-03T10:23:32.339 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140385.log 2023-10-03T10:23:32.340 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179771.log: /var/log/ceph/ceph-client.admin.140385.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.179771.log.gz 2023-10-03T10:23:32.340 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140385.log.gz 2023-10-03T10:23:32.340 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154829.log 2023-10-03T10:23:32.340 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190836.log 2023-10-03T10:23:32.340 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154829.log: /var/log/ceph/ceph-client.admin.190836.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.154829.log.gz 2023-10-03T10:23:32.340 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190836.log.gz 2023-10-03T10:23:32.340 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192999.log 2023-10-03T10:23:32.340 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183551.log 2023-10-03T10:23:32.341 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192999.log: /var/log/ceph/ceph-client.admin.183551.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192999.log.gz 2023-10-03T10:23:32.341 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.183551.log.gz 2023-10-03T10:23:32.341 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176429.log 2023-10-03T10:23:32.341 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149845.log 2023-10-03T10:23:32.341 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176429.log: /var/log/ceph/ceph-client.admin.149845.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176429.log.gz 2023-10-03T10:23:32.341 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149845.log.gz 2023-10-03T10:23:32.341 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180725.log 2023-10-03T10:23:32.341 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157965.log 2023-10-03T10:23:32.341 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180725.log: /var/log/ceph/ceph-client.admin.157965.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.180725.log.gz 2023-10-03T10:23:32.342 INFO:teuthology.orchestra.run.smithi072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.157965.log.gz 2023-10-03T10:23:32.342 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193952.log 2023-10-03T10:23:32.342 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173445.log 2023-10-03T10:23:32.342 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193952.log: /var/log/ceph/ceph-client.admin.173445.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.193952.log.gz 2023-10-03T10:23:32.342 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173445.log.gz 2023-10-03T10:23:32.342 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161693.log 2023-10-03T10:23:32.342 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159068.log 2023-10-03T10:23:32.343 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161693.log: /var/log/ceph/ceph-client.admin.159068.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.161693.log.gz 2023-10-03T10:23:32.343 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.159068.log.gz 2023-10-03T10:23:32.343 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157769.log 2023-10-03T10:23:32.343 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193140.log 2023-10-03T10:23:32.343 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157769.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.157769.log.gz 2023-10-03T10:23:32.343 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193140.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193140.log.gz 2023-10-03T10:23:32.343 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165592.log 2023-10-03T10:23:32.343 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153553.log 2023-10-03T10:23:32.344 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165592.log: /var/log/ceph/ceph-client.admin.153553.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.165592.log.gz 2023-10-03T10:23:32.344 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153553.log.gz 2023-10-03T10:23:32.344 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174931.log 2023-10-03T10:23:32.344 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154337.log 2023-10-03T10:23:32.344 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174931.log: /var/log/ceph/ceph-client.admin.154337.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174931.log.gz 2023-10-03T10:23:32.344 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154337.log.gz 2023-10-03T10:23:32.344 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177458.log 2023-10-03T10:23:32.344 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189025.log 2023-10-03T10:23:32.345 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177458.log: /var/log/ceph/ceph-client.admin.189025.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177458.log.gz 2023-10-03T10:23:32.345 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.189025.log.gz 2023-10-03T10:23:32.345 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144031.log 2023-10-03T10:23:32.345 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192186.log 2023-10-03T10:23:32.345 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144031.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144031.log.gz 2023-10-03T10:23:32.345 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192186.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.192186.log.gz 2023-10-03T10:23:32.345 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165958.log 2023-10-03T10:23:32.345 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171407.log 2023-10-03T10:23:32.346 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165958.log: /var/log/ceph/ceph-client.admin.171407.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165958.log.gz 2023-10-03T10:23:32.346 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.171407.log.gz 2023-10-03T10:23:32.346 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162804.log 2023-10-03T10:23:32.346 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148473.log 2023-10-03T10:23:32.346 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162804.log: /var/log/ceph/ceph-client.admin.148473.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162804.log.gz 2023-10-03T10:23:32.346 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148473.log.gz 2023-10-03T10:23:32.346 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170672.log 2023-10-03T10:23:32.346 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181117.log 2023-10-03T10:23:32.347 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170672.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170672.log.gz 2023-10-03T10:23:32.347 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181117.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.181117.log.gz 2023-10-03T10:23:32.347 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138935.log 2023-10-03T10:23:32.347 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161199.log 2023-10-03T10:23:32.347 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138935.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138935.log.gz 2023-10-03T10:23:32.347 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161199.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.161199.log.gz 2023-10-03T10:23:32.347 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182489.log 2023-10-03T10:23:32.347 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140554.log 2023-10-03T10:23:32.348 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182489.log: /var/log/ceph/ceph-client.admin.140554.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182489.log.gz 2023-10-03T10:23:32.348 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140554.log.gz 2023-10-03T10:23:32.348 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145706.log 2023-10-03T10:23:32.348 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194073.log 2023-10-03T10:23:32.348 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145706.log: /var/log/ceph/ceph-client.admin.194073.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.145706.log.gz 2023-10-03T10:23:32.348 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.194073.log.gz 2023-10-03T10:23:32.348 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147569.log 2023-10-03T10:23:32.348 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144128.log 2023-10-03T10:23:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147569.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147569.log.gz 2023-10-03T10:23:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.144128.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.144128.log.gz 2023-10-03T10:23:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186886.log 2023-10-03T10:23:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172075.log 2023-10-03T10:23:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186886.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.186886.log.gz 2023-10-03T10:23:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.172075.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172075.log.gz 2023-10-03T10:23:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159629.log 2023-10-03T10:23:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159657.log 2023-10-03T10:23:32.350 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.159629.log: /var/log/ceph/ceph-client.admin.159657.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.159629.log.gz 2023-10-03T10:23:32.350 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159657.log.gz 2023-10-03T10:23:32.350 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188190.log 2023-10-03T10:23:32.350 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161395.log 2023-10-03T10:23:32.350 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188190.log: /var/log/ceph/ceph-client.admin.161395.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.188190.log.gz 2023-10-03T10:23:32.350 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161395.log.gz 2023-10-03T10:23:32.350 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188242.log 2023-10-03T10:23:32.350 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129706.log 2023-10-03T10:23:32.351 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188242.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.188242.log.gz 2023-10-03T10:23:32.351 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.129706.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129706.log.gz 2023-10-03T10:23:32.351 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182150.log 2023-10-03T10:23:32.351 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136439.log 2023-10-03T10:23:32.351 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182150.log: 88.4%/var/log/ceph/ceph-client.admin.136439.log: -- replaced with /var/log/ceph/ceph-client.admin.182150.log.gz 2023-10-03T10:23:32.351 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.136439.log.gz 2023-10-03T10:23:32.351 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174861.log 2023-10-03T10:23:32.351 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139035.log 2023-10-03T10:23:32.352 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174861.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174861.log.gz 2023-10-03T10:23:32.352 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139035.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139035.log.gz 2023-10-03T10:23:32.352 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174543.log 2023-10-03T10:23:32.352 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177654.log 2023-10-03T10:23:32.352 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174543.log: /var/log/ceph/ceph-client.admin.177654.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174543.log.gz 2023-10-03T10:23:32.352 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.177654.log.gz 2023-10-03T10:23:32.352 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186077.log 2023-10-03T10:23:32.352 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169122.log 2023-10-03T10:23:32.353 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186077.log: /var/log/ceph/ceph-client.admin.169122.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.186077.log.gz 2023-10-03T10:23:32.353 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169122.log.gz 2023-10-03T10:23:32.353 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143051.log 2023-10-03T10:23:32.353 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177189.log 2023-10-03T10:23:32.353 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.143051.log: /var/log/ceph/ceph-client.admin.177189.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143051.log.gz 2023-10-03T10:23:32.353 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177189.log.gz 2023-10-03T10:23:32.353 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182630.log 2023-10-03T10:23:32.353 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175519.log 2023-10-03T10:23:32.354 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182630.log: /var/log/ceph/ceph-client.admin.175519.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.182630.log.gz 2023-10-03T10:23:32.354 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175519.log.gz 2023-10-03T10:23:32.354 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166891.log 2023-10-03T10:23:32.354 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150435.log 2023-10-03T10:23:32.354 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166891.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166891.log.gz 2023-10-03T10:23:32.354 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150435.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150435.log.gz 2023-10-03T10:23:32.354 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191794.log 2023-10-03T10:23:32.354 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160415.log 2023-10-03T10:23:32.355 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191794.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.191794.log.gz 2023-10-03T10:23:32.355 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160415.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.160415.log.gz 2023-10-03T10:23:32.355 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139209.log 2023-10-03T10:23:32.355 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165274.log 2023-10-03T10:23:32.355 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139209.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139209.log.gz 2023-10-03T10:23:32.355 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165274.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165274.log.gz 2023-10-03T10:23:32.355 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188634.log 2023-10-03T10:23:32.356 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138643.log 2023-10-03T10:23:32.356 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188634.log: /var/log/ceph/ceph-client.admin.138643.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.188634.log.gz 2023-10-03T10:23:32.356 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138643.log.gz 2023-10-03T10:23:32.356 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135398.log 2023-10-03T10:23:32.356 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129512.log 2023-10-03T10:23:32.356 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.135398.log: /var/log/ceph/ceph-client.admin.129512.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135398.log.gz 2023-10-03T10:23:32.356 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129512.log.gz 2023-10-03T10:23:32.357 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149725.log 2023-10-03T10:23:32.357 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141143.log 2023-10-03T10:23:32.357 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149725.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149725.log.gz 2023-10-03T10:23:32.357 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141143.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141143.log.gz 2023-10-03T10:23:32.357 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195317.log 2023-10-03T10:23:32.357 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142557.log 2023-10-03T10:23:32.357 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.195317.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.195317.log.gz 2023-10-03T10:23:32.357 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142557.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142557.log.gz 2023-10-03T10:23:32.358 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188608.log 2023-10-03T10:23:32.358 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178365.log 2023-10-03T10:23:32.358 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188608.log: /var/log/ceph/ceph-client.admin.178365.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188608.log.gz 2023-10-03T10:23:32.358 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.178365.log.gz 2023-10-03T10:23:32.358 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149409.log 2023-10-03T10:23:32.358 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194514.log 2023-10-03T10:23:32.358 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149409.log: /var/log/ceph/ceph-client.admin.194514.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149409.log.gz 2023-10-03T10:23:32.358 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.194514.log.gz 2023-10-03T10:23:32.359 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157669.log 2023-10-03T10:23:32.359 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148026.log 2023-10-03T10:23:32.359 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157669.log: /var/log/ceph/ceph-client.admin.148026.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.157669.log.gz 2023-10-03T10:23:32.359 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148026.log.gz 2023-10-03T10:23:32.359 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145072.log 2023-10-03T10:23:32.359 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170546.log 2023-10-03T10:23:32.359 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145072.log: /var/log/ceph/ceph-client.admin.170546.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.145072.log.gz 2023-10-03T10:23:32.359 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170546.log.gz 2023-10-03T10:23:32.360 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166964.log 2023-10-03T10:23:32.360 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143443.log 2023-10-03T10:23:32.360 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166964.log: /var/log/ceph/ceph-client.admin.143443.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166964.log.gz 2023-10-03T10:23:32.360 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143443.log.gz 2023-10-03T10:23:32.360 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165370.log 2023-10-03T10:23:32.360 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186469.log 2023-10-03T10:23:32.360 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165370.log: /var/log/ceph/ceph-client.admin.186469.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165370.log.gz 2023-10-03T10:23:32.361 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.186469.log.gz 2023-10-03T10:23:32.361 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148447.log 2023-10-03T10:23:32.361 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126744.log 2023-10-03T10:23:32.361 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148447.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148447.log.gz 2023-10-03T10:23:32.361 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.126744.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.126744.log.gz 2023-10-03T10:23:32.361 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152124.log 2023-10-03T10:23:32.361 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172044.log 2023-10-03T10:23:32.361 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152124.log: /var/log/ceph/ceph-client.admin.172044.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.152124.log.gz 2023-10-03T10:23:32.362 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172044.log.gz 2023-10-03T10:23:32.362 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152591.log 2023-10-03T10:23:32.362 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187202.log 2023-10-03T10:23:32.362 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.152591.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152591.log.gz 2023-10-03T10:23:32.362 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187202.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187202.log.gz 2023-10-03T10:23:32.362 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142756.log 2023-10-03T10:23:32.362 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181852.log 2023-10-03T10:23:32.362 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142756.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142756.log.gz 2023-10-03T10:23:32.363 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181852.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181852.log.gz 2023-10-03T10:23:32.363 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193168.log 2023-10-03T10:23:32.363 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157034.log 2023-10-03T10:23:32.363 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.193168.log: /var/log/ceph/ceph-client.admin.157034.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.193168.log.gz 2023-10-03T10:23:32.363 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.157034.log.gz 2023-10-03T10:23:32.363 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151536.log 2023-10-03T10:23:32.363 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139353.log 2023-10-03T10:23:32.363 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151536.log: /var/log/ceph/ceph-client.admin.139353.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151536.log.gz 2023-10-03T10:23:32.364 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.139353.log.gz 2023-10-03T10:23:32.364 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127014.log 2023-10-03T10:23:32.364 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168779.log 2023-10-03T10:23:32.364 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127014.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127014.log.gz 2023-10-03T10:23:32.364 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168779.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.168779.log.gz 2023-10-03T10:23:32.364 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129835.log 2023-10-03T10:23:32.364 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142169.log 2023-10-03T10:23:32.364 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.129835.log: /var/log/ceph/ceph-client.admin.142169.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.129835.log.gz 2023-10-03T10:23:32.365 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142169.log.gz 2023-10-03T10:23:32.365 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127417.log 2023-10-03T10:23:32.365 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142954.log 2023-10-03T10:23:32.365 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.127417.log: /var/log/ceph/ceph-client.admin.142954.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.127417.log.gz 2023-10-03T10:23:32.365 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142954.log.gz 2023-10-03T10:23:32.365 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192578.log 2023-10-03T10:23:32.365 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149529.log 2023-10-03T10:23:32.365 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192578.log: /var/log/ceph/ceph-client.admin.149529.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.192578.log.gz 2023-10-03T10:23:32.366 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.149529.log.gz 2023-10-03T10:23:32.366 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188878.log 2023-10-03T10:23:32.366 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194122.log 2023-10-03T10:23:32.366 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188878.log: /var/log/ceph/ceph-client.admin.194122.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188878.log.gz 2023-10-03T10:23:32.366 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.194122.log.gz 2023-10-03T10:23:32.366 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141731.log 2023-10-03T10:23:32.366 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126838.log 2023-10-03T10:23:32.366 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141731.log: /var/log/ceph/ceph-client.admin.126838.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141731.log.gz 2023-10-03T10:23:32.367 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126838.log.gz 2023-10-03T10:23:32.367 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137563.log 2023-10-03T10:23:32.367 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187060.log 2023-10-03T10:23:32.367 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137563.log: /var/log/ceph/ceph-client.admin.187060.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.137563.log.gz 2023-10-03T10:23:32.367 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.187060.log.gz 2023-10-03T10:23:32.367 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177777.log 2023-10-03T10:23:32.367 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174004.log 2023-10-03T10:23:32.367 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177777.log: /var/log/ceph/ceph-client.admin.174004.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.177777.log.gz 2023-10-03T10:23:32.368 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.174004.log.gz 2023-10-03T10:23:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154045.log 2023-10-03T10:23:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157865.log 2023-10-03T10:23:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.154045.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.154045.log.gz 2023-10-03T10:23:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157865.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157865.log.gz 2023-10-03T10:23:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157573.log 2023-10-03T10:23:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183386.log 2023-10-03T10:23:32.368 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157573.log: /var/log/ceph/ceph-client.admin.183386.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.157573.log.gz 2023-10-03T10:23:32.369 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.183386.log.gz 2023-10-03T10:23:32.369 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149213.log 2023-10-03T10:23:32.369 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164931.log 2023-10-03T10:23:32.369 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.149213.log: /var/log/ceph/ceph-client.admin.164931.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149213.log.gz 2023-10-03T10:23:32.369 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164931.log.gz 2023-10-03T10:23:32.369 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140751.log 2023-10-03T10:23:32.369 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169243.log 2023-10-03T10:23:32.369 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140751.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.140751.log.gz 2023-10-03T10:23:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169243.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.169243.log.gz 2023-10-03T10:23:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140777.log 2023-10-03T10:23:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183159.log 2023-10-03T10:23:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140777.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140777.log.gz/var/log/ceph/ceph-client.admin.183159.log: 2023-10-03T10:23:32.370 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183159.log.gz 2023-10-03T10:23:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158479.log 2023-10-03T10:23:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163410.log 2023-10-03T10:23:32.370 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158479.log: /var/log/ceph/ceph-client.admin.163410.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158479.log.gz 2023-10-03T10:23:32.371 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163410.log.gz 2023-10-03T10:23:32.371 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178000.log 2023-10-03T10:23:32.371 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137643.log 2023-10-03T10:23:32.371 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178000.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.178000.log.gz 2023-10-03T10:23:32.371 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137643.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.137643.log.gz 2023-10-03T10:23:32.371 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161991.log 2023-10-03T10:23:32.371 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178316.log 2023-10-03T10:23:32.371 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161991.log: /var/log/ceph/ceph-client.admin.178316.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161991.log.gz 2023-10-03T10:23:32.372 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.178316.log.gz 2023-10-03T10:23:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181313.log 2023-10-03T10:23:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186692.log 2023-10-03T10:23:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181313.log: /var/log/ceph/ceph-client.admin.186692.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.181313.log.gz 2023-10-03T10:23:32.372 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186692.log.gz 2023-10-03T10:23:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189170.log 2023-10-03T10:23:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184928.log 2023-10-03T10:23:32.372 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.189170.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189170.log.gz 2023-10-03T10:23:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184928.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.184928.log.gz 2023-10-03T10:23:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146026.log 2023-10-03T10:23:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126890.log 2023-10-03T10:23:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.146026.log: /var/log/ceph/ceph-client.admin.126890.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146026.log.gz 2023-10-03T10:23:32.373 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.126890.log.gz 2023-10-03T10:23:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191625.log 2023-10-03T10:23:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165078.log 2023-10-03T10:23:32.373 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191625.log: /var/log/ceph/ceph-client.admin.165078.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.191625.log.gz 2023-10-03T10:23:32.374 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165078.log.gz 2023-10-03T10:23:32.374 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168210.log 2023-10-03T10:23:32.374 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189223.log 2023-10-03T10:23:32.374 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168210.log: /var/log/ceph/ceph-client.admin.189223.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168210.log.gz 2023-10-03T10:23:32.374 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189223.log.gz 2023-10-03T10:23:32.374 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158061.log 2023-10-03T10:23:32.374 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141287.log 2023-10-03T10:23:32.374 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158061.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.158061.log.gz 2023-10-03T10:23:32.375 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141287.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141287.log.gz 2023-10-03T10:23:32.375 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163436.log 2023-10-03T10:23:32.375 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151611.log 2023-10-03T10:23:32.375 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.163436.log: /var/log/ceph/ceph-client.admin.151611.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163436.log.gz 2023-10-03T10:23:32.375 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.151611.log.gz 2023-10-03T10:23:32.375 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158210.log 2023-10-03T10:23:32.375 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147399.log 2023-10-03T10:23:32.375 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158210.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.158210.log.gz 2023-10-03T10:23:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147399.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147399.log.gz 2023-10-03T10:23:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128132.log 2023-10-03T10:23:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194587.log 2023-10-03T10:23:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128132.log: /var/log/ceph/ceph-client.admin.194587.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128132.log.gz 2023-10-03T10:23:32.376 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.194587.log.gz 2023-10-03T10:23:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124213.log 2023-10-03T10:23:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185711.log 2023-10-03T10:23:32.376 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.124213.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124213.log.gz 2023-10-03T10:23:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185711.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.185711.log.gz 2023-10-03T10:23:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190569.log 2023-10-03T10:23:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156005.log 2023-10-03T10:23:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190569.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190569.log.gz/var/log/ceph/ceph-client.admin.156005.log: 2023-10-03T10:23:32.377 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156005.log.gz 2023-10-03T10:23:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191376.log 2023-10-03T10:23:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181901.log 2023-10-03T10:23:32.377 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191376.log: /var/log/ceph/ceph-client.admin.181901.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.191376.log.gz 2023-10-03T10:23:32.378 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181901.log.gz 2023-10-03T10:23:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142366.log 2023-10-03T10:23:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155931.log 2023-10-03T10:23:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142366.log: /var/log/ceph/ceph-client.admin.155931.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142366.log.gz 2023-10-03T10:23:32.378 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155931.log.gz 2023-10-03T10:23:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166938.log 2023-10-03T10:23:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162617.log 2023-10-03T10:23:32.378 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166938.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.166938.log.gz 2023-10-03T10:23:32.379 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162617.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162617.log.gz 2023-10-03T10:23:32.379 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181731.log 2023-10-03T10:23:32.379 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177973.log 2023-10-03T10:23:32.379 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181731.log: /var/log/ceph/ceph-client.admin.177973.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181731.log.gz 2023-10-03T10:23:32.379 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177973.log.gz 2023-10-03T10:23:32.379 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123821.log 2023-10-03T10:23:32.379 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186418.log 2023-10-03T10:23:32.379 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123821.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123821.log.gz 2023-10-03T10:23:32.380 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.186418.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.186418.log.gz 2023-10-03T10:23:32.380 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166154.log 2023-10-03T10:23:32.380 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193485.log 2023-10-03T10:23:32.380 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166154.log: /var/log/ceph/ceph-client.admin.193485.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.166154.log.gz 2023-10-03T10:23:32.380 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.193485.log.gz 2023-10-03T10:23:32.380 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178169.log 2023-10-03T10:23:32.380 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155709.log 2023-10-03T10:23:32.380 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178169.log: /var/log/ceph/ceph-client.admin.155709.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.178169.log.gz 2023-10-03T10:23:32.381 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155709.log.gz 2023-10-03T10:23:32.381 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176552.log 2023-10-03T10:23:32.381 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170349.log 2023-10-03T10:23:32.381 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176552.log: /var/log/ceph/ceph-client.admin.170349.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176552.log.gz 2023-10-03T10:23:32.381 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.170349.log.gz 2023-10-03T10:23:32.381 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139770.log 2023-10-03T10:23:32.381 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180163.log 2023-10-03T10:23:32.381 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.139770.log: /var/log/ceph/ceph-client.admin.180163.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139770.log.gz 2023-10-03T10:23:32.382 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180163.log.gz 2023-10-03T10:23:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177805.log 2023-10-03T10:23:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183674.log 2023-10-03T10:23:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177805.log: /var/log/ceph/ceph-client.admin.183674.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177805.log.gz 2023-10-03T10:23:32.382 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183674.log.gz 2023-10-03T10:23:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165470.log 2023-10-03T10:23:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136072.log 2023-10-03T10:23:32.382 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166107.log 2023-10-03T10:23:32.383 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.165470.log.gz 2023-10-03T10:23:32.383 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136072.log: /var/log/ceph/ceph-client.admin.166107.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136072.log.gz 2023-10-03T10:23:32.383 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166107.log.gz 2023-10-03T10:23:32.383 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136832.log 2023-10-03T10:23:32.383 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155466.log 2023-10-03T10:23:32.383 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136832.log: /var/log/ceph/ceph-client.admin.155466.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136832.log.gz 2023-10-03T10:23:32.383 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.155466.log.gz 2023-10-03T10:23:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150239.log 2023-10-03T10:23:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194540.log 2023-10-03T10:23:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150239.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.150239.log.gz/var/log/ceph/ceph-client.admin.194540.log: 2023-10-03T10:23:32.384 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.194540.log.gz 2023-10-03T10:23:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125068.log 2023-10-03T10:23:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125068.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125068.log.gz 2023-10-03T10:23:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194778.log 2023-10-03T10:23:32.384 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142562.log 2023-10-03T10:23:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.194778.log: /var/log/ceph/ceph-client.admin.142562.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.194778.log.gz 2023-10-03T10:23:32.385 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142562.log.gz 2023-10-03T10:23:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174347.log 2023-10-03T10:23:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146641.log 2023-10-03T10:23:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174347.log: /var/log/ceph/ceph-client.admin.146641.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174347.log.gz 2023-10-03T10:23:32.385 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146641.log.gz 2023-10-03T10:23:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137418.log 2023-10-03T10:23:32.385 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142361.log 2023-10-03T10:23:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137418.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137418.log.gz 2023-10-03T10:23:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142361.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.142361.log.gz 2023-10-03T10:23:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150705.log 2023-10-03T10:23:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156911.log 2023-10-03T10:23:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.150705.log: /var/log/ceph/ceph-client.admin.156911.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.150705.log.gz 2023-10-03T10:23:32.386 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156911.log.gz 2023-10-03T10:23:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128811.log 2023-10-03T10:23:32.386 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190150.log 2023-10-03T10:23:32.387 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.128811.log: /var/log/ceph/ceph-client.admin.190150.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128811.log.gz 2023-10-03T10:23:32.387 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190150.log.gz 2023-10-03T10:23:32.387 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140581.log 2023-10-03T10:23:32.387 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138764.log 2023-10-03T10:23:32.387 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140581.log: /var/log/ceph/ceph-client.admin.138764.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140581.log.gz 2023-10-03T10:23:32.387 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.138764.log.gz 2023-10-03T10:23:32.387 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157818.log 2023-10-03T10:23:32.387 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137171.log 2023-10-03T10:23:32.388 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157818.log: /var/log/ceph/ceph-client.admin.137171.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157818.log.gz 2023-10-03T10:23:32.388 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.137171.log.gz 2023-10-03T10:23:32.388 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141974.log 2023-10-03T10:23:32.388 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166546.log 2023-10-03T10:23:32.388 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141974.log: /var/log/ceph/ceph-client.admin.166546.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141974.log.gz 2023-10-03T10:23:32.388 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166546.log.gz 2023-10-03T10:23:32.388 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182293.log 2023-10-03T10:23:32.388 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184733.log 2023-10-03T10:23:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182293.log: /var/log/ceph/ceph-client.admin.184733.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.182293.log.gz 2023-10-03T10:23:32.389 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.184733.log.gz 2023-10-03T10:23:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118596.log 2023-10-03T10:23:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118596.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118596.log.gz 2023-10-03T10:23:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158749.log 2023-10-03T10:23:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183031.log 2023-10-03T10:23:32.389 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158749.log: /var/log/ceph/ceph-client.admin.183031.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158749.log.gz 2023-10-03T10:23:32.389 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.183031.log.gz 2023-10-03T10:23:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148669.log 2023-10-03T10:23:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187655.log 2023-10-03T10:23:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.148669.log: /var/log/ceph/ceph-client.admin.187655.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.148669.log.gz 2023-10-03T10:23:32.390 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187655.log.gz 2023-10-03T10:23:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153702.log 2023-10-03T10:23:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188051.log 2023-10-03T10:23:32.390 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.153702.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153702.log.gz 2023-10-03T10:23:32.391 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.188051.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188051.log.gz 2023-10-03T10:23:32.391 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169319.log 2023-10-03T10:23:32.391 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185881.log 2023-10-03T10:23:32.391 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169319.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169319.log.gz 2023-10-03T10:23:32.391 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.185881.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185881.log.gz 2023-10-03T10:23:32.391 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180676.log 2023-10-03T10:23:32.391 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188093.log 2023-10-03T10:23:32.391 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.180676.log: /var/log/ceph/ceph-client.admin.188093.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180676.log.gz 2023-10-03T10:23:32.392 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.188093.log.gz 2023-10-03T10:23:32.392 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123400.log 2023-10-03T10:23:32.392 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161746.log 2023-10-03T10:23:32.392 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123400.log: /var/log/ceph/ceph-client.admin.161746.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.123400.log.gz 2023-10-03T10:23:32.392 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.161746.log.gz 2023-10-03T10:23:32.392 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155809.log 2023-10-03T10:23:32.392 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179186.log 2023-10-03T10:23:32.392 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.155809.log: /var/log/ceph/ceph-client.admin.179186.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.155809.log.gz 2023-10-03T10:23:32.393 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179186.log.gz 2023-10-03T10:23:32.393 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137027.log 2023-10-03T10:23:32.393 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136241.log 2023-10-03T10:23:32.393 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.137027.log: /var/log/ceph/ceph-client.admin.136241.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137027.log.gz 2023-10-03T10:23:32.393 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136241.log.gz 2023-10-03T10:23:32.393 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125678.log 2023-10-03T10:23:32.393 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128566.log 2023-10-03T10:23:32.393 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.125678.log: /var/log/ceph/ceph-client.admin.128566.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125678.log.gz 2023-10-03T10:23:32.394 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.128566.log.gz 2023-10-03T10:23:32.394 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145118.log 2023-10-03T10:23:32.394 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166253.log 2023-10-03T10:23:32.394 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145118.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145118.log.gz 2023-10-03T10:23:32.394 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166253.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166253.log.gz 2023-10-03T10:23:32.394 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157081.log 2023-10-03T10:23:32.394 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153261.log 2023-10-03T10:23:32.395 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.157081.log: /var/log/ceph/ceph-client.admin.153261.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157081.log.gz 2023-10-03T10:23:32.395 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.153261.log.gz 2023-10-03T10:23:32.395 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181170.log 2023-10-03T10:23:32.395 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159582.log 2023-10-03T10:23:32.395 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.181170.log: /var/log/ceph/ceph-client.admin.159582.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181170.log.gz 2023-10-03T10:23:32.395 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159582.log.gz 2023-10-03T10:23:32.395 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140946.log 2023-10-03T10:23:32.395 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152714.log 2023-10-03T10:23:32.395 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140946.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.140946.log.gz/var/log/ceph/ceph-client.admin.152714.log: 2023-10-03T10:23:32.396 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.152714.log.gz 2023-10-03T10:23:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147258.log 2023-10-03T10:23:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179353.log 2023-10-03T10:23:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147258.log: /var/log/ceph/ceph-client.admin.179353.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147258.log.gz 2023-10-03T10:23:32.396 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179353.log.gz 2023-10-03T10:23:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164147.log 2023-10-03T10:23:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178120.log 2023-10-03T10:23:32.396 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164147.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164147.log.gz 2023-10-03T10:23:32.397 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.178120.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178120.log.gz 2023-10-03T10:23:32.397 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-03T10:23:32.397 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153141.log 2023-10-03T10:23:32.397 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.153141.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.153141.log.gz 2023-10-03T10:23:32.397 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136805.log 2023-10-03T10:23:32.409 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136805.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.136805.log.gz 2023-10-03T10:23:32.410 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142922.log 2023-10-03T10:23:32.410 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142922.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142922.log.gz 2023-10-03T10:23:32.410 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190937.log 2023-10-03T10:23:32.410 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155270.log 2023-10-03T10:23:32.410 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.190937.log: /var/log/ceph/ceph-client.admin.155270.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.190937.log.gz 2023-10-03T10:23:32.410 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155270.log.gz 2023-10-03T10:23:32.411 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162530.log 2023-10-03T10:23:32.411 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162530.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.162530.log.gz 2023-10-03T10:23:32.411 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170623.log 2023-10-03T10:23:32.411 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.170623.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170623.log.gz 2023-10-03T10:23:32.411 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156838.log 2023-10-03T10:23:32.411 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.156838.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.156838.log.gz 2023-10-03T10:23:32.411 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142071.log 2023-10-03T10:23:32.411 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.142071.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142071.log.gz 2023-10-03T10:23:32.412 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165200.log 2023-10-03T10:23:32.412 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165200.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.165200.log.gz 2023-10-03T10:23:32.412 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176283.log 2023-10-03T10:23:32.412 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.176283.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176283.log.gz 2023-10-03T10:23:32.412 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177019.log 2023-10-03T10:23:32.412 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177019.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177019.log.gz 2023-10-03T10:23:32.412 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161150.log 2023-10-03T10:23:32.412 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.161150.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.161150.log.gz 2023-10-03T10:23:32.413 INFO:teuthology.orchestra.run.smithi072.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-03T10:23:32.413 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138543.log 2023-10-03T10:23:32.413 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167818.log 2023-10-03T10:23:32.413 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138543.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138543.log.gz 2023-10-03T10:23:32.413 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151198.log 2023-10-03T10:23:32.413 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.167818.log.gz 2023-10-03T10:23:32.413 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164586.log 2023-10-03T10:23:32.413 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.151198.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.151198.log.gz 2023-10-03T10:23:32.414 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141875.log 2023-10-03T10:23:32.414 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164586.log.gz 2023-10-03T10:23:32.414 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175323.log 2023-10-03T10:23:32.414 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122243.log 2023-10-03T10:23:32.414 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141875.log: /var/log/ceph/ceph-client.admin.175323.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141875.log.gz 2023-10-03T10:23:32.414 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122243.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175323.log.gz 2023-10-03T10:23:32.414 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182346.log 2023-10-03T10:23:32.414 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.122243.log.gz 2023-10-03T10:23:32.415 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169947.log 2023-10-03T10:23:32.415 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182346.log: /var/log/ceph/ceph-client.admin.169947.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.182346.log.gz 2023-10-03T10:23:32.415 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191721.log 2023-10-03T10:23:32.415 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169947.log.gz 2023-10-03T10:23:32.415 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124212.log 2023-10-03T10:23:32.415 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191721.log: /var/log/ceph/ceph-client.admin.124212.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.191721.log.gz 2023-10-03T10:23:32.415 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129610.log 2023-10-03T10:23:32.415 INFO:teuthology.orchestra.run.smithi072.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.124212.log.gz 2023-10-03T10:23:32.416 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188386.log 2023-10-03T10:23:32.416 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.129610.log: /var/log/ceph/ceph-client.admin.188386.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129610.log.gz 2023-10-03T10:23:32.416 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164612.log 2023-10-03T10:23:32.416 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.188386.log.gz 2023-10-03T10:23:32.416 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164612.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164612.log.gz 2023-10-03T10:23:32.416 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147595.log 2023-10-03T10:23:32.416 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154290.log 2023-10-03T10:23:32.416 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147595.log: /var/log/ceph/ceph-client.admin.154290.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.147595.log.gz 2023-10-03T10:23:32.417 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.154290.log.gz 2023-10-03T10:23:32.417 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129301.log 2023-10-03T10:23:32.417 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168898.log 2023-10-03T10:23:32.417 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.129301.log: /var/log/ceph/ceph-client.admin.168898.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129301.log.gz 2023-10-03T10:23:32.417 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138446.log 2023-10-03T10:23:32.417 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168898.log.gz 2023-10-03T10:23:32.417 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153579.log 2023-10-03T10:23:32.417 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.138446.log: /var/log/ceph/ceph-client.admin.153579.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.138446.log.gz 2023-10-03T10:23:32.418 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.153579.log.gz 2023-10-03T10:23:32.418 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191572.log 2023-10-03T10:23:32.418 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145607.log 2023-10-03T10:23:32.418 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.191572.log: /var/log/ceph/ceph-client.admin.145607.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.191572.log.gz 2023-10-03T10:23:32.418 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.145607.log.gz 2023-10-03T10:23:32.418 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136582.log 2023-10-03T10:23:32.418 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146882.log 2023-10-03T10:23:32.418 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.136582.log: 88.0%/var/log/ceph/ceph-client.admin.146882.log: -- replaced with /var/log/ceph/ceph-client.admin.136582.log.gz 2023-10-03T10:23:32.419 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146882.log.gz 2023-10-03T10:23:32.419 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123547.log 2023-10-03T10:23:32.419 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122898.log 2023-10-03T10:23:32.419 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.123547.log: /var/log/ceph/ceph-client.admin.122898.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123547.log.gz 2023-10-03T10:23:32.419 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.122898.log.gz 2023-10-03T10:23:32.419 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141779.log 2023-10-03T10:23:32.419 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179108.log 2023-10-03T10:23:32.419 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.141779.log: /var/log/ceph/ceph-client.admin.179108.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141779.log.gz 2023-10-03T10:23:32.420 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179108.log.gz 2023-10-03T10:23:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165519.log 2023-10-03T10:23:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118499.log 2023-10-03T10:23:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.165519.log: /var/log/ceph/ceph-client.admin.118499.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165519.log.gz 2023-10-03T10:23:32.420 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118499.log.gz 2023-10-03T10:23:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147257.log 2023-10-03T10:23:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177924.log 2023-10-03T10:23:32.420 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147257.log: /var/log/ceph/ceph-client.admin.177924.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147257.log.gz 2023-10-03T10:23:32.421 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.177924.log.gz 2023-10-03T10:23:32.421 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174396.log 2023-10-03T10:23:32.421 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176748.log 2023-10-03T10:23:32.421 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.174396.log: /var/log/ceph/ceph-client.admin.176748.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174396.log.gz 2023-10-03T10:23:32.421 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176748.log.gz 2023-10-03T10:23:32.421 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179967.log 2023-10-03T10:23:32.421 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172240.log 2023-10-03T10:23:32.422 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179967.log: /var/log/ceph/ceph-client.admin.172240.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.179967.log.gz 2023-10-03T10:23:32.422 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172240.log.gz 2023-10-03T10:23:32.422 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184706.log 2023-10-03T10:23:32.422 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147856.log 2023-10-03T10:23:32.422 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.184706.log: /var/log/ceph/ceph-client.admin.147856.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.184706.log.gz 2023-10-03T10:23:32.422 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.147856.log.gz 2023-10-03T10:23:32.422 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162187.log 2023-10-03T10:23:32.422 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159433.log 2023-10-03T10:23:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162187.log: /var/log/ceph/ceph-client.admin.159433.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162187.log.gz 2023-10-03T10:23:32.423 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159433.log.gz 2023-10-03T10:23:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164416.log 2023-10-03T10:23:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166448.log 2023-10-03T10:23:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.164416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144261.log 2023-10-03T10:23:32.423 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.164416.log.gz 2023-10-03T10:23:32.423 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.166448.log: /var/log/ceph/ceph-client.admin.144261.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166448.log.gz 2023-10-03T10:23:32.423 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144261.log.gz 2023-10-03T10:23:32.424 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140036.log 2023-10-03T10:23:32.424 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159925.log 2023-10-03T10:23:32.424 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.140036.log: /var/log/ceph/ceph-client.admin.159925.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140036.log.gz 2023-10-03T10:23:32.424 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182944.log 2023-10-03T10:23:32.424 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159925.log.gz 2023-10-03T10:23:32.424 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162334.log 2023-10-03T10:23:32.424 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.182944.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182944.log.gz 2023-10-03T10:23:32.424 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122847.log 2023-10-03T10:23:32.425 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.162334.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.162334.log.gz 2023-10-03T10:23:32.425 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118450.log 2023-10-03T10:23:32.425 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173171.log 2023-10-03T10:23:32.425 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122847.log.gz 2023-10-03T10:23:32.425 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160707.log 2023-10-03T10:23:32.425 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.173171.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118450.log.gz 2023-10-03T10:23:32.425 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173171.log.gz 2023-10-03T10:23:32.425 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192113.log 2023-10-03T10:23:32.426 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.160707.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160707.log.gz 2023-10-03T10:23:32.426 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158602.log 2023-10-03T10:23:32.426 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.192113.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.192113.log.gz 2023-10-03T10:23:32.426 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179621.log 2023-10-03T10:23:32.426 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.158602.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158602.log.gz 2023-10-03T10:23:32.426 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.179621.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.179621.log.gz 2023-10-03T10:23:32.426 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169439.log 2023-10-03T10:23:32.427 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135670.log 2023-10-03T10:23:32.427 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.169439.log: /var/log/ceph/ceph-client.admin.135670.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169439.log.gz 2023-10-03T10:23:32.427 INFO:teuthology.orchestra.run.smithi072.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.135670.log.gz 2023-10-03T10:23:32.427 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167944.log 2023-10-03T10:23:32.427 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163245.log 2023-10-03T10:23:32.427 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.167944.log: /var/log/ceph/ceph-client.admin.163245.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.167944.log.gz 2023-10-03T10:23:32.427 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163245.log.gz 2023-10-03T10:23:32.427 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147070.log 2023-10-03T10:23:32.428 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152163.log 2023-10-03T10:23:32.428 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.147070.log: /var/log/ceph/ceph-client.admin.152163.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147070.log.gz 2023-10-03T10:23:32.428 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.152163.log.gz 2023-10-03T10:23:32.428 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175696.log 2023-10-03T10:23:32.428 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157230.log 2023-10-03T10:23:32.428 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.175696.log: /var/log/ceph/ceph-client.admin.157230.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.175696.log.gz 2023-10-03T10:23:32.428 INFO:teuthology.orchestra.run.smithi072.stderr:gzip 87.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.157230.log.gz--verbose 2023-10-03T10:23:32.428 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.187255.log 2023-10-03T10:23:32.429 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129350.log 2023-10-03T10:23:32.429 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.187255.log: /var/log/ceph/ceph-client.admin.129350.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.187255.log.gz 2023-10-03T10:23:32.429 INFO:teuthology.orchestra.run.smithi072.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.129350.log.gz 2023-10-03T10:23:32.429 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145045.log 2023-10-03T10:23:32.429 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168851.log 2023-10-03T10:23:32.429 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.145045.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145045.log.gz 2023-10-03T10:23:32.429 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.168851.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168851.log.gz 2023-10-03T10:23:32.429 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177850.log 2023-10-03T10:23:32.430 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.177850.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177850.log.gz 2023-10-03T10:23:32.434 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-03T10:23:32.435 INFO:teuthology.orchestra.run.smithi072.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-03T10:23:32.493 INFO:teuthology.orchestra.run.smithi072.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-03T10:23:32.650 INFO:teuthology.orchestra.run.smithi072.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-03T10:23:32.746 INFO:teuthology.orchestra.run.smithi072.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-03T10:23:32.748 INFO:teuthology.orchestra.run.smithi072.stderr: 2023-10-03T10:23:32.748 INFO:teuthology.orchestra.run.smithi072.stderr:real 0m1.041s 2023-10-03T10:23:32.748 INFO:teuthology.orchestra.run.smithi072.stderr:user 0m3.856s 2023-10-03T10:23:32.748 INFO:teuthology.orchestra.run.smithi072.stderr:sys 0m0.799s 2023-10-03T10:23:32.748 INFO:tasks.ceph:Archiving logs... 2023-10-03T10:23:32.749 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573/remote/smithi072/log 2023-10-03T10:23:32.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-03T10:23:34.339 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573/remote/smithi119/log 2023-10-03T10:23:34.340 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-03T10:23:34.380 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:23:34.390 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-03T10:23:34.415 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:23:34.419 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-03T10:23:34.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-03T10:23:34.424 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-03T10:23:34.543 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-03T10:23:34.554 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-03T10:23:34.555 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:23:34.557 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:23:34.574 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2023-10-03T10:23:34.576 INFO:teuthology.orchestra.run.smithi119.stderr:bash: ntpq: command not found 2023-10-03T10:23:34.578 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:23:34.578 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-10-03T10:23:34.579 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 28 +624us[ +633us] +/- 72ms 2023-10-03T10:23:34.579 INFO:teuthology.orchestra.run.smithi072.stdout:^* hv02.front.sepia.ceph.com 3 6 377 27 -182us[ -174us] +/- 59ms 2023-10-03T10:23:34.579 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 -321us[ -313us] +/- 80ms 2023-10-03T10:23:34.579 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:23:34.580 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:23:34.580 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2023-10-03T10:23:34.581 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 28 +609us[ +615us] +/- 72ms 2023-10-03T10:23:34.581 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv02.front.sepia.ceph.com 3 6 377 28 -210us[ -204us] +/- 59ms 2023-10-03T10:23:34.581 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 -340us[ -334us] +/- 80ms 2023-10-03T10:23:34.581 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:23:34.582 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-03T10:23:34.593 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-03T10:23:34.594 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-03T10:23:34.605 DEBUG:teuthology.orchestra.run.smithi072:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-03T10:23:34.670 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-03T10:23:34.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T10:23:34.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:23:34.794 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T10:23:34.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:23:34.827 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-03T10:23:34.838 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-03T10:23:34.849 INFO:teuthology.task.internal:Duration was 1451.730632 seconds 2023-10-03T10:23:34.850 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-03T10:23:34.860 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-03T10:23:34.860 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-03T10:23:34.863 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-03T10:23:34.909 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T10:23:34.914 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T10:23:35.015 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-03T10:23:35.015 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2023-10-03T10:23:35.015 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-03T10:23:35.038 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2023-10-03T10:23:35.038 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-03T10:23:35.059 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-03T10:23:35.060 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T10:23:35.080 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T10:23:35.136 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-03T10:23:35.137 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:23:35.139 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:23:35.239 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-03T10:23:35.252 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-03T10:23:35.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-03T10:23:35.279 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-03T10:23:35.306 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-03T10:23:35.318 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:23:35.321 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:23:35.345 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2023-10-03T10:23:35.373 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2023-10-03T10:23:35.386 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:23:35.428 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi072.front.sepia.ceph.com, flagging run as failed 2023-10-03T10:23:35.428 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:23:35.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:23:35.445 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-03T10:23:35.457 INFO:teuthology.task.internal:Transferring archived files... 2023-10-03T10:23:35.457 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573/remote/smithi072 2023-10-03T10:23:35.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-03T10:25:03.787 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-10-03T10:25:03.797 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573/remote/smithi072/coredump/1696327949.126756.core.gz: gzip compressed data, was "1696327949.126756.core", last modified: Tue Oct 3 10:23:35 2023, max compression, original size modulo 2^32 1365295104 2023-10-03T10:25:03.798 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-10-03T10:25:09.553 INFO:teuthology.task.internal: core looks like: /tmp/tmpc4lmkfn1: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mgr -f --cluster ceph -i x', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mgr', platform: 'x86_64' 2023-10-03T10:25:09.689 INFO:teuthology.task.internal: dump_program: ceph-mgr -f --cluster ceph -i x 2023-10-03T10:25:09.690 DEBUG:teuthology.orchestra.run.smithi072:> which 'ceph-mgr -f --cluster ceph -i x' 2023-10-03T10:25:09.712 INFO:teuthology.orchestra.run.smithi072.stderr:/usr/bin/which: invalid option -- 'f' 2023-10-03T10:25:09.713 INFO:teuthology.orchestra.run.smithi072.stderr:/usr/bin/which: unrecognized option '--cluster' 2023-10-03T10:25:09.713 INFO:teuthology.orchestra.run.smithi072.stderr:/usr/bin/which: no x in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2023-10-03T10:25:09.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:25:09.714 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph-mgr 2023-10-03T10:25:09.714 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/ceph 2023-10-03T10:25:09.715 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 1: "which 'ceph-mgr -f --cluster ceph -i x'" 2023-10-03T10:25:09.731 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-03T10:25:09.790 INFO:teuthology.task.internal:Not uploading archives. 2023-10-03T10:25:09.790 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-03T10:25:09.802 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-03T10:25:09.802 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-03T10:25:09.817 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-03T10:25:09.830 INFO:teuthology.orchestra.run.smithi072.stdout: 525563 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest 2023-10-03T10:25:09.830 INFO:teuthology.orchestra.run.smithi072.stdout: 525587 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive 2023-10-03T10:25:09.830 INFO:teuthology.orchestra.run.smithi072.stdout: 525609 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 10:12 /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:25:09.830 INFO:teuthology.orchestra.run.smithi072.stdout: 525595 361628 -rw------- 1 root root 1365295104 Oct 3 10:12 /home/ubuntu/cephtest/archive/coredump/1696327949.126756.core 2023-10-03T10:25:09.830 INFO:teuthology.orchestra.run.smithi072.stdout: 655784 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive/audit 2023-10-03T10:25:09.831 INFO:teuthology.orchestra.run.smithi072.stdout: 655822 28 -rw------- 1 ubuntu ubuntu 25478 Oct 3 10:23 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-10-03T10:25:09.831 INFO:teuthology.orchestra.run.smithi072.stdout: 525621 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog 2023-10-03T10:25:09.831 INFO:teuthology.orchestra.run.smithi072.stdout: 525476 4 -rw-rw-rw- 1 ubuntu ubuntu 765 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-10-03T10:25:09.831 INFO:teuthology.orchestra.run.smithi072.stdout: 525521 112 -rw-rw-r-- 1 ubuntu ubuntu 113392 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:25:09.831 INFO:teuthology.orchestra.run.smithi072.stdout: 525477 132 -rw-rw-rw- 1 ubuntu ubuntu 135102 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-10-03T10:25:09.832 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:25:09.833 INFO:teuthology.orchestra.run.smithi072.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-03T10:25:09.833 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-03T10:25:09.846 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-03T10:25:09.859 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-03T10:25:09.872 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi072 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:25:09.872 INFO:teuthology.nuke:Checking targets against current locks 2023-10-03T10:25:09.879 INFO:teuthology.orchestra.run.smithi119.stdout: 525357 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest 2023-10-03T10:25:09.879 INFO:teuthology.orchestra.run.smithi119.stdout: 525358 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive 2023-10-03T10:25:09.879 INFO:teuthology.orchestra.run.smithi119.stdout: 655785 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive/audit 2023-10-03T10:25:09.879 INFO:teuthology.orchestra.run.smithi119.stdout: 655787 220 -rw------- 1 ubuntu ubuntu 223500 Oct 3 10:23 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-10-03T10:25:09.879 INFO:teuthology.orchestra.run.smithi119.stdout: 525360 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog 2023-10-03T10:25:09.880 INFO:teuthology.orchestra.run.smithi119.stdout: 525485 4 -rw-rw-rw- 1 ubuntu ubuntu 884 Oct 3 10:21 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-10-03T10:25:09.880 INFO:teuthology.orchestra.run.smithi119.stdout: 525362 92 -rw-rw-r-- 1 ubuntu ubuntu 92463 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:25:09.880 INFO:teuthology.orchestra.run.smithi119.stdout: 525361 88 -rw-rw-rw- 1 ubuntu ubuntu 86658 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-10-03T10:25:09.881 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-03T10:25:09.903 DEBUG:teuthology.nuke:shortname: smithi072 2023-10-03T10:25:09.903 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T10:25:09.925 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:48.262884', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPfP9tnAMamE3Fl+b+77jHnwhMvEsyPJvhQeBm52/HeWDw4zKhS1nLPe+WvZ1BCeHtrP1rMdwfUOTRQ3u1vcOcM='} 2023-10-03T10:25:09.929 DEBUG:teuthology.nuke:shortname: smithi119 2023-10-03T10:25:09.929 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T10:25:09.951 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409573', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:48.264213', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDdUQPzKTAiEAIAiiGvKrXKFTcQUH0/kbWZc2nUWH5/yuUO5D4vM9P02dkNXCqv3QvnHP5kU5YSVicX3N1foee8='} 2023-10-03T10:25:09.984 INFO:teuthology.orchestra.console.smithi072:Power off 2023-10-03T10:25:09.984 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T10:25:10.007 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-10-03T10:25:10.007 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:10.021 INFO:teuthology.orchestra.console.smithi119:Power off 2023-10-03T10:25:10.022 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T10:25:10.032 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-03T10:25:10.043 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2023-10-03T10:25:10.043 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:10.065 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-10-03T10:25:14.034 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:14.066 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:14.144 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-03T10:25:14.175 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-10-03T10:25:18.148 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:18.176 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:25:18.258 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-03T10:25:18.285 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-10-03T10:25:18.359 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-10-03T10:25:18.386 INFO:teuthology.orchestra.console.smithi119:Power off completed 2023-10-03T10:25:18.491 INFO:teuthology.run:Summary data: description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}} duration: 1451.730631828308 failure_reason: 'Command failed on smithi072 with status 124: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json''' flavor: default owner: scheduled_dparmar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=81e94f0751c045238401bb4f3fbbe8a2 status: fail success: false 2023-10-03T10:25:18.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T10:25:18.568 INFO:teuthology.run:FAIL